2023-07-14T12:11:52.177 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T12:11:52.178 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} --name rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi --owner scheduled_rishabh@teuthology --verbose --archive /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451 -- /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451/orig.config.yaml 2023-07-14T12:11:52.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T12:11:52.361 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451 branch: wip-rishabh-2023Jul13 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} email: null first_in_suite: false job_id: '7337451' kernel: flavor: default kdb: true sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023Jul13 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul13 sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi131.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi135.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 500 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: aa6a80e6cc655fff48452a7eca02070e61d074fc timestamp: 2023-07-14_10:26:42 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-14T12:11:52.362 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa; will attempt to use it 2023-07-14T12:11:52.362 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks 2023-07-14T12:11:52.363 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-14T12:11:52.364 INFO:teuthology.task.internal:Checking packages... 2023-07-14T12:11:52.393 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '3fc0089cc1082313a98853d48b892acdc1385b8b' 2023-07-14T12:11:52.393 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-14T12:11:52.393 INFO:teuthology.packaging:ref: None 2023-07-14T12:11:52.394 INFO:teuthology.packaging:tag: None 2023-07-14T12:11:52.394 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul13 2023-07-14T12:11:52.394 INFO:teuthology.packaging:sha1: 3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:11:52.394 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Jul13 2023-07-14T12:11:52.957 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4757.g3fc0089c 2023-07-14T12:11:52.957 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-14T12:11:52.965 INFO:teuthology.task.internal:no buildpackages task found 2023-07-14T12:11:52.965 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-14T12:11:52.977 INFO:teuthology.task.internal:Saving configuration 2023-07-14T12:11:52.999 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-14T12:11:53.005 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T12:11:53.035 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 12:06:56.489207', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-14T12:11:53.060 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 12:06:56.490547', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-14T12:11:53.085 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 12:06:56.486966', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-14T12:11:53.085 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-14T12:11:53.095 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-07-14T12:11:53.095 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-07-14T12:11:53.095 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-07-14T12:11:53.095 INFO:teuthology.run_tasks:Running task console_log... 2023-07-14T12:11:53.225 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa98be0c5e0>, signals=[15]) 2023-07-14T12:11:53.226 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-14T12:11:53.236 INFO:teuthology.task.internal:Opening connections... 2023-07-14T12:11:53.236 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2023-07-14T12:11:53.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:11:53.309 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2023-07-14T12:11:53.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:11:53.383 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2023-07-14T12:11:53.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:11:53.454 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-14T12:11:53.461 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-07-14T12:11:53.484 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-07-14T12:11:53.484 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-07-14T12:11:53.545 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T12:11:53.546 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T12:11:53.546 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-07-14T12:11:53.546 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-07-14T12:11:53.547 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.6" 2023-07-14T12:11:53.547 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-07-14T12:11:53.547 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T12:11:53.547 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-07-14T12:11:53.548 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T12:11:53.548 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T12:11:53.548 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T12:11:53.549 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T12:11:53.549 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:11:53.549 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T12:11:53.550 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T12:11:53.550 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T12:11:53.550 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T12:11:53.551 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-07-14T12:11:53.580 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-07-14T12:11:53.601 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-07-14T12:11:53.601 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-07-14T12:11:53.660 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T12:11:53.660 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T12:11:53.661 INFO:teuthology.orchestra.run.smithi131.stdout:ID="rhel" 2023-07-14T12:11:53.661 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="fedora" 2023-07-14T12:11:53.661 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8.6" 2023-07-14T12:11:53.661 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2023-07-14T12:11:53.661 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T12:11:53.661 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-07-14T12:11:53.661 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T12:11:53.662 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T12:11:53.662 INFO:teuthology.orchestra.run.smithi131.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T12:11:53.662 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T12:11:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:11:53.662 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T12:11:53.662 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T12:11:53.662 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T12:11:53.662 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T12:11:53.663 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-07-14T12:11:53.688 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-07-14T12:11:53.712 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-07-14T12:11:53.713 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-07-14T12:11:53.775 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T12:11:53.776 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T12:11:53.776 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-07-14T12:11:53.776 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-07-14T12:11:53.777 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2023-07-14T12:11:53.777 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-07-14T12:11:53.777 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T12:11:53.777 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-07-14T12:11:53.778 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T12:11:53.778 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T12:11:53.778 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T12:11:53.779 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T12:11:53.779 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:11:53.779 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T12:11:53.779 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T12:11:53.780 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T12:11:53.780 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T12:11:53.781 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-07-14T12:11:53.804 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-14T12:11:53.819 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-14T12:11:53.827 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-14T12:11:53.827 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2023-07-14T12:11:53.830 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2023-07-14T12:11:53.832 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2023-07-14T12:11:53.850 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-14T12:11:53.904 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-14T12:11:53.904 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2023-07-14T12:11:53.907 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2023-07-14T12:11:53.909 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2023-07-14T12:11:53.967 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-14T12:11:54.051 INFO:teuthology.run_tasks:Running task kernel... 2023-07-14T12:11:54.075 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'} 2023-07-14T12:11:54.076 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'a440c79eee0258ae07e4988d8690fe6187b8b7a3'}}, timeout 300 2023-07-14T12:11:54.076 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T12:11:54.077 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T12:11:54.078 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T12:11:54.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:11:54.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:11:54.099 DEBUG:teuthology.task.kernel:sha1 for mon.c is a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:11:54.099 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "a440c79eee0258ae07e4988d8690fe6187b8b7a3"... 2023-07-14T12:11:54.099 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-07-14T12:11:54.100 DEBUG:teuthology.task.kernel:sha1 for mon.b is a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:11:54.100 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "a440c79eee0258ae07e4988d8690fe6187b8b7a3"... 2023-07-14T12:11:54.101 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2023-07-14T12:11:54.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:11:54.103 DEBUG:teuthology.task.kernel:sha1 for mon.a is a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:11:54.103 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "a440c79eee0258ae07e4988d8690fe6187b8b7a3"... 2023-07-14T12:11:54.104 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2023-07-14T12:11:54.159 INFO:teuthology.orchestra.run.smithi131.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-14T12:11:54.159 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:11:54.160 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-14T12:11:54.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:11:54.164 INFO:teuthology.orchestra.run.smithi017.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-14T12:11:54.164 INFO:teuthology.orchestra.run.smithi135.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-14T12:11:54.165 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:11:54.165 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-14T12:11:54.165 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:11:54.166 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:11:54.167 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-14T12:11:54.167 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:11:54.571 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum upgrade -y linux-firmware 2023-07-14T12:11:54.574 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum upgrade -y linux-firmware 2023-07-14T12:11:54.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum upgrade -y linux-firmware 2023-07-14T12:11:55.694 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-07-14T12:11:55.695 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2023-07-14T12:11:55.727 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-07-14T12:11:55.728 INFO:teuthology.orchestra.run.smithi131.stdout:Unable to read consumer identity 2023-07-14T12:11:55.773 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-07-14T12:11:55.774 INFO:teuthology.orchestra.run.smithi017.stdout:Unable to read consumer identity 2023-07-14T12:11:57.221 INFO:teuthology.orchestra.run.smithi131.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-07-14T12:11:57.225 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-07-14T12:11:57.234 INFO:teuthology.orchestra.run.smithi017.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-07-14T12:12:28.844 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 505 kB/s | 16 MB 00:31 2023-07-14T12:12:32.356 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 223 kB/s | 24 kB 00:00 2023-07-14T12:12:33.088 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-07-14T12:12:33.089 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2023-07-14T12:12:33.089 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-07-14T12:12:33.270 INFO:teuthology.task.kernel:Downloading kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on mon.b... 2023-07-14T12:12:33.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:12:33.899 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ 2023-07-14T12:12:33.899 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-14T12:12:33.901 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi131.front.sepia.ceph.com to complete... 2023-07-14T12:12:41.582 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 360 kB/s | 16 MB 00:44 2023-07-14T12:12:42.297 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 355 kB/s | 16 MB 00:45 2023-07-14T12:12:45.157 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 665 kB/s | 24 kB 00:00 2023-07-14T12:12:45.864 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 169 kB/s | 24 kB 00:00 2023-07-14T12:12:45.900 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-07-14T12:12:45.901 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2023-07-14T12:12:45.901 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-07-14T12:12:46.015 INFO:teuthology.task.kernel:Downloading kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on mon.a... 2023-07-14T12:12:46.016 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:12:46.377 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ 2023-07-14T12:12:46.377 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-14T12:12:46.380 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi017.front.sepia.ceph.com to complete... 2023-07-14T12:12:46.611 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-07-14T12:12:46.612 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2023-07-14T12:12:46.612 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-07-14T12:12:46.758 INFO:teuthology.task.kernel:Downloading kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on mon.c... 2023-07-14T12:12:46.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a440c79eee0258ae07e4988d8690fe6187b8b7a3 2023-07-14T12:12:47.118 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ 2023-07-14T12:12:47.118 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-14T12:12:47.120 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi135.front.sepia.ceph.com to complete... 2023-07-14T12:24:01.501 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14 12:24:01 URL:https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm [380684764/380684764] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-14T12:24:01.501 INFO:teuthology.orchestra.run.smithi135.stderr:FINISHED --2023-07-14 12:24:01-- 2023-07-14T12:24:01.502 INFO:teuthology.orchestra.run.smithi135.stderr:Total wall clock time: 11m 14s 2023-07-14T12:24:01.502 INFO:teuthology.orchestra.run.smithi135.stderr:Downloaded: 1 files, 363M in 11m 14s (552 KB/s) 2023-07-14T12:24:01.503 INFO:teuthology.task.kernel:Installing kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on mon.c... 2023-07-14T12:24:01.503 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-14T12:24:03.118 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying... ######################################## 2023-07-14T12:24:03.189 INFO:teuthology.orchestra.run.smithi135.stdout:Preparing... ######################################## 2023-07-14T12:24:03.273 INFO:teuthology.orchestra.run.smithi135.stdout:Updating / installing... 2023-07-14T12:24:09.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14 12:24:09 URL:https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm [380684764/380684764] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-14T12:24:09.896 INFO:teuthology.orchestra.run.smithi017.stderr:FINISHED --2023-07-14 12:24:09-- 2023-07-14T12:24:09.896 INFO:teuthology.orchestra.run.smithi017.stderr:Total wall clock time: 11m 23s 2023-07-14T12:24:09.896 INFO:teuthology.orchestra.run.smithi017.stderr:Downloaded: 1 files, 363M in 11m 23s (544 KB/s) 2023-07-14T12:24:09.897 INFO:teuthology.task.kernel:Installing kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on mon.a... 2023-07-14T12:24:09.897 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-14T12:24:11.576 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying... ######################################## 2023-07-14T12:24:11.625 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14 12:24:11 URL:https://2.chacra.ceph.com/r/kernel/testing/a440c79eee0258ae07e4988d8690fe6187b8b7a3/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_ga440c79eee02-1.x86_64.rpm [380684764/380684764] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-14T12:24:11.626 INFO:teuthology.orchestra.run.smithi131.stderr:FINISHED --2023-07-14 12:24:11-- 2023-07-14T12:24:11.626 INFO:teuthology.orchestra.run.smithi131.stderr:Total wall clock time: 11m 38s 2023-07-14T12:24:11.626 INFO:teuthology.orchestra.run.smithi131.stderr:Downloaded: 1 files, 363M in 11m 37s (533 KB/s) 2023-07-14T12:24:11.627 INFO:teuthology.task.kernel:Installing kernel a440c79eee0258ae07e4988d8690fe6187b8b7a3 on mon.b... 2023-07-14T12:24:11.627 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-14T12:24:11.636 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing... ######################################## 2023-07-14T12:24:11.725 INFO:teuthology.orchestra.run.smithi017.stdout:Updating / installing... 2023-07-14T12:24:13.257 INFO:teuthology.orchestra.run.smithi131.stdout:Verifying... ######################################## 2023-07-14T12:24:13.328 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing... ######################################## 2023-07-14T12:24:13.418 INFO:teuthology.orchestra.run.smithi131.stdout:Updating / installing... 2023-07-14T12:24:41.182 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-6.5.0_rc1_ga440c79eee02-1 ######################################## 2023-07-14T12:24:51.404 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-6.5.0_rc1_ga440c79eee02-1 ######################################## 2023-07-14T12:24:52.277 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-6.5.0_rc1_ga440c79eee02-1 ######################################## 2023-07-14T12:25:05.436 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-14T12:25:05.437 DEBUG:teuthology.orchestra.run.smithi135:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-14T12:25:05.485 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:05.485 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/config-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:05.485 INFO:teuthology.orchestra.run.smithi135.stdout:/boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:05.485 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:05.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel 2023-07-14T12:25:05.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch 2023-07-14T12:25:05.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86 2023-07-14T12:25:05.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto 2023-07-14T12:25:05.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-14T12:25:05.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-14T12:25:05.486 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-14T12:25:05.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-14T12:25:05.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-14T12:25:05.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-14T12:25:05.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-14T12:25:05.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-14T12:25:05.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-14T12:25:05.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-14T12:25:05.487 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-14T12:25:05.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-14T12:25:05.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-14T12:25:05.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-14T12:25:05.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-14T12:25:05.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-14T12:25:05.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-14T12:25:05.488 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-14T12:25:05.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-14T12:25:05.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-14T12:25:05.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel 2023-07-14T12:25:05.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu 2023-07-14T12:25:05.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce 2023-07-14T12:25:05.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-14T12:25:05.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm 2023-07-14T12:25:05.489 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-14T12:25:05.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-14T12:25:05.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm.ko 2023-07-14T12:25:05.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto 2023-07-14T12:25:05.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ansi_cprng.ko 2023-07-14T12:25:05.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/anubis.ko 2023-07-14T12:25:05.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/arc4.ko 2023-07-14T12:25:05.490 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx 2023-07-14T12:25:05.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_memcpy.ko 2023-07-14T12:25:05.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_pq.ko 2023-07-14T12:25:05.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-14T12:25:05.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_tx.ko 2023-07-14T12:25:05.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_xor.ko 2023-07-14T12:25:05.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/raid6test.ko 2023-07-14T12:25:05.491 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authenc.ko 2023-07-14T12:25:05.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authencesn.ko 2023-07-14T12:25:05.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blake2b_generic.ko 2023-07-14T12:25:05.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_common.ko 2023-07-14T12:25:05.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_generic.ko 2023-07-14T12:25:05.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/camellia_generic.ko 2023-07-14T12:25:05.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast5_generic.ko 2023-07-14T12:25:05.492 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast6_generic.ko 2023-07-14T12:25:05.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast_common.ko 2023-07-14T12:25:05.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ccm.ko 2023-07-14T12:25:05.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cmac.ko 2023-07-14T12:25:05.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crc32_generic.ko 2023-07-14T12:25:05.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_engine.ko 2023-07-14T12:25:05.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_user.ko 2023-07-14T12:25:05.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cts.ko 2023-07-14T12:25:05.493 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/des_generic.ko 2023-07-14T12:25:05.494 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/dh_generic.ko 2023-07-14T12:25:05.494 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/echainiv.ko 2023-07-14T12:25:05.494 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/essiv.ko 2023-07-14T12:25:05.494 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/fcrypt.ko 2023-07-14T12:25:05.494 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/khazad.ko 2023-07-14T12:25:05.494 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4.ko 2023-07-14T12:25:05.494 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4hc.ko 2023-07-14T12:25:05.495 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/md4.ko 2023-07-14T12:25:05.495 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/michael_mic.ko 2023-07-14T12:25:05.495 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcbc.ko 2023-07-14T12:25:05.495 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcrypt.ko 2023-07-14T12:25:05.495 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/rmd160.ko 2023-07-14T12:25:05.495 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/seed.ko 2023-07-14T12:25:05.495 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/serpent_generic.ko 2023-07-14T12:25:05.495 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tcrypt.ko 2023-07-14T12:25:05.496 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tea.ko 2023-07-14T12:25:05.496 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_common.ko 2023-07-14T12:25:05.496 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_generic.ko 2023-07-14T12:25:05.496 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/vmac.ko 2023-07-14T12:25:05.496 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/wp512.ko 2023-07-14T12:25:05.496 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xcbc.ko 2023-07-14T12:25:05.496 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xor.ko 2023-07-14T12:25:05.497 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xxhash_generic.ko 2023-07-14T12:25:05.497 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers 2023-07-14T12:25:05.497 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi 2023-07-14T12:25:05.497 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-14T12:25:05.497 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_pad.ko 2023-07-14T12:25:05.497 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/custom_method.ko 2023-07-14T12:25:05.497 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ec_sys.ko 2023-07-14T12:25:05.497 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/platform_profile.ko 2023-07-14T12:25:05.498 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbs.ko 2023-07-14T12:25:05.498 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbshc.ko 2023-07-14T12:25:05.498 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/video.ko 2023-07-14T12:25:05.498 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata 2023-07-14T12:25:05.498 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/acard-ahci.ko 2023-07-14T12:25:05.498 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci_platform.ko 2023-07-14T12:25:05.498 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ata_generic.ko 2023-07-14T12:25:05.499 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci_platform.ko 2023-07-14T12:25:05.499 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_acpi.ko 2023-07-14T12:25:05.499 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ali.ko 2023-07-14T12:25:05.499 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_amd.ko 2023-07-14T12:25:05.499 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_artop.ko 2023-07-14T12:25:05.499 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atiixp.ko 2023-07-14T12:25:05.499 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atp867x.ko 2023-07-14T12:25:05.499 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd640.ko 2023-07-14T12:25:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd64x.ko 2023-07-14T12:25:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cypress.ko 2023-07-14T12:25:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_efar.ko 2023-07-14T12:25:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt366.ko 2023-07-14T12:25:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt37x.ko 2023-07-14T12:25:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-14T12:25:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-14T12:25:05.500 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it8213.ko 2023-07-14T12:25:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it821x.ko 2023-07-14T12:25:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_jmicron.ko 2023-07-14T12:25:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_marvell.ko 2023-07-14T12:25:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_mpiix.ko 2023-07-14T12:25:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_netcell.ko 2023-07-14T12:25:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ninja32.ko 2023-07-14T12:25:05.501 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87410.ko 2023-07-14T12:25:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87415.ko 2023-07-14T12:25:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_oldpiix.ko 2023-07-14T12:25:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_opti.ko 2023-07-14T12:25:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_optidma.ko 2023-07-14T12:25:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pcmcia.ko 2023-07-14T12:25:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-14T12:25:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-14T12:25:05.502 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_piccolo.ko 2023-07-14T12:25:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rdc.ko 2023-07-14T12:25:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sch.ko 2023-07-14T12:25:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_serverworks.ko 2023-07-14T12:25:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sil680.ko 2023-07-14T12:25:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sis.ko 2023-07-14T12:25:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sl82c105.ko 2023-07-14T12:25:05.503 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_triflex.ko 2023-07-14T12:25:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_via.ko 2023-07-14T12:25:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pdc_adma.ko 2023-07-14T12:25:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_inic162x.ko 2023-07-14T12:25:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_mv.ko 2023-07-14T12:25:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_nv.ko 2023-07-14T12:25:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_promise.ko 2023-07-14T12:25:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_qstor.ko 2023-07-14T12:25:05.504 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil.ko 2023-07-14T12:25:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil24.ko 2023-07-14T12:25:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sis.ko 2023-07-14T12:25:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_svw.ko 2023-07-14T12:25:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sx4.ko 2023-07-14T12:25:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_uli.ko 2023-07-14T12:25:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_via.ko 2023-07-14T12:25:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_vsc.ko 2023-07-14T12:25:05.505 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay 2023-07-14T12:25:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ks0108.ko 2023-07-14T12:25:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base 2023-07-14T12:25:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap 2023-07-14T12:25:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-14T12:25:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-14T12:25:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma 2023-07-14T12:25:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/bcma.ko 2023-07-14T12:25:05.506 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block 2023-07-14T12:25:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe 2023-07-14T12:25:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/aoe.ko 2023-07-14T12:25:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/brd.ko 2023-07-14T12:25:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd 2023-07-14T12:25:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/drbd.ko 2023-07-14T12:25:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/floppy.ko 2023-07-14T12:25:05.507 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/loop.ko 2023-07-14T12:25:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx 2023-07-14T12:25:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-14T12:25:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/nbd.ko 2023-07-14T12:25:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk 2023-07-14T12:25:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/null_blk.ko 2023-07-14T12:25:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/pktcdvd.ko 2023-07-14T12:25:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/rbd.ko 2023-07-14T12:25:05.508 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/virtio_blk.ko 2023-07-14T12:25:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback 2023-07-14T12:25:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-14T12:25:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkfront.ko 2023-07-14T12:25:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram 2023-07-14T12:25:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/zram.ko 2023-07-14T12:25:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char 2023-07-14T12:25:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hangcheck-timer.ko 2023-07-14T12:25:05.509 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random 2023-07-14T12:25:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-14T12:25:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-14T12:25:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-14T12:25:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/via-rng.ko 2023-07-14T12:25:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-14T12:25:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi 2023-07-14T12:25:05.510 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-14T12:25:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-14T12:25:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-14T12:25:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-14T12:25:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-14T12:25:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-14T12:25:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/lp.ko 2023-07-14T12:25:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave 2023-07-14T12:25:05.511 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/mwave.ko 2023-07-14T12:25:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ppdev.ko 2023-07-14T12:25:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tlclk.ko 2023-07-14T12:25:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm 2023-07-14T12:25:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm.ko 2023-07-14T12:25:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-14T12:25:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-14T12:25:05.512 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-14T12:25:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-14T12:25:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-14T12:25:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/uv_mmtimer.ko 2023-07-14T12:25:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/virtio_console.ko 2023-07-14T12:25:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq 2023-07-14T12:25:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-14T12:25:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-14T12:25:05.513 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-14T12:25:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-14T12:25:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-14T12:25:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-14T12:25:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto 2023-07-14T12:25:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp 2023-07-14T12:25:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-14T12:25:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp.ko 2023-07-14T12:25:05.514 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel 2023-07-14T12:25:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat 2023-07-14T12:25:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common 2023-07-14T12:25:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-14T12:25:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-14T12:25:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-14T12:25:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-aes.ko 2023-07-14T12:25:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-sha.ko 2023-07-14T12:25:05.515 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio 2023-07-14T12:25:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-14T12:25:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca 2023-07-14T12:25:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/dca.ko 2023-07-14T12:25:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq 2023-07-14T12:25:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-14T12:25:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma 2023-07-14T12:25:05.516 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw 2023-07-14T12:25:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-14T12:25:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat 2023-07-14T12:25:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-14T12:25:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac 2023-07-14T12:25:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/amd64_edac.ko 2023-07-14T12:25:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/e752x_edac.ko 2023-07-14T12:25:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/edac_mce_amd.ko 2023-07-14T12:25:05.517 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3000_edac.ko 2023-07-14T12:25:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3200_edac.ko 2023-07-14T12:25:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5100_edac.ko 2023-07-14T12:25:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5400_edac.ko 2023-07-14T12:25:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7300_edac.ko 2023-07-14T12:25:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7core_edac.ko 2023-07-14T12:25:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i82975x_edac.ko 2023-07-14T12:25:05.518 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ie31200_edac.ko 2023-07-14T12:25:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/sb_edac.ko 2023-07-14T12:25:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/x38_edac.ko 2023-07-14T12:25:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware 2023-07-14T12:25:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/edd.ko 2023-07-14T12:25:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-14T12:25:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio 2023-07-14T12:25:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ich.ko 2023-07-14T12:25:05.519 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-14T12:25:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid 2023-07-14T12:25:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-appleir.ko 2023-07-14T12:25:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-aureal.ko 2023-07-14T12:25:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-axff.ko 2023-07-14T12:25:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-dr.ko 2023-07-14T12:25:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elecom.ko 2023-07-14T12:25:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elo.ko 2023-07-14T12:25:05.520 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-emsff.ko 2023-07-14T12:25:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gaff.ko 2023-07-14T12:25:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gt683r.ko 2023-07-14T12:25:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gyration.ko 2023-07-14T12:25:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-14T12:25:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-14T12:25:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtekff.ko 2023-07-14T12:25:05.521 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-hyperv.ko 2023-07-14T12:25:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-icade.ko 2023-07-14T12:25:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-keytouch.ko 2023-07-14T12:25:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kye.ko 2023-07-14T12:25:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lcpower.ko 2023-07-14T12:25:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-led.ko 2023-07-14T12:25:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lenovo.ko 2023-07-14T12:25:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-14T12:25:05.522 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-14T12:25:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-multitouch.ko 2023-07-14T12:25:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ortek.ko 2023-07-14T12:25:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-penmount.ko 2023-07-14T12:25:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-petalynx.ko 2023-07-14T12:25:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-picolcd.ko 2023-07-14T12:25:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-pl.ko 2023-07-14T12:25:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-plantronics.ko 2023-07-14T12:25:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-primax.ko 2023-07-14T12:25:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-rmi.ko 2023-07-14T12:25:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-14T12:25:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-common.ko 2023-07-14T12:25:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-14T12:25:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-14T12:25:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-14T12:25:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-14T12:25:05.524 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-14T12:25:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-14T12:25:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-14T12:25:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-14T12:25:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-14T12:25:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat.ko 2023-07-14T12:25:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-saitek.ko 2023-07-14T12:25:05.525 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-samsung.ko 2023-07-14T12:25:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-14T12:25:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sjoy.ko 2023-07-14T12:25:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sony.ko 2023-07-14T12:25:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-speedlink.ko 2023-07-14T12:25:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-steelseries.ko 2023-07-14T12:25:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sunplus.ko 2023-07-14T12:25:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-14T12:25:05.526 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tivo.ko 2023-07-14T12:25:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tmff.ko 2023-07-14T12:25:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-topseed.ko 2023-07-14T12:25:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-twinhan.ko 2023-07-14T12:25:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-uclogic.ko 2023-07-14T12:25:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-waltop.ko 2023-07-14T12:25:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-wiimote.ko 2023-07-14T12:25:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-xinmo.ko 2023-07-14T12:25:05.527 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zpff.ko 2023-07-14T12:25:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zydacron.ko 2023-07-14T12:25:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/uhid.ko 2023-07-14T12:25:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/wacom.ko 2023-07-14T12:25:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv 2023-07-14T12:25:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_balloon.ko 2023-07-14T12:25:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_utils.ko 2023-07-14T12:25:05.528 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_vmbus.ko 2023-07-14T12:25:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon 2023-07-14T12:25:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru.ko 2023-07-14T12:25:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru3.ko 2023-07-14T12:25:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-14T12:25:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7414.ko 2023-07-14T12:25:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7418.ko 2023-07-14T12:25:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adc128d818.ko 2023-07-14T12:25:05.529 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1025.ko 2023-07-14T12:25:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1026.ko 2023-07-14T12:25:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1029.ko 2023-07-14T12:25:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1031.ko 2023-07-14T12:25:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm9240.ko 2023-07-14T12:25:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ads7828.ko 2023-07-14T12:25:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7410.ko 2023-07-14T12:25:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7411.ko 2023-07-14T12:25:05.530 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7462.ko 2023-07-14T12:25:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7470.ko 2023-07-14T12:25:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7475.ko 2023-07-14T12:25:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7x10.ko 2023-07-14T12:25:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/amc6821.ko 2023-07-14T12:25:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/applesmc.ko 2023-07-14T12:25:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asb100.ko 2023-07-14T12:25:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asc7621.ko 2023-07-14T12:25:05.531 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-14T12:25:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/atxp1.ko 2023-07-14T12:25:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/coretemp.ko 2023-07-14T12:25:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-14T12:25:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dme1737.ko 2023-07-14T12:25:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds1621.ko 2023-07-14T12:25:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds620.ko 2023-07-14T12:25:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc1403.ko 2023-07-14T12:25:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc6w201.ko 2023-07-14T12:25:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71805f.ko 2023-07-14T12:25:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71882fg.ko 2023-07-14T12:25:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f75375s.ko 2023-07-14T12:25:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fam15h_power.ko 2023-07-14T12:25:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fschmd.ko 2023-07-14T12:25:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g760a.ko 2023-07-14T12:25:05.533 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g762.ko 2023-07-14T12:25:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl518sm.ko 2023-07-14T12:25:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl520sm.ko 2023-07-14T12:25:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-14T12:25:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5500_temp.ko 2023-07-14T12:25:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5k_amb.ko 2023-07-14T12:25:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmaem.ko 2023-07-14T12:25:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmpex.ko 2023-07-14T12:25:05.534 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina209.ko 2023-07-14T12:25:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina2xx.ko 2023-07-14T12:25:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/it87.ko 2023-07-14T12:25:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k10temp.ko 2023-07-14T12:25:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k8temp.ko 2023-07-14T12:25:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lineage-pem.ko 2023-07-14T12:25:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm63.ko 2023-07-14T12:25:05.535 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm73.ko 2023-07-14T12:25:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm75.ko 2023-07-14T12:25:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm77.ko 2023-07-14T12:25:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm78.ko 2023-07-14T12:25:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm80.ko 2023-07-14T12:25:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm83.ko 2023-07-14T12:25:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm85.ko 2023-07-14T12:25:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm87.ko 2023-07-14T12:25:05.536 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm90.ko 2023-07-14T12:25:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm92.ko 2023-07-14T12:25:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm93.ko 2023-07-14T12:25:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95234.ko 2023-07-14T12:25:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95241.ko 2023-07-14T12:25:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95245.ko 2023-07-14T12:25:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc2945.ko 2023-07-14T12:25:05.537 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4151.ko 2023-07-14T12:25:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4215.ko 2023-07-14T12:25:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4222.ko 2023-07-14T12:25:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4245.ko 2023-07-14T12:25:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4260.ko 2023-07-14T12:25:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4261.ko 2023-07-14T12:25:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max16065.ko 2023-07-14T12:25:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1619.ko 2023-07-14T12:25:05.538 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1668.ko 2023-07-14T12:25:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max197.ko 2023-07-14T12:25:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6639.ko 2023-07-14T12:25:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6650.ko 2023-07-14T12:25:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6697.ko 2023-07-14T12:25:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mcp3021.ko 2023-07-14T12:25:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6683.ko 2023-07-14T12:25:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775-core.ko 2023-07-14T12:25:05.539 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775.ko 2023-07-14T12:25:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct7802.ko 2023-07-14T12:25:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87360.ko 2023-07-14T12:25:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87427.ko 2023-07-14T12:25:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pcf8591.ko 2023-07-14T12:25:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus 2023-07-14T12:25:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-14T12:25:05.540 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-14T12:25:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-14T12:25:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-14T12:25:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-14T12:25:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-14T12:25:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-14T12:25:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-14T12:25:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-14T12:25:05.541 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-14T12:25:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-14T12:25:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-14T12:25:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/powr1220.ko 2023-07-14T12:25:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5627.ko 2023-07-14T12:25:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5636.ko 2023-07-14T12:25:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-14T12:25:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht15.ko 2023-07-14T12:25:05.542 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht21.ko 2023-07-14T12:25:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/shtc1.ko 2023-07-14T12:25:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sis5595.ko 2023-07-14T12:25:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47b397.ko 2023-07-14T12:25:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m1.ko 2023-07-14T12:25:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m192.ko 2023-07-14T12:25:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/thmc50.ko 2023-07-14T12:25:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp102.ko 2023-07-14T12:25:05.543 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp103.ko 2023-07-14T12:25:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp401.ko 2023-07-14T12:25:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp421.ko 2023-07-14T12:25:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via-cputemp.ko 2023-07-14T12:25:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via686a.ko 2023-07-14T12:25:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt1211.ko 2023-07-14T12:25:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt8231.ko 2023-07-14T12:25:05.544 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627ehf.ko 2023-07-14T12:25:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627hf.ko 2023-07-14T12:25:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83781d.ko 2023-07-14T12:25:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83791d.ko 2023-07-14T12:25:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83792d.ko 2023-07-14T12:25:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83793.ko 2023-07-14T12:25:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83795.ko 2023-07-14T12:25:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l785ts.ko 2023-07-14T12:25:05.545 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l786ng.ko 2023-07-14T12:25:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c 2023-07-14T12:25:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos 2023-07-14T12:25:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-14T12:25:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-14T12:25:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses 2023-07-14T12:25:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-14T12:25:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-14T12:25:05.546 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-14T12:25:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-14T12:25:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-14T12:25:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-14T12:25:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-14T12:25:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-14T12:25:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-14T12:25:05.547 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-14T12:25:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-14T12:25:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-14T12:25:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-14T12:25:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-14T12:25:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-14T12:25:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-14T12:25:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-14T12:25:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-14T12:25:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-14T12:25:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-14T12:25:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-14T12:25:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-14T12:25:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-14T12:25:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-dev.ko 2023-07-14T12:25:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-mux.ko 2023-07-14T12:25:05.549 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-14T12:25:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-smbus.ko 2023-07-14T12:25:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-stub.ko 2023-07-14T12:25:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband 2023-07-14T12:25:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core 2023-07-14T12:25:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-14T12:25:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_core.ko 2023-07-14T12:25:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-14T12:25:05.550 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-14T12:25:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-14T12:25:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-14T12:25:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-14T12:25:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw 2023-07-14T12:25:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4 2023-07-14T12:25:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-14T12:25:05.551 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4 2023-07-14T12:25:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-14T12:25:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5 2023-07-14T12:25:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-14T12:25:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca 2023-07-14T12:25:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-14T12:25:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp 2023-07-14T12:25:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib 2023-07-14T12:25:05.552 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-14T12:25:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser 2023-07-14T12:25:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-14T12:25:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert 2023-07-14T12:25:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-14T12:25:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp 2023-07-14T12:25:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-14T12:25:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt 2023-07-14T12:25:05.553 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-14T12:25:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input 2023-07-14T12:25:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport 2023-07-14T12:25:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-14T12:25:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-14T12:25:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/gameport.ko 2023-07-14T12:25:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/lightning.ko 2023-07-14T12:25:05.554 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ns558.ko 2023-07-14T12:25:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/joydev.ko 2023-07-14T12:25:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard 2023-07-14T12:25:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-14T12:25:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse 2023-07-14T12:25:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/appletouch.ko 2023-07-14T12:25:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/bcm5974.ko 2023-07-14T12:25:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/cyapatp.ko 2023-07-14T12:25:05.555 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-14T12:25:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/sermouse.ko 2023-07-14T12:25:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-14T12:25:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-14T12:25:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-14T12:25:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4 2023-07-14T12:25:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-14T12:25:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio 2023-07-14T12:25:05.556 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/altera_ps2.ko 2023-07-14T12:25:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/arc_ps2.ko 2023-07-14T12:25:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-14T12:25:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serio_raw.ko 2023-07-14T12:25:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/sparse-keymap.ko 2023-07-14T12:25:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu 2023-07-14T12:25:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd 2023-07-14T12:25:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-14T12:25:05.557 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds 2023-07-14T12:25:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-blinkm.ko 2023-07-14T12:25:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3530.ko 2023-07-14T12:25:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp3944.ko 2023-07-14T12:25:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-ss4200.ko 2023-07-14T12:25:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger 2023-07-14T12:25:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-14T12:25:05.558 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-14T12:25:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-14T12:25:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-14T12:25:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-14T12:25:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-14T12:25:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-14T12:25:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-14T12:25:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md 2023-07-14T12:25:05.559 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache 2023-07-14T12:25:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/bcache.ko 2023-07-14T12:25:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bio-prison.ko 2023-07-14T12:25:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache-smq.ko 2023-07-14T12:25:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache.ko 2023-07-14T12:25:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-crypt.ko 2023-07-14T12:25:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-delay.ko 2023-07-14T12:25:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-flakey.ko 2023-07-14T12:25:05.560 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log-userspace.ko 2023-07-14T12:25:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-multipath.ko 2023-07-14T12:25:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-queue-length.ko 2023-07-14T12:25:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-raid.ko 2023-07-14T12:25:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-round-robin.ko 2023-07-14T12:25:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-service-time.ko 2023-07-14T12:25:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-switch.ko 2023-07-14T12:25:05.561 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-thin-pool.ko 2023-07-14T12:25:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-verity.ko 2023-07-14T12:25:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/faulty.ko 2023-07-14T12:25:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/linear.ko 2023-07-14T12:25:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/multipath.ko 2023-07-14T12:25:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data 2023-07-14T12:25:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-14T12:25:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid0.ko 2023-07-14T12:25:05.562 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid1.ko 2023-07-14T12:25:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid10.ko 2023-07-14T12:25:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid456.ko 2023-07-14T12:25:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message 2023-07-14T12:25:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion 2023-07-14T12:25:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptbase.ko 2023-07-14T12:25:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptctl.ko 2023-07-14T12:25:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptfc.ko 2023-07-14T12:25:05.563 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptlan.ko 2023-07-14T12:25:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptsas.ko 2023-07-14T12:25:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptscsih.ko 2023-07-14T12:25:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptspi.ko 2023-07-14T12:25:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd 2023-07-14T12:25:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_ich.ko 2023-07-14T12:25:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_sch.ko 2023-07-14T12:25:05.564 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mfd-core.ko 2023-07-14T12:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/sm501.ko 2023-07-14T12:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/viperboard.ko 2023-07-14T12:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/vx855.ko 2023-07-14T12:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wl1273-core.ko 2023-07-14T12:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc 2023-07-14T12:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl 2023-07-14T12:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-14T12:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds9802als.ko 2023-07-14T12:25:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds990x.ko 2023-07-14T12:25:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/bh1770glc.ko 2023-07-14T12:25:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710 2023-07-14T12:25:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/cb710.ko 2023-07-14T12:25:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom 2023-07-14T12:25:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/at24.ko 2023-07-14T12:25:05.566 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-14T12:25:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-14T12:25:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/max6875.ko 2023-07-14T12:25:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/enclosure.ko 2023-07-14T12:25:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hpilo.ko 2023-07-14T12:25:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29003.ko 2023-07-14T12:25:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29020.ko 2023-07-14T12:25:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d 2023-07-14T12:25:05.567 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-14T12:25:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-14T12:25:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei 2023-07-14T12:25:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-me.ko 2023-07-14T12:25:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-txe.ko 2023-07-14T12:25:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei.ko 2023-07-14T12:25:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru 2023-07-14T12:25:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-14T12:25:05.568 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp 2023-07-14T12:25:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-14T12:25:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-14T12:25:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-14T12:25:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_7xx1.ko 2023-07-14T12:25:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_core.ko 2023-07-14T12:25:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tsl2550.ko 2023-07-14T12:25:05.569 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_balloon.ko 2023-07-14T12:25:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci 2023-07-14T12:25:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-14T12:25:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net 2023-07-14T12:25:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding 2023-07-14T12:25:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/bonding.ko 2023-07-14T12:25:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa 2023-07-14T12:25:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53 2023-07-14T12:25:05.570 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-14T12:25:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-14T12:25:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-14T12:25:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx 2023-07-14T12:25:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-14T12:25:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dummy.ko 2023-07-14T12:25:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/eql.ko 2023-07-14T12:25:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet 2023-07-14T12:25:05.571 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com 2023-07-14T12:25:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-14T12:25:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-14T12:25:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-14T12:25:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-14T12:25:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390 2023-07-14T12:25:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-14T12:25:05.572 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-14T12:25:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-14T12:25:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-14T12:25:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec 2023-07-14T12:25:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-14T12:25:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere 2023-07-14T12:25:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-14T12:25:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon 2023-07-14T12:25:05.573 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-14T12:25:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera 2023-07-14T12:25:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-14T12:25:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd 2023-07-14T12:25:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-14T12:25:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-14T12:25:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-14T12:25:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros 2023-07-14T12:25:05.574 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx 2023-07-14T12:25:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-14T12:25:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-14T12:25:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-14T12:25:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-14T12:25:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-14T12:25:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx 2023-07-14T12:25:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-14T12:25:05.575 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-14T12:25:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom 2023-07-14T12:25:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-14T12:25:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-14T12:25:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-14T12:25:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-14T12:25:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-14T12:25:05.576 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet 2023-07-14T12:25:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-14T12:25:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-14T12:25:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade 2023-07-14T12:25:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna 2023-07-14T12:25:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-14T12:25:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio 2023-07-14T12:25:05.577 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-14T12:25:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-14T12:25:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-14T12:25:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-14T12:25:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-14T12:25:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-14T12:25:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-14T12:25:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-14T12:25:05.578 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-14T12:25:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-14T12:25:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco 2023-07-14T12:25:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic 2023-07-14T12:25:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-14T12:25:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec 2023-07-14T12:25:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip 2023-07-14T12:25:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-14T12:25:05.579 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-14T12:25:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-14T12:25:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-14T12:25:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-14T12:25:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-14T12:25:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink 2023-07-14T12:25:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-14T12:25:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-14T12:25:05.580 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dnet.ko 2023-07-14T12:25:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex 2023-07-14T12:25:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet 2023-07-14T12:25:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-14T12:25:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ethoc.ko 2023-07-14T12:25:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fealnx.ko 2023-07-14T12:25:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel 2023-07-14T12:25:05.581 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-14T12:25:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000 2023-07-14T12:25:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-14T12:25:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e 2023-07-14T12:25:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-14T12:25:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k 2023-07-14T12:25:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-14T12:25:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e 2023-07-14T12:25:05.582 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-14T12:25:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf 2023-07-14T12:25:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-14T12:25:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb 2023-07-14T12:25:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-14T12:25:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf 2023-07-14T12:25:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-14T12:25:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-14T12:25:05.583 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-14T12:25:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-14T12:25:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-14T12:25:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/jme.ko 2023-07-14T12:25:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell 2023-07-14T12:25:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-14T12:25:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-14T12:25:05.584 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-14T12:25:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox 2023-07-14T12:25:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-14T12:25:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-14T12:25:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-14T12:25:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-14T12:25:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-14T12:25:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-14T12:25:05.585 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel 2023-07-14T12:25:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-14T12:25:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom 2023-07-14T12:25:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-14T12:25:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-14T12:25:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi 2023-07-14T12:25:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-14T12:25:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-14T12:25:05.586 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion 2023-07-14T12:25:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-14T12:25:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia 2023-07-14T12:25:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-14T12:25:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines 2023-07-14T12:25:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-14T12:25:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-14T12:25:05.587 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic 2023-07-14T12:25:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-14T12:25:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-14T12:25:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-14T12:25:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-14T12:25:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-14T12:25:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc 2023-07-14T12:25:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-14T12:25:05.588 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek 2023-07-14T12:25:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-14T12:25:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-14T12:25:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-14T12:25:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-14T12:25:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker 2023-07-14T12:25:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-14T12:25:05.589 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc 2023-07-14T12:25:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-14T12:25:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan 2023-07-14T12:25:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-14T12:25:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis 2023-07-14T12:25:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-14T12:25:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-14T12:25:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc 2023-07-14T12:25:05.590 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-14T12:25:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-14T12:25:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-14T12:25:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-14T12:25:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro 2023-07-14T12:25:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-14T12:25:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-14T12:25:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-14T12:25:05.591 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun 2023-07-14T12:25:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-14T12:25:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-14T12:25:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-14T12:25:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-14T12:25:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti 2023-07-14T12:25:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-14T12:25:05.592 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti 2023-07-14T12:25:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-14T12:25:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via 2023-07-14T12:25:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-14T12:25:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-14T12:25:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet 2023-07-14T12:25:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-14T12:25:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-14T12:25:05.593 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom 2023-07-14T12:25:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-14T12:25:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/geneve.ko 2023-07-14T12:25:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv 2023-07-14T12:25:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-14T12:25:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154 2023-07-14T12:25:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-14T12:25:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ifb.ko 2023-07-14T12:25:05.594 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan 2023-07-14T12:25:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-14T12:25:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvlan.ko 2023-07-14T12:25:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvtap.ko 2023-07-14T12:25:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio 2023-07-14T12:25:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio.ko 2023-07-14T12:25:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-14T12:25:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-14T12:25:05.595 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-14T12:25:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mii.ko 2023-07-14T12:25:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/net_failover.ko 2023-07-14T12:25:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/netconsole.ko 2023-07-14T12:25:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/nlmon.ko 2023-07-14T12:25:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs 2023-07-14T12:25:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-14T12:25:05.596 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-14T12:25:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy 2023-07-14T12:25:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/amd.ko 2023-07-14T12:25:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-14T12:25:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-14T12:25:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-14T12:25:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm87xx.ko 2023-07-14T12:25:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/broadcom.ko 2023-07-14T12:25:05.597 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/cicada.ko 2023-07-14T12:25:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/davicom.ko 2023-07-14T12:25:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/dp83640.ko 2023-07-14T12:25:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/et1011c.ko 2023-07-14T12:25:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/icplus.ko 2023-07-14T12:25:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/lxt.ko 2023-07-14T12:25:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/marvell.ko 2023-07-14T12:25:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/micrel.ko 2023-07-14T12:25:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/national.ko 2023-07-14T12:25:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/phylink.ko 2023-07-14T12:25:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/qsemi.ko 2023-07-14T12:25:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/realtek.ko 2023-07-14T12:25:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/smsc.ko 2023-07-14T12:25:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ste10Xp.ko 2023-07-14T12:25:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/vitesse.ko 2023-07-14T12:25:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp 2023-07-14T12:25:05.599 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-14T12:25:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_async.ko 2023-07-14T12:25:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-14T12:25:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-14T12:25:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-14T12:25:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-14T12:25:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppoe.ko 2023-07-14T12:25:05.600 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppox.ko 2023-07-14T12:25:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pptp.ko 2023-07-14T12:25:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip 2023-07-14T12:25:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slhc.ko 2023-07-14T12:25:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slip.ko 2023-07-14T12:25:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sungem_phy.ko 2023-07-14T12:25:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tap.ko 2023-07-14T12:25:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team 2023-07-14T12:25:05.601 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team.ko 2023-07-14T12:25:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-14T12:25:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-14T12:25:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-14T12:25:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_random.ko 2023-07-14T12:25:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-14T12:25:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tun.ko 2023-07-14T12:25:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/veth.ko 2023-07-14T12:25:05.602 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/virtio_net.ko 2023-07-14T12:25:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3 2023-07-14T12:25:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-14T12:25:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan 2023-07-14T12:25:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/vxlan.ko 2023-07-14T12:25:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback 2023-07-14T12:25:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-14T12:25:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netfront.ko 2023-07-14T12:25:05.603 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb 2023-07-14T12:25:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ntb.ko 2023-07-14T12:25:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme 2023-07-14T12:25:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host 2023-07-14T12:25:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme-core.ko 2023-07-14T12:25:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme.ko 2023-07-14T12:25:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport 2023-07-14T12:25:05.604 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport.ko 2023-07-14T12:25:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_cs.ko 2023-07-14T12:25:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_pc.ko 2023-07-14T12:25:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_serial.ko 2023-07-14T12:25:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci 2023-07-14T12:25:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug 2023-07-14T12:25:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-14T12:25:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie 2023-07-14T12:25:05.605 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-14T12:25:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/xen-pcifront.ko 2023-07-14T12:25:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia 2023-07-14T12:25:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/i82092.ko 2023-07-14T12:25:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pd6729.ko 2023-07-14T12:25:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-14T12:25:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl 2023-07-14T12:25:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel 2023-07-14T12:25:05.606 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-14T12:25:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform 2023-07-14T12:25:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86 2023-07-14T12:25:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-14T12:25:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acerhdf.ko 2023-07-14T12:25:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-14T12:25:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-14T12:25:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-14T12:25:05.607 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-14T12:25:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-14T12:25:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-14T12:25:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-14T12:25:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-14T12:25:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-14T12:25:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/hdaps.ko 2023-07-14T12:25:05.608 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel 2023-07-14T12:25:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-14T12:25:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel_ips.ko 2023-07-14T12:25:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-14T12:25:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-14T12:25:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-14T12:25:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-14T12:25:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-14T12:25:05.609 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-14T12:25:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-14T12:25:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-14T12:25:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-14T12:25:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi.ko 2023-07-14T12:25:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap 2023-07-14T12:25:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-14T12:25:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-14T12:25:05.610 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps 2023-07-14T12:25:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients 2023-07-14T12:25:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-14T12:25:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-14T12:25:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps_parport.ko 2023-07-14T12:25:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/pps_core.ko 2023-07-14T12:25:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp 2023-07-14T12:25:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp.ko 2023-07-14T12:25:05.611 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp_kvm.ko 2023-07-14T12:25:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc 2023-07-14T12:25:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-14T12:25:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-14T12:25:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-14T12:25:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-14T12:25:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-14T12:25:05.612 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-14T12:25:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-14T12:25:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-14T12:25:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-14T12:25:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-14T12:25:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-14T12:25:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-em3027.ko 2023-07-14T12:25:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-14T12:25:05.613 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-14T12:25:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-14T12:25:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-14T12:25:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-14T12:25:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-14T12:25:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max6900.ko 2023-07-14T12:25:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-14T12:25:05.614 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-14T12:25:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-14T12:25:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-14T12:25:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-14T12:25:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-14T12:25:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-14T12:25:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-14T12:25:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-14T12:25:05.615 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-14T12:25:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-14T12:25:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-14T12:25:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-x1205.ko 2023-07-14T12:25:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi 2023-07-14T12:25:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-9xxx.ko 2023-07-14T12:25:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-sas.ko 2023-07-14T12:25:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-xxxx.ko 2023-07-14T12:25:05.616 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/BusLogic.ko 2023-07-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/a100u2w.ko 2023-07-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid 2023-07-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/advansys.ko 2023-07-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx 2023-07-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-14T12:25:05.617 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/am53c974.ko 2023-07-14T12:25:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr 2023-07-14T12:25:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-14T12:25:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/atp870u.ko 2023-07-14T12:25:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi 2023-07-14T12:25:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-14T12:25:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa 2023-07-14T12:25:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/bfa.ko 2023-07-14T12:25:05.618 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc 2023-07-14T12:25:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-14T12:25:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i 2023-07-14T12:25:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-14T12:25:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ch.ko 2023-07-14T12:25:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor 2023-07-14T12:25:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-14T12:25:05.619 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi 2023-07-14T12:25:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-14T12:25:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-14T12:25:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-14T12:25:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-14T12:25:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-14T12:25:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dc395x.ko 2023-07-14T12:25:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler 2023-07-14T12:25:05.620 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-14T12:25:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-14T12:25:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-14T12:25:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-14T12:25:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dmx3191d.ko 2023-07-14T12:25:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r 2023-07-14T12:25:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-14T12:25:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esp_scsi.ko 2023-07-14T12:25:05.621 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe 2023-07-14T12:25:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-14T12:25:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-14T12:25:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic 2023-07-14T12:25:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/fnic.ko 2023-07-14T12:25:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hpsa.ko 2023-07-14T12:25:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hptiop.ko 2023-07-14T12:25:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hv_storvsc.ko 2023-07-14T12:25:05.622 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/initio.ko 2023-07-14T12:25:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ipr.ko 2023-07-14T12:25:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ips.ko 2023-07-14T12:25:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci 2023-07-14T12:25:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/isci.ko 2023-07-14T12:25:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-14T12:25:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-14T12:25:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc 2023-07-14T12:25:05.623 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/libfc.ko 2023-07-14T12:25:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi.ko 2023-07-14T12:25:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-14T12:25:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas 2023-07-14T12:25:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/libsas.ko 2023-07-14T12:25:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc 2023-07-14T12:25:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-14T12:25:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid 2023-07-14T12:25:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid.ko 2023-07-14T12:25:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-14T12:25:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-14T12:25:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-14T12:25:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas 2023-07-14T12:25:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-14T12:25:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas 2023-07-14T12:25:05.625 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-14T12:25:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvumi.ko 2023-07-14T12:25:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001 2023-07-14T12:25:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-14T12:25:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pmcraid.ko 2023-07-14T12:25:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla1280.ko 2023-07-14T12:25:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx 2023-07-14T12:25:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-14T12:25:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-14T12:25:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx 2023-07-14T12:25:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-14T12:25:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/raid_class.ko 2023-07-14T12:25:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_debug.ko 2023-07-14T12:25:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-14T12:25:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-14T12:25:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-14T12:25:05.627 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-14T12:25:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-14T12:25:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ses.ko 2023-07-14T12:25:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/st.ko 2023-07-14T12:25:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/stex.ko 2023-07-14T12:25:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2 2023-07-14T12:25:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-14T12:25:05.628 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/virtio_scsi.ko 2023-07-14T12:25:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-14T12:25:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/wd719x.ko 2023-07-14T12:25:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb 2023-07-14T12:25:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ssb.ko 2023-07-14T12:25:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target 2023-07-14T12:25:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi 2023-07-14T12:25:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-14T12:25:05.629 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback 2023-07-14T12:25:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-14T12:25:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_file.ko 2023-07-14T12:25:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_iblock.ko 2023-07-14T12:25:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_mod.ko 2023-07-14T12:25:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_pscsi.ko 2023-07-14T12:25:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_user.ko 2023-07-14T12:25:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc 2023-07-14T12:25:05.630 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-14T12:25:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal 2023-07-14T12:25:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel 2023-07-14T12:25:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal 2023-07-14T12:25:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-14T12:25:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-14T12:25:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-14T12:25:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-14T12:25:05.631 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-14T12:25:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-14T12:25:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-14T12:25:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-14T12:25:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-14T12:25:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-14T12:25:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-14T12:25:05.632 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-14T12:25:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-14T12:25:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-14T12:25:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-14T12:25:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty 2023-07-14T12:25:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless 2023-07-14T12:25:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-14T12:25:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_gsm.ko 2023-07-14T12:25:05.633 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_hdlc.ko 2023-07-14T12:25:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/nozomi.ko 2023-07-14T12:25:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial 2023-07-14T12:25:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250 2023-07-14T12:25:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-14T12:25:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/arc_uart.ko 2023-07-14T12:25:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm 2023-07-14T12:25:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-14T12:25:05.634 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/synclink_gt.ko 2023-07-14T12:25:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs 2023-07-14T12:25:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core 2023-07-14T12:25:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-14T12:25:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host 2023-07-14T12:25:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-14T12:25:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio 2023-07-14T12:25:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio.ko 2023-07-14T12:25:05.635 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_aec.ko 2023-07-14T12:25:05.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_cif.ko 2023-07-14T12:25:05.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pci_generic.ko 2023-07-14T12:25:05.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_sercos3.ko 2023-07-14T12:25:05.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb 2023-07-14T12:25:05.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class 2023-07-14T12:25:05.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-acm.ko 2023-07-14T12:25:05.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-14T12:25:05.636 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usblp.ko 2023-07-14T12:25:05.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usbtmc.ko 2023-07-14T12:25:05.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host 2023-07-14T12:25:05.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-14T12:25:05.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image 2023-07-14T12:25:05.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/mdc800.ko 2023-07-14T12:25:05.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/microtek.ko 2023-07-14T12:25:05.637 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc 2023-07-14T12:25:05.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/adutux.ko 2023-07-14T12:25:05.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/appledisplay.ko 2023-07-14T12:25:05.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi26.ko 2023-07-14T12:25:05.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi62.ko 2023-07-14T12:25:05.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ezusb.ko 2023-07-14T12:25:05.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/idmouse.ko 2023-07-14T12:25:05.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/iowarrior.ko 2023-07-14T12:25:05.638 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-14T12:25:05.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ldusb.ko 2023-07-14T12:25:05.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/legousbtower.ko 2023-07-14T12:25:05.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga 2023-07-14T12:25:05.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-14T12:25:05.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-14T12:25:05.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usb3503.ko 2023-07-14T12:25:05.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usblcd.ko 2023-07-14T12:25:05.639 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-14T12:25:05.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/uss720.ko 2023-07-14T12:25:05.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/yurex.ko 2023-07-14T12:25:05.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy 2023-07-14T12:25:05.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-generic.ko 2023-07-14T12:25:05.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial 2023-07-14T12:25:05.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/aircable.ko 2023-07-14T12:25:05.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ark3116.ko 2023-07-14T12:25:05.640 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-14T12:25:05.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ch341.ko 2023-07-14T12:25:05.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cp210x.ko 2023-07-14T12:25:05.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cyberjack.ko 2023-07-14T12:25:05.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-14T12:25:05.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-14T12:25:05.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/empeg.ko 2023-07-14T12:25:05.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-14T12:25:05.641 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-14T12:25:05.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-14T12:25:05.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_ti.ko 2023-07-14T12:25:05.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipaq.ko 2023-07-14T12:25:05.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipw.ko 2023-07-14T12:25:05.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ir-usb.ko 2023-07-14T12:25:05.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-14T12:25:05.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan.ko 2023-07-14T12:25:05.642 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-14T12:25:05.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-14T12:25:05.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-14T12:25:05.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mct_u232.ko 2023-07-14T12:25:05.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7720.ko 2023-07-14T12:25:05.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7840.ko 2023-07-14T12:25:05.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/navman.ko 2023-07-14T12:25:05.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/omninet.ko 2023-07-14T12:25:05.643 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/opticon.ko 2023-07-14T12:25:05.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/option.ko 2023-07-14T12:25:05.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/oti6858.ko 2023-07-14T12:25:05.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/pl2303.ko 2023-07-14T12:25:05.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcaux.ko 2023-07-14T12:25:05.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcserial.ko 2023-07-14T12:25:05.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/quatech2.ko 2023-07-14T12:25:05.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/safe_serial.ko 2023-07-14T12:25:05.644 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/sierra.ko 2023-07-14T12:25:05.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-14T12:25:05.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ssu100.ko 2023-07-14T12:25:05.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/symbolserial.ko 2023-07-14T12:25:05.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-14T12:25:05.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-14T12:25:05.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_debug.ko 2023-07-14T12:25:05.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-14T12:25:05.645 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/visor.ko 2023-07-14T12:25:05.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/whiteheat.ko 2023-07-14T12:25:05.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-14T12:25:05.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage 2023-07-14T12:25:05.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/uas.ko 2023-07-14T12:25:05.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-14T12:25:05.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-14T12:25:05.646 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-14T12:25:05.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-14T12:25:05.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-14T12:25:05.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-14T12:25:05.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-14T12:25:05.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-karma.ko 2023-07-14T12:25:05.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-14T12:25:05.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-14T12:25:05.647 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-14T12:25:05.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-14T12:25:05.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-14T12:25:05.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/usb-storage.ko 2023-07-14T12:25:05.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip 2023-07-14T12:25:05.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-14T12:25:05.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-14T12:25:05.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-14T12:25:05.648 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio 2023-07-14T12:25:05.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci 2023-07-14T12:25:05.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-14T12:25:05.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-14T12:25:05.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio.ko 2023-07-14T12:25:05.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-14T12:25:05.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost 2023-07-14T12:25:05.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost.ko 2023-07-14T12:25:05.649 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-14T12:25:05.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_net.ko 2023-07-14T12:25:05.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_scsi.ko 2023-07-14T12:25:05.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video 2023-07-14T12:25:05.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight 2023-07-14T12:25:05.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/apple_bl.ko 2023-07-14T12:25:05.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lcd.ko 2023-07-14T12:25:05.650 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-14T12:25:05.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio 2023-07-14T12:25:05.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio.ko 2023-07-14T12:25:05.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_balloon.ko 2023-07-14T12:25:05.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_mmio.ko 2023-07-14T12:25:05.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci.ko 2023-07-14T12:25:05.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-14T12:25:05.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-14T12:25:05.651 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_ring.ko 2023-07-14T12:25:05.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1 2023-07-14T12:25:05.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters 2023-07-14T12:25:05.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2482.ko 2023-07-14T12:25:05.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2490.ko 2023-07-14T12:25:05.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves 2023-07-14T12:25:05.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-14T12:25:05.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-14T12:25:05.652 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-14T12:25:05.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-14T12:25:05.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-14T12:25:05.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-14T12:25:05.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-14T12:25:05.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-14T12:25:05.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-14T12:25:05.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-14T12:25:05.653 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-14T12:25:05.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/wire.ko 2023-07-14T12:25:05.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog 2023-07-14T12:25:05.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-14T12:25:05.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-14T12:25:05.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-14T12:25:05.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/hpwdt.ko 2023-07-14T12:25:05.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/i6300esb.ko 2023-07-14T12:25:05.654 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-14T12:25:05.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-14T12:25:05.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ib700wdt.ko 2023-07-14T12:25:05.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ibmasr.ko 2023-07-14T12:25:05.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-14T12:25:05.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-14T12:25:05.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it87_wdt.ko 2023-07-14T12:25:05.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/machzwd.ko 2023-07-14T12:25:05.655 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/nv_tco.ko 2023-07-14T12:25:05.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-14T12:25:05.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-14T12:25:05.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-14T12:25:05.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-14T12:25:05.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/softdog.ko 2023-07-14T12:25:05.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-14T12:25:05.656 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/via_wdt.ko 2023-07-14T12:25:05.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-14T12:25:05.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-14T12:25:05.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-14T12:25:05.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wdt_pci.ko 2023-07-14T12:25:05.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/xen_wdt.ko 2023-07-14T12:25:05.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen 2023-07-14T12:25:05.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-14T12:25:05.657 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-evtchn.ko 2023-07-14T12:25:05.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntalloc.ko 2023-07-14T12:25:05.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntdev.ko 2023-07-14T12:25:05.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback 2023-07-14T12:25:05.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-14T12:25:05.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-privcmd.ko 2023-07-14T12:25:05.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs 2023-07-14T12:25:05.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-14T12:25:05.658 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs 2023-07-14T12:25:05.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p 2023-07-14T12:25:05.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/9p.ko 2023-07-14T12:25:05.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs 2023-07-14T12:25:05.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/affs.ko 2023-07-14T12:25:05.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs 2023-07-14T12:25:05.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/befs.ko 2023-07-14T12:25:05.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/binfmt_misc.ko 2023-07-14T12:25:05.659 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs 2023-07-14T12:25:05.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/btrfs.ko 2023-07-14T12:25:05.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles 2023-07-14T12:25:05.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/cachefiles.ko 2023-07-14T12:25:05.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph 2023-07-14T12:25:05.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ceph.ko 2023-07-14T12:25:05.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda 2023-07-14T12:25:05.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/coda.ko 2023-07-14T12:25:05.660 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs 2023-07-14T12:25:05.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/cramfs.ko 2023-07-14T12:25:05.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm 2023-07-14T12:25:05.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/dlm.ko 2023-07-14T12:25:05.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs 2023-07-14T12:25:05.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-14T12:25:05.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs 2023-07-14T12:25:05.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/f2fs.ko 2023-07-14T12:25:05.661 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat 2023-07-14T12:25:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/fat.ko 2023-07-14T12:25:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/msdos.ko 2023-07-14T12:25:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/vfat.ko 2023-07-14T12:25:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache 2023-07-14T12:25:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/fscache.ko 2023-07-14T12:25:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse 2023-07-14T12:25:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/cuse.ko 2023-07-14T12:25:05.662 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/fuse.ko 2023-07-14T12:25:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2 2023-07-14T12:25:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/gfs2.ko 2023-07-14T12:25:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs 2023-07-14T12:25:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/hfs.ko 2023-07-14T12:25:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus 2023-07-14T12:25:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/hfsplus.ko 2023-07-14T12:25:05.663 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs 2023-07-14T12:25:05.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/isofs.ko 2023-07-14T12:25:05.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs 2023-07-14T12:25:05.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/jfs.ko 2023-07-14T12:25:05.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd 2023-07-14T12:25:05.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/lockd.ko 2023-07-14T12:25:05.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix 2023-07-14T12:25:05.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/minix.ko 2023-07-14T12:25:05.664 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs 2023-07-14T12:25:05.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/netfs.ko 2023-07-14T12:25:05.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs 2023-07-14T12:25:05.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout 2023-07-14T12:25:05.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-14T12:25:05.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout 2023-07-14T12:25:05.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-14T12:25:05.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout 2023-07-14T12:25:05.665 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-14T12:25:05.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfs.ko 2023-07-14T12:25:05.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv3.ko 2023-07-14T12:25:05.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv4.ko 2023-07-14T12:25:05.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common 2023-07-14T12:25:05.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/grace.ko 2023-07-14T12:25:05.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/nfs_acl.ko 2023-07-14T12:25:05.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd 2023-07-14T12:25:05.666 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/nfsd.ko 2023-07-14T12:25:05.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2 2023-07-14T12:25:05.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/nilfs2.ko 2023-07-14T12:25:05.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls 2023-07-14T12:25:05.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-celtic.ko 2023-07-14T12:25:05.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-centeuro.ko 2023-07-14T12:25:05.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-croatian.ko 2023-07-14T12:25:05.667 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-cyrillic.ko 2023-07-14T12:25:05.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-gaelic.ko 2023-07-14T12:25:05.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-greek.ko 2023-07-14T12:25:05.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-iceland.ko 2023-07-14T12:25:05.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-inuit.ko 2023-07-14T12:25:05.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-roman.ko 2023-07-14T12:25:05.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-romanian.ko 2023-07-14T12:25:05.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-turkish.ko 2023-07-14T12:25:05.668 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1250.ko 2023-07-14T12:25:05.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1251.ko 2023-07-14T12:25:05.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1255.ko 2023-07-14T12:25:05.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp737.ko 2023-07-14T12:25:05.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp775.ko 2023-07-14T12:25:05.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp850.ko 2023-07-14T12:25:05.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp852.ko 2023-07-14T12:25:05.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp855.ko 2023-07-14T12:25:05.669 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp857.ko 2023-07-14T12:25:05.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp860.ko 2023-07-14T12:25:05.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp861.ko 2023-07-14T12:25:05.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp862.ko 2023-07-14T12:25:05.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp863.ko 2023-07-14T12:25:05.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp864.ko 2023-07-14T12:25:05.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp865.ko 2023-07-14T12:25:05.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp866.ko 2023-07-14T12:25:05.670 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp869.ko 2023-07-14T12:25:05.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp874.ko 2023-07-14T12:25:05.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp932.ko 2023-07-14T12:25:05.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp936.ko 2023-07-14T12:25:05.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp949.ko 2023-07-14T12:25:05.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp950.ko 2023-07-14T12:25:05.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_euc-jp.ko 2023-07-14T12:25:05.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-1.ko 2023-07-14T12:25:05.671 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-13.ko 2023-07-14T12:25:05.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-14.ko 2023-07-14T12:25:05.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-15.ko 2023-07-14T12:25:05.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-2.ko 2023-07-14T12:25:05.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-3.ko 2023-07-14T12:25:05.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-4.ko 2023-07-14T12:25:05.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-5.ko 2023-07-14T12:25:05.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-6.ko 2023-07-14T12:25:05.672 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-7.ko 2023-07-14T12:25:05.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-9.ko 2023-07-14T12:25:05.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-r.ko 2023-07-14T12:25:05.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-ru.ko 2023-07-14T12:25:05.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-u.ko 2023-07-14T12:25:05.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_utf8.ko 2023-07-14T12:25:05.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2 2023-07-14T12:25:05.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster 2023-07-14T12:25:05.673 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-14T12:25:05.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm 2023-07-14T12:25:05.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-14T12:25:05.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs 2023-07-14T12:25:05.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-14T12:25:05.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2.ko 2023-07-14T12:25:05.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-14T12:25:05.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-14T12:25:05.674 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-14T12:25:05.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs 2023-07-14T12:25:05.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/overlay.ko 2023-07-14T12:25:05.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore 2023-07-14T12:25:05.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ramoops.ko 2023-07-14T12:25:05.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs 2023-07-14T12:25:05.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/reiserfs.ko 2023-07-14T12:25:05.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs 2023-07-14T12:25:05.675 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/romfs.ko 2023-07-14T12:25:05.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb 2023-07-14T12:25:05.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client 2023-07-14T12:25:05.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/cifs.ko 2023-07-14T12:25:05.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common 2023-07-14T12:25:05.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_arc4.ko 2023-07-14T12:25:05.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_md4.ko 2023-07-14T12:25:05.676 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs 2023-07-14T12:25:05.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/squashfs.ko 2023-07-14T12:25:05.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv 2023-07-14T12:25:05.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/sysv.ko 2023-07-14T12:25:05.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf 2023-07-14T12:25:05.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/udf.ko 2023-07-14T12:25:05.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs 2023-07-14T12:25:05.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ufs.ko 2023-07-14T12:25:05.677 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs 2023-07-14T12:25:05.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/xfs.ko 2023-07-14T12:25:05.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel 2023-07-14T12:25:05.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu 2023-07-14T12:25:05.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu/rcutorture.ko 2023-07-14T12:25:05.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/torture.ko 2023-07-14T12:25:05.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace 2023-07-14T12:25:05.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-14T12:25:05.678 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib 2023-07-14T12:25:05.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/asn1_encoder.ko 2023-07-14T12:25:05.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc-itu-t.ko 2023-07-14T12:25:05.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc8.ko 2023-07-14T12:25:05.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto 2023-07-14T12:25:05.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libarc4.ko 2023-07-14T12:25:05.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libdes.ko 2023-07-14T12:25:05.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/libcrc32c.ko 2023-07-14T12:25:05.679 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lru_cache.ko 2023-07-14T12:25:05.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4 2023-07-14T12:25:05.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4_compress.ko 2023-07-14T12:25:05.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4hc_compress.ko 2023-07-14T12:25:05.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math 2023-07-14T12:25:05.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/cordic.ko 2023-07-14T12:25:05.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6 2023-07-14T12:25:05.680 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/raid6_pq.ko 2023-07-14T12:25:05.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon 2023-07-14T12:25:05.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-14T12:25:05.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_bm.ko 2023-07-14T12:25:05.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_fsm.ko 2023-07-14T12:25:05.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_kmp.ko 2023-07-14T12:25:05.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd 2023-07-14T12:25:05.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd/zstd_compress.ko 2023-07-14T12:25:05.681 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm 2023-07-14T12:25:05.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/hwpoison-inject.ko 2023-07-14T12:25:05.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net 2023-07-14T12:25:05.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan 2023-07-14T12:25:05.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/6lowpan.ko 2023-07-14T12:25:05.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_dest.ko 2023-07-14T12:25:05.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_fragment.ko 2023-07-14T12:25:05.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_hop.ko 2023-07-14T12:25:05.682 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-14T12:25:05.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_mobility.ko 2023-07-14T12:25:05.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_routing.ko 2023-07-14T12:25:05.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_udp.ko 2023-07-14T12:25:05.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802 2023-07-14T12:25:05.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/garp.ko 2023-07-14T12:25:05.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/mrp.ko 2023-07-14T12:25:05.683 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/p8022.ko 2023-07-14T12:25:05.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/psnap.ko 2023-07-14T12:25:05.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/stp.ko 2023-07-14T12:25:05.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q 2023-07-14T12:25:05.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/8021q.ko 2023-07-14T12:25:05.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p 2023-07-14T12:25:05.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet.ko 2023-07-14T12:25:05.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_fd.ko 2023-07-14T12:25:05.684 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_rdma.ko 2023-07-14T12:25:05.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_virtio.ko 2023-07-14T12:25:05.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv 2023-07-14T12:25:05.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/batman-adv.ko 2023-07-14T12:25:05.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge 2023-07-14T12:25:05.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/br_netfilter.ko 2023-07-14T12:25:05.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/bridge.ko 2023-07-14T12:25:05.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter 2023-07-14T12:25:05.685 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-14T12:25:05.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-14T12:25:05.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-14T12:25:05.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-14T12:25:05.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-14T12:25:05.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-14T12:25:05.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-14T12:25:05.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-14T12:25:05.686 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-14T12:25:05.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-14T12:25:05.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-14T12:25:05.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-14T12:25:05.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-14T12:25:05.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-14T12:25:05.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-14T12:25:05.687 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-14T12:25:05.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-14T12:25:05.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-14T12:25:05.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-14T12:25:05.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-14T12:25:05.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtables.ko 2023-07-14T12:25:05.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-14T12:25:05.688 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-14T12:25:05.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-14T12:25:05.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph 2023-07-14T12:25:05.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/libceph.ko 2023-07-14T12:25:05.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core 2023-07-14T12:25:05.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/failover.ko 2023-07-14T12:25:05.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/pktgen.ko 2023-07-14T12:25:05.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp 2023-07-14T12:25:05.689 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp.ko 2023-07-14T12:25:05.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_diag.ko 2023-07-14T12:25:05.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv4.ko 2023-07-14T12:25:05.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv6.ko 2023-07-14T12:25:05.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver 2023-07-14T12:25:05.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver/dns_resolver.ko 2023-07-14T12:25:05.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa 2023-07-14T12:25:05.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/dsa_core.ko 2023-07-14T12:25:05.690 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_brcm.ko 2023-07-14T12:25:05.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_dsa.ko 2023-07-14T12:25:05.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_none.ko 2023-07-14T12:25:05.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_trailer.ko 2023-07-14T12:25:05.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154 2023-07-14T12:25:05.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan 2023-07-14T12:25:05.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-14T12:25:05.691 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154.ko 2023-07-14T12:25:05.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-14T12:25:05.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4 2023-07-14T12:25:05.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ah4.ko 2023-07-14T12:25:05.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/esp4.ko 2023-07-14T12:25:05.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/fou.ko 2023-07-14T12:25:05.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/gre.ko 2023-07-14T12:25:05.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/inet_diag.ko 2023-07-14T12:25:05.692 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_gre.ko 2023-07-14T12:25:05.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_tunnel.ko 2023-07-14T12:25:05.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_vti.ko 2023-07-14T12:25:05.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipcomp.ko 2023-07-14T12:25:05.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipip.ko 2023-07-14T12:25:05.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter 2023-07-14T12:25:05.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-14T12:25:05.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-14T12:25:05.693 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-14T12:25:05.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-14T12:25:05.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-14T12:25:05.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-14T12:25:05.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-14T12:25:05.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-14T12:25:05.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-14T12:25:05.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-14T12:25:05.694 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-14T12:25:05.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-14T12:25:05.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-14T12:25:05.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-14T12:25:05.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-14T12:25:05.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-14T12:25:05.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-14T12:25:05.695 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-14T12:25:05.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-14T12:25:05.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-14T12:25:05.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-14T12:25:05.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_bic.ko 2023-07-14T12:25:05.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_dctcp.ko 2023-07-14T12:25:05.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_diag.ko 2023-07-14T12:25:05.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_highspeed.ko 2023-07-14T12:25:05.696 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_htcp.ko 2023-07-14T12:25:05.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_hybla.ko 2023-07-14T12:25:05.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_illinois.ko 2023-07-14T12:25:05.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_lp.ko 2023-07-14T12:25:05.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_scalable.ko 2023-07-14T12:25:05.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_vegas.ko 2023-07-14T12:25:05.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_veno.ko 2023-07-14T12:25:05.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_westwood.ko 2023-07-14T12:25:05.697 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_yeah.ko 2023-07-14T12:25:05.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tunnel4.ko 2023-07-14T12:25:05.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_diag.ko 2023-07-14T12:25:05.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_tunnel.ko 2023-07-14T12:25:05.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-14T12:25:05.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6 2023-07-14T12:25:05.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ah6.ko 2023-07-14T12:25:05.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/esp6.ko 2023-07-14T12:25:05.698 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/fou6.ko 2023-07-14T12:25:05.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_tunnel.ko 2023-07-14T12:25:05.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-14T12:25:05.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_vti.ko 2023-07-14T12:25:05.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ipcomp6.ko 2023-07-14T12:25:05.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter 2023-07-14T12:25:05.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-14T12:25:05.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-14T12:25:05.699 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-14T12:25:05.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-14T12:25:05.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-14T12:25:05.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-14T12:25:05.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-14T12:25:05.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-14T12:25:05.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-14T12:25:05.700 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-14T12:25:05.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-14T12:25:05.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-14T12:25:05.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-14T12:25:05.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-14T12:25:05.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-14T12:25:05.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-14T12:25:05.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-14T12:25:05.701 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-14T12:25:05.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-14T12:25:05.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-14T12:25:05.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-14T12:25:05.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-14T12:25:05.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-14T12:25:05.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-14T12:25:05.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/sit.ko 2023-07-14T12:25:05.702 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/tunnel6.ko 2023-07-14T12:25:05.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-14T12:25:05.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key 2023-07-14T12:25:05.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/af_key.ko 2023-07-14T12:25:05.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp 2023-07-14T12:25:05.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_core.ko 2023-07-14T12:25:05.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-14T12:25:05.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_eth.ko 2023-07-14T12:25:05.703 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip.ko 2023-07-14T12:25:05.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip6.ko 2023-07-14T12:25:05.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_netlink.ko 2023-07-14T12:25:05.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ppp.ko 2023-07-14T12:25:05.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc 2023-07-14T12:25:05.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc.ko 2023-07-14T12:25:05.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154 2023-07-14T12:25:05.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/mac802154.ko 2023-07-14T12:25:05.704 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls 2023-07-14T12:25:05.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/mpls_gso.ko 2023-07-14T12:25:05.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter 2023-07-14T12:25:05.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset 2023-07-14T12:25:05.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set.ko 2023-07-14T12:25:05.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-14T12:25:05.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-14T12:25:05.705 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-14T12:25:05.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-14T12:25:05.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-14T12:25:05.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-14T12:25:05.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-14T12:25:05.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-14T12:25:05.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-14T12:25:05.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-14T12:25:05.706 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-14T12:25:05.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-14T12:25:05.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-14T12:25:05.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-14T12:25:05.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-14T12:25:05.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs 2023-07-14T12:25:05.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-14T12:25:05.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-14T12:25:05.707 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-14T12:25:05.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-14T12:25:05.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-14T12:25:05.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-14T12:25:05.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-14T12:25:05.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-14T12:25:05.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-14T12:25:05.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-14T12:25:05.708 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-14T12:25:05.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-14T12:25:05.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-14T12:25:05.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-14T12:25:05.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conncount.ko 2023-07-14T12:25:05.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack.ko 2023-07-14T12:25:05.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-14T12:25:05.709 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-14T12:25:05.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-14T12:25:05.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-14T12:25:05.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-14T12:25:05.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-14T12:25:05.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-14T12:25:05.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-14T12:25:05.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-14T12:25:05.710 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-14T12:25:05.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-14T12:25:05.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-14T12:25:05.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-14T12:25:05.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table.ko 2023-07-14T12:25:05.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-14T12:25:05.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_log_syslog.ko 2023-07-14T12:25:05.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat.ko 2023-07-14T12:25:05.711 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-14T12:25:05.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-14T12:25:05.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_irc.ko 2023-07-14T12:25:05.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_sip.ko 2023-07-14T12:25:05.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-14T12:25:05.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-14T12:25:05.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_tables.ko 2023-07-14T12:25:05.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink.ko 2023-07-14T12:25:05.712 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-14T12:25:05.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_log.ko 2023-07-14T12:25:05.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-14T12:25:05.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-14T12:25:05.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_chain_nat.ko 2023-07-14T12:25:05.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_compat.ko 2023-07-14T12:25:05.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_ct.ko 2023-07-14T12:25:05.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-14T12:25:05.713 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fib.ko 2023-07-14T12:25:05.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-14T12:25:05.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_hash.ko 2023-07-14T12:25:05.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_limit.ko 2023-07-14T12:25:05.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_log.ko 2023-07-14T12:25:05.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_masq.ko 2023-07-14T12:25:05.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_nat.ko 2023-07-14T12:25:05.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_numgen.ko 2023-07-14T12:25:05.714 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_queue.ko 2023-07-14T12:25:05.715 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_quota.ko 2023-07-14T12:25:05.715 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_redir.ko 2023-07-14T12:25:05.715 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject.ko 2023-07-14T12:25:05.715 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject_inet.ko 2023-07-14T12:25:05.715 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_socket.ko 2023-07-14T12:25:05.715 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_tunnel.ko 2023-07-14T12:25:05.715 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_AUDIT.ko 2023-07-14T12:25:05.716 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-14T12:25:05.716 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-14T12:25:05.716 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-14T12:25:05.716 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CT.ko 2023-07-14T12:25:05.716 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_DSCP.ko 2023-07-14T12:25:05.716 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HL.ko 2023-07-14T12:25:05.716 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HMARK.ko 2023-07-14T12:25:05.716 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-14T12:25:05.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LED.ko 2023-07-14T12:25:05.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LOG.ko 2023-07-14T12:25:05.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-14T12:25:05.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NETMAP.ko 2023-07-14T12:25:05.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFLOG.ko 2023-07-14T12:25:05.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-14T12:25:05.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_RATEEST.ko 2023-07-14T12:25:05.717 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-14T12:25:05.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_SECMARK.ko 2023-07-14T12:25:05.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-14T12:25:05.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-14T12:25:05.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TEE.ko 2023-07-14T12:25:05.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TPROXY.ko 2023-07-14T12:25:05.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TRACE.ko 2023-07-14T12:25:05.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_addrtype.ko 2023-07-14T12:25:05.718 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_bpf.ko 2023-07-14T12:25:05.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cgroup.ko 2023-07-14T12:25:05.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cluster.ko 2023-07-14T12:25:05.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_comment.ko 2023-07-14T12:25:05.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connbytes.ko 2023-07-14T12:25:05.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlabel.ko 2023-07-14T12:25:05.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlimit.ko 2023-07-14T12:25:05.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connmark.ko 2023-07-14T12:25:05.719 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_conntrack.ko 2023-07-14T12:25:05.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cpu.ko 2023-07-14T12:25:05.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dccp.ko 2023-07-14T12:25:05.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_devgroup.ko 2023-07-14T12:25:05.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dscp.ko 2023-07-14T12:25:05.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ecn.ko 2023-07-14T12:25:05.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_esp.ko 2023-07-14T12:25:05.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hashlimit.ko 2023-07-14T12:25:05.720 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_helper.ko 2023-07-14T12:25:05.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hl.ko 2023-07-14T12:25:05.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipcomp.ko 2023-07-14T12:25:05.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_iprange.ko 2023-07-14T12:25:05.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipvs.ko 2023-07-14T12:25:05.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_l2tp.ko 2023-07-14T12:25:05.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_length.ko 2023-07-14T12:25:05.721 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_limit.ko 2023-07-14T12:25:05.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mac.ko 2023-07-14T12:25:05.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mark.ko 2023-07-14T12:25:05.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_multiport.ko 2023-07-14T12:25:05.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nat.ko 2023-07-14T12:25:05.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nfacct.ko 2023-07-14T12:25:05.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_osf.ko 2023-07-14T12:25:05.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_owner.ko 2023-07-14T12:25:05.722 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_physdev.ko 2023-07-14T12:25:05.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_pkttype.ko 2023-07-14T12:25:05.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_policy.ko 2023-07-14T12:25:05.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_quota.ko 2023-07-14T12:25:05.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_rateest.ko 2023-07-14T12:25:05.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_realm.ko 2023-07-14T12:25:05.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_recent.ko 2023-07-14T12:25:05.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_sctp.ko 2023-07-14T12:25:05.723 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_set.ko 2023-07-14T12:25:05.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_socket.ko 2023-07-14T12:25:05.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_state.ko 2023-07-14T12:25:05.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_statistic.ko 2023-07-14T12:25:05.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_string.ko 2023-07-14T12:25:05.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpmss.ko 2023-07-14T12:25:05.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_time.ko 2023-07-14T12:25:05.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_u32.ko 2023-07-14T12:25:05.724 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink 2023-07-14T12:25:05.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/netlink_diag.ko 2023-07-14T12:25:05.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh 2023-07-14T12:25:05.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/nsh.ko 2023-07-14T12:25:05.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch 2023-07-14T12:25:05.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/openvswitch.ko 2023-07-14T12:25:05.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-geneve.ko 2023-07-14T12:25:05.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-gre.ko 2023-07-14T12:25:05.725 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-vxlan.ko 2023-07-14T12:25:05.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet 2023-07-14T12:25:05.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/af_packet_diag.ko 2023-07-14T12:25:05.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds 2023-07-14T12:25:05.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds.ko 2023-07-14T12:25:05.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_rdma.ko 2023-07-14T12:25:05.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_tcp.ko 2023-07-14T12:25:05.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched 2023-07-14T12:25:05.726 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_csum.ko 2023-07-14T12:25:05.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_gact.ko 2023-07-14T12:25:05.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_ipt.ko 2023-07-14T12:25:05.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_mirred.ko 2023-07-14T12:25:05.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_nat.ko 2023-07-14T12:25:05.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_pedit.ko 2023-07-14T12:25:05.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_police.ko 2023-07-14T12:25:05.727 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_simple.ko 2023-07-14T12:25:05.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_skbedit.ko 2023-07-14T12:25:05.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_vlan.ko 2023-07-14T12:25:05.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_basic.ko 2023-07-14T12:25:05.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_bpf.ko 2023-07-14T12:25:05.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_flow.ko 2023-07-14T12:25:05.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_fw.ko 2023-07-14T12:25:05.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_route.ko 2023-07-14T12:25:05.728 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_u32.ko 2023-07-14T12:25:05.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_cmp.ko 2023-07-14T12:25:05.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_ipset.ko 2023-07-14T12:25:05.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_meta.ko 2023-07-14T12:25:05.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_nbyte.ko 2023-07-14T12:25:05.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_text.ko 2023-07-14T12:25:05.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_u32.ko 2023-07-14T12:25:05.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_choke.ko 2023-07-14T12:25:05.729 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_codel.ko 2023-07-14T12:25:05.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_drr.ko 2023-07-14T12:25:05.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq.ko 2023-07-14T12:25:05.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_gred.ko 2023-07-14T12:25:05.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hfsc.ko 2023-07-14T12:25:05.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hhf.ko 2023-07-14T12:25:05.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_htb.ko 2023-07-14T12:25:05.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_ingress.ko 2023-07-14T12:25:05.730 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio.ko 2023-07-14T12:25:05.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio_lib.ko 2023-07-14T12:25:05.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_multiq.ko 2023-07-14T12:25:05.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_netem.ko 2023-07-14T12:25:05.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_pie.ko 2023-07-14T12:25:05.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_plug.ko 2023-07-14T12:25:05.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_prio.ko 2023-07-14T12:25:05.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_qfq.ko 2023-07-14T12:25:05.731 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_red.ko 2023-07-14T12:25:05.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfb.ko 2023-07-14T12:25:05.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfq.ko 2023-07-14T12:25:05.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_tbf.ko 2023-07-14T12:25:05.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_teql.ko 2023-07-14T12:25:05.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp 2023-07-14T12:25:05.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp.ko 2023-07-14T12:25:05.732 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp_diag.ko 2023-07-14T12:25:05.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc 2023-07-14T12:25:05.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss 2023-07-14T12:25:05.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-14T12:25:05.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-14T12:25:05.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/sunrpc.ko 2023-07-14T12:25:05.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma 2023-07-14T12:25:05.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-14T12:25:05.733 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc 2023-07-14T12:25:05.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/diag.ko 2023-07-14T12:25:05.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/tipc.ko 2023-07-14T12:25:05.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix 2023-07-14T12:25:05.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/unix_diag.ko 2023-07-14T12:25:05.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock 2023-07-14T12:25:05.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-14T12:25:05.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-14T12:25:05.734 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock.ko 2023-07-14T12:25:05.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-14T12:25:05.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-14T12:25:05.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm 2023-07-14T12:25:05.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-14T12:25:05.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security 2023-07-14T12:25:05.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys 2023-07-14T12:25:05.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys 2023-07-14T12:25:05.735 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-14T12:25:05.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys 2023-07-14T12:25:05.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys/trusted.ko 2023-07-14T12:25:05.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt 2023-07-14T12:25:05.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib 2023-07-14T12:25:05.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/irqbypass.ko 2023-07-14T12:25:05.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias 2023-07-14T12:25:05.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias.bin 2023-07-14T12:25:05.736 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin 2023-07-14T12:25:05.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.bin 2023-07-14T12:25:05.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.modinfo 2023-07-14T12:25:05.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep 2023-07-14T12:25:05.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep.bin 2023-07-14T12:25:05.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.devname 2023-07-14T12:25:05.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.order 2023-07-14T12:25:05.737 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.softdep 2023-07-14T12:25:05.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols 2023-07-14T12:25:05.738 INFO:teuthology.orchestra.run.smithi135.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols.bin 2023-07-14T12:25:05.738 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:05.739 DEBUG:teuthology.orchestra.run.smithi135:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-14T12:25:05.765 INFO:teuthology.orchestra.run.smithi135.stdout:postinstall scriptlet (using /bin/sh): 2023-07-14T12:25:05.766 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 -a -r /boot/System.map-6.5.0-rc1-ga440c79eee02 ]; then 2023-07-14T12:25:05.766 INFO:teuthology.orchestra.run.smithi135.stdout:cp /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:05.766 INFO:teuthology.orchestra.run.smithi135.stdout:cp /boot/System.map-6.5.0-rc1-ga440c79eee02 /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:05.766 INFO:teuthology.orchestra.run.smithi135.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:05.766 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/installkernel 6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:05.766 INFO:teuthology.orchestra.run.smithi135.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:05.767 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-07-14T12:25:05.767 INFO:teuthology.orchestra.run.smithi135.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-14T12:25:05.767 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-14T12:25:05.767 INFO:teuthology.orchestra.run.smithi135.stdout:new-kernel-pkg --remove 6.5.0-rc1-ga440c79eee02 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-ga440c79eee02.img 2023-07-14T12:25:05.767 INFO:teuthology.orchestra.run.smithi135.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-14T12:25:05.767 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-install remove 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:05.767 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-07-14T12:25:05.768 INFO:teuthology.orchestra.run.smithi135.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-14T12:25:05.768 INFO:teuthology.orchestra.run.smithi135.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-14T12:25:05.768 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:05.768 INFO:teuthology.orchestra.run.smithi135.stdout:fi 2023-07-14T12:25:05.769 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2023-07-14T12:25:05.848 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2023-07-14T12:25:05.848 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2023-07-14T12:25:05.848 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.02 2023-07-14T12:25:05.848 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 123.el8 2023-07-14T12:25:05.849 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2023-07-14T12:25:05.849 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-07-14T12:25:05.849 INFO:teuthology.orchestra.run.smithi135.stdout:Group : System Environment/Base 2023-07-14T12:25:05.849 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 9265450 2023-07-14T12:25:05.849 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2023-07-14T12:25:05.849 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-07-14T12:25:05.849 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-07-14T12:25:05.849 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-07-14T12:25:05.850 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-07-14T12:25:05.850 INFO:teuthology.orchestra.run.smithi135.stdout:Relocations : (not relocatable) 2023-07-14T12:25:05.850 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : Red Hat, Inc. 2023-07-14T12:25:05.850 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : Red Hat, Inc. 2023-07-14T12:25:05.850 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-14T12:25:05.850 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2023-07-14T12:25:05.850 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2023-07-14T12:25:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:25:05.851 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-14T12:25:05.851 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-14T12:25:05.851 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-14T12:25:05.851 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2023-07-14T12:25:05.851 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:25:05.851 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2023-07-14T12:25:05.852 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-14T12:25:05.852 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:05.853 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-14T12:25:10.530 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2023-07-14T12:25:12.392 INFO:teuthology.orchestra.run.smithi135.stderr:done 2023-07-14T12:25:12.394 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2023-07-14T12:25:12.410 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.YmlfcXI1sl 2023-07-14T12:25:12.411 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YmlfcXI1sl 2023-07-14T12:25:12.494 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.YmlfcXI1sl 2023-07-14T12:25:12.624 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.YmlfcXI1sl is 6KB 2023-07-14T12:25:12.644 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.YmlfcXI1sl 2023-07-14T12:25:12.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2023-07-14T12:25:12.733 INFO:teuthology.orchestra.run.smithi135.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-07-14T12:25:12.733 INFO:teuthology.orchestra.run.smithi135.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-07-14T12:25:12.733 INFO:teuthology.orchestra.run.smithi135.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-ga440c79eee02.conf 2023-07-14T12:25:12.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:12.889 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2023-07-14T12:25:16.024 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-14T12:25:16.024 DEBUG:teuthology.orchestra.run.smithi131:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-14T12:25:16.075 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:16.075 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/config-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:16.075 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:16.075 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:16.075 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel 2023-07-14T12:25:16.076 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch 2023-07-14T12:25:16.076 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86 2023-07-14T12:25:16.076 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto 2023-07-14T12:25:16.076 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-14T12:25:16.076 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-14T12:25:16.076 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-14T12:25:16.076 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-14T12:25:16.077 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-14T12:25:16.077 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-14T12:25:16.077 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-14T12:25:16.077 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-14T12:25:16.077 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-14T12:25:16.077 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-14T12:25:16.077 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-14T12:25:16.077 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-14T12:25:16.078 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-14T12:25:16.078 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-14T12:25:16.078 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-14T12:25:16.078 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-14T12:25:16.078 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-14T12:25:16.078 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-14T12:25:16.078 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-14T12:25:16.079 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-14T12:25:16.079 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel 2023-07-14T12:25:16.079 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu 2023-07-14T12:25:16.079 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce 2023-07-14T12:25:16.079 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-14T12:25:16.079 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm 2023-07-14T12:25:16.079 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-14T12:25:16.079 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-14T12:25:16.080 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm.ko 2023-07-14T12:25:16.080 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto 2023-07-14T12:25:16.080 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ansi_cprng.ko 2023-07-14T12:25:16.080 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/anubis.ko 2023-07-14T12:25:16.080 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/arc4.ko 2023-07-14T12:25:16.080 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx 2023-07-14T12:25:16.080 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_memcpy.ko 2023-07-14T12:25:16.080 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_pq.ko 2023-07-14T12:25:16.081 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-14T12:25:16.081 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_tx.ko 2023-07-14T12:25:16.081 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_xor.ko 2023-07-14T12:25:16.081 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/raid6test.ko 2023-07-14T12:25:16.081 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authenc.ko 2023-07-14T12:25:16.081 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authencesn.ko 2023-07-14T12:25:16.081 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blake2b_generic.ko 2023-07-14T12:25:16.082 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_common.ko 2023-07-14T12:25:16.082 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_generic.ko 2023-07-14T12:25:16.082 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/camellia_generic.ko 2023-07-14T12:25:16.082 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast5_generic.ko 2023-07-14T12:25:16.082 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast6_generic.ko 2023-07-14T12:25:16.082 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast_common.ko 2023-07-14T12:25:16.082 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ccm.ko 2023-07-14T12:25:16.082 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cmac.ko 2023-07-14T12:25:16.083 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crc32_generic.ko 2023-07-14T12:25:16.083 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_engine.ko 2023-07-14T12:25:16.083 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_user.ko 2023-07-14T12:25:16.083 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cts.ko 2023-07-14T12:25:16.083 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/des_generic.ko 2023-07-14T12:25:16.083 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/dh_generic.ko 2023-07-14T12:25:16.083 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/echainiv.ko 2023-07-14T12:25:16.083 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/essiv.ko 2023-07-14T12:25:16.084 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/fcrypt.ko 2023-07-14T12:25:16.084 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/khazad.ko 2023-07-14T12:25:16.084 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4.ko 2023-07-14T12:25:16.084 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4hc.ko 2023-07-14T12:25:16.084 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/md4.ko 2023-07-14T12:25:16.084 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/michael_mic.ko 2023-07-14T12:25:16.084 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcbc.ko 2023-07-14T12:25:16.084 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcrypt.ko 2023-07-14T12:25:16.085 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/rmd160.ko 2023-07-14T12:25:16.085 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/seed.ko 2023-07-14T12:25:16.085 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/serpent_generic.ko 2023-07-14T12:25:16.085 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tcrypt.ko 2023-07-14T12:25:16.085 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tea.ko 2023-07-14T12:25:16.085 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_common.ko 2023-07-14T12:25:16.085 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_generic.ko 2023-07-14T12:25:16.086 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/vmac.ko 2023-07-14T12:25:16.086 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/wp512.ko 2023-07-14T12:25:16.086 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xcbc.ko 2023-07-14T12:25:16.086 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xor.ko 2023-07-14T12:25:16.086 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xxhash_generic.ko 2023-07-14T12:25:16.086 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers 2023-07-14T12:25:16.086 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi 2023-07-14T12:25:16.086 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-14T12:25:16.087 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_pad.ko 2023-07-14T12:25:16.087 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/custom_method.ko 2023-07-14T12:25:16.087 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ec_sys.ko 2023-07-14T12:25:16.087 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/platform_profile.ko 2023-07-14T12:25:16.087 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbs.ko 2023-07-14T12:25:16.087 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbshc.ko 2023-07-14T12:25:16.087 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/video.ko 2023-07-14T12:25:16.087 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata 2023-07-14T12:25:16.088 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/acard-ahci.ko 2023-07-14T12:25:16.088 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci_platform.ko 2023-07-14T12:25:16.088 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ata_generic.ko 2023-07-14T12:25:16.088 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci_platform.ko 2023-07-14T12:25:16.088 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_acpi.ko 2023-07-14T12:25:16.088 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ali.ko 2023-07-14T12:25:16.088 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_amd.ko 2023-07-14T12:25:16.089 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_artop.ko 2023-07-14T12:25:16.089 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atiixp.ko 2023-07-14T12:25:16.089 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atp867x.ko 2023-07-14T12:25:16.089 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd640.ko 2023-07-14T12:25:16.089 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd64x.ko 2023-07-14T12:25:16.089 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cypress.ko 2023-07-14T12:25:16.089 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_efar.ko 2023-07-14T12:25:16.089 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt366.ko 2023-07-14T12:25:16.090 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt37x.ko 2023-07-14T12:25:16.090 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-14T12:25:16.090 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-14T12:25:16.090 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it8213.ko 2023-07-14T12:25:16.090 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it821x.ko 2023-07-14T12:25:16.090 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_jmicron.ko 2023-07-14T12:25:16.090 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_marvell.ko 2023-07-14T12:25:16.090 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_mpiix.ko 2023-07-14T12:25:16.091 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_netcell.ko 2023-07-14T12:25:16.091 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ninja32.ko 2023-07-14T12:25:16.091 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87410.ko 2023-07-14T12:25:16.091 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87415.ko 2023-07-14T12:25:16.091 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_oldpiix.ko 2023-07-14T12:25:16.091 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_opti.ko 2023-07-14T12:25:16.091 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_optidma.ko 2023-07-14T12:25:16.092 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pcmcia.ko 2023-07-14T12:25:16.092 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-14T12:25:16.092 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-14T12:25:16.092 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_piccolo.ko 2023-07-14T12:25:16.092 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rdc.ko 2023-07-14T12:25:16.092 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sch.ko 2023-07-14T12:25:16.092 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_serverworks.ko 2023-07-14T12:25:16.092 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sil680.ko 2023-07-14T12:25:16.093 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sis.ko 2023-07-14T12:25:16.093 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sl82c105.ko 2023-07-14T12:25:16.093 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_triflex.ko 2023-07-14T12:25:16.093 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_via.ko 2023-07-14T12:25:16.093 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pdc_adma.ko 2023-07-14T12:25:16.093 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_inic162x.ko 2023-07-14T12:25:16.093 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_mv.ko 2023-07-14T12:25:16.093 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_nv.ko 2023-07-14T12:25:16.094 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_promise.ko 2023-07-14T12:25:16.094 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_qstor.ko 2023-07-14T12:25:16.094 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil.ko 2023-07-14T12:25:16.094 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil24.ko 2023-07-14T12:25:16.094 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sis.ko 2023-07-14T12:25:16.094 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_svw.ko 2023-07-14T12:25:16.094 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sx4.ko 2023-07-14T12:25:16.094 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_uli.ko 2023-07-14T12:25:16.095 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_via.ko 2023-07-14T12:25:16.095 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_vsc.ko 2023-07-14T12:25:16.095 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay 2023-07-14T12:25:16.095 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ks0108.ko 2023-07-14T12:25:16.095 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base 2023-07-14T12:25:16.095 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap 2023-07-14T12:25:16.095 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-14T12:25:16.096 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-14T12:25:16.096 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma 2023-07-14T12:25:16.096 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/bcma.ko 2023-07-14T12:25:16.096 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block 2023-07-14T12:25:16.096 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe 2023-07-14T12:25:16.096 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/aoe.ko 2023-07-14T12:25:16.096 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/brd.ko 2023-07-14T12:25:16.096 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd 2023-07-14T12:25:16.097 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/drbd.ko 2023-07-14T12:25:16.097 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/floppy.ko 2023-07-14T12:25:16.097 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/loop.ko 2023-07-14T12:25:16.097 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx 2023-07-14T12:25:16.097 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-14T12:25:16.097 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/nbd.ko 2023-07-14T12:25:16.097 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk 2023-07-14T12:25:16.098 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/null_blk.ko 2023-07-14T12:25:16.098 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/pktcdvd.ko 2023-07-14T12:25:16.098 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/rbd.ko 2023-07-14T12:25:16.098 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/virtio_blk.ko 2023-07-14T12:25:16.098 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback 2023-07-14T12:25:16.098 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-14T12:25:16.098 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkfront.ko 2023-07-14T12:25:16.098 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram 2023-07-14T12:25:16.099 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/zram.ko 2023-07-14T12:25:16.099 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char 2023-07-14T12:25:16.099 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hangcheck-timer.ko 2023-07-14T12:25:16.099 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random 2023-07-14T12:25:16.099 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-14T12:25:16.099 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-14T12:25:16.099 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-14T12:25:16.099 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/via-rng.ko 2023-07-14T12:25:16.100 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-14T12:25:16.100 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi 2023-07-14T12:25:16.100 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-14T12:25:16.100 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-14T12:25:16.100 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-14T12:25:16.100 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-14T12:25:16.100 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-14T12:25:16.101 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-14T12:25:16.101 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/lp.ko 2023-07-14T12:25:16.101 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave 2023-07-14T12:25:16.101 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/mwave.ko 2023-07-14T12:25:16.101 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ppdev.ko 2023-07-14T12:25:16.101 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tlclk.ko 2023-07-14T12:25:16.101 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm 2023-07-14T12:25:16.101 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm.ko 2023-07-14T12:25:16.102 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-14T12:25:16.102 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-14T12:25:16.102 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-14T12:25:16.102 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-14T12:25:16.102 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-14T12:25:16.102 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/uv_mmtimer.ko 2023-07-14T12:25:16.102 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/virtio_console.ko 2023-07-14T12:25:16.102 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq 2023-07-14T12:25:16.103 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-14T12:25:16.103 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-14T12:25:16.103 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-14T12:25:16.103 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-14T12:25:16.103 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-14T12:25:16.103 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-14T12:25:16.103 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto 2023-07-14T12:25:16.103 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp 2023-07-14T12:25:16.104 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-14T12:25:16.104 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp.ko 2023-07-14T12:25:16.104 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel 2023-07-14T12:25:16.104 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat 2023-07-14T12:25:16.104 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common 2023-07-14T12:25:16.104 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-14T12:25:16.104 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-14T12:25:16.105 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-14T12:25:16.105 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-aes.ko 2023-07-14T12:25:16.105 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-sha.ko 2023-07-14T12:25:16.105 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio 2023-07-14T12:25:16.105 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-14T12:25:16.105 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca 2023-07-14T12:25:16.105 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/dca.ko 2023-07-14T12:25:16.105 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq 2023-07-14T12:25:16.106 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-14T12:25:16.106 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma 2023-07-14T12:25:16.106 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw 2023-07-14T12:25:16.106 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-14T12:25:16.106 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat 2023-07-14T12:25:16.106 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-14T12:25:16.106 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac 2023-07-14T12:25:16.107 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/amd64_edac.ko 2023-07-14T12:25:16.107 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/e752x_edac.ko 2023-07-14T12:25:16.107 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/edac_mce_amd.ko 2023-07-14T12:25:16.107 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3000_edac.ko 2023-07-14T12:25:16.107 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3200_edac.ko 2023-07-14T12:25:16.107 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5100_edac.ko 2023-07-14T12:25:16.107 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5400_edac.ko 2023-07-14T12:25:16.107 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7300_edac.ko 2023-07-14T12:25:16.108 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7core_edac.ko 2023-07-14T12:25:16.108 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i82975x_edac.ko 2023-07-14T12:25:16.108 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ie31200_edac.ko 2023-07-14T12:25:16.108 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/sb_edac.ko 2023-07-14T12:25:16.108 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/x38_edac.ko 2023-07-14T12:25:16.108 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware 2023-07-14T12:25:16.108 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/edd.ko 2023-07-14T12:25:16.109 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-14T12:25:16.109 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio 2023-07-14T12:25:16.109 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ich.ko 2023-07-14T12:25:16.109 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-14T12:25:16.109 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid 2023-07-14T12:25:16.109 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-appleir.ko 2023-07-14T12:25:16.109 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-aureal.ko 2023-07-14T12:25:16.109 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-axff.ko 2023-07-14T12:25:16.110 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-dr.ko 2023-07-14T12:25:16.110 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elecom.ko 2023-07-14T12:25:16.110 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elo.ko 2023-07-14T12:25:16.110 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-emsff.ko 2023-07-14T12:25:16.110 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gaff.ko 2023-07-14T12:25:16.110 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gt683r.ko 2023-07-14T12:25:16.110 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gyration.ko 2023-07-14T12:25:16.110 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-14T12:25:16.111 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-14T12:25:16.111 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtekff.ko 2023-07-14T12:25:16.111 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-hyperv.ko 2023-07-14T12:25:16.111 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-icade.ko 2023-07-14T12:25:16.111 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-keytouch.ko 2023-07-14T12:25:16.111 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kye.ko 2023-07-14T12:25:16.111 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lcpower.ko 2023-07-14T12:25:16.112 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-led.ko 2023-07-14T12:25:16.112 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lenovo.ko 2023-07-14T12:25:16.112 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-14T12:25:16.112 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-14T12:25:16.112 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-multitouch.ko 2023-07-14T12:25:16.112 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ortek.ko 2023-07-14T12:25:16.112 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-penmount.ko 2023-07-14T12:25:16.112 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-petalynx.ko 2023-07-14T12:25:16.113 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-picolcd.ko 2023-07-14T12:25:16.113 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-pl.ko 2023-07-14T12:25:16.113 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-plantronics.ko 2023-07-14T12:25:16.113 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-primax.ko 2023-07-14T12:25:16.113 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-rmi.ko 2023-07-14T12:25:16.113 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-14T12:25:16.113 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-common.ko 2023-07-14T12:25:16.113 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-14T12:25:16.114 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-14T12:25:16.114 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-14T12:25:16.114 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-14T12:25:16.114 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-14T12:25:16.114 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-14T12:25:16.114 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-14T12:25:16.114 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-14T12:25:16.114 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-14T12:25:16.115 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat.ko 2023-07-14T12:25:16.115 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-saitek.ko 2023-07-14T12:25:16.115 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-samsung.ko 2023-07-14T12:25:16.115 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-14T12:25:16.115 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sjoy.ko 2023-07-14T12:25:16.115 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sony.ko 2023-07-14T12:25:16.115 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-speedlink.ko 2023-07-14T12:25:16.116 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-steelseries.ko 2023-07-14T12:25:16.116 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sunplus.ko 2023-07-14T12:25:16.116 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-14T12:25:16.116 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tivo.ko 2023-07-14T12:25:16.116 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tmff.ko 2023-07-14T12:25:16.116 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-topseed.ko 2023-07-14T12:25:16.116 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-twinhan.ko 2023-07-14T12:25:16.116 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-uclogic.ko 2023-07-14T12:25:16.117 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-waltop.ko 2023-07-14T12:25:16.117 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-wiimote.ko 2023-07-14T12:25:16.117 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-xinmo.ko 2023-07-14T12:25:16.117 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zpff.ko 2023-07-14T12:25:16.117 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zydacron.ko 2023-07-14T12:25:16.117 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/uhid.ko 2023-07-14T12:25:16.117 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/wacom.ko 2023-07-14T12:25:16.117 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv 2023-07-14T12:25:16.118 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_balloon.ko 2023-07-14T12:25:16.118 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_utils.ko 2023-07-14T12:25:16.118 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_vmbus.ko 2023-07-14T12:25:16.118 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon 2023-07-14T12:25:16.118 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru.ko 2023-07-14T12:25:16.118 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru3.ko 2023-07-14T12:25:16.118 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-14T12:25:16.118 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7414.ko 2023-07-14T12:25:16.119 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7418.ko 2023-07-14T12:25:16.119 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adc128d818.ko 2023-07-14T12:25:16.119 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1025.ko 2023-07-14T12:25:16.119 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1026.ko 2023-07-14T12:25:16.119 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1029.ko 2023-07-14T12:25:16.119 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1031.ko 2023-07-14T12:25:16.119 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm9240.ko 2023-07-14T12:25:16.120 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ads7828.ko 2023-07-14T12:25:16.120 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7410.ko 2023-07-14T12:25:16.120 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7411.ko 2023-07-14T12:25:16.120 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7462.ko 2023-07-14T12:25:16.120 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7470.ko 2023-07-14T12:25:16.120 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7475.ko 2023-07-14T12:25:16.120 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7x10.ko 2023-07-14T12:25:16.120 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/amc6821.ko 2023-07-14T12:25:16.121 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/applesmc.ko 2023-07-14T12:25:16.121 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asb100.ko 2023-07-14T12:25:16.121 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asc7621.ko 2023-07-14T12:25:16.121 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-14T12:25:16.121 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/atxp1.ko 2023-07-14T12:25:16.121 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/coretemp.ko 2023-07-14T12:25:16.121 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-14T12:25:16.122 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dme1737.ko 2023-07-14T12:25:16.122 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds1621.ko 2023-07-14T12:25:16.122 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds620.ko 2023-07-14T12:25:16.122 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc1403.ko 2023-07-14T12:25:16.122 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc6w201.ko 2023-07-14T12:25:16.122 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71805f.ko 2023-07-14T12:25:16.122 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71882fg.ko 2023-07-14T12:25:16.122 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f75375s.ko 2023-07-14T12:25:16.123 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fam15h_power.ko 2023-07-14T12:25:16.123 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fschmd.ko 2023-07-14T12:25:16.123 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g760a.ko 2023-07-14T12:25:16.123 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g762.ko 2023-07-14T12:25:16.123 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl518sm.ko 2023-07-14T12:25:16.123 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl520sm.ko 2023-07-14T12:25:16.123 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-14T12:25:16.123 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5500_temp.ko 2023-07-14T12:25:16.124 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5k_amb.ko 2023-07-14T12:25:16.124 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmaem.ko 2023-07-14T12:25:16.124 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmpex.ko 2023-07-14T12:25:16.124 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina209.ko 2023-07-14T12:25:16.124 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina2xx.ko 2023-07-14T12:25:16.124 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/it87.ko 2023-07-14T12:25:16.124 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k10temp.ko 2023-07-14T12:25:16.125 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k8temp.ko 2023-07-14T12:25:16.125 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lineage-pem.ko 2023-07-14T12:25:16.125 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm63.ko 2023-07-14T12:25:16.125 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm73.ko 2023-07-14T12:25:16.125 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm75.ko 2023-07-14T12:25:16.125 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm77.ko 2023-07-14T12:25:16.125 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm78.ko 2023-07-14T12:25:16.125 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm80.ko 2023-07-14T12:25:16.126 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm83.ko 2023-07-14T12:25:16.126 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm85.ko 2023-07-14T12:25:16.126 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm87.ko 2023-07-14T12:25:16.126 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm90.ko 2023-07-14T12:25:16.126 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm92.ko 2023-07-14T12:25:16.126 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm93.ko 2023-07-14T12:25:16.126 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95234.ko 2023-07-14T12:25:16.126 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95241.ko 2023-07-14T12:25:16.127 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95245.ko 2023-07-14T12:25:16.127 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc2945.ko 2023-07-14T12:25:16.127 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4151.ko 2023-07-14T12:25:16.127 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4215.ko 2023-07-14T12:25:16.127 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4222.ko 2023-07-14T12:25:16.127 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4245.ko 2023-07-14T12:25:16.127 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4260.ko 2023-07-14T12:25:16.127 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4261.ko 2023-07-14T12:25:16.128 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max16065.ko 2023-07-14T12:25:16.128 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1619.ko 2023-07-14T12:25:16.128 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1668.ko 2023-07-14T12:25:16.128 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max197.ko 2023-07-14T12:25:16.128 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6639.ko 2023-07-14T12:25:16.128 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6650.ko 2023-07-14T12:25:16.128 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6697.ko 2023-07-14T12:25:16.129 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mcp3021.ko 2023-07-14T12:25:16.129 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6683.ko 2023-07-14T12:25:16.129 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775-core.ko 2023-07-14T12:25:16.129 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775.ko 2023-07-14T12:25:16.129 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct7802.ko 2023-07-14T12:25:16.129 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87360.ko 2023-07-14T12:25:16.129 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87427.ko 2023-07-14T12:25:16.129 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pcf8591.ko 2023-07-14T12:25:16.130 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus 2023-07-14T12:25:16.130 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-14T12:25:16.130 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-14T12:25:16.130 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-14T12:25:16.130 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-14T12:25:16.130 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-14T12:25:16.130 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-14T12:25:16.130 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-14T12:25:16.131 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-14T12:25:16.131 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-14T12:25:16.131 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-14T12:25:16.131 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-14T12:25:16.131 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-14T12:25:16.131 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/powr1220.ko 2023-07-14T12:25:16.131 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5627.ko 2023-07-14T12:25:16.132 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5636.ko 2023-07-14T12:25:16.132 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-14T12:25:16.132 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht15.ko 2023-07-14T12:25:16.132 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht21.ko 2023-07-14T12:25:16.132 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/shtc1.ko 2023-07-14T12:25:16.132 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sis5595.ko 2023-07-14T12:25:16.132 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47b397.ko 2023-07-14T12:25:16.133 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m1.ko 2023-07-14T12:25:16.133 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m192.ko 2023-07-14T12:25:16.133 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/thmc50.ko 2023-07-14T12:25:16.133 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp102.ko 2023-07-14T12:25:16.133 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp103.ko 2023-07-14T12:25:16.133 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp401.ko 2023-07-14T12:25:16.133 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp421.ko 2023-07-14T12:25:16.133 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via-cputemp.ko 2023-07-14T12:25:16.134 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via686a.ko 2023-07-14T12:25:16.134 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt1211.ko 2023-07-14T12:25:16.134 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt8231.ko 2023-07-14T12:25:16.134 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627ehf.ko 2023-07-14T12:25:16.134 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627hf.ko 2023-07-14T12:25:16.134 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83781d.ko 2023-07-14T12:25:16.134 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83791d.ko 2023-07-14T12:25:16.134 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83792d.ko 2023-07-14T12:25:16.135 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83793.ko 2023-07-14T12:25:16.135 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83795.ko 2023-07-14T12:25:16.135 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l785ts.ko 2023-07-14T12:25:16.135 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l786ng.ko 2023-07-14T12:25:16.135 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c 2023-07-14T12:25:16.135 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos 2023-07-14T12:25:16.135 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-14T12:25:16.135 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-14T12:25:16.136 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses 2023-07-14T12:25:16.136 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-14T12:25:16.136 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-14T12:25:16.136 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-14T12:25:16.136 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-14T12:25:16.136 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-14T12:25:16.136 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-14T12:25:16.137 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-14T12:25:16.137 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-14T12:25:16.137 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-14T12:25:16.137 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-14T12:25:16.137 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-14T12:25:16.137 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-14T12:25:16.137 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-14T12:25:16.137 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-14T12:25:16.138 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-14T12:25:16.138 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-14T12:25:16.138 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-14T12:25:16.138 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-14T12:25:16.138 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-14T12:25:16.138 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-14T12:25:16.138 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-14T12:25:16.139 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-14T12:25:16.139 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-14T12:25:16.139 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-dev.ko 2023-07-14T12:25:16.139 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-mux.ko 2023-07-14T12:25:16.139 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-14T12:25:16.139 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-smbus.ko 2023-07-14T12:25:16.139 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-stub.ko 2023-07-14T12:25:16.139 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband 2023-07-14T12:25:16.140 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core 2023-07-14T12:25:16.140 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-14T12:25:16.140 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_core.ko 2023-07-14T12:25:16.140 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-14T12:25:16.140 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-14T12:25:16.140 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-14T12:25:16.140 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-14T12:25:16.141 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-14T12:25:16.141 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw 2023-07-14T12:25:16.141 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4 2023-07-14T12:25:16.141 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-14T12:25:16.141 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4 2023-07-14T12:25:16.141 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-14T12:25:16.141 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5 2023-07-14T12:25:16.141 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-14T12:25:16.142 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca 2023-07-14T12:25:16.142 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-14T12:25:16.142 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp 2023-07-14T12:25:16.142 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib 2023-07-14T12:25:16.142 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-14T12:25:16.142 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser 2023-07-14T12:25:16.142 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-14T12:25:16.142 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert 2023-07-14T12:25:16.143 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-14T12:25:16.143 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp 2023-07-14T12:25:16.143 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-14T12:25:16.143 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt 2023-07-14T12:25:16.143 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-14T12:25:16.143 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input 2023-07-14T12:25:16.143 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport 2023-07-14T12:25:16.144 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-14T12:25:16.144 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-14T12:25:16.144 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/gameport.ko 2023-07-14T12:25:16.144 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/lightning.ko 2023-07-14T12:25:16.144 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ns558.ko 2023-07-14T12:25:16.144 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/joydev.ko 2023-07-14T12:25:16.144 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard 2023-07-14T12:25:16.144 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-14T12:25:16.145 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse 2023-07-14T12:25:16.145 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/appletouch.ko 2023-07-14T12:25:16.145 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/bcm5974.ko 2023-07-14T12:25:16.145 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/cyapatp.ko 2023-07-14T12:25:16.145 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-14T12:25:16.145 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/sermouse.ko 2023-07-14T12:25:16.145 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-14T12:25:16.145 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-14T12:25:16.146 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-14T12:25:16.146 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4 2023-07-14T12:25:16.146 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-14T12:25:16.146 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio 2023-07-14T12:25:16.146 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/altera_ps2.ko 2023-07-14T12:25:16.146 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/arc_ps2.ko 2023-07-14T12:25:16.146 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-14T12:25:16.146 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serio_raw.ko 2023-07-14T12:25:16.147 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/sparse-keymap.ko 2023-07-14T12:25:16.147 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu 2023-07-14T12:25:16.147 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd 2023-07-14T12:25:16.147 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-14T12:25:16.147 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds 2023-07-14T12:25:16.147 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-blinkm.ko 2023-07-14T12:25:16.147 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3530.ko 2023-07-14T12:25:16.148 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp3944.ko 2023-07-14T12:25:16.148 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-ss4200.ko 2023-07-14T12:25:16.148 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger 2023-07-14T12:25:16.148 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-14T12:25:16.148 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-14T12:25:16.148 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-14T12:25:16.148 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-14T12:25:16.148 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-14T12:25:16.149 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-14T12:25:16.149 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-14T12:25:16.149 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-14T12:25:16.149 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md 2023-07-14T12:25:16.149 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache 2023-07-14T12:25:16.149 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/bcache.ko 2023-07-14T12:25:16.149 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bio-prison.ko 2023-07-14T12:25:16.149 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache-smq.ko 2023-07-14T12:25:16.150 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache.ko 2023-07-14T12:25:16.150 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-crypt.ko 2023-07-14T12:25:16.150 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-delay.ko 2023-07-14T12:25:16.150 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-flakey.ko 2023-07-14T12:25:16.150 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log-userspace.ko 2023-07-14T12:25:16.150 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-multipath.ko 2023-07-14T12:25:16.150 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-queue-length.ko 2023-07-14T12:25:16.150 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-raid.ko 2023-07-14T12:25:16.151 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-round-robin.ko 2023-07-14T12:25:16.151 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-service-time.ko 2023-07-14T12:25:16.151 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-switch.ko 2023-07-14T12:25:16.151 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-thin-pool.ko 2023-07-14T12:25:16.151 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-verity.ko 2023-07-14T12:25:16.151 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/faulty.ko 2023-07-14T12:25:16.151 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/linear.ko 2023-07-14T12:25:16.152 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/multipath.ko 2023-07-14T12:25:16.152 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data 2023-07-14T12:25:16.152 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-14T12:25:16.152 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid0.ko 2023-07-14T12:25:16.152 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid1.ko 2023-07-14T12:25:16.152 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid10.ko 2023-07-14T12:25:16.152 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid456.ko 2023-07-14T12:25:16.152 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message 2023-07-14T12:25:16.153 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion 2023-07-14T12:25:16.153 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptbase.ko 2023-07-14T12:25:16.153 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptctl.ko 2023-07-14T12:25:16.153 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptfc.ko 2023-07-14T12:25:16.153 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptlan.ko 2023-07-14T12:25:16.153 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptsas.ko 2023-07-14T12:25:16.153 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptscsih.ko 2023-07-14T12:25:16.154 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptspi.ko 2023-07-14T12:25:16.154 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd 2023-07-14T12:25:16.154 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_ich.ko 2023-07-14T12:25:16.154 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_sch.ko 2023-07-14T12:25:16.154 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mfd-core.ko 2023-07-14T12:25:16.154 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/sm501.ko 2023-07-14T12:25:16.154 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/viperboard.ko 2023-07-14T12:25:16.154 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/vx855.ko 2023-07-14T12:25:16.155 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wl1273-core.ko 2023-07-14T12:25:16.155 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc 2023-07-14T12:25:16.155 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl 2023-07-14T12:25:16.155 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-14T12:25:16.155 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds9802als.ko 2023-07-14T12:25:16.155 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds990x.ko 2023-07-14T12:25:16.155 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/bh1770glc.ko 2023-07-14T12:25:16.155 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710 2023-07-14T12:25:16.156 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/cb710.ko 2023-07-14T12:25:16.156 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom 2023-07-14T12:25:16.156 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/at24.ko 2023-07-14T12:25:16.156 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-14T12:25:16.156 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-14T12:25:16.156 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/max6875.ko 2023-07-14T12:25:16.156 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/enclosure.ko 2023-07-14T12:25:16.156 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hpilo.ko 2023-07-14T12:25:16.157 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29003.ko 2023-07-14T12:25:16.157 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29020.ko 2023-07-14T12:25:16.157 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d 2023-07-14T12:25:16.157 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-14T12:25:16.157 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-14T12:25:16.157 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei 2023-07-14T12:25:16.157 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-me.ko 2023-07-14T12:25:16.158 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-txe.ko 2023-07-14T12:25:16.158 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei.ko 2023-07-14T12:25:16.158 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru 2023-07-14T12:25:16.158 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-14T12:25:16.158 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp 2023-07-14T12:25:16.158 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-14T12:25:16.158 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-14T12:25:16.158 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-14T12:25:16.159 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_7xx1.ko 2023-07-14T12:25:16.159 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_core.ko 2023-07-14T12:25:16.159 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tsl2550.ko 2023-07-14T12:25:16.159 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_balloon.ko 2023-07-14T12:25:16.159 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci 2023-07-14T12:25:16.159 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-14T12:25:16.159 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net 2023-07-14T12:25:16.159 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding 2023-07-14T12:25:16.160 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/bonding.ko 2023-07-14T12:25:16.160 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa 2023-07-14T12:25:16.160 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53 2023-07-14T12:25:16.160 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-14T12:25:16.160 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-14T12:25:16.160 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-14T12:25:16.160 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx 2023-07-14T12:25:16.160 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-14T12:25:16.161 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dummy.ko 2023-07-14T12:25:16.161 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/eql.ko 2023-07-14T12:25:16.161 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet 2023-07-14T12:25:16.161 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com 2023-07-14T12:25:16.161 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-14T12:25:16.161 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-14T12:25:16.161 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-14T12:25:16.162 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-14T12:25:16.162 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390 2023-07-14T12:25:16.162 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-14T12:25:16.162 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-14T12:25:16.162 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-14T12:25:16.162 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-14T12:25:16.162 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec 2023-07-14T12:25:16.162 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-14T12:25:16.163 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere 2023-07-14T12:25:16.163 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-14T12:25:16.163 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon 2023-07-14T12:25:16.163 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-14T12:25:16.163 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera 2023-07-14T12:25:16.163 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-14T12:25:16.163 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd 2023-07-14T12:25:16.163 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-14T12:25:16.164 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-14T12:25:16.164 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-14T12:25:16.164 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros 2023-07-14T12:25:16.164 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx 2023-07-14T12:25:16.164 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-14T12:25:16.164 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-14T12:25:16.164 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-14T12:25:16.164 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-14T12:25:16.165 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-14T12:25:16.165 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx 2023-07-14T12:25:16.165 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-14T12:25:16.165 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-14T12:25:16.165 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom 2023-07-14T12:25:16.165 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-14T12:25:16.165 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-14T12:25:16.166 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-14T12:25:16.166 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-14T12:25:16.166 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-14T12:25:16.166 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet 2023-07-14T12:25:16.166 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-14T12:25:16.166 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-14T12:25:16.166 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade 2023-07-14T12:25:16.166 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna 2023-07-14T12:25:16.167 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-14T12:25:16.167 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio 2023-07-14T12:25:16.167 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-14T12:25:16.167 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-14T12:25:16.167 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-14T12:25:16.167 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-14T12:25:16.167 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-14T12:25:16.167 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-14T12:25:16.168 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-14T12:25:16.168 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-14T12:25:16.168 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-14T12:25:16.168 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-14T12:25:16.168 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco 2023-07-14T12:25:16.168 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic 2023-07-14T12:25:16.168 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-14T12:25:16.169 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec 2023-07-14T12:25:16.169 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip 2023-07-14T12:25:16.169 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-14T12:25:16.169 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-14T12:25:16.169 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-14T12:25:16.169 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-14T12:25:16.169 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-14T12:25:16.169 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-14T12:25:16.170 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink 2023-07-14T12:25:16.170 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-14T12:25:16.170 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-14T12:25:16.170 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dnet.ko 2023-07-14T12:25:16.170 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex 2023-07-14T12:25:16.170 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet 2023-07-14T12:25:16.170 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-14T12:25:16.170 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ethoc.ko 2023-07-14T12:25:16.171 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fealnx.ko 2023-07-14T12:25:16.171 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel 2023-07-14T12:25:16.171 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-14T12:25:16.171 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000 2023-07-14T12:25:16.171 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-14T12:25:16.171 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e 2023-07-14T12:25:16.171 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-14T12:25:16.171 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k 2023-07-14T12:25:16.172 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-14T12:25:16.172 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e 2023-07-14T12:25:16.172 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-14T12:25:16.172 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf 2023-07-14T12:25:16.172 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-14T12:25:16.172 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb 2023-07-14T12:25:16.172 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-14T12:25:16.173 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf 2023-07-14T12:25:16.173 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-14T12:25:16.173 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-14T12:25:16.173 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-14T12:25:16.173 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-14T12:25:16.173 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-14T12:25:16.173 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/jme.ko 2023-07-14T12:25:16.173 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell 2023-07-14T12:25:16.174 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-14T12:25:16.174 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-14T12:25:16.174 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-14T12:25:16.174 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox 2023-07-14T12:25:16.174 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-14T12:25:16.174 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-14T12:25:16.174 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-14T12:25:16.174 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-14T12:25:16.175 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-14T12:25:16.175 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-14T12:25:16.175 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel 2023-07-14T12:25:16.175 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-14T12:25:16.175 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom 2023-07-14T12:25:16.175 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-14T12:25:16.175 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-14T12:25:16.176 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi 2023-07-14T12:25:16.176 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-14T12:25:16.176 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-14T12:25:16.176 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion 2023-07-14T12:25:16.176 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-14T12:25:16.176 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia 2023-07-14T12:25:16.176 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-14T12:25:16.176 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines 2023-07-14T12:25:16.177 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-14T12:25:16.177 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-14T12:25:16.177 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic 2023-07-14T12:25:16.177 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-14T12:25:16.177 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-14T12:25:16.177 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-14T12:25:16.177 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-14T12:25:16.177 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-14T12:25:16.178 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc 2023-07-14T12:25:16.178 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-14T12:25:16.178 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek 2023-07-14T12:25:16.178 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-14T12:25:16.178 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-14T12:25:16.178 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-14T12:25:16.178 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-14T12:25:16.179 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker 2023-07-14T12:25:16.179 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-14T12:25:16.179 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc 2023-07-14T12:25:16.179 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-14T12:25:16.179 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan 2023-07-14T12:25:16.179 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-14T12:25:16.179 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis 2023-07-14T12:25:16.180 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-14T12:25:16.180 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-14T12:25:16.180 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc 2023-07-14T12:25:16.180 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-14T12:25:16.180 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-14T12:25:16.180 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-14T12:25:16.180 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-14T12:25:16.180 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro 2023-07-14T12:25:16.181 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-14T12:25:16.181 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-14T12:25:16.181 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-14T12:25:16.181 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun 2023-07-14T12:25:16.181 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-14T12:25:16.181 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-14T12:25:16.181 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-14T12:25:16.182 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-14T12:25:16.182 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti 2023-07-14T12:25:16.182 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-14T12:25:16.182 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti 2023-07-14T12:25:16.182 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-14T12:25:16.182 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via 2023-07-14T12:25:16.182 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-14T12:25:16.182 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-14T12:25:16.183 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet 2023-07-14T12:25:16.183 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-14T12:25:16.183 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-14T12:25:16.183 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom 2023-07-14T12:25:16.183 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-14T12:25:16.183 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/geneve.ko 2023-07-14T12:25:16.183 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv 2023-07-14T12:25:16.183 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-14T12:25:16.184 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154 2023-07-14T12:25:16.184 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-14T12:25:16.184 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ifb.ko 2023-07-14T12:25:16.184 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan 2023-07-14T12:25:16.184 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-14T12:25:16.184 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvlan.ko 2023-07-14T12:25:16.184 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvtap.ko 2023-07-14T12:25:16.185 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio 2023-07-14T12:25:16.185 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio.ko 2023-07-14T12:25:16.185 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-14T12:25:16.185 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-14T12:25:16.185 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-14T12:25:16.185 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mii.ko 2023-07-14T12:25:16.185 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/net_failover.ko 2023-07-14T12:25:16.185 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/netconsole.ko 2023-07-14T12:25:16.186 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/nlmon.ko 2023-07-14T12:25:16.186 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs 2023-07-14T12:25:16.186 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-14T12:25:16.186 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-14T12:25:16.186 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy 2023-07-14T12:25:16.186 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/amd.ko 2023-07-14T12:25:16.186 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-14T12:25:16.186 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-14T12:25:16.187 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-14T12:25:16.187 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm87xx.ko 2023-07-14T12:25:16.187 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/broadcom.ko 2023-07-14T12:25:16.187 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/cicada.ko 2023-07-14T12:25:16.187 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/davicom.ko 2023-07-14T12:25:16.187 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/dp83640.ko 2023-07-14T12:25:16.187 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/et1011c.ko 2023-07-14T12:25:16.187 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/icplus.ko 2023-07-14T12:25:16.188 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/lxt.ko 2023-07-14T12:25:16.188 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/marvell.ko 2023-07-14T12:25:16.188 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/micrel.ko 2023-07-14T12:25:16.188 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/national.ko 2023-07-14T12:25:16.188 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/phylink.ko 2023-07-14T12:25:16.188 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/qsemi.ko 2023-07-14T12:25:16.188 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/realtek.ko 2023-07-14T12:25:16.189 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/smsc.ko 2023-07-14T12:25:16.189 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ste10Xp.ko 2023-07-14T12:25:16.189 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/vitesse.ko 2023-07-14T12:25:16.189 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp 2023-07-14T12:25:16.189 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-14T12:25:16.189 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_async.ko 2023-07-14T12:25:16.189 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-14T12:25:16.189 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-14T12:25:16.190 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-14T12:25:16.190 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-14T12:25:16.190 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppoe.ko 2023-07-14T12:25:16.190 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppox.ko 2023-07-14T12:25:16.190 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pptp.ko 2023-07-14T12:25:16.190 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip 2023-07-14T12:25:16.190 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slhc.ko 2023-07-14T12:25:16.190 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slip.ko 2023-07-14T12:25:16.191 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sungem_phy.ko 2023-07-14T12:25:16.191 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tap.ko 2023-07-14T12:25:16.191 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team 2023-07-14T12:25:16.191 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team.ko 2023-07-14T12:25:16.191 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-14T12:25:16.191 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-14T12:25:16.191 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-14T12:25:16.191 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_random.ko 2023-07-14T12:25:16.192 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-14T12:25:16.192 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tun.ko 2023-07-14T12:25:16.192 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/veth.ko 2023-07-14T12:25:16.192 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/virtio_net.ko 2023-07-14T12:25:16.192 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3 2023-07-14T12:25:16.192 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-14T12:25:16.192 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan 2023-07-14T12:25:16.193 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/vxlan.ko 2023-07-14T12:25:16.193 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback 2023-07-14T12:25:16.193 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-14T12:25:16.193 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netfront.ko 2023-07-14T12:25:16.193 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb 2023-07-14T12:25:16.193 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ntb.ko 2023-07-14T12:25:16.193 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme 2023-07-14T12:25:16.193 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host 2023-07-14T12:25:16.194 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme-core.ko 2023-07-14T12:25:16.194 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme.ko 2023-07-14T12:25:16.194 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport 2023-07-14T12:25:16.194 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport.ko 2023-07-14T12:25:16.194 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_cs.ko 2023-07-14T12:25:16.194 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_pc.ko 2023-07-14T12:25:16.194 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_serial.ko 2023-07-14T12:25:16.194 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci 2023-07-14T12:25:16.195 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug 2023-07-14T12:25:16.195 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-14T12:25:16.195 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie 2023-07-14T12:25:16.195 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-14T12:25:16.195 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/xen-pcifront.ko 2023-07-14T12:25:16.195 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia 2023-07-14T12:25:16.195 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/i82092.ko 2023-07-14T12:25:16.195 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pd6729.ko 2023-07-14T12:25:16.196 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-14T12:25:16.196 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl 2023-07-14T12:25:16.196 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel 2023-07-14T12:25:16.196 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-14T12:25:16.196 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform 2023-07-14T12:25:16.196 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86 2023-07-14T12:25:16.196 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-14T12:25:16.197 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acerhdf.ko 2023-07-14T12:25:16.197 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-14T12:25:16.197 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-14T12:25:16.197 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-14T12:25:16.197 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-14T12:25:16.197 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-14T12:25:16.197 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-14T12:25:16.197 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-14T12:25:16.198 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-14T12:25:16.198 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-14T12:25:16.198 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/hdaps.ko 2023-07-14T12:25:16.198 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel 2023-07-14T12:25:16.198 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-14T12:25:16.198 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel_ips.ko 2023-07-14T12:25:16.198 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-14T12:25:16.198 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-14T12:25:16.199 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-14T12:25:16.199 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-14T12:25:16.199 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-14T12:25:16.199 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-14T12:25:16.199 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-14T12:25:16.199 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-14T12:25:16.199 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-14T12:25:16.199 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi.ko 2023-07-14T12:25:16.200 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap 2023-07-14T12:25:16.200 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-14T12:25:16.200 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-14T12:25:16.200 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps 2023-07-14T12:25:16.200 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients 2023-07-14T12:25:16.200 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-14T12:25:16.200 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-14T12:25:16.201 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps_parport.ko 2023-07-14T12:25:16.201 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/pps_core.ko 2023-07-14T12:25:16.201 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp 2023-07-14T12:25:16.201 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp.ko 2023-07-14T12:25:16.201 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp_kvm.ko 2023-07-14T12:25:16.201 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc 2023-07-14T12:25:16.201 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-14T12:25:16.201 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-14T12:25:16.202 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-14T12:25:16.202 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-14T12:25:16.202 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-14T12:25:16.202 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-14T12:25:16.202 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-14T12:25:16.202 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-14T12:25:16.202 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-14T12:25:16.202 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-14T12:25:16.203 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-14T12:25:16.203 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-em3027.ko 2023-07-14T12:25:16.203 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-14T12:25:16.203 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-14T12:25:16.203 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-14T12:25:16.203 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-14T12:25:16.203 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-14T12:25:16.204 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-14T12:25:16.204 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max6900.ko 2023-07-14T12:25:16.204 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-14T12:25:16.204 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-14T12:25:16.204 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-14T12:25:16.204 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-14T12:25:16.204 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-14T12:25:16.205 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-14T12:25:16.205 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-14T12:25:16.205 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-14T12:25:16.205 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-14T12:25:16.205 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-14T12:25:16.205 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-14T12:25:16.205 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-14T12:25:16.205 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-x1205.ko 2023-07-14T12:25:16.206 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi 2023-07-14T12:25:16.206 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-9xxx.ko 2023-07-14T12:25:16.206 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-sas.ko 2023-07-14T12:25:16.206 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-xxxx.ko 2023-07-14T12:25:16.206 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/BusLogic.ko 2023-07-14T12:25:16.206 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/a100u2w.ko 2023-07-14T12:25:16.206 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid 2023-07-14T12:25:16.207 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-14T12:25:16.207 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/advansys.ko 2023-07-14T12:25:16.207 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx 2023-07-14T12:25:16.207 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-14T12:25:16.207 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-14T12:25:16.207 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/am53c974.ko 2023-07-14T12:25:16.207 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr 2023-07-14T12:25:16.207 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-14T12:25:16.208 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/atp870u.ko 2023-07-14T12:25:16.208 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi 2023-07-14T12:25:16.208 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-14T12:25:16.208 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa 2023-07-14T12:25:16.208 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/bfa.ko 2023-07-14T12:25:16.208 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc 2023-07-14T12:25:16.208 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-14T12:25:16.209 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i 2023-07-14T12:25:16.209 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-14T12:25:16.209 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ch.ko 2023-07-14T12:25:16.209 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor 2023-07-14T12:25:16.209 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-14T12:25:16.209 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi 2023-07-14T12:25:16.209 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-14T12:25:16.209 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-14T12:25:16.210 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-14T12:25:16.210 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-14T12:25:16.210 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-14T12:25:16.210 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dc395x.ko 2023-07-14T12:25:16.210 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler 2023-07-14T12:25:16.210 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-14T12:25:16.210 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-14T12:25:16.210 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-14T12:25:16.211 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-14T12:25:16.211 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dmx3191d.ko 2023-07-14T12:25:16.211 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r 2023-07-14T12:25:16.211 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-14T12:25:16.211 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esp_scsi.ko 2023-07-14T12:25:16.211 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe 2023-07-14T12:25:16.211 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-14T12:25:16.211 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-14T12:25:16.212 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic 2023-07-14T12:25:16.212 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/fnic.ko 2023-07-14T12:25:16.212 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hpsa.ko 2023-07-14T12:25:16.212 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hptiop.ko 2023-07-14T12:25:16.212 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hv_storvsc.ko 2023-07-14T12:25:16.212 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/initio.ko 2023-07-14T12:25:16.212 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ipr.ko 2023-07-14T12:25:16.212 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ips.ko 2023-07-14T12:25:16.213 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci 2023-07-14T12:25:16.213 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/isci.ko 2023-07-14T12:25:16.213 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-14T12:25:16.213 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-14T12:25:16.213 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc 2023-07-14T12:25:16.213 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/libfc.ko 2023-07-14T12:25:16.213 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi.ko 2023-07-14T12:25:16.214 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-14T12:25:16.214 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas 2023-07-14T12:25:16.214 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/libsas.ko 2023-07-14T12:25:16.214 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc 2023-07-14T12:25:16.214 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-14T12:25:16.214 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid 2023-07-14T12:25:16.214 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid.ko 2023-07-14T12:25:16.214 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-14T12:25:16.215 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-14T12:25:16.215 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-14T12:25:16.215 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas 2023-07-14T12:25:16.215 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-14T12:25:16.215 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas 2023-07-14T12:25:16.215 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-14T12:25:16.215 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvumi.ko 2023-07-14T12:25:16.215 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001 2023-07-14T12:25:16.216 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-14T12:25:16.216 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pmcraid.ko 2023-07-14T12:25:16.216 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla1280.ko 2023-07-14T12:25:16.216 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx 2023-07-14T12:25:16.216 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-14T12:25:16.216 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-14T12:25:16.216 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx 2023-07-14T12:25:16.216 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-14T12:25:16.217 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/raid_class.ko 2023-07-14T12:25:16.217 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_debug.ko 2023-07-14T12:25:16.217 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-14T12:25:16.217 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-14T12:25:16.217 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-14T12:25:16.217 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-14T12:25:16.217 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-14T12:25:16.218 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ses.ko 2023-07-14T12:25:16.218 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/st.ko 2023-07-14T12:25:16.218 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/stex.ko 2023-07-14T12:25:16.218 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2 2023-07-14T12:25:16.218 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-14T12:25:16.218 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/virtio_scsi.ko 2023-07-14T12:25:16.218 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-14T12:25:16.218 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/wd719x.ko 2023-07-14T12:25:16.219 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb 2023-07-14T12:25:16.219 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ssb.ko 2023-07-14T12:25:16.219 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target 2023-07-14T12:25:16.219 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi 2023-07-14T12:25:16.219 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-14T12:25:16.219 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback 2023-07-14T12:25:16.219 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-14T12:25:16.219 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_file.ko 2023-07-14T12:25:16.220 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_iblock.ko 2023-07-14T12:25:16.220 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_mod.ko 2023-07-14T12:25:16.220 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_pscsi.ko 2023-07-14T12:25:16.220 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_user.ko 2023-07-14T12:25:16.220 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc 2023-07-14T12:25:16.220 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-14T12:25:16.220 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal 2023-07-14T12:25:16.221 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel 2023-07-14T12:25:16.221 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal 2023-07-14T12:25:16.221 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-14T12:25:16.221 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-14T12:25:16.221 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-14T12:25:16.221 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-14T12:25:16.221 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-14T12:25:16.221 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-14T12:25:16.222 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-14T12:25:16.222 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-14T12:25:16.222 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-14T12:25:16.222 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-14T12:25:16.222 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-14T12:25:16.222 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-14T12:25:16.222 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-14T12:25:16.222 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-14T12:25:16.223 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-14T12:25:16.223 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty 2023-07-14T12:25:16.223 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless 2023-07-14T12:25:16.223 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-14T12:25:16.223 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_gsm.ko 2023-07-14T12:25:16.223 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_hdlc.ko 2023-07-14T12:25:16.223 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/nozomi.ko 2023-07-14T12:25:16.224 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial 2023-07-14T12:25:16.224 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250 2023-07-14T12:25:16.224 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-14T12:25:16.224 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/arc_uart.ko 2023-07-14T12:25:16.224 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm 2023-07-14T12:25:16.224 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-14T12:25:16.224 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/synclink_gt.ko 2023-07-14T12:25:16.224 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs 2023-07-14T12:25:16.225 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core 2023-07-14T12:25:16.225 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-14T12:25:16.225 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host 2023-07-14T12:25:16.225 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-14T12:25:16.225 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio 2023-07-14T12:25:16.225 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio.ko 2023-07-14T12:25:16.225 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_aec.ko 2023-07-14T12:25:16.225 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_cif.ko 2023-07-14T12:25:16.226 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pci_generic.ko 2023-07-14T12:25:16.226 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_sercos3.ko 2023-07-14T12:25:16.226 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb 2023-07-14T12:25:16.226 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class 2023-07-14T12:25:16.226 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-acm.ko 2023-07-14T12:25:16.226 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-14T12:25:16.226 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usblp.ko 2023-07-14T12:25:16.226 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usbtmc.ko 2023-07-14T12:25:16.227 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host 2023-07-14T12:25:16.227 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-14T12:25:16.227 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image 2023-07-14T12:25:16.227 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/mdc800.ko 2023-07-14T12:25:16.227 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/microtek.ko 2023-07-14T12:25:16.227 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc 2023-07-14T12:25:16.227 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/adutux.ko 2023-07-14T12:25:16.228 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/appledisplay.ko 2023-07-14T12:25:16.228 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi26.ko 2023-07-14T12:25:16.228 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi62.ko 2023-07-14T12:25:16.228 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ezusb.ko 2023-07-14T12:25:16.228 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/idmouse.ko 2023-07-14T12:25:16.228 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/iowarrior.ko 2023-07-14T12:25:16.228 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-14T12:25:16.228 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ldusb.ko 2023-07-14T12:25:16.229 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/legousbtower.ko 2023-07-14T12:25:16.229 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga 2023-07-14T12:25:16.229 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-14T12:25:16.229 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-14T12:25:16.229 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usb3503.ko 2023-07-14T12:25:16.229 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usblcd.ko 2023-07-14T12:25:16.229 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-14T12:25:16.229 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/uss720.ko 2023-07-14T12:25:16.230 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/yurex.ko 2023-07-14T12:25:16.230 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy 2023-07-14T12:25:16.230 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-generic.ko 2023-07-14T12:25:16.230 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial 2023-07-14T12:25:16.230 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/aircable.ko 2023-07-14T12:25:16.230 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ark3116.ko 2023-07-14T12:25:16.230 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-14T12:25:16.230 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ch341.ko 2023-07-14T12:25:16.231 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cp210x.ko 2023-07-14T12:25:16.231 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cyberjack.ko 2023-07-14T12:25:16.231 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-14T12:25:16.231 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-14T12:25:16.231 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/empeg.ko 2023-07-14T12:25:16.231 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-14T12:25:16.231 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-14T12:25:16.231 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-14T12:25:16.232 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_ti.ko 2023-07-14T12:25:16.232 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipaq.ko 2023-07-14T12:25:16.232 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipw.ko 2023-07-14T12:25:16.232 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ir-usb.ko 2023-07-14T12:25:16.232 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-14T12:25:16.232 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan.ko 2023-07-14T12:25:16.232 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-14T12:25:16.233 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-14T12:25:16.233 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-14T12:25:16.233 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mct_u232.ko 2023-07-14T12:25:16.233 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7720.ko 2023-07-14T12:25:16.233 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7840.ko 2023-07-14T12:25:16.233 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/navman.ko 2023-07-14T12:25:16.233 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/omninet.ko 2023-07-14T12:25:16.233 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/opticon.ko 2023-07-14T12:25:16.234 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/option.ko 2023-07-14T12:25:16.234 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/oti6858.ko 2023-07-14T12:25:16.234 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/pl2303.ko 2023-07-14T12:25:16.234 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcaux.ko 2023-07-14T12:25:16.234 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcserial.ko 2023-07-14T12:25:16.234 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/quatech2.ko 2023-07-14T12:25:16.234 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/safe_serial.ko 2023-07-14T12:25:16.234 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/sierra.ko 2023-07-14T12:25:16.235 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-14T12:25:16.235 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ssu100.ko 2023-07-14T12:25:16.235 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/symbolserial.ko 2023-07-14T12:25:16.235 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-14T12:25:16.235 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-14T12:25:16.235 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_debug.ko 2023-07-14T12:25:16.235 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-14T12:25:16.235 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/visor.ko 2023-07-14T12:25:16.236 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/whiteheat.ko 2023-07-14T12:25:16.236 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-14T12:25:16.236 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage 2023-07-14T12:25:16.236 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/uas.ko 2023-07-14T12:25:16.236 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-14T12:25:16.236 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-14T12:25:16.236 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-14T12:25:16.236 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-14T12:25:16.237 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-14T12:25:16.237 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-14T12:25:16.237 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-14T12:25:16.237 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-karma.ko 2023-07-14T12:25:16.237 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-14T12:25:16.237 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-14T12:25:16.237 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-14T12:25:16.238 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-14T12:25:16.238 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-14T12:25:16.238 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/usb-storage.ko 2023-07-14T12:25:16.238 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip 2023-07-14T12:25:16.238 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-14T12:25:16.238 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-14T12:25:16.238 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-14T12:25:16.238 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio 2023-07-14T12:25:16.239 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci 2023-07-14T12:25:16.239 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-14T12:25:16.239 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-14T12:25:16.239 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio.ko 2023-07-14T12:25:16.239 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-14T12:25:16.239 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost 2023-07-14T12:25:16.239 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost.ko 2023-07-14T12:25:16.239 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-14T12:25:16.240 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_net.ko 2023-07-14T12:25:16.240 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_scsi.ko 2023-07-14T12:25:16.240 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video 2023-07-14T12:25:16.240 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight 2023-07-14T12:25:16.240 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/apple_bl.ko 2023-07-14T12:25:16.240 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lcd.ko 2023-07-14T12:25:16.240 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-14T12:25:16.241 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio 2023-07-14T12:25:16.241 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio.ko 2023-07-14T12:25:16.241 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_balloon.ko 2023-07-14T12:25:16.241 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_mmio.ko 2023-07-14T12:25:16.241 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci.ko 2023-07-14T12:25:16.241 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-14T12:25:16.241 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-14T12:25:16.241 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_ring.ko 2023-07-14T12:25:16.242 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1 2023-07-14T12:25:16.242 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters 2023-07-14T12:25:16.242 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2482.ko 2023-07-14T12:25:16.242 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2490.ko 2023-07-14T12:25:16.242 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves 2023-07-14T12:25:16.242 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-14T12:25:16.242 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-14T12:25:16.242 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-14T12:25:16.243 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-14T12:25:16.243 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-14T12:25:16.243 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-14T12:25:16.243 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-14T12:25:16.243 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-14T12:25:16.243 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-14T12:25:16.243 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-14T12:25:16.243 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-14T12:25:16.244 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/wire.ko 2023-07-14T12:25:16.244 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog 2023-07-14T12:25:16.244 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-14T12:25:16.244 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-14T12:25:16.244 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-14T12:25:16.244 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/hpwdt.ko 2023-07-14T12:25:16.244 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/i6300esb.ko 2023-07-14T12:25:16.245 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-14T12:25:16.245 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-14T12:25:16.245 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ib700wdt.ko 2023-07-14T12:25:16.245 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ibmasr.ko 2023-07-14T12:25:16.245 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-14T12:25:16.245 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-14T12:25:16.245 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it87_wdt.ko 2023-07-14T12:25:16.245 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/machzwd.ko 2023-07-14T12:25:16.246 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/nv_tco.ko 2023-07-14T12:25:16.246 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-14T12:25:16.246 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-14T12:25:16.246 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-14T12:25:16.246 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-14T12:25:16.246 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/softdog.ko 2023-07-14T12:25:16.246 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-14T12:25:16.246 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/via_wdt.ko 2023-07-14T12:25:16.247 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-14T12:25:16.247 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-14T12:25:16.247 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-14T12:25:16.247 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wdt_pci.ko 2023-07-14T12:25:16.247 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/xen_wdt.ko 2023-07-14T12:25:16.247 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen 2023-07-14T12:25:16.247 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-14T12:25:16.247 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-evtchn.ko 2023-07-14T12:25:16.248 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntalloc.ko 2023-07-14T12:25:16.248 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntdev.ko 2023-07-14T12:25:16.248 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback 2023-07-14T12:25:16.248 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-14T12:25:16.248 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-privcmd.ko 2023-07-14T12:25:16.248 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs 2023-07-14T12:25:16.248 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-14T12:25:16.248 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs 2023-07-14T12:25:16.249 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p 2023-07-14T12:25:16.249 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/9p.ko 2023-07-14T12:25:16.249 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs 2023-07-14T12:25:16.249 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/affs.ko 2023-07-14T12:25:16.249 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs 2023-07-14T12:25:16.249 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/befs.ko 2023-07-14T12:25:16.249 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/binfmt_misc.ko 2023-07-14T12:25:16.250 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs 2023-07-14T12:25:16.250 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/btrfs.ko 2023-07-14T12:25:16.250 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles 2023-07-14T12:25:16.250 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/cachefiles.ko 2023-07-14T12:25:16.250 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph 2023-07-14T12:25:16.250 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ceph.ko 2023-07-14T12:25:16.250 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda 2023-07-14T12:25:16.250 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/coda.ko 2023-07-14T12:25:16.251 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs 2023-07-14T12:25:16.251 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/cramfs.ko 2023-07-14T12:25:16.251 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm 2023-07-14T12:25:16.251 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/dlm.ko 2023-07-14T12:25:16.251 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs 2023-07-14T12:25:16.251 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-14T12:25:16.251 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs 2023-07-14T12:25:16.251 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/f2fs.ko 2023-07-14T12:25:16.252 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat 2023-07-14T12:25:16.252 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/fat.ko 2023-07-14T12:25:16.252 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/msdos.ko 2023-07-14T12:25:16.252 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/vfat.ko 2023-07-14T12:25:16.252 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache 2023-07-14T12:25:16.252 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/fscache.ko 2023-07-14T12:25:16.252 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse 2023-07-14T12:25:16.253 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/cuse.ko 2023-07-14T12:25:16.253 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/fuse.ko 2023-07-14T12:25:16.253 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2 2023-07-14T12:25:16.253 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/gfs2.ko 2023-07-14T12:25:16.253 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs 2023-07-14T12:25:16.253 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/hfs.ko 2023-07-14T12:25:16.253 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus 2023-07-14T12:25:16.253 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/hfsplus.ko 2023-07-14T12:25:16.254 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs 2023-07-14T12:25:16.254 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/isofs.ko 2023-07-14T12:25:16.254 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs 2023-07-14T12:25:16.254 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/jfs.ko 2023-07-14T12:25:16.254 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd 2023-07-14T12:25:16.254 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/lockd.ko 2023-07-14T12:25:16.254 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix 2023-07-14T12:25:16.254 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/minix.ko 2023-07-14T12:25:16.255 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs 2023-07-14T12:25:16.255 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/netfs.ko 2023-07-14T12:25:16.255 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs 2023-07-14T12:25:16.255 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout 2023-07-14T12:25:16.255 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-14T12:25:16.255 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout 2023-07-14T12:25:16.255 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-14T12:25:16.255 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout 2023-07-14T12:25:16.256 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-14T12:25:16.256 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfs.ko 2023-07-14T12:25:16.256 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv3.ko 2023-07-14T12:25:16.256 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv4.ko 2023-07-14T12:25:16.256 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common 2023-07-14T12:25:16.256 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/grace.ko 2023-07-14T12:25:16.256 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/nfs_acl.ko 2023-07-14T12:25:16.257 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd 2023-07-14T12:25:16.257 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/nfsd.ko 2023-07-14T12:25:16.257 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2 2023-07-14T12:25:16.257 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/nilfs2.ko 2023-07-14T12:25:16.257 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls 2023-07-14T12:25:16.257 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-celtic.ko 2023-07-14T12:25:16.257 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-centeuro.ko 2023-07-14T12:25:16.257 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-croatian.ko 2023-07-14T12:25:16.258 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-cyrillic.ko 2023-07-14T12:25:16.258 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-gaelic.ko 2023-07-14T12:25:16.258 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-greek.ko 2023-07-14T12:25:16.258 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-iceland.ko 2023-07-14T12:25:16.258 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-inuit.ko 2023-07-14T12:25:16.258 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-roman.ko 2023-07-14T12:25:16.258 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-romanian.ko 2023-07-14T12:25:16.258 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-turkish.ko 2023-07-14T12:25:16.259 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1250.ko 2023-07-14T12:25:16.259 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1251.ko 2023-07-14T12:25:16.259 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1255.ko 2023-07-14T12:25:16.259 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp737.ko 2023-07-14T12:25:16.259 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp775.ko 2023-07-14T12:25:16.259 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp850.ko 2023-07-14T12:25:16.259 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp852.ko 2023-07-14T12:25:16.259 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp855.ko 2023-07-14T12:25:16.260 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp857.ko 2023-07-14T12:25:16.260 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp860.ko 2023-07-14T12:25:16.260 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp861.ko 2023-07-14T12:25:16.260 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp862.ko 2023-07-14T12:25:16.260 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp863.ko 2023-07-14T12:25:16.260 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp864.ko 2023-07-14T12:25:16.260 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp865.ko 2023-07-14T12:25:16.261 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp866.ko 2023-07-14T12:25:16.261 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp869.ko 2023-07-14T12:25:16.261 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp874.ko 2023-07-14T12:25:16.261 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp932.ko 2023-07-14T12:25:16.261 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp936.ko 2023-07-14T12:25:16.261 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp949.ko 2023-07-14T12:25:16.261 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp950.ko 2023-07-14T12:25:16.261 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_euc-jp.ko 2023-07-14T12:25:16.262 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-1.ko 2023-07-14T12:25:16.262 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-13.ko 2023-07-14T12:25:16.262 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-14.ko 2023-07-14T12:25:16.262 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-15.ko 2023-07-14T12:25:16.262 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-2.ko 2023-07-14T12:25:16.262 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-3.ko 2023-07-14T12:25:16.262 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-4.ko 2023-07-14T12:25:16.262 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-5.ko 2023-07-14T12:25:16.263 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-6.ko 2023-07-14T12:25:16.263 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-7.ko 2023-07-14T12:25:16.263 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-9.ko 2023-07-14T12:25:16.263 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-r.ko 2023-07-14T12:25:16.263 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-ru.ko 2023-07-14T12:25:16.263 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-u.ko 2023-07-14T12:25:16.263 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_utf8.ko 2023-07-14T12:25:16.263 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2 2023-07-14T12:25:16.264 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster 2023-07-14T12:25:16.264 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-14T12:25:16.264 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm 2023-07-14T12:25:16.264 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-14T12:25:16.264 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs 2023-07-14T12:25:16.264 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-14T12:25:16.264 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2.ko 2023-07-14T12:25:16.265 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-14T12:25:16.265 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-14T12:25:16.265 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-14T12:25:16.265 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs 2023-07-14T12:25:16.265 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/overlay.ko 2023-07-14T12:25:16.265 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore 2023-07-14T12:25:16.265 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ramoops.ko 2023-07-14T12:25:16.265 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs 2023-07-14T12:25:16.266 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/reiserfs.ko 2023-07-14T12:25:16.266 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs 2023-07-14T12:25:16.266 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/romfs.ko 2023-07-14T12:25:16.266 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb 2023-07-14T12:25:16.266 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client 2023-07-14T12:25:16.266 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/cifs.ko 2023-07-14T12:25:16.266 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common 2023-07-14T12:25:16.266 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_arc4.ko 2023-07-14T12:25:16.267 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_md4.ko 2023-07-14T12:25:16.267 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs 2023-07-14T12:25:16.267 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/squashfs.ko 2023-07-14T12:25:16.267 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv 2023-07-14T12:25:16.267 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/sysv.ko 2023-07-14T12:25:16.267 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf 2023-07-14T12:25:16.267 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/udf.ko 2023-07-14T12:25:16.267 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs 2023-07-14T12:25:16.268 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ufs.ko 2023-07-14T12:25:16.268 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs 2023-07-14T12:25:16.268 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/xfs.ko 2023-07-14T12:25:16.268 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel 2023-07-14T12:25:16.268 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu 2023-07-14T12:25:16.268 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu/rcutorture.ko 2023-07-14T12:25:16.268 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/torture.ko 2023-07-14T12:25:16.268 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace 2023-07-14T12:25:16.269 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-14T12:25:16.269 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib 2023-07-14T12:25:16.269 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/asn1_encoder.ko 2023-07-14T12:25:16.269 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc-itu-t.ko 2023-07-14T12:25:16.269 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc8.ko 2023-07-14T12:25:16.269 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto 2023-07-14T12:25:16.269 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libarc4.ko 2023-07-14T12:25:16.270 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libdes.ko 2023-07-14T12:25:16.270 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/libcrc32c.ko 2023-07-14T12:25:16.270 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lru_cache.ko 2023-07-14T12:25:16.270 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4 2023-07-14T12:25:16.270 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4_compress.ko 2023-07-14T12:25:16.270 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4hc_compress.ko 2023-07-14T12:25:16.270 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math 2023-07-14T12:25:16.270 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/cordic.ko 2023-07-14T12:25:16.271 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6 2023-07-14T12:25:16.271 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/raid6_pq.ko 2023-07-14T12:25:16.271 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon 2023-07-14T12:25:16.271 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-14T12:25:16.271 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_bm.ko 2023-07-14T12:25:16.271 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_fsm.ko 2023-07-14T12:25:16.271 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_kmp.ko 2023-07-14T12:25:16.271 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd 2023-07-14T12:25:16.272 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd/zstd_compress.ko 2023-07-14T12:25:16.272 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm 2023-07-14T12:25:16.272 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/hwpoison-inject.ko 2023-07-14T12:25:16.272 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net 2023-07-14T12:25:16.272 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan 2023-07-14T12:25:16.272 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/6lowpan.ko 2023-07-14T12:25:16.272 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_dest.ko 2023-07-14T12:25:16.273 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_fragment.ko 2023-07-14T12:25:16.273 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_hop.ko 2023-07-14T12:25:16.273 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-14T12:25:16.273 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_mobility.ko 2023-07-14T12:25:16.273 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_routing.ko 2023-07-14T12:25:16.273 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_udp.ko 2023-07-14T12:25:16.273 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802 2023-07-14T12:25:16.273 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/garp.ko 2023-07-14T12:25:16.274 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/mrp.ko 2023-07-14T12:25:16.274 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/p8022.ko 2023-07-14T12:25:16.274 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/psnap.ko 2023-07-14T12:25:16.274 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/stp.ko 2023-07-14T12:25:16.274 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q 2023-07-14T12:25:16.274 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/8021q.ko 2023-07-14T12:25:16.274 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p 2023-07-14T12:25:16.274 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet.ko 2023-07-14T12:25:16.275 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_fd.ko 2023-07-14T12:25:16.275 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_rdma.ko 2023-07-14T12:25:16.275 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_virtio.ko 2023-07-14T12:25:16.275 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv 2023-07-14T12:25:16.275 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/batman-adv.ko 2023-07-14T12:25:16.275 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge 2023-07-14T12:25:16.275 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/br_netfilter.ko 2023-07-14T12:25:16.275 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/bridge.ko 2023-07-14T12:25:16.276 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter 2023-07-14T12:25:16.276 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-14T12:25:16.276 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-14T12:25:16.276 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-14T12:25:16.276 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-14T12:25:16.276 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-14T12:25:16.276 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-14T12:25:16.277 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-14T12:25:16.277 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-14T12:25:16.277 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-14T12:25:16.277 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-14T12:25:16.277 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-14T12:25:16.277 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-14T12:25:16.277 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-14T12:25:16.277 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-14T12:25:16.278 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-14T12:25:16.278 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-14T12:25:16.278 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-14T12:25:16.278 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-14T12:25:16.278 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-14T12:25:16.278 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-14T12:25:16.278 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtables.ko 2023-07-14T12:25:16.278 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-14T12:25:16.279 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-14T12:25:16.279 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-14T12:25:16.279 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph 2023-07-14T12:25:16.279 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/libceph.ko 2023-07-14T12:25:16.279 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core 2023-07-14T12:25:16.279 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/failover.ko 2023-07-14T12:25:16.279 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/pktgen.ko 2023-07-14T12:25:16.279 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp 2023-07-14T12:25:16.280 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp.ko 2023-07-14T12:25:16.280 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_diag.ko 2023-07-14T12:25:16.280 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv4.ko 2023-07-14T12:25:16.280 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv6.ko 2023-07-14T12:25:16.280 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver 2023-07-14T12:25:16.280 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver/dns_resolver.ko 2023-07-14T12:25:16.280 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa 2023-07-14T12:25:16.281 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/dsa_core.ko 2023-07-14T12:25:16.281 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_brcm.ko 2023-07-14T12:25:16.281 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_dsa.ko 2023-07-14T12:25:16.281 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_none.ko 2023-07-14T12:25:16.281 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_trailer.ko 2023-07-14T12:25:16.281 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154 2023-07-14T12:25:16.281 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan 2023-07-14T12:25:16.281 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-14T12:25:16.282 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154.ko 2023-07-14T12:25:16.282 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-14T12:25:16.282 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4 2023-07-14T12:25:16.282 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ah4.ko 2023-07-14T12:25:16.282 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/esp4.ko 2023-07-14T12:25:16.282 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/fou.ko 2023-07-14T12:25:16.282 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/gre.ko 2023-07-14T12:25:16.282 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/inet_diag.ko 2023-07-14T12:25:16.283 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_gre.ko 2023-07-14T12:25:16.283 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_tunnel.ko 2023-07-14T12:25:16.283 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_vti.ko 2023-07-14T12:25:16.283 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipcomp.ko 2023-07-14T12:25:16.283 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipip.ko 2023-07-14T12:25:16.283 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter 2023-07-14T12:25:16.283 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-14T12:25:16.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-14T12:25:16.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-14T12:25:16.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-14T12:25:16.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-14T12:25:16.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-14T12:25:16.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-14T12:25:16.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-14T12:25:16.284 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-14T12:25:16.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-14T12:25:16.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-14T12:25:16.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-14T12:25:16.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-14T12:25:16.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-14T12:25:16.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-14T12:25:16.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-14T12:25:16.285 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-14T12:25:16.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-14T12:25:16.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-14T12:25:16.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-14T12:25:16.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-14T12:25:16.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_bic.ko 2023-07-14T12:25:16.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_dctcp.ko 2023-07-14T12:25:16.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_diag.ko 2023-07-14T12:25:16.286 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_highspeed.ko 2023-07-14T12:25:16.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_htcp.ko 2023-07-14T12:25:16.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_hybla.ko 2023-07-14T12:25:16.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_illinois.ko 2023-07-14T12:25:16.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_lp.ko 2023-07-14T12:25:16.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_scalable.ko 2023-07-14T12:25:16.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_vegas.ko 2023-07-14T12:25:16.287 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_veno.ko 2023-07-14T12:25:16.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_westwood.ko 2023-07-14T12:25:16.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_yeah.ko 2023-07-14T12:25:16.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tunnel4.ko 2023-07-14T12:25:16.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_diag.ko 2023-07-14T12:25:16.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_tunnel.ko 2023-07-14T12:25:16.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-14T12:25:16.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6 2023-07-14T12:25:16.288 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ah6.ko 2023-07-14T12:25:16.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/esp6.ko 2023-07-14T12:25:16.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/fou6.ko 2023-07-14T12:25:16.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_tunnel.ko 2023-07-14T12:25:16.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-14T12:25:16.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_vti.ko 2023-07-14T12:25:16.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ipcomp6.ko 2023-07-14T12:25:16.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter 2023-07-14T12:25:16.289 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-14T12:25:16.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-14T12:25:16.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-14T12:25:16.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-14T12:25:16.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-14T12:25:16.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-14T12:25:16.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-14T12:25:16.290 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-14T12:25:16.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-14T12:25:16.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-14T12:25:16.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-14T12:25:16.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-14T12:25:16.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-14T12:25:16.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-14T12:25:16.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-14T12:25:16.291 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-14T12:25:16.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-14T12:25:16.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-14T12:25:16.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-14T12:25:16.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-14T12:25:16.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-14T12:25:16.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-14T12:25:16.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-14T12:25:16.292 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-14T12:25:16.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/sit.ko 2023-07-14T12:25:16.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/tunnel6.ko 2023-07-14T12:25:16.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-14T12:25:16.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key 2023-07-14T12:25:16.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/af_key.ko 2023-07-14T12:25:16.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp 2023-07-14T12:25:16.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_core.ko 2023-07-14T12:25:16.293 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-14T12:25:16.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_eth.ko 2023-07-14T12:25:16.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip.ko 2023-07-14T12:25:16.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip6.ko 2023-07-14T12:25:16.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_netlink.ko 2023-07-14T12:25:16.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ppp.ko 2023-07-14T12:25:16.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc 2023-07-14T12:25:16.294 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc.ko 2023-07-14T12:25:16.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154 2023-07-14T12:25:16.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/mac802154.ko 2023-07-14T12:25:16.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls 2023-07-14T12:25:16.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/mpls_gso.ko 2023-07-14T12:25:16.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter 2023-07-14T12:25:16.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset 2023-07-14T12:25:16.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set.ko 2023-07-14T12:25:16.295 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-14T12:25:16.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-14T12:25:16.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-14T12:25:16.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-14T12:25:16.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-14T12:25:16.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-14T12:25:16.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-14T12:25:16.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-14T12:25:16.296 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-14T12:25:16.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-14T12:25:16.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-14T12:25:16.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-14T12:25:16.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-14T12:25:16.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-14T12:25:16.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-14T12:25:16.297 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs 2023-07-14T12:25:16.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-14T12:25:16.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-14T12:25:16.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-14T12:25:16.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-14T12:25:16.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-14T12:25:16.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-14T12:25:16.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-14T12:25:16.298 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-14T12:25:16.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-14T12:25:16.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-14T12:25:16.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-14T12:25:16.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-14T12:25:16.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-14T12:25:16.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-14T12:25:16.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conncount.ko 2023-07-14T12:25:16.299 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack.ko 2023-07-14T12:25:16.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-14T12:25:16.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-14T12:25:16.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-14T12:25:16.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-14T12:25:16.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-14T12:25:16.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-14T12:25:16.300 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-14T12:25:16.301 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-14T12:25:16.301 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-14T12:25:16.301 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-14T12:25:16.301 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-14T12:25:16.301 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-14T12:25:16.301 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-14T12:25:16.301 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table.ko 2023-07-14T12:25:16.301 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-14T12:25:16.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_log_syslog.ko 2023-07-14T12:25:16.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat.ko 2023-07-14T12:25:16.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-14T12:25:16.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-14T12:25:16.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_irc.ko 2023-07-14T12:25:16.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_sip.ko 2023-07-14T12:25:16.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-14T12:25:16.302 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-14T12:25:16.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_tables.ko 2023-07-14T12:25:16.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink.ko 2023-07-14T12:25:16.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-14T12:25:16.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_log.ko 2023-07-14T12:25:16.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-14T12:25:16.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-14T12:25:16.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_chain_nat.ko 2023-07-14T12:25:16.303 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_compat.ko 2023-07-14T12:25:16.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_ct.ko 2023-07-14T12:25:16.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-14T12:25:16.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fib.ko 2023-07-14T12:25:16.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-14T12:25:16.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_hash.ko 2023-07-14T12:25:16.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_limit.ko 2023-07-14T12:25:16.304 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_log.ko 2023-07-14T12:25:16.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_masq.ko 2023-07-14T12:25:16.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_nat.ko 2023-07-14T12:25:16.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_numgen.ko 2023-07-14T12:25:16.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_queue.ko 2023-07-14T12:25:16.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_quota.ko 2023-07-14T12:25:16.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_redir.ko 2023-07-14T12:25:16.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject.ko 2023-07-14T12:25:16.305 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject_inet.ko 2023-07-14T12:25:16.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_socket.ko 2023-07-14T12:25:16.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_tunnel.ko 2023-07-14T12:25:16.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_AUDIT.ko 2023-07-14T12:25:16.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-14T12:25:16.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-14T12:25:16.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-14T12:25:16.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CT.ko 2023-07-14T12:25:16.306 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_DSCP.ko 2023-07-14T12:25:16.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HL.ko 2023-07-14T12:25:16.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HMARK.ko 2023-07-14T12:25:16.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-14T12:25:16.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LED.ko 2023-07-14T12:25:16.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LOG.ko 2023-07-14T12:25:16.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-14T12:25:16.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NETMAP.ko 2023-07-14T12:25:16.307 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFLOG.ko 2023-07-14T12:25:16.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-14T12:25:16.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_RATEEST.ko 2023-07-14T12:25:16.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-14T12:25:16.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_SECMARK.ko 2023-07-14T12:25:16.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-14T12:25:16.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-14T12:25:16.308 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TEE.ko 2023-07-14T12:25:16.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TPROXY.ko 2023-07-14T12:25:16.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TRACE.ko 2023-07-14T12:25:16.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_addrtype.ko 2023-07-14T12:25:16.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_bpf.ko 2023-07-14T12:25:16.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cgroup.ko 2023-07-14T12:25:16.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cluster.ko 2023-07-14T12:25:16.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_comment.ko 2023-07-14T12:25:16.309 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connbytes.ko 2023-07-14T12:25:16.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlabel.ko 2023-07-14T12:25:16.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlimit.ko 2023-07-14T12:25:16.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connmark.ko 2023-07-14T12:25:16.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_conntrack.ko 2023-07-14T12:25:16.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cpu.ko 2023-07-14T12:25:16.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dccp.ko 2023-07-14T12:25:16.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_devgroup.ko 2023-07-14T12:25:16.310 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dscp.ko 2023-07-14T12:25:16.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ecn.ko 2023-07-14T12:25:16.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_esp.ko 2023-07-14T12:25:16.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hashlimit.ko 2023-07-14T12:25:16.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_helper.ko 2023-07-14T12:25:16.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hl.ko 2023-07-14T12:25:16.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipcomp.ko 2023-07-14T12:25:16.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_iprange.ko 2023-07-14T12:25:16.311 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipvs.ko 2023-07-14T12:25:16.312 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_l2tp.ko 2023-07-14T12:25:16.312 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_length.ko 2023-07-14T12:25:16.312 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_limit.ko 2023-07-14T12:25:16.312 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mac.ko 2023-07-14T12:25:16.312 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mark.ko 2023-07-14T12:25:16.312 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_multiport.ko 2023-07-14T12:25:16.312 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nat.ko 2023-07-14T12:25:16.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nfacct.ko 2023-07-14T12:25:16.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_osf.ko 2023-07-14T12:25:16.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_owner.ko 2023-07-14T12:25:16.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_physdev.ko 2023-07-14T12:25:16.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_pkttype.ko 2023-07-14T12:25:16.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_policy.ko 2023-07-14T12:25:16.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_quota.ko 2023-07-14T12:25:16.313 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_rateest.ko 2023-07-14T12:25:16.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_realm.ko 2023-07-14T12:25:16.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_recent.ko 2023-07-14T12:25:16.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_sctp.ko 2023-07-14T12:25:16.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_set.ko 2023-07-14T12:25:16.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_socket.ko 2023-07-14T12:25:16.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_state.ko 2023-07-14T12:25:16.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_statistic.ko 2023-07-14T12:25:16.314 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_string.ko 2023-07-14T12:25:16.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpmss.ko 2023-07-14T12:25:16.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_time.ko 2023-07-14T12:25:16.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_u32.ko 2023-07-14T12:25:16.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink 2023-07-14T12:25:16.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/netlink_diag.ko 2023-07-14T12:25:16.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh 2023-07-14T12:25:16.315 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/nsh.ko 2023-07-14T12:25:16.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch 2023-07-14T12:25:16.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/openvswitch.ko 2023-07-14T12:25:16.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-geneve.ko 2023-07-14T12:25:16.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-gre.ko 2023-07-14T12:25:16.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-vxlan.ko 2023-07-14T12:25:16.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet 2023-07-14T12:25:16.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/af_packet_diag.ko 2023-07-14T12:25:16.316 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds 2023-07-14T12:25:16.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds.ko 2023-07-14T12:25:16.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_rdma.ko 2023-07-14T12:25:16.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_tcp.ko 2023-07-14T12:25:16.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched 2023-07-14T12:25:16.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_csum.ko 2023-07-14T12:25:16.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_gact.ko 2023-07-14T12:25:16.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_ipt.ko 2023-07-14T12:25:16.317 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_mirred.ko 2023-07-14T12:25:16.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_nat.ko 2023-07-14T12:25:16.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_pedit.ko 2023-07-14T12:25:16.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_police.ko 2023-07-14T12:25:16.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_simple.ko 2023-07-14T12:25:16.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_skbedit.ko 2023-07-14T12:25:16.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_vlan.ko 2023-07-14T12:25:16.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_basic.ko 2023-07-14T12:25:16.318 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_bpf.ko 2023-07-14T12:25:16.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_flow.ko 2023-07-14T12:25:16.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_fw.ko 2023-07-14T12:25:16.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_route.ko 2023-07-14T12:25:16.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_u32.ko 2023-07-14T12:25:16.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_cmp.ko 2023-07-14T12:25:16.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_ipset.ko 2023-07-14T12:25:16.319 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_meta.ko 2023-07-14T12:25:16.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_nbyte.ko 2023-07-14T12:25:16.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_text.ko 2023-07-14T12:25:16.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_u32.ko 2023-07-14T12:25:16.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_choke.ko 2023-07-14T12:25:16.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_codel.ko 2023-07-14T12:25:16.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_drr.ko 2023-07-14T12:25:16.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq.ko 2023-07-14T12:25:16.320 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_gred.ko 2023-07-14T12:25:16.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hfsc.ko 2023-07-14T12:25:16.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hhf.ko 2023-07-14T12:25:16.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_htb.ko 2023-07-14T12:25:16.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_ingress.ko 2023-07-14T12:25:16.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio.ko 2023-07-14T12:25:16.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio_lib.ko 2023-07-14T12:25:16.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_multiq.ko 2023-07-14T12:25:16.321 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_netem.ko 2023-07-14T12:25:16.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_pie.ko 2023-07-14T12:25:16.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_plug.ko 2023-07-14T12:25:16.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_prio.ko 2023-07-14T12:25:16.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_qfq.ko 2023-07-14T12:25:16.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_red.ko 2023-07-14T12:25:16.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfb.ko 2023-07-14T12:25:16.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfq.ko 2023-07-14T12:25:16.322 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_tbf.ko 2023-07-14T12:25:16.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_teql.ko 2023-07-14T12:25:16.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp 2023-07-14T12:25:16.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp.ko 2023-07-14T12:25:16.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp_diag.ko 2023-07-14T12:25:16.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc 2023-07-14T12:25:16.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss 2023-07-14T12:25:16.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-14T12:25:16.323 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-14T12:25:16.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/sunrpc.ko 2023-07-14T12:25:16.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma 2023-07-14T12:25:16.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-14T12:25:16.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc 2023-07-14T12:25:16.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/diag.ko 2023-07-14T12:25:16.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/tipc.ko 2023-07-14T12:25:16.324 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix 2023-07-14T12:25:16.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/unix_diag.ko 2023-07-14T12:25:16.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock 2023-07-14T12:25:16.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-14T12:25:16.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-14T12:25:16.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock.ko 2023-07-14T12:25:16.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-14T12:25:16.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-14T12:25:16.325 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm 2023-07-14T12:25:16.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-14T12:25:16.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security 2023-07-14T12:25:16.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys 2023-07-14T12:25:16.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys 2023-07-14T12:25:16.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-14T12:25:16.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys 2023-07-14T12:25:16.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys/trusted.ko 2023-07-14T12:25:16.326 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt 2023-07-14T12:25:16.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib 2023-07-14T12:25:16.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/irqbypass.ko 2023-07-14T12:25:16.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias 2023-07-14T12:25:16.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias.bin 2023-07-14T12:25:16.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin 2023-07-14T12:25:16.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.bin 2023-07-14T12:25:16.327 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.modinfo 2023-07-14T12:25:16.328 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep 2023-07-14T12:25:16.328 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep.bin 2023-07-14T12:25:16.328 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.devname 2023-07-14T12:25:16.328 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.order 2023-07-14T12:25:16.328 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.softdep 2023-07-14T12:25:16.328 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols 2023-07-14T12:25:16.328 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols.bin 2023-07-14T12:25:16.329 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:16.329 DEBUG:teuthology.orchestra.run.smithi131:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-14T12:25:16.355 INFO:teuthology.orchestra.run.smithi131.stdout:postinstall scriptlet (using /bin/sh): 2023-07-14T12:25:16.355 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 -a -r /boot/System.map-6.5.0-rc1-ga440c79eee02 ]; then 2023-07-14T12:25:16.355 INFO:teuthology.orchestra.run.smithi131.stdout:cp /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:16.356 INFO:teuthology.orchestra.run.smithi131.stdout:cp /boot/System.map-6.5.0-rc1-ga440c79eee02 /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:16.356 INFO:teuthology.orchestra.run.smithi131.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:16.356 INFO:teuthology.orchestra.run.smithi131.stdout:/sbin/installkernel 6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:16.356 INFO:teuthology.orchestra.run.smithi131.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:16.356 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2023-07-14T12:25:16.356 INFO:teuthology.orchestra.run.smithi131.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-14T12:25:16.356 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-14T12:25:16.356 INFO:teuthology.orchestra.run.smithi131.stdout:new-kernel-pkg --remove 6.5.0-rc1-ga440c79eee02 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-ga440c79eee02.img 2023-07-14T12:25:16.357 INFO:teuthology.orchestra.run.smithi131.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-14T12:25:16.357 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-install remove 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:16.357 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2023-07-14T12:25:16.357 INFO:teuthology.orchestra.run.smithi131.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-14T12:25:16.357 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-14T12:25:16.357 INFO:teuthology.orchestra.run.smithi131.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:16.357 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2023-07-14T12:25:16.358 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -qi grub2-tools 2023-07-14T12:25:16.435 INFO:teuthology.orchestra.run.smithi131.stdout:Name : grub2-tools 2023-07-14T12:25:16.435 INFO:teuthology.orchestra.run.smithi131.stdout:Epoch : 1 2023-07-14T12:25:16.435 INFO:teuthology.orchestra.run.smithi131.stdout:Version : 2.02 2023-07-14T12:25:16.435 INFO:teuthology.orchestra.run.smithi131.stdout:Release : 123.el8 2023-07-14T12:25:16.435 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: x86_64 2023-07-14T12:25:16.435 INFO:teuthology.orchestra.run.smithi131.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-07-14T12:25:16.436 INFO:teuthology.orchestra.run.smithi131.stdout:Group : System Environment/Base 2023-07-14T12:25:16.436 INFO:teuthology.orchestra.run.smithi131.stdout:Size : 9265450 2023-07-14T12:25:16.436 INFO:teuthology.orchestra.run.smithi131.stdout:License : GPLv3+ 2023-07-14T12:25:16.436 INFO:teuthology.orchestra.run.smithi131.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-07-14T12:25:16.436 INFO:teuthology.orchestra.run.smithi131.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-07-14T12:25:16.436 INFO:teuthology.orchestra.run.smithi131.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-07-14T12:25:16.436 INFO:teuthology.orchestra.run.smithi131.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-07-14T12:25:16.437 INFO:teuthology.orchestra.run.smithi131.stdout:Relocations : (not relocatable) 2023-07-14T12:25:16.437 INFO:teuthology.orchestra.run.smithi131.stdout:Packager : Red Hat, Inc. 2023-07-14T12:25:16.437 INFO:teuthology.orchestra.run.smithi131.stdout:Vendor : Red Hat, Inc. 2023-07-14T12:25:16.437 INFO:teuthology.orchestra.run.smithi131.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-14T12:25:16.437 INFO:teuthology.orchestra.run.smithi131.stdout:Summary : Support tools for GRUB. 2023-07-14T12:25:16.437 INFO:teuthology.orchestra.run.smithi131.stdout:Description : 2023-07-14T12:25:16.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:25:16.438 INFO:teuthology.orchestra.run.smithi131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-14T12:25:16.438 INFO:teuthology.orchestra.run.smithi131.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-14T12:25:16.438 INFO:teuthology.orchestra.run.smithi131.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-14T12:25:16.438 INFO:teuthology.orchestra.run.smithi131.stdout:hardware devices. 2023-07-14T12:25:16.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:25:16.438 INFO:teuthology.orchestra.run.smithi131.stdout:This subpackage provides tools for support of all platforms. 2023-07-14T12:25:16.439 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-14T12:25:16.439 INFO:teuthology.task.kernel:Updating grub on smithi131 to boot 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:16.439 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-14T12:25:19.040 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-14T12:25:19.040 DEBUG:teuthology.orchestra.run.smithi017:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-14T12:25:19.069 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:19.070 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/config-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:19.070 INFO:teuthology.orchestra.run.smithi017.stdout:/boot/vmlinuz-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:19.070 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:19.070 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel 2023-07-14T12:25:19.070 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch 2023-07-14T12:25:19.070 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86 2023-07-14T12:25:19.070 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto 2023-07-14T12:25:19.071 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-14T12:25:19.071 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-14T12:25:19.071 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-14T12:25:19.071 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-14T12:25:19.071 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-14T12:25:19.071 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-14T12:25:19.071 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-14T12:25:19.072 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-14T12:25:19.072 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-14T12:25:19.072 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-14T12:25:19.072 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-14T12:25:19.072 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-14T12:25:19.072 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-14T12:25:19.072 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-14T12:25:19.073 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-14T12:25:19.073 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-14T12:25:19.073 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-14T12:25:19.073 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-14T12:25:19.073 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-14T12:25:19.073 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-14T12:25:19.073 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel 2023-07-14T12:25:19.073 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu 2023-07-14T12:25:19.074 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce 2023-07-14T12:25:19.074 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-14T12:25:19.074 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm 2023-07-14T12:25:19.074 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-14T12:25:19.074 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-14T12:25:19.074 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/arch/x86/kvm/kvm.ko 2023-07-14T12:25:19.074 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto 2023-07-14T12:25:19.074 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ansi_cprng.ko 2023-07-14T12:25:19.075 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/anubis.ko 2023-07-14T12:25:19.075 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/arc4.ko 2023-07-14T12:25:19.075 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx 2023-07-14T12:25:19.075 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_memcpy.ko 2023-07-14T12:25:19.075 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_pq.ko 2023-07-14T12:25:19.075 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-14T12:25:19.075 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_tx.ko 2023-07-14T12:25:19.076 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/async_xor.ko 2023-07-14T12:25:19.076 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/async_tx/raid6test.ko 2023-07-14T12:25:19.076 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authenc.ko 2023-07-14T12:25:19.076 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/authencesn.ko 2023-07-14T12:25:19.076 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blake2b_generic.ko 2023-07-14T12:25:19.076 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_common.ko 2023-07-14T12:25:19.076 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/blowfish_generic.ko 2023-07-14T12:25:19.076 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/camellia_generic.ko 2023-07-14T12:25:19.077 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast5_generic.ko 2023-07-14T12:25:19.077 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast6_generic.ko 2023-07-14T12:25:19.077 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cast_common.ko 2023-07-14T12:25:19.077 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/ccm.ko 2023-07-14T12:25:19.077 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cmac.ko 2023-07-14T12:25:19.077 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crc32_generic.ko 2023-07-14T12:25:19.077 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_engine.ko 2023-07-14T12:25:19.078 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/crypto_user.ko 2023-07-14T12:25:19.078 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/cts.ko 2023-07-14T12:25:19.078 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/des_generic.ko 2023-07-14T12:25:19.078 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/dh_generic.ko 2023-07-14T12:25:19.078 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/echainiv.ko 2023-07-14T12:25:19.078 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/essiv.ko 2023-07-14T12:25:19.078 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/fcrypt.ko 2023-07-14T12:25:19.078 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/khazad.ko 2023-07-14T12:25:19.079 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4.ko 2023-07-14T12:25:19.079 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/lz4hc.ko 2023-07-14T12:25:19.079 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/md4.ko 2023-07-14T12:25:19.079 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/michael_mic.ko 2023-07-14T12:25:19.079 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcbc.ko 2023-07-14T12:25:19.079 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/pcrypt.ko 2023-07-14T12:25:19.079 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/rmd160.ko 2023-07-14T12:25:19.079 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/seed.ko 2023-07-14T12:25:19.080 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/serpent_generic.ko 2023-07-14T12:25:19.080 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tcrypt.ko 2023-07-14T12:25:19.080 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/tea.ko 2023-07-14T12:25:19.080 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_common.ko 2023-07-14T12:25:19.080 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/twofish_generic.ko 2023-07-14T12:25:19.080 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/vmac.ko 2023-07-14T12:25:19.080 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/wp512.ko 2023-07-14T12:25:19.080 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xcbc.ko 2023-07-14T12:25:19.081 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xor.ko 2023-07-14T12:25:19.081 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/crypto/xxhash_generic.ko 2023-07-14T12:25:19.081 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers 2023-07-14T12:25:19.081 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi 2023-07-14T12:25:19.081 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-14T12:25:19.081 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/acpi_pad.ko 2023-07-14T12:25:19.081 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/custom_method.ko 2023-07-14T12:25:19.082 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/ec_sys.ko 2023-07-14T12:25:19.082 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/platform_profile.ko 2023-07-14T12:25:19.082 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbs.ko 2023-07-14T12:25:19.082 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/sbshc.ko 2023-07-14T12:25:19.082 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/acpi/video.ko 2023-07-14T12:25:19.082 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata 2023-07-14T12:25:19.082 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/acard-ahci.ko 2023-07-14T12:25:19.082 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ahci_platform.ko 2023-07-14T12:25:19.083 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/ata_generic.ko 2023-07-14T12:25:19.083 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/libahci_platform.ko 2023-07-14T12:25:19.083 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_acpi.ko 2023-07-14T12:25:19.083 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ali.ko 2023-07-14T12:25:19.083 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_amd.ko 2023-07-14T12:25:19.083 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_artop.ko 2023-07-14T12:25:19.083 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atiixp.ko 2023-07-14T12:25:19.083 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_atp867x.ko 2023-07-14T12:25:19.084 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd640.ko 2023-07-14T12:25:19.084 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cmd64x.ko 2023-07-14T12:25:19.084 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_cypress.ko 2023-07-14T12:25:19.084 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_efar.ko 2023-07-14T12:25:19.099 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt366.ko 2023-07-14T12:25:19.099 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt37x.ko 2023-07-14T12:25:19.099 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-14T12:25:19.100 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-14T12:25:19.100 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it8213.ko 2023-07-14T12:25:19.100 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_it821x.ko 2023-07-14T12:25:19.100 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_jmicron.ko 2023-07-14T12:25:19.100 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_marvell.ko 2023-07-14T12:25:19.100 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_mpiix.ko 2023-07-14T12:25:19.100 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_netcell.ko 2023-07-14T12:25:19.101 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ninja32.ko 2023-07-14T12:25:19.101 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87410.ko 2023-07-14T12:25:19.101 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_ns87415.ko 2023-07-14T12:25:19.101 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_oldpiix.ko 2023-07-14T12:25:19.101 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_opti.ko 2023-07-14T12:25:19.101 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_optidma.ko 2023-07-14T12:25:19.101 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pcmcia.ko 2023-07-14T12:25:19.101 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-14T12:25:19.102 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-14T12:25:19.102 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_piccolo.ko 2023-07-14T12:25:19.102 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_rdc.ko 2023-07-14T12:25:19.102 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sch.ko 2023-07-14T12:25:19.102 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_serverworks.ko 2023-07-14T12:25:19.102 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sil680.ko 2023-07-14T12:25:19.102 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sis.ko 2023-07-14T12:25:19.103 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_sl82c105.ko 2023-07-14T12:25:19.103 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_triflex.ko 2023-07-14T12:25:19.103 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pata_via.ko 2023-07-14T12:25:19.103 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/pdc_adma.ko 2023-07-14T12:25:19.103 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_inic162x.ko 2023-07-14T12:25:19.103 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_mv.ko 2023-07-14T12:25:19.103 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_nv.ko 2023-07-14T12:25:19.103 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_promise.ko 2023-07-14T12:25:19.104 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_qstor.ko 2023-07-14T12:25:19.104 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil.ko 2023-07-14T12:25:19.104 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sil24.ko 2023-07-14T12:25:19.104 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sis.ko 2023-07-14T12:25:19.104 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_svw.ko 2023-07-14T12:25:19.104 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_sx4.ko 2023-07-14T12:25:19.104 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_uli.ko 2023-07-14T12:25:19.104 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_via.ko 2023-07-14T12:25:19.105 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ata/sata_vsc.ko 2023-07-14T12:25:19.105 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay 2023-07-14T12:25:19.105 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/auxdisplay/ks0108.ko 2023-07-14T12:25:19.105 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base 2023-07-14T12:25:19.105 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap 2023-07-14T12:25:19.105 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-14T12:25:19.105 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-14T12:25:19.105 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma 2023-07-14T12:25:19.106 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/bcma/bcma.ko 2023-07-14T12:25:19.106 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block 2023-07-14T12:25:19.106 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe 2023-07-14T12:25:19.106 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/aoe/aoe.ko 2023-07-14T12:25:19.106 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/brd.ko 2023-07-14T12:25:19.106 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd 2023-07-14T12:25:19.106 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/drbd/drbd.ko 2023-07-14T12:25:19.107 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/floppy.ko 2023-07-14T12:25:19.107 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/loop.ko 2023-07-14T12:25:19.107 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx 2023-07-14T12:25:19.107 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-14T12:25:19.107 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/nbd.ko 2023-07-14T12:25:19.107 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk 2023-07-14T12:25:19.107 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/null_blk/null_blk.ko 2023-07-14T12:25:19.107 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/pktcdvd.ko 2023-07-14T12:25:19.108 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/rbd.ko 2023-07-14T12:25:19.108 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/virtio_blk.ko 2023-07-14T12:25:19.108 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback 2023-07-14T12:25:19.108 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-14T12:25:19.108 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/xen-blkfront.ko 2023-07-14T12:25:19.108 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram 2023-07-14T12:25:19.108 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/block/zram/zram.ko 2023-07-14T12:25:19.108 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char 2023-07-14T12:25:19.109 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hangcheck-timer.ko 2023-07-14T12:25:19.109 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random 2023-07-14T12:25:19.109 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-14T12:25:19.109 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-14T12:25:19.109 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-14T12:25:19.109 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/via-rng.ko 2023-07-14T12:25:19.109 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-14T12:25:19.110 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi 2023-07-14T12:25:19.110 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-14T12:25:19.110 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-14T12:25:19.110 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-14T12:25:19.110 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-14T12:25:19.110 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-14T12:25:19.110 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-14T12:25:19.110 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/lp.ko 2023-07-14T12:25:19.111 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave 2023-07-14T12:25:19.111 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/mwave/mwave.ko 2023-07-14T12:25:19.111 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/ppdev.ko 2023-07-14T12:25:19.111 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tlclk.ko 2023-07-14T12:25:19.111 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm 2023-07-14T12:25:19.111 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm.ko 2023-07-14T12:25:19.111 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-14T12:25:19.111 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-14T12:25:19.112 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-14T12:25:19.112 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-14T12:25:19.112 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-14T12:25:19.112 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/uv_mmtimer.ko 2023-07-14T12:25:19.112 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/char/virtio_console.ko 2023-07-14T12:25:19.112 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq 2023-07-14T12:25:19.112 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-14T12:25:19.112 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-14T12:25:19.113 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-14T12:25:19.113 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-14T12:25:19.113 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-14T12:25:19.113 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-14T12:25:19.113 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto 2023-07-14T12:25:19.113 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp 2023-07-14T12:25:19.113 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-14T12:25:19.114 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/ccp/ccp.ko 2023-07-14T12:25:19.114 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel 2023-07-14T12:25:19.114 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat 2023-07-14T12:25:19.114 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common 2023-07-14T12:25:19.114 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-14T12:25:19.114 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-14T12:25:19.114 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-14T12:25:19.114 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-aes.ko 2023-07-14T12:25:19.115 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/padlock-sha.ko 2023-07-14T12:25:19.115 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio 2023-07-14T12:25:19.115 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-14T12:25:19.115 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca 2023-07-14T12:25:19.115 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dca/dca.ko 2023-07-14T12:25:19.115 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq 2023-07-14T12:25:19.115 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-14T12:25:19.116 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma 2023-07-14T12:25:19.116 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw 2023-07-14T12:25:19.116 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-14T12:25:19.116 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat 2023-07-14T12:25:19.116 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-14T12:25:19.116 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac 2023-07-14T12:25:19.116 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/amd64_edac.ko 2023-07-14T12:25:19.116 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/e752x_edac.ko 2023-07-14T12:25:19.117 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/edac_mce_amd.ko 2023-07-14T12:25:19.117 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3000_edac.ko 2023-07-14T12:25:19.117 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i3200_edac.ko 2023-07-14T12:25:19.117 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5100_edac.ko 2023-07-14T12:25:19.117 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i5400_edac.ko 2023-07-14T12:25:19.117 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7300_edac.ko 2023-07-14T12:25:19.117 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i7core_edac.ko 2023-07-14T12:25:19.117 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/i82975x_edac.ko 2023-07-14T12:25:19.118 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/ie31200_edac.ko 2023-07-14T12:25:19.118 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/sb_edac.ko 2023-07-14T12:25:19.118 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/edac/x38_edac.ko 2023-07-14T12:25:19.118 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware 2023-07-14T12:25:19.118 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/edd.ko 2023-07-14T12:25:19.118 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-14T12:25:19.118 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio 2023-07-14T12:25:19.118 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-ich.ko 2023-07-14T12:25:19.119 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-14T12:25:19.119 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid 2023-07-14T12:25:19.119 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-appleir.ko 2023-07-14T12:25:19.119 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-aureal.ko 2023-07-14T12:25:19.119 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-axff.ko 2023-07-14T12:25:19.119 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-dr.ko 2023-07-14T12:25:19.119 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elecom.ko 2023-07-14T12:25:19.120 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-elo.ko 2023-07-14T12:25:19.120 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-emsff.ko 2023-07-14T12:25:19.120 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gaff.ko 2023-07-14T12:25:19.120 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gt683r.ko 2023-07-14T12:25:19.120 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-gyration.ko 2023-07-14T12:25:19.120 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-14T12:25:19.120 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-14T12:25:19.120 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-holtekff.ko 2023-07-14T12:25:19.121 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-hyperv.ko 2023-07-14T12:25:19.121 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-icade.ko 2023-07-14T12:25:19.121 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-keytouch.ko 2023-07-14T12:25:19.121 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-kye.ko 2023-07-14T12:25:19.121 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lcpower.ko 2023-07-14T12:25:19.121 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-led.ko 2023-07-14T12:25:19.124 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-lenovo.ko 2023-07-14T12:25:19.124 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-14T12:25:19.124 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-14T12:25:19.124 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-multitouch.ko 2023-07-14T12:25:19.125 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-ortek.ko 2023-07-14T12:25:19.125 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-penmount.ko 2023-07-14T12:25:19.125 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-petalynx.ko 2023-07-14T12:25:19.125 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-picolcd.ko 2023-07-14T12:25:19.125 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-pl.ko 2023-07-14T12:25:19.125 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-plantronics.ko 2023-07-14T12:25:19.125 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-primax.ko 2023-07-14T12:25:19.125 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-rmi.ko 2023-07-14T12:25:19.126 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-14T12:25:19.126 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-common.ko 2023-07-14T12:25:19.126 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-14T12:25:19.126 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-14T12:25:19.126 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-14T12:25:19.126 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-14T12:25:19.126 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-14T12:25:19.126 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-14T12:25:19.127 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-14T12:25:19.127 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-14T12:25:19.127 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-14T12:25:19.127 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-roccat.ko 2023-07-14T12:25:19.127 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-saitek.ko 2023-07-14T12:25:19.127 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-samsung.ko 2023-07-14T12:25:19.127 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-14T12:25:19.127 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sjoy.ko 2023-07-14T12:25:19.128 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sony.ko 2023-07-14T12:25:19.128 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-speedlink.ko 2023-07-14T12:25:19.128 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-steelseries.ko 2023-07-14T12:25:19.128 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-sunplus.ko 2023-07-14T12:25:19.128 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-14T12:25:19.128 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tivo.ko 2023-07-14T12:25:19.128 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-tmff.ko 2023-07-14T12:25:19.128 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-topseed.ko 2023-07-14T12:25:19.129 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-twinhan.ko 2023-07-14T12:25:19.129 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-uclogic.ko 2023-07-14T12:25:19.129 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-waltop.ko 2023-07-14T12:25:19.129 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-wiimote.ko 2023-07-14T12:25:19.129 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-xinmo.ko 2023-07-14T12:25:19.130 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zpff.ko 2023-07-14T12:25:19.130 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/hid-zydacron.ko 2023-07-14T12:25:19.130 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/uhid.ko 2023-07-14T12:25:19.130 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hid/wacom.ko 2023-07-14T12:25:19.130 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv 2023-07-14T12:25:19.130 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_balloon.ko 2023-07-14T12:25:19.131 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_utils.ko 2023-07-14T12:25:19.131 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hv/hv_vmbus.ko 2023-07-14T12:25:19.131 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon 2023-07-14T12:25:19.131 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru.ko 2023-07-14T12:25:19.131 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/abituguru3.ko 2023-07-14T12:25:19.131 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-14T12:25:19.131 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7414.ko 2023-07-14T12:25:19.132 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ad7418.ko 2023-07-14T12:25:19.132 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adc128d818.ko 2023-07-14T12:25:19.132 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1025.ko 2023-07-14T12:25:19.132 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1026.ko 2023-07-14T12:25:19.132 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1029.ko 2023-07-14T12:25:19.132 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm1031.ko 2023-07-14T12:25:19.132 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adm9240.ko 2023-07-14T12:25:19.133 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ads7828.ko 2023-07-14T12:25:19.133 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7410.ko 2023-07-14T12:25:19.133 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7411.ko 2023-07-14T12:25:19.133 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7462.ko 2023-07-14T12:25:19.133 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7470.ko 2023-07-14T12:25:19.133 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7475.ko 2023-07-14T12:25:19.133 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/adt7x10.ko 2023-07-14T12:25:19.134 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/amc6821.ko 2023-07-14T12:25:19.134 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/applesmc.ko 2023-07-14T12:25:19.134 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asb100.ko 2023-07-14T12:25:19.134 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asc7621.ko 2023-07-14T12:25:19.134 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-14T12:25:19.134 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/atxp1.ko 2023-07-14T12:25:19.134 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/coretemp.ko 2023-07-14T12:25:19.135 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-14T12:25:19.135 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/dme1737.ko 2023-07-14T12:25:19.135 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds1621.ko 2023-07-14T12:25:19.135 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ds620.ko 2023-07-14T12:25:19.135 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc1403.ko 2023-07-14T12:25:19.135 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/emc6w201.ko 2023-07-14T12:25:19.135 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71805f.ko 2023-07-14T12:25:19.136 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f71882fg.ko 2023-07-14T12:25:19.136 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/f75375s.ko 2023-07-14T12:25:19.136 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fam15h_power.ko 2023-07-14T12:25:19.136 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/fschmd.ko 2023-07-14T12:25:19.136 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g760a.ko 2023-07-14T12:25:19.136 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/g762.ko 2023-07-14T12:25:19.136 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl518sm.ko 2023-07-14T12:25:19.137 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/gl520sm.ko 2023-07-14T12:25:19.137 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-14T12:25:19.137 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5500_temp.ko 2023-07-14T12:25:19.137 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/i5k_amb.ko 2023-07-14T12:25:19.137 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmaem.ko 2023-07-14T12:25:19.137 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ibmpex.ko 2023-07-14T12:25:19.137 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina209.ko 2023-07-14T12:25:19.137 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ina2xx.ko 2023-07-14T12:25:19.138 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/it87.ko 2023-07-14T12:25:19.138 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k10temp.ko 2023-07-14T12:25:19.138 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/k8temp.ko 2023-07-14T12:25:19.138 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lineage-pem.ko 2023-07-14T12:25:19.138 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm63.ko 2023-07-14T12:25:19.138 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm73.ko 2023-07-14T12:25:19.138 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm75.ko 2023-07-14T12:25:19.138 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm77.ko 2023-07-14T12:25:19.139 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm78.ko 2023-07-14T12:25:19.139 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm80.ko 2023-07-14T12:25:19.139 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm83.ko 2023-07-14T12:25:19.139 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm85.ko 2023-07-14T12:25:19.139 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm87.ko 2023-07-14T12:25:19.139 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm90.ko 2023-07-14T12:25:19.139 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm92.ko 2023-07-14T12:25:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm93.ko 2023-07-14T12:25:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95234.ko 2023-07-14T12:25:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95241.ko 2023-07-14T12:25:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/lm95245.ko 2023-07-14T12:25:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc2945.ko 2023-07-14T12:25:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4151.ko 2023-07-14T12:25:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4215.ko 2023-07-14T12:25:19.140 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4222.ko 2023-07-14T12:25:19.141 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4245.ko 2023-07-14T12:25:19.141 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4260.ko 2023-07-14T12:25:19.141 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/ltc4261.ko 2023-07-14T12:25:19.141 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max16065.ko 2023-07-14T12:25:19.141 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1619.ko 2023-07-14T12:25:19.141 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max1668.ko 2023-07-14T12:25:19.141 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max197.ko 2023-07-14T12:25:19.141 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6639.ko 2023-07-14T12:25:19.142 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6650.ko 2023-07-14T12:25:19.142 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/max6697.ko 2023-07-14T12:25:19.142 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/mcp3021.ko 2023-07-14T12:25:19.142 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6683.ko 2023-07-14T12:25:19.142 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775-core.ko 2023-07-14T12:25:19.142 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct6775.ko 2023-07-14T12:25:19.142 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/nct7802.ko 2023-07-14T12:25:19.143 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87360.ko 2023-07-14T12:25:19.143 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pc87427.ko 2023-07-14T12:25:19.143 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pcf8591.ko 2023-07-14T12:25:19.143 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus 2023-07-14T12:25:19.143 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-14T12:25:19.143 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-14T12:25:19.143 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-14T12:25:19.143 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-14T12:25:19.144 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-14T12:25:19.144 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-14T12:25:19.144 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-14T12:25:19.144 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-14T12:25:19.144 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-14T12:25:19.144 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-14T12:25:19.144 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-14T12:25:19.145 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-14T12:25:19.145 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/powr1220.ko 2023-07-14T12:25:19.145 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5627.ko 2023-07-14T12:25:19.145 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch5636.ko 2023-07-14T12:25:19.145 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-14T12:25:19.145 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht15.ko 2023-07-14T12:25:19.145 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sht21.ko 2023-07-14T12:25:19.146 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/shtc1.ko 2023-07-14T12:25:19.146 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/sis5595.ko 2023-07-14T12:25:19.146 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47b397.ko 2023-07-14T12:25:19.146 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m1.ko 2023-07-14T12:25:19.146 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/smsc47m192.ko 2023-07-14T12:25:19.146 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/thmc50.ko 2023-07-14T12:25:19.146 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp102.ko 2023-07-14T12:25:19.146 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp103.ko 2023-07-14T12:25:19.147 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp401.ko 2023-07-14T12:25:19.147 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/tmp421.ko 2023-07-14T12:25:19.147 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via-cputemp.ko 2023-07-14T12:25:19.147 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/via686a.ko 2023-07-14T12:25:19.147 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt1211.ko 2023-07-14T12:25:19.147 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/vt8231.ko 2023-07-14T12:25:19.147 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627ehf.ko 2023-07-14T12:25:19.148 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83627hf.ko 2023-07-14T12:25:19.148 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83781d.ko 2023-07-14T12:25:19.148 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83791d.ko 2023-07-14T12:25:19.148 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83792d.ko 2023-07-14T12:25:19.148 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83793.ko 2023-07-14T12:25:19.148 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83795.ko 2023-07-14T12:25:19.148 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l785ts.ko 2023-07-14T12:25:19.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/hwmon/w83l786ng.ko 2023-07-14T12:25:19.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c 2023-07-14T12:25:19.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos 2023-07-14T12:25:19.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-14T12:25:19.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-14T12:25:19.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses 2023-07-14T12:25:19.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-14T12:25:19.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-14T12:25:19.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-14T12:25:19.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-14T12:25:19.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-14T12:25:19.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-14T12:25:19.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-14T12:25:19.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-14T12:25:19.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-14T12:25:19.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-14T12:25:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-14T12:25:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-14T12:25:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-14T12:25:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-14T12:25:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-14T12:25:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-14T12:25:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-14T12:25:19.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-14T12:25:19.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-14T12:25:19.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-14T12:25:19.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-14T12:25:19.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-14T12:25:19.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-14T12:25:19.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-dev.ko 2023-07-14T12:25:19.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-mux.ko 2023-07-14T12:25:19.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-14T12:25:19.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-smbus.ko 2023-07-14T12:25:19.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/i2c/i2c-stub.ko 2023-07-14T12:25:19.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband 2023-07-14T12:25:19.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core 2023-07-14T12:25:19.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-14T12:25:19.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_core.ko 2023-07-14T12:25:19.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-14T12:25:19.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-14T12:25:19.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-14T12:25:19.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-14T12:25:19.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-14T12:25:19.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw 2023-07-14T12:25:19.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4 2023-07-14T12:25:19.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-14T12:25:19.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4 2023-07-14T12:25:19.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-14T12:25:19.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5 2023-07-14T12:25:19.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-14T12:25:19.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca 2023-07-14T12:25:19.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-14T12:25:19.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp 2023-07-14T12:25:19.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib 2023-07-14T12:25:19.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-14T12:25:19.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser 2023-07-14T12:25:19.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-14T12:25:19.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert 2023-07-14T12:25:19.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-14T12:25:19.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp 2023-07-14T12:25:19.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-14T12:25:19.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt 2023-07-14T12:25:19.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-14T12:25:19.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input 2023-07-14T12:25:19.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport 2023-07-14T12:25:19.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-14T12:25:19.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-14T12:25:19.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/gameport.ko 2023-07-14T12:25:19.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/lightning.ko 2023-07-14T12:25:19.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/gameport/ns558.ko 2023-07-14T12:25:19.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/joydev.ko 2023-07-14T12:25:19.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard 2023-07-14T12:25:19.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-14T12:25:19.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse 2023-07-14T12:25:19.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/appletouch.ko 2023-07-14T12:25:19.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/bcm5974.ko 2023-07-14T12:25:19.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/cyapatp.ko 2023-07-14T12:25:19.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-14T12:25:19.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/sermouse.ko 2023-07-14T12:25:19.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-14T12:25:19.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-14T12:25:19.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-14T12:25:19.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4 2023-07-14T12:25:19.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-14T12:25:19.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio 2023-07-14T12:25:19.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/altera_ps2.ko 2023-07-14T12:25:19.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/arc_ps2.ko 2023-07-14T12:25:19.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-14T12:25:19.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/serio/serio_raw.ko 2023-07-14T12:25:19.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/input/sparse-keymap.ko 2023-07-14T12:25:19.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu 2023-07-14T12:25:19.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd 2023-07-14T12:25:19.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-14T12:25:19.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds 2023-07-14T12:25:19.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-blinkm.ko 2023-07-14T12:25:19.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lm3530.ko 2023-07-14T12:25:19.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-lp3944.ko 2023-07-14T12:25:19.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/leds-ss4200.ko 2023-07-14T12:25:19.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger 2023-07-14T12:25:19.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-14T12:25:19.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-14T12:25:19.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-14T12:25:19.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-14T12:25:19.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-14T12:25:19.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-14T12:25:19.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-14T12:25:19.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-14T12:25:19.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md 2023-07-14T12:25:19.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache 2023-07-14T12:25:19.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/bcache/bcache.ko 2023-07-14T12:25:19.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-bio-prison.ko 2023-07-14T12:25:19.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache-smq.ko 2023-07-14T12:25:19.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-cache.ko 2023-07-14T12:25:19.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-crypt.ko 2023-07-14T12:25:19.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-delay.ko 2023-07-14T12:25:19.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-flakey.ko 2023-07-14T12:25:19.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-log-userspace.ko 2023-07-14T12:25:19.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-multipath.ko 2023-07-14T12:25:19.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-queue-length.ko 2023-07-14T12:25:19.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-raid.ko 2023-07-14T12:25:19.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-round-robin.ko 2023-07-14T12:25:19.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-service-time.ko 2023-07-14T12:25:19.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-switch.ko 2023-07-14T12:25:19.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-thin-pool.ko 2023-07-14T12:25:19.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/dm-verity.ko 2023-07-14T12:25:19.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/faulty.ko 2023-07-14T12:25:19.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/linear.ko 2023-07-14T12:25:19.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/multipath.ko 2023-07-14T12:25:19.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data 2023-07-14T12:25:19.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-14T12:25:19.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid0.ko 2023-07-14T12:25:19.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid1.ko 2023-07-14T12:25:19.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid10.ko 2023-07-14T12:25:19.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/md/raid456.ko 2023-07-14T12:25:19.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message 2023-07-14T12:25:19.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion 2023-07-14T12:25:19.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptbase.ko 2023-07-14T12:25:19.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptctl.ko 2023-07-14T12:25:19.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptfc.ko 2023-07-14T12:25:19.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptlan.ko 2023-07-14T12:25:19.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptsas.ko 2023-07-14T12:25:19.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptscsih.ko 2023-07-14T12:25:19.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/message/fusion/mptspi.ko 2023-07-14T12:25:19.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd 2023-07-14T12:25:19.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_ich.ko 2023-07-14T12:25:19.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/lpc_sch.ko 2023-07-14T12:25:19.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/mfd-core.ko 2023-07-14T12:25:19.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/sm501.ko 2023-07-14T12:25:19.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/viperboard.ko 2023-07-14T12:25:19.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/vx855.ko 2023-07-14T12:25:19.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/mfd/wl1273-core.ko 2023-07-14T12:25:19.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc 2023-07-14T12:25:19.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl 2023-07-14T12:25:19.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-14T12:25:19.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds9802als.ko 2023-07-14T12:25:19.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/apds990x.ko 2023-07-14T12:25:19.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/bh1770glc.ko 2023-07-14T12:25:19.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710 2023-07-14T12:25:19.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/cb710/cb710.ko 2023-07-14T12:25:19.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom 2023-07-14T12:25:19.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/at24.ko 2023-07-14T12:25:19.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-14T12:25:19.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-14T12:25:19.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/eeprom/max6875.ko 2023-07-14T12:25:19.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/enclosure.ko 2023-07-14T12:25:19.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/hpilo.ko 2023-07-14T12:25:19.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29003.ko 2023-07-14T12:25:19.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/isl29020.ko 2023-07-14T12:25:19.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d 2023-07-14T12:25:19.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-14T12:25:19.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-14T12:25:19.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei 2023-07-14T12:25:19.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-me.ko 2023-07-14T12:25:19.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei-txe.ko 2023-07-14T12:25:19.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/mei/mei.ko 2023-07-14T12:25:19.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru 2023-07-14T12:25:19.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-14T12:25:19.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp 2023-07-14T12:25:19.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-14T12:25:19.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-14T12:25:19.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-14T12:25:19.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_7xx1.ko 2023-07-14T12:25:19.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tifm_core.ko 2023-07-14T12:25:19.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/tsl2550.ko 2023-07-14T12:25:19.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_balloon.ko 2023-07-14T12:25:19.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci 2023-07-14T12:25:19.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-14T12:25:19.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net 2023-07-14T12:25:19.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding 2023-07-14T12:25:19.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/bonding/bonding.ko 2023-07-14T12:25:19.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa 2023-07-14T12:25:19.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53 2023-07-14T12:25:19.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-14T12:25:19.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-14T12:25:19.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-14T12:25:19.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx 2023-07-14T12:25:19.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-14T12:25:19.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/dummy.ko 2023-07-14T12:25:19.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/eql.ko 2023-07-14T12:25:19.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet 2023-07-14T12:25:19.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com 2023-07-14T12:25:19.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-14T12:25:19.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-14T12:25:19.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-14T12:25:19.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-14T12:25:19.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390 2023-07-14T12:25:19.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-14T12:25:19.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-14T12:25:19.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-14T12:25:19.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-14T12:25:19.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec 2023-07-14T12:25:19.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-14T12:25:19.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere 2023-07-14T12:25:19.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-14T12:25:19.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon 2023-07-14T12:25:19.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-14T12:25:19.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera 2023-07-14T12:25:19.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-14T12:25:19.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd 2023-07-14T12:25:19.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-14T12:25:19.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-14T12:25:19.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-14T12:25:19.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros 2023-07-14T12:25:19.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx 2023-07-14T12:25:19.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-14T12:25:19.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-14T12:25:19.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-14T12:25:19.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-14T12:25:19.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-14T12:25:19.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx 2023-07-14T12:25:19.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-14T12:25:19.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-14T12:25:19.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom 2023-07-14T12:25:19.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-14T12:25:19.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-14T12:25:19.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-14T12:25:19.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-14T12:25:19.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-14T12:25:19.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet 2023-07-14T12:25:19.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-14T12:25:19.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-14T12:25:19.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade 2023-07-14T12:25:19.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna 2023-07-14T12:25:19.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-14T12:25:19.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio 2023-07-14T12:25:19.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-14T12:25:19.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-14T12:25:19.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-14T12:25:19.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-14T12:25:19.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-14T12:25:19.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-14T12:25:19.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-14T12:25:19.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-14T12:25:19.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-14T12:25:19.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-14T12:25:19.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco 2023-07-14T12:25:19.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic 2023-07-14T12:25:19.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-14T12:25:19.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec 2023-07-14T12:25:19.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip 2023-07-14T12:25:19.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-14T12:25:19.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-14T12:25:19.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-14T12:25:19.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-14T12:25:19.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-14T12:25:19.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-14T12:25:19.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink 2023-07-14T12:25:19.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-14T12:25:19.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-14T12:25:19.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/dnet.ko 2023-07-14T12:25:19.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex 2023-07-14T12:25:19.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet 2023-07-14T12:25:19.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-14T12:25:19.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ethoc.ko 2023-07-14T12:25:19.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/fealnx.ko 2023-07-14T12:25:19.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel 2023-07-14T12:25:19.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-14T12:25:19.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000 2023-07-14T12:25:19.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-14T12:25:19.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e 2023-07-14T12:25:19.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-14T12:25:19.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k 2023-07-14T12:25:19.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-14T12:25:19.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e 2023-07-14T12:25:19.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-14T12:25:19.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf 2023-07-14T12:25:19.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-14T12:25:19.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb 2023-07-14T12:25:19.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-14T12:25:19.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf 2023-07-14T12:25:19.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-14T12:25:19.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-14T12:25:19.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-14T12:25:19.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-14T12:25:19.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-14T12:25:19.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/jme.ko 2023-07-14T12:25:19.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell 2023-07-14T12:25:19.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-14T12:25:19.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-14T12:25:19.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-14T12:25:19.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox 2023-07-14T12:25:19.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-14T12:25:19.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-14T12:25:19.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-14T12:25:19.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-14T12:25:19.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-14T12:25:19.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-14T12:25:19.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel 2023-07-14T12:25:19.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-14T12:25:19.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom 2023-07-14T12:25:19.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-14T12:25:19.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-14T12:25:19.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi 2023-07-14T12:25:19.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-14T12:25:19.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-14T12:25:19.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion 2023-07-14T12:25:19.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-14T12:25:19.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia 2023-07-14T12:25:19.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-14T12:25:19.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines 2023-07-14T12:25:19.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-14T12:25:19.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-14T12:25:19.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic 2023-07-14T12:25:19.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-14T12:25:19.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-14T12:25:19.192 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-14T12:25:19.192 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-14T12:25:19.192 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-14T12:25:19.192 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc 2023-07-14T12:25:19.192 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-14T12:25:19.192 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek 2023-07-14T12:25:19.192 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-14T12:25:19.192 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-14T12:25:19.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-14T12:25:19.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-14T12:25:19.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker 2023-07-14T12:25:19.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-14T12:25:19.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc 2023-07-14T12:25:19.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-14T12:25:19.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan 2023-07-14T12:25:19.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-14T12:25:19.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis 2023-07-14T12:25:19.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-14T12:25:19.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-14T12:25:19.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc 2023-07-14T12:25:19.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-14T12:25:19.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-14T12:25:19.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-14T12:25:19.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-14T12:25:19.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro 2023-07-14T12:25:19.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-14T12:25:19.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-14T12:25:19.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-14T12:25:19.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun 2023-07-14T12:25:19.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-14T12:25:19.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-14T12:25:19.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-14T12:25:19.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-14T12:25:19.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti 2023-07-14T12:25:19.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-14T12:25:19.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti 2023-07-14T12:25:19.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-14T12:25:19.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via 2023-07-14T12:25:19.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-14T12:25:19.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-14T12:25:19.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet 2023-07-14T12:25:19.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-14T12:25:19.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-14T12:25:19.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom 2023-07-14T12:25:19.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-14T12:25:19.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/geneve.ko 2023-07-14T12:25:19.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv 2023-07-14T12:25:19.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-14T12:25:19.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154 2023-07-14T12:25:19.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-14T12:25:19.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ifb.ko 2023-07-14T12:25:19.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan 2023-07-14T12:25:19.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-14T12:25:19.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvlan.ko 2023-07-14T12:25:19.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/macvtap.ko 2023-07-14T12:25:19.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio 2023-07-14T12:25:19.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio.ko 2023-07-14T12:25:19.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-14T12:25:19.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-14T12:25:19.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-14T12:25:19.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/mii.ko 2023-07-14T12:25:19.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/net_failover.ko 2023-07-14T12:25:19.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/netconsole.ko 2023-07-14T12:25:19.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/nlmon.ko 2023-07-14T12:25:19.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs 2023-07-14T12:25:19.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-14T12:25:19.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-14T12:25:19.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy 2023-07-14T12:25:19.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/amd.ko 2023-07-14T12:25:19.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-14T12:25:19.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-14T12:25:19.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-14T12:25:19.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/bcm87xx.ko 2023-07-14T12:25:19.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/broadcom.ko 2023-07-14T12:25:19.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/cicada.ko 2023-07-14T12:25:19.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/davicom.ko 2023-07-14T12:25:19.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/dp83640.ko 2023-07-14T12:25:19.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/et1011c.ko 2023-07-14T12:25:19.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/icplus.ko 2023-07-14T12:25:19.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/lxt.ko 2023-07-14T12:25:19.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/marvell.ko 2023-07-14T12:25:19.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/micrel.ko 2023-07-14T12:25:19.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/national.ko 2023-07-14T12:25:19.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/phylink.ko 2023-07-14T12:25:19.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/qsemi.ko 2023-07-14T12:25:19.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/realtek.ko 2023-07-14T12:25:19.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/smsc.ko 2023-07-14T12:25:19.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/ste10Xp.ko 2023-07-14T12:25:19.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/phy/vitesse.ko 2023-07-14T12:25:19.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp 2023-07-14T12:25:19.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-14T12:25:19.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_async.ko 2023-07-14T12:25:19.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-14T12:25:19.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-14T12:25:19.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-14T12:25:19.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-14T12:25:19.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppoe.ko 2023-07-14T12:25:19.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pppox.ko 2023-07-14T12:25:19.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/ppp/pptp.ko 2023-07-14T12:25:19.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip 2023-07-14T12:25:19.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slhc.ko 2023-07-14T12:25:19.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/slip/slip.ko 2023-07-14T12:25:19.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/sungem_phy.ko 2023-07-14T12:25:19.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tap.ko 2023-07-14T12:25:19.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team 2023-07-14T12:25:19.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team.ko 2023-07-14T12:25:19.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-14T12:25:19.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-14T12:25:19.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-14T12:25:19.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_random.ko 2023-07-14T12:25:19.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-14T12:25:19.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/tun.ko 2023-07-14T12:25:19.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/veth.ko 2023-07-14T12:25:19.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/virtio_net.ko 2023-07-14T12:25:19.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3 2023-07-14T12:25:19.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-14T12:25:19.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan 2023-07-14T12:25:19.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/vxlan/vxlan.ko 2023-07-14T12:25:19.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback 2023-07-14T12:25:19.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-14T12:25:19.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/net/xen-netfront.ko 2023-07-14T12:25:19.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb 2023-07-14T12:25:19.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ntb/ntb.ko 2023-07-14T12:25:19.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme 2023-07-14T12:25:19.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host 2023-07-14T12:25:19.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme-core.ko 2023-07-14T12:25:19.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/nvme/host/nvme.ko 2023-07-14T12:25:19.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport 2023-07-14T12:25:19.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport.ko 2023-07-14T12:25:19.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_cs.ko 2023-07-14T12:25:19.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_pc.ko 2023-07-14T12:25:19.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/parport/parport_serial.ko 2023-07-14T12:25:19.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci 2023-07-14T12:25:19.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug 2023-07-14T12:25:19.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-14T12:25:19.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie 2023-07-14T12:25:19.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-14T12:25:19.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pci/xen-pcifront.ko 2023-07-14T12:25:19.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia 2023-07-14T12:25:19.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/i82092.ko 2023-07-14T12:25:19.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/pd6729.ko 2023-07-14T12:25:19.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-14T12:25:19.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl 2023-07-14T12:25:19.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel 2023-07-14T12:25:19.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-14T12:25:19.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform 2023-07-14T12:25:19.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86 2023-07-14T12:25:19.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-14T12:25:19.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/acerhdf.ko 2023-07-14T12:25:19.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-14T12:25:19.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-14T12:25:19.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-14T12:25:19.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-14T12:25:19.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-14T12:25:19.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-14T12:25:19.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-14T12:25:19.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-14T12:25:19.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-14T12:25:19.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/hdaps.ko 2023-07-14T12:25:19.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel 2023-07-14T12:25:19.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-14T12:25:19.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/intel_ips.ko 2023-07-14T12:25:19.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-14T12:25:19.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-14T12:25:19.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-14T12:25:19.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-14T12:25:19.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-14T12:25:19.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-14T12:25:19.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-14T12:25:19.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-14T12:25:19.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-14T12:25:19.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/platform/x86/wmi.ko 2023-07-14T12:25:19.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap 2023-07-14T12:25:19.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-14T12:25:19.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-14T12:25:19.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps 2023-07-14T12:25:19.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients 2023-07-14T12:25:19.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-14T12:25:19.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-14T12:25:19.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/clients/pps_parport.ko 2023-07-14T12:25:19.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/pps/pps_core.ko 2023-07-14T12:25:19.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp 2023-07-14T12:25:19.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp.ko 2023-07-14T12:25:19.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ptp/ptp_kvm.ko 2023-07-14T12:25:19.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc 2023-07-14T12:25:19.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-14T12:25:19.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-14T12:25:19.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-14T12:25:19.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-14T12:25:19.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-14T12:25:19.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-14T12:25:19.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-14T12:25:19.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-14T12:25:19.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-14T12:25:19.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-14T12:25:19.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-14T12:25:19.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-em3027.ko 2023-07-14T12:25:19.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-14T12:25:19.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-14T12:25:19.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-14T12:25:19.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-14T12:25:19.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-14T12:25:19.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-14T12:25:19.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-max6900.ko 2023-07-14T12:25:19.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-14T12:25:19.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-14T12:25:19.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-14T12:25:19.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-14T12:25:19.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-14T12:25:19.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-14T12:25:19.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-14T12:25:19.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-14T12:25:19.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-14T12:25:19.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-14T12:25:19.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-14T12:25:19.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-14T12:25:19.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/rtc/rtc-x1205.ko 2023-07-14T12:25:19.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi 2023-07-14T12:25:19.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-9xxx.ko 2023-07-14T12:25:19.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-sas.ko 2023-07-14T12:25:19.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/3w-xxxx.ko 2023-07-14T12:25:19.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/BusLogic.ko 2023-07-14T12:25:19.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/a100u2w.ko 2023-07-14T12:25:19.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid 2023-07-14T12:25:19.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-14T12:25:19.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/advansys.ko 2023-07-14T12:25:19.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx 2023-07-14T12:25:19.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-14T12:25:19.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-14T12:25:19.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/am53c974.ko 2023-07-14T12:25:19.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr 2023-07-14T12:25:19.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-14T12:25:19.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/atp870u.ko 2023-07-14T12:25:19.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi 2023-07-14T12:25:19.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-14T12:25:19.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa 2023-07-14T12:25:19.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bfa/bfa.ko 2023-07-14T12:25:19.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc 2023-07-14T12:25:19.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-14T12:25:19.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i 2023-07-14T12:25:19.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-14T12:25:19.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ch.ko 2023-07-14T12:25:19.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor 2023-07-14T12:25:19.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-14T12:25:19.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi 2023-07-14T12:25:19.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-14T12:25:19.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-14T12:25:19.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-14T12:25:19.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-14T12:25:19.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-14T12:25:19.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dc395x.ko 2023-07-14T12:25:19.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler 2023-07-14T12:25:19.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-14T12:25:19.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-14T12:25:19.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-14T12:25:19.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-14T12:25:19.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/dmx3191d.ko 2023-07-14T12:25:19.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r 2023-07-14T12:25:19.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-14T12:25:19.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/esp_scsi.ko 2023-07-14T12:25:19.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe 2023-07-14T12:25:19.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-14T12:25:19.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-14T12:25:19.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic 2023-07-14T12:25:19.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/fnic/fnic.ko 2023-07-14T12:25:19.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hpsa.ko 2023-07-14T12:25:19.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hptiop.ko 2023-07-14T12:25:19.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/hv_storvsc.ko 2023-07-14T12:25:19.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/initio.ko 2023-07-14T12:25:19.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ipr.ko 2023-07-14T12:25:19.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ips.ko 2023-07-14T12:25:19.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci 2023-07-14T12:25:19.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/isci/isci.ko 2023-07-14T12:25:19.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-14T12:25:19.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-14T12:25:19.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc 2023-07-14T12:25:19.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libfc/libfc.ko 2023-07-14T12:25:19.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi.ko 2023-07-14T12:25:19.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-14T12:25:19.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas 2023-07-14T12:25:19.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/libsas/libsas.ko 2023-07-14T12:25:19.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc 2023-07-14T12:25:19.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-14T12:25:19.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid 2023-07-14T12:25:19.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid.ko 2023-07-14T12:25:19.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-14T12:25:19.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-14T12:25:19.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-14T12:25:19.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas 2023-07-14T12:25:19.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-14T12:25:19.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas 2023-07-14T12:25:19.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-14T12:25:19.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/mvumi.ko 2023-07-14T12:25:19.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001 2023-07-14T12:25:19.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-14T12:25:19.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/pmcraid.ko 2023-07-14T12:25:19.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla1280.ko 2023-07-14T12:25:19.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx 2023-07-14T12:25:19.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-14T12:25:19.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-14T12:25:19.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx 2023-07-14T12:25:19.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-14T12:25:19.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/raid_class.ko 2023-07-14T12:25:19.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_debug.ko 2023-07-14T12:25:19.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-14T12:25:19.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-14T12:25:19.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-14T12:25:19.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-14T12:25:19.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-14T12:25:19.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/ses.ko 2023-07-14T12:25:19.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/st.ko 2023-07-14T12:25:19.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/stex.ko 2023-07-14T12:25:19.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2 2023-07-14T12:25:19.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-14T12:25:19.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/virtio_scsi.ko 2023-07-14T12:25:19.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-14T12:25:19.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/scsi/wd719x.ko 2023-07-14T12:25:19.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb 2023-07-14T12:25:19.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ssb/ssb.ko 2023-07-14T12:25:19.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target 2023-07-14T12:25:19.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi 2023-07-14T12:25:19.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-14T12:25:19.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback 2023-07-14T12:25:19.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-14T12:25:19.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_file.ko 2023-07-14T12:25:19.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_iblock.ko 2023-07-14T12:25:19.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_mod.ko 2023-07-14T12:25:19.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_pscsi.ko 2023-07-14T12:25:19.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/target_core_user.ko 2023-07-14T12:25:19.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc 2023-07-14T12:25:19.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-14T12:25:19.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal 2023-07-14T12:25:19.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel 2023-07-14T12:25:19.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal 2023-07-14T12:25:19.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-14T12:25:19.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-14T12:25:19.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-14T12:25:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-14T12:25:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-14T12:25:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-14T12:25:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-14T12:25:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-14T12:25:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-14T12:25:19.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-14T12:25:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-14T12:25:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-14T12:25:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-14T12:25:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-14T12:25:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-14T12:25:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty 2023-07-14T12:25:19.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless 2023-07-14T12:25:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-14T12:25:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_gsm.ko 2023-07-14T12:25:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/n_hdlc.ko 2023-07-14T12:25:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/nozomi.ko 2023-07-14T12:25:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial 2023-07-14T12:25:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250 2023-07-14T12:25:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-14T12:25:19.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/arc_uart.ko 2023-07-14T12:25:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm 2023-07-14T12:25:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-14T12:25:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/tty/synclink_gt.ko 2023-07-14T12:25:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs 2023-07-14T12:25:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core 2023-07-14T12:25:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-14T12:25:19.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host 2023-07-14T12:25:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-14T12:25:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio 2023-07-14T12:25:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio.ko 2023-07-14T12:25:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_aec.ko 2023-07-14T12:25:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_cif.ko 2023-07-14T12:25:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_pci_generic.ko 2023-07-14T12:25:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/uio/uio_sercos3.ko 2023-07-14T12:25:19.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb 2023-07-14T12:25:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class 2023-07-14T12:25:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-acm.ko 2023-07-14T12:25:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-14T12:25:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usblp.ko 2023-07-14T12:25:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/class/usbtmc.ko 2023-07-14T12:25:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host 2023-07-14T12:25:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-14T12:25:19.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image 2023-07-14T12:25:19.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/mdc800.ko 2023-07-14T12:25:19.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/image/microtek.ko 2023-07-14T12:25:19.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc 2023-07-14T12:25:19.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/adutux.ko 2023-07-14T12:25:19.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/appledisplay.ko 2023-07-14T12:25:19.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi26.ko 2023-07-14T12:25:19.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/emi62.ko 2023-07-14T12:25:19.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ezusb.ko 2023-07-14T12:25:19.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/idmouse.ko 2023-07-14T12:25:19.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/iowarrior.ko 2023-07-14T12:25:19.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-14T12:25:19.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/ldusb.ko 2023-07-14T12:25:19.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/legousbtower.ko 2023-07-14T12:25:19.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga 2023-07-14T12:25:19.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-14T12:25:19.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-14T12:25:19.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usb3503.ko 2023-07-14T12:25:19.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usblcd.ko 2023-07-14T12:25:19.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-14T12:25:19.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/uss720.ko 2023-07-14T12:25:19.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/misc/yurex.ko 2023-07-14T12:25:19.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy 2023-07-14T12:25:19.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/phy/phy-generic.ko 2023-07-14T12:25:19.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial 2023-07-14T12:25:19.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/aircable.ko 2023-07-14T12:25:19.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ark3116.ko 2023-07-14T12:25:19.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-14T12:25:19.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ch341.ko 2023-07-14T12:25:19.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cp210x.ko 2023-07-14T12:25:19.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cyberjack.ko 2023-07-14T12:25:19.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-14T12:25:19.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-14T12:25:19.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/empeg.ko 2023-07-14T12:25:19.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-14T12:25:19.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-14T12:25:19.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-14T12:25:19.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/io_ti.ko 2023-07-14T12:25:19.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipaq.ko 2023-07-14T12:25:19.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ipw.ko 2023-07-14T12:25:19.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ir-usb.ko 2023-07-14T12:25:19.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-14T12:25:19.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan.ko 2023-07-14T12:25:19.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-14T12:25:19.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-14T12:25:19.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-14T12:25:19.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mct_u232.ko 2023-07-14T12:25:19.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7720.ko 2023-07-14T12:25:19.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/mos7840.ko 2023-07-14T12:25:19.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/navman.ko 2023-07-14T12:25:19.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/omninet.ko 2023-07-14T12:25:19.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/opticon.ko 2023-07-14T12:25:19.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/option.ko 2023-07-14T12:25:19.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/oti6858.ko 2023-07-14T12:25:19.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/pl2303.ko 2023-07-14T12:25:19.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcaux.ko 2023-07-14T12:25:19.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/qcserial.ko 2023-07-14T12:25:19.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/quatech2.ko 2023-07-14T12:25:19.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/safe_serial.ko 2023-07-14T12:25:19.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/sierra.ko 2023-07-14T12:25:19.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-14T12:25:19.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ssu100.ko 2023-07-14T12:25:19.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/symbolserial.ko 2023-07-14T12:25:19.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-14T12:25:19.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-14T12:25:19.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_debug.ko 2023-07-14T12:25:19.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-14T12:25:19.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/visor.ko 2023-07-14T12:25:19.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/whiteheat.ko 2023-07-14T12:25:19.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-14T12:25:19.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage 2023-07-14T12:25:19.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/uas.ko 2023-07-14T12:25:19.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-14T12:25:19.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-14T12:25:19.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-14T12:25:19.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-14T12:25:19.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-14T12:25:19.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-14T12:25:19.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-14T12:25:19.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-karma.ko 2023-07-14T12:25:19.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-14T12:25:19.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-14T12:25:19.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-14T12:25:19.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-14T12:25:19.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-14T12:25:19.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/storage/usb-storage.ko 2023-07-14T12:25:19.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip 2023-07-14T12:25:19.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-14T12:25:19.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-14T12:25:19.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-14T12:25:19.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio 2023-07-14T12:25:19.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci 2023-07-14T12:25:19.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-14T12:25:19.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-14T12:25:19.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio.ko 2023-07-14T12:25:19.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-14T12:25:19.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost 2023-07-14T12:25:19.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost.ko 2023-07-14T12:25:19.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-14T12:25:19.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_net.ko 2023-07-14T12:25:19.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/vhost/vhost_scsi.ko 2023-07-14T12:25:19.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video 2023-07-14T12:25:19.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight 2023-07-14T12:25:19.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/apple_bl.ko 2023-07-14T12:25:19.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/lcd.ko 2023-07-14T12:25:19.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-14T12:25:19.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio 2023-07-14T12:25:19.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio.ko 2023-07-14T12:25:19.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_balloon.ko 2023-07-14T12:25:19.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_mmio.ko 2023-07-14T12:25:19.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci.ko 2023-07-14T12:25:19.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-14T12:25:19.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-14T12:25:19.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/virtio/virtio_ring.ko 2023-07-14T12:25:19.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1 2023-07-14T12:25:19.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters 2023-07-14T12:25:19.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2482.ko 2023-07-14T12:25:19.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/masters/ds2490.ko 2023-07-14T12:25:19.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves 2023-07-14T12:25:19.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-14T12:25:19.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-14T12:25:19.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-14T12:25:19.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-14T12:25:19.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-14T12:25:19.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-14T12:25:19.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-14T12:25:19.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-14T12:25:19.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-14T12:25:19.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-14T12:25:19.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-14T12:25:19.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/w1/wire.ko 2023-07-14T12:25:19.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog 2023-07-14T12:25:19.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-14T12:25:19.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-14T12:25:19.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-14T12:25:19.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/hpwdt.ko 2023-07-14T12:25:19.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/i6300esb.ko 2023-07-14T12:25:19.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-14T12:25:19.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-14T12:25:19.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ib700wdt.ko 2023-07-14T12:25:19.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ibmasr.ko 2023-07-14T12:25:19.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-14T12:25:19.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-14T12:25:19.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/it87_wdt.ko 2023-07-14T12:25:19.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/machzwd.ko 2023-07-14T12:25:19.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/nv_tco.ko 2023-07-14T12:25:19.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-14T12:25:19.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-14T12:25:19.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-14T12:25:19.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-14T12:25:19.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/softdog.ko 2023-07-14T12:25:19.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-14T12:25:19.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/via_wdt.ko 2023-07-14T12:25:19.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-14T12:25:19.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-14T12:25:19.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-14T12:25:19.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/wdt_pci.ko 2023-07-14T12:25:19.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/watchdog/xen_wdt.ko 2023-07-14T12:25:19.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen 2023-07-14T12:25:19.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-14T12:25:19.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-evtchn.ko 2023-07-14T12:25:19.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntalloc.ko 2023-07-14T12:25:19.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-gntdev.ko 2023-07-14T12:25:19.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback 2023-07-14T12:25:19.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-14T12:25:19.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xen-privcmd.ko 2023-07-14T12:25:19.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs 2023-07-14T12:25:19.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-14T12:25:19.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs 2023-07-14T12:25:19.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p 2023-07-14T12:25:19.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/9p/9p.ko 2023-07-14T12:25:19.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs 2023-07-14T12:25:19.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/affs/affs.ko 2023-07-14T12:25:19.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs 2023-07-14T12:25:19.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/befs/befs.ko 2023-07-14T12:25:19.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/binfmt_misc.ko 2023-07-14T12:25:19.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs 2023-07-14T12:25:19.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/btrfs/btrfs.ko 2023-07-14T12:25:19.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles 2023-07-14T12:25:19.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cachefiles/cachefiles.ko 2023-07-14T12:25:19.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph 2023-07-14T12:25:19.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ceph/ceph.ko 2023-07-14T12:25:19.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda 2023-07-14T12:25:19.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/coda/coda.ko 2023-07-14T12:25:19.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs 2023-07-14T12:25:19.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/cramfs/cramfs.ko 2023-07-14T12:25:19.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm 2023-07-14T12:25:19.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/dlm/dlm.ko 2023-07-14T12:25:19.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs 2023-07-14T12:25:19.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-14T12:25:19.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs 2023-07-14T12:25:19.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/f2fs/f2fs.ko 2023-07-14T12:25:19.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat 2023-07-14T12:25:19.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/fat.ko 2023-07-14T12:25:19.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/msdos.ko 2023-07-14T12:25:19.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fat/vfat.ko 2023-07-14T12:25:19.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache 2023-07-14T12:25:19.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fscache/fscache.ko 2023-07-14T12:25:19.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse 2023-07-14T12:25:19.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/cuse.ko 2023-07-14T12:25:19.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/fuse/fuse.ko 2023-07-14T12:25:19.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2 2023-07-14T12:25:19.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/gfs2/gfs2.ko 2023-07-14T12:25:19.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs 2023-07-14T12:25:19.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfs/hfs.ko 2023-07-14T12:25:19.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus 2023-07-14T12:25:19.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/hfsplus/hfsplus.ko 2023-07-14T12:25:19.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs 2023-07-14T12:25:19.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/isofs/isofs.ko 2023-07-14T12:25:19.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs 2023-07-14T12:25:19.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/jfs/jfs.ko 2023-07-14T12:25:19.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd 2023-07-14T12:25:19.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/lockd/lockd.ko 2023-07-14T12:25:19.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix 2023-07-14T12:25:19.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/minix/minix.ko 2023-07-14T12:25:19.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs 2023-07-14T12:25:19.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/netfs/netfs.ko 2023-07-14T12:25:19.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs 2023-07-14T12:25:19.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout 2023-07-14T12:25:19.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-14T12:25:19.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout 2023-07-14T12:25:19.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-14T12:25:19.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout 2023-07-14T12:25:19.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-14T12:25:19.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfs.ko 2023-07-14T12:25:19.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv3.ko 2023-07-14T12:25:19.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs/nfsv4.ko 2023-07-14T12:25:19.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common 2023-07-14T12:25:19.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/grace.ko 2023-07-14T12:25:19.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfs_common/nfs_acl.ko 2023-07-14T12:25:19.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd 2023-07-14T12:25:19.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nfsd/nfsd.ko 2023-07-14T12:25:19.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2 2023-07-14T12:25:19.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nilfs2/nilfs2.ko 2023-07-14T12:25:19.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls 2023-07-14T12:25:19.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-celtic.ko 2023-07-14T12:25:19.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-centeuro.ko 2023-07-14T12:25:19.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-croatian.ko 2023-07-14T12:25:19.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-cyrillic.ko 2023-07-14T12:25:19.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-gaelic.ko 2023-07-14T12:25:19.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-greek.ko 2023-07-14T12:25:19.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-iceland.ko 2023-07-14T12:25:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-inuit.ko 2023-07-14T12:25:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-roman.ko 2023-07-14T12:25:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-romanian.ko 2023-07-14T12:25:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/mac-turkish.ko 2023-07-14T12:25:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1250.ko 2023-07-14T12:25:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1251.ko 2023-07-14T12:25:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp1255.ko 2023-07-14T12:25:19.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp737.ko 2023-07-14T12:25:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp775.ko 2023-07-14T12:25:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp850.ko 2023-07-14T12:25:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp852.ko 2023-07-14T12:25:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp855.ko 2023-07-14T12:25:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp857.ko 2023-07-14T12:25:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp860.ko 2023-07-14T12:25:19.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp861.ko 2023-07-14T12:25:19.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp862.ko 2023-07-14T12:25:19.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp863.ko 2023-07-14T12:25:19.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp864.ko 2023-07-14T12:25:19.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp865.ko 2023-07-14T12:25:19.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp866.ko 2023-07-14T12:25:19.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp869.ko 2023-07-14T12:25:19.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp874.ko 2023-07-14T12:25:19.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp932.ko 2023-07-14T12:25:19.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp936.ko 2023-07-14T12:25:19.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp949.ko 2023-07-14T12:25:19.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_cp950.ko 2023-07-14T12:25:19.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_euc-jp.ko 2023-07-14T12:25:19.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-1.ko 2023-07-14T12:25:19.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-13.ko 2023-07-14T12:25:19.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-14.ko 2023-07-14T12:25:19.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-15.ko 2023-07-14T12:25:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-2.ko 2023-07-14T12:25:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-3.ko 2023-07-14T12:25:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-4.ko 2023-07-14T12:25:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-5.ko 2023-07-14T12:25:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-6.ko 2023-07-14T12:25:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-7.ko 2023-07-14T12:25:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_iso8859-9.ko 2023-07-14T12:25:19.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-r.ko 2023-07-14T12:25:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-ru.ko 2023-07-14T12:25:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_koi8-u.ko 2023-07-14T12:25:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/nls/nls_utf8.ko 2023-07-14T12:25:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2 2023-07-14T12:25:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster 2023-07-14T12:25:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-14T12:25:19.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm 2023-07-14T12:25:19.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-14T12:25:19.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs 2023-07-14T12:25:19.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-14T12:25:19.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2.ko 2023-07-14T12:25:19.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-14T12:25:19.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-14T12:25:19.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-14T12:25:19.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs 2023-07-14T12:25:19.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/overlayfs/overlay.ko 2023-07-14T12:25:19.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore 2023-07-14T12:25:19.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/pstore/ramoops.ko 2023-07-14T12:25:19.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs 2023-07-14T12:25:19.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/reiserfs/reiserfs.ko 2023-07-14T12:25:19.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs 2023-07-14T12:25:19.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/romfs/romfs.ko 2023-07-14T12:25:19.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb 2023-07-14T12:25:19.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client 2023-07-14T12:25:19.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/client/cifs.ko 2023-07-14T12:25:19.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common 2023-07-14T12:25:19.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_arc4.ko 2023-07-14T12:25:19.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/smb/common/cifs_md4.ko 2023-07-14T12:25:19.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs 2023-07-14T12:25:19.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/squashfs/squashfs.ko 2023-07-14T12:25:19.284 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv 2023-07-14T12:25:19.284 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/sysv/sysv.ko 2023-07-14T12:25:19.284 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf 2023-07-14T12:25:19.284 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/udf/udf.ko 2023-07-14T12:25:19.284 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs 2023-07-14T12:25:19.284 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/ufs/ufs.ko 2023-07-14T12:25:19.284 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs 2023-07-14T12:25:19.285 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/fs/xfs/xfs.ko 2023-07-14T12:25:19.285 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel 2023-07-14T12:25:19.285 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu 2023-07-14T12:25:19.285 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/rcu/rcutorture.ko 2023-07-14T12:25:19.285 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/torture.ko 2023-07-14T12:25:19.285 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace 2023-07-14T12:25:19.285 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-14T12:25:19.285 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib 2023-07-14T12:25:19.286 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/asn1_encoder.ko 2023-07-14T12:25:19.286 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc-itu-t.ko 2023-07-14T12:25:19.286 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crc8.ko 2023-07-14T12:25:19.286 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto 2023-07-14T12:25:19.286 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libarc4.ko 2023-07-14T12:25:19.286 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/crypto/libdes.ko 2023-07-14T12:25:19.286 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/libcrc32c.ko 2023-07-14T12:25:19.287 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lru_cache.ko 2023-07-14T12:25:19.287 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4 2023-07-14T12:25:19.287 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4_compress.ko 2023-07-14T12:25:19.287 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/lz4/lz4hc_compress.ko 2023-07-14T12:25:19.287 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math 2023-07-14T12:25:19.287 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/math/cordic.ko 2023-07-14T12:25:19.287 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6 2023-07-14T12:25:19.287 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/raid6/raid6_pq.ko 2023-07-14T12:25:19.288 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon 2023-07-14T12:25:19.288 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-14T12:25:19.288 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_bm.ko 2023-07-14T12:25:19.288 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_fsm.ko 2023-07-14T12:25:19.288 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/ts_kmp.ko 2023-07-14T12:25:19.288 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd 2023-07-14T12:25:19.288 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/lib/zstd/zstd_compress.ko 2023-07-14T12:25:19.289 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm 2023-07-14T12:25:19.289 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/mm/hwpoison-inject.ko 2023-07-14T12:25:19.289 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net 2023-07-14T12:25:19.289 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan 2023-07-14T12:25:19.289 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/6lowpan.ko 2023-07-14T12:25:19.289 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_dest.ko 2023-07-14T12:25:19.289 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_fragment.ko 2023-07-14T12:25:19.289 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_hop.ko 2023-07-14T12:25:19.290 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-14T12:25:19.290 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_mobility.ko 2023-07-14T12:25:19.290 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_routing.ko 2023-07-14T12:25:19.290 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/6lowpan/nhc_udp.ko 2023-07-14T12:25:19.290 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802 2023-07-14T12:25:19.290 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/garp.ko 2023-07-14T12:25:19.290 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/mrp.ko 2023-07-14T12:25:19.290 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/p8022.ko 2023-07-14T12:25:19.291 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/psnap.ko 2023-07-14T12:25:19.291 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/802/stp.ko 2023-07-14T12:25:19.291 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q 2023-07-14T12:25:19.291 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/8021q/8021q.ko 2023-07-14T12:25:19.291 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p 2023-07-14T12:25:19.291 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet.ko 2023-07-14T12:25:19.291 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_fd.ko 2023-07-14T12:25:19.291 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_rdma.ko 2023-07-14T12:25:19.292 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/9p/9pnet_virtio.ko 2023-07-14T12:25:19.292 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv 2023-07-14T12:25:19.292 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/batman-adv/batman-adv.ko 2023-07-14T12:25:19.292 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge 2023-07-14T12:25:19.292 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/br_netfilter.ko 2023-07-14T12:25:19.292 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/bridge.ko 2023-07-14T12:25:19.292 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter 2023-07-14T12:25:19.293 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-14T12:25:19.293 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-14T12:25:19.293 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-14T12:25:19.293 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-14T12:25:19.293 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-14T12:25:19.293 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-14T12:25:19.294 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-14T12:25:19.294 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-14T12:25:19.294 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-14T12:25:19.294 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-14T12:25:19.294 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-14T12:25:19.294 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-14T12:25:19.294 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-14T12:25:19.294 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-14T12:25:19.295 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-14T12:25:19.295 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-14T12:25:19.295 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-14T12:25:19.295 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-14T12:25:19.295 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-14T12:25:19.295 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-14T12:25:19.295 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/ebtables.ko 2023-07-14T12:25:19.296 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-14T12:25:19.296 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-14T12:25:19.296 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-14T12:25:19.296 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph 2023-07-14T12:25:19.296 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ceph/libceph.ko 2023-07-14T12:25:19.296 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core 2023-07-14T12:25:19.296 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/failover.ko 2023-07-14T12:25:19.297 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/core/pktgen.ko 2023-07-14T12:25:19.297 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp 2023-07-14T12:25:19.297 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp.ko 2023-07-14T12:25:19.297 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_diag.ko 2023-07-14T12:25:19.297 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv4.ko 2023-07-14T12:25:19.297 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dccp/dccp_ipv6.ko 2023-07-14T12:25:19.297 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver 2023-07-14T12:25:19.298 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dns_resolver/dns_resolver.ko 2023-07-14T12:25:19.298 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa 2023-07-14T12:25:19.298 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/dsa_core.ko 2023-07-14T12:25:19.298 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_brcm.ko 2023-07-14T12:25:19.298 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_dsa.ko 2023-07-14T12:25:19.298 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_none.ko 2023-07-14T12:25:19.298 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/dsa/tag_trailer.ko 2023-07-14T12:25:19.298 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154 2023-07-14T12:25:19.299 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan 2023-07-14T12:25:19.299 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-14T12:25:19.299 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154.ko 2023-07-14T12:25:19.299 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-14T12:25:19.299 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4 2023-07-14T12:25:19.299 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ah4.ko 2023-07-14T12:25:19.299 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/esp4.ko 2023-07-14T12:25:19.300 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/fou.ko 2023-07-14T12:25:19.300 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/gre.ko 2023-07-14T12:25:19.300 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/inet_diag.ko 2023-07-14T12:25:19.300 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_gre.ko 2023-07-14T12:25:19.300 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_tunnel.ko 2023-07-14T12:25:19.300 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ip_vti.ko 2023-07-14T12:25:19.300 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipcomp.ko 2023-07-14T12:25:19.300 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/ipip.ko 2023-07-14T12:25:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter 2023-07-14T12:25:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-14T12:25:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-14T12:25:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-14T12:25:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-14T12:25:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-14T12:25:19.301 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-14T12:25:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-14T12:25:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-14T12:25:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-14T12:25:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-14T12:25:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-14T12:25:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-14T12:25:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-14T12:25:19.302 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-14T12:25:19.303 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-14T12:25:19.303 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-14T12:25:19.303 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-14T12:25:19.303 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-14T12:25:19.303 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-14T12:25:19.303 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-14T12:25:19.303 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-14T12:25:19.303 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_bic.ko 2023-07-14T12:25:19.304 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_dctcp.ko 2023-07-14T12:25:19.304 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_diag.ko 2023-07-14T12:25:19.304 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_highspeed.ko 2023-07-14T12:25:19.304 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_htcp.ko 2023-07-14T12:25:19.304 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_hybla.ko 2023-07-14T12:25:19.304 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_illinois.ko 2023-07-14T12:25:19.304 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_lp.ko 2023-07-14T12:25:19.305 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_scalable.ko 2023-07-14T12:25:19.305 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_vegas.ko 2023-07-14T12:25:19.305 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_veno.ko 2023-07-14T12:25:19.305 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_westwood.ko 2023-07-14T12:25:19.305 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tcp_yeah.ko 2023-07-14T12:25:19.305 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/tunnel4.ko 2023-07-14T12:25:19.305 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_diag.ko 2023-07-14T12:25:19.305 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/udp_tunnel.ko 2023-07-14T12:25:19.306 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-14T12:25:19.306 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6 2023-07-14T12:25:19.306 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ah6.ko 2023-07-14T12:25:19.306 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/esp6.ko 2023-07-14T12:25:19.306 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/fou6.ko 2023-07-14T12:25:19.306 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_tunnel.ko 2023-07-14T12:25:19.306 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-14T12:25:19.306 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ip6_vti.ko 2023-07-14T12:25:19.307 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/ipcomp6.ko 2023-07-14T12:25:19.307 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter 2023-07-14T12:25:19.307 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-14T12:25:19.307 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-14T12:25:19.307 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-14T12:25:19.307 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-14T12:25:19.307 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-14T12:25:19.308 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-14T12:25:19.308 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-14T12:25:19.308 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-14T12:25:19.308 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-14T12:25:19.308 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-14T12:25:19.308 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-14T12:25:19.308 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-14T12:25:19.308 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-14T12:25:19.309 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-14T12:25:19.309 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-14T12:25:19.309 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-14T12:25:19.309 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-14T12:25:19.309 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-14T12:25:19.309 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-14T12:25:19.309 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-14T12:25:19.309 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-14T12:25:19.310 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-14T12:25:19.310 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-14T12:25:19.310 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-14T12:25:19.310 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/sit.ko 2023-07-14T12:25:19.310 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/tunnel6.ko 2023-07-14T12:25:19.310 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-14T12:25:19.310 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key 2023-07-14T12:25:19.311 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/key/af_key.ko 2023-07-14T12:25:19.311 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp 2023-07-14T12:25:19.311 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_core.ko 2023-07-14T12:25:19.311 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-14T12:25:19.311 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_eth.ko 2023-07-14T12:25:19.311 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip.ko 2023-07-14T12:25:19.311 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ip6.ko 2023-07-14T12:25:19.311 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_netlink.ko 2023-07-14T12:25:19.312 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/l2tp/l2tp_ppp.ko 2023-07-14T12:25:19.312 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc 2023-07-14T12:25:19.312 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/llc/llc.ko 2023-07-14T12:25:19.312 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154 2023-07-14T12:25:19.312 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mac802154/mac802154.ko 2023-07-14T12:25:19.312 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls 2023-07-14T12:25:19.312 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/mpls/mpls_gso.ko 2023-07-14T12:25:19.313 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter 2023-07-14T12:25:19.313 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset 2023-07-14T12:25:19.313 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set.ko 2023-07-14T12:25:19.313 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-14T12:25:19.313 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-14T12:25:19.313 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-14T12:25:19.313 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-14T12:25:19.313 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-14T12:25:19.314 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-14T12:25:19.314 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-14T12:25:19.314 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-14T12:25:19.314 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-14T12:25:19.314 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-14T12:25:19.314 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-14T12:25:19.314 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-14T12:25:19.315 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-14T12:25:19.315 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-14T12:25:19.315 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-14T12:25:19.315 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs 2023-07-14T12:25:19.315 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-14T12:25:19.315 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-14T12:25:19.315 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-14T12:25:19.315 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-14T12:25:19.316 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-14T12:25:19.316 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-14T12:25:19.316 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-14T12:25:19.316 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-14T12:25:19.316 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-14T12:25:19.316 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-14T12:25:19.316 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-14T12:25:19.317 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-14T12:25:19.317 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-14T12:25:19.317 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-14T12:25:19.317 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conncount.ko 2023-07-14T12:25:19.317 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack.ko 2023-07-14T12:25:19.317 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-14T12:25:19.317 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-14T12:25:19.317 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-14T12:25:19.318 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-14T12:25:19.318 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-14T12:25:19.318 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-14T12:25:19.318 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-14T12:25:19.318 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-14T12:25:19.318 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-14T12:25:19.318 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-14T12:25:19.318 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-14T12:25:19.319 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-14T12:25:19.319 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-14T12:25:19.319 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table.ko 2023-07-14T12:25:19.319 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-14T12:25:19.319 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_log_syslog.ko 2023-07-14T12:25:19.319 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat.ko 2023-07-14T12:25:19.319 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-14T12:25:19.320 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-14T12:25:19.320 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_irc.ko 2023-07-14T12:25:19.320 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_sip.ko 2023-07-14T12:25:19.320 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-14T12:25:19.320 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-14T12:25:19.320 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nf_tables.ko 2023-07-14T12:25:19.320 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink.ko 2023-07-14T12:25:19.320 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-14T12:25:19.321 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_log.ko 2023-07-14T12:25:19.321 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-14T12:25:19.321 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-14T12:25:19.321 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_chain_nat.ko 2023-07-14T12:25:19.321 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_compat.ko 2023-07-14T12:25:19.321 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_ct.ko 2023-07-14T12:25:19.321 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-14T12:25:19.321 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fib.ko 2023-07-14T12:25:19.322 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-14T12:25:19.322 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_hash.ko 2023-07-14T12:25:19.322 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_limit.ko 2023-07-14T12:25:19.322 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_log.ko 2023-07-14T12:25:19.322 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_masq.ko 2023-07-14T12:25:19.322 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_nat.ko 2023-07-14T12:25:19.322 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_numgen.ko 2023-07-14T12:25:19.323 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_queue.ko 2023-07-14T12:25:19.323 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_quota.ko 2023-07-14T12:25:19.323 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_redir.ko 2023-07-14T12:25:19.323 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject.ko 2023-07-14T12:25:19.323 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_reject_inet.ko 2023-07-14T12:25:19.323 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_socket.ko 2023-07-14T12:25:19.323 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/nft_tunnel.ko 2023-07-14T12:25:19.323 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_AUDIT.ko 2023-07-14T12:25:19.324 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-14T12:25:19.324 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-14T12:25:19.324 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-14T12:25:19.324 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_CT.ko 2023-07-14T12:25:19.324 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_DSCP.ko 2023-07-14T12:25:19.324 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HL.ko 2023-07-14T12:25:19.324 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_HMARK.ko 2023-07-14T12:25:19.325 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-14T12:25:19.325 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LED.ko 2023-07-14T12:25:19.325 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_LOG.ko 2023-07-14T12:25:19.325 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-14T12:25:19.325 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NETMAP.ko 2023-07-14T12:25:19.325 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFLOG.ko 2023-07-14T12:25:19.325 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-14T12:25:19.325 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_RATEEST.ko 2023-07-14T12:25:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-14T12:25:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_SECMARK.ko 2023-07-14T12:25:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-14T12:25:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-14T12:25:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TEE.ko 2023-07-14T12:25:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TPROXY.ko 2023-07-14T12:25:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_TRACE.ko 2023-07-14T12:25:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_addrtype.ko 2023-07-14T12:25:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_bpf.ko 2023-07-14T12:25:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cgroup.ko 2023-07-14T12:25:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cluster.ko 2023-07-14T12:25:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_comment.ko 2023-07-14T12:25:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connbytes.ko 2023-07-14T12:25:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlabel.ko 2023-07-14T12:25:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connlimit.ko 2023-07-14T12:25:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_connmark.ko 2023-07-14T12:25:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_conntrack.ko 2023-07-14T12:25:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_cpu.ko 2023-07-14T12:25:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dccp.ko 2023-07-14T12:25:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_devgroup.ko 2023-07-14T12:25:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_dscp.ko 2023-07-14T12:25:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ecn.ko 2023-07-14T12:25:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_esp.ko 2023-07-14T12:25:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hashlimit.ko 2023-07-14T12:25:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_helper.ko 2023-07-14T12:25:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_hl.ko 2023-07-14T12:25:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipcomp.ko 2023-07-14T12:25:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_iprange.ko 2023-07-14T12:25:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_ipvs.ko 2023-07-14T12:25:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_l2tp.ko 2023-07-14T12:25:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_length.ko 2023-07-14T12:25:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_limit.ko 2023-07-14T12:25:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mac.ko 2023-07-14T12:25:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_mark.ko 2023-07-14T12:25:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_multiport.ko 2023-07-14T12:25:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nat.ko 2023-07-14T12:25:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_nfacct.ko 2023-07-14T12:25:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_osf.ko 2023-07-14T12:25:19.331 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_owner.ko 2023-07-14T12:25:19.331 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_physdev.ko 2023-07-14T12:25:19.331 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_pkttype.ko 2023-07-14T12:25:19.331 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_policy.ko 2023-07-14T12:25:19.331 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_quota.ko 2023-07-14T12:25:19.331 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_rateest.ko 2023-07-14T12:25:19.331 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_realm.ko 2023-07-14T12:25:19.331 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_recent.ko 2023-07-14T12:25:19.332 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_sctp.ko 2023-07-14T12:25:19.332 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_set.ko 2023-07-14T12:25:19.332 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_socket.ko 2023-07-14T12:25:19.332 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_state.ko 2023-07-14T12:25:19.332 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_statistic.ko 2023-07-14T12:25:19.332 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_string.ko 2023-07-14T12:25:19.332 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_tcpmss.ko 2023-07-14T12:25:19.333 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_time.ko 2023-07-14T12:25:19.333 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netfilter/xt_u32.ko 2023-07-14T12:25:19.333 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink 2023-07-14T12:25:19.333 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/netlink/netlink_diag.ko 2023-07-14T12:25:19.333 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh 2023-07-14T12:25:19.333 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/nsh/nsh.ko 2023-07-14T12:25:19.333 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch 2023-07-14T12:25:19.333 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/openvswitch.ko 2023-07-14T12:25:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-geneve.ko 2023-07-14T12:25:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-gre.ko 2023-07-14T12:25:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/openvswitch/vport-vxlan.ko 2023-07-14T12:25:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet 2023-07-14T12:25:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/packet/af_packet_diag.ko 2023-07-14T12:25:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds 2023-07-14T12:25:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds.ko 2023-07-14T12:25:19.335 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_rdma.ko 2023-07-14T12:25:19.335 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/rds/rds_tcp.ko 2023-07-14T12:25:19.335 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched 2023-07-14T12:25:19.335 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_csum.ko 2023-07-14T12:25:19.335 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_gact.ko 2023-07-14T12:25:19.335 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_ipt.ko 2023-07-14T12:25:19.335 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_mirred.ko 2023-07-14T12:25:19.335 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_nat.ko 2023-07-14T12:25:19.336 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_pedit.ko 2023-07-14T12:25:19.336 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_police.ko 2023-07-14T12:25:19.336 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_simple.ko 2023-07-14T12:25:19.336 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_skbedit.ko 2023-07-14T12:25:19.336 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/act_vlan.ko 2023-07-14T12:25:19.336 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_basic.ko 2023-07-14T12:25:19.336 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_bpf.ko 2023-07-14T12:25:19.337 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_flow.ko 2023-07-14T12:25:19.337 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_fw.ko 2023-07-14T12:25:19.337 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_route.ko 2023-07-14T12:25:19.337 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/cls_u32.ko 2023-07-14T12:25:19.337 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_cmp.ko 2023-07-14T12:25:19.337 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_ipset.ko 2023-07-14T12:25:19.337 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_meta.ko 2023-07-14T12:25:19.337 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_nbyte.ko 2023-07-14T12:25:19.338 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_text.ko 2023-07-14T12:25:19.338 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/em_u32.ko 2023-07-14T12:25:19.338 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_choke.ko 2023-07-14T12:25:19.338 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_codel.ko 2023-07-14T12:25:19.338 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_drr.ko 2023-07-14T12:25:19.338 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_fq.ko 2023-07-14T12:25:19.338 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_gred.ko 2023-07-14T12:25:19.338 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hfsc.ko 2023-07-14T12:25:19.339 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_hhf.ko 2023-07-14T12:25:19.339 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_htb.ko 2023-07-14T12:25:19.339 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_ingress.ko 2023-07-14T12:25:19.339 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio.ko 2023-07-14T12:25:19.339 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_mqprio_lib.ko 2023-07-14T12:25:19.339 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_multiq.ko 2023-07-14T12:25:19.339 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_netem.ko 2023-07-14T12:25:19.340 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_pie.ko 2023-07-14T12:25:19.340 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_plug.ko 2023-07-14T12:25:19.340 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_prio.ko 2023-07-14T12:25:19.340 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_qfq.ko 2023-07-14T12:25:19.340 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_red.ko 2023-07-14T12:25:19.340 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfb.ko 2023-07-14T12:25:19.340 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_sfq.ko 2023-07-14T12:25:19.340 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_tbf.ko 2023-07-14T12:25:19.341 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sched/sch_teql.ko 2023-07-14T12:25:19.341 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp 2023-07-14T12:25:19.341 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp.ko 2023-07-14T12:25:19.341 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sctp/sctp_diag.ko 2023-07-14T12:25:19.341 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc 2023-07-14T12:25:19.341 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss 2023-07-14T12:25:19.341 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-14T12:25:19.341 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-14T12:25:19.342 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/sunrpc.ko 2023-07-14T12:25:19.342 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma 2023-07-14T12:25:19.342 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-14T12:25:19.342 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc 2023-07-14T12:25:19.342 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/diag.ko 2023-07-14T12:25:19.342 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/tipc/tipc.ko 2023-07-14T12:25:19.342 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix 2023-07-14T12:25:19.343 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/unix/unix_diag.ko 2023-07-14T12:25:19.343 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock 2023-07-14T12:25:19.343 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-14T12:25:19.343 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-14T12:25:19.343 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock.ko 2023-07-14T12:25:19.343 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-14T12:25:19.343 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-14T12:25:19.344 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm 2023-07-14T12:25:19.344 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-14T12:25:19.344 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security 2023-07-14T12:25:19.344 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys 2023-07-14T12:25:19.344 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys 2023-07-14T12:25:19.344 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-14T12:25:19.344 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys 2023-07-14T12:25:19.345 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/security/keys/trusted-keys/trusted.ko 2023-07-14T12:25:19.345 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt 2023-07-14T12:25:19.345 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib 2023-07-14T12:25:19.345 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/kernel/virt/lib/irqbypass.ko 2023-07-14T12:25:19.345 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias 2023-07-14T12:25:19.345 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.alias.bin 2023-07-14T12:25:19.345 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin 2023-07-14T12:25:19.345 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.bin 2023-07-14T12:25:19.346 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.builtin.modinfo 2023-07-14T12:25:19.346 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep 2023-07-14T12:25:19.346 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.dep.bin 2023-07-14T12:25:19.346 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.devname 2023-07-14T12:25:19.346 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.order 2023-07-14T12:25:19.346 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.softdep 2023-07-14T12:25:19.346 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols 2023-07-14T12:25:19.346 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.5.0-rc1-ga440c79eee02/modules.symbols.bin 2023-07-14T12:25:19.347 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:19.347 DEBUG:teuthology.orchestra.run.smithi017:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-14T12:25:19.376 INFO:teuthology.orchestra.run.smithi017.stdout:postinstall scriptlet (using /bin/sh): 2023-07-14T12:25:19.376 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 -a -r /boot/System.map-6.5.0-rc1-ga440c79eee02 ]; then 2023-07-14T12:25:19.376 INFO:teuthology.orchestra.run.smithi017.stdout:cp /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:19.376 INFO:teuthology.orchestra.run.smithi017.stdout:cp /boot/System.map-6.5.0-rc1-ga440c79eee02 /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:19.377 INFO:teuthology.orchestra.run.smithi017.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-ga440c79eee02 /boot/System.map-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:19.377 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/installkernel 6.5.0-rc1-ga440c79eee02 /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:19.377 INFO:teuthology.orchestra.run.smithi017.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-ga440c79eee02-rpm /boot/.System.map-6.5.0-rc1-ga440c79eee02-rpm 2023-07-14T12:25:19.377 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2023-07-14T12:25:19.377 INFO:teuthology.orchestra.run.smithi017.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-14T12:25:19.377 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-14T12:25:19.377 INFO:teuthology.orchestra.run.smithi017.stdout:new-kernel-pkg --remove 6.5.0-rc1-ga440c79eee02 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-ga440c79eee02.img 2023-07-14T12:25:19.378 INFO:teuthology.orchestra.run.smithi017.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-14T12:25:19.378 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-install remove 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:19.378 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2023-07-14T12:25:19.378 INFO:teuthology.orchestra.run.smithi017.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-14T12:25:19.378 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-14T12:25:19.378 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:19.378 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2023-07-14T12:25:19.379 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2023-07-14T12:25:19.459 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2023-07-14T12:25:19.459 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2023-07-14T12:25:19.459 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.02 2023-07-14T12:25:19.460 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 123.el8 2023-07-14T12:25:19.460 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2023-07-14T12:25:19.460 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-07-14T12:25:19.460 INFO:teuthology.orchestra.run.smithi017.stdout:Group : System Environment/Base 2023-07-14T12:25:19.460 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 9265450 2023-07-14T12:25:19.460 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2023-07-14T12:25:19.460 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-07-14T12:25:19.461 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-07-14T12:25:19.461 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-07-14T12:25:19.461 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-07-14T12:25:19.461 INFO:teuthology.orchestra.run.smithi017.stdout:Relocations : (not relocatable) 2023-07-14T12:25:19.461 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : Red Hat, Inc. 2023-07-14T12:25:19.461 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : Red Hat, Inc. 2023-07-14T12:25:19.461 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-14T12:25:19.461 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2023-07-14T12:25:19.462 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2023-07-14T12:25:19.462 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:25:19.462 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-14T12:25:19.462 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-14T12:25:19.462 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-14T12:25:19.462 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2023-07-14T12:25:19.462 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:25:19.463 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2023-07-14T12:25:19.463 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-14T12:25:19.463 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:19.464 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-14T12:25:20.095 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2023-07-14T12:25:21.641 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2023-07-14T12:25:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:done 2023-07-14T12:25:22.141 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2023-07-14T12:25:22.165 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.XyBC9tco9T 2023-07-14T12:25:22.165 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XyBC9tco9T 2023-07-14T12:25:22.238 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.XyBC9tco9T 2023-07-14T12:25:22.392 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.XyBC9tco9T is 6KB 2023-07-14T12:25:22.412 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.XyBC9tco9T 2023-07-14T12:25:22.428 DEBUG:teuthology.orchestra.run.smithi131:> sudo /bin/ls /boot/loader/entries || true 2023-07-14T12:25:22.502 INFO:teuthology.orchestra.run.smithi131.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-07-14T12:25:22.503 INFO:teuthology.orchestra.run.smithi131.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-07-14T12:25:22.503 INFO:teuthology.orchestra.run.smithi131.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-ga440c79eee02.conf 2023-07-14T12:25:22.504 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:22.635 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2023-07-14T12:25:23.638 INFO:teuthology.orchestra.run.smithi017.stderr:done 2023-07-14T12:25:23.640 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2023-07-14T12:25:23.664 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.xMwXdo3fAD 2023-07-14T12:25:23.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xMwXdo3fAD 2023-07-14T12:25:23.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.xMwXdo3fAD 2023-07-14T12:25:23.861 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.xMwXdo3fAD is 6KB 2023-07-14T12:25:23.882 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.xMwXdo3fAD 2023-07-14T12:25:23.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2023-07-14T12:25:23.974 INFO:teuthology.orchestra.run.smithi017.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-07-14T12:25:23.975 INFO:teuthology.orchestra.run.smithi017.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-07-14T12:25:23.975 INFO:teuthology.orchestra.run.smithi017.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-ga440c79eee02.conf 2023-07-14T12:25:23.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-ga440c79eee02 2023-07-14T12:25:24.134 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2023-07-14T12:25:42.909 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2023-07-14T12:25:42.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-07-14T12:25:42.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:25:52.646 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-07-14T12:25:52.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-14T12:25:52.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:25:54.138 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-07-14T12:25:54.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-07-14T12:25:54.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:26:01.460 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-07-14T12:26:10.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-07-14T12:26:10.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:26:11.184 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-07-14T12:26:12.464 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-07-14T12:26:13.524 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-07-14T12:26:20.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-14T12:26:20.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:26:21.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-07-14T12:26:21.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:26:25.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-07-14T12:26:25.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:26:57.601 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-07-14T12:26:58.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-07-14T12:26:58.109 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.5.0-rc1-ga440c79eee02"... 2023-07-14T12:26:58.109 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2023-07-14T12:26:58.153 INFO:teuthology.orchestra.run.smithi135.stdout:6.5.0-rc1-ga440c79eee02 2023-07-14T12:26:58.154 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-ga440c79eee02 vs 6.5.0-rc1-ga440c79eee02 2023-07-14T12:26:58.154 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-14T12:26:58.154 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-07-14T12:26:59.155 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-07-14T12:26:59.155 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-14T12:26:59.282 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2023-07-14T12:26:59.310 DEBUG:teuthology.parallel:result is None 2023-07-14T12:27:20.194 DEBUG:teuthology.orchestra.remote:timed out 2023-07-14T12:27:21.469 DEBUG:teuthology.orchestra.remote:timed out 2023-07-14T12:27:32.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-14T12:27:32.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:27:32.582 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-07-14T12:27:32.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-14T12:27:32.998 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc1-ga440c79eee02"... 2023-07-14T12:27:32.999 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2023-07-14T12:27:33.041 INFO:teuthology.orchestra.run.smithi131.stdout:6.5.0-rc1-ga440c79eee02 2023-07-14T12:27:33.041 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-ga440c79eee02 vs 6.5.0-rc1-ga440c79eee02 2023-07-14T12:27:33.041 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-14T12:27:33.042 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-07-14T12:27:33.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-07-14T12:27:33.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:27:33.823 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-07-14T12:27:34.043 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-07-14T12:27:34.043 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-14T12:27:34.181 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2023-07-14T12:27:34.203 DEBUG:teuthology.parallel:result is None 2023-07-14T12:27:34.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-07-14T12:27:34.267 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc1-ga440c79eee02"... 2023-07-14T12:27:34.267 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2023-07-14T12:27:34.310 INFO:teuthology.orchestra.run.smithi017.stdout:6.5.0-rc1-ga440c79eee02 2023-07-14T12:27:34.311 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-ga440c79eee02 vs 6.5.0-rc1-ga440c79eee02 2023-07-14T12:27:34.311 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-14T12:27:34.311 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-07-14T12:27:35.312 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-14T12:27:35.312 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-14T12:27:35.440 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2023-07-14T12:27:35.466 DEBUG:teuthology.parallel:result is None 2023-07-14T12:27:35.467 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-14T12:27:35.474 INFO:teuthology.task.internal:Creating test directory... 2023-07-14T12:27:35.475 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T12:27:35.479 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T12:27:35.484 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T12:27:35.534 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-14T12:27:35.540 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-14T12:27:35.552 INFO:teuthology.task.internal:Creating archive directory... 2023-07-14T12:27:35.552 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T12:27:35.563 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T12:27:35.568 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T12:27:35.627 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-14T12:27:35.634 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-14T12:27:35.635 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T12:27:35.639 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T12:27:35.643 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T12:27:35.708 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T12:27:35.715 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T12:27:35.727 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T12:27:35.736 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T12:27:35.742 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T12:27:35.756 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T12:27:35.759 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-14T12:27:35.769 INFO:teuthology.task.internal:Configuring sudo... 2023-07-14T12:27:35.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T12:27:35.774 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T12:27:35.779 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T12:27:35.847 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-14T12:27:35.864 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-14T12:27:35.864 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T12:27:35.869 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T12:27:35.874 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T12:27:35.917 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T12:27:36.023 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T12:27:36.102 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T12:27:36.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T12:27:36.257 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:27:36.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T12:27:36.331 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T12:27:36.404 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T12:27:36.484 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T12:27:36.558 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T12:27:36.636 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-14T12:27:36.636 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T12:27:36.704 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T12:27:36.783 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T12:27:36.863 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T12:27:36.936 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T12:27:37.003 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-07-14T12:27:37.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T12:27:37.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2023-07-14T12:27:37.076 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2023-07-14T12:27:37.080 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2023-07-14T12:27:37.188 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T12:27:37.189 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T12:27:37.230 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T12:27:37.614 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-14T12:27:37.625 INFO:teuthology.task.internal:Starting timer... 2023-07-14T12:27:37.626 INFO:teuthology.run_tasks:Running task pcp... 2023-07-14T12:27:37.637 INFO:teuthology.run_tasks:Running task selinux... 2023-07-14T12:27:37.646 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-14T12:27:37.646 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2023-07-14T12:27:37.761 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2023-07-14T12:27:37.765 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2023-07-14T12:27:37.888 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2023-07-14T12:27:37.891 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2023-07-14T12:27:38.017 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2023-07-14T12:27:38.020 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-14T12:27:38.020 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2023-07-14T12:27:38.074 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2023-07-14T12:27:38.075 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2023-07-14T12:27:38.126 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2023-07-14T12:27:38.126 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2023-07-14T12:27:38.175 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2023-07-14T12:27:38.175 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi131.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2023-07-14T12:27:38.175 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T12:27:38.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:27:38.249 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T12:27:38.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:27:38.321 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T12:27:38.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:27:38.392 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-14T12:27:38.392 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2023-07-14T12:27:38.462 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2023-07-14T12:27:38.547 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2023-07-14T12:27:38.615 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-14T12:27:38.626 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-14T12:27:38.632 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-14T12:27:38.761 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-14T12:27:38.785 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-14T12:27:38.787 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi131.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-14T12:40:20.417 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2023-07-14T12:40:20.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-07-14T12:40:20.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:40:20.534 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-07-14T12:40:20.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-07-14T12:40:20.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-14T12:40:20.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:40:20.740 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-07-14T12:40:20.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-14T12:40:20.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-07-14T12:40:20.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T12:40:20.940 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-07-14T12:40:21.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-07-14T12:40:21.053 INFO:teuthology.run_tasks:Running task clock... 2023-07-14T12:40:21.062 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-14T12:40:21.063 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T12:40:21.063 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T12:40:21.068 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T12:40:21.069 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T12:40:21.073 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T12:40:21.074 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T12:40:21.143 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-14T12:40:21.144 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-14T12:40:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-14T12:40:21.177 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-14T12:40:21.182 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-14T12:40:21.203 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-14T12:40:21.274 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2023-07-14T12:40:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2023-07-14T12:40:21.297 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2023-07-14T12:40:21.304 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2023-07-14T12:40:21.307 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2023-07-14T12:40:21.326 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2023-07-14T12:40:21.340 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-14T12:40:21.341 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-14T12:40:21.360 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-14T12:40:21.375 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-14T12:40:21.376 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-14T12:40:21.393 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-14T12:40:21.463 INFO:teuthology.orchestra.run.smithi131.stderr:bash: ntpq: command not found 2023-07-14T12:40:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:bash: ntpq: command not found 2023-07-14T12:40:21.470 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T12:40:21.470 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2023-07-14T12:40:21.470 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.470 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.471 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.471 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.474 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T12:40:21.474 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2023-07-14T12:40:21.474 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.474 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.474 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.474 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.483 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2023-07-14T12:40:21.490 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T12:40:21.491 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-07-14T12:40:21.491 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.491 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.491 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.491 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T12:40:21.492 INFO:teuthology.run_tasks:Running task pexec... 2023-07-14T12:40:21.508 INFO:teuthology.task.pexec:Executing custom commands... 2023-07-14T12:40:21.509 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi017.front.sepia.ceph.com 2023-07-14T12:40:21.509 DEBUG:teuthology.orchestra.run.smithi017:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-07-14T12:40:21.509 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi131.front.sepia.ceph.com 2023-07-14T12:40:21.510 DEBUG:teuthology.orchestra.run.smithi131:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-07-14T12:40:21.510 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi135.front.sepia.ceph.com 2023-07-14T12:40:21.510 DEBUG:teuthology.orchestra.run.smithi135:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-07-14T12:40:21.989 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:21.991 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:22.022 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:23.559 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:23 ago on Fri 14 Jul 2023 12:38:00 PM UTC. 2023-07-14T12:40:23.566 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:23 ago on Fri 14 Jul 2023 12:38:00 PM UTC. 2023-07-14T12:40:23.624 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:14 ago on Fri 14 Jul 2023 12:38:09 PM UTC. 2023-07-14T12:40:25.348 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-07-14T12:40:25.349 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-07-14T12:40:25.349 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2023-07-14T12:40:25.350 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-07-14T12:40:25.350 INFO:teuthology.orchestra.run.smithi131.stdout:Resetting modules: 2023-07-14T12:40:25.350 INFO:teuthology.orchestra.run.smithi131.stdout: container-tools 2023-07-14T12:40:25.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:40:25.350 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-07-14T12:40:25.350 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-07-14T12:40:25.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:40:25.407 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-07-14T12:40:25.408 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-07-14T12:40:25.408 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2023-07-14T12:40:25.409 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-07-14T12:40:25.409 INFO:teuthology.orchestra.run.smithi135.stdout:Resetting modules: 2023-07-14T12:40:25.409 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools 2023-07-14T12:40:25.409 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:40:25.410 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-07-14T12:40:25.410 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2023-07-14T12:40:25.410 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:40:25.751 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-07-14T12:40:25.752 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2023-07-14T12:40:25.752 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2023-07-14T12:40:25.752 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2023-07-14T12:40:25.753 INFO:teuthology.orchestra.run.smithi017.stdout:Resetting modules: 2023-07-14T12:40:25.753 INFO:teuthology.orchestra.run.smithi017.stdout: container-tools 2023-07-14T12:40:25.753 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:40:25.753 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2023-07-14T12:40:25.753 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2023-07-14T12:40:25.753 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:40:26.584 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:26 ago on Fri 14 Jul 2023 12:38:00 PM UTC. 2023-07-14T12:40:26.633 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:26 ago on Fri 14 Jul 2023 12:38:00 PM UTC. 2023-07-14T12:40:27.031 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:17 ago on Fri 14 Jul 2023 12:38:09 PM UTC. 2023-07-14T12:40:32.318 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-07-14T12:40:32.907 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:32.921 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-07-14T12:40:33.512 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:34.253 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-07-14T12:40:34.520 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:33 ago on Fri 14 Jul 2023 12:38:00 PM UTC. 2023-07-14T12:40:34.871 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:35.262 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:34 ago on Fri 14 Jul 2023 12:38:00 PM UTC. 2023-07-14T12:40:36.106 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:26 ago on Fri 14 Jul 2023 12:38:09 PM UTC. 2023-07-14T12:40:36.274 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-07-14T12:40:36.372 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================================ 2023-07-14T12:40:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-07-14T12:40:36.373 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================================ 2023-07-14T12:40:36.373 INFO:teuthology.orchestra.run.smithi135.stdout:Installing group/module packages: 2023-07-14T12:40:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-07-14T12:40:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-07-14T12:40:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-07-14T12:40:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-07-14T12:40:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-07-14T12:40:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-07-14T12:40:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-07-14T12:40:36.374 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-07-14T12:40:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-07-14T12:40:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-07-14T12:40:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-07-14T12:40:36.375 INFO:teuthology.orchestra.run.smithi135.stdout:Installing module profiles: 2023-07-14T12:40:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools/common 2023-07-14T12:40:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:40:36.375 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling module streams: 2023-07-14T12:40:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: container-tools rhel8 2023-07-14T12:40:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:40:36.375 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-07-14T12:40:36.376 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================================================ 2023-07-14T12:40:36.376 INFO:teuthology.orchestra.run.smithi135.stdout:Install 10 Packages 2023-07-14T12:40:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:40:36.376 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 18 M 2023-07-14T12:40:36.377 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 65 M 2023-07-14T12:40:36.377 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-07-14T12:40:36.508 INFO:teuthology.orchestra.run.smithi135.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 192 kB/s | 25 kB 00:00 2023-07-14T12:40:36.572 INFO:teuthology.orchestra.run.smithi135.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 208 kB/s | 41 kB 00:00 2023-07-14T12:40:36.631 INFO:teuthology.orchestra.run.smithi135.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 368 kB/s | 94 kB 00:00 2023-07-14T12:40:36.707 INFO:teuthology.orchestra.run.smithi135.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 245 kB/s | 49 kB 00:00 2023-07-14T12:40:36.841 INFO:teuthology.orchestra.run.smithi135.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 1.9 MB/s | 524 kB 00:00 2023-07-14T12:40:36.874 INFO:teuthology.orchestra.run.smithi135.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 895 kB/s | 149 kB 00:00 2023-07-14T12:40:37.008 INFO:teuthology.orchestra.run.smithi135.stdout:(7/10): buildah-1.26.2-1.module+el8.6.0+16771+2 21 MB/s | 8.0 MB 00:00 2023-07-14T12:40:37.025 INFO:teuthology.orchestra.run.smithi135.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.1 MB/s | 213 kB 00:00 2023-07-14T12:40:37.049 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-07-14T12:40:37.147 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================================ 2023-07-14T12:40:37.148 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2023-07-14T12:40:37.148 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================================ 2023-07-14T12:40:37.148 INFO:teuthology.orchestra.run.smithi131.stdout:Installing group/module packages: 2023-07-14T12:40:37.149 INFO:teuthology.orchestra.run.smithi131.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-07-14T12:40:37.149 INFO:teuthology.orchestra.run.smithi131.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-07-14T12:40:37.149 INFO:teuthology.orchestra.run.smithi131.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-07-14T12:40:37.149 INFO:teuthology.orchestra.run.smithi131.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-07-14T12:40:37.150 INFO:teuthology.orchestra.run.smithi131.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-07-14T12:40:37.150 INFO:teuthology.orchestra.run.smithi131.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-07-14T12:40:37.150 INFO:teuthology.orchestra.run.smithi131.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-07-14T12:40:37.150 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2023-07-14T12:40:37.151 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-07-14T12:40:37.151 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-07-14T12:40:37.151 INFO:teuthology.orchestra.run.smithi131.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-07-14T12:40:37.151 INFO:teuthology.orchestra.run.smithi131.stdout:Installing module profiles: 2023-07-14T12:40:37.151 INFO:teuthology.orchestra.run.smithi131.stdout: container-tools/common 2023-07-14T12:40:37.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:40:37.152 INFO:teuthology.orchestra.run.smithi131.stdout:Enabling module streams: 2023-07-14T12:40:37.152 INFO:teuthology.orchestra.run.smithi131.stdout: container-tools rhel8 2023-07-14T12:40:37.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:40:37.153 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-07-14T12:40:37.153 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================================ 2023-07-14T12:40:37.153 INFO:teuthology.orchestra.run.smithi131.stdout:Install 10 Packages 2023-07-14T12:40:37.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:40:37.154 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 18 M 2023-07-14T12:40:37.155 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 65 M 2023-07-14T12:40:37.155 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-07-14T12:40:37.217 INFO:teuthology.orchestra.run.smithi135.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 20 MB/s | 7.0 MB 00:00 2023-07-14T12:40:37.267 INFO:teuthology.orchestra.run.smithi135.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 8.5 MB/s | 2.2 MB 00:00 2023-07-14T12:40:37.268 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-07-14T12:40:37.268 INFO:teuthology.orchestra.run.smithi135.stdout:Total 20 MB/s | 18 MB 00:00 2023-07-14T12:40:37.346 INFO:teuthology.orchestra.run.smithi131.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 208 kB/s | 41 kB 00:00 2023-07-14T12:40:37.430 INFO:teuthology.orchestra.run.smithi131.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 89 kB/s | 25 kB 00:00 2023-07-14T12:40:37.455 INFO:teuthology.orchestra.run.smithi131.stdout:(3/10): udica-0.2.6-4.module+el8.6.0+16771+28df 454 kB/s | 49 kB 00:00 2023-07-14T12:40:37.481 INFO:teuthology.orchestra.run.smithi131.stdout:(4/10): python3-pyxdg-0.25-16.el8.noarch.rpm 284 kB/s | 94 kB 00:00 2023-07-14T12:40:37.599 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-07-14T12:40:37.622 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-07-14T12:40:37.622 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-07-14T12:40:37.673 INFO:teuthology.orchestra.run.smithi131.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.1 MB/s | 524 kB 00:00 2023-07-14T12:40:37.698 INFO:teuthology.orchestra.run.smithi131.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 689 kB/s | 149 kB 00:00 2023-07-14T12:40:37.832 INFO:teuthology.orchestra.run.smithi131.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.3 MB/s | 213 kB 00:00 2023-07-14T12:40:37.982 INFO:teuthology.orchestra.run.smithi131.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 15 MB/s | 8.0 MB 00:00 2023-07-14T12:40:38.082 INFO:teuthology.orchestra.run.smithi131.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 8.8 MB/s | 2.2 MB 00:00 2023-07-14T12:40:38.117 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-07-14T12:40:38.176 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-07-14T12:40:38.181 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-07-14T12:40:38.223 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================================ 2023-07-14T12:40:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2023-07-14T12:40:38.224 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================================ 2023-07-14T12:40:38.224 INFO:teuthology.orchestra.run.smithi017.stdout:Installing group/module packages: 2023-07-14T12:40:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-07-14T12:40:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-07-14T12:40:38.224 INFO:teuthology.orchestra.run.smithi017.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-07-14T12:40:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-07-14T12:40:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-07-14T12:40:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-07-14T12:40:38.225 INFO:teuthology.orchestra.run.smithi017.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-07-14T12:40:38.225 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2023-07-14T12:40:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-07-14T12:40:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-07-14T12:40:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-07-14T12:40:38.226 INFO:teuthology.orchestra.run.smithi017.stdout:Installing module profiles: 2023-07-14T12:40:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: container-tools/common 2023-07-14T12:40:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:40:38.226 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling module streams: 2023-07-14T12:40:38.226 INFO:teuthology.orchestra.run.smithi017.stdout: container-tools rhel8 2023-07-14T12:40:38.227 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:40:38.227 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2023-07-14T12:40:38.227 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================================================ 2023-07-14T12:40:38.227 INFO:teuthology.orchestra.run.smithi017.stdout:Install 10 Packages 2023-07-14T12:40:38.228 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:40:38.229 INFO:teuthology.orchestra.run.smithi131.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 13 MB/s | 7.0 MB 00:00 2023-07-14T12:40:38.229 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-07-14T12:40:38.229 INFO:teuthology.orchestra.run.smithi131.stdout:Total 17 MB/s | 18 MB 00:01 2023-07-14T12:40:38.229 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 18 M 2023-07-14T12:40:38.229 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 65 M 2023-07-14T12:40:38.229 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2023-07-14T12:40:38.375 INFO:teuthology.orchestra.run.smithi017.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 168 kB/s | 25 kB 00:00 2023-07-14T12:40:38.400 INFO:teuthology.orchestra.run.smithi017.stdout:(2/10): python3-pyxdg-0.25-16.el8.noarch.rpm 542 kB/s | 94 kB 00:00 2023-07-14T12:40:38.426 INFO:teuthology.orchestra.run.smithi017.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 205 kB/s | 41 kB 00:00 2023-07-14T12:40:38.534 INFO:teuthology.orchestra.run.smithi017.stdout:(4/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.8 MB/s | 524 kB 00:00 2023-07-14T12:40:38.558 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-07-14T12:40:38.559 INFO:teuthology.orchestra.run.smithi017.stdout:(5/10): udica-0.2.6-4.module+el8.6.0+16771+28df 268 kB/s | 49 kB 00:00 2023-07-14T12:40:38.580 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-07-14T12:40:38.581 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-07-14T12:40:38.685 INFO:teuthology.orchestra.run.smithi017.stdout:(6/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.7 MB/s | 213 kB 00:00 2023-07-14T12:40:38.730 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-07-14T12:40:38.835 INFO:teuthology.orchestra.run.smithi017.stdout:(7/10): buildah-1.26.2-1.module+el8.6.0+16771+2 19 MB/s | 8.0 MB 00:00 2023-07-14T12:40:38.860 INFO:teuthology.orchestra.run.smithi017.stdout:(8/10): python3-podman-4.0.1-1.module+el8.6.0+1 459 kB/s | 149 kB 00:00 2023-07-14T12:40:38.916 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-07-14T12:40:39.035 INFO:teuthology.orchestra.run.smithi017.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 20 MB/s | 7.0 MB 00:00 2023-07-14T12:40:39.085 INFO:teuthology.orchestra.run.smithi017.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 8.8 MB/s | 2.2 MB 00:00 2023-07-14T12:40:39.086 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2023-07-14T12:40:39.087 INFO:teuthology.orchestra.run.smithi017.stdout:Total 21 MB/s | 18 MB 00:00 2023-07-14T12:40:39.108 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-07-14T12:40:39.112 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-07-14T12:40:39.138 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T12:40:39.338 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-07-14T12:40:39.428 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2023-07-14T12:40:39.452 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2023-07-14T12:40:39.452 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2023-07-14T12:40:39.566 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-07-14T12:40:39.698 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-07-14T12:40:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-07-14T12:40:39.949 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-07-14T12:40:39.972 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2023-07-14T12:40:39.977 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2023-07-14T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T12:40:40.330 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-07-14T12:40:40.574 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-07-14T12:40:40.576 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2023-07-14T12:40:40.775 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-07-14T12:40:40.775 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-07-14T12:40:40.939 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-07-14T12:40:40.942 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T12:40:41.156 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-07-14T12:40:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-07-14T12:40:41.714 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-07-14T12:40:41.775 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-07-14T12:40:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-07-14T12:40:42.010 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-07-14T12:40:42.160 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-07-14T12:40:42.343 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T12:40:42.649 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-07-14T12:40:42.705 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-07-14T12:40:42.744 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T12:40:42.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-07-14T12:40:42.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T12:40:42.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-07-14T12:40:42.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-07-14T12:40:42.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-07-14T12:40:42.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-07-14T12:40:42.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-07-14T12:40:42.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-07-14T12:40:42.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-07-14T12:40:43.000 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-07-14T12:40:43.176 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-07-14T12:40:43.433 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T12:40:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-07-14T12:40:43.820 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T12:40:43.820 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-07-14T12:40:43.820 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T12:40:43.821 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-07-14T12:40:43.821 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-07-14T12:40:43.821 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-07-14T12:40:43.821 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-07-14T12:40:43.821 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-07-14T12:40:43.821 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-07-14T12:40:43.821 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-07-14T12:40:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-07-14T12:40:44.081 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-07-14T12:40:44.144 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-07-14T12:40:44.144 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:43 ago on Fri 14 Jul 2023 12:38:00 PM UTC. 2023-07-14T12:40:44.280 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T12:40:44.672 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T12:40:44.673 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-07-14T12:40:44.673 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T12:40:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-07-14T12:40:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-07-14T12:40:44.674 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-07-14T12:40:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-07-14T12:40:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-07-14T12:40:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-07-14T12:40:44.675 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-07-14T12:40:45.219 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-07-14T12:40:45.219 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:44 ago on Fri 14 Jul 2023 12:38:00 PM UTC. 2023-07-14T12:40:46.136 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-07-14T12:40:46.136 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:36 ago on Fri 14 Jul 2023 12:38:09 PM UTC. 2023-07-14T12:40:48.702 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2023-07-14T12:40:48.864 INFO:teuthology.orchestra.run.smithi131.stdout:Installed products updated. 2023-07-14T12:40:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:40:48.906 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-07-14T12:40:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:48.906 INFO:teuthology.orchestra.run.smithi135.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T12:40:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-07-14T12:40:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-07-14T12:40:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-07-14T12:40:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:48.907 INFO:teuthology.orchestra.run.smithi135.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T12:40:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: yajl-2.1.0-10.el8.x86_64 2023-07-14T12:40:48.908 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:40:48.908 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-07-14T12:40:49.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:40:49.097 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2023-07-14T12:40:49.097 INFO:teuthology.orchestra.run.smithi131.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:49.098 INFO:teuthology.orchestra.run.smithi131.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T12:40:49.098 INFO:teuthology.orchestra.run.smithi131.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:49.098 INFO:teuthology.orchestra.run.smithi131.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-07-14T12:40:49.098 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-07-14T12:40:49.099 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-07-14T12:40:49.099 INFO:teuthology.orchestra.run.smithi131.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:49.099 INFO:teuthology.orchestra.run.smithi131.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:49.100 INFO:teuthology.orchestra.run.smithi131.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T12:40:49.100 INFO:teuthology.orchestra.run.smithi131.stdout: yajl-2.1.0-10.el8.x86_64 2023-07-14T12:40:49.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:40:49.101 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-07-14T12:40:49.126 DEBUG:teuthology.parallel:result is None 2023-07-14T12:40:49.312 DEBUG:teuthology.parallel:result is None 2023-07-14T12:40:49.340 INFO:teuthology.orchestra.run.smithi017.stdout:Installed products updated. 2023-07-14T12:40:49.562 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:40:49.562 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2023-07-14T12:40:49.562 INFO:teuthology.orchestra.run.smithi017.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:49.562 INFO:teuthology.orchestra.run.smithi017.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T12:40:49.562 INFO:teuthology.orchestra.run.smithi017.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:49.562 INFO:teuthology.orchestra.run.smithi017.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-07-14T12:40:49.563 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-07-14T12:40:49.563 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-07-14T12:40:49.563 INFO:teuthology.orchestra.run.smithi017.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:49.563 INFO:teuthology.orchestra.run.smithi017.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T12:40:49.563 INFO:teuthology.orchestra.run.smithi017.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T12:40:49.563 INFO:teuthology.orchestra.run.smithi017.stdout: yajl-2.1.0-10.el8.x86_64 2023-07-14T12:40:49.563 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:40:49.564 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-07-14T12:40:49.776 DEBUG:teuthology.parallel:result is None 2023-07-14T12:40:49.776 INFO:teuthology.run_tasks:Running task install... 2023-07-14T12:40:49.786 DEBUG:teuthology.task.install:project ceph 2023-07-14T12:40:49.786 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'}} 2023-07-14T12:40:49.787 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b'} 2023-07-14T12:40:49.787 INFO:teuthology.task.install:Using flavor: default 2023-07-14T12:40:49.793 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-14T12:40:49.793 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-14T12:40:49.794 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'tag': None, 'wait_for_package': False} 2023-07-14T12:40:49.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:40:49.797 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'tag': None, 'wait_for_package': False} 2023-07-14T12:40:49.797 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:40:49.798 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'tag': None, 'wait_for_package': False} 2023-07-14T12:40:49.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:40:50.154 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/ 2023-07-14T12:40:50.155 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4757.g3fc0089c 2023-07-14T12:40:50.162 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/ 2023-07-14T12:40:50.163 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4757.g3fc0089c 2023-07-14T12:40:50.167 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/ 2023-07-14T12:40:50.168 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4757.g3fc0089c 2023-07-14T12:40:50.437 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-14T12:40:50.437 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:40:50.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-14T12:40:50.442 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-14T12:40:50.442 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-07-14T12:40:50.443 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-14T12:40:50.454 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-14T12:40:50.454 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-14T12:40:50.454 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-14T12:40:50.517 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-14T12:40:50.518 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3fc0089cc1082313a98853d48b892acdc1385b8b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-14T12:40:50.519 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-14T12:40:50.519 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3fc0089cc1082313a98853d48b892acdc1385b8b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-14T12:40:50.530 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-14T12:40:50.531 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3fc0089cc1082313a98853d48b892acdc1385b8b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-14T12:40:50.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-14T12:40:50.631 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-14T12:40:50.641 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-14T12:40:50.726 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-14T12:40:50.729 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-14T12:40:50.737 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-14T12:40:50.794 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2023-07-14T12:40:50.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2023-07-14T12:40:50.798 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2023-07-14T12:40:50.803 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2023-07-14T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2023-07-14T12:40:50.810 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2023-07-14T12:40:51.239 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:51.256 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:51.283 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:52.064 INFO:teuthology.orchestra.run.smithi135.stdout:44 files removed 2023-07-14T12:40:52.119 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-14T12:40:52.173 INFO:teuthology.orchestra.run.smithi131.stdout:44 files removed 2023-07-14T12:40:52.228 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-14T12:40:52.272 INFO:teuthology.orchestra.run.smithi017.stdout:44 files removed 2023-07-14T12:40:52.330 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-14T12:40:52.560 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:52.671 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:52.810 INFO:teuthology.orchestra.run.smithi017.stdout:Updating Subscription Management repositories. 2023-07-14T12:40:54.103 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 117 kB/s | 81 kB 00:00 2023-07-14T12:40:54.130 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 113 kB/s | 81 kB 00:00 2023-07-14T12:40:54.263 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 101 kB/s | 81 kB 00:00 2023-07-14T12:40:54.629 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 19 kB/s | 9.4 kB 00:00 2023-07-14T12:40:54.639 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 20 kB/s | 9.4 kB 00:00 2023-07-14T12:40:54.764 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 20 kB/s | 9.4 kB 00:00 2023-07-14T12:40:55.097 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 3.3 kB/s | 1.5 kB 00:00 2023-07-14T12:40:55.123 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 3.2 kB/s | 1.5 kB 00:00 2023-07-14T12:40:55.240 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 3.3 kB/s | 1.5 kB 00:00 2023-07-14T12:40:55.323 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-07-14T12:40:55.348 INFO:teuthology.orchestra.run.smithi131.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-07-14T12:40:55.506 INFO:teuthology.orchestra.run.smithi017.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-07-14T12:40:56.875 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-07-14T12:40:57.817 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 6.3 MB/s | 16 MB 00:02 2023-07-14T12:41:00.949 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 437 kB/s | 24 kB 00:00 2023-07-14T12:41:01.757 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 406 kB/s | 24 kB 00:00 2023-07-14T12:41:02.052 INFO:teuthology.orchestra.run.smithi131.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 47 MB 00:01 2023-07-14T12:41:03.201 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 35 MB/s | 47 MB 00:01 2023-07-14T12:41:10.870 INFO:teuthology.orchestra.run.smithi131.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 53 MB 00:01 2023-07-14T12:41:11.778 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2023-07-14T12:41:22.691 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T12:41:22.692 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T12:41:22.707 INFO:teuthology.orchestra.run.smithi131.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-14T12:41:22.708 INFO:teuthology.orchestra.run.smithi131.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-14T12:41:22.709 INFO:teuthology.orchestra.run.smithi131.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-14T12:41:22.710 INFO:teuthology.orchestra.run.smithi131.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-14T12:41:22.713 INFO:teuthology.orchestra.run.smithi131.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-14T12:41:22.716 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-14T12:41:22.717 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-14T12:41:22.855 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-07-14T12:41:22.868 INFO:teuthology.orchestra.run.smithi131.stdout:=========================================================================================================================== 2023-07-14T12:41:22.868 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2023-07-14T12:41:22.869 INFO:teuthology.orchestra.run.smithi131.stdout:=========================================================================================================================== 2023-07-14T12:41:22.869 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2023-07-14T12:41:22.869 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-14T12:41:22.869 INFO:teuthology.orchestra.run.smithi131.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-14T12:41:22.869 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.4 k 2023-07-14T12:41:22.869 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 5.4 M 2023-07-14T12:41:22.869 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 848 k 2023-07-14T12:41:22.870 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 165 k 2023-07-14T12:41:22.870 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 1.5 M 2023-07-14T12:41:22.870 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 129 k 2023-07-14T12:41:22.870 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 1.7 M 2023-07-14T12:41:22.871 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 7.4 M 2023-07-14T12:41:22.871 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 47 k 2023-07-14T12:41:22.871 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 13 M 2023-07-14T12:41:22.871 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 48 M 2023-07-14T12:41:22.871 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 258 k 2023-07-14T12:41:22.871 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 166 k 2023-07-14T12:41:22.871 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 258 k 2023-07-14T12:41:22.872 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 18 k 2023-07-14T12:41:22.872 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-14T12:41:22.872 INFO:teuthology.orchestra.run.smithi131.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-14T12:41:22.872 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-14T12:41:22.872 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 31 k 2023-07-14T12:41:22.872 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 771 k 2023-07-14T12:41:22.872 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 139 k 2023-07-14T12:41:22.873 INFO:teuthology.orchestra.run.smithi131.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-14T12:41:22.873 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-14T12:41:22.873 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-14T12:41:22.873 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-14T12:41:22.873 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-14T12:41:22.873 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-14T12:41:22.873 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 197 k 2023-07-14T12:41:22.873 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 371 k 2023-07-14T12:41:22.874 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 364 k 2023-07-14T12:41:22.874 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 107 k 2023-07-14T12:41:22.874 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 94 k 2023-07-14T12:41:22.874 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.4 M 2023-07-14T12:41:22.874 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 179 k 2023-07-14T12:41:22.874 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-14T12:41:22.874 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2023-07-14T12:41:22.875 INFO:teuthology.orchestra.run.smithi131.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-14T12:41:22.875 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.7 M 2023-07-14T12:41:22.875 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.6 M 2023-07-14T12:41:22.875 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2023-07-14T12:41:22.875 INFO:teuthology.orchestra.run.smithi131.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-14T12:41:22.875 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 22 M 2023-07-14T12:41:22.875 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 23 k 2023-07-14T12:41:22.875 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 2.3 M 2023-07-14T12:41:22.876 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 240 k 2023-07-14T12:41:22.876 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 4.6 M 2023-07-14T12:41:22.876 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 18 M 2023-07-14T12:41:22.876 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 15 k 2023-07-14T12:41:22.876 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 24 k 2023-07-14T12:41:22.876 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-14T12:41:22.876 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-14T12:41:22.877 INFO:teuthology.orchestra.run.smithi131.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-14T12:41:22.877 INFO:teuthology.orchestra.run.smithi131.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-14T12:41:22.877 INFO:teuthology.orchestra.run.smithi131.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-14T12:41:22.877 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 137 k 2023-07-14T12:41:22.877 INFO:teuthology.orchestra.run.smithi131.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-14T12:41:22.877 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-14T12:41:22.877 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-14T12:41:22.877 INFO:teuthology.orchestra.run.smithi131.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-14T12:41:22.878 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-14T12:41:22.878 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-14T12:41:22.878 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 473 k 2023-07-14T12:41:22.878 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-14T12:41:22.878 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.7 M 2023-07-14T12:41:22.878 INFO:teuthology.orchestra.run.smithi131.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-14T12:41:22.878 INFO:teuthology.orchestra.run.smithi131.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-14T12:41:22.879 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-14T12:41:22.879 INFO:teuthology.orchestra.run.smithi131.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-14T12:41:22.879 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-14T12:41:22.879 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-14T12:41:22.879 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-14T12:41:22.879 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-14T12:41:22.879 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-14T12:41:22.879 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-14T12:41:22.880 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-14T12:41:22.880 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-14T12:41:22.880 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-14T12:41:22.880 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-14T12:41:22.880 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-14T12:41:22.880 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-14T12:41:22.880 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 45 k 2023-07-14T12:41:22.881 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 119 k 2023-07-14T12:41:22.881 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-14T12:41:22.881 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-14T12:41:22.881 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-14T12:41:22.881 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-14T12:41:22.881 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-14T12:41:22.881 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-14T12:41:22.882 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-14T12:41:22.882 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-14T12:41:22.882 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-14T12:41:22.882 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-14T12:41:22.882 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-14T12:41:22.882 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T12:41:22.882 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-14T12:41:22.882 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-14T12:41:22.883 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-14T12:41:22.883 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-14T12:41:22.883 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-14T12:41:22.883 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-14T12:41:22.883 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-14T12:41:22.883 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-14T12:41:22.883 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-14T12:41:22.883 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-14T12:41:22.884 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-14T12:41:22.884 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-14T12:41:22.884 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-14T12:41:22.884 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-14T12:41:22.884 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-14T12:41:22.884 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-14T12:41:22.885 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-14T12:41:22.885 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-14T12:41:22.885 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T12:41:22.885 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-14T12:41:22.885 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-14T12:41:22.885 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-14T12:41:22.885 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-14T12:41:22.885 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-14T12:41:22.886 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-14T12:41:22.886 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-14T12:41:22.886 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-14T12:41:22.886 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-14T12:41:22.886 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-14T12:41:22.886 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-14T12:41:22.886 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-14T12:41:22.886 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-14T12:41:22.887 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-14T12:41:22.887 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-14T12:41:22.887 INFO:teuthology.orchestra.run.smithi131.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-14T12:41:22.887 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-14T12:41:22.887 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-14T12:41:22.887 INFO:teuthology.orchestra.run.smithi131.stdout:Enabling module streams: 2023-07-14T12:41:22.887 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql 10 2023-07-14T12:41:22.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:41:22.888 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-07-14T12:41:22.888 INFO:teuthology.orchestra.run.smithi131.stdout:=========================================================================================================================== 2023-07-14T12:41:22.888 INFO:teuthology.orchestra.run.smithi131.stdout:Install 128 Packages 2023-07-14T12:41:22.888 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 3 Packages 2023-07-14T12:41:22.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:41:22.889 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 205 M 2023-07-14T12:41:22.889 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-07-14T12:41:23.307 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T12:41:23.308 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T12:41:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-14T12:41:23.369 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-14T12:41:23.372 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-14T12:41:23.373 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-14T12:41:23.373 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-14T12:41:23.373 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-14T12:41:23.373 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-14T12:41:23.476 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2023-07-14T12:41:23.494 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-07-14T12:41:23.495 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2023-07-14T12:41:23.495 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-07-14T12:41:23.495 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2023-07-14T12:41:23.495 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-14T12:41:23.495 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-14T12:41:23.496 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.4 k 2023-07-14T12:41:23.496 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 5.4 M 2023-07-14T12:41:23.496 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 848 k 2023-07-14T12:41:23.496 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 165 k 2023-07-14T12:41:23.496 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 1.5 M 2023-07-14T12:41:23.496 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 129 k 2023-07-14T12:41:23.496 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 1.7 M 2023-07-14T12:41:23.497 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 7.4 M 2023-07-14T12:41:23.497 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 47 k 2023-07-14T12:41:23.497 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 13 M 2023-07-14T12:41:23.497 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 48 M 2023-07-14T12:41:23.497 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 258 k 2023-07-14T12:41:23.497 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 166 k 2023-07-14T12:41:23.498 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 258 k 2023-07-14T12:41:23.498 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 18 k 2023-07-14T12:41:23.498 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-14T12:41:23.498 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-14T12:41:23.498 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-14T12:41:23.498 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 31 k 2023-07-14T12:41:23.498 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 771 k 2023-07-14T12:41:23.499 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 139 k 2023-07-14T12:41:23.499 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-14T12:41:23.499 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-14T12:41:23.499 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-14T12:41:23.499 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-14T12:41:23.499 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-14T12:41:23.499 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-14T12:41:23.500 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 197 k 2023-07-14T12:41:23.500 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 371 k 2023-07-14T12:41:23.500 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 364 k 2023-07-14T12:41:23.500 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 107 k 2023-07-14T12:41:23.500 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 94 k 2023-07-14T12:41:23.501 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.4 M 2023-07-14T12:41:23.501 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 179 k 2023-07-14T12:41:23.501 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-14T12:41:23.501 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2023-07-14T12:41:23.501 INFO:teuthology.orchestra.run.smithi135.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-14T12:41:23.501 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.7 M 2023-07-14T12:41:23.501 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.6 M 2023-07-14T12:41:23.502 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2023-07-14T12:41:23.502 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-14T12:41:23.502 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 22 M 2023-07-14T12:41:23.502 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 23 k 2023-07-14T12:41:23.502 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 2.3 M 2023-07-14T12:41:23.502 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 240 k 2023-07-14T12:41:23.502 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 4.6 M 2023-07-14T12:41:23.502 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 18 M 2023-07-14T12:41:23.503 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 15 k 2023-07-14T12:41:23.503 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 24 k 2023-07-14T12:41:23.503 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-14T12:41:23.503 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-14T12:41:23.503 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-14T12:41:23.503 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-14T12:41:23.503 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-14T12:41:23.504 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 137 k 2023-07-14T12:41:23.504 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-14T12:41:23.505 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-14T12:41:23.505 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-14T12:41:23.505 INFO:teuthology.orchestra.run.smithi135.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-14T12:41:23.505 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-14T12:41:23.506 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-14T12:41:23.506 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 473 k 2023-07-14T12:41:23.506 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-14T12:41:23.506 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.7 M 2023-07-14T12:41:23.506 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-14T12:41:23.507 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-14T12:41:23.507 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-14T12:41:23.507 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-14T12:41:23.507 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-14T12:41:23.507 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-14T12:41:23.507 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-14T12:41:23.507 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-14T12:41:23.508 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-14T12:41:23.508 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-14T12:41:23.508 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-14T12:41:23.508 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-14T12:41:23.509 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-14T12:41:23.509 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-14T12:41:23.509 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-14T12:41:23.509 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-14T12:41:23.509 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 45 k 2023-07-14T12:41:23.509 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 119 k 2023-07-14T12:41:23.510 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-14T12:41:23.510 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-14T12:41:23.510 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-14T12:41:23.510 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-14T12:41:23.510 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-14T12:41:23.510 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-14T12:41:23.510 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-14T12:41:23.511 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-14T12:41:23.511 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-14T12:41:23.511 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-14T12:41:23.511 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-14T12:41:23.511 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T12:41:23.511 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-14T12:41:23.511 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-14T12:41:23.512 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-14T12:41:23.512 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-14T12:41:23.512 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-14T12:41:23.512 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-14T12:41:23.512 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-14T12:41:23.512 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-14T12:41:23.512 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-14T12:41:23.513 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-14T12:41:23.513 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-14T12:41:23.513 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-14T12:41:23.513 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-14T12:41:23.513 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-14T12:41:23.513 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-14T12:41:23.513 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-14T12:41:23.513 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-14T12:41:23.514 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-14T12:41:23.514 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T12:41:23.514 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-14T12:41:23.514 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-14T12:41:23.514 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-14T12:41:23.514 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-14T12:41:23.515 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-14T12:41:23.515 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-14T12:41:23.515 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-14T12:41:23.516 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-14T12:41:23.516 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-14T12:41:23.516 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-14T12:41:23.516 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-14T12:41:23.516 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-14T12:41:23.516 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-14T12:41:23.517 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-14T12:41:23.517 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-14T12:41:23.517 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-14T12:41:23.517 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-14T12:41:23.517 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-14T12:41:23.517 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling module streams: 2023-07-14T12:41:23.518 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql 10 2023-07-14T12:41:23.518 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:41:23.518 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2023-07-14T12:41:23.518 INFO:teuthology.orchestra.run.smithi135.stdout:=========================================================================================================================== 2023-07-14T12:41:23.518 INFO:teuthology.orchestra.run.smithi135.stdout:Install 128 Packages 2023-07-14T12:41:23.518 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 3 Packages 2023-07-14T12:41:23.518 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:41:23.519 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 205 M 2023-07-14T12:41:23.520 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2023-07-14T12:41:23.887 INFO:teuthology.orchestra.run.smithi131.stdout:(1/131): ceph-18.0.0-4757.g3fc0089c.el8.x86_64. 16 kB/s | 6.4 kB 00:00 2023-07-14T12:41:24.538 INFO:teuthology.orchestra.run.smithi135.stdout:(1/131): ceph-18.0.0-4757.g3fc0089c.el8.x86_64. 15 kB/s | 6.4 kB 00:00 2023-07-14T12:41:25.062 INFO:teuthology.orchestra.run.smithi131.stdout:(2/131): ceph-fuse-18.0.0-4757.g3fc0089c.el8.x8 722 kB/s | 848 kB 00:01 2023-07-14T12:41:25.321 INFO:teuthology.orchestra.run.smithi131.stdout:(3/131): ceph-immutable-object-cache-18.0.0-475 641 kB/s | 165 kB 00:00 2023-07-14T12:41:25.746 INFO:teuthology.orchestra.run.smithi135.stdout:(2/131): ceph-fuse-18.0.0-4757.g3fc0089c.el8.x8 702 kB/s | 848 kB 00:01 2023-07-14T12:41:25.888 INFO:teuthology.orchestra.run.smithi135.stdout:(3/131): ceph-immutable-object-cache-18.0.0-475 1.1 MB/s | 165 kB 00:00 2023-07-14T12:41:26.304 INFO:teuthology.orchestra.run.smithi131.stdout:(4/131): ceph-mds-18.0.0-4757.g3fc0089c.el8.x86 2.3 MB/s | 2.3 MB 00:00 2023-07-14T12:41:26.672 INFO:teuthology.orchestra.run.smithi131.stdout:(5/131): ceph-base-18.0.0-4757.g3fc0089c.el8.x8 1.7 MB/s | 5.4 MB 00:03 2023-07-14T12:41:26.880 INFO:teuthology.orchestra.run.smithi131.stdout:(6/131): ceph-mgr-18.0.0-4757.g3fc0089c.el8.x86 2.7 MB/s | 1.5 MB 00:00 2023-07-14T12:41:26.914 INFO:teuthology.orchestra.run.smithi135.stdout:(4/131): ceph-mds-18.0.0-4757.g3fc0089c.el8.x86 2.2 MB/s | 2.3 MB 00:01 2023-07-14T12:41:27.306 INFO:teuthology.orchestra.run.smithi135.stdout:(5/131): ceph-base-18.0.0-4757.g3fc0089c.el8.x8 1.7 MB/s | 5.4 MB 00:03 2023-07-14T12:41:27.523 INFO:teuthology.orchestra.run.smithi135.stdout:(6/131): ceph-mgr-18.0.0-4757.g3fc0089c.el8.x86 2.5 MB/s | 1.5 MB 00:00 2023-07-14T12:41:27.764 INFO:teuthology.orchestra.run.smithi131.stdout:(7/131): ceph-mon-18.0.0-4757.g3fc0089c.el8.x86 4.2 MB/s | 4.6 MB 00:01 2023-07-14T12:41:28.615 INFO:teuthology.orchestra.run.smithi135.stdout:(7/131): ceph-mon-18.0.0-4757.g3fc0089c.el8.x86 3.5 MB/s | 4.6 MB 00:01 2023-07-14T12:41:29.572 INFO:teuthology.orchestra.run.smithi131.stdout:(8/131): ceph-common-18.0.0-4757.g3fc0089c.el8. 3.6 MB/s | 22 MB 00:06 2023-07-14T12:41:29.689 INFO:teuthology.orchestra.run.smithi131.stdout:(9/131): ceph-selinux-18.0.0-4757.g3fc0089c.el8 209 kB/s | 24 kB 00:00 2023-07-14T12:41:30.848 INFO:teuthology.orchestra.run.smithi135.stdout:(8/131): ceph-osd-18.0.0-4757.g3fc0089c.el8.x86 5.3 MB/s | 18 MB 00:03 2023-07-14T12:41:30.973 INFO:teuthology.orchestra.run.smithi135.stdout:(9/131): ceph-selinux-18.0.0-4757.g3fc0089c.el8 195 kB/s | 24 kB 00:00 2023-07-14T12:41:31.031 INFO:teuthology.orchestra.run.smithi131.stdout:(10/131): ceph-radosgw-18.0.0-4757.g3fc0089c.el 4.1 MB/s | 13 MB 00:03 2023-07-14T12:41:31.198 INFO:teuthology.orchestra.run.smithi131.stdout:(11/131): cephfs-mirror-18.0.0-4757.g3fc0089c.e 1.5 MB/s | 258 kB 00:00 2023-07-14T12:41:31.398 INFO:teuthology.orchestra.run.smithi131.stdout:(12/131): libcephfs-devel-18.0.0-4757.g3fc0089c 155 kB/s | 31 kB 00:00 2023-07-14T12:41:31.857 INFO:teuthology.orchestra.run.smithi135.stdout:(10/131): ceph-common-18.0.0-4757.g3fc0089c.el8 2.8 MB/s | 22 MB 00:07 2023-07-14T12:41:31.895 INFO:teuthology.orchestra.run.smithi131.stdout:(13/131): libcephfs2-18.0.0-4757.g3fc0089c.el8. 1.5 MB/s | 771 kB 00:00 2023-07-14T12:41:32.016 INFO:teuthology.orchestra.run.smithi131.stdout:(14/131): libcephsqlite-18.0.0-4757.g3fc0089c.e 1.1 MB/s | 137 kB 00:00 2023-07-14T12:41:32.150 INFO:teuthology.orchestra.run.smithi131.stdout:(15/131): librados-devel-18.0.0-4757.g3fc0089c. 1.0 MB/s | 139 kB 00:00 2023-07-14T12:41:32.174 INFO:teuthology.orchestra.run.smithi135.stdout:(11/131): cephfs-mirror-18.0.0-4757.g3fc0089c.e 815 kB/s | 258 kB 00:00 2023-07-14T12:41:32.308 INFO:teuthology.orchestra.run.smithi135.stdout:(12/131): libcephfs-devel-18.0.0-4757.g3fc0089c 232 kB/s | 31 kB 00:00 2023-07-14T12:41:32.383 INFO:teuthology.orchestra.run.smithi131.stdout:(16/131): libradosstriper1-18.0.0-4757.g3fc0089 2.0 MB/s | 473 kB 00:00 2023-07-14T12:41:32.975 INFO:teuthology.orchestra.run.smithi131.stdout:(17/131): ceph-osd-18.0.0-4757.g3fc0089c.el8.x8 2.9 MB/s | 18 MB 00:06 2023-07-14T12:41:33.075 INFO:teuthology.orchestra.run.smithi131.stdout:(18/131): python3-ceph-argparse-18.0.0-4757.g3f 448 kB/s | 45 kB 00:00 2023-07-14T12:41:33.083 INFO:teuthology.orchestra.run.smithi135.stdout:(13/131): libcephfs2-18.0.0-4757.g3fc0089c.el8. 995 kB/s | 771 kB 00:00 2023-07-14T12:41:33.167 INFO:teuthology.orchestra.run.smithi131.stdout:(19/131): python3-ceph-common-18.0.0-4757.g3fc0 1.3 MB/s | 119 kB 00:00 2023-07-14T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout:(20/131): python3-cephfs-18.0.0-4757.g3fc0089c. 2.1 MB/s | 197 kB 00:00 2023-07-14T12:41:33.275 INFO:teuthology.orchestra.run.smithi135.stdout:(14/131): ceph-radosgw-18.0.0-4757.g3fc0089c.el 2.9 MB/s | 13 MB 00:04 2023-07-14T12:41:33.301 INFO:teuthology.orchestra.run.smithi135.stdout:(15/131): libcephsqlite-18.0.0-4757.g3fc0089c.e 632 kB/s | 137 kB 00:00 2023-07-14T12:41:33.420 INFO:teuthology.orchestra.run.smithi135.stdout:(16/131): librados-devel-18.0.0-4757.g3fc0089c. 963 kB/s | 139 kB 00:00 2023-07-14T12:41:33.443 INFO:teuthology.orchestra.run.smithi131.stdout:(21/131): python3-rados-18.0.0-4757.g3fc0089c.e 2.0 MB/s | 371 kB 00:00 2023-07-14T12:41:33.610 INFO:teuthology.orchestra.run.smithi135.stdout:(17/131): libradosstriper1-18.0.0-4757.g3fc0089 1.5 MB/s | 473 kB 00:00 2023-07-14T12:41:33.668 INFO:teuthology.orchestra.run.smithi131.stdout:(22/131): python3-rbd-18.0.0-4757.g3fc0089c.el8 1.6 MB/s | 364 kB 00:00 2023-07-14T12:41:33.727 INFO:teuthology.orchestra.run.smithi135.stdout:(18/131): python3-ceph-argparse-18.0.0-4757.g3f 384 kB/s | 45 kB 00:00 2023-07-14T12:41:33.752 INFO:teuthology.orchestra.run.smithi131.stdout:(23/131): librgw2-18.0.0-4757.g3fc0089c.el8.x86 4.9 MB/s | 6.7 MB 00:01 2023-07-14T12:41:33.803 INFO:teuthology.orchestra.run.smithi131.stdout:(24/131): python3-rgw-18.0.0-4757.g3fc0089c.el8 792 kB/s | 107 kB 00:00 2023-07-14T12:41:33.810 INFO:teuthology.orchestra.run.smithi135.stdout:(19/131): python3-ceph-common-18.0.0-4757.g3fc0 1.4 MB/s | 119 kB 00:00 2023-07-14T12:41:33.861 INFO:teuthology.orchestra.run.smithi131.stdout:(25/131): rbd-fuse-18.0.0-4757.g3fc0089c.el8.x8 869 kB/s | 94 kB 00:00 2023-07-14T12:41:33.978 INFO:teuthology.orchestra.run.smithi131.stdout:(26/131): rbd-nbd-18.0.0-4757.g3fc0089c.el8.x86 1.5 MB/s | 179 kB 00:00 2023-07-14T12:41:34.003 INFO:teuthology.orchestra.run.smithi135.stdout:(20/131): python3-cephfs-18.0.0-4757.g3fc0089c. 1.0 MB/s | 197 kB 00:00 2023-07-14T12:41:34.228 INFO:teuthology.orchestra.run.smithi131.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4757.g 92 kB/s | 23 kB 00:00 2023-07-14T12:41:34.236 INFO:teuthology.orchestra.run.smithi135.stdout:(21/131): python3-rados-18.0.0-4757.g3fc0089c.e 1.6 MB/s | 371 kB 00:00 2023-07-14T12:41:34.320 INFO:teuthology.orchestra.run.smithi131.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4757.g3fc0089 1.4 MB/s | 129 kB 00:00 2023-07-14T12:41:34.395 INFO:teuthology.orchestra.run.smithi135.stdout:(22/131): python3-rbd-18.0.0-4757.g3fc0089c.el8 2.3 MB/s | 364 kB 00:00 2023-07-14T12:41:34.516 INFO:teuthology.orchestra.run.smithi135.stdout:(23/131): python3-rgw-18.0.0-4757.g3fc0089c.el8 915 kB/s | 107 kB 00:00 2023-07-14T12:41:34.612 INFO:teuthology.orchestra.run.smithi135.stdout:(24/131): rbd-fuse-18.0.0-4757.g3fc0089c.el8.x8 945 kB/s | 94 kB 00:00 2023-07-14T12:41:34.804 INFO:teuthology.orchestra.run.smithi131.stdout:(29/131): ceph-mgr-dashboard-18.0.0-4757.g3fc00 3.5 MB/s | 1.7 MB 00:00 2023-07-14T12:41:34.988 INFO:teuthology.orchestra.run.smithi131.stdout:(30/131): rbd-mirror-18.0.0-4757.g3fc0089c.el8. 2.9 MB/s | 3.4 MB 00:01 2023-07-14T12:41:35.171 INFO:teuthology.orchestra.run.smithi131.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4757.g3f 1.3 MB/s | 240 kB 00:00 2023-07-14T12:41:35.288 INFO:teuthology.orchestra.run.smithi131.stdout:(32/131): ceph-mgr-rook-18.0.0-4757.g3fc0089c.e 406 kB/s | 47 kB 00:00 2023-07-14T12:41:35.447 INFO:teuthology.orchestra.run.smithi131.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4757.g3 92 kB/s | 15 kB 00:00 2023-07-14T12:41:35.622 INFO:teuthology.orchestra.run.smithi131.stdout:(34/131): ceph-volume-18.0.0-4757.g3fc0089c.el8 1.4 MB/s | 258 kB 00:00 2023-07-14T12:41:35.671 INFO:teuthology.orchestra.run.smithi135.stdout:(25/131): librgw2-18.0.0-4757.g3fc0089c.el8.x86 3.0 MB/s | 6.7 MB 00:02 2023-07-14T12:41:35.739 INFO:teuthology.orchestra.run.smithi131.stdout:(35/131): cephadm-18.0.0-4757.g3fc0089c.el8.noa 1.4 MB/s | 166 kB 00:00 2023-07-14T12:41:35.783 INFO:teuthology.orchestra.run.smithi135.stdout:(26/131): rbd-nbd-18.0.0-4757.g3fc0089c.el8.x86 1.6 MB/s | 179 kB 00:00 2023-07-14T12:41:35.831 INFO:teuthology.orchestra.run.smithi131.stdout:(36/131): cephfs-top-18.0.0-4757.g3fc0089c.el8. 196 kB/s | 18 kB 00:00 2023-07-14T12:41:35.863 INFO:teuthology.orchestra.run.smithi135.stdout:(27/131): rbd-mirror-18.0.0-4757.g3fc0089c.el8. 2.8 MB/s | 3.4 MB 00:01 2023-07-14T12:41:35.889 INFO:teuthology.orchestra.run.smithi135.stdout:(28/131): ceph-grafana-dashboards-18.0.0-4757.g 212 kB/s | 23 kB 00:00 2023-07-14T12:41:36.223 INFO:teuthology.orchestra.run.smithi131.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 782 kB/s | 306 kB 00:00 2023-07-14T12:41:36.290 INFO:teuthology.orchestra.run.smithi131.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 884 kB/s | 59 kB 00:00 2023-07-14T12:41:36.357 INFO:teuthology.orchestra.run.smithi131.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-07-14T12:41:36.447 INFO:teuthology.orchestra.run.smithi135.stdout:(29/131): ceph-test-18.0.0-4757.g3fc0089c.el8.x 8.7 MB/s | 48 MB 00:05 2023-07-14T12:41:36.482 INFO:teuthology.orchestra.run.smithi131.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.7 MB/s | 476 kB 00:00 2023-07-14T12:41:36.541 INFO:teuthology.orchestra.run.smithi131.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 748 kB/s | 44 kB 00:00 2023-07-14T12:41:36.617 INFO:teuthology.orchestra.run.smithi131.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2023-07-14T12:41:36.708 INFO:teuthology.orchestra.run.smithi131.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 360 kB/s | 33 kB 00:00 2023-07-14T12:41:36.767 INFO:teuthology.orchestra.run.smithi131.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 279 kB/s | 16 kB 00:00 2023-07-14T12:41:36.851 INFO:teuthology.orchestra.run.smithi131.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-07-14T12:41:36.934 INFO:teuthology.orchestra.run.smithi131.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2023-07-14T12:41:37.001 INFO:teuthology.orchestra.run.smithi131.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-07-14T12:41:37.077 INFO:teuthology.orchestra.run.smithi131.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-07-14T12:41:37.186 INFO:teuthology.orchestra.run.smithi131.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-07-14T12:41:37.344 INFO:teuthology.orchestra.run.smithi131.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 7.4 MB/s | 1.2 MB 00:00 2023-07-14T12:41:37.428 INFO:teuthology.orchestra.run.smithi131.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 584 kB/s | 49 kB 00:00 2023-07-14T12:41:37.511 INFO:teuthology.orchestra.run.smithi131.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 705 kB/s | 59 kB 00:00 2023-07-14T12:41:37.587 INFO:teuthology.orchestra.run.smithi131.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 802 kB/s | 60 kB 00:00 2023-07-14T12:41:37.679 INFO:teuthology.orchestra.run.smithi131.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-07-14T12:41:37.754 INFO:teuthology.orchestra.run.smithi131.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-07-14T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 450 kB/s | 34 kB 00:00 2023-07-14T12:41:37.913 INFO:teuthology.orchestra.run.smithi131.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-07-14T12:41:37.997 INFO:teuthology.orchestra.run.smithi131.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 738 kB/s | 61 kB 00:00 2023-07-14T12:41:38.080 INFO:teuthology.orchestra.run.smithi131.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 224 kB/s | 19 kB 00:00 2023-07-14T12:41:38.172 INFO:teuthology.orchestra.run.smithi131.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 261 kB/s | 24 kB 00:00 2023-07-14T12:41:38.248 INFO:teuthology.orchestra.run.smithi131.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2023-07-14T12:41:38.323 INFO:teuthology.orchestra.run.smithi131.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 368 kB/s | 27 kB 00:00 2023-07-14T12:41:38.407 INFO:teuthology.orchestra.run.smithi131.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2023-07-14T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.7 MB/s | 251 kB 00:00 2023-07-14T12:41:38.612 INFO:teuthology.orchestra.run.smithi131.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 542 kB/s | 61 kB 00:00 2023-07-14T12:41:38.691 INFO:teuthology.orchestra.run.smithi131.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-07-14T12:41:38.766 INFO:teuthology.orchestra.run.smithi131.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 306 kB/s | 23 kB 00:00 2023-07-14T12:41:38.917 INFO:teuthology.orchestra.run.smithi131.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-07-14T12:41:38.951 INFO:teuthology.orchestra.run.smithi131.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 70 kB 00:00 2023-07-14T12:41:39.317 INFO:teuthology.orchestra.run.smithi131.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 37 MB/s | 14 MB 00:00 2023-07-14T12:41:39.368 INFO:teuthology.orchestra.run.smithi131.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-07-14T12:41:39.410 INFO:teuthology.orchestra.run.smithi131.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-07-14T12:41:39.461 INFO:teuthology.orchestra.run.smithi131.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-07-14T12:41:39.513 INFO:teuthology.orchestra.run.smithi131.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.2 MB/s | 323 kB 00:00 2023-07-14T12:41:39.548 INFO:teuthology.orchestra.run.smithi131.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-07-14T12:41:39.622 INFO:teuthology.orchestra.run.smithi131.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 9.0 MB/s | 688 kB 00:00 2023-07-14T12:41:39.672 INFO:teuthology.orchestra.run.smithi131.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-07-14T12:41:39.714 INFO:teuthology.orchestra.run.smithi131.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-07-14T12:41:39.756 INFO:teuthology.orchestra.run.smithi131.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-07-14T12:41:39.807 INFO:teuthology.orchestra.run.smithi131.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-07-14T12:41:39.948 INFO:teuthology.orchestra.run.smithi131.stdout:(81/131): python3-babel-2.5.1-7.el8.noarch.rpm 34 MB/s | 4.8 MB 00:00 2023-07-14T12:41:39.990 INFO:teuthology.orchestra.run.smithi131.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 641 kB/s | 27 kB 00:00 2023-07-14T12:41:40.059 INFO:teuthology.orchestra.run.smithi131.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 4.6 MB/s | 320 kB 00:00 2023-07-14T12:41:40.107 INFO:teuthology.orchestra.run.smithi131.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 908 kB/s | 44 kB 00:00 2023-07-14T12:41:40.233 INFO:teuthology.orchestra.run.smithi131.stdout:(85/131): python3-numpy-1.14.3-10.el8.x86_64.rp 30 MB/s | 3.7 MB 00:00 2023-07-14T12:41:40.277 INFO:teuthology.orchestra.run.smithi131.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-07-14T12:41:40.316 INFO:teuthology.orchestra.run.smithi131.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-07-14T12:41:40.350 INFO:teuthology.orchestra.run.smithi131.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2023-07-14T12:41:40.384 INFO:teuthology.orchestra.run.smithi131.stdout:(89/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.7 MB/s | 126 kB 00:00 2023-07-14T12:41:40.418 INFO:teuthology.orchestra.run.smithi131.stdout:(90/131): python3-jsonpointer-1.10-11.el8.noarc 602 kB/s | 20 kB 00:00 2023-07-14T12:41:40.459 INFO:teuthology.orchestra.run.smithi131.stdout:(91/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-07-14T12:41:40.546 INFO:teuthology.orchestra.run.smithi131.stdout:(92/131): libtool-2.4.6-25.el8.x86_64.rpm 8.0 MB/s | 709 kB 00:00 2023-07-14T12:41:40.694 INFO:teuthology.orchestra.run.smithi131.stdout:(93/131): openblas-threads-0.3.15-3.el8.x86_64. 33 MB/s | 4.9 MB 00:00 2023-07-14T12:41:40.736 INFO:teuthology.orchestra.run.smithi131.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-07-14T12:41:40.869 INFO:teuthology.orchestra.run.smithi131.stdout:(95/131): openblas-0.3.15-3.el8.x86_64.rpm 36 MB/s | 4.7 MB 00:00 2023-07-14T12:41:40.911 INFO:teuthology.orchestra.run.smithi131.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-07-14T12:41:40.953 INFO:teuthology.orchestra.run.smithi131.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-07-14T12:41:41.104 INFO:teuthology.orchestra.run.smithi131.stdout:(98/131): postgresql-server-10.21-2.module+el8. 34 MB/s | 5.1 MB 00:00 2023-07-14T12:41:41.154 INFO:teuthology.orchestra.run.smithi131.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 16 MB/s | 808 kB 00:00 2023-07-14T12:41:41.221 INFO:teuthology.orchestra.run.smithi131.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 23 MB/s | 1.5 MB 00:00 2023-07-14T12:41:41.255 INFO:teuthology.orchestra.run.smithi131.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-07-14T12:41:41.297 INFO:teuthology.orchestra.run.smithi131.stdout:(102/131): libselinux-devel-2.9-5.el8.x86_64.rp 4.7 MB/s | 200 kB 00:00 2023-07-14T12:41:41.330 INFO:teuthology.orchestra.run.smithi131.stdout:(103/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2023-07-14T12:41:41.372 INFO:teuthology.orchestra.run.smithi131.stdout:(104/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-07-14T12:41:41.406 INFO:teuthology.orchestra.run.smithi131.stdout:(105/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.4 MB/s | 48 kB 00:00 2023-07-14T12:41:41.439 INFO:teuthology.orchestra.run.smithi131.stdout:(106/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.6 MB/s | 87 kB 00:00 2023-07-14T12:41:41.497 INFO:teuthology.orchestra.run.smithi131.stdout:(107/131): python3-requests-oauthlib-1.0.0-1.el 751 kB/s | 43 kB 00:00 2023-07-14T12:41:41.540 INFO:teuthology.orchestra.run.smithi131.stdout:(108/131): python3-pycparser-2.14-14.el8.noarch 2.5 MB/s | 109 kB 00:00 2023-07-14T12:41:41.582 INFO:teuthology.orchestra.run.smithi131.stdout:(109/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2023-07-14T12:41:41.632 INFO:teuthology.orchestra.run.smithi131.stdout:(110/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 11 MB/s | 560 kB 00:00 2023-07-14T12:41:41.666 INFO:teuthology.orchestra.run.smithi131.stdout:(111/131): libaio-devel-0.3.112-1.el8.x86_64.rp 560 kB/s | 19 kB 00:00 2023-07-14T12:41:41.708 INFO:teuthology.orchestra.run.smithi131.stdout:(112/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.7 MB/s | 155 kB 00:00 2023-07-14T12:41:41.750 INFO:teuthology.orchestra.run.smithi131.stdout:(113/131): python3-cryptography-3.2.1-5.el8.x86 13 MB/s | 559 kB 00:00 2023-07-14T12:41:41.775 INFO:teuthology.orchestra.run.smithi131.stdout:(114/131): libverto-devel-0.3.0-5.el8.x86_64.rp 714 kB/s | 18 kB 00:00 2023-07-14T12:41:41.825 INFO:teuthology.orchestra.run.smithi131.stdout:(115/131): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-07-14T12:41:41.868 INFO:teuthology.orchestra.run.smithi131.stdout:(116/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 238 kB 00:00 2023-07-14T12:41:42.243 INFO:teuthology.orchestra.run.smithi131.stdout:(117/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.2 MB/s | 2.3 MB 00:00 2023-07-14T12:41:42.285 INFO:teuthology.orchestra.run.smithi131.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.7 MB/s | 72 kB 00:00 2023-07-14T12:41:42.327 INFO:teuthology.orchestra.run.smithi131.stdout:(119/131): fuse-2.9.7-15.el8.x86_64.rpm 2.0 MB/s | 83 kB 00:00 2023-07-14T12:41:42.369 INFO:teuthology.orchestra.run.smithi131.stdout:(120/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-07-14T12:41:42.402 INFO:teuthology.orchestra.run.smithi131.stdout:(121/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.9 MB/s | 98 kB 00:00 2023-07-14T12:41:42.445 INFO:teuthology.orchestra.run.smithi131.stdout:(122/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.4 MB/s | 58 kB 00:00 2023-07-14T12:41:42.512 INFO:teuthology.orchestra.run.smithi131.stdout:(123/131): libcom_err-devel-1.45.6-4.el8.x86_64 581 kB/s | 39 kB 00:00 2023-07-14T12:41:42.567 INFO:teuthology.orchestra.run.smithi131.stdout:(124/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 12 MB/s | 644 kB 00:00 2023-07-14T12:41:42.597 INFO:teuthology.orchestra.run.smithi131.stdout:(125/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 5.0 MB/s | 171 kB 00:00 2023-07-14T12:41:42.640 INFO:teuthology.orchestra.run.smithi131.stdout:(126/131): NetworkManager-initscripts-updown-1. 3.2 MB/s | 138 kB 00:00 2023-07-14T12:41:42.708 INFO:teuthology.orchestra.run.smithi135.stdout:(30/131): ceph-mgr-cephadm-18.0.0-4757.g3fc0089 19 kB/s | 129 kB 00:06 2023-07-14T12:41:42.892 INFO:teuthology.orchestra.run.smithi135.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4757.g3f 1.3 MB/s | 240 kB 00:00 2023-07-14T12:41:42.975 INFO:teuthology.orchestra.run.smithi135.stdout:(32/131): ceph-mgr-rook-18.0.0-4757.g3fc0089c.e 571 kB/s | 47 kB 00:00 2023-07-14T12:41:43.292 INFO:teuthology.orchestra.run.smithi135.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4757.g3 46 kB/s | 15 kB 00:00 2023-07-14T12:41:43.335 INFO:teuthology.orchestra.run.smithi135.stdout:(34/131): ceph-mgr-dashboard-18.0.0-4757.g3fc00 235 kB/s | 1.7 MB 00:07 2023-07-14T12:41:43.464 INFO:teuthology.orchestra.run.smithi135.stdout:(35/131): cephadm-18.0.0-4757.g3fc0089c.el8.noa 1.3 MB/s | 166 kB 00:00 2023-07-14T12:41:43.502 INFO:teuthology.orchestra.run.smithi135.stdout:(36/131): ceph-volume-18.0.0-4757.g3fc0089c.el8 1.2 MB/s | 258 kB 00:00 2023-07-14T12:41:43.611 INFO:teuthology.orchestra.run.smithi135.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 1.0 MB/s | 7.4 MB 00:07 2023-07-14T12:41:43.636 INFO:teuthology.orchestra.run.smithi135.stdout:(38/131): cephfs-top-18.0.0-4757.g3fc0089c.el8. 104 kB/s | 18 kB 00:00 2023-07-14T12:41:43.920 INFO:teuthology.orchestra.run.smithi135.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 191 kB/s | 59 kB 00:00 2023-07-14T12:41:43.953 INFO:teuthology.orchestra.run.smithi135.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 237 kB/s | 75 kB 00:00 2023-07-14T12:41:43.973 INFO:teuthology.orchestra.run.smithi131.stdout:(127/131): librados2-18.0.0-4757.g3fc0089c.el8. 2.7 MB/s | 3.7 MB 00:01 2023-07-14T12:41:44.080 INFO:teuthology.orchestra.run.smithi135.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 532 kB/s | 306 kB 00:00 2023-07-14T12:41:44.112 INFO:teuthology.orchestra.run.smithi135.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 275 kB/s | 44 kB 00:00 2023-07-14T12:41:44.205 INFO:teuthology.orchestra.run.smithi135.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-07-14T12:41:44.230 INFO:teuthology.orchestra.run.smithi135.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 281 kB/s | 33 kB 00:00 2023-07-14T12:41:44.255 INFO:teuthology.orchestra.run.smithi135.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.4 MB/s | 476 kB 00:00 2023-07-14T12:41:44.308 INFO:teuthology.orchestra.run.smithi135.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2023-07-14T12:41:44.398 INFO:teuthology.orchestra.run.smithi135.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 885 kB/s | 81 kB 00:00 2023-07-14T12:41:44.423 INFO:teuthology.orchestra.run.smithi135.stdout:(48/131): python3-cheroot-8.5.2-1.el8.noarch.rp 897 kB/s | 173 kB 00:00 2023-07-14T12:41:44.449 INFO:teuthology.orchestra.run.smithi135.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.9 MB/s | 384 kB 00:00 2023-07-14T12:41:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 132 kB/s | 11 kB 00:00 2023-07-14T12:41:44.541 INFO:teuthology.orchestra.run.smithi135.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2023-07-14T12:41:44.625 INFO:teuthology.orchestra.run.smithi135.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 704 kB/s | 59 kB 00:00 2023-07-14T12:41:44.650 INFO:teuthology.orchestra.run.smithi135.stdout:(53/131): python3-logutils-0.3.5-11.el8.noarch. 291 kB/s | 49 kB 00:00 2023-07-14T12:41:44.717 INFO:teuthology.orchestra.run.smithi135.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 657 kB/s | 60 kB 00:00 2023-07-14T12:41:44.784 INFO:teuthology.orchestra.run.smithi135.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2023-07-14T12:41:44.810 INFO:teuthology.orchestra.run.smithi135.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-07-14T12:41:44.877 INFO:teuthology.orchestra.run.smithi135.stdout:(57/131): python3-kubernetes-11.0.0-6.el8.noarc 2.7 MB/s | 1.2 MB 00:00 2023-07-14T12:41:44.910 INFO:teuthology.orchestra.run.smithi135.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 267 kB/s | 34 kB 00:00 2023-07-14T12:41:44.936 INFO:teuthology.orchestra.run.smithi135.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-07-14T12:41:44.961 INFO:teuthology.orchestra.run.smithi135.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 738 kB/s | 61 kB 00:00 2023-07-14T12:41:44.965 INFO:teuthology.orchestra.run.smithi131.stdout:(128/131): ceph-mgr-diskprediction-local-18.0.0 747 kB/s | 7.4 MB 00:10 2023-07-14T12:41:44.987 INFO:teuthology.orchestra.run.smithi135.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 247 kB/s | 19 kB 00:00 2023-07-14T12:41:45.012 INFO:teuthology.orchestra.run.smithi135.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-07-14T12:41:45.024 INFO:teuthology.orchestra.run.smithi131.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-07-14T12:41:45.038 INFO:teuthology.orchestra.run.smithi135.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 387 kB/s | 29 kB 00:00 2023-07-14T12:41:45.062 INFO:teuthology.orchestra.run.smithi135.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 364 kB/s | 27 kB 00:00 2023-07-14T12:41:45.088 INFO:teuthology.orchestra.run.smithi135.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-07-14T12:41:45.147 INFO:teuthology.orchestra.run.smithi135.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.2 MB/s | 251 kB 00:00 2023-07-14T12:41:45.172 INFO:teuthology.orchestra.run.smithi135.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 561 kB/s | 61 kB 00:00 2023-07-14T12:41:45.197 INFO:teuthology.orchestra.run.smithi135.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 783 kB/s | 85 kB 00:00 2023-07-14T12:41:45.223 INFO:teuthology.orchestra.run.smithi135.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-07-14T12:41:45.248 INFO:teuthology.orchestra.run.smithi135.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.3 MB/s | 70 kB 00:00 2023-07-14T12:41:45.307 INFO:teuthology.orchestra.run.smithi135.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.9 MB/s | 110 kB 00:00 2023-07-14T12:41:45.351 INFO:teuthology.orchestra.run.smithi135.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.2 MB/s | 54 kB 00:00 2023-07-14T12:41:45.418 INFO:teuthology.orchestra.run.smithi135.stdout:(73/131): thrift-0.13.0-2.el8.x86_64.rpm 7.1 MB/s | 1.7 MB 00:00 2023-07-14T12:41:45.452 INFO:teuthology.orchestra.run.smithi135.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2023-07-14T12:41:45.494 INFO:teuthology.orchestra.run.smithi135.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-07-14T12:41:45.527 INFO:teuthology.orchestra.run.smithi135.stdout:(76/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-07-14T12:41:45.594 INFO:teuthology.orchestra.run.smithi135.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 6.7 MB/s | 688 kB 00:00 2023-07-14T12:41:45.645 INFO:teuthology.orchestra.run.smithi135.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 4.5 MB/s | 538 kB 00:00 2023-07-14T12:41:45.670 INFO:teuthology.orchestra.run.smithi135.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-07-14T12:41:45.696 INFO:teuthology.orchestra.run.smithi135.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-07-14T12:41:45.737 INFO:teuthology.orchestra.run.smithi135.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-07-14T12:41:45.771 INFO:teuthology.orchestra.run.smithi135.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 793 kB/s | 27 kB 00:00 2023-07-14T12:41:45.831 INFO:teuthology.orchestra.run.smithi135.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 5.4 MB/s | 320 kB 00:00 2023-07-14T12:41:45.872 INFO:teuthology.orchestra.run.smithi135.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-07-14T12:41:45.907 INFO:teuthology.orchestra.run.smithi131.stdout:(130/131): librbd1-18.0.0-4757.g3fc0089c.el8.x8 1.8 MB/s | 3.6 MB 00:01 2023-07-14T12:41:46.006 INFO:teuthology.orchestra.run.smithi135.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-07-14T12:41:46.056 INFO:teuthology.orchestra.run.smithi135.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-07-14T12:41:46.124 INFO:teuthology.orchestra.run.smithi135.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-07-14T12:41:46.148 INFO:teuthology.orchestra.run.smithi135.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.4 MB/s | 225 kB 00:00 2023-07-14T12:41:46.165 INFO:teuthology.orchestra.run.smithi135.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-07-14T12:41:46.191 INFO:teuthology.orchestra.run.smithi135.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.9 MB/s | 126 kB 00:00 2023-07-14T12:41:46.216 INFO:teuthology.orchestra.run.smithi135.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-07-14T12:41:46.274 INFO:teuthology.orchestra.run.smithi135.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.2 MB/s | 103 kB 00:00 2023-07-14T12:41:46.326 INFO:teuthology.orchestra.run.smithi135.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 6.3 MB/s | 709 kB 00:00 2023-07-14T12:41:46.368 INFO:teuthology.orchestra.run.smithi135.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-07-14T12:41:46.527 INFO:teuthology.orchestra.run.smithi135.stdout:(95/131): python3-scipy-1.0.0-21.module+el8.5.0 11 MB/s | 14 MB 00:01 2023-07-14T12:41:46.569 INFO:teuthology.orchestra.run.smithi135.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-14T12:41:46.619 INFO:teuthology.orchestra.run.smithi135.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-07-14T12:41:46.728 INFO:teuthology.orchestra.run.smithi135.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 11 MB/s | 4.9 MB 00:00 2023-07-14T12:41:46.820 INFO:teuthology.orchestra.run.smithi135.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 10 MB/s | 4.7 MB 00:00 2023-07-14T12:41:46.853 INFO:teuthology.orchestra.run.smithi135.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-07-14T12:41:46.895 INFO:teuthology.orchestra.run.smithi135.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-07-14T12:41:46.937 INFO:teuthology.orchestra.run.smithi135.stdout:(102/131): libselinux-devel-2.9-5.el8.x86_64.rp 4.7 MB/s | 200 kB 00:00 2023-07-14T12:41:47.021 INFO:teuthology.orchestra.run.smithi135.stdout:(103/131): postgresql-10.21-2.module+el8.6.0+15 7.5 MB/s | 1.5 MB 00:00 2023-07-14T12:41:47.046 INFO:teuthology.orchestra.run.smithi135.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 392 kB/s | 43 kB 00:00 2023-07-14T12:41:47.080 INFO:teuthology.orchestra.run.smithi135.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-07-14T12:41:47.106 INFO:teuthology.orchestra.run.smithi135.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 816 kB/s | 48 kB 00:00 2023-07-14T12:41:47.131 INFO:teuthology.orchestra.run.smithi135.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-07-14T12:41:47.156 INFO:teuthology.orchestra.run.smithi135.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 848 kB/s | 43 kB 00:00 2023-07-14T12:41:47.182 INFO:teuthology.orchestra.run.smithi135.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-07-14T12:41:47.215 INFO:teuthology.orchestra.run.smithi135.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-07-14T12:41:47.291 INFO:teuthology.orchestra.run.smithi135.stdout:(111/131): postgresql-server-10.21-2.module+el8 7.5 MB/s | 5.1 MB 00:00 2023-07-14T12:41:47.308 INFO:teuthology.orchestra.run.smithi135.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 203 kB/s | 19 kB 00:00 2023-07-14T12:41:47.341 INFO:teuthology.orchestra.run.smithi135.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-07-14T12:41:47.383 INFO:teuthology.orchestra.run.smithi135.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.7 MB/s | 560 kB 00:00 2023-07-14T12:41:47.409 INFO:teuthology.orchestra.run.smithi135.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 267 kB/s | 18 kB 00:00 2023-07-14T12:41:47.452 INFO:teuthology.orchestra.run.smithi135.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.8 MB/s | 559 kB 00:00 2023-07-14T12:41:47.485 INFO:teuthology.orchestra.run.smithi135.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2023-07-14T12:41:47.511 INFO:teuthology.orchestra.run.smithi135.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-07-14T12:41:47.536 INFO:teuthology.orchestra.run.smithi135.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-07-14T12:41:47.569 INFO:teuthology.orchestra.run.smithi135.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-07-14T12:41:47.595 INFO:teuthology.orchestra.run.smithi135.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.0 MB/s | 60 kB 00:00 2023-07-14T12:41:47.620 INFO:teuthology.orchestra.run.smithi135.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-07-14T12:41:47.645 INFO:teuthology.orchestra.run.smithi135.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-07-14T12:41:47.696 INFO:teuthology.orchestra.run.smithi135.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 510 kB/s | 39 kB 00:00 2023-07-14T12:41:47.746 INFO:teuthology.orchestra.run.smithi135.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 6.3 MB/s | 644 kB 00:00 2023-07-14T12:41:47.772 INFO:teuthology.orchestra.run.smithi135.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.2 MB/s | 171 kB 00:00 2023-07-14T12:41:47.797 INFO:teuthology.orchestra.run.smithi135.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-07-14T12:41:47.856 INFO:teuthology.orchestra.run.smithi135.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.8 MB/s | 2.3 MB 00:00 2023-07-14T12:41:47.914 INFO:teuthology.orchestra.run.smithi135.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-07-14T12:41:48.348 INFO:teuthology.orchestra.run.smithi135.stdout:(130/131): librados2-18.0.0-4757.g3fc0089c.el8. 6.4 MB/s | 3.7 MB 00:00 2023-07-14T12:41:48.682 INFO:teuthology.orchestra.run.smithi131.stdout:(131/131): ceph-test-18.0.0-4757.g3fc0089c.el8. 2.5 MB/s | 48 MB 00:18 2023-07-14T12:41:48.686 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-07-14T12:41:48.686 INFO:teuthology.orchestra.run.smithi131.stdout:Total 8.0 MB/s | 205 MB 00:25 2023-07-14T12:41:48.715 INFO:teuthology.orchestra.run.smithi135.stdout:(131/131): librbd1-18.0.0-4757.g3fc0089c.el8.x8 3.9 MB/s | 3.6 MB 00:00 2023-07-14T12:41:48.718 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2023-07-14T12:41:48.718 INFO:teuthology.orchestra.run.smithi135.stdout:Total 8.1 MB/s | 205 MB 00:25 2023-07-14T12:41:50.329 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-07-14T12:41:50.355 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2023-07-14T12:41:50.464 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-07-14T12:41:50.464 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-07-14T12:41:50.488 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2023-07-14T12:41:50.489 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2023-07-14T12:41:52.028 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-07-14T12:41:52.032 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-07-14T12:41:52.046 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2023-07-14T12:41:52.050 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2023-07-14T12:41:57.182 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2023-07-14T12:41:57.332 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-07-14T12:41:57.357 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-14T12:41:57.515 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-14T12:41:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-14T12:41:57.718 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-14T12:41:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-14T12:41:57.900 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-14T12:41:58.044 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-14T12:41:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-14T12:41:58.224 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-14T12:41:58.258 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-14T12:41:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-14T12:41:58.624 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-14T12:41:58.722 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-14T12:41:58.958 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T12:41:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-14T12:41:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T12:41:59.412 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T12:41:59.591 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T12:41:59.727 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T12:41:59.750 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T12:41:59.941 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T12:41:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T12:42:00.066 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T12:42:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T12:42:00.246 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/134 2023-07-14T12:42:00.282 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T12:42:00.386 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T12:42:00.482 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-14T12:42:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/134 2023-07-14T12:42:00.754 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-14T12:42:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-14T12:42:01.070 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-14T12:42:01.185 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-14T12:42:01.445 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-14T12:42:01.477 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-14T12:42:01.599 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 14/134 2023-07-14T12:42:01.703 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-14T12:42:01.721 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 14/134 2023-07-14T12:42:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 14/134 2023-07-14T12:42:01.874 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 15/134 2023-07-14T12:42:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 14/134 2023-07-14T12:42:02.011 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 15/134 2023-07-14T12:42:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 15/134 2023-07-14T12:42:02.149 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-14T12:42:02.219 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 15/134 2023-07-14T12:42:02.302 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-14T12:42:02.381 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-14T12:42:02.466 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-14T12:42:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-14T12:42:02.690 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-14T12:42:03.163 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-14T12:42:03.385 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-14T12:42:03.399 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-14T12:42:03.564 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-14T12:42:04.258 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-14T12:42:04.372 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-14T12:42:04.439 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-14T12:42:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-14T12:42:05.263 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-14T12:42:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-14T12:42:05.547 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-14T12:42:05.741 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-14T12:42:05.823 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-14T12:42:05.982 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-14T12:42:06.038 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-14T12:42:06.239 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-14T12:42:06.256 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-14T12:42:06.433 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-14T12:42:06.489 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-14T12:42:06.667 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-14T12:42:06.775 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-14T12:42:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 26/134 2023-07-14T12:42:06.969 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-14T12:42:07.094 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 27/134 2023-07-14T12:42:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 26/134 2023-07-14T12:42:07.287 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 27/134 2023-07-14T12:42:08.146 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 28/134 2023-07-14T12:42:08.329 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 28/134 2023-07-14T12:42:08.500 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-14T12:42:08.688 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-14T12:42:08.787 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-14T12:42:08.956 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-14T12:42:09.070 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-14T12:42:09.263 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-14T12:42:09.270 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-14T12:42:09.457 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-14T12:42:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-14T12:42:11.529 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-14T12:42:11.680 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-14T12:42:11.891 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-14T12:42:11.899 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-14T12:42:12.101 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-14T12:42:12.119 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-14T12:42:12.295 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-14T12:42:12.305 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 36/134 2023-07-14T12:42:12.464 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 36/134 2023-07-14T12:42:12.535 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 37/134 2023-07-14T12:42:12.686 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 37/134 2023-07-14T12:42:12.705 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-14T12:42:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-14T12:42:12.901 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-14T12:42:13.026 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-14T12:42:13.116 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-14T12:42:13.259 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-14T12:42:13.269 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-14T12:42:13.412 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-14T12:42:13.520 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-14T12:42:13.661 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-14T12:42:13.754 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-14T12:42:13.878 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-14T12:42:14.210 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-14T12:42:14.352 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-14T12:42:14.561 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-14T12:42:14.663 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-14T12:42:14.769 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-14T12:42:14.854 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-14T12:42:15.057 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-14T12:42:15.092 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-14T12:42:15.289 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-14T12:42:15.383 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-14T12:42:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-14T12:42:15.700 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-14T12:42:15.889 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-14T12:42:15.907 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-14T12:42:16.057 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-14T12:42:16.101 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-14T12:42:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-14T12:42:16.333 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-14T12:42:16.464 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-14T12:42:16.530 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-14T12:42:16.626 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-14T12:42:16.694 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-14T12:42:16.978 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-14T12:42:17.057 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-14T12:42:17.264 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-14T12:42:17.359 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-14T12:42:17.560 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-14T12:42:17.637 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-14T12:42:17.837 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-14T12:42:17.888 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-14T12:42:18.038 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-14T12:42:18.064 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-14T12:42:18.229 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-14T12:42:18.273 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-14T12:42:18.420 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-14T12:42:18.472 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-14T12:42:18.509 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-14T12:42:18.558 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-14T12:42:18.750 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-14T12:42:18.794 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-14T12:42:18.951 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-14T12:42:19.078 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-14T12:42:19.087 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-14T12:42:19.188 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-14T12:42:19.255 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-14T12:42:19.354 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-14T12:42:19.415 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-14T12:42:19.564 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-14T12:42:19.603 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-14T12:42:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-14T12:42:19.808 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-14T12:42:19.961 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-14T12:42:20.015 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-14T12:42:20.221 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-14T12:42:20.276 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-14T12:42:20.495 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-14T12:42:20.523 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-14T12:42:20.684 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-14T12:42:20.731 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-14T12:42:20.825 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-14T12:42:20.868 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-14T12:42:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-14T12:42:21.068 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-14T12:42:21.261 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-14T12:42:21.261 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-14T12:42:21.461 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-14T12:42:21.462 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-14T12:42:21.666 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-14T12:42:21.696 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-14T12:42:21.811 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-14T12:42:21.875 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-14T12:42:22.037 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-14T12:42:22.038 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-14T12:42:22.278 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-14T12:42:22.286 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-14T12:42:22.469 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-14T12:42:22.543 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-14T12:42:22.752 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-14T12:42:22.777 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-14T12:42:23.008 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-14T12:42:23.021 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-14T12:42:23.230 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-14T12:42:23.305 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-14T12:42:23.461 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-14T12:42:23.489 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-14T12:42:23.720 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-14T12:42:24.799 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-14T12:42:25.083 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-14T12:42:25.130 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-14T12:42:25.399 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-14T12:42:25.400 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-14T12:42:25.693 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-14T12:42:25.800 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-14T12:42:26.114 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-14T12:42:26.140 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-14T12:42:26.349 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-14T12:42:26.407 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-14T12:42:26.690 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-14T12:42:27.211 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-14T12:42:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 92/134 2023-07-14T12:42:27.453 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 92/134 2023-07-14T12:42:27.539 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-14T12:42:27.636 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 93/134 2023-07-14T12:42:27.721 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 92/134 2023-07-14T12:42:27.814 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 92/134 2023-07-14T12:42:28.046 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 93/134 2023-07-14T12:42:32.509 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T12:42:32.761 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T12:42:33.025 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T12:42:33.254 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T12:42:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T12:42:33.955 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T12:42:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 95/134 2023-07-14T12:42:34.795 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 95/134 2023-07-14T12:42:34.901 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 96/134 2023-07-14T12:42:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 95/134 2023-07-14T12:42:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 95/134 2023-07-14T12:42:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 96/134 2023-07-14T12:42:55.349 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 96/134 2023-07-14T12:42:55.350 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2023-07-14T12:42:55.350 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2023-07-14T12:42:55.350 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2023-07-14T12:42:55.351 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /run 2023-07-14T12:42:55.351 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2023-07-14T12:42:55.351 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2023-07-14T12:42:55.351 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2023-07-14T12:42:55.352 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2023-07-14T12:42:55.352 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2023-07-14T12:42:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:42:55.732 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 97/134 2023-07-14T12:42:56.175 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 96/134 2023-07-14T12:42:56.176 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2023-07-14T12:42:56.176 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2023-07-14T12:42:56.177 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-07-14T12:42:56.177 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /run 2023-07-14T12:42:56.177 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2023-07-14T12:42:56.178 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2023-07-14T12:42:56.178 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2023-07-14T12:42:56.178 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2023-07-14T12:42:56.179 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2023-07-14T12:42:56.179 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:42:56.584 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 97/134 2023-07-14T12:42:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 97/134 2023-07-14T12:42:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 98/134 2023-07-14T12:42:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 98/134 2023-07-14T12:42:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 99/134 2023-07-14T12:42:58.307 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 97/134 2023-07-14T12:42:58.503 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 98/134 2023-07-14T12:42:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 99/134 2023-07-14T12:42:58.772 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 98/134 2023-07-14T12:42:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/134 2023-07-14T12:42:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/134 2023-07-14T12:42:58.999 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 99/134 2023-07-14T12:42:59.527 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 99/134 2023-07-14T12:42:59.750 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/134 2023-07-14T12:42:59.792 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/134 2023-07-14T12:43:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 101/134 2023-07-14T12:43:01.789 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 101/134 2023-07-14T12:43:01.922 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 102/134 2023-07-14T12:43:02.152 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 103/134 2023-07-14T12:43:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 104/134 2023-07-14T12:43:02.492 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 101/134 2023-07-14T12:43:02.585 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 104/134 2023-07-14T12:43:02.672 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 101/134 2023-07-14T12:43:02.782 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 102/134 2023-07-14T12:43:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 105/134 2023-07-14T12:43:03.004 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 103/134 2023-07-14T12:43:03.198 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 104/134 2023-07-14T12:43:03.464 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 104/134 2023-07-14T12:43:03.693 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 105/134 2023-07-14T12:43:03.907 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 105/134 2023-07-14T12:43:04.097 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 106/134 2023-07-14T12:43:04.226 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 106/134 2023-07-14T12:43:04.593 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 107/134 2023-07-14T12:43:04.809 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 105/134 2023-07-14T12:43:04.824 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 108/134 2023-07-14T12:43:04.890 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 108/134 2023-07-14T12:43:05.007 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 106/134 2023-07-14T12:43:05.096 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 109/134 2023-07-14T12:43:05.124 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 109/134 2023-07-14T12:43:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 106/134 2023-07-14T12:43:05.517 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 107/134 2023-07-14T12:43:05.789 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 108/134 2023-07-14T12:43:05.854 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 108/134 2023-07-14T12:43:06.031 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 109/134 2023-07-14T12:43:06.060 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 109/134 2023-07-14T12:43:06.514 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 110/134 2023-07-14T12:43:06.725 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 111/134 2023-07-14T12:43:06.792 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 111/134 2023-07-14T12:43:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 112/134 2023-07-14T12:43:07.058 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 112/134 2023-07-14T12:43:07.222 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 113/134 2023-07-14T12:43:07.446 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 110/134 2023-07-14T12:43:07.628 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 113/134 2023-07-14T12:43:07.665 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 111/134 2023-07-14T12:43:07.751 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 111/134 2023-07-14T12:43:07.788 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 114/134 2023-07-14T12:43:07.915 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 112/134 2023-07-14T12:43:07.992 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 112/134 2023-07-14T12:43:08.181 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 113/134 2023-07-14T12:43:08.589 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 113/134 2023-07-14T12:43:08.782 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 114/134 2023-07-14T12:43:12.806 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 114/134 2023-07-14T12:43:13.103 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 115/134 2023-07-14T12:43:13.295 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-14T12:43:13.543 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-14T12:43:13.837 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 114/134 2023-07-14T12:43:14.206 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 115/134 2023-07-14T12:43:14.389 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-14T12:43:14.654 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-14T12:43:14.770 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-14T12:43:15.100 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-14T12:43:15.310 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 119/134 2023-07-14T12:43:15.500 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-14T12:43:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 121/134 2023-07-14T12:43:15.855 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T12:43:15.972 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-14T12:43:16.336 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-14T12:43:16.536 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 119/134 2023-07-14T12:43:16.718 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-14T12:43:16.943 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 121/134 2023-07-14T12:43:17.106 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T12:43:19.172 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T12:43:19.440 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T12:43:19.477 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T12:43:19.704 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 124/134 2023-07-14T12:43:19.904 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 125/134 2023-07-14T12:43:20.257 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 126/134 2023-07-14T12:43:20.409 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T12:43:20.563 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-14T12:43:20.713 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T12:43:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T12:43:20.751 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T12:43:20.767 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T12:43:20.930 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 124/134 2023-07-14T12:43:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-14T12:43:21.173 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 125/134 2023-07-14T12:43:21.185 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-14T12:43:21.298 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-14T12:43:21.519 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-14T12:43:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 126/134 2023-07-14T12:43:21.547 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-14T12:43:21.548 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T12:43:21.759 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T12:43:21.759 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T12:43:21.915 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-14T12:43:22.042 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T12:43:22.104 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T12:43:22.127 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T12:43:22.227 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T12:43:22.356 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-14T12:43:22.477 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T12:43:22.477 INFO:teuthology.orchestra.run.smithi131.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-14T12:43:22.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:43:22.579 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-14T12:43:22.692 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-14T12:43:22.896 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-14T12:43:22.925 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-14T12:43:22.925 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T12:43:23.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 1/134 2023-07-14T12:43:23.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2/134 2023-07-14T12:43:23.100 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 3/134 2023-07-14T12:43:23.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 4/134 2023-07-14T12:43:23.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 5/134 2023-07-14T12:43:23.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T12:43:23.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T12:43:23.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T12:43:23.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/134 2023-07-14T12:43:23.101 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 10/134 2023-07-14T12:43:23.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 11/134 2023-07-14T12:43:23.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 12/134 2023-07-14T12:43:23.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 13/134 2023-07-14T12:43:23.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 14/134 2023-07-14T12:43:23.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 15/134 2023-07-14T12:43:23.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 16/134 2023-07-14T12:43:23.102 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 17/134 2023-07-14T12:43:23.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 18/134 2023-07-14T12:43:23.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 19/134 2023-07-14T12:43:23.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 20/134 2023-07-14T12:43:23.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 21/134 2023-07-14T12:43:23.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 22/134 2023-07-14T12:43:23.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 23/134 2023-07-14T12:43:23.103 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 24/134 2023-07-14T12:43:23.104 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 25/134 2023-07-14T12:43:23.111 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 26/134 2023-07-14T12:43:23.112 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 27/134 2023-07-14T12:43:23.112 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 28/134 2023-07-14T12:43:23.112 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 29/134 2023-07-14T12:43:23.112 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 30/134 2023-07-14T12:43:23.112 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 31/134 2023-07-14T12:43:23.113 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 32/134 2023-07-14T12:43:23.113 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 33/134 2023-07-14T12:43:23.113 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 34/134 2023-07-14T12:43:23.113 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 35/134 2023-07-14T12:43:23.113 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 36/134 2023-07-14T12:43:23.113 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 37/134 2023-07-14T12:43:23.113 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 38/134 2023-07-14T12:43:23.114 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-14T12:43:23.114 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-14T12:43:23.114 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-14T12:43:23.114 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-14T12:43:23.114 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-14T12:43:23.114 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-14T12:43:23.115 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-14T12:43:23.115 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-14T12:43:23.115 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-14T12:43:23.115 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-14T12:43:23.116 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-14T12:43:23.116 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-14T12:43:23.116 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-14T12:43:23.116 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-14T12:43:23.116 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-14T12:43:23.116 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-14T12:43:23.117 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-14T12:43:23.117 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-14T12:43:23.117 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-14T12:43:23.117 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-14T12:43:23.117 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-14T12:43:23.117 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-14T12:43:23.118 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-14T12:43:23.118 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-14T12:43:23.118 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-14T12:43:23.118 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-14T12:43:23.118 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-14T12:43:23.118 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-14T12:43:23.118 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-14T12:43:23.119 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-14T12:43:23.119 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-14T12:43:23.119 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-14T12:43:23.119 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-14T12:43:23.119 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-14T12:43:23.119 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-14T12:43:23.120 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-14T12:43:23.120 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-14T12:43:23.120 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-14T12:43:23.120 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-14T12:43:23.120 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-14T12:43:23.120 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-14T12:43:23.121 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-14T12:43:23.121 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-14T12:43:23.121 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-14T12:43:23.121 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-14T12:43:23.121 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-14T12:43:23.121 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-14T12:43:23.122 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-14T12:43:23.122 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-14T12:43:23.122 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-14T12:43:23.122 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-14T12:43:23.122 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-14T12:43:23.122 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-14T12:43:23.122 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-14T12:43:23.123 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-14T12:43:23.123 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-14T12:43:23.123 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-14T12:43:23.123 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-14T12:43:23.123 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-14T12:43:23.123 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-14T12:43:23.124 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-14T12:43:23.124 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-14T12:43:23.124 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-14T12:43:23.124 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-14T12:43:23.124 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-14T12:43:23.124 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-14T12:43:23.124 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-14T12:43:23.125 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-14T12:43:23.125 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-14T12:43:23.125 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-14T12:43:23.125 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-14T12:43:23.125 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-14T12:43:23.126 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-14T12:43:23.126 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-14T12:43:23.126 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-14T12:43:23.127 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-14T12:43:23.127 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-14T12:43:23.127 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-14T12:43:23.127 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-14T12:43:23.127 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-14T12:43:23.127 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-14T12:43:23.128 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-14T12:43:23.128 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-14T12:43:23.128 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T12:43:23.128 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-14T12:43:23.128 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-14T12:43:23.128 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-14T12:43:23.128 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-14T12:43:23.129 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-14T12:43:23.129 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T12:43:23.129 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 129/134 2023-07-14T12:43:23.129 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-14T12:43:23.129 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 131/134 2023-07-14T12:43:23.129 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T12:43:23.130 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-14T12:43:23.130 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T12:43:23.131 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T12:43:23.402 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T12:43:23.629 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T12:43:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T12:43:23.898 INFO:teuthology.orchestra.run.smithi135.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-14T12:43:23.898 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:43:24.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 1/134 2023-07-14T12:43:24.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2/134 2023-07-14T12:43:24.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 3/134 2023-07-14T12:43:24.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 4/134 2023-07-14T12:43:24.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 5/134 2023-07-14T12:43:24.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T12:43:24.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T12:43:24.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T12:43:24.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/134 2023-07-14T12:43:24.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 10/134 2023-07-14T12:43:24.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 11/134 2023-07-14T12:43:24.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 12/134 2023-07-14T12:43:24.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 13/134 2023-07-14T12:43:24.513 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 14/134 2023-07-14T12:43:24.513 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 15/134 2023-07-14T12:43:24.513 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 16/134 2023-07-14T12:43:24.514 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 17/134 2023-07-14T12:43:24.514 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 18/134 2023-07-14T12:43:24.515 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 19/134 2023-07-14T12:43:24.515 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 20/134 2023-07-14T12:43:24.515 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 21/134 2023-07-14T12:43:24.515 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 22/134 2023-07-14T12:43:24.515 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 23/134 2023-07-14T12:43:24.516 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 24/134 2023-07-14T12:43:24.516 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 25/134 2023-07-14T12:43:24.516 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 26/134 2023-07-14T12:43:24.516 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 27/134 2023-07-14T12:43:24.516 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 28/134 2023-07-14T12:43:24.525 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 29/134 2023-07-14T12:43:24.526 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 30/134 2023-07-14T12:43:24.526 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 31/134 2023-07-14T12:43:24.526 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 32/134 2023-07-14T12:43:24.526 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 33/134 2023-07-14T12:43:24.526 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 34/134 2023-07-14T12:43:24.527 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 35/134 2023-07-14T12:43:24.527 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 36/134 2023-07-14T12:43:24.527 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 37/134 2023-07-14T12:43:24.527 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 38/134 2023-07-14T12:43:24.527 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-14T12:43:24.527 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-14T12:43:24.527 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-14T12:43:24.527 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-14T12:43:24.528 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-14T12:43:24.528 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-14T12:43:24.528 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-14T12:43:24.528 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-14T12:43:24.528 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-14T12:43:24.528 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-14T12:43:24.528 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-14T12:43:24.529 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-14T12:43:24.529 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-14T12:43:24.529 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-14T12:43:24.529 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-14T12:43:24.529 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-14T12:43:24.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-14T12:43:24.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-14T12:43:24.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-14T12:43:24.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-14T12:43:24.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-14T12:43:24.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-14T12:43:24.530 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-14T12:43:24.531 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-14T12:43:24.531 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-14T12:43:24.531 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-14T12:43:24.531 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-14T12:43:24.531 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-14T12:43:24.531 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-14T12:43:24.531 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-14T12:43:24.531 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-14T12:43:24.532 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-14T12:43:24.532 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-14T12:43:24.532 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-14T12:43:24.532 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-14T12:43:24.532 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-14T12:43:24.532 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-14T12:43:24.532 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-14T12:43:24.533 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-14T12:43:24.533 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-14T12:43:24.533 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-14T12:43:24.533 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-14T12:43:24.533 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-14T12:43:24.533 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-14T12:43:24.533 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-14T12:43:24.534 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-14T12:43:24.534 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-14T12:43:24.534 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-14T12:43:24.534 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-14T12:43:24.534 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-14T12:43:24.534 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-14T12:43:24.534 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-14T12:43:24.534 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-14T12:43:24.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-14T12:43:24.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-14T12:43:24.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-14T12:43:24.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-14T12:43:24.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-14T12:43:24.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-14T12:43:24.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-14T12:43:24.535 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-14T12:43:24.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-14T12:43:24.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-14T12:43:24.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-14T12:43:24.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-14T12:43:24.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-14T12:43:24.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-14T12:43:24.536 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-14T12:43:24.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-14T12:43:24.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-14T12:43:24.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-14T12:43:24.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-14T12:43:24.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-14T12:43:24.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-14T12:43:24.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-14T12:43:24.537 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-14T12:43:24.538 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-14T12:43:24.538 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-14T12:43:24.538 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-14T12:43:24.538 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-14T12:43:24.538 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-14T12:43:24.539 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-14T12:43:24.539 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-14T12:43:24.539 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T12:43:24.539 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-14T12:43:24.539 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-14T12:43:24.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-14T12:43:24.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-14T12:43:24.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-14T12:43:24.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T12:43:24.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 129/134 2023-07-14T12:43:24.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-14T12:43:24.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 131/134 2023-07-14T12:43:24.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T12:43:24.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-14T12:43:25.925 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T12:43:25.925 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:15 ago on Fri 14 Jul 2023 12:41:10 PM UTC. 2023-07-14T12:43:27.272 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T12:43:27.273 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:02:16 ago on Fri 14 Jul 2023 12:41:11 PM UTC. 2023-07-14T12:43:30.802 INFO:teuthology.orchestra.run.smithi131.stdout:Installed products updated. 2023-07-14T12:43:31.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:43:31.038 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2023-07-14T12:43:31.038 INFO:teuthology.orchestra.run.smithi131.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-14T12:43:31.038 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.038 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.039 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2023-07-14T12:43:31.039 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-14T12:43:31.039 INFO:teuthology.orchestra.run.smithi131.stdout: automake-1.16.1-7.el8.noarch 2023-07-14T12:43:31.039 INFO:teuthology.orchestra.run.smithi131.stdout: bison-3.0.4-10.el8.x86_64 2023-07-14T12:43:31.039 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.039 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.039 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.040 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.040 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.040 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.040 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.040 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.040 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.040 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.040 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.041 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.042 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.042 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.042 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.042 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.042 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.042 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-14T12:43:31.042 INFO:teuthology.orchestra.run.smithi131.stdout: flex-2.6.1-9.el8.x86_64 2023-07-14T12:43:31.042 INFO:teuthology.orchestra.run.smithi131.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-14T12:43:31.043 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-14T12:43:31.043 INFO:teuthology.orchestra.run.smithi131.stdout: jq-1.6-3.el8.x86_64 2023-07-14T12:43:31.043 INFO:teuthology.orchestra.run.smithi131.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-14T12:43:31.043 INFO:teuthology.orchestra.run.smithi131.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-14T12:43:31.043 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-14T12:43:31.043 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.043 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.044 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.044 INFO:teuthology.orchestra.run.smithi131.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-14T12:43:31.044 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-14T12:43:31.044 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-14T12:43:31.044 INFO:teuthology.orchestra.run.smithi131.stdout: libpq-13.5-1.el8.x86_64 2023-07-14T12:43:31.044 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-14T12:43:31.044 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-14T12:43:31.045 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.045 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.045 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-14T12:43:31.045 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.045 INFO:teuthology.orchestra.run.smithi131.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-14T12:43:31.045 INFO:teuthology.orchestra.run.smithi131.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-14T12:43:31.045 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-14T12:43:31.045 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-14T12:43:31.046 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-14T12:43:31.046 INFO:teuthology.orchestra.run.smithi131.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-14T12:43:31.046 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-14T12:43:31.046 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-14T12:43:31.046 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-14T12:43:31.046 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-14T12:43:31.046 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-14T12:43:31.046 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-14T12:43:31.047 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-14T12:43:31.047 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-14T12:43:31.047 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T12:43:31.047 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T12:43:31.047 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T12:43:31.047 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-14T12:43:31.047 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-14T12:43:31.048 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-14T12:43:31.048 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-14T12:43:31.048 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-14T12:43:31.048 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.048 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.048 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.048 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-14T12:43:31.048 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-14T12:43:31.049 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-14T12:43:31.049 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-14T12:43:31.049 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-14T12:43:31.049 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-14T12:43:31.049 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-14T12:43:31.049 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-14T12:43:31.049 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-14T12:43:31.050 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-14T12:43:31.050 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-14T12:43:31.050 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-14T12:43:31.050 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-14T12:43:31.050 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-14T12:43:31.050 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-14T12:43:31.050 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-14T12:43:31.050 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-14T12:43:31.051 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-14T12:43:31.051 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-14T12:43:31.051 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-14T12:43:31.051 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-14T12:43:31.051 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-14T12:43:31.051 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-2.6-1.el8.noarch 2023-07-14T12:43:31.051 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-14T12:43:31.051 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-14T12:43:31.052 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-14T12:43:31.052 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-14T12:43:31.052 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-14T12:43:31.052 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-14T12:43:31.052 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.052 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.052 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-14T12:43:31.053 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-14T12:43:31.053 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.053 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-14T12:43:31.053 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-14T12:43:31.053 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-14T12:43:31.053 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-14T12:43:31.053 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-14T12:43:31.053 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-14T12:43:31.054 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-14T12:43:31.054 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-14T12:43:31.054 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-14T12:43:31.054 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-14T12:43:31.054 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-14T12:43:31.054 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-14T12:43:31.054 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-14T12:43:31.054 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.055 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.055 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.055 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-14T12:43:31.055 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-14T12:43:31.055 INFO:teuthology.orchestra.run.smithi131.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-14T12:43:31.055 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-14T12:43:31.055 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-14T12:43:31.056 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-14T12:43:31.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-07-14T12:43:31.056 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-07-14T12:43:31.421 DEBUG:teuthology.parallel:result is None 2023-07-14T12:43:31.656 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2023-07-14T12:43:31.878 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:43:31.879 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2023-07-14T12:43:31.879 INFO:teuthology.orchestra.run.smithi135.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-14T12:43:31.879 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.879 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.879 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2023-07-14T12:43:31.879 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-14T12:43:31.879 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.1-7.el8.noarch 2023-07-14T12:43:31.880 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.0.4-10.el8.x86_64 2023-07-14T12:43:31.880 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.880 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.880 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.880 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.880 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.880 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.881 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.881 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.881 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.881 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.881 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.881 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.881 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.882 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.882 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.882 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.882 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.882 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.882 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.882 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.882 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.883 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.883 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:43:31.883 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-14T12:43:31.883 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.1-9.el8.x86_64 2023-07-14T12:43:31.883 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-14T12:43:31.883 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-14T12:43:31.883 INFO:teuthology.orchestra.run.smithi135.stdout: jq-1.6-3.el8.x86_64 2023-07-14T12:43:31.884 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-14T12:43:31.884 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-14T12:43:31.884 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-14T12:43:31.884 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.884 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.884 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.884 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-14T12:43:31.885 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-14T12:43:31.885 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-14T12:43:31.885 INFO:teuthology.orchestra.run.smithi135.stdout: libpq-13.5-1.el8.x86_64 2023-07-14T12:43:31.885 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-14T12:43:31.885 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-14T12:43:31.885 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.885 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.886 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-14T12:43:31.886 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.886 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-14T12:43:31.886 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-14T12:43:31.886 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-14T12:43:31.886 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-14T12:43:31.886 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-14T12:43:31.886 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-14T12:43:31.887 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-14T12:43:31.887 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-14T12:43:31.887 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-14T12:43:31.887 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-14T12:43:31.887 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-14T12:43:31.887 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-14T12:43:31.887 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-14T12:43:31.888 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-14T12:43:31.888 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T12:43:31.888 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T12:43:31.888 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T12:43:31.888 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-14T12:43:31.888 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-14T12:43:31.888 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-14T12:43:31.888 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-14T12:43:31.889 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-14T12:43:31.889 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.889 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.889 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.889 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-14T12:43:31.889 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-14T12:43:31.889 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-14T12:43:31.890 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-14T12:43:31.890 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-14T12:43:31.890 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-14T12:43:31.890 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-14T12:43:31.890 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-14T12:43:31.890 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-14T12:43:31.890 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-14T12:43:31.890 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-14T12:43:31.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-14T12:43:31.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-14T12:43:31.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-14T12:43:31.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-14T12:43:31.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-14T12:43:31.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-14T12:43:31.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-14T12:43:31.891 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-14T12:43:31.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-14T12:43:31.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-14T12:43:31.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-14T12:43:31.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-2.6-1.el8.noarch 2023-07-14T12:43:31.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-14T12:43:31.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-14T12:43:31.892 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-14T12:43:31.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-14T12:43:31.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-14T12:43:31.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-14T12:43:31.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-14T12:43:31.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-14T12:43:31.893 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-14T12:43:31.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-14T12:43:31.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-14T12:43:31.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-14T12:43:31.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-14T12:43:31.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-14T12:43:31.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-14T12:43:31.894 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-14T12:43:31.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-14T12:43:31.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-14T12:43:31.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-14T12:43:31.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-14T12:43:31.895 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-14T12:43:31.895 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.895 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.896 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:43:31.896 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-14T12:43:31.896 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-14T12:43:31.896 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-14T12:43:31.896 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-14T12:43:31.896 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-14T12:43:31.897 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-14T12:43:31.897 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:43:31.897 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2023-07-14T12:43:32.195 DEBUG:teuthology.parallel:result is None 2023-07-14T12:45:27.176 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 59 kB/s | 16 MB 04:31 2023-07-14T12:45:31.459 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 455 kB/s | 24 kB 00:00 2023-07-14T12:45:32.778 INFO:teuthology.orchestra.run.smithi017.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 43 MB/s | 53 MB 00:01 2023-07-14T12:45:41.962 INFO:teuthology.orchestra.run.smithi017.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 47 MB 00:01 2023-07-14T12:45:54.323 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T12:45:54.324 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T12:45:54.340 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-14T12:45:54.341 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-14T12:45:54.342 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-14T12:45:54.344 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-14T12:45:54.346 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-14T12:45:54.350 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-14T12:45:54.351 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-14T12:45:54.499 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2023-07-14T12:45:54.513 INFO:teuthology.orchestra.run.smithi017.stdout:=========================================================================================================================== 2023-07-14T12:45:54.513 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2023-07-14T12:45:54.514 INFO:teuthology.orchestra.run.smithi017.stdout:=========================================================================================================================== 2023-07-14T12:45:54.514 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2023-07-14T12:45:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-14T12:45:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-14T12:45:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.4 k 2023-07-14T12:45:54.514 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 5.4 M 2023-07-14T12:45:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 848 k 2023-07-14T12:45:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 165 k 2023-07-14T12:45:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 1.5 M 2023-07-14T12:45:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 129 k 2023-07-14T12:45:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 1.7 M 2023-07-14T12:45:54.515 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 7.4 M 2023-07-14T12:45:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 47 k 2023-07-14T12:45:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 13 M 2023-07-14T12:45:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 48 M 2023-07-14T12:45:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 258 k 2023-07-14T12:45:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 166 k 2023-07-14T12:45:54.516 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 258 k 2023-07-14T12:45:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 18 k 2023-07-14T12:45:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-14T12:45:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-14T12:45:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-14T12:45:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 31 k 2023-07-14T12:45:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 771 k 2023-07-14T12:45:54.517 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 139 k 2023-07-14T12:45:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-14T12:45:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-14T12:45:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-14T12:45:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-14T12:45:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-14T12:45:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-14T12:45:54.518 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 197 k 2023-07-14T12:45:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 371 k 2023-07-14T12:45:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 364 k 2023-07-14T12:45:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 107 k 2023-07-14T12:45:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 94 k 2023-07-14T12:45:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.4 M 2023-07-14T12:45:54.519 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 179 k 2023-07-14T12:45:54.520 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-14T12:45:54.520 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2023-07-14T12:45:54.520 INFO:teuthology.orchestra.run.smithi017.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-14T12:45:54.520 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.7 M 2023-07-14T12:45:54.520 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 3.6 M 2023-07-14T12:45:54.520 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2023-07-14T12:45:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-14T12:45:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 22 M 2023-07-14T12:45:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 23 k 2023-07-14T12:45:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 2.3 M 2023-07-14T12:45:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 240 k 2023-07-14T12:45:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 4.6 M 2023-07-14T12:45:54.521 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 18 M 2023-07-14T12:45:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4757.g3fc0089c.el8 ceph-noarch 15 k 2023-07-14T12:45:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 24 k 2023-07-14T12:45:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-14T12:45:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-14T12:45:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-14T12:45:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-14T12:45:54.522 INFO:teuthology.orchestra.run.smithi017.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-14T12:45:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 137 k 2023-07-14T12:45:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-14T12:45:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-14T12:45:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-14T12:45:54.523 INFO:teuthology.orchestra.run.smithi017.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-14T12:45:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-14T12:45:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-14T12:45:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 473 k 2023-07-14T12:45:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-14T12:45:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 6.7 M 2023-07-14T12:45:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-14T12:45:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-14T12:45:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-14T12:45:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-14T12:45:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-14T12:45:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-14T12:45:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-14T12:45:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-14T12:45:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-14T12:45:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-14T12:45:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-14T12:45:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-14T12:45:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-14T12:45:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-14T12:45:54.526 INFO:teuthology.orchestra.run.smithi017.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-14T12:45:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-14T12:45:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 45 k 2023-07-14T12:45:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:18.0.0-4757.g3fc0089c.el8 ceph 119 k 2023-07-14T12:45:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-14T12:45:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-14T12:45:54.527 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-14T12:45:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-14T12:45:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-14T12:45:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-14T12:45:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-14T12:45:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-14T12:45:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-14T12:45:54.528 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-14T12:45:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-14T12:45:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T12:45:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-14T12:45:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-14T12:45:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-14T12:45:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-14T12:45:54.529 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-14T12:45:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-14T12:45:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-14T12:45:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-14T12:45:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-14T12:45:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-14T12:45:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-14T12:45:54.530 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-14T12:45:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-14T12:45:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-14T12:45:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-14T12:45:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-14T12:45:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-14T12:45:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-14T12:45:54.531 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T12:45:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-14T12:45:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-14T12:45:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-14T12:45:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-14T12:45:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-14T12:45:54.532 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-14T12:45:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-14T12:45:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-14T12:45:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-14T12:45:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-14T12:45:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-14T12:45:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-14T12:45:54.533 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-14T12:45:54.534 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-14T12:45:54.534 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-14T12:45:54.534 INFO:teuthology.orchestra.run.smithi017.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-14T12:45:54.534 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-14T12:45:54.534 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-14T12:45:54.534 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling module streams: 2023-07-14T12:45:54.535 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql 10 2023-07-14T12:45:54.535 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:45:54.535 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2023-07-14T12:45:54.535 INFO:teuthology.orchestra.run.smithi017.stdout:=========================================================================================================================== 2023-07-14T12:45:54.535 INFO:teuthology.orchestra.run.smithi017.stdout:Install 128 Packages 2023-07-14T12:45:54.536 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 3 Packages 2023-07-14T12:45:54.536 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:45:54.537 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 205 M 2023-07-14T12:45:54.537 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2023-07-14T12:45:55.263 INFO:teuthology.orchestra.run.smithi017.stdout:(1/131): ceph-18.0.0-4757.g3fc0089c.el8.x86_64. 32 kB/s | 6.4 kB 00:00 2023-07-14T12:45:55.921 INFO:teuthology.orchestra.run.smithi017.stdout:(2/131): ceph-fuse-18.0.0-4757.g3fc0089c.el8.x8 1.3 MB/s | 848 kB 00:00 2023-07-14T12:45:56.055 INFO:teuthology.orchestra.run.smithi017.stdout:(3/131): ceph-immutable-object-cache-18.0.0-475 1.2 MB/s | 165 kB 00:00 2023-07-14T12:45:56.847 INFO:teuthology.orchestra.run.smithi017.stdout:(4/131): ceph-mds-18.0.0-4757.g3fc0089c.el8.x86 2.9 MB/s | 2.3 MB 00:00 2023-07-14T12:45:57.147 INFO:teuthology.orchestra.run.smithi017.stdout:(5/131): ceph-base-18.0.0-4757.g3fc0089c.el8.x8 2.6 MB/s | 5.4 MB 00:02 2023-07-14T12:45:57.331 INFO:teuthology.orchestra.run.smithi017.stdout:(6/131): ceph-mgr-18.0.0-4757.g3fc0089c.el8.x86 3.2 MB/s | 1.5 MB 00:00 2023-07-14T12:45:58.014 INFO:teuthology.orchestra.run.smithi017.stdout:(7/131): ceph-mon-18.0.0-4757.g3fc0089c.el8.x86 5.3 MB/s | 4.6 MB 00:00 2023-07-14T12:45:59.957 INFO:teuthology.orchestra.run.smithi017.stdout:(8/131): ceph-common-18.0.0-4757.g3fc0089c.el8. 4.5 MB/s | 22 MB 00:04 2023-07-14T12:46:00.040 INFO:teuthology.orchestra.run.smithi017.stdout:(9/131): ceph-selinux-18.0.0-4757.g3fc0089c.el8 293 kB/s | 24 kB 00:00 2023-07-14T12:46:00.690 INFO:teuthology.orchestra.run.smithi017.stdout:(10/131): ceph-radosgw-18.0.0-4757.g3fc0089c.el 5.0 MB/s | 13 MB 00:02 2023-07-14T12:46:00.807 INFO:teuthology.orchestra.run.smithi017.stdout:(11/131): cephfs-mirror-18.0.0-4757.g3fc0089c.e 2.2 MB/s | 258 kB 00:00 2023-07-14T12:46:00.899 INFO:teuthology.orchestra.run.smithi017.stdout:(12/131): libcephfs-devel-18.0.0-4757.g3fc0089c 338 kB/s | 31 kB 00:00 2023-07-14T12:46:01.066 INFO:teuthology.orchestra.run.smithi017.stdout:(13/131): libcephfs2-18.0.0-4757.g3fc0089c.el8. 4.5 MB/s | 771 kB 00:00 2023-07-14T12:46:01.267 INFO:teuthology.orchestra.run.smithi017.stdout:(14/131): ceph-osd-18.0.0-4757.g3fc0089c.el8.x8 4.5 MB/s | 18 MB 00:03 2023-07-14T12:46:01.283 INFO:teuthology.orchestra.run.smithi017.stdout:(15/131): libcephsqlite-18.0.0-4757.g3fc0089c.e 632 kB/s | 137 kB 00:00 2023-07-14T12:46:01.350 INFO:teuthology.orchestra.run.smithi017.stdout:(16/131): librados-devel-18.0.0-4757.g3fc0089c. 1.6 MB/s | 139 kB 00:00 2023-07-14T12:46:01.459 INFO:teuthology.orchestra.run.smithi017.stdout:(17/131): libradosstriper1-18.0.0-4757.g3fc0089 2.6 MB/s | 473 kB 00:00 2023-07-14T12:46:01.667 INFO:teuthology.orchestra.run.smithi017.stdout:(18/131): python3-ceph-argparse-18.0.0-4757.g3f 215 kB/s | 45 kB 00:00 2023-07-14T12:46:01.768 INFO:teuthology.orchestra.run.smithi017.stdout:(19/131): python3-ceph-common-18.0.0-4757.g3fc0 1.2 MB/s | 119 kB 00:00 2023-07-14T12:46:01.851 INFO:teuthology.orchestra.run.smithi017.stdout:(20/131): python3-cephfs-18.0.0-4757.g3fc0089c. 2.3 MB/s | 197 kB 00:00 2023-07-14T12:46:01.943 INFO:teuthology.orchestra.run.smithi017.stdout:(21/131): python3-rados-18.0.0-4757.g3fc0089c.e 4.0 MB/s | 371 kB 00:00 2023-07-14T12:46:02.352 INFO:teuthology.orchestra.run.smithi017.stdout:(22/131): python3-rbd-18.0.0-4757.g3fc0089c.el8 893 kB/s | 364 kB 00:00 2023-07-14T12:46:02.435 INFO:teuthology.orchestra.run.smithi017.stdout:(23/131): python3-rgw-18.0.0-4757.g3fc0089c.el8 1.3 MB/s | 107 kB 00:00 2023-07-14T12:46:02.527 INFO:teuthology.orchestra.run.smithi017.stdout:(24/131): rbd-fuse-18.0.0-4757.g3fc0089c.el8.x8 1.0 MB/s | 94 kB 00:00 2023-07-14T12:46:03.161 INFO:teuthology.orchestra.run.smithi017.stdout:(25/131): librgw2-18.0.0-4757.g3fc0089c.el8.x86 3.7 MB/s | 6.7 MB 00:01 2023-07-14T12:46:03.245 INFO:teuthology.orchestra.run.smithi017.stdout:(26/131): rbd-nbd-18.0.0-4757.g3fc0089c.el8.x86 2.1 MB/s | 179 kB 00:00 2023-07-14T12:46:03.353 INFO:teuthology.orchestra.run.smithi017.stdout:(27/131): rbd-mirror-18.0.0-4757.g3fc0089c.el8. 4.2 MB/s | 3.4 MB 00:00 2023-07-14T12:46:03.370 INFO:teuthology.orchestra.run.smithi017.stdout:(28/131): ceph-grafana-dashboards-18.0.0-4757.g 184 kB/s | 23 kB 00:00 2023-07-14T12:46:03.445 INFO:teuthology.orchestra.run.smithi017.stdout:(29/131): ceph-mgr-cephadm-18.0.0-4757.g3fc0089 1.4 MB/s | 129 kB 00:00 2023-07-14T12:46:03.854 INFO:teuthology.orchestra.run.smithi017.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4757.g3fc00 3.5 MB/s | 1.7 MB 00:00 2023-07-14T12:46:03.946 INFO:teuthology.orchestra.run.smithi017.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4757.g3f 2.6 MB/s | 240 kB 00:00 2023-07-14T12:46:04.046 INFO:teuthology.orchestra.run.smithi017.stdout:(32/131): ceph-mgr-rook-18.0.0-4757.g3fc0089c.e 475 kB/s | 47 kB 00:00 2023-07-14T12:46:04.146 INFO:teuthology.orchestra.run.smithi017.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4757.g3 146 kB/s | 15 kB 00:00 2023-07-14T12:46:04.255 INFO:teuthology.orchestra.run.smithi017.stdout:(34/131): ceph-volume-18.0.0-4757.g3fc0089c.el8 2.3 MB/s | 258 kB 00:00 2023-07-14T12:46:04.347 INFO:teuthology.orchestra.run.smithi017.stdout:(35/131): cephadm-18.0.0-4757.g3fc0089c.el8.noa 1.8 MB/s | 166 kB 00:00 2023-07-14T12:46:04.439 INFO:teuthology.orchestra.run.smithi017.stdout:(36/131): cephfs-top-18.0.0-4757.g3fc0089c.el8. 195 kB/s | 18 kB 00:00 2023-07-14T12:46:04.881 INFO:teuthology.orchestra.run.smithi017.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 694 kB/s | 306 kB 00:00 2023-07-14T12:46:05.030 INFO:teuthology.orchestra.run.smithi017.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 397 kB/s | 59 kB 00:00 2023-07-14T12:46:05.140 INFO:teuthology.orchestra.run.smithi017.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 684 kB/s | 75 kB 00:00 2023-07-14T12:46:05.307 INFO:teuthology.orchestra.run.smithi017.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.8 MB/s | 476 kB 00:00 2023-07-14T12:46:05.399 INFO:teuthology.orchestra.run.smithi017.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 477 kB/s | 44 kB 00:00 2023-07-14T12:46:05.524 INFO:teuthology.orchestra.run.smithi017.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-07-14T12:46:05.641 INFO:teuthology.orchestra.run.smithi017.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 283 kB/s | 33 kB 00:00 2023-07-14T12:46:05.750 INFO:teuthology.orchestra.run.smithi017.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-07-14T12:46:05.925 INFO:teuthology.orchestra.run.smithi017.stdout:(45/131): ceph-mgr-diskprediction-local-18.0.0- 3.0 MB/s | 7.4 MB 00:02 2023-07-14T12:46:05.981 INFO:teuthology.orchestra.run.smithi017.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 749 kB/s | 173 kB 00:00 2023-07-14T12:46:06.101 INFO:teuthology.orchestra.run.smithi017.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 680 kB/s | 81 kB 00:00 2023-07-14T12:46:06.193 INFO:teuthology.orchestra.run.smithi017.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-07-14T12:46:06.285 INFO:teuthology.orchestra.run.smithi017.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 192 kB/s | 18 kB 00:00 2023-07-14T12:46:06.527 INFO:teuthology.orchestra.run.smithi017.stdout:(50/131): python3-cherrypy-18.4.0-1.el8.noarch. 640 kB/s | 384 kB 00:00 2023-07-14T12:46:06.569 INFO:teuthology.orchestra.run.smithi017.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 4.1 MB/s | 1.2 MB 00:00 2023-07-14T12:46:06.594 INFO:teuthology.orchestra.run.smithi017.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 733 kB/s | 49 kB 00:00 2023-07-14T12:46:06.636 INFO:teuthology.orchestra.run.smithi017.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 880 kB/s | 59 kB 00:00 2023-07-14T12:46:06.678 INFO:teuthology.orchestra.run.smithi017.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 721 kB/s | 60 kB 00:00 2023-07-14T12:46:06.728 INFO:teuthology.orchestra.run.smithi017.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-07-14T12:46:06.770 INFO:teuthology.orchestra.run.smithi017.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-07-14T12:46:06.829 INFO:teuthology.orchestra.run.smithi017.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 335 kB/s | 34 kB 00:00 2023-07-14T12:46:06.913 INFO:teuthology.orchestra.run.smithi017.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2023-07-14T12:46:06.946 INFO:teuthology.orchestra.run.smithi017.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 527 kB/s | 61 kB 00:00 2023-07-14T12:46:07.013 INFO:teuthology.orchestra.run.smithi017.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 188 kB/s | 19 kB 00:00 2023-07-14T12:46:07.105 INFO:teuthology.orchestra.run.smithi017.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 320 kB/s | 29 kB 00:00 2023-07-14T12:46:07.172 INFO:teuthology.orchestra.run.smithi017.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 413 kB/s | 27 kB 00:00 2023-07-14T12:46:07.197 INFO:teuthology.orchestra.run.smithi017.stdout:(63/131): python3-singledispatch-3.4.0.3-18.el8 95 kB/s | 24 kB 00:00 2023-07-14T12:46:07.281 INFO:teuthology.orchestra.run.smithi017.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-07-14T12:46:07.323 INFO:teuthology.orchestra.run.smithi017.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-07-14T12:46:07.406 INFO:teuthology.orchestra.run.smithi017.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 489 kB/s | 61 kB 00:00 2023-07-14T12:46:07.432 INFO:teuthology.orchestra.run.smithi017.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 787 kB/s | 85 kB 00:00 2023-07-14T12:46:07.482 INFO:teuthology.orchestra.run.smithi017.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2023-07-14T12:46:07.499 INFO:teuthology.orchestra.run.smithi017.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.2 MB/s | 70 kB 00:00 2023-07-14T12:46:07.558 INFO:teuthology.orchestra.run.smithi017.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 805 kB/s | 47 kB 00:00 2023-07-14T12:46:07.600 INFO:teuthology.orchestra.run.smithi017.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-07-14T12:46:07.642 INFO:teuthology.orchestra.run.smithi017.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-07-14T12:46:07.684 INFO:teuthology.orchestra.run.smithi017.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-07-14T12:46:07.725 INFO:teuthology.orchestra.run.smithi017.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 5.9 MB/s | 1.7 MB 00:00 2023-07-14T12:46:07.751 INFO:teuthology.orchestra.run.smithi017.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 722 kB/s | 48 kB 00:00 2023-07-14T12:46:07.801 INFO:teuthology.orchestra.run.smithi017.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-07-14T12:46:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 681 kB/s | 87 kB 00:00 2023-07-14T12:46:07.885 INFO:teuthology.orchestra.run.smithi017.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2023-07-14T12:46:07.918 INFO:teuthology.orchestra.run.smithi017.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.5 MB/s | 229 kB 00:00 2023-07-14T12:46:08.069 INFO:teuthology.orchestra.run.smithi017.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.0 MB/s | 560 kB 00:00 2023-07-14T12:46:08.094 INFO:teuthology.orchestra.run.smithi017.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 107 kB/s | 19 kB 00:00 2023-07-14T12:46:08.119 INFO:teuthology.orchestra.run.smithi017.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-07-14T12:46:08.153 INFO:teuthology.orchestra.run.smithi017.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.3 MB/s | 559 kB 00:00 2023-07-14T12:46:08.178 INFO:teuthology.orchestra.run.smithi017.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 306 kB/s | 18 kB 00:00 2023-07-14T12:46:08.220 INFO:teuthology.orchestra.run.smithi017.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.9 MB/s | 605 kB 00:00 2023-07-14T12:46:08.254 INFO:teuthology.orchestra.run.smithi017.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2023-07-14T12:46:08.324 INFO:teuthology.orchestra.run.smithi017.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.0 MB/s | 72 kB 00:00 2023-07-14T12:46:08.371 INFO:teuthology.orchestra.run.smithi017.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.7 MB/s | 83 kB 00:00 2023-07-14T12:46:08.421 INFO:teuthology.orchestra.run.smithi017.stdout:(89/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 12 MB/s | 2.3 MB 00:00 2023-07-14T12:46:08.447 INFO:teuthology.orchestra.run.smithi017.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 796 kB/s | 60 kB 00:00 2023-07-14T12:46:08.472 INFO:teuthology.orchestra.run.smithi017.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-07-14T12:46:08.497 INFO:teuthology.orchestra.run.smithi017.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-07-14T12:46:08.515 INFO:teuthology.orchestra.run.smithi017.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 913 kB/s | 39 kB 00:00 2023-07-14T12:46:08.565 INFO:teuthology.orchestra.run.smithi017.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-07-14T12:46:08.590 INFO:teuthology.orchestra.run.smithi017.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.2 MB/s | 171 kB 00:00 2023-07-14T12:46:08.615 INFO:teuthology.orchestra.run.smithi017.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-07-14T12:46:08.657 INFO:teuthology.orchestra.run.smithi017.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-07-14T12:46:08.691 INFO:teuthology.orchestra.run.smithi017.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-07-14T12:46:08.732 INFO:teuthology.orchestra.run.smithi017.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-07-14T12:46:08.825 INFO:teuthology.orchestra.run.smithi017.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2023-07-14T12:46:08.858 INFO:teuthology.orchestra.run.smithi017.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-07-14T12:46:08.917 INFO:teuthology.orchestra.run.smithi017.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-07-14T12:46:08.967 INFO:teuthology.orchestra.run.smithi017.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 11 MB/s | 538 kB 00:00 2023-07-14T12:46:09.000 INFO:teuthology.orchestra.run.smithi017.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 4.7 MB/s | 157 kB 00:00 2023-07-14T12:46:09.043 INFO:teuthology.orchestra.run.smithi017.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-07-14T12:46:09.126 INFO:teuthology.orchestra.run.smithi017.stdout:(106/131): automake-1.16.1-7.el8.noarch.rpm 8.4 MB/s | 713 kB 00:00 2023-07-14T12:46:09.368 INFO:teuthology.orchestra.run.smithi017.stdout:(107/131): python3-scipy-1.0.0-21.module+el8.5. 18 MB/s | 14 MB 00:00 2023-07-14T12:46:09.402 INFO:teuthology.orchestra.run.smithi017.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 809 kB/s | 27 kB 00:00 2023-07-14T12:46:09.444 INFO:teuthology.orchestra.run.smithi017.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-14T12:46:09.511 INFO:teuthology.orchestra.run.smithi017.stdout:(110/131): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2023-07-14T12:46:09.536 INFO:teuthology.orchestra.run.smithi017.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 479 kB/s | 44 kB 00:00 2023-07-14T12:46:09.586 INFO:teuthology.orchestra.run.smithi017.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-07-14T12:46:09.628 INFO:teuthology.orchestra.run.smithi017.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-07-14T12:46:09.670 INFO:teuthology.orchestra.run.smithi017.stdout:(114/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-07-14T12:46:09.737 INFO:teuthology.orchestra.run.smithi017.stdout:(115/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-07-14T12:46:09.762 INFO:teuthology.orchestra.run.smithi017.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.3 MB/s | 126 kB 00:00 2023-07-14T12:46:09.787 INFO:teuthology.orchestra.run.smithi017.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 400 kB/s | 20 kB 00:00 2023-07-14T12:46:09.847 INFO:teuthology.orchestra.run.smithi017.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.2 MB/s | 103 kB 00:00 2023-07-14T12:46:09.896 INFO:teuthology.orchestra.run.smithi017.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 6.4 MB/s | 709 kB 00:00 2023-07-14T12:46:09.939 INFO:teuthology.orchestra.run.smithi017.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-07-14T12:46:10.406 INFO:teuthology.orchestra.run.smithi017.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 8.7 MB/s | 4.9 MB 00:00 2023-07-14T12:46:10.448 INFO:teuthology.orchestra.run.smithi017.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-14T12:46:10.531 INFO:teuthology.orchestra.run.smithi017.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 8.0 MB/s | 4.7 MB 00:00 2023-07-14T12:46:10.557 INFO:teuthology.orchestra.run.smithi017.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-07-14T12:46:10.623 INFO:teuthology.orchestra.run.smithi017.stdout:(125/131): postgresql-contrib-10.21-2.module+el 12 MB/s | 808 kB 00:00 2023-07-14T12:46:10.707 INFO:teuthology.orchestra.run.smithi017.stdout:(126/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-07-14T12:46:10.824 INFO:teuthology.orchestra.run.smithi017.stdout:(127/131): postgresql-server-10.21-2.module+el8 17 MB/s | 5.1 MB 00:00 2023-07-14T12:46:12.166 INFO:teuthology.orchestra.run.smithi017.stdout:(128/131): librbd1-18.0.0-4757.g3fc0089c.el8.x8 2.7 MB/s | 3.6 MB 00:01 2023-07-14T12:46:12.241 INFO:teuthology.orchestra.run.smithi017.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 10 MB/s | 798 kB 00:00 2023-07-14T12:46:12.574 INFO:teuthology.orchestra.run.smithi017.stdout:(130/131): librados2-18.0.0-4757.g3fc0089c.el8. 2.0 MB/s | 3.7 MB 00:01 2023-07-14T12:46:28.391 INFO:teuthology.orchestra.run.smithi017.stdout:(131/131): ceph-test-18.0.0-4757.g3fc0089c.el8. 1.7 MB/s | 48 MB 00:28 2023-07-14T12:46:28.394 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2023-07-14T12:46:28.394 INFO:teuthology.orchestra.run.smithi017.stdout:Total 6.1 MB/s | 205 MB 00:33 2023-07-14T12:46:30.079 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2023-07-14T12:46:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2023-07-14T12:46:30.224 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2023-07-14T12:46:31.822 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2023-07-14T12:46:31.827 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2023-07-14T12:46:36.897 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2023-07-14T12:46:37.100 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-14T12:46:37.288 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-14T12:46:37.472 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-14T12:46:37.624 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-14T12:46:37.843 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-14T12:46:38.369 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-14T12:46:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 5/134 2023-07-14T12:46:39.076 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 5/134 2023-07-14T12:46:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T12:46:39.394 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T12:46:39.585 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T12:46:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T12:46:39.924 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T12:46:40.098 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-07-14T12:46:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-14T12:46:40.591 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-14T12:46:41.033 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-14T12:46:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-14T12:46:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 14/134 2023-07-14T12:46:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 14/134 2023-07-14T12:46:41.743 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 15/134 2023-07-14T12:46:41.927 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 15/134 2023-07-14T12:46:42.150 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-07-14T12:46:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-07-14T12:46:42.548 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-07-14T12:46:42.734 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-14T12:46:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-14T12:46:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-14T12:46:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-14T12:46:44.026 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-14T12:46:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-14T12:46:44.942 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-07-14T12:46:45.808 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-07-14T12:46:46.067 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-07-14T12:46:46.283 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-07-14T12:46:46.567 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-14T12:46:46.733 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 26/134 2023-07-14T12:46:46.874 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 27/134 2023-07-14T12:46:47.159 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 28/134 2023-07-14T12:46:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-14T12:46:49.524 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-14T12:46:50.719 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-07-14T12:46:51.097 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-07-14T12:46:51.395 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-07-14T12:46:51.620 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-07-14T12:46:51.865 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-14T12:46:52.050 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-14T12:46:52.267 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 36/134 2023-07-14T12:46:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 37/134 2023-07-14T12:46:52.613 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-07-14T12:46:52.805 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-07-14T12:46:52.975 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-07-14T12:46:53.063 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-07-14T12:46:53.359 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-07-14T12:46:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-07-14T12:46:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-14T12:46:53.917 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-14T12:46:54.180 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-07-14T12:46:54.330 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-07-14T12:46:54.493 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-07-14T12:46:54.720 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-07-14T12:46:54.878 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-07-14T12:46:55.082 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-07-14T12:46:55.301 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-07-14T12:46:55.527 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-07-14T12:46:55.945 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-07-14T12:46:56.291 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-07-14T12:46:56.551 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-07-14T12:46:56.795 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-07-14T12:46:57.071 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-07-14T12:46:57.405 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-07-14T12:46:57.618 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-07-14T12:46:57.812 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-07-14T12:46:58.045 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-07-14T12:46:58.216 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-07-14T12:46:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-07-14T12:46:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-07-14T12:46:59.102 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-07-14T12:46:59.393 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-07-14T12:46:59.645 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-07-14T12:46:59.860 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-14T12:47:00.052 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-14T12:47:00.360 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-14T12:47:00.583 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-14T12:47:00.772 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-14T12:47:00.922 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-14T12:47:01.119 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-14T12:47:01.689 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-14T12:47:01.893 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-14T12:47:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-14T12:47:02.232 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-14T12:47:02.472 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-14T12:47:02.723 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-14T12:47:02.924 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-14T12:47:03.248 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-14T12:47:03.459 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-14T12:47:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-14T12:47:03.906 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-14T12:47:05.331 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-14T12:47:05.655 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-14T12:47:05.914 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-14T12:47:06.307 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-14T12:47:06.616 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-14T12:47:06.824 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-14T12:47:07.798 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-14T12:47:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 92/134 2023-07-14T12:47:08.098 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 92/134 2023-07-14T12:47:08.265 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 93/134 2023-07-14T12:47:13.359 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T12:47:13.607 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T12:47:14.333 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 94/134 2023-07-14T12:47:14.633 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 95/134 2023-07-14T12:47:14.782 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 95/134 2023-07-14T12:47:14.923 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 96/134 2023-07-14T12:47:36.071 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 96/134 2023-07-14T12:47:36.071 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2023-07-14T12:47:36.072 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2023-07-14T12:47:36.072 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /dev 2023-07-14T12:47:36.072 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /run 2023-07-14T12:47:36.072 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2023-07-14T12:47:36.072 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2023-07-14T12:47:36.072 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2023-07-14T12:47:36.072 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2023-07-14T12:47:36.073 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /dev 2023-07-14T12:47:36.073 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:47:36.480 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 97/134 2023-07-14T12:47:38.323 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 97/134 2023-07-14T12:47:38.505 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 98/134 2023-07-14T12:47:38.790 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 98/134 2023-07-14T12:47:39.004 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 99/134 2023-07-14T12:47:39.567 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 99/134 2023-07-14T12:47:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/134 2023-07-14T12:47:39.805 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 100/134 2023-07-14T12:47:42.815 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 101/134 2023-07-14T12:47:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 101/134 2023-07-14T12:47:43.137 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 102/134 2023-07-14T12:47:43.343 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 103/134 2023-07-14T12:47:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 104/134 2023-07-14T12:47:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 104/134 2023-07-14T12:47:44.062 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 105/134 2023-07-14T12:47:45.251 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 105/134 2023-07-14T12:47:45.570 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 106/134 2023-07-14T12:47:45.705 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 106/134 2023-07-14T12:47:46.115 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 107/134 2023-07-14T12:47:46.309 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 108/134 2023-07-14T12:47:46.376 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 108/134 2023-07-14T12:47:46.536 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 109/134 2023-07-14T12:47:46.565 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 109/134 2023-07-14T12:47:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 110/134 2023-07-14T12:47:48.288 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 111/134 2023-07-14T12:47:48.368 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 111/134 2023-07-14T12:47:48.520 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 112/134 2023-07-14T12:47:48.601 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 112/134 2023-07-14T12:47:48.811 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 113/134 2023-07-14T12:47:49.245 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 113/134 2023-07-14T12:47:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 114/134 2023-07-14T12:47:54.808 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 114/134 2023-07-14T12:47:56.135 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 115/134 2023-07-14T12:47:56.495 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-07-14T12:47:56.717 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 117/134 2023-07-14T12:47:56.982 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-07-14T12:47:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-07-14T12:47:57.432 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-07-14T12:47:57.791 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-07-14T12:47:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 121/134 2023-07-14T12:47:58.137 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T12:48:01.735 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T12:48:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T12:48:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T12:48:02.245 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 124/134 2023-07-14T12:48:02.479 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 125/134 2023-07-14T12:48:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 126/134 2023-07-14T12:48:03.168 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-14T12:48:03.334 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-07-14T12:48:03.445 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-07-14T12:48:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-07-14T12:48:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-07-14T12:48:03.893 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-14T12:48:03.916 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-14T12:48:04.080 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-07-14T12:48:04.081 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T12:48:04.291 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T12:48:04.292 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T12:48:04.550 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T12:48:04.961 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T12:48:05.252 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T12:48:05.252 INFO:teuthology.orchestra.run.smithi017.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-14T12:48:05.253 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:48:05.923 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 1/134 2023-07-14T12:48:05.923 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2/134 2023-07-14T12:48:05.923 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 3/134 2023-07-14T12:48:05.923 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 4/134 2023-07-14T12:48:05.923 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4757.g3fc00 5/134 2023-07-14T12:48:05.923 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 6/134 2023-07-14T12:48:05.924 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 7/134 2023-07-14T12:48:05.924 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 8/134 2023-07-14T12:48:05.924 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 9/134 2023-07-14T12:48:05.924 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 10/134 2023-07-14T12:48:05.924 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 11/134 2023-07-14T12:48:05.924 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 12/134 2023-07-14T12:48:05.924 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 13/134 2023-07-14T12:48:05.925 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_ 14/134 2023-07-14T12:48:05.925 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 15/134 2023-07-14T12:48:05.926 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 16/134 2023-07-14T12:48:05.926 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_6 17/134 2023-07-14T12:48:05.926 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86 18/134 2023-07-14T12:48:05.926 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 19/134 2023-07-14T12:48:05.926 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el 20/134 2023-07-14T12:48:05.927 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8. 21/134 2023-07-14T12:48:05.927 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_6 22/134 2023-07-14T12:48:05.927 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 23/134 2023-07-14T12:48:05.927 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 24/134 2023-07-14T12:48:05.927 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 25/134 2023-07-14T12:48:05.927 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 26/134 2023-07-14T12:48:05.934 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 27/134 2023-07-14T12:48:05.934 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 28/134 2023-07-14T12:48:05.934 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c. 29/134 2023-07-14T12:48:05.935 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noa 30/134 2023-07-14T12:48:05.935 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.n 31/134 2023-07-14T12:48:05.935 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc 32/134 2023-07-14T12:48:05.935 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el 33/134 2023-07-14T12:48:05.935 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 34/134 2023-07-14T12:48:05.935 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.e 35/134 2023-07-14T12:48:05.935 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 36/134 2023-07-14T12:48:05.936 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 37/134 2023-07-14T12:48:05.936 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 38/134 2023-07-14T12:48:05.936 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-14T12:48:05.936 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-14T12:48:05.936 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-14T12:48:05.936 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-14T12:48:05.936 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-14T12:48:05.936 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-14T12:48:05.937 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-14T12:48:05.937 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-14T12:48:05.937 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-14T12:48:05.937 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-14T12:48:05.937 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-14T12:48:05.937 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-14T12:48:05.937 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-14T12:48:05.938 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-14T12:48:05.938 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-14T12:48:05.938 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-14T12:48:05.938 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-14T12:48:05.938 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-14T12:48:05.938 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-14T12:48:05.938 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-14T12:48:05.938 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-14T12:48:05.939 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-14T12:48:05.939 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-14T12:48:05.939 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-14T12:48:05.939 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-14T12:48:05.939 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-14T12:48:05.939 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-14T12:48:05.939 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-14T12:48:05.939 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-14T12:48:05.940 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-14T12:48:05.940 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-14T12:48:05.940 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-14T12:48:05.940 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-14T12:48:05.940 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-07-14T12:48:05.940 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-07-14T12:48:05.940 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-07-14T12:48:05.941 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-07-14T12:48:05.941 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-07-14T12:48:05.941 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-07-14T12:48:05.941 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-07-14T12:48:05.941 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-07-14T12:48:05.941 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-07-14T12:48:05.941 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-07-14T12:48:05.941 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-07-14T12:48:05.942 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-07-14T12:48:05.942 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-07-14T12:48:05.942 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-07-14T12:48:05.942 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-07-14T12:48:05.942 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-07-14T12:48:05.942 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-07-14T12:48:05.942 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-07-14T12:48:05.943 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-07-14T12:48:05.943 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-07-14T12:48:05.943 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-07-14T12:48:05.943 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-07-14T12:48:05.943 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-07-14T12:48:05.943 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-07-14T12:48:05.943 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-07-14T12:48:05.943 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-07-14T12:48:05.944 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-07-14T12:48:05.944 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-07-14T12:48:05.944 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-07-14T12:48:05.944 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-07-14T12:48:05.944 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-07-14T12:48:05.944 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-07-14T12:48:05.944 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-07-14T12:48:05.945 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-07-14T12:48:05.945 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-07-14T12:48:05.945 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-07-14T12:48:05.945 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-07-14T12:48:05.945 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-07-14T12:48:05.945 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-07-14T12:48:05.945 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-07-14T12:48:05.945 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-07-14T12:48:05.946 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-07-14T12:48:05.946 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-07-14T12:48:05.946 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-07-14T12:48:05.946 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-07-14T12:48:05.946 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-07-14T12:48:05.946 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-07-14T12:48:05.946 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-07-14T12:48:05.946 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-07-14T12:48:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-07-14T12:48:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-07-14T12:48:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-07-14T12:48:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-07-14T12:48:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-07-14T12:48:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-07-14T12:48:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-07-14T12:48:05.947 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-07-14T12:48:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 129/134 2023-07-14T12:48:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-14T12:48:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 131/134 2023-07-14T12:48:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T12:48:05.948 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-14T12:48:08.658 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T12:48:08.658 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:02:27 ago on Fri 14 Jul 2023 12:45:41 PM UTC. 2023-07-14T12:48:11.386 INFO:teuthology.orchestra.run.smithi017.stdout:Installed products updated. 2023-07-14T12:48:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:48:11.627 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2023-07-14T12:48:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-14T12:48:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.628 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2023-07-14T12:48:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-14T12:48:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.1-7.el8.noarch 2023-07-14T12:48:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.0.4-10.el8.x86_64 2023-07-14T12:48:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:48:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:48:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:48:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:48:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:48:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:48:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:48:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:48:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:48:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:18.0.0-4757.g3fc0089c.el8.noarch 2023-07-14T12:48:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-14T12:48:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.1-9.el8.x86_64 2023-07-14T12:48:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-14T12:48:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-14T12:48:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: jq-1.6-3.el8.x86_64 2023-07-14T12:48:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-14T12:48:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-14T12:48:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-14T12:48:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-14T12:48:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-14T12:48:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-14T12:48:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: libpq-13.5-1.el8.x86_64 2023-07-14T12:48:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-14T12:48:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-14T12:48:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-14T12:48:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-14T12:48:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-14T12:48:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-14T12:48:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-14T12:48:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-14T12:48:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-14T12:48:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-14T12:48:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-14T12:48:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-14T12:48:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-14T12:48:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-14T12:48:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-14T12:48:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-14T12:48:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-14T12:48:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T12:48:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T12:48:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T12:48:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-14T12:48:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-14T12:48:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-14T12:48:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-14T12:48:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-14T12:48:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-14T12:48:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-14T12:48:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-14T12:48:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-14T12:48:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-14T12:48:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-14T12:48:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-14T12:48:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-14T12:48:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-14T12:48:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-14T12:48:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-14T12:48:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-14T12:48:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-14T12:48:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-14T12:48:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-14T12:48:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-14T12:48:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-14T12:48:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-14T12:48:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-14T12:48:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-14T12:48:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-14T12:48:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-14T12:48:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-2.6-1.el8.noarch 2023-07-14T12:48:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-14T12:48:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-14T12:48:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-14T12:48:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-14T12:48:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-14T12:48:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-14T12:48:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-14T12:48:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-14T12:48:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-14T12:48:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-14T12:48:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-14T12:48:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-14T12:48:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-14T12:48:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-14T12:48:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-14T12:48:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-14T12:48:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-14T12:48:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-14T12:48:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-14T12:48:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-14T12:48:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-14T12:48:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:18.0.0-4757.g3fc0089c.el8.x86_64 2023-07-14T12:48:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-14T12:48:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-14T12:48:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-14T12:48:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-14T12:48:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-14T12:48:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-14T12:48:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:48:11.659 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2023-07-14T12:48:11.980 DEBUG:teuthology.parallel:result is None 2023-07-14T12:48:11.981 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:48:12.345 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-14T12:48:12.403 INFO:teuthology.orchestra.run.smithi017.stdout:18.0.0-4757.g3fc0089c.el8 2023-07-14T12:48:12.403 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4757.g3fc0089c.el8 2023-07-14T12:48:12.404 INFO:teuthology.task.install:The correct ceph version 18.0.0-4757.g3fc0089c is installed. 2023-07-14T12:48:12.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:48:12.759 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-14T12:48:12.819 INFO:teuthology.orchestra.run.smithi131.stdout:18.0.0-4757.g3fc0089c.el8 2023-07-14T12:48:12.820 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4757.g3fc0089c.el8 2023-07-14T12:48:12.820 INFO:teuthology.task.install:The correct ceph version 18.0.0-4757.g3fc0089c is installed. 2023-07-14T12:48:12.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:48:13.247 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-14T12:48:13.309 INFO:teuthology.orchestra.run.smithi135.stdout:18.0.0-4757.g3fc0089c.el8 2023-07-14T12:48:13.309 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4757.g3fc0089c.el8 2023-07-14T12:48:13.309 INFO:teuthology.task.install:The correct ceph version 18.0.0-4757.g3fc0089c is installed. 2023-07-14T12:48:13.310 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-14T12:48:13.310 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:48:13.310 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T12:48:13.405 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-14T12:48:13.405 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T12:48:13.500 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-07-14T12:48:13.500 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T12:48:13.593 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-14T12:48:13.593 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:48:13.594 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T12:48:13.666 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T12:48:13.777 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-14T12:48:13.778 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T12:48:13.848 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T12:48:13.956 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-07-14T12:48:13.957 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T12:48:14.027 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T12:48:14.134 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-14T12:48:14.135 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:48:14.135 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T12:48:14.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T12:48:14.312 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-14T12:48:14.312 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T12:48:14.380 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T12:48:14.487 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-07-14T12:48:14.487 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T12:48:14.555 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T12:48:14.661 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-14T12:48:14.662 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:48:14.662 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T12:48:14.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T12:48:14.851 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-14T12:48:14.851 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T12:48:14.919 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T12:48:15.025 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-07-14T12:48:15.026 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T12:48:15.093 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T12:48:15.200 INFO:teuthology.run_tasks:Running task cephadm... 2023-07-14T12:48:15.290 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'subvols': {'create': 2}} 2023-07-14T12:48:15.290 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:48:15.302 INFO:tasks.cephadm:Cluster fsid is b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:48:15.303 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-07-14T12:48:15.304 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.17', 'mon.b': '172.21.15.131', 'mon.c': '172.21.15.135'} 2023-07-14T12:48:15.304 INFO:tasks.cephadm:First mon is mon.a on smithi017 2023-07-14T12:48:15.304 INFO:tasks.cephadm:First mgr is x 2023-07-14T12:48:15.305 INFO:tasks.cephadm:Normalizing hostnames... 2023-07-14T12:48:15.305 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname $(hostname -s) 2023-07-14T12:48:15.380 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname $(hostname -s) 2023-07-14T12:48:15.449 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2023-07-14T12:48:15.519 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-07-14T12:48:15.519 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:48:15.897 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3fc0089cc1082313a98853d48b892acdc1385b8b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/71399/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-4757-g3fc0089c', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-4757.g3fc0089c'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-07-13 19:47:46.444052', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-2023Jul13', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-07-14T12:48:16.296 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-2023Jul13, sha1 3fc0089cc1082313a98853d48b892acdc1385b8b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=3fc0089cc1082313a98853d48b892acdc1385b8b 2023-07-14T12:48:16.297 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/x86_64/flavors/default/cephadm 2023-07-14T12:48:16.297 DEBUG:teuthology.orchestra.run.smithi017:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-14T12:48:17.595 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-rw-r--. 1 ubuntu ubuntu 663791 Jul 14 12:48 /home/ubuntu/cephtest/cephadm 2023-07-14T12:48:17.596 DEBUG:teuthology.orchestra.run.smithi131:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-14T12:48:18.717 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-rw-r--. 1 ubuntu ubuntu 663791 Jul 14 12:48 /home/ubuntu/cephtest/cephadm 2023-07-14T12:48:18.717 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Jul13/3fc0089cc1082313a98853d48b892acdc1385b8b/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-14T12:48:19.705 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-rw-r--. 1 ubuntu ubuntu 663791 Jul 14 12:48 /home/ubuntu/cephtest/cephadm 2023-07-14T12:48:19.706 DEBUG:teuthology.orchestra.run.smithi017:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-14T12:48:19.757 DEBUG:teuthology.orchestra.run.smithi131:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-14T12:48:19.807 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-14T12:48:19.897 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b on all hosts... 2023-07-14T12:48:19.897 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b pull 2023-07-14T12:48:19.902 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b pull 2023-07-14T12:48:19.906 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b pull 2023-07-14T12:48:21.349 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b... 2023-07-14T12:48:21.395 INFO:teuthology.orchestra.run.smithi131.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b... 2023-07-14T12:48:24.278 INFO:teuthology.orchestra.run.smithi017.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b... 2023-07-14T12:48:48.956 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-07-14T12:48:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", 2023-07-14T12:48:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "image_id": "afd12e232ec04c7e77932076425916985d97c3486288fff2ba931630e84a9295", 2023-07-14T12:48:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "repo_digests": [ 2023-07-14T12:48:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c4bf3497f7cb9cae2d0db734c6fa7ef173cd8dc715907bde16e4a68082d82e1d" 2023-07-14T12:48:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2023-07-14T12:48:48.958 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-07-14T12:48:52.014 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-07-14T12:48:52.014 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", 2023-07-14T12:48:52.014 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "afd12e232ec04c7e77932076425916985d97c3486288fff2ba931630e84a9295", 2023-07-14T12:48:52.015 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2023-07-14T12:48:52.015 INFO:teuthology.orchestra.run.smithi135.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c4bf3497f7cb9cae2d0db734c6fa7ef173cd8dc715907bde16e4a68082d82e1d" 2023-07-14T12:48:52.015 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2023-07-14T12:48:52.015 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-07-14T12:48:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:48:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", 2023-07-14T12:48:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: "image_id": "afd12e232ec04c7e77932076425916985d97c3486288fff2ba931630e84a9295", 2023-07-14T12:48:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: "repo_digests": [ 2023-07-14T12:48:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c4bf3497f7cb9cae2d0db734c6fa7ef173cd8dc715907bde16e4a68082d82e1d" 2023-07-14T12:48:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T12:48:52.539 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:48:52.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph 2023-07-14T12:48:52.640 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph 2023-07-14T12:48:52.719 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2023-07-14T12:48:52.793 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /etc/ceph 2023-07-14T12:48:52.863 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /etc/ceph 2023-07-14T12:48:52.932 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2023-07-14T12:48:53.000 INFO:tasks.cephadm:Writing seed config... 2023-07-14T12:48:53.001 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-07-14T12:48:53.001 INFO:tasks.cephadm: override: [client] debug client = 20 2023-07-14T12:48:53.002 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-07-14T12:48:53.002 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-07-14T12:48:53.002 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-07-14T12:48:53.002 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-07-14T12:48:53.002 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-07-14T12:48:53.003 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-07-14T12:48:53.003 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-07-14T12:48:53.003 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-07-14T12:48:53.003 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-07-14T12:48:53.003 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-07-14T12:48:53.004 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-07-14T12:48:53.004 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-07-14T12:48:53.004 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-07-14T12:48:53.004 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-07-14T12:48:53.004 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-07-14T12:48:53.005 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-07-14T12:48:53.005 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-07-14T12:48:53.005 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-07-14T12:48:53.005 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-07-14T12:48:53.005 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-07-14T12:48:53.006 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-07-14T12:48:53.006 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-07-14T12:48:53.006 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-07-14T12:48:53.006 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-07-14T12:48:53.006 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-07-14T12:48:53.007 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-07-14T12:48:53.007 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-07-14T12:48:53.007 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-07-14T12:48:53.007 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-07-14T12:48:53.007 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-07-14T12:48:53.008 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-07-14T12:48:53.008 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-07-14T12:48:53.008 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-07-14T12:48:53.008 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-07-14T12:48:53.009 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-07-14T12:48:53.009 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-07-14T12:48:53.009 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-07-14T12:48:53.009 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-07-14T12:48:53.009 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-07-14T12:48:53.010 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-07-14T12:48:53.010 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-07-14T12:48:53.010 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-07-14T12:48:53.011 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:48:53.011 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-07-14T12:48:53.054 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = b31a3268-2244-11ee-9b33-001a4aab830c [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-07-14T12:48:53.055 DEBUG:teuthology.orchestra.run.smithi017:mon.a> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.a.service 2023-07-14T12:48:53.098 DEBUG:teuthology.orchestra.run.smithi017:mgr.x> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.x.service 2023-07-14T12:48:53.143 INFO:tasks.cephadm:Bootstrapping... 2023-07-14T12:48:53.143 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b -v bootstrap --fsid b31a3268-2244-11ee-9b33-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.17 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-07-14T12:48:53.166 INFO:journalctl@ceph.mon.a.smithi017.stdout:-- Logs begin at Fri 2023-07-14 12:26:45 UTC. -- 2023-07-14T12:48:53.213 INFO:journalctl@ceph.mgr.x.smithi017.stdout:-- Logs begin at Fri 2023-07-14 12:26:45 UTC. -- 2023-07-14T12:48:53.373 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2023-07-14T12:48:53.373 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b', '-v', 'bootstrap', '--fsid', 'b31a3268-2244-11ee-9b33-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.17', '--skip-admin-label'] 2023-07-14T12:48:53.547 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 4.1.1 2023-07-14T12:48:53.548 INFO:teuthology.orchestra.run.smithi017.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-07-14T12:48:53.548 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying podman|docker is present... 2023-07-14T12:48:53.718 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 4.1.1 2023-07-14T12:48:53.719 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying lvm2 is present... 2023-07-14T12:48:53.719 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying time synchronization is in place... 2023-07-14T12:48:53.733 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-07-14T12:48:53.733 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-07-14T12:48:53.747 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-07-14T12:48:53.747 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-07-14T12:48:53.760 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2023-07-14T12:48:53.773 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2023-07-14T12:48:53.773 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2023-07-14T12:48:53.774 INFO:teuthology.orchestra.run.smithi017.stdout:Repeating the final host check... 2023-07-14T12:48:53.943 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 4.1.1 2023-07-14T12:48:53.944 INFO:teuthology.orchestra.run.smithi017.stdout:podman (/bin/podman) version 4.1.1 is present 2023-07-14T12:48:53.944 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl is present 2023-07-14T12:48:53.944 INFO:teuthology.orchestra.run.smithi017.stdout:lvcreate is present 2023-07-14T12:48:53.957 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-07-14T12:48:53.957 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-07-14T12:48:53.970 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-07-14T12:48:53.970 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-07-14T12:48:53.984 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2023-07-14T12:48:53.997 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2023-07-14T12:48:53.997 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2023-07-14T12:48:53.997 INFO:teuthology.orchestra.run.smithi017.stdout:Host looks OK 2023-07-14T12:48:53.997 INFO:teuthology.orchestra.run.smithi017.stdout:Cluster fsid: b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:48:53.998 INFO:teuthology.orchestra.run.smithi017.stdout:Acquiring lock 140491983714792 on /run/cephadm/b31a3268-2244-11ee-9b33-001a4aab830c.lock 2023-07-14T12:48:53.998 INFO:teuthology.orchestra.run.smithi017.stdout:Lock 140491983714792 acquired on /run/cephadm/b31a3268-2244-11ee-9b33-001a4aab830c.lock 2023-07-14T12:48:53.998 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 3300 ... 2023-07-14T12:48:53.999 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 6789 ... 2023-07-14T12:48:53.999 INFO:teuthology.orchestra.run.smithi017.stdout:Base mon IP(s) is [172.21.15.17:3300, 172.21.15.17:6789], mon addrv is [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2023-07-14T12:48:54.007 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-07-14T12:48:54.007 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.17 metric 100 2023-07-14T12:48:54.013 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-07-14T12:48:54.013 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-07-14T12:48:54.014 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1617sec hoplimit 64 pref medium 2023-07-14T12:48:54.020 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-07-14T12:48:54.020 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-07-14T12:48:54.020 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-07-14T12:48:54.020 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-07-14T12:48:54.020 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-07-14T12:48:54.020 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-07-14T12:48:54.021 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2023-07-14T12:48:54.021 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2023-07-14T12:48:54.021 INFO:teuthology.orchestra.run.smithi017.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-07-14T12:48:54.022 INFO:teuthology.orchestra.run.smithi017.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-07-14T12:48:54.023 INFO:teuthology.orchestra.run.smithi017.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b... 2023-07-14T12:48:54.497 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout afd12e232ec04c7e77932076425916985d97c3486288fff2ba931630e84a9295 2023-07-14T12:48:54.497 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b... 2023-07-14T12:48:54.497 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Getting image source signatures 2023-07-14T12:48:54.497 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:d8eac6e0ff3c58bd5607bffacb1c2214d20cdd3ff8cfaf23cfeb0cc60b2d0d6b 2023-07-14T12:48:54.497 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:6022c611d474f2b306ddd1edfc8360123ece5266119096f25fde843d7967e636 2023-07-14T12:48:54.497 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying config sha256:afd12e232ec04c7e77932076425916985d97c3486288fff2ba931630e84a9295 2023-07-14T12:48:54.498 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Writing manifest to image destination 2023-07-14T12:48:54.498 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Storing signatures 2023-07-14T12:48:55.474 INFO:teuthology.orchestra.run.smithi017.stdout:ceph: stdout ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev) 2023-07-14T12:48:55.474 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph version: ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev) 2023-07-14T12:48:55.475 INFO:teuthology.orchestra.run.smithi017.stdout:Extracting ceph user uid/gid from container image... 2023-07-14T12:48:56.355 INFO:teuthology.orchestra.run.smithi017.stdout:stat: stdout 167 167 2023-07-14T12:48:56.355 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial keys... 2023-07-14T12:48:57.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQA4RLFkXhu5LBAAe1oRlx8EinAn8aQErMIEYA== 2023-07-14T12:48:58.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQA5RLFkc9VFIxAAwFY4tIrB73rRg8nidmA7eA== 2023-07-14T12:48:58.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQA6RLFkwlBpFxAAzz1B4v2K44ExkhK3aBw1Dw== 2023-07-14T12:48:58.888 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial monmap... 2023-07-14T12:48:59.762 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-07-14T12:48:59.763 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-07-14T12:48:59.763 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:48:59.763 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-07-14T12:48:59.763 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool for a [v2:172.21.15.17:3300,v1:172.21.15.17:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-07-14T12:48:59.763 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = pacific 2023-07-14T12:48:59.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: set fsid to b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:48:59.764 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-07-14T12:48:59.764 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:48:59.765 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mon... 2023-07-14T12:49:00.846 INFO:teuthology.orchestra.run.smithi017.stdout:create mon.a on 2023-07-14T12:49:01.113 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-07-14T12:49:01.329 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-07-14T12:49:01.584 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-b31a3268-2244-11ee-9b33-001a4aab830c.target → /etc/systemd/system/ceph-b31a3268-2244-11ee-9b33-001a4aab830c.target. 2023-07-14T12:49:01.584 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-b31a3268-2244-11ee-9b33-001a4aab830c.target → /etc/systemd/system/ceph-b31a3268-2244-11ee-9b33-001a4aab830c.target. 2023-07-14T12:49:01.970 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.a 2023-07-14T12:49:01.970 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.a.service: Unit ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.a.service not loaded. 2023-07-14T12:49:02.177 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b31a3268-2244-11ee-9b33-001a4aab830c.target.wants/ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-b31a3268-2244-11ee-9b33-001a4aab830c@.service. 2023-07-14T12:49:02.345 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:02 smithi017 systemd[1]: Starting Ceph mon.a for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:49:02.968 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:02 smithi017 podman[94994]: 2023-07-14T12:49:02.969 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:02 smithi017 bash[94994]: 8d0a8a1a5663295a9ededbb81af6916ea194f71001ef34b05b806841abb205e9 2023-07-14T12:49:03.001 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-14T12:49:03.002 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2023-07-14T12:49:03.017 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-14T12:49:03.017 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-07-14T12:49:03.017 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2023-07-14T12:49:03.018 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2023-07-14T12:49:03.018 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon to start... 2023-07-14T12:49:03.018 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon... 2023-07-14T12:49:03.305 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:02 smithi017 ceph-mon[95034]: mkfs b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:49:03.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:02 smithi017 ceph-mon[95034]: mon.a is new leader, mons a in quorum (ranks 0) 2023-07-14T12:49:03.306 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:02 smithi017 systemd[1]: Started Ceph mon.a for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:49:04.099 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout cluster: 2023-07-14T12:49:04.101 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout id: b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:49:04.101 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-07-14T12:49:04.101 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:04.101 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout services: 2023-07-14T12:49:04.101 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.691131s) 2023-07-14T12:49:04.102 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-07-14T12:49:04.102 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-07-14T12:49:04.102 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:04.102 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout data: 2023-07-14T12:49:04.102 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-07-14T12:49:04.102 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-07-14T12:49:04.102 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-07-14T12:49:04.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pgs: 2023-07-14T12:49:04.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:04.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.550+0000 7fa88a551700 1 Processor -- start 2023-07-14T12:49:04.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.550+0000 7fa88a551700 1 -- start start 2023-07-14T12:49:04.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.550+0000 7fa88a551700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa884105620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:04.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.550+0000 7fa88a551700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa884105b60 con 0x7fa884105210 2023-07-14T12:49:04.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.551+0000 7fa883fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa884105620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:04.103 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.551+0000 7fa883fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa884105620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46542/0 (socket says 172.21.15.17:46542) 2023-07-14T12:49:04.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.551+0000 7fa883fff700 1 -- 172.21.15.17:0/3978022630 learned_addr learned my addr 172.21.15.17:0/3978022630 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:04.107 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.552+0000 7fa883fff700 1 -- 172.21.15.17:0/3978022630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa884105ca0 con 0x7fa884105210 2023-07-14T12:49:04.107 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.552+0000 7fa883fff700 1 --2- 172.21.15.17:0/3978022630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa884105620 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa8740098a0 tx=0x7fa874009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570db1efac049f45 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:04.107 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.552+0000 7fa882ffd700 1 -- 172.21.15.17:0/3978022630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa874004160 con 0x7fa884105210 2023-07-14T12:49:04.107 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.552+0000 7fa882ffd700 1 -- 172.21.15.17:0/3978022630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8740042c0 con 0x7fa884105210 2023-07-14T12:49:04.107 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.552+0000 7fa882ffd700 1 -- 172.21.15.17:0/3978022630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8740045a0 con 0x7fa884105210 2023-07-14T12:49:04.107 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.553+0000 7fa88a551700 1 -- 172.21.15.17:0/3978022630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 msgr2=0x7fa884105620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:04.108 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.553+0000 7fa88a551700 1 --2- 172.21.15.17:0/3978022630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa884105620 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa8740098a0 tx=0x7fa874009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:04.108 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.553+0000 7fa88a551700 1 -- 172.21.15.17:0/3978022630 shutdown_connections 2023-07-14T12:49:04.108 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.553+0000 7fa88a551700 1 --2- 172.21.15.17:0/3978022630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa884105620 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:04.108 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.553+0000 7fa88a551700 1 -- 172.21.15.17:0/3978022630 >> 172.21.15.17:0/3978022630 conn(0x7fa884100900 msgr2=0x7fa884102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:04.108 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.553+0000 7fa88a551700 1 -- 172.21.15.17:0/3978022630 shutdown_connections 2023-07-14T12:49:04.108 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.553+0000 7fa88a551700 1 -- 172.21.15.17:0/3978022630 wait complete. 2023-07-14T12:49:04.109 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.554+0000 7fa88a551700 1 Processor -- start 2023-07-14T12:49:04.109 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.554+0000 7fa88a551700 1 -- start start 2023-07-14T12:49:04.109 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.554+0000 7fa88a551700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa88419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:04.109 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.554+0000 7fa88a551700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88419aef0 con 0x7fa884105210 2023-07-14T12:49:04.109 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.555+0000 7fa883fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa88419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:04.109 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.555+0000 7fa883fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa88419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46558/0 (socket says 172.21.15.17:46558) 2023-07-14T12:49:04.110 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.555+0000 7fa883fff700 1 -- 172.21.15.17:0/2508640758 learned_addr learned my addr 172.21.15.17:0/2508640758 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:04.110 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.555+0000 7fa883fff700 1 -- 172.21.15.17:0/2508640758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874009550 con 0x7fa884105210 2023-07-14T12:49:04.110 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.555+0000 7fa883fff700 1 --2- 172.21.15.17:0/2508640758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa88419a9b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa884105f40 tx=0x7fa874004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:04.110 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.555+0000 7fa8817fa700 1 -- 172.21.15.17:0/2508640758 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa874011630 con 0x7fa884105210 2023-07-14T12:49:04.110 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.555+0000 7fa8817fa700 1 -- 172.21.15.17:0/2508640758 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa874011790 con 0x7fa884105210 2023-07-14T12:49:04.110 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.555+0000 7fa8817fa700 1 -- 172.21.15.17:0/2508640758 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa874011a30 con 0x7fa884105210 2023-07-14T12:49:04.110 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.556+0000 7fa88a551700 1 -- 172.21.15.17:0/2508640758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88419b0f0 con 0x7fa884105210 2023-07-14T12:49:04.111 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.556+0000 7fa88a551700 1 -- 172.21.15.17:0/2508640758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88419b510 con 0x7fa884105210 2023-07-14T12:49:04.111 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.556+0000 7fa8817fa700 1 -- 172.21.15.17:0/2508640758 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa874022070 con 0x7fa884105210 2023-07-14T12:49:04.111 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.556+0000 7fa8817fa700 1 -- 172.21.15.17:0/2508640758 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa87401c450 con 0x7fa884105210 2023-07-14T12:49:04.111 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.557+0000 7fa88a551700 1 -- 172.21.15.17:0/2508640758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8841943f0 con 0x7fa884105210 2023-07-14T12:49:04.111 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.560+0000 7fa8817fa700 1 -- 172.21.15.17:0/2508640758 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fa87401b450 con 0x7fa884105210 2023-07-14T12:49:04.111 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.636+0000 7fa88a551700 1 -- 172.21.15.17:0/2508640758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fa88402c850 con 0x7fa884105210 2023-07-14T12:49:04.111 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.637+0000 7fa8817fa700 1 -- 172.21.15.17:0/2508640758 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fa87401b5f0 con 0x7fa884105210 2023-07-14T12:49:04.111 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.637+0000 7fa88a551700 1 -- 172.21.15.17:0/2508640758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 msgr2=0x7fa88419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:04.112 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.637+0000 7fa88a551700 1 --2- 172.21.15.17:0/2508640758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa88419a9b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa884105f40 tx=0x7fa874004750 comp rx=0 tx=0).stop 2023-07-14T12:49:04.112 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.637+0000 7fa88a551700 1 -- 172.21.15.17:0/2508640758 shutdown_connections 2023-07-14T12:49:04.112 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.637+0000 7fa88a551700 1 --2- 172.21.15.17:0/2508640758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa884105210 0x7fa88419a9b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:04.112 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.637+0000 7fa88a551700 1 -- 172.21.15.17:0/2508640758 >> 172.21.15.17:0/2508640758 conn(0x7fa884100900 msgr2=0x7fa88418cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:04.112 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.638+0000 7fa88a551700 1 -- 172.21.15.17:0/2508640758 shutdown_connections 2023-07-14T12:49:04.112 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:03.638+0000 7fa88a551700 1 -- 172.21.15.17:0/2508640758 wait complete. 2023-07-14T12:49:04.112 INFO:teuthology.orchestra.run.smithi017.stdout:mon is available 2023-07-14T12:49:04.113 INFO:teuthology.orchestra.run.smithi017.stdout:Assimilating anything we can from ceph.conf... 2023-07-14T12:49:04.345 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:03 smithi017 ceph-mon[95034]: mon.a is new leader, mons a in quorum (ranks 0) 2023-07-14T12:49:04.345 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:03 smithi017 ceph-mon[95034]: monmap e1: 1 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0]} removed_ranks: {} 2023-07-14T12:49:04.345 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:03 smithi017 ceph-mon[95034]: fsmap 2023-07-14T12:49:04.345 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:03 smithi017 ceph-mon[95034]: osdmap e1: 0 total, 0 up, 0 in 2023-07-14T12:49:04.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:03 smithi017 ceph-mon[95034]: mgrmap e1: no daemons active 2023-07-14T12:49:04.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:03 smithi017 ceph-mon[95034]: from='client.? 172.21.15.17:0/2508640758' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-07-14T12:49:05.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:04 smithi017 ceph-mon[95034]: from='client.? 172.21.15.17:0/372774714' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-07-14T12:49:05.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:04 smithi017 ceph-mon[95034]: from='client.? 172.21.15.17:0/372774714' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-07-14T12:49:06.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:06.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2023-07-14T12:49:06.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:49:06.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2023-07-14T12:49:06.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-07-14T12:49:06.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-07-14T12:49:06.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-07-14T12:49:06.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-07-14T12:49:06.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:06.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2023-07-14T12:49:06.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-07-14T12:49:06.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:06.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2023-07-14T12:49:06.592 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-07-14T12:49:06.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-07-14T12:49:06.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-07-14T12:49:06.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-07-14T12:49:06.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-07-14T12:49:06.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.615+0000 7fc5dcad3700 1 Processor -- start 2023-07-14T12:49:06.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.615+0000 7fc5dcad3700 1 -- start start 2023-07-14T12:49:06.593 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.615+0000 7fc5dcad3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d807a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:06.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.615+0000 7fc5dcad3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d807a830 con 0x7fc5d807bdf0 2023-07-14T12:49:06.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.616+0000 7fc5d77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d807a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:06.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.616+0000 7fc5d77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d807a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46564/0 (socket says 172.21.15.17:46564) 2023-07-14T12:49:06.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.616+0000 7fc5d77fe700 1 -- 172.21.15.17:0/3724098854 learned_addr learned my addr 172.21.15.17:0/3724098854 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:06.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.616+0000 7fc5d77fe700 1 -- 172.21.15.17:0/3724098854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d807a970 con 0x7fc5d807bdf0 2023-07-14T12:49:06.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.616+0000 7fc5d77fe700 1 --2- 172.21.15.17:0/3724098854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d807a2f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80098a0 tx=0x7fc5c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53917a5999aa86b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:06.594 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.617+0000 7fc5d67fc700 1 -- 172.21.15.17:0/3724098854 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5c8004160 con 0x7fc5d807bdf0 2023-07-14T12:49:06.595 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.617+0000 7fc5d67fc700 1 -- 172.21.15.17:0/3724098854 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c80042c0 con 0x7fc5d807bdf0 2023-07-14T12:49:06.595 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.617+0000 7fc5d67fc700 1 -- 172.21.15.17:0/3724098854 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5c80045a0 con 0x7fc5d807bdf0 2023-07-14T12:49:06.595 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.617+0000 7fc5dcad3700 1 -- 172.21.15.17:0/3724098854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 msgr2=0x7fc5d807a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:06.595 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.617+0000 7fc5dcad3700 1 --2- 172.21.15.17:0/3724098854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d807a2f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80098a0 tx=0x7fc5c8009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:06.595 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.617+0000 7fc5dcad3700 1 -- 172.21.15.17:0/3724098854 shutdown_connections 2023-07-14T12:49:06.595 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.617+0000 7fc5dcad3700 1 --2- 172.21.15.17:0/3724098854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d807a2f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:06.595 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.617+0000 7fc5dcad3700 1 -- 172.21.15.17:0/3724098854 >> 172.21.15.17:0/3724098854 conn(0x7fc5d81006c0 msgr2=0x7fc5d8102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:06.596 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.617+0000 7fc5dcad3700 1 -- 172.21.15.17:0/3724098854 shutdown_connections 2023-07-14T12:49:06.596 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.617+0000 7fc5dcad3700 1 -- 172.21.15.17:0/3724098854 wait complete. 2023-07-14T12:49:06.596 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.618+0000 7fc5dcad3700 1 Processor -- start 2023-07-14T12:49:06.596 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.618+0000 7fc5dcad3700 1 -- start start 2023-07-14T12:49:06.596 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.619+0000 7fc5dcad3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:06.596 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.619+0000 7fc5dcad3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d819ad20 con 0x7fc5d807bdf0 2023-07-14T12:49:06.596 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.619+0000 7fc5d77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:06.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.619+0000 7fc5d77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d819a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46572/0 (socket says 172.21.15.17:46572) 2023-07-14T12:49:06.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.619+0000 7fc5d77fe700 1 -- 172.21.15.17:0/372774714 learned_addr learned my addr 172.21.15.17:0/372774714 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:06.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.620+0000 7fc5d77fe700 1 -- 172.21.15.17:0/372774714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8009550 con 0x7fc5d807bdf0 2023-07-14T12:49:06.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.620+0000 7fc5d77fe700 1 --2- 172.21.15.17:0/372774714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d819a7e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8004000 tx=0x7fc5c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:06.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.620+0000 7fc5d4ff9700 1 -- 172.21.15.17:0/372774714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5c8011630 con 0x7fc5d807bdf0 2023-07-14T12:49:06.597 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.620+0000 7fc5d4ff9700 1 -- 172.21.15.17:0/372774714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c8011790 con 0x7fc5d807bdf0 2023-07-14T12:49:06.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.620+0000 7fc5dcad3700 1 -- 172.21.15.17:0/372774714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d819af20 con 0x7fc5d807bdf0 2023-07-14T12:49:06.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.620+0000 7fc5d4ff9700 1 -- 172.21.15.17:0/372774714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5c8011a30 con 0x7fc5d807bdf0 2023-07-14T12:49:06.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.620+0000 7fc5dcad3700 1 -- 172.21.15.17:0/372774714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d819b340 con 0x7fc5d807bdf0 2023-07-14T12:49:06.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.621+0000 7fc5d4ff9700 1 -- 172.21.15.17:0/372774714 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc5c8022070 con 0x7fc5d807bdf0 2023-07-14T12:49:06.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.621+0000 7fc5d4ff9700 1 -- 172.21.15.17:0/372774714 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc5c801c450 con 0x7fc5d807bdf0 2023-07-14T12:49:06.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.621+0000 7fc5dcad3700 1 -- 172.21.15.17:0/372774714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d81945a0 con 0x7fc5d807bdf0 2023-07-14T12:49:06.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.624+0000 7fc5d4ff9700 1 -- 172.21.15.17:0/372774714 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fc5c801b450 con 0x7fc5d807bdf0 2023-07-14T12:49:06.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.698+0000 7fc5dcad3700 1 -- 172.21.15.17:0/372774714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fc5d802ca40 con 0x7fc5d807bdf0 2023-07-14T12:49:06.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.702+0000 7fc5d4ff9700 1 -- 172.21.15.17:0/372774714 <== mon.0 v2:172.21.15.17:3300/0 7 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc5c801b5f0 con 0x7fc5d807bdf0 2023-07-14T12:49:06.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.702+0000 7fc5d4ff9700 1 -- 172.21.15.17:0/372774714 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fc5c8024560 con 0x7fc5d807bdf0 2023-07-14T12:49:06.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.704+0000 7fc5dcad3700 1 -- 172.21.15.17:0/372774714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 msgr2=0x7fc5d819a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:06.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.704+0000 7fc5dcad3700 1 --2- 172.21.15.17:0/372774714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d819a7e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8004000 tx=0x7fc5c8004750 comp rx=0 tx=0).stop 2023-07-14T12:49:06.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.704+0000 7fc5dcad3700 1 -- 172.21.15.17:0/372774714 shutdown_connections 2023-07-14T12:49:06.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.704+0000 7fc5dcad3700 1 --2- 172.21.15.17:0/372774714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5d807bdf0 0x7fc5d819a7e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:06.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.704+0000 7fc5dcad3700 1 -- 172.21.15.17:0/372774714 >> 172.21.15.17:0/372774714 conn(0x7fc5d81006c0 msgr2=0x7fc5d8101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:06.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.704+0000 7fc5dcad3700 1 -- 172.21.15.17:0/372774714 shutdown_connections 2023-07-14T12:49:06.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:04.704+0000 7fc5dcad3700 1 -- 172.21.15.17:0/372774714 wait complete. 2023-07-14T12:49:06.602 INFO:teuthology.orchestra.run.smithi017.stdout:Generating new minimal ceph.conf... 2023-07-14T12:49:07.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:07 smithi017 ceph-mon[95034]: from='client.? 172.21.15.17:0/2061859955' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:49:07.773 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.133+0000 7f79641f6700 1 Processor -- start 2023-07-14T12:49:07.774 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.133+0000 7f79641f6700 1 -- start start 2023-07-14T12:49:07.774 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.133+0000 7f79641f6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c105620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:07.774 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.133+0000 7f79641f6700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c105b60 con 0x7f795c105210 2023-07-14T12:49:07.774 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.133+0000 7f7961f92700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c105620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:07.774 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.133+0000 7f7961f92700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c105620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35746/0 (socket says 172.21.15.17:35746) 2023-07-14T12:49:07.774 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.133+0000 7f7961f92700 1 -- 172.21.15.17:0/3595328252 learned_addr learned my addr 172.21.15.17:0/3595328252 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:07.775 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.134+0000 7f7961f92700 1 -- 172.21.15.17:0/3595328252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c105ca0 con 0x7f795c105210 2023-07-14T12:49:07.775 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.134+0000 7f7961f92700 1 --2- 172.21.15.17:0/3595328252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c105620 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79580098a0 tx=0x7f7958009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61301ad535a46c81 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:07.775 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.134+0000 7f7960f90700 1 -- 172.21.15.17:0/3595328252 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7958004160 con 0x7f795c105210 2023-07-14T12:49:07.775 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.135+0000 7f7960f90700 1 -- 172.21.15.17:0/3595328252 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f79580042c0 con 0x7f795c105210 2023-07-14T12:49:07.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.135+0000 7f7960f90700 1 -- 172.21.15.17:0/3595328252 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7958011940 con 0x7f795c105210 2023-07-14T12:49:07.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.135+0000 7f79641f6700 1 -- 172.21.15.17:0/3595328252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 msgr2=0x7f795c105620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:07.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.135+0000 7f79641f6700 1 --2- 172.21.15.17:0/3595328252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c105620 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79580098a0 tx=0x7f7958009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:07.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.135+0000 7f79641f6700 1 -- 172.21.15.17:0/3595328252 shutdown_connections 2023-07-14T12:49:07.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.135+0000 7f79641f6700 1 --2- 172.21.15.17:0/3595328252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c105620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:07.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.135+0000 7f79641f6700 1 -- 172.21.15.17:0/3595328252 >> 172.21.15.17:0/3595328252 conn(0x7f795c100900 msgr2=0x7f795c102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:07.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.135+0000 7f79641f6700 1 -- 172.21.15.17:0/3595328252 shutdown_connections 2023-07-14T12:49:07.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.135+0000 7f79641f6700 1 -- 172.21.15.17:0/3595328252 wait complete. 2023-07-14T12:49:07.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.136+0000 7f79641f6700 1 Processor -- start 2023-07-14T12:49:07.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.136+0000 7f79641f6700 1 -- start start 2023-07-14T12:49:07.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.137+0000 7f79641f6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c19b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:07.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.137+0000 7f79641f6700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c19b640 con 0x7f795c105210 2023-07-14T12:49:07.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.137+0000 7f7961f92700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c19b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:07.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.137+0000 7f7961f92700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c19b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35754/0 (socket says 172.21.15.17:35754) 2023-07-14T12:49:07.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.137+0000 7f7961f92700 1 -- 172.21.15.17:0/2061859955 learned_addr learned my addr 172.21.15.17:0/2061859955 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:07.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.137+0000 7f7961f92700 1 -- 172.21.15.17:0/2061859955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7958009550 con 0x7f795c105210 2023-07-14T12:49:07.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.138+0000 7f7961f92700 1 --2- 172.21.15.17:0/2061859955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c19b100 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7958011dc0 tx=0x7f7958011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:07.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.138+0000 7f7952ffd700 1 -- 172.21.15.17:0/2061859955 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79580037d0 con 0x7f795c105210 2023-07-14T12:49:07.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.138+0000 7f7952ffd700 1 -- 172.21.15.17:0/2061859955 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f795801b440 con 0x7f795c105210 2023-07-14T12:49:07.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.138+0000 7f7952ffd700 1 -- 172.21.15.17:0/2061859955 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f795801a560 con 0x7f795c105210 2023-07-14T12:49:07.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.138+0000 7f79641f6700 1 -- 172.21.15.17:0/2061859955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c19b840 con 0x7f795c105210 2023-07-14T12:49:07.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.138+0000 7f79641f6700 1 -- 172.21.15.17:0/2061859955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c19bc60 con 0x7f795c105210 2023-07-14T12:49:07.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.138+0000 7f7952ffd700 1 -- 172.21.15.17:0/2061859955 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f795801aad0 con 0x7f795c105210 2023-07-14T12:49:07.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.138+0000 7f7952ffd700 1 -- 172.21.15.17:0/2061859955 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f79580193f0 con 0x7f795c105210 2023-07-14T12:49:07.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.139+0000 7f79641f6700 1 -- 172.21.15.17:0/2061859955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c061b40 con 0x7f795c105210 2023-07-14T12:49:07.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.142+0000 7f7952ffd700 1 -- 172.21.15.17:0/2061859955 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f7958029060 con 0x7f795c105210 2023-07-14T12:49:07.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.215+0000 7f79641f6700 1 -- 172.21.15.17:0/2061859955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f795c19ecb0 con 0x7f795c105210 2023-07-14T12:49:07.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.216+0000 7f7952ffd700 1 -- 172.21.15.17:0/2061859955 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f7958033090 con 0x7f795c105210 2023-07-14T12:49:07.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.217+0000 7f79641f6700 1 -- 172.21.15.17:0/2061859955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 msgr2=0x7f795c19b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:07.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.217+0000 7f79641f6700 1 --2- 172.21.15.17:0/2061859955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c19b100 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7958011dc0 tx=0x7f7958011ea0 comp rx=0 tx=0).stop 2023-07-14T12:49:07.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.217+0000 7f79641f6700 1 -- 172.21.15.17:0/2061859955 shutdown_connections 2023-07-14T12:49:07.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.217+0000 7f79641f6700 1 --2- 172.21.15.17:0/2061859955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f795c105210 0x7f795c19b100 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:07.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.217+0000 7f79641f6700 1 -- 172.21.15.17:0/2061859955 >> 172.21.15.17:0/2061859955 conn(0x7f795c100900 msgr2=0x7f795c101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:07.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.217+0000 7f79641f6700 1 -- 172.21.15.17:0/2061859955 shutdown_connections 2023-07-14T12:49:07.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:07.217+0000 7f79641f6700 1 -- 172.21.15.17:0/2061859955 wait complete. 2023-07-14T12:49:07.782 INFO:teuthology.orchestra.run.smithi017.stdout:Restarting the monitor... 2023-07-14T12:49:08.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:07 smithi017 systemd[1]: Stopping Ceph mon.a for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:49:08.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:08 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-a[95010]: 2023-07-14T12:49:08.207+0000 7f6c45712700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T12:49:08.527 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:08 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-a[95010]: 2023-07-14T12:49:08.207+0000 7f6c45712700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-14T12:49:08.778 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:08 smithi017 bash[95375]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-a 2023-07-14T12:49:09.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 systemd[1]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.a.service: Succeeded. 2023-07-14T12:49:09.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 systemd[1]: Stopped Ceph mon.a for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:49:09.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 systemd[1]: Starting Ceph mon.a for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:49:09.781 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 podman[95496]: 2023-07-14T12:49:09.782 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 bash[95496]: a917ac1e29d1449d253b0d5713201bf934a4747109c268ed129400023178fb1e 2023-07-14T12:49:09.782 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: set uid:gid to 167:167 (ceph:ceph) 2023-07-14T12:49:09.790 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev), process ceph-mon, pid 7 2023-07-14T12:49:09.790 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: pidfile_write: ignore empty --pid-file 2023-07-14T12:49:09.834 INFO:teuthology.orchestra.run.smithi017.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-07-14T12:49:10.095 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: load: jerasure load: lrc 2023-07-14T12:49:10.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: RocksDB version: 7.9.2 2023-07-14T12:49:10.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Git sha 0 2023-07-14T12:49:10.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Compile date 2023-07-13 18:29:45 2023-07-14T12:49:10.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: DB SUMMARY 2023-07-14T12:49:10.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: DB Session ID: XG3DAWRTA6XEJDDW36C4 2023-07-14T12:49:10.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: CURRENT file: CURRENT 2023-07-14T12:49:10.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: IDENTITY file: IDENTITY 2023-07-14T12:49:10.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-07-14T12:49:10.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-07-14T12:49:10.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99230 ; 2023-07-14T12:49:10.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.error_if_exists: 0 2023-07-14T12:49:10.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.create_if_missing: 0 2023-07-14T12:49:10.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.paranoid_checks: 1 2023-07-14T12:49:10.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.flush_verify_memtable_count: 1 2023-07-14T12:49:10.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-14T12:49:10.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-14T12:49:10.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.env: 0x564b474b3720 2023-07-14T12:49:10.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.fs: PosixFileSystem 2023-07-14T12:49:10.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.info_log: 0x564b4830b280 2023-07-14T12:49:10.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_file_opening_threads: 16 2023-07-14T12:49:10.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.statistics: (nil) 2023-07-14T12:49:10.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.use_fsync: 0 2023-07-14T12:49:10.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_log_file_size: 0 2023-07-14T12:49:10.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-14T12:49:10.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.log_file_time_to_roll: 0 2023-07-14T12:49:10.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.keep_log_file_num: 1000 2023-07-14T12:49:10.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.recycle_log_file_num: 0 2023-07-14T12:49:10.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.allow_fallocate: 1 2023-07-14T12:49:10.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.allow_mmap_reads: 0 2023-07-14T12:49:10.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.allow_mmap_writes: 0 2023-07-14T12:49:10.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.use_direct_reads: 0 2023-07-14T12:49:10.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-14T12:49:10.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.create_missing_column_families: 0 2023-07-14T12:49:10.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.db_log_dir: 2023-07-14T12:49:10.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.wal_dir: 2023-07-14T12:49:10.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.table_cache_numshardbits: 6 2023-07-14T12:49:10.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.WAL_ttl_seconds: 0 2023-07-14T12:49:10.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.WAL_size_limit_MB: 0 2023-07-14T12:49:10.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-14T12:49:10.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-14T12:49:10.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.is_fd_close_on_exec: 1 2023-07-14T12:49:10.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.advise_random_on_open: 1 2023-07-14T12:49:10.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.db_write_buffer_size: 0 2023-07-14T12:49:10.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.write_buffer_manager: 0x564b4822c3c0 2023-07-14T12:49:10.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-14T12:49:10.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-14T12:49:10.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.use_adaptive_mutex: 0 2023-07-14T12:49:10.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.rate_limiter: (nil) 2023-07-14T12:49:10.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-14T12:49:10.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.wal_recovery_mode: 2 2023-07-14T12:49:10.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.enable_thread_tracking: 0 2023-07-14T12:49:10.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.enable_pipelined_write: 0 2023-07-14T12:49:10.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.unordered_write: 0 2023-07-14T12:49:10.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-14T12:49:10.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-14T12:49:10.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-14T12:49:10.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-14T12:49:10.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.row_cache: None 2023-07-14T12:49:10.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.wal_filter: None 2023-07-14T12:49:10.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-14T12:49:10.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.allow_ingest_behind: 0 2023-07-14T12:49:10.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.two_write_queues: 0 2023-07-14T12:49:10.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.manual_wal_flush: 0 2023-07-14T12:49:10.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.wal_compression: 0 2023-07-14T12:49:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.atomic_flush: 0 2023-07-14T12:49:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-14T12:49:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.persist_stats_to_disk: 0 2023-07-14T12:49:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.write_dbid_to_manifest: 0 2023-07-14T12:49:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.log_readahead_size: 0 2023-07-14T12:49:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-14T12:49:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.best_efforts_recovery: 0 2023-07-14T12:49:10.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-14T12:49:10.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-14T12:49:10.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.allow_data_in_errors: 0 2023-07-14T12:49:10.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.db_host_id: __hostname__ 2023-07-14T12:49:10.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.enforce_single_del_contracts: true 2023-07-14T12:49:10.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_background_jobs: 2 2023-07-14T12:49:10.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_background_compactions: -1 2023-07-14T12:49:10.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_subcompactions: 1 2023-07-14T12:49:10.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-14T12:49:10.108 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-14T12:49:10.108 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.delayed_write_rate : 16777216 2023-07-14T12:49:10.108 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_total_wal_size: 0 2023-07-14T12:49:10.108 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-14T12:49:10.108 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.stats_dump_period_sec: 600 2023-07-14T12:49:10.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.stats_persist_period_sec: 600 2023-07-14T12:49:10.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-14T12:49:10.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_open_files: -1 2023-07-14T12:49:10.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bytes_per_sync: 0 2023-07-14T12:49:10.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.wal_bytes_per_sync: 0 2023-07-14T12:49:10.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.strict_bytes_per_sync: 0 2023-07-14T12:49:10.109 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_readahead_size: 0 2023-07-14T12:49:10.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_background_flushes: -1 2023-07-14T12:49:10.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Compression algorithms supported: 2023-07-14T12:49:10.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-14T12:49:10.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: kZSTD supported: 0 2023-07-14T12:49:10.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: kXpressCompression supported: 0 2023-07-14T12:49:10.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: kLZ4HCCompression supported: 1 2023-07-14T12:49:10.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: kZlibCompression supported: 1 2023-07-14T12:49:10.110 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: kSnappyCompression supported: 1 2023-07-14T12:49:10.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: kLZ4Compression supported: 1 2023-07-14T12:49:10.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: kBZip2Compression supported: 0 2023-07-14T12:49:10.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Fast CRC32 supported: Supported on x86 2023-07-14T12:49:10.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: DMutex implementation: pthread_mutex_t 2023-07-14T12:49:10.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-07-14T12:49:10.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-14T12:49:10.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-14T12:49:10.111 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.merge_operator: 2023-07-14T12:49:10.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_filter: None 2023-07-14T12:49:10.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_filter_factory: None 2023-07-14T12:49:10.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.sst_partitioner_factory: None 2023-07-14T12:49:10.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.memtable_factory: SkipListFactory 2023-07-14T12:49:10.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.table_factory: BlockBasedTable 2023-07-14T12:49:10.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564b4830b380) 2023-07-14T12:49:10.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks: 1 2023-07-14T12:49:10.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-14T12:49:10.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-14T12:49:10.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: pin_top_level_index_and_filter: 1 2023-07-14T12:49:10.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_type: 0 2023-07-14T12:49:10.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_index_type: 0 2023-07-14T12:49:10.113 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_shortening: 1 2023-07-14T12:49:10.114 INFO:journalctl@ceph.mon.a.smithi017.stdout: data_block_hash_table_util_ratio: 0.750000 2023-07-14T12:49:10.114 INFO:journalctl@ceph.mon.a.smithi017.stdout: checksum: 4 2023-07-14T12:49:10.114 INFO:journalctl@ceph.mon.a.smithi017.stdout: no_block_cache: 0 2023-07-14T12:49:10.114 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache: 0x564b482cb1f0 2023-07-14T12:49:10.114 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_name: BinnedLRUCache 2023-07-14T12:49:10.114 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_options: 2023-07-14T12:49:10.114 INFO:journalctl@ceph.mon.a.smithi017.stdout: capacity : 536870912 2023-07-14T12:49:10.114 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_shard_bits : 4 2023-07-14T12:49:10.115 INFO:journalctl@ceph.mon.a.smithi017.stdout: strict_capacity_limit : 0 2023-07-14T12:49:10.115 INFO:journalctl@ceph.mon.a.smithi017.stdout: high_pri_pool_ratio: 0.000 2023-07-14T12:49:10.115 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_cache_compressed: (nil) 2023-07-14T12:49:10.115 INFO:journalctl@ceph.mon.a.smithi017.stdout: persistent_cache: (nil) 2023-07-14T12:49:10.115 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size: 4096 2023-07-14T12:49:10.115 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_size_deviation: 10 2023-07-14T12:49:10.115 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_restart_interval: 16 2023-07-14T12:49:10.116 INFO:journalctl@ceph.mon.a.smithi017.stdout: index_block_restart_interval: 1 2023-07-14T12:49:10.116 INFO:journalctl@ceph.mon.a.smithi017.stdout: metadata_block_size: 4096 2023-07-14T12:49:10.116 INFO:journalctl@ceph.mon.a.smithi017.stdout: partition_filters: 0 2023-07-14T12:49:10.116 INFO:journalctl@ceph.mon.a.smithi017.stdout: use_delta_encoding: 1 2023-07-14T12:49:10.116 INFO:journalctl@ceph.mon.a.smithi017.stdout: filter_policy: bloomfilter 2023-07-14T12:49:10.116 INFO:journalctl@ceph.mon.a.smithi017.stdout: whole_key_filtering: 1 2023-07-14T12:49:10.117 INFO:journalctl@ceph.mon.a.smithi017.stdout: verify_compression: 0 2023-07-14T12:49:10.117 INFO:journalctl@ceph.mon.a.smithi017.stdout: read_amp_bytes_per_bit: 0 2023-07-14T12:49:10.117 INFO:journalctl@ceph.mon.a.smithi017.stdout: format_version: 5 2023-07-14T12:49:10.117 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_index_compression: 1 2023-07-14T12:49:10.117 INFO:journalctl@ceph.mon.a.smithi017.stdout: block_align: 0 2023-07-14T12:49:10.117 INFO:journalctl@ceph.mon.a.smithi017.stdout: max_auto_readahead_size: 262144 2023-07-14T12:49:10.117 INFO:journalctl@ceph.mon.a.smithi017.stdout: prepopulate_block_cache: 0 2023-07-14T12:49:10.118 INFO:journalctl@ceph.mon.a.smithi017.stdout: initial_auto_readahead_size: 8192 2023-07-14T12:49:10.118 INFO:journalctl@ceph.mon.a.smithi017.stdout: num_file_reads_for_auto_readahead: 2 2023-07-14T12:49:10.118 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.write_buffer_size: 33554432 2023-07-14T12:49:10.118 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_write_buffer_number: 2 2023-07-14T12:49:10.118 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compression: NoCompression 2023-07-14T12:49:10.118 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bottommost_compression: Disabled 2023-07-14T12:49:10.119 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.prefix_extractor: nullptr 2023-07-14T12:49:10.119 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-14T12:49:10.119 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.num_levels: 7 2023-07-14T12:49:10.119 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-14T12:49:10.119 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-14T12:49:10.119 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-14T12:49:10.119 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-14T12:49:10.119 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-14T12:49:10.120 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-14T12:49:10.120 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-14T12:49:10.120 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-14T12:49:10.120 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-14T12:49:10.120 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-14T12:49:10.120 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-14T12:49:10.120 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-14T12:49:10.121 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compression_opts.window_bits: -14 2023-07-14T12:49:10.121 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compression_opts.level: 32767 2023-07-14T12:49:10.121 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compression_opts.strategy: 0 2023-07-14T12:49:10.121 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-14T12:49:10.121 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-14T12:49:10.121 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-14T12:49:10.121 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-14T12:49:10.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compression_opts.enabled: false 2023-07-14T12:49:10.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-14T12:49:10.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-14T12:49:10.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-14T12:49:10.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-14T12:49:10.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.target_file_size_base: 67108864 2023-07-14T12:49:10.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.target_file_size_multiplier: 1 2023-07-14T12:49:10.122 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-14T12:49:10.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-14T12:49:10.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-14T12:49:10.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-14T12:49:10.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-14T12:49:10.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-14T12:49:10.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-14T12:49:10.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-14T12:49:10.123 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-14T12:49:10.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-14T12:49:10.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-14T12:49:10.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-14T12:49:10.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-14T12:49:10.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.arena_block_size: 1048576 2023-07-14T12:49:10.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-14T12:49:10.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-14T12:49:10.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.disable_auto_compactions: 0 2023-07-14T12:49:10.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-14T12:49:10.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-14T12:49:10.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-14T12:49:10.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-14T12:49:10.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-14T12:49:10.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-14T12:49:10.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-14T12:49:10.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-14T12:49:10.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-14T12:49:10.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-14T12:49:10.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.table_properties_collectors: 2023-07-14T12:49:10.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.inplace_update_support: 0 2023-07-14T12:49:10.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.inplace_update_num_locks: 10000 2023-07-14T12:49:10.126 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-14T12:49:10.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-14T12:49:10.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.memtable_huge_page_size: 0 2023-07-14T12:49:10.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.bloom_locality: 0 2023-07-14T12:49:10.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.max_successive_merges: 0 2023-07-14T12:49:10.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.optimize_filters_for_hits: 0 2023-07-14T12:49:10.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.paranoid_file_checks: 0 2023-07-14T12:49:10.127 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.force_consistency_checks: 1 2023-07-14T12:49:10.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.report_bg_io_stats: 0 2023-07-14T12:49:10.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.ttl: 2592000 2023-07-14T12:49:10.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.periodic_compaction_seconds: 0 2023-07-14T12:49:10.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-14T12:49:10.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-14T12:49:10.128 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.enable_blob_files: false 2023-07-14T12:49:10.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.min_blob_size: 0 2023-07-14T12:49:10.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.blob_file_size: 268435456 2023-07-14T12:49:10.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.blob_compression_type: NoCompression 2023-07-14T12:49:10.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.enable_blob_garbage_collection: false 2023-07-14T12:49:10.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-14T12:49:10.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-14T12:49:10.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-14T12:49:10.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.blob_file_starting_level: 0 2023-07-14T12:49:10.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-14T12:49:10.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-07-14T12:49:10.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-07-14T12:49:10.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 497a375c-3da9-4866-8711-da723493a90c 2023-07-14T12:49:10.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689338949772242, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-07-14T12:49:10.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-07-14T12:49:10.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689338949774250, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94213, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 323, "table_properties": {"data_size": 92224, "index_size": 271, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13654, "raw_average_key_size": 49, "raw_value_size": 84786, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 274, "num_filter_entries": 274, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689338949, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "497a375c-3da9-4866-8711-da723493a90c", "db_session_id": "XG3DAWRTA6XEJDDW36C4", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-07-14T12:49:10.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689338949774390, "job": 1, "event": "recovery_finished"} 2023-07-14T12:49:10.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-07-14T12:49:10.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-14T12:49:10.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564b48364000 2023-07-14T12:49:10.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: DB pointer 0x564b48350000 2023-07-14T12:49:10.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-14T12:49:10.132 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-14T12:49:10.132 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** DB Stats ** 2023-07-14T12:49:10.132 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-14T12:49:10.132 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-14T12:49:10.132 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-14T12:49:10.132 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-14T12:49:10.133 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-14T12:49:10.133 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-14T12:49:10.133 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-14T12:49:10.133 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-07-14T12:49:10.133 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2023-07-14T12:49:10.133 INFO:journalctl@ceph.mon.a.smithi017.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-14T12:49:10.133 INFO:journalctl@ceph.mon.a.smithi017.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-14T12:49:10.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: L0 2/0 93.84 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:49:10.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: Sum 2/0 93.84 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:49:10.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:49:10.134 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-07-14T12:49:10.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** Compaction Stats [default] ** 2023-07-14T12:49:10.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-14T12:49:10.135 INFO:journalctl@ceph.mon.a.smithi017.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-14T12:49:10.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 72.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:49:10.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-07-14T12:49:10.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-14T12:49:10.136 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-07-14T12:49:10.137 INFO:journalctl@ceph.mon.a.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-14T12:49:10.137 INFO:journalctl@ceph.mon.a.smithi017.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-07-14T12:49:10.137 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-14T12:49:10.138 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-07-14T12:49:10.138 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-07-14T12:49:10.138 INFO:journalctl@ceph.mon.a.smithi017.stdout: AddFile(Keys): cumulative 0, interval 0 2023-07-14T12:49:10.139 INFO:journalctl@ceph.mon.a.smithi017.stdout: Cumulative compaction: 0.00 GB write, 13.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-14T12:49:10.139 INFO:journalctl@ceph.mon.a.smithi017.stdout: Interval compaction: 0.00 GB write, 13.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-14T12:49:10.139 INFO:journalctl@ceph.mon.a.smithi017.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-14T12:49:10.140 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache BinnedLRUCache@0x564b482cb1f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-07-14T12:49:10.140 INFO:journalctl@ceph.mon.a.smithi017.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-07-14T12:49:10.140 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-07-14T12:49:10.140 INFO:journalctl@ceph.mon.a.smithi017.stdout: ** File Read Latency Histogram By Level [default] ** 2023-07-14T12:49:10.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: starting mon.a rank 0 at public addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] at bind addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:49:10.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: mon.a@-1(???) e1 preinit fsid b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:49:10.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: mon.a@-1(???).mds e1 new map 2023-07-14T12:49:10.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: mon.a@-1(???).mds e1 print_map 2023-07-14T12:49:10.141 INFO:journalctl@ceph.mon.a.smithi017.stdout: e1 2023-07-14T12:49:10.142 INFO:journalctl@ceph.mon.a.smithi017.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-07-14T12:49:10.142 INFO:journalctl@ceph.mon.a.smithi017.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-14T12:49:10.142 INFO:journalctl@ceph.mon.a.smithi017.stdout: legacy client fscid: -1 2023-07-14T12:49:10.143 INFO:journalctl@ceph.mon.a.smithi017.stdout: 2023-07-14T12:49:10.143 INFO:journalctl@ceph.mon.a.smithi017.stdout: No filesystems configured 2023-07-14T12:49:10.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-14T12:49:10.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T12:49:10.144 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T12:49:10.144 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T12:49:10.144 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-07-14T12:49:10.144 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta expand map: {default=false} 2023-07-14T12:49:10.144 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta from 'false' to 'false' 2023-07-14T12:49:10.144 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta expanded map: {default=false} 2023-07-14T12:49:10.144 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta expand map: {default=info} 2023-07-14T12:49:10.145 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta from 'info' to 'info' 2023-07-14T12:49:10.145 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta expanded map: {default=info} 2023-07-14T12:49:10.145 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta expand map: {default=daemon} 2023-07-14T12:49:10.145 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta from 'daemon' to 'daemon' 2023-07-14T12:49:10.145 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta expanded map: {default=daemon} 2023-07-14T12:49:10.145 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta expand map: {default=debug} 2023-07-14T12:49:10.145 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta from 'debug' to 'debug' 2023-07-14T12:49:10.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: expand_channel_meta expanded map: {default=debug} 2023-07-14T12:49:10.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 systemd[1]: Started Ceph mon.a for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:49:10.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: mon.a is new leader, mons a in quorum (ranks 0) 2023-07-14T12:49:10.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: monmap e1: 1 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0]} removed_ranks: {} 2023-07-14T12:49:10.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: fsmap 2023-07-14T12:49:10.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: osdmap e1: 0 total, 0 up, 0 in 2023-07-14T12:49:10.146 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:09 smithi017 ceph-mon[95536]: mgrmap e1: no daemons active 2023-07-14T12:49:10.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.353+0000 7f01a520f700 1 Processor -- start 2023-07-14T12:49:10.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.353+0000 7f01a520f700 1 -- start start 2023-07-14T12:49:10.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.354+0000 7f01a520f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a0105610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:10.919 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.354+0000 7f01a520f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a0105b50 con 0x7f01a0105200 2023-07-14T12:49:10.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.354+0000 7f019ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a0105610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:10.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.355+0000 7f019ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a0105610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35762/0 (socket says 172.21.15.17:35762) 2023-07-14T12:49:10.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.355+0000 7f019ed9d700 1 -- 172.21.15.17:0/889844252 learned_addr learned my addr 172.21.15.17:0/889844252 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:10.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.355+0000 7f019ed9d700 1 -- 172.21.15.17:0/889844252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a0105c90 con 0x7f01a0105200 2023-07-14T12:49:10.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.355+0000 7f019ed9d700 1 --2- 172.21.15.17:0/889844252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a0105610 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f01900098a0 tx=0x7f0190009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3b819ebc8b57c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:10.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.355+0000 7f019dd9b700 1 -- 172.21.15.17:0/889844252 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0190004160 con 0x7f01a0105200 2023-07-14T12:49:10.920 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.356+0000 7f019dd9b700 1 -- 172.21.15.17:0/889844252 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f01900042c0 con 0x7f01a0105200 2023-07-14T12:49:10.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.356+0000 7f019dd9b700 1 -- 172.21.15.17:0/889844252 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0190011940 con 0x7f01a0105200 2023-07-14T12:49:10.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.356+0000 7f01a520f700 1 -- 172.21.15.17:0/889844252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 msgr2=0x7f01a0105610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:10.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.356+0000 7f01a520f700 1 --2- 172.21.15.17:0/889844252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a0105610 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f01900098a0 tx=0x7f0190009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:10.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.356+0000 7f01a520f700 1 -- 172.21.15.17:0/889844252 shutdown_connections 2023-07-14T12:49:10.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.356+0000 7f01a520f700 1 --2- 172.21.15.17:0/889844252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a0105610 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:10.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.356+0000 7f01a520f700 1 -- 172.21.15.17:0/889844252 >> 172.21.15.17:0/889844252 conn(0x7f01a0100890 msgr2=0x7f01a0102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:10.921 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.356+0000 7f01a520f700 1 -- 172.21.15.17:0/889844252 shutdown_connections 2023-07-14T12:49:10.922 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.356+0000 7f01a520f700 1 -- 172.21.15.17:0/889844252 wait complete. 2023-07-14T12:49:10.922 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.357+0000 7f01a520f700 1 Processor -- start 2023-07-14T12:49:10.922 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.357+0000 7f01a520f700 1 -- start start 2023-07-14T12:49:10.922 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.358+0000 7f01a520f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a019b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:10.922 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.358+0000 7f01a520f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a019b5b0 con 0x7f01a0105200 2023-07-14T12:49:10.922 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.358+0000 7f019ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a019b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:10.922 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.358+0000 7f019ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a019b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35774/0 (socket says 172.21.15.17:35774) 2023-07-14T12:49:10.922 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.358+0000 7f019ed9d700 1 -- 172.21.15.17:0/434277908 learned_addr learned my addr 172.21.15.17:0/434277908 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:10.923 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.358+0000 7f019ed9d700 1 -- 172.21.15.17:0/434277908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190009550 con 0x7f01a0105200 2023-07-14T12:49:10.923 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.359+0000 7f019ed9d700 1 --2- 172.21.15.17:0/434277908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a019b070 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0190011dc0 tx=0x7f0190011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:10.923 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.359+0000 7f0187fff700 1 -- 172.21.15.17:0/434277908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01900037d0 con 0x7f01a0105200 2023-07-14T12:49:10.923 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.359+0000 7f0187fff700 1 -- 172.21.15.17:0/434277908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f019001b440 con 0x7f01a0105200 2023-07-14T12:49:10.923 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.359+0000 7f0187fff700 1 -- 172.21.15.17:0/434277908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f019001a560 con 0x7f01a0105200 2023-07-14T12:49:10.923 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.359+0000 7f01a520f700 1 -- 172.21.15.17:0/434277908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a019b7b0 con 0x7f01a0105200 2023-07-14T12:49:10.923 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.359+0000 7f01a520f700 1 -- 172.21.15.17:0/434277908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a019bbd0 con 0x7f01a0105200 2023-07-14T12:49:10.924 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.359+0000 7f0187fff700 1 -- 172.21.15.17:0/434277908 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f019001aad0 con 0x7f01a0105200 2023-07-14T12:49:10.924 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.360+0000 7f0187fff700 1 -- 172.21.15.17:0/434277908 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f01900193f0 con 0x7f01a0105200 2023-07-14T12:49:10.924 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.360+0000 7f01a520f700 1 -- 172.21.15.17:0/434277908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a0061b40 con 0x7f01a0105200 2023-07-14T12:49:10.924 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.363+0000 7f0187fff700 1 -- 172.21.15.17:0/434277908 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0190029060 con 0x7f01a0105200 2023-07-14T12:49:10.924 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.436+0000 7f01a520f700 1 -- 172.21.15.17:0/434277908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f01a0107060 con 0x7f01a0105200 2023-07-14T12:49:10.924 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.439+0000 7f0187fff700 1 -- 172.21.15.17:0/434277908 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f01a0107060 con 0x7f01a0105200 2023-07-14T12:49:10.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.439+0000 7f01a520f700 1 -- 172.21.15.17:0/434277908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 msgr2=0x7f01a019b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:10.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.439+0000 7f01a520f700 1 --2- 172.21.15.17:0/434277908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a019b070 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0190011dc0 tx=0x7f0190011ea0 comp rx=0 tx=0).stop 2023-07-14T12:49:10.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.440+0000 7f01a520f700 1 -- 172.21.15.17:0/434277908 shutdown_connections 2023-07-14T12:49:10.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.440+0000 7f01a520f700 1 --2- 172.21.15.17:0/434277908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01a0105200 0x7f01a019b070 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:10.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.440+0000 7f01a520f700 1 -- 172.21.15.17:0/434277908 >> 172.21.15.17:0/434277908 conn(0x7f01a0100890 msgr2=0x7f01a01015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:10.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.440+0000 7f01a520f700 1 -- 172.21.15.17:0/434277908 shutdown_connections 2023-07-14T12:49:10.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:10.440+0000 7f01a520f700 1 -- 172.21.15.17:0/434277908 wait complete. 2023-07-14T12:49:10.925 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote config to /etc/ceph/ceph.conf 2023-07-14T12:49:10.951 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-07-14T12:49:10.951 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mgr... 2023-07-14T12:49:10.952 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 9283 ... 2023-07-14T12:49:10.952 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 8765 ... 2023-07-14T12:49:11.319 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.x 2023-07-14T12:49:11.319 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.x.service: Unit ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.x.service not loaded. 2023-07-14T12:49:11.531 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b31a3268-2244-11ee-9b33-001a4aab830c.target.wants/ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.x.service → /etc/systemd/system/ceph-b31a3268-2244-11ee-9b33-001a4aab830c@.service. 2023-07-14T12:49:11.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:11 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/434277908' entity='client.admin' 2023-07-14T12:49:11.595 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:11 smithi017 systemd[1]: Starting Ceph mgr.x for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:49:12.296 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:12 smithi017 podman[95767]: 2023-07-14T12:49:12.341 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-14T12:49:12.342 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2023-07-14T12:49:12.359 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-14T12:49:12.359 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-07-14T12:49:12.359 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2023-07-14T12:49:12.359 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2023-07-14T12:49:12.380 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-14T12:49:12.380 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2023-07-14T12:49:12.398 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-14T12:49:12.399 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-07-14T12:49:12.399 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2023-07-14T12:49:12.400 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-07-14T12:49:12.400 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr to start... 2023-07-14T12:49:12.400 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr... 2023-07-14T12:49:12.576 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:12 smithi017 bash[95767]: 48a1ca61dfbcfcea3104e1024fff44b56e407629138949d23e13903055d699eb 2023-07-14T12:49:12.576 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:12 smithi017 systemd[1]: Started Ceph mgr.x for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:49:12.576 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:12 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:12.447+0000 7f7f9d0dd200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:49:12.576 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:12 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:12.556+0000 7f7f9d0dd200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:49:12.832 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:12 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:12.680+0000 7f7f9d0dd200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:49:13.095 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:12 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:12.812+0000 7f7f9d0dd200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:49:13.095 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:13 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:13.046+0000 7f7f9d0dd200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:49:13.494 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:13 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2174190548' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-14T12:49:13.596 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:13.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-07-14T12:49:13.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "b31a3268-2244-11ee-9b33-001a4aab830c", 2023-07-14T12:49:13.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2023-07-14T12:49:13.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-14T12:49:13.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-14T12:49:13.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-14T12:49:13.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:13.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-14T12:49:13.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-14T12:49:13.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2023-07-14T12:49:13.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-07-14T12:49:13.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-14T12:49:13.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2023-07-14T12:49:13.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-07-14T12:49:13.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-07-14T12:49:13.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-14T12:49:13.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:13.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-14T12:49:13.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-14T12:49:13.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:13.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-14T12:49:13.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:13.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-14T12:49:13.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-14T12:49:13.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-14T12:49:13.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-14T12:49:13.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-14T12:49:13.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-14T12:49:13.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:13.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-14T12:49:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-14T12:49:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-14T12:49:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-14T12:49:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-14T12:49:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-14T12:49:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-14T12:49:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-14T12:49:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-14T12:49:13.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:13.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-14T12:49:13.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:13.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-14T12:49:13.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-14T12:49:13.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:13.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-14T12:49:13.610 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2023-07-14T12:49:13.610 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-14T12:49:13.610 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-14T12:49:13.610 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-14T12:49:13.610 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-14T12:49:13.610 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2023-07-14T12:49:13.610 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-07-14T12:49:13.610 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T12:49:13.611 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:13.611 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-14T12:49:13.611 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:13.611 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2023-07-14T12:49:02.948392+0000", 2023-07-14T12:49:13.611 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T12:49:13.611 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:13.611 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-14T12:49:13.611 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-07-14T12:49:13.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.985+0000 7fb47ed04700 1 Processor -- start 2023-07-14T12:49:13.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.985+0000 7fb47ed04700 1 -- start start 2023-07-14T12:49:13.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.985+0000 7fb47ed04700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47807a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:13.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.985+0000 7fb47ed04700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47807a810 con 0x7fb47807bdd0 2023-07-14T12:49:13.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.986+0000 7fb47caa0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47807a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:13.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.986+0000 7fb47caa0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47807a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35808/0 (socket says 172.21.15.17:35808) 2023-07-14T12:49:13.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.986+0000 7fb47caa0700 1 -- 172.21.15.17:0/2328792034 learned_addr learned my addr 172.21.15.17:0/2328792034 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:13.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.986+0000 7fb47caa0700 1 -- 172.21.15.17:0/2328792034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47807a950 con 0x7fb47807bdd0 2023-07-14T12:49:13.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.986+0000 7fb47caa0700 1 --2- 172.21.15.17:0/2328792034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47807a2d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0098a0 tx=0x7fb46c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5cd9057fe7ffa4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:13.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.987+0000 7fb4777fe700 1 -- 172.21.15.17:0/2328792034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46c004160 con 0x7fb47807bdd0 2023-07-14T12:49:13.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.987+0000 7fb4777fe700 1 -- 172.21.15.17:0/2328792034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb46c0042c0 con 0x7fb47807bdd0 2023-07-14T12:49:13.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.987+0000 7fb4777fe700 1 -- 172.21.15.17:0/2328792034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46c011940 con 0x7fb47807bdd0 2023-07-14T12:49:13.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.987+0000 7fb47ed04700 1 -- 172.21.15.17:0/2328792034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 msgr2=0x7fb47807a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:13.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.987+0000 7fb47ed04700 1 --2- 172.21.15.17:0/2328792034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47807a2d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0098a0 tx=0x7fb46c009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:13.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.987+0000 7fb47ed04700 1 -- 172.21.15.17:0/2328792034 shutdown_connections 2023-07-14T12:49:13.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.987+0000 7fb47ed04700 1 --2- 172.21.15.17:0/2328792034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47807a2d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:13.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.987+0000 7fb47ed04700 1 -- 172.21.15.17:0/2328792034 >> 172.21.15.17:0/2328792034 conn(0x7fb478100900 msgr2=0x7fb478102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:13.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.987+0000 7fb47ed04700 1 -- 172.21.15.17:0/2328792034 shutdown_connections 2023-07-14T12:49:13.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.988+0000 7fb47ed04700 1 -- 172.21.15.17:0/2328792034 wait complete. 2023-07-14T12:49:13.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.988+0000 7fb47ed04700 1 Processor -- start 2023-07-14T12:49:13.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.989+0000 7fb47ed04700 1 -- start start 2023-07-14T12:49:13.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.989+0000 7fb47ed04700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:13.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.989+0000 7fb47ed04700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47819b6b0 con 0x7fb47807bdd0 2023-07-14T12:49:13.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.989+0000 7fb47caa0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:13.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.989+0000 7fb47caa0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35822/0 (socket says 172.21.15.17:35822) 2023-07-14T12:49:13.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.989+0000 7fb47caa0700 1 -- 172.21.15.17:0/2174190548 learned_addr learned my addr 172.21.15.17:0/2174190548 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:13.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.990+0000 7fb47caa0700 1 -- 172.21.15.17:0/2174190548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c009550 con 0x7fb47807bdd0 2023-07-14T12:49:13.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.990+0000 7fb47caa0700 1 --2- 172.21.15.17:0/2174190548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47819b170 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb46c000c00 tx=0x7fb46c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:13.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.990+0000 7fb475ffb700 1 -- 172.21.15.17:0/2174190548 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46c0036a0 con 0x7fb47807bdd0 2023-07-14T12:49:13.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.990+0000 7fb475ffb700 1 -- 172.21.15.17:0/2174190548 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb46c003c70 con 0x7fb47807bdd0 2023-07-14T12:49:13.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.990+0000 7fb475ffb700 1 -- 172.21.15.17:0/2174190548 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb46c0193f0 con 0x7fb47807bdd0 2023-07-14T12:49:13.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.990+0000 7fb47ed04700 1 -- 172.21.15.17:0/2174190548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47819b8b0 con 0x7fb47807bdd0 2023-07-14T12:49:13.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.990+0000 7fb47ed04700 1 -- 172.21.15.17:0/2174190548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47819bcd0 con 0x7fb47807bdd0 2023-07-14T12:49:13.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.990+0000 7fb475ffb700 1 -- 172.21.15.17:0/2174190548 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb46c019920 con 0x7fb47807bdd0 2023-07-14T12:49:13.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.991+0000 7fb475ffb700 1 -- 172.21.15.17:0/2174190548 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb46c01a3d0 con 0x7fb47807bdd0 2023-07-14T12:49:13.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.991+0000 7fb47ed04700 1 -- 172.21.15.17:0/2174190548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb478061b40 con 0x7fb47807bdd0 2023-07-14T12:49:13.617 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:12.994+0000 7fb475ffb700 1 -- 172.21.15.17:0/2174190548 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fb46c029060 con 0x7fb47807bdd0 2023-07-14T12:49:13.617 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:13.071+0000 7fb47ed04700 1 -- 172.21.15.17:0/2174190548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb47819e710 con 0x7fb47807bdd0 2023-07-14T12:49:13.617 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:13.071+0000 7fb475ffb700 1 -- 172.21.15.17:0/2174190548 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fb46c033090 con 0x7fb47807bdd0 2023-07-14T12:49:13.617 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:13.072+0000 7fb47ed04700 1 -- 172.21.15.17:0/2174190548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 msgr2=0x7fb47819b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:13.617 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:13.072+0000 7fb47ed04700 1 --2- 172.21.15.17:0/2174190548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47819b170 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb46c000c00 tx=0x7fb46c011e70 comp rx=0 tx=0).stop 2023-07-14T12:49:13.617 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:13.072+0000 7fb47ed04700 1 -- 172.21.15.17:0/2174190548 shutdown_connections 2023-07-14T12:49:13.617 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:13.072+0000 7fb47ed04700 1 --2- 172.21.15.17:0/2174190548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb47807bdd0 0x7fb47819b170 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:13.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:13.072+0000 7fb47ed04700 1 -- 172.21.15.17:0/2174190548 >> 172.21.15.17:0/2174190548 conn(0x7fb478100900 msgr2=0x7fb478102000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:13.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:13.073+0000 7fb47ed04700 1 -- 172.21.15.17:0/2174190548 shutdown_connections 2023-07-14T12:49:13.618 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:13.073+0000 7fb47ed04700 1 -- 172.21.15.17:0/2174190548 wait complete. 2023-07-14T12:49:13.618 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (1/15)... 2023-07-14T12:49:13.780 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:13 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:13.475+0000 7f7f9d0dd200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:49:13.781 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:13 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:13.595+0000 7f7f9d0dd200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:49:13.781 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:13 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:13.761+0000 7f7f9d0dd200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:49:14.095 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:13 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:13.887+0000 7f7f9d0dd200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:49:14.845 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:14 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:14.447+0000 7f7f9d0dd200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:49:15.595 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:15 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:15.252+0000 7f7f9d0dd200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T12:49:15.595 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:15 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:15.463+0000 7f7f9d0dd200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:49:16.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:16 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2445936208' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-14T12:49:16.596 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:16 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:16.500+0000 7f7f9d0dd200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:49:17.095 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:16 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:16.628+0000 7f7f9d0dd200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:49:17.095 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:16 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:16.864+0000 7f7f9d0dd200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:49:17.540 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:17 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:17.238+0000 7f7f9d0dd200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T12:49:17.845 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:17 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:17.521+0000 7f7f9d0dd200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:49:17.845 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:17 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:17.726+0000 7f7f9d0dd200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:49:18.595 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:18 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:18.080+0000 7f7f9d0dd200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:49:19.345 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:19 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:19.047+0000 7f7f9d0dd200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:49:19.345 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:19 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:19.229+0000 7f7f9d0dd200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:49:19.845 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:19 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:19.483+0000 7f7f9d0dd200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:49:19.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:19 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:19.635+0000 7f7f9d0dd200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:49:20.345 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:19 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:19.922+0000 7f7f9d0dd200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:49:21.345 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:21.029+0000 7f7f9d0dd200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:49:21.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: Activating manager daemon x 2023-07-14T12:49:21.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: mgrmap e2: x(active, starting, since 0.00413028s) 2023-07-14T12:49:21.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: from='mgr.14100 172.21.15.17:0/3142308287' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-14T12:49:21.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: from='mgr.14100 172.21.15.17:0/3142308287' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-14T12:49:21.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: from='mgr.14100 172.21.15.17:0/3142308287' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-14T12:49:21.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: from='mgr.14100 172.21.15.17:0/3142308287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:49:21.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: from='mgr.14100 172.21.15.17:0/3142308287' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-14T12:49:21.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: Manager daemon x is now available 2023-07-14T12:49:21.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: from='mgr.14100 172.21.15.17:0/3142308287' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T12:49:21.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: from='mgr.14100 172.21.15.17:0/3142308287' entity='mgr.x' 2023-07-14T12:49:21.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: from='mgr.14100 172.21.15.17:0/3142308287' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T12:49:21.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: from='mgr.14100 172.21.15.17:0/3142308287' entity='mgr.x' 2023-07-14T12:49:21.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:21 smithi017 ceph-mon[95536]: from='mgr.14100 172.21.15.17:0/3142308287' entity='mgr.x' 2023-07-14T12:49:23.345 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:23 smithi017 ceph-mon[95536]: mgrmap e3: x(active, since 1.01087s) 2023-07-14T12:49:24.345 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:24 smithi017 ceph-mon[95536]: mgrmap e4: x(active, since 2s) 2023-07-14T12:49:25.309 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:25.309 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-07-14T12:49:25.309 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "b31a3268-2244-11ee-9b33-001a4aab830c", 2023-07-14T12:49:25.309 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2023-07-14T12:49:25.309 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-14T12:49:25.309 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-14T12:49:25.310 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-14T12:49:25.310 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:25.310 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-14T12:49:25.310 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-14T12:49:25.310 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2023-07-14T12:49:25.310 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-07-14T12:49:25.312 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-14T12:49:25.312 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2023-07-14T12:49:25.312 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-07-14T12:49:25.312 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-07-14T12:49:25.312 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-14T12:49:25.313 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:25.313 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-14T12:49:25.313 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-14T12:49:25.313 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:25.313 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-14T12:49:25.313 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:25.313 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-14T12:49:25.314 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-14T12:49:25.314 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-14T12:49:25.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-14T12:49:25.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-14T12:49:25.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-14T12:49:25.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:25.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-14T12:49:25.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-14T12:49:25.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-14T12:49:25.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-14T12:49:25.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-14T12:49:25.322 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-14T12:49:25.322 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-14T12:49:25.324 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-14T12:49:25.324 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-14T12:49:25.324 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:25.324 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-14T12:49:25.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:25.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-14T12:49:25.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-14T12:49:25.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:25.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-14T12:49:25.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2023-07-14T12:49:25.325 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-14T12:49:25.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-14T12:49:25.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-14T12:49:25.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-14T12:49:25.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2023-07-14T12:49:25.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-07-14T12:49:25.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T12:49:25.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:25.326 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-14T12:49:25.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:25.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2023-07-14T12:49:02.948392+0000", 2023-07-14T12:49:25.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T12:49:25.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:25.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-14T12:49:25.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-07-14T12:49:25.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.175+0000 7f6baac0a700 1 Processor -- start 2023-07-14T12:49:25.327 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.175+0000 7f6baac0a700 1 -- start start 2023-07-14T12:49:25.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.175+0000 7f6baac0a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba407a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:25.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.175+0000 7f6baac0a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba407a830 con 0x7f6ba407bdf0 2023-07-14T12:49:25.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.175+0000 7f6ba89a6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba407a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:25.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.176+0000 7f6ba89a6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba407a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53310/0 (socket says 172.21.15.17:53310) 2023-07-14T12:49:25.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.176+0000 7f6ba89a6700 1 -- 172.21.15.17:0/3235769254 learned_addr learned my addr 172.21.15.17:0/3235769254 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:25.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.176+0000 7f6ba89a6700 1 -- 172.21.15.17:0/3235769254 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba407a970 con 0x7f6ba407bdf0 2023-07-14T12:49:25.328 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.176+0000 7f6ba89a6700 1 --2- 172.21.15.17:0/3235769254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba407a2f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6b980098a0 tx=0x7f6b98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25363ebe03ca0664 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:25.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.176+0000 7f6ba37fe700 1 -- 172.21.15.17:0/3235769254 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b98004160 con 0x7f6ba407bdf0 2023-07-14T12:49:25.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.176+0000 7f6ba37fe700 1 -- 172.21.15.17:0/3235769254 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6b980042c0 con 0x7f6ba407bdf0 2023-07-14T12:49:25.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.177+0000 7f6ba37fe700 1 -- 172.21.15.17:0/3235769254 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b98011940 con 0x7f6ba407bdf0 2023-07-14T12:49:25.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.177+0000 7f6baac0a700 1 -- 172.21.15.17:0/3235769254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 msgr2=0x7f6ba407a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:25.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.177+0000 7f6baac0a700 1 --2- 172.21.15.17:0/3235769254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba407a2f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6b980098a0 tx=0x7f6b98009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:25.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.177+0000 7f6baac0a700 1 -- 172.21.15.17:0/3235769254 shutdown_connections 2023-07-14T12:49:25.329 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.177+0000 7f6baac0a700 1 --2- 172.21.15.17:0/3235769254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba407a2f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:25.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.177+0000 7f6baac0a700 1 -- 172.21.15.17:0/3235769254 >> 172.21.15.17:0/3235769254 conn(0x7f6ba4100900 msgr2=0x7f6ba4102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:25.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.177+0000 7f6baac0a700 1 -- 172.21.15.17:0/3235769254 shutdown_connections 2023-07-14T12:49:25.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.177+0000 7f6baac0a700 1 -- 172.21.15.17:0/3235769254 wait complete. 2023-07-14T12:49:25.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.179+0000 7f6baac0a700 1 Processor -- start 2023-07-14T12:49:25.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.179+0000 7f6baac0a700 1 -- start start 2023-07-14T12:49:25.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.179+0000 7f6baac0a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba419b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:25.330 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.180+0000 7f6baac0a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba419b6b0 con 0x7f6ba407bdf0 2023-07-14T12:49:25.331 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.180+0000 7f6ba89a6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba419b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:25.331 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.180+0000 7f6ba89a6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba419b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53314/0 (socket says 172.21.15.17:53314) 2023-07-14T12:49:25.331 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.180+0000 7f6ba89a6700 1 -- 172.21.15.17:0/2445936208 learned_addr learned my addr 172.21.15.17:0/2445936208 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:25.331 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.180+0000 7f6ba89a6700 1 -- 172.21.15.17:0/2445936208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98009550 con 0x7f6ba407bdf0 2023-07-14T12:49:25.331 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.180+0000 7f6ba89a6700 1 --2- 172.21.15.17:0/2445936208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba419b170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6b98006af0 tx=0x7f6b98011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:25.331 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.181+0000 7f6ba1ffb700 1 -- 172.21.15.17:0/2445936208 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b98003bf0 con 0x7f6ba407bdf0 2023-07-14T12:49:25.331 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.181+0000 7f6ba1ffb700 1 -- 172.21.15.17:0/2445936208 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6b9801b8b0 con 0x7f6ba407bdf0 2023-07-14T12:49:25.332 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.181+0000 7f6ba1ffb700 1 -- 172.21.15.17:0/2445936208 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b980197e0 con 0x7f6ba407bdf0 2023-07-14T12:49:25.332 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.181+0000 7f6baac0a700 1 -- 172.21.15.17:0/2445936208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba419b8b0 con 0x7f6ba407bdf0 2023-07-14T12:49:25.332 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.181+0000 7f6baac0a700 1 -- 172.21.15.17:0/2445936208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba419bcd0 con 0x7f6ba407bdf0 2023-07-14T12:49:25.332 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.181+0000 7f6ba1ffb700 1 -- 172.21.15.17:0/2445936208 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6b980233f0 con 0x7f6ba407bdf0 2023-07-14T12:49:25.332 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.181+0000 7f6ba1ffb700 1 -- 172.21.15.17:0/2445936208 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6b9801a710 con 0x7f6ba407bdf0 2023-07-14T12:49:25.332 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.182+0000 7f6baac0a700 1 -- 172.21.15.17:0/2445936208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba4061b40 con 0x7f6ba407bdf0 2023-07-14T12:49:25.332 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.185+0000 7f6ba1ffb700 1 -- 172.21.15.17:0/2445936208 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6b98028060 con 0x7f6ba407bdf0 2023-07-14T12:49:25.333 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.262+0000 7f6baac0a700 1 -- 172.21.15.17:0/2445936208 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6ba419e710 con 0x7f6ba407bdf0 2023-07-14T12:49:25.333 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.263+0000 7f6ba1ffb700 1 -- 172.21.15.17:0/2445936208 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f6b9801bd70 con 0x7f6ba407bdf0 2023-07-14T12:49:25.333 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.264+0000 7f6baac0a700 1 -- 172.21.15.17:0/2445936208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 msgr2=0x7f6ba419b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:25.333 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.264+0000 7f6baac0a700 1 --2- 172.21.15.17:0/2445936208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba419b170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6b98006af0 tx=0x7f6b98011a30 comp rx=0 tx=0).stop 2023-07-14T12:49:25.333 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.264+0000 7f6baac0a700 1 -- 172.21.15.17:0/2445936208 shutdown_connections 2023-07-14T12:49:25.333 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.264+0000 7f6baac0a700 1 --2- 172.21.15.17:0/2445936208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ba407bdf0 0x7f6ba419b170 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:25.333 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.264+0000 7f6baac0a700 1 -- 172.21.15.17:0/2445936208 >> 172.21.15.17:0/2445936208 conn(0x7f6ba4100900 msgr2=0x7f6ba4101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:25.334 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.264+0000 7f6baac0a700 1 -- 172.21.15.17:0/2445936208 shutdown_connections 2023-07-14T12:49:25.334 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:16.264+0000 7f6baac0a700 1 -- 172.21.15.17:0/2445936208 wait complete. 2023-07-14T12:49:25.334 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (2/15)... 2023-07-14T12:49:28.595 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:28 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/993773050' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-14T12:49:28.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:28.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-07-14T12:49:28.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "b31a3268-2244-11ee-9b33-001a4aab830c", 2023-07-14T12:49:28.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2023-07-14T12:49:28.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-14T12:49:28.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-14T12:49:28.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-14T12:49:28.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:28.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-14T12:49:28.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-14T12:49:28.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2023-07-14T12:49:28.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-07-14T12:49:28.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-14T12:49:28.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "a" 2023-07-14T12:49:28.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-07-14T12:49:28.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 18, 2023-07-14T12:49:28.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-14T12:49:28.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:28.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-14T12:49:28.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-14T12:49:28.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:28.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-14T12:49:28.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:28.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-14T12:49:28.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-14T12:49:28.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-14T12:49:28.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-14T12:49:28.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-14T12:49:28.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-14T12:49:28.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:28.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-14T12:49:28.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-14T12:49:28.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-14T12:49:28.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-14T12:49:28.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-14T12:49:28.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-14T12:49:28.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-14T12:49:28.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-14T12:49:28.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-14T12:49:28.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:28.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-14T12:49:28.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:28.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-14T12:49:28.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-14T12:49:28.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:28.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-14T12:49:28.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-14T12:49:28.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-14T12:49:28.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-14T12:49:28.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-14T12:49:28.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-14T12:49:28.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2023-07-14T12:49:28.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2023-07-14T12:49:28.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T12:49:28.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:28.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-14T12:49:28.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T12:49:28.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2023-07-14T12:49:02.948392+0000", 2023-07-14T12:49:28.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T12:49:28.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2023-07-14T12:49:28.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-14T12:49:28.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-07-14T12:49:28.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.869+0000 7f5d87dc2700 1 Processor -- start 2023-07-14T12:49:28.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.869+0000 7f5d87dc2700 1 -- start start 2023-07-14T12:49:28.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.869+0000 7f5d87dc2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8007a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:28.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.869+0000 7f5d87dc2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8007a830 con 0x7f5d8007bdf0 2023-07-14T12:49:28.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.870+0000 7f5d85b5e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8007a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:28.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.870+0000 7f5d85b5e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8007a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40936/0 (socket says 172.21.15.17:40936) 2023-07-14T12:49:28.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.870+0000 7f5d85b5e700 1 -- 172.21.15.17:0/3449243608 learned_addr learned my addr 172.21.15.17:0/3449243608 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:28.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.870+0000 7f5d85b5e700 1 -- 172.21.15.17:0/3449243608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8007a970 con 0x7f5d8007bdf0 2023-07-14T12:49:28.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.870+0000 7f5d85b5e700 1 --2- 172.21.15.17:0/3449243608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8007a2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0098a0 tx=0x7f5d7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390c0deca89d0b53 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:28.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.871+0000 7f5d84b5c700 1 -- 172.21.15.17:0/3449243608 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d7c004160 con 0x7f5d8007bdf0 2023-07-14T12:49:28.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.871+0000 7f5d84b5c700 1 -- 172.21.15.17:0/3449243608 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5d7c0042c0 con 0x7f5d8007bdf0 2023-07-14T12:49:28.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.871+0000 7f5d84b5c700 1 -- 172.21.15.17:0/3449243608 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d7c011940 con 0x7f5d8007bdf0 2023-07-14T12:49:28.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.871+0000 7f5d87dc2700 1 -- 172.21.15.17:0/3449243608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 msgr2=0x7f5d8007a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:28.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.871+0000 7f5d87dc2700 1 --2- 172.21.15.17:0/3449243608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8007a2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0098a0 tx=0x7f5d7c009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:28.724 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.871+0000 7f5d87dc2700 1 -- 172.21.15.17:0/3449243608 shutdown_connections 2023-07-14T12:49:28.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.871+0000 7f5d87dc2700 1 --2- 172.21.15.17:0/3449243608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8007a2f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:28.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.871+0000 7f5d87dc2700 1 -- 172.21.15.17:0/3449243608 >> 172.21.15.17:0/3449243608 conn(0x7f5d80100900 msgr2=0x7f5d80102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:28.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.871+0000 7f5d87dc2700 1 -- 172.21.15.17:0/3449243608 shutdown_connections 2023-07-14T12:49:28.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.871+0000 7f5d87dc2700 1 -- 172.21.15.17:0/3449243608 wait complete. 2023-07-14T12:49:28.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.873+0000 7f5d87dc2700 1 Processor -- start 2023-07-14T12:49:28.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.873+0000 7f5d87dc2700 1 -- start start 2023-07-14T12:49:28.725 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.873+0000 7f5d87dc2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:28.726 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.873+0000 7f5d87dc2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8019b6b0 con 0x7f5d8007bdf0 2023-07-14T12:49:28.726 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.873+0000 7f5d85b5e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:28.726 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.873+0000 7f5d85b5e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8019b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40946/0 (socket says 172.21.15.17:40946) 2023-07-14T12:49:28.726 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.873+0000 7f5d85b5e700 1 -- 172.21.15.17:0/993773050 learned_addr learned my addr 172.21.15.17:0/993773050 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:28.726 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.874+0000 7f5d85b5e700 1 -- 172.21.15.17:0/993773050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c009550 con 0x7f5d8007bdf0 2023-07-14T12:49:28.726 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.874+0000 7f5d85b5e700 1 --2- 172.21.15.17:0/993773050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8019b170 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c000c00 tx=0x7f5d7c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:28.726 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.874+0000 7f5d76ffd700 1 -- 172.21.15.17:0/993773050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d7c0036a0 con 0x7f5d8007bdf0 2023-07-14T12:49:28.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.874+0000 7f5d76ffd700 1 -- 172.21.15.17:0/993773050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f5d7c003c70 con 0x7f5d8007bdf0 2023-07-14T12:49:28.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.874+0000 7f5d76ffd700 1 -- 172.21.15.17:0/993773050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d7c0193f0 con 0x7f5d8007bdf0 2023-07-14T12:49:28.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.874+0000 7f5d87dc2700 1 -- 172.21.15.17:0/993773050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8019b8b0 con 0x7f5d8007bdf0 2023-07-14T12:49:28.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.874+0000 7f5d87dc2700 1 -- 172.21.15.17:0/993773050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8019bcd0 con 0x7f5d8007bdf0 2023-07-14T12:49:28.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.875+0000 7f5d87dc2700 1 -- 172.21.15.17:0/993773050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8010b510 con 0x7f5d8007bdf0 2023-07-14T12:49:28.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.875+0000 7f5d76ffd700 1 -- 172.21.15.17:0/993773050 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f5d7c01b440 con 0x7f5d8007bdf0 2023-07-14T12:49:28.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.876+0000 7f5d76ffd700 1 --2- 172.21.15.17:0/993773050 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f5d6c038710 0x7f5d6c03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:28.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.876+0000 7f5d76ffd700 1 -- 172.21.15.17:0/993773050 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5d7c04c470 con 0x7f5d8007bdf0 2023-07-14T12:49:28.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.876+0000 7f5d8535d700 1 --2- 172.21.15.17:0/993773050 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f5d6c038710 0x7f5d6c03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:28.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.877+0000 7f5d8535d700 1 --2- 172.21.15.17:0/993773050 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f5d6c038710 0x7f5d6c03abc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5d70006fd0 tx=0x7f5d70006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:28.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:27.882+0000 7f5d76ffd700 1 -- 172.21.15.17:0/993773050 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5d7c022930 con 0x7f5d8007bdf0 2023-07-14T12:49:28.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.166+0000 7f5d87dc2700 1 -- 172.21.15.17:0/993773050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5d8010b700 con 0x7f5d8007bdf0 2023-07-14T12:49:28.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.167+0000 7f5d76ffd700 1 -- 172.21.15.17:0/993773050 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f5d7c01f070 con 0x7f5d8007bdf0 2023-07-14T12:49:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.169+0000 7f5d87dc2700 1 -- 172.21.15.17:0/993773050 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f5d6c038710 msgr2=0x7f5d6c03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.169+0000 7f5d87dc2700 1 --2- 172.21.15.17:0/993773050 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f5d6c038710 0x7f5d6c03abc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5d70006fd0 tx=0x7f5d70006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.169+0000 7f5d87dc2700 1 -- 172.21.15.17:0/993773050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 msgr2=0x7f5d8019b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.169+0000 7f5d87dc2700 1 --2- 172.21.15.17:0/993773050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8019b170 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c000c00 tx=0x7f5d7c011e70 comp rx=0 tx=0).stop 2023-07-14T12:49:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.169+0000 7f5d87dc2700 1 -- 172.21.15.17:0/993773050 shutdown_connections 2023-07-14T12:49:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.169+0000 7f5d87dc2700 1 --2- 172.21.15.17:0/993773050 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f5d6c038710 0x7f5d6c03abc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.169+0000 7f5d87dc2700 1 --2- 172.21.15.17:0/993773050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5d8007bdf0 0x7f5d8019b170 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:28.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.169+0000 7f5d87dc2700 1 -- 172.21.15.17:0/993773050 >> 172.21.15.17:0/993773050 conn(0x7f5d80100900 msgr2=0x7f5d80101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:28.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.169+0000 7f5d87dc2700 1 -- 172.21.15.17:0/993773050 shutdown_connections 2023-07-14T12:49:28.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:28.169+0000 7f5d87dc2700 1 -- 172.21.15.17:0/993773050 wait complete. 2023-07-14T12:49:28.730 INFO:teuthology.orchestra.run.smithi017.stdout:mgr is available 2023-07-14T12:49:29.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:29 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1069830825' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-07-14T12:49:29.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:29.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2023-07-14T12:49:29.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:49:29.996 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-07-14T12:49:29.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-07-14T12:49:29.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-07-14T12:49:29.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-07-14T12:49:29.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:29.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2023-07-14T12:49:29.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-07-14T12:49:29.997 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2023-07-14T12:49:29.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2023-07-14T12:49:29.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-07-14T12:49:29.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-07-14T12:49:29.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-07-14T12:49:29.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-07-14T12:49:29.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-07-14T12:49:29.998 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.261+0000 7fa5cc941700 1 Processor -- start 2023-07-14T12:49:29.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.261+0000 7fa5cc941700 1 -- start start 2023-07-14T12:49:29.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.262+0000 7fa5cc941700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c807a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:29.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.262+0000 7fa5cc941700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c807a850 con 0x7fa5c807be10 2023-07-14T12:49:29.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.262+0000 7fa5c659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c807a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:29.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.262+0000 7fa5c659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c807a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40948/0 (socket says 172.21.15.17:40948) 2023-07-14T12:49:29.999 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.262+0000 7fa5c659c700 1 -- 172.21.15.17:0/2964707327 learned_addr learned my addr 172.21.15.17:0/2964707327 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:30.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.262+0000 7fa5c659c700 1 -- 172.21.15.17:0/2964707327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c807a990 con 0x7fa5c807be10 2023-07-14T12:49:30.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.263+0000 7fa5c659c700 1 --2- 172.21.15.17:0/2964707327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c807a310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80098a0 tx=0x7fa5b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63bb00978592b7c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:30.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.263+0000 7fa5c559a700 1 -- 172.21.15.17:0/2964707327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8004160 con 0x7fa5c807be10 2023-07-14T12:49:30.000 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.263+0000 7fa5c559a700 1 -- 172.21.15.17:0/2964707327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa5b80042c0 con 0x7fa5c807be10 2023-07-14T12:49:30.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.263+0000 7fa5c559a700 1 -- 172.21.15.17:0/2964707327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8011940 con 0x7fa5c807be10 2023-07-14T12:49:30.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.264+0000 7fa5cc941700 1 -- 172.21.15.17:0/2964707327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 msgr2=0x7fa5c807a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:30.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.264+0000 7fa5cc941700 1 --2- 172.21.15.17:0/2964707327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c807a310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80098a0 tx=0x7fa5b8009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:30.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.264+0000 7fa5cc941700 1 -- 172.21.15.17:0/2964707327 shutdown_connections 2023-07-14T12:49:30.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.264+0000 7fa5cc941700 1 --2- 172.21.15.17:0/2964707327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c807a310 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:30.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.264+0000 7fa5cc941700 1 -- 172.21.15.17:0/2964707327 >> 172.21.15.17:0/2964707327 conn(0x7fa5c8100900 msgr2=0x7fa5c8102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:30.001 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.264+0000 7fa5cc941700 1 -- 172.21.15.17:0/2964707327 shutdown_connections 2023-07-14T12:49:30.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.264+0000 7fa5cc941700 1 -- 172.21.15.17:0/2964707327 wait complete. 2023-07-14T12:49:30.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.265+0000 7fa5cc941700 1 Processor -- start 2023-07-14T12:49:30.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.265+0000 7fa5cc941700 1 -- start start 2023-07-14T12:49:30.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.265+0000 7fa5cc941700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:30.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.265+0000 7fa5cc941700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c819b6e0 con 0x7fa5c807be10 2023-07-14T12:49:30.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.266+0000 7fa5c659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:30.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.266+0000 7fa5c659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c819b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40964/0 (socket says 172.21.15.17:40964) 2023-07-14T12:49:30.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.266+0000 7fa5c659c700 1 -- 172.21.15.17:0/1069830825 learned_addr learned my addr 172.21.15.17:0/1069830825 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:30.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.266+0000 7fa5c659c700 1 -- 172.21.15.17:0/1069830825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b8009550 con 0x7fa5c807be10 2023-07-14T12:49:30.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.266+0000 7fa5c659c700 1 --2- 172.21.15.17:0/1069830825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c819b1a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8000c00 tx=0x7fa5b8004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:30.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.266+0000 7fa5b77fe700 1 -- 172.21.15.17:0/1069830825 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5b80036a0 con 0x7fa5c807be10 2023-07-14T12:49:30.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.266+0000 7fa5b77fe700 1 -- 172.21.15.17:0/1069830825 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa5b8003c70 con 0x7fa5c807be10 2023-07-14T12:49:30.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.266+0000 7fa5b77fe700 1 -- 172.21.15.17:0/1069830825 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8024d70 con 0x7fa5c807be10 2023-07-14T12:49:30.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.266+0000 7fa5cc941700 1 -- 172.21.15.17:0/1069830825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c819b8e0 con 0x7fa5c807be10 2023-07-14T12:49:30.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.267+0000 7fa5cc941700 1 -- 172.21.15.17:0/1069830825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c819bd00 con 0x7fa5c807be10 2023-07-14T12:49:30.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.268+0000 7fa5b77fe700 1 -- 172.21.15.17:0/1069830825 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7fa5b80245d0 con 0x7fa5c807be10 2023-07-14T12:49:30.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.268+0000 7fa5cc941700 1 -- 172.21.15.17:0/1069830825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c8061b40 con 0x7fa5c807be10 2023-07-14T12:49:30.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.268+0000 7fa5b77fe700 1 --2- 172.21.15.17:0/1069830825 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7fa5b0038710 0x7fa5b003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:30.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.268+0000 7fa5b77fe700 1 -- 172.21.15.17:0/1069830825 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa5b804c2d0 con 0x7fa5c807be10 2023-07-14T12:49:30.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.268+0000 7fa5c5d9b700 1 --2- 172.21.15.17:0/1069830825 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7fa5b0038710 0x7fa5b003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:30.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.269+0000 7fa5c5d9b700 1 --2- 172.21.15.17:0/1069830825 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7fa5b0038710 0x7fa5b003abc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc006fd0 tx=0x7fa5bc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:30.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.273+0000 7fa5b77fe700 1 -- 172.21.15.17:0/1069830825 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa5b80189a0 con 0x7fa5c807be10 2023-07-14T12:49:30.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.478+0000 7fa5cc941700 1 -- 172.21.15.17:0/1069830825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fa5c819eb80 con 0x7fa5c807be10 2023-07-14T12:49:30.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.478+0000 7fa5b77fe700 1 -- 172.21.15.17:0/1069830825 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fa5b8018350 con 0x7fa5c807be10 2023-07-14T12:49:30.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.481+0000 7fa5cc941700 1 -- 172.21.15.17:0/1069830825 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7fa5b0038710 msgr2=0x7fa5b003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:30.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.481+0000 7fa5cc941700 1 --2- 172.21.15.17:0/1069830825 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7fa5b0038710 0x7fa5b003abc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc006fd0 tx=0x7fa5bc006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:30.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.481+0000 7fa5cc941700 1 -- 172.21.15.17:0/1069830825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 msgr2=0x7fa5c819b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:30.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.481+0000 7fa5cc941700 1 --2- 172.21.15.17:0/1069830825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c819b1a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8000c00 tx=0x7fa5b8004250 comp rx=0 tx=0).stop 2023-07-14T12:49:30.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.481+0000 7fa5cc941700 1 -- 172.21.15.17:0/1069830825 shutdown_connections 2023-07-14T12:49:30.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.481+0000 7fa5cc941700 1 --2- 172.21.15.17:0/1069830825 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7fa5b0038710 0x7fa5b003abc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:30.007 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.481+0000 7fa5cc941700 1 --2- 172.21.15.17:0/1069830825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5c807be10 0x7fa5c819b1a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:30.007 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.481+0000 7fa5cc941700 1 -- 172.21.15.17:0/1069830825 >> 172.21.15.17:0/1069830825 conn(0x7fa5c8100900 msgr2=0x7fa5c8102000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:30.007 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.481+0000 7fa5cc941700 1 -- 172.21.15.17:0/1069830825 shutdown_connections 2023-07-14T12:49:30.007 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:29.481+0000 7fa5cc941700 1 -- 172.21.15.17:0/1069830825 wait complete. 2023-07-14T12:49:30.007 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling cephadm module... 2023-07-14T12:49:31.558 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:31 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/153856545' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-07-14T12:49:31.559 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:31 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: ignoring --setuser ceph since I am not root 2023-07-14T12:49:31.559 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:31 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: ignoring --setgroup ceph since I am not root 2023-07-14T12:49:31.773 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.947+0000 7f3e2fc11700 1 Processor -- start 2023-07-14T12:49:31.773 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.947+0000 7f3e2fc11700 1 -- start start 2023-07-14T12:49:31.774 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.948+0000 7f3e2fc11700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2807a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:31.774 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.948+0000 7f3e2fc11700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2807a850 con 0x7f3e2807be10 2023-07-14T12:49:31.774 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.948+0000 7f3e2d9ad700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2807a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:31.774 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.948+0000 7f3e2d9ad700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2807a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40968/0 (socket says 172.21.15.17:40968) 2023-07-14T12:49:31.776 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.948+0000 7f3e2d9ad700 1 -- 172.21.15.17:0/3635869024 learned_addr learned my addr 172.21.15.17:0/3635869024 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:31.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.949+0000 7f3e2d9ad700 1 -- 172.21.15.17:0/3635869024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2807a990 con 0x7f3e2807be10 2023-07-14T12:49:31.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.949+0000 7f3e2d9ad700 1 --2- 172.21.15.17:0/3635869024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2807a310 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e240098a0 tx=0x7f3e24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb15d9c0e2c83d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:31.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.949+0000 7f3e2c9ab700 1 -- 172.21.15.17:0/3635869024 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e24004160 con 0x7f3e2807be10 2023-07-14T12:49:31.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.949+0000 7f3e2c9ab700 1 -- 172.21.15.17:0/3635869024 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f3e240042c0 con 0x7f3e2807be10 2023-07-14T12:49:31.777 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.949+0000 7f3e2c9ab700 1 -- 172.21.15.17:0/3635869024 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e24011940 con 0x7f3e2807be10 2023-07-14T12:49:31.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.950+0000 7f3e2fc11700 1 -- 172.21.15.17:0/3635869024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 msgr2=0x7f3e2807a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:31.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.950+0000 7f3e2fc11700 1 --2- 172.21.15.17:0/3635869024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2807a310 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e240098a0 tx=0x7f3e24009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:31.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.950+0000 7f3e2fc11700 1 -- 172.21.15.17:0/3635869024 shutdown_connections 2023-07-14T12:49:31.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.950+0000 7f3e2fc11700 1 --2- 172.21.15.17:0/3635869024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2807a310 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:31.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.950+0000 7f3e2fc11700 1 -- 172.21.15.17:0/3635869024 >> 172.21.15.17:0/3635869024 conn(0x7f3e28100890 msgr2=0x7f3e28102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:31.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.950+0000 7f3e2fc11700 1 -- 172.21.15.17:0/3635869024 shutdown_connections 2023-07-14T12:49:31.778 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.950+0000 7f3e2fc11700 1 -- 172.21.15.17:0/3635869024 wait complete. 2023-07-14T12:49:31.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.951+0000 7f3e2fc11700 1 Processor -- start 2023-07-14T12:49:31.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.951+0000 7f3e2fc11700 1 -- start start 2023-07-14T12:49:31.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.951+0000 7f3e2fc11700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:31.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.951+0000 7f3e2fc11700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2819b5e0 con 0x7f3e2807be10 2023-07-14T12:49:31.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.952+0000 7f3e2d9ad700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:31.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.952+0000 7f3e2d9ad700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2819b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40982/0 (socket says 172.21.15.17:40982) 2023-07-14T12:49:31.779 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.952+0000 7f3e2d9ad700 1 -- 172.21.15.17:0/153856545 learned_addr learned my addr 172.21.15.17:0/153856545 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:31.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.952+0000 7f3e2d9ad700 1 -- 172.21.15.17:0/153856545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e24009550 con 0x7f3e2807be10 2023-07-14T12:49:31.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.952+0000 7f3e2d9ad700 1 --2- 172.21.15.17:0/153856545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2819b0a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e24000c00 tx=0x7f3e24004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:31.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.952+0000 7f3e1effd700 1 -- 172.21.15.17:0/153856545 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e240036a0 con 0x7f3e2807be10 2023-07-14T12:49:31.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.952+0000 7f3e1effd700 1 -- 172.21.15.17:0/153856545 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f3e24003c70 con 0x7f3e2807be10 2023-07-14T12:49:31.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.952+0000 7f3e1effd700 1 -- 172.21.15.17:0/153856545 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e24024d70 con 0x7f3e2807be10 2023-07-14T12:49:31.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.953+0000 7f3e2fc11700 1 -- 172.21.15.17:0/153856545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2819b7e0 con 0x7f3e2807be10 2023-07-14T12:49:31.780 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.953+0000 7f3e2fc11700 1 -- 172.21.15.17:0/153856545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2819bc00 con 0x7f3e2807be10 2023-07-14T12:49:31.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.954+0000 7f3e1effd700 1 -- 172.21.15.17:0/153856545 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f3e240245d0 con 0x7f3e2807be10 2023-07-14T12:49:31.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.954+0000 7f3e2fc11700 1 -- 172.21.15.17:0/153856545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e28061b40 con 0x7f3e2807be10 2023-07-14T12:49:31.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.954+0000 7f3e1effd700 1 --2- 172.21.15.17:0/153856545 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f3e14038710 0x7f3e1403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:31.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.954+0000 7f3e1effd700 1 -- 172.21.15.17:0/153856545 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3e2404c350 con 0x7f3e2807be10 2023-07-14T12:49:31.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.954+0000 7f3e2d1ac700 1 --2- 172.21.15.17:0/153856545 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f3e14038710 0x7f3e1403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:31.781 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.955+0000 7f3e2d1ac700 1 --2- 172.21.15.17:0/153856545 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f3e14038710 0x7f3e1403abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e18006fd0 tx=0x7f3e18006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:31.782 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:30.959+0000 7f3e1effd700 1 -- 172.21.15.17:0/153856545 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3e240189a0 con 0x7f3e2807be10 2023-07-14T12:49:31.783 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.219+0000 7f3e2fc11700 1 -- 172.21.15.17:0/153856545 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f3e2819ed80 con 0x7f3e2807be10 2023-07-14T12:49:31.783 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.272+0000 7f3e1effd700 1 -- 172.21.15.17:0/153856545 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f3e2402d910 con 0x7f3e2807be10 2023-07-14T12:49:31.783 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.274+0000 7f3e1effd700 1 -- 172.21.15.17:0/153856545 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f3e2404bdb0 con 0x7f3e2807be10 2023-07-14T12:49:31.783 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.276+0000 7f3e2fc11700 1 -- 172.21.15.17:0/153856545 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f3e14038710 msgr2=0x7f3e1403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:31.783 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.276+0000 7f3e2fc11700 1 --2- 172.21.15.17:0/153856545 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f3e14038710 0x7f3e1403abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e18006fd0 tx=0x7f3e18006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:31.783 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.276+0000 7f3e2fc11700 1 -- 172.21.15.17:0/153856545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 msgr2=0x7f3e2819b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:31.784 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.276+0000 7f3e2fc11700 1 --2- 172.21.15.17:0/153856545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2819b0a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e24000c00 tx=0x7f3e24004250 comp rx=0 tx=0).stop 2023-07-14T12:49:31.784 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.276+0000 7f3e2fc11700 1 -- 172.21.15.17:0/153856545 shutdown_connections 2023-07-14T12:49:31.784 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.276+0000 7f3e2fc11700 1 --2- 172.21.15.17:0/153856545 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f3e14038710 0x7f3e1403abc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:31.784 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.276+0000 7f3e2fc11700 1 --2- 172.21.15.17:0/153856545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e2807be10 0x7f3e2819b0a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:31.784 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.276+0000 7f3e2fc11700 1 -- 172.21.15.17:0/153856545 >> 172.21.15.17:0/153856545 conn(0x7f3e28100890 msgr2=0x7f3e28101670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:31.784 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.277+0000 7f3e2fc11700 1 -- 172.21.15.17:0/153856545 shutdown_connections 2023-07-14T12:49:31.784 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:31.277+0000 7f3e2fc11700 1 -- 172.21.15.17:0/153856545 wait complete. 2023-07-14T12:49:31.845 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:31 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:31.539+0000 7fb843527200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:49:31.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:31 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:31.647+0000 7fb843527200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:49:31.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:31 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:31.768+0000 7fb843527200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:49:32.295 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:31 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:31.898+0000 7fb843527200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:49:32.295 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:32 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:32.138+0000 7fb843527200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:49:32.572 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:32 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/153856545' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-07-14T12:49:32.572 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:32 smithi017 ceph-mon[95536]: mgrmap e5: x(active, since 10s) 2023-07-14T12:49:32.823 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:32 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:32.552+0000 7fb843527200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:49:32.823 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:32 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:32.674+0000 7fb843527200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:49:33.095 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:32 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:32.851+0000 7fb843527200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:49:33.096 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:32 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:32.980+0000 7fb843527200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:49:33.164 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-07-14T12:49:33.164 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-07-14T12:49:33.165 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-14T12:49:33.165 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-07-14T12:49:33.165 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-07-14T12:49:33.165 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-07-14T12:49:33.165 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.332+0000 7f7177a90700 1 Processor -- start 2023-07-14T12:49:33.165 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.332+0000 7f7177a90700 1 -- start start 2023-07-14T12:49:33.165 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.332+0000 7f7177a90700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717007a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:33.166 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.332+0000 7f7177a90700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717007a850 con 0x7f717007be10 2023-07-14T12:49:33.166 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.332+0000 7f717582c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717007a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:33.166 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.333+0000 7f717582c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717007a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41012/0 (socket says 172.21.15.17:41012) 2023-07-14T12:49:33.166 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.333+0000 7f717582c700 1 -- 172.21.15.17:0/365783249 learned_addr learned my addr 172.21.15.17:0/365783249 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:33.166 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.333+0000 7f717582c700 1 -- 172.21.15.17:0/365783249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717007a990 con 0x7f717007be10 2023-07-14T12:49:33.166 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.333+0000 7f717582c700 1 --2- 172.21.15.17:0/365783249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717007a310 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f716c0098a0 tx=0x7f716c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44956868479eb302 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:33.166 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.333+0000 7f717482a700 1 -- 172.21.15.17:0/365783249 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f716c004160 con 0x7f717007be10 2023-07-14T12:49:33.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.333+0000 7f717482a700 1 -- 172.21.15.17:0/365783249 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f716c0042c0 con 0x7f717007be10 2023-07-14T12:49:33.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.333+0000 7f717482a700 1 -- 172.21.15.17:0/365783249 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f716c011940 con 0x7f717007be10 2023-07-14T12:49:33.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.334+0000 7f7177a90700 1 -- 172.21.15.17:0/365783249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 msgr2=0x7f717007a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:33.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.334+0000 7f7177a90700 1 --2- 172.21.15.17:0/365783249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717007a310 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f716c0098a0 tx=0x7f716c009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:33.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.334+0000 7f7177a90700 1 -- 172.21.15.17:0/365783249 shutdown_connections 2023-07-14T12:49:33.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.334+0000 7f7177a90700 1 --2- 172.21.15.17:0/365783249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717007a310 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:33.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.334+0000 7f7177a90700 1 -- 172.21.15.17:0/365783249 >> 172.21.15.17:0/365783249 conn(0x7f7170100900 msgr2=0x7f7170102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:33.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.334+0000 7f7177a90700 1 -- 172.21.15.17:0/365783249 shutdown_connections 2023-07-14T12:49:33.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.334+0000 7f7177a90700 1 -- 172.21.15.17:0/365783249 wait complete. 2023-07-14T12:49:33.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.335+0000 7f7177a90700 1 Processor -- start 2023-07-14T12:49:33.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.336+0000 7f7177a90700 1 -- start start 2023-07-14T12:49:33.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.336+0000 7f7177a90700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:33.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.336+0000 7f7177a90700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717019b6e0 con 0x7f717007be10 2023-07-14T12:49:33.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.336+0000 7f717582c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:33.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.336+0000 7f717582c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717019b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41022/0 (socket says 172.21.15.17:41022) 2023-07-14T12:49:33.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.336+0000 7f717582c700 1 -- 172.21.15.17:0/4157881507 learned_addr learned my addr 172.21.15.17:0/4157881507 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:33.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.337+0000 7f717582c700 1 -- 172.21.15.17:0/4157881507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c009550 con 0x7f717007be10 2023-07-14T12:49:33.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.337+0000 7f717582c700 1 --2- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717019b1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f716c000c00 tx=0x7f716c004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:33.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.337+0000 7f7166ffd700 1 -- 172.21.15.17:0/4157881507 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f716c0036a0 con 0x7f717007be10 2023-07-14T12:49:33.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.337+0000 7f7166ffd700 1 -- 172.21.15.17:0/4157881507 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f716c003c70 con 0x7f717007be10 2023-07-14T12:49:33.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.337+0000 7f7166ffd700 1 -- 172.21.15.17:0/4157881507 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f716c024d70 con 0x7f717007be10 2023-07-14T12:49:33.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.337+0000 7f7177a90700 1 -- 172.21.15.17:0/4157881507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717019b8e0 con 0x7f717007be10 2023-07-14T12:49:33.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.337+0000 7f7177a90700 1 -- 172.21.15.17:0/4157881507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717019bd00 con 0x7f717007be10 2023-07-14T12:49:33.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.338+0000 7f7166ffd700 1 -- 172.21.15.17:0/4157881507 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f716c0245d0 con 0x7f717007be10 2023-07-14T12:49:33.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.338+0000 7f7177a90700 1 -- 172.21.15.17:0/4157881507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7170061b40 con 0x7f717007be10 2023-07-14T12:49:33.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.339+0000 7f7166ffd700 1 --2- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f715c038760 0x7f715c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:33.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.339+0000 7f7166ffd700 1 -- 172.21.15.17:0/4157881507 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f716c04c410 con 0x7f717007be10 2023-07-14T12:49:33.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.339+0000 7f717502b700 1 -- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f715c038760 msgr2=0x7f715c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3639458654 2023-07-14T12:49:33.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.339+0000 7f717502b700 1 --2- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f715c038760 0x7f715c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:49:33.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.348+0000 7f7166ffd700 1 -- 172.21.15.17:0/4157881507 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f716c018b80 con 0x7f717007be10 2023-07-14T12:49:33.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.540+0000 7f717502b700 1 -- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f715c038760 msgr2=0x7f715c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3639458654 2023-07-14T12:49:33.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.540+0000 7f717502b700 1 --2- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f715c038760 0x7f715c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T12:49:33.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.619+0000 7f7177a90700 1 -- 172.21.15.17:0/4157881507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f717019ee10 con 0x7f717007be10 2023-07-14T12:49:33.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.620+0000 7f7166ffd700 1 -- 172.21.15.17:0/4157881507 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f716c018350 con 0x7f717007be10 2023-07-14T12:49:33.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.623+0000 7f7177a90700 1 -- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f715c038760 msgr2=0x7f715c03ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:49:33.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.623+0000 7f7177a90700 1 --2- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f715c038760 0x7f715c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:33.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.623+0000 7f7177a90700 1 -- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 msgr2=0x7f717019b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:33.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.623+0000 7f7177a90700 1 --2- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717019b1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f716c000c00 tx=0x7f716c004250 comp rx=0 tx=0).stop 2023-07-14T12:49:33.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.623+0000 7f7177a90700 1 -- 172.21.15.17:0/4157881507 shutdown_connections 2023-07-14T12:49:33.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.623+0000 7f7177a90700 1 --2- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f715c038760 0x7f715c03ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:33.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.623+0000 7f7177a90700 1 --2- 172.21.15.17:0/4157881507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717007be10 0x7f717019b1a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:33.172 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.623+0000 7f7177a90700 1 -- 172.21.15.17:0/4157881507 >> 172.21.15.17:0/4157881507 conn(0x7f7170100900 msgr2=0x7f7170102000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:33.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.623+0000 7f7177a90700 1 -- 172.21.15.17:0/4157881507 shutdown_connections 2023-07-14T12:49:33.173 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:32.623+0000 7f7177a90700 1 -- 172.21.15.17:0/4157881507 wait complete. 2023-07-14T12:49:33.173 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2023-07-14T12:49:33.173 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 5... 2023-07-14T12:49:33.468 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:33 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/4157881507' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-07-14T12:49:33.845 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:33 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:33.557+0000 7fb843527200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:49:34.845 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:34 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:34.330+0000 7fb843527200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T12:49:34.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:34 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:34.543+0000 7fb843527200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:49:35.845 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:35.519+0000 7fb843527200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:49:35.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:35.644+0000 7fb843527200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:49:36.260 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:35.871+0000 7fb843527200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:49:36.539 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:36.241+0000 7fb843527200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T12:49:36.845 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:36.520+0000 7fb843527200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:49:36.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:36.717+0000 7fb843527200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:49:37.345 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:37 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:37.067+0000 7fb843527200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:49:38.346 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:38.020+0000 7fb843527200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:49:38.346 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:38.198+0000 7fb843527200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:49:38.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:38.448+0000 7fb843527200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:49:38.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:38.599+0000 7fb843527200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:49:39.346 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:38.880+0000 7fb843527200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:49:40.346 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:39 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:39.977+0000 7fb843527200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:49:41.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: Active manager daemon x restarted 2023-07-14T12:49:41.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: Activating manager daemon x 2023-07-14T12:49:41.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: osdmap e2: 0 total, 0 up, 0 in 2023-07-14T12:49:41.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: mgrmap e6: x(active, starting, since 0.00413132s) 2023-07-14T12:49:41.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:49:41.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-14T12:49:41.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-14T12:49:41.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-14T12:49:41.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-14T12:49:41.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: Manager daemon x is now available 2023-07-14T12:49:41.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: Found migration_current of "None". Setting to last migration. 2023-07-14T12:49:41.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:41.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:41.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:49:41.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:49:41.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:49:41.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T12:49:41.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T12:49:41.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:41.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:40 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:41.458 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-07-14T12:49:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-07-14T12:49:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2023-07-14T12:49:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-07-14T12:49:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.722+0000 7f6fa9fdf700 1 Processor -- start 2023-07-14T12:49:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.723+0000 7f6fa9fdf700 1 -- start start 2023-07-14T12:49:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.723+0000 7f6fa9fdf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4079d10 0x7f6fa4107da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.723+0000 7f6fa9fdf700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41082e0 con 0x7f6fa4079d10 2023-07-14T12:49:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.723+0000 7f6fa37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4079d10 0x7f6fa4107da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.724+0000 7f6fa37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4079d10 0x7f6fa4107da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41032/0 (socket says 172.21.15.17:41032) 2023-07-14T12:49:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.724+0000 7f6fa37fe700 1 -- 172.21.15.17:0/2739990543 learned_addr learned my addr 172.21.15.17:0/2739990543 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:41.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.724+0000 7f6fa37fe700 1 -- 172.21.15.17:0/2739990543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa4108420 con 0x7f6fa4079d10 2023-07-14T12:49:41.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.724+0000 7f6fa37fe700 1 --2- 172.21.15.17:0/2739990543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4079d10 0x7f6fa4107da0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6f940098a0 tx=0x7f6f94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcda6721d9ec0b54 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:41.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.724+0000 7f6fa27fc700 1 -- 172.21.15.17:0/2739990543 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f94004160 con 0x7f6fa4079d10 2023-07-14T12:49:41.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.724+0000 7f6fa27fc700 1 -- 172.21.15.17:0/2739990543 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6f940042c0 con 0x7f6fa4079d10 2023-07-14T12:49:41.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.724+0000 7f6fa27fc700 1 -- 172.21.15.17:0/2739990543 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f94011940 con 0x7f6fa4079d10 2023-07-14T12:49:41.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.725+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2739990543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4079d10 msgr2=0x7f6fa4107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:41.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.725+0000 7f6fa9fdf700 1 --2- 172.21.15.17:0/2739990543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4079d10 0x7f6fa4107da0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6f940098a0 tx=0x7f6f94009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:41.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.725+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2739990543 shutdown_connections 2023-07-14T12:49:41.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.725+0000 7f6fa9fdf700 1 --2- 172.21.15.17:0/2739990543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa4079d10 0x7f6fa4107da0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:41.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.725+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2739990543 >> 172.21.15.17:0/2739990543 conn(0x7f6fa40ff7f0 msgr2=0x7f6fa4101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:41.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.725+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2739990543 shutdown_connections 2023-07-14T12:49:41.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.725+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2739990543 wait complete. 2023-07-14T12:49:41.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.727+0000 7f6fa9fdf700 1 Processor -- start 2023-07-14T12:49:41.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.727+0000 7f6fa9fdf700 1 -- start start 2023-07-14T12:49:41.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.727+0000 7f6fa9fdf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa41056b0 0x7f6fa4103d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:41.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.727+0000 7f6fa9fdf700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4105ac0 con 0x7f6fa41056b0 2023-07-14T12:49:41.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.727+0000 7f6fa37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa41056b0 0x7f6fa4103d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:41.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.728+0000 7f6fa37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa41056b0 0x7f6fa4103d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41038/0 (socket says 172.21.15.17:41038) 2023-07-14T12:49:41.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.728+0000 7f6fa37fe700 1 -- 172.21.15.17:0/2120844508 learned_addr learned my addr 172.21.15.17:0/2120844508 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:41.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.728+0000 7f6fa37fe700 1 -- 172.21.15.17:0/2120844508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94009550 con 0x7f6fa41056b0 2023-07-14T12:49:41.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.728+0000 7f6fa37fe700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa41056b0 0x7f6fa4103d40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f94000c00 tx=0x7f6f94011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:41.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.728+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f940036a0 con 0x7f6fa41056b0 2023-07-14T12:49:41.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.728+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6f9401b440 con 0x7f6fa41056b0 2023-07-14T12:49:41.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.728+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f940193f0 con 0x7f6fa41056b0 2023-07-14T12:49:41.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.728+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2120844508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa4104280 con 0x7f6fa41056b0 2023-07-14T12:49:41.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.729+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2120844508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa41046a0 con 0x7f6fa41056b0 2023-07-14T12:49:41.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.730+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f6f9401b5b0 con 0x7f6fa41056b0 2023-07-14T12:49:41.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.730+0000 7f6fa0ff9700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 0x7f6f8c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:41.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.730+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 --> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f8c03b320 con 0x7f6f8c038760 2023-07-14T12:49:41.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.730+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6f9404c5a0 con 0x7f6fa41056b0 2023-07-14T12:49:41.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.730+0000 7f6fa2ffd700 1 -- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 msgr2=0x7f6f8c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3639458654 2023-07-14T12:49:41.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.730+0000 7f6fa2ffd700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 0x7f6f8c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:49:41.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.931+0000 7f6fa2ffd700 1 -- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 msgr2=0x7f6f8c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3639458654 2023-07-14T12:49:41.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:33.931+0000 7f6fa2ffd700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 0x7f6f8c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T12:49:41.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:34.332+0000 7f6fa2ffd700 1 -- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 msgr2=0x7f6f8c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3639458654 2023-07-14T12:49:41.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:34.332+0000 7f6fa2ffd700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 0x7f6f8c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T12:49:41.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:35.133+0000 7f6fa2ffd700 1 -- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 msgr2=0x7f6f8c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3639458654 2023-07-14T12:49:41.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:35.133+0000 7f6fa2ffd700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 0x7f6f8c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T12:49:41.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:36.734+0000 7f6fa2ffd700 1 -- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 msgr2=0x7f6f8c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3639458654 2023-07-14T12:49:41.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:36.734+0000 7f6fa2ffd700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 0x7f6f8c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-07-14T12:49:41.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:39.938+0000 7f6fa2ffd700 1 -- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 msgr2=0x7f6f8c03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/3639458654 2023-07-14T12:49:41.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:39.938+0000 7f6fa2ffd700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 0x7f6f8c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-07-14T12:49:41.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:39.982+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 6) v1 ==== 45250+0+0 (secure 0 0 0) 0x7f6f94003990 con 0x7f6fa41056b0 2023-07-14T12:49:41.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:39.982+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 msgr2=0x7f6f8c03ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:49:41.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:39.982+0000 7f6fa0ff9700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 0x7f6f8c03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:41.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.984+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f6f94024d10 con 0x7f6fa41056b0 2023-07-14T12:49:41.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.984+0000 7f6fa0ff9700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6f8c03bfe0 0x7f6f8c03e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:41.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.984+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 --> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f8c03b320 con 0x7f6f8c03bfe0 2023-07-14T12:49:41.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.985+0000 7f6fa2ffd700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6f8c03bfe0 0x7f6f8c03e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:41.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.986+0000 7f6fa2ffd700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6f8c03bfe0 0x7f6f8c03e3c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6f98003a10 tx=0x7f6f980092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:41.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.987+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 <== mgr.14118 v2:172.21.15.17:6800/1783581931 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f6f8c03b320 con 0x7f6f8c03bfe0 2023-07-14T12:49:41.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.993+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2120844508 --> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f6fa4105290 con 0x7f6f8c03bfe0 2023-07-14T12:49:41.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa0ff9700 1 -- 172.21.15.17:0/2120844508 <== mgr.14118 v2:172.21.15.17:6800/1783581931 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f6fa4105290 con 0x7f6f8c03bfe0 2023-07-14T12:49:41.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6f8c03bfe0 msgr2=0x7f6f8c03e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:41.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa9fdf700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6f8c03bfe0 0x7f6f8c03e3c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6f98003a10 tx=0x7f6f980092b0 comp rx=0 tx=0).stop 2023-07-14T12:49:41.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa41056b0 msgr2=0x7f6fa4103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:41.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa9fdf700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa41056b0 0x7f6fa4103d40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f94000c00 tx=0x7f6f94011e70 comp rx=0 tx=0).stop 2023-07-14T12:49:41.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2120844508 shutdown_connections 2023-07-14T12:49:41.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa9fdf700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6f8c03bfe0 0x7f6f8c03e3c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:41.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa9fdf700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fa41056b0 0x7f6fa4103d40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:41.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa9fdf700 1 --2- 172.21.15.17:0/2120844508 >> [v2:172.21.15.17:6800/3639458654,v1:172.21.15.17:6801/3639458654] conn(0x7f6f8c038760 0x7f6f8c03ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:41.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2120844508 >> 172.21.15.17:0/2120844508 conn(0x7f6fa40ff7f0 msgr2=0x7f6fa4100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:41.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2120844508 shutdown_connections 2023-07-14T12:49:41.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:40.994+0000 7f6fa9fdf700 1 -- 172.21.15.17:0/2120844508 wait complete. 2023-07-14T12:49:41.473 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 5 is available 2023-07-14T12:49:41.473 INFO:teuthology.orchestra.run.smithi017.stdout:Setting orchestrator backend to cephadm... 2023-07-14T12:49:42.278 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:41 smithi017 ceph-mon[95536]: mgrmap e7: x(active, since 1.00686s) 2023-07-14T12:49:42.278 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:41 smithi017 ceph-mon[95536]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-07-14T12:49:42.278 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:41 smithi017 ceph-mon[95536]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-07-14T12:49:42.279 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:41 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:49:42.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.996+0000 7f628aa4e700 1 Processor -- start 2023-07-14T12:49:42.746 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.997+0000 7f628aa4e700 1 -- start start 2023-07-14T12:49:42.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.997+0000 7f628aa4e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f6284105610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:42.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.997+0000 7f628aa4e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6284105b50 con 0x7f6284105200 2023-07-14T12:49:42.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.997+0000 7f6283fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f6284105610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:42.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.997+0000 7f6283fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f6284105610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47534/0 (socket says 172.21.15.17:47534) 2023-07-14T12:49:42.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.997+0000 7f6283fff700 1 -- 172.21.15.17:0/1050193006 learned_addr learned my addr 172.21.15.17:0/1050193006 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:42.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.997+0000 7f6283fff700 1 -- 172.21.15.17:0/1050193006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284105c90 con 0x7f6284105200 2023-07-14T12:49:42.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.998+0000 7f6283fff700 1 --2- 172.21.15.17:0/1050193006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f6284105610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f62740098a0 tx=0x7f6274009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddecf1fee656e4d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:42.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.998+0000 7f6282ffd700 1 -- 172.21.15.17:0/1050193006 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6274004160 con 0x7f6284105200 2023-07-14T12:49:42.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.998+0000 7f6282ffd700 1 -- 172.21.15.17:0/1050193006 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f62740042c0 con 0x7f6284105200 2023-07-14T12:49:42.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.998+0000 7f6282ffd700 1 -- 172.21.15.17:0/1050193006 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6274011940 con 0x7f6284105200 2023-07-14T12:49:42.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.998+0000 7f628aa4e700 1 -- 172.21.15.17:0/1050193006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 msgr2=0x7f6284105610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:42.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.998+0000 7f628aa4e700 1 --2- 172.21.15.17:0/1050193006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f6284105610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f62740098a0 tx=0x7f6274009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:42.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.999+0000 7f628aa4e700 1 -- 172.21.15.17:0/1050193006 shutdown_connections 2023-07-14T12:49:42.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.999+0000 7f628aa4e700 1 --2- 172.21.15.17:0/1050193006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f6284105610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:42.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.999+0000 7f628aa4e700 1 -- 172.21.15.17:0/1050193006 >> 172.21.15.17:0/1050193006 conn(0x7f6284100890 msgr2=0x7f6284102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:42.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.999+0000 7f628aa4e700 1 -- 172.21.15.17:0/1050193006 shutdown_connections 2023-07-14T12:49:42.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:41.999+0000 7f628aa4e700 1 -- 172.21.15.17:0/1050193006 wait complete. 2023-07-14T12:49:42.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.000+0000 7f628aa4e700 1 Processor -- start 2023-07-14T12:49:42.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.000+0000 7f628aa4e700 1 -- start start 2023-07-14T12:49:42.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.000+0000 7f628aa4e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f628419b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:42.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.000+0000 7f628aa4e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628419b5b0 con 0x7f6284105200 2023-07-14T12:49:42.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.000+0000 7f6283fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f628419b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:42.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.001+0000 7f6283fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f628419b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47546/0 (socket says 172.21.15.17:47546) 2023-07-14T12:49:42.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.001+0000 7f6283fff700 1 -- 172.21.15.17:0/2334585215 learned_addr learned my addr 172.21.15.17:0/2334585215 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:42.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.001+0000 7f6283fff700 1 -- 172.21.15.17:0/2334585215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274009550 con 0x7f6284105200 2023-07-14T12:49:42.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.001+0000 7f6283fff700 1 --2- 172.21.15.17:0/2334585215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f628419b070 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6274011dc0 tx=0x7f6274011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:42.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.001+0000 7f62817fa700 1 -- 172.21.15.17:0/2334585215 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62740037d0 con 0x7f6284105200 2023-07-14T12:49:42.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.001+0000 7f62817fa700 1 -- 172.21.15.17:0/2334585215 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f627401b440 con 0x7f6284105200 2023-07-14T12:49:42.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.001+0000 7f62817fa700 1 -- 172.21.15.17:0/2334585215 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f627401a560 con 0x7f6284105200 2023-07-14T12:49:42.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.001+0000 7f628aa4e700 1 -- 172.21.15.17:0/2334585215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628419b7b0 con 0x7f6284105200 2023-07-14T12:49:42.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.002+0000 7f628aa4e700 1 -- 172.21.15.17:0/2334585215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628419bbd0 con 0x7f6284105200 2023-07-14T12:49:42.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.003+0000 7f628aa4e700 1 -- 172.21.15.17:0/2334585215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6284061b40 con 0x7f6284105200 2023-07-14T12:49:42.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.003+0000 7f62817fa700 1 -- 172.21.15.17:0/2334585215 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f627401b5b0 con 0x7f6284105200 2023-07-14T12:49:42.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.003+0000 7f62817fa700 1 --2- 172.21.15.17:0/2334585215 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f626c038760 0x7f626c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:42.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.003+0000 7f62817fa700 1 -- 172.21.15.17:0/2334585215 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f627404c5f0 con 0x7f6284105200 2023-07-14T12:49:42.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.004+0000 7f62837fe700 1 --2- 172.21.15.17:0/2334585215 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f626c038760 0x7f626c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:42.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.004+0000 7f62837fe700 1 --2- 172.21.15.17:0/2334585215 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f626c038760 0x7f626c03ac10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6278006fd0 tx=0x7f6278006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:42.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.009+0000 7f62817fa700 1 -- 172.21.15.17:0/2334585215 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6274023590 con 0x7f6284105200 2023-07-14T12:49:42.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.226+0000 7f628aa4e700 1 -- 172.21.15.17:0/2334585215 --> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f628419ea30 con 0x7f626c038760 2023-07-14T12:49:42.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.232+0000 7f62817fa700 1 -- 172.21.15.17:0/2334585215 <== mgr.14118 v2:172.21.15.17:6800/1783581931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f628419ea30 con 0x7f626c038760 2023-07-14T12:49:42.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.235+0000 7f628aa4e700 1 -- 172.21.15.17:0/2334585215 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f626c038760 msgr2=0x7f626c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:42.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.235+0000 7f628aa4e700 1 --2- 172.21.15.17:0/2334585215 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f626c038760 0x7f626c03ac10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6278006fd0 tx=0x7f6278006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:42.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.235+0000 7f628aa4e700 1 -- 172.21.15.17:0/2334585215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 msgr2=0x7f628419b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:42.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.235+0000 7f628aa4e700 1 --2- 172.21.15.17:0/2334585215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f628419b070 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6274011dc0 tx=0x7f6274011ea0 comp rx=0 tx=0).stop 2023-07-14T12:49:42.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.235+0000 7f628aa4e700 1 -- 172.21.15.17:0/2334585215 shutdown_connections 2023-07-14T12:49:42.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.235+0000 7f628aa4e700 1 --2- 172.21.15.17:0/2334585215 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f626c038760 0x7f626c03ac10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:42.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.235+0000 7f628aa4e700 1 --2- 172.21.15.17:0/2334585215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6284105200 0x7f628419b070 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:42.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.235+0000 7f628aa4e700 1 -- 172.21.15.17:0/2334585215 >> 172.21.15.17:0/2334585215 conn(0x7f6284100890 msgr2=0x7f62841015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:42.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.235+0000 7f628aa4e700 1 -- 172.21.15.17:0/2334585215 shutdown_connections 2023-07-14T12:49:42.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:42.236+0000 7f628aa4e700 1 -- 172.21.15.17:0/2334585215 wait complete. 2023-07-14T12:49:43.062 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:42 smithi017 ceph-mon[95536]: [14/Jul/2023:12:49:41] ENGINE Bus STARTING 2023-07-14T12:49:43.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:42 smithi017 ceph-mon[95536]: [14/Jul/2023:12:49:41] ENGINE Serving on https://172.21.15.17:7150 2023-07-14T12:49:43.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:42 smithi017 ceph-mon[95536]: [14/Jul/2023:12:49:41] ENGINE Serving on http://172.21.15.17:8765 2023-07-14T12:49:43.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:42 smithi017 ceph-mon[95536]: [14/Jul/2023:12:49:41] ENGINE Bus STARTED 2023-07-14T12:49:43.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:42 smithi017 ceph-mon[95536]: mgrmap e8: x(active, since 2s) 2023-07-14T12:49:43.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:42 smithi017 ceph-mon[95536]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:49:43.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:42 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:43.063 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:42 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:49:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout value unchanged 2023-07-14T12:49:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.252+0000 7fcc66776700 1 Processor -- start 2023-07-14T12:49:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.253+0000 7fcc66776700 1 -- start start 2023-07-14T12:49:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.253+0000 7fcc66776700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6007a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.253+0000 7fcc66776700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6007a850 con 0x7fcc6007be10 2023-07-14T12:49:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.253+0000 7fcc5ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6007a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.253+0000 7fcc5ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6007a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47548/0 (socket says 172.21.15.17:47548) 2023-07-14T12:49:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.253+0000 7fcc5ffff700 1 -- 172.21.15.17:0/3636375852 learned_addr learned my addr 172.21.15.17:0/3636375852 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.254+0000 7fcc5ffff700 1 -- 172.21.15.17:0/3636375852 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6007a990 con 0x7fcc6007be10 2023-07-14T12:49:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.254+0000 7fcc5ffff700 1 --2- 172.21.15.17:0/3636375852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6007a310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcc500098a0 tx=0x7fcc50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829791a6cf5a9f20 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.254+0000 7fcc5effd700 1 -- 172.21.15.17:0/3636375852 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc50004160 con 0x7fcc6007be10 2023-07-14T12:49:43.926 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.254+0000 7fcc5effd700 1 -- 172.21.15.17:0/3636375852 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fcc500042c0 con 0x7fcc6007be10 2023-07-14T12:49:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.254+0000 7fcc5effd700 1 -- 172.21.15.17:0/3636375852 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc50011940 con 0x7fcc6007be10 2023-07-14T12:49:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.255+0000 7fcc66776700 1 -- 172.21.15.17:0/3636375852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 msgr2=0x7fcc6007a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.255+0000 7fcc66776700 1 --2- 172.21.15.17:0/3636375852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6007a310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcc500098a0 tx=0x7fcc50009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.255+0000 7fcc66776700 1 -- 172.21.15.17:0/3636375852 shutdown_connections 2023-07-14T12:49:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.255+0000 7fcc66776700 1 --2- 172.21.15.17:0/3636375852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6007a310 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.255+0000 7fcc66776700 1 -- 172.21.15.17:0/3636375852 >> 172.21.15.17:0/3636375852 conn(0x7fcc60100900 msgr2=0x7fcc60102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.255+0000 7fcc66776700 1 -- 172.21.15.17:0/3636375852 shutdown_connections 2023-07-14T12:49:43.927 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.255+0000 7fcc66776700 1 -- 172.21.15.17:0/3636375852 wait complete. 2023-07-14T12:49:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.256+0000 7fcc66776700 1 Processor -- start 2023-07-14T12:49:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.256+0000 7fcc66776700 1 -- start start 2023-07-14T12:49:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.256+0000 7fcc66776700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.256+0000 7fcc66776700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6019b6e0 con 0x7fcc6007be10 2023-07-14T12:49:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.257+0000 7fcc5ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.257+0000 7fcc5ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6019b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47552/0 (socket says 172.21.15.17:47552) 2023-07-14T12:49:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.257+0000 7fcc5ffff700 1 -- 172.21.15.17:0/2160116223 learned_addr learned my addr 172.21.15.17:0/2160116223 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.257+0000 7fcc5ffff700 1 -- 172.21.15.17:0/2160116223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc50009550 con 0x7fcc6007be10 2023-07-14T12:49:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.257+0000 7fcc5ffff700 1 --2- 172.21.15.17:0/2160116223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6019b1a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc50000c00 tx=0x7fcc50004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.257+0000 7fcc5d7fa700 1 -- 172.21.15.17:0/2160116223 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc500036a0 con 0x7fcc6007be10 2023-07-14T12:49:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.258+0000 7fcc5d7fa700 1 -- 172.21.15.17:0/2160116223 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fcc50003c70 con 0x7fcc6007be10 2023-07-14T12:49:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.258+0000 7fcc5d7fa700 1 -- 172.21.15.17:0/2160116223 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc50024d70 con 0x7fcc6007be10 2023-07-14T12:49:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.258+0000 7fcc66776700 1 -- 172.21.15.17:0/2160116223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6019b8e0 con 0x7fcc6007be10 2023-07-14T12:49:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.258+0000 7fcc66776700 1 -- 172.21.15.17:0/2160116223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6019bd00 con 0x7fcc6007be10 2023-07-14T12:49:43.929 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.259+0000 7fcc5d7fa700 1 -- 172.21.15.17:0/2160116223 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fcc500245d0 con 0x7fcc6007be10 2023-07-14T12:49:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.259+0000 7fcc66776700 1 -- 172.21.15.17:0/2160116223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6010b4f0 con 0x7fcc6007be10 2023-07-14T12:49:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.260+0000 7fcc5d7fa700 1 --2- 172.21.15.17:0/2160116223 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fcc48038760 0x7fcc4803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.260+0000 7fcc5d7fa700 1 -- 172.21.15.17:0/2160116223 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcc5004c450 con 0x7fcc6007be10 2023-07-14T12:49:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.260+0000 7fcc5f7fe700 1 --2- 172.21.15.17:0/2160116223 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fcc48038760 0x7fcc4803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.260+0000 7fcc5f7fe700 1 --2- 172.21.15.17:0/2160116223 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fcc48038760 0x7fcc4803ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc54006fd0 tx=0x7fcc54006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.264+0000 7fcc5d7fa700 1 -- 172.21.15.17:0/2160116223 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcc500189a0 con 0x7fcc6007be10 2023-07-14T12:49:43.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.473+0000 7fcc66776700 1 -- 172.21.15.17:0/2160116223 --> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc6019eb60 con 0x7fcc48038760 2023-07-14T12:49:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.473+0000 7fcc5d7fa700 1 -- 172.21.15.17:0/2160116223 <== mgr.14118 v2:172.21.15.17:6800/1783581931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fcc6019eb60 con 0x7fcc48038760 2023-07-14T12:49:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.476+0000 7fcc66776700 1 -- 172.21.15.17:0/2160116223 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fcc48038760 msgr2=0x7fcc4803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.476+0000 7fcc66776700 1 --2- 172.21.15.17:0/2160116223 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fcc48038760 0x7fcc4803ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc54006fd0 tx=0x7fcc54006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.476+0000 7fcc66776700 1 -- 172.21.15.17:0/2160116223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 msgr2=0x7fcc6019b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.476+0000 7fcc66776700 1 --2- 172.21.15.17:0/2160116223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6019b1a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc50000c00 tx=0x7fcc50004250 comp rx=0 tx=0).stop 2023-07-14T12:49:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.476+0000 7fcc66776700 1 -- 172.21.15.17:0/2160116223 shutdown_connections 2023-07-14T12:49:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.476+0000 7fcc66776700 1 --2- 172.21.15.17:0/2160116223 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fcc48038760 0x7fcc4803ac10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.476+0000 7fcc66776700 1 --2- 172.21.15.17:0/2160116223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc6007be10 0x7fcc6019b1a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.476+0000 7fcc66776700 1 -- 172.21.15.17:0/2160116223 >> 172.21.15.17:0/2160116223 conn(0x7fcc60100900 msgr2=0x7fcc60102000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.476+0000 7fcc66776700 1 -- 172.21.15.17:0/2160116223 shutdown_connections 2023-07-14T12:49:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:43.477+0000 7fcc66776700 1 -- 172.21.15.17:0/2160116223 wait complete. 2023-07-14T12:49:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:Generating ssh key... 2023-07-14T12:49:44.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-mon[95536]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:49:45.307 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.467+0000 7fc1188fc700 1 Processor -- start 2023-07-14T12:49:45.307 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.468+0000 7fc1188fc700 1 -- start start 2023-07-14T12:49:45.307 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.468+0000 7fc1188fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11407a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:45.308 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.468+0000 7fc1188fc700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11407a830 con 0x7fc11407bdf0 2023-07-14T12:49:45.308 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.468+0000 7fc11259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11407a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:45.308 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.468+0000 7fc11259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11407a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47554/0 (socket says 172.21.15.17:47554) 2023-07-14T12:49:45.309 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.468+0000 7fc11259c700 1 -- 172.21.15.17:0/1492935714 learned_addr learned my addr 172.21.15.17:0/1492935714 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:45.309 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.469+0000 7fc11259c700 1 -- 172.21.15.17:0/1492935714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11407a970 con 0x7fc11407bdf0 2023-07-14T12:49:45.309 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.469+0000 7fc11259c700 1 --2- 172.21.15.17:0/1492935714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11407a2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc1040098a0 tx=0x7fc104009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7726accf3b9de4f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:45.310 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.469+0000 7fc11159a700 1 -- 172.21.15.17:0/1492935714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc104004160 con 0x7fc11407bdf0 2023-07-14T12:49:45.310 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.469+0000 7fc11159a700 1 -- 172.21.15.17:0/1492935714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc1040042c0 con 0x7fc11407bdf0 2023-07-14T12:49:45.310 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.469+0000 7fc11159a700 1 -- 172.21.15.17:0/1492935714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc104011940 con 0x7fc11407bdf0 2023-07-14T12:49:45.310 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.470+0000 7fc1188fc700 1 -- 172.21.15.17:0/1492935714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 msgr2=0x7fc11407a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:45.311 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.470+0000 7fc1188fc700 1 --2- 172.21.15.17:0/1492935714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11407a2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc1040098a0 tx=0x7fc104009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:45.311 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.470+0000 7fc1188fc700 1 -- 172.21.15.17:0/1492935714 shutdown_connections 2023-07-14T12:49:45.311 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.470+0000 7fc1188fc700 1 --2- 172.21.15.17:0/1492935714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11407a2f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:45.312 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.470+0000 7fc1188fc700 1 -- 172.21.15.17:0/1492935714 >> 172.21.15.17:0/1492935714 conn(0x7fc114100900 msgr2=0x7fc114102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:45.312 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.470+0000 7fc1188fc700 1 -- 172.21.15.17:0/1492935714 shutdown_connections 2023-07-14T12:49:45.312 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.470+0000 7fc1188fc700 1 -- 172.21.15.17:0/1492935714 wait complete. 2023-07-14T12:49:45.312 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.471+0000 7fc1188fc700 1 Processor -- start 2023-07-14T12:49:45.313 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.471+0000 7fc1188fc700 1 -- start start 2023-07-14T12:49:45.313 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.471+0000 7fc1188fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11419b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:45.313 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.471+0000 7fc1188fc700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11419b6b0 con 0x7fc11407bdf0 2023-07-14T12:49:45.314 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.472+0000 7fc11259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11419b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:45.314 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.472+0000 7fc11259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11419b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47568/0 (socket says 172.21.15.17:47568) 2023-07-14T12:49:45.314 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.472+0000 7fc11259c700 1 -- 172.21.15.17:0/3992949808 learned_addr learned my addr 172.21.15.17:0/3992949808 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:45.314 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.472+0000 7fc11259c700 1 -- 172.21.15.17:0/3992949808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc104009550 con 0x7fc11407bdf0 2023-07-14T12:49:45.315 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.472+0000 7fc11259c700 1 --2- 172.21.15.17:0/3992949808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11419b170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc104000c00 tx=0x7fc104011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:45.315 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.472+0000 7fc1037fe700 1 -- 172.21.15.17:0/3992949808 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1040036a0 con 0x7fc11407bdf0 2023-07-14T12:49:45.315 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.472+0000 7fc1188fc700 1 -- 172.21.15.17:0/3992949808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11419b8b0 con 0x7fc11407bdf0 2023-07-14T12:49:45.315 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.472+0000 7fc1037fe700 1 -- 172.21.15.17:0/3992949808 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc104003c70 con 0x7fc11407bdf0 2023-07-14T12:49:45.316 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.472+0000 7fc1037fe700 1 -- 172.21.15.17:0/3992949808 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1040193f0 con 0x7fc11407bdf0 2023-07-14T12:49:45.316 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.473+0000 7fc1188fc700 1 -- 172.21.15.17:0/3992949808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11419bcd0 con 0x7fc11407bdf0 2023-07-14T12:49:45.316 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.474+0000 7fc1188fc700 1 -- 172.21.15.17:0/3992949808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc114061b40 con 0x7fc11407bdf0 2023-07-14T12:49:45.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.474+0000 7fc1037fe700 1 -- 172.21.15.17:0/3992949808 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fc10401b440 con 0x7fc11407bdf0 2023-07-14T12:49:45.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.474+0000 7fc1037fe700 1 --2- 172.21.15.17:0/3992949808 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fc0fc038710 0x7fc0fc03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:45.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.474+0000 7fc1037fe700 1 -- 172.21.15.17:0/3992949808 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc10404c640 con 0x7fc11407bdf0 2023-07-14T12:49:45.317 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.474+0000 7fc111d9b700 1 --2- 172.21.15.17:0/3992949808 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fc0fc038710 0x7fc0fc03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:45.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.475+0000 7fc111d9b700 1 --2- 172.21.15.17:0/3992949808 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fc0fc038710 0x7fc0fc03abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc108006fd0 tx=0x7fc108006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:45.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.479+0000 7fc1037fe700 1 -- 172.21.15.17:0/3992949808 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc104022950 con 0x7fc11407bdf0 2023-07-14T12:49:45.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.686+0000 7fc1188fc700 1 -- 172.21.15.17:0/3992949808 --> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fc114102c10 con 0x7fc0fc038710 2023-07-14T12:49:45.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.849+0000 7fc1037fe700 1 -- 172.21.15.17:0/3992949808 <== mgr.14118 v2:172.21.15.17:6800/1783581931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc114102c10 con 0x7fc0fc038710 2023-07-14T12:49:45.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.852+0000 7fc1188fc700 1 -- 172.21.15.17:0/3992949808 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fc0fc038710 msgr2=0x7fc0fc03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:45.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.852+0000 7fc1188fc700 1 --2- 172.21.15.17:0/3992949808 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fc0fc038710 0x7fc0fc03abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc108006fd0 tx=0x7fc108006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:45.319 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.852+0000 7fc1188fc700 1 -- 172.21.15.17:0/3992949808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 msgr2=0x7fc11419b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:45.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.852+0000 7fc1188fc700 1 --2- 172.21.15.17:0/3992949808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11419b170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc104000c00 tx=0x7fc104011e70 comp rx=0 tx=0).stop 2023-07-14T12:49:45.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.852+0000 7fc1188fc700 1 -- 172.21.15.17:0/3992949808 shutdown_connections 2023-07-14T12:49:45.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.852+0000 7fc1188fc700 1 --2- 172.21.15.17:0/3992949808 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fc0fc038710 0x7fc0fc03abc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:45.320 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.852+0000 7fc1188fc700 1 --2- 172.21.15.17:0/3992949808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc11407bdf0 0x7fc11419b170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:45.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.852+0000 7fc1188fc700 1 -- 172.21.15.17:0/3992949808 >> 172.21.15.17:0/3992949808 conn(0x7fc114100900 msgr2=0x7fc114101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:45.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.852+0000 7fc1188fc700 1 -- 172.21.15.17:0/3992949808 shutdown_connections 2023-07-14T12:49:45.321 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:44.852+0000 7fc1188fc700 1 -- 172.21.15.17:0/3992949808 wait complete. 2023-07-14T12:49:45.322 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: Generating public/private rsa key pair. 2023-07-14T12:49:45.322 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: Your identification has been saved in /tmp/tmpfvsc7m_8/key. 2023-07-14T12:49:45.322 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: Your public key has been saved in /tmp/tmpfvsc7m_8/key.pub. 2023-07-14T12:49:45.323 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: The key fingerprint is: 2023-07-14T12:49:45.323 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: SHA256:bFyfdUoJT22xio0KyZUxo/wpzM+rHmgS61nGtQ9x/xo ceph-b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:49:45.323 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: The key's randomart image is: 2023-07-14T12:49:45.323 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: +---[RSA 3072]----+ 2023-07-14T12:49:45.324 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: | + . .o.| 2023-07-14T12:49:45.324 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: | . . = + .+| 2023-07-14T12:49:45.324 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: | o o. =o.| 2023-07-14T12:49:45.324 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: | +o+...++.o | 2023-07-14T12:49:45.325 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: | . XS+ ooo. | 2023-07-14T12:49:45.325 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: | + o.O o | 2023-07-14T12:49:45.325 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: | o * + + E | 2023-07-14T12:49:45.325 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: | . * + . o | 2023-07-14T12:49:45.326 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: | o .o.o ... | 2023-07-14T12:49:45.326 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: +----[SHA256]-----+ 2023-07-14T12:49:46.117 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:45 smithi017 ceph-mon[95536]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:49:46.117 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:45 smithi017 ceph-mon[95536]: Generating ssh key... 2023-07-14T12:49:46.118 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:45 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:46.118 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:45 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:46.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Zcos0kfvjSo98+P74+iYoJOzUgeE1PQ+RzcRC3mSJ0jBdB3BYAmCpos2a8xvzMrGX/G7VKCkf6zb62OO8cU+rAslf1ggPV8rzvkStNYXY0o2+cCjcjBgLpg4SgxuLWM8a9OfufeEQj7+pM/y9ulooGDj4vjsPGXUhv8ME+jhg06Phtvl81SkmfkC8qM8MzI0wH6a1U+A4oJMdynfg7ZK3vP7NeC+JtLW9felu6Qt+49iNRxCMOQvpsnCgcLb+lMRqIJU0YFaZa4hI/KM+xdBWs0hHODKlbT2+hmt0+/Vk72PUiup8hKh/L+IcfWQzT0NcHvrFlW+BxjSfYnnf2/xktFDmiLlateIJkZvkNcY3LApxomfRG201yJ9yXqoH5dCLoUIBSodVeXHsXc51U2yTGUtLMfjIvZkcHBnX1APbQUaC0ODiLUT9KXhhJr8ApdWu8QkFT7HpCBL6BfldA/TsPv/cA1z5myyr122qM0cpa/o0IvOUBVwdGFhmcvUNk8= ceph-b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:49:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.853+0000 7f64ad0c2700 1 Processor -- start 2023-07-14T12:49:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.853+0000 7f64ad0c2700 1 -- start start 2023-07-14T12:49:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.853+0000 7f64ad0c2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a807a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.853+0000 7f64ad0c2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a807a810 con 0x7f64a807bdd0 2023-07-14T12:49:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.853+0000 7f64a6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a807a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.853+0000 7f64a6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a807a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41972/0 (socket says 172.21.15.17:41972) 2023-07-14T12:49:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.853+0000 7f64a6d9d700 1 -- 172.21.15.17:0/4061903634 learned_addr learned my addr 172.21.15.17:0/4061903634 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.854+0000 7f64a6d9d700 1 -- 172.21.15.17:0/4061903634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a807a950 con 0x7f64a807bdd0 2023-07-14T12:49:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.854+0000 7f64a6d9d700 1 --2- 172.21.15.17:0/4061903634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a807a2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f64980098a0 tx=0x7f6498009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f13aa3debce47a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.854+0000 7f64a5d9b700 1 -- 172.21.15.17:0/4061903634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6498004160 con 0x7f64a807bdd0 2023-07-14T12:49:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.854+0000 7f64a5d9b700 1 -- 172.21.15.17:0/4061903634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f64980042c0 con 0x7f64a807bdd0 2023-07-14T12:49:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.854+0000 7f64a5d9b700 1 -- 172.21.15.17:0/4061903634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6498011940 con 0x7f64a807bdd0 2023-07-14T12:49:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.855+0000 7f64ad0c2700 1 -- 172.21.15.17:0/4061903634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 msgr2=0x7f64a807a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:46.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.855+0000 7f64ad0c2700 1 --2- 172.21.15.17:0/4061903634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a807a2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f64980098a0 tx=0x7f6498009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:46.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.855+0000 7f64ad0c2700 1 -- 172.21.15.17:0/4061903634 shutdown_connections 2023-07-14T12:49:46.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.855+0000 7f64ad0c2700 1 --2- 172.21.15.17:0/4061903634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a807a2d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:46.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.855+0000 7f64ad0c2700 1 -- 172.21.15.17:0/4061903634 >> 172.21.15.17:0/4061903634 conn(0x7f64a8100900 msgr2=0x7f64a8102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:46.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.855+0000 7f64ad0c2700 1 -- 172.21.15.17:0/4061903634 shutdown_connections 2023-07-14T12:49:46.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.855+0000 7f64ad0c2700 1 -- 172.21.15.17:0/4061903634 wait complete. 2023-07-14T12:49:46.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.857+0000 7f64ad0c2700 1 Processor -- start 2023-07-14T12:49:46.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.857+0000 7f64ad0c2700 1 -- start start 2023-07-14T12:49:46.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.857+0000 7f64ad0c2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:46.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.857+0000 7f64ad0c2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a819b6b0 con 0x7f64a807bdd0 2023-07-14T12:49:46.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.857+0000 7f64a6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:46.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.858+0000 7f64a6d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41988/0 (socket says 172.21.15.17:41988) 2023-07-14T12:49:46.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.858+0000 7f64a6d9d700 1 -- 172.21.15.17:0/2204354290 learned_addr learned my addr 172.21.15.17:0/2204354290 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:46.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.858+0000 7f64a6d9d700 1 -- 172.21.15.17:0/2204354290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6498009550 con 0x7f64a807bdd0 2023-07-14T12:49:46.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.858+0000 7f64a6d9d700 1 --2- 172.21.15.17:0/2204354290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a819b170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6498000c00 tx=0x7f6498011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:46.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.858+0000 7f648ffff700 1 -- 172.21.15.17:0/2204354290 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64980036a0 con 0x7f64a807bdd0 2023-07-14T12:49:46.588 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.858+0000 7f648ffff700 1 -- 172.21.15.17:0/2204354290 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6498003c70 con 0x7f64a807bdd0 2023-07-14T12:49:46.588 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.858+0000 7f64ad0c2700 1 -- 172.21.15.17:0/2204354290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a819b8b0 con 0x7f64a807bdd0 2023-07-14T12:49:46.588 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.858+0000 7f648ffff700 1 -- 172.21.15.17:0/2204354290 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64980193f0 con 0x7f64a807bdd0 2023-07-14T12:49:46.588 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.859+0000 7f64ad0c2700 1 -- 172.21.15.17:0/2204354290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a819bcd0 con 0x7f64a807bdd0 2023-07-14T12:49:46.588 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.860+0000 7f648ffff700 1 -- 172.21.15.17:0/2204354290 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f649801b440 con 0x7f64a807bdd0 2023-07-14T12:49:46.588 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.860+0000 7f64ad0c2700 1 -- 172.21.15.17:0/2204354290 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a8061b40 con 0x7f64a807bdd0 2023-07-14T12:49:46.588 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.860+0000 7f648ffff700 1 --2- 172.21.15.17:0/2204354290 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6490038760 0x7f649003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:46.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.860+0000 7f648ffff700 1 -- 172.21.15.17:0/2204354290 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f649804c5d0 con 0x7f64a807bdd0 2023-07-14T12:49:46.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.860+0000 7f64a659c700 1 --2- 172.21.15.17:0/2204354290 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6490038760 0x7f649003ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:46.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.861+0000 7f64a659c700 1 --2- 172.21.15.17:0/2204354290 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6490038760 0x7f649003ac10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f649c006fd0 tx=0x7f649c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:46.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:45.866+0000 7f648ffff700 1 -- 172.21.15.17:0/2204354290 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6498022950 con 0x7f64a807bdd0 2023-07-14T12:49:46.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.073+0000 7f64ad0c2700 1 -- 172.21.15.17:0/2204354290 --> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f64a8102c20 con 0x7f6490038760 2023-07-14T12:49:46.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.074+0000 7f648ffff700 1 -- 172.21.15.17:0/2204354290 <== mgr.14118 v2:172.21.15.17:6800/1783581931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f64a8102c20 con 0x7f6490038760 2023-07-14T12:49:46.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.076+0000 7f64ad0c2700 1 -- 172.21.15.17:0/2204354290 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6490038760 msgr2=0x7f649003ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:46.589 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.076+0000 7f64ad0c2700 1 --2- 172.21.15.17:0/2204354290 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6490038760 0x7f649003ac10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f649c006fd0 tx=0x7f649c006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:46.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.076+0000 7f64ad0c2700 1 -- 172.21.15.17:0/2204354290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 msgr2=0x7f64a819b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:46.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.076+0000 7f64ad0c2700 1 --2- 172.21.15.17:0/2204354290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a819b170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6498000c00 tx=0x7f6498011e70 comp rx=0 tx=0).stop 2023-07-14T12:49:46.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.076+0000 7f64ad0c2700 1 -- 172.21.15.17:0/2204354290 shutdown_connections 2023-07-14T12:49:46.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.076+0000 7f64ad0c2700 1 --2- 172.21.15.17:0/2204354290 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f6490038760 0x7f649003ac10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:46.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.076+0000 7f64ad0c2700 1 --2- 172.21.15.17:0/2204354290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a807bdd0 0x7f64a819b170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:46.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.076+0000 7f64ad0c2700 1 -- 172.21.15.17:0/2204354290 >> 172.21.15.17:0/2204354290 conn(0x7f64a8100900 msgr2=0x7f64a8102000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:46.590 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.076+0000 7f64ad0c2700 1 -- 172.21.15.17:0/2204354290 shutdown_connections 2023-07-14T12:49:46.591 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:46.076+0000 7f64ad0c2700 1 -- 172.21.15.17:0/2204354290 wait complete. 2023-07-14T12:49:46.591 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-07-14T12:49:46.591 INFO:teuthology.orchestra.run.smithi017.stdout:Adding key to root@localhost authorized_keys... 2023-07-14T12:49:46.591 INFO:teuthology.orchestra.run.smithi017.stdout:Adding host smithi017... 2023-07-14T12:49:47.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:46 smithi017 ceph-mon[95536]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:49:48.057 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:47 smithi017 ceph-mon[95536]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:49:49.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:48 smithi017 ceph-mon[95536]: Deploying cephadm binary to smithi017 2023-07-14T12:49:50.972 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Added host 'smithi017' with addr '172.21.15.17' 2023-07-14T12:49:50.973 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.128+0000 7fabcbf8d700 1 Processor -- start 2023-07-14T12:49:50.973 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.128+0000 7fabcbf8d700 1 -- start start 2023-07-14T12:49:50.973 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.129+0000 7fabcbf8d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc407a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:50.973 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.129+0000 7fabcbf8d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc407a810 con 0x7fabc407bdd0 2023-07-14T12:49:50.973 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.129+0000 7fabc9d29700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc407a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:50.973 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.129+0000 7fabc9d29700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc407a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41990/0 (socket says 172.21.15.17:41990) 2023-07-14T12:49:50.973 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.129+0000 7fabc9d29700 1 -- 172.21.15.17:0/4174919361 learned_addr learned my addr 172.21.15.17:0/4174919361 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.129+0000 7fabc9d29700 1 -- 172.21.15.17:0/4174919361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc407a950 con 0x7fabc407bdd0 2023-07-14T12:49:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.130+0000 7fabc9d29700 1 --2- 172.21.15.17:0/4174919361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc407a2d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fabc00098a0 tx=0x7fabc0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e27aee8c605110 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.130+0000 7fabc8d27700 1 -- 172.21.15.17:0/4174919361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabc0004160 con 0x7fabc407bdd0 2023-07-14T12:49:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.130+0000 7fabc8d27700 1 -- 172.21.15.17:0/4174919361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fabc00042c0 con 0x7fabc407bdd0 2023-07-14T12:49:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.130+0000 7fabc8d27700 1 -- 172.21.15.17:0/4174919361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabc0011940 con 0x7fabc407bdd0 2023-07-14T12:49:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.130+0000 7fabcbf8d700 1 -- 172.21.15.17:0/4174919361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 msgr2=0x7fabc407a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.130+0000 7fabcbf8d700 1 --2- 172.21.15.17:0/4174919361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc407a2d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fabc00098a0 tx=0x7fabc0009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.131+0000 7fabcbf8d700 1 -- 172.21.15.17:0/4174919361 shutdown_connections 2023-07-14T12:49:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.131+0000 7fabcbf8d700 1 --2- 172.21.15.17:0/4174919361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc407a2d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.131+0000 7fabcbf8d700 1 -- 172.21.15.17:0/4174919361 >> 172.21.15.17:0/4174919361 conn(0x7fabc4100890 msgr2=0x7fabc4102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.131+0000 7fabcbf8d700 1 -- 172.21.15.17:0/4174919361 shutdown_connections 2023-07-14T12:49:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.131+0000 7fabcbf8d700 1 -- 172.21.15.17:0/4174919361 wait complete. 2023-07-14T12:49:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.132+0000 7fabcbf8d700 1 Processor -- start 2023-07-14T12:49:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.132+0000 7fabcbf8d700 1 -- start start 2023-07-14T12:49:50.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.133+0000 7fabcbf8d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc419b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:50.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.133+0000 7fabcbf8d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc419b5d0 con 0x7fabc407bdd0 2023-07-14T12:49:50.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.133+0000 7fabc9d29700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc419b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:50.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.133+0000 7fabc9d29700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc419b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42004/0 (socket says 172.21.15.17:42004) 2023-07-14T12:49:50.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.133+0000 7fabc9d29700 1 -- 172.21.15.17:0/3998280970 learned_addr learned my addr 172.21.15.17:0/3998280970 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:50.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.134+0000 7fabc9d29700 1 -- 172.21.15.17:0/3998280970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc0009550 con 0x7fabc407bdd0 2023-07-14T12:49:50.976 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.134+0000 7fabc9d29700 1 --2- 172.21.15.17:0/3998280970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc419b090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fabc0000c00 tx=0x7fabc0011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:50.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.134+0000 7fabbaffd700 1 -- 172.21.15.17:0/3998280970 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabc00036a0 con 0x7fabc407bdd0 2023-07-14T12:49:50.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.134+0000 7fabcbf8d700 1 -- 172.21.15.17:0/3998280970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc419b7d0 con 0x7fabc407bdd0 2023-07-14T12:49:50.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.134+0000 7fabcbf8d700 1 -- 172.21.15.17:0/3998280970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc419bbf0 con 0x7fabc407bdd0 2023-07-14T12:49:50.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.134+0000 7fabbaffd700 1 -- 172.21.15.17:0/3998280970 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fabc0003c70 con 0x7fabc407bdd0 2023-07-14T12:49:50.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.134+0000 7fabbaffd700 1 -- 172.21.15.17:0/3998280970 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabc001bda0 con 0x7fabc407bdd0 2023-07-14T12:49:50.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.135+0000 7fabbaffd700 1 -- 172.21.15.17:0/3998280970 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fabc00193f0 con 0x7fabc407bdd0 2023-07-14T12:49:50.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.135+0000 7fabcbf8d700 1 -- 172.21.15.17:0/3998280970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba8005320 con 0x7fabc407bdd0 2023-07-14T12:49:50.977 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.136+0000 7fabbaffd700 1 --2- 172.21.15.17:0/3998280970 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fabb0038760 0x7fabb003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:50.978 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.136+0000 7fabbaffd700 1 -- 172.21.15.17:0/3998280970 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fabc004c620 con 0x7fabc407bdd0 2023-07-14T12:49:50.978 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.136+0000 7fabc9528700 1 --2- 172.21.15.17:0/3998280970 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fabb0038760 0x7fabb003ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:50.978 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.136+0000 7fabc9528700 1 --2- 172.21.15.17:0/3998280970 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fabb0038760 0x7fabb003ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006fd0 tx=0x7fabb4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:50.978 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.141+0000 7fabbaffd700 1 -- 172.21.15.17:0/3998280970 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fabc0022720 con 0x7fabc407bdd0 2023-07-14T12:49:50.978 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:47.350+0000 7fabcbf8d700 1 -- 172.21.15.17:0/3998280970 --> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}) v1 -- 0x7faba8000bf0 con 0x7fabb0038760 2023-07-14T12:49:50.978 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:50.518+0000 7fabbaffd700 1 -- 172.21.15.17:0/3998280970 <== mgr.14118 v2:172.21.15.17:6800/1783581931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7faba8000bf0 con 0x7fabb0038760 2023-07-14T12:49:50.978 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:50.521+0000 7fabcbf8d700 1 -- 172.21.15.17:0/3998280970 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fabb0038760 msgr2=0x7fabb003ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:50.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:50.521+0000 7fabcbf8d700 1 --2- 172.21.15.17:0/3998280970 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fabb0038760 0x7fabb003ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006fd0 tx=0x7fabb4006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:50.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:50.521+0000 7fabcbf8d700 1 -- 172.21.15.17:0/3998280970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 msgr2=0x7fabc419b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:50.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:50.521+0000 7fabcbf8d700 1 --2- 172.21.15.17:0/3998280970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc419b090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fabc0000c00 tx=0x7fabc0011e70 comp rx=0 tx=0).stop 2023-07-14T12:49:50.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:50.521+0000 7fabcbf8d700 1 -- 172.21.15.17:0/3998280970 shutdown_connections 2023-07-14T12:49:50.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:50.521+0000 7fabcbf8d700 1 --2- 172.21.15.17:0/3998280970 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fabb0038760 0x7fabb003ac10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:50.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:50.521+0000 7fabcbf8d700 1 --2- 172.21.15.17:0/3998280970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabc407bdd0 0x7fabc419b090 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:50.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:50.521+0000 7fabcbf8d700 1 -- 172.21.15.17:0/3998280970 >> 172.21.15.17:0/3998280970 conn(0x7fabc4100890 msgr2=0x7fabc4101650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:50.979 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:50.521+0000 7fabcbf8d700 1 -- 172.21.15.17:0/3998280970 shutdown_connections 2023-07-14T12:49:50.980 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:50.521+0000 7fabcbf8d700 1 -- 172.21.15.17:0/3998280970 wait complete. 2023-07-14T12:49:50.980 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mon service... 2023-07-14T12:49:51.788 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:51 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:51.789 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:51 smithi017 ceph-mon[95536]: Added host smithi017 2023-07-14T12:49:51.789 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:51 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:49:52.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-07-14T12:49:52.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.499+0000 7f8568a58700 1 Processor -- start 2023-07-14T12:49:52.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.499+0000 7f8568a58700 1 -- start start 2023-07-14T12:49:52.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.500+0000 7f8568a58700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856407a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:52.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.500+0000 7f8568a58700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856407a830 con 0x7f856407bdf0 2023-07-14T12:49:52.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.500+0000 7f856259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856407a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:52.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.500+0000 7f856259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856407a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42016/0 (socket says 172.21.15.17:42016) 2023-07-14T12:49:52.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.500+0000 7f856259c700 1 -- 172.21.15.17:0/2157348240 learned_addr learned my addr 172.21.15.17:0/2157348240 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:52.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.500+0000 7f856259c700 1 -- 172.21.15.17:0/2157348240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856407a970 con 0x7f856407bdf0 2023-07-14T12:49:52.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.501+0000 7f856259c700 1 --2- 172.21.15.17:0/2157348240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856407a2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f85540098a0 tx=0x7f8554009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8799d3a0e9ff1c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:52.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.501+0000 7f856159a700 1 -- 172.21.15.17:0/2157348240 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8554004160 con 0x7f856407bdf0 2023-07-14T12:49:52.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.501+0000 7f856159a700 1 -- 172.21.15.17:0/2157348240 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f85540042c0 con 0x7f856407bdf0 2023-07-14T12:49:52.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.501+0000 7f856159a700 1 -- 172.21.15.17:0/2157348240 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8554011940 con 0x7f856407bdf0 2023-07-14T12:49:52.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.501+0000 7f8568a58700 1 -- 172.21.15.17:0/2157348240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 msgr2=0x7f856407a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:52.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.501+0000 7f8568a58700 1 --2- 172.21.15.17:0/2157348240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856407a2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f85540098a0 tx=0x7f8554009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:52.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.502+0000 7f8568a58700 1 -- 172.21.15.17:0/2157348240 shutdown_connections 2023-07-14T12:49:52.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.502+0000 7f8568a58700 1 --2- 172.21.15.17:0/2157348240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856407a2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:52.273 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.502+0000 7f8568a58700 1 -- 172.21.15.17:0/2157348240 >> 172.21.15.17:0/2157348240 conn(0x7f8564100890 msgr2=0x7f8564102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:52.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.502+0000 7f8568a58700 1 -- 172.21.15.17:0/2157348240 shutdown_connections 2023-07-14T12:49:52.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.502+0000 7f8568a58700 1 -- 172.21.15.17:0/2157348240 wait complete. 2023-07-14T12:49:52.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.503+0000 7f8568a58700 1 Processor -- start 2023-07-14T12:49:52.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.503+0000 7f8568a58700 1 -- start start 2023-07-14T12:49:52.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.503+0000 7f8568a58700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856419b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:52.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.503+0000 7f8568a58700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856419b5d0 con 0x7f856407bdf0 2023-07-14T12:49:52.274 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.504+0000 7f856259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856419b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:52.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.504+0000 7f856259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856419b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42028/0 (socket says 172.21.15.17:42028) 2023-07-14T12:49:52.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.504+0000 7f856259c700 1 -- 172.21.15.17:0/3662043540 learned_addr learned my addr 172.21.15.17:0/3662043540 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:52.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.504+0000 7f856259c700 1 -- 172.21.15.17:0/3662043540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8554009550 con 0x7f856407bdf0 2023-07-14T12:49:52.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.504+0000 7f856259c700 1 --2- 172.21.15.17:0/3662043540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856419b090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8554000c00 tx=0x7f8554011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:52.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.504+0000 7f85537fe700 1 -- 172.21.15.17:0/3662043540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85540036a0 con 0x7f856407bdf0 2023-07-14T12:49:52.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.504+0000 7f85537fe700 1 -- 172.21.15.17:0/3662043540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f8554003c70 con 0x7f856407bdf0 2023-07-14T12:49:52.275 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.504+0000 7f85537fe700 1 -- 172.21.15.17:0/3662043540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85540193f0 con 0x7f856407bdf0 2023-07-14T12:49:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.504+0000 7f8568a58700 1 -- 172.21.15.17:0/3662043540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856419b7d0 con 0x7f856407bdf0 2023-07-14T12:49:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.505+0000 7f8568a58700 1 -- 172.21.15.17:0/3662043540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856419bbf0 con 0x7f856407bdf0 2023-07-14T12:49:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.506+0000 7f85537fe700 1 -- 172.21.15.17:0/3662043540 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f855401b440 con 0x7f856407bdf0 2023-07-14T12:49:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.506+0000 7f8568a58700 1 -- 172.21.15.17:0/3662043540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856410b500 con 0x7f856407bdf0 2023-07-14T12:49:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.506+0000 7f85537fe700 1 --2- 172.21.15.17:0/3662043540 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f854c038760 0x7f854c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.506+0000 7f85537fe700 1 -- 172.21.15.17:0/3662043540 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f855404c510 con 0x7f856407bdf0 2023-07-14T12:49:52.276 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.507+0000 7f8561d9b700 1 --2- 172.21.15.17:0/3662043540 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f854c038760 0x7f854c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:52.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.507+0000 7f8561d9b700 1 --2- 172.21.15.17:0/3662043540 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f854c038760 0x7f854c03ac10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8558006fd0 tx=0x7f8558006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:52.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.512+0000 7f85537fe700 1 -- 172.21.15.17:0/3662043540 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8554022950 con 0x7f856407bdf0 2023-07-14T12:49:52.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.738+0000 7f8568a58700 1 -- 172.21.15.17:0/3662043540 --> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f856419ea50 con 0x7f854c038760 2023-07-14T12:49:52.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.743+0000 7f85537fe700 1 -- 172.21.15.17:0/3662043540 <== mgr.14118 v2:172.21.15.17:6800/1783581931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f856419ea50 con 0x7f854c038760 2023-07-14T12:49:52.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.745+0000 7f8568a58700 1 -- 172.21.15.17:0/3662043540 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f854c038760 msgr2=0x7f854c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:52.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.745+0000 7f8568a58700 1 --2- 172.21.15.17:0/3662043540 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f854c038760 0x7f854c03ac10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8558006fd0 tx=0x7f8558006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:52.277 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.745+0000 7f8568a58700 1 -- 172.21.15.17:0/3662043540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 msgr2=0x7f856419b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:52.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.745+0000 7f8568a58700 1 --2- 172.21.15.17:0/3662043540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856419b090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8554000c00 tx=0x7f8554011e70 comp rx=0 tx=0).stop 2023-07-14T12:49:52.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.745+0000 7f8568a58700 1 -- 172.21.15.17:0/3662043540 shutdown_connections 2023-07-14T12:49:52.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.745+0000 7f8568a58700 1 --2- 172.21.15.17:0/3662043540 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f854c038760 0x7f854c03ac10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:52.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.745+0000 7f8568a58700 1 --2- 172.21.15.17:0/3662043540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f856407bdf0 0x7f856419b090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:52.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.745+0000 7f8568a58700 1 -- 172.21.15.17:0/3662043540 >> 172.21.15.17:0/3662043540 conn(0x7f8564100890 msgr2=0x7f8564101610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:52.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.746+0000 7f8568a58700 1 -- 172.21.15.17:0/3662043540 shutdown_connections 2023-07-14T12:49:52.278 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:51.746+0000 7f8568a58700 1 -- 172.21.15.17:0/3662043540 wait complete. 2023-07-14T12:49:52.278 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying unmanaged mgr service... 2023-07-14T12:49:52.912 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:52 smithi017 ceph-mon[95536]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:49:52.912 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:52 smithi017 ceph-mon[95536]: Saving service mon spec with placement count:5 2023-07-14T12:49:52.912 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:52 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:53.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-07-14T12:49:53.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.952+0000 7f0130d23700 1 Processor -- start 2023-07-14T12:49:53.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.953+0000 7f0130d23700 1 -- start start 2023-07-14T12:49:53.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.953+0000 7f0130d23700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c07a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:53.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.953+0000 7f0130d23700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c07a870 con 0x7f012c07be30 2023-07-14T12:49:53.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.953+0000 7f012a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c07a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:53.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.954+0000 7f012a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c07a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42038/0 (socket says 172.21.15.17:42038) 2023-07-14T12:49:53.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.954+0000 7f012a59c700 1 -- 172.21.15.17:0/400226853 learned_addr learned my addr 172.21.15.17:0/400226853 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:53.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.954+0000 7f012a59c700 1 -- 172.21.15.17:0/400226853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c07a9b0 con 0x7f012c07be30 2023-07-14T12:49:53.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.954+0000 7f012a59c700 1 --2- 172.21.15.17:0/400226853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c07a330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f011c0098a0 tx=0x7f011c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bcd1c109ebc041 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:53.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.954+0000 7f012959a700 1 -- 172.21.15.17:0/400226853 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f011c004160 con 0x7f012c07be30 2023-07-14T12:49:53.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.954+0000 7f012959a700 1 -- 172.21.15.17:0/400226853 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f011c0042c0 con 0x7f012c07be30 2023-07-14T12:49:53.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.954+0000 7f012959a700 1 -- 172.21.15.17:0/400226853 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f011c011940 con 0x7f012c07be30 2023-07-14T12:49:53.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.955+0000 7f0130d23700 1 -- 172.21.15.17:0/400226853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 msgr2=0x7f012c07a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:53.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.955+0000 7f0130d23700 1 --2- 172.21.15.17:0/400226853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c07a330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f011c0098a0 tx=0x7f011c009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:53.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.955+0000 7f0130d23700 1 -- 172.21.15.17:0/400226853 shutdown_connections 2023-07-14T12:49:53.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.955+0000 7f0130d23700 1 --2- 172.21.15.17:0/400226853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c07a330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:53.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.955+0000 7f0130d23700 1 -- 172.21.15.17:0/400226853 >> 172.21.15.17:0/400226853 conn(0x7f012c100890 msgr2=0x7f012c102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:53.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.955+0000 7f0130d23700 1 -- 172.21.15.17:0/400226853 shutdown_connections 2023-07-14T12:49:53.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.955+0000 7f0130d23700 1 -- 172.21.15.17:0/400226853 wait complete. 2023-07-14T12:49:53.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.956+0000 7f0130d23700 1 Processor -- start 2023-07-14T12:49:53.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.956+0000 7f0130d23700 1 -- start start 2023-07-14T12:49:53.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.957+0000 7f0130d23700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:53.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.957+0000 7f0130d23700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c19b610 con 0x7f012c07be30 2023-07-14T12:49:53.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.957+0000 7f012a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:53.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.957+0000 7f012a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c19b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42048/0 (socket says 172.21.15.17:42048) 2023-07-14T12:49:53.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.957+0000 7f012a59c700 1 -- 172.21.15.17:0/3604631349 learned_addr learned my addr 172.21.15.17:0/3604631349 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:53.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.957+0000 7f012a59c700 1 -- 172.21.15.17:0/3604631349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c009550 con 0x7f012c07be30 2023-07-14T12:49:53.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.958+0000 7f012a59c700 1 --2- 172.21.15.17:0/3604631349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c19b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f011c000c00 tx=0x7f011c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:53.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.958+0000 7f011b7fe700 1 -- 172.21.15.17:0/3604631349 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f011c0036a0 con 0x7f012c07be30 2023-07-14T12:49:53.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.958+0000 7f011b7fe700 1 -- 172.21.15.17:0/3604631349 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f011c003c70 con 0x7f012c07be30 2023-07-14T12:49:53.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.958+0000 7f0130d23700 1 -- 172.21.15.17:0/3604631349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012c19b810 con 0x7f012c07be30 2023-07-14T12:49:53.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.958+0000 7f011b7fe700 1 -- 172.21.15.17:0/3604631349 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f011c0193f0 con 0x7f012c07be30 2023-07-14T12:49:53.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.958+0000 7f0130d23700 1 -- 172.21.15.17:0/3604631349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c19bc30 con 0x7f012c07be30 2023-07-14T12:49:53.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.959+0000 7f011b7fe700 1 -- 172.21.15.17:0/3604631349 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f011c01b440 con 0x7f012c07be30 2023-07-14T12:49:53.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.959+0000 7f0130d23700 1 -- 172.21.15.17:0/3604631349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012c061b40 con 0x7f012c07be30 2023-07-14T12:49:53.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.959+0000 7f011b7fe700 1 --2- 172.21.15.17:0/3604631349 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f01140387b0 0x7f011403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:53.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.960+0000 7f011b7fe700 1 -- 172.21.15.17:0/3604631349 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f011c04c5a0 con 0x7f012c07be30 2023-07-14T12:49:53.711 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.960+0000 7f0129d9b700 1 --2- 172.21.15.17:0/3604631349 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f01140387b0 0x7f011403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:53.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.960+0000 7f0129d9b700 1 --2- 172.21.15.17:0/3604631349 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f01140387b0 0x7f011403ac60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0120006fd0 tx=0x7f0120006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:53.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:52.965+0000 7f011b7fe700 1 -- 172.21.15.17:0/3604631349 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f011c022930 con 0x7f012c07be30 2023-07-14T12:49:53.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.172+0000 7f011b7fe700 1 -- 172.21.15.17:0/3604631349 <== mon.0 v2:172.21.15.17:3300/0 7 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f011c04bef0 con 0x7f012c07be30 2023-07-14T12:49:53.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.189+0000 7f0130d23700 1 -- 172.21.15.17:0/3604631349 --> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f012c101d70 con 0x7f01140387b0 2023-07-14T12:49:53.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.193+0000 7f011b7fe700 1 -- 172.21.15.17:0/3604631349 <== mgr.14118 v2:172.21.15.17:6800/1783581931 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f012c101d70 con 0x7f01140387b0 2023-07-14T12:49:53.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.195+0000 7f0130d23700 1 -- 172.21.15.17:0/3604631349 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f01140387b0 msgr2=0x7f011403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:53.712 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.195+0000 7f0130d23700 1 --2- 172.21.15.17:0/3604631349 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f01140387b0 0x7f011403ac60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0120006fd0 tx=0x7f0120006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:53.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.195+0000 7f0130d23700 1 -- 172.21.15.17:0/3604631349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 msgr2=0x7f012c19b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:53.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.195+0000 7f0130d23700 1 --2- 172.21.15.17:0/3604631349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c19b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f011c000c00 tx=0x7f011c011e70 comp rx=0 tx=0).stop 2023-07-14T12:49:53.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.195+0000 7f0130d23700 1 -- 172.21.15.17:0/3604631349 shutdown_connections 2023-07-14T12:49:53.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.196+0000 7f0130d23700 1 --2- 172.21.15.17:0/3604631349 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f01140387b0 0x7f011403ac60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:53.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.196+0000 7f0130d23700 1 --2- 172.21.15.17:0/3604631349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f012c07be30 0x7f012c19b0d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:53.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.196+0000 7f0130d23700 1 -- 172.21.15.17:0/3604631349 >> 172.21.15.17:0/3604631349 conn(0x7f012c100890 msgr2=0x7f012c101660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:53.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.196+0000 7f0130d23700 1 -- 172.21.15.17:0/3604631349 shutdown_connections 2023-07-14T12:49:53.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:53.196+0000 7f0130d23700 1 -- 172.21.15.17:0/3604631349 wait complete. 2023-07-14T12:49:54.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:54 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:54.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:54 smithi017 ceph-mon[95536]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:49:54.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:54 smithi017 ceph-mon[95536]: Saving service mgr spec with placement count:2 2023-07-14T12:49:54.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:54 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:54.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:54 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:55.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.270+0000 7f3bc79da700 1 Processor -- start 2023-07-14T12:49:55.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.270+0000 7f3bc79da700 1 -- start start 2023-07-14T12:49:55.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.271+0000 7f3bc79da700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc007a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:55.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.271+0000 7f3bc79da700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc007a870 con 0x7f3bc007be30 2023-07-14T12:49:55.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.271+0000 7f3bc5776700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc007a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:55.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.271+0000 7f3bc5776700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc007a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42058/0 (socket says 172.21.15.17:42058) 2023-07-14T12:49:55.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.271+0000 7f3bc5776700 1 -- 172.21.15.17:0/200343959 learned_addr learned my addr 172.21.15.17:0/200343959 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:55.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.271+0000 7f3bc5776700 1 -- 172.21.15.17:0/200343959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc007a9b0 con 0x7f3bc007be30 2023-07-14T12:49:55.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.272+0000 7f3bc5776700 1 --2- 172.21.15.17:0/200343959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc007a330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0098a0 tx=0x7f3bbc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf3ad60b02b3dfd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:55.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.272+0000 7f3bb7fff700 1 -- 172.21.15.17:0/200343959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc004160 con 0x7f3bc007be30 2023-07-14T12:49:55.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.272+0000 7f3bb7fff700 1 -- 172.21.15.17:0/200343959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3bbc0042c0 con 0x7f3bc007be30 2023-07-14T12:49:55.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.272+0000 7f3bb7fff700 1 -- 172.21.15.17:0/200343959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc0118e0 con 0x7f3bc007be30 2023-07-14T12:49:55.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.272+0000 7f3bc79da700 1 -- 172.21.15.17:0/200343959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 msgr2=0x7f3bc007a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:55.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.272+0000 7f3bc79da700 1 --2- 172.21.15.17:0/200343959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc007a330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0098a0 tx=0x7f3bbc009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:55.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.273+0000 7f3bc79da700 1 -- 172.21.15.17:0/200343959 shutdown_connections 2023-07-14T12:49:55.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.273+0000 7f3bc79da700 1 --2- 172.21.15.17:0/200343959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc007a330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:55.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.273+0000 7f3bc79da700 1 -- 172.21.15.17:0/200343959 >> 172.21.15.17:0/200343959 conn(0x7f3bc0100900 msgr2=0x7f3bc0102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:55.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.273+0000 7f3bc79da700 1 -- 172.21.15.17:0/200343959 shutdown_connections 2023-07-14T12:49:55.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.273+0000 7f3bc79da700 1 -- 172.21.15.17:0/200343959 wait complete. 2023-07-14T12:49:55.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.274+0000 7f3bc79da700 1 Processor -- start 2023-07-14T12:49:55.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.274+0000 7f3bc79da700 1 -- start start 2023-07-14T12:49:55.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.274+0000 7f3bc79da700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc019b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:55.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.274+0000 7f3bc79da700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc019b760 con 0x7f3bc007be30 2023-07-14T12:49:55.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.274+0000 7f3bc5776700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc019b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:55.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.274+0000 7f3bc5776700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc019b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42060/0 (socket says 172.21.15.17:42060) 2023-07-14T12:49:55.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.274+0000 7f3bc5776700 1 -- 172.21.15.17:0/764383263 learned_addr learned my addr 172.21.15.17:0/764383263 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:55.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.275+0000 7f3bc5776700 1 -- 172.21.15.17:0/764383263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc009550 con 0x7f3bc007be30 2023-07-14T12:49:55.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.275+0000 7f3bc5776700 1 --2- 172.21.15.17:0/764383263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc019b220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc003e30 tx=0x7f3bbc011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:55.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.275+0000 7f3bb67fc700 1 -- 172.21.15.17:0/764383263 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc0037d0 con 0x7f3bc007be30 2023-07-14T12:49:55.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.275+0000 7f3bb67fc700 1 -- 172.21.15.17:0/764383263 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3bbc01b440 con 0x7f3bc007be30 2023-07-14T12:49:55.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.275+0000 7f3bc79da700 1 -- 172.21.15.17:0/764383263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc019b960 con 0x7f3bc007be30 2023-07-14T12:49:55.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.275+0000 7f3bb67fc700 1 -- 172.21.15.17:0/764383263 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bbc023400 con 0x7f3bc007be30 2023-07-14T12:49:55.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.275+0000 7f3bc79da700 1 -- 172.21.15.17:0/764383263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc019bd80 con 0x7f3bc007be30 2023-07-14T12:49:55.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.276+0000 7f3bb67fc700 1 -- 172.21.15.17:0/764383263 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f3bbc003930 con 0x7f3bc007be30 2023-07-14T12:49:55.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.276+0000 7f3bc79da700 1 -- 172.21.15.17:0/764383263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc01951a0 con 0x7f3bc007be30 2023-07-14T12:49:55.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.277+0000 7f3bb67fc700 1 --2- 172.21.15.17:0/764383263 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f3bac038740 0x7f3bac03abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:55.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.277+0000 7f3bb67fc700 1 -- 172.21.15.17:0/764383263 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3bbc04c730 con 0x7f3bc007be30 2023-07-14T12:49:55.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.277+0000 7f3bc4f75700 1 --2- 172.21.15.17:0/764383263 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f3bac038740 0x7f3bac03abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:55.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.278+0000 7f3bc4f75700 1 --2- 172.21.15.17:0/764383263 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f3bac038740 0x7f3bac03abf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0006fd0 tx=0x7f3bb0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:55.094 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.282+0000 7f3bb67fc700 1 -- 172.21.15.17:0/764383263 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3bbc02b350 con 0x7f3bc007be30 2023-07-14T12:49:55.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.497+0000 7f3bc79da700 1 -- 172.21.15.17:0/764383263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f3bc002cce0 con 0x7f3bc007be30 2023-07-14T12:49:55.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.501+0000 7f3bb67fc700 1 -- 172.21.15.17:0/764383263 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f3bbc01a3d0 con 0x7f3bc007be30 2023-07-14T12:49:55.095 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.505+0000 7f3bc79da700 1 -- 172.21.15.17:0/764383263 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f3bac038740 msgr2=0x7f3bac03abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:55.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.505+0000 7f3bc79da700 1 --2- 172.21.15.17:0/764383263 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f3bac038740 0x7f3bac03abf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0006fd0 tx=0x7f3bb0006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:55.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.505+0000 7f3bc79da700 1 -- 172.21.15.17:0/764383263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 msgr2=0x7f3bc019b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:55.096 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.505+0000 7f3bc79da700 1 --2- 172.21.15.17:0/764383263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc019b220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc003e30 tx=0x7f3bbc011b50 comp rx=0 tx=0).stop 2023-07-14T12:49:55.097 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.505+0000 7f3bc79da700 1 -- 172.21.15.17:0/764383263 shutdown_connections 2023-07-14T12:49:55.097 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.505+0000 7f3bc79da700 1 --2- 172.21.15.17:0/764383263 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f3bac038740 0x7f3bac03abf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:55.097 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.505+0000 7f3bc79da700 1 --2- 172.21.15.17:0/764383263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bc007be30 0x7f3bc019b220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:55.097 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.505+0000 7f3bc79da700 1 -- 172.21.15.17:0/764383263 >> 172.21.15.17:0/764383263 conn(0x7f3bc0100900 msgr2=0x7f3bc0102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:55.097 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.505+0000 7f3bc79da700 1 -- 172.21.15.17:0/764383263 shutdown_connections 2023-07-14T12:49:55.097 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:54.505+0000 7f3bc79da700 1 -- 172.21.15.17:0/764383263 wait complete. 2023-07-14T12:49:55.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:55 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/764383263' entity='client.admin' 2023-07-14T12:49:56.579 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.667+0000 7f15e2b5b700 1 Processor -- start 2023-07-14T12:49:56.580 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.667+0000 7f15e2b5b700 1 -- start start 2023-07-14T12:49:56.580 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.668+0000 7f15e2b5b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc105610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:56.580 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.668+0000 7f15e2b5b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc105b50 con 0x7f15dc105200 2023-07-14T12:49:56.580 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.668+0000 7f15e08f7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc105610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:56.580 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.668+0000 7f15e08f7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc105610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37734/0 (socket says 172.21.15.17:37734) 2023-07-14T12:49:56.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.668+0000 7f15e08f7700 1 -- 172.21.15.17:0/4285430574 learned_addr learned my addr 172.21.15.17:0/4285430574 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:56.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.669+0000 7f15e08f7700 1 -- 172.21.15.17:0/4285430574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc105c90 con 0x7f15dc105200 2023-07-14T12:49:56.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.669+0000 7f15e08f7700 1 --2- 172.21.15.17:0/4285430574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc105610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f15d00098a0 tx=0x7f15d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7dcd7ba083e49bc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:56.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.669+0000 7f15db7fe700 1 -- 172.21.15.17:0/4285430574 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15d0004160 con 0x7f15dc105200 2023-07-14T12:49:56.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.669+0000 7f15db7fe700 1 -- 172.21.15.17:0/4285430574 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15d00042c0 con 0x7f15dc105200 2023-07-14T12:49:56.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.669+0000 7f15db7fe700 1 -- 172.21.15.17:0/4285430574 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15d00118e0 con 0x7f15dc105200 2023-07-14T12:49:56.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.670+0000 7f15e2b5b700 1 -- 172.21.15.17:0/4285430574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 msgr2=0x7f15dc105610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:56.581 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.670+0000 7f15e2b5b700 1 --2- 172.21.15.17:0/4285430574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc105610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f15d00098a0 tx=0x7f15d0009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:56.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.670+0000 7f15e2b5b700 1 -- 172.21.15.17:0/4285430574 shutdown_connections 2023-07-14T12:49:56.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.670+0000 7f15e2b5b700 1 --2- 172.21.15.17:0/4285430574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc105610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:56.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.670+0000 7f15e2b5b700 1 -- 172.21.15.17:0/4285430574 >> 172.21.15.17:0/4285430574 conn(0x7f15dc100890 msgr2=0x7f15dc102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:56.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.670+0000 7f15e2b5b700 1 -- 172.21.15.17:0/4285430574 shutdown_connections 2023-07-14T12:49:56.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.670+0000 7f15e2b5b700 1 -- 172.21.15.17:0/4285430574 wait complete. 2023-07-14T12:49:56.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.671+0000 7f15e2b5b700 1 Processor -- start 2023-07-14T12:49:56.582 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.671+0000 7f15e2b5b700 1 -- start start 2023-07-14T12:49:56.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.671+0000 7f15e2b5b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:56.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.671+0000 7f15e2b5b700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc19b680 con 0x7f15dc105200 2023-07-14T12:49:56.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.672+0000 7f15e08f7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:56.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.672+0000 7f15e08f7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc19b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37746/0 (socket says 172.21.15.17:37746) 2023-07-14T12:49:56.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.672+0000 7f15e08f7700 1 -- 172.21.15.17:0/644368877 learned_addr learned my addr 172.21.15.17:0/644368877 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:56.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.672+0000 7f15e08f7700 1 -- 172.21.15.17:0/644368877 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0009550 con 0x7f15dc105200 2023-07-14T12:49:56.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.672+0000 7f15e08f7700 1 --2- 172.21.15.17:0/644368877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc19b140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f15d0006af0 tx=0x7f15d0011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.673+0000 7f15d9ffb700 1 -- 172.21.15.17:0/644368877 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15d00037d0 con 0x7f15dc105200 2023-07-14T12:49:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.673+0000 7f15d9ffb700 1 -- 172.21.15.17:0/644368877 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15d001b440 con 0x7f15dc105200 2023-07-14T12:49:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.673+0000 7f15d9ffb700 1 -- 172.21.15.17:0/644368877 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15d0023400 con 0x7f15dc105200 2023-07-14T12:49:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.673+0000 7f15e2b5b700 1 -- 172.21.15.17:0/644368877 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15dc19b880 con 0x7f15dc105200 2023-07-14T12:49:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.673+0000 7f15e2b5b700 1 -- 172.21.15.17:0/644368877 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc19bca0 con 0x7f15dc105200 2023-07-14T12:49:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.674+0000 7f15d9ffb700 1 -- 172.21.15.17:0/644368877 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f15d001b5b0 con 0x7f15dc105200 2023-07-14T12:49:56.584 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.674+0000 7f15e2b5b700 1 -- 172.21.15.17:0/644368877 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15dc061b40 con 0x7f15dc105200 2023-07-14T12:49:56.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.674+0000 7f15d9ffb700 1 --2- 172.21.15.17:0/644368877 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f15cc038710 0x7f15cc03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:56.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.674+0000 7f15d9ffb700 1 -- 172.21.15.17:0/644368877 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f15d004c790 con 0x7f15dc105200 2023-07-14T12:49:56.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.675+0000 7f15dbfff700 1 --2- 172.21.15.17:0/644368877 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f15cc038710 0x7f15cc03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:56.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.675+0000 7f15dbfff700 1 --2- 172.21.15.17:0/644368877 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f15cc038710 0x7f15cc03abc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f15c8006fd0 tx=0x7f15c8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:56.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.679+0000 7f15d9ffb700 1 -- 172.21.15.17:0/644368877 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f15d001b8d0 con 0x7f15dc105200 2023-07-14T12:49:56.585 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.895+0000 7f15e2b5b700 1 -- 172.21.15.17:0/644368877 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f15dc19eb00 con 0x7f15dc105200 2023-07-14T12:49:56.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.899+0000 7f15d9ffb700 1 -- 172.21.15.17:0/644368877 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f15d000bbd0 con 0x7f15dc105200 2023-07-14T12:49:56.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.901+0000 7f15e2b5b700 1 -- 172.21.15.17:0/644368877 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f15cc038710 msgr2=0x7f15cc03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:56.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.901+0000 7f15e2b5b700 1 --2- 172.21.15.17:0/644368877 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f15cc038710 0x7f15cc03abc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f15c8006fd0 tx=0x7f15c8006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:56.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.901+0000 7f15e2b5b700 1 -- 172.21.15.17:0/644368877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 msgr2=0x7f15dc19b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:56.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.901+0000 7f15e2b5b700 1 --2- 172.21.15.17:0/644368877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc19b140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f15d0006af0 tx=0x7f15d0011ed0 comp rx=0 tx=0).stop 2023-07-14T12:49:56.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.901+0000 7f15e2b5b700 1 -- 172.21.15.17:0/644368877 shutdown_connections 2023-07-14T12:49:56.586 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.901+0000 7f15e2b5b700 1 --2- 172.21.15.17:0/644368877 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f15cc038710 0x7f15cc03abc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:56.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.901+0000 7f15e2b5b700 1 --2- 172.21.15.17:0/644368877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15dc105200 0x7f15dc19b140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:56.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.901+0000 7f15e2b5b700 1 -- 172.21.15.17:0/644368877 >> 172.21.15.17:0/644368877 conn(0x7f15dc100890 msgr2=0x7f15dc101670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:56.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.902+0000 7f15e2b5b700 1 -- 172.21.15.17:0/644368877 shutdown_connections 2023-07-14T12:49:56.587 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:55.902+0000 7f15e2b5b700 1 -- 172.21.15.17:0/644368877 wait complete. 2023-07-14T12:49:56.587 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling the dashboard module... 2023-07-14T12:49:57.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:56 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/644368877' entity='client.admin' 2023-07-14T12:49:57.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:56 smithi017 ceph-mon[95536]: from='mgr.14118 172.21.15.17:0/2979159498' entity='mgr.x' 2023-07-14T12:49:58.233 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:57 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1348443660' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-07-14T12:49:58.233 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: ignoring --setuser ceph since I am not root 2023-07-14T12:49:58.234 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: ignoring --setgroup ceph since I am not root 2023-07-14T12:49:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.150+0000 7f2b92d09700 1 Processor -- start 2023-07-14T12:49:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.150+0000 7f2b92d09700 1 -- start start 2023-07-14T12:49:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.150+0000 7f2b92d09700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c07a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.150+0000 7f2b92d09700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c07a810 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.151+0000 7f2b90aa5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c07a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.151+0000 7f2b90aa5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c07a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37752/0 (socket says 172.21.15.17:37752) 2023-07-14T12:49:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.151+0000 7f2b90aa5700 1 -- 172.21.15.17:0/512830251 learned_addr learned my addr 172.21.15.17:0/512830251 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.151+0000 7f2b90aa5700 1 -- 172.21.15.17:0/512830251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c07a950 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.151+0000 7f2b90aa5700 1 --2- 172.21.15.17:0/512830251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c07a2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b800098a0 tx=0x7f2b80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95cf9b548ab2c5b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.152+0000 7f2b8b7fe700 1 -- 172.21.15.17:0/512830251 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b80004160 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.152+0000 7f2b8b7fe700 1 -- 172.21.15.17:0/512830251 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b800042c0 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.152+0000 7f2b8b7fe700 1 -- 172.21.15.17:0/512830251 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b800118e0 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.152+0000 7f2b92d09700 1 -- 172.21.15.17:0/512830251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 msgr2=0x7f2b8c07a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:58.368 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.152+0000 7f2b92d09700 1 --2- 172.21.15.17:0/512830251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c07a2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b800098a0 tx=0x7f2b80009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.152+0000 7f2b92d09700 1 -- 172.21.15.17:0/512830251 shutdown_connections 2023-07-14T12:49:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.152+0000 7f2b92d09700 1 --2- 172.21.15.17:0/512830251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c07a2d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.152+0000 7f2b92d09700 1 -- 172.21.15.17:0/512830251 >> 172.21.15.17:0/512830251 conn(0x7f2b8c100890 msgr2=0x7f2b8c102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.152+0000 7f2b92d09700 1 -- 172.21.15.17:0/512830251 shutdown_connections 2023-07-14T12:49:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.152+0000 7f2b92d09700 1 -- 172.21.15.17:0/512830251 wait complete. 2023-07-14T12:49:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.153+0000 7f2b92d09700 1 Processor -- start 2023-07-14T12:49:58.369 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.154+0000 7f2b92d09700 1 -- start start 2023-07-14T12:49:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.154+0000 7f2b92d09700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.154+0000 7f2b92d09700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c19b680 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.154+0000 7f2b90aa5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.154+0000 7f2b90aa5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c19b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37760/0 (socket says 172.21.15.17:37760) 2023-07-14T12:49:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.154+0000 7f2b90aa5700 1 -- 172.21.15.17:0/1348443660 learned_addr learned my addr 172.21.15.17:0/1348443660 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.154+0000 7f2b90aa5700 1 -- 172.21.15.17:0/1348443660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b80009550 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.155+0000 7f2b90aa5700 1 --2- 172.21.15.17:0/1348443660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c19b140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b80006af0 tx=0x7f2b80011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.155+0000 7f2b89ffb700 1 -- 172.21.15.17:0/1348443660 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b800037d0 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.155+0000 7f2b89ffb700 1 -- 172.21.15.17:0/1348443660 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b8001b440 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.155+0000 7f2b89ffb700 1 -- 172.21.15.17:0/1348443660 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b80023400 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.155+0000 7f2b92d09700 1 -- 172.21.15.17:0/1348443660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c19b880 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.155+0000 7f2b92d09700 1 -- 172.21.15.17:0/1348443660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c19bca0 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.156+0000 7f2b89ffb700 1 -- 172.21.15.17:0/1348443660 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f2b8001b5b0 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.156+0000 7f2b92d09700 1 -- 172.21.15.17:0/1348443660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c061b40 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.157+0000 7f2b89ffb700 1 --2- 172.21.15.17:0/1348443660 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f2b7c038760 0x7f2b7c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.157+0000 7f2b89ffb700 1 -- 172.21.15.17:0/1348443660 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2b8004c750 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.157+0000 7f2b8bfff700 1 --2- 172.21.15.17:0/1348443660 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f2b7c038760 0x7f2b7c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.158+0000 7f2b8bfff700 1 --2- 172.21.15.17:0/1348443660 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f2b7c038760 0x7f2b7c03ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b78006fd0 tx=0x7f2b78006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.166+0000 7f2b89ffb700 1 -- 172.21.15.17:0/1348443660 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2b8001b8d0 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.430+0000 7f2b92d09700 1 -- 172.21.15.17:0/1348443660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f2b8c19ed90 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.905+0000 7f2b89ffb700 1 -- 172.21.15.17:0/1348443660 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f2b80003930 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.907+0000 7f2b89ffb700 1 -- 172.21.15.17:0/1348443660 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f2b80018350 con 0x7f2b8c07bdd0 2023-07-14T12:49:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.909+0000 7f2b92d09700 1 -- 172.21.15.17:0/1348443660 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f2b7c038760 msgr2=0x7f2b7c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.910+0000 7f2b92d09700 1 --2- 172.21.15.17:0/1348443660 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f2b7c038760 0x7f2b7c03ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b78006fd0 tx=0x7f2b78006e40 comp rx=0 tx=0).stop 2023-07-14T12:49:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.910+0000 7f2b92d09700 1 -- 172.21.15.17:0/1348443660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 msgr2=0x7f2b8c19b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.910+0000 7f2b92d09700 1 --2- 172.21.15.17:0/1348443660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c19b140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b80006af0 tx=0x7f2b80011ed0 comp rx=0 tx=0).stop 2023-07-14T12:49:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.910+0000 7f2b92d09700 1 -- 172.21.15.17:0/1348443660 shutdown_connections 2023-07-14T12:49:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.910+0000 7f2b92d09700 1 --2- 172.21.15.17:0/1348443660 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f2b7c038760 0x7f2b7c03ac10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.910+0000 7f2b92d09700 1 --2- 172.21.15.17:0/1348443660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b8c07bdd0 0x7f2b8c19b140 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:58.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.910+0000 7f2b92d09700 1 -- 172.21.15.17:0/1348443660 >> 172.21.15.17:0/1348443660 conn(0x7f2b8c100890 msgr2=0x7f2b8c101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:58.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.910+0000 7f2b92d09700 1 -- 172.21.15.17:0/1348443660 shutdown_connections 2023-07-14T12:49:58.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:57.910+0000 7f2b92d09700 1 -- 172.21.15.17:0/1348443660 wait complete. 2023-07-14T12:49:58.594 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:58.212+0000 7f117a4d2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:49:58.595 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:58.321+0000 7f117a4d2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:49:58.595 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:58.450+0000 7f117a4d2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:49:58.847 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:58.574+0000 7f117a4d2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:49:58.847 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:58.818+0000 7f117a4d2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:49:59.266 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:58 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1348443660' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-07-14T12:49:59.267 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:58 smithi017 ceph-mon[95536]: mgrmap e9: x(active, since 17s) 2023-07-14T12:49:59.567 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:59 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:59.246+0000 7f117a4d2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:49:59.568 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:59 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:59.379+0000 7f117a4d2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:49:59.747 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-07-14T12:49:59.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-07-14T12:49:59.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-14T12:49:59.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-07-14T12:49:59.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-07-14T12:49:59.748 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-07-14T12:49:59.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.945+0000 7f8081a94700 1 Processor -- start 2023-07-14T12:49:59.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.946+0000 7f8081a94700 1 -- start start 2023-07-14T12:49:59.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.946+0000 7f8081a94700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:59.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.946+0000 7f8081a94700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c07a830 con 0x7f807c07bdf0 2023-07-14T12:49:59.749 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.947+0000 7f807b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:59.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.947+0000 7f807b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37776/0 (socket says 172.21.15.17:37776) 2023-07-14T12:49:59.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.947+0000 7f807b7fe700 1 -- 172.21.15.17:0/3168178370 learned_addr learned my addr 172.21.15.17:0/3168178370 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:59.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.947+0000 7f807b7fe700 1 -- 172.21.15.17:0/3168178370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c07a970 con 0x7f807c07bdf0 2023-07-14T12:49:59.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.947+0000 7f807b7fe700 1 --2- 172.21.15.17:0/3168178370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c07a2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f806c0098a0 tx=0x7f806c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f50a2edb0dc97f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:59.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.948+0000 7f807a7fc700 1 -- 172.21.15.17:0/3168178370 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f806c004160 con 0x7f807c07bdf0 2023-07-14T12:49:59.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.948+0000 7f807a7fc700 1 -- 172.21.15.17:0/3168178370 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f806c0042c0 con 0x7f807c07bdf0 2023-07-14T12:49:59.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.948+0000 7f807a7fc700 1 -- 172.21.15.17:0/3168178370 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f806c0118e0 con 0x7f807c07bdf0 2023-07-14T12:49:59.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.948+0000 7f8081a94700 1 -- 172.21.15.17:0/3168178370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 msgr2=0x7f807c07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:59.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.948+0000 7f8081a94700 1 --2- 172.21.15.17:0/3168178370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c07a2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f806c0098a0 tx=0x7f806c009bb0 comp rx=0 tx=0).stop 2023-07-14T12:49:59.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.948+0000 7f8081a94700 1 -- 172.21.15.17:0/3168178370 shutdown_connections 2023-07-14T12:49:59.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.948+0000 7f8081a94700 1 --2- 172.21.15.17:0/3168178370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c07a2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:59.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.948+0000 7f8081a94700 1 -- 172.21.15.17:0/3168178370 >> 172.21.15.17:0/3168178370 conn(0x7f807c100900 msgr2=0x7f807c102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:59.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.949+0000 7f8081a94700 1 -- 172.21.15.17:0/3168178370 shutdown_connections 2023-07-14T12:49:59.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.949+0000 7f8081a94700 1 -- 172.21.15.17:0/3168178370 wait complete. 2023-07-14T12:49:59.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.950+0000 7f8081a94700 1 Processor -- start 2023-07-14T12:49:59.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.950+0000 7f8081a94700 1 -- start start 2023-07-14T12:49:59.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.951+0000 7f8081a94700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:59.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.951+0000 7f8081a94700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c19b740 con 0x7f807c07bdf0 2023-07-14T12:49:59.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.951+0000 7f807b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:49:59.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.951+0000 7f807b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c19b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37790/0 (socket says 172.21.15.17:37790) 2023-07-14T12:49:59.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.951+0000 7f807b7fe700 1 -- 172.21.15.17:0/3749394645 learned_addr learned my addr 172.21.15.17:0/3749394645 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:49:59.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.951+0000 7f807b7fe700 1 -- 172.21.15.17:0/3749394645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c009550 con 0x7f807c07bdf0 2023-07-14T12:49:59.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.952+0000 7f807b7fe700 1 --2- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c19b200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f806c003e30 tx=0x7f806c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:49:59.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.952+0000 7f8078ff9700 1 -- 172.21.15.17:0/3749394645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f806c0036a0 con 0x7f807c07bdf0 2023-07-14T12:49:59.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.952+0000 7f8078ff9700 1 -- 172.21.15.17:0/3749394645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f806c01b440 con 0x7f807c07bdf0 2023-07-14T12:49:59.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.952+0000 7f8078ff9700 1 -- 172.21.15.17:0/3749394645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f806c023400 con 0x7f807c07bdf0 2023-07-14T12:49:59.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.952+0000 7f8081a94700 1 -- 172.21.15.17:0/3749394645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807c19b940 con 0x7f807c07bdf0 2023-07-14T12:49:59.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.952+0000 7f8081a94700 1 -- 172.21.15.17:0/3749394645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807c19bd60 con 0x7f807c07bdf0 2023-07-14T12:49:59.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.953+0000 7f8078ff9700 1 -- 172.21.15.17:0/3749394645 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f806c003800 con 0x7f807c07bdf0 2023-07-14T12:49:59.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.954+0000 7f8081a94700 1 -- 172.21.15.17:0/3749394645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807c1951b0 con 0x7f807c07bdf0 2023-07-14T12:49:59.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.954+0000 7f8078ff9700 1 --2- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f8064038760 0x7f806403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:49:59.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.954+0000 7f8078ff9700 1 -- 172.21.15.17:0/3749394645 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f806c04c770 con 0x7f807c07bdf0 2023-07-14T12:49:59.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.954+0000 7f807affd700 1 -- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f8064038760 msgr2=0x7f806403ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1783581931 2023-07-14T12:49:59.758 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.954+0000 7f807affd700 1 --2- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f8064038760 0x7f806403ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:49:59.758 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:58.959+0000 7f8078ff9700 1 -- 172.21.15.17:0/3749394645 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f806c02b350 con 0x7f807c07bdf0 2023-07-14T12:49:59.758 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.155+0000 7f807affd700 1 -- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f8064038760 msgr2=0x7f806403ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1783581931 2023-07-14T12:49:59.758 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.155+0000 7f807affd700 1 --2- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f8064038760 0x7f806403ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T12:49:59.758 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.240+0000 7f8081a94700 1 -- 172.21.15.17:0/3749394645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f807c061b40 con 0x7f807c07bdf0 2023-07-14T12:49:59.758 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.241+0000 7f8078ff9700 1 -- 172.21.15.17:0/3749394645 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f806c02b350 con 0x7f807c07bdf0 2023-07-14T12:49:59.758 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.243+0000 7f8081a94700 1 -- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f8064038760 msgr2=0x7f806403ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:49:59.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.243+0000 7f8081a94700 1 --2- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f8064038760 0x7f806403ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:59.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.243+0000 7f8081a94700 1 -- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 msgr2=0x7f807c19b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:49:59.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.243+0000 7f8081a94700 1 --2- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c19b200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f806c003e30 tx=0x7f806c0119a0 comp rx=0 tx=0).stop 2023-07-14T12:49:59.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.243+0000 7f8081a94700 1 -- 172.21.15.17:0/3749394645 shutdown_connections 2023-07-14T12:49:59.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.243+0000 7f8081a94700 1 --2- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7f8064038760 0x7f806403ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:59.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.243+0000 7f8081a94700 1 --2- 172.21.15.17:0/3749394645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f807c07bdf0 0x7f807c19b200 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:49:59.759 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.243+0000 7f8081a94700 1 -- 172.21.15.17:0/3749394645 >> 172.21.15.17:0/3749394645 conn(0x7f807c100900 msgr2=0x7f807c102020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:49:59.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.243+0000 7f8081a94700 1 -- 172.21.15.17:0/3749394645 shutdown_connections 2023-07-14T12:49:59.760 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:49:59.243+0000 7f8081a94700 1 -- 172.21.15.17:0/3749394645 wait complete. 2023-07-14T12:49:59.760 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2023-07-14T12:49:59.760 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 9... 2023-07-14T12:49:59.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:59 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:59.547+0000 7f117a4d2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:49:59.846 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:49:59 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:49:59.674+0000 7f117a4d2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:50:00.288 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:49:59 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3749394645' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-07-14T12:50:00.596 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:00.267+0000 7f117a4d2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:50:01.346 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:01 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:01.041+0000 7f117a4d2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T12:50:01.346 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:01 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:01.255+0000 7f117a4d2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:50:02.596 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:02 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:02.238+0000 7f117a4d2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:50:02.596 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:02 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:02.361+0000 7f117a4d2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:50:02.984 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:02 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:02.591+0000 7f117a4d2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:50:03.265 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:02 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:02.963+0000 7f117a4d2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T12:50:03.596 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:03 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:03.244+0000 7f117a4d2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:50:03.596 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:03 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:03.443+0000 7f117a4d2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:50:04.096 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:03 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:03.797+0000 7f117a4d2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:50:05.096 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:04 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:04.756+0000 7f117a4d2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:50:05.096 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:04 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:04.935+0000 7f117a4d2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:50:05.596 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:05 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:05.189+0000 7f117a4d2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:50:05.596 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:05 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:05.343+0000 7f117a4d2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:50:06.096 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:05 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:05.627+0000 7f117a4d2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:50:07.096 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:50:06.731+0000 7f117a4d2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:50:07.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: Active manager daemon x restarted 2023-07-14T12:50:07.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: Activating manager daemon x 2023-07-14T12:50:07.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: osdmap e3: 0 total, 0 up, 0 in 2023-07-14T12:50:07.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: mgrmap e10: x(active, starting, since 0.00385037s) 2023-07-14T12:50:07.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:50:07.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-14T12:50:07.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-14T12:50:07.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-14T12:50:07.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-14T12:50:07.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: Manager daemon x is now available 2023-07-14T12:50:07.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:50:07.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:50:08.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T12:50:08.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T12:50:08.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:07 smithi017 ceph-mon[95536]: mgrmap e11: x(active, since 1.00782s) 2023-07-14T12:50:08.261 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2023-07-14T12:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-07-14T12:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2023-07-14T12:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2023-07-14T12:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.322+0000 7feffab2f700 1 Processor -- start 2023-07-14T12:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.322+0000 7feffab2f700 1 -- start start 2023-07-14T12:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.323+0000 7feffab2f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff407a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:08.262 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.323+0000 7feffab2f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff407a850 con 0x7feff407be10 2023-07-14T12:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.323+0000 7feff88cb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff407a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.323+0000 7feff88cb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff407a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37798/0 (socket says 172.21.15.17:37798) 2023-07-14T12:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.323+0000 7feff88cb700 1 -- 172.21.15.17:0/774770911 learned_addr learned my addr 172.21.15.17:0/774770911 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.323+0000 7feff88cb700 1 -- 172.21.15.17:0/774770911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff407a990 con 0x7feff407be10 2023-07-14T12:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.324+0000 7feff88cb700 1 --2- 172.21.15.17:0/774770911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff407a310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fefe80098a0 tx=0x7fefe8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fcc2f920da241 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.324+0000 7feff37fe700 1 -- 172.21.15.17:0/774770911 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe8004160 con 0x7feff407be10 2023-07-14T12:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.324+0000 7feff37fe700 1 -- 172.21.15.17:0/774770911 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefe80042c0 con 0x7feff407be10 2023-07-14T12:50:08.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.324+0000 7feff37fe700 1 -- 172.21.15.17:0/774770911 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe80118e0 con 0x7feff407be10 2023-07-14T12:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.324+0000 7feffab2f700 1 -- 172.21.15.17:0/774770911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 msgr2=0x7feff407a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.324+0000 7feffab2f700 1 --2- 172.21.15.17:0/774770911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff407a310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fefe80098a0 tx=0x7fefe8009bb0 comp rx=0 tx=0).stop 2023-07-14T12:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.325+0000 7feffab2f700 1 -- 172.21.15.17:0/774770911 shutdown_connections 2023-07-14T12:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.325+0000 7feffab2f700 1 --2- 172.21.15.17:0/774770911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff407a310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.325+0000 7feffab2f700 1 -- 172.21.15.17:0/774770911 >> 172.21.15.17:0/774770911 conn(0x7feff4100900 msgr2=0x7feff4102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.325+0000 7feffab2f700 1 -- 172.21.15.17:0/774770911 shutdown_connections 2023-07-14T12:50:08.264 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.325+0000 7feffab2f700 1 -- 172.21.15.17:0/774770911 wait complete. 2023-07-14T12:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.326+0000 7feffab2f700 1 Processor -- start 2023-07-14T12:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.326+0000 7feffab2f700 1 -- start start 2023-07-14T12:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.326+0000 7feffab2f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff419b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.326+0000 7feffab2f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff419b780 con 0x7feff407be10 2023-07-14T12:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.326+0000 7feff88cb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff419b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.327+0000 7feff88cb700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff419b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37804/0 (socket says 172.21.15.17:37804) 2023-07-14T12:50:08.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.327+0000 7feff88cb700 1 -- 172.21.15.17:0/595800431 learned_addr learned my addr 172.21.15.17:0/595800431 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.327+0000 7feff88cb700 1 -- 172.21.15.17:0/595800431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe8009550 con 0x7feff407be10 2023-07-14T12:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.327+0000 7feff88cb700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff419b240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fefe8000c00 tx=0x7fefe80119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.327+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe80036a0 con 0x7feff407be10 2023-07-14T12:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.327+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefe8024440 con 0x7feff407be10 2023-07-14T12:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.327+0000 7feffab2f700 1 -- 172.21.15.17:0/595800431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff419b980 con 0x7feff407be10 2023-07-14T12:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.327+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fefe801a430 con 0x7feff407be10 2023-07-14T12:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.328+0000 7feffab2f700 1 -- 172.21.15.17:0/595800431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff419bda0 con 0x7feff407be10 2023-07-14T12:50:08.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.329+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fefe8003800 con 0x7feff407be10 2023-07-14T12:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.329+0000 7feff1ffb700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 0x7fefe403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.329+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 --> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fefe403b370 con 0x7fefe40387b0 2023-07-14T12:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.329+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fefe804c2c0 con 0x7feff407be10 2023-07-14T12:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.329+0000 7feff3fff700 1 -- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 msgr2=0x7fefe403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1783581931 2023-07-14T12:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.329+0000 7feff3fff700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 0x7fefe403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.530+0000 7feff3fff700 1 -- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 msgr2=0x7fefe403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1783581931 2023-07-14T12:50:08.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.530+0000 7feff3fff700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 0x7fefe403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T12:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.931+0000 7feff3fff700 1 -- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 msgr2=0x7fefe403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1783581931 2023-07-14T12:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:00.931+0000 7feff3fff700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 0x7fefe403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T12:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:01.732+0000 7feff3fff700 1 -- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 msgr2=0x7fefe403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1783581931 2023-07-14T12:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:01.732+0000 7feff3fff700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 0x7fefe403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T12:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:03.333+0000 7feff3fff700 1 -- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 msgr2=0x7fefe403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1783581931 2023-07-14T12:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:03.333+0000 7feff3fff700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 0x7fefe403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-07-14T12:50:08.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:06.536+0000 7feff3fff700 1 -- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 msgr2=0x7fefe403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1783581931 2023-07-14T12:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:06.536+0000 7feff3fff700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 0x7fefe403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-07-14T12:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:06.736+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 10) v1 ==== 45263+0+0 (secure 0 0 0) 0x7fefe8024820 con 0x7feff407be10 2023-07-14T12:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:06.736+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 msgr2=0x7fefe403ac60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:06.736+0000 7feff1ffb700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 0x7fefe403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.739+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7fefe802d3f0 con 0x7feff407be10 2023-07-14T12:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.739+0000 7feff1ffb700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fefe403bff0 0x7fefe403e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:08.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.739+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fefe403b370 con 0x7fefe403bff0 2023-07-14T12:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.740+0000 7feff3fff700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fefe403bff0 0x7fefe403e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.741+0000 7feff3fff700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fefe403bff0 0x7fefe403e3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fefe0003a10 tx=0x7fefe0009270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.742+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fefe403b370 con 0x7fefe403bff0 2023-07-14T12:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.749+0000 7feffab2f700 1 -- 172.21.15.17:0/595800431 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7feff419c580 con 0x7fefe403bff0 2023-07-14T12:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.749+0000 7feff1ffb700 1 -- 172.21.15.17:0/595800431 <== mgr.14150 v2:172.21.15.17:6800/2034486077 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7feff419c580 con 0x7fefe403bff0 2023-07-14T12:50:08.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.750+0000 7feffab2f700 1 -- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fefe403bff0 msgr2=0x7fefe403e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.750+0000 7feffab2f700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fefe403bff0 0x7fefe403e3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fefe0003a10 tx=0x7fefe0009270 comp rx=0 tx=0).stop 2023-07-14T12:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.750+0000 7feffab2f700 1 -- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 msgr2=0x7feff419b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.750+0000 7feffab2f700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff419b240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fefe8000c00 tx=0x7fefe80119a0 comp rx=0 tx=0).stop 2023-07-14T12:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.750+0000 7feffab2f700 1 -- 172.21.15.17:0/595800431 shutdown_connections 2023-07-14T12:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.750+0000 7feffab2f700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fefe403bff0 0x7fefe403e3d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.750+0000 7feffab2f700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feff407be10 0x7feff419b240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:08.271 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.750+0000 7feffab2f700 1 --2- 172.21.15.17:0/595800431 >> [v2:172.21.15.17:6800/1783581931,v1:172.21.15.17:6801/1783581931] conn(0x7fefe40387b0 0x7fefe403ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.750+0000 7feffab2f700 1 -- 172.21.15.17:0/595800431 >> 172.21.15.17:0/595800431 conn(0x7feff4100900 msgr2=0x7feff4102080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.750+0000 7feffab2f700 1 -- 172.21.15.17:0/595800431 shutdown_connections 2023-07-14T12:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:07.750+0000 7feffab2f700 1 -- 172.21.15.17:0/595800431 wait complete. 2023-07-14T12:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 9 is available 2023-07-14T12:50:08.272 INFO:teuthology.orchestra.run.smithi017.stdout:Generating a dashboard self-signed certificate... 2023-07-14T12:50:09.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:08 smithi017 ceph-mon[95536]: [14/Jul/2023:12:50:07] ENGINE Bus STARTING 2023-07-14T12:50:09.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:08 smithi017 ceph-mon[95536]: [14/Jul/2023:12:50:07] ENGINE Serving on https://172.21.15.17:7150 2023-07-14T12:50:09.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:08 smithi017 ceph-mon[95536]: [14/Jul/2023:12:50:07] ENGINE Serving on http://172.21.15.17:8765 2023-07-14T12:50:09.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:08 smithi017 ceph-mon[95536]: [14/Jul/2023:12:50:07] ENGINE Bus STARTED 2023-07-14T12:50:09.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:08 smithi017 ceph-mon[95536]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-07-14T12:50:09.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:08 smithi017 ceph-mon[95536]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-07-14T12:50:09.853 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-07-14T12:50:09.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.017+0000 7efc83d63700 1 Processor -- start 2023-07-14T12:50:09.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.018+0000 7efc83d63700 1 -- start start 2023-07-14T12:50:09.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.018+0000 7efc83d63700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c1080f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:09.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.018+0000 7efc83d63700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c079d90 con 0x7efc7c105d10 2023-07-14T12:50:09.854 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.018+0000 7efc81aff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c1080f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:09.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.018+0000 7efc81aff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c1080f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47682/0 (socket says 172.21.15.17:47682) 2023-07-14T12:50:09.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.018+0000 7efc81aff700 1 -- 172.21.15.17:0/4063856589 learned_addr learned my addr 172.21.15.17:0/4063856589 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:09.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.019+0000 7efc81aff700 1 -- 172.21.15.17:0/4063856589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c079ed0 con 0x7efc7c105d10 2023-07-14T12:50:09.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.019+0000 7efc81aff700 1 --2- 172.21.15.17:0/4063856589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c1080f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc780098a0 tx=0x7efc78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df53e2f5fb66f2ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:09.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.019+0000 7efc80afd700 1 -- 172.21.15.17:0/4063856589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc78004160 con 0x7efc7c105d10 2023-07-14T12:50:09.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.019+0000 7efc80afd700 1 -- 172.21.15.17:0/4063856589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc780042c0 con 0x7efc7c105d10 2023-07-14T12:50:09.855 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.019+0000 7efc80afd700 1 -- 172.21.15.17:0/4063856589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc780118e0 con 0x7efc7c105d10 2023-07-14T12:50:09.856 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.020+0000 7efc83d63700 1 -- 172.21.15.17:0/4063856589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 msgr2=0x7efc7c1080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:09.856 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.020+0000 7efc83d63700 1 --2- 172.21.15.17:0/4063856589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c1080f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc780098a0 tx=0x7efc78009bb0 comp rx=0 tx=0).stop 2023-07-14T12:50:09.856 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.020+0000 7efc83d63700 1 -- 172.21.15.17:0/4063856589 shutdown_connections 2023-07-14T12:50:09.856 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.020+0000 7efc83d63700 1 --2- 172.21.15.17:0/4063856589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c1080f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:09.856 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.020+0000 7efc83d63700 1 -- 172.21.15.17:0/4063856589 >> 172.21.15.17:0/4063856589 conn(0x7efc7c0ff7f0 msgr2=0x7efc7c101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:09.856 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.020+0000 7efc83d63700 1 -- 172.21.15.17:0/4063856589 shutdown_connections 2023-07-14T12:50:09.856 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.020+0000 7efc83d63700 1 -- 172.21.15.17:0/4063856589 wait complete. 2023-07-14T12:50:09.856 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.021+0000 7efc83d63700 1 Processor -- start 2023-07-14T12:50:09.857 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.021+0000 7efc83d63700 1 -- start start 2023-07-14T12:50:09.857 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.021+0000 7efc83d63700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:09.857 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.021+0000 7efc83d63700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c19b6b0 con 0x7efc7c105d10 2023-07-14T12:50:09.857 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.022+0000 7efc81aff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:09.857 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.022+0000 7efc81aff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c19b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47696/0 (socket says 172.21.15.17:47696) 2023-07-14T12:50:09.857 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.022+0000 7efc81aff700 1 -- 172.21.15.17:0/40668528 learned_addr learned my addr 172.21.15.17:0/40668528 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:09.857 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.022+0000 7efc81aff700 1 -- 172.21.15.17:0/40668528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc78009550 con 0x7efc7c105d10 2023-07-14T12:50:09.858 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.022+0000 7efc81aff700 1 --2- 172.21.15.17:0/40668528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c19b170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc78000c00 tx=0x7efc780119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:09.858 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.022+0000 7efc72ffd700 1 -- 172.21.15.17:0/40668528 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc780036a0 con 0x7efc7c105d10 2023-07-14T12:50:09.858 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.022+0000 7efc83d63700 1 -- 172.21.15.17:0/40668528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c19b8b0 con 0x7efc7c105d10 2023-07-14T12:50:09.858 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.022+0000 7efc72ffd700 1 -- 172.21.15.17:0/40668528 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc7801b440 con 0x7efc7c105d10 2023-07-14T12:50:09.858 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.022+0000 7efc72ffd700 1 -- 172.21.15.17:0/40668528 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc7801a3d0 con 0x7efc7c105d10 2023-07-14T12:50:09.858 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.023+0000 7efc83d63700 1 -- 172.21.15.17:0/40668528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c19bcd0 con 0x7efc7c105d10 2023-07-14T12:50:09.858 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.024+0000 7efc83d63700 1 -- 172.21.15.17:0/40668528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c061b40 con 0x7efc7c105d10 2023-07-14T12:50:09.859 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.024+0000 7efc72ffd700 1 -- 172.21.15.17:0/40668528 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7efc7801b5b0 con 0x7efc7c105d10 2023-07-14T12:50:09.859 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.024+0000 7efc72ffd700 1 --2- 172.21.15.17:0/40668528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efc68038760 0x7efc6803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:09.859 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.024+0000 7efc72ffd700 1 -- 172.21.15.17:0/40668528 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efc7804c780 con 0x7efc7c105d10 2023-07-14T12:50:09.859 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.024+0000 7efc812fe700 1 --2- 172.21.15.17:0/40668528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efc68038760 0x7efc6803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:09.859 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.025+0000 7efc812fe700 1 --2- 172.21.15.17:0/40668528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efc68038760 0x7efc6803ac10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006fd0 tx=0x7efc6c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:09.859 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.029+0000 7efc72ffd700 1 -- 172.21.15.17:0/40668528 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7efc78023a00 con 0x7efc7c105d10 2023-07-14T12:50:09.859 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.262+0000 7efc83d63700 1 -- 172.21.15.17:0/40668528 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7efc7c101b00 con 0x7efc68038760 2023-07-14T12:50:09.860 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.359+0000 7efc72ffd700 1 -- 172.21.15.17:0/40668528 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7efc7c101b00 con 0x7efc68038760 2023-07-14T12:50:09.860 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.361+0000 7efc83d63700 1 -- 172.21.15.17:0/40668528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efc68038760 msgr2=0x7efc6803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:09.860 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.361+0000 7efc83d63700 1 --2- 172.21.15.17:0/40668528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efc68038760 0x7efc6803ac10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006fd0 tx=0x7efc6c006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:09.860 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.361+0000 7efc83d63700 1 -- 172.21.15.17:0/40668528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 msgr2=0x7efc7c19b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:09.860 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.361+0000 7efc83d63700 1 --2- 172.21.15.17:0/40668528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c19b170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc78000c00 tx=0x7efc780119a0 comp rx=0 tx=0).stop 2023-07-14T12:50:09.860 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.361+0000 7efc83d63700 1 -- 172.21.15.17:0/40668528 shutdown_connections 2023-07-14T12:50:09.860 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.361+0000 7efc83d63700 1 --2- 172.21.15.17:0/40668528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efc68038760 0x7efc6803ac10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:09.860 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.361+0000 7efc83d63700 1 --2- 172.21.15.17:0/40668528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc7c105d10 0x7efc7c19b170 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:09.861 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.361+0000 7efc83d63700 1 -- 172.21.15.17:0/40668528 >> 172.21.15.17:0/40668528 conn(0x7efc7c0ff7f0 msgr2=0x7efc7c100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:09.861 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.362+0000 7efc83d63700 1 -- 172.21.15.17:0/40668528 shutdown_connections 2023-07-14T12:50:09.861 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:09.362+0000 7efc83d63700 1 -- 172.21.15.17:0/40668528 wait complete. 2023-07-14T12:50:09.861 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial admin user... 2023-07-14T12:50:10.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:09 smithi017 ceph-mon[95536]: mgrmap e12: x(active, since 2s) 2023-07-14T12:50:10.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:10.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:10.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:11.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:10 smithi017 ceph-mon[95536]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:50:11.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:10 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:11.454 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$dYFnK3NaQTIlK2v3vLDgn.MNXubVU01h3xm0TaPtg/hjzT3BQk90C", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1689339010, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-07-14T12:50:11.454 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.433+0000 7f74925b7700 1 Processor -- start 2023-07-14T12:50:11.454 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.433+0000 7f74925b7700 1 -- start start 2023-07-14T12:50:11.455 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.433+0000 7f74925b7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:11.455 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.433+0000 7f74925b7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c07a830 con 0x7f748c07bdf0 2023-07-14T12:50:11.455 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.434+0000 7f748bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:11.455 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.434+0000 7f748bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47698/0 (socket says 172.21.15.17:47698) 2023-07-14T12:50:11.455 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.434+0000 7f748bfff700 1 -- 172.21.15.17:0/2243522091 learned_addr learned my addr 172.21.15.17:0/2243522091 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:11.455 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.434+0000 7f748bfff700 1 -- 172.21.15.17:0/2243522091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c07a970 con 0x7f748c07bdf0 2023-07-14T12:50:11.455 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.434+0000 7f748bfff700 1 --2- 172.21.15.17:0/2243522091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c07a2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f747c0098a0 tx=0x7f747c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef992bcc23b3d4df server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:11.456 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.435+0000 7f748affd700 1 -- 172.21.15.17:0/2243522091 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f747c004160 con 0x7f748c07bdf0 2023-07-14T12:50:11.456 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.435+0000 7f748affd700 1 -- 172.21.15.17:0/2243522091 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f747c0042c0 con 0x7f748c07bdf0 2023-07-14T12:50:11.456 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.435+0000 7f748affd700 1 -- 172.21.15.17:0/2243522091 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f747c0118e0 con 0x7f748c07bdf0 2023-07-14T12:50:11.456 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.435+0000 7f74925b7700 1 -- 172.21.15.17:0/2243522091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 msgr2=0x7f748c07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:11.456 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.435+0000 7f74925b7700 1 --2- 172.21.15.17:0/2243522091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c07a2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f747c0098a0 tx=0x7f747c009bb0 comp rx=0 tx=0).stop 2023-07-14T12:50:11.456 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.435+0000 7f74925b7700 1 -- 172.21.15.17:0/2243522091 shutdown_connections 2023-07-14T12:50:11.456 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.435+0000 7f74925b7700 1 --2- 172.21.15.17:0/2243522091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c07a2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:11.456 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.435+0000 7f74925b7700 1 -- 172.21.15.17:0/2243522091 >> 172.21.15.17:0/2243522091 conn(0x7f748c100900 msgr2=0x7f748c102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:11.457 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.435+0000 7f74925b7700 1 -- 172.21.15.17:0/2243522091 shutdown_connections 2023-07-14T12:50:11.457 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.435+0000 7f74925b7700 1 -- 172.21.15.17:0/2243522091 wait complete. 2023-07-14T12:50:11.457 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.436+0000 7f74925b7700 1 Processor -- start 2023-07-14T12:50:11.457 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.437+0000 7f74925b7700 1 -- start start 2023-07-14T12:50:11.457 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.437+0000 7f74925b7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c19b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:11.457 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.437+0000 7f74925b7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c19b770 con 0x7f748c07bdf0 2023-07-14T12:50:11.457 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.437+0000 7f748bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c19b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:11.458 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.437+0000 7f748bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c19b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47702/0 (socket says 172.21.15.17:47702) 2023-07-14T12:50:11.458 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.437+0000 7f748bfff700 1 -- 172.21.15.17:0/2480158268 learned_addr learned my addr 172.21.15.17:0/2480158268 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:11.458 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.437+0000 7f748bfff700 1 -- 172.21.15.17:0/2480158268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c009550 con 0x7f748c07bdf0 2023-07-14T12:50:11.458 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.438+0000 7f748bfff700 1 --2- 172.21.15.17:0/2480158268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c19b230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f747c006af0 tx=0x7f747c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:11.458 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.438+0000 7f74897fa700 1 -- 172.21.15.17:0/2480158268 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f747c0037d0 con 0x7f748c07bdf0 2023-07-14T12:50:11.458 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.438+0000 7f74897fa700 1 -- 172.21.15.17:0/2480158268 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f747c01b440 con 0x7f748c07bdf0 2023-07-14T12:50:11.458 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.438+0000 7f74925b7700 1 -- 172.21.15.17:0/2480158268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c19b970 con 0x7f748c07bdf0 2023-07-14T12:50:11.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.438+0000 7f74897fa700 1 -- 172.21.15.17:0/2480158268 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f747c023400 con 0x7f748c07bdf0 2023-07-14T12:50:11.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.438+0000 7f74925b7700 1 -- 172.21.15.17:0/2480158268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c19bd90 con 0x7f748c07bdf0 2023-07-14T12:50:11.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.439+0000 7f74897fa700 1 -- 172.21.15.17:0/2480158268 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f747c01b5b0 con 0x7f748c07bdf0 2023-07-14T12:50:11.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.439+0000 7f74925b7700 1 -- 172.21.15.17:0/2480158268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c1951b0 con 0x7f748c07bdf0 2023-07-14T12:50:11.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.440+0000 7f74897fa700 1 --2- 172.21.15.17:0/2480158268 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74740387b0 0x7f747403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:11.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.440+0000 7f74897fa700 1 -- 172.21.15.17:0/2480158268 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f747c04c920 con 0x7f748c07bdf0 2023-07-14T12:50:11.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.440+0000 7f748b7fe700 1 --2- 172.21.15.17:0/2480158268 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74740387b0 0x7f747403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:11.459 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.441+0000 7f748b7fe700 1 --2- 172.21.15.17:0/2480158268 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74740387b0 0x7f747403ac60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7480006fd0 tx=0x7f7480006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:11.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.445+0000 7f74897fa700 1 -- 172.21.15.17:0/2480158268 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f747c01b8d0 con 0x7f748c07bdf0 2023-07-14T12:50:11.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.688+0000 7f74925b7700 1 -- 172.21.15.17:0/2480158268 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f748c02cce0 con 0x7f74740387b0 2023-07-14T12:50:11.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.935+0000 7f74897fa700 1 -- 172.21.15.17:0/2480158268 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f748c02cce0 con 0x7f74740387b0 2023-07-14T12:50:11.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.938+0000 7f74925b7700 1 -- 172.21.15.17:0/2480158268 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74740387b0 msgr2=0x7f747403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:11.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.938+0000 7f74925b7700 1 --2- 172.21.15.17:0/2480158268 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74740387b0 0x7f747403ac60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7480006fd0 tx=0x7f7480006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:11.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.938+0000 7f74925b7700 1 -- 172.21.15.17:0/2480158268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 msgr2=0x7f748c19b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:11.460 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.938+0000 7f74925b7700 1 --2- 172.21.15.17:0/2480158268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c19b230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f747c006af0 tx=0x7f747c011ed0 comp rx=0 tx=0).stop 2023-07-14T12:50:11.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.938+0000 7f74925b7700 1 -- 172.21.15.17:0/2480158268 shutdown_connections 2023-07-14T12:50:11.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.938+0000 7f74925b7700 1 --2- 172.21.15.17:0/2480158268 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74740387b0 0x7f747403ac60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:11.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.938+0000 7f74925b7700 1 --2- 172.21.15.17:0/2480158268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f748c07bdf0 0x7f748c19b230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:11.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.938+0000 7f74925b7700 1 -- 172.21.15.17:0/2480158268 >> 172.21.15.17:0/2480158268 conn(0x7f748c100900 msgr2=0x7f748c102040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:11.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.938+0000 7f74925b7700 1 -- 172.21.15.17:0/2480158268 shutdown_connections 2023-07-14T12:50:11.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:10.938+0000 7f74925b7700 1 -- 172.21.15.17:0/2480158268 wait complete. 2023-07-14T12:50:11.461 INFO:teuthology.orchestra.run.smithi017.stdout:Fetching dashboard port number... 2023-07-14T12:50:12.096 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:11 smithi017 ceph-mon[95536]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:50:12.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:11 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:13.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 8443 2023-07-14T12:50:13.143 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.138+0000 7fac14946700 1 Processor -- start 2023-07-14T12:50:13.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.138+0000 7fac14946700 1 -- start start 2023-07-14T12:50:13.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.138+0000 7fac14946700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac10105610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:13.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.139+0000 7fac14946700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac10105b50 con 0x7fac10105200 2023-07-14T12:50:13.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.139+0000 7fac0e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac10105610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:13.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.139+0000 7fac0e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac10105610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47710/0 (socket says 172.21.15.17:47710) 2023-07-14T12:50:13.144 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.139+0000 7fac0e59c700 1 -- 172.21.15.17:0/3037432197 learned_addr learned my addr 172.21.15.17:0/3037432197 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:13.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.139+0000 7fac0e59c700 1 -- 172.21.15.17:0/3037432197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac10105c90 con 0x7fac10105200 2023-07-14T12:50:13.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.140+0000 7fac0e59c700 1 --2- 172.21.15.17:0/3037432197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac10105610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fac000098a0 tx=0x7fac00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2975fbf45c09a001 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:13.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.140+0000 7fac0d59a700 1 -- 172.21.15.17:0/3037432197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac00004160 con 0x7fac10105200 2023-07-14T12:50:13.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.140+0000 7fac0d59a700 1 -- 172.21.15.17:0/3037432197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac000042c0 con 0x7fac10105200 2023-07-14T12:50:13.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.140+0000 7fac0d59a700 1 -- 172.21.15.17:0/3037432197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac000118e0 con 0x7fac10105200 2023-07-14T12:50:13.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.140+0000 7fac14946700 1 -- 172.21.15.17:0/3037432197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 msgr2=0x7fac10105610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:13.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.140+0000 7fac14946700 1 --2- 172.21.15.17:0/3037432197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac10105610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fac000098a0 tx=0x7fac00009bb0 comp rx=0 tx=0).stop 2023-07-14T12:50:13.145 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.140+0000 7fac14946700 1 -- 172.21.15.17:0/3037432197 shutdown_connections 2023-07-14T12:50:13.146 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.140+0000 7fac14946700 1 --2- 172.21.15.17:0/3037432197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac10105610 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:13.146 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.140+0000 7fac14946700 1 -- 172.21.15.17:0/3037432197 >> 172.21.15.17:0/3037432197 conn(0x7fac10100890 msgr2=0x7fac10102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:13.146 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.141+0000 7fac14946700 1 -- 172.21.15.17:0/3037432197 shutdown_connections 2023-07-14T12:50:13.146 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.141+0000 7fac14946700 1 -- 172.21.15.17:0/3037432197 wait complete. 2023-07-14T12:50:13.146 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.141+0000 7fac14946700 1 Processor -- start 2023-07-14T12:50:13.146 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.142+0000 7fac14946700 1 -- start start 2023-07-14T12:50:13.146 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.142+0000 7fac14946700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac1007bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:13.147 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.142+0000 7fac14946700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1007c1a0 con 0x7fac10105200 2023-07-14T12:50:13.147 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.142+0000 7fac0e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac1007bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:13.147 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.142+0000 7fac0e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac1007bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47716/0 (socket says 172.21.15.17:47716) 2023-07-14T12:50:13.147 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.142+0000 7fac0e59c700 1 -- 172.21.15.17:0/3897489682 learned_addr learned my addr 172.21.15.17:0/3897489682 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:13.147 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.143+0000 7fac0e59c700 1 -- 172.21.15.17:0/3897489682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac00009550 con 0x7fac10105200 2023-07-14T12:50:13.147 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.143+0000 7fac0e59c700 1 --2- 172.21.15.17:0/3897489682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac1007bc60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac00006af0 tx=0x7fac00011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:13.147 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.143+0000 7fabff7fe700 1 -- 172.21.15.17:0/3897489682 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac000037d0 con 0x7fac10105200 2023-07-14T12:50:13.148 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.143+0000 7fac14946700 1 -- 172.21.15.17:0/3897489682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1007a2b0 con 0x7fac10105200 2023-07-14T12:50:13.148 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.143+0000 7fabff7fe700 1 -- 172.21.15.17:0/3897489682 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac0001b440 con 0x7fac10105200 2023-07-14T12:50:13.148 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.143+0000 7fabff7fe700 1 -- 172.21.15.17:0/3897489682 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac00023400 con 0x7fac10105200 2023-07-14T12:50:13.148 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.143+0000 7fac14946700 1 -- 172.21.15.17:0/3897489682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1007a6d0 con 0x7fac10105200 2023-07-14T12:50:13.148 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.144+0000 7fabff7fe700 1 -- 172.21.15.17:0/3897489682 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fac0001b5b0 con 0x7fac10105200 2023-07-14T12:50:13.148 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.144+0000 7fac14946700 1 -- 172.21.15.17:0/3897489682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac10061b40 con 0x7fac10105200 2023-07-14T12:50:13.148 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.145+0000 7fabff7fe700 1 --2- 172.21.15.17:0/3897489682 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fabf8038710 0x7fabf803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:13.148 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.145+0000 7fabff7fe700 1 -- 172.21.15.17:0/3897489682 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fac0004c880 con 0x7fac10105200 2023-07-14T12:50:13.149 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.145+0000 7fac0dd9b700 1 --2- 172.21.15.17:0/3897489682 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fabf8038710 0x7fabf803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:13.149 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.146+0000 7fac0dd9b700 1 --2- 172.21.15.17:0/3897489682 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fabf8038710 0x7fabf803abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fac04006fd0 tx=0x7fac04006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:13.149 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.150+0000 7fabff7fe700 1 -- 172.21.15.17:0/3897489682 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fac0001b8d0 con 0x7fac10105200 2023-07-14T12:50:13.149 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.366+0000 7fac14946700 1 -- 172.21.15.17:0/3897489682 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fac1007ae90 con 0x7fac10105200 2023-07-14T12:50:13.149 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.367+0000 7fabff7fe700 1 -- 172.21.15.17:0/3897489682 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fac0000b3e0 con 0x7fac10105200 2023-07-14T12:50:13.149 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.369+0000 7fac14946700 1 -- 172.21.15.17:0/3897489682 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fabf8038710 msgr2=0x7fabf803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:13.149 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.369+0000 7fac14946700 1 --2- 172.21.15.17:0/3897489682 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fabf8038710 0x7fabf803abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fac04006fd0 tx=0x7fac04006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:13.150 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.369+0000 7fac14946700 1 -- 172.21.15.17:0/3897489682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 msgr2=0x7fac1007bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:13.150 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.369+0000 7fac14946700 1 --2- 172.21.15.17:0/3897489682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac1007bc60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac00006af0 tx=0x7fac00011ed0 comp rx=0 tx=0).stop 2023-07-14T12:50:13.150 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.369+0000 7fac14946700 1 -- 172.21.15.17:0/3897489682 shutdown_connections 2023-07-14T12:50:13.150 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.369+0000 7fac14946700 1 --2- 172.21.15.17:0/3897489682 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fabf8038710 0x7fabf803abc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:13.150 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.369+0000 7fac14946700 1 --2- 172.21.15.17:0/3897489682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac10105200 0x7fac1007bc60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:13.150 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.370+0000 7fac14946700 1 -- 172.21.15.17:0/3897489682 >> 172.21.15.17:0/3897489682 conn(0x7fac10100890 msgr2=0x7fac10101670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:13.150 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.370+0000 7fac14946700 1 -- 172.21.15.17:0/3897489682 shutdown_connections 2023-07-14T12:50:13.150 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:12.370+0000 7fac14946700 1 -- 172.21.15.17:0/3897489682 wait complete. 2023-07-14T12:50:13.162 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-14T12:50:13.162 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2023-07-14T12:50:13.178 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-14T12:50:13.178 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2023-07-14T12:50:13.178 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2023-07-14T12:50:13.179 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-07-14T12:50:13.181 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph Dashboard is now available at: 2023-07-14T12:50:13.181 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:13.181 INFO:teuthology.orchestra.run.smithi017.stdout: URL: https://smithi017.front.sepia.ceph.com:8443/ 2023-07-14T12:50:13.181 INFO:teuthology.orchestra.run.smithi017.stdout: User: admin 2023-07-14T12:50:13.181 INFO:teuthology.orchestra.run.smithi017.stdout: Password: frhk3bon91 2023-07-14T12:50:13.182 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:13.182 INFO:teuthology.orchestra.run.smithi017.stdout:Saving cluster configuration to /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config directory 2023-07-14T12:50:13.182 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling autotune for osd_memory_target 2023-07-14T12:50:13.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:12 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3897489682' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-07-14T12:50:14.346 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:13 smithi017 ceph-mon[95536]: mgrmap e13: x(active, since 6s) 2023-07-14T12:50:14.466 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.734+0000 7f0911140700 1 Processor -- start 2023-07-14T12:50:14.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.734+0000 7f0911140700 1 -- start start 2023-07-14T12:50:14.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.734+0000 7f0911140700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c07a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:14.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.734+0000 7f0911140700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c07a870 con 0x7f090c07be30 2023-07-14T12:50:14.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.735+0000 7f090ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c07a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:14.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.735+0000 7f090ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c07a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47722/0 (socket says 172.21.15.17:47722) 2023-07-14T12:50:14.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.735+0000 7f090ad9d700 1 -- 172.21.15.17:0/84652662 learned_addr learned my addr 172.21.15.17:0/84652662 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:14.467 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.735+0000 7f090ad9d700 1 -- 172.21.15.17:0/84652662 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c07a9b0 con 0x7f090c07be30 2023-07-14T12:50:14.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.735+0000 7f090ad9d700 1 --2- 172.21.15.17:0/84652662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c07a330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0098a0 tx=0x7f08fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1235135bec4000ec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:14.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.736+0000 7f0909d9b700 1 -- 172.21.15.17:0/84652662 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08fc004160 con 0x7f090c07be30 2023-07-14T12:50:14.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.736+0000 7f0909d9b700 1 -- 172.21.15.17:0/84652662 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08fc0042c0 con 0x7f090c07be30 2023-07-14T12:50:14.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.736+0000 7f0909d9b700 1 -- 172.21.15.17:0/84652662 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08fc0118e0 con 0x7f090c07be30 2023-07-14T12:50:14.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.736+0000 7f0911140700 1 -- 172.21.15.17:0/84652662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 msgr2=0x7f090c07a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:14.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.736+0000 7f0911140700 1 --2- 172.21.15.17:0/84652662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c07a330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0098a0 tx=0x7f08fc009bb0 comp rx=0 tx=0).stop 2023-07-14T12:50:14.468 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.736+0000 7f0911140700 1 -- 172.21.15.17:0/84652662 shutdown_connections 2023-07-14T12:50:14.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.736+0000 7f0911140700 1 --2- 172.21.15.17:0/84652662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c07a330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:14.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.736+0000 7f0911140700 1 -- 172.21.15.17:0/84652662 >> 172.21.15.17:0/84652662 conn(0x7f090c100890 msgr2=0x7f090c102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:14.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.736+0000 7f0911140700 1 -- 172.21.15.17:0/84652662 shutdown_connections 2023-07-14T12:50:14.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.736+0000 7f0911140700 1 -- 172.21.15.17:0/84652662 wait complete. 2023-07-14T12:50:14.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.737+0000 7f0911140700 1 Processor -- start 2023-07-14T12:50:14.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.738+0000 7f0911140700 1 -- start start 2023-07-14T12:50:14.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.738+0000 7f0911140700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:14.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.738+0000 7f0911140700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c19b680 con 0x7f090c07be30 2023-07-14T12:50:14.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.738+0000 7f090ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:14.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.738+0000 7f090ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c19b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47734/0 (socket says 172.21.15.17:47734) 2023-07-14T12:50:14.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.738+0000 7f090ad9d700 1 -- 172.21.15.17:0/2554586264 learned_addr learned my addr 172.21.15.17:0/2554586264 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:14.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.738+0000 7f090ad9d700 1 -- 172.21.15.17:0/2554586264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc009550 con 0x7f090c07be30 2023-07-14T12:50:14.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.739+0000 7f090ad9d700 1 --2- 172.21.15.17:0/2554586264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c19b140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08fc006af0 tx=0x7f08fc011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:14.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.739+0000 7f08f3fff700 1 -- 172.21.15.17:0/2554586264 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08fc0037d0 con 0x7f090c07be30 2023-07-14T12:50:14.470 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.739+0000 7f08f3fff700 1 -- 172.21.15.17:0/2554586264 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08fc01b440 con 0x7f090c07be30 2023-07-14T12:50:14.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.739+0000 7f0911140700 1 -- 172.21.15.17:0/2554586264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c19b880 con 0x7f090c07be30 2023-07-14T12:50:14.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.739+0000 7f08f3fff700 1 -- 172.21.15.17:0/2554586264 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08fc023400 con 0x7f090c07be30 2023-07-14T12:50:14.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.739+0000 7f0911140700 1 -- 172.21.15.17:0/2554586264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c19bca0 con 0x7f090c07be30 2023-07-14T12:50:14.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.740+0000 7f08f3fff700 1 -- 172.21.15.17:0/2554586264 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f08fc01b5b0 con 0x7f090c07be30 2023-07-14T12:50:14.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.740+0000 7f0911140700 1 -- 172.21.15.17:0/2554586264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c10b510 con 0x7f090c07be30 2023-07-14T12:50:14.471 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.741+0000 7f08f3fff700 1 --2- 172.21.15.17:0/2554586264 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f4038800 0x7f08f403acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:14.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.741+0000 7f08f3fff700 1 -- 172.21.15.17:0/2554586264 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f08fc04c8c0 con 0x7f090c07be30 2023-07-14T12:50:14.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.741+0000 7f090a59c700 1 --2- 172.21.15.17:0/2554586264 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f4038800 0x7f08f403acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:14.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.742+0000 7f090a59c700 1 --2- 172.21.15.17:0/2554586264 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f4038800 0x7f08f403acb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0900006fd0 tx=0x7f0900006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:14.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.746+0000 7f08f3fff700 1 -- 172.21.15.17:0/2554586264 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f08fc01b8d0 con 0x7f090c07be30 2023-07-14T12:50:14.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.952+0000 7f0911140700 1 -- 172.21.15.17:0/2554586264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f090c19eb00 con 0x7f090c07be30 2023-07-14T12:50:14.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.953+0000 7f08f3fff700 1 -- 172.21.15.17:0/2554586264 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f08fc00b3e0 con 0x7f090c07be30 2023-07-14T12:50:14.472 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.955+0000 7f0911140700 1 -- 172.21.15.17:0/2554586264 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f4038800 msgr2=0x7f08f403acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:14.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.955+0000 7f0911140700 1 --2- 172.21.15.17:0/2554586264 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f4038800 0x7f08f403acb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0900006fd0 tx=0x7f0900006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:14.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.955+0000 7f0911140700 1 -- 172.21.15.17:0/2554586264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 msgr2=0x7f090c19b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:14.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.955+0000 7f0911140700 1 --2- 172.21.15.17:0/2554586264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c19b140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08fc006af0 tx=0x7f08fc011ed0 comp rx=0 tx=0).stop 2023-07-14T12:50:14.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.955+0000 7f0911140700 1 -- 172.21.15.17:0/2554586264 shutdown_connections 2023-07-14T12:50:14.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.955+0000 7f0911140700 1 --2- 172.21.15.17:0/2554586264 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f4038800 0x7f08f403acb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:14.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.955+0000 7f0911140700 1 --2- 172.21.15.17:0/2554586264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f090c07be30 0x7f090c19b140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:14.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.955+0000 7f0911140700 1 -- 172.21.15.17:0/2554586264 >> 172.21.15.17:0/2554586264 conn(0x7f090c100890 msgr2=0x7f090c101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:14.473 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.956+0000 7f0911140700 1 -- 172.21.15.17:0/2554586264 shutdown_connections 2023-07-14T12:50:14.474 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:13.956+0000 7f0911140700 1 -- 172.21.15.17:0/2554586264 wait complete. 2023-07-14T12:50:15.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.966+0000 7f8b44717700 1 Processor -- start 2023-07-14T12:50:15.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.966+0000 7f8b44717700 1 -- start start 2023-07-14T12:50:15.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.967+0000 7f8b44717700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:15.750 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.967+0000 7f8b44717700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c07a830 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.967+0000 7f8b424b3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:15.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.967+0000 7f8b424b3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32908/0 (socket says 172.21.15.17:32908) 2023-07-14T12:50:15.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.967+0000 7f8b424b3700 1 -- 172.21.15.17:0/278869985 learned_addr learned my addr 172.21.15.17:0/278869985 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:15.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.967+0000 7f8b424b3700 1 -- 172.21.15.17:0/278869985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c07a970 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.968+0000 7f8b424b3700 1 --2- 172.21.15.17:0/278869985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c07a2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b380098a0 tx=0x7f8b38009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b7d58c2f6e1b36 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:15.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.968+0000 7f8b414b1700 1 -- 172.21.15.17:0/278869985 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b38004160 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.751 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.968+0000 7f8b414b1700 1 -- 172.21.15.17:0/278869985 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b380042c0 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.968+0000 7f8b414b1700 1 -- 172.21.15.17:0/278869985 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b380118e0 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.968+0000 7f8b44717700 1 -- 172.21.15.17:0/278869985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 msgr2=0x7f8b3c07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:15.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.968+0000 7f8b44717700 1 --2- 172.21.15.17:0/278869985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c07a2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b380098a0 tx=0x7f8b38009bb0 comp rx=0 tx=0).stop 2023-07-14T12:50:15.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.969+0000 7f8b44717700 1 -- 172.21.15.17:0/278869985 shutdown_connections 2023-07-14T12:50:15.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.969+0000 7f8b44717700 1 --2- 172.21.15.17:0/278869985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c07a2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:15.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.969+0000 7f8b44717700 1 -- 172.21.15.17:0/278869985 >> 172.21.15.17:0/278869985 conn(0x7f8b3c100890 msgr2=0x7f8b3c102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:15.752 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.969+0000 7f8b44717700 1 -- 172.21.15.17:0/278869985 shutdown_connections 2023-07-14T12:50:15.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.969+0000 7f8b44717700 1 -- 172.21.15.17:0/278869985 wait complete. 2023-07-14T12:50:15.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.970+0000 7f8b44717700 1 Processor -- start 2023-07-14T12:50:15.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.970+0000 7f8b44717700 1 -- start start 2023-07-14T12:50:15.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.970+0000 7f8b44717700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c19b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:15.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.970+0000 7f8b44717700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c19b680 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.970+0000 7f8b424b3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c19b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:15.753 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.970+0000 7f8b424b3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c19b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32924/0 (socket says 172.21.15.17:32924) 2023-07-14T12:50:15.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.971+0000 7f8b424b3700 1 -- 172.21.15.17:0/2337369468 learned_addr learned my addr 172.21.15.17:0/2337369468 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:15.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.971+0000 7f8b424b3700 1 -- 172.21.15.17:0/2337369468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38009550 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.971+0000 7f8b424b3700 1 --2- 172.21.15.17:0/2337369468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c19b140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b38003e30 tx=0x7f8b380119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:15.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.971+0000 7f8b337fe700 1 -- 172.21.15.17:0/2337369468 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b380036a0 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.971+0000 7f8b337fe700 1 -- 172.21.15.17:0/2337369468 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b3801b440 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.971+0000 7f8b337fe700 1 -- 172.21.15.17:0/2337369468 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b38023400 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.754 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.971+0000 7f8b44717700 1 -- 172.21.15.17:0/2337369468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c19b880 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.971+0000 7f8b44717700 1 -- 172.21.15.17:0/2337369468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c19bca0 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.972+0000 7f8b337fe700 1 -- 172.21.15.17:0/2337369468 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f8b3801b5b0 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.972+0000 7f8b44717700 1 -- 172.21.15.17:0/2337369468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c10b550 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.973+0000 7f8b337fe700 1 --2- 172.21.15.17:0/2337369468 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b28038850 0x7f8b2803ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:15.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.973+0000 7f8b337fe700 1 -- 172.21.15.17:0/2337369468 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8b3804c900 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.973+0000 7f8b41cb2700 1 --2- 172.21.15.17:0/2337369468 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b28038850 0x7f8b2803ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:15.755 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.974+0000 7f8b41cb2700 1 --2- 172.21.15.17:0/2337369468 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b28038850 0x7f8b2803ad00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c006fd0 tx=0x7f8b2c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:15.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:14.978+0000 7f8b337fe700 1 -- 172.21.15.17:0/2337369468 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8b3800be40 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.295+0000 7f8b44717700 1 -- 172.21.15.17:0/2337369468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f8b3c19eb00 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.298+0000 7f8b337fe700 1 -- 172.21.15.17:0/2337369468 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) v1 ==== 153+0+0 (secure 0 0 0) 0x7f8b3800b3e0 con 0x7f8b3c07bdf0 2023-07-14T12:50:15.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.300+0000 7f8b44717700 1 -- 172.21.15.17:0/2337369468 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b28038850 msgr2=0x7f8b2803ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:15.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.300+0000 7f8b44717700 1 --2- 172.21.15.17:0/2337369468 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b28038850 0x7f8b2803ad00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c006fd0 tx=0x7f8b2c006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:15.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.300+0000 7f8b44717700 1 -- 172.21.15.17:0/2337369468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 msgr2=0x7f8b3c19b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:15.756 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.300+0000 7f8b44717700 1 --2- 172.21.15.17:0/2337369468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c19b140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b38003e30 tx=0x7f8b380119a0 comp rx=0 tx=0).stop 2023-07-14T12:50:15.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.300+0000 7f8b44717700 1 -- 172.21.15.17:0/2337369468 shutdown_connections 2023-07-14T12:50:15.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.300+0000 7f8b44717700 1 --2- 172.21.15.17:0/2337369468 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b28038850 0x7f8b2803ad00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:15.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.300+0000 7f8b44717700 1 --2- 172.21.15.17:0/2337369468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b3c07bdf0 0x7f8b3c19b140 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:15.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.300+0000 7f8b44717700 1 -- 172.21.15.17:0/2337369468 >> 172.21.15.17:0/2337369468 conn(0x7f8b3c100890 msgr2=0x7f8b3c101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:15.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.300+0000 7f8b44717700 1 -- 172.21.15.17:0/2337369468 shutdown_connections 2023-07-14T12:50:15.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2023-07-14T12:50:15.300+0000 7f8b44717700 1 -- 172.21.15.17:0/2337369468 wait complete. 2023-07-14T12:50:15.757 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-07-14T12:50:15.758 INFO:teuthology.orchestra.run.smithi017.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-07-14T12:50:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-07-14T12:50:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:15.758 INFO:teuthology.orchestra.run.smithi017.stdout:Or, if you are only running a single cluster on this host: 2023-07-14T12:50:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:15.758 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-07-14T12:50:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:15.759 INFO:teuthology.orchestra.run.smithi017.stdout:Please consider enabling telemetry to help improve Ceph: 2023-07-14T12:50:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: ceph telemetry on 2023-07-14T12:50:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:15.759 INFO:teuthology.orchestra.run.smithi017.stdout:For more information see: 2023-07-14T12:50:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:15.759 INFO:teuthology.orchestra.run.smithi017.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-07-14T12:50:15.760 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:15.760 INFO:teuthology.orchestra.run.smithi017.stdout:Bootstrap complete. 2023-07-14T12:50:15.809 INFO:tasks.cephadm:Fetching config... 2023-07-14T12:50:15.809 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:50:15.809 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-07-14T12:50:15.854 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-07-14T12:50:15.854 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:50:15.854 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-07-14T12:50:15.940 INFO:tasks.cephadm:Fetching mon keyring... 2023-07-14T12:50:15.940 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:50:15.941 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/keyring of=/dev/stdout 2023-07-14T12:50:16.052 INFO:tasks.cephadm:Fetching pub ssh key... 2023-07-14T12:50:16.053 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:50:16.053 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-07-14T12:50:16.135 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-07-14T12:50:16.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Zcos0kfvjSo98+P74+iYoJOzUgeE1PQ+RzcRC3mSJ0jBdB3BYAmCpos2a8xvzMrGX/G7VKCkf6zb62OO8cU+rAslf1ggPV8rzvkStNYXY0o2+cCjcjBgLpg4SgxuLWM8a9OfufeEQj7+pM/y9ulooGDj4vjsPGXUhv8ME+jhg06Phtvl81SkmfkC8qM8MzI0wH6a1U+A4oJMdynfg7ZK3vP7NeC+JtLW9felu6Qt+49iNRxCMOQvpsnCgcLb+lMRqIJU0YFaZa4hI/KM+xdBWs0hHODKlbT2+hmt0+/Vk72PUiup8hKh/L+IcfWQzT0NcHvrFlW+BxjSfYnnf2/xktFDmiLlateIJkZvkNcY3LApxomfRG201yJ9yXqoH5dCLoUIBSodVeXHsXc51U2yTGUtLMfjIvZkcHBnX1APbQUaC0ODiLUT9KXhhJr8ApdWu8QkFT7HpCBL6BfldA/TsPv/cA1z5myyr122qM0cpa/o0IvOUBVwdGFhmcvUNk8= ceph-b31a3268-2244-11ee-9b33-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-14T12:50:16.279 INFO:teuthology.orchestra.run.smithi017.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Zcos0kfvjSo98+P74+iYoJOzUgeE1PQ+RzcRC3mSJ0jBdB3BYAmCpos2a8xvzMrGX/G7VKCkf6zb62OO8cU+rAslf1ggPV8rzvkStNYXY0o2+cCjcjBgLpg4SgxuLWM8a9OfufeEQj7+pM/y9ulooGDj4vjsPGXUhv8ME+jhg06Phtvl81SkmfkC8qM8MzI0wH6a1U+A4oJMdynfg7ZK3vP7NeC+JtLW9felu6Qt+49iNRxCMOQvpsnCgcLb+lMRqIJU0YFaZa4hI/KM+xdBWs0hHODKlbT2+hmt0+/Vk72PUiup8hKh/L+IcfWQzT0NcHvrFlW+BxjSfYnnf2/xktFDmiLlateIJkZvkNcY3LApxomfRG201yJ9yXqoH5dCLoUIBSodVeXHsXc51U2yTGUtLMfjIvZkcHBnX1APbQUaC0ODiLUT9KXhhJr8ApdWu8QkFT7HpCBL6BfldA/TsPv/cA1z5myyr122qM0cpa/o0IvOUBVwdGFhmcvUNk8= ceph-b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:50:16.311 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Zcos0kfvjSo98+P74+iYoJOzUgeE1PQ+RzcRC3mSJ0jBdB3BYAmCpos2a8xvzMrGX/G7VKCkf6zb62OO8cU+rAslf1ggPV8rzvkStNYXY0o2+cCjcjBgLpg4SgxuLWM8a9OfufeEQj7+pM/y9ulooGDj4vjsPGXUhv8ME+jhg06Phtvl81SkmfkC8qM8MzI0wH6a1U+A4oJMdynfg7ZK3vP7NeC+JtLW9felu6Qt+49iNRxCMOQvpsnCgcLb+lMRqIJU0YFaZa4hI/KM+xdBWs0hHODKlbT2+hmt0+/Vk72PUiup8hKh/L+IcfWQzT0NcHvrFlW+BxjSfYnnf2/xktFDmiLlateIJkZvkNcY3LApxomfRG201yJ9yXqoH5dCLoUIBSodVeXHsXc51U2yTGUtLMfjIvZkcHBnX1APbQUaC0ODiLUT9KXhhJr8ApdWu8QkFT7HpCBL6BfldA/TsPv/cA1z5myyr122qM0cpa/o0IvOUBVwdGFhmcvUNk8= ceph-b31a3268-2244-11ee-9b33-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-14T12:50:16.415 INFO:teuthology.orchestra.run.smithi131.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Zcos0kfvjSo98+P74+iYoJOzUgeE1PQ+RzcRC3mSJ0jBdB3BYAmCpos2a8xvzMrGX/G7VKCkf6zb62OO8cU+rAslf1ggPV8rzvkStNYXY0o2+cCjcjBgLpg4SgxuLWM8a9OfufeEQj7+pM/y9ulooGDj4vjsPGXUhv8ME+jhg06Phtvl81SkmfkC8qM8MzI0wH6a1U+A4oJMdynfg7ZK3vP7NeC+JtLW9felu6Qt+49iNRxCMOQvpsnCgcLb+lMRqIJU0YFaZa4hI/KM+xdBWs0hHODKlbT2+hmt0+/Vk72PUiup8hKh/L+IcfWQzT0NcHvrFlW+BxjSfYnnf2/xktFDmiLlateIJkZvkNcY3LApxomfRG201yJ9yXqoH5dCLoUIBSodVeXHsXc51U2yTGUtLMfjIvZkcHBnX1APbQUaC0ODiLUT9KXhhJr8ApdWu8QkFT7HpCBL6BfldA/TsPv/cA1z5myyr122qM0cpa/o0IvOUBVwdGFhmcvUNk8= ceph-b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:50:16.445 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Zcos0kfvjSo98+P74+iYoJOzUgeE1PQ+RzcRC3mSJ0jBdB3BYAmCpos2a8xvzMrGX/G7VKCkf6zb62OO8cU+rAslf1ggPV8rzvkStNYXY0o2+cCjcjBgLpg4SgxuLWM8a9OfufeEQj7+pM/y9ulooGDj4vjsPGXUhv8ME+jhg06Phtvl81SkmfkC8qM8MzI0wH6a1U+A4oJMdynfg7ZK3vP7NeC+JtLW9felu6Qt+49iNRxCMOQvpsnCgcLb+lMRqIJU0YFaZa4hI/KM+xdBWs0hHODKlbT2+hmt0+/Vk72PUiup8hKh/L+IcfWQzT0NcHvrFlW+BxjSfYnnf2/xktFDmiLlateIJkZvkNcY3LApxomfRG201yJ9yXqoH5dCLoUIBSodVeXHsXc51U2yTGUtLMfjIvZkcHBnX1APbQUaC0ODiLUT9KXhhJr8ApdWu8QkFT7HpCBL6BfldA/TsPv/cA1z5myyr122qM0cpa/o0IvOUBVwdGFhmcvUNk8= ceph-b31a3268-2244-11ee-9b33-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-14T12:50:16.548 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Zcos0kfvjSo98+P74+iYoJOzUgeE1PQ+RzcRC3mSJ0jBdB3BYAmCpos2a8xvzMrGX/G7VKCkf6zb62OO8cU+rAslf1ggPV8rzvkStNYXY0o2+cCjcjBgLpg4SgxuLWM8a9OfufeEQj7+pM/y9ulooGDj4vjsPGXUhv8ME+jhg06Phtvl81SkmfkC8qM8MzI0wH6a1U+A4oJMdynfg7ZK3vP7NeC+JtLW9felu6Qt+49iNRxCMOQvpsnCgcLb+lMRqIJU0YFaZa4hI/KM+xdBWs0hHODKlbT2+hmt0+/Vk72PUiup8hKh/L+IcfWQzT0NcHvrFlW+BxjSfYnnf2/xktFDmiLlateIJkZvkNcY3LApxomfRG201yJ9yXqoH5dCLoUIBSodVeXHsXc51U2yTGUtLMfjIvZkcHBnX1APbQUaC0ODiLUT9KXhhJr8ApdWu8QkFT7HpCBL6BfldA/TsPv/cA1z5myyr122qM0cpa/o0IvOUBVwdGFhmcvUNk8= ceph-b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:50:16.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-07-14T12:50:16.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:16 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2337369468' entity='client.admin' 2023-07-14T12:50:17.671 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:50:18.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:18 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:18.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:18 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:18.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:18 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:50:18.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:18 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:18.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:18 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:50:18.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:18 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:19.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.264+0000 7fef581a1700 1 -- 172.21.15.17:0/2623245344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef500ff5e0 msgr2=0x7fef500ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:19.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.264+0000 7fef581a1700 1 --2- 172.21.15.17:0/2623245344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef500ff5e0 0x7fef500ff9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009910 tx=0x7fef4c009c20 comp rx=0 tx=0).stop 2023-07-14T12:50:19.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.264+0000 7fef581a1700 1 -- 172.21.15.17:0/2623245344 shutdown_connections 2023-07-14T12:50:19.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.264+0000 7fef581a1700 1 --2- 172.21.15.17:0/2623245344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef500ff5e0 0x7fef500ff9f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:19.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.264+0000 7fef581a1700 1 -- 172.21.15.17:0/2623245344 >> 172.21.15.17:0/2623245344 conn(0x7fef500fab90 msgr2=0x7fef500fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:19.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.264+0000 7fef581a1700 1 -- 172.21.15.17:0/2623245344 shutdown_connections 2023-07-14T12:50:19.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.264+0000 7fef581a1700 1 -- 172.21.15.17:0/2623245344 wait complete. 2023-07-14T12:50:19.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.265+0000 7fef581a1700 1 Processor -- start 2023-07-14T12:50:19.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.265+0000 7fef581a1700 1 -- start start 2023-07-14T12:50:19.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.266+0000 7fef581a1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef500ff5e0 0x7fef500742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:19.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.266+0000 7fef581a1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500747f0 con 0x7fef500ff5e0 2023-07-14T12:50:19.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.266+0000 7fef55f3d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef500ff5e0 0x7fef500742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:19.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.266+0000 7fef55f3d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef500ff5e0 0x7fef500742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32940/0 (socket says 172.21.15.17:32940) 2023-07-14T12:50:19.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.266+0000 7fef55f3d700 1 -- 172.21.15.17:0/81780970 learned_addr learned my addr 172.21.15.17:0/81780970 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:19.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.266+0000 7fef55f3d700 1 -- 172.21.15.17:0/81780970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c0095f0 con 0x7fef500ff5e0 2023-07-14T12:50:19.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.267+0000 7fef55f3d700 1 --2- 172.21.15.17:0/81780970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef500ff5e0 0x7fef500742b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fef4c005950 tx=0x7fef4c005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:19.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.267+0000 7fef46ffd700 1 -- 172.21.15.17:0/81780970 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef4c00ba90 con 0x7fef500ff5e0 2023-07-14T12:50:19.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.267+0000 7fef581a1700 1 -- 172.21.15.17:0/81780970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef50072900 con 0x7fef500ff5e0 2023-07-14T12:50:19.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.267+0000 7fef46ffd700 1 -- 172.21.15.17:0/81780970 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef4c00bbf0 con 0x7fef500ff5e0 2023-07-14T12:50:19.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.267+0000 7fef46ffd700 1 -- 172.21.15.17:0/81780970 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef4c017440 con 0x7fef500ff5e0 2023-07-14T12:50:19.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.267+0000 7fef581a1700 1 -- 172.21.15.17:0/81780970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef50072da0 con 0x7fef500ff5e0 2023-07-14T12:50:19.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.268+0000 7fef581a1700 1 -- 172.21.15.17:0/81780970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef50061b40 con 0x7fef500ff5e0 2023-07-14T12:50:19.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.268+0000 7fef46ffd700 1 -- 172.21.15.17:0/81780970 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fef4c00f460 con 0x7fef500ff5e0 2023-07-14T12:50:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.269+0000 7fef46ffd700 1 --2- 172.21.15.17:0/81780970 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fef3c0387b0 0x7fef3c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.269+0000 7fef46ffd700 1 -- 172.21.15.17:0/81780970 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fef4c04c9c0 con 0x7fef500ff5e0 2023-07-14T12:50:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.269+0000 7fef5573c700 1 --2- 172.21.15.17:0/81780970 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fef3c0387b0 0x7fef3c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.269+0000 7fef5573c700 1 --2- 172.21.15.17:0/81780970 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fef3c0387b0 0x7fef3c03ac60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fef40006fd0 tx=0x7fef40006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.273+0000 7fef46ffd700 1 -- 172.21.15.17:0/81780970 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fef4c015350 con 0x7fef500ff5e0 2023-07-14T12:50:19.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.478+0000 7fef581a1700 1 -- 172.21.15.17:0/81780970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fef5018da40 con 0x7fef500ff5e0 2023-07-14T12:50:19.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.482+0000 7fef46ffd700 1 -- 172.21.15.17:0/81780970 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fef4c027070 con 0x7fef500ff5e0 2023-07-14T12:50:19.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.484+0000 7fef581a1700 1 -- 172.21.15.17:0/81780970 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fef3c0387b0 msgr2=0x7fef3c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:19.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.484+0000 7fef581a1700 1 --2- 172.21.15.17:0/81780970 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fef3c0387b0 0x7fef3c03ac60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fef40006fd0 tx=0x7fef40006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:19.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.484+0000 7fef581a1700 1 -- 172.21.15.17:0/81780970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef500ff5e0 msgr2=0x7fef500742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:19.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.484+0000 7fef581a1700 1 --2- 172.21.15.17:0/81780970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef500ff5e0 0x7fef500742b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fef4c005950 tx=0x7fef4c005810 comp rx=0 tx=0).stop 2023-07-14T12:50:19.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.485+0000 7fef581a1700 1 -- 172.21.15.17:0/81780970 shutdown_connections 2023-07-14T12:50:19.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.485+0000 7fef581a1700 1 --2- 172.21.15.17:0/81780970 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fef3c0387b0 0x7fef3c03ac60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:19.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.485+0000 7fef581a1700 1 --2- 172.21.15.17:0/81780970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef500ff5e0 0x7fef500742b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:19.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.485+0000 7fef581a1700 1 -- 172.21.15.17:0/81780970 >> 172.21.15.17:0/81780970 conn(0x7fef500fab90 msgr2=0x7fef500fb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:19.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.485+0000 7fef581a1700 1 -- 172.21.15.17:0/81780970 shutdown_connections 2023-07-14T12:50:19.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:19.485+0000 7fef581a1700 1 -- 172.21.15.17:0/81780970 wait complete. 2023-07-14T12:50:20.055 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-07-14T12:50:20.056 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-07-14T12:50:20.820 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:50:20.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:20 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/81780970' entity='client.admin' 2023-07-14T12:50:20.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:50:20.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.330+0000 7f18e8e41700 1 -- 172.21.15.17:0/2587755058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18e40ff5e0 msgr2=0x7f18e40ff9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.330+0000 7f18e8e41700 1 --2- 172.21.15.17:0/2587755058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18e40ff5e0 0x7f18e40ff9f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009910 tx=0x7f18d4009c20 comp rx=0 tx=0).stop 2023-07-14T12:50:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.330+0000 7f18e8e41700 1 -- 172.21.15.17:0/2587755058 shutdown_connections 2023-07-14T12:50:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.330+0000 7f18e8e41700 1 --2- 172.21.15.17:0/2587755058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18e40ff5e0 0x7f18e40ff9f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.330+0000 7f18e8e41700 1 -- 172.21.15.17:0/2587755058 >> 172.21.15.17:0/2587755058 conn(0x7f18e40fab90 msgr2=0x7f18e40fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.330+0000 7f18e8e41700 1 -- 172.21.15.17:0/2587755058 shutdown_connections 2023-07-14T12:50:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.330+0000 7f18e8e41700 1 -- 172.21.15.17:0/2587755058 wait complete. 2023-07-14T12:50:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.331+0000 7f18e8e41700 1 Processor -- start 2023-07-14T12:50:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.331+0000 7f18e8e41700 1 -- start start 2023-07-14T12:50:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.332+0000 7f18e8e41700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18e40ff5e0 0x7f18e40742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.332+0000 7f18e8e41700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e40747f0 con 0x7f18e40ff5e0 2023-07-14T12:50:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.332+0000 7f18e259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18e40ff5e0 0x7f18e40742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.332+0000 7f18e259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18e40ff5e0 0x7f18e40742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32970/0 (socket says 172.21.15.17:32970) 2023-07-14T12:50:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.332+0000 7f18e259c700 1 -- 172.21.15.17:0/2351711348 learned_addr learned my addr 172.21.15.17:0/2351711348 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.332+0000 7f18e259c700 1 -- 172.21.15.17:0/2351711348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d40095f0 con 0x7f18e40ff5e0 2023-07-14T12:50:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.333+0000 7f18e259c700 1 --2- 172.21.15.17:0/2351711348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18e40ff5e0 0x7f18e40742b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18d4005950 tx=0x7f18d4005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.333+0000 7f18d37fe700 1 -- 172.21.15.17:0/2351711348 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18d400ba90 con 0x7f18e40ff5e0 2023-07-14T12:50:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.333+0000 7f18d37fe700 1 -- 172.21.15.17:0/2351711348 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18d400bbf0 con 0x7f18e40ff5e0 2023-07-14T12:50:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.333+0000 7f18e8e41700 1 -- 172.21.15.17:0/2351711348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e4072900 con 0x7f18e40ff5e0 2023-07-14T12:50:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.333+0000 7f18d37fe700 1 -- 172.21.15.17:0/2351711348 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18d4017440 con 0x7f18e40ff5e0 2023-07-14T12:50:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.333+0000 7f18e8e41700 1 -- 172.21.15.17:0/2351711348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e4072da0 con 0x7f18e40ff5e0 2023-07-14T12:50:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.334+0000 7f18e8e41700 1 -- 172.21.15.17:0/2351711348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e4061b40 con 0x7f18e40ff5e0 2023-07-14T12:50:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.334+0000 7f18d37fe700 1 -- 172.21.15.17:0/2351711348 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f18d400f460 con 0x7f18e40ff5e0 2023-07-14T12:50:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.334+0000 7f18d37fe700 1 --2- 172.21.15.17:0/2351711348 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18cc038800 0x7f18cc03acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.334+0000 7f18d37fe700 1 -- 172.21.15.17:0/2351711348 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f18d404c960 con 0x7f18e40ff5e0 2023-07-14T12:50:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.335+0000 7f18e1d9b700 1 --2- 172.21.15.17:0/2351711348 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18cc038800 0x7f18cc03acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.335+0000 7f18e1d9b700 1 --2- 172.21.15.17:0/2351711348 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18cc038800 0x7f18cc03acb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f18d8006fd0 tx=0x7f18d8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.340+0000 7f18d37fe700 1 -- 172.21.15.17:0/2351711348 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f18d402ad30 con 0x7f18e40ff5e0 2023-07-14T12:50:22.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.550+0000 7f18e8e41700 1 -- 172.21.15.17:0/2351711348 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f18e40730a0 con 0x7f18cc038800 2023-07-14T12:50:22.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.553+0000 7f18d37fe700 1 -- 172.21.15.17:0/2351711348 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f18e40730a0 con 0x7f18cc038800 2023-07-14T12:50:22.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.556+0000 7f18e8e41700 1 -- 172.21.15.17:0/2351711348 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18cc038800 msgr2=0x7f18cc03acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:22.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.556+0000 7f18e8e41700 1 --2- 172.21.15.17:0/2351711348 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18cc038800 0x7f18cc03acb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f18d8006fd0 tx=0x7f18d8006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:22.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.556+0000 7f18e8e41700 1 -- 172.21.15.17:0/2351711348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18e40ff5e0 msgr2=0x7f18e40742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:22.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.556+0000 7f18e8e41700 1 --2- 172.21.15.17:0/2351711348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18e40ff5e0 0x7f18e40742b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18d4005950 tx=0x7f18d4005810 comp rx=0 tx=0).stop 2023-07-14T12:50:22.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.556+0000 7f18e8e41700 1 -- 172.21.15.17:0/2351711348 shutdown_connections 2023-07-14T12:50:22.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.556+0000 7f18e8e41700 1 --2- 172.21.15.17:0/2351711348 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18cc038800 0x7f18cc03acb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:22.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.556+0000 7f18e8e41700 1 --2- 172.21.15.17:0/2351711348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18e40ff5e0 0x7f18e40742b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:22.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.556+0000 7f18e8e41700 1 -- 172.21.15.17:0/2351711348 >> 172.21.15.17:0/2351711348 conn(0x7f18e40fab90 msgr2=0x7f18e40fb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:22.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.556+0000 7f18e8e41700 1 -- 172.21.15.17:0/2351711348 shutdown_connections 2023-07-14T12:50:22.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:22.556+0000 7f18e8e41700 1 -- 172.21.15.17:0/2351711348 wait complete. 2023-07-14T12:50:23.099 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi131 2023-07-14T12:50:23.100 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-14T12:50:23.100 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.conf 2023-07-14T12:50:23.147 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-14T12:50:23.148 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:50:23.233 INFO:tasks.cephadm:Adding host smithi131 to orchestrator... 2023-07-14T12:50:23.233 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch host add smithi131 2023-07-14T12:50:23.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:23 smithi017 ceph-mon[95536]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:50:23.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:23.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:50:23.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:50:23.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:50:23.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:23 smithi017 ceph-mon[95536]: Updating smithi017:/etc/ceph/ceph.conf 2023-07-14T12:50:23.991 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:50:24.818 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:24 smithi017 ceph-mon[95536]: Updating smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:50:24.819 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:24 smithi017 ceph-mon[95536]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:50:25.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.510+0000 7fcdd2002700 1 -- 172.21.15.17:0/2152016511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc105630 msgr2=0x7fcdcc105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:25.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.510+0000 7fcdd2002700 1 --2- 172.21.15.17:0/2152016511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc105630 0x7fcdcc105a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009910 tx=0x7fcdbc009c20 comp rx=0 tx=0).stop 2023-07-14T12:50:25.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.510+0000 7fcdd2002700 1 -- 172.21.15.17:0/2152016511 shutdown_connections 2023-07-14T12:50:25.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.510+0000 7fcdd2002700 1 --2- 172.21.15.17:0/2152016511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc105630 0x7fcdcc105a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:25.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.510+0000 7fcdd2002700 1 -- 172.21.15.17:0/2152016511 >> 172.21.15.17:0/2152016511 conn(0x7fcdcc0fb130 msgr2=0x7fcdcc0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:25.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.510+0000 7fcdd2002700 1 -- 172.21.15.17:0/2152016511 shutdown_connections 2023-07-14T12:50:25.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.510+0000 7fcdd2002700 1 -- 172.21.15.17:0/2152016511 wait complete. 2023-07-14T12:50:25.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.511+0000 7fcdd2002700 1 Processor -- start 2023-07-14T12:50:25.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.512+0000 7fcdd2002700 1 -- start start 2023-07-14T12:50:25.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.512+0000 7fcdd2002700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc105630 0x7fcdcc072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:25.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.512+0000 7fcdd2002700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc074790 con 0x7fcdcc105630 2023-07-14T12:50:25.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.512+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc105630 0x7fcdcc072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:25.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.512+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc105630 0x7fcdcc072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50426/0 (socket says 172.21.15.17:50426) 2023-07-14T12:50:25.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.512+0000 7fcdcb7fe700 1 -- 172.21.15.17:0/1506404834 learned_addr learned my addr 172.21.15.17:0/1506404834 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:25.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.513+0000 7fcdcb7fe700 1 -- 172.21.15.17:0/1506404834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc0095f0 con 0x7fcdcc105630 2023-07-14T12:50:25.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.513+0000 7fcdcb7fe700 1 --2- 172.21.15.17:0/1506404834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc105630 0x7fcdcc072810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc004f40 tx=0x7fcdbc005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:25.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.513+0000 7fcdc8ff9700 1 -- 172.21.15.17:0/1506404834 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdbc01d070 con 0x7fcdcc105630 2023-07-14T12:50:25.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.513+0000 7fcdc8ff9700 1 -- 172.21.15.17:0/1506404834 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcdbc0044b0 con 0x7fcdcc105630 2023-07-14T12:50:25.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.513+0000 7fcdc8ff9700 1 -- 172.21.15.17:0/1506404834 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcdbc003860 con 0x7fcdcc105630 2023-07-14T12:50:25.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.513+0000 7fcdd2002700 1 -- 172.21.15.17:0/1506404834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc072d50 con 0x7fcdcc105630 2023-07-14T12:50:25.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.513+0000 7fcdd2002700 1 -- 172.21.15.17:0/1506404834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc073250 con 0x7fcdcc105630 2023-07-14T12:50:25.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.514+0000 7fcdd2002700 1 -- 172.21.15.17:0/1506404834 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc1048d0 con 0x7fcdcc105630 2023-07-14T12:50:25.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.514+0000 7fcdc8ff9700 1 -- 172.21.15.17:0/1506404834 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fcdbc00b960 con 0x7fcdcc105630 2023-07-14T12:50:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.515+0000 7fcdc8ff9700 1 --2- 172.21.15.17:0/1506404834 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdb4038850 0x7fcdb403ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.515+0000 7fcdc8ff9700 1 -- 172.21.15.17:0/1506404834 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcdbc04c6f0 con 0x7fcdcc105630 2023-07-14T12:50:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.515+0000 7fcdcaffd700 1 --2- 172.21.15.17:0/1506404834 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdb4038850 0x7fcdb403ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:25.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.516+0000 7fcdcaffd700 1 --2- 172.21.15.17:0/1506404834 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdb4038850 0x7fcdb403ad00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0006fd0 tx=0x7fcdc0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:25.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.520+0000 7fcdc8ff9700 1 -- 172.21.15.17:0/1506404834 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcdbc02a540 con 0x7fcdcc105630 2023-07-14T12:50:25.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:25.732+0000 7fcdd2002700 1 -- 172.21.15.17:0/1506404834 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdcc073d40 con 0x7fcdb4038850 2023-07-14T12:50:26.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:25 smithi017 ceph-mon[95536]: Updating smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:50:26.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:26.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:26.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:27.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:26 smithi017 ceph-mon[95536]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:50:28.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:27 smithi017 ceph-mon[95536]: Deploying cephadm binary to smithi131 2023-07-14T12:50:28.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:27 smithi017 ceph-mon[95536]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:28.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:28.950+0000 7fcdc8ff9700 1 -- 172.21.15.17:0/1506404834 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fcdcc073d40 con 0x7fcdb4038850 2023-07-14T12:50:28.971 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi131' with addr '172.21.15.131' 2023-07-14T12:50:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:28.953+0000 7fcdd2002700 1 -- 172.21.15.17:0/1506404834 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdb4038850 msgr2=0x7fcdb403ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:28.953+0000 7fcdd2002700 1 --2- 172.21.15.17:0/1506404834 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdb4038850 0x7fcdb403ad00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0006fd0 tx=0x7fcdc0006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:28.953+0000 7fcdd2002700 1 -- 172.21.15.17:0/1506404834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc105630 msgr2=0x7fcdcc072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:28.953+0000 7fcdd2002700 1 --2- 172.21.15.17:0/1506404834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc105630 0x7fcdcc072810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc004f40 tx=0x7fcdbc005020 comp rx=0 tx=0).stop 2023-07-14T12:50:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:28.954+0000 7fcdd2002700 1 -- 172.21.15.17:0/1506404834 shutdown_connections 2023-07-14T12:50:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:28.954+0000 7fcdd2002700 1 --2- 172.21.15.17:0/1506404834 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdb4038850 0x7fcdb403ad00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:28.954+0000 7fcdd2002700 1 --2- 172.21.15.17:0/1506404834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcdcc105630 0x7fcdcc072810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:28.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:28.954+0000 7fcdd2002700 1 -- 172.21.15.17:0/1506404834 >> 172.21.15.17:0/1506404834 conn(0x7fcdcc0fb130 msgr2=0x7fcdcc0fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:28.954+0000 7fcdd2002700 1 -- 172.21.15.17:0/1506404834 shutdown_connections 2023-07-14T12:50:28.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:28.954+0000 7fcdd2002700 1 -- 172.21.15.17:0/1506404834 wait complete. 2023-07-14T12:50:29.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch host ls --format=json 2023-07-14T12:50:30.209 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:50:30.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:29 smithi017 ceph-mon[95536]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:30.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:30.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:29 smithi017 ceph-mon[95536]: Added host smithi131 2023-07-14T12:50:30.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:50:30.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:31.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.751+0000 7fb93381d700 1 -- 172.21.15.17:0/783560814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c074a40 msgr2=0x7fb92c074e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.751+0000 7fb93381d700 1 --2- 172.21.15.17:0/783560814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c074a40 0x7fb92c074e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb928009910 tx=0x7fb928009c20 comp rx=0 tx=0).stop 2023-07-14T12:50:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.751+0000 7fb93381d700 1 -- 172.21.15.17:0/783560814 shutdown_connections 2023-07-14T12:50:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.751+0000 7fb93381d700 1 --2- 172.21.15.17:0/783560814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c074a40 0x7fb92c074e10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.751+0000 7fb93381d700 1 -- 172.21.15.17:0/783560814 >> 172.21.15.17:0/783560814 conn(0x7fb92c0fd330 msgr2=0x7fb92c0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:31.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.751+0000 7fb93381d700 1 -- 172.21.15.17:0/783560814 shutdown_connections 2023-07-14T12:50:31.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.752+0000 7fb93381d700 1 -- 172.21.15.17:0/783560814 wait complete. 2023-07-14T12:50:31.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.752+0000 7fb93381d700 1 Processor -- start 2023-07-14T12:50:31.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.753+0000 7fb93381d700 1 -- start start 2023-07-14T12:50:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.753+0000 7fb93381d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c074a40 0x7fb92c19b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.753+0000 7fb93381d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c19b540 con 0x7fb92c074a40 2023-07-14T12:50:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.753+0000 7fb9315b9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c074a40 0x7fb92c19b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.753+0000 7fb9315b9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c074a40 0x7fb92c19b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50432/0 (socket says 172.21.15.17:50432) 2023-07-14T12:50:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.753+0000 7fb9315b9700 1 -- 172.21.15.17:0/2265716667 learned_addr learned my addr 172.21.15.17:0/2265716667 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.754+0000 7fb9315b9700 1 -- 172.21.15.17:0/2265716667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280095f0 con 0x7fb92c074a40 2023-07-14T12:50:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.754+0000 7fb9315b9700 1 --2- 172.21.15.17:0/2265716667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c074a40 0x7fb92c19b000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb928006010 tx=0x7fb928004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.754+0000 7fb9227fc700 1 -- 172.21.15.17:0/2265716667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb92801d070 con 0x7fb92c074a40 2023-07-14T12:50:31.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.754+0000 7fb93381d700 1 -- 172.21.15.17:0/2265716667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92c19b740 con 0x7fb92c074a40 2023-07-14T12:50:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.754+0000 7fb9227fc700 1 -- 172.21.15.17:0/2265716667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb92800bdf0 con 0x7fb92c074a40 2023-07-14T12:50:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.754+0000 7fb9227fc700 1 -- 172.21.15.17:0/2265716667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb928022d80 con 0x7fb92c074a40 2023-07-14T12:50:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.754+0000 7fb93381d700 1 -- 172.21.15.17:0/2265716667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92c19bb60 con 0x7fb92c074a40 2023-07-14T12:50:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.755+0000 7fb9227fc700 1 -- 172.21.15.17:0/2265716667 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fb928022570 con 0x7fb92c074a40 2023-07-14T12:50:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.755+0000 7fb93381d700 1 -- 172.21.15.17:0/2265716667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92c061b40 con 0x7fb92c074a40 2023-07-14T12:50:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.756+0000 7fb9227fc700 1 --2- 172.21.15.17:0/2265716667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb9180387b0 0x7fb91803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.756+0000 7fb9227fc700 1 -- 172.21.15.17:0/2265716667 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb92804c960 con 0x7fb92c074a40 2023-07-14T12:50:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.756+0000 7fb930db8700 1 --2- 172.21.15.17:0/2265716667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb9180387b0 0x7fb91803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.757+0000 7fb930db8700 1 --2- 172.21.15.17:0/2265716667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb9180387b0 0x7fb91803ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb91c006fd0 tx=0x7fb91c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.761+0000 7fb9227fc700 1 -- 172.21.15.17:0/2265716667 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb92802bba0 con 0x7fb92c074a40 2023-07-14T12:50:31.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:31 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:31.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:31 smithi017 ceph-mon[95536]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:31.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.976+0000 7fb93381d700 1 -- 172.21.15.17:0/2265716667 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb92c10d1a0 con 0x7fb9180387b0 2023-07-14T12:50:31.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.977+0000 7fb9227fc700 1 -- 172.21.15.17:0/2265716667 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fb92c10d1a0 con 0x7fb9180387b0 2023-07-14T12:50:31.998 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:31.999 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.131", "hostname": "smithi131", "labels": [], "status": ""}] 2023-07-14T12:50:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.980+0000 7fb93381d700 1 -- 172.21.15.17:0/2265716667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb9180387b0 msgr2=0x7fb91803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.980+0000 7fb93381d700 1 --2- 172.21.15.17:0/2265716667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb9180387b0 0x7fb91803ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb91c006fd0 tx=0x7fb91c006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.980+0000 7fb93381d700 1 -- 172.21.15.17:0/2265716667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c074a40 msgr2=0x7fb92c19b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.980+0000 7fb93381d700 1 --2- 172.21.15.17:0/2265716667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c074a40 0x7fb92c19b000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb928006010 tx=0x7fb928004ff0 comp rx=0 tx=0).stop 2023-07-14T12:50:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.980+0000 7fb93381d700 1 -- 172.21.15.17:0/2265716667 shutdown_connections 2023-07-14T12:50:32.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.980+0000 7fb93381d700 1 --2- 172.21.15.17:0/2265716667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb9180387b0 0x7fb91803ac60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:32.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.980+0000 7fb93381d700 1 --2- 172.21.15.17:0/2265716667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb92c074a40 0x7fb92c19b000 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:32.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.980+0000 7fb93381d700 1 -- 172.21.15.17:0/2265716667 >> 172.21.15.17:0/2265716667 conn(0x7fb92c0fd330 msgr2=0x7fb92c0fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:32.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.980+0000 7fb93381d700 1 -- 172.21.15.17:0/2265716667 shutdown_connections 2023-07-14T12:50:32.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:31.980+0000 7fb93381d700 1 -- 172.21.15.17:0/2265716667 wait complete. 2023-07-14T12:50:32.497 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi135 2023-07-14T12:50:32.497 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-07-14T12:50:32.498 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.conf 2023-07-14T12:50:32.545 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-07-14T12:50:32.545 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:50:32.629 INFO:tasks.cephadm:Adding host smithi135 to orchestrator... 2023-07-14T12:50:32.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch host add smithi135 2023-07-14T12:50:33.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:33.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:32 smithi017 ceph-mon[95536]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:50:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:50:33.931 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:33 smithi017 ceph-mon[95536]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:34.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.888+0000 7f50435fd700 1 -- 172.21.15.17:0/4162406672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c105630 msgr2=0x7f503c105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:34.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.888+0000 7f50435fd700 1 --2- 172.21.15.17:0/4162406672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c105630 0x7f503c105a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5038009910 tx=0x7f5038009c20 comp rx=0 tx=0).stop 2023-07-14T12:50:34.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.888+0000 7f50435fd700 1 -- 172.21.15.17:0/4162406672 shutdown_connections 2023-07-14T12:50:34.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.888+0000 7f50435fd700 1 --2- 172.21.15.17:0/4162406672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c105630 0x7f503c105a00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:34.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.888+0000 7f50435fd700 1 -- 172.21.15.17:0/4162406672 >> 172.21.15.17:0/4162406672 conn(0x7f503c0fb130 msgr2=0x7f503c0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:34.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.888+0000 7f50435fd700 1 -- 172.21.15.17:0/4162406672 shutdown_connections 2023-07-14T12:50:34.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.888+0000 7f50435fd700 1 -- 172.21.15.17:0/4162406672 wait complete. 2023-07-14T12:50:34.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.889+0000 7f50435fd700 1 Processor -- start 2023-07-14T12:50:34.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.889+0000 7f50435fd700 1 -- start start 2023-07-14T12:50:34.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.890+0000 7f50435fd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c105630 0x7f503c19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.890+0000 7f50435fd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c19cda0 con 0x7f503c105630 2023-07-14T12:50:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.890+0000 7f5041399700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c105630 0x7f503c19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.890+0000 7f5041399700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c105630 0x7f503c19c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55494/0 (socket says 172.21.15.17:55494) 2023-07-14T12:50:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.890+0000 7f5041399700 1 -- 172.21.15.17:0/3132047805 learned_addr learned my addr 172.21.15.17:0/3132047805 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.890+0000 7f5041399700 1 -- 172.21.15.17:0/3132047805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50380095f0 con 0x7f503c105630 2023-07-14T12:50:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.891+0000 7f5041399700 1 --2- 172.21.15.17:0/3132047805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c105630 0x7f503c19c860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5038006010 tx=0x7f5038004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.891+0000 7f50327fc700 1 -- 172.21.15.17:0/3132047805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f503801d070 con 0x7f503c105630 2023-07-14T12:50:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.891+0000 7f50327fc700 1 -- 172.21.15.17:0/3132047805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f503800bdf0 con 0x7f503c105630 2023-07-14T12:50:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.891+0000 7f50327fc700 1 -- 172.21.15.17:0/3132047805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5038022d80 con 0x7f503c105630 2023-07-14T12:50:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.891+0000 7f50435fd700 1 -- 172.21.15.17:0/3132047805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503c19d000 con 0x7f503c105630 2023-07-14T12:50:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.891+0000 7f50435fd700 1 -- 172.21.15.17:0/3132047805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c1968e0 con 0x7f503c105630 2023-07-14T12:50:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.892+0000 7f50327fc700 1 -- 172.21.15.17:0/3132047805 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f5038022570 con 0x7f503c105630 2023-07-14T12:50:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.892+0000 7f50435fd700 1 -- 172.21.15.17:0/3132047805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503c061b40 con 0x7f503c105630 2023-07-14T12:50:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.893+0000 7f50327fc700 1 --2- 172.21.15.17:0/3132047805 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5028038800 0x7f502803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.893+0000 7f50327fc700 1 -- 172.21.15.17:0/3132047805 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f503804c8a0 con 0x7f503c105630 2023-07-14T12:50:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.893+0000 7f5040b98700 1 --2- 172.21.15.17:0/3132047805 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5028038800 0x7f502803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.894+0000 7f5040b98700 1 --2- 172.21.15.17:0/3132047805 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5028038800 0x7f502803acb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f502c006fd0 tx=0x7f502c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:34.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:34.898+0000 7f50327fc700 1 -- 172.21.15.17:0/3132047805 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f503802b590 con 0x7f503c105630 2023-07-14T12:50:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:35.109+0000 7f50435fd700 1 -- 172.21.15.17:0/3132047805 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}) v1 -- 0x7f503c072e50 con 0x7f5028038800 2023-07-14T12:50:36.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:35 smithi017 ceph-mon[95536]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:36.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:36.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:36.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:36.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:36.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:50:36.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:50:36.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:50:37.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:36 smithi017 ceph-mon[95536]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:50:37.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:36 smithi017 ceph-mon[95536]: Updating smithi131:/etc/ceph/ceph.conf 2023-07-14T12:50:37.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:36 smithi017 ceph-mon[95536]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:50:37.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:36 smithi017 ceph-mon[95536]: Deploying cephadm binary to smithi135 2023-07-14T12:50:38.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:38.262+0000 7f50327fc700 1 -- 172.21.15.17:0/3132047805 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f503c072e50 con 0x7f5028038800 2023-07-14T12:50:38.284 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi135' with addr '172.21.15.135' 2023-07-14T12:50:38.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:38.264+0000 7f50435fd700 1 -- 172.21.15.17:0/3132047805 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5028038800 msgr2=0x7f502803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:38.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:38.264+0000 7f50435fd700 1 --2- 172.21.15.17:0/3132047805 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5028038800 0x7f502803acb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f502c006fd0 tx=0x7f502c006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:38.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:38.265+0000 7f50435fd700 1 -- 172.21.15.17:0/3132047805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c105630 msgr2=0x7f503c19c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:38.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:38.265+0000 7f50435fd700 1 --2- 172.21.15.17:0/3132047805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c105630 0x7f503c19c860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5038006010 tx=0x7f5038004ff0 comp rx=0 tx=0).stop 2023-07-14T12:50:38.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:38.265+0000 7f50435fd700 1 -- 172.21.15.17:0/3132047805 shutdown_connections 2023-07-14T12:50:38.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:38.265+0000 7f50435fd700 1 --2- 172.21.15.17:0/3132047805 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5028038800 0x7f502803acb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:38.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:38.265+0000 7f50435fd700 1 --2- 172.21.15.17:0/3132047805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f503c105630 0x7f503c19c860 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:38.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:38.265+0000 7f50435fd700 1 -- 172.21.15.17:0/3132047805 >> 172.21.15.17:0/3132047805 conn(0x7f503c0fb130 msgr2=0x7f503c072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:38.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:38.265+0000 7f50435fd700 1 -- 172.21.15.17:0/3132047805 shutdown_connections 2023-07-14T12:50:38.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:38.265+0000 7f50435fd700 1 -- 172.21.15.17:0/3132047805 wait complete. 2023-07-14T12:50:38.308 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:37 smithi017 ceph-mon[95536]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:50:38.308 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:37 smithi017 ceph-mon[95536]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:38.308 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:37 smithi017 ceph-mon[95536]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:50:38.846 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch host ls --format=json 2023-07-14T12:50:39.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:39.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:39.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:39.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:39.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:50:39.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:39.580 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:50:40.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:39 smithi017 ceph-mon[95536]: Added host smithi135 2023-07-14T12:50:40.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:39 smithi017 ceph-mon[95536]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:40.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:39 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.100+0000 7efcdbbf2700 1 -- 172.21.15.17:0/3172994936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcd4105630 msgr2=0x7efcd4105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.100+0000 7efcdbbf2700 1 --2- 172.21.15.17:0/3172994936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcd4105630 0x7efcd4105a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009910 tx=0x7efcd0009c20 comp rx=0 tx=0).stop 2023-07-14T12:50:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.100+0000 7efcdbbf2700 1 -- 172.21.15.17:0/3172994936 shutdown_connections 2023-07-14T12:50:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.100+0000 7efcdbbf2700 1 --2- 172.21.15.17:0/3172994936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcd4105630 0x7efcd4105a00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.100+0000 7efcdbbf2700 1 -- 172.21.15.17:0/3172994936 >> 172.21.15.17:0/3172994936 conn(0x7efcd40fb130 msgr2=0x7efcd40fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.100+0000 7efcdbbf2700 1 -- 172.21.15.17:0/3172994936 shutdown_connections 2023-07-14T12:50:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.100+0000 7efcdbbf2700 1 -- 172.21.15.17:0/3172994936 wait complete. 2023-07-14T12:50:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.101+0000 7efcdbbf2700 1 Processor -- start 2023-07-14T12:50:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.101+0000 7efcdbbf2700 1 -- start start 2023-07-14T12:50:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.102+0000 7efcdbbf2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcd4105630 0x7efcd419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.102+0000 7efcdbbf2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd419cda0 con 0x7efcd4105630 2023-07-14T12:50:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.102+0000 7efcd998e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcd4105630 0x7efcd419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.102+0000 7efcd998e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcd4105630 0x7efcd419c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55506/0 (socket says 172.21.15.17:55506) 2023-07-14T12:50:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.102+0000 7efcd998e700 1 -- 172.21.15.17:0/1873088857 learned_addr learned my addr 172.21.15.17:0/1873088857 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.102+0000 7efcd998e700 1 -- 172.21.15.17:0/1873088857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd00095f0 con 0x7efcd4105630 2023-07-14T12:50:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.103+0000 7efcd998e700 1 --2- 172.21.15.17:0/1873088857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcd4105630 0x7efcd419c860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efcd0004f40 tx=0x7efcd0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.103+0000 7efccaffd700 1 -- 172.21.15.17:0/1873088857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcd001d070 con 0x7efcd4105630 2023-07-14T12:50:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.103+0000 7efccaffd700 1 -- 172.21.15.17:0/1873088857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efcd00044b0 con 0x7efcd4105630 2023-07-14T12:50:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.103+0000 7efccaffd700 1 -- 172.21.15.17:0/1873088857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcd0003810 con 0x7efcd4105630 2023-07-14T12:50:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.103+0000 7efcdbbf2700 1 -- 172.21.15.17:0/1873088857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd419d000 con 0x7efcd4105630 2023-07-14T12:50:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.103+0000 7efcdbbf2700 1 -- 172.21.15.17:0/1873088857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd41968e0 con 0x7efcd4105630 2023-07-14T12:50:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.104+0000 7efccaffd700 1 -- 172.21.15.17:0/1873088857 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7efcd0003a40 con 0x7efcd4105630 2023-07-14T12:50:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.104+0000 7efcdbbf2700 1 -- 172.21.15.17:0/1873088857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd4061b40 con 0x7efcd4105630 2023-07-14T12:50:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.105+0000 7efccaffd700 1 --2- 172.21.15.17:0/1873088857 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efcc00387f0 0x7efcc003aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.105+0000 7efccaffd700 1 -- 172.21.15.17:0/1873088857 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efcd004c6c0 con 0x7efcd4105630 2023-07-14T12:50:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.105+0000 7efcd918d700 1 --2- 172.21.15.17:0/1873088857 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efcc00387f0 0x7efcc003aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.106+0000 7efcd918d700 1 --2- 172.21.15.17:0/1873088857 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efcc00387f0 0x7efcc003aca0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efcc4006fd0 tx=0x7efcc4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:41.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.110+0000 7efccaffd700 1 -- 172.21.15.17:0/1873088857 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7efcd002a540 con 0x7efcd4105630 2023-07-14T12:50:41.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.320+0000 7efcdbbf2700 1 -- 172.21.15.17:0/1873088857 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efcd4072e50 con 0x7efcc00387f0 2023-07-14T12:50:41.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.321+0000 7efccaffd700 1 -- 172.21.15.17:0/1873088857 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7efcd4072e50 con 0x7efcc00387f0 2023-07-14T12:50:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:50:41.342 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.131", "hostname": "smithi131", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}] 2023-07-14T12:50:41.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.323+0000 7efcdbbf2700 1 -- 172.21.15.17:0/1873088857 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efcc00387f0 msgr2=0x7efcc003aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:41.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.323+0000 7efcdbbf2700 1 --2- 172.21.15.17:0/1873088857 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efcc00387f0 0x7efcc003aca0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efcc4006fd0 tx=0x7efcc4006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:41.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.323+0000 7efcdbbf2700 1 -- 172.21.15.17:0/1873088857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcd4105630 msgr2=0x7efcd419c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:41.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.323+0000 7efcdbbf2700 1 --2- 172.21.15.17:0/1873088857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcd4105630 0x7efcd419c860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efcd0004f40 tx=0x7efcd0005020 comp rx=0 tx=0).stop 2023-07-14T12:50:41.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.323+0000 7efcdbbf2700 1 -- 172.21.15.17:0/1873088857 shutdown_connections 2023-07-14T12:50:41.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.323+0000 7efcdbbf2700 1 --2- 172.21.15.17:0/1873088857 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efcc00387f0 0x7efcc003aca0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:41.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.323+0000 7efcdbbf2700 1 --2- 172.21.15.17:0/1873088857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efcd4105630 0x7efcd419c860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:41.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.323+0000 7efcdbbf2700 1 -- 172.21.15.17:0/1873088857 >> 172.21.15.17:0/1873088857 conn(0x7efcd40fb130 msgr2=0x7efcd4072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:41.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.324+0000 7efcdbbf2700 1 -- 172.21.15.17:0/1873088857 shutdown_connections 2023-07-14T12:50:41.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:41.324+0000 7efcdbbf2700 1 -- 172.21.15.17:0/1873088857 wait complete. 2023-07-14T12:50:41.854 INFO:tasks.cephadm:Setting crush tunables to default 2023-07-14T12:50:41.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd crush tunables default 2023-07-14T12:50:42.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:41 smithi017 ceph-mon[95536]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:42.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:41 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:42.582 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:50:43.205 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:42 smithi017 ceph-mon[95536]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:50:44.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.075+0000 7f7adce55700 1 -- 172.21.15.17:0/1459147563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ad8105650 msgr2=0x7f7ad8105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:44.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.075+0000 7f7adce55700 1 --2- 172.21.15.17:0/1459147563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ad8105650 0x7f7ad8105a20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009910 tx=0x7f7ac8009c20 comp rx=0 tx=0).stop 2023-07-14T12:50:44.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.075+0000 7f7adce55700 1 -- 172.21.15.17:0/1459147563 shutdown_connections 2023-07-14T12:50:44.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.075+0000 7f7adce55700 1 --2- 172.21.15.17:0/1459147563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ad8105650 0x7f7ad8105a20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:44.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.075+0000 7f7adce55700 1 -- 172.21.15.17:0/1459147563 >> 172.21.15.17:0/1459147563 conn(0x7f7ad80fb130 msgr2=0x7f7ad80fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:44.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.075+0000 7f7adce55700 1 -- 172.21.15.17:0/1459147563 shutdown_connections 2023-07-14T12:50:44.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.075+0000 7f7adce55700 1 -- 172.21.15.17:0/1459147563 wait complete. 2023-07-14T12:50:44.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:43 smithi017 ceph-mon[95536]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:44.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.077+0000 7f7adce55700 1 Processor -- start 2023-07-14T12:50:44.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.077+0000 7f7adce55700 1 -- start start 2023-07-14T12:50:44.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.077+0000 7f7adce55700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ad8105650 0x7f7ad819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:44.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.077+0000 7f7adce55700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad819cea0 con 0x7f7ad8105650 2023-07-14T12:50:44.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.077+0000 7f7ad659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ad8105650 0x7f7ad819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:44.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.077+0000 7f7ad659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ad8105650 0x7f7ad819c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55520/0 (socket says 172.21.15.17:55520) 2023-07-14T12:50:44.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.077+0000 7f7ad659c700 1 -- 172.21.15.17:0/389715228 learned_addr learned my addr 172.21.15.17:0/389715228 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:50:44.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.078+0000 7f7ad659c700 1 -- 172.21.15.17:0/389715228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac80095f0 con 0x7f7ad8105650 2023-07-14T12:50:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.078+0000 7f7ad659c700 1 --2- 172.21.15.17:0/389715228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ad8105650 0x7f7ad819c960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8006010 tx=0x7f7ac8004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.078+0000 7f7ac77fe700 1 -- 172.21.15.17:0/389715228 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ac801d070 con 0x7f7ad8105650 2023-07-14T12:50:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.078+0000 7f7ac77fe700 1 -- 172.21.15.17:0/389715228 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ac800bdf0 con 0x7f7ad8105650 2023-07-14T12:50:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.078+0000 7f7ac77fe700 1 -- 172.21.15.17:0/389715228 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ac8022d80 con 0x7f7ad8105650 2023-07-14T12:50:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.078+0000 7f7adce55700 1 -- 172.21.15.17:0/389715228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad819d100 con 0x7f7ad8105650 2023-07-14T12:50:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.078+0000 7f7adce55700 1 -- 172.21.15.17:0/389715228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad8196950 con 0x7f7ad8105650 2023-07-14T12:50:44.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.079+0000 7f7ac77fe700 1 -- 172.21.15.17:0/389715228 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f7ac8022570 con 0x7f7ad8105650 2023-07-14T12:50:44.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.079+0000 7f7adce55700 1 -- 172.21.15.17:0/389715228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad8061b40 con 0x7f7ad8105650 2023-07-14T12:50:44.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.080+0000 7f7ac77fe700 1 --2- 172.21.15.17:0/389715228 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ac0038800 0x7f7ac003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.080+0000 7f7ac77fe700 1 -- 172.21.15.17:0/389715228 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7ac804c960 con 0x7f7ad8105650 2023-07-14T12:50:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.080+0000 7f7ad5d9b700 1 --2- 172.21.15.17:0/389715228 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ac0038800 0x7f7ac003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.081+0000 7f7ad5d9b700 1 --2- 172.21.15.17:0/389715228 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ac0038800 0x7f7ac003acb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7acc006fd0 tx=0x7f7acc006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:44.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.085+0000 7f7ac77fe700 1 -- 172.21.15.17:0/389715228 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7ac802b590 con 0x7f7ad8105650 2023-07-14T12:50:44.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:44.298+0000 7f7adce55700 1 -- 172.21.15.17:0/389715228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7ad8197410 con 0x7f7ad8105650 2023-07-14T12:50:45.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:45.264+0000 7f7ac77fe700 1 -- 172.21.15.17:0/389715228 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7ac8027070 con 0x7f7ad8105650 2023-07-14T12:50:45.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:45.267+0000 7f7adce55700 1 -- 172.21.15.17:0/389715228 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ac0038800 msgr2=0x7f7ac003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:45.267+0000 7f7adce55700 1 --2- 172.21.15.17:0/389715228 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ac0038800 0x7f7ac003acb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7acc006fd0 tx=0x7f7acc006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:45.267+0000 7f7adce55700 1 -- 172.21.15.17:0/389715228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ad8105650 msgr2=0x7f7ad819c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:45.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:45.267+0000 7f7adce55700 1 --2- 172.21.15.17:0/389715228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ad8105650 0x7f7ad819c960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8006010 tx=0x7f7ac8004ff0 comp rx=0 tx=0).stop 2023-07-14T12:50:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:45.267+0000 7f7adce55700 1 -- 172.21.15.17:0/389715228 shutdown_connections 2023-07-14T12:50:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:45.267+0000 7f7adce55700 1 --2- 172.21.15.17:0/389715228 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ac0038800 0x7f7ac003acb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:45.267+0000 7f7adce55700 1 --2- 172.21.15.17:0/389715228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ad8105650 0x7f7ad819c960 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:45.267+0000 7f7adce55700 1 -- 172.21.15.17:0/389715228 >> 172.21.15.17:0/389715228 conn(0x7f7ad80fb130 msgr2=0x7f7ad80fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:45.267+0000 7f7adce55700 1 -- 172.21.15.17:0/389715228 shutdown_connections 2023-07-14T12:50:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:50:45.267+0000 7f7adce55700 1 -- 172.21.15.17:0/389715228 wait complete. 2023-07-14T12:50:45.291 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2023-07-14T12:50:45.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:45 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:45.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:45 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:45.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:45 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:45.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:45 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:45.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:45 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:50:45.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:45 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:50:45.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:45 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:50:45.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:45 smithi017 ceph-mon[95536]: Updating smithi135:/etc/ceph/ceph.conf 2023-07-14T12:50:45.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:45 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/389715228' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-14T12:50:45.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:45 smithi017 ceph-mon[95536]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:45.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:45 smithi017 ceph-mon[95536]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:50:45.760 INFO:tasks.cephadm:Adding mon.a on smithi017 2023-07-14T12:50:45.760 INFO:tasks.cephadm:Adding mon.b on smithi131 2023-07-14T12:50:45.760 INFO:tasks.cephadm:Adding mon.c on smithi135 2023-07-14T12:50:45.761 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch apply mon '3;smithi017:172.21.15.17=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c' 2023-07-14T12:50:46.394 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:50:46.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:46 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/389715228' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-14T12:50:46.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:46 smithi017 ceph-mon[95536]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T12:50:46.597 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:46 smithi017 ceph-mon[95536]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:50:46.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:46 smithi017 ceph-mon[95536]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:50:47.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.751+0000 7fb301981700 1 -- 172.21.15.135:0/2542906292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc105630 msgr2=0x7fb2fc105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:47.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.751+0000 7fb301981700 1 --2- 172.21.15.135:0/2542906292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc105630 0x7fb2fc105a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009910 tx=0x7fb2ec009c20 comp rx=0 tx=0).stop 2023-07-14T12:50:47.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.751+0000 7fb301981700 1 -- 172.21.15.135:0/2542906292 shutdown_connections 2023-07-14T12:50:47.773 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.751+0000 7fb301981700 1 --2- 172.21.15.135:0/2542906292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc105630 0x7fb2fc105a00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:47.774 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.751+0000 7fb301981700 1 -- 172.21.15.135:0/2542906292 >> 172.21.15.135:0/2542906292 conn(0x7fb2fc0fb130 msgr2=0x7fb2fc0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:47.774 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.751+0000 7fb301981700 1 -- 172.21.15.135:0/2542906292 shutdown_connections 2023-07-14T12:50:47.774 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.751+0000 7fb301981700 1 -- 172.21.15.135:0/2542906292 wait complete. 2023-07-14T12:50:47.775 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.752+0000 7fb301981700 1 Processor -- start 2023-07-14T12:50:47.775 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.752+0000 7fb301981700 1 -- start start 2023-07-14T12:50:47.775 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.753+0000 7fb301981700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc105630 0x7fb2fc19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:47.775 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.753+0000 7fb301981700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc19cda0 con 0x7fb2fc105630 2023-07-14T12:50:47.775 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.753+0000 7fb2faffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc105630 0x7fb2fc19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:47.776 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.753+0000 7fb2faffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc105630 0x7fb2fc19c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.135:48988/0 (socket says 172.21.15.135:48988) 2023-07-14T12:50:47.776 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.753+0000 7fb2faffd700 1 -- 172.21.15.135:0/1598495371 learned_addr learned my addr 172.21.15.135:0/1598495371 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-07-14T12:50:47.776 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.754+0000 7fb2faffd700 1 -- 172.21.15.135:0/1598495371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0095f0 con 0x7fb2fc105630 2023-07-14T12:50:47.776 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.754+0000 7fb2faffd700 1 --2- 172.21.15.135:0/1598495371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc105630 0x7fb2fc19c860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec006010 tx=0x7fb2ec004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:47.777 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.754+0000 7fb30097f700 1 -- 172.21.15.135:0/1598495371 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2ec01d070 con 0x7fb2fc105630 2023-07-14T12:50:47.778 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.754+0000 7fb30097f700 1 -- 172.21.15.135:0/1598495371 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2ec00bdf0 con 0x7fb2fc105630 2023-07-14T12:50:47.778 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.754+0000 7fb301981700 1 -- 172.21.15.135:0/1598495371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc19d000 con 0x7fb2fc105630 2023-07-14T12:50:47.778 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.754+0000 7fb30097f700 1 -- 172.21.15.135:0/1598495371 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2ec022d80 con 0x7fb2fc105630 2023-07-14T12:50:47.778 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.754+0000 7fb301981700 1 -- 172.21.15.135:0/1598495371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc1968e0 con 0x7fb2fc105630 2023-07-14T12:50:47.778 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.755+0000 7fb301981700 1 -- 172.21.15.135:0/1598495371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc061b40 con 0x7fb2fc105630 2023-07-14T12:50:47.778 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.755+0000 7fb30097f700 1 -- 172.21.15.135:0/1598495371 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7fb2ec022570 con 0x7fb2fc105630 2023-07-14T12:50:47.778 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.756+0000 7fb30097f700 1 --2- 172.21.15.135:0/1598495371 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb2e40387b0 0x7fb2e403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:47.778 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.756+0000 7fb30097f700 1 -- 172.21.15.135:0/1598495371 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb2ec04c960 con 0x7fb2fc105630 2023-07-14T12:50:47.779 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.756+0000 7fb2fa7fc700 1 --2- 172.21.15.135:0/1598495371 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb2e40387b0 0x7fb2e403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:47.779 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.757+0000 7fb2fa7fc700 1 --2- 172.21.15.135:0/1598495371 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb2e40387b0 0x7fb2e403ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0006fd0 tx=0x7fb2f0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.761+0000 7fb30097f700 1 -- 172.21.15.135:0/1598495371 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb2ec02bba0 con 0x7fb2fc105630 2023-07-14T12:50:47.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:47.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:47.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:47.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:47 smithi017 ceph-mon[95536]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:47.985 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.964+0000 7fb301981700 1 -- 172.21.15.135:0/1598495371 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2fc072f10 con 0x7fb2e40387b0 2023-07-14T12:50:47.993 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.972+0000 7fb30097f700 1 -- 172.21.15.135:0/1598495371 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb2fc072f10 con 0x7fb2e40387b0 2023-07-14T12:50:47.993 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mon update... 2023-07-14T12:50:47.995 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.974+0000 7fb301981700 1 -- 172.21.15.135:0/1598495371 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb2e40387b0 msgr2=0x7fb2e403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:47.996 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.974+0000 7fb301981700 1 --2- 172.21.15.135:0/1598495371 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb2e40387b0 0x7fb2e403ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0006fd0 tx=0x7fb2f0006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:47.996 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.974+0000 7fb301981700 1 -- 172.21.15.135:0/1598495371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc105630 msgr2=0x7fb2fc19c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:47.996 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.974+0000 7fb301981700 1 --2- 172.21.15.135:0/1598495371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc105630 0x7fb2fc19c860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec006010 tx=0x7fb2ec004ff0 comp rx=0 tx=0).stop 2023-07-14T12:50:47.996 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.974+0000 7fb301981700 1 -- 172.21.15.135:0/1598495371 shutdown_connections 2023-07-14T12:50:47.996 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.974+0000 7fb301981700 1 --2- 172.21.15.135:0/1598495371 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb2e40387b0 0x7fb2e403ac60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:47.997 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.974+0000 7fb301981700 1 --2- 172.21.15.135:0/1598495371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc105630 0x7fb2fc19c860 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:47.997 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.974+0000 7fb301981700 1 -- 172.21.15.135:0/1598495371 >> 172.21.15.135:0/1598495371 conn(0x7fb2fc0fb130 msgr2=0x7fb2fc072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:47.997 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.974+0000 7fb301981700 1 -- 172.21.15.135:0/1598495371 shutdown_connections 2023-07-14T12:50:47.997 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:47.974+0000 7fb301981700 1 -- 172.21.15.135:0/1598495371 wait complete. 2023-07-14T12:50:48.464 DEBUG:teuthology.orchestra.run.smithi131:mon.b> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.b.service 2023-07-14T12:50:48.469 DEBUG:teuthology.orchestra.run.smithi135:mon.c> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.c.service 2023-07-14T12:50:48.474 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-07-14T12:50:48.474 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph mon dump -f json 2023-07-14T12:50:48.545 INFO:journalctl@ceph.mon.c.smithi135.stdout:-- Logs begin at Fri 2023-07-14 12:26:36 UTC. -- 2023-07-14T12:50:48.546 INFO:journalctl@ceph.mon.b.smithi131.stdout:-- Logs begin at Fri 2023-07-14 12:26:41 UTC. -- 2023-07-14T12:50:49.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:48 smithi017 ceph-mon[95536]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:50:49.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:48 smithi017 ceph-mon[95536]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c;count:3 2023-07-14T12:50:49.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:48 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:49.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:48 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:50:49.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:48 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:50:49.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:48 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:50:49.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:48 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:49.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:48 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:50:49.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:48 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:50:49.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:48 smithi017 ceph-mon[95536]: Deploying daemon mon.c on smithi135 2023-07-14T12:50:49.576 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:50:50.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:50 smithi017 ceph-mon[95536]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:51.863 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.841+0000 7f136c37f700 1 -- 172.21.15.135:0/1552447657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13640728b0 msgr2=0x7f1364072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:51.864 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.841+0000 7f136c37f700 1 --2- 172.21.15.135:0/1552447657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13640728b0 0x7f1364072c80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1360009910 tx=0x7f1360009c20 comp rx=0 tx=0).stop 2023-07-14T12:50:51.864 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.841+0000 7f136c37f700 1 -- 172.21.15.135:0/1552447657 shutdown_connections 2023-07-14T12:50:51.864 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.841+0000 7f136c37f700 1 --2- 172.21.15.135:0/1552447657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13640728b0 0x7f1364072c80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:51.864 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.841+0000 7f136c37f700 1 -- 172.21.15.135:0/1552447657 >> 172.21.15.135:0/1552447657 conn(0x7f13640fb130 msgr2=0x7f13640fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:51.864 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.841+0000 7f136c37f700 1 -- 172.21.15.135:0/1552447657 shutdown_connections 2023-07-14T12:50:51.864 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.841+0000 7f136c37f700 1 -- 172.21.15.135:0/1552447657 wait complete. 2023-07-14T12:50:51.865 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.842+0000 7f136c37f700 1 Processor -- start 2023-07-14T12:50:51.865 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.843+0000 7f136c37f700 1 -- start start 2023-07-14T12:50:51.866 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.843+0000 7f136c37f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13640728b0 0x7f136419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:51.866 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.843+0000 7f136c37f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136419ce90 con 0x7f13640728b0 2023-07-14T12:50:51.866 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.843+0000 7f136a11b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13640728b0 0x7f136419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:51.866 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.843+0000 7f136a11b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13640728b0 0x7f136419c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.135:49000/0 (socket says 172.21.15.135:49000) 2023-07-14T12:50:51.866 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.843+0000 7f136a11b700 1 -- 172.21.15.135:0/2797750532 learned_addr learned my addr 172.21.15.135:0/2797750532 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-07-14T12:50:51.866 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.844+0000 7f136a11b700 1 -- 172.21.15.135:0/2797750532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600095f0 con 0x7f13640728b0 2023-07-14T12:50:51.866 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.844+0000 7f136a11b700 1 --2- 172.21.15.135:0/2797750532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13640728b0 0x7f136419c950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1360006010 tx=0x7f1360004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:51.867 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.844+0000 7f135b7fe700 1 -- 172.21.15.135:0/2797750532 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f136001d070 con 0x7f13640728b0 2023-07-14T12:50:51.867 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.844+0000 7f136c37f700 1 -- 172.21.15.135:0/2797750532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136419d090 con 0x7f13640728b0 2023-07-14T12:50:51.868 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.844+0000 7f135b7fe700 1 -- 172.21.15.135:0/2797750532 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f136000bdf0 con 0x7f13640728b0 2023-07-14T12:50:51.868 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.844+0000 7f135b7fe700 1 -- 172.21.15.135:0/2797750532 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1360022d80 con 0x7f13640728b0 2023-07-14T12:50:51.868 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.845+0000 7f136c37f700 1 -- 172.21.15.135:0/2797750532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136419d4b0 con 0x7f13640728b0 2023-07-14T12:50:51.868 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.846+0000 7f136c37f700 1 -- 172.21.15.135:0/2797750532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1364061b40 con 0x7f13640728b0 2023-07-14T12:50:51.868 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.846+0000 7f135b7fe700 1 -- 172.21.15.135:0/2797750532 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f1360022570 con 0x7f13640728b0 2023-07-14T12:50:51.869 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.846+0000 7f135b7fe700 1 --2- 172.21.15.135:0/2797750532 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1350038800 0x7f135003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:51.869 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.846+0000 7f135b7fe700 1 -- 172.21.15.135:0/2797750532 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f136004c8f0 con 0x7f13640728b0 2023-07-14T12:50:51.869 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.847+0000 7f136991a700 1 --2- 172.21.15.135:0/2797750532 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1350038800 0x7f135003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:51.869 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.847+0000 7f136991a700 1 --2- 172.21.15.135:0/2797750532 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1350038800 0x7f135003acb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1354006fd0 tx=0x7f1354006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:51.873 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:51.852+0000 7f135b7fe700 1 -- 172.21.15.135:0/2797750532 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f136002bb60 con 0x7f13640728b0 2023-07-14T12:50:52.173 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.152+0000 7f136c37f700 1 -- 172.21.15.135:0/2797750532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1364197ee0 con 0x7f13640728b0 2023-07-14T12:50:52.174 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.153+0000 7f135b7fe700 1 -- 172.21.15.135:0/2797750532 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f1360027020 con 0x7f13640728b0 2023-07-14T12:50:52.174 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:50:52.175 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","modified":"2023-07-14T12:48:59.289205Z","created":"2023-07-14T12:48:59.289205Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-07-14T12:50:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.155+0000 7f136c37f700 1 -- 172.21.15.135:0/2797750532 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1350038800 msgr2=0x7f135003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.155+0000 7f136c37f700 1 --2- 172.21.15.135:0/2797750532 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1350038800 0x7f135003acb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1354006fd0 tx=0x7f1354006e40 comp rx=0 tx=0).stop 2023-07-14T12:50:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.155+0000 7f136c37f700 1 -- 172.21.15.135:0/2797750532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13640728b0 msgr2=0x7f136419c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.156+0000 7f136c37f700 1 --2- 172.21.15.135:0/2797750532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13640728b0 0x7f136419c950 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1360006010 tx=0x7f1360004f40 comp rx=0 tx=0).stop 2023-07-14T12:50:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.156+0000 7f136c37f700 1 -- 172.21.15.135:0/2797750532 shutdown_connections 2023-07-14T12:50:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.156+0000 7f136c37f700 1 --2- 172.21.15.135:0/2797750532 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1350038800 0x7f135003acb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.156+0000 7f136c37f700 1 --2- 172.21.15.135:0/2797750532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13640728b0 0x7f136419c950 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.156+0000 7f136c37f700 1 -- 172.21.15.135:0/2797750532 >> 172.21.15.135:0/2797750532 conn(0x7f13640fb130 msgr2=0x7f1364106130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.156+0000 7f136c37f700 1 -- 172.21.15.135:0/2797750532 shutdown_connections 2023-07-14T12:50:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:52.156+0000 7f136c37f700 1 -- 172.21.15.135:0/2797750532 wait complete. 2023-07-14T12:50:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2023-07-14T12:50:52.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:52 smithi017 ceph-mon[95536]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:53.259 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.recycle_log_file_num: 0 2023-07-14T12:50:53.260 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.allow_fallocate: 1 2023-07-14T12:50:53.260 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.allow_mmap_reads: 0 2023-07-14T12:50:53.347 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:53 smithi017 ceph-mon[95536]: from='client.? 172.21.15.135:0/2797750532' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T12:50:53.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.allow_mmap_writes: 0 2023-07-14T12:50:53.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.use_direct_reads: 0 2023-07-14T12:50:53.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-14T12:50:53.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.create_missing_column_families: 0 2023-07-14T12:50:53.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.db_log_dir: 2023-07-14T12:50:53.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.wal_dir: 2023-07-14T12:50:53.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.table_cache_numshardbits: 6 2023-07-14T12:50:53.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.WAL_ttl_seconds: 0 2023-07-14T12:50:53.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.WAL_size_limit_MB: 0 2023-07-14T12:50:53.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-14T12:50:53.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-14T12:50:53.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.is_fd_close_on_exec: 1 2023-07-14T12:50:53.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.advise_random_on_open: 1 2023-07-14T12:50:53.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.db_write_buffer_size: 0 2023-07-14T12:50:53.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.write_buffer_manager: 0x55e20184a3c0 2023-07-14T12:50:53.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-14T12:50:53.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-14T12:50:53.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.use_adaptive_mutex: 0 2023-07-14T12:50:53.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.rate_limiter: (nil) 2023-07-14T12:50:53.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-14T12:50:53.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.wal_recovery_mode: 2 2023-07-14T12:50:53.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.enable_thread_tracking: 0 2023-07-14T12:50:53.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.enable_pipelined_write: 0 2023-07-14T12:50:53.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.unordered_write: 0 2023-07-14T12:50:53.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-14T12:50:53.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-14T12:50:53.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-14T12:50:53.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-14T12:50:53.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.row_cache: None 2023-07-14T12:50:53.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.wal_filter: None 2023-07-14T12:50:53.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-14T12:50:53.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.allow_ingest_behind: 0 2023-07-14T12:50:53.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.two_write_queues: 0 2023-07-14T12:50:53.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.manual_wal_flush: 0 2023-07-14T12:50:53.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.wal_compression: 0 2023-07-14T12:50:53.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.atomic_flush: 0 2023-07-14T12:50:53.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-14T12:50:53.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.persist_stats_to_disk: 0 2023-07-14T12:50:53.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.write_dbid_to_manifest: 0 2023-07-14T12:50:53.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.log_readahead_size: 0 2023-07-14T12:50:53.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-14T12:50:53.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.best_efforts_recovery: 0 2023-07-14T12:50:53.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-14T12:50:53.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-14T12:50:53.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.allow_data_in_errors: 0 2023-07-14T12:50:53.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.db_host_id: __hostname__ 2023-07-14T12:50:53.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.enforce_single_del_contracts: true 2023-07-14T12:50:53.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_background_jobs: 2 2023-07-14T12:50:53.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_background_compactions: -1 2023-07-14T12:50:53.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_subcompactions: 1 2023-07-14T12:50:53.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-14T12:50:53.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-14T12:50:53.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.delayed_write_rate : 16777216 2023-07-14T12:50:53.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_total_wal_size: 0 2023-07-14T12:50:53.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-14T12:50:53.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.stats_dump_period_sec: 600 2023-07-14T12:50:53.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.stats_persist_period_sec: 600 2023-07-14T12:50:53.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-14T12:50:53.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_open_files: -1 2023-07-14T12:50:53.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bytes_per_sync: 0 2023-07-14T12:50:53.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.wal_bytes_per_sync: 0 2023-07-14T12:50:53.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.strict_bytes_per_sync: 0 2023-07-14T12:50:53.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_readahead_size: 0 2023-07-14T12:50:53.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_background_flushes: -1 2023-07-14T12:50:53.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Compression algorithms supported: 2023-07-14T12:50:53.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-14T12:50:53.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: kZSTD supported: 0 2023-07-14T12:50:53.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: kXpressCompression supported: 0 2023-07-14T12:50:53.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: kLZ4HCCompression supported: 1 2023-07-14T12:50:53.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: kZlibCompression supported: 1 2023-07-14T12:50:53.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: kSnappyCompression supported: 1 2023-07-14T12:50:53.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: kLZ4Compression supported: 1 2023-07-14T12:50:53.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: kBZip2Compression supported: 0 2023-07-14T12:50:53.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Fast CRC32 supported: Supported on x86 2023-07-14T12:50:53.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: DMutex implementation: pthread_mutex_t 2023-07-14T12:50:53.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-07-14T12:50:53.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-14T12:50:53.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-14T12:50:53.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.merge_operator: 2023-07-14T12:50:53.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_filter: None 2023-07-14T12:50:53.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_filter_factory: None 2023-07-14T12:50:53.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.sst_partitioner_factory: None 2023-07-14T12:50:53.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.memtable_factory: SkipListFactory 2023-07-14T12:50:53.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.table_factory: BlockBasedTable 2023-07-14T12:50:53.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e201929380) 2023-07-14T12:50:53.705 INFO:journalctl@ceph.mon.c.smithi135.stdout: cache_index_and_filter_blocks: 1 2023-07-14T12:50:53.705 INFO:journalctl@ceph.mon.c.smithi135.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-14T12:50:53.706 INFO:journalctl@ceph.mon.c.smithi135.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-14T12:50:53.706 INFO:journalctl@ceph.mon.c.smithi135.stdout: pin_top_level_index_and_filter: 1 2023-07-14T12:50:53.706 INFO:journalctl@ceph.mon.c.smithi135.stdout: index_type: 0 2023-07-14T12:50:53.707 INFO:journalctl@ceph.mon.c.smithi135.stdout: data_block_index_type: 0 2023-07-14T12:50:53.707 INFO:journalctl@ceph.mon.c.smithi135.stdout: index_shortening: 1 2023-07-14T12:50:53.707 INFO:journalctl@ceph.mon.c.smithi135.stdout: data_block_hash_table_util_ratio: 0.750000 2023-07-14T12:50:53.707 INFO:journalctl@ceph.mon.c.smithi135.stdout: checksum: 4 2023-07-14T12:50:53.707 INFO:journalctl@ceph.mon.c.smithi135.stdout: no_block_cache: 0 2023-07-14T12:50:53.707 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_cache: 0x55e2018e91f0 2023-07-14T12:50:53.707 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_cache_name: BinnedLRUCache 2023-07-14T12:50:53.708 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_cache_options: 2023-07-14T12:50:53.708 INFO:journalctl@ceph.mon.c.smithi135.stdout: capacity : 536870912 2023-07-14T12:50:53.708 INFO:journalctl@ceph.mon.c.smithi135.stdout: num_shard_bits : 4 2023-07-14T12:50:53.708 INFO:journalctl@ceph.mon.c.smithi135.stdout: strict_capacity_limit : 0 2023-07-14T12:50:53.708 INFO:journalctl@ceph.mon.c.smithi135.stdout: high_pri_pool_ratio: 0.000 2023-07-14T12:50:53.708 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_cache_compressed: (nil) 2023-07-14T12:50:53.708 INFO:journalctl@ceph.mon.c.smithi135.stdout: persistent_cache: (nil) 2023-07-14T12:50:53.709 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_size: 4096 2023-07-14T12:50:53.709 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_size_deviation: 10 2023-07-14T12:50:53.709 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_restart_interval: 16 2023-07-14T12:50:53.709 INFO:journalctl@ceph.mon.c.smithi135.stdout: index_block_restart_interval: 1 2023-07-14T12:50:53.709 INFO:journalctl@ceph.mon.c.smithi135.stdout: metadata_block_size: 4096 2023-07-14T12:50:53.709 INFO:journalctl@ceph.mon.c.smithi135.stdout: partition_filters: 0 2023-07-14T12:50:53.709 INFO:journalctl@ceph.mon.c.smithi135.stdout: use_delta_encoding: 1 2023-07-14T12:50:53.709 INFO:journalctl@ceph.mon.c.smithi135.stdout: filter_policy: bloomfilter 2023-07-14T12:50:53.710 INFO:journalctl@ceph.mon.c.smithi135.stdout: whole_key_filtering: 1 2023-07-14T12:50:53.710 INFO:journalctl@ceph.mon.c.smithi135.stdout: verify_compression: 0 2023-07-14T12:50:53.710 INFO:journalctl@ceph.mon.c.smithi135.stdout: read_amp_bytes_per_bit: 0 2023-07-14T12:50:53.710 INFO:journalctl@ceph.mon.c.smithi135.stdout: format_version: 5 2023-07-14T12:50:53.710 INFO:journalctl@ceph.mon.c.smithi135.stdout: enable_index_compression: 1 2023-07-14T12:50:53.710 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_align: 0 2023-07-14T12:50:53.710 INFO:journalctl@ceph.mon.c.smithi135.stdout: max_auto_readahead_size: 262144 2023-07-14T12:50:53.711 INFO:journalctl@ceph.mon.c.smithi135.stdout: prepopulate_block_cache: 0 2023-07-14T12:50:53.711 INFO:journalctl@ceph.mon.c.smithi135.stdout: initial_auto_readahead_size: 8192 2023-07-14T12:50:53.711 INFO:journalctl@ceph.mon.c.smithi135.stdout: num_file_reads_for_auto_readahead: 2 2023-07-14T12:50:53.711 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.write_buffer_size: 33554432 2023-07-14T12:50:53.711 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_write_buffer_number: 2 2023-07-14T12:50:53.711 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compression: NoCompression 2023-07-14T12:50:53.711 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bottommost_compression: Disabled 2023-07-14T12:50:53.712 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.prefix_extractor: nullptr 2023-07-14T12:50:53.712 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-14T12:50:53.712 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.num_levels: 7 2023-07-14T12:50:53.712 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-14T12:50:53.712 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-14T12:50:53.712 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-14T12:50:53.712 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-14T12:50:53.712 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-14T12:50:53.713 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-14T12:50:53.713 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-14T12:50:53.713 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-14T12:50:53.713 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-14T12:50:53.713 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-14T12:50:53.713 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-14T12:50:53.713 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-14T12:50:53.714 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compression_opts.window_bits: -14 2023-07-14T12:50:53.714 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compression_opts.level: 32767 2023-07-14T12:50:53.714 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compression_opts.strategy: 0 2023-07-14T12:50:53.714 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-14T12:50:53.714 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-14T12:50:53.714 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-14T12:50:53.714 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-14T12:50:53.714 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compression_opts.enabled: false 2023-07-14T12:50:53.715 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-14T12:50:53.715 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-14T12:50:53.715 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-14T12:50:53.715 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-14T12:50:53.715 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.target_file_size_base: 67108864 2023-07-14T12:50:53.715 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.target_file_size_multiplier: 1 2023-07-14T12:50:53.715 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-14T12:50:53.716 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-14T12:50:53.716 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-14T12:50:53.716 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-14T12:50:53.716 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-14T12:50:53.716 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-14T12:50:53.716 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-14T12:50:53.716 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-14T12:50:53.716 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-14T12:50:53.717 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-14T12:50:53.717 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-14T12:50:53.717 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-14T12:50:53.717 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-14T12:50:53.717 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.arena_block_size: 1048576 2023-07-14T12:50:53.717 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-14T12:50:53.717 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-14T12:50:53.718 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.disable_auto_compactions: 0 2023-07-14T12:50:53.718 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-14T12:50:53.718 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-14T12:50:53.718 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-14T12:50:53.718 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-14T12:50:53.718 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-14T12:50:53.718 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-14T12:50:53.718 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-14T12:50:53.719 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-14T12:50:53.719 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-14T12:50:53.719 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-14T12:50:53.719 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.table_properties_collectors: 2023-07-14T12:50:53.719 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.inplace_update_support: 0 2023-07-14T12:50:53.719 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.inplace_update_num_locks: 10000 2023-07-14T12:50:53.719 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-14T12:50:53.719 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-14T12:50:53.720 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.memtable_huge_page_size: 0 2023-07-14T12:50:53.720 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.bloom_locality: 0 2023-07-14T12:50:53.720 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.max_successive_merges: 0 2023-07-14T12:50:53.720 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.optimize_filters_for_hits: 0 2023-07-14T12:50:53.720 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.paranoid_file_checks: 0 2023-07-14T12:50:53.720 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.force_consistency_checks: 1 2023-07-14T12:50:53.721 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.report_bg_io_stats: 0 2023-07-14T12:50:53.721 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.ttl: 2592000 2023-07-14T12:50:53.721 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.periodic_compaction_seconds: 0 2023-07-14T12:50:53.721 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-14T12:50:53.721 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-14T12:50:53.721 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.enable_blob_files: false 2023-07-14T12:50:53.721 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.min_blob_size: 0 2023-07-14T12:50:53.722 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.blob_file_size: 268435456 2023-07-14T12:50:53.722 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.blob_compression_type: NoCompression 2023-07-14T12:50:53.722 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.enable_blob_garbage_collection: false 2023-07-14T12:50:53.722 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-14T12:50:53.722 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-14T12:50:53.722 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-14T12:50:53.722 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.blob_file_starting_level: 0 2023-07-14T12:50:53.722 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-14T12:50:53.723 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-14T12:50:53.723 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-07-14T12:50:53.723 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f7752e8e-fab8-4518-8261-f4c463103580 2023-07-14T12:50:53.723 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689339053241316, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-07-14T12:50:53.723 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-07-14T12:50:53.723 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689339053242200, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689339053, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f7752e8e-fab8-4518-8261-f4c463103580", "db_session_id": "5PPIDNW0K19IGPOX6DRR", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-07-14T12:50:53.723 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689339053242416, "job": 1, "event": "recovery_finished"} 2023-07-14T12:50:53.724 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-07-14T12:50:53.724 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-14T12:50:53.724 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e201982000 2023-07-14T12:50:53.724 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: DB pointer 0x55e20196e000 2023-07-14T12:50:53.724 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-14T12:50:53.724 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-14T12:50:53.724 INFO:journalctl@ceph.mon.c.smithi135.stdout: ** DB Stats ** 2023-07-14T12:50:53.725 INFO:journalctl@ceph.mon.c.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-14T12:50:53.725 INFO:journalctl@ceph.mon.c.smithi135.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-14T12:50:53.725 INFO:journalctl@ceph.mon.c.smithi135.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-14T12:50:53.725 INFO:journalctl@ceph.mon.c.smithi135.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-14T12:50:53.725 INFO:journalctl@ceph.mon.c.smithi135.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-14T12:50:53.725 INFO:journalctl@ceph.mon.c.smithi135.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-14T12:50:53.725 INFO:journalctl@ceph.mon.c.smithi135.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-14T12:50:53.726 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2023-07-14T12:50:53.726 INFO:journalctl@ceph.mon.c.smithi135.stdout: ** Compaction Stats [default] ** 2023-07-14T12:50:53.726 INFO:journalctl@ceph.mon.c.smithi135.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-14T12:50:53.726 INFO:journalctl@ceph.mon.c.smithi135.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-14T12:50:53.726 INFO:journalctl@ceph.mon.c.smithi135.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:50:53.726 INFO:journalctl@ceph.mon.c.smithi135.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:50:53.726 INFO:journalctl@ceph.mon.c.smithi135.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:50:53.727 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2023-07-14T12:50:53.727 INFO:journalctl@ceph.mon.c.smithi135.stdout: ** Compaction Stats [default] ** 2023-07-14T12:50:53.727 INFO:journalctl@ceph.mon.c.smithi135.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-14T12:50:53.727 INFO:journalctl@ceph.mon.c.smithi135.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-14T12:50:53.727 INFO:journalctl@ceph.mon.c.smithi135.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:50:53.727 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2023-07-14T12:50:53.727 INFO:journalctl@ceph.mon.c.smithi135.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-14T12:50:53.727 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2023-07-14T12:50:53.728 INFO:journalctl@ceph.mon.c.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-14T12:50:53.728 INFO:journalctl@ceph.mon.c.smithi135.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-07-14T12:50:53.728 INFO:journalctl@ceph.mon.c.smithi135.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-14T12:50:53.728 INFO:journalctl@ceph.mon.c.smithi135.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-07-14T12:50:53.728 INFO:journalctl@ceph.mon.c.smithi135.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-07-14T12:50:53.728 INFO:journalctl@ceph.mon.c.smithi135.stdout: AddFile(Keys): cumulative 0, interval 0 2023-07-14T12:50:53.728 INFO:journalctl@ceph.mon.c.smithi135.stdout: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-14T12:50:53.729 INFO:journalctl@ceph.mon.c.smithi135.stdout: Interval compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-14T12:50:53.729 INFO:journalctl@ceph.mon.c.smithi135.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-14T12:50:53.729 INFO:journalctl@ceph.mon.c.smithi135.stdout: Block cache BinnedLRUCache@0x55e2018e91f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-07-14T12:50:53.729 INFO:journalctl@ceph.mon.c.smithi135.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-07-14T12:50:53.729 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2023-07-14T12:50:53.729 INFO:journalctl@ceph.mon.c.smithi135.stdout: ** File Read Latency Histogram By Level [default] ** 2023-07-14T12:50:53.729 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-07-14T12:50:53.729 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: using public_addr v2:172.21.15.135:0/0 -> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2023-07-14T12:50:53.730 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: starting mon.c rank -1 at public addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] at bind addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:50:53.730 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(???) e0 preinit fsid b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:50:53.730 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 bash[97299]: 36758eaaa5f0208e460ae1099cfd241a4a122f9a97bcbb449eadcc85ee2b62b7 2023-07-14T12:50:53.730 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).mds e1 new map 2023-07-14T12:50:53.730 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).mds e1 print_map 2023-07-14T12:50:53.730 INFO:journalctl@ceph.mon.c.smithi135.stdout: e1 2023-07-14T12:50:53.730 INFO:journalctl@ceph.mon.c.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-07-14T12:50:53.731 INFO:journalctl@ceph.mon.c.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-14T12:50:53.731 INFO:journalctl@ceph.mon.c.smithi135.stdout: legacy client fscid: -1 2023-07-14T12:50:53.731 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2023-07-14T12:50:53.731 INFO:journalctl@ceph.mon.c.smithi135.stdout: No filesystems configured 2023-07-14T12:50:53.731 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-07-14T12:50:53.731 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-07-14T12:50:53.731 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-07-14T12:50:53.731 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-07-14T12:50:53.732 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-07-14T12:50:53.732 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-07-14T12:50:53.732 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-14T12:50:53.732 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T12:50:53.732 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T12:50:53.732 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T12:50:53.732 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.733 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:50:53.733 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:53.733 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:53.733 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.733 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.733 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.733 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.733 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:50:53.734 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:50:53.734 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:50:53.734 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:50:53.734 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Updating smithi131:/etc/ceph/ceph.conf 2023-07-14T12:50:53.734 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:50:53.734 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Deploying cephadm binary to smithi135 2023-07-14T12:50:53.735 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:50:53.735 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:53.735 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:50:53.735 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.735 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.735 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.735 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.735 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:50:53.736 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.736 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Added host smithi135 2023-07-14T12:50:53.736 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:53.736 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.736 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:53.736 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.736 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:50:53.737 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:53.737 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.737 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.737 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.737 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.737 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:50:53.737 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:50:53.737 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:50:53.738 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Updating smithi135:/etc/ceph/ceph.conf 2023-07-14T12:50:53.738 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/389715228' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-14T12:50:53.738 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:53.738 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:50:53.738 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/389715228' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-14T12:50:53.738 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T12:50:53.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:50:53.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:50:53.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:53.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:50:53.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c;count:3 2023-07-14T12:50:53.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:50:53.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:50:53.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:50:53.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:53.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:50:53.741 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:50:53.741 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: Deploying daemon mon.c on smithi135 2023-07-14T12:50:53.741 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:53.741 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:53.741 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: from='client.? 172.21.15.135:0/2797750532' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T12:50:53.741 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-07-14T12:50:53.741 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 ceph-mon[97338]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-07-14T12:50:53.741 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:53 smithi135 systemd[1]: Started Ceph mon.c for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:50:53.742 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-07-14T12:50:53.742 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph mon dump -f json 2023-07-14T12:50:54.465 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:50:58.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:50:58.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: mon.a calling monitor election 2023-07-14T12:50:58.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:58.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: mon.c calling monitor election 2023-07-14T12:50:58.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:58.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-14T12:50:58.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: monmap e2: 2 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-07-14T12:50:58.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: fsmap 2023-07-14T12:50:58.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T12:50:58.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: mgrmap e13: x(active, since 51s) 2023-07-14T12:50:58.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: overall HEALTH_OK 2023-07-14T12:50:58.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:58.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:58.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:58.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:50:58.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:50:58.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:50:58.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: mon.a calling monitor election 2023-07-14T12:50:58.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:58.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: mon.c calling monitor election 2023-07-14T12:50:58.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:58.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:58.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-14T12:50:58.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: monmap e2: 2 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-07-14T12:50:58.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: fsmap 2023-07-14T12:50:58.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T12:50:58.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: mgrmap e13: x(active, since 51s) 2023-07-14T12:50:58.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: overall HEALTH_OK 2023-07-14T12:50:58.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:58.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:58.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:50:58.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:50:58.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:50:58.887 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.865+0000 7f993a0f3700 1 -- 172.21.15.135:0/1013050323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9934105730 msgr2=0x7f991c005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:58.887 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.865+0000 7f993a0f3700 1 --2- 172.21.15.135:0/1013050323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9934105730 0x7f991c005610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f992400fc90 tx=0x7f992400ffa0 comp rx=0 tx=0).stop 2023-07-14T12:50:58.887 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.865+0000 7f993a0f3700 1 -- 172.21.15.135:0/1013050323 shutdown_connections 2023-07-14T12:50:58.887 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.865+0000 7f993a0f3700 1 --2- 172.21.15.135:0/1013050323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9934105730 0x7f991c005610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:58.888 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.865+0000 7f993a0f3700 1 -- 172.21.15.135:0/1013050323 >> 172.21.15.135:0/1013050323 conn(0x7f99340fb210 msgr2=0x7f99340fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:58.888 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.865+0000 7f993a0f3700 1 -- 172.21.15.135:0/1013050323 shutdown_connections 2023-07-14T12:50:58.888 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.865+0000 7f993a0f3700 1 -- 172.21.15.135:0/1013050323 wait complete. 2023-07-14T12:50:58.888 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.867+0000 7f993a0f3700 1 Processor -- start 2023-07-14T12:50:58.888 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.867+0000 7f993a0f3700 1 -- start start 2023-07-14T12:50:58.889 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.867+0000 7f993a0f3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9934105730 0x7f9934072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:58.889 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.867+0000 7f993a0f3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9934072d50 0x7f99340731c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:58.889 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.867+0000 7f993a0f3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9934074790 con 0x7f9934072d50 2023-07-14T12:50:58.889 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.867+0000 7f993a0f3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99341a0c70 con 0x7f9934105730 2023-07-14T12:50:58.890 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.868+0000 7f9932ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9934072d50 0x7f99340731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:58.890 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.868+0000 7f9932ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9934072d50 0x7f99340731c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.135:41026/0 (socket says 172.21.15.135:41026) 2023-07-14T12:50:58.890 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.868+0000 7f9932ffd700 1 -- 172.21.15.135:0/2468125670 learned_addr learned my addr 172.21.15.135:0/2468125670 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-07-14T12:50:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.868+0000 7f9932ffd700 1 -- 172.21.15.135:0/2468125670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9934105730 msgr2=0x7f9934072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.868+0000 7f9932ffd700 1 --2- 172.21.15.135:0/2468125670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9934105730 0x7f9934072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.868+0000 7f9932ffd700 1 -- 172.21.15.135:0/2468125670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992400f970 con 0x7f9934072d50 2023-07-14T12:50:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.869+0000 7f9932ffd700 1 --2- 172.21.15.135:0/2468125670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9934072d50 0x7f99340731c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f992800b700 tx=0x7f992800bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.869+0000 7f9930ff9700 1 -- 172.21.15.135:0/2468125670 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f9928011630 con 0x7f9934072d50 2023-07-14T12:50:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.869+0000 7f9930ff9700 1 -- 172.21.15.135:0/2468125670 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9928011c20 con 0x7f9934072d50 2023-07-14T12:50:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.869+0000 7f993a0f3700 1 -- 172.21.15.135:0/2468125670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99341a0e70 con 0x7f9934072d50 2023-07-14T12:50:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.869+0000 7f9930ff9700 1 -- 172.21.15.135:0/2468125670 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f9928010c60 con 0x7f9934072d50 2023-07-14T12:50:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.869+0000 7f993a0f3700 1 -- 172.21.15.135:0/2468125670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99341a13b0 con 0x7f9934072d50 2023-07-14T12:50:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.870+0000 7f9930ff9700 1 -- 172.21.15.135:0/2468125670 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f9928011790 con 0x7f9934072d50 2023-07-14T12:50:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.871+0000 7f993a0f3700 1 -- 172.21.15.135:0/2468125670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9934061b40 con 0x7f9934072d50 2023-07-14T12:50:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.871+0000 7f9930ff9700 1 --2- 172.21.15.135:0/2468125670 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99200385f0 0x7f992003aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:50:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.871+0000 7f9930ff9700 1 -- 172.21.15.135:0/2468125670 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f992804aed0 con 0x7f9934072d50 2023-07-14T12:50:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.871+0000 7f99337fe700 1 --2- 172.21.15.135:0/2468125670 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99200385f0 0x7f992003aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:50:58.894 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.872+0000 7f99337fe700 1 --2- 172.21.15.135:0/2468125670 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99200385f0 0x7f992003aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f99240059d0 tx=0x7f9924005940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:50:58.897 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:58.876+0000 7f9930ff9700 1 -- 172.21.15.135:0/2468125670 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f99280172c0 con 0x7f9934072d50 2023-07-14T12:50:59.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.149+0000 7f993a0f3700 1 -- 172.21.15.135:0/2468125670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9934073d40 con 0x7f9934072d50 2023-07-14T12:50:59.171 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.150+0000 7f9930ff9700 1 -- 172.21.15.135:0/2468125670 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f99280172c0 con 0x7f9934072d50 2023-07-14T12:50:59.172 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:50:59.172 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","modified":"2023-07-14T12:50:53.290024Z","created":"2023-07-14T12:48:59.289205Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-07-14T12:50:59.174 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.152+0000 7f993a0f3700 1 -- 172.21.15.135:0/2468125670 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99200385f0 msgr2=0x7f992003aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:59.174 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.152+0000 7f993a0f3700 1 --2- 172.21.15.135:0/2468125670 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99200385f0 0x7f992003aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f99240059d0 tx=0x7f9924005940 comp rx=0 tx=0).stop 2023-07-14T12:50:59.174 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.152+0000 7f993a0f3700 1 -- 172.21.15.135:0/2468125670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9934072d50 msgr2=0x7f99340731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:50:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.152+0000 7f993a0f3700 1 --2- 172.21.15.135:0/2468125670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9934072d50 0x7f99340731c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f992800b700 tx=0x7f992800bac0 comp rx=0 tx=0).stop 2023-07-14T12:50:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.153+0000 7f993a0f3700 1 -- 172.21.15.135:0/2468125670 shutdown_connections 2023-07-14T12:50:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.153+0000 7f993a0f3700 1 --2- 172.21.15.135:0/2468125670 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99200385f0 0x7f992003aaa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.153+0000 7f993a0f3700 1 --2- 172.21.15.135:0/2468125670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9934105730 0x7f9934072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.153+0000 7f993a0f3700 1 --2- 172.21.15.135:0/2468125670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9934072d50 0x7f99340731c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:50:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.153+0000 7f993a0f3700 1 -- 172.21.15.135:0/2468125670 >> 172.21.15.135:0/2468125670 conn(0x7f99340fb210 msgr2=0x7f993418dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:50:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.153+0000 7f993a0f3700 1 -- 172.21.15.135:0/2468125670 shutdown_connections 2023-07-14T12:50:59.175 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:50:59.153+0000 7f993a0f3700 1 -- 172.21.15.135:0/2468125670 wait complete. 2023-07-14T12:50:59.176 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 2 2023-07-14T12:50:59.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:59 smithi135 ceph-mon[97338]: Deploying daemon mon.b on smithi131 2023-07-14T12:50:59.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:59 smithi135 ceph-mon[97338]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:59.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:59 smithi135 ceph-mon[97338]: from='client.? 172.21.15.135:0/2468125670' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T12:50:59.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:50:59 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:50:59.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:59 smithi017 ceph-mon[95536]: Deploying daemon mon.b on smithi131 2023-07-14T12:50:59.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:59 smithi017 ceph-mon[95536]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:50:59.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:59 smithi017 ceph-mon[95536]: from='client.? 172.21.15.135:0/2468125670' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T12:50:59.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:50:59 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:51:00.744 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-07-14T12:51:00.744 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph mon dump -f json 2023-07-14T12:51:01.469 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:51:02.035 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:01 smithi135 ceph-mon[97338]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:02.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:01 smithi017 ceph-mon[95536]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:02.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:01 smithi131 systemd[1]: Starting Ceph mon.b for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:51:02.676 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 podman[96913]: 2023-07-14T12:51:02.677 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 bash[96913]: 00560241cab4d4a510bd6395e775cac00085f43ee9d5e39030e781f5e21a6c4d 2023-07-14T12:51:02.677 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: set uid:gid to 167:167 (ceph:ceph) 2023-07-14T12:51:02.677 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev), process ceph-mon, pid 7 2023-07-14T12:51:02.677 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pidfile_write: ignore empty --pid-file 2023-07-14T12:51:02.677 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: load: jerasure load: lrc 2023-07-14T12:51:02.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: RocksDB version: 7.9.2 2023-07-14T12:51:02.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Git sha 0 2023-07-14T12:51:02.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Compile date 2023-07-13 18:29:45 2023-07-14T12:51:02.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: DB SUMMARY 2023-07-14T12:51:02.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: DB Session ID: HTLGPZZC01MRTPJIC6U4 2023-07-14T12:51:02.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: CURRENT file: CURRENT 2023-07-14T12:51:02.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: IDENTITY file: IDENTITY 2023-07-14T12:51:02.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-07-14T12:51:02.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-07-14T12:51:02.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-07-14T12:51:02.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.error_if_exists: 0 2023-07-14T12:51:02.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.create_if_missing: 0 2023-07-14T12:51:02.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.paranoid_checks: 1 2023-07-14T12:51:02.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.flush_verify_memtable_count: 1 2023-07-14T12:51:02.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-14T12:51:02.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-14T12:51:02.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.env: 0x562532c3e720 2023-07-14T12:51:02.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.fs: PosixFileSystem 2023-07-14T12:51:02.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.info_log: 0x562533775280 2023-07-14T12:51:02.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_file_opening_threads: 16 2023-07-14T12:51:02.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.statistics: (nil) 2023-07-14T12:51:02.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.use_fsync: 0 2023-07-14T12:51:02.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_log_file_size: 0 2023-07-14T12:51:02.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-14T12:51:02.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.log_file_time_to_roll: 0 2023-07-14T12:51:02.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.keep_log_file_num: 1000 2023-07-14T12:51:02.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.recycle_log_file_num: 0 2023-07-14T12:51:02.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.allow_fallocate: 1 2023-07-14T12:51:02.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.allow_mmap_reads: 0 2023-07-14T12:51:02.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.allow_mmap_writes: 0 2023-07-14T12:51:02.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.use_direct_reads: 0 2023-07-14T12:51:02.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-14T12:51:02.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.create_missing_column_families: 0 2023-07-14T12:51:02.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.db_log_dir: 2023-07-14T12:51:02.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.wal_dir: 2023-07-14T12:51:02.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.table_cache_numshardbits: 6 2023-07-14T12:51:02.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.WAL_ttl_seconds: 0 2023-07-14T12:51:02.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.WAL_size_limit_MB: 0 2023-07-14T12:51:02.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-14T12:51:02.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-14T12:51:02.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.is_fd_close_on_exec: 1 2023-07-14T12:51:02.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.advise_random_on_open: 1 2023-07-14T12:51:02.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.db_write_buffer_size: 0 2023-07-14T12:51:02.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.write_buffer_manager: 0x5625336963c0 2023-07-14T12:51:02.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-14T12:51:02.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-14T12:51:02.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.use_adaptive_mutex: 0 2023-07-14T12:51:02.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.rate_limiter: (nil) 2023-07-14T12:51:02.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-14T12:51:02.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.wal_recovery_mode: 2 2023-07-14T12:51:02.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.enable_thread_tracking: 0 2023-07-14T12:51:02.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.enable_pipelined_write: 0 2023-07-14T12:51:02.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.unordered_write: 0 2023-07-14T12:51:02.997 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-14T12:51:02.997 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-14T12:51:02.997 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-14T12:51:02.997 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-14T12:51:02.997 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.row_cache: None 2023-07-14T12:51:02.997 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.wal_filter: None 2023-07-14T12:51:02.997 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-14T12:51:02.998 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.allow_ingest_behind: 0 2023-07-14T12:51:02.998 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.two_write_queues: 0 2023-07-14T12:51:02.998 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.manual_wal_flush: 0 2023-07-14T12:51:02.998 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.wal_compression: 0 2023-07-14T12:51:02.998 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.atomic_flush: 0 2023-07-14T12:51:02.998 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-14T12:51:02.998 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.persist_stats_to_disk: 0 2023-07-14T12:51:02.999 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.write_dbid_to_manifest: 0 2023-07-14T12:51:02.999 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.log_readahead_size: 0 2023-07-14T12:51:02.999 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-14T12:51:02.999 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.best_efforts_recovery: 0 2023-07-14T12:51:02.999 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-14T12:51:02.999 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-14T12:51:02.999 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.allow_data_in_errors: 0 2023-07-14T12:51:03.000 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.db_host_id: __hostname__ 2023-07-14T12:51:03.000 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.enforce_single_del_contracts: true 2023-07-14T12:51:03.000 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_background_jobs: 2 2023-07-14T12:51:03.000 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_background_compactions: -1 2023-07-14T12:51:03.000 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_subcompactions: 1 2023-07-14T12:51:03.000 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-14T12:51:03.001 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-14T12:51:03.001 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.delayed_write_rate : 16777216 2023-07-14T12:51:03.001 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_total_wal_size: 0 2023-07-14T12:51:03.001 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-14T12:51:03.001 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.stats_dump_period_sec: 600 2023-07-14T12:51:03.001 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.stats_persist_period_sec: 600 2023-07-14T12:51:03.001 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-14T12:51:03.002 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_open_files: -1 2023-07-14T12:51:03.002 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bytes_per_sync: 0 2023-07-14T12:51:03.002 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.wal_bytes_per_sync: 0 2023-07-14T12:51:03.002 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.strict_bytes_per_sync: 0 2023-07-14T12:51:03.002 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_readahead_size: 0 2023-07-14T12:51:03.002 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_background_flushes: -1 2023-07-14T12:51:03.002 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Compression algorithms supported: 2023-07-14T12:51:03.003 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-14T12:51:03.003 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: kZSTD supported: 0 2023-07-14T12:51:03.003 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: kXpressCompression supported: 0 2023-07-14T12:51:03.003 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: kLZ4HCCompression supported: 1 2023-07-14T12:51:03.003 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: kZlibCompression supported: 1 2023-07-14T12:51:03.003 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: kSnappyCompression supported: 1 2023-07-14T12:51:03.003 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: kLZ4Compression supported: 1 2023-07-14T12:51:03.004 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: kBZip2Compression supported: 0 2023-07-14T12:51:03.004 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Fast CRC32 supported: Supported on x86 2023-07-14T12:51:03.004 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: DMutex implementation: pthread_mutex_t 2023-07-14T12:51:03.004 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-07-14T12:51:03.004 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-14T12:51:03.004 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-14T12:51:03.004 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.merge_operator: 2023-07-14T12:51:03.005 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_filter: None 2023-07-14T12:51:03.005 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_filter_factory: None 2023-07-14T12:51:03.005 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.sst_partitioner_factory: None 2023-07-14T12:51:03.005 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.memtable_factory: SkipListFactory 2023-07-14T12:51:03.005 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.table_factory: BlockBasedTable 2023-07-14T12:51:03.005 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562533775380) 2023-07-14T12:51:03.005 INFO:journalctl@ceph.mon.b.smithi131.stdout: cache_index_and_filter_blocks: 1 2023-07-14T12:51:03.006 INFO:journalctl@ceph.mon.b.smithi131.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-14T12:51:03.006 INFO:journalctl@ceph.mon.b.smithi131.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-14T12:51:03.006 INFO:journalctl@ceph.mon.b.smithi131.stdout: pin_top_level_index_and_filter: 1 2023-07-14T12:51:03.006 INFO:journalctl@ceph.mon.b.smithi131.stdout: index_type: 0 2023-07-14T12:51:03.006 INFO:journalctl@ceph.mon.b.smithi131.stdout: data_block_index_type: 0 2023-07-14T12:51:03.006 INFO:journalctl@ceph.mon.b.smithi131.stdout: index_shortening: 1 2023-07-14T12:51:03.006 INFO:journalctl@ceph.mon.b.smithi131.stdout: data_block_hash_table_util_ratio: 0.750000 2023-07-14T12:51:03.007 INFO:journalctl@ceph.mon.b.smithi131.stdout: checksum: 4 2023-07-14T12:51:03.007 INFO:journalctl@ceph.mon.b.smithi131.stdout: no_block_cache: 0 2023-07-14T12:51:03.007 INFO:journalctl@ceph.mon.b.smithi131.stdout: block_cache: 0x5625337351f0 2023-07-14T12:51:03.007 INFO:journalctl@ceph.mon.b.smithi131.stdout: block_cache_name: BinnedLRUCache 2023-07-14T12:51:03.007 INFO:journalctl@ceph.mon.b.smithi131.stdout: block_cache_options: 2023-07-14T12:51:03.007 INFO:journalctl@ceph.mon.b.smithi131.stdout: capacity : 536870912 2023-07-14T12:51:03.007 INFO:journalctl@ceph.mon.b.smithi131.stdout: num_shard_bits : 4 2023-07-14T12:51:03.008 INFO:journalctl@ceph.mon.b.smithi131.stdout: strict_capacity_limit : 0 2023-07-14T12:51:03.008 INFO:journalctl@ceph.mon.b.smithi131.stdout: high_pri_pool_ratio: 0.000 2023-07-14T12:51:03.008 INFO:journalctl@ceph.mon.b.smithi131.stdout: block_cache_compressed: (nil) 2023-07-14T12:51:03.008 INFO:journalctl@ceph.mon.b.smithi131.stdout: persistent_cache: (nil) 2023-07-14T12:51:03.008 INFO:journalctl@ceph.mon.b.smithi131.stdout: block_size: 4096 2023-07-14T12:51:03.008 INFO:journalctl@ceph.mon.b.smithi131.stdout: block_size_deviation: 10 2023-07-14T12:51:03.008 INFO:journalctl@ceph.mon.b.smithi131.stdout: block_restart_interval: 16 2023-07-14T12:51:03.009 INFO:journalctl@ceph.mon.b.smithi131.stdout: index_block_restart_interval: 1 2023-07-14T12:51:03.009 INFO:journalctl@ceph.mon.b.smithi131.stdout: metadata_block_size: 4096 2023-07-14T12:51:03.009 INFO:journalctl@ceph.mon.b.smithi131.stdout: partition_filters: 0 2023-07-14T12:51:03.009 INFO:journalctl@ceph.mon.b.smithi131.stdout: use_delta_encoding: 1 2023-07-14T12:51:03.009 INFO:journalctl@ceph.mon.b.smithi131.stdout: filter_policy: bloomfilter 2023-07-14T12:51:03.009 INFO:journalctl@ceph.mon.b.smithi131.stdout: whole_key_filtering: 1 2023-07-14T12:51:03.009 INFO:journalctl@ceph.mon.b.smithi131.stdout: verify_compression: 0 2023-07-14T12:51:03.010 INFO:journalctl@ceph.mon.b.smithi131.stdout: read_amp_bytes_per_bit: 0 2023-07-14T12:51:03.010 INFO:journalctl@ceph.mon.b.smithi131.stdout: format_version: 5 2023-07-14T12:51:03.010 INFO:journalctl@ceph.mon.b.smithi131.stdout: enable_index_compression: 1 2023-07-14T12:51:03.010 INFO:journalctl@ceph.mon.b.smithi131.stdout: block_align: 0 2023-07-14T12:51:03.010 INFO:journalctl@ceph.mon.b.smithi131.stdout: max_auto_readahead_size: 262144 2023-07-14T12:51:03.010 INFO:journalctl@ceph.mon.b.smithi131.stdout: prepopulate_block_cache: 0 2023-07-14T12:51:03.010 INFO:journalctl@ceph.mon.b.smithi131.stdout: initial_auto_readahead_size: 8192 2023-07-14T12:51:03.010 INFO:journalctl@ceph.mon.b.smithi131.stdout: num_file_reads_for_auto_readahead: 2 2023-07-14T12:51:03.011 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.write_buffer_size: 33554432 2023-07-14T12:51:03.011 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_write_buffer_number: 2 2023-07-14T12:51:03.011 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compression: NoCompression 2023-07-14T12:51:03.011 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bottommost_compression: Disabled 2023-07-14T12:51:03.011 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.prefix_extractor: nullptr 2023-07-14T12:51:03.011 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-14T12:51:03.011 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.num_levels: 7 2023-07-14T12:51:03.012 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-14T12:51:03.012 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-14T12:51:03.012 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-14T12:51:03.012 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-14T12:51:03.012 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-14T12:51:03.012 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-14T12:51:03.012 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-14T12:51:03.013 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-14T12:51:03.013 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-14T12:51:03.013 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-14T12:51:03.013 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-14T12:51:03.013 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-14T12:51:03.013 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compression_opts.window_bits: -14 2023-07-14T12:51:03.013 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compression_opts.level: 32767 2023-07-14T12:51:03.014 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compression_opts.strategy: 0 2023-07-14T12:51:03.014 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-14T12:51:03.014 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-14T12:51:03.014 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-14T12:51:03.014 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-14T12:51:03.014 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compression_opts.enabled: false 2023-07-14T12:51:03.014 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-14T12:51:03.015 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-14T12:51:03.015 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-14T12:51:03.015 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-14T12:51:03.015 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.target_file_size_base: 67108864 2023-07-14T12:51:03.015 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.target_file_size_multiplier: 1 2023-07-14T12:51:03.015 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-14T12:51:03.015 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-14T12:51:03.016 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-14T12:51:03.016 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-14T12:51:03.016 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-14T12:51:03.016 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-14T12:51:03.016 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-14T12:51:03.016 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-14T12:51:03.016 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-14T12:51:03.017 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-14T12:51:03.017 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-14T12:51:03.017 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-14T12:51:03.017 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-14T12:51:03.017 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.arena_block_size: 1048576 2023-07-14T12:51:03.017 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-14T12:51:03.017 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-14T12:51:03.018 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.disable_auto_compactions: 0 2023-07-14T12:51:03.018 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-14T12:51:03.018 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-14T12:51:03.018 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-14T12:51:03.018 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-14T12:51:03.018 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-14T12:51:03.018 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-14T12:51:03.019 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-14T12:51:03.020 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-14T12:51:03.020 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-14T12:51:03.020 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-14T12:51:03.020 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.table_properties_collectors: 2023-07-14T12:51:03.021 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.inplace_update_support: 0 2023-07-14T12:51:03.021 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.inplace_update_num_locks: 10000 2023-07-14T12:51:03.021 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-14T12:51:03.021 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-14T12:51:03.021 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.memtable_huge_page_size: 0 2023-07-14T12:51:03.021 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.bloom_locality: 0 2023-07-14T12:51:03.021 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.max_successive_merges: 0 2023-07-14T12:51:03.022 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.optimize_filters_for_hits: 0 2023-07-14T12:51:03.022 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.paranoid_file_checks: 0 2023-07-14T12:51:03.022 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.force_consistency_checks: 1 2023-07-14T12:51:03.022 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.report_bg_io_stats: 0 2023-07-14T12:51:03.022 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.ttl: 2592000 2023-07-14T12:51:03.023 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.periodic_compaction_seconds: 0 2023-07-14T12:51:03.023 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-14T12:51:03.023 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-14T12:51:03.023 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.enable_blob_files: false 2023-07-14T12:51:03.023 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.min_blob_size: 0 2023-07-14T12:51:03.023 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.blob_file_size: 268435456 2023-07-14T12:51:03.023 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.blob_compression_type: NoCompression 2023-07-14T12:51:03.024 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.enable_blob_garbage_collection: false 2023-07-14T12:51:03.024 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-14T12:51:03.024 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-14T12:51:03.024 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-14T12:51:03.024 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.blob_file_starting_level: 0 2023-07-14T12:51:03.024 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-14T12:51:03.024 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-14T12:51:03.025 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-07-14T12:51:03.025 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a015608a-e9f0-4e0a-963d-1efe76c87501 2023-07-14T12:51:03.025 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689339062660471, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-07-14T12:51:03.025 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-07-14T12:51:03.025 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689339062661741, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689339062, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a015608a-e9f0-4e0a-963d-1efe76c87501", "db_session_id": "HTLGPZZC01MRTPJIC6U4", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-07-14T12:51:03.025 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689339062662133, "job": 1, "event": "recovery_finished"} 2023-07-14T12:51:03.025 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-07-14T12:51:03.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-14T12:51:03.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5625337ce000 2023-07-14T12:51:03.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: DB pointer 0x5625337ba000 2023-07-14T12:51:03.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-14T12:51:03.026 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-14T12:51:03.026 INFO:journalctl@ceph.mon.b.smithi131.stdout: ** DB Stats ** 2023-07-14T12:51:03.026 INFO:journalctl@ceph.mon.b.smithi131.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-14T12:51:03.027 INFO:journalctl@ceph.mon.b.smithi131.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-14T12:51:03.027 INFO:journalctl@ceph.mon.b.smithi131.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-14T12:51:03.027 INFO:journalctl@ceph.mon.b.smithi131.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-14T12:51:03.027 INFO:journalctl@ceph.mon.b.smithi131.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-14T12:51:03.027 INFO:journalctl@ceph.mon.b.smithi131.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-14T12:51:03.027 INFO:journalctl@ceph.mon.b.smithi131.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-14T12:51:03.027 INFO:journalctl@ceph.mon.b.smithi131.stdout: 2023-07-14T12:51:03.028 INFO:journalctl@ceph.mon.b.smithi131.stdout: ** Compaction Stats [default] ** 2023-07-14T12:51:03.028 INFO:journalctl@ceph.mon.b.smithi131.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-14T12:51:03.028 INFO:journalctl@ceph.mon.b.smithi131.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-14T12:51:03.028 INFO:journalctl@ceph.mon.b.smithi131.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:51:03.028 INFO:journalctl@ceph.mon.b.smithi131.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:51:03.029 INFO:journalctl@ceph.mon.b.smithi131.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:51:03.029 INFO:journalctl@ceph.mon.b.smithi131.stdout: 2023-07-14T12:51:03.029 INFO:journalctl@ceph.mon.b.smithi131.stdout: ** Compaction Stats [default] ** 2023-07-14T12:51:03.029 INFO:journalctl@ceph.mon.b.smithi131.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-14T12:51:03.029 INFO:journalctl@ceph.mon.b.smithi131.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-14T12:51:03.029 INFO:journalctl@ceph.mon.b.smithi131.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T12:51:03.030 INFO:journalctl@ceph.mon.b.smithi131.stdout: 2023-07-14T12:51:03.030 INFO:journalctl@ceph.mon.b.smithi131.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-14T12:51:03.030 INFO:journalctl@ceph.mon.b.smithi131.stdout: 2023-07-14T12:51:03.030 INFO:journalctl@ceph.mon.b.smithi131.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-14T12:51:03.030 INFO:journalctl@ceph.mon.b.smithi131.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-07-14T12:51:03.030 INFO:journalctl@ceph.mon.b.smithi131.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-14T12:51:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-07-14T12:51:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-07-14T12:51:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout: AddFile(Keys): cumulative 0, interval 0 2023-07-14T12:51:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout: Cumulative compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-14T12:51:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout: Interval compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-14T12:51:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-14T12:51:03.031 INFO:journalctl@ceph.mon.b.smithi131.stdout: Block cache BinnedLRUCache@0x5625337351f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2023-07-14T12:51:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-07-14T12:51:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout: 2023-07-14T12:51:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout: ** File Read Latency Histogram By Level [default] ** 2023-07-14T12:51:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-07-14T12:51:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: using public_addr v2:172.21.15.131:0/0 -> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-07-14T12:51:03.032 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: starting mon.b rank -1 at public addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] at bind addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:51:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(???) e0 preinit fsid b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:51:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).mds e1 new map 2023-07-14T12:51:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).mds e1 print_map 2023-07-14T12:51:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout: e1 2023-07-14T12:51:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-07-14T12:51:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-14T12:51:03.033 INFO:journalctl@ceph.mon.b.smithi131.stdout: legacy client fscid: -1 2023-07-14T12:51:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout: 2023-07-14T12:51:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout: No filesystems configured 2023-07-14T12:51:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-07-14T12:51:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-07-14T12:51:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-07-14T12:51:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-07-14T12:51:03.034 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-07-14T12:51:03.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-07-14T12:51:03.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-14T12:51:03.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T12:51:03.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T12:51:03.035 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T12:51:03.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:51:03.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.036 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:51:03.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:03.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:03.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:51:03.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Updating smithi131:/etc/ceph/ceph.conf 2023-07-14T12:51:03.037 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:51:03.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Deploying cephadm binary to smithi135 2023-07-14T12:51:03.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:51:03.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:51:03.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.038 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:03.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Added host smithi135 2023-07-14T12:51:03.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.039 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:51:03.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.040 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:51:03.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:03.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:03.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Updating smithi135:/etc/ceph/ceph.conf 2023-07-14T12:51:03.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/389715228' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-14T12:51:03.041 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.042 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:51:03.042 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/389715228' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-14T12:51:03.042 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T12:51:03.042 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:51:03.042 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:51:03.042 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.042 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.043 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.043 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.043 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi017:172.21.15.17=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:51:03.043 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Saving service mon spec with placement smithi017:172.21.15.17=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c;count:3 2023-07-14T12:51:03.043 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.043 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:03.044 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:03.044 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:03.044 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.044 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:51:03.045 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:03.045 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Deploying daemon mon.c on smithi135 2023-07-14T12:51:03.045 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.045 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.045 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='client.? 172.21.15.135:0/2797750532' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T12:51:03.045 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:51:03.045 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.a calling monitor election 2023-07-14T12:51:03.046 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:51:03.046 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:51:03.046 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.046 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:51:03.046 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.c calling monitor election 2023-07-14T12:51:03.046 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:51:03.046 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.047 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:51:03.047 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:51:03.047 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-14T12:51:03.047 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: monmap e2: 2 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-07-14T12:51:03.047 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: fsmap 2023-07-14T12:51:03.047 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T12:51:03.047 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mgrmap e13: x(active, since 51s) 2023-07-14T12:51:03.048 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: overall HEALTH_OK 2023-07-14T12:51:03.048 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.048 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.048 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:03.048 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:51:03.048 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:03.048 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: Deploying daemon mon.b on smithi131 2023-07-14T12:51:03.049 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.049 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='client.? 172.21.15.135:0/2468125670' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T12:51:03.049 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:51:03.049 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:03.049 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-07-14T12:51:03.049 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-07-14T12:51:03.049 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta expand map: {default=false} 2023-07-14T12:51:03.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta from 'false' to 'false' 2023-07-14T12:51:03.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta expanded map: {default=false} 2023-07-14T12:51:03.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta expand map: {default=info} 2023-07-14T12:51:03.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta from 'info' to 'info' 2023-07-14T12:51:03.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta expanded map: {default=info} 2023-07-14T12:51:03.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta expand map: {default=daemon} 2023-07-14T12:51:03.050 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta from 'daemon' to 'daemon' 2023-07-14T12:51:03.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta expanded map: {default=daemon} 2023-07-14T12:51:03.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta expand map: {default=debug} 2023-07-14T12:51:03.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta from 'debug' to 'debug' 2023-07-14T12:51:03.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 ceph-mon[96953]: expand_channel_meta expanded map: {default=debug} 2023-07-14T12:51:03.051 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:02 smithi131 systemd[1]: Started Ceph mon.b for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:51:08.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:51:08.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: mon.a calling monitor election 2023-07-14T12:51:08.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: mon.c calling monitor election 2023-07-14T12:51:08.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:51:08.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:08.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: mon.b calling monitor election 2023-07-14T12:51:08.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:08.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:08.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-14T12:51:08.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-07-14T12:51:08.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: fsmap 2023-07-14T12:51:08.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T12:51:08.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: mgrmap e13: x(active, since 60s) 2023-07-14T12:51:08.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: overall HEALTH_OK 2023-07-14T12:51:08.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:08.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:08.189 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:51:08.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: mon.a calling monitor election 2023-07-14T12:51:08.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: mon.c calling monitor election 2023-07-14T12:51:08.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:51:08.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:08.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: mon.b calling monitor election 2023-07-14T12:51:08.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:08.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:08.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-14T12:51:08.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-07-14T12:51:08.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: fsmap 2023-07-14T12:51:08.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T12:51:08.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: mgrmap e13: x(active, since 60s) 2023-07-14T12:51:08.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: overall HEALTH_OK 2023-07-14T12:51:08.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:08.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:08.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:51:08.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: mon.a calling monitor election 2023-07-14T12:51:08.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: mon.c calling monitor election 2023-07-14T12:51:08.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:51:08.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:08.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: mon.b calling monitor election 2023-07-14T12:51:08.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:08.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:08.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:08.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-14T12:51:08.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: monmap e3: 3 mons at {a=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],b=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0],c=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2023-07-14T12:51:08.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: fsmap 2023-07-14T12:51:08.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T12:51:08.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: mgrmap e13: x(active, since 60s) 2023-07-14T12:51:08.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: overall HEALTH_OK 2023-07-14T12:51:08.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:08.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:08.954 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.931+0000 7f0d88235700 1 -- 172.21.15.135:0/3547649513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d6c006220 msgr2=0x7f0d6c008680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:08.954 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.931+0000 7f0d88235700 1 --2- 172.21.15.135:0/3547649513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d6c006220 0x7f0d6c008680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d80073970 tx=0x7f0d7c00fe90 comp rx=0 tx=0).stop 2023-07-14T12:51:08.955 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.931+0000 7f0d88235700 1 -- 172.21.15.135:0/3547649513 shutdown_connections 2023-07-14T12:51:08.955 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.931+0000 7f0d88235700 1 --2- 172.21.15.135:0/3547649513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d6c006220 0x7f0d6c008680 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:08.955 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.931+0000 7f0d88235700 1 -- 172.21.15.135:0/3547649513 >> 172.21.15.135:0/3547649513 conn(0x7f0d800fb210 msgr2=0x7f0d800fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:51:08.955 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.931+0000 7f0d88235700 1 -- 172.21.15.135:0/3547649513 shutdown_connections 2023-07-14T12:51:08.955 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.932+0000 7f0d88235700 1 -- 172.21.15.135:0/3547649513 wait complete. 2023-07-14T12:51:08.956 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.933+0000 7f0d88235700 1 Processor -- start 2023-07-14T12:51:08.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.933+0000 7f0d88235700 1 -- start start 2023-07-14T12:51:08.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.933+0000 7f0d88235700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d6c006220 0x7f0d80196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:08.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.933+0000 7f0d88235700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d801973f0 0x7f0d8019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:08.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.933+0000 7f0d88235700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d8019bd50 0x7f0d8019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:08.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.933+0000 7f0d88235700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80197b50 con 0x7f0d801973f0 2023-07-14T12:51:08.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.933+0000 7f0d88235700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801a3ac0 con 0x7f0d8019bd50 2023-07-14T12:51:08.957 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.933+0000 7f0d88235700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801a3c50 con 0x7f0d6c006220 2023-07-14T12:51:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.934+0000 7f0d85fd1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d6c006220 0x7f0d80196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.934+0000 7f0d85fd1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d6c006220 0x7f0d80196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46724/0 (socket says 172.21.15.135:46724) 2023-07-14T12:51:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.934+0000 7f0d85fd1700 1 -- 172.21.15.135:0/82896643 learned_addr learned my addr 172.21.15.135:0/82896643 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-07-14T12:51:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.934+0000 7f0d857d0700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d801973f0 0x7f0d8019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.934+0000 7f0d867d2700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d8019bd50 0x7f0d8019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.934+0000 7f0d85fd1700 1 -- 172.21.15.135:0/82896643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d8019bd50 msgr2=0x7f0d8019c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:08.958 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.934+0000 7f0d85fd1700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d8019bd50 0x7f0d8019c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.934+0000 7f0d85fd1700 1 -- 172.21.15.135:0/82896643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d801973f0 msgr2=0x7f0d8019b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.934+0000 7f0d85fd1700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d801973f0 0x7f0d8019b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.934+0000 7f0d85fd1700 1 -- 172.21.15.135:0/82896643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c00f8e0 con 0x7f0d6c006220 2023-07-14T12:51:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.934+0000 7f0d867d2700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d8019bd50 0x7f0d8019c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:51:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.935+0000 7f0d85fd1700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d6c006220 0x7f0d80196eb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c01d9b0 tx=0x7f0d7c01d9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:51:08.960 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.935+0000 7f0d76ffd700 1 -- 172.21.15.135:0/82896643 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c005da0 con 0x7f0d6c006220 2023-07-14T12:51:08.960 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.935+0000 7f0d88235700 1 -- 172.21.15.135:0/82896643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d801a3ed0 con 0x7f0d6c006220 2023-07-14T12:51:08.960 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.935+0000 7f0d76ffd700 1 -- 172.21.15.135:0/82896643 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d7c005460 con 0x7f0d6c006220 2023-07-14T12:51:08.960 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.935+0000 7f0d76ffd700 1 -- 172.21.15.135:0/82896643 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c011840 con 0x7f0d6c006220 2023-07-14T12:51:08.961 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.935+0000 7f0d88235700 1 -- 172.21.15.135:0/82896643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d801a42f0 con 0x7f0d6c006220 2023-07-14T12:51:08.961 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.936+0000 7f0d76ffd700 1 -- 172.21.15.135:0/82896643 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f0d7c0119a0 con 0x7f0d6c006220 2023-07-14T12:51:08.961 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.936+0000 7f0d88235700 1 -- 172.21.15.135:0/82896643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d80061b40 con 0x7f0d6c006220 2023-07-14T12:51:08.961 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.937+0000 7f0d76ffd700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0d64038c80 0x7f0d6403b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:08.961 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.937+0000 7f0d76ffd700 1 -- 172.21.15.135:0/82896643 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0d7c04e770 con 0x7f0d6c006220 2023-07-14T12:51:08.961 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.937+0000 7f0d857d0700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0d64038c80 0x7f0d6403b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:08.961 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.938+0000 7f0d857d0700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0d64038c80 0x7f0d6403b130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009ad0 tx=0x7f0d70009210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:51:08.964 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:08.942+0000 7f0d76ffd700 1 -- 172.21.15.135:0/82896643 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0d7c038b00 con 0x7f0d6c006220 2023-07-14T12:51:09.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:08 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:09.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:08 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:09.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:08 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:09.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:08 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:09.189 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:08 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:09.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:08 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:09.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:08 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:09.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:08 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:09.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:08 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:09.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:08 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:09.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:08 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:09.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:08 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:51:09.260 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.239+0000 7f0d88235700 1 -- 172.21.15.135:0/82896643 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0d801a46d0 con 0x7f0d6c006220 2023-07-14T12:51:09.261 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.239+0000 7f0d76ffd700 1 -- 172.21.15.135:0/82896643 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f0d7c038b00 con 0x7f0d6c006220 2023-07-14T12:51:09.261 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-07-14T12:51:09.262 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":3,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","modified":"2023-07-14T12:51:02.709565Z","created":"2023-07-14T12:48:59.289205Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3300","nonce":0},{"type":"v1","addr":"172.21.15.131:6789","nonce":0}]},"addr":"172.21.15.131:6789/0","public_addr":"172.21.15.131:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-14T12:51:09.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 -- 172.21.15.135:0/82896643 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0d64038c80 msgr2=0x7f0d6403b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:09.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0d64038c80 0x7f0d6403b130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009ad0 tx=0x7f0d70009210 comp rx=0 tx=0).stop 2023-07-14T12:51:09.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 -- 172.21.15.135:0/82896643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d6c006220 msgr2=0x7f0d80196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:09.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d6c006220 0x7f0d80196eb0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c01d9b0 tx=0x7f0d7c01d9e0 comp rx=0 tx=0).stop 2023-07-14T12:51:09.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 -- 172.21.15.135:0/82896643 shutdown_connections 2023-07-14T12:51:09.264 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0d64038c80 0x7f0d6403b130 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:09.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d8019bd50 0x7f0d8019c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:09.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d6c006220 0x7f0d80196eb0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:09.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 --2- 172.21.15.135:0/82896643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d801973f0 0x7f0d8019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:09.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 -- 172.21.15.135:0/82896643 >> 172.21.15.135:0/82896643 conn(0x7f0d800fb210 msgr2=0x7f0d80103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:51:09.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 -- 172.21.15.135:0/82896643 shutdown_connections 2023-07-14T12:51:09.265 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:09.242+0000 7f0d88235700 1 -- 172.21.15.135:0/82896643 wait complete. 2023-07-14T12:51:09.266 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 3 2023-07-14T12:51:10.056 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-07-14T12:51:10.057 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph config generate-minimal-conf 2023-07-14T12:51:10.097 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:09 smithi017 ceph-mon[95536]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:10.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:09 smithi017 ceph-mon[95536]: from='client.? 172.21.15.135:0/82896643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T12:51:10.189 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:09 smithi135 ceph-mon[97338]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:10.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:09 smithi135 ceph-mon[97338]: from='client.? 172.21.15.135:0/82896643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T12:51:10.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:09 smithi131 ceph-mon[96953]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:10.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:09 smithi131 ceph-mon[96953]: from='client.? 172.21.15.135:0/82896643' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T12:51:10.855 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:51:11.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:10 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.139 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:10 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:10 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:10 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:10 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:11.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:10 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:11.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:10 smithi017 ceph-mon[95536]: Updating smithi017:/etc/ceph/ceph.conf 2023-07-14T12:51:11.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:10 smithi017 ceph-mon[95536]: Updating smithi131:/etc/ceph/ceph.conf 2023-07-14T12:51:11.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:10 smithi017 ceph-mon[95536]: Updating smithi135:/etc/ceph/ceph.conf 2023-07-14T12:51:11.189 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:10 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:10 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:10 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:10 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:10 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:11.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:10 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:11.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:10 smithi135 ceph-mon[97338]: Updating smithi017:/etc/ceph/ceph.conf 2023-07-14T12:51:11.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:10 smithi135 ceph-mon[97338]: Updating smithi131:/etc/ceph/ceph.conf 2023-07-14T12:51:11.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:10 smithi135 ceph-mon[97338]: Updating smithi135:/etc/ceph/ceph.conf 2023-07-14T12:51:11.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:10 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:10 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:10 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:10 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:11.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:10 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:11.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:10 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:11.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:10 smithi131 ceph-mon[96953]: Updating smithi017:/etc/ceph/ceph.conf 2023-07-14T12:51:11.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:10 smithi131 ceph-mon[96953]: Updating smithi131:/etc/ceph/ceph.conf 2023-07-14T12:51:11.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:10 smithi131 ceph-mon[96953]: Updating smithi135:/etc/ceph/ceph.conf 2023-07-14T12:51:12.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: Updating smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:51:12.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:51:12.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:51:12.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:12.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:51:12.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T12:51:12.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:12.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.439 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: Updating smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:51:12.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:51:12.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:51:12.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:12.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:51:12.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T12:51:12.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:12.442 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: Updating smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:51:12.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:51:12.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:51:12.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:12.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:51:12.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T12:51:12.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:12.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:12.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.468+0000 7f2990941700 1 -- 172.21.15.17:0/3038178046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c105630 msgr2=0x7f298c105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:12.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.468+0000 7f2990941700 1 --2- 172.21.15.17:0/3038178046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c105630 0x7f298c105a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f297c009910 tx=0x7f297c009c20 comp rx=0 tx=0).stop 2023-07-14T12:51:12.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.468+0000 7f2990941700 1 -- 172.21.15.17:0/3038178046 shutdown_connections 2023-07-14T12:51:12.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.468+0000 7f2990941700 1 --2- 172.21.15.17:0/3038178046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c105630 0x7f298c105a00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:12.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.468+0000 7f2990941700 1 -- 172.21.15.17:0/3038178046 >> 172.21.15.17:0/3038178046 conn(0x7f298c0fb130 msgr2=0x7f298c0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:51:12.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.468+0000 7f2990941700 1 -- 172.21.15.17:0/3038178046 shutdown_connections 2023-07-14T12:51:12.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.468+0000 7f2990941700 1 -- 172.21.15.17:0/3038178046 wait complete. 2023-07-14T12:51:12.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.469+0000 7f2990941700 1 Processor -- start 2023-07-14T12:51:12.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.469+0000 7f2990941700 1 -- start start 2023-07-14T12:51:12.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.470+0000 7f2990941700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f298c105630 0x7f298c19ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:12.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.470+0000 7f2990941700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c19cfa0 0x7f298c196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:12.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.470+0000 7f2990941700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c197020 0x7f298c1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:12.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.470+0000 7f2990941700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c19d5b0 con 0x7f298c197020 2023-07-14T12:51:12.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.470+0000 7f2990941700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c1a3880 con 0x7f298c19cfa0 2023-07-14T12:51:12.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.470+0000 7f2990941700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c1a39c0 con 0x7f298c105630 2023-07-14T12:51:12.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.470+0000 7f298ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c197020 0x7f298c1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:12.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.470+0000 7f298ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c197020 0x7f298c1974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46248/0 (socket says 172.21.15.17:46248) 2023-07-14T12:51:12.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.470+0000 7f298ad9d700 1 -- 172.21.15.17:0/1738273297 learned_addr learned my addr 172.21.15.17:0/1738273297 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:51:12.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.470+0000 7f2989d9b700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c19cfa0 0x7f298c196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:12.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.470+0000 7f298a59c700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f298c105630 0x7f298c19ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:12.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f298ad9d700 1 -- 172.21.15.17:0/1738273297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f298c105630 msgr2=0x7f298c19ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:12.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f298ad9d700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f298c105630 0x7f298c19ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:12.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f298ad9d700 1 -- 172.21.15.17:0/1738273297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c19cfa0 msgr2=0x7f298c196ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:12.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f298ad9d700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c19cfa0 0x7f298c196ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:12.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f298ad9d700 1 -- 172.21.15.17:0/1738273297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0095f0 con 0x7f298c197020 2023-07-14T12:51:12.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f2989d9b700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c19cfa0 0x7f298c196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:51:12.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f298ad9d700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c197020 0x7f298c1974c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f298400ba50 tx=0x7f298400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:51:12.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f297b7fe700 1 -- 172.21.15.17:0/1738273297 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400cab0 con 0x7f298c197020 2023-07-14T12:51:12.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f2990941700 1 -- 172.21.15.17:0/1738273297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c1a3ca0 con 0x7f298c197020 2023-07-14T12:51:12.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f297b7fe700 1 -- 172.21.15.17:0/1738273297 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f298400cc10 con 0x7f298c197020 2023-07-14T12:51:12.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f297b7fe700 1 -- 172.21.15.17:0/1738273297 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29840075b0 con 0x7f298c197020 2023-07-14T12:51:12.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.471+0000 7f2990941700 1 -- 172.21.15.17:0/1738273297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c1a4220 con 0x7f298c197020 2023-07-14T12:51:12.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.472+0000 7f2990941700 1 -- 172.21.15.17:0/1738273297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c061b40 con 0x7f298c197020 2023-07-14T12:51:12.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.473+0000 7f297b7fe700 1 -- 172.21.15.17:0/1738273297 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f2984014440 con 0x7f298c197020 2023-07-14T12:51:12.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.473+0000 7f297b7fe700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f2974038c80 0x7f297403b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:12.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.473+0000 7f297b7fe700 1 -- 172.21.15.17:0/1738273297 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f298404aab0 con 0x7f298c197020 2023-07-14T12:51:12.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.473+0000 7f298a59c700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f2974038c80 0x7f297403b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:12.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.474+0000 7f298a59c700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f2974038c80 0x7f297403b130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f297c006010 tx=0x7f297c00b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:51:12.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.478+0000 7f297b7fe700 1 -- 172.21.15.17:0/1738273297 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2984012340 con 0x7f298c197020 2023-07-14T12:51:12.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.697+0000 7f2990941700 1 -- 172.21.15.17:0/1738273297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f298c197ff0 con 0x7f298c197020 2023-07-14T12:51:12.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.697+0000 7f297b7fe700 1 -- 172.21.15.17:0/1738273297 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f2984012340 con 0x7f298c197020 2023-07-14T12:51:12.719 INFO:teuthology.orchestra.run.smithi017.stdout:# minimal ceph.conf for b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:51:12.719 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2023-07-14T12:51:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:51:12.720 INFO:teuthology.orchestra.run.smithi017.stdout: mon_host = [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2023-07-14T12:51:12.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 -- 172.21.15.17:0/1738273297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f2974038c80 msgr2=0x7f297403b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:12.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f2974038c80 0x7f297403b130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f297c006010 tx=0x7f297c00b540 comp rx=0 tx=0).stop 2023-07-14T12:51:12.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 -- 172.21.15.17:0/1738273297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c197020 msgr2=0x7f298c1974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:12.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c197020 0x7f298c1974c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f298400ba50 tx=0x7f298400be10 comp rx=0 tx=0).stop 2023-07-14T12:51:12.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 -- 172.21.15.17:0/1738273297 shutdown_connections 2023-07-14T12:51:12.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f2974038c80 0x7f297403b130 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:12.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f298c197020 0x7f298c1974c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:12.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f298c105630 0x7f298c19ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:12.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 --2- 172.21.15.17:0/1738273297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f298c19cfa0 0x7f298c196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:12.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 -- 172.21.15.17:0/1738273297 >> 172.21.15.17:0/1738273297 conn(0x7f298c0fb130 msgr2=0x7f298c072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:51:12.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 -- 172.21.15.17:0/1738273297 shutdown_connections 2023-07-14T12:51:12.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:12.700+0000 7f2990941700 1 -- 172.21.15.17:0/1738273297 wait complete. 2023-07-14T12:51:13.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:13 smithi017 ceph-mon[95536]: Reconfiguring mon.a (unknown last config time)... 2023-07-14T12:51:13.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:13 smithi017 ceph-mon[95536]: Reconfiguring daemon mon.a on smithi017 2023-07-14T12:51:13.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:13 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1738273297' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:13.401 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-07-14T12:51:13.401 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:51:13.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.conf 2023-07-14T12:51:13.439 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:13 smithi135 ceph-mon[97338]: Reconfiguring mon.a (unknown last config time)... 2023-07-14T12:51:13.439 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:13 smithi135 ceph-mon[97338]: Reconfiguring daemon mon.a on smithi017 2023-07-14T12:51:13.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:13 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1738273297' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:13.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:13 smithi131 ceph-mon[96953]: Reconfiguring mon.a (unknown last config time)... 2023-07-14T12:51:13.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:13 smithi131 ceph-mon[96953]: Reconfiguring daemon mon.a on smithi017 2023-07-14T12:51:13.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:13 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1738273297' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:13.513 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:51:13.514 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:51:13.622 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-14T12:51:13.622 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.conf 2023-07-14T12:51:13.694 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-14T12:51:13.694 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:51:13.810 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-07-14T12:51:13.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2023-07-14T12:51:13.888 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-07-14T12:51:13.889 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:51:13.999 INFO:tasks.cephadm:Adding mgr.x on smithi017 2023-07-14T12:51:13.999 INFO:tasks.cephadm:Adding mgr.y on smithi131 2023-07-14T12:51:13.999 INFO:tasks.cephadm:Adding mgr.z on smithi135 2023-07-14T12:51:13.999 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch apply mgr '3;smithi017=x;smithi131=y;smithi135=z' 2023-07-14T12:51:14.189 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:14 smithi135 ceph-mon[97338]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:14.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:14 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:14.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:14 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:14.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:14 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:51:14.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:14 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T12:51:14.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:14 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:14.311 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:14 smithi131 ceph-mon[96953]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:14.311 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:14 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:14.312 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:14 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:14.312 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:14 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:51:14.312 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:14 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T12:51:14.312 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:14 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:14.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:14 smithi017 ceph-mon[95536]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:14.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:14 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:14.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:14 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:14.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:14 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:51:14.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:14 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T12:51:14.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:14 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:14.748 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:51:15.301 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:15 smithi135 ceph-mon[97338]: Reconfiguring mon.b (monmap changed)... 2023-07-14T12:51:15.301 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:15 smithi135 ceph-mon[97338]: Reconfiguring daemon mon.b on smithi131 2023-07-14T12:51:15.301 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:15.301 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:15.302 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:51:15.302 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T12:51:15.302 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:15.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:15 smithi017 ceph-mon[95536]: Reconfiguring mon.b (monmap changed)... 2023-07-14T12:51:15.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:15 smithi017 ceph-mon[95536]: Reconfiguring daemon mon.b on smithi131 2023-07-14T12:51:15.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:15.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:15.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:51:15.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T12:51:15.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:15.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:15 smithi131 ceph-mon[96953]: Reconfiguring mon.b (monmap changed)... 2023-07-14T12:51:15.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:15 smithi131 ceph-mon[96953]: Reconfiguring daemon mon.b on smithi131 2023-07-14T12:51:15.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:15.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:15.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T12:51:15.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T12:51:15.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:16.189 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:16 smithi135 ceph-mon[97338]: Reconfiguring mon.c (monmap changed)... 2023-07-14T12:51:16.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:16 smithi135 ceph-mon[97338]: Reconfiguring daemon mon.c on smithi135 2023-07-14T12:51:16.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:16 smithi135 ceph-mon[97338]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:16.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:16 smithi017 ceph-mon[95536]: Reconfiguring mon.c (monmap changed)... 2023-07-14T12:51:16.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:16 smithi017 ceph-mon[95536]: Reconfiguring daemon mon.c on smithi135 2023-07-14T12:51:16.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:16 smithi017 ceph-mon[95536]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:16.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:16 smithi131 ceph-mon[96953]: Reconfiguring mon.c (monmap changed)... 2023-07-14T12:51:16.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:16 smithi131 ceph-mon[96953]: Reconfiguring daemon mon.c on smithi135 2023-07-14T12:51:16.488 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:16 smithi131 ceph-mon[96953]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.621+0000 7f46cfe64700 1 -- 172.21.15.135:0/1744082008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c8072f70 msgr2=0x7f46c80733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.621+0000 7f46cfe64700 1 --2- 172.21.15.135:0/1744082008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c8072f70 0x7f46c80733e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009990 tx=0x7f46b8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:51:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.621+0000 7f46cfe64700 1 -- 172.21.15.135:0/1744082008 shutdown_connections 2023-07-14T12:51:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.621+0000 7f46cfe64700 1 --2- 172.21.15.135:0/1744082008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46c8107a60 0x7f46c8109ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.621+0000 7f46cfe64700 1 --2- 172.21.15.135:0/1744082008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c8074540 0x7f46c80729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.621+0000 7f46cfe64700 1 --2- 172.21.15.135:0/1744082008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c8072f70 0x7f46c80733e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.621+0000 7f46cfe64700 1 -- 172.21.15.135:0/1744082008 >> 172.21.15.135:0/1744082008 conn(0x7f46c80fb1a0 msgr2=0x7f46c80fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:51:16.645 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.621+0000 7f46cfe64700 1 -- 172.21.15.135:0/1744082008 shutdown_connections 2023-07-14T12:51:16.645 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.621+0000 7f46cfe64700 1 -- 172.21.15.135:0/1744082008 wait complete. 2023-07-14T12:51:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.622+0000 7f46cfe64700 1 Processor -- start 2023-07-14T12:51:16.647 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46cfe64700 1 -- start start 2023-07-14T12:51:16.647 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46cfe64700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46c8072f70 0x7f46c81979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:16.647 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46cfe64700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c8074540 0x7f46c8197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:16.647 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46cfe64700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c8107a60 0x7f46c819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:16.647 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46cfe64700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c819f530 con 0x7f46c8072f70 2023-07-14T12:51:16.647 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46cfe64700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c819f670 con 0x7f46c8107a60 2023-07-14T12:51:16.647 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46cfe64700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c819f800 con 0x7f46c8074540 2023-07-14T12:51:16.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46cd3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c8074540 0x7f46c8197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:16.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46cdc00700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46c8072f70 0x7f46c81979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:16.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46cdc00700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46c8072f70 0x7f46c81979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.135:54994/0 (socket says 172.21.15.135:54994) 2023-07-14T12:51:16.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46cdc00700 1 -- 172.21.15.135:0/2484411685 learned_addr learned my addr 172.21.15.135:0/2484411685 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-07-14T12:51:16.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.623+0000 7f46ce401700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c8107a60 0x7f46c819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:16.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46cdc00700 1 -- 172.21.15.135:0/2484411685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c8074540 msgr2=0x7f46c8197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:16.648 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46cdc00700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c8074540 0x7f46c8197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:16.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46cdc00700 1 -- 172.21.15.135:0/2484411685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c8107a60 msgr2=0x7f46c819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:16.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46cdc00700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c8107a60 0x7f46c819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:16.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46cdc00700 1 -- 172.21.15.135:0/2484411685 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b80095f0 con 0x7f46c8072f70 2023-07-14T12:51:16.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46ce401700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c8107a60 0x7f46c819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:51:16.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46cd3ff700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c8074540 0x7f46c8197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:51:16.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46cdc00700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46c8072f70 0x7f46c81979a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46c400d980 tx=0x7f46c400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:51:16.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46beffd700 1 -- 172.21.15.135:0/2484411685 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4009b40 con 0x7f46c8072f70 2023-07-14T12:51:16.649 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46cfe64700 1 -- 172.21.15.135:0/2484411685 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c819fae0 con 0x7f46c8072f70 2023-07-14T12:51:16.650 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46beffd700 1 -- 172.21.15.135:0/2484411685 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46c400b6e0 con 0x7f46c8072f70 2023-07-14T12:51:16.650 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46beffd700 1 -- 172.21.15.135:0/2484411685 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c400f3c0 con 0x7f46c8072f70 2023-07-14T12:51:16.650 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.624+0000 7f46cfe64700 1 -- 172.21.15.135:0/2484411685 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c81a0030 con 0x7f46c8072f70 2023-07-14T12:51:16.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.625+0000 7f46cfe64700 1 -- 172.21.15.135:0/2484411685 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c8106110 con 0x7f46c8072f70 2023-07-14T12:51:16.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.625+0000 7f46beffd700 1 -- 172.21.15.135:0/2484411685 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f46c4010460 con 0x7f46c8072f70 2023-07-14T12:51:16.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.626+0000 7f46beffd700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f46b40389e0 0x7f46b403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:16.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.626+0000 7f46beffd700 1 -- 172.21.15.135:0/2484411685 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f46c404b2a0 con 0x7f46c8072f70 2023-07-14T12:51:16.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.626+0000 7f46cd3ff700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f46b40389e0 0x7f46b403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:16.651 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.627+0000 7f46cd3ff700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f46b40389e0 0x7f46b403ae90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f46b80059d0 tx=0x7f46b8005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:51:16.653 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.631+0000 7f46beffd700 1 -- 172.21.15.135:0/2484411685 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f46c401aa00 con 0x7f46c8072f70 2023-07-14T12:51:16.858 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.836+0000 7f46cfe64700 1 -- 172.21.15.135:0/2484411685 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi131=y;smithi135=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f46c8060950 con 0x7f46b40389e0 2023-07-14T12:51:16.864 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.842+0000 7f46beffd700 1 -- 172.21.15.135:0/2484411685 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f46c8060950 con 0x7f46b40389e0 2023-07-14T12:51:16.865 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mgr update... 2023-07-14T12:51:16.867 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 -- 172.21.15.135:0/2484411685 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f46b40389e0 msgr2=0x7f46b403ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:16.867 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f46b40389e0 0x7f46b403ae90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f46b80059d0 tx=0x7f46b8005960 comp rx=0 tx=0).stop 2023-07-14T12:51:16.867 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 -- 172.21.15.135:0/2484411685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46c8072f70 msgr2=0x7f46c81979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:16.867 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46c8072f70 0x7f46c81979a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46c400d980 tx=0x7f46c400dc90 comp rx=0 tx=0).stop 2023-07-14T12:51:16.867 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 -- 172.21.15.135:0/2484411685 shutdown_connections 2023-07-14T12:51:16.867 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f46b40389e0 0x7f46b403ae90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:16.868 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c8107a60 0x7f46c819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:16.868 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46c8072f70 0x7f46c81979a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:16.868 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 --2- 172.21.15.135:0/2484411685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c8074540 0x7f46c8197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:16.868 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 -- 172.21.15.135:0/2484411685 >> 172.21.15.135:0/2484411685 conn(0x7f46c80fb1a0 msgr2=0x7f46c80fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:51:16.868 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 -- 172.21.15.135:0/2484411685 shutdown_connections 2023-07-14T12:51:16.868 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:51:16.845+0000 7f46cfe64700 1 -- 172.21.15.135:0/2484411685 wait complete. 2023-07-14T12:51:17.562 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.563 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.563 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:17.563 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:17.563 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi131=y;smithi135=z", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:51:17.563 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: Saving service mgr spec with placement smithi017=x;smithi131=y;smithi135=z;count:3 2023-07-14T12:51:17.563 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.563 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:17.564 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:17.564 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.564 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T12:51:17.564 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T12:51:17.564 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T12:51:17.564 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:17.565 DEBUG:teuthology.orchestra.run.smithi131:mgr.y> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.y.service 2023-07-14T12:51:17.570 DEBUG:teuthology.orchestra.run.smithi135:mgr.z> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.z.service 2023-07-14T12:51:17.574 INFO:tasks.cephadm:Deploying OSDs... 2023-07-14T12:51:17.575 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:51:17.575 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T12:51:17.619 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T12:51:17.620 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2023-07-14T12:51:17.645 INFO:journalctl@ceph.mgr.z.smithi135.stdout:-- Logs begin at Fri 2023-07-14 12:26:36 UTC. -- 2023-07-14T12:51:17.646 INFO:journalctl@ceph.mgr.y.smithi131.stdout:-- Logs begin at Fri 2023-07-14 12:26:41 UTC. -- 2023-07-14T12:51:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T12:51:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:17.705 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 446 Links: 1 2023-07-14T12:51:17.705 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:17.705 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:17.705 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-07-14 12:50:16.769539088 +0000 2023-07-14T12:51:17.705 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-07-14 12:39:36.581205684 +0000 2023-07-14T12:51:17.705 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-07-14 12:39:36.581205684 +0000 2023-07-14T12:51:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-07-14 12:39:36.557205963 +0000 2023-07-14T12:51:17.706 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T12:51:17.738 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:17.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:17.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi131=y;smithi135=z", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:51:17.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: Saving service mgr spec with placement smithi017=x;smithi131=y;smithi135=z;count:3 2023-07-14T12:51:17.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:17.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:17.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T12:51:17.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T12:51:17.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T12:51:17.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:17.805 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.805 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:17.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:17.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='client.14208 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi017=x;smithi131=y;smithi135=z", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:51:17.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: Saving service mgr spec with placement smithi017=x;smithi131=y;smithi135=z;count:3 2023-07-14T12:51:17.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:17.806 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:17.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:17.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T12:51:17.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T12:51:17.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T12:51:17.807 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:17.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-07-14T12:51:17.812 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-07-14T12:51:17.812 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000183344 s, 2.8 MB/s 2023-07-14T12:51:17.814 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T12:51:17.859 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2023-07-14T12:51:17.943 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T12:51:17.944 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:17.944 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-07-14T12:51:17.944 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:17.944 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:17.944 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-07-14 12:50:16.769539088 +0000 2023-07-14T12:51:17.944 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-07-14 12:39:37.431195790 +0000 2023-07-14T12:51:17.945 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-07-14 12:39:37.431195790 +0000 2023-07-14T12:51:17.945 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-07-14 12:39:37.408196058 +0000 2023-07-14T12:51:17.945 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T12:51:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-07-14T12:51:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-07-14T12:51:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000182519 s, 2.8 MB/s 2023-07-14T12:51:18.052 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T12:51:18.097 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2023-07-14T12:51:18.180 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T12:51:18.181 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:18.181 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-07-14T12:51:18.181 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:18.181 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:18.181 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-07-14 12:50:16.769539088 +0000 2023-07-14T12:51:18.181 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-07-14 12:39:38.279185920 +0000 2023-07-14T12:51:18.181 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-07-14 12:39:38.279185920 +0000 2023-07-14T12:51:18.182 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-07-14 12:39:38.255186199 +0000 2023-07-14T12:51:18.182 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T12:51:18.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-07-14T12:51:18.286 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-07-14T12:51:18.287 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000188466 s, 2.7 MB/s 2023-07-14T12:51:18.289 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T12:51:18.333 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2023-07-14T12:51:18.417 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T12:51:18.417 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:18.418 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-07-14T12:51:18.418 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:18.418 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:18.418 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2023-07-14 12:50:16.769539088 +0000 2023-07-14T12:51:18.418 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2023-07-14 12:39:39.123176096 +0000 2023-07-14T12:51:18.418 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2023-07-14 12:39:39.123176096 +0000 2023-07-14T12:51:18.419 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2023-07-14 12:39:39.100176364 +0000 2023-07-14T12:51:18.419 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T12:51:18.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2023-07-14T12:51:18.523 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2023-07-14T12:51:18.524 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.00018709 s, 2.7 MB/s 2023-07-14T12:51:18.526 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T12:51:18.571 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-07-14T12:51:18.571 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T12:51:18.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:18 smithi017 ceph-mon[95536]: Deploying daemon mgr.z on smithi135 2023-07-14T12:51:18.619 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T12:51:18.619 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2023-07-14T12:51:18.665 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T12:51:18.666 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:18.666 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 446 Links: 1 2023-07-14T12:51:18.666 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:18.666 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:18.666 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-07-14 12:51:01.819420878 +0000 2023-07-14T12:51:18.666 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-07-14 12:39:24.858990555 +0000 2023-07-14T12:51:18.666 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-07-14 12:39:24.858990555 +0000 2023-07-14T12:51:18.667 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2023-07-14 12:39:24.828991211 +0000 2023-07-14T12:51:18.667 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T12:51:18.681 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:18 smithi135 ceph-mon[97338]: Deploying daemon mgr.z on smithi135 2023-07-14T12:51:18.738 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:18 smithi131 ceph-mon[96953]: Deploying daemon mgr.z on smithi135 2023-07-14T12:51:18.771 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-07-14T12:51:18.772 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-07-14T12:51:18.772 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000310894 s, 1.6 MB/s 2023-07-14T12:51:18.774 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T12:51:18.859 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2023-07-14T12:51:18.942 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T12:51:18.942 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:18.943 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-07-14T12:51:18.943 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:18.943 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:18.943 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-07-14 12:51:01.819420878 +0000 2023-07-14T12:51:18.943 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-07-14 12:39:25.679972602 +0000 2023-07-14T12:51:18.943 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-07-14 12:39:25.679972602 +0000 2023-07-14T12:51:18.943 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2023-07-14 12:39:25.652973192 +0000 2023-07-14T12:51:18.944 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T12:51:19.047 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-07-14T12:51:19.047 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-07-14T12:51:19.047 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000316452 s, 1.6 MB/s 2023-07-14T12:51:19.049 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T12:51:19.095 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2023-07-14T12:51:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T12:51:19.178 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:19.178 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-07-14T12:51:19.179 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:19.179 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:19.179 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-07-14 12:51:01.819420878 +0000 2023-07-14T12:51:19.179 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-07-14 12:39:26.523954145 +0000 2023-07-14T12:51:19.179 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-07-14 12:39:26.523954145 +0000 2023-07-14T12:51:19.179 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2023-07-14 12:39:26.498954692 +0000 2023-07-14T12:51:19.180 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T12:51:19.283 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-07-14T12:51:19.283 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-07-14T12:51:19.283 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000316468 s, 1.6 MB/s 2023-07-14T12:51:19.285 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T12:51:19.330 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2023-07-14T12:51:19.414 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T12:51:19.414 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:19.414 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-07-14T12:51:19.415 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:19.415 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:19.415 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-07-14 12:51:01.819420878 +0000 2023-07-14T12:51:19.415 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-07-14 12:39:27.361935820 +0000 2023-07-14T12:51:19.415 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-07-14 12:39:27.361935820 +0000 2023-07-14T12:51:19.415 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2023-07-14 12:39:27.333936432 +0000 2023-07-14T12:51:19.416 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T12:51:19.438 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:19 smithi135 systemd[1]: Starting Ceph mgr.z for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:51:19.519 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-07-14T12:51:19.520 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-07-14T12:51:19.520 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.00033339 s, 1.5 MB/s 2023-07-14T12:51:19.522 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T12:51:19.566 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2023-07-14T12:51:19.567 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T12:51:19.617 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T12:51:19.617 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2023-07-14T12:51:19.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:19 smithi135 ceph-mon[97338]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:19.702 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T12:51:19.702 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:19.702 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 446 Links: 1 2023-07-14T12:51:19.703 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:19.703 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:19.703 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-07-14 12:51:19.108021147 +0000 2023-07-14T12:51:19.703 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-07-14 12:39:24.938787690 +0000 2023-07-14T12:51:19.703 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-07-14 12:39:24.938787690 +0000 2023-07-14T12:51:19.703 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-07-14 12:39:24.912788259 +0000 2023-07-14T12:51:19.703 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T12:51:19.738 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:19 smithi131 ceph-mon[96953]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:19.814 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-07-14T12:51:19.815 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-07-14T12:51:19.815 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000275657 s, 1.9 MB/s 2023-07-14T12:51:19.817 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T12:51:19.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:19 smithi017 ceph-mon[95536]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:19.864 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2023-07-14T12:51:19.908 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T12:51:19.908 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:19.908 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-07-14T12:51:19.909 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:19.909 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:19.909 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-07-14 12:51:19.109021125 +0000 2023-07-14T12:51:19.909 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-07-14 12:39:25.773769409 +0000 2023-07-14T12:51:19.909 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-07-14 12:39:25.773769409 +0000 2023-07-14T12:51:19.909 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-07-14 12:39:25.746770000 +0000 2023-07-14T12:51:19.910 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T12:51:19.984 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:19 smithi135 podman[99180]: 2023-07-14T12:51:20.016 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-07-14T12:51:20.016 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-07-14T12:51:20.016 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000325819 s, 1.6 MB/s 2023-07-14T12:51:20.019 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T12:51:20.106 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2023-07-14T12:51:20.153 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T12:51:20.153 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:20.153 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-07-14T12:51:20.153 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:20.153 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:20.153 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-07-14 12:51:19.109021125 +0000 2023-07-14T12:51:20.154 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-07-14 12:39:26.604751217 +0000 2023-07-14T12:51:20.154 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-07-14 12:39:26.604751217 +0000 2023-07-14T12:51:20.154 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-07-14 12:39:26.579751764 +0000 2023-07-14T12:51:20.154 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T12:51:20.216 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:19 smithi135 ceph-mgr[99319]: -- 172.21.15.135:0/1075871356 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5570f2fe51e0 con 0x5570f2fbac00 2023-07-14T12:51:20.216 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:19 smithi135 bash[99180]: 5145a0aa431846fd2945b30782e0414388a69b8cbab635ccebc8da6830233608 2023-07-14T12:51:20.216 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:20 smithi135 systemd[1]: Started Ceph mgr.z for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:51:20.216 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:20.148+0000 7f9d5f89b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:51:20.224 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-07-14T12:51:20.224 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-07-14T12:51:20.224 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000286151 s, 1.8 MB/s 2023-07-14T12:51:20.228 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T12:51:20.273 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2023-07-14T12:51:20.317 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T12:51:20.317 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T12:51:20.317 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-07-14T12:51:20.318 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T12:51:20.318 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T12:51:20.318 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2023-07-14 12:51:19.109021125 +0000 2023-07-14T12:51:20.318 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2023-07-14 12:39:27.432733090 +0000 2023-07-14T12:51:20.318 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2023-07-14 12:39:27.432733090 +0000 2023-07-14T12:51:20.318 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2023-07-14 12:39:27.406733659 +0000 2023-07-14T12:51:20.319 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T12:51:20.424 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2023-07-14T12:51:20.425 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2023-07-14T12:51:20.425 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000324272 s, 1.6 MB/s 2023-07-14T12:51:20.427 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T12:51:20.472 INFO:tasks.cephadm:Deploying osd.0 on smithi017 with /dev/vg_nvme/lv_4... 2023-07-14T12:51:20.472 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-14T12:51:20.536 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:20.263+0000 7f9d5f89b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:51:20.536 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:20.386+0000 7f9d5f89b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:51:20.536 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:20.514+0000 7f9d5f89b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:51:20.939 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:20.730+0000 7f9d5f89b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:51:21.203 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:51:21.344 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:21.344 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:21.345 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:21.345 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T12:51:21.345 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T12:51:21.345 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T12:51:21.345 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:21.345 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:21 smithi131 ceph-mon[96953]: Deploying daemon mgr.y on smithi131 2023-07-14T12:51:21.345 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:21 smithi131 ceph-mon[96953]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:21.420 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:21.122+0000 7f9d5f89b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:51:21.420 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:21.237+0000 7f9d5f89b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:51:21.421 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:21.421 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:21.421 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:21.421 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T12:51:21.421 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T12:51:21.421 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T12:51:21.422 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:21.422 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-mon[97338]: Deploying daemon mgr.y on smithi131 2023-07-14T12:51:21.422 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-mon[97338]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:21.466 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:21.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:21.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:21.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T12:51:21.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T12:51:21.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T12:51:21.467 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:21.468 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:21 smithi017 ceph-mon[95536]: Deploying daemon mgr.y on smithi131 2023-07-14T12:51:21.468 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:21 smithi017 ceph-mon[95536]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:21.689 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:21.398+0000 7f9d5f89b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:51:21.690 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:21.520+0000 7f9d5f89b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:51:22.439 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:22.054+0000 7f9d5f89b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:51:22.488 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:22 smithi131 systemd[1]: Starting Ceph mgr.y for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:51:23.095 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:22 smithi131 podman[98393]: 2023-07-14T12:51:23.095 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:23 smithi131 bash[98393]: 6fc4954832a5f5e58cd5cfd0c9f2c1807937eb6fb27d38249aebfb531787c5b4 2023-07-14T12:51:23.189 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:22.825+0000 7f9d5f89b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T12:51:23.190 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:23.033+0000 7f9d5f89b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:51:23.230 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-14T12:51:23.230 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-14T12:51:23.230 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2023-07-14T12:51:23.231 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2023-07-14T12:51:23.231 INFO:teuthology.orchestra.run.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0321972 s, 326 MB/s 2023-07-14T12:51:23.231 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2023-07-14T12:51:23.380 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-mgr[98433]: -- 172.21.15.131:0/397070026 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dd8ed271e0 con 0x55dd8ecfc800 2023-07-14T12:51:23.380 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:23 smithi131 systemd[1]: Started Ceph mgr.y for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:51:23.380 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:23.252+0000 7fdb6548a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:51:23.738 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:23.357+0000 7fdb6548a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:51:23.738 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:23.480+0000 7fdb6548a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:51:23.739 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:23.601+0000 7fdb6548a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:51:23.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi017:vg_nvme/lv_4 2023-07-14T12:51:24.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:23 smithi017 ceph-mon[95536]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:24.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:24.158 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:24.009+0000 7f9d5f89b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:51:24.158 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:24.136+0000 7f9d5f89b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:51:24.159 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:23 smithi135 ceph-mon[97338]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:24.159 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:23 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.159 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:23 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.159 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:23 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.159 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:23 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.159 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:23 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:24.238 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:23.832+0000 7fdb6548a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:51:24.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-mon[96953]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:24.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:24.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:23 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:24.440 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:24.364+0000 7f9d5f89b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:51:24.508 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:51:24.575 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:24 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:24.257+0000 7fdb6548a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:51:24.575 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:24 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:24.381+0000 7fdb6548a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:51:24.988 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:24 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:24.552+0000 7fdb6548a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:51:24.989 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:24 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:24.681+0000 7fdb6548a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:51:25.079 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:24.762+0000 7f9d5f89b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T12:51:25.440 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:25.056+0000 7f9d5f89b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:51:25.440 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:25.257+0000 7f9d5f89b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:51:25.738 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:25 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:25.253+0000 7fdb6548a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:51:25.940 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:25.636+0000 7f9d5f89b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:51:25.940 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:25 smithi135 ceph-mon[97338]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:25.940 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:25.940 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:25.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:25.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:25.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:25.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:25.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:25.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.970+0000 7f7037402700 1 -- 172.21.15.17:0/3181924952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7030107a60 msgr2=0x7f7030109ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:25.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.970+0000 7f7037402700 1 --2- 172.21.15.17:0/3181924952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7030107a60 0x7f7030109ea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f702800b0a0 tx=0x7f702800b3b0 comp rx=0 tx=0).stop 2023-07-14T12:51:25.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.970+0000 7f7037402700 1 -- 172.21.15.17:0/3181924952 shutdown_connections 2023-07-14T12:51:25.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.970+0000 7f7037402700 1 --2- 172.21.15.17:0/3181924952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7030107a60 0x7f7030109ea0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:25.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.970+0000 7f7037402700 1 --2- 172.21.15.17:0/3181924952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030074540 0x7f70300729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:25.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.970+0000 7f7037402700 1 --2- 172.21.15.17:0/3181924952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7030072f70 0x7f70300733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:25.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.970+0000 7f7037402700 1 -- 172.21.15.17:0/3181924952 >> 172.21.15.17:0/3181924952 conn(0x7f70300fb1a0 msgr2=0x7f70300fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:51:25.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.970+0000 7f7037402700 1 -- 172.21.15.17:0/3181924952 shutdown_connections 2023-07-14T12:51:25.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.970+0000 7f7037402700 1 -- 172.21.15.17:0/3181924952 wait complete. 2023-07-14T12:51:25.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.971+0000 7f7037402700 1 Processor -- start 2023-07-14T12:51:25.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.971+0000 7f7037402700 1 -- start start 2023-07-14T12:51:25.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.971+0000 7f7037402700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7030072f70 0x7f7030197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:25.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f7037402700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030074540 0x7f7030197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:25.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f7037402700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7030107a60 0x7f703019f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:25.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f7037402700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703019f5e0 con 0x7f7030072f70 2023-07-14T12:51:25.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f7037402700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703019f720 con 0x7f7030074540 2023-07-14T12:51:25.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f7037402700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703019f8b0 con 0x7f7030107a60 2023-07-14T12:51:25.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f703519e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7030072f70 0x7f7030197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:25.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f703499d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030074540 0x7f7030197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:25.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f703519e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7030072f70 0x7f7030197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55130/0 (socket says 172.21.15.17:55130) 2023-07-14T12:51:25.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f703519e700 1 -- 172.21.15.17:0/621824656 learned_addr learned my addr 172.21.15.17:0/621824656 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:51:25.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f703599f700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7030107a60 0x7f703019f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:25.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f703519e700 1 -- 172.21.15.17:0/621824656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7030107a60 msgr2=0x7f703019f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:25.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f703519e700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7030107a60 0x7f703019f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:25.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f703519e700 1 -- 172.21.15.17:0/621824656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030074540 msgr2=0x7f7030197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:25.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f703519e700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030074540 0x7f7030197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:25.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f703519e700 1 -- 172.21.15.17:0/621824656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7028009d00 con 0x7f7030072f70 2023-07-14T12:51:25.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.972+0000 7f703499d700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030074540 0x7f7030197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:51:25.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.973+0000 7f703519e700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7030072f70 0x7f7030197a50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f702c00d9b0 tx=0x7f702c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:51:25.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.973+0000 7f70267fc700 1 -- 172.21.15.17:0/621824656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c004220 con 0x7f7030072f70 2023-07-14T12:51:25.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.973+0000 7f70267fc700 1 -- 172.21.15.17:0/621824656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f702c007640 con 0x7f7030072f70 2023-07-14T12:51:25.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.973+0000 7f7037402700 1 -- 172.21.15.17:0/621824656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703019fb90 con 0x7f7030072f70 2023-07-14T12:51:25.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.973+0000 7f70267fc700 1 -- 172.21.15.17:0/621824656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c005480 con 0x7f7030072f70 2023-07-14T12:51:25.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.973+0000 7f7037402700 1 -- 172.21.15.17:0/621824656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70301a00e0 con 0x7f7030072f70 2023-07-14T12:51:25.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.974+0000 7f70267fc700 1 -- 172.21.15.17:0/621824656 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45539+0+0 (secure 0 0 0) 0x7f702c0055e0 con 0x7f7030072f70 2023-07-14T12:51:25.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.974+0000 7f7037402700 1 -- 172.21.15.17:0/621824656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7030106110 con 0x7f7030072f70 2023-07-14T12:51:26.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.975+0000 7f70267fc700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f701c0389e0 0x7f701c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:26.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.975+0000 7f70267fc700 1 -- 172.21.15.17:0/621824656 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f702c04b2b0 con 0x7f7030072f70 2023-07-14T12:51:26.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.975+0000 7f703499d700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f701c0389e0 0x7f701c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:26.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.975+0000 7f703499d700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f701c0389e0 0x7f701c03ae90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7020011490 tx=0x7f7020009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:51:26.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:25.980+0000 7f70267fc700 1 -- 172.21.15.17:0/621824656 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f702c022350 con 0x7f7030072f70 2023-07-14T12:51:26.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:25 smithi017 ceph-mon[95536]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:26.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:26.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:26.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:26.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:26.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:26.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:26.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:26.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:26.199+0000 7f7037402700 1 -- 172.21.15.17:0/621824656 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7030060950 con 0x7f701c0389e0 2023-07-14T12:51:26.238 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:26 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:26.051+0000 7fdb6548a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T12:51:26.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:25 smithi131 ceph-mon[96953]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:26.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:26.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:26.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:26.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:26.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:26.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:26.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:26.738 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:26 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:26.258+0000 7fdb6548a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:51:26.940 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:26.572+0000 7f9d5f89b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:51:26.940 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:26.743+0000 7f9d5f89b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:51:26.940 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-mon[97338]: Reconfiguring mgr.x (unknown last config time)... 2023-07-14T12:51:26.940 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T12:51:26.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T12:51:26.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:26.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-mon[97338]: Reconfiguring daemon mgr.x on smithi017 2023-07-14T12:51:26.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:51:26.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:51:26.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:26.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:27.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:26 smithi017 ceph-mon[95536]: Reconfiguring mgr.x (unknown last config time)... 2023-07-14T12:51:27.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:26 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T12:51:27.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:26 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T12:51:27.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:26 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:27.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:26 smithi017 ceph-mon[95536]: Reconfiguring daemon mgr.x on smithi017 2023-07-14T12:51:27.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:26 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:51:27.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:26 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:51:27.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:26 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:27.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:26 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:27.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:26 smithi131 ceph-mon[96953]: Reconfiguring mgr.x (unknown last config time)... 2023-07-14T12:51:27.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:26 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T12:51:27.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:26 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T12:51:27.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:26 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:27.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:26 smithi131 ceph-mon[96953]: Reconfiguring daemon mgr.x on smithi017 2023-07-14T12:51:27.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:26 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:51:27.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:26 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:51:27.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:26 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:27.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:26 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:27.432 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:26.989+0000 7f9d5f89b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:51:27.433 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:27.136+0000 7f9d5f89b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:51:27.488 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:27.192+0000 7fdb6548a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:51:27.489 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:27.309+0000 7fdb6548a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:51:27.690 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:27.410+0000 7f9d5f89b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:51:27.841 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:27.526+0000 7fdb6548a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:51:28.059 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:27 smithi017 ceph-mon[95536]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:51:28.060 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:27 smithi017 ceph-mon[95536]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:28.060 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:28.060 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:28.060 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:28.060 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:28.060 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:28.061 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:28.188 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:27.892+0000 7fdb6548a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T12:51:28.189 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-mon[96953]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:51:28.189 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-mon[96953]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:28.189 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:28.189 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:28.189 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:28.190 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:28.190 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:28.190 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:28.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:27 smithi135 ceph-mon[97338]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:51:28.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:27 smithi135 ceph-mon[97338]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:28.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:28.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:28.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:28.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:28.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:28.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:28.488 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:28 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:28.166+0000 7fdb6548a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:51:28.488 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:28 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:28.352+0000 7fdb6548a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:51:28.848 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:51:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:51:28.486+0000 7f9d5f89b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:51:28.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:28.829+0000 7f70267fc700 1 -- 172.21.15.17:0/621824656 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 14) v1 ==== 90599+0+0 (secure 0 0 0) 0x7f702c0036d0 con 0x7f7030072f70 2023-07-14T12:51:28.988 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:28 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:28.686+0000 7fdb6548a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:51:28.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:28 smithi131 ceph-mon[96953]: Standby manager daemon z started 2023-07-14T12:51:28.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:28 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-14T12:51:28.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:28 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:51:28.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:28 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-14T12:51:28.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:28 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:51:29.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:28 smithi017 ceph-mon[95536]: Standby manager daemon z started 2023-07-14T12:51:29.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:28 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-14T12:51:29.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:28 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:51:29.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:28 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-14T12:51:29.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:28 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:51:29.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:28 smithi135 ceph-mon[97338]: Standby manager daemon z started 2023-07-14T12:51:29.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:28 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-14T12:51:29.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:28 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:51:29.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:28 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-14T12:51:29.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:28 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.135:0/4188454272' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:51:29.988 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:29 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:29.604+0000 7fdb6548a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:51:29.989 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:29 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:29.774+0000 7fdb6548a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:51:29.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:29 smithi131 ceph-mon[96953]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:29.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:29 smithi131 ceph-mon[96953]: mgrmap e14: x(active, since 82s), standbys: z 2023-07-14T12:51:29.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-14T12:51:29.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:29 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2768616786' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5de7a33f-905e-4374-bf3b-95ca11eee3c5"}]: dispatch 2023-07-14T12:51:29.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:29 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2768616786' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5de7a33f-905e-4374-bf3b-95ca11eee3c5"}]': finished 2023-07-14T12:51:29.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:29 smithi131 ceph-mon[96953]: osdmap e5: 1 total, 0 up, 1 in 2023-07-14T12:51:29.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:30.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:29 smithi135 ceph-mon[97338]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:30.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:29 smithi135 ceph-mon[97338]: mgrmap e14: x(active, since 82s), standbys: z 2023-07-14T12:51:30.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-14T12:51:30.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:29 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2768616786' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5de7a33f-905e-4374-bf3b-95ca11eee3c5"}]: dispatch 2023-07-14T12:51:30.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:29 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2768616786' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5de7a33f-905e-4374-bf3b-95ca11eee3c5"}]': finished 2023-07-14T12:51:30.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:29 smithi135 ceph-mon[97338]: osdmap e5: 1 total, 0 up, 1 in 2023-07-14T12:51:30.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:30.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:29 smithi017 ceph-mon[95536]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:30.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:29 smithi017 ceph-mon[95536]: mgrmap e14: x(active, since 82s), standbys: z 2023-07-14T12:51:30.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-14T12:51:30.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:29 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2768616786' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5de7a33f-905e-4374-bf3b-95ca11eee3c5"}]: dispatch 2023-07-14T12:51:30.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:29 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2768616786' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5de7a33f-905e-4374-bf3b-95ca11eee3c5"}]': finished 2023-07-14T12:51:30.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:29 smithi017 ceph-mon[95536]: osdmap e5: 1 total, 0 up, 1 in 2023-07-14T12:51:30.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:30.455 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:30 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:30.015+0000 7fdb6548a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:51:30.455 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:30 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:30.161+0000 7fdb6548a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:51:30.456 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:30 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:30.432+0000 7fdb6548a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:51:31.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:30 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3903062589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:51:31.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:30 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3903062589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:51:31.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:30 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3903062589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:51:31.855 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:51:31 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:51:31.486+0000 7fdb6548a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:51:31.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:31.844+0000 7f70267fc700 1 -- 172.21.15.17:0/621824656 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f702c07d4d0 con 0x7f7030072f70 2023-07-14T12:51:32.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:31 smithi135 ceph-mon[97338]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:32.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:31 smithi135 ceph-mon[97338]: Standby manager daemon y started 2023-07-14T12:51:32.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:31 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-14T12:51:32.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:31 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:51:32.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:31 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-14T12:51:32.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:31 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:51:32.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:31 smithi131 ceph-mon[96953]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:32.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:31 smithi131 ceph-mon[96953]: Standby manager daemon y started 2023-07-14T12:51:32.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:31 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-14T12:51:32.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:31 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:51:32.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:31 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-14T12:51:32.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:31 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:51:32.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:31 smithi017 ceph-mon[95536]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:32.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:31 smithi017 ceph-mon[95536]: Standby manager daemon y started 2023-07-14T12:51:32.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:31 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-14T12:51:32.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:31 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:51:32.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:31 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-14T12:51:32.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:31 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.131:0/3571059708' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:51:33.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:32 smithi135 ceph-mon[97338]: mgrmap e15: x(active, since 85s), standbys: z, y 2023-07-14T12:51:33.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-14T12:51:33.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:32 smithi131 ceph-mon[96953]: mgrmap e15: x(active, since 85s), standbys: z, y 2023-07-14T12:51:33.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-14T12:51:33.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:32 smithi017 ceph-mon[95536]: mgrmap e15: x(active, since 85s), standbys: z, y 2023-07-14T12:51:33.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-14T12:51:34.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:33 smithi017 ceph-mon[95536]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:34.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:33 smithi135 ceph-mon[97338]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:34.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:33 smithi131 ceph-mon[96953]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:36.006 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:35 smithi017 ceph-mon[95536]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:36.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:35 smithi135 ceph-mon[97338]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:36.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:35 smithi131 ceph-mon[96953]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:38.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:37 smithi135 ceph-mon[97338]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:38.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:37 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-14T12:51:38.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:37 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:38.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:37 smithi131 ceph-mon[96953]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:38.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:37 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-14T12:51:38.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:37 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:38.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:37 smithi017 ceph-mon[95536]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:38.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:37 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-14T12:51:38.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:37 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:39.015 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:38 smithi017 ceph-mon[95536]: Deploying daemon osd.0 on smithi017 2023-07-14T12:51:39.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:38 smithi135 ceph-mon[97338]: Deploying daemon osd.0 on smithi017 2023-07-14T12:51:39.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:38 smithi131 ceph-mon[96953]: Deploying daemon osd.0 on smithi017 2023-07-14T12:51:40.141 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:39 smithi017 ceph-mon[95536]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:40.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:39 smithi135 ceph-mon[97338]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:40.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:39 smithi131 ceph-mon[96953]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:42.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:41 smithi135 ceph-mon[97338]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:42.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:41 smithi131 ceph-mon[96953]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:42.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:41 smithi017 ceph-mon[95536]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:44.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:43 smithi135 ceph-mon[97338]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:44.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:43 smithi131 ceph-mon[96953]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:44.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:43 smithi017 ceph-mon[95536]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:45.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:45.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:45.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:45.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:45.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:45.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:45.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:45.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:45.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:46.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:45 smithi017 ceph-mon[95536]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:46.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:45 smithi131 ceph-mon[96953]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:46.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:45 smithi135 ceph-mon[97338]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:47.551 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 0 on host 'smithi017' 2023-07-14T12:51:47.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.528+0000 7f70267fc700 1 -- 172.21.15.17:0/621824656 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7030060950 con 0x7f701c0389e0 2023-07-14T12:51:47.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 -- 172.21.15.17:0/621824656 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f701c0389e0 msgr2=0x7f701c03ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:47.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f701c0389e0 0x7f701c03ae90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7020011490 tx=0x7f7020009260 comp rx=0 tx=0).stop 2023-07-14T12:51:47.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 -- 172.21.15.17:0/621824656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7030072f70 msgr2=0x7f7030197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:47.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7030072f70 0x7f7030197a50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f702c00d9b0 tx=0x7f702c00dcc0 comp rx=0 tx=0).stop 2023-07-14T12:51:47.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 -- 172.21.15.17:0/621824656 shutdown_connections 2023-07-14T12:51:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f701c0389e0 0x7f701c03ae90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7030107a60 0x7f703019f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7030072f70 0x7f7030197a50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 --2- 172.21.15.17:0/621824656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030074540 0x7f7030197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 -- 172.21.15.17:0/621824656 >> 172.21.15.17:0/621824656 conn(0x7f70300fb1a0 msgr2=0x7f70300fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:51:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 -- 172.21.15.17:0/621824656 shutdown_connections 2023-07-14T12:51:47.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:51:47.531+0000 7f7037402700 1 -- 172.21.15.17:0/621824656 wait complete. 2023-07-14T12:51:47.743 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.743 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.743 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:47.743 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:47.744 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.744 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:47 smithi017 ceph-mon[95536]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:47.744 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.744 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.744 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:47.940 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:47.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:47.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:47 smithi135 ceph-mon[97338]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:47.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.942 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:47.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:47.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:47.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:47 smithi131 ceph-mon[96953]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:47.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:47.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:51:48.042 DEBUG:teuthology.orchestra.run.smithi017:osd.0> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.0.service 2023-07-14T12:51:48.047 INFO:tasks.cephadm:Deploying osd.1 on smithi131 with /dev/vg_nvme/lv_4... 2023-07-14T12:51:48.047 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-14T12:51:48.123 INFO:journalctl@ceph.osd.0.smithi017.stdout:-- Logs begin at Fri 2023-07-14 12:26:45 UTC. -- 2023-07-14T12:51:48.772 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T12:51:48.940 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:48 smithi135 ceph-mon[97338]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-14T12:51:48.957 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:48 smithi017 ceph-mon[95536]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-14T12:51:48.988 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:48 smithi131 ceph-mon[96953]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-14T12:51:49.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:49 smithi131 ceph-mon[96953]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-14T12:51:49.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:49 smithi131 ceph-mon[96953]: osdmap e6: 1 total, 0 up, 1 in 2023-07-14T12:51:49.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:49 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:49.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:49 smithi131 ceph-mon[96953]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:51:49.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:49 smithi131 ceph-mon[96953]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:50.099 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 12:51:49 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-0[107780]: 2023-07-14T12:51:49.682+0000 7fb800481700 -1 osd.0 0 waiting for initial osdmap 2023-07-14T12:51:50.099 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 12:51:49 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-0[107780]: 2023-07-14T12:51:49.687+0000 7fb7f9a71700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:51:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:49 smithi017 ceph-mon[95536]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-14T12:51:50.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:49 smithi017 ceph-mon[95536]: osdmap e6: 1 total, 0 up, 1 in 2023-07-14T12:51:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:49 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:49 smithi017 ceph-mon[95536]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:51:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:49 smithi017 ceph-mon[95536]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:50.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:49 smithi135 ceph-mon[97338]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-14T12:51:50.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:49 smithi135 ceph-mon[97338]: osdmap e6: 1 total, 0 up, 1 in 2023-07-14T12:51:50.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:49 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:50.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:49 smithi135 ceph-mon[97338]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:51:50.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:49 smithi135 ceph-mon[97338]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:50.760 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-14T12:51:50.760 INFO:teuthology.orchestra.run.smithi131.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-14T12:51:50.760 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10+0 records in 2023-07-14T12:51:50.760 INFO:teuthology.orchestra.run.smithi131.stderr:10+0 records out 2023-07-14T12:51:50.761 INFO:teuthology.orchestra.run.smithi131.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0389472 s, 269 MB/s 2023-07-14T12:51:50.761 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping successful for: 2023-07-14T12:51:50.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:50 smithi017 ceph-mon[95536]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:51:50.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:50 smithi017 ceph-mon[95536]: osdmap e7: 1 total, 0 up, 1 in 2023-07-14T12:51:50.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:50 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:50.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:50 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:50.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:50 smithi131 ceph-mon[96953]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:51:50.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:50 smithi131 ceph-mon[96953]: osdmap e7: 1 total, 0 up, 1 in 2023-07-14T12:51:50.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:50 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:50.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:50 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:51.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:50 smithi135 ceph-mon[97338]: from='osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:51:51.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:50 smithi135 ceph-mon[97338]: osdmap e7: 1 total, 0 up, 1 in 2023-07-14T12:51:51.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:50 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:51.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:50 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:51.243 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi131:vg_nvme/lv_4 2023-07-14T12:51:51.959 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T12:51:51.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:51:51.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:51:51.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788] boot 2023-07-14T12:51:51.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: osdmap e8: 1 total, 1 up, 1 in 2023-07-14T12:51:51.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:51.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:51.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi017 2023-07-14T12:51:51.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:51.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:51.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:51:51.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi017 to 17272M 2023-07-14T12:51:51.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:51.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:51.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:51.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:52.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:51:52.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:51:52.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788] boot 2023-07-14T12:51:52.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: osdmap e8: 1 total, 1 up, 1 in 2023-07-14T12:51:52.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:52.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:52.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi017 2023-07-14T12:51:52.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:52.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:52.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:51:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi017 to 17272M 2023-07-14T12:51:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:52.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:51:52.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:51:52.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: osd.0 [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788] boot 2023-07-14T12:51:52.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: osdmap e8: 1 total, 1 up, 1 in 2023-07-14T12:51:52.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:51:52.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T12:51:52.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi017 2023-07-14T12:51:52.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:52.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:52.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:51:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi017 to 17272M 2023-07-14T12:51:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:51:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:51:53.302 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:53 smithi131 ceph-mon[96953]: osdmap e9: 1 total, 1 up, 1 in 2023-07-14T12:51:53.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:53 smithi017 ceph-mon[95536]: osdmap e9: 1 total, 1 up, 1 in 2023-07-14T12:51:53.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:53 smithi135 ceph-mon[97338]: osdmap e9: 1 total, 1 up, 1 in 2023-07-14T12:51:53.493 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.470+0000 7ff33d812700 1 -- 172.21.15.131:0/1227493874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff338101720 msgr2=0x7ff338107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:53.493 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.470+0000 7ff33d812700 1 --2- 172.21.15.131:0/1227493874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff338101720 0x7ff338107fe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff33000b0a0 tx=0x7ff33000b3b0 comp rx=0 tx=0).stop 2023-07-14T12:51:53.493 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.470+0000 7ff33d812700 1 -- 172.21.15.131:0/1227493874 shutdown_connections 2023-07-14T12:51:53.493 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.470+0000 7ff33d812700 1 --2- 172.21.15.131:0/1227493874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff338101720 0x7ff338107fe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:53.493 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.470+0000 7ff33d812700 1 --2- 172.21.15.131:0/1227493874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3380ffb90 0x7ff3380fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:53.494 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.470+0000 7ff33d812700 1 --2- 172.21.15.131:0/1227493874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff338100d90 0x7ff3381011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:53.494 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.470+0000 7ff33d812700 1 -- 172.21.15.131:0/1227493874 >> 172.21.15.131:0/1227493874 conn(0x7ff3380fb1a0 msgr2=0x7ff3380fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:51:53.494 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.470+0000 7ff33d812700 1 -- 172.21.15.131:0/1227493874 shutdown_connections 2023-07-14T12:51:53.494 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.470+0000 7ff33d812700 1 -- 172.21.15.131:0/1227493874 wait complete. 2023-07-14T12:51:53.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.471+0000 7ff33d812700 1 Processor -- start 2023-07-14T12:51:53.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff33d812700 1 -- start start 2023-07-14T12:51:53.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff33d812700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3380ffb90 0x7ff338195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:53.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff33d812700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff338100d90 0x7ff338195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:53.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff33d812700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff338101720 0x7ff33819cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:53.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff33d812700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33819d4d0 con 0x7ff338101720 2023-07-14T12:51:53.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff33d812700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33819d610 con 0x7ff338100d90 2023-07-14T12:51:53.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff33d812700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33819d7a0 con 0x7ff3380ffb90 2023-07-14T12:51:53.497 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff3367fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff338100d90 0x7ff338195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:53.497 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff3367fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff338100d90 0x7ff338195e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46006/0 (socket says 172.21.15.131:46006) 2023-07-14T12:51:53.497 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff3367fc700 1 -- 172.21.15.131:0/1813637945 learned_addr learned my addr 172.21.15.131:0/1813637945 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-07-14T12:51:53.497 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff336ffd700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3380ffb90 0x7ff338195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:53.497 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.472+0000 7ff3377fe700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff338101720 0x7ff33819cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:53.497 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.473+0000 7ff3367fc700 1 -- 172.21.15.131:0/1813637945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3380ffb90 msgr2=0x7ff338195940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:53.497 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.473+0000 7ff3367fc700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3380ffb90 0x7ff338195940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.473+0000 7ff3367fc700 1 -- 172.21.15.131:0/1813637945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff338101720 msgr2=0x7ff33819cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:51:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.473+0000 7ff3367fc700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff338101720 0x7ff33819cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:51:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.473+0000 7ff3367fc700 1 -- 172.21.15.131:0/1813637945 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff330009d00 con 0x7ff338100d90 2023-07-14T12:51:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.473+0000 7ff3367fc700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff338100d90 0x7ff338195e80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00d980 tx=0x7ff32c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:51:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.473+0000 7ff33c810700 1 -- 172.21.15.131:0/1813637945 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c004a30 con 0x7ff338100d90 2023-07-14T12:51:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.473+0000 7ff33c810700 1 -- 172.21.15.131:0/1813637945 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff32c0054b0 con 0x7ff338100d90 2023-07-14T12:51:53.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.473+0000 7ff33d812700 1 -- 172.21.15.131:0/1813637945 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33819da80 con 0x7ff338100d90 2023-07-14T12:51:53.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.473+0000 7ff33c810700 1 -- 172.21.15.131:0/1813637945 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00fb50 con 0x7ff338100d90 2023-07-14T12:51:53.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.473+0000 7ff33d812700 1 -- 172.21.15.131:0/1813637945 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33819df30 con 0x7ff338100d90 2023-07-14T12:51:53.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.474+0000 7ff33d812700 1 -- 172.21.15.131:0/1813637945 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3381071e0 con 0x7ff338100d90 2023-07-14T12:51:53.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.476+0000 7ff33c810700 1 -- 172.21.15.131:0/1813637945 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7ff32c00fcb0 con 0x7ff338100d90 2023-07-14T12:51:53.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.477+0000 7ff33c810700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff3200a10c0 0x7ff3200a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:51:53.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.478+0000 7ff33c810700 1 -- 172.21.15.131:0/1813637945 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7ff32c0cad50 con 0x7ff338100d90 2023-07-14T12:51:53.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.478+0000 7ff336ffd700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff3200a10c0 0x7ff3200a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:51:53.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.478+0000 7ff336ffd700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff3200a10c0 0x7ff3200a3570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff338100bf0 tx=0x7ff32800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:51:53.504 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.482+0000 7ff33c810700 1 -- 172.21.15.131:0/1813637945 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff32c095e70 con 0x7ff338100d90 2023-07-14T12:51:53.701 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:51:53.679+0000 7ff33d812700 1 -- 172.21.15.131:0/1813637945 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff338060950 con 0x7ff3200a10c0 2023-07-14T12:51:54.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:54 smithi017 ceph-mon[95536]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:51:54.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:54 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:51:54.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:54 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:51:54.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:54 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:54.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:54 smithi135 ceph-mon[97338]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:51:54.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:54 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:51:54.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:54 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:51:54.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:54 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:54.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:54 smithi131 ceph-mon[96953]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:51:54.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:54 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:51:54.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:54 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:51:54.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:54 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:51:55.344 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:55 smithi131 ceph-mon[96953]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:51:55.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:55 smithi017 ceph-mon[95536]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:51:55.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:55 smithi135 ceph-mon[97338]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:51:56.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:56 smithi017 ceph-mon[95536]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:51:56.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:56 smithi135 ceph-mon[97338]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:51:56.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:56 smithi131 ceph-mon[96953]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:51:57.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:57 smithi017 ceph-mon[95536]: from='client.? 172.21.15.131:0/438367197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73e24a1b-4661-4c71-83ef-5f5ad4081046"}]: dispatch 2023-07-14T12:51:57.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:57 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73e24a1b-4661-4c71-83ef-5f5ad4081046"}]: dispatch 2023-07-14T12:51:57.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:57 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73e24a1b-4661-4c71-83ef-5f5ad4081046"}]': finished 2023-07-14T12:51:57.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:57 smithi017 ceph-mon[95536]: osdmap e10: 2 total, 1 up, 2 in 2023-07-14T12:51:57.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:57 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:51:57.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:57 smithi135 ceph-mon[97338]: from='client.? 172.21.15.131:0/438367197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73e24a1b-4661-4c71-83ef-5f5ad4081046"}]: dispatch 2023-07-14T12:51:57.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:57 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73e24a1b-4661-4c71-83ef-5f5ad4081046"}]: dispatch 2023-07-14T12:51:57.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:57 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73e24a1b-4661-4c71-83ef-5f5ad4081046"}]': finished 2023-07-14T12:51:57.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:57 smithi135 ceph-mon[97338]: osdmap e10: 2 total, 1 up, 2 in 2023-07-14T12:51:57.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:57 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:51:57.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:57 smithi131 ceph-mon[96953]: from='client.? 172.21.15.131:0/438367197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73e24a1b-4661-4c71-83ef-5f5ad4081046"}]: dispatch 2023-07-14T12:51:57.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:57 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73e24a1b-4661-4c71-83ef-5f5ad4081046"}]: dispatch 2023-07-14T12:51:57.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:57 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73e24a1b-4661-4c71-83ef-5f5ad4081046"}]': finished 2023-07-14T12:51:57.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:57 smithi131 ceph-mon[96953]: osdmap e10: 2 total, 1 up, 2 in 2023-07-14T12:51:57.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:57 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:51:58.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:58 smithi017 ceph-mon[95536]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:51:58.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:51:58 smithi017 ceph-mon[95536]: from='client.? 172.21.15.131:0/3424474793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:51:58.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:58 smithi135 ceph-mon[97338]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:51:58.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:51:58 smithi135 ceph-mon[97338]: from='client.? 172.21.15.131:0/3424474793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:51:58.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:58 smithi131 ceph-mon[96953]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:51:58.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:51:58 smithi131 ceph-mon[96953]: from='client.? 172.21.15.131:0/3424474793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:52:00.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:00 smithi017 ceph-mon[95536]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:00.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:00 smithi135 ceph-mon[97338]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:00.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:00 smithi131 ceph-mon[96953]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:02.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:02 smithi017 ceph-mon[95536]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:02.388 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:02 smithi131 ceph-mon[96953]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:02.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:02 smithi135 ceph-mon[97338]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:04.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:04 smithi017 ceph-mon[95536]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:04.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:04 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-14T12:52:04.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:04 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:04.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:04 smithi135 ceph-mon[97338]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:04.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:04 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-14T12:52:04.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:04 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:04.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:04 smithi131 ceph-mon[96953]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:04.489 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:04 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-14T12:52:04.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:04 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:05.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:05 smithi131 ceph-mon[96953]: Deploying daemon osd.1 on smithi131 2023-07-14T12:52:05.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:05 smithi017 ceph-mon[95536]: Deploying daemon osd.1 on smithi131 2023-07-14T12:52:05.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:05 smithi135 ceph-mon[97338]: Deploying daemon osd.1 on smithi131 2023-07-14T12:52:06.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:06 smithi017 ceph-mon[95536]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:06.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:06 smithi135 ceph-mon[97338]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:06.473 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:06 smithi131 ceph-mon[96953]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:08.323 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:08 smithi131 ceph-mon[96953]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:08.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:08 smithi017 ceph-mon[95536]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:08.440 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:08 smithi135 ceph-mon[97338]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:10.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:10 smithi131 ceph-mon[96953]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:10.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:10 smithi017 ceph-mon[95536]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:10.441 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:10 smithi135 ceph-mon[97338]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:11.524 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:11 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:11.525 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:11 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:11.525 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:11 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:11.525 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:11 smithi131 ceph-mon[96953]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:11.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:11 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:11.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:11 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:11.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:11 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:11.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:11 smithi017 ceph-mon[95536]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:11.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:11 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:11.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:11 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:11.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:11 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:11.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:11 smithi135 ceph-mon[97338]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:13.629 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 1 on host 'smithi131' 2023-07-14T12:52:13.630 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.605+0000 7ff33c810700 1 -- 172.21.15.131:0/1813637945 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff338060950 con 0x7ff3200a10c0 2023-07-14T12:52:13.632 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.608+0000 7ff33d812700 1 -- 172.21.15.131:0/1813637945 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff3200a10c0 msgr2=0x7ff3200a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:13.632 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.608+0000 7ff33d812700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff3200a10c0 0x7ff3200a3570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff338100bf0 tx=0x7ff32800b410 comp rx=0 tx=0).stop 2023-07-14T12:52:13.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.608+0000 7ff33d812700 1 -- 172.21.15.131:0/1813637945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff338100d90 msgr2=0x7ff338195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:13.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.608+0000 7ff33d812700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff338100d90 0x7ff338195e80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00d980 tx=0x7ff32c00dc90 comp rx=0 tx=0).stop 2023-07-14T12:52:13.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.608+0000 7ff33d812700 1 -- 172.21.15.131:0/1813637945 shutdown_connections 2023-07-14T12:52:13.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.608+0000 7ff33d812700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff3200a10c0 0x7ff3200a3570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:13.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.608+0000 7ff33d812700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff338101720 0x7ff33819cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:13.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.608+0000 7ff33d812700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3380ffb90 0x7ff338195940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:13.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.608+0000 7ff33d812700 1 --2- 172.21.15.131:0/1813637945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff338100d90 0x7ff338195e80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:13.634 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.608+0000 7ff33d812700 1 -- 172.21.15.131:0/1813637945 >> 172.21.15.131:0/1813637945 conn(0x7ff3380fb1a0 msgr2=0x7ff338104320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:13.634 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.609+0000 7ff33d812700 1 -- 172.21.15.131:0/1813637945 shutdown_connections 2023-07-14T12:52:13.634 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:52:13.609+0000 7ff33d812700 1 -- 172.21.15.131:0/1813637945 wait complete. 2023-07-14T12:52:13.820 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:13.821 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:13.821 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:13.821 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:13.821 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:13.821 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:13 smithi131 ceph-mon[96953]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:13.821 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:13.822 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:13.822 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:13.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:13.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:13.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:13.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:13.942 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:13.942 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:13 smithi135 ceph-mon[97338]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:13.942 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:13.942 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:13.942 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:14.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:14.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:14.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:14.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:14.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:14.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:13 smithi017 ceph-mon[95536]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:14.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:14.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:14.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:14.174 DEBUG:teuthology.orchestra.run.smithi131:osd.1> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.1.service 2023-07-14T12:52:14.178 INFO:tasks.cephadm:Deploying osd.2 on smithi135 with /dev/vg_nvme/lv_4... 2023-07-14T12:52:14.179 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-14T12:52:14.252 INFO:journalctl@ceph.osd.1.smithi131.stdout:-- Logs begin at Fri 2023-07-14 12:26:41 UTC. -- 2023-07-14T12:52:14.489 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 12:52:14 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-1[102050]: 2023-07-14T12:52:14.286+0000 7f9b4505a640 -1 osd.1 0 log_to_monitors true 2023-07-14T12:52:14.903 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:52:14.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:14 smithi131 ceph-mon[96953]: from='osd.1 [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T12:52:14.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:14 smithi131 ceph-mon[96953]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T12:52:15.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:14 smithi017 ceph-mon[95536]: from='osd.1 [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T12:52:15.124 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:14 smithi017 ceph-mon[95536]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T12:52:15.145 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:14 smithi135 ceph-mon[97338]: from='osd.1 [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T12:52:15.145 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:14 smithi135 ceph-mon[97338]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T12:52:15.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:15 smithi131 ceph-mon[96953]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-14T12:52:15.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:15 smithi131 ceph-mon[96953]: osdmap e11: 2 total, 1 up, 2 in 2023-07-14T12:52:15.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:15.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:15 smithi131 ceph-mon[96953]: from='osd.1 [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:52:15.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:15 smithi131 ceph-mon[96953]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:52:15.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:15 smithi131 ceph-mon[96953]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:15.991 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 12:52:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-1[102050]: 2023-07-14T12:52:15.693+0000 7f9b3a6d2700 -1 osd.1 0 waiting for initial osdmap 2023-07-14T12:52:15.991 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 12:52:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-1[102050]: 2023-07-14T12:52:15.698+0000 7f9b364c7700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:52:16.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:15 smithi017 ceph-mon[95536]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-14T12:52:16.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:15 smithi017 ceph-mon[95536]: osdmap e11: 2 total, 1 up, 2 in 2023-07-14T12:52:16.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:16.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:15 smithi017 ceph-mon[95536]: from='osd.1 [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:52:16.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:15 smithi017 ceph-mon[95536]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:52:16.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:15 smithi017 ceph-mon[95536]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:16.155 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:15 smithi135 ceph-mon[97338]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-14T12:52:16.155 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:15 smithi135 ceph-mon[97338]: osdmap e11: 2 total, 1 up, 2 in 2023-07-14T12:52:16.156 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:16.156 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:15 smithi135 ceph-mon[97338]: from='osd.1 [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:52:16.156 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:15 smithi135 ceph-mon[97338]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:52:16.156 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:15 smithi135 ceph-mon[97338]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:16.884 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-14T12:52:16.884 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-14T12:52:16.884 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-07-14T12:52:16.884 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-07-14T12:52:16.885 INFO:teuthology.orchestra.run.smithi135.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0392244 s, 267 MB/s 2023-07-14T12:52:16.885 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-07-14T12:52:16.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:16 smithi131 ceph-mon[96953]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:52:16.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:16 smithi131 ceph-mon[96953]: osdmap e12: 2 total, 1 up, 2 in 2023-07-14T12:52:16.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:16 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:16.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:16 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:17.075 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:16 smithi135 ceph-mon[97338]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:52:17.075 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:16 smithi135 ceph-mon[97338]: osdmap e12: 2 total, 1 up, 2 in 2023-07-14T12:52:17.075 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:16 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:17.075 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:16 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:17.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:16 smithi017 ceph-mon[95536]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:52:17.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:16 smithi017 ceph-mon[95536]: osdmap e12: 2 total, 1 up, 2 in 2023-07-14T12:52:17.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:16 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:17.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:16 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:17.375 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2023-07-14T12:52:17.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:52:17.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:52:17.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: osd.1 [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592] boot 2023-07-14T12:52:17.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: osdmap e13: 2 total, 2 up, 2 in 2023-07-14T12:52:17.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:17.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:17.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi131 2023-07-14T12:52:17.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:17.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:17.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:52:17.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:17.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:17.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:17.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:18.094 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:52:18.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:52:18.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:52:18.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: osd.1 [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592] boot 2023-07-14T12:52:18.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: osdmap e13: 2 total, 2 up, 2 in 2023-07-14T12:52:18.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:18.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:18.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi131 2023-07-14T12:52:18.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:18.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:18.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:52:18.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:18.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:18.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:18.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:18.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:52:18.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:52:18.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: osd.1 [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592] boot 2023-07-14T12:52:18.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: osdmap e13: 2 total, 2 up, 2 in 2023-07-14T12:52:18.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:52:18.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T12:52:18.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi131 2023-07-14T12:52:18.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:18.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:18.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:52:18.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:18.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:18.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:18.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:18.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:18 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi131 to 17267M 2023-07-14T12:52:18.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:18 smithi135 ceph-mon[97338]: osdmap e14: 2 total, 2 up, 2 in 2023-07-14T12:52:18.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:18 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi131 to 17267M 2023-07-14T12:52:18.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:18 smithi131 ceph-mon[96953]: osdmap e14: 2 total, 2 up, 2 in 2023-07-14T12:52:19.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:18 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi131 to 17267M 2023-07-14T12:52:19.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:18 smithi017 ceph-mon[95536]: osdmap e14: 2 total, 2 up, 2 in 2023-07-14T12:52:19.594 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.571+0000 7fcd968ac700 1 -- 172.21.15.135:0/571532349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd90100d90 msgr2=0x7fcd901011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:19.594 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.571+0000 7fcd968ac700 1 --2- 172.21.15.135:0/571532349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd90100d90 0x7fcd901011e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009990 tx=0x7fcd78009ca0 comp rx=0 tx=0).stop 2023-07-14T12:52:19.594 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.571+0000 7fcd968ac700 1 -- 172.21.15.135:0/571532349 shutdown_connections 2023-07-14T12:52:19.595 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.571+0000 7fcd968ac700 1 --2- 172.21.15.135:0/571532349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd90101720 0x7fcd90107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:19.595 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.571+0000 7fcd968ac700 1 --2- 172.21.15.135:0/571532349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900ffb90 0x7fcd900fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:19.595 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.571+0000 7fcd968ac700 1 --2- 172.21.15.135:0/571532349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd90100d90 0x7fcd901011e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:19.595 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.571+0000 7fcd968ac700 1 -- 172.21.15.135:0/571532349 >> 172.21.15.135:0/571532349 conn(0x7fcd900fb1a0 msgr2=0x7fcd900fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:19.595 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.571+0000 7fcd968ac700 1 -- 172.21.15.135:0/571532349 shutdown_connections 2023-07-14T12:52:19.595 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.571+0000 7fcd968ac700 1 -- 172.21.15.135:0/571532349 wait complete. 2023-07-14T12:52:19.597 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.572+0000 7fcd968ac700 1 Processor -- start 2023-07-14T12:52:19.597 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.572+0000 7fcd968ac700 1 -- start start 2023-07-14T12:52:19.597 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.572+0000 7fcd968ac700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900ffb90 0x7fcd90197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:19.597 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.572+0000 7fcd968ac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd90100d90 0x7fcd90197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:19.597 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.572+0000 7fcd968ac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd90101720 0x7fcd9019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:19.597 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.572+0000 7fcd968ac700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9019f590 con 0x7fcd900ffb90 2023-07-14T12:52:19.598 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.572+0000 7fcd968ac700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9019f6d0 con 0x7fcd90100d90 2023-07-14T12:52:19.598 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.572+0000 7fcd968ac700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9019f860 con 0x7fcd90101720 2023-07-14T12:52:19.598 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd94e49700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd90101720 0x7fcd9019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:19.598 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd94e49700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd90101720 0x7fcd9019efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53088/0 (socket says 172.21.15.135:53088) 2023-07-14T12:52:19.598 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd94e49700 1 -- 172.21.15.135:0/1294681989 learned_addr learned my addr 172.21.15.135:0/1294681989 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-07-14T12:52:19.598 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd8ffff700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900ffb90 0x7fcd90197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:19.598 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd87fff700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd90100d90 0x7fcd90197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:19.598 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd94e49700 1 -- 172.21.15.135:0/1294681989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd90100d90 msgr2=0x7fcd90197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:19.599 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd94e49700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd90100d90 0x7fcd90197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:19.599 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd94e49700 1 -- 172.21.15.135:0/1294681989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900ffb90 msgr2=0x7fcd90197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:19.599 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd94e49700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900ffb90 0x7fcd90197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:19.599 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd94e49700 1 -- 172.21.15.135:0/1294681989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd780095f0 con 0x7fcd90101720 2023-07-14T12:52:19.599 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd94e49700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd90101720 0x7fcd9019efc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcd88007f10 tx=0x7fcd8800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:19.599 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd8dffb700 1 -- 172.21.15.135:0/1294681989 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88017070 con 0x7fcd90101720 2023-07-14T12:52:19.599 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd8dffb700 1 -- 172.21.15.135:0/1294681989 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd8800f040 con 0x7fcd90101720 2023-07-14T12:52:19.600 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.573+0000 7fcd968ac700 1 -- 172.21.15.135:0/1294681989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9019fb40 con 0x7fcd90101720 2023-07-14T12:52:19.600 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.574+0000 7fcd8dffb700 1 -- 172.21.15.135:0/1294681989 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88005710 con 0x7fcd90101720 2023-07-14T12:52:19.600 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.574+0000 7fcd968ac700 1 -- 172.21.15.135:0/1294681989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9019fff0 con 0x7fcd90101720 2023-07-14T12:52:19.600 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.575+0000 7fcd968ac700 1 -- 172.21.15.135:0/1294681989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd90192110 con 0x7fcd90101720 2023-07-14T12:52:19.600 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.576+0000 7fcd8dffb700 1 -- 172.21.15.135:0/1294681989 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7fcd88004ad0 con 0x7fcd90101720 2023-07-14T12:52:19.601 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.578+0000 7fcd8dffb700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcd7c0a10c0 0x7fcd7c0a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:19.601 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.578+0000 7fcd8dffb700 1 -- 172.21.15.135:0/1294681989 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fcd880ca960 con 0x7fcd90101720 2023-07-14T12:52:19.601 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.578+0000 7fcd8ffff700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcd7c0a10c0 0x7fcd7c0a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:19.602 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.579+0000 7fcd8ffff700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcd7c0a10c0 0x7fcd7c0a3570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcd90100bf0 tx=0x7fcd8000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:19.605 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.582+0000 7fcd8dffb700 1 -- 172.21.15.135:0/1294681989 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcd88095860 con 0x7fcd90101720 2023-07-14T12:52:19.808 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:19.785+0000 7fcd968ac700 1 -- 172.21.15.135:0/1294681989 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd90060950 con 0x7fcd7c0a10c0 2023-07-14T12:52:19.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:19 smithi131 ceph-mon[96953]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:20.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:19 smithi017 ceph-mon[95536]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:20.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:19 smithi135 ceph-mon[97338]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:20.989 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:20 smithi131 ceph-mon[96953]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:52:20.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:52:20.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:52:20.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:21.021 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:20 smithi135 ceph-mon[97338]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:52:21.022 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:52:21.022 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:52:21.022 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:21.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:20 smithi017 ceph-mon[95536]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:52:21.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:52:21.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:52:21.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:22.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:21 smithi017 ceph-mon[95536]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:22.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:21 smithi135 ceph-mon[97338]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:22.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:21 smithi131 ceph-mon[96953]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:23.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:22 smithi135 ceph-mon[97338]: from='client.? 172.21.15.135:0/670989929' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde438ad-9889-4407-b0d7-1baf7dde5fa4"}]: dispatch 2023-07-14T12:52:23.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:22 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde438ad-9889-4407-b0d7-1baf7dde5fa4"}]: dispatch 2023-07-14T12:52:23.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:22 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fde438ad-9889-4407-b0d7-1baf7dde5fa4"}]': finished 2023-07-14T12:52:23.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:22 smithi135 ceph-mon[97338]: osdmap e15: 3 total, 2 up, 3 in 2023-07-14T12:52:23.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:22 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:23.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:22 smithi131 ceph-mon[96953]: from='client.? 172.21.15.135:0/670989929' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde438ad-9889-4407-b0d7-1baf7dde5fa4"}]: dispatch 2023-07-14T12:52:23.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:22 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde438ad-9889-4407-b0d7-1baf7dde5fa4"}]: dispatch 2023-07-14T12:52:23.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:22 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fde438ad-9889-4407-b0d7-1baf7dde5fa4"}]': finished 2023-07-14T12:52:23.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:22 smithi131 ceph-mon[96953]: osdmap e15: 3 total, 2 up, 3 in 2023-07-14T12:52:23.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:22 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:23.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:22 smithi017 ceph-mon[95536]: from='client.? 172.21.15.135:0/670989929' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde438ad-9889-4407-b0d7-1baf7dde5fa4"}]: dispatch 2023-07-14T12:52:23.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:22 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde438ad-9889-4407-b0d7-1baf7dde5fa4"}]: dispatch 2023-07-14T12:52:23.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:22 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fde438ad-9889-4407-b0d7-1baf7dde5fa4"}]': finished 2023-07-14T12:52:23.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:22 smithi017 ceph-mon[95536]: osdmap e15: 3 total, 2 up, 3 in 2023-07-14T12:52:23.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:22 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:24.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:23 smithi135 ceph-mon[97338]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:24.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:23 smithi135 ceph-mon[97338]: from='client.? 172.21.15.135:0/2877448441' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:52:24.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:23 smithi131 ceph-mon[96953]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:24.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:23 smithi131 ceph-mon[96953]: from='client.? 172.21.15.135:0/2877448441' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:52:24.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:23 smithi017 ceph-mon[95536]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:24.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:23 smithi017 ceph-mon[95536]: from='client.? 172.21.15.135:0/2877448441' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:52:26.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:25 smithi135 ceph-mon[97338]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:26.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:25 smithi131 ceph-mon[96953]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:26.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:25 smithi017 ceph-mon[95536]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:28.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:27 smithi135 ceph-mon[97338]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:28.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:27 smithi131 ceph-mon[96953]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:28.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:27 smithi017 ceph-mon[95536]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:30.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:29 smithi135 ceph-mon[97338]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:30.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:29 smithi131 ceph-mon[96953]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:30.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:29 smithi017 ceph-mon[95536]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:31.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:30 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-14T12:52:31.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:30 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:31.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:30 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-14T12:52:31.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:30 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:31.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:30 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-14T12:52:31.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:30 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:32.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:31 smithi135 ceph-mon[97338]: Deploying daemon osd.2 on smithi135 2023-07-14T12:52:32.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:31 smithi135 ceph-mon[97338]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:32.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:31 smithi131 ceph-mon[96953]: Deploying daemon osd.2 on smithi135 2023-07-14T12:52:32.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:31 smithi131 ceph-mon[96953]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:32.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:31 smithi017 ceph-mon[95536]: Deploying daemon osd.2 on smithi135 2023-07-14T12:52:32.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:31 smithi017 ceph-mon[95536]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:34.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:33 smithi135 ceph-mon[97338]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:34.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:33 smithi131 ceph-mon[96953]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:34.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:33 smithi017 ceph-mon[95536]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:36.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:35 smithi135 ceph-mon[97338]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:36.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:35 smithi131 ceph-mon[96953]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:36.349 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:35 smithi017 ceph-mon[95536]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:37.956 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:37 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:37.956 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:37 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:37.956 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:37 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:37.956 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:37 smithi135 ceph-mon[97338]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:37.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:37 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:37.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:37 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:37.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:37 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:37.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:37 smithi131 ceph-mon[96953]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:38.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:37 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:38.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:37 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:38.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:37 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:38.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:37 smithi017 ceph-mon[95536]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:40.290 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.266+0000 7fcd8dffb700 1 -- 172.21.15.135:0/1294681989 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcd90060950 con 0x7fcd7c0a10c0 2023-07-14T12:52:40.290 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 2 on host 'smithi135' 2023-07-14T12:52:40.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 -- 172.21.15.135:0/1294681989 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcd7c0a10c0 msgr2=0x7fcd7c0a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:40.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcd7c0a10c0 0x7fcd7c0a3570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcd90100bf0 tx=0x7fcd8000b410 comp rx=0 tx=0).stop 2023-07-14T12:52:40.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 -- 172.21.15.135:0/1294681989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd90101720 msgr2=0x7fcd9019efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:40.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd90101720 0x7fcd9019efc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcd88007f10 tx=0x7fcd8800d3b0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 -- 172.21.15.135:0/1294681989 shutdown_connections 2023-07-14T12:52:40.293 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcd7c0a10c0 0x7fcd7c0a3570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.294 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd90101720 0x7fcd9019efc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.294 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd900ffb90 0x7fcd90197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.294 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 --2- 172.21.15.135:0/1294681989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd90100d90 0x7fcd90197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:40.294 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 -- 172.21.15.135:0/1294681989 >> 172.21.15.135:0/1294681989 conn(0x7fcd900fb1a0 msgr2=0x7fcd90106760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:40.294 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 -- 172.21.15.135:0/1294681989 shutdown_connections 2023-07-14T12:52:40.294 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:52:40.269+0000 7fcd968ac700 1 -- 172.21.15.135:0/1294681989 wait complete. 2023-07-14T12:52:40.315 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:40 smithi135 ceph-mon[97338]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:40.316 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:40 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:40.316 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:40 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:40.316 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:40 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:40.316 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:40 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:40.317 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:40 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:40.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:40 smithi017 ceph-mon[95536]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:40.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:40 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:40.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:40 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:40.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:40 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:40.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:40 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:40.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:40 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:40.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:40 smithi131 ceph-mon[96953]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:40.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:40 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:40.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:40 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:40.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:40 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:40.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:40 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:40.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:40 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:40.814 DEBUG:teuthology.orchestra.run.smithi135:osd.2> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.2.service 2023-07-14T12:52:40.823 INFO:tasks.cephadm:Deploying osd.3 on smithi017 with /dev/vg_nvme/lv_3... 2023-07-14T12:52:40.824 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-14T12:52:40.899 INFO:journalctl@ceph.osd.2.smithi135.stdout:-- Logs begin at Fri 2023-07-14 12:26:36 UTC. -- 2023-07-14T12:52:41.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:41 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:41.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:41 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:41.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:41 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:41.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:41 smithi131 ceph-mon[96953]: from='osd.2 [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T12:52:41.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:41 smithi131 ceph-mon[96953]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T12:52:41.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:41 smithi131 ceph-mon[96953]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:41.494 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:41 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:41.494 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:41 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:41.494 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:41 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:41.494 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:41 smithi135 ceph-mon[97338]: from='osd.2 [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T12:52:41.494 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:41 smithi135 ceph-mon[97338]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T12:52:41.494 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:41 smithi135 ceph-mon[97338]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:41.562 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:52:41.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:41 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:41.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:41 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:41.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:41 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:52:41.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:41 smithi017 ceph-mon[95536]: from='osd.2 [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T12:52:41.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:41 smithi017 ceph-mon[95536]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T12:52:41.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:41 smithi017 ceph-mon[95536]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:42.386 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:42 smithi017 ceph-mon[95536]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-14T12:52:42.386 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:42 smithi017 ceph-mon[95536]: osdmap e16: 3 total, 2 up, 3 in 2023-07-14T12:52:42.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:42 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:42.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:42 smithi017 ceph-mon[95536]: from='osd.2 [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:52:42.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:42 smithi017 ceph-mon[95536]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:52:42.428 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:42 smithi135 ceph-mon[97338]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-14T12:52:42.429 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:42 smithi135 ceph-mon[97338]: osdmap e16: 3 total, 2 up, 3 in 2023-07-14T12:52:42.429 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:42 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:42.429 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:42 smithi135 ceph-mon[97338]: from='osd.2 [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:52:42.429 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:42 smithi135 ceph-mon[97338]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:52:42.430 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 12:52:42 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-2[103191]: 2023-07-14T12:52:42.231+0000 7f680c532700 -1 osd.2 0 waiting for initial osdmap 2023-07-14T12:52:42.430 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 12:52:42 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-2[103191]: 2023-07-14T12:52:42.237+0000 7f6806b24700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:52:42.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:42 smithi131 ceph-mon[96953]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-14T12:52:42.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:42 smithi131 ceph-mon[96953]: osdmap e16: 3 total, 2 up, 3 in 2023-07-14T12:52:42.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:42 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:42.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:42 smithi131 ceph-mon[96953]: from='osd.2 [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:52:42.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:42 smithi131 ceph-mon[96953]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:52:43.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:43 smithi017 ceph-mon[95536]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:52:43.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:43 smithi017 ceph-mon[95536]: osdmap e17: 3 total, 2 up, 3 in 2023-07-14T12:52:43.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:43.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:43.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:43 smithi017 ceph-mon[95536]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:43.689 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-14T12:52:43.690 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-14T12:52:43.690 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2023-07-14T12:52:43.690 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2023-07-14T12:52:43.690 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0362303 s, 289 MB/s 2023-07-14T12:52:43.690 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2023-07-14T12:52:43.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:43 smithi135 ceph-mon[97338]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:52:43.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:43 smithi135 ceph-mon[97338]: osdmap e17: 3 total, 2 up, 3 in 2023-07-14T12:52:43.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:43.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:43.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:43 smithi135 ceph-mon[97338]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:43.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:43 smithi131 ceph-mon[96953]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:52:43.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:43 smithi131 ceph-mon[96953]: osdmap e17: 3 total, 2 up, 3 in 2023-07-14T12:52:43.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:43.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:43.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:43 smithi131 ceph-mon[96953]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T12:52:44.238 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi017:vg_nvme/lv_3 2023-07-14T12:52:44.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:52:44.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:52:44.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: osd.2 [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423] boot 2023-07-14T12:52:44.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: osdmap e18: 3 total, 3 up, 3 in 2023-07-14T12:52:44.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:44.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi135 2023-07-14T12:52:44.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:52:44.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi135 to 17267M 2023-07-14T12:52:44.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:44.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:44.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:52:44.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:52:44.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: osd.2 [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423] boot 2023-07-14T12:52:44.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: osdmap e18: 3 total, 3 up, 3 in 2023-07-14T12:52:44.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:44.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi135 2023-07-14T12:52:44.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:52:44.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi135 to 17267M 2023-07-14T12:52:44.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:44.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:44.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:52:44.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:52:44.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: osd.2 [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423] boot 2023-07-14T12:52:44.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: osdmap e18: 3 total, 3 up, 3 in 2023-07-14T12:52:44.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:52:44.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi135 2023-07-14T12:52:44.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:52:44.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi135 to 17267M 2023-07-14T12:52:44.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:44.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:52:44.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:44.974 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:52:45.559 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:45 smithi017 ceph-mon[95536]: osdmap e19: 3 total, 3 up, 3 in 2023-07-14T12:52:45.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:45 smithi135 ceph-mon[97338]: osdmap e19: 3 total, 3 up, 3 in 2023-07-14T12:52:45.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:45 smithi131 ceph-mon[96953]: osdmap e19: 3 total, 3 up, 3 in 2023-07-14T12:52:46.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.642+0000 7f946ad25700 1 -- 172.21.15.17:0/1046708518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f946410c170 msgr2=0x7f946410e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:46.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.642+0000 7f946ad25700 1 --2- 172.21.15.17:0/1046708518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f946410c170 0x7f946410e550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f945c00b0d0 tx=0x7f945c00b3e0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.642+0000 7f946ad25700 1 -- 172.21.15.17:0/1046708518 shutdown_connections 2023-07-14T12:52:46.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.642+0000 7f946ad25700 1 --2- 172.21.15.17:0/1046708518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f946410c170 0x7f946410e550 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.642+0000 7f946ad25700 1 --2- 172.21.15.17:0/1046708518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9464074540 0x7f94640729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.642+0000 7f946ad25700 1 --2- 172.21.15.17:0/1046708518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9464072f70 0x7f94640733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.642+0000 7f946ad25700 1 -- 172.21.15.17:0/1046708518 >> 172.21.15.17:0/1046708518 conn(0x7f94640fb1a0 msgr2=0x7f94640fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:52:46.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.642+0000 7f946ad25700 1 -- 172.21.15.17:0/1046708518 shutdown_connections 2023-07-14T12:52:46.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.642+0000 7f946ad25700 1 -- 172.21.15.17:0/1046708518 wait complete. 2023-07-14T12:52:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.643+0000 7f946ad25700 1 Processor -- start 2023-07-14T12:52:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.644+0000 7f946ad25700 1 -- start start 2023-07-14T12:52:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.644+0000 7f946ad25700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9464072f70 0x7f946419be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.644+0000 7f946ad25700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9464074540 0x7f946419c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.644+0000 7f946ad25700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f946410c170 0x7f94641a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.644+0000 7f946ad25700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94641a3a10 con 0x7f9464074540 2023-07-14T12:52:46.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.644+0000 7f946ad25700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94641a3b50 con 0x7f9464072f70 2023-07-14T12:52:46.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.644+0000 7f946ad25700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94641a3ce0 con 0x7f946410c170 2023-07-14T12:52:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.644+0000 7f9463fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9464074540 0x7f946419c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.644+0000 7f9463fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9464074540 0x7f946419c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33228/0 (socket says 172.21.15.17:33228) 2023-07-14T12:52:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.644+0000 7f9463fff700 1 -- 172.21.15.17:0/1499885226 learned_addr learned my addr 172.21.15.17:0/1499885226 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:52:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.644+0000 7f9468ac1700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9464072f70 0x7f946419be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.645+0000 7f94692c2700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f946410c170 0x7f94641a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.645+0000 7f9463fff700 1 -- 172.21.15.17:0/1499885226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f946410c170 msgr2=0x7f94641a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.645+0000 7f9463fff700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f946410c170 0x7f94641a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.645+0000 7f9463fff700 1 -- 172.21.15.17:0/1499885226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9464072f70 msgr2=0x7f946419be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:52:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.645+0000 7f9463fff700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9464072f70 0x7f946419be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:52:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.645+0000 7f9463fff700 1 -- 172.21.15.17:0/1499885226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c009d00 con 0x7f9464074540 2023-07-14T12:52:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.645+0000 7f9463fff700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9464074540 0x7f946419c3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f945000e9d0 tx=0x7f945000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.645+0000 7f9461ffb700 1 -- 172.21.15.17:0/1499885226 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450009790 con 0x7f9464074540 2023-07-14T12:52:46.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.645+0000 7f9461ffb700 1 -- 172.21.15.17:0/1499885226 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f945000cbd0 con 0x7f9464074540 2023-07-14T12:52:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.645+0000 7f9461ffb700 1 -- 172.21.15.17:0/1499885226 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450018680 con 0x7f9464074540 2023-07-14T12:52:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.645+0000 7f946ad25700 1 -- 172.21.15.17:0/1499885226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94641a3fc0 con 0x7f9464074540 2023-07-14T12:52:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.646+0000 7f946ad25700 1 -- 172.21.15.17:0/1499885226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94641a4430 con 0x7f9464074540 2023-07-14T12:52:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.647+0000 7f946ad25700 1 -- 172.21.15.17:0/1499885226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9464101cc0 con 0x7f9464074540 2023-07-14T12:52:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.649+0000 7f9461ffb700 1 -- 172.21.15.17:0/1499885226 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 15) v1 ==== 135659+0+0 (secure 0 0 0) 0x7f945000cd40 con 0x7f9464074540 2023-07-14T12:52:46.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.651+0000 7f9461ffb700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f94540a1140 0x7f94540a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:52:46.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.651+0000 7f9461ffb700 1 -- 172.21.15.17:0/1499885226 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3237+0+0 (secure 0 0 0) 0x7f9450014070 con 0x7f9464074540 2023-07-14T12:52:46.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.651+0000 7f9468ac1700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f94540a1140 0x7f94540a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:52:46.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.652+0000 7f9468ac1700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f94540a1140 0x7f94540a35f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9458009c60 tx=0x7f9458009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:52:46.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.656+0000 7f9461ffb700 1 -- 172.21.15.17:0/1499885226 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9450096290 con 0x7f9464074540 2023-07-14T12:52:46.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:46 smithi135 ceph-mon[97338]: pgmap v88: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:46.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-07-14T12:52:46.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-07-14T12:52:46.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:46 smithi135 ceph-mon[97338]: osdmap e20: 3 total, 3 up, 3 in 2023-07-14T12:52:46.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-07-14T12:52:46.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:46 smithi131 ceph-mon[96953]: pgmap v88: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:46.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-07-14T12:52:46.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-07-14T12:52:46.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:46 smithi131 ceph-mon[96953]: osdmap e20: 3 total, 3 up, 3 in 2023-07-14T12:52:46.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-07-14T12:52:46.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:46 smithi017 ceph-mon[95536]: pgmap v88: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:46.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-07-14T12:52:46.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-07-14T12:52:46.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:46 smithi017 ceph-mon[95536]: osdmap e20: 3 total, 3 up, 3 in 2023-07-14T12:52:46.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-07-14T12:52:46.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:46.872+0000 7f946ad25700 1 -- 172.21.15.17:0/1499885226 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9464060950 con 0x7f94540a1140 2023-07-14T12:52:47.350 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 12:52:47 smithi017 sudo[110849]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T12:52:47.350 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 12:52:47 smithi017 sudo[110849]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:47.350 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 12:52:47 smithi017 sudo[110849]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:47.350 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 12:52:47 smithi017 sudo[110849]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:47.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:52:47.419+0000 7f9461ffb700 1 -- 172.21.15.17:0/1499885226 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9450096660 con 0x7f9464074540 2023-07-14T12:52:47.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-07-14T12:52:47.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:47 smithi135 ceph-mon[97338]: osdmap e21: 3 total, 3 up, 3 in 2023-07-14T12:52:47.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:47 smithi135 ceph-mon[97338]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:47.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:47 smithi135 ceph-mon[97338]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:52:47.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:52:47.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:52:47.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:47.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-07-14T12:52:47.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:47 smithi131 ceph-mon[96953]: osdmap e21: 3 total, 3 up, 3 in 2023-07-14T12:52:47.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:47 smithi131 ceph-mon[96953]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:47.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:47 smithi131 ceph-mon[96953]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:52:47.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:52:47.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:52:47.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:47.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-07-14T12:52:47.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:47 smithi017 ceph-mon[95536]: osdmap e21: 3 total, 3 up, 3 in 2023-07-14T12:52:47.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:47 smithi017 ceph-mon[95536]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:47.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:47 smithi017 ceph-mon[95536]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:52:47.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:52:47.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:52:47.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:47.852 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 12:52:47 smithi017 sudo[110898]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-14T12:52:47.852 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 12:52:47 smithi017 sudo[110898]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:47.852 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 12:52:47 smithi017 sudo[110898]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:47.852 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 12:52:47 smithi017 sudo[110898]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:48.435 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 12:52:48 smithi131 sudo[104355]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T12:52:48.436 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 12:52:48 smithi131 sudo[104355]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:48.436 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 12:52:48 smithi131 sudo[104355]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:48.436 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 12:52:48 smithi131 sudo[104355]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:48.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:48 smithi017 ceph-mon[95536]: osdmap e22: 3 total, 3 up, 3 in 2023-07-14T12:52:48.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:48 smithi017 ceph-mon[95536]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-07-14T12:52:48.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:48 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:48.686 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 12:52:48 smithi131 sudo[104358]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-14T12:52:48.686 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 12:52:48 smithi131 sudo[104358]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:48.686 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 12:52:48 smithi131 sudo[104358]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:48.686 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:48 smithi131 ceph-mon[96953]: osdmap e22: 3 total, 3 up, 3 in 2023-07-14T12:52:48.686 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:48 smithi131 ceph-mon[96953]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-07-14T12:52:48.687 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:48 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:48.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:48 smithi135 ceph-mon[97338]: osdmap e22: 3 total, 3 up, 3 in 2023-07-14T12:52:48.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:48 smithi135 ceph-mon[97338]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-07-14T12:52:48.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:48 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:48.990 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 12:52:48 smithi131 sudo[104358]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:49.691 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 12:52:49 smithi135 sudo[105365]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T12:52:49.692 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 12:52:49 smithi135 sudo[105365]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:49.692 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 12:52:49 smithi135 sudo[105365]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:49.692 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 12:52:49 smithi135 sudo[105365]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:49.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:49 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:49.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:49 smithi131 ceph-mon[96953]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:49 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:50.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:49 smithi017 ceph-mon[95536]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:50.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:49 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:50.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:49 smithi135 ceph-mon[97338]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:50.192 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 12:52:49 smithi135 sudo[105368]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-14T12:52:50.193 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 12:52:49 smithi135 sudo[105368]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:50.193 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 12:52:49 smithi135 sudo[105368]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:50.193 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 12:52:49 smithi135 sudo[105368]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:50.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:50 smithi017 sudo[111053]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T12:52:50.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:50 smithi017 sudo[111053]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:50.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:50 smithi017 sudo[111053]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:50.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:50 smithi017 sudo[111053]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:51.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:50 smithi017 sudo[111056]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-14T12:52:51.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:50 smithi017 sudo[111056]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:51.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:50 smithi017 sudo[111056]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:51.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:50 smithi017 sudo[111056]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:51.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:50 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:51.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:50 smithi017 ceph-mon[95536]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T12:52:51.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:50 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:51.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:50 smithi135 ceph-mon[97338]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T12:52:51.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:50 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:52:51.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:50 smithi131 ceph-mon[96953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T12:52:51.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 sudo[105371]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T12:52:51.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 sudo[105371]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:51.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 sudo[105371]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:51.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 sudo[105371]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:52.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:52.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T12:52:52.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:52:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1435993440' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "784f3a65-facf-426b-babf-bde561f064cb"}]: dispatch 2023-07-14T12:52:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:52:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:52:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1435993440' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "784f3a65-facf-426b-babf-bde561f064cb"}]': finished 2023-07-14T12:52:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: osdmap e23: 4 total, 3 up, 4 in 2023-07-14T12:52:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:52:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:52:52.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:52:52.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:52:52.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:51 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2885162568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:52:52.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 sudo[105374]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-14T12:52:52.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 sudo[105374]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:52.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 sudo[105374]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:52.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 sudo[105374]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:52.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:52.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T12:52:52.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:52:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1435993440' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "784f3a65-facf-426b-babf-bde561f064cb"}]: dispatch 2023-07-14T12:52:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:52:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:52:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1435993440' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "784f3a65-facf-426b-babf-bde561f064cb"}]': finished 2023-07-14T12:52:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: osdmap e23: 4 total, 3 up, 4 in 2023-07-14T12:52:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:52:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:52:52.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:52:52.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:52:52.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:51 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2885162568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:52:52.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 sudo[104369]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T12:52:52.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 sudo[104369]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:52.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 sudo[104369]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:52.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 sudo[104369]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:53.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:52 smithi017 ceph-mon[95536]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T12:52:53.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:52 smithi017 ceph-mon[95536]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T12:52:53.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:52 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:52:53.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:52 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:52:53.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:52 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:52:53.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:52 smithi135 ceph-mon[97338]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T12:52:53.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:52 smithi135 ceph-mon[97338]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T12:52:53.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:52 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:52:53.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:52 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:52:53.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:52 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:52:53.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 sudo[104372]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-14T12:52:53.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 sudo[104372]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T12:52:53.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 sudo[104372]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T12:52:53.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 sudo[104372]: pam_unix(sudo:session): session closed for user root 2023-07-14T12:52:53.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:52:53.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T12:52:53.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:52:53.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1435993440' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "784f3a65-facf-426b-babf-bde561f064cb"}]: dispatch 2023-07-14T12:52:53.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:52:53.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:52:53.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1435993440' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "784f3a65-facf-426b-babf-bde561f064cb"}]': finished 2023-07-14T12:52:53.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: osdmap e23: 4 total, 3 up, 4 in 2023-07-14T12:52:53.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:52:53.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:52:53.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:52:53.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:52:53.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2885162568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:52:53.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T12:52:53.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T12:52:53.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:52:53.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:52:53.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:52:54.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:53 smithi135 ceph-mon[97338]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T12:52:54.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:53 smithi135 ceph-mon[97338]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 261 KiB/s wr, 16 op/s 2023-07-14T12:52:54.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:53 smithi135 ceph-mon[97338]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T12:52:54.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:53 smithi131 ceph-mon[96953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T12:52:54.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:53 smithi131 ceph-mon[96953]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 261 KiB/s wr, 16 op/s 2023-07-14T12:52:54.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:53 smithi131 ceph-mon[96953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T12:52:54.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:53 smithi017 ceph-mon[95536]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T12:52:54.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:53 smithi017 ceph-mon[95536]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 261 KiB/s wr, 16 op/s 2023-07-14T12:52:54.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:53 smithi017 ceph-mon[95536]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T12:52:56.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:55 smithi135 ceph-mon[97338]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-07-14T12:52:56.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:55 smithi131 ceph-mon[96953]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-07-14T12:52:56.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:55 smithi017 ceph-mon[95536]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 174 KiB/s wr, 10 op/s 2023-07-14T12:52:58.173 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:57 smithi017 ceph-mon[95536]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-07-14T12:52:58.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:57 smithi135 ceph-mon[97338]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-07-14T12:52:58.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:57 smithi131 ceph-mon[96953]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 130 KiB/s wr, 8 op/s 2023-07-14T12:52:59.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-14T12:52:59.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:59.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-14T12:52:59.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:52:59.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:58 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-14T12:52:59.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:58 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:00.032 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:59 smithi017 ceph-mon[95536]: Deploying daemon osd.3 on smithi017 2023-07-14T12:53:00.033 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:52:59 smithi017 ceph-mon[95536]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-07-14T12:53:00.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:59 smithi135 ceph-mon[97338]: Deploying daemon osd.3 on smithi017 2023-07-14T12:53:00.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:52:59 smithi135 ceph-mon[97338]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-07-14T12:53:00.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:59 smithi131 ceph-mon[96953]: Deploying daemon osd.3 on smithi017 2023-07-14T12:53:00.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:52:59 smithi131 ceph-mon[96953]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-07-14T12:53:02.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:01 smithi017 ceph-mon[95536]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-07-14T12:53:02.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:01 smithi135 ceph-mon[97338]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-07-14T12:53:02.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:01 smithi131 ceph-mon[96953]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-07-14T12:53:04.129 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:03 smithi017 ceph-mon[95536]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-07-14T12:53:04.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:03 smithi135 ceph-mon[97338]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-07-14T12:53:04.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:03 smithi131 ceph-mon[96953]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-07-14T12:53:06.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:05 smithi017 ceph-mon[95536]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-14T12:53:06.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:06.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:06.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:06.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:05 smithi135 ceph-mon[97338]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-14T12:53:06.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:06.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:06.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:06.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:05 smithi131 ceph-mon[96953]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-14T12:53:06.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:06.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:06.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:08.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:07 smithi017 ceph-mon[95536]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-14T12:53:08.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:07 smithi135 ceph-mon[97338]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-14T12:53:08.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:07 smithi131 ceph-mon[96953]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-14T12:53:09.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.488+0000 7f9461ffb700 1 -- 172.21.15.17:0/1499885226 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9464060950 con 0x7f94540a1140 2023-07-14T12:53:09.513 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 3 on host 'smithi017' 2023-07-14T12:53:09.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 -- 172.21.15.17:0/1499885226 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f94540a1140 msgr2=0x7f94540a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f94540a1140 0x7f94540a35f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9458009c60 tx=0x7f9458009260 comp rx=0 tx=0).stop 2023-07-14T12:53:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 -- 172.21.15.17:0/1499885226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9464074540 msgr2=0x7f946419c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9464074540 0x7f946419c3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f945000e9d0 tx=0x7f945000ece0 comp rx=0 tx=0).stop 2023-07-14T12:53:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 -- 172.21.15.17:0/1499885226 shutdown_connections 2023-07-14T12:53:09.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f94540a1140 0x7f94540a35f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:09.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f946410c170 0x7f94641a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:09.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9464072f70 0x7f946419be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:09.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 --2- 172.21.15.17:0/1499885226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9464074540 0x7f946419c3c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:09.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 -- 172.21.15.17:0/1499885226 >> 172.21.15.17:0/1499885226 conn(0x7f94640fb1a0 msgr2=0x7f94640fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:09.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 -- 172.21.15.17:0/1499885226 shutdown_connections 2023-07-14T12:53:09.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:53:09.491+0000 7f946ad25700 1 -- 172.21.15.17:0/1499885226 wait complete. 2023-07-14T12:53:09.542 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:09.542 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:09.543 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:09.543 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:09.543 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:09.543 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:09 smithi017 ceph-mon[95536]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-14T12:53:09.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:09.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:09.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:09.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:09.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:09.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:09 smithi135 ceph-mon[97338]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-14T12:53:09.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:09.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:09.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:09.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:09.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:09.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:09 smithi131 ceph-mon[96953]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-14T12:53:10.013 DEBUG:teuthology.orchestra.run.smithi017:osd.3> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.3.service 2023-07-14T12:53:10.018 INFO:tasks.cephadm:Deploying osd.4 on smithi131 with /dev/vg_nvme/lv_3... 2023-07-14T12:53:10.018 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-14T12:53:10.098 INFO:journalctl@ceph.osd.3.smithi017.stdout:-- Logs begin at Fri 2023-07-14 12:26:45 UTC. -- 2023-07-14T12:53:10.490 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:10 smithi131 ceph-mon[96953]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-14T12:53:10.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:10 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:10.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:10 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:10.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:10 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:10.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:10 smithi017 ceph-mon[95536]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-14T12:53:10.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:10 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:10.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:10 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:10.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:10 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:10.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:10 smithi135 ceph-mon[97338]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-14T12:53:10.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:10 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:10.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:10 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:10.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:10 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:10.744 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T12:53:11.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:11 smithi017 ceph-mon[95536]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-14T12:53:11.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:11 smithi017 ceph-mon[95536]: osdmap e24: 4 total, 3 up, 4 in 2023-07-14T12:53:11.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:11 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:11.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:11 smithi017 ceph-mon[95536]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:53:11.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:11 smithi017 ceph-mon[95536]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:53:11.602 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 12:53:11 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3[113327]: 2023-07-14T12:53:11.300+0000 7f6540d6c700 -1 osd.3 0 waiting for initial osdmap 2023-07-14T12:53:11.602 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 12:53:11 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3[113327]: 2023-07-14T12:53:11.310+0000 7f653a35c700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:53:11.647 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:11 smithi131 ceph-mon[96953]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-14T12:53:11.647 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:11 smithi131 ceph-mon[96953]: osdmap e24: 4 total, 3 up, 4 in 2023-07-14T12:53:11.648 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:11 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:11.648 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:11 smithi131 ceph-mon[96953]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:53:11.648 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:11 smithi131 ceph-mon[96953]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:53:11.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:11 smithi135 ceph-mon[97338]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-14T12:53:11.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:11 smithi135 ceph-mon[97338]: osdmap e24: 4 total, 3 up, 4 in 2023-07-14T12:53:11.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:11 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:11.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:11 smithi135 ceph-mon[97338]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:53:11.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:11 smithi135 ceph-mon[97338]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T12:53:12.588 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:12 smithi017 ceph-mon[95536]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:53:12.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:12 smithi017 ceph-mon[95536]: osdmap e25: 4 total, 3 up, 4 in 2023-07-14T12:53:12.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:12.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:12.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:12 smithi135 ceph-mon[97338]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:53:12.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:12 smithi135 ceph-mon[97338]: osdmap e25: 4 total, 3 up, 4 in 2023-07-14T12:53:12.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:12.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:12.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:12 smithi131 ceph-mon[96953]: from='osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:53:12.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:12 smithi131 ceph-mon[96953]: osdmap e25: 4 total, 3 up, 4 in 2023-07-14T12:53:12.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:12.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:12.749 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-14T12:53:12.749 INFO:teuthology.orchestra.run.smithi131.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-14T12:53:12.749 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10+0 records in 2023-07-14T12:53:12.749 INFO:teuthology.orchestra.run.smithi131.stderr:10+0 records out 2023-07-14T12:53:12.750 INFO:teuthology.orchestra.run.smithi131.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0302546 s, 347 MB/s 2023-07-14T12:53:12.750 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 2023-07-14T12:53:12.750 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping successful for: 2023-07-14T12:53:13.215 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi131:vg_nvme/lv_3 2023-07-14T12:53:13.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:53:13.492 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:53:13.492 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316] boot 2023-07-14T12:53:13.492 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: osdmap e26: 4 total, 4 up, 4 in 2023-07-14T12:53:13.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:13.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:13.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi017 2023-07-14T12:53:13.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:13.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:13.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi017 to 8636M 2023-07-14T12:53:13.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:13.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:13.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:53:13.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:53:13.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316] boot 2023-07-14T12:53:13.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: osdmap e26: 4 total, 4 up, 4 in 2023-07-14T12:53:13.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:13.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:13.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi017 2023-07-14T12:53:13.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:13.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:13.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi017 to 8636M 2023-07-14T12:53:13.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:13.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:13.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:53:13.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:53:13.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: osd.3 [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316] boot 2023-07-14T12:53:13.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: osdmap e26: 4 total, 4 up, 4 in 2023-07-14T12:53:13.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:53:13.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:13.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi017 2023-07-14T12:53:13.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:13.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:13.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi017 to 8636M 2023-07-14T12:53:13.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:13.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:13.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:13.941 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T12:53:14.478 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:14 smithi131 ceph-mon[96953]: osdmap e27: 4 total, 4 up, 4 in 2023-07-14T12:53:14.478 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:14 smithi131 ceph-mon[96953]: osdmap e28: 4 total, 4 up, 4 in 2023-07-14T12:53:14.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:14 smithi017 ceph-mon[95536]: osdmap e27: 4 total, 4 up, 4 in 2023-07-14T12:53:14.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:14 smithi017 ceph-mon[95536]: osdmap e28: 4 total, 4 up, 4 in 2023-07-14T12:53:14.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:14 smithi135 ceph-mon[97338]: osdmap e27: 4 total, 4 up, 4 in 2023-07-14T12:53:14.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:14 smithi135 ceph-mon[97338]: osdmap e28: 4 total, 4 up, 4 in 2023-07-14T12:53:15.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.290+0000 7fafe0de2700 1 -- 172.21.15.131:0/2014262687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc101720 msgr2=0x7fafdc107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.290+0000 7fafe0de2700 1 --2- 172.21.15.131:0/2014262687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc101720 0x7fafdc107fe0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fafd400b0a0 tx=0x7fafd400b3b0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.291+0000 7fafe0de2700 1 -- 172.21.15.131:0/2014262687 shutdown_connections 2023-07-14T12:53:15.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.291+0000 7fafe0de2700 1 --2- 172.21.15.131:0/2014262687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc101720 0x7fafdc107fe0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.291+0000 7fafe0de2700 1 --2- 172.21.15.131:0/2014262687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc0ffb90 0x7fafdc0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.291+0000 7fafe0de2700 1 --2- 172.21.15.131:0/2014262687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc100d90 0x7fafdc1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.291+0000 7fafe0de2700 1 -- 172.21.15.131:0/2014262687 >> 172.21.15.131:0/2014262687 conn(0x7fafdc0fb1a0 msgr2=0x7fafdc0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:15.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.291+0000 7fafe0de2700 1 -- 172.21.15.131:0/2014262687 shutdown_connections 2023-07-14T12:53:15.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.291+0000 7fafe0de2700 1 -- 172.21.15.131:0/2014262687 wait complete. 2023-07-14T12:53:15.318 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.292+0000 7fafe0de2700 1 Processor -- start 2023-07-14T12:53:15.318 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.292+0000 7fafe0de2700 1 -- start start 2023-07-14T12:53:15.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.292+0000 7fafe0de2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ffb90 0x7fafdc0742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.292+0000 7fafe0de2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc100d90 0x7fafdc072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.292+0000 7fafe0de2700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101720 0x7fafdc072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.292+0000 7fafe0de2700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc0735c0 con 0x7fafdc101720 2023-07-14T12:53:15.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.292+0000 7fafe0de2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc073730 con 0x7fafdc0ffb90 2023-07-14T12:53:15.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.292+0000 7fafe0de2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc19f980 con 0x7fafdc100d90 2023-07-14T12:53:15.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafda59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ffb90 0x7fafdc0742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.320 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafda59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ffb90 0x7fafdc0742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:51282/0 (socket says 172.21.15.131:51282) 2023-07-14T12:53:15.320 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafda59c700 1 -- 172.21.15.131:0/2854547806 learned_addr learned my addr 172.21.15.131:0/2854547806 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-07-14T12:53:15.320 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafd9d9b700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc100d90 0x7fafdc072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.320 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafdad9d700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101720 0x7fafdc072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.320 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafda59c700 1 -- 172.21.15.131:0/2854547806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc100d90 msgr2=0x7fafdc072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.320 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafda59c700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc100d90 0x7fafdc072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafda59c700 1 -- 172.21.15.131:0/2854547806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101720 msgr2=0x7fafdc072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:15.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafda59c700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101720 0x7fafdc072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:15.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafda59c700 1 -- 172.21.15.131:0/2854547806 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd4009d00 con 0x7fafdc0ffb90 2023-07-14T12:53:15.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafda59c700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ffb90 0x7fafdc0742b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00d980 tx=0x7fafcc00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:15.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafcb7fe700 1 -- 172.21.15.131:0/2854547806 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc004020 con 0x7fafdc0ffb90 2023-07-14T12:53:15.322 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafe0de2700 1 -- 172.21.15.131:0/2854547806 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafdc19fc60 con 0x7fafdc0ffb90 2023-07-14T12:53:15.322 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafcb7fe700 1 -- 172.21.15.131:0/2854547806 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fafcc009730 con 0x7fafdc0ffb90 2023-07-14T12:53:15.322 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.293+0000 7fafcb7fe700 1 -- 172.21.15.131:0/2854547806 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc003a00 con 0x7fafdc0ffb90 2023-07-14T12:53:15.322 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.294+0000 7fafe0de2700 1 -- 172.21.15.131:0/2854547806 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafdc1a0160 con 0x7fafdc0ffb90 2023-07-14T12:53:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.295+0000 7fafe0de2700 1 -- 172.21.15.131:0/2854547806 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafdc107180 con 0x7fafdc0ffb90 2023-07-14T12:53:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.297+0000 7fafcb7fe700 1 -- 172.21.15.131:0/2854547806 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fafcc0098a0 con 0x7fafdc0ffb90 2023-07-14T12:53:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.298+0000 7fafcb7fe700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 0x7fafc40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.298+0000 7fafcb7fe700 1 -- 172.21.15.131:0/2854547806 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3698+0+0 (secure 0 0 0) 0x7fafcc0cb830 con 0x7fafdc0ffb90 2023-07-14T12:53:15.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.298+0000 7fafd9d9b700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 0x7fafc40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:15.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.299+0000 7fafd9d9b700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 0x7fafc40a3600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fafd0004630 tx=0x7fafd000b3c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:15.325 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.301+0000 7fafcb7fe700 1 -- 172.21.15.131:0/2854547806 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fafcc0960e0 con 0x7fafdc0ffb90 2023-07-14T12:53:15.530 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:15.505+0000 7fafe0de2700 1 -- 172.21.15.131:0/2854547806 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fafdc060950 con 0x7fafc40a1150 2023-07-14T12:53:15.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:15 smithi017 ceph-mon[95536]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:15.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:15 smithi135 ceph-mon[97338]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:15.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:15 smithi131 ceph-mon[96953]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:16.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:16 smithi017 ceph-mon[95536]: osdmap e29: 4 total, 4 up, 4 in 2023-07-14T12:53:16.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:16 smithi017 ceph-mon[95536]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:53:16.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:16 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:53:16.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:16 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:53:16.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:16 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:16.628 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:16 smithi131 ceph-mon[96953]: osdmap e29: 4 total, 4 up, 4 in 2023-07-14T12:53:16.628 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:16 smithi131 ceph-mon[96953]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:53:16.629 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:16 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:53:16.629 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:16 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:53:16.629 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:16 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:16.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:16 smithi135 ceph-mon[97338]: osdmap e29: 4 total, 4 up, 4 in 2023-07-14T12:53:16.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:16 smithi135 ceph-mon[97338]: from='client.24239 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:53:16.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:16 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:53:16.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:16 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:53:16.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:16 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:17.459 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:17 smithi131 ceph-mon[96953]: osdmap e30: 4 total, 4 up, 4 in 2023-07-14T12:53:17.460 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:17 smithi131 ceph-mon[96953]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:17.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:17 smithi135 ceph-mon[97338]: osdmap e30: 4 total, 4 up, 4 in 2023-07-14T12:53:17.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:17 smithi135 ceph-mon[97338]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:17.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:17 smithi017 ceph-mon[95536]: osdmap e30: 4 total, 4 up, 4 in 2023-07-14T12:53:17.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:17 smithi017 ceph-mon[95536]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:18.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:18 smithi131 ceph-mon[96953]: from='client.? 172.21.15.131:0/1138899143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "443988de-50af-4760-ba5b-9b024a906d8d"}]: dispatch 2023-07-14T12:53:18.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:18 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "443988de-50af-4760-ba5b-9b024a906d8d"}]: dispatch 2023-07-14T12:53:18.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:18 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "443988de-50af-4760-ba5b-9b024a906d8d"}]': finished 2023-07-14T12:53:18.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:18 smithi131 ceph-mon[96953]: osdmap e31: 5 total, 4 up, 5 in 2023-07-14T12:53:18.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:18 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:18.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:18 smithi017 ceph-mon[95536]: from='client.? 172.21.15.131:0/1138899143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "443988de-50af-4760-ba5b-9b024a906d8d"}]: dispatch 2023-07-14T12:53:18.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:18 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "443988de-50af-4760-ba5b-9b024a906d8d"}]: dispatch 2023-07-14T12:53:18.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:18 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "443988de-50af-4760-ba5b-9b024a906d8d"}]': finished 2023-07-14T12:53:18.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:18 smithi017 ceph-mon[95536]: osdmap e31: 5 total, 4 up, 5 in 2023-07-14T12:53:18.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:18 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:18.942 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:18 smithi135 ceph-mon[97338]: from='client.? 172.21.15.131:0/1138899143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "443988de-50af-4760-ba5b-9b024a906d8d"}]: dispatch 2023-07-14T12:53:18.942 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:18 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "443988de-50af-4760-ba5b-9b024a906d8d"}]: dispatch 2023-07-14T12:53:18.942 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:18 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "443988de-50af-4760-ba5b-9b024a906d8d"}]': finished 2023-07-14T12:53:18.943 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:18 smithi135 ceph-mon[97338]: osdmap e31: 5 total, 4 up, 5 in 2023-07-14T12:53:18.943 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:18 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:19.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:19 smithi131 ceph-mon[96953]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 129 KiB/s, 0 objects/s recovering 2023-07-14T12:53:19.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:19 smithi131 ceph-mon[96953]: from='client.? 172.21.15.131:0/4149720064' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:53:19.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:19 smithi017 ceph-mon[95536]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 129 KiB/s, 0 objects/s recovering 2023-07-14T12:53:19.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:19 smithi017 ceph-mon[95536]: from='client.? 172.21.15.131:0/4149720064' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:53:19.942 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:19 smithi135 ceph-mon[97338]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 129 KiB/s, 0 objects/s recovering 2023-07-14T12:53:19.942 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:19 smithi135 ceph-mon[97338]: from='client.? 172.21.15.131:0/4149720064' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:53:22.100 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:21 smithi017 ceph-mon[95536]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-07-14T12:53:22.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:21 smithi135 ceph-mon[97338]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-07-14T12:53:22.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:21 smithi131 ceph-mon[96953]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-07-14T12:53:24.135 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:23 smithi131 ceph-mon[96953]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-07-14T12:53:24.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:23 smithi135 ceph-mon[97338]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-07-14T12:53:24.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:23 smithi017 ceph-mon[95536]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-07-14T12:53:26.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:25 smithi135 ceph-mon[97338]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2023-07-14T12:53:26.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:25 smithi131 ceph-mon[96953]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2023-07-14T12:53:26.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:25 smithi017 ceph-mon[95536]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2023-07-14T12:53:27.069 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:26 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-14T12:53:27.069 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:26 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:27.069 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:26 smithi131 ceph-mon[96953]: Deploying daemon osd.4 on smithi131 2023-07-14T12:53:27.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:26 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-14T12:53:27.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:26 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:27.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:26 smithi135 ceph-mon[97338]: Deploying daemon osd.4 on smithi131 2023-07-14T12:53:27.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:26 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-14T12:53:27.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:26 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:27.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:26 smithi017 ceph-mon[95536]: Deploying daemon osd.4 on smithi131 2023-07-14T12:53:28.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:27 smithi135 ceph-mon[97338]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-07-14T12:53:28.240 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:27 smithi131 ceph-mon[96953]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-07-14T12:53:28.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:27 smithi017 ceph-mon[95536]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-07-14T12:53:30.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:29 smithi135 ceph-mon[97338]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:30.201 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:29 smithi131 ceph-mon[96953]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:30.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:29 smithi017 ceph-mon[95536]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:32.122 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:31 smithi131 ceph-mon[96953]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:32.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:31 smithi135 ceph-mon[97338]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:32.350 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:31 smithi017 ceph-mon[95536]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:33.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:33 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:33.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:33 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:33.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:33 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:33.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:33 smithi131 ceph-mon[96953]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:33.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:33 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:33.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:33 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:33.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:33 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:33.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:33 smithi017 ceph-mon[95536]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:33.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:33 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:33.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:33 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:33.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:33 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:33.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:33 smithi135 ceph-mon[97338]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:35.456 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.431+0000 7fafcb7fe700 1 -- 172.21.15.131:0/2854547806 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fafdc060950 con 0x7fafc40a1150 2023-07-14T12:53:35.456 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 4 on host 'smithi131' 2023-07-14T12:53:35.459 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 -- 172.21.15.131:0/2854547806 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 msgr2=0x7fafc40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:35.459 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 0x7fafc40a3600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fafd0004630 tx=0x7fafd000b3c0 comp rx=0 tx=0).stop 2023-07-14T12:53:35.459 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 -- 172.21.15.131:0/2854547806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ffb90 msgr2=0x7fafdc0742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:35.459 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ffb90 0x7fafdc0742b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00d980 tx=0x7fafcc00dc90 comp rx=0 tx=0).stop 2023-07-14T12:53:35.460 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 -- 172.21.15.131:0/2854547806 shutdown_connections 2023-07-14T12:53:35.460 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 0x7fafc40a3600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:35.460 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101720 0x7fafdc072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:35.460 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ffb90 0x7fafdc0742b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:35.460 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 --2- 172.21.15.131:0/2854547806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc100d90 0x7fafdc072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:35.461 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 -- 172.21.15.131:0/2854547806 >> 172.21.15.131:0/2854547806 conn(0x7fafdc0fb1a0 msgr2=0x7fafdc1042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:35.461 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 -- 172.21.15.131:0/2854547806 shutdown_connections 2023-07-14T12:53:35.461 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:53:35.435+0000 7fafe0de2700 1 -- 172.21.15.131:0/2854547806 wait complete. 2023-07-14T12:53:35.963 DEBUG:teuthology.orchestra.run.smithi131:osd.4> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.4.service 2023-07-14T12:53:35.967 INFO:tasks.cephadm:Deploying osd.5 on smithi135 with /dev/vg_nvme/lv_3... 2023-07-14T12:53:35.967 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-14T12:53:36.059 INFO:journalctl@ceph.osd.4.smithi131.stdout:-- Logs begin at Fri 2023-07-14 12:26:41 UTC. -- 2023-07-14T12:53:36.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:35 smithi135 ceph-mon[97338]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:36.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:35 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:35 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:35 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:36.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:35 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:36.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:35 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:35 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:35 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:35 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:36.222 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:35 smithi131 ceph-mon[96953]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:36.222 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:35 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:35 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:35 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:36.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:35 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:36.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:35 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:35 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:35 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:35 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:36.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:35 smithi017 ceph-mon[95536]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:36.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:36.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:36.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:36.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:35 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:36.491 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 12:53:36 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-4[107581]: 2023-07-14T12:53:36.196+0000 7fd8083c5640 -1 osd.4 0 log_to_monitors true 2023-07-14T12:53:36.708 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:53:37.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:36 smithi135 ceph-mon[97338]: from='osd.4 [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T12:53:37.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:36 smithi135 ceph-mon[97338]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T12:53:37.197 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:36 smithi131 ceph-mon[96953]: from='osd.4 [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T12:53:37.197 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:36 smithi131 ceph-mon[96953]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T12:53:37.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:36 smithi017 ceph-mon[95536]: from='osd.4 [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T12:53:37.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:36 smithi017 ceph-mon[95536]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T12:53:38.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:37 smithi135 ceph-mon[97338]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:38.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:37 smithi135 ceph-mon[97338]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-14T12:53:38.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:37 smithi135 ceph-mon[97338]: osdmap e32: 5 total, 4 up, 5 in 2023-07-14T12:53:38.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:37 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:38.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:37 smithi135 ceph-mon[97338]: from='osd.4 [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:53:38.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:37 smithi135 ceph-mon[97338]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:53:38.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:37 smithi131 ceph-mon[96953]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:38.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:37 smithi131 ceph-mon[96953]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-14T12:53:38.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:37 smithi131 ceph-mon[96953]: osdmap e32: 5 total, 4 up, 5 in 2023-07-14T12:53:38.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:37 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:38.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:37 smithi131 ceph-mon[96953]: from='osd.4 [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:53:38.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:37 smithi131 ceph-mon[96953]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:53:38.243 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 12:53:37 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-4[107581]: 2023-07-14T12:53:37.899+0000 7fd7fda3d700 -1 osd.4 0 waiting for initial osdmap 2023-07-14T12:53:38.243 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 12:53:37 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-4[107581]: 2023-07-14T12:53:37.911+0000 7fd7f602b700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:53:38.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:37 smithi017 ceph-mon[95536]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:38.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:37 smithi017 ceph-mon[95536]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-14T12:53:38.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:37 smithi017 ceph-mon[95536]: osdmap e32: 5 total, 4 up, 5 in 2023-07-14T12:53:38.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:37 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:38.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:37 smithi017 ceph-mon[95536]: from='osd.4 [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:53:38.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:37 smithi017 ceph-mon[95536]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:53:38.636 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-14T12:53:38.636 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-14T12:53:38.637 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-07-14T12:53:38.637 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-07-14T12:53:38.637 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0296624 s, 354 MB/s 2023-07-14T12:53:38.637 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-07-14T12:53:38.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:53:38.991 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: osdmap e33: 5 total, 4 up, 5 in 2023-07-14T12:53:38.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:38.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:38.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:38.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:38.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:38.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:38.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:38.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:38.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:38.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:39.087 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2023-07-14T12:53:39.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:53:39.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: osdmap e33: 5 total, 4 up, 5 in 2023-07-14T12:53:39.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:39.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:39.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:39.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:39.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:39.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:39.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:39.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:39.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:39.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:39.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:53:39.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: osdmap e33: 5 total, 4 up, 5 in 2023-07-14T12:53:39.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:39.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:39.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:39.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:39.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:39.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:53:39.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:39.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:39.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:53:39.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:39.807 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:53:40.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:39 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:53:40.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:39 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:53:40.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:39 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi131 2023-07-14T12:53:40.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:39 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi131 to 8633M 2023-07-14T12:53:40.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:39 smithi135 ceph-mon[97338]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:40.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:39 smithi135 ceph-mon[97338]: osd.4 [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738] boot 2023-07-14T12:53:40.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:39 smithi135 ceph-mon[97338]: osdmap e34: 5 total, 5 up, 5 in 2023-07-14T12:53:40.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:39 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:40.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:39 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:53:40.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:39 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:53:40.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:39 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi131 2023-07-14T12:53:40.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:39 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi131 to 8633M 2023-07-14T12:53:40.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:39 smithi131 ceph-mon[96953]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:40.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:39 smithi131 ceph-mon[96953]: osd.4 [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738] boot 2023-07-14T12:53:40.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:39 smithi131 ceph-mon[96953]: osdmap e34: 5 total, 5 up, 5 in 2023-07-14T12:53:40.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:39 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:40.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:39 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:53:40.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:39 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:53:40.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:39 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi131 2023-07-14T12:53:40.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:39 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi131 to 8633M 2023-07-14T12:53:40.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:39 smithi017 ceph-mon[95536]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-14T12:53:40.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:39 smithi017 ceph-mon[95536]: osd.4 [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738] boot 2023-07-14T12:53:40.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:39 smithi017 ceph-mon[95536]: osdmap e34: 5 total, 5 up, 5 in 2023-07-14T12:53:40.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:39 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:53:41.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:40 smithi135 ceph-mon[97338]: osdmap e35: 5 total, 5 up, 5 in 2023-07-14T12:53:41.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:40 smithi131 ceph-mon[96953]: osdmap e35: 5 total, 5 up, 5 in 2023-07-14T12:53:41.294 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.269+0000 7fafbd81c700 1 -- 172.21.15.135:0/3697604103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb8100d90 msgr2=0x7fafb81011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:41.295 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.269+0000 7fafbd81c700 1 --2- 172.21.15.135:0/3697604103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb8100d90 0x7fafb81011e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fafac009990 tx=0x7fafac009ca0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.295 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.269+0000 7fafbd81c700 1 -- 172.21.15.135:0/3697604103 shutdown_connections 2023-07-14T12:53:41.295 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.269+0000 7fafbd81c700 1 --2- 172.21.15.135:0/3697604103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafb8101720 0x7fafb8107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.295 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.269+0000 7fafbd81c700 1 --2- 172.21.15.135:0/3697604103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafb80ffb90 0x7fafb80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.295 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.269+0000 7fafbd81c700 1 --2- 172.21.15.135:0/3697604103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb8100d90 0x7fafb81011e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.296 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.269+0000 7fafbd81c700 1 -- 172.21.15.135:0/3697604103 >> 172.21.15.135:0/3697604103 conn(0x7fafb80fb1a0 msgr2=0x7fafb80fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:53:41.296 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.269+0000 7fafbd81c700 1 -- 172.21.15.135:0/3697604103 shutdown_connections 2023-07-14T12:53:41.296 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.270+0000 7fafbd81c700 1 -- 172.21.15.135:0/3697604103 wait complete. 2023-07-14T12:53:41.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.270+0000 7fafbd81c700 1 Processor -- start 2023-07-14T12:53:41.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafbd81c700 1 -- start start 2023-07-14T12:53:41.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafbd81c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafb80ffb90 0x7fafb80742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:41.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafbd81c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafb8100d90 0x7fafb8072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:41.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafbd81c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb8101720 0x7fafb8072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:41.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafbd81c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb80735c0 con 0x7fafb80ffb90 2023-07-14T12:53:41.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafbd81c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb8073730 con 0x7fafb8100d90 2023-07-14T12:53:41.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafbd81c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb819f8d0 con 0x7fafb8101720 2023-07-14T12:53:41.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafb77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb8101720 0x7fafb8072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:41.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafb77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb8101720 0x7fafb8072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59000/0 (socket says 172.21.15.135:59000) 2023-07-14T12:53:41.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafb77fe700 1 -- 172.21.15.135:0/1019917754 learned_addr learned my addr 172.21.15.135:0/1019917754 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-07-14T12:53:41.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafb6ffd700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafb80ffb90 0x7fafb80742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:41.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.271+0000 7fafb67fc700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafb8100d90 0x7fafb8072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:41.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.272+0000 7fafb77fe700 1 -- 172.21.15.135:0/1019917754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafb8100d90 msgr2=0x7fafb8072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:41.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.272+0000 7fafb77fe700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafb8100d90 0x7fafb8072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.272+0000 7fafb77fe700 1 -- 172.21.15.135:0/1019917754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafb80ffb90 msgr2=0x7fafb80742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:53:41.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.272+0000 7fafb77fe700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafb80ffb90 0x7fafb80742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:53:41.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.272+0000 7fafb77fe700 1 -- 172.21.15.135:0/1019917754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0095f0 con 0x7fafb8101720 2023-07-14T12:53:41.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.272+0000 7fafb77fe700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb8101720 0x7fafb8072e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fafb000b970 tx=0x7fafb000bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:41.301 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.272+0000 7fafbc81a700 1 -- 172.21.15.135:0/1019917754 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000d860 con 0x7fafb8101720 2023-07-14T12:53:41.301 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.272+0000 7fafbc81a700 1 -- 172.21.15.135:0/1019917754 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fafb000de50 con 0x7fafb8101720 2023-07-14T12:53:41.301 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.272+0000 7fafbd81c700 1 -- 172.21.15.135:0/1019917754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb819fbb0 con 0x7fafb8101720 2023-07-14T12:53:41.301 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.272+0000 7fafbc81a700 1 -- 172.21.15.135:0/1019917754 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0017400 con 0x7fafb8101720 2023-07-14T12:53:41.301 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.272+0000 7fafbd81c700 1 -- 172.21.15.135:0/1019917754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb81a00b0 con 0x7fafb8101720 2023-07-14T12:53:41.302 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.273+0000 7fafbd81c700 1 -- 172.21.15.135:0/1019917754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb810b2d0 con 0x7fafb8101720 2023-07-14T12:53:41.302 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.277+0000 7fafbc81a700 1 -- 172.21.15.135:0/1019917754 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fafb000d9c0 con 0x7fafb8101720 2023-07-14T12:53:41.303 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.278+0000 7fafbc81a700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafa00a11d0 0x7fafa00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:53:41.303 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.278+0000 7fafbc81a700 1 -- 172.21.15.135:0/1019917754 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7fafb0006e40 con 0x7fafb8101720 2023-07-14T12:53:41.304 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.279+0000 7fafb6ffd700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafa00a11d0 0x7fafa00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:53:41.304 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.279+0000 7fafb6ffd700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafa00a11d0 0x7fafa00a3680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafb8100bf0 tx=0x7fafa800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:53:41.306 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.281+0000 7fafbc81a700 1 -- 172.21.15.135:0/1019917754 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fafb0095d80 con 0x7fafb8101720 2023-07-14T12:53:41.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:40 smithi017 ceph-mon[95536]: osdmap e35: 5 total, 5 up, 5 in 2023-07-14T12:53:41.506 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:53:41.482+0000 7fafbd81c700 1 -- 172.21.15.135:0/1019917754 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fafb8060950 con 0x7fafa00a11d0 2023-07-14T12:53:42.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:41 smithi131 ceph-mon[96953]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:42.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:41 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:53:42.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:41 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:53:42.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:41 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:42.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:41 smithi017 ceph-mon[95536]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:42.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:41 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:53:42.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:41 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:53:42.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:41 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:42.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:41 smithi135 ceph-mon[97338]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:42.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:41 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:53:42.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:41 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:53:42.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:41 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:43.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:42 smithi135 ceph-mon[97338]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:53:43.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:42 smithi131 ceph-mon[96953]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:53:43.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:42 smithi017 ceph-mon[95536]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:53:44.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:43 smithi131 ceph-mon[96953]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:44.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:43 smithi017 ceph-mon[95536]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:44.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:43 smithi135 ceph-mon[97338]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:45.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:44 smithi131 ceph-mon[96953]: from='client.? 172.21.15.135:0/898257638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "adb30dc0-fa38-45d5-8413-e049e6a1dd6b"}]: dispatch 2023-07-14T12:53:45.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:44 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "adb30dc0-fa38-45d5-8413-e049e6a1dd6b"}]: dispatch 2023-07-14T12:53:45.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:44 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adb30dc0-fa38-45d5-8413-e049e6a1dd6b"}]': finished 2023-07-14T12:53:45.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:44 smithi131 ceph-mon[96953]: osdmap e36: 6 total, 5 up, 6 in 2023-07-14T12:53:45.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:53:45.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:44 smithi017 ceph-mon[95536]: from='client.? 172.21.15.135:0/898257638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "adb30dc0-fa38-45d5-8413-e049e6a1dd6b"}]: dispatch 2023-07-14T12:53:45.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:44 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "adb30dc0-fa38-45d5-8413-e049e6a1dd6b"}]: dispatch 2023-07-14T12:53:45.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:44 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adb30dc0-fa38-45d5-8413-e049e6a1dd6b"}]': finished 2023-07-14T12:53:45.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:44 smithi017 ceph-mon[95536]: osdmap e36: 6 total, 5 up, 6 in 2023-07-14T12:53:45.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:53:45.442 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:44 smithi135 ceph-mon[97338]: from='client.? 172.21.15.135:0/898257638' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "adb30dc0-fa38-45d5-8413-e049e6a1dd6b"}]: dispatch 2023-07-14T12:53:45.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:44 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "adb30dc0-fa38-45d5-8413-e049e6a1dd6b"}]: dispatch 2023-07-14T12:53:45.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:44 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adb30dc0-fa38-45d5-8413-e049e6a1dd6b"}]': finished 2023-07-14T12:53:45.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:44 smithi135 ceph-mon[97338]: osdmap e36: 6 total, 5 up, 6 in 2023-07-14T12:53:45.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:53:46.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:45 smithi131 ceph-mon[96953]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:46.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:45 smithi131 ceph-mon[96953]: from='client.? 172.21.15.135:0/2716537848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:53:46.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:45 smithi017 ceph-mon[95536]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:46.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:45 smithi017 ceph-mon[95536]: from='client.? 172.21.15.135:0/2716537848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:53:46.442 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:45 smithi135 ceph-mon[97338]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:46.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:45 smithi135 ceph-mon[97338]: from='client.? 172.21.15.135:0/2716537848' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:53:48.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:47 smithi131 ceph-mon[96953]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:48.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:47 smithi017 ceph-mon[95536]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:48.431 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:47 smithi135 ceph-mon[97338]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:50.229 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:49 smithi135 ceph-mon[97338]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:50.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:49 smithi131 ceph-mon[96953]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:50.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:49 smithi017 ceph-mon[95536]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:52.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:51 smithi135 ceph-mon[97338]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-14T12:53:52.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:52.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:51 smithi131 ceph-mon[96953]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:52.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-14T12:53:52.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:52.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:51 smithi017 ceph-mon[95536]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:52.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-14T12:53:52.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:53:53.021 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:52 smithi135 ceph-mon[97338]: Deploying daemon osd.5 on smithi135 2023-07-14T12:53:53.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:52 smithi131 ceph-mon[96953]: Deploying daemon osd.5 on smithi135 2023-07-14T12:53:53.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:52 smithi017 ceph-mon[95536]: Deploying daemon osd.5 on smithi135 2023-07-14T12:53:54.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:53 smithi131 ceph-mon[96953]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:54.254 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:53 smithi135 ceph-mon[97338]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:54.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:53 smithi017 ceph-mon[95536]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:56.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:55 smithi131 ceph-mon[96953]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:56.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:55 smithi017 ceph-mon[95536]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:56.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:55 smithi135 ceph-mon[97338]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:58.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:57 smithi131 ceph-mon[96953]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:58.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:57 smithi017 ceph-mon[95536]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:58.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:57 smithi135 ceph-mon[97338]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:53:59.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:58 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:59.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:58 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:59.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:53:58 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:59.268 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:59.268 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:59.268 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:53:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:59.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:53:59.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:53:59.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:53:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:00.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:00 smithi135 ceph-mon[97338]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:00.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:00 smithi017 ceph-mon[95536]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:00.491 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:00 smithi131 ceph-mon[96953]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:01.640 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.615+0000 7fafbc81a700 1 -- 172.21.15.135:0/1019917754 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fafb8060950 con 0x7fafa00a11d0 2023-07-14T12:54:01.640 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 5 on host 'smithi135' 2023-07-14T12:54:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 -- 172.21.15.135:0/1019917754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafa00a11d0 msgr2=0x7fafa00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:01.642 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafa00a11d0 0x7fafa00a3680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafb8100bf0 tx=0x7fafa800b410 comp rx=0 tx=0).stop 2023-07-14T12:54:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 -- 172.21.15.135:0/1019917754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb8101720 msgr2=0x7fafb8072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb8101720 0x7fafb8072e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fafb000b970 tx=0x7fafb000bc80 comp rx=0 tx=0).stop 2023-07-14T12:54:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 -- 172.21.15.135:0/1019917754 shutdown_connections 2023-07-14T12:54:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafa00a11d0 0x7fafa00a3680 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb8101720 0x7fafb8072e40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafb80ffb90 0x7fafb80742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.643 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 --2- 172.21.15.135:0/1019917754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafb8100d90 0x7fafb8072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:01.644 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 -- 172.21.15.135:0/1019917754 >> 172.21.15.135:0/1019917754 conn(0x7fafb80fb1a0 msgr2=0x7fafb80fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:01.644 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 -- 172.21.15.135:0/1019917754 shutdown_connections 2023-07-14T12:54:01.644 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:54:01.617+0000 7fafbd81c700 1 -- 172.21.15.135:0/1019917754 wait complete. 2023-07-14T12:54:02.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:01 smithi135 ceph-mon[97338]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:02.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:01 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:01 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:01 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:02.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:01 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:02.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:01 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:01 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:01 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:01 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:02.120 DEBUG:teuthology.orchestra.run.smithi135:osd.5> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.5.service 2023-07-14T12:54:02.124 INFO:tasks.cephadm:Deploying osd.6 on smithi017 with /dev/vg_nvme/lv_2... 2023-07-14T12:54:02.124 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-14T12:54:02.196 INFO:journalctl@ceph.osd.5.smithi135.stdout:-- Logs begin at Fri 2023-07-14 12:26:36 UTC. -- 2023-07-14T12:54:02.213 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:01 smithi017 ceph-mon[95536]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:02.213 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:01 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.213 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:01 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.214 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:01 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:02.214 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:01 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:02.214 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:01 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.214 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:01 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.214 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:01 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.214 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:01 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:02.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:01 smithi131 ceph-mon[96953]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:02.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:01 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:01 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:01 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:02.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:01 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:02.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:01 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:01 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:01 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:02.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:01 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:02.883 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:54:03.070 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:02 smithi135 ceph-mon[97338]: from='osd.5 [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T12:54:03.070 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:02 smithi135 ceph-mon[97338]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T12:54:03.210 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:02 smithi017 ceph-mon[95536]: from='osd.5 [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T12:54:03.211 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:02 smithi017 ceph-mon[95536]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T12:54:03.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:02 smithi131 ceph-mon[96953]: from='osd.5 [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T12:54:03.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:02 smithi131 ceph-mon[96953]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T12:54:04.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:03 smithi017 ceph-mon[95536]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:04.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:03 smithi017 ceph-mon[95536]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-14T12:54:04.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:03 smithi017 ceph-mon[95536]: osdmap e37: 6 total, 5 up, 6 in 2023-07-14T12:54:04.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:03 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:04.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:03 smithi017 ceph-mon[95536]: from='osd.5 [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:54:04.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:03 smithi017 ceph-mon[95536]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:54:04.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:03 smithi135 ceph-mon[97338]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:04.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:03 smithi135 ceph-mon[97338]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-14T12:54:04.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:03 smithi135 ceph-mon[97338]: osdmap e37: 6 total, 5 up, 6 in 2023-07-14T12:54:04.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:03 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:04.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:03 smithi135 ceph-mon[97338]: from='osd.5 [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:54:04.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:03 smithi135 ceph-mon[97338]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:54:04.195 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 12:54:03 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T12:54:03.922+0000 7fddbaa42700 -1 osd.5 0 waiting for initial osdmap 2023-07-14T12:54:04.195 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 12:54:03 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T12:54:03.931+0000 7fddb282f700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:54:04.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:03 smithi131 ceph-mon[96953]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:04.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:03 smithi131 ceph-mon[96953]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-14T12:54:04.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:03 smithi131 ceph-mon[96953]: osdmap e37: 6 total, 5 up, 6 in 2023-07-14T12:54:04.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:03 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:04.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:03 smithi131 ceph-mon[96953]: from='osd.5 [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:54:04.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:03 smithi131 ceph-mon[96953]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:54:04.836 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-14T12:54:04.836 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-14T12:54:04.837 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2023-07-14T12:54:04.837 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2023-07-14T12:54:04.837 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0299772 s, 350 MB/s 2023-07-14T12:54:04.837 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2023-07-14T12:54:05.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:04 smithi131 ceph-mon[96953]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:54:05.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:04 smithi131 ceph-mon[96953]: osdmap e38: 6 total, 5 up, 6 in 2023-07-14T12:54:05.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:04 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:05.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:04 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:05.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:04 smithi017 ceph-mon[95536]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:54:05.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:04 smithi017 ceph-mon[95536]: osdmap e38: 6 total, 5 up, 6 in 2023-07-14T12:54:05.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:04 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:05.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:04 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:05.367 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi017:vg_nvme/lv_2 2023-07-14T12:54:05.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:04 smithi135 ceph-mon[97338]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:54:05.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:04 smithi135 ceph-mon[97338]: osdmap e38: 6 total, 5 up, 6 in 2023-07-14T12:54:05.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:04 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:05.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:04 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:06.101 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:54:06.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:54:06.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:54:06.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:06.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:06.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: osd.5 [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229] boot 2023-07-14T12:54:06.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: osdmap e39: 6 total, 6 up, 6 in 2023-07-14T12:54:06.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:06.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi135 2023-07-14T12:54:06.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:06.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:06.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi135 to 8633M 2023-07-14T12:54:06.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:06.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:06.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:05 smithi131 ceph-mon[96953]: osdmap e40: 6 total, 6 up, 6 in 2023-07-14T12:54:06.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:54:06.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:54:06.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:06.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:06.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: osd.5 [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229] boot 2023-07-14T12:54:06.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: osdmap e39: 6 total, 6 up, 6 in 2023-07-14T12:54:06.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:06.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi135 2023-07-14T12:54:06.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:06.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:06.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi135 to 8633M 2023-07-14T12:54:06.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:06.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:06.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:05 smithi017 ceph-mon[95536]: osdmap e40: 6 total, 6 up, 6 in 2023-07-14T12:54:06.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:54:06.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:54:06.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-14T12:54:06.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:06.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: osd.5 [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229] boot 2023-07-14T12:54:06.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: osdmap e39: 6 total, 6 up, 6 in 2023-07-14T12:54:06.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:54:06.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi135 2023-07-14T12:54:06.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:06.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:06.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi135 to 8633M 2023-07-14T12:54:06.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:06.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:06.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:06.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:05 smithi135 ceph-mon[97338]: osdmap e40: 6 total, 6 up, 6 in 2023-07-14T12:54:07.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.594+0000 7f618a96d700 1 -- 172.21.15.17:0/4249726129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184074540 msgr2=0x7f61840729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.594+0000 7f618a96d700 1 --2- 172.21.15.17:0/4249726129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184074540 0x7f61840729a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f61740099c0 tx=0x7f6174009cd0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.594+0000 7f618a96d700 1 -- 172.21.15.17:0/4249726129 shutdown_connections 2023-07-14T12:54:07.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.594+0000 7f618a96d700 1 --2- 172.21.15.17:0/4249726129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f618410c170 0x7f618410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.594+0000 7f618a96d700 1 --2- 172.21.15.17:0/4249726129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184074540 0x7f61840729a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.594+0000 7f618a96d700 1 --2- 172.21.15.17:0/4249726129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6184072f70 0x7f61840733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.594+0000 7f618a96d700 1 -- 172.21.15.17:0/4249726129 >> 172.21.15.17:0/4249726129 conn(0x7f61840fb1a0 msgr2=0x7f61840fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:07.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.594+0000 7f618a96d700 1 -- 172.21.15.17:0/4249726129 shutdown_connections 2023-07-14T12:54:07.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.594+0000 7f618a96d700 1 -- 172.21.15.17:0/4249726129 wait complete. 2023-07-14T12:54:07.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.595+0000 7f618a96d700 1 Processor -- start 2023-07-14T12:54:07.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.595+0000 7f618a96d700 1 -- start start 2023-07-14T12:54:07.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.595+0000 7f618a96d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184072f70 0x7f618419be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.595+0000 7f618a96d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6184074540 0x7f618419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.595+0000 7f618a96d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f618410c170 0x7f61841a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.595+0000 7f618a96d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61841a39d0 con 0x7f6184072f70 2023-07-14T12:54:07.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.595+0000 7f618a96d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61841a3b10 con 0x7f6184074540 2023-07-14T12:54:07.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.595+0000 7f618a96d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61841a3ca0 con 0x7f618410c170 2023-07-14T12:54:07.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.596+0000 7f6183fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184072f70 0x7f618419be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.596+0000 7f6183fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184072f70 0x7f618419be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48068/0 (socket says 172.21.15.17:48068) 2023-07-14T12:54:07.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.596+0000 7f6183fff700 1 -- 172.21.15.17:0/1930273769 learned_addr learned my addr 172.21.15.17:0/1930273769 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:54:07.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.596+0000 7f6188f0a700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f618410c170 0x7f61841a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.596+0000 7f61837fe700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6184074540 0x7f618419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.596+0000 7f6183fff700 1 -- 172.21.15.17:0/1930273769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f618410c170 msgr2=0x7f61841a3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.596+0000 7f6183fff700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f618410c170 0x7f61841a3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.596+0000 7f6183fff700 1 -- 172.21.15.17:0/1930273769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6184074540 msgr2=0x7f618419c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:07.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.596+0000 7f6183fff700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6184074540 0x7f618419c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:07.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.596+0000 7f6183fff700 1 -- 172.21.15.17:0/1930273769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61740095f0 con 0x7f6184072f70 2023-07-14T12:54:07.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.596+0000 7f6183fff700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184072f70 0x7f618419be40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f617400b580 tx=0x7f6174003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:07.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.597+0000 7f61817fa700 1 -- 172.21.15.17:0/1930273769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617401d070 con 0x7f6184072f70 2023-07-14T12:54:07.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.597+0000 7f61817fa700 1 -- 172.21.15.17:0/1930273769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f617400bd30 con 0x7f6184072f70 2023-07-14T12:54:07.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.597+0000 7f618a96d700 1 -- 172.21.15.17:0/1930273769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61841a3f20 con 0x7f6184072f70 2023-07-14T12:54:07.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.597+0000 7f61817fa700 1 -- 172.21.15.17:0/1930273769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174022bf0 con 0x7f6184072f70 2023-07-14T12:54:07.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.597+0000 7f618a96d700 1 -- 172.21.15.17:0/1930273769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61841a4280 con 0x7f6184072f70 2023-07-14T12:54:07.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.598+0000 7f618a96d700 1 -- 172.21.15.17:0/1930273769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6184101cc0 con 0x7f6184072f70 2023-07-14T12:54:07.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.600+0000 7f61817fa700 1 -- 172.21.15.17:0/1930273769 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f6174003e80 con 0x7f6184072f70 2023-07-14T12:54:07.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.602+0000 7f61817fa700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f616c0a1150 0x7f616c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:07.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.602+0000 7f61817fa700 1 -- 172.21.15.17:0/1930273769 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f61740cd7f0 con 0x7f6184072f70 2023-07-14T12:54:07.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.602+0000 7f61837fe700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f616c0a1150 0x7f616c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:07.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.603+0000 7f61837fe700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f616c0a1150 0x7f616c0a3600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6178005950 tx=0x7f617800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.604+0000 7f61817fa700 1 -- 172.21.15.17:0/1930273769 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6174097dd0 con 0x7f6184072f70 2023-07-14T12:54:07.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:07.819+0000 7f618a96d700 1 -- 172.21.15.17:0/1930273769 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6184060950 con 0x7f616c0a1150 2023-07-14T12:54:08.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:07 smithi135 ceph-mon[97338]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:08.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:07 smithi135 ceph-mon[97338]: osdmap e41: 6 total, 6 up, 6 in 2023-07-14T12:54:08.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:54:08.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:54:08.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:08.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:07 smithi131 ceph-mon[96953]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:08.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:07 smithi131 ceph-mon[96953]: osdmap e41: 6 total, 6 up, 6 in 2023-07-14T12:54:08.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:54:08.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:54:08.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:08.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:07 smithi017 ceph-mon[95536]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:08.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:07 smithi017 ceph-mon[95536]: osdmap e41: 6 total, 6 up, 6 in 2023-07-14T12:54:08.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:54:08.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:54:08.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:09.233 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:08 smithi017 ceph-mon[95536]: from='client.14382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:54:09.234 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:08 smithi017 ceph-mon[95536]: osdmap e42: 6 total, 6 up, 6 in 2023-07-14T12:54:09.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:08 smithi131 ceph-mon[96953]: from='client.14382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:54:09.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:08 smithi131 ceph-mon[96953]: osdmap e42: 6 total, 6 up, 6 in 2023-07-14T12:54:09.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:08 smithi135 ceph-mon[97338]: from='client.14382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:54:09.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:08 smithi135 ceph-mon[97338]: osdmap e42: 6 total, 6 up, 6 in 2023-07-14T12:54:10.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:09 smithi131 ceph-mon[96953]: pgmap v153: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-14T12:54:10.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:09 smithi131 ceph-mon[96953]: osdmap e43: 6 total, 6 up, 6 in 2023-07-14T12:54:10.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:09 smithi017 ceph-mon[95536]: pgmap v153: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-14T12:54:10.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:09 smithi017 ceph-mon[95536]: osdmap e43: 6 total, 6 up, 6 in 2023-07-14T12:54:10.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:09 smithi135 ceph-mon[97338]: pgmap v153: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-14T12:54:10.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:09 smithi135 ceph-mon[97338]: osdmap e43: 6 total, 6 up, 6 in 2023-07-14T12:54:12.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:11 smithi017 ceph-mon[95536]: pgmap v155: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-07-14T12:54:12.101 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:11 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2910433203' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4"}]: dispatch 2023-07-14T12:54:12.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:11 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2910433203' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4"}]': finished 2023-07-14T12:54:12.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:11 smithi017 ceph-mon[95536]: osdmap e44: 7 total, 6 up, 7 in 2023-07-14T12:54:12.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:11 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:12.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:11 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2846246670' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:54:12.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:11 smithi135 ceph-mon[97338]: pgmap v155: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-07-14T12:54:12.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:11 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2910433203' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4"}]: dispatch 2023-07-14T12:54:12.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:11 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2910433203' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4"}]': finished 2023-07-14T12:54:12.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:11 smithi135 ceph-mon[97338]: osdmap e44: 7 total, 6 up, 7 in 2023-07-14T12:54:12.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:11 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:12.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:11 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2846246670' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:54:12.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:11 smithi131 ceph-mon[96953]: pgmap v155: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-07-14T12:54:12.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:11 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2910433203' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4"}]: dispatch 2023-07-14T12:54:12.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:11 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2910433203' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4"}]': finished 2023-07-14T12:54:12.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:11 smithi131 ceph-mon[96953]: osdmap e44: 7 total, 6 up, 7 in 2023-07-14T12:54:12.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:11 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:12.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:11 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2846246670' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:54:14.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:13 smithi135 ceph-mon[97338]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-07-14T12:54:14.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:13 smithi131 ceph-mon[96953]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-07-14T12:54:14.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:13 smithi017 ceph-mon[95536]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-07-14T12:54:16.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:15 smithi135 ceph-mon[97338]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:16.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:15 smithi131 ceph-mon[96953]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:16.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:15 smithi017 ceph-mon[95536]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:18.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:17 smithi135 ceph-mon[97338]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:18.242 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:17 smithi017 ceph-mon[95536]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:18.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:17 smithi131 ceph-mon[96953]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:19.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:18 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-14T12:54:19.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:18 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:19.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:18 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-14T12:54:19.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:18 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:19.351 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:18 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-14T12:54:19.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:18 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:20.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:19 smithi017 ceph-mon[95536]: Deploying daemon osd.6 on smithi017 2023-07-14T12:54:20.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:19 smithi017 ceph-mon[95536]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:20.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:19 smithi135 ceph-mon[97338]: Deploying daemon osd.6 on smithi017 2023-07-14T12:54:20.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:19 smithi135 ceph-mon[97338]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:20.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:19 smithi131 ceph-mon[96953]: Deploying daemon osd.6 on smithi017 2023-07-14T12:54:20.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:19 smithi131 ceph-mon[96953]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:22.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:21 smithi135 ceph-mon[97338]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:22.241 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:21 smithi131 ceph-mon[96953]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:22.338 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:21 smithi017 ceph-mon[95536]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:24.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:23 smithi017 ceph-mon[95536]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:24.193 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:23 smithi135 ceph-mon[97338]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:24.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:23 smithi131 ceph-mon[96953]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:26.283 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:25 smithi017 ceph-mon[95536]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:26.284 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:26.284 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:26.284 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:26.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:25 smithi135 ceph-mon[97338]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:26.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:26.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:26.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:26.492 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:25 smithi131 ceph-mon[96953]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:26.492 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:26.492 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:26.492 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:28.274 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:27 smithi017 ceph-mon[95536]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:28.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:27 smithi135 ceph-mon[97338]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:28.492 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:27 smithi131 ceph-mon[96953]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:28.706 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 6 on host 'smithi017' 2023-07-14T12:54:28.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.680+0000 7f61817fa700 1 -- 172.21.15.17:0/1930273769 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6184060950 con 0x7f616c0a1150 2023-07-14T12:54:28.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.683+0000 7f618a96d700 1 -- 172.21.15.17:0/1930273769 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f616c0a1150 msgr2=0x7f616c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.683+0000 7f618a96d700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f616c0a1150 0x7f616c0a3600 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6178005950 tx=0x7f617800b410 comp rx=0 tx=0).stop 2023-07-14T12:54:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.683+0000 7f618a96d700 1 -- 172.21.15.17:0/1930273769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184072f70 msgr2=0x7f618419be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.683+0000 7f618a96d700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184072f70 0x7f618419be40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f617400b580 tx=0x7f6174003a50 comp rx=0 tx=0).stop 2023-07-14T12:54:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.683+0000 7f618a96d700 1 -- 172.21.15.17:0/1930273769 shutdown_connections 2023-07-14T12:54:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.683+0000 7f618a96d700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f616c0a1150 0x7f616c0a3600 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.683+0000 7f618a96d700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f618410c170 0x7f61841a3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.683+0000 7f618a96d700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6184072f70 0x7f618419be40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.683+0000 7f618a96d700 1 --2- 172.21.15.17:0/1930273769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6184074540 0x7f618419c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.683+0000 7f618a96d700 1 -- 172.21.15.17:0/1930273769 >> 172.21.15.17:0/1930273769 conn(0x7f61840fb1a0 msgr2=0x7f61840fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.683+0000 7f618a96d700 1 -- 172.21.15.17:0/1930273769 shutdown_connections 2023-07-14T12:54:28.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:54:28.684+0000 7f618a96d700 1 -- 172.21.15.17:0/1930273769 wait complete. 2023-07-14T12:54:29.170 DEBUG:teuthology.orchestra.run.smithi017:osd.6> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.6.service 2023-07-14T12:54:29.175 INFO:tasks.cephadm:Deploying osd.7 on smithi131 with /dev/vg_nvme/lv_2... 2023-07-14T12:54:29.175 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-14T12:54:29.252 INFO:journalctl@ceph.osd.6.smithi017.stdout:-- Logs begin at Fri 2023-07-14 12:26:45 UTC. -- 2023-07-14T12:54:29.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:29.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:29.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:29.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:29 smithi017 ceph-mon[95536]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:29.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:29 smithi017 ceph-mon[95536]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-14T12:54:29.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:29.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:29.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:29.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:29 smithi135 ceph-mon[97338]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:29.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:29 smithi135 ceph-mon[97338]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-14T12:54:29.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:29.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:29.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:29.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:29.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:29 smithi131 ceph-mon[96953]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:29.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:29 smithi131 ceph-mon[96953]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-14T12:54:29.901 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T12:54:30.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:30 smithi131 ceph-mon[96953]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-14T12:54:30.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:30 smithi131 ceph-mon[96953]: osdmap e45: 7 total, 6 up, 7 in 2023-07-14T12:54:30.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:30 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:30.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:30 smithi131 ceph-mon[96953]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:54:30.943 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:30 smithi135 ceph-mon[97338]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-14T12:54:30.943 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:30 smithi135 ceph-mon[97338]: osdmap e45: 7 total, 6 up, 7 in 2023-07-14T12:54:30.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:30 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:30.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:30 smithi135 ceph-mon[97338]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:54:31.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:30 smithi017 ceph-mon[95536]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-14T12:54:31.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:30 smithi017 ceph-mon[95536]: osdmap e45: 7 total, 6 up, 7 in 2023-07-14T12:54:31.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:30 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:31.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:30 smithi017 ceph-mon[95536]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:54:31.103 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 12:54:30 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T12:54:30.651+0000 7f5e1f59c700 -1 osd.6 0 waiting for initial osdmap 2023-07-14T12:54:31.103 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 12:54:30 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T12:54:30.662+0000 7f5e18b8c700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:54:31.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:31 smithi017 ceph-mon[95536]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:54:31.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:31 smithi017 ceph-mon[95536]: osdmap e46: 7 total, 6 up, 7 in 2023-07-14T12:54:31.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:31 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:31.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:31 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:31.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:31 smithi017 ceph-mon[95536]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:31.888 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-14T12:54:31.888 INFO:teuthology.orchestra.run.smithi131.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-14T12:54:31.888 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10+0 records in 2023-07-14T12:54:31.889 INFO:teuthology.orchestra.run.smithi131.stderr:10+0 records out 2023-07-14T12:54:31.889 INFO:teuthology.orchestra.run.smithi131.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0441214 s, 238 MB/s 2023-07-14T12:54:31.889 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping successful for: 2023-07-14T12:54:31.943 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:31 smithi135 ceph-mon[97338]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:54:31.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:31 smithi135 ceph-mon[97338]: osdmap e46: 7 total, 6 up, 7 in 2023-07-14T12:54:31.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:31 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:31.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:31 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:31.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:31 smithi135 ceph-mon[97338]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:31.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:31 smithi131 ceph-mon[96953]: from='osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:54:31.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:31 smithi131 ceph-mon[96953]: osdmap e46: 7 total, 6 up, 7 in 2023-07-14T12:54:31.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:31 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:31.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:31 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:31.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:31 smithi131 ceph-mon[96953]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-14T12:54:32.377 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi131:vg_nvme/lv_2 2023-07-14T12:54:32.943 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:54:32.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:54:32.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:32.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731] boot 2023-07-14T12:54:32.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: osdmap e47: 7 total, 7 up, 7 in 2023-07-14T12:54:32.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:32.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi017 2023-07-14T12:54:32.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:32.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:32.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:32.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:32.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:32.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi017 to 5757M 2023-07-14T12:54:32.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:32.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:32.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:32.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:32.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:54:32.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:54:32.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:32.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731] boot 2023-07-14T12:54:32.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: osdmap e47: 7 total, 7 up, 7 in 2023-07-14T12:54:32.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:32.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi017 2023-07-14T12:54:32.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:32.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:32.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:32.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:32.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:32.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi017 to 5757M 2023-07-14T12:54:32.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:32.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:32.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:32.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:33.093 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T12:54:33.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:54:33.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:54:33.102 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:33.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: osd.6 [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731] boot 2023-07-14T12:54:33.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: osdmap e47: 7 total, 7 up, 7 in 2023-07-14T12:54:33.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:54:33.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi017 2023-07-14T12:54:33.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:33.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:33.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:33.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:33.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:33.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi017 to 5757M 2023-07-14T12:54:33.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:33.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:33.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:33.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:34.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:33 smithi131 ceph-mon[96953]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:34.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:33 smithi131 ceph-mon[96953]: osdmap e48: 7 total, 7 up, 7 in 2023-07-14T12:54:34.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:33 smithi017 ceph-mon[95536]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:34.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:33 smithi017 ceph-mon[95536]: osdmap e48: 7 total, 7 up, 7 in 2023-07-14T12:54:34.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:33 smithi135 ceph-mon[97338]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:34.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:33 smithi135 ceph-mon[97338]: osdmap e48: 7 total, 7 up, 7 in 2023-07-14T12:54:34.543 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.516+0000 7f759c557700 1 -- 172.21.15.131:0/4024977546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7594101720 msgr2=0x7f7594107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:34.543 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.516+0000 7f759c557700 1 --2- 172.21.15.131:0/4024977546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7594101720 0x7f7594107fe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f758c00b0a0 tx=0x7f758c00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:54:34.544 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.516+0000 7f759c557700 1 -- 172.21.15.131:0/4024977546 shutdown_connections 2023-07-14T12:54:34.544 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.516+0000 7f759c557700 1 --2- 172.21.15.131:0/4024977546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7594101720 0x7f7594107fe0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:34.544 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.517+0000 7f759c557700 1 --2- 172.21.15.131:0/4024977546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75940ffb90 0x7f75940fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:34.544 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.517+0000 7f759c557700 1 --2- 172.21.15.131:0/4024977546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7594100d90 0x7f75941011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:34.544 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.517+0000 7f759c557700 1 -- 172.21.15.131:0/4024977546 >> 172.21.15.131:0/4024977546 conn(0x7f75940fb1a0 msgr2=0x7f75940fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:34.545 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.517+0000 7f759c557700 1 -- 172.21.15.131:0/4024977546 shutdown_connections 2023-07-14T12:54:34.545 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.517+0000 7f759c557700 1 -- 172.21.15.131:0/4024977546 wait complete. 2023-07-14T12:54:34.546 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.518+0000 7f759c557700 1 Processor -- start 2023-07-14T12:54:34.547 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.518+0000 7f759c557700 1 -- start start 2023-07-14T12:54:34.547 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.518+0000 7f759c557700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75940ffb90 0x7f7594197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:34.547 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.518+0000 7f759c557700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7594100d90 0x7f7594197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:34.547 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.518+0000 7f759c557700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7594101720 0x7f759419f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:34.547 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.518+0000 7f759c557700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759419f630 con 0x7f75940ffb90 2023-07-14T12:54:34.547 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.518+0000 7f759c557700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759419f770 con 0x7f7594101720 2023-07-14T12:54:34.547 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.518+0000 7f759c557700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759419f900 con 0x7f7594100d90 2023-07-14T12:54:34.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.518+0000 7f759aaf4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7594101720 0x7f759419f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:34.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.518+0000 7f759aaf4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7594101720 0x7f759419f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34906/0 (socket says 172.21.15.131:34906) 2023-07-14T12:54:34.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.518+0000 7f759aaf4700 1 -- 172.21.15.131:0/2542334850 learned_addr learned my addr 172.21.15.131:0/2542334850 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-07-14T12:54:34.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f7599af2700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7594100d90 0x7f7594197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:34.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f759a2f3700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75940ffb90 0x7f7594197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:34.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f759aaf4700 1 -- 172.21.15.131:0/2542334850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7594100d90 msgr2=0x7f7594197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:34.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f759aaf4700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7594100d90 0x7f7594197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:34.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f759aaf4700 1 -- 172.21.15.131:0/2542334850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75940ffb90 msgr2=0x7f7594197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:34.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f759aaf4700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75940ffb90 0x7f7594197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:34.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f759aaf4700 1 -- 172.21.15.131:0/2542334850 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c009d00 con 0x7f7594101720 2023-07-14T12:54:34.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f759aaf4700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7594101720 0x7f759419f060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f758c00d010 tx=0x7f758c00bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:34.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f758b7fe700 1 -- 172.21.15.131:0/2542334850 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00e040 con 0x7f7594101720 2023-07-14T12:54:34.550 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f758b7fe700 1 -- 172.21.15.131:0/2542334850 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f758c003e10 con 0x7f7594101720 2023-07-14T12:54:34.550 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f759c557700 1 -- 172.21.15.131:0/2542334850 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759419fb80 con 0x7f7594101720 2023-07-14T12:54:34.550 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.519+0000 7f758b7fe700 1 -- 172.21.15.131:0/2542334850 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0052a0 con 0x7f7594101720 2023-07-14T12:54:34.550 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.520+0000 7f759c557700 1 -- 172.21.15.131:0/2542334850 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759419ff90 con 0x7f7594101720 2023-07-14T12:54:34.550 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.521+0000 7f759c557700 1 -- 172.21.15.131:0/2542334850 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759410b280 con 0x7f7594101720 2023-07-14T12:54:34.551 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.523+0000 7f758b7fe700 1 -- 172.21.15.131:0/2542334850 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f758c01d9a0 con 0x7f7594101720 2023-07-14T12:54:34.551 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.524+0000 7f758b7fe700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75800a1150 0x7f75800a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:54:34.551 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.524+0000 7f758b7fe700 1 -- 172.21.15.131:0/2542334850 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f758c0cd460 con 0x7f7594101720 2023-07-14T12:54:34.551 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.525+0000 7f759a2f3700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75800a1150 0x7f75800a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:54:34.552 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.525+0000 7f759a2f3700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75800a1150 0x7f75800a3600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7594100bf0 tx=0x7f7590009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:54:34.552 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.527+0000 7f758b7fe700 1 -- 172.21.15.131:0/2542334850 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f758c0978b0 con 0x7f7594101720 2023-07-14T12:54:34.755 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:34.729+0000 7f759c557700 1 -- 172.21.15.131:0/2542334850 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f75941076f0 con 0x7f75800a1150 2023-07-14T12:54:35.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:34 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:54:35.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:34 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:54:35.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:34 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:35.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:34 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:54:35.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:34 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:54:35.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:34 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:35.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:34 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:54:35.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:34 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:54:35.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:34 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:36.117 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:35 smithi131 ceph-mon[96953]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:54:36.117 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:35 smithi131 ceph-mon[96953]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:36.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:35 smithi017 ceph-mon[95536]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:54:36.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:35 smithi017 ceph-mon[95536]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:36.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:35 smithi135 ceph-mon[97338]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:54:36.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:35 smithi135 ceph-mon[97338]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:38.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:37 smithi131 ceph-mon[96953]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:38.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:37 smithi131 ceph-mon[96953]: from='client.? 172.21.15.131:0/3265787822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8043c8e-d385-48fe-afd2-163ce4cb49da"}]: dispatch 2023-07-14T12:54:38.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:37 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8043c8e-d385-48fe-afd2-163ce4cb49da"}]: dispatch 2023-07-14T12:54:38.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:37 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8043c8e-d385-48fe-afd2-163ce4cb49da"}]': finished 2023-07-14T12:54:38.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:37 smithi131 ceph-mon[96953]: osdmap e49: 8 total, 7 up, 8 in 2023-07-14T12:54:38.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:37 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:38.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:37 smithi017 ceph-mon[95536]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:38.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:37 smithi017 ceph-mon[95536]: from='client.? 172.21.15.131:0/3265787822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8043c8e-d385-48fe-afd2-163ce4cb49da"}]: dispatch 2023-07-14T12:54:38.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:37 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8043c8e-d385-48fe-afd2-163ce4cb49da"}]: dispatch 2023-07-14T12:54:38.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:37 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8043c8e-d385-48fe-afd2-163ce4cb49da"}]': finished 2023-07-14T12:54:38.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:37 smithi017 ceph-mon[95536]: osdmap e49: 8 total, 7 up, 8 in 2023-07-14T12:54:38.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:37 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:38.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:37 smithi135 ceph-mon[97338]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:38.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:37 smithi135 ceph-mon[97338]: from='client.? 172.21.15.131:0/3265787822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8043c8e-d385-48fe-afd2-163ce4cb49da"}]: dispatch 2023-07-14T12:54:38.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:37 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8043c8e-d385-48fe-afd2-163ce4cb49da"}]: dispatch 2023-07-14T12:54:38.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:37 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8043c8e-d385-48fe-afd2-163ce4cb49da"}]': finished 2023-07-14T12:54:38.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:37 smithi135 ceph-mon[97338]: osdmap e49: 8 total, 7 up, 8 in 2023-07-14T12:54:38.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:37 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:39.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:38 smithi131 ceph-mon[96953]: from='client.? 172.21.15.131:0/1615696376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:54:39.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:38 smithi017 ceph-mon[95536]: from='client.? 172.21.15.131:0/1615696376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:54:39.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:38 smithi135 ceph-mon[97338]: from='client.? 172.21.15.131:0/1615696376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:54:40.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:39 smithi131 ceph-mon[96953]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:40.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:39 smithi017 ceph-mon[95536]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:40.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:39 smithi135 ceph-mon[97338]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:42.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:41 smithi131 ceph-mon[96953]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:42.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:41 smithi017 ceph-mon[95536]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:42.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:41 smithi135 ceph-mon[97338]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:44.221 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:43 smithi131 ceph-mon[96953]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:44.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:43 smithi017 ceph-mon[95536]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:44.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:43 smithi135 ceph-mon[97338]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:46.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:45 smithi131 ceph-mon[96953]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:46.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:45 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-14T12:54:46.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:45 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:46.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:45 smithi017 ceph-mon[95536]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:46.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:45 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-14T12:54:46.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:45 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:46.443 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:45 smithi135 ceph-mon[97338]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:46.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:45 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-14T12:54:46.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:45 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:47.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:46 smithi131 ceph-mon[96953]: Deploying daemon osd.7 on smithi131 2023-07-14T12:54:47.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:46 smithi017 ceph-mon[95536]: Deploying daemon osd.7 on smithi131 2023-07-14T12:54:47.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:46 smithi135 ceph-mon[97338]: Deploying daemon osd.7 on smithi131 2023-07-14T12:54:48.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:47 smithi131 ceph-mon[96953]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:48.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:47 smithi017 ceph-mon[95536]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:48.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:47 smithi135 ceph-mon[97338]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:50.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:49 smithi131 ceph-mon[96953]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:50.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:49 smithi017 ceph-mon[95536]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:50.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:49 smithi135 ceph-mon[97338]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:52.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:51 smithi017 ceph-mon[95536]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:52.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:52.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:52.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:52.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:51 smithi135 ceph-mon[97338]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:52.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:52.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:52.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:52.492 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:51 smithi131 ceph-mon[96953]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:52.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:52.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:52.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:54.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:53 smithi017 ceph-mon[95536]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:54.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:53 smithi135 ceph-mon[97338]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:54.492 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:53 smithi131 ceph-mon[96953]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:55.486 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.460+0000 7f758b7fe700 1 -- 172.21.15.131:0/2542334850 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f75941076f0 con 0x7f75800a1150 2023-07-14T12:54:55.487 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 7 on host 'smithi131' 2023-07-14T12:54:55.488 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 -- 172.21.15.131:0/2542334850 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75800a1150 msgr2=0x7f75800a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:55.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75800a1150 0x7f75800a3600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7594100bf0 tx=0x7f7590009260 comp rx=0 tx=0).stop 2023-07-14T12:54:55.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 -- 172.21.15.131:0/2542334850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7594101720 msgr2=0x7f759419f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:54:55.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7594101720 0x7f759419f060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f758c00d010 tx=0x7f758c00bcc0 comp rx=0 tx=0).stop 2023-07-14T12:54:55.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 -- 172.21.15.131:0/2542334850 shutdown_connections 2023-07-14T12:54:55.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75800a1150 0x7f75800a3600 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:55.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7594101720 0x7f759419f060 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:55.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75940ffb90 0x7f7594197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:55.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 --2- 172.21.15.131:0/2542334850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7594100d90 0x7f7594197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:54:55.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 -- 172.21.15.131:0/2542334850 >> 172.21.15.131:0/2542334850 conn(0x7f75940fb1a0 msgr2=0x7f75940fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:54:55.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 -- 172.21.15.131:0/2542334850 shutdown_connections 2023-07-14T12:54:55.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:54:55.463+0000 7f759c557700 1 -- 172.21.15.131:0/2542334850 wait complete. 2023-07-14T12:54:55.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:55 smithi131 ceph-mon[96953]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:55.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:55 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:55.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:55 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:55.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:55 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:55.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:55 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:55.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:55 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:55.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:55 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:55.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:55 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:55.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:55 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:55.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:55 smithi131 ceph-mon[96953]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-14T12:54:56.024 DEBUG:teuthology.orchestra.run.smithi131:osd.7> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.7.service 2023-07-14T12:54:56.028 INFO:tasks.cephadm:Deploying osd.8 on smithi135 with /dev/vg_nvme/lv_2... 2023-07-14T12:54:56.029 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-14T12:54:56.106 INFO:journalctl@ceph.osd.7.smithi131.stdout:-- Logs begin at Fri 2023-07-14 12:26:41 UTC. -- 2023-07-14T12:54:56.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:55 smithi135 ceph-mon[97338]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:56.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:55 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:56.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:55 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:56.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:55 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:56.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:55 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:56.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:55 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:56.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:55 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:56.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:55 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:56.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:55 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:56.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:55 smithi135 ceph-mon[97338]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-14T12:54:56.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:55 smithi017 ceph-mon[95536]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:56.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:55 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:56.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:55 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:56.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:55 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:56.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:55 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:56.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:55 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:56.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:55 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:56.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:55 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:54:56.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:55 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:56.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:55 smithi017 ceph-mon[95536]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-14T12:54:56.758 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:54:57.603 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:57 smithi135 ceph-mon[97338]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-14T12:54:57.604 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:57 smithi135 ceph-mon[97338]: osdmap e50: 8 total, 7 up, 8 in 2023-07-14T12:54:57.604 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:57 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:57.604 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:57 smithi135 ceph-mon[97338]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:54:57.605 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:57 smithi135 ceph-mon[97338]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:57.627 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:57 smithi131 ceph-mon[96953]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-14T12:54:57.627 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:57 smithi131 ceph-mon[96953]: osdmap e50: 8 total, 7 up, 8 in 2023-07-14T12:54:57.628 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:57 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:57.628 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:57 smithi131 ceph-mon[96953]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:54:57.628 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:57 smithi131 ceph-mon[96953]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:57.628 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 12:54:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T12:54:57.422+0000 7fb96e2dc700 -1 osd.7 0 waiting for initial osdmap 2023-07-14T12:54:57.629 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 12:54:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T12:54:57.435+0000 7fb9678cc700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:54:57.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:57 smithi017 ceph-mon[95536]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-14T12:54:57.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:57 smithi017 ceph-mon[95536]: osdmap e50: 8 total, 7 up, 8 in 2023-07-14T12:54:57.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:57 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:57.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:57 smithi017 ceph-mon[95536]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:54:57.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:57 smithi017 ceph-mon[95536]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:58.676 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-14T12:54:58.676 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-14T12:54:58.676 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-07-14T12:54:58.676 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-07-14T12:54:58.677 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0312622 s, 335 MB/s 2023-07-14T12:54:58.677 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-07-14T12:54:58.712 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:58 smithi135 ceph-mon[97338]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:54:58.712 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:58 smithi135 ceph-mon[97338]: osdmap e51: 8 total, 7 up, 8 in 2023-07-14T12:54:58.712 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:58.713 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:58.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:58 smithi131 ceph-mon[96953]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:54:58.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:58 smithi131 ceph-mon[96953]: osdmap e51: 8 total, 7 up, 8 in 2023-07-14T12:54:58.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:58 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:58.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:58 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:58.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:58 smithi017 ceph-mon[95536]: from='osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:54:58.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:58 smithi017 ceph-mon[95536]: osdmap e51: 8 total, 7 up, 8 in 2023-07-14T12:54:58.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:58.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:59.131 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2023-07-14T12:54:59.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:54:59.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:54:59.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147] boot 2023-07-14T12:54:59.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: osdmap e52: 8 total, 8 up, 8 in 2023-07-14T12:54:59.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:59.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:59.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi131 2023-07-14T12:54:59.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:59.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:59.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:59.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi131 to 5755M 2023-07-14T12:54:59.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:59.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:59.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:54:59 smithi131 ceph-mon[96953]: osdmap e53: 8 total, 8 up, 8 in 2023-07-14T12:54:59.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:54:59.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:54:59.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147] boot 2023-07-14T12:54:59.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: osdmap e52: 8 total, 8 up, 8 in 2023-07-14T12:54:59.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:59.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:59.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi131 2023-07-14T12:54:59.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:59.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:59.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:59.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi131 to 5755M 2023-07-14T12:54:59.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:59.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:59.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:54:59 smithi017 ceph-mon[95536]: osdmap e53: 8 total, 8 up, 8 in 2023-07-14T12:54:59.855 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:54:59.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:54:59.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:54:59.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: osd.7 [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147] boot 2023-07-14T12:54:59.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: osdmap e52: 8 total, 8 up, 8 in 2023-07-14T12:54:59.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:54:59.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-07-14T12:54:59.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi131 2023-07-14T12:54:59.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:59.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:59.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:54:59.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi131 to 5755M 2023-07-14T12:54:59.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:54:59.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:54:59.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:54:59.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:54:59 smithi135 ceph-mon[97338]: osdmap e53: 8 total, 8 up, 8 in 2023-07-14T12:55:01.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.339+0000 7f901fae4700 1 -- 172.21.15.135:0/55635143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90180ffb90 msgr2=0x7f90180fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:01.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.339+0000 7f901fae4700 1 --2- 172.21.15.135:0/55635143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90180ffb90 0x7f90180fffa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9014009990 tx=0x7f9014009ca0 comp rx=0 tx=0).stop 2023-07-14T12:55:01.365 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.339+0000 7f901fae4700 1 -- 172.21.15.135:0/55635143 shutdown_connections 2023-07-14T12:55:01.366 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.339+0000 7f901fae4700 1 --2- 172.21.15.135:0/55635143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9018101720 0x7f9018107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:01.366 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.339+0000 7f901fae4700 1 --2- 172.21.15.135:0/55635143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90180ffb90 0x7f90180fffa0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:01.366 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.339+0000 7f901fae4700 1 --2- 172.21.15.135:0/55635143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9018100d90 0x7f90181011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:01.366 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.339+0000 7f901fae4700 1 -- 172.21.15.135:0/55635143 >> 172.21.15.135:0/55635143 conn(0x7f90180fb1a0 msgr2=0x7f90180fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:55:01.366 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.339+0000 7f901fae4700 1 -- 172.21.15.135:0/55635143 shutdown_connections 2023-07-14T12:55:01.366 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.339+0000 7f901fae4700 1 -- 172.21.15.135:0/55635143 wait complete. 2023-07-14T12:55:01.368 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.340+0000 7f901fae4700 1 Processor -- start 2023-07-14T12:55:01.368 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901fae4700 1 -- start start 2023-07-14T12:55:01.368 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901fae4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90180ffb90 0x7f9018195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:01.369 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901fae4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9018100d90 0x7f9018195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:01.369 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901fae4700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9018101720 0x7f901819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:01.369 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901fae4700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901819d3c0 con 0x7f9018101720 2023-07-14T12:55:01.369 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901fae4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901819d500 con 0x7f90180ffb90 2023-07-14T12:55:01.369 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901fae4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901819d690 con 0x7f9018100d90 2023-07-14T12:55:01.369 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901d07f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9018100d90 0x7f9018195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:01.369 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901d07f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9018100d90 0x7f9018195d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51492/0 (socket says 172.21.15.135:51492) 2023-07-14T12:55:01.370 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901d07f700 1 -- 172.21.15.135:0/1327681368 learned_addr learned my addr 172.21.15.135:0/1327681368 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-07-14T12:55:01.370 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901d880700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90180ffb90 0x7f9018195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:01.370 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901d07f700 1 -- 172.21.15.135:0/1327681368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90180ffb90 msgr2=0x7f9018195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:01.370 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901e081700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9018101720 0x7f901819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:01.370 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901d07f700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90180ffb90 0x7f9018195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:01.370 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.341+0000 7f901d07f700 1 -- 172.21.15.135:0/1327681368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9018101720 msgr2=0x7f901819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:01.370 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.342+0000 7f901d07f700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9018101720 0x7f901819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:01.370 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.342+0000 7f901d07f700 1 -- 172.21.15.135:0/1327681368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90140095f0 con 0x7f9018100d90 2023-07-14T12:55:01.371 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.342+0000 7f901e081700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9018101720 0x7f901819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:55:01.371 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.342+0000 7f901d07f700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9018100d90 0x7f9018195d70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f900800d9b0 tx=0x7f900800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:55:01.371 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.342+0000 7f900effd700 1 -- 172.21.15.135:0/1327681368 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008004220 con 0x7f9018100d90 2023-07-14T12:55:01.371 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.342+0000 7f900effd700 1 -- 172.21.15.135:0/1327681368 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9008007640 con 0x7f9018100d90 2023-07-14T12:55:01.371 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.342+0000 7f900effd700 1 -- 172.21.15.135:0/1327681368 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008005620 con 0x7f9018100d90 2023-07-14T12:55:01.372 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.342+0000 7f901fae4700 1 -- 172.21.15.135:0/1327681368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901819d970 con 0x7f9018100d90 2023-07-14T12:55:01.372 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.342+0000 7f901fae4700 1 -- 172.21.15.135:0/1327681368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901819de20 con 0x7f9018100d90 2023-07-14T12:55:01.372 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.343+0000 7f901fae4700 1 -- 172.21.15.135:0/1327681368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9018106b60 con 0x7f9018100d90 2023-07-14T12:55:01.372 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.347+0000 7f900effd700 1 -- 172.21.15.135:0/1327681368 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9008004750 con 0x7f9018100d90 2023-07-14T12:55:01.373 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.348+0000 7f900effd700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90040a11d0 0x7f90040a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:01.374 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.349+0000 7f900effd700 1 -- 172.21.15.135:0/1327681368 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5397+0+0 (secure 0 0 0) 0x7f90080cc130 con 0x7f9018100d90 2023-07-14T12:55:01.374 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.349+0000 7f901d880700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90040a11d0 0x7f90040a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:01.374 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.350+0000 7f901d880700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90040a11d0 0x7f90040a3680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f901400b5c0 tx=0x7f9014005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:55:01.376 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.351+0000 7f900effd700 1 -- 172.21.15.135:0/1327681368 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9008096340 con 0x7f9018100d90 2023-07-14T12:55:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:01.554+0000 7f901fae4700 1 -- 172.21.15.135:0/1327681368 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9018060950 con 0x7f90040a11d0 2023-07-14T12:55:01.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:01 smithi131 ceph-mon[96953]: osdmap e54: 8 total, 8 up, 8 in 2023-07-14T12:55:01.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:01 smithi131 ceph-mon[96953]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:01.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:01 smithi131 ceph-mon[96953]: osdmap e55: 8 total, 8 up, 8 in 2023-07-14T12:55:01.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:01 smithi017 ceph-mon[95536]: osdmap e54: 8 total, 8 up, 8 in 2023-07-14T12:55:01.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:01 smithi017 ceph-mon[95536]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:01.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:01 smithi017 ceph-mon[95536]: osdmap e55: 8 total, 8 up, 8 in 2023-07-14T12:55:01.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:01 smithi135 ceph-mon[97338]: osdmap e54: 8 total, 8 up, 8 in 2023-07-14T12:55:01.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:01 smithi135 ceph-mon[97338]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:01.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:01 smithi135 ceph-mon[97338]: osdmap e55: 8 total, 8 up, 8 in 2023-07-14T12:55:02.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:02 smithi131 ceph-mon[96953]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:55:02.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:55:02.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:55:02.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:02 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:02.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:02 smithi131 ceph-mon[96953]: osdmap e56: 8 total, 8 up, 8 in 2023-07-14T12:55:02.784 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:02 smithi135 ceph-mon[97338]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:55:02.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:02 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:55:02.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:02 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:55:02.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:02 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:02.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:02 smithi135 ceph-mon[97338]: osdmap e56: 8 total, 8 up, 8 in 2023-07-14T12:55:02.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:02 smithi017 ceph-mon[95536]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:55:02.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:02 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:55:02.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:02 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:55:02.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:02 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:02.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:02 smithi017 ceph-mon[95536]: osdmap e56: 8 total, 8 up, 8 in 2023-07-14T12:55:03.592 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:03 smithi135 ceph-mon[97338]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:03.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:03 smithi131 ceph-mon[96953]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:03.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:03 smithi017 ceph-mon[95536]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:04.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:04 smithi017 ceph-mon[95536]: from='client.? 172.21.15.135:0/3620204733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d828ebc9-487a-46ac-bd6c-b5572903cd3b"}]: dispatch 2023-07-14T12:55:04.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:04 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d828ebc9-487a-46ac-bd6c-b5572903cd3b"}]: dispatch 2023-07-14T12:55:04.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:04 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d828ebc9-487a-46ac-bd6c-b5572903cd3b"}]': finished 2023-07-14T12:55:04.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:04 smithi017 ceph-mon[95536]: osdmap e57: 9 total, 8 up, 9 in 2023-07-14T12:55:04.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:04 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:04.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:04 smithi135 ceph-mon[97338]: from='client.? 172.21.15.135:0/3620204733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d828ebc9-487a-46ac-bd6c-b5572903cd3b"}]: dispatch 2023-07-14T12:55:04.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:04 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d828ebc9-487a-46ac-bd6c-b5572903cd3b"}]: dispatch 2023-07-14T12:55:04.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:04 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d828ebc9-487a-46ac-bd6c-b5572903cd3b"}]': finished 2023-07-14T12:55:04.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:04 smithi135 ceph-mon[97338]: osdmap e57: 9 total, 8 up, 9 in 2023-07-14T12:55:04.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:04 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:04.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:04 smithi131 ceph-mon[96953]: from='client.? 172.21.15.135:0/3620204733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d828ebc9-487a-46ac-bd6c-b5572903cd3b"}]: dispatch 2023-07-14T12:55:04.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:04 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d828ebc9-487a-46ac-bd6c-b5572903cd3b"}]: dispatch 2023-07-14T12:55:04.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:04 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d828ebc9-487a-46ac-bd6c-b5572903cd3b"}]': finished 2023-07-14T12:55:04.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:04 smithi131 ceph-mon[96953]: osdmap e57: 9 total, 8 up, 9 in 2023-07-14T12:55:04.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:04 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:05.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:05 smithi017 ceph-mon[95536]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:05.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:05 smithi017 ceph-mon[95536]: from='client.? 172.21.15.135:0/3399362635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:55:05.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:05 smithi135 ceph-mon[97338]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:05.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:05 smithi135 ceph-mon[97338]: from='client.? 172.21.15.135:0/3399362635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:55:05.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:05 smithi131 ceph-mon[96953]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:05.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:05 smithi131 ceph-mon[96953]: from='client.? 172.21.15.135:0/3399362635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:55:08.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:07 smithi135 ceph-mon[97338]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:08.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:07 smithi131 ceph-mon[96953]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:08.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:07 smithi017 ceph-mon[95536]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:10.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:09 smithi135 ceph-mon[97338]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:10.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:09 smithi131 ceph-mon[96953]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:10.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:09 smithi017 ceph-mon[95536]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:12.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:11 smithi135 ceph-mon[97338]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:12.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:11 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-14T12:55:12.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:11 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:12.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:11 smithi131 ceph-mon[96953]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:12.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:11 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-14T12:55:12.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:11 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:12.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:11 smithi017 ceph-mon[95536]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:12.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:11 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-14T12:55:12.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:11 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:13.143 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:12 smithi135 ceph-mon[97338]: Deploying daemon osd.8 on smithi135 2023-07-14T12:55:13.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:12 smithi131 ceph-mon[96953]: Deploying daemon osd.8 on smithi135 2023-07-14T12:55:13.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:12 smithi017 ceph-mon[95536]: Deploying daemon osd.8 on smithi135 2023-07-14T12:55:14.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:13 smithi135 ceph-mon[97338]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:14.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:13 smithi131 ceph-mon[96953]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:14.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:13 smithi017 ceph-mon[95536]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:15.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:15 smithi135 ceph-mon[97338]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:16.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:15 smithi131 ceph-mon[96953]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:16.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:15 smithi017 ceph-mon[95536]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:18.128 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:17 smithi135 ceph-mon[97338]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:18.242 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:17 smithi131 ceph-mon[96953]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:18.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:17 smithi017 ceph-mon[95536]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:19.460 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:19.461 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:19.461 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:19.461 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:19 smithi135 ceph-mon[97338]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:19.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:19.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:19.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:19.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:19 smithi131 ceph-mon[96953]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:19.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:19.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:19.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:19.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:19 smithi017 ceph-mon[95536]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:22.008 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.982+0000 7f900effd700 1 -- 172.21.15.135:0/1327681368 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9018060950 con 0x7f90040a11d0 2023-07-14T12:55:22.009 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 8 on host 'smithi135' 2023-07-14T12:55:22.012 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 -- 172.21.15.135:0/1327681368 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90040a11d0 msgr2=0x7f90040a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:22.012 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90040a11d0 0x7f90040a3680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f901400b5c0 tx=0x7f9014005fb0 comp rx=0 tx=0).stop 2023-07-14T12:55:22.012 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 -- 172.21.15.135:0/1327681368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9018100d90 msgr2=0x7f9018195d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:22.012 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9018100d90 0x7f9018195d70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f900800d9b0 tx=0x7f900800dcc0 comp rx=0 tx=0).stop 2023-07-14T12:55:22.012 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 -- 172.21.15.135:0/1327681368 shutdown_connections 2023-07-14T12:55:22.012 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90040a11d0 0x7f90040a3680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:22.013 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9018101720 0x7f901819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:22.013 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90180ffb90 0x7f9018195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:22.013 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 --2- 172.21.15.135:0/1327681368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9018100d90 0x7f9018195d70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:22.013 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 -- 172.21.15.135:0/1327681368 >> 172.21.15.135:0/1327681368 conn(0x7f90180fb1a0 msgr2=0x7f90180fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:55:22.013 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 -- 172.21.15.135:0/1327681368 shutdown_connections 2023-07-14T12:55:22.013 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:55:21.985+0000 7f901fae4700 1 -- 172.21.15.135:0/1327681368 wait complete. 2023-07-14T12:55:22.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:21 smithi135 ceph-mon[97338]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:22.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:22.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:22.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:22.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:22.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:21 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:22.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:21 smithi131 ceph-mon[96953]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:22.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:22.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:22.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:22.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:22.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:21 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:22.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:21 smithi017 ceph-mon[95536]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:22.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:22.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:22.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:22.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:22.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:21 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:22.481 DEBUG:teuthology.orchestra.run.smithi135:osd.8> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.8.service 2023-07-14T12:55:22.486 INFO:tasks.cephadm:Deploying osd.9 on smithi017 with /dev/vg_nvme/lv_1... 2023-07-14T12:55:22.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-07-14T12:55:22.561 INFO:journalctl@ceph.osd.8.smithi135.stdout:-- Logs begin at Fri 2023-07-14 12:26:36 UTC. -- 2023-07-14T12:55:23.227 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:55:23.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:22 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:23.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:22 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:23.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:22 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:23.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:22 smithi131 ceph-mon[96953]: from='osd.8 [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T12:55:23.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:22 smithi131 ceph-mon[96953]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T12:55:23.267 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:22 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:23.267 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:22 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:23.267 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:22 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:23.267 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:22 smithi135 ceph-mon[97338]: from='osd.8 [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T12:55:23.268 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:22 smithi135 ceph-mon[97338]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T12:55:23.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:22 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:23.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:22 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:23.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:22 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:23.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:22 smithi017 ceph-mon[95536]: from='osd.8 [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T12:55:23.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:22 smithi017 ceph-mon[95536]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T12:55:24.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:23 smithi017 ceph-mon[95536]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:24.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:23 smithi017 ceph-mon[95536]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-07-14T12:55:24.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:23 smithi017 ceph-mon[95536]: osdmap e58: 9 total, 8 up, 9 in 2023-07-14T12:55:24.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:24.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:23 smithi017 ceph-mon[95536]: from='osd.8 [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:55:24.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:23 smithi017 ceph-mon[95536]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:55:24.444 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 12:55:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T12:55:23.981+0000 7f0031a61700 -1 osd.8 0 waiting for initial osdmap 2023-07-14T12:55:24.445 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 12:55:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T12:55:23.993+0000 7f002a04f700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:55:24.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:23 smithi135 ceph-mon[97338]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:24.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:23 smithi135 ceph-mon[97338]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-07-14T12:55:24.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:23 smithi135 ceph-mon[97338]: osdmap e58: 9 total, 8 up, 9 in 2023-07-14T12:55:24.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:23 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:24.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:23 smithi135 ceph-mon[97338]: from='osd.8 [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:55:24.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:23 smithi135 ceph-mon[97338]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:55:24.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:23 smithi131 ceph-mon[96953]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:24.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:23 smithi131 ceph-mon[96953]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-07-14T12:55:24.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:23 smithi131 ceph-mon[96953]: osdmap e58: 9 total, 8 up, 9 in 2023-07-14T12:55:24.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:23 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:24.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:23 smithi131 ceph-mon[96953]: from='osd.8 [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:55:24.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:23 smithi131 ceph-mon[96953]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:55:25.187 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-07-14T12:55:25.187 INFO:teuthology.orchestra.run.smithi017.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-07-14T12:55:25.188 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10+0 records in 2023-07-14T12:55:25.188 INFO:teuthology.orchestra.run.smithi017.stderr:10+0 records out 2023-07-14T12:55:25.188 INFO:teuthology.orchestra.run.smithi017.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0298631 s, 351 MB/s 2023-07-14T12:55:25.188 INFO:teuthology.orchestra.run.smithi017.stderr:--> Zapping successful for: 2023-07-14T12:55:25.194 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:24 smithi135 ceph-mon[97338]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:55:25.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:24 smithi135 ceph-mon[97338]: osdmap e59: 9 total, 8 up, 9 in 2023-07-14T12:55:25.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:24 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:25.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:24 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:25.334 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:24 smithi017 ceph-mon[95536]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:55:25.334 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:24 smithi017 ceph-mon[95536]: osdmap e59: 9 total, 8 up, 9 in 2023-07-14T12:55:25.334 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:24 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:25.335 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:24 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:25.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:24 smithi131 ceph-mon[96953]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:55:25.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:24 smithi131 ceph-mon[96953]: osdmap e59: 9 total, 8 up, 9 in 2023-07-14T12:55:25.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:24 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:25.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:24 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:25.610 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi017:vg_nvme/lv_1 2023-07-14T12:55:26.346 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:55:26.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:55:26.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:55:26.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:26.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:26.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: osd.8 [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895] boot 2023-07-14T12:55:26.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: osdmap e60: 9 total, 9 up, 9 in 2023-07-14T12:55:26.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:26.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:26.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:26.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:26.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:26.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:26.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:25 smithi017 ceph-mon[95536]: osdmap e61: 9 total, 9 up, 9 in 2023-07-14T12:55:26.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:55:26.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:55:26.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:26.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:26.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: osd.8 [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895] boot 2023-07-14T12:55:26.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: osdmap e60: 9 total, 9 up, 9 in 2023-07-14T12:55:26.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:26.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:26.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:26.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:26.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:26.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:26.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:25 smithi135 ceph-mon[97338]: osdmap e61: 9 total, 9 up, 9 in 2023-07-14T12:55:26.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:55:26.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:55:26.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-14T12:55:26.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:26.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: osd.8 [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895] boot 2023-07-14T12:55:26.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: osdmap e60: 9 total, 9 up, 9 in 2023-07-14T12:55:26.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:55:26.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:26.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:26.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:26.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:26.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:26.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:26.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:25 smithi131 ceph-mon[96953]: osdmap e61: 9 total, 9 up, 9 in 2023-07-14T12:55:27.279 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:26 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi135 2023-07-14T12:55:27.280 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:26 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi135 to 5755M 2023-07-14T12:55:27.280 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:26 smithi017 ceph-mon[95536]: osdmap e62: 9 total, 9 up, 9 in 2023-07-14T12:55:27.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:26 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi135 2023-07-14T12:55:27.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:26 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi135 to 5755M 2023-07-14T12:55:27.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:26 smithi135 ceph-mon[97338]: osdmap e62: 9 total, 9 up, 9 in 2023-07-14T12:55:27.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:26 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi135 2023-07-14T12:55:27.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:26 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi135 to 5755M 2023-07-14T12:55:27.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:26 smithi131 ceph-mon[96953]: osdmap e62: 9 total, 9 up, 9 in 2023-07-14T12:55:27.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.848+0000 7fed58c43700 1 -- 172.21.15.17:0/4235602550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed54100d90 msgr2=0x7fed541011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:27.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.848+0000 7fed58c43700 1 --2- 172.21.15.17:0/4235602550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed54100d90 0x7fed541011e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed48009990 tx=0x7fed48009ca0 comp rx=0 tx=0).stop 2023-07-14T12:55:27.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.848+0000 7fed58c43700 1 -- 172.21.15.17:0/4235602550 shutdown_connections 2023-07-14T12:55:27.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.848+0000 7fed58c43700 1 --2- 172.21.15.17:0/4235602550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed54101720 0x7fed54107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:27.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.848+0000 7fed58c43700 1 --2- 172.21.15.17:0/4235602550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed540ffb90 0x7fed540fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:27.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.848+0000 7fed58c43700 1 --2- 172.21.15.17:0/4235602550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed54100d90 0x7fed541011e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:27.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.848+0000 7fed58c43700 1 -- 172.21.15.17:0/4235602550 >> 172.21.15.17:0/4235602550 conn(0x7fed540fb1a0 msgr2=0x7fed540fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:55:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.848+0000 7fed58c43700 1 -- 172.21.15.17:0/4235602550 shutdown_connections 2023-07-14T12:55:27.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.848+0000 7fed58c43700 1 -- 172.21.15.17:0/4235602550 wait complete. 2023-07-14T12:55:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.849+0000 7fed58c43700 1 Processor -- start 2023-07-14T12:55:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.849+0000 7fed58c43700 1 -- start start 2023-07-14T12:55:27.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.850+0000 7fed58c43700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed540ffb90 0x7fed540742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.850+0000 7fed58c43700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed54100d90 0x7fed54072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.850+0000 7fed58c43700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed54101720 0x7fed54072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.850+0000 7fed58c43700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed540735c0 con 0x7fed54100d90 2023-07-14T12:55:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.850+0000 7fed58c43700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54073730 con 0x7fed540ffb90 2023-07-14T12:55:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.850+0000 7fed58c43700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5419f770 con 0x7fed54101720 2023-07-14T12:55:27.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.850+0000 7fed51d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed54100d90 0x7fed54072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.850+0000 7fed51d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed54100d90 0x7fed54072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52820/0 (socket says 172.21.15.17:52820) 2023-07-14T12:55:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.850+0000 7fed51d9b700 1 -- 172.21.15.17:0/2894659346 learned_addr learned my addr 172.21.15.17:0/2894659346 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:55:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.850+0000 7fed52d9d700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed54101720 0x7fed54072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.850+0000 7fed5259c700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed540ffb90 0x7fed540742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.851+0000 7fed51d9b700 1 -- 172.21.15.17:0/2894659346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed54101720 msgr2=0x7fed54072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:27.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.851+0000 7fed51d9b700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed54101720 0x7fed54072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.851+0000 7fed51d9b700 1 -- 172.21.15.17:0/2894659346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed540ffb90 msgr2=0x7fed540742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.851+0000 7fed51d9b700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed540ffb90 0x7fed540742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.851+0000 7fed51d9b700 1 -- 172.21.15.17:0/2894659346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480095f0 con 0x7fed54100d90 2023-07-14T12:55:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.851+0000 7fed51d9b700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed54100d90 0x7fed54072900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fed4800c010 tx=0x7fed48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:55:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.851+0000 7fed437fe700 1 -- 172.21.15.17:0/2894659346 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4801d070 con 0x7fed54100d90 2023-07-14T12:55:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.851+0000 7fed58c43700 1 -- 172.21.15.17:0/2894659346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5419f9f0 con 0x7fed54100d90 2023-07-14T12:55:27.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.851+0000 7fed437fe700 1 -- 172.21.15.17:0/2894659346 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed48004040 con 0x7fed54100d90 2023-07-14T12:55:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.851+0000 7fed437fe700 1 -- 172.21.15.17:0/2894659346 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48022d10 con 0x7fed54100d90 2023-07-14T12:55:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.851+0000 7fed58c43700 1 -- 172.21.15.17:0/2894659346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5419fe60 con 0x7fed54100d90 2023-07-14T12:55:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.852+0000 7fed58c43700 1 -- 172.21.15.17:0/2894659346 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed54107140 con 0x7fed54100d90 2023-07-14T12:55:27.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.854+0000 7fed437fe700 1 -- 172.21.15.17:0/2894659346 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fed48022470 con 0x7fed54100d90 2023-07-14T12:55:27.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.856+0000 7fed437fe700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed3c0a1150 0x7fed3c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:27.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.856+0000 7fed437fe700 1 -- 172.21.15.17:0/2894659346 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5858+0+0 (secure 0 0 0) 0x7fed480cd540 con 0x7fed54100d90 2023-07-14T12:55:27.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.856+0000 7fed5259c700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed3c0a1150 0x7fed3c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:27.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.857+0000 7fed5259c700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed3c0a1150 0x7fed3c0a3600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed54100bf0 tx=0x7fed4400a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:55:27.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:27.859+0000 7fed437fe700 1 -- 172.21.15.17:0/2894659346 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fed48097610 con 0x7fed54100d90 2023-07-14T12:55:28.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:28.080+0000 7fed58c43700 1 -- 172.21.15.17:0/2894659346 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fed54060950 con 0x7fed3c0a1150 2023-07-14T12:55:28.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:27 smithi017 ceph-mon[95536]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:28.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:27 smithi135 ceph-mon[97338]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:28.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:27 smithi131 ceph-mon[96953]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:29.331 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:29 smithi017 ceph-mon[95536]: osdmap e63: 9 total, 9 up, 9 in 2023-07-14T12:55:29.331 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:29 smithi017 ceph-mon[95536]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:55:29.331 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:55:29.331 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:55:29.332 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:29 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:29.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:29 smithi135 ceph-mon[97338]: osdmap e63: 9 total, 9 up, 9 in 2023-07-14T12:55:29.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:29 smithi135 ceph-mon[97338]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:55:29.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:55:29.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:55:29.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:29 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:29.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:29 smithi131 ceph-mon[96953]: osdmap e63: 9 total, 9 up, 9 in 2023-07-14T12:55:29.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:29 smithi131 ceph-mon[96953]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:55:29.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:55:29.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:55:29.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:29 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:30.247 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:30 smithi017 ceph-mon[95536]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:30.248 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:30 smithi017 ceph-mon[95536]: osdmap e64: 9 total, 9 up, 9 in 2023-07-14T12:55:30.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:30 smithi135 ceph-mon[97338]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:30.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:30 smithi135 ceph-mon[97338]: osdmap e64: 9 total, 9 up, 9 in 2023-07-14T12:55:30.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:30 smithi131 ceph-mon[96953]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:30.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:30 smithi131 ceph-mon[96953]: osdmap e64: 9 total, 9 up, 9 in 2023-07-14T12:55:32.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:32 smithi017 ceph-mon[95536]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-07-14T12:55:32.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:32 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1360489652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e83ba4ac-ebb8-4f08-961d-3221193aa1eb"}]: dispatch 2023-07-14T12:55:32.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:32 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1360489652' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e83ba4ac-ebb8-4f08-961d-3221193aa1eb"}]': finished 2023-07-14T12:55:32.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:32 smithi017 ceph-mon[95536]: osdmap e65: 10 total, 9 up, 10 in 2023-07-14T12:55:32.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:32 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:32.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:32 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2302911796' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:55:32.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:32 smithi135 ceph-mon[97338]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-07-14T12:55:32.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:32 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1360489652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e83ba4ac-ebb8-4f08-961d-3221193aa1eb"}]: dispatch 2023-07-14T12:55:32.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:32 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1360489652' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e83ba4ac-ebb8-4f08-961d-3221193aa1eb"}]': finished 2023-07-14T12:55:32.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:32 smithi135 ceph-mon[97338]: osdmap e65: 10 total, 9 up, 10 in 2023-07-14T12:55:32.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:32 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:32.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:32 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2302911796' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:55:32.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:32 smithi131 ceph-mon[96953]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 116 KiB/s, 0 objects/s recovering 2023-07-14T12:55:32.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:32 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1360489652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e83ba4ac-ebb8-4f08-961d-3221193aa1eb"}]: dispatch 2023-07-14T12:55:32.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:32 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1360489652' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e83ba4ac-ebb8-4f08-961d-3221193aa1eb"}]': finished 2023-07-14T12:55:32.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:32 smithi131 ceph-mon[96953]: osdmap e65: 10 total, 9 up, 10 in 2023-07-14T12:55:32.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:32 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:32.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:32 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2302911796' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:55:34.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:34 smithi017 ceph-mon[95536]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-07-14T12:55:34.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:34 smithi135 ceph-mon[97338]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-07-14T12:55:34.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:34 smithi131 ceph-mon[96953]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-07-14T12:55:36.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:36 smithi017 ceph-mon[95536]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2023-07-14T12:55:36.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:36 smithi135 ceph-mon[97338]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2023-07-14T12:55:36.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:36 smithi131 ceph-mon[96953]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2023-07-14T12:55:38.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:38 smithi017 ceph-mon[95536]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T12:55:38.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:38 smithi135 ceph-mon[97338]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T12:55:38.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:38 smithi131 ceph-mon[96953]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T12:55:39.352 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:39 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-14T12:55:39.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:39 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:39.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:39 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-14T12:55:39.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:39 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:39.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:39 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-14T12:55:39.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:39 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:40.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:40 smithi017 ceph-mon[95536]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-07-14T12:55:40.103 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:40 smithi017 ceph-mon[95536]: Deploying daemon osd.9 on smithi017 2023-07-14T12:55:40.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:40 smithi135 ceph-mon[97338]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-07-14T12:55:40.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:40 smithi135 ceph-mon[97338]: Deploying daemon osd.9 on smithi017 2023-07-14T12:55:40.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:40 smithi131 ceph-mon[96953]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-07-14T12:55:40.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:40 smithi131 ceph-mon[96953]: Deploying daemon osd.9 on smithi017 2023-07-14T12:55:42.338 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:42 smithi017 ceph-mon[95536]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:42.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:42 smithi135 ceph-mon[97338]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:42.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:42 smithi131 ceph-mon[96953]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:44.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:44 smithi017 ceph-mon[95536]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:44.444 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:44 smithi135 ceph-mon[97338]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:44.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:44 smithi131 ceph-mon[96953]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:46.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:46 smithi017 ceph-mon[95536]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:46.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:46.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:46.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:46.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:46 smithi135 ceph-mon[97338]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:46.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:46.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:46.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:46.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:46 smithi131 ceph-mon[96953]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:46.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:46.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:46.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:48.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:48 smithi017 ceph-mon[95536]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:48.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:48 smithi135 ceph-mon[97338]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:48.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:48 smithi131 ceph-mon[96953]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.197+0000 7fed437fe700 1 -- 172.21.15.17:0/2894659346 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fed54060950 con 0x7fed3c0a1150 2023-07-14T12:55:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 9 on host 'smithi017' 2023-07-14T12:55:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.200+0000 7fed58c43700 1 -- 172.21.15.17:0/2894659346 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed3c0a1150 msgr2=0x7fed3c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.200+0000 7fed58c43700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed3c0a1150 0x7fed3c0a3600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed54100bf0 tx=0x7fed4400a3b0 comp rx=0 tx=0).stop 2023-07-14T12:55:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.200+0000 7fed58c43700 1 -- 172.21.15.17:0/2894659346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed54100d90 msgr2=0x7fed54072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.200+0000 7fed58c43700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed54100d90 0x7fed54072900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fed4800c010 tx=0x7fed48004730 comp rx=0 tx=0).stop 2023-07-14T12:55:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.200+0000 7fed58c43700 1 -- 172.21.15.17:0/2894659346 shutdown_connections 2023-07-14T12:55:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.200+0000 7fed58c43700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed3c0a1150 0x7fed3c0a3600 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.201+0000 7fed58c43700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed54101720 0x7fed54072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.201+0000 7fed58c43700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed540ffb90 0x7fed540742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.201+0000 7fed58c43700 1 --2- 172.21.15.17:0/2894659346 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed54100d90 0x7fed54072900 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.201+0000 7fed58c43700 1 -- 172.21.15.17:0/2894659346 >> 172.21.15.17:0/2894659346 conn(0x7fed540fb1a0 msgr2=0x7fed54104280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:55:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.201+0000 7fed58c43700 1 -- 172.21.15.17:0/2894659346 shutdown_connections 2023-07-14T12:55:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:55:49.201+0000 7fed58c43700 1 -- 172.21.15.17:0/2894659346 wait complete. 2023-07-14T12:55:49.675 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:49 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.675 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:49 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:49 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:49.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:49 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:49.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:49 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:49 smithi017 ceph-mon[95536]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:49.676 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:49 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.677 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:49 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.677 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:49 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:49.677 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:49 smithi017 ceph-mon[95536]: from='osd.9 [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T12:55:49.677 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:49 smithi017 ceph-mon[95536]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T12:55:49.679 DEBUG:teuthology.orchestra.run.smithi017:osd.9> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.9.service 2023-07-14T12:55:49.684 INFO:tasks.cephadm:Deploying osd.10 on smithi131 with /dev/vg_nvme/lv_1... 2023-07-14T12:55:49.684 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-07-14T12:55:49.760 INFO:journalctl@ceph.osd.9.smithi017.stdout:-- Logs begin at Fri 2023-07-14 12:26:45 UTC. -- 2023-07-14T12:55:49.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:49 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:49 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:49 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:49.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:49 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:49.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:49 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:49 smithi135 ceph-mon[97338]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:49.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:49 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:49 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:49 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:49.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:49 smithi135 ceph-mon[97338]: from='osd.9 [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T12:55:49.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:49 smithi135 ceph-mon[97338]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T12:55:49.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:49 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:49 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:49 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:49.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:49 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:49.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:49 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:49 smithi131 ceph-mon[96953]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:49.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:49 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:49 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:49.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:49 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:55:49.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:49 smithi131 ceph-mon[96953]: from='osd.9 [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T12:55:49.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:49 smithi131 ceph-mon[96953]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T12:55:50.411 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T12:55:51.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:51 smithi017 ceph-mon[95536]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-07-14T12:55:51.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:51 smithi017 ceph-mon[95536]: osdmap e66: 10 total, 9 up, 10 in 2023-07-14T12:55:51.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:51 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:51.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:51 smithi017 ceph-mon[95536]: from='osd.9 [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:55:51.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:51 smithi017 ceph-mon[95536]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:55:51.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:51 smithi017 ceph-mon[95536]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:51.354 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 12:55:51 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T12:55:51.162+0000 7fb87674e700 -1 osd.9 0 waiting for initial osdmap 2023-07-14T12:55:51.354 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 12:55:51 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T12:55:51.177+0000 7fb86ed3c700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:55:51.388 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:51 smithi131 ceph-mon[96953]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-07-14T12:55:51.389 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:51 smithi131 ceph-mon[96953]: osdmap e66: 10 total, 9 up, 10 in 2023-07-14T12:55:51.389 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:51 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:51.389 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:51 smithi131 ceph-mon[96953]: from='osd.9 [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:55:51.389 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:51 smithi131 ceph-mon[96953]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:55:51.389 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:51 smithi131 ceph-mon[96953]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:51.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:51 smithi135 ceph-mon[97338]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-07-14T12:55:51.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:51 smithi135 ceph-mon[97338]: osdmap e66: 10 total, 9 up, 10 in 2023-07-14T12:55:51.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:51 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:51.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:51 smithi135 ceph-mon[97338]: from='osd.9 [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:55:51.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:51 smithi135 ceph-mon[97338]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2023-07-14T12:55:51.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:51 smithi135 ceph-mon[97338]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:52.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:52 smithi135 ceph-mon[97338]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:55:52.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:52 smithi135 ceph-mon[97338]: osdmap e67: 10 total, 9 up, 10 in 2023-07-14T12:55:52.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:52 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:52.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:52 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:52.446 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-07-14T12:55:52.446 INFO:teuthology.orchestra.run.smithi131.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-07-14T12:55:52.446 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10+0 records in 2023-07-14T12:55:52.446 INFO:teuthology.orchestra.run.smithi131.stderr:10+0 records out 2023-07-14T12:55:52.446 INFO:teuthology.orchestra.run.smithi131.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0296195 s, 354 MB/s 2023-07-14T12:55:52.446 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping successful for: 2023-07-14T12:55:52.482 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:52 smithi131 ceph-mon[96953]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:55:52.482 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:52 smithi131 ceph-mon[96953]: osdmap e67: 10 total, 9 up, 10 in 2023-07-14T12:55:52.482 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:52.482 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:52 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:52.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:52 smithi017 ceph-mon[95536]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2023-07-14T12:55:52.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:52 smithi017 ceph-mon[95536]: osdmap e67: 10 total, 9 up, 10 in 2023-07-14T12:55:52.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:52 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:52.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:52 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:52.888 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi131:vg_nvme/lv_1 2023-07-14T12:55:53.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:55:53.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:55:53.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:53.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: osd.9 [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808] boot 2023-07-14T12:55:53.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: osdmap e68: 10 total, 10 up, 10 in 2023-07-14T12:55:53.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:53.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:53.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi017 2023-07-14T12:55:53.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi017 to 4318M 2023-07-14T12:55:53.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:53.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:53.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:53 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:55:53.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:55:53.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:53.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: osd.9 [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808] boot 2023-07-14T12:55:53.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: osdmap e68: 10 total, 10 up, 10 in 2023-07-14T12:55:53.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:53.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:53.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi017 2023-07-14T12:55:53.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi017 to 4318M 2023-07-14T12:55:53.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:53.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:53.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:53 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:55:53.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:55:53.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:53.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: osd.9 [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808] boot 2023-07-14T12:55:53.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: osdmap e68: 10 total, 10 up, 10 in 2023-07-14T12:55:53.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:55:53.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-14T12:55:53.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi017 2023-07-14T12:55:53.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:55:53.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi017 to 4318M 2023-07-14T12:55:53.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:53.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:55:53.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:53 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:55:53.610 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T12:55:54.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:54 smithi131 ceph-mon[96953]: osdmap e69: 10 total, 10 up, 10 in 2023-07-14T12:55:54.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:54 smithi017 ceph-mon[95536]: osdmap e69: 10 total, 10 up, 10 in 2023-07-14T12:55:54.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:54 smithi135 ceph-mon[97338]: osdmap e69: 10 total, 10 up, 10 in 2023-07-14T12:55:55.099 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.072+0000 7f8c3038c700 1 -- 172.21.15.131:0/3531786848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ffb90 msgr2=0x7f8c280fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:55.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.072+0000 7f8c3038c700 1 --2- 172.21.15.131:0/3531786848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ffb90 0x7f8c280fffa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8c24009990 tx=0x7f8c24009ca0 comp rx=0 tx=0).stop 2023-07-14T12:55:55.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.072+0000 7f8c3038c700 1 -- 172.21.15.131:0/3531786848 shutdown_connections 2023-07-14T12:55:55.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.072+0000 7f8c3038c700 1 --2- 172.21.15.131:0/3531786848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c28101720 0x7f8c28107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:55.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.072+0000 7f8c3038c700 1 --2- 172.21.15.131:0/3531786848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ffb90 0x7f8c280fffa0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:55.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.072+0000 7f8c3038c700 1 --2- 172.21.15.131:0/3531786848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c28100d90 0x7f8c281011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:55.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.072+0000 7f8c3038c700 1 -- 172.21.15.131:0/3531786848 >> 172.21.15.131:0/3531786848 conn(0x7f8c280fb1a0 msgr2=0x7f8c280fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:55:55.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.072+0000 7f8c3038c700 1 -- 172.21.15.131:0/3531786848 shutdown_connections 2023-07-14T12:55:55.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.072+0000 7f8c3038c700 1 -- 172.21.15.131:0/3531786848 wait complete. 2023-07-14T12:55:55.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.073+0000 7f8c3038c700 1 Processor -- start 2023-07-14T12:55:55.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.073+0000 7f8c3038c700 1 -- start start 2023-07-14T12:55:55.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.073+0000 7f8c3038c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ffb90 0x7f8c28197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:55.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.073+0000 7f8c3038c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c28100d90 0x7f8c28197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:55.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.073+0000 7f8c3038c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c28101720 0x7f8c2819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:55.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.073+0000 7f8c3038c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2819f520 con 0x7f8c28100d90 2023-07-14T12:55:55.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.073+0000 7f8c3038c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2819f660 con 0x7f8c280ffb90 2023-07-14T12:55:55.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.073+0000 7f8c3038c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2819f7f0 con 0x7f8c28101720 2023-07-14T12:55:55.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.073+0000 7f8c2e128700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ffb90 0x7f8c28197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:55.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c2e128700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ffb90 0x7f8c28197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56762/0 (socket says 172.21.15.131:56762) 2023-07-14T12:55:55.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c2e128700 1 -- 172.21.15.131:0/2544337669 learned_addr learned my addr 172.21.15.131:0/2544337669 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-07-14T12:55:55.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c2e929700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c28101720 0x7f8c2819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:55.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c2d927700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c28100d90 0x7f8c28197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:55.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c2e128700 1 -- 172.21.15.131:0/2544337669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c28101720 msgr2=0x7f8c2819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:55.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c2e128700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c28101720 0x7f8c2819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:55.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c2e128700 1 -- 172.21.15.131:0/2544337669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c28100d90 msgr2=0x7f8c28197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:55:55.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c2e128700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c28100d90 0x7f8c28197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:55:55.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c2e128700 1 -- 172.21.15.131:0/2544337669 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c240095f0 con 0x7f8c280ffb90 2023-07-14T12:55:55.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c2e929700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c28101720 0x7f8c2819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:55:55.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c2e128700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ffb90 0x7f8c28197990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8c240095c0 tx=0x7f8c24005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:55:55.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c1f7fe700 1 -- 172.21.15.131:0/2544337669 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2401d070 con 0x7f8c280ffb90 2023-07-14T12:55:55.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c1f7fe700 1 -- 172.21.15.131:0/2544337669 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c24004080 con 0x7f8c280ffb90 2023-07-14T12:55:55.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c1f7fe700 1 -- 172.21.15.131:0/2544337669 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24022ca0 con 0x7f8c280ffb90 2023-07-14T12:55:55.106 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.074+0000 7f8c3038c700 1 -- 172.21.15.131:0/2544337669 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2819fa70 con 0x7f8c280ffb90 2023-07-14T12:55:55.106 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.075+0000 7f8c3038c700 1 -- 172.21.15.131:0/2544337669 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2819fe30 con 0x7f8c280ffb90 2023-07-14T12:55:55.106 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.076+0000 7f8c3038c700 1 -- 172.21.15.131:0/2544337669 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c28192110 con 0x7f8c280ffb90 2023-07-14T12:55:55.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.078+0000 7f8c1f7fe700 1 -- 172.21.15.131:0/2544337669 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8c24003bf0 con 0x7f8c280ffb90 2023-07-14T12:55:55.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.079+0000 7f8c1f7fe700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c140a11d0 0x7f8c140a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:55:55.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.079+0000 7f8c1f7fe700 1 -- 172.21.15.131:0/2544337669 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f8c240cd7e0 con 0x7f8c280ffb90 2023-07-14T12:55:55.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.079+0000 7f8c2d927700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c140a11d0 0x7f8c140a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:55:55.108 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.080+0000 7f8c2d927700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c140a11d0 0x7f8c140a3680 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8c18005ea0 tx=0x7f8c18005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:55:55.110 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.083+0000 7f8c1f7fe700 1 -- 172.21.15.131:0/2544337669 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8c24097840 con 0x7f8c280ffb90 2023-07-14T12:55:55.314 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:55:55.287+0000 7f8c3038c700 1 -- 172.21.15.131:0/2544337669 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c28060950 con 0x7f8c140a11d0 2023-07-14T12:55:55.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:55 smithi131 ceph-mon[96953]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:55:55.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:55 smithi017 ceph-mon[95536]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:55:55.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:55 smithi135 ceph-mon[97338]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:55:56.464 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:56 smithi131 ceph-mon[96953]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:55:56.465 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:56 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:55:56.465 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:56 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:55:56.465 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:56 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:56.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:56 smithi017 ceph-mon[95536]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:55:56.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:56 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:55:56.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:56 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:55:56.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:56 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:56.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:56 smithi135 ceph-mon[97338]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:55:56.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:56 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:55:56.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:56 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:55:56.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:56 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:55:57.493 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:57 smithi131 ceph-mon[96953]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:55:57.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:57 smithi017 ceph-mon[95536]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:55:57.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:57 smithi135 ceph-mon[97338]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:55:58.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:58 smithi135 ceph-mon[97338]: from='client.? 172.21.15.131:0/4111955698' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61c3f223-8d23-4b29-9c18-e45d08aa5960"}]: dispatch 2023-07-14T12:55:58.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:58 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61c3f223-8d23-4b29-9c18-e45d08aa5960"}]: dispatch 2023-07-14T12:55:58.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:58 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61c3f223-8d23-4b29-9c18-e45d08aa5960"}]': finished 2023-07-14T12:55:58.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:58 smithi135 ceph-mon[97338]: osdmap e70: 11 total, 10 up, 11 in 2023-07-14T12:55:58.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:58 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:55:58.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:58 smithi131 ceph-mon[96953]: from='client.? 172.21.15.131:0/4111955698' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61c3f223-8d23-4b29-9c18-e45d08aa5960"}]: dispatch 2023-07-14T12:55:58.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:58 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61c3f223-8d23-4b29-9c18-e45d08aa5960"}]: dispatch 2023-07-14T12:55:58.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:58 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61c3f223-8d23-4b29-9c18-e45d08aa5960"}]': finished 2023-07-14T12:55:58.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:58 smithi131 ceph-mon[96953]: osdmap e70: 11 total, 10 up, 11 in 2023-07-14T12:55:58.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:58 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:55:58.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:58 smithi017 ceph-mon[95536]: from='client.? 172.21.15.131:0/4111955698' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61c3f223-8d23-4b29-9c18-e45d08aa5960"}]: dispatch 2023-07-14T12:55:58.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:58 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61c3f223-8d23-4b29-9c18-e45d08aa5960"}]: dispatch 2023-07-14T12:55:58.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:58 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61c3f223-8d23-4b29-9c18-e45d08aa5960"}]': finished 2023-07-14T12:55:58.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:58 smithi017 ceph-mon[95536]: osdmap e70: 11 total, 10 up, 11 in 2023-07-14T12:55:58.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:58 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:55:59.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:59 smithi135 ceph-mon[97338]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:55:59.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:55:59 smithi135 ceph-mon[97338]: from='client.? 172.21.15.131:0/4162444076' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:55:59.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:59 smithi131 ceph-mon[96953]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:55:59.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:55:59 smithi131 ceph-mon[96953]: from='client.? 172.21.15.131:0/4162444076' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:55:59.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:59 smithi017 ceph-mon[95536]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:55:59.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:55:59 smithi017 ceph-mon[95536]: from='client.? 172.21.15.131:0/4162444076' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:56:02.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:01 smithi135 ceph-mon[97338]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:02.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:01 smithi131 ceph-mon[96953]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:02.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:01 smithi017 ceph-mon[95536]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:04.187 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:03 smithi131 ceph-mon[96953]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:04.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:03 smithi135 ceph-mon[97338]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:04.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:03 smithi017 ceph-mon[95536]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:06.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:05 smithi135 ceph-mon[97338]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:06.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:05 smithi131 ceph-mon[96953]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:06.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:05 smithi017 ceph-mon[95536]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:07.156 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:06 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-14T12:56:07.156 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:06 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:07.156 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:06 smithi131 ceph-mon[96953]: Deploying daemon osd.10 on smithi131 2023-07-14T12:56:07.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:06 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-14T12:56:07.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:06 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:07.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:06 smithi135 ceph-mon[97338]: Deploying daemon osd.10 on smithi131 2023-07-14T12:56:07.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-14T12:56:07.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:07.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:06 smithi017 ceph-mon[95536]: Deploying daemon osd.10 on smithi131 2023-07-14T12:56:08.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:07 smithi135 ceph-mon[97338]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:08.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:07 smithi131 ceph-mon[96953]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:08.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:07 smithi017 ceph-mon[95536]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:10.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:09 smithi135 ceph-mon[97338]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:10.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:09 smithi131 ceph-mon[96953]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:10.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:09 smithi017 ceph-mon[95536]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:12.190 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:11 smithi131 ceph-mon[96953]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:12.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:11 smithi135 ceph-mon[97338]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:12.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:11 smithi017 ceph-mon[95536]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:13.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:13.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:13.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:13 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:13.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:13 smithi131 ceph-mon[96953]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:13.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:13.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:13.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:13 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:13.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:13 smithi017 ceph-mon[95536]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:13.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:13.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:13.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:13 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:13.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:13 smithi135 ceph-mon[97338]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:16.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:15 smithi135 ceph-mon[97338]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:16.243 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:15 smithi131 ceph-mon[96953]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:16.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.315+0000 7f8c1f7fe700 1 -- 172.21.15.131:0/2544337669 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f8c28060950 con 0x7f8c140a11d0 2023-07-14T12:56:16.342 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 10 on host 'smithi131' 2023-07-14T12:56:16.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 -- 172.21.15.131:0/2544337669 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c140a11d0 msgr2=0x7f8c140a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:16.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c140a11d0 0x7f8c140a3680 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8c18005ea0 tx=0x7f8c18005e30 comp rx=0 tx=0).stop 2023-07-14T12:56:16.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 -- 172.21.15.131:0/2544337669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ffb90 msgr2=0x7f8c28197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:16.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ffb90 0x7f8c28197990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8c240095c0 tx=0x7f8c24005ef0 comp rx=0 tx=0).stop 2023-07-14T12:56:16.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 -- 172.21.15.131:0/2544337669 shutdown_connections 2023-07-14T12:56:16.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c140a11d0 0x7f8c140a3680 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:16.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c28101720 0x7f8c2819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:16.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ffb90 0x7f8c28197990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:16.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 --2- 172.21.15.131:0/2544337669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c28100d90 0x7f8c28197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:16.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 -- 172.21.15.131:0/2544337669 >> 172.21.15.131:0/2544337669 conn(0x7f8c280fb1a0 msgr2=0x7f8c28106710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:16.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 -- 172.21.15.131:0/2544337669 shutdown_connections 2023-07-14T12:56:16.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-07-14T12:56:16.317+0000 7f8c3038c700 1 -- 172.21.15.131:0/2544337669 wait complete. 2023-07-14T12:56:16.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:15 smithi017 ceph-mon[95536]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:16.845 DEBUG:teuthology.orchestra.run.smithi131:osd.10> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.10.service 2023-07-14T12:56:16.851 INFO:tasks.cephadm:Deploying osd.11 on smithi135 with /dev/vg_nvme/lv_1... 2023-07-14T12:56:16.851 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-07-14T12:56:16.923 INFO:journalctl@ceph.osd.10.smithi131.stdout:-- Logs begin at Fri 2023-07-14 12:26:41 UTC. -- 2023-07-14T12:56:17.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:17.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:17.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:17 smithi135 ceph-mon[97338]: from='osd.10 [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T12:56:17.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:17 smithi135 ceph-mon[97338]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T12:56:17.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:17 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:17.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:17 smithi135 ceph-mon[97338]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:17.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:17.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:17.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:17 smithi131 ceph-mon[96953]: from='osd.10 [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T12:56:17.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:17 smithi131 ceph-mon[96953]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T12:56:17.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:17 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:17.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:17 smithi131 ceph-mon[96953]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:17.578 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:56:17.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:17.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:17.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:17.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:17 smithi017 ceph-mon[95536]: from='osd.10 [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T12:56:17.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:17 smithi017 ceph-mon[95536]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T12:56:17.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:17 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:17.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:17 smithi017 ceph-mon[95536]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:18.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:18 smithi135 ceph-mon[97338]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-07-14T12:56:18.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:18 smithi135 ceph-mon[97338]: osdmap e71: 11 total, 10 up, 11 in 2023-07-14T12:56:18.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:18 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:18.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:18 smithi135 ceph-mon[97338]: from='osd.10 [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:56:18.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:18 smithi135 ceph-mon[97338]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:56:18.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:18 smithi017 ceph-mon[95536]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-07-14T12:56:18.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:18 smithi017 ceph-mon[95536]: osdmap e71: 11 total, 10 up, 11 in 2023-07-14T12:56:18.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:18 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:18.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:18 smithi017 ceph-mon[95536]: from='osd.10 [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:56:18.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:18 smithi017 ceph-mon[95536]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:56:18.689 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:18 smithi131 ceph-mon[96953]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-07-14T12:56:18.689 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:18 smithi131 ceph-mon[96953]: osdmap e71: 11 total, 10 up, 11 in 2023-07-14T12:56:18.689 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:18 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:18.690 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:18 smithi131 ceph-mon[96953]: from='osd.10 [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:56:18.690 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:18 smithi131 ceph-mon[96953]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-07-14T12:56:18.690 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 12:56:18 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T12:56:18.328+0000 7f1a53314700 -1 osd.10 0 waiting for initial osdmap 2023-07-14T12:56:18.690 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 12:56:18 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T12:56:18.346+0000 7f1a4d105700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:56:19.562 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-07-14T12:56:19.562 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-07-14T12:56:19.562 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2023-07-14T12:56:19.563 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2023-07-14T12:56:19.563 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0390285 s, 269 MB/s 2023-07-14T12:56:19.563 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2023-07-14T12:56:19.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:19 smithi135 ceph-mon[97338]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:56:19.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:19 smithi135 ceph-mon[97338]: osdmap e72: 11 total, 10 up, 11 in 2023-07-14T12:56:19.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:19.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:19.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:19 smithi135 ceph-mon[97338]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:19.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:19 smithi131 ceph-mon[96953]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:56:19.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:19 smithi131 ceph-mon[96953]: osdmap e72: 11 total, 10 up, 11 in 2023-07-14T12:56:19.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:19.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:19.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:19 smithi131 ceph-mon[96953]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:19.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:19 smithi017 ceph-mon[95536]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-07-14T12:56:19.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:19 smithi017 ceph-mon[95536]: osdmap e72: 11 total, 10 up, 11 in 2023-07-14T12:56:19.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:19.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:19.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:19 smithi017 ceph-mon[95536]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-14T12:56:20.049 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi135:vg_nvme/lv_1 2023-07-14T12:56:20.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:56:20.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:56:20.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: osd.10 [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823] boot 2023-07-14T12:56:20.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: osdmap e73: 11 total, 11 up, 11 in 2023-07-14T12:56:20.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:20.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi131 2023-07-14T12:56:20.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:20.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:20.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi131 to 4316M 2023-07-14T12:56:20.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:20.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:20.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:20.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:20 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:20.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:56:20.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:56:20.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: osd.10 [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823] boot 2023-07-14T12:56:20.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: osdmap e73: 11 total, 11 up, 11 in 2023-07-14T12:56:20.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:20.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi131 2023-07-14T12:56:20.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:20.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:20.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi131 to 4316M 2023-07-14T12:56:20.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:20.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:20.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:20.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:20 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:20.773 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:56:20.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:56:20.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:56:20.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: osd.10 [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823] boot 2023-07-14T12:56:20.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: osdmap e73: 11 total, 11 up, 11 in 2023-07-14T12:56:20.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:56:20.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi131 2023-07-14T12:56:20.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:20.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:20.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.856 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.856 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.856 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:20.856 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi131 to 4316M 2023-07-14T12:56:20.856 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:20.856 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:20.856 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:20.857 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:20 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:21.650 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:21 smithi135 ceph-mon[97338]: osdmap e74: 11 total, 11 up, 11 in 2023-07-14T12:56:21.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:21 smithi135 ceph-mon[97338]: pgmap v251: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:21.651 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:21 smithi135 ceph-mon[97338]: osdmap e75: 11 total, 11 up, 11 in 2023-07-14T12:56:21.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:21 smithi131 ceph-mon[96953]: osdmap e74: 11 total, 11 up, 11 in 2023-07-14T12:56:21.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:21 smithi131 ceph-mon[96953]: pgmap v251: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:21.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:21 smithi131 ceph-mon[96953]: osdmap e75: 11 total, 11 up, 11 in 2023-07-14T12:56:21.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:21 smithi017 ceph-mon[95536]: osdmap e74: 11 total, 11 up, 11 in 2023-07-14T12:56:21.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:21 smithi017 ceph-mon[95536]: pgmap v251: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:21.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:21 smithi017 ceph-mon[95536]: osdmap e75: 11 total, 11 up, 11 in 2023-07-14T12:56:22.295 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.267+0000 7f8bbf355700 1 -- 172.21.15.135:0/126958672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb8101720 msgr2=0x7f8bb8107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:22.295 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.267+0000 7f8bbf355700 1 --2- 172.21.15.135:0/126958672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb8101720 0x7f8bb8107fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000b0a0 tx=0x7f8bb000b3b0 comp rx=0 tx=0).stop 2023-07-14T12:56:22.295 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.267+0000 7f8bbf355700 1 -- 172.21.15.135:0/126958672 shutdown_connections 2023-07-14T12:56:22.295 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.267+0000 7f8bbf355700 1 --2- 172.21.15.135:0/126958672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb8101720 0x7f8bb8107fe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:22.295 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.267+0000 7f8bbf355700 1 --2- 172.21.15.135:0/126958672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb80ffb90 0x7f8bb80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:22.296 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.267+0000 7f8bbf355700 1 --2- 172.21.15.135:0/126958672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb8100d90 0x7f8bb81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:22.296 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.267+0000 7f8bbf355700 1 -- 172.21.15.135:0/126958672 >> 172.21.15.135:0/126958672 conn(0x7f8bb80fb1a0 msgr2=0x7f8bb80fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:22.296 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.267+0000 7f8bbf355700 1 -- 172.21.15.135:0/126958672 shutdown_connections 2023-07-14T12:56:22.296 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.267+0000 7f8bbf355700 1 -- 172.21.15.135:0/126958672 wait complete. 2023-07-14T12:56:22.297 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.268+0000 7f8bbf355700 1 Processor -- start 2023-07-14T12:56:22.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.268+0000 7f8bbf355700 1 -- start start 2023-07-14T12:56:22.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbf355700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb80ffb90 0x7f8bb8197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:22.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbf355700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb8100d90 0x7f8bb8197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:22.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbf355700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb8101720 0x7f8bb819f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:22.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbf355700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb819f630 con 0x7f8bb8100d90 2023-07-14T12:56:22.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbf355700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb819f770 con 0x7f8bb8101720 2023-07-14T12:56:22.298 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbf355700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb819f900 con 0x7f8bb80ffb90 2023-07-14T12:56:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbd0f1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb80ffb90 0x7f8bb8197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbd0f1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb80ffb90 0x7f8bb8197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49566/0 (socket says 172.21.15.135:49566) 2023-07-14T12:56:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbd0f1700 1 -- 172.21.15.135:0/3663521909 learned_addr learned my addr 172.21.15.135:0/3663521909 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-07-14T12:56:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbc8f0700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb8100d90 0x7f8bb8197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbd8f2700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb8101720 0x7f8bb819f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbd0f1700 1 -- 172.21.15.135:0/3663521909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb8101720 msgr2=0x7f8bb819f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:22.299 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbd0f1700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb8101720 0x7f8bb819f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:22.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbd0f1700 1 -- 172.21.15.135:0/3663521909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb8100d90 msgr2=0x7f8bb8197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:22.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbd0f1700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb8100d90 0x7f8bb8197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:22.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.269+0000 7f8bbd0f1700 1 -- 172.21.15.135:0/3663521909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009d00 con 0x7f8bb80ffb90 2023-07-14T12:56:22.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.270+0000 7f8bbd0f1700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb80ffb90 0x7f8bb8197aa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400d9b0 tx=0x7f8bb400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:22.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.270+0000 7f8bae7fc700 1 -- 172.21.15.135:0/3663521909 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4004020 con 0x7f8bb80ffb90 2023-07-14T12:56:22.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.270+0000 7f8bae7fc700 1 -- 172.21.15.135:0/3663521909 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bb4009730 con 0x7f8bb80ffb90 2023-07-14T12:56:22.300 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.270+0000 7f8bbf355700 1 -- 172.21.15.135:0/3663521909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb819fbe0 con 0x7f8bb80ffb90 2023-07-14T12:56:22.301 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.270+0000 7f8bae7fc700 1 -- 172.21.15.135:0/3663521909 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb40038e0 con 0x7f8bb80ffb90 2023-07-14T12:56:22.301 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.270+0000 7f8bbf355700 1 -- 172.21.15.135:0/3663521909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb81a0130 con 0x7f8bb80ffb90 2023-07-14T12:56:22.301 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.271+0000 7f8bbf355700 1 -- 172.21.15.135:0/3663521909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb810b210 con 0x7f8bb80ffb90 2023-07-14T12:56:22.301 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.273+0000 7f8bae7fc700 1 -- 172.21.15.135:0/3663521909 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8bb40098a0 con 0x7f8bb80ffb90 2023-07-14T12:56:22.302 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.274+0000 7f8bae7fc700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8ba40a11d0 0x7f8ba40a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:22.302 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.275+0000 7f8bae7fc700 1 -- 172.21.15.135:0/3663521909 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f8bb40cbf40 con 0x7f8bb80ffb90 2023-07-14T12:56:22.302 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.275+0000 7f8bbc8f0700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8ba40a11d0 0x7f8ba40a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:22.303 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.275+0000 7f8bbc8f0700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8ba40a11d0 0x7f8ba40a3680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009c60 tx=0x7f8ba8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:22.306 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.279+0000 7f8bae7fc700 1 -- 172.21.15.135:0/3663521909 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8bb4095c20 con 0x7f8bb80ffb90 2023-07-14T12:56:22.509 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:22.481+0000 7f8bbf355700 1 -- 172.21.15.135:0/3663521909 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bb81076f0 con 0x7f8ba40a11d0 2023-07-14T12:56:23.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:23 smithi135 ceph-mon[97338]: osdmap e76: 11 total, 11 up, 11 in 2023-07-14T12:56:23.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:23 smithi135 ceph-mon[97338]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:56:23.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:23 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:56:23.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:23 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:56:23.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:23 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:23.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:23 smithi135 ceph-mon[97338]: pgmap v254: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:23.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:23 smithi131 ceph-mon[96953]: osdmap e76: 11 total, 11 up, 11 in 2023-07-14T12:56:23.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:23 smithi131 ceph-mon[96953]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:56:23.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:23 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:56:23.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:23 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:56:23.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:23 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:23.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:23 smithi131 ceph-mon[96953]: pgmap v254: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:23.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:23 smithi017 ceph-mon[95536]: osdmap e76: 11 total, 11 up, 11 in 2023-07-14T12:56:23.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:23 smithi017 ceph-mon[95536]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:56:23.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T12:56:23.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T12:56:23.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:23 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:23.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:23 smithi017 ceph-mon[95536]: pgmap v254: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:24.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:24 smithi135 ceph-mon[97338]: osdmap e77: 11 total, 11 up, 11 in 2023-07-14T12:56:24.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:24 smithi131 ceph-mon[96953]: osdmap e77: 11 total, 11 up, 11 in 2023-07-14T12:56:24.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:24 smithi017 ceph-mon[95536]: osdmap e77: 11 total, 11 up, 11 in 2023-07-14T12:56:25.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:25 smithi135 ceph-mon[97338]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 129 KiB/s, 0 objects/s recovering 2023-07-14T12:56:25.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:25 smithi131 ceph-mon[96953]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 129 KiB/s, 0 objects/s recovering 2023-07-14T12:56:25.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:25 smithi017 ceph-mon[95536]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 129 KiB/s, 0 objects/s recovering 2023-07-14T12:56:26.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:26 smithi135 ceph-mon[97338]: from='client.? 172.21.15.135:0/3913124521' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a17613e-c927-4c60-bfe9-518ea7d627e4"}]: dispatch 2023-07-14T12:56:26.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:26 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a17613e-c927-4c60-bfe9-518ea7d627e4"}]: dispatch 2023-07-14T12:56:26.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:26 smithi135 ceph-mon[97338]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a17613e-c927-4c60-bfe9-518ea7d627e4"}]': finished 2023-07-14T12:56:26.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:26 smithi135 ceph-mon[97338]: osdmap e78: 12 total, 11 up, 12 in 2023-07-14T12:56:26.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:26 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:26.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:26 smithi135 ceph-mon[97338]: from='client.? 172.21.15.135:0/538951938' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:56:26.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:26 smithi131 ceph-mon[96953]: from='client.? 172.21.15.135:0/3913124521' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a17613e-c927-4c60-bfe9-518ea7d627e4"}]: dispatch 2023-07-14T12:56:26.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:26 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a17613e-c927-4c60-bfe9-518ea7d627e4"}]: dispatch 2023-07-14T12:56:26.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:26 smithi131 ceph-mon[96953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a17613e-c927-4c60-bfe9-518ea7d627e4"}]': finished 2023-07-14T12:56:26.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:26 smithi131 ceph-mon[96953]: osdmap e78: 12 total, 11 up, 12 in 2023-07-14T12:56:26.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:26 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:26.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:26 smithi131 ceph-mon[96953]: from='client.? 172.21.15.135:0/538951938' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:56:26.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:26 smithi017 ceph-mon[95536]: from='client.? 172.21.15.135:0/3913124521' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a17613e-c927-4c60-bfe9-518ea7d627e4"}]: dispatch 2023-07-14T12:56:26.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:26 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a17613e-c927-4c60-bfe9-518ea7d627e4"}]: dispatch 2023-07-14T12:56:26.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:26 smithi017 ceph-mon[95536]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a17613e-c927-4c60-bfe9-518ea7d627e4"}]': finished 2023-07-14T12:56:26.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:26 smithi017 ceph-mon[95536]: osdmap e78: 12 total, 11 up, 12 in 2023-07-14T12:56:26.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:26 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:26.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:26 smithi017 ceph-mon[95536]: from='client.? 172.21.15.135:0/538951938' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T12:56:27.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:27 smithi135 ceph-mon[97338]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-07-14T12:56:27.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:27 smithi131 ceph-mon[96953]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-07-14T12:56:27.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:27 smithi017 ceph-mon[95536]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-07-14T12:56:30.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:29 smithi135 ceph-mon[97338]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-07-14T12:56:30.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:29 smithi131 ceph-mon[96953]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-07-14T12:56:30.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:29 smithi017 ceph-mon[95536]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-07-14T12:56:32.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:31 smithi135 ceph-mon[97338]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T12:56:32.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:31 smithi131 ceph-mon[96953]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T12:56:32.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:31 smithi017 ceph-mon[95536]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T12:56:34.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:33 smithi135 ceph-mon[97338]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2023-07-14T12:56:34.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:33 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-14T12:56:34.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:33 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:34.191 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:33 smithi135 ceph-mon[97338]: Deploying daemon osd.11 on smithi135 2023-07-14T12:56:34.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:33 smithi131 ceph-mon[96953]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2023-07-14T12:56:34.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:33 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-14T12:56:34.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:33 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:34.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:33 smithi131 ceph-mon[96953]: Deploying daemon osd.11 on smithi135 2023-07-14T12:56:34.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:33 smithi017 ceph-mon[95536]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2023-07-14T12:56:34.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:33 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-14T12:56:34.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:33 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:34.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:33 smithi017 ceph-mon[95536]: Deploying daemon osd.11 on smithi135 2023-07-14T12:56:36.159 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:35 smithi135 ceph-mon[97338]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:36.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:35 smithi131 ceph-mon[96953]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:36.353 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:35 smithi017 ceph-mon[95536]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:38.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:37 smithi135 ceph-mon[97338]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:38.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:37 smithi131 ceph-mon[96953]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:38.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:37 smithi017 ceph-mon[95536]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:40.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:39 smithi135 ceph-mon[97338]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:40.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:39 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:40.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:39 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:40.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:39 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:40.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:39 smithi131 ceph-mon[96953]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:40.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:39 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:40.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:39 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:40.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:39 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:40.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:39 smithi017 ceph-mon[95536]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:40.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:39 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:40.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:39 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:40.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:39 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:42.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:41 smithi135 ceph-mon[97338]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:42.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:41 smithi131 ceph-mon[96953]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:42.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:41 smithi017 ceph-mon[95536]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:42.991 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.962+0000 7f8bae7fc700 1 -- 172.21.15.135:0/3663521909 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f8bb81076f0 con 0x7f8ba40a11d0 2023-07-14T12:56:42.991 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 11 on host 'smithi135' 2023-07-14T12:56:42.993 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.965+0000 7f8bbf355700 1 -- 172.21.15.135:0/3663521909 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8ba40a11d0 msgr2=0x7f8ba40a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:42.993 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.965+0000 7f8bbf355700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8ba40a11d0 0x7f8ba40a3680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009c60 tx=0x7f8ba8009260 comp rx=0 tx=0).stop 2023-07-14T12:56:42.994 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.965+0000 7f8bbf355700 1 -- 172.21.15.135:0/3663521909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb80ffb90 msgr2=0x7f8bb8197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:42.994 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.965+0000 7f8bbf355700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb80ffb90 0x7f8bb8197aa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400d9b0 tx=0x7f8bb400dcc0 comp rx=0 tx=0).stop 2023-07-14T12:56:42.994 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.965+0000 7f8bbf355700 1 -- 172.21.15.135:0/3663521909 shutdown_connections 2023-07-14T12:56:42.994 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.965+0000 7f8bbf355700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8ba40a11d0 0x7f8ba40a3680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:42.994 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.965+0000 7f8bbf355700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb8101720 0x7f8bb819f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:42.995 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.965+0000 7f8bbf355700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb80ffb90 0x7f8bb8197aa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:42.995 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.965+0000 7f8bbf355700 1 --2- 172.21.15.135:0/3663521909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb8100d90 0x7f8bb8197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:42.995 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.965+0000 7f8bbf355700 1 -- 172.21.15.135:0/3663521909 >> 172.21.15.135:0/3663521909 conn(0x7f8bb80fb1a0 msgr2=0x7f8bb80fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:42.995 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.966+0000 7f8bbf355700 1 -- 172.21.15.135:0/3663521909 shutdown_connections 2023-07-14T12:56:42.995 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:42.966+0000 7f8bbf355700 1 -- 172.21.15.135:0/3663521909 wait complete. 2023-07-14T12:56:43.489 DEBUG:teuthology.orchestra.run.smithi135:osd.11> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.11.service 2023-07-14T12:56:43.496 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-07-14T12:56:43.497 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd stat -f json 2023-07-14T12:56:43.569 INFO:journalctl@ceph.osd.11.smithi135.stdout:-- Logs begin at Fri 2023-07-14 12:26:36 UTC. -- 2023-07-14T12:56:43.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:43.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:43.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:43 smithi017 ceph-mon[95536]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:43.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:43.855 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:43 smithi017 ceph-mon[95536]: from='osd.11 [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T12:56:43.856 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:43 smithi017 ceph-mon[95536]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T12:56:43.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:43.947 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:43.947 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.947 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:43 smithi135 ceph-mon[97338]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:43.947 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.948 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.948 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:43.948 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:43 smithi135 ceph-mon[97338]: from='osd.11 [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T12:56:43.949 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:43 smithi135 ceph-mon[97338]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T12:56:43.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:43.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:43.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:43 smithi131 ceph-mon[96953]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:43.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:43.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:43.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:43 smithi131 ceph-mon[96953]: from='osd.11 [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T12:56:43.996 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:43 smithi131 ceph-mon[96953]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T12:56:44.240 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:56:45.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:44 smithi017 ceph-mon[95536]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-07-14T12:56:45.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:44 smithi017 ceph-mon[95536]: osdmap e79: 12 total, 11 up, 12 in 2023-07-14T12:56:45.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:45.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:44 smithi017 ceph-mon[95536]: from='osd.11 [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:56:45.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:44 smithi017 ceph-mon[95536]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:56:45.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:44 smithi135 ceph-mon[97338]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-07-14T12:56:45.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:44 smithi135 ceph-mon[97338]: osdmap e79: 12 total, 11 up, 12 in 2023-07-14T12:56:45.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:45.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:44 smithi135 ceph-mon[97338]: from='osd.11 [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:56:45.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:44 smithi135 ceph-mon[97338]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:56:45.117 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 12:56:44 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T12:56:44.968+0000 7f6da82c3700 -1 osd.11 0 waiting for initial osdmap 2023-07-14T12:56:45.117 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 12:56:44 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T12:56:44.984+0000 7f6da20b4700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T12:56:45.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:44 smithi131 ceph-mon[96953]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-07-14T12:56:45.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:44 smithi131 ceph-mon[96953]: osdmap e79: 12 total, 11 up, 12 in 2023-07-14T12:56:45.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:45.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:44 smithi131 ceph-mon[96953]: from='osd.11 [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:56:45.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:44 smithi131 ceph-mon[96953]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2023-07-14T12:56:45.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.953+0000 7f4b60519700 1 -- 172.21.15.17:0/1350141560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b58074540 msgr2=0x7f4b580729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:45.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.953+0000 7f4b60519700 1 --2- 172.21.15.17:0/1350141560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b58074540 0x7f4b580729a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b540099c0 tx=0x7f4b54009cd0 comp rx=0 tx=0).stop 2023-07-14T12:56:45.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.953+0000 7f4b60519700 1 -- 172.21.15.17:0/1350141560 shutdown_connections 2023-07-14T12:56:45.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.953+0000 7f4b60519700 1 --2- 172.21.15.17:0/1350141560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b5810c170 0x7f4b5810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:45.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.953+0000 7f4b60519700 1 --2- 172.21.15.17:0/1350141560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b58074540 0x7f4b580729a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.953+0000 7f4b60519700 1 --2- 172.21.15.17:0/1350141560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b58072f70 0x7f4b580733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.953+0000 7f4b60519700 1 -- 172.21.15.17:0/1350141560 >> 172.21.15.17:0/1350141560 conn(0x7f4b580fb1a0 msgr2=0x7f4b580fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.954+0000 7f4b60519700 1 -- 172.21.15.17:0/1350141560 shutdown_connections 2023-07-14T12:56:45.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.954+0000 7f4b60519700 1 -- 172.21.15.17:0/1350141560 wait complete. 2023-07-14T12:56:45.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.955+0000 7f4b60519700 1 Processor -- start 2023-07-14T12:56:45.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.955+0000 7f4b60519700 1 -- start start 2023-07-14T12:56:45.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.955+0000 7f4b60519700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b58072f70 0x7f4b5819bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:45.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.955+0000 7f4b60519700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b58074540 0x7f4b5819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:45.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.955+0000 7f4b60519700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b5810c170 0x7f4b581a3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:45.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.955+0000 7f4b60519700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b581a3950 con 0x7f4b58072f70 2023-07-14T12:56:45.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.955+0000 7f4b60519700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b581a3a90 con 0x7f4b5810c170 2023-07-14T12:56:45.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.955+0000 7f4b60519700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b581a3c20 con 0x7f4b58074540 2023-07-14T12:56:45.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.955+0000 7f4b5e2b5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b58072f70 0x7f4b5819bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:45.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.955+0000 7f4b5e2b5700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b58072f70 0x7f4b5819bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55348/0 (socket says 172.21.15.17:55348) 2023-07-14T12:56:45.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.955+0000 7f4b5e2b5700 1 -- 172.21.15.17:0/4024878873 learned_addr learned my addr 172.21.15.17:0/4024878873 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:56:45.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.956+0000 7f4b5dab4700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b58074540 0x7f4b5819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:45.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.956+0000 7f4b5eab6700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b5810c170 0x7f4b581a3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:45.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.956+0000 7f4b5e2b5700 1 -- 172.21.15.17:0/4024878873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b58074540 msgr2=0x7f4b5819c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.956+0000 7f4b5e2b5700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b58074540 0x7f4b5819c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.956+0000 7f4b5e2b5700 1 -- 172.21.15.17:0/4024878873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b5810c170 msgr2=0x7f4b581a3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.956+0000 7f4b5e2b5700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b5810c170 0x7f4b581a3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.956+0000 7f4b5e2b5700 1 -- 172.21.15.17:0/4024878873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b540095f0 con 0x7f4b58072f70 2023-07-14T12:56:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.956+0000 7f4b5eab6700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b5810c170 0x7f4b581a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:56:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.956+0000 7f4b5e2b5700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b58072f70 0x7f4b5819bdc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400f690 tx=0x7f4b54005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:45.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.956+0000 7f4b4f7fe700 1 -- 172.21.15.17:0/4024878873 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5401d070 con 0x7f4b58072f70 2023-07-14T12:56:45.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.956+0000 7f4b4f7fe700 1 -- 172.21.15.17:0/4024878873 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b54005050 con 0x7f4b58072f70 2023-07-14T12:56:45.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.957+0000 7f4b60519700 1 -- 172.21.15.17:0/4024878873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b581a3ea0 con 0x7f4b58072f70 2023-07-14T12:56:45.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.957+0000 7f4b4f7fe700 1 -- 172.21.15.17:0/4024878873 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54004af0 con 0x7f4b58072f70 2023-07-14T12:56:45.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.957+0000 7f4b60519700 1 -- 172.21.15.17:0/4024878873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b581a4200 con 0x7f4b58072f70 2023-07-14T12:56:45.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.958+0000 7f4b60519700 1 -- 172.21.15.17:0/4024878873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b58101cc0 con 0x7f4b58072f70 2023-07-14T12:56:45.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.960+0000 7f4b4f7fe700 1 -- 172.21.15.17:0/4024878873 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4b540051c0 con 0x7f4b58072f70 2023-07-14T12:56:45.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.961+0000 7f4b4f7fe700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4b440a1150 0x7f4b440a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:45.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.961+0000 7f4b4f7fe700 1 -- 172.21.15.17:0/4024878873 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f4b540cd650 con 0x7f4b58072f70 2023-07-14T12:56:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.961+0000 7f4b5dab4700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4b440a1150 0x7f4b440a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.962+0000 7f4b5dab4700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4b440a1150 0x7f4b440a3600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009c60 tx=0x7f4b48009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:45.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:45.964+0000 7f4b4f7fe700 1 -- 172.21.15.17:0/4024878873 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4b54097350 con 0x7f4b58072f70 2023-07-14T12:56:46.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:45 smithi135 ceph-mon[97338]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:46.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:45 smithi135 ceph-mon[97338]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:56:46.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:45 smithi135 ceph-mon[97338]: osdmap e80: 12 total, 11 up, 12 in 2023-07-14T12:56:46.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:45 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:46.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:45 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.173+0000 7f4b60519700 1 -- 172.21.15.17:0/4024878873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4b5802caa0 con 0x7f4b58072f70 2023-07-14T12:56:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.174+0000 7f4b4f7fe700 1 -- 172.21.15.17:0/4024878873 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) v1 ==== 74+0+133 (secure 0 0 0) 0x7f4b5409a970 con 0x7f4b58072f70 2023-07-14T12:56:46.202 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:56:46.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 -- 172.21.15.17:0/4024878873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4b440a1150 msgr2=0x7f4b440a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:46.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4b440a1150 0x7f4b440a3600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009c60 tx=0x7f4b48009260 comp rx=0 tx=0).stop 2023-07-14T12:56:46.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 -- 172.21.15.17:0/4024878873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b58072f70 msgr2=0x7f4b5819bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:46.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b58072f70 0x7f4b5819bdc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400f690 tx=0x7f4b54005f10 comp rx=0 tx=0).stop 2023-07-14T12:56:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 -- 172.21.15.17:0/4024878873 shutdown_connections 2023-07-14T12:56:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4b440a1150 0x7f4b440a3600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b5810c170 0x7f4b581a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b58072f70 0x7f4b5819bdc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 --2- 172.21.15.17:0/4024878873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b58074540 0x7f4b5819c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 -- 172.21.15.17:0/4024878873 >> 172.21.15.17:0/4024878873 conn(0x7f4b580fb1a0 msgr2=0x7f4b580fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:46.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 -- 172.21.15.17:0/4024878873 shutdown_connections 2023-07-14T12:56:46.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:46.176+0000 7f4b60519700 1 -- 172.21.15.17:0/4024878873 wait complete. 2023-07-14T12:56:46.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:45 smithi017 ceph-mon[95536]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:46.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:45 smithi017 ceph-mon[95536]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:56:46.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:45 smithi017 ceph-mon[95536]: osdmap e80: 12 total, 11 up, 12 in 2023-07-14T12:56:46.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:45 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:46.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:45 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:46.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:45 smithi131 ceph-mon[96953]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-14T12:56:46.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:45 smithi131 ceph-mon[96953]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2023-07-14T12:56:46.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:45 smithi131 ceph-mon[96953]: osdmap e80: 12 total, 11 up, 12 in 2023-07-14T12:56:46.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:45 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:46.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:45 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:46.863 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1689339405,"num_in_osds":12,"osd_in_since":1689339385,"num_remapped_pgs":0} 2023-07-14T12:56:46.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd dump --format=json 2023-07-14T12:56:47.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: purged_snaps scrub starts 2023-07-14T12:56:47.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: purged_snaps scrub ok 2023-07-14T12:56:47.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: osd.11 [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404] boot 2023-07-14T12:56:47.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: osdmap e81: 12 total, 12 up, 12 in 2023-07-14T12:56:47.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:47.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/4024878873' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-14T12:56:47.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:47.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:47.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:46 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: purged_snaps scrub starts 2023-07-14T12:56:47.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: purged_snaps scrub ok 2023-07-14T12:56:47.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: osd.11 [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404] boot 2023-07-14T12:56:47.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: osdmap e81: 12 total, 12 up, 12 in 2023-07-14T12:56:47.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:47.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/4024878873' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-14T12:56:47.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:47.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:47.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:46 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: purged_snaps scrub starts 2023-07-14T12:56:47.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: purged_snaps scrub ok 2023-07-14T12:56:47.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: osd.11 [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404] boot 2023-07-14T12:56:47.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: osdmap e81: 12 total, 12 up, 12 in 2023-07-14T12:56:47.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:56:47.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/4024878873' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-14T12:56:47.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:56:47.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:47.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:47.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:46 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:56:48.208 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:47 smithi017 ceph-mon[95536]: Detected new or changed devices on smithi135 2023-07-14T12:56:48.208 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:47 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi135 to 4316M 2023-07-14T12:56:48.208 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:47 smithi017 ceph-mon[95536]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:48.208 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:47 smithi017 ceph-mon[95536]: osdmap e82: 12 total, 12 up, 12 in 2023-07-14T12:56:48.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:47 smithi135 ceph-mon[97338]: Detected new or changed devices on smithi135 2023-07-14T12:56:48.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:47 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi135 to 4316M 2023-07-14T12:56:48.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:47 smithi135 ceph-mon[97338]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:48.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:47 smithi135 ceph-mon[97338]: osdmap e82: 12 total, 12 up, 12 in 2023-07-14T12:56:48.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:47 smithi131 ceph-mon[96953]: Detected new or changed devices on smithi135 2023-07-14T12:56:48.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:47 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi135 to 4316M 2023-07-14T12:56:48.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:47 smithi131 ceph-mon[96953]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:48.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:47 smithi131 ceph-mon[96953]: osdmap e82: 12 total, 12 up, 12 in 2023-07-14T12:56:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.193+0000 7f8a8b61c700 1 -- 172.21.15.17:0/2771888804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a8410c3e0 msgr2=0x7f8a8410e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.193+0000 7f8a8b61c700 1 --2- 172.21.15.17:0/2771888804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a8410c3e0 0x7f8a8410e7c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00b0a0 tx=0x7f8a7c00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.193+0000 7f8a8b61c700 1 -- 172.21.15.17:0/2771888804 shutdown_connections 2023-07-14T12:56:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.193+0000 7f8a8b61c700 1 --2- 172.21.15.17:0/2771888804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a8410c3e0 0x7f8a8410e7c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.193+0000 7f8a8b61c700 1 --2- 172.21.15.17:0/2771888804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a840728b0 0x7f8a84072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.193+0000 7f8a8b61c700 1 --2- 172.21.15.17:0/2771888804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a840731c0 0x7f8a8410bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.193+0000 7f8a8b61c700 1 -- 172.21.15.17:0/2771888804 >> 172.21.15.17:0/2771888804 conn(0x7f8a840fb660 msgr2=0x7f8a840fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.194+0000 7f8a8b61c700 1 -- 172.21.15.17:0/2771888804 shutdown_connections 2023-07-14T12:56:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.194+0000 7f8a8b61c700 1 -- 172.21.15.17:0/2771888804 wait complete. 2023-07-14T12:56:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.194+0000 7f8a8b61c700 1 Processor -- start 2023-07-14T12:56:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.195+0000 7f8a8b61c700 1 -- start start 2023-07-14T12:56:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.195+0000 7f8a8b61c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a840728b0 0x7f8a84197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.195+0000 7f8a8b61c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a840731c0 0x7f8a84198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.195+0000 7f8a8b61c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8410c3e0 0x7f8a8419c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.195+0000 7f8a8b61c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8419cdf0 con 0x7f8a840728b0 2023-07-14T12:56:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.195+0000 7f8a8b61c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8419cf60 con 0x7f8a8410c3e0 2023-07-14T12:56:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.195+0000 7f8a8b61c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8419d120 con 0x7f8a840731c0 2023-07-14T12:56:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.195+0000 7f8a893b8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a840728b0 0x7f8a84197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.195+0000 7f8a893b8700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a840728b0 0x7f8a84197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55368/0 (socket says 172.21.15.17:55368) 2023-07-14T12:56:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.195+0000 7f8a893b8700 1 -- 172.21.15.17:0/3319984074 learned_addr learned my addr 172.21.15.17:0/3319984074 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:56:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.195+0000 7f8a89bb9700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8410c3e0 0x7f8a8419c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a88bb7700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a840731c0 0x7f8a84198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a893b8700 1 -- 172.21.15.17:0/3319984074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a840731c0 msgr2=0x7f8a84198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a893b8700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a840731c0 0x7f8a84198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a893b8700 1 -- 172.21.15.17:0/3319984074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8410c3e0 msgr2=0x7f8a8419c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a893b8700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8410c3e0 0x7f8a8419c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a893b8700 1 -- 172.21.15.17:0/3319984074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c009d00 con 0x7f8a840728b0 2023-07-14T12:56:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a893b8700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a840728b0 0x7f8a84197e30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000c9b0 tx=0x7f8a8000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a7a7fc700 1 -- 172.21.15.17:0/3319984074 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80007b00 con 0x7f8a840728b0 2023-07-14T12:56:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a7a7fc700 1 -- 172.21.15.17:0/3319984074 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a80007c60 con 0x7f8a840728b0 2023-07-14T12:56:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a8b61c700 1 -- 172.21.15.17:0/3319984074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8419d400 con 0x7f8a840728b0 2023-07-14T12:56:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a7a7fc700 1 -- 172.21.15.17:0/3319984074 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80018660 con 0x7f8a840728b0 2023-07-14T12:56:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.196+0000 7f8a8b61c700 1 -- 172.21.15.17:0/3319984074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a841a4c60 con 0x7f8a840728b0 2023-07-14T12:56:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.198+0000 7f8a8b61c700 1 -- 172.21.15.17:0/3319984074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8404e210 con 0x7f8a840728b0 2023-07-14T12:56:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.199+0000 7f8a7a7fc700 1 -- 172.21.15.17:0/3319984074 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8a8000f450 con 0x7f8a840728b0 2023-07-14T12:56:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.201+0000 7f8a7a7fc700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8a700a1150 0x7f8a700a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.201+0000 7f8a7a7fc700 1 -- 172.21.15.17:0/3319984074 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8a800cc530 con 0x7f8a840728b0 2023-07-14T12:56:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.201+0000 7f8a88bb7700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8a700a1150 0x7f8a700a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.202+0000 7f8a88bb7700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8a700a1150 0x7f8a700a3600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8a74005950 tx=0x7f8a740058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:49.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.204+0000 7f8a7a7fc700 1 -- 172.21.15.17:0/3319984074 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8a80096080 con 0x7f8a840728b0 2023-07-14T12:56:49.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.411+0000 7f8a8b61c700 1 -- 172.21.15.17:0/3319984074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a841a4f50 con 0x7f8a840728b0 2023-07-14T12:56:49.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.412+0000 7f8a7a7fc700 1 -- 172.21.15.17:0/3319984074 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18422 (secure 0 0 0) 0x7f8a8000fe60 con 0x7f8a840728b0 2023-07-14T12:56:49.440 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:56:49.441 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:56:46.971673+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:56:49.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.414+0000 7f8a8b61c700 1 -- 172.21.15.17:0/3319984074 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8a700a1150 msgr2=0x7f8a700a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:49.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.414+0000 7f8a8b61c700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8a700a1150 0x7f8a700a3600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8a74005950 tx=0x7f8a740058e0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.414+0000 7f8a8b61c700 1 -- 172.21.15.17:0/3319984074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a840728b0 msgr2=0x7f8a84197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.414+0000 7f8a8b61c700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a840728b0 0x7f8a84197e30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000c9b0 tx=0x7f8a8000ccc0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.414+0000 7f8a8b61c700 1 -- 172.21.15.17:0/3319984074 shutdown_connections 2023-07-14T12:56:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.414+0000 7f8a8b61c700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8a700a1150 0x7f8a700a3600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.414+0000 7f8a8b61c700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a8410c3e0 0x7f8a8419c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.414+0000 7f8a8b61c700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a840728b0 0x7f8a84197e30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.414+0000 7f8a8b61c700 1 --2- 172.21.15.17:0/3319984074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a840731c0 0x7f8a84198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:49.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.414+0000 7f8a8b61c700 1 -- 172.21.15.17:0/3319984074 >> 172.21.15.17:0/3319984074 conn(0x7f8a840fb660 msgr2=0x7f8a8410e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:49.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.415+0000 7f8a8b61c700 1 -- 172.21.15.17:0/3319984074 shutdown_connections 2023-07-14T12:56:49.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:49.415+0000 7f8a8b61c700 1 -- 172.21.15.17:0/3319984074 wait complete. 2023-07-14T12:56:49.980 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:56:49.981 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd pool get .mgr pg_num 2023-07-14T12:56:50.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:49 smithi017 ceph-mon[95536]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:50.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:49 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3319984074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:56:50.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:49 smithi135 ceph-mon[97338]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:50.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:49 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3319984074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:56:50.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:49 smithi131 ceph-mon[96953]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:50.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:49 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3319984074' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:56:50.711 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:56:52.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.212+0000 7ff2220cf700 1 -- 172.21.15.17:0/3403519962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff21c1007a0 msgr2=0x7ff21c104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:52.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.212+0000 7ff2220cf700 1 --2- 172.21.15.17:0/3403519962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff21c1007a0 0x7ff21c104770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff2100099c0 tx=0x7ff210009cd0 comp rx=0 tx=0).stop 2023-07-14T12:56:52.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.213+0000 7ff2220cf700 1 -- 172.21.15.17:0/3403519962 shutdown_connections 2023-07-14T12:56:52.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.213+0000 7ff2220cf700 1 --2- 172.21.15.17:0/3403519962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c104ea0 0x7ff21c10ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:52.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.213+0000 7ff2220cf700 1 --2- 172.21.15.17:0/3403519962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff21c0ffe00 0x7ff21c1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:52.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.213+0000 7ff2220cf700 1 --2- 172.21.15.17:0/3403519962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff21c1007a0 0x7ff21c104770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:52.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.213+0000 7ff2220cf700 1 -- 172.21.15.17:0/3403519962 >> 172.21.15.17:0/3403519962 conn(0x7ff21c0fb660 msgr2=0x7ff21c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:52.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.213+0000 7ff2220cf700 1 -- 172.21.15.17:0/3403519962 shutdown_connections 2023-07-14T12:56:52.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.213+0000 7ff2220cf700 1 -- 172.21.15.17:0/3403519962 wait complete. 2023-07-14T12:56:52.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.214+0000 7ff2220cf700 1 Processor -- start 2023-07-14T12:56:52.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.214+0000 7ff2220cf700 1 -- start start 2023-07-14T12:56:52.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.214+0000 7ff2220cf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c0ffe00 0x7ff21c19dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:52.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.214+0000 7ff2220cf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff21c1007a0 0x7ff21c19e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:52.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.214+0000 7ff2220cf700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff21c104ea0 0x7ff21c197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:52.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.214+0000 7ff2220cf700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c1981c0 con 0x7ff21c104ea0 2023-07-14T12:56:52.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.214+0000 7ff2220cf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c198330 con 0x7ff21c1007a0 2023-07-14T12:56:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.214+0000 7ff2220cf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c1984f0 con 0x7ff21c0ffe00 2023-07-14T12:56:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.214+0000 7ff21bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff21c104ea0 0x7ff21c197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.215+0000 7ff21bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff21c104ea0 0x7ff21c197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55392/0 (socket says 172.21.15.17:55392) 2023-07-14T12:56:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.215+0000 7ff21bfff700 1 -- 172.21.15.17:0/2469944243 learned_addr learned my addr 172.21.15.17:0/2469944243 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:56:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.215+0000 7ff21b7fe700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c0ffe00 0x7ff21c19dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.215+0000 7ff21affd700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff21c1007a0 0x7ff21c19e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.215+0000 7ff21bfff700 1 -- 172.21.15.17:0/2469944243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c0ffe00 msgr2=0x7ff21c19dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.215+0000 7ff21bfff700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c0ffe00 0x7ff21c19dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.215+0000 7ff21bfff700 1 -- 172.21.15.17:0/2469944243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff21c1007a0 msgr2=0x7ff21c19e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.215+0000 7ff21bfff700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff21c1007a0 0x7ff21c19e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.215+0000 7ff21bfff700 1 -- 172.21.15.17:0/2469944243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100095f0 con 0x7ff21c104ea0 2023-07-14T12:56:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.215+0000 7ff21bfff700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff21c104ea0 0x7ff21c197b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff214007d70 tx=0x7ff21400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.215+0000 7ff218ff9700 1 -- 172.21.15.17:0/2469944243 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400ad40 con 0x7ff21c104ea0 2023-07-14T12:56:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.216+0000 7ff218ff9700 1 -- 172.21.15.17:0/2469944243 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2140128b0 con 0x7ff21c104ea0 2023-07-14T12:56:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.216+0000 7ff2220cf700 1 -- 172.21.15.17:0/2469944243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21c1987d0 con 0x7ff21c104ea0 2023-07-14T12:56:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.216+0000 7ff218ff9700 1 -- 172.21.15.17:0/2469944243 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2140115a0 con 0x7ff21c104ea0 2023-07-14T12:56:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.216+0000 7ff2220cf700 1 -- 172.21.15.17:0/2469944243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21c1a4ac0 con 0x7ff21c104ea0 2023-07-14T12:56:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.217+0000 7ff2220cf700 1 -- 172.21.15.17:0/2469944243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21c04e210 con 0x7ff21c104ea0 2023-07-14T12:56:52.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.219+0000 7ff218ff9700 1 -- 172.21.15.17:0/2469944243 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff214012a20 con 0x7ff21c104ea0 2023-07-14T12:56:52.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.220+0000 7ff218ff9700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2040a1150 0x7ff2040a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:52.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.220+0000 7ff218ff9700 1 -- 172.21.15.17:0/2469944243 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff2140cc700 con 0x7ff21c104ea0 2023-07-14T12:56:52.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.220+0000 7ff21b7fe700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2040a1150 0x7ff2040a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:52.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.221+0000 7ff21b7fe700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2040a1150 0x7ff2040a3600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00ac50 tx=0x7ff20c00a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:52.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.225+0000 7ff218ff9700 1 -- 172.21.15.17:0/2469944243 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff214096250 con 0x7ff21c104ea0 2023-07-14T12:56:52.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:51 smithi017 ceph-mon[95536]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:52.445 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:51 smithi135 ceph-mon[97338]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:52.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.428+0000 7ff2220cf700 1 -- 172.21.15.17:0/2469944243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff21c1a4d50 con 0x7ff21c104ea0 2023-07-14T12:56:52.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.428+0000 7ff218ff9700 1 -- 172.21.15.17:0/2469944243 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff214099870 con 0x7ff21c104ea0 2023-07-14T12:56:52.457 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T12:56:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 -- 172.21.15.17:0/2469944243 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2040a1150 msgr2=0x7ff2040a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2040a1150 0x7ff2040a3600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00ac50 tx=0x7ff20c00a380 comp rx=0 tx=0).stop 2023-07-14T12:56:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 -- 172.21.15.17:0/2469944243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff21c104ea0 msgr2=0x7ff21c197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff21c104ea0 0x7ff21c197b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff214007d70 tx=0x7ff21400a340 comp rx=0 tx=0).stop 2023-07-14T12:56:52.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 -- 172.21.15.17:0/2469944243 shutdown_connections 2023-07-14T12:56:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2040a1150 0x7ff2040a3600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff21c104ea0 0x7ff21c197b50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff21c0ffe00 0x7ff21c19dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 --2- 172.21.15.17:0/2469944243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff21c1007a0 0x7ff21c19e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 -- 172.21.15.17:0/2469944243 >> 172.21.15.17:0/2469944243 conn(0x7ff21c0fb660 msgr2=0x7ff21c0fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:52.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 -- 172.21.15.17:0/2469944243 shutdown_connections 2023-07-14T12:56:52.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:52.431+0000 7ff2220cf700 1 -- 172.21.15.17:0/2469944243 wait complete. 2023-07-14T12:56:52.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:51 smithi131 ceph-mon[96953]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:52.895 INFO:tasks.cephadm:Adding mds.a on smithi017 2023-07-14T12:56:52.895 INFO:tasks.cephadm:Adding mds.d on smithi017 2023-07-14T12:56:52.896 INFO:tasks.cephadm:Adding mds.g on smithi017 2023-07-14T12:56:52.896 INFO:tasks.cephadm:Adding mds.j on smithi017 2023-07-14T12:56:52.896 INFO:tasks.cephadm:Adding mds.b on smithi131 2023-07-14T12:56:52.896 INFO:tasks.cephadm:Adding mds.e on smithi131 2023-07-14T12:56:52.897 INFO:tasks.cephadm:Adding mds.h on smithi131 2023-07-14T12:56:52.897 INFO:tasks.cephadm:Adding mds.k on smithi131 2023-07-14T12:56:52.897 INFO:tasks.cephadm:Adding mds.c on smithi135 2023-07-14T12:56:52.897 INFO:tasks.cephadm:Adding mds.f on smithi135 2023-07-14T12:56:52.897 INFO:tasks.cephadm:Adding mds.i on smithi135 2023-07-14T12:56:52.897 INFO:tasks.cephadm:Adding mds.l on smithi135 2023-07-14T12:56:52.898 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph orch apply mds all '12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l' 2023-07-14T12:56:53.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:52 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2469944243' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:56:53.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:52 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2469944243' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:56:53.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:52 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2469944243' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:56:53.631 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T12:56:54.195 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:53 smithi135 ceph-mon[97338]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:54.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:53 smithi017 ceph-mon[95536]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:54.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:53 smithi131 ceph-mon[96953]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:55.101 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.073+0000 7fe244e58700 1 -- 172.21.15.135:0/553072555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240107a60 msgr2=0x7fe240109ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:55.102 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.073+0000 7fe244e58700 1 --2- 172.21.15.135:0/553072555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240107a60 0x7fe240109ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe23800b0a0 tx=0x7fe23800b3b0 comp rx=0 tx=0).stop 2023-07-14T12:56:55.102 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.073+0000 7fe244e58700 1 -- 172.21.15.135:0/553072555 shutdown_connections 2023-07-14T12:56:55.102 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.073+0000 7fe244e58700 1 --2- 172.21.15.135:0/553072555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240107a60 0x7fe240109ea0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:55.102 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.073+0000 7fe244e58700 1 --2- 172.21.15.135:0/553072555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe240074540 0x7fe2400729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:55.102 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.073+0000 7fe244e58700 1 --2- 172.21.15.135:0/553072555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe240072f70 0x7fe2400733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:55.102 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.073+0000 7fe244e58700 1 -- 172.21.15.135:0/553072555 >> 172.21.15.135:0/553072555 conn(0x7fe2400fb1a0 msgr2=0x7fe2400fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:55.103 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.073+0000 7fe244e58700 1 -- 172.21.15.135:0/553072555 shutdown_connections 2023-07-14T12:56:55.103 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.073+0000 7fe244e58700 1 -- 172.21.15.135:0/553072555 wait complete. 2023-07-14T12:56:55.104 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.074+0000 7fe244e58700 1 Processor -- start 2023-07-14T12:56:55.104 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.074+0000 7fe244e58700 1 -- start start 2023-07-14T12:56:55.104 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe244e58700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe240072f70 0x7fe240197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:55.105 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe244e58700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240074540 0x7fe240197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:55.105 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe244e58700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe240107a60 0x7fe24019f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:55.105 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe244e58700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24019f630 con 0x7fe240072f70 2023-07-14T12:56:55.105 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe244e58700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24019f770 con 0x7fe240107a60 2023-07-14T12:56:55.105 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe244e58700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24019f900 con 0x7fe240074540 2023-07-14T12:56:55.105 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe23dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240074540 0x7fe240197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:55.105 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe23dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240074540 0x7fe240197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53420/0 (socket says 172.21.15.135:53420) 2023-07-14T12:56:55.106 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe23dd9b700 1 -- 172.21.15.135:0/3879370324 learned_addr learned my addr 172.21.15.135:0/3879370324 (peer_addr_for_me v2:172.21.15.135:0/0) 2023-07-14T12:56:55.106 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe23ed9d700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe240107a60 0x7fe24019f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:55.106 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe23e59c700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe240072f70 0x7fe240197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:55.106 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe23dd9b700 1 -- 172.21.15.135:0/3879370324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe240107a60 msgr2=0x7fe24019f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:55.106 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe23dd9b700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe240107a60 0x7fe24019f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:55.106 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe23dd9b700 1 -- 172.21.15.135:0/3879370324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe240072f70 msgr2=0x7fe240197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:55.106 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe23dd9b700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe240072f70 0x7fe240197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:55.106 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe23dd9b700 1 -- 172.21.15.135:0/3879370324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe238009d00 con 0x7fe240074540 2023-07-14T12:56:55.107 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.075+0000 7fe23e59c700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe240072f70 0x7fe240197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:56:55.107 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.076+0000 7fe23dd9b700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240074540 0x7fe240197fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe23400d980 tx=0x7fe23400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:55.107 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.076+0000 7fe22f7fe700 1 -- 172.21.15.135:0/3879370324 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234009b40 con 0x7fe240074540 2023-07-14T12:56:55.107 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.076+0000 7fe22f7fe700 1 -- 172.21.15.135:0/3879370324 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe23400b6e0 con 0x7fe240074540 2023-07-14T12:56:55.107 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.076+0000 7fe244e58700 1 -- 172.21.15.135:0/3879370324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24019fbe0 con 0x7fe240074540 2023-07-14T12:56:55.107 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.076+0000 7fe22f7fe700 1 -- 172.21.15.135:0/3879370324 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400f3c0 con 0x7fe240074540 2023-07-14T12:56:55.107 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.076+0000 7fe244e58700 1 -- 172.21.15.135:0/3879370324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2401a00e0 con 0x7fe240074540 2023-07-14T12:56:55.108 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.077+0000 7fe244e58700 1 -- 172.21.15.135:0/3879370324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe240106110 con 0x7fe240074540 2023-07-14T12:56:55.108 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.079+0000 7fe22f7fe700 1 -- 172.21.15.135:0/3879370324 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe234010460 con 0x7fe240074540 2023-07-14T12:56:55.109 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.081+0000 7fe22f7fe700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe2280a1150 0x7fe2280a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:55.109 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.081+0000 7fe22f7fe700 1 -- 172.21.15.135:0/3879370324 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe2340cc430 con 0x7fe240074540 2023-07-14T12:56:55.109 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.081+0000 7fe23e59c700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe2280a1150 0x7fe2280a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:55.110 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.082+0000 7fe23e59c700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe2280a1150 0x7fe2280a3600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe23000bc10 tx=0x7fe23000b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:55.111 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.083+0000 7fe22f7fe700 1 -- 172.21.15.135:0/3879370324 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe234095f80 con 0x7fe240074540 2023-07-14T12:56:55.315 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.286+0000 7fe244e58700 1 -- 172.21.15.135:0/3879370324 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fe240060c10 con 0x7fe2280a1150 2023-07-14T12:56:55.323 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.295+0000 7fe22f7fe700 1 -- 172.21.15.135:0/3879370324 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fe240060c10 con 0x7fe2280a1150 2023-07-14T12:56:55.323 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mds.all update... 2023-07-14T12:56:55.326 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 -- 172.21.15.135:0/3879370324 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe2280a1150 msgr2=0x7fe2280a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:55.326 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe2280a1150 0x7fe2280a3600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe23000bc10 tx=0x7fe23000b5f0 comp rx=0 tx=0).stop 2023-07-14T12:56:55.326 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 -- 172.21.15.135:0/3879370324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240074540 msgr2=0x7fe240197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:55.326 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240074540 0x7fe240197fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe23400d980 tx=0x7fe23400dc90 comp rx=0 tx=0).stop 2023-07-14T12:56:55.327 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 -- 172.21.15.135:0/3879370324 shutdown_connections 2023-07-14T12:56:55.327 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe2280a1150 0x7fe2280a3600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:55.327 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe240107a60 0x7fe24019f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:55.328 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe240072f70 0x7fe240197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:55.328 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 --2- 172.21.15.135:0/3879370324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe240074540 0x7fe240197fe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:55.328 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 -- 172.21.15.135:0/3879370324 >> 172.21.15.135:0/3879370324 conn(0x7fe2400fb1a0 msgr2=0x7fe2400fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:55.328 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 -- 172.21.15.135:0/3879370324 shutdown_connections 2023-07-14T12:56:55.328 INFO:teuthology.orchestra.run.smithi135.stderr:2023-07-14T12:56:55.298+0000 7fe244e58700 1 -- 172.21.15.135:0/3879370324 wait complete. 2023-07-14T12:56:55.799 DEBUG:teuthology.orchestra.run.smithi017:mds.a> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.a.service 2023-07-14T12:56:55.804 DEBUG:teuthology.orchestra.run.smithi017:mds.d> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.d.service 2023-07-14T12:56:55.851 DEBUG:teuthology.orchestra.run.smithi017:mds.g> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.g.service 2023-07-14T12:56:55.887 INFO:journalctl@ceph.mds.a.smithi017.stdout:-- Logs begin at Fri 2023-07-14 12:26:45 UTC. -- 2023-07-14T12:56:55.891 DEBUG:teuthology.orchestra.run.smithi017:mds.j> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.j.service 2023-07-14T12:56:55.926 INFO:journalctl@ceph.mds.d.smithi017.stdout:-- Logs begin at Fri 2023-07-14 12:26:45 UTC. -- 2023-07-14T12:56:55.929 DEBUG:teuthology.orchestra.run.smithi131:mds.b> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.b.service 2023-07-14T12:56:55.934 DEBUG:teuthology.orchestra.run.smithi131:mds.e> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.e.service 2023-07-14T12:56:55.964 INFO:journalctl@ceph.mds.g.smithi017.stdout:-- Logs begin at Fri 2023-07-14 12:26:45 UTC. -- 2023-07-14T12:56:55.980 DEBUG:teuthology.orchestra.run.smithi131:mds.h> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.h.service 2023-07-14T12:56:56.000 INFO:journalctl@ceph.mds.j.smithi017.stdout:-- Logs begin at Fri 2023-07-14 12:26:45 UTC. -- 2023-07-14T12:56:56.007 INFO:journalctl@ceph.mds.b.smithi131.stdout:-- Logs begin at Fri 2023-07-14 12:26:41 UTC. -- 2023-07-14T12:56:56.010 DEBUG:teuthology.orchestra.run.smithi131:mds.k> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.k.service 2023-07-14T12:56:56.056 DEBUG:teuthology.orchestra.run.smithi135:mds.c> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.c.service 2023-07-14T12:56:56.057 INFO:journalctl@ceph.mds.e.smithi131.stdout:-- Logs begin at Fri 2023-07-14 12:26:41 UTC. -- 2023-07-14T12:56:56.062 DEBUG:teuthology.orchestra.run.smithi135:mds.f> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.f.service 2023-07-14T12:56:56.085 INFO:journalctl@ceph.mds.h.smithi131.stdout:-- Logs begin at Fri 2023-07-14 12:26:41 UTC. -- 2023-07-14T12:56:56.106 DEBUG:teuthology.orchestra.run.smithi135:mds.i> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.i.service 2023-07-14T12:56:56.125 INFO:journalctl@ceph.mds.k.smithi131.stdout:-- Logs begin at Fri 2023-07-14 12:26:41 UTC. -- 2023-07-14T12:56:56.134 INFO:journalctl@ceph.mds.c.smithi135.stdout:-- Logs begin at Fri 2023-07-14 12:26:36 UTC. -- 2023-07-14T12:56:56.137 DEBUG:teuthology.orchestra.run.smithi135:mds.l> sudo journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.l.service 2023-07-14T12:56:56.175 INFO:journalctl@ceph.mds.f.smithi135.stdout:-- Logs begin at Fri 2023-07-14 12:26:36 UTC. -- 2023-07-14T12:56:56.178 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-07-14T12:56:56.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:56:56.206 INFO:journalctl@ceph.mds.i.smithi135.stdout:-- Logs begin at Fri 2023-07-14 12:26:36 UTC. -- 2023-07-14T12:56:56.242 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:55 smithi017 ceph-mon[95536]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:56.242 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:55 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:56.242 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:55 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:56.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:55 smithi131 ceph-mon[96953]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:56.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:55 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:56.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:55 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:56.247 INFO:journalctl@ceph.mds.l.smithi135.stdout:-- Logs begin at Fri 2023-07-14 12:26:36 UTC. -- 2023-07-14T12:56:56.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.382+0000 7ff22f3ff700 1 -- 172.21.15.17:0/37367882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff228100cf0 msgr2=0x7ff228101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:56.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.382+0000 7ff22f3ff700 1 --2- 172.21.15.17:0/37367882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff228100cf0 0x7ff228101140 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff218009990 tx=0x7ff218009ca0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.382+0000 7ff22f3ff700 1 -- 172.21.15.17:0/37367882 shutdown_connections 2023-07-14T12:56:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.382+0000 7ff22f3ff700 1 --2- 172.21.15.17:0/37367882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228101680 0x7ff228107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.382+0000 7ff22f3ff700 1 --2- 172.21.15.17:0/37367882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2280ffb00 0x7ff2280fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.382+0000 7ff22f3ff700 1 --2- 172.21.15.17:0/37367882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff228100cf0 0x7ff228101140 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.382+0000 7ff22f3ff700 1 -- 172.21.15.17:0/37367882 >> 172.21.15.17:0/37367882 conn(0x7ff2280fb0e0 msgr2=0x7ff2280fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.382+0000 7ff22f3ff700 1 -- 172.21.15.17:0/37367882 shutdown_connections 2023-07-14T12:56:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.382+0000 7ff22f3ff700 1 -- 172.21.15.17:0/37367882 wait complete. 2023-07-14T12:56:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.383+0000 7ff22f3ff700 1 Processor -- start 2023-07-14T12:56:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.383+0000 7ff22f3ff700 1 -- start start 2023-07-14T12:56:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.383+0000 7ff22f3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2280ffb00 0x7ff228197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.383+0000 7ff22f3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228100cf0 0x7ff228197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22f3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff228101680 0x7ff22819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22f3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22819f4b0 con 0x7ff2280ffb00 2023-07-14T12:56:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22f3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22819f5f0 con 0x7ff228101680 2023-07-14T12:56:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22f3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22819f780 con 0x7ff228100cf0 2023-07-14T12:56:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22d19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2280ffb00 0x7ff228197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22d19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2280ffb00 0x7ff228197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41538/0 (socket says 172.21.15.17:41538) 2023-07-14T12:56:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22d19b700 1 -- 172.21.15.17:0/1541695873 learned_addr learned my addr 172.21.15.17:0/1541695873 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:56:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22c99a700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228100cf0 0x7ff228197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22d99c700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff228101680 0x7ff22819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22d19b700 1 -- 172.21.15.17:0/1541695873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228100cf0 msgr2=0x7ff228197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22d19b700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228100cf0 0x7ff228197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22d19b700 1 -- 172.21.15.17:0/1541695873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff228101680 msgr2=0x7ff22819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:56.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22d19b700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff228101680 0x7ff22819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22d19b700 1 -- 172.21.15.17:0/1541695873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2180095f0 con 0x7ff2280ffb00 2023-07-14T12:56:56.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22c99a700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228100cf0 0x7ff228197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:56:56.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.384+0000 7ff22d19b700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2280ffb00 0x7ff228197930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff22400d980 tx=0x7ff22400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:56.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.385+0000 7ff21e7fc700 1 -- 172.21.15.17:0/1541695873 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224004020 con 0x7ff2280ffb00 2023-07-14T12:56:56.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.385+0000 7ff21e7fc700 1 -- 172.21.15.17:0/1541695873 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff224009730 con 0x7ff2280ffb00 2023-07-14T12:56:56.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.385+0000 7ff21e7fc700 1 -- 172.21.15.17:0/1541695873 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224003a00 con 0x7ff2280ffb00 2023-07-14T12:56:56.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.385+0000 7ff22f3ff700 1 -- 172.21.15.17:0/1541695873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22819fa60 con 0x7ff2280ffb00 2023-07-14T12:56:56.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.385+0000 7ff22f3ff700 1 -- 172.21.15.17:0/1541695873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22819ff70 con 0x7ff2280ffb00 2023-07-14T12:56:56.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.386+0000 7ff22f3ff700 1 -- 172.21.15.17:0/1541695873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff228192090 con 0x7ff2280ffb00 2023-07-14T12:56:56.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.388+0000 7ff21e7fc700 1 -- 172.21.15.17:0/1541695873 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff2240098a0 con 0x7ff2280ffb00 2023-07-14T12:56:56.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.389+0000 7ff21e7fc700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2140a1220 0x7ff2140a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:56.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.389+0000 7ff21e7fc700 1 -- 172.21.15.17:0/1541695873 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff2240cc180 con 0x7ff2280ffb00 2023-07-14T12:56:56.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.389+0000 7ff22c99a700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2140a1220 0x7ff2140a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:56.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.390+0000 7ff22c99a700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2140a1220 0x7ff2140a36d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff218006010 tx=0x7ff21800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:56.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.393+0000 7ff21e7fc700 1 -- 172.21.15.17:0/1541695873 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff224095cd0 con 0x7ff2280ffb00 2023-07-14T12:56:56.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:55 smithi135 ceph-mon[97338]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:56.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:55 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:56.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:55 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:56:56.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.603+0000 7ff22f3ff700 1 -- 172.21.15.17:0/1541695873 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff22802c850 con 0x7ff2280ffb00 2023-07-14T12:56:56.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.604+0000 7ff21e7fc700 1 -- 172.21.15.17:0/1541695873 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18422 (secure 0 0 0) 0x7ff2240232f0 con 0x7ff2280ffb00 2023-07-14T12:56:56.633 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:56:56.633 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:56:46.971673+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:56:56.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.606+0000 7ff22f3ff700 1 -- 172.21.15.17:0/1541695873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2140a1220 msgr2=0x7ff2140a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:56.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.606+0000 7ff22f3ff700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2140a1220 0x7ff2140a36d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff218006010 tx=0x7ff21800b260 comp rx=0 tx=0).stop 2023-07-14T12:56:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.606+0000 7ff22f3ff700 1 -- 172.21.15.17:0/1541695873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2280ffb00 msgr2=0x7ff228197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.606+0000 7ff22f3ff700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2280ffb00 0x7ff228197930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff22400d980 tx=0x7ff22400dc90 comp rx=0 tx=0).stop 2023-07-14T12:56:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.606+0000 7ff22f3ff700 1 -- 172.21.15.17:0/1541695873 shutdown_connections 2023-07-14T12:56:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.606+0000 7ff22f3ff700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff2140a1220 0x7ff2140a36d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.606+0000 7ff22f3ff700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff228101680 0x7ff22819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.606+0000 7ff22f3ff700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2280ffb00 0x7ff228197930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.606+0000 7ff22f3ff700 1 --2- 172.21.15.17:0/1541695873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff228100cf0 0x7ff228197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.606+0000 7ff22f3ff700 1 -- 172.21.15.17:0/1541695873 >> 172.21.15.17:0/1541695873 conn(0x7ff2280fb0e0 msgr2=0x7ff2281065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.606+0000 7ff22f3ff700 1 -- 172.21.15.17:0/1541695873 shutdown_connections 2023-07-14T12:56:56.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.607+0000 7ff22f3ff700 1 -- 172.21.15.17:0/1541695873 wait complete. 2023-07-14T12:56:56.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:56:56.655 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:56:56.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.835+0000 7f49751ff700 1 -- 172.21.15.17:0/751675960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4970101670 msgr2=0x7f4970107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.835+0000 7f49751ff700 1 --2- 172.21.15.17:0/751675960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4970101670 0x7f4970107f30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f496800b0a0 tx=0x7f496800b3b0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.835+0000 7f49751ff700 1 -- 172.21.15.17:0/751675960 shutdown_connections 2023-07-14T12:56:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.835+0000 7f49751ff700 1 --2- 172.21.15.17:0/751675960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4970101670 0x7f4970107f30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.835+0000 7f49751ff700 1 --2- 172.21.15.17:0/751675960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49700ffaf0 0x7f49700fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.835+0000 7f49751ff700 1 --2- 172.21.15.17:0/751675960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4970100ce0 0x7f4970101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.835+0000 7f49751ff700 1 -- 172.21.15.17:0/751675960 >> 172.21.15.17:0/751675960 conn(0x7f49700fb130 msgr2=0x7f49700fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.835+0000 7f49751ff700 1 -- 172.21.15.17:0/751675960 shutdown_connections 2023-07-14T12:56:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.835+0000 7f49751ff700 1 -- 172.21.15.17:0/751675960 wait complete. 2023-07-14T12:56:56.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.836+0000 7f49751ff700 1 Processor -- start 2023-07-14T12:56:56.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.836+0000 7f49751ff700 1 -- start start 2023-07-14T12:56:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f49751ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49700ffaf0 0x7f49700742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f49751ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4970100ce0 0x7f4970072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f49751ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4970101670 0x7f4970072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f49751ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49700735e0 con 0x7f4970101670 2023-07-14T12:56:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f49751ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4970073750 con 0x7f4970100ce0 2023-07-14T12:56:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f49751ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497019f8e0 con 0x7f49700ffaf0 2023-07-14T12:56:56.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f496f59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4970101670 0x7f4970072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f496ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49700ffaf0 0x7f49700742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f496f59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4970101670 0x7f4970072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41568/0 (socket says 172.21.15.17:41568) 2023-07-14T12:56:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f496f59e700 1 -- 172.21.15.17:0/304111634 learned_addr learned my addr 172.21.15.17:0/304111634 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:56:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f496e59c700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4970100ce0 0x7f4970072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f496f59e700 1 -- 172.21.15.17:0/304111634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49700ffaf0 msgr2=0x7f49700742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f496f59e700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49700ffaf0 0x7f49700742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f496f59e700 1 -- 172.21.15.17:0/304111634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4970100ce0 msgr2=0x7f4970072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:56.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f496f59e700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4970100ce0 0x7f4970072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.837+0000 7f496f59e700 1 -- 172.21.15.17:0/304111634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4968009d00 con 0x7f4970101670 2023-07-14T12:56:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.838+0000 7f496f59e700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4970101670 0x7f4970072e40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4968009fd0 tx=0x7f496800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.838+0000 7f4957fff700 1 -- 172.21.15.17:0/304111634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496800e040 con 0x7f4970101670 2023-07-14T12:56:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.838+0000 7f4957fff700 1 -- 172.21.15.17:0/304111634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4968007760 con 0x7f4970101670 2023-07-14T12:56:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.838+0000 7f49751ff700 1 -- 172.21.15.17:0/304111634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497019fb60 con 0x7f4970101670 2023-07-14T12:56:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.838+0000 7f4957fff700 1 -- 172.21.15.17:0/304111634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496801b6c0 con 0x7f4970101670 2023-07-14T12:56:56.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.838+0000 7f49751ff700 1 -- 172.21.15.17:0/304111634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497019ff80 con 0x7f4970101670 2023-07-14T12:56:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.839+0000 7f49751ff700 1 -- 172.21.15.17:0/304111634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4970107020 con 0x7f4970101670 2023-07-14T12:56:56.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.841+0000 7f4957fff700 1 -- 172.21.15.17:0/304111634 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f496801d470 con 0x7f4970101670 2023-07-14T12:56:56.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.843+0000 7f4957fff700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f49580a11d0 0x7f49580a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.844+0000 7f4957fff700 1 -- 172.21.15.17:0/304111634 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f49680cd750 con 0x7f4970101670 2023-07-14T12:56:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.844+0000 7f496ed9d700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f49580a11d0 0x7f49580a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:56.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.844+0000 7f496ed9d700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f49580a11d0 0x7f49580a3680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4970100b40 tx=0x7f496000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:56.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:56.847+0000 7f4957fff700 1 -- 172.21.15.17:0/304111634 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4968097330 con 0x7f4970101670 2023-07-14T12:56:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.057+0000 7f49751ff700 1 -- 172.21.15.17:0/304111634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49700611c0 con 0x7f4970101670 2023-07-14T12:56:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.057+0000 7f4957fff700 1 -- 172.21.15.17:0/304111634 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f496809a950 con 0x7f4970101670 2023-07-14T12:56:57.086 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T12:56:57.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 -- 172.21.15.17:0/304111634 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f49580a11d0 msgr2=0x7f49580a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:57.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f49580a11d0 0x7f49580a3680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4970100b40 tx=0x7f496000b410 comp rx=0 tx=0).stop 2023-07-14T12:56:57.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 -- 172.21.15.17:0/304111634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4970101670 msgr2=0x7f4970072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:57.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4970101670 0x7f4970072e40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4968009fd0 tx=0x7f496800bc80 comp rx=0 tx=0).stop 2023-07-14T12:56:57.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 -- 172.21.15.17:0/304111634 shutdown_connections 2023-07-14T12:56:57.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f49580a11d0 0x7f49580a3680 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4970101670 0x7f4970072e40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49700ffaf0 0x7f49700742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 --2- 172.21.15.17:0/304111634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4970100ce0 0x7f4970072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 -- 172.21.15.17:0/304111634 >> 172.21.15.17:0/304111634 conn(0x7f49700fb130 msgr2=0x7f4970104160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:57.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 -- 172.21.15.17:0/304111634 shutdown_connections 2023-07-14T12:56:57.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.060+0000 7f49751ff700 1 -- 172.21.15.17:0/304111634 wait complete. 2023-07-14T12:56:57.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:56:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.283+0000 7f028c5ff700 1 -- 172.21.15.17:0/1241844196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0284101680 msgr2=0x7f0284107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.283+0000 7f028c5ff700 1 --2- 172.21.15.17:0/1241844196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0284101680 0x7f0284107f40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f027c00b0a0 tx=0x7f027c00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.283+0000 7f028c5ff700 1 -- 172.21.15.17:0/1241844196 shutdown_connections 2023-07-14T12:56:57.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.283+0000 7f028c5ff700 1 --2- 172.21.15.17:0/1241844196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0284101680 0x7f0284107f40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.283+0000 7f028c5ff700 1 --2- 172.21.15.17:0/1241844196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02840ffb00 0x7f02840fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.283+0000 7f028c5ff700 1 --2- 172.21.15.17:0/1241844196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0284100cf0 0x7f0284101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.283+0000 7f028c5ff700 1 -- 172.21.15.17:0/1241844196 >> 172.21.15.17:0/1241844196 conn(0x7f02840fb0e0 msgr2=0x7f02840fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.283+0000 7f028c5ff700 1 -- 172.21.15.17:0/1241844196 shutdown_connections 2023-07-14T12:56:57.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.283+0000 7f028c5ff700 1 -- 172.21.15.17:0/1241844196 wait complete. 2023-07-14T12:56:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.284+0000 7f028c5ff700 1 Processor -- start 2023-07-14T12:56:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.284+0000 7f028c5ff700 1 -- start start 2023-07-14T12:56:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.284+0000 7f028c5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02840ffb00 0x7f02840742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.284+0000 7f028c5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0284100cf0 0x7f0284072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028c5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284101680 0x7f0284072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:57.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028c5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02840735e0 con 0x7f02840ffb00 2023-07-14T12:56:57.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028c5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0284073750 con 0x7f0284101680 2023-07-14T12:56:57.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028c5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028419f920 con 0x7f0284100cf0 2023-07-14T12:56:57.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02840ffb00 0x7f02840742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:57.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02840ffb00 0x7f02840742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41584/0 (socket says 172.21.15.17:41584) 2023-07-14T12:56:57.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028a39b700 1 -- 172.21.15.17:0/2745684056 learned_addr learned my addr 172.21.15.17:0/2745684056 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:56:57.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f0289b9a700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0284100cf0 0x7f0284072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:57.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028ab9c700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284101680 0x7f0284072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:57.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028a39b700 1 -- 172.21.15.17:0/2745684056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0284100cf0 msgr2=0x7f0284072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:57.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028a39b700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0284100cf0 0x7f0284072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028a39b700 1 -- 172.21.15.17:0/2745684056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284101680 msgr2=0x7f0284072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:57.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028a39b700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284101680 0x7f0284072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028a39b700 1 -- 172.21.15.17:0/2745684056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c009d00 con 0x7f02840ffb00 2023-07-14T12:56:57.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028ab9c700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284101680 0x7f0284072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:56:57.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f028a39b700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02840ffb00 0x7f02840742c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f028000e970 tx=0x7f028000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:57.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.285+0000 7f027b7fe700 1 -- 172.21.15.17:0/2745684056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280009790 con 0x7f02840ffb00 2023-07-14T12:56:57.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.286+0000 7f027b7fe700 1 -- 172.21.15.17:0/2745684056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f028000eec0 con 0x7f02840ffb00 2023-07-14T12:56:57.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.286+0000 7f028c5ff700 1 -- 172.21.15.17:0/2745684056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028419fc00 con 0x7f02840ffb00 2023-07-14T12:56:57.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.286+0000 7f027b7fe700 1 -- 172.21.15.17:0/2745684056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0280003c10 con 0x7f02840ffb00 2023-07-14T12:56:57.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.286+0000 7f028c5ff700 1 -- 172.21.15.17:0/2745684056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02841a0160 con 0x7f02840ffb00 2023-07-14T12:56:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.287+0000 7f028c5ff700 1 -- 172.21.15.17:0/2745684056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0284107040 con 0x7f02840ffb00 2023-07-14T12:56:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.289+0000 7f027b7fe700 1 -- 172.21.15.17:0/2745684056 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0280003db0 con 0x7f02840ffb00 2023-07-14T12:56:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.290+0000 7f027b7fe700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f02700a1220 0x7f02700a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.290+0000 7f027b7fe700 1 -- 172.21.15.17:0/2745684056 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0280014070 con 0x7f02840ffb00 2023-07-14T12:56:57.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.290+0000 7f0289b9a700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f02700a1220 0x7f02700a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:57.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.291+0000 7f0289b9a700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f02700a1220 0x7f02700a36d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0274009be0 tx=0x7f0274009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:57.320 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:56 smithi135 ceph-mon[97338]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:56:57.321 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:56 smithi135 ceph-mon[97338]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2023-07-14T12:56:57.321 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:56 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:57.321 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:56 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:57.321 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:56 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:57.321 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:56 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:56:57.321 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:56 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:56:57.321 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:56 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:57.321 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:56 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1541695873' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:56:57.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.294+0000 7f027b7fe700 1 -- 172.21.15.17:0/2745684056 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0280096260 con 0x7f02840ffb00 2023-07-14T12:56:57.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:56 smithi017 ceph-mon[95536]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:56:57.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:56 smithi017 ceph-mon[95536]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2023-07-14T12:56:57.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:56 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:57.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:56 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:57.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:56 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:57.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:56 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:56:57.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:56 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:56:57.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:56 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:57.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:56 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1541695873' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:56:57.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:56 smithi131 ceph-mon[96953]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:56:57.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:56 smithi131 ceph-mon[96953]: Saving service mds.all spec with placement smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2023-07-14T12:56:57.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:56 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:57.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:56 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:56:57.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:56 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:56:57.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:56 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:56:57.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:56 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:56:57.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:56 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:56:57.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:56 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1541695873' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:56:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.551+0000 7f028c5ff700 1 -- 172.21.15.17:0/2745684056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f028419fd90 con 0x7f02840ffb00 2023-07-14T12:56:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.551+0000 7f027b7fe700 1 -- 172.21.15.17:0/2745684056 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f028419fd90 con 0x7f02840ffb00 2023-07-14T12:56:57.579 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:56:57.580 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-07-14T12:56:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 -- 172.21.15.17:0/2745684056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f02700a1220 msgr2=0x7f02700a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f02700a1220 0x7f02700a36d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0274009be0 tx=0x7f0274009260 comp rx=0 tx=0).stop 2023-07-14T12:56:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 -- 172.21.15.17:0/2745684056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02840ffb00 msgr2=0x7f02840742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02840ffb00 0x7f02840742c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f028000e970 tx=0x7f028000ec80 comp rx=0 tx=0).stop 2023-07-14T12:56:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 -- 172.21.15.17:0/2745684056 shutdown_connections 2023-07-14T12:56:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f02700a1220 0x7f02700a36d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0284101680 0x7f0284072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02840ffb00 0x7f02840742c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 --2- 172.21.15.17:0/2745684056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0284100cf0 0x7f0284072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:57.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 -- 172.21.15.17:0/2745684056 >> 172.21.15.17:0/2745684056 conn(0x7f02840fb0e0 msgr2=0x7f0284104180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:57.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 -- 172.21.15.17:0/2745684056 shutdown_connections 2023-07-14T12:56:57.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:57.554+0000 7f028c5ff700 1 -- 172.21.15.17:0/2745684056 wait complete. 2023-07-14T12:56:57.584 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2023-07-14T12:56:58.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:57 smithi017 ceph-mon[95536]: Deploying daemon mds.l on smithi135 2023-07-14T12:56:58.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:57 smithi017 ceph-mon[95536]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:58.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:57 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/304111634' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:56:58.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:56:57 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2745684056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:56:58.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:58 smithi135 ceph-mon[97338]: Deploying daemon mds.l on smithi135 2023-07-14T12:56:58.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:58 smithi135 ceph-mon[97338]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:58.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:58 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/304111634' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:56:58.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:56:58 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2745684056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:56:58.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:58 smithi131 ceph-mon[96953]: Deploying daemon mds.l on smithi135 2023-07-14T12:56:58.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:58 smithi131 ceph-mon[96953]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:56:58.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:58 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/304111634' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:56:58.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:56:58 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2745684056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:56:58.946 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 12:56:58 smithi135 systemd[1]: Starting Ceph mds.l for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:56:59.270 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 12:56:58 smithi135 podman[122632]: 2023-07-14T12:56:59.270 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 12:56:59 smithi135 bash[122632]: 20307eb6194fc6bc3e5420084a00f08cce3ff0ff14b3f1f8cdf473e24ab9e293 2023-07-14T12:56:59.270 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 12:56:59 smithi135 ceph-mds[122672]: -- 172.21.15.135:0/1956314348 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563556d7b1e0 con 0x563556d50800 2023-07-14T12:56:59.271 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 12:56:59 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-l[122648]: starting mds.l at 2023-07-14T12:56:59.602 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:56:59.696 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 12:56:59 smithi135 systemd[1]: Started Ceph mds.l for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:56:59.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.788+0000 7f249f1ff700 1 -- 172.21.15.17:0/1066321074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24980ffb00 msgr2=0x7f24980fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:59.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.788+0000 7f249f1ff700 1 --2- 172.21.15.17:0/1066321074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24980ffb00 0x7f24980fff10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f248c009990 tx=0x7f248c009ca0 comp rx=0 tx=0).stop 2023-07-14T12:56:59.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.789+0000 7f249f1ff700 1 -- 172.21.15.17:0/1066321074 shutdown_connections 2023-07-14T12:56:59.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.789+0000 7f249f1ff700 1 --2- 172.21.15.17:0/1066321074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2498101680 0x7f2498107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:59.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.789+0000 7f249f1ff700 1 --2- 172.21.15.17:0/1066321074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24980ffb00 0x7f24980fff10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:59.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.789+0000 7f249f1ff700 1 --2- 172.21.15.17:0/1066321074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2498100cf0 0x7f2498101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:59.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.789+0000 7f249f1ff700 1 -- 172.21.15.17:0/1066321074 >> 172.21.15.17:0/1066321074 conn(0x7f24980fb0e0 msgr2=0x7f24980fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:56:59.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.789+0000 7f249f1ff700 1 -- 172.21.15.17:0/1066321074 shutdown_connections 2023-07-14T12:56:59.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.789+0000 7f249f1ff700 1 -- 172.21.15.17:0/1066321074 wait complete. 2023-07-14T12:56:59.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.790+0000 7f249f1ff700 1 Processor -- start 2023-07-14T12:56:59.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.790+0000 7f249f1ff700 1 -- start start 2023-07-14T12:56:59.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.791+0000 7f249f1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24980ffb00 0x7f24980742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:59.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.791+0000 7f249f1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2498100cf0 0x7f2498072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:59.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.791+0000 7f249f1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2498101680 0x7f2498072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:59.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.791+0000 7f249f1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24980735e0 con 0x7f2498100cf0 2023-07-14T12:56:59.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.791+0000 7f249f1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2498073750 con 0x7f24980ffb00 2023-07-14T12:56:59.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.791+0000 7f249f1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249819f830 con 0x7f2498101680 2023-07-14T12:56:59.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.791+0000 7f2497fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2498100cf0 0x7f2498072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:59.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.791+0000 7f2497fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2498100cf0 0x7f2498072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41604/0 (socket says 172.21.15.17:41604) 2023-07-14T12:56:59.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.791+0000 7f2497fff700 1 -- 172.21.15.17:0/369180851 learned_addr learned my addr 172.21.15.17:0/369180851 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:56:59.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.791+0000 7f249cf9b700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24980ffb00 0x7f24980742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:59.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f249d79c700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2498101680 0x7f2498072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:59.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f2497fff700 1 -- 172.21.15.17:0/369180851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2498101680 msgr2=0x7f2498072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:59.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f2497fff700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2498101680 0x7f2498072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:59.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f2497fff700 1 -- 172.21.15.17:0/369180851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24980ffb00 msgr2=0x7f24980742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:56:59.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f2497fff700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24980ffb00 0x7f24980742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:56:59.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f2497fff700 1 -- 172.21.15.17:0/369180851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c0095f0 con 0x7f2498100cf0 2023-07-14T12:56:59.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f2497fff700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2498100cf0 0x7f2498072900 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f248400e9a0 tx=0x7f248400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:59.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f2495ffb700 1 -- 172.21.15.17:0/369180851 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484009790 con 0x7f2498100cf0 2023-07-14T12:56:59.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f249f1ff700 1 -- 172.21.15.17:0/369180851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249819fb10 con 0x7f2498100cf0 2023-07-14T12:56:59.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f2495ffb700 1 -- 172.21.15.17:0/369180851 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f248400cbd0 con 0x7f2498100cf0 2023-07-14T12:56:59.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f2495ffb700 1 -- 172.21.15.17:0/369180851 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484018680 con 0x7f2498100cf0 2023-07-14T12:56:59.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.792+0000 7f249f1ff700 1 -- 172.21.15.17:0/369180851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24981a0020 con 0x7f2498100cf0 2023-07-14T12:56:59.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.793+0000 7f249f1ff700 1 -- 172.21.15.17:0/369180851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24981070e0 con 0x7f2498100cf0 2023-07-14T12:56:59.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.796+0000 7f2495ffb700 1 -- 172.21.15.17:0/369180851 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f248400cd40 con 0x7f2498100cf0 2023-07-14T12:56:59.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.797+0000 7f2495ffb700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f24880a11a0 0x7f24880a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:56:59.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.797+0000 7f2495ffb700 1 -- 172.21.15.17:0/369180851 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2484014070 con 0x7f2498100cf0 2023-07-14T12:56:59.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.797+0000 7f249cf9b700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f24880a11a0 0x7f24880a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:56:59.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.798+0000 7f249cf9b700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f24880a11a0 0x7f24880a3650 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f248c0098e0 tx=0x7f248c00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:56:59.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:56:59.801+0000 7f2495ffb700 1 -- 172.21.15.17:0/369180851 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2484051790 con 0x7f2498100cf0 2023-07-14T12:57:00.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.058+0000 7f249f1ff700 1 -- 172.21.15.17:0/369180851 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f249802c850 con 0x7f2498100cf0 2023-07-14T12:57:00.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.058+0000 7f2495ffb700 1 -- 172.21.15.17:0/369180851 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f2484096300 con 0x7f2498100cf0 2023-07-14T12:57:00.087 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:00.087 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-14T12:57:00.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 -- 172.21.15.17:0/369180851 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f24880a11a0 msgr2=0x7f24880a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:00.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f24880a11a0 0x7f24880a3650 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f248c0098e0 tx=0x7f248c00b260 comp rx=0 tx=0).stop 2023-07-14T12:57:00.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 -- 172.21.15.17:0/369180851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2498100cf0 msgr2=0x7f2498072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:00.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2498100cf0 0x7f2498072900 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f248400e9a0 tx=0x7f248400ecb0 comp rx=0 tx=0).stop 2023-07-14T12:57:00.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 -- 172.21.15.17:0/369180851 shutdown_connections 2023-07-14T12:57:00.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f24880a11a0 0x7f24880a3650 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:00.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2498101680 0x7f2498072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:00.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24980ffb00 0x7f24980742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:00.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 --2- 172.21.15.17:0/369180851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2498100cf0 0x7f2498072900 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:00.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 -- 172.21.15.17:0/369180851 >> 172.21.15.17:0/369180851 conn(0x7f24980fb0e0 msgr2=0x7f2498104220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:00.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 -- 172.21.15.17:0/369180851 shutdown_connections 2023-07-14T12:57:00.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:00.061+0000 7f249f1ff700 1 -- 172.21.15.17:0/369180851 wait complete. 2023-07-14T12:57:00.091 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2023-07-14T12:57:00.316 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:00 smithi131 ceph-mon[96953]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:00.316 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:00 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.135:6832/1506834360,v1:172.21.15.135:6833/1506834360] up:boot 2023-07-14T12:57:00.317 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:00 smithi131 ceph-mon[96953]: fsmap 1 up:standby 2023-07-14T12:57:00.317 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:00 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-14T12:57:00.317 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:00 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:00.317 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:00 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:00.318 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:00 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:00.318 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:00 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:00.318 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:00 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:00.319 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:00 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:00.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:00 smithi017 ceph-mon[95536]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:00.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:00 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.135:6832/1506834360,v1:172.21.15.135:6833/1506834360] up:boot 2023-07-14T12:57:00.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:00 smithi017 ceph-mon[95536]: fsmap 1 up:standby 2023-07-14T12:57:00.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:00 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-14T12:57:00.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:00 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:00.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:00 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:00.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:00 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:00.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:00 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:00.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:00 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:00.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:00 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:00.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:00 smithi135 ceph-mon[97338]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:00.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:00 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.135:6832/1506834360,v1:172.21.15.135:6833/1506834360] up:boot 2023-07-14T12:57:00.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:00 smithi135 ceph-mon[97338]: fsmap 1 up:standby 2023-07-14T12:57:00.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:00 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-14T12:57:00.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:00 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:00.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:00 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:00.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:00 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:00.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:00 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:00.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:00 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:00.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:00 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:01.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:01 smithi131 ceph-mon[96953]: Deploying daemon mds.k on smithi131 2023-07-14T12:57:01.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:01 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/369180851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:01.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:01 smithi017 ceph-mon[95536]: Deploying daemon mds.k on smithi131 2023-07-14T12:57:01.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:01 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/369180851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:01.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:01 smithi135 ceph-mon[97338]: Deploying daemon mds.k on smithi131 2023-07-14T12:57:01.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:01 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/369180851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:01.744 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 12:57:01 smithi131 systemd[1]: Starting Ceph mds.k for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:57:02.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:02.302 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:02 smithi131 ceph-mon[96953]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:02.302 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 12:57:02 smithi131 podman[121232]: 2023-07-14T12:57:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.293+0000 7f86775ff700 1 -- 172.21.15.17:0/1168484946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8670101d10 msgr2=0x7f8670102120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.293+0000 7f86775ff700 1 --2- 172.21.15.17:0/1168484946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8670101d10 0x7f8670102120 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f866c009990 tx=0x7f866c009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.294+0000 7f86775ff700 1 -- 172.21.15.17:0/1168484946 shutdown_connections 2023-07-14T12:57:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.294+0000 7f86775ff700 1 --2- 172.21.15.17:0/1168484946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8670103890 0x7f867010a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.294+0000 7f86775ff700 1 --2- 172.21.15.17:0/1168484946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8670101d10 0x7f8670102120 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.294+0000 7f86775ff700 1 --2- 172.21.15.17:0/1168484946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8670102f00 0x7f8670103350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.294+0000 7f86775ff700 1 -- 172.21.15.17:0/1168484946 >> 172.21.15.17:0/1168484946 conn(0x7f86700fd350 msgr2=0x7f86700ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.294+0000 7f86775ff700 1 -- 172.21.15.17:0/1168484946 shutdown_connections 2023-07-14T12:57:02.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.294+0000 7f86775ff700 1 -- 172.21.15.17:0/1168484946 wait complete. 2023-07-14T12:57:02.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.295+0000 7f86775ff700 1 Processor -- start 2023-07-14T12:57:02.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.295+0000 7f86775ff700 1 -- start start 2023-07-14T12:57:02.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.295+0000 7f86775ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8670101d10 0x7f8670197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:02.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.295+0000 7f86775ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8670102f00 0x7f8670197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:02.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.295+0000 7f86775ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8670103890 0x7f867019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:02.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.295+0000 7f86775ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867019f490 con 0x7f8670102f00 2023-07-14T12:57:02.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.295+0000 7f86775ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867019f5d0 con 0x7f8670101d10 2023-07-14T12:57:02.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.295+0000 7f86775ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867019f760 con 0x7f8670103890 2023-07-14T12:57:02.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.295+0000 7f8674b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8670102f00 0x7f8670197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:02.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.295+0000 7f8674b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8670102f00 0x7f8670197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41622/0 (socket says 172.21.15.17:41622) 2023-07-14T12:57:02.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.295+0000 7f8674b9a700 1 -- 172.21.15.17:0/3320702885 learned_addr learned my addr 172.21.15.17:0/3320702885 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f867539b700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8670101d10 0x7f8670197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f8675b9c700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8670103890 0x7f867019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f8674b9a700 1 -- 172.21.15.17:0/3320702885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8670103890 msgr2=0x7f867019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:02.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f8674b9a700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8670103890 0x7f867019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:02.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f8674b9a700 1 -- 172.21.15.17:0/3320702885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8670101d10 msgr2=0x7f8670197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:02.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f8674b9a700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8670101d10 0x7f8670197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:02.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f8674b9a700 1 -- 172.21.15.17:0/3320702885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c0095f0 con 0x7f8670102f00 2023-07-14T12:57:02.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f867539b700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8670101d10 0x7f8670197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:57:02.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f8674b9a700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8670102f00 0x7f8670197e50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f866000e9a0 tx=0x7f866000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:02.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f86667fc700 1 -- 172.21.15.17:0/3320702885 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660009790 con 0x7f8670102f00 2023-07-14T12:57:02.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f86667fc700 1 -- 172.21.15.17:0/3320702885 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8660010430 con 0x7f8670102f00 2023-07-14T12:57:02.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f86667fc700 1 -- 172.21.15.17:0/3320702885 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866000cea0 con 0x7f8670102f00 2023-07-14T12:57:02.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.296+0000 7f86775ff700 1 -- 172.21.15.17:0/3320702885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867019fa40 con 0x7f8670102f00 2023-07-14T12:57:02.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.297+0000 7f86775ff700 1 -- 172.21.15.17:0/3320702885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867019ff00 con 0x7f8670102f00 2023-07-14T12:57:02.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.298+0000 7f86775ff700 1 -- 172.21.15.17:0/3320702885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867010d3e0 con 0x7f8670102f00 2023-07-14T12:57:02.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.299+0000 7f86667fc700 1 -- 172.21.15.17:0/3320702885 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f86600105a0 con 0x7f8670102f00 2023-07-14T12:57:02.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.301+0000 7f86667fc700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f865c0a1220 0x7f865c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:02.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.301+0000 7f86667fc700 1 -- 172.21.15.17:0/3320702885 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8660014070 con 0x7f8670102f00 2023-07-14T12:57:02.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.301+0000 7f867539b700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f865c0a1220 0x7f865c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:02.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.302+0000 7f867539b700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f865c0a1220 0x7f865c0a36d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f866c0098e0 tx=0x7f866c00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:02.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.305+0000 7f86667fc700 1 -- 172.21.15.17:0/3320702885 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8660051790 con 0x7f8670102f00 2023-07-14T12:57:02.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:02 smithi017 ceph-mon[95536]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:02.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:02 smithi135 ceph-mon[97338]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:02.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.563+0000 7f86775ff700 1 -- 172.21.15.17:0/3320702885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f867010d5d0 con 0x7f8670102f00 2023-07-14T12:57:02.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.564+0000 7f86667fc700 1 -- 172.21.15.17:0/3320702885 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f86600961f0 con 0x7f8670102f00 2023-07-14T12:57:02.592 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:02.592 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-14T12:57:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.566+0000 7f86775ff700 1 -- 172.21.15.17:0/3320702885 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f865c0a1220 msgr2=0x7f865c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:02.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.566+0000 7f86775ff700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f865c0a1220 0x7f865c0a36d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f866c0098e0 tx=0x7f866c00b260 comp rx=0 tx=0).stop 2023-07-14T12:57:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.566+0000 7f86775ff700 1 -- 172.21.15.17:0/3320702885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8670102f00 msgr2=0x7f8670197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.566+0000 7f86775ff700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8670102f00 0x7f8670197e50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f866000e9a0 tx=0x7f866000ecb0 comp rx=0 tx=0).stop 2023-07-14T12:57:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.566+0000 7f86775ff700 1 -- 172.21.15.17:0/3320702885 shutdown_connections 2023-07-14T12:57:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.566+0000 7f86775ff700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f865c0a1220 0x7f865c0a36d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.566+0000 7f86775ff700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8670103890 0x7f867019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.566+0000 7f86775ff700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8670101d10 0x7f8670197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.566+0000 7f86775ff700 1 --2- 172.21.15.17:0/3320702885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8670102f00 0x7f8670197e50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:02.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.567+0000 7f86775ff700 1 -- 172.21.15.17:0/3320702885 >> 172.21.15.17:0/3320702885 conn(0x7f86700fd350 msgr2=0x7f86700ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:02.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.567+0000 7f86775ff700 1 -- 172.21.15.17:0/3320702885 shutdown_connections 2023-07-14T12:57:02.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:02.567+0000 7f86775ff700 1 -- 172.21.15.17:0/3320702885 wait complete. 2023-07-14T12:57:02.596 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2023-07-14T12:57:02.744 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 12:57:02 smithi131 bash[121232]: 61c495fa43c8b8e7d18e63b93188fa2564e3088c7d2bd98a80d36a1f87339ba0 2023-07-14T12:57:02.744 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 12:57:02 smithi131 ceph-mds[121272]: -- 172.21.15.131:0/2930168420 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dd32e031e0 con 0x55dd32dd9000 2023-07-14T12:57:02.744 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 12:57:02 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-k[121248]: starting mds.k at 2023-07-14T12:57:02.745 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 12:57:02 smithi131 systemd[1]: Started Ceph mds.k for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:57:03.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:03.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:03.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:03.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:03.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:03.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:03.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: Deploying daemon mds.j on smithi017 2023-07-14T12:57:03.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3320702885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:03.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:03.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.131:6832/610469935,v1:172.21.15.131:6833/610469935] up:boot 2023-07-14T12:57:03.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: fsmap 2 up:standby 2023-07-14T12:57:03.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:03 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-14T12:57:03.698 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:03.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:03.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:03.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:03.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:03.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:03.699 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: Deploying daemon mds.j on smithi017 2023-07-14T12:57:03.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3320702885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:03.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:03.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.131:6832/610469935,v1:172.21.15.131:6833/610469935] up:boot 2023-07-14T12:57:03.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: fsmap 2 up:standby 2023-07-14T12:57:03.700 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:03 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-14T12:57:03.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:03.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:03.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:03.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:03.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:03.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:03.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: Deploying daemon mds.j on smithi017 2023-07-14T12:57:03.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3320702885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:03.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:03.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.131:6832/610469935,v1:172.21.15.131:6833/610469935] up:boot 2023-07-14T12:57:03.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: fsmap 2 up:standby 2023-07-14T12:57:03.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:03 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-14T12:57:04.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:04.652 INFO:journalctl@ceph.mds.j.smithi017.stdout:Jul 14 12:57:04 smithi017 systemd[1]: Starting Ceph mds.j for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:57:04.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.813+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3297558070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0101680 msgr2=0x7fe6d0107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:04.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.813+0000 7fe6d73ff700 1 --2- 172.21.15.17:0/3297558070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0101680 0x7fe6d0107f40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800b0a0 tx=0x7fe6c800b3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:04.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.813+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3297558070 shutdown_connections 2023-07-14T12:57:04.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.813+0000 7fe6d73ff700 1 --2- 172.21.15.17:0/3297558070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d0101680 0x7fe6d0107f40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:04.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.813+0000 7fe6d73ff700 1 --2- 172.21.15.17:0/3297558070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6d00ffb00 0x7fe6d00fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:04.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.813+0000 7fe6d73ff700 1 --2- 172.21.15.17:0/3297558070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d0100cf0 0x7fe6d0101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:04.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.813+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3297558070 >> 172.21.15.17:0/3297558070 conn(0x7fe6d00fb0e0 msgr2=0x7fe6d00fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:04.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.814+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3297558070 shutdown_connections 2023-07-14T12:57:04.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.814+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3297558070 wait complete. 2023-07-14T12:57:04.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.815+0000 7fe6d73ff700 1 Processor -- start 2023-07-14T12:57:04.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.815+0000 7fe6d73ff700 1 -- start start 2023-07-14T12:57:04.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.816+0000 7fe6d73ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d00ffb00 0x7fe6d0197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:04.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.816+0000 7fe6d73ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6d0100cf0 0x7fe6d0197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:04.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.816+0000 7fe6d73ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d0101680 0x7fe6d019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:04.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.816+0000 7fe6d73ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d019f5f0 con 0x7fe6d00ffb00 2023-07-14T12:57:04.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.816+0000 7fe6d73ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d019f730 con 0x7fe6d0101680 2023-07-14T12:57:04.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.816+0000 7fe6d73ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d019f8c0 con 0x7fe6d0100cf0 2023-07-14T12:57:04.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.816+0000 7fe6d519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d00ffb00 0x7fe6d0197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:04.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.816+0000 7fe6d519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d00ffb00 0x7fe6d0197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41642/0 (socket says 172.21.15.17:41642) 2023-07-14T12:57:04.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.816+0000 7fe6d519b700 1 -- 172.21.15.17:0/3543229219 learned_addr learned my addr 172.21.15.17:0/3543229219 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:04.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.816+0000 7fe6d599c700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d0101680 0x7fe6d019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:04.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6d499a700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6d0100cf0 0x7fe6d0197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:04.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6d519b700 1 -- 172.21.15.17:0/3543229219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6d0100cf0 msgr2=0x7fe6d0197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:04.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6d519b700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6d0100cf0 0x7fe6d0197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:04.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6d519b700 1 -- 172.21.15.17:0/3543229219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d0101680 msgr2=0x7fe6d019f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:04.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6d519b700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d0101680 0x7fe6d019f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:04.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6d519b700 1 -- 172.21.15.17:0/3543229219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c8009d00 con 0x7fe6d00ffb00 2023-07-14T12:57:04.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6d499a700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6d0100cf0 0x7fe6d0197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:57:04.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6d519b700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d00ffb00 0x7fe6d0197a70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00d980 tx=0x7fe6cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:04.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6c67fc700 1 -- 172.21.15.17:0/3543229219 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc004020 con 0x7fe6d00ffb00 2023-07-14T12:57:04.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6c67fc700 1 -- 172.21.15.17:0/3543229219 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6cc009730 con 0x7fe6d00ffb00 2023-07-14T12:57:04.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3543229219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d019fba0 con 0x7fe6d00ffb00 2023-07-14T12:57:04.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6c67fc700 1 -- 172.21.15.17:0/3543229219 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc003a00 con 0x7fe6d00ffb00 2023-07-14T12:57:04.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.817+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3543229219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d01a00b0 con 0x7fe6d00ffb00 2023-07-14T12:57:04.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.819+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3543229219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d010b1e0 con 0x7fe6d00ffb00 2023-07-14T12:57:04.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.821+0000 7fe6c67fc700 1 -- 172.21.15.17:0/3543229219 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe6cc0098a0 con 0x7fe6d00ffb00 2023-07-14T12:57:04.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.823+0000 7fe6c67fc700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6bc0a11a0 0x7fe6bc0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:04.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.823+0000 7fe6c67fc700 1 -- 172.21.15.17:0/3543229219 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe6cc0cc240 con 0x7fe6d00ffb00 2023-07-14T12:57:04.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.823+0000 7fe6d499a700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6bc0a11a0 0x7fe6bc0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:04.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.824+0000 7fe6d499a700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6bc0a11a0 0x7fe6bc0a3650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0005fd0 tx=0x7fe6c0005ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:04.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:04.826+0000 7fe6c67fc700 1 -- 172.21.15.17:0/3543229219 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe6cc095d90 con 0x7fe6d00ffb00 2023-07-14T12:57:05.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.098+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3543229219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6d010b4c0 con 0x7fe6d00ffb00 2023-07-14T12:57:05.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.099+0000 7fe6c67fc700 1 -- 172.21.15.17:0/3543229219 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2017 (secure 0 0 0) 0x7fe6d010b4c0 con 0x7fe6d00ffb00 2023-07-14T12:57:05.127 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:05.127 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-14T12:57:05.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3543229219 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6bc0a11a0 msgr2=0x7fe6bc0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6bc0a11a0 0x7fe6bc0a3650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0005fd0 tx=0x7fe6c0005ee0 comp rx=0 tx=0).stop 2023-07-14T12:57:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3543229219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d00ffb00 msgr2=0x7fe6d0197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d00ffb00 0x7fe6d0197a70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00d980 tx=0x7fe6cc00dc90 comp rx=0 tx=0).stop 2023-07-14T12:57:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3543229219 shutdown_connections 2023-07-14T12:57:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6bc0a11a0 0x7fe6bc0a3650 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:05.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6d0101680 0x7fe6d019f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:05.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6d00ffb00 0x7fe6d0197a70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:05.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 --2- 172.21.15.17:0/3543229219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6d0100cf0 0x7fe6d0197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:05.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3543229219 >> 172.21.15.17:0/3543229219 conn(0x7fe6d00fb0e0 msgr2=0x7fe6d00fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:05.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3543229219 shutdown_connections 2023-07-14T12:57:05.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:05.101+0000 7fe6d73ff700 1 -- 172.21.15.17:0/3543229219 wait complete. 2023-07-14T12:57:05.133 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 3 2023-07-14T12:57:05.411 INFO:journalctl@ceph.mds.j.smithi017.stdout:Jul 14 12:57:05 smithi017 podman[128273]: 2023-07-14T12:57:05.854 INFO:journalctl@ceph.mds.j.smithi017.stdout:Jul 14 12:57:05 smithi017 bash[128273]: 0ad3e71922cb5570089358e08aeb3910ce5f2ef074bbd9b9e669abf664effa3d 2023-07-14T12:57:05.854 INFO:journalctl@ceph.mds.j.smithi017.stdout:Jul 14 12:57:05 smithi017 ceph-mds[128315]: -- 172.21.15.17:0/1886089058 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fb040571e0 con 0x55fb0402cc00 2023-07-14T12:57:05.855 INFO:journalctl@ceph.mds.j.smithi017.stdout:Jul 14 12:57:05 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-j[128291]: starting mds.j at 2023-07-14T12:57:05.855 INFO:journalctl@ceph.mds.j.smithi017.stdout:Jul 14 12:57:05 smithi017 systemd[1]: Started Ceph mds.j for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:57:06.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:05 smithi135 ceph-mon[97338]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:06.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:05 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3543229219' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:06.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:06.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:06.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:06.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:06.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:06.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:05 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:06.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:05 smithi131 ceph-mon[96953]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:06.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:05 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3543229219' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:06.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:06.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:06.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:06.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:06.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:06.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:05 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:06.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:05 smithi017 ceph-mon[95536]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:06.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:05 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3543229219' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:06.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:06.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:06.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:06.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:06.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:06.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:05 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:07.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:06 smithi017 ceph-mon[95536]: Deploying daemon mds.d on smithi017 2023-07-14T12:57:07.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:06 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.17:6834/52692559,v1:172.21.15.17:6835/52692559] up:boot 2023-07-14T12:57:07.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:06 smithi017 ceph-mon[95536]: fsmap 3 up:standby 2023-07-14T12:57:07.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-14T12:57:07.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:07.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:06 smithi135 ceph-mon[97338]: Deploying daemon mds.d on smithi017 2023-07-14T12:57:07.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:06 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.17:6834/52692559,v1:172.21.15.17:6835/52692559] up:boot 2023-07-14T12:57:07.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:06 smithi135 ceph-mon[97338]: fsmap 3 up:standby 2023-07-14T12:57:07.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:06 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-14T12:57:07.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:06 smithi131 ceph-mon[96953]: Deploying daemon mds.d on smithi017 2023-07-14T12:57:07.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:06 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.17:6834/52692559,v1:172.21.15.17:6835/52692559] up:boot 2023-07-14T12:57:07.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:06 smithi131 ceph-mon[96953]: fsmap 3 up:standby 2023-07-14T12:57:07.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:06 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-14T12:57:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.351+0000 7f1286dff700 1 -- 172.21.15.17:0/945849430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f128010c0d0 msgr2=0x7f128010e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.351+0000 7f1286dff700 1 --2- 172.21.15.17:0/945849430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f128010c0d0 0x7f128010e4b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f127800b0a0 tx=0x7f127800b3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:07.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.351+0000 7f1286dff700 1 -- 172.21.15.17:0/945849430 shutdown_connections 2023-07-14T12:57:07.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.351+0000 7f1286dff700 1 --2- 172.21.15.17:0/945849430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f128010c0d0 0x7f128010e4b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:07.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.351+0000 7f1286dff700 1 --2- 172.21.15.17:0/945849430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1280074550 0x7f12800729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:07.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.351+0000 7f1286dff700 1 --2- 172.21.15.17:0/945849430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1280072f70 0x7f12800733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:07.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.351+0000 7f1286dff700 1 -- 172.21.15.17:0/945849430 >> 172.21.15.17:0/945849430 conn(0x7f12800fb0e0 msgr2=0x7f12800fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:07.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.351+0000 7f1286dff700 1 -- 172.21.15.17:0/945849430 shutdown_connections 2023-07-14T12:57:07.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.351+0000 7f1286dff700 1 -- 172.21.15.17:0/945849430 wait complete. 2023-07-14T12:57:07.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.352+0000 7f1286dff700 1 Processor -- start 2023-07-14T12:57:07.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.352+0000 7f1286dff700 1 -- start start 2023-07-14T12:57:07.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.353+0000 7f1286dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1280072f70 0x7f128019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:07.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.353+0000 7f1286dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280074550 0x7f128019c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:07.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.353+0000 7f1286dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f128010c0d0 0x7f12801a3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:07.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.353+0000 7f1286dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12801a3a20 con 0x7f1280074550 2023-07-14T12:57:07.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.353+0000 7f1286dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12801a3b60 con 0x7f1280072f70 2023-07-14T12:57:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.353+0000 7f1286dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12801a3cf0 con 0x7f128010c0d0 2023-07-14T12:57:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.353+0000 7f127ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280074550 0x7f128019c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.353+0000 7f127ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280074550 0x7f128019c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34298/0 (socket says 172.21.15.17:34298) 2023-07-14T12:57:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.353+0000 7f127ffff700 1 -- 172.21.15.17:0/1556204126 learned_addr learned my addr 172.21.15.17:0/1556204126 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.353+0000 7f1284b9b700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1280072f70 0x7f128019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f128539c700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f128010c0d0 0x7f12801a3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f127ffff700 1 -- 172.21.15.17:0/1556204126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f128010c0d0 msgr2=0x7f12801a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f127ffff700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f128010c0d0 0x7f12801a3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f127ffff700 1 -- 172.21.15.17:0/1556204126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1280072f70 msgr2=0x7f128019bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f127ffff700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1280072f70 0x7f128019bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f127ffff700 1 -- 172.21.15.17:0/1556204126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278009d00 con 0x7f1280074550 2023-07-14T12:57:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f127ffff700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280074550 0x7f128019c430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f126c00d980 tx=0x7f126c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f127dffb700 1 -- 172.21.15.17:0/1556204126 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c004020 con 0x7f1280074550 2023-07-14T12:57:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f1286dff700 1 -- 172.21.15.17:0/1556204126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12801a3fd0 con 0x7f1280074550 2023-07-14T12:57:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f127dffb700 1 -- 172.21.15.17:0/1556204126 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f126c009730 con 0x7f1280074550 2023-07-14T12:57:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f127dffb700 1 -- 172.21.15.17:0/1556204126 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0039c0 con 0x7f1280074550 2023-07-14T12:57:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.354+0000 7f1286dff700 1 -- 172.21.15.17:0/1556204126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12801a4450 con 0x7f1280074550 2023-07-14T12:57:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.355+0000 7f1286dff700 1 -- 172.21.15.17:0/1556204126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1280101c20 con 0x7f1280074550 2023-07-14T12:57:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.357+0000 7f127dffb700 1 -- 172.21.15.17:0/1556204126 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f126c0098a0 con 0x7f1280074550 2023-07-14T12:57:07.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.359+0000 7f127dffb700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12700a11a0 0x7f12700a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:07.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.359+0000 7f127dffb700 1 -- 172.21.15.17:0/1556204126 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f126c0cc1c0 con 0x7f1280074550 2023-07-14T12:57:07.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.359+0000 7f1284b9b700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12700a11a0 0x7f12700a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:07.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.360+0000 7f1284b9b700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12700a11a0 0x7f12700a3650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1274005950 tx=0x7f127400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:07.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.363+0000 7f127dffb700 1 -- 172.21.15.17:0/1556204126 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f126c095d10 con 0x7f1280074550 2023-07-14T12:57:07.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.684+0000 7f1286dff700 1 -- 172.21.15.17:0/1556204126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f128002c850 con 0x7f1280074550 2023-07-14T12:57:07.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.685+0000 7f127dffb700 1 -- 172.21.15.17:0/1556204126 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2768 (secure 0 0 0) 0x7f126c099330 con 0x7f1280074550 2023-07-14T12:57:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:07.714 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-14T12:57:07.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.687+0000 7f1286dff700 1 -- 172.21.15.17:0/1556204126 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12700a11a0 msgr2=0x7f12700a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:07.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.687+0000 7f1286dff700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12700a11a0 0x7f12700a3650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1274005950 tx=0x7f127400b410 comp rx=0 tx=0).stop 2023-07-14T12:57:07.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.687+0000 7f1286dff700 1 -- 172.21.15.17:0/1556204126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280074550 msgr2=0x7f128019c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:07.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.687+0000 7f1286dff700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280074550 0x7f128019c430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f126c00d980 tx=0x7f126c00dc90 comp rx=0 tx=0).stop 2023-07-14T12:57:07.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.688+0000 7f1286dff700 1 -- 172.21.15.17:0/1556204126 shutdown_connections 2023-07-14T12:57:07.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.688+0000 7f1286dff700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12700a11a0 0x7f12700a3650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:07.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.688+0000 7f1286dff700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f128010c0d0 0x7f12801a3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:07.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.688+0000 7f1286dff700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1280072f70 0x7f128019bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:07.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.688+0000 7f1286dff700 1 --2- 172.21.15.17:0/1556204126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280074550 0x7f128019c430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:07.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.688+0000 7f1286dff700 1 -- 172.21.15.17:0/1556204126 >> 172.21.15.17:0/1556204126 conn(0x7f12800fb0e0 msgr2=0x7f12800fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:07.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.688+0000 7f1286dff700 1 -- 172.21.15.17:0/1556204126 shutdown_connections 2023-07-14T12:57:07.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:07.688+0000 7f1286dff700 1 -- 172.21.15.17:0/1556204126 wait complete. 2023-07-14T12:57:07.718 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 4 2023-07-14T12:57:08.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:07 smithi135 ceph-mon[97338]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:08.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:07 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1556204126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:08.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:07 smithi131 ceph-mon[96953]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:08.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:07 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1556204126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:08.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:07 smithi017 ceph-mon[95536]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:08.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:07 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1556204126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:08.355 INFO:journalctl@ceph.mds.d.smithi017.stdout:Jul 14 12:57:07 smithi017 systemd[1]: Starting Ceph mds.d for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:57:08.644 INFO:journalctl@ceph.mds.d.smithi017.stdout:Jul 14 12:57:08 smithi017 podman[128663]: 2023-07-14T12:57:09.104 INFO:journalctl@ceph.mds.d.smithi017.stdout:Jul 14 12:57:08 smithi017 bash[128663]: dc118007be90383b50e663a5350a8f8ffd9215184caefef45672c41e406ef2d1 2023-07-14T12:57:09.104 INFO:journalctl@ceph.mds.d.smithi017.stdout:Jul 14 12:57:08 smithi017 ceph-mds[128703]: -- 172.21.15.17:0/4047621392 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56429c9eb1e0 con 0x56429c9c0800 2023-07-14T12:57:09.104 INFO:journalctl@ceph.mds.d.smithi017.stdout:Jul 14 12:57:08 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-d[128679]: starting mds.d at 2023-07-14T12:57:09.105 INFO:journalctl@ceph.mds.d.smithi017.stdout:Jul 14 12:57:08 smithi017 systemd[1]: Started Ceph mds.d for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:57:09.736 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.929+0000 7f12ce1ff700 1 -- 172.21.15.17:0/139735659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c80ffb00 msgr2=0x7f12c80fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:09.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.929+0000 7f12ce1ff700 1 --2- 172.21.15.17:0/139735659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c80ffb00 0x7f12c80fff10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009990 tx=0x7f12b8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:09.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.929+0000 7f12ce1ff700 1 -- 172.21.15.17:0/139735659 shutdown_connections 2023-07-14T12:57:09.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.929+0000 7f12ce1ff700 1 --2- 172.21.15.17:0/139735659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c8101680 0x7f12c8107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:09.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.929+0000 7f12ce1ff700 1 --2- 172.21.15.17:0/139735659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c80ffb00 0x7f12c80fff10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:09.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.929+0000 7f12ce1ff700 1 --2- 172.21.15.17:0/139735659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c8100cf0 0x7f12c8101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:09.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.929+0000 7f12ce1ff700 1 -- 172.21.15.17:0/139735659 >> 172.21.15.17:0/139735659 conn(0x7f12c80fb0e0 msgr2=0x7f12c80fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:09.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.929+0000 7f12ce1ff700 1 -- 172.21.15.17:0/139735659 shutdown_connections 2023-07-14T12:57:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.929+0000 7f12ce1ff700 1 -- 172.21.15.17:0/139735659 wait complete. 2023-07-14T12:57:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.931+0000 7f12ce1ff700 1 Processor -- start 2023-07-14T12:57:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.931+0000 7f12ce1ff700 1 -- start start 2023-07-14T12:57:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.931+0000 7f12ce1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c80ffb00 0x7f12c81957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.931+0000 7f12ce1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c8100cf0 0x7f12c8195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.931+0000 7f12ce1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c8101680 0x7f12c819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.931+0000 7f12ce1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c819d370 con 0x7f12c80ffb00 2023-07-14T12:57:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.931+0000 7f12ce1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c819d4b0 con 0x7f12c8100cf0 2023-07-14T12:57:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.931+0000 7f12ce1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c819d640 con 0x7f12c8101680 2023-07-14T12:57:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.932+0000 7f12c77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c80ffb00 0x7f12c81957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.932+0000 7f12c77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c80ffb00 0x7f12c81957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34336/0 (socket says 172.21.15.17:34336) 2023-07-14T12:57:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.932+0000 7f12c77fe700 1 -- 172.21.15.17:0/278356088 learned_addr learned my addr 172.21.15.17:0/278356088 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.932+0000 7f12c6ffd700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c8100cf0 0x7f12c8195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.932+0000 7f12c77fe700 1 -- 172.21.15.17:0/278356088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c8101680 msgr2=0x7f12c819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.932+0000 7f12c77fe700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c8101680 0x7f12c819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.932+0000 7f12c77fe700 1 -- 172.21.15.17:0/278356088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c8100cf0 msgr2=0x7f12c8195d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.932+0000 7f12c77fe700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c8100cf0 0x7f12c8195d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:09.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.932+0000 7f12c77fe700 1 -- 172.21.15.17:0/278356088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b80095f0 con 0x7f12c80ffb00 2023-07-14T12:57:09.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.932+0000 7f12c77fe700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c80ffb00 0x7f12c81957f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f12b80098e0 tx=0x7f12b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:09.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.933+0000 7f12c4ff9700 1 -- 172.21.15.17:0/278356088 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b801d070 con 0x7f12c80ffb00 2023-07-14T12:57:09.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.933+0000 7f12c4ff9700 1 -- 172.21.15.17:0/278356088 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12b800bd50 con 0x7f12c80ffb00 2023-07-14T12:57:09.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.933+0000 7f12ce1ff700 1 -- 172.21.15.17:0/278356088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c819d8c0 con 0x7f12c80ffb00 2023-07-14T12:57:09.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.933+0000 7f12c4ff9700 1 -- 172.21.15.17:0/278356088 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8022d60 con 0x7f12c80ffb00 2023-07-14T12:57:09.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.933+0000 7f12ce1ff700 1 -- 172.21.15.17:0/278356088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c819dce0 con 0x7f12c80ffb00 2023-07-14T12:57:09.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.934+0000 7f12ce1ff700 1 -- 172.21.15.17:0/278356088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c810b1d0 con 0x7f12c80ffb00 2023-07-14T12:57:09.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.936+0000 7f12c4ff9700 1 -- 172.21.15.17:0/278356088 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f12b8022470 con 0x7f12c80ffb00 2023-07-14T12:57:09.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.937+0000 7f12c4ff9700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12b00a11a0 0x7f12b00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:09.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.937+0000 7f12c4ff9700 1 -- 172.21.15.17:0/278356088 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f12b80cd970 con 0x7f12c80ffb00 2023-07-14T12:57:09.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.937+0000 7f12c6ffd700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12b00a11a0 0x7f12b00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:09.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.938+0000 7f12c6ffd700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12b00a11a0 0x7f12b00a3650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009c60 tx=0x7f12bc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:09.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:09.941+0000 7f12c4ff9700 1 -- 172.21.15.17:0/278356088 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f12b8097550 con 0x7f12c80ffb00 2023-07-14T12:57:10.064 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:10.065 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:10.065 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:09 smithi131 ceph-mon[96953]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:10.065 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:10.065 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:10.065 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:10.065 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:10.066 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:09 smithi131 ceph-mon[96953]: Deploying daemon mds.e on smithi131 2023-07-14T12:57:10.066 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:09 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.17:6836/1941846207,v1:172.21.15.17:6837/1941846207] up:boot 2023-07-14T12:57:10.066 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:09 smithi131 ceph-mon[96953]: fsmap 4 up:standby 2023-07-14T12:57:10.066 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:09 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-14T12:57:10.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:10.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:09 smithi017 ceph-mon[95536]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:09 smithi017 ceph-mon[95536]: Deploying daemon mds.e on smithi131 2023-07-14T12:57:10.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:09 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.17:6836/1941846207,v1:172.21.15.17:6837/1941846207] up:boot 2023-07-14T12:57:10.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:09 smithi017 ceph-mon[95536]: fsmap 4 up:standby 2023-07-14T12:57:10.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:09 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-14T12:57:10.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:10.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:10.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:09 smithi135 ceph-mon[97338]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:10.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:10.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:10.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:10.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:10.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:09 smithi135 ceph-mon[97338]: Deploying daemon mds.e on smithi131 2023-07-14T12:57:10.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:09 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.17:6836/1941846207,v1:172.21.15.17:6837/1941846207] up:boot 2023-07-14T12:57:10.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:09 smithi135 ceph-mon[97338]: fsmap 4 up:standby 2023-07-14T12:57:10.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:09 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-14T12:57:10.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.198+0000 7f12ce1ff700 1 -- 172.21.15.17:0/278356088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12c8106ac0 con 0x7f12c80ffb00 2023-07-14T12:57:10.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.198+0000 7f12c4ff9700 1 -- 172.21.15.17:0/278356088 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3525 (secure 0 0 0) 0x7f12b8027de0 con 0x7f12c80ffb00 2023-07-14T12:57:10.227 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:10.227 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-14T12:57:10.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 -- 172.21.15.17:0/278356088 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12b00a11a0 msgr2=0x7f12b00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:10.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12b00a11a0 0x7f12b00a3650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f12bc009c60 tx=0x7f12bc009260 comp rx=0 tx=0).stop 2023-07-14T12:57:10.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 -- 172.21.15.17:0/278356088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c80ffb00 msgr2=0x7f12c81957f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:10.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c80ffb00 0x7f12c81957f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f12b80098e0 tx=0x7f12b8004730 comp rx=0 tx=0).stop 2023-07-14T12:57:10.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 -- 172.21.15.17:0/278356088 shutdown_connections 2023-07-14T12:57:10.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12b00a11a0 0x7f12b00a3650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:10.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c8101680 0x7f12c819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:10.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12c80ffb00 0x7f12c81957f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:10.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 --2- 172.21.15.17:0/278356088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12c8100cf0 0x7f12c8195d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:10.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 -- 172.21.15.17:0/278356088 >> 172.21.15.17:0/278356088 conn(0x7f12c80fb0e0 msgr2=0x7f12c80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:10.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 -- 172.21.15.17:0/278356088 shutdown_connections 2023-07-14T12:57:10.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:10.201+0000 7f12ce1ff700 1 -- 172.21.15.17:0/278356088 wait complete. 2023-07-14T12:57:10.231 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 5 2023-07-14T12:57:11.062 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:10 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/278356088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:11.063 INFO:journalctl@ceph.mds.e.smithi131.stdout:Jul 14 12:57:11 smithi131 systemd[1]: Starting Ceph mds.e for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:57:11.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:10 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/278356088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:11.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:10 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/278356088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:11.784 INFO:journalctl@ceph.mds.e.smithi131.stdout:Jul 14 12:57:11 smithi131 podman[121571]: 2023-07-14T12:57:12.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:11 smithi135 ceph-mon[97338]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:12.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:11 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:12.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:11 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:12.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:11 smithi131 ceph-mon[96953]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:12.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:11 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:12.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:11 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:12.245 INFO:journalctl@ceph.mds.e.smithi131.stdout:Jul 14 12:57:11 smithi131 ceph-mds[121611]: -- 172.21.15.131:0/1636607305 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559c15e151e0 con 0x559c15deb000 2023-07-14T12:57:12.245 INFO:journalctl@ceph.mds.e.smithi131.stdout:Jul 14 12:57:11 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-e[121587]: starting mds.e at 2023-07-14T12:57:12.245 INFO:journalctl@ceph.mds.e.smithi131.stdout:Jul 14 12:57:11 smithi131 bash[121571]: f3ae67fc8d688140b9bc8f8955a0fe229c8170f077e4ad3aacea5f58b6703885 2023-07-14T12:57:12.246 INFO:journalctl@ceph.mds.e.smithi131.stdout:Jul 14 12:57:11 smithi131 systemd[1]: Started Ceph mds.e for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:57:12.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:12.316 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:11 smithi017 ceph-mon[95536]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:12.317 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:11 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:12.317 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:11 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:12.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.434+0000 7f8c03fff700 1 -- 172.21.15.17:0/2200017453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc100550 msgr2=0x7f8bfc102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.434+0000 7f8c03fff700 1 --2- 172.21.15.17:0/2200017453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc100550 0x7f8bfc102930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009990 tx=0x7f8bf8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.434+0000 7f8c03fff700 1 -- 172.21.15.17:0/2200017453 shutdown_connections 2023-07-14T12:57:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.434+0000 7f8c03fff700 1 --2- 172.21.15.17:0/2200017453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc105790 0x7f8bfc107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.434+0000 7f8c03fff700 1 --2- 172.21.15.17:0/2200017453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc100550 0x7f8bfc102930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.434+0000 7f8c03fff700 1 --2- 172.21.15.17:0/2200017453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc102e70 0x7f8bfc105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.434+0000 7f8c03fff700 1 -- 172.21.15.17:0/2200017453 >> 172.21.15.17:0/2200017453 conn(0x7f8bfc0f9fd0 msgr2=0x7f8bfc0fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.434+0000 7f8c03fff700 1 -- 172.21.15.17:0/2200017453 shutdown_connections 2023-07-14T12:57:12.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.434+0000 7f8c03fff700 1 -- 172.21.15.17:0/2200017453 wait complete. 2023-07-14T12:57:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.435+0000 7f8c03fff700 1 Processor -- start 2023-07-14T12:57:12.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.435+0000 7f8c03fff700 1 -- start start 2023-07-14T12:57:12.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c03fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc100550 0x7f8bfc195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:12.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c03fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc102e70 0x7f8bfc195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:12.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c03fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc105790 0x7f8bfc19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:12.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c03fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc19d1f0 con 0x7f8bfc105790 2023-07-14T12:57:12.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c03fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc19d330 con 0x7f8bfc102e70 2023-07-14T12:57:12.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c03fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc19d4c0 con 0x7f8bfc100550 2023-07-14T12:57:12.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c0259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc105790 0x7f8bfc19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c01d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc100550 0x7f8bfc195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c01d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc100550 0x7f8bfc195670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45604/0 (socket says 172.21.15.17:45604) 2023-07-14T12:57:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c0259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc105790 0x7f8bfc19cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34362/0 (socket says 172.21.15.17:34362) 2023-07-14T12:57:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c01d9b700 1 -- 172.21.15.17:0/3930511106 learned_addr learned my addr 172.21.15.17:0/3930511106 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c0159a700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc102e70 0x7f8bfc195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:12.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c0259c700 1 -- 172.21.15.17:0/3930511106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc100550 msgr2=0x7f8bfc195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c0259c700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc100550 0x7f8bfc195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c0259c700 1 -- 172.21.15.17:0/3930511106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc102e70 msgr2=0x7f8bfc195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c0259c700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc102e70 0x7f8bfc195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c0259c700 1 -- 172.21.15.17:0/3930511106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80095f0 con 0x7f8bfc105790 2023-07-14T12:57:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c0159a700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc102e70 0x7f8bfc195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:57:12.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.436+0000 7f8c0259c700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc105790 0x7f8bfc19cc20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4007f10 tx=0x7f8bf400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.437+0000 7f8bf2ffd700 1 -- 172.21.15.17:0/3930511106 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf400ddd0 con 0x7f8bfc105790 2023-07-14T12:57:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.437+0000 7f8bf2ffd700 1 -- 172.21.15.17:0/3930511106 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bf400f040 con 0x7f8bfc105790 2023-07-14T12:57:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.437+0000 7f8c03fff700 1 -- 172.21.15.17:0/3930511106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc19d7a0 con 0x7f8bfc105790 2023-07-14T12:57:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.437+0000 7f8bf2ffd700 1 -- 172.21.15.17:0/3930511106 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40059c0 con 0x7f8bfc105790 2023-07-14T12:57:12.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.437+0000 7f8c03fff700 1 -- 172.21.15.17:0/3930511106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc19dcb0 con 0x7f8bfc105790 2023-07-14T12:57:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.438+0000 7f8c03fff700 1 -- 172.21.15.17:0/3930511106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc0fbb40 con 0x7f8bfc105790 2023-07-14T12:57:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.440+0000 7f8bf2ffd700 1 -- 172.21.15.17:0/3930511106 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8bf4005020 con 0x7f8bfc105790 2023-07-14T12:57:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.441+0000 7f8bf2ffd700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8be80a11a0 0x7f8be80a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.441+0000 7f8bf2ffd700 1 -- 172.21.15.17:0/3930511106 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8bf40cbd80 con 0x7f8bfc105790 2023-07-14T12:57:12.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.441+0000 7f8c01d9b700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8be80a11a0 0x7f8be80a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:12.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.442+0000 7f8c01d9b700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8be80a11a0 0x7f8be80a3650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8006010 tx=0x7f8bf800b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:12.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.445+0000 7f8bf2ffd700 1 -- 172.21.15.17:0/3930511106 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8bf404e790 con 0x7f8bfc105790 2023-07-14T12:57:12.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.701+0000 7f8c03fff700 1 -- 172.21.15.17:0/3930511106 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bfc02c850 con 0x7f8bfc105790 2023-07-14T12:57:12.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.701+0000 7f8bf2ffd700 1 -- 172.21.15.17:0/3930511106 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4285 (secure 0 0 0) 0x7f8bf40958d0 con 0x7f8bfc105790 2023-07-14T12:57:12.730 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:12.730 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2023-07-14T12:57:12.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 -- 172.21.15.17:0/3930511106 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8be80a11a0 msgr2=0x7f8be80a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:12.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8be80a11a0 0x7f8be80a3650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8006010 tx=0x7f8bf800b540 comp rx=0 tx=0).stop 2023-07-14T12:57:12.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 -- 172.21.15.17:0/3930511106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc105790 msgr2=0x7f8bfc19cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:12.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc105790 0x7f8bfc19cc20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4007f10 tx=0x7f8bf400d3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:12.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 -- 172.21.15.17:0/3930511106 shutdown_connections 2023-07-14T12:57:12.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8be80a11a0 0x7f8be80a3650 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:12.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bfc105790 0x7f8bfc19cc20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:12.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bfc100550 0x7f8bfc195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:12.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 --2- 172.21.15.17:0/3930511106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bfc102e70 0x7f8bfc195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:12.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 -- 172.21.15.17:0/3930511106 >> 172.21.15.17:0/3930511106 conn(0x7f8bfc0f9fd0 msgr2=0x7f8bfc1011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:12.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 -- 172.21.15.17:0/3930511106 shutdown_connections 2023-07-14T12:57:12.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:12.704+0000 7f8c03fff700 1 -- 172.21.15.17:0/3930511106 wait complete. 2023-07-14T12:57:12.734 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 6 2023-07-14T12:57:13.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:12 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.131:6834/1432780018,v1:172.21.15.131:6835/1432780018] up:boot 2023-07-14T12:57:13.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:12 smithi017 ceph-mon[95536]: fsmap 5 up:standby 2023-07-14T12:57:13.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-14T12:57:13.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:13.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:13.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:13.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:12 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:13.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:12 smithi017 ceph-mon[95536]: Deploying daemon mds.f on smithi135 2023-07-14T12:57:13.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:12 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3930511106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:13.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:12 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.131:6834/1432780018,v1:172.21.15.131:6835/1432780018] up:boot 2023-07-14T12:57:13.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:12 smithi135 ceph-mon[97338]: fsmap 5 up:standby 2023-07-14T12:57:13.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-14T12:57:13.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:13.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:13.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:13.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:12 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:13.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:12 smithi135 ceph-mon[97338]: Deploying daemon mds.f on smithi135 2023-07-14T12:57:13.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:12 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3930511106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:13.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:12 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.131:6834/1432780018,v1:172.21.15.131:6835/1432780018] up:boot 2023-07-14T12:57:13.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:12 smithi131 ceph-mon[96953]: fsmap 5 up:standby 2023-07-14T12:57:13.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-14T12:57:13.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:13.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:13.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:13.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:12 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:13.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:12 smithi131 ceph-mon[96953]: Deploying daemon mds.f on smithi135 2023-07-14T12:57:13.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:12 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3930511106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:14.171 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:13 smithi135 ceph-mon[97338]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:14.172 INFO:journalctl@ceph.mds.f.smithi135.stdout:Jul 14 12:57:14 smithi135 systemd[1]: Starting Ceph mds.f for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:57:14.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:13 smithi131 ceph-mon[96953]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:14.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:13 smithi017 ceph-mon[95536]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:14.751 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:14.891 INFO:journalctl@ceph.mds.f.smithi135.stdout:Jul 14 12:57:14 smithi135 podman[122980]: 2023-07-14T12:57:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.938+0000 7ff0f51ff700 1 -- 172.21.15.17:0/4270249864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f0102ef0 msgr2=0x7ff0f0103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.938+0000 7ff0f51ff700 1 --2- 172.21.15.17:0/4270249864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f0102ef0 0x7ff0f0103340 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009990 tx=0x7ff0e4009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.938+0000 7ff0f51ff700 1 -- 172.21.15.17:0/4270249864 shutdown_connections 2023-07-14T12:57:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.938+0000 7ff0f51ff700 1 --2- 172.21.15.17:0/4270249864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0f0103880 0x7ff0f010a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.938+0000 7ff0f51ff700 1 --2- 172.21.15.17:0/4270249864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0f0101d00 0x7ff0f0102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.938+0000 7ff0f51ff700 1 --2- 172.21.15.17:0/4270249864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f0102ef0 0x7ff0f0103340 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:14.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.938+0000 7ff0f51ff700 1 -- 172.21.15.17:0/4270249864 >> 172.21.15.17:0/4270249864 conn(0x7ff0f00fd320 msgr2=0x7ff0f00ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:14.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.938+0000 7ff0f51ff700 1 -- 172.21.15.17:0/4270249864 shutdown_connections 2023-07-14T12:57:14.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.938+0000 7ff0f51ff700 1 -- 172.21.15.17:0/4270249864 wait complete. 2023-07-14T12:57:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.940+0000 7ff0f51ff700 1 Processor -- start 2023-07-14T12:57:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.940+0000 7ff0f51ff700 1 -- start start 2023-07-14T12:57:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.940+0000 7ff0f51ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0f0101d00 0x7ff0f0197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.940+0000 7ff0f51ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0f0102ef0 0x7ff0f0197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.940+0000 7ff0f51ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f0103880 0x7ff0f019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.940+0000 7ff0f51ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f019f4b0 con 0x7ff0f0103880 2023-07-14T12:57:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.940+0000 7ff0f51ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f019f5f0 con 0x7ff0f0101d00 2023-07-14T12:57:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.940+0000 7ff0f51ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f019f780 con 0x7ff0f0102ef0 2023-07-14T12:57:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.941+0000 7ff0ee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0f0102ef0 0x7ff0f0197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.941+0000 7ff0ef59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f0103880 0x7ff0f019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.941+0000 7ff0ee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0f0102ef0 0x7ff0f0197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55574/0 (socket says 172.21.15.17:55574) 2023-07-14T12:57:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.941+0000 7ff0ee59c700 1 -- 172.21.15.17:0/587879993 learned_addr learned my addr 172.21.15.17:0/587879993 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.941+0000 7ff0eed9d700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0f0101d00 0x7ff0f0197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.941+0000 7ff0ee59c700 1 -- 172.21.15.17:0/587879993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0f0101d00 msgr2=0x7ff0f0197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.941+0000 7ff0ee59c700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0f0101d00 0x7ff0f0197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.941+0000 7ff0ee59c700 1 -- 172.21.15.17:0/587879993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f0103880 msgr2=0x7ff0f019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.941+0000 7ff0ee59c700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f0103880 0x7ff0f019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.941+0000 7ff0ee59c700 1 -- 172.21.15.17:0/587879993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40095f0 con 0x7ff0f0102ef0 2023-07-14T12:57:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.941+0000 7ff0ee59c700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0f0102ef0 0x7ff0f0197e70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4005910 tx=0x7ff0e4005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.942+0000 7ff0d7fff700 1 -- 172.21.15.17:0/587879993 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e401d070 con 0x7ff0f0102ef0 2023-07-14T12:57:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.942+0000 7ff0d7fff700 1 -- 172.21.15.17:0/587879993 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0e400be10 con 0x7ff0f0102ef0 2023-07-14T12:57:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.942+0000 7ff0f51ff700 1 -- 172.21.15.17:0/587879993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f019fa00 con 0x7ff0f0102ef0 2023-07-14T12:57:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.942+0000 7ff0d7fff700 1 -- 172.21.15.17:0/587879993 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4022e30 con 0x7ff0f0102ef0 2023-07-14T12:57:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.942+0000 7ff0f51ff700 1 -- 172.21.15.17:0/587879993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f019fe20 con 0x7ff0f0102ef0 2023-07-14T12:57:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.943+0000 7ff0f51ff700 1 -- 172.21.15.17:0/587879993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f0109290 con 0x7ff0f0102ef0 2023-07-14T12:57:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.945+0000 7ff0d7fff700 1 -- 172.21.15.17:0/587879993 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff0e4022600 con 0x7ff0f0102ef0 2023-07-14T12:57:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.946+0000 7ff0d7fff700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0d80a11a0 0x7ff0d80a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:14.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.946+0000 7ff0d7fff700 1 -- 172.21.15.17:0/587879993 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff0e40cdb90 con 0x7ff0f0102ef0 2023-07-14T12:57:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.946+0000 7ff0eed9d700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0d80a11a0 0x7ff0d80a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.947+0000 7ff0eed9d700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0d80a11a0 0x7ff0d80a3650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0102d50 tx=0x7ff0e0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:14.949+0000 7ff0d7fff700 1 -- 172.21.15.17:0/587879993 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff0e4097770 con 0x7ff0f0102ef0 2023-07-14T12:57:15.196 INFO:journalctl@ceph.mds.f.smithi135.stdout:Jul 14 12:57:14 smithi135 bash[122980]: da6899ca90ed5322c9db9dc3d7e15ca58991ff47c6662af9dc3b04a925ac1427 2023-07-14T12:57:15.196 INFO:journalctl@ceph.mds.f.smithi135.stdout:Jul 14 12:57:14 smithi135 ceph-mds[123021]: -- 172.21.15.135:0/1231227810 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bd62c6f1e0 con 0x55bd62c44c00 2023-07-14T12:57:15.196 INFO:journalctl@ceph.mds.f.smithi135.stdout:Jul 14 12:57:14 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-f[122996]: starting mds.f at 2023-07-14T12:57:15.196 INFO:journalctl@ceph.mds.f.smithi135.stdout:Jul 14 12:57:14 smithi135 systemd[1]: Started Ceph mds.f for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:57:15.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.208+0000 7ff0f51ff700 1 -- 172.21.15.17:0/587879993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0f002c850 con 0x7ff0f0102ef0 2023-07-14T12:57:15.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.208+0000 7ff0d7fff700 1 -- 172.21.15.17:0/587879993 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5045 (secure 0 0 0) 0x7ff0e409ad90 con 0x7ff0f0102ef0 2023-07-14T12:57:15.237 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:15.237 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2023-07-14T12:57:15.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 -- 172.21.15.17:0/587879993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0d80a11a0 msgr2=0x7ff0d80a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:15.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0d80a11a0 0x7ff0d80a3650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0102d50 tx=0x7ff0e0009260 comp rx=0 tx=0).stop 2023-07-14T12:57:15.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 -- 172.21.15.17:0/587879993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0f0102ef0 msgr2=0x7ff0f0197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:15.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0f0102ef0 0x7ff0f0197e70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4005910 tx=0x7ff0e4005740 comp rx=0 tx=0).stop 2023-07-14T12:57:15.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 -- 172.21.15.17:0/587879993 shutdown_connections 2023-07-14T12:57:15.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0d80a11a0 0x7ff0d80a3650 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:15.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0f0103880 0x7ff0f019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:15.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0f0101d00 0x7ff0f0197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:15.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 --2- 172.21.15.17:0/587879993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0f0102ef0 0x7ff0f0197e70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:15.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 -- 172.21.15.17:0/587879993 >> 172.21.15.17:0/587879993 conn(0x7ff0f00fd320 msgr2=0x7ff0f01063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:15.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 -- 172.21.15.17:0/587879993 shutdown_connections 2023-07-14T12:57:15.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:15.211+0000 7ff0f51ff700 1 -- 172.21.15.17:0/587879993 wait complete. 2023-07-14T12:57:15.241 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2023-07-14T12:57:16.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:16.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.135:6834/1201140251,v1:172.21.15.135:6835/1201140251] up:boot 2023-07-14T12:57:16.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: fsmap 6 up:standby 2023-07-14T12:57:16.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-14T12:57:16.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:16.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:16.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:16.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:16.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:16.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:16.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: Deploying daemon mds.c on smithi135 2023-07-14T12:57:16.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:15 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/587879993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:16.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:16.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.135:6834/1201140251,v1:172.21.15.135:6835/1201140251] up:boot 2023-07-14T12:57:16.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: fsmap 6 up:standby 2023-07-14T12:57:16.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-14T12:57:16.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:16.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:16.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:16.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:16.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:16.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:16.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: Deploying daemon mds.c on smithi135 2023-07-14T12:57:16.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:15 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/587879993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:16.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:16.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.135:6834/1201140251,v1:172.21.15.135:6835/1201140251] up:boot 2023-07-14T12:57:16.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: fsmap 6 up:standby 2023-07-14T12:57:16.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-14T12:57:16.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:16.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:16.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:16.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:16.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:16.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:16.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: Deploying daemon mds.c on smithi135 2023-07-14T12:57:16.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:15 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/587879993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:17.218 INFO:journalctl@ceph.mds.c.smithi135.stdout:Jul 14 12:57:17 smithi135 systemd[1]: Starting Ceph mds.c for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:57:17.258 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:17.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.444+0000 7f8c349ff700 1 -- 172.21.15.17:0/724954990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c300ffb00 msgr2=0x7f8c300fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:17.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.444+0000 7f8c349ff700 1 --2- 172.21.15.17:0/724954990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c300ffb00 0x7f8c300fff10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009990 tx=0x7f8c20009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:17.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.444+0000 7f8c349ff700 1 -- 172.21.15.17:0/724954990 shutdown_connections 2023-07-14T12:57:17.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.444+0000 7f8c349ff700 1 --2- 172.21.15.17:0/724954990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c30101680 0x7f8c30107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:17.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.444+0000 7f8c349ff700 1 --2- 172.21.15.17:0/724954990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c300ffb00 0x7f8c300fff10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:17.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.444+0000 7f8c349ff700 1 --2- 172.21.15.17:0/724954990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c30100cf0 0x7f8c30101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:17.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.444+0000 7f8c349ff700 1 -- 172.21.15.17:0/724954990 >> 172.21.15.17:0/724954990 conn(0x7f8c300fb0e0 msgr2=0x7f8c300fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:17.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.444+0000 7f8c349ff700 1 -- 172.21.15.17:0/724954990 shutdown_connections 2023-07-14T12:57:17.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.444+0000 7f8c349ff700 1 -- 172.21.15.17:0/724954990 wait complete. 2023-07-14T12:57:17.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.445+0000 7f8c349ff700 1 Processor -- start 2023-07-14T12:57:17.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.445+0000 7f8c349ff700 1 -- start start 2023-07-14T12:57:17.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.445+0000 7f8c349ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c300ffb00 0x7f8c30197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:17.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.445+0000 7f8c349ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c30100cf0 0x7f8c30197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:17.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.445+0000 7f8c349ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c30101680 0x7f8c3019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.445+0000 7f8c349ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3019f500 con 0x7f8c300ffb00 2023-07-14T12:57:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.445+0000 7f8c349ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3019f640 con 0x7f8c30101680 2023-07-14T12:57:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.445+0000 7f8c349ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3019f7d0 con 0x7f8c30100cf0 2023-07-14T12:57:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.446+0000 7f8c2e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c300ffb00 0x7f8c30197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.446+0000 7f8c27fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c30100cf0 0x7f8c30197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.446+0000 7f8c2e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c300ffb00 0x7f8c30197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48938/0 (socket says 172.21.15.17:48938) 2023-07-14T12:57:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.446+0000 7f8c2e59c700 1 -- 172.21.15.17:0/2710586421 learned_addr learned my addr 172.21.15.17:0/2710586421 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.446+0000 7f8c2ed9d700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c30101680 0x7f8c3019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.446+0000 7f8c2e59c700 1 -- 172.21.15.17:0/2710586421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c30100cf0 msgr2=0x7f8c30197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.446+0000 7f8c2e59c700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c30100cf0 0x7f8c30197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.446+0000 7f8c2e59c700 1 -- 172.21.15.17:0/2710586421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c30101680 msgr2=0x7f8c3019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.446+0000 7f8c2e59c700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c30101680 0x7f8c3019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.446+0000 7f8c2e59c700 1 -- 172.21.15.17:0/2710586421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c200095f0 con 0x7f8c300ffb00 2023-07-14T12:57:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.446+0000 7f8c2e59c700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c300ffb00 0x7f8c30197980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000b5c0 tx=0x7f8c20005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.447+0000 7f8c277fe700 1 -- 172.21.15.17:0/2710586421 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2001d070 con 0x7f8c300ffb00 2023-07-14T12:57:17.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.447+0000 7f8c277fe700 1 -- 172.21.15.17:0/2710586421 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c20003ec0 con 0x7f8c300ffb00 2023-07-14T12:57:17.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.447+0000 7f8c349ff700 1 -- 172.21.15.17:0/2710586421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3019fa50 con 0x7f8c300ffb00 2023-07-14T12:57:17.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.447+0000 7f8c277fe700 1 -- 172.21.15.17:0/2710586421 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20022be0 con 0x7f8c300ffb00 2023-07-14T12:57:17.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.447+0000 7f8c349ff700 1 -- 172.21.15.17:0/2710586421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3019fe70 con 0x7f8c300ffb00 2023-07-14T12:57:17.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.448+0000 7f8c349ff700 1 -- 172.21.15.17:0/2710586421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3010b1d0 con 0x7f8c300ffb00 2023-07-14T12:57:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.450+0000 7f8c277fe700 1 -- 172.21.15.17:0/2710586421 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8c20004030 con 0x7f8c300ffb00 2023-07-14T12:57:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.451+0000 7f8c277fe700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c1c0a11a0 0x7f8c1c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.451+0000 7f8c277fe700 1 -- 172.21.15.17:0/2710586421 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8c200cdb80 con 0x7f8c300ffb00 2023-07-14T12:57:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.451+0000 7f8c27fff700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c1c0a11a0 0x7f8c1c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:17.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.452+0000 7f8c27fff700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c1c0a11a0 0x7f8c1c0a3650 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8c18007c60 tx=0x7f8c180073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:17.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.455+0000 7f8c277fe700 1 -- 172.21.15.17:0/2710586421 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8c20097760 con 0x7f8c300ffb00 2023-07-14T12:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.712+0000 7f8c349ff700 1 -- 172.21.15.17:0/2710586421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c3010b3c0 con 0x7f8c300ffb00 2023-07-14T12:57:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.712+0000 7f8c277fe700 1 -- 172.21.15.17:0/2710586421 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5045 (secure 0 0 0) 0x7f8c2009ad80 con 0x7f8c300ffb00 2023-07-14T12:57:17.741 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:17.741 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2023-07-14T12:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 -- 172.21.15.17:0/2710586421 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c1c0a11a0 msgr2=0x7f8c1c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c1c0a11a0 0x7f8c1c0a3650 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8c18007c60 tx=0x7f8c180073d0 comp rx=0 tx=0).stop 2023-07-14T12:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 -- 172.21.15.17:0/2710586421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c300ffb00 msgr2=0x7f8c30197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c300ffb00 0x7f8c30197980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000b5c0 tx=0x7f8c20005740 comp rx=0 tx=0).stop 2023-07-14T12:57:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 -- 172.21.15.17:0/2710586421 shutdown_connections 2023-07-14T12:57:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8c1c0a11a0 0x7f8c1c0a3650 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c30101680 0x7f8c3019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c300ffb00 0x7f8c30197980 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 --2- 172.21.15.17:0/2710586421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c30100cf0 0x7f8c30197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 -- 172.21.15.17:0/2710586421 >> 172.21.15.17:0/2710586421 conn(0x7f8c300fb0e0 msgr2=0x7f8c300fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 -- 172.21.15.17:0/2710586421 shutdown_connections 2023-07-14T12:57:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:17.715+0000 7f8c349ff700 1 -- 172.21.15.17:0/2710586421 wait complete. 2023-07-14T12:57:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2023-07-14T12:57:17.975 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:17 smithi135 ceph-mon[97338]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:17.975 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:17 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2710586421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:17.975 INFO:journalctl@ceph.mds.c.smithi135.stdout:Jul 14 12:57:17 smithi135 podman[123326]: 2023-07-14T12:57:18.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:17 smithi017 ceph-mon[95536]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:18.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:17 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2710586421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:18.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:17 smithi131 ceph-mon[96953]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:18.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:17 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2710586421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:18.446 INFO:journalctl@ceph.mds.c.smithi135.stdout:Jul 14 12:57:17 smithi135 bash[123326]: cc817b8521a9bf6792bfd3127d6110c1233302d29058ddb4c1cfe08879476d79 2023-07-14T12:57:18.446 INFO:journalctl@ceph.mds.c.smithi135.stdout:Jul 14 12:57:17 smithi135 ceph-mds[123366]: -- 172.21.15.135:0/2772057100 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a002c431e0 con 0x55a002c18800 2023-07-14T12:57:18.446 INFO:journalctl@ceph.mds.c.smithi135.stdout:Jul 14 12:57:17 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-c[123342]: starting mds.c at 2023-07-14T12:57:18.446 INFO:journalctl@ceph.mds.c.smithi135.stdout:Jul 14 12:57:18 smithi135 systemd[1]: Started Ceph mds.c for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:57:19.401 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:19.402 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:19.402 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:19.402 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:19.402 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:19.402 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:19.403 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:19 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.135:6836/4030549564,v1:172.21.15.135:6837/4030549564] up:boot 2023-07-14T12:57:19.403 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:19 smithi131 ceph-mon[96953]: fsmap 7 up:standby 2023-07-14T12:57:19.403 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:19 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-14T12:57:19.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:19.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:19.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:19.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:19.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:19.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:19.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:19 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.135:6836/4030549564,v1:172.21.15.135:6837/4030549564] up:boot 2023-07-14T12:57:19.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:19 smithi135 ceph-mon[97338]: fsmap 7 up:standby 2023-07-14T12:57:19.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:19 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-14T12:57:19.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:19.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:19.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:19.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:19.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:19.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:19.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:19 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.135:6836/4030549564,v1:172.21.15.135:6837/4030549564] up:boot 2023-07-14T12:57:19.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:19 smithi017 ceph-mon[95536]: fsmap 7 up:standby 2023-07-14T12:57:19.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:19 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-14T12:57:19.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.948+0000 7fe61fdff700 1 -- 172.21.15.17:0/3912457545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6180ffb00 msgr2=0x7fe6180fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.948+0000 7fe61fdff700 1 --2- 172.21.15.17:0/3912457545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6180ffb00 0x7fe6180fff10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe614009990 tx=0x7fe614009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.948+0000 7fe61fdff700 1 -- 172.21.15.17:0/3912457545 shutdown_connections 2023-07-14T12:57:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.948+0000 7fe61fdff700 1 --2- 172.21.15.17:0/3912457545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe618101680 0x7fe618107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.948+0000 7fe61fdff700 1 --2- 172.21.15.17:0/3912457545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6180ffb00 0x7fe6180fff10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:19.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.948+0000 7fe61fdff700 1 --2- 172.21.15.17:0/3912457545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe618100cf0 0x7fe618101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:19.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.948+0000 7fe61fdff700 1 -- 172.21.15.17:0/3912457545 >> 172.21.15.17:0/3912457545 conn(0x7fe6180fb0e0 msgr2=0x7fe6180fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:19.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.948+0000 7fe61fdff700 1 -- 172.21.15.17:0/3912457545 shutdown_connections 2023-07-14T12:57:19.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.949+0000 7fe61fdff700 1 -- 172.21.15.17:0/3912457545 wait complete. 2023-07-14T12:57:19.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.949+0000 7fe61fdff700 1 Processor -- start 2023-07-14T12:57:19.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61fdff700 1 -- start start 2023-07-14T12:57:19.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61fdff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6180ffb00 0x7fe618195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:19.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61fdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe618100cf0 0x7fe618195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:19.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61fdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe618101680 0x7fe61819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:19.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61fdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61819d280 con 0x7fe618101680 2023-07-14T12:57:19.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61fdff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61819d3c0 con 0x7fe6180ffb00 2023-07-14T12:57:19.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61fdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61819d550 con 0x7fe618100cf0 2023-07-14T12:57:19.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61db9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6180ffb00 0x7fe618195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61e39c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe618101680 0x7fe61819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61db9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6180ffb00 0x7fe618195700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:42484/0 (socket says 172.21.15.17:42484) 2023-07-14T12:57:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61db9b700 1 -- 172.21.15.17:0/1186388452 learned_addr learned my addr 172.21.15.17:0/1186388452 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.950+0000 7fe61d39a700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe618100cf0 0x7fe618195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe61db9b700 1 -- 172.21.15.17:0/1186388452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe618100cf0 msgr2=0x7fe618195c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe61db9b700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe618100cf0 0x7fe618195c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe61db9b700 1 -- 172.21.15.17:0/1186388452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe618101680 msgr2=0x7fe61819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:19.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe61db9b700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe618101680 0x7fe61819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:19.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe61db9b700 1 -- 172.21.15.17:0/1186388452 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140095f0 con 0x7fe6180ffb00 2023-07-14T12:57:19.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe61d39a700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe618100cf0 0x7fe618195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:57:19.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe61e39c700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe618101680 0x7fe61819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:57:19.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe61db9b700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6180ffb00 0x7fe618195700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6140098e0 tx=0x7fe614004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:19.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe60effd700 1 -- 172.21.15.17:0/1186388452 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61401d070 con 0x7fe6180ffb00 2023-07-14T12:57:19.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe60effd700 1 -- 172.21.15.17:0/1186388452 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe61400bdd0 con 0x7fe6180ffb00 2023-07-14T12:57:19.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe60effd700 1 -- 172.21.15.17:0/1186388452 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe614022d70 con 0x7fe6180ffb00 2023-07-14T12:57:19.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe61fdff700 1 -- 172.21.15.17:0/1186388452 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61819d7d0 con 0x7fe6180ffb00 2023-07-14T12:57:19.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.951+0000 7fe61fdff700 1 -- 172.21.15.17:0/1186388452 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61819dba0 con 0x7fe6180ffb00 2023-07-14T12:57:19.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.952+0000 7fe61fdff700 1 -- 172.21.15.17:0/1186388452 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61810b1d0 con 0x7fe6180ffb00 2023-07-14T12:57:19.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.954+0000 7fe60effd700 1 -- 172.21.15.17:0/1186388452 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe614022470 con 0x7fe6180ffb00 2023-07-14T12:57:19.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.956+0000 7fe60effd700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6040a11a0 0x7fe6040a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:19.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.956+0000 7fe60effd700 1 -- 172.21.15.17:0/1186388452 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe6140ce2d0 con 0x7fe6180ffb00 2023-07-14T12:57:19.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.956+0000 7fe61d39a700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6040a11a0 0x7fe6040a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:19.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.956+0000 7fe61d39a700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6040a11a0 0x7fe6040a3650 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe608005fd0 tx=0x7fe608005e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:19.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:19.958+0000 7fe60effd700 1 -- 172.21.15.17:0/1186388452 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe614097eb0 con 0x7fe6180ffb00 2023-07-14T12:57:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.218+0000 7fe61fdff700 1 -- 172.21.15.17:0/1186388452 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6181069b0 con 0x7fe6180ffb00 2023-07-14T12:57:20.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.219+0000 7fe60effd700 1 -- 172.21.15.17:0/1186388452 <== mon.2 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5805 (secure 0 0 0) 0x7fe61409b4d0 con 0x7fe6180ffb00 2023-07-14T12:57:20.248 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:20.248 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-07-14T12:57:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 -- 172.21.15.17:0/1186388452 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6040a11a0 msgr2=0x7fe6040a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:20.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6040a11a0 0x7fe6040a3650 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe608005fd0 tx=0x7fe608005e30 comp rx=0 tx=0).stop 2023-07-14T12:57:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 -- 172.21.15.17:0/1186388452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6180ffb00 msgr2=0x7fe618195700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6180ffb00 0x7fe618195700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6140098e0 tx=0x7fe614004730 comp rx=0 tx=0).stop 2023-07-14T12:57:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 -- 172.21.15.17:0/1186388452 shutdown_connections 2023-07-14T12:57:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6040a11a0 0x7fe6040a3650 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe618101680 0x7fe61819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6180ffb00 0x7fe618195700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:20.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 --2- 172.21.15.17:0/1186388452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe618100cf0 0x7fe618195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 -- 172.21.15.17:0/1186388452 >> 172.21.15.17:0/1186388452 conn(0x7fe6180fb0e0 msgr2=0x7fe6180fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 -- 172.21.15.17:0/1186388452 shutdown_connections 2023-07-14T12:57:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:20.222+0000 7fe61fdff700 1 -- 172.21.15.17:0/1186388452 wait complete. 2023-07-14T12:57:20.252 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2023-07-14T12:57:20.382 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:20 smithi131 ceph-mon[96953]: Deploying daemon mds.h on smithi131 2023-07-14T12:57:20.382 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:20 smithi131 ceph-mon[96953]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:20.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:20 smithi135 ceph-mon[97338]: Deploying daemon mds.h on smithi131 2023-07-14T12:57:20.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:20 smithi135 ceph-mon[97338]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:20.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:20 smithi017 ceph-mon[95536]: Deploying daemon mds.h on smithi131 2023-07-14T12:57:20.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:20 smithi017 ceph-mon[95536]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:20.744 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 12:57:20 smithi131 systemd[1]: Starting Ceph mds.h for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:57:21.158 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 12:57:20 smithi131 podman[121916]: 2023-07-14T12:57:21.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:21 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1186388452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:21.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:21 smithi135 ceph-mon[97338]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:21.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:21 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1186388452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:21.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:21 smithi131 ceph-mon[96953]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:21.495 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 12:57:21 smithi131 ceph-mds[121956]: -- 172.21.15.131:0/2138499811 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557f9ff851e0 con 0x557f9ff5a800 2023-07-14T12:57:21.495 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 12:57:21 smithi131 bash[121916]: d1276eaacf53d1f83a8a4746729259e7a04d17fc6f4722970a59e95ed9dff2c6 2023-07-14T12:57:21.495 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 12:57:21 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-h[121932]: starting mds.h at 2023-07-14T12:57:21.496 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 12:57:21 smithi131 systemd[1]: Started Ceph mds.h for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:57:21.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:21 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1186388452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:21.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:21 smithi017 ceph-mon[95536]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:22.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.457+0000 7ff97f3ff700 1 -- 172.21.15.17:0/3784779173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff978100cf0 msgr2=0x7ff978101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.457+0000 7ff97f3ff700 1 --2- 172.21.15.17:0/3784779173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff978100cf0 0x7ff978101140 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff968009990 tx=0x7ff968009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.458+0000 7ff97f3ff700 1 -- 172.21.15.17:0/3784779173 shutdown_connections 2023-07-14T12:57:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.458+0000 7ff97f3ff700 1 --2- 172.21.15.17:0/3784779173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff978101680 0x7ff978107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.458+0000 7ff97f3ff700 1 --2- 172.21.15.17:0/3784779173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9780ffb00 0x7ff9780fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.458+0000 7ff97f3ff700 1 --2- 172.21.15.17:0/3784779173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff978100cf0 0x7ff978101140 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.458+0000 7ff97f3ff700 1 -- 172.21.15.17:0/3784779173 >> 172.21.15.17:0/3784779173 conn(0x7ff9780fb0e0 msgr2=0x7ff9780fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.458+0000 7ff97f3ff700 1 -- 172.21.15.17:0/3784779173 shutdown_connections 2023-07-14T12:57:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.458+0000 7ff97f3ff700 1 -- 172.21.15.17:0/3784779173 wait complete. 2023-07-14T12:57:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97f3ff700 1 Processor -- start 2023-07-14T12:57:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97f3ff700 1 -- start start 2023-07-14T12:57:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97f3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9780ffb00 0x7ff978197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97f3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff978100cf0 0x7ff978197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97f3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff978101680 0x7ff97819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97f3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97819f500 con 0x7ff9780ffb00 2023-07-14T12:57:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97f3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97819f640 con 0x7ff978101680 2023-07-14T12:57:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97f3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97819f7d0 con 0x7ff978100cf0 2023-07-14T12:57:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97d19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9780ffb00 0x7ff978197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97d19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9780ffb00 0x7ff978197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48980/0 (socket says 172.21.15.17:48980) 2023-07-14T12:57:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97d19b700 1 -- 172.21.15.17:0/2973089196 learned_addr learned my addr 172.21.15.17:0/2973089196 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.459+0000 7ff97c99a700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff978100cf0 0x7ff978197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff97d99c700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff978101680 0x7ff97819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff97d19b700 1 -- 172.21.15.17:0/2973089196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff978100cf0 msgr2=0x7ff978197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:22.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff97d19b700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff978100cf0 0x7ff978197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff97d19b700 1 -- 172.21.15.17:0/2973089196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff978101680 msgr2=0x7ff97819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff97d19b700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff978101680 0x7ff97819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff97d19b700 1 -- 172.21.15.17:0/2973089196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680095f0 con 0x7ff9780ffb00 2023-07-14T12:57:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff97d99c700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff978101680 0x7ff97819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:57:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff97d19b700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9780ffb00 0x7ff978197980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff97400e970 tx=0x7ff97400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff96e7fc700 1 -- 172.21.15.17:0/2973089196 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974009790 con 0x7ff9780ffb00 2023-07-14T12:57:22.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff96e7fc700 1 -- 172.21.15.17:0/2973089196 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff97400eec0 con 0x7ff9780ffb00 2023-07-14T12:57:22.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff97f3ff700 1 -- 172.21.15.17:0/2973089196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97819fab0 con 0x7ff9780ffb00 2023-07-14T12:57:22.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff96e7fc700 1 -- 172.21.15.17:0/2973089196 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974003c10 con 0x7ff9780ffb00 2023-07-14T12:57:22.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.460+0000 7ff97f3ff700 1 -- 172.21.15.17:0/2973089196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9781a0010 con 0x7ff9780ffb00 2023-07-14T12:57:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.461+0000 7ff97f3ff700 1 -- 172.21.15.17:0/2973089196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff978192090 con 0x7ff9780ffb00 2023-07-14T12:57:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.464+0000 7ff96e7fc700 1 -- 172.21.15.17:0/2973089196 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff974003d90 con 0x7ff9780ffb00 2023-07-14T12:57:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.465+0000 7ff96e7fc700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff9640a1220 0x7ff9640a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.465+0000 7ff96e7fc700 1 -- 172.21.15.17:0/2973089196 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff974014070 con 0x7ff9780ffb00 2023-07-14T12:57:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.465+0000 7ff97c99a700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff9640a1220 0x7ff9640a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.466+0000 7ff97c99a700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff9640a1220 0x7ff9640a36d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff968006010 tx=0x7ff96800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.467+0000 7ff96e7fc700 1 -- 172.21.15.17:0/2973089196 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff9740963a0 con 0x7ff9780ffb00 2023-07-14T12:57:22.568 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:22 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:22.568 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:22 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:22.568 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:22 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:22.569 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:22 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:22.569 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:22 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:22.569 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:22 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:22.569 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:22 smithi135 ceph-mon[97338]: Deploying daemon mds.i on smithi135 2023-07-14T12:57:22.570 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:22 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] up:boot 2023-07-14T12:57:22.570 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:22 smithi135 ceph-mon[97338]: fsmap 8 up:standby 2023-07-14T12:57:22.570 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:22 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-14T12:57:22.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:22 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:22.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:22 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:22.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:22 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:22.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:22 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:22.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:22 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:22.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:22 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:22.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:22 smithi017 ceph-mon[95536]: Deploying daemon mds.i on smithi135 2023-07-14T12:57:22.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:22 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] up:boot 2023-07-14T12:57:22.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:22 smithi017 ceph-mon[95536]: fsmap 8 up:standby 2023-07-14T12:57:22.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:22 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-14T12:57:22.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:22 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:22.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:22 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:22.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:22 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:22.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:22 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:22.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:22 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:22.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:22 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:22.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:22 smithi131 ceph-mon[96953]: Deploying daemon mds.i on smithi135 2023-07-14T12:57:22.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:22 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] up:boot 2023-07-14T12:57:22.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:22 smithi131 ceph-mon[96953]: fsmap 8 up:standby 2023-07-14T12:57:22.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:22 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-14T12:57:22.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.721+0000 7ff97f3ff700 1 -- 172.21.15.17:0/2973089196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff97802c850 con 0x7ff9780ffb00 2023-07-14T12:57:22.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.722+0000 7ff96e7fc700 1 -- 172.21.15.17:0/2973089196 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6565 (secure 0 0 0) 0x7ff9740999c0 con 0x7ff9780ffb00 2023-07-14T12:57:22.751 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:22.751 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-07-14T12:57:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.724+0000 7ff97f3ff700 1 -- 172.21.15.17:0/2973089196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff9640a1220 msgr2=0x7ff9640a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.725+0000 7ff97f3ff700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff9640a1220 0x7ff9640a36d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff968006010 tx=0x7ff96800b260 comp rx=0 tx=0).stop 2023-07-14T12:57:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.725+0000 7ff97f3ff700 1 -- 172.21.15.17:0/2973089196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9780ffb00 msgr2=0x7ff978197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.725+0000 7ff97f3ff700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9780ffb00 0x7ff978197980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff97400e970 tx=0x7ff97400ec80 comp rx=0 tx=0).stop 2023-07-14T12:57:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.725+0000 7ff97f3ff700 1 -- 172.21.15.17:0/2973089196 shutdown_connections 2023-07-14T12:57:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.725+0000 7ff97f3ff700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff9640a1220 0x7ff9640a36d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.725+0000 7ff97f3ff700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff978101680 0x7ff97819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.725+0000 7ff97f3ff700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9780ffb00 0x7ff978197980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.725+0000 7ff97f3ff700 1 --2- 172.21.15.17:0/2973089196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff978100cf0 0x7ff978197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.725+0000 7ff97f3ff700 1 -- 172.21.15.17:0/2973089196 >> 172.21.15.17:0/2973089196 conn(0x7ff9780fb0e0 msgr2=0x7ff978106630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.725+0000 7ff97f3ff700 1 -- 172.21.15.17:0/2973089196 shutdown_connections 2023-07-14T12:57:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:22.725+0000 7ff97f3ff700 1 -- 172.21.15.17:0/2973089196 wait complete. 2023-07-14T12:57:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 9 2023-07-14T12:57:23.548 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:23 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2973089196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:23.548 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:23 smithi135 ceph-mon[97338]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:23.548 INFO:journalctl@ceph.mds.i.smithi135.stdout:Jul 14 12:57:23 smithi135 systemd[1]: Starting Ceph mds.i for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:57:23.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:23 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2973089196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:23.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:23 smithi017 ceph-mon[95536]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:23.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:23 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2973089196' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:23.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:23 smithi131 ceph-mon[96953]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:24.303 INFO:journalctl@ceph.mds.i.smithi135.stdout:Jul 14 12:57:24 smithi135 podman[123673]: 2023-07-14T12:57:24.303 INFO:journalctl@ceph.mds.i.smithi135.stdout:Jul 14 12:57:24 smithi135 bash[123673]: dedc40fb0d6e0331d498ff260806cdf1e73afc37d3f4fdc4a203c888379c1bae 2023-07-14T12:57:24.304 INFO:journalctl@ceph.mds.i.smithi135.stdout:Jul 14 12:57:24 smithi135 ceph-mds[123713]: -- 172.21.15.135:0/2243424349 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55acf762b1e0 con 0x55acf7601000 2023-07-14T12:57:24.304 INFO:journalctl@ceph.mds.i.smithi135.stdout:Jul 14 12:57:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-i[123689]: starting mds.i at 2023-07-14T12:57:24.696 INFO:journalctl@ceph.mds.i.smithi135.stdout:Jul 14 12:57:24 smithi135 systemd[1]: Started Ceph mds.i for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:57:24.773 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:24.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.956+0000 7f0a355ff700 1 -- 172.21.15.17:0/510024441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a30100560 msgr2=0x7f0a30102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:24.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.956+0000 7f0a355ff700 1 --2- 172.21.15.17:0/510024441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a30100560 0x7f0a30102940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009990 tx=0x7f0a20009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.956+0000 7f0a355ff700 1 -- 172.21.15.17:0/510024441 shutdown_connections 2023-07-14T12:57:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.956+0000 7f0a355ff700 1 --2- 172.21.15.17:0/510024441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a301057a0 0x7f0a30107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.956+0000 7f0a355ff700 1 --2- 172.21.15.17:0/510024441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a30100560 0x7f0a30102940 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:24.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.956+0000 7f0a355ff700 1 --2- 172.21.15.17:0/510024441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a30102e80 0x7f0a30105260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.956+0000 7f0a355ff700 1 -- 172.21.15.17:0/510024441 >> 172.21.15.17:0/510024441 conn(0x7f0a300fa000 msgr2=0x7f0a300fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.957+0000 7f0a355ff700 1 -- 172.21.15.17:0/510024441 shutdown_connections 2023-07-14T12:57:24.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.957+0000 7f0a355ff700 1 -- 172.21.15.17:0/510024441 wait complete. 2023-07-14T12:57:24.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.958+0000 7f0a355ff700 1 Processor -- start 2023-07-14T12:57:24.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.958+0000 7f0a355ff700 1 -- start start 2023-07-14T12:57:24.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.958+0000 7f0a355ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a30100560 0x7f0a30197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:24.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.958+0000 7f0a355ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a30102e80 0x7f0a30197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:24.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.958+0000 7f0a355ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a301057a0 0x7f0a3019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:24.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.958+0000 7f0a355ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3019f4f0 con 0x7f0a301057a0 2023-07-14T12:57:24.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.958+0000 7f0a355ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3019f630 con 0x7f0a30100560 2023-07-14T12:57:24.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.958+0000 7f0a355ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3019f7c0 con 0x7f0a30102e80 2023-07-14T12:57:24.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.959+0000 7f0a2e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a30102e80 0x7f0a30197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:24.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.959+0000 7f0a2effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a30100560 0x7f0a30197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.959+0000 7f0a2effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a30100560 0x7f0a30197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:46456/0 (socket says 172.21.15.17:46456) 2023-07-14T12:57:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.959+0000 7f0a2effd700 1 -- 172.21.15.17:0/3297492890 learned_addr learned my addr 172.21.15.17:0/3297492890 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.959+0000 7f0a2f7fe700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a301057a0 0x7f0a3019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:24.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.959+0000 7f0a2effd700 1 -- 172.21.15.17:0/3297492890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a30102e80 msgr2=0x7f0a30197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:24.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.959+0000 7f0a2effd700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a30102e80 0x7f0a30197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:24.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.959+0000 7f0a2effd700 1 -- 172.21.15.17:0/3297492890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a301057a0 msgr2=0x7f0a3019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:24.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.959+0000 7f0a2effd700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a301057a0 0x7f0a3019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:24.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.959+0000 7f0a2effd700 1 -- 172.21.15.17:0/3297492890 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a200095f0 con 0x7f0a30100560 2023-07-14T12:57:24.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.959+0000 7f0a2effd700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a30100560 0x7f0a30197970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0a20005910 tx=0x7f0a20005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.960+0000 7f0a17fff700 1 -- 172.21.15.17:0/3297492890 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2001d070 con 0x7f0a30100560 2023-07-14T12:57:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.960+0000 7f0a355ff700 1 -- 172.21.15.17:0/3297492890 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3019fa40 con 0x7f0a30100560 2023-07-14T12:57:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.960+0000 7f0a17fff700 1 -- 172.21.15.17:0/3297492890 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a20022470 con 0x7f0a30100560 2023-07-14T12:57:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.960+0000 7f0a17fff700 1 -- 172.21.15.17:0/3297492890 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20022ea0 con 0x7f0a30100560 2023-07-14T12:57:24.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.960+0000 7f0a355ff700 1 -- 172.21.15.17:0/3297492890 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3019ff40 con 0x7f0a30100560 2023-07-14T12:57:24.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.961+0000 7f0a355ff700 1 -- 172.21.15.17:0/3297492890 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a30107330 con 0x7f0a30100560 2023-07-14T12:57:24.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.963+0000 7f0a17fff700 1 -- 172.21.15.17:0/3297492890 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0a2000ba60 con 0x7f0a30100560 2023-07-14T12:57:24.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.964+0000 7f0a17fff700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a180a11a0 0x7f0a180a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:24.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.965+0000 7f0a17fff700 1 -- 172.21.15.17:0/3297492890 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0a200cd810 con 0x7f0a30100560 2023-07-14T12:57:24.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.965+0000 7f0a2e7fc700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a180a11a0 0x7f0a180a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:24.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.965+0000 7f0a2e7fc700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a180a11a0 0x7f0a180a3650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009c60 tx=0x7f0a24009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:24.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:24.967+0000 7f0a17fff700 1 -- 172.21.15.17:0/3297492890 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0a200973f0 con 0x7f0a30100560 2023-07-14T12:57:25.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.237+0000 7f0a355ff700 1 -- 172.21.15.17:0/3297492890 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a3002c850 con 0x7f0a30100560 2023-07-14T12:57:25.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.238+0000 7f0a17fff700 1 -- 172.21.15.17:0/3297492890 <== mon.2 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7327 (secure 0 0 0) 0x7f0a2009aa10 con 0x7f0a30100560 2023-07-14T12:57:25.266 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:25.266 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24547,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-07-14T12:57:25.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 -- 172.21.15.17:0/3297492890 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a180a11a0 msgr2=0x7f0a180a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:25.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a180a11a0 0x7f0a180a3650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009c60 tx=0x7f0a24009260 comp rx=0 tx=0).stop 2023-07-14T12:57:25.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 -- 172.21.15.17:0/3297492890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a30100560 msgr2=0x7f0a30197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:25.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a30100560 0x7f0a30197970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0a20005910 tx=0x7f0a20005720 comp rx=0 tx=0).stop 2023-07-14T12:57:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 -- 172.21.15.17:0/3297492890 shutdown_connections 2023-07-14T12:57:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a180a11a0 0x7f0a180a3650 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:25.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a301057a0 0x7f0a3019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:25.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a30100560 0x7f0a30197970 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:25.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 --2- 172.21.15.17:0/3297492890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a30102e80 0x7f0a30197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:25.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 -- 172.21.15.17:0/3297492890 >> 172.21.15.17:0/3297492890 conn(0x7f0a300fa000 msgr2=0x7f0a300febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:25.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 -- 172.21.15.17:0/3297492890 shutdown_connections 2023-07-14T12:57:25.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:25.240+0000 7f0a355ff700 1 -- 172.21.15.17:0/3297492890 wait complete. 2023-07-14T12:57:25.270 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 10 2023-07-14T12:57:25.588 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] up:boot 2023-07-14T12:57:25.588 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: fsmap 9 up:standby 2023-07-14T12:57:25.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-14T12:57:25.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:25.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:25.589 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:25.590 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:25.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: Deploying daemon mds.g on smithi017 2023-07-14T12:57:25.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:25.591 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:25 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3297492890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:25.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] up:boot 2023-07-14T12:57:25.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: fsmap 9 up:standby 2023-07-14T12:57:25.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-14T12:57:25.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:25.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:25.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:25.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:25.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:25.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:25.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: Deploying daemon mds.g on smithi017 2023-07-14T12:57:25.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:25.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:25 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3297492890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:25.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] up:boot 2023-07-14T12:57:25.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: fsmap 9 up:standby 2023-07-14T12:57:25.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-14T12:57:25.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:25.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:25.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:25.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:25.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:25.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:25.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: Deploying daemon mds.g on smithi017 2023-07-14T12:57:25.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:25.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:25 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3297492890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:27.105 INFO:journalctl@ceph.mds.g.smithi017.stdout:Jul 14 12:57:26 smithi017 systemd[1]: Starting Ceph mds.g for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:57:27.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:27.484 INFO:journalctl@ceph.mds.g.smithi017.stdout:Jul 14 12:57:27 smithi017 podman[129330]: 2023-07-14T12:57:27.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.481+0000 7f9aab3ff700 1 -- 172.21.15.17:0/1032852249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa4072f70 msgr2=0x7f9aa40733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:27.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.481+0000 7f9aab3ff700 1 --2- 172.21.15.17:0/1032852249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa4072f70 0x7f9aa40733e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009990 tx=0x7f9a94009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:27.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.481+0000 7f9aab3ff700 1 -- 172.21.15.17:0/1032852249 shutdown_connections 2023-07-14T12:57:27.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.481+0000 7f9aab3ff700 1 --2- 172.21.15.17:0/1032852249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9aa41079c0 0x7f9aa4109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:27.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.481+0000 7f9aab3ff700 1 --2- 172.21.15.17:0/1032852249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa4074550 0x7f9aa40729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:27.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.481+0000 7f9aab3ff700 1 --2- 172.21.15.17:0/1032852249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa4072f70 0x7f9aa40733e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:27.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.481+0000 7f9aab3ff700 1 -- 172.21.15.17:0/1032852249 >> 172.21.15.17:0/1032852249 conn(0x7f9aa40fb0e0 msgr2=0x7f9aa40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:27.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.481+0000 7f9aab3ff700 1 -- 172.21.15.17:0/1032852249 shutdown_connections 2023-07-14T12:57:27.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.481+0000 7f9aab3ff700 1 -- 172.21.15.17:0/1032852249 wait complete. 2023-07-14T12:57:27.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.482+0000 7f9aab3ff700 1 Processor -- start 2023-07-14T12:57:27.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.482+0000 7f9aab3ff700 1 -- start start 2023-07-14T12:57:27.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aab3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa4072f70 0x7f9aa4197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:27.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aab3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa4074550 0x7f9aa4197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:27.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aab3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9aa41079c0 0x7f9aa419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:27.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aab3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa419f4a0 con 0x7f9aa4072f70 2023-07-14T12:57:27.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aab3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa419f5e0 con 0x7f9aa41079c0 2023-07-14T12:57:27.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aab3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa419f770 con 0x7f9aa4074550 2023-07-14T12:57:27.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aa919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa4072f70 0x7f9aa4197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:27.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aa919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa4072f70 0x7f9aa4197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42402/0 (socket says 172.21.15.17:42402) 2023-07-14T12:57:27.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aa919b700 1 -- 172.21.15.17:0/3976877193 learned_addr learned my addr 172.21.15.17:0/3976877193 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:27.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aa899a700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa4074550 0x7f9aa4197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:27.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aa999c700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9aa41079c0 0x7f9aa419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:27.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aa919b700 1 -- 172.21.15.17:0/3976877193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa4074550 msgr2=0x7f9aa4197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:27.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aa919b700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa4074550 0x7f9aa4197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:27.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aa919b700 1 -- 172.21.15.17:0/3976877193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9aa41079c0 msgr2=0x7f9aa419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:27.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aa919b700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9aa41079c0 0x7f9aa419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:27.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aa919b700 1 -- 172.21.15.17:0/3976877193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a940095f0 con 0x7f9aa4072f70 2023-07-14T12:57:27.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.483+0000 7f9aa999c700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9aa41079c0 0x7f9aa419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:57:27.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.484+0000 7f9aa919b700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa4072f70 0x7f9aa4197920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000d980 tx=0x7f9aa000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:27.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.484+0000 7f9a9a7fc700 1 -- 172.21.15.17:0/3976877193 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0009930 con 0x7f9aa4072f70 2023-07-14T12:57:27.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.484+0000 7f9aab3ff700 1 -- 172.21.15.17:0/3976877193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa419fa50 con 0x7f9aa4072f70 2023-07-14T12:57:27.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.484+0000 7f9a9a7fc700 1 -- 172.21.15.17:0/3976877193 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9aa0010460 con 0x7f9aa4072f70 2023-07-14T12:57:27.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.484+0000 7f9a9a7fc700 1 -- 172.21.15.17:0/3976877193 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000f620 con 0x7f9aa4072f70 2023-07-14T12:57:27.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.484+0000 7f9aab3ff700 1 -- 172.21.15.17:0/3976877193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa419ff60 con 0x7f9aa4072f70 2023-07-14T12:57:27.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.485+0000 7f9aab3ff700 1 -- 172.21.15.17:0/3976877193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa4106070 con 0x7f9aa4072f70 2023-07-14T12:57:27.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.487+0000 7f9a9a7fc700 1 -- 172.21.15.17:0/3976877193 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9aa00105d0 con 0x7f9aa4072f70 2023-07-14T12:57:27.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.489+0000 7f9a9a7fc700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9a900a11a0 0x7f9a900a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:27.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.489+0000 7f9a9a7fc700 1 -- 172.21.15.17:0/3976877193 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9aa00cbfc0 con 0x7f9aa4072f70 2023-07-14T12:57:27.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.489+0000 7f9aa899a700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9a900a11a0 0x7f9a900a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:27.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.490+0000 7f9aa899a700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9a900a11a0 0x7f9a900a3650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a94000c00 tx=0x7f9a9400b560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:27.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.493+0000 7f9a9a7fc700 1 -- 172.21.15.17:0/3976877193 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9aa0095b10 con 0x7f9aa4072f70 2023-07-14T12:57:27.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.757+0000 7f9aab3ff700 1 -- 172.21.15.17:0/3976877193 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9aa402cce0 con 0x7f9aa4072f70 2023-07-14T12:57:27.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.757+0000 7f9a9a7fc700 1 -- 172.21.15.17:0/3976877193 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7327 (secure 0 0 0) 0x7f9aa0099130 con 0x7f9aa4072f70 2023-07-14T12:57:27.786 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:27.786 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24547,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-07-14T12:57:27.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 -- 172.21.15.17:0/3976877193 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9a900a11a0 msgr2=0x7f9a900a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9a900a11a0 0x7f9a900a3650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a94000c00 tx=0x7f9a9400b560 comp rx=0 tx=0).stop 2023-07-14T12:57:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 -- 172.21.15.17:0/3976877193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa4072f70 msgr2=0x7f9aa4197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa4072f70 0x7f9aa4197920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000d980 tx=0x7f9aa000dc90 comp rx=0 tx=0).stop 2023-07-14T12:57:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 -- 172.21.15.17:0/3976877193 shutdown_connections 2023-07-14T12:57:27.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9a900a11a0 0x7f9a900a3650 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9aa41079c0 0x7f9aa419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa4072f70 0x7f9aa4197920 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 --2- 172.21.15.17:0/3976877193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9aa4074550 0x7f9aa4197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 -- 172.21.15.17:0/3976877193 >> 172.21.15.17:0/3976877193 conn(0x7f9aa40fb0e0 msgr2=0x7f9aa40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 -- 172.21.15.17:0/3976877193 shutdown_connections 2023-07-14T12:57:27.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:27.760+0000 7f9aab3ff700 1 -- 172.21.15.17:0/3976877193 wait complete. 2023-07-14T12:57:27.791 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 10 2023-07-14T12:57:27.806 INFO:journalctl@ceph.mds.g.smithi017.stdout:Jul 14 12:57:27 smithi017 bash[129330]: 22866e12b69af2be51d99040c1f388ac0d539d88b4930d102b52f0a6fefbf088 2023-07-14T12:57:27.806 INFO:journalctl@ceph.mds.g.smithi017.stdout:Jul 14 12:57:27 smithi017 ceph-mds[129393]: -- 172.21.15.17:0/2324511285 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5651e3e5b1e0 con 0x5651e3e30800 2023-07-14T12:57:27.806 INFO:journalctl@ceph.mds.g.smithi017.stdout:Jul 14 12:57:27 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-g[129352]: starting mds.g at 2023-07-14T12:57:27.806 INFO:journalctl@ceph.mds.g.smithi017.stdout:Jul 14 12:57:27 smithi017 systemd[1]: Started Ceph mds.g for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:57:28.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:27 smithi017 ceph-mon[95536]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:28.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:28.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:28.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:28.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:28.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:28.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:27 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:28.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:27 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3976877193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:28.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:27 smithi135 ceph-mon[97338]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:28.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:28.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:28.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:28.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:28.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:28.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:27 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:28.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:27 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3976877193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:28.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:27 smithi131 ceph-mon[96953]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:28.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:28.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:28.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:28.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:28.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:28.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:27 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:28.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:27 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3976877193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:29.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:28 smithi135 ceph-mon[97338]: Deploying daemon mds.a on smithi017 2023-07-14T12:57:29.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:28 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.17:6838/3827721971,v1:172.21.15.17:6839/3827721971] up:boot 2023-07-14T12:57:29.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:28 smithi135 ceph-mon[97338]: fsmap 10 up:standby 2023-07-14T12:57:29.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:28 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-14T12:57:29.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:28 smithi131 ceph-mon[96953]: Deploying daemon mds.a on smithi017 2023-07-14T12:57:29.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:28 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.17:6838/3827721971,v1:172.21.15.17:6839/3827721971] up:boot 2023-07-14T12:57:29.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:28 smithi131 ceph-mon[96953]: fsmap 10 up:standby 2023-07-14T12:57:29.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:28 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-14T12:57:29.333 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:28 smithi017 ceph-mon[95536]: Deploying daemon mds.a on smithi017 2023-07-14T12:57:29.334 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:28 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.17:6838/3827721971,v1:172.21.15.17:6839/3827721971] up:boot 2023-07-14T12:57:29.334 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:28 smithi017 ceph-mon[95536]: fsmap 10 up:standby 2023-07-14T12:57:29.334 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:28 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-14T12:57:29.808 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:29.999 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:29 smithi017 ceph-mon[95536]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:29.999 INFO:journalctl@ceph.mds.a.smithi017.stdout:Jul 14 12:57:29 smithi017 systemd[1]: Starting Ceph mds.a for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:57:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.100+0000 7f7c277ff700 1 -- 172.21.15.17:0/867991357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c20074550 msgr2=0x7f7c200729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.100+0000 7f7c277ff700 1 --2- 172.21.15.17:0/867991357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c20074550 0x7f7c200729a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009990 tx=0x7f7c1c009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.100+0000 7f7c277ff700 1 -- 172.21.15.17:0/867991357 shutdown_connections 2023-07-14T12:57:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.100+0000 7f7c277ff700 1 --2- 172.21.15.17:0/867991357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2010c0d0 0x7f7c2010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.100+0000 7f7c277ff700 1 --2- 172.21.15.17:0/867991357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c20074550 0x7f7c200729a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.100+0000 7f7c277ff700 1 --2- 172.21.15.17:0/867991357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c20072f70 0x7f7c200733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.100+0000 7f7c277ff700 1 -- 172.21.15.17:0/867991357 >> 172.21.15.17:0/867991357 conn(0x7f7c200fb0e0 msgr2=0x7f7c200fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.101+0000 7f7c277ff700 1 -- 172.21.15.17:0/867991357 shutdown_connections 2023-07-14T12:57:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.101+0000 7f7c277ff700 1 -- 172.21.15.17:0/867991357 wait complete. 2023-07-14T12:57:30.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.101+0000 7f7c277ff700 1 Processor -- start 2023-07-14T12:57:30.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.102+0000 7f7c277ff700 1 -- start start 2023-07-14T12:57:30.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.102+0000 7f7c277ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c20072f70 0x7f7c2019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:30.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.102+0000 7f7c277ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c20074550 0x7f7c2019c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:30.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.102+0000 7f7c277ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2010c0d0 0x7f7c201a3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.102+0000 7f7c277ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201a38f0 con 0x7f7c2010c0d0 2023-07-14T12:57:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.102+0000 7f7c277ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201a3a60 con 0x7f7c20074550 2023-07-14T12:57:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.102+0000 7f7c277ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201a3c20 con 0x7f7c20072f70 2023-07-14T12:57:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.102+0000 7f7c25d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2010c0d0 0x7f7c201a3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.102+0000 7f7c24d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c20074550 0x7f7c2019c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.102+0000 7f7c25d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2010c0d0 0x7f7c201a3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42420/0 (socket says 172.21.15.17:42420) 2023-07-14T12:57:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.102+0000 7f7c25d9c700 1 -- 172.21.15.17:0/4096944846 learned_addr learned my addr 172.21.15.17:0/4096944846 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c2559b700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c20072f70 0x7f7c2019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c25d9c700 1 -- 172.21.15.17:0/4096944846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c20072f70 msgr2=0x7f7c2019bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c25d9c700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c20072f70 0x7f7c2019bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c25d9c700 1 -- 172.21.15.17:0/4096944846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c20074550 msgr2=0x7f7c2019c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c25d9c700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c20074550 0x7f7c2019c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c25d9c700 1 -- 172.21.15.17:0/4096944846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c0095f0 con 0x7f7c2010c0d0 2023-07-14T12:57:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c2559b700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c20072f70 0x7f7c2019bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:57:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c25d9c700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2010c0d0 0x7f7c201a3320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800ef30 tx=0x7f7c1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c167fc700 1 -- 172.21.15.17:0/4096944846 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18018070 con 0x7f7c2010c0d0 2023-07-14T12:57:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c167fc700 1 -- 172.21.15.17:0/4096944846 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c1800f040 con 0x7f7c2010c0d0 2023-07-14T12:57:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c167fc700 1 -- 172.21.15.17:0/4096944846 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1800cc70 con 0x7f7c2010c0d0 2023-07-14T12:57:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c277ff700 1 -- 172.21.15.17:0/4096944846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c201a3ea0 con 0x7f7c2010c0d0 2023-07-14T12:57:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.103+0000 7f7c277ff700 1 -- 172.21.15.17:0/4096944846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c201a4270 con 0x7f7c2010c0d0 2023-07-14T12:57:30.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.105+0000 7f7c277ff700 1 -- 172.21.15.17:0/4096944846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c20101c20 con 0x7f7c2010c0d0 2023-07-14T12:57:30.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.107+0000 7f7c167fc700 1 -- 172.21.15.17:0/4096944846 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f7c18007500 con 0x7f7c2010c0d0 2023-07-14T12:57:30.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.109+0000 7f7c167fc700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7c0c0a1220 0x7f7c0c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:30.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.109+0000 7f7c167fc700 1 -- 172.21.15.17:0/4096944846 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7c180cbfb0 con 0x7f7c2010c0d0 2023-07-14T12:57:30.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.109+0000 7f7c2559b700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7c0c0a1220 0x7f7c0c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:30.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.110+0000 7f7c2559b700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7c0c0a1220 0x7f7c0c0a36d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0098e0 tx=0x7f7c1c005a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:30.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.112+0000 7f7c167fc700 1 -- 172.21.15.17:0/4096944846 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7c18095b90 con 0x7f7c2010c0d0 2023-07-14T12:57:30.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:29 smithi135 ceph-mon[97338]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:30.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:29 smithi131 ceph-mon[96953]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:30.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.433+0000 7f7c277ff700 1 -- 172.21.15.17:0/4096944846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c2002c850 con 0x7f7c2010c0d0 2023-07-14T12:57:30.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.434+0000 7f7c167fc700 1 -- 172.21.15.17:0/4096944846 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8085 (secure 0 0 0) 0x7f7c180991b0 con 0x7f7c2010c0d0 2023-07-14T12:57:30.463 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:30.463 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24547,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-07-14T12:57:30.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 -- 172.21.15.17:0/4096944846 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7c0c0a1220 msgr2=0x7f7c0c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:30.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7c0c0a1220 0x7f7c0c0a36d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0098e0 tx=0x7f7c1c005a90 comp rx=0 tx=0).stop 2023-07-14T12:57:30.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 -- 172.21.15.17:0/4096944846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2010c0d0 msgr2=0x7f7c201a3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2010c0d0 0x7f7c201a3320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800ef30 tx=0x7f7c1800c3a0 comp rx=0 tx=0).stop 2023-07-14T12:57:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 -- 172.21.15.17:0/4096944846 shutdown_connections 2023-07-14T12:57:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7c0c0a1220 0x7f7c0c0a36d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c2010c0d0 0x7f7c201a3320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c20072f70 0x7f7c2019bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 --2- 172.21.15.17:0/4096944846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c20074550 0x7f7c2019c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:30.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 -- 172.21.15.17:0/4096944846 >> 172.21.15.17:0/4096944846 conn(0x7f7c200fb0e0 msgr2=0x7f7c200fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:30.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 -- 172.21.15.17:0/4096944846 shutdown_connections 2023-07-14T12:57:30.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:30.437+0000 7f7c277ff700 1 -- 172.21.15.17:0/4096944846 wait complete. 2023-07-14T12:57:30.467 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 11 2023-07-14T12:57:30.808 INFO:journalctl@ceph.mds.a.smithi017.stdout:Jul 14 12:57:30 smithi017 podman[129758]: 2023-07-14T12:57:31.104 INFO:journalctl@ceph.mds.a.smithi017.stdout:Jul 14 12:57:30 smithi017 bash[129758]: 0dbbfb6e75c07d78fbbae3a2ddf332a9edacc6fc8a282e8ac78630e257e17084 2023-07-14T12:57:31.105 INFO:journalctl@ceph.mds.a.smithi017.stdout:Jul 14 12:57:30 smithi017 ceph-mds[129800]: -- 172.21.15.17:0/1165184517 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558b985811e0 con 0x558b98556c00 2023-07-14T12:57:31.105 INFO:journalctl@ceph.mds.a.smithi017.stdout:Jul 14 12:57:30 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-a[129776]: starting mds.a at 2023-07-14T12:57:31.105 INFO:journalctl@ceph.mds.a.smithi017.stdout:Jul 14 12:57:30 smithi017 systemd[1]: Started Ceph mds.a for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:57:31.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:30 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/4096944846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:31.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:30 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:31.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:30 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:31.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:30 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/4096944846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:31.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:30 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:31.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:30 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:31.244 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:30 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/4096944846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:31.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:30 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:31.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:30 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:32.142 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:31 smithi131 ceph-mon[96953]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:32.142 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:31 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.17:6840/2303800338,v1:172.21.15.17:6841/2303800338] up:boot 2023-07-14T12:57:32.142 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:31 smithi131 ceph-mon[96953]: fsmap 11 up:standby 2023-07-14T12:57:32.142 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:31 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-14T12:57:32.143 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:31 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:32.143 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:31 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:32.143 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:31 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:32.143 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:31 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:32.143 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:31 smithi131 ceph-mon[96953]: Deploying daemon mds.b on smithi131 2023-07-14T12:57:32.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:31 smithi135 ceph-mon[97338]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:32.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:31 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.17:6840/2303800338,v1:172.21.15.17:6841/2303800338] up:boot 2023-07-14T12:57:32.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:31 smithi135 ceph-mon[97338]: fsmap 11 up:standby 2023-07-14T12:57:32.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:31 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-14T12:57:32.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:31 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:32.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:31 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:32.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:31 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:32.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:31 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:32.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:31 smithi135 ceph-mon[97338]: Deploying daemon mds.b on smithi131 2023-07-14T12:57:32.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:31 smithi017 ceph-mon[95536]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:32.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:31 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.17:6840/2303800338,v1:172.21.15.17:6841/2303800338] up:boot 2023-07-14T12:57:32.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:31 smithi017 ceph-mon[95536]: fsmap 11 up:standby 2023-07-14T12:57:32.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:31 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-14T12:57:32.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:31 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:32.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:31 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T12:57:32.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:31 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T12:57:32.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:31 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:32.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:31 smithi017 ceph-mon[95536]: Deploying daemon mds.b on smithi131 2023-07-14T12:57:32.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.673+0000 7fb87d5ff700 1 -- 172.21.15.17:0/3216818982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb878072f70 msgr2=0x7fb8780733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.673+0000 7fb87d5ff700 1 --2- 172.21.15.17:0/3216818982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb878072f70 0x7fb8780733e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb860009990 tx=0x7fb860009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.674+0000 7fb87d5ff700 1 -- 172.21.15.17:0/3216818982 shutdown_connections 2023-07-14T12:57:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.674+0000 7fb87d5ff700 1 --2- 172.21.15.17:0/3216818982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8781079c0 0x7fb878109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.674+0000 7fb87d5ff700 1 --2- 172.21.15.17:0/3216818982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb878074550 0x7fb8780729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.674+0000 7fb87d5ff700 1 --2- 172.21.15.17:0/3216818982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb878072f70 0x7fb8780733e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.674+0000 7fb87d5ff700 1 -- 172.21.15.17:0/3216818982 >> 172.21.15.17:0/3216818982 conn(0x7fb8780fb0e0 msgr2=0x7fb8780fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:32.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.674+0000 7fb87d5ff700 1 -- 172.21.15.17:0/3216818982 shutdown_connections 2023-07-14T12:57:32.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.674+0000 7fb87d5ff700 1 -- 172.21.15.17:0/3216818982 wait complete. 2023-07-14T12:57:32.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb87d5ff700 1 Processor -- start 2023-07-14T12:57:32.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb87d5ff700 1 -- start start 2023-07-14T12:57:32.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb87d5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb878072f70 0x7fb878197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:32.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb87d5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb878074550 0x7fb878197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:32.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb87d5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8781079c0 0x7fb87819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb87d5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87819f510 con 0x7fb878072f70 2023-07-14T12:57:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb87d5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87819f650 con 0x7fb8781079c0 2023-07-14T12:57:32.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb87d5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87819f7e0 con 0x7fb878074550 2023-07-14T12:57:32.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb876ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb878072f70 0x7fb878197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:32.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb876ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb878072f70 0x7fb878197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42456/0 (socket says 172.21.15.17:42456) 2023-07-14T12:57:32.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb8777fe700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8781079c0 0x7fb87819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:32.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.675+0000 7fb876ffd700 1 -- 172.21.15.17:0/579702321 learned_addr learned my addr 172.21.15.17:0/579702321 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:32.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.676+0000 7fb86ffff700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb878074550 0x7fb878197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:32.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.676+0000 7fb876ffd700 1 -- 172.21.15.17:0/579702321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb878074550 msgr2=0x7fb878197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.676+0000 7fb876ffd700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb878074550 0x7fb878197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.676+0000 7fb876ffd700 1 -- 172.21.15.17:0/579702321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8781079c0 msgr2=0x7fb87819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.676+0000 7fb876ffd700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8781079c0 0x7fb87819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.676+0000 7fb876ffd700 1 -- 172.21.15.17:0/579702321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600095f0 con 0x7fb878072f70 2023-07-14T12:57:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.676+0000 7fb876ffd700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb878072f70 0x7fb878197990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb86800c9e0 tx=0x7fb86800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.676+0000 7fb874ff9700 1 -- 172.21.15.17:0/579702321 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868007aa0 con 0x7fb878072f70 2023-07-14T12:57:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.676+0000 7fb874ff9700 1 -- 172.21.15.17:0/579702321 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb86800ce80 con 0x7fb878072f70 2023-07-14T12:57:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.676+0000 7fb87d5ff700 1 -- 172.21.15.17:0/579702321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87819fac0 con 0x7fb878072f70 2023-07-14T12:57:32.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.676+0000 7fb874ff9700 1 -- 172.21.15.17:0/579702321 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868018400 con 0x7fb878072f70 2023-07-14T12:57:32.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.677+0000 7fb87d5ff700 1 -- 172.21.15.17:0/579702321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87819ffd0 con 0x7fb878072f70 2023-07-14T12:57:32.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.678+0000 7fb87d5ff700 1 -- 172.21.15.17:0/579702321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb878106070 con 0x7fb878072f70 2023-07-14T12:57:32.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.680+0000 7fb874ff9700 1 -- 172.21.15.17:0/579702321 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fb86800f450 con 0x7fb878072f70 2023-07-14T12:57:32.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.681+0000 7fb874ff9700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8640a11a0 0x7fb8640a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:32.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.681+0000 7fb874ff9700 1 -- 172.21.15.17:0/579702321 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb8680cc450 con 0x7fb878072f70 2023-07-14T12:57:32.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.681+0000 7fb86ffff700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8640a11a0 0x7fb8640a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:32.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.682+0000 7fb86ffff700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8640a11a0 0x7fb8640a3650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb860000c00 tx=0x7fb860005ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:32.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.685+0000 7fb874ff9700 1 -- 172.21.15.17:0/579702321 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb868095fa0 con 0x7fb878072f70 2023-07-14T12:57:32.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.943+0000 7fb87d5ff700 1 -- 172.21.15.17:0/579702321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb87802c850 con 0x7fb878072f70 2023-07-14T12:57:32.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.943+0000 7fb874ff9700 1 -- 172.21.15.17:0/579702321 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8843 (secure 0 0 0) 0x7fb8680995c0 con 0x7fb878072f70 2023-07-14T12:57:32.974 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:32.974 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24547,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-07-14T12:57:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 -- 172.21.15.17:0/579702321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8640a11a0 msgr2=0x7fb8640a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8640a11a0 0x7fb8640a3650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb860000c00 tx=0x7fb860005ee0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 -- 172.21.15.17:0/579702321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb878072f70 msgr2=0x7fb878197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:32.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb878072f70 0x7fb878197990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb86800c9e0 tx=0x7fb86800ccf0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 -- 172.21.15.17:0/579702321 shutdown_connections 2023-07-14T12:57:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8640a11a0 0x7fb8640a3650 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8781079c0 0x7fb87819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb878072f70 0x7fb878197990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 --2- 172.21.15.17:0/579702321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb878074550 0x7fb878197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 -- 172.21.15.17:0/579702321 >> 172.21.15.17:0/579702321 conn(0x7fb8780fb0e0 msgr2=0x7fb8780fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:32.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 -- 172.21.15.17:0/579702321 shutdown_connections 2023-07-14T12:57:32.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:32.946+0000 7fb87d5ff700 1 -- 172.21.15.17:0/579702321 wait complete. 2023-07-14T12:57:32.977 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 12 2023-07-14T12:57:33.139 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 12:57:33 smithi131 systemd[1]: Starting Ceph mds.b for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T12:57:33.919 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 12:57:33 smithi131 podman[122258]: 2023-07-14T12:57:34.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:33 smithi135 ceph-mon[97338]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:34.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:33 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/579702321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:34.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:33 smithi131 ceph-mon[96953]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:34.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:33 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/579702321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:34.245 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 12:57:33 smithi131 ceph-mds[122298]: -- 172.21.15.131:0/2581802769 <== mon.2 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564c107271e0 con 0x564c106fd000 2023-07-14T12:57:34.245 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 12:57:33 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-b[122274]: starting mds.b at 2023-07-14T12:57:34.245 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 12:57:33 smithi131 bash[122258]: c4fb389322b1069221b221c9c8554d9d24ae70c0929d86b73aedb8fd6050bdc6 2023-07-14T12:57:34.246 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 12:57:33 smithi131 systemd[1]: Started Ceph mds.b for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T12:57:34.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:33 smithi017 ceph-mon[95536]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:34.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:33 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/579702321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:34.995 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:35.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:34 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] up:boot 2023-07-14T12:57:35.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:34 smithi135 ceph-mon[97338]: fsmap 12 up:standby 2023-07-14T12:57:35.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:34 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-14T12:57:35.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:34 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:34 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:34 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:34 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:34 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:34 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:57:35.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.191+0000 7f075e7ff700 1 -- 172.21.15.17:0/2822281432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07580ffb00 msgr2=0x7f07580fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:35.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.191+0000 7f075e7ff700 1 --2- 172.21.15.17:0/2822281432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07580ffb00 0x7f07580fff10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07480098f0 tx=0x7f0748009c00 comp rx=0 tx=0).stop 2023-07-14T12:57:35.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.191+0000 7f075e7ff700 1 -- 172.21.15.17:0/2822281432 shutdown_connections 2023-07-14T12:57:35.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.191+0000 7f075e7ff700 1 --2- 172.21.15.17:0/2822281432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758101680 0x7f0758107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.191+0000 7f075e7ff700 1 --2- 172.21.15.17:0/2822281432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07580ffb00 0x7f07580fff10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.191+0000 7f075e7ff700 1 --2- 172.21.15.17:0/2822281432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0758100cf0 0x7f0758101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.191+0000 7f075e7ff700 1 -- 172.21.15.17:0/2822281432 >> 172.21.15.17:0/2822281432 conn(0x7f07580fb0e0 msgr2=0x7f07580fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:35.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.191+0000 7f075e7ff700 1 -- 172.21.15.17:0/2822281432 shutdown_connections 2023-07-14T12:57:35.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.191+0000 7f075e7ff700 1 -- 172.21.15.17:0/2822281432 wait complete. 2023-07-14T12:57:35.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.192+0000 7f075e7ff700 1 Processor -- start 2023-07-14T12:57:35.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f075e7ff700 1 -- start start 2023-07-14T12:57:35.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f075e7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07580ffb00 0x7f07581979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:35.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f075e7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0758100cf0 0x7f0758197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:35.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f075e7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758101680 0x7f075819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:35.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f075e7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075819f540 con 0x7f0758100cf0 2023-07-14T12:57:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f075e7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075819f680 con 0x7f0758101680 2023-07-14T12:57:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f075e7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075819f810 con 0x7f07580ffb00 2023-07-14T12:57:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f07577fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0758100cf0 0x7f0758197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f075cd9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758101680 0x7f075819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f07577fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0758100cf0 0x7f0758197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47554/0 (socket says 172.21.15.17:47554) 2023-07-14T12:57:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f07577fe700 1 -- 172.21.15.17:0/944380034 learned_addr learned my addr 172.21.15.17:0/944380034 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.193+0000 7f0757fff700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07580ffb00 0x7f07581979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f075cd9c700 1 -- 172.21.15.17:0/944380034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07580ffb00 msgr2=0x7f07581979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f075cd9c700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07580ffb00 0x7f07581979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f075cd9c700 1 -- 172.21.15.17:0/944380034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0758100cf0 msgr2=0x7f0758197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f075cd9c700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0758100cf0 0x7f0758197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f075cd9c700 1 -- 172.21.15.17:0/944380034 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c0095f0 con 0x7f0758101680 2023-07-14T12:57:35.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f07577fe700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0758100cf0 0x7f0758197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:57:35.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f075cd9c700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758101680 0x7f075819ef70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f075000efb0 tx=0x7f075000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:35.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f07557fa700 1 -- 172.21.15.17:0/944380034 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750003a00 con 0x7f0758101680 2023-07-14T12:57:35.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f07557fa700 1 -- 172.21.15.17:0/944380034 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f075000f040 con 0x7f0758101680 2023-07-14T12:57:35.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f075e7ff700 1 -- 172.21.15.17:0/944380034 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0750009c40 con 0x7f0758101680 2023-07-14T12:57:35.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f07557fa700 1 -- 172.21.15.17:0/944380034 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500044d0 con 0x7f0758101680 2023-07-14T12:57:35.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.194+0000 7f075e7ff700 1 -- 172.21.15.17:0/944380034 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0748009520 con 0x7f0758101680 2023-07-14T12:57:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.195+0000 7f075e7ff700 1 -- 172.21.15.17:0/944380034 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0758192030 con 0x7f0758101680 2023-07-14T12:57:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.197+0000 7f07557fa700 1 -- 172.21.15.17:0/944380034 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f075000cbc0 con 0x7f0758101680 2023-07-14T12:57:35.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.199+0000 7f07557fa700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f07400a11a0 0x7f07400a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.199+0000 7f07557fa700 1 -- 172.21.15.17:0/944380034 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f07500cbff0 con 0x7f0758101680 2023-07-14T12:57:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.199+0000 7f0757fff700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f07400a11a0 0x7f07400a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:35.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.200+0000 7f0757fff700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f07400a11a0 0x7f07400a3650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0748009fd0 tx=0x7f0748019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:35.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.203+0000 7f07557fa700 1 -- 172.21.15.17:0/944380034 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0750095c30 con 0x7f0758101680 2023-07-14T12:57:35.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:34 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] up:boot 2023-07-14T12:57:35.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:34 smithi131 ceph-mon[96953]: fsmap 12 up:standby 2023-07-14T12:57:35.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:34 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-14T12:57:35.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:34 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:34 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:34 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:34 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:34 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:34 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:57:35.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:34 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] up:boot 2023-07-14T12:57:35.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:34 smithi017 ceph-mon[95536]: fsmap 12 up:standby 2023-07-14T12:57:35.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:34 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-14T12:57:35.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:34 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:34 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:34 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:34 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:34 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:35.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:34 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:57:35.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.465+0000 7f075e7ff700 1 -- 172.21.15.17:0/944380034 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f075802c850 con 0x7f0758101680 2023-07-14T12:57:35.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.466+0000 7f07557fa700 1 -- 172.21.15.17:0/944380034 <== mon.2 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9604 (secure 0 0 0) 0x7f0750099250 con 0x7f0758101680 2023-07-14T12:57:35.495 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:35.495 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24508,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24526,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24547,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-07-14T12:57:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 -- 172.21.15.17:0/944380034 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f07400a11a0 msgr2=0x7f07400a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f07400a11a0 0x7f07400a3650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0748009fd0 tx=0x7f0748019040 comp rx=0 tx=0).stop 2023-07-14T12:57:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 -- 172.21.15.17:0/944380034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758101680 msgr2=0x7f075819ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:35.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758101680 0x7f075819ef70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f075000efb0 tx=0x7f075000c3a0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 -- 172.21.15.17:0/944380034 shutdown_connections 2023-07-14T12:57:35.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f07400a11a0 0x7f07400a3650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0758101680 0x7f075819ef70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07580ffb00 0x7f07581979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 --2- 172.21.15.17:0/944380034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0758100cf0 0x7f0758197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 -- 172.21.15.17:0/944380034 >> 172.21.15.17:0/944380034 conn(0x7f07580fb0e0 msgr2=0x7f07581066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 -- 172.21.15.17:0/944380034 shutdown_connections 2023-07-14T12:57:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.469+0000 7f075e7ff700 1 -- 172.21.15.17:0/944380034 wait complete. 2023-07-14T12:57:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 13 2023-07-14T12:57:35.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:57:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.699+0000 7f19c0fff700 1 -- 172.21.15.17:0/3799223872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19bc100d00 msgr2=0x7f19bc101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.699+0000 7f19c0fff700 1 --2- 172.21.15.17:0/3799223872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19bc100d00 0x7f19bc101150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009990 tx=0x7f19b0009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.699+0000 7f19c0fff700 1 -- 172.21.15.17:0/3799223872 shutdown_connections 2023-07-14T12:57:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.699+0000 7f19c0fff700 1 --2- 172.21.15.17:0/3799223872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc101690 0x7f19bc107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.699+0000 7f19c0fff700 1 --2- 172.21.15.17:0/3799223872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19bc0ffb10 0x7f19bc0fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.699+0000 7f19c0fff700 1 --2- 172.21.15.17:0/3799223872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19bc100d00 0x7f19bc101150 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.699+0000 7f19c0fff700 1 -- 172.21.15.17:0/3799223872 >> 172.21.15.17:0/3799223872 conn(0x7f19bc0fb110 msgr2=0x7f19bc0fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:35.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.699+0000 7f19c0fff700 1 -- 172.21.15.17:0/3799223872 shutdown_connections 2023-07-14T12:57:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.699+0000 7f19c0fff700 1 -- 172.21.15.17:0/3799223872 wait complete. 2023-07-14T12:57:35.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.700+0000 7f19c0fff700 1 Processor -- start 2023-07-14T12:57:35.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.700+0000 7f19c0fff700 1 -- start start 2023-07-14T12:57:35.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19c0fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc0ffb10 0x7f19bc0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:35.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19c0fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19bc100d00 0x7f19bc072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:35.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19c0fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19bc101690 0x7f19bc072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:35.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19c0fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0735e0 con 0x7f19bc0ffb10 2023-07-14T12:57:35.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19c0fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc073750 con 0x7f19bc100d00 2023-07-14T12:57:35.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19c0fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc19f7d0 con 0x7f19bc101690 2023-07-14T12:57:35.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19ba59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc0ffb10 0x7f19bc0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19b9d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19bc100d00 0x7f19bc072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19b9d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19bc100d00 0x7f19bc072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34608/0 (socket says 172.21.15.17:34608) 2023-07-14T12:57:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19b9d9b700 1 -- 172.21.15.17:0/724922750 learned_addr learned my addr 172.21.15.17:0/724922750 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19bad9d700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19bc101690 0x7f19bc072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19ba59c700 1 -- 172.21.15.17:0/724922750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19bc101690 msgr2=0x7f19bc072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19ba59c700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19bc101690 0x7f19bc072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19ba59c700 1 -- 172.21.15.17:0/724922750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19bc100d00 msgr2=0x7f19bc072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.701+0000 7f19ba59c700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19bc100d00 0x7f19bc072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.702+0000 7f19ba59c700 1 -- 172.21.15.17:0/724922750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b00095f0 con 0x7f19bc0ffb10 2023-07-14T12:57:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.702+0000 7f19b9d9b700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19bc100d00 0x7f19bc072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:57:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.702+0000 7f19ba59c700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc0ffb10 0x7f19bc0742c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e9c0 tx=0x7f19ac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.702+0000 7f19ab7fe700 1 -- 172.21.15.17:0/724922750 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac004220 con 0x7f19bc0ffb10 2023-07-14T12:57:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.702+0000 7f19ab7fe700 1 -- 172.21.15.17:0/724922750 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f19ac004380 con 0x7f19bc0ffb10 2023-07-14T12:57:35.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.702+0000 7f19c0fff700 1 -- 172.21.15.17:0/724922750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc19fab0 con 0x7f19bc0ffb10 2023-07-14T12:57:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.702+0000 7f19ab7fe700 1 -- 172.21.15.17:0/724922750 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac003b40 con 0x7f19bc0ffb10 2023-07-14T12:57:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.702+0000 7f19c0fff700 1 -- 172.21.15.17:0/724922750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc1a0010 con 0x7f19bc0ffb10 2023-07-14T12:57:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.703+0000 7f19c0fff700 1 -- 172.21.15.17:0/724922750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc10b1e0 con 0x7f19bc0ffb10 2023-07-14T12:57:35.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.706+0000 7f19ab7fe700 1 -- 172.21.15.17:0/724922750 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f19ac003ca0 con 0x7f19bc0ffb10 2023-07-14T12:57:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.707+0000 7f19ab7fe700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a40a1220 0x7f19a40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.707+0000 7f19ab7fe700 1 -- 172.21.15.17:0/724922750 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f19ac014070 con 0x7f19bc0ffb10 2023-07-14T12:57:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.708+0000 7f19b9d9b700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a40a1220 0x7f19a40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:35.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.708+0000 7f19b9d9b700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a40a1220 0x7f19a40a36d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f19b0006010 tx=0x7f19b000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:35.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.709+0000 7f19ab7fe700 1 -- 172.21.15.17:0/724922750 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f19ac096350 con 0x7f19bc0ffb10 2023-07-14T12:57:35.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.928+0000 7f19c0fff700 1 -- 172.21.15.17:0/724922750 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19bc106a30 con 0x7f19bc0ffb10 2023-07-14T12:57:35.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.929+0000 7f19ab7fe700 1 -- 172.21.15.17:0/724922750 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18422 (secure 0 0 0) 0x7f19ac099970 con 0x7f19bc0ffb10 2023-07-14T12:57:35.958 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:35.958 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":82,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:56:46.971673+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:57:35.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 -- 172.21.15.17:0/724922750 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a40a1220 msgr2=0x7f19a40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:35.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a40a1220 0x7f19a40a36d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f19b0006010 tx=0x7f19b000b260 comp rx=0 tx=0).stop 2023-07-14T12:57:35.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 -- 172.21.15.17:0/724922750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc0ffb10 msgr2=0x7f19bc0742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:35.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc0ffb10 0x7f19bc0742c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e9c0 tx=0x7f19ac00ecd0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 -- 172.21.15.17:0/724922750 shutdown_connections 2023-07-14T12:57:35.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a40a1220 0x7f19a40a36d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19bc101690 0x7f19bc072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19bc0ffb10 0x7f19bc0742c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 --2- 172.21.15.17:0/724922750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19bc100d00 0x7f19bc072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:35.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 -- 172.21.15.17:0/724922750 >> 172.21.15.17:0/724922750 conn(0x7f19bc0fb110 msgr2=0x7f19bc0fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:35.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 -- 172.21.15.17:0/724922750 shutdown_connections 2023-07-14T12:57:35.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:35.932+0000 7f19c0fff700 1 -- 172.21.15.17:0/724922750 wait complete. 2023-07-14T12:57:35.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:57:35.985 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:57:36.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.183+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/2797106193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4df4100620 msgr2=0x7f4df4102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.183+0000 7f4dfc5ff700 1 --2- 172.21.15.17:0/2797106193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4df4100620 0x7f4df4102a00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009990 tx=0x7f4df0009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.183+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/2797106193 shutdown_connections 2023-07-14T12:57:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.183+0000 7f4dfc5ff700 1 --2- 172.21.15.17:0/2797106193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4df4105860 0x7f4df4107c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.183+0000 7f4dfc5ff700 1 --2- 172.21.15.17:0/2797106193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4df4100620 0x7f4df4102a00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.183+0000 7f4dfc5ff700 1 --2- 172.21.15.17:0/2797106193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4df4102f40 0x7f4df4105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.183+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/2797106193 >> 172.21.15.17:0/2797106193 conn(0x7f4df40fa000 msgr2=0x7f4df40fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:36.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.183+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/2797106193 shutdown_connections 2023-07-14T12:57:36.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.183+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/2797106193 wait complete. 2023-07-14T12:57:36.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.184+0000 7f4dfc5ff700 1 Processor -- start 2023-07-14T12:57:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.185+0000 7f4dfc5ff700 1 -- start start 2023-07-14T12:57:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.185+0000 7f4dfc5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4df4100620 0x7f4df40fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.185+0000 7f4dfc5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4df4102f40 0x7f4df40fe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.185+0000 7f4dfc5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4df4105860 0x7f4df40feb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.185+0000 7f4dfc5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df40ff2b0 con 0x7f4df4102f40 2023-07-14T12:57:36.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.185+0000 7f4dfc5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df40ff420 con 0x7f4df4100620 2023-07-14T12:57:36.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.185+0000 7f4dfc5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df419f7f0 con 0x7f4df4105860 2023-07-14T12:57:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.186+0000 7f4dfa39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4df4100620 0x7f4df40fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.186+0000 7f4dfa39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4df4100620 0x7f4df40fff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34626/0 (socket says 172.21.15.17:34626) 2023-07-14T12:57:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.186+0000 7f4df9b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4df4102f40 0x7f4df40fe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.186+0000 7f4dfa39b700 1 -- 172.21.15.17:0/328707822 learned_addr learned my addr 172.21.15.17:0/328707822 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.186+0000 7f4dfab9c700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4df4105860 0x7f4df40feb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:36.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.186+0000 7f4dfa39b700 1 -- 172.21.15.17:0/328707822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4df4105860 msgr2=0x7f4df40feb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.186+0000 7f4dfa39b700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4df4105860 0x7f4df40feb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.186+0000 7f4dfa39b700 1 -- 172.21.15.17:0/328707822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4df4102f40 msgr2=0x7f4df40fe5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.186+0000 7f4dfa39b700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4df4102f40 0x7f4df40fe5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.186+0000 7f4dfa39b700 1 -- 172.21.15.17:0/328707822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00095f0 con 0x7f4df4100620 2023-07-14T12:57:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.186+0000 7f4dfa39b700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4df4100620 0x7f4df40fff90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4df00098e0 tx=0x7f4df0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.187+0000 7f4deb7fe700 1 -- 172.21.15.17:0/328707822 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df001d070 con 0x7f4df4100620 2023-07-14T12:57:36.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.187+0000 7f4deb7fe700 1 -- 172.21.15.17:0/328707822 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4df000be30 con 0x7f4df4100620 2023-07-14T12:57:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.187+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/328707822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df419fa70 con 0x7f4df4100620 2023-07-14T12:57:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.187+0000 7f4deb7fe700 1 -- 172.21.15.17:0/328707822 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0022db0 con 0x7f4df4100620 2023-07-14T12:57:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.187+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/328707822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df419fef0 con 0x7f4df4100620 2023-07-14T12:57:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.189+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/328707822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df40fbb70 con 0x7f4df4100620 2023-07-14T12:57:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.190+0000 7f4deb7fe700 1 -- 172.21.15.17:0/328707822 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4df0022470 con 0x7f4df4100620 2023-07-14T12:57:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.191+0000 7f4deb7fe700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4de00a11d0 0x7f4de00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.192+0000 7f4deb7fe700 1 -- 172.21.15.17:0/328707822 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4df00cd800 con 0x7f4df4100620 2023-07-14T12:57:36.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.192+0000 7f4df9b9a700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4de00a11d0 0x7f4de00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.192+0000 7f4df9b9a700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4de00a11d0 0x7f4de00a3680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4de4007c60 tx=0x7f4de40073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:36.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.195+0000 7f4deb7fe700 1 -- 172.21.15.17:0/328707822 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4df005c790 con 0x7f4df4100620 2023-07-14T12:57:36.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:36 smithi017 ceph-mon[95536]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:36.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:36 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/944380034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:36.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:36 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/724922750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:36.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.416+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/328707822 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4df402cc80 con 0x7f4df4100620 2023-07-14T12:57:36.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.416+0000 7f4deb7fe700 1 -- 172.21.15.17:0/328707822 <== mon.2 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4df0097500 con 0x7f4df4100620 2023-07-14T12:57:36.445 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T12:57:36.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:36 smithi135 ceph-mon[97338]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:36.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:36 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/944380034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:36.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:36 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/724922750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/328707822 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4de00a11d0 msgr2=0x7f4de00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4de00a11d0 0x7f4de00a3680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4de4007c60 tx=0x7f4de40073d0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/328707822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4df4100620 msgr2=0x7f4df40fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4df4100620 0x7f4df40fff90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4df00098e0 tx=0x7f4df0004730 comp rx=0 tx=0).stop 2023-07-14T12:57:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/328707822 shutdown_connections 2023-07-14T12:57:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4de00a11d0 0x7f4de00a3680 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4df4105860 0x7f4df40feb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4df4100620 0x7f4df40fff90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 --2- 172.21.15.17:0/328707822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4df4102f40 0x7f4df40fe5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/328707822 >> 172.21.15.17:0/328707822 conn(0x7f4df40fa000 msgr2=0x7f4df4101280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:36.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/328707822 shutdown_connections 2023-07-14T12:57:36.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.419+0000 7f4dfc5ff700 1 -- 172.21.15.17:0/328707822 wait complete. 2023-07-14T12:57:36.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T12:57:36.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:36 smithi131 ceph-mon[96953]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:36.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:36 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/944380034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:36.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:36 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/724922750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:36.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.657+0000 7fa3063ff700 1 -- 172.21.15.17:0/3884970033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300102e70 msgr2=0x7fa300105250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.657+0000 7fa3063ff700 1 --2- 172.21.15.17:0/3884970033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300102e70 0x7fa300105250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009990 tx=0x7fa2f4009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.657+0000 7fa3063ff700 1 -- 172.21.15.17:0/3884970033 shutdown_connections 2023-07-14T12:57:36.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.657+0000 7fa3063ff700 1 --2- 172.21.15.17:0/3884970033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa300105790 0x7fa300107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.657+0000 7fa3063ff700 1 --2- 172.21.15.17:0/3884970033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa300100550 0x7fa300102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.657+0000 7fa3063ff700 1 --2- 172.21.15.17:0/3884970033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300102e70 0x7fa300105250 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.657+0000 7fa3063ff700 1 -- 172.21.15.17:0/3884970033 >> 172.21.15.17:0/3884970033 conn(0x7fa3000f9fd0 msgr2=0x7fa3000fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:36.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.657+0000 7fa3063ff700 1 -- 172.21.15.17:0/3884970033 shutdown_connections 2023-07-14T12:57:36.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.658+0000 7fa3063ff700 1 -- 172.21.15.17:0/3884970033 wait complete. 2023-07-14T12:57:36.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.659+0000 7fa3063ff700 1 Processor -- start 2023-07-14T12:57:36.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.659+0000 7fa3063ff700 1 -- start start 2023-07-14T12:57:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.659+0000 7fa3063ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa300100550 0x7fa300197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.659+0000 7fa3063ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa300102e70 0x7fa300197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.659+0000 7fa3063ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300105790 0x7fa30019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.659+0000 7fa3063ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30019f4a0 con 0x7fa300105790 2023-07-14T12:57:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.659+0000 7fa3063ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30019f5e0 con 0x7fa300100550 2023-07-14T12:57:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.659+0000 7fa3063ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30019f770 con 0x7fa300102e70 2023-07-14T12:57:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa30499c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300105790 0x7fa30019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa2fffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa300100550 0x7fa300197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa30499c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300105790 0x7fa30019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47602/0 (socket says 172.21.15.17:47602) 2023-07-14T12:57:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa30499c700 1 -- 172.21.15.17:0/2817868311 learned_addr learned my addr 172.21.15.17:0/2817868311 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa2fffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa300100550 0x7fa300197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34648/0 (socket says 172.21.15.17:34648) 2023-07-14T12:57:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa2ff7fe700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa300102e70 0x7fa300197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa30499c700 1 -- 172.21.15.17:0/2817868311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa300102e70 msgr2=0x7fa300197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:36.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa30499c700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa300102e70 0x7fa300197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa30499c700 1 -- 172.21.15.17:0/2817868311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa300100550 msgr2=0x7fa300197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:36.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa30499c700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa300100550 0x7fa300197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa30499c700 1 -- 172.21.15.17:0/2817868311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40095f0 con 0x7fa300105790 2023-07-14T12:57:36.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa2fffff700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa300100550 0x7fa300197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:57:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa30499c700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300105790 0x7fa30019eed0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8007ee0 tx=0x7fa2f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa2fd7fa700 1 -- 172.21.15.17:0/2817868311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8017070 con 0x7fa300105790 2023-07-14T12:57:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.660+0000 7fa2fd7fa700 1 -- 172.21.15.17:0/2817868311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2f800f040 con 0x7fa300105790 2023-07-14T12:57:36.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.661+0000 7fa3063ff700 1 -- 172.21.15.17:0/2817868311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30019fa50 con 0x7fa300105790 2023-07-14T12:57:36.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.661+0000 7fa2fd7fa700 1 -- 172.21.15.17:0/2817868311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8005570 con 0x7fa300105790 2023-07-14T12:57:36.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.661+0000 7fa3063ff700 1 -- 172.21.15.17:0/2817868311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30019ffb0 con 0x7fa300105790 2023-07-14T12:57:36.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.662+0000 7fa3063ff700 1 -- 172.21.15.17:0/2817868311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa300107350 con 0x7fa300105790 2023-07-14T12:57:36.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.664+0000 7fa2fd7fa700 1 -- 172.21.15.17:0/2817868311 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa2f800db20 con 0x7fa300105790 2023-07-14T12:57:36.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.665+0000 7fa2fd7fa700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa2e80a1220 0x7fa2e80a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:36.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.666+0000 7fa2fd7fa700 1 -- 172.21.15.17:0/2817868311 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa2f80cc1f0 con 0x7fa300105790 2023-07-14T12:57:36.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.666+0000 7fa2fffff700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa2e80a1220 0x7fa2e80a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:36.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.666+0000 7fa2fffff700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa2e80a1220 0x7fa2e80a36d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0011490 tx=0x7fa2f0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:36.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.671+0000 7fa2fd7fa700 1 -- 172.21.15.17:0/2817868311 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa2f8095d40 con 0x7fa300105790 2023-07-14T12:57:36.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.896+0000 7fa3063ff700 1 -- 172.21.15.17:0/2817868311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa30002c850 con 0x7fa300105790 2023-07-14T12:57:36.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.896+0000 7fa2fd7fa700 1 -- 172.21.15.17:0/2817868311 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa2f809ae60 con 0x7fa300105790 2023-07-14T12:57:36.925 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:36.925 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-07-14T12:57:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T12:57:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2023-07-14T12:57:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2023-07-14T12:57:36.926 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T12:57:36.926 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-07-14T12:57:36.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 -- 172.21.15.17:0/2817868311 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa2e80a1220 msgr2=0x7fa2e80a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:36.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa2e80a1220 0x7fa2e80a36d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0011490 tx=0x7fa2f0009260 comp rx=0 tx=0).stop 2023-07-14T12:57:36.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 -- 172.21.15.17:0/2817868311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300105790 msgr2=0x7fa30019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:36.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300105790 0x7fa30019eed0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8007ee0 tx=0x7fa2f800d3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 -- 172.21.15.17:0/2817868311 shutdown_connections 2023-07-14T12:57:36.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa2e80a1220 0x7fa2e80a36d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300105790 0x7fa30019eed0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa300100550 0x7fa300197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 --2- 172.21.15.17:0/2817868311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa300102e70 0x7fa300197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:36.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 -- 172.21.15.17:0/2817868311 >> 172.21.15.17:0/2817868311 conn(0x7fa3000f9fd0 msgr2=0x7fa3000febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:36.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 -- 172.21.15.17:0/2817868311 shutdown_connections 2023-07-14T12:57:36.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:36.899+0000 7fa3063ff700 1 -- 172.21.15.17:0/2817868311 wait complete. 2023-07-14T12:57:36.946 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T12:57:36.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T12:57:37.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.132+0000 7f19bcf9d700 1 -- 172.21.15.17:0/3035850969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b8101630 msgr2=0x7f19b8107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:37.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.132+0000 7f19bcf9d700 1 --2- 172.21.15.17:0/3035850969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b8101630 0x7f19b8107ed0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f19b000b0a0 tx=0x7f19b000b3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.132+0000 7f19bcf9d700 1 -- 172.21.15.17:0/3035850969 shutdown_connections 2023-07-14T12:57:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.132+0000 7f19bcf9d700 1 --2- 172.21.15.17:0/3035850969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b8101630 0x7f19b8107ed0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.132+0000 7f19bcf9d700 1 --2- 172.21.15.17:0/3035850969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b80ff9f0 0x7f19b80ffe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.132+0000 7f19bcf9d700 1 --2- 172.21.15.17:0/3035850969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b8100c80 0x7f19b81010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:37.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.132+0000 7f19bcf9d700 1 -- 172.21.15.17:0/3035850969 >> 172.21.15.17:0/3035850969 conn(0x7f19b80fb010 msgr2=0x7f19b80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:37.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.133+0000 7f19bcf9d700 1 -- 172.21.15.17:0/3035850969 shutdown_connections 2023-07-14T12:57:37.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.133+0000 7f19bcf9d700 1 -- 172.21.15.17:0/3035850969 wait complete. 2023-07-14T12:57:37.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19bcf9d700 1 Processor -- start 2023-07-14T12:57:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19bcf9d700 1 -- start start 2023-07-14T12:57:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19bcf9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b80ff9f0 0x7f19b81955b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19bcf9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b8100c80 0x7f19b8195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19bcf9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b8101630 0x7f19b819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:37.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19bcf9d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b819d130 con 0x7f19b80ff9f0 2023-07-14T12:57:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19bcf9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b819d270 con 0x7f19b8101630 2023-07-14T12:57:37.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19bcf9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b819d400 con 0x7f19b8100c80 2023-07-14T12:57:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19b77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b80ff9f0 0x7f19b81955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19b77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b80ff9f0 0x7f19b81955b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47618/0 (socket says 172.21.15.17:47618) 2023-07-14T12:57:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19b77fe700 1 -- 172.21.15.17:0/2792873063 learned_addr learned my addr 172.21.15.17:0/2792873063 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.134+0000 7f19b6ffd700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b8100c80 0x7f19b8195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19b7fff700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b8101630 0x7f19b819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19b77fe700 1 -- 172.21.15.17:0/2792873063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b8100c80 msgr2=0x7f19b8195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19b77fe700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b8100c80 0x7f19b8195af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19b77fe700 1 -- 172.21.15.17:0/2792873063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b8101630 msgr2=0x7f19b819cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19b77fe700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b8101630 0x7f19b819cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:37.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19b77fe700 1 -- 172.21.15.17:0/2792873063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac009520 con 0x7f19b80ff9f0 2023-07-14T12:57:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19b7fff700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b8101630 0x7f19b819cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:57:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19b77fe700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b80ff9f0 0x7f19b81955b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f19a800e9a0 tx=0x7f19a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19b4ff9700 1 -- 172.21.15.17:0/2792873063 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8009790 con 0x7f19b80ff9f0 2023-07-14T12:57:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19b4ff9700 1 -- 172.21.15.17:0/2792873063 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f19a800cbd0 con 0x7f19b80ff9f0 2023-07-14T12:57:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19bcf9d700 1 -- 172.21.15.17:0/2792873063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b0009d00 con 0x7f19b80ff9f0 2023-07-14T12:57:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19b4ff9700 1 -- 172.21.15.17:0/2792873063 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a8018680 con 0x7f19b80ff9f0 2023-07-14T12:57:37.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.135+0000 7f19bcf9d700 1 -- 172.21.15.17:0/2792873063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b819da60 con 0x7f19b80ff9f0 2023-07-14T12:57:37.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.136+0000 7f19bcf9d700 1 -- 172.21.15.17:0/2792873063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b81068f0 con 0x7f19b80ff9f0 2023-07-14T12:57:37.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.138+0000 7f19b4ff9700 1 -- 172.21.15.17:0/2792873063 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f19a800cd40 con 0x7f19b80ff9f0 2023-07-14T12:57:37.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.140+0000 7f19b4ff9700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a00a11f0 0x7f19a00a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:37.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.140+0000 7f19b4ff9700 1 -- 172.21.15.17:0/2792873063 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f19a8014070 con 0x7f19b80ff9f0 2023-07-14T12:57:37.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.140+0000 7f19b6ffd700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a00a11f0 0x7f19a00a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:37.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.140+0000 7f19b6ffd700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a00a11f0 0x7f19a00a36a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009df0 tx=0x7f19ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:37.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.143+0000 7f19b4ff9700 1 -- 172.21.15.17:0/2792873063 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f19a8051790 con 0x7f19b80ff9f0 2023-07-14T12:57:37.354 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:37 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/328707822' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:57:37.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:37 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:37.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:37 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2817868311' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-07-14T12:57:37.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:37.356+0000 7f19bcf9d700 1 -- 172.21.15.17:0/2792873063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f19b802c850 con 0x7f19b80ff9f0 2023-07-14T12:57:37.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:37 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/328707822' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:57:37.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:37 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:37.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:37 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2817868311' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-07-14T12:57:37.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:37 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/328707822' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:57:37.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:37 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:37.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:37 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2817868311' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-07-14T12:57:38.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.111+0000 7f19b4ff9700 1 -- 172.21.15.17:0/2792873063 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7f19a8096300 con 0x7f19b80ff9f0 2023-07-14T12:57:38.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.117+0000 7f19bcf9d700 1 -- 172.21.15.17:0/2792873063 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a00a11f0 msgr2=0x7f19a00a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:38.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.117+0000 7f19bcf9d700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a00a11f0 0x7f19a00a36a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009df0 tx=0x7f19ac009260 comp rx=0 tx=0).stop 2023-07-14T12:57:38.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.117+0000 7f19bcf9d700 1 -- 172.21.15.17:0/2792873063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b80ff9f0 msgr2=0x7f19b81955b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:38.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.117+0000 7f19bcf9d700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b80ff9f0 0x7f19b81955b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f19a800e9a0 tx=0x7f19a800ecb0 comp rx=0 tx=0).stop 2023-07-14T12:57:38.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.117+0000 7f19bcf9d700 1 -- 172.21.15.17:0/2792873063 shutdown_connections 2023-07-14T12:57:38.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.117+0000 7f19bcf9d700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f19a00a11f0 0x7f19a00a36a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:38.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.117+0000 7f19bcf9d700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b8101630 0x7f19b819cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:38.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.117+0000 7f19bcf9d700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19b80ff9f0 0x7f19b81955b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:38.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.117+0000 7f19bcf9d700 1 --2- 172.21.15.17:0/2792873063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19b8100c80 0x7f19b8195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:38.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.117+0000 7f19bcf9d700 1 -- 172.21.15.17:0/2792873063 >> 172.21.15.17:0/2792873063 conn(0x7f19b80fb010 msgr2=0x7f19b80fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:38.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.118+0000 7f19bcf9d700 1 -- 172.21.15.17:0/2792873063 shutdown_connections 2023-07-14T12:57:38.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.118+0000 7f19bcf9d700 1 -- 172.21.15.17:0/2792873063 wait complete. 2023-07-14T12:57:38.148 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2023-07-14T12:57:38.165 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T12:57:38.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.352+0000 7f1483dff700 1 -- 172.21.15.17:0/720094022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147c1079a0 msgr2=0x7f147c109e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:38.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.352+0000 7f1483dff700 1 --2- 172.21.15.17:0/720094022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147c1079a0 0x7f147c109e20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f147400b0a0 tx=0x7f147400b3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:38.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.352+0000 7f1483dff700 1 -- 172.21.15.17:0/720094022 shutdown_connections 2023-07-14T12:57:38.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.352+0000 7f1483dff700 1 --2- 172.21.15.17:0/720094022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147c1079a0 0x7f147c109e20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:38.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.352+0000 7f1483dff700 1 --2- 172.21.15.17:0/720094022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f147c074550 0x7f147c0729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:38.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.352+0000 7f1483dff700 1 --2- 172.21.15.17:0/720094022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f147c072f70 0x7f147c0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:38.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.352+0000 7f1483dff700 1 -- 172.21.15.17:0/720094022 >> 172.21.15.17:0/720094022 conn(0x7f147c0fb0e0 msgr2=0x7f147c0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:38.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.352+0000 7f1483dff700 1 -- 172.21.15.17:0/720094022 shutdown_connections 2023-07-14T12:57:38.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.352+0000 7f1483dff700 1 -- 172.21.15.17:0/720094022 wait complete. 2023-07-14T12:57:38.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.353+0000 7f1483dff700 1 Processor -- start 2023-07-14T12:57:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.353+0000 7f1483dff700 1 -- start start 2023-07-14T12:57:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.353+0000 7f1483dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147c072f70 0x7f147c197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.353+0000 7f1483dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f147c074550 0x7f147c198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.353+0000 7f1483dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f147c1079a0 0x7f147c19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.353+0000 7f1483dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c19f5f0 con 0x7f147c072f70 2023-07-14T12:57:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.353+0000 7f1483dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c19f730 con 0x7f147c074550 2023-07-14T12:57:38.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.353+0000 7f1483dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c19f8c0 con 0x7f147c1079a0 2023-07-14T12:57:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.354+0000 7f1481b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147c072f70 0x7f147c197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.354+0000 7f148239c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f147c1079a0 0x7f147c19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.354+0000 7f1481b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147c072f70 0x7f147c197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47636/0 (socket says 172.21.15.17:47636) 2023-07-14T12:57:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.354+0000 7f1481b9b700 1 -- 172.21.15.17:0/1510925364 learned_addr learned my addr 172.21.15.17:0/1510925364 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.354+0000 7f148139a700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f147c074550 0x7f147c198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.354+0000 7f1481b9b700 1 -- 172.21.15.17:0/1510925364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f147c1079a0 msgr2=0x7f147c19f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:38.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.354+0000 7f1481b9b700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f147c1079a0 0x7f147c19f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.354+0000 7f1481b9b700 1 -- 172.21.15.17:0/1510925364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f147c074550 msgr2=0x7f147c198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.354+0000 7f1481b9b700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f147c074550 0x7f147c198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.354+0000 7f1481b9b700 1 -- 172.21.15.17:0/1510925364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1478009520 con 0x7f147c072f70 2023-07-14T12:57:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.354+0000 7f1481b9b700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147c072f70 0x7f147c197ac0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f147800ea30 tx=0x7f147800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.355+0000 7f1472ffd700 1 -- 172.21.15.17:0/1510925364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478009820 con 0x7f147c072f70 2023-07-14T12:57:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.355+0000 7f1472ffd700 1 -- 172.21.15.17:0/1510925364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14780044b0 con 0x7f147c072f70 2023-07-14T12:57:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.355+0000 7f1483dff700 1 -- 172.21.15.17:0/1510925364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1474009d00 con 0x7f147c072f70 2023-07-14T12:57:38.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.355+0000 7f1472ffd700 1 -- 172.21.15.17:0/1510925364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478003ce0 con 0x7f147c072f70 2023-07-14T12:57:38.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.355+0000 7f1483dff700 1 -- 172.21.15.17:0/1510925364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c19ff70 con 0x7f147c072f70 2023-07-14T12:57:38.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.356+0000 7f1483dff700 1 -- 172.21.15.17:0/1510925364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c106050 con 0x7f147c072f70 2023-07-14T12:57:38.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.359+0000 7f1472ffd700 1 -- 172.21.15.17:0/1510925364 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f1478003e60 con 0x7f147c072f70 2023-07-14T12:57:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.361+0000 7f1472ffd700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14680a11d0 0x7f14680a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.361+0000 7f1472ffd700 1 -- 172.21.15.17:0/1510925364 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f1478014070 con 0x7f147c072f70 2023-07-14T12:57:38.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.361+0000 7f148139a700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14680a11d0 0x7f14680a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:38.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.362+0000 7f148139a700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14680a11d0 0x7f14680a3680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f146c005950 tx=0x7f146c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:38.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.363+0000 7f1472ffd700 1 -- 172.21.15.17:0/1510925364 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1478096440 con 0x7f147c072f70 2023-07-14T12:57:38.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:38 smithi135 ceph-mon[97338]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:38.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:38 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2792873063' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-07-14T12:57:38.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:38.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:57:38.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:38 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.494 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:38 smithi131 ceph-mon[96953]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:38.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:38 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2792873063' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-07-14T12:57:38.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:38.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:57:38.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:38 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:38 smithi017 ceph-mon[95536]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:38.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:38 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2792873063' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-07-14T12:57:38.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:38.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:57:38.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:38 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:38.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:38.608+0000 7f1483dff700 1 -- 172.21.15.17:0/1510925364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f147c02c850 con 0x7f147c072f70 2023-07-14T12:57:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.125+0000 7f1472ffd700 1 -- 172.21.15.17:0/1510925364 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1478099a60 con 0x7f147c072f70 2023-07-14T12:57:39.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.131+0000 7f1483dff700 1 -- 172.21.15.17:0/1510925364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14680a11d0 msgr2=0x7f14680a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:39.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.131+0000 7f1483dff700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14680a11d0 0x7f14680a3680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f146c005950 tx=0x7f146c0058e0 comp rx=0 tx=0).stop 2023-07-14T12:57:39.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.131+0000 7f1483dff700 1 -- 172.21.15.17:0/1510925364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147c072f70 msgr2=0x7f147c197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:39.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.131+0000 7f1483dff700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147c072f70 0x7f147c197ac0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f147800ea30 tx=0x7f147800ed40 comp rx=0 tx=0).stop 2023-07-14T12:57:39.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.135+0000 7f1483dff700 1 -- 172.21.15.17:0/1510925364 shutdown_connections 2023-07-14T12:57:39.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.135+0000 7f1483dff700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14680a11d0 0x7f14680a3680 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:39.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.135+0000 7f1483dff700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f147c1079a0 0x7f147c19f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:39.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.135+0000 7f1483dff700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f147c072f70 0x7f147c197ac0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:39.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.135+0000 7f1483dff700 1 --2- 172.21.15.17:0/1510925364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f147c074550 0x7f147c198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:39.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.135+0000 7f1483dff700 1 -- 172.21.15.17:0/1510925364 >> 172.21.15.17:0/1510925364 conn(0x7f147c0fb0e0 msgr2=0x7f147c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:39.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.135+0000 7f1483dff700 1 -- 172.21.15.17:0/1510925364 shutdown_connections 2023-07-14T12:57:39.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.135+0000 7f1483dff700 1 -- 172.21.15.17:0/1510925364 wait complete. 2023-07-14T12:57:39.175 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2023-07-14T12:57:39.200 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T12:57:39.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.387+0000 7ff6a4dff700 1 -- 172.21.15.17:0/492664597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a0100ce0 msgr2=0x7ff6a0101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:39.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.387+0000 7ff6a4dff700 1 --2- 172.21.15.17:0/492664597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a0100ce0 0x7ff6a0101130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff694009990 tx=0x7ff694009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:39.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.387+0000 7ff6a4dff700 1 -- 172.21.15.17:0/492664597 shutdown_connections 2023-07-14T12:57:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.387+0000 7ff6a4dff700 1 --2- 172.21.15.17:0/492664597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a0101670 0x7ff6a0107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.387+0000 7ff6a4dff700 1 --2- 172.21.15.17:0/492664597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a00ffaf0 0x7ff6a00fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.387+0000 7ff6a4dff700 1 --2- 172.21.15.17:0/492664597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a0100ce0 0x7ff6a0101130 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.387+0000 7ff6a4dff700 1 -- 172.21.15.17:0/492664597 >> 172.21.15.17:0/492664597 conn(0x7ff6a00fb130 msgr2=0x7ff6a00fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:39.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.389+0000 7ff6a4dff700 1 -- 172.21.15.17:0/492664597 shutdown_connections 2023-07-14T12:57:39.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.389+0000 7ff6a4dff700 1 -- 172.21.15.17:0/492664597 wait complete. 2023-07-14T12:57:39.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.391+0000 7ff6a4dff700 1 Processor -- start 2023-07-14T12:57:39.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.391+0000 7ff6a4dff700 1 -- start start 2023-07-14T12:57:39.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff6a4dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a00ffaf0 0x7ff6a0197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:39.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff6a4dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a0100ce0 0x7ff6a0197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:39.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff6a4dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a0101670 0x7ff6a019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:39.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff6a4dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a019f4c0 con 0x7ff6a0100ce0 2023-07-14T12:57:39.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff6a4dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a019f600 con 0x7ff6a0101670 2023-07-14T12:57:39.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff6a4dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a019f790 con 0x7ff6a00ffaf0 2023-07-14T12:57:39.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a0100ce0 0x7ff6a0197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:39.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a0100ce0 0x7ff6a0197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47662/0 (socket says 172.21.15.17:47662) 2023-07-14T12:57:39.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69dd9b700 1 -- 172.21.15.17:0/2611751076 learned_addr learned my addr 172.21.15.17:0/2611751076 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:39.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69e59c700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a00ffaf0 0x7ff6a0197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:39.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69ed9d700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a0101670 0x7ff6a019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:39.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69e59c700 1 -- 172.21.15.17:0/2611751076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a0101670 msgr2=0x7ff6a019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69e59c700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a0101670 0x7ff6a019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69e59c700 1 -- 172.21.15.17:0/2611751076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a0100ce0 msgr2=0x7ff6a0197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69e59c700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a0100ce0 0x7ff6a0197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69e59c700 1 -- 172.21.15.17:0/2611751076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6940095f0 con 0x7ff6a00ffaf0 2023-07-14T12:57:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69ed9d700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a0101670 0x7ff6a019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:57:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.392+0000 7ff69dd9b700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a0100ce0 0x7ff6a0197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:57:39.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.393+0000 7ff69e59c700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a00ffaf0 0x7ff6a0197940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff69000e9c0 tx=0x7ff69000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:39.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.393+0000 7ff68f7fe700 1 -- 172.21.15.17:0/2611751076 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000cbd0 con 0x7ff6a00ffaf0 2023-07-14T12:57:39.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.393+0000 7ff68f7fe700 1 -- 172.21.15.17:0/2611751076 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff69000eeb0 con 0x7ff6a00ffaf0 2023-07-14T12:57:39.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.393+0000 7ff68f7fe700 1 -- 172.21.15.17:0/2611751076 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff690003c40 con 0x7ff6a00ffaf0 2023-07-14T12:57:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.393+0000 7ff6a4dff700 1 -- 172.21.15.17:0/2611751076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a019fa70 con 0x7ff6a00ffaf0 2023-07-14T12:57:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.393+0000 7ff6a4dff700 1 -- 172.21.15.17:0/2611751076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a019ff30 con 0x7ff6a00ffaf0 2023-07-14T12:57:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.394+0000 7ff6a4dff700 1 -- 172.21.15.17:0/2611751076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a0192030 con 0x7ff6a00ffaf0 2023-07-14T12:57:39.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.396+0000 7ff68f7fe700 1 -- 172.21.15.17:0/2611751076 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff690003da0 con 0x7ff6a00ffaf0 2023-07-14T12:57:39.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.398+0000 7ff68f7fe700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff6880a1150 0x7ff6880a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:39.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.398+0000 7ff68f7fe700 1 -- 172.21.15.17:0/2611751076 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7ff690014070 con 0x7ff6a00ffaf0 2023-07-14T12:57:39.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.398+0000 7ff69dd9b700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff6880a1150 0x7ff6880a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:39.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.399+0000 7ff69dd9b700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff6880a1150 0x7ff6880a3600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff694006010 tx=0x7ff69400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.402+0000 7ff68f7fe700 1 -- 172.21.15.17:0/2611751076 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff690096300 con 0x7ff6a00ffaf0 2023-07-14T12:57:39.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:39 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2792873063' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-07-14T12:57:39.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:39 smithi135 ceph-mon[97338]: osdmap e83: 12 total, 12 up, 12 in 2023-07-14T12:57:39.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:39 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:57:39.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:39 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2792873063' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-07-14T12:57:39.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:39 smithi131 ceph-mon[96953]: osdmap e83: 12 total, 12 up, 12 in 2023-07-14T12:57:39.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:39 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:57:39.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:39 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2792873063' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-07-14T12:57:39.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:39 smithi017 ceph-mon[95536]: osdmap e83: 12 total, 12 up, 12 in 2023-07-14T12:57:39.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:39 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:57:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:39.668+0000 7ff6a4dff700 1 -- 172.21.15.17:0/2611751076 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff6a002c850 con 0x7ff6a00ffaf0 2023-07-14T12:57:40.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.177+0000 7ff68f7fe700 1 -- 172.21.15.17:0/2611751076 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff690099920 con 0x7ff6a00ffaf0 2023-07-14T12:57:40.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.179+0000 7ff6a4dff700 1 -- 172.21.15.17:0/2611751076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff6880a1150 msgr2=0x7ff6880a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:40.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.179+0000 7ff6a4dff700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff6880a1150 0x7ff6880a3600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff694006010 tx=0x7ff69400b260 comp rx=0 tx=0).stop 2023-07-14T12:57:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.179+0000 7ff6a4dff700 1 -- 172.21.15.17:0/2611751076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a00ffaf0 msgr2=0x7ff6a0197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.179+0000 7ff6a4dff700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a00ffaf0 0x7ff6a0197940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff69000e9c0 tx=0x7ff69000ecd0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.179+0000 7ff6a4dff700 1 -- 172.21.15.17:0/2611751076 shutdown_connections 2023-07-14T12:57:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.179+0000 7ff6a4dff700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff6880a1150 0x7ff6880a3600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.179+0000 7ff6a4dff700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a0101670 0x7ff6a019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.179+0000 7ff6a4dff700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a00ffaf0 0x7ff6a0197940 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.179+0000 7ff6a4dff700 1 --2- 172.21.15.17:0/2611751076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a0100ce0 0x7ff6a0197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.179+0000 7ff6a4dff700 1 -- 172.21.15.17:0/2611751076 >> 172.21.15.17:0/2611751076 conn(0x7ff6a00fb130 msgr2=0x7ff6a0106670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:40.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.179+0000 7ff6a4dff700 1 -- 172.21.15.17:0/2611751076 shutdown_connections 2023-07-14T12:57:40.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.180+0000 7ff6a4dff700 1 -- 172.21.15.17:0/2611751076 wait complete. 2023-07-14T12:57:40.212 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 2 and data pool 3 2023-07-14T12:57:40.230 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:57:40.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:40 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1510925364' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-07-14T12:57:40.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:40 smithi135 ceph-mon[97338]: pgmap v299: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:40.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:40 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1510925364' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-07-14T12:57:40.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:40 smithi135 ceph-mon[97338]: osdmap e84: 12 total, 12 up, 12 in 2023-07-14T12:57:40.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:40 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2611751076' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T12:57:40.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:40 smithi135 ceph-mon[97338]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T12:57:40.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:40 smithi135 ceph-mon[97338]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-07-14T12:57:40.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.420+0000 7fe9a8fff700 1 -- 172.21.15.17:0/137897830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100d00 msgr2=0x7fe9a4101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:40.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.420+0000 7fe9a8fff700 1 --2- 172.21.15.17:0/137897830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100d00 0x7fe9a4101150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe998009990 tx=0x7fe998009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.421+0000 7fe9a8fff700 1 -- 172.21.15.17:0/137897830 shutdown_connections 2023-07-14T12:57:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.421+0000 7fe9a8fff700 1 --2- 172.21.15.17:0/137897830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a4101690 0x7fe9a4107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.421+0000 7fe9a8fff700 1 --2- 172.21.15.17:0/137897830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a40ffb10 0x7fe9a40fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.421+0000 7fe9a8fff700 1 --2- 172.21.15.17:0/137897830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100d00 0x7fe9a4101150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.421+0000 7fe9a8fff700 1 -- 172.21.15.17:0/137897830 >> 172.21.15.17:0/137897830 conn(0x7fe9a40fb110 msgr2=0x7fe9a40fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.421+0000 7fe9a8fff700 1 -- 172.21.15.17:0/137897830 shutdown_connections 2023-07-14T12:57:40.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.421+0000 7fe9a8fff700 1 -- 172.21.15.17:0/137897830 wait complete. 2023-07-14T12:57:40.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.422+0000 7fe9a8fff700 1 Processor -- start 2023-07-14T12:57:40.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.422+0000 7fe9a8fff700 1 -- start start 2023-07-14T12:57:40.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.422+0000 7fe9a8fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a40ffb10 0x7fe9a4197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:40.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.422+0000 7fe9a8fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100d00 0x7fe9a4197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:40.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.422+0000 7fe9a8fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a4101690 0x7fe9a419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:40.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.422+0000 7fe9a8fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a419f4e0 con 0x7fe9a4100d00 2023-07-14T12:57:40.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.422+0000 7fe9a8fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a419f620 con 0x7fe9a40ffb10 2023-07-14T12:57:40.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.422+0000 7fe9a8fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a419f7b0 con 0x7fe9a4101690 2023-07-14T12:57:40.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.423+0000 7fe9a1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100d00 0x7fe9a4197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:40.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.423+0000 7fe9a1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100d00 0x7fe9a4197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47672/0 (socket says 172.21.15.17:47672) 2023-07-14T12:57:40.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.423+0000 7fe9a1d9b700 1 -- 172.21.15.17:0/1575209300 learned_addr learned my addr 172.21.15.17:0/1575209300 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:40.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.423+0000 7fe9a259c700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a40ffb10 0x7fe9a4197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:40.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.423+0000 7fe9a2d9d700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a4101690 0x7fe9a419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:40.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.423+0000 7fe9a1d9b700 1 -- 172.21.15.17:0/1575209300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a4101690 msgr2=0x7fe9a419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:40.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.423+0000 7fe9a1d9b700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a4101690 0x7fe9a419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.423+0000 7fe9a1d9b700 1 -- 172.21.15.17:0/1575209300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a40ffb10 msgr2=0x7fe9a4197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:40.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.423+0000 7fe9a1d9b700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a40ffb10 0x7fe9a4197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.423+0000 7fe9a1d9b700 1 -- 172.21.15.17:0/1575209300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980095f0 con 0x7fe9a4100d00 2023-07-14T12:57:40.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.423+0000 7fe9a1d9b700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100d00 0x7fe9a4197ea0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe9980098e0 tx=0x7fe998004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.424+0000 7fe9937fe700 1 -- 172.21.15.17:0/1575209300 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99801d070 con 0x7fe9a4100d00 2023-07-14T12:57:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.424+0000 7fe9a8fff700 1 -- 172.21.15.17:0/1575209300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a419fa30 con 0x7fe9a4100d00 2023-07-14T12:57:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.424+0000 7fe9937fe700 1 -- 172.21.15.17:0/1575209300 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe99800bdd0 con 0x7fe9a4100d00 2023-07-14T12:57:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.424+0000 7fe9937fe700 1 -- 172.21.15.17:0/1575209300 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998022db0 con 0x7fe9a4100d00 2023-07-14T12:57:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.424+0000 7fe9a8fff700 1 -- 172.21.15.17:0/1575209300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a419feb0 con 0x7fe9a4100d00 2023-07-14T12:57:40.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.425+0000 7fe9a8fff700 1 -- 172.21.15.17:0/1575209300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a41920a0 con 0x7fe9a4100d00 2023-07-14T12:57:40.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.429+0000 7fe9937fe700 1 -- 172.21.15.17:0/1575209300 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe998022470 con 0x7fe9a4100d00 2023-07-14T12:57:40.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.431+0000 7fe9937fe700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe98c0a11a0 0x7fe98c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:40.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.431+0000 7fe9937fe700 1 -- 172.21.15.17:0/1575209300 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe9980cde50 con 0x7fe9a4100d00 2023-07-14T12:57:40.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.431+0000 7fe9a259c700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe98c0a11a0 0x7fe98c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:40.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.432+0000 7fe9a259c700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe98c0a11a0 0x7fe98c0a3650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4100b60 tx=0x7fe994009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:40.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.436+0000 7fe9937fe700 1 -- 172.21.15.17:0/1575209300 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe9980976e0 con 0x7fe9a4100d00 2023-07-14T12:57:40.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:40 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1510925364' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-07-14T12:57:40.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:40 smithi131 ceph-mon[96953]: pgmap v299: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:40.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:40 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1510925364' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-07-14T12:57:40.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:40 smithi131 ceph-mon[96953]: osdmap e84: 12 total, 12 up, 12 in 2023-07-14T12:57:40.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:40 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2611751076' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T12:57:40.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:40 smithi131 ceph-mon[96953]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T12:57:40.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:40 smithi131 ceph-mon[96953]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-07-14T12:57:40.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:40 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1510925364' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-07-14T12:57:40.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:40 smithi017 ceph-mon[95536]: pgmap v299: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:40.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:40 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1510925364' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-07-14T12:57:40.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:40 smithi017 ceph-mon[95536]: osdmap e84: 12 total, 12 up, 12 in 2023-07-14T12:57:40.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:40 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2611751076' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T12:57:40.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:40 smithi017 ceph-mon[95536]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T12:57:40.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:40 smithi017 ceph-mon[95536]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-07-14T12:57:40.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.651+0000 7fe9a8fff700 1 -- 172.21.15.17:0/1575209300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9a402c850 con 0x7fe9a4100d00 2023-07-14T12:57:40.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.653+0000 7fe9937fe700 1 -- 172.21.15.17:0/1575209300 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22132 (secure 0 0 0) 0x7fe99809ad00 con 0x7fe9a4100d00 2023-07-14T12:57:40.682 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:40.682 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":85,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:57:39.670756+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:57:40.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 -- 172.21.15.17:0/1575209300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe98c0a11a0 msgr2=0x7fe98c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:40.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe98c0a11a0 0x7fe98c0a3650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4100b60 tx=0x7fe994009260 comp rx=0 tx=0).stop 2023-07-14T12:57:40.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 -- 172.21.15.17:0/1575209300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100d00 msgr2=0x7fe9a4197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:40.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100d00 0x7fe9a4197ea0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe9980098e0 tx=0x7fe998004730 comp rx=0 tx=0).stop 2023-07-14T12:57:40.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 -- 172.21.15.17:0/1575209300 shutdown_connections 2023-07-14T12:57:40.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe98c0a11a0 0x7fe98c0a3650 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a4101690 0x7fe9a419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9a40ffb10 0x7fe9a4197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 --2- 172.21.15.17:0/1575209300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a4100d00 0x7fe9a4197ea0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 -- 172.21.15.17:0/1575209300 >> 172.21.15.17:0/1575209300 conn(0x7fe9a40fb110 msgr2=0x7fe9a4106610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:40.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 -- 172.21.15.17:0/1575209300 shutdown_connections 2023-07-14T12:57:40.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.656+0000 7fe9a8fff700 1 -- 172.21.15.17:0/1575209300 wait complete. 2023-07-14T12:57:40.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:57:40.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.910+0000 7ff0c17ff700 1 -- 172.21.15.17:0/2260874866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0bc074550 msgr2=0x7ff0bc0729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:40.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.910+0000 7ff0c17ff700 1 --2- 172.21.15.17:0/2260874866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0bc074550 0x7ff0bc0729a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009990 tx=0x7ff0ac009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.910+0000 7ff0c17ff700 1 -- 172.21.15.17:0/2260874866 shutdown_connections 2023-07-14T12:57:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.910+0000 7ff0c17ff700 1 --2- 172.21.15.17:0/2260874866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0bc1079c0 0x7ff0bc109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.910+0000 7ff0c17ff700 1 --2- 172.21.15.17:0/2260874866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0bc074550 0x7ff0bc0729a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.910+0000 7ff0c17ff700 1 --2- 172.21.15.17:0/2260874866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0bc072f70 0x7ff0bc0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.910+0000 7ff0c17ff700 1 -- 172.21.15.17:0/2260874866 >> 172.21.15.17:0/2260874866 conn(0x7ff0bc0fb0e0 msgr2=0x7ff0bc0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.911+0000 7ff0c17ff700 1 -- 172.21.15.17:0/2260874866 shutdown_connections 2023-07-14T12:57:40.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.911+0000 7ff0c17ff700 1 -- 172.21.15.17:0/2260874866 wait complete. 2023-07-14T12:57:40.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0c17ff700 1 Processor -- start 2023-07-14T12:57:40.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0c17ff700 1 -- start start 2023-07-14T12:57:40.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0c17ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0bc072f70 0x7ff0bc1979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:40.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0c17ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0bc074550 0x7ff0bc197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0c17ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0bc1079c0 0x7ff0bc19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0c17ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc19f550 con 0x7ff0bc074550 2023-07-14T12:57:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0c17ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc19f690 con 0x7ff0bc1079c0 2023-07-14T12:57:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0c17ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc19f820 con 0x7ff0bc072f70 2023-07-14T12:57:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0ba7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0bc074550 0x7ff0bc197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0ba7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0bc074550 0x7ff0bc197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47688/0 (socket says 172.21.15.17:47688) 2023-07-14T12:57:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0ba7fc700 1 -- 172.21.15.17:0/22611623 learned_addr learned my addr 172.21.15.17:0/22611623 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:40.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.912+0000 7ff0baffd700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0bc072f70 0x7ff0bc1979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0bb7fe700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0bc1079c0 0x7ff0bc19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0ba7fc700 1 -- 172.21.15.17:0/22611623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0bc072f70 msgr2=0x7ff0bc1979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0ba7fc700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0bc072f70 0x7ff0bc1979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0ba7fc700 1 -- 172.21.15.17:0/22611623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0bc1079c0 msgr2=0x7ff0bc19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0ba7fc700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0bc1079c0 0x7ff0bc19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0ba7fc700 1 -- 172.21.15.17:0/22611623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b0009520 con 0x7ff0bc074550 2023-07-14T12:57:40.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0baffd700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0bc072f70 0x7ff0bc1979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:57:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0ba7fc700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0bc074550 0x7ff0bc197f10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000ea50 tx=0x7ff0b000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0a3fff700 1 -- 172.21.15.17:0/22611623 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b000cbd0 con 0x7ff0bc074550 2023-07-14T12:57:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0a3fff700 1 -- 172.21.15.17:0/22611623 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0b000cd30 con 0x7ff0bc074550 2023-07-14T12:57:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0c17ff700 1 -- 172.21.15.17:0/22611623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ac0095f0 con 0x7ff0bc074550 2023-07-14T12:57:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0a3fff700 1 -- 172.21.15.17:0/22611623 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0018680 con 0x7ff0bc074550 2023-07-14T12:57:40.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.913+0000 7ff0c17ff700 1 -- 172.21.15.17:0/22611623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc19fed0 con 0x7ff0bc074550 2023-07-14T12:57:40.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.914+0000 7ff0c17ff700 1 -- 172.21.15.17:0/22611623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc106070 con 0x7ff0bc074550 2023-07-14T12:57:40.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.917+0000 7ff0a3fff700 1 -- 172.21.15.17:0/22611623 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7ff0b0010430 con 0x7ff0bc074550 2023-07-14T12:57:40.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.918+0000 7ff0a3fff700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0a40a1220 0x7ff0a40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:40.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.918+0000 7ff0a3fff700 1 -- 172.21.15.17:0/22611623 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff0b0014070 con 0x7ff0bc074550 2023-07-14T12:57:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.918+0000 7ff0baffd700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0a40a1220 0x7ff0a40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:40.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.919+0000 7ff0baffd700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0a40a1220 0x7ff0a40a36d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac005910 tx=0x7ff0ac00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:40.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:40.922+0000 7ff0a3fff700 1 -- 172.21.15.17:0/22611623 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff0b0096520 con 0x7ff0bc074550 2023-07-14T12:57:41.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.139+0000 7ff0c17ff700 1 -- 172.21.15.17:0/22611623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0bc02c850 con 0x7ff0bc074550 2023-07-14T12:57:41.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.141+0000 7ff0a3fff700 1 -- 172.21.15.17:0/22611623 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22132 (secure 0 0 0) 0x7ff0b0099b40 con 0x7ff0bc074550 2023-07-14T12:57:41.170 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:41.170 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":85,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:57:39.670756+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:57:41.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.143+0000 7ff0c17ff700 1 -- 172.21.15.17:0/22611623 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0a40a1220 msgr2=0x7ff0a40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:41.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.144+0000 7ff0c17ff700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0a40a1220 0x7ff0a40a36d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac005910 tx=0x7ff0ac00b260 comp rx=0 tx=0).stop 2023-07-14T12:57:41.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.144+0000 7ff0c17ff700 1 -- 172.21.15.17:0/22611623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0bc074550 msgr2=0x7ff0bc197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:41.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.144+0000 7ff0c17ff700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0bc074550 0x7ff0bc197f10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000ea50 tx=0x7ff0b000ed60 comp rx=0 tx=0).stop 2023-07-14T12:57:41.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.144+0000 7ff0c17ff700 1 -- 172.21.15.17:0/22611623 shutdown_connections 2023-07-14T12:57:41.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.144+0000 7ff0c17ff700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0a40a1220 0x7ff0a40a36d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:41.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.144+0000 7ff0c17ff700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0bc1079c0 0x7ff0bc19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:41.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.144+0000 7ff0c17ff700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0bc072f70 0x7ff0bc1979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:41.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.144+0000 7ff0c17ff700 1 --2- 172.21.15.17:0/22611623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0bc074550 0x7ff0bc197f10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:41.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.144+0000 7ff0c17ff700 1 -- 172.21.15.17:0/22611623 >> 172.21.15.17:0/22611623 conn(0x7ff0bc0fb0e0 msgr2=0x7ff0bc0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:41.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.144+0000 7ff0c17ff700 1 -- 172.21.15.17:0/22611623 shutdown_connections 2023-07-14T12:57:41.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.144+0000 7ff0c17ff700 1 -- 172.21.15.17:0/22611623 wait complete. 2023-07-14T12:57:41.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T12:57:41.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.376+0000 7f76807ff700 1 -- 172.21.15.17:0/2471254781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76780ffae0 msgr2=0x7f76780ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:41.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.376+0000 7f76807ff700 1 --2- 172.21.15.17:0/2471254781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76780ffae0 0x7f76780ffef0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7674009990 tx=0x7f7674009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:41.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.376+0000 7f76807ff700 1 -- 172.21.15.17:0/2471254781 shutdown_connections 2023-07-14T12:57:41.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.376+0000 7f76807ff700 1 --2- 172.21.15.17:0/2471254781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7678101660 0x7f7678107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:41.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.376+0000 7f76807ff700 1 --2- 172.21.15.17:0/2471254781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76780ffae0 0x7f76780ffef0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:41.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.376+0000 7f76807ff700 1 --2- 172.21.15.17:0/2471254781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7678100cd0 0x7f7678101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:41.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.376+0000 7f76807ff700 1 -- 172.21.15.17:0/2471254781 >> 172.21.15.17:0/2471254781 conn(0x7f76780fb0e0 msgr2=0x7f76780fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:41.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.376+0000 7f76807ff700 1 -- 172.21.15.17:0/2471254781 shutdown_connections 2023-07-14T12:57:41.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.376+0000 7f76807ff700 1 -- 172.21.15.17:0/2471254781 wait complete. 2023-07-14T12:57:41.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.377+0000 7f76807ff700 1 Processor -- start 2023-07-14T12:57:41.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.377+0000 7f76807ff700 1 -- start start 2023-07-14T12:57:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f76807ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76780ffae0 0x7f76780742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f76807ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7678100cd0 0x7f7678072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f76807ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7678101660 0x7f7678072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f76807ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780735e0 con 0x7f7678101660 2023-07-14T12:57:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f76807ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7678073750 con 0x7f76780ffae0 2023-07-14T12:57:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f76807ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767819f810 con 0x7f7678100cd0 2023-07-14T12:57:41.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f767dd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7678100cd0 0x7f7678072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:41.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f767dd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7678100cd0 0x7f7678072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40614/0 (socket says 172.21.15.17:40614) 2023-07-14T12:57:41.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f767dd9a700 1 -- 172.21.15.17:0/616999716 learned_addr learned my addr 172.21.15.17:0/616999716 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:41.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f767e59b700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76780ffae0 0x7f76780742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:41.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f767ed9c700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7678101660 0x7f7678072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:41.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f767dd9a700 1 -- 172.21.15.17:0/616999716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76780ffae0 msgr2=0x7f76780742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:41.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f767dd9a700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76780ffae0 0x7f76780742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:41.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f767dd9a700 1 -- 172.21.15.17:0/616999716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7678101660 msgr2=0x7f7678072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:41.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f767dd9a700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7678101660 0x7f7678072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:41.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.378+0000 7f767dd9a700 1 -- 172.21.15.17:0/616999716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76740095f0 con 0x7f7678100cd0 2023-07-14T12:57:41.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.379+0000 7f767dd9a700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7678100cd0 0x7f7678072900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f766800e9a0 tx=0x7f766800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:41.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.379+0000 7f766f7fe700 1 -- 172.21.15.17:0/616999716 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7668009790 con 0x7f7678100cd0 2023-07-14T12:57:41.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.379+0000 7f76807ff700 1 -- 172.21.15.17:0/616999716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767819faf0 con 0x7f7678100cd0 2023-07-14T12:57:41.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.379+0000 7f766f7fe700 1 -- 172.21.15.17:0/616999716 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7668010430 con 0x7f7678100cd0 2023-07-14T12:57:41.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.379+0000 7f766f7fe700 1 -- 172.21.15.17:0/616999716 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766800cea0 con 0x7f7678100cd0 2023-07-14T12:57:41.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.379+0000 7f76807ff700 1 -- 172.21.15.17:0/616999716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76781a0000 con 0x7f7678100cd0 2023-07-14T12:57:41.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.380+0000 7f76807ff700 1 -- 172.21.15.17:0/616999716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767810b1b0 con 0x7f7678100cd0 2023-07-14T12:57:41.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.382+0000 7f766f7fe700 1 -- 172.21.15.17:0/616999716 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f76680105a0 con 0x7f7678100cd0 2023-07-14T12:57:41.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.384+0000 7f766f7fe700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f76640a1150 0x7f76640a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:41.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.384+0000 7f766f7fe700 1 -- 172.21.15.17:0/616999716 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7668014070 con 0x7f7678100cd0 2023-07-14T12:57:41.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.384+0000 7f767e59b700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f76640a1150 0x7f76640a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:41.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.384+0000 7f767e59b700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f76640a1150 0x7f76640a3600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76740098e0 tx=0x7f767400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:41.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.386+0000 7f766f7fe700 1 -- 172.21.15.17:0/616999716 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f76680963c0 con 0x7f7678100cd0 2023-07-14T12:57:41.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:41 smithi135 ceph-mon[97338]: osdmap e85: 12 total, 12 up, 12 in 2023-07-14T12:57:41.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:41 smithi135 ceph-mon[97338]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-07-14T12:57:41.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:41 smithi135 ceph-mon[97338]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-07-14T12:57:41.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:41 smithi135 ceph-mon[97338]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-07-14T12:57:41.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:41 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1575209300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:41.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:41 smithi135 ceph-mon[97338]: pgmap v302: 97 pgs: 7 active+clean, 21 creating+peering, 69 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:41.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:41 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] up:active 2023-07-14T12:57:41.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:41 smithi135 ceph-mon[97338]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T12:57:41.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:41 smithi131 ceph-mon[96953]: osdmap e85: 12 total, 12 up, 12 in 2023-07-14T12:57:41.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:41 smithi131 ceph-mon[96953]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-07-14T12:57:41.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:41 smithi131 ceph-mon[96953]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-07-14T12:57:41.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:41 smithi131 ceph-mon[96953]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-07-14T12:57:41.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:41 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1575209300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:41.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:41 smithi131 ceph-mon[96953]: pgmap v302: 97 pgs: 7 active+clean, 21 creating+peering, 69 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:41.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:41 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] up:active 2023-07-14T12:57:41.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:41 smithi131 ceph-mon[96953]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T12:57:41.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:41 smithi017 ceph-mon[95536]: osdmap e85: 12 total, 12 up, 12 in 2023-07-14T12:57:41.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:41 smithi017 ceph-mon[95536]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-07-14T12:57:41.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:41 smithi017 ceph-mon[95536]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-07-14T12:57:41.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:41 smithi017 ceph-mon[95536]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-07-14T12:57:41.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:41 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1575209300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:41.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:41 smithi017 ceph-mon[95536]: pgmap v302: 97 pgs: 7 active+clean, 21 creating+peering, 69 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:57:41.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:41 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] up:active 2023-07-14T12:57:41.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:41 smithi017 ceph-mon[95536]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T12:57:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:41.665+0000 7f76807ff700 1 -- 172.21.15.17:0/616999716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f767810b3d0 con 0x7f7678100cd0 2023-07-14T12:57:42.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.181+0000 7f766f7fe700 1 -- 172.21.15.17:0/616999716 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f76680260b0 con 0x7f7678100cd0 2023-07-14T12:57:42.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 -- 172.21.15.17:0/616999716 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f76640a1150 msgr2=0x7f76640a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:42.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f76640a1150 0x7f76640a3600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76740098e0 tx=0x7f767400b260 comp rx=0 tx=0).stop 2023-07-14T12:57:42.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 -- 172.21.15.17:0/616999716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7678100cd0 msgr2=0x7f7678072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:42.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7678100cd0 0x7f7678072900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f766800e9a0 tx=0x7f766800ecb0 comp rx=0 tx=0).stop 2023-07-14T12:57:42.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 -- 172.21.15.17:0/616999716 shutdown_connections 2023-07-14T12:57:42.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f76640a1150 0x7f76640a3600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7678101660 0x7f7678072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76780ffae0 0x7f76780742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 --2- 172.21.15.17:0/616999716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7678100cd0 0x7f7678072900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:42.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 -- 172.21.15.17:0/616999716 >> 172.21.15.17:0/616999716 conn(0x7f76780fb0e0 msgr2=0x7f76780fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:42.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 -- 172.21.15.17:0/616999716 shutdown_connections 2023-07-14T12:57:42.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.183+0000 7f76807ff700 1 -- 172.21.15.17:0/616999716 wait complete. 2023-07-14T12:57:42.231 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2023-07-14T12:57:42.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-07-14T12:57:42.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.414+0000 7f77c31ff700 1 -- 172.21.15.17:0/1250814002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77bc0ffbd0 msgr2=0x7f77bc100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:42.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.414+0000 7f77c31ff700 1 --2- 172.21.15.17:0/1250814002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77bc0ffbd0 0x7f77bc100020 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009990 tx=0x7f77a8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:42.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.414+0000 7f77c31ff700 1 -- 172.21.15.17:0/1250814002 shutdown_connections 2023-07-14T12:57:42.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.414+0000 7f77c31ff700 1 --2- 172.21.15.17:0/1250814002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc100560 0x7f77bc106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:42.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.414+0000 7f77c31ff700 1 --2- 172.21.15.17:0/1250814002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc0fe9e0 0x7f77bc0fedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:42.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.414+0000 7f77c31ff700 1 --2- 172.21.15.17:0/1250814002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77bc0ffbd0 0x7f77bc100020 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:42.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.414+0000 7f77c31ff700 1 -- 172.21.15.17:0/1250814002 >> 172.21.15.17:0/1250814002 conn(0x7f77bc0fa000 msgr2=0x7f77bc0fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:42.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.414+0000 7f77c31ff700 1 -- 172.21.15.17:0/1250814002 shutdown_connections 2023-07-14T12:57:42.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.414+0000 7f77c31ff700 1 -- 172.21.15.17:0/1250814002 wait complete. 2023-07-14T12:57:42.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.416+0000 7f77c31ff700 1 Processor -- start 2023-07-14T12:57:42.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.416+0000 7f77c31ff700 1 -- start start 2023-07-14T12:57:42.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c31ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc0fe9e0 0x7f77bc1957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:42.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c31ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc0ffbd0 0x7f77bc195ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:42.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c31ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77bc100560 0x7f77bc19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:42.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c31ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc19d320 con 0x7f77bc100560 2023-07-14T12:57:42.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c31ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc19d460 con 0x7f77bc0fe9e0 2023-07-14T12:57:42.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c31ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc19d5f0 con 0x7f77bc0ffbd0 2023-07-14T12:57:42.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c179c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77bc100560 0x7f77bc19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:42.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c179c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77bc100560 0x7f77bc19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47724/0 (socket says 172.21.15.17:47724) 2023-07-14T12:57:42.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c179c700 1 -- 172.21.15.17:0/2500529430 learned_addr learned my addr 172.21.15.17:0/2500529430 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:42.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77bbfff700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc0ffbd0 0x7f77bc195ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:42.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c0f9b700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc0fe9e0 0x7f77bc1957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:42.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:42 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/22611623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:42.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:42 smithi135 ceph-mon[97338]: osdmap e86: 12 total, 12 up, 12 in 2023-07-14T12:57:42.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:42 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/616999716' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-14T12:57:42.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:42 smithi135 ceph-mon[97338]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-14T12:57:42.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:42 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:42 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:42 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:42 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:42 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:42 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c179c700 1 -- 172.21.15.17:0/2500529430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc0ffbd0 msgr2=0x7f77bc195ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:42.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c179c700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc0ffbd0 0x7f77bc195ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:42.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c179c700 1 -- 172.21.15.17:0/2500529430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc0fe9e0 msgr2=0x7f77bc1957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:42.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c179c700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc0fe9e0 0x7f77bc1957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:42.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.417+0000 7f77c179c700 1 -- 172.21.15.17:0/2500529430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a80095f0 con 0x7f77bc100560 2023-07-14T12:57:42.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.418+0000 7f77c179c700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77bc100560 0x7f77bc19cd50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f77b400ef30 tx=0x7f77b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:42.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.418+0000 7f77b9ffb700 1 -- 172.21.15.17:0/2500529430 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4018070 con 0x7f77bc100560 2023-07-14T12:57:42.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.418+0000 7f77b9ffb700 1 -- 172.21.15.17:0/2500529430 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77b400f040 con 0x7f77bc100560 2023-07-14T12:57:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.418+0000 7f77b9ffb700 1 -- 172.21.15.17:0/2500529430 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b400cbc0 con 0x7f77bc100560 2023-07-14T12:57:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.418+0000 7f77c31ff700 1 -- 172.21.15.17:0/2500529430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77bc19d870 con 0x7f77bc100560 2023-07-14T12:57:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.418+0000 7f77c31ff700 1 -- 172.21.15.17:0/2500529430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc19dd30 con 0x7f77bc100560 2023-07-14T12:57:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.419+0000 7f77c31ff700 1 -- 172.21.15.17:0/2500529430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77bc10a0b0 con 0x7f77bc100560 2023-07-14T12:57:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.421+0000 7f77b9ffb700 1 -- 172.21.15.17:0/2500529430 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f77b400cd40 con 0x7f77bc100560 2023-07-14T12:57:42.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.423+0000 7f77b9ffb700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f77ac0a1150 0x7f77ac0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:42.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.423+0000 7f77b9ffb700 1 -- 172.21.15.17:0/2500529430 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f77b40cc7c0 con 0x7f77bc100560 2023-07-14T12:57:42.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.423+0000 7f77c0f9b700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f77ac0a1150 0x7f77ac0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.424+0000 7f77c0f9b700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f77ac0a1150 0x7f77ac0a3600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0ffa30 tx=0x7f77b000a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.425+0000 7f77b9ffb700 1 -- 172.21.15.17:0/2500529430 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f77b40960f0 con 0x7f77bc100560 2023-07-14T12:57:42.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:42 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/22611623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:42.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:42 smithi131 ceph-mon[96953]: osdmap e86: 12 total, 12 up, 12 in 2023-07-14T12:57:42.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:42 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/616999716' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-14T12:57:42.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:42 smithi131 ceph-mon[96953]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-14T12:57:42.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:42 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:42 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:42 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:42 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:42 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:42 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:42 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/22611623' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:42.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:42 smithi017 ceph-mon[95536]: osdmap e86: 12 total, 12 up, 12 in 2023-07-14T12:57:42.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:42 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/616999716' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-14T12:57:42.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:42 smithi017 ceph-mon[95536]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-14T12:57:42.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:42 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:42 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:42 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:42 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:42 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:42 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:42.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:42.686+0000 7f77c31ff700 1 -- 172.21.15.17:0/2500529430 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f77bc19e370 con 0x7f77bc100560 2023-07-14T12:57:43.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.186+0000 7f77b9ffb700 1 -- 172.21.15.17:0/2500529430 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v17) v1 ==== 105+0+0 (secure 0 0 0) 0x7f77b4099710 con 0x7f77bc100560 2023-07-14T12:57:43.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.188+0000 7f77c31ff700 1 -- 172.21.15.17:0/2500529430 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f77ac0a1150 msgr2=0x7f77ac0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:43.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.188+0000 7f77c31ff700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f77ac0a1150 0x7f77ac0a3600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0ffa30 tx=0x7f77b000a3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.188+0000 7f77c31ff700 1 -- 172.21.15.17:0/2500529430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77bc100560 msgr2=0x7f77bc19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:43.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.188+0000 7f77c31ff700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77bc100560 0x7f77bc19cd50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f77b400ef30 tx=0x7f77b400c3a0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.189+0000 7f77c31ff700 1 -- 172.21.15.17:0/2500529430 shutdown_connections 2023-07-14T12:57:43.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.189+0000 7f77c31ff700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f77ac0a1150 0x7f77ac0a3600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.189+0000 7f77c31ff700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77bc100560 0x7f77bc19cd50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.189+0000 7f77c31ff700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77bc0fe9e0 0x7f77bc1957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.189+0000 7f77c31ff700 1 --2- 172.21.15.17:0/2500529430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77bc0ffbd0 0x7f77bc195ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.189+0000 7f77c31ff700 1 -- 172.21.15.17:0/2500529430 >> 172.21.15.17:0/2500529430 conn(0x7f77bc0fa000 msgr2=0x7f77bc0676d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:43.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.189+0000 7f77c31ff700 1 -- 172.21.15.17:0/2500529430 shutdown_connections 2023-07-14T12:57:43.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.189+0000 7f77c31ff700 1 -- 172.21.15.17:0/2500529430 wait complete. 2023-07-14T12:57:43.240 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-07-14T12:57:43.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.417+0000 7fc7c4bff700 1 -- 172.21.15.17:0/2188175323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7c0072f10 msgr2=0x7fc7c0073380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:43.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.417+0000 7fc7c4bff700 1 --2- 172.21.15.17:0/2188175323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7c0072f10 0x7fc7c0073380 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009990 tx=0x7fc7b4009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.417+0000 7fc7c4bff700 1 -- 172.21.15.17:0/2188175323 shutdown_connections 2023-07-14T12:57:43.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.417+0000 7fc7c4bff700 1 --2- 172.21.15.17:0/2188175323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c0107980 0x7fc7c0109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.417+0000 7fc7c4bff700 1 --2- 172.21.15.17:0/2188175323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7c00744f0 0x7fc7c0072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.417+0000 7fc7c4bff700 1 --2- 172.21.15.17:0/2188175323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7c0072f10 0x7fc7c0073380 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.417+0000 7fc7c4bff700 1 -- 172.21.15.17:0/2188175323 >> 172.21.15.17:0/2188175323 conn(0x7fc7c00fb130 msgr2=0x7fc7c00fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:43.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.417+0000 7fc7c4bff700 1 -- 172.21.15.17:0/2188175323 shutdown_connections 2023-07-14T12:57:43.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.417+0000 7fc7c4bff700 1 -- 172.21.15.17:0/2188175323 wait complete. 2023-07-14T12:57:43.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.418+0000 7fc7c4bff700 1 Processor -- start 2023-07-14T12:57:43.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.418+0000 7fc7c4bff700 1 -- start start 2023-07-14T12:57:43.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7c4bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7c0072f10 0x7fc7c0197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:43.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7c4bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7c00744f0 0x7fc7c0197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:43.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7c4bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c0107980 0x7fc7c019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7c4bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c019f4f0 con 0x7fc7c00744f0 2023-07-14T12:57:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7c4bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c019f630 con 0x7fc7c0072f10 2023-07-14T12:57:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7c4bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c019f7c0 con 0x7fc7c0107980 2023-07-14T12:57:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7bdd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7c00744f0 0x7fc7c0197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7bdd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7c00744f0 0x7fc7c0197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47744/0 (socket says 172.21.15.17:47744) 2023-07-14T12:57:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7bdd9b700 1 -- 172.21.15.17:0/450733974 learned_addr learned my addr 172.21.15.17:0/450733974 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7be59c700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7c0072f10 0x7fc7c0197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7bed9d700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c0107980 0x7fc7c019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7bdd9b700 1 -- 172.21.15.17:0/450733974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c0107980 msgr2=0x7fc7c019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7bdd9b700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c0107980 0x7fc7c019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7bdd9b700 1 -- 172.21.15.17:0/450733974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7c0072f10 msgr2=0x7fc7c0197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7bdd9b700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7c0072f10 0x7fc7c0197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7bdd9b700 1 -- 172.21.15.17:0/450733974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b40095f0 con 0x7fc7c00744f0 2023-07-14T12:57:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.419+0000 7fc7bed9d700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c0107980 0x7fc7c019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:57:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.420+0000 7fc7bdd9b700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7c00744f0 0x7fc7c0197eb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40098e0 tx=0x7fc7b4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:43.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.420+0000 7fc7af7fe700 1 -- 172.21.15.17:0/450733974 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b401d070 con 0x7fc7c00744f0 2023-07-14T12:57:43.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.420+0000 7fc7c4bff700 1 -- 172.21.15.17:0/450733974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c019fa40 con 0x7fc7c00744f0 2023-07-14T12:57:43.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.420+0000 7fc7af7fe700 1 -- 172.21.15.17:0/450733974 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7b400f460 con 0x7fc7c00744f0 2023-07-14T12:57:43.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.420+0000 7fc7af7fe700 1 -- 172.21.15.17:0/450733974 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4021670 con 0x7fc7c00744f0 2023-07-14T12:57:43.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.420+0000 7fc7c4bff700 1 -- 172.21.15.17:0/450733974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c019fec0 con 0x7fc7c00744f0 2023-07-14T12:57:43.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.421+0000 7fc7c4bff700 1 -- 172.21.15.17:0/450733974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c01060c0 con 0x7fc7c00744f0 2023-07-14T12:57:43.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.423+0000 7fc7af7fe700 1 -- 172.21.15.17:0/450733974 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc7b400f5d0 con 0x7fc7c00744f0 2023-07-14T12:57:43.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.424+0000 7fc7af7fe700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc7a80a1150 0x7fc7a80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.424+0000 7fc7af7fe700 1 -- 172.21.15.17:0/450733974 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc7b40cda10 con 0x7fc7c00744f0 2023-07-14T12:57:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.425+0000 7fc7be59c700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc7a80a1150 0x7fc7a80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.425+0000 7fc7be59c700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc7a80a1150 0x7fc7a80a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009bf0 tx=0x7fc7b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:43.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.428+0000 7fc7af7fe700 1 -- 172.21.15.17:0/450733974 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc7b40972a0 con 0x7fc7c00744f0 2023-07-14T12:57:43.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:43 smithi131 ceph-mon[96953]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-07-14T12:57:43.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:43 smithi131 ceph-mon[96953]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T12:57:43.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:43 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2500529430' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-07-14T12:57:43.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:43 smithi131 ceph-mon[96953]: pgmap v304: 97 pgs: 68 active+clean, 21 creating+peering, 8 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 651 B/s wr, 5 op/s 2023-07-14T12:57:43.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:43.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:57:43.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:43 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:43.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:43 smithi017 ceph-mon[95536]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-07-14T12:57:43.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:43 smithi017 ceph-mon[95536]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T12:57:43.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:43 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2500529430' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-07-14T12:57:43.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:43 smithi017 ceph-mon[95536]: pgmap v304: 97 pgs: 68 active+clean, 21 creating+peering, 8 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 651 B/s wr, 5 op/s 2023-07-14T12:57:43.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:43.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:57:43.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:43 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:43.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:43 smithi135 ceph-mon[97338]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-07-14T12:57:43.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:43 smithi135 ceph-mon[97338]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T12:57:43.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:43 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2500529430' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-07-14T12:57:43.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:43 smithi135 ceph-mon[97338]: pgmap v304: 97 pgs: 68 active+clean, 21 creating+peering, 8 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 651 B/s wr, 5 op/s 2023-07-14T12:57:43.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:57:43.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:57:43.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:43 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:57:43.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:43.686+0000 7fc7c4bff700 1 -- 172.21.15.17:0/450733974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fc7c0061120 con 0x7fc7c00744f0 2023-07-14T12:57:44.214 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 12:57:43 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-b[122274]: 2023-07-14T12:57:43.916+0000 7f042359f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T12:57:44.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.193+0000 7fc7af7fe700 1 -- 172.21.15.17:0/450733974 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7fc7b409a8c0 con 0x7fc7c00744f0 2023-07-14T12:57:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.196+0000 7fc7c4bff700 1 -- 172.21.15.17:0/450733974 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc7a80a1150 msgr2=0x7fc7a80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.196+0000 7fc7c4bff700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc7a80a1150 0x7fc7a80a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009bf0 tx=0x7fc7b0009260 comp rx=0 tx=0).stop 2023-07-14T12:57:44.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.196+0000 7fc7c4bff700 1 -- 172.21.15.17:0/450733974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7c00744f0 msgr2=0x7fc7c0197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:44.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.196+0000 7fc7c4bff700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7c00744f0 0x7fc7c0197eb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40098e0 tx=0x7fc7b4005ef0 comp rx=0 tx=0).stop 2023-07-14T12:57:44.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.197+0000 7fc7c4bff700 1 -- 172.21.15.17:0/450733974 shutdown_connections 2023-07-14T12:57:44.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.197+0000 7fc7c4bff700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc7a80a1150 0x7fc7a80a3600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.197+0000 7fc7c4bff700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7c0107980 0x7fc7c019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.197+0000 7fc7c4bff700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7c0072f10 0x7fc7c0197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.197+0000 7fc7c4bff700 1 --2- 172.21.15.17:0/450733974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7c00744f0 0x7fc7c0197eb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.197+0000 7fc7c4bff700 1 -- 172.21.15.17:0/450733974 >> 172.21.15.17:0/450733974 conn(0x7fc7c00fb130 msgr2=0x7fc7c00fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:44.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.197+0000 7fc7c4bff700 1 -- 172.21.15.17:0/450733974 shutdown_connections 2023-07-14T12:57:44.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.197+0000 7fc7c4bff700 1 -- 172.21.15.17:0/450733974 wait complete. 2023-07-14T12:57:44.251 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-07-14T12:57:44.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.432+0000 7f3240dff700 1 -- 172.21.15.17:0/3916878495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f323c1079a0 msgr2=0x7f323c109e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:44.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.432+0000 7f3240dff700 1 --2- 172.21.15.17:0/3916878495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f323c1079a0 0x7f323c109e20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f323400b0a0 tx=0x7f323400b3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.432+0000 7f3240dff700 1 -- 172.21.15.17:0/3916878495 shutdown_connections 2023-07-14T12:57:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.432+0000 7f3240dff700 1 --2- 172.21.15.17:0/3916878495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f323c1079a0 0x7f323c109e20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.432+0000 7f3240dff700 1 --2- 172.21.15.17:0/3916878495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f323c074550 0x7f323c0729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.432+0000 7f3240dff700 1 --2- 172.21.15.17:0/3916878495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f323c072f70 0x7f323c0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.432+0000 7f3240dff700 1 -- 172.21.15.17:0/3916878495 >> 172.21.15.17:0/3916878495 conn(0x7f323c0fb0e0 msgr2=0x7f323c0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.432+0000 7f3240dff700 1 -- 172.21.15.17:0/3916878495 shutdown_connections 2023-07-14T12:57:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.433+0000 7f3240dff700 1 -- 172.21.15.17:0/3916878495 wait complete. 2023-07-14T12:57:44.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.433+0000 7f3240dff700 1 Processor -- start 2023-07-14T12:57:44.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.434+0000 7f3240dff700 1 -- start start 2023-07-14T12:57:44.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.434+0000 7f3240dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f323c072f70 0x7f323c197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:44.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.434+0000 7f3240dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f323c074550 0x7f323c198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:44.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.434+0000 7f3240dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f323c1079a0 0x7f323c19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:44.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.434+0000 7f3240dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c19f5f0 con 0x7f323c072f70 2023-07-14T12:57:44.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.434+0000 7f3240dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c19f730 con 0x7f323c074550 2023-07-14T12:57:44.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.434+0000 7f3240dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c19f8c0 con 0x7f323c1079a0 2023-07-14T12:57:44.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.434+0000 7f323a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f323c072f70 0x7f323c197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:44.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.434+0000 7f323a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f323c072f70 0x7f323c197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47762/0 (socket says 172.21.15.17:47762) 2023-07-14T12:57:44.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.434+0000 7f323a59c700 1 -- 172.21.15.17:0/1984349178 learned_addr learned my addr 172.21.15.17:0/1984349178 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:44.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.434+0000 7f3239d9b700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f323c074550 0x7f323c198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:44.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f323ad9d700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f323c1079a0 0x7f323c19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:44.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f323a59c700 1 -- 172.21.15.17:0/1984349178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f323c1079a0 msgr2=0x7f323c19f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:44.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f323a59c700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f323c1079a0 0x7f323c19f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:44.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f323a59c700 1 -- 172.21.15.17:0/1984349178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f323c074550 msgr2=0x7f323c198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:44.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f323a59c700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f323c074550 0x7f323c198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:44.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f323a59c700 1 -- 172.21.15.17:0/1984349178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234009d00 con 0x7f323c072f70 2023-07-14T12:57:44.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f323ad9d700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f323c1079a0 0x7f323c19f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:57:44.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f323a59c700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f323c072f70 0x7f323c197ac0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f322c00e970 tx=0x7f322c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:44.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f322b7fe700 1 -- 172.21.15.17:0/1984349178 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c009790 con 0x7f323c072f70 2023-07-14T12:57:44.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f322b7fe700 1 -- 172.21.15.17:0/1984349178 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f322c00eec0 con 0x7f323c072f70 2023-07-14T12:57:44.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f3240dff700 1 -- 172.21.15.17:0/1984349178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c19fba0 con 0x7f323c072f70 2023-07-14T12:57:44.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f322b7fe700 1 -- 172.21.15.17:0/1984349178 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c0054b0 con 0x7f323c072f70 2023-07-14T12:57:44.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.435+0000 7f3240dff700 1 -- 172.21.15.17:0/1984349178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c1a00b0 con 0x7f323c072f70 2023-07-14T12:57:44.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.436+0000 7f3240dff700 1 -- 172.21.15.17:0/1984349178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c106050 con 0x7f323c072f70 2023-07-14T12:57:44.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.438+0000 7f322b7fe700 1 -- 172.21.15.17:0/1984349178 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f322c004750 con 0x7f323c072f70 2023-07-14T12:57:44.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.440+0000 7f322b7fe700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32240a1150 0x7f32240a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:44.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.440+0000 7f322b7fe700 1 -- 172.21.15.17:0/1984349178 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f322c014070 con 0x7f323c072f70 2023-07-14T12:57:44.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.440+0000 7f3239d9b700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32240a1150 0x7f32240a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:44.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.441+0000 7f3239d9b700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32240a1150 0x7f32240a3600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f323c074270 tx=0x7f323000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:44.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.444+0000 7f322b7fe700 1 -- 172.21.15.17:0/1984349178 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f322c0962a0 con 0x7f323c072f70 2023-07-14T12:57:44.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:44 smithi131 ceph-mon[96953]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-07-14T12:57:44.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:44 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2500529430' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-07-14T12:57:44.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:44 smithi131 ceph-mon[96953]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-07-14T12:57:44.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:44 smithi131 ceph-mon[96953]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T12:57:44.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:44 smithi131 ceph-mon[96953]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-07-14T12:57:44.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:44 smithi131 ceph-mon[96953]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-07-14T12:57:44.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:44 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/450733974' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-14T12:57:44.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:44 smithi017 ceph-mon[95536]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-07-14T12:57:44.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:44 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2500529430' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-07-14T12:57:44.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:44 smithi017 ceph-mon[95536]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-07-14T12:57:44.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:44 smithi017 ceph-mon[95536]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T12:57:44.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:44 smithi017 ceph-mon[95536]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-07-14T12:57:44.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:44 smithi017 ceph-mon[95536]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-07-14T12:57:44.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:44 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/450733974' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-14T12:57:44.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:44 smithi135 ceph-mon[97338]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-07-14T12:57:44.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:44 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2500529430' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-07-14T12:57:44.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:44 smithi135 ceph-mon[97338]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-07-14T12:57:44.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:44 smithi135 ceph-mon[97338]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T12:57:44.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:44 smithi135 ceph-mon[97338]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2023-07-14T12:57:44.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:44 smithi135 ceph-mon[97338]: daemon mds.h is now active in filesystem cephfs as rank 1 2023-07-14T12:57:44.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:44 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/450733974' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-14T12:57:44.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:44.700+0000 7f3240dff700 1 -- 172.21.15.17:0/1984349178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f323c02c850 con 0x7f323c072f70 2023-07-14T12:57:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.207+0000 7f322b7fe700 1 -- 172.21.15.17:0/1984349178 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f322c0998c0 con 0x7f323c072f70 2023-07-14T12:57:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.210+0000 7f3240dff700 1 -- 172.21.15.17:0/1984349178 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32240a1150 msgr2=0x7f32240a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.210+0000 7f3240dff700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32240a1150 0x7f32240a3600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f323c074270 tx=0x7f323000b410 comp rx=0 tx=0).stop 2023-07-14T12:57:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.210+0000 7f3240dff700 1 -- 172.21.15.17:0/1984349178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f323c072f70 msgr2=0x7f323c197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.210+0000 7f3240dff700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f323c072f70 0x7f323c197ac0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f322c00e970 tx=0x7f322c00ec80 comp rx=0 tx=0).stop 2023-07-14T12:57:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.210+0000 7f3240dff700 1 -- 172.21.15.17:0/1984349178 shutdown_connections 2023-07-14T12:57:45.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.210+0000 7f3240dff700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32240a1150 0x7f32240a3600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.210+0000 7f3240dff700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f323c1079a0 0x7f323c19f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.210+0000 7f3240dff700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f323c072f70 0x7f323c197ac0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.210+0000 7f3240dff700 1 --2- 172.21.15.17:0/1984349178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f323c074550 0x7f323c198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.210+0000 7f3240dff700 1 -- 172.21.15.17:0/1984349178 >> 172.21.15.17:0/1984349178 conn(0x7f323c0fb0e0 msgr2=0x7f323c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.210+0000 7f3240dff700 1 -- 172.21.15.17:0/1984349178 shutdown_connections 2023-07-14T12:57:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.211+0000 7f3240dff700 1 -- 172.21.15.17:0/1984349178 wait complete. 2023-07-14T12:57:45.261 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2023-07-14T12:57:45.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-07-14T12:57:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.440+0000 7f6906bff700 1 -- 172.21.15.17:0/715976634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69000ffae0 msgr2=0x7f69000ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.440+0000 7f6906bff700 1 --2- 172.21.15.17:0/715976634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69000ffae0 0x7f69000ffef0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009990 tx=0x7f68f4009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.440+0000 7f6906bff700 1 -- 172.21.15.17:0/715976634 shutdown_connections 2023-07-14T12:57:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.440+0000 7f6906bff700 1 --2- 172.21.15.17:0/715976634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6900101660 0x7f6900107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.440+0000 7f6906bff700 1 --2- 172.21.15.17:0/715976634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69000ffae0 0x7f69000ffef0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.440+0000 7f6906bff700 1 --2- 172.21.15.17:0/715976634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6900100cd0 0x7f6900101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.440+0000 7f6906bff700 1 -- 172.21.15.17:0/715976634 >> 172.21.15.17:0/715976634 conn(0x7f69000fb0e0 msgr2=0x7f69000fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:45.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.441+0000 7f6906bff700 1 -- 172.21.15.17:0/715976634 shutdown_connections 2023-07-14T12:57:45.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.441+0000 7f6906bff700 1 -- 172.21.15.17:0/715976634 wait complete. 2023-07-14T12:57:45.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.441+0000 7f6906bff700 1 Processor -- start 2023-07-14T12:57:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.442+0000 7f6906bff700 1 -- start start 2023-07-14T12:57:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.442+0000 7f6906bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69000ffae0 0x7f69001978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:45.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.442+0000 7f6906bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6900100cd0 0x7f6900197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.442+0000 7f6906bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6900101660 0x7f690019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.442+0000 7f6906bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690019f450 con 0x7f69000ffae0 2023-07-14T12:57:45.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.442+0000 7f6906bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690019f590 con 0x7f6900101660 2023-07-14T12:57:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.442+0000 7f6906bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690019f720 con 0x7f6900100cd0 2023-07-14T12:57:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.442+0000 7f690499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69000ffae0 0x7f69001978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.442+0000 7f690499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69000ffae0 0x7f69001978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48444/0 (socket says 172.21.15.17:48444) 2023-07-14T12:57:45.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.442+0000 7f690499b700 1 -- 172.21.15.17:0/3139793030 learned_addr learned my addr 172.21.15.17:0/3139793030 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.442+0000 7f68fffff700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6900100cd0 0x7f6900197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f690519c700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6900101660 0x7f690019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f690499b700 1 -- 172.21.15.17:0/3139793030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6900100cd0 msgr2=0x7f6900197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:45.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f690499b700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6900100cd0 0x7f6900197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f690499b700 1 -- 172.21.15.17:0/3139793030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6900101660 msgr2=0x7f690019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f690499b700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6900101660 0x7f690019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f690499b700 1 -- 172.21.15.17:0/3139793030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f40095f0 con 0x7f69000ffae0 2023-07-14T12:57:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f690519c700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6900101660 0x7f690019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:57:45.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f690499b700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69000ffae0 0x7f69001978d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f68f4003ec0 tx=0x7f68f4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f68fdffb700 1 -- 172.21.15.17:0/3139793030 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f401d070 con 0x7f69000ffae0 2023-07-14T12:57:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f68fdffb700 1 -- 172.21.15.17:0/3139793030 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68f400be70 con 0x7f69000ffae0 2023-07-14T12:57:45.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f6906bff700 1 -- 172.21.15.17:0/3139793030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690019f9a0 con 0x7f69000ffae0 2023-07-14T12:57:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f68fdffb700 1 -- 172.21.15.17:0/3139793030 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4022ea0 con 0x7f69000ffae0 2023-07-14T12:57:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.443+0000 7f6906bff700 1 -- 172.21.15.17:0/3139793030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690019fe20 con 0x7f69000ffae0 2023-07-14T12:57:45.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.445+0000 7f6906bff700 1 -- 172.21.15.17:0/3139793030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6900191fc0 con 0x7f69000ffae0 2023-07-14T12:57:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.447+0000 7f68fdffb700 1 -- 172.21.15.17:0/3139793030 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f68f4022670 con 0x7f69000ffae0 2023-07-14T12:57:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.448+0000 7f68fdffb700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68f00a1150 0x7f68f00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.449+0000 7f68fdffb700 1 -- 172.21.15.17:0/3139793030 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f68f40cdb30 con 0x7f69000ffae0 2023-07-14T12:57:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.449+0000 7f68fffff700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68f00a1150 0x7f68f00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:45.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.449+0000 7f68fffff700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68f00a1150 0x7f68f00a3600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009c60 tx=0x7f68ec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:45.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.452+0000 7f68fdffb700 1 -- 172.21.15.17:0/3139793030 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f68f405c790 con 0x7f69000ffae0 2023-07-14T12:57:45.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:45 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] up:active 2023-07-14T12:57:45.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:45 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/450733974' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-07-14T12:57:45.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:45 smithi131 ceph-mon[96953]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-07-14T12:57:45.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:45 smithi131 ceph-mon[96953]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-07-14T12:57:45.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:45 smithi131 ceph-mon[96953]: Cluster is now healthy 2023-07-14T12:57:45.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:45 smithi131 ceph-mon[96953]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2023-07-14T12:57:45.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:45 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2023-07-14T12:57:45.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:45 smithi131 ceph-mon[96953]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-07-14T12:57:45.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:45 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1984349178' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-07-14T12:57:45.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:45 smithi131 ceph-mon[96953]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 11 op/s 2023-07-14T12:57:45.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] up:active 2023-07-14T12:57:45.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/450733974' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-07-14T12:57:45.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-mon[95536]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-07-14T12:57:45.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-mon[95536]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-07-14T12:57:45.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-mon[95536]: Cluster is now healthy 2023-07-14T12:57:45.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-mon[95536]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2023-07-14T12:57:45.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2023-07-14T12:57:45.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-mon[95536]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-07-14T12:57:45.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1984349178' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-07-14T12:57:45.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-mon[95536]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 11 op/s 2023-07-14T12:57:45.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:45 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] up:active 2023-07-14T12:57:45.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:45 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/450733974' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-07-14T12:57:45.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:45 smithi135 ceph-mon[97338]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-07-14T12:57:45.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:45 smithi135 ceph-mon[97338]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-07-14T12:57:45.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:45 smithi135 ceph-mon[97338]: Cluster is now healthy 2023-07-14T12:57:45.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:45 smithi135 ceph-mon[97338]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2023-07-14T12:57:45.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:45 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2023-07-14T12:57:45.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:45 smithi135 ceph-mon[97338]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-07-14T12:57:45.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:45 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1984349178' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-07-14T12:57:45.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:45 smithi135 ceph-mon[97338]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 11 op/s 2023-07-14T12:57:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.695+0000 7f6906bff700 1 -- 172.21.15.17:0/3139793030 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f6900060950 con 0x7f68f00a1150 2023-07-14T12:57:45.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.742+0000 7f68fdffb700 1 -- 172.21.15.17:0/3139793030 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6900060950 con 0x7f68f00a1150 2023-07-14T12:57:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.744+0000 7f6906bff700 1 -- 172.21.15.17:0/3139793030 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68f00a1150 msgr2=0x7f68f00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:45.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.744+0000 7f6906bff700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68f00a1150 0x7f68f00a3600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009c60 tx=0x7f68ec009260 comp rx=0 tx=0).stop 2023-07-14T12:57:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.744+0000 7f6906bff700 1 -- 172.21.15.17:0/3139793030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69000ffae0 msgr2=0x7f69001978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.744+0000 7f6906bff700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69000ffae0 0x7f69001978d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f68f4003ec0 tx=0x7f68f4005740 comp rx=0 tx=0).stop 2023-07-14T12:57:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.745+0000 7f6906bff700 1 -- 172.21.15.17:0/3139793030 shutdown_connections 2023-07-14T12:57:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.745+0000 7f6906bff700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68f00a1150 0x7f68f00a3600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.745+0000 7f6906bff700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6900101660 0x7f690019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.745+0000 7f6906bff700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69000ffae0 0x7f69001978d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.745+0000 7f6906bff700 1 --2- 172.21.15.17:0/3139793030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6900100cd0 0x7f6900197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:45.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.745+0000 7f6906bff700 1 -- 172.21.15.17:0/3139793030 >> 172.21.15.17:0/3139793030 conn(0x7f69000fb0e0 msgr2=0x7f6900106670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:45.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.745+0000 7f6906bff700 1 -- 172.21.15.17:0/3139793030 shutdown_connections 2023-07-14T12:57:45.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.745+0000 7f6906bff700 1 -- 172.21.15.17:0/3139793030 wait complete. 2023-07-14T12:57:45.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-07-14T12:57:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.971+0000 7f8bb97ff700 1 -- 172.21.15.17:0/303780928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb4101670 msgr2=0x7f8bb4107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:46.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.971+0000 7f8bb97ff700 1 --2- 172.21.15.17:0/303780928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb4101670 0x7f8bb4107f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00b0a0 tx=0x7f8bac00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.971+0000 7f8bb97ff700 1 -- 172.21.15.17:0/303780928 shutdown_connections 2023-07-14T12:57:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.971+0000 7f8bb97ff700 1 --2- 172.21.15.17:0/303780928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb4101670 0x7f8bb4107f30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.971+0000 7f8bb97ff700 1 --2- 172.21.15.17:0/303780928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb40ffaf0 0x7f8bb40fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.971+0000 7f8bb97ff700 1 --2- 172.21.15.17:0/303780928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb4100ce0 0x7f8bb4101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.971+0000 7f8bb97ff700 1 -- 172.21.15.17:0/303780928 >> 172.21.15.17:0/303780928 conn(0x7f8bb40fb130 msgr2=0x7f8bb40fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.971+0000 7f8bb97ff700 1 -- 172.21.15.17:0/303780928 shutdown_connections 2023-07-14T12:57:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.971+0000 7f8bb97ff700 1 -- 172.21.15.17:0/303780928 wait complete. 2023-07-14T12:57:46.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.972+0000 7f8bb97ff700 1 Processor -- start 2023-07-14T12:57:46.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb97ff700 1 -- start start 2023-07-14T12:57:46.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb97ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb40ffaf0 0x7f8bb4197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:46.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb97ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb4100ce0 0x7f8bb4198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb97ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb4101670 0x7f8bb419f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb97ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb419f6a0 con 0x7f8bb4100ce0 2023-07-14T12:57:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb97ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb419f7e0 con 0x7f8bb40ffaf0 2023-07-14T12:57:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb97ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb419f970 con 0x7f8bb4101670 2023-07-14T12:57:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb4100ce0 0x7f8bb4198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:46.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb4100ce0 0x7f8bb4198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48480/0 (socket says 172.21.15.17:48480) 2023-07-14T12:57:46.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb27fc700 1 -- 172.21.15.17:0/1908624946 learned_addr learned my addr 172.21.15.17:0/1908624946 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:46.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb2ffd700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb40ffaf0 0x7f8bb4197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:46.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb37fe700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb4101670 0x7f8bb419f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:46.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.973+0000 7f8bb27fc700 1 -- 172.21.15.17:0/1908624946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb4101670 msgr2=0x7f8bb419f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:46.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.974+0000 7f8bb27fc700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb4101670 0x7f8bb419f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.974+0000 7f8bb27fc700 1 -- 172.21.15.17:0/1908624946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb40ffaf0 msgr2=0x7f8bb4197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:46.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.974+0000 7f8bb27fc700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb40ffaf0 0x7f8bb4197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.974+0000 7f8bb27fc700 1 -- 172.21.15.17:0/1908624946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac009d00 con 0x7f8bb4100ce0 2023-07-14T12:57:46.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.974+0000 7f8bb2ffd700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb40ffaf0 0x7f8bb4197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:57:46.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.974+0000 7f8bb27fc700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb4100ce0 0x7f8bb4198060 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800d950 tx=0x7f8ba800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:46.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.974+0000 7f8b9bfff700 1 -- 172.21.15.17:0/1908624946 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8009b40 con 0x7f8bb4100ce0 2023-07-14T12:57:46.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.974+0000 7f8bb97ff700 1 -- 172.21.15.17:0/1908624946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb419fc50 con 0x7f8bb4100ce0 2023-07-14T12:57:46.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.974+0000 7f8b9bfff700 1 -- 172.21.15.17:0/1908624946 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ba8009ca0 con 0x7f8bb4100ce0 2023-07-14T12:57:46.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.974+0000 7f8b9bfff700 1 -- 172.21.15.17:0/1908624946 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba800f620 con 0x7f8bb4100ce0 2023-07-14T12:57:46.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.974+0000 7f8bb97ff700 1 -- 172.21.15.17:0/1908624946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb41a0160 con 0x7f8bb4100ce0 2023-07-14T12:57:46.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.975+0000 7f8bb97ff700 1 -- 172.21.15.17:0/1908624946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb4192090 con 0x7f8bb4100ce0 2023-07-14T12:57:46.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.977+0000 7f8b9bfff700 1 -- 172.21.15.17:0/1908624946 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8ba8010460 con 0x7f8bb4100ce0 2023-07-14T12:57:46.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.979+0000 7f8b9bfff700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b9c0a1150 0x7f8b9c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:46.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.979+0000 7f8b9bfff700 1 -- 172.21.15.17:0/1908624946 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8ba80ccad0 con 0x7f8bb4100ce0 2023-07-14T12:57:46.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.979+0000 7f8bb2ffd700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b9c0a1150 0x7f8b9c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:46.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.979+0000 7f8bb2ffd700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b9c0a1150 0x7f8b9c0a3600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4100b40 tx=0x7f8ba4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:46.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:45.983+0000 7f8b9bfff700 1 -- 172.21.15.17:0/1908624946 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8ba8096370 con 0x7f8bb4100ce0 2023-07-14T12:57:46.105 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:57:45.703+0000 7f10dd438700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:57:46.105 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:57:45.703+0000 7f10dd438700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:57:46.105 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:57:45.703+0000 7f10dd438700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:57:46.106 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:57:45.703+0000 7f10dd438700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:57:46.106 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:57:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:57:45.703+0000 7f10dd438700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:57:46.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.233+0000 7f8bb97ff700 1 -- 172.21.15.17:0/1908624946 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bb4060950 con 0x7f8b9c0a1150 2023-07-14T12:57:46.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.238+0000 7f8b9bfff700 1 -- 172.21.15.17:0/1908624946 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f8bb4060950 con 0x7f8b9c0a1150 2023-07-14T12:57:46.267 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 2023-07-14T12:57:46.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.240+0000 7f8bb97ff700 1 -- 172.21.15.17:0/1908624946 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b9c0a1150 msgr2=0x7f8b9c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:46.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.240+0000 7f8bb97ff700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b9c0a1150 0x7f8b9c0a3600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4100b40 tx=0x7f8ba4009260 comp rx=0 tx=0).stop 2023-07-14T12:57:46.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.240+0000 7f8bb97ff700 1 -- 172.21.15.17:0/1908624946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb4100ce0 msgr2=0x7f8bb4198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.240+0000 7f8bb97ff700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb4100ce0 0x7f8bb4198060 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800d950 tx=0x7f8ba800dd10 comp rx=0 tx=0).stop 2023-07-14T12:57:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.241+0000 7f8bb97ff700 1 -- 172.21.15.17:0/1908624946 shutdown_connections 2023-07-14T12:57:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.241+0000 7f8bb97ff700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8b9c0a1150 0x7f8b9c0a3600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.241+0000 7f8bb97ff700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bb4101670 0x7f8bb419f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.241+0000 7f8bb97ff700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bb40ffaf0 0x7f8bb4197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.241+0000 7f8bb97ff700 1 --2- 172.21.15.17:0/1908624946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bb4100ce0 0x7f8bb4198060 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.241+0000 7f8bb97ff700 1 -- 172.21.15.17:0/1908624946 >> 172.21.15.17:0/1908624946 conn(0x7f8bb40fb130 msgr2=0x7f8bb41065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:46.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.241+0000 7f8bb97ff700 1 -- 172.21.15.17:0/1908624946 shutdown_connections 2023-07-14T12:57:46.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.241+0000 7f8bb97ff700 1 -- 172.21.15.17:0/1908624946 wait complete. 2023-07-14T12:57:46.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-07-14T12:57:46.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:46 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] up:active 2023-07-14T12:57:46.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:46 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1984349178' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-07-14T12:57:46.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:46 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2023-07-14T12:57:46.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:46 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T12:57:46.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:46 smithi131 ceph-mon[96953]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.468+0000 7f78bb3ff700 1 -- 172.21.15.17:0/283296520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b4074550 msgr2=0x7f78b40729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.468+0000 7f78bb3ff700 1 --2- 172.21.15.17:0/283296520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b4074550 0x7f78b40729a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009990 tx=0x7f78b0009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.468+0000 7f78bb3ff700 1 -- 172.21.15.17:0/283296520 shutdown_connections 2023-07-14T12:57:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.468+0000 7f78bb3ff700 1 --2- 172.21.15.17:0/283296520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b41079a0 0x7f78b4109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.468+0000 7f78bb3ff700 1 --2- 172.21.15.17:0/283296520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b4074550 0x7f78b40729a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.468+0000 7f78bb3ff700 1 --2- 172.21.15.17:0/283296520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b4072f70 0x7f78b40733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.468+0000 7f78bb3ff700 1 -- 172.21.15.17:0/283296520 >> 172.21.15.17:0/283296520 conn(0x7f78b40fb0e0 msgr2=0x7f78b40fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.468+0000 7f78bb3ff700 1 -- 172.21.15.17:0/283296520 shutdown_connections 2023-07-14T12:57:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.468+0000 7f78bb3ff700 1 -- 172.21.15.17:0/283296520 wait complete. 2023-07-14T12:57:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.469+0000 7f78bb3ff700 1 Processor -- start 2023-07-14T12:57:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78bb3ff700 1 -- start start 2023-07-14T12:57:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78bb3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b4072f70 0x7f78b4197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78bb3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b4074550 0x7f78b4197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78bb3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b41079a0 0x7f78b419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78bb3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b419f590 con 0x7f78b41079a0 2023-07-14T12:57:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78bb3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b419f6d0 con 0x7f78b4072f70 2023-07-14T12:57:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78bb3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b419f860 con 0x7f78b4074550 2023-07-14T12:57:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78b919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b4072f70 0x7f78b4197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78b999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b41079a0 0x7f78b419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78b919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b4072f70 0x7f78b4197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35818/0 (socket says 172.21.15.17:35818) 2023-07-14T12:57:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78b919b700 1 -- 172.21.15.17:0/963065856 learned_addr learned my addr 172.21.15.17:0/963065856 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.470+0000 7f78b899a700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b4074550 0x7f78b4197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.471+0000 7f78b999c700 1 -- 172.21.15.17:0/963065856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b4074550 msgr2=0x7f78b4197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.471+0000 7f78b999c700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b4074550 0x7f78b4197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.471+0000 7f78b999c700 1 -- 172.21.15.17:0/963065856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b4072f70 msgr2=0x7f78b4197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.471+0000 7f78b999c700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b4072f70 0x7f78b4197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.471+0000 7f78b999c700 1 -- 172.21.15.17:0/963065856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b00095f0 con 0x7f78b41079a0 2023-07-14T12:57:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.471+0000 7f78b999c700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b41079a0 0x7f78b419efc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f78ac007f10 tx=0x7f78ac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.471+0000 7f78aa7fc700 1 -- 172.21.15.17:0/963065856 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00ddd0 con 0x7f78b41079a0 2023-07-14T12:57:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.471+0000 7f78aa7fc700 1 -- 172.21.15.17:0/963065856 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78ac00f040 con 0x7f78b41079a0 2023-07-14T12:57:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.471+0000 7f78bb3ff700 1 -- 172.21.15.17:0/963065856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b419fb40 con 0x7f78b41079a0 2023-07-14T12:57:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.471+0000 7f78aa7fc700 1 -- 172.21.15.17:0/963065856 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0059c0 con 0x7f78b41079a0 2023-07-14T12:57:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.471+0000 7f78bb3ff700 1 -- 172.21.15.17:0/963065856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b41a0050 con 0x7f78b41079a0 2023-07-14T12:57:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.472+0000 7f78bb3ff700 1 -- 172.21.15.17:0/963065856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b4106050 con 0x7f78b41079a0 2023-07-14T12:57:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.474+0000 7f78aa7fc700 1 -- 172.21.15.17:0/963065856 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f78ac005020 con 0x7f78b41079a0 2023-07-14T12:57:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.475+0000 7f78aa7fc700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f78a00a1150 0x7f78a00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.476+0000 7f78aa7fc700 1 -- 172.21.15.17:0/963065856 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f78ac0cc0d0 con 0x7f78b41079a0 2023-07-14T12:57:46.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.476+0000 7f78b919b700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f78a00a1150 0x7f78a00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:46.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.476+0000 7f78b919b700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f78a00a1150 0x7f78a00a3600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f78b0006010 tx=0x7f78b000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:46.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.479+0000 7f78aa7fc700 1 -- 172.21.15.17:0/963065856 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f78ac04e790 con 0x7f78b41079a0 2023-07-14T12:57:46.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:46 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] up:active 2023-07-14T12:57:46.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:46 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1984349178' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-07-14T12:57:46.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:46 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2023-07-14T12:57:46.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:46 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T12:57:46.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:46 smithi017 ceph-mon[95536]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:46.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:46 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] up:active 2023-07-14T12:57:46.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:46 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1984349178' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-07-14T12:57:46.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:46 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2023-07-14T12:57:46.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:46 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T12:57:46.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:46 smithi135 ceph-mon[97338]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:46.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.723+0000 7f78bb3ff700 1 -- 172.21.15.17:0/963065856 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f78b40609e0 con 0x7f78a00a1150 2023-07-14T12:57:46.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.752+0000 7f78aa7fc700 1 -- 172.21.15.17:0/963065856 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f78b40609e0 con 0x7f78a00a1150 2023-07-14T12:57:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 -- 172.21.15.17:0/963065856 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f78a00a1150 msgr2=0x7f78a00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f78a00a1150 0x7f78a00a3600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f78b0006010 tx=0x7f78b000b260 comp rx=0 tx=0).stop 2023-07-14T12:57:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 -- 172.21.15.17:0/963065856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b41079a0 msgr2=0x7f78b419efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b41079a0 0x7f78b419efc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f78ac007f10 tx=0x7f78ac00d3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 -- 172.21.15.17:0/963065856 shutdown_connections 2023-07-14T12:57:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f78a00a1150 0x7f78a00a3600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b41079a0 0x7f78b419efc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b4072f70 0x7f78b4197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 --2- 172.21.15.17:0/963065856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b4074550 0x7f78b4197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 -- 172.21.15.17:0/963065856 >> 172.21.15.17:0/963065856 conn(0x7f78b40fb0e0 msgr2=0x7f78b40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:46.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 -- 172.21.15.17:0/963065856 shutdown_connections 2023-07-14T12:57:46.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.755+0000 7f78bb3ff700 1 -- 172.21.15.17:0/963065856 wait complete. 2023-07-14T12:57:46.802 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-07-14T12:57:47.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.981+0000 7fafe27ff700 1 -- 172.21.15.17:0/1356347555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc100ce0 msgr2=0x7fafdc101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.981+0000 7fafe27ff700 1 --2- 172.21.15.17:0/1356347555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc100ce0 0x7fafdc101130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009990 tx=0x7fafd0009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.981+0000 7fafe27ff700 1 -- 172.21.15.17:0/1356347555 shutdown_connections 2023-07-14T12:57:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.981+0000 7fafe27ff700 1 --2- 172.21.15.17:0/1356347555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc101670 0x7fafdc107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.981+0000 7fafe27ff700 1 --2- 172.21.15.17:0/1356347555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0ffaf0 0x7fafdc0fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.981+0000 7fafe27ff700 1 --2- 172.21.15.17:0/1356347555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc100ce0 0x7fafdc101130 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.981+0000 7fafe27ff700 1 -- 172.21.15.17:0/1356347555 >> 172.21.15.17:0/1356347555 conn(0x7fafdc0fb130 msgr2=0x7fafdc0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.981+0000 7fafe27ff700 1 -- 172.21.15.17:0/1356347555 shutdown_connections 2023-07-14T12:57:47.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.981+0000 7fafe27ff700 1 -- 172.21.15.17:0/1356347555 wait complete. 2023-07-14T12:57:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.982+0000 7fafe27ff700 1 Processor -- start 2023-07-14T12:57:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.982+0000 7fafe27ff700 1 -- start start 2023-07-14T12:57:47.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.982+0000 7fafe27ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0ffaf0 0x7fafdc0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.982+0000 7fafe27ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc100ce0 0x7fafdc072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.982+0000 7fafe27ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101670 0x7fafdc072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.982+0000 7fafe27ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc199650 con 0x7fafdc101670 2023-07-14T12:57:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.982+0000 7fafe27ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc073380 con 0x7fafdc100ce0 2023-07-14T12:57:47.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.982+0000 7fafe27ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc073540 con 0x7fafdc0ffaf0 2023-07-14T12:57:47.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafe0d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101670 0x7fafdc072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:47.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafe0d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101670 0x7fafdc072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48516/0 (socket says 172.21.15.17:48516) 2023-07-14T12:57:47.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafe0d9c700 1 -- 172.21.15.17:0/4230844990 learned_addr learned my addr 172.21.15.17:0/4230844990 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:47.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafdbfff700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0ffaf0 0x7fafdc0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:47.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafdb7fe700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc100ce0 0x7fafdc072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:47.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafe0d9c700 1 -- 172.21.15.17:0/4230844990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0ffaf0 msgr2=0x7fafdc0742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:47.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafe0d9c700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0ffaf0 0x7fafdc0742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafe0d9c700 1 -- 172.21.15.17:0/4230844990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc100ce0 msgr2=0x7fafdc072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:47.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafe0d9c700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc100ce0 0x7fafdc072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafe0d9c700 1 -- 172.21.15.17:0/4230844990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00095f0 con 0x7fafdc101670 2023-07-14T12:57:47.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafdb7fe700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc100ce0 0x7fafdc072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:57:47.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafe0d9c700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101670 0x7fafdc072e40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fafd400ef30 tx=0x7fafd400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:47.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.983+0000 7fafd97fa700 1 -- 172.21.15.17:0/4230844990 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4018070 con 0x7fafdc101670 2023-07-14T12:57:47.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.984+0000 7fafd97fa700 1 -- 172.21.15.17:0/4230844990 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fafd400f040 con 0x7fafdc101670 2023-07-14T12:57:47.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.984+0000 7fafe27ff700 1 -- 172.21.15.17:0/4230844990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafdc1a4000 con 0x7fafdc101670 2023-07-14T12:57:47.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.984+0000 7fafd97fa700 1 -- 172.21.15.17:0/4230844990 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4003d00 con 0x7fafdc101670 2023-07-14T12:57:47.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.984+0000 7fafe27ff700 1 -- 172.21.15.17:0/4230844990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafdc1a4370 con 0x7fafdc101670 2023-07-14T12:57:47.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.985+0000 7fafe27ff700 1 -- 172.21.15.17:0/4230844990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafdc10b1c0 con 0x7fafdc101670 2023-07-14T12:57:47.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.987+0000 7fafd97fa700 1 -- 172.21.15.17:0/4230844990 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fafd400caa0 con 0x7fafdc101670 2023-07-14T12:57:47.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.989+0000 7fafd97fa700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 0x7fafc40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:47.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.989+0000 7fafd97fa700 1 -- 172.21.15.17:0/4230844990 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fafd40cc5d0 con 0x7fafdc101670 2023-07-14T12:57:47.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.989+0000 7fafdbfff700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 0x7fafc40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:47.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.990+0000 7fafdbfff700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 0x7fafc40a3600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fafcc005950 tx=0x7fafcc0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:46.993+0000 7fafd97fa700 1 -- 172.21.15.17:0/4230844990 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fafd4095e60 con 0x7fafdc101670 2023-07-14T12:57:47.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.226+0000 7fafd97fa700 1 -- 172.21.15.17:0/4230844990 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fafd4096230 con 0x7fafdc101670 2023-07-14T12:57:47.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.247+0000 7fafe27ff700 1 -- 172.21.15.17:0/4230844990 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fafdc060950 con 0x7fafc40a1150 2023-07-14T12:57:47.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.251+0000 7fafd97fa700 1 -- 172.21.15.17:0/4230844990 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fafdc060950 con 0x7fafc40a1150 2023-07-14T12:57:47.280 INFO:teuthology.orchestra.run.smithi017.stdout:/volumes/_nogroup/sv_1/19745af3-53b7-48d2-b641-4ff392b97db5 2023-07-14T12:57:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 -- 172.21.15.17:0/4230844990 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 msgr2=0x7fafc40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 0x7fafc40a3600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fafcc005950 tx=0x7fafcc0058e0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 -- 172.21.15.17:0/4230844990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101670 msgr2=0x7fafdc072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101670 0x7fafdc072e40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fafd400ef30 tx=0x7fafd400c450 comp rx=0 tx=0).stop 2023-07-14T12:57:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 -- 172.21.15.17:0/4230844990 shutdown_connections 2023-07-14T12:57:47.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc40a1150 0x7fafc40a3600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc101670 0x7fafdc072e40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0ffaf0 0x7fafdc0742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 --2- 172.21.15.17:0/4230844990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc100ce0 0x7fafdc072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 -- 172.21.15.17:0/4230844990 >> 172.21.15.17:0/4230844990 conn(0x7fafdc0fb130 msgr2=0x7fafdc0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 -- 172.21.15.17:0/4230844990 shutdown_connections 2023-07-14T12:57:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.253+0000 7fafe27ff700 1 -- 172.21.15.17:0/4230844990 wait complete. 2023-07-14T12:57:47.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:57:47.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.476+0000 7f46ba3ff700 1 -- 172.21.15.17:0/568892294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b4072f70 msgr2=0x7f46b40733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:47.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.476+0000 7f46ba3ff700 1 --2- 172.21.15.17:0/568892294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b4072f70 0x7f46b40733e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009990 tx=0x7f46a8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.476+0000 7f46ba3ff700 1 -- 172.21.15.17:0/568892294 shutdown_connections 2023-07-14T12:57:47.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.476+0000 7f46ba3ff700 1 --2- 172.21.15.17:0/568892294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b41079c0 0x7f46b4109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.476+0000 7f46ba3ff700 1 --2- 172.21.15.17:0/568892294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b4074550 0x7f46b40729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.476+0000 7f46ba3ff700 1 --2- 172.21.15.17:0/568892294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b4072f70 0x7f46b40733e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.476+0000 7f46ba3ff700 1 -- 172.21.15.17:0/568892294 >> 172.21.15.17:0/568892294 conn(0x7f46b40fb0e0 msgr2=0x7f46b40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:47.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.476+0000 7f46ba3ff700 1 -- 172.21.15.17:0/568892294 shutdown_connections 2023-07-14T12:57:47.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.476+0000 7f46ba3ff700 1 -- 172.21.15.17:0/568892294 wait complete. 2023-07-14T12:57:47.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.477+0000 7f46ba3ff700 1 Processor -- start 2023-07-14T12:57:47.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.478+0000 7f46ba3ff700 1 -- start start 2023-07-14T12:57:47.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.478+0000 7f46ba3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b4072f70 0x7f46b4197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:47.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.478+0000 7f46ba3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b4074550 0x7f46b4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:47.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.478+0000 7f46ba3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b41079c0 0x7f46b419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:47.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.478+0000 7f46ba3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b419f500 con 0x7f46b41079c0 2023-07-14T12:57:47.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.478+0000 7f46ba3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b419f640 con 0x7f46b4074550 2023-07-14T12:57:47.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.478+0000 7f46ba3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b419f7d0 con 0x7f46b4072f70 2023-07-14T12:57:47.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.478+0000 7f46b899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b41079c0 0x7f46b419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:47.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.478+0000 7f46b899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b41079c0 0x7f46b419ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48530/0 (socket says 172.21.15.17:48530) 2023-07-14T12:57:47.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.478+0000 7f46b899c700 1 -- 172.21.15.17:0/765236284 learned_addr learned my addr 172.21.15.17:0/765236284 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:47.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46b3fff700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b4072f70 0x7f46b4197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:47.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46b37fe700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b4074550 0x7f46b4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:47.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46b899c700 1 -- 172.21.15.17:0/765236284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b4072f70 msgr2=0x7f46b4197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:47.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46b899c700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b4072f70 0x7f46b4197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46b899c700 1 -- 172.21.15.17:0/765236284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b4074550 msgr2=0x7f46b4197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:47.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46b899c700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b4074550 0x7f46b4197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46b899c700 1 -- 172.21.15.17:0/765236284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80095f0 con 0x7f46b41079c0 2023-07-14T12:57:47.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46b899c700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b41079c0 0x7f46b419ef30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f46ac007ee0 tx=0x7f46ac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:47.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46b17fa700 1 -- 172.21.15.17:0/765236284 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00dd20 con 0x7f46b41079c0 2023-07-14T12:57:47.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46ba3ff700 1 -- 172.21.15.17:0/765236284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b419fab0 con 0x7f46b41079c0 2023-07-14T12:57:47.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46b17fa700 1 -- 172.21.15.17:0/765236284 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46ac00f040 con 0x7f46b41079c0 2023-07-14T12:57:47.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.479+0000 7f46b17fa700 1 -- 172.21.15.17:0/765236284 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac004750 con 0x7f46b41079c0 2023-07-14T12:57:47.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.480+0000 7f46ba3ff700 1 -- 172.21.15.17:0/765236284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b419ffc0 con 0x7f46b41079c0 2023-07-14T12:57:47.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.481+0000 7f46ba3ff700 1 -- 172.21.15.17:0/765236284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b4106070 con 0x7f46b41079c0 2023-07-14T12:57:47.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.482+0000 7f46b17fa700 1 -- 172.21.15.17:0/765236284 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f46ac003a00 con 0x7f46b41079c0 2023-07-14T12:57:47.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.485+0000 7f46b17fa700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f469c0a1220 0x7f469c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:47.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.485+0000 7f46b17fa700 1 -- 172.21.15.17:0/765236284 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f46ac0cc230 con 0x7f46b41079c0 2023-07-14T12:57:47.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.485+0000 7f46b3fff700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f469c0a1220 0x7f469c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:47.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.486+0000 7f46b3fff700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f469c0a1220 0x7f469c0a36d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f46b4074920 tx=0x7f46a4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:47.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.489+0000 7f46b17fa700 1 -- 172.21.15.17:0/765236284 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f46ac04e790 con 0x7f46b41079c0 2023-07-14T12:57:47.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:47 smithi017 ceph-mon[95536]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:47.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:47 smithi017 ceph-mon[95536]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:47.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:47 smithi017 ceph-mon[95536]: pgmap v306: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2023-07-14T12:57:47.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:47 smithi135 ceph-mon[97338]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:47.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:47 smithi135 ceph-mon[97338]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:47.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:47 smithi135 ceph-mon[97338]: pgmap v306: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2023-07-14T12:57:47.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:47 smithi131 ceph-mon[96953]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:47.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:47 smithi131 ceph-mon[96953]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:47.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:47 smithi131 ceph-mon[96953]: pgmap v306: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2023-07-14T12:57:47.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.744+0000 7f46ba3ff700 1 -- 172.21.15.17:0/765236284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46b402c850 con 0x7f46b41079c0 2023-07-14T12:57:47.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.745+0000 7f46b17fa700 1 -- 172.21.15.17:0/765236284 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10845 (secure 0 0 0) 0x7f46ac0958d0 con 0x7f46b41079c0 2023-07-14T12:57:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T12:57:45.208579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:57:47.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.747+0000 7f46ba3ff700 1 -- 172.21.15.17:0/765236284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f469c0a1220 msgr2=0x7f469c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:47.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.747+0000 7f46ba3ff700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f469c0a1220 0x7f469c0a36d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f46b4074920 tx=0x7f46a4009260 comp rx=0 tx=0).stop 2023-07-14T12:57:47.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.747+0000 7f46ba3ff700 1 -- 172.21.15.17:0/765236284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b41079c0 msgr2=0x7f46b419ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:47.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.747+0000 7f46ba3ff700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b41079c0 0x7f46b419ef30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f46ac007ee0 tx=0x7f46ac00d3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.748+0000 7f46ba3ff700 1 -- 172.21.15.17:0/765236284 shutdown_connections 2023-07-14T12:57:47.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.748+0000 7f46ba3ff700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f469c0a1220 0x7f469c0a36d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.748+0000 7f46ba3ff700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46b41079c0 0x7f46b419ef30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.748+0000 7f46ba3ff700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46b4072f70 0x7f46b4197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.748+0000 7f46ba3ff700 1 --2- 172.21.15.17:0/765236284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46b4074550 0x7f46b4197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.748+0000 7f46ba3ff700 1 -- 172.21.15.17:0/765236284 >> 172.21.15.17:0/765236284 conn(0x7f46b40fb0e0 msgr2=0x7f46b40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:47.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.748+0000 7f46ba3ff700 1 -- 172.21.15.17:0/765236284 shutdown_connections 2023-07-14T12:57:47.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.748+0000 7f46ba3ff700 1 -- 172.21.15.17:0/765236284 wait complete. 2023-07-14T12:57:47.778 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2023-07-14T12:57:47.795 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:57:47.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.970+0000 7febc6dff700 1 -- 172.21.15.17:0/3964549789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febc00ffb00 msgr2=0x7febc00fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:47.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.970+0000 7febc6dff700 1 --2- 172.21.15.17:0/3964549789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febc00ffb00 0x7febc00fff10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7febb4009990 tx=0x7febb4009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:47.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.970+0000 7febc6dff700 1 -- 172.21.15.17:0/3964549789 shutdown_connections 2023-07-14T12:57:48.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.970+0000 7febc6dff700 1 --2- 172.21.15.17:0/3964549789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc0101680 0x7febc0107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.970+0000 7febc6dff700 1 --2- 172.21.15.17:0/3964549789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febc00ffb00 0x7febc00fff10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.970+0000 7febc6dff700 1 --2- 172.21.15.17:0/3964549789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc0100cf0 0x7febc0101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.970+0000 7febc6dff700 1 -- 172.21.15.17:0/3964549789 >> 172.21.15.17:0/3964549789 conn(0x7febc00fb0e0 msgr2=0x7febc00fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:48.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.970+0000 7febc6dff700 1 -- 172.21.15.17:0/3964549789 shutdown_connections 2023-07-14T12:57:48.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.970+0000 7febc6dff700 1 -- 172.21.15.17:0/3964549789 wait complete. 2023-07-14T12:57:48.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.971+0000 7febc6dff700 1 Processor -- start 2023-07-14T12:57:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.971+0000 7febc6dff700 1 -- start start 2023-07-14T12:57:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febc6dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc00ffb00 0x7febc00742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febc6dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febc0100cf0 0x7febc0072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febc6dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc0101680 0x7febc0072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febc6dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00735e0 con 0x7febc0100cf0 2023-07-14T12:57:48.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febc6dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc0073750 con 0x7febc0101680 2023-07-14T12:57:48.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febc6dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc019f830 con 0x7febc00ffb00 2023-07-14T12:57:48.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febbffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febc0100cf0 0x7febc0072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:48.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febbffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febc0100cf0 0x7febc0072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48554/0 (socket says 172.21.15.17:48554) 2023-07-14T12:57:48.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febbffff700 1 -- 172.21.15.17:0/877848442 learned_addr learned my addr 172.21.15.17:0/877848442 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:48.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febc4b9b700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc00ffb00 0x7febc00742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:48.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febc539c700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc0101680 0x7febc0072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:48.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febbffff700 1 -- 172.21.15.17:0/877848442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc00ffb00 msgr2=0x7febc00742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febbffff700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc00ffb00 0x7febc00742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febbffff700 1 -- 172.21.15.17:0/877848442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc0101680 msgr2=0x7febc0072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febbffff700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc0101680 0x7febc0072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.972+0000 7febbffff700 1 -- 172.21.15.17:0/877848442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb40095f0 con 0x7febc0100cf0 2023-07-14T12:57:48.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.973+0000 7febbffff700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febc0100cf0 0x7febc0072900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7febac00e9a0 tx=0x7febac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:48.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.973+0000 7febbdffb700 1 -- 172.21.15.17:0/877848442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac009790 con 0x7febc0100cf0 2023-07-14T12:57:48.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.973+0000 7febc6dff700 1 -- 172.21.15.17:0/877848442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc019fb10 con 0x7febc0100cf0 2023-07-14T12:57:48.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.973+0000 7febbdffb700 1 -- 172.21.15.17:0/877848442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febac00cbd0 con 0x7febc0100cf0 2023-07-14T12:57:48.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.973+0000 7febbdffb700 1 -- 172.21.15.17:0/877848442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac018680 con 0x7febc0100cf0 2023-07-14T12:57:48.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.973+0000 7febc6dff700 1 -- 172.21.15.17:0/877848442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc01a0070 con 0x7febc0100cf0 2023-07-14T12:57:48.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.974+0000 7febc6dff700 1 -- 172.21.15.17:0/877848442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc01070e0 con 0x7febc0100cf0 2023-07-14T12:57:48.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.976+0000 7febbdffb700 1 -- 172.21.15.17:0/877848442 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7febac00cd40 con 0x7febc0100cf0 2023-07-14T12:57:48.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.977+0000 7febbdffb700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7febb00a1220 0x7febb00a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.978+0000 7febbdffb700 1 -- 172.21.15.17:0/877848442 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7febac014070 con 0x7febc0100cf0 2023-07-14T12:57:48.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.978+0000 7febc4b9b700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7febb00a1220 0x7febb00a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:48.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.978+0000 7febc4b9b700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7febb00a1220 0x7febb00a36d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febb40098e0 tx=0x7febb400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:48.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:47.981+0000 7febbdffb700 1 -- 172.21.15.17:0/877848442 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7febac051790 con 0x7febc0100cf0 2023-07-14T12:57:48.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.195+0000 7febc6dff700 1 -- 172.21.15.17:0/877848442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febc002caa0 con 0x7febc0100cf0 2023-07-14T12:57:48.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.197+0000 7febbdffb700 1 -- 172.21.15.17:0/877848442 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22119 (secure 0 0 0) 0x7febac096330 con 0x7febc0100cf0 2023-07-14T12:57:48.226 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:48.226 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:57:41.139773+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:57:48.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.199+0000 7febc6dff700 1 -- 172.21.15.17:0/877848442 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7febb00a1220 msgr2=0x7febb00a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.199+0000 7febc6dff700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7febb00a1220 0x7febb00a36d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7febb40098e0 tx=0x7febb400b260 comp rx=0 tx=0).stop 2023-07-14T12:57:48.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.199+0000 7febc6dff700 1 -- 172.21.15.17:0/877848442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febc0100cf0 msgr2=0x7febc0072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.199+0000 7febc6dff700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febc0100cf0 0x7febc0072900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7febac00e9a0 tx=0x7febac00ecb0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.199+0000 7febc6dff700 1 -- 172.21.15.17:0/877848442 shutdown_connections 2023-07-14T12:57:48.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.200+0000 7febc6dff700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7febb00a1220 0x7febb00a36d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.200+0000 7febc6dff700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febc0101680 0x7febc0072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.200+0000 7febc6dff700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febc00ffb00 0x7febc00742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.200+0000 7febc6dff700 1 --2- 172.21.15.17:0/877848442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febc0100cf0 0x7febc0072900 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.200+0000 7febc6dff700 1 -- 172.21.15.17:0/877848442 >> 172.21.15.17:0/877848442 conn(0x7febc00fb0e0 msgr2=0x7febc0104220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:48.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.200+0000 7febc6dff700 1 -- 172.21.15.17:0/877848442 shutdown_connections 2023-07-14T12:57:48.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.200+0000 7febc6dff700 1 -- 172.21.15.17:0/877848442 wait complete. 2023-07-14T12:57:48.248 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T12:57:48.248 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:57:48.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.423+0000 7f61791ff700 1 -- 172.21.15.17:0/1619039670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740ffb00 msgr2=0x7f61740fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.423+0000 7f61791ff700 1 --2- 172.21.15.17:0/1619039670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740ffb00 0x7f61740fff10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6164009990 tx=0x7f6164009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.423+0000 7f61791ff700 1 -- 172.21.15.17:0/1619039670 shutdown_connections 2023-07-14T12:57:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.423+0000 7f61791ff700 1 --2- 172.21.15.17:0/1619039670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6174101680 0x7f6174107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.423+0000 7f61791ff700 1 --2- 172.21.15.17:0/1619039670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740ffb00 0x7f61740fff10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.423+0000 7f61791ff700 1 --2- 172.21.15.17:0/1619039670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6174100cf0 0x7f6174101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.423+0000 7f61791ff700 1 -- 172.21.15.17:0/1619039670 >> 172.21.15.17:0/1619039670 conn(0x7f61740fb0e0 msgr2=0x7f61740fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.424+0000 7f61791ff700 1 -- 172.21.15.17:0/1619039670 shutdown_connections 2023-07-14T12:57:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.424+0000 7f61791ff700 1 -- 172.21.15.17:0/1619039670 wait complete. 2023-07-14T12:57:48.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.425+0000 7f61791ff700 1 Processor -- start 2023-07-14T12:57:48.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.425+0000 7f61791ff700 1 -- start start 2023-07-14T12:57:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.425+0000 7f61791ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740ffb00 0x7f6174197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.425+0000 7f61791ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6174100cf0 0x7f6174197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.425+0000 7f61791ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6174101680 0x7f617419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.425+0000 7f61791ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617419f500 con 0x7f61740ffb00 2023-07-14T12:57:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.425+0000 7f61791ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617419f640 con 0x7f6174100cf0 2023-07-14T12:57:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.425+0000 7f61791ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617419f7d0 con 0x7f6174101680 2023-07-14T12:57:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.425+0000 7f6172d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740ffb00 0x7f6174197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.425+0000 7f6172d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740ffb00 0x7f6174197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48568/0 (socket says 172.21.15.17:48568) 2023-07-14T12:57:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.425+0000 7f6172d9d700 1 -- 172.21.15.17:0/4216065185 learned_addr learned my addr 172.21.15.17:0/4216065185 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.426+0000 7f617259c700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6174100cf0 0x7f6174197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.426+0000 7f6172d9d700 1 -- 172.21.15.17:0/4216065185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6174101680 msgr2=0x7f617419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.426+0000 7f6172d9d700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6174101680 0x7f617419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.426+0000 7f6172d9d700 1 -- 172.21.15.17:0/4216065185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6174100cf0 msgr2=0x7f6174197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.426+0000 7f6172d9d700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6174100cf0 0x7f6174197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.426+0000 7f6172d9d700 1 -- 172.21.15.17:0/4216065185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640095f0 con 0x7f61740ffb00 2023-07-14T12:57:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.426+0000 7f6172d9d700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740ffb00 0x7f6174197980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6164005910 tx=0x7f61640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.426+0000 7f615bfff700 1 -- 172.21.15.17:0/4216065185 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616401d070 con 0x7f61740ffb00 2023-07-14T12:57:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.426+0000 7f61791ff700 1 -- 172.21.15.17:0/4216065185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617419fa50 con 0x7f61740ffb00 2023-07-14T12:57:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.426+0000 7f615bfff700 1 -- 172.21.15.17:0/4216065185 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f616400be50 con 0x7f61740ffb00 2023-07-14T12:57:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.426+0000 7f615bfff700 1 -- 172.21.15.17:0/4216065185 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6164022e00 con 0x7f61740ffb00 2023-07-14T12:57:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.427+0000 7f61791ff700 1 -- 172.21.15.17:0/4216065185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617419fe80 con 0x7f61740ffb00 2023-07-14T12:57:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.427+0000 7f61791ff700 1 -- 172.21.15.17:0/4216065185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6174192090 con 0x7f61740ffb00 2023-07-14T12:57:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.429+0000 7f615bfff700 1 -- 172.21.15.17:0/4216065185 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f616400b9c0 con 0x7f61740ffb00 2023-07-14T12:57:48.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.431+0000 7f615bfff700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f615c0a1220 0x7f615c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.431+0000 7f615bfff700 1 -- 172.21.15.17:0/4216065185 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f61640cdff0 con 0x7f61740ffb00 2023-07-14T12:57:48.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.431+0000 7f617259c700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f615c0a1220 0x7f615c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:48.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.432+0000 7f617259c700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f615c0a1220 0x7f615c0a36d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6168009bf0 tx=0x7f6168009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:48.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.435+0000 7f615bfff700 1 -- 172.21.15.17:0/4216065185 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6164097760 con 0x7f61740ffb00 2023-07-14T12:57:48.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:48 smithi017 ceph-mon[95536]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-07-14T12:57:48.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:48 smithi017 ceph-mon[95536]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:48.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:48 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/765236284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:48.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:48 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/877848442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:48.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.639+0000 7f61791ff700 1 -- 172.21.15.17:0/4216065185 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6174060950 con 0x7f615c0a1220 2023-07-14T12:57:48.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.652+0000 7f615bfff700 1 -- 172.21.15.17:0/4216065185 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+334370 (secure 0 0 0) 0x7f6174060950 con 0x7f615c0a1220 2023-07-14T12:57:48.685 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:48.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 -- 172.21.15.17:0/4216065185 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f615c0a1220 msgr2=0x7f615c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f615c0a1220 0x7f615c0a36d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6168009bf0 tx=0x7f6168009260 comp rx=0 tx=0).stop 2023-07-14T12:57:48.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 -- 172.21.15.17:0/4216065185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740ffb00 msgr2=0x7f6174197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740ffb00 0x7f6174197980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6164005910 tx=0x7f61640057f0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 -- 172.21.15.17:0/4216065185 shutdown_connections 2023-07-14T12:57:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f615c0a1220 0x7f615c0a36d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6174101680 0x7f617419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61740ffb00 0x7f6174197980 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 --2- 172.21.15.17:0/4216065185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6174100cf0 0x7f6174197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 -- 172.21.15.17:0/4216065185 >> 172.21.15.17:0/4216065185 conn(0x7f61740fb0e0 msgr2=0x7f6174106640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 -- 172.21.15.17:0/4216065185 shutdown_connections 2023-07-14T12:57:48.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.657+0000 7f61791ff700 1 -- 172.21.15.17:0/4216065185 wait complete. 2023-07-14T12:57:48.691 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-07-14T12:57:48.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:48 smithi135 ceph-mon[97338]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-07-14T12:57:48.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:48 smithi135 ceph-mon[97338]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:48.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:48 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/765236284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:48.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:48 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/877848442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:48.705 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2023-07-14T12:57:46.829068+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594110,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":146,"num_read_kb":128,"num_write":270,"num_write_kb":2971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":268,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334504,"kb_used_data":11080,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124607320,"statfs":{"total":1151940427776,"available":1151597895680,"internally_reserved":0,"allocated":11345920,"data_stored":7061388,"data_compressed":108384,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3742,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":89,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.708140"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186824+0000","last_change":"2023-07-14T12:57:40.168203+0000","last_active":"2023-07-14T12:57:42.186824+0000","last_peered":"2023-07-14T12:57:42.186824+0000","last_clean":"2023-07-14T12:57:42.186824+0000","last_became_active":"2023-07-14T12:57:40.164682+0000","last_became_peered":"2023-07-14T12:57:40.164682+0000","last_unstale":"2023-07-14T12:57:42.186824+0000","last_undegraded":"2023-07-14T12:57:42.186824+0000","last_fullsized":"2023-07-14T12:57:42.186824+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:34.823018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504878+0000","last_change":"2023-07-14T12:57:40.168194+0000","last_active":"2023-07-14T12:57:42.504878+0000","last_peered":"2023-07-14T12:57:42.504878+0000","last_clean":"2023-07-14T12:57:42.504878+0000","last_became_active":"2023-07-14T12:57:40.167825+0000","last_became_peered":"2023-07-14T12:57:40.167825+0000","last_unstale":"2023-07-14T12:57:42.504878+0000","last_undegraded":"2023-07-14T12:57:42.504878+0000","last_fullsized":"2023-07-14T12:57:42.504878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:02.374567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504545+0000","last_change":"2023-07-14T12:57:40.162824+0000","last_active":"2023-07-14T12:57:42.504545+0000","last_peered":"2023-07-14T12:57:42.504545+0000","last_clean":"2023-07-14T12:57:42.504545+0000","last_became_active":"2023-07-14T12:57:40.162526+0000","last_became_peered":"2023-07-14T12:57:40.162526+0000","last_unstale":"2023-07-14T12:57:42.504545+0000","last_undegraded":"2023-07-14T12:57:42.504545+0000","last_fullsized":"2023-07-14T12:57:42.504545+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:19:18.096250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505021+0000","last_change":"2023-07-14T12:57:40.160772+0000","last_active":"2023-07-14T12:57:42.505021+0000","last_peered":"2023-07-14T12:57:42.505021+0000","last_clean":"2023-07-14T12:57:42.505021+0000","last_became_active":"2023-07-14T12:57:40.160315+0000","last_became_peered":"2023-07-14T12:57:40.160315+0000","last_unstale":"2023-07-14T12:57:42.505021+0000","last_undegraded":"2023-07-14T12:57:42.505021+0000","last_fullsized":"2023-07-14T12:57:42.505021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:23:33.310782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.471742+0000","last_change":"2023-07-14T12:57:40.160868+0000","last_active":"2023-07-14T12:57:42.471742+0000","last_peered":"2023-07-14T12:57:42.471742+0000","last_clean":"2023-07-14T12:57:42.471742+0000","last_became_active":"2023-07-14T12:57:40.160558+0000","last_became_peered":"2023-07-14T12:57:40.160558+0000","last_unstale":"2023-07-14T12:57:42.471742+0000","last_undegraded":"2023-07-14T12:57:42.471742+0000","last_fullsized":"2023-07-14T12:57:42.471742+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:19.421538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.506575+0000","last_change":"2023-07-14T12:57:40.166305+0000","last_active":"2023-07-14T12:57:41.506575+0000","last_peered":"2023-07-14T12:57:41.506575+0000","last_clean":"2023-07-14T12:57:41.506575+0000","last_became_active":"2023-07-14T12:57:40.166012+0000","last_became_peered":"2023-07-14T12:57:40.166012+0000","last_unstale":"2023-07-14T12:57:41.506575+0000","last_undegraded":"2023-07-14T12:57:41.506575+0000","last_fullsized":"2023-07-14T12:57:41.506575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:15:13.120661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504401+0000","last_change":"2023-07-14T12:57:40.163312+0000","last_active":"2023-07-14T12:57:42.504401+0000","last_peered":"2023-07-14T12:57:42.504401+0000","last_clean":"2023-07-14T12:57:42.504401+0000","last_became_active":"2023-07-14T12:57:40.163030+0000","last_became_peered":"2023-07-14T12:57:40.163030+0000","last_unstale":"2023-07-14T12:57:42.504401+0000","last_undegraded":"2023-07-14T12:57:42.504401+0000","last_fullsized":"2023-07-14T12:57:42.504401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:21:10.760702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.148714+0000","last_change":"2023-07-14T12:57:40.163369+0000","last_active":"2023-07-14T12:57:41.148714+0000","last_peered":"2023-07-14T12:57:41.148714+0000","last_clean":"2023-07-14T12:57:41.148714+0000","last_became_active":"2023-07-14T12:57:40.163076+0000","last_became_peered":"2023-07-14T12:57:40.163076+0000","last_unstale":"2023-07-14T12:57:41.148714+0000","last_undegraded":"2023-07-14T12:57:41.148714+0000","last_fullsized":"2023-07-14T12:57:41.148714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:25:05.381086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.150019+0000","last_change":"2023-07-14T12:57:40.170263+0000","last_active":"2023-07-14T12:57:41.150019+0000","last_peered":"2023-07-14T12:57:41.150019+0000","last_clean":"2023-07-14T12:57:41.150019+0000","last_became_active":"2023-07-14T12:57:40.169952+0000","last_became_peered":"2023-07-14T12:57:40.169952+0000","last_unstale":"2023-07-14T12:57:41.150019+0000","last_undegraded":"2023-07-14T12:57:41.150019+0000","last_fullsized":"2023-07-14T12:57:41.150019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:44:12.572040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.506594+0000","last_change":"2023-07-14T12:57:40.165359+0000","last_active":"2023-07-14T12:57:41.506594+0000","last_peered":"2023-07-14T12:57:41.506594+0000","last_clean":"2023-07-14T12:57:41.506594+0000","last_became_active":"2023-07-14T12:57:40.164918+0000","last_became_peered":"2023-07-14T12:57:40.164918+0000","last_unstale":"2023-07-14T12:57:41.506594+0000","last_undegraded":"2023-07-14T12:57:41.506594+0000","last_fullsized":"2023-07-14T12:57:41.506594+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:00:17.304218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504867+0000","last_change":"2023-07-14T12:57:40.160524+0000","last_active":"2023-07-14T12:57:42.504867+0000","last_peered":"2023-07-14T12:57:42.504867+0000","last_clean":"2023-07-14T12:57:42.504867+0000","last_became_active":"2023-07-14T12:57:40.160215+0000","last_became_peered":"2023-07-14T12:57:40.160215+0000","last_unstale":"2023-07-14T12:57:42.504867+0000","last_undegraded":"2023-07-14T12:57:42.504867+0000","last_fullsized":"2023-07-14T12:57:42.504867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:04.295507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505514+0000","last_change":"2023-07-14T12:57:40.167705+0000","last_active":"2023-07-14T12:57:42.505514+0000","last_peered":"2023-07-14T12:57:42.505514+0000","last_clean":"2023-07-14T12:57:42.505514+0000","last_became_active":"2023-07-14T12:57:40.167329+0000","last_became_peered":"2023-07-14T12:57:40.167329+0000","last_unstale":"2023-07-14T12:57:42.505514+0000","last_undegraded":"2023-07-14T12:57:42.505514+0000","last_fullsized":"2023-07-14T12:57:42.505514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:59:14.875748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505684+0000","last_change":"2023-07-14T12:57:40.162166+0000","last_active":"2023-07-14T12:57:42.505684+0000","last_peered":"2023-07-14T12:57:42.505684+0000","last_clean":"2023-07-14T12:57:42.505684+0000","last_became_active":"2023-07-14T12:57:40.161750+0000","last_became_peered":"2023-07-14T12:57:40.161750+0000","last_unstale":"2023-07-14T12:57:42.505684+0000","last_undegraded":"2023-07-14T12:57:42.505684+0000","last_fullsized":"2023-07-14T12:57:42.505684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:30.462081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504596+0000","last_change":"2023-07-14T12:57:40.160556+0000","last_active":"2023-07-14T12:57:42.504596+0000","last_peered":"2023-07-14T12:57:42.504596+0000","last_clean":"2023-07-14T12:57:42.504596+0000","last_became_active":"2023-07-14T12:57:40.159974+0000","last_became_peered":"2023-07-14T12:57:40.159974+0000","last_unstale":"2023-07-14T12:57:42.504596+0000","last_undegraded":"2023-07-14T12:57:42.504596+0000","last_fullsized":"2023-07-14T12:57:42.504596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:45.370514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504443+0000","last_change":"2023-07-14T12:57:40.169116+0000","last_active":"2023-07-14T12:57:42.504443+0000","last_peered":"2023-07-14T12:57:42.504443+0000","last_clean":"2023-07-14T12:57:42.504443+0000","last_became_active":"2023-07-14T12:57:40.168714+0000","last_became_peered":"2023-07-14T12:57:40.168714+0000","last_unstale":"2023-07-14T12:57:42.504443+0000","last_undegraded":"2023-07-14T12:57:42.504443+0000","last_fullsized":"2023-07-14T12:57:42.504443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:51.039327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149631+0000","last_change":"2023-07-14T12:57:40.162621+0000","last_active":"2023-07-14T12:57:41.149631+0000","last_peered":"2023-07-14T12:57:41.149631+0000","last_clean":"2023-07-14T12:57:41.149631+0000","last_became_active":"2023-07-14T12:57:40.162329+0000","last_became_peered":"2023-07-14T12:57:40.162329+0000","last_unstale":"2023-07-14T12:57:41.149631+0000","last_undegraded":"2023-07-14T12:57:41.149631+0000","last_fullsized":"2023-07-14T12:57:41.149631+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:14.529162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186917+0000","last_change":"2023-07-14T12:57:40.172697+0000","last_active":"2023-07-14T12:57:42.186917+0000","last_peered":"2023-07-14T12:57:42.186917+0000","last_clean":"2023-07-14T12:57:42.186917+0000","last_became_active":"2023-07-14T12:57:40.172366+0000","last_became_peered":"2023-07-14T12:57:40.172366+0000","last_unstale":"2023-07-14T12:57:42.186917+0000","last_undegraded":"2023-07-14T12:57:42.186917+0000","last_fullsized":"2023-07-14T12:57:42.186917+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:26.923287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.506047+0000","last_change":"2023-07-14T12:57:40.166669+0000","last_active":"2023-07-14T12:57:42.506047+0000","last_peered":"2023-07-14T12:57:42.506047+0000","last_clean":"2023-07-14T12:57:42.506047+0000","last_became_active":"2023-07-14T12:57:40.166367+0000","last_became_peered":"2023-07-14T12:57:40.166367+0000","last_unstale":"2023-07-14T12:57:42.506047+0000","last_undegraded":"2023-07-14T12:57:42.506047+0000","last_fullsized":"2023-07-14T12:57:42.506047+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:50.966474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.834026+0000","last_change":"2023-07-14T12:57:40.159133+0000","last_active":"2023-07-14T12:57:41.834026+0000","last_peered":"2023-07-14T12:57:41.834026+0000","last_clean":"2023-07-14T12:57:41.834026+0000","last_became_active":"2023-07-14T12:57:40.158819+0000","last_became_peered":"2023-07-14T12:57:40.158819+0000","last_unstale":"2023-07-14T12:57:41.834026+0000","last_undegraded":"2023-07-14T12:57:41.834026+0000","last_fullsized":"2023-07-14T12:57:41.834026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:12.588410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505927+0000","last_change":"2023-07-14T12:57:39.144919+0000","last_active":"2023-07-14T12:57:42.505927+0000","last_peered":"2023-07-14T12:57:42.505927+0000","last_clean":"2023-07-14T12:57:42.505927+0000","last_became_active":"2023-07-14T12:57:39.144604+0000","last_became_peered":"2023-07-14T12:57:39.144604+0000","last_unstale":"2023-07-14T12:57:42.505927+0000","last_undegraded":"2023-07-14T12:57:42.505927+0000","last_fullsized":"2023-07-14T12:57:42.505927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:23.885243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149114+0000","last_change":"2023-07-14T12:57:40.165754+0000","last_active":"2023-07-14T12:57:41.149114+0000","last_peered":"2023-07-14T12:57:41.149114+0000","last_clean":"2023-07-14T12:57:41.149114+0000","last_became_active":"2023-07-14T12:57:40.165416+0000","last_became_peered":"2023-07-14T12:57:40.165416+0000","last_unstale":"2023-07-14T12:57:41.149114+0000","last_undegraded":"2023-07-14T12:57:41.149114+0000","last_fullsized":"2023-07-14T12:57:41.149114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:02:33.310959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149174+0000","last_change":"2023-07-14T12:57:39.153977+0000","last_active":"2023-07-14T12:57:41.149174+0000","last_peered":"2023-07-14T12:57:41.149174+0000","last_clean":"2023-07-14T12:57:41.149174+0000","last_became_active":"2023-07-14T12:57:39.153675+0000","last_became_peered":"2023-07-14T12:57:39.153675+0000","last_unstale":"2023-07-14T12:57:41.149174+0000","last_undegraded":"2023-07-14T12:57:41.149174+0000","last_fullsized":"2023-07-14T12:57:41.149174+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:17.493911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505155+0000","last_change":"2023-07-14T12:57:40.157076+0000","last_active":"2023-07-14T12:57:42.505155+0000","last_peered":"2023-07-14T12:57:42.505155+0000","last_clean":"2023-07-14T12:57:42.505155+0000","last_became_active":"2023-07-14T12:57:40.156652+0000","last_became_peered":"2023-07-14T12:57:40.156652+0000","last_unstale":"2023-07-14T12:57:42.505155+0000","last_undegraded":"2023-07-14T12:57:42.505155+0000","last_fullsized":"2023-07-14T12:57:42.505155+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:58.647850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.211330+0000","last_change":"2023-07-14T12:57:39.145123+0000","last_active":"2023-07-14T12:57:44.211330+0000","last_peered":"2023-07-14T12:57:44.211330+0000","last_clean":"2023-07-14T12:57:44.211330+0000","last_became_active":"2023-07-14T12:57:39.144768+0000","last_became_peered":"2023-07-14T12:57:39.144768+0000","last_unstale":"2023-07-14T12:57:44.211330+0000","last_undegraded":"2023-07-14T12:57:44.211330+0000","last_fullsized":"2023-07-14T12:57:44.211330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:30.431747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149792+0000","last_change":"2023-07-14T12:57:40.167084+0000","last_active":"2023-07-14T12:57:41.149792+0000","last_peered":"2023-07-14T12:57:41.149792+0000","last_clean":"2023-07-14T12:57:41.149792+0000","last_became_active":"2023-07-14T12:57:40.166654+0000","last_became_peered":"2023-07-14T12:57:40.166654+0000","last_unstale":"2023-07-14T12:57:41.149792+0000","last_undegraded":"2023-07-14T12:57:41.149792+0000","last_fullsized":"2023-07-14T12:57:41.149792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:35.359589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.471904+0000","last_change":"2023-07-14T12:57:39.137432+0000","last_active":"2023-07-14T12:57:42.471904+0000","last_peered":"2023-07-14T12:57:42.471904+0000","last_clean":"2023-07-14T12:57:42.471904+0000","last_became_active":"2023-07-14T12:57:39.137124+0000","last_became_peered":"2023-07-14T12:57:39.137124+0000","last_unstale":"2023-07-14T12:57:42.471904+0000","last_undegraded":"2023-07-14T12:57:42.471904+0000","last_fullsized":"2023-07-14T12:57:42.471904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:16:11.673056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149525+0000","last_change":"2023-07-14T12:57:40.167477+0000","last_active":"2023-07-14T12:57:41.149525+0000","last_peered":"2023-07-14T12:57:41.149525+0000","last_clean":"2023-07-14T12:57:41.149525+0000","last_became_active":"2023-07-14T12:57:40.167177+0000","last_became_peered":"2023-07-14T12:57:40.167177+0000","last_unstale":"2023-07-14T12:57:41.149525+0000","last_undegraded":"2023-07-14T12:57:41.149525+0000","last_fullsized":"2023-07-14T12:57:41.149525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:57.583425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:45.220148+0000","last_change":"2023-07-14T12:57:39.146569+0000","last_active":"2023-07-14T12:57:45.220148+0000","last_peered":"2023-07-14T12:57:45.220148+0000","last_clean":"2023-07-14T12:57:45.220148+0000","last_became_active":"2023-07-14T12:57:39.146251+0000","last_became_peered":"2023-07-14T12:57:39.146251+0000","last_unstale":"2023-07-14T12:57:45.220148+0000","last_undegraded":"2023-07-14T12:57:45.220148+0000","last_fullsized":"2023-07-14T12:57:45.220148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:31:38.341211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.472028+0000","last_change":"2023-07-14T12:57:40.160511+0000","last_active":"2023-07-14T12:57:42.472028+0000","last_peered":"2023-07-14T12:57:42.472028+0000","last_clean":"2023-07-14T12:57:42.472028+0000","last_became_active":"2023-07-14T12:57:40.160152+0000","last_became_peered":"2023-07-14T12:57:40.160152+0000","last_unstale":"2023-07-14T12:57:42.472028+0000","last_undegraded":"2023-07-14T12:57:42.472028+0000","last_fullsized":"2023-07-14T12:57:42.472028+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:21:32.813063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.209719+0000","last_change":"2023-07-14T12:57:39.141565+0000","last_active":"2023-07-14T12:57:44.209719+0000","last_peered":"2023-07-14T12:57:44.209719+0000","last_clean":"2023-07-14T12:57:44.209719+0000","last_became_active":"2023-07-14T12:57:39.141247+0000","last_became_peered":"2023-07-14T12:57:39.141247+0000","last_unstale":"2023-07-14T12:57:44.209719+0000","last_undegraded":"2023-07-14T12:57:44.209719+0000","last_fullsized":"2023-07-14T12:57:44.209719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:44:31.939537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.150787+0000","last_change":"2023-07-14T12:57:40.167335+0000","last_active":"2023-07-14T12:57:41.150787+0000","last_peered":"2023-07-14T12:57:41.150787+0000","last_clean":"2023-07-14T12:57:41.150787+0000","last_became_active":"2023-07-14T12:57:40.167016+0000","last_became_peered":"2023-07-14T12:57:40.167016+0000","last_unstale":"2023-07-14T12:57:41.150787+0000","last_undegraded":"2023-07-14T12:57:41.150787+0000","last_fullsized":"2023-07-14T12:57:41.150787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:43.681447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505087+0000","last_change":"2023-07-14T12:57:39.145352+0000","last_active":"2023-07-14T12:57:42.505087+0000","last_peered":"2023-07-14T12:57:42.505087+0000","last_clean":"2023-07-14T12:57:42.505087+0000","last_became_active":"2023-07-14T12:57:39.145018+0000","last_became_peered":"2023-07-14T12:57:39.145018+0000","last_unstale":"2023-07-14T12:57:42.505087+0000","last_undegraded":"2023-07-14T12:57:42.505087+0000","last_fullsized":"2023-07-14T12:57:42.505087+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:31.561871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.148808+0000","last_change":"2023-07-14T12:57:40.173457+0000","last_active":"2023-07-14T12:57:41.148808+0000","last_peered":"2023-07-14T12:57:41.148808+0000","last_clean":"2023-07-14T12:57:41.148808+0000","last_became_active":"2023-07-14T12:57:40.173080+0000","last_became_peered":"2023-07-14T12:57:40.173080+0000","last_unstale":"2023-07-14T12:57:41.148808+0000","last_undegraded":"2023-07-14T12:57:41.148808+0000","last_fullsized":"2023-07-14T12:57:41.148808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:47.496195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.150855+0000","last_change":"2023-07-14T12:57:39.145383+0000","last_active":"2023-07-14T12:57:41.150855+0000","last_peered":"2023-07-14T12:57:41.150855+0000","last_clean":"2023-07-14T12:57:41.150855+0000","last_became_active":"2023-07-14T12:57:39.145088+0000","last_became_peered":"2023-07-14T12:57:39.145088+0000","last_unstale":"2023-07-14T12:57:41.150855+0000","last_undegraded":"2023-07-14T12:57:41.150855+0000","last_fullsized":"2023-07-14T12:57:41.150855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:21:43.986898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505723+0000","last_change":"2023-07-14T12:57:40.162123+0000","last_active":"2023-07-14T12:57:42.505723+0000","last_peered":"2023-07-14T12:57:42.505723+0000","last_clean":"2023-07-14T12:57:42.505723+0000","last_became_active":"2023-07-14T12:57:40.160789+0000","last_became_peered":"2023-07-14T12:57:40.160789+0000","last_unstale":"2023-07-14T12:57:42.505723+0000","last_undegraded":"2023-07-14T12:57:42.505723+0000","last_fullsized":"2023-07-14T12:57:42.505723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:56.247181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203199+0000","last_change":"2023-07-14T12:57:39.139524+0000","last_active":"2023-07-14T12:57:43.203199+0000","last_peered":"2023-07-14T12:57:43.203199+0000","last_clean":"2023-07-14T12:57:43.203199+0000","last_became_active":"2023-07-14T12:57:39.139176+0000","last_became_peered":"2023-07-14T12:57:39.139176+0000","last_unstale":"2023-07-14T12:57:43.203199+0000","last_undegraded":"2023-07-14T12:57:43.203199+0000","last_fullsized":"2023-07-14T12:57:43.203199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:59:35.174476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.150018+0000","last_change":"2023-07-14T12:57:40.168729+0000","last_active":"2023-07-14T12:57:41.150018+0000","last_peered":"2023-07-14T12:57:41.150018+0000","last_clean":"2023-07-14T12:57:41.150018+0000","last_became_active":"2023-07-14T12:57:40.168408+0000","last_became_peered":"2023-07-14T12:57:40.168408+0000","last_unstale":"2023-07-14T12:57:41.150018+0000","last_undegraded":"2023-07-14T12:57:41.150018+0000","last_fullsized":"2023-07-14T12:57:41.150018+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:31:20.072947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.202871+0000","last_change":"2023-07-14T12:57:39.140744+0000","last_active":"2023-07-14T12:57:43.202871+0000","last_peered":"2023-07-14T12:57:43.202871+0000","last_clean":"2023-07-14T12:57:43.202871+0000","last_became_active":"2023-07-14T12:57:39.140391+0000","last_became_peered":"2023-07-14T12:57:39.140391+0000","last_unstale":"2023-07-14T12:57:43.202871+0000","last_undegraded":"2023-07-14T12:57:43.202871+0000","last_fullsized":"2023-07-14T12:57:43.202871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:26:18.601004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504989+0000","last_change":"2023-07-14T12:57:40.165552+0000","last_active":"2023-07-14T12:57:42.504989+0000","last_peered":"2023-07-14T12:57:42.504989+0000","last_clean":"2023-07-14T12:57:42.504989+0000","last_became_active":"2023-07-14T12:57:40.165214+0000","last_became_peered":"2023-07-14T12:57:40.165214+0000","last_unstale":"2023-07-14T12:57:42.504989+0000","last_undegraded":"2023-07-14T12:57:42.504989+0000","last_fullsized":"2023-07-14T12:57:42.504989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:34:50.558696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203751+0000","last_change":"2023-07-14T12:57:39.150311+0000","last_active":"2023-07-14T12:57:43.203751+0000","last_peered":"2023-07-14T12:57:43.203751+0000","last_clean":"2023-07-14T12:57:43.203751+0000","last_became_active":"2023-07-14T12:57:39.149885+0000","last_became_peered":"2023-07-14T12:57:39.149885+0000","last_unstale":"2023-07-14T12:57:43.203751+0000","last_undegraded":"2023-07-14T12:57:43.203751+0000","last_fullsized":"2023-07-14T12:57:43.203751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:11.856884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149935+0000","last_change":"2023-07-14T12:57:40.161845+0000","last_active":"2023-07-14T12:57:41.149935+0000","last_peered":"2023-07-14T12:57:41.149935+0000","last_clean":"2023-07-14T12:57:41.149935+0000","last_became_active":"2023-07-14T12:57:40.160895+0000","last_became_peered":"2023-07-14T12:57:40.160895+0000","last_unstale":"2023-07-14T12:57:41.149935+0000","last_undegraded":"2023-07-14T12:57:41.149935+0000","last_fullsized":"2023-07-14T12:57:41.149935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:29:52.802467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203334+0000","last_change":"2023-07-14T12:57:39.142584+0000","last_active":"2023-07-14T12:57:43.203334+0000","last_peered":"2023-07-14T12:57:43.203334+0000","last_clean":"2023-07-14T12:57:43.203334+0000","last_became_active":"2023-07-14T12:57:39.142239+0000","last_became_peered":"2023-07-14T12:57:39.142239+0000","last_unstale":"2023-07-14T12:57:43.203334+0000","last_undegraded":"2023-07-14T12:57:43.203334+0000","last_fullsized":"2023-07-14T12:57:43.203334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:04.608372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.471878+0000","last_change":"2023-07-14T12:57:40.170013+0000","last_active":"2023-07-14T12:57:42.471878+0000","last_peered":"2023-07-14T12:57:42.471878+0000","last_clean":"2023-07-14T12:57:42.471878+0000","last_became_active":"2023-07-14T12:57:40.169177+0000","last_became_peered":"2023-07-14T12:57:40.169177+0000","last_unstale":"2023-07-14T12:57:42.471878+0000","last_undegraded":"2023-07-14T12:57:42.471878+0000","last_fullsized":"2023-07-14T12:57:42.471878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:24:46.500669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203998+0000","last_change":"2023-07-14T12:57:39.146790+0000","last_active":"2023-07-14T12:57:43.203998+0000","last_peered":"2023-07-14T12:57:43.203998+0000","last_clean":"2023-07-14T12:57:43.203998+0000","last_became_active":"2023-07-14T12:57:39.146361+0000","last_became_peered":"2023-07-14T12:57:39.146361+0000","last_unstale":"2023-07-14T12:57:43.203998+0000","last_undegraded":"2023-07-14T12:57:43.203998+0000","last_fullsized":"2023-07-14T12:57:43.203998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:28.273262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505339+0000","last_change":"2023-07-14T12:57:40.158098+0000","last_active":"2023-07-14T12:57:42.505339+0000","last_peered":"2023-07-14T12:57:42.505339+0000","last_clean":"2023-07-14T12:57:42.505339+0000","last_became_active":"2023-07-14T12:57:40.157736+0000","last_became_peered":"2023-07-14T12:57:40.157736+0000","last_unstale":"2023-07-14T12:57:42.505339+0000","last_undegraded":"2023-07-14T12:57:42.505339+0000","last_fullsized":"2023-07-14T12:57:42.505339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:53:22.679495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203479+0000","last_change":"2023-07-14T12:57:39.135784+0000","last_active":"2023-07-14T12:57:43.203479+0000","last_peered":"2023-07-14T12:57:43.203479+0000","last_clean":"2023-07-14T12:57:43.203479+0000","last_became_active":"2023-07-14T12:57:39.135480+0000","last_became_peered":"2023-07-14T12:57:39.135480+0000","last_unstale":"2023-07-14T12:57:43.203479+0000","last_undegraded":"2023-07-14T12:57:43.203479+0000","last_fullsized":"2023-07-14T12:57:43.203479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:27:29.620891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504844+0000","last_change":"2023-07-14T12:57:40.162548+0000","last_active":"2023-07-14T12:57:42.504844+0000","last_peered":"2023-07-14T12:57:42.504844+0000","last_clean":"2023-07-14T12:57:42.504844+0000","last_became_active":"2023-07-14T12:57:40.162191+0000","last_became_peered":"2023-07-14T12:57:40.162191+0000","last_unstale":"2023-07-14T12:57:42.504844+0000","last_undegraded":"2023-07-14T12:57:42.504844+0000","last_fullsized":"2023-07-14T12:57:42.504844+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:30.127931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504771+0000","last_change":"2023-07-14T12:57:39.145533+0000","last_active":"2023-07-14T12:57:42.504771+0000","last_peered":"2023-07-14T12:57:42.504771+0000","last_clean":"2023-07-14T12:57:42.504771+0000","last_became_active":"2023-07-14T12:57:39.145201+0000","last_became_peered":"2023-07-14T12:57:39.145201+0000","last_unstale":"2023-07-14T12:57:42.504771+0000","last_undegraded":"2023-07-14T12:57:42.504771+0000","last_fullsized":"2023-07-14T12:57:42.504771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:29.466344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504354+0000","last_change":"2023-07-14T12:57:40.160047+0000","last_active":"2023-07-14T12:57:42.504354+0000","last_peered":"2023-07-14T12:57:42.504354+0000","last_clean":"2023-07-14T12:57:42.504354+0000","last_became_active":"2023-07-14T12:57:40.159751+0000","last_became_peered":"2023-07-14T12:57:40.159751+0000","last_unstale":"2023-07-14T12:57:42.504354+0000","last_undegraded":"2023-07-14T12:57:42.504354+0000","last_fullsized":"2023-07-14T12:57:42.504354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:37:43.363147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.213341+0000","last_change":"2023-07-14T12:57:39.139507+0000","last_active":"2023-07-14T12:57:44.213341+0000","last_peered":"2023-07-14T12:57:44.213341+0000","last_clean":"2023-07-14T12:57:44.213341+0000","last_became_active":"2023-07-14T12:57:39.139197+0000","last_became_peered":"2023-07-14T12:57:39.139197+0000","last_unstale":"2023-07-14T12:57:44.213341+0000","last_undegraded":"2023-07-14T12:57:44.213341+0000","last_fullsized":"2023-07-14T12:57:44.213341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:20:16.962249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149324+0000","last_change":"2023-07-14T12:57:40.173741+0000","last_active":"2023-07-14T12:57:41.149324+0000","last_peered":"2023-07-14T12:57:41.149324+0000","last_clean":"2023-07-14T12:57:41.149324+0000","last_became_active":"2023-07-14T12:57:40.173427+0000","last_became_peered":"2023-07-14T12:57:40.173427+0000","last_unstale":"2023-07-14T12:57:41.149324+0000","last_undegraded":"2023-07-14T12:57:41.149324+0000","last_fullsized":"2023-07-14T12:57:41.149324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:20:20.128168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.472005+0000","last_change":"2023-07-14T12:57:39.140979+0000","last_active":"2023-07-14T12:57:42.472005+0000","last_peered":"2023-07-14T12:57:42.472005+0000","last_clean":"2023-07-14T12:57:42.472005+0000","last_became_active":"2023-07-14T12:57:39.140692+0000","last_became_peered":"2023-07-14T12:57:39.140692+0000","last_unstale":"2023-07-14T12:57:42.472005+0000","last_undegraded":"2023-07-14T12:57:42.472005+0000","last_fullsized":"2023-07-14T12:57:42.472005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:27:27.409329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186751+0000","last_change":"2023-07-14T12:57:40.164258+0000","last_active":"2023-07-14T12:57:42.186751+0000","last_peered":"2023-07-14T12:57:42.186751+0000","last_clean":"2023-07-14T12:57:42.186751+0000","last_became_active":"2023-07-14T12:57:40.163911+0000","last_became_peered":"2023-07-14T12:57:40.163911+0000","last_unstale":"2023-07-14T12:57:42.186751+0000","last_undegraded":"2023-07-14T12:57:42.186751+0000","last_fullsized":"2023-07-14T12:57:42.186751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:53:30.538995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505795+0000","last_change":"2023-07-14T12:57:39.151301+0000","last_active":"2023-07-14T12:57:42.505795+0000","last_peered":"2023-07-14T12:57:42.505795+0000","last_clean":"2023-07-14T12:57:42.505795+0000","last_became_active":"2023-07-14T12:57:39.150948+0000","last_became_peered":"2023-07-14T12:57:39.150948+0000","last_unstale":"2023-07-14T12:57:42.505795+0000","last_undegraded":"2023-07-14T12:57:42.505795+0000","last_fullsized":"2023-07-14T12:57:42.505795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:35:06.119180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.506537+0000","last_change":"2023-07-14T12:57:40.158591+0000","last_active":"2023-07-14T12:57:41.506537+0000","last_peered":"2023-07-14T12:57:41.506537+0000","last_clean":"2023-07-14T12:57:41.506537+0000","last_became_active":"2023-07-14T12:57:40.158229+0000","last_became_peered":"2023-07-14T12:57:40.158229+0000","last_unstale":"2023-07-14T12:57:41.506537+0000","last_undegraded":"2023-07-14T12:57:41.506537+0000","last_fullsized":"2023-07-14T12:57:41.506537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:26.016492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504628+0000","last_change":"2023-07-14T12:57:39.152151+0000","last_active":"2023-07-14T12:57:42.504628+0000","last_peered":"2023-07-14T12:57:42.504628+0000","last_clean":"2023-07-14T12:57:42.504628+0000","last_became_active":"2023-07-14T12:57:39.151859+0000","last_became_peered":"2023-07-14T12:57:39.151859+0000","last_unstale":"2023-07-14T12:57:42.504628+0000","last_undegraded":"2023-07-14T12:57:42.504628+0000","last_fullsized":"2023-07-14T12:57:42.504628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:05.536248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.506619+0000","last_change":"2023-07-14T12:57:40.166604+0000","last_active":"2023-07-14T12:57:41.506619+0000","last_peered":"2023-07-14T12:57:41.506619+0000","last_clean":"2023-07-14T12:57:41.506619+0000","last_became_active":"2023-07-14T12:57:40.166265+0000","last_became_peered":"2023-07-14T12:57:40.166265+0000","last_unstale":"2023-07-14T12:57:41.506619+0000","last_undegraded":"2023-07-14T12:57:41.506619+0000","last_fullsized":"2023-07-14T12:57:41.506619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:52.069623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149438+0000","last_change":"2023-07-14T12:57:40.169910+0000","last_active":"2023-07-14T12:57:41.149438+0000","last_peered":"2023-07-14T12:57:41.149438+0000","last_clean":"2023-07-14T12:57:41.149438+0000","last_became_active":"2023-07-14T12:57:40.169621+0000","last_became_peered":"2023-07-14T12:57:40.169621+0000","last_unstale":"2023-07-14T12:57:41.149438+0000","last_undegraded":"2023-07-14T12:57:41.149438+0000","last_fullsized":"2023-07-14T12:57:41.149438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:58.873791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504946+0000","last_change":"2023-07-14T12:57:39.144463+0000","last_active":"2023-07-14T12:57:42.504946+0000","last_peered":"2023-07-14T12:57:42.504946+0000","last_clean":"2023-07-14T12:57:42.504946+0000","last_became_active":"2023-07-14T12:57:39.142094+0000","last_became_peered":"2023-07-14T12:57:39.142094+0000","last_unstale":"2023-07-14T12:57:42.504946+0000","last_undegraded":"2023-07-14T12:57:42.504946+0000","last_fullsized":"2023-07-14T12:57:42.504946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:50:48.743012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149204+0000","last_change":"2023-07-14T12:57:40.163588+0000","last_active":"2023-07-14T12:57:41.149204+0000","last_peered":"2023-07-14T12:57:41.149204+0000","last_clean":"2023-07-14T12:57:41.149204+0000","last_became_active":"2023-07-14T12:57:40.162611+0000","last_became_peered":"2023-07-14T12:57:40.162611+0000","last_unstale":"2023-07-14T12:57:41.149204+0000","last_undegraded":"2023-07-14T12:57:41.149204+0000","last_fullsized":"2023-07-14T12:57:41.149204+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:44.177488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.204317+0000","last_change":"2023-07-14T12:57:39.143581+0000","last_active":"2023-07-14T12:57:43.204317+0000","last_peered":"2023-07-14T12:57:43.204317+0000","last_clean":"2023-07-14T12:57:43.204317+0000","last_became_active":"2023-07-14T12:57:39.143257+0000","last_became_peered":"2023-07-14T12:57:39.143257+0000","last_unstale":"2023-07-14T12:57:43.204317+0000","last_undegraded":"2023-07-14T12:57:43.204317+0000","last_fullsized":"2023-07-14T12:57:43.204317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:07:34.816912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":346,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504439+0000","last_change":"2023-07-14T12:56:23.360103+0000","last_active":"2023-07-14T12:57:42.504439+0000","last_peered":"2023-07-14T12:57:42.504439+0000","last_clean":"2023-07-14T12:57:42.504439+0000","last_became_active":"2023-07-14T12:56:23.359608+0000","last_became_peered":"2023-07-14T12:56:23.359608+0000","last_unstale":"2023-07-14T12:57:42.504439+0000","last_undegraded":"2023-07-14T12:57:42.504439+0000","last_fullsized":"2023-07-14T12:57:42.504439+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.397328+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:32.997358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504948+0000","last_change":"2023-07-14T12:57:40.158039+0000","last_active":"2023-07-14T12:57:42.504948+0000","last_peered":"2023-07-14T12:57:42.504948+0000","last_clean":"2023-07-14T12:57:42.504948+0000","last_became_active":"2023-07-14T12:57:40.157629+0000","last_became_peered":"2023-07-14T12:57:40.157629+0000","last_unstale":"2023-07-14T12:57:42.504948+0000","last_undegraded":"2023-07-14T12:57:42.504948+0000","last_fullsized":"2023-07-14T12:57:42.504948+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:43:59.402836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.211461+0000","last_change":"2023-07-14T12:57:39.146449+0000","last_active":"2023-07-14T12:57:44.211461+0000","last_peered":"2023-07-14T12:57:44.211461+0000","last_clean":"2023-07-14T12:57:44.211461+0000","last_became_active":"2023-07-14T12:57:39.146109+0000","last_became_peered":"2023-07-14T12:57:39.146109+0000","last_unstale":"2023-07-14T12:57:44.211461+0000","last_undegraded":"2023-07-14T12:57:44.211461+0000","last_fullsized":"2023-07-14T12:57:44.211461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:18:11.909100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.202387+0000","last_change":"2023-07-14T12:57:39.149417+0000","last_active":"2023-07-14T12:57:43.202387+0000","last_peered":"2023-07-14T12:57:43.202387+0000","last_clean":"2023-07-14T12:57:43.202387+0000","last_became_active":"2023-07-14T12:57:39.149097+0000","last_became_peered":"2023-07-14T12:57:39.149097+0000","last_unstale":"2023-07-14T12:57:43.202387+0000","last_undegraded":"2023-07-14T12:57:43.202387+0000","last_fullsized":"2023-07-14T12:57:43.202387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:56:40.798083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505259+0000","last_change":"2023-07-14T12:57:40.160881+0000","last_active":"2023-07-14T12:57:42.505259+0000","last_peered":"2023-07-14T12:57:42.505259+0000","last_clean":"2023-07-14T12:57:42.505259+0000","last_became_active":"2023-07-14T12:57:40.158570+0000","last_became_peered":"2023-07-14T12:57:40.158570+0000","last_unstale":"2023-07-14T12:57:42.505259+0000","last_undegraded":"2023-07-14T12:57:42.505259+0000","last_fullsized":"2023-07-14T12:57:42.505259+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:59:22.927364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505943+0000","last_change":"2023-07-14T12:57:39.142805+0000","last_active":"2023-07-14T12:57:42.505943+0000","last_peered":"2023-07-14T12:57:42.505943+0000","last_clean":"2023-07-14T12:57:42.505943+0000","last_became_active":"2023-07-14T12:57:39.142417+0000","last_became_peered":"2023-07-14T12:57:39.142417+0000","last_unstale":"2023-07-14T12:57:42.505943+0000","last_undegraded":"2023-07-14T12:57:42.505943+0000","last_fullsized":"2023-07-14T12:57:42.505943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:02.490001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149168+0000","last_change":"2023-07-14T12:57:40.171695+0000","last_active":"2023-07-14T12:57:41.149168+0000","last_peered":"2023-07-14T12:57:41.149168+0000","last_clean":"2023-07-14T12:57:41.149168+0000","last_became_active":"2023-07-14T12:57:40.171344+0000","last_became_peered":"2023-07-14T12:57:40.171344+0000","last_unstale":"2023-07-14T12:57:41.149168+0000","last_undegraded":"2023-07-14T12:57:41.149168+0000","last_fullsized":"2023-07-14T12:57:41.149168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:56.137168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.202872+0000","last_change":"2023-07-14T12:57:39.141065+0000","last_active":"2023-07-14T12:57:43.202872+0000","last_peered":"2023-07-14T12:57:43.202872+0000","last_clean":"2023-07-14T12:57:43.202872+0000","last_became_active":"2023-07-14T12:57:39.140681+0000","last_became_peered":"2023-07-14T12:57:39.140681+0000","last_unstale":"2023-07-14T12:57:43.202872+0000","last_undegraded":"2023-07-14T12:57:43.202872+0000","last_fullsized":"2023-07-14T12:57:43.202872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:49:32.052430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505038+0000","last_change":"2023-07-14T12:57:40.158403+0000","last_active":"2023-07-14T12:57:42.505038+0000","last_peered":"2023-07-14T12:57:42.505038+0000","last_clean":"2023-07-14T12:57:42.505038+0000","last_became_active":"2023-07-14T12:57:40.158077+0000","last_became_peered":"2023-07-14T12:57:40.158077+0000","last_unstale":"2023-07-14T12:57:42.505038+0000","last_undegraded":"2023-07-14T12:57:42.505038+0000","last_fullsized":"2023-07-14T12:57:42.505038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:35.671087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149561+0000","last_change":"2023-07-14T12:57:39.139613+0000","last_active":"2023-07-14T12:57:41.149561+0000","last_peered":"2023-07-14T12:57:41.149561+0000","last_clean":"2023-07-14T12:57:41.149561+0000","last_became_active":"2023-07-14T12:57:39.139306+0000","last_became_peered":"2023-07-14T12:57:39.139306+0000","last_unstale":"2023-07-14T12:57:41.149561+0000","last_undegraded":"2023-07-14T12:57:41.149561+0000","last_fullsized":"2023-07-14T12:57:41.149561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:12:13.925670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.471672+0000","last_change":"2023-07-14T12:57:40.169715+0000","last_active":"2023-07-14T12:57:42.471672+0000","last_peered":"2023-07-14T12:57:42.471672+0000","last_clean":"2023-07-14T12:57:42.471672+0000","last_became_active":"2023-07-14T12:57:40.169319+0000","last_became_peered":"2023-07-14T12:57:40.169319+0000","last_unstale":"2023-07-14T12:57:42.471672+0000","last_undegraded":"2023-07-14T12:57:42.471672+0000","last_fullsized":"2023-07-14T12:57:42.471672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:57:20.861652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.148787+0000","last_change":"2023-07-14T12:57:39.134058+0000","last_active":"2023-07-14T12:57:41.148787+0000","last_peered":"2023-07-14T12:57:41.148787+0000","last_clean":"2023-07-14T12:57:41.148787+0000","last_became_active":"2023-07-14T12:57:39.133143+0000","last_became_peered":"2023-07-14T12:57:39.133143+0000","last_unstale":"2023-07-14T12:57:41.148787+0000","last_undegraded":"2023-07-14T12:57:41.148787+0000","last_fullsized":"2023-07-14T12:57:41.148787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:41.298689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186620+0000","last_change":"2023-07-14T12:57:40.164106+0000","last_active":"2023-07-14T12:57:42.186620+0000","last_peered":"2023-07-14T12:57:42.186620+0000","last_clean":"2023-07-14T12:57:42.186620+0000","last_became_active":"2023-07-14T12:57:40.163768+0000","last_became_peered":"2023-07-14T12:57:40.163768+0000","last_unstale":"2023-07-14T12:57:42.186620+0000","last_undegraded":"2023-07-14T12:57:42.186620+0000","last_fullsized":"2023-07-14T12:57:42.186620+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:24:55.560222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.833768+0000","last_change":"2023-07-14T12:57:39.146799+0000","last_active":"2023-07-14T12:57:41.833768+0000","last_peered":"2023-07-14T12:57:41.833768+0000","last_clean":"2023-07-14T12:57:41.833768+0000","last_became_active":"2023-07-14T12:57:39.145764+0000","last_became_peered":"2023-07-14T12:57:39.145764+0000","last_unstale":"2023-07-14T12:57:41.833768+0000","last_undegraded":"2023-07-14T12:57:41.833768+0000","last_fullsized":"2023-07-14T12:57:41.833768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:32:27.390501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149227+0000","last_change":"2023-07-14T12:57:40.163373+0000","last_active":"2023-07-14T12:57:41.149227+0000","last_peered":"2023-07-14T12:57:41.149227+0000","last_clean":"2023-07-14T12:57:41.149227+0000","last_became_active":"2023-07-14T12:57:40.162852+0000","last_became_peered":"2023-07-14T12:57:40.162852+0000","last_unstale":"2023-07-14T12:57:41.149227+0000","last_undegraded":"2023-07-14T12:57:41.149227+0000","last_fullsized":"2023-07-14T12:57:41.149227+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:24:28.549988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203899+0000","last_change":"2023-07-14T12:57:39.143961+0000","last_active":"2023-07-14T12:57:43.203899+0000","last_peered":"2023-07-14T12:57:43.203899+0000","last_clean":"2023-07-14T12:57:43.203899+0000","last_became_active":"2023-07-14T12:57:39.143599+0000","last_became_peered":"2023-07-14T12:57:39.143599+0000","last_unstale":"2023-07-14T12:57:43.203899+0000","last_undegraded":"2023-07-14T12:57:43.203899+0000","last_fullsized":"2023-07-14T12:57:43.203899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:10:36.419424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504623+0000","last_change":"2023-07-14T12:57:40.157972+0000","last_active":"2023-07-14T12:57:42.504623+0000","last_peered":"2023-07-14T12:57:42.504623+0000","last_clean":"2023-07-14T12:57:42.504623+0000","last_became_active":"2023-07-14T12:57:40.157645+0000","last_became_peered":"2023-07-14T12:57:40.157645+0000","last_unstale":"2023-07-14T12:57:42.504623+0000","last_undegraded":"2023-07-14T12:57:42.504623+0000","last_fullsized":"2023-07-14T12:57:42.504623+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:01:24.154140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.834078+0000","last_change":"2023-07-14T12:57:39.153405+0000","last_active":"2023-07-14T12:57:41.834078+0000","last_peered":"2023-07-14T12:57:41.834078+0000","last_clean":"2023-07-14T12:57:41.834078+0000","last_became_active":"2023-07-14T12:57:39.153029+0000","last_became_peered":"2023-07-14T12:57:39.153029+0000","last_unstale":"2023-07-14T12:57:41.834078+0000","last_undegraded":"2023-07-14T12:57:41.834078+0000","last_fullsized":"2023-07-14T12:57:41.834078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:05.454727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505053+0000","last_change":"2023-07-14T12:57:40.163910+0000","last_active":"2023-07-14T12:57:42.505053+0000","last_peered":"2023-07-14T12:57:42.505053+0000","last_clean":"2023-07-14T12:57:42.505053+0000","last_became_active":"2023-07-14T12:57:40.163539+0000","last_became_peered":"2023-07-14T12:57:40.163539+0000","last_unstale":"2023-07-14T12:57:42.505053+0000","last_undegraded":"2023-07-14T12:57:42.505053+0000","last_fullsized":"2023-07-14T12:57:42.505053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:20:21.218348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149612+0000","last_change":"2023-07-14T12:57:39.132649+0000","last_active":"2023-07-14T12:57:41.149612+0000","last_peered":"2023-07-14T12:57:41.149612+0000","last_clean":"2023-07-14T12:57:41.149612+0000","last_became_active":"2023-07-14T12:57:39.132295+0000","last_became_peered":"2023-07-14T12:57:39.132295+0000","last_unstale":"2023-07-14T12:57:41.149612+0000","last_undegraded":"2023-07-14T12:57:41.149612+0000","last_fullsized":"2023-07-14T12:57:41.149612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:06:59.116492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505271+0000","last_change":"2023-07-14T12:57:40.166285+0000","last_active":"2023-07-14T12:57:42.505271+0000","last_peered":"2023-07-14T12:57:42.505271+0000","last_clean":"2023-07-14T12:57:42.505271+0000","last_became_active":"2023-07-14T12:57:40.165968+0000","last_became_peered":"2023-07-14T12:57:40.165968+0000","last_unstale":"2023-07-14T12:57:42.505271+0000","last_undegraded":"2023-07-14T12:57:42.505271+0000","last_fullsized":"2023-07-14T12:57:42.505271+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:27:06.743383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504568+0000","last_change":"2023-07-14T12:57:39.150988+0000","last_active":"2023-07-14T12:57:42.504568+0000","last_peered":"2023-07-14T12:57:42.504568+0000","last_clean":"2023-07-14T12:57:42.504568+0000","last_became_active":"2023-07-14T12:57:39.150552+0000","last_became_peered":"2023-07-14T12:57:39.150552+0000","last_unstale":"2023-07-14T12:57:42.504568+0000","last_undegraded":"2023-07-14T12:57:42.504568+0000","last_fullsized":"2023-07-14T12:57:42.504568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:41.464083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505250+0000","last_change":"2023-07-14T12:57:40.169729+0000","last_active":"2023-07-14T12:57:42.505250+0000","last_peered":"2023-07-14T12:57:42.505250+0000","last_clean":"2023-07-14T12:57:42.505250+0000","last_became_active":"2023-07-14T12:57:40.169432+0000","last_became_peered":"2023-07-14T12:57:40.169432+0000","last_unstale":"2023-07-14T12:57:42.505250+0000","last_undegraded":"2023-07-14T12:57:42.505250+0000","last_fullsized":"2023-07-14T12:57:42.505250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:39:06.036539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186738+0000","last_change":"2023-07-14T12:57:40.167668+0000","last_active":"2023-07-14T12:57:42.186738+0000","last_peered":"2023-07-14T12:57:42.186738+0000","last_clean":"2023-07-14T12:57:42.186738+0000","last_became_active":"2023-07-14T12:57:40.167328+0000","last_became_peered":"2023-07-14T12:57:40.167328+0000","last_unstale":"2023-07-14T12:57:42.186738+0000","last_undegraded":"2023-07-14T12:57:42.186738+0000","last_fullsized":"2023-07-14T12:57:42.186738+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:37.640321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.834059+0000","last_change":"2023-07-14T12:57:40.161340+0000","last_active":"2023-07-14T12:57:41.834059+0000","last_peered":"2023-07-14T12:57:41.834059+0000","last_clean":"2023-07-14T12:57:41.834059+0000","last_became_active":"2023-07-14T12:57:40.161024+0000","last_became_peered":"2023-07-14T12:57:40.161024+0000","last_unstale":"2023-07-14T12:57:41.834059+0000","last_undegraded":"2023-07-14T12:57:41.834059+0000","last_fullsized":"2023-07-14T12:57:41.834059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:51.802631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.833923+0000","last_change":"2023-07-14T12:57:40.159287+0000","last_active":"2023-07-14T12:57:41.833923+0000","last_peered":"2023-07-14T12:57:41.833923+0000","last_clean":"2023-07-14T12:57:41.833923+0000","last_became_active":"2023-07-14T12:57:40.158889+0000","last_became_peered":"2023-07-14T12:57:40.158889+0000","last_unstale":"2023-07-14T12:57:41.833923+0000","last_undegraded":"2023-07-14T12:57:41.833923+0000","last_fullsized":"2023-07-14T12:57:41.833923+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:08:19.606003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504569+0000","last_change":"2023-07-14T12:57:40.168898+0000","last_active":"2023-07-14T12:57:42.504569+0000","last_peered":"2023-07-14T12:57:42.504569+0000","last_clean":"2023-07-14T12:57:42.504569+0000","last_became_active":"2023-07-14T12:57:40.168596+0000","last_became_peered":"2023-07-14T12:57:40.168596+0000","last_unstale":"2023-07-14T12:57:42.504569+0000","last_undegraded":"2023-07-14T12:57:42.504569+0000","last_fullsized":"2023-07-14T12:57:42.504569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:58.836111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505152+0000","last_change":"2023-07-14T12:57:40.156267+0000","last_active":"2023-07-14T12:57:42.505152+0000","last_peered":"2023-07-14T12:57:42.505152+0000","last_clean":"2023-07-14T12:57:42.505152+0000","last_became_active":"2023-07-14T12:57:40.155909+0000","last_became_peered":"2023-07-14T12:57:40.155909+0000","last_unstale":"2023-07-14T12:57:42.505152+0000","last_undegraded":"2023-07-14T12:57:42.505152+0000","last_fullsized":"2023-07-14T12:57:42.505152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:38:30.089659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186773+0000","last_change":"2023-07-14T12:57:40.162956+0000","last_active":"2023-07-14T12:57:42.186773+0000","last_peered":"2023-07-14T12:57:42.186773+0000","last_clean":"2023-07-14T12:57:42.186773+0000","last_became_active":"2023-07-14T12:57:40.162373+0000","last_became_peered":"2023-07-14T12:57:40.162373+0000","last_unstale":"2023-07-14T12:57:42.186773+0000","last_undegraded":"2023-07-14T12:57:42.186773+0000","last_fullsized":"2023-07-14T12:57:42.186773+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:47:05.877086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.834195+0000","last_change":"2023-07-14T12:57:40.158655+0000","last_active":"2023-07-14T12:57:41.834195+0000","last_peered":"2023-07-14T12:57:41.834195+0000","last_clean":"2023-07-14T12:57:41.834195+0000","last_became_active":"2023-07-14T12:57:40.158290+0000","last_became_peered":"2023-07-14T12:57:40.158290+0000","last_unstale":"2023-07-14T12:57:41.834195+0000","last_undegraded":"2023-07-14T12:57:41.834195+0000","last_fullsized":"2023-07-14T12:57:41.834195+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:33.297000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149011+0000","last_change":"2023-07-14T12:57:40.164132+0000","last_active":"2023-07-14T12:57:41.149011+0000","last_peered":"2023-07-14T12:57:41.149011+0000","last_clean":"2023-07-14T12:57:41.149011+0000","last_became_active":"2023-07-14T12:57:40.163774+0000","last_became_peered":"2023-07-14T12:57:40.163774+0000","last_unstale":"2023-07-14T12:57:41.149011+0000","last_undegraded":"2023-07-14T12:57:41.149011+0000","last_fullsized":"2023-07-14T12:57:41.149011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:06:28.034699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149282+0000","last_change":"2023-07-14T12:57:40.171046+0000","last_active":"2023-07-14T12:57:41.149282+0000","last_peered":"2023-07-14T12:57:41.149282+0000","last_clean":"2023-07-14T12:57:41.149282+0000","last_became_active":"2023-07-14T12:57:40.170727+0000","last_became_peered":"2023-07-14T12:57:40.170727+0000","last_unstale":"2023-07-14T12:57:41.149282+0000","last_undegraded":"2023-07-14T12:57:41.149282+0000","last_fullsized":"2023-07-14T12:57:41.149282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:49:12.139244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.148956+0000","last_change":"2023-07-14T12:57:40.171636+0000","last_active":"2023-07-14T12:57:41.148956+0000","last_peered":"2023-07-14T12:57:41.148956+0000","last_clean":"2023-07-14T12:57:41.148956+0000","last_became_active":"2023-07-14T12:57:40.171365+0000","last_became_peered":"2023-07-14T12:57:40.171365+0000","last_unstale":"2023-07-14T12:57:41.148956+0000","last_undegraded":"2023-07-14T12:57:41.148956+0000","last_fullsized":"2023-07-14T12:57:41.148956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:50:06.097699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149711+0000","last_change":"2023-07-14T12:57:40.162963+0000","last_active":"2023-07-14T12:57:41.149711+0000","last_peered":"2023-07-14T12:57:41.149711+0000","last_clean":"2023-07-14T12:57:41.149711+0000","last_became_active":"2023-07-14T12:57:40.162614+0000","last_became_peered":"2023-07-14T12:57:40.162614+0000","last_unstale":"2023-07-14T12:57:41.149711+0000","last_undegraded":"2023-07-14T12:57:41.149711+0000","last_fullsized":"2023-07-14T12:57:41.149711+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:30.482837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505811+0000","last_change":"2023-07-14T12:57:40.156138+0000","last_active":"2023-07-14T12:57:42.505811+0000","last_peered":"2023-07-14T12:57:42.505811+0000","last_clean":"2023-07-14T12:57:42.505811+0000","last_became_active":"2023-07-14T12:57:40.155785+0000","last_became_peered":"2023-07-14T12:57:40.155785+0000","last_unstale":"2023-07-14T12:57:42.505811+0000","last_undegraded":"2023-07-14T12:57:42.505811+0000","last_fullsized":"2023-07-14T12:57:42.505811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:09:17.095943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186632+0000","last_change":"2023-07-14T12:57:40.163978+0000","last_active":"2023-07-14T12:57:42.186632+0000","last_peered":"2023-07-14T12:57:42.186632+0000","last_clean":"2023-07-14T12:57:42.186632+0000","last_became_active":"2023-07-14T12:57:40.163620+0000","last_became_peered":"2023-07-14T12:57:40.163620+0000","last_unstale":"2023-07-14T12:57:42.186632+0000","last_undegraded":"2023-07-14T12:57:42.186632+0000","last_fullsized":"2023-07-14T12:57:42.186632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:11.761539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":215126,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3742,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":89,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":13460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350989,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":925696,"data_stored":441942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]}]},{"osd":10,"up_from":73,"seq":313532612626,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":1007616,"data_stored":1034248,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.626}]},{"osd":2,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.77000000000000002}]},{"osd":9,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.81599999999999995},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.82999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":9,"up_from":68,"seq":292057776151,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":433372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.76900000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.629},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.75},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.89500000000000002}]},{"osd":8,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.82399999999999995}]},{"osd":10,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.86699999999999999}]}]},{"osd":8,"up_from":60,"seq":257698037791,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":942080,"data_stored":442098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.5,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.51700000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.206,"5min":1.847,"15min":1.847},"last":0.83099999999999996}]},{"osd":1,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52600000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.52600000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.73299999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64000000000000001,"15min":0.64600000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68300000000000005,"15min":0.68000000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.95299999999999996,"15min":0.995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2350000000000001,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.84999999999999998,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.127,"5min":1.825,"15min":1.825},"last":0.80200000000000005}]},{"osd":4,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.76600000000000001},"min":{"1min":0.47899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2789999999999999,"5min":1.3,"15min":1.3},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.77500000000000002,"15min":0.78900000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.75}]},{"osd":6,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.93000000000000005,"15min":0.94399999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.872},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.93700000000000006,"15min":0.95499999999999996},"min":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2929999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.96599999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.92100000000000004,"15min":0.92500000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.91800000000000004,"15min":0.93300000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.321,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.93500000000000005}]},{"osd":9,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.85099999999999998}]},{"osd":10,"last update":"Fri Jul 14 12:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.91900000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":7,"up_from":52,"seq":223338299428,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":983040,"data_stored":1033093,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69099999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85499999999999998,"5min":1.02,"15min":1.02},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.79800000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":1.0109999999999999}]},{"osd":3,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.101,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76100000000000001,"15min":0.76000000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0549999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91700000000000004,"5min":1.169,"15min":1.169},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84399999999999997,"15min":0.85299999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.999,"5min":1.073,"15min":1.073},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.83099999999999996,"15min":0.84599999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94399999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":1.0529999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.624,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.503}]},{"osd":8,"last update":"Fri Jul 14 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81000000000000005,"15min":0.79800000000000004},"min":{"1min":0.71499999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.83199999999999996,"15min":0.82499999999999996},"min":{"1min":0.71299999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.036,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":1.1279999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.65100000000000002}]},{"osd":10,"last update":"Fri Jul 14 12:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.67600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]}]},{"osd":6,"up_from":47,"seq":201863462952,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":909312,"data_stored":432790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.51800000000000002,"15min":0.50700000000000001},"min":{"1min":0.35299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.432},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.373,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0960000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77000000000000002,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":4.0759999999999996,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.69499999999999995}]},{"osd":2,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94799999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.997,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.69399999999999995},"min":{"1min":0.48399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.626}]},{"osd":4,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.53100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.63700000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.81699999999999995,"15min":0.81499999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.84999999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.84399999999999997,"15min":0.82999999999999996},"min":{"1min":0.62,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.82699999999999996,"15min":0.81799999999999995},"min":{"1min":0.70799999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1200000000000001,"5min":1.155,"15min":1.155},"last":0.91700000000000004}]},{"osd":8,"last update":"Fri Jul 14 12:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.91300000000000003,"15min":0.92300000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.93700000000000006,"15min":0.95199999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1879999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.75600000000000001}]},{"osd":9,"last update":"Fri Jul 14 12:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.67100000000000004}]},{"osd":10,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":4.109,"5min":4.109,"15min":4.109},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.93799999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":929792,"data_stored":442651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.49399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.755},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63600000000000001,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.67300000000000004,"15min":0.63100000000000001},"min":{"1min":0.58499999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.65800000000000003,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81799999999999995,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Jul 14 12:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.73199999999999998,"15min":0.70399999999999996},"min":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.72299999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54200000000000004,"15min":0.52400000000000002},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.39900000000000002}]},{"osd":5,"last update":"Fri Jul 14 12:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68000000000000005,"15min":0.66400000000000003},"min":{"1min":0.46600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.72099999999999997,"15min":0.71199999999999997},"min":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88400000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72499999999999998,"15min":0.70299999999999996},"min":{"1min":0.64000000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.036,"15min":1.036},"last":0.627},{"interface":"front","average":{"1min":0.874,"5min":0.81100000000000005,"15min":0.78600000000000003},"min":{"1min":0.66000000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Jul 14 12:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.64900000000000002,"15min":0.623},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.70999999999999996}]},{"osd":8,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80700000000000005,"15min":0.79200000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.88100000000000001,"15min":0.86499999999999999},"min":{"1min":0.63400000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.61699999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.77000000000000002}]},{"osd":10,"last update":"Fri Jul 14 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.63800000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":442838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61099999999999999,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.622,"15min":0.58099999999999996},"min":{"1min":0.48099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri Jul 14 12:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.65200000000000002,"15min":0.622},"min":{"1min":0.53000000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.621},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97599999999999998,"5min":1.133,"15min":1.133},"last":0.83299999999999996}]},{"osd":3,"last update":"Fri Jul 14 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70799999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.57999999999999996,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0720000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69599999999999995,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.873,"5min":1.121,"15min":1.121},"last":0.627}]},{"osd":5,"last update":"Fri Jul 14 12:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.012,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.52500000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.66100000000000003,"15min":0.68500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.077},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94699999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.434}]},{"osd":7,"last update":"Fri Jul 14 12:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1200000000000001,"5min":1.155,"15min":1.155},"last":0.751},{"interface":"front","average":{"1min":0.873,"5min":0.79700000000000004,"15min":0.78400000000000003},"min":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.61799999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.879,"15min":0.88900000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1080000000000001,"5min":1.208,"15min":1.208},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.871,"15min":0.88300000000000001},"min":{"1min":0.57399999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1699999999999999,"5min":1.48,"15min":1.48},"last":0.89900000000000002}]},{"osd":9,"last update":"Fri Jul 14 12:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.53700000000000003}]},{"osd":10,"last update":"Fri Jul 14 12:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.749}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":933888,"data_stored":442685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79700000000000004,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83299999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Jul 14 12:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48399999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.874,"5min":1.819,"15min":1.819},"last":0.745},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.43099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94099999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Jul 14 12:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66000000000000003,"15min":0.66300000000000003},"min":{"1min":0.55100000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Jul 14 12:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.47799999999999998},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.622}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73699999999999999,"15min":0.72799999999999998},"min":{"1min":0.57999999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Jul 14 12:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.69299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77800000000000002}]},{"osd":8,"last update":"Fri Jul 14 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.58899999999999997}]},{"osd":9,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.60399999999999998}]},{"osd":10,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.84099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149752,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":925696,"data_stored":441133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.439,"15min":0.41899999999999998},"min":{"1min":0.378,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64800000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.46000000000000002,"15min":0.442},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.70799999999999996,"15min":0.66600000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":6.867,"5min":6.867,"15min":6.867},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.73599999999999999,"15min":0.67300000000000004},"min":{"1min":0.46000000000000002,"5min":0.436,"15min":0.436},"max":{"1min":6.8860000000000001,"5min":6.8860000000000001,"15min":6.8860000000000001},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69199999999999995,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93200000000000005,"5min":1.077,"15min":1.077},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.72599999999999998,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.436,"15min":0.436},"max":{"1min":6.9020000000000001,"5min":6.9020000000000001,"15min":6.9020000000000001},"last":0.89800000000000002}]},{"osd":4,"last update":"Fri Jul 14 12:56:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.71399999999999997,"15min":0.69799999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.01,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72399999999999998,"15min":0.70699999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.046,"5min":1.119,"15min":1.119},"last":0.749}]},{"osd":5,"last update":"Fri Jul 14 12:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Fri Jul 14 12:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69699999999999995,"15min":0.66100000000000003},"min":{"1min":0.56299999999999994,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0900000000000001,"5min":1.214,"15min":1.214},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68899999999999995,"15min":0.66200000000000003},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.103,"15min":1.103},"last":0.872}]},{"osd":7,"last update":"Fri Jul 14 12:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.79000000000000004,"15min":0.77000000000000002},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.76100000000000001}]},{"osd":8,"last update":"Fri Jul 14 12:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2010000000000001,"5min":1.206,"15min":1.206},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1859999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.80500000000000005}]},{"osd":9,"last update":"Fri Jul 14 12:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.92100000000000004}]},{"osd":10,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.96499999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888115,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":925696,"data_stored":441382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77600000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.35399999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.46800000000000003,"15min":0.45100000000000001},"min":{"1min":0.376,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.68999999999999995,"15min":0.67000000000000004},"min":{"1min":0.45500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76600000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.36099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.873}]},{"osd":5,"last update":"Fri Jul 14 12:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.54200000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0189999999999999,"5min":1.077,"15min":1.077},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.71099999999999997,"15min":0.69499999999999995},"min":{"1min":0.52900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.81599999999999995}]},{"osd":6,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77600000000000002,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93200000000000005,"5min":1.093,"15min":1.093},"last":1.022},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.042,"5min":1.282,"15min":1.282},"last":0.94299999999999995}]},{"osd":7,"last update":"Fri Jul 14 12:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0049999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.90100000000000002}]},{"osd":8,"last update":"Fri Jul 14 12:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1259999999999999,"5min":1.234,"15min":1.234},"last":1.143}]},{"osd":9,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.105},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":1.0089999999999999}]},{"osd":10,"last update":"Fri Jul 14 12:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.069},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":1.04}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":999424,"data_stored":1033156,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.48799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77100000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.42599999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96399999999999997,"5min":0.997,"15min":0.997},"last":0.53900000000000003}]},{"osd":1,"last update":"Fri Jul 14 12:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.65000000000000002,"15min":0.61499999999999999},"min":{"1min":0.53900000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.63200000000000001,"15min":0.60399999999999998},"min":{"1min":0.47399999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Jul 14 12:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.35099999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76500000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.504},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.49199999999999999,"15min":0.47199999999999998},"min":{"1min":0.33400000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78100000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90100000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70799999999999996,"15min":0.70499999999999996},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.96099999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Jul 14 12:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69799999999999995,"15min":0.66000000000000003},"min":{"1min":0.623,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70999999999999996,"15min":0.69399999999999995},"min":{"1min":0.51400000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.014,"5min":1.139,"15min":1.139},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Jul 14 12:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76000000000000001,"15min":0.75700000000000001},"min":{"1min":0.56399999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98799999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.55400000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93300000000000005,"5min":1.28,"15min":1.28},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Jul 14 12:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.85199999999999998},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91900000000000004,"5min":1.236,"15min":1.236},"last":0.746}]},{"osd":8,"last update":"Fri Jul 14 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98399999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.52900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.73499999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70999999999999996}]},{"osd":10,"last update":"Fri Jul 14 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.82199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34486,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:57:48.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:57:48.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:48 smithi131 ceph-mon[96953]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-07-14T12:57:48.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:48 smithi131 ceph-mon[96953]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:57:48.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:48 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/765236284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:57:48.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:48 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/877848442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:48.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.919+0000 7facbd5ff700 1 -- 172.21.15.17:0/1261994298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb8074550 msgr2=0x7facb80729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.919+0000 7facbd5ff700 1 --2- 172.21.15.17:0/1261994298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb8074550 0x7facb80729a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faca8009990 tx=0x7faca8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.920+0000 7facbd5ff700 1 -- 172.21.15.17:0/1261994298 shutdown_connections 2023-07-14T12:57:48.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.920+0000 7facbd5ff700 1 --2- 172.21.15.17:0/1261994298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb81079a0 0x7facb8109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.920+0000 7facbd5ff700 1 --2- 172.21.15.17:0/1261994298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb8074550 0x7facb80729a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.920+0000 7facbd5ff700 1 --2- 172.21.15.17:0/1261994298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb8072f70 0x7facb80733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.920+0000 7facbd5ff700 1 -- 172.21.15.17:0/1261994298 >> 172.21.15.17:0/1261994298 conn(0x7facb80fb100 msgr2=0x7facb80fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:48.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.920+0000 7facbd5ff700 1 -- 172.21.15.17:0/1261994298 shutdown_connections 2023-07-14T12:57:48.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.920+0000 7facbd5ff700 1 -- 172.21.15.17:0/1261994298 wait complete. 2023-07-14T12:57:48.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.921+0000 7facbd5ff700 1 Processor -- start 2023-07-14T12:57:48.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.921+0000 7facbd5ff700 1 -- start start 2023-07-14T12:57:48.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.921+0000 7facbd5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb8072f70 0x7facb8197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.921+0000 7facbd5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb8074550 0x7facb8197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.921+0000 7facbd5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb81079a0 0x7facb819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.921+0000 7facbd5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb819f590 con 0x7facb81079a0 2023-07-14T12:57:48.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.921+0000 7facbd5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb819f6d0 con 0x7facb8072f70 2023-07-14T12:57:48.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.921+0000 7facbd5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb819f860 con 0x7facb8074550 2023-07-14T12:57:48.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facb77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb81079a0 0x7facb819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:48.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facb77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb81079a0 0x7facb819efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48584/0 (socket says 172.21.15.17:48584) 2023-07-14T12:57:48.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facb77fe700 1 -- 172.21.15.17:0/3419935474 learned_addr learned my addr 172.21.15.17:0/3419935474 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:48.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facaffff700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb8074550 0x7facb8197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:48.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facb6ffd700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb8072f70 0x7facb8197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:48.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facb77fe700 1 -- 172.21.15.17:0/3419935474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb8074550 msgr2=0x7facb8197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facb77fe700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb8074550 0x7facb8197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facb77fe700 1 -- 172.21.15.17:0/3419935474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb8072f70 msgr2=0x7facb8197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:48.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facb77fe700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb8072f70 0x7facb8197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:48.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facb77fe700 1 -- 172.21.15.17:0/3419935474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca80095f0 con 0x7facb81079a0 2023-07-14T12:57:48.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facb6ffd700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb8072f70 0x7facb8197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:57:48.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.922+0000 7facb77fe700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb81079a0 0x7facb819efc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7facb000b970 tx=0x7facb000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:48.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.923+0000 7facb4ff9700 1 -- 172.21.15.17:0/3419935474 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb000c930 con 0x7facb81079a0 2023-07-14T12:57:48.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.923+0000 7facb4ff9700 1 -- 172.21.15.17:0/3419935474 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facb0014440 con 0x7facb81079a0 2023-07-14T12:57:48.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.923+0000 7facb4ff9700 1 -- 172.21.15.17:0/3419935474 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00075d0 con 0x7facb81079a0 2023-07-14T12:57:48.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.923+0000 7facbd5ff700 1 -- 172.21.15.17:0/3419935474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb819fb40 con 0x7facb81079a0 2023-07-14T12:57:48.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.923+0000 7facbd5ff700 1 -- 172.21.15.17:0/3419935474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb81a0000 con 0x7facb81079a0 2023-07-14T12:57:48.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.924+0000 7facbd5ff700 1 -- 172.21.15.17:0/3419935474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb8106050 con 0x7facb81079a0 2023-07-14T12:57:48.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.926+0000 7facb4ff9700 1 -- 172.21.15.17:0/3419935474 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7facb00145b0 con 0x7facb81079a0 2023-07-14T12:57:48.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.928+0000 7facb4ff9700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faca40a12a0 0x7faca40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:48.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.928+0000 7facb4ff9700 1 -- 172.21.15.17:0/3419935474 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7facb0006e40 con 0x7facb81079a0 2023-07-14T12:57:48.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.928+0000 7facb6ffd700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faca40a12a0 0x7faca40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:48.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.929+0000 7facb6ffd700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faca40a12a0 0x7faca40a3750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faca800b5c0 tx=0x7faca8005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:48.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:48.932+0000 7facb4ff9700 1 -- 172.21.15.17:0/3419935474 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7facb00958f0 con 0x7facb81079a0 2023-07-14T12:57:49.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.138+0000 7facbd5ff700 1 -- 172.21.15.17:0/3419935474 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7facb8060950 con 0x7faca40a12a0 2023-07-14T12:57:49.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.149+0000 7facb4ff9700 1 -- 172.21.15.17:0/3419935474 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+334535 (secure 0 0 0) 0x7facb8060950 con 0x7faca40a12a0 2023-07-14T12:57:49.181 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:49.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.153+0000 7facbd5ff700 1 -- 172.21.15.17:0/3419935474 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faca40a12a0 msgr2=0x7faca40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:49.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.153+0000 7facbd5ff700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faca40a12a0 0x7faca40a3750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faca800b5c0 tx=0x7faca8005fb0 comp rx=0 tx=0).stop 2023-07-14T12:57:49.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.153+0000 7facbd5ff700 1 -- 172.21.15.17:0/3419935474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb81079a0 msgr2=0x7facb819efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:49.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.153+0000 7facbd5ff700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb81079a0 0x7facb819efc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7facb000b970 tx=0x7facb000bc80 comp rx=0 tx=0).stop 2023-07-14T12:57:49.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.153+0000 7facbd5ff700 1 -- 172.21.15.17:0/3419935474 shutdown_connections 2023-07-14T12:57:49.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.153+0000 7facbd5ff700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faca40a12a0 0x7faca40a3750 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:49.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.153+0000 7facbd5ff700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb81079a0 0x7facb819efc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:49.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.153+0000 7facbd5ff700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb8072f70 0x7facb8197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:49.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.153+0000 7facbd5ff700 1 --2- 172.21.15.17:0/3419935474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb8074550 0x7facb8197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:49.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.153+0000 7facbd5ff700 1 -- 172.21.15.17:0/3419935474 >> 172.21.15.17:0/3419935474 conn(0x7facb80fb100 msgr2=0x7facb80fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:49.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.154+0000 7facbd5ff700 1 -- 172.21.15.17:0/3419935474 shutdown_connections 2023-07-14T12:57:49.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:49.154+0000 7facbd5ff700 1 -- 172.21.15.17:0/3419935474 wait complete. 2023-07-14T12:57:49.185 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-07-14T12:57:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2023-07-14T12:57:48.829541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594872,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":152,"num_read_kb":134,"num_write":302,"num_write_kb":2974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":241,"ondisk_log_size":241,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334652,"kb_used_data":11228,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124607172,"statfs":{"total":1151940427776,"available":1151597744128,"internally_reserved":0,"allocated":11497472,"data_stored":7150017,"data_compressed":108384,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4504,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":16,"num_read_kb":15,"num_write":121,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.689650"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186824+0000","last_change":"2023-07-14T12:57:40.168203+0000","last_active":"2023-07-14T12:57:42.186824+0000","last_peered":"2023-07-14T12:57:42.186824+0000","last_clean":"2023-07-14T12:57:42.186824+0000","last_became_active":"2023-07-14T12:57:40.164682+0000","last_became_peered":"2023-07-14T12:57:40.164682+0000","last_unstale":"2023-07-14T12:57:42.186824+0000","last_undegraded":"2023-07-14T12:57:42.186824+0000","last_fullsized":"2023-07-14T12:57:42.186824+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:34.823018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504878+0000","last_change":"2023-07-14T12:57:40.168194+0000","last_active":"2023-07-14T12:57:42.504878+0000","last_peered":"2023-07-14T12:57:42.504878+0000","last_clean":"2023-07-14T12:57:42.504878+0000","last_became_active":"2023-07-14T12:57:40.167825+0000","last_became_peered":"2023-07-14T12:57:40.167825+0000","last_unstale":"2023-07-14T12:57:42.504878+0000","last_undegraded":"2023-07-14T12:57:42.504878+0000","last_fullsized":"2023-07-14T12:57:42.504878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:02.374567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504545+0000","last_change":"2023-07-14T12:57:40.162824+0000","last_active":"2023-07-14T12:57:42.504545+0000","last_peered":"2023-07-14T12:57:42.504545+0000","last_clean":"2023-07-14T12:57:42.504545+0000","last_became_active":"2023-07-14T12:57:40.162526+0000","last_became_peered":"2023-07-14T12:57:40.162526+0000","last_unstale":"2023-07-14T12:57:42.504545+0000","last_undegraded":"2023-07-14T12:57:42.504545+0000","last_fullsized":"2023-07-14T12:57:42.504545+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:19:18.096250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505021+0000","last_change":"2023-07-14T12:57:40.160772+0000","last_active":"2023-07-14T12:57:42.505021+0000","last_peered":"2023-07-14T12:57:42.505021+0000","last_clean":"2023-07-14T12:57:42.505021+0000","last_became_active":"2023-07-14T12:57:40.160315+0000","last_became_peered":"2023-07-14T12:57:40.160315+0000","last_unstale":"2023-07-14T12:57:42.505021+0000","last_undegraded":"2023-07-14T12:57:42.505021+0000","last_fullsized":"2023-07-14T12:57:42.505021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:23:33.310782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.471742+0000","last_change":"2023-07-14T12:57:40.160868+0000","last_active":"2023-07-14T12:57:42.471742+0000","last_peered":"2023-07-14T12:57:42.471742+0000","last_clean":"2023-07-14T12:57:42.471742+0000","last_became_active":"2023-07-14T12:57:40.160558+0000","last_became_peered":"2023-07-14T12:57:40.160558+0000","last_unstale":"2023-07-14T12:57:42.471742+0000","last_undegraded":"2023-07-14T12:57:42.471742+0000","last_fullsized":"2023-07-14T12:57:42.471742+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:14:19.421538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.506575+0000","last_change":"2023-07-14T12:57:40.166305+0000","last_active":"2023-07-14T12:57:41.506575+0000","last_peered":"2023-07-14T12:57:41.506575+0000","last_clean":"2023-07-14T12:57:41.506575+0000","last_became_active":"2023-07-14T12:57:40.166012+0000","last_became_peered":"2023-07-14T12:57:40.166012+0000","last_unstale":"2023-07-14T12:57:41.506575+0000","last_undegraded":"2023-07-14T12:57:41.506575+0000","last_fullsized":"2023-07-14T12:57:41.506575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:15:13.120661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504401+0000","last_change":"2023-07-14T12:57:40.163312+0000","last_active":"2023-07-14T12:57:42.504401+0000","last_peered":"2023-07-14T12:57:42.504401+0000","last_clean":"2023-07-14T12:57:42.504401+0000","last_became_active":"2023-07-14T12:57:40.163030+0000","last_became_peered":"2023-07-14T12:57:40.163030+0000","last_unstale":"2023-07-14T12:57:42.504401+0000","last_undegraded":"2023-07-14T12:57:42.504401+0000","last_fullsized":"2023-07-14T12:57:42.504401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:21:10.760702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.148714+0000","last_change":"2023-07-14T12:57:40.163369+0000","last_active":"2023-07-14T12:57:41.148714+0000","last_peered":"2023-07-14T12:57:41.148714+0000","last_clean":"2023-07-14T12:57:41.148714+0000","last_became_active":"2023-07-14T12:57:40.163076+0000","last_became_peered":"2023-07-14T12:57:40.163076+0000","last_unstale":"2023-07-14T12:57:41.148714+0000","last_undegraded":"2023-07-14T12:57:41.148714+0000","last_fullsized":"2023-07-14T12:57:41.148714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:25:05.381086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.150019+0000","last_change":"2023-07-14T12:57:40.170263+0000","last_active":"2023-07-14T12:57:41.150019+0000","last_peered":"2023-07-14T12:57:41.150019+0000","last_clean":"2023-07-14T12:57:41.150019+0000","last_became_active":"2023-07-14T12:57:40.169952+0000","last_became_peered":"2023-07-14T12:57:40.169952+0000","last_unstale":"2023-07-14T12:57:41.150019+0000","last_undegraded":"2023-07-14T12:57:41.150019+0000","last_fullsized":"2023-07-14T12:57:41.150019+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:44:12.572040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.506594+0000","last_change":"2023-07-14T12:57:40.165359+0000","last_active":"2023-07-14T12:57:41.506594+0000","last_peered":"2023-07-14T12:57:41.506594+0000","last_clean":"2023-07-14T12:57:41.506594+0000","last_became_active":"2023-07-14T12:57:40.164918+0000","last_became_peered":"2023-07-14T12:57:40.164918+0000","last_unstale":"2023-07-14T12:57:41.506594+0000","last_undegraded":"2023-07-14T12:57:41.506594+0000","last_fullsized":"2023-07-14T12:57:41.506594+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:00:17.304218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504867+0000","last_change":"2023-07-14T12:57:40.160524+0000","last_active":"2023-07-14T12:57:42.504867+0000","last_peered":"2023-07-14T12:57:42.504867+0000","last_clean":"2023-07-14T12:57:42.504867+0000","last_became_active":"2023-07-14T12:57:40.160215+0000","last_became_peered":"2023-07-14T12:57:40.160215+0000","last_unstale":"2023-07-14T12:57:42.504867+0000","last_undegraded":"2023-07-14T12:57:42.504867+0000","last_fullsized":"2023-07-14T12:57:42.504867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:04.295507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505514+0000","last_change":"2023-07-14T12:57:40.167705+0000","last_active":"2023-07-14T12:57:42.505514+0000","last_peered":"2023-07-14T12:57:42.505514+0000","last_clean":"2023-07-14T12:57:42.505514+0000","last_became_active":"2023-07-14T12:57:40.167329+0000","last_became_peered":"2023-07-14T12:57:40.167329+0000","last_unstale":"2023-07-14T12:57:42.505514+0000","last_undegraded":"2023-07-14T12:57:42.505514+0000","last_fullsized":"2023-07-14T12:57:42.505514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:59:14.875748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505684+0000","last_change":"2023-07-14T12:57:40.162166+0000","last_active":"2023-07-14T12:57:42.505684+0000","last_peered":"2023-07-14T12:57:42.505684+0000","last_clean":"2023-07-14T12:57:42.505684+0000","last_became_active":"2023-07-14T12:57:40.161750+0000","last_became_peered":"2023-07-14T12:57:40.161750+0000","last_unstale":"2023-07-14T12:57:42.505684+0000","last_undegraded":"2023-07-14T12:57:42.505684+0000","last_fullsized":"2023-07-14T12:57:42.505684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:27:30.462081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504596+0000","last_change":"2023-07-14T12:57:40.160556+0000","last_active":"2023-07-14T12:57:42.504596+0000","last_peered":"2023-07-14T12:57:42.504596+0000","last_clean":"2023-07-14T12:57:42.504596+0000","last_became_active":"2023-07-14T12:57:40.159974+0000","last_became_peered":"2023-07-14T12:57:40.159974+0000","last_unstale":"2023-07-14T12:57:42.504596+0000","last_undegraded":"2023-07-14T12:57:42.504596+0000","last_fullsized":"2023-07-14T12:57:42.504596+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:12:45.370514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504443+0000","last_change":"2023-07-14T12:57:40.169116+0000","last_active":"2023-07-14T12:57:42.504443+0000","last_peered":"2023-07-14T12:57:42.504443+0000","last_clean":"2023-07-14T12:57:42.504443+0000","last_became_active":"2023-07-14T12:57:40.168714+0000","last_became_peered":"2023-07-14T12:57:40.168714+0000","last_unstale":"2023-07-14T12:57:42.504443+0000","last_undegraded":"2023-07-14T12:57:42.504443+0000","last_fullsized":"2023-07-14T12:57:42.504443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:39:51.039327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149631+0000","last_change":"2023-07-14T12:57:40.162621+0000","last_active":"2023-07-14T12:57:41.149631+0000","last_peered":"2023-07-14T12:57:41.149631+0000","last_clean":"2023-07-14T12:57:41.149631+0000","last_became_active":"2023-07-14T12:57:40.162329+0000","last_became_peered":"2023-07-14T12:57:40.162329+0000","last_unstale":"2023-07-14T12:57:41.149631+0000","last_undegraded":"2023-07-14T12:57:41.149631+0000","last_fullsized":"2023-07-14T12:57:41.149631+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:21:14.529162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186917+0000","last_change":"2023-07-14T12:57:40.172697+0000","last_active":"2023-07-14T12:57:42.186917+0000","last_peered":"2023-07-14T12:57:42.186917+0000","last_clean":"2023-07-14T12:57:42.186917+0000","last_became_active":"2023-07-14T12:57:40.172366+0000","last_became_peered":"2023-07-14T12:57:40.172366+0000","last_unstale":"2023-07-14T12:57:42.186917+0000","last_undegraded":"2023-07-14T12:57:42.186917+0000","last_fullsized":"2023-07-14T12:57:42.186917+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:26.923287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.506047+0000","last_change":"2023-07-14T12:57:40.166669+0000","last_active":"2023-07-14T12:57:42.506047+0000","last_peered":"2023-07-14T12:57:42.506047+0000","last_clean":"2023-07-14T12:57:42.506047+0000","last_became_active":"2023-07-14T12:57:40.166367+0000","last_became_peered":"2023-07-14T12:57:40.166367+0000","last_unstale":"2023-07-14T12:57:42.506047+0000","last_undegraded":"2023-07-14T12:57:42.506047+0000","last_fullsized":"2023-07-14T12:57:42.506047+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:03:50.966474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.834026+0000","last_change":"2023-07-14T12:57:40.159133+0000","last_active":"2023-07-14T12:57:41.834026+0000","last_peered":"2023-07-14T12:57:41.834026+0000","last_clean":"2023-07-14T12:57:41.834026+0000","last_became_active":"2023-07-14T12:57:40.158819+0000","last_became_peered":"2023-07-14T12:57:40.158819+0000","last_unstale":"2023-07-14T12:57:41.834026+0000","last_undegraded":"2023-07-14T12:57:41.834026+0000","last_fullsized":"2023-07-14T12:57:41.834026+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:01:12.588410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.213353+0000","last_change":"2023-07-14T12:57:39.144919+0000","last_active":"2023-07-14T12:57:44.213353+0000","last_peered":"2023-07-14T12:57:44.213353+0000","last_clean":"2023-07-14T12:57:44.213353+0000","last_became_active":"2023-07-14T12:57:39.144604+0000","last_became_peered":"2023-07-14T12:57:39.144604+0000","last_unstale":"2023-07-14T12:57:44.213353+0000","last_undegraded":"2023-07-14T12:57:44.213353+0000","last_fullsized":"2023-07-14T12:57:44.213353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:30:23.885243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149114+0000","last_change":"2023-07-14T12:57:40.165754+0000","last_active":"2023-07-14T12:57:41.149114+0000","last_peered":"2023-07-14T12:57:41.149114+0000","last_clean":"2023-07-14T12:57:41.149114+0000","last_became_active":"2023-07-14T12:57:40.165416+0000","last_became_peered":"2023-07-14T12:57:40.165416+0000","last_unstale":"2023-07-14T12:57:41.149114+0000","last_undegraded":"2023-07-14T12:57:41.149114+0000","last_fullsized":"2023-07-14T12:57:41.149114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:02:33.310959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.335063+0000","last_change":"2023-07-14T12:57:39.153977+0000","last_active":"2023-07-14T12:57:42.335063+0000","last_peered":"2023-07-14T12:57:42.335063+0000","last_clean":"2023-07-14T12:57:42.335063+0000","last_became_active":"2023-07-14T12:57:39.153675+0000","last_became_peered":"2023-07-14T12:57:39.153675+0000","last_unstale":"2023-07-14T12:57:42.335063+0000","last_undegraded":"2023-07-14T12:57:42.335063+0000","last_fullsized":"2023-07-14T12:57:42.335063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:17.493911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505155+0000","last_change":"2023-07-14T12:57:40.157076+0000","last_active":"2023-07-14T12:57:42.505155+0000","last_peered":"2023-07-14T12:57:42.505155+0000","last_clean":"2023-07-14T12:57:42.505155+0000","last_became_active":"2023-07-14T12:57:40.156652+0000","last_became_peered":"2023-07-14T12:57:40.156652+0000","last_unstale":"2023-07-14T12:57:42.505155+0000","last_undegraded":"2023-07-14T12:57:42.505155+0000","last_fullsized":"2023-07-14T12:57:42.505155+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:58.647850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.211330+0000","last_change":"2023-07-14T12:57:39.145123+0000","last_active":"2023-07-14T12:57:44.211330+0000","last_peered":"2023-07-14T12:57:44.211330+0000","last_clean":"2023-07-14T12:57:44.211330+0000","last_became_active":"2023-07-14T12:57:39.144768+0000","last_became_peered":"2023-07-14T12:57:39.144768+0000","last_unstale":"2023-07-14T12:57:44.211330+0000","last_undegraded":"2023-07-14T12:57:44.211330+0000","last_fullsized":"2023-07-14T12:57:44.211330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:30.431747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149792+0000","last_change":"2023-07-14T12:57:40.167084+0000","last_active":"2023-07-14T12:57:41.149792+0000","last_peered":"2023-07-14T12:57:41.149792+0000","last_clean":"2023-07-14T12:57:41.149792+0000","last_became_active":"2023-07-14T12:57:40.166654+0000","last_became_peered":"2023-07-14T12:57:40.166654+0000","last_unstale":"2023-07-14T12:57:41.149792+0000","last_undegraded":"2023-07-14T12:57:41.149792+0000","last_fullsized":"2023-07-14T12:57:41.149792+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:35.359589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.471904+0000","last_change":"2023-07-14T12:57:39.137432+0000","last_active":"2023-07-14T12:57:42.471904+0000","last_peered":"2023-07-14T12:57:42.471904+0000","last_clean":"2023-07-14T12:57:42.471904+0000","last_became_active":"2023-07-14T12:57:39.137124+0000","last_became_peered":"2023-07-14T12:57:39.137124+0000","last_unstale":"2023-07-14T12:57:42.471904+0000","last_undegraded":"2023-07-14T12:57:42.471904+0000","last_fullsized":"2023-07-14T12:57:42.471904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:16:11.673056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149525+0000","last_change":"2023-07-14T12:57:40.167477+0000","last_active":"2023-07-14T12:57:41.149525+0000","last_peered":"2023-07-14T12:57:41.149525+0000","last_clean":"2023-07-14T12:57:41.149525+0000","last_became_active":"2023-07-14T12:57:40.167177+0000","last_became_peered":"2023-07-14T12:57:40.167177+0000","last_unstale":"2023-07-14T12:57:41.149525+0000","last_undegraded":"2023-07-14T12:57:41.149525+0000","last_fullsized":"2023-07-14T12:57:41.149525+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:33:57.583425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:45.220148+0000","last_change":"2023-07-14T12:57:39.146569+0000","last_active":"2023-07-14T12:57:45.220148+0000","last_peered":"2023-07-14T12:57:45.220148+0000","last_clean":"2023-07-14T12:57:45.220148+0000","last_became_active":"2023-07-14T12:57:39.146251+0000","last_became_peered":"2023-07-14T12:57:39.146251+0000","last_unstale":"2023-07-14T12:57:45.220148+0000","last_undegraded":"2023-07-14T12:57:45.220148+0000","last_fullsized":"2023-07-14T12:57:45.220148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:31:38.341211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.472028+0000","last_change":"2023-07-14T12:57:40.160511+0000","last_active":"2023-07-14T12:57:42.472028+0000","last_peered":"2023-07-14T12:57:42.472028+0000","last_clean":"2023-07-14T12:57:42.472028+0000","last_became_active":"2023-07-14T12:57:40.160152+0000","last_became_peered":"2023-07-14T12:57:40.160152+0000","last_unstale":"2023-07-14T12:57:42.472028+0000","last_undegraded":"2023-07-14T12:57:42.472028+0000","last_fullsized":"2023-07-14T12:57:42.472028+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:21:32.813063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.209719+0000","last_change":"2023-07-14T12:57:39.141565+0000","last_active":"2023-07-14T12:57:44.209719+0000","last_peered":"2023-07-14T12:57:44.209719+0000","last_clean":"2023-07-14T12:57:44.209719+0000","last_became_active":"2023-07-14T12:57:39.141247+0000","last_became_peered":"2023-07-14T12:57:39.141247+0000","last_unstale":"2023-07-14T12:57:44.209719+0000","last_undegraded":"2023-07-14T12:57:44.209719+0000","last_fullsized":"2023-07-14T12:57:44.209719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:44:31.939537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.150787+0000","last_change":"2023-07-14T12:57:40.167335+0000","last_active":"2023-07-14T12:57:41.150787+0000","last_peered":"2023-07-14T12:57:41.150787+0000","last_clean":"2023-07-14T12:57:41.150787+0000","last_became_active":"2023-07-14T12:57:40.167016+0000","last_became_peered":"2023-07-14T12:57:40.167016+0000","last_unstale":"2023-07-14T12:57:41.150787+0000","last_undegraded":"2023-07-14T12:57:41.150787+0000","last_fullsized":"2023-07-14T12:57:41.150787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:43.681447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.212325+0000","last_change":"2023-07-14T12:57:39.145352+0000","last_active":"2023-07-14T12:57:44.212325+0000","last_peered":"2023-07-14T12:57:44.212325+0000","last_clean":"2023-07-14T12:57:44.212325+0000","last_became_active":"2023-07-14T12:57:39.145018+0000","last_became_peered":"2023-07-14T12:57:39.145018+0000","last_unstale":"2023-07-14T12:57:44.212325+0000","last_undegraded":"2023-07-14T12:57:44.212325+0000","last_fullsized":"2023-07-14T12:57:44.212325+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:31.561871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.148808+0000","last_change":"2023-07-14T12:57:40.173457+0000","last_active":"2023-07-14T12:57:41.148808+0000","last_peered":"2023-07-14T12:57:41.148808+0000","last_clean":"2023-07-14T12:57:41.148808+0000","last_became_active":"2023-07-14T12:57:40.173080+0000","last_became_peered":"2023-07-14T12:57:40.173080+0000","last_unstale":"2023-07-14T12:57:41.148808+0000","last_undegraded":"2023-07-14T12:57:41.148808+0000","last_fullsized":"2023-07-14T12:57:41.148808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:27:47.496195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.150855+0000","last_change":"2023-07-14T12:57:39.145383+0000","last_active":"2023-07-14T12:57:41.150855+0000","last_peered":"2023-07-14T12:57:41.150855+0000","last_clean":"2023-07-14T12:57:41.150855+0000","last_became_active":"2023-07-14T12:57:39.145088+0000","last_became_peered":"2023-07-14T12:57:39.145088+0000","last_unstale":"2023-07-14T12:57:41.150855+0000","last_undegraded":"2023-07-14T12:57:41.150855+0000","last_fullsized":"2023-07-14T12:57:41.150855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:21:43.986898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505723+0000","last_change":"2023-07-14T12:57:40.162123+0000","last_active":"2023-07-14T12:57:42.505723+0000","last_peered":"2023-07-14T12:57:42.505723+0000","last_clean":"2023-07-14T12:57:42.505723+0000","last_became_active":"2023-07-14T12:57:40.160789+0000","last_became_peered":"2023-07-14T12:57:40.160789+0000","last_unstale":"2023-07-14T12:57:42.505723+0000","last_undegraded":"2023-07-14T12:57:42.505723+0000","last_fullsized":"2023-07-14T12:57:42.505723+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:56.247181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203199+0000","last_change":"2023-07-14T12:57:39.139524+0000","last_active":"2023-07-14T12:57:43.203199+0000","last_peered":"2023-07-14T12:57:43.203199+0000","last_clean":"2023-07-14T12:57:43.203199+0000","last_became_active":"2023-07-14T12:57:39.139176+0000","last_became_peered":"2023-07-14T12:57:39.139176+0000","last_unstale":"2023-07-14T12:57:43.203199+0000","last_undegraded":"2023-07-14T12:57:43.203199+0000","last_fullsized":"2023-07-14T12:57:43.203199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:59:35.174476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.150018+0000","last_change":"2023-07-14T12:57:40.168729+0000","last_active":"2023-07-14T12:57:41.150018+0000","last_peered":"2023-07-14T12:57:41.150018+0000","last_clean":"2023-07-14T12:57:41.150018+0000","last_became_active":"2023-07-14T12:57:40.168408+0000","last_became_peered":"2023-07-14T12:57:40.168408+0000","last_unstale":"2023-07-14T12:57:41.150018+0000","last_undegraded":"2023-07-14T12:57:41.150018+0000","last_fullsized":"2023-07-14T12:57:41.150018+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:31:20.072947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.202871+0000","last_change":"2023-07-14T12:57:39.140744+0000","last_active":"2023-07-14T12:57:43.202871+0000","last_peered":"2023-07-14T12:57:43.202871+0000","last_clean":"2023-07-14T12:57:43.202871+0000","last_became_active":"2023-07-14T12:57:39.140391+0000","last_became_peered":"2023-07-14T12:57:39.140391+0000","last_unstale":"2023-07-14T12:57:43.202871+0000","last_undegraded":"2023-07-14T12:57:43.202871+0000","last_fullsized":"2023-07-14T12:57:43.202871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:26:18.601004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504989+0000","last_change":"2023-07-14T12:57:40.165552+0000","last_active":"2023-07-14T12:57:42.504989+0000","last_peered":"2023-07-14T12:57:42.504989+0000","last_clean":"2023-07-14T12:57:42.504989+0000","last_became_active":"2023-07-14T12:57:40.165214+0000","last_became_peered":"2023-07-14T12:57:40.165214+0000","last_unstale":"2023-07-14T12:57:42.504989+0000","last_undegraded":"2023-07-14T12:57:42.504989+0000","last_fullsized":"2023-07-14T12:57:42.504989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:34:50.558696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203751+0000","last_change":"2023-07-14T12:57:39.150311+0000","last_active":"2023-07-14T12:57:43.203751+0000","last_peered":"2023-07-14T12:57:43.203751+0000","last_clean":"2023-07-14T12:57:43.203751+0000","last_became_active":"2023-07-14T12:57:39.149885+0000","last_became_peered":"2023-07-14T12:57:39.149885+0000","last_unstale":"2023-07-14T12:57:43.203751+0000","last_undegraded":"2023-07-14T12:57:43.203751+0000","last_fullsized":"2023-07-14T12:57:43.203751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:44:11.856884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149935+0000","last_change":"2023-07-14T12:57:40.161845+0000","last_active":"2023-07-14T12:57:41.149935+0000","last_peered":"2023-07-14T12:57:41.149935+0000","last_clean":"2023-07-14T12:57:41.149935+0000","last_became_active":"2023-07-14T12:57:40.160895+0000","last_became_peered":"2023-07-14T12:57:40.160895+0000","last_unstale":"2023-07-14T12:57:41.149935+0000","last_undegraded":"2023-07-14T12:57:41.149935+0000","last_fullsized":"2023-07-14T12:57:41.149935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:29:52.802467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203334+0000","last_change":"2023-07-14T12:57:39.142584+0000","last_active":"2023-07-14T12:57:43.203334+0000","last_peered":"2023-07-14T12:57:43.203334+0000","last_clean":"2023-07-14T12:57:43.203334+0000","last_became_active":"2023-07-14T12:57:39.142239+0000","last_became_peered":"2023-07-14T12:57:39.142239+0000","last_unstale":"2023-07-14T12:57:43.203334+0000","last_undegraded":"2023-07-14T12:57:43.203334+0000","last_fullsized":"2023-07-14T12:57:43.203334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:43:04.608372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.471878+0000","last_change":"2023-07-14T12:57:40.170013+0000","last_active":"2023-07-14T12:57:42.471878+0000","last_peered":"2023-07-14T12:57:42.471878+0000","last_clean":"2023-07-14T12:57:42.471878+0000","last_became_active":"2023-07-14T12:57:40.169177+0000","last_became_peered":"2023-07-14T12:57:40.169177+0000","last_unstale":"2023-07-14T12:57:42.471878+0000","last_undegraded":"2023-07-14T12:57:42.471878+0000","last_fullsized":"2023-07-14T12:57:42.471878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:24:46.500669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.210663+0000","last_change":"2023-07-14T12:57:39.146790+0000","last_active":"2023-07-14T12:57:44.210663+0000","last_peered":"2023-07-14T12:57:44.210663+0000","last_clean":"2023-07-14T12:57:44.210663+0000","last_became_active":"2023-07-14T12:57:39.146361+0000","last_became_peered":"2023-07-14T12:57:39.146361+0000","last_unstale":"2023-07-14T12:57:44.210663+0000","last_undegraded":"2023-07-14T12:57:44.210663+0000","last_fullsized":"2023-07-14T12:57:44.210663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:53:28.273262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505339+0000","last_change":"2023-07-14T12:57:40.158098+0000","last_active":"2023-07-14T12:57:42.505339+0000","last_peered":"2023-07-14T12:57:42.505339+0000","last_clean":"2023-07-14T12:57:42.505339+0000","last_became_active":"2023-07-14T12:57:40.157736+0000","last_became_peered":"2023-07-14T12:57:40.157736+0000","last_unstale":"2023-07-14T12:57:42.505339+0000","last_undegraded":"2023-07-14T12:57:42.505339+0000","last_fullsized":"2023-07-14T12:57:42.505339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:53:22.679495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203479+0000","last_change":"2023-07-14T12:57:39.135784+0000","last_active":"2023-07-14T12:57:43.203479+0000","last_peered":"2023-07-14T12:57:43.203479+0000","last_clean":"2023-07-14T12:57:43.203479+0000","last_became_active":"2023-07-14T12:57:39.135480+0000","last_became_peered":"2023-07-14T12:57:39.135480+0000","last_unstale":"2023-07-14T12:57:43.203479+0000","last_undegraded":"2023-07-14T12:57:43.203479+0000","last_fullsized":"2023-07-14T12:57:43.203479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:27:29.620891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504844+0000","last_change":"2023-07-14T12:57:40.162548+0000","last_active":"2023-07-14T12:57:42.504844+0000","last_peered":"2023-07-14T12:57:42.504844+0000","last_clean":"2023-07-14T12:57:42.504844+0000","last_became_active":"2023-07-14T12:57:40.162191+0000","last_became_peered":"2023-07-14T12:57:40.162191+0000","last_unstale":"2023-07-14T12:57:42.504844+0000","last_undegraded":"2023-07-14T12:57:42.504844+0000","last_fullsized":"2023-07-14T12:57:42.504844+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:45:30.127931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504771+0000","last_change":"2023-07-14T12:57:39.145533+0000","last_active":"2023-07-14T12:57:42.504771+0000","last_peered":"2023-07-14T12:57:42.504771+0000","last_clean":"2023-07-14T12:57:42.504771+0000","last_became_active":"2023-07-14T12:57:39.145201+0000","last_became_peered":"2023-07-14T12:57:39.145201+0000","last_unstale":"2023-07-14T12:57:42.504771+0000","last_undegraded":"2023-07-14T12:57:42.504771+0000","last_fullsized":"2023-07-14T12:57:42.504771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:53:29.466344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504354+0000","last_change":"2023-07-14T12:57:40.160047+0000","last_active":"2023-07-14T12:57:42.504354+0000","last_peered":"2023-07-14T12:57:42.504354+0000","last_clean":"2023-07-14T12:57:42.504354+0000","last_became_active":"2023-07-14T12:57:40.159751+0000","last_became_peered":"2023-07-14T12:57:40.159751+0000","last_unstale":"2023-07-14T12:57:42.504354+0000","last_undegraded":"2023-07-14T12:57:42.504354+0000","last_fullsized":"2023-07-14T12:57:42.504354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:37:43.363147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.213341+0000","last_change":"2023-07-14T12:57:39.139507+0000","last_active":"2023-07-14T12:57:44.213341+0000","last_peered":"2023-07-14T12:57:44.213341+0000","last_clean":"2023-07-14T12:57:44.213341+0000","last_became_active":"2023-07-14T12:57:39.139197+0000","last_became_peered":"2023-07-14T12:57:39.139197+0000","last_unstale":"2023-07-14T12:57:44.213341+0000","last_undegraded":"2023-07-14T12:57:44.213341+0000","last_fullsized":"2023-07-14T12:57:44.213341+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:20:16.962249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149324+0000","last_change":"2023-07-14T12:57:40.173741+0000","last_active":"2023-07-14T12:57:41.149324+0000","last_peered":"2023-07-14T12:57:41.149324+0000","last_clean":"2023-07-14T12:57:41.149324+0000","last_became_active":"2023-07-14T12:57:40.173427+0000","last_became_peered":"2023-07-14T12:57:40.173427+0000","last_unstale":"2023-07-14T12:57:41.149324+0000","last_undegraded":"2023-07-14T12:57:41.149324+0000","last_fullsized":"2023-07-14T12:57:41.149324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:20:20.128168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.472005+0000","last_change":"2023-07-14T12:57:39.140979+0000","last_active":"2023-07-14T12:57:42.472005+0000","last_peered":"2023-07-14T12:57:42.472005+0000","last_clean":"2023-07-14T12:57:42.472005+0000","last_became_active":"2023-07-14T12:57:39.140692+0000","last_became_peered":"2023-07-14T12:57:39.140692+0000","last_unstale":"2023-07-14T12:57:42.472005+0000","last_undegraded":"2023-07-14T12:57:42.472005+0000","last_fullsized":"2023-07-14T12:57:42.472005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:27:27.409329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186751+0000","last_change":"2023-07-14T12:57:40.164258+0000","last_active":"2023-07-14T12:57:42.186751+0000","last_peered":"2023-07-14T12:57:42.186751+0000","last_clean":"2023-07-14T12:57:42.186751+0000","last_became_active":"2023-07-14T12:57:40.163911+0000","last_became_peered":"2023-07-14T12:57:40.163911+0000","last_unstale":"2023-07-14T12:57:42.186751+0000","last_undegraded":"2023-07-14T12:57:42.186751+0000","last_fullsized":"2023-07-14T12:57:42.186751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:53:30.538995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505795+0000","last_change":"2023-07-14T12:57:39.151301+0000","last_active":"2023-07-14T12:57:42.505795+0000","last_peered":"2023-07-14T12:57:42.505795+0000","last_clean":"2023-07-14T12:57:42.505795+0000","last_became_active":"2023-07-14T12:57:39.150948+0000","last_became_peered":"2023-07-14T12:57:39.150948+0000","last_unstale":"2023-07-14T12:57:42.505795+0000","last_undegraded":"2023-07-14T12:57:42.505795+0000","last_fullsized":"2023-07-14T12:57:42.505795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:35:06.119180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.506537+0000","last_change":"2023-07-14T12:57:40.158591+0000","last_active":"2023-07-14T12:57:41.506537+0000","last_peered":"2023-07-14T12:57:41.506537+0000","last_clean":"2023-07-14T12:57:41.506537+0000","last_became_active":"2023-07-14T12:57:40.158229+0000","last_became_peered":"2023-07-14T12:57:40.158229+0000","last_unstale":"2023-07-14T12:57:41.506537+0000","last_undegraded":"2023-07-14T12:57:41.506537+0000","last_fullsized":"2023-07-14T12:57:41.506537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:26.016492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504628+0000","last_change":"2023-07-14T12:57:39.152151+0000","last_active":"2023-07-14T12:57:42.504628+0000","last_peered":"2023-07-14T12:57:42.504628+0000","last_clean":"2023-07-14T12:57:42.504628+0000","last_became_active":"2023-07-14T12:57:39.151859+0000","last_became_peered":"2023-07-14T12:57:39.151859+0000","last_unstale":"2023-07-14T12:57:42.504628+0000","last_undegraded":"2023-07-14T12:57:42.504628+0000","last_fullsized":"2023-07-14T12:57:42.504628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:05.536248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.506619+0000","last_change":"2023-07-14T12:57:40.166604+0000","last_active":"2023-07-14T12:57:41.506619+0000","last_peered":"2023-07-14T12:57:41.506619+0000","last_clean":"2023-07-14T12:57:41.506619+0000","last_became_active":"2023-07-14T12:57:40.166265+0000","last_became_peered":"2023-07-14T12:57:40.166265+0000","last_unstale":"2023-07-14T12:57:41.506619+0000","last_undegraded":"2023-07-14T12:57:41.506619+0000","last_fullsized":"2023-07-14T12:57:41.506619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:52.069623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149438+0000","last_change":"2023-07-14T12:57:40.169910+0000","last_active":"2023-07-14T12:57:41.149438+0000","last_peered":"2023-07-14T12:57:41.149438+0000","last_clean":"2023-07-14T12:57:41.149438+0000","last_became_active":"2023-07-14T12:57:40.169621+0000","last_became_peered":"2023-07-14T12:57:40.169621+0000","last_unstale":"2023-07-14T12:57:41.149438+0000","last_undegraded":"2023-07-14T12:57:41.149438+0000","last_fullsized":"2023-07-14T12:57:41.149438+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:56:58.873791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:46.222987+0000","last_change":"2023-07-14T12:57:39.144463+0000","last_active":"2023-07-14T12:57:46.222987+0000","last_peered":"2023-07-14T12:57:46.222987+0000","last_clean":"2023-07-14T12:57:46.222987+0000","last_became_active":"2023-07-14T12:57:39.142094+0000","last_became_peered":"2023-07-14T12:57:39.142094+0000","last_unstale":"2023-07-14T12:57:46.222987+0000","last_undegraded":"2023-07-14T12:57:46.222987+0000","last_fullsized":"2023-07-14T12:57:46.222987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:50:48.743012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149204+0000","last_change":"2023-07-14T12:57:40.163588+0000","last_active":"2023-07-14T12:57:41.149204+0000","last_peered":"2023-07-14T12:57:41.149204+0000","last_clean":"2023-07-14T12:57:41.149204+0000","last_became_active":"2023-07-14T12:57:40.162611+0000","last_became_peered":"2023-07-14T12:57:40.162611+0000","last_unstale":"2023-07-14T12:57:41.149204+0000","last_undegraded":"2023-07-14T12:57:41.149204+0000","last_fullsized":"2023-07-14T12:57:41.149204+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:50:44.177488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.204317+0000","last_change":"2023-07-14T12:57:39.143581+0000","last_active":"2023-07-14T12:57:43.204317+0000","last_peered":"2023-07-14T12:57:43.204317+0000","last_clean":"2023-07-14T12:57:43.204317+0000","last_became_active":"2023-07-14T12:57:39.143257+0000","last_became_peered":"2023-07-14T12:57:39.143257+0000","last_unstale":"2023-07-14T12:57:43.204317+0000","last_undegraded":"2023-07-14T12:57:43.204317+0000","last_fullsized":"2023-07-14T12:57:43.204317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:07:34.816912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":346,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504439+0000","last_change":"2023-07-14T12:56:23.360103+0000","last_active":"2023-07-14T12:57:42.504439+0000","last_peered":"2023-07-14T12:57:42.504439+0000","last_clean":"2023-07-14T12:57:42.504439+0000","last_became_active":"2023-07-14T12:56:23.359608+0000","last_became_peered":"2023-07-14T12:56:23.359608+0000","last_unstale":"2023-07-14T12:57:42.504439+0000","last_undegraded":"2023-07-14T12:57:42.504439+0000","last_fullsized":"2023-07-14T12:57:42.504439+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.397328+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:19:32.997358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504948+0000","last_change":"2023-07-14T12:57:40.158039+0000","last_active":"2023-07-14T12:57:42.504948+0000","last_peered":"2023-07-14T12:57:42.504948+0000","last_clean":"2023-07-14T12:57:42.504948+0000","last_became_active":"2023-07-14T12:57:40.157629+0000","last_became_peered":"2023-07-14T12:57:40.157629+0000","last_unstale":"2023-07-14T12:57:42.504948+0000","last_undegraded":"2023-07-14T12:57:42.504948+0000","last_fullsized":"2023-07-14T12:57:42.504948+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:43:59.402836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.211461+0000","last_change":"2023-07-14T12:57:39.146449+0000","last_active":"2023-07-14T12:57:44.211461+0000","last_peered":"2023-07-14T12:57:44.211461+0000","last_clean":"2023-07-14T12:57:44.211461+0000","last_became_active":"2023-07-14T12:57:39.146109+0000","last_became_peered":"2023-07-14T12:57:39.146109+0000","last_unstale":"2023-07-14T12:57:44.211461+0000","last_undegraded":"2023-07-14T12:57:44.211461+0000","last_fullsized":"2023-07-14T12:57:44.211461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:18:11.909100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.202387+0000","last_change":"2023-07-14T12:57:39.149417+0000","last_active":"2023-07-14T12:57:43.202387+0000","last_peered":"2023-07-14T12:57:43.202387+0000","last_clean":"2023-07-14T12:57:43.202387+0000","last_became_active":"2023-07-14T12:57:39.149097+0000","last_became_peered":"2023-07-14T12:57:39.149097+0000","last_unstale":"2023-07-14T12:57:43.202387+0000","last_undegraded":"2023-07-14T12:57:43.202387+0000","last_fullsized":"2023-07-14T12:57:43.202387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:56:40.798083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505259+0000","last_change":"2023-07-14T12:57:40.160881+0000","last_active":"2023-07-14T12:57:42.505259+0000","last_peered":"2023-07-14T12:57:42.505259+0000","last_clean":"2023-07-14T12:57:42.505259+0000","last_became_active":"2023-07-14T12:57:40.158570+0000","last_became_peered":"2023-07-14T12:57:40.158570+0000","last_unstale":"2023-07-14T12:57:42.505259+0000","last_undegraded":"2023-07-14T12:57:42.505259+0000","last_fullsized":"2023-07-14T12:57:42.505259+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:59:22.927364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.213736+0000","last_change":"2023-07-14T12:57:39.142805+0000","last_active":"2023-07-14T12:57:44.213736+0000","last_peered":"2023-07-14T12:57:44.213736+0000","last_clean":"2023-07-14T12:57:44.213736+0000","last_became_active":"2023-07-14T12:57:39.142417+0000","last_became_peered":"2023-07-14T12:57:39.142417+0000","last_unstale":"2023-07-14T12:57:44.213736+0000","last_undegraded":"2023-07-14T12:57:44.213736+0000","last_fullsized":"2023-07-14T12:57:44.213736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:49:02.490001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149168+0000","last_change":"2023-07-14T12:57:40.171695+0000","last_active":"2023-07-14T12:57:41.149168+0000","last_peered":"2023-07-14T12:57:41.149168+0000","last_clean":"2023-07-14T12:57:41.149168+0000","last_became_active":"2023-07-14T12:57:40.171344+0000","last_became_peered":"2023-07-14T12:57:40.171344+0000","last_unstale":"2023-07-14T12:57:41.149168+0000","last_undegraded":"2023-07-14T12:57:41.149168+0000","last_fullsized":"2023-07-14T12:57:41.149168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:56.137168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.202872+0000","last_change":"2023-07-14T12:57:39.141065+0000","last_active":"2023-07-14T12:57:43.202872+0000","last_peered":"2023-07-14T12:57:43.202872+0000","last_clean":"2023-07-14T12:57:43.202872+0000","last_became_active":"2023-07-14T12:57:39.140681+0000","last_became_peered":"2023-07-14T12:57:39.140681+0000","last_unstale":"2023-07-14T12:57:43.202872+0000","last_undegraded":"2023-07-14T12:57:43.202872+0000","last_fullsized":"2023-07-14T12:57:43.202872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:49:32.052430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505038+0000","last_change":"2023-07-14T12:57:40.158403+0000","last_active":"2023-07-14T12:57:42.505038+0000","last_peered":"2023-07-14T12:57:42.505038+0000","last_clean":"2023-07-14T12:57:42.505038+0000","last_became_active":"2023-07-14T12:57:40.158077+0000","last_became_peered":"2023-07-14T12:57:40.158077+0000","last_unstale":"2023-07-14T12:57:42.505038+0000","last_undegraded":"2023-07-14T12:57:42.505038+0000","last_fullsized":"2023-07-14T12:57:42.505038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:51:35.671087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.202856+0000","last_change":"2023-07-14T12:57:39.139613+0000","last_active":"2023-07-14T12:57:43.202856+0000","last_peered":"2023-07-14T12:57:43.202856+0000","last_clean":"2023-07-14T12:57:43.202856+0000","last_became_active":"2023-07-14T12:57:39.139306+0000","last_became_peered":"2023-07-14T12:57:39.139306+0000","last_unstale":"2023-07-14T12:57:43.202856+0000","last_undegraded":"2023-07-14T12:57:43.202856+0000","last_fullsized":"2023-07-14T12:57:43.202856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:12:13.925670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.471672+0000","last_change":"2023-07-14T12:57:40.169715+0000","last_active":"2023-07-14T12:57:42.471672+0000","last_peered":"2023-07-14T12:57:42.471672+0000","last_clean":"2023-07-14T12:57:42.471672+0000","last_became_active":"2023-07-14T12:57:40.169319+0000","last_became_peered":"2023-07-14T12:57:40.169319+0000","last_unstale":"2023-07-14T12:57:42.471672+0000","last_undegraded":"2023-07-14T12:57:42.471672+0000","last_fullsized":"2023-07-14T12:57:42.471672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:57:20.861652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203962+0000","last_change":"2023-07-14T12:57:39.134058+0000","last_active":"2023-07-14T12:57:43.203962+0000","last_peered":"2023-07-14T12:57:43.203962+0000","last_clean":"2023-07-14T12:57:43.203962+0000","last_became_active":"2023-07-14T12:57:39.133143+0000","last_became_peered":"2023-07-14T12:57:39.133143+0000","last_unstale":"2023-07-14T12:57:43.203962+0000","last_undegraded":"2023-07-14T12:57:43.203962+0000","last_fullsized":"2023-07-14T12:57:43.203962+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:41.298689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186620+0000","last_change":"2023-07-14T12:57:40.164106+0000","last_active":"2023-07-14T12:57:42.186620+0000","last_peered":"2023-07-14T12:57:42.186620+0000","last_clean":"2023-07-14T12:57:42.186620+0000","last_became_active":"2023-07-14T12:57:40.163768+0000","last_became_peered":"2023-07-14T12:57:40.163768+0000","last_unstale":"2023-07-14T12:57:42.186620+0000","last_undegraded":"2023-07-14T12:57:42.186620+0000","last_fullsized":"2023-07-14T12:57:42.186620+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:24:55.560222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.834225+0000","last_change":"2023-07-14T12:57:39.146799+0000","last_active":"2023-07-14T12:57:41.834225+0000","last_peered":"2023-07-14T12:57:41.834225+0000","last_clean":"2023-07-14T12:57:41.834225+0000","last_became_active":"2023-07-14T12:57:39.145764+0000","last_became_peered":"2023-07-14T12:57:39.145764+0000","last_unstale":"2023-07-14T12:57:41.834225+0000","last_undegraded":"2023-07-14T12:57:41.834225+0000","last_fullsized":"2023-07-14T12:57:41.834225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:32:27.390501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149227+0000","last_change":"2023-07-14T12:57:40.163373+0000","last_active":"2023-07-14T12:57:41.149227+0000","last_peered":"2023-07-14T12:57:41.149227+0000","last_clean":"2023-07-14T12:57:41.149227+0000","last_became_active":"2023-07-14T12:57:40.162852+0000","last_became_peered":"2023-07-14T12:57:40.162852+0000","last_unstale":"2023-07-14T12:57:41.149227+0000","last_undegraded":"2023-07-14T12:57:41.149227+0000","last_fullsized":"2023-07-14T12:57:41.149227+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:24:28.549988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:43.203899+0000","last_change":"2023-07-14T12:57:39.143961+0000","last_active":"2023-07-14T12:57:43.203899+0000","last_peered":"2023-07-14T12:57:43.203899+0000","last_clean":"2023-07-14T12:57:43.203899+0000","last_became_active":"2023-07-14T12:57:39.143599+0000","last_became_peered":"2023-07-14T12:57:39.143599+0000","last_unstale":"2023-07-14T12:57:43.203899+0000","last_undegraded":"2023-07-14T12:57:43.203899+0000","last_fullsized":"2023-07-14T12:57:43.203899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:10:36.419424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504623+0000","last_change":"2023-07-14T12:57:40.157972+0000","last_active":"2023-07-14T12:57:42.504623+0000","last_peered":"2023-07-14T12:57:42.504623+0000","last_clean":"2023-07-14T12:57:42.504623+0000","last_became_active":"2023-07-14T12:57:40.157645+0000","last_became_peered":"2023-07-14T12:57:40.157645+0000","last_unstale":"2023-07-14T12:57:42.504623+0000","last_undegraded":"2023-07-14T12:57:42.504623+0000","last_fullsized":"2023-07-14T12:57:42.504623+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:01:24.154140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:44.212956+0000","last_change":"2023-07-14T12:57:39.153405+0000","last_active":"2023-07-14T12:57:44.212956+0000","last_peered":"2023-07-14T12:57:44.212956+0000","last_clean":"2023-07-14T12:57:44.212956+0000","last_became_active":"2023-07-14T12:57:39.153029+0000","last_became_peered":"2023-07-14T12:57:39.153029+0000","last_unstale":"2023-07-14T12:57:44.212956+0000","last_undegraded":"2023-07-14T12:57:44.212956+0000","last_fullsized":"2023-07-14T12:57:44.212956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:47:05.454727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505053+0000","last_change":"2023-07-14T12:57:40.163910+0000","last_active":"2023-07-14T12:57:42.505053+0000","last_peered":"2023-07-14T12:57:42.505053+0000","last_clean":"2023-07-14T12:57:42.505053+0000","last_became_active":"2023-07-14T12:57:40.163539+0000","last_became_peered":"2023-07-14T12:57:40.163539+0000","last_unstale":"2023-07-14T12:57:42.505053+0000","last_undegraded":"2023-07-14T12:57:42.505053+0000","last_fullsized":"2023-07-14T12:57:42.505053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:20:21.218348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149612+0000","last_change":"2023-07-14T12:57:39.132649+0000","last_active":"2023-07-14T12:57:41.149612+0000","last_peered":"2023-07-14T12:57:41.149612+0000","last_clean":"2023-07-14T12:57:41.149612+0000","last_became_active":"2023-07-14T12:57:39.132295+0000","last_became_peered":"2023-07-14T12:57:39.132295+0000","last_unstale":"2023-07-14T12:57:41.149612+0000","last_undegraded":"2023-07-14T12:57:41.149612+0000","last_fullsized":"2023-07-14T12:57:41.149612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:06:59.116492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505271+0000","last_change":"2023-07-14T12:57:40.166285+0000","last_active":"2023-07-14T12:57:42.505271+0000","last_peered":"2023-07-14T12:57:42.505271+0000","last_clean":"2023-07-14T12:57:42.505271+0000","last_became_active":"2023-07-14T12:57:40.165968+0000","last_became_peered":"2023-07-14T12:57:40.165968+0000","last_unstale":"2023-07-14T12:57:42.505271+0000","last_undegraded":"2023-07-14T12:57:42.505271+0000","last_fullsized":"2023-07-14T12:57:42.505271+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:27:06.743383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504568+0000","last_change":"2023-07-14T12:57:39.150988+0000","last_active":"2023-07-14T12:57:42.504568+0000","last_peered":"2023-07-14T12:57:42.504568+0000","last_clean":"2023-07-14T12:57:42.504568+0000","last_became_active":"2023-07-14T12:57:39.150552+0000","last_became_peered":"2023-07-14T12:57:39.150552+0000","last_unstale":"2023-07-14T12:57:42.504568+0000","last_undegraded":"2023-07-14T12:57:42.504568+0000","last_fullsized":"2023-07-14T12:57:42.504568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:25:41.464083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505250+0000","last_change":"2023-07-14T12:57:40.169729+0000","last_active":"2023-07-14T12:57:42.505250+0000","last_peered":"2023-07-14T12:57:42.505250+0000","last_clean":"2023-07-14T12:57:42.505250+0000","last_became_active":"2023-07-14T12:57:40.169432+0000","last_became_peered":"2023-07-14T12:57:40.169432+0000","last_unstale":"2023-07-14T12:57:42.505250+0000","last_undegraded":"2023-07-14T12:57:42.505250+0000","last_fullsized":"2023-07-14T12:57:42.505250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:39:06.036539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186738+0000","last_change":"2023-07-14T12:57:40.167668+0000","last_active":"2023-07-14T12:57:42.186738+0000","last_peered":"2023-07-14T12:57:42.186738+0000","last_clean":"2023-07-14T12:57:42.186738+0000","last_became_active":"2023-07-14T12:57:40.167328+0000","last_became_peered":"2023-07-14T12:57:40.167328+0000","last_unstale":"2023-07-14T12:57:42.186738+0000","last_undegraded":"2023-07-14T12:57:42.186738+0000","last_fullsized":"2023-07-14T12:57:42.186738+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:37.640321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.834059+0000","last_change":"2023-07-14T12:57:40.161340+0000","last_active":"2023-07-14T12:57:41.834059+0000","last_peered":"2023-07-14T12:57:41.834059+0000","last_clean":"2023-07-14T12:57:41.834059+0000","last_became_active":"2023-07-14T12:57:40.161024+0000","last_became_peered":"2023-07-14T12:57:40.161024+0000","last_unstale":"2023-07-14T12:57:41.834059+0000","last_undegraded":"2023-07-14T12:57:41.834059+0000","last_fullsized":"2023-07-14T12:57:41.834059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:51.802631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.833923+0000","last_change":"2023-07-14T12:57:40.159287+0000","last_active":"2023-07-14T12:57:41.833923+0000","last_peered":"2023-07-14T12:57:41.833923+0000","last_clean":"2023-07-14T12:57:41.833923+0000","last_became_active":"2023-07-14T12:57:40.158889+0000","last_became_peered":"2023-07-14T12:57:40.158889+0000","last_unstale":"2023-07-14T12:57:41.833923+0000","last_undegraded":"2023-07-14T12:57:41.833923+0000","last_fullsized":"2023-07-14T12:57:41.833923+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:08:19.606003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.504569+0000","last_change":"2023-07-14T12:57:40.168898+0000","last_active":"2023-07-14T12:57:42.504569+0000","last_peered":"2023-07-14T12:57:42.504569+0000","last_clean":"2023-07-14T12:57:42.504569+0000","last_became_active":"2023-07-14T12:57:40.168596+0000","last_became_peered":"2023-07-14T12:57:40.168596+0000","last_unstale":"2023-07-14T12:57:42.504569+0000","last_undegraded":"2023-07-14T12:57:42.504569+0000","last_fullsized":"2023-07-14T12:57:42.504569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:58.836111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505152+0000","last_change":"2023-07-14T12:57:40.156267+0000","last_active":"2023-07-14T12:57:42.505152+0000","last_peered":"2023-07-14T12:57:42.505152+0000","last_clean":"2023-07-14T12:57:42.505152+0000","last_became_active":"2023-07-14T12:57:40.155909+0000","last_became_peered":"2023-07-14T12:57:40.155909+0000","last_unstale":"2023-07-14T12:57:42.505152+0000","last_undegraded":"2023-07-14T12:57:42.505152+0000","last_fullsized":"2023-07-14T12:57:42.505152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:38:30.089659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186773+0000","last_change":"2023-07-14T12:57:40.162956+0000","last_active":"2023-07-14T12:57:42.186773+0000","last_peered":"2023-07-14T12:57:42.186773+0000","last_clean":"2023-07-14T12:57:42.186773+0000","last_became_active":"2023-07-14T12:57:40.162373+0000","last_became_peered":"2023-07-14T12:57:40.162373+0000","last_unstale":"2023-07-14T12:57:42.186773+0000","last_undegraded":"2023-07-14T12:57:42.186773+0000","last_fullsized":"2023-07-14T12:57:42.186773+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:47:05.877086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.834195+0000","last_change":"2023-07-14T12:57:40.158655+0000","last_active":"2023-07-14T12:57:41.834195+0000","last_peered":"2023-07-14T12:57:41.834195+0000","last_clean":"2023-07-14T12:57:41.834195+0000","last_became_active":"2023-07-14T12:57:40.158290+0000","last_became_peered":"2023-07-14T12:57:40.158290+0000","last_unstale":"2023-07-14T12:57:41.834195+0000","last_undegraded":"2023-07-14T12:57:41.834195+0000","last_fullsized":"2023-07-14T12:57:41.834195+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:24:33.297000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149011+0000","last_change":"2023-07-14T12:57:40.164132+0000","last_active":"2023-07-14T12:57:41.149011+0000","last_peered":"2023-07-14T12:57:41.149011+0000","last_clean":"2023-07-14T12:57:41.149011+0000","last_became_active":"2023-07-14T12:57:40.163774+0000","last_became_peered":"2023-07-14T12:57:40.163774+0000","last_unstale":"2023-07-14T12:57:41.149011+0000","last_undegraded":"2023-07-14T12:57:41.149011+0000","last_fullsized":"2023-07-14T12:57:41.149011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:06:28.034699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149282+0000","last_change":"2023-07-14T12:57:40.171046+0000","last_active":"2023-07-14T12:57:41.149282+0000","last_peered":"2023-07-14T12:57:41.149282+0000","last_clean":"2023-07-14T12:57:41.149282+0000","last_became_active":"2023-07-14T12:57:40.170727+0000","last_became_peered":"2023-07-14T12:57:40.170727+0000","last_unstale":"2023-07-14T12:57:41.149282+0000","last_undegraded":"2023-07-14T12:57:41.149282+0000","last_fullsized":"2023-07-14T12:57:41.149282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:49:12.139244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.148956+0000","last_change":"2023-07-14T12:57:40.171636+0000","last_active":"2023-07-14T12:57:41.148956+0000","last_peered":"2023-07-14T12:57:41.148956+0000","last_clean":"2023-07-14T12:57:41.148956+0000","last_became_active":"2023-07-14T12:57:40.171365+0000","last_became_peered":"2023-07-14T12:57:40.171365+0000","last_unstale":"2023-07-14T12:57:41.148956+0000","last_undegraded":"2023-07-14T12:57:41.148956+0000","last_fullsized":"2023-07-14T12:57:41.148956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:50:06.097699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:41.149711+0000","last_change":"2023-07-14T12:57:40.162963+0000","last_active":"2023-07-14T12:57:41.149711+0000","last_peered":"2023-07-14T12:57:41.149711+0000","last_clean":"2023-07-14T12:57:41.149711+0000","last_became_active":"2023-07-14T12:57:40.162614+0000","last_became_peered":"2023-07-14T12:57:40.162614+0000","last_unstale":"2023-07-14T12:57:41.149711+0000","last_undegraded":"2023-07-14T12:57:41.149711+0000","last_fullsized":"2023-07-14T12:57:41.149711+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:02:30.482837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.505811+0000","last_change":"2023-07-14T12:57:40.156138+0000","last_active":"2023-07-14T12:57:42.505811+0000","last_peered":"2023-07-14T12:57:42.505811+0000","last_clean":"2023-07-14T12:57:42.505811+0000","last_became_active":"2023-07-14T12:57:40.155785+0000","last_became_peered":"2023-07-14T12:57:40.155785+0000","last_unstale":"2023-07-14T12:57:42.505811+0000","last_undegraded":"2023-07-14T12:57:42.505811+0000","last_fullsized":"2023-07-14T12:57:42.505811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:09:17.095943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T12:57:42.186632+0000","last_change":"2023-07-14T12:57:40.163978+0000","last_active":"2023-07-14T12:57:42.186632+0000","last_peered":"2023-07-14T12:57:42.186632+0000","last_clean":"2023-07-14T12:57:42.186632+0000","last_became_active":"2023-07-14T12:57:40.163620+0000","last_became_peered":"2023-07-14T12:57:40.163620+0000","last_unstale":"2023-07-14T12:57:42.186632+0000","last_undegraded":"2023-07-14T12:57:42.186632+0000","last_fullsized":"2023-07-14T12:57:42.186632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:16:11.761539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":215126,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4504,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":16,"num_read_kb":15,"num_write":121,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":84006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350989,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":925696,"data_stored":441942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]}]},{"osd":10,"up_from":73,"seq":313532612626,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":1007616,"data_stored":1034248,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.626}]},{"osd":2,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59799999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.77000000000000002}]},{"osd":9,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.81599999999999995},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.82999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]},{"osd":9,"up_from":68,"seq":292057776152,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":942080,"data_stored":442178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.439},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.38600000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.505},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.86599999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.748},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":0.66800000000000004}]},{"osd":10,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.78300000000000003}]}]},{"osd":8,"up_from":60,"seq":257698037791,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":942080,"data_stored":442098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.5,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.751,"15min":0.76300000000000001},"min":{"1min":0.51700000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.206,"5min":1.847,"15min":1.847},"last":0.83099999999999996}]},{"osd":1,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52600000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.52600000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.73299999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64000000000000001,"15min":0.64600000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68300000000000005,"15min":0.68000000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.5739999999999998,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.95299999999999996,"15min":0.995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.2350000000000001,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.84999999999999998,"15min":0.86699999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.127,"5min":1.825,"15min":1.825},"last":0.80200000000000005}]},{"osd":4,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.76600000000000001},"min":{"1min":0.47899999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2789999999999999,"5min":1.3,"15min":1.3},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.77500000000000002,"15min":0.78900000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.2890000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.75}]},{"osd":6,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.93000000000000005,"15min":0.94399999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.872},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.93700000000000006,"15min":0.95499999999999996},"min":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2929999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.96599999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.92100000000000004,"15min":0.92500000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.91800000000000004,"15min":0.93300000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.321,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.93500000000000005}]},{"osd":9,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.85099999999999998}]},{"osd":10,"last update":"Fri Jul 14 12:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.91900000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":7,"up_from":52,"seq":223338299428,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":983040,"data_stored":1033093,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53200000000000003,"15min":0.53600000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69099999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85499999999999998,"5min":1.02,"15min":1.02},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.79800000000000004,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":1.0109999999999999}]},{"osd":3,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.101,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76100000000000001,"15min":0.76000000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0549999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91700000000000004,"5min":1.169,"15min":1.169},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.42899999999999999}]},{"osd":5,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.84399999999999997,"15min":0.85299999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.999,"5min":1.073,"15min":1.073},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.83099999999999996,"15min":0.84599999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94399999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":1.0529999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88200000000000001,"15min":0.879},"min":{"1min":0.624,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.503}]},{"osd":8,"last update":"Fri Jul 14 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81000000000000005,"15min":0.79800000000000004},"min":{"1min":0.71499999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.83199999999999996,"15min":0.82499999999999996},"min":{"1min":0.71299999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.036,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":1.1279999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.65100000000000002}]},{"osd":10,"last update":"Fri Jul 14 12:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.67600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]}]},{"osd":6,"up_from":47,"seq":201863462953,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":929792,"data_stored":441573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.51800000000000002,"15min":0.50700000000000001},"min":{"1min":0.35299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.373,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.66700000000000004}]},{"osd":1,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0960000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77000000000000002,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":4.0759999999999996,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.92200000000000004}]},{"osd":2,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94799999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.624}]},{"osd":3,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.997,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.69399999999999995},"min":{"1min":0.48399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.53100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.75},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.63700000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.81699999999999995,"15min":0.81499999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.84399999999999997,"15min":0.82999999999999996},"min":{"1min":0.62,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.879},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.82699999999999996,"15min":0.81799999999999995},"min":{"1min":0.70799999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1200000000000001,"5min":1.155,"15min":1.155},"last":0.78600000000000003}]},{"osd":8,"last update":"Fri Jul 14 12:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.91300000000000003,"15min":0.92300000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.93700000000000006,"15min":0.95199999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.1879999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.82599999999999996}]},{"osd":9,"last update":"Fri Jul 14 12:56:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.69699999999999995}]},{"osd":10,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":4.109,"5min":4.109,"15min":4.109},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.84399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":477324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.49399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63600000000000001,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.67300000000000004,"15min":0.63100000000000001},"min":{"1min":0.58499999999999996,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.65800000000000003,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81799999999999995,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Jul 14 12:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.73199999999999998,"15min":0.70399999999999996},"min":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54200000000000004,"15min":0.52400000000000002},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51600000000000001,"15min":0.52000000000000002},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Jul 14 12:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68000000000000005,"15min":0.66400000000000003},"min":{"1min":0.46600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":1.115},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.72099999999999997,"15min":0.71199999999999997},"min":{"1min":0.54600000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88400000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.83799999999999997}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72499999999999998,"15min":0.70299999999999996},"min":{"1min":0.64000000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.036,"15min":1.036},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.81100000000000005,"15min":0.78600000000000003},"min":{"1min":0.66000000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.996}]},{"osd":7,"last update":"Fri Jul 14 12:57:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.64900000000000002,"15min":0.623},"min":{"1min":0.45100000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.1599999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80700000000000005,"15min":0.79200000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.236},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.88100000000000001,"15min":0.86499999999999999},"min":{"1min":0.63400000000000001,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.1319999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:56:57 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":1.0760000000000001}]},{"osd":10,"last update":"Fri Jul 14 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.91400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":442838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61099999999999999,"15min":0.59299999999999997},"min":{"1min":0.38500000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.622,"15min":0.58099999999999996},"min":{"1min":0.48099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri Jul 14 12:56:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.65200000000000002,"15min":0.622},"min":{"1min":0.53000000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.621},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97599999999999998,"5min":1.133,"15min":1.133},"last":0.83299999999999996}]},{"osd":3,"last update":"Fri Jul 14 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70799999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.57999999999999996,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0720000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69599999999999995,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.873,"5min":1.121,"15min":1.121},"last":0.627}]},{"osd":5,"last update":"Fri Jul 14 12:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.012,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.52500000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.66100000000000003,"15min":0.68500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.077},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94699999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.434}]},{"osd":7,"last update":"Fri Jul 14 12:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1200000000000001,"5min":1.155,"15min":1.155},"last":0.751},{"interface":"front","average":{"1min":0.873,"5min":0.79700000000000004,"15min":0.78400000000000003},"min":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.61799999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:57:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.879,"15min":0.88900000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1080000000000001,"5min":1.208,"15min":1.208},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.871,"15min":0.88300000000000001},"min":{"1min":0.57399999999999995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1699999999999999,"5min":1.48,"15min":1.48},"last":0.89900000000000002}]},{"osd":9,"last update":"Fri Jul 14 12:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.53700000000000003}]},{"osd":10,"last update":"Fri Jul 14 12:57:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.749}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":987136,"data_stored":478626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79700000000000004,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.373,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83299999999999996,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.60299999999999998}]},{"osd":1,"last update":"Fri Jul 14 12:56:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.48399999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.874,"5min":1.819,"15min":1.819},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.43099999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85299999999999998,"5min":1.841,"15min":1.841},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Jul 14 12:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.628},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94099999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.76800000000000002}]},{"osd":4,"last update":"Fri Jul 14 12:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66000000000000003,"15min":0.66300000000000003},"min":{"1min":0.55100000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.86499999999999999}]},{"osd":5,"last update":"Fri Jul 14 12:57:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.47799999999999998},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.97199999999999998}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73699999999999999,"15min":0.72799999999999998},"min":{"1min":0.57999999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.052},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":1.0429999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.69299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77800000000000002}]},{"osd":8,"last update":"Fri Jul 14 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.48799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.022}]},{"osd":9,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.998}]},{"osd":10,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.1060000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149753,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":942080,"data_stored":441559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.439,"15min":0.41899999999999998},"min":{"1min":0.378,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.64800000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.312},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.46000000000000002,"15min":0.442},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.33800000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.70799999999999996,"15min":0.66600000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":6.867,"5min":6.867,"15min":6.867},"last":0.629},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.73599999999999999,"15min":0.67300000000000004},"min":{"1min":0.46000000000000002,"5min":0.436,"15min":0.436},"max":{"1min":6.8860000000000001,"5min":6.8860000000000001,"15min":6.8860000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69199999999999995,"15min":0.67100000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93200000000000005,"5min":1.077,"15min":1.077},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.72599999999999998,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.436,"15min":0.436},"max":{"1min":6.9020000000000001,"5min":6.9020000000000001,"15min":6.9020000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:57:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.77900000000000003,"15min":0.71899999999999997},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":6.8419999999999996,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.70899999999999996},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.109,"5min":1.119,"15min":1.119},"last":0.73299999999999998}]},{"osd":5,"last update":"Fri Jul 14 12:57:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Jul 14 12:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69699999999999995,"15min":0.66100000000000003},"min":{"1min":0.56299999999999994,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0900000000000001,"5min":1.214,"15min":1.214},"last":0.435},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68899999999999995,"15min":0.66200000000000003},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.103,"15min":1.103},"last":0.40999999999999998}]},{"osd":7,"last update":"Fri Jul 14 12:57:04 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.77000000000000002,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.79000000000000004,"15min":0.77000000000000002},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.747}]},{"osd":8,"last update":"Fri Jul 14 12:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2010000000000001,"5min":1.206,"15min":1.206},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1859999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.80500000000000005}]},{"osd":9,"last update":"Fri Jul 14 12:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55200000000000005}]},{"osd":10,"last update":"Fri Jul 14 12:57:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.68500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":4,"up_from":34,"seq":146028888115,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":925696,"data_stored":441382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77600000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.35399999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.46800000000000003,"15min":0.45100000000000001},"min":{"1min":0.376,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.68999999999999995,"15min":0.67000000000000004},"min":{"1min":0.45500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.76600000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.45300000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.36099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.873}]},{"osd":5,"last update":"Fri Jul 14 12:57:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.54200000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0189999999999999,"5min":1.077,"15min":1.077},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.71099999999999997,"15min":0.69499999999999995},"min":{"1min":0.52900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.81599999999999995}]},{"osd":6,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77600000000000002,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93200000000000005,"5min":1.093,"15min":1.093},"last":1.022},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.042,"5min":1.282,"15min":1.282},"last":0.94299999999999995}]},{"osd":7,"last update":"Fri Jul 14 12:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0049999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.90100000000000002}]},{"osd":8,"last update":"Fri Jul 14 12:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0189999999999999,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85699999999999998,"15min":0.85899999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1259999999999999,"5min":1.234,"15min":1.234},"last":1.143}]},{"osd":9,"last update":"Fri Jul 14 12:56:54 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.105},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":1.0089999999999999}]},{"osd":10,"last update":"Fri Jul 14 12:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.069},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":1.04}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":999424,"data_stored":1033156,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.48799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77100000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.42599999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96399999999999997,"5min":0.997,"15min":0.997},"last":0.53900000000000003}]},{"osd":1,"last update":"Fri Jul 14 12:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.65000000000000002,"15min":0.61499999999999999},"min":{"1min":0.53900000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.63200000000000001,"15min":0.60399999999999998},"min":{"1min":0.47399999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Jul 14 12:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.35099999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76500000000000001,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.504},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.49199999999999999,"15min":0.47199999999999998},"min":{"1min":0.33400000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78100000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90100000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70799999999999996,"15min":0.70499999999999996},"min":{"1min":0.503,"5min":0.434,"15min":0.434},"max":{"1min":0.96099999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Jul 14 12:57:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69799999999999995,"15min":0.66000000000000003},"min":{"1min":0.623,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70999999999999996,"15min":0.69399999999999995},"min":{"1min":0.51400000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.014,"5min":1.139,"15min":1.139},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Jul 14 12:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76000000000000001,"15min":0.75700000000000001},"min":{"1min":0.56399999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98799999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.55400000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93300000000000005,"5min":1.28,"15min":1.28},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Jul 14 12:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.82199999999999995,"15min":0.82499999999999996},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.85199999999999998},"min":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91900000000000004,"5min":1.236,"15min":1.236},"last":0.746}]},{"osd":8,"last update":"Fri Jul 14 12:57:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98399999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.52900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.73499999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70999999999999996}]},{"osd":10,"last update":"Fri Jul 14 12:57:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.82199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34486,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":37539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:57:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T12:57:49.213 INFO:tasks.cephadm:Setting up client nodes... 2023-07-14T12:57:49.214 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-07-14T12:57:49.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:49 smithi017 ceph-mon[95536]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:57:49.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:49 smithi017 ceph-mon[95536]: pgmap v307: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.1 KiB/s wr, 15 op/s 2023-07-14T12:57:49.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:49 smithi135 ceph-mon[97338]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:57:49.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:49 smithi135 ceph-mon[97338]: pgmap v307: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.1 KiB/s wr, 15 op/s 2023-07-14T12:57:49.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:49 smithi131 ceph-mon[96953]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:57:49.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:49 smithi131 ceph-mon[96953]: pgmap v307: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.1 KiB/s wr, 15 op/s 2023-07-14T12:57:49.966 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:57:50.525 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:50 smithi017 ceph-mon[95536]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:57:50.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:50 smithi135 ceph-mon[97338]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:57:50.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:50 smithi131 ceph-mon[96953]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:57:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.594+0000 7fb7ffd98700 1 -- 172.21.15.17:0/1049363570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f8101740 msgr2=0x7fb7f8108000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:51.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.594+0000 7fb7ffd98700 1 --2- 172.21.15.17:0/1049363570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f8101740 0x7fb7f8108000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000b0a0 tx=0x7fb7f000b3b0 comp rx=0 tx=0).stop 2023-07-14T12:57:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.595+0000 7fb7ffd98700 1 -- 172.21.15.17:0/1049363570 shutdown_connections 2023-07-14T12:57:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.595+0000 7fb7ffd98700 1 --2- 172.21.15.17:0/1049363570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f8101740 0x7fb7f8108000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:51.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.595+0000 7fb7ffd98700 1 --2- 172.21.15.17:0/1049363570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7f80ffbb0 0x7fb7f80fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.595+0000 7fb7ffd98700 1 --2- 172.21.15.17:0/1049363570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f8100db0 0x7fb7f8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.595+0000 7fb7ffd98700 1 -- 172.21.15.17:0/1049363570 >> 172.21.15.17:0/1049363570 conn(0x7fb7f80fb200 msgr2=0x7fb7f80fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:51.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.595+0000 7fb7ffd98700 1 -- 172.21.15.17:0/1049363570 shutdown_connections 2023-07-14T12:57:51.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.595+0000 7fb7ffd98700 1 -- 172.21.15.17:0/1049363570 wait complete. 2023-07-14T12:57:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.596+0000 7fb7ffd98700 1 Processor -- start 2023-07-14T12:57:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.596+0000 7fb7ffd98700 1 -- start start 2023-07-14T12:57:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.596+0000 7fb7ffd98700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f80ffbb0 0x7fb7f80742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:51.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.596+0000 7fb7ffd98700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f8100db0 0x7fb7f8072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:51.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.596+0000 7fb7ffd98700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7f8101740 0x7fb7f8072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:51.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.596+0000 7fb7ffd98700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80735c0 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.596+0000 7fb7ffd98700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f8073730 con 0x7fb7f8100db0 2023-07-14T12:57:51.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.596+0000 7fb7ffd98700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f819f960 con 0x7fb7f8101740 2023-07-14T12:57:51.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.597+0000 7fb7fdb34700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f80ffbb0 0x7fb7f80742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:51.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.597+0000 7fb7fdb34700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f80ffbb0 0x7fb7f80742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48616/0 (socket says 172.21.15.17:48616) 2023-07-14T12:57:51.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.597+0000 7fb7fdb34700 1 -- 172.21.15.17:0/3407436180 learned_addr learned my addr 172.21.15.17:0/3407436180 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:51.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.597+0000 7fb7fd333700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f8100db0 0x7fb7f8072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:51.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.597+0000 7fb7fe335700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7f8101740 0x7fb7f8072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:51.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.597+0000 7fb7fdb34700 1 -- 172.21.15.17:0/3407436180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7f8101740 msgr2=0x7fb7f8072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:51.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.597+0000 7fb7fdb34700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7f8101740 0x7fb7f8072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:51.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.597+0000 7fb7fdb34700 1 -- 172.21.15.17:0/3407436180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f8100db0 msgr2=0x7fb7f8072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:51.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.597+0000 7fb7fdb34700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f8100db0 0x7fb7f8072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:51.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.597+0000 7fb7fdb34700 1 -- 172.21.15.17:0/3407436180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0009d00 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.597+0000 7fb7fdb34700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f80ffbb0 0x7fb7f80742b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400b500 tx=0x7fb7f400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:51.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.598+0000 7fb7eeffd700 1 -- 172.21.15.17:0/3407436180 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4011830 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.598+0000 7fb7eeffd700 1 -- 172.21.15.17:0/3407436180 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7f4011e20 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.598+0000 7fb7eeffd700 1 -- 172.21.15.17:0/3407436180 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4010cf0 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.598+0000 7fb7ffd98700 1 -- 172.21.15.17:0/3407436180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f819fc40 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.598+0000 7fb7ffd98700 1 -- 172.21.15.17:0/3407436180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f81a00f0 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.599+0000 7fb7ffd98700 1 -- 172.21.15.17:0/3407436180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f81070b0 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.601+0000 7fb7eeffd700 1 -- 172.21.15.17:0/3407436180 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fb7f4011990 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.602+0000 7fb7eeffd700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb7e40a1260 0x7fb7e40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.603+0000 7fb7eeffd700 1 -- 172.21.15.17:0/3407436180 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb7f40cc6a0 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.603+0000 7fb7fd333700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb7e40a1260 0x7fb7e40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:51.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.603+0000 7fb7fd333700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb7e40a1260 0x7fb7e40a3710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800ac50 tx=0x7fb7e800a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:51.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.604+0000 7fb7eeffd700 1 -- 172.21.15.17:0/3407436180 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb7f4095e50 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.889+0000 7fb7ffd98700 1 -- 172.21.15.17:0/3407436180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb7f802c8a0 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.895+0000 7fb7eeffd700 1 -- 172.21.15.17:0/3407436180 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb7f40150f0 con 0x7fb7f80ffbb0 2023-07-14T12:57:51.924 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2023-07-14T12:57:51.924 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBPRrFkeZY2NRAAkuBy576XrE5SXJhFt6R3JQ== 2023-07-14T12:57:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 -- 172.21.15.17:0/3407436180 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb7e40a1260 msgr2=0x7fb7e40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb7e40a1260 0x7fb7e40a3710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800ac50 tx=0x7fb7e800a380 comp rx=0 tx=0).stop 2023-07-14T12:57:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 -- 172.21.15.17:0/3407436180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f80ffbb0 msgr2=0x7fb7f80742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f80ffbb0 0x7fb7f80742b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400b500 tx=0x7fb7f400b810 comp rx=0 tx=0).stop 2023-07-14T12:57:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 -- 172.21.15.17:0/3407436180 shutdown_connections 2023-07-14T12:57:51.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb7e40a1260 0x7fb7e40a3710 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:51.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7f8101740 0x7fb7f8072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:51.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7f80ffbb0 0x7fb7f80742b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:51.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 --2- 172.21.15.17:0/3407436180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7f8100db0 0x7fb7f8072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:51.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 -- 172.21.15.17:0/3407436180 >> 172.21.15.17:0/3407436180 conn(0x7fb7f80fb200 msgr2=0x7fb7f81041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:51.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 -- 172.21.15.17:0/3407436180 shutdown_connections 2023-07-14T12:57:51.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:51.897+0000 7fb7ffd98700 1 -- 172.21.15.17:0/3407436180 wait complete. 2023-07-14T12:57:52.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:51 smithi135 ceph-mon[97338]: pgmap v308: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.1 KiB/s wr, 18 op/s 2023-07-14T12:57:52.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:51 smithi131 ceph-mon[96953]: pgmap v308: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.1 KiB/s wr, 18 op/s 2023-07-14T12:57:52.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:51 smithi017 ceph-mon[95536]: pgmap v308: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.1 KiB/s wr, 18 op/s 2023-07-14T12:57:52.547 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T12:57:52.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-07-14T12:57:52.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-14T12:57:52.651 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-14T12:57:52.652 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-07-14T12:57:52.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph mgr dump --format=json 2023-07-14T12:57:53.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:52 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3407436180' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-14T12:57:53.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:52 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3407436180' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-14T12:57:53.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:52 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3407436180' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-14T12:57:53.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:52 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3407436180' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-14T12:57:53.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:52 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3407436180' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-14T12:57:53.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:52 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3407436180' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-14T12:57:53.423 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:57:54.059 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:53 smithi017 ceph-mon[95536]: pgmap v309: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2023-07-14T12:57:54.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:53 smithi135 ceph-mon[97338]: pgmap v309: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2023-07-14T12:57:54.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:53 smithi131 ceph-mon[96953]: pgmap v309: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2023-07-14T12:57:54.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.944+0000 7f8e66ace700 1 -- 172.21.15.17:0/2471824574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e60104ea0 msgr2=0x7f8e6010ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:54.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.944+0000 7f8e66ace700 1 --2- 172.21.15.17:0/2471824574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e60104ea0 0x7f8e6010ca20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800b0d0 tx=0x7f8e5800b3e0 comp rx=0 tx=0).stop 2023-07-14T12:57:54.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.945+0000 7f8e66ace700 1 -- 172.21.15.17:0/2471824574 shutdown_connections 2023-07-14T12:57:54.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.945+0000 7f8e66ace700 1 --2- 172.21.15.17:0/2471824574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e60104ea0 0x7f8e6010ca20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:54.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.945+0000 7f8e66ace700 1 --2- 172.21.15.17:0/2471824574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e600ffe00 0x7f8e601001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:54.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.945+0000 7f8e66ace700 1 --2- 172.21.15.17:0/2471824574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e601007a0 0x7f8e60104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:54.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.945+0000 7f8e66ace700 1 -- 172.21.15.17:0/2471824574 >> 172.21.15.17:0/2471824574 conn(0x7f8e600fb660 msgr2=0x7f8e600fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:54.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.945+0000 7f8e66ace700 1 -- 172.21.15.17:0/2471824574 shutdown_connections 2023-07-14T12:57:54.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.945+0000 7f8e66ace700 1 -- 172.21.15.17:0/2471824574 wait complete. 2023-07-14T12:57:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.946+0000 7f8e66ace700 1 Processor -- start 2023-07-14T12:57:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.946+0000 7f8e66ace700 1 -- start start 2023-07-14T12:57:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.946+0000 7f8e66ace700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e600ffe00 0x7f8e60195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.946+0000 7f8e66ace700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e601007a0 0x7f8e601962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:54.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.946+0000 7f8e66ace700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e60104ea0 0x7f8e6019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.946+0000 7f8e66ace700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6019ad20 con 0x7f8e60104ea0 2023-07-14T12:57:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.946+0000 7f8e66ace700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6019ae90 con 0x7f8e601007a0 2023-07-14T12:57:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.946+0000 7f8e66ace700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6019b050 con 0x7f8e600ffe00 2023-07-14T12:57:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.947+0000 7f8e6506b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e60104ea0 0x7f8e6019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.947+0000 7f8e6506b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e60104ea0 0x7f8e6019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39922/0 (socket says 172.21.15.17:39922) 2023-07-14T12:57:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.947+0000 7f8e6506b700 1 -- 172.21.15.17:0/768012095 learned_addr learned my addr 172.21.15.17:0/768012095 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.947+0000 7f8e6486a700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e600ffe00 0x7f8e60195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:54.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.947+0000 7f8e5ffff700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e601007a0 0x7f8e601962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.947+0000 7f8e6506b700 1 -- 172.21.15.17:0/768012095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e600ffe00 msgr2=0x7f8e60195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.947+0000 7f8e6506b700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e600ffe00 0x7f8e60195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.947+0000 7f8e6506b700 1 -- 172.21.15.17:0/768012095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e601007a0 msgr2=0x7f8e601962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.947+0000 7f8e6506b700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e601007a0 0x7f8e601962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.947+0000 7f8e6506b700 1 -- 172.21.15.17:0/768012095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58009d00 con 0x7f8e60104ea0 2023-07-14T12:57:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.947+0000 7f8e6506b700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e60104ea0 0x7f8e6019a710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009300 tx=0x7f8e58009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:54.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.948+0000 7f8e5dffb700 1 -- 172.21.15.17:0/768012095 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800e040 con 0x7f8e60104ea0 2023-07-14T12:57:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.948+0000 7f8e66ace700 1 -- 172.21.15.17:0/768012095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6019b2d0 con 0x7f8e60104ea0 2023-07-14T12:57:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.948+0000 7f8e5dffb700 1 -- 172.21.15.17:0/768012095 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e58003e10 con 0x7f8e60104ea0 2023-07-14T12:57:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.948+0000 7f8e5dffb700 1 -- 172.21.15.17:0/768012095 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5801b8e0 con 0x7f8e60104ea0 2023-07-14T12:57:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.948+0000 7f8e66ace700 1 -- 172.21.15.17:0/768012095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e601a2b90 con 0x7f8e60104ea0 2023-07-14T12:57:54.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.949+0000 7f8e66ace700 1 -- 172.21.15.17:0/768012095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6004e210 con 0x7f8e60104ea0 2023-07-14T12:57:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.951+0000 7f8e5dffb700 1 -- 172.21.15.17:0/768012095 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8e5801ba40 con 0x7f8e60104ea0 2023-07-14T12:57:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.952+0000 7f8e5dffb700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8e500a1260 0x7f8e500a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:54.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.952+0000 7f8e5dffb700 1 -- 172.21.15.17:0/768012095 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8e580ce480 con 0x7f8e60104ea0 2023-07-14T12:57:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.953+0000 7f8e6486a700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8e500a1260 0x7f8e500a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:54.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.953+0000 7f8e6486a700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8e500a1260 0x7f8e500a3710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8e54007be0 tx=0x7f8e540073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:54.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:54.954+0000 7f8e5dffb700 1 -- 172.21.15.17:0/768012095 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8e58097bb0 con 0x7f8e60104ea0 2023-07-14T12:57:55.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.219+0000 7f8e66ace700 1 -- 172.21.15.17:0/768012095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8e601a2d20 con 0x7f8e60104ea0 2023-07-14T12:57:55.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.224+0000 7f8e5dffb700 1 -- 172.21.15.17:0/768012095 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260124 (secure 0 0 0) 0x7f8e5809b1d0 con 0x7f8e60104ea0 2023-07-14T12:57:55.259 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.228+0000 7f8e66ace700 1 -- 172.21.15.17:0/768012095 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8e500a1260 msgr2=0x7f8e500a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.228+0000 7f8e66ace700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8e500a1260 0x7f8e500a3710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8e54007be0 tx=0x7f8e540073d0 comp rx=0 tx=0).stop 2023-07-14T12:57:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.228+0000 7f8e66ace700 1 -- 172.21.15.17:0/768012095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e60104ea0 msgr2=0x7f8e6019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.229+0000 7f8e66ace700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e60104ea0 0x7f8e6019a710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009300 tx=0x7f8e58009330 comp rx=0 tx=0).stop 2023-07-14T12:57:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.229+0000 7f8e66ace700 1 -- 172.21.15.17:0/768012095 shutdown_connections 2023-07-14T12:57:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.229+0000 7f8e66ace700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8e500a1260 0x7f8e500a3710 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.229+0000 7f8e66ace700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e60104ea0 0x7f8e6019a710 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.229+0000 7f8e66ace700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e600ffe00 0x7f8e60195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.229+0000 7f8e66ace700 1 --2- 172.21.15.17:0/768012095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e601007a0 0x7f8e601962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:55.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.229+0000 7f8e66ace700 1 -- 172.21.15.17:0/768012095 >> 172.21.15.17:0/768012095 conn(0x7f8e600fb660 msgr2=0x7f8e600fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:55.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.229+0000 7f8e66ace700 1 -- 172.21.15.17:0/768012095 shutdown_connections 2023-07-14T12:57:55.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:55.229+0000 7f8e66ace700 1 -- 172.21.15.17:0/768012095 wait complete. 2023-07-14T12:57:55.908 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":2034486077},{"type":"v1","addr":"172.21.15.17:6801","nonce":2034486077}]},"active_addr":"172.21.15.17:6801/2034486077","active_change":"2023-07-14T12:50:06.735038+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24121,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.17:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1809272973}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1285371613}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":895305494}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":645612714}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3432176096}]}]} 2023-07-14T12:57:55.918 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-07-14T12:57:55.919 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-07-14T12:57:55.919 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd dump --format=json 2023-07-14T12:57:56.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:55 smithi135 ceph-mon[97338]: pgmap v310: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2023-07-14T12:57:56.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:55 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/768012095' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-14T12:57:56.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:55 smithi131 ceph-mon[96953]: pgmap v310: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2023-07-14T12:57:56.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:55 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/768012095' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-14T12:57:56.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:55 smithi017 ceph-mon[95536]: pgmap v310: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.8 KiB/s wr, 16 op/s 2023-07-14T12:57:56.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:55 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/768012095' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-14T12:57:56.656 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:57:58.041 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:57 smithi017 ceph-mon[95536]: pgmap v311: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.3 KiB/s wr, 13 op/s 2023-07-14T12:57:58.196 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:57 smithi135 ceph-mon[97338]: pgmap v311: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.3 KiB/s wr, 13 op/s 2023-07-14T12:57:58.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:57 smithi131 ceph-mon[96953]: pgmap v311: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.3 KiB/s wr, 13 op/s 2023-07-14T12:57:58.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.409+0000 7efe56366700 1 -- 172.21.15.17:0/643594004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe500ffe00 msgr2=0x7efe501001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:58.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.409+0000 7efe56366700 1 --2- 172.21.15.17:0/643594004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe500ffe00 0x7efe501001d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe400099c0 tx=0x7efe40009cd0 comp rx=0 tx=0).stop 2023-07-14T12:57:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.409+0000 7efe56366700 1 -- 172.21.15.17:0/643594004 shutdown_connections 2023-07-14T12:57:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.409+0000 7efe56366700 1 --2- 172.21.15.17:0/643594004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe50104ea0 0x7efe5010ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.409+0000 7efe56366700 1 --2- 172.21.15.17:0/643594004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe500ffe00 0x7efe501001d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.409+0000 7efe56366700 1 --2- 172.21.15.17:0/643594004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe501007a0 0x7efe50104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.409+0000 7efe56366700 1 -- 172.21.15.17:0/643594004 >> 172.21.15.17:0/643594004 conn(0x7efe500fb660 msgr2=0x7efe500fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.409+0000 7efe56366700 1 -- 172.21.15.17:0/643594004 shutdown_connections 2023-07-14T12:57:58.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.409+0000 7efe56366700 1 -- 172.21.15.17:0/643594004 wait complete. 2023-07-14T12:57:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.410+0000 7efe56366700 1 Processor -- start 2023-07-14T12:57:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.410+0000 7efe56366700 1 -- start start 2023-07-14T12:57:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.411+0000 7efe56366700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe500ffe00 0x7efe5019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.411+0000 7efe56366700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe501007a0 0x7efe5019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:58.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.411+0000 7efe56366700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe50104ea0 0x7efe50195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.411+0000 7efe56366700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe50196000 con 0x7efe500ffe00 2023-07-14T12:57:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.411+0000 7efe56366700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe50196170 con 0x7efe501007a0 2023-07-14T12:57:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.411+0000 7efe56366700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe50196330 con 0x7efe50104ea0 2023-07-14T12:57:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.411+0000 7efe4ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe500ffe00 0x7efe5019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.411+0000 7efe4ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe500ffe00 0x7efe5019b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39944/0 (socket says 172.21.15.17:39944) 2023-07-14T12:57:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.411+0000 7efe4ffff700 1 -- 172.21.15.17:0/2575172811 learned_addr learned my addr 172.21.15.17:0/2575172811 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:57:58.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.411+0000 7efe4f7fe700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe501007a0 0x7efe5019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:58.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe54903700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe50104ea0 0x7efe50195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:58.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe4ffff700 1 -- 172.21.15.17:0/2575172811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe50104ea0 msgr2=0x7efe50195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:58.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe4ffff700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe50104ea0 0x7efe50195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:58.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe4ffff700 1 -- 172.21.15.17:0/2575172811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe501007a0 msgr2=0x7efe5019be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:58.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe4ffff700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe501007a0 0x7efe5019be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:58.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe4ffff700 1 -- 172.21.15.17:0/2575172811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe400095f0 con 0x7efe500ffe00 2023-07-14T12:57:58.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe4ffff700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe500ffe00 0x7efe5019b910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efe40009f50 tx=0x7efe40005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:58.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe4d7fa700 1 -- 172.21.15.17:0/2575172811 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4001d070 con 0x7efe500ffe00 2023-07-14T12:57:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe4d7fa700 1 -- 172.21.15.17:0/2575172811 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe40003fc0 con 0x7efe500ffe00 2023-07-14T12:57:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe56366700 1 -- 172.21.15.17:0/2575172811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe501965b0 con 0x7efe500ffe00 2023-07-14T12:57:58.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe4d7fa700 1 -- 172.21.15.17:0/2575172811 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40022ca0 con 0x7efe500ffe00 2023-07-14T12:57:58.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.412+0000 7efe56366700 1 -- 172.21.15.17:0/2575172811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe501a2900 con 0x7efe500ffe00 2023-07-14T12:57:58.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.414+0000 7efe56366700 1 -- 172.21.15.17:0/2575172811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5004e210 con 0x7efe500ffe00 2023-07-14T12:57:58.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.415+0000 7efe4d7fa700 1 -- 172.21.15.17:0/2575172811 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7efe40022470 con 0x7efe500ffe00 2023-07-14T12:57:58.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.417+0000 7efe4d7fa700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efe380a11e0 0x7efe380a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:57:58.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.417+0000 7efe4d7fa700 1 -- 172.21.15.17:0/2575172811 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efe400cded0 con 0x7efe500ffe00 2023-07-14T12:57:58.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.417+0000 7efe4f7fe700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efe380a11e0 0x7efe380a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:57:58.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.418+0000 7efe4f7fe700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efe380a11e0 0x7efe380a3690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe500feb50 tx=0x7efe4400a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:57:58.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.421+0000 7efe4d7fa700 1 -- 172.21.15.17:0/2575172811 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7efe40097600 con 0x7efe500ffe00 2023-07-14T12:57:58.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.625+0000 7efe56366700 1 -- 172.21.15.17:0/2575172811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe50196ea0 con 0x7efe500ffe00 2023-07-14T12:57:58.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.627+0000 7efe4d7fa700 1 -- 172.21.15.17:0/2575172811 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22119 (secure 0 0 0) 0x7efe4009ac20 con 0x7efe500ffe00 2023-07-14T12:57:58.656 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:57:58.656 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:57:41.139773+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:57:58.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.629+0000 7efe56366700 1 -- 172.21.15.17:0/2575172811 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efe380a11e0 msgr2=0x7efe380a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:58.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.629+0000 7efe56366700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efe380a11e0 0x7efe380a3690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe500feb50 tx=0x7efe4400a380 comp rx=0 tx=0).stop 2023-07-14T12:57:58.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.629+0000 7efe56366700 1 -- 172.21.15.17:0/2575172811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe500ffe00 msgr2=0x7efe5019b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:57:58.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.629+0000 7efe56366700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe500ffe00 0x7efe5019b910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efe40009f50 tx=0x7efe40005740 comp rx=0 tx=0).stop 2023-07-14T12:57:58.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.629+0000 7efe56366700 1 -- 172.21.15.17:0/2575172811 shutdown_connections 2023-07-14T12:57:58.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.629+0000 7efe56366700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7efe380a11e0 0x7efe380a3690 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:58.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.629+0000 7efe56366700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe50104ea0 0x7efe50195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:58.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.629+0000 7efe56366700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe500ffe00 0x7efe5019b910 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:58.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.629+0000 7efe56366700 1 --2- 172.21.15.17:0/2575172811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe501007a0 0x7efe5019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:57:58.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.629+0000 7efe56366700 1 -- 172.21.15.17:0/2575172811 >> 172.21.15.17:0/2575172811 conn(0x7efe500fb660 msgr2=0x7efe500fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:57:58.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.629+0000 7efe56366700 1 -- 172.21.15.17:0/2575172811 shutdown_connections 2023-07-14T12:57:58.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:57:58.630+0000 7efe56366700 1 -- 172.21.15.17:0/2575172811 wait complete. 2023-07-14T12:57:59.131 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-07-14T12:57:59.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd dump --format=json 2023-07-14T12:57:59.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:58 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2575172811' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:59.199 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:58 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2575172811' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:59.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:58 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2575172811' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:57:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:00.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:57:59 smithi135 ceph-mon[97338]: pgmap v312: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2023-07-14T12:58:00.200 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:57:59 smithi017 ceph-mon[95536]: pgmap v312: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2023-07-14T12:58:00.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:57:59 smithi131 ceph-mon[96953]: pgmap v312: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.3 KiB/s wr, 11 op/s 2023-07-14T12:58:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.551+0000 7fed08288700 1 -- 172.21.15.17:0/2518133749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed000ffe00 msgr2=0x7fed001001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.551+0000 7fed08288700 1 --2- 172.21.15.17:0/2518133749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed000ffe00 0x7fed001001d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0099c0 tx=0x7fecfc009cd0 comp rx=0 tx=0).stop 2023-07-14T12:58:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.552+0000 7fed08288700 1 -- 172.21.15.17:0/2518133749 shutdown_connections 2023-07-14T12:58:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.552+0000 7fed08288700 1 --2- 172.21.15.17:0/2518133749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed00104ea0 0x7fed0010ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.552+0000 7fed08288700 1 --2- 172.21.15.17:0/2518133749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed000ffe00 0x7fed001001d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.552+0000 7fed08288700 1 --2- 172.21.15.17:0/2518133749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed001007a0 0x7fed00104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.552+0000 7fed08288700 1 -- 172.21.15.17:0/2518133749 >> 172.21.15.17:0/2518133749 conn(0x7fed000fb660 msgr2=0x7fed000fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.552+0000 7fed08288700 1 -- 172.21.15.17:0/2518133749 shutdown_connections 2023-07-14T12:58:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.552+0000 7fed08288700 1 -- 172.21.15.17:0/2518133749 wait complete. 2023-07-14T12:58:01.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.553+0000 7fed08288700 1 Processor -- start 2023-07-14T12:58:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.553+0000 7fed08288700 1 -- start start 2023-07-14T12:58:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.553+0000 7fed08288700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed000ffe00 0x7fed00197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.553+0000 7fed08288700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed001007a0 0x7fed00198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.553+0000 7fed08288700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed00104ea0 0x7fed0019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.553+0000 7fed08288700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0019cce0 con 0x7fed001007a0 2023-07-14T12:58:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.553+0000 7fed08288700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0019ce50 con 0x7fed000ffe00 2023-07-14T12:58:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.553+0000 7fed08288700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0019d010 con 0x7fed00104ea0 2023-07-14T12:58:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.553+0000 7fed05823700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed001007a0 0x7fed00198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed05823700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed001007a0 0x7fed00198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39954/0 (socket says 172.21.15.17:39954) 2023-07-14T12:58:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed05823700 1 -- 172.21.15.17:0/342970495 learned_addr learned my addr 172.21.15.17:0/342970495 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed06825700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed00104ea0 0x7fed0019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed06024700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed000ffe00 0x7fed00197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed05823700 1 -- 172.21.15.17:0/342970495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed00104ea0 msgr2=0x7fed0019c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed05823700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed00104ea0 0x7fed0019c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed05823700 1 -- 172.21.15.17:0/342970495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed000ffe00 msgr2=0x7fed00197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed05823700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed000ffe00 0x7fed00197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed05823700 1 -- 172.21.15.17:0/342970495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0095f0 con 0x7fed001007a0 2023-07-14T12:58:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed06024700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed000ffe00 0x7fed00197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:58:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed05823700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed001007a0 0x7fed00198260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fecf000d950 tx=0x7fecf000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fecf77fe700 1 -- 172.21.15.17:0/342970495 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf000bb60 con 0x7fed001007a0 2023-07-14T12:58:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fecf77fe700 1 -- 172.21.15.17:0/342970495 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecf0007620 con 0x7fed001007a0 2023-07-14T12:58:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.554+0000 7fed08288700 1 -- 172.21.15.17:0/342970495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0019d2f0 con 0x7fed001007a0 2023-07-14T12:58:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.555+0000 7fecf77fe700 1 -- 172.21.15.17:0/342970495 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00053e0 con 0x7fed001007a0 2023-07-14T12:58:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.555+0000 7fed08288700 1 -- 172.21.15.17:0/342970495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed001a4b50 con 0x7fed001007a0 2023-07-14T12:58:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.556+0000 7fed08288700 1 -- 172.21.15.17:0/342970495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0004e210 con 0x7fed001007a0 2023-07-14T12:58:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.558+0000 7fecf77fe700 1 -- 172.21.15.17:0/342970495 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fecf0005540 con 0x7fed001007a0 2023-07-14T12:58:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.559+0000 7fecf77fe700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fecec0a11e0 0x7fecec0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.559+0000 7fecf77fe700 1 -- 172.21.15.17:0/342970495 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fecf00cc380 con 0x7fed001007a0 2023-07-14T12:58:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.559+0000 7fed06024700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fecec0a11e0 0x7fecec0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.560+0000 7fed06024700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fecec0a11e0 0x7fecec0a3690 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fecfc006010 tx=0x7fecfc003680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.563+0000 7fecf77fe700 1 -- 172.21.15.17:0/342970495 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fecf0095a20 con 0x7fed001007a0 2023-07-14T12:58:01.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.769+0000 7fed08288700 1 -- 172.21.15.17:0/342970495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed00199080 con 0x7fed001007a0 2023-07-14T12:58:01.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.770+0000 7fecf77fe700 1 -- 172.21.15.17:0/342970495 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22119 (secure 0 0 0) 0x7fecf0099040 con 0x7fed001007a0 2023-07-14T12:58:01.800 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:58:01.801 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":86,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:57:41.139773+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:58:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 -- 172.21.15.17:0/342970495 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fecec0a11e0 msgr2=0x7fecec0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:01.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fecec0a11e0 0x7fecec0a3690 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fecfc006010 tx=0x7fecfc003680 comp rx=0 tx=0).stop 2023-07-14T12:58:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 -- 172.21.15.17:0/342970495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed001007a0 msgr2=0x7fed00198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed001007a0 0x7fed00198260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fecf000d950 tx=0x7fecf000dd10 comp rx=0 tx=0).stop 2023-07-14T12:58:01.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 -- 172.21.15.17:0/342970495 shutdown_connections 2023-07-14T12:58:01.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fecec0a11e0 0x7fecec0a3690 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:01.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed00104ea0 0x7fed0019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:01.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed000ffe00 0x7fed00197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:01.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 --2- 172.21.15.17:0/342970495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed001007a0 0x7fed00198260 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:01.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 -- 172.21.15.17:0/342970495 >> 172.21.15.17:0/342970495 conn(0x7fed000fb660 msgr2=0x7fed00101740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:01.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 -- 172.21.15.17:0/342970495 shutdown_connections 2023-07-14T12:58:01.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:01.773+0000 7fed08288700 1 -- 172.21.15.17:0/342970495 wait complete. 2023-07-14T12:58:02.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:01 smithi017 ceph-mon[95536]: pgmap v313: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2023-07-14T12:58:02.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:01 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/342970495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:02.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:01 smithi135 ceph-mon[97338]: pgmap v313: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2023-07-14T12:58:02.197 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:01 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/342970495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:02.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:01 smithi131 ceph-mon[96953]: pgmap v313: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2023-07-14T12:58:02.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:01 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/342970495' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:02.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2023-07-14T12:58:02.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2023-07-14T12:58:02.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2023-07-14T12:58:02.352 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2023-07-14T12:58:02.353 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2023-07-14T12:58:02.353 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2023-07-14T12:58:02.354 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2023-07-14T12:58:02.354 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2023-07-14T12:58:02.355 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2023-07-14T12:58:02.355 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2023-07-14T12:58:02.356 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2023-07-14T12:58:02.356 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2023-07-14T12:58:04.196 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:04.217 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:04.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:03 smithi131 ceph-mon[96953]: pgmap v314: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2023-07-14T12:58:04.247 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:04.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:03 smithi017 ceph-mon[95536]: pgmap v314: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2023-07-14T12:58:04.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:03 smithi135 ceph-mon[97338]: pgmap v314: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2023-07-14T12:58:04.460 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:04.460 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:04.578 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:04.666 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:05.315 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:05.316 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:06.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:05 smithi017 ceph-mon[95536]: pgmap v315: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-07-14T12:58:06.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:05 smithi131 ceph-mon[96953]: pgmap v315: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-07-14T12:58:06.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:05 smithi135 ceph-mon[97338]: pgmap v315: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-07-14T12:58:07.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-07-14T12:58:07.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2023-07-14T12:58:07.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-07-14T12:58:07.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2023-07-14T12:58:07.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8, 5, 9]}]: dispatch 2023-07-14T12:58:07.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-07-14T12:58:07.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:06 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2023-07-14T12:58:07.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:06 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-07-14T12:58:07.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:06 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2023-07-14T12:58:07.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:06 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-07-14T12:58:07.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:06 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2023-07-14T12:58:07.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:06 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8, 5, 9]}]: dispatch 2023-07-14T12:58:07.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:06 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-07-14T12:58:07.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:06 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2023-07-14T12:58:07.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:06 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-07-14T12:58:07.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:06 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2023-07-14T12:58:07.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:06 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-07-14T12:58:07.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:06 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2023-07-14T12:58:07.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:06 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8, 5, 9]}]: dispatch 2023-07-14T12:58:07.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:06 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-07-14T12:58:07.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:06 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2023-07-14T12:58:08.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:07 smithi017 ceph-mon[95536]: pgmap v316: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-07-14T12:58:08.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-07-14T12:58:08.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2023-07-14T12:58:08.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-07-14T12:58:08.164 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2023-07-14T12:58:08.164 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8, 5, 9]}]': finished 2023-07-14T12:58:08.164 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-07-14T12:58:08.164 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:07 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2023-07-14T12:58:08.164 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:07 smithi017 ceph-mon[95536]: osdmap e87: 12 total, 12 up, 12 in 2023-07-14T12:58:08.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:07 smithi131 ceph-mon[96953]: pgmap v316: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-07-14T12:58:08.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-07-14T12:58:08.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2023-07-14T12:58:08.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-07-14T12:58:08.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2023-07-14T12:58:08.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8, 5, 9]}]': finished 2023-07-14T12:58:08.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-07-14T12:58:08.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:07 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2023-07-14T12:58:08.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:07 smithi131 ceph-mon[96953]: osdmap e87: 12 total, 12 up, 12 in 2023-07-14T12:58:08.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:07 smithi135 ceph-mon[97338]: pgmap v316: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2023-07-14T12:58:08.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-07-14T12:58:08.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2023-07-14T12:58:08.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-07-14T12:58:08.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2023-07-14T12:58:08.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8, 5, 9]}]': finished 2023-07-14T12:58:08.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-07-14T12:58:08.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:07 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2023-07-14T12:58:08.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:07 smithi135 ceph-mon[97338]: osdmap e87: 12 total, 12 up, 12 in 2023-07-14T12:58:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.981+0000 7fc22c53e700 1 -- 172.21.15.17:0/2939123692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2241007a0 msgr2=0x7fc224104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.981+0000 7fc22c53e700 1 --2- 172.21.15.17:0/2939123692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2241007a0 0x7fc224104770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc2140099c0 tx=0x7fc214009cd0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.981+0000 7fc22c53e700 1 -- 172.21.15.17:0/2939123692 shutdown_connections 2023-07-14T12:58:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.982+0000 7fc22c53e700 1 --2- 172.21.15.17:0/2939123692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc224104ea0 0x7fc22410ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.982+0000 7fc22c53e700 1 --2- 172.21.15.17:0/2939123692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2240ffe00 0x7fc2241001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.982+0000 7fc22c53e700 1 --2- 172.21.15.17:0/2939123692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2241007a0 0x7fc224104770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.982+0000 7fc22c53e700 1 -- 172.21.15.17:0/2939123692 >> 172.21.15.17:0/2939123692 conn(0x7fc2240fb660 msgr2=0x7fc2240fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.982+0000 7fc22c53e700 1 -- 172.21.15.17:0/2939123692 shutdown_connections 2023-07-14T12:58:09.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.982+0000 7fc22c53e700 1 -- 172.21.15.17:0/2939123692 wait complete. 2023-07-14T12:58:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.983+0000 7fc22c53e700 1 Processor -- start 2023-07-14T12:58:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.983+0000 7fc22c53e700 1 -- start start 2023-07-14T12:58:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.983+0000 7fc22c53e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2240ffe00 0x7fc224072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.983+0000 7fc22c53e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2241007a0 0x7fc224072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.983+0000 7fc22c53e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc224104ea0 0x7fc2240732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.983+0000 7fc22c53e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241a40d0 con 0x7fc2241007a0 2023-07-14T12:58:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.983+0000 7fc22c53e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241a4240 con 0x7fc2240ffe00 2023-07-14T12:58:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.983+0000 7fc22c53e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2241a4400 con 0x7fc224104ea0 2023-07-14T12:58:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.984+0000 7fc22aadb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc224104ea0 0x7fc2240732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.984+0000 7fc22a2da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2240ffe00 0x7fc224072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.984+0000 7fc22a2da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2240ffe00 0x7fc224072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:43882/0 (socket says 172.21.15.17:43882) 2023-07-14T12:58:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.984+0000 7fc22aadb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc224104ea0 0x7fc2240732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39506/0 (socket says 172.21.15.17:39506) 2023-07-14T12:58:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.984+0000 7fc22a2da700 1 -- 172.21.15.17:0/2142973165 learned_addr learned my addr 172.21.15.17:0/2142973165 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:09.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.984+0000 7fc22a2da700 1 -- 172.21.15.17:0/2142973165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc224104ea0 msgr2=0x7fc2240732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.984+0000 7fc22a2da700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc224104ea0 0x7fc2240732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.984+0000 7fc22a2da700 1 -- 172.21.15.17:0/2142973165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2241007a0 msgr2=0x7fc224072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.984+0000 7fc22a2da700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2241007a0 0x7fc224072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.984+0000 7fc22a2da700 1 -- 172.21.15.17:0/2142973165 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2140095f0 con 0x7fc2240ffe00 2023-07-14T12:58:09.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.985+0000 7fc22a2da700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2240ffe00 0x7fc224072810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc22000e9a0 tx=0x7fc22000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.985+0000 7fc21b7fe700 1 -- 172.21.15.17:0/2142973165 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220009790 con 0x7fc2240ffe00 2023-07-14T12:58:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.985+0000 7fc21b7fe700 1 -- 172.21.15.17:0/2142973165 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc22000cbd0 con 0x7fc2240ffe00 2023-07-14T12:58:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.985+0000 7fc21b7fe700 1 -- 172.21.15.17:0/2142973165 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220018680 con 0x7fc2240ffe00 2023-07-14T12:58:09.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.985+0000 7fc22c53e700 1 -- 172.21.15.17:0/2142973165 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2241a46e0 con 0x7fc2240ffe00 2023-07-14T12:58:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.985+0000 7fc22c53e700 1 -- 172.21.15.17:0/2142973165 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2241a4b90 con 0x7fc2240ffe00 2023-07-14T12:58:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.987+0000 7fc22c53e700 1 -- 172.21.15.17:0/2142973165 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc22410fc70 con 0x7fc2240ffe00 2023-07-14T12:58:09.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.989+0000 7fc21b7fe700 1 -- 172.21.15.17:0/2142973165 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc22000cd40 con 0x7fc2240ffe00 2023-07-14T12:58:09.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.990+0000 7fc21b7fe700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc2100a12a0 0x7fc2100a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:09.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.990+0000 7fc21b7fe700 1 -- 172.21.15.17:0/2142973165 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fc220014070 con 0x7fc2240ffe00 2023-07-14T12:58:09.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.991+0000 7fc229ad9700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc2100a12a0 0x7fc2100a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:09.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.991+0000 7fc21b7fe700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229] conn(0x7fc2100aad50 0x7fc2100ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.991+0000 7fc21b7fe700 1 -- 172.21.15.17:0/2142973165 --> [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2100ad8b0 con 0x7fc2100aad50 2023-07-14T12:58:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.991+0000 7fc21b7fe700 1 -- 172.21.15.17:0/2142973165 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2200d12a0 con 0x7fc2240ffe00 2023-07-14T12:58:09.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.991+0000 7fc229ad9700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc2100a12a0 0x7fc2100a3750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc214009fd0 tx=0x7fc214000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:09.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.991+0000 7fc22aadb700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229] conn(0x7fc2100aad50 0x7fc2100ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:09.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.992+0000 7fc22aadb700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229] conn(0x7fc2100aad50 0x7fc2100ad1e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:09.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:08.993+0000 7fc21b7fe700 1 -- 172.21.15.17:0/2142973165 <== osd.5 v2:172.21.15.135:6808/494689229 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc2100ad8b0 con 0x7fc2100aad50 2023-07-14T12:58:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.012+0000 7fc22c53e700 1 -- 172.21.15.17:0/2142973165 --> [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc22404e210 con 0x7fc2100aad50 2023-07-14T12:58:09.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.013+0000 7fc21b7fe700 1 -- 172.21.15.17:0/2142973165 <== osd.5 v2:172.21.15.135:6808/494689229 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc22404e210 con 0x7fc2100aad50 2023-07-14T12:58:09.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.014+0000 7fc22c53e700 1 -- 172.21.15.17:0/2142973165 >> [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229] conn(0x7fc2100aad50 msgr2=0x7fc2100ad1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.014+0000 7fc22c53e700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229] conn(0x7fc2100aad50 0x7fc2100ad1e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.014+0000 7fc22c53e700 1 -- 172.21.15.17:0/2142973165 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc2100a12a0 msgr2=0x7fc2100a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.014+0000 7fc22c53e700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc2100a12a0 0x7fc2100a3750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc214009fd0 tx=0x7fc214000bc0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.014+0000 7fc22c53e700 1 -- 172.21.15.17:0/2142973165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2240ffe00 msgr2=0x7fc224072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.014+0000 7fc22c53e700 1 --2- 172.21.15.17:0/2142973165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2240ffe00 0x7fc224072810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc22000e9a0 tx=0x7fc22000ecb0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.014+0000 7fc22aadb700 1 -- 172.21.15.17:0/2142973165 reap_dead start 2023-07-14T12:58:09.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.014+0000 7fc22c53e700 1 -- 172.21.15.17:0/2142973165 shutdown_connections 2023-07-14T12:58:09.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.014+0000 7fc22c53e700 1 -- 172.21.15.17:0/2142973165 >> 172.21.15.17:0/2142973165 conn(0x7fc2240fb660 msgr2=0x7fc2240fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:09.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.014+0000 7fc22c53e700 1 -- 172.21.15.17:0/2142973165 shutdown_connections 2023-07-14T12:58:09.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.014+0000 7fc22c53e700 1 -- 172.21.15.17:0/2142973165 wait complete. 2023-07-14T12:58:09.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:08 smithi017 ceph-mon[95536]: osdmap e88: 12 total, 12 up, 12 in 2023-07-14T12:58:09.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:08 smithi131 ceph-mon[96953]: osdmap e88: 12 total, 12 up, 12 in 2023-07-14T12:58:09.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:08 smithi135 ceph-mon[97338]: osdmap e88: 12 total, 12 up, 12 in 2023-07-14T12:58:09.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.877+0000 7f20b3910700 1 -- 172.21.15.17:0/1168765032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac1007b0 msgr2=0x7f20ac104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.877+0000 7f20b3910700 1 --2- 172.21.15.17:0/1168765032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac1007b0 0x7f20ac104780 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f209c0099c0 tx=0x7f209c009cd0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.877+0000 7f20b3910700 1 -- 172.21.15.17:0/1168765032 shutdown_connections 2023-07-14T12:58:09.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.877+0000 7f20b3910700 1 --2- 172.21.15.17:0/1168765032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ac104eb0 0x7f20ac10ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.877+0000 7f20b3910700 1 --2- 172.21.15.17:0/1168765032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20ac0ffe10 0x7f20ac1001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.877+0000 7f20b3910700 1 --2- 172.21.15.17:0/1168765032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac1007b0 0x7f20ac104780 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.877+0000 7f20b3910700 1 -- 172.21.15.17:0/1168765032 >> 172.21.15.17:0/1168765032 conn(0x7f20ac0fb690 msgr2=0x7f20ac0fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.877+0000 7f20b3910700 1 -- 172.21.15.17:0/1168765032 shutdown_connections 2023-07-14T12:58:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.877+0000 7f20b3910700 1 -- 172.21.15.17:0/1168765032 wait complete. 2023-07-14T12:58:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.878+0000 7f20b3910700 1 Processor -- start 2023-07-14T12:58:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.878+0000 7f20b3910700 1 -- start start 2023-07-14T12:58:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.878+0000 7f20b3910700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20ac0ffe10 0x7f20ac197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.878+0000 7f20b3910700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ac1007b0 0x7f20ac198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b3910700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac104eb0 0x7f20ac19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b3910700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac19cda0 con 0x7f20ac104eb0 2023-07-14T12:58:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b3910700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac19cf10 con 0x7f20ac0ffe10 2023-07-14T12:58:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b3910700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac19d0d0 con 0x7f20ac1007b0 2023-07-14T12:58:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b1ead700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac104eb0 0x7f20ac19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b1ead700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac104eb0 0x7f20ac19c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33808/0 (socket says 172.21.15.17:33808) 2023-07-14T12:58:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b1ead700 1 -- 172.21.15.17:0/2712249904 learned_addr learned my addr 172.21.15.17:0/2712249904 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b16ac700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20ac0ffe10 0x7f20ac197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b0eab700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ac1007b0 0x7f20ac198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b1ead700 1 -- 172.21.15.17:0/2712249904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ac1007b0 msgr2=0x7f20ac198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b1ead700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ac1007b0 0x7f20ac198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b1ead700 1 -- 172.21.15.17:0/2712249904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20ac0ffe10 msgr2=0x7f20ac197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b1ead700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20ac0ffe10 0x7f20ac197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.879+0000 7f20b1ead700 1 -- 172.21.15.17:0/2712249904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c0095f0 con 0x7f20ac104eb0 2023-07-14T12:58:09.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.880+0000 7f20b1ead700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac104eb0 0x7f20ac19c790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f20a400ada0 tx=0x7f20a400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:09.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.880+0000 7f20a27fc700 1 -- 172.21.15.17:0/2712249904 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a400f070 con 0x7f20ac104eb0 2023-07-14T12:58:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.880+0000 7f20a27fc700 1 -- 172.21.15.17:0/2712249904 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20a4007b30 con 0x7f20ac104eb0 2023-07-14T12:58:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.880+0000 7f20b3910700 1 -- 172.21.15.17:0/2712249904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac19d3b0 con 0x7f20ac104eb0 2023-07-14T12:58:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.880+0000 7f20a27fc700 1 -- 172.21.15.17:0/2712249904 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4005280 con 0x7f20ac104eb0 2023-07-14T12:58:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.880+0000 7f20b3910700 1 -- 172.21.15.17:0/2712249904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac1a4c10 con 0x7f20ac104eb0 2023-07-14T12:58:09.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.881+0000 7f20b3910700 1 -- 172.21.15.17:0/2712249904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20ac04e210 con 0x7f20ac104eb0 2023-07-14T12:58:09.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.883+0000 7f20a27fc700 1 -- 172.21.15.17:0/2712249904 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f20a400c980 con 0x7f20ac104eb0 2023-07-14T12:58:09.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.884+0000 7f20a27fc700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f20980a1260 0x7f20980a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:09.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.884+0000 7f20a27fc700 1 -- 172.21.15.17:0/2712249904 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f20a40cca80 con 0x7f20ac104eb0 2023-07-14T12:58:09.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.885+0000 7f20b16ac700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f20980a1260 0x7f20980a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:09.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.885+0000 7f20a27fc700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738] conn(0x7f20980aad10 0x7f20980ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:09.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.885+0000 7f20a27fc700 1 -- 172.21.15.17:0/2712249904 --> [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20980ad870 con 0x7f20980aad10 2023-07-14T12:58:09.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.885+0000 7f20a27fc700 1 -- 172.21.15.17:0/2712249904 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20a40ccdf0 con 0x7f20ac104eb0 2023-07-14T12:58:09.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.885+0000 7f20b16ac700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f20980a1260 0x7f20980a3710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20a8007be0 tx=0x7f20a80073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.885+0000 7f20b0eab700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738] conn(0x7f20980aad10 0x7f20980ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:09.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.886+0000 7f20b0eab700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738] conn(0x7f20980aad10 0x7f20980ad1a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:09.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.887+0000 7f20a27fc700 1 -- 172.21.15.17:0/2712249904 <== osd.4 v2:172.21.15.131:6808/2961620738 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f20980ad870 con 0x7f20980aad10 2023-07-14T12:58:09.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.903+0000 7f20b3910700 1 -- 172.21.15.17:0/2712249904 --> [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20ac10fc50 con 0x7f20980aad10 2023-07-14T12:58:09.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.904+0000 7f20a27fc700 1 -- 172.21.15.17:0/2712249904 <== osd.4 v2:172.21.15.131:6808/2961620738 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f209c01e040 con 0x7f20980aad10 2023-07-14T12:58:09.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.904+0000 7f20b3910700 1 -- 172.21.15.17:0/2712249904 >> [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738] conn(0x7f20980aad10 msgr2=0x7f20980ad1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.904+0000 7f20b3910700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738] conn(0x7f20980aad10 0x7f20980ad1a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.905+0000 7f20b3910700 1 -- 172.21.15.17:0/2712249904 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f20980a1260 msgr2=0x7f20980a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.905+0000 7f20b3910700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f20980a1260 0x7f20980a3710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20a8007be0 tx=0x7f20a80073d0 comp rx=0 tx=0).stop 2023-07-14T12:58:09.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.905+0000 7f20b3910700 1 -- 172.21.15.17:0/2712249904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac104eb0 msgr2=0x7f20ac19c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:09.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.905+0000 7f20b3910700 1 --2- 172.21.15.17:0/2712249904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20ac104eb0 0x7f20ac19c790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f20a400ada0 tx=0x7f20a400c330 comp rx=0 tx=0).stop 2023-07-14T12:58:09.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.905+0000 7f20b1ead700 1 -- 172.21.15.17:0/2712249904 reap_dead start 2023-07-14T12:58:09.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.905+0000 7f20b3910700 1 -- 172.21.15.17:0/2712249904 shutdown_connections 2023-07-14T12:58:09.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.905+0000 7f20b3910700 1 -- 172.21.15.17:0/2712249904 >> 172.21.15.17:0/2712249904 conn(0x7f20ac0fb690 msgr2=0x7f20ac0fc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:09.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.905+0000 7f20b3910700 1 -- 172.21.15.17:0/2712249904 shutdown_connections 2023-07-14T12:58:09.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:09.905+0000 7f20b3910700 1 -- 172.21.15.17:0/2712249904 wait complete. 2023-07-14T12:58:10.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:09 smithi131 ceph-mon[96953]: pgmap v319: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 639 B/s wr, 5 op/s 2023-07-14T12:58:10.294 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:09 smithi017 ceph-mon[95536]: pgmap v319: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 639 B/s wr, 5 op/s 2023-07-14T12:58:10.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.209+0000 7f135fc9f700 1 -- 172.21.15.17:0/2744852994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1358073140 msgr2=0x7f135810bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:10.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.209+0000 7f135fc9f700 1 --2- 172.21.15.17:0/2744852994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1358073140 0x7f135810bf20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1348009990 tx=0x7f1348009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:10.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.209+0000 7f135fc9f700 1 -- 172.21.15.17:0/2744852994 shutdown_connections 2023-07-14T12:58:10.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.209+0000 7f135fc9f700 1 --2- 172.21.15.17:0/2744852994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f135810c460 0x7f135810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:10.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.209+0000 7f135fc9f700 1 --2- 172.21.15.17:0/2744852994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358072830 0x7f1358072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.209+0000 7f135fc9f700 1 --2- 172.21.15.17:0/2744852994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1358073140 0x7f135810bf20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.209+0000 7f135fc9f700 1 -- 172.21.15.17:0/2744852994 >> 172.21.15.17:0/2744852994 conn(0x7f13580fb660 msgr2=0x7f13580fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.209+0000 7f135fc9f700 1 -- 172.21.15.17:0/2744852994 shutdown_connections 2023-07-14T12:58:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.209+0000 7f135fc9f700 1 -- 172.21.15.17:0/2744852994 wait complete. 2023-07-14T12:58:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.211+0000 7f135fc9f700 1 Processor -- start 2023-07-14T12:58:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.211+0000 7f135fc9f700 1 -- start start 2023-07-14T12:58:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.211+0000 7f135fc9f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358072830 0x7f1358071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.211+0000 7f135fc9f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1358073140 0x7f1358071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.211+0000 7f135fc9f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135810c460 0x7f135806a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.211+0000 7f135fc9f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135806b0b0 con 0x7f135810c460 2023-07-14T12:58:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.211+0000 7f135fc9f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135806b220 con 0x7f1358073140 2023-07-14T12:58:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.211+0000 7f135fc9f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135806b3e0 con 0x7f1358072830 2023-07-14T12:58:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.212+0000 7f135e23c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135810c460 0x7f135806a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.212+0000 7f135e23c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135810c460 0x7f135806a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33830/0 (socket says 172.21.15.17:33830) 2023-07-14T12:58:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.212+0000 7f135e23c700 1 -- 172.21.15.17:0/828167388 learned_addr learned my addr 172.21.15.17:0/828167388 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.212+0000 7f135e23c700 1 -- 172.21.15.17:0/828167388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358072830 msgr2=0x7f1358071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.212+0000 7f135e23c700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1358072830 0x7f1358071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.212+0000 7f135e23c700 1 -- 172.21.15.17:0/828167388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1358073140 msgr2=0x7f1358071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.212+0000 7f135e23c700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1358073140 0x7f1358071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.212+0000 7f135e23c700 1 -- 172.21.15.17:0/828167388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13480095f0 con 0x7f135810c460 2023-07-14T12:58:10.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.213+0000 7f135e23c700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135810c460 0x7f135806a9a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1350007ee0 tx=0x7f135000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:10.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.213+0000 7f134effd700 1 -- 172.21.15.17:0/828167388 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350017070 con 0x7f135810c460 2023-07-14T12:58:10.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.213+0000 7f134effd700 1 -- 172.21.15.17:0/828167388 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f135000f040 con 0x7f135810c460 2023-07-14T12:58:10.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.213+0000 7f135fc9f700 1 -- 172.21.15.17:0/828167388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135806b6c0 con 0x7f135810c460 2023-07-14T12:58:10.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.213+0000 7f134effd700 1 -- 172.21.15.17:0/828167388 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350005710 con 0x7f135810c460 2023-07-14T12:58:10.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.213+0000 7f135fc9f700 1 -- 172.21.15.17:0/828167388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135806f740 con 0x7f135810c460 2023-07-14T12:58:10.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.214+0000 7f135fc9f700 1 -- 172.21.15.17:0/828167388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1358111dc0 con 0x7f135810c460 2023-07-14T12:58:10.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.216+0000 7f134effd700 1 -- 172.21.15.17:0/828167388 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1350005870 con 0x7f135810c460 2023-07-14T12:58:10.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.218+0000 7f134effd700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13440a1260 0x7f13440a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:10.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.218+0000 7f134effd700 1 -- 172.21.15.17:0/828167388 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f13500cc960 con 0x7f135810c460 2023-07-14T12:58:10.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.219+0000 7f134effd700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592] conn(0x7f13440aad10 0x7f13440ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:10.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.219+0000 7f134effd700 1 -- 172.21.15.17:0/828167388 --> [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13440ad870 con 0x7f13440aad10 2023-07-14T12:58:10.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.219+0000 7f134effd700 1 -- 172.21.15.17:0/828167388 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13500cccd0 con 0x7f135810c460 2023-07-14T12:58:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.219+0000 7f135d23a700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592] conn(0x7f13440aad10 0x7f13440ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.219+0000 7f135da3b700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13440a1260 0x7f13440a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.220+0000 7f135da3b700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13440a1260 0x7f13440a3710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1354005950 tx=0x7f13540058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.223+0000 7f135d23a700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592] conn(0x7f13440aad10 0x7f13440ad1a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.225+0000 7f134effd700 1 -- 172.21.15.17:0/828167388 <== osd.1 v2:172.21.15.131:6800/3352217592 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f13440ad870 con 0x7f13440aad10 2023-07-14T12:58:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.243+0000 7f135fc9f700 1 -- 172.21.15.17:0/828167388 --> [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f135804e210 con 0x7f13440aad10 2023-07-14T12:58:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.243+0000 7f134effd700 1 -- 172.21.15.17:0/828167388 <== osd.1 v2:172.21.15.131:6800/3352217592 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f135804e210 con 0x7f13440aad10 2023-07-14T12:58:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.244+0000 7f135fc9f700 1 -- 172.21.15.17:0/828167388 >> [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592] conn(0x7f13440aad10 msgr2=0x7f13440ad1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.244+0000 7f135fc9f700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592] conn(0x7f13440aad10 0x7f13440ad1a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.244+0000 7f135fc9f700 1 -- 172.21.15.17:0/828167388 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13440a1260 msgr2=0x7f13440a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.244+0000 7f135fc9f700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13440a1260 0x7f13440a3710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1354005950 tx=0x7f13540058e0 comp rx=0 tx=0).stop 2023-07-14T12:58:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.244+0000 7f135fc9f700 1 -- 172.21.15.17:0/828167388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135810c460 msgr2=0x7f135806a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.244+0000 7f135fc9f700 1 --2- 172.21.15.17:0/828167388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135810c460 0x7f135806a9a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1350007ee0 tx=0x7f135000d3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.244+0000 7f135e23c700 1 -- 172.21.15.17:0/828167388 reap_dead start 2023-07-14T12:58:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.244+0000 7f135fc9f700 1 -- 172.21.15.17:0/828167388 shutdown_connections 2023-07-14T12:58:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.244+0000 7f135fc9f700 1 -- 172.21.15.17:0/828167388 >> 172.21.15.17:0/828167388 conn(0x7f13580fb660 msgr2=0x7f135810e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:10.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.244+0000 7f135fc9f700 1 -- 172.21.15.17:0/828167388 shutdown_connections 2023-07-14T12:58:10.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:10.244+0000 7f135fc9f700 1 -- 172.21.15.17:0/828167388 wait complete. 2023-07-14T12:58:10.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:09 smithi135 ceph-mon[97338]: pgmap v319: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 639 B/s wr, 5 op/s 2023-07-14T12:58:12.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:11 smithi131 ceph-mon[96953]: pgmap v320: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 639 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T12:58:12.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:11 smithi017 ceph-mon[95536]: pgmap v320: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 639 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T12:58:12.371 INFO:teuthology.orchestra.run.smithi017.stdout:167503724596 2023-07-14T12:58:12.372 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.5 2023-07-14T12:58:12.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:11 smithi135 ceph-mon[97338]: pgmap v320: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 639 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T12:58:12.606 INFO:teuthology.orchestra.run.smithi017.stdout:55834574922 2023-07-14T12:58:12.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.1 2023-07-14T12:58:13.321 INFO:teuthology.orchestra.run.smithi017.stdout:146028888121 2023-07-14T12:58:13.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.4 2023-07-14T12:58:13.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.799+0000 7f7652e0a700 1 -- 172.21.15.17:0/662749276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f764c10a140 msgr2=0x7f764c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:13.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.799+0000 7f7652e0a700 1 --2- 172.21.15.17:0/662749276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f764c10a140 0x7f764c10c580 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f764400b0a0 tx=0x7f764400b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:13.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.799+0000 7f7652e0a700 1 -- 172.21.15.17:0/662749276 shutdown_connections 2023-07-14T12:58:13.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.799+0000 7f7652e0a700 1 --2- 172.21.15.17:0/662749276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f764c10a140 0x7f764c10c580 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:13.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.799+0000 7f7652e0a700 1 --2- 172.21.15.17:0/662749276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f764c100df0 0x7f764c1011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:13.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.799+0000 7f7652e0a700 1 --2- 172.21.15.17:0/662749276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f764c101700 0x7f764c109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:13.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.799+0000 7f7652e0a700 1 -- 172.21.15.17:0/662749276 >> 172.21.15.17:0/662749276 conn(0x7f764c075b70 msgr2=0x7f764c075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:13.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.799+0000 7f7652e0a700 1 -- 172.21.15.17:0/662749276 shutdown_connections 2023-07-14T12:58:13.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.799+0000 7f7652e0a700 1 -- 172.21.15.17:0/662749276 wait complete. 2023-07-14T12:58:13.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.801+0000 7f7652e0a700 1 Processor -- start 2023-07-14T12:58:13.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.802+0000 7f7652e0a700 1 -- start start 2023-07-14T12:58:13.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.803+0000 7f7652e0a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f764c100df0 0x7f764c19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:13.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.803+0000 7f7652e0a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f764c101700 0x7f764c19bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:13.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.803+0000 7f7652e0a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f764c10a140 0x7f764c195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:13.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.803+0000 7f7652e0a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c196130 con 0x7f764c10a140 2023-07-14T12:58:13.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.803+0000 7f7652e0a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c1962a0 con 0x7f764c101700 2023-07-14T12:58:13.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.803+0000 7f7652e0a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c196460 con 0x7f764c100df0 2023-07-14T12:58:13.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.803+0000 7f764bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f764c101700 0x7f764c19bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:13.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.803+0000 7f764bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f764c101700 0x7f764c19bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:43940/0 (socket says 172.21.15.17:43940) 2023-07-14T12:58:13.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.803+0000 7f764bfff700 1 -- 172.21.15.17:0/1487933592 learned_addr learned my addr 172.21.15.17:0/1487933592 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:13.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.804+0000 7f764bfff700 1 -- 172.21.15.17:0/1487933592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f764c100df0 msgr2=0x7f764c19ba40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T12:58:13.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.804+0000 7f764bfff700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f764c100df0 0x7f764c19ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:13.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.804+0000 7f764bfff700 1 -- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f764c10a140 msgr2=0x7f764c195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:13.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.804+0000 7f764bfff700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f764c10a140 0x7f764c195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:13.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.804+0000 7f764bfff700 1 -- 172.21.15.17:0/1487933592 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644009d00 con 0x7f764c101700 2023-07-14T12:58:13.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.804+0000 7f764bfff700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f764c101700 0x7f764c19bf80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f763800c9b0 tx=0x7f763800cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:13.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.804+0000 7f7649ffb700 1 -- 172.21.15.17:0/1487933592 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638007b00 con 0x7f764c101700 2023-07-14T12:58:13.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.805+0000 7f7649ffb700 1 -- 172.21.15.17:0/1487933592 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7638007c60 con 0x7f764c101700 2023-07-14T12:58:13.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.805+0000 7f7649ffb700 1 -- 172.21.15.17:0/1487933592 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763800e610 con 0x7f764c101700 2023-07-14T12:58:13.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.805+0000 7f7652e0a700 1 -- 172.21.15.17:0/1487933592 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c196740 con 0x7f764c101700 2023-07-14T12:58:13.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.805+0000 7f7652e0a700 1 -- 172.21.15.17:0/1487933592 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c0feb50 con 0x7f764c101700 2023-07-14T12:58:13.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.806+0000 7f7652e0a700 1 -- 172.21.15.17:0/1487933592 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f764c10fbe0 con 0x7f764c101700 2023-07-14T12:58:13.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.810+0000 7f7649ffb700 1 -- 172.21.15.17:0/1487933592 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f763800f450 con 0x7f764c101700 2023-07-14T12:58:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.813+0000 7f7649ffb700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f763c0a11e0 0x7f763c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.813+0000 7f7649ffb700 1 -- 172.21.15.17:0/1487933592 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f76380cd0e0 con 0x7f764c101700 2023-07-14T12:58:13.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.813+0000 7f7649ffb700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316] conn(0x7f763c0aac90 0x7f763c0ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:13.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.813+0000 7f7649ffb700 1 -- 172.21.15.17:0/1487933592 --> [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f763c0ad7f0 con 0x7f763c0aac90 2023-07-14T12:58:13.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.813+0000 7f7649ffb700 1 -- 172.21.15.17:0/1487933592 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76380cd4f0 con 0x7f764c101700 2023-07-14T12:58:13.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.814+0000 7f7650ba6700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f763c0a11e0 0x7f763c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:13.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.814+0000 7f76513a7700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316] conn(0x7f763c0aac90 0x7f763c0ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:13.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.815+0000 7f76513a7700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316] conn(0x7f763c0aac90 0x7f763c0ad120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:13.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.815+0000 7f7650ba6700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f763c0a11e0 0x7f763c0a3690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f764000ba10 tx=0x7f764000b3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:13.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.819+0000 7f7649ffb700 1 -- 172.21.15.17:0/1487933592 <== osd.3 v2:172.21.15.17:6810/1157710316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f763c0ad7f0 con 0x7f763c0aac90 2023-07-14T12:58:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.841+0000 7f7652e0a700 1 -- 172.21.15.17:0/1487933592 --> [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f764c10b510 con 0x7f763c0aac90 2023-07-14T12:58:13.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.844+0000 7f7649ffb700 1 -- 172.21.15.17:0/1487933592 <== osd.3 v2:172.21.15.17:6810/1157710316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f764c10b510 con 0x7f763c0aac90 2023-07-14T12:58:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.848+0000 7f7652e0a700 1 -- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316] conn(0x7f763c0aac90 msgr2=0x7f763c0ad120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.848+0000 7f7652e0a700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316] conn(0x7f763c0aac90 0x7f763c0ad120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.848+0000 7f7652e0a700 1 -- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f763c0a11e0 msgr2=0x7f763c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.848+0000 7f7652e0a700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f763c0a11e0 0x7f763c0a3690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f764000ba10 tx=0x7f764000b3f0 comp rx=0 tx=0).stop 2023-07-14T12:58:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.848+0000 7f7652e0a700 1 -- 172.21.15.17:0/1487933592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f764c101700 msgr2=0x7f764c19bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.848+0000 7f7652e0a700 1 --2- 172.21.15.17:0/1487933592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f764c101700 0x7f764c19bf80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f763800c9b0 tx=0x7f763800cd70 comp rx=0 tx=0).stop 2023-07-14T12:58:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.848+0000 7f76513a7700 1 -- 172.21.15.17:0/1487933592 reap_dead start 2023-07-14T12:58:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.848+0000 7f7652e0a700 1 -- 172.21.15.17:0/1487933592 shutdown_connections 2023-07-14T12:58:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.848+0000 7f7652e0a700 1 -- 172.21.15.17:0/1487933592 >> 172.21.15.17:0/1487933592 conn(0x7f764c075b70 msgr2=0x7f764c10ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:13.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.849+0000 7f7652e0a700 1 -- 172.21.15.17:0/1487933592 shutdown_connections 2023-07-14T12:58:13.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:13.849+0000 7f7652e0a700 1 -- 172.21.15.17:0/1487933592 wait complete. 2023-07-14T12:58:14.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.098+0000 7f13bdf63700 1 -- 172.21.15.17:0/1107526749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13b80728b0 msgr2=0x7f13b8072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.098+0000 7f13bdf63700 1 --2- 172.21.15.17:0/1107526749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13b80728b0 0x7f13b8072c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009990 tx=0x7f13a8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.099+0000 7f13bdf63700 1 -- 172.21.15.17:0/1107526749 shutdown_connections 2023-07-14T12:58:14.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.099+0000 7f13bdf63700 1 --2- 172.21.15.17:0/1107526749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13b810c3e0 0x7f13b810e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.099+0000 7f13bdf63700 1 --2- 172.21.15.17:0/1107526749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13b80728b0 0x7f13b8072c80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.099+0000 7f13bdf63700 1 --2- 172.21.15.17:0/1107526749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13b80731c0 0x7f13b810bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.099+0000 7f13bdf63700 1 -- 172.21.15.17:0/1107526749 >> 172.21.15.17:0/1107526749 conn(0x7f13b80fb660 msgr2=0x7f13b80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:14.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.099+0000 7f13bdf63700 1 -- 172.21.15.17:0/1107526749 shutdown_connections 2023-07-14T12:58:14.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.099+0000 7f13bdf63700 1 -- 172.21.15.17:0/1107526749 wait complete. 2023-07-14T12:58:14.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.100+0000 7f13bdf63700 1 Processor -- start 2023-07-14T12:58:14.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.100+0000 7f13bdf63700 1 -- start start 2023-07-14T12:58:14.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.100+0000 7f13bdf63700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13b80728b0 0x7f13b819dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:14.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.100+0000 7f13bdf63700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13b80731c0 0x7f13b819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:14.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.100+0000 7f13bdf63700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13b810c3e0 0x7f13b8197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.100+0000 7f13bdf63700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b81982a0 con 0x7f13b80731c0 2023-07-14T12:58:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.100+0000 7f13bdf63700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b8198410 con 0x7f13b80728b0 2023-07-14T12:58:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.100+0000 7f13bdf63700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b81985d0 con 0x7f13b810c3e0 2023-07-14T12:58:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.101+0000 7f13b6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13b80731c0 0x7f13b819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.101+0000 7f13b7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13b810c3e0 0x7f13b8197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.101+0000 7f13b6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13b80731c0 0x7f13b819e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33856/0 (socket says 172.21.15.17:33856) 2023-07-14T12:58:14.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.101+0000 7f13b6ffd700 1 -- 172.21.15.17:0/3187146542 learned_addr learned my addr 172.21.15.17:0/3187146542 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.101+0000 7f13b77fe700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13b80728b0 0x7f13b819dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.101+0000 7f13b6ffd700 1 -- 172.21.15.17:0/3187146542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13b810c3e0 msgr2=0x7f13b8197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.101+0000 7f13b6ffd700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13b810c3e0 0x7f13b8197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.101+0000 7f13b6ffd700 1 -- 172.21.15.17:0/3187146542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13b80728b0 msgr2=0x7f13b819dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.101+0000 7f13b6ffd700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13b80728b0 0x7f13b819dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.101+0000 7f13b6ffd700 1 -- 172.21.15.17:0/3187146542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a80095f0 con 0x7f13b80731c0 2023-07-14T12:58:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.102+0000 7f13b6ffd700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13b80731c0 0x7f13b819e010 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00e9a0 tx=0x7f13ac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:14.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.102+0000 7f13b4ff9700 1 -- 172.21.15.17:0/3187146542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac009790 con 0x7f13b80731c0 2023-07-14T12:58:14.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.102+0000 7f13bdf63700 1 -- 172.21.15.17:0/3187146542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b81988b0 con 0x7f13b80731c0 2023-07-14T12:58:14.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.102+0000 7f13b4ff9700 1 -- 172.21.15.17:0/3187146542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13ac010430 con 0x7f13b80731c0 2023-07-14T12:58:14.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.102+0000 7f13b4ff9700 1 -- 172.21.15.17:0/3187146542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac00cea0 con 0x7f13b80731c0 2023-07-14T12:58:14.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.102+0000 7f13bdf63700 1 -- 172.21.15.17:0/3187146542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b81a4b70 con 0x7f13b80731c0 2023-07-14T12:58:14.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.103+0000 7f13bdf63700 1 -- 172.21.15.17:0/3187146542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13b804e210 con 0x7f13b80731c0 2023-07-14T12:58:14.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.105+0000 7f13b4ff9700 1 -- 172.21.15.17:0/3187146542 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f13ac0105a0 con 0x7f13b80731c0 2023-07-14T12:58:14.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.106+0000 7f13b4ff9700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13a00a11e0 0x7f13a00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:14.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.107+0000 7f13b4ff9700 1 -- 172.21.15.17:0/3187146542 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f13ac014070 con 0x7f13b80731c0 2023-07-14T12:58:14.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.107+0000 7f13b77fe700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13a00a11e0 0x7f13a00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:14.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.107+0000 7f13b4ff9700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788] conn(0x7f13a00aac90 0x7f13a00ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:14.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.107+0000 7f13b4ff9700 1 -- 172.21.15.17:0/3187146542 --> [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13a00ad7f0 con 0x7f13a00aac90 2023-07-14T12:58:14.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.107+0000 7f13b4ff9700 1 -- 172.21.15.17:0/3187146542 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13ac0cd2c0 con 0x7f13b80731c0 2023-07-14T12:58:14.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.107+0000 7f13b7fff700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788] conn(0x7f13a00aac90 0x7f13a00ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.107+0000 7f13b77fe700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13a00a11e0 0x7f13a00a3690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13a8006010 tx=0x7f13a800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.108+0000 7f13b7fff700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788] conn(0x7f13a00aac90 0x7f13a00ad120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.109+0000 7f13b4ff9700 1 -- 172.21.15.17:0/3187146542 <== osd.0 v2:172.21.15.17:6802/2578098788 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f13a00ad7f0 con 0x7f13a00aac90 2023-07-14T12:58:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.126+0000 7f13bdf63700 1 -- 172.21.15.17:0/3187146542 --> [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f13b8111e20 con 0x7f13a00aac90 2023-07-14T12:58:14.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.126+0000 7f13b4ff9700 1 -- 172.21.15.17:0/3187146542 <== osd.0 v2:172.21.15.17:6802/2578098788 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f13b000f040 con 0x7f13a00aac90 2023-07-14T12:58:14.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.127+0000 7f13bdf63700 1 -- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788] conn(0x7f13a00aac90 msgr2=0x7f13a00ad120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.127+0000 7f13bdf63700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788] conn(0x7f13a00aac90 0x7f13a00ad120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.127+0000 7f13bdf63700 1 -- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13a00a11e0 msgr2=0x7f13a00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.127+0000 7f13bdf63700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13a00a11e0 0x7f13a00a3690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f13a8006010 tx=0x7f13a800b260 comp rx=0 tx=0).stop 2023-07-14T12:58:14.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.127+0000 7f13bdf63700 1 -- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13b80731c0 msgr2=0x7f13b819e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.127+0000 7f13bdf63700 1 --2- 172.21.15.17:0/3187146542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13b80731c0 0x7f13b819e010 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00e9a0 tx=0x7f13ac00ecb0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.127+0000 7f13b7fff700 1 -- 172.21.15.17:0/3187146542 reap_dead start 2023-07-14T12:58:14.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.127+0000 7f13bdf63700 1 -- 172.21.15.17:0/3187146542 shutdown_connections 2023-07-14T12:58:14.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.127+0000 7f13bdf63700 1 -- 172.21.15.17:0/3187146542 >> 172.21.15.17:0/3187146542 conn(0x7f13b80fb660 msgr2=0x7f13b810e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:14.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.127+0000 7f13bdf63700 1 -- 172.21.15.17:0/3187146542 shutdown_connections 2023-07-14T12:58:14.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.127+0000 7f13bdf63700 1 -- 172.21.15.17:0/3187146542 wait complete. 2023-07-14T12:58:14.291 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:13 smithi017 ceph-mon[95536]: pgmap v321: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 18 B/s, 1 keys/s, 1 objects/s recovering 2023-07-14T12:58:14.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:13 smithi135 ceph-mon[97338]: pgmap v321: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 18 B/s, 1 keys/s, 1 objects/s recovering 2023-07-14T12:58:14.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:13 smithi131 ceph-mon[96953]: pgmap v321: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s; 18 B/s, 1 keys/s, 1 objects/s recovering 2023-07-14T12:58:14.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.253+0000 7f99f360d700 1 -- 172.21.15.17:0/3764514005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ec0ffe00 msgr2=0x7f99ec1001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.253+0000 7f99f360d700 1 --2- 172.21.15.17:0/3764514005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ec0ffe00 0x7f99ec1001d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f99e80099c0 tx=0x7f99e8009cd0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.253+0000 7f99f360d700 1 -- 172.21.15.17:0/3764514005 shutdown_connections 2023-07-14T12:58:14.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.253+0000 7f99f360d700 1 --2- 172.21.15.17:0/3764514005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ec104ea0 0x7f99ec10ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.253+0000 7f99f360d700 1 --2- 172.21.15.17:0/3764514005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ec0ffe00 0x7f99ec1001d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.253+0000 7f99f360d700 1 --2- 172.21.15.17:0/3764514005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ec1007a0 0x7f99ec104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.253+0000 7f99f360d700 1 -- 172.21.15.17:0/3764514005 >> 172.21.15.17:0/3764514005 conn(0x7f99ec0fb660 msgr2=0x7f99ec0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:14.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.253+0000 7f99f360d700 1 -- 172.21.15.17:0/3764514005 shutdown_connections 2023-07-14T12:58:14.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.253+0000 7f99f360d700 1 -- 172.21.15.17:0/3764514005 wait complete. 2023-07-14T12:58:14.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.254+0000 7f99f360d700 1 Processor -- start 2023-07-14T12:58:14.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.255+0000 7f99f360d700 1 -- start start 2023-07-14T12:58:14.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.255+0000 7f99f360d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ec0ffe00 0x7f99ec197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:14.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.255+0000 7f99f360d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ec1007a0 0x7f99ec198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:14.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.255+0000 7f99f360d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ec104ea0 0x7f99ec19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:14.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.255+0000 7f99f360d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec19cda0 con 0x7f99ec0ffe00 2023-07-14T12:58:14.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.255+0000 7f99f360d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec19cf10 con 0x7f99ec104ea0 2023-07-14T12:58:14.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.255+0000 7f99f360d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec19d0d0 con 0x7f99ec1007a0 2023-07-14T12:58:14.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.255+0000 7f99f13a9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ec0ffe00 0x7f99ec197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:14.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.255+0000 7f99f13a9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ec0ffe00 0x7f99ec197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33866/0 (socket says 172.21.15.17:33866) 2023-07-14T12:58:14.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.255+0000 7f99f13a9700 1 -- 172.21.15.17:0/3363077016 learned_addr learned my addr 172.21.15.17:0/3363077016 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:14.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99f1baa700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ec104ea0 0x7f99ec19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:14.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99f0ba8700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ec1007a0 0x7f99ec198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:14.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99f13a9700 1 -- 172.21.15.17:0/3363077016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ec1007a0 msgr2=0x7f99ec198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99f13a9700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99ec1007a0 0x7f99ec198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99f13a9700 1 -- 172.21.15.17:0/3363077016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ec104ea0 msgr2=0x7f99ec19c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99f13a9700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99ec104ea0 0x7f99ec19c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99f13a9700 1 -- 172.21.15.17:0/3363077016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80095f0 con 0x7f99ec0ffe00 2023-07-14T12:58:14.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99f13a9700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ec0ffe00 0x7f99ec197de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c010 tx=0x7f99e8009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:14.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99e27fc700 1 -- 172.21.15.17:0/3363077016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e801d070 con 0x7f99ec0ffe00 2023-07-14T12:58:14.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99f360d700 1 -- 172.21.15.17:0/3363077016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ec19d350 con 0x7f99ec0ffe00 2023-07-14T12:58:14.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99e27fc700 1 -- 172.21.15.17:0/3363077016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99e8004100 con 0x7f99ec0ffe00 2023-07-14T12:58:14.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99e27fc700 1 -- 172.21.15.17:0/3363077016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e800fe50 con 0x7f99ec0ffe00 2023-07-14T12:58:14.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.256+0000 7f99f360d700 1 -- 172.21.15.17:0/3363077016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ec06a100 con 0x7f99ec0ffe00 2023-07-14T12:58:14.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.257+0000 7f99f360d700 1 -- 172.21.15.17:0/3363077016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99ec10fc60 con 0x7f99ec0ffe00 2023-07-14T12:58:14.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.261+0000 7f99e27fc700 1 -- 172.21.15.17:0/3363077016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f99e800f5f0 con 0x7f99ec0ffe00 2023-07-14T12:58:14.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.263+0000 7f99e27fc700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99d80a1260 0x7f99d80a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:14.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.263+0000 7f99e27fc700 1 -- 172.21.15.17:0/3363077016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f99e80cdfe0 con 0x7f99ec0ffe00 2023-07-14T12:58:14.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.264+0000 7f99f0ba8700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99d80a1260 0x7f99d80a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:14.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.264+0000 7f99e27fc700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808] conn(0x7f99d80aad10 0x7f99d80ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:14.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.264+0000 7f99e27fc700 1 -- 172.21.15.17:0/3363077016 --> [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99d80ad870 con 0x7f99d80aad10 2023-07-14T12:58:14.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.264+0000 7f99e27fc700 1 -- 172.21.15.17:0/3363077016 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99e80ce3f0 con 0x7f99ec0ffe00 2023-07-14T12:58:14.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.264+0000 7f99f1baa700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808] conn(0x7f99d80aad10 0x7f99d80ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:14.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.264+0000 7f99f0ba8700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99d80a1260 0x7f99d80a3710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f99dc005950 tx=0x7f99dc0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:14.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.265+0000 7f99f1baa700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808] conn(0x7f99d80aad10 0x7f99d80ad1a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:14.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.266+0000 7f99e27fc700 1 -- 172.21.15.17:0/3363077016 <== osd.9 v2:172.21.15.17:6826/556821808 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f99d80ad870 con 0x7f99d80aad10 2023-07-14T12:58:14.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.290+0000 7f99f360d700 1 -- 172.21.15.17:0/3363077016 --> [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99ec04e210 con 0x7f99d80aad10 2023-07-14T12:58:14.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.290+0000 7f99e27fc700 1 -- 172.21.15.17:0/3363077016 <== osd.9 v2:172.21.15.17:6826/556821808 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f99ec04e210 con 0x7f99d80aad10 2023-07-14T12:58:14.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.291+0000 7f99f360d700 1 -- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808] conn(0x7f99d80aad10 msgr2=0x7f99d80ad1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.291+0000 7f99f360d700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808] conn(0x7f99d80aad10 0x7f99d80ad1a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.291+0000 7f99f360d700 1 -- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99d80a1260 msgr2=0x7f99d80a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.291+0000 7f99f360d700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99d80a1260 0x7f99d80a3710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f99dc005950 tx=0x7f99dc0058e0 comp rx=0 tx=0).stop 2023-07-14T12:58:14.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.291+0000 7f99f360d700 1 -- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ec0ffe00 msgr2=0x7f99ec197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:14.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.291+0000 7f99f360d700 1 --2- 172.21.15.17:0/3363077016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99ec0ffe00 0x7f99ec197de0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c010 tx=0x7f99e8009510 comp rx=0 tx=0).stop 2023-07-14T12:58:14.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.291+0000 7f99f1baa700 1 -- 172.21.15.17:0/3363077016 reap_dead start 2023-07-14T12:58:14.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.292+0000 7f99f360d700 1 -- 172.21.15.17:0/3363077016 shutdown_connections 2023-07-14T12:58:14.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.292+0000 7f99f360d700 1 -- 172.21.15.17:0/3363077016 >> 172.21.15.17:0/3363077016 conn(0x7f99ec0fb660 msgr2=0x7f99ec0fc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:14.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.293+0000 7f99f360d700 1 -- 172.21.15.17:0/3363077016 shutdown_connections 2023-07-14T12:58:14.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:14.293+0000 7f99f360d700 1 -- 172.21.15.17:0/3363077016 wait complete. 2023-07-14T12:58:15.117 INFO:teuthology.orchestra.run.smithi017.stdout:111669149759 2023-07-14T12:58:15.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.3 2023-07-14T12:58:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.240+0000 7fc5940ed700 1 -- 172.21.15.17:0/3011369869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c0731c0 msgr2=0x7fc58c10bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.240+0000 7fc5940ed700 1 --2- 172.21.15.17:0/3011369869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c0731c0 0x7fc58c10bea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc5800098f0 tx=0x7fc580009c00 comp rx=0 tx=0).stop 2023-07-14T12:58:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.240+0000 7fc5940ed700 1 -- 172.21.15.17:0/3011369869 shutdown_connections 2023-07-14T12:58:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.240+0000 7fc5940ed700 1 --2- 172.21.15.17:0/3011369869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c10c3e0 0x7fc58c10e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.240+0000 7fc5940ed700 1 --2- 172.21.15.17:0/3011369869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c0728b0 0x7fc58c072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.240+0000 7fc5940ed700 1 --2- 172.21.15.17:0/3011369869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c0731c0 0x7fc58c10bea0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.240+0000 7fc5940ed700 1 -- 172.21.15.17:0/3011369869 >> 172.21.15.17:0/3011369869 conn(0x7fc58c0fb660 msgr2=0x7fc58c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.240+0000 7fc5940ed700 1 -- 172.21.15.17:0/3011369869 shutdown_connections 2023-07-14T12:58:15.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.240+0000 7fc5940ed700 1 -- 172.21.15.17:0/3011369869 wait complete. 2023-07-14T12:58:15.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.241+0000 7fc5940ed700 1 Processor -- start 2023-07-14T12:58:15.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.242+0000 7fc5940ed700 1 -- start start 2023-07-14T12:58:15.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.242+0000 7fc5940ed700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c0728b0 0x7fc58c1052c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.242+0000 7fc5940ed700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c10c3e0 0x7fc58c105820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.242+0000 7fc5940ed700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c100370 0x7fc58c100810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.242+0000 7fc5940ed700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c100fa0 con 0x7fc58c0728b0 2023-07-14T12:58:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.242+0000 7fc5940ed700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c101110 con 0x7fc58c100370 2023-07-14T12:58:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.242+0000 7fc5940ed700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c10b050 con 0x7fc58c10c3e0 2023-07-14T12:58:15.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.243+0000 7fc591e89700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c0728b0 0x7fc58c1052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.243+0000 7fc591e89700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c0728b0 0x7fc58c1052c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35618/0 (socket says 172.21.15.17:35618) 2023-07-14T12:58:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.243+0000 7fc591e89700 1 -- 172.21.15.17:0/1723358772 learned_addr learned my addr 172.21.15.17:0/1723358772 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.243+0000 7fc59268a700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c100370 0x7fc58c100810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.243+0000 7fc591688700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c10c3e0 0x7fc58c105820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.243+0000 7fc591e89700 1 -- 172.21.15.17:0/1723358772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c10c3e0 msgr2=0x7fc58c105820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.243+0000 7fc591e89700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc58c10c3e0 0x7fc58c105820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.243+0000 7fc591e89700 1 -- 172.21.15.17:0/1723358772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c100370 msgr2=0x7fc58c100810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.243+0000 7fc591e89700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc58c100370 0x7fc58c100810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.243+0000 7fc591e89700 1 -- 172.21.15.17:0/1723358772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc580009520 con 0x7fc58c0728b0 2023-07-14T12:58:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.244+0000 7fc591e89700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c0728b0 0x7fc58c1052c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc58800e9a0 tx=0x7fc58800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.244+0000 7fc57effd700 1 -- 172.21.15.17:0/1723358772 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588009790 con 0x7fc58c0728b0 2023-07-14T12:58:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.244+0000 7fc57effd700 1 -- 172.21.15.17:0/1723358772 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc588010430 con 0x7fc58c0728b0 2023-07-14T12:58:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.244+0000 7fc57effd700 1 -- 172.21.15.17:0/1723358772 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58800cea0 con 0x7fc58c0728b0 2023-07-14T12:58:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.244+0000 7fc5940ed700 1 -- 172.21.15.17:0/1723358772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c10b330 con 0x7fc58c0728b0 2023-07-14T12:58:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.244+0000 7fc5940ed700 1 -- 172.21.15.17:0/1723358772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c10b7b0 con 0x7fc58c0728b0 2023-07-14T12:58:15.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.246+0000 7fc5940ed700 1 -- 172.21.15.17:0/1723358772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc58c111df0 con 0x7fc58c0728b0 2023-07-14T12:58:15.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.248+0000 7fc57effd700 1 -- 172.21.15.17:0/1723358772 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc5880105a0 con 0x7fc58c0728b0 2023-07-14T12:58:15.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.250+0000 7fc57effd700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc5780a1260 0x7fc5780a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.250+0000 7fc57effd700 1 -- 172.21.15.17:0/1723358772 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fc588014070 con 0x7fc58c0728b0 2023-07-14T12:58:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.250+0000 7fc57effd700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423] conn(0x7fc5780aad10 0x7fc5780ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.250+0000 7fc57effd700 1 -- 172.21.15.17:0/1723358772 --> [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5780ad870 con 0x7fc5780aad10 2023-07-14T12:58:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.250+0000 7fc57effd700 1 -- 172.21.15.17:0/1723358772 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5880d5460 con 0x7fc58c0728b0 2023-07-14T12:58:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.250+0000 7fc591688700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc5780a1260 0x7fc5780a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.251+0000 7fc59268a700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423] conn(0x7fc5780aad10 0x7fc5780ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.251+0000 7fc591688700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc5780a1260 0x7fc5780a3710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc580009230 tx=0x7fc580019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.251+0000 7fc59268a700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423] conn(0x7fc5780aad10 0x7fc5780ad1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.253+0000 7fc57effd700 1 -- 172.21.15.17:0/1723358772 <== osd.2 v2:172.21.15.135:6800/280499423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc5780ad870 con 0x7fc5780aad10 2023-07-14T12:58:15.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.270+0000 7fc5940ed700 1 -- 172.21.15.17:0/1723358772 --> [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc58c04e210 con 0x7fc5780aad10 2023-07-14T12:58:15.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.271+0000 7fc57effd700 1 -- 172.21.15.17:0/1723358772 <== osd.2 v2:172.21.15.135:6800/280499423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc58c04e210 con 0x7fc5780aad10 2023-07-14T12:58:15.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.271+0000 7fc5940ed700 1 -- 172.21.15.17:0/1723358772 >> [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423] conn(0x7fc5780aad10 msgr2=0x7fc5780ad1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.271+0000 7fc5940ed700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423] conn(0x7fc5780aad10 0x7fc5780ad1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.271+0000 7fc5940ed700 1 -- 172.21.15.17:0/1723358772 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc5780a1260 msgr2=0x7fc5780a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.271+0000 7fc5940ed700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc5780a1260 0x7fc5780a3710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc580009230 tx=0x7fc580019040 comp rx=0 tx=0).stop 2023-07-14T12:58:15.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.271+0000 7fc5940ed700 1 -- 172.21.15.17:0/1723358772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c0728b0 msgr2=0x7fc58c1052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.271+0000 7fc5940ed700 1 --2- 172.21.15.17:0/1723358772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc58c0728b0 0x7fc58c1052c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc58800e9a0 tx=0x7fc58800ecb0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.271+0000 7fc59268a700 1 -- 172.21.15.17:0/1723358772 reap_dead start 2023-07-14T12:58:15.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.271+0000 7fc5940ed700 1 -- 172.21.15.17:0/1723358772 shutdown_connections 2023-07-14T12:58:15.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.271+0000 7fc5940ed700 1 -- 172.21.15.17:0/1723358772 >> 172.21.15.17:0/1723358772 conn(0x7fc58c0fb660 msgr2=0x7fc58c0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.272+0000 7fc5940ed700 1 -- 172.21.15.17:0/1723358772 shutdown_connections 2023-07-14T12:58:15.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.272+0000 7fc5940ed700 1 -- 172.21.15.17:0/1723358772 wait complete. 2023-07-14T12:58:15.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.295+0000 7f97bd074700 1 -- 172.21.15.17:0/2785558800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b8100df0 msgr2=0x7f97b81011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.295+0000 7f97bd074700 1 --2- 172.21.15.17:0/2785558800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b8100df0 0x7f97b81011c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009990 tx=0x7f97a8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.295+0000 7f97bd074700 1 -- 172.21.15.17:0/2785558800 shutdown_connections 2023-07-14T12:58:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.295+0000 7f97bd074700 1 --2- 172.21.15.17:0/2785558800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b810a140 0x7f97b810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.295+0000 7f97bd074700 1 --2- 172.21.15.17:0/2785558800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b8100df0 0x7f97b81011c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.295+0000 7f97bd074700 1 --2- 172.21.15.17:0/2785558800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97b8101700 0x7f97b8109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.295+0000 7f97bd074700 1 -- 172.21.15.17:0/2785558800 >> 172.21.15.17:0/2785558800 conn(0x7f97b8075b70 msgr2=0x7f97b8075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:15.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.296+0000 7f97bd074700 1 -- 172.21.15.17:0/2785558800 shutdown_connections 2023-07-14T12:58:15.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.296+0000 7f97bd074700 1 -- 172.21.15.17:0/2785558800 wait complete. 2023-07-14T12:58:15.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.297+0000 7f97bd074700 1 Processor -- start 2023-07-14T12:58:15.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.297+0000 7f97bd074700 1 -- start start 2023-07-14T12:58:15.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.298+0000 7f97bd074700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b8100df0 0x7f97b8193990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.298+0000 7f97bd074700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97b8101700 0x7f97b8193ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.298+0000 7f97bd074700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b810a140 0x7f97b8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.298+0000 7f97bd074700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8198940 con 0x7f97b8101700 2023-07-14T12:58:15.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.298+0000 7f97bd074700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8198ab0 con 0x7f97b8100df0 2023-07-14T12:58:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.298+0000 7f97bd074700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8198c70 con 0x7f97b810a140 2023-07-14T12:58:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.298+0000 7f97b6d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b8100df0 0x7f97b8193990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.298+0000 7f97b6d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b8100df0 0x7f97b8193990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:47098/0 (socket says 172.21.15.17:47098) 2023-07-14T12:58:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.298+0000 7f97b6d9d700 1 -- 172.21.15.17:0/2267741617 learned_addr learned my addr 172.21.15.17:0/2267741617 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.298+0000 7f97b759e700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b810a140 0x7f97b8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.299+0000 7f97b6d9d700 1 -- 172.21.15.17:0/2267741617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b810a140 msgr2=0x7f97b8198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.299+0000 7f97b6d9d700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97b810a140 0x7f97b8198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.299+0000 7f97b6d9d700 1 -- 172.21.15.17:0/2267741617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97b8101700 msgr2=0x7f97b8193ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.299+0000 7f97b6d9d700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97b8101700 0x7f97b8193ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.299+0000 7f97b6d9d700 1 -- 172.21.15.17:0/2267741617 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a80095f0 con 0x7f97b8100df0 2023-07-14T12:58:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.299+0000 7f97b6d9d700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b8100df0 0x7f97b8193990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f97a8005740 tx=0x7f97a8005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.300+0000 7f979ffff700 1 -- 172.21.15.17:0/2267741617 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a801d070 con 0x7f97b8100df0 2023-07-14T12:58:15.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.300+0000 7f97bd074700 1 -- 172.21.15.17:0/2267741617 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b8198ef0 con 0x7f97b8100df0 2023-07-14T12:58:15.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.300+0000 7f97bd074700 1 -- 172.21.15.17:0/2267741617 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b81a07f0 con 0x7f97b8100df0 2023-07-14T12:58:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.300+0000 7f979ffff700 1 -- 172.21.15.17:0/2267741617 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97a8022470 con 0x7f97b8100df0 2023-07-14T12:58:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.300+0000 7f979ffff700 1 -- 172.21.15.17:0/2267741617 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8017650 con 0x7f97b8100df0 2023-07-14T12:58:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.301+0000 7f97bd074700 1 -- 172.21.15.17:0/2267741617 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97b804e210 con 0x7f97b8100df0 2023-07-14T12:58:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.306+0000 7f979ffff700 1 -- 172.21.15.17:0/2267741617 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f97a800fb00 con 0x7f97b8100df0 2023-07-14T12:58:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.307+0000 7f979ffff700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f97a00a56f0 0x7f97a00a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.307+0000 7f979ffff700 1 -- 172.21.15.17:0/2267741617 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f97a80cea00 con 0x7f97b8100df0 2023-07-14T12:58:15.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.307+0000 7f97b659c700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f97a00a56f0 0x7f97a00a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.307+0000 7f979ffff700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404] conn(0x7f97a00af1a0 0x7f97a00b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.307+0000 7f979ffff700 1 -- 172.21.15.17:0/2267741617 --> [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97a00b1d00 con 0x7f97a00af1a0 2023-07-14T12:58:15.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.307+0000 7f979ffff700 1 -- 172.21.15.17:0/2267741617 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97a80cedb0 con 0x7f97b8100df0 2023-07-14T12:58:15.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.308+0000 7f97b659c700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f97a00a56f0 0x7f97a00a7ba0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97ac005950 tx=0x7f97ac0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.308+0000 7f97b759e700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404] conn(0x7f97a00af1a0 0x7f97a00b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.309+0000 7f97b759e700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404] conn(0x7f97a00af1a0 0x7f97a00b1630 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.310+0000 7f979ffff700 1 -- 172.21.15.17:0/2267741617 <== osd.11 v2:172.21.15.135:6824/2475021404 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f97a00b1d00 con 0x7f97a00af1a0 2023-07-14T12:58:15.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.327+0000 7f97bd074700 1 -- 172.21.15.17:0/2267741617 --> [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f97b810dac0 con 0x7f97a00af1a0 2023-07-14T12:58:15.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.328+0000 7f979ffff700 1 -- 172.21.15.17:0/2267741617 <== osd.11 v2:172.21.15.135:6824/2475021404 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f97b000f040 con 0x7f97a00af1a0 2023-07-14T12:58:15.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.328+0000 7f97bd074700 1 -- 172.21.15.17:0/2267741617 >> [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404] conn(0x7f97a00af1a0 msgr2=0x7f97a00b1630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.328+0000 7f97bd074700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404] conn(0x7f97a00af1a0 0x7f97a00b1630 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.328+0000 7f97bd074700 1 -- 172.21.15.17:0/2267741617 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f97a00a56f0 msgr2=0x7f97a00a7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.328+0000 7f97bd074700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f97a00a56f0 0x7f97a00a7ba0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97ac005950 tx=0x7f97ac0058e0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.328+0000 7f97bd074700 1 -- 172.21.15.17:0/2267741617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b8100df0 msgr2=0x7f97b8193990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.328+0000 7f97bd074700 1 --2- 172.21.15.17:0/2267741617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97b8100df0 0x7f97b8193990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f97a8005740 tx=0x7f97a8005770 comp rx=0 tx=0).stop 2023-07-14T12:58:15.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.328+0000 7f97b759e700 1 -- 172.21.15.17:0/2267741617 reap_dead start 2023-07-14T12:58:15.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.329+0000 7f97bd074700 1 -- 172.21.15.17:0/2267741617 shutdown_connections 2023-07-14T12:58:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.329+0000 7f97bd074700 1 -- 172.21.15.17:0/2267741617 >> 172.21.15.17:0/2267741617 conn(0x7f97b8075b70 msgr2=0x7f97b8101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.329+0000 7f97bd074700 1 -- 172.21.15.17:0/2267741617 shutdown_connections 2023-07-14T12:58:15.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.329+0000 7f97bd074700 1 -- 172.21.15.17:0/2267741617 wait complete. 2023-07-14T12:58:15.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.836+0000 7f097cf5a700 1 -- 172.21.15.17:0/1226301994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0978104ea0 msgr2=0x7f097810ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.836+0000 7f097cf5a700 1 --2- 172.21.15.17:0/1226301994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0978104ea0 0x7f097810ca20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f097000b0d0 tx=0x7f097000b3e0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.837+0000 7f097cf5a700 1 -- 172.21.15.17:0/1226301994 shutdown_connections 2023-07-14T12:58:15.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.837+0000 7f097cf5a700 1 --2- 172.21.15.17:0/1226301994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0978104ea0 0x7f097810ca20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.837+0000 7f097cf5a700 1 --2- 172.21.15.17:0/1226301994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09780ffe00 0x7f09781001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.837+0000 7f097cf5a700 1 --2- 172.21.15.17:0/1226301994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09781007a0 0x7f0978104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.837+0000 7f097cf5a700 1 -- 172.21.15.17:0/1226301994 >> 172.21.15.17:0/1226301994 conn(0x7f09780fb660 msgr2=0x7f09780fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:15.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.837+0000 7f097cf5a700 1 -- 172.21.15.17:0/1226301994 shutdown_connections 2023-07-14T12:58:15.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.837+0000 7f097cf5a700 1 -- 172.21.15.17:0/1226301994 wait complete. 2023-07-14T12:58:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.838+0000 7f097cf5a700 1 Processor -- start 2023-07-14T12:58:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.838+0000 7f097cf5a700 1 -- start start 2023-07-14T12:58:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f097cf5a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09780ffe00 0x7f0978197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f097cf5a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09781007a0 0x7f09781983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f097cf5a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0978104ea0 0x7f097819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f097cf5a700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097819ce40 con 0x7f0978104ea0 2023-07-14T12:58:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f097cf5a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097819cfb0 con 0x7f09781007a0 2023-07-14T12:58:15.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f097cf5a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097819d170 con 0x7f09780ffe00 2023-07-14T12:58:15.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f097659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09780ffe00 0x7f0978197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f0976d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0978104ea0 0x7f097819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f097659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09780ffe00 0x7f0978197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44294/0 (socket says 172.21.15.17:44294) 2023-07-14T12:58:15.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f097659c700 1 -- 172.21.15.17:0/991949586 learned_addr learned my addr 172.21.15.17:0/991949586 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:15.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f0975d9b700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09781007a0 0x7f09781983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f0976d9d700 1 -- 172.21.15.17:0/991949586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09780ffe00 msgr2=0x7f0978197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f0976d9d700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09780ffe00 0x7f0978197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.839+0000 7f0976d9d700 1 -- 172.21.15.17:0/991949586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09781007a0 msgr2=0x7f09781983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.840+0000 7f0976d9d700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09781007a0 0x7f09781983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.840+0000 7f0976d9d700 1 -- 172.21.15.17:0/991949586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0970009d00 con 0x7f0978104ea0 2023-07-14T12:58:15.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.840+0000 7f0975d9b700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09781007a0 0x7f09781983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:15.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.840+0000 7f0976d9d700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0978104ea0 0x7f097819c830 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0970009fd0 tx=0x7f0970007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.840+0000 7f09677fe700 1 -- 172.21.15.17:0/991949586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097000e040 con 0x7f0978104ea0 2023-07-14T12:58:15.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.840+0000 7f097cf5a700 1 -- 172.21.15.17:0/991949586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097819d3f0 con 0x7f0978104ea0 2023-07-14T12:58:15.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.840+0000 7f097cf5a700 1 -- 172.21.15.17:0/991949586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09781a4cb0 con 0x7f0978104ea0 2023-07-14T12:58:15.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.841+0000 7f09677fe700 1 -- 172.21.15.17:0/991949586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0970009b80 con 0x7f0978104ea0 2023-07-14T12:58:15.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.841+0000 7f09677fe700 1 -- 172.21.15.17:0/991949586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097001ddb0 con 0x7f0978104ea0 2023-07-14T12:58:15.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.841+0000 7f097cf5a700 1 -- 172.21.15.17:0/991949586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0958000ff0 con 0x7f0978104ea0 2023-07-14T12:58:15.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.844+0000 7f09677fe700 1 -- 172.21.15.17:0/991949586 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f0970004c50 con 0x7f0978104ea0 2023-07-14T12:58:15.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.845+0000 7f09677fe700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f09600a11e0 0x7f09600a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.845+0000 7f09677fe700 1 -- 172.21.15.17:0/991949586 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f09700ce960 con 0x7f0978104ea0 2023-07-14T12:58:15.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.846+0000 7f09677fe700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731] conn(0x7f09600aac90 0x7f09600ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.846+0000 7f09677fe700 1 -- 172.21.15.17:0/991949586 --> [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09600ad7f0 con 0x7f09600aac90 2023-07-14T12:58:15.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.846+0000 7f09677fe700 1 -- 172.21.15.17:0/991949586 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09700cecd0 con 0x7f0978104ea0 2023-07-14T12:58:15.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.846+0000 7f097659c700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f09600a11e0 0x7f09600a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.846+0000 7f0975d9b700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731] conn(0x7f09600aac90 0x7f09600ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.846+0000 7f0975d9b700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731] conn(0x7f09600aac90 0x7f09600ad120 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.846+0000 7f097659c700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f09600a11e0 0x7f09600a3690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0968009d20 tx=0x7f0968009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.848+0000 7f09677fe700 1 -- 172.21.15.17:0/991949586 <== osd.6 v2:172.21.15.17:6818/3590489731 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f09600ad7f0 con 0x7f09600aac90 2023-07-14T12:58:15.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.867+0000 7f097cf5a700 1 -- 172.21.15.17:0/991949586 --> [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0958002d70 con 0x7f09600aac90 2023-07-14T12:58:15.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.867+0000 7f09677fe700 1 -- 172.21.15.17:0/991949586 <== osd.6 v2:172.21.15.17:6818/3590489731 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0958002d70 con 0x7f09600aac90 2023-07-14T12:58:15.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.868+0000 7f097cf5a700 1 -- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731] conn(0x7f09600aac90 msgr2=0x7f09600ad120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.868+0000 7f097cf5a700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731] conn(0x7f09600aac90 0x7f09600ad120 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.868+0000 7f097cf5a700 1 -- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f09600a11e0 msgr2=0x7f09600a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.868+0000 7f097cf5a700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f09600a11e0 0x7f09600a3690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0968009d20 tx=0x7f0968009260 comp rx=0 tx=0).stop 2023-07-14T12:58:15.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.868+0000 7f097cf5a700 1 -- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0978104ea0 msgr2=0x7f097819c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.868+0000 7f097cf5a700 1 --2- 172.21.15.17:0/991949586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0978104ea0 0x7f097819c830 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0970009fd0 tx=0x7f0970007910 comp rx=0 tx=0).stop 2023-07-14T12:58:15.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.868+0000 7f0976d9d700 1 -- 172.21.15.17:0/991949586 reap_dead start 2023-07-14T12:58:15.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.869+0000 7f097cf5a700 1 -- 172.21.15.17:0/991949586 shutdown_connections 2023-07-14T12:58:15.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.869+0000 7f097cf5a700 1 -- 172.21.15.17:0/991949586 >> 172.21.15.17:0/991949586 conn(0x7f09780fb660 msgr2=0x7f09780fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:15.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.869+0000 7f097cf5a700 1 -- 172.21.15.17:0/991949586 shutdown_connections 2023-07-14T12:58:15.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.869+0000 7f097cf5a700 1 -- 172.21.15.17:0/991949586 wait complete. 2023-07-14T12:58:15.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.883+0000 7f2c7eee7700 1 -- 172.21.15.17:0/2333076679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c781007a0 msgr2=0x7f2c78104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.883+0000 7f2c7eee7700 1 --2- 172.21.15.17:0/2333076679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c781007a0 0x7f2c78104770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2c640099c0 tx=0x7f2c64009cd0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.883+0000 7f2c7eee7700 1 -- 172.21.15.17:0/2333076679 shutdown_connections 2023-07-14T12:58:15.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.883+0000 7f2c7eee7700 1 --2- 172.21.15.17:0/2333076679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c78104ea0 0x7f2c7810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.883+0000 7f2c7eee7700 1 --2- 172.21.15.17:0/2333076679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c780ffe00 0x7f2c781001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.883+0000 7f2c7eee7700 1 --2- 172.21.15.17:0/2333076679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c781007a0 0x7f2c78104770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.883+0000 7f2c7eee7700 1 -- 172.21.15.17:0/2333076679 >> 172.21.15.17:0/2333076679 conn(0x7f2c780fb660 msgr2=0x7f2c780fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:15.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.883+0000 7f2c7eee7700 1 -- 172.21.15.17:0/2333076679 shutdown_connections 2023-07-14T12:58:15.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.883+0000 7f2c7eee7700 1 -- 172.21.15.17:0/2333076679 wait complete. 2023-07-14T12:58:15.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.884+0000 7f2c7eee7700 1 Processor -- start 2023-07-14T12:58:15.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.885+0000 7f2c7eee7700 1 -- start start 2023-07-14T12:58:15.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.885+0000 7f2c7eee7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c780ffe00 0x7f2c78197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.885+0000 7f2c7eee7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c781007a0 0x7f2c78198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.885+0000 7f2c7eee7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c78104ea0 0x7f2c7819c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.885+0000 7f2c7eee7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7819cec0 con 0x7f2c78104ea0 2023-07-14T12:58:15.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.885+0000 7f2c7eee7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7819d030 con 0x7f2c781007a0 2023-07-14T12:58:15.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.885+0000 7f2c7eee7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7819d1f0 con 0x7f2c780ffe00 2023-07-14T12:58:15.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.885+0000 7f2c77fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c781007a0 0x7f2c78198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.885+0000 7f2c7d484700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c78104ea0 0x7f2c7819c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.886+0000 7f2c77fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c781007a0 0x7f2c78198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:47150/0 (socket says 172.21.15.17:47150) 2023-07-14T12:58:15.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.886+0000 7f2c77fff700 1 -- 172.21.15.17:0/1019404367 learned_addr learned my addr 172.21.15.17:0/1019404367 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:15.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.886+0000 7f2c7cc83700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c780ffe00 0x7f2c78197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.886+0000 7f2c77fff700 1 -- 172.21.15.17:0/1019404367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c780ffe00 msgr2=0x7f2c78197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.886+0000 7f2c77fff700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c780ffe00 0x7f2c78197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.886+0000 7f2c77fff700 1 -- 172.21.15.17:0/1019404367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c78104ea0 msgr2=0x7f2c7819c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.886+0000 7f2c77fff700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c78104ea0 0x7f2c7819c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.886+0000 7f2c77fff700 1 -- 172.21.15.17:0/1019404367 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c640095f0 con 0x7f2c781007a0 2023-07-14T12:58:15.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.886+0000 7f2c77fff700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c781007a0 0x7f2c78198440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009990 tx=0x7f2c64009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.887+0000 7f2c75ffb700 1 -- 172.21.15.17:0/1019404367 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6401d070 con 0x7f2c781007a0 2023-07-14T12:58:15.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.887+0000 7f2c7eee7700 1 -- 172.21.15.17:0/1019404367 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7819d470 con 0x7f2c781007a0 2023-07-14T12:58:15.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.887+0000 7f2c75ffb700 1 -- 172.21.15.17:0/1019404367 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c64003ec0 con 0x7f2c781007a0 2023-07-14T12:58:15.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.887+0000 7f2c75ffb700 1 -- 172.21.15.17:0/1019404367 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64022bf0 con 0x7f2c781007a0 2023-07-14T12:58:15.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.887+0000 7f2c7eee7700 1 -- 172.21.15.17:0/1019404367 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c781a4d30 con 0x7f2c781007a0 2023-07-14T12:58:15.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.888+0000 7f2c7eee7700 1 -- 172.21.15.17:0/1019404367 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c7810fc00 con 0x7f2c781007a0 2023-07-14T12:58:15.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.890+0000 7f2c75ffb700 1 -- 172.21.15.17:0/1019404367 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f2c64022d50 con 0x7f2c781007a0 2023-07-14T12:58:15.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.893+0000 7f2c75ffb700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f2c680a11e0 0x7f2c680a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.893+0000 7f2c75ffb700 1 -- 172.21.15.17:0/1019404367 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f2c640ce750 con 0x7f2c781007a0 2023-07-14T12:58:15.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.893+0000 7f2c75ffb700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823] conn(0x7f2c680aac90 0x7f2c680ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:15.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.893+0000 7f2c75ffb700 1 -- 172.21.15.17:0/1019404367 --> [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c680ad7f0 con 0x7f2c680aac90 2023-07-14T12:58:15.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.893+0000 7f2c75ffb700 1 -- 172.21.15.17:0/1019404367 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c640ceac0 con 0x7f2c781007a0 2023-07-14T12:58:15.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.893+0000 7f2c7cc83700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f2c680a11e0 0x7f2c680a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.893+0000 7f2c7d484700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823] conn(0x7f2c680aac90 0x7f2c680ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:15.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.894+0000 7f2c7cc83700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f2c680a11e0 0x7f2c680a3690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c005950 tx=0x7f2c6c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.894+0000 7f2c7d484700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823] conn(0x7f2c680aac90 0x7f2c680ad120 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:15.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.895+0000 7f2c75ffb700 1 -- 172.21.15.17:0/1019404367 <== osd.10 v2:172.21.15.131:6824/3503442823 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2c680ad7f0 con 0x7f2c680aac90 2023-07-14T12:58:15.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.913+0000 7f2c7eee7700 1 -- 172.21.15.17:0/1019404367 --> [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c7804e210 con 0x7f2c680aac90 2023-07-14T12:58:15.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.914+0000 7f2c75ffb700 1 -- 172.21.15.17:0/1019404367 <== osd.10 v2:172.21.15.131:6824/3503442823 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2c7804e210 con 0x7f2c680aac90 2023-07-14T12:58:15.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.914+0000 7f2c7eee7700 1 -- 172.21.15.17:0/1019404367 >> [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823] conn(0x7f2c680aac90 msgr2=0x7f2c680ad120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.914+0000 7f2c7eee7700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823] conn(0x7f2c680aac90 0x7f2c680ad120 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.915+0000 7f2c7eee7700 1 -- 172.21.15.17:0/1019404367 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f2c680a11e0 msgr2=0x7f2c680a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.915+0000 7f2c7eee7700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f2c680a11e0 0x7f2c680a3690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c005950 tx=0x7f2c6c00b410 comp rx=0 tx=0).stop 2023-07-14T12:58:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.915+0000 7f2c7eee7700 1 -- 172.21.15.17:0/1019404367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c781007a0 msgr2=0x7f2c78198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:15.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.915+0000 7f2c7eee7700 1 --2- 172.21.15.17:0/1019404367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c781007a0 0x7f2c78198440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009990 tx=0x7f2c64009580 comp rx=0 tx=0).stop 2023-07-14T12:58:15.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.915+0000 7f2c7d484700 1 -- 172.21.15.17:0/1019404367 reap_dead start 2023-07-14T12:58:15.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.915+0000 7f2c7eee7700 1 -- 172.21.15.17:0/1019404367 shutdown_connections 2023-07-14T12:58:15.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.915+0000 7f2c7eee7700 1 -- 172.21.15.17:0/1019404367 >> 172.21.15.17:0/1019404367 conn(0x7f2c780fb660 msgr2=0x7f2c780fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:15.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.915+0000 7f2c7eee7700 1 -- 172.21.15.17:0/1019404367 shutdown_connections 2023-07-14T12:58:15.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.915+0000 7f2c7eee7700 1 -- 172.21.15.17:0/1019404367 wait complete. 2023-07-14T12:58:16.140 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:15 smithi017 ceph-mon[95536]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s; 18 B/s, 1 keys/s, 1 objects/s recovering 2023-07-14T12:58:16.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:15 smithi135 ceph-mon[97338]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s; 18 B/s, 1 keys/s, 1 objects/s recovering 2023-07-14T12:58:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.442+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/2096846711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2810a180 msgr2=0x7f7b2810c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.442+0000 7f7b2ee4f700 1 --2- 172.21.15.17:0/2096846711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2810a180 0x7f7b2810c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000b0a0 tx=0x7f7b2000b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.443+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/2096846711 shutdown_connections 2023-07-14T12:58:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.443+0000 7f7b2ee4f700 1 --2- 172.21.15.17:0/2096846711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2810a180 0x7f7b2810c5a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.443+0000 7f7b2ee4f700 1 --2- 172.21.15.17:0/2096846711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b28100c60 0x7f7b28101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.443+0000 7f7b2ee4f700 1 --2- 172.21.15.17:0/2096846711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b28101570 0x7f7b28109c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.443+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/2096846711 >> 172.21.15.17:0/2096846711 conn(0x7f7b28075b70 msgr2=0x7f7b28075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.443+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/2096846711 shutdown_connections 2023-07-14T12:58:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.443+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/2096846711 wait complete. 2023-07-14T12:58:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.445+0000 7f7b2ee4f700 1 Processor -- start 2023-07-14T12:58:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.445+0000 7f7b2ee4f700 1 -- start start 2023-07-14T12:58:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.445+0000 7f7b2ee4f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b28100c60 0x7f7b28199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.445+0000 7f7b2ee4f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b28101570 0x7f7b28199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.445+0000 7f7b2ee4f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2810a180 0x7f7b281938e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.445+0000 7f7b2ee4f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28193f50 con 0x7f7b2810a180 2023-07-14T12:58:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.445+0000 7f7b2ee4f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b281940c0 con 0x7f7b28100c60 2023-07-14T12:58:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.446+0000 7f7b2ee4f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28194280 con 0x7f7b28101570 2023-07-14T12:58:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.446+0000 7f7b2d3ec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2810a180 0x7f7b281938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.446+0000 7f7b2d3ec700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2810a180 0x7f7b281938e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35652/0 (socket says 172.21.15.17:35652) 2023-07-14T12:58:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.446+0000 7f7b2d3ec700 1 -- 172.21.15.17:0/80577585 learned_addr learned my addr 172.21.15.17:0/80577585 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.446+0000 7f7b2cbeb700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b28100c60 0x7f7b28199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.447+0000 7f7b2d3ec700 1 -- 172.21.15.17:0/80577585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b28101570 msgr2=0x7f7b28199da0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T12:58:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.447+0000 7f7b2d3ec700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b28101570 0x7f7b28199da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.447+0000 7f7b2d3ec700 1 -- 172.21.15.17:0/80577585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b28100c60 msgr2=0x7f7b28199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.447+0000 7f7b2d3ec700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b28100c60 0x7f7b28199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.447+0000 7f7b2d3ec700 1 -- 172.21.15.17:0/80577585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b20009d00 con 0x7f7b2810a180 2023-07-14T12:58:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.447+0000 7f7b2d3ec700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2810a180 0x7f7b281938e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7b200062a0 tx=0x7f7b2000bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.448+0000 7f7b25ffb700 1 -- 172.21.15.17:0/80577585 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000e040 con 0x7f7b2810a180 2023-07-14T12:58:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.448+0000 7f7b25ffb700 1 -- 172.21.15.17:0/80577585 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b20007880 con 0x7f7b2810a180 2023-07-14T12:58:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.448+0000 7f7b25ffb700 1 -- 172.21.15.17:0/80577585 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20005040 con 0x7f7b2810a180 2023-07-14T12:58:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.452+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/80577585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b28194500 con 0x7f7b2810a180 2023-07-14T12:58:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.452+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/80577585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2806a100 con 0x7f7b2810a180 2023-07-14T12:58:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.453+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/80577585 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b28194750 con 0x7f7b2810a180 2023-07-14T12:58:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.456+0000 7f7b25ffb700 1 -- 172.21.15.17:0/80577585 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f7b2001d480 con 0x7f7b2810a180 2023-07-14T12:58:16.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.457+0000 7f7b25ffb700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7b180a5770 0x7f7b180a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.458+0000 7f7b25ffb700 1 -- 172.21.15.17:0/80577585 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f7b200cdde0 con 0x7f7b2810a180 2023-07-14T12:58:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.458+0000 7f7b25ffb700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147] conn(0x7f7b180af220 0x7f7b180b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.458+0000 7f7b25ffb700 1 -- 172.21.15.17:0/80577585 --> [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b180b1d80 con 0x7f7b180af220 2023-07-14T12:58:16.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.458+0000 7f7b25ffb700 1 -- 172.21.15.17:0/80577585 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b200ce150 con 0x7f7b2810a180 2023-07-14T12:58:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.458+0000 7f7b2cbeb700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7b180a5770 0x7f7b180a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.458+0000 7f7b27fff700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147] conn(0x7f7b180af220 0x7f7b180b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.459+0000 7f7b2cbeb700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7b180a5770 0x7f7b180a7c20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009bf0 tx=0x7f7b1c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.459+0000 7f7b27fff700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147] conn(0x7f7b180af220 0x7f7b180b16b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.460+0000 7f7b25ffb700 1 -- 172.21.15.17:0/80577585 <== osd.7 v2:172.21.15.131:6816/2006382147 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7b180b1d80 con 0x7f7b180af220 2023-07-14T12:58:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.484+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/80577585 --> [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b280fdd40 con 0x7f7b180af220 2023-07-14T12:58:16.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.485+0000 7f7b25ffb700 1 -- 172.21.15.17:0/80577585 <== osd.7 v2:172.21.15.131:6816/2006382147 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7b280fdd40 con 0x7f7b180af220 2023-07-14T12:58:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.486+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/80577585 >> [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147] conn(0x7f7b180af220 msgr2=0x7f7b180b16b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.486+0000 7f7b2ee4f700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147] conn(0x7f7b180af220 0x7f7b180b16b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.487+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/80577585 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7b180a5770 msgr2=0x7f7b180a7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.487+0000 7f7b2ee4f700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7b180a5770 0x7f7b180a7c20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009bf0 tx=0x7f7b1c009260 comp rx=0 tx=0).stop 2023-07-14T12:58:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.487+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/80577585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2810a180 msgr2=0x7f7b281938e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.487+0000 7f7b2ee4f700 1 --2- 172.21.15.17:0/80577585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2810a180 0x7f7b281938e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7b200062a0 tx=0x7f7b2000bd90 comp rx=0 tx=0).stop 2023-07-14T12:58:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.487+0000 7f7b2d3ec700 1 -- 172.21.15.17:0/80577585 reap_dead start 2023-07-14T12:58:16.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.487+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/80577585 shutdown_connections 2023-07-14T12:58:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.487+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/80577585 >> 172.21.15.17:0/80577585 conn(0x7f7b28075b70 msgr2=0x7f7b280fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.487+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/80577585 shutdown_connections 2023-07-14T12:58:16.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:15.487+0000 7f7b2ee4f700 1 -- 172.21.15.17:0/80577585 wait complete. 2023-07-14T12:58:16.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:15 smithi131 ceph-mon[96953]: pgmap v322: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s; 18 B/s, 1 keys/s, 1 objects/s recovering 2023-07-14T12:58:16.640 INFO:teuthology.orchestra.run.smithi017.stdout:77309411396 2023-07-14T12:58:16.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.2 2023-07-14T12:58:16.781 INFO:teuthology.orchestra.run.smithi017.stdout:34359738447 2023-07-14T12:58:16.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.0 2023-07-14T12:58:17.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.250+0000 7f9d99da7700 1 -- 172.21.15.17:0/2046061877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d9410a140 msgr2=0x7f9d9410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:17.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.250+0000 7f9d99da7700 1 --2- 172.21.15.17:0/2046061877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d9410a140 0x7f9d9410c580 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00b0a0 tx=0x7f9d8c00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:17.282 INFO:teuthology.orchestra.run.smithi017.stdout:292057776158 2023-07-14T12:58:17.282 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.9 2023-07-14T12:58:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.251+0000 7f9d99da7700 1 -- 172.21.15.17:0/2046061877 shutdown_connections 2023-07-14T12:58:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.251+0000 7f9d99da7700 1 --2- 172.21.15.17:0/2046061877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d9410a140 0x7f9d9410c580 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:17.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.251+0000 7f9d99da7700 1 --2- 172.21.15.17:0/2046061877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94100df0 0x7f9d941011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:17.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.251+0000 7f9d99da7700 1 --2- 172.21.15.17:0/2046061877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d94101700 0x7f9d94109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:17.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.251+0000 7f9d99da7700 1 -- 172.21.15.17:0/2046061877 >> 172.21.15.17:0/2046061877 conn(0x7f9d94075b70 msgr2=0x7f9d94075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:17.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.252+0000 7f9d99da7700 1 -- 172.21.15.17:0/2046061877 shutdown_connections 2023-07-14T12:58:17.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.252+0000 7f9d99da7700 1 -- 172.21.15.17:0/2046061877 wait complete. 2023-07-14T12:58:17.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.253+0000 7f9d99da7700 1 Processor -- start 2023-07-14T12:58:17.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.253+0000 7f9d99da7700 1 -- start start 2023-07-14T12:58:17.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.253+0000 7f9d99da7700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d94100df0 0x7f9d94197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:17.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.253+0000 7f9d99da7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94101700 0x7f9d941982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:17.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.254+0000 7f9d99da7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d9410a140 0x7f9d9419c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:17.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.254+0000 7f9d99da7700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9419cd70 con 0x7f9d94100df0 2023-07-14T12:58:17.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.254+0000 7f9d99da7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9419cee0 con 0x7f9d94101700 2023-07-14T12:58:17.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.254+0000 7f9d99da7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9419d0a0 con 0x7f9d9410a140 2023-07-14T12:58:17.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.254+0000 7f9d92ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94101700 0x7f9d941982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:17.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.254+0000 7f9d937fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d94100df0 0x7f9d94197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:17.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.254+0000 7f9d92ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94101700 0x7f9d941982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:47170/0 (socket says 172.21.15.17:47170) 2023-07-14T12:58:17.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.254+0000 7f9d93fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d9410a140 0x7f9d9419c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:17.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.254+0000 7f9d92ffd700 1 -- 172.21.15.17:0/3848589239 learned_addr learned my addr 172.21.15.17:0/3848589239 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:17.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.254+0000 7f9d937fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d94100df0 0x7f9d94197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35702/0 (socket says 172.21.15.17:35702) 2023-07-14T12:58:17.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.255+0000 7f9d92ffd700 1 -- 172.21.15.17:0/3848589239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d9410a140 msgr2=0x7f9d9419c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:17.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.255+0000 7f9d92ffd700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d9410a140 0x7f9d9419c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:17.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.255+0000 7f9d92ffd700 1 -- 172.21.15.17:0/3848589239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d94100df0 msgr2=0x7f9d94197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:17.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.255+0000 7f9d92ffd700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d94100df0 0x7f9d94197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:17.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.255+0000 7f9d92ffd700 1 -- 172.21.15.17:0/3848589239 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c009d00 con 0x7f9d94101700 2023-07-14T12:58:17.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.255+0000 7f9d92ffd700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94101700 0x7f9d941982f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e9a0 tx=0x7f9d8800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:17.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.255+0000 7f9d90ff9700 1 -- 172.21.15.17:0/3848589239 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88009790 con 0x7f9d94101700 2023-07-14T12:58:17.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.255+0000 7f9d90ff9700 1 -- 172.21.15.17:0/3848589239 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d88010430 con 0x7f9d94101700 2023-07-14T12:58:17.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.255+0000 7f9d90ff9700 1 -- 172.21.15.17:0/3848589239 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800cea0 con 0x7f9d94101700 2023-07-14T12:58:17.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.255+0000 7f9d99da7700 1 -- 172.21.15.17:0/3848589239 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9419d380 con 0x7f9d94101700 2023-07-14T12:58:17.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.256+0000 7f9d99da7700 1 -- 172.21.15.17:0/3848589239 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d941a4be0 con 0x7f9d94101700 2023-07-14T12:58:17.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.257+0000 7f9d99da7700 1 -- 172.21.15.17:0/3848589239 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d9410fbe0 con 0x7f9d94101700 2023-07-14T12:58:17.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.260+0000 7f9d90ff9700 1 -- 172.21.15.17:0/3848589239 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9d880105a0 con 0x7f9d94101700 2023-07-14T12:58:17.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.262+0000 7f9d90ff9700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9d7c0a1260 0x7f9d7c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:17.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.262+0000 7f9d90ff9700 1 -- 172.21.15.17:0/3848589239 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f9d88014070 con 0x7f9d94101700 2023-07-14T12:58:17.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.263+0000 7f9d90ff9700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895] conn(0x7f9d7c0aad10 0x7f9d7c0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:17.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.263+0000 7f9d90ff9700 1 -- 172.21.15.17:0/3848589239 --> [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d7c0ad870 con 0x7f9d7c0aad10 2023-07-14T12:58:17.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.263+0000 7f9d90ff9700 1 -- 172.21.15.17:0/3848589239 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d880ccd20 con 0x7f9d94101700 2023-07-14T12:58:17.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.263+0000 7f9d937fe700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9d7c0a1260 0x7f9d7c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:17.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.263+0000 7f9d93fff700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895] conn(0x7f9d7c0aad10 0x7f9d7c0ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:17.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.264+0000 7f9d937fe700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9d7c0a1260 0x7f9d7c0a3710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9d84005950 tx=0x7f9d8400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:17.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.264+0000 7f9d93fff700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895] conn(0x7f9d7c0aad10 0x7f9d7c0ad1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:17.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.265+0000 7f9d90ff9700 1 -- 172.21.15.17:0/3848589239 <== osd.8 v2:172.21.15.135:6816/4144218895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9d7c0ad870 con 0x7f9d7c0aad10 2023-07-14T12:58:17.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.289+0000 7f9d99da7700 1 -- 172.21.15.17:0/3848589239 --> [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d9404e210 con 0x7f9d7c0aad10 2023-07-14T12:58:17.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.290+0000 7f9d90ff9700 1 -- 172.21.15.17:0/3848589239 <== osd.8 v2:172.21.15.135:6816/4144218895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9d9404e210 con 0x7f9d7c0aad10 2023-07-14T12:58:17.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.290+0000 7f9d99da7700 1 -- 172.21.15.17:0/3848589239 >> [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895] conn(0x7f9d7c0aad10 msgr2=0x7f9d7c0ad1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:17.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.290+0000 7f9d99da7700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895] conn(0x7f9d7c0aad10 0x7f9d7c0ad1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:17.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.290+0000 7f9d99da7700 1 -- 172.21.15.17:0/3848589239 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9d7c0a1260 msgr2=0x7f9d7c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:17.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.290+0000 7f9d99da7700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9d7c0a1260 0x7f9d7c0a3710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9d84005950 tx=0x7f9d8400b410 comp rx=0 tx=0).stop 2023-07-14T12:58:17.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.290+0000 7f9d99da7700 1 -- 172.21.15.17:0/3848589239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94101700 msgr2=0x7f9d941982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:17.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.290+0000 7f9d99da7700 1 --2- 172.21.15.17:0/3848589239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94101700 0x7f9d941982f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e9a0 tx=0x7f9d8800ecb0 comp rx=0 tx=0).stop 2023-07-14T12:58:17.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.291+0000 7f9d93fff700 1 -- 172.21.15.17:0/3848589239 reap_dead start 2023-07-14T12:58:17.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.291+0000 7f9d99da7700 1 -- 172.21.15.17:0/3848589239 shutdown_connections 2023-07-14T12:58:17.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.291+0000 7f9d99da7700 1 -- 172.21.15.17:0/3848589239 >> 172.21.15.17:0/3848589239 conn(0x7f9d94075b70 msgr2=0x7f9d9410a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:17.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.291+0000 7f9d99da7700 1 -- 172.21.15.17:0/3848589239 shutdown_connections 2023-07-14T12:58:17.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:17.291+0000 7f9d99da7700 1 -- 172.21.15.17:0/3848589239 wait complete. 2023-07-14T12:58:17.406 INFO:teuthology.orchestra.run.smithi017.stdout:347892350995 2023-07-14T12:58:17.407 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.11 2023-07-14T12:58:17.668 INFO:teuthology.orchestra.run.smithi017.stdout:223338299435 2023-07-14T12:58:17.668 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.7 2023-07-14T12:58:18.163 INFO:teuthology.orchestra.run.smithi017.stdout:257698037798 2023-07-14T12:58:18.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.8 2023-07-14T12:58:18.284 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:17 smithi017 ceph-mon[95536]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 206 B/s wr, 6 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2023-07-14T12:58:18.285 INFO:teuthology.orchestra.run.smithi017.stdout:201863462959 2023-07-14T12:58:18.286 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.6 2023-07-14T12:58:18.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:17 smithi135 ceph-mon[97338]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 206 B/s wr, 6 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2023-07-14T12:58:18.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:17 smithi131 ceph-mon[96953]: pgmap v323: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 206 B/s wr, 6 op/s; 14 B/s, 1 keys/s, 1 objects/s recovering 2023-07-14T12:58:18.964 INFO:teuthology.orchestra.run.smithi017.stdout:313532612633 2023-07-14T12:58:18.965 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.10 2023-07-14T12:58:19.016 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:19.035 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:19.061 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:19.703 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:20.243 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:19 smithi017 ceph-mon[95536]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 188 B/s wr, 5 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2023-07-14T12:58:20.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:19 smithi135 ceph-mon[97338]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 188 B/s wr, 5 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2023-07-14T12:58:20.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:19 smithi131 ceph-mon[96953]: pgmap v324: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 188 B/s wr, 5 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2023-07-14T12:58:20.734 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:20.753 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:20.878 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:22.094 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:22.096 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:22.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:21 smithi017 ceph-mon[95536]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2023-07-14T12:58:22.401 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:22.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:21 smithi135 ceph-mon[97338]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2023-07-14T12:58:22.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:21 smithi131 ceph-mon[96953]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2023-07-14T12:58:23.448 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:24.331 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:23 smithi017 ceph-mon[95536]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2023-07-14T12:58:24.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:23 smithi135 ceph-mon[97338]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2023-07-14T12:58:24.495 INFO:teuthology.orchestra.run.smithi017.stdout:167503724599 2023-07-14T12:58:24.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.029+0000 7fed7c6cc700 1 -- 172.21.15.17:0/2328206211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed741007a0 msgr2=0x7fed74104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:24.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.029+0000 7fed7c6cc700 1 --2- 172.21.15.17:0/2328206211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed741007a0 0x7fed74104770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fed640099c0 tx=0x7fed64009cd0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.029+0000 7fed7c6cc700 1 -- 172.21.15.17:0/2328206211 shutdown_connections 2023-07-14T12:58:24.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.029+0000 7fed7c6cc700 1 --2- 172.21.15.17:0/2328206211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed74104ea0 0x7fed7410ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.029+0000 7fed7c6cc700 1 --2- 172.21.15.17:0/2328206211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed740ffe00 0x7fed741001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.029+0000 7fed7c6cc700 1 --2- 172.21.15.17:0/2328206211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed741007a0 0x7fed74104770 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.029+0000 7fed7c6cc700 1 -- 172.21.15.17:0/2328206211 >> 172.21.15.17:0/2328206211 conn(0x7fed740fb660 msgr2=0x7fed740fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:24.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.029+0000 7fed7c6cc700 1 -- 172.21.15.17:0/2328206211 shutdown_connections 2023-07-14T12:58:24.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.029+0000 7fed7c6cc700 1 -- 172.21.15.17:0/2328206211 wait complete. 2023-07-14T12:58:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.030+0000 7fed7c6cc700 1 Processor -- start 2023-07-14T12:58:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.031+0000 7fed7c6cc700 1 -- start start 2023-07-14T12:58:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.031+0000 7fed7c6cc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed740ffe00 0x7fed74072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.031+0000 7fed7c6cc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed741007a0 0x7fed74072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.031+0000 7fed7c6cc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed74104ea0 0x7fed740732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.031+0000 7fed7c6cc700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed741a4040 con 0x7fed74104ea0 2023-07-14T12:58:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.031+0000 7fed7c6cc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed741a41b0 con 0x7fed740ffe00 2023-07-14T12:58:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.031+0000 7fed7c6cc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed741a4370 con 0x7fed741007a0 2023-07-14T12:58:24.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.031+0000 7fed7ac69700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed74104ea0 0x7fed740732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:24.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.031+0000 7fed7ac69700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed74104ea0 0x7fed740732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35718/0 (socket says 172.21.15.17:35718) 2023-07-14T12:58:24.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.031+0000 7fed7ac69700 1 -- 172.21.15.17:0/4005170147 learned_addr learned my addr 172.21.15.17:0/4005170147 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:24.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed7a468700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed740ffe00 0x7fed74072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:24.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed79c67700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed741007a0 0x7fed74072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:24.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed7ac69700 1 -- 172.21.15.17:0/4005170147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed741007a0 msgr2=0x7fed74072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:24.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed7ac69700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed741007a0 0x7fed74072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed7ac69700 1 -- 172.21.15.17:0/4005170147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed740ffe00 msgr2=0x7fed74072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:24.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed7ac69700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed740ffe00 0x7fed74072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed7ac69700 1 -- 172.21.15.17:0/4005170147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640095f0 con 0x7fed74104ea0 2023-07-14T12:58:24.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed7ac69700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed74104ea0 0x7fed740732d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00ef30 tx=0x7fed6c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed6b7fe700 1 -- 172.21.15.17:0/4005170147 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c018070 con 0x7fed74104ea0 2023-07-14T12:58:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed7c6cc700 1 -- 172.21.15.17:0/4005170147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed741a45f0 con 0x7fed74104ea0 2023-07-14T12:58:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed6b7fe700 1 -- 172.21.15.17:0/4005170147 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed6c00f040 con 0x7fed74104ea0 2023-07-14T12:58:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.032+0000 7fed6b7fe700 1 -- 172.21.15.17:0/4005170147 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c00cc70 con 0x7fed74104ea0 2023-07-14T12:58:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.033+0000 7fed7c6cc700 1 -- 172.21.15.17:0/4005170147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed741a4a70 con 0x7fed74104ea0 2023-07-14T12:58:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.034+0000 7fed7c6cc700 1 -- 172.21.15.17:0/4005170147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7404e210 con 0x7fed74104ea0 2023-07-14T12:58:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.036+0000 7fed6b7fe700 1 -- 172.21.15.17:0/4005170147 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fed6c007500 con 0x7fed74104ea0 2023-07-14T12:58:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.037+0000 7fed6b7fe700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed600a11e0 0x7fed600a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:24.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.037+0000 7fed6b7fe700 1 -- 172.21.15.17:0/4005170147 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fed6c0cc5c0 con 0x7fed74104ea0 2023-07-14T12:58:24.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.037+0000 7fed7a468700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed600a11e0 0x7fed600a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:24.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.038+0000 7fed7a468700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed600a11e0 0x7fed600a3690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed70007be0 tx=0x7fed700073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:24.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.042+0000 7fed6b7fe700 1 -- 172.21.15.17:0/4005170147 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fed6c095c10 con 0x7fed74104ea0 2023-07-14T12:58:24.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.276+0000 7fed7c6cc700 1 -- 172.21.15.17:0/4005170147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fed741a4dc0 con 0x7fed74104ea0 2023-07-14T12:58:24.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.277+0000 7fed6b7fe700 1 -- 172.21.15.17:0/4005170147 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed6c099230 con 0x7fed74104ea0 2023-07-14T12:58:24.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.279+0000 7fed7c6cc700 1 -- 172.21.15.17:0/4005170147 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed600a11e0 msgr2=0x7fed600a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:24.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.279+0000 7fed7c6cc700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed600a11e0 0x7fed600a3690 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed70007be0 tx=0x7fed700073d0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.279+0000 7fed7c6cc700 1 -- 172.21.15.17:0/4005170147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed74104ea0 msgr2=0x7fed740732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:24.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.279+0000 7fed7c6cc700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed74104ea0 0x7fed740732d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00ef30 tx=0x7fed6c00c3a0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.279+0000 7fed7c6cc700 1 -- 172.21.15.17:0/4005170147 shutdown_connections 2023-07-14T12:58:24.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.279+0000 7fed7c6cc700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fed600a11e0 0x7fed600a3690 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.279+0000 7fed7c6cc700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed74104ea0 0x7fed740732d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.279+0000 7fed7c6cc700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed740ffe00 0x7fed74072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.279+0000 7fed7c6cc700 1 --2- 172.21.15.17:0/4005170147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed741007a0 0x7fed74072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.279+0000 7fed7c6cc700 1 -- 172.21.15.17:0/4005170147 >> 172.21.15.17:0/4005170147 conn(0x7fed740fb660 msgr2=0x7fed740fc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.280+0000 7fed7c6cc700 1 -- 172.21.15.17:0/4005170147 shutdown_connections 2023-07-14T12:58:24.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:24.280+0000 7fed7c6cc700 1 -- 172.21.15.17:0/4005170147 wait complete. 2023-07-14T12:58:24.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:23 smithi131 ceph-mon[96953]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2023-07-14T12:58:25.271 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:24 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/4005170147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-14T12:58:25.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:24 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/4005170147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-14T12:58:25.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:24 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/4005170147' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-14T12:58:25.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.557+0000 7ff0e87dc700 1 -- 172.21.15.17:0/1103696257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0e00728b0 msgr2=0x7ff0e0072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:25.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.557+0000 7ff0e87dc700 1 --2- 172.21.15.17:0/1103696257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0e00728b0 0x7ff0e0072c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0099c0 tx=0x7ff0dc009cd0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.557+0000 7ff0e87dc700 1 -- 172.21.15.17:0/1103696257 shutdown_connections 2023-07-14T12:58:25.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.557+0000 7ff0e87dc700 1 --2- 172.21.15.17:0/1103696257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e0110bb0 0x7ff0e0112f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.557+0000 7ff0e87dc700 1 --2- 172.21.15.17:0/1103696257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0e00728b0 0x7ff0e0072c80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.557+0000 7ff0e87dc700 1 --2- 172.21.15.17:0/1103696257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0e00731c0 0x7ff0e0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.557+0000 7ff0e87dc700 1 -- 172.21.15.17:0/1103696257 >> 172.21.15.17:0/1103696257 conn(0x7ff0e00fb660 msgr2=0x7ff0e00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:25.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.557+0000 7ff0e87dc700 1 -- 172.21.15.17:0/1103696257 shutdown_connections 2023-07-14T12:58:25.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.557+0000 7ff0e87dc700 1 -- 172.21.15.17:0/1103696257 wait complete. 2023-07-14T12:58:25.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.558+0000 7ff0e87dc700 1 Processor -- start 2023-07-14T12:58:25.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.559+0000 7ff0e87dc700 1 -- start start 2023-07-14T12:58:25.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.559+0000 7ff0e87dc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0e00728b0 0x7ff0e019c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:25.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.559+0000 7ff0e87dc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0e00731c0 0x7ff0e019c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:25.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.559+0000 7ff0e5d77700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0e00731c0 0x7ff0e019c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.559+0000 7ff0e5d77700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0e00731c0 0x7ff0e019c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60874/0 (socket says 172.21.15.17:60874) 2023-07-14T12:58:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e87dc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e0110bb0 0x7ff0e01a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e87dc700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01a11c0 con 0x7ff0e00731c0 2023-07-14T12:58:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e87dc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01a1330 con 0x7ff0e0110bb0 2023-07-14T12:58:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e87dc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01a14f0 con 0x7ff0e00728b0 2023-07-14T12:58:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e5d77700 1 -- 172.21.15.17:0/783244321 learned_addr learned my addr 172.21.15.17:0/783244321 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e6578700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0e00728b0 0x7ff0e019c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e6d79700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e0110bb0 0x7ff0e01a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e6578700 1 -- 172.21.15.17:0/783244321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e0110bb0 msgr2=0x7ff0e01a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:25.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e6578700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e0110bb0 0x7ff0e01a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e6578700 1 -- 172.21.15.17:0/783244321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0e00731c0 msgr2=0x7ff0e019c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:25.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e6578700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0e00731c0 0x7ff0e019c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e6578700 1 -- 172.21.15.17:0/783244321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8009c40 con 0x7ff0e00728b0 2023-07-14T12:58:25.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.560+0000 7ff0e5d77700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0e00731c0 0x7ff0e019c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:58:25.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.561+0000 7ff0e6578700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0e00728b0 0x7ff0e019c200 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0098e0 tx=0x7ff0dc00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:25.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.561+0000 7ff0d77fe700 1 -- 172.21.15.17:0/783244321 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc01d070 con 0x7ff0e00728b0 2023-07-14T12:58:25.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.561+0000 7ff0e87dc700 1 -- 172.21.15.17:0/783244321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc0095f0 con 0x7ff0e00728b0 2023-07-14T12:58:25.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.561+0000 7ff0d77fe700 1 -- 172.21.15.17:0/783244321 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0dc005050 con 0x7ff0e00728b0 2023-07-14T12:58:25.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.561+0000 7ff0d77fe700 1 -- 172.21.15.17:0/783244321 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc004a70 con 0x7ff0e00728b0 2023-07-14T12:58:25.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.561+0000 7ff0e87dc700 1 -- 172.21.15.17:0/783244321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e01a8e60 con 0x7ff0e00728b0 2023-07-14T12:58:25.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.562+0000 7ff0e87dc700 1 -- 172.21.15.17:0/783244321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e0103090 con 0x7ff0e00728b0 2023-07-14T12:58:25.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.565+0000 7ff0d77fe700 1 -- 172.21.15.17:0/783244321 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff0dc0051c0 con 0x7ff0e00728b0 2023-07-14T12:58:25.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.566+0000 7ff0d77fe700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0cc0a1260 0x7ff0cc0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:25.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.567+0000 7ff0d77fe700 1 -- 172.21.15.17:0/783244321 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7ff0dc0cd6d0 con 0x7ff0e00728b0 2023-07-14T12:58:25.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.567+0000 7ff0e5d77700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0cc0a1260 0x7ff0cc0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:25.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.568+0000 7ff0e5d77700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0cc0a1260 0x7ff0cc0a3710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0e019d820 tx=0x7ff0d0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:25.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.570+0000 7ff0d77fe700 1 -- 172.21.15.17:0/783244321 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff0dc096d20 con 0x7ff0e00728b0 2023-07-14T12:58:25.627 INFO:teuthology.orchestra.run.smithi017.stdout:257698037799 2023-07-14T12:58:25.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.116+0000 7f25c5fc1700 1 -- 172.21.15.17:0/2813869124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c0072850 msgr2=0x7f25c0072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.116+0000 7f25c5fc1700 1 --2- 172.21.15.17:0/2813869124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c0072850 0x7f25c0072c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009990 tx=0x7f25b0009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.117+0000 7f25c5fc1700 1 -- 172.21.15.17:0/2813869124 shutdown_connections 2023-07-14T12:58:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.117+0000 7f25c5fc1700 1 --2- 172.21.15.17:0/2813869124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25c010c490 0x7f25c010e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.117+0000 7f25c5fc1700 1 --2- 172.21.15.17:0/2813869124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c0072850 0x7f25c0072c20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.117+0000 7f25c5fc1700 1 --2- 172.21.15.17:0/2813869124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c0073160 0x7f25c010bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.117+0000 7f25c5fc1700 1 -- 172.21.15.17:0/2813869124 >> 172.21.15.17:0/2813869124 conn(0x7f25c00fb710 msgr2=0x7f25c00fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.117+0000 7f25c5fc1700 1 -- 172.21.15.17:0/2813869124 shutdown_connections 2023-07-14T12:58:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.117+0000 7f25c5fc1700 1 -- 172.21.15.17:0/2813869124 wait complete. 2023-07-14T12:58:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.118+0000 7f25c5fc1700 1 Processor -- start 2023-07-14T12:58:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.118+0000 7f25c5fc1700 1 -- start start 2023-07-14T12:58:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.119+0000 7f25c5fc1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c0072850 0x7f25c0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.119+0000 7f25c5fc1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c0073160 0x7f25c01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.119+0000 7f25c5fc1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25c010c490 0x7f25c019c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.119+0000 7f25c5fc1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c019ce20 con 0x7f25c0072850 2023-07-14T12:58:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.119+0000 7f25c5fc1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c019cf90 con 0x7f25c010c490 2023-07-14T12:58:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.119+0000 7f25c5fc1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c019d150 con 0x7f25c0073160 2023-07-14T12:58:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.119+0000 7f25beffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c0073160 0x7f25c01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.119+0000 7f25beffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c0073160 0x7f25c01983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39262/0 (socket says 172.21.15.17:39262) 2023-07-14T12:58:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.119+0000 7f25beffd700 1 -- 172.21.15.17:0/1595617632 learned_addr learned my addr 172.21.15.17:0/1595617632 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.119+0000 7f25bffff700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25c010c490 0x7f25c019c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.120+0000 7f25bf7fe700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c0072850 0x7f25c0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:25.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.120+0000 7f25beffd700 1 -- 172.21.15.17:0/1595617632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25c010c490 msgr2=0x7f25c019c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.120+0000 7f25beffd700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25c010c490 0x7f25c019c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.120+0000 7f25beffd700 1 -- 172.21.15.17:0/1595617632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c0072850 msgr2=0x7f25c0197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.120+0000 7f25beffd700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c0072850 0x7f25c0197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.120+0000 7f25beffd700 1 -- 172.21.15.17:0/1595617632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b00095f0 con 0x7f25c0073160 2023-07-14T12:58:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.120+0000 7f25beffd700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c0073160 0x7f25c01983a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f25b400b530 tx=0x7f25b400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.121+0000 7f25bcff9700 1 -- 172.21.15.17:0/1595617632 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4011830 con 0x7f25c0073160 2023-07-14T12:58:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.121+0000 7f25c5fc1700 1 -- 172.21.15.17:0/1595617632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c019d430 con 0x7f25c0073160 2023-07-14T12:58:25.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.121+0000 7f25bcff9700 1 -- 172.21.15.17:0/1595617632 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25b4011e20 con 0x7f25c0073160 2023-07-14T12:58:25.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.121+0000 7f25bcff9700 1 -- 172.21.15.17:0/1595617632 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400f2e0 con 0x7f25c0073160 2023-07-14T12:58:25.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.121+0000 7f25c5fc1700 1 -- 172.21.15.17:0/1595617632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c01a4c90 con 0x7f25c0073160 2023-07-14T12:58:25.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.122+0000 7f25c5fc1700 1 -- 172.21.15.17:0/1595617632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c004e210 con 0x7f25c0073160 2023-07-14T12:58:25.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.124+0000 7f25bcff9700 1 -- 172.21.15.17:0/1595617632 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f25b4011990 con 0x7f25c0073160 2023-07-14T12:58:25.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.125+0000 7f25bcff9700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f25a80a1260 0x7f25a80a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.126+0000 7f25bcff9700 1 -- 172.21.15.17:0/1595617632 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f25b40cc480 con 0x7f25c0073160 2023-07-14T12:58:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.126+0000 7f25bf7fe700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f25a80a1260 0x7f25a80a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.127+0000 7f25bf7fe700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f25a80a1260 0x7f25a80a3710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f25b0006010 tx=0x7f25b000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.130+0000 7f25bcff9700 1 -- 172.21.15.17:0/1595617632 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f25b4095b50 con 0x7f25c0073160 2023-07-14T12:58:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.379+0000 7f25c5fc1700 1 -- 172.21.15.17:0/1595617632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f25c01a4ee0 con 0x7f25c0073160 2023-07-14T12:58:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.380+0000 7f25bcff9700 1 -- 172.21.15.17:0/1595617632 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25b4099170 con 0x7f25c0073160 2023-07-14T12:58:25.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.382+0000 7f25c5fc1700 1 -- 172.21.15.17:0/1595617632 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f25a80a1260 msgr2=0x7f25a80a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.382+0000 7f25c5fc1700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f25a80a1260 0x7f25a80a3710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f25b0006010 tx=0x7f25b000b260 comp rx=0 tx=0).stop 2023-07-14T12:58:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.382+0000 7f25c5fc1700 1 -- 172.21.15.17:0/1595617632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c0073160 msgr2=0x7f25c01983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.382+0000 7f25c5fc1700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c0073160 0x7f25c01983a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f25b400b530 tx=0x7f25b400b840 comp rx=0 tx=0).stop 2023-07-14T12:58:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.383+0000 7f25c5fc1700 1 -- 172.21.15.17:0/1595617632 shutdown_connections 2023-07-14T12:58:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.383+0000 7f25c5fc1700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f25a80a1260 0x7f25a80a3710 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.383+0000 7f25c5fc1700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25c010c490 0x7f25c019c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.383+0000 7f25c5fc1700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25c0072850 0x7f25c0197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.383+0000 7f25c5fc1700 1 --2- 172.21.15.17:0/1595617632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25c0073160 0x7f25c01983a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.383+0000 7f25c5fc1700 1 -- 172.21.15.17:0/1595617632 >> 172.21.15.17:0/1595617632 conn(0x7f25c00fb710 msgr2=0x7f25c010e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.383+0000 7f25c5fc1700 1 -- 172.21.15.17:0/1595617632 shutdown_connections 2023-07-14T12:58:25.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.383+0000 7f25c5fc1700 1 -- 172.21.15.17:0/1595617632 wait complete. 2023-07-14T12:58:25.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.795+0000 7ff0e87dc700 1 -- 172.21.15.17:0/783244321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff0e004e210 con 0x7ff0e00728b0 2023-07-14T12:58:25.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.796+0000 7ff0d77fe700 1 -- 172.21.15.17:0/783244321 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff0dc09a340 con 0x7ff0e00728b0 2023-07-14T12:58:25.825 INFO:teuthology.orchestra.run.smithi017.stdout:34359738449 2023-07-14T12:58:25.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 -- 172.21.15.17:0/783244321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0cc0a1260 msgr2=0x7ff0cc0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:25.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0cc0a1260 0x7ff0cc0a3710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0e019d820 tx=0x7ff0d0009260 comp rx=0 tx=0).stop 2023-07-14T12:58:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 -- 172.21.15.17:0/783244321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0e00728b0 msgr2=0x7ff0e019c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0e00728b0 0x7ff0e019c200 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0098e0 tx=0x7ff0dc00f690 comp rx=0 tx=0).stop 2023-07-14T12:58:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 -- 172.21.15.17:0/783244321 shutdown_connections 2023-07-14T12:58:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff0cc0a1260 0x7ff0cc0a3710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e0110bb0 0x7ff0e01a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0e00728b0 0x7ff0e019c200 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 --2- 172.21.15.17:0/783244321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0e00731c0 0x7ff0e019c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:25.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 -- 172.21.15.17:0/783244321 >> 172.21.15.17:0/783244321 conn(0x7ff0e00fb660 msgr2=0x7ff0e00fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:25.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 -- 172.21.15.17:0/783244321 shutdown_connections 2023-07-14T12:58:25.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.798+0000 7ff0e87dc700 1 -- 172.21.15.17:0/783244321 wait complete. 2023-07-14T12:58:25.940 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724596 got 167503724599 for osd.5 2023-07-14T12:58:25.941 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:26.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:25 smithi017 ceph-mon[95536]: pgmap v327: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2023-07-14T12:58:26.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:25 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1595617632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-07-14T12:58:26.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:25 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/889211139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-14T12:58:26.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:25 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/783244321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-14T12:58:26.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.155+0000 7f4e589a3700 1 -- 172.21.15.17:0/144683556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e541007a0 msgr2=0x7f4e54104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:26.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.155+0000 7f4e589a3700 1 --2- 172.21.15.17:0/144683556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e541007a0 0x7f4e54104770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0099c0 tx=0x7f4e3c009cd0 comp rx=0 tx=0).stop 2023-07-14T12:58:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.155+0000 7f4e589a3700 1 -- 172.21.15.17:0/144683556 shutdown_connections 2023-07-14T12:58:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.155+0000 7f4e589a3700 1 --2- 172.21.15.17:0/144683556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e54104ea0 0x7f4e5410ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.155+0000 7f4e589a3700 1 --2- 172.21.15.17:0/144683556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e540ffe00 0x7f4e541001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.155+0000 7f4e589a3700 1 --2- 172.21.15.17:0/144683556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e541007a0 0x7f4e54104770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:26.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.155+0000 7f4e589a3700 1 -- 172.21.15.17:0/144683556 >> 172.21.15.17:0/144683556 conn(0x7f4e540fb660 msgr2=0x7f4e540fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:26.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.155+0000 7f4e589a3700 1 -- 172.21.15.17:0/144683556 shutdown_connections 2023-07-14T12:58:26.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.155+0000 7f4e589a3700 1 -- 172.21.15.17:0/144683556 wait complete. 2023-07-14T12:58:26.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.156+0000 7f4e589a3700 1 Processor -- start 2023-07-14T12:58:26.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.156+0000 7f4e589a3700 1 -- start start 2023-07-14T12:58:26.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.157+0000 7f4e589a3700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e540ffe00 0x7f4e541997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:26.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.157+0000 7f4e589a3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e541007a0 0x7f4e54199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:26.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.157+0000 7f4e589a3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e54104ea0 0x7f4e54193830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:26.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.157+0000 7f4e589a3700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54193ea0 con 0x7f4e540ffe00 2023-07-14T12:58:26.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.157+0000 7f4e589a3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54194010 con 0x7f4e541007a0 2023-07-14T12:58:26.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.157+0000 7f4e589a3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e541941d0 con 0x7f4e54104ea0 2023-07-14T12:58:26.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.157+0000 7f4e51d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e541007a0 0x7f4e54199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:26.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.157+0000 7f4e5259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e540ffe00 0x7f4e541997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:26.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.157+0000 7f4e51d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e541007a0 0x7f4e54199cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49634/0 (socket says 172.21.15.17:49634) 2023-07-14T12:58:26.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.157+0000 7f4e51d9b700 1 -- 172.21.15.17:0/889211139 learned_addr learned my addr 172.21.15.17:0/889211139 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:26.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.158+0000 7f4e52d9d700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e54104ea0 0x7f4e54193830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:26.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.158+0000 7f4e5259c700 1 -- 172.21.15.17:0/889211139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e54104ea0 msgr2=0x7f4e54193830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:26.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.158+0000 7f4e5259c700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e54104ea0 0x7f4e54193830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:26.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.158+0000 7f4e5259c700 1 -- 172.21.15.17:0/889211139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e541007a0 msgr2=0x7f4e54199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:26.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.158+0000 7f4e5259c700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e541007a0 0x7f4e54199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:26.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.158+0000 7f4e5259c700 1 -- 172.21.15.17:0/889211139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0095f0 con 0x7f4e540ffe00 2023-07-14T12:58:26.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.158+0000 7f4e51d9b700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e541007a0 0x7f4e54199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:58:26.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.158+0000 7f4e52d9d700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e54104ea0 0x7f4e54193830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:58:26.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.158+0000 7f4e5259c700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e540ffe00 0x7f4e541997b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400e9f0 tx=0x7f4e4400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:26.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.159+0000 7f4e4b7fe700 1 -- 172.21.15.17:0/889211139 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400c9c0 con 0x7f4e540ffe00 2023-07-14T12:58:26.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.159+0000 7f4e4b7fe700 1 -- 172.21.15.17:0/889211139 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e44010430 con 0x7f4e540ffe00 2023-07-14T12:58:26.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.159+0000 7f4e589a3700 1 -- 172.21.15.17:0/889211139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e541944b0 con 0x7f4e540ffe00 2023-07-14T12:58:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.159+0000 7f4e4b7fe700 1 -- 172.21.15.17:0/889211139 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44018680 con 0x7f4e540ffe00 2023-07-14T12:58:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.159+0000 7f4e589a3700 1 -- 172.21.15.17:0/889211139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e541a07a0 con 0x7f4e540ffe00 2023-07-14T12:58:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.161+0000 7f4e589a3700 1 -- 172.21.15.17:0/889211139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5404e210 con 0x7f4e540ffe00 2023-07-14T12:58:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.162+0000 7f4e4b7fe700 1 -- 172.21.15.17:0/889211139 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f4e440105a0 con 0x7f4e540ffe00 2023-07-14T12:58:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.165+0000 7f4e4b7fe700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4e400a5670 0x7f4e400a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.166+0000 7f4e4b7fe700 1 -- 172.21.15.17:0/889211139 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f4e44014070 con 0x7f4e540ffe00 2023-07-14T12:58:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.166+0000 7f4e51d9b700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4e400a5670 0x7f4e400a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:26.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.168+0000 7f4e51d9b700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4e400a5670 0x7f4e400a7b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c005b20 tx=0x7f4e3c01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:26.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.171+0000 7f4e4b7fe700 1 -- 172.21.15.17:0/889211139 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4e44051790 con 0x7f4e540ffe00 2023-07-14T12:58:26.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.398+0000 7f4e589a3700 1 -- 172.21.15.17:0/889211139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e541a09c0 con 0x7f4e540ffe00 2023-07-14T12:58:26.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.399+0000 7f4e4b7fe700 1 -- 172.21.15.17:0/889211139 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e44096130 con 0x7f4e540ffe00 2023-07-14T12:58:26.252 INFO:teuthology.orchestra.run.smithi017.stdout:55834574925 2023-07-14T12:58:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.401+0000 7f4e589a3700 1 -- 172.21.15.17:0/889211139 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4e400a5670 msgr2=0x7f4e400a7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.401+0000 7f4e589a3700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4e400a5670 0x7f4e400a7b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c005b20 tx=0x7f4e3c01a040 comp rx=0 tx=0).stop 2023-07-14T12:58:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.402+0000 7f4e589a3700 1 -- 172.21.15.17:0/889211139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e540ffe00 msgr2=0x7f4e541997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.402+0000 7f4e589a3700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e540ffe00 0x7f4e541997b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400e9f0 tx=0x7f4e4400ed00 comp rx=0 tx=0).stop 2023-07-14T12:58:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.402+0000 7f4e589a3700 1 -- 172.21.15.17:0/889211139 shutdown_connections 2023-07-14T12:58:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.402+0000 7f4e589a3700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4e400a5670 0x7f4e400a7b20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:26.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.402+0000 7f4e589a3700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e54104ea0 0x7f4e54193830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:26.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.402+0000 7f4e589a3700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e540ffe00 0x7f4e541997b0 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400e9f0 tx=0x7f4e4400ed00 comp rx=0 tx=0).stop 2023-07-14T12:58:26.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.402+0000 7f4e589a3700 1 --2- 172.21.15.17:0/889211139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e541007a0 0x7f4e54199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:26.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.402+0000 7f4e589a3700 1 -- 172.21.15.17:0/889211139 >> 172.21.15.17:0/889211139 conn(0x7f4e540fb660 msgr2=0x7f4e540fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:26.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.402+0000 7f4e589a3700 1 -- 172.21.15.17:0/889211139 shutdown_connections 2023-07-14T12:58:26.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:25.402+0000 7f4e589a3700 1 -- 172.21.15.17:0/889211139 wait complete. 2023-07-14T12:58:26.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:25 smithi135 ceph-mon[97338]: pgmap v327: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2023-07-14T12:58:26.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:25 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1595617632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-07-14T12:58:26.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:25 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/889211139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-14T12:58:26.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:25 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/783244321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-14T12:58:26.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:25 smithi131 ceph-mon[96953]: pgmap v327: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2023-07-14T12:58:26.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:25 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1595617632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-07-14T12:58:26.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:25 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/889211139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-14T12:58:26.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:25 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/783244321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-14T12:58:27.406 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037798 got 257698037799 for osd.8 2023-07-14T12:58:27.407 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:27.445 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574922 got 55834574925 for osd.1 2023-07-14T12:58:27.446 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:28.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:27 smithi017 ceph-mon[95536]: pgmap v328: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:28.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:27 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/178357087' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-14T12:58:28.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:27 smithi135 ceph-mon[97338]: pgmap v328: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:28.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:27 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/178357087' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-14T12:58:28.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.864+0000 7f625e040700 1 -- 172.21.15.17:0/2543497595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6258104ea0 msgr2=0x7f625810ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:28.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.864+0000 7f625e040700 1 --2- 172.21.15.17:0/2543497595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6258104ea0 0x7f625810ca20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f625000b0d0 tx=0x7f625000b3e0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.864+0000 7f625e040700 1 -- 172.21.15.17:0/2543497595 shutdown_connections 2023-07-14T12:58:28.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.864+0000 7f625e040700 1 --2- 172.21.15.17:0/2543497595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6258104ea0 0x7f625810ca20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.864+0000 7f625e040700 1 --2- 172.21.15.17:0/2543497595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62580ffe00 0x7f62581001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.864+0000 7f625e040700 1 --2- 172.21.15.17:0/2543497595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62581007a0 0x7f6258104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.864+0000 7f625e040700 1 -- 172.21.15.17:0/2543497595 >> 172.21.15.17:0/2543497595 conn(0x7f62580fb660 msgr2=0x7f62580fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:28.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.864+0000 7f625e040700 1 -- 172.21.15.17:0/2543497595 shutdown_connections 2023-07-14T12:58:28.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.864+0000 7f625e040700 1 -- 172.21.15.17:0/2543497595 wait complete. 2023-07-14T12:58:28.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.865+0000 7f625e040700 1 Processor -- start 2023-07-14T12:58:28.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.865+0000 7f625e040700 1 -- start start 2023-07-14T12:58:28.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.866+0000 7f625e040700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62580ffe00 0x7f6258072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:28.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.866+0000 7f625e040700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62581007a0 0x7f6258072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:28.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.866+0000 7f625e040700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6258104ea0 0x7f62580732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:28.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.866+0000 7f625e040700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62581a40e0 con 0x7f62581007a0 2023-07-14T12:58:28.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.866+0000 7f625e040700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62581a4250 con 0x7f6258104ea0 2023-07-14T12:58:28.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.866+0000 7f625e040700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62581a4410 con 0x7f62580ffe00 2023-07-14T12:58:28.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.866+0000 7f6256ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62581007a0 0x7f6258072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:28.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.866+0000 7f6256ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62581007a0 0x7f6258072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60910/0 (socket says 172.21.15.17:60910) 2023-07-14T12:58:28.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.866+0000 7f6256ffd700 1 -- 172.21.15.17:0/3088483723 learned_addr learned my addr 172.21.15.17:0/3088483723 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:28.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.866+0000 7f62577fe700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62580ffe00 0x7f6258072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:28.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.866+0000 7f6257fff700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6258104ea0 0x7f62580732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:28.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f6256ffd700 1 -- 172.21.15.17:0/3088483723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62580ffe00 msgr2=0x7f6258072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:28.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f6256ffd700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62580ffe00 0x7f6258072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f6256ffd700 1 -- 172.21.15.17:0/3088483723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6258104ea0 msgr2=0x7f62580732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:28.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f6256ffd700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6258104ea0 0x7f62580732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f6256ffd700 1 -- 172.21.15.17:0/3088483723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6250009d00 con 0x7f62581007a0 2023-07-14T12:58:28.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f62577fe700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62580ffe00 0x7f6258072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:28.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f6256ffd700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62581007a0 0x7f6258072d50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f624c00d950 tx=0x7f624c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:28.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f6254ff9700 1 -- 172.21.15.17:0/3088483723 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c00bb60 con 0x7f62581007a0 2023-07-14T12:58:28.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f625e040700 1 -- 172.21.15.17:0/3088483723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62581a46f0 con 0x7f62581007a0 2023-07-14T12:58:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f6254ff9700 1 -- 172.21.15.17:0/3088483723 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f624c007620 con 0x7f62581007a0 2023-07-14T12:58:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f6254ff9700 1 -- 172.21.15.17:0/3088483723 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c003b20 con 0x7f62581007a0 2023-07-14T12:58:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.867+0000 7f625e040700 1 -- 172.21.15.17:0/3088483723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62581a4c40 con 0x7f62581007a0 2023-07-14T12:58:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.869+0000 7f625e040700 1 -- 172.21.15.17:0/3088483723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625804e210 con 0x7f62581007a0 2023-07-14T12:58:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.870+0000 7f6254ff9700 1 -- 172.21.15.17:0/3088483723 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f624c003c80 con 0x7f62581007a0 2023-07-14T12:58:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.872+0000 7f6254ff9700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f62400a11e0 0x7f62400a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.872+0000 7f6254ff9700 1 -- 172.21.15.17:0/3088483723 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f624c0cc5d0 con 0x7f62581007a0 2023-07-14T12:58:28.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.873+0000 7f62577fe700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f62400a11e0 0x7f62400a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:28.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.873+0000 7f62577fe700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f62400a11e0 0x7f62400a3690 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6248009cb0 tx=0x7f6248009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:28.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.876+0000 7f6254ff9700 1 -- 172.21.15.17:0/3088483723 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f624c095b90 con 0x7f62581007a0 2023-07-14T12:58:28.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.118+0000 7f625e040700 1 -- 172.21.15.17:0/3088483723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f62581a4e60 con 0x7f62581007a0 2023-07-14T12:58:28.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.119+0000 7f6254ff9700 1 -- 172.21.15.17:0/3088483723 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f624c0991b0 con 0x7f62581007a0 2023-07-14T12:58:28.483 INFO:teuthology.orchestra.run.smithi017.stdout:146028888124 2023-07-14T12:58:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 -- 172.21.15.17:0/3088483723 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f62400a11e0 msgr2=0x7f62400a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f62400a11e0 0x7f62400a3690 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6248009cb0 tx=0x7f6248009260 comp rx=0 tx=0).stop 2023-07-14T12:58:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 -- 172.21.15.17:0/3088483723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62581007a0 msgr2=0x7f6258072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:28.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62581007a0 0x7f6258072d50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f624c00d950 tx=0x7f624c00dd10 comp rx=0 tx=0).stop 2023-07-14T12:58:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 -- 172.21.15.17:0/3088483723 shutdown_connections 2023-07-14T12:58:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f62400a11e0 0x7f62400a3690 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6258104ea0 0x7f62580732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62580ffe00 0x7f6258072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 --2- 172.21.15.17:0/3088483723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62581007a0 0x7f6258072d50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 -- 172.21.15.17:0/3088483723 >> 172.21.15.17:0/3088483723 conn(0x7f62580fb660 msgr2=0x7f62580fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:28.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 -- 172.21.15.17:0/3088483723 shutdown_connections 2023-07-14T12:58:28.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:28.121+0000 7f625e040700 1 -- 172.21.15.17:0/3088483723 wait complete. 2023-07-14T12:58:28.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:27 smithi131 ceph-mon[96953]: pgmap v328: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:28.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:27 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/178357087' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-14T12:58:28.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.801+0000 7f96673ea700 1 -- 172.21.15.17:0/2315232241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9660104ea0 msgr2=0x7f966010ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:28.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.801+0000 7f96673ea700 1 --2- 172.21.15.17:0/2315232241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9660104ea0 0x7f966010ca20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f965800b0d0 tx=0x7f965800b3e0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.801+0000 7f96673ea700 1 -- 172.21.15.17:0/2315232241 shutdown_connections 2023-07-14T12:58:28.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.801+0000 7f96673ea700 1 --2- 172.21.15.17:0/2315232241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9660104ea0 0x7f966010ca20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.801+0000 7f96673ea700 1 --2- 172.21.15.17:0/2315232241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96600ffe00 0x7f96601001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.801+0000 7f96673ea700 1 --2- 172.21.15.17:0/2315232241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96601007a0 0x7f9660104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.801+0000 7f96673ea700 1 -- 172.21.15.17:0/2315232241 >> 172.21.15.17:0/2315232241 conn(0x7f96600fb660 msgr2=0x7f96600fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:28.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.801+0000 7f96673ea700 1 -- 172.21.15.17:0/2315232241 shutdown_connections 2023-07-14T12:58:28.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.801+0000 7f96673ea700 1 -- 172.21.15.17:0/2315232241 wait complete. 2023-07-14T12:58:28.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.802+0000 7f96673ea700 1 Processor -- start 2023-07-14T12:58:28.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.803+0000 7f96673ea700 1 -- start start 2023-07-14T12:58:28.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.803+0000 7f96673ea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96600ffe00 0x7f966019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:28.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.803+0000 7f96673ea700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96601007a0 0x7f966019bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:28.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.803+0000 7f96673ea700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9660104ea0 0x7f9660195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:28.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.803+0000 7f96673ea700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9660196150 con 0x7f9660104ea0 2023-07-14T12:58:28.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.803+0000 7f96673ea700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96601962c0 con 0x7f96601007a0 2023-07-14T12:58:28.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.803+0000 7f96673ea700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9660196480 con 0x7f96600ffe00 2023-07-14T12:58:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.803+0000 7f9665987700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9660104ea0 0x7f9660195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.803+0000 7f9665987700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9660104ea0 0x7f9660195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60896/0 (socket says 172.21.15.17:60896) 2023-07-14T12:58:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.803+0000 7f9665987700 1 -- 172.21.15.17:0/178357087 learned_addr learned my addr 172.21.15.17:0/178357087 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.804+0000 7f9665186700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96600ffe00 0x7f966019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.804+0000 7f9664985700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96601007a0 0x7f966019bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.804+0000 7f9665987700 1 -- 172.21.15.17:0/178357087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96600ffe00 msgr2=0x7f966019ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.804+0000 7f9665987700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96600ffe00 0x7f966019ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.804+0000 7f9665987700 1 -- 172.21.15.17:0/178357087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96601007a0 msgr2=0x7f966019bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:28.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.804+0000 7f9665987700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96601007a0 0x7f966019bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.804+0000 7f9665987700 1 -- 172.21.15.17:0/178357087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9658009d00 con 0x7f9660104ea0 2023-07-14T12:58:28.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.805+0000 7f9665987700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9660104ea0 0x7f9660195ae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9658009380 tx=0x7f96580093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:28.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.805+0000 7f96567fc700 1 -- 172.21.15.17:0/178357087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965800e040 con 0x7f9660104ea0 2023-07-14T12:58:28.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.805+0000 7f96567fc700 1 -- 172.21.15.17:0/178357087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9658003e10 con 0x7f9660104ea0 2023-07-14T12:58:28.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.805+0000 7f96673ea700 1 -- 172.21.15.17:0/178357087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9660196700 con 0x7f9660104ea0 2023-07-14T12:58:28.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.805+0000 7f96567fc700 1 -- 172.21.15.17:0/178357087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965801b940 con 0x7f9660104ea0 2023-07-14T12:58:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.805+0000 7f96673ea700 1 -- 172.21.15.17:0/178357087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96601a2a50 con 0x7f9660104ea0 2023-07-14T12:58:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.807+0000 7f96673ea700 1 -- 172.21.15.17:0/178357087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966004e210 con 0x7f9660104ea0 2023-07-14T12:58:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.809+0000 7f96567fc700 1 -- 172.21.15.17:0/178357087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9658005690 con 0x7f9660104ea0 2023-07-14T12:58:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.810+0000 7f96567fc700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f964c0a11e0 0x7f964c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.810+0000 7f96567fc700 1 -- 172.21.15.17:0/178357087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f96580ce040 con 0x7f9660104ea0 2023-07-14T12:58:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.810+0000 7f9665186700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f964c0a11e0 0x7f964c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.811+0000 7f9665186700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f964c0a11e0 0x7f964c0a3690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f965c005950 tx=0x7f965c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:26.812+0000 7f96567fc700 1 -- 172.21.15.17:0/178357087 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f96580976f0 con 0x7f9660104ea0 2023-07-14T12:58:28.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.023+0000 7f96673ea700 1 -- 172.21.15.17:0/178357087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9660196ff0 con 0x7f9660104ea0 2023-07-14T12:58:28.533 INFO:teuthology.orchestra.run.smithi017.stdout:201863462961 2023-07-14T12:58:28.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.023+0000 7f96567fc700 1 -- 172.21.15.17:0/178357087 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f965809ad10 con 0x7f9660104ea0 2023-07-14T12:58:28.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 -- 172.21.15.17:0/178357087 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f964c0a11e0 msgr2=0x7f964c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:28.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f964c0a11e0 0x7f964c0a3690 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f965c005950 tx=0x7f965c00b410 comp rx=0 tx=0).stop 2023-07-14T12:58:28.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 -- 172.21.15.17:0/178357087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9660104ea0 msgr2=0x7f9660195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:28.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9660104ea0 0x7f9660195ae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9658009380 tx=0x7f96580093b0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 -- 172.21.15.17:0/178357087 shutdown_connections 2023-07-14T12:58:28.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f964c0a11e0 0x7f964c0a3690 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9660104ea0 0x7f9660195ae0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96600ffe00 0x7f966019ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 --2- 172.21.15.17:0/178357087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96601007a0 0x7f966019bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:28.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 -- 172.21.15.17:0/178357087 >> 172.21.15.17:0/178357087 conn(0x7f96600fb660 msgr2=0x7f96600fc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:28.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 -- 172.21.15.17:0/178357087 shutdown_connections 2023-07-14T12:58:28.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:27.026+0000 7f96673ea700 1 -- 172.21.15.17:0/178357087 wait complete. 2023-07-14T12:58:29.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:29 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3088483723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-14T12:58:29.396 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738447 got 34359738449 for osd.0 2023-07-14T12:58:29.396 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:29.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:29 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3088483723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-14T12:58:29.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:29 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3088483723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-14T12:58:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.643+0000 7f8be1ec6700 1 -- 172.21.15.17:0/887272340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bdc0ffe00 msgr2=0x7f8bdc1001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.643+0000 7f8be1ec6700 1 --2- 172.21.15.17:0/887272340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bdc0ffe00 0x7f8bdc1001d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0099c0 tx=0x7f8bcc009cd0 comp rx=0 tx=0).stop 2023-07-14T12:58:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.643+0000 7f8be1ec6700 1 -- 172.21.15.17:0/887272340 shutdown_connections 2023-07-14T12:58:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.643+0000 7f8be1ec6700 1 --2- 172.21.15.17:0/887272340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bdc104ea0 0x7f8bdc10ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.643+0000 7f8be1ec6700 1 --2- 172.21.15.17:0/887272340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bdc0ffe00 0x7f8bdc1001d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.643+0000 7f8be1ec6700 1 --2- 172.21.15.17:0/887272340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bdc1007a0 0x7f8bdc104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.643+0000 7f8be1ec6700 1 -- 172.21.15.17:0/887272340 >> 172.21.15.17:0/887272340 conn(0x7f8bdc0fb660 msgr2=0x7f8bdc0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.643+0000 7f8be1ec6700 1 -- 172.21.15.17:0/887272340 shutdown_connections 2023-07-14T12:58:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.643+0000 7f8be1ec6700 1 -- 172.21.15.17:0/887272340 wait complete. 2023-07-14T12:58:29.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.644+0000 7f8be1ec6700 1 Processor -- start 2023-07-14T12:58:29.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.644+0000 7f8be1ec6700 1 -- start start 2023-07-14T12:58:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.645+0000 7f8be1ec6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bdc0ffe00 0x7f8bdc197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.645+0000 7f8be1ec6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bdc1007a0 0x7f8bdc198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.645+0000 7f8be1ec6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bdc104ea0 0x7f8bdc19c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.645+0000 7f8be1ec6700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc19cd60 con 0x7f8bdc1007a0 2023-07-14T12:58:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.645+0000 7f8be1ec6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc19ced0 con 0x7f8bdc104ea0 2023-07-14T12:58:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.645+0000 7f8be1ec6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc19d090 con 0x7f8bdc0ffe00 2023-07-14T12:58:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.645+0000 7f8bdaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bdc1007a0 0x7f8bdc198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.645+0000 7f8bdaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bdc1007a0 0x7f8bdc198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60920/0 (socket says 172.21.15.17:60920) 2023-07-14T12:58:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.645+0000 7f8bdaffd700 1 -- 172.21.15.17:0/109959364 learned_addr learned my addr 172.21.15.17:0/109959364 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.645+0000 7f8bdb7fe700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bdc0ffe00 0x7f8bdc197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.645+0000 7f8bdbfff700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bdc104ea0 0x7f8bdc19c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8bdaffd700 1 -- 172.21.15.17:0/109959364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bdc0ffe00 msgr2=0x7f8bdc197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8bdaffd700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bdc0ffe00 0x7f8bdc197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8bdaffd700 1 -- 172.21.15.17:0/109959364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bdc104ea0 msgr2=0x7f8bdc19c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:29.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8bdaffd700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bdc104ea0 0x7f8bdc19c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8bdaffd700 1 -- 172.21.15.17:0/109959364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc0095f0 con 0x7f8bdc1007a0 2023-07-14T12:58:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8bdbfff700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bdc104ea0 0x7f8bdc19c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8bdaffd700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bdc1007a0 0x7f8bdc198380 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000e970 tx=0x7f8bd000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8bd8ff9700 1 -- 172.21.15.17:0/109959364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0009790 con 0x7f8bdc1007a0 2023-07-14T12:58:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8be1ec6700 1 -- 172.21.15.17:0/109959364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc19d370 con 0x7f8bdc1007a0 2023-07-14T12:58:29.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8bd8ff9700 1 -- 172.21.15.17:0/109959364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bd000eec0 con 0x7f8bdc1007a0 2023-07-14T12:58:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8bd8ff9700 1 -- 172.21.15.17:0/109959364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd00054b0 con 0x7f8bdc1007a0 2023-07-14T12:58:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.646+0000 7f8be1ec6700 1 -- 172.21.15.17:0/109959364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc1a4bd0 con 0x7f8bdc1007a0 2023-07-14T12:58:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.647+0000 7f8be1ec6700 1 -- 172.21.15.17:0/109959364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bdc04e210 con 0x7f8bdc1007a0 2023-07-14T12:58:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.649+0000 7f8bd8ff9700 1 -- 172.21.15.17:0/109959364 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8bd0005610 con 0x7f8bdc1007a0 2023-07-14T12:58:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.651+0000 7f8bd8ff9700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bc40a11e0 0x7f8bc40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:29.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.651+0000 7f8bd8ff9700 1 -- 172.21.15.17:0/109959364 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f8bd0014070 con 0x7f8bdc1007a0 2023-07-14T12:58:29.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.651+0000 7f8bdb7fe700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bc40a11e0 0x7f8bc40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:29.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.652+0000 7f8bdb7fe700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bc40a11e0 0x7f8bc40a3690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00b580 tx=0x7f8bcc005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:29.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.653+0000 7f8bd8ff9700 1 -- 172.21.15.17:0/109959364 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8bd00964d0 con 0x7f8bdc1007a0 2023-07-14T12:58:29.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.874+0000 7f8be1ec6700 1 -- 172.21.15.17:0/109959364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f8bdc1a4e20 con 0x7f8bdc1007a0 2023-07-14T12:58:29.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.874+0000 7f8bd8ff9700 1 -- 172.21.15.17:0/109959364 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f8bd0099af0 con 0x7f8bdc1007a0 2023-07-14T12:58:29.904 INFO:teuthology.orchestra.run.smithi017.stdout:347892350998 2023-07-14T12:58:29.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.877+0000 7f8be1ec6700 1 -- 172.21.15.17:0/109959364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bc40a11e0 msgr2=0x7f8bc40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:29.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.877+0000 7f8be1ec6700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bc40a11e0 0x7f8bc40a3690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00b580 tx=0x7f8bcc005c00 comp rx=0 tx=0).stop 2023-07-14T12:58:29.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.877+0000 7f8be1ec6700 1 -- 172.21.15.17:0/109959364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bdc1007a0 msgr2=0x7f8bdc198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:29.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.877+0000 7f8be1ec6700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bdc1007a0 0x7f8bdc198380 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000e970 tx=0x7f8bd000ec80 comp rx=0 tx=0).stop 2023-07-14T12:58:29.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.878+0000 7f8be1ec6700 1 -- 172.21.15.17:0/109959364 shutdown_connections 2023-07-14T12:58:29.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.878+0000 7f8be1ec6700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bc40a11e0 0x7f8bc40a3690 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:29.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.878+0000 7f8be1ec6700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bdc104ea0 0x7f8bdc19c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:29.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.878+0000 7f8be1ec6700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bdc0ffe00 0x7f8bdc197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:29.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.878+0000 7f8be1ec6700 1 --2- 172.21.15.17:0/109959364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bdc1007a0 0x7f8bdc198380 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:29.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.878+0000 7f8be1ec6700 1 -- 172.21.15.17:0/109959364 >> 172.21.15.17:0/109959364 conn(0x7f8bdc0fb660 msgr2=0x7f8bdc0fc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:29.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.878+0000 7f8be1ec6700 1 -- 172.21.15.17:0/109959364 shutdown_connections 2023-07-14T12:58:29.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:29.878+0000 7f8be1ec6700 1 -- 172.21.15.17:0/109959364 wait complete. 2023-07-14T12:58:30.057 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462959 got 201863462961 for osd.6 2023-07-14T12:58:30.058 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:30.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:30 smithi017 ceph-mon[95536]: pgmap v329: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-14T12:58:30.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:30 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/109959364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-07-14T12:58:30.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:30 smithi135 ceph-mon[97338]: pgmap v329: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-14T12:58:30.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:30 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/109959364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-07-14T12:58:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.388+0000 7fddc5a37700 1 -- 172.21.15.17:0/2332305000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddc010a140 msgr2=0x7fddc010c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.388+0000 7fddc5a37700 1 --2- 172.21.15.17:0/2332305000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddc010a140 0x7fddc010c580 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fddb800b0a0 tx=0x7fddb800b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.388+0000 7fddc5a37700 1 -- 172.21.15.17:0/2332305000 shutdown_connections 2023-07-14T12:58:30.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.388+0000 7fddc5a37700 1 --2- 172.21.15.17:0/2332305000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddc010a140 0x7fddc010c580 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.388+0000 7fddc5a37700 1 --2- 172.21.15.17:0/2332305000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddc0100df0 0x7fddc01011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.388+0000 7fddc5a37700 1 --2- 172.21.15.17:0/2332305000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fddc0101700 0x7fddc0109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.388+0000 7fddc5a37700 1 -- 172.21.15.17:0/2332305000 >> 172.21.15.17:0/2332305000 conn(0x7fddc0075b70 msgr2=0x7fddc0075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:30.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.390+0000 7fddc5a37700 1 -- 172.21.15.17:0/2332305000 shutdown_connections 2023-07-14T12:58:30.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.390+0000 7fddc5a37700 1 -- 172.21.15.17:0/2332305000 wait complete. 2023-07-14T12:58:30.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.391+0000 7fddc5a37700 1 Processor -- start 2023-07-14T12:58:30.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.391+0000 7fddc5a37700 1 -- start start 2023-07-14T12:58:30.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddc5a37700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddc0100df0 0x7fddc0197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:30.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddc5a37700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fddc0101700 0x7fddc01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:30.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddc5a37700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddc010a140 0x7fddc019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:30.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddc5a37700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc019ce50 con 0x7fddc010a140 2023-07-14T12:58:30.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddc5a37700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc019cfc0 con 0x7fddc0101700 2023-07-14T12:58:30.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddc5a37700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc019d180 con 0x7fddc0100df0 2023-07-14T12:58:30.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddbf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddc010a140 0x7fddc019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:30.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddbf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddc010a140 0x7fddc019c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60944/0 (socket says 172.21.15.17:60944) 2023-07-14T12:58:30.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddbf7fe700 1 -- 172.21.15.17:0/2264065438 learned_addr learned my addr 172.21.15.17:0/2264065438 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:30.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddbe7fc700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fddc0101700 0x7fddc01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:30.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddbeffd700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddc0100df0 0x7fddc0197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:30.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddbf7fe700 1 -- 172.21.15.17:0/2264065438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddc0100df0 msgr2=0x7fddc0197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:30.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddbf7fe700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddc0100df0 0x7fddc0197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddbf7fe700 1 -- 172.21.15.17:0/2264065438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fddc0101700 msgr2=0x7fddc01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:30.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddbf7fe700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fddc0101700 0x7fddc01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddbf7fe700 1 -- 172.21.15.17:0/2264065438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb4009520 con 0x7fddc010a140 2023-07-14T12:58:30.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.392+0000 7fddbeffd700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddc0100df0 0x7fddc0197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:30.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.393+0000 7fddbf7fe700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddc010a140 0x7fddc019c840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fddb800b070 tx=0x7fddb800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:30.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.393+0000 7fddc4a35700 1 -- 172.21.15.17:0/2264065438 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb800e040 con 0x7fddc010a140 2023-07-14T12:58:30.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.393+0000 7fddc5a37700 1 -- 172.21.15.17:0/2264065438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb8009d00 con 0x7fddc010a140 2023-07-14T12:58:30.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.393+0000 7fddc4a35700 1 -- 172.21.15.17:0/2264065438 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fddb8009480 con 0x7fddc010a140 2023-07-14T12:58:30.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.393+0000 7fddc4a35700 1 -- 172.21.15.17:0/2264065438 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8005040 con 0x7fddc010a140 2023-07-14T12:58:30.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.393+0000 7fddc5a37700 1 -- 172.21.15.17:0/2264065438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc01a4af0 con 0x7fddc010a140 2023-07-14T12:58:30.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.395+0000 7fddc5a37700 1 -- 172.21.15.17:0/2264065438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc0107700 con 0x7fddc010a140 2023-07-14T12:58:30.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.396+0000 7fddc4a35700 1 -- 172.21.15.17:0/2264065438 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fddb801d480 con 0x7fddc010a140 2023-07-14T12:58:30.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.398+0000 7fddc4a35700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdda80a11e0 0x7fdda80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:30.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.398+0000 7fddc4a35700 1 -- 172.21.15.17:0/2264065438 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fddb80cdac0 con 0x7fddc010a140 2023-07-14T12:58:30.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.398+0000 7fddbeffd700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdda80a11e0 0x7fdda80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:30.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.399+0000 7fddbeffd700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdda80a11e0 0x7fdda80a3690 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009cb0 tx=0x7fddb0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:30.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.402+0000 7fddc4a35700 1 -- 172.21.15.17:0/2264065438 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fddb8097110 con 0x7fddc010a140 2023-07-14T12:58:30.491 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888121 got 146028888124 for osd.4 2023-07-14T12:58:30.491 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:30.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:30 smithi131 ceph-mon[96953]: pgmap v329: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-14T12:58:30.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:30 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/109959364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-07-14T12:58:30.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.671+0000 7fddc5a37700 1 -- 172.21.15.17:0/2264065438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fddc01070e0 con 0x7fddc010a140 2023-07-14T12:58:30.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.671+0000 7fddc4a35700 1 -- 172.21.15.17:0/2264065438 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddb809a730 con 0x7fddc010a140 2023-07-14T12:58:30.703 INFO:teuthology.orchestra.run.smithi017.stdout:223338299437 2023-07-14T12:58:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 -- 172.21.15.17:0/2264065438 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdda80a11e0 msgr2=0x7fdda80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdda80a11e0 0x7fdda80a3690 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009cb0 tx=0x7fddb0009260 comp rx=0 tx=0).stop 2023-07-14T12:58:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 -- 172.21.15.17:0/2264065438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddc010a140 msgr2=0x7fddc019c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddc010a140 0x7fddc019c840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fddb800b070 tx=0x7fddb800bce0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 -- 172.21.15.17:0/2264065438 shutdown_connections 2023-07-14T12:58:30.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdda80a11e0 0x7fdda80a3690 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddc010a140 0x7fddc019c840 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddc0100df0 0x7fddc0197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 --2- 172.21.15.17:0/2264065438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fddc0101700 0x7fddc01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 -- 172.21.15.17:0/2264065438 >> 172.21.15.17:0/2264065438 conn(0x7fddc0075b70 msgr2=0x7fddc00feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 -- 172.21.15.17:0/2264065438 shutdown_connections 2023-07-14T12:58:30.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.674+0000 7fddc5a37700 1 -- 172.21.15.17:0/2264065438 wait complete. 2023-07-14T12:58:30.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.809+0000 7f309afa6700 1 -- 172.21.15.17:0/34245224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30940ff290 msgr2=0x7f309410bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:30.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.809+0000 7f309afa6700 1 --2- 172.21.15.17:0/34245224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30940ff290 0x7f309410bff0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3080009990 tx=0x7f3080009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.809+0000 7f309afa6700 1 -- 172.21.15.17:0/34245224 shutdown_connections 2023-07-14T12:58:30.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.809+0000 7f309afa6700 1 --2- 172.21.15.17:0/34245224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f309410c530 0x7f309410e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.809+0000 7f309afa6700 1 --2- 172.21.15.17:0/34245224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30940fe980 0x7f30940fed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.809+0000 7f309afa6700 1 --2- 172.21.15.17:0/34245224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30940ff290 0x7f309410bff0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.809+0000 7f309afa6700 1 -- 172.21.15.17:0/34245224 >> 172.21.15.17:0/34245224 conn(0x7f3094075b70 msgr2=0x7f3094075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:30.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.809+0000 7f309afa6700 1 -- 172.21.15.17:0/34245224 shutdown_connections 2023-07-14T12:58:30.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.809+0000 7f309afa6700 1 -- 172.21.15.17:0/34245224 wait complete. 2023-07-14T12:58:30.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.810+0000 7f309afa6700 1 Processor -- start 2023-07-14T12:58:30.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.811+0000 7f309afa6700 1 -- start start 2023-07-14T12:58:30.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.811+0000 7f309afa6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30940fe980 0x7f3094197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:30.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.811+0000 7f309afa6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30940ff290 0x7f3094198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:30.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.811+0000 7f309afa6700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309410c530 0x7f309419c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:30.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.811+0000 7f309afa6700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309419cde0 con 0x7f309410c530 2023-07-14T12:58:30.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.811+0000 7f309afa6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309419cf50 con 0x7f30940fe980 2023-07-14T12:58:30.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.811+0000 7f309afa6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309419d110 con 0x7f30940ff290 2023-07-14T12:58:30.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.811+0000 7f3099543700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309410c530 0x7f309419c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:30.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.812+0000 7f3099543700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309410c530 0x7f309419c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60958/0 (socket says 172.21.15.17:60958) 2023-07-14T12:58:30.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.812+0000 7f3099543700 1 -- 172.21.15.17:0/3977727445 learned_addr learned my addr 172.21.15.17:0/3977727445 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:30.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.812+0000 7f3098d42700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30940fe980 0x7f3094197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:30.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.812+0000 7f3093fff700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30940ff290 0x7f3094198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:30.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.812+0000 7f3099543700 1 -- 172.21.15.17:0/3977727445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30940ff290 msgr2=0x7f3094198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:30.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.812+0000 7f3099543700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30940ff290 0x7f3094198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.812+0000 7f3099543700 1 -- 172.21.15.17:0/3977727445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30940fe980 msgr2=0x7f3094197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:30.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.812+0000 7f3099543700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30940fe980 0x7f3094197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:30.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.812+0000 7f3099543700 1 -- 172.21.15.17:0/3977727445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800095f0 con 0x7f309410c530 2023-07-14T12:58:30.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.813+0000 7f3099543700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309410c530 0x7f309419c7d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f308c00ab70 tx=0x7f308c00ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:30.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.813+0000 7f3091ffb700 1 -- 172.21.15.17:0/3977727445 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c00f070 con 0x7f309410c530 2023-07-14T12:58:30.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.814+0000 7f3091ffb700 1 -- 172.21.15.17:0/3977727445 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f308c004bb0 con 0x7f309410c530 2023-07-14T12:58:30.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.814+0000 7f3091ffb700 1 -- 172.21.15.17:0/3977727445 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c005280 con 0x7f309410c530 2023-07-14T12:58:30.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.814+0000 7f309afa6700 1 -- 172.21.15.17:0/3977727445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309419d3f0 con 0x7f309410c530 2023-07-14T12:58:30.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.814+0000 7f309afa6700 1 -- 172.21.15.17:0/3977727445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30941a4c50 con 0x7f309410c530 2023-07-14T12:58:30.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.815+0000 7f309afa6700 1 -- 172.21.15.17:0/3977727445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309404e210 con 0x7f309410c530 2023-07-14T12:58:30.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.818+0000 7f3091ffb700 1 -- 172.21.15.17:0/3977727445 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f308c004d20 con 0x7f309410c530 2023-07-14T12:58:30.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.821+0000 7f3091ffb700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30840a13b0 0x7f30840a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:30.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.821+0000 7f3091ffb700 1 -- 172.21.15.17:0/3977727445 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f308c0cc410 con 0x7f309410c530 2023-07-14T12:58:30.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.822+0000 7f3098d42700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30840a13b0 0x7f30840a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:30.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.822+0000 7f3091ffb700 1 -- 172.21.15.17:0/3977727445 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f308c095ae0 con 0x7f309410c530 2023-07-14T12:58:30.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.825+0000 7f3098d42700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30840a13b0 0x7f30840a3860 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3088009c60 tx=0x7f3088009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.059+0000 7f309afa6700 1 -- 172.21.15.17:0/3977727445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f30941a4e40 con 0x7f309410c530 2023-07-14T12:58:31.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.060+0000 7f3091ffb700 1 -- 172.21.15.17:0/3977727445 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f308c099100 con 0x7f309410c530 2023-07-14T12:58:31.090 INFO:teuthology.orchestra.run.smithi017.stdout:111669149762 2023-07-14T12:58:31.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.062+0000 7f309afa6700 1 -- 172.21.15.17:0/3977727445 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30840a13b0 msgr2=0x7f30840a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.062+0000 7f309afa6700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30840a13b0 0x7f30840a3860 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3088009c60 tx=0x7f3088009260 comp rx=0 tx=0).stop 2023-07-14T12:58:31.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.062+0000 7f309afa6700 1 -- 172.21.15.17:0/3977727445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309410c530 msgr2=0x7f309419c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.062+0000 7f309afa6700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309410c530 0x7f309419c7d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f308c00ab70 tx=0x7f308c00ae80 comp rx=0 tx=0).stop 2023-07-14T12:58:31.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.062+0000 7f309afa6700 1 -- 172.21.15.17:0/3977727445 shutdown_connections 2023-07-14T12:58:31.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.062+0000 7f309afa6700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30840a13b0 0x7f30840a3860 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.063+0000 7f309afa6700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f309410c530 0x7f309419c7d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.063+0000 7f309afa6700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30940fe980 0x7f3094197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.063+0000 7f309afa6700 1 --2- 172.21.15.17:0/3977727445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30940ff290 0x7f3094198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.063+0000 7f309afa6700 1 -- 172.21.15.17:0/3977727445 >> 172.21.15.17:0/3977727445 conn(0x7f3094075b70 msgr2=0x7f30940fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:31.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.063+0000 7f309afa6700 1 -- 172.21.15.17:0/3977727445 shutdown_connections 2023-07-14T12:58:31.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.063+0000 7f309afa6700 1 -- 172.21.15.17:0/3977727445 wait complete. 2023-07-14T12:58:31.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:31 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2264065438' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-14T12:58:31.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.069+0000 7f92f558f700 1 -- 172.21.15.17:0/750105945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f00ff290 msgr2=0x7f92f010bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.069+0000 7f92f558f700 1 --2- 172.21.15.17:0/750105945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f00ff290 0x7f92f010bff0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009990 tx=0x7f92e4009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.069+0000 7f92f558f700 1 -- 172.21.15.17:0/750105945 shutdown_connections 2023-07-14T12:58:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.069+0000 7f92f558f700 1 --2- 172.21.15.17:0/750105945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92f010c530 0x7f92f010e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.069+0000 7f92f558f700 1 --2- 172.21.15.17:0/750105945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92f00fe980 0x7f92f00fed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.069+0000 7f92f558f700 1 --2- 172.21.15.17:0/750105945 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f00ff290 0x7f92f010bff0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.069+0000 7f92f558f700 1 -- 172.21.15.17:0/750105945 >> 172.21.15.17:0/750105945 conn(0x7f92f0075b70 msgr2=0x7f92f0075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.069+0000 7f92f558f700 1 -- 172.21.15.17:0/750105945 shutdown_connections 2023-07-14T12:58:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.069+0000 7f92f558f700 1 -- 172.21.15.17:0/750105945 wait complete. 2023-07-14T12:58:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.070+0000 7f92f558f700 1 Processor -- start 2023-07-14T12:58:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.070+0000 7f92f558f700 1 -- start start 2023-07-14T12:58:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.071+0000 7f92f558f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92f00fe980 0x7f92f0197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:31.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.071+0000 7f92f558f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f00ff290 0x7f92f0198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.071+0000 7f92f558f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92f010c530 0x7f92f019c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.071+0000 7f92f558f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f019ce10 con 0x7f92f00ff290 2023-07-14T12:58:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.071+0000 7f92f558f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f019cf80 con 0x7f92f010c530 2023-07-14T12:58:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.071+0000 7f92f558f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f019d140 con 0x7f92f00fe980 2023-07-14T12:58:31.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.071+0000 7f92ee7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f00ff290 0x7f92f0198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:31.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.071+0000 7f92eeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92f00fe980 0x7f92f0197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:31.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.071+0000 7f92eeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92f00fe980 0x7f92f0197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39414/0 (socket says 172.21.15.17:39414) 2023-07-14T12:58:31.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.071+0000 7f92ee7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f00ff290 0x7f92f0198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60976/0 (socket says 172.21.15.17:60976) 2023-07-14T12:58:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.071+0000 7f92eeffd700 1 -- 172.21.15.17:0/3594158274 learned_addr learned my addr 172.21.15.17:0/3594158274 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.072+0000 7f92ef7fe700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92f010c530 0x7f92f019c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.072+0000 7f92eeffd700 1 -- 172.21.15.17:0/3594158274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92f010c530 msgr2=0x7f92f019c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.072+0000 7f92eeffd700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92f010c530 0x7f92f019c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.072+0000 7f92eeffd700 1 -- 172.21.15.17:0/3594158274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f00ff290 msgr2=0x7f92f0198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.072+0000 7f92eeffd700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f00ff290 0x7f92f0198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.072+0000 7f92eeffd700 1 -- 172.21.15.17:0/3594158274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e40095f0 con 0x7f92f00fe980 2023-07-14T12:58:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.072+0000 7f92eeffd700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92f00fe980 0x7f92f0197e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92e000e9a0 tx=0x7f92e000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.072+0000 7f92d7fff700 1 -- 172.21.15.17:0/3594158274 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0009790 con 0x7f92f00fe980 2023-07-14T12:58:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.072+0000 7f92f558f700 1 -- 172.21.15.17:0/3594158274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f019d420 con 0x7f92f00fe980 2023-07-14T12:58:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.072+0000 7f92d7fff700 1 -- 172.21.15.17:0/3594158274 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92e0010430 con 0x7f92f00fe980 2023-07-14T12:58:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.072+0000 7f92d7fff700 1 -- 172.21.15.17:0/3594158274 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e000cea0 con 0x7f92f00fe980 2023-07-14T12:58:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.073+0000 7f92f558f700 1 -- 172.21.15.17:0/3594158274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f01a4c80 con 0x7f92f00fe980 2023-07-14T12:58:31.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.074+0000 7f92f558f700 1 -- 172.21.15.17:0/3594158274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f004e210 con 0x7f92f00fe980 2023-07-14T12:58:31.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.076+0000 7f92d7fff700 1 -- 172.21.15.17:0/3594158274 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f92e00105a0 con 0x7f92f00fe980 2023-07-14T12:58:31.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.077+0000 7f92d7fff700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f92d80a11e0 0x7f92d80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:31.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.077+0000 7f92d7fff700 1 -- 172.21.15.17:0/3594158274 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f92e0014070 con 0x7f92f00fe980 2023-07-14T12:58:31.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.077+0000 7f92ee7fc700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f92d80a11e0 0x7f92d80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:31.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.078+0000 7f92ee7fc700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f92d80a11e0 0x7f92d80a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f92e4006010 tx=0x7f92e40058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:31.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.082+0000 7f92d7fff700 1 -- 172.21.15.17:0/3594158274 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f92e0051790 con 0x7f92f00fe980 2023-07-14T12:58:31.218 INFO:teuthology.orchestra.run.smithi017.stdout:292057776161 2023-07-14T12:58:31.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.856+0000 7f95f06b1700 1 -- 172.21.15.17:0/3232935981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95e8101700 msgr2=0x7f95e8109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.856+0000 7f95f06b1700 1 --2- 172.21.15.17:0/3232935981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95e8101700 0x7f95e8109c00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009990 tx=0x7f95d8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.856+0000 7f95f06b1700 1 -- 172.21.15.17:0/3232935981 shutdown_connections 2023-07-14T12:58:31.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.856+0000 7f95f06b1700 1 --2- 172.21.15.17:0/3232935981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95e810a140 0x7f95e810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.856+0000 7f95f06b1700 1 --2- 172.21.15.17:0/3232935981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95e8100df0 0x7f95e81011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.856+0000 7f95f06b1700 1 --2- 172.21.15.17:0/3232935981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95e8101700 0x7f95e8109c00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.856+0000 7f95f06b1700 1 -- 172.21.15.17:0/3232935981 >> 172.21.15.17:0/3232935981 conn(0x7f95e8075b70 msgr2=0x7f95e8075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:31.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.857+0000 7f95f06b1700 1 -- 172.21.15.17:0/3232935981 shutdown_connections 2023-07-14T12:58:31.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.857+0000 7f95f06b1700 1 -- 172.21.15.17:0/3232935981 wait complete. 2023-07-14T12:58:31.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.858+0000 7f95f06b1700 1 Processor -- start 2023-07-14T12:58:31.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.858+0000 7f95f06b1700 1 -- start start 2023-07-14T12:58:31.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.858+0000 7f95f06b1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95e8100df0 0x7f95e8197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:31.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.858+0000 7f95f06b1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95e8101700 0x7f95e81982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:31.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.858+0000 7f95f06b1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95e810a140 0x7f95e819c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:31.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.858+0000 7f95f06b1700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e819cd60 con 0x7f95e810a140 2023-07-14T12:58:31.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.858+0000 7f95f06b1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e819ced0 con 0x7f95e8101700 2023-07-14T12:58:31.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.858+0000 7f95f06b1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e819d090 con 0x7f95e8100df0 2023-07-14T12:58:31.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.859+0000 7f95eec4e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95e810a140 0x7f95e819c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:31.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.859+0000 7f95eec4e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95e810a140 0x7f95e819c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60962/0 (socket says 172.21.15.17:60962) 2023-07-14T12:58:31.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.859+0000 7f95eec4e700 1 -- 172.21.15.17:0/2631399746 learned_addr learned my addr 172.21.15.17:0/2631399746 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:31.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.859+0000 7f95edc4c700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95e8101700 0x7f95e81982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.859+0000 7f95ee44d700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95e8100df0 0x7f95e8197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.859+0000 7f95eec4e700 1 -- 172.21.15.17:0/2631399746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95e8100df0 msgr2=0x7f95e8197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.859+0000 7f95eec4e700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95e8100df0 0x7f95e8197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.859+0000 7f95eec4e700 1 -- 172.21.15.17:0/2631399746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95e8101700 msgr2=0x7f95e81982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.859+0000 7f95eec4e700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95e8101700 0x7f95e81982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.859+0000 7f95eec4e700 1 -- 172.21.15.17:0/2631399746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d80095f0 con 0x7f95e810a140 2023-07-14T12:58:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.859+0000 7f95eec4e700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95e810a140 0x7f95e819c750 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f95e000efc0 tx=0x7f95e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:31.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.860+0000 7f95df7fe700 1 -- 172.21.15.17:0/2631399746 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0018070 con 0x7f95e810a140 2023-07-14T12:58:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.860+0000 7f95df7fe700 1 -- 172.21.15.17:0/2631399746 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95e000f040 con 0x7f95e810a140 2023-07-14T12:58:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.860+0000 7f95df7fe700 1 -- 172.21.15.17:0/2631399746 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e000cbb0 con 0x7f95e810a140 2023-07-14T12:58:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.860+0000 7f95f06b1700 1 -- 172.21.15.17:0/2631399746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e819d310 con 0x7f95e810a140 2023-07-14T12:58:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.860+0000 7f95f06b1700 1 -- 172.21.15.17:0/2631399746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e81a4bd0 con 0x7f95e810a140 2023-07-14T12:58:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.861+0000 7f95f06b1700 1 -- 172.21.15.17:0/2631399746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e81076c0 con 0x7f95e810a140 2023-07-14T12:58:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.863+0000 7f95df7fe700 1 -- 172.21.15.17:0/2631399746 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f95e000cd70 con 0x7f95e810a140 2023-07-14T12:58:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.865+0000 7f95df7fe700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95d40a1260 0x7f95d40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:31.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.865+0000 7f95df7fe700 1 -- 172.21.15.17:0/2631399746 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f95e00cc0e0 con 0x7f95e810a140 2023-07-14T12:58:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.865+0000 7f95ee44d700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95d40a1260 0x7f95d40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.866+0000 7f95ee44d700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95d40a1260 0x7f95d40a3710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f95e4005950 tx=0x7f95e40058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:30.873+0000 7f95df7fe700 1 -- 172.21.15.17:0/2631399746 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f95e0095730 con 0x7f95e810a140 2023-07-14T12:58:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.105+0000 7f95f06b1700 1 -- 172.21.15.17:0/2631399746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f95e804e210 con 0x7f95e810a140 2023-07-14T12:58:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.105+0000 7f95df7fe700 1 -- 172.21.15.17:0/2631399746 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95e0098d50 con 0x7f95e810a140 2023-07-14T12:58:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 -- 172.21.15.17:0/2631399746 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95d40a1260 msgr2=0x7f95d40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95d40a1260 0x7f95d40a3710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f95e4005950 tx=0x7f95e40058e0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 -- 172.21.15.17:0/2631399746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95e810a140 msgr2=0x7f95e819c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95e810a140 0x7f95e819c750 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f95e000efc0 tx=0x7f95e000c3a0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 -- 172.21.15.17:0/2631399746 shutdown_connections 2023-07-14T12:58:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95d40a1260 0x7f95d40a3710 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95e810a140 0x7f95e819c750 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95e8100df0 0x7f95e8197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 --2- 172.21.15.17:0/2631399746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95e8101700 0x7f95e81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 -- 172.21.15.17:0/2631399746 >> 172.21.15.17:0/2631399746 conn(0x7f95e8075b70 msgr2=0x7f95e80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 -- 172.21.15.17:0/2631399746 shutdown_connections 2023-07-14T12:58:31.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.108+0000 7f95f06b1700 1 -- 172.21.15.17:0/2631399746 wait complete. 2023-07-14T12:58:31.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.312+0000 7f92f558f700 1 -- 172.21.15.17:0/3594158274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f92f01a4e70 con 0x7f92f00fe980 2023-07-14T12:58:31.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.312+0000 7f92d7fff700 1 -- 172.21.15.17:0/3594158274 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92e00962e0 con 0x7f92f00fe980 2023-07-14T12:58:31.342 INFO:teuthology.orchestra.run.smithi017.stdout:77309411399 2023-07-14T12:58:31.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 -- 172.21.15.17:0/3594158274 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f92d80a11e0 msgr2=0x7f92d80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f92d80a11e0 0x7f92d80a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f92e4006010 tx=0x7f92e40058e0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 -- 172.21.15.17:0/3594158274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92f00fe980 msgr2=0x7f92f0197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:31.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92f00fe980 0x7f92f0197e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92e000e9a0 tx=0x7f92e000ecb0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 -- 172.21.15.17:0/3594158274 shutdown_connections 2023-07-14T12:58:31.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f92d80a11e0 0x7f92d80a3690 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92f010c530 0x7f92f019c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92f00fe980 0x7f92f0197e50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 --2- 172.21.15.17:0/3594158274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f00ff290 0x7f92f0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 -- 172.21.15.17:0/3594158274 >> 172.21.15.17:0/3594158274 conn(0x7f92f0075b70 msgr2=0x7f92f00fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 -- 172.21.15.17:0/3594158274 shutdown_connections 2023-07-14T12:58:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:31.315+0000 7f92f558f700 1 -- 172.21.15.17:0/3594158274 wait complete. 2023-07-14T12:58:31.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:31 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2264065438' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-14T12:58:31.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:31 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2264065438' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-14T12:58:31.757 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350995 got 347892350998 for osd.11 2023-07-14T12:58:31.757 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:32.125 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776158 got 292057776161 for osd.9 2023-07-14T12:58:32.125 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:32.129 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411396 got 77309411399 for osd.2 2023-07-14T12:58:32.129 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:32.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:32 smithi017 ceph-mon[95536]: pgmap v330: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-14T12:58:32.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:32 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3977727445' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-14T12:58:32.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:32 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2631399746' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-07-14T12:58:32.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:32 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3594158274' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-14T12:58:32.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:32 smithi135 ceph-mon[97338]: pgmap v330: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-14T12:58:32.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:32 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3977727445' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-14T12:58:32.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:32 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2631399746' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-07-14T12:58:32.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:32 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3594158274' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-14T12:58:32.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:32 smithi131 ceph-mon[96953]: pgmap v330: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-14T12:58:32.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:32 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3977727445' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-14T12:58:32.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:32 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2631399746' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-07-14T12:58:32.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:32 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3594158274' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-14T12:58:32.609 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299435 got 223338299437 for osd.7 2023-07-14T12:58:32.609 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:32.820 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149759 got 111669149762 for osd.3 2023-07-14T12:58:32.820 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.064+0000 7f688567f700 1 -- 172.21.15.17:0/2691693821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68801007a0 msgr2=0x7f6880104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.064+0000 7f688567f700 1 --2- 172.21.15.17:0/2691693821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68801007a0 0x7f6880104770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f68740099c0 tx=0x7f6874009cd0 comp rx=0 tx=0).stop 2023-07-14T12:58:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.064+0000 7f688567f700 1 -- 172.21.15.17:0/2691693821 shutdown_connections 2023-07-14T12:58:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.064+0000 7f688567f700 1 --2- 172.21.15.17:0/2691693821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6880104ea0 0x7f688010ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.064+0000 7f688567f700 1 --2- 172.21.15.17:0/2691693821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68800ffe00 0x7f68801001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.064+0000 7f688567f700 1 --2- 172.21.15.17:0/2691693821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68801007a0 0x7f6880104770 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.064+0000 7f688567f700 1 -- 172.21.15.17:0/2691693821 >> 172.21.15.17:0/2691693821 conn(0x7f68800fb660 msgr2=0x7f68800fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.064+0000 7f688567f700 1 -- 172.21.15.17:0/2691693821 shutdown_connections 2023-07-14T12:58:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.064+0000 7f688567f700 1 -- 172.21.15.17:0/2691693821 wait complete. 2023-07-14T12:58:33.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.065+0000 7f688567f700 1 Processor -- start 2023-07-14T12:58:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.065+0000 7f688567f700 1 -- start start 2023-07-14T12:58:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f688567f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68800ffe00 0x7f6880072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f688567f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68801007a0 0x7f6880072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f688567f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6880104ea0 0x7f6880073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f688567f700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68801a8530 con 0x7f68801007a0 2023-07-14T12:58:33.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f688567f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68801a8670 con 0x7f6880104ea0 2023-07-14T12:58:33.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f688567f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68801a87b0 con 0x7f68800ffe00 2023-07-14T12:58:33.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f687e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68801007a0 0x7f6880072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f687e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68801007a0 0x7f6880072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32776/0 (socket says 172.21.15.17:32776) 2023-07-14T12:58:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f687e7fc700 1 -- 172.21.15.17:0/1240918796 learned_addr learned my addr 172.21.15.17:0/1240918796 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f687f7fe700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6880104ea0 0x7f6880073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f687effd700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68800ffe00 0x7f6880072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f687e7fc700 1 -- 172.21.15.17:0/1240918796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68800ffe00 msgr2=0x7f6880072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f687e7fc700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68800ffe00 0x7f6880072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f687e7fc700 1 -- 172.21.15.17:0/1240918796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6880104ea0 msgr2=0x7f6880073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f687e7fc700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6880104ea0 0x7f6880073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.066+0000 7f687e7fc700 1 -- 172.21.15.17:0/1240918796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740095f0 con 0x7f68801007a0 2023-07-14T12:58:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.067+0000 7f687e7fc700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68801007a0 0x7f6880072d50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f68740036c0 tx=0x7f6874004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.067+0000 7f6867fff700 1 -- 172.21.15.17:0/1240918796 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687401d070 con 0x7f68801007a0 2023-07-14T12:58:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.067+0000 7f6867fff700 1 -- 172.21.15.17:0/1240918796 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6874003ec0 con 0x7f68801007a0 2023-07-14T12:58:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.067+0000 7f688567f700 1 -- 172.21.15.17:0/1240918796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68801a8a30 con 0x7f68801007a0 2023-07-14T12:58:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.067+0000 7f6867fff700 1 -- 172.21.15.17:0/1240918796 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874022c00 con 0x7f68801007a0 2023-07-14T12:58:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.067+0000 7f688567f700 1 -- 172.21.15.17:0/1240918796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68801a8ea0 con 0x7f68801007a0 2023-07-14T12:58:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.068+0000 7f688567f700 1 -- 172.21.15.17:0/1240918796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688004e210 con 0x7f68801007a0 2023-07-14T12:58:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.070+0000 7f6867fff700 1 -- 172.21.15.17:0/1240918796 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6874004030 con 0x7f68801007a0 2023-07-14T12:58:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.072+0000 7f6867fff700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68680a1260 0x7f68680a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.072+0000 7f6867fff700 1 -- 172.21.15.17:0/1240918796 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f68740cdec0 con 0x7f68801007a0 2023-07-14T12:58:33.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.072+0000 7f687effd700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68680a1260 0x7f68680a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:33.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.072+0000 7f687effd700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68680a1260 0x7f68680a3710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6870005950 tx=0x7f68700058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:33.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.076+0000 7f6867fff700 1 -- 172.21.15.17:0/1240918796 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6874097510 con 0x7f68801007a0 2023-07-14T12:58:33.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.284+0000 7f688567f700 1 -- 172.21.15.17:0/1240918796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f68801a9030 con 0x7f68801007a0 2023-07-14T12:58:33.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.284+0000 7f6867fff700 1 -- 172.21.15.17:0/1240918796 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f687409ab30 con 0x7f68801007a0 2023-07-14T12:58:33.314 INFO:teuthology.orchestra.run.smithi017.stdout:313532612636 2023-07-14T12:58:33.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 -- 172.21.15.17:0/1240918796 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68680a1260 msgr2=0x7f68680a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:33.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68680a1260 0x7f68680a3710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6870005950 tx=0x7f68700058e0 comp rx=0 tx=0).stop 2023-07-14T12:58:33.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 -- 172.21.15.17:0/1240918796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68801007a0 msgr2=0x7f6880072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:33.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68801007a0 0x7f6880072d50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f68740036c0 tx=0x7f6874004730 comp rx=0 tx=0).stop 2023-07-14T12:58:33.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 -- 172.21.15.17:0/1240918796 shutdown_connections 2023-07-14T12:58:33.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f68680a1260 0x7f68680a3710 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:33.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6880104ea0 0x7f6880073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:33.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68800ffe00 0x7f6880072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:33.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 --2- 172.21.15.17:0/1240918796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68801007a0 0x7f6880072d50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:33.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 -- 172.21.15.17:0/1240918796 >> 172.21.15.17:0/1240918796 conn(0x7f68800fb660 msgr2=0x7f68800fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:33.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 -- 172.21.15.17:0/1240918796 shutdown_connections 2023-07-14T12:58:33.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:33.287+0000 7f688567f700 1 -- 172.21.15.17:0/1240918796 wait complete. 2023-07-14T12:58:33.842 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612633 got 313532612636 for osd.10 2023-07-14T12:58:33.842 DEBUG:teuthology.parallel:result is None 2023-07-14T12:58:33.843 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-07-14T12:58:33.843 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph pg dump --format=json 2023-07-14T12:58:34.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:34 smithi017 ceph-mon[95536]: pgmap v331: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:34.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:34 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1240918796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-07-14T12:58:34.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:34 smithi135 ceph-mon[97338]: pgmap v331: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:34.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:34 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1240918796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-07-14T12:58:34.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:34 smithi131 ceph-mon[96953]: pgmap v331: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:34.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:34 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1240918796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-07-14T12:58:34.575 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:36.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.055+0000 7f610058e700 1 -- 172.21.15.17:0/277712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60f80731c0 msgr2=0x7f60f810bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:36.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.055+0000 7f610058e700 1 --2- 172.21.15.17:0/277712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60f80731c0 0x7f60f810bea0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009990 tx=0x7f60e8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:36.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.055+0000 7f610058e700 1 -- 172.21.15.17:0/277712 shutdown_connections 2023-07-14T12:58:36.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.055+0000 7f610058e700 1 --2- 172.21.15.17:0/277712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f810c3e0 0x7f60f810e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:36.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.055+0000 7f610058e700 1 --2- 172.21.15.17:0/277712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60f80728b0 0x7f60f8072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:36.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.055+0000 7f610058e700 1 --2- 172.21.15.17:0/277712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60f80731c0 0x7f60f810bea0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:36.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.056+0000 7f610058e700 1 -- 172.21.15.17:0/277712 >> 172.21.15.17:0/277712 conn(0x7f60f80fb660 msgr2=0x7f60f80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:36.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.056+0000 7f610058e700 1 -- 172.21.15.17:0/277712 shutdown_connections 2023-07-14T12:58:36.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.056+0000 7f610058e700 1 -- 172.21.15.17:0/277712 wait complete. 2023-07-14T12:58:36.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.057+0000 7f610058e700 1 Processor -- start 2023-07-14T12:58:36.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.057+0000 7f610058e700 1 -- start start 2023-07-14T12:58:36.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.057+0000 7f610058e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80728b0 0x7f60f819dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:36.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.057+0000 7f610058e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60f80731c0 0x7f60f819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:36.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.057+0000 7f610058e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60f810c3e0 0x7f60f8197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:36.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.057+0000 7f610058e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f81982a0 con 0x7f60f810c3e0 2023-07-14T12:58:36.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.057+0000 7f610058e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8198410 con 0x7f60f80731c0 2023-07-14T12:58:36.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.057+0000 7f610058e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f81985d0 con 0x7f60f80728b0 2023-07-14T12:58:36.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60feb2b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60f810c3e0 0x7f60f8197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:36.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60fe32a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80728b0 0x7f60f819dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:36.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60feb2b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60f810c3e0 0x7f60f8197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49404/0 (socket says 172.21.15.17:49404) 2023-07-14T12:58:36.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60fe32a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80728b0 0x7f60f819dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39746/0 (socket says 172.21.15.17:39746) 2023-07-14T12:58:36.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60feb2b700 1 -- 172.21.15.17:0/234471304 learned_addr learned my addr 172.21.15.17:0/234471304 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:36.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60fdb29700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60f80731c0 0x7f60f819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:36.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60feb2b700 1 -- 172.21.15.17:0/234471304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80728b0 msgr2=0x7f60f819dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:36.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60feb2b700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80728b0 0x7f60f819dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:36.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60feb2b700 1 -- 172.21.15.17:0/234471304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60f80731c0 msgr2=0x7f60f819e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:36.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60feb2b700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60f80731c0 0x7f60f819e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:36.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60feb2b700 1 -- 172.21.15.17:0/234471304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80095f0 con 0x7f60f810c3e0 2023-07-14T12:58:36.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.058+0000 7f60feb2b700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60f810c3e0 0x7f60f8197b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f60f0007ee0 tx=0x7f60f000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:36.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.059+0000 7f60ef7fe700 1 -- 172.21.15.17:0/234471304 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000dd20 con 0x7f60f810c3e0 2023-07-14T12:58:36.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.059+0000 7f60ef7fe700 1 -- 172.21.15.17:0/234471304 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60f000f040 con 0x7f60f810c3e0 2023-07-14T12:58:36.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.059+0000 7f60ef7fe700 1 -- 172.21.15.17:0/234471304 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0004750 con 0x7f60f810c3e0 2023-07-14T12:58:36.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.059+0000 7f610058e700 1 -- 172.21.15.17:0/234471304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f81988b0 con 0x7f60f810c3e0 2023-07-14T12:58:36.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.059+0000 7f610058e700 1 -- 172.21.15.17:0/234471304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f81a4ac0 con 0x7f60f810c3e0 2023-07-14T12:58:36.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.060+0000 7f610058e700 1 -- 172.21.15.17:0/234471304 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f804e210 con 0x7f60f810c3e0 2023-07-14T12:58:36.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.062+0000 7f60ef7fe700 1 -- 172.21.15.17:0/234471304 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f60f0003a00 con 0x7f60f810c3e0 2023-07-14T12:58:36.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.064+0000 7f60ef7fe700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f60e40a11e0 0x7f60e40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:36.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.064+0000 7f60ef7fe700 1 -- 172.21.15.17:0/234471304 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f60f00cc310 con 0x7f60f810c3e0 2023-07-14T12:58:36.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.065+0000 7f60fe32a700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f60e40a11e0 0x7f60e40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:36.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.065+0000 7f60fe32a700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f60e40a11e0 0x7f60e40a3690 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f60f4005950 tx=0x7f60f400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:36.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.069+0000 7f60ef7fe700 1 -- 172.21.15.17:0/234471304 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f60f004e790 con 0x7f60f810c3e0 2023-07-14T12:58:36.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:36 smithi017 ceph-mon[95536]: pgmap v332: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.277+0000 7f610058e700 1 -- 172.21.15.17:0/234471304 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60f80fd2d0 con 0x7f60e40a11e0 2023-07-14T12:58:36.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.288+0000 7f60ef7fe700 1 -- 172.21.15.17:0/234471304 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339194 (secure 0 0 0) 0x7f60f80fd2d0 con 0x7f60e40a11e0 2023-07-14T12:58:36.323 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:58:36.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 -- 172.21.15.17:0/234471304 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f60e40a11e0 msgr2=0x7f60e40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:36.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f60e40a11e0 0x7f60e40a3690 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f60f4005950 tx=0x7f60f400b410 comp rx=0 tx=0).stop 2023-07-14T12:58:36.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 -- 172.21.15.17:0/234471304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60f810c3e0 msgr2=0x7f60f8197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:36.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60f810c3e0 0x7f60f8197b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f60f0007ee0 tx=0x7f60f000d3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:36.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 -- 172.21.15.17:0/234471304 shutdown_connections 2023-07-14T12:58:36.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f60e40a11e0 0x7f60e40a3690 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:36.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60f810c3e0 0x7f60f8197b50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:36.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60f80728b0 0x7f60f819dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:36.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 --2- 172.21.15.17:0/234471304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60f80731c0 0x7f60f819e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:36.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 -- 172.21.15.17:0/234471304 >> 172.21.15.17:0/234471304 conn(0x7f60f80fb660 msgr2=0x7f60f810e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:36.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 -- 172.21.15.17:0/234471304 shutdown_connections 2023-07-14T12:58:36.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:36.294+0000 7f610058e700 1 -- 172.21.15.17:0/234471304 wait complete. 2023-07-14T12:58:36.327 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-07-14T12:58:36.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:36 smithi135 ceph-mon[97338]: pgmap v332: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:36.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:36 smithi131 ceph-mon[96953]: pgmap v332: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:36.754 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2023-07-14T12:58:34.849049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653240,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":455,"num_read_kb":346,"num_write":331,"num_write_kb":3042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1180882,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335060,"kb_used_data":11636,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124606764,"statfs":{"total":1151940427776,"available":1151597326336,"internally_reserved":0,"allocated":11915264,"data_stored":7461640,"data_compressed":113190,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004434"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.962174+0000","last_change":"2023-07-14T12:57:40.168203+0000","last_active":"2023-07-14T12:58:07.962174+0000","last_peered":"2023-07-14T12:58:07.962174+0000","last_clean":"2023-07-14T12:58:07.962174+0000","last_became_active":"2023-07-14T12:57:40.164682+0000","last_became_peered":"2023-07-14T12:57:40.164682+0000","last_unstale":"2023-07-14T12:58:07.962174+0000","last_undegraded":"2023-07-14T12:58:07.962174+0000","last_fullsized":"2023-07-14T12:58:07.962174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:39.005726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966330+0000","last_change":"2023-07-14T12:57:40.168194+0000","last_active":"2023-07-14T12:58:07.966330+0000","last_peered":"2023-07-14T12:58:07.966330+0000","last_clean":"2023-07-14T12:58:07.966330+0000","last_became_active":"2023-07-14T12:57:40.167825+0000","last_became_peered":"2023-07-14T12:57:40.167825+0000","last_unstale":"2023-07-14T12:58:07.966330+0000","last_undegraded":"2023-07-14T12:58:07.966330+0000","last_fullsized":"2023-07-14T12:58:07.966330+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:23:35.037851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965584+0000","last_change":"2023-07-14T12:57:40.162824+0000","last_active":"2023-07-14T12:58:07.965584+0000","last_peered":"2023-07-14T12:58:07.965584+0000","last_clean":"2023-07-14T12:58:07.965584+0000","last_became_active":"2023-07-14T12:57:40.162526+0000","last_became_peered":"2023-07-14T12:57:40.162526+0000","last_unstale":"2023-07-14T12:58:07.965584+0000","last_undegraded":"2023-07-14T12:58:07.965584+0000","last_fullsized":"2023-07-14T12:58:07.965584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:01:27.137266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113989+0000","last_change":"2023-07-14T12:57:40.160772+0000","last_active":"2023-07-14T12:58:08.113989+0000","last_peered":"2023-07-14T12:58:08.113989+0000","last_clean":"2023-07-14T12:58:08.113989+0000","last_became_active":"2023-07-14T12:57:40.160315+0000","last_became_peered":"2023-07-14T12:57:40.160315+0000","last_unstale":"2023-07-14T12:58:08.113989+0000","last_undegraded":"2023-07-14T12:58:08.113989+0000","last_fullsized":"2023-07-14T12:58:08.113989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:48.047786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963574+0000","last_change":"2023-07-14T12:57:40.160868+0000","last_active":"2023-07-14T12:58:07.963574+0000","last_peered":"2023-07-14T12:58:07.963574+0000","last_clean":"2023-07-14T12:58:07.963574+0000","last_became_active":"2023-07-14T12:57:40.160558+0000","last_became_peered":"2023-07-14T12:57:40.160558+0000","last_unstale":"2023-07-14T12:58:07.963574+0000","last_undegraded":"2023-07-14T12:58:07.963574+0000","last_fullsized":"2023-07-14T12:58:07.963574+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:21:57.315978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959509+0000","last_change":"2023-07-14T12:57:40.166305+0000","last_active":"2023-07-14T12:58:07.959509+0000","last_peered":"2023-07-14T12:58:07.959509+0000","last_clean":"2023-07-14T12:58:07.959509+0000","last_became_active":"2023-07-14T12:57:40.166012+0000","last_became_peered":"2023-07-14T12:57:40.166012+0000","last_unstale":"2023-07-14T12:58:07.959509+0000","last_undegraded":"2023-07-14T12:58:07.959509+0000","last_fullsized":"2023-07-14T12:58:07.959509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:03:06.167704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957663+0000","last_change":"2023-07-14T12:57:40.163312+0000","last_active":"2023-07-14T12:58:07.957663+0000","last_peered":"2023-07-14T12:58:07.957663+0000","last_clean":"2023-07-14T12:58:07.957663+0000","last_became_active":"2023-07-14T12:57:40.163030+0000","last_became_peered":"2023-07-14T12:57:40.163030+0000","last_unstale":"2023-07-14T12:58:07.957663+0000","last_undegraded":"2023-07-14T12:58:07.957663+0000","last_fullsized":"2023-07-14T12:58:07.957663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:41.303341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.115578+0000","last_change":"2023-07-14T12:58:08.115121+0000","last_active":"2023-07-14T12:58:08.115578+0000","last_peered":"2023-07-14T12:58:08.115578+0000","last_clean":"2023-07-14T12:58:08.115578+0000","last_became_active":"2023-07-14T12:58:08.114736+0000","last_became_peered":"2023-07-14T12:58:08.114736+0000","last_unstale":"2023-07-14T12:58:08.115578+0000","last_undegraded":"2023-07-14T12:58:08.115578+0000","last_fullsized":"2023-07-14T12:58:08.115578+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:30:27.815140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.114989+0000","last_change":"2023-07-14T12:57:40.170263+0000","last_active":"2023-07-14T12:58:08.114989+0000","last_peered":"2023-07-14T12:58:08.114989+0000","last_clean":"2023-07-14T12:58:08.114989+0000","last_became_active":"2023-07-14T12:57:40.169952+0000","last_became_peered":"2023-07-14T12:57:40.169952+0000","last_unstale":"2023-07-14T12:58:08.114989+0000","last_undegraded":"2023-07-14T12:58:08.114989+0000","last_fullsized":"2023-07-14T12:58:08.114989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:07:08.714595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.960490+0000","last_change":"2023-07-14T12:57:40.165359+0000","last_active":"2023-07-14T12:58:07.960490+0000","last_peered":"2023-07-14T12:58:07.960490+0000","last_clean":"2023-07-14T12:58:07.960490+0000","last_became_active":"2023-07-14T12:57:40.164918+0000","last_became_peered":"2023-07-14T12:57:40.164918+0000","last_unstale":"2023-07-14T12:58:07.960490+0000","last_undegraded":"2023-07-14T12:58:07.960490+0000","last_fullsized":"2023-07-14T12:58:07.960490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:57:54.633792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958355+0000","last_change":"2023-07-14T12:57:40.160524+0000","last_active":"2023-07-14T12:58:07.958355+0000","last_peered":"2023-07-14T12:58:07.958355+0000","last_clean":"2023-07-14T12:58:07.958355+0000","last_became_active":"2023-07-14T12:57:40.160215+0000","last_became_peered":"2023-07-14T12:57:40.160215+0000","last_unstale":"2023-07-14T12:58:07.958355+0000","last_undegraded":"2023-07-14T12:58:07.958355+0000","last_fullsized":"2023-07-14T12:58:07.958355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:21.213962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965141+0000","last_change":"2023-07-14T12:58:07.964366+0000","last_active":"2023-07-14T12:58:07.965141+0000","last_peered":"2023-07-14T12:58:07.965141+0000","last_clean":"2023-07-14T12:58:07.965141+0000","last_became_active":"2023-07-14T12:58:07.963981+0000","last_became_peered":"2023-07-14T12:58:07.963981+0000","last_unstale":"2023-07-14T12:58:07.965141+0000","last_undegraded":"2023-07-14T12:58:07.965141+0000","last_fullsized":"2023-07-14T12:58:07.965141+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:28:52.971393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961839+0000","last_change":"2023-07-14T12:57:40.162166+0000","last_active":"2023-07-14T12:58:07.961839+0000","last_peered":"2023-07-14T12:58:07.961839+0000","last_clean":"2023-07-14T12:58:07.961839+0000","last_became_active":"2023-07-14T12:57:40.161750+0000","last_became_peered":"2023-07-14T12:57:40.161750+0000","last_unstale":"2023-07-14T12:58:07.961839+0000","last_undegraded":"2023-07-14T12:58:07.961839+0000","last_fullsized":"2023-07-14T12:58:07.961839+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:19:28.054997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965781+0000","last_change":"2023-07-14T12:57:40.160556+0000","last_active":"2023-07-14T12:58:07.965781+0000","last_peered":"2023-07-14T12:58:07.965781+0000","last_clean":"2023-07-14T12:58:07.965781+0000","last_became_active":"2023-07-14T12:57:40.159974+0000","last_became_peered":"2023-07-14T12:57:40.159974+0000","last_unstale":"2023-07-14T12:58:07.965781+0000","last_undegraded":"2023-07-14T12:58:07.965781+0000","last_fullsized":"2023-07-14T12:58:07.965781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:35:12.700407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965584+0000","last_change":"2023-07-14T12:57:40.169116+0000","last_active":"2023-07-14T12:58:07.965584+0000","last_peered":"2023-07-14T12:58:07.965584+0000","last_clean":"2023-07-14T12:58:07.965584+0000","last_became_active":"2023-07-14T12:57:40.168714+0000","last_became_peered":"2023-07-14T12:57:40.168714+0000","last_unstale":"2023-07-14T12:58:07.965584+0000","last_undegraded":"2023-07-14T12:58:07.965584+0000","last_fullsized":"2023-07-14T12:58:07.965584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:17:06.970124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.112939+0000","last_change":"2023-07-14T12:57:40.162621+0000","last_active":"2023-07-14T12:58:08.112939+0000","last_peered":"2023-07-14T12:58:08.112939+0000","last_clean":"2023-07-14T12:58:08.112939+0000","last_became_active":"2023-07-14T12:57:40.162329+0000","last_became_peered":"2023-07-14T12:57:40.162329+0000","last_unstale":"2023-07-14T12:58:08.112939+0000","last_undegraded":"2023-07-14T12:58:08.112939+0000","last_fullsized":"2023-07-14T12:58:08.112939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:19.671402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.962504+0000","last_change":"2023-07-14T12:57:40.172697+0000","last_active":"2023-07-14T12:58:07.962504+0000","last_peered":"2023-07-14T12:58:07.962504+0000","last_clean":"2023-07-14T12:58:07.962504+0000","last_became_active":"2023-07-14T12:57:40.172366+0000","last_became_peered":"2023-07-14T12:57:40.172366+0000","last_unstale":"2023-07-14T12:58:07.962504+0000","last_undegraded":"2023-07-14T12:58:07.962504+0000","last_fullsized":"2023-07-14T12:58:07.962504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:57.950996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959470+0000","last_change":"2023-07-14T12:57:40.166669+0000","last_active":"2023-07-14T12:58:07.959470+0000","last_peered":"2023-07-14T12:58:07.959470+0000","last_clean":"2023-07-14T12:58:07.959470+0000","last_became_active":"2023-07-14T12:57:40.166367+0000","last_became_peered":"2023-07-14T12:57:40.166367+0000","last_unstale":"2023-07-14T12:58:07.959470+0000","last_undegraded":"2023-07-14T12:58:07.959470+0000","last_fullsized":"2023-07-14T12:58:07.959470+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:32:55.001814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965791+0000","last_change":"2023-07-14T12:57:40.159133+0000","last_active":"2023-07-14T12:58:07.965791+0000","last_peered":"2023-07-14T12:58:07.965791+0000","last_clean":"2023-07-14T12:58:07.965791+0000","last_became_active":"2023-07-14T12:57:40.158819+0000","last_became_peered":"2023-07-14T12:57:40.158819+0000","last_unstale":"2023-07-14T12:58:07.965791+0000","last_undegraded":"2023-07-14T12:58:07.965791+0000","last_fullsized":"2023-07-14T12:58:07.965791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:34.782295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959654+0000","last_change":"2023-07-14T12:57:39.144919+0000","last_active":"2023-07-14T12:58:07.959654+0000","last_peered":"2023-07-14T12:58:07.959654+0000","last_clean":"2023-07-14T12:58:07.959654+0000","last_became_active":"2023-07-14T12:57:39.144604+0000","last_became_peered":"2023-07-14T12:57:39.144604+0000","last_unstale":"2023-07-14T12:58:07.959654+0000","last_undegraded":"2023-07-14T12:58:07.959654+0000","last_fullsized":"2023-07-14T12:58:07.959654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:32:41.249364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965297+0000","last_change":"2023-07-14T12:57:40.165754+0000","last_active":"2023-07-14T12:58:07.965297+0000","last_peered":"2023-07-14T12:58:07.965297+0000","last_clean":"2023-07-14T12:58:07.965297+0000","last_became_active":"2023-07-14T12:57:40.165416+0000","last_became_peered":"2023-07-14T12:57:40.165416+0000","last_unstale":"2023-07-14T12:58:07.965297+0000","last_undegraded":"2023-07-14T12:58:07.965297+0000","last_fullsized":"2023-07-14T12:58:07.965297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:44.533325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965435+0000","last_change":"2023-07-14T12:57:39.153977+0000","last_active":"2023-07-14T12:58:07.965435+0000","last_peered":"2023-07-14T12:58:07.965435+0000","last_clean":"2023-07-14T12:58:07.965435+0000","last_became_active":"2023-07-14T12:57:39.153675+0000","last_became_peered":"2023-07-14T12:57:39.153675+0000","last_unstale":"2023-07-14T12:58:07.965435+0000","last_undegraded":"2023-07-14T12:58:07.965435+0000","last_fullsized":"2023-07-14T12:58:07.965435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:56.670099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966537+0000","last_change":"2023-07-14T12:57:40.157076+0000","last_active":"2023-07-14T12:58:07.966537+0000","last_peered":"2023-07-14T12:58:07.966537+0000","last_clean":"2023-07-14T12:58:07.966537+0000","last_became_active":"2023-07-14T12:57:40.156652+0000","last_became_peered":"2023-07-14T12:57:40.156652+0000","last_unstale":"2023-07-14T12:58:07.966537+0000","last_undegraded":"2023-07-14T12:58:07.966537+0000","last_fullsized":"2023-07-14T12:58:07.966537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:51.608575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963702+0000","last_change":"2023-07-14T12:57:39.145123+0000","last_active":"2023-07-14T12:58:07.963702+0000","last_peered":"2023-07-14T12:58:07.963702+0000","last_clean":"2023-07-14T12:58:07.963702+0000","last_became_active":"2023-07-14T12:57:39.144768+0000","last_became_peered":"2023-07-14T12:57:39.144768+0000","last_unstale":"2023-07-14T12:58:07.963702+0000","last_undegraded":"2023-07-14T12:58:07.963702+0000","last_fullsized":"2023-07-14T12:58:07.963702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:13:21.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113165+0000","last_change":"2023-07-14T12:57:40.167084+0000","last_active":"2023-07-14T12:58:08.113165+0000","last_peered":"2023-07-14T12:58:08.113165+0000","last_clean":"2023-07-14T12:58:08.113165+0000","last_became_active":"2023-07-14T12:57:40.166654+0000","last_became_peered":"2023-07-14T12:57:40.166654+0000","last_unstale":"2023-07-14T12:58:08.113165+0000","last_undegraded":"2023-07-14T12:58:08.113165+0000","last_fullsized":"2023-07-14T12:58:08.113165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:01:54.429150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963132+0000","last_change":"2023-07-14T12:57:39.137432+0000","last_active":"2023-07-14T12:58:07.963132+0000","last_peered":"2023-07-14T12:58:07.963132+0000","last_clean":"2023-07-14T12:58:07.963132+0000","last_became_active":"2023-07-14T12:57:39.137124+0000","last_became_peered":"2023-07-14T12:57:39.137124+0000","last_unstale":"2023-07-14T12:58:07.963132+0000","last_undegraded":"2023-07-14T12:58:07.963132+0000","last_fullsized":"2023-07-14T12:58:07.963132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:50.638289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113501+0000","last_change":"2023-07-14T12:57:40.167477+0000","last_active":"2023-07-14T12:58:08.113501+0000","last_peered":"2023-07-14T12:58:08.113501+0000","last_clean":"2023-07-14T12:58:08.113501+0000","last_became_active":"2023-07-14T12:57:40.167177+0000","last_became_peered":"2023-07-14T12:57:40.167177+0000","last_unstale":"2023-07-14T12:58:08.113501+0000","last_undegraded":"2023-07-14T12:58:08.113501+0000","last_fullsized":"2023-07-14T12:58:08.113501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:39:35.566121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":71,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:29.300574+0000","last_change":"2023-07-14T12:57:39.146569+0000","last_active":"2023-07-14T12:58:29.300574+0000","last_peered":"2023-07-14T12:58:29.300574+0000","last_clean":"2023-07-14T12:58:29.300574+0000","last_became_active":"2023-07-14T12:57:39.146251+0000","last_became_peered":"2023-07-14T12:57:39.146251+0000","last_unstale":"2023-07-14T12:58:29.300574+0000","last_undegraded":"2023-07-14T12:58:29.300574+0000","last_fullsized":"2023-07-14T12:58:29.300574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:33.372913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963532+0000","last_change":"2023-07-14T12:57:40.160511+0000","last_active":"2023-07-14T12:58:07.963532+0000","last_peered":"2023-07-14T12:58:07.963532+0000","last_clean":"2023-07-14T12:58:07.963532+0000","last_became_active":"2023-07-14T12:57:40.160152+0000","last_became_peered":"2023-07-14T12:57:40.160152+0000","last_unstale":"2023-07-14T12:58:07.963532+0000","last_undegraded":"2023-07-14T12:58:07.963532+0000","last_fullsized":"2023-07-14T12:58:07.963532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:05.198459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.119603+0000","last_change":"2023-07-14T12:58:08.119603+0000","last_active":"2023-07-14T12:58:08.119603+0000","last_peered":"2023-07-14T12:58:08.119603+0000","last_clean":"2023-07-14T12:58:08.119603+0000","last_became_active":"2023-07-14T12:58:08.115814+0000","last_became_peered":"2023-07-14T12:58:08.115814+0000","last_unstale":"2023-07-14T12:58:08.119603+0000","last_undegraded":"2023-07-14T12:58:08.119603+0000","last_fullsized":"2023-07-14T12:58:08.119603+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:49.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.967955+0000","last_change":"2023-07-14T12:58:07.967463+0000","last_active":"2023-07-14T12:58:07.967955+0000","last_peered":"2023-07-14T12:58:07.967955+0000","last_clean":"2023-07-14T12:58:07.967955+0000","last_became_active":"2023-07-14T12:58:07.967136+0000","last_became_peered":"2023-07-14T12:58:07.967136+0000","last_unstale":"2023-07-14T12:58:07.967955+0000","last_undegraded":"2023-07-14T12:58:07.967955+0000","last_fullsized":"2023-07-14T12:58:07.967955+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:53.152331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961797+0000","last_change":"2023-07-14T12:57:39.145352+0000","last_active":"2023-07-14T12:58:07.961797+0000","last_peered":"2023-07-14T12:58:07.961797+0000","last_clean":"2023-07-14T12:58:07.961797+0000","last_became_active":"2023-07-14T12:57:39.145018+0000","last_became_peered":"2023-07-14T12:57:39.145018+0000","last_unstale":"2023-07-14T12:58:07.961797+0000","last_undegraded":"2023-07-14T12:58:07.961797+0000","last_fullsized":"2023-07-14T12:58:07.961797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:46:13.836721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.964729+0000","last_change":"2023-07-14T12:57:40.173457+0000","last_active":"2023-07-14T12:58:07.964729+0000","last_peered":"2023-07-14T12:58:07.964729+0000","last_clean":"2023-07-14T12:58:07.964729+0000","last_became_active":"2023-07-14T12:57:40.173080+0000","last_became_peered":"2023-07-14T12:57:40.173080+0000","last_unstale":"2023-07-14T12:58:07.964729+0000","last_undegraded":"2023-07-14T12:58:07.964729+0000","last_fullsized":"2023-07-14T12:58:07.964729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:18.222106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113467+0000","last_change":"2023-07-14T12:57:39.145383+0000","last_active":"2023-07-14T12:58:08.113467+0000","last_peered":"2023-07-14T12:58:08.113467+0000","last_clean":"2023-07-14T12:58:08.113467+0000","last_became_active":"2023-07-14T12:57:39.145088+0000","last_became_peered":"2023-07-14T12:57:39.145088+0000","last_unstale":"2023-07-14T12:58:08.113467+0000","last_undegraded":"2023-07-14T12:58:08.113467+0000","last_fullsized":"2023-07-14T12:58:08.113467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:32.979153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959132+0000","last_change":"2023-07-14T12:57:40.162123+0000","last_active":"2023-07-14T12:58:07.959132+0000","last_peered":"2023-07-14T12:58:07.959132+0000","last_clean":"2023-07-14T12:58:07.959132+0000","last_became_active":"2023-07-14T12:57:40.160789+0000","last_became_peered":"2023-07-14T12:57:40.160789+0000","last_unstale":"2023-07-14T12:58:07.959132+0000","last_undegraded":"2023-07-14T12:58:07.959132+0000","last_fullsized":"2023-07-14T12:58:07.959132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:24.181158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":71,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:33.306397+0000","last_change":"2023-07-14T12:57:39.139524+0000","last_active":"2023-07-14T12:58:33.306397+0000","last_peered":"2023-07-14T12:58:33.306397+0000","last_clean":"2023-07-14T12:58:33.306397+0000","last_became_active":"2023-07-14T12:57:39.139176+0000","last_became_peered":"2023-07-14T12:57:39.139176+0000","last_unstale":"2023-07-14T12:58:33.306397+0000","last_undegraded":"2023-07-14T12:58:33.306397+0000","last_fullsized":"2023-07-14T12:58:33.306397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:27.070260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113322+0000","last_change":"2023-07-14T12:57:40.168729+0000","last_active":"2023-07-14T12:58:08.113322+0000","last_peered":"2023-07-14T12:58:08.113322+0000","last_clean":"2023-07-14T12:58:08.113322+0000","last_became_active":"2023-07-14T12:57:40.168408+0000","last_became_peered":"2023-07-14T12:57:40.168408+0000","last_unstale":"2023-07-14T12:58:08.113322+0000","last_undegraded":"2023-07-14T12:58:08.113322+0000","last_fullsized":"2023-07-14T12:58:08.113322+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:58:20.491077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958510+0000","last_change":"2023-07-14T12:57:39.140744+0000","last_active":"2023-07-14T12:58:07.958510+0000","last_peered":"2023-07-14T12:58:07.958510+0000","last_clean":"2023-07-14T12:58:07.958510+0000","last_became_active":"2023-07-14T12:57:39.140391+0000","last_became_peered":"2023-07-14T12:57:39.140391+0000","last_unstale":"2023-07-14T12:58:07.958510+0000","last_undegraded":"2023-07-14T12:58:07.958510+0000","last_fullsized":"2023-07-14T12:58:07.958510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:01.023100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966511+0000","last_change":"2023-07-14T12:57:40.165552+0000","last_active":"2023-07-14T12:58:07.966511+0000","last_peered":"2023-07-14T12:58:07.966511+0000","last_clean":"2023-07-14T12:58:07.966511+0000","last_became_active":"2023-07-14T12:57:40.165214+0000","last_became_peered":"2023-07-14T12:57:40.165214+0000","last_unstale":"2023-07-14T12:58:07.966511+0000","last_undegraded":"2023-07-14T12:58:07.966511+0000","last_fullsized":"2023-07-14T12:58:07.966511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:15.528292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113790+0000","last_change":"2023-07-14T12:57:39.150311+0000","last_active":"2023-07-14T12:58:08.113790+0000","last_peered":"2023-07-14T12:58:08.113790+0000","last_clean":"2023-07-14T12:58:08.113790+0000","last_became_active":"2023-07-14T12:57:39.149885+0000","last_became_peered":"2023-07-14T12:57:39.149885+0000","last_unstale":"2023-07-14T12:58:08.113790+0000","last_undegraded":"2023-07-14T12:58:08.113790+0000","last_fullsized":"2023-07-14T12:58:08.113790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:56.722568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113391+0000","last_change":"2023-07-14T12:57:40.161845+0000","last_active":"2023-07-14T12:58:08.113391+0000","last_peered":"2023-07-14T12:58:08.113391+0000","last_clean":"2023-07-14T12:58:08.113391+0000","last_became_active":"2023-07-14T12:57:40.160895+0000","last_became_peered":"2023-07-14T12:57:40.160895+0000","last_unstale":"2023-07-14T12:58:08.113391+0000","last_undegraded":"2023-07-14T12:58:08.113391+0000","last_fullsized":"2023-07-14T12:58:08.113391+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:20:16.547464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'27","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:34.318704+0000","last_change":"2023-07-14T12:57:39.142584+0000","last_active":"2023-07-14T12:58:34.318704+0000","last_peered":"2023-07-14T12:58:34.318704+0000","last_clean":"2023-07-14T12:58:34.318704+0000","last_became_active":"2023-07-14T12:57:39.142239+0000","last_became_peered":"2023-07-14T12:57:39.142239+0000","last_unstale":"2023-07-14T12:58:34.318704+0000","last_undegraded":"2023-07-14T12:58:34.318704+0000","last_fullsized":"2023-07-14T12:58:34.318704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:56.022427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59112,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":28,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963247+0000","last_change":"2023-07-14T12:57:40.170013+0000","last_active":"2023-07-14T12:58:07.963247+0000","last_peered":"2023-07-14T12:58:07.963247+0000","last_clean":"2023-07-14T12:58:07.963247+0000","last_became_active":"2023-07-14T12:57:40.169177+0000","last_became_peered":"2023-07-14T12:57:40.169177+0000","last_unstale":"2023-07-14T12:58:07.963247+0000","last_undegraded":"2023-07-14T12:58:07.963247+0000","last_fullsized":"2023-07-14T12:58:07.963247+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:42.957456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.978704+0000","last_change":"2023-07-14T12:58:07.978239+0000","last_active":"2023-07-14T12:58:07.978704+0000","last_peered":"2023-07-14T12:58:07.978704+0000","last_clean":"2023-07-14T12:58:07.978704+0000","last_became_active":"2023-07-14T12:58:07.967195+0000","last_became_peered":"2023-07-14T12:58:07.967195+0000","last_unstale":"2023-07-14T12:58:07.978704+0000","last_undegraded":"2023-07-14T12:58:07.978704+0000","last_fullsized":"2023-07-14T12:58:07.978704+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:05.124879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961641+0000","last_change":"2023-07-14T12:57:40.158098+0000","last_active":"2023-07-14T12:58:07.961641+0000","last_peered":"2023-07-14T12:58:07.961641+0000","last_clean":"2023-07-14T12:58:07.961641+0000","last_became_active":"2023-07-14T12:57:40.157736+0000","last_became_peered":"2023-07-14T12:57:40.157736+0000","last_unstale":"2023-07-14T12:58:07.961641+0000","last_undegraded":"2023-07-14T12:58:07.961641+0000","last_fullsized":"2023-07-14T12:58:07.961641+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:04:59.371098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113762+0000","last_change":"2023-07-14T12:57:39.135784+0000","last_active":"2023-07-14T12:58:08.113762+0000","last_peered":"2023-07-14T12:58:08.113762+0000","last_clean":"2023-07-14T12:58:08.113762+0000","last_became_active":"2023-07-14T12:57:39.135480+0000","last_became_peered":"2023-07-14T12:57:39.135480+0000","last_unstale":"2023-07-14T12:58:08.113762+0000","last_undegraded":"2023-07-14T12:58:08.113762+0000","last_fullsized":"2023-07-14T12:58:08.113762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:33:37.574910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957954+0000","last_change":"2023-07-14T12:57:40.162548+0000","last_active":"2023-07-14T12:58:07.957954+0000","last_peered":"2023-07-14T12:58:07.957954+0000","last_clean":"2023-07-14T12:58:07.957954+0000","last_became_active":"2023-07-14T12:57:40.162191+0000","last_became_peered":"2023-07-14T12:57:40.162191+0000","last_unstale":"2023-07-14T12:58:07.957954+0000","last_undegraded":"2023-07-14T12:58:07.957954+0000","last_fullsized":"2023-07-14T12:58:07.957954+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:04.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":72,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:32.320667+0000","last_change":"2023-07-14T12:57:39.145533+0000","last_active":"2023-07-14T12:58:32.320667+0000","last_peered":"2023-07-14T12:58:32.320667+0000","last_clean":"2023-07-14T12:58:32.320667+0000","last_became_active":"2023-07-14T12:57:39.145201+0000","last_became_peered":"2023-07-14T12:57:39.145201+0000","last_unstale":"2023-07-14T12:58:32.320667+0000","last_undegraded":"2023-07-14T12:58:32.320667+0000","last_fullsized":"2023-07-14T12:58:32.320667+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:46.324639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958091+0000","last_change":"2023-07-14T12:57:40.160047+0000","last_active":"2023-07-14T12:58:07.958091+0000","last_peered":"2023-07-14T12:58:07.958091+0000","last_clean":"2023-07-14T12:58:07.958091+0000","last_became_active":"2023-07-14T12:57:40.159751+0000","last_became_peered":"2023-07-14T12:57:40.159751+0000","last_unstale":"2023-07-14T12:58:07.958091+0000","last_undegraded":"2023-07-14T12:58:07.958091+0000","last_fullsized":"2023-07-14T12:58:07.958091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:16.874363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.130840+0000","last_change":"2023-07-14T12:58:08.130840+0000","last_active":"2023-07-14T12:58:08.130840+0000","last_peered":"2023-07-14T12:58:08.130840+0000","last_clean":"2023-07-14T12:58:08.130840+0000","last_became_active":"2023-07-14T12:58:08.116583+0000","last_became_peered":"2023-07-14T12:58:08.116583+0000","last_unstale":"2023-07-14T12:58:08.130840+0000","last_undegraded":"2023-07-14T12:58:08.130840+0000","last_fullsized":"2023-07-14T12:58:08.130840+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:07:34.361949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113509+0000","last_change":"2023-07-14T12:57:40.173741+0000","last_active":"2023-07-14T12:58:08.113509+0000","last_peered":"2023-07-14T12:58:08.113509+0000","last_clean":"2023-07-14T12:58:08.113509+0000","last_became_active":"2023-07-14T12:57:40.173427+0000","last_became_peered":"2023-07-14T12:57:40.173427+0000","last_unstale":"2023-07-14T12:58:08.113509+0000","last_undegraded":"2023-07-14T12:58:08.113509+0000","last_fullsized":"2023-07-14T12:58:08.113509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:41:16.366763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963223+0000","last_change":"2023-07-14T12:57:39.140979+0000","last_active":"2023-07-14T12:58:07.963223+0000","last_peered":"2023-07-14T12:58:07.963223+0000","last_clean":"2023-07-14T12:58:07.963223+0000","last_became_active":"2023-07-14T12:57:39.140692+0000","last_became_peered":"2023-07-14T12:57:39.140692+0000","last_unstale":"2023-07-14T12:58:07.963223+0000","last_undegraded":"2023-07-14T12:58:07.963223+0000","last_fullsized":"2023-07-14T12:58:07.963223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:01:09.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961982+0000","last_change":"2023-07-14T12:57:40.164258+0000","last_active":"2023-07-14T12:58:07.961982+0000","last_peered":"2023-07-14T12:58:07.961982+0000","last_clean":"2023-07-14T12:58:07.961982+0000","last_became_active":"2023-07-14T12:57:40.163911+0000","last_became_peered":"2023-07-14T12:57:40.163911+0000","last_unstale":"2023-07-14T12:58:07.961982+0000","last_undegraded":"2023-07-14T12:58:07.961982+0000","last_fullsized":"2023-07-14T12:58:07.961982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:45.474358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959321+0000","last_change":"2023-07-14T12:57:39.151301+0000","last_active":"2023-07-14T12:58:07.959321+0000","last_peered":"2023-07-14T12:58:07.959321+0000","last_clean":"2023-07-14T12:58:07.959321+0000","last_became_active":"2023-07-14T12:57:39.150948+0000","last_became_peered":"2023-07-14T12:57:39.150948+0000","last_unstale":"2023-07-14T12:58:07.959321+0000","last_undegraded":"2023-07-14T12:58:07.959321+0000","last_fullsized":"2023-07-14T12:58:07.959321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:11.221824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.960006+0000","last_change":"2023-07-14T12:57:40.158591+0000","last_active":"2023-07-14T12:58:07.960006+0000","last_peered":"2023-07-14T12:58:07.960006+0000","last_clean":"2023-07-14T12:58:07.960006+0000","last_became_active":"2023-07-14T12:57:40.158229+0000","last_became_peered":"2023-07-14T12:57:40.158229+0000","last_unstale":"2023-07-14T12:58:07.960006+0000","last_undegraded":"2023-07-14T12:58:07.960006+0000","last_fullsized":"2023-07-14T12:58:07.960006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:48.116113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957827+0000","last_change":"2023-07-14T12:57:39.152151+0000","last_active":"2023-07-14T12:58:07.957827+0000","last_peered":"2023-07-14T12:58:07.957827+0000","last_clean":"2023-07-14T12:58:07.957827+0000","last_became_active":"2023-07-14T12:57:39.151859+0000","last_became_peered":"2023-07-14T12:57:39.151859+0000","last_unstale":"2023-07-14T12:58:07.957827+0000","last_undegraded":"2023-07-14T12:58:07.957827+0000","last_fullsized":"2023-07-14T12:58:07.957827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:19:10.573132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959825+0000","last_change":"2023-07-14T12:57:40.166604+0000","last_active":"2023-07-14T12:58:07.959825+0000","last_peered":"2023-07-14T12:58:07.959825+0000","last_clean":"2023-07-14T12:58:07.959825+0000","last_became_active":"2023-07-14T12:57:40.166265+0000","last_became_peered":"2023-07-14T12:57:40.166265+0000","last_unstale":"2023-07-14T12:58:07.959825+0000","last_undegraded":"2023-07-14T12:58:07.959825+0000","last_fullsized":"2023-07-14T12:58:07.959825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:01.157573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113808+0000","last_change":"2023-07-14T12:57:40.169910+0000","last_active":"2023-07-14T12:58:08.113808+0000","last_peered":"2023-07-14T12:58:08.113808+0000","last_clean":"2023-07-14T12:58:08.113808+0000","last_became_active":"2023-07-14T12:57:40.169621+0000","last_became_peered":"2023-07-14T12:57:40.169621+0000","last_unstale":"2023-07-14T12:58:08.113808+0000","last_undegraded":"2023-07-14T12:58:08.113808+0000","last_fullsized":"2023-07-14T12:58:08.113808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:14.831482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":70,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:31.317438+0000","last_change":"2023-07-14T12:57:39.144463+0000","last_active":"2023-07-14T12:58:31.317438+0000","last_peered":"2023-07-14T12:58:31.317438+0000","last_clean":"2023-07-14T12:58:31.317438+0000","last_became_active":"2023-07-14T12:57:39.142094+0000","last_became_peered":"2023-07-14T12:57:39.142094+0000","last_unstale":"2023-07-14T12:58:31.317438+0000","last_undegraded":"2023-07-14T12:58:31.317438+0000","last_fullsized":"2023-07-14T12:58:31.317438+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:11:20.958238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965691+0000","last_change":"2023-07-14T12:57:40.163588+0000","last_active":"2023-07-14T12:58:07.965691+0000","last_peered":"2023-07-14T12:58:07.965691+0000","last_clean":"2023-07-14T12:58:07.965691+0000","last_became_active":"2023-07-14T12:57:40.162611+0000","last_became_peered":"2023-07-14T12:57:40.162611+0000","last_unstale":"2023-07-14T12:58:07.965691+0000","last_undegraded":"2023-07-14T12:58:07.965691+0000","last_fullsized":"2023-07-14T12:58:07.965691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:21:59.184916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113974+0000","last_change":"2023-07-14T12:57:39.143581+0000","last_active":"2023-07-14T12:58:08.113974+0000","last_peered":"2023-07-14T12:58:08.113974+0000","last_clean":"2023-07-14T12:58:08.113974+0000","last_became_active":"2023-07-14T12:57:39.143257+0000","last_became_peered":"2023-07-14T12:57:39.143257+0000","last_unstale":"2023-07-14T12:58:08.113974+0000","last_undegraded":"2023-07-14T12:58:08.113974+0000","last_fullsized":"2023-07-14T12:58:08.113974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:30.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":350,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957866+0000","last_change":"2023-07-14T12:56:23.360103+0000","last_active":"2023-07-14T12:58:07.957866+0000","last_peered":"2023-07-14T12:58:07.957866+0000","last_clean":"2023-07-14T12:58:07.957866+0000","last_became_active":"2023-07-14T12:56:23.359608+0000","last_became_peered":"2023-07-14T12:56:23.359608+0000","last_unstale":"2023-07-14T12:58:07.957866+0000","last_undegraded":"2023-07-14T12:58:07.957866+0000","last_fullsized":"2023-07-14T12:58:07.957866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.397328+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:52:52.622736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961633+0000","last_change":"2023-07-14T12:57:40.158039+0000","last_active":"2023-07-14T12:58:07.961633+0000","last_peered":"2023-07-14T12:58:07.961633+0000","last_clean":"2023-07-14T12:58:07.961633+0000","last_became_active":"2023-07-14T12:57:40.157629+0000","last_became_peered":"2023-07-14T12:57:40.157629+0000","last_unstale":"2023-07-14T12:58:07.961633+0000","last_undegraded":"2023-07-14T12:58:07.961633+0000","last_fullsized":"2023-07-14T12:58:07.961633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:18.205760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958150+0000","last_change":"2023-07-14T12:57:39.146449+0000","last_active":"2023-07-14T12:58:07.958150+0000","last_peered":"2023-07-14T12:58:07.958150+0000","last_clean":"2023-07-14T12:58:07.958150+0000","last_became_active":"2023-07-14T12:57:39.146109+0000","last_became_peered":"2023-07-14T12:57:39.146109+0000","last_unstale":"2023-07-14T12:58:07.958150+0000","last_undegraded":"2023-07-14T12:58:07.958150+0000","last_fullsized":"2023-07-14T12:58:07.958150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:15.222237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963386+0000","last_change":"2023-07-14T12:57:39.149417+0000","last_active":"2023-07-14T12:58:07.963386+0000","last_peered":"2023-07-14T12:58:07.963386+0000","last_clean":"2023-07-14T12:58:07.963386+0000","last_became_active":"2023-07-14T12:57:39.149097+0000","last_became_peered":"2023-07-14T12:57:39.149097+0000","last_unstale":"2023-07-14T12:58:07.963386+0000","last_undegraded":"2023-07-14T12:58:07.963386+0000","last_fullsized":"2023-07-14T12:58:07.963386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:10.550476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961833+0000","last_change":"2023-07-14T12:57:40.160881+0000","last_active":"2023-07-14T12:58:07.961833+0000","last_peered":"2023-07-14T12:58:07.961833+0000","last_clean":"2023-07-14T12:58:07.961833+0000","last_became_active":"2023-07-14T12:57:40.158570+0000","last_became_peered":"2023-07-14T12:57:40.158570+0000","last_unstale":"2023-07-14T12:58:07.961833+0000","last_undegraded":"2023-07-14T12:58:07.961833+0000","last_fullsized":"2023-07-14T12:58:07.961833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:46.644633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959462+0000","last_change":"2023-07-14T12:57:39.142805+0000","last_active":"2023-07-14T12:58:07.959462+0000","last_peered":"2023-07-14T12:58:07.959462+0000","last_clean":"2023-07-14T12:58:07.959462+0000","last_became_active":"2023-07-14T12:57:39.142417+0000","last_became_peered":"2023-07-14T12:57:39.142417+0000","last_unstale":"2023-07-14T12:58:07.959462+0000","last_undegraded":"2023-07-14T12:58:07.959462+0000","last_fullsized":"2023-07-14T12:58:07.959462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:01:14.949862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965258+0000","last_change":"2023-07-14T12:57:40.171695+0000","last_active":"2023-07-14T12:58:07.965258+0000","last_peered":"2023-07-14T12:58:07.965258+0000","last_clean":"2023-07-14T12:58:07.965258+0000","last_became_active":"2023-07-14T12:57:40.171344+0000","last_became_peered":"2023-07-14T12:57:40.171344+0000","last_unstale":"2023-07-14T12:58:07.965258+0000","last_undegraded":"2023-07-14T12:58:07.965258+0000","last_fullsized":"2023-07-14T12:58:07.965258+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:49.528964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113794+0000","last_change":"2023-07-14T12:57:39.141065+0000","last_active":"2023-07-14T12:58:08.113794+0000","last_peered":"2023-07-14T12:58:08.113794+0000","last_clean":"2023-07-14T12:58:08.113794+0000","last_became_active":"2023-07-14T12:57:39.140681+0000","last_became_peered":"2023-07-14T12:57:39.140681+0000","last_unstale":"2023-07-14T12:58:08.113794+0000","last_undegraded":"2023-07-14T12:58:08.113794+0000","last_fullsized":"2023-07-14T12:58:08.113794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:38:35.851889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966374+0000","last_change":"2023-07-14T12:57:40.158403+0000","last_active":"2023-07-14T12:58:07.966374+0000","last_peered":"2023-07-14T12:58:07.966374+0000","last_clean":"2023-07-14T12:58:07.966374+0000","last_became_active":"2023-07-14T12:57:40.158077+0000","last_became_peered":"2023-07-14T12:57:40.158077+0000","last_unstale":"2023-07-14T12:58:07.966374+0000","last_undegraded":"2023-07-14T12:58:07.966374+0000","last_fullsized":"2023-07-14T12:58:07.966374+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:27:14.759138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.112919+0000","last_change":"2023-07-14T12:57:39.139613+0000","last_active":"2023-07-14T12:58:08.112919+0000","last_peered":"2023-07-14T12:58:08.112919+0000","last_clean":"2023-07-14T12:58:08.112919+0000","last_became_active":"2023-07-14T12:57:39.139306+0000","last_became_peered":"2023-07-14T12:57:39.139306+0000","last_unstale":"2023-07-14T12:58:08.112919+0000","last_undegraded":"2023-07-14T12:58:08.112919+0000","last_fullsized":"2023-07-14T12:58:08.112919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:16:13.426604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.962606+0000","last_change":"2023-07-14T12:57:40.169715+0000","last_active":"2023-07-14T12:58:07.962606+0000","last_peered":"2023-07-14T12:58:07.962606+0000","last_clean":"2023-07-14T12:58:07.962606+0000","last_became_active":"2023-07-14T12:57:40.169319+0000","last_became_peered":"2023-07-14T12:57:40.169319+0000","last_unstale":"2023-07-14T12:58:07.962606+0000","last_undegraded":"2023-07-14T12:58:07.962606+0000","last_fullsized":"2023-07-14T12:58:07.962606+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:49.187041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.964905+0000","last_change":"2023-07-14T12:57:39.134058+0000","last_active":"2023-07-14T12:58:07.964905+0000","last_peered":"2023-07-14T12:58:07.964905+0000","last_clean":"2023-07-14T12:58:07.964905+0000","last_became_active":"2023-07-14T12:57:39.133143+0000","last_became_peered":"2023-07-14T12:57:39.133143+0000","last_unstale":"2023-07-14T12:58:07.964905+0000","last_undegraded":"2023-07-14T12:58:07.964905+0000","last_fullsized":"2023-07-14T12:58:07.964905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:22:41.049828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961593+0000","last_change":"2023-07-14T12:57:40.164106+0000","last_active":"2023-07-14T12:58:07.961593+0000","last_peered":"2023-07-14T12:58:07.961593+0000","last_clean":"2023-07-14T12:58:07.961593+0000","last_became_active":"2023-07-14T12:57:40.163768+0000","last_became_peered":"2023-07-14T12:57:40.163768+0000","last_unstale":"2023-07-14T12:58:07.961593+0000","last_undegraded":"2023-07-14T12:58:07.961593+0000","last_fullsized":"2023-07-14T12:58:07.961593+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:27.922121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.971006+0000","last_change":"2023-07-14T12:58:07.970517+0000","last_active":"2023-07-14T12:58:07.971006+0000","last_peered":"2023-07-14T12:58:07.971006+0000","last_clean":"2023-07-14T12:58:07.971006+0000","last_became_active":"2023-07-14T12:58:07.967121+0000","last_became_peered":"2023-07-14T12:58:07.967121+0000","last_unstale":"2023-07-14T12:58:07.971006+0000","last_undegraded":"2023-07-14T12:58:07.971006+0000","last_fullsized":"2023-07-14T12:58:07.971006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:48:35.651155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965590+0000","last_change":"2023-07-14T12:57:40.163373+0000","last_active":"2023-07-14T12:58:07.965590+0000","last_peered":"2023-07-14T12:58:07.965590+0000","last_clean":"2023-07-14T12:58:07.965590+0000","last_became_active":"2023-07-14T12:57:40.162852+0000","last_became_peered":"2023-07-14T12:57:40.162852+0000","last_unstale":"2023-07-14T12:58:07.965590+0000","last_undegraded":"2023-07-14T12:58:07.965590+0000","last_fullsized":"2023-07-14T12:58:07.965590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:38.396243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963013+0000","last_change":"2023-07-14T12:57:39.143961+0000","last_active":"2023-07-14T12:58:07.963013+0000","last_peered":"2023-07-14T12:58:07.963013+0000","last_clean":"2023-07-14T12:58:07.963013+0000","last_became_active":"2023-07-14T12:57:39.143599+0000","last_became_peered":"2023-07-14T12:57:39.143599+0000","last_unstale":"2023-07-14T12:58:07.963013+0000","last_undegraded":"2023-07-14T12:58:07.963013+0000","last_fullsized":"2023-07-14T12:58:07.963013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:25.216766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957979+0000","last_change":"2023-07-14T12:57:40.157972+0000","last_active":"2023-07-14T12:58:07.957979+0000","last_peered":"2023-07-14T12:58:07.957979+0000","last_clean":"2023-07-14T12:58:07.957979+0000","last_became_active":"2023-07-14T12:57:40.157645+0000","last_became_peered":"2023-07-14T12:57:40.157645+0000","last_unstale":"2023-07-14T12:58:07.957979+0000","last_undegraded":"2023-07-14T12:58:07.957979+0000","last_fullsized":"2023-07-14T12:58:07.957979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:54:33.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965731+0000","last_change":"2023-07-14T12:57:39.153405+0000","last_active":"2023-07-14T12:58:07.965731+0000","last_peered":"2023-07-14T12:58:07.965731+0000","last_clean":"2023-07-14T12:58:07.965731+0000","last_became_active":"2023-07-14T12:57:39.153029+0000","last_became_peered":"2023-07-14T12:57:39.153029+0000","last_unstale":"2023-07-14T12:58:07.965731+0000","last_undegraded":"2023-07-14T12:58:07.965731+0000","last_fullsized":"2023-07-14T12:58:07.965731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:47:58.753892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958530+0000","last_change":"2023-07-14T12:57:40.163910+0000","last_active":"2023-07-14T12:58:07.958530+0000","last_peered":"2023-07-14T12:58:07.958530+0000","last_clean":"2023-07-14T12:58:07.958530+0000","last_became_active":"2023-07-14T12:57:40.163539+0000","last_became_peered":"2023-07-14T12:57:40.163539+0000","last_unstale":"2023-07-14T12:58:07.958530+0000","last_undegraded":"2023-07-14T12:58:07.958530+0000","last_fullsized":"2023-07-14T12:58:07.958530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:12.543412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113454+0000","last_change":"2023-07-14T12:57:39.132649+0000","last_active":"2023-07-14T12:58:08.113454+0000","last_peered":"2023-07-14T12:58:08.113454+0000","last_clean":"2023-07-14T12:58:08.113454+0000","last_became_active":"2023-07-14T12:57:39.132295+0000","last_became_peered":"2023-07-14T12:57:39.132295+0000","last_unstale":"2023-07-14T12:58:08.113454+0000","last_undegraded":"2023-07-14T12:58:08.113454+0000","last_fullsized":"2023-07-14T12:58:08.113454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:19.495427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958143+0000","last_change":"2023-07-14T12:57:40.166285+0000","last_active":"2023-07-14T12:58:07.958143+0000","last_peered":"2023-07-14T12:58:07.958143+0000","last_clean":"2023-07-14T12:58:07.958143+0000","last_became_active":"2023-07-14T12:57:40.165968+0000","last_became_peered":"2023-07-14T12:57:40.165968+0000","last_unstale":"2023-07-14T12:58:07.958143+0000","last_undegraded":"2023-07-14T12:58:07.958143+0000","last_fullsized":"2023-07-14T12:58:07.958143+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:22.071229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961885+0000","last_change":"2023-07-14T12:57:39.150988+0000","last_active":"2023-07-14T12:58:07.961885+0000","last_peered":"2023-07-14T12:58:07.961885+0000","last_clean":"2023-07-14T12:58:07.961885+0000","last_became_active":"2023-07-14T12:57:39.150552+0000","last_became_peered":"2023-07-14T12:57:39.150552+0000","last_unstale":"2023-07-14T12:58:07.961885+0000","last_undegraded":"2023-07-14T12:58:07.961885+0000","last_fullsized":"2023-07-14T12:58:07.961885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:04:27.733757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958595+0000","last_change":"2023-07-14T12:57:40.169729+0000","last_active":"2023-07-14T12:58:07.958595+0000","last_peered":"2023-07-14T12:58:07.958595+0000","last_clean":"2023-07-14T12:58:07.958595+0000","last_became_active":"2023-07-14T12:57:40.169432+0000","last_became_peered":"2023-07-14T12:57:40.169432+0000","last_unstale":"2023-07-14T12:58:07.958595+0000","last_undegraded":"2023-07-14T12:58:07.958595+0000","last_fullsized":"2023-07-14T12:58:07.958595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:27:50.731427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961691+0000","last_change":"2023-07-14T12:57:40.167668+0000","last_active":"2023-07-14T12:58:07.961691+0000","last_peered":"2023-07-14T12:58:07.961691+0000","last_clean":"2023-07-14T12:58:07.961691+0000","last_became_active":"2023-07-14T12:57:40.167328+0000","last_became_peered":"2023-07-14T12:57:40.167328+0000","last_unstale":"2023-07-14T12:58:07.961691+0000","last_undegraded":"2023-07-14T12:58:07.961691+0000","last_fullsized":"2023-07-14T12:58:07.961691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:24.623266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965220+0000","last_change":"2023-07-14T12:57:40.161340+0000","last_active":"2023-07-14T12:58:07.965220+0000","last_peered":"2023-07-14T12:58:07.965220+0000","last_clean":"2023-07-14T12:58:07.965220+0000","last_became_active":"2023-07-14T12:57:40.161024+0000","last_became_peered":"2023-07-14T12:57:40.161024+0000","last_unstale":"2023-07-14T12:58:07.965220+0000","last_undegraded":"2023-07-14T12:58:07.965220+0000","last_fullsized":"2023-07-14T12:58:07.965220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:56.043017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965390+0000","last_change":"2023-07-14T12:57:40.159287+0000","last_active":"2023-07-14T12:58:07.965390+0000","last_peered":"2023-07-14T12:58:07.965390+0000","last_clean":"2023-07-14T12:58:07.965390+0000","last_became_active":"2023-07-14T12:57:40.158889+0000","last_became_peered":"2023-07-14T12:57:40.158889+0000","last_unstale":"2023-07-14T12:58:07.965390+0000","last_undegraded":"2023-07-14T12:58:07.965390+0000","last_fullsized":"2023-07-14T12:58:07.965390+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:27.078113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966189+0000","last_change":"2023-07-14T12:57:40.168898+0000","last_active":"2023-07-14T12:58:07.966189+0000","last_peered":"2023-07-14T12:58:07.966189+0000","last_clean":"2023-07-14T12:58:07.966189+0000","last_became_active":"2023-07-14T12:57:40.168596+0000","last_became_peered":"2023-07-14T12:57:40.168596+0000","last_unstale":"2023-07-14T12:58:07.966189+0000","last_undegraded":"2023-07-14T12:58:07.966189+0000","last_fullsized":"2023-07-14T12:58:07.966189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:18.836992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961751+0000","last_change":"2023-07-14T12:57:40.156267+0000","last_active":"2023-07-14T12:58:07.961751+0000","last_peered":"2023-07-14T12:58:07.961751+0000","last_clean":"2023-07-14T12:58:07.961751+0000","last_became_active":"2023-07-14T12:57:40.155909+0000","last_became_peered":"2023-07-14T12:57:40.155909+0000","last_unstale":"2023-07-14T12:58:07.961751+0000","last_undegraded":"2023-07-14T12:58:07.961751+0000","last_fullsized":"2023-07-14T12:58:07.961751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:07.081173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.962239+0000","last_change":"2023-07-14T12:57:40.162956+0000","last_active":"2023-07-14T12:58:07.962239+0000","last_peered":"2023-07-14T12:58:07.962239+0000","last_clean":"2023-07-14T12:58:07.962239+0000","last_became_active":"2023-07-14T12:57:40.162373+0000","last_became_peered":"2023-07-14T12:57:40.162373+0000","last_unstale":"2023-07-14T12:58:07.962239+0000","last_undegraded":"2023-07-14T12:58:07.962239+0000","last_fullsized":"2023-07-14T12:58:07.962239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:15.307049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966187+0000","last_change":"2023-07-14T12:57:40.158655+0000","last_active":"2023-07-14T12:58:07.966187+0000","last_peered":"2023-07-14T12:58:07.966187+0000","last_clean":"2023-07-14T12:58:07.966187+0000","last_became_active":"2023-07-14T12:57:40.158290+0000","last_became_peered":"2023-07-14T12:57:40.158290+0000","last_unstale":"2023-07-14T12:58:07.966187+0000","last_undegraded":"2023-07-14T12:58:07.966187+0000","last_fullsized":"2023-07-14T12:58:07.966187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:02:22.373566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965124+0000","last_change":"2023-07-14T12:57:40.164132+0000","last_active":"2023-07-14T12:58:07.965124+0000","last_peered":"2023-07-14T12:58:07.965124+0000","last_clean":"2023-07-14T12:58:07.965124+0000","last_became_active":"2023-07-14T12:57:40.163774+0000","last_became_peered":"2023-07-14T12:57:40.163774+0000","last_unstale":"2023-07-14T12:58:07.965124+0000","last_undegraded":"2023-07-14T12:58:07.965124+0000","last_fullsized":"2023-07-14T12:58:07.965124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:30.562785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113592+0000","last_change":"2023-07-14T12:57:40.171046+0000","last_active":"2023-07-14T12:58:08.113592+0000","last_peered":"2023-07-14T12:58:08.113592+0000","last_clean":"2023-07-14T12:58:08.113592+0000","last_became_active":"2023-07-14T12:57:40.170727+0000","last_became_peered":"2023-07-14T12:57:40.170727+0000","last_unstale":"2023-07-14T12:58:08.113592+0000","last_undegraded":"2023-07-14T12:58:08.113592+0000","last_fullsized":"2023-07-14T12:58:08.113592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:44.795580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.964940+0000","last_change":"2023-07-14T12:57:40.171636+0000","last_active":"2023-07-14T12:58:07.964940+0000","last_peered":"2023-07-14T12:58:07.964940+0000","last_clean":"2023-07-14T12:58:07.964940+0000","last_became_active":"2023-07-14T12:57:40.171365+0000","last_became_peered":"2023-07-14T12:57:40.171365+0000","last_unstale":"2023-07-14T12:58:07.964940+0000","last_undegraded":"2023-07-14T12:58:07.964940+0000","last_fullsized":"2023-07-14T12:58:07.964940+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:10.582323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113365+0000","last_change":"2023-07-14T12:57:40.162963+0000","last_active":"2023-07-14T12:58:08.113365+0000","last_peered":"2023-07-14T12:58:08.113365+0000","last_clean":"2023-07-14T12:58:08.113365+0000","last_became_active":"2023-07-14T12:57:40.162614+0000","last_became_peered":"2023-07-14T12:57:40.162614+0000","last_unstale":"2023-07-14T12:58:08.113365+0000","last_undegraded":"2023-07-14T12:58:08.113365+0000","last_fullsized":"2023-07-14T12:58:08.113365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:46.953808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961969+0000","last_change":"2023-07-14T12:57:40.156138+0000","last_active":"2023-07-14T12:58:07.961969+0000","last_peered":"2023-07-14T12:58:07.961969+0000","last_clean":"2023-07-14T12:58:07.961969+0000","last_became_active":"2023-07-14T12:57:40.155785+0000","last_became_peered":"2023-07-14T12:57:40.155785+0000","last_unstale":"2023-07-14T12:58:07.961969+0000","last_undegraded":"2023-07-14T12:58:07.961969+0000","last_fullsized":"2023-07-14T12:58:07.961969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:45.189290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961857+0000","last_change":"2023-07-14T12:57:40.163978+0000","last_active":"2023-07-14T12:58:07.961857+0000","last_peered":"2023-07-14T12:58:07.961857+0000","last_clean":"2023-07-14T12:58:07.961857+0000","last_became_active":"2023-07-14T12:57:40.163620+0000","last_became_peered":"2023-07-14T12:57:40.163620+0000","last_unstale":"2023-07-14T12:58:07.961857+0000","last_undegraded":"2023-07-14T12:58:07.961857+0000","last_fullsized":"2023-07-14T12:58:07.961857+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:48.986548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":215126,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62626,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":319,"num_read_kb":227,"num_write":148,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":146,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":187878,"data_compressed":4806,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350999,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":459210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.70799999999999996}]},{"osd":1,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.81499999999999995}]},{"osd":2,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.501},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.621}]},{"osd":5,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.74199999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":9,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.073}]},{"osd":10,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.093},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.92100000000000004}]}]},{"osd":10,"up_from":73,"seq":313532612637,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1097728,"data_stored":1109727,"data_compressed":37730,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82699999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.434},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.034,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.92000000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.745}]},{"osd":3,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85999999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89800000000000002,"5min":1.391,"15min":1.391},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.65700000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95599999999999996,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.996,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.90000000000000002,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.83999999999999997,"15min":0.86299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93899999999999995,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.86599999999999999,"15min":0.874},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.98099999999999998,"5min":1.298,"15min":1.298},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92200000000000004,"15min":0.93600000000000005},"min":{"1min":0.61199999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.018,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.72299999999999998}]},{"osd":9,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.94599999999999995,"15min":0.96999999999999997},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":0.998,"5min":1.746,"15min":1.746},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.052,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.80600000000000005}]},{"osd":11,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.84599999999999997}]}]},{"osd":9,"up_from":68,"seq":292057776162,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.54800000000000004,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72399999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77700000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.40899999999999997}]},{"osd":1,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0600000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.78800000000000003,"15min":0.81000000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96599999999999997,"5min":1.383,"15min":1.383},"last":0.77100000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94799999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.622},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0109999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.65500000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":1.169,"15min":1.169},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.877,"15min":0.89700000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0620000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.874,"15min":0.89800000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97899999999999998,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.876,"15min":0.90000000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.022,"5min":1.355,"15min":1.355},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.86199999999999999,"15min":0.88100000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.998,"5min":1.256,"15min":1.256},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.874,"15min":0.89400000000000002},"min":{"1min":0.49299999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0509999999999999,"5min":1.367,"15min":1.367},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.92700000000000005,"15min":0.95299999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0409999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.96499999999999997,"15min":0.98799999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1439999999999999,"5min":1.575,"15min":1.575},"last":0.752},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.0029999999999999,"15min":1.022},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1539999999999999,"5min":1.871,"15min":1.871},"last":0.70299999999999996}]},{"osd":8,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.0820000000000001,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.84299999999999997,"5min":1.0029999999999999,"15min":1.03},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1279999999999999,"5min":1.661,"15min":1.661},"last":0.72599999999999998}]},{"osd":10,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.97499999999999998,"15min":0.97899999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":3.1389999999999998,"5min":3.1389999999999998,"15min":3.1389999999999998},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.93000000000000005,"15min":0.93700000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.82499999999999996}]}]},{"osd":8,"up_from":60,"seq":257698037801,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6559999999999999,"5min":1.855,"15min":1.855},"last":1.6559999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6220000000000001,"5min":1.847,"15min":1.847},"last":1.6220000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.52800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.746,"15min":0.73499999999999999},"min":{"1min":0.625,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.024,"5min":1.802,"15min":1.802},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.628,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.439},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1200000000000001,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.90300000000000002,"15min":0.97799999999999998},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5249999999999999,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":1.5249999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82899999999999996,"15min":0.85999999999999999},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.48,"5min":1.825,"15min":1.825},"last":1.48}]},{"osd":4,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.137,"5min":1.3,"15min":1.3},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.80100000000000005,"15min":0.81000000000000005},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94599999999999995,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75800000000000001,"15min":0.78400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0720000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.93700000000000006},"min":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.575,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.575},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.92600000000000005,"15min":0.95099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1899999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.014,"5min":1.73,"15min":1.73},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.92400000000000004,"15min":0.93500000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2490000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.83999999999999997}]},{"osd":9,"last update":"Fri Jul 14 12:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.93400000000000005,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0549999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.88700000000000001,"15min":0.89100000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0429999999999999,"5min":1.133,"15min":1.133},"last":0.71999999999999997}]},{"osd":10,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.90100000000000002,"15min":0.88100000000000001},"min":{"1min":0.64800000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2709999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.877,"15min":0.86599999999999999},"min":{"1min":0.68799999999999994,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1519999999999999,"5min":1.161,"15min":1.161},"last":0.629}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":7,"up_from":52,"seq":223338299439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":1011712,"data_stored":1050450,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69999999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.66800000000000004}]},{"osd":2,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":1.016},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.745,"15min":0.73799999999999999},"min":{"1min":0.55400000000000005,"5min":0.432,"15min":0.432},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.54400000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69899999999999995,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.018,"5min":1.169,"15min":1.169},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90500000000000003,"5min":1.012,"15min":1.012},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82999999999999996,"15min":0.84799999999999998},"min":{"1min":0.59599999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.036,"5min":1.073,"15min":1.073},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.81200000000000006,"15min":0.83999999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1279999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.877,"15min":0.877},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.92800000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.82799999999999996,"15min":0.80400000000000005},"min":{"1min":0.69399999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83599999999999997,"15min":0.82599999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.0409999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85099999999999998,"15min":0.84699999999999998},"min":{"1min":0.73999999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0669999999999999,"5min":1.105,"15min":1.105},"last":0.879},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.1499999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.83999999999999997}]},{"osd":10,"last update":"Fri Jul 14 12:58:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.90900000000000003,"15min":0.92400000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.135},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.92800000000000005,"15min":0.93300000000000005},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.204,"5min":1.276,"15min":1.276},"last":0.90500000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":6,"up_from":47,"seq":201863462963,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":458807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.51800000000000002,"15min":0.50700000000000001},"min":{"1min":0.35299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.373,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.48899999999999999}]},{"osd":1,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0960000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77000000000000002,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":4.0759999999999996,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.66300000000000003}]},{"osd":2,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94799999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.997,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.69399999999999995},"min":{"1min":0.48399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.60399999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.53100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.625},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.63700000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.81699999999999995,"15min":0.81499999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Jul 14 12:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.85599999999999998,"15min":0.83399999999999996},"min":{"1min":0.63700000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.625,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.82199999999999995}]},{"osd":8,"last update":"Fri Jul 14 12:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.89600000000000002,"15min":0.91700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93200000000000005,"15min":0.94999999999999996},"min":{"1min":0.72399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.88900000000000001}]},{"osd":9,"last update":"Fri Jul 14 12:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.91400000000000003,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.97099999999999997,"15min":0.98599999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.80600000000000005}]},{"osd":10,"last update":"Fri Jul 14 12:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.089,"15min":1.1100000000000001},"min":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7430000000000001,"5min":4.109,"15min":4.109},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.016,"5min":0.95699999999999996,"15min":0.94699999999999995},"min":{"1min":0.73899999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.84899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":1007616,"data_stored":517433,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.38800000000000001,"15min":0.37},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64800000000000002,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.40799999999999997,"15min":0.40500000000000003},"max":{"1min":1.1950000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.024}]},{"osd":2,"last update":"Fri Jul 14 12:57:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.70799999999999996,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0069999999999999,"5min":1.131,"15min":1.131},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67400000000000004,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97399999999999998,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.745}]},{"osd":3,"last update":"Fri Jul 14 12:58:20 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.67700000000000005,"15min":0.65800000000000003},"min":{"1min":0.57499999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99399999999999999,"5min":0.997,"15min":0.997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.70999999999999996},"min":{"1min":0.59199999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99199999999999999,"5min":1.145,"15min":1.145},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Jul 14 12:57:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.56899999999999995,"15min":0.53300000000000003},"min":{"1min":0.41799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":1.079,"15min":1.079},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84699999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:58:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.70899999999999996,"15min":0.67300000000000004},"min":{"1min":0.49099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0349999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.83299999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72499999999999998,"15min":0.70299999999999996},"min":{"1min":0.64000000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.036,"15min":1.036},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.874,"5min":0.81100000000000005,"15min":0.78600000000000003},"min":{"1min":0.66000000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.92700000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.52200000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1519999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.68600000000000005,"15min":0.63600000000000001},"min":{"1min":0.40000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.73199999999999998}]},{"osd":8,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.83899999999999997,"15min":0.80300000000000005},"min":{"1min":0.71999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.006,"5min":0.91100000000000003,"15min":0.875},"min":{"1min":0.61699999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.1559999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.96199999999999997}]},{"osd":9,"last update":"Fri Jul 14 12:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.85599999999999998,"15min":0.86599999999999999},"min":{"1min":0.63,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95599999999999996,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.998,"15min":1.006},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.80800000000000005}]},{"osd":10,"last update":"Fri Jul 14 12:58:24 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.046,"15min":1.048},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.23,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.63800000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.91300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":974848,"data_stored":460072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.66400000000000003,"15min":0.61099999999999999},"min":{"1min":0.40699999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.0069999999999997,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":0.752},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.69699999999999995,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":6.8099999999999996,"5min":6.8099999999999996,"15min":6.8099999999999996},"last":0.90800000000000003}]},{"osd":2,"last update":"Fri Jul 14 12:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66200000000000003,"15min":0.625},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65800000000000003,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88200000000000001,"5min":1.133,"15min":1.133},"last":0.80000000000000004}]},{"osd":3,"last update":"Fri Jul 14 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70799999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":1.4430000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.57999999999999996,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":1.4790000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0720000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69599999999999995,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.873,"5min":1.121,"15min":1.121},"last":1.081}]},{"osd":5,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.749,"15min":0.71199999999999997},"min":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2830000000000004,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":1.363},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.78300000000000003,"15min":0.755},"min":{"1min":0.50800000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1769999999999996,"5min":4.1769999999999996,"15min":4.1769999999999996},"last":0.97199999999999998}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.66100000000000003,"15min":0.68500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.077},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94699999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":1.514}]},{"osd":7,"last update":"Fri Jul 14 12:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1200000000000001,"5min":1.155,"15min":1.155},"last":0.751},{"interface":"front","average":{"1min":0.873,"5min":0.79700000000000004,"15min":0.78400000000000003},"min":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.61799999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.60999999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.3239999999999998,"5min":4.3239999999999998,"15min":4.3239999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.89100000000000001,"15min":0.88900000000000001},"min":{"1min":0.65000000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":0.86199999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.871,"15min":0.90700000000000003},"min":{"1min":0.438,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98899999999999999,"5min":1.175,"15min":1.175},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.879,"15min":0.91100000000000003},"min":{"1min":0.45300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.5589999999999999}]},{"osd":10,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.93300000000000005,"15min":0.92100000000000004},"min":{"1min":0.502,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":4.0579999999999998,"5min":4.0579999999999998,"15min":4.0579999999999998},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.125,"5min":0.95899999999999996,"15min":0.93100000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":6.992,"5min":6.992,"15min":6.992},"last":1.04}]},{"osd":11,"last update":"Fri Jul 14 12:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.119}]}]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":1019904,"data_stored":518589,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.45600000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91600000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:57:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.51700000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0549999999999999,"5min":1.819,"15min":1.819},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64600000000000002,"15min":0.64400000000000002},"min":{"1min":0.54800000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":1.841,"15min":1.841},"last":0.73699999999999999}]},{"osd":3,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":0.78500000000000003,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":6.4779999999999998,"5min":6.4779999999999998,"15min":6.4779999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Jul 14 12:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66000000000000003,"15min":0.66300000000000003},"min":{"1min":0.55100000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":1.0329999999999999}]},{"osd":5,"last update":"Fri Jul 14 12:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.49199999999999999},"min":{"1min":0.46600000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.56999999999999995,"15min":0.52500000000000002},"min":{"1min":0.44600000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.96699999999999997}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73699999999999999,"15min":0.72799999999999998},"min":{"1min":0.57999999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":1.077},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.86699999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.69299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77800000000000002}]},{"osd":8,"last update":"Fri Jul 14 12:58:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.58499999999999996,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1,"5min":1.222,"15min":1.222},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.751,"15min":0.72699999999999998},"min":{"1min":0.58899999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.095,"5min":1.133,"15min":1.133},"last":1.1879999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.82099999999999995,"15min":0.80700000000000005},"min":{"1min":0.66200000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.82399999999999995,"15min":0.81399999999999995},"min":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2390000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.996}]},{"osd":10,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85899999999999999,"15min":0.85199999999999998},"min":{"1min":0.67400000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.099,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.89200000000000002,"15min":0.876},"min":{"1min":0.73199999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.234}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149763,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":458793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.46300000000000002,"15min":0.42699999999999999},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.499,"15min":0.45500000000000002},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71699999999999997,"15min":0.66900000000000004},"min":{"1min":0.432,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.087,"5min":6.867,"15min":6.867},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.79700000000000004,"15min":0.69299999999999995},"min":{"1min":0.57499999999999996,"5min":0.436,"15min":0.436},"max":{"1min":4.21,"5min":6.8860000000000001,"15min":6.8860000000000001},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.71699999999999997,"15min":0.67900000000000005},"min":{"1min":0.51900000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.69099999999999995},"min":{"1min":0.48799999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.135,"5min":6.9020000000000001,"15min":6.9020000000000001},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Jul 14 12:57:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.77900000000000003,"15min":0.71899999999999997},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":6.8419999999999996,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.70899999999999996},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.109,"5min":1.119,"15min":1.119},"last":0.753}]},{"osd":5,"last update":"Fri Jul 14 12:58:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.55600000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0169999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.48799999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69699999999999995,"15min":0.66100000000000003},"min":{"1min":0.56299999999999994,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0900000000000001,"5min":1.214,"15min":1.214},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68899999999999995,"15min":0.66200000000000003},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.103,"15min":1.103},"last":0.501}]},{"osd":7,"last update":"Fri Jul 14 12:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77500000000000002,"15min":0.76400000000000001},"min":{"1min":0.59899999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.95799999999999996,"5min":1.131,"15min":1.131},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.80400000000000005,"15min":0.77500000000000002},"min":{"1min":0.66800000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.86699999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2010000000000001,"5min":1.206,"15min":1.206},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1859999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.80500000000000005}]},{"osd":9,"last update":"Fri Jul 14 12:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.92000000000000004,"15min":0.93400000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.442},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":0.82999999999999996},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0289999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.53800000000000003}]},{"osd":10,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90500000000000003,"15min":0.90300000000000002},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.94899999999999995,"15min":0.94699999999999995},"min":{"1min":0.68500000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.72299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":4,"up_from":34,"seq":146028888126,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77600000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.45700000000000002},"min":{"1min":0.35499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79000000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.501}]},{"osd":2,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70899999999999996,"15min":0.67700000000000005},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.47899999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95499999999999996,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.80000000000000004}]},{"osd":3,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67900000000000005,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97399999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65800000000000003,"15min":0.64600000000000002},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92500000000000004,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:58:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.52000000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.751},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71899999999999997,"15min":0.69699999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.89900000000000002}]},{"osd":6,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77600000000000002,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93200000000000005,"5min":1.093,"15min":1.093},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.042,"5min":1.282,"15min":1.282},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Jul 14 12:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90000000000000002,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.47399999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97999999999999998,"5min":1.129,"15min":1.129},"last":0.94199999999999995}]},{"osd":8,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.875,"15min":0.86499999999999999},"min":{"1min":0.65900000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.143,"5min":1.234,"15min":1.234},"last":1.024}]},{"osd":9,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.871,"15min":0.876},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.105,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.68700000000000006}]},{"osd":10,"last update":"Fri Jul 14 12:58:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92600000000000005,"15min":0.92200000000000004},"min":{"1min":0.67700000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1919999999999999,"5min":1.337,"15min":1.337},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.81999999999999995,"15min":0.80900000000000005},"min":{"1min":0.56399999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.64600000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724601,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":1028096,"data_stored":1050513,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79700000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88200000000000001,"5min":0.997,"15min":0.997},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66900000000000004,"15min":0.621},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65700000000000003,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.505,"15min":0.47599999999999998},"min":{"1min":0.34899999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83899999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.752}]},{"osd":3,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.441,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77300000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.52800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.248,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.89100000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.72499999999999998,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71999999999999997,"15min":0.69799999999999995},"min":{"1min":0.44700000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.075,"5min":1.139,"15min":1.139},"last":0.997}]},{"osd":6,"last update":"Fri Jul 14 12:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76000000000000001,"15min":0.75700000000000001},"min":{"1min":0.56399999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98799999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.878},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.55400000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93300000000000005,"5min":1.28,"15min":1.28},"last":1.018}]},{"osd":7,"last update":"Fri Jul 14 12:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.83099999999999996,"15min":0.84899999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.087,"5min":1.236,"15min":1.236},"last":1.075}]},{"osd":8,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":1.036},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.056}]},{"osd":9,"last update":"Fri Jul 14 12:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.872,"15min":0.871},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85199999999999998,"15min":0.84599999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1.1220000000000001}]},{"osd":10,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.86799999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.091},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.874,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.157}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34486,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59112,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":60268,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60642,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:58:36.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph pg dump --format=json 2023-07-14T12:58:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:38.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:38 smithi017 ceph-mon[95536]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:58:38.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:38 smithi017 ceph-mon[95536]: pgmap v333: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:38.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:38 smithi135 ceph-mon[97338]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:58:38.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:38 smithi135 ceph-mon[97338]: pgmap v333: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:38.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:38 smithi131 ceph-mon[96953]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:58:38.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:38 smithi131 ceph-mon[96953]: pgmap v333: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.104+0000 7f0b35a05700 1 -- 172.21.15.17:0/3332761314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b300728b0 msgr2=0x7f0b30072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.104+0000 7f0b35a05700 1 --2- 172.21.15.17:0/3332761314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b300728b0 0x7f0b30072c80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009990 tx=0x7f0b20009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.104+0000 7f0b35a05700 1 -- 172.21.15.17:0/3332761314 shutdown_connections 2023-07-14T12:58:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.104+0000 7f0b35a05700 1 --2- 172.21.15.17:0/3332761314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b3010c3e0 0x7f0b3010e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.104+0000 7f0b35a05700 1 --2- 172.21.15.17:0/3332761314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b300728b0 0x7f0b30072c80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.104+0000 7f0b35a05700 1 --2- 172.21.15.17:0/3332761314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b300731c0 0x7f0b3010bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.104+0000 7f0b35a05700 1 -- 172.21.15.17:0/3332761314 >> 172.21.15.17:0/3332761314 conn(0x7f0b300fb660 msgr2=0x7f0b300fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.104+0000 7f0b35a05700 1 -- 172.21.15.17:0/3332761314 shutdown_connections 2023-07-14T12:58:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.104+0000 7f0b35a05700 1 -- 172.21.15.17:0/3332761314 wait complete. 2023-07-14T12:58:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.105+0000 7f0b35a05700 1 Processor -- start 2023-07-14T12:58:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b35a05700 1 -- start start 2023-07-14T12:58:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b35a05700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b300728b0 0x7f0b30197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b35a05700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b300731c0 0x7f0b30198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b35a05700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b3010c3e0 0x7f0b3019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b35a05700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3019bc50 con 0x7f0b300728b0 2023-07-14T12:58:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b35a05700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3019bdc0 con 0x7f0b3010c3e0 2023-07-14T12:58:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b35a05700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3019bf80 con 0x7f0b300731c0 2023-07-14T12:58:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b2effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b300728b0 0x7f0b30197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b2effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b300728b0 0x7f0b30197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49414/0 (socket says 172.21.15.17:49414) 2023-07-14T12:58:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b2effd700 1 -- 172.21.15.17:0/804076189 learned_addr learned my addr 172.21.15.17:0/804076189 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b2f7fe700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b3010c3e0 0x7f0b3019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:39.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.106+0000 7f0b2e7fc700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b300731c0 0x7f0b30198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:39.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.107+0000 7f0b2effd700 1 -- 172.21.15.17:0/804076189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b300731c0 msgr2=0x7f0b30198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:39.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.107+0000 7f0b2effd700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b300731c0 0x7f0b30198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:39.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.107+0000 7f0b2effd700 1 -- 172.21.15.17:0/804076189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b3010c3e0 msgr2=0x7f0b3019b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:39.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.107+0000 7f0b2effd700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b3010c3e0 0x7f0b3019b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:39.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.107+0000 7f0b2effd700 1 -- 172.21.15.17:0/804076189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b200095f0 con 0x7f0b300728b0 2023-07-14T12:58:39.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.107+0000 7f0b2effd700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b300728b0 0x7f0b30197cc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0b200098e0 tx=0x7f0b20005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.107+0000 7f0b34a03700 1 -- 172.21.15.17:0/804076189 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2001d070 con 0x7f0b300728b0 2023-07-14T12:58:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.107+0000 7f0b34a03700 1 -- 172.21.15.17:0/804076189 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b20005030 con 0x7f0b300728b0 2023-07-14T12:58:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.107+0000 7f0b35a05700 1 -- 172.21.15.17:0/804076189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3019c200 con 0x7f0b300728b0 2023-07-14T12:58:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.107+0000 7f0b34a03700 1 -- 172.21.15.17:0/804076189 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20004ab0 con 0x7f0b300728b0 2023-07-14T12:58:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.107+0000 7f0b35a05700 1 -- 172.21.15.17:0/804076189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b301a4b20 con 0x7f0b300728b0 2023-07-14T12:58:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.109+0000 7f0b35a05700 1 -- 172.21.15.17:0/804076189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3004e210 con 0x7f0b300728b0 2023-07-14T12:58:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.110+0000 7f0b34a03700 1 -- 172.21.15.17:0/804076189 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f0b20004c10 con 0x7f0b300728b0 2023-07-14T12:58:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.112+0000 7f0b34a03700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0b180a1260 0x7f0b180a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.112+0000 7f0b34a03700 1 -- 172.21.15.17:0/804076189 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f0b200cda40 con 0x7f0b300728b0 2023-07-14T12:58:39.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.112+0000 7f0b2e7fc700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0b180a1260 0x7f0b180a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:39.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.113+0000 7f0b2e7fc700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0b180a1260 0x7f0b180a3710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0b301992a0 tx=0x7f0b240073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:39.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.116+0000 7f0b34a03700 1 -- 172.21.15.17:0/804076189 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0b20097090 con 0x7f0b300728b0 2023-07-14T12:58:39.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.317+0000 7f0b35a05700 1 -- 172.21.15.17:0/804076189 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b300fd2d0 con 0x7f0b180a1260 2023-07-14T12:58:39.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.327+0000 7f0b34a03700 1 -- 172.21.15.17:0/804076189 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339364 (secure 0 0 0) 0x7f0b300fd2d0 con 0x7f0b180a1260 2023-07-14T12:58:39.362 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:58:39.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 -- 172.21.15.17:0/804076189 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0b180a1260 msgr2=0x7f0b180a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:39.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0b180a1260 0x7f0b180a3710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0b301992a0 tx=0x7f0b240073d0 comp rx=0 tx=0).stop 2023-07-14T12:58:39.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 -- 172.21.15.17:0/804076189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b300728b0 msgr2=0x7f0b30197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:39.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b300728b0 0x7f0b30197cc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0b200098e0 tx=0x7f0b20005f10 comp rx=0 tx=0).stop 2023-07-14T12:58:39.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 -- 172.21.15.17:0/804076189 shutdown_connections 2023-07-14T12:58:39.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0b180a1260 0x7f0b180a3710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:39.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b3010c3e0 0x7f0b3019b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:39.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b300728b0 0x7f0b30197cc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:39.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 --2- 172.21.15.17:0/804076189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b300731c0 0x7f0b30198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:39.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 -- 172.21.15.17:0/804076189 >> 172.21.15.17:0/804076189 conn(0x7f0b300fb660 msgr2=0x7f0b3010e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:39.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 -- 172.21.15.17:0/804076189 shutdown_connections 2023-07-14T12:58:39.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:39.333+0000 7f0b35a05700 1 -- 172.21.15.17:0/804076189 wait complete. 2023-07-14T12:58:39.366 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-07-14T12:58:39.909 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2023-07-14T12:58:38.850035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653240,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":465,"num_read_kb":351,"num_write":331,"num_write_kb":3042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1180882,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335060,"kb_used_data":11636,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124606764,"statfs":{"total":1151940427776,"available":1151597326336,"internally_reserved":0,"allocated":11915264,"data_stored":7461640,"data_compressed":113190,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004375"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.962174+0000","last_change":"2023-07-14T12:57:40.168203+0000","last_active":"2023-07-14T12:58:07.962174+0000","last_peered":"2023-07-14T12:58:07.962174+0000","last_clean":"2023-07-14T12:58:07.962174+0000","last_became_active":"2023-07-14T12:57:40.164682+0000","last_became_peered":"2023-07-14T12:57:40.164682+0000","last_unstale":"2023-07-14T12:58:07.962174+0000","last_undegraded":"2023-07-14T12:58:07.962174+0000","last_fullsized":"2023-07-14T12:58:07.962174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:39.005726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966330+0000","last_change":"2023-07-14T12:57:40.168194+0000","last_active":"2023-07-14T12:58:07.966330+0000","last_peered":"2023-07-14T12:58:07.966330+0000","last_clean":"2023-07-14T12:58:07.966330+0000","last_became_active":"2023-07-14T12:57:40.167825+0000","last_became_peered":"2023-07-14T12:57:40.167825+0000","last_unstale":"2023-07-14T12:58:07.966330+0000","last_undegraded":"2023-07-14T12:58:07.966330+0000","last_fullsized":"2023-07-14T12:58:07.966330+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:23:35.037851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965584+0000","last_change":"2023-07-14T12:57:40.162824+0000","last_active":"2023-07-14T12:58:07.965584+0000","last_peered":"2023-07-14T12:58:07.965584+0000","last_clean":"2023-07-14T12:58:07.965584+0000","last_became_active":"2023-07-14T12:57:40.162526+0000","last_became_peered":"2023-07-14T12:57:40.162526+0000","last_unstale":"2023-07-14T12:58:07.965584+0000","last_undegraded":"2023-07-14T12:58:07.965584+0000","last_fullsized":"2023-07-14T12:58:07.965584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:01:27.137266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113989+0000","last_change":"2023-07-14T12:57:40.160772+0000","last_active":"2023-07-14T12:58:08.113989+0000","last_peered":"2023-07-14T12:58:08.113989+0000","last_clean":"2023-07-14T12:58:08.113989+0000","last_became_active":"2023-07-14T12:57:40.160315+0000","last_became_peered":"2023-07-14T12:57:40.160315+0000","last_unstale":"2023-07-14T12:58:08.113989+0000","last_undegraded":"2023-07-14T12:58:08.113989+0000","last_fullsized":"2023-07-14T12:58:08.113989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:48.047786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963574+0000","last_change":"2023-07-14T12:57:40.160868+0000","last_active":"2023-07-14T12:58:07.963574+0000","last_peered":"2023-07-14T12:58:07.963574+0000","last_clean":"2023-07-14T12:58:07.963574+0000","last_became_active":"2023-07-14T12:57:40.160558+0000","last_became_peered":"2023-07-14T12:57:40.160558+0000","last_unstale":"2023-07-14T12:58:07.963574+0000","last_undegraded":"2023-07-14T12:58:07.963574+0000","last_fullsized":"2023-07-14T12:58:07.963574+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:21:57.315978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959509+0000","last_change":"2023-07-14T12:57:40.166305+0000","last_active":"2023-07-14T12:58:07.959509+0000","last_peered":"2023-07-14T12:58:07.959509+0000","last_clean":"2023-07-14T12:58:07.959509+0000","last_became_active":"2023-07-14T12:57:40.166012+0000","last_became_peered":"2023-07-14T12:57:40.166012+0000","last_unstale":"2023-07-14T12:58:07.959509+0000","last_undegraded":"2023-07-14T12:58:07.959509+0000","last_fullsized":"2023-07-14T12:58:07.959509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:03:06.167704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957663+0000","last_change":"2023-07-14T12:57:40.163312+0000","last_active":"2023-07-14T12:58:07.957663+0000","last_peered":"2023-07-14T12:58:07.957663+0000","last_clean":"2023-07-14T12:58:07.957663+0000","last_became_active":"2023-07-14T12:57:40.163030+0000","last_became_peered":"2023-07-14T12:57:40.163030+0000","last_unstale":"2023-07-14T12:58:07.957663+0000","last_undegraded":"2023-07-14T12:58:07.957663+0000","last_fullsized":"2023-07-14T12:58:07.957663+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:41.303341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.115578+0000","last_change":"2023-07-14T12:58:08.115121+0000","last_active":"2023-07-14T12:58:08.115578+0000","last_peered":"2023-07-14T12:58:08.115578+0000","last_clean":"2023-07-14T12:58:08.115578+0000","last_became_active":"2023-07-14T12:58:08.114736+0000","last_became_peered":"2023-07-14T12:58:08.114736+0000","last_unstale":"2023-07-14T12:58:08.115578+0000","last_undegraded":"2023-07-14T12:58:08.115578+0000","last_fullsized":"2023-07-14T12:58:08.115578+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:30:27.815140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.114989+0000","last_change":"2023-07-14T12:57:40.170263+0000","last_active":"2023-07-14T12:58:08.114989+0000","last_peered":"2023-07-14T12:58:08.114989+0000","last_clean":"2023-07-14T12:58:08.114989+0000","last_became_active":"2023-07-14T12:57:40.169952+0000","last_became_peered":"2023-07-14T12:57:40.169952+0000","last_unstale":"2023-07-14T12:58:08.114989+0000","last_undegraded":"2023-07-14T12:58:08.114989+0000","last_fullsized":"2023-07-14T12:58:08.114989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:07:08.714595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.960490+0000","last_change":"2023-07-14T12:57:40.165359+0000","last_active":"2023-07-14T12:58:07.960490+0000","last_peered":"2023-07-14T12:58:07.960490+0000","last_clean":"2023-07-14T12:58:07.960490+0000","last_became_active":"2023-07-14T12:57:40.164918+0000","last_became_peered":"2023-07-14T12:57:40.164918+0000","last_unstale":"2023-07-14T12:58:07.960490+0000","last_undegraded":"2023-07-14T12:58:07.960490+0000","last_fullsized":"2023-07-14T12:58:07.960490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:57:54.633792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958355+0000","last_change":"2023-07-14T12:57:40.160524+0000","last_active":"2023-07-14T12:58:07.958355+0000","last_peered":"2023-07-14T12:58:07.958355+0000","last_clean":"2023-07-14T12:58:07.958355+0000","last_became_active":"2023-07-14T12:57:40.160215+0000","last_became_peered":"2023-07-14T12:57:40.160215+0000","last_unstale":"2023-07-14T12:58:07.958355+0000","last_undegraded":"2023-07-14T12:58:07.958355+0000","last_fullsized":"2023-07-14T12:58:07.958355+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:21.213962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965141+0000","last_change":"2023-07-14T12:58:07.964366+0000","last_active":"2023-07-14T12:58:07.965141+0000","last_peered":"2023-07-14T12:58:07.965141+0000","last_clean":"2023-07-14T12:58:07.965141+0000","last_became_active":"2023-07-14T12:58:07.963981+0000","last_became_peered":"2023-07-14T12:58:07.963981+0000","last_unstale":"2023-07-14T12:58:07.965141+0000","last_undegraded":"2023-07-14T12:58:07.965141+0000","last_fullsized":"2023-07-14T12:58:07.965141+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:28:52.971393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961839+0000","last_change":"2023-07-14T12:57:40.162166+0000","last_active":"2023-07-14T12:58:07.961839+0000","last_peered":"2023-07-14T12:58:07.961839+0000","last_clean":"2023-07-14T12:58:07.961839+0000","last_became_active":"2023-07-14T12:57:40.161750+0000","last_became_peered":"2023-07-14T12:57:40.161750+0000","last_unstale":"2023-07-14T12:58:07.961839+0000","last_undegraded":"2023-07-14T12:58:07.961839+0000","last_fullsized":"2023-07-14T12:58:07.961839+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:19:28.054997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965781+0000","last_change":"2023-07-14T12:57:40.160556+0000","last_active":"2023-07-14T12:58:07.965781+0000","last_peered":"2023-07-14T12:58:07.965781+0000","last_clean":"2023-07-14T12:58:07.965781+0000","last_became_active":"2023-07-14T12:57:40.159974+0000","last_became_peered":"2023-07-14T12:57:40.159974+0000","last_unstale":"2023-07-14T12:58:07.965781+0000","last_undegraded":"2023-07-14T12:58:07.965781+0000","last_fullsized":"2023-07-14T12:58:07.965781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:35:12.700407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965584+0000","last_change":"2023-07-14T12:57:40.169116+0000","last_active":"2023-07-14T12:58:07.965584+0000","last_peered":"2023-07-14T12:58:07.965584+0000","last_clean":"2023-07-14T12:58:07.965584+0000","last_became_active":"2023-07-14T12:57:40.168714+0000","last_became_peered":"2023-07-14T12:57:40.168714+0000","last_unstale":"2023-07-14T12:58:07.965584+0000","last_undegraded":"2023-07-14T12:58:07.965584+0000","last_fullsized":"2023-07-14T12:58:07.965584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:17:06.970124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.112939+0000","last_change":"2023-07-14T12:57:40.162621+0000","last_active":"2023-07-14T12:58:08.112939+0000","last_peered":"2023-07-14T12:58:08.112939+0000","last_clean":"2023-07-14T12:58:08.112939+0000","last_became_active":"2023-07-14T12:57:40.162329+0000","last_became_peered":"2023-07-14T12:57:40.162329+0000","last_unstale":"2023-07-14T12:58:08.112939+0000","last_undegraded":"2023-07-14T12:58:08.112939+0000","last_fullsized":"2023-07-14T12:58:08.112939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:19.671402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.962504+0000","last_change":"2023-07-14T12:57:40.172697+0000","last_active":"2023-07-14T12:58:07.962504+0000","last_peered":"2023-07-14T12:58:07.962504+0000","last_clean":"2023-07-14T12:58:07.962504+0000","last_became_active":"2023-07-14T12:57:40.172366+0000","last_became_peered":"2023-07-14T12:57:40.172366+0000","last_unstale":"2023-07-14T12:58:07.962504+0000","last_undegraded":"2023-07-14T12:58:07.962504+0000","last_fullsized":"2023-07-14T12:58:07.962504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:57.950996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959470+0000","last_change":"2023-07-14T12:57:40.166669+0000","last_active":"2023-07-14T12:58:07.959470+0000","last_peered":"2023-07-14T12:58:07.959470+0000","last_clean":"2023-07-14T12:58:07.959470+0000","last_became_active":"2023-07-14T12:57:40.166367+0000","last_became_peered":"2023-07-14T12:57:40.166367+0000","last_unstale":"2023-07-14T12:58:07.959470+0000","last_undegraded":"2023-07-14T12:58:07.959470+0000","last_fullsized":"2023-07-14T12:58:07.959470+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:32:55.001814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965791+0000","last_change":"2023-07-14T12:57:40.159133+0000","last_active":"2023-07-14T12:58:07.965791+0000","last_peered":"2023-07-14T12:58:07.965791+0000","last_clean":"2023-07-14T12:58:07.965791+0000","last_became_active":"2023-07-14T12:57:40.158819+0000","last_became_peered":"2023-07-14T12:57:40.158819+0000","last_unstale":"2023-07-14T12:58:07.965791+0000","last_undegraded":"2023-07-14T12:58:07.965791+0000","last_fullsized":"2023-07-14T12:58:07.965791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:34.782295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959654+0000","last_change":"2023-07-14T12:57:39.144919+0000","last_active":"2023-07-14T12:58:07.959654+0000","last_peered":"2023-07-14T12:58:07.959654+0000","last_clean":"2023-07-14T12:58:07.959654+0000","last_became_active":"2023-07-14T12:57:39.144604+0000","last_became_peered":"2023-07-14T12:57:39.144604+0000","last_unstale":"2023-07-14T12:58:07.959654+0000","last_undegraded":"2023-07-14T12:58:07.959654+0000","last_fullsized":"2023-07-14T12:58:07.959654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:32:41.249364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965297+0000","last_change":"2023-07-14T12:57:40.165754+0000","last_active":"2023-07-14T12:58:07.965297+0000","last_peered":"2023-07-14T12:58:07.965297+0000","last_clean":"2023-07-14T12:58:07.965297+0000","last_became_active":"2023-07-14T12:57:40.165416+0000","last_became_peered":"2023-07-14T12:57:40.165416+0000","last_unstale":"2023-07-14T12:58:07.965297+0000","last_undegraded":"2023-07-14T12:58:07.965297+0000","last_fullsized":"2023-07-14T12:58:07.965297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:44.533325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965435+0000","last_change":"2023-07-14T12:57:39.153977+0000","last_active":"2023-07-14T12:58:07.965435+0000","last_peered":"2023-07-14T12:58:07.965435+0000","last_clean":"2023-07-14T12:58:07.965435+0000","last_became_active":"2023-07-14T12:57:39.153675+0000","last_became_peered":"2023-07-14T12:57:39.153675+0000","last_unstale":"2023-07-14T12:58:07.965435+0000","last_undegraded":"2023-07-14T12:58:07.965435+0000","last_fullsized":"2023-07-14T12:58:07.965435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:56.670099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966537+0000","last_change":"2023-07-14T12:57:40.157076+0000","last_active":"2023-07-14T12:58:07.966537+0000","last_peered":"2023-07-14T12:58:07.966537+0000","last_clean":"2023-07-14T12:58:07.966537+0000","last_became_active":"2023-07-14T12:57:40.156652+0000","last_became_peered":"2023-07-14T12:57:40.156652+0000","last_unstale":"2023-07-14T12:58:07.966537+0000","last_undegraded":"2023-07-14T12:58:07.966537+0000","last_fullsized":"2023-07-14T12:58:07.966537+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:51.608575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963702+0000","last_change":"2023-07-14T12:57:39.145123+0000","last_active":"2023-07-14T12:58:07.963702+0000","last_peered":"2023-07-14T12:58:07.963702+0000","last_clean":"2023-07-14T12:58:07.963702+0000","last_became_active":"2023-07-14T12:57:39.144768+0000","last_became_peered":"2023-07-14T12:57:39.144768+0000","last_unstale":"2023-07-14T12:58:07.963702+0000","last_undegraded":"2023-07-14T12:58:07.963702+0000","last_fullsized":"2023-07-14T12:58:07.963702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:13:21.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113165+0000","last_change":"2023-07-14T12:57:40.167084+0000","last_active":"2023-07-14T12:58:08.113165+0000","last_peered":"2023-07-14T12:58:08.113165+0000","last_clean":"2023-07-14T12:58:08.113165+0000","last_became_active":"2023-07-14T12:57:40.166654+0000","last_became_peered":"2023-07-14T12:57:40.166654+0000","last_unstale":"2023-07-14T12:58:08.113165+0000","last_undegraded":"2023-07-14T12:58:08.113165+0000","last_fullsized":"2023-07-14T12:58:08.113165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:01:54.429150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963132+0000","last_change":"2023-07-14T12:57:39.137432+0000","last_active":"2023-07-14T12:58:07.963132+0000","last_peered":"2023-07-14T12:58:07.963132+0000","last_clean":"2023-07-14T12:58:07.963132+0000","last_became_active":"2023-07-14T12:57:39.137124+0000","last_became_peered":"2023-07-14T12:57:39.137124+0000","last_unstale":"2023-07-14T12:58:07.963132+0000","last_undegraded":"2023-07-14T12:58:07.963132+0000","last_fullsized":"2023-07-14T12:58:07.963132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:50.638289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113501+0000","last_change":"2023-07-14T12:57:40.167477+0000","last_active":"2023-07-14T12:58:08.113501+0000","last_peered":"2023-07-14T12:58:08.113501+0000","last_clean":"2023-07-14T12:58:08.113501+0000","last_became_active":"2023-07-14T12:57:40.167177+0000","last_became_peered":"2023-07-14T12:57:40.167177+0000","last_unstale":"2023-07-14T12:58:08.113501+0000","last_undegraded":"2023-07-14T12:58:08.113501+0000","last_fullsized":"2023-07-14T12:58:08.113501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:39:35.566121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":76,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:34.309002+0000","last_change":"2023-07-14T12:57:39.146569+0000","last_active":"2023-07-14T12:58:34.309002+0000","last_peered":"2023-07-14T12:58:34.309002+0000","last_clean":"2023-07-14T12:58:34.309002+0000","last_became_active":"2023-07-14T12:57:39.146251+0000","last_became_peered":"2023-07-14T12:57:39.146251+0000","last_unstale":"2023-07-14T12:58:34.309002+0000","last_undegraded":"2023-07-14T12:58:34.309002+0000","last_fullsized":"2023-07-14T12:58:34.309002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:33.372913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963532+0000","last_change":"2023-07-14T12:57:40.160511+0000","last_active":"2023-07-14T12:58:07.963532+0000","last_peered":"2023-07-14T12:58:07.963532+0000","last_clean":"2023-07-14T12:58:07.963532+0000","last_became_active":"2023-07-14T12:57:40.160152+0000","last_became_peered":"2023-07-14T12:57:40.160152+0000","last_unstale":"2023-07-14T12:58:07.963532+0000","last_undegraded":"2023-07-14T12:58:07.963532+0000","last_fullsized":"2023-07-14T12:58:07.963532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:05.198459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.119603+0000","last_change":"2023-07-14T12:58:08.119603+0000","last_active":"2023-07-14T12:58:08.119603+0000","last_peered":"2023-07-14T12:58:08.119603+0000","last_clean":"2023-07-14T12:58:08.119603+0000","last_became_active":"2023-07-14T12:58:08.115814+0000","last_became_peered":"2023-07-14T12:58:08.115814+0000","last_unstale":"2023-07-14T12:58:08.119603+0000","last_undegraded":"2023-07-14T12:58:08.119603+0000","last_fullsized":"2023-07-14T12:58:08.119603+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:49.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.967955+0000","last_change":"2023-07-14T12:58:07.967463+0000","last_active":"2023-07-14T12:58:07.967955+0000","last_peered":"2023-07-14T12:58:07.967955+0000","last_clean":"2023-07-14T12:58:07.967955+0000","last_became_active":"2023-07-14T12:58:07.967136+0000","last_became_peered":"2023-07-14T12:58:07.967136+0000","last_unstale":"2023-07-14T12:58:07.967955+0000","last_undegraded":"2023-07-14T12:58:07.967955+0000","last_fullsized":"2023-07-14T12:58:07.967955+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:53.152331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961797+0000","last_change":"2023-07-14T12:57:39.145352+0000","last_active":"2023-07-14T12:58:07.961797+0000","last_peered":"2023-07-14T12:58:07.961797+0000","last_clean":"2023-07-14T12:58:07.961797+0000","last_became_active":"2023-07-14T12:57:39.145018+0000","last_became_peered":"2023-07-14T12:57:39.145018+0000","last_unstale":"2023-07-14T12:58:07.961797+0000","last_undegraded":"2023-07-14T12:58:07.961797+0000","last_fullsized":"2023-07-14T12:58:07.961797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:46:13.836721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.964729+0000","last_change":"2023-07-14T12:57:40.173457+0000","last_active":"2023-07-14T12:58:07.964729+0000","last_peered":"2023-07-14T12:58:07.964729+0000","last_clean":"2023-07-14T12:58:07.964729+0000","last_became_active":"2023-07-14T12:57:40.173080+0000","last_became_peered":"2023-07-14T12:57:40.173080+0000","last_unstale":"2023-07-14T12:58:07.964729+0000","last_undegraded":"2023-07-14T12:58:07.964729+0000","last_fullsized":"2023-07-14T12:58:07.964729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:18.222106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113467+0000","last_change":"2023-07-14T12:57:39.145383+0000","last_active":"2023-07-14T12:58:08.113467+0000","last_peered":"2023-07-14T12:58:08.113467+0000","last_clean":"2023-07-14T12:58:08.113467+0000","last_became_active":"2023-07-14T12:57:39.145088+0000","last_became_peered":"2023-07-14T12:57:39.145088+0000","last_unstale":"2023-07-14T12:58:08.113467+0000","last_undegraded":"2023-07-14T12:58:08.113467+0000","last_fullsized":"2023-07-14T12:58:08.113467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:32.979153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959132+0000","last_change":"2023-07-14T12:57:40.162123+0000","last_active":"2023-07-14T12:58:07.959132+0000","last_peered":"2023-07-14T12:58:07.959132+0000","last_clean":"2023-07-14T12:58:07.959132+0000","last_became_active":"2023-07-14T12:57:40.160789+0000","last_became_peered":"2023-07-14T12:57:40.160789+0000","last_unstale":"2023-07-14T12:58:07.959132+0000","last_undegraded":"2023-07-14T12:58:07.959132+0000","last_fullsized":"2023-07-14T12:58:07.959132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:24.181158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":71,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:33.306397+0000","last_change":"2023-07-14T12:57:39.139524+0000","last_active":"2023-07-14T12:58:33.306397+0000","last_peered":"2023-07-14T12:58:33.306397+0000","last_clean":"2023-07-14T12:58:33.306397+0000","last_became_active":"2023-07-14T12:57:39.139176+0000","last_became_peered":"2023-07-14T12:57:39.139176+0000","last_unstale":"2023-07-14T12:58:33.306397+0000","last_undegraded":"2023-07-14T12:58:33.306397+0000","last_fullsized":"2023-07-14T12:58:33.306397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:27.070260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113322+0000","last_change":"2023-07-14T12:57:40.168729+0000","last_active":"2023-07-14T12:58:08.113322+0000","last_peered":"2023-07-14T12:58:08.113322+0000","last_clean":"2023-07-14T12:58:08.113322+0000","last_became_active":"2023-07-14T12:57:40.168408+0000","last_became_peered":"2023-07-14T12:57:40.168408+0000","last_unstale":"2023-07-14T12:58:08.113322+0000","last_undegraded":"2023-07-14T12:58:08.113322+0000","last_fullsized":"2023-07-14T12:58:08.113322+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:58:20.491077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958510+0000","last_change":"2023-07-14T12:57:39.140744+0000","last_active":"2023-07-14T12:58:07.958510+0000","last_peered":"2023-07-14T12:58:07.958510+0000","last_clean":"2023-07-14T12:58:07.958510+0000","last_became_active":"2023-07-14T12:57:39.140391+0000","last_became_peered":"2023-07-14T12:57:39.140391+0000","last_unstale":"2023-07-14T12:58:07.958510+0000","last_undegraded":"2023-07-14T12:58:07.958510+0000","last_fullsized":"2023-07-14T12:58:07.958510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:01.023100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966511+0000","last_change":"2023-07-14T12:57:40.165552+0000","last_active":"2023-07-14T12:58:07.966511+0000","last_peered":"2023-07-14T12:58:07.966511+0000","last_clean":"2023-07-14T12:58:07.966511+0000","last_became_active":"2023-07-14T12:57:40.165214+0000","last_became_peered":"2023-07-14T12:57:40.165214+0000","last_unstale":"2023-07-14T12:58:07.966511+0000","last_undegraded":"2023-07-14T12:58:07.966511+0000","last_fullsized":"2023-07-14T12:58:07.966511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:15.528292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113790+0000","last_change":"2023-07-14T12:57:39.150311+0000","last_active":"2023-07-14T12:58:08.113790+0000","last_peered":"2023-07-14T12:58:08.113790+0000","last_clean":"2023-07-14T12:58:08.113790+0000","last_became_active":"2023-07-14T12:57:39.149885+0000","last_became_peered":"2023-07-14T12:57:39.149885+0000","last_unstale":"2023-07-14T12:58:08.113790+0000","last_undegraded":"2023-07-14T12:58:08.113790+0000","last_fullsized":"2023-07-14T12:58:08.113790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:56.722568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113391+0000","last_change":"2023-07-14T12:57:40.161845+0000","last_active":"2023-07-14T12:58:08.113391+0000","last_peered":"2023-07-14T12:58:08.113391+0000","last_clean":"2023-07-14T12:58:08.113391+0000","last_became_active":"2023-07-14T12:57:40.160895+0000","last_became_peered":"2023-07-14T12:57:40.160895+0000","last_unstale":"2023-07-14T12:58:08.113391+0000","last_undegraded":"2023-07-14T12:58:08.113391+0000","last_fullsized":"2023-07-14T12:58:08.113391+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:20:16.547464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'27","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:34.318704+0000","last_change":"2023-07-14T12:57:39.142584+0000","last_active":"2023-07-14T12:58:34.318704+0000","last_peered":"2023-07-14T12:58:34.318704+0000","last_clean":"2023-07-14T12:58:34.318704+0000","last_became_active":"2023-07-14T12:57:39.142239+0000","last_became_peered":"2023-07-14T12:57:39.142239+0000","last_unstale":"2023-07-14T12:58:34.318704+0000","last_undegraded":"2023-07-14T12:58:34.318704+0000","last_fullsized":"2023-07-14T12:58:34.318704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:56.022427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59112,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":28,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963247+0000","last_change":"2023-07-14T12:57:40.170013+0000","last_active":"2023-07-14T12:58:07.963247+0000","last_peered":"2023-07-14T12:58:07.963247+0000","last_clean":"2023-07-14T12:58:07.963247+0000","last_became_active":"2023-07-14T12:57:40.169177+0000","last_became_peered":"2023-07-14T12:57:40.169177+0000","last_unstale":"2023-07-14T12:58:07.963247+0000","last_undegraded":"2023-07-14T12:58:07.963247+0000","last_fullsized":"2023-07-14T12:58:07.963247+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:42.957456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.978704+0000","last_change":"2023-07-14T12:58:07.978239+0000","last_active":"2023-07-14T12:58:07.978704+0000","last_peered":"2023-07-14T12:58:07.978704+0000","last_clean":"2023-07-14T12:58:07.978704+0000","last_became_active":"2023-07-14T12:58:07.967195+0000","last_became_peered":"2023-07-14T12:58:07.967195+0000","last_unstale":"2023-07-14T12:58:07.978704+0000","last_undegraded":"2023-07-14T12:58:07.978704+0000","last_fullsized":"2023-07-14T12:58:07.978704+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:05.124879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961641+0000","last_change":"2023-07-14T12:57:40.158098+0000","last_active":"2023-07-14T12:58:07.961641+0000","last_peered":"2023-07-14T12:58:07.961641+0000","last_clean":"2023-07-14T12:58:07.961641+0000","last_became_active":"2023-07-14T12:57:40.157736+0000","last_became_peered":"2023-07-14T12:57:40.157736+0000","last_unstale":"2023-07-14T12:58:07.961641+0000","last_undegraded":"2023-07-14T12:58:07.961641+0000","last_fullsized":"2023-07-14T12:58:07.961641+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:04:59.371098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113762+0000","last_change":"2023-07-14T12:57:39.135784+0000","last_active":"2023-07-14T12:58:08.113762+0000","last_peered":"2023-07-14T12:58:08.113762+0000","last_clean":"2023-07-14T12:58:08.113762+0000","last_became_active":"2023-07-14T12:57:39.135480+0000","last_became_peered":"2023-07-14T12:57:39.135480+0000","last_unstale":"2023-07-14T12:58:08.113762+0000","last_undegraded":"2023-07-14T12:58:08.113762+0000","last_fullsized":"2023-07-14T12:58:08.113762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:33:37.574910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957954+0000","last_change":"2023-07-14T12:57:40.162548+0000","last_active":"2023-07-14T12:58:07.957954+0000","last_peered":"2023-07-14T12:58:07.957954+0000","last_clean":"2023-07-14T12:58:07.957954+0000","last_became_active":"2023-07-14T12:57:40.162191+0000","last_became_peered":"2023-07-14T12:57:40.162191+0000","last_unstale":"2023-07-14T12:58:07.957954+0000","last_undegraded":"2023-07-14T12:58:07.957954+0000","last_fullsized":"2023-07-14T12:58:07.957954+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:04.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":72,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:32.320667+0000","last_change":"2023-07-14T12:57:39.145533+0000","last_active":"2023-07-14T12:58:32.320667+0000","last_peered":"2023-07-14T12:58:32.320667+0000","last_clean":"2023-07-14T12:58:32.320667+0000","last_became_active":"2023-07-14T12:57:39.145201+0000","last_became_peered":"2023-07-14T12:57:39.145201+0000","last_unstale":"2023-07-14T12:58:32.320667+0000","last_undegraded":"2023-07-14T12:58:32.320667+0000","last_fullsized":"2023-07-14T12:58:32.320667+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:46.324639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958091+0000","last_change":"2023-07-14T12:57:40.160047+0000","last_active":"2023-07-14T12:58:07.958091+0000","last_peered":"2023-07-14T12:58:07.958091+0000","last_clean":"2023-07-14T12:58:07.958091+0000","last_became_active":"2023-07-14T12:57:40.159751+0000","last_became_peered":"2023-07-14T12:57:40.159751+0000","last_unstale":"2023-07-14T12:58:07.958091+0000","last_undegraded":"2023-07-14T12:58:07.958091+0000","last_fullsized":"2023-07-14T12:58:07.958091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:16.874363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.130840+0000","last_change":"2023-07-14T12:58:08.130840+0000","last_active":"2023-07-14T12:58:08.130840+0000","last_peered":"2023-07-14T12:58:08.130840+0000","last_clean":"2023-07-14T12:58:08.130840+0000","last_became_active":"2023-07-14T12:58:08.116583+0000","last_became_peered":"2023-07-14T12:58:08.116583+0000","last_unstale":"2023-07-14T12:58:08.130840+0000","last_undegraded":"2023-07-14T12:58:08.130840+0000","last_fullsized":"2023-07-14T12:58:08.130840+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:07:34.361949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113509+0000","last_change":"2023-07-14T12:57:40.173741+0000","last_active":"2023-07-14T12:58:08.113509+0000","last_peered":"2023-07-14T12:58:08.113509+0000","last_clean":"2023-07-14T12:58:08.113509+0000","last_became_active":"2023-07-14T12:57:40.173427+0000","last_became_peered":"2023-07-14T12:57:40.173427+0000","last_unstale":"2023-07-14T12:58:08.113509+0000","last_undegraded":"2023-07-14T12:58:08.113509+0000","last_fullsized":"2023-07-14T12:58:08.113509+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:41:16.366763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963223+0000","last_change":"2023-07-14T12:57:39.140979+0000","last_active":"2023-07-14T12:58:07.963223+0000","last_peered":"2023-07-14T12:58:07.963223+0000","last_clean":"2023-07-14T12:58:07.963223+0000","last_became_active":"2023-07-14T12:57:39.140692+0000","last_became_peered":"2023-07-14T12:57:39.140692+0000","last_unstale":"2023-07-14T12:58:07.963223+0000","last_undegraded":"2023-07-14T12:58:07.963223+0000","last_fullsized":"2023-07-14T12:58:07.963223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:01:09.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961982+0000","last_change":"2023-07-14T12:57:40.164258+0000","last_active":"2023-07-14T12:58:07.961982+0000","last_peered":"2023-07-14T12:58:07.961982+0000","last_clean":"2023-07-14T12:58:07.961982+0000","last_became_active":"2023-07-14T12:57:40.163911+0000","last_became_peered":"2023-07-14T12:57:40.163911+0000","last_unstale":"2023-07-14T12:58:07.961982+0000","last_undegraded":"2023-07-14T12:58:07.961982+0000","last_fullsized":"2023-07-14T12:58:07.961982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:45.474358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959321+0000","last_change":"2023-07-14T12:57:39.151301+0000","last_active":"2023-07-14T12:58:07.959321+0000","last_peered":"2023-07-14T12:58:07.959321+0000","last_clean":"2023-07-14T12:58:07.959321+0000","last_became_active":"2023-07-14T12:57:39.150948+0000","last_became_peered":"2023-07-14T12:57:39.150948+0000","last_unstale":"2023-07-14T12:58:07.959321+0000","last_undegraded":"2023-07-14T12:58:07.959321+0000","last_fullsized":"2023-07-14T12:58:07.959321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:11.221824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.960006+0000","last_change":"2023-07-14T12:57:40.158591+0000","last_active":"2023-07-14T12:58:07.960006+0000","last_peered":"2023-07-14T12:58:07.960006+0000","last_clean":"2023-07-14T12:58:07.960006+0000","last_became_active":"2023-07-14T12:57:40.158229+0000","last_became_peered":"2023-07-14T12:57:40.158229+0000","last_unstale":"2023-07-14T12:58:07.960006+0000","last_undegraded":"2023-07-14T12:58:07.960006+0000","last_fullsized":"2023-07-14T12:58:07.960006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:48.116113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957827+0000","last_change":"2023-07-14T12:57:39.152151+0000","last_active":"2023-07-14T12:58:07.957827+0000","last_peered":"2023-07-14T12:58:07.957827+0000","last_clean":"2023-07-14T12:58:07.957827+0000","last_became_active":"2023-07-14T12:57:39.151859+0000","last_became_peered":"2023-07-14T12:57:39.151859+0000","last_unstale":"2023-07-14T12:58:07.957827+0000","last_undegraded":"2023-07-14T12:58:07.957827+0000","last_fullsized":"2023-07-14T12:58:07.957827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:19:10.573132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959825+0000","last_change":"2023-07-14T12:57:40.166604+0000","last_active":"2023-07-14T12:58:07.959825+0000","last_peered":"2023-07-14T12:58:07.959825+0000","last_clean":"2023-07-14T12:58:07.959825+0000","last_became_active":"2023-07-14T12:57:40.166265+0000","last_became_peered":"2023-07-14T12:57:40.166265+0000","last_unstale":"2023-07-14T12:58:07.959825+0000","last_undegraded":"2023-07-14T12:58:07.959825+0000","last_fullsized":"2023-07-14T12:58:07.959825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:01.157573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113808+0000","last_change":"2023-07-14T12:57:40.169910+0000","last_active":"2023-07-14T12:58:08.113808+0000","last_peered":"2023-07-14T12:58:08.113808+0000","last_clean":"2023-07-14T12:58:08.113808+0000","last_became_active":"2023-07-14T12:57:40.169621+0000","last_became_peered":"2023-07-14T12:57:40.169621+0000","last_unstale":"2023-07-14T12:58:08.113808+0000","last_undegraded":"2023-07-14T12:58:08.113808+0000","last_fullsized":"2023-07-14T12:58:08.113808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:14.831482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":75,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:36.327788+0000","last_change":"2023-07-14T12:57:39.144463+0000","last_active":"2023-07-14T12:58:36.327788+0000","last_peered":"2023-07-14T12:58:36.327788+0000","last_clean":"2023-07-14T12:58:36.327788+0000","last_became_active":"2023-07-14T12:57:39.142094+0000","last_became_peered":"2023-07-14T12:57:39.142094+0000","last_unstale":"2023-07-14T12:58:36.327788+0000","last_undegraded":"2023-07-14T12:58:36.327788+0000","last_fullsized":"2023-07-14T12:58:36.327788+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:11:20.958238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965691+0000","last_change":"2023-07-14T12:57:40.163588+0000","last_active":"2023-07-14T12:58:07.965691+0000","last_peered":"2023-07-14T12:58:07.965691+0000","last_clean":"2023-07-14T12:58:07.965691+0000","last_became_active":"2023-07-14T12:57:40.162611+0000","last_became_peered":"2023-07-14T12:57:40.162611+0000","last_unstale":"2023-07-14T12:58:07.965691+0000","last_undegraded":"2023-07-14T12:58:07.965691+0000","last_fullsized":"2023-07-14T12:58:07.965691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:21:59.184916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113974+0000","last_change":"2023-07-14T12:57:39.143581+0000","last_active":"2023-07-14T12:58:08.113974+0000","last_peered":"2023-07-14T12:58:08.113974+0000","last_clean":"2023-07-14T12:58:08.113974+0000","last_became_active":"2023-07-14T12:57:39.143257+0000","last_became_peered":"2023-07-14T12:57:39.143257+0000","last_unstale":"2023-07-14T12:58:08.113974+0000","last_undegraded":"2023-07-14T12:58:08.113974+0000","last_fullsized":"2023-07-14T12:58:08.113974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:30.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":350,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957866+0000","last_change":"2023-07-14T12:56:23.360103+0000","last_active":"2023-07-14T12:58:07.957866+0000","last_peered":"2023-07-14T12:58:07.957866+0000","last_clean":"2023-07-14T12:58:07.957866+0000","last_became_active":"2023-07-14T12:56:23.359608+0000","last_became_peered":"2023-07-14T12:56:23.359608+0000","last_unstale":"2023-07-14T12:58:07.957866+0000","last_undegraded":"2023-07-14T12:58:07.957866+0000","last_fullsized":"2023-07-14T12:58:07.957866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.397328+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:52:52.622736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961633+0000","last_change":"2023-07-14T12:57:40.158039+0000","last_active":"2023-07-14T12:58:07.961633+0000","last_peered":"2023-07-14T12:58:07.961633+0000","last_clean":"2023-07-14T12:58:07.961633+0000","last_became_active":"2023-07-14T12:57:40.157629+0000","last_became_peered":"2023-07-14T12:57:40.157629+0000","last_unstale":"2023-07-14T12:58:07.961633+0000","last_undegraded":"2023-07-14T12:58:07.961633+0000","last_fullsized":"2023-07-14T12:58:07.961633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:18.205760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958150+0000","last_change":"2023-07-14T12:57:39.146449+0000","last_active":"2023-07-14T12:58:07.958150+0000","last_peered":"2023-07-14T12:58:07.958150+0000","last_clean":"2023-07-14T12:58:07.958150+0000","last_became_active":"2023-07-14T12:57:39.146109+0000","last_became_peered":"2023-07-14T12:57:39.146109+0000","last_unstale":"2023-07-14T12:58:07.958150+0000","last_undegraded":"2023-07-14T12:58:07.958150+0000","last_fullsized":"2023-07-14T12:58:07.958150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:15.222237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963386+0000","last_change":"2023-07-14T12:57:39.149417+0000","last_active":"2023-07-14T12:58:07.963386+0000","last_peered":"2023-07-14T12:58:07.963386+0000","last_clean":"2023-07-14T12:58:07.963386+0000","last_became_active":"2023-07-14T12:57:39.149097+0000","last_became_peered":"2023-07-14T12:57:39.149097+0000","last_unstale":"2023-07-14T12:58:07.963386+0000","last_undegraded":"2023-07-14T12:58:07.963386+0000","last_fullsized":"2023-07-14T12:58:07.963386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:10.550476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961833+0000","last_change":"2023-07-14T12:57:40.160881+0000","last_active":"2023-07-14T12:58:07.961833+0000","last_peered":"2023-07-14T12:58:07.961833+0000","last_clean":"2023-07-14T12:58:07.961833+0000","last_became_active":"2023-07-14T12:57:40.158570+0000","last_became_peered":"2023-07-14T12:57:40.158570+0000","last_unstale":"2023-07-14T12:58:07.961833+0000","last_undegraded":"2023-07-14T12:58:07.961833+0000","last_fullsized":"2023-07-14T12:58:07.961833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:46.644633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959462+0000","last_change":"2023-07-14T12:57:39.142805+0000","last_active":"2023-07-14T12:58:07.959462+0000","last_peered":"2023-07-14T12:58:07.959462+0000","last_clean":"2023-07-14T12:58:07.959462+0000","last_became_active":"2023-07-14T12:57:39.142417+0000","last_became_peered":"2023-07-14T12:57:39.142417+0000","last_unstale":"2023-07-14T12:58:07.959462+0000","last_undegraded":"2023-07-14T12:58:07.959462+0000","last_fullsized":"2023-07-14T12:58:07.959462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:01:14.949862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965258+0000","last_change":"2023-07-14T12:57:40.171695+0000","last_active":"2023-07-14T12:58:07.965258+0000","last_peered":"2023-07-14T12:58:07.965258+0000","last_clean":"2023-07-14T12:58:07.965258+0000","last_became_active":"2023-07-14T12:57:40.171344+0000","last_became_peered":"2023-07-14T12:57:40.171344+0000","last_unstale":"2023-07-14T12:58:07.965258+0000","last_undegraded":"2023-07-14T12:58:07.965258+0000","last_fullsized":"2023-07-14T12:58:07.965258+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:49.528964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113794+0000","last_change":"2023-07-14T12:57:39.141065+0000","last_active":"2023-07-14T12:58:08.113794+0000","last_peered":"2023-07-14T12:58:08.113794+0000","last_clean":"2023-07-14T12:58:08.113794+0000","last_became_active":"2023-07-14T12:57:39.140681+0000","last_became_peered":"2023-07-14T12:57:39.140681+0000","last_unstale":"2023-07-14T12:58:08.113794+0000","last_undegraded":"2023-07-14T12:58:08.113794+0000","last_fullsized":"2023-07-14T12:58:08.113794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:38:35.851889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966374+0000","last_change":"2023-07-14T12:57:40.158403+0000","last_active":"2023-07-14T12:58:07.966374+0000","last_peered":"2023-07-14T12:58:07.966374+0000","last_clean":"2023-07-14T12:58:07.966374+0000","last_became_active":"2023-07-14T12:57:40.158077+0000","last_became_peered":"2023-07-14T12:57:40.158077+0000","last_unstale":"2023-07-14T12:58:07.966374+0000","last_undegraded":"2023-07-14T12:58:07.966374+0000","last_fullsized":"2023-07-14T12:58:07.966374+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:27:14.759138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.112919+0000","last_change":"2023-07-14T12:57:39.139613+0000","last_active":"2023-07-14T12:58:08.112919+0000","last_peered":"2023-07-14T12:58:08.112919+0000","last_clean":"2023-07-14T12:58:08.112919+0000","last_became_active":"2023-07-14T12:57:39.139306+0000","last_became_peered":"2023-07-14T12:57:39.139306+0000","last_unstale":"2023-07-14T12:58:08.112919+0000","last_undegraded":"2023-07-14T12:58:08.112919+0000","last_fullsized":"2023-07-14T12:58:08.112919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:16:13.426604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.962606+0000","last_change":"2023-07-14T12:57:40.169715+0000","last_active":"2023-07-14T12:58:07.962606+0000","last_peered":"2023-07-14T12:58:07.962606+0000","last_clean":"2023-07-14T12:58:07.962606+0000","last_became_active":"2023-07-14T12:57:40.169319+0000","last_became_peered":"2023-07-14T12:57:40.169319+0000","last_unstale":"2023-07-14T12:58:07.962606+0000","last_undegraded":"2023-07-14T12:58:07.962606+0000","last_fullsized":"2023-07-14T12:58:07.962606+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:49.187041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.964905+0000","last_change":"2023-07-14T12:57:39.134058+0000","last_active":"2023-07-14T12:58:07.964905+0000","last_peered":"2023-07-14T12:58:07.964905+0000","last_clean":"2023-07-14T12:58:07.964905+0000","last_became_active":"2023-07-14T12:57:39.133143+0000","last_became_peered":"2023-07-14T12:57:39.133143+0000","last_unstale":"2023-07-14T12:58:07.964905+0000","last_undegraded":"2023-07-14T12:58:07.964905+0000","last_fullsized":"2023-07-14T12:58:07.964905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:22:41.049828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961593+0000","last_change":"2023-07-14T12:57:40.164106+0000","last_active":"2023-07-14T12:58:07.961593+0000","last_peered":"2023-07-14T12:58:07.961593+0000","last_clean":"2023-07-14T12:58:07.961593+0000","last_became_active":"2023-07-14T12:57:40.163768+0000","last_became_peered":"2023-07-14T12:57:40.163768+0000","last_unstale":"2023-07-14T12:58:07.961593+0000","last_undegraded":"2023-07-14T12:58:07.961593+0000","last_fullsized":"2023-07-14T12:58:07.961593+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:27.922121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.971006+0000","last_change":"2023-07-14T12:58:07.970517+0000","last_active":"2023-07-14T12:58:07.971006+0000","last_peered":"2023-07-14T12:58:07.971006+0000","last_clean":"2023-07-14T12:58:07.971006+0000","last_became_active":"2023-07-14T12:58:07.967121+0000","last_became_peered":"2023-07-14T12:58:07.967121+0000","last_unstale":"2023-07-14T12:58:07.971006+0000","last_undegraded":"2023-07-14T12:58:07.971006+0000","last_fullsized":"2023-07-14T12:58:07.971006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:48:35.651155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965590+0000","last_change":"2023-07-14T12:57:40.163373+0000","last_active":"2023-07-14T12:58:07.965590+0000","last_peered":"2023-07-14T12:58:07.965590+0000","last_clean":"2023-07-14T12:58:07.965590+0000","last_became_active":"2023-07-14T12:57:40.162852+0000","last_became_peered":"2023-07-14T12:57:40.162852+0000","last_unstale":"2023-07-14T12:58:07.965590+0000","last_undegraded":"2023-07-14T12:58:07.965590+0000","last_fullsized":"2023-07-14T12:58:07.965590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:38.396243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963013+0000","last_change":"2023-07-14T12:57:39.143961+0000","last_active":"2023-07-14T12:58:07.963013+0000","last_peered":"2023-07-14T12:58:07.963013+0000","last_clean":"2023-07-14T12:58:07.963013+0000","last_became_active":"2023-07-14T12:57:39.143599+0000","last_became_peered":"2023-07-14T12:57:39.143599+0000","last_unstale":"2023-07-14T12:58:07.963013+0000","last_undegraded":"2023-07-14T12:58:07.963013+0000","last_fullsized":"2023-07-14T12:58:07.963013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:25.216766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957979+0000","last_change":"2023-07-14T12:57:40.157972+0000","last_active":"2023-07-14T12:58:07.957979+0000","last_peered":"2023-07-14T12:58:07.957979+0000","last_clean":"2023-07-14T12:58:07.957979+0000","last_became_active":"2023-07-14T12:57:40.157645+0000","last_became_peered":"2023-07-14T12:57:40.157645+0000","last_unstale":"2023-07-14T12:58:07.957979+0000","last_undegraded":"2023-07-14T12:58:07.957979+0000","last_fullsized":"2023-07-14T12:58:07.957979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:54:33.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965731+0000","last_change":"2023-07-14T12:57:39.153405+0000","last_active":"2023-07-14T12:58:07.965731+0000","last_peered":"2023-07-14T12:58:07.965731+0000","last_clean":"2023-07-14T12:58:07.965731+0000","last_became_active":"2023-07-14T12:57:39.153029+0000","last_became_peered":"2023-07-14T12:57:39.153029+0000","last_unstale":"2023-07-14T12:58:07.965731+0000","last_undegraded":"2023-07-14T12:58:07.965731+0000","last_fullsized":"2023-07-14T12:58:07.965731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:47:58.753892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958530+0000","last_change":"2023-07-14T12:57:40.163910+0000","last_active":"2023-07-14T12:58:07.958530+0000","last_peered":"2023-07-14T12:58:07.958530+0000","last_clean":"2023-07-14T12:58:07.958530+0000","last_became_active":"2023-07-14T12:57:40.163539+0000","last_became_peered":"2023-07-14T12:57:40.163539+0000","last_unstale":"2023-07-14T12:58:07.958530+0000","last_undegraded":"2023-07-14T12:58:07.958530+0000","last_fullsized":"2023-07-14T12:58:07.958530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:12.543412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113454+0000","last_change":"2023-07-14T12:57:39.132649+0000","last_active":"2023-07-14T12:58:08.113454+0000","last_peered":"2023-07-14T12:58:08.113454+0000","last_clean":"2023-07-14T12:58:08.113454+0000","last_became_active":"2023-07-14T12:57:39.132295+0000","last_became_peered":"2023-07-14T12:57:39.132295+0000","last_unstale":"2023-07-14T12:58:08.113454+0000","last_undegraded":"2023-07-14T12:58:08.113454+0000","last_fullsized":"2023-07-14T12:58:08.113454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:19.495427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958143+0000","last_change":"2023-07-14T12:57:40.166285+0000","last_active":"2023-07-14T12:58:07.958143+0000","last_peered":"2023-07-14T12:58:07.958143+0000","last_clean":"2023-07-14T12:58:07.958143+0000","last_became_active":"2023-07-14T12:57:40.165968+0000","last_became_peered":"2023-07-14T12:57:40.165968+0000","last_unstale":"2023-07-14T12:58:07.958143+0000","last_undegraded":"2023-07-14T12:58:07.958143+0000","last_fullsized":"2023-07-14T12:58:07.958143+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:22.071229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961885+0000","last_change":"2023-07-14T12:57:39.150988+0000","last_active":"2023-07-14T12:58:07.961885+0000","last_peered":"2023-07-14T12:58:07.961885+0000","last_clean":"2023-07-14T12:58:07.961885+0000","last_became_active":"2023-07-14T12:57:39.150552+0000","last_became_peered":"2023-07-14T12:57:39.150552+0000","last_unstale":"2023-07-14T12:58:07.961885+0000","last_undegraded":"2023-07-14T12:58:07.961885+0000","last_fullsized":"2023-07-14T12:58:07.961885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:04:27.733757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958595+0000","last_change":"2023-07-14T12:57:40.169729+0000","last_active":"2023-07-14T12:58:07.958595+0000","last_peered":"2023-07-14T12:58:07.958595+0000","last_clean":"2023-07-14T12:58:07.958595+0000","last_became_active":"2023-07-14T12:57:40.169432+0000","last_became_peered":"2023-07-14T12:57:40.169432+0000","last_unstale":"2023-07-14T12:58:07.958595+0000","last_undegraded":"2023-07-14T12:58:07.958595+0000","last_fullsized":"2023-07-14T12:58:07.958595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:27:50.731427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961691+0000","last_change":"2023-07-14T12:57:40.167668+0000","last_active":"2023-07-14T12:58:07.961691+0000","last_peered":"2023-07-14T12:58:07.961691+0000","last_clean":"2023-07-14T12:58:07.961691+0000","last_became_active":"2023-07-14T12:57:40.167328+0000","last_became_peered":"2023-07-14T12:57:40.167328+0000","last_unstale":"2023-07-14T12:58:07.961691+0000","last_undegraded":"2023-07-14T12:58:07.961691+0000","last_fullsized":"2023-07-14T12:58:07.961691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:24.623266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965220+0000","last_change":"2023-07-14T12:57:40.161340+0000","last_active":"2023-07-14T12:58:07.965220+0000","last_peered":"2023-07-14T12:58:07.965220+0000","last_clean":"2023-07-14T12:58:07.965220+0000","last_became_active":"2023-07-14T12:57:40.161024+0000","last_became_peered":"2023-07-14T12:57:40.161024+0000","last_unstale":"2023-07-14T12:58:07.965220+0000","last_undegraded":"2023-07-14T12:58:07.965220+0000","last_fullsized":"2023-07-14T12:58:07.965220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:56.043017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965390+0000","last_change":"2023-07-14T12:57:40.159287+0000","last_active":"2023-07-14T12:58:07.965390+0000","last_peered":"2023-07-14T12:58:07.965390+0000","last_clean":"2023-07-14T12:58:07.965390+0000","last_became_active":"2023-07-14T12:57:40.158889+0000","last_became_peered":"2023-07-14T12:57:40.158889+0000","last_unstale":"2023-07-14T12:58:07.965390+0000","last_undegraded":"2023-07-14T12:58:07.965390+0000","last_fullsized":"2023-07-14T12:58:07.965390+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:27.078113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966189+0000","last_change":"2023-07-14T12:57:40.168898+0000","last_active":"2023-07-14T12:58:07.966189+0000","last_peered":"2023-07-14T12:58:07.966189+0000","last_clean":"2023-07-14T12:58:07.966189+0000","last_became_active":"2023-07-14T12:57:40.168596+0000","last_became_peered":"2023-07-14T12:57:40.168596+0000","last_unstale":"2023-07-14T12:58:07.966189+0000","last_undegraded":"2023-07-14T12:58:07.966189+0000","last_fullsized":"2023-07-14T12:58:07.966189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:18.836992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961751+0000","last_change":"2023-07-14T12:57:40.156267+0000","last_active":"2023-07-14T12:58:07.961751+0000","last_peered":"2023-07-14T12:58:07.961751+0000","last_clean":"2023-07-14T12:58:07.961751+0000","last_became_active":"2023-07-14T12:57:40.155909+0000","last_became_peered":"2023-07-14T12:57:40.155909+0000","last_unstale":"2023-07-14T12:58:07.961751+0000","last_undegraded":"2023-07-14T12:58:07.961751+0000","last_fullsized":"2023-07-14T12:58:07.961751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:07.081173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.962239+0000","last_change":"2023-07-14T12:57:40.162956+0000","last_active":"2023-07-14T12:58:07.962239+0000","last_peered":"2023-07-14T12:58:07.962239+0000","last_clean":"2023-07-14T12:58:07.962239+0000","last_became_active":"2023-07-14T12:57:40.162373+0000","last_became_peered":"2023-07-14T12:57:40.162373+0000","last_unstale":"2023-07-14T12:58:07.962239+0000","last_undegraded":"2023-07-14T12:58:07.962239+0000","last_fullsized":"2023-07-14T12:58:07.962239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:15.307049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.966187+0000","last_change":"2023-07-14T12:57:40.158655+0000","last_active":"2023-07-14T12:58:07.966187+0000","last_peered":"2023-07-14T12:58:07.966187+0000","last_clean":"2023-07-14T12:58:07.966187+0000","last_became_active":"2023-07-14T12:57:40.158290+0000","last_became_peered":"2023-07-14T12:57:40.158290+0000","last_unstale":"2023-07-14T12:58:07.966187+0000","last_undegraded":"2023-07-14T12:58:07.966187+0000","last_fullsized":"2023-07-14T12:58:07.966187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:02:22.373566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965124+0000","last_change":"2023-07-14T12:57:40.164132+0000","last_active":"2023-07-14T12:58:07.965124+0000","last_peered":"2023-07-14T12:58:07.965124+0000","last_clean":"2023-07-14T12:58:07.965124+0000","last_became_active":"2023-07-14T12:57:40.163774+0000","last_became_peered":"2023-07-14T12:57:40.163774+0000","last_unstale":"2023-07-14T12:58:07.965124+0000","last_undegraded":"2023-07-14T12:58:07.965124+0000","last_fullsized":"2023-07-14T12:58:07.965124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:30.562785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113592+0000","last_change":"2023-07-14T12:57:40.171046+0000","last_active":"2023-07-14T12:58:08.113592+0000","last_peered":"2023-07-14T12:58:08.113592+0000","last_clean":"2023-07-14T12:58:08.113592+0000","last_became_active":"2023-07-14T12:57:40.170727+0000","last_became_peered":"2023-07-14T12:57:40.170727+0000","last_unstale":"2023-07-14T12:58:08.113592+0000","last_undegraded":"2023-07-14T12:58:08.113592+0000","last_fullsized":"2023-07-14T12:58:08.113592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:44.795580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.964940+0000","last_change":"2023-07-14T12:57:40.171636+0000","last_active":"2023-07-14T12:58:07.964940+0000","last_peered":"2023-07-14T12:58:07.964940+0000","last_clean":"2023-07-14T12:58:07.964940+0000","last_became_active":"2023-07-14T12:57:40.171365+0000","last_became_peered":"2023-07-14T12:57:40.171365+0000","last_unstale":"2023-07-14T12:58:07.964940+0000","last_undegraded":"2023-07-14T12:58:07.964940+0000","last_fullsized":"2023-07-14T12:58:07.964940+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:10.582323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113365+0000","last_change":"2023-07-14T12:57:40.162963+0000","last_active":"2023-07-14T12:58:08.113365+0000","last_peered":"2023-07-14T12:58:08.113365+0000","last_clean":"2023-07-14T12:58:08.113365+0000","last_became_active":"2023-07-14T12:57:40.162614+0000","last_became_peered":"2023-07-14T12:57:40.162614+0000","last_unstale":"2023-07-14T12:58:08.113365+0000","last_undegraded":"2023-07-14T12:58:08.113365+0000","last_fullsized":"2023-07-14T12:58:08.113365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:46.953808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961969+0000","last_change":"2023-07-14T12:57:40.156138+0000","last_active":"2023-07-14T12:58:07.961969+0000","last_peered":"2023-07-14T12:58:07.961969+0000","last_clean":"2023-07-14T12:58:07.961969+0000","last_became_active":"2023-07-14T12:57:40.155785+0000","last_became_peered":"2023-07-14T12:57:40.155785+0000","last_unstale":"2023-07-14T12:58:07.961969+0000","last_undegraded":"2023-07-14T12:58:07.961969+0000","last_fullsized":"2023-07-14T12:58:07.961969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:45.189290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961857+0000","last_change":"2023-07-14T12:57:40.163978+0000","last_active":"2023-07-14T12:58:07.961857+0000","last_peered":"2023-07-14T12:58:07.961857+0000","last_clean":"2023-07-14T12:58:07.961857+0000","last_became_active":"2023-07-14T12:57:40.163620+0000","last_became_peered":"2023-07-14T12:57:40.163620+0000","last_unstale":"2023-07-14T12:58:07.961857+0000","last_undegraded":"2023-07-14T12:58:07.961857+0000","last_fullsized":"2023-07-14T12:58:07.961857+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:48.986548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":215126,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62626,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":329,"num_read_kb":232,"num_write":148,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":146,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":187878,"data_compressed":4806,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351000,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":459210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.746},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.91800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.88}]},{"osd":5,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.028}]},{"osd":6,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.95599999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.1419999999999999}]},{"osd":10,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.0429999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612637,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1097728,"data_stored":1109727,"data_compressed":37730,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82699999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.434},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.034,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.92000000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.745}]},{"osd":3,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85999999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89800000000000002,"5min":1.391,"15min":1.391},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.65700000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95599999999999996,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.996,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.90000000000000002,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.83999999999999997,"15min":0.86299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93899999999999995,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.86599999999999999,"15min":0.874},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.98099999999999998,"5min":1.298,"15min":1.298},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92200000000000004,"15min":0.93600000000000005},"min":{"1min":0.61199999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.018,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.72299999999999998}]},{"osd":9,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.94599999999999995,"15min":0.96999999999999997},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":0.998,"5min":1.746,"15min":1.746},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.052,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.80600000000000005}]},{"osd":11,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.84599999999999997}]}]},{"osd":9,"up_from":68,"seq":292057776163,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.54800000000000004,"15min":0.56299999999999994},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72399999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.501},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77700000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0600000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.78800000000000003,"15min":0.81000000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96599999999999997,"5min":1.383,"15min":1.383},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94799999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0109999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.85599999999999998,"5min":1.169,"15min":1.169},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.877,"15min":0.89700000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0620000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.874,"15min":0.89800000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97899999999999998,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.876,"15min":0.90000000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.022,"5min":1.355,"15min":1.355},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.86199999999999999,"15min":0.88100000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.998,"5min":1.256,"15min":1.256},"last":0.61499999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.874,"15min":0.89400000000000002},"min":{"1min":0.49299999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0509999999999999,"5min":1.367,"15min":1.367},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.92700000000000005,"15min":0.95299999999999996},"min":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0409999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.96499999999999997,"15min":0.98799999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1439999999999999,"5min":1.575,"15min":1.575},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.0029999999999999,"15min":1.022},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1539999999999999,"5min":1.871,"15min":1.871},"last":0.71099999999999997}]},{"osd":8,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.0820000000000001,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":1.0029999999999999,"15min":1.03},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1279999999999999,"5min":1.661,"15min":1.661},"last":0.75700000000000001}]},{"osd":10,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.97499999999999998,"15min":0.97899999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":3.1389999999999998,"5min":3.1389999999999998,"15min":3.1389999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.93000000000000005,"15min":0.93700000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.83399999999999996}]}]},{"osd":8,"up_from":60,"seq":257698037802,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6559999999999999,"5min":1.855,"15min":1.855},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6220000000000001,"5min":1.847,"15min":1.847},"last":0.51700000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.52800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.748},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.746,"15min":0.73499999999999999},"min":{"1min":0.625,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.024,"5min":1.802,"15min":1.802},"last":0.95899999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.628,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1200000000000001,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.621}]},{"osd":3,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.90300000000000002,"15min":0.97799999999999998},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5249999999999999,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82899999999999996,"15min":0.85999999999999999},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.48,"5min":1.825,"15min":1.825},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.137,"5min":1.3,"15min":1.3},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.80100000000000005,"15min":0.81000000000000005},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94599999999999995,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.99399999999999999}]},{"osd":5,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75800000000000001,"15min":0.78400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0720000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.93700000000000006},"min":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.575,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.92600000000000005,"15min":0.95099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1899999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.004}]},{"osd":7,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.014,"5min":1.73,"15min":1.73},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.92400000000000004,"15min":0.93500000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2490000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.0269999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.93400000000000005,"15min":0.94599999999999995},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0549999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.018},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.88700000000000001,"15min":0.89100000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0429999999999999,"5min":1.133,"15min":1.133},"last":0.92500000000000004}]},{"osd":10,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":0.90100000000000002,"15min":0.88100000000000001},"min":{"1min":0.64800000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2709999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.877,"15min":0.86599999999999999},"min":{"1min":0.68799999999999994,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1519999999999999,"5min":1.161,"15min":1.161},"last":0.876}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]}]},{"osd":7,"up_from":52,"seq":223338299439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":1011712,"data_stored":1050450,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.373,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69999999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.66800000000000004}]},{"osd":2,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73099999999999998,"15min":0.746},"min":{"1min":0.55700000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":1.016},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.745,"15min":0.73799999999999999},"min":{"1min":0.55400000000000005,"5min":0.432,"15min":0.432},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.54400000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69899999999999995,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.018,"5min":1.169,"15min":1.169},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.70499999999999996,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90500000000000003,"5min":1.012,"15min":1.012},"last":0.70399999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.82999999999999996,"15min":0.84799999999999998},"min":{"1min":0.59599999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.036,"5min":1.073,"15min":1.073},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.81200000000000006,"15min":0.83999999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Jul 14 12:58:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.84599999999999997,"15min":0.85599999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1279999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.877,"15min":0.877},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.92800000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.82799999999999996,"15min":0.80400000000000005},"min":{"1min":0.69399999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83599999999999997,"15min":0.82599999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.0409999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85099999999999998,"15min":0.84699999999999998},"min":{"1min":0.73999999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0669999999999999,"5min":1.105,"15min":1.105},"last":0.879},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.1499999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.83999999999999997}]},{"osd":10,"last update":"Fri Jul 14 12:58:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.90900000000000003,"15min":0.92400000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.135},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.92800000000000005,"15min":0.93300000000000005},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.204,"5min":1.276,"15min":1.276},"last":0.90500000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":6,"up_from":47,"seq":201863462964,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":458807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.51800000000000002,"15min":0.50700000000000001},"min":{"1min":0.35299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.435},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.373,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73899999999999999,"15min":0.71699999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0960000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77000000000000002,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":4.0759999999999996,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.94799999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.752}]},{"osd":3,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.997,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.69399999999999995},"min":{"1min":0.48399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.52500000000000002}]},{"osd":4,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.72999999999999998,"15min":0.72499999999999998},"min":{"1min":0.53100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.85199999999999998},"min":{"1min":0.63700000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.77700000000000002}]},{"osd":5,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.81699999999999995,"15min":0.81499999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Jul 14 12:58:01 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.85599999999999998,"15min":0.83399999999999996},"min":{"1min":0.63700000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.83399999999999996,"15min":0.81999999999999995},"min":{"1min":0.625,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.86599999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.89600000000000002,"15min":0.91700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93200000000000005,"15min":0.94999999999999996},"min":{"1min":0.72399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.76500000000000001}]},{"osd":9,"last update":"Fri Jul 14 12:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.91400000000000003,"15min":0.92500000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.97099999999999997,"15min":0.98599999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.69899999999999995}]},{"osd":10,"last update":"Fri Jul 14 12:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.089,"15min":1.1100000000000001},"min":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7430000000000001,"5min":4.109,"15min":4.109},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.016,"5min":0.95699999999999996,"15min":0.94699999999999995},"min":{"1min":0.73899999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.83099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":1007616,"data_stored":517433,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:24 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60299999999999998,"15min":0.56499999999999995},"min":{"1min":0.441,"5min":0.38800000000000001,"15min":0.37},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64800000000000002,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.40799999999999997,"15min":0.40500000000000003},"max":{"1min":1.1950000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:57:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.70799999999999996,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0069999999999999,"5min":1.131,"15min":1.131},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67400000000000004,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97399999999999998,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.86599999999999999}]},{"osd":3,"last update":"Fri Jul 14 12:58:20 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.67700000000000005,"15min":0.65800000000000003},"min":{"1min":0.57499999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99399999999999999,"5min":0.997,"15min":0.997},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.70999999999999996},"min":{"1min":0.59199999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99199999999999999,"5min":1.145,"15min":1.145},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Jul 14 12:57:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.56899999999999995,"15min":0.53300000000000003},"min":{"1min":0.41799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":1.079,"15min":1.079},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84699999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Jul 14 12:58:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.70899999999999996,"15min":0.67300000000000004},"min":{"1min":0.49099999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.53300000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0349999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72499999999999998,"15min":0.70299999999999996},"min":{"1min":0.64000000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.002,"5min":1.036,"15min":1.036},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.874,"5min":0.81100000000000005,"15min":0.78600000000000003},"min":{"1min":0.66000000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:58:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.52200000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1519999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.68600000000000005,"15min":0.63600000000000001},"min":{"1min":0.40000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.0389999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.83899999999999997,"15min":0.80300000000000005},"min":{"1min":0.71999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.006,"5min":0.91100000000000003,"15min":0.875},"min":{"1min":0.61699999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.1559999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.073}]},{"osd":9,"last update":"Fri Jul 14 12:57:58 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.85599999999999998,"15min":0.86599999999999999},"min":{"1min":0.63,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95599999999999996,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.998,"15min":1.006},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.91900000000000004}]},{"osd":10,"last update":"Fri Jul 14 12:58:24 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.046,"15min":1.048},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.23,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.022},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.63800000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":1.0549999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":974848,"data_stored":460072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.66400000000000003,"15min":0.61099999999999999},"min":{"1min":0.40699999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.0069999999999997,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.69699999999999995,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":6.8099999999999996,"5min":6.8099999999999996,"15min":6.8099999999999996},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:57:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66200000000000003,"15min":0.625},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65800000000000003,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88200000000000001,"5min":1.133,"15min":1.133},"last":0.746}]},{"osd":3,"last update":"Fri Jul 14 12:56:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70799999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.437},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.57999999999999996,"15min":0.55400000000000005},"min":{"1min":0.40999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.68700000000000006},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0720000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69599999999999995,"15min":0.67200000000000004},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.873,"5min":1.121,"15min":1.121},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.749,"15min":0.71199999999999997},"min":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.2830000000000004,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.78300000000000003,"15min":0.755},"min":{"1min":0.50800000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.1769999999999996,"5min":4.1769999999999996,"15min":4.1769999999999996},"last":1.085}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.66100000000000003,"15min":0.68500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.077},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.94699999999999995,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.83099999999999996}]},{"osd":7,"last update":"Fri Jul 14 12:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1200000000000001,"5min":1.155,"15min":1.155},"last":0.751},{"interface":"front","average":{"1min":0.873,"5min":0.79700000000000004,"15min":0.78400000000000003},"min":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.61799999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.60999999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.3239999999999998,"5min":4.3239999999999998,"15min":4.3239999999999998},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.89100000000000001,"15min":0.88900000000000001},"min":{"1min":0.65000000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":1.0089999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.871,"15min":0.90700000000000003},"min":{"1min":0.438,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98899999999999999,"5min":1.175,"15min":1.175},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.879,"15min":0.91100000000000003},"min":{"1min":0.45300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.153,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.92200000000000004}]},{"osd":10,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.93300000000000005,"15min":0.92100000000000004},"min":{"1min":0.502,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":4.0579999999999998,"5min":4.0579999999999998,"15min":4.0579999999999998},"last":1.171},{"interface":"front","average":{"1min":1.125,"5min":0.95899999999999996,"15min":0.93100000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":6.992,"5min":6.992,"15min":6.992},"last":1.0669999999999999}]},{"osd":11,"last update":"Fri Jul 14 12:57:47 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.123},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.1930000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":1019904,"data_stored":518589,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.45600000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.47499999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.91600000000000004,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59299999999999997}]},{"osd":1,"last update":"Fri Jul 14 12:57:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.51700000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0549999999999999,"5min":1.819,"15min":1.819},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64600000000000002,"15min":0.64400000000000002},"min":{"1min":0.54800000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":1.841,"15min":1.841},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":0.78500000000000003,"15min":0.72799999999999998},"min":{"1min":0.46700000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":6.4779999999999998,"5min":6.4779999999999998,"15min":6.4779999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70199999999999996,"15min":0.70099999999999996},"min":{"1min":0.49199999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.73499999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.48199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66000000000000003,"15min":0.66300000000000003},"min":{"1min":0.55100000000000005,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89100000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.89700000000000002}]},{"osd":5,"last update":"Fri Jul 14 12:58:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.49199999999999999},"min":{"1min":0.46600000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.56999999999999995,"15min":0.52500000000000002},"min":{"1min":0.44600000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.752}]},{"osd":6,"last update":"Fri Jul 14 12:57:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.73699999999999999,"15min":0.72799999999999998},"min":{"1min":0.57999999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.747,"15min":0.72899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.69299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77800000000000002}]},{"osd":8,"last update":"Fri Jul 14 12:58:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.745,"15min":0.73299999999999998},"min":{"1min":0.58499999999999996,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1,"5min":1.222,"15min":1.222},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.751,"15min":0.72699999999999998},"min":{"1min":0.58899999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.095,"5min":1.133,"15min":1.133},"last":0.94399999999999995}]},{"osd":9,"last update":"Fri Jul 14 12:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.82099999999999995,"15min":0.80700000000000005},"min":{"1min":0.66200000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.82399999999999995,"15min":0.81399999999999995},"min":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2390000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.64600000000000002}]},{"osd":10,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85899999999999999,"15min":0.85199999999999998},"min":{"1min":0.67400000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.099,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.89200000000000002,"15min":0.876},"min":{"1min":0.73199999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.92000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":3,"up_from":26,"seq":111669149764,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":458793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.46300000000000002,"15min":0.42699999999999999},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.442},{"interface":"front","average":{"1min":0.63,"5min":0.499,"15min":0.45500000000000002},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71699999999999997,"15min":0.66900000000000004},"min":{"1min":0.432,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.087,"5min":6.867,"15min":6.867},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.79700000000000004,"15min":0.69299999999999995},"min":{"1min":0.57499999999999996,"5min":0.436,"15min":0.436},"max":{"1min":4.21,"5min":6.8860000000000001,"15min":6.8860000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.71699999999999997,"15min":0.67900000000000005},"min":{"1min":0.51900000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.69099999999999995},"min":{"1min":0.48799999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.135,"5min":6.9020000000000001,"15min":6.9020000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:57:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.77900000000000003,"15min":0.71899999999999997},"min":{"1min":0.48799999999999999,"5min":0.432,"15min":0.432},"max":{"1min":6.8419999999999996,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72899999999999998,"15min":0.70899999999999996},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.109,"5min":1.119,"15min":1.119},"last":0.79000000000000004}]},{"osd":5,"last update":"Fri Jul 14 12:58:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73499999999999999},"min":{"1min":0.55600000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0169999999999999,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.874}]},{"osd":6,"last update":"Fri Jul 14 12:57:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.69699999999999995,"15min":0.66100000000000003},"min":{"1min":0.56299999999999994,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0900000000000001,"5min":1.214,"15min":1.214},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68899999999999995,"15min":0.66200000000000003},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.103,"15min":1.103},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:58:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77500000000000002,"15min":0.76400000000000001},"min":{"1min":0.59899999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.95799999999999996,"5min":1.131,"15min":1.131},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.80400000000000005,"15min":0.77500000000000002},"min":{"1min":0.66800000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.81999999999999995}]},{"osd":8,"last update":"Fri Jul 14 12:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2010000000000001,"5min":1.206,"15min":1.206},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1859999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.80500000000000005}]},{"osd":9,"last update":"Fri Jul 14 12:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.92000000000000004,"15min":0.93400000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.82099999999999995,"15min":0.82999999999999996},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0289999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.69499999999999995}]},{"osd":10,"last update":"Fri Jul 14 12:58:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90500000000000003,"15min":0.90300000000000002},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.94899999999999995,"15min":0.94699999999999995},"min":{"1min":0.68500000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.68500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]}]},{"osd":4,"up_from":34,"seq":146028888126,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77600000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.46200000000000002},"min":{"1min":0.30199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.45700000000000002},"min":{"1min":0.35499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79000000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.501}]},{"osd":2,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70899999999999996,"15min":0.67700000000000005},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.998,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.47899999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95499999999999996,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.80000000000000004}]},{"osd":3,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67900000000000005,"15min":0.66200000000000003},"min":{"1min":0.44400000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97399999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65800000000000003,"15min":0.64600000000000002},"min":{"1min":0.43099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92500000000000004,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:58:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71099999999999997,"15min":0.68899999999999995},"min":{"1min":0.52000000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.751},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71899999999999997,"15min":0.69699999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.89900000000000002}]},{"osd":6,"last update":"Fri Jul 14 12:57:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77600000000000002,"15min":0.77200000000000002},"min":{"1min":0.55800000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93200000000000005,"5min":1.093,"15min":1.093},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.042,"5min":1.282,"15min":1.282},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Jul 14 12:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68899999999999995,"15min":0.69499999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90000000000000002,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.47399999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97999999999999998,"5min":1.129,"15min":1.129},"last":0.94199999999999995}]},{"osd":8,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.875,"15min":0.86499999999999999},"min":{"1min":0.65900000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.143,"5min":1.234,"15min":1.234},"last":1.024}]},{"osd":9,"last update":"Fri Jul 14 12:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.871,"15min":0.876},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.105,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.68700000000000006}]},{"osd":10,"last update":"Fri Jul 14 12:58:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92600000000000005,"15min":0.92200000000000004},"min":{"1min":0.67700000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1919999999999999,"5min":1.337,"15min":1.337},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.81999999999999995,"15min":0.80900000000000005},"min":{"1min":0.56399999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.64600000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724602,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":1028096,"data_stored":1050513,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79700000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.436,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88200000000000001,"5min":0.997,"15min":0.997},"last":0.439}]},{"osd":1,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66900000000000004,"15min":0.621},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65700000000000003,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.497},"min":{"1min":0.34999999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.746,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.505,"15min":0.47599999999999998},"min":{"1min":0.34899999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83899999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.441,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77300000000000002,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.52800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.248,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:58:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.72499999999999998,"15min":0.66900000000000004},"min":{"1min":0.497,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71999999999999997,"15min":0.69799999999999995},"min":{"1min":0.44700000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.075,"5min":1.139,"15min":1.139},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76000000000000001,"15min":0.75700000000000001},"min":{"1min":0.56399999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98799999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.627},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.55400000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93300000000000005,"5min":1.28,"15min":1.28},"last":0.73699999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:58:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.83099999999999996,"15min":0.84899999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.087,"5min":1.236,"15min":1.236},"last":0.83299999999999996}]},{"osd":8,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.88100000000000001}]},{"osd":9,"last update":"Fri Jul 14 12:57:59 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.872,"15min":0.871},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85199999999999998,"15min":0.84599999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.86599999999999999}]},{"osd":10,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.86799999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.874,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.92200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34486,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59112,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":60268,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60642,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:58:39.917 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-07-14T12:58:39.917 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-14T12:58:39.918 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-07-14T12:58:39.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph health --format=json 2023-07-14T12:58:40.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:40 smithi017 ceph-mon[95536]: pgmap v334: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:40.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:40 smithi135 ceph-mon[97338]: pgmap v334: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:40.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:40 smithi131 ceph-mon[96953]: pgmap v334: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:40.684 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:41.303 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:41 smithi017 ceph-mon[95536]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:58:41.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:41 smithi135 ceph-mon[97338]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:58:41.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:41 smithi131 ceph-mon[96953]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:58:42.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.286+0000 7f185b5b0700 1 -- 172.21.15.17:0/103091069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1854104ea0 msgr2=0x7f185410ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:42.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.286+0000 7f185b5b0700 1 --2- 172.21.15.17:0/103091069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1854104ea0 0x7f185410ca20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f184c00b0d0 tx=0x7f184c00b3e0 comp rx=0 tx=0).stop 2023-07-14T12:58:42.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.286+0000 7f185b5b0700 1 -- 172.21.15.17:0/103091069 shutdown_connections 2023-07-14T12:58:42.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.286+0000 7f185b5b0700 1 --2- 172.21.15.17:0/103091069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1854104ea0 0x7f185410ca20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:42.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.286+0000 7f185b5b0700 1 --2- 172.21.15.17:0/103091069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540ffe00 0x7f18541001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:42.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.286+0000 7f185b5b0700 1 --2- 172.21.15.17:0/103091069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18541007a0 0x7f1854104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:42.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.286+0000 7f185b5b0700 1 -- 172.21.15.17:0/103091069 >> 172.21.15.17:0/103091069 conn(0x7f18540fb660 msgr2=0x7f18540fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:42.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.286+0000 7f185b5b0700 1 -- 172.21.15.17:0/103091069 shutdown_connections 2023-07-14T12:58:42.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.286+0000 7f185b5b0700 1 -- 172.21.15.17:0/103091069 wait complete. 2023-07-14T12:58:42.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.287+0000 7f185b5b0700 1 Processor -- start 2023-07-14T12:58:42.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.287+0000 7f185b5b0700 1 -- start start 2023-07-14T12:58:42.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.287+0000 7f185b5b0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540ffe00 0x7f1854072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:42.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.287+0000 7f185b5b0700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18541007a0 0x7f1854072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:42.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.287+0000 7f185b5b0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1854104ea0 0x7f18540732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:42.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.287+0000 7f185b5b0700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18541a40e0 con 0x7f18541007a0 2023-07-14T12:58:42.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.287+0000 7f185b5b0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18541a4250 con 0x7f1854104ea0 2023-07-14T12:58:42.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.287+0000 7f185b5b0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18541a4410 con 0x7f18540ffe00 2023-07-14T12:58:42.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.288+0000 7f1858b4b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18541007a0 0x7f1854072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:42.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.288+0000 7f1858b4b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18541007a0 0x7f1854072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49438/0 (socket says 172.21.15.17:49438) 2023-07-14T12:58:42.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.288+0000 7f1858b4b700 1 -- 172.21.15.17:0/511299076 learned_addr learned my addr 172.21.15.17:0/511299076 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:42.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.288+0000 7f185934c700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540ffe00 0x7f1854072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:42.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.288+0000 7f1859b4d700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1854104ea0 0x7f18540732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:42.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.288+0000 7f1858b4b700 1 -- 172.21.15.17:0/511299076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540ffe00 msgr2=0x7f1854072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:42.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.288+0000 7f1858b4b700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540ffe00 0x7f1854072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:42.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.288+0000 7f1858b4b700 1 -- 172.21.15.17:0/511299076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1854104ea0 msgr2=0x7f18540732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:42.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.288+0000 7f1858b4b700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1854104ea0 0x7f18540732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:42.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.288+0000 7f1858b4b700 1 -- 172.21.15.17:0/511299076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c009d00 con 0x7f18541007a0 2023-07-14T12:58:42.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.289+0000 7f1858b4b700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18541007a0 0x7f1854072d50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f184400e970 tx=0x7f184400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:42.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.289+0000 7f184a7fc700 1 -- 172.21.15.17:0/511299076 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844009790 con 0x7f18541007a0 2023-07-14T12:58:42.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.289+0000 7f184a7fc700 1 -- 172.21.15.17:0/511299076 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f184400eec0 con 0x7f18541007a0 2023-07-14T12:58:42.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.289+0000 7f185b5b0700 1 -- 172.21.15.17:0/511299076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18541a46f0 con 0x7f18541007a0 2023-07-14T12:58:42.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.289+0000 7f184a7fc700 1 -- 172.21.15.17:0/511299076 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440054b0 con 0x7f18541007a0 2023-07-14T12:58:42.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.289+0000 7f185b5b0700 1 -- 172.21.15.17:0/511299076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18541a4bf0 con 0x7f18541007a0 2023-07-14T12:58:42.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.290+0000 7f185b5b0700 1 -- 172.21.15.17:0/511299076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185404e210 con 0x7f18541007a0 2023-07-14T12:58:42.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.292+0000 7f184a7fc700 1 -- 172.21.15.17:0/511299076 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f1844004750 con 0x7f18541007a0 2023-07-14T12:58:42.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.293+0000 7f184a7fc700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18400a11e0 0x7f18400a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:42.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.293+0000 7f184a7fc700 1 -- 172.21.15.17:0/511299076 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f1844014070 con 0x7f18541007a0 2023-07-14T12:58:42.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.294+0000 7f185934c700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18400a11e0 0x7f18400a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:42.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.294+0000 7f185934c700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18400a11e0 0x7f18400a3690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1850005950 tx=0x7f185000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.297+0000 7f184a7fc700 1 -- 172.21.15.17:0/511299076 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1844096240 con 0x7f18541007a0 2023-07-14T12:58:42.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:42 smithi017 ceph-mon[95536]: pgmap v335: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:42.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:42 smithi135 ceph-mon[97338]: pgmap v335: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:42.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:42 smithi131 ceph-mon[96953]: pgmap v335: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:42.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.550+0000 7f185b5b0700 1 -- 172.21.15.17:0/511299076 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1854073d40 con 0x7f18541007a0 2023-07-14T12:58:42.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.550+0000 7f184a7fc700 1 -- 172.21.15.17:0/511299076 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1844099860 con 0x7f18541007a0 2023-07-14T12:58:42.580 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:58:42.581 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-14T12:58:42.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 -- 172.21.15.17:0/511299076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18400a11e0 msgr2=0x7f18400a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:42.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18400a11e0 0x7f18400a3690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1850005950 tx=0x7f185000b410 comp rx=0 tx=0).stop 2023-07-14T12:58:42.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 -- 172.21.15.17:0/511299076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18541007a0 msgr2=0x7f1854072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:42.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18541007a0 0x7f1854072d50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f184400e970 tx=0x7f184400ec80 comp rx=0 tx=0).stop 2023-07-14T12:58:42.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 -- 172.21.15.17:0/511299076 shutdown_connections 2023-07-14T12:58:42.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f18400a11e0 0x7f18400a3690 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:42.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1854104ea0 0x7f18540732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:42.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18540ffe00 0x7f1854072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 --2- 172.21.15.17:0/511299076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18541007a0 0x7f1854072d50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 -- 172.21.15.17:0/511299076 >> 172.21.15.17:0/511299076 conn(0x7f18540fb660 msgr2=0x7f18540fc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 -- 172.21.15.17:0/511299076 shutdown_connections 2023-07-14T12:58:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:42.553+0000 7f185b5b0700 1 -- 172.21.15.17:0/511299076 wait complete. 2023-07-14T12:58:43.066 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-07-14T12:58:43.067 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:58:43.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.246+0000 7f69a49ff700 1 -- 172.21.15.17:0/1914171786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00ffb00 msgr2=0x7f69a00fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:43.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.246+0000 7f69a49ff700 1 --2- 172.21.15.17:0/1914171786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00ffb00 0x7f69a00fff10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6990009990 tx=0x7f6990009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.246+0000 7f69a49ff700 1 -- 172.21.15.17:0/1914171786 shutdown_connections 2023-07-14T12:58:43.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.246+0000 7f69a49ff700 1 --2- 172.21.15.17:0/1914171786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69a0101680 0x7f69a0107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.246+0000 7f69a49ff700 1 --2- 172.21.15.17:0/1914171786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00ffb00 0x7f69a00fff10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.246+0000 7f69a49ff700 1 --2- 172.21.15.17:0/1914171786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69a0100cf0 0x7f69a0101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.246+0000 7f69a49ff700 1 -- 172.21.15.17:0/1914171786 >> 172.21.15.17:0/1914171786 conn(0x7f69a00fb0e0 msgr2=0x7f69a00fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:43.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.246+0000 7f69a49ff700 1 -- 172.21.15.17:0/1914171786 shutdown_connections 2023-07-14T12:58:43.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.246+0000 7f69a49ff700 1 -- 172.21.15.17:0/1914171786 wait complete. 2023-07-14T12:58:43.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.247+0000 7f69a49ff700 1 Processor -- start 2023-07-14T12:58:43.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.247+0000 7f69a49ff700 1 -- start start 2023-07-14T12:58:43.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f69a49ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00ffb00 0x7f69a0197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:43.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f69a49ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69a0100cf0 0x7f69a0197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:43.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f69a49ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69a0101680 0x7f69a019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f69a49ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a019f500 con 0x7f69a00ffb00 2023-07-14T12:58:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f69a49ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a019f640 con 0x7f69a0101680 2023-07-14T12:58:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f69a49ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a019f7d0 con 0x7f69a0100cf0 2023-07-14T12:58:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f699e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00ffb00 0x7f69a0197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f699e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00ffb00 0x7f69a0197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49446/0 (socket says 172.21.15.17:49446) 2023-07-14T12:58:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f699e59c700 1 -- 172.21.15.17:0/1210193498 learned_addr learned my addr 172.21.15.17:0/1210193498 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f699dd9b700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69a0100cf0 0x7f69a0197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f699ed9d700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69a0101680 0x7f69a019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f699e59c700 1 -- 172.21.15.17:0/1210193498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69a0100cf0 msgr2=0x7f69a0197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f699e59c700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69a0100cf0 0x7f69a0197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f699e59c700 1 -- 172.21.15.17:0/1210193498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69a0101680 msgr2=0x7f69a019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f699e59c700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69a0101680 0x7f69a019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.248+0000 7f699e59c700 1 -- 172.21.15.17:0/1210193498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69900095f0 con 0x7f69a00ffb00 2023-07-14T12:58:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.249+0000 7f699e59c700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00ffb00 0x7f69a0197980 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f69900098e0 tx=0x7f6990004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.249+0000 7f698f7fe700 1 -- 172.21.15.17:0/1210193498 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699001d070 con 0x7f69a00ffb00 2023-07-14T12:58:43.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.249+0000 7f698f7fe700 1 -- 172.21.15.17:0/1210193498 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f699000bdd0 con 0x7f69a00ffb00 2023-07-14T12:58:43.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.249+0000 7f69a49ff700 1 -- 172.21.15.17:0/1210193498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a019fa50 con 0x7f69a00ffb00 2023-07-14T12:58:43.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.249+0000 7f698f7fe700 1 -- 172.21.15.17:0/1210193498 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990022d80 con 0x7f69a00ffb00 2023-07-14T12:58:43.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.249+0000 7f69a49ff700 1 -- 172.21.15.17:0/1210193498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a019fed0 con 0x7f69a00ffb00 2023-07-14T12:58:43.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.250+0000 7f69a49ff700 1 -- 172.21.15.17:0/1210193498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a0192090 con 0x7f69a00ffb00 2023-07-14T12:58:43.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.252+0000 7f698f7fe700 1 -- 172.21.15.17:0/1210193498 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f6990022470 con 0x7f69a00ffb00 2023-07-14T12:58:43.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.254+0000 7f698f7fe700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f69880a12a0 0x7f69880a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:43.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.254+0000 7f698f7fe700 1 -- 172.21.15.17:0/1210193498 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f69900cdef0 con 0x7f69a00ffb00 2023-07-14T12:58:43.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.254+0000 7f699dd9b700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f69880a12a0 0x7f69880a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:43.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.255+0000 7f699dd9b700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f69880a12a0 0x7f69880a3750 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6994009c60 tx=0x7f6994009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:43.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.258+0000 7f698f7fe700 1 -- 172.21.15.17:0/1210193498 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6990097540 con 0x7f69a00ffb00 2023-07-14T12:58:43.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:43 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/511299076' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-14T12:58:43.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:43 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/511299076' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-14T12:58:43.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:43 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/511299076' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-14T12:58:43.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.473+0000 7f69a49ff700 1 -- 172.21.15.17:0/1210193498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69a002caa0 con 0x7f69a00ffb00 2023-07-14T12:58:43.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.475+0000 7f698f7fe700 1 -- 172.21.15.17:0/1210193498 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22469 (secure 0 0 0) 0x7f699009ab60 con 0x7f69a00ffb00 2023-07-14T12:58:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:58:43.506 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":88,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:58:07.945460+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:58:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 -- 172.21.15.17:0/1210193498 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f69880a12a0 msgr2=0x7f69880a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f69880a12a0 0x7f69880a3750 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6994009c60 tx=0x7f6994009260 comp rx=0 tx=0).stop 2023-07-14T12:58:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 -- 172.21.15.17:0/1210193498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00ffb00 msgr2=0x7f69a0197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00ffb00 0x7f69a0197980 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f69900098e0 tx=0x7f6990004730 comp rx=0 tx=0).stop 2023-07-14T12:58:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 -- 172.21.15.17:0/1210193498 shutdown_connections 2023-07-14T12:58:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f69880a12a0 0x7f69880a3750 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69a0101680 0x7f69a019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00ffb00 0x7f69a0197980 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 --2- 172.21.15.17:0/1210193498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69a0100cf0 0x7f69a0197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 -- 172.21.15.17:0/1210193498 >> 172.21.15.17:0/1210193498 conn(0x7f69a00fb0e0 msgr2=0x7f69a0106630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 -- 172.21.15.17:0/1210193498 shutdown_connections 2023-07-14T12:58:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.479+0000 7f69a49ff700 1 -- 172.21.15.17:0/1210193498 wait complete. 2023-07-14T12:58:43.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:57:37.876360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:57:39.117456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:58:43.537 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:58:43.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.719+0000 7f17691ff700 1 -- 172.21.15.17:0/3571767579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1764101660 msgr2=0x7f1764107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:43.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.719+0000 7f17691ff700 1 --2- 172.21.15.17:0/3571767579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1764101660 0x7f1764107f20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f175c00b0a0 tx=0x7f175c00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.719+0000 7f17691ff700 1 -- 172.21.15.17:0/3571767579 shutdown_connections 2023-07-14T12:58:43.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.719+0000 7f17691ff700 1 --2- 172.21.15.17:0/3571767579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1764101660 0x7f1764107f20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.719+0000 7f17691ff700 1 --2- 172.21.15.17:0/3571767579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17640ffae0 0x7f17640ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.719+0000 7f17691ff700 1 --2- 172.21.15.17:0/3571767579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1764100cd0 0x7f1764101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.719+0000 7f17691ff700 1 -- 172.21.15.17:0/3571767579 >> 172.21.15.17:0/3571767579 conn(0x7f17640fb0e0 msgr2=0x7f17640fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:43.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.719+0000 7f17691ff700 1 -- 172.21.15.17:0/3571767579 shutdown_connections 2023-07-14T12:58:43.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.719+0000 7f17691ff700 1 -- 172.21.15.17:0/3571767579 wait complete. 2023-07-14T12:58:43.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.721+0000 7f17691ff700 1 Processor -- start 2023-07-14T12:58:43.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.721+0000 7f17691ff700 1 -- start start 2023-07-14T12:58:43.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.721+0000 7f17691ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17640ffae0 0x7f1764197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:43.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.721+0000 7f17691ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1764100cd0 0x7f1764198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:43.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.721+0000 7f17691ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1764101660 0x7f176419f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:43.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.721+0000 7f17691ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176419f640 con 0x7f17640ffae0 2023-07-14T12:58:43.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.721+0000 7f17691ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176419f780 con 0x7f1764100cd0 2023-07-14T12:58:43.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.721+0000 7f17691ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176419f910 con 0x7f1764101660 2023-07-14T12:58:43.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.722+0000 7f1762d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17640ffae0 0x7f1764197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:43.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.722+0000 7f1762d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17640ffae0 0x7f1764197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49454/0 (socket says 172.21.15.17:49454) 2023-07-14T12:58:43.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.722+0000 7f1762d9d700 1 -- 172.21.15.17:0/2676588488 learned_addr learned my addr 172.21.15.17:0/2676588488 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:43.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.722+0000 7f176259c700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1764100cd0 0x7f1764198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:43.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.722+0000 7f176359e700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1764101660 0x7f176419f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:43.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.722+0000 7f1762d9d700 1 -- 172.21.15.17:0/2676588488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1764101660 msgr2=0x7f176419f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:43.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.722+0000 7f1762d9d700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1764101660 0x7f176419f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.722+0000 7f1762d9d700 1 -- 172.21.15.17:0/2676588488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1764100cd0 msgr2=0x7f1764198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:43.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.722+0000 7f1762d9d700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1764100cd0 0x7f1764198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.722+0000 7f1762d9d700 1 -- 172.21.15.17:0/2676588488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009d00 con 0x7f17640ffae0 2023-07-14T12:58:43.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.722+0000 7f1762d9d700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17640ffae0 0x7f1764197ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f175400e970 tx=0x7f175400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.723+0000 7f174bfff700 1 -- 172.21.15.17:0/2676588488 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754009790 con 0x7f17640ffae0 2023-07-14T12:58:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.723+0000 7f174bfff700 1 -- 172.21.15.17:0/2676588488 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f175400c7e0 con 0x7f17640ffae0 2023-07-14T12:58:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.723+0000 7f17691ff700 1 -- 172.21.15.17:0/2676588488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176419fbf0 con 0x7f17640ffae0 2023-07-14T12:58:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.723+0000 7f174bfff700 1 -- 172.21.15.17:0/2676588488 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754003bd0 con 0x7f17640ffae0 2023-07-14T12:58:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.723+0000 7f17691ff700 1 -- 172.21.15.17:0/2676588488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17641a0150 con 0x7f17640ffae0 2023-07-14T12:58:43.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.724+0000 7f17691ff700 1 -- 172.21.15.17:0/2676588488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176410b1c0 con 0x7f17640ffae0 2023-07-14T12:58:43.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.726+0000 7f174bfff700 1 -- 172.21.15.17:0/2676588488 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f175400c950 con 0x7f17640ffae0 2023-07-14T12:58:43.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.727+0000 7f174bfff700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f174c0a1260 0x7f174c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:43.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.727+0000 7f174bfff700 1 -- 172.21.15.17:0/2676588488 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f1754014070 con 0x7f17640ffae0 2023-07-14T12:58:43.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.728+0000 7f176259c700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f174c0a1260 0x7f174c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:43.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.728+0000 7f176259c700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f174c0a1260 0x7f174c0a3710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1758009c60 tx=0x7f1758009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:43.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.731+0000 7f174bfff700 1 -- 172.21.15.17:0/2676588488 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f17540961f0 con 0x7f17640ffae0 2023-07-14T12:58:43.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.954+0000 7f17691ff700 1 -- 172.21.15.17:0/2676588488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17641a0700 con 0x7f17640ffae0 2023-07-14T12:58:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.955+0000 7f174bfff700 1 -- 172.21.15.17:0/2676588488 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1754099810 con 0x7f17640ffae0 2023-07-14T12:58:43.984 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T12:58:43.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 -- 172.21.15.17:0/2676588488 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f174c0a1260 msgr2=0x7f174c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:43.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f174c0a1260 0x7f174c0a3710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1758009c60 tx=0x7f1758009260 comp rx=0 tx=0).stop 2023-07-14T12:58:43.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 -- 172.21.15.17:0/2676588488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17640ffae0 msgr2=0x7f1764197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17640ffae0 0x7f1764197ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f175400e970 tx=0x7f175400ec80 comp rx=0 tx=0).stop 2023-07-14T12:58:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 -- 172.21.15.17:0/2676588488 shutdown_connections 2023-07-14T12:58:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f174c0a1260 0x7f174c0a3710 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1764101660 0x7f176419f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17640ffae0 0x7f1764197ac0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 --2- 172.21.15.17:0/2676588488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1764100cd0 0x7f1764198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:43.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 -- 172.21.15.17:0/2676588488 >> 172.21.15.17:0/2676588488 conn(0x7f17640fb0e0 msgr2=0x7f17640fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:43.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 -- 172.21.15.17:0/2676588488 shutdown_connections 2023-07-14T12:58:43.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:43.957+0000 7f17691ff700 1 -- 172.21.15.17:0/2676588488 wait complete. 2023-07-14T12:58:44.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:58:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.194+0000 7fc3423ff700 1 -- 172.21.15.17:0/2343686380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc33c100d40 msgr2=0x7fc33c101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.194+0000 7fc3423ff700 1 --2- 172.21.15.17:0/2343686380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc33c100d40 0x7fc33c101190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc330009990 tx=0x7fc330009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.194+0000 7fc3423ff700 1 -- 172.21.15.17:0/2343686380 shutdown_connections 2023-07-14T12:58:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.194+0000 7fc3423ff700 1 --2- 172.21.15.17:0/2343686380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc33c1016d0 0x7fc33c107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.194+0000 7fc3423ff700 1 --2- 172.21.15.17:0/2343686380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33c0ffb50 0x7fc33c0fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.194+0000 7fc3423ff700 1 --2- 172.21.15.17:0/2343686380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc33c100d40 0x7fc33c101190 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.194+0000 7fc3423ff700 1 -- 172.21.15.17:0/2343686380 >> 172.21.15.17:0/2343686380 conn(0x7fc33c0fb170 msgr2=0x7fc33c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.194+0000 7fc3423ff700 1 -- 172.21.15.17:0/2343686380 shutdown_connections 2023-07-14T12:58:44.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.194+0000 7fc3423ff700 1 -- 172.21.15.17:0/2343686380 wait complete. 2023-07-14T12:58:44.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.196+0000 7fc3423ff700 1 Processor -- start 2023-07-14T12:58:44.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.196+0000 7fc3423ff700 1 -- start start 2023-07-14T12:58:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.196+0000 7fc3423ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc33c0ffb50 0x7fc33c0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.196+0000 7fc3423ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33c100d40 0x7fc33c072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.196+0000 7fc3423ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc33c1016d0 0x7fc33c072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.196+0000 7fc3423ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c0735e0 con 0x7fc33c1016d0 2023-07-14T12:58:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.196+0000 7fc3423ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c073750 con 0x7fc33c0ffb50 2023-07-14T12:58:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.196+0000 7fc3423ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c19f7e0 con 0x7fc33c100d40 2023-07-14T12:58:44.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc34099c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc33c1016d0 0x7fc33c072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:44.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc34099c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc33c1016d0 0x7fc33c072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49470/0 (socket says 172.21.15.17:49470) 2023-07-14T12:58:44.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc34099c700 1 -- 172.21.15.17:0/1796421667 learned_addr learned my addr 172.21.15.17:0/1796421667 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:44.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc33b7fe700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33c100d40 0x7fc33c072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:44.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc33bfff700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc33c0ffb50 0x7fc33c0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:44.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc34099c700 1 -- 172.21.15.17:0/1796421667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33c100d40 msgr2=0x7fc33c072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:44.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc34099c700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33c100d40 0x7fc33c072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc34099c700 1 -- 172.21.15.17:0/1796421667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc33c0ffb50 msgr2=0x7fc33c0742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:44.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc34099c700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc33c0ffb50 0x7fc33c0742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc34099c700 1 -- 172.21.15.17:0/1796421667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300095f0 con 0x7fc33c1016d0 2023-07-14T12:58:44.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc33bfff700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc33c0ffb50 0x7fc33c0742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:58:44.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc33b7fe700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33c100d40 0x7fc33c072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:58:44.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc34099c700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc33c1016d0 0x7fc33c072e40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc33400ef30 tx=0x7fc33400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:44.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc3397fa700 1 -- 172.21.15.17:0/1796421667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334018070 con 0x7fc33c1016d0 2023-07-14T12:58:44.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc3397fa700 1 -- 172.21.15.17:0/1796421667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc33400f040 con 0x7fc33c1016d0 2023-07-14T12:58:44.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc3423ff700 1 -- 172.21.15.17:0/1796421667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c19fa60 con 0x7fc33c1016d0 2023-07-14T12:58:44.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.197+0000 7fc3397fa700 1 -- 172.21.15.17:0/1796421667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334003d00 con 0x7fc33c1016d0 2023-07-14T12:58:44.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.198+0000 7fc3423ff700 1 -- 172.21.15.17:0/1796421667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c19ff20 con 0x7fc33c1016d0 2023-07-14T12:58:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.199+0000 7fc3423ff700 1 -- 172.21.15.17:0/1796421667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33c106b00 con 0x7fc33c1016d0 2023-07-14T12:58:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.201+0000 7fc3397fa700 1 -- 172.21.15.17:0/1796421667 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fc33400caa0 con 0x7fc33c1016d0 2023-07-14T12:58:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.202+0000 7fc3397fa700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc3240a11e0 0x7fc3240a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:44.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.202+0000 7fc3397fa700 1 -- 172.21.15.17:0/1796421667 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fc3340cc810 con 0x7fc33c1016d0 2023-07-14T12:58:44.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.202+0000 7fc33bfff700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc3240a11e0 0x7fc3240a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:44.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.203+0000 7fc33bfff700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc3240a11e0 0x7fc3240a3690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005fd0 tx=0x7fc32c005f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:44.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.206+0000 7fc3397fa700 1 -- 172.21.15.17:0/1796421667 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc334095e60 con 0x7fc33c1016d0 2023-07-14T12:58:44.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:44 smithi017 ceph-mon[95536]: pgmap v336: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:44.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:44 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:58:44.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:44 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1210193498' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:44.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:44 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2676588488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:58:44.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:44 smithi135 ceph-mon[97338]: pgmap v336: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:44.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:44 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:58:44.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:44 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1210193498' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:44.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:44 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2676588488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:58:44.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.429+0000 7fc3423ff700 1 -- 172.21.15.17:0/1796421667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc33c02caa0 con 0x7fc33c1016d0 2023-07-14T12:58:44.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.429+0000 7fc3397fa700 1 -- 172.21.15.17:0/1796421667 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc334099480 con 0x7fc33c1016d0 2023-07-14T12:58:44.459 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-07-14T12:58:44.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 -- 172.21.15.17:0/1796421667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc3240a11e0 msgr2=0x7fc3240a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:44.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc3240a11e0 0x7fc3240a3690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005fd0 tx=0x7fc32c005f00 comp rx=0 tx=0).stop 2023-07-14T12:58:44.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 -- 172.21.15.17:0/1796421667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc33c1016d0 msgr2=0x7fc33c072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc33c1016d0 0x7fc33c072e40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc33400ef30 tx=0x7fc33400c450 comp rx=0 tx=0).stop 2023-07-14T12:58:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 -- 172.21.15.17:0/1796421667 shutdown_connections 2023-07-14T12:58:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc3240a11e0 0x7fc3240a3690 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc33c1016d0 0x7fc33c072e40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc33c0ffb50 0x7fc33c0742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 --2- 172.21.15.17:0/1796421667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc33c100d40 0x7fc33c072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 -- 172.21.15.17:0/1796421667 >> 172.21.15.17:0/1796421667 conn(0x7fc33c0fb170 msgr2=0x7fc33c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:44.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 -- 172.21.15.17:0/1796421667 shutdown_connections 2023-07-14T12:58:44.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.432+0000 7fc3423ff700 1 -- 172.21.15.17:0/1796421667 wait complete. 2023-07-14T12:58:44.480 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:58:44.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:44 smithi131 ceph-mon[96953]: pgmap v336: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:44.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:44 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:58:44.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:44 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1210193498' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:44.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:44 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2676588488' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:58:44.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.666+0000 7f54151ff700 1 -- 172.21.15.17:0/2250448223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5410102f00 msgr2=0x7f5410103350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.666+0000 7f54151ff700 1 --2- 172.21.15.17:0/2250448223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5410102f00 0x7f5410103350 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5404009990 tx=0x7f5404009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.666+0000 7f54151ff700 1 -- 172.21.15.17:0/2250448223 shutdown_connections 2023-07-14T12:58:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.666+0000 7f54151ff700 1 --2- 172.21.15.17:0/2250448223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5410103890 0x7f541010a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.666+0000 7f54151ff700 1 --2- 172.21.15.17:0/2250448223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5410101d10 0x7f5410102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.666+0000 7f54151ff700 1 --2- 172.21.15.17:0/2250448223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5410102f00 0x7f5410103350 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.666+0000 7f54151ff700 1 -- 172.21.15.17:0/2250448223 >> 172.21.15.17:0/2250448223 conn(0x7f54100fd350 msgr2=0x7f54100ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:44.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.666+0000 7f54151ff700 1 -- 172.21.15.17:0/2250448223 shutdown_connections 2023-07-14T12:58:44.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.666+0000 7f54151ff700 1 -- 172.21.15.17:0/2250448223 wait complete. 2023-07-14T12:58:44.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.667+0000 7f54151ff700 1 Processor -- start 2023-07-14T12:58:44.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.667+0000 7f54151ff700 1 -- start start 2023-07-14T12:58:44.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f54151ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5410101d10 0x7f54101979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:44.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f54151ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5410102f00 0x7f5410197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:44.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f54151ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5410103890 0x7f541019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:44.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f54151ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541019f550 con 0x7f5410103890 2023-07-14T12:58:44.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f54151ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541019f690 con 0x7f5410102f00 2023-07-14T12:58:44.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f54151ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541019f820 con 0x7f5410101d10 2023-07-14T12:58:44.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5410101d10 0x7f54101979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:44.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540f59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5410103890 0x7f541019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:44.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5410101d10 0x7f54101979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39878/0 (socket says 172.21.15.17:39878) 2023-07-14T12:58:44.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540f59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5410103890 0x7f541019ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49488/0 (socket says 172.21.15.17:49488) 2023-07-14T12:58:44.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540ed9d700 1 -- 172.21.15.17:0/2243434250 learned_addr learned my addr 172.21.15.17:0/2243434250 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:44.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5410102f00 0x7f5410197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:44.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540f59e700 1 -- 172.21.15.17:0/2243434250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5410101d10 msgr2=0x7f54101979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:44.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540f59e700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5410101d10 0x7f54101979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540f59e700 1 -- 172.21.15.17:0/2243434250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5410102f00 msgr2=0x7f5410197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:44.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540f59e700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5410102f00 0x7f5410197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540f59e700 1 -- 172.21.15.17:0/2243434250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54040095f0 con 0x7f5410103890 2023-07-14T12:58:44.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.668+0000 7f540e59c700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5410102f00 0x7f5410197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:58:44.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.669+0000 7f540f59e700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5410103890 0x7f541019ef80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f540800efc0 tx=0x7f540800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:44.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.669+0000 7f53f7fff700 1 -- 172.21.15.17:0/2243434250 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408018070 con 0x7f5410103890 2023-07-14T12:58:44.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.669+0000 7f53f7fff700 1 -- 172.21.15.17:0/2243434250 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f540800f040 con 0x7f5410103890 2023-07-14T12:58:44.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.669+0000 7f54151ff700 1 -- 172.21.15.17:0/2243434250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541019faa0 con 0x7f5410103890 2023-07-14T12:58:44.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.669+0000 7f53f7fff700 1 -- 172.21.15.17:0/2243434250 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540800cba0 con 0x7f5410103890 2023-07-14T12:58:44.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.669+0000 7f54151ff700 1 -- 172.21.15.17:0/2243434250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54101a0000 con 0x7f5410103890 2023-07-14T12:58:44.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.671+0000 7f54151ff700 1 -- 172.21.15.17:0/2243434250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541010d3e0 con 0x7f5410103890 2023-07-14T12:58:44.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.672+0000 7f53f7fff700 1 -- 172.21.15.17:0/2243434250 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f5408003a00 con 0x7f5410103890 2023-07-14T12:58:44.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.674+0000 7f53f7fff700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f53f80a1260 0x7f53f80a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:44.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.674+0000 7f53f7fff700 1 -- 172.21.15.17:0/2243434250 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f54080cc490 con 0x7f5410103890 2023-07-14T12:58:44.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.674+0000 7f540ed9d700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f53f80a1260 0x7f53f80a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:44.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.675+0000 7f540ed9d700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f53f80a1260 0x7f53f80a3710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5400005950 tx=0x7f5400009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.678+0000 7f53f7fff700 1 -- 172.21.15.17:0/2243434250 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5408095b40 con 0x7f5410103890 2023-07-14T12:58:44.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.892+0000 7f54151ff700 1 -- 172.21.15.17:0/2243434250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5410108cc0 con 0x7f5410103890 2023-07-14T12:58:44.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.892+0000 7f53f7fff700 1 -- 172.21.15.17:0/2243434250 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5408099160 con 0x7f5410103890 2023-07-14T12:58:44.922 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-07-14T12:58:44.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 -- 172.21.15.17:0/2243434250 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f53f80a1260 msgr2=0x7f53f80a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:44.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f53f80a1260 0x7f53f80a3710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5400005950 tx=0x7f5400009260 comp rx=0 tx=0).stop 2023-07-14T12:58:44.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 -- 172.21.15.17:0/2243434250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5410103890 msgr2=0x7f541019ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:44.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5410103890 0x7f541019ef80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f540800efc0 tx=0x7f540800c3a0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 -- 172.21.15.17:0/2243434250 shutdown_connections 2023-07-14T12:58:44.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f53f80a1260 0x7f53f80a3710 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5410103890 0x7f541019ef80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5410101d10 0x7f54101979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 --2- 172.21.15.17:0/2243434250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5410102f00 0x7f5410197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:44.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 -- 172.21.15.17:0/2243434250 >> 172.21.15.17:0/2243434250 conn(0x7f54100fd350 msgr2=0x7f54100ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:44.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 -- 172.21.15.17:0/2243434250 shutdown_connections 2023-07-14T12:58:44.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:44.895+0000 7f54151ff700 1 -- 172.21.15.17:0/2243434250 wait complete. 2023-07-14T12:58:44.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:58:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.130+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/26979094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d080ffb00 msgr2=0x7f9d080fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.130+0000 7f9d0f9ff700 1 --2- 172.21.15.17:0/26979094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d080ffb00 0x7f9d080fff10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400b0a0 tx=0x7f9d0400b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.130+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/26979094 shutdown_connections 2023-07-14T12:58:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.130+0000 7f9d0f9ff700 1 --2- 172.21.15.17:0/26979094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d08101680 0x7f9d08107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.130+0000 7f9d0f9ff700 1 --2- 172.21.15.17:0/26979094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d080ffb00 0x7f9d080fff10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.130+0000 7f9d0f9ff700 1 --2- 172.21.15.17:0/26979094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d08100cf0 0x7f9d08101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.130+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/26979094 >> 172.21.15.17:0/26979094 conn(0x7f9d080fb0e0 msgr2=0x7f9d080fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.130+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/26979094 shutdown_connections 2023-07-14T12:58:45.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.130+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/26979094 wait complete. 2023-07-14T12:58:45.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.131+0000 7f9d0f9ff700 1 Processor -- start 2023-07-14T12:58:45.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.131+0000 7f9d0f9ff700 1 -- start start 2023-07-14T12:58:45.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0f9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d080ffb00 0x7f9d080742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:45.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0f9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d08100cf0 0x7f9d08072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:45.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0f9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d08101680 0x7f9d08072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0f9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080735e0 con 0x7f9d08100cf0 2023-07-14T12:58:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0f9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08073750 con 0x7f9d08101680 2023-07-14T12:58:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0f9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0819f970 con 0x7f9d080ffb00 2023-07-14T12:58:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0cf9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d08100cf0 0x7f9d08072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0d79b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d080ffb00 0x7f9d080742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:45.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0df9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d08101680 0x7f9d08072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0d79b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d080ffb00 0x7f9d080742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34122/0 (socket says 172.21.15.17:34122) 2023-07-14T12:58:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0cf9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d08100cf0 0x7f9d08072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56076/0 (socket says 172.21.15.17:56076) 2023-07-14T12:58:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0d79b700 1 -- 172.21.15.17:0/3131776056 learned_addr learned my addr 172.21.15.17:0/3131776056 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0cf9a700 1 -- 172.21.15.17:0/3131776056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d080ffb00 msgr2=0x7f9d080742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.132+0000 7f9d0cf9a700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d080ffb00 0x7f9d080742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.133+0000 7f9d0cf9a700 1 -- 172.21.15.17:0/3131776056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d08101680 msgr2=0x7f9d08072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:45.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.133+0000 7f9d0cf9a700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d08101680 0x7f9d08072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.133+0000 7f9d0cf9a700 1 -- 172.21.15.17:0/3131776056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d04009d00 con 0x7f9d08100cf0 2023-07-14T12:58:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.133+0000 7f9d0d79b700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d080ffb00 0x7f9d080742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:58:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.133+0000 7f9d0cf9a700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d08100cf0 0x7f9d08072900 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800d950 tx=0x7f9cf800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.133+0000 7f9cfe7fc700 1 -- 172.21.15.17:0/3131776056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8009930 con 0x7f9d08100cf0 2023-07-14T12:58:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.133+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/3131776056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0819fc50 con 0x7f9d08100cf0 2023-07-14T12:58:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.133+0000 7f9cfe7fc700 1 -- 172.21.15.17:0/3131776056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9cf800be70 con 0x7f9d08100cf0 2023-07-14T12:58:45.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.133+0000 7f9cfe7fc700 1 -- 172.21.15.17:0/3131776056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8010db0 con 0x7f9d08100cf0 2023-07-14T12:58:45.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.133+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/3131776056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d081a01b0 con 0x7f9d08100cf0 2023-07-14T12:58:45.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.134+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/3131776056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0810b1d0 con 0x7f9d08100cf0 2023-07-14T12:58:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.136+0000 7f9cfe7fc700 1 -- 172.21.15.17:0/3131776056 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f9cf8009a90 con 0x7f9d08100cf0 2023-07-14T12:58:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.137+0000 7f9cfe7fc700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9cf40a1220 0x7f9cf40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.138+0000 7f9cfe7fc700 1 -- 172.21.15.17:0/3131776056 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f9cf80cc580 con 0x7f9d08100cf0 2023-07-14T12:58:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.138+0000 7f9d0d79b700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9cf40a1220 0x7f9cf40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:45.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.138+0000 7f9d0d79b700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9cf40a1220 0x7f9cf40a36d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009fd0 tx=0x7f9d04006210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:45.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.141+0000 7f9cfe7fc700 1 -- 172.21.15.17:0/3131776056 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9cf8095b40 con 0x7f9d08100cf0 2023-07-14T12:58:45.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:45 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1796421667' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:58:45.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:45 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2243434250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:58:45.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.404+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/3131776056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d0810b3c0 con 0x7f9d08100cf0 2023-07-14T12:58:45.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.405+0000 7f9cfe7fc700 1 -- 172.21.15.17:0/3131776056 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10845 (secure 0 0 0) 0x7f9cf8099160 con 0x7f9d08100cf0 2023-07-14T12:58:45.435 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:58:45.435 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T12:57:45.208579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:58:45.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/3131776056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9cf40a1220 msgr2=0x7f9cf40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:45.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9cf40a1220 0x7f9cf40a36d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009fd0 tx=0x7f9d04006210 comp rx=0 tx=0).stop 2023-07-14T12:58:45.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/3131776056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d08100cf0 msgr2=0x7f9d08072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:45.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d08100cf0 0x7f9d08072900 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800d950 tx=0x7f9cf800dc60 comp rx=0 tx=0).stop 2023-07-14T12:58:45.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/3131776056 shutdown_connections 2023-07-14T12:58:45.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f9cf40a1220 0x7f9cf40a36d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d08101680 0x7f9d08072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d080ffb00 0x7f9d080742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 --2- 172.21.15.17:0/3131776056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d08100cf0 0x7f9d08072900 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/3131776056 >> 172.21.15.17:0/3131776056 conn(0x7f9d080fb0e0 msgr2=0x7f9d080fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:45.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/3131776056 shutdown_connections 2023-07-14T12:58:45.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.408+0000 7f9d0f9ff700 1 -- 172.21.15.17:0/3131776056 wait complete. 2023-07-14T12:58:45.440 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2023-07-14T12:58:45.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:45 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1796421667' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:58:45.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:45 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2243434250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:58:45.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:58:45.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:45 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1796421667' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:58:45.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:45 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2243434250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:58:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.644+0000 7f79ab5ff700 1 -- 172.21.15.17:0/133449737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4074550 msgr2=0x7f79a40729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.644+0000 7f79ab5ff700 1 --2- 172.21.15.17:0/133449737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4074550 0x7f79a40729a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009990 tx=0x7f79a0009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.645+0000 7f79ab5ff700 1 -- 172.21.15.17:0/133449737 shutdown_connections 2023-07-14T12:58:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.645+0000 7f79ab5ff700 1 --2- 172.21.15.17:0/133449737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79a410c0d0 0x7f79a410e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.645+0000 7f79ab5ff700 1 --2- 172.21.15.17:0/133449737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a4074550 0x7f79a40729a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.645+0000 7f79ab5ff700 1 --2- 172.21.15.17:0/133449737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79a4072f70 0x7f79a40733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.645+0000 7f79ab5ff700 1 -- 172.21.15.17:0/133449737 >> 172.21.15.17:0/133449737 conn(0x7f79a40fb0e0 msgr2=0x7f79a40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:45.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.645+0000 7f79ab5ff700 1 -- 172.21.15.17:0/133449737 shutdown_connections 2023-07-14T12:58:45.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.645+0000 7f79ab5ff700 1 -- 172.21.15.17:0/133449737 wait complete. 2023-07-14T12:58:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79ab5ff700 1 Processor -- start 2023-07-14T12:58:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79ab5ff700 1 -- start start 2023-07-14T12:58:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79ab5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79a4072f70 0x7f79a419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:45.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79ab5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79a4074550 0x7f79a419c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79ab5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a410c0d0 0x7f79a41a32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79ab5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a41a3870 con 0x7f79a410c0d0 2023-07-14T12:58:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79ab5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a41a39e0 con 0x7f79a4072f70 2023-07-14T12:58:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79ab5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a41a3ba0 con 0x7f79a4074550 2023-07-14T12:58:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79a9b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a410c0d0 0x7f79a41a32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79a9b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a410c0d0 0x7f79a41a32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56092/0 (socket says 172.21.15.17:56092) 2023-07-14T12:58:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79a9b9c700 1 -- 172.21.15.17:0/3746716528 learned_addr learned my addr 172.21.15.17:0/3746716528 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.646+0000 7f79a939b700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79a4072f70 0x7f79a419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.647+0000 7f79a8b9a700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79a4074550 0x7f79a419c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.647+0000 7f79a9b9c700 1 -- 172.21.15.17:0/3746716528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79a4074550 msgr2=0x7f79a419c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.647+0000 7f79a9b9c700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79a4074550 0x7f79a419c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.647+0000 7f79a9b9c700 1 -- 172.21.15.17:0/3746716528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79a4072f70 msgr2=0x7f79a419bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.647+0000 7f79a9b9c700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79a4072f70 0x7f79a419bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.647+0000 7f79a9b9c700 1 -- 172.21.15.17:0/3746716528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00095f0 con 0x7f79a410c0d0 2023-07-14T12:58:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.647+0000 7f79a939b700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79a4072f70 0x7f79a419bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:58:45.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.647+0000 7f79a9b9c700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a410c0d0 0x7f79a41a32a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f799c007d70 tx=0x7f799c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.647+0000 7f799a7fc700 1 -- 172.21.15.17:0/3746716528 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c00ac90 con 0x7f79a410c0d0 2023-07-14T12:58:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.648+0000 7f799a7fc700 1 -- 172.21.15.17:0/3746716528 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f799c00adf0 con 0x7f79a410c0d0 2023-07-14T12:58:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.648+0000 7f79ab5ff700 1 -- 172.21.15.17:0/3746716528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a41a3e80 con 0x7f79a410c0d0 2023-07-14T12:58:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.648+0000 7f799a7fc700 1 -- 172.21.15.17:0/3746716528 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c0115e0 con 0x7f79a410c0d0 2023-07-14T12:58:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.648+0000 7f79ab5ff700 1 -- 172.21.15.17:0/3746716528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a41a42a0 con 0x7f79a410c0d0 2023-07-14T12:58:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.649+0000 7f79ab5ff700 1 -- 172.21.15.17:0/3746716528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a4101c20 con 0x7f79a410c0d0 2023-07-14T12:58:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.651+0000 7f799a7fc700 1 -- 172.21.15.17:0/3746716528 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f799c012420 con 0x7f79a410c0d0 2023-07-14T12:58:45.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.652+0000 7f799a7fc700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f79900a1220 0x7f79900a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:45.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.652+0000 7f799a7fc700 1 -- 172.21.15.17:0/3746716528 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f799c0ccb10 con 0x7f79a410c0d0 2023-07-14T12:58:45.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.652+0000 7f79a939b700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f79900a1220 0x7f79900a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:45.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.653+0000 7f79a939b700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f79900a1220 0x7f79900a36d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79a000c010 tx=0x7f79a0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:45.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.660+0000 7f799a7fc700 1 -- 172.21.15.17:0/3746716528 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f799c096240 con 0x7f79a410c0d0 2023-07-14T12:58:45.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.888+0000 7f79ab5ff700 1 -- 172.21.15.17:0/3746716528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79a402ca70 con 0x7f79a410c0d0 2023-07-14T12:58:45.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.889+0000 7f799a7fc700 1 -- 172.21.15.17:0/3746716528 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22469 (secure 0 0 0) 0x7f799c099860 con 0x7f79a410c0d0 2023-07-14T12:58:45.920 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:58:45.920 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":88,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:58:07.945460+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:58:45.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 -- 172.21.15.17:0/3746716528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f79900a1220 msgr2=0x7f79900a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f79900a1220 0x7f79900a36d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79a000c010 tx=0x7f79a0000bc0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 -- 172.21.15.17:0/3746716528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a410c0d0 msgr2=0x7f79a41a32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a410c0d0 0x7f79a41a32a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f799c007d70 tx=0x7f799c00a340 comp rx=0 tx=0).stop 2023-07-14T12:58:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 -- 172.21.15.17:0/3746716528 shutdown_connections 2023-07-14T12:58:45.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f79900a1220 0x7f79900a36d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a410c0d0 0x7f79a41a32a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79a4072f70 0x7f79a419bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 --2- 172.21.15.17:0/3746716528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79a4074550 0x7f79a419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 -- 172.21.15.17:0/3746716528 >> 172.21.15.17:0/3746716528 conn(0x7f79a40fb0e0 msgr2=0x7f79a40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 -- 172.21.15.17:0/3746716528 shutdown_connections 2023-07-14T12:58:45.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:45.892+0000 7f79ab5ff700 1 -- 172.21.15.17:0/3746716528 wait complete. 2023-07-14T12:58:45.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:57:37.876360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:57:39.117456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:58:45.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:58:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.143+0000 7f12ff3ff700 1 -- 172.21.15.17:0/909736740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f8100cd0 msgr2=0x7f12f8101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.143+0000 7f12ff3ff700 1 --2- 172.21.15.17:0/909736740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f8100cd0 0x7f12f8101120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f12e800faf0 tx=0x7f12e800fe00 comp rx=0 tx=0).stop 2023-07-14T12:58:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.143+0000 7f12ff3ff700 1 -- 172.21.15.17:0/909736740 shutdown_connections 2023-07-14T12:58:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.143+0000 7f12ff3ff700 1 --2- 172.21.15.17:0/909736740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12f8101660 0x7f12f8107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.143+0000 7f12ff3ff700 1 --2- 172.21.15.17:0/909736740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12f80ffae0 0x7f12f80ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.143+0000 7f12ff3ff700 1 --2- 172.21.15.17:0/909736740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f8100cd0 0x7f12f8101120 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.143+0000 7f12ff3ff700 1 -- 172.21.15.17:0/909736740 >> 172.21.15.17:0/909736740 conn(0x7f12f80fb0e0 msgr2=0x7f12f80fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:46.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.143+0000 7f12ff3ff700 1 -- 172.21.15.17:0/909736740 shutdown_connections 2023-07-14T12:58:46.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.143+0000 7f12ff3ff700 1 -- 172.21.15.17:0/909736740 wait complete. 2023-07-14T12:58:46.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.144+0000 7f12ff3ff700 1 Processor -- start 2023-07-14T12:58:46.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.145+0000 7f12ff3ff700 1 -- start start 2023-07-14T12:58:46.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.145+0000 7f12ff3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f80ffae0 0x7f12f81935b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:46.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.145+0000 7f12ff3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12f8100cd0 0x7f12f8193af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:46.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.145+0000 7f12ff3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12f8101660 0x7f12f819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:46.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.145+0000 7f12ff3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f819b130 con 0x7f12f80ffae0 2023-07-14T12:58:46.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.145+0000 7f12ff3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f819b270 con 0x7f12f8100cd0 2023-07-14T12:58:46.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.145+0000 7f12ff3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f819b400 con 0x7f12f8101660 2023-07-14T12:58:46.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.145+0000 7f12fd19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f80ffae0 0x7f12f81935b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:46.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12fd19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f80ffae0 0x7f12f81935b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56100/0 (socket says 172.21.15.17:56100) 2023-07-14T12:58:46.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12fd19b700 1 -- 172.21.15.17:0/2734913211 learned_addr learned my addr 172.21.15.17:0/2734913211 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:46.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12fc99a700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12f8100cd0 0x7f12f8193af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:46.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12fd99c700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12f8101660 0x7f12f819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:46.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12fd19b700 1 -- 172.21.15.17:0/2734913211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12f8101660 msgr2=0x7f12f819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12fd19b700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12f8101660 0x7f12f819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12fd19b700 1 -- 172.21.15.17:0/2734913211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12f8100cd0 msgr2=0x7f12f8193af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12fd19b700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12f8100cd0 0x7f12f8193af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12fd19b700 1 -- 172.21.15.17:0/2734913211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e800f750 con 0x7f12f80ffae0 2023-07-14T12:58:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12fc99a700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12f8100cd0 0x7f12f8193af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:58:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12fd19b700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f80ffae0 0x7f12f81935b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f12f400e970 tx=0x7f12f400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:46.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12ee7fc700 1 -- 172.21.15.17:0/2734913211 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4009790 con 0x7f12f80ffae0 2023-07-14T12:58:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12ff3ff700 1 -- 172.21.15.17:0/2734913211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f819b6e0 con 0x7f12f80ffae0 2023-07-14T12:58:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12ee7fc700 1 -- 172.21.15.17:0/2734913211 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12f400c7e0 con 0x7f12f80ffae0 2023-07-14T12:58:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.146+0000 7f12ee7fc700 1 -- 172.21.15.17:0/2734913211 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4003bd0 con 0x7f12f80ffae0 2023-07-14T12:58:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.147+0000 7f12ff3ff700 1 -- 172.21.15.17:0/2734913211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f819bc40 con 0x7f12f80ffae0 2023-07-14T12:58:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.148+0000 7f12ff3ff700 1 -- 172.21.15.17:0/2734913211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f81070c0 con 0x7f12f80ffae0 2023-07-14T12:58:46.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.149+0000 7f12ee7fc700 1 -- 172.21.15.17:0/2734913211 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f12f400c950 con 0x7f12f80ffae0 2023-07-14T12:58:46.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.151+0000 7f12ee7fc700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12e40a1260 0x7f12e40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:46.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.151+0000 7f12ee7fc700 1 -- 172.21.15.17:0/2734913211 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f12f4014070 con 0x7f12f80ffae0 2023-07-14T12:58:46.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.151+0000 7f12fc99a700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12e40a1260 0x7f12e40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:46.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.152+0000 7f12fc99a700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12e40a1260 0x7f12e40a3710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000c00 tx=0x7f12e800ff90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:46.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.155+0000 7f12ee7fc700 1 -- 172.21.15.17:0/2734913211 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f12f40961a0 con 0x7f12f80ffae0 2023-07-14T12:58:46.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:46 smithi017 ceph-mon[95536]: pgmap v337: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:46.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:46 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3131776056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:58:46.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:46 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3746716528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:46.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.397+0000 7f12ff3ff700 1 -- 172.21.15.17:0/2734913211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12f802cab0 con 0x7f12f80ffae0 2023-07-14T12:58:46.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.398+0000 7f12ee7fc700 1 -- 172.21.15.17:0/2734913211 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12f4016330 con 0x7f12f80ffae0 2023-07-14T12:58:46.428 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T12:58:46.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.400+0000 7f12ff3ff700 1 -- 172.21.15.17:0/2734913211 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12e40a1260 msgr2=0x7f12e40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:46.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.400+0000 7f12ff3ff700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12e40a1260 0x7f12e40a3710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000c00 tx=0x7f12e800ff90 comp rx=0 tx=0).stop 2023-07-14T12:58:46.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.400+0000 7f12ff3ff700 1 -- 172.21.15.17:0/2734913211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f80ffae0 msgr2=0x7f12f81935b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:46.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.400+0000 7f12ff3ff700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f80ffae0 0x7f12f81935b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f12f400e970 tx=0x7f12f400ec80 comp rx=0 tx=0).stop 2023-07-14T12:58:46.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.400+0000 7f12ff3ff700 1 -- 172.21.15.17:0/2734913211 shutdown_connections 2023-07-14T12:58:46.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.400+0000 7f12ff3ff700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f12e40a1260 0x7f12e40a3710 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.400+0000 7f12ff3ff700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12f8101660 0x7f12f819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.400+0000 7f12ff3ff700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12f80ffae0 0x7f12f81935b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.400+0000 7f12ff3ff700 1 --2- 172.21.15.17:0/2734913211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12f8100cd0 0x7f12f8193af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.400+0000 7f12ff3ff700 1 -- 172.21.15.17:0/2734913211 >> 172.21.15.17:0/2734913211 conn(0x7f12f80fb0e0 msgr2=0x7f12f8104200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:46.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.401+0000 7f12ff3ff700 1 -- 172.21.15.17:0/2734913211 shutdown_connections 2023-07-14T12:58:46.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.401+0000 7f12ff3ff700 1 -- 172.21.15.17:0/2734913211 wait complete. 2023-07-14T12:58:46.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:46 smithi135 ceph-mon[97338]: pgmap v337: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:46.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:46 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3131776056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:58:46.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:46 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3746716528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:46.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:58:46.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:46 smithi131 ceph-mon[96953]: pgmap v337: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:46.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:46 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3131776056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:58:46.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:46 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3746716528' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:46.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.631+0000 7f3b829ff700 1 -- 172.21.15.17:0/2661278009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c072f70 msgr2=0x7f3b7c0733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:46.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.631+0000 7f3b829ff700 1 --2- 172.21.15.17:0/2661278009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c072f70 0x7f3b7c0733e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009990 tx=0x7f3b70009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.632+0000 7f3b829ff700 1 -- 172.21.15.17:0/2661278009 shutdown_connections 2023-07-14T12:58:46.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.632+0000 7f3b829ff700 1 --2- 172.21.15.17:0/2661278009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b7c10c0c0 0x7f3b7c10e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.632+0000 7f3b829ff700 1 --2- 172.21.15.17:0/2661278009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7c074550 0x7f3b7c0729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.632+0000 7f3b829ff700 1 --2- 172.21.15.17:0/2661278009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c072f70 0x7f3b7c0733e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.632+0000 7f3b829ff700 1 -- 172.21.15.17:0/2661278009 >> 172.21.15.17:0/2661278009 conn(0x7f3b7c0fb130 msgr2=0x7f3b7c0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:46.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.632+0000 7f3b829ff700 1 -- 172.21.15.17:0/2661278009 shutdown_connections 2023-07-14T12:58:46.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.632+0000 7f3b829ff700 1 -- 172.21.15.17:0/2661278009 wait complete. 2023-07-14T12:58:46.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.633+0000 7f3b829ff700 1 Processor -- start 2023-07-14T12:58:46.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.633+0000 7f3b829ff700 1 -- start start 2023-07-14T12:58:46.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.634+0000 7f3b829ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b7c072f70 0x7f3b7c19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:46.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.634+0000 7f3b829ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7c074550 0x7f3b7c19c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:46.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.634+0000 7f3b829ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c10c0c0 0x7f3b7c1a3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:46.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.634+0000 7f3b829ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c1a3960 con 0x7f3b7c10c0c0 2023-07-14T12:58:46.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.634+0000 7f3b829ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c1a3aa0 con 0x7f3b7c072f70 2023-07-14T12:58:46.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.634+0000 7f3b829ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c1a3c30 con 0x7f3b7c074550 2023-07-14T12:58:46.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.634+0000 7f3b80f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c10c0c0 0x7f3b7c1a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:46.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.634+0000 7f3b7bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b7c072f70 0x7f3b7c19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:46.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.634+0000 7f3b80f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c10c0c0 0x7f3b7c1a3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56126/0 (socket says 172.21.15.17:56126) 2023-07-14T12:58:46.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.634+0000 7f3b7bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b7c072f70 0x7f3b7c19bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40950/0 (socket says 172.21.15.17:40950) 2023-07-14T12:58:46.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.634+0000 7f3b80f9c700 1 -- 172.21.15.17:0/3999746345 learned_addr learned my addr 172.21.15.17:0/3999746345 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:46.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.635+0000 7f3b7b7fe700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7c074550 0x7f3b7c19c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:46.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.635+0000 7f3b7bfff700 1 -- 172.21.15.17:0/3999746345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7c074550 msgr2=0x7f3b7c19c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:46.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.635+0000 7f3b7bfff700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7c074550 0x7f3b7c19c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.635+0000 7f3b7bfff700 1 -- 172.21.15.17:0/3999746345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c10c0c0 msgr2=0x7f3b7c1a3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:46.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.635+0000 7f3b7bfff700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c10c0c0 0x7f3b7c1a3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.635+0000 7f3b7bfff700 1 -- 172.21.15.17:0/3999746345 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b700095f0 con 0x7f3b7c072f70 2023-07-14T12:58:46.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.635+0000 7f3b7b7fe700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7c074550 0x7f3b7c19c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:46.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.635+0000 7f3b7bfff700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b7c072f70 0x7f3b7c19bde0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00e9c0 tx=0x7f3b6c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.635+0000 7f3b797fa700 1 -- 172.21.15.17:0/3999746345 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00cbd0 con 0x7f3b7c072f70 2023-07-14T12:58:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.635+0000 7f3b797fa700 1 -- 172.21.15.17:0/3999746345 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b6c00eeb0 con 0x7f3b7c072f70 2023-07-14T12:58:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.635+0000 7f3b829ff700 1 -- 172.21.15.17:0/3999746345 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c1a3f10 con 0x7f3b7c072f70 2023-07-14T12:58:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.636+0000 7f3b797fa700 1 -- 172.21.15.17:0/3999746345 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c018680 con 0x7f3b7c072f70 2023-07-14T12:58:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.636+0000 7f3b829ff700 1 -- 172.21.15.17:0/3999746345 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c1a4330 con 0x7f3b7c072f70 2023-07-14T12:58:46.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.637+0000 7f3b829ff700 1 -- 172.21.15.17:0/3999746345 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c101c10 con 0x7f3b7c072f70 2023-07-14T12:58:46.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.639+0000 7f3b797fa700 1 -- 172.21.15.17:0/3999746345 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f3b6c010430 con 0x7f3b7c072f70 2023-07-14T12:58:46.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.640+0000 7f3b797fa700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3b640a11e0 0x7f3b640a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.640+0000 7f3b797fa700 1 -- 172.21.15.17:0/3999746345 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f3b6c014070 con 0x7f3b7c072f70 2023-07-14T12:58:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.640+0000 7f3b7b7fe700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3b640a11e0 0x7f3b640a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:46.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.641+0000 7f3b7b7fe700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3b640a11e0 0x7f3b640a3690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005910 tx=0x7f3b7000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:46.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.644+0000 7f3b797fa700 1 -- 172.21.15.17:0/3999746345 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3b6c051790 con 0x7f3b7c072f70 2023-07-14T12:58:46.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.882+0000 7f3b829ff700 1 -- 172.21.15.17:0/3999746345 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b7c02c850 con 0x7f3b7c072f70 2023-07-14T12:58:46.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.883+0000 7f3b797fa700 1 -- 172.21.15.17:0/3999746345 <== mon.2 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b6c0962e0 con 0x7f3b7c072f70 2023-07-14T12:58:46.913 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-07-14T12:58:46.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 -- 172.21.15.17:0/3999746345 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3b640a11e0 msgr2=0x7f3b640a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:46.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3b640a11e0 0x7f3b640a3690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005910 tx=0x7f3b7000b260 comp rx=0 tx=0).stop 2023-07-14T12:58:46.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 -- 172.21.15.17:0/3999746345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b7c072f70 msgr2=0x7f3b7c19bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:46.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b7c072f70 0x7f3b7c19bde0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00e9c0 tx=0x7f3b6c00ecd0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 -- 172.21.15.17:0/3999746345 shutdown_connections 2023-07-14T12:58:46.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3b640a11e0 0x7f3b640a3690 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c10c0c0 0x7f3b7c1a3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b7c072f70 0x7f3b7c19bde0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 --2- 172.21.15.17:0/3999746345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b7c074550 0x7f3b7c19c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:46.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 -- 172.21.15.17:0/3999746345 >> 172.21.15.17:0/3999746345 conn(0x7f3b7c0fb130 msgr2=0x7f3b7c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:46.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 -- 172.21.15.17:0/3999746345 shutdown_connections 2023-07-14T12:58:46.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:46.886+0000 7f3b829ff700 1 -- 172.21.15.17:0/3999746345 wait complete. 2023-07-14T12:58:46.936 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:58:47.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.119+0000 7ff15a7ff700 1 -- 172.21.15.17:0/2661451489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff154102f20 msgr2=0x7ff154105300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:47.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.119+0000 7ff15a7ff700 1 --2- 172.21.15.17:0/2661451489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff154102f20 0x7ff154105300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff148009990 tx=0x7ff148009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.119+0000 7ff15a7ff700 1 -- 172.21.15.17:0/2661451489 shutdown_connections 2023-07-14T12:58:47.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.119+0000 7ff15a7ff700 1 --2- 172.21.15.17:0/2661451489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff154105840 0x7ff154107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.119+0000 7ff15a7ff700 1 --2- 172.21.15.17:0/2661451489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff154100600 0x7ff1541029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.119+0000 7ff15a7ff700 1 --2- 172.21.15.17:0/2661451489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff154102f20 0x7ff154105300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.119+0000 7ff15a7ff700 1 -- 172.21.15.17:0/2661451489 >> 172.21.15.17:0/2661451489 conn(0x7ff1540fa000 msgr2=0x7ff1540fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:47.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.119+0000 7ff15a7ff700 1 -- 172.21.15.17:0/2661451489 shutdown_connections 2023-07-14T12:58:47.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.119+0000 7ff15a7ff700 1 -- 172.21.15.17:0/2661451489 wait complete. 2023-07-14T12:58:47.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.121+0000 7ff15a7ff700 1 Processor -- start 2023-07-14T12:58:47.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.121+0000 7ff15a7ff700 1 -- start start 2023-07-14T12:58:47.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff15a7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff154100600 0x7ff154195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:47.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff15a7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff154102f20 0x7ff154195cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:47.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff15a7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff154105840 0x7ff15419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:47.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff15a7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15419d300 con 0x7ff154105840 2023-07-14T12:58:47.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff15a7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15419d440 con 0x7ff154100600 2023-07-14T12:58:47.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff15a7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15419d5d0 con 0x7ff154102f20 2023-07-14T12:58:47.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff158d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff154105840 0x7ff15419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:47.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff158d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff154105840 0x7ff15419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56138/0 (socket says 172.21.15.17:56138) 2023-07-14T12:58:47.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff158d9c700 1 -- 172.21.15.17:0/946169853 learned_addr learned my addr 172.21.15.17:0/946169853 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:47.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff1537fe700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff154102f20 0x7ff154195cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:47.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff153fff700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff154100600 0x7ff154195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:47.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff158d9c700 1 -- 172.21.15.17:0/946169853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff154102f20 msgr2=0x7ff154195cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:47.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff158d9c700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff154102f20 0x7ff154195cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff158d9c700 1 -- 172.21.15.17:0/946169853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff154100600 msgr2=0x7ff154195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:47.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff158d9c700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff154100600 0x7ff154195780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.122+0000 7ff158d9c700 1 -- 172.21.15.17:0/946169853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1480095f0 con 0x7ff154105840 2023-07-14T12:58:47.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.123+0000 7ff158d9c700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff154105840 0x7ff15419cd30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00ef30 tx=0x7ff14c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:47.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.123+0000 7ff1517fa700 1 -- 172.21.15.17:0/946169853 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c018070 con 0x7ff154105840 2023-07-14T12:58:47.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.123+0000 7ff15a7ff700 1 -- 172.21.15.17:0/946169853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15419d850 con 0x7ff154105840 2023-07-14T12:58:47.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.123+0000 7ff1517fa700 1 -- 172.21.15.17:0/946169853 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff14c00f040 con 0x7ff154105840 2023-07-14T12:58:47.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.123+0000 7ff1517fa700 1 -- 172.21.15.17:0/946169853 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c00cbc0 con 0x7ff154105840 2023-07-14T12:58:47.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.123+0000 7ff15a7ff700 1 -- 172.21.15.17:0/946169853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15419dd60 con 0x7ff154105840 2023-07-14T12:58:47.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.125+0000 7ff15a7ff700 1 -- 172.21.15.17:0/946169853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1540fbb70 con 0x7ff154105840 2023-07-14T12:58:47.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.126+0000 7ff1517fa700 1 -- 172.21.15.17:0/946169853 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7ff14c007500 con 0x7ff154105840 2023-07-14T12:58:47.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.128+0000 7ff1517fa700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff13c0a1260 0x7ff13c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:47.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.128+0000 7ff1517fa700 1 -- 172.21.15.17:0/946169853 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7ff14c0cc540 con 0x7ff154105840 2023-07-14T12:58:47.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.128+0000 7ff153fff700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff13c0a1260 0x7ff13c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:47.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.129+0000 7ff153fff700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff13c0a1260 0x7ff13c0a3710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff144009c60 tx=0x7ff144009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:47.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.131+0000 7ff1517fa700 1 -- 172.21.15.17:0/946169853 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff14c095b90 con 0x7ff154105840 2023-07-14T12:58:47.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:47 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2734913211' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:58:47.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:47 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:47 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3999746345' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:58:47.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.363+0000 7ff15a7ff700 1 -- 172.21.15.17:0/946169853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff15402c850 con 0x7ff154105840 2023-07-14T12:58:47.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.363+0000 7ff1517fa700 1 -- 172.21.15.17:0/946169853 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff14c0991b0 con 0x7ff154105840 2023-07-14T12:58:47.393 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-07-14T12:58:47.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 -- 172.21.15.17:0/946169853 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff13c0a1260 msgr2=0x7ff13c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:47.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff13c0a1260 0x7ff13c0a3710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff144009c60 tx=0x7ff144009260 comp rx=0 tx=0).stop 2023-07-14T12:58:47.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 -- 172.21.15.17:0/946169853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff154105840 msgr2=0x7ff15419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:47.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff154105840 0x7ff15419cd30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00ef30 tx=0x7ff14c00c3a0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 -- 172.21.15.17:0/946169853 shutdown_connections 2023-07-14T12:58:47.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff13c0a1260 0x7ff13c0a3710 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff154105840 0x7ff15419cd30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff154100600 0x7ff154195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 --2- 172.21.15.17:0/946169853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff154102f20 0x7ff154195cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 -- 172.21.15.17:0/946169853 >> 172.21.15.17:0/946169853 conn(0x7ff1540fa000 msgr2=0x7ff154101260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:47.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 -- 172.21.15.17:0/946169853 shutdown_connections 2023-07-14T12:58:47.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.367+0000 7ff15a7ff700 1 -- 172.21.15.17:0/946169853 wait complete. 2023-07-14T12:58:47.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:58:47.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:47 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2734913211' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:58:47.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:47 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:47 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3999746345' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:58:47.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:47 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2734913211' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:58:47.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:47 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:47.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:47 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3999746345' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:58:47.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.610+0000 7f14d41ff700 1 -- 172.21.15.17:0/271378735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14cc101680 msgr2=0x7f14cc107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:47.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.610+0000 7f14d41ff700 1 --2- 172.21.15.17:0/271378735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14cc101680 0x7f14cc107f40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f14c400b0a0 tx=0x7f14c400b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.610+0000 7f14d41ff700 1 -- 172.21.15.17:0/271378735 shutdown_connections 2023-07-14T12:58:47.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.610+0000 7f14d41ff700 1 --2- 172.21.15.17:0/271378735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14cc101680 0x7f14cc107f40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.610+0000 7f14d41ff700 1 --2- 172.21.15.17:0/271378735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc0ffb00 0x7f14cc0fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.610+0000 7f14d41ff700 1 --2- 172.21.15.17:0/271378735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14cc100cf0 0x7f14cc101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.610+0000 7f14d41ff700 1 -- 172.21.15.17:0/271378735 >> 172.21.15.17:0/271378735 conn(0x7f14cc0fb0e0 msgr2=0x7f14cc0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:47.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.610+0000 7f14d41ff700 1 -- 172.21.15.17:0/271378735 shutdown_connections 2023-07-14T12:58:47.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.610+0000 7f14d41ff700 1 -- 172.21.15.17:0/271378735 wait complete. 2023-07-14T12:58:47.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.611+0000 7f14d41ff700 1 Processor -- start 2023-07-14T12:58:47.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.611+0000 7f14d41ff700 1 -- start start 2023-07-14T12:58:47.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.611+0000 7f14d41ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14cc0ffb00 0x7f14cc197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:47.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d41ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc100cf0 0x7f14cc197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:47.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d41ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14cc101680 0x7f14cc19f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:47.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d41ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc19f600 con 0x7f14cc0ffb00 2023-07-14T12:58:47.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d41ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc19f740 con 0x7f14cc101680 2023-07-14T12:58:47.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d41ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc19f8d0 con 0x7f14cc100cf0 2023-07-14T12:58:47.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d1f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14cc0ffb00 0x7f14cc197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:47.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d1f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14cc0ffb00 0x7f14cc197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56164/0 (socket says 172.21.15.17:56164) 2023-07-14T12:58:47.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d1f9b700 1 -- 172.21.15.17:0/4167197004 learned_addr learned my addr 172.21.15.17:0/4167197004 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:47.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d179a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc100cf0 0x7f14cc197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:47.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d279c700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14cc101680 0x7f14cc19f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:47.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d1f9b700 1 -- 172.21.15.17:0/4167197004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc100cf0 msgr2=0x7f14cc197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:47.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d1f9b700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc100cf0 0x7f14cc197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d1f9b700 1 -- 172.21.15.17:0/4167197004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14cc101680 msgr2=0x7f14cc19f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:47.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d1f9b700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14cc101680 0x7f14cc19f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.612+0000 7f14d1f9b700 1 -- 172.21.15.17:0/4167197004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c4009d00 con 0x7f14cc0ffb00 2023-07-14T12:58:47.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.613+0000 7f14d1f9b700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14cc0ffb00 0x7f14cc197a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f14c800e970 tx=0x7f14c800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:47.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.613+0000 7f14c2ffd700 1 -- 172.21.15.17:0/4167197004 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8009790 con 0x7f14cc0ffb00 2023-07-14T12:58:47.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.613+0000 7f14c2ffd700 1 -- 172.21.15.17:0/4167197004 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14c800c7e0 con 0x7f14cc0ffb00 2023-07-14T12:58:47.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.613+0000 7f14c2ffd700 1 -- 172.21.15.17:0/4167197004 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8003bd0 con 0x7f14cc0ffb00 2023-07-14T12:58:47.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.613+0000 7f14d41ff700 1 -- 172.21.15.17:0/4167197004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14cc19fbb0 con 0x7f14cc0ffb00 2023-07-14T12:58:47.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.613+0000 7f14d41ff700 1 -- 172.21.15.17:0/4167197004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14cc1a0070 con 0x7f14cc0ffb00 2023-07-14T12:58:47.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.614+0000 7f14d41ff700 1 -- 172.21.15.17:0/4167197004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14cc10b200 con 0x7f14cc0ffb00 2023-07-14T12:58:47.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.616+0000 7f14c2ffd700 1 -- 172.21.15.17:0/4167197004 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f14c800c950 con 0x7f14cc0ffb00 2023-07-14T12:58:47.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.618+0000 7f14c2ffd700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14b80a12a0 0x7f14b80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:47.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.618+0000 7f14c2ffd700 1 -- 172.21.15.17:0/4167197004 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f14c8014070 con 0x7f14cc0ffb00 2023-07-14T12:58:47.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.618+0000 7f14d179a700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14b80a12a0 0x7f14b80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:47.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.618+0000 7f14d179a700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14b80a12a0 0x7f14b80a3750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009c60 tx=0x7f14bc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:47.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.621+0000 7f14c2ffd700 1 -- 172.21.15.17:0/4167197004 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f14c80961f0 con 0x7f14cc0ffb00 2023-07-14T12:58:47.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.907+0000 7f14d41ff700 1 -- 172.21.15.17:0/4167197004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14cc10b420 con 0x7f14cc0ffb00 2023-07-14T12:58:47.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.908+0000 7f14c2ffd700 1 -- 172.21.15.17:0/4167197004 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10845 (secure 0 0 0) 0x7f14c8099810 con 0x7f14cc0ffb00 2023-07-14T12:58:47.938 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:58:47.938 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T12:57:45.208579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:58:47.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.910+0000 7f14d41ff700 1 -- 172.21.15.17:0/4167197004 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14b80a12a0 msgr2=0x7f14b80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:47.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.910+0000 7f14d41ff700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14b80a12a0 0x7f14b80a3750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009c60 tx=0x7f14bc009260 comp rx=0 tx=0).stop 2023-07-14T12:58:47.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.910+0000 7f14d41ff700 1 -- 172.21.15.17:0/4167197004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14cc0ffb00 msgr2=0x7f14cc197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:47.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.910+0000 7f14d41ff700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14cc0ffb00 0x7f14cc197a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f14c800e970 tx=0x7f14c800ec80 comp rx=0 tx=0).stop 2023-07-14T12:58:47.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.910+0000 7f14d41ff700 1 -- 172.21.15.17:0/4167197004 shutdown_connections 2023-07-14T12:58:47.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.910+0000 7f14d41ff700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f14b80a12a0 0x7f14b80a3750 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.910+0000 7f14d41ff700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14cc101680 0x7f14cc19f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.910+0000 7f14d41ff700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14cc0ffb00 0x7f14cc197a80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.910+0000 7f14d41ff700 1 --2- 172.21.15.17:0/4167197004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14cc100cf0 0x7f14cc197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:47.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.910+0000 7f14d41ff700 1 -- 172.21.15.17:0/4167197004 >> 172.21.15.17:0/4167197004 conn(0x7f14cc0fb0e0 msgr2=0x7f14cc106580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:47.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.911+0000 7f14d41ff700 1 -- 172.21.15.17:0/4167197004 shutdown_connections 2023-07-14T12:58:47.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:47.911+0000 7f14d41ff700 1 -- 172.21.15.17:0/4167197004 wait complete. 2023-07-14T12:58:47.942 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2023-07-14T12:58:47.959 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:58:48.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.134+0000 7f310f9ff700 1 -- 172.21.15.17:0/2178056899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3108100cf0 msgr2=0x7f3108101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:48.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.134+0000 7f310f9ff700 1 --2- 172.21.15.17:0/2178056899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3108100cf0 0x7f3108101140 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30f8009990 tx=0x7f30f8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.134+0000 7f310f9ff700 1 -- 172.21.15.17:0/2178056899 shutdown_connections 2023-07-14T12:58:48.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.134+0000 7f310f9ff700 1 --2- 172.21.15.17:0/2178056899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108101680 0x7f3108107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.134+0000 7f310f9ff700 1 --2- 172.21.15.17:0/2178056899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31080ffb00 0x7f31080fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.134+0000 7f310f9ff700 1 --2- 172.21.15.17:0/2178056899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3108100cf0 0x7f3108101140 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.134+0000 7f310f9ff700 1 -- 172.21.15.17:0/2178056899 >> 172.21.15.17:0/2178056899 conn(0x7f31080fb0e0 msgr2=0x7f31080fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:48.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.134+0000 7f310f9ff700 1 -- 172.21.15.17:0/2178056899 shutdown_connections 2023-07-14T12:58:48.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.134+0000 7f310f9ff700 1 -- 172.21.15.17:0/2178056899 wait complete. 2023-07-14T12:58:48.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.135+0000 7f310f9ff700 1 Processor -- start 2023-07-14T12:58:48.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.135+0000 7f310f9ff700 1 -- start start 2023-07-14T12:58:48.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310f9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31080ffb00 0x7f31080742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:48.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310f9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108100cf0 0x7f3108072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:48.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310f9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3108101680 0x7f3108072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:48.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310f9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31080735e0 con 0x7f3108101680 2023-07-14T12:58:48.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310f9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3108073750 con 0x7f31080ffb00 2023-07-14T12:58:48.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310f9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819f7b0 con 0x7f3108100cf0 2023-07-14T12:58:48.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310cf9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108100cf0 0x7f3108072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:48.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310df9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3108101680 0x7f3108072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:48.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310cf9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108100cf0 0x7f3108072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34228/0 (socket says 172.21.15.17:34228) 2023-07-14T12:58:48.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310cf9a700 1 -- 172.21.15.17:0/798770993 learned_addr learned my addr 172.21.15.17:0/798770993 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:48.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310d79b700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31080ffb00 0x7f31080742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:48.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310cf9a700 1 -- 172.21.15.17:0/798770993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31080ffb00 msgr2=0x7f31080742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:48.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310cf9a700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31080ffb00 0x7f31080742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310cf9a700 1 -- 172.21.15.17:0/798770993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3108101680 msgr2=0x7f3108072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:48.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310cf9a700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3108101680 0x7f3108072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310cf9a700 1 -- 172.21.15.17:0/798770993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f80095f0 con 0x7f3108100cf0 2023-07-14T12:58:48.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.136+0000 7f310df9c700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3108101680 0x7f3108072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:58:48.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.137+0000 7f310cf9a700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108100cf0 0x7f3108072900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30f8005910 tx=0x7f30f8005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:48.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.137+0000 7f30fe7fc700 1 -- 172.21.15.17:0/798770993 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f801d070 con 0x7f3108100cf0 2023-07-14T12:58:48.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.137+0000 7f30fe7fc700 1 -- 172.21.15.17:0/798770993 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30f800be10 con 0x7f3108100cf0 2023-07-14T12:58:48.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.137+0000 7f310f9ff700 1 -- 172.21.15.17:0/798770993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310819fa30 con 0x7f3108100cf0 2023-07-14T12:58:48.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.137+0000 7f30fe7fc700 1 -- 172.21.15.17:0/798770993 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8022e00 con 0x7f3108100cf0 2023-07-14T12:58:48.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.137+0000 7f310f9ff700 1 -- 172.21.15.17:0/798770993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310819fe50 con 0x7f3108100cf0 2023-07-14T12:58:48.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.138+0000 7f310f9ff700 1 -- 172.21.15.17:0/798770993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3108106a00 con 0x7f3108100cf0 2023-07-14T12:58:48.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.140+0000 7f30fe7fc700 1 -- 172.21.15.17:0/798770993 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f30f800b980 con 0x7f3108100cf0 2023-07-14T12:58:48.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.141+0000 7f30fe7fc700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30f40a1220 0x7f30f40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:48.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.142+0000 7f30fe7fc700 1 -- 172.21.15.17:0/798770993 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f30f80ce180 con 0x7f3108100cf0 2023-07-14T12:58:48.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.142+0000 7f310d79b700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30f40a1220 0x7f30f40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:48.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.142+0000 7f310d79b700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30f40a1220 0x7f30f40a36d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3108100b50 tx=0x7f3104009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:48.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.144+0000 7f30fe7fc700 1 -- 172.21.15.17:0/798770993 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f30f80977d0 con 0x7f3108100cf0 2023-07-14T12:58:48.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:48 smithi017 ceph-mon[95536]: pgmap v338: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:48.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:48 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/946169853' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:58:48.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:48 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:58:48.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:48 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:58:48.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:48 smithi017 ceph-mon[95536]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:48.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:48 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/4167197004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:58:48.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.352+0000 7f310f9ff700 1 -- 172.21.15.17:0/798770993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f310802caa0 con 0x7f3108100cf0 2023-07-14T12:58:48.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.353+0000 7f30fe7fc700 1 -- 172.21.15.17:0/798770993 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22469 (secure 0 0 0) 0x7f30f809adf0 con 0x7f3108100cf0 2023-07-14T12:58:48.383 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:58:48.384 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":88,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:58:07.945460+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:58:48.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 -- 172.21.15.17:0/798770993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30f40a1220 msgr2=0x7f30f40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:48.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30f40a1220 0x7f30f40a36d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3108100b50 tx=0x7f3104009260 comp rx=0 tx=0).stop 2023-07-14T12:58:48.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 -- 172.21.15.17:0/798770993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108100cf0 msgr2=0x7f3108072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:48.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108100cf0 0x7f3108072900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30f8005910 tx=0x7f30f8005740 comp rx=0 tx=0).stop 2023-07-14T12:58:48.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 -- 172.21.15.17:0/798770993 shutdown_connections 2023-07-14T12:58:48.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30f40a1220 0x7f30f40a36d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3108101680 0x7f3108072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31080ffb00 0x7f31080742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 --2- 172.21.15.17:0/798770993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3108100cf0 0x7f3108072900 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 -- 172.21.15.17:0/798770993 >> 172.21.15.17:0/798770993 conn(0x7f31080fb0e0 msgr2=0x7f31080fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:48.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 -- 172.21.15.17:0/798770993 shutdown_connections 2023-07-14T12:58:48.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.356+0000 7f310f9ff700 1 -- 172.21.15.17:0/798770993 wait complete. 2023-07-14T12:58:48.405 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:58:48.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:48 smithi135 ceph-mon[97338]: pgmap v338: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:48.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:48 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/946169853' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:58:48.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:48 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:58:48.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:48 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:58:48.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:48 smithi135 ceph-mon[97338]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:48.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:48 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/4167197004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:58:48.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:48 smithi131 ceph-mon[96953]: pgmap v338: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:48.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:48 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/946169853' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:58:48.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:48 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:58:48.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:48 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:58:48.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:48 smithi131 ceph-mon[96953]: from='mgr.14150 172.21.15.17:0/1267853038' entity='mgr.x' 2023-07-14T12:58:48.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:48 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/4167197004' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:58:48.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.578+0000 7f020ffff700 1 -- 172.21.15.17:0/2538608870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0208101680 msgr2=0x7f0208107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.578+0000 7f020ffff700 1 --2- 172.21.15.17:0/2538608870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0208101680 0x7f0208107f40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f020000b0a0 tx=0x7f020000b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.578+0000 7f020ffff700 1 -- 172.21.15.17:0/2538608870 shutdown_connections 2023-07-14T12:58:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.578+0000 7f020ffff700 1 --2- 172.21.15.17:0/2538608870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0208101680 0x7f0208107f40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.578+0000 7f020ffff700 1 --2- 172.21.15.17:0/2538608870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080ffb00 0x7f02080fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.578+0000 7f020ffff700 1 --2- 172.21.15.17:0/2538608870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208100cf0 0x7f0208101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.578+0000 7f020ffff700 1 -- 172.21.15.17:0/2538608870 >> 172.21.15.17:0/2538608870 conn(0x7f02080fb0e0 msgr2=0x7f02080fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:48.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.578+0000 7f020ffff700 1 -- 172.21.15.17:0/2538608870 shutdown_connections 2023-07-14T12:58:48.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.578+0000 7f020ffff700 1 -- 172.21.15.17:0/2538608870 wait complete. 2023-07-14T12:58:48.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.579+0000 7f020ffff700 1 Processor -- start 2023-07-14T12:58:48.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.579+0000 7f020ffff700 1 -- start start 2023-07-14T12:58:48.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.579+0000 7f020ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080ffb00 0x7f02080742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:48.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.579+0000 7f020ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0208100cf0 0x7f0208072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:48.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.579+0000 7f020ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208101680 0x7f0208072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:48.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.579+0000 7f020ffff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02080735e0 con 0x7f0208100cf0 2023-07-14T12:58:48.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.579+0000 7f020ffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208073750 con 0x7f0208101680 2023-07-14T12:58:48.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.579+0000 7f020ffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020819f8e0 con 0x7f02080ffb00 2023-07-14T12:58:48.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020d59a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0208100cf0 0x7f0208072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:48.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080ffb00 0x7f02080742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:48.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020d59a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0208100cf0 0x7f0208072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56206/0 (socket says 172.21.15.17:56206) 2023-07-14T12:58:48.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080ffb00 0x7f02080742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34248/0 (socket says 172.21.15.17:34248) 2023-07-14T12:58:48.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020d59a700 1 -- 172.21.15.17:0/4030189556 learned_addr learned my addr 172.21.15.17:0/4030189556 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:48.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020e59c700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208101680 0x7f0208072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:48.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020d59a700 1 -- 172.21.15.17:0/4030189556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080ffb00 msgr2=0x7f02080742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:48.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020d59a700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080ffb00 0x7f02080742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020d59a700 1 -- 172.21.15.17:0/4030189556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208101680 msgr2=0x7f0208072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:48.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020d59a700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208101680 0x7f0208072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020d59a700 1 -- 172.21.15.17:0/4030189556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f8009520 con 0x7f0208100cf0 2023-07-14T12:58:48.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.580+0000 7f020d59a700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0208100cf0 0x7f0208072900 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f01f800eb30 tx=0x7f01f800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:48.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.581+0000 7f01feffd700 1 -- 172.21.15.17:0/4030189556 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8009880 con 0x7f0208100cf0 2023-07-14T12:58:48.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.581+0000 7f01feffd700 1 -- 172.21.15.17:0/4030189556 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01f80044b0 con 0x7f0208100cf0 2023-07-14T12:58:48.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.581+0000 7f020ffff700 1 -- 172.21.15.17:0/4030189556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0200009d00 con 0x7f0208100cf0 2023-07-14T12:58:48.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.581+0000 7f01feffd700 1 -- 172.21.15.17:0/4030189556 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8003df0 con 0x7f0208100cf0 2023-07-14T12:58:48.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.581+0000 7f020ffff700 1 -- 172.21.15.17:0/4030189556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020819ff40 con 0x7f0208100cf0 2023-07-14T12:58:48.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.582+0000 7f020ffff700 1 -- 172.21.15.17:0/4030189556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020810b200 con 0x7f0208100cf0 2023-07-14T12:58:48.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.584+0000 7f01feffd700 1 -- 172.21.15.17:0/4030189556 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f01f8003f50 con 0x7f0208100cf0 2023-07-14T12:58:48.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.585+0000 7f01feffd700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f01f40a1220 0x7f01f40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:48.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.585+0000 7f01feffd700 1 -- 172.21.15.17:0/4030189556 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f01f8014070 con 0x7f0208100cf0 2023-07-14T12:58:48.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.585+0000 7f020dd9b700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f01f40a1220 0x7f01f40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:48.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.586+0000 7f020dd9b700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f01f40a1220 0x7f01f40a36d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0208100b50 tx=0x7f0204009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:48.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.589+0000 7f01feffd700 1 -- 172.21.15.17:0/4030189556 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f01f8096460 con 0x7f0208100cf0 2023-07-14T12:58:48.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.844+0000 7f020ffff700 1 -- 172.21.15.17:0/4030189556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0208106990 con 0x7f0208100cf0 2023-07-14T12:58:48.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.845+0000 7f01feffd700 1 -- 172.21.15.17:0/4030189556 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10845 (secure 0 0 0) 0x7f01f8016330 con 0x7f0208100cf0 2023-07-14T12:58:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:58:48.875 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T12:57:45.208579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:58:48.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.847+0000 7f020ffff700 1 -- 172.21.15.17:0/4030189556 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f01f40a1220 msgr2=0x7f01f40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:48.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.847+0000 7f020ffff700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f01f40a1220 0x7f01f40a36d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0208100b50 tx=0x7f0204009260 comp rx=0 tx=0).stop 2023-07-14T12:58:48.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.847+0000 7f020ffff700 1 -- 172.21.15.17:0/4030189556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0208100cf0 msgr2=0x7f0208072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:48.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.847+0000 7f020ffff700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0208100cf0 0x7f0208072900 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f01f800eb30 tx=0x7f01f800ee40 comp rx=0 tx=0).stop 2023-07-14T12:58:48.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.847+0000 7f020ffff700 1 -- 172.21.15.17:0/4030189556 shutdown_connections 2023-07-14T12:58:48.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.847+0000 7f020ffff700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f01f40a1220 0x7f01f40a36d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.847+0000 7f020ffff700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208101680 0x7f0208072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.847+0000 7f020ffff700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080ffb00 0x7f02080742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.847+0000 7f020ffff700 1 --2- 172.21.15.17:0/4030189556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0208100cf0 0x7f0208072900 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:48.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.847+0000 7f020ffff700 1 -- 172.21.15.17:0/4030189556 >> 172.21.15.17:0/4030189556 conn(0x7f02080fb0e0 msgr2=0x7f02080fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:48.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.848+0000 7f020ffff700 1 -- 172.21.15.17:0/4030189556 shutdown_connections 2023-07-14T12:58:48.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:48.848+0000 7f020ffff700 1 -- 172.21.15.17:0/4030189556 wait complete. 2023-07-14T12:58:48.881 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2023-07-14T12:58:48.896 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-07-14T12:57:39.671161+0000', 'modified': '2023-07-14T12:57:45.208579+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24593, 'mds_1': 24548, 'mds_2': 24547}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24508': {'gid': 24508, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/1201140251', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 1201140251}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 1201140251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24515': {'gid': 24515, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.131:6835/1432780018', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6834', 'nonce': 1432780018}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 1432780018}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24526': {'gid': 24526, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6837/4030549564', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 4030549564}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 4030549564}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24547': {'gid': 24547, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.135:6839/2221555127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 2221555127}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 2221555127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24548': {'gid': 24548, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.131:6837/3087773753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6836', 'nonce': 3087773753}, {'type': 'v1', 'addr': '172.21.15.131:6837', 'nonce': 3087773753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24593': {'gid': 24593, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6839/2296586377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6838', 'nonce': 2296586377}, {'type': 'v1', 'addr': '172.21.15.131:6839', 'nonce': 2296586377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T12:58:48.897 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-07-14T12:58:48.897 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-07-14T12:58:49.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.073+0000 7f90da5ff700 1 -- 172.21.15.17:0/1442104951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90d4101660 msgr2=0x7f90d4107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.073+0000 7f90da5ff700 1 --2- 172.21.15.17:0/1442104951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90d4101660 0x7f90d4107f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00b0a0 tx=0x7f90cc00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.073+0000 7f90da5ff700 1 -- 172.21.15.17:0/1442104951 shutdown_connections 2023-07-14T12:58:49.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.073+0000 7f90da5ff700 1 --2- 172.21.15.17:0/1442104951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90d4101660 0x7f90d4107f20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.073+0000 7f90da5ff700 1 --2- 172.21.15.17:0/1442104951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d40ffae0 0x7f90d40ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.073+0000 7f90da5ff700 1 --2- 172.21.15.17:0/1442104951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d4100cd0 0x7f90d4101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.073+0000 7f90da5ff700 1 -- 172.21.15.17:0/1442104951 >> 172.21.15.17:0/1442104951 conn(0x7f90d40fb0e0 msgr2=0x7f90d40fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.073+0000 7f90da5ff700 1 -- 172.21.15.17:0/1442104951 shutdown_connections 2023-07-14T12:58:49.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.073+0000 7f90da5ff700 1 -- 172.21.15.17:0/1442104951 wait complete. 2023-07-14T12:58:49.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.074+0000 7f90da5ff700 1 Processor -- start 2023-07-14T12:58:49.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.074+0000 7f90da5ff700 1 -- start start 2023-07-14T12:58:49.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.074+0000 7f90da5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d40ffae0 0x7f90d4197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.074+0000 7f90da5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90d4100cd0 0x7f90d4197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.074+0000 7f90da5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d4101660 0x7f90d419f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.074+0000 7f90da5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d419f610 con 0x7f90d4100cd0 2023-07-14T12:58:49.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.074+0000 7f90da5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d419f750 con 0x7f90d4101660 2023-07-14T12:58:49.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.074+0000 7f90da5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d419f8e0 con 0x7f90d40ffae0 2023-07-14T12:58:49.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90d4100cd0 0x7f90d4197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90d4100cd0 0x7f90d4197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56224/0 (socket says 172.21.15.17:56224) 2023-07-14T12:58:49.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d37fe700 1 -- 172.21.15.17:0/1777577573 learned_addr learned my addr 172.21.15.17:0/1777577573 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d3fff700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d40ffae0 0x7f90d4197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d8b9c700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d4101660 0x7f90d419f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d37fe700 1 -- 172.21.15.17:0/1777577573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d40ffae0 msgr2=0x7f90d4197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d37fe700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d40ffae0 0x7f90d4197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d37fe700 1 -- 172.21.15.17:0/1777577573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d4101660 msgr2=0x7f90d419f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d37fe700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d4101660 0x7f90d419f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d37fe700 1 -- 172.21.15.17:0/1777577573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc009d00 con 0x7f90d4100cd0 2023-07-14T12:58:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d37fe700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90d4100cd0 0x7f90d4197fd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f90c800e9a0 tx=0x7f90c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d17fa700 1 -- 172.21.15.17:0/1777577573 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8009790 con 0x7f90d4100cd0 2023-07-14T12:58:49.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d17fa700 1 -- 172.21.15.17:0/1777577573 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90c800cbd0 con 0x7f90d4100cd0 2023-07-14T12:58:49.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.075+0000 7f90d17fa700 1 -- 172.21.15.17:0/1777577573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8018680 con 0x7f90d4100cd0 2023-07-14T12:58:49.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.076+0000 7f90da5ff700 1 -- 172.21.15.17:0/1777577573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d419fbc0 con 0x7f90d4100cd0 2023-07-14T12:58:49.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.076+0000 7f90da5ff700 1 -- 172.21.15.17:0/1777577573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d41a0080 con 0x7f90d4100cd0 2023-07-14T12:58:49.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.079+0000 7f90d17fa700 1 -- 172.21.15.17:0/1777577573 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f90c800cd40 con 0x7f90d4100cd0 2023-07-14T12:58:49.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.080+0000 7f90edfcdb80 1 Processor -- start 2023-07-14T12:58:49.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.080+0000 7f90d17fa700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90bc0a11e0 0x7f90bc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.080+0000 7f90edfcdb80 1 -- start start 2023-07-14T12:58:49.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.080+0000 7f90d17fa700 1 -- 172.21.15.17:0/1777577573 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f90c8014070 con 0x7f90d4100cd0 2023-07-14T12:58:49.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.080+0000 7f90d8b9c700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90bc0a11e0 0x7f90bc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.080+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8277890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8277dd0 0x556ee8278690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8278c20 0x556ee8279090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee817cc60 con 0x556ee8277480 2023-07-14T12:58:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee81cf9f0 con 0x556ee8277dd0 2023-07-14T12:58:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee81c8e80 con 0x556ee8278c20 2023-07-14T12:58:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8277890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8277890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56228/0 (socket says 172.21.15.17:56228) 2023-07-14T12:58:49.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d3fff700 1 -- 172.21.15.17:0/1247786712 learned_addr learned my addr 172.21.15.17:0/1247786712 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d8b9c700 1 --2- 172.21.15.17:0/1247786712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8278c20 0x556ee8279090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d37fe700 1 --2- 172.21.15.17:0/1247786712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8277dd0 0x556ee8278690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d8b9c700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90bc0a11e0 0x7f90bc0a3690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0062a0 tx=0x7f90cc0061f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d3fff700 1 -- 172.21.15.17:0/1247786712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8278c20 msgr2=0x556ee8279090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d3fff700 1 --2- 172.21.15.17:0/1247786712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8278c20 0x556ee8279090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d3fff700 1 -- 172.21.15.17:0/1247786712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8277dd0 msgr2=0x556ee8278690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d3fff700 1 --2- 172.21.15.17:0/1247786712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8277dd0 0x556ee8278690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d3fff700 1 -- 172.21.15.17:0/1247786712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ee7ff6d90 con 0x556ee8277480 2023-07-14T12:58:49.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.081+0000 7f90d3fff700 1 --2- 172.21.15.17:0/1247786712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8277890 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009d30 tx=0x7f90c4011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67c7d87543c1c94 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.082+0000 7f90ba7fc700 1 -- 172.21.15.17:0/1247786712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4004220 con 0x556ee8277480 2023-07-14T12:58:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.082+0000 7f90ba7fc700 1 -- 172.21.15.17:0/1247786712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90c4004380 con 0x556ee8277480 2023-07-14T12:58:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.082+0000 7f90ba7fc700 1 -- 172.21.15.17:0/1247786712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4019780 con 0x556ee8277480 2023-07-14T12:58:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.082+0000 7f90edfcdb80 1 -- 172.21.15.17:0/1247786712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 msgr2=0x556ee8277890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.082+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/1247786712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8277890 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009d30 tx=0x7f90c4011720 comp rx=0 tx=0).stop 2023-07-14T12:58:49.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.083+0000 7f90edfcdb80 1 -- 172.21.15.17:0/1247786712 shutdown_connections 2023-07-14T12:58:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.083+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/1247786712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8278c20 0x556ee8279090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.083+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/1247786712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8277890 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.083+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/1247786712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8277dd0 0x556ee8278690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.083+0000 7f90edfcdb80 1 -- 172.21.15.17:0/1247786712 >> 172.21.15.17:0/1247786712 conn(0x556ee826cd50 msgr2=0x556ee8272180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.083+0000 7f90edfcdb80 1 -- 172.21.15.17:0/1247786712 shutdown_connections 2023-07-14T12:58:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.083+0000 7f90edfcdb80 1 -- 172.21.15.17:0/1247786712 wait complete. 2023-07-14T12:58:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.083+0000 7f90edfcdb80 1 -- start start 2023-07-14T12:58:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.083+0000 7f90edfcdb80 1 Processor -- start 2023-07-14T12:58:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8281160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8277dd0 0x556ee82816a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 0x556ee82886e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee8168a70 con 0x556ee8277480 2023-07-14T12:58:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee8168770 con 0x556ee8278c20 2023-07-14T12:58:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee804c8d0 con 0x556ee8277dd0 2023-07-14T12:58:49.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90edfcdb80 10 client.0 _ll_register_callbacks cb 0x556ee8166710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:58:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90d3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8281160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90d3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8281160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56236/0 (socket says 172.21.15.17:56236) 2023-07-14T12:58:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90d3fff700 1 -- 172.21.15.17:0/3856528040 learned_addr learned my addr 172.21.15.17:0/3856528040 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90d37fe700 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8277dd0 0x556ee82816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90d8b9c700 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 0x556ee82886e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90d3fff700 1 -- 172.21.15.17:0/3856528040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8277dd0 msgr2=0x556ee82816a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90d3fff700 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8277dd0 0x556ee82816a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90d3fff700 1 -- 172.21.15.17:0/3856528040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 msgr2=0x556ee82886e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90d3fff700 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 0x556ee82886e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90d3fff700 1 -- 172.21.15.17:0/3856528040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c4009960 con 0x556ee8277480 2023-07-14T12:58:49.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.084+0000 7f90d8b9c700 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 0x556ee82886e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:49.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.085+0000 7f90d3fff700 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8281160 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f90c4000c00 tx=0x7f90c4009fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ee4e0048cf32fb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.085+0000 7f90b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:58:49.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.085+0000 7f90b37fe700 1 -- 172.21.15.17:0/3856528040 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4005240 con 0x556ee8277480 2023-07-14T12:58:49.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.085+0000 7f90b37fe700 1 -- 172.21.15.17:0/3856528040 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f90c40053a0 con 0x556ee8277480 2023-07-14T12:58:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.085+0000 7f90edfcdb80 1 -- 172.21.15.17:0/3856528040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ee81224a0 con 0x556ee8277480 2023-07-14T12:58:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.085+0000 7f90b37fe700 1 -- 172.21.15.17:0/3856528040 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90c4003ac0 con 0x556ee8277480 2023-07-14T12:58:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.085+0000 7f90edfcdb80 10 client.15099 fetch_fsmap learned FSMap version 22 2023-07-14T12:58:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.085+0000 7f90edfcdb80 1 -- 172.21.15.17:0/3856528040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x556ee7fdfc10 con 0x556ee8277480 2023-07-14T12:58:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.086+0000 7f90b37fe700 1 -- 172.21.15.17:0/3856528040 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556ee81224a0 con 0x556ee8277480 2023-07-14T12:58:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.086+0000 7f90b37fe700 1 -- 172.21.15.17:0/3856528040 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f90c4021040 con 0x556ee8277480 2023-07-14T12:58:49.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.086+0000 7f90edfcdb80 10 client.15099 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:58:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.086+0000 7f90edfcdb80 10 client.15099 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-14T12:58:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.086+0000 7f90edfcdb80 20 client.15099 populate_metadata read hostname 'smithi017' 2023-07-14T12:58:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.086+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x556ee828c330 0x556ee828b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.086+0000 7f90edfcdb80 4 client.15099 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:58:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.086+0000 7f90edfcdb80 1 -- 172.21.15.17:0/3856528040 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ee81c1e60 con 0x556ee828c330 2023-07-14T12:58:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.086+0000 7f90d37fe700 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x556ee828c330 0x556ee828b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.087+0000 7f90d37fe700 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x556ee828c330 0x556ee828b790 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1e608cf4303d037 server_cookie=bec709917f710970 in_seq=0 out_seq=0 2023-07-14T12:58:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.087+0000 7f90b37fe700 10 client.15099 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T12:58:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90b37fe700 1 -- 172.21.15.17:0/3856528040 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556ee81c1e60 con 0x556ee828c330 2023-07-14T12:58:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90b37fe700 10 client.15099 handle_command_reply: tid=0 2023-07-14T12:58:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90edfcdb80 1 client.15099 shutdown 2023-07-14T12:58:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90edfcdb80 1 -- 172.21.15.17:0/3856528040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 msgr2=0x556ee8281160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8281160 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f90c4000c00 tx=0x7f90c4009fc0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90edfcdb80 1 -- 172.21.15.17:0/3856528040 shutdown_connections 2023-07-14T12:58:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 0x556ee82886e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8281160 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x556ee828c330 0x556ee828b790 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/3856528040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8277dd0 0x556ee82816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90edfcdb80 1 -- 172.21.15.17:0/3856528040 >> 172.21.15.17:0/3856528040 conn(0x556ee826cd50 msgr2=0x556ee8271860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.088+0000 7f90b37fe700 0 client.15099 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T12:58:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.089+0000 7f90edfcdb80 1 -- 172.21.15.17:0/3856528040 shutdown_connections 2023-07-14T12:58:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.089+0000 7f90edfcdb80 1 -- 172.21.15.17:0/3856528040 wait complete. 2023-07-14T12:58:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.089+0000 7f90edfcdb80 20 client.15099 trim_cache size 0 max 16384 2023-07-14T12:58:49.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.107+0000 7f90edfcdb80 1 Processor -- start 2023-07-14T12:58:49.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.107+0000 7f90edfcdb80 1 -- start start 2023-07-14T12:58:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8271860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8277dd0 0x556ee82886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 0x556ee828b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee81c1e60 con 0x556ee8277480 2023-07-14T12:58:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee81224a0 con 0x556ee8278c20 2023-07-14T12:58:49.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee8197790 con 0x556ee8277dd0 2023-07-14T12:58:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90d3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8271860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90d3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8271860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56246/0 (socket says 172.21.15.17:56246) 2023-07-14T12:58:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90d3fff700 1 -- 172.21.15.17:0/590699575 learned_addr learned my addr 172.21.15.17:0/590699575 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90d3fff700 1 -- 172.21.15.17:0/590699575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8277dd0 msgr2=0x556ee82886a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90d3fff700 1 --2- 172.21.15.17:0/590699575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8277dd0 0x556ee82886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90d3fff700 1 -- 172.21.15.17:0/590699575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 msgr2=0x556ee828b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90d8b9c700 1 --2- 172.21.15.17:0/590699575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 0x556ee828b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90d3fff700 1 --2- 172.21.15.17:0/590699575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 0x556ee828b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90d3fff700 1 -- 172.21.15.17:0/590699575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ee801d200 con 0x556ee8277480 2023-07-14T12:58:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90d8b9c700 1 --2- 172.21.15.17:0/590699575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 0x556ee828b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:58:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.108+0000 7f90d3fff700 1 --2- 172.21.15.17:0/590699575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8271860 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f90c4005e70 tx=0x7f90c4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3588839f54d164d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90baffd700 1 -- 172.21.15.17:0/590699575 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4019430 con 0x556ee8277480 2023-07-14T12:58:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90baffd700 1 -- 172.21.15.17:0/590699575 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90c4003730 con 0x556ee8277480 2023-07-14T12:58:49.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90baffd700 1 -- 172.21.15.17:0/590699575 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400fb00 con 0x556ee8277480 2023-07-14T12:58:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90edfcdb80 1 -- 172.21.15.17:0/590699575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 msgr2=0x556ee8271860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/590699575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8271860 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f90c4005e70 tx=0x7f90c4009260 comp rx=0 tx=0).stop 2023-07-14T12:58:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90edfcdb80 1 -- 172.21.15.17:0/590699575 shutdown_connections 2023-07-14T12:58:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/590699575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8278c20 0x556ee828b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/590699575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277480 0x556ee8271860 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/590699575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8277dd0 0x556ee82886a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90edfcdb80 1 -- 172.21.15.17:0/590699575 >> 172.21.15.17:0/590699575 conn(0x556ee826cd50 msgr2=0x556ee827fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90edfcdb80 1 -- 172.21.15.17:0/590699575 shutdown_connections 2023-07-14T12:58:49.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.109+0000 7f90edfcdb80 1 -- 172.21.15.17:0/590699575 wait complete. 2023-07-14T12:58:49.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.110+0000 7f90edfcdb80 1 -- start start 2023-07-14T12:58:49.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.110+0000 7f90edfcdb80 1 Processor -- start 2023-07-14T12:58:49.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8277480 0x556ee8283910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277dd0 0x556ee8283e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90edfcdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8278c20 0x556ee8286ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee8287220 con 0x556ee8277dd0 2023-07-14T12:58:49.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee8287390 con 0x556ee8277480 2023-07-14T12:58:49.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90edfcdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ee8287550 con 0x556ee8278c20 2023-07-14T12:58:49.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90edfcdb80 10 client.0 _ll_register_callbacks cb 0x7f90c4009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:58:49.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90d37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277dd0 0x556ee8283e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90d37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277dd0 0x556ee8283e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56250/0 (socket says 172.21.15.17:56250) 2023-07-14T12:58:49.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90d37fe700 1 -- 172.21.15.17:0/2003041478 learned_addr learned my addr 172.21.15.17:0/2003041478 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90d8b9c700 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8278c20 0x556ee8286ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90d3fff700 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8277480 0x556ee8283910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90d37fe700 1 -- 172.21.15.17:0/2003041478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8278c20 msgr2=0x556ee8286ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90d37fe700 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8278c20 0x556ee8286ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90d37fe700 1 -- 172.21.15.17:0/2003041478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8277480 msgr2=0x556ee8283910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90d37fe700 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8277480 0x556ee8283910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90d37fe700 1 -- 172.21.15.17:0/2003041478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ee7fdfc10 con 0x556ee8277dd0 2023-07-14T12:58:49.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.111+0000 7f90d3fff700 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8277480 0x556ee8283910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:49.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90d37fe700 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277dd0 0x556ee8283e50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f90c8099f80 tx=0x7f90c809e190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea821be85dff651 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:58:49.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90b37fe700 1 -- 172.21.15.17:0/2003041478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80994e0 con 0x556ee8277dd0 2023-07-14T12:58:49.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90b37fe700 1 -- 172.21.15.17:0/2003041478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f90c8099640 con 0x556ee8277dd0 2023-07-14T12:58:49.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90edfcdb80 1 -- 172.21.15.17:0/2003041478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ee8184000 con 0x556ee8277dd0 2023-07-14T12:58:49.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90b37fe700 1 -- 172.21.15.17:0/2003041478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90c80a1fb0 con 0x556ee8277dd0 2023-07-14T12:58:49.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90edfcdb80 10 client.15105 fetch_fsmap learned FSMap version 22 2023-07-14T12:58:49.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90edfcdb80 1 -- 172.21.15.17:0/2003041478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x556ee7ff5260 con 0x556ee8277dd0 2023-07-14T12:58:49.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90b37fe700 1 -- 172.21.15.17:0/2003041478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556ee8184000 con 0x556ee8277dd0 2023-07-14T12:58:49.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90b37fe700 1 -- 172.21.15.17:0/2003041478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f90c8095de0 con 0x556ee8277dd0 2023-07-14T12:58:49.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90edfcdb80 10 client.15105 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:58:49.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90edfcdb80 10 client.15105 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-14T12:58:49.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.112+0000 7f90edfcdb80 20 client.15105 populate_metadata read hostname 'smithi017' 2023-07-14T12:58:49.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.113+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x556ee82e57b0 0x556ee82e21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.113+0000 7f90edfcdb80 4 client.15105 mds_command: new command op to 24547 tid=0[{"prefix": "status"}] 2023-07-14T12:58:49.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.113+0000 7f90edfcdb80 1 -- 172.21.15.17:0/2003041478 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556ee8017f20 con 0x556ee82e57b0 2023-07-14T12:58:49.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.113+0000 7f90d3fff700 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x556ee82e57b0 0x556ee82e21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.113+0000 7f90d3fff700 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x556ee82e57b0 0x556ee82e21c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c9561d3543d9ef54 server_cookie=ab2d1b140fe7cc8e in_seq=0 out_seq=0 2023-07-14T12:58:49.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.113+0000 7f90b37fe700 10 client.15105 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T12:58:49.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90b37fe700 1 -- 172.21.15.17:0/2003041478 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x556ee8017f20 con 0x556ee82e57b0 2023-07-14T12:58:49.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90b37fe700 10 client.15105 handle_command_reply: tid=0 2023-07-14T12:58:49.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 1 client.15105 shutdown 2023-07-14T12:58:49.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 1 -- 172.21.15.17:0/2003041478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277dd0 msgr2=0x556ee8283e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277dd0 0x556ee8283e50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f90c8099f80 tx=0x7f90c809e190 comp rx=0 tx=0).stop 2023-07-14T12:58:49.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 1 -- 172.21.15.17:0/2003041478 shutdown_connections 2023-07-14T12:58:49.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x556ee82e57b0 0x556ee82e21c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ee8278c20 0x556ee8286ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556ee8277480 0x556ee8283910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 1 --2- 172.21.15.17:0/2003041478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556ee8277dd0 0x556ee8283e50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90b37fe700 0 client.15105 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T12:58:49.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 1 -- 172.21.15.17:0/2003041478 >> 172.21.15.17:0/2003041478 conn(0x556ee826cd50 msgr2=0x556ee827fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 1 -- 172.21.15.17:0/2003041478 shutdown_connections 2023-07-14T12:58:49.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 1 -- 172.21.15.17:0/2003041478 wait complete. 2023-07-14T12:58:49.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.114+0000 7f90edfcdb80 20 client.15105 trim_cache size 0 max 16384 2023-07-14T12:58:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:58:49.158 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b31a3268-2244-11ee-9b33-001a4aab830c", 2023-07-14T12:58:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2023-07-14T12:58:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24547, 2023-07-14T12:58:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-07-14T12:58:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-07-14T12:58:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-07-14T12:58:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 64.914874806, 2023-07-14T12:58:49.159 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 22, 2023-07-14T12:58:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 88, 2023-07-14T12:58:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 86, 2023-07-14T12:58:49.160 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 84.846134285999995 2023-07-14T12:58:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:58:49.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 -- 172.21.15.17:0/1777577573 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90bc0a11e0 msgr2=0x7f90bc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90bc0a11e0 0x7f90bc0a3690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0062a0 tx=0x7f90cc0061f0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 -- 172.21.15.17:0/1777577573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90d4100cd0 msgr2=0x7f90d4197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90d4100cd0 0x7f90d4197fd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f90c800e9a0 tx=0x7f90c800ecb0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 -- 172.21.15.17:0/1777577573 shutdown_connections 2023-07-14T12:58:49.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f90bc0a11e0 0x7f90bc0a3690 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90d4101660 0x7f90d419f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d40ffae0 0x7f90d4197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 --2- 172.21.15.17:0/1777577573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90d4100cd0 0x7f90d4197fd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 -- 172.21.15.17:0/1777577573 >> 172.21.15.17:0/1777577573 conn(0x7f90d40fb0e0 msgr2=0x7f90d40fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 -- 172.21.15.17:0/1777577573 shutdown_connections 2023-07-14T12:58:49.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.115+0000 7f90da5ff700 1 -- 172.21.15.17:0/1777577573 wait complete. 2023-07-14T12:58:49.162 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:49 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/798770993' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:49.163 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:49 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/4030189556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:58:49.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-07-14T12:58:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.338+0000 7fa8b97ff700 1 -- 172.21.15.17:0/198713205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b4101660 msgr2=0x7fa8b4107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.338+0000 7fa8b97ff700 1 --2- 172.21.15.17:0/198713205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b4101660 0x7fa8b4107f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00b0a0 tx=0x7fa8ac00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.338+0000 7fa8b97ff700 1 -- 172.21.15.17:0/198713205 shutdown_connections 2023-07-14T12:58:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.338+0000 7fa8b97ff700 1 --2- 172.21.15.17:0/198713205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b4101660 0x7fa8b4107f20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.338+0000 7fa8b97ff700 1 --2- 172.21.15.17:0/198713205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b40ffae0 0x7fa8b40ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.338+0000 7fa8b97ff700 1 --2- 172.21.15.17:0/198713205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8b4100cd0 0x7fa8b4101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.338+0000 7fa8b97ff700 1 -- 172.21.15.17:0/198713205 >> 172.21.15.17:0/198713205 conn(0x7fa8b40fb0e0 msgr2=0x7fa8b40fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.338+0000 7fa8b97ff700 1 -- 172.21.15.17:0/198713205 shutdown_connections 2023-07-14T12:58:49.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.338+0000 7fa8b97ff700 1 -- 172.21.15.17:0/198713205 wait complete. 2023-07-14T12:58:49.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.339+0000 7fa8b97ff700 1 Processor -- start 2023-07-14T12:58:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.339+0000 7fa8b97ff700 1 -- start start 2023-07-14T12:58:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b97ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b40ffae0 0x7fa8b41958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b97ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8b4100cd0 0x7fa8b4195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b97ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b4101660 0x7fa8b419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b97ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b419d420 con 0x7fa8b4101660 2023-07-14T12:58:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b97ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b419d560 con 0x7fa8b4100cd0 2023-07-14T12:58:49.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b97ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b419d6f0 con 0x7fa8b40ffae0 2023-07-14T12:58:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b4101660 0x7fa8b419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b4101660 0x7fa8b419ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56274/0 (socket says 172.21.15.17:56274) 2023-07-14T12:58:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b37fe700 1 -- 172.21.15.17:0/3195423010 learned_addr learned my addr 172.21.15.17:0/3195423010 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b2ffd700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b40ffae0 0x7fa8b41958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b37fe700 1 -- 172.21.15.17:0/3195423010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b40ffae0 msgr2=0x7fa8b41958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b40ffae0 0x7fa8b41958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b37fe700 1 -- 172.21.15.17:0/3195423010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8b4100cd0 msgr2=0x7fa8b4195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8b4100cd0 0x7fa8b4195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b37fe700 1 -- 172.21.15.17:0/3195423010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac009d00 con 0x7fa8b4101660 2023-07-14T12:58:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.340+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b4101660 0x7fa8b419ce50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009fd0 tx=0x7fa8ac00bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.341+0000 7fa89bfff700 1 -- 172.21.15.17:0/3195423010 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00e040 con 0x7fa8b4101660 2023-07-14T12:58:49.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.341+0000 7fa89bfff700 1 -- 172.21.15.17:0/3195423010 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8ac003c00 con 0x7fa8b4101660 2023-07-14T12:58:49.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.341+0000 7fa89bfff700 1 -- 172.21.15.17:0/3195423010 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac01b6c0 con 0x7fa8b4101660 2023-07-14T12:58:49.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.341+0000 7fa8b97ff700 1 -- 172.21.15.17:0/3195423010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b419d970 con 0x7fa8b4101660 2023-07-14T12:58:49.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.341+0000 7fa8b97ff700 1 -- 172.21.15.17:0/3195423010 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b419dd40 con 0x7fa8b4101660 2023-07-14T12:58:49.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.344+0000 7fa89bfff700 1 -- 172.21.15.17:0/3195423010 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fa8ac01d470 con 0x7fa8b4101660 2023-07-14T12:58:49.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa8cd1b0b80 1 Processor -- start 2023-07-14T12:58:49.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa8cd1b0b80 1 -- start start 2023-07-14T12:58:49.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa89bfff700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa89c0a11e0 0x7fa89c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa89bfff700 1 -- 172.21.15.17:0/3195423010 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa8ac0cde00 con 0x7fa8b4101660 2023-07-14T12:58:49.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973a890 0x559dd973aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973b1e0 0x559dd973baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa8b27fc700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa89c0a11e0 0x7fa89c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd973c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd963bc60 con 0x559dd973c030 2023-07-14T12:58:49.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd968e9f0 con 0x559dd973b1e0 2023-07-14T12:58:49.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd9687e80 con 0x559dd973a890 2023-07-14T12:58:49.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.346+0000 7fa8b37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd973c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd973c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56288/0 (socket says 172.21.15.17:56288) 2023-07-14T12:58:49.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b37fe700 1 -- 172.21.15.17:0/262977211 learned_addr learned my addr 172.21.15.17:0/262977211 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b27fc700 1 --2- 172.21.15.17:0/262977211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973b1e0 0x559dd973baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b2ffd700 1 --2- 172.21.15.17:0/262977211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973a890 0x559dd973aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b37fe700 1 -- 172.21.15.17:0/262977211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973a890 msgr2=0x559dd973aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/262977211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973a890 0x559dd973aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b37fe700 1 -- 172.21.15.17:0/262977211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973b1e0 msgr2=0x559dd973baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/262977211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973b1e0 0x559dd973baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b37fe700 1 -- 172.21.15.17:0/262977211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd94b5d90 con 0x559dd973c030 2023-07-14T12:58:49.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b2ffd700 1 --2- 172.21.15.17:0/262977211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973a890 0x559dd973aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:58:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b27fc700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa89c0a11e0 0x7fa89c0a3690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80094f0 tx=0x7fa8a8009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/262977211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd973c4a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0a2fa0 tx=0x7fa8ac09aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9c7812ccae3588 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8997fa700 1 -- 172.21.15.17:0/262977211 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac09f140 con 0x559dd973c030 2023-07-14T12:58:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8997fa700 1 -- 172.21.15.17:0/262977211 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8ac0a34d0 con 0x559dd973c030 2023-07-14T12:58:49.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.347+0000 7fa8997fa700 1 -- 172.21.15.17:0/262977211 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac09b5d0 con 0x559dd973c030 2023-07-14T12:58:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.348+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/262977211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 msgr2=0x559dd973c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.348+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/262977211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd973c4a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0a2fa0 tx=0x7fa8ac09aa70 comp rx=0 tx=0).stop 2023-07-14T12:58:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.348+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/262977211 shutdown_connections 2023-07-14T12:58:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.348+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/262977211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd973c4a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.348+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/262977211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973a890 0x559dd973aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.348+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/262977211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973b1e0 0x559dd973baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.348+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/262977211 >> 172.21.15.17:0/262977211 conn(0x559dd972bd50 msgr2=0x559dd9731180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.348+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/262977211 shutdown_connections 2023-07-14T12:58:49.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.348+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/262977211 wait complete. 2023-07-14T12:58:49.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.349+0000 7fa8cd1b0b80 1 -- start start 2023-07-14T12:58:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.349+0000 7fa8cd1b0b80 1 Processor -- start 2023-07-14T12:58:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973a890 0x559dd97442f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973b1e0 0x559dd9744830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd974b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd9627a70 con 0x559dd973c030 2023-07-14T12:58:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd9627770 con 0x559dd973a890 2023-07-14T12:58:49.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd950b8d0 con 0x559dd973b1e0 2023-07-14T12:58:49.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8cd1b0b80 10 client.0 _ll_register_callbacks cb 0x559dd9625710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:58:49.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8b37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd974b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8b37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd974b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56298/0 (socket says 172.21.15.17:56298) 2023-07-14T12:58:49.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8b37fe700 1 -- 172.21.15.17:0/3155898228 learned_addr learned my addr 172.21.15.17:0/3155898228 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8b27fc700 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973b1e0 0x559dd9744830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8b2ffd700 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973a890 0x559dd97442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8b37fe700 1 -- 172.21.15.17:0/3155898228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973b1e0 msgr2=0x559dd9744830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973b1e0 0x559dd9744830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8b37fe700 1 -- 172.21.15.17:0/3155898228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973a890 msgr2=0x559dd97442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973a890 0x559dd97442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8b37fe700 1 -- 172.21.15.17:0/3155898228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b419dd40 con 0x559dd973c030 2023-07-14T12:58:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.350+0000 7fa8b2ffd700 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973a890 0x559dd97442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.351+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd974b870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac09ae10 tx=0x7fa8ac0cbc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5611f8ab937302f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.351+0000 7fa896ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:58:49.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.351+0000 7fa896ff5700 1 -- 172.21.15.17:0/3155898228 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0994b0 con 0x559dd973c030 2023-07-14T12:58:49.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.351+0000 7fa896ff5700 1 -- 172.21.15.17:0/3155898228 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa8ac09b580 con 0x559dd973c030 2023-07-14T12:58:49.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.351+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3155898228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559dd95e14a0 con 0x559dd973c030 2023-07-14T12:58:49.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.351+0000 7fa896ff5700 1 -- 172.21.15.17:0/3155898228 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8ac0b9250 con 0x559dd973c030 2023-07-14T12:58:49.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.351+0000 7fa8cd1b0b80 10 client.15117 fetch_fsmap learned FSMap version 22 2023-07-14T12:58:49.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.351+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3155898228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x559dd949ec10 con 0x559dd973c030 2023-07-14T12:58:49.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.351+0000 7fa896ff5700 1 -- 172.21.15.17:0/3155898228 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8ac0cb020 con 0x559dd973c030 2023-07-14T12:58:49.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.351+0000 7fa896ff5700 1 -- 172.21.15.17:0/3155898228 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa8ac096f00 con 0x559dd973c030 2023-07-14T12:58:49.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.351+0000 7fa8cd1b0b80 10 client.15117 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:58:49.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.352+0000 7fa8cd1b0b80 10 client.15117 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-14T12:58:49.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.352+0000 7fa8cd1b0b80 20 client.15117 populate_metadata read hostname 'smithi017' 2023-07-14T12:58:49.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.352+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x559dd974ef80 0x559dd974e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.352+0000 7fa8cd1b0b80 4 client.15117 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:58:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.352+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3155898228 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559dd9680e60 con 0x559dd974ef80 2023-07-14T12:58:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.352+0000 7fa8b2ffd700 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x559dd974ef80 0x559dd974e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.353+0000 7fa8b2ffd700 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x559dd974ef80 0x559dd974e710 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=799128f86bf156d server_cookie=cc05b5c265ac737d in_seq=0 out_seq=0 2023-07-14T12:58:49.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.353+0000 7fa896ff5700 10 client.15117 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T12:58:49.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa896ff5700 1 -- 172.21.15.17:0/3155898228 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559dd9680e60 con 0x559dd974ef80 2023-07-14T12:58:49.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa896ff5700 10 client.15117 handle_command_reply: tid=0 2023-07-14T12:58:49.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 1 client.15117 shutdown 2023-07-14T12:58:49.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3155898228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 msgr2=0x559dd974b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd974b870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac09ae10 tx=0x7fa8ac0cbc00 comp rx=0 tx=0).stop 2023-07-14T12:58:49.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3155898228 shutdown_connections 2023-07-14T12:58:49.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973c030 0x559dd974b870 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x559dd974ef80 0x559dd974e710 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973a890 0x559dd97442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3155898228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973b1e0 0x559dd9744830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3155898228 >> 172.21.15.17:0/3155898228 conn(0x559dd972bd50 msgr2=0x559dd9730860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa896ff5700 0 client.15117 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T12:58:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3155898228 shutdown_connections 2023-07-14T12:58:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3155898228 wait complete. 2023-07-14T12:58:49.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.354+0000 7fa8cd1b0b80 20 client.15117 trim_cache size 0 max 16384 2023-07-14T12:58:49.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.373+0000 7fa8cd1b0b80 1 Processor -- start 2023-07-14T12:58:49.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.373+0000 7fa8cd1b0b80 1 -- start start 2023-07-14T12:58:49.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.373+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973a890 0x559dd9730860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.373+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd974b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.373+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973c030 0x559dd9742420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.373+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd973b5b0 con 0x559dd973b1e0 2023-07-14T12:58:49.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.373+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd9750240 con 0x559dd973c030 2023-07-14T12:58:49.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.373+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd972de90 con 0x559dd973a890 2023-07-14T12:58:49.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.373+0000 7fa8b27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd974b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa8b27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd974b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56308/0 (socket says 172.21.15.17:56308) 2023-07-14T12:58:49.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa8b27fc700 1 -- 172.21.15.17:0/104356120 learned_addr learned my addr 172.21.15.17:0/104356120 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/104356120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973c030 0x559dd9742420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa8b2ffd700 1 --2- 172.21.15.17:0/104356120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973a890 0x559dd9730860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa8b27fc700 1 -- 172.21.15.17:0/104356120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973a890 msgr2=0x559dd9730860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa8b27fc700 1 --2- 172.21.15.17:0/104356120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973a890 0x559dd9730860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa8b27fc700 1 -- 172.21.15.17:0/104356120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973c030 msgr2=0x559dd9742420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa8b27fc700 1 --2- 172.21.15.17:0/104356120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973c030 0x559dd9742420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa8b27fc700 1 -- 172.21.15.17:0/104356120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd9731420 con 0x559dd973b1e0 2023-07-14T12:58:49.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/104356120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973c030 0x559dd9742420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:49.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa8b27fc700 1 --2- 172.21.15.17:0/104356120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd974b830 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8010f00 tx=0x7fa8a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd10025357d53c5a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.374+0000 7fa899ffb700 1 -- 172.21.15.17:0/104356120 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8004220 con 0x559dd973b1e0 2023-07-14T12:58:49.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.375+0000 7fa899ffb700 1 -- 172.21.15.17:0/104356120 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8a8009e80 con 0x559dd973b1e0 2023-07-14T12:58:49.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.375+0000 7fa899ffb700 1 -- 172.21.15.17:0/104356120 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80126b0 con 0x559dd973b1e0 2023-07-14T12:58:49.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.375+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/104356120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 msgr2=0x559dd974b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.375+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/104356120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd974b830 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8010f00 tx=0x7fa8a8019000 comp rx=0 tx=0).stop 2023-07-14T12:58:49.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.375+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/104356120 shutdown_connections 2023-07-14T12:58:49.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.375+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/104356120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973c030 0x559dd9742420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.375+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/104356120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973a890 0x559dd9730860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.375+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/104356120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd974b830 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.375+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/104356120 >> 172.21.15.17:0/104356120 conn(0x559dd972bd50 msgr2=0x559dd9742fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.375+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/104356120 shutdown_connections 2023-07-14T12:58:49.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.375+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/104356120 wait complete. 2023-07-14T12:58:49.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.376+0000 7fa8cd1b0b80 1 -- start start 2023-07-14T12:58:49.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.376+0000 7fa8cd1b0b80 1 Processor -- start 2023-07-14T12:58:49.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.376+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973a890 0x559dd9747720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.376+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd9747c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.376+0000 7fa8cd1b0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973c030 0x559dd974ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.376+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd974b1c0 con 0x559dd973b1e0 2023-07-14T12:58:49.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.376+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd974b330 con 0x559dd973a890 2023-07-14T12:58:49.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.376+0000 7fa8cd1b0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd974b4f0 con 0x559dd973c030 2023-07-14T12:58:49.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.376+0000 7fa8cd1b0b80 10 client.0 _ll_register_callbacks cb 0x7fa8ac09ac50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:58:49.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa8b27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd9747c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa8b27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd9747c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56324/0 (socket says 172.21.15.17:56324) 2023-07-14T12:58:49.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa8b27fc700 1 -- 172.21.15.17:0/3978759699 learned_addr learned my addr 172.21.15.17:0/3978759699 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa8b37fe700 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973c030 0x559dd974ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa8b2ffd700 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973a890 0x559dd9747720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa8b27fc700 1 -- 172.21.15.17:0/3978759699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973c030 msgr2=0x559dd974ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa8b27fc700 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973c030 0x559dd974ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa8b27fc700 1 -- 172.21.15.17:0/3978759699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973a890 msgr2=0x559dd9747720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa8b27fc700 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973a890 0x559dd9747720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa8b27fc700 1 -- 172.21.15.17:0/3978759699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a8010bb0 con 0x559dd973b1e0 2023-07-14T12:58:49.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa8b27fc700 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd9747c60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8029040 tx=0x7fa8a80042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5800ad53c8e57726 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa896ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:58:49.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.377+0000 7fa896ff5700 1 -- 172.21.15.17:0/3978759699 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8009a50 con 0x559dd973b1e0 2023-07-14T12:58:49.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3978759699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8ac0a34d0 con 0x559dd973b1e0 2023-07-14T12:58:49.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa896ff5700 1 -- 172.21.15.17:0/3978759699 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa8a8004830 con 0x559dd973b1e0 2023-07-14T12:58:49.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa896ff5700 1 -- 172.21.15.17:0/3978759699 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8a80049f0 con 0x559dd973b1e0 2023-07-14T12:58:49.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa8cd1b0b80 10 client.15123 fetch_fsmap learned FSMap version 22 2023-07-14T12:58:49.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3978759699 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x559dd94dc200 con 0x559dd973b1e0 2023-07-14T12:58:49.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa896ff5700 1 -- 172.21.15.17:0/3978759699 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8a8041020 con 0x559dd973b1e0 2023-07-14T12:58:49.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa896ff5700 1 -- 172.21.15.17:0/3978759699 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa8a802f070 con 0x559dd973b1e0 2023-07-14T12:58:49.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa8cd1b0b80 10 client.15123 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:58:49.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa8cd1b0b80 10 client.15123 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-14T12:58:49.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa8cd1b0b80 20 client.15123 populate_metadata read hostname 'smithi017' 2023-07-14T12:58:49.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x559dd97a9240 0x559dd97a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa8cd1b0b80 4 client.15123 mds_command: new command op to 24548 tid=0[{"prefix": "status"}] 2023-07-14T12:58:49.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.378+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3978759699 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559dd9643000 con 0x559dd97a9240 2023-07-14T12:58:49.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.379+0000 7fa8b2ffd700 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x559dd97a9240 0x559dd97a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.379+0000 7fa8b2ffd700 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x559dd97a9240 0x559dd97a5b90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=93e731128ef30a1a server_cookie=a2beac189d30fcb5 in_seq=0 out_seq=0 2023-07-14T12:58:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.379+0000 7fa896ff5700 10 client.15123 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T12:58:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa896ff5700 1 -- 172.21.15.17:0/3978759699 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x559dd9643000 con 0x559dd97a9240 2023-07-14T12:58:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa896ff5700 10 client.15123 handle_command_reply: tid=0 2023-07-14T12:58:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa8cd1b0b80 1 client.15123 shutdown 2023-07-14T12:58:49.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3978759699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 msgr2=0x559dd9747c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd9747c60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8029040 tx=0x7fa8a80042c0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3978759699 shutdown_connections 2023-07-14T12:58:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559dd973c030 0x559dd974ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x559dd97a9240 0x559dd97a5b90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dd973a890 0x559dd9747720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa8cd1b0b80 1 --2- 172.21.15.17:0/3978759699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559dd973b1e0 0x559dd9747c60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa896ff5700 0 client.15123 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T12:58:49.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3978759699 >> 172.21.15.17:0/3978759699 conn(0x559dd972bd50 msgr2=0x559dd9742420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3978759699 shutdown_connections 2023-07-14T12:58:49.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.380+0000 7fa8cd1b0b80 1 -- 172.21.15.17:0/3978759699 wait complete. 2023-07-14T12:58:49.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8cd1b0b80 20 client.15123 trim_cache size 0 max 16384 2023-07-14T12:58:49.421 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:58:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b31a3268-2244-11ee-9b33-001a4aab830c", 2023-07-14T12:58:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2023-07-14T12:58:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24548, 2023-07-14T12:58:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-07-14T12:58:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-07-14T12:58:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-07-14T12:58:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 66.189022612000002, 2023-07-14T12:58:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 22, 2023-07-14T12:58:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 88, 2023-07-14T12:58:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 86, 2023-07-14T12:58:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 88.234819825000002 2023-07-14T12:58:49.423 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:58:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 -- 172.21.15.17:0/3195423010 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa89c0a11e0 msgr2=0x7fa89c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa89c0a11e0 0x7fa89c0a3690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa8a80094f0 tx=0x7fa8a8009720 comp rx=0 tx=0).stop 2023-07-14T12:58:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 -- 172.21.15.17:0/3195423010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b4101660 msgr2=0x7fa8b419ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b4101660 0x7fa8b419ce50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009fd0 tx=0x7fa8ac00bb00 comp rx=0 tx=0).stop 2023-07-14T12:58:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 -- 172.21.15.17:0/3195423010 shutdown_connections 2023-07-14T12:58:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa89c0a11e0 0x7fa89c0a3690 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8b4101660 0x7fa8b419ce50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b40ffae0 0x7fa8b41958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 --2- 172.21.15.17:0/3195423010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8b4100cd0 0x7fa8b4195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 -- 172.21.15.17:0/3195423010 >> 172.21.15.17:0/3195423010 conn(0x7fa8b40fb0e0 msgr2=0x7fa8b4104200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 -- 172.21.15.17:0/3195423010 shutdown_connections 2023-07-14T12:58:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.381+0000 7fa8b97ff700 1 -- 172.21.15.17:0/3195423010 wait complete. 2023-07-14T12:58:49.429 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-14T12:58:49.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:49 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/798770993' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:49.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:49 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/4030189556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:58:49.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:49 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/798770993' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:58:49.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:49 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/4030189556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:58:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.604+0000 7f427fbff700 1 -- 172.21.15.17:0/817926457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42780ffae0 msgr2=0x7f42780ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.604+0000 7f427fbff700 1 --2- 172.21.15.17:0/817926457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42780ffae0 0x7f42780ffef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f427400b0a0 tx=0x7f427400b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.604+0000 7f427fbff700 1 -- 172.21.15.17:0/817926457 shutdown_connections 2023-07-14T12:58:49.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.604+0000 7f427fbff700 1 --2- 172.21.15.17:0/817926457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4278101660 0x7f4278107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.604+0000 7f427fbff700 1 --2- 172.21.15.17:0/817926457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42780ffae0 0x7f42780ffef0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.604+0000 7f427fbff700 1 --2- 172.21.15.17:0/817926457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4278100cd0 0x7f4278101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.604+0000 7f427fbff700 1 -- 172.21.15.17:0/817926457 >> 172.21.15.17:0/817926457 conn(0x7f42780fb0e0 msgr2=0x7f42780fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.604+0000 7f427fbff700 1 -- 172.21.15.17:0/817926457 shutdown_connections 2023-07-14T12:58:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.604+0000 7f427fbff700 1 -- 172.21.15.17:0/817926457 wait complete. 2023-07-14T12:58:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.605+0000 7f427fbff700 1 Processor -- start 2023-07-14T12:58:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.605+0000 7f427fbff700 1 -- start start 2023-07-14T12:58:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.605+0000 7f427fbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42780ffae0 0x7f4278197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.605+0000 7f427fbff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4278100cd0 0x7f42781980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.605+0000 7f427fbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4278101660 0x7f427819f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.605+0000 7f427fbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427819f6e0 con 0x7f4278101660 2023-07-14T12:58:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.605+0000 7f427fbff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427819f820 con 0x7f4278100cd0 2023-07-14T12:58:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.605+0000 7f427fbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427819f9b0 con 0x7f42780ffae0 2023-07-14T12:58:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4278101660 0x7f427819f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4278101660 0x7f427819f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56340/0 (socket says 172.21.15.17:56340) 2023-07-14T12:58:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427e19c700 1 -- 172.21.15.17:0/3783154196 learned_addr learned my addr 172.21.15.17:0/3783154196 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427d99b700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42780ffae0 0x7f4278197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427d19a700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4278100cd0 0x7f42781980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427e19c700 1 -- 172.21.15.17:0/3783154196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42780ffae0 msgr2=0x7f4278197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427e19c700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42780ffae0 0x7f4278197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427e19c700 1 -- 172.21.15.17:0/3783154196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4278100cd0 msgr2=0x7f42781980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427e19c700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4278100cd0 0x7f42781980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427e19c700 1 -- 172.21.15.17:0/3783154196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4274009d00 con 0x7f4278101660 2023-07-14T12:58:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427d99b700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42780ffae0 0x7f4278197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427d19a700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4278100cd0 0x7f42781980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.606+0000 7f427e19c700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4278101660 0x7f427819f110 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f427000d980 tx=0x7f427000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.607+0000 7f426effd700 1 -- 172.21.15.17:0/3783154196 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270009940 con 0x7f4278101660 2023-07-14T12:58:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.607+0000 7f426effd700 1 -- 172.21.15.17:0/3783154196 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4270004830 con 0x7f4278101660 2023-07-14T12:58:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.607+0000 7f426effd700 1 -- 172.21.15.17:0/3783154196 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270005410 con 0x7f4278101660 2023-07-14T12:58:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.607+0000 7f427fbff700 1 -- 172.21.15.17:0/3783154196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427819fc90 con 0x7f4278101660 2023-07-14T12:58:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.607+0000 7f427fbff700 1 -- 172.21.15.17:0/3783154196 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42781a0150 con 0x7f4278101660 2023-07-14T12:58:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.610+0000 7f426effd700 1 -- 172.21.15.17:0/3783154196 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f42700049a0 con 0x7f4278101660 2023-07-14T12:58:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.611+0000 7f4293606b80 1 Processor -- start 2023-07-14T12:58:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.611+0000 7f4293606b80 1 -- start start 2023-07-14T12:58:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.611+0000 7f426effd700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42640a1260 0x7f42640a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.611+0000 7f426effd700 1 -- 172.21.15.17:0/3783154196 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f42700cc930 con 0x7f4278101660 2023-07-14T12:58:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f4293606b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5db480 0x55b20c5db890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f4293606b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dbdd0 0x55b20c5dc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f4293606b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5dd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f427d19a700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42640a1260 0x7f42640a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f4293606b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c4e0c60 con 0x55b20c5dcc20 2023-07-14T12:58:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f4293606b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c5339f0 con 0x55b20c5db480 2023-07-14T12:58:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f4293606b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c52ce80 con 0x55b20c5dbdd0 2023-07-14T12:58:49.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f427e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5dd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f427e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5dd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56352/0 (socket says 172.21.15.17:56352) 2023-07-14T12:58:49.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f427e19c700 1 -- 172.21.15.17:0/3847025927 learned_addr learned my addr 172.21.15.17:0/3847025927 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f427d99b700 1 --2- 172.21.15.17:0/3847025927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5db480 0x55b20c5db890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f427d19a700 1 --2- 172.21.15.17:0/3847025927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dbdd0 0x55b20c5dc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f427e19c700 1 -- 172.21.15.17:0/3847025927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dbdd0 msgr2=0x55b20c5dc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f427e19c700 1 --2- 172.21.15.17:0/3847025927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dbdd0 0x55b20c5dc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f427e19c700 1 -- 172.21.15.17:0/3847025927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5db480 msgr2=0x55b20c5db890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f427e19c700 1 --2- 172.21.15.17:0/3847025927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5db480 0x55b20c5db890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.612+0000 7f427e19c700 1 -- 172.21.15.17:0/3847025927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b20c35ad90 con 0x55b20c5dcc20 2023-07-14T12:58:49.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.613+0000 7f427d19a700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42640a1260 0x7f42640a3710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4268009de0 tx=0x7f42680136e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.613+0000 7f427e19c700 1 --2- 172.21.15.17:0/3847025927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5dd090 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4270096680 tx=0x7f4270004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f2a66ee152581c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.613+0000 7f4263fff700 1 -- 172.21.15.17:0/3847025927 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700a2060 con 0x55b20c5dcc20 2023-07-14T12:58:49.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.613+0000 7f4263fff700 1 -- 172.21.15.17:0/3847025927 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4270097fb0 con 0x55b20c5dcc20 2023-07-14T12:58:49.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.613+0000 7f4263fff700 1 -- 172.21.15.17:0/3847025927 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270099100 con 0x55b20c5dcc20 2023-07-14T12:58:49.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.614+0000 7f4293606b80 1 -- 172.21.15.17:0/3847025927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 msgr2=0x55b20c5dd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.614+0000 7f4293606b80 1 --2- 172.21.15.17:0/3847025927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5dd090 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4270096680 tx=0x7f4270004ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.614+0000 7f4293606b80 1 -- 172.21.15.17:0/3847025927 shutdown_connections 2023-07-14T12:58:49.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.614+0000 7f4293606b80 1 --2- 172.21.15.17:0/3847025927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5dd090 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.614+0000 7f4293606b80 1 --2- 172.21.15.17:0/3847025927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5db480 0x55b20c5db890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.614+0000 7f4293606b80 1 --2- 172.21.15.17:0/3847025927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dbdd0 0x55b20c5dc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.614+0000 7f4293606b80 1 -- 172.21.15.17:0/3847025927 >> 172.21.15.17:0/3847025927 conn(0x55b20c5d0d50 msgr2=0x55b20c5d6180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.614+0000 7f4293606b80 1 -- 172.21.15.17:0/3847025927 shutdown_connections 2023-07-14T12:58:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.614+0000 7f4293606b80 1 -- 172.21.15.17:0/3847025927 wait complete. 2023-07-14T12:58:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.614+0000 7f4293606b80 1 -- start start 2023-07-14T12:58:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f4293606b80 1 Processor -- start 2023-07-14T12:58:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f4293606b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f4293606b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dbdd0 0x55b20c5e54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f4293606b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dcc20 0x55b20c5ec530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f4293606b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c4cca70 con 0x55b20c5db480 2023-07-14T12:58:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f4293606b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c4cc770 con 0x55b20c5dbdd0 2023-07-14T12:58:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f4293606b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c3b08d0 con 0x55b20c5dcc20 2023-07-14T12:58:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f4293606b80 10 client.0 _ll_register_callbacks cb 0x55b20c4ca710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:58:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f427d99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f427d99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56358/0 (socket says 172.21.15.17:56358) 2023-07-14T12:58:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f427d99b700 1 -- 172.21.15.17:0/1614527242 learned_addr learned my addr 172.21.15.17:0/1614527242 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.615+0000 7f427d19a700 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dbdd0 0x55b20c5e54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.616+0000 7f427d99b700 1 -- 172.21.15.17:0/1614527242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dcc20 msgr2=0x55b20c5ec530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.616+0000 7f427d99b700 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dcc20 0x55b20c5ec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.616+0000 7f427d99b700 1 -- 172.21.15.17:0/1614527242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dbdd0 msgr2=0x55b20c5e54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.616+0000 7f427d99b700 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dbdd0 0x55b20c5e54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.616+0000 7f427d99b700 1 -- 172.21.15.17:0/1614527242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42781a0150 con 0x55b20c5db480 2023-07-14T12:58:49.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.616+0000 7f427d99b700 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e4fb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f427400b0a0 tx=0x7f4274007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ca327bf04ad174 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.616+0000 7f42617fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:58:49.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.616+0000 7f42617fa700 1 -- 172.21.15.17:0/1614527242 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400e070 con 0x55b20c5db480 2023-07-14T12:58:49.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.616+0000 7f4293606b80 1 -- 172.21.15.17:0/1614527242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b20c4864a0 con 0x55b20c5db480 2023-07-14T12:58:49.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.616+0000 7f42617fa700 1 -- 172.21.15.17:0/1614527242 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f427400bc50 con 0x55b20c5db480 2023-07-14T12:58:49.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.616+0000 7f42617fa700 1 -- 172.21.15.17:0/1614527242 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f427400be10 con 0x55b20c5db480 2023-07-14T12:58:49.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.617+0000 7f4293606b80 10 client.15135 fetch_fsmap learned FSMap version 22 2023-07-14T12:58:49.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.617+0000 7f4293606b80 1 -- 172.21.15.17:0/1614527242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55b20c343c10 con 0x55b20c5db480 2023-07-14T12:58:49.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.617+0000 7f42617fa700 1 -- 172.21.15.17:0/1614527242 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b20c4864a0 con 0x55b20c5db480 2023-07-14T12:58:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.617+0000 7f42617fa700 1 -- 172.21.15.17:0/1614527242 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f427400b0d0 con 0x55b20c5db480 2023-07-14T12:58:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.617+0000 7f4293606b80 10 client.15135 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:58:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.617+0000 7f4293606b80 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T12:58:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.617+0000 7f4293606b80 20 client.15135 populate_metadata read hostname 'smithi017' 2023-07-14T12:58:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.617+0000 7f4293606b80 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b20c5f0270 0x55b20c5ef680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.617+0000 7f4293606b80 4 client.15135 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:58:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.617+0000 7f4293606b80 1 -- 172.21.15.17:0/1614527242 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b20c525e60 con 0x55b20c5f0270 2023-07-14T12:58:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.617+0000 7f427d19a700 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b20c5f0270 0x55b20c5ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.618+0000 7f427d19a700 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b20c5f0270 0x55b20c5ef680 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcff6f3857c2dee3 server_cookie=fd35d743bebbdb86 in_seq=0 out_seq=0 2023-07-14T12:58:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.618+0000 7f42617fa700 10 client.15135 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:58:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.619+0000 7f42617fa700 1 -- 172.21.15.17:0/1614527242 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b20c525e60 con 0x55b20c5f0270 2023-07-14T12:58:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.619+0000 7f42617fa700 10 client.15135 handle_command_reply: tid=0 2023-07-14T12:58:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.619+0000 7f4293606b80 1 client.15135 shutdown 2023-07-14T12:58:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f4293606b80 1 -- 172.21.15.17:0/1614527242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 msgr2=0x55b20c5e4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f4293606b80 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e4fb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f427400b0a0 tx=0x7f4274007d50 comp rx=0 tx=0).stop 2023-07-14T12:58:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f4293606b80 1 -- 172.21.15.17:0/1614527242 shutdown_connections 2023-07-14T12:58:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f4293606b80 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b20c5f0270 0x55b20c5ef680 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f4293606b80 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dcc20 0x55b20c5ec530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f4293606b80 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e4fb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f4293606b80 1 --2- 172.21.15.17:0/1614527242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dbdd0 0x55b20c5e54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f42617fa700 0 client.15135 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:58:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f4293606b80 1 -- 172.21.15.17:0/1614527242 >> 172.21.15.17:0/1614527242 conn(0x55b20c5d0d50 msgr2=0x55b20c5d5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f4293606b80 1 -- 172.21.15.17:0/1614527242 shutdown_connections 2023-07-14T12:58:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f4293606b80 1 -- 172.21.15.17:0/1614527242 wait complete. 2023-07-14T12:58:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.620+0000 7f4293606b80 20 client.15135 trim_cache size 0 max 16384 2023-07-14T12:58:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.638+0000 7f4293606b80 1 Processor -- start 2023-07-14T12:58:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.638+0000 7f4293606b80 1 -- start start 2023-07-14T12:58:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f4293606b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5db480 0x55b20c5e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f4293606b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dbdd0 0x55b20c5ec450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f4293606b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5d5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f4293606b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c5e4b80 con 0x55b20c5dcc20 2023-07-14T12:58:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f4293606b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c5d2e90 con 0x55b20c5dbdd0 2023-07-14T12:58:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f4293606b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c5e5eb0 con 0x55b20c5db480 2023-07-14T12:58:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f427e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5d5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f427d19a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dbdd0 0x55b20c5ec450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f427e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5d5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56368/0 (socket says 172.21.15.17:56368) 2023-07-14T12:58:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f427e19c700 1 -- 172.21.15.17:0/2900040197 learned_addr learned my addr 172.21.15.17:0/2900040197 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f427d99b700 1 --2- 172.21.15.17:0/2900040197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5db480 0x55b20c5e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f427d19a700 1 -- 172.21.15.17:0/2900040197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5db480 msgr2=0x55b20c5e3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f427d19a700 1 --2- 172.21.15.17:0/2900040197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5db480 0x55b20c5e3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f427d19a700 1 -- 172.21.15.17:0/2900040197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 msgr2=0x55b20c5d5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f427d19a700 1 --2- 172.21.15.17:0/2900040197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5d5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f427d19a700 1 -- 172.21.15.17:0/2900040197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b20c381200 con 0x55b20c5dbdd0 2023-07-14T12:58:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.639+0000 7f427e19c700 1 --2- 172.21.15.17:0/2900040197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5d5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:58:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.640+0000 7f427d19a700 1 --2- 172.21.15.17:0/2900040197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dbdd0 0x55b20c5ec450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55b20c5f14b0 tx=0x7f4268016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f156b9a524281e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.640+0000 7f426cbff700 1 -- 172.21.15.17:0/2900040197 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268023040 con 0x55b20c5dbdd0 2023-07-14T12:58:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.640+0000 7f426cbff700 1 -- 172.21.15.17:0/2900040197 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4268020e60 con 0x55b20c5dbdd0 2023-07-14T12:58:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.640+0000 7f426cbff700 1 -- 172.21.15.17:0/2900040197 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426801e780 con 0x55b20c5dbdd0 2023-07-14T12:58:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.641+0000 7f4293606b80 1 -- 172.21.15.17:0/2900040197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dbdd0 msgr2=0x55b20c5ec450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.641+0000 7f4293606b80 1 --2- 172.21.15.17:0/2900040197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dbdd0 0x55b20c5ec450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55b20c5f14b0 tx=0x7f4268016000 comp rx=0 tx=0).stop 2023-07-14T12:58:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.641+0000 7f4293606b80 1 -- 172.21.15.17:0/2900040197 shutdown_connections 2023-07-14T12:58:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.641+0000 7f4293606b80 1 --2- 172.21.15.17:0/2900040197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5dcc20 0x55b20c5d5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.641+0000 7f4293606b80 1 --2- 172.21.15.17:0/2900040197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5db480 0x55b20c5e3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.641+0000 7f4293606b80 1 --2- 172.21.15.17:0/2900040197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dbdd0 0x55b20c5ec450 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.641+0000 7f4293606b80 1 -- 172.21.15.17:0/2900040197 >> 172.21.15.17:0/2900040197 conn(0x55b20c5d0d50 msgr2=0x55b20c5f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.641+0000 7f4293606b80 1 -- 172.21.15.17:0/2900040197 shutdown_connections 2023-07-14T12:58:49.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.641+0000 7f4293606b80 1 -- 172.21.15.17:0/2900040197 wait complete. 2023-07-14T12:58:49.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.641+0000 7f4293606b80 1 -- start start 2023-07-14T12:58:49.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f4293606b80 1 Processor -- start 2023-07-14T12:58:49.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f4293606b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f4293606b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dbdd0 0x55b20c5ec450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f4293606b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dcc20 0x55b20c644130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f4293606b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c644670 con 0x55b20c5db480 2023-07-14T12:58:49.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f4293606b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c6447b0 con 0x55b20c5dcc20 2023-07-14T12:58:49.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f4293606b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b20c644940 con 0x55b20c5dbdd0 2023-07-14T12:58:49.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f4293606b80 10 client.0 _ll_register_callbacks cb 0x7f42740077f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:58:49.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f427d99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f427d99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56370/0 (socket says 172.21.15.17:56370) 2023-07-14T12:58:49.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f427d99b700 1 -- 172.21.15.17:0/1930804059 learned_addr learned my addr 172.21.15.17:0/1930804059 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:49.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f427e19c700 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dcc20 0x55b20c644130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.642+0000 7f427d19a700 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dbdd0 0x55b20c5ec450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f427d99b700 1 -- 172.21.15.17:0/1930804059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dbdd0 msgr2=0x55b20c5ec450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f427d99b700 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dbdd0 0x55b20c5ec450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f427d99b700 1 -- 172.21.15.17:0/1930804059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dcc20 msgr2=0x55b20c644130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:58:49.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f427d99b700 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dcc20 0x55b20c644130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f427d99b700 1 -- 172.21.15.17:0/1930804059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b20c35ad90 con 0x55b20c5db480 2023-07-14T12:58:49.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f427d19a700 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dbdd0 0x55b20c5ec450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:58:49.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f427d99b700 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e22c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4274002230 tx=0x7f427400bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d225a8a2068274 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:49.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f42617fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:58:49.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f42617fa700 1 -- 172.21.15.17:0/1930804059 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400e040 con 0x55b20c5db480 2023-07-14T12:58:49.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f4293606b80 1 -- 172.21.15.17:0/1930804059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4270097fb0 con 0x55b20c5db480 2023-07-14T12:58:49.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f42617fa700 1 -- 172.21.15.17:0/1930804059 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f4274025d90 con 0x55b20c5db480 2023-07-14T12:58:49.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f42617fa700 1 -- 172.21.15.17:0/1930804059 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4274009b80 con 0x55b20c5db480 2023-07-14T12:58:49.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f4293606b80 10 client.15141 fetch_fsmap learned FSMap version 22 2023-07-14T12:58:49.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.643+0000 7f4293606b80 1 -- 172.21.15.17:0/1930804059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f4268019070 con 0x55b20c5db480 2023-07-14T12:58:49.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.644+0000 7f42617fa700 1 -- 172.21.15.17:0/1930804059 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4270097fb0 con 0x55b20c5db480 2023-07-14T12:58:49.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.644+0000 7f42617fa700 1 -- 172.21.15.17:0/1930804059 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f42740050c0 con 0x55b20c5db480 2023-07-14T12:58:49.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.644+0000 7f4293606b80 10 client.15141 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:58:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.644+0000 7f4293606b80 10 client.15141 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T12:58:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.644+0000 7f4293606b80 20 client.15141 populate_metadata read hostname 'smithi017' 2023-07-14T12:58:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.644+0000 7f4293606b80 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b20c649420 0x55b20c645d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.644+0000 7f4293606b80 4 client.15141 mds_command: new command op to 24593 tid=0[{"prefix": "status"}] 2023-07-14T12:58:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.644+0000 7f4293606b80 1 -- 172.21.15.17:0/1930804059 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b20c4e8000 con 0x55b20c649420 2023-07-14T12:58:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.644+0000 7f427d19a700 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b20c649420 0x55b20c645d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f42617fa700 10 client.15141 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:58:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f427d19a700 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b20c649420 0x55b20c645d30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=461669c6ba9c755e server_cookie=42719ad357138eb in_seq=0 out_seq=0 2023-07-14T12:58:49.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f42617fa700 1 -- 172.21.15.17:0/1930804059 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55b20c4e8000 con 0x55b20c649420 2023-07-14T12:58:49.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f42617fa700 10 client.15141 handle_command_reply: tid=0 2023-07-14T12:58:49.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f4293606b80 1 client.15141 shutdown 2023-07-14T12:58:49.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f4293606b80 1 -- 172.21.15.17:0/1930804059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 msgr2=0x55b20c5e22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f4293606b80 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e22c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4274002230 tx=0x7f427400bd00 comp rx=0 tx=0).stop 2023-07-14T12:58:49.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f4293606b80 1 -- 172.21.15.17:0/1930804059 shutdown_connections 2023-07-14T12:58:49.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f4293606b80 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b20c649420 0x55b20c645d30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f4293606b80 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b20c5dcc20 0x55b20c644130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f4293606b80 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b20c5db480 0x55b20c5e22c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f4293606b80 1 --2- 172.21.15.17:0/1930804059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b20c5dbdd0 0x55b20c5ec450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f42617fa700 0 client.15141 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:58:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f4293606b80 1 -- 172.21.15.17:0/1930804059 >> 172.21.15.17:0/1930804059 conn(0x55b20c5d0d50 msgr2=0x55b20c5d5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f4293606b80 1 -- 172.21.15.17:0/1930804059 shutdown_connections 2023-07-14T12:58:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.645+0000 7f4293606b80 1 -- 172.21.15.17:0/1930804059 wait complete. 2023-07-14T12:58:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f4293606b80 20 client.15141 trim_cache size 0 max 16384 2023-07-14T12:58:49.685 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:58:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b31a3268-2244-11ee-9b33-001a4aab830c", 2023-07-14T12:58:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-07-14T12:58:49.685 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24593, 2023-07-14T12:58:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-07-14T12:58:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-07-14T12:58:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-07-14T12:58:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 69.469304366000003, 2023-07-14T12:58:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 22, 2023-07-14T12:58:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 88, 2023-07-14T12:58:49.686 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 86, 2023-07-14T12:58:49.687 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 75.749352888000004 2023-07-14T12:58:49.687 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:58:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 -- 172.21.15.17:0/3783154196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42640a1260 msgr2=0x7f42640a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42640a1260 0x7f42640a3710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4268009de0 tx=0x7f42680136e0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 -- 172.21.15.17:0/3783154196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4278101660 msgr2=0x7f427819f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:49.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4278101660 0x7f427819f110 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f427000d980 tx=0x7f427000dd40 comp rx=0 tx=0).stop 2023-07-14T12:58:49.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 -- 172.21.15.17:0/3783154196 shutdown_connections 2023-07-14T12:58:49.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42640a1260 0x7f42640a3710 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4278101660 0x7f427819f110 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42780ffae0 0x7f4278197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 --2- 172.21.15.17:0/3783154196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4278100cd0 0x7f42781980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 -- 172.21.15.17:0/3783154196 >> 172.21.15.17:0/3783154196 conn(0x7f42780fb0e0 msgr2=0x7f42780fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 -- 172.21.15.17:0/3783154196 shutdown_connections 2023-07-14T12:58:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:49.646+0000 7f427fbff700 1 -- 172.21.15.17:0/3783154196 wait complete. 2023-07-14T12:58:49.694 INFO:tasks.cephadm:Setup complete, yielding 2023-07-14T12:58:49.694 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-07-14T12:58:49.704 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2023-07-14T12:58:49.704 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- bash -c 'ceph orch status' 2023-07-14T12:58:50.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:50 smithi017 ceph-mon[95536]: pgmap v339: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:50.429 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:50.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:50 smithi135 ceph-mon[97338]: pgmap v339: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:50.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:50 smithi131 ceph-mon[96953]: pgmap v339: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:52.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.980+0000 7f8d80405700 1 -- 172.21.15.17:0/127550823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d78100d90 msgr2=0x7f8d781011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:52.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.980+0000 7f8d80405700 1 --2- 172.21.15.17:0/127550823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d78100d90 0x7f8d781011e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009990 tx=0x7f8d68009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.980+0000 7f8d80405700 1 -- 172.21.15.17:0/127550823 shutdown_connections 2023-07-14T12:58:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.980+0000 7f8d80405700 1 --2- 172.21.15.17:0/127550823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d78101720 0x7f8d78107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.980+0000 7f8d80405700 1 --2- 172.21.15.17:0/127550823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d780ffb90 0x7f8d780fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.980+0000 7f8d80405700 1 --2- 172.21.15.17:0/127550823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d78100d90 0x7f8d781011e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.980+0000 7f8d80405700 1 -- 172.21.15.17:0/127550823 >> 172.21.15.17:0/127550823 conn(0x7f8d780fb1a0 msgr2=0x7f8d780fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.980+0000 7f8d80405700 1 -- 172.21.15.17:0/127550823 shutdown_connections 2023-07-14T12:58:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.980+0000 7f8d80405700 1 -- 172.21.15.17:0/127550823 wait complete. 2023-07-14T12:58:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.981+0000 7f8d80405700 1 Processor -- start 2023-07-14T12:58:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.982+0000 7f8d80405700 1 -- start start 2023-07-14T12:58:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.982+0000 7f8d80405700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d780ffb90 0x7f8d78195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.982+0000 7f8d80405700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d78100d90 0x7f8d78195cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.982+0000 7f8d80405700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d78101720 0x7f8d7819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.982+0000 7f8d80405700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7819d310 con 0x7f8d780ffb90 2023-07-14T12:58:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.982+0000 7f8d80405700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7819d450 con 0x7f8d78100d90 2023-07-14T12:58:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.982+0000 7f8d80405700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7819d5e0 con 0x7f8d78101720 2023-07-14T12:58:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7e1a1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d780ffb90 0x7f8d78195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7e1a1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d780ffb90 0x7f8d78195780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56382/0 (socket says 172.21.15.17:56382) 2023-07-14T12:58:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7e1a1700 1 -- 172.21.15.17:0/4195219543 learned_addr learned my addr 172.21.15.17:0/4195219543 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7e9a2700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d78101720 0x7f8d7819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7d9a0700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d78100d90 0x7f8d78195cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7e1a1700 1 -- 172.21.15.17:0/4195219543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d78101720 msgr2=0x7f8d7819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7e1a1700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d78101720 0x7f8d7819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7e1a1700 1 -- 172.21.15.17:0/4195219543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d78100d90 msgr2=0x7f8d78195cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7e1a1700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d78100d90 0x7f8d78195cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7e1a1700 1 -- 172.21.15.17:0/4195219543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d680095f0 con 0x7f8d780ffb90 2023-07-14T12:58:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7d9a0700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d78100d90 0x7f8d78195cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.983+0000 7f8d7e1a1700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d780ffb90 0x7f8d78195780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d9b0 tx=0x7f8d7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:52.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.984+0000 7f8d6f7fe700 1 -- 172.21.15.17:0/4195219543 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400b950 con 0x7f8d780ffb90 2023-07-14T12:58:52.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.984+0000 7f8d6f7fe700 1 -- 172.21.15.17:0/4195219543 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d74007620 con 0x7f8d780ffb90 2023-07-14T12:58:52.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.984+0000 7f8d6f7fe700 1 -- 172.21.15.17:0/4195219543 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400f3c0 con 0x7f8d780ffb90 2023-07-14T12:58:52.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.984+0000 7f8d80405700 1 -- 172.21.15.17:0/4195219543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7819d8c0 con 0x7f8d780ffb90 2023-07-14T12:58:52.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.984+0000 7f8d80405700 1 -- 172.21.15.17:0/4195219543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7819dd70 con 0x7f8d780ffb90 2023-07-14T12:58:52.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.985+0000 7f8d80405700 1 -- 172.21.15.17:0/4195219543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7810b200 con 0x7f8d780ffb90 2023-07-14T12:58:52.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.987+0000 7f8d6f7fe700 1 -- 172.21.15.17:0/4195219543 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f8d7400bab0 con 0x7f8d780ffb90 2023-07-14T12:58:52.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.988+0000 7f8d6f7fe700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8d640a1260 0x7f8d640a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:52.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.988+0000 7f8d6f7fe700 1 -- 172.21.15.17:0/4195219543 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f8d740ccc10 con 0x7f8d780ffb90 2023-07-14T12:58:52.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.988+0000 7f8d7d9a0700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8d640a1260 0x7f8d640a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:52.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.989+0000 7f8d7d9a0700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8d640a1260 0x7f8d640a3710 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800b5c0 tx=0x7f8d68005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:52.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:51.992+0000 7f8d6f7fe700 1 -- 172.21.15.17:0/4195219543 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8d740961d0 con 0x7f8d780ffb90 2023-07-14T12:58:52.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.218+0000 7f8d80405700 1 -- 172.21.15.17:0/4195219543 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d78060950 con 0x7f8d640a1260 2023-07-14T12:58:52.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.219+0000 7f8d6f7fe700 1 -- 172.21.15.17:0/4195219543 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8d78060950 con 0x7f8d640a1260 2023-07-14T12:58:52.249 INFO:teuthology.orchestra.run.smithi017.stdout:Backend: cephadm 2023-07-14T12:58:52.249 INFO:teuthology.orchestra.run.smithi017.stdout:Available: Yes 2023-07-14T12:58:52.249 INFO:teuthology.orchestra.run.smithi017.stdout:Paused: No 2023-07-14T12:58:52.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 -- 172.21.15.17:0/4195219543 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8d640a1260 msgr2=0x7f8d640a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:52.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8d640a1260 0x7f8d640a3710 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800b5c0 tx=0x7f8d68005fb0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 -- 172.21.15.17:0/4195219543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d780ffb90 msgr2=0x7f8d78195780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:52.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d780ffb90 0x7f8d78195780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d9b0 tx=0x7f8d7400dcc0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 -- 172.21.15.17:0/4195219543 shutdown_connections 2023-07-14T12:58:52.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8d640a1260 0x7f8d640a3710 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d78101720 0x7f8d7819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d780ffb90 0x7f8d78195780 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 --2- 172.21.15.17:0/4195219543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d78100d90 0x7f8d78195cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:52.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 -- 172.21.15.17:0/4195219543 >> 172.21.15.17:0/4195219543 conn(0x7f8d780fb1a0 msgr2=0x7f8d780fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:52.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 -- 172.21.15.17:0/4195219543 shutdown_connections 2023-07-14T12:58:52.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:52.222+0000 7f8d80405700 1 -- 172.21.15.17:0/4195219543 wait complete. 2023-07-14T12:58:52.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:52 smithi017 ceph-mon[95536]: pgmap v340: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:52.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:52 smithi135 ceph-mon[97338]: pgmap v340: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:52.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:52 smithi131 ceph-mon[96953]: pgmap v340: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:52.809 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- bash -c 'ceph orch ps' 2023-07-14T12:58:53.540 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:54.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:54 smithi017 ceph-mon[95536]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:58:54.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:54 smithi017 ceph-mon[95536]: pgmap v341: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:54.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:54 smithi135 ceph-mon[97338]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:58:54.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:54 smithi135 ceph-mon[97338]: pgmap v341: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:54.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:54 smithi131 ceph-mon[96953]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:58:54.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:54 smithi131 ceph-mon[96953]: pgmap v341: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:58:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.112+0000 7fedbc5cd700 1 -- 172.21.15.17:0/466365875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb40ffb90 msgr2=0x7fedb40fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.112+0000 7fedbc5cd700 1 --2- 172.21.15.17:0/466365875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb40ffb90 0x7fedb40fffa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009990 tx=0x7fedb0009ca0 comp rx=0 tx=0).stop 2023-07-14T12:58:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.113+0000 7fedbc5cd700 1 -- 172.21.15.17:0/466365875 shutdown_connections 2023-07-14T12:58:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.113+0000 7fedbc5cd700 1 --2- 172.21.15.17:0/466365875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb4101720 0x7fedb4107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.113+0000 7fedbc5cd700 1 --2- 172.21.15.17:0/466365875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb40ffb90 0x7fedb40fffa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:55.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.113+0000 7fedbc5cd700 1 --2- 172.21.15.17:0/466365875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb4100d90 0x7fedb41011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:55.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.113+0000 7fedbc5cd700 1 -- 172.21.15.17:0/466365875 >> 172.21.15.17:0/466365875 conn(0x7fedb40fb1a0 msgr2=0x7fedb40fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:55.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.113+0000 7fedbc5cd700 1 -- 172.21.15.17:0/466365875 shutdown_connections 2023-07-14T12:58:55.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.113+0000 7fedbc5cd700 1 -- 172.21.15.17:0/466365875 wait complete. 2023-07-14T12:58:55.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.114+0000 7fedbc5cd700 1 Processor -- start 2023-07-14T12:58:55.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.114+0000 7fedbc5cd700 1 -- start start 2023-07-14T12:58:55.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.114+0000 7fedbc5cd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb40ffb90 0x7fedb4197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:55.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.114+0000 7fedbc5cd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb4100d90 0x7fedb4197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:55.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.114+0000 7fedbc5cd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb4101720 0x7fedb419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:55.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.114+0000 7fedbc5cd700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb419f5e0 con 0x7fedb4101720 2023-07-14T12:58:55.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.114+0000 7fedbc5cd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb419f720 con 0x7fedb4100d90 2023-07-14T12:58:55.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.114+0000 7fedbc5cd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb419f8b0 con 0x7fedb40ffb90 2023-07-14T12:58:55.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedbab6a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb4101720 0x7fedb419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:55.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedbab6a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb4101720 0x7fedb419f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34846/0 (socket says 172.21.15.17:34846) 2023-07-14T12:58:55.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedbab6a700 1 -- 172.21.15.17:0/3664705892 learned_addr learned my addr 172.21.15.17:0/3664705892 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:55.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedba369700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb40ffb90 0x7fedb4197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:55.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedb9b68700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb4100d90 0x7fedb4197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:55.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedbab6a700 1 -- 172.21.15.17:0/3664705892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb40ffb90 msgr2=0x7fedb4197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:55.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedbab6a700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb40ffb90 0x7fedb4197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedbab6a700 1 -- 172.21.15.17:0/3664705892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb4100d90 msgr2=0x7fedb4197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedbab6a700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb4100d90 0x7fedb4197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedbab6a700 1 -- 172.21.15.17:0/3664705892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb00095f0 con 0x7fedb4101720 2023-07-14T12:58:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedb9b68700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb4100d90 0x7fedb4197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.115+0000 7fedbab6a700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb4101720 0x7fedb419f010 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fedac00add0 tx=0x7fedac00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.116+0000 7fedab7fe700 1 -- 172.21.15.17:0/3664705892 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac00f070 con 0x7fedb4101720 2023-07-14T12:58:55.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.116+0000 7fedbc5cd700 1 -- 172.21.15.17:0/3664705892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb419fb90 con 0x7fedb4101720 2023-07-14T12:58:55.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.116+0000 7fedab7fe700 1 -- 172.21.15.17:0/3664705892 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedac007b30 con 0x7fedb4101720 2023-07-14T12:58:55.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.116+0000 7fedab7fe700 1 -- 172.21.15.17:0/3664705892 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac005280 con 0x7fedb4101720 2023-07-14T12:58:55.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.116+0000 7fedbc5cd700 1 -- 172.21.15.17:0/3664705892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb41a00e0 con 0x7fedb4101720 2023-07-14T12:58:55.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.117+0000 7fedbc5cd700 1 -- 172.21.15.17:0/3664705892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb4192110 con 0x7fedb4101720 2023-07-14T12:58:55.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.119+0000 7fedab7fe700 1 -- 172.21.15.17:0/3664705892 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7fedac00c940 con 0x7fedb4101720 2023-07-14T12:58:55.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.120+0000 7fedab7fe700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feda00a11e0 0x7feda00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:55.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.120+0000 7fedab7fe700 1 -- 172.21.15.17:0/3664705892 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fedac0cc030 con 0x7fedb4101720 2023-07-14T12:58:55.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.120+0000 7fedba369700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feda00a11e0 0x7feda00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:55.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.121+0000 7fedba369700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feda00a11e0 0x7feda00a3690 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fedb000b5c0 tx=0x7fedb0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:55.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.124+0000 7fedab7fe700 1 -- 172.21.15.17:0/3664705892 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fedac0956e0 con 0x7fedb4101720 2023-07-14T12:58:55.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.338+0000 7fedbc5cd700 1 -- 172.21.15.17:0/3664705892 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fedb4060950 con 0x7feda00a11e0 2023-07-14T12:58:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.351+0000 7fedab7fe700 1 -- 172.21.15.17:0/3664705892 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7fedb4060950 con 0x7feda00a11e0 2023-07-14T12:58:55.381 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-07-14T12:58:55.382 INFO:teuthology.orchestra.run.smithi017.stdout:mds.a smithi017 running (84s) 8s ago 84s 13.7M - 18.0.0-4757-g3fc0089c afd12e232ec0 0dbbfb6e75c0 2023-07-14T12:58:55.382 INFO:teuthology.orchestra.run.smithi017.stdout:mds.b smithi131 running (81s) 8s ago 81s 28.9M - 18.0.0-4757-g3fc0089c afd12e232ec0 c4fb389322b1 2023-07-14T12:58:55.382 INFO:teuthology.orchestra.run.smithi017.stdout:mds.c smithi135 running (97s) 8s ago 97s 18.1M - 18.0.0-4757-g3fc0089c afd12e232ec0 cc817b8521a9 2023-07-14T12:58:55.382 INFO:teuthology.orchestra.run.smithi017.stdout:mds.d smithi017 running (107s) 8s ago 106s 13.8M - 18.0.0-4757-g3fc0089c afd12e232ec0 dc118007be90 2023-07-14T12:58:55.382 INFO:teuthology.orchestra.run.smithi017.stdout:mds.e smithi131 running (103s) 8s ago 103s 16.8M - 18.0.0-4757-g3fc0089c afd12e232ec0 f3ae67fc8d68 2023-07-14T12:58:55.382 INFO:teuthology.orchestra.run.smithi017.stdout:mds.f smithi135 running (100s) 8s ago 100s 16.8M - 18.0.0-4757-g3fc0089c afd12e232ec0 da6899ca90ed 2023-07-14T12:58:55.382 INFO:teuthology.orchestra.run.smithi017.stdout:mds.g smithi017 running (88s) 8s ago 87s 13.7M - 18.0.0-4757-g3fc0089c afd12e232ec0 22866e12b69a 2023-07-14T12:58:55.383 INFO:teuthology.orchestra.run.smithi017.stdout:mds.h smithi131 running (94s) 8s ago 94s 18.2M - 18.0.0-4757-g3fc0089c afd12e232ec0 d1276eaacf53 2023-07-14T12:58:55.383 INFO:teuthology.orchestra.run.smithi017.stdout:mds.i smithi135 running (91s) 8s ago 91s 17.7M - 18.0.0-4757-g3fc0089c afd12e232ec0 dedc40fb0d6e 2023-07-14T12:58:55.383 INFO:teuthology.orchestra.run.smithi017.stdout:mds.j smithi017 running (110s) 8s ago 109s 13.7M - 18.0.0-4757-g3fc0089c afd12e232ec0 0ad3e71922cb 2023-07-14T12:58:55.383 INFO:teuthology.orchestra.run.smithi017.stdout:mds.k smithi131 running (113s) 8s ago 113s 13.8M - 18.0.0-4757-g3fc0089c afd12e232ec0 61c495fa43c8 2023-07-14T12:58:55.383 INFO:teuthology.orchestra.run.smithi017.stdout:mds.l smithi135 running (116s) 8s ago 116s 13.8M - 18.0.0-4757-g3fc0089c afd12e232ec0 20307eb6194f 2023-07-14T12:58:55.383 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.x smithi017 *:9283,8765 running (9m) 8s ago 9m 522M - 18.0.0-4757-g3fc0089c afd12e232ec0 48a1ca61dfbc 2023-07-14T12:58:55.383 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.y smithi131 *:8443,8765 running (7m) 8s ago 7m 449M - 18.0.0-4757-g3fc0089c afd12e232ec0 6fc4954832a5 2023-07-14T12:58:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.z smithi135 *:8443,8765 running (7m) 8s ago 7m 449M - 18.0.0-4757-g3fc0089c afd12e232ec0 5145a0aa4318 2023-07-14T12:58:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a smithi017 running (9m) 8s ago 9m 97.5M 2048M 18.0.0-4757-g3fc0089c afd12e232ec0 a917ac1e29d1 2023-07-14T12:58:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b smithi131 running (7m) 8s ago 7m 61.6M 2048M 18.0.0-4757-g3fc0089c afd12e232ec0 00560241cab4 2023-07-14T12:58:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c smithi135 running (8m) 8s ago 8m 66.1M 2048M 18.0.0-4757-g3fc0089c afd12e232ec0 36758eaaa5f0 2023-07-14T12:58:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 8s ago 7m 69.7M 4318M 18.0.0-4757-g3fc0089c afd12e232ec0 b5dfd7ad147c 2023-07-14T12:58:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi131 running (6m) 8s ago 6m 75.6M 4316M 18.0.0-4757-g3fc0089c afd12e232ec0 1fae38d1e7e7 2023-07-14T12:58:55.384 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi135 running (6m) 8s ago 6m 72.8M 4316M 18.0.0-4757-g3fc0089c afd12e232ec0 bc9c7e0338dc 2023-07-14T12:58:55.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi017 running (5m) 8s ago 5m 63.3M 4318M 18.0.0-4757-g3fc0089c afd12e232ec0 c2140dc6e90b 2023-07-14T12:58:55.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi131 running (5m) 8s ago 5m 61.2M 4316M 18.0.0-4757-g3fc0089c afd12e232ec0 0198af846e89 2023-07-14T12:58:55.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi135 running (4m) 8s ago 4m 64.9M 4316M 18.0.0-4757-g3fc0089c afd12e232ec0 5d33e2aa5a5c 2023-07-14T12:58:55.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 smithi017 running (4m) 8s ago 4m 59.5M 4318M 18.0.0-4757-g3fc0089c afd12e232ec0 d9dcf9a9a940 2023-07-14T12:58:55.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 smithi131 running (4m) 8s ago 4m 62.3M 4316M 18.0.0-4757-g3fc0089c afd12e232ec0 01df20afda0f 2023-07-14T12:58:55.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 smithi135 running (3m) 8s ago 3m 60.7M 4316M 18.0.0-4757-g3fc0089c afd12e232ec0 3b1858bf8e1d 2023-07-14T12:58:55.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 smithi017 running (3m) 8s ago 3m 56.7M 4318M 18.0.0-4757-g3fc0089c afd12e232ec0 9227affa1875 2023-07-14T12:58:55.385 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 smithi131 running (2m) 8s ago 2m 61.0M 4316M 18.0.0-4757-g3fc0089c afd12e232ec0 f255103a47ac 2023-07-14T12:58:55.386 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 smithi135 running (2m) 8s ago 2m 53.0M 4316M 18.0.0-4757-g3fc0089c afd12e232ec0 37cb83b3ba36 2023-07-14T12:58:55.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.353+0000 7fedbc5cd700 1 -- 172.21.15.17:0/3664705892 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feda00a11e0 msgr2=0x7feda00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.353+0000 7fedbc5cd700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feda00a11e0 0x7feda00a3690 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fedb000b5c0 tx=0x7fedb0005fb0 comp rx=0 tx=0).stop 2023-07-14T12:58:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.354+0000 7fedbc5cd700 1 -- 172.21.15.17:0/3664705892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb4101720 msgr2=0x7fedb419f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.354+0000 7fedbc5cd700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb4101720 0x7fedb419f010 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fedac00add0 tx=0x7fedac00c330 comp rx=0 tx=0).stop 2023-07-14T12:58:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.354+0000 7fedbc5cd700 1 -- 172.21.15.17:0/3664705892 shutdown_connections 2023-07-14T12:58:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.354+0000 7fedbc5cd700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feda00a11e0 0x7feda00a3690 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.354+0000 7fedbc5cd700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb4101720 0x7fedb419f010 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:55.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.354+0000 7fedbc5cd700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb40ffb90 0x7fedb4197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.354+0000 7fedbc5cd700 1 --2- 172.21.15.17:0/3664705892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb4100d90 0x7fedb4197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.354+0000 7fedbc5cd700 1 -- 172.21.15.17:0/3664705892 >> 172.21.15.17:0/3664705892 conn(0x7fedb40fb1a0 msgr2=0x7fedb41067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.354+0000 7fedbc5cd700 1 -- 172.21.15.17:0/3664705892 shutdown_connections 2023-07-14T12:58:55.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:55.354+0000 7fedbc5cd700 1 -- 172.21.15.17:0/3664705892 wait complete. 2023-07-14T12:58:55.818 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- bash -c 'ceph orch ls' 2023-07-14T12:58:56.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:56 smithi017 ceph-mon[95536]: pgmap v342: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:56.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:56 smithi135 ceph-mon[97338]: pgmap v342: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:56.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:56 smithi131 ceph-mon[96953]: pgmap v342: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-14T12:58:56.556 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:58:57.105 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:57 smithi017 ceph-mon[95536]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:58:57.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:57 smithi135 ceph-mon[97338]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:58:57.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:57 smithi131 ceph-mon[96953]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:58:58.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.087+0000 7f00daf93700 1 -- 172.21.15.17:0/456326108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d4101720 msgr2=0x7f00d4107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:58.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.087+0000 7f00daf93700 1 --2- 172.21.15.17:0/456326108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d4101720 0x7f00d4107fe0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00b0a0 tx=0x7f00cc00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.087+0000 7f00daf93700 1 -- 172.21.15.17:0/456326108 shutdown_connections 2023-07-14T12:58:58.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.087+0000 7f00daf93700 1 --2- 172.21.15.17:0/456326108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d4101720 0x7f00d4107fe0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.087+0000 7f00daf93700 1 --2- 172.21.15.17:0/456326108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d40ffb90 0x7f00d40fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.087+0000 7f00daf93700 1 --2- 172.21.15.17:0/456326108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4100d90 0x7f00d41011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.087+0000 7f00daf93700 1 -- 172.21.15.17:0/456326108 >> 172.21.15.17:0/456326108 conn(0x7f00d40fb1a0 msgr2=0x7f00d40fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:58.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.087+0000 7f00daf93700 1 -- 172.21.15.17:0/456326108 shutdown_connections 2023-07-14T12:58:58.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.087+0000 7f00daf93700 1 -- 172.21.15.17:0/456326108 wait complete. 2023-07-14T12:58:58.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.088+0000 7f00daf93700 1 Processor -- start 2023-07-14T12:58:58.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.088+0000 7f00daf93700 1 -- start start 2023-07-14T12:58:58.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00daf93700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d40ffb90 0x7f00d4197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:58.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00daf93700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d4100d90 0x7f00d4197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:58.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00daf93700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4101720 0x7f00d419f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:58.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00daf93700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d419f630 con 0x7f00d40ffb90 2023-07-14T12:58:58.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00daf93700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d419f770 con 0x7f00d4100d90 2023-07-14T12:58:58.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00daf93700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d419f900 con 0x7f00d4101720 2023-07-14T12:58:58.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00d8d2f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d40ffb90 0x7f00d4197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:58.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00d8d2f700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d40ffb90 0x7f00d4197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34852/0 (socket says 172.21.15.17:34852) 2023-07-14T12:58:58.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00d8d2f700 1 -- 172.21.15.17:0/2164513499 learned_addr learned my addr 172.21.15.17:0/2164513499 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:58:58.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00d9530700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4101720 0x7f00d419f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:58.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00d3fff700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d4100d90 0x7f00d4197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:58.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00d8d2f700 1 -- 172.21.15.17:0/2164513499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4101720 msgr2=0x7f00d419f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:58.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00d8d2f700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4101720 0x7f00d419f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00d8d2f700 1 -- 172.21.15.17:0/2164513499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d4100d90 msgr2=0x7f00d4197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:58.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00d8d2f700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d4100d90 0x7f00d4197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00d8d2f700 1 -- 172.21.15.17:0/2164513499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc009d00 con 0x7f00d40ffb90 2023-07-14T12:58:58.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.089+0000 7f00d3fff700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d4100d90 0x7f00d4197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:58:58.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.090+0000 7f00d8d2f700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d40ffb90 0x7f00d4197aa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f00c800d9b0 tx=0x7f00c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:58.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.090+0000 7f00d1ffb700 1 -- 172.21.15.17:0/2164513499 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8004020 con 0x7f00d40ffb90 2023-07-14T12:58:58.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.090+0000 7f00d1ffb700 1 -- 172.21.15.17:0/2164513499 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00c8009730 con 0x7f00d40ffb90 2023-07-14T12:58:58.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.090+0000 7f00daf93700 1 -- 172.21.15.17:0/2164513499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d419fbe0 con 0x7f00d40ffb90 2023-07-14T12:58:58.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.090+0000 7f00d1ffb700 1 -- 172.21.15.17:0/2164513499 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80039c0 con 0x7f00d40ffb90 2023-07-14T12:58:58.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.090+0000 7f00daf93700 1 -- 172.21.15.17:0/2164513499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d41a00e0 con 0x7f00d40ffb90 2023-07-14T12:58:58.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.091+0000 7f00daf93700 1 -- 172.21.15.17:0/2164513499 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d410b210 con 0x7f00d40ffb90 2023-07-14T12:58:58.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.093+0000 7f00d1ffb700 1 -- 172.21.15.17:0/2164513499 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f00c80098a0 con 0x7f00d40ffb90 2023-07-14T12:58:58.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.095+0000 7f00d1ffb700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f00c40a11e0 0x7f00c40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:58:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.095+0000 7f00d1ffb700 1 -- 172.21.15.17:0/2164513499 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f00c80cc780 con 0x7f00d40ffb90 2023-07-14T12:58:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.095+0000 7f00d3fff700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f00c40a11e0 0x7f00c40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:58:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.096+0000 7f00d3fff700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f00c40a11e0 0x7f00c40a3690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f00c000bc10 tx=0x7f00c000b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:58:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.100+0000 7f00d1ffb700 1 -- 172.21.15.17:0/2164513499 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f00c8095d40 con 0x7f00d40ffb90 2023-07-14T12:58:58.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.319+0000 7f00daf93700 1 -- 172.21.15.17:0/2164513499 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f00d41076f0 con 0x7f00c40a11e0 2023-07-14T12:58:58.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.325+0000 7f00d1ffb700 1 -- 172.21.15.17:0/2164513499 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f00d41076f0 con 0x7f00c40a11e0 2023-07-14T12:58:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-07-14T12:58:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:mds.all 12/12 11s ago 2m smithi017=a;smithi017=d;smithi017=g;smithi017=j;smithi131=b;smithi131=e;smithi131=h;smithi131=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2023-07-14T12:58:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:mgr 3/3 11s ago 7m smithi017=x;smithi131=y;smithi135=z;count:3 2023-07-14T12:58:58.355 INFO:teuthology.orchestra.run.smithi017.stdout:mon 3/3 11s ago 8m smithi017:172.21.15.17=a;smithi131:172.21.15.131=b;smithi135:172.21.15.135=c;count:3 2023-07-14T12:58:58.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd 12 11s ago - 2023-07-14T12:58:58.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.327+0000 7f00daf93700 1 -- 172.21.15.17:0/2164513499 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f00c40a11e0 msgr2=0x7f00c40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:58.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.327+0000 7f00daf93700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f00c40a11e0 0x7f00c40a3690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f00c000bc10 tx=0x7f00c000b5f0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.327+0000 7f00daf93700 1 -- 172.21.15.17:0/2164513499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d40ffb90 msgr2=0x7f00d4197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:58:58.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.327+0000 7f00daf93700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d40ffb90 0x7f00d4197aa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f00c800d9b0 tx=0x7f00c800dcc0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.328+0000 7f00daf93700 1 -- 172.21.15.17:0/2164513499 shutdown_connections 2023-07-14T12:58:58.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.328+0000 7f00daf93700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f00c40a11e0 0x7f00c40a3690 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.328+0000 7f00daf93700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4101720 0x7f00d419f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.328+0000 7f00daf93700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d40ffb90 0x7f00d4197aa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.328+0000 7f00daf93700 1 --2- 172.21.15.17:0/2164513499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00d4100d90 0x7f00d4197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:58:58.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.328+0000 7f00daf93700 1 -- 172.21.15.17:0/2164513499 >> 172.21.15.17:0/2164513499 conn(0x7f00d40fb1a0 msgr2=0x7f00d40fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:58:58.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.328+0000 7f00daf93700 1 -- 172.21.15.17:0/2164513499 shutdown_connections 2023-07-14T12:58:58.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:58:58.328+0000 7f00daf93700 1 -- 172.21.15.17:0/2164513499 wait complete. 2023-07-14T12:58:58.378 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:58:58 smithi017 ceph-mon[95536]: pgmap v343: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:58.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:58:58 smithi135 ceph-mon[97338]: pgmap v343: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:58.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:58:58 smithi131 ceph-mon[96953]: pgmap v343: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-14T12:58:58.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- bash -c 'ceph orch host ls' 2023-07-14T12:58:59.678 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:59:00.258 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:00 smithi017 ceph-mon[95536]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:00.259 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:00 smithi017 ceph-mon[95536]: pgmap v344: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:59:00.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:00 smithi135 ceph-mon[97338]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:00.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:00 smithi135 ceph-mon[97338]: pgmap v344: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:59:00.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:00 smithi131 ceph-mon[96953]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:00.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:00 smithi131 ceph-mon[96953]: pgmap v344: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-14T12:59:01.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.189+0000 7f48ffd95700 1 -- 172.21.15.17:0/932877089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8105910 msgr2=0x7f48f8107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.189+0000 7f48ffd95700 1 --2- 172.21.15.17:0/932877089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8105910 0x7f48f8107cf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f48f000b0a0 tx=0x7f48f000b3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.189+0000 7f48ffd95700 1 -- 172.21.15.17:0/932877089 shutdown_connections 2023-07-14T12:59:01.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.189+0000 7f48ffd95700 1 --2- 172.21.15.17:0/932877089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8105910 0x7f48f8107cf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.189+0000 7f48ffd95700 1 --2- 172.21.15.17:0/932877089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f81006d0 0x7f48f8102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:01.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.189+0000 7f48ffd95700 1 --2- 172.21.15.17:0/932877089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48f8102ff0 0x7f48f81053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.189+0000 7f48ffd95700 1 -- 172.21.15.17:0/932877089 >> 172.21.15.17:0/932877089 conn(0x7f48f80fa0b0 msgr2=0x7f48f80fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.189+0000 7f48ffd95700 1 -- 172.21.15.17:0/932877089 shutdown_connections 2023-07-14T12:59:01.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.189+0000 7f48ffd95700 1 -- 172.21.15.17:0/932877089 wait complete. 2023-07-14T12:59:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.190+0000 7f48ffd95700 1 Processor -- start 2023-07-14T12:59:01.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.191+0000 7f48ffd95700 1 -- start start 2023-07-14T12:59:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.191+0000 7f48ffd95700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48f81006d0 0x7f48f81979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.191+0000 7f48ffd95700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8102ff0 0x7f48f8197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.191+0000 7f48ffd95700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f8105910 0x7f48f819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.191+0000 7f48ffd95700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f819f580 con 0x7f48f8102ff0 2023-07-14T12:59:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.191+0000 7f48ffd95700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f819f6c0 con 0x7f48f8105910 2023-07-14T12:59:01.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.191+0000 7f48ffd95700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f819f850 con 0x7f48f81006d0 2023-07-14T12:59:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.191+0000 7f48fd330700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8102ff0 0x7f48f8197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.191+0000 7f48fd330700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8102ff0 0x7f48f8197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34868/0 (socket says 172.21.15.17:34868) 2023-07-14T12:59:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.191+0000 7f48fd330700 1 -- 172.21.15.17:0/3964590830 learned_addr learned my addr 172.21.15.17:0/3964590830 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.191+0000 7f48fdb31700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48f81006d0 0x7f48f81979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48fe332700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f8105910 0x7f48f819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48fd330700 1 -- 172.21.15.17:0/3964590830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48f81006d0 msgr2=0x7f48f81979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:01.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48fd330700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48f81006d0 0x7f48f81979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48fd330700 1 -- 172.21.15.17:0/3964590830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f8105910 msgr2=0x7f48f819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48fd330700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f8105910 0x7f48f819efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48fd330700 1 -- 172.21.15.17:0/3964590830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f0009d00 con 0x7f48f8102ff0 2023-07-14T12:59:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48fd330700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8102ff0 0x7f48f8197f30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c9e0 tx=0x7f48e800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48eeffd700 1 -- 172.21.15.17:0/3964590830 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8007ac0 con 0x7f48f8102ff0 2023-07-14T12:59:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48ffd95700 1 -- 172.21.15.17:0/3964590830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f819fb30 con 0x7f48f8102ff0 2023-07-14T12:59:01.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48eeffd700 1 -- 172.21.15.17:0/3964590830 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48e8007c20 con 0x7f48f8102ff0 2023-07-14T12:59:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48eeffd700 1 -- 172.21.15.17:0/3964590830 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8018660 con 0x7f48f8102ff0 2023-07-14T12:59:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.192+0000 7f48ffd95700 1 -- 172.21.15.17:0/3964590830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f81a0080 con 0x7f48f8102ff0 2023-07-14T12:59:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.194+0000 7f48ffd95700 1 -- 172.21.15.17:0/3964590830 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f8107480 con 0x7f48f8102ff0 2023-07-14T12:59:01.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.196+0000 7f48eeffd700 1 -- 172.21.15.17:0/3964590830 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f48e800f450 con 0x7f48f8102ff0 2023-07-14T12:59:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.197+0000 7f48eeffd700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f48e40a11e0 0x7f48e40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.197+0000 7f48eeffd700 1 -- 172.21.15.17:0/3964590830 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f48e80cca80 con 0x7f48f8102ff0 2023-07-14T12:59:01.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.197+0000 7f48fdb31700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f48e40a11e0 0x7f48e40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:01.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.198+0000 7f48fdb31700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f48e40a11e0 0x7f48e40a3690 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005950 tx=0x7f48f400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:01.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.201+0000 7f48eeffd700 1 -- 172.21.15.17:0/3964590830 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f48e8096040 con 0x7f48f8102ff0 2023-07-14T12:59:01.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.414+0000 7f48ffd95700 1 -- 172.21.15.17:0/3964590830 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f48f8060950 con 0x7f48e40a11e0 2023-07-14T12:59:01.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.415+0000 7f48eeffd700 1 -- 172.21.15.17:0/3964590830 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f48f8060950 con 0x7f48e40a11e0 2023-07-14T12:59:01.470 INFO:teuthology.orchestra.run.smithi017.stdout:HOST ADDR LABELS STATUS 2023-07-14T12:59:01.470 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 172.21.15.17 2023-07-14T12:59:01.470 INFO:teuthology.orchestra.run.smithi017.stdout:smithi131 172.21.15.131 2023-07-14T12:59:01.470 INFO:teuthology.orchestra.run.smithi017.stdout:smithi135 172.21.15.135 2023-07-14T12:59:01.471 INFO:teuthology.orchestra.run.smithi017.stdout:3 hosts in cluster 2023-07-14T12:59:01.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.417+0000 7f48ffd95700 1 -- 172.21.15.17:0/3964590830 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f48e40a11e0 msgr2=0x7f48e40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:01.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.417+0000 7f48ffd95700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f48e40a11e0 0x7f48e40a3690 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005950 tx=0x7f48f400b410 comp rx=0 tx=0).stop 2023-07-14T12:59:01.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.417+0000 7f48ffd95700 1 -- 172.21.15.17:0/3964590830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8102ff0 msgr2=0x7f48f8197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.417+0000 7f48ffd95700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8102ff0 0x7f48f8197f30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c9e0 tx=0x7f48e800ccf0 comp rx=0 tx=0).stop 2023-07-14T12:59:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.418+0000 7f48ffd95700 1 -- 172.21.15.17:0/3964590830 shutdown_connections 2023-07-14T12:59:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.418+0000 7f48ffd95700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f48e40a11e0 0x7f48e40a3690 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.418+0000 7f48ffd95700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48f8105910 0x7f48f819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.418+0000 7f48ffd95700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48f81006d0 0x7f48f81979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.418+0000 7f48ffd95700 1 --2- 172.21.15.17:0/3964590830 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48f8102ff0 0x7f48f8197f30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.418+0000 7f48ffd95700 1 -- 172.21.15.17:0/3964590830 >> 172.21.15.17:0/3964590830 conn(0x7f48f80fa0b0 msgr2=0x7f48f80fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.418+0000 7f48ffd95700 1 -- 172.21.15.17:0/3964590830 shutdown_connections 2023-07-14T12:59:01.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:01.418+0000 7f48ffd95700 1 -- 172.21.15.17:0/3964590830 wait complete. 2023-07-14T12:59:02.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- bash -c 'ceph orch device ls' 2023-07-14T12:59:02.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:02 smithi017 ceph-mon[95536]: pgmap v345: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-14T12:59:02.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:02 smithi135 ceph-mon[97338]: pgmap v345: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-14T12:59:02.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:02 smithi131 ceph-mon[96953]: pgmap v345: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-14T12:59:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:59:03.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:03 smithi017 ceph-mon[95536]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:03.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:03 smithi135 ceph-mon[97338]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:03.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:03 smithi131 ceph-mon[96953]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.320+0000 7f4273606700 1 -- 172.21.15.17:0/3348083113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f426c0ffb90 msgr2=0x7f426c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.320+0000 7f4273606700 1 --2- 172.21.15.17:0/3348083113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f426c0ffb90 0x7f426c0fffa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4268009990 tx=0x7f4268009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.320+0000 7f4273606700 1 -- 172.21.15.17:0/3348083113 shutdown_connections 2023-07-14T12:59:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.320+0000 7f4273606700 1 --2- 172.21.15.17:0/3348083113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f426c101720 0x7f426c107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.320+0000 7f4273606700 1 --2- 172.21.15.17:0/3348083113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f426c0ffb90 0x7f426c0fffa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.320+0000 7f4273606700 1 --2- 172.21.15.17:0/3348083113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f426c100d90 0x7f426c1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.320+0000 7f4273606700 1 -- 172.21.15.17:0/3348083113 >> 172.21.15.17:0/3348083113 conn(0x7f426c0fb1a0 msgr2=0x7f426c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:04.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.320+0000 7f4273606700 1 -- 172.21.15.17:0/3348083113 shutdown_connections 2023-07-14T12:59:04.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.320+0000 7f4273606700 1 -- 172.21.15.17:0/3348083113 wait complete. 2023-07-14T12:59:04.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.321+0000 7f4273606700 1 Processor -- start 2023-07-14T12:59:04.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f4273606700 1 -- start start 2023-07-14T12:59:04.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f4273606700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f426c0ffb90 0x7f426c195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:04.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f4273606700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f426c100d90 0x7f426c195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:04.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f4273606700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f426c101720 0x7f426c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:04.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f4273606700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c19d300 con 0x7f426c100d90 2023-07-14T12:59:04.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f4273606700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c19d440 con 0x7f426c101720 2023-07-14T12:59:04.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f4273606700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c19d5d0 con 0x7f426c0ffb90 2023-07-14T12:59:04.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f4270ba1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f426c100d90 0x7f426c195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:04.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f4270ba1700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f426c100d90 0x7f426c195cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34884/0 (socket says 172.21.15.17:34884) 2023-07-14T12:59:04.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f4270ba1700 1 -- 172.21.15.17:0/96373889 learned_addr learned my addr 172.21.15.17:0/96373889 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:04.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f4271ba3700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f426c101720 0x7f426c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:04.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.322+0000 7f42713a2700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f426c0ffb90 0x7f426c195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:04.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f4270ba1700 1 -- 172.21.15.17:0/96373889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f426c0ffb90 msgr2=0x7f426c195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:04.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f4270ba1700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f426c0ffb90 0x7f426c195770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f4270ba1700 1 -- 172.21.15.17:0/96373889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f426c101720 msgr2=0x7f426c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:04.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f4270ba1700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f426c101720 0x7f426c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f4270ba1700 1 -- 172.21.15.17:0/96373889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42680095f0 con 0x7f426c100d90 2023-07-14T12:59:04.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f4271ba3700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f426c101720 0x7f426c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:04.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f4270ba1700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f426c100d90 0x7f426c195cb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f425c00c9e0 tx=0x7f425c00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:04.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f42627fc700 1 -- 172.21.15.17:0/96373889 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c007ac0 con 0x7f426c100d90 2023-07-14T12:59:04.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f4273606700 1 -- 172.21.15.17:0/96373889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426c19d8b0 con 0x7f426c100d90 2023-07-14T12:59:04.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f42627fc700 1 -- 172.21.15.17:0/96373889 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f425c007c20 con 0x7f426c100d90 2023-07-14T12:59:04.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f42627fc700 1 -- 172.21.15.17:0/96373889 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c018660 con 0x7f426c100d90 2023-07-14T12:59:04.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.323+0000 7f4273606700 1 -- 172.21.15.17:0/96373889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c19de00 con 0x7f426c100d90 2023-07-14T12:59:04.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.324+0000 7f4273606700 1 -- 172.21.15.17:0/96373889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426c107190 con 0x7f426c100d90 2023-07-14T12:59:04.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:04 smithi017 ceph-mon[95536]: pgmap v346: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-14T12:59:04.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.326+0000 7f42627fc700 1 -- 172.21.15.17:0/96373889 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 135766+0+0 (secure 0 0 0) 0x7f425c00f450 con 0x7f426c100d90 2023-07-14T12:59:04.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.328+0000 7f42627fc700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42580a1260 0x7f42580a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:04.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.328+0000 7f42627fc700 1 -- 172.21.15.17:0/96373889 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f425c0cc9d0 con 0x7f426c100d90 2023-07-14T12:59:04.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.328+0000 7f42713a2700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42580a1260 0x7f42580a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:04.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.329+0000 7f42713a2700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42580a1260 0x7f42580a3710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f42680098e0 tx=0x7f4268000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:04.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.332+0000 7f42627fc700 1 -- 172.21.15.17:0/96373889 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f425c095ff0 con 0x7f426c100d90 2023-07-14T12:59:04.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:04 smithi135 ceph-mon[97338]: pgmap v346: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-14T12:59:04.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:04 smithi131 ceph-mon[96953]: pgmap v346: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-14T12:59:04.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.547+0000 7f4273606700 1 -- 172.21.15.17:0/96373889 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f426c060950 con 0x7f42580a1260 2023-07-14T12:59:04.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.549+0000 7f42627fc700 1 -- 172.21.15.17:0/96373889 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7f426c060950 con 0x7f42580a1260 2023-07-14T12:59:04.579 INFO:teuthology.orchestra.run.smithi017.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-07-14T12:59:04.579 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7473003Q480DGN 447G No 3m ago LVM detected, locked 2023-07-14T12:59:04.579 INFO:teuthology.orchestra.run.smithi017.stdout:smithi131 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300N4400BGN 372G No 2m ago LVM detected, locked 2023-07-14T12:59:04.579 INFO:teuthology.orchestra.run.smithi017.stdout:smithi135 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401BA400BGN 372G No 2m ago LVM detected, locked 2023-07-14T12:59:04.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 -- 172.21.15.17:0/96373889 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42580a1260 msgr2=0x7f42580a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:04.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42580a1260 0x7f42580a3710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f42680098e0 tx=0x7f4268000bc0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 -- 172.21.15.17:0/96373889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f426c100d90 msgr2=0x7f426c195cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:04.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f426c100d90 0x7f426c195cb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f425c00c9e0 tx=0x7f425c00cda0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 -- 172.21.15.17:0/96373889 shutdown_connections 2023-07-14T12:59:04.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f42580a1260 0x7f42580a3710 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f426c101720 0x7f426c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f426c0ffb90 0x7f426c195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 --2- 172.21.15.17:0/96373889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f426c100d90 0x7f426c195cb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:04.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 -- 172.21.15.17:0/96373889 >> 172.21.15.17:0/96373889 conn(0x7f426c0fb1a0 msgr2=0x7f426c1042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:04.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 -- 172.21.15.17:0/96373889 shutdown_connections 2023-07-14T12:59:04.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:04.551+0000 7f4273606700 1 -- 172.21.15.17:0/96373889 wait complete. 2023-07-14T12:59:05.112 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-07-14T12:59:05.123 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2023-07-14T12:59:05.124 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- bash -c 'ceph fs dump' 2023-07-14T12:59:05.872 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:59:06.433 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:06 smithi017 ceph-mon[95536]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:06.434 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:06 smithi017 ceph-mon[95536]: pgmap v347: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-14T12:59:06.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:06 smithi135 ceph-mon[97338]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:06.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:06 smithi135 ceph-mon[97338]: pgmap v347: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-14T12:59:06.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:06 smithi131 ceph-mon[96953]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:06.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:06 smithi131 ceph-mon[96953]: pgmap v347: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-14T12:59:07.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.418+0000 7f13428c9700 1 -- 172.21.15.17:0/1804501365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f133c074540 msgr2=0x7f133c0729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:07.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.418+0000 7f13428c9700 1 --2- 172.21.15.17:0/1804501365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f133c074540 0x7f133c0729a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f132c009990 tx=0x7f132c009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:07.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.419+0000 7f13428c9700 1 -- 172.21.15.17:0/1804501365 shutdown_connections 2023-07-14T12:59:07.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.419+0000 7f13428c9700 1 --2- 172.21.15.17:0/1804501365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c107a60 0x7f133c109ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:07.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.419+0000 7f13428c9700 1 --2- 172.21.15.17:0/1804501365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f133c074540 0x7f133c0729a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:07.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.419+0000 7f13428c9700 1 --2- 172.21.15.17:0/1804501365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f133c072f70 0x7f133c0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:07.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.419+0000 7f13428c9700 1 -- 172.21.15.17:0/1804501365 >> 172.21.15.17:0/1804501365 conn(0x7f133c0fb1a0 msgr2=0x7f133c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:07.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.419+0000 7f13428c9700 1 -- 172.21.15.17:0/1804501365 shutdown_connections 2023-07-14T12:59:07.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.419+0000 7f13428c9700 1 -- 172.21.15.17:0/1804501365 wait complete. 2023-07-14T12:59:07.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.420+0000 7f13428c9700 1 Processor -- start 2023-07-14T12:59:07.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.420+0000 7f13428c9700 1 -- start start 2023-07-14T12:59:07.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.420+0000 7f13428c9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f133c072f70 0x7f133c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:07.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.420+0000 7f13428c9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c074540 0x7f133c197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:07.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.420+0000 7f13428c9700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f133c107a60 0x7f133c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:07.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.420+0000 7f13428c9700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c19f570 con 0x7f133c107a60 2023-07-14T12:59:07.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.420+0000 7f13428c9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c19f6b0 con 0x7f133c074540 2023-07-14T12:59:07.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.420+0000 7f13428c9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c19f840 con 0x7f133c072f70 2023-07-14T12:59:07.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.420+0000 7f1340e66700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f133c107a60 0x7f133c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:07.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.421+0000 7f1340e66700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f133c107a60 0x7f133c19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34732/0 (socket says 172.21.15.17:34732) 2023-07-14T12:59:07.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.421+0000 7f1340e66700 1 -- 172.21.15.17:0/876533609 learned_addr learned my addr 172.21.15.17:0/876533609 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:07.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.421+0000 7f133b7fe700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c074540 0x7f133c197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:07.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.421+0000 7f133bfff700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f133c072f70 0x7f133c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:07.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.421+0000 7f1340e66700 1 -- 172.21.15.17:0/876533609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f133c072f70 msgr2=0x7f133c1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:07.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.421+0000 7f1340e66700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f133c072f70 0x7f133c1979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:07.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.421+0000 7f1340e66700 1 -- 172.21.15.17:0/876533609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c074540 msgr2=0x7f133c197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:07.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.421+0000 7f1340e66700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c074540 0x7f133c197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:07.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.421+0000 7f1340e66700 1 -- 172.21.15.17:0/876533609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c0095f0 con 0x7f133c107a60 2023-07-14T12:59:07.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.421+0000 7f1340e66700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f133c107a60 0x7f133c19efa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1334007f10 tx=0x7f133400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:07.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.422+0000 7f13397fa700 1 -- 172.21.15.17:0/876533609 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334017070 con 0x7f133c107a60 2023-07-14T12:59:07.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.422+0000 7f13397fa700 1 -- 172.21.15.17:0/876533609 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f133400f040 con 0x7f133c107a60 2023-07-14T12:59:07.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.422+0000 7f13397fa700 1 -- 172.21.15.17:0/876533609 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334005570 con 0x7f133c107a60 2023-07-14T12:59:07.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.422+0000 7f13428c9700 1 -- 172.21.15.17:0/876533609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c19fb20 con 0x7f133c107a60 2023-07-14T12:59:07.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.422+0000 7f13428c9700 1 -- 172.21.15.17:0/876533609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c19ffd0 con 0x7f133c107a60 2023-07-14T12:59:07.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.423+0000 7f13428c9700 1 -- 172.21.15.17:0/876533609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c106110 con 0x7f133c107a60 2023-07-14T12:59:07.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.425+0000 7f13397fa700 1 -- 172.21.15.17:0/876533609 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f133400db20 con 0x7f133c107a60 2023-07-14T12:59:07.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.426+0000 7f13397fa700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13240a11d0 0x7f13240a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:07.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.426+0000 7f13397fa700 1 -- 172.21.15.17:0/876533609 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f13340cbfe0 con 0x7f133c107a60 2023-07-14T12:59:07.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.427+0000 7f133bfff700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13240a11d0 0x7f13240a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:07.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.427+0000 7f133bfff700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13240a11d0 0x7f13240a3680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f132c006010 tx=0x7f132c00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:07.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.430+0000 7f13397fa700 1 -- 172.21.15.17:0/876533609 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1334095720 con 0x7f133c107a60 2023-07-14T12:59:07.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.681+0000 7f13428c9700 1 -- 172.21.15.17:0/876533609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f133c02c850 con 0x7f133c107a60 2023-07-14T12:59:07.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.682+0000 7f13397fa700 1 -- 172.21.15.17:0/876533609 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+2899 (secure 0 0 0) 0x7f1334098d40 con 0x7f133c107a60 2023-07-14T12:59:07.712 INFO:teuthology.orchestra.run.smithi017.stdout:e22 2023-07-14T12:59:07.712 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-07-14T12:59:07.712 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-14T12:59:07.712 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2023-07-14T12:59:07.713 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:07.713 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2023-07-14T12:59:07.713 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2023-07-14T12:59:07.713 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 22 2023-07-14T12:59:07.713 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-07-14T12:59:07.713 INFO:teuthology.orchestra.run.smithi017.stdout:created 2023-07-14T12:57:39.671161+0000 2023-07-14T12:59:07.714 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2023-07-14T12:57:45.208579+0000 2023-07-14T12:59:07.714 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2023-07-14T12:59:07.714 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2023-07-14T12:59:07.714 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 300 2023-07-14T12:59:07.714 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2023-07-14T12:59:07.714 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2023-07-14T12:59:07.715 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2023-07-14T12:59:07.715 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2023-07-14T12:59:07.715 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2023-07-14T12:59:07.715 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2023-07-14T12:59:07.715 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-14T12:59:07.715 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 3 2023-07-14T12:59:07.715 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1,2 2023-07-14T12:59:07.716 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=24593,1=24548,2=24547} 2023-07-14T12:59:07.716 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2023-07-14T12:59:07.716 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2023-07-14T12:59:07.716 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2023-07-14T12:59:07.716 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2023-07-14T12:59:07.716 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2023-07-14T12:59:07.716 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data disabled 2023-07-14T12:59:07.717 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2023-07-14T12:59:07.717 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2023-07-14T12:59:07.717 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 0 2023-07-14T12:59:07.717 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b{0:24593} state up:active seq 3 addr [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.717 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c{0:24526} state up:standby-replay seq 1 addr [v2:172.21.15.135:6836/4030549564,v1:172.21.15.135:6837/4030549564] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.717 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.h{1:24548} state up:active seq 7 addr [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.717 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.e{1:24515} state up:standby-replay seq 1 addr [v2:172.21.15.131:6834/1432780018,v1:172.21.15.131:6835/1432780018] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.717 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.i{2:24547} state up:active seq 6 addr [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.718 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.f{2:24508} state up:standby-replay seq 1 addr [v2:172.21.15.135:6834/1201140251,v1:172.21.15.135:6835/1201140251] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:07.718 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2023-07-14T12:59:07.718 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:07.718 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.j{-1:14598} state up:standby seq 1 addr [v2:172.21.15.17:6834/52692559,v1:172.21.15.17:6835/52692559] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.718 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d{-1:14610} state up:standby seq 1 addr [v2:172.21.15.17:6836/1941846207,v1:172.21.15.17:6837/1941846207] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.718 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.g{-1:14676} state up:standby seq 1 addr [v2:172.21.15.17:6838/3827721971,v1:172.21.15.17:6839/3827721971] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.719 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a{-1:14694} state up:standby seq 1 addr [v2:172.21.15.17:6840/2303800338,v1:172.21.15.17:6841/2303800338] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.719 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.l{-1:24457} state up:standby seq 1 addr [v2:172.21.15.135:6832/1506834360,v1:172.21.15.135:6833/1506834360] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.719 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.k{-1:24479} state up:standby seq 1 addr [v2:172.21.15.131:6832/610469935,v1:172.21.15.131:6833/610469935] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T12:59:07.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.684+0000 7f13428c9700 1 -- 172.21.15.17:0/876533609 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13240a11d0 msgr2=0x7f13240a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:07.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.684+0000 7f13428c9700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13240a11d0 0x7f13240a3680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f132c006010 tx=0x7f132c00b260 comp rx=0 tx=0).stop 2023-07-14T12:59:07.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.684+0000 7f13428c9700 1 -- 172.21.15.17:0/876533609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f133c107a60 msgr2=0x7f133c19efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:07.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.684+0000 7f13428c9700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f133c107a60 0x7f133c19efa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1334007f10 tx=0x7f133400d3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:07.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.684+0000 7f13428c9700 1 -- 172.21.15.17:0/876533609 shutdown_connections 2023-07-14T12:59:07.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.684+0000 7f13428c9700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f13240a11d0 0x7f13240a3680 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:07.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.684+0000 7f13428c9700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f133c107a60 0x7f133c19efa0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:07.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.684+0000 7f13428c9700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f133c072f70 0x7f133c1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:07.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.684+0000 7f13428c9700 1 --2- 172.21.15.17:0/876533609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c074540 0x7f133c197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:07.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.684+0000 7f13428c9700 1 -- 172.21.15.17:0/876533609 >> 172.21.15.17:0/876533609 conn(0x7f133c0fb1a0 msgr2=0x7f133c0fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:07.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.684+0000 7f13428c9700 1 -- 172.21.15.17:0/876533609 shutdown_connections 2023-07-14T12:59:07.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:07.685+0000 7f13428c9700 1 -- 172.21.15.17:0/876533609 wait complete. 2023-07-14T12:59:07.721 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2023-07-14T12:59:08.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- bash -c 'ceph osd dump' 2023-07-14T12:59:08.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:08 smithi135 ceph-mon[97338]: pgmap v348: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2023-07-14T12:59:08.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:08 smithi135 ceph-mon[97338]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-07-14T12:59:08.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:08 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/876533609' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-07-14T12:59:08.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:08 smithi131 ceph-mon[96953]: pgmap v348: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2023-07-14T12:59:08.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:08 smithi131 ceph-mon[96953]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-07-14T12:59:08.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:08 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/876533609' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-07-14T12:59:08.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:08 smithi017 ceph-mon[95536]: pgmap v348: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2023-07-14T12:59:08.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:08 smithi017 ceph-mon[95536]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-07-14T12:59:08.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:08 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/876533609' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-07-14T12:59:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:59:10.279 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:10 smithi017 ceph-mon[95536]: pgmap v349: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-07-14T12:59:10.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:10 smithi135 ceph-mon[97338]: pgmap v349: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-07-14T12:59:10.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:10 smithi131 ceph-mon[96953]: pgmap v349: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-07-14T12:59:10.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.494+0000 7f32a3d7c700 1 -- 172.21.15.17:0/2853604807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f329c103940 msgr2=0x7f329c10a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.494+0000 7f32a3d7c700 1 --2- 172.21.15.17:0/2853604807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f329c103940 0x7f329c10a270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f329400b0a0 tx=0x7f329400b3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.494+0000 7f32a3d7c700 1 -- 172.21.15.17:0/2853604807 shutdown_connections 2023-07-14T12:59:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.494+0000 7f32a3d7c700 1 --2- 172.21.15.17:0/2853604807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f329c103940 0x7f329c10a270 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.494+0000 7f32a3d7c700 1 --2- 172.21.15.17:0/2853604807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f329c101e30 0x7f329c102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:10.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.494+0000 7f32a3d7c700 1 --2- 172.21.15.17:0/2853604807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c102f90 0x7f329c103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:10.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.494+0000 7f32a3d7c700 1 -- 172.21.15.17:0/2853604807 >> 172.21.15.17:0/2853604807 conn(0x7f329c0fd440 msgr2=0x7f329c0ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:10.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.494+0000 7f32a3d7c700 1 -- 172.21.15.17:0/2853604807 shutdown_connections 2023-07-14T12:59:10.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.494+0000 7f32a3d7c700 1 -- 172.21.15.17:0/2853604807 wait complete. 2023-07-14T12:59:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.496+0000 7f32a3d7c700 1 Processor -- start 2023-07-14T12:59:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.496+0000 7f32a3d7c700 1 -- start start 2023-07-14T12:59:10.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.496+0000 7f32a3d7c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f329c101e30 0x7f329c197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a3d7c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c102f90 0x7f329c198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a3d7c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f329c103940 0x7f329c19f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a3d7c700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c19f670 con 0x7f329c101e30 2023-07-14T12:59:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a3d7c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c19f7b0 con 0x7f329c103940 2023-07-14T12:59:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a3d7c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c19f940 con 0x7f329c102f90 2023-07-14T12:59:10.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a1b18700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f329c101e30 0x7f329c197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a1b18700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f329c101e30 0x7f329c197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34750/0 (socket says 172.21.15.17:34750) 2023-07-14T12:59:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a1317700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c102f90 0x7f329c198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a1b18700 1 -- 172.21.15.17:0/689972232 learned_addr learned my addr 172.21.15.17:0/689972232 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a2319700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f329c103940 0x7f329c19f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a1b18700 1 -- 172.21.15.17:0/689972232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c102f90 msgr2=0x7f329c198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:10.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a1b18700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c102f90 0x7f329c198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:10.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a1b18700 1 -- 172.21.15.17:0/689972232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f329c103940 msgr2=0x7f329c19f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:10.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a1b18700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f329c103940 0x7f329c19f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:10.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a1b18700 1 -- 172.21.15.17:0/689972232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294009d00 con 0x7f329c101e30 2023-07-14T12:59:10.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.497+0000 7f32a2319700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f329c103940 0x7f329c19f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:10.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.498+0000 7f32a1b18700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f329c101e30 0x7f329c197ae0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f329800d9b0 tx=0x7f329800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.498+0000 7f3292ffd700 1 -- 172.21.15.17:0/689972232 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298004220 con 0x7f329c101e30 2023-07-14T12:59:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.498+0000 7f32a3d7c700 1 -- 172.21.15.17:0/689972232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c19fc20 con 0x7f329c101e30 2023-07-14T12:59:10.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.498+0000 7f3292ffd700 1 -- 172.21.15.17:0/689972232 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3298007640 con 0x7f329c101e30 2023-07-14T12:59:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.498+0000 7f3292ffd700 1 -- 172.21.15.17:0/689972232 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298005620 con 0x7f329c101e30 2023-07-14T12:59:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.498+0000 7f32a3d7c700 1 -- 172.21.15.17:0/689972232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c1a0170 con 0x7f329c101e30 2023-07-14T12:59:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.499+0000 7f32a3d7c700 1 -- 172.21.15.17:0/689972232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c10d450 con 0x7f329c101e30 2023-07-14T12:59:10.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.501+0000 7f3292ffd700 1 -- 172.21.15.17:0/689972232 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f3298004750 con 0x7f329c101e30 2023-07-14T12:59:10.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.503+0000 7f3292ffd700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32880a1150 0x7f32880a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:10.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.503+0000 7f3292ffd700 1 -- 172.21.15.17:0/689972232 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f32980cc800 con 0x7f329c101e30 2023-07-14T12:59:10.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.503+0000 7f32a1317700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32880a1150 0x7f32880a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:10.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.504+0000 7f32a1317700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32880a1150 0x7f32880a3600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f328c009be0 tx=0x7f328c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:10.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.506+0000 7f3292ffd700 1 -- 172.21.15.17:0/689972232 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3298095f20 con 0x7f329c101e30 2023-07-14T12:59:10.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.712+0000 7f32a3d7c700 1 -- 172.21.15.17:0/689972232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f329c108de0 con 0x7f329c101e30 2023-07-14T12:59:10.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.713+0000 7f3292ffd700 1 -- 172.21.15.17:0/689972232 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) v1 ==== 56+0+5262 (secure 0 0 0) 0x7f3298005780 con 0x7f329c101e30 2023-07-14T12:59:10.744 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 88 2023-07-14T12:59:10.744 INFO:teuthology.orchestra.run.smithi017.stdout:fsid b31a3268-2244-11ee-9b33-001a4aab830c 2023-07-14T12:59:10.744 INFO:teuthology.orchestra.run.smithi017.stdout:created 2023-07-14T12:49:02.947884+0000 2023-07-14T12:59:10.744 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2023-07-14T12:58:07.945460+0000 2023-07-14T12:59:10.745 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-07-14T12:59:10.745 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 26 2023-07-14T12:59:10.745 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2023-07-14T12:59:10.746 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2023-07-14T12:59:10.746 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2023-07-14T12:59:10.746 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2023-07-14T12:59:10.746 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client luminous 2023-07-14T12:59:10.747 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release reef 2023-07-14T12:59:10.747 INFO:teuthology.orchestra.run.smithi017.stdout:stretch_mode_enabled false 2023-07-14T12:59:10.747 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-07-14T12:59:10.747 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2023-07-14T12:59:10.748 INFO:teuthology.orchestra.run.smithi017.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-07-14T12:59:10.748 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 12 2023-07-14T12:59:10.748 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6802/2578098788,v1:172.21.15.17:6803/2578098788] [v2:172.21.15.17:6804/2578098788,v1:172.21.15.17:6805/2578098788] exists,up 5de7a33f-905e-4374-bf3b-95ca11eee3c5 2023-07-14T12:59:10.749 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6800/3352217592,v1:172.21.15.131:6801/3352217592] [v2:172.21.15.131:6802/3352217592,v1:172.21.15.131:6803/3352217592] exists,up 73e24a1b-4661-4c71-83ef-5f5ad4081046 2023-07-14T12:59:10.749 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6800/280499423,v1:172.21.15.135:6801/280499423] [v2:172.21.15.135:6802/280499423,v1:172.21.15.135:6803/280499423] exists,up fde438ad-9889-4407-b0d7-1baf7dde5fa4 2023-07-14T12:59:10.749 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6810/1157710316,v1:172.21.15.17:6811/1157710316] [v2:172.21.15.17:6812/1157710316,v1:172.21.15.17:6813/1157710316] exists,up 784f3a65-facf-426b-babf-bde561f064cb 2023-07-14T12:59:10.749 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 up in weight 1 up_from 34 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6808/2961620738,v1:172.21.15.131:6809/2961620738] [v2:172.21.15.131:6810/2961620738,v1:172.21.15.131:6811/2961620738] exists,up 443988de-50af-4760-ba5b-9b024a906d8d 2023-07-14T12:59:10.749 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 up in weight 1 up_from 39 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6808/494689229,v1:172.21.15.135:6809/494689229] [v2:172.21.15.135:6810/494689229,v1:172.21.15.135:6811/494689229] exists,up adb30dc0-fa38-45d5-8413-e049e6a1dd6b 2023-07-14T12:59:10.750 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 up in weight 1 up_from 47 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6818/3590489731,v1:172.21.15.17:6819/3590489731] [v2:172.21.15.17:6820/3590489731,v1:172.21.15.17:6821/3590489731] exists,up 7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4 2023-07-14T12:59:10.750 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 up in weight 1 up_from 52 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6816/2006382147,v1:172.21.15.131:6817/2006382147] [v2:172.21.15.131:6818/2006382147,v1:172.21.15.131:6819/2006382147] exists,up b8043c8e-d385-48fe-afd2-163ce4cb49da 2023-07-14T12:59:10.750 INFO:teuthology.orchestra.run.smithi017.stdout:osd.8 up in weight 1 up_from 60 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6816/4144218895,v1:172.21.15.135:6817/4144218895] [v2:172.21.15.135:6818/4144218895,v1:172.21.15.135:6819/4144218895] exists,up d828ebc9-487a-46ac-bd6c-b5572903cd3b 2023-07-14T12:59:10.750 INFO:teuthology.orchestra.run.smithi017.stdout:osd.9 up in weight 1 up_from 68 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6826/556821808,v1:172.21.15.17:6827/556821808] [v2:172.21.15.17:6828/556821808,v1:172.21.15.17:6829/556821808] exists,up e83ba4ac-ebb8-4f08-961d-3221193aa1eb 2023-07-14T12:59:10.750 INFO:teuthology.orchestra.run.smithi017.stdout:osd.10 up in weight 1 up_from 73 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6824/3503442823,v1:172.21.15.131:6825/3503442823] [v2:172.21.15.131:6826/3503442823,v1:172.21.15.131:6827/3503442823] exists,up 61c3f223-8d23-4b29-9c18-e45d08aa5960 2023-07-14T12:59:10.750 INFO:teuthology.orchestra.run.smithi017.stdout:osd.11 up in weight 1 up_from 81 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6824/2475021404,v1:172.21.15.135:6825/2475021404] [v2:172.21.15.135:6826/2475021404,v1:172.21.15.135:6827/2475021404] exists,up 3a17613e-c927-4c60-bfe9-518ea7d627e4 2023-07-14T12:59:10.750 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.a [2,11] 2023-07-14T12:59:10.751 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.10 [2,4] 2023-07-14T12:59:10.751 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.13 [2,11] 2023-07-14T12:59:10.751 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 2.1a [8,1] 2023-07-14T12:59:10.751 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.1b [4,8,5,9] 2023-07-14T12:59:10.751 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.34 [4,9] 2023-07-14T12:59:10.751 INFO:teuthology.orchestra.run.smithi017.stdout:pg_upmap_items 3.38 [3,9] 2023-07-14T12:59:10.751 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/1783581931 expires 2023-07-15T12:50:06.734862+0000 2023-07-14T12:59:10.751 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/1783581931 expires 2023-07-15T12:50:06.734862+0000 2023-07-14T12:59:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/289337901 expires 2023-07-15T12:50:06.734862+0000 2023-07-14T12:59:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6801/3639458654 expires 2023-07-15T12:49:39.980336+0000 2023-07-14T12:59:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/135468511 expires 2023-07-15T12:50:06.734862+0000 2023-07-14T12:59:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:6800/3639458654 expires 2023-07-15T12:49:39.980336+0000 2023-07-14T12:59:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/1204213342 expires 2023-07-15T12:49:39.980336+0000 2023-07-14T12:59:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/2727688865 expires 2023-07-15T12:49:39.980336+0000 2023-07-14T12:59:10.752 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/3042541598 expires 2023-07-15T12:50:06.734862+0000 2023-07-14T12:59:10.753 INFO:teuthology.orchestra.run.smithi017.stdout:blocklist 172.21.15.17:0/3837590693 expires 2023-07-15T12:49:39.980336+0000 2023-07-14T12:59:10.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 -- 172.21.15.17:0/689972232 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32880a1150 msgr2=0x7f32880a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:10.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32880a1150 0x7f32880a3600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f328c009be0 tx=0x7f328c009260 comp rx=0 tx=0).stop 2023-07-14T12:59:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 -- 172.21.15.17:0/689972232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f329c101e30 msgr2=0x7f329c197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f329c101e30 0x7f329c197ae0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f329800d9b0 tx=0x7f329800dcc0 comp rx=0 tx=0).stop 2023-07-14T12:59:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 -- 172.21.15.17:0/689972232 shutdown_connections 2023-07-14T12:59:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f32880a1150 0x7f32880a3600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f329c103940 0x7f329c19f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f329c101e30 0x7f329c197ae0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:10.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 --2- 172.21.15.17:0/689972232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f329c102f90 0x7f329c198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:10.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 -- 172.21.15.17:0/689972232 >> 172.21.15.17:0/689972232 conn(0x7f329c0fd440 msgr2=0x7f329c0ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:10.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 -- 172.21.15.17:0/689972232 shutdown_connections 2023-07-14T12:59:10.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:10.716+0000 7f32a3d7c700 1 -- 172.21.15.17:0/689972232 wait complete. 2023-07-14T12:59:11.285 INFO:teuthology.run_tasks:Running task fs.ready... 2023-07-14T12:59:11.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:59:11.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:11 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/689972232' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-07-14T12:59:11.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:11 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/689972232' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-07-14T12:59:11.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.478+0000 7fc1387ff700 1 -- 172.21.15.17:0/2644863579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1300ffb00 msgr2=0x7fc1300fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:11.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.478+0000 7fc1387ff700 1 --2- 172.21.15.17:0/2644863579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1300ffb00 0x7fc1300fff10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009990 tx=0x7fc12c009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.478+0000 7fc1387ff700 1 -- 172.21.15.17:0/2644863579 shutdown_connections 2023-07-14T12:59:11.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.478+0000 7fc1387ff700 1 --2- 172.21.15.17:0/2644863579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130101680 0x7fc130107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.478+0000 7fc1387ff700 1 --2- 172.21.15.17:0/2644863579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1300ffb00 0x7fc1300fff10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.478+0000 7fc1387ff700 1 --2- 172.21.15.17:0/2644863579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc130100cf0 0x7fc130101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.478+0000 7fc1387ff700 1 -- 172.21.15.17:0/2644863579 >> 172.21.15.17:0/2644863579 conn(0x7fc1300fb0e0 msgr2=0x7fc1300fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:11.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.478+0000 7fc1387ff700 1 -- 172.21.15.17:0/2644863579 shutdown_connections 2023-07-14T12:59:11.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.478+0000 7fc1387ff700 1 -- 172.21.15.17:0/2644863579 wait complete. 2023-07-14T12:59:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.479+0000 7fc1387ff700 1 Processor -- start 2023-07-14T12:59:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.479+0000 7fc1387ff700 1 -- start start 2023-07-14T12:59:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc1387ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1300ffb00 0x7fc130197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc1387ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130100cf0 0x7fc130197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc1387ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc130101680 0x7fc13019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc1387ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13019f4f0 con 0x7fc1300ffb00 2023-07-14T12:59:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc1387ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13019f630 con 0x7fc130101680 2023-07-14T12:59:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc1387ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13019f7c0 con 0x7fc130100cf0 2023-07-14T12:59:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc13659b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1300ffb00 0x7fc130197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc13659b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1300ffb00 0x7fc130197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34766/0 (socket says 172.21.15.17:34766) 2023-07-14T12:59:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc13659b700 1 -- 172.21.15.17:0/989013241 learned_addr learned my addr 172.21.15.17:0/989013241 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc136d9c700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc130101680 0x7fc13019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc135d9a700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130100cf0 0x7fc130197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc13659b700 1 -- 172.21.15.17:0/989013241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130100cf0 msgr2=0x7fc130197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc13659b700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130100cf0 0x7fc130197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc13659b700 1 -- 172.21.15.17:0/989013241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc130101680 msgr2=0x7fc13019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc13659b700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc130101680 0x7fc13019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.480+0000 7fc13659b700 1 -- 172.21.15.17:0/989013241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c0095f0 con 0x7fc1300ffb00 2023-07-14T12:59:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.481+0000 7fc135d9a700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130100cf0 0x7fc130197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.481+0000 7fc13659b700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1300ffb00 0x7fc130197970 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00b5c0 tx=0x7fc12c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.481+0000 7fc1277fe700 1 -- 172.21.15.17:0/989013241 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c01d070 con 0x7fc1300ffb00 2023-07-14T12:59:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.481+0000 7fc1277fe700 1 -- 172.21.15.17:0/989013241 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc12c004000 con 0x7fc1300ffb00 2023-07-14T12:59:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.481+0000 7fc1387ff700 1 -- 172.21.15.17:0/989013241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13019fa40 con 0x7fc1300ffb00 2023-07-14T12:59:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.481+0000 7fc1277fe700 1 -- 172.21.15.17:0/989013241 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c022d00 con 0x7fc1300ffb00 2023-07-14T12:59:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.481+0000 7fc1387ff700 1 -- 172.21.15.17:0/989013241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13019ff40 con 0x7fc1300ffb00 2023-07-14T12:59:11.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.482+0000 7fc1387ff700 1 -- 172.21.15.17:0/989013241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1301920c0 con 0x7fc1300ffb00 2023-07-14T12:59:11.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.484+0000 7fc1277fe700 1 -- 172.21.15.17:0/989013241 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc12c003b70 con 0x7fc1300ffb00 2023-07-14T12:59:11.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.485+0000 7fc1277fe700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc11c0a1220 0x7fc11c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:11.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.486+0000 7fc1277fe700 1 -- 172.21.15.17:0/989013241 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fc12c0cdc60 con 0x7fc1300ffb00 2023-07-14T12:59:11.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.486+0000 7fc135d9a700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc11c0a1220 0x7fc11c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:11.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.486+0000 7fc135d9a700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc11c0a1220 0x7fc11c0a36d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc120005950 tx=0x7fc1200058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:11.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.489+0000 7fc1277fe700 1 -- 172.21.15.17:0/989013241 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc12c097410 con 0x7fc1300ffb00 2023-07-14T12:59:11.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:11 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/689972232' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-07-14T12:59:11.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.700+0000 7fc1387ff700 1 -- 172.21.15.17:0/989013241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc13002c850 con 0x7fc1300ffb00 2023-07-14T12:59:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.701+0000 7fc1277fe700 1 -- 172.21.15.17:0/989013241 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22469 (secure 0 0 0) 0x7fc12c022e60 con 0x7fc1300ffb00 2023-07-14T12:59:11.731 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:11.732 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":88,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:58:07.945460+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:59:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 -- 172.21.15.17:0/989013241 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc11c0a1220 msgr2=0x7fc11c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc11c0a1220 0x7fc11c0a36d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc120005950 tx=0x7fc1200058e0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 -- 172.21.15.17:0/989013241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1300ffb00 msgr2=0x7fc130197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1300ffb00 0x7fc130197970 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00b5c0 tx=0x7fc12c005740 comp rx=0 tx=0).stop 2023-07-14T12:59:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 -- 172.21.15.17:0/989013241 shutdown_connections 2023-07-14T12:59:11.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc11c0a1220 0x7fc11c0a36d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc130101680 0x7fc13019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1300ffb00 0x7fc130197970 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 --2- 172.21.15.17:0/989013241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130100cf0 0x7fc130197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 -- 172.21.15.17:0/989013241 >> 172.21.15.17:0/989013241 conn(0x7fc1300fb0e0 msgr2=0x7fc1301065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 -- 172.21.15.17:0/989013241 shutdown_connections 2023-07-14T12:59:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.704+0000 7fc1387ff700 1 -- 172.21.15.17:0/989013241 wait complete. 2023-07-14T12:59:11.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:57:37.876360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:57:39.117456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:59:11.754 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:59:11.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.932+0000 7f953a5ff700 1 -- 172.21.15.17:0/2815552936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9534101660 msgr2=0x7f9534107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:11.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.932+0000 7f953a5ff700 1 --2- 172.21.15.17:0/2815552936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9534101660 0x7f9534107f20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f952c00b0a0 tx=0x7f952c00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.932+0000 7f953a5ff700 1 -- 172.21.15.17:0/2815552936 shutdown_connections 2023-07-14T12:59:11.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.932+0000 7f953a5ff700 1 --2- 172.21.15.17:0/2815552936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9534101660 0x7f9534107f20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.932+0000 7f953a5ff700 1 --2- 172.21.15.17:0/2815552936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95340ffae0 0x7f95340ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.932+0000 7f953a5ff700 1 --2- 172.21.15.17:0/2815552936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9534100cd0 0x7f9534101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.932+0000 7f953a5ff700 1 -- 172.21.15.17:0/2815552936 >> 172.21.15.17:0/2815552936 conn(0x7f95340fb0e0 msgr2=0x7f95340fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:11.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.932+0000 7f953a5ff700 1 -- 172.21.15.17:0/2815552936 shutdown_connections 2023-07-14T12:59:11.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.932+0000 7f953a5ff700 1 -- 172.21.15.17:0/2815552936 wait complete. 2023-07-14T12:59:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.933+0000 7f953a5ff700 1 Processor -- start 2023-07-14T12:59:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.933+0000 7f953a5ff700 1 -- start start 2023-07-14T12:59:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.933+0000 7f953a5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340ffae0 0x7f95340742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.933+0000 7f953a5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534100cd0 0x7f9534072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.933+0000 7f953a5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9534101660 0x7f9534072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.933+0000 7f953a5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95340735e0 con 0x7f95340ffae0 2023-07-14T12:59:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.933+0000 7f953a5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9534073750 con 0x7f9534101660 2023-07-14T12:59:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.933+0000 7f953a5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953419f940 con 0x7f9534100cd0 2023-07-14T12:59:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f9533fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340ffae0 0x7f95340742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f9533fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340ffae0 0x7f95340742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34776/0 (socket says 172.21.15.17:34776) 2023-07-14T12:59:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f9533fff700 1 -- 172.21.15.17:0/587909337 learned_addr learned my addr 172.21.15.17:0/587909337 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f95337fe700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534100cd0 0x7f9534072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f9533fff700 1 -- 172.21.15.17:0/587909337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534100cd0 msgr2=0x7f9534072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f9533fff700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534100cd0 0x7f9534072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f9533fff700 1 -- 172.21.15.17:0/587909337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9534101660 msgr2=0x7f9534072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f9533fff700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9534101660 0x7f9534072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f9533fff700 1 -- 172.21.15.17:0/587909337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c009d00 con 0x7f95340ffae0 2023-07-14T12:59:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f95337fe700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534100cd0 0x7f9534072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f9533fff700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340ffae0 0x7f95340742c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f952400d980 tx=0x7f952400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.934+0000 7f95317fa700 1 -- 172.21.15.17:0/587909337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400de60 con 0x7f95340ffae0 2023-07-14T12:59:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.935+0000 7f95317fa700 1 -- 172.21.15.17:0/587909337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95240044b0 con 0x7f95340ffae0 2023-07-14T12:59:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.935+0000 7f95317fa700 1 -- 172.21.15.17:0/587909337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524003b40 con 0x7f95340ffae0 2023-07-14T12:59:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.935+0000 7f953a5ff700 1 -- 172.21.15.17:0/587909337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953419fc20 con 0x7f95340ffae0 2023-07-14T12:59:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.935+0000 7f953a5ff700 1 -- 172.21.15.17:0/587909337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95341a00e0 con 0x7f95340ffae0 2023-07-14T12:59:11.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.936+0000 7f953a5ff700 1 -- 172.21.15.17:0/587909337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9534107070 con 0x7f95340ffae0 2023-07-14T12:59:11.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.938+0000 7f95317fa700 1 -- 172.21.15.17:0/587909337 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f9524003ca0 con 0x7f95340ffae0 2023-07-14T12:59:11.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.939+0000 7f95317fa700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f951c0a11d0 0x7f951c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:11.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.939+0000 7f95317fa700 1 -- 172.21.15.17:0/587909337 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f95240cc5b0 con 0x7f95340ffae0 2023-07-14T12:59:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.939+0000 7f95337fe700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f951c0a11d0 0x7f951c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.940+0000 7f95337fe700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f951c0a11d0 0x7f951c0a3680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9528005e10 tx=0x7f9528005d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:11.943+0000 7f95317fa700 1 -- 172.21.15.17:0/587909337 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f9524095cd0 con 0x7f95340ffae0 2023-07-14T12:59:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.154+0000 7f953a5ff700 1 -- 172.21.15.17:0/587909337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f953402cab0 con 0x7f95340ffae0 2023-07-14T12:59:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.155+0000 7f95317fa700 1 -- 172.21.15.17:0/587909337 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9524009940 con 0x7f95340ffae0 2023-07-14T12:59:12.185 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T12:59:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 -- 172.21.15.17:0/587909337 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f951c0a11d0 msgr2=0x7f951c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f951c0a11d0 0x7f951c0a3680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9528005e10 tx=0x7f9528005d60 comp rx=0 tx=0).stop 2023-07-14T12:59:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 -- 172.21.15.17:0/587909337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340ffae0 msgr2=0x7f95340742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:12.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340ffae0 0x7f95340742c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f952400d980 tx=0x7f952400dd40 comp rx=0 tx=0).stop 2023-07-14T12:59:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 -- 172.21.15.17:0/587909337 shutdown_connections 2023-07-14T12:59:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f951c0a11d0 0x7f951c0a3680 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9534101660 0x7f9534072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95340ffae0 0x7f95340742c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 --2- 172.21.15.17:0/587909337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9534100cd0 0x7f9534072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 -- 172.21.15.17:0/587909337 >> 172.21.15.17:0/587909337 conn(0x7f95340fb0e0 msgr2=0x7f95341041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 -- 172.21.15.17:0/587909337 shutdown_connections 2023-07-14T12:59:12.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.157+0000 7f953a5ff700 1 -- 172.21.15.17:0/587909337 wait complete. 2023-07-14T12:59:12.206 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:59:12.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.382+0000 7f88f1fff700 1 -- 172.21.15.17:0/3826895775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ec072f70 msgr2=0x7f88ec0733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:12.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.382+0000 7f88f1fff700 1 --2- 172.21.15.17:0/3826895775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ec072f70 0x7f88ec0733e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009990 tx=0x7f88e0009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.382+0000 7f88f1fff700 1 -- 172.21.15.17:0/3826895775 shutdown_connections 2023-07-14T12:59:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.382+0000 7f88f1fff700 1 --2- 172.21.15.17:0/3826895775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88ec1079b0 0x7f88ec109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.382+0000 7f88f1fff700 1 --2- 172.21.15.17:0/3826895775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec074550 0x7f88ec0729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.382+0000 7f88f1fff700 1 --2- 172.21.15.17:0/3826895775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ec072f70 0x7f88ec0733e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.382+0000 7f88f1fff700 1 -- 172.21.15.17:0/3826895775 >> 172.21.15.17:0/3826895775 conn(0x7f88ec0fb130 msgr2=0x7f88ec0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.383+0000 7f88f1fff700 1 -- 172.21.15.17:0/3826895775 shutdown_connections 2023-07-14T12:59:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.383+0000 7f88f1fff700 1 -- 172.21.15.17:0/3826895775 wait complete. 2023-07-14T12:59:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.384+0000 7f88f1fff700 1 Processor -- start 2023-07-14T12:59:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.384+0000 7f88f1fff700 1 -- start start 2023-07-14T12:59:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.384+0000 7f88f1fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88ec072f70 0x7f88ec1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.384+0000 7f88f1fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec074550 0x7f88ec197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.384+0000 7f88f1fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ec1079b0 0x7f88ec19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.384+0000 7f88f1fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec19f570 con 0x7f88ec1079b0 2023-07-14T12:59:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.384+0000 7f88f1fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec19f6b0 con 0x7f88ec074550 2023-07-14T12:59:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.384+0000 7f88f1fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec19f840 con 0x7f88ec072f70 2023-07-14T12:59:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.384+0000 7f88ebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ec1079b0 0x7f88ec19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.384+0000 7f88ebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ec1079b0 0x7f88ec19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34784/0 (socket says 172.21.15.17:34784) 2023-07-14T12:59:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.384+0000 7f88ebfff700 1 -- 172.21.15.17:0/1737036002 learned_addr learned my addr 172.21.15.17:0/1737036002 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88eaffd700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec074550 0x7f88ec197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88eb7fe700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88ec072f70 0x7f88ec1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88ebfff700 1 -- 172.21.15.17:0/1737036002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88ec072f70 msgr2=0x7f88ec1979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88ebfff700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88ec072f70 0x7f88ec1979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88ebfff700 1 -- 172.21.15.17:0/1737036002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec074550 msgr2=0x7f88ec197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88ebfff700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec074550 0x7f88ec197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88ebfff700 1 -- 172.21.15.17:0/1737036002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e00095f0 con 0x7f88ec1079b0 2023-07-14T12:59:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88ebfff700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ec1079b0 0x7f88ec19efa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f88e4007ee0 tx=0x7f88e400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88e8ff9700 1 -- 172.21.15.17:0/1737036002 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4017070 con 0x7f88ec1079b0 2023-07-14T12:59:12.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88e8ff9700 1 -- 172.21.15.17:0/1737036002 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88e400f040 con 0x7f88ec1079b0 2023-07-14T12:59:12.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88e8ff9700 1 -- 172.21.15.17:0/1737036002 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4005710 con 0x7f88ec1079b0 2023-07-14T12:59:12.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.385+0000 7f88f1fff700 1 -- 172.21.15.17:0/1737036002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec19fb20 con 0x7f88ec1079b0 2023-07-14T12:59:12.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.386+0000 7f88f1fff700 1 -- 172.21.15.17:0/1737036002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec19ffe0 con 0x7f88ec1079b0 2023-07-14T12:59:12.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.387+0000 7f88f1fff700 1 -- 172.21.15.17:0/1737036002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ec106060 con 0x7f88ec1079b0 2023-07-14T12:59:12.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.389+0000 7f88e8ff9700 1 -- 172.21.15.17:0/1737036002 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f88e4005870 con 0x7f88ec1079b0 2023-07-14T12:59:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.390+0000 7f88e8ff9700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f88d40a1150 0x7f88d40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.390+0000 7f88e8ff9700 1 -- 172.21.15.17:0/1737036002 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f88e40cc150 con 0x7f88ec1079b0 2023-07-14T12:59:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.390+0000 7f88eb7fe700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f88d40a1150 0x7f88d40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.391+0000 7f88eb7fe700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f88d40a1150 0x7f88d40a3600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f88ec074920 tx=0x7f88dc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:12.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.394+0000 7f88e8ff9700 1 -- 172.21.15.17:0/1737036002 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f88e4095870 con 0x7f88ec1079b0 2023-07-14T12:59:12.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:12 smithi135 ceph-mon[97338]: pgmap v350: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2023-07-14T12:59:12.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:12 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/989013241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:12.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:12 smithi131 ceph-mon[96953]: pgmap v350: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2023-07-14T12:59:12.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:12 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/989013241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:12.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:12 smithi017 ceph-mon[95536]: pgmap v350: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2023-07-14T12:59:12.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:12 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/989013241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:12.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.604+0000 7f88f1fff700 1 -- 172.21.15.17:0/1737036002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88ec0611c0 con 0x7f88ec1079b0 2023-07-14T12:59:12.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.604+0000 7f88e8ff9700 1 -- 172.21.15.17:0/1737036002 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88e4098e90 con 0x7f88ec1079b0 2023-07-14T12:59:12.635 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-07-14T12:59:12.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 -- 172.21.15.17:0/1737036002 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f88d40a1150 msgr2=0x7f88d40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:12.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f88d40a1150 0x7f88d40a3600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f88ec074920 tx=0x7f88dc009260 comp rx=0 tx=0).stop 2023-07-14T12:59:12.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 -- 172.21.15.17:0/1737036002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ec1079b0 msgr2=0x7f88ec19efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:12.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ec1079b0 0x7f88ec19efa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f88e4007ee0 tx=0x7f88e400d3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 -- 172.21.15.17:0/1737036002 shutdown_connections 2023-07-14T12:59:12.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f88d40a1150 0x7f88d40a3600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88ec1079b0 0x7f88ec19efa0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88ec072f70 0x7f88ec1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 --2- 172.21.15.17:0/1737036002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88ec074550 0x7f88ec197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 -- 172.21.15.17:0/1737036002 >> 172.21.15.17:0/1737036002 conn(0x7f88ec0fb130 msgr2=0x7f88ec0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:12.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 -- 172.21.15.17:0/1737036002 shutdown_connections 2023-07-14T12:59:12.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.607+0000 7f88f1fff700 1 -- 172.21.15.17:0/1737036002 wait complete. 2023-07-14T12:59:12.655 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:59:12.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.831+0000 7f95d519d700 1 -- 172.21.15.17:0/3530219964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95d0107850 msgr2=0x7f95d0109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.831+0000 7f95d519d700 1 --2- 172.21.15.17:0/3530219964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95d0107850 0x7f95d0109c70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f95c800b0a0 tx=0x7f95c800b3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.831+0000 7f95d519d700 1 -- 172.21.15.17:0/3530219964 shutdown_connections 2023-07-14T12:59:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.831+0000 7f95d519d700 1 --2- 172.21.15.17:0/3530219964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95d0107850 0x7f95d0109c70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.831+0000 7f95d519d700 1 --2- 172.21.15.17:0/3530219964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d00744b0 0x7f95d00729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.831+0000 7f95d519d700 1 --2- 172.21.15.17:0/3530219964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95d0072ee0 0x7f95d0073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.831+0000 7f95d519d700 1 -- 172.21.15.17:0/3530219964 >> 172.21.15.17:0/3530219964 conn(0x7f95d00fb010 msgr2=0x7f95d00fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.832+0000 7f95d519d700 1 -- 172.21.15.17:0/3530219964 shutdown_connections 2023-07-14T12:59:12.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.832+0000 7f95d519d700 1 -- 172.21.15.17:0/3530219964 wait complete. 2023-07-14T12:59:12.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.833+0000 7f95d519d700 1 Processor -- start 2023-07-14T12:59:12.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.833+0000 7f95d519d700 1 -- start start 2023-07-14T12:59:12.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.833+0000 7f95d519d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95d0072ee0 0x7f95d01977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:12.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.833+0000 7f95d519d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d00744b0 0x7f95d0197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:12.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.833+0000 7f95d519d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95d0107850 0x7f95d019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:12.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.833+0000 7f95d519d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d019f360 con 0x7f95d0072ee0 2023-07-14T12:59:12.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.833+0000 7f95d519d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d019f4a0 con 0x7f95d0107850 2023-07-14T12:59:12.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.833+0000 7f95d519d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d019f630 con 0x7f95d00744b0 2023-07-14T12:59:12.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.833+0000 7f95cffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95d0072ee0 0x7f95d01977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:12.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.833+0000 7f95cffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95d0072ee0 0x7f95d01977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34802/0 (socket says 172.21.15.17:34802) 2023-07-14T12:59:12.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.833+0000 7f95cffff700 1 -- 172.21.15.17:0/610659804 learned_addr learned my addr 172.21.15.17:0/610659804 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:12.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95d499c700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95d0107850 0x7f95d019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:12.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95cffff700 1 -- 172.21.15.17:0/610659804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d00744b0 msgr2=0x7f95d0197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:12.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95cffff700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d00744b0 0x7f95d0197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95cffff700 1 -- 172.21.15.17:0/610659804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95d0107850 msgr2=0x7f95d019ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:12.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95cffff700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95d0107850 0x7f95d019ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:12.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95cffff700 1 -- 172.21.15.17:0/610659804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c8009d00 con 0x7f95d0072ee0 2023-07-14T12:59:12.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95cffff700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95d0072ee0 0x7f95d01977e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f95c000e970 tx=0x7f95c000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:12.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95cd7fa700 1 -- 172.21.15.17:0/610659804 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c0009790 con 0x7f95d0072ee0 2023-07-14T12:59:12.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95cd7fa700 1 -- 172.21.15.17:0/610659804 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95c00044b0 con 0x7f95d0072ee0 2023-07-14T12:59:12.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95d519d700 1 -- 172.21.15.17:0/610659804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d019f910 con 0x7f95d0072ee0 2023-07-14T12:59:12.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95cd7fa700 1 -- 172.21.15.17:0/610659804 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c0003dd0 con 0x7f95d0072ee0 2023-07-14T12:59:12.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.834+0000 7f95d519d700 1 -- 172.21.15.17:0/610659804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d019fe70 con 0x7f95d0072ee0 2023-07-14T12:59:12.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.835+0000 7f95d519d700 1 -- 172.21.15.17:0/610659804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d0105fe0 con 0x7f95d0072ee0 2023-07-14T12:59:12.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.837+0000 7f95cd7fa700 1 -- 172.21.15.17:0/610659804 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f95c0004000 con 0x7f95d0072ee0 2023-07-14T12:59:12.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.839+0000 7f95cd7fa700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95b80a1270 0x7f95b80a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:12.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.839+0000 7f95cd7fa700 1 -- 172.21.15.17:0/610659804 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f95c0014070 con 0x7f95d0072ee0 2023-07-14T12:59:12.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.839+0000 7f95cf7fe700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95b80a1270 0x7f95b80a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:12.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.840+0000 7f95cf7fe700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95b80a1270 0x7f95b80a3720 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95c4005950 tx=0x7f95c40058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:12.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:12.843+0000 7f95cd7fa700 1 -- 172.21.15.17:0/610659804 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f95c0096340 con 0x7f95d0072ee0 2023-07-14T12:59:13.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.052+0000 7f95d519d700 1 -- 172.21.15.17:0/610659804 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95d0061220 con 0x7f95d0072ee0 2023-07-14T12:59:13.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.052+0000 7f95cd7fa700 1 -- 172.21.15.17:0/610659804 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95c0099960 con 0x7f95d0072ee0 2023-07-14T12:59:13.082 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-07-14T12:59:13.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.054+0000 7f95d519d700 1 -- 172.21.15.17:0/610659804 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95b80a1270 msgr2=0x7f95b80a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:13.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.054+0000 7f95d519d700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95b80a1270 0x7f95b80a3720 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95c4005950 tx=0x7f95c40058e0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.054+0000 7f95d519d700 1 -- 172.21.15.17:0/610659804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95d0072ee0 msgr2=0x7f95d01977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:13.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.054+0000 7f95d519d700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95d0072ee0 0x7f95d01977e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f95c000e970 tx=0x7f95c000ed30 comp rx=0 tx=0).stop 2023-07-14T12:59:13.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.055+0000 7f95d519d700 1 -- 172.21.15.17:0/610659804 shutdown_connections 2023-07-14T12:59:13.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.055+0000 7f95d519d700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f95b80a1270 0x7f95b80a3720 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.055+0000 7f95d519d700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95d0107850 0x7f95d019ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.055+0000 7f95d519d700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95d0072ee0 0x7f95d01977e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.055+0000 7f95d519d700 1 --2- 172.21.15.17:0/610659804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95d00744b0 0x7f95d0197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.055+0000 7f95d519d700 1 -- 172.21.15.17:0/610659804 >> 172.21.15.17:0/610659804 conn(0x7f95d00fb010 msgr2=0x7f95d00fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:13.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.055+0000 7f95d519d700 1 -- 172.21.15.17:0/610659804 shutdown_connections 2023-07-14T12:59:13.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.055+0000 7f95d519d700 1 -- 172.21.15.17:0/610659804 wait complete. 2023-07-14T12:59:13.103 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:59:13.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.278+0000 7f85473ff700 1 -- 172.21.15.17:0/550702785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8540100cf0 msgr2=0x7f8540101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:13.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.278+0000 7f85473ff700 1 --2- 172.21.15.17:0/550702785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8540100cf0 0x7f8540101140 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8530009990 tx=0x7f8530009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.278+0000 7f85473ff700 1 -- 172.21.15.17:0/550702785 shutdown_connections 2023-07-14T12:59:13.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.278+0000 7f85473ff700 1 --2- 172.21.15.17:0/550702785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8540101680 0x7f8540107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.278+0000 7f85473ff700 1 --2- 172.21.15.17:0/550702785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85400ffb00 0x7f85400fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.278+0000 7f85473ff700 1 --2- 172.21.15.17:0/550702785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8540100cf0 0x7f8540101140 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.278+0000 7f85473ff700 1 -- 172.21.15.17:0/550702785 >> 172.21.15.17:0/550702785 conn(0x7f85400fb0e0 msgr2=0x7f85400fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:13.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.278+0000 7f85473ff700 1 -- 172.21.15.17:0/550702785 shutdown_connections 2023-07-14T12:59:13.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.278+0000 7f85473ff700 1 -- 172.21.15.17:0/550702785 wait complete. 2023-07-14T12:59:13.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.280+0000 7f85473ff700 1 Processor -- start 2023-07-14T12:59:13.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.280+0000 7f85473ff700 1 -- start start 2023-07-14T12:59:13.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f85473ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb00 0x7f85401957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:13.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f85473ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540100cf0 0x7f8540195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:13.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f85473ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8540101680 0x7f854019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:13.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f85473ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854019d340 con 0x7f85400ffb00 2023-07-14T12:59:13.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f85473ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854019d480 con 0x7f8540101680 2023-07-14T12:59:13.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f85473ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854019d610 con 0x7f8540100cf0 2023-07-14T12:59:13.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f854519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb00 0x7f85401957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:13.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f854519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb00 0x7f85401957c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34810/0 (socket says 172.21.15.17:34810) 2023-07-14T12:59:13.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f854519b700 1 -- 172.21.15.17:0/1010944943 learned_addr learned my addr 172.21.15.17:0/1010944943 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:13.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f854499a700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540100cf0 0x7f8540195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:13.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f854599c700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8540101680 0x7f854019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:13.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f854519b700 1 -- 172.21.15.17:0/1010944943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540100cf0 msgr2=0x7f8540195d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:13.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f854519b700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540100cf0 0x7f8540195d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f854519b700 1 -- 172.21.15.17:0/1010944943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8540101680 msgr2=0x7f854019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:13.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f854519b700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8540101680 0x7f854019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f854519b700 1 -- 172.21.15.17:0/1010944943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85300095f0 con 0x7f85400ffb00 2023-07-14T12:59:13.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.281+0000 7f854599c700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8540101680 0x7f854019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:59:13.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.282+0000 7f854519b700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb00 0x7f85401957c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f853c00d980 tx=0x7f853c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:13.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.282+0000 7f85367fc700 1 -- 172.21.15.17:0/1010944943 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c004020 con 0x7f85400ffb00 2023-07-14T12:59:13.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.282+0000 7f85473ff700 1 -- 172.21.15.17:0/1010944943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854019d8f0 con 0x7f85400ffb00 2023-07-14T12:59:13.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.282+0000 7f85367fc700 1 -- 172.21.15.17:0/1010944943 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853c009730 con 0x7f85400ffb00 2023-07-14T12:59:13.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.282+0000 7f85367fc700 1 -- 172.21.15.17:0/1010944943 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c0039c0 con 0x7f85400ffb00 2023-07-14T12:59:13.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.282+0000 7f85473ff700 1 -- 172.21.15.17:0/1010944943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854019de80 con 0x7f85400ffb00 2023-07-14T12:59:13.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.283+0000 7f85473ff700 1 -- 172.21.15.17:0/1010944943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85401070c0 con 0x7f85400ffb00 2023-07-14T12:59:13.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.285+0000 7f85367fc700 1 -- 172.21.15.17:0/1010944943 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f853c0098a0 con 0x7f85400ffb00 2023-07-14T12:59:13.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.287+0000 7f85367fc700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f852c0a11a0 0x7f852c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:13.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.288+0000 7f85367fc700 1 -- 172.21.15.17:0/1010944943 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f853c0cc5d0 con 0x7f85400ffb00 2023-07-14T12:59:13.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.288+0000 7f854499a700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f852c0a11a0 0x7f852c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:13.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.288+0000 7f854499a700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f852c0a11a0 0x7f852c0a3650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f853000c010 tx=0x7f8530005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:13.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.291+0000 7f85367fc700 1 -- 172.21.15.17:0/1010944943 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f853c095d30 con 0x7f85400ffb00 2023-07-14T12:59:13.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:13 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/587909337' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:13.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:13 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1737036002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:13.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:13 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/610659804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:13.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:13 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/587909337' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:13.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:13 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1737036002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:13.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:13 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/610659804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:13.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:13 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/587909337' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:13.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:13 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1737036002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:13.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:13 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/610659804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:13.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.545+0000 7f85473ff700 1 -- 172.21.15.17:0/1010944943 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f854019da80 con 0x7f85400ffb00 2023-07-14T12:59:13.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.545+0000 7f85367fc700 1 -- 172.21.15.17:0/1010944943 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10845 (secure 0 0 0) 0x7f854019da80 con 0x7f85400ffb00 2023-07-14T12:59:13.575 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:13.576 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T12:57:45.208579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:59:13.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 -- 172.21.15.17:0/1010944943 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f852c0a11a0 msgr2=0x7f852c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f852c0a11a0 0x7f852c0a3650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f853000c010 tx=0x7f8530005fb0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 -- 172.21.15.17:0/1010944943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb00 msgr2=0x7f85401957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb00 0x7f85401957c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f853c00d980 tx=0x7f853c00dc90 comp rx=0 tx=0).stop 2023-07-14T12:59:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 -- 172.21.15.17:0/1010944943 shutdown_connections 2023-07-14T12:59:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f852c0a11a0 0x7f852c0a3650 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8540101680 0x7f854019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb00 0x7f85401957c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 --2- 172.21.15.17:0/1010944943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540100cf0 0x7f8540195d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 -- 172.21.15.17:0/1010944943 >> 172.21.15.17:0/1010944943 conn(0x7f85400fb0e0 msgr2=0x7f8540104200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:13.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 -- 172.21.15.17:0/1010944943 shutdown_connections 2023-07-14T12:59:13.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.548+0000 7f85473ff700 1 -- 172.21.15.17:0/1010944943 wait complete. 2023-07-14T12:59:13.579 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2023-07-14T12:59:13.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:59:13.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.771+0000 7f6027bff700 1 -- 172.21.15.17:0/3218086574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6020100cf0 msgr2=0x7f6020101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:13.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.771+0000 7f6027bff700 1 --2- 172.21.15.17:0/3218086574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6020100cf0 0x7f6020101140 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6010009990 tx=0x7f6010009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.771+0000 7f6027bff700 1 -- 172.21.15.17:0/3218086574 shutdown_connections 2023-07-14T12:59:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.771+0000 7f6027bff700 1 --2- 172.21.15.17:0/3218086574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020101680 0x7f6020107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.771+0000 7f6027bff700 1 --2- 172.21.15.17:0/3218086574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60200ffb00 0x7f60200fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.771+0000 7f6027bff700 1 --2- 172.21.15.17:0/3218086574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6020100cf0 0x7f6020101140 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.771+0000 7f6027bff700 1 -- 172.21.15.17:0/3218086574 >> 172.21.15.17:0/3218086574 conn(0x7f60200fb0e0 msgr2=0x7f60200fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.771+0000 7f6027bff700 1 -- 172.21.15.17:0/3218086574 shutdown_connections 2023-07-14T12:59:13.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.771+0000 7f6027bff700 1 -- 172.21.15.17:0/3218086574 wait complete. 2023-07-14T12:59:13.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.772+0000 7f6027bff700 1 Processor -- start 2023-07-14T12:59:13.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.772+0000 7f6027bff700 1 -- start start 2023-07-14T12:59:13.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f6027bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60200ffb00 0x7f6020197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:13.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f6027bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6020100cf0 0x7f6020197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:13.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f6027bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020101680 0x7f602019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:13.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f6027bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602019f500 con 0x7f60200ffb00 2023-07-14T12:59:13.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f6027bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602019f640 con 0x7f6020101680 2023-07-14T12:59:13.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f6027bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602019f7d0 con 0x7f6020100cf0 2023-07-14T12:59:13.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f602599b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60200ffb00 0x7f6020197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:13.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f602599b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60200ffb00 0x7f6020197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34830/0 (socket says 172.21.15.17:34830) 2023-07-14T12:59:13.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f602599b700 1 -- 172.21.15.17:0/1237722284 learned_addr learned my addr 172.21.15.17:0/1237722284 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:13.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f602519a700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6020100cf0 0x7f6020197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:13.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f602619c700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020101680 0x7f602019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:13.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f602599b700 1 -- 172.21.15.17:0/1237722284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6020100cf0 msgr2=0x7f6020197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:13.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f602599b700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6020100cf0 0x7f6020197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f602599b700 1 -- 172.21.15.17:0/1237722284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020101680 msgr2=0x7f602019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:13.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f602599b700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020101680 0x7f602019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:13.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f602599b700 1 -- 172.21.15.17:0/1237722284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60100095f0 con 0x7f60200ffb00 2023-07-14T12:59:13.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.773+0000 7f602519a700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6020100cf0 0x7f6020197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:13.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.774+0000 7f602599b700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60200ffb00 0x7f6020197980 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f601c00d980 tx=0x7f601c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:13.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.774+0000 7f6016ffd700 1 -- 172.21.15.17:0/1237722284 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00de60 con 0x7f60200ffb00 2023-07-14T12:59:13.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.774+0000 7f6016ffd700 1 -- 172.21.15.17:0/1237722284 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f601c0044b0 con 0x7f60200ffb00 2023-07-14T12:59:13.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.774+0000 7f6027bff700 1 -- 172.21.15.17:0/1237722284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602019fab0 con 0x7f60200ffb00 2023-07-14T12:59:13.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.774+0000 7f6016ffd700 1 -- 172.21.15.17:0/1237722284 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c003b40 con 0x7f60200ffb00 2023-07-14T12:59:13.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.774+0000 7f6027bff700 1 -- 172.21.15.17:0/1237722284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60201a0010 con 0x7f60200ffb00 2023-07-14T12:59:13.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.775+0000 7f6027bff700 1 -- 172.21.15.17:0/1237722284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6020192090 con 0x7f60200ffb00 2023-07-14T12:59:13.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.777+0000 7f6016ffd700 1 -- 172.21.15.17:0/1237722284 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f601c003ca0 con 0x7f60200ffb00 2023-07-14T12:59:13.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.778+0000 7f6016ffd700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f600c0a1220 0x7f600c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:13.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.778+0000 7f6016ffd700 1 -- 172.21.15.17:0/1237722284 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f601c0cc5c0 con 0x7f60200ffb00 2023-07-14T12:59:13.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.779+0000 7f602519a700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f600c0a1220 0x7f600c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:13.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.779+0000 7f602519a700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f600c0a1220 0x7f600c0a36d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f601000b5c0 tx=0x7f6010005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:13.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.782+0000 7f6016ffd700 1 -- 172.21.15.17:0/1237722284 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f601c095ce0 con 0x7f60200ffb00 2023-07-14T12:59:14.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.995+0000 7f6027bff700 1 -- 172.21.15.17:0/1237722284 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f602002c850 con 0x7f60200ffb00 2023-07-14T12:59:14.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.996+0000 7f6016ffd700 1 -- 172.21.15.17:0/1237722284 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22469 (secure 0 0 0) 0x7f601c009940 con 0x7f60200ffb00 2023-07-14T12:59:14.026 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:14.026 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":88,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:58:07.945460+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:59:14.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 -- 172.21.15.17:0/1237722284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f600c0a1220 msgr2=0x7f600c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f600c0a1220 0x7f600c0a36d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f601000b5c0 tx=0x7f6010005fb0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 -- 172.21.15.17:0/1237722284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60200ffb00 msgr2=0x7f6020197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60200ffb00 0x7f6020197980 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f601c00d980 tx=0x7f601c00dd40 comp rx=0 tx=0).stop 2023-07-14T12:59:14.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 -- 172.21.15.17:0/1237722284 shutdown_connections 2023-07-14T12:59:14.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f600c0a1220 0x7f600c0a36d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020101680 0x7f602019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60200ffb00 0x7f6020197980 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 --2- 172.21.15.17:0/1237722284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6020100cf0 0x7f6020197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 -- 172.21.15.17:0/1237722284 >> 172.21.15.17:0/1237722284 conn(0x7f60200fb0e0 msgr2=0x7f60201065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:14.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 -- 172.21.15.17:0/1237722284 shutdown_connections 2023-07-14T12:59:14.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:13.999+0000 7f6027bff700 1 -- 172.21.15.17:0/1237722284 wait complete. 2023-07-14T12:59:14.048 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:57:37.876360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:57:39.117456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:59:14.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:59:14.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.225+0000 7f1c673ff700 1 -- 172.21.15.17:0/2297282490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c60101660 msgr2=0x7f1c60107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.225+0000 7f1c673ff700 1 --2- 172.21.15.17:0/2297282490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c60101660 0x7f1c60107f20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009990 tx=0x7f1c58009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.225+0000 7f1c673ff700 1 -- 172.21.15.17:0/2297282490 shutdown_connections 2023-07-14T12:59:14.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.225+0000 7f1c673ff700 1 --2- 172.21.15.17:0/2297282490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c60101660 0x7f1c60107f20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.225+0000 7f1c673ff700 1 --2- 172.21.15.17:0/2297282490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c600ffae0 0x7f1c600ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.225+0000 7f1c673ff700 1 --2- 172.21.15.17:0/2297282490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c60100cd0 0x7f1c60101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.225+0000 7f1c673ff700 1 -- 172.21.15.17:0/2297282490 >> 172.21.15.17:0/2297282490 conn(0x7f1c600fb0e0 msgr2=0x7f1c600fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:14.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.225+0000 7f1c673ff700 1 -- 172.21.15.17:0/2297282490 shutdown_connections 2023-07-14T12:59:14.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.225+0000 7f1c673ff700 1 -- 172.21.15.17:0/2297282490 wait complete. 2023-07-14T12:59:14.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.226+0000 7f1c673ff700 1 Processor -- start 2023-07-14T12:59:14.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.226+0000 7f1c673ff700 1 -- start start 2023-07-14T12:59:14.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.226+0000 7f1c673ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c600ffae0 0x7f1c600742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:14.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.226+0000 7f1c673ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c60100cd0 0x7f1c60072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:14.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c673ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c60101660 0x7f1c60072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:14.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c673ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600735e0 con 0x7f1c600ffae0 2023-07-14T12:59:14.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c673ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60073750 con 0x7f1c60100cd0 2023-07-14T12:59:14.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c673ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6019f7e0 con 0x7f1c60101660 2023-07-14T12:59:14.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c6519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c600ffae0 0x7f1c600742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:14.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c6519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c600ffae0 0x7f1c600742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34850/0 (socket says 172.21.15.17:34850) 2023-07-14T12:59:14.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c6519b700 1 -- 172.21.15.17:0/3164113093 learned_addr learned my addr 172.21.15.17:0/3164113093 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:14.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c6519b700 1 -- 172.21.15.17:0/3164113093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c60101660 msgr2=0x7f1c60072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c6519b700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c60101660 0x7f1c60072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c6519b700 1 -- 172.21.15.17:0/3164113093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c60100cd0 msgr2=0x7f1c60072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c6519b700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c60100cd0 0x7f1c60072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c6519b700 1 -- 172.21.15.17:0/3164113093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c580095f0 con 0x7f1c600ffae0 2023-07-14T12:59:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c6519b700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c600ffae0 0x7f1c600742c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00efc0 tx=0x7f1c5c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.227+0000 7f1c567fc700 1 -- 172.21.15.17:0/3164113093 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c018070 con 0x7f1c600ffae0 2023-07-14T12:59:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.228+0000 7f1c673ff700 1 -- 172.21.15.17:0/3164113093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6019fa60 con 0x7f1c600ffae0 2023-07-14T12:59:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.228+0000 7f1c567fc700 1 -- 172.21.15.17:0/3164113093 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c5c00f040 con 0x7f1c600ffae0 2023-07-14T12:59:14.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.228+0000 7f1c567fc700 1 -- 172.21.15.17:0/3164113093 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c004280 con 0x7f1c600ffae0 2023-07-14T12:59:14.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.228+0000 7f1c673ff700 1 -- 172.21.15.17:0/3164113093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6019ffc0 con 0x7f1c600ffae0 2023-07-14T12:59:14.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.229+0000 7f1c673ff700 1 -- 172.21.15.17:0/3164113093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c60107070 con 0x7f1c600ffae0 2023-07-14T12:59:14.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.231+0000 7f1c567fc700 1 -- 172.21.15.17:0/3164113093 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f1c5c00cad0 con 0x7f1c600ffae0 2023-07-14T12:59:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.232+0000 7f1c567fc700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c4c0a1150 0x7f1c4c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.232+0000 7f1c567fc700 1 -- 172.21.15.17:0/3164113093 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f1c5c0cc940 con 0x7f1c600ffae0 2023-07-14T12:59:14.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.232+0000 7f1c6499a700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c4c0a1150 0x7f1c4c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:14.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.233+0000 7f1c6499a700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c4c0a1150 0x7f1c4c0a3600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c50005fd0 tx=0x7f1c50005ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:14.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.236+0000 7f1c567fc700 1 -- 172.21.15.17:0/3164113093 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1c5c096150 con 0x7f1c600ffae0 2023-07-14T12:59:14.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:14 smithi017 ceph-mon[95536]: pgmap v351: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2023-07-14T12:59:14.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:14 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1010944943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:14.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:14 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1237722284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:14.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:14 smithi135 ceph-mon[97338]: pgmap v351: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2023-07-14T12:59:14.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:14 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1010944943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:14.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:14 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1237722284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:14.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.443+0000 7f1c673ff700 1 -- 172.21.15.17:0/3164113093 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c6002c850 con 0x7f1c600ffae0 2023-07-14T12:59:14.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.443+0000 7f1c567fc700 1 -- 172.21.15.17:0/3164113093 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c6002c850 con 0x7f1c600ffae0 2023-07-14T12:59:14.473 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T12:59:14.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 -- 172.21.15.17:0/3164113093 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c4c0a1150 msgr2=0x7f1c4c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c4c0a1150 0x7f1c4c0a3600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c50005fd0 tx=0x7f1c50005ee0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 -- 172.21.15.17:0/3164113093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c600ffae0 msgr2=0x7f1c600742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c600ffae0 0x7f1c600742c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00efc0 tx=0x7f1c5c00c3a0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 -- 172.21.15.17:0/3164113093 shutdown_connections 2023-07-14T12:59:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c4c0a1150 0x7f1c4c0a3600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c60101660 0x7f1c60072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c600ffae0 0x7f1c600742c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 --2- 172.21.15.17:0/3164113093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c60100cd0 0x7f1c60072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 -- 172.21.15.17:0/3164113093 >> 172.21.15.17:0/3164113093 conn(0x7f1c600fb0e0 msgr2=0x7f1c601041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:14.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 -- 172.21.15.17:0/3164113093 shutdown_connections 2023-07-14T12:59:14.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.446+0000 7f1c673ff700 1 -- 172.21.15.17:0/3164113093 wait complete. 2023-07-14T12:59:14.494 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:59:14.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:14 smithi131 ceph-mon[96953]: pgmap v351: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2023-07-14T12:59:14.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:14 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1010944943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:14.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:14 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1237722284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:14.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.670+0000 7feaf97ff700 1 -- 172.21.15.17:0/3415287479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf40ffae0 msgr2=0x7feaf40ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.670+0000 7feaf97ff700 1 --2- 172.21.15.17:0/3415287479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf40ffae0 0x7feaf40ffef0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feae4009990 tx=0x7feae4009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.671+0000 7feaf97ff700 1 -- 172.21.15.17:0/3415287479 shutdown_connections 2023-07-14T12:59:14.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.671+0000 7feaf97ff700 1 --2- 172.21.15.17:0/3415287479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101660 0x7feaf4107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.671+0000 7feaf97ff700 1 --2- 172.21.15.17:0/3415287479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf40ffae0 0x7feaf40ffef0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.671+0000 7feaf97ff700 1 --2- 172.21.15.17:0/3415287479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf4100cd0 0x7feaf4101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.671+0000 7feaf97ff700 1 -- 172.21.15.17:0/3415287479 >> 172.21.15.17:0/3415287479 conn(0x7feaf40fb0e0 msgr2=0x7feaf40fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:14.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.671+0000 7feaf97ff700 1 -- 172.21.15.17:0/3415287479 shutdown_connections 2023-07-14T12:59:14.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.671+0000 7feaf97ff700 1 -- 172.21.15.17:0/3415287479 wait complete. 2023-07-14T12:59:14.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf97ff700 1 Processor -- start 2023-07-14T12:59:14.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf97ff700 1 -- start start 2023-07-14T12:59:14.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf97ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf40ffae0 0x7feaf41956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:14.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf97ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf4100cd0 0x7feaf4195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:14.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf97ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101660 0x7feaf419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:14.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf97ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf419d240 con 0x7feaf4100cd0 2023-07-14T12:59:14.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf97ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf419d380 con 0x7feaf40ffae0 2023-07-14T12:59:14.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf97ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf419d510 con 0x7feaf4101660 2023-07-14T12:59:14.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf4100cd0 0x7feaf4195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:14.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf4100cd0 0x7feaf4195c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34862/0 (socket says 172.21.15.17:34862) 2023-07-14T12:59:14.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf27fc700 1 -- 172.21.15.17:0/1961973714 learned_addr learned my addr 172.21.15.17:0/1961973714 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:14.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf2ffd700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf40ffae0 0x7feaf41956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:14.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.672+0000 7feaf37fe700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101660 0x7feaf419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:14.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.673+0000 7feaf27fc700 1 -- 172.21.15.17:0/1961973714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101660 msgr2=0x7feaf419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.673+0000 7feaf27fc700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101660 0x7feaf419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.673+0000 7feaf27fc700 1 -- 172.21.15.17:0/1961973714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf40ffae0 msgr2=0x7feaf41956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.673+0000 7feaf27fc700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf40ffae0 0x7feaf41956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.673+0000 7feaf27fc700 1 -- 172.21.15.17:0/1961973714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40095f0 con 0x7feaf4100cd0 2023-07-14T12:59:14.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.673+0000 7feaf27fc700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf4100cd0 0x7feaf4195c00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feae800c9b0 tx=0x7feae800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:14.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.673+0000 7feadbfff700 1 -- 172.21.15.17:0/1961973714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8007b00 con 0x7feaf4100cd0 2023-07-14T12:59:14.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.673+0000 7feaf97ff700 1 -- 172.21.15.17:0/1961973714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf419d7f0 con 0x7feaf4100cd0 2023-07-14T12:59:14.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.673+0000 7feadbfff700 1 -- 172.21.15.17:0/1961973714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feae800ce50 con 0x7feaf4100cd0 2023-07-14T12:59:14.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.673+0000 7feadbfff700 1 -- 172.21.15.17:0/1961973714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8018400 con 0x7feaf4100cd0 2023-07-14T12:59:14.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.674+0000 7feaf97ff700 1 -- 172.21.15.17:0/1961973714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf419dd00 con 0x7feaf4100cd0 2023-07-14T12:59:14.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.675+0000 7feaf97ff700 1 -- 172.21.15.17:0/1961973714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf41069c0 con 0x7feaf4100cd0 2023-07-14T12:59:14.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.676+0000 7feadbfff700 1 -- 172.21.15.17:0/1961973714 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7feae800f450 con 0x7feaf4100cd0 2023-07-14T12:59:14.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.678+0000 7feadbfff700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feadc0a1150 0x7feadc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:14.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.678+0000 7feadbfff700 1 -- 172.21.15.17:0/1961973714 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7feae80cc870 con 0x7feaf4100cd0 2023-07-14T12:59:14.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.678+0000 7feaf2ffd700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feadc0a1150 0x7feadc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:14.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.679+0000 7feaf2ffd700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feadc0a1150 0x7feadc0a3600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feae400c010 tx=0x7feae4005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:14.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.682+0000 7feadbfff700 1 -- 172.21.15.17:0/1961973714 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7feae8095f90 con 0x7feaf4100cd0 2023-07-14T12:59:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.892+0000 7feaf97ff700 1 -- 172.21.15.17:0/1961973714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feaf4061120 con 0x7feaf4100cd0 2023-07-14T12:59:14.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.893+0000 7feadbfff700 1 -- 172.21.15.17:0/1961973714 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7feae800f700 con 0x7feaf4100cd0 2023-07-14T12:59:14.923 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-07-14T12:59:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 -- 172.21.15.17:0/1961973714 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feadc0a1150 msgr2=0x7feadc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feadc0a1150 0x7feadc0a3600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feae400c010 tx=0x7feae4005fd0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 -- 172.21.15.17:0/1961973714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf4100cd0 msgr2=0x7feaf4195c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf4100cd0 0x7feaf4195c00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feae800c9b0 tx=0x7feae800ccc0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 -- 172.21.15.17:0/1961973714 shutdown_connections 2023-07-14T12:59:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7feadc0a1150 0x7feadc0a3600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf4101660 0x7feaf419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf40ffae0 0x7feaf41956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 --2- 172.21.15.17:0/1961973714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf4100cd0 0x7feaf4195c00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 -- 172.21.15.17:0/1961973714 >> 172.21.15.17:0/1961973714 conn(0x7feaf40fb0e0 msgr2=0x7feaf40fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 -- 172.21.15.17:0/1961973714 shutdown_connections 2023-07-14T12:59:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:14.895+0000 7feaf97ff700 1 -- 172.21.15.17:0/1961973714 wait complete. 2023-07-14T12:59:14.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:59:15.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.119+0000 7fc9d13ff700 1 -- 172.21.15.17:0/1042974475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc101670 msgr2=0x7fc9cc107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:15.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.119+0000 7fc9d13ff700 1 --2- 172.21.15.17:0/1042974475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc101670 0x7fc9cc107f30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400b0a0 tx=0x7fc9c400b3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.119+0000 7fc9d13ff700 1 -- 172.21.15.17:0/1042974475 shutdown_connections 2023-07-14T12:59:15.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.119+0000 7fc9d13ff700 1 --2- 172.21.15.17:0/1042974475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc101670 0x7fc9cc107f30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.119+0000 7fc9d13ff700 1 --2- 172.21.15.17:0/1042974475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9cc0ffaf0 0x7fc9cc0fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.119+0000 7fc9d13ff700 1 --2- 172.21.15.17:0/1042974475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9cc100ce0 0x7fc9cc101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.119+0000 7fc9d13ff700 1 -- 172.21.15.17:0/1042974475 >> 172.21.15.17:0/1042974475 conn(0x7fc9cc0fb130 msgr2=0x7fc9cc0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:15.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.119+0000 7fc9d13ff700 1 -- 172.21.15.17:0/1042974475 shutdown_connections 2023-07-14T12:59:15.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.119+0000 7fc9d13ff700 1 -- 172.21.15.17:0/1042974475 wait complete. 2023-07-14T12:59:15.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.120+0000 7fc9d13ff700 1 Processor -- start 2023-07-14T12:59:15.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.120+0000 7fc9d13ff700 1 -- start start 2023-07-14T12:59:15.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.120+0000 7fc9d13ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9cc0ffaf0 0x7fc9cc0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:15.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9d13ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc100ce0 0x7fc9cc072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:15.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9d13ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9cc101670 0x7fc9cc072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:15.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9d13ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc0735e0 con 0x7fc9cc100ce0 2023-07-14T12:59:15.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9d13ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc073750 con 0x7fc9cc101670 2023-07-14T12:59:15.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9d13ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc19f910 con 0x7fc9cc0ffaf0 2023-07-14T12:59:15.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9c3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc100ce0 0x7fc9cc072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:15.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9c3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc100ce0 0x7fc9cc072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35512/0 (socket says 172.21.15.17:35512) 2023-07-14T12:59:15.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9c3fff700 1 -- 172.21.15.17:0/908649141 learned_addr learned my addr 172.21.15.17:0/908649141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:15.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9caffd700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9cc0ffaf0 0x7fc9cc0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:15.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9c3fff700 1 -- 172.21.15.17:0/908649141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9cc0ffaf0 msgr2=0x7fc9cc0742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:15.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9c3fff700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9cc0ffaf0 0x7fc9cc0742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9c3fff700 1 -- 172.21.15.17:0/908649141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9cc101670 msgr2=0x7fc9cc072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:15.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9cb7fe700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9cc101670 0x7fc9cc072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:15.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9c3fff700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9cc101670 0x7fc9cc072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9c3fff700 1 -- 172.21.15.17:0/908649141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c4009d00 con 0x7fc9cc100ce0 2023-07-14T12:59:15.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9cb7fe700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9cc101670 0x7fc9cc072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:59:15.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.121+0000 7fc9c3fff700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc100ce0 0x7fc9cc072900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400e9a0 tx=0x7fc9b400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:15.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.122+0000 7fc9c8ff9700 1 -- 172.21.15.17:0/908649141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4009790 con 0x7fc9cc100ce0 2023-07-14T12:59:15.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.122+0000 7fc9c8ff9700 1 -- 172.21.15.17:0/908649141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9b400cbd0 con 0x7fc9cc100ce0 2023-07-14T12:59:15.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.122+0000 7fc9d13ff700 1 -- 172.21.15.17:0/908649141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc19fbf0 con 0x7fc9cc100ce0 2023-07-14T12:59:15.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.122+0000 7fc9c8ff9700 1 -- 172.21.15.17:0/908649141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4018680 con 0x7fc9cc100ce0 2023-07-14T12:59:15.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.122+0000 7fc9d13ff700 1 -- 172.21.15.17:0/908649141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc1a0150 con 0x7fc9cc100ce0 2023-07-14T12:59:15.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.123+0000 7fc9d13ff700 1 -- 172.21.15.17:0/908649141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc10b1d0 con 0x7fc9cc100ce0 2023-07-14T12:59:15.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.125+0000 7fc9c8ff9700 1 -- 172.21.15.17:0/908649141 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fc9b400cd40 con 0x7fc9cc100ce0 2023-07-14T12:59:15.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.126+0000 7fc9c8ff9700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc9b80a11d0 0x7fc9b80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:15.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.126+0000 7fc9c8ff9700 1 -- 172.21.15.17:0/908649141 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fc9b4014070 con 0x7fc9cc100ce0 2023-07-14T12:59:15.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.126+0000 7fc9caffd700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc9b80a11d0 0x7fc9b80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:15.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.127+0000 7fc9caffd700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc9b80a11d0 0x7fc9b80a3680 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc100b40 tx=0x7fc9bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:15.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.128+0000 7fc9c8ff9700 1 -- 172.21.15.17:0/908649141 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fc9b40965c0 con 0x7fc9cc100ce0 2023-07-14T12:59:15.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:15 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3164113093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:15.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:15 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1961973714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:15.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.341+0000 7fc9d13ff700 1 -- 172.21.15.17:0/908649141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9cc106a20 con 0x7fc9cc100ce0 2023-07-14T12:59:15.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.341+0000 7fc9c8ff9700 1 -- 172.21.15.17:0/908649141 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9b4026020 con 0x7fc9cc100ce0 2023-07-14T12:59:15.372 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-07-14T12:59:15.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 -- 172.21.15.17:0/908649141 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc9b80a11d0 msgr2=0x7fc9b80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:15.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc9b80a11d0 0x7fc9b80a3680 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc100b40 tx=0x7fc9bc00b410 comp rx=0 tx=0).stop 2023-07-14T12:59:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 -- 172.21.15.17:0/908649141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc100ce0 msgr2=0x7fc9cc072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc100ce0 0x7fc9cc072900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400e9a0 tx=0x7fc9b400ecb0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 -- 172.21.15.17:0/908649141 shutdown_connections 2023-07-14T12:59:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fc9b80a11d0 0x7fc9b80a3680 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9cc101670 0x7fc9cc072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9cc0ffaf0 0x7fc9cc0742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 --2- 172.21.15.17:0/908649141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc100ce0 0x7fc9cc072900 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 -- 172.21.15.17:0/908649141 >> 172.21.15.17:0/908649141 conn(0x7fc9cc0fb130 msgr2=0x7fc9cc0fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:15.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 -- 172.21.15.17:0/908649141 shutdown_connections 2023-07-14T12:59:15.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.344+0000 7fc9d13ff700 1 -- 172.21.15.17:0/908649141 wait complete. 2023-07-14T12:59:15.393 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:59:15.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:15 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3164113093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:15.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:15 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1961973714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:15.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:15 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3164113093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:15.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:15 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1961973714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.566+0000 7f11365ff700 1 -- 172.21.15.17:0/1962741375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1130100cf0 msgr2=0x7f1130101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.566+0000 7f11365ff700 1 --2- 172.21.15.17:0/1962741375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1130100cf0 0x7f1130101140 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1124009990 tx=0x7f1124009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.567+0000 7f11365ff700 1 -- 172.21.15.17:0/1962741375 shutdown_connections 2023-07-14T12:59:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.567+0000 7f11365ff700 1 --2- 172.21.15.17:0/1962741375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1130101680 0x7f1130107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.567+0000 7f11365ff700 1 --2- 172.21.15.17:0/1962741375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11300ffb00 0x7f11300fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.567+0000 7f11365ff700 1 --2- 172.21.15.17:0/1962741375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1130100cf0 0x7f1130101140 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.567+0000 7f11365ff700 1 -- 172.21.15.17:0/1962741375 >> 172.21.15.17:0/1962741375 conn(0x7f11300fb0e0 msgr2=0x7f11300fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.567+0000 7f11365ff700 1 -- 172.21.15.17:0/1962741375 shutdown_connections 2023-07-14T12:59:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.567+0000 7f11365ff700 1 -- 172.21.15.17:0/1962741375 wait complete. 2023-07-14T12:59:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.568+0000 7f11365ff700 1 Processor -- start 2023-07-14T12:59:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.568+0000 7f11365ff700 1 -- start start 2023-07-14T12:59:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.568+0000 7f11365ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11300ffb00 0x7f1130197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.568+0000 7f11365ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1130100cf0 0x7f1130197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.568+0000 7f11365ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1130101680 0x7f113019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.568+0000 7f11365ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113019f590 con 0x7f1130100cf0 2023-07-14T12:59:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.568+0000 7f11365ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113019f6d0 con 0x7f1130101680 2023-07-14T12:59:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.568+0000 7f11365ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113019f860 con 0x7f11300ffb00 2023-07-14T12:59:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.569+0000 7f112f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1130100cf0 0x7f1130197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.569+0000 7f112f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1130100cf0 0x7f1130197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35524/0 (socket says 172.21.15.17:35524) 2023-07-14T12:59:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.569+0000 7f112f7fe700 1 -- 172.21.15.17:0/1521100695 learned_addr learned my addr 172.21.15.17:0/1521100695 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.569+0000 7f112ffff700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11300ffb00 0x7f1130197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:15.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.569+0000 7f1134b9c700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1130101680 0x7f113019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:15.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.569+0000 7f112f7fe700 1 -- 172.21.15.17:0/1521100695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11300ffb00 msgr2=0x7f1130197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:15.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.569+0000 7f112f7fe700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11300ffb00 0x7f1130197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.569+0000 7f112f7fe700 1 -- 172.21.15.17:0/1521100695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1130101680 msgr2=0x7f113019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:15.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.569+0000 7f112f7fe700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1130101680 0x7f113019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.569+0000 7f112f7fe700 1 -- 172.21.15.17:0/1521100695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11240095f0 con 0x7f1130100cf0 2023-07-14T12:59:15.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.569+0000 7f112f7fe700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1130100cf0 0x7f1130197f50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f11240098e0 tx=0x7f1124004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:15.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.570+0000 7f112d7fa700 1 -- 172.21.15.17:0/1521100695 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112401d070 con 0x7f1130100cf0 2023-07-14T12:59:15.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.570+0000 7f112d7fa700 1 -- 172.21.15.17:0/1521100695 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f112400bd50 con 0x7f1130100cf0 2023-07-14T12:59:15.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.570+0000 7f112d7fa700 1 -- 172.21.15.17:0/1521100695 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124022d20 con 0x7f1130100cf0 2023-07-14T12:59:15.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.570+0000 7f11365ff700 1 -- 172.21.15.17:0/1521100695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113019fae0 con 0x7f1130100cf0 2023-07-14T12:59:15.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.570+0000 7f11365ff700 1 -- 172.21.15.17:0/1521100695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113019feb0 con 0x7f1130100cf0 2023-07-14T12:59:15.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.571+0000 7f11365ff700 1 -- 172.21.15.17:0/1521100695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1130192090 con 0x7f1130100cf0 2023-07-14T12:59:15.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.573+0000 7f112d7fa700 1 -- 172.21.15.17:0/1521100695 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f112400b8c0 con 0x7f1130100cf0 2023-07-14T12:59:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.575+0000 7f112d7fa700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f11180a1220 0x7f11180a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.575+0000 7f112d7fa700 1 -- 172.21.15.17:0/1521100695 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f11240cdee0 con 0x7f1130100cf0 2023-07-14T12:59:15.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.575+0000 7f112ffff700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f11180a1220 0x7f11180a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:15.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.576+0000 7f112ffff700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f11180a1220 0x7f11180a36d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1130100b50 tx=0x7f1120009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:15.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.579+0000 7f112d7fa700 1 -- 172.21.15.17:0/1521100695 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1124097690 con 0x7f1130100cf0 2023-07-14T12:59:15.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.836+0000 7f11365ff700 1 -- 172.21.15.17:0/1521100695 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f113002c850 con 0x7f1130100cf0 2023-07-14T12:59:15.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.837+0000 7f112d7fa700 1 -- 172.21.15.17:0/1521100695 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10845 (secure 0 0 0) 0x7f112409acb0 con 0x7f1130100cf0 2023-07-14T12:59:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:15.868 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T12:57:45.208579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:59:15.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 -- 172.21.15.17:0/1521100695 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f11180a1220 msgr2=0x7f11180a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f11180a1220 0x7f11180a36d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1130100b50 tx=0x7f1120009260 comp rx=0 tx=0).stop 2023-07-14T12:59:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 -- 172.21.15.17:0/1521100695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1130100cf0 msgr2=0x7f1130197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1130100cf0 0x7f1130197f50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f11240098e0 tx=0x7f1124004730 comp rx=0 tx=0).stop 2023-07-14T12:59:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 -- 172.21.15.17:0/1521100695 shutdown_connections 2023-07-14T12:59:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f11180a1220 0x7f11180a36d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1130101680 0x7f113019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11300ffb00 0x7f1130197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 --2- 172.21.15.17:0/1521100695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1130100cf0 0x7f1130197f50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:15.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 -- 172.21.15.17:0/1521100695 >> 172.21.15.17:0/1521100695 conn(0x7f11300fb0e0 msgr2=0x7f1130106670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:15.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 -- 172.21.15.17:0/1521100695 shutdown_connections 2023-07-14T12:59:15.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:15.840+0000 7f11365ff700 1 -- 172.21.15.17:0/1521100695 wait complete. 2023-07-14T12:59:15.872 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2023-07-14T12:59:15.888 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:59:16.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.062+0000 7fcee71ff700 1 -- 172.21.15.17:0/783974321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0100cf0 msgr2=0x7fcee0101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.062+0000 7fcee71ff700 1 --2- 172.21.15.17:0/783974321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0100cf0 0x7fcee0101140 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009990 tx=0x7fcecc009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.062+0000 7fcee71ff700 1 -- 172.21.15.17:0/783974321 shutdown_connections 2023-07-14T12:59:16.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.062+0000 7fcee71ff700 1 --2- 172.21.15.17:0/783974321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcee0101680 0x7fcee0107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.062+0000 7fcee71ff700 1 --2- 172.21.15.17:0/783974321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcee00ffb00 0x7fcee00fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.062+0000 7fcee71ff700 1 --2- 172.21.15.17:0/783974321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0100cf0 0x7fcee0101140 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.062+0000 7fcee71ff700 1 -- 172.21.15.17:0/783974321 >> 172.21.15.17:0/783974321 conn(0x7fcee00fb0e0 msgr2=0x7fcee00fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.063+0000 7fcee71ff700 1 -- 172.21.15.17:0/783974321 shutdown_connections 2023-07-14T12:59:16.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.063+0000 7fcee71ff700 1 -- 172.21.15.17:0/783974321 wait complete. 2023-07-14T12:59:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.064+0000 7fcee71ff700 1 Processor -- start 2023-07-14T12:59:16.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.064+0000 7fcee71ff700 1 -- start start 2023-07-14T12:59:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.064+0000 7fcee71ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcee00ffb00 0x7fcee0197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.064+0000 7fcee71ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcee0100cf0 0x7fcee0197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.064+0000 7fcee71ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0101680 0x7fcee019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.064+0000 7fcee71ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee019f4b0 con 0x7fcee0100cf0 2023-07-14T12:59:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.064+0000 7fcee71ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee019f5f0 con 0x7fcee00ffb00 2023-07-14T12:59:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.064+0000 7fcee71ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee019f780 con 0x7fcee0101680 2023-07-14T12:59:16.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcedffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcee0100cf0 0x7fcee0197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcedffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcee0100cf0 0x7fcee0197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35550/0 (socket says 172.21.15.17:35550) 2023-07-14T12:59:16.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcedffff700 1 -- 172.21.15.17:0/1837782542 learned_addr learned my addr 172.21.15.17:0/1837782542 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:16.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcee579c700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0101680 0x7fcee019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcee4f9b700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcee00ffb00 0x7fcee0197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcedffff700 1 -- 172.21.15.17:0/1837782542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0101680 msgr2=0x7fcee019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcedffff700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0101680 0x7fcee019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcedffff700 1 -- 172.21.15.17:0/1837782542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcee00ffb00 msgr2=0x7fcee0197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcedffff700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcee00ffb00 0x7fcee0197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcedffff700 1 -- 172.21.15.17:0/1837782542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0095f0 con 0x7fcee0100cf0 2023-07-14T12:59:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcedffff700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcee0100cf0 0x7fcee0197e70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0098e0 tx=0x7fcecc009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fceddffb700 1 -- 172.21.15.17:0/1837782542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc01d070 con 0x7fcee0100cf0 2023-07-14T12:59:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fcee71ff700 1 -- 172.21.15.17:0/1837782542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee019fa00 con 0x7fcee0100cf0 2023-07-14T12:59:16.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fceddffb700 1 -- 172.21.15.17:0/1837782542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcecc022470 con 0x7fcee0100cf0 2023-07-14T12:59:16.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.065+0000 7fceddffb700 1 -- 172.21.15.17:0/1837782542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00f6c0 con 0x7fcee0100cf0 2023-07-14T12:59:16.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.066+0000 7fcee71ff700 1 -- 172.21.15.17:0/1837782542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee019fe80 con 0x7fcee0100cf0 2023-07-14T12:59:16.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.067+0000 7fcee71ff700 1 -- 172.21.15.17:0/1837782542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee010b170 con 0x7fcee0100cf0 2023-07-14T12:59:16.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.069+0000 7fceddffb700 1 -- 172.21.15.17:0/1837782542 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fcecc00baa0 con 0x7fcee0100cf0 2023-07-14T12:59:16.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.070+0000 7fceddffb700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fced00a11a0 0x7fced00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.070+0000 7fceddffb700 1 -- 172.21.15.17:0/1837782542 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fcecc0cddb0 con 0x7fcee0100cf0 2023-07-14T12:59:16.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.070+0000 7fcee4f9b700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fced00a11a0 0x7fced00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.071+0000 7fcee4f9b700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fced00a11a0 0x7fced00a3650 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcee0100b50 tx=0x7fced4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.074+0000 7fceddffb700 1 -- 172.21.15.17:0/1837782542 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcecc0975c0 con 0x7fcee0100cf0 2023-07-14T12:59:16.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.288+0000 7fcee71ff700 1 -- 172.21.15.17:0/1837782542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcee01a0490 con 0x7fcee0100cf0 2023-07-14T12:59:16.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.289+0000 7fceddffb700 1 -- 172.21.15.17:0/1837782542 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22469 (secure 0 0 0) 0x7fcecc09abe0 con 0x7fcee0100cf0 2023-07-14T12:59:16.320 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:16.320 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":88,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:58:07.945460+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:59:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 -- 172.21.15.17:0/1837782542 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fced00a11a0 msgr2=0x7fced00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fced00a11a0 0x7fced00a3650 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcee0100b50 tx=0x7fced4009260 comp rx=0 tx=0).stop 2023-07-14T12:59:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 -- 172.21.15.17:0/1837782542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcee0100cf0 msgr2=0x7fcee0197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcee0100cf0 0x7fcee0197e70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0098e0 tx=0x7fcecc009570 comp rx=0 tx=0).stop 2023-07-14T12:59:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 -- 172.21.15.17:0/1837782542 shutdown_connections 2023-07-14T12:59:16.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fced00a11a0 0x7fced00a3650 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcee0101680 0x7fcee019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcee00ffb00 0x7fcee0197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 --2- 172.21.15.17:0/1837782542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcee0100cf0 0x7fcee0197e70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 -- 172.21.15.17:0/1837782542 >> 172.21.15.17:0/1837782542 conn(0x7fcee00fb0e0 msgr2=0x7fcee00fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 -- 172.21.15.17:0/1837782542 shutdown_connections 2023-07-14T12:59:16.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.292+0000 7fcee71ff700 1 -- 172.21.15.17:0/1837782542 wait complete. 2023-07-14T12:59:16.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-07-14T12:57:39.671161+0000', 'modified': '2023-07-14T12:57:45.208579+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24593, 'mds_1': 24548, 'mds_2': 24547}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24508': {'gid': 24508, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/1201140251', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 1201140251}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 1201140251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24515': {'gid': 24515, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.131:6835/1432780018', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6834', 'nonce': 1432780018}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 1432780018}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24526': {'gid': 24526, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6837/4030549564', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 4030549564}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 4030549564}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24547': {'gid': 24547, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.135:6839/2221555127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 2221555127}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 2221555127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24548': {'gid': 24548, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.131:6837/3087773753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6836', 'nonce': 3087773753}, {'type': 'v1', 'addr': '172.21.15.131:6837', 'nonce': 3087773753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24593': {'gid': 24593, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.131:6839/2296586377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6838', 'nonce': 2296586377}, {'type': 'v1', 'addr': '172.21.15.131:6839', 'nonce': 2296586377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T12:59:16.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-07-14T12:59:16.342 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-07-14T12:59:16.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:16 smithi135 ceph-mon[97338]: pgmap v352: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 7 op/s 2023-07-14T12:59:16.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:16 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/908649141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:16.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:16 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1521100695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:16.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:16 smithi131 ceph-mon[96953]: pgmap v352: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 7 op/s 2023-07-14T12:59:16.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:16 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/908649141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:16.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:16 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1521100695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:16.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.515+0000 7faf673ff700 1 -- 172.21.15.17:0/336837998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf60100cd0 msgr2=0x7faf60101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.515+0000 7faf673ff700 1 --2- 172.21.15.17:0/336837998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf60100cd0 0x7faf60101120 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faf50009990 tx=0x7faf50009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.515+0000 7faf673ff700 1 -- 172.21.15.17:0/336837998 shutdown_connections 2023-07-14T12:59:16.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.515+0000 7faf673ff700 1 --2- 172.21.15.17:0/336837998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf60101660 0x7faf60107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.515+0000 7faf673ff700 1 --2- 172.21.15.17:0/336837998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf600ffae0 0x7faf600ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.515+0000 7faf673ff700 1 --2- 172.21.15.17:0/336837998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf60100cd0 0x7faf60101120 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.515+0000 7faf673ff700 1 -- 172.21.15.17:0/336837998 >> 172.21.15.17:0/336837998 conn(0x7faf600fb0e0 msgr2=0x7faf600fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.515+0000 7faf673ff700 1 -- 172.21.15.17:0/336837998 shutdown_connections 2023-07-14T12:59:16.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.515+0000 7faf673ff700 1 -- 172.21.15.17:0/336837998 wait complete. 2023-07-14T12:59:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.516+0000 7faf673ff700 1 Processor -- start 2023-07-14T12:59:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.516+0000 7faf673ff700 1 -- start start 2023-07-14T12:59:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.516+0000 7faf673ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf600ffae0 0x7faf600742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.516+0000 7faf673ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf60100cd0 0x7faf60072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.516+0000 7faf673ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf60101660 0x7faf60072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.516+0000 7faf673ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf600735e0 con 0x7faf600ffae0 2023-07-14T12:59:16.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.516+0000 7faf673ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60073750 con 0x7faf60101660 2023-07-14T12:59:16.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.516+0000 7faf673ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6019f800 con 0x7faf60100cd0 2023-07-14T12:59:16.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf600ffae0 0x7faf600742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf600ffae0 0x7faf600742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35572/0 (socket says 172.21.15.17:35572) 2023-07-14T12:59:16.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6519b700 1 -- 172.21.15.17:0/3066274754 learned_addr learned my addr 172.21.15.17:0/3066274754 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:16.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6599c700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf60101660 0x7faf60072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6499a700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf60100cd0 0x7faf60072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6519b700 1 -- 172.21.15.17:0/3066274754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf60100cd0 msgr2=0x7faf60072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6519b700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf60100cd0 0x7faf60072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6519b700 1 -- 172.21.15.17:0/3066274754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf60101660 msgr2=0x7faf60072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6519b700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf60101660 0x7faf60072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6519b700 1 -- 172.21.15.17:0/3066274754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf500095f0 con 0x7faf600ffae0 2023-07-14T12:59:16.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6599c700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf60101660 0x7faf60072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:16.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6499a700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf60100cd0 0x7faf60072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:16.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf6519b700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf600ffae0 0x7faf600742c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00e970 tx=0x7faf5c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf567fc700 1 -- 172.21.15.17:0/3066274754 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c009790 con 0x7faf600ffae0 2023-07-14T12:59:16.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf567fc700 1 -- 172.21.15.17:0/3066274754 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf5c0044b0 con 0x7faf600ffae0 2023-07-14T12:59:16.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.517+0000 7faf567fc700 1 -- 172.21.15.17:0/3066274754 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c003dd0 con 0x7faf600ffae0 2023-07-14T12:59:16.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.518+0000 7faf673ff700 1 -- 172.21.15.17:0/3066274754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6019fae0 con 0x7faf600ffae0 2023-07-14T12:59:16.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.518+0000 7faf673ff700 1 -- 172.21.15.17:0/3066274754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6019ffa0 con 0x7faf600ffae0 2023-07-14T12:59:16.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.521+0000 7faf567fc700 1 -- 172.21.15.17:0/3066274754 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7faf5c003f30 con 0x7faf600ffae0 2023-07-14T12:59:16.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.522+0000 7faf7ad22b80 1 Processor -- start 2023-07-14T12:59:16.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.522+0000 7faf7ad22b80 1 -- start start 2023-07-14T12:59:16.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.522+0000 7faf567fc700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faf4c0a11d0 0x7faf4c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf567fc700 1 -- 172.21.15.17:0/3066274754 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7faf5c014070 con 0x7faf600ffae0 2023-07-14T12:59:16.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf6599c700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faf4c0a11d0 0x7faf4c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415480 0x55d932415890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415dd0 0x55d932416690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932416c20 0x55d932417090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93231ac60 con 0x55d932415dd0 2023-07-14T12:59:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93236d9f0 con 0x55d932416c20 2023-07-14T12:59:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d932366e80 con 0x55d932415480 2023-07-14T12:59:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf6499a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415dd0 0x55d932416690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf6499a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415dd0 0x55d932416690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35582/0 (socket says 172.21.15.17:35582) 2023-07-14T12:59:16.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf6499a700 1 -- 172.21.15.17:0/547602590 learned_addr learned my addr 172.21.15.17:0/547602590 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:16.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf6519b700 1 --2- 172.21.15.17:0/547602590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415480 0x55d932415890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.523+0000 7faf6599c700 1 --2- 172.21.15.17:0/547602590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932416c20 0x55d932417090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.524+0000 7faf6499a700 1 -- 172.21.15.17:0/547602590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415480 msgr2=0x55d932415890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.524+0000 7faf6499a700 1 --2- 172.21.15.17:0/547602590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415480 0x55d932415890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.524+0000 7faf6499a700 1 -- 172.21.15.17:0/547602590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932416c20 msgr2=0x55d932417090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.524+0000 7faf6499a700 1 --2- 172.21.15.17:0/547602590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932416c20 0x55d932417090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.524+0000 7faf6499a700 1 -- 172.21.15.17:0/547602590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d932194d90 con 0x55d932415dd0 2023-07-14T12:59:16.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.524+0000 7faf6599c700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faf4c0a11d0 0x7faf4c0a3680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf60074920 tx=0x7faf58009f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.524+0000 7faf6499a700 1 --2- 172.21.15.17:0/547602590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415dd0 0x55d932416690 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faf50006010 tx=0x7faf50005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116105b72bf89f60 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.524+0000 7faf4b7fe700 1 -- 172.21.15.17:0/547602590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf500047e0 con 0x55d932415dd0 2023-07-14T12:59:16.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.524+0000 7faf4b7fe700 1 -- 172.21.15.17:0/547602590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf5001e040 con 0x55d932415dd0 2023-07-14T12:59:16.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.524+0000 7faf4b7fe700 1 -- 172.21.15.17:0/547602590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50003680 con 0x55d932415dd0 2023-07-14T12:59:16.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.525+0000 7faf7ad22b80 1 -- 172.21.15.17:0/547602590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415dd0 msgr2=0x55d932416690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.525+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/547602590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415dd0 0x55d932416690 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faf50006010 tx=0x7faf50005c80 comp rx=0 tx=0).stop 2023-07-14T12:59:16.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.525+0000 7faf7ad22b80 1 -- 172.21.15.17:0/547602590 shutdown_connections 2023-07-14T12:59:16.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.525+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/547602590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932416c20 0x55d932417090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.525+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/547602590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415480 0x55d932415890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.525+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/547602590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415dd0 0x55d932416690 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.525+0000 7faf7ad22b80 1 -- 172.21.15.17:0/547602590 >> 172.21.15.17:0/547602590 conn(0x55d93240ad50 msgr2=0x55d932410180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.525+0000 7faf7ad22b80 1 -- 172.21.15.17:0/547602590 shutdown_connections 2023-07-14T12:59:16.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.525+0000 7faf7ad22b80 1 -- 172.21.15.17:0/547602590 wait complete. 2023-07-14T12:59:16.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.525+0000 7faf7ad22b80 1 -- start start 2023-07-14T12:59:16.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf7ad22b80 1 Processor -- start 2023-07-14T12:59:16.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415480 0x55d93241f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415dd0 0x55d93241f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d932426620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d932306a70 con 0x55d932416c20 2023-07-14T12:59:16.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d932306770 con 0x55d932415480 2023-07-14T12:59:16.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9321ea8d0 con 0x55d932415dd0 2023-07-14T12:59:16.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf7ad22b80 10 client.0 _ll_register_callbacks cb 0x55d932304710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:16.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf6599c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d932426620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf6599c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d932426620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35598/0 (socket says 172.21.15.17:35598) 2023-07-14T12:59:16.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf6599c700 1 -- 172.21.15.17:0/1875419318 learned_addr learned my addr 172.21.15.17:0/1875419318 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:16.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf6519b700 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415480 0x55d93241f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.526+0000 7faf6499a700 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415dd0 0x55d93241f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.527+0000 7faf6599c700 1 -- 172.21.15.17:0/1875419318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415dd0 msgr2=0x55d93241f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.527+0000 7faf6599c700 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415dd0 0x55d93241f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.527+0000 7faf6599c700 1 -- 172.21.15.17:0/1875419318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415480 msgr2=0x55d93241f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.527+0000 7faf6599c700 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415480 0x55d93241f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.527+0000 7faf6599c700 1 -- 172.21.15.17:0/1875419318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf60108850 con 0x55d932416c20 2023-07-14T12:59:16.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.527+0000 7faf6499a700 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415dd0 0x55d93241f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:16.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.527+0000 7faf6599c700 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d932426620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faf58009f60 tx=0x7faf58004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5686024b96c777 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.527+0000 7faf48ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:16.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.527+0000 7faf48ff9700 1 -- 172.21.15.17:0/1875419318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58016a30 con 0x55d932416c20 2023-07-14T12:59:16.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.527+0000 7faf7ad22b80 1 -- 172.21.15.17:0/1875419318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9322c04a0 con 0x55d932416c20 2023-07-14T12:59:16.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.527+0000 7faf48ff9700 1 -- 172.21.15.17:0/1875419318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7faf58016b90 con 0x55d932416c20 2023-07-14T12:59:16.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.528+0000 7faf48ff9700 1 -- 172.21.15.17:0/1875419318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf58016d50 con 0x55d932416c20 2023-07-14T12:59:16.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.528+0000 7faf7ad22b80 10 client.15261 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:16.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.528+0000 7faf7ad22b80 1 -- 172.21.15.17:0/1875419318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55d93217dc10 con 0x55d932416c20 2023-07-14T12:59:16.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.528+0000 7faf48ff9700 1 -- 172.21.15.17:0/1875419318 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf58034020 con 0x55d932416c20 2023-07-14T12:59:16.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.528+0000 7faf48ff9700 1 -- 172.21.15.17:0/1875419318 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf58024410 con 0x55d932416c20 2023-07-14T12:59:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.528+0000 7faf7ad22b80 10 client.15261 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.528+0000 7faf7ad22b80 10 client.15261 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-14T12:59:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.528+0000 7faf7ad22b80 20 client.15261 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.528+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55d93242a380 0x55d932429720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.528+0000 7faf7ad22b80 4 client.15261 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:59:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.528+0000 7faf7ad22b80 1 -- 172.21.15.17:0/1875419318 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d93235fe60 con 0x55d93242a380 2023-07-14T12:59:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.529+0000 7faf6519b700 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55d93242a380 0x55d932429720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.529+0000 7faf6519b700 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55d93242a380 0x55d932429720 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4d66b92570710b55 server_cookie=86ef8d4a168e0b58 in_seq=0 out_seq=0 2023-07-14T12:59:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.529+0000 7faf48ff9700 10 client.15261 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T12:59:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.530+0000 7faf48ff9700 1 -- 172.21.15.17:0/1875419318 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d93235fe60 con 0x55d93242a380 2023-07-14T12:59:16.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.530+0000 7faf48ff9700 10 client.15261 handle_command_reply: tid=0 2023-07-14T12:59:16.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.530+0000 7faf7ad22b80 1 client.15261 shutdown 2023-07-14T12:59:16.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf7ad22b80 1 -- 172.21.15.17:0/1875419318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 msgr2=0x55d932426620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d932426620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7faf58009f60 tx=0x7faf58004b40 comp rx=0 tx=0).stop 2023-07-14T12:59:16.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf7ad22b80 1 -- 172.21.15.17:0/1875419318 shutdown_connections 2023-07-14T12:59:16.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d932426620 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415480 0x55d93241f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55d93242a380 0x55d932429720 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/1875419318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415dd0 0x55d93241f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf7ad22b80 1 -- 172.21.15.17:0/1875419318 >> 172.21.15.17:0/1875419318 conn(0x55d93240ad50 msgr2=0x55d93240f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf48ff9700 0 client.15261 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T12:59:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf7ad22b80 1 -- 172.21.15.17:0/1875419318 shutdown_connections 2023-07-14T12:59:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf7ad22b80 1 -- 172.21.15.17:0/1875419318 wait complete. 2023-07-14T12:59:16.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.531+0000 7faf7ad22b80 20 client.15261 trim_cache size 0 max 16384 2023-07-14T12:59:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.549+0000 7faf7ad22b80 1 Processor -- start 2023-07-14T12:59:16.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.549+0000 7faf7ad22b80 1 -- start start 2023-07-14T12:59:16.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415480 0x55d93241cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415dd0 0x55d932426540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932416c20 0x55d932429720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93241ec70 con 0x55d932415480 2023-07-14T12:59:16.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d932302d50 con 0x55d932415dd0 2023-07-14T12:59:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93240a940 con 0x55d932416c20 2023-07-14T12:59:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415480 0x55d93241cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415480 0x55d93241cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35612/0 (socket says 172.21.15.17:35612) 2023-07-14T12:59:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6519b700 1 -- 172.21.15.17:0/3161367067 learned_addr learned my addr 172.21.15.17:0/3161367067 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:16.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6499a700 1 --2- 172.21.15.17:0/3161367067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415dd0 0x55d932426540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6599c700 1 --2- 172.21.15.17:0/3161367067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932416c20 0x55d932429720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6519b700 1 -- 172.21.15.17:0/3161367067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932416c20 msgr2=0x55d932429720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6519b700 1 --2- 172.21.15.17:0/3161367067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932416c20 0x55d932429720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6519b700 1 -- 172.21.15.17:0/3161367067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415dd0 msgr2=0x55d932426540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6519b700 1 --2- 172.21.15.17:0/3161367067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415dd0 0x55d932426540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6519b700 1 -- 172.21.15.17:0/3161367067 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9324172c0 con 0x55d932415480 2023-07-14T12:59:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6599c700 1 --2- 172.21.15.17:0/3161367067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932416c20 0x55d932429720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:59:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.550+0000 7faf6499a700 1 --2- 172.21.15.17:0/3161367067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415dd0 0x55d932426540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.551+0000 7faf6519b700 1 --2- 172.21.15.17:0/3161367067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415480 0x55d93241cfd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faf5c005bf0 tx=0x7faf5c00b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcbe776006400ed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.551+0000 7faf4bfff700 1 -- 172.21.15.17:0/3161367067 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0b2040 con 0x55d932415480 2023-07-14T12:59:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.551+0000 7faf4bfff700 1 -- 172.21.15.17:0/3161367067 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf5c0a2440 con 0x55d932415480 2023-07-14T12:59:16.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.551+0000 7faf4bfff700 1 -- 172.21.15.17:0/3161367067 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0041e0 con 0x55d932415480 2023-07-14T12:59:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.551+0000 7faf7ad22b80 1 -- 172.21.15.17:0/3161367067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415480 msgr2=0x55d93241cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.551+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/3161367067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415480 0x55d93241cfd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faf5c005bf0 tx=0x7faf5c00b3f0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.551+0000 7faf7ad22b80 1 -- 172.21.15.17:0/3161367067 shutdown_connections 2023-07-14T12:59:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.551+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/3161367067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932416c20 0x55d932429720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.551+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/3161367067 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932415480 0x55d93241cfd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.551+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/3161367067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415dd0 0x55d932426540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.551+0000 7faf7ad22b80 1 -- 172.21.15.17:0/3161367067 >> 172.21.15.17:0/3161367067 conn(0x55d93240ad50 msgr2=0x55d93241dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.552+0000 7faf7ad22b80 1 -- 172.21.15.17:0/3161367067 shutdown_connections 2023-07-14T12:59:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.552+0000 7faf7ad22b80 1 -- 172.21.15.17:0/3161367067 wait complete. 2023-07-14T12:59:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.552+0000 7faf7ad22b80 1 -- start start 2023-07-14T12:59:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.552+0000 7faf7ad22b80 1 Processor -- start 2023-07-14T12:59:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415480 0x55d932424530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415dd0 0x55d93247c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf7ad22b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d93247e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93241c8c0 con 0x55d932416c20 2023-07-14T12:59:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93247ecc0 con 0x55d932415480 2023-07-14T12:59:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf7ad22b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93247ee00 con 0x55d932415dd0 2023-07-14T12:59:16.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf7ad22b80 10 client.0 _ll_register_callbacks cb 0x7faf580197f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf6599c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d93247e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf6599c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d93247e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35614/0 (socket says 172.21.15.17:35614) 2023-07-14T12:59:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf6599c700 1 -- 172.21.15.17:0/2357642737 learned_addr learned my addr 172.21.15.17:0/2357642737 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf6499a700 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415dd0 0x55d93247c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf6519b700 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415480 0x55d932424530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf6599c700 1 -- 172.21.15.17:0/2357642737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415dd0 msgr2=0x55d93247c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf6599c700 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415dd0 0x55d93247c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf6599c700 1 -- 172.21.15.17:0/2357642737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415480 msgr2=0x55d932424530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf6599c700 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415480 0x55d932424530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf6599c700 1 -- 172.21.15.17:0/2357642737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6019ffa0 con 0x55d932416c20 2023-07-14T12:59:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.553+0000 7faf6519b700 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415480 0x55d932424530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.554+0000 7faf6599c700 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d93247e780 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faf58024770 tx=0x7faf58009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0244aa8bcc7ec9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.554+0000 7faf48ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.554+0000 7faf48ff9700 1 -- 172.21.15.17:0/2357642737 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58016a30 con 0x55d932416c20 2023-07-14T12:59:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.554+0000 7faf7ad22b80 1 -- 172.21.15.17:0/2357642737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf5001e040 con 0x55d932416c20 2023-07-14T12:59:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.554+0000 7faf48ff9700 1 -- 172.21.15.17:0/2357642737 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7faf58035080 con 0x55d932416c20 2023-07-14T12:59:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.554+0000 7faf48ff9700 1 -- 172.21.15.17:0/2357642737 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf58016b90 con 0x55d932416c20 2023-07-14T12:59:16.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.554+0000 7faf7ad22b80 10 client.15267 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:16.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.554+0000 7faf7ad22b80 1 -- 172.21.15.17:0/2357642737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55d9321bb200 con 0x55d932416c20 2023-07-14T12:59:16.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.554+0000 7faf48ff9700 1 -- 172.21.15.17:0/2357642737 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf5001e040 con 0x55d932416c20 2023-07-14T12:59:16.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.554+0000 7faf48ff9700 1 -- 172.21.15.17:0/2357642737 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf58019c30 con 0x55d932416c20 2023-07-14T12:59:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.555+0000 7faf7ad22b80 10 client.15267 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.555+0000 7faf7ad22b80 10 client.15267 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-14T12:59:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.555+0000 7faf7ad22b80 20 client.15267 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.555+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55d932483b00 0x55d932480450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.555+0000 7faf7ad22b80 4 client.15267 mds_command: new command op to 24547 tid=0[{"prefix": "status"}] 2023-07-14T12:59:16.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.555+0000 7faf7ad22b80 1 -- 172.21.15.17:0/2357642737 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d932322000 con 0x55d932483b00 2023-07-14T12:59:16.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.555+0000 7faf6519b700 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55d932483b00 0x55d932480450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf48ff9700 10 client.15267 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T12:59:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf6519b700 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55d932483b00 0x55d932480450 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17f347d46a14db25 server_cookie=4c5aa35c73cce328 in_seq=0 out_seq=0 2023-07-14T12:59:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf48ff9700 1 -- 172.21.15.17:0/2357642737 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55d932322000 con 0x55d932483b00 2023-07-14T12:59:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf48ff9700 10 client.15267 handle_command_reply: tid=0 2023-07-14T12:59:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 1 client.15267 shutdown 2023-07-14T12:59:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 1 -- 172.21.15.17:0/2357642737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 msgr2=0x55d93247e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d93247e780 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faf58024770 tx=0x7faf58009520 comp rx=0 tx=0).stop 2023-07-14T12:59:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 1 -- 172.21.15.17:0/2357642737 shutdown_connections 2023-07-14T12:59:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d932416c20 0x55d93247e780 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d932415480 0x55d932424530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55d932483b00 0x55d932480450 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 1 --2- 172.21.15.17:0/2357642737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d932415dd0 0x55d93247c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf48ff9700 0 client.15267 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T12:59:16.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 1 -- 172.21.15.17:0/2357642737 >> 172.21.15.17:0/2357642737 conn(0x55d93240ad50 msgr2=0x55d93241cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 1 -- 172.21.15.17:0/2357642737 shutdown_connections 2023-07-14T12:59:16.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 1 -- 172.21.15.17:0/2357642737 wait complete. 2023-07-14T12:59:16.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.556+0000 7faf7ad22b80 20 client.15267 trim_cache size 0 max 16384 2023-07-14T12:59:16.600 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:59:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b31a3268-2244-11ee-9b33-001a4aab830c", 2023-07-14T12:59:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2023-07-14T12:59:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24547, 2023-07-14T12:59:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-07-14T12:59:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-07-14T12:59:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-07-14T12:59:16.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 92.356980327000002, 2023-07-14T12:59:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 22, 2023-07-14T12:59:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 88, 2023-07-14T12:59:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 86, 2023-07-14T12:59:16.602 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 112.28824267 2023-07-14T12:59:16.602 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:59:16.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 -- 172.21.15.17:0/3066274754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faf4c0a11d0 msgr2=0x7faf4c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faf4c0a11d0 0x7faf4c0a3680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf60074920 tx=0x7faf58009f90 comp rx=0 tx=0).stop 2023-07-14T12:59:16.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 -- 172.21.15.17:0/3066274754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf600ffae0 msgr2=0x7faf600742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf600ffae0 0x7faf600742c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00e970 tx=0x7faf5c00ed30 comp rx=0 tx=0).stop 2023-07-14T12:59:16.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 -- 172.21.15.17:0/3066274754 shutdown_connections 2023-07-14T12:59:16.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7faf4c0a11d0 0x7faf4c0a3680 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf60101660 0x7faf60072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf600ffae0 0x7faf600742c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 --2- 172.21.15.17:0/3066274754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf60100cd0 0x7faf60072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 -- 172.21.15.17:0/3066274754 >> 172.21.15.17:0/3066274754 conn(0x7faf600fb0e0 msgr2=0x7faf600fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 -- 172.21.15.17:0/3066274754 shutdown_connections 2023-07-14T12:59:16.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.557+0000 7faf673ff700 1 -- 172.21.15.17:0/3066274754 wait complete. 2023-07-14T12:59:16.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:16 smithi017 ceph-mon[95536]: pgmap v352: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 7 op/s 2023-07-14T12:59:16.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:16 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/908649141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:16.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:16 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1521100695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:16.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-07-14T12:59:16.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.780+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/2487097312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c48100ce0 msgr2=0x7f1c48101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.780+0000 7f1c4d1ff700 1 --2- 172.21.15.17:0/2487097312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c48100ce0 0x7f1c48101130 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009990 tx=0x7f1c3c009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.780+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/2487097312 shutdown_connections 2023-07-14T12:59:16.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.780+0000 7f1c4d1ff700 1 --2- 172.21.15.17:0/2487097312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c48101670 0x7f1c48107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.780+0000 7f1c4d1ff700 1 --2- 172.21.15.17:0/2487097312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c480ffaf0 0x7f1c480fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.780+0000 7f1c4d1ff700 1 --2- 172.21.15.17:0/2487097312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c48100ce0 0x7f1c48101130 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.780+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/2487097312 >> 172.21.15.17:0/2487097312 conn(0x7f1c480fb130 msgr2=0x7f1c480fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.780+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/2487097312 shutdown_connections 2023-07-14T12:59:16.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.780+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/2487097312 wait complete. 2023-07-14T12:59:16.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.781+0000 7f1c4d1ff700 1 Processor -- start 2023-07-14T12:59:16.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.781+0000 7f1c4d1ff700 1 -- start start 2023-07-14T12:59:16.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.781+0000 7f1c4d1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c480ffaf0 0x7f1c48197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.781+0000 7f1c4d1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c48100ce0 0x7f1c48197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.781+0000 7f1c4d1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c48101670 0x7f1c4819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4d1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4819f510 con 0x7f1c48101670 2023-07-14T12:59:16.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4d1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4819f650 con 0x7f1c48100ce0 2023-07-14T12:59:16.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4d1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4819f7e0 con 0x7f1c480ffaf0 2023-07-14T12:59:16.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c48101670 0x7f1c4819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c48101670 0x7f1c4819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35634/0 (socket says 172.21.15.17:35634) 2023-07-14T12:59:16.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4759e700 1 -- 172.21.15.17:0/1054779967 learned_addr learned my addr 172.21.15.17:0/1054779967 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:16.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c46d9d700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c480ffaf0 0x7f1c48197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4659c700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c48100ce0 0x7f1c48197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4759e700 1 -- 172.21.15.17:0/1054779967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c480ffaf0 msgr2=0x7f1c48197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4759e700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c480ffaf0 0x7f1c48197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4759e700 1 -- 172.21.15.17:0/1054779967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c48100ce0 msgr2=0x7f1c48197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4759e700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c48100ce0 0x7f1c48197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4759e700 1 -- 172.21.15.17:0/1054779967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c0095f0 con 0x7f1c48101670 2023-07-14T12:59:16.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.782+0000 7f1c4759e700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c48101670 0x7f1c4819ef40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000ef30 tx=0x7f1c4000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.783+0000 7f1c2ffff700 1 -- 172.21.15.17:0/1054779967 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40018070 con 0x7f1c48101670 2023-07-14T12:59:16.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.783+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/1054779967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4819fa60 con 0x7f1c48101670 2023-07-14T12:59:16.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.783+0000 7f1c2ffff700 1 -- 172.21.15.17:0/1054779967 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c4000f040 con 0x7f1c48101670 2023-07-14T12:59:16.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.783+0000 7f1c2ffff700 1 -- 172.21.15.17:0/1054779967 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4000cc30 con 0x7f1c48101670 2023-07-14T12:59:16.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.783+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/1054779967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4819ff70 con 0x7f1c48101670 2023-07-14T12:59:16.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.786+0000 7f1c2ffff700 1 -- 172.21.15.17:0/1054779967 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f1c40007500 con 0x7f1c48101670 2023-07-14T12:59:16.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.787+0000 7f1c60bdcb80 1 Processor -- start 2023-07-14T12:59:16.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.787+0000 7f1c60bdcb80 1 -- start start 2023-07-14T12:59:16.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.787+0000 7f1c2ffff700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c300a1150 0x7f1c300a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c2ffff700 1 -- 172.21.15.17:0/1054779967 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f1c400cc3c0 con 0x7f1c48101670 2023-07-14T12:59:16.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b110890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b111690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b111c20 0x562c1b112090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c4659c700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c300a1150 0x7f1c300a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1b015c60 con 0x562c1b110480 2023-07-14T12:59:16.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1b0689f0 con 0x562c1b110dd0 2023-07-14T12:59:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1b061e80 con 0x562c1b111c20 2023-07-14T12:59:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c46d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b110890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c46d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b110890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35650/0 (socket says 172.21.15.17:35650) 2023-07-14T12:59:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4215789145 learned_addr learned my addr 172.21.15.17:0/4215789145 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c4659c700 1 --2- 172.21.15.17:0/4215789145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b111690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c4759e700 1 --2- 172.21.15.17:0/4215789145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b111c20 0x562c1b112090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4215789145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b111c20 msgr2=0x562c1b112090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c46d9d700 1 --2- 172.21.15.17:0/4215789145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b111c20 0x562c1b112090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4215789145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 msgr2=0x562c1b111690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c46d9d700 1 --2- 172.21.15.17:0/4215789145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b111690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.788+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4215789145 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c1ae8fd90 con 0x562c1b110480 2023-07-14T12:59:16.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.789+0000 7f1c4659c700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c300a1150 0x7f1c300a3600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c006010 tx=0x7f1c3c005170 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.789+0000 7f1c46d9d700 1 --2- 172.21.15.17:0/4215789145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b110890 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1c38007d10 tx=0x7f1c380106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32ac3daac98f6a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.789+0000 7f1c2d7fa700 1 -- 172.21.15.17:0/4215789145 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38010ec0 con 0x562c1b110480 2023-07-14T12:59:16.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.789+0000 7f1c2d7fa700 1 -- 172.21.15.17:0/4215789145 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c38015070 con 0x562c1b110480 2023-07-14T12:59:16.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.789+0000 7f1c2d7fa700 1 -- 172.21.15.17:0/4215789145 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c380195d0 con 0x562c1b110480 2023-07-14T12:59:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.790+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4215789145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 msgr2=0x562c1b110890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.790+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4215789145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b110890 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1c38007d10 tx=0x7f1c380106b0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.790+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4215789145 shutdown_connections 2023-07-14T12:59:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.790+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4215789145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b111c20 0x562c1b112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.790+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4215789145 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b110890 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.790+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4215789145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.790+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4215789145 >> 172.21.15.17:0/4215789145 conn(0x562c1b105d50 msgr2=0x562c1b10b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.790+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4215789145 shutdown_connections 2023-07-14T12:59:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.790+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4215789145 wait complete. 2023-07-14T12:59:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.790+0000 7f1c60bdcb80 1 -- start start 2023-07-14T12:59:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c60bdcb80 1 Processor -- start 2023-07-14T12:59:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b11a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b11a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b111c20 0x562c1b121600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1b001a70 con 0x562c1b110480 2023-07-14T12:59:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1b001770 con 0x562c1b110dd0 2023-07-14T12:59:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1aee58d0 con 0x562c1b111c20 2023-07-14T12:59:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c60bdcb80 10 client.0 _ll_register_callbacks cb 0x562c1afff710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c46d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b11a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c46d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b11a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35660/0 (socket says 172.21.15.17:35660) 2023-07-14T12:59:16.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4181650352 learned_addr learned my addr 172.21.15.17:0/4181650352 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:16.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.791+0000 7f1c4659c700 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b11a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4181650352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b111c20 msgr2=0x562c1b121600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c46d9d700 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b111c20 0x562c1b121600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4181650352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 msgr2=0x562c1b11a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c46d9d700 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b11a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4181650352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c38007970 con 0x562c1b110480 2023-07-14T12:59:16.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c4659c700 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b11a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:59:16.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c46d9d700 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b11a080 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1c38007fc0 tx=0x7f1c38010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2b0b9bd764fb3f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c2aff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:16.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4181650352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38004230 con 0x562c1b110480 2023-07-14T12:59:16.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4181650352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562c1afbb4a0 con 0x562c1b110480 2023-07-14T12:59:16.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4181650352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f1c38004390 con 0x562c1b110480 2023-07-14T12:59:16.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4181650352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c38004550 con 0x562c1b110480 2023-07-14T12:59:16.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c60bdcb80 10 client.15279 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:16.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.792+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4181650352 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x562c1ae78c10 con 0x562c1b110480 2023-07-14T12:59:16.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.793+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4181650352 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c38032020 con 0x562c1b110480 2023-07-14T12:59:16.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.793+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4181650352 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1c3802a060 con 0x562c1b110480 2023-07-14T12:59:16.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.793+0000 7f1c60bdcb80 10 client.15279 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:16.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.793+0000 7f1c60bdcb80 10 client.15279 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-14T12:59:16.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.793+0000 7f1c60bdcb80 20 client.15279 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:16.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.793+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562c1b125270 0x562c1b124640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.793+0000 7f1c60bdcb80 4 client.15279 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:59:16.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.793+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4181650352 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562c1b05ae60 con 0x562c1b125270 2023-07-14T12:59:16.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.793+0000 7f1c4659c700 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562c1b125270 0x562c1b124640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.794+0000 7f1c4659c700 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562c1b125270 0x562c1b124640 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d59da1c5695f116 server_cookie=829b13989bdd0518 in_seq=0 out_seq=0 2023-07-14T12:59:16.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.794+0000 7f1c2aff5700 10 client.15279 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T12:59:16.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4181650352 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562c1b05ae60 con 0x562c1b125270 2023-07-14T12:59:16.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c2aff5700 10 client.15279 handle_command_reply: tid=0 2023-07-14T12:59:16.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c60bdcb80 1 client.15279 shutdown 2023-07-14T12:59:16.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4181650352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 msgr2=0x562c1b11a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b11a080 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1c38007fc0 tx=0x7f1c38010d70 comp rx=0 tx=0).stop 2023-07-14T12:59:16.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4181650352 shutdown_connections 2023-07-14T12:59:16.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b111c20 0x562c1b121600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b11a080 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562c1b125270 0x562c1b124640 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4181650352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b11a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c2aff5700 0 client.15279 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T12:59:16.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4181650352 >> 172.21.15.17:0/4181650352 conn(0x562c1b105d50 msgr2=0x562c1b10a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4181650352 shutdown_connections 2023-07-14T12:59:16.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.795+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4181650352 wait complete. 2023-07-14T12:59:16.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.796+0000 7f1c60bdcb80 20 client.15279 trim_cache size 0 max 16384 2023-07-14T12:59:16.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.814+0000 7f1c60bdcb80 1 Processor -- start 2023-07-14T12:59:16.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.814+0000 7f1c60bdcb80 1 -- start start 2023-07-14T12:59:16.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.814+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b110480 0x562c1b12e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.814+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b121520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.814+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b111c20 0x562c1b10a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.814+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1affdd50 con 0x562c1b111c20 2023-07-14T12:59:16.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.814+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1b126560 con 0x562c1b110dd0 2023-07-14T12:59:16.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.814+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1b119530 con 0x562c1b110480 2023-07-14T12:59:16.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c4759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b111c20 0x562c1b10a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c4759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b111c20 0x562c1b10a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35666/0 (socket says 172.21.15.17:35666) 2023-07-14T12:59:16.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c4759e700 1 -- 172.21.15.17:0/565041919 learned_addr learned my addr 172.21.15.17:0/565041919 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:16.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c46d9d700 1 --2- 172.21.15.17:0/565041919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b110480 0x562c1b12e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c4659c700 1 --2- 172.21.15.17:0/565041919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b121520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c4759e700 1 -- 172.21.15.17:0/565041919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b110480 msgr2=0x562c1b12e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c4759e700 1 --2- 172.21.15.17:0/565041919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b110480 0x562c1b12e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c4759e700 1 -- 172.21.15.17:0/565041919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 msgr2=0x562c1b121520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c4759e700 1 --2- 172.21.15.17:0/565041919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b121520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c4759e700 1 -- 172.21.15.17:0/565041919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c1aeb6200 con 0x562c1b111c20 2023-07-14T12:59:16.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c4659c700 1 --2- 172.21.15.17:0/565041919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b121520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:59:16.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c4759e700 1 --2- 172.21.15.17:0/565041919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b111c20 0x562c1b10a860 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1c400c9e90 tx=0x7f1c40099210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c8b7636dde49cd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c2dffb700 1 -- 172.21.15.17:0/565041919 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40099830 con 0x562c1b111c20 2023-07-14T12:59:16.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c2dffb700 1 -- 172.21.15.17:0/565041919 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c4009d860 con 0x562c1b111c20 2023-07-14T12:59:16.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.815+0000 7f1c2dffb700 1 -- 172.21.15.17:0/565041919 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40004b60 con 0x562c1b111c20 2023-07-14T12:59:16.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.816+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/565041919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b111c20 msgr2=0x562c1b10a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.816+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/565041919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b111c20 0x562c1b10a860 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1c400c9e90 tx=0x7f1c40099210 comp rx=0 tx=0).stop 2023-07-14T12:59:16.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.816+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/565041919 shutdown_connections 2023-07-14T12:59:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.816+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/565041919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b111c20 0x562c1b10a860 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.816+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/565041919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b110480 0x562c1b12e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.816+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/565041919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b110dd0 0x562c1b121520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.816+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/565041919 >> 172.21.15.17:0/565041919 conn(0x562c1b105d50 msgr2=0x562c1b10b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.816+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/565041919 shutdown_connections 2023-07-14T12:59:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.816+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/565041919 wait complete. 2023-07-14T12:59:16.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.816+0000 7f1c60bdcb80 1 -- start start 2023-07-14T12:59:16.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.817+0000 7f1c60bdcb80 1 Processor -- start 2023-07-14T12:59:16.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.817+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b1169a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.817+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b110dd0 0x562c1b116ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.817+0000 7f1c60bdcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b111c20 0x562c1b179130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.817+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1b179670 con 0x562c1b110480 2023-07-14T12:59:16.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.817+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1b1797b0 con 0x562c1b111c20 2023-07-14T12:59:16.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.817+0000 7f1c60bdcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c1b179920 con 0x562c1b110dd0 2023-07-14T12:59:16.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.817+0000 7f1c60bdcb80 10 client.0 _ll_register_callbacks cb 0x7f1c38007b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:16.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.817+0000 7f1c46d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b1169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.817+0000 7f1c46d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b1169a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35678/0 (socket says 172.21.15.17:35678) 2023-07-14T12:59:16.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.817+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4135226811 learned_addr learned my addr 172.21.15.17:0/4135226811 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:16.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.818+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4135226811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b110dd0 msgr2=0x562c1b116ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.818+0000 7f1c46d9d700 1 --2- 172.21.15.17:0/4135226811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b110dd0 0x562c1b116ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.818+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4135226811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b111c20 msgr2=0x562c1b179130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:16.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.818+0000 7f1c46d9d700 1 --2- 172.21.15.17:0/4135226811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b111c20 0x562c1b179130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.818+0000 7f1c46d9d700 1 -- 172.21.15.17:0/4135226811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4819ff70 con 0x562c1b110480 2023-07-14T12:59:16.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.818+0000 7f1c46d9d700 1 --2- 172.21.15.17:0/4135226811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b1169a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1c38005790 tx=0x7f1c38005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bd0920b852fe24 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:16.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.818+0000 7f1c2aff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:16.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.818+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4135226811 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38011640 con 0x562c1b110480 2023-07-14T12:59:16.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.818+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4135226811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c38015070 con 0x562c1b110480 2023-07-14T12:59:16.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.818+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4135226811 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f1c38033080 con 0x562c1b110480 2023-07-14T12:59:16.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.819+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4135226811 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c38010e90 con 0x562c1b110480 2023-07-14T12:59:16.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.819+0000 7f1c60bdcb80 10 client.15285 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:16.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.819+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4135226811 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x562c1ae8e260 con 0x562c1b110480 2023-07-14T12:59:16.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.819+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4135226811 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c38015070 con 0x562c1b110480 2023-07-14T12:59:16.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.819+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4135226811 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1c38035070 con 0x562c1b110480 2023-07-14T12:59:16.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.819+0000 7f1c60bdcb80 10 client.15285 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:16.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.819+0000 7f1c60bdcb80 10 client.15285 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-14T12:59:16.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.819+0000 7f1c60bdcb80 20 client.15285 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:16.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.819+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4135226811 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562c1b17e2a0 0x562c1b17ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:16.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.819+0000 7f1c60bdcb80 4 client.15285 mds_command: new command op to 24548 tid=0[{"prefix": "status"}] 2023-07-14T12:59:16.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.819+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4135226811 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562c1b01d000 con 0x562c1b17e2a0 2023-07-14T12:59:16.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.820+0000 7f1c4659c700 1 --2- 172.21.15.17:0/4135226811 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562c1b17e2a0 0x562c1b17ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:16.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.820+0000 7f1c4659c700 1 --2- 172.21.15.17:0/4135226811 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562c1b17e2a0 0x562c1b17ab50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4486eaa5d913d13a server_cookie=dd428050fce7048 in_seq=0 out_seq=0 2023-07-14T12:59:16.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.820+0000 7f1c2aff5700 10 client.15285 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T12:59:16.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.820+0000 7f1c2aff5700 1 -- 172.21.15.17:0/4135226811 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562c1b01d000 con 0x562c1b17e2a0 2023-07-14T12:59:16.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.820+0000 7f1c2aff5700 10 client.15285 handle_command_reply: tid=0 2023-07-14T12:59:16.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.820+0000 7f1c60bdcb80 1 client.15285 shutdown 2023-07-14T12:59:16.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4135226811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 msgr2=0x562c1b1169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4135226811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b1169a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1c38005790 tx=0x7f1c38005810 comp rx=0 tx=0).stop 2023-07-14T12:59:16.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4135226811 shutdown_connections 2023-07-14T12:59:16.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4135226811 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562c1b17e2a0 0x562c1b17ab50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4135226811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c1b111c20 0x562c1b179130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4135226811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562c1b110480 0x562c1b1169a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c2aff5700 0 client.15285 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T12:59:16.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c60bdcb80 1 --2- 172.21.15.17:0/4135226811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562c1b110dd0 0x562c1b116ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4135226811 >> 172.21.15.17:0/4135226811 conn(0x562c1b105d50 msgr2=0x562c1b124640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4135226811 shutdown_connections 2023-07-14T12:59:16.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c60bdcb80 1 -- 172.21.15.17:0/4135226811 wait complete. 2023-07-14T12:59:16.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.821+0000 7f1c60bdcb80 20 client.15285 trim_cache size 0 max 16384 2023-07-14T12:59:16.860 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:59:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b31a3268-2244-11ee-9b33-001a4aab830c", 2023-07-14T12:59:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2023-07-14T12:59:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24548, 2023-07-14T12:59:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-07-14T12:59:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-07-14T12:59:16.861 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-07-14T12:59:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 93.629792230000007, 2023-07-14T12:59:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 22, 2023-07-14T12:59:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 88, 2023-07-14T12:59:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 86, 2023-07-14T12:59:16.862 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 115.675592102 2023-07-14T12:59:16.862 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:59:16.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/1054779967 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c300a1150 msgr2=0x7f1c300a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c300a1150 0x7f1c300a3600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c006010 tx=0x7f1c3c005170 comp rx=0 tx=0).stop 2023-07-14T12:59:16.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/1054779967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c48101670 msgr2=0x7f1c4819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:16.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c48101670 0x7f1c4819ef40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000ef30 tx=0x7f1c4000c3a0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/1054779967 shutdown_connections 2023-07-14T12:59:16.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1c300a1150 0x7f1c300a3600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c48101670 0x7f1c4819ef40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c480ffaf0 0x7f1c48197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 --2- 172.21.15.17:0/1054779967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c48100ce0 0x7f1c48197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:16.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/1054779967 >> 172.21.15.17:0/1054779967 conn(0x7f1c480fb130 msgr2=0x7f1c48106670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:16.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/1054779967 shutdown_connections 2023-07-14T12:59:16.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:16.822+0000 7f1c4d1ff700 1 -- 172.21.15.17:0/1054779967 wait complete. 2023-07-14T12:59:16.870 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-14T12:59:17.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.043+0000 7f8ed35ff700 1 -- 172.21.15.17:0/1781515052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ecc100cd0 msgr2=0x7f8ecc101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:17.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.043+0000 7f8ed35ff700 1 --2- 172.21.15.17:0/1781515052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ecc100cd0 0x7f8ecc101120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0098f0 tx=0x7f8ebc009c00 comp rx=0 tx=0).stop 2023-07-14T12:59:17.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.043+0000 7f8ed35ff700 1 -- 172.21.15.17:0/1781515052 shutdown_connections 2023-07-14T12:59:17.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.043+0000 7f8ed35ff700 1 --2- 172.21.15.17:0/1781515052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ecc101660 0x7f8ecc107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.043+0000 7f8ed35ff700 1 --2- 172.21.15.17:0/1781515052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ecc0ffae0 0x7f8ecc0ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.043+0000 7f8ed35ff700 1 --2- 172.21.15.17:0/1781515052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ecc100cd0 0x7f8ecc101120 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.043+0000 7f8ed35ff700 1 -- 172.21.15.17:0/1781515052 >> 172.21.15.17:0/1781515052 conn(0x7f8ecc0fb0e0 msgr2=0x7f8ecc0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:17.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.043+0000 7f8ed35ff700 1 -- 172.21.15.17:0/1781515052 shutdown_connections 2023-07-14T12:59:17.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.043+0000 7f8ed35ff700 1 -- 172.21.15.17:0/1781515052 wait complete. 2023-07-14T12:59:17.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.044+0000 7f8ed35ff700 1 Processor -- start 2023-07-14T12:59:17.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.044+0000 7f8ed35ff700 1 -- start start 2023-07-14T12:59:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed35ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ecc0ffae0 0x7f8ecc197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed35ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ecc100cd0 0x7f8ecc197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed35ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ecc101660 0x7f8ecc19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed35ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19f510 con 0x7f8ecc101660 2023-07-14T12:59:17.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed35ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19f650 con 0x7f8ecc0ffae0 2023-07-14T12:59:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed35ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc19f7e0 con 0x7f8ecc100cd0 2023-07-14T12:59:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed1b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ecc101660 0x7f8ecc19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed1b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ecc101660 0x7f8ecc19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35694/0 (socket says 172.21.15.17:35694) 2023-07-14T12:59:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed1b9c700 1 -- 172.21.15.17:0/704652610 learned_addr learned my addr 172.21.15.17:0/704652610 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed139b700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ecc0ffae0 0x7f8ecc197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed0b9a700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ecc100cd0 0x7f8ecc197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed1b9c700 1 -- 172.21.15.17:0/704652610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ecc100cd0 msgr2=0x7f8ecc197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed1b9c700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ecc100cd0 0x7f8ecc197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed1b9c700 1 -- 172.21.15.17:0/704652610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ecc0ffae0 msgr2=0x7f8ecc197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed1b9c700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ecc0ffae0 0x7f8ecc197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.045+0000 7f8ed1b9c700 1 -- 172.21.15.17:0/704652610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4009d00 con 0x7f8ecc101660 2023-07-14T12:59:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.046+0000 7f8ed1b9c700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ecc101660 0x7f8ecc19ef40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400e3c0 tx=0x7f8ec400e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.046+0000 7f8ec27fc700 1 -- 172.21.15.17:0/704652610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec40090d0 con 0x7f8ecc101660 2023-07-14T12:59:17.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.046+0000 7f8ec27fc700 1 -- 172.21.15.17:0/704652610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ec400f040 con 0x7f8ecc101660 2023-07-14T12:59:17.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.046+0000 7f8ed35ff700 1 -- 172.21.15.17:0/704652610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ebc009520 con 0x7f8ecc101660 2023-07-14T12:59:17.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.046+0000 7f8ec27fc700 1 -- 172.21.15.17:0/704652610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4007b10 con 0x7f8ecc101660 2023-07-14T12:59:17.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.046+0000 7f8ed35ff700 1 -- 172.21.15.17:0/704652610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc19fe90 con 0x7f8ecc101660 2023-07-14T12:59:17.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.049+0000 7f8ec27fc700 1 -- 172.21.15.17:0/704652610 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8ec4007c70 con 0x7f8ecc101660 2023-07-14T12:59:17.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.050+0000 7f8ee6f09b80 1 Processor -- start 2023-07-14T12:59:17.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.050+0000 7f8ec27fc700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8eb80a11d0 0x7f8eb80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.050+0000 7f8ee6f09b80 1 -- start start 2023-07-14T12:59:17.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ec27fc700 1 -- 172.21.15.17:0/704652610 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f8ec40cc640 con 0x7f8ecc101660 2023-07-14T12:59:17.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a2778ff890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2778ffdd0 0x55a277900690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a277900c20 0x55a277901090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a277804c60 con 0x55a277900c20 2023-07-14T12:59:17.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2778579f0 con 0x55a2778ff480 2023-07-14T12:59:17.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a277850e80 con 0x55a2778ffdd0 2023-07-14T12:59:17.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ed0b9a700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8eb80a11d0 0x7f8eb80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ed1b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a277900c20 0x55a277901090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ed1b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a277900c20 0x55a277901090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35706/0 (socket says 172.21.15.17:35706) 2023-07-14T12:59:17.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ed1b9c700 1 -- 172.21.15.17:0/2029265097 learned_addr learned my addr 172.21.15.17:0/2029265097 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:17.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.051+0000 7f8ed139b700 1 --2- 172.21.15.17:0/2029265097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a2778ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8ed0b9a700 1 --2- 172.21.15.17:0/2029265097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2778ffdd0 0x55a277900690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8ed1b9c700 1 -- 172.21.15.17:0/2029265097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2778ffdd0 msgr2=0x55a277900690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:17.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8ed1b9c700 1 --2- 172.21.15.17:0/2029265097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2778ffdd0 0x55a277900690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8ed1b9c700 1 -- 172.21.15.17:0/2029265097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 msgr2=0x55a2778ff890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:17.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8ed1b9c700 1 --2- 172.21.15.17:0/2029265097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a2778ff890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8ed1b9c700 1 -- 172.21.15.17:0/2029265097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a27767ed90 con 0x55a277900c20 2023-07-14T12:59:17.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8ed0b9a700 1 --2- 172.21.15.17:0/2029265097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2778ffdd0 0x55a277900690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:59:17.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8ed139b700 1 --2- 172.21.15.17:0/2029265097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a2778ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:17.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8ed0b9a700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8eb80a11d0 0x7f8eb80a3680 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc005e90 tx=0x7f8ebc005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:17.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8ed1b9c700 1 --2- 172.21.15.17:0/2029265097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a277900c20 0x55a277901090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4095fb0 tx=0x7f8ec4009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf38b2e5e9f2cd88 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:17.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8eb77fe700 1 -- 172.21.15.17:0/2029265097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4009230 con 0x55a277900c20 2023-07-14T12:59:17.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8eb77fe700 1 -- 172.21.15.17:0/2029265097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ec40112c0 con 0x55a277900c20 2023-07-14T12:59:17.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.052+0000 7f8eb77fe700 1 -- 172.21.15.17:0/2029265097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4099d10 con 0x55a277900c20 2023-07-14T12:59:17.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.053+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/2029265097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a277900c20 msgr2=0x55a277901090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:17.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.053+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/2029265097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a277900c20 0x55a277901090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4095fb0 tx=0x7f8ec4009530 comp rx=0 tx=0).stop 2023-07-14T12:59:17.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.053+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/2029265097 shutdown_connections 2023-07-14T12:59:17.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.053+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/2029265097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a277900c20 0x55a277901090 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.053+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/2029265097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a2778ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.053+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/2029265097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2778ffdd0 0x55a277900690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.053+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/2029265097 >> 172.21.15.17:0/2029265097 conn(0x55a2778f4d50 msgr2=0x55a2778fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:17.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.053+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/2029265097 shutdown_connections 2023-07-14T12:59:17.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.053+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/2029265097 wait complete. 2023-07-14T12:59:17.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.053+0000 7f8ee6f09b80 1 -- start start 2023-07-14T12:59:17.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.054+0000 7f8ee6f09b80 1 Processor -- start 2023-07-14T12:59:17.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.054+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a277909110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.054+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 0x55a277909650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.054+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a277900c20 0x55a277910690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.054+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2777f0a70 con 0x55a2778ffdd0 2023-07-14T12:59:17.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.054+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2777f0770 con 0x55a2778ff480 2023-07-14T12:59:17.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.054+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2776d48d0 con 0x55a277900c20 2023-07-14T12:59:17.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.054+0000 7f8ee6f09b80 10 client.0 _ll_register_callbacks cb 0x55a2777ee710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:17.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.054+0000 7f8ed0b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 0x55a277909650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.054+0000 7f8ed0b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 0x55a277909650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35720/0 (socket says 172.21.15.17:35720) 2023-07-14T12:59:17.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.054+0000 7f8ed0b9a700 1 -- 172.21.15.17:0/319079789 learned_addr learned my addr 172.21.15.17:0/319079789 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:17.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8ed139b700 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a277909110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8ed1b9c700 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a277900c20 0x55a277910690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8ed0b9a700 1 -- 172.21.15.17:0/319079789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a277900c20 msgr2=0x55a277910690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8ed0b9a700 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a277900c20 0x55a277910690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8ed0b9a700 1 -- 172.21.15.17:0/319079789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 msgr2=0x55a277909110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:17.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8ed0b9a700 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a277909110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8ed0b9a700 1 -- 172.21.15.17:0/319079789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec80098e0 con 0x55a2778ffdd0 2023-07-14T12:59:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8ed0b9a700 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 0x55a277909650 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00f9d0 tx=0x7f8ebc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f63f58bf98c62ca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8eb4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/319079789 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00bbd0 con 0x55a2778ffdd0 2023-07-14T12:59:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/319079789 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f8ebc005030 con 0x55a2778ffdd0 2023-07-14T12:59:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.055+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/319079789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2777aa4a0 con 0x55a2778ffdd0 2023-07-14T12:59:17.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.056+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/319079789 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ebc0051f0 con 0x55a2778ffdd0 2023-07-14T12:59:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.056+0000 7f8ee6f09b80 10 client.15297 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.056+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/319079789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f8ecc19fe90 con 0x55a2778ffdd0 2023-07-14T12:59:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.056+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/319079789 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a2777aa4a0 con 0x55a2778ffdd0 2023-07-14T12:59:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.056+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/319079789 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8ebc003cb0 con 0x55a2778ffdd0 2023-07-14T12:59:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.056+0000 7f8ee6f09b80 10 client.15297 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.056+0000 7f8ee6f09b80 10 client.15297 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T12:59:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.056+0000 7f8ee6f09b80 20 client.15297 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:17.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.056+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a277914320 0x55a277913750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.056+0000 7f8ee6f09b80 4 client.15297 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:59:17.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.056+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/319079789 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a277849e60 con 0x55a277914320 2023-07-14T12:59:17.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.057+0000 7f8ed139b700 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a277914320 0x55a277913750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.058+0000 7f8ed139b700 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a277914320 0x55a277913750 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4c8c5badf3a4da0 server_cookie=799b339c12478413 in_seq=0 out_seq=0 2023-07-14T12:59:17.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.058+0000 7f8eb4ff9700 10 client.15297 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:17.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.058+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/319079789 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a277849e60 con 0x55a277914320 2023-07-14T12:59:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.058+0000 7f8eb4ff9700 10 client.15297 handle_command_reply: tid=0 2023-07-14T12:59:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.058+0000 7f8ee6f09b80 1 client.15297 shutdown 2023-07-14T12:59:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/319079789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 msgr2=0x55a277909650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 0x55a277909650 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00f9d0 tx=0x7f8ebc009c00 comp rx=0 tx=0).stop 2023-07-14T12:59:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/319079789 shutdown_connections 2023-07-14T12:59:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a277914320 0x55a277913750 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a277900c20 0x55a277910690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a277909110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/319079789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 0x55a277909650 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/319079789 >> 172.21.15.17:0/319079789 conn(0x55a2778f4d50 msgr2=0x55a2778f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8eb4ff9700 0 client.15297 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/319079789 shutdown_connections 2023-07-14T12:59:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/319079789 wait complete. 2023-07-14T12:59:17.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.059+0000 7f8ee6f09b80 20 client.15297 trim_cache size 0 max 16384 2023-07-14T12:59:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.077+0000 7f8ee6f09b80 1 Processor -- start 2023-07-14T12:59:17.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.077+0000 7f8ee6f09b80 1 -- start start 2023-07-14T12:59:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a277913750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 0x55a277910620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a277900c20 0x55a277903ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27790a300 con 0x55a2778ffdd0 2023-07-14T12:59:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2778fb480 con 0x55a2778ff480 2023-07-14T12:59:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2776e0de0 con 0x55a277900c20 2023-07-14T12:59:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ed0b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 0x55a277910620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ed0b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 0x55a277910620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35722/0 (socket says 172.21.15.17:35722) 2023-07-14T12:59:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ed0b9a700 1 -- 172.21.15.17:0/1661322936 learned_addr learned my addr 172.21.15.17:0/1661322936 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ed139b700 1 --2- 172.21.15.17:0/1661322936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a277913750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ed1b9c700 1 --2- 172.21.15.17:0/1661322936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a277900c20 0x55a277903ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ed139b700 1 -- 172.21.15.17:0/1661322936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a277900c20 msgr2=0x55a277903ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.078+0000 7f8ed139b700 1 --2- 172.21.15.17:0/1661322936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a277900c20 0x55a277903ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.079+0000 7f8ed139b700 1 -- 172.21.15.17:0/1661322936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 msgr2=0x55a277910620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:17.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.079+0000 7f8ed139b700 1 --2- 172.21.15.17:0/1661322936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 0x55a277910620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.079+0000 7f8ed139b700 1 -- 172.21.15.17:0/1661322936 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a277667c10 con 0x55a2778ff480 2023-07-14T12:59:17.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.079+0000 7f8ed139b700 1 --2- 172.21.15.17:0/1661322936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a277913750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55a2777fa530 tx=0x7f8ec8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=206e266dbd81c8b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.079+0000 7f8eb7fff700 1 -- 172.21.15.17:0/1661322936 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8017040 con 0x55a2778ff480 2023-07-14T12:59:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.079+0000 7f8eb7fff700 1 -- 172.21.15.17:0/1661322936 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ec8018040 con 0x55a2778ff480 2023-07-14T12:59:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.079+0000 7f8eb7fff700 1 -- 172.21.15.17:0/1661322936 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec80042b0 con 0x55a2778ff480 2023-07-14T12:59:17.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.080+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1661322936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 msgr2=0x55a277913750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.080+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/1661322936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a277913750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55a2777fa530 tx=0x7f8ec8009260 comp rx=0 tx=0).stop 2023-07-14T12:59:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.080+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1661322936 shutdown_connections 2023-07-14T12:59:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.080+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/1661322936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a277900c20 0x55a277903ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.080+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/1661322936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2778ff480 0x55a277913750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.080+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/1661322936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ffdd0 0x55a277910620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.080+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1661322936 >> 172.21.15.17:0/1661322936 conn(0x55a2778f4d50 msgr2=0x55a277906fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.080+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1661322936 shutdown_connections 2023-07-14T12:59:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.080+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1661322936 wait complete. 2023-07-14T12:59:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.080+0000 7f8ee6f09b80 1 -- start start 2023-07-14T12:59:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.080+0000 7f8ee6f09b80 1 Processor -- start 2023-07-14T12:59:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ff480 0x55a27790b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2778ffdd0 0x55a27790ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ee6f09b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a277900c20 0x55a277968180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27790c0f0 con 0x55a2778ff480 2023-07-14T12:59:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2779686c0 con 0x55a277900c20 2023-07-14T12:59:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ee6f09b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a277968850 con 0x55a2778ffdd0 2023-07-14T12:59:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ee6f09b80 10 client.0 _ll_register_callbacks cb 0x7f8ebc00fed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ed139b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ff480 0x55a27790b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ed139b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ff480 0x55a27790b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35732/0 (socket says 172.21.15.17:35732) 2023-07-14T12:59:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ed139b700 1 -- 172.21.15.17:0/1702195684 learned_addr learned my addr 172.21.15.17:0/1702195684 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ed1b9c700 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a277900c20 0x55a277968180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ed0b9a700 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2778ffdd0 0x55a27790ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ed139b700 1 -- 172.21.15.17:0/1702195684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2778ffdd0 msgr2=0x55a27790ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.081+0000 7f8ed139b700 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2778ffdd0 0x55a27790ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.082+0000 7f8ed139b700 1 -- 172.21.15.17:0/1702195684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a277900c20 msgr2=0x55a277968180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.082+0000 7f8ed139b700 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a277900c20 0x55a277968180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.082+0000 7f8ed139b700 1 -- 172.21.15.17:0/1702195684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec801fa40 con 0x55a2778ff480 2023-07-14T12:59:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.082+0000 7f8ed139b700 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ff480 0x55a27790b4e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55a2778fbda0 tx=0x7f8ec8009d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62808d8b4198b876 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.082+0000 7f8eb4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.082+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/1702195684 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8004250 con 0x55a2778ff480 2023-07-14T12:59:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.082+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1702195684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ec40112c0 con 0x55a2778ff480 2023-07-14T12:59:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.082+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/1702195684 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f8ec80043b0 con 0x55a2778ff480 2023-07-14T12:59:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.082+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/1702195684 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec8004570 con 0x55a2778ff480 2023-07-14T12:59:17.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.082+0000 7f8ee6f09b80 10 client.15303 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.082+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1702195684 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55a2776a5200 con 0x55a2778ff480 2023-07-14T12:59:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.083+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/1702195684 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ec40112c0 con 0x55a2778ff480 2023-07-14T12:59:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.083+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/1702195684 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8ec802e020 con 0x55a2778ff480 2023-07-14T12:59:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.083+0000 7f8ee6f09b80 10 client.15303 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.083+0000 7f8ee6f09b80 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T12:59:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.083+0000 7f8ee6f09b80 20 client.15303 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.083+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a27796d540 0x55a277969f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:17.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.083+0000 7f8ee6f09b80 4 client.15303 mds_command: new command op to 24593 tid=0[{"prefix": "status"}] 2023-07-14T12:59:17.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.083+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1702195684 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a27780c000 con 0x55a27796d540 2023-07-14T12:59:17.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.083+0000 7f8ed0b9a700 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a27796d540 0x55a277969f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:17.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8ed0b9a700 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a27796d540 0x55a277969f40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18f92da83a64c77a server_cookie=d6da62bfdbadc25 in_seq=0 out_seq=0 2023-07-14T12:59:17.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8eb4ff9700 10 client.15303 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:17.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8eb4ff9700 1 -- 172.21.15.17:0/1702195684 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55a27780c000 con 0x55a27796d540 2023-07-14T12:59:17.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8eb4ff9700 10 client.15303 handle_command_reply: tid=0 2023-07-14T12:59:17.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8ee6f09b80 1 client.15303 shutdown 2023-07-14T12:59:17.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1702195684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ff480 msgr2=0x55a27790b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:17.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ff480 0x55a27790b4e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x55a2778fbda0 tx=0x7f8ec8009d50 comp rx=0 tx=0).stop 2023-07-14T12:59:17.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1702195684 shutdown_connections 2023-07-14T12:59:17.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a27796d540 0x55a277969f40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a277900c20 0x55a277968180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8eb4ff9700 0 client.15303 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.084+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a2778ff480 0x55a27790b4e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ee6f09b80 1 --2- 172.21.15.17:0/1702195684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2778ffdd0 0x55a27790ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1702195684 >> 172.21.15.17:0/1702195684 conn(0x55a2778f4d50 msgr2=0x55a277913750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1702195684 shutdown_connections 2023-07-14T12:59:17.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ee6f09b80 1 -- 172.21.15.17:0/1702195684 wait complete. 2023-07-14T12:59:17.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ee6f09b80 20 client.15303 trim_cache size 0 max 16384 2023-07-14T12:59:17.125 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:59:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b31a3268-2244-11ee-9b33-001a4aab830c", 2023-07-14T12:59:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2023-07-14T12:59:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 24593, 2023-07-14T12:59:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2023-07-14T12:59:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2023-07-14T12:59:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2023-07-14T12:59:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 96.908499882000001, 2023-07-14T12:59:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 22, 2023-07-14T12:59:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 88, 2023-07-14T12:59:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 86, 2023-07-14T12:59:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 103.18854827 2023-07-14T12:59:17.128 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:59:17.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ed35ff700 1 -- 172.21.15.17:0/704652610 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8eb80a11d0 msgr2=0x7f8eb80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:17.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ed35ff700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8eb80a11d0 0x7f8eb80a3680 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc005e90 tx=0x7f8ebc005dc0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ed35ff700 1 -- 172.21.15.17:0/704652610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ecc101660 msgr2=0x7f8ecc19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ed35ff700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ecc101660 0x7f8ecc19ef40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400e3c0 tx=0x7f8ec400e6d0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ed35ff700 1 -- 172.21.15.17:0/704652610 shutdown_connections 2023-07-14T12:59:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ed35ff700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8eb80a11d0 0x7f8eb80a3680 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ed35ff700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ecc101660 0x7f8ecc19ef40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ed35ff700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ecc0ffae0 0x7f8ecc197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ed35ff700 1 --2- 172.21.15.17:0/704652610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ecc100cd0 0x7f8ecc197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.085+0000 7f8ed35ff700 1 -- 172.21.15.17:0/704652610 >> 172.21.15.17:0/704652610 conn(0x7f8ecc0fb0e0 msgr2=0x7f8ecc0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.086+0000 7f8ed35ff700 1 -- 172.21.15.17:0/704652610 shutdown_connections 2023-07-14T12:59:17.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:17.086+0000 7f8ed35ff700 1 -- 172.21.15.17:0/704652610 wait complete. 2023-07-14T12:59:17.133 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-07-14T12:59:17.159 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-07-14T12:59:17.160 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-07-14T12:59:17.160 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-07-14T12:59:17.160 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T12:59:17.161 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-07-14T12:59:17.161 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-07-14T12:59:17.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:17.162 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-07-14T12:59:17.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:17.208 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-07-14T12:59:17.321 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2023-07-14T12:59:17.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T12:59:17.324 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-07-14T12:59:17.324 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph fs ls 2023-07-14T12:59:17.387 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:17 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1837782542' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:17.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:17 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1837782542' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:17.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:17 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1837782542' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:18.053 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T12:59:18.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:18 smithi135 ceph-mon[97338]: pgmap v353: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-07-14T12:59:18.491 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:18 smithi017 ceph-mon[95536]: pgmap v353: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-07-14T12:59:18.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:18 smithi131 ceph-mon[96953]: pgmap v353: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-07-14T12:59:19.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:19 smithi017 ceph-mon[95536]: pgmap v354: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2023-07-14T12:59:19.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:19 smithi135 ceph-mon[97338]: pgmap v354: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2023-07-14T12:59:19.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:19 smithi131 ceph-mon[96953]: pgmap v354: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2023-07-14T12:59:19.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.665+0000 7f3c49032700 1 -- 172.21.15.17:0/2536204552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c440728b0 msgr2=0x7f3c44072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:19.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.665+0000 7f3c49032700 1 --2- 172.21.15.17:0/2536204552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c440728b0 0x7f3c44072c80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009990 tx=0x7f3c34009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:19.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.665+0000 7f3c49032700 1 -- 172.21.15.17:0/2536204552 shutdown_connections 2023-07-14T12:59:19.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.665+0000 7f3c49032700 1 --2- 172.21.15.17:0/2536204552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4410c3e0 0x7f3c4410e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:19.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.665+0000 7f3c49032700 1 --2- 172.21.15.17:0/2536204552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c440728b0 0x7f3c44072c80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:19.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.665+0000 7f3c49032700 1 --2- 172.21.15.17:0/2536204552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c440731c0 0x7f3c4410bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:19.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.665+0000 7f3c49032700 1 -- 172.21.15.17:0/2536204552 >> 172.21.15.17:0/2536204552 conn(0x7f3c440fb660 msgr2=0x7f3c440fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:19.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.665+0000 7f3c49032700 1 -- 172.21.15.17:0/2536204552 shutdown_connections 2023-07-14T12:59:19.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.665+0000 7f3c49032700 1 -- 172.21.15.17:0/2536204552 wait complete. 2023-07-14T12:59:19.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.666+0000 7f3c49032700 1 Processor -- start 2023-07-14T12:59:19.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.666+0000 7f3c49032700 1 -- start start 2023-07-14T12:59:19.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.666+0000 7f3c49032700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c440728b0 0x7f3c44197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:19.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.666+0000 7f3c49032700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c440731c0 0x7f3c44198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:19.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.666+0000 7f3c49032700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4410c3e0 0x7f3c4419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:19.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c49032700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4419cda0 con 0x7f3c440728b0 2023-07-14T12:59:19.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c49032700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4419cf10 con 0x7f3c440731c0 2023-07-14T12:59:19.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c49032700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4419d0d0 con 0x7f3c4410c3e0 2023-07-14T12:59:19.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c42d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c440728b0 0x7f3c44197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:19.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c42d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c440728b0 0x7f3c44197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35748/0 (socket says 172.21.15.17:35748) 2023-07-14T12:59:19.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c42d9d700 1 -- 172.21.15.17:0/3005733942 learned_addr learned my addr 172.21.15.17:0/3005733942 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:19.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c4359e700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4410c3e0 0x7f3c4419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:19.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c4259c700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c440731c0 0x7f3c44198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:19.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c42d9d700 1 -- 172.21.15.17:0/3005733942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4410c3e0 msgr2=0x7f3c4419c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:19.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c42d9d700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4410c3e0 0x7f3c4419c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:19.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c42d9d700 1 -- 172.21.15.17:0/3005733942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c440731c0 msgr2=0x7f3c44198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:19.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c42d9d700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c440731c0 0x7f3c44198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:19.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c42d9d700 1 -- 172.21.15.17:0/3005733942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340095f0 con 0x7f3c440728b0 2023-07-14T12:59:19.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.667+0000 7f3c42d9d700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c440728b0 0x7f3c44197d50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3c340036c0 tx=0x7f3c34005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:19.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.668+0000 7f3c2bfff700 1 -- 172.21.15.17:0/3005733942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3401d070 con 0x7f3c440728b0 2023-07-14T12:59:19.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.668+0000 7f3c2bfff700 1 -- 172.21.15.17:0/3005733942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c34003f40 con 0x7f3c440728b0 2023-07-14T12:59:19.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.668+0000 7f3c49032700 1 -- 172.21.15.17:0/3005733942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4419d350 con 0x7f3c440728b0 2023-07-14T12:59:19.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.668+0000 7f3c2bfff700 1 -- 172.21.15.17:0/3005733942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34022c40 con 0x7f3c440728b0 2023-07-14T12:59:19.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.668+0000 7f3c49032700 1 -- 172.21.15.17:0/3005733942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c441a4b80 con 0x7f3c440728b0 2023-07-14T12:59:19.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.669+0000 7f3c49032700 1 -- 172.21.15.17:0/3005733942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4404e210 con 0x7f3c440728b0 2023-07-14T12:59:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.671+0000 7f3c2bfff700 1 -- 172.21.15.17:0/3005733942 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f3c34022470 con 0x7f3c440728b0 2023-07-14T12:59:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.672+0000 7f3c2bfff700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3c2c0a11d0 0x7f3c2c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.672+0000 7f3c2bfff700 1 -- 172.21.15.17:0/3005733942 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f3c340ce470 con 0x7f3c440728b0 2023-07-14T12:59:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.672+0000 7f3c4259c700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3c2c0a11d0 0x7f3c2c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.673+0000 7f3c4259c700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3c2c0a11d0 0x7f3c2c0a3680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3c38005fd0 tx=0x7f3c38005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:19.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.674+0000 7f3c2bfff700 1 -- 172.21.15.17:0/3005733942 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3c34097c20 con 0x7f3c440728b0 2023-07-14T12:59:19.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.926+0000 7f3c49032700 1 -- 172.21.15.17:0/3005733942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3c441a4dd0 con 0x7f3c440728b0 2023-07-14T12:59:19.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.926+0000 7f3c2bfff700 1 -- 172.21.15.17:0/3005733942 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3c34027060 con 0x7f3c440728b0 2023-07-14T12:59:19.957 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-14T12:59:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 -- 172.21.15.17:0/3005733942 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3c2c0a11d0 msgr2=0x7f3c2c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3c2c0a11d0 0x7f3c2c0a3680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3c38005fd0 tx=0x7f3c38005f60 comp rx=0 tx=0).stop 2023-07-14T12:59:19.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 -- 172.21.15.17:0/3005733942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c440728b0 msgr2=0x7f3c44197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c440728b0 0x7f3c44197d50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3c340036c0 tx=0x7f3c34005740 comp rx=0 tx=0).stop 2023-07-14T12:59:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 -- 172.21.15.17:0/3005733942 shutdown_connections 2023-07-14T12:59:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f3c2c0a11d0 0x7f3c2c0a3680 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4410c3e0 0x7f3c4419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c440728b0 0x7f3c44197d50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 --2- 172.21.15.17:0/3005733942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c440731c0 0x7f3c44198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:19.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 -- 172.21.15.17:0/3005733942 >> 172.21.15.17:0/3005733942 conn(0x7f3c440fb660 msgr2=0x7f3c4410e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 -- 172.21.15.17:0/3005733942 shutdown_connections 2023-07-14T12:59:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:19.929+0000 7f3c49032700 1 -- 172.21.15.17:0/3005733942 wait complete. 2023-07-14T12:59:20.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:20 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3005733942' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-14T12:59:20.431 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T12:59:20.431 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T12:59:20.432 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2023-07-14T12:59:20.432 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T12:59:20.432 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-07-14T12:59:20.432 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T12:59:20.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T12:59:20.433 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T12:59:20.433 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-07-14T12:59:20.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:20.434 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2023-07-14T12:59:20.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:20 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3005733942' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-14T12:59:20.479 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T12:59:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T12:59:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T12:59:20.479 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:59:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2023-07-14T12:59:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:59:20.480 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T12:59:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:59:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2023-07-14T12:59:20.480 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T12:59:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:59:20.480 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2023-07-14T12:59:20.481 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T12:59:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:59:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2023-07-14T12:59:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-14T12:59:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 41261sec preferred_lft 41261sec 2023-07-14T12:59:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link 2023-07-14T12:59:20.481 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2023-07-14T12:59:20.482 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T12:59:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2023-07-14T12:59:20.482 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2023-07-14T12:59:20.483 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-14T12:59:20.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:20.483 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-07-14T12:59:20.484 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-07-14T12:59:20.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2023-07-14T12:59:20.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2023-07-14T12:59:20.484 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2023-07-14T12:59:20.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-14T12:59:20.485 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-07-14T12:59:20.496 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:20 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3005733942' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-14T12:59:20.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:20.982 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T12:59:21.054 INFO:teuthology.orchestra.run.smithi017.stdout:1 2023-07-14T12:59:21.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:21.058 DEBUG:teuthology.orchestra.run.smithi017:> route 2023-07-14T12:59:21.120 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2023-07-14T12:59:21.120 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T12:59:21.120 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-14T12:59:21.120 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-14T12:59:21.121 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T12:59:21.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:21.122 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-07-14T12:59:21.122 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-07-14T12:59:21.122 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-14T12:59:21.123 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-14T12:59:21.123 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-14T12:59:21.123 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-07-14T12:59:21.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:21.809 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-07-14T12:59:21.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:21.854 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2023-07-14T12:59:21.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:21.938 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-07-14T12:59:21.939 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-07-14T12:59:21.939 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--tmp-cephfs 2023-07-14T12:59:21.940 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-07-14T12:59:21.940 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-07-14T12:59:22.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:21 smithi017 ceph-mon[95536]: pgmap v355: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2023-07-14T12:59:22.126 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-07-14T12:59:22.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:22.127 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-07-14T12:59:22.127 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-07-14T12:59:22.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-07-14T12:59:22.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-14T12:59:22.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-07-14T12:59:22.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-07-14T12:59:22.128 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-07-14T12:59:22.128 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-07-14T12:59:22.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:21 smithi131 ceph-mon[96953]: pgmap v355: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2023-07-14T12:59:22.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:22.417 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2023-07-14T12:59:22.417 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2023-07-14T12:59:22.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2023-07-14T12:59:22.418 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2023-07-14T12:59:22.418 DEBUG:teuthology.orchestra.run.smithi017:> ') 2023-07-14T12:59:22.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:21 smithi135 ceph-mon[97338]: pgmap v355: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2023-07-14T12:59:22.595 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-07-14T12:59:22.595 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:59:22.595 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /tmp/cephfs 2023-07-14T12:59:22.639 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/tmp/cephfs' 2023-07-14T12:59:22.639 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T12:59:22.639 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /tmp/cephfs 2023-07-14T12:59:22.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2023-07-14T12:59:22.831 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-14T12:59:22.832 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-14T12:59:22.901 INFO:teuthology.orchestra.run.smithi017.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-14T12:59:22.903 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-14T12:59:22.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:22.905 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2023-07-14T12:59:22.949 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-14T12:59:22.949 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2023-07-14T12:59:22.993 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2023-07-14T12:59:23.066 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-14T12:59:23.066 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-14T12:59:23.137 INFO:teuthology.orchestra.run.smithi017.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-14T12:59:23.140 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-14T12:59:23.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:23.141 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2023-07-14T12:59:23.209 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2023-07-14T12:59:23.180+0000 7f6500d405c0 -1 init, newargv = 0x564a7638b320 newargc=17 2023-07-14T12:59:23.210 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[142901]: starting ceph client 2023-07-14T12:59:23.232 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[142901]: starting fuse 2023-07-14T12:59:24.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:23 smithi017 ceph-mon[95536]: pgmap v356: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2023-07-14T12:59:24.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:23 smithi131 ceph-mon[96953]: pgmap v356: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2023-07-14T12:59:24.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2023-07-14T12:59:24.372 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-14T12:59:24.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-14T12:59:24.443 INFO:teuthology.orchestra.run.smithi017.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-14T12:59:24.446 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-14T12:59:24.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:24.447 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2023-07-14T12:59:24.447 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:23 smithi135 ceph-mon[97338]: pgmap v356: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2023-07-14T12:59:24.490 INFO:teuthology.orchestra.run.smithi017.stdout:121 2023-07-14T12:59:24.491 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-07-14T12:59:24.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-14T12:59:24.492 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2023-07-14T12:59:24.492 DEBUG:teuthology.orchestra.run.smithi017:> import re 2023-07-14T12:59:24.493 DEBUG:teuthology.orchestra.run.smithi017:> import os 2023-07-14T12:59:24.493 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2023-07-14T12:59:24.493 DEBUG:teuthology.orchestra.run.smithi017:> 2023-07-14T12:59:24.493 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2023-07-14T12:59:24.493 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-14T12:59:24.494 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2023-07-14T12:59:24.494 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/tmp/cephfs" 2023-07-14T12:59:24.494 DEBUG:teuthology.orchestra.run.smithi017:> 2023-07-14T12:59:24.494 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2023-07-14T12:59:24.495 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2023-07-14T12:59:24.495 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2023-07-14T12:59:24.495 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2023-07-14T12:59:24.495 DEBUG:teuthology.orchestra.run.smithi017:> 2023-07-14T12:59:24.496 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2023-07-14T12:59:24.496 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-14T12:59:24.496 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-14T12:59:24.496 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-14T12:59:24.496 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2023-07-14T12:59:24.497 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2023-07-14T12:59:24.497 DEBUG:teuthology.orchestra.run.smithi017:> return f 2023-07-14T12:59:24.497 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-14T12:59:24.497 DEBUG:teuthology.orchestra.run.smithi017:> 2023-07-14T12:59:24.498 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2023-07-14T12:59:24.498 DEBUG:teuthology.orchestra.run.smithi017:> ' 2023-07-14T12:59:24.677 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.142901.asok 2023-07-14T12:59:24.853 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.142901.asok 2023-07-14T12:59:24.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:24.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.142901.asok status 2023-07-14T12:59:25.085 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:59:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2023-07-14T12:59:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "3fc0089cc1082313a98853d48b892acdc1385b8b", 2023-07-14T12:59:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 18.0.0-4757-g3fc0089c (3fc0089cc1082313a98853d48b892acdc1385b8b) reef (dev)", 2023-07-14T12:59:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2023-07-14T12:59:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2023-07-14T12:59:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/tmp/cephfs", 2023-07-14T12:59:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "142901", 2023-07-14T12:59:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3" 2023-07-14T12:59:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T12:59:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2023-07-14T12:59:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2023-07-14T12:59:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 15315, 2023-07-14T12:59:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2023-07-14T12:59:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2023-07-14T12:59:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2023-07-14T12:59:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 15315 2023-07-14T12:59:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T12:59:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2023-07-14T12:59:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-07-14T12:59:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2023-07-14T12:59:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2059009231 2023-07-14T12:59:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T12:59:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T12:59:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2023-07-14T12:59:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-07-14T12:59:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2023-07-14T12:59:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 2059009231 2023-07-14T12:59:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T12:59:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.15315 192.168.0.1:0/2059009231", 2023-07-14T12:59:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/2059009231", 2023-07-14T12:59:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 5, 2023-07-14T12:59:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 22, 2023-07-14T12:59:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 88, 2023-07-14T12:59:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2023-07-14T12:59:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2023-07-14T12:59:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2023-07-14T12:59:25.091 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:59:25.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:25.100 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2023-07-14T12:59:25.101 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /tmp/cephfs 2023-07-14T12:59:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2023-07-14T12:59:25.147 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2023-07-14T12:59:25.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T12:59:25.148 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /tmp/cephfs 2023-07-14T12:59:25.219 INFO:teuthology.run_tasks:Running task check-counter... 2023-07-14T12:59:25.231 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-07-14T12:59:25.242 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:59:25.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.414+0000 7fb866bff700 1 -- 172.21.15.17:0/429329270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb860101680 msgr2=0x7fb860107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:25.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.414+0000 7fb866bff700 1 --2- 172.21.15.17:0/429329270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb860101680 0x7fb860107f40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb85800b0a0 tx=0x7fb85800b3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.415+0000 7fb866bff700 1 -- 172.21.15.17:0/429329270 shutdown_connections 2023-07-14T12:59:25.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.415+0000 7fb866bff700 1 --2- 172.21.15.17:0/429329270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb860101680 0x7fb860107f40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.415+0000 7fb866bff700 1 --2- 172.21.15.17:0/429329270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8600ffb00 0x7fb8600fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.415+0000 7fb866bff700 1 --2- 172.21.15.17:0/429329270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860100cf0 0x7fb860101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.415+0000 7fb866bff700 1 -- 172.21.15.17:0/429329270 >> 172.21.15.17:0/429329270 conn(0x7fb8600fb0e0 msgr2=0x7fb8600fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:25.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.415+0000 7fb866bff700 1 -- 172.21.15.17:0/429329270 shutdown_connections 2023-07-14T12:59:25.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.415+0000 7fb866bff700 1 -- 172.21.15.17:0/429329270 wait complete. 2023-07-14T12:59:25.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.416+0000 7fb866bff700 1 Processor -- start 2023-07-14T12:59:25.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.416+0000 7fb866bff700 1 -- start start 2023-07-14T12:59:25.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.417+0000 7fb866bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8600ffb00 0x7fb8600742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:25.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.417+0000 7fb866bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860100cf0 0x7fb860072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:25.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.417+0000 7fb866bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb860101680 0x7fb860072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:25.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.417+0000 7fb866bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600735e0 con 0x7fb860101680 2023-07-14T12:59:25.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.417+0000 7fb866bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860073750 con 0x7fb8600ffb00 2023-07-14T12:59:25.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.417+0000 7fb866bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86019f830 con 0x7fb860100cf0 2023-07-14T12:59:25.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.417+0000 7fb86519c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb860101680 0x7fb860072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:25.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.417+0000 7fb86499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8600ffb00 0x7fb8600742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:25.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.417+0000 7fb86519c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb860101680 0x7fb860072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51684/0 (socket says 172.21.15.17:51684) 2023-07-14T12:59:25.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.417+0000 7fb86519c700 1 -- 172.21.15.17:0/1782529959 learned_addr learned my addr 172.21.15.17:0/1782529959 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:25.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.417+0000 7fb85ffff700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860100cf0 0x7fb860072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:25.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb86519c700 1 -- 172.21.15.17:0/1782529959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860100cf0 msgr2=0x7fb860072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:25.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb86519c700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860100cf0 0x7fb860072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb86519c700 1 -- 172.21.15.17:0/1782529959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8600ffb00 msgr2=0x7fb8600742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:25.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb86519c700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8600ffb00 0x7fb8600742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb86519c700 1 -- 172.21.15.17:0/1782529959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858009d00 con 0x7fb860101680 2023-07-14T12:59:25.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb86499b700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8600ffb00 0x7fb8600742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:25.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb86519c700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb860101680 0x7fb860072e40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb85800bad0 tx=0x7fb85800bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:25.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb85dffb700 1 -- 172.21.15.17:0/1782529959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800e040 con 0x7fb860101680 2023-07-14T12:59:25.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb85dffb700 1 -- 172.21.15.17:0/1782529959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb858003c00 con 0x7fb860101680 2023-07-14T12:59:25.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb866bff700 1 -- 172.21.15.17:0/1782529959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86019fab0 con 0x7fb860101680 2023-07-14T12:59:25.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb85dffb700 1 -- 172.21.15.17:0/1782529959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580052a0 con 0x7fb860101680 2023-07-14T12:59:25.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.418+0000 7fb866bff700 1 -- 172.21.15.17:0/1782529959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86019ff30 con 0x7fb860101680 2023-07-14T12:59:25.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.419+0000 7fb866bff700 1 -- 172.21.15.17:0/1782529959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb860107050 con 0x7fb860101680 2023-07-14T12:59:25.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.421+0000 7fb85dffb700 1 -- 172.21.15.17:0/1782529959 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fb85801d470 con 0x7fb860101680 2023-07-14T12:59:25.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.423+0000 7fb85dffb700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8500a11a0 0x7fb8500a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.423+0000 7fb85dffb700 1 -- 172.21.15.17:0/1782529959 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fb8580cda40 con 0x7fb860101680 2023-07-14T12:59:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.423+0000 7fb86499b700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8500a11a0 0x7fb8500a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.424+0000 7fb86499b700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8500a11a0 0x7fb8500a3650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb860100b50 tx=0x7fb854009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.427+0000 7fb85dffb700 1 -- 172.21.15.17:0/1782529959 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb8580971f0 con 0x7fb860101680 2023-07-14T12:59:25.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.636+0000 7fb866bff700 1 -- 172.21.15.17:0/1782529959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb86002c850 con 0x7fb860101680 2023-07-14T12:59:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.637+0000 7fb85dffb700 1 -- 172.21.15.17:0/1782529959 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22469 (secure 0 0 0) 0x7fb858024350 con 0x7fb860101680 2023-07-14T12:59:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:25.668 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":88,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:58:07.945460+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:59:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 -- 172.21.15.17:0/1782529959 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8500a11a0 msgr2=0x7fb8500a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8500a11a0 0x7fb8500a3650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb860100b50 tx=0x7fb854009260 comp rx=0 tx=0).stop 2023-07-14T12:59:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 -- 172.21.15.17:0/1782529959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb860101680 msgr2=0x7fb860072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb860101680 0x7fb860072e40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb85800bad0 tx=0x7fb85800bb00 comp rx=0 tx=0).stop 2023-07-14T12:59:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 -- 172.21.15.17:0/1782529959 shutdown_connections 2023-07-14T12:59:25.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fb8500a11a0 0x7fb8500a3650 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb860101680 0x7fb860072e40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8600ffb00 0x7fb8600742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 --2- 172.21.15.17:0/1782529959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860100cf0 0x7fb860072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 -- 172.21.15.17:0/1782529959 >> 172.21.15.17:0/1782529959 conn(0x7fb8600fb0e0 msgr2=0x7fb860104190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 -- 172.21.15.17:0/1782529959 shutdown_connections 2023-07-14T12:59:25.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.640+0000 7fb866bff700 1 -- 172.21.15.17:0/1782529959 wait complete. 2023-07-14T12:59:25.688 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:57:37.876360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:57:39.117456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:59:25.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:59:25.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.864+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/2604283036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6c8101660 msgr2=0x7fa6c8107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:25.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.864+0000 7fa6ce5ff700 1 --2- 172.21.15.17:0/2604283036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6c8101660 0x7fa6c8107f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009990 tx=0x7fa6c0009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.864+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/2604283036 shutdown_connections 2023-07-14T12:59:25.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.864+0000 7fa6ce5ff700 1 --2- 172.21.15.17:0/2604283036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6c8101660 0x7fa6c8107f20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.864+0000 7fa6ce5ff700 1 --2- 172.21.15.17:0/2604283036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c80ffae0 0x7fa6c80ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.864+0000 7fa6ce5ff700 1 --2- 172.21.15.17:0/2604283036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c8100cd0 0x7fa6c8101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.864+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/2604283036 >> 172.21.15.17:0/2604283036 conn(0x7fa6c80fb0e0 msgr2=0x7fa6c80fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:25.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.864+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/2604283036 shutdown_connections 2023-07-14T12:59:25.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.865+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/2604283036 wait complete. 2023-07-14T12:59:25.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.865+0000 7fa6ce5ff700 1 Processor -- start 2023-07-14T12:59:25.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6ce5ff700 1 -- start start 2023-07-14T12:59:25.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6ce5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c80ffae0 0x7fa6c8197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:25.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6ce5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c8100cd0 0x7fa6c8197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:25.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6ce5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6c8101660 0x7fa6c819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:25.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6ce5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c819f4b0 con 0x7fa6c8101660 2023-07-14T12:59:25.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6ce5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c819f5f0 con 0x7fa6c80ffae0 2023-07-14T12:59:25.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6ce5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c819f780 con 0x7fa6c8100cd0 2023-07-14T12:59:25.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6ccb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6c8101660 0x7fa6c819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:25.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6c7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c80ffae0 0x7fa6c8197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:25.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6ccb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6c8101660 0x7fa6c819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51710/0 (socket says 172.21.15.17:51710) 2023-07-14T12:59:25.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6ccb9c700 1 -- 172.21.15.17:0/412705077 learned_addr learned my addr 172.21.15.17:0/412705077 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:25.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.866+0000 7fa6c77fe700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c8100cd0 0x7fa6c8197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:25.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6ccb9c700 1 -- 172.21.15.17:0/412705077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c8100cd0 msgr2=0x7fa6c8197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:25.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6ccb9c700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c8100cd0 0x7fa6c8197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6ccb9c700 1 -- 172.21.15.17:0/412705077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c80ffae0 msgr2=0x7fa6c8197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:25.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6ccb9c700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c80ffae0 0x7fa6c8197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:25.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6ccb9c700 1 -- 172.21.15.17:0/412705077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c00095f0 con 0x7fa6c8101660 2023-07-14T12:59:25.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6c7fff700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c80ffae0 0x7fa6c8197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:25.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6ccb9c700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6c8101660 0x7fa6c819eee0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0003ec0 tx=0x7fa6c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:25.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6c57fa700 1 -- 172.21.15.17:0/412705077 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c001d070 con 0x7fa6c8101660 2023-07-14T12:59:25.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6c57fa700 1 -- 172.21.15.17:0/412705077 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6c000bd50 con 0x7fa6c8101660 2023-07-14T12:59:25.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6c57fa700 1 -- 172.21.15.17:0/412705077 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0005280 con 0x7fa6c8101660 2023-07-14T12:59:25.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/412705077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c819fa00 con 0x7fa6c8101660 2023-07-14T12:59:25.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.867+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/412705077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c819fdc0 con 0x7fa6c8101660 2023-07-14T12:59:25.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.868+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/412705077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c8192080 con 0x7fa6c8101660 2023-07-14T12:59:25.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.870+0000 7fa6c57fa700 1 -- 172.21.15.17:0/412705077 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa6c000b8c0 con 0x7fa6c8101660 2023-07-14T12:59:25.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.872+0000 7fa6c57fa700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa6b00a11d0 0x7fa6b00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:25.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.872+0000 7fa6c57fa700 1 -- 172.21.15.17:0/412705077 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa6c00cdb50 con 0x7fa6c8101660 2023-07-14T12:59:25.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.872+0000 7fa6c7fff700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa6b00a11d0 0x7fa6b00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:25.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.873+0000 7fa6c7fff700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa6b00a11d0 0x7fa6b00a3680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8100b30 tx=0x7fa6b800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:25.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:25.875+0000 7fa6c57fa700 1 -- 172.21.15.17:0/412705077 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa6c005b790 con 0x7fa6c8101660 2023-07-14T12:59:26.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.086+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/412705077 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6c8061120 con 0x7fa6c8101660 2023-07-14T12:59:26.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.086+0000 7fa6c57fa700 1 -- 172.21.15.17:0/412705077 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6c0097300 con 0x7fa6c8101660 2023-07-14T12:59:26.116 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T12:59:26.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/412705077 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa6b00a11d0 msgr2=0x7fa6b00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:26.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa6b00a11d0 0x7fa6b00a3680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8100b30 tx=0x7fa6b800b040 comp rx=0 tx=0).stop 2023-07-14T12:59:26.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/412705077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6c8101660 msgr2=0x7fa6c819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:26.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6c8101660 0x7fa6c819eee0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0003ec0 tx=0x7fa6c0004730 comp rx=0 tx=0).stop 2023-07-14T12:59:26.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/412705077 shutdown_connections 2023-07-14T12:59:26.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa6b00a11d0 0x7fa6b00a3680 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6c8101660 0x7fa6c819eee0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6c80ffae0 0x7fa6c8197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 --2- 172.21.15.17:0/412705077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6c8100cd0 0x7fa6c8197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/412705077 >> 172.21.15.17:0/412705077 conn(0x7fa6c80fb0e0 msgr2=0x7fa6c81065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:26.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/412705077 shutdown_connections 2023-07-14T12:59:26.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.089+0000 7fa6ce5ff700 1 -- 172.21.15.17:0/412705077 wait complete. 2023-07-14T12:59:26.137 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:59:26.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:25 smithi131 ceph-mon[96953]: pgmap v357: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2023-07-14T12:59:26.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:25 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1782529959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:26.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.313+0000 7f5e41fff700 1 -- 172.21.15.17:0/1606590365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e3c100cd0 msgr2=0x7f5e3c101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:26.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.313+0000 7f5e41fff700 1 --2- 172.21.15.17:0/1606590365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e3c100cd0 0x7f5e3c101120 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009990 tx=0x7f5e30009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.313+0000 7f5e41fff700 1 -- 172.21.15.17:0/1606590365 shutdown_connections 2023-07-14T12:59:26.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.313+0000 7f5e41fff700 1 --2- 172.21.15.17:0/1606590365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c101660 0x7f5e3c107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.313+0000 7f5e41fff700 1 --2- 172.21.15.17:0/1606590365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e3c0ffae0 0x7f5e3c0ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.313+0000 7f5e41fff700 1 --2- 172.21.15.17:0/1606590365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e3c100cd0 0x7f5e3c101120 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.313+0000 7f5e41fff700 1 -- 172.21.15.17:0/1606590365 >> 172.21.15.17:0/1606590365 conn(0x7f5e3c0fb0e0 msgr2=0x7f5e3c0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:26.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.313+0000 7f5e41fff700 1 -- 172.21.15.17:0/1606590365 shutdown_connections 2023-07-14T12:59:26.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.313+0000 7f5e41fff700 1 -- 172.21.15.17:0/1606590365 wait complete. 2023-07-14T12:59:26.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.314+0000 7f5e41fff700 1 Processor -- start 2023-07-14T12:59:26.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.315+0000 7f5e41fff700 1 -- start start 2023-07-14T12:59:26.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.315+0000 7f5e41fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e3c0ffae0 0x7f5e3c0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:26.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.315+0000 7f5e41fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c100cd0 0x7f5e3c072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:26.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.315+0000 7f5e41fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e3c101660 0x7f5e3c072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:26.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.315+0000 7f5e41fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0735e0 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.315+0000 7f5e41fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c073750 con 0x7f5e3c101660 2023-07-14T12:59:26.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.315+0000 7f5e41fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c19f800 con 0x7f5e3c100cd0 2023-07-14T12:59:26.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.315+0000 7f5e3b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e3c0ffae0 0x7f5e3c0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.315+0000 7f5e3b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e3c0ffae0 0x7f5e3c0742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51724/0 (socket says 172.21.15.17:51724) 2023-07-14T12:59:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.315+0000 7f5e3b7fe700 1 -- 172.21.15.17:0/1868418985 learned_addr learned my addr 172.21.15.17:0/1868418985 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.315+0000 7f5e3affd700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c100cd0 0x7f5e3c072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e3bfff700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e3c101660 0x7f5e3c072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e3b7fe700 1 -- 172.21.15.17:0/1868418985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c100cd0 msgr2=0x7f5e3c072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e3b7fe700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c100cd0 0x7f5e3c072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e3b7fe700 1 -- 172.21.15.17:0/1868418985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e3c101660 msgr2=0x7f5e3c072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e3b7fe700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e3c101660 0x7f5e3c072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e3b7fe700 1 -- 172.21.15.17:0/1868418985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300095f0 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e3b7fe700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e3c0ffae0 0x7f5e3c0742c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00e970 tx=0x7f5e2c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e38ff9700 1 -- 172.21.15.17:0/1868418985 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c009790 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e38ff9700 1 -- 172.21.15.17:0/1868418985 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e2c00eec0 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e41fff700 1 -- 172.21.15.17:0/1868418985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c19fae0 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e38ff9700 1 -- 172.21.15.17:0/1868418985 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c003c10 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.316+0000 7f5e41fff700 1 -- 172.21.15.17:0/1868418985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c1a0040 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.317+0000 7f5e41fff700 1 -- 172.21.15.17:0/1868418985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c106ac0 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.319+0000 7f5e38ff9700 1 -- 172.21.15.17:0/1868418985 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f5e2c003d90 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.321+0000 7f5e38ff9700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5e240a11d0 0x7f5e240a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.321+0000 7f5e38ff9700 1 -- 172.21.15.17:0/1868418985 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f5e2c014070 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.321+0000 7f5e3affd700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5e240a11d0 0x7f5e240a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:26.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.322+0000 7f5e3affd700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5e240a11d0 0x7f5e240a3680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e30006010 tx=0x7f5e3000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:26.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.323+0000 7f5e38ff9700 1 -- 172.21.15.17:0/1868418985 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f5e2c0963a0 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:25 smithi017 ceph-mon[95536]: pgmap v357: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2023-07-14T12:59:26.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:25 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1782529959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:26.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:25 smithi135 ceph-mon[97338]: pgmap v357: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2023-07-14T12:59:26.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:25 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1782529959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:26.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.532+0000 7f5e41fff700 1 -- 172.21.15.17:0/1868418985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e3c02c850 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.533+0000 7f5e38ff9700 1 -- 172.21.15.17:0/1868418985 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e2c0999c0 con 0x7f5e3c0ffae0 2023-07-14T12:59:26.563 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-07-14T12:59:26.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 -- 172.21.15.17:0/1868418985 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5e240a11d0 msgr2=0x7f5e240a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:26.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5e240a11d0 0x7f5e240a3680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e30006010 tx=0x7f5e3000b260 comp rx=0 tx=0).stop 2023-07-14T12:59:26.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 -- 172.21.15.17:0/1868418985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e3c0ffae0 msgr2=0x7f5e3c0742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e3c0ffae0 0x7f5e3c0742c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00e970 tx=0x7f5e2c00ec80 comp rx=0 tx=0).stop 2023-07-14T12:59:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 -- 172.21.15.17:0/1868418985 shutdown_connections 2023-07-14T12:59:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f5e240a11d0 0x7f5e240a3680 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5e3c101660 0x7f5e3c072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5e3c0ffae0 0x7f5e3c0742c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 --2- 172.21.15.17:0/1868418985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e3c100cd0 0x7f5e3c072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 -- 172.21.15.17:0/1868418985 >> 172.21.15.17:0/1868418985 conn(0x7f5e3c0fb0e0 msgr2=0x7f5e3c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 -- 172.21.15.17:0/1868418985 shutdown_connections 2023-07-14T12:59:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.535+0000 7f5e41fff700 1 -- 172.21.15.17:0/1868418985 wait complete. 2023-07-14T12:59:26.584 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:59:26.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.759+0000 7f090e5ff700 1 -- 172.21.15.17:0/1114061632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09080ffae0 msgr2=0x7f09080ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:26.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.759+0000 7f090e5ff700 1 --2- 172.21.15.17:0/1114061632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09080ffae0 0x7f09080ffef0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009990 tx=0x7f08f8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.759+0000 7f090e5ff700 1 -- 172.21.15.17:0/1114061632 shutdown_connections 2023-07-14T12:59:26.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.759+0000 7f090e5ff700 1 --2- 172.21.15.17:0/1114061632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0908101660 0x7f0908107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.759+0000 7f090e5ff700 1 --2- 172.21.15.17:0/1114061632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09080ffae0 0x7f09080ffef0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.759+0000 7f090e5ff700 1 --2- 172.21.15.17:0/1114061632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0908100cd0 0x7f0908101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.759+0000 7f090e5ff700 1 -- 172.21.15.17:0/1114061632 >> 172.21.15.17:0/1114061632 conn(0x7f09080fb0e0 msgr2=0x7f09080fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:26.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.759+0000 7f090e5ff700 1 -- 172.21.15.17:0/1114061632 shutdown_connections 2023-07-14T12:59:26.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.759+0000 7f090e5ff700 1 -- 172.21.15.17:0/1114061632 wait complete. 2023-07-14T12:59:26.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.760+0000 7f090e5ff700 1 Processor -- start 2023-07-14T12:59:26.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.761+0000 7f090e5ff700 1 -- start start 2023-07-14T12:59:26.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.761+0000 7f090e5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09080ffae0 0x7f09080742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:26.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.761+0000 7f090e5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0908100cd0 0x7f0908072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:26.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.761+0000 7f090e5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0908101660 0x7f0908072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:26.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.761+0000 7f090e5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080735e0 con 0x7f0908101660 2023-07-14T12:59:26.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.761+0000 7f090e5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908073750 con 0x7f0908100cd0 2023-07-14T12:59:26.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.761+0000 7f090e5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090819f800 con 0x7f09080ffae0 2023-07-14T12:59:26.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.761+0000 7f090cb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0908101660 0x7f0908072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:26.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.761+0000 7f090cb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0908101660 0x7f0908072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51734/0 (socket says 172.21.15.17:51734) 2023-07-14T12:59:26.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.761+0000 7f090cb9c700 1 -- 172.21.15.17:0/3943706239 learned_addr learned my addr 172.21.15.17:0/3943706239 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:26.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f09077fe700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0908100cd0 0x7f0908072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:26.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f0907fff700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09080ffae0 0x7f09080742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:26.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f090cb9c700 1 -- 172.21.15.17:0/3943706239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09080ffae0 msgr2=0x7f09080742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:26.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f090cb9c700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09080ffae0 0x7f09080742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f090cb9c700 1 -- 172.21.15.17:0/3943706239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0908100cd0 msgr2=0x7f0908072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:26.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f090cb9c700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0908100cd0 0x7f0908072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:26.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f090cb9c700 1 -- 172.21.15.17:0/3943706239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80095f0 con 0x7f0908101660 2023-07-14T12:59:26.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f090cb9c700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0908101660 0x7f0908072e40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0900007ee0 tx=0x7f090000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:26.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f09057fa700 1 -- 172.21.15.17:0/3943706239 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900017070 con 0x7f0908101660 2023-07-14T12:59:26.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f090e5ff700 1 -- 172.21.15.17:0/3943706239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090819fae0 con 0x7f0908101660 2023-07-14T12:59:26.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f09057fa700 1 -- 172.21.15.17:0/3943706239 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f090000f040 con 0x7f0908101660 2023-07-14T12:59:26.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.762+0000 7f09057fa700 1 -- 172.21.15.17:0/3943706239 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900005570 con 0x7f0908101660 2023-07-14T12:59:26.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.763+0000 7f090e5ff700 1 -- 172.21.15.17:0/3943706239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090819fff0 con 0x7f0908101660 2023-07-14T12:59:26.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.764+0000 7f090e5ff700 1 -- 172.21.15.17:0/3943706239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0908106ac0 con 0x7f0908101660 2023-07-14T12:59:26.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.765+0000 7f09057fa700 1 -- 172.21.15.17:0/3943706239 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f090000db20 con 0x7f0908101660 2023-07-14T12:59:26.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.767+0000 7f09057fa700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f00a1150 0x7f08f00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:26.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.767+0000 7f09057fa700 1 -- 172.21.15.17:0/3943706239 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f09000cc010 con 0x7f0908101660 2023-07-14T12:59:26.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.768+0000 7f0907fff700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f00a1150 0x7f08f00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:26.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.768+0000 7f0907fff700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f00a1150 0x7f08f00a3600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f08f80098e0 tx=0x7f08f800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:26.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.771+0000 7f09057fa700 1 -- 172.21.15.17:0/3943706239 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0900095790 con 0x7f0908101660 2023-07-14T12:59:27.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.981+0000 7f090e5ff700 1 -- 172.21.15.17:0/3943706239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09080611c0 con 0x7f0908101660 2023-07-14T12:59:27.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.982+0000 7f09057fa700 1 -- 172.21.15.17:0/3943706239 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0900098db0 con 0x7f0908101660 2023-07-14T12:59:27.012 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-07-14T12:59:27.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 -- 172.21.15.17:0/3943706239 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f00a1150 msgr2=0x7f08f00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f00a1150 0x7f08f00a3600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f08f80098e0 tx=0x7f08f800b260 comp rx=0 tx=0).stop 2023-07-14T12:59:27.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 -- 172.21.15.17:0/3943706239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0908101660 msgr2=0x7f0908072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0908101660 0x7f0908072e40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0900007ee0 tx=0x7f090000d3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 -- 172.21.15.17:0/3943706239 shutdown_connections 2023-07-14T12:59:27.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f08f00a1150 0x7f08f00a3600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0908101660 0x7f0908072e40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09080ffae0 0x7f09080742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 --2- 172.21.15.17:0/3943706239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0908100cd0 0x7f0908072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 -- 172.21.15.17:0/3943706239 >> 172.21.15.17:0/3943706239 conn(0x7f09080fb0e0 msgr2=0x7f09080fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:27.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 -- 172.21.15.17:0/3943706239 shutdown_connections 2023-07-14T12:59:27.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:26.984+0000 7f090e5ff700 1 -- 172.21.15.17:0/3943706239 wait complete. 2023-07-14T12:59:27.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:59:27.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.206+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/940755512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb4101680 msgr2=0x7f7cb4107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.206+0000 7f7cbc7ff700 1 --2- 172.21.15.17:0/940755512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb4101680 0x7f7cb4107f40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00b0a0 tx=0x7f7cac00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.206+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/940755512 shutdown_connections 2023-07-14T12:59:27.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.206+0000 7f7cbc7ff700 1 --2- 172.21.15.17:0/940755512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb4101680 0x7f7cb4107f40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.206+0000 7f7cbc7ff700 1 --2- 172.21.15.17:0/940755512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cb40ffb00 0x7f7cb40fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.206+0000 7f7cbc7ff700 1 --2- 172.21.15.17:0/940755512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb4100cf0 0x7f7cb4101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.206+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/940755512 >> 172.21.15.17:0/940755512 conn(0x7f7cb40fb0e0 msgr2=0x7f7cb40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:27.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.206+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/940755512 shutdown_connections 2023-07-14T12:59:27.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.206+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/940755512 wait complete. 2023-07-14T12:59:27.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.207+0000 7f7cbc7ff700 1 Processor -- start 2023-07-14T12:59:27.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.207+0000 7f7cbc7ff700 1 -- start start 2023-07-14T12:59:27.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.207+0000 7f7cbc7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cb40ffb00 0x7f7cb40742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:27.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.207+0000 7f7cbc7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb4100cf0 0x7f7cb4072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:27.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.207+0000 7f7cbc7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb4101680 0x7f7cb4072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:27.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.207+0000 7f7cbc7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40735e0 con 0x7f7cb4100cf0 2023-07-14T12:59:27.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.207+0000 7f7cbc7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb4073750 con 0x7f7cb40ffb00 2023-07-14T12:59:27.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.207+0000 7f7cbc7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb419f8e0 con 0x7f7cb4101680 2023-07-14T12:59:27.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cb9d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb4100cf0 0x7f7cb4072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:27.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cb9d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb4100cf0 0x7f7cb4072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51756/0 (socket says 172.21.15.17:51756) 2023-07-14T12:59:27.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cb9d9a700 1 -- 172.21.15.17:0/2567231300 learned_addr learned my addr 172.21.15.17:0/2567231300 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cba59b700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cb40ffb00 0x7f7cb40742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cbad9c700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb4101680 0x7f7cb4072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cb9d9a700 1 -- 172.21.15.17:0/2567231300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb4101680 msgr2=0x7f7cb4072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cb9d9a700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb4101680 0x7f7cb4072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cb9d9a700 1 -- 172.21.15.17:0/2567231300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cb40ffb00 msgr2=0x7f7cb40742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cb9d9a700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cb40ffb00 0x7f7cb40742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cb9d9a700 1 -- 172.21.15.17:0/2567231300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac009d00 con 0x7f7cb4100cf0 2023-07-14T12:59:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cbad9c700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb4101680 0x7f7cb4072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.208+0000 7f7cb9d9a700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb4100cf0 0x7f7cb4072900 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400e9a0 tx=0x7f7ca400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.209+0000 7f7cab7fe700 1 -- 172.21.15.17:0/2567231300 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4009790 con 0x7f7cb4100cf0 2023-07-14T12:59:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.209+0000 7f7cab7fe700 1 -- 172.21.15.17:0/2567231300 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ca400cbd0 con 0x7f7cb4100cf0 2023-07-14T12:59:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.209+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/2567231300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb419fbc0 con 0x7f7cb4100cf0 2023-07-14T12:59:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.209+0000 7f7cab7fe700 1 -- 172.21.15.17:0/2567231300 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4018680 con 0x7f7cb4100cf0 2023-07-14T12:59:27.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.209+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/2567231300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb41a0120 con 0x7f7cb4100cf0 2023-07-14T12:59:27.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.210+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/2567231300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb410b1e0 con 0x7f7cb4100cf0 2023-07-14T12:59:27.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.212+0000 7f7cab7fe700 1 -- 172.21.15.17:0/2567231300 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f7ca400cd40 con 0x7f7cb4100cf0 2023-07-14T12:59:27.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.213+0000 7f7cab7fe700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ca00a1220 0x7f7ca00a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:27.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.213+0000 7f7cab7fe700 1 -- 172.21.15.17:0/2567231300 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f7ca4014070 con 0x7f7cb4100cf0 2023-07-14T12:59:27.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.213+0000 7f7cba59b700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ca00a1220 0x7f7ca00a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:27.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.214+0000 7f7cba59b700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ca00a1220 0x7f7ca00a36d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4100b50 tx=0x7f7cb0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:27.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:26 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/412705077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:27.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:26 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1868418985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:27.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.217+0000 7f7cab7fe700 1 -- 172.21.15.17:0/2567231300 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7ca4051790 con 0x7f7cb4100cf0 2023-07-14T12:59:27.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:26 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/412705077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:27.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:26 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1868418985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:27.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:26 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/412705077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:27.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:26 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1868418985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:27.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.427+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/2567231300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cb410b400 con 0x7f7cb4100cf0 2023-07-14T12:59:27.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.429+0000 7f7cab7fe700 1 -- 172.21.15.17:0/2567231300 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22469 (secure 0 0 0) 0x7f7ca4096250 con 0x7f7cb4100cf0 2023-07-14T12:59:27.459 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:27.459 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":88,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:58:07.945460+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:59:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/2567231300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ca00a1220 msgr2=0x7f7ca00a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ca00a1220 0x7f7ca00a36d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4100b50 tx=0x7f7cb0009260 comp rx=0 tx=0).stop 2023-07-14T12:59:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/2567231300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb4100cf0 msgr2=0x7f7cb4072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb4100cf0 0x7f7cb4072900 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400e9a0 tx=0x7f7ca400ecb0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/2567231300 shutdown_connections 2023-07-14T12:59:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f7ca00a1220 0x7f7ca00a36d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb4101680 0x7f7cb4072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7cb40ffb00 0x7f7cb40742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 --2- 172.21.15.17:0/2567231300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cb4100cf0 0x7f7cb4072900 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/2567231300 >> 172.21.15.17:0/2567231300 conn(0x7f7cb40fb0e0 msgr2=0x7f7cb40fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:27.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/2567231300 shutdown_connections 2023-07-14T12:59:27.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.431+0000 7f7cbc7ff700 1 -- 172.21.15.17:0/2567231300 wait complete. 2023-07-14T12:59:27.480 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:57:37.876360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:57:39.117456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:59:27.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:59:27.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.657+0000 7f0a479ff700 1 -- 172.21.15.17:0/3060339408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a400ffae0 msgr2=0x7f0a400ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.657+0000 7f0a479ff700 1 --2- 172.21.15.17:0/3060339408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a400ffae0 0x7f0a400ffef0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009990 tx=0x7f0a3c009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.657+0000 7f0a479ff700 1 -- 172.21.15.17:0/3060339408 shutdown_connections 2023-07-14T12:59:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.657+0000 7f0a479ff700 1 --2- 172.21.15.17:0/3060339408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a40101660 0x7f0a40107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.657+0000 7f0a479ff700 1 --2- 172.21.15.17:0/3060339408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a400ffae0 0x7f0a400ffef0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.657+0000 7f0a479ff700 1 --2- 172.21.15.17:0/3060339408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a40100cd0 0x7f0a40101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.657+0000 7f0a479ff700 1 -- 172.21.15.17:0/3060339408 >> 172.21.15.17:0/3060339408 conn(0x7f0a400fb0e0 msgr2=0x7f0a400fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.657+0000 7f0a479ff700 1 -- 172.21.15.17:0/3060339408 shutdown_connections 2023-07-14T12:59:27.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.657+0000 7f0a479ff700 1 -- 172.21.15.17:0/3060339408 wait complete. 2023-07-14T12:59:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.659+0000 7f0a479ff700 1 Processor -- start 2023-07-14T12:59:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.659+0000 7f0a479ff700 1 -- start start 2023-07-14T12:59:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.659+0000 7f0a479ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a400ffae0 0x7f0a40197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.659+0000 7f0a479ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a40100cd0 0x7f0a40197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.659+0000 7f0a479ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a40101660 0x7f0a4019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:27.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a479ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4019f4f0 con 0x7f0a40101660 2023-07-14T12:59:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a479ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4019f630 con 0x7f0a40100cd0 2023-07-14T12:59:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a479ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4019f7c0 con 0x7f0a400ffae0 2023-07-14T12:59:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a45f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a40101660 0x7f0a4019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a45f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a40101660 0x7f0a4019ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51784/0 (socket says 172.21.15.17:51784) 2023-07-14T12:59:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a45f9c700 1 -- 172.21.15.17:0/158736451 learned_addr learned my addr 172.21.15.17:0/158736451 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a44f9a700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a40100cd0 0x7f0a40197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:27.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a4579b700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a400ffae0 0x7f0a40197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a45f9c700 1 -- 172.21.15.17:0/158736451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a400ffae0 msgr2=0x7f0a40197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a45f9c700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a400ffae0 0x7f0a40197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a45f9c700 1 -- 172.21.15.17:0/158736451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a40100cd0 msgr2=0x7f0a40197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a45f9c700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a40100cd0 0x7f0a40197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.660+0000 7f0a45f9c700 1 -- 172.21.15.17:0/158736451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0095f0 con 0x7f0a40101660 2023-07-14T12:59:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.661+0000 7f0a45f9c700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a40101660 0x7f0a4019ef20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0a38007d70 tx=0x7f0a3800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.661+0000 7f0a367fc700 1 -- 172.21.15.17:0/158736451 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800ac90 con 0x7f0a40101660 2023-07-14T12:59:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.661+0000 7f0a367fc700 1 -- 172.21.15.17:0/158736451 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a3800adf0 con 0x7f0a40101660 2023-07-14T12:59:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.661+0000 7f0a479ff700 1 -- 172.21.15.17:0/158736451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4019faa0 con 0x7f0a40101660 2023-07-14T12:59:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.661+0000 7f0a367fc700 1 -- 172.21.15.17:0/158736451 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a380115e0 con 0x7f0a40101660 2023-07-14T12:59:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.661+0000 7f0a479ff700 1 -- 172.21.15.17:0/158736451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4019ff60 con 0x7f0a40101660 2023-07-14T12:59:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.662+0000 7f0a479ff700 1 -- 172.21.15.17:0/158736451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a40192070 con 0x7f0a40101660 2023-07-14T12:59:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.664+0000 7f0a367fc700 1 -- 172.21.15.17:0/158736451 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0a38004ad0 con 0x7f0a40101660 2023-07-14T12:59:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.665+0000 7f0a367fc700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a2c0a1150 0x7f0a2c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.665+0000 7f0a367fc700 1 -- 172.21.15.17:0/158736451 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f0a380ccec0 con 0x7f0a40101660 2023-07-14T12:59:27.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.666+0000 7f0a4579b700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a2c0a1150 0x7f0a2c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:27.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.666+0000 7f0a4579b700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a2c0a1150 0x7f0a2c0a3600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00c010 tx=0x7f0a3c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:27.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.668+0000 7f0a367fc700 1 -- 172.21.15.17:0/158736451 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0a380965e0 con 0x7f0a40101660 2023-07-14T12:59:27.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.877+0000 7f0a479ff700 1 -- 172.21.15.17:0/158736451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a4002c9e0 con 0x7f0a40101660 2023-07-14T12:59:27.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.877+0000 7f0a367fc700 1 -- 172.21.15.17:0/158736451 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a380160a0 con 0x7f0a40101660 2023-07-14T12:59:27.908 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T12:59:27.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 -- 172.21.15.17:0/158736451 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a2c0a1150 msgr2=0x7f0a2c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a2c0a1150 0x7f0a2c0a3600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00c010 tx=0x7f0a3c005fb0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 -- 172.21.15.17:0/158736451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a40101660 msgr2=0x7f0a4019ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:27.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a40101660 0x7f0a4019ef20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0a38007d70 tx=0x7f0a3800a340 comp rx=0 tx=0).stop 2023-07-14T12:59:27.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 -- 172.21.15.17:0/158736451 shutdown_connections 2023-07-14T12:59:27.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0a2c0a1150 0x7f0a2c0a3600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a40101660 0x7f0a4019ef20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a400ffae0 0x7f0a40197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 --2- 172.21.15.17:0/158736451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a40100cd0 0x7f0a40197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:27.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 -- 172.21.15.17:0/158736451 >> 172.21.15.17:0/158736451 conn(0x7f0a400fb0e0 msgr2=0x7f0a40106610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:27.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 -- 172.21.15.17:0/158736451 shutdown_connections 2023-07-14T12:59:27.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:27.880+0000 7f0a479ff700 1 -- 172.21.15.17:0/158736451 wait complete. 2023-07-14T12:59:27.928 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:59:28.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.104+0000 7f8bd3dff700 1 -- 172.21.15.17:0/737228552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bcc074550 msgr2=0x7f8bcc0729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:28.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.104+0000 7f8bd3dff700 1 --2- 172.21.15.17:0/737228552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bcc074550 0x7f8bcc0729a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009990 tx=0x7f8bc8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.104+0000 7f8bd3dff700 1 -- 172.21.15.17:0/737228552 shutdown_connections 2023-07-14T12:59:28.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.104+0000 7f8bd3dff700 1 --2- 172.21.15.17:0/737228552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bcc1079a0 0x7f8bcc109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.104+0000 7f8bd3dff700 1 --2- 172.21.15.17:0/737228552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bcc074550 0x7f8bcc0729a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.104+0000 7f8bd3dff700 1 --2- 172.21.15.17:0/737228552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bcc072f70 0x7f8bcc0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.104+0000 7f8bd3dff700 1 -- 172.21.15.17:0/737228552 >> 172.21.15.17:0/737228552 conn(0x7f8bcc0fb0e0 msgr2=0x7f8bcc0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:28.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.104+0000 7f8bd3dff700 1 -- 172.21.15.17:0/737228552 shutdown_connections 2023-07-14T12:59:28.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.105+0000 7f8bd3dff700 1 -- 172.21.15.17:0/737228552 wait complete. 2023-07-14T12:59:28.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.105+0000 7f8bd3dff700 1 Processor -- start 2023-07-14T12:59:28.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd3dff700 1 -- start start 2023-07-14T12:59:28.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd3dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bcc072f70 0x7f8bcc197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:28.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd3dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bcc074550 0x7f8bcc197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:28.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd3dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bcc1079a0 0x7f8bcc19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:28.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd3dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc19f5a0 con 0x7f8bcc1079a0 2023-07-14T12:59:28.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd3dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc19f6e0 con 0x7f8bcc074550 2023-07-14T12:59:28.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd3dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc19f870 con 0x7f8bcc072f70 2023-07-14T12:59:28.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd239c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bcc1079a0 0x7f8bcc19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:28.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd1b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bcc072f70 0x7f8bcc197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:28.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd239c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bcc1079a0 0x7f8bcc19efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51802/0 (socket says 172.21.15.17:51802) 2023-07-14T12:59:28.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd239c700 1 -- 172.21.15.17:0/3741922880 learned_addr learned my addr 172.21.15.17:0/3741922880 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:28.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.106+0000 7f8bd139a700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bcc074550 0x7f8bcc197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:28.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.107+0000 7f8bd239c700 1 -- 172.21.15.17:0/3741922880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bcc072f70 msgr2=0x7f8bcc197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:28.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.107+0000 7f8bd239c700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bcc072f70 0x7f8bcc197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.107+0000 7f8bd239c700 1 -- 172.21.15.17:0/3741922880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bcc074550 msgr2=0x7f8bcc197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:28.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.107+0000 7f8bd239c700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bcc074550 0x7f8bcc197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.107+0000 7f8bd239c700 1 -- 172.21.15.17:0/3741922880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc80095f0 con 0x7f8bcc1079a0 2023-07-14T12:59:28.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.107+0000 7f8bd239c700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bcc1079a0 0x7f8bcc19efd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400ada0 tx=0x7f8bc400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:28.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.107+0000 7f8bc2ffd700 1 -- 172.21.15.17:0/3741922880 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400f070 con 0x7f8bcc1079a0 2023-07-14T12:59:28.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.107+0000 7f8bc2ffd700 1 -- 172.21.15.17:0/3741922880 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bc4007b30 con 0x7f8bcc1079a0 2023-07-14T12:59:28.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.107+0000 7f8bd3dff700 1 -- 172.21.15.17:0/3741922880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bcc19fb50 con 0x7f8bcc1079a0 2023-07-14T12:59:28.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.107+0000 7f8bc2ffd700 1 -- 172.21.15.17:0/3741922880 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4005280 con 0x7f8bcc1079a0 2023-07-14T12:59:28.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.107+0000 7f8bd3dff700 1 -- 172.21.15.17:0/3741922880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc1a0010 con 0x7f8bcc1079a0 2023-07-14T12:59:28.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.108+0000 7f8bd3dff700 1 -- 172.21.15.17:0/3741922880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bcc106050 con 0x7f8bcc1079a0 2023-07-14T12:59:28.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.110+0000 7f8bc2ffd700 1 -- 172.21.15.17:0/3741922880 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8bc400c8d0 con 0x7f8bcc1079a0 2023-07-14T12:59:28.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.113+0000 7f8bc2ffd700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bb80a1150 0x7f8bb80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:28.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.113+0000 7f8bc2ffd700 1 -- 172.21.15.17:0/3741922880 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f8bc40cbe80 con 0x7f8bcc1079a0 2023-07-14T12:59:28.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.113+0000 7f8bd1b9b700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bb80a1150 0x7f8bb80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:28.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.114+0000 7f8bd1b9b700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bb80a1150 0x7f8bb80a3600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8000c00 tx=0x7f8bc800b560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:28.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.117+0000 7f8bc2ffd700 1 -- 172.21.15.17:0/3741922880 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8bc4095630 con 0x7f8bcc1079a0 2023-07-14T12:59:28.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:27 smithi131 ceph-mon[96953]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-14T12:59:28.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:27 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3943706239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:28.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:27 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2567231300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:28.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:27 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/158736451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:28.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.323+0000 7f8bd3dff700 1 -- 172.21.15.17:0/3741922880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8bcc0611c0 con 0x7f8bcc1079a0 2023-07-14T12:59:28.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.323+0000 7f8bc2ffd700 1 -- 172.21.15.17:0/3741922880 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8bc4098c50 con 0x7f8bcc1079a0 2023-07-14T12:59:28.354 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-07-14T12:59:28.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.325+0000 7f8bd3dff700 1 -- 172.21.15.17:0/3741922880 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bb80a1150 msgr2=0x7f8bb80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:28.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.325+0000 7f8bd3dff700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bb80a1150 0x7f8bb80a3600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8000c00 tx=0x7f8bc800b560 comp rx=0 tx=0).stop 2023-07-14T12:59:28.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.325+0000 7f8bd3dff700 1 -- 172.21.15.17:0/3741922880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bcc1079a0 msgr2=0x7f8bcc19efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:28.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.325+0000 7f8bd3dff700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bcc1079a0 0x7f8bcc19efd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400ada0 tx=0x7f8bc400c330 comp rx=0 tx=0).stop 2023-07-14T12:59:28.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.326+0000 7f8bd3dff700 1 -- 172.21.15.17:0/3741922880 shutdown_connections 2023-07-14T12:59:28.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.326+0000 7f8bd3dff700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8bb80a1150 0x7f8bb80a3600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.326+0000 7f8bd3dff700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bcc1079a0 0x7f8bcc19efd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.326+0000 7f8bd3dff700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bcc072f70 0x7f8bcc197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.326+0000 7f8bd3dff700 1 --2- 172.21.15.17:0/3741922880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8bcc074550 0x7f8bcc197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.326+0000 7f8bd3dff700 1 -- 172.21.15.17:0/3741922880 >> 172.21.15.17:0/3741922880 conn(0x7f8bcc0fb0e0 msgr2=0x7f8bcc0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.326+0000 7f8bd3dff700 1 -- 172.21.15.17:0/3741922880 shutdown_connections 2023-07-14T12:59:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.326+0000 7f8bd3dff700 1 -- 172.21.15.17:0/3741922880 wait complete. 2023-07-14T12:59:28.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:27 smithi017 ceph-mon[95536]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-14T12:59:28.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:27 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3943706239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:28.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:27 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2567231300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:28.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:27 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/158736451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:28.374 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:59:28.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:27 smithi135 ceph-mon[97338]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-14T12:59:28.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:27 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3943706239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:28.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:27 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2567231300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:28.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:27 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/158736451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:28.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.550+0000 7f39543ff700 1 -- 172.21.15.17:0/3182726840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f394c0ffae0 msgr2=0x7f394c0ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:28.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.550+0000 7f39543ff700 1 --2- 172.21.15.17:0/3182726840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f394c0ffae0 0x7f394c0ffef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3948009990 tx=0x7f3948009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.550+0000 7f39543ff700 1 -- 172.21.15.17:0/3182726840 shutdown_connections 2023-07-14T12:59:28.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.550+0000 7f39543ff700 1 --2- 172.21.15.17:0/3182726840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c101660 0x7f394c107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.550+0000 7f39543ff700 1 --2- 172.21.15.17:0/3182726840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f394c0ffae0 0x7f394c0ffef0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.550+0000 7f39543ff700 1 --2- 172.21.15.17:0/3182726840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f394c100cd0 0x7f394c101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.550+0000 7f39543ff700 1 -- 172.21.15.17:0/3182726840 >> 172.21.15.17:0/3182726840 conn(0x7f394c0fb0e0 msgr2=0x7f394c0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:28.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.550+0000 7f39543ff700 1 -- 172.21.15.17:0/3182726840 shutdown_connections 2023-07-14T12:59:28.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.550+0000 7f39543ff700 1 -- 172.21.15.17:0/3182726840 wait complete. 2023-07-14T12:59:28.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.551+0000 7f39543ff700 1 Processor -- start 2023-07-14T12:59:28.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.551+0000 7f39543ff700 1 -- start start 2023-07-14T12:59:28.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f39543ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f394c0ffae0 0x7f394c0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:28.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f39543ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c100cd0 0x7f394c072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:28.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f39543ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f394c101660 0x7f394c072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:28.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f39543ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c199620 con 0x7f394c100cd0 2023-07-14T12:59:28.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f39543ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c073380 con 0x7f394c0ffae0 2023-07-14T12:59:28.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f39543ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c073540 con 0x7f394c101660 2023-07-14T12:59:28.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f395199a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c100cd0 0x7f394c072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:28.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f395199a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c100cd0 0x7f394c072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51820/0 (socket says 172.21.15.17:51820) 2023-07-14T12:59:28.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f395199a700 1 -- 172.21.15.17:0/279525072 learned_addr learned my addr 172.21.15.17:0/279525072 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:28.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f395219b700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f394c0ffae0 0x7f394c0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:28.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f395299c700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f394c101660 0x7f394c072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:28.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f395199a700 1 -- 172.21.15.17:0/279525072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f394c101660 msgr2=0x7f394c072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:28.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f395199a700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f394c101660 0x7f394c072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f395199a700 1 -- 172.21.15.17:0/279525072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f394c0ffae0 msgr2=0x7f394c0742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:28.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f395199a700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f394c0ffae0 0x7f394c0742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f395199a700 1 -- 172.21.15.17:0/279525072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3944009c40 con 0x7f394c100cd0 2023-07-14T12:59:28.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.552+0000 7f395299c700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f394c101660 0x7f394c072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:28.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.553+0000 7f395199a700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c100cd0 0x7f394c072900 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f393c00e9a0 tx=0x7f393c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:28.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.553+0000 7f39437fe700 1 -- 172.21.15.17:0/279525072 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c009790 con 0x7f394c100cd0 2023-07-14T12:59:28.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.553+0000 7f39437fe700 1 -- 172.21.15.17:0/279525072 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f393c00cbd0 con 0x7f394c100cd0 2023-07-14T12:59:28.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.553+0000 7f39543ff700 1 -- 172.21.15.17:0/279525072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39480095f0 con 0x7f394c100cd0 2023-07-14T12:59:28.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.553+0000 7f39437fe700 1 -- 172.21.15.17:0/279525072 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c018680 con 0x7f394c100cd0 2023-07-14T12:59:28.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.553+0000 7f39543ff700 1 -- 172.21.15.17:0/279525072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c1a4200 con 0x7f394c100cd0 2023-07-14T12:59:28.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.554+0000 7f39543ff700 1 -- 172.21.15.17:0/279525072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c106af0 con 0x7f394c100cd0 2023-07-14T12:59:28.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.556+0000 7f39437fe700 1 -- 172.21.15.17:0/279525072 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f393c00cd40 con 0x7f394c100cd0 2023-07-14T12:59:28.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.557+0000 7f39437fe700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f39380a1150 0x7f39380a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:28.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.558+0000 7f39437fe700 1 -- 172.21.15.17:0/279525072 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f393c014070 con 0x7f394c100cd0 2023-07-14T12:59:28.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.558+0000 7f395219b700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f39380a1150 0x7f39380a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:28.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.558+0000 7f395219b700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f39380a1150 0x7f39380a3600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3948006010 tx=0x7f394800b2a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:28.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.559+0000 7f39437fe700 1 -- 172.21.15.17:0/279525072 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f393c0966a0 con 0x7f394c100cd0 2023-07-14T12:59:28.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.768+0000 7f39543ff700 1 -- 172.21.15.17:0/279525072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f394c02caa0 con 0x7f394c100cd0 2023-07-14T12:59:28.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.768+0000 7f39437fe700 1 -- 172.21.15.17:0/279525072 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f393c099cc0 con 0x7f394c100cd0 2023-07-14T12:59:28.799 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-07-14T12:59:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 -- 172.21.15.17:0/279525072 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f39380a1150 msgr2=0x7f39380a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f39380a1150 0x7f39380a3600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3948006010 tx=0x7f394800b2a0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 -- 172.21.15.17:0/279525072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c100cd0 msgr2=0x7f394c072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c100cd0 0x7f394c072900 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f393c00e9a0 tx=0x7f393c00ecb0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 -- 172.21.15.17:0/279525072 shutdown_connections 2023-07-14T12:59:28.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f39380a1150 0x7f39380a3600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f394c101660 0x7f394c072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f394c0ffae0 0x7f394c0742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 --2- 172.21.15.17:0/279525072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f394c100cd0 0x7f394c072900 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 -- 172.21.15.17:0/279525072 >> 172.21.15.17:0/279525072 conn(0x7f394c0fb0e0 msgr2=0x7f394c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 -- 172.21.15.17:0/279525072 shutdown_connections 2023-07-14T12:59:28.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.771+0000 7f39543ff700 1 -- 172.21.15.17:0/279525072 wait complete. 2023-07-14T12:59:28.819 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-07-14T12:59:28.820 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:59:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.995+0000 7f788a5ff700 1 -- 172.21.15.17:0/3554489125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7884101680 msgr2=0x7f7884107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.995+0000 7f788a5ff700 1 --2- 172.21.15.17:0/3554489125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7884101680 0x7f7884107f40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f787c00b0a0 tx=0x7f787c00b3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.995+0000 7f788a5ff700 1 -- 172.21.15.17:0/3554489125 shutdown_connections 2023-07-14T12:59:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.995+0000 7f788a5ff700 1 --2- 172.21.15.17:0/3554489125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7884101680 0x7f7884107f40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.995+0000 7f788a5ff700 1 --2- 172.21.15.17:0/3554489125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78840ffb00 0x7f78840fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.995+0000 7f788a5ff700 1 --2- 172.21.15.17:0/3554489125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7884100cf0 0x7f7884101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.995+0000 7f788a5ff700 1 -- 172.21.15.17:0/3554489125 >> 172.21.15.17:0/3554489125 conn(0x7f78840fb0e0 msgr2=0x7f78840fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.995+0000 7f788a5ff700 1 -- 172.21.15.17:0/3554489125 shutdown_connections 2023-07-14T12:59:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.995+0000 7f788a5ff700 1 -- 172.21.15.17:0/3554489125 wait complete. 2023-07-14T12:59:29.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.996+0000 7f788a5ff700 1 Processor -- start 2023-07-14T12:59:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.996+0000 7f788a5ff700 1 -- start start 2023-07-14T12:59:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f788a5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78840ffb00 0x7f78840742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f788a5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7884100cf0 0x7f7884072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f788a5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7884101680 0x7f7884072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f788a5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78840735e0 con 0x7f78840ffb00 2023-07-14T12:59:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f788a5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7884073750 con 0x7f7884100cf0 2023-07-14T12:59:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f788a5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788419f920 con 0x7f7884101680 2023-07-14T12:59:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f7883fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78840ffb00 0x7f78840742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f7883fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78840ffb00 0x7f78840742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51838/0 (socket says 172.21.15.17:51838) 2023-07-14T12:59:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f7883fff700 1 -- 172.21.15.17:0/1051245130 learned_addr learned my addr 172.21.15.17:0/1051245130 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f78837fe700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7884100cf0 0x7f7884072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f7888b9c700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7884101680 0x7f7884072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f7883fff700 1 -- 172.21.15.17:0/1051245130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7884101680 msgr2=0x7f7884072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f7883fff700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7884101680 0x7f7884072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f7883fff700 1 -- 172.21.15.17:0/1051245130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7884100cf0 msgr2=0x7f7884072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f7883fff700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7884100cf0 0x7f7884072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f7883fff700 1 -- 172.21.15.17:0/1051245130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c009d00 con 0x7f78840ffb00 2023-07-14T12:59:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f7888b9c700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7884101680 0x7f7884072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:59:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.997+0000 7f7883fff700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78840ffb00 0x7f78840742c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f787400d980 tx=0x7f787400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.998+0000 7f78817fa700 1 -- 172.21.15.17:0/1051245130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787400bb60 con 0x7f78840ffb00 2023-07-14T12:59:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.998+0000 7f788a5ff700 1 -- 172.21.15.17:0/1051245130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788419fc00 con 0x7f78840ffb00 2023-07-14T12:59:29.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.998+0000 7f78817fa700 1 -- 172.21.15.17:0/1051245130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7874007620 con 0x7f78840ffb00 2023-07-14T12:59:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.998+0000 7f78817fa700 1 -- 172.21.15.17:0/1051245130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787400f3c0 con 0x7f78840ffb00 2023-07-14T12:59:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.998+0000 7f788a5ff700 1 -- 172.21.15.17:0/1051245130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78841a0110 con 0x7f78840ffb00 2023-07-14T12:59:29.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:28.999+0000 7f788a5ff700 1 -- 172.21.15.17:0/1051245130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7884107040 con 0x7f78840ffb00 2023-07-14T12:59:29.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.001+0000 7f78817fa700 1 -- 172.21.15.17:0/1051245130 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f7874010460 con 0x7f78840ffb00 2023-07-14T12:59:29.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.002+0000 7f78817fa700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f786c0a11a0 0x7f786c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:29.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.002+0000 7f78817fa700 1 -- 172.21.15.17:0/1051245130 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f78740cd100 con 0x7f78840ffb00 2023-07-14T12:59:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.003+0000 7f78837fe700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f786c0a11a0 0x7f786c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.003+0000 7f78837fe700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f786c0a11a0 0x7f786c0a3650 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7878009bd0 tx=0x7f7878009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:29.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.004+0000 7f78817fa700 1 -- 172.21.15.17:0/1051245130 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7874096820 con 0x7f78840ffb00 2023-07-14T12:59:29.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:28 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3741922880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:29.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:28 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/279525072' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:29.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:28 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3741922880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:29.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:28 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/279525072' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.261+0000 7f788a5ff700 1 -- 172.21.15.17:0/1051245130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f788402c850 con 0x7f78840ffb00 2023-07-14T12:59:29.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.262+0000 7f78817fa700 1 -- 172.21.15.17:0/1051245130 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10845 (secure 0 0 0) 0x7f7874010710 con 0x7f78840ffb00 2023-07-14T12:59:29.292 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:29.292 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T12:57:45.208579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:59:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 -- 172.21.15.17:0/1051245130 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f786c0a11a0 msgr2=0x7f786c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:29.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f786c0a11a0 0x7f786c0a3650 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7878009bd0 tx=0x7f7878009260 comp rx=0 tx=0).stop 2023-07-14T12:59:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 -- 172.21.15.17:0/1051245130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78840ffb00 msgr2=0x7f78840742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78840ffb00 0x7f78840742c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f787400d980 tx=0x7f787400dd40 comp rx=0 tx=0).stop 2023-07-14T12:59:29.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 -- 172.21.15.17:0/1051245130 shutdown_connections 2023-07-14T12:59:29.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f786c0a11a0 0x7f786c0a3650 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7884101680 0x7f7884072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78840ffb00 0x7f78840742c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 --2- 172.21.15.17:0/1051245130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7884100cf0 0x7f7884072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 -- 172.21.15.17:0/1051245130 >> 172.21.15.17:0/1051245130 conn(0x7f78840fb0e0 msgr2=0x7f7884104180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:29.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 -- 172.21.15.17:0/1051245130 shutdown_connections 2023-07-14T12:59:29.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.264+0000 7f788a5ff700 1 -- 172.21.15.17:0/1051245130 wait complete. 2023-07-14T12:59:29.299 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2023-07-14T12:59:29.312 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-07-14T12:59:29.313 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-07-14T12:59:29.313 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:59:29.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:28 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3741922880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:29.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:28 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/279525072' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:29.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.488+0000 7fd3793ff700 1 -- 172.21.15.17:0/1701602813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd374102ed0 msgr2=0x7fd3741052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:29.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.488+0000 7fd3793ff700 1 --2- 172.21.15.17:0/1701602813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd374102ed0 0x7fd3741052b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd368009990 tx=0x7fd368009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.488+0000 7fd3793ff700 1 -- 172.21.15.17:0/1701602813 shutdown_connections 2023-07-14T12:59:29.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.488+0000 7fd3793ff700 1 --2- 172.21.15.17:0/1701602813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3741057f0 0x7fd374107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.488+0000 7fd3793ff700 1 --2- 172.21.15.17:0/1701602813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3741005b0 0x7fd374102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.488+0000 7fd3793ff700 1 --2- 172.21.15.17:0/1701602813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd374102ed0 0x7fd3741052b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.488+0000 7fd3793ff700 1 -- 172.21.15.17:0/1701602813 >> 172.21.15.17:0/1701602813 conn(0x7fd3740f9fd0 msgr2=0x7fd3740fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:29.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.488+0000 7fd3793ff700 1 -- 172.21.15.17:0/1701602813 shutdown_connections 2023-07-14T12:59:29.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.488+0000 7fd3793ff700 1 -- 172.21.15.17:0/1701602813 wait complete. 2023-07-14T12:59:29.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.489+0000 7fd3793ff700 1 Processor -- start 2023-07-14T12:59:29.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.489+0000 7fd3793ff700 1 -- start start 2023-07-14T12:59:29.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.489+0000 7fd3793ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3741005b0 0x7fd3741978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:29.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.489+0000 7fd3793ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd374102ed0 0x7fd374197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:29.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.489+0000 7fd3793ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3741057f0 0x7fd37419ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:29.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3793ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37419f440 con 0x7fd3741057f0 2023-07-14T12:59:29.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3793ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37419f580 con 0x7fd3741005b0 2023-07-14T12:59:29.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3793ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37419f710 con 0x7fd374102ed0 2023-07-14T12:59:29.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3737fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3741057f0 0x7fd37419ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:29.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3737fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3741057f0 0x7fd37419ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51856/0 (socket says 172.21.15.17:51856) 2023-07-14T12:59:29.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3737fe700 1 -- 172.21.15.17:0/4170350297 learned_addr learned my addr 172.21.15.17:0/4170350297 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:29.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd372ffd700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3741005b0 0x7fd3741978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:29.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3727fc700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd374102ed0 0x7fd374197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:29.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3737fe700 1 -- 172.21.15.17:0/4170350297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd374102ed0 msgr2=0x7fd374197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:29.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3737fe700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd374102ed0 0x7fd374197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3737fe700 1 -- 172.21.15.17:0/4170350297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3741005b0 msgr2=0x7fd3741978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:29.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3737fe700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3741005b0 0x7fd3741978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3737fe700 1 -- 172.21.15.17:0/4170350297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3680095f0 con 0x7fd3741057f0 2023-07-14T12:59:29.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.490+0000 7fd3737fe700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3741057f0 0x7fd37419ee70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd36c007ee0 tx=0x7fd36c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:29.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.491+0000 7fd35bfff700 1 -- 172.21.15.17:0/4170350297 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00dd20 con 0x7fd3741057f0 2023-07-14T12:59:29.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.491+0000 7fd3793ff700 1 -- 172.21.15.17:0/4170350297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37419f9f0 con 0x7fd3741057f0 2023-07-14T12:59:29.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.491+0000 7fd35bfff700 1 -- 172.21.15.17:0/4170350297 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd36c00f040 con 0x7fd3741057f0 2023-07-14T12:59:29.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.491+0000 7fd35bfff700 1 -- 172.21.15.17:0/4170350297 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c004750 con 0x7fd3741057f0 2023-07-14T12:59:29.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.491+0000 7fd3793ff700 1 -- 172.21.15.17:0/4170350297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37419ff00 con 0x7fd3741057f0 2023-07-14T12:59:29.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.492+0000 7fd3793ff700 1 -- 172.21.15.17:0/4170350297 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd374107360 con 0x7fd3741057f0 2023-07-14T12:59:29.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.494+0000 7fd35bfff700 1 -- 172.21.15.17:0/4170350297 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fd36c003a00 con 0x7fd3741057f0 2023-07-14T12:59:29.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.495+0000 7fd35bfff700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fd35c0a11a0 0x7fd35c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:29.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.496+0000 7fd35bfff700 1 -- 172.21.15.17:0/4170350297 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fd36c0cc890 con 0x7fd3741057f0 2023-07-14T12:59:29.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.496+0000 7fd372ffd700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fd35c0a11a0 0x7fd35c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:29.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.496+0000 7fd372ffd700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fd35c0a11a0 0x7fd35c0a3650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd364007c60 tx=0x7fd3640073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:29.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.497+0000 7fd35bfff700 1 -- 172.21.15.17:0/4170350297 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd36c095fb0 con 0x7fd3741057f0 2023-07-14T12:59:29.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.703+0000 7fd3793ff700 1 -- 172.21.15.17:0/4170350297 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd374060950 con 0x7fd35c0a11a0 2023-07-14T12:59:29.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.715+0000 7fd35bfff700 1 -- 172.21.15.17:0/4170350297 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343950 (secure 0 0 0) 0x7fd374060950 con 0x7fd35c0a11a0 2023-07-14T12:59:29.748 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:29.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.719+0000 7fd3793ff700 1 -- 172.21.15.17:0/4170350297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fd35c0a11a0 msgr2=0x7fd35c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:29.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.719+0000 7fd3793ff700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fd35c0a11a0 0x7fd35c0a3650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd364007c60 tx=0x7fd3640073d0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.719+0000 7fd3793ff700 1 -- 172.21.15.17:0/4170350297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3741057f0 msgr2=0x7fd37419ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:29.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.719+0000 7fd3793ff700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3741057f0 0x7fd37419ee70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd36c007ee0 tx=0x7fd36c00d3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.719+0000 7fd3793ff700 1 -- 172.21.15.17:0/4170350297 shutdown_connections 2023-07-14T12:59:29.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.719+0000 7fd3793ff700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fd35c0a11a0 0x7fd35c0a3650 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.719+0000 7fd3793ff700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3741057f0 0x7fd37419ee70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.719+0000 7fd3793ff700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3741005b0 0x7fd3741978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.719+0000 7fd3793ff700 1 --2- 172.21.15.17:0/4170350297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd374102ed0 0x7fd374197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:29.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.719+0000 7fd3793ff700 1 -- 172.21.15.17:0/4170350297 >> 172.21.15.17:0/4170350297 conn(0x7fd3740f9fd0 msgr2=0x7fd3740fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:29.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.720+0000 7fd3793ff700 1 -- 172.21.15.17:0/4170350297 shutdown_connections 2023-07-14T12:59:29.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.720+0000 7fd3793ff700 1 -- 172.21.15.17:0/4170350297 wait complete. 2023-07-14T12:59:29.753 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-07-14T12:59:29.768 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2023-07-14T12:59:28.864082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654938,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":766,"num_read_kb":503,"num_write":344,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1180882,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":780,"ondisk_log_size":780,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335060,"kb_used_data":11636,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124606764,"statfs":{"total":1151940427776,"available":1151597326336,"internally_reserved":0,"allocated":11915264,"data_stored":7466734,"data_compressed":113190,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1449,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003150"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.881025+0000","last_change":"2023-07-14T12:57:40.168203+0000","last_active":"2023-07-14T12:59:06.881025+0000","last_peered":"2023-07-14T12:59:06.881025+0000","last_clean":"2023-07-14T12:59:06.881025+0000","last_became_active":"2023-07-14T12:57:40.164682+0000","last_became_peered":"2023-07-14T12:57:40.164682+0000","last_unstale":"2023-07-14T12:59:06.881025+0000","last_undegraded":"2023-07-14T12:59:06.881025+0000","last_fullsized":"2023-07-14T12:59:06.881025+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:39.005726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.872934+0000","last_change":"2023-07-14T12:57:40.168194+0000","last_active":"2023-07-14T12:59:06.872934+0000","last_peered":"2023-07-14T12:59:06.872934+0000","last_clean":"2023-07-14T12:59:06.872934+0000","last_became_active":"2023-07-14T12:57:40.167825+0000","last_became_peered":"2023-07-14T12:57:40.167825+0000","last_unstale":"2023-07-14T12:59:06.872934+0000","last_undegraded":"2023-07-14T12:59:06.872934+0000","last_fullsized":"2023-07-14T12:59:06.872934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:23:35.037851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.879101+0000","last_change":"2023-07-14T12:57:40.162824+0000","last_active":"2023-07-14T12:59:06.879101+0000","last_peered":"2023-07-14T12:59:06.879101+0000","last_clean":"2023-07-14T12:59:06.879101+0000","last_became_active":"2023-07-14T12:57:40.162526+0000","last_became_peered":"2023-07-14T12:57:40.162526+0000","last_unstale":"2023-07-14T12:59:06.879101+0000","last_undegraded":"2023-07-14T12:59:06.879101+0000","last_fullsized":"2023-07-14T12:59:06.879101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:01:27.137266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.859900+0000","last_change":"2023-07-14T12:57:40.160772+0000","last_active":"2023-07-14T12:59:06.859900+0000","last_peered":"2023-07-14T12:59:06.859900+0000","last_clean":"2023-07-14T12:59:06.859900+0000","last_became_active":"2023-07-14T12:57:40.160315+0000","last_became_peered":"2023-07-14T12:57:40.160315+0000","last_unstale":"2023-07-14T12:59:06.859900+0000","last_undegraded":"2023-07-14T12:59:06.859900+0000","last_fullsized":"2023-07-14T12:59:06.859900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:48.047786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869216+0000","last_change":"2023-07-14T12:57:40.160868+0000","last_active":"2023-07-14T12:59:06.869216+0000","last_peered":"2023-07-14T12:59:06.869216+0000","last_clean":"2023-07-14T12:59:06.869216+0000","last_became_active":"2023-07-14T12:57:40.160558+0000","last_became_peered":"2023-07-14T12:57:40.160558+0000","last_unstale":"2023-07-14T12:59:06.869216+0000","last_undegraded":"2023-07-14T12:59:06.869216+0000","last_fullsized":"2023-07-14T12:59:06.869216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:21:57.315978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.872638+0000","last_change":"2023-07-14T12:57:40.166305+0000","last_active":"2023-07-14T12:59:06.872638+0000","last_peered":"2023-07-14T12:59:06.872638+0000","last_clean":"2023-07-14T12:59:06.872638+0000","last_became_active":"2023-07-14T12:57:40.166012+0000","last_became_peered":"2023-07-14T12:57:40.166012+0000","last_unstale":"2023-07-14T12:59:06.872638+0000","last_undegraded":"2023-07-14T12:59:06.872638+0000","last_fullsized":"2023-07-14T12:59:06.872638+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:03:06.167704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.855384+0000","last_change":"2023-07-14T12:57:40.163312+0000","last_active":"2023-07-14T12:59:06.855384+0000","last_peered":"2023-07-14T12:59:06.855384+0000","last_clean":"2023-07-14T12:59:06.855384+0000","last_became_active":"2023-07-14T12:57:40.163030+0000","last_became_peered":"2023-07-14T12:57:40.163030+0000","last_unstale":"2023-07-14T12:59:06.855384+0000","last_undegraded":"2023-07-14T12:59:06.855384+0000","last_fullsized":"2023-07-14T12:59:06.855384+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:41.303341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869384+0000","last_change":"2023-07-14T12:58:08.115121+0000","last_active":"2023-07-14T12:59:06.869384+0000","last_peered":"2023-07-14T12:59:06.869384+0000","last_clean":"2023-07-14T12:59:06.869384+0000","last_became_active":"2023-07-14T12:58:08.114736+0000","last_became_peered":"2023-07-14T12:58:08.114736+0000","last_unstale":"2023-07-14T12:59:06.869384+0000","last_undegraded":"2023-07-14T12:59:06.869384+0000","last_fullsized":"2023-07-14T12:59:06.869384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:30:27.815140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.880702+0000","last_change":"2023-07-14T12:57:40.170263+0000","last_active":"2023-07-14T12:59:06.880702+0000","last_peered":"2023-07-14T12:59:06.880702+0000","last_clean":"2023-07-14T12:59:06.880702+0000","last_became_active":"2023-07-14T12:57:40.169952+0000","last_became_peered":"2023-07-14T12:57:40.169952+0000","last_unstale":"2023-07-14T12:59:06.880702+0000","last_undegraded":"2023-07-14T12:59:06.880702+0000","last_fullsized":"2023-07-14T12:59:06.880702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:07:08.714595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866126+0000","last_change":"2023-07-14T12:57:40.165359+0000","last_active":"2023-07-14T12:59:06.866126+0000","last_peered":"2023-07-14T12:59:06.866126+0000","last_clean":"2023-07-14T12:59:06.866126+0000","last_became_active":"2023-07-14T12:57:40.164918+0000","last_became_peered":"2023-07-14T12:57:40.164918+0000","last_unstale":"2023-07-14T12:59:06.866126+0000","last_undegraded":"2023-07-14T12:59:06.866126+0000","last_fullsized":"2023-07-14T12:59:06.866126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:57:54.633792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.877061+0000","last_change":"2023-07-14T12:57:40.160524+0000","last_active":"2023-07-14T12:59:06.877061+0000","last_peered":"2023-07-14T12:59:06.877061+0000","last_clean":"2023-07-14T12:59:06.877061+0000","last_became_active":"2023-07-14T12:57:40.160215+0000","last_became_peered":"2023-07-14T12:57:40.160215+0000","last_unstale":"2023-07-14T12:59:06.877061+0000","last_undegraded":"2023-07-14T12:59:06.877061+0000","last_fullsized":"2023-07-14T12:59:06.877061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:21.213962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870167+0000","last_change":"2023-07-14T12:58:07.964366+0000","last_active":"2023-07-14T12:59:06.870167+0000","last_peered":"2023-07-14T12:59:06.870167+0000","last_clean":"2023-07-14T12:59:06.870167+0000","last_became_active":"2023-07-14T12:58:07.963981+0000","last_became_peered":"2023-07-14T12:58:07.963981+0000","last_unstale":"2023-07-14T12:59:06.870167+0000","last_undegraded":"2023-07-14T12:59:06.870167+0000","last_fullsized":"2023-07-14T12:59:06.870167+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:28:52.971393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870190+0000","last_change":"2023-07-14T12:57:40.162166+0000","last_active":"2023-07-14T12:59:06.870190+0000","last_peered":"2023-07-14T12:59:06.870190+0000","last_clean":"2023-07-14T12:59:06.870190+0000","last_became_active":"2023-07-14T12:57:40.161750+0000","last_became_peered":"2023-07-14T12:57:40.161750+0000","last_unstale":"2023-07-14T12:59:06.870190+0000","last_undegraded":"2023-07-14T12:59:06.870190+0000","last_fullsized":"2023-07-14T12:59:06.870190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:19:28.054997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.871810+0000","last_change":"2023-07-14T12:57:40.160556+0000","last_active":"2023-07-14T12:59:06.871810+0000","last_peered":"2023-07-14T12:59:06.871810+0000","last_clean":"2023-07-14T12:59:06.871810+0000","last_became_active":"2023-07-14T12:57:40.159974+0000","last_became_peered":"2023-07-14T12:57:40.159974+0000","last_unstale":"2023-07-14T12:59:06.871810+0000","last_undegraded":"2023-07-14T12:59:06.871810+0000","last_fullsized":"2023-07-14T12:59:06.871810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:35:12.700407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870639+0000","last_change":"2023-07-14T12:57:40.169116+0000","last_active":"2023-07-14T12:59:06.870639+0000","last_peered":"2023-07-14T12:59:06.870639+0000","last_clean":"2023-07-14T12:59:06.870639+0000","last_became_active":"2023-07-14T12:57:40.168714+0000","last_became_peered":"2023-07-14T12:57:40.168714+0000","last_unstale":"2023-07-14T12:59:06.870639+0000","last_undegraded":"2023-07-14T12:59:06.870639+0000","last_fullsized":"2023-07-14T12:59:06.870639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:17:06.970124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.880546+0000","last_change":"2023-07-14T12:57:40.162621+0000","last_active":"2023-07-14T12:59:06.880546+0000","last_peered":"2023-07-14T12:59:06.880546+0000","last_clean":"2023-07-14T12:59:06.880546+0000","last_became_active":"2023-07-14T12:57:40.162329+0000","last_became_peered":"2023-07-14T12:57:40.162329+0000","last_unstale":"2023-07-14T12:59:06.880546+0000","last_undegraded":"2023-07-14T12:59:06.880546+0000","last_fullsized":"2023-07-14T12:59:06.880546+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:19.671402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.881150+0000","last_change":"2023-07-14T12:57:40.172697+0000","last_active":"2023-07-14T12:59:06.881150+0000","last_peered":"2023-07-14T12:59:06.881150+0000","last_clean":"2023-07-14T12:59:06.881150+0000","last_became_active":"2023-07-14T12:57:40.172366+0000","last_became_peered":"2023-07-14T12:57:40.172366+0000","last_unstale":"2023-07-14T12:59:06.881150+0000","last_undegraded":"2023-07-14T12:59:06.881150+0000","last_fullsized":"2023-07-14T12:59:06.881150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:57.950996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.877348+0000","last_change":"2023-07-14T12:57:40.166669+0000","last_active":"2023-07-14T12:59:06.877348+0000","last_peered":"2023-07-14T12:59:06.877348+0000","last_clean":"2023-07-14T12:59:06.877348+0000","last_became_active":"2023-07-14T12:57:40.166367+0000","last_became_peered":"2023-07-14T12:57:40.166367+0000","last_unstale":"2023-07-14T12:59:06.877348+0000","last_undegraded":"2023-07-14T12:59:06.877348+0000","last_fullsized":"2023-07-14T12:59:06.877348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:32:55.001814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869373+0000","last_change":"2023-07-14T12:57:40.159133+0000","last_active":"2023-07-14T12:59:06.869373+0000","last_peered":"2023-07-14T12:59:06.869373+0000","last_clean":"2023-07-14T12:59:06.869373+0000","last_became_active":"2023-07-14T12:57:40.158819+0000","last_became_peered":"2023-07-14T12:57:40.158819+0000","last_unstale":"2023-07-14T12:59:06.869373+0000","last_undegraded":"2023-07-14T12:59:06.869373+0000","last_fullsized":"2023-07-14T12:59:06.869373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:34.782295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959654+0000","last_change":"2023-07-14T12:57:39.144919+0000","last_active":"2023-07-14T12:58:07.959654+0000","last_peered":"2023-07-14T12:58:07.959654+0000","last_clean":"2023-07-14T12:58:07.959654+0000","last_became_active":"2023-07-14T12:57:39.144604+0000","last_became_peered":"2023-07-14T12:57:39.144604+0000","last_unstale":"2023-07-14T12:58:07.959654+0000","last_undegraded":"2023-07-14T12:58:07.959654+0000","last_fullsized":"2023-07-14T12:58:07.959654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:32:41.249364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866853+0000","last_change":"2023-07-14T12:57:40.165754+0000","last_active":"2023-07-14T12:59:06.866853+0000","last_peered":"2023-07-14T12:59:06.866853+0000","last_clean":"2023-07-14T12:59:06.866853+0000","last_became_active":"2023-07-14T12:57:40.165416+0000","last_became_peered":"2023-07-14T12:57:40.165416+0000","last_unstale":"2023-07-14T12:59:06.866853+0000","last_undegraded":"2023-07-14T12:59:06.866853+0000","last_fullsized":"2023-07-14T12:59:06.866853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:44.533325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965435+0000","last_change":"2023-07-14T12:57:39.153977+0000","last_active":"2023-07-14T12:58:07.965435+0000","last_peered":"2023-07-14T12:58:07.965435+0000","last_clean":"2023-07-14T12:58:07.965435+0000","last_became_active":"2023-07-14T12:57:39.153675+0000","last_became_peered":"2023-07-14T12:57:39.153675+0000","last_unstale":"2023-07-14T12:58:07.965435+0000","last_undegraded":"2023-07-14T12:58:07.965435+0000","last_fullsized":"2023-07-14T12:58:07.965435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:56.670099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.879198+0000","last_change":"2023-07-14T12:57:40.157076+0000","last_active":"2023-07-14T12:59:06.879198+0000","last_peered":"2023-07-14T12:59:06.879198+0000","last_clean":"2023-07-14T12:59:06.879198+0000","last_became_active":"2023-07-14T12:57:40.156652+0000","last_became_peered":"2023-07-14T12:57:40.156652+0000","last_unstale":"2023-07-14T12:59:06.879198+0000","last_undegraded":"2023-07-14T12:59:06.879198+0000","last_fullsized":"2023-07-14T12:59:06.879198+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:51.608575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963702+0000","last_change":"2023-07-14T12:57:39.145123+0000","last_active":"2023-07-14T12:58:07.963702+0000","last_peered":"2023-07-14T12:58:07.963702+0000","last_clean":"2023-07-14T12:58:07.963702+0000","last_became_active":"2023-07-14T12:57:39.144768+0000","last_became_peered":"2023-07-14T12:57:39.144768+0000","last_unstale":"2023-07-14T12:58:07.963702+0000","last_undegraded":"2023-07-14T12:58:07.963702+0000","last_fullsized":"2023-07-14T12:58:07.963702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:13:21.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878293+0000","last_change":"2023-07-14T12:57:40.167084+0000","last_active":"2023-07-14T12:59:06.878293+0000","last_peered":"2023-07-14T12:59:06.878293+0000","last_clean":"2023-07-14T12:59:06.878293+0000","last_became_active":"2023-07-14T12:57:40.166654+0000","last_became_peered":"2023-07-14T12:57:40.166654+0000","last_unstale":"2023-07-14T12:59:06.878293+0000","last_undegraded":"2023-07-14T12:59:06.878293+0000","last_fullsized":"2023-07-14T12:59:06.878293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:01:54.429150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963132+0000","last_change":"2023-07-14T12:57:39.137432+0000","last_active":"2023-07-14T12:58:07.963132+0000","last_peered":"2023-07-14T12:58:07.963132+0000","last_clean":"2023-07-14T12:58:07.963132+0000","last_became_active":"2023-07-14T12:57:39.137124+0000","last_became_peered":"2023-07-14T12:57:39.137124+0000","last_unstale":"2023-07-14T12:58:07.963132+0000","last_undegraded":"2023-07-14T12:58:07.963132+0000","last_fullsized":"2023-07-14T12:58:07.963132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:50.638289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.876649+0000","last_change":"2023-07-14T12:57:40.167477+0000","last_active":"2023-07-14T12:59:06.876649+0000","last_peered":"2023-07-14T12:59:06.876649+0000","last_clean":"2023-07-14T12:59:06.876649+0000","last_became_active":"2023-07-14T12:57:40.167177+0000","last_became_peered":"2023-07-14T12:57:40.167177+0000","last_unstale":"2023-07-14T12:59:06.876649+0000","last_undegraded":"2023-07-14T12:59:06.876649+0000","last_fullsized":"2023-07-14T12:59:06.876649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:39:35.566121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":128,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:24.398014+0000","last_change":"2023-07-14T12:57:39.146569+0000","last_active":"2023-07-14T12:59:24.398014+0000","last_peered":"2023-07-14T12:59:24.398014+0000","last_clean":"2023-07-14T12:59:24.398014+0000","last_became_active":"2023-07-14T12:57:39.146251+0000","last_became_peered":"2023-07-14T12:57:39.146251+0000","last_unstale":"2023-07-14T12:59:24.398014+0000","last_undegraded":"2023-07-14T12:59:24.398014+0000","last_fullsized":"2023-07-14T12:59:24.398014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:33.372913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.853293+0000","last_change":"2023-07-14T12:57:40.160511+0000","last_active":"2023-07-14T12:59:06.853293+0000","last_peered":"2023-07-14T12:59:06.853293+0000","last_clean":"2023-07-14T12:59:06.853293+0000","last_became_active":"2023-07-14T12:57:40.160152+0000","last_became_peered":"2023-07-14T12:57:40.160152+0000","last_unstale":"2023-07-14T12:59:06.853293+0000","last_undegraded":"2023-07-14T12:59:06.853293+0000","last_fullsized":"2023-07-14T12:59:06.853293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:05.198459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.119603+0000","last_change":"2023-07-14T12:58:08.119603+0000","last_active":"2023-07-14T12:58:08.119603+0000","last_peered":"2023-07-14T12:58:08.119603+0000","last_clean":"2023-07-14T12:58:08.119603+0000","last_became_active":"2023-07-14T12:58:08.115814+0000","last_became_peered":"2023-07-14T12:58:08.115814+0000","last_unstale":"2023-07-14T12:58:08.119603+0000","last_undegraded":"2023-07-14T12:58:08.119603+0000","last_fullsized":"2023-07-14T12:58:08.119603+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:49.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867830+0000","last_change":"2023-07-14T12:58:07.967463+0000","last_active":"2023-07-14T12:59:06.867830+0000","last_peered":"2023-07-14T12:59:06.867830+0000","last_clean":"2023-07-14T12:59:06.867830+0000","last_became_active":"2023-07-14T12:58:07.967136+0000","last_became_peered":"2023-07-14T12:58:07.967136+0000","last_unstale":"2023-07-14T12:59:06.867830+0000","last_undegraded":"2023-07-14T12:59:06.867830+0000","last_fullsized":"2023-07-14T12:59:06.867830+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:53.152331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961797+0000","last_change":"2023-07-14T12:57:39.145352+0000","last_active":"2023-07-14T12:58:07.961797+0000","last_peered":"2023-07-14T12:58:07.961797+0000","last_clean":"2023-07-14T12:58:07.961797+0000","last_became_active":"2023-07-14T12:57:39.145018+0000","last_became_peered":"2023-07-14T12:57:39.145018+0000","last_unstale":"2023-07-14T12:58:07.961797+0000","last_undegraded":"2023-07-14T12:58:07.961797+0000","last_fullsized":"2023-07-14T12:58:07.961797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:46:13.836721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.865933+0000","last_change":"2023-07-14T12:57:40.173457+0000","last_active":"2023-07-14T12:59:06.865933+0000","last_peered":"2023-07-14T12:59:06.865933+0000","last_clean":"2023-07-14T12:59:06.865933+0000","last_became_active":"2023-07-14T12:57:40.173080+0000","last_became_peered":"2023-07-14T12:57:40.173080+0000","last_unstale":"2023-07-14T12:59:06.865933+0000","last_undegraded":"2023-07-14T12:59:06.865933+0000","last_fullsized":"2023-07-14T12:59:06.865933+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:18.222106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113467+0000","last_change":"2023-07-14T12:57:39.145383+0000","last_active":"2023-07-14T12:58:08.113467+0000","last_peered":"2023-07-14T12:58:08.113467+0000","last_clean":"2023-07-14T12:58:08.113467+0000","last_became_active":"2023-07-14T12:57:39.145088+0000","last_became_peered":"2023-07-14T12:57:39.145088+0000","last_unstale":"2023-07-14T12:58:08.113467+0000","last_undegraded":"2023-07-14T12:58:08.113467+0000","last_fullsized":"2023-07-14T12:58:08.113467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:32.979153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868706+0000","last_change":"2023-07-14T12:57:40.162123+0000","last_active":"2023-07-14T12:59:06.868706+0000","last_peered":"2023-07-14T12:59:06.868706+0000","last_clean":"2023-07-14T12:59:06.868706+0000","last_became_active":"2023-07-14T12:57:40.160789+0000","last_became_peered":"2023-07-14T12:57:40.160789+0000","last_unstale":"2023-07-14T12:59:06.868706+0000","last_undegraded":"2023-07-14T12:59:06.868706+0000","last_fullsized":"2023-07-14T12:59:06.868706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:24.181158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:23.188752+0000","last_change":"2023-07-14T12:57:39.139524+0000","last_active":"2023-07-14T12:59:23.188752+0000","last_peered":"2023-07-14T12:59:23.188752+0000","last_clean":"2023-07-14T12:59:23.188752+0000","last_became_active":"2023-07-14T12:57:39.139176+0000","last_became_peered":"2023-07-14T12:57:39.139176+0000","last_unstale":"2023-07-14T12:59:23.188752+0000","last_undegraded":"2023-07-14T12:59:23.188752+0000","last_fullsized":"2023-07-14T12:59:23.188752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:27.070260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.880493+0000","last_change":"2023-07-14T12:57:40.168729+0000","last_active":"2023-07-14T12:59:06.880493+0000","last_peered":"2023-07-14T12:59:06.880493+0000","last_clean":"2023-07-14T12:59:06.880493+0000","last_became_active":"2023-07-14T12:57:40.168408+0000","last_became_peered":"2023-07-14T12:57:40.168408+0000","last_unstale":"2023-07-14T12:59:06.880493+0000","last_undegraded":"2023-07-14T12:59:06.880493+0000","last_fullsized":"2023-07-14T12:59:06.880493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:58:20.491077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958510+0000","last_change":"2023-07-14T12:57:39.140744+0000","last_active":"2023-07-14T12:58:07.958510+0000","last_peered":"2023-07-14T12:58:07.958510+0000","last_clean":"2023-07-14T12:58:07.958510+0000","last_became_active":"2023-07-14T12:57:39.140391+0000","last_became_peered":"2023-07-14T12:57:39.140391+0000","last_unstale":"2023-07-14T12:58:07.958510+0000","last_undegraded":"2023-07-14T12:58:07.958510+0000","last_fullsized":"2023-07-14T12:58:07.958510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:01.023100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.873963+0000","last_change":"2023-07-14T12:57:40.165552+0000","last_active":"2023-07-14T12:59:06.873963+0000","last_peered":"2023-07-14T12:59:06.873963+0000","last_clean":"2023-07-14T12:59:06.873963+0000","last_became_active":"2023-07-14T12:57:40.165214+0000","last_became_peered":"2023-07-14T12:57:40.165214+0000","last_unstale":"2023-07-14T12:59:06.873963+0000","last_undegraded":"2023-07-14T12:59:06.873963+0000","last_fullsized":"2023-07-14T12:59:06.873963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:15.528292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113790+0000","last_change":"2023-07-14T12:57:39.150311+0000","last_active":"2023-07-14T12:58:08.113790+0000","last_peered":"2023-07-14T12:58:08.113790+0000","last_clean":"2023-07-14T12:58:08.113790+0000","last_became_active":"2023-07-14T12:57:39.149885+0000","last_became_peered":"2023-07-14T12:57:39.149885+0000","last_unstale":"2023-07-14T12:58:08.113790+0000","last_undegraded":"2023-07-14T12:58:08.113790+0000","last_fullsized":"2023-07-14T12:58:08.113790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:56.722568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878693+0000","last_change":"2023-07-14T12:57:40.161845+0000","last_active":"2023-07-14T12:59:06.878693+0000","last_peered":"2023-07-14T12:59:06.878693+0000","last_clean":"2023-07-14T12:59:06.878693+0000","last_became_active":"2023-07-14T12:57:40.160895+0000","last_became_peered":"2023-07-14T12:57:40.160895+0000","last_unstale":"2023-07-14T12:59:06.878693+0000","last_undegraded":"2023-07-14T12:59:06.878693+0000","last_fullsized":"2023-07-14T12:59:06.878693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:20:16.547464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'32","reported_seq":258,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:23.405124+0000","last_change":"2023-07-14T12:57:39.142584+0000","last_active":"2023-07-14T12:59:23.405124+0000","last_peered":"2023-07-14T12:59:23.405124+0000","last_clean":"2023-07-14T12:59:23.405124+0000","last_became_active":"2023-07-14T12:57:39.142239+0000","last_became_peered":"2023-07-14T12:57:39.142239+0000","last_unstale":"2023-07-14T12:59:23.405124+0000","last_undegraded":"2023-07-14T12:59:23.405124+0000","last_fullsized":"2023-07-14T12:59:23.405124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:56.022427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59844,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":162,"num_write":33,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.861434+0000","last_change":"2023-07-14T12:57:40.170013+0000","last_active":"2023-07-14T12:59:06.861434+0000","last_peered":"2023-07-14T12:59:06.861434+0000","last_clean":"2023-07-14T12:59:06.861434+0000","last_became_active":"2023-07-14T12:57:40.169177+0000","last_became_peered":"2023-07-14T12:57:40.169177+0000","last_unstale":"2023-07-14T12:59:06.861434+0000","last_undegraded":"2023-07-14T12:59:06.861434+0000","last_fullsized":"2023-07-14T12:59:06.861434+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:42.957456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.978704+0000","last_change":"2023-07-14T12:58:07.978239+0000","last_active":"2023-07-14T12:58:07.978704+0000","last_peered":"2023-07-14T12:58:07.978704+0000","last_clean":"2023-07-14T12:58:07.978704+0000","last_became_active":"2023-07-14T12:58:07.967195+0000","last_became_peered":"2023-07-14T12:58:07.967195+0000","last_unstale":"2023-07-14T12:58:07.978704+0000","last_undegraded":"2023-07-14T12:58:07.978704+0000","last_fullsized":"2023-07-14T12:58:07.978704+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:05.124879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.865208+0000","last_change":"2023-07-14T12:57:40.158098+0000","last_active":"2023-07-14T12:59:06.865208+0000","last_peered":"2023-07-14T12:59:06.865208+0000","last_clean":"2023-07-14T12:59:06.865208+0000","last_became_active":"2023-07-14T12:57:40.157736+0000","last_became_peered":"2023-07-14T12:57:40.157736+0000","last_unstale":"2023-07-14T12:59:06.865208+0000","last_undegraded":"2023-07-14T12:59:06.865208+0000","last_fullsized":"2023-07-14T12:59:06.865208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:04:59.371098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113762+0000","last_change":"2023-07-14T12:57:39.135784+0000","last_active":"2023-07-14T12:58:08.113762+0000","last_peered":"2023-07-14T12:58:08.113762+0000","last_clean":"2023-07-14T12:58:08.113762+0000","last_became_active":"2023-07-14T12:57:39.135480+0000","last_became_peered":"2023-07-14T12:57:39.135480+0000","last_unstale":"2023-07-14T12:58:08.113762+0000","last_undegraded":"2023-07-14T12:58:08.113762+0000","last_fullsized":"2023-07-14T12:58:08.113762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:33:37.574910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870560+0000","last_change":"2023-07-14T12:57:40.162548+0000","last_active":"2023-07-14T12:59:06.870560+0000","last_peered":"2023-07-14T12:59:06.870560+0000","last_clean":"2023-07-14T12:59:06.870560+0000","last_became_active":"2023-07-14T12:57:40.162191+0000","last_became_peered":"2023-07-14T12:57:40.162191+0000","last_unstale":"2023-07-14T12:59:06.870560+0000","last_undegraded":"2023-07-14T12:59:06.870560+0000","last_fullsized":"2023-07-14T12:59:06.870560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:04.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:23.416335+0000","last_change":"2023-07-14T12:57:39.145533+0000","last_active":"2023-07-14T12:59:23.416335+0000","last_peered":"2023-07-14T12:59:23.416335+0000","last_clean":"2023-07-14T12:59:23.416335+0000","last_became_active":"2023-07-14T12:57:39.145201+0000","last_became_peered":"2023-07-14T12:57:39.145201+0000","last_unstale":"2023-07-14T12:59:23.416335+0000","last_undegraded":"2023-07-14T12:59:23.416335+0000","last_fullsized":"2023-07-14T12:59:23.416335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:46.324639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1023,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.857816+0000","last_change":"2023-07-14T12:57:40.160047+0000","last_active":"2023-07-14T12:59:06.857816+0000","last_peered":"2023-07-14T12:59:06.857816+0000","last_clean":"2023-07-14T12:59:06.857816+0000","last_became_active":"2023-07-14T12:57:40.159751+0000","last_became_peered":"2023-07-14T12:57:40.159751+0000","last_unstale":"2023-07-14T12:59:06.857816+0000","last_undegraded":"2023-07-14T12:59:06.857816+0000","last_fullsized":"2023-07-14T12:59:06.857816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:16.874363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.130840+0000","last_change":"2023-07-14T12:58:08.130840+0000","last_active":"2023-07-14T12:58:08.130840+0000","last_peered":"2023-07-14T12:58:08.130840+0000","last_clean":"2023-07-14T12:58:08.130840+0000","last_became_active":"2023-07-14T12:58:08.116583+0000","last_became_peered":"2023-07-14T12:58:08.116583+0000","last_unstale":"2023-07-14T12:58:08.130840+0000","last_undegraded":"2023-07-14T12:58:08.130840+0000","last_fullsized":"2023-07-14T12:58:08.130840+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:07:34.361949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.875167+0000","last_change":"2023-07-14T12:57:40.173741+0000","last_active":"2023-07-14T12:59:06.875167+0000","last_peered":"2023-07-14T12:59:06.875167+0000","last_clean":"2023-07-14T12:59:06.875167+0000","last_became_active":"2023-07-14T12:57:40.173427+0000","last_became_peered":"2023-07-14T12:57:40.173427+0000","last_unstale":"2023-07-14T12:59:06.875167+0000","last_undegraded":"2023-07-14T12:59:06.875167+0000","last_fullsized":"2023-07-14T12:59:06.875167+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:41:16.366763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963223+0000","last_change":"2023-07-14T12:57:39.140979+0000","last_active":"2023-07-14T12:58:07.963223+0000","last_peered":"2023-07-14T12:58:07.963223+0000","last_clean":"2023-07-14T12:58:07.963223+0000","last_became_active":"2023-07-14T12:57:39.140692+0000","last_became_peered":"2023-07-14T12:57:39.140692+0000","last_unstale":"2023-07-14T12:58:07.963223+0000","last_undegraded":"2023-07-14T12:58:07.963223+0000","last_fullsized":"2023-07-14T12:58:07.963223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:01:09.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867229+0000","last_change":"2023-07-14T12:57:40.164258+0000","last_active":"2023-07-14T12:59:06.867229+0000","last_peered":"2023-07-14T12:59:06.867229+0000","last_clean":"2023-07-14T12:59:06.867229+0000","last_became_active":"2023-07-14T12:57:40.163911+0000","last_became_peered":"2023-07-14T12:57:40.163911+0000","last_unstale":"2023-07-14T12:59:06.867229+0000","last_undegraded":"2023-07-14T12:59:06.867229+0000","last_fullsized":"2023-07-14T12:59:06.867229+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:45.474358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959321+0000","last_change":"2023-07-14T12:57:39.151301+0000","last_active":"2023-07-14T12:58:07.959321+0000","last_peered":"2023-07-14T12:58:07.959321+0000","last_clean":"2023-07-14T12:58:07.959321+0000","last_became_active":"2023-07-14T12:57:39.150948+0000","last_became_peered":"2023-07-14T12:57:39.150948+0000","last_unstale":"2023-07-14T12:58:07.959321+0000","last_undegraded":"2023-07-14T12:58:07.959321+0000","last_fullsized":"2023-07-14T12:58:07.959321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:11.221824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869578+0000","last_change":"2023-07-14T12:57:40.158591+0000","last_active":"2023-07-14T12:59:06.869578+0000","last_peered":"2023-07-14T12:59:06.869578+0000","last_clean":"2023-07-14T12:59:06.869578+0000","last_became_active":"2023-07-14T12:57:40.158229+0000","last_became_peered":"2023-07-14T12:57:40.158229+0000","last_unstale":"2023-07-14T12:59:06.869578+0000","last_undegraded":"2023-07-14T12:59:06.869578+0000","last_fullsized":"2023-07-14T12:59:06.869578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:48.116113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957827+0000","last_change":"2023-07-14T12:57:39.152151+0000","last_active":"2023-07-14T12:58:07.957827+0000","last_peered":"2023-07-14T12:58:07.957827+0000","last_clean":"2023-07-14T12:58:07.957827+0000","last_became_active":"2023-07-14T12:57:39.151859+0000","last_became_peered":"2023-07-14T12:57:39.151859+0000","last_unstale":"2023-07-14T12:58:07.957827+0000","last_undegraded":"2023-07-14T12:58:07.957827+0000","last_fullsized":"2023-07-14T12:58:07.957827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:19:10.573132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867586+0000","last_change":"2023-07-14T12:57:40.166604+0000","last_active":"2023-07-14T12:59:06.867586+0000","last_peered":"2023-07-14T12:59:06.867586+0000","last_clean":"2023-07-14T12:59:06.867586+0000","last_became_active":"2023-07-14T12:57:40.166265+0000","last_became_peered":"2023-07-14T12:57:40.166265+0000","last_unstale":"2023-07-14T12:59:06.867586+0000","last_undegraded":"2023-07-14T12:59:06.867586+0000","last_fullsized":"2023-07-14T12:59:06.867586+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:01.157573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.865245+0000","last_change":"2023-07-14T12:57:40.169910+0000","last_active":"2023-07-14T12:59:06.865245+0000","last_peered":"2023-07-14T12:59:06.865245+0000","last_clean":"2023-07-14T12:59:06.865245+0000","last_became_active":"2023-07-14T12:57:40.169621+0000","last_became_peered":"2023-07-14T12:57:40.169621+0000","last_unstale":"2023-07-14T12:59:06.865245+0000","last_undegraded":"2023-07-14T12:59:06.865245+0000","last_fullsized":"2023-07-14T12:59:06.865245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:14.831482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:26.422239+0000","last_change":"2023-07-14T12:57:39.144463+0000","last_active":"2023-07-14T12:59:26.422239+0000","last_peered":"2023-07-14T12:59:26.422239+0000","last_clean":"2023-07-14T12:59:26.422239+0000","last_became_active":"2023-07-14T12:57:39.142094+0000","last_became_peered":"2023-07-14T12:57:39.142094+0000","last_unstale":"2023-07-14T12:59:26.422239+0000","last_undegraded":"2023-07-14T12:59:26.422239+0000","last_fullsized":"2023-07-14T12:59:26.422239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:11:20.958238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.876605+0000","last_change":"2023-07-14T12:57:40.163588+0000","last_active":"2023-07-14T12:59:06.876605+0000","last_peered":"2023-07-14T12:59:06.876605+0000","last_clean":"2023-07-14T12:59:06.876605+0000","last_became_active":"2023-07-14T12:57:40.162611+0000","last_became_peered":"2023-07-14T12:57:40.162611+0000","last_unstale":"2023-07-14T12:59:06.876605+0000","last_undegraded":"2023-07-14T12:59:06.876605+0000","last_fullsized":"2023-07-14T12:59:06.876605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:21:59.184916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113974+0000","last_change":"2023-07-14T12:57:39.143581+0000","last_active":"2023-07-14T12:58:08.113974+0000","last_peered":"2023-07-14T12:58:08.113974+0000","last_clean":"2023-07-14T12:58:08.113974+0000","last_became_active":"2023-07-14T12:57:39.143257+0000","last_became_peered":"2023-07-14T12:57:39.143257+0000","last_unstale":"2023-07-14T12:58:08.113974+0000","last_undegraded":"2023-07-14T12:58:08.113974+0000","last_fullsized":"2023-07-14T12:58:08.113974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:30.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":351,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957918+0000","last_change":"2023-07-14T12:56:23.360103+0000","last_active":"2023-07-14T12:58:07.957918+0000","last_peered":"2023-07-14T12:58:07.957918+0000","last_clean":"2023-07-14T12:58:07.957918+0000","last_became_active":"2023-07-14T12:56:23.359608+0000","last_became_peered":"2023-07-14T12:56:23.359608+0000","last_unstale":"2023-07-14T12:58:07.957918+0000","last_undegraded":"2023-07-14T12:58:07.957918+0000","last_fullsized":"2023-07-14T12:58:07.957918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.397328+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:52:52.622736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869371+0000","last_change":"2023-07-14T12:57:40.158039+0000","last_active":"2023-07-14T12:59:06.869371+0000","last_peered":"2023-07-14T12:59:06.869371+0000","last_clean":"2023-07-14T12:59:06.869371+0000","last_became_active":"2023-07-14T12:57:40.157629+0000","last_became_peered":"2023-07-14T12:57:40.157629+0000","last_unstale":"2023-07-14T12:59:06.869371+0000","last_undegraded":"2023-07-14T12:59:06.869371+0000","last_fullsized":"2023-07-14T12:59:06.869371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:18.205760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958150+0000","last_change":"2023-07-14T12:57:39.146449+0000","last_active":"2023-07-14T12:58:07.958150+0000","last_peered":"2023-07-14T12:58:07.958150+0000","last_clean":"2023-07-14T12:58:07.958150+0000","last_became_active":"2023-07-14T12:57:39.146109+0000","last_became_peered":"2023-07-14T12:57:39.146109+0000","last_unstale":"2023-07-14T12:58:07.958150+0000","last_undegraded":"2023-07-14T12:58:07.958150+0000","last_fullsized":"2023-07-14T12:58:07.958150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:15.222237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963386+0000","last_change":"2023-07-14T12:57:39.149417+0000","last_active":"2023-07-14T12:58:07.963386+0000","last_peered":"2023-07-14T12:58:07.963386+0000","last_clean":"2023-07-14T12:58:07.963386+0000","last_became_active":"2023-07-14T12:57:39.149097+0000","last_became_peered":"2023-07-14T12:57:39.149097+0000","last_unstale":"2023-07-14T12:58:07.963386+0000","last_undegraded":"2023-07-14T12:58:07.963386+0000","last_fullsized":"2023-07-14T12:58:07.963386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:10.550476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868801+0000","last_change":"2023-07-14T12:57:40.160881+0000","last_active":"2023-07-14T12:59:06.868801+0000","last_peered":"2023-07-14T12:59:06.868801+0000","last_clean":"2023-07-14T12:59:06.868801+0000","last_became_active":"2023-07-14T12:57:40.158570+0000","last_became_peered":"2023-07-14T12:57:40.158570+0000","last_unstale":"2023-07-14T12:59:06.868801+0000","last_undegraded":"2023-07-14T12:59:06.868801+0000","last_fullsized":"2023-07-14T12:59:06.868801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:46.644633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:08.903948+0000","last_change":"2023-07-14T12:57:39.142805+0000","last_active":"2023-07-14T12:59:08.903948+0000","last_peered":"2023-07-14T12:59:08.903948+0000","last_clean":"2023-07-14T12:59:08.903948+0000","last_became_active":"2023-07-14T12:57:39.142417+0000","last_became_peered":"2023-07-14T12:57:39.142417+0000","last_unstale":"2023-07-14T12:59:08.903948+0000","last_undegraded":"2023-07-14T12:59:08.903948+0000","last_fullsized":"2023-07-14T12:59:08.903948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:01:14.949862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866590+0000","last_change":"2023-07-14T12:57:40.171695+0000","last_active":"2023-07-14T12:59:06.866590+0000","last_peered":"2023-07-14T12:59:06.866590+0000","last_clean":"2023-07-14T12:59:06.866590+0000","last_became_active":"2023-07-14T12:57:40.171344+0000","last_became_peered":"2023-07-14T12:57:40.171344+0000","last_unstale":"2023-07-14T12:59:06.866590+0000","last_undegraded":"2023-07-14T12:59:06.866590+0000","last_fullsized":"2023-07-14T12:59:06.866590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:49.528964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113794+0000","last_change":"2023-07-14T12:57:39.141065+0000","last_active":"2023-07-14T12:58:08.113794+0000","last_peered":"2023-07-14T12:58:08.113794+0000","last_clean":"2023-07-14T12:58:08.113794+0000","last_became_active":"2023-07-14T12:57:39.140681+0000","last_became_peered":"2023-07-14T12:57:39.140681+0000","last_unstale":"2023-07-14T12:58:08.113794+0000","last_undegraded":"2023-07-14T12:58:08.113794+0000","last_fullsized":"2023-07-14T12:58:08.113794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:38:35.851889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.872326+0000","last_change":"2023-07-14T12:57:40.158403+0000","last_active":"2023-07-14T12:59:06.872326+0000","last_peered":"2023-07-14T12:59:06.872326+0000","last_clean":"2023-07-14T12:59:06.872326+0000","last_became_active":"2023-07-14T12:57:40.158077+0000","last_became_peered":"2023-07-14T12:57:40.158077+0000","last_unstale":"2023-07-14T12:59:06.872326+0000","last_undegraded":"2023-07-14T12:59:06.872326+0000","last_fullsized":"2023-07-14T12:59:06.872326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:27:14.759138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.112919+0000","last_change":"2023-07-14T12:57:39.139613+0000","last_active":"2023-07-14T12:58:08.112919+0000","last_peered":"2023-07-14T12:58:08.112919+0000","last_clean":"2023-07-14T12:58:08.112919+0000","last_became_active":"2023-07-14T12:57:39.139306+0000","last_became_peered":"2023-07-14T12:57:39.139306+0000","last_unstale":"2023-07-14T12:58:08.112919+0000","last_undegraded":"2023-07-14T12:58:08.112919+0000","last_fullsized":"2023-07-14T12:58:08.112919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:16:13.426604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.831149+0000","last_change":"2023-07-14T12:57:40.169715+0000","last_active":"2023-07-14T12:59:06.831149+0000","last_peered":"2023-07-14T12:59:06.831149+0000","last_clean":"2023-07-14T12:59:06.831149+0000","last_became_active":"2023-07-14T12:57:40.169319+0000","last_became_peered":"2023-07-14T12:57:40.169319+0000","last_unstale":"2023-07-14T12:59:06.831149+0000","last_undegraded":"2023-07-14T12:59:06.831149+0000","last_fullsized":"2023-07-14T12:59:06.831149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:49.187041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.964905+0000","last_change":"2023-07-14T12:57:39.134058+0000","last_active":"2023-07-14T12:58:07.964905+0000","last_peered":"2023-07-14T12:58:07.964905+0000","last_clean":"2023-07-14T12:58:07.964905+0000","last_became_active":"2023-07-14T12:57:39.133143+0000","last_became_peered":"2023-07-14T12:57:39.133143+0000","last_unstale":"2023-07-14T12:58:07.964905+0000","last_undegraded":"2023-07-14T12:58:07.964905+0000","last_fullsized":"2023-07-14T12:58:07.964905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:22:41.049828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.875376+0000","last_change":"2023-07-14T12:57:40.164106+0000","last_active":"2023-07-14T12:59:06.875376+0000","last_peered":"2023-07-14T12:59:06.875376+0000","last_clean":"2023-07-14T12:59:06.875376+0000","last_became_active":"2023-07-14T12:57:40.163768+0000","last_became_peered":"2023-07-14T12:57:40.163768+0000","last_unstale":"2023-07-14T12:59:06.875376+0000","last_undegraded":"2023-07-14T12:59:06.875376+0000","last_fullsized":"2023-07-14T12:59:06.875376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:27.922121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.971006+0000","last_change":"2023-07-14T12:58:07.970517+0000","last_active":"2023-07-14T12:58:07.971006+0000","last_peered":"2023-07-14T12:58:07.971006+0000","last_clean":"2023-07-14T12:58:07.971006+0000","last_became_active":"2023-07-14T12:58:07.967121+0000","last_became_peered":"2023-07-14T12:58:07.967121+0000","last_unstale":"2023-07-14T12:58:07.971006+0000","last_undegraded":"2023-07-14T12:58:07.971006+0000","last_fullsized":"2023-07-14T12:58:07.971006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:48:35.651155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.871293+0000","last_change":"2023-07-14T12:57:40.163373+0000","last_active":"2023-07-14T12:59:06.871293+0000","last_peered":"2023-07-14T12:59:06.871293+0000","last_clean":"2023-07-14T12:59:06.871293+0000","last_became_active":"2023-07-14T12:57:40.162852+0000","last_became_peered":"2023-07-14T12:57:40.162852+0000","last_unstale":"2023-07-14T12:59:06.871293+0000","last_undegraded":"2023-07-14T12:59:06.871293+0000","last_fullsized":"2023-07-14T12:59:06.871293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:38.396243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963013+0000","last_change":"2023-07-14T12:57:39.143961+0000","last_active":"2023-07-14T12:58:07.963013+0000","last_peered":"2023-07-14T12:58:07.963013+0000","last_clean":"2023-07-14T12:58:07.963013+0000","last_became_active":"2023-07-14T12:57:39.143599+0000","last_became_peered":"2023-07-14T12:57:39.143599+0000","last_unstale":"2023-07-14T12:58:07.963013+0000","last_undegraded":"2023-07-14T12:58:07.963013+0000","last_fullsized":"2023-07-14T12:58:07.963013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:25.216766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878725+0000","last_change":"2023-07-14T12:57:40.157972+0000","last_active":"2023-07-14T12:59:06.878725+0000","last_peered":"2023-07-14T12:59:06.878725+0000","last_clean":"2023-07-14T12:59:06.878725+0000","last_became_active":"2023-07-14T12:57:40.157645+0000","last_became_peered":"2023-07-14T12:57:40.157645+0000","last_unstale":"2023-07-14T12:59:06.878725+0000","last_undegraded":"2023-07-14T12:59:06.878725+0000","last_fullsized":"2023-07-14T12:59:06.878725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:54:33.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965731+0000","last_change":"2023-07-14T12:57:39.153405+0000","last_active":"2023-07-14T12:58:07.965731+0000","last_peered":"2023-07-14T12:58:07.965731+0000","last_clean":"2023-07-14T12:58:07.965731+0000","last_became_active":"2023-07-14T12:57:39.153029+0000","last_became_peered":"2023-07-14T12:57:39.153029+0000","last_unstale":"2023-07-14T12:58:07.965731+0000","last_undegraded":"2023-07-14T12:58:07.965731+0000","last_fullsized":"2023-07-14T12:58:07.965731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:47:58.753892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.877188+0000","last_change":"2023-07-14T12:57:40.163910+0000","last_active":"2023-07-14T12:59:06.877188+0000","last_peered":"2023-07-14T12:59:06.877188+0000","last_clean":"2023-07-14T12:59:06.877188+0000","last_became_active":"2023-07-14T12:57:40.163539+0000","last_became_peered":"2023-07-14T12:57:40.163539+0000","last_unstale":"2023-07-14T12:59:06.877188+0000","last_undegraded":"2023-07-14T12:59:06.877188+0000","last_fullsized":"2023-07-14T12:59:06.877188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:12.543412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113454+0000","last_change":"2023-07-14T12:57:39.132649+0000","last_active":"2023-07-14T12:58:08.113454+0000","last_peered":"2023-07-14T12:58:08.113454+0000","last_clean":"2023-07-14T12:58:08.113454+0000","last_became_active":"2023-07-14T12:57:39.132295+0000","last_became_peered":"2023-07-14T12:57:39.132295+0000","last_unstale":"2023-07-14T12:58:08.113454+0000","last_undegraded":"2023-07-14T12:58:08.113454+0000","last_fullsized":"2023-07-14T12:58:08.113454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:19.495427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.862100+0000","last_change":"2023-07-14T12:57:40.166285+0000","last_active":"2023-07-14T12:59:06.862100+0000","last_peered":"2023-07-14T12:59:06.862100+0000","last_clean":"2023-07-14T12:59:06.862100+0000","last_became_active":"2023-07-14T12:57:40.165968+0000","last_became_peered":"2023-07-14T12:57:40.165968+0000","last_unstale":"2023-07-14T12:59:06.862100+0000","last_undegraded":"2023-07-14T12:59:06.862100+0000","last_fullsized":"2023-07-14T12:59:06.862100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:22.071229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961885+0000","last_change":"2023-07-14T12:57:39.150988+0000","last_active":"2023-07-14T12:58:07.961885+0000","last_peered":"2023-07-14T12:58:07.961885+0000","last_clean":"2023-07-14T12:58:07.961885+0000","last_became_active":"2023-07-14T12:57:39.150552+0000","last_became_peered":"2023-07-14T12:57:39.150552+0000","last_unstale":"2023-07-14T12:58:07.961885+0000","last_undegraded":"2023-07-14T12:58:07.961885+0000","last_fullsized":"2023-07-14T12:58:07.961885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:04:27.733757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868282+0000","last_change":"2023-07-14T12:57:40.169729+0000","last_active":"2023-07-14T12:59:06.868282+0000","last_peered":"2023-07-14T12:59:06.868282+0000","last_clean":"2023-07-14T12:59:06.868282+0000","last_became_active":"2023-07-14T12:57:40.169432+0000","last_became_peered":"2023-07-14T12:57:40.169432+0000","last_unstale":"2023-07-14T12:59:06.868282+0000","last_undegraded":"2023-07-14T12:59:06.868282+0000","last_fullsized":"2023-07-14T12:59:06.868282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:27:50.731427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867770+0000","last_change":"2023-07-14T12:57:40.167668+0000","last_active":"2023-07-14T12:59:06.867770+0000","last_peered":"2023-07-14T12:59:06.867770+0000","last_clean":"2023-07-14T12:59:06.867770+0000","last_became_active":"2023-07-14T12:57:40.167328+0000","last_became_peered":"2023-07-14T12:57:40.167328+0000","last_unstale":"2023-07-14T12:59:06.867770+0000","last_undegraded":"2023-07-14T12:59:06.867770+0000","last_fullsized":"2023-07-14T12:59:06.867770+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:24.623266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.861260+0000","last_change":"2023-07-14T12:57:40.161340+0000","last_active":"2023-07-14T12:59:06.861260+0000","last_peered":"2023-07-14T12:59:06.861260+0000","last_clean":"2023-07-14T12:59:06.861260+0000","last_became_active":"2023-07-14T12:57:40.161024+0000","last_became_peered":"2023-07-14T12:57:40.161024+0000","last_unstale":"2023-07-14T12:59:06.861260+0000","last_undegraded":"2023-07-14T12:59:06.861260+0000","last_fullsized":"2023-07-14T12:59:06.861260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:56.043017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870956+0000","last_change":"2023-07-14T12:57:40.159287+0000","last_active":"2023-07-14T12:59:06.870956+0000","last_peered":"2023-07-14T12:59:06.870956+0000","last_clean":"2023-07-14T12:59:06.870956+0000","last_became_active":"2023-07-14T12:57:40.158889+0000","last_became_peered":"2023-07-14T12:57:40.158889+0000","last_unstale":"2023-07-14T12:59:06.870956+0000","last_undegraded":"2023-07-14T12:59:06.870956+0000","last_fullsized":"2023-07-14T12:59:06.870956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:27.078113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.874752+0000","last_change":"2023-07-14T12:57:40.168898+0000","last_active":"2023-07-14T12:59:06.874752+0000","last_peered":"2023-07-14T12:59:06.874752+0000","last_clean":"2023-07-14T12:59:06.874752+0000","last_became_active":"2023-07-14T12:57:40.168596+0000","last_became_peered":"2023-07-14T12:57:40.168596+0000","last_unstale":"2023-07-14T12:59:06.874752+0000","last_undegraded":"2023-07-14T12:59:06.874752+0000","last_fullsized":"2023-07-14T12:59:06.874752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:18.836992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.873481+0000","last_change":"2023-07-14T12:57:40.156267+0000","last_active":"2023-07-14T12:59:06.873481+0000","last_peered":"2023-07-14T12:59:06.873481+0000","last_clean":"2023-07-14T12:59:06.873481+0000","last_became_active":"2023-07-14T12:57:40.155909+0000","last_became_peered":"2023-07-14T12:57:40.155909+0000","last_unstale":"2023-07-14T12:59:06.873481+0000","last_undegraded":"2023-07-14T12:59:06.873481+0000","last_fullsized":"2023-07-14T12:59:06.873481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:07.081173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866738+0000","last_change":"2023-07-14T12:57:40.162956+0000","last_active":"2023-07-14T12:59:06.866738+0000","last_peered":"2023-07-14T12:59:06.866738+0000","last_clean":"2023-07-14T12:59:06.866738+0000","last_became_active":"2023-07-14T12:57:40.162373+0000","last_became_peered":"2023-07-14T12:57:40.162373+0000","last_unstale":"2023-07-14T12:59:06.866738+0000","last_undegraded":"2023-07-14T12:59:06.866738+0000","last_fullsized":"2023-07-14T12:59:06.866738+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:15.307049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.879456+0000","last_change":"2023-07-14T12:57:40.158655+0000","last_active":"2023-07-14T12:59:06.879456+0000","last_peered":"2023-07-14T12:59:06.879456+0000","last_clean":"2023-07-14T12:59:06.879456+0000","last_became_active":"2023-07-14T12:57:40.158290+0000","last_became_peered":"2023-07-14T12:57:40.158290+0000","last_unstale":"2023-07-14T12:59:06.879456+0000","last_undegraded":"2023-07-14T12:59:06.879456+0000","last_fullsized":"2023-07-14T12:59:06.879456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:02:22.373566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.859587+0000","last_change":"2023-07-14T12:57:40.164132+0000","last_active":"2023-07-14T12:59:06.859587+0000","last_peered":"2023-07-14T12:59:06.859587+0000","last_clean":"2023-07-14T12:59:06.859587+0000","last_became_active":"2023-07-14T12:57:40.163774+0000","last_became_peered":"2023-07-14T12:57:40.163774+0000","last_unstale":"2023-07-14T12:59:06.859587+0000","last_undegraded":"2023-07-14T12:59:06.859587+0000","last_fullsized":"2023-07-14T12:59:06.859587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:30.562785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868125+0000","last_change":"2023-07-14T12:57:40.171046+0000","last_active":"2023-07-14T12:59:06.868125+0000","last_peered":"2023-07-14T12:59:06.868125+0000","last_clean":"2023-07-14T12:59:06.868125+0000","last_became_active":"2023-07-14T12:57:40.170727+0000","last_became_peered":"2023-07-14T12:57:40.170727+0000","last_unstale":"2023-07-14T12:59:06.868125+0000","last_undegraded":"2023-07-14T12:59:06.868125+0000","last_fullsized":"2023-07-14T12:59:06.868125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:44.795580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.864235+0000","last_change":"2023-07-14T12:57:40.171636+0000","last_active":"2023-07-14T12:59:06.864235+0000","last_peered":"2023-07-14T12:59:06.864235+0000","last_clean":"2023-07-14T12:59:06.864235+0000","last_became_active":"2023-07-14T12:57:40.171365+0000","last_became_peered":"2023-07-14T12:57:40.171365+0000","last_unstale":"2023-07-14T12:59:06.864235+0000","last_undegraded":"2023-07-14T12:59:06.864235+0000","last_fullsized":"2023-07-14T12:59:06.864235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:10.582323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878104+0000","last_change":"2023-07-14T12:57:40.162963+0000","last_active":"2023-07-14T12:59:06.878104+0000","last_peered":"2023-07-14T12:59:06.878104+0000","last_clean":"2023-07-14T12:59:06.878104+0000","last_became_active":"2023-07-14T12:57:40.162614+0000","last_became_peered":"2023-07-14T12:57:40.162614+0000","last_unstale":"2023-07-14T12:59:06.878104+0000","last_undegraded":"2023-07-14T12:59:06.878104+0000","last_fullsized":"2023-07-14T12:59:06.878104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:46.953808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.873797+0000","last_change":"2023-07-14T12:57:40.156138+0000","last_active":"2023-07-14T12:59:06.873797+0000","last_peered":"2023-07-14T12:59:06.873797+0000","last_clean":"2023-07-14T12:59:06.873797+0000","last_became_active":"2023-07-14T12:57:40.155785+0000","last_became_peered":"2023-07-14T12:57:40.155785+0000","last_unstale":"2023-07-14T12:59:06.873797+0000","last_undegraded":"2023-07-14T12:59:06.873797+0000","last_fullsized":"2023-07-14T12:59:06.873797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:45.189290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866624+0000","last_change":"2023-07-14T12:57:40.163978+0000","last_active":"2023-07-14T12:59:06.866624+0000","last_peered":"2023-07-14T12:59:06.866624+0000","last_clean":"2023-07-14T12:59:06.866624+0000","last_became_active":"2023-07-14T12:57:40.163620+0000","last_became_peered":"2023-07-14T12:57:40.163620+0000","last_unstale":"2023-07-14T12:59:06.866624+0000","last_undegraded":"2023-07-14T12:59:06.866624+0000","last_fullsized":"2023-07-14T12:59:06.866624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:48.986548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":215126,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64324,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":630,"num_read_kb":384,"num_write":161,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":146,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":192972,"data_compressed":4806,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351010,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":459210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":9.1430000000000007,"5min":9.1430000000000007,"15min":9.1430000000000007},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67600000000000005,"15min":0.68799999999999994},"min":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92800000000000005,"5min":1.097,"15min":1.097},"last":0.64800000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59899999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.042,"5min":1.111,"15min":1.111},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93300000000000005,"5min":1.341,"15min":1.341},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.41499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92500000000000004,"5min":1.347,"15min":1.347},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92800000000000005,"5min":1.506,"15min":1.506},"last":0.84799999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.3959999999999999,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81799999999999995,"15min":0.81399999999999995},"min":{"1min":0.623,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0640000000000001,"5min":1.542,"15min":1.542},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.80500000000000005},"min":{"1min":0.51500000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":1.411,"15min":1.411},"last":1.024}]},{"osd":5,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94299999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.79700000000000004,"15min":0.80400000000000005},"min":{"1min":0.46600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.028,"5min":1.881,"15min":1.881},"last":0.94499999999999995}]},{"osd":6,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92600000000000005,"15min":0.92800000000000005},"min":{"1min":0.74199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1220000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.95599999999999996,"5min":1.373,"15min":1.373},"last":0.92800000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":1.097},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.1180000000000001}]},{"osd":9,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.96099999999999997,"15min":0.91800000000000004},"min":{"1min":0.66300000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":9.2210000000000001,"5min":9.2210000000000001,"15min":9.2210000000000001},"last":1.133},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96399999999999997,"15min":0.96099999999999997},"min":{"1min":0.70799999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.1679999999999999}]},{"osd":10,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.68000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.093,"5min":1.633,"15min":1.633},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.95199999999999996,"15min":0.95999999999999996},"min":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.069,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1579999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612647,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1097728,"data_stored":1110942,"data_compressed":37730,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82699999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.034,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.92000000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85999999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.82299999999999995}]},{"osd":4,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89800000000000002,"5min":1.391,"15min":1.391},"last":0.75}]},{"osd":5,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.65700000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95599999999999996,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.996,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.95299999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.90000000000000002,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.83999999999999997,"15min":0.86299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93899999999999995,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.872}]},{"osd":7,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.86599999999999999,"15min":0.874},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.98099999999999998,"5min":1.298,"15min":1.298},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92200000000000004,"15min":0.93600000000000005},"min":{"1min":0.61199999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.018,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.92200000000000004}]},{"osd":9,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.94599999999999995,"15min":0.96999999999999997},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":0.998,"5min":1.746,"15min":1.746},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.052,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.85299999999999998}]},{"osd":11,"last update":"Fri Jul 14 12:58:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91200000000000003,"15min":0.91700000000000004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.069,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.145,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.032}]}]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.0150000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.80300000000000005},"min":{"1min":0.53000000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.3120000000000001,"5min":1.383,"15min":1.383},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.753,"15min":0.747},"min":{"1min":0.51400000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.68400000000000005,"15min":0.68100000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":3.4550000000000001,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.2050000000000001,"5min":3.2050000000000001,"15min":3.2050000000000001},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.83799999999999997,"15min":0.88400000000000001},"min":{"1min":0.54000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85699999999999998,"15min":0.89300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.89500000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.623},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85599999999999998,"15min":0.879},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86099999999999999,"15min":0.89000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":3.173,"5min":3.173,"15min":3.173},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.88900000000000001,"15min":0.93999999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.94399999999999995,"15min":0.98099999999999998},"min":{"1min":0.61799999999999999,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.97799999999999998,"15min":1.014},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":0.73199999999999998}]},{"osd":8,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.95999999999999996,"15min":1.012},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3109999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.97499999999999998,"15min":1.0209999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.66900000000000004}]},{"osd":10,"last update":"Fri Jul 14 12:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.96899999999999997},"min":{"1min":0.622,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1879999999999999,"5min":3.1389999999999998,"15min":3.1389999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.70399999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.82399999999999995}]}]},{"osd":8,"up_from":60,"seq":257698037812,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6559999999999999,"5min":1.855,"15min":1.855},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6220000000000001,"5min":1.847,"15min":1.847},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.52800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.746,"15min":0.73499999999999999},"min":{"1min":0.625,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.024,"5min":1.802,"15min":1.802},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.628,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1200000000000001,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.67300000000000004}]},{"osd":3,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.90300000000000002,"15min":0.97799999999999998},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5249999999999999,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82899999999999996,"15min":0.85999999999999999},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.48,"5min":1.825,"15min":1.825},"last":0.78200000000000003}]},{"osd":4,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.137,"5min":1.3,"15min":1.3},"last":0.88},{"interface":"front","average":{"1min":0.75,"5min":0.80100000000000005,"15min":0.81000000000000005},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94599999999999995,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75800000000000001,"15min":0.78400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0720000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.93700000000000006},"min":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.575,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.92600000000000005,"15min":0.95099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1899999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.014,"5min":1.73,"15min":1.73},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.92400000000000004,"15min":0.93500000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2490000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.999}]},{"osd":9,"last update":"Fri Jul 14 12:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.71799999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3779999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.018},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88500000000000001,"15min":0.89100000000000001},"min":{"1min":0.69199999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.93899999999999995}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.91600000000000004,"15min":0.88600000000000001},"min":{"1min":0.79900000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.127,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88700000000000001,"15min":0.86899999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.103,"5min":1.161,"15min":1.161},"last":0.89600000000000002}]},{"osd":11,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.103}]}]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":1011712,"data_stored":1051416,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66900000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81499999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.016,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.54200000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.85299999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77700000000000002,"15min":0.76500000000000001},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.091,"5min":1.397,"15min":1.397},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.70599999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0009999999999999,"5min":1.169,"15min":1.169},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.67900000000000005,"15min":0.70799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.81000000000000005,"15min":0.84199999999999997},"min":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.83399999999999996},"min":{"1min":0.61799999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84199999999999997,"15min":0.85499999999999998},"min":{"1min":0.55800000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.85799999999999998,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.1459999999999999,"5min":1.639,"15min":1.639},"last":0.89100000000000001}]},{"osd":8,"last update":"Fri Jul 14 12:58:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.82799999999999996,"15min":0.80400000000000005},"min":{"1min":0.69399999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83599999999999997,"15min":0.82599999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.78000000000000003}]},{"osd":9,"last update":"Fri Jul 14 12:59:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.405,"5min":1.004,"15min":0.93200000000000005},"min":{"1min":0.67300000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":9.7870000000000008,"5min":9.7870000000000008,"15min":9.7870000000000008},"last":0.873}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88900000000000001,"15min":0.91700000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.135,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93000000000000005,"15min":0.93400000000000005},"min":{"1min":0.64100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1699999999999999,"5min":1.276,"15min":1.276},"last":0.60699999999999998}]},{"osd":11,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.92900000000000005}]}]},{"osd":6,"up_from":47,"seq":201863462974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":458807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53300000000000003,"15min":0.51200000000000001},"min":{"1min":0.34499999999999997,"5min":0.307,"15min":0.307},"max":{"1min":1.458,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.847,"5min":2.081,"15min":2.081},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.71899999999999997},"min":{"1min":0.54600000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77400000000000002,"15min":0.73499999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.6319999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.755}]},{"osd":2,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.73499999999999999,"15min":0.70799999999999996},"min":{"1min":0.52900000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.59299999999999997,"5min":0.44,"15min":0.44},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68999999999999995,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.45900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.706,"5min":2.113,"15min":2.113},"last":0.504}]},{"osd":4,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.752,"15min":0.73199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.59599999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.83399999999999996,"15min":0.84599999999999997},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85299999999999998,"15min":0.83299999999999996},"min":{"1min":0.64400000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84499999999999997,"15min":0.82399999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.74099999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.89600000000000002,"15min":0.91700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93200000000000005,"15min":0.94999999999999996},"min":{"1min":0.72399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.625}]},{"osd":9,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.878,"15min":0.91300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.93600000000000005,"15min":0.97399999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5940000000000001,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.80800000000000005}]},{"osd":10,"last update":"Fri Jul 14 12:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":1.0309999999999999,"15min":1.091},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":0.91500000000000004,"5min":4.109,"15min":4.109},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.93200000000000005,"15min":0.93899999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.98999999999999999,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":1007616,"data_stored":518165,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.625,"15min":0.57299999999999995},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":1.038,"15min":1.038},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65900000000000003,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40799999999999997,"15min":0.40500000000000003},"max":{"1min":1.024,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.76400000000000001,"15min":0.66100000000000003},"min":{"1min":0.69299999999999995,"5min":0.41099999999999998,"15min":0.34000000000000002},"max":{"1min":1.127,"5min":1.131,"15min":1.131},"last":1.2},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.70699999999999996,"15min":0.65500000000000003},"min":{"1min":0.64100000000000001,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.98099999999999998,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.90900000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.55400000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94099999999999995,"5min":0.997,"15min":0.997},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.018,"5min":0.81299999999999994,"15min":0.73099999999999998},"min":{"1min":0.61299999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":5.1369999999999996,"5min":5.1369999999999996,"15min":5.1369999999999996},"last":1.0800000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.61299999999999999,"15min":0.54700000000000004},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0580000000000001,"5min":1.079,"15min":1.079},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.44500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85599999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Jul 14 12:59:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.74399999999999999,"15min":0.68500000000000005},"min":{"1min":0.56899999999999995,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0149999999999999,"5min":1.115,"15min":1.115},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.76200000000000001,"15min":0.72599999999999998},"min":{"1min":0.66700000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0820000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.95799999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74299999999999999,"15min":0.70899999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0960000000000001,"5min":0.875,"15min":0.80700000000000005},"min":{"1min":0.56899999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":5.1749999999999998,"5min":5.1749999999999998,"15min":5.1749999999999998},"last":1.2350000000000001}]},{"osd":7,"last update":"Fri Jul 14 12:59:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.79800000000000004,"15min":0.71999999999999997},"min":{"1min":0.66500000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2330000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.73699999999999999,"15min":0.65300000000000002},"min":{"1min":0.60299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1439999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.97299999999999998}]},{"osd":8,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.83899999999999997,"15min":0.80300000000000005},"min":{"1min":0.71999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.91100000000000003,"15min":0.875},"min":{"1min":0.61699999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.1559999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.292}]},{"osd":9,"last update":"Fri Jul 14 12:59:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.90800000000000003,"15min":0.88300000000000001},"min":{"1min":0.59199999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.1559999999999997,"5min":5.1559999999999997,"15min":5.1559999999999997},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.02,"5min":1,"15min":1.0069999999999999},"min":{"1min":0.80800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.304,"5min":1.496,"15min":1.496},"last":1.266}]},{"osd":10,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.046,"15min":1.048},"min":{"1min":0.82099999999999995,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.3160000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.89900000000000002,"15min":0.89200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.095}]},{"osd":11,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":1.179}]}]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":974848,"data_stored":460072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.66400000000000003,"15min":0.61099999999999999},"min":{"1min":0.40699999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.0069999999999997,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.69699999999999995,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":6.8099999999999996,"5min":6.8099999999999996,"15min":6.8099999999999996},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Jul 14 12:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":1.046,"15min":1.046},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.70599999999999996,"15min":0.64200000000000002},"min":{"1min":0.46100000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.90300000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.3579999999999997,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.3899999999999997,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":0.84099999999999997}]},{"osd":4,"last update":"Fri Jul 14 12:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.749,"15min":0.69899999999999995},"min":{"1min":0.47199999999999998,"5min":0.44,"15min":0.44},"max":{"1min":4.0960000000000001,"5min":4.0960000000000001,"15min":4.0960000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.032,"5min":0.77000000000000002,"15min":0.69599999999999995},"min":{"1min":0.48399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":6.9550000000000001,"5min":6.9550000000000001,"15min":6.9550000000000001},"last":0.78800000000000003}]},{"osd":5,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.753,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.363,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.87},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.754},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.085,"5min":4.1769999999999996,"15min":4.1769999999999996},"last":1.01}]},{"osd":6,"last update":"Fri Jul 14 12:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.71199999999999997,"15min":0.70199999999999996},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":6.8739999999999997,"5min":6.8739999999999997,"15min":6.8739999999999997},"last":1.135},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.754,"15min":0.73299999999999998},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.4240000000000004,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1200000000000001,"5min":1.155,"15min":1.155},"last":0.751},{"interface":"front","average":{"1min":0.873,"5min":0.79700000000000004,"15min":0.78400000000000003},"min":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.61799999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.60999999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.3239999999999998,"5min":4.3239999999999998,"15min":4.3239999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.89100000000000001,"15min":0.88900000000000001},"min":{"1min":0.65000000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":1.0629999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:59:00 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.89100000000000001,"15min":0.91300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":7.0350000000000001,"5min":7.0350000000000001,"15min":7.0350000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.004,"5min":0.89500000000000002,"15min":0.91600000000000004},"min":{"1min":0.5,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.2729999999999999}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.55100000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.171,"5min":4.0579999999999998,"15min":4.0579999999999998},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.94599999999999995,"15min":0.92700000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7889999999999999,"5min":6.992,"15min":6.992},"last":1.2190000000000001}]},{"osd":11,"last update":"Fri Jul 14 12:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.90700000000000003,"15min":0.88200000000000001},"min":{"1min":0.623,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.21,"5min":4.21,"15min":4.21},"last":1.25},{"interface":"front","average":{"1min":1.198,"5min":0.94599999999999995,"15min":0.90400000000000003},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":6.9169999999999998,"5min":6.9169999999999998,"15min":6.9169999999999998},"last":1.294}]}]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":1019904,"data_stored":519804,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":0.86499999999999999,"15min":0.89400000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.61899999999999999,"15min":0.59699999999999998},"min":{"1min":0.54900000000000004,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.67800000000000005,"15min":0.65800000000000003},"min":{"1min":0.56100000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92800000000000005,"5min":1.0549999999999999,"15min":1.819},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.53000000000000003,"5min":0.42199999999999999,"15min":0.41699999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":1.841},"last":0.80500000000000005}]},{"osd":3,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.77100000000000002,"15min":0.72299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":6.4779999999999998,"15min":6.4779999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.46200000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.878,"5min":1.629,"15min":1.629},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Jul 14 12:59:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.60299999999999998,"15min":0.50900000000000001},"min":{"1min":0.502,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93799999999999994,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.629,"15min":0.54500000000000004},"min":{"1min":0.58499999999999996,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.78000000000000003,"15min":0.74199999999999999},"min":{"1min":0.69199999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.76900000000000002,"15min":0.73699999999999999},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.69299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77800000000000002}]},{"osd":8,"last update":"Fri Jul 14 12:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0069999999999999,"5min":1.222,"15min":1.222},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.79600000000000004,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.98899999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:58:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":0.93999999999999995,"15min":0.84699999999999998},"min":{"1min":0.73199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":6.5179999999999998,"5min":6.5179999999999998,"15min":6.5179999999999998},"last":1.014},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83499999999999996,"15min":0.81699999999999995},"min":{"1min":0.63300000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.93400000000000005}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.92000000000000004,"15min":0.88600000000000001},"min":{"1min":0.78400000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.044}]},{"osd":11,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":1.056},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.079}]}]},{"osd":3,"up_from":26,"seq":111669149774,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":458793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47199999999999998,"15min":0.42999999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81200000000000006,"5min":1.165,"15min":1.165},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51100000000000001,"15min":0.45900000000000002},"min":{"1min":0.36599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73599999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.67500000000000004},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98699999999999999,"5min":6.867,"15min":6.867},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81100000000000005,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.004,"5min":6.8860000000000001,"15min":6.8860000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.75600000000000001,"15min":0.69199999999999995},"min":{"1min":0.52400000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.747,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.94299999999999995,"5min":6.9020000000000001,"15min":6.9020000000000001},"last":0.84499999999999997}]},{"osd":4,"last update":"Fri Jul 14 12:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80800000000000005,"15min":0.72899999999999998},"min":{"1min":0.48399999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.7490000000000001,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.754,"15min":0.71699999999999997},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.621}]},{"osd":5,"last update":"Fri Jul 14 12:59:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.79500000000000004,"15min":0.78900000000000003},"min":{"1min":0.58499999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.1890000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.73799999999999999},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Jul 14 12:58:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.77000000000000002,"15min":0.68600000000000005},"min":{"1min":0.435,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.4290000000000003,"5min":7.4290000000000003,"15min":7.4290000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.248,"5min":0.80900000000000005,"15min":0.70199999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":12.958,"5min":12.958,"15min":12.958},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:59:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.63600000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.036,"5min":0.85899999999999999,"15min":0.79300000000000004},"min":{"1min":0.69099999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.2670000000000003,"5min":4.2670000000000003,"15min":4.2670000000000003},"last":0.76200000000000001}]},{"osd":8,"last update":"Fri Jul 14 12:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2010000000000001,"5min":1.206,"15min":1.206},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1859999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.80500000000000005}]},{"osd":9,"last update":"Fri Jul 14 12:58:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":7.3700000000000001,"5min":7.3700000000000001,"15min":7.3700000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81999999999999995,"15min":0.82999999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.749}]},{"osd":10,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.89100000000000001,"15min":0.89900000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0649999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.93200000000000005,"15min":0.94199999999999995},"min":{"1min":0.68500000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.1679999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.82499999999999996}]},{"osd":11,"last update":"Fri Jul 14 12:58:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.871}]}]},{"osd":4,"up_from":34,"seq":146028888136,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77600000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:58:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.46400000000000002},"min":{"1min":0.34399999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.65100000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.5,"15min":0.46200000000000002},"min":{"1min":0.40100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79900000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Jul 14 12:58:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.73999999999999999,"15min":0.68700000000000006},"min":{"1min":0.58799999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.099,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71799999999999997,"15min":0.70399999999999996},"min":{"1min":0.57399999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.78800000000000003,"15min":0.69799999999999995},"min":{"1min":0.53300000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":7.0250000000000004,"5min":7.0250000000000004,"15min":7.0250000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.056,"5min":0.74099999999999999,"15min":0.67300000000000004},"min":{"1min":0.496,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:59:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.877},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.73899999999999999,"15min":0.70399999999999996},"min":{"1min":0.58399999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.93000000000000005,"5min":1.002,"15min":1.002},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":0.91600000000000004,"15min":0.81899999999999995},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":9.6229999999999993,"5min":9.6229999999999993,"15min":9.6229999999999993},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.4630000000000001,"5min":0.88900000000000001,"15min":0.79000000000000004},"min":{"1min":0.52800000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":9.6590000000000007,"5min":9.6590000000000007,"15min":9.6590000000000007},"last":0.746}]},{"osd":7,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89600000000000002,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.751,"15min":0.749},"min":{"1min":0.57499999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98899999999999999,"5min":1.129,"15min":1.129},"last":0.69599999999999995}]},{"osd":8,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.875,"15min":0.86499999999999999},"min":{"1min":0.65900000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.143,"5min":1.234,"15min":1.234},"last":0.99099999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:58:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.93799999999999994,"15min":0.89800000000000002},"min":{"1min":0.63100000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.0919999999999996,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.872,"15min":0.85199999999999998},"min":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.82399999999999995}]},{"osd":10,"last update":"Fri Jul 14 12:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.93100000000000005,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1970000000000001,"5min":1.337,"15min":1.337},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82499999999999996,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98299999999999998,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.93500000000000005}]},{"osd":11,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.0189999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724612,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":1028096,"data_stored":1050996,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61699999999999999,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85499999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91600000000000004,"5min":0.997,"15min":0.997},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69799999999999995,"15min":0.63100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.69599999999999995,"15min":0.625},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53000000000000003,"15min":0.503},"min":{"1min":0.38800000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79900000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.54100000000000004,"15min":0.48799999999999999},"min":{"1min":0.41799999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.028,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.501,"5min":0.434,"15min":0.434},"max":{"1min":0.996,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.78100000000000003}]},{"osd":4,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75800000000000001,"15min":0.68000000000000005},"min":{"1min":0.55700000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0269999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.75,"15min":0.70799999999999996},"min":{"1min":0.57099999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1080000000000001,"5min":1.139,"15min":1.139},"last":0.755}]},{"osd":6,"last update":"Fri Jul 14 12:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.749,"15min":0.753},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98199999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76900000000000002,"15min":0.78400000000000003},"min":{"1min":0.50900000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.018,"5min":1.28,"15min":1.28},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Jul 14 12:59:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.69399999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.84799999999999998},"min":{"1min":0.51700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.218,"5min":1.236,"15min":1.236},"last":0.92700000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.88400000000000001}]},{"osd":9,"last update":"Fri Jul 14 12:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.873,"15min":0.871},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1499999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.84899999999999998},"min":{"1min":0.67200000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1379999999999999,"5min":1.286,"15min":1.286},"last":0.96699999999999997}]},{"osd":10,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.86799999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.874,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34486,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59844,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61483,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":61857,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:59:29.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:59:30.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.984+0000 7f10909ff700 1 -- 172.21.15.17:0/2731507274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c0fe9d0 msgr2=0x7f108c0fede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.984+0000 7f10909ff700 1 --2- 172.21.15.17:0/2731507274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c0fe9d0 0x7f108c0fede0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f107c009990 tx=0x7f107c009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.984+0000 7f10909ff700 1 -- 172.21.15.17:0/2731507274 shutdown_connections 2023-07-14T12:59:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.984+0000 7f10909ff700 1 --2- 172.21.15.17:0/2731507274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f108c100550 0x7f108c106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.984+0000 7f10909ff700 1 --2- 172.21.15.17:0/2731507274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c0fe9d0 0x7f108c0fede0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.984+0000 7f10909ff700 1 --2- 172.21.15.17:0/2731507274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f108c0ffbc0 0x7f108c100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.984+0000 7f10909ff700 1 -- 172.21.15.17:0/2731507274 >> 172.21.15.17:0/2731507274 conn(0x7f108c0f9fd0 msgr2=0x7f108c0fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:30.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.984+0000 7f10909ff700 1 -- 172.21.15.17:0/2731507274 shutdown_connections 2023-07-14T12:59:30.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.984+0000 7f10909ff700 1 -- 172.21.15.17:0/2731507274 wait complete. 2023-07-14T12:59:30.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.985+0000 7f10909ff700 1 Processor -- start 2023-07-14T12:59:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.985+0000 7f10909ff700 1 -- start start 2023-07-14T12:59:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.986+0000 7f10909ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f108c0fe9d0 0x7f108c102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.986+0000 7f10909ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c0ffbc0 0x7f108c100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.986+0000 7f10909ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f108c100550 0x7f108c1014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.986+0000 7f10909ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c101c80 con 0x7f108c0ffbc0 2023-07-14T12:59:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.986+0000 7f10909ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c101df0 con 0x7f108c0fe9d0 2023-07-14T12:59:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.986+0000 7f10909ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c19f7d0 con 0x7f108c100550 2023-07-14T12:59:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.986+0000 7f1083fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c0ffbc0 0x7f108c100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.986+0000 7f1083fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c0ffbc0 0x7f108c100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51870/0 (socket says 172.21.15.17:51870) 2023-07-14T12:59:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.986+0000 7f1083fff700 1 -- 172.21.15.17:0/2872552013 learned_addr learned my addr 172.21.15.17:0/2872552013 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.986+0000 7f108a59c700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f108c0fe9d0 0x7f108c102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f108ad9d700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f108c100550 0x7f108c1014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f1083fff700 1 -- 172.21.15.17:0/2872552013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f108c100550 msgr2=0x7f108c1014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:30.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f1083fff700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f108c100550 0x7f108c1014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f1083fff700 1 -- 172.21.15.17:0/2872552013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f108c0fe9d0 msgr2=0x7f108c102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:30.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f1083fff700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f108c0fe9d0 0x7f108c102960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f1083fff700 1 -- 172.21.15.17:0/2872552013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c0095f0 con 0x7f108c0ffbc0 2023-07-14T12:59:30.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f108a59c700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f108c0fe9d0 0x7f108c102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:30.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f108ad9d700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f108c100550 0x7f108c1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:59:30.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f1083fff700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c0ffbc0 0x7f108c100fa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f107400d950 tx=0x7f107400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:30.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f10837fe700 1 -- 172.21.15.17:0/2872552013 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1074009b40 con 0x7f108c0ffbc0 2023-07-14T12:59:30.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f10837fe700 1 -- 172.21.15.17:0/2872552013 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1074009ca0 con 0x7f108c0ffbc0 2023-07-14T12:59:30.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f10909ff700 1 -- 172.21.15.17:0/2872552013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c19fab0 con 0x7f108c0ffbc0 2023-07-14T12:59:30.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f10837fe700 1 -- 172.21.15.17:0/2872552013 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107400f620 con 0x7f108c0ffbc0 2023-07-14T12:59:30.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.987+0000 7f10909ff700 1 -- 172.21.15.17:0/2872552013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c19ffc0 con 0x7f108c0ffbc0 2023-07-14T12:59:30.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.988+0000 7f10909ff700 1 -- 172.21.15.17:0/2872552013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c10a0a0 con 0x7f108c0ffbc0 2023-07-14T12:59:30.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.990+0000 7f10837fe700 1 -- 172.21.15.17:0/2872552013 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f1074010460 con 0x7f108c0ffbc0 2023-07-14T12:59:30.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.992+0000 7f10837fe700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f10780a11a0 0x7f10780a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:30.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.992+0000 7f10837fe700 1 -- 172.21.15.17:0/2872552013 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f10740ccc90 con 0x7f108c0ffbc0 2023-07-14T12:59:30.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.992+0000 7f108a59c700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f10780a11a0 0x7f10780a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:30.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.993+0000 7f108a59c700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f10780a11a0 0x7f10780a3650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f107c00b5c0 tx=0x7f107c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:30.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:29.996+0000 7f10837fe700 1 -- 172.21.15.17:0/2872552013 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1074096410 con 0x7f108c0ffbc0 2023-07-14T12:59:30.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:29 smithi017 ceph-mon[95536]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2023-07-14T12:59:30.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:29 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1051245130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:30.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.200+0000 7f10909ff700 1 -- 172.21.15.17:0/2872552013 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f108c067e40 con 0x7f10780a11a0 2023-07-14T12:59:30.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.211+0000 7f10837fe700 1 -- 172.21.15.17:0/2872552013 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343950 (secure 0 0 0) 0x7f108c067e40 con 0x7f10780a11a0 2023-07-14T12:59:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:30.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:29 smithi131 ceph-mon[96953]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2023-07-14T12:59:30.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:29 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1051245130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.215+0000 7f10909ff700 1 -- 172.21.15.17:0/2872552013 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f10780a11a0 msgr2=0x7f10780a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.215+0000 7f10909ff700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f10780a11a0 0x7f10780a3650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f107c00b5c0 tx=0x7f107c005fd0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.215+0000 7f10909ff700 1 -- 172.21.15.17:0/2872552013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c0ffbc0 msgr2=0x7f108c100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.215+0000 7f10909ff700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c0ffbc0 0x7f108c100fa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f107400d950 tx=0x7f107400dd10 comp rx=0 tx=0).stop 2023-07-14T12:59:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.215+0000 7f10909ff700 1 -- 172.21.15.17:0/2872552013 shutdown_connections 2023-07-14T12:59:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.215+0000 7f10909ff700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f10780a11a0 0x7f10780a3650 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.215+0000 7f10909ff700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f108c100550 0x7f108c1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.215+0000 7f10909ff700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f108c0fe9d0 0x7f108c102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.215+0000 7f10909ff700 1 --2- 172.21.15.17:0/2872552013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c0ffbc0 0x7f108c100fa0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.215+0000 7f10909ff700 1 -- 172.21.15.17:0/2872552013 >> 172.21.15.17:0/2872552013 conn(0x7f108c0f9fd0 msgr2=0x7f108c067730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:30.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.216+0000 7f10909ff700 1 -- 172.21.15.17:0/2872552013 shutdown_connections 2023-07-14T12:59:30.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.216+0000 7f10909ff700 1 -- 172.21.15.17:0/2872552013 wait complete. 2023-07-14T12:59:30.249 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-07-14T12:59:30.264 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2023-07-14T12:59:28.864082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654938,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":766,"num_read_kb":503,"num_write":344,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1180882,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":780,"ondisk_log_size":780,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335060,"kb_used_data":11636,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124606764,"statfs":{"total":1151940427776,"available":1151597326336,"internally_reserved":0,"allocated":11915264,"data_stored":7466734,"data_compressed":113190,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1449,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003150"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.881025+0000","last_change":"2023-07-14T12:57:40.168203+0000","last_active":"2023-07-14T12:59:06.881025+0000","last_peered":"2023-07-14T12:59:06.881025+0000","last_clean":"2023-07-14T12:59:06.881025+0000","last_became_active":"2023-07-14T12:57:40.164682+0000","last_became_peered":"2023-07-14T12:57:40.164682+0000","last_unstale":"2023-07-14T12:59:06.881025+0000","last_undegraded":"2023-07-14T12:59:06.881025+0000","last_fullsized":"2023-07-14T12:59:06.881025+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:39.005726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.872934+0000","last_change":"2023-07-14T12:57:40.168194+0000","last_active":"2023-07-14T12:59:06.872934+0000","last_peered":"2023-07-14T12:59:06.872934+0000","last_clean":"2023-07-14T12:59:06.872934+0000","last_became_active":"2023-07-14T12:57:40.167825+0000","last_became_peered":"2023-07-14T12:57:40.167825+0000","last_unstale":"2023-07-14T12:59:06.872934+0000","last_undegraded":"2023-07-14T12:59:06.872934+0000","last_fullsized":"2023-07-14T12:59:06.872934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:23:35.037851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.879101+0000","last_change":"2023-07-14T12:57:40.162824+0000","last_active":"2023-07-14T12:59:06.879101+0000","last_peered":"2023-07-14T12:59:06.879101+0000","last_clean":"2023-07-14T12:59:06.879101+0000","last_became_active":"2023-07-14T12:57:40.162526+0000","last_became_peered":"2023-07-14T12:57:40.162526+0000","last_unstale":"2023-07-14T12:59:06.879101+0000","last_undegraded":"2023-07-14T12:59:06.879101+0000","last_fullsized":"2023-07-14T12:59:06.879101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:01:27.137266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.859900+0000","last_change":"2023-07-14T12:57:40.160772+0000","last_active":"2023-07-14T12:59:06.859900+0000","last_peered":"2023-07-14T12:59:06.859900+0000","last_clean":"2023-07-14T12:59:06.859900+0000","last_became_active":"2023-07-14T12:57:40.160315+0000","last_became_peered":"2023-07-14T12:57:40.160315+0000","last_unstale":"2023-07-14T12:59:06.859900+0000","last_undegraded":"2023-07-14T12:59:06.859900+0000","last_fullsized":"2023-07-14T12:59:06.859900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:48.047786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869216+0000","last_change":"2023-07-14T12:57:40.160868+0000","last_active":"2023-07-14T12:59:06.869216+0000","last_peered":"2023-07-14T12:59:06.869216+0000","last_clean":"2023-07-14T12:59:06.869216+0000","last_became_active":"2023-07-14T12:57:40.160558+0000","last_became_peered":"2023-07-14T12:57:40.160558+0000","last_unstale":"2023-07-14T12:59:06.869216+0000","last_undegraded":"2023-07-14T12:59:06.869216+0000","last_fullsized":"2023-07-14T12:59:06.869216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:21:57.315978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.872638+0000","last_change":"2023-07-14T12:57:40.166305+0000","last_active":"2023-07-14T12:59:06.872638+0000","last_peered":"2023-07-14T12:59:06.872638+0000","last_clean":"2023-07-14T12:59:06.872638+0000","last_became_active":"2023-07-14T12:57:40.166012+0000","last_became_peered":"2023-07-14T12:57:40.166012+0000","last_unstale":"2023-07-14T12:59:06.872638+0000","last_undegraded":"2023-07-14T12:59:06.872638+0000","last_fullsized":"2023-07-14T12:59:06.872638+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:03:06.167704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.855384+0000","last_change":"2023-07-14T12:57:40.163312+0000","last_active":"2023-07-14T12:59:06.855384+0000","last_peered":"2023-07-14T12:59:06.855384+0000","last_clean":"2023-07-14T12:59:06.855384+0000","last_became_active":"2023-07-14T12:57:40.163030+0000","last_became_peered":"2023-07-14T12:57:40.163030+0000","last_unstale":"2023-07-14T12:59:06.855384+0000","last_undegraded":"2023-07-14T12:59:06.855384+0000","last_fullsized":"2023-07-14T12:59:06.855384+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:41.303341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869384+0000","last_change":"2023-07-14T12:58:08.115121+0000","last_active":"2023-07-14T12:59:06.869384+0000","last_peered":"2023-07-14T12:59:06.869384+0000","last_clean":"2023-07-14T12:59:06.869384+0000","last_became_active":"2023-07-14T12:58:08.114736+0000","last_became_peered":"2023-07-14T12:58:08.114736+0000","last_unstale":"2023-07-14T12:59:06.869384+0000","last_undegraded":"2023-07-14T12:59:06.869384+0000","last_fullsized":"2023-07-14T12:59:06.869384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:30:27.815140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.880702+0000","last_change":"2023-07-14T12:57:40.170263+0000","last_active":"2023-07-14T12:59:06.880702+0000","last_peered":"2023-07-14T12:59:06.880702+0000","last_clean":"2023-07-14T12:59:06.880702+0000","last_became_active":"2023-07-14T12:57:40.169952+0000","last_became_peered":"2023-07-14T12:57:40.169952+0000","last_unstale":"2023-07-14T12:59:06.880702+0000","last_undegraded":"2023-07-14T12:59:06.880702+0000","last_fullsized":"2023-07-14T12:59:06.880702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:07:08.714595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866126+0000","last_change":"2023-07-14T12:57:40.165359+0000","last_active":"2023-07-14T12:59:06.866126+0000","last_peered":"2023-07-14T12:59:06.866126+0000","last_clean":"2023-07-14T12:59:06.866126+0000","last_became_active":"2023-07-14T12:57:40.164918+0000","last_became_peered":"2023-07-14T12:57:40.164918+0000","last_unstale":"2023-07-14T12:59:06.866126+0000","last_undegraded":"2023-07-14T12:59:06.866126+0000","last_fullsized":"2023-07-14T12:59:06.866126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:57:54.633792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.877061+0000","last_change":"2023-07-14T12:57:40.160524+0000","last_active":"2023-07-14T12:59:06.877061+0000","last_peered":"2023-07-14T12:59:06.877061+0000","last_clean":"2023-07-14T12:59:06.877061+0000","last_became_active":"2023-07-14T12:57:40.160215+0000","last_became_peered":"2023-07-14T12:57:40.160215+0000","last_unstale":"2023-07-14T12:59:06.877061+0000","last_undegraded":"2023-07-14T12:59:06.877061+0000","last_fullsized":"2023-07-14T12:59:06.877061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:21.213962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870167+0000","last_change":"2023-07-14T12:58:07.964366+0000","last_active":"2023-07-14T12:59:06.870167+0000","last_peered":"2023-07-14T12:59:06.870167+0000","last_clean":"2023-07-14T12:59:06.870167+0000","last_became_active":"2023-07-14T12:58:07.963981+0000","last_became_peered":"2023-07-14T12:58:07.963981+0000","last_unstale":"2023-07-14T12:59:06.870167+0000","last_undegraded":"2023-07-14T12:59:06.870167+0000","last_fullsized":"2023-07-14T12:59:06.870167+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:28:52.971393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870190+0000","last_change":"2023-07-14T12:57:40.162166+0000","last_active":"2023-07-14T12:59:06.870190+0000","last_peered":"2023-07-14T12:59:06.870190+0000","last_clean":"2023-07-14T12:59:06.870190+0000","last_became_active":"2023-07-14T12:57:40.161750+0000","last_became_peered":"2023-07-14T12:57:40.161750+0000","last_unstale":"2023-07-14T12:59:06.870190+0000","last_undegraded":"2023-07-14T12:59:06.870190+0000","last_fullsized":"2023-07-14T12:59:06.870190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:19:28.054997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.871810+0000","last_change":"2023-07-14T12:57:40.160556+0000","last_active":"2023-07-14T12:59:06.871810+0000","last_peered":"2023-07-14T12:59:06.871810+0000","last_clean":"2023-07-14T12:59:06.871810+0000","last_became_active":"2023-07-14T12:57:40.159974+0000","last_became_peered":"2023-07-14T12:57:40.159974+0000","last_unstale":"2023-07-14T12:59:06.871810+0000","last_undegraded":"2023-07-14T12:59:06.871810+0000","last_fullsized":"2023-07-14T12:59:06.871810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:35:12.700407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870639+0000","last_change":"2023-07-14T12:57:40.169116+0000","last_active":"2023-07-14T12:59:06.870639+0000","last_peered":"2023-07-14T12:59:06.870639+0000","last_clean":"2023-07-14T12:59:06.870639+0000","last_became_active":"2023-07-14T12:57:40.168714+0000","last_became_peered":"2023-07-14T12:57:40.168714+0000","last_unstale":"2023-07-14T12:59:06.870639+0000","last_undegraded":"2023-07-14T12:59:06.870639+0000","last_fullsized":"2023-07-14T12:59:06.870639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:17:06.970124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.880546+0000","last_change":"2023-07-14T12:57:40.162621+0000","last_active":"2023-07-14T12:59:06.880546+0000","last_peered":"2023-07-14T12:59:06.880546+0000","last_clean":"2023-07-14T12:59:06.880546+0000","last_became_active":"2023-07-14T12:57:40.162329+0000","last_became_peered":"2023-07-14T12:57:40.162329+0000","last_unstale":"2023-07-14T12:59:06.880546+0000","last_undegraded":"2023-07-14T12:59:06.880546+0000","last_fullsized":"2023-07-14T12:59:06.880546+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:19.671402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.881150+0000","last_change":"2023-07-14T12:57:40.172697+0000","last_active":"2023-07-14T12:59:06.881150+0000","last_peered":"2023-07-14T12:59:06.881150+0000","last_clean":"2023-07-14T12:59:06.881150+0000","last_became_active":"2023-07-14T12:57:40.172366+0000","last_became_peered":"2023-07-14T12:57:40.172366+0000","last_unstale":"2023-07-14T12:59:06.881150+0000","last_undegraded":"2023-07-14T12:59:06.881150+0000","last_fullsized":"2023-07-14T12:59:06.881150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:57.950996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.877348+0000","last_change":"2023-07-14T12:57:40.166669+0000","last_active":"2023-07-14T12:59:06.877348+0000","last_peered":"2023-07-14T12:59:06.877348+0000","last_clean":"2023-07-14T12:59:06.877348+0000","last_became_active":"2023-07-14T12:57:40.166367+0000","last_became_peered":"2023-07-14T12:57:40.166367+0000","last_unstale":"2023-07-14T12:59:06.877348+0000","last_undegraded":"2023-07-14T12:59:06.877348+0000","last_fullsized":"2023-07-14T12:59:06.877348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:32:55.001814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869373+0000","last_change":"2023-07-14T12:57:40.159133+0000","last_active":"2023-07-14T12:59:06.869373+0000","last_peered":"2023-07-14T12:59:06.869373+0000","last_clean":"2023-07-14T12:59:06.869373+0000","last_became_active":"2023-07-14T12:57:40.158819+0000","last_became_peered":"2023-07-14T12:57:40.158819+0000","last_unstale":"2023-07-14T12:59:06.869373+0000","last_undegraded":"2023-07-14T12:59:06.869373+0000","last_fullsized":"2023-07-14T12:59:06.869373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:34.782295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959654+0000","last_change":"2023-07-14T12:57:39.144919+0000","last_active":"2023-07-14T12:58:07.959654+0000","last_peered":"2023-07-14T12:58:07.959654+0000","last_clean":"2023-07-14T12:58:07.959654+0000","last_became_active":"2023-07-14T12:57:39.144604+0000","last_became_peered":"2023-07-14T12:57:39.144604+0000","last_unstale":"2023-07-14T12:58:07.959654+0000","last_undegraded":"2023-07-14T12:58:07.959654+0000","last_fullsized":"2023-07-14T12:58:07.959654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:32:41.249364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866853+0000","last_change":"2023-07-14T12:57:40.165754+0000","last_active":"2023-07-14T12:59:06.866853+0000","last_peered":"2023-07-14T12:59:06.866853+0000","last_clean":"2023-07-14T12:59:06.866853+0000","last_became_active":"2023-07-14T12:57:40.165416+0000","last_became_peered":"2023-07-14T12:57:40.165416+0000","last_unstale":"2023-07-14T12:59:06.866853+0000","last_undegraded":"2023-07-14T12:59:06.866853+0000","last_fullsized":"2023-07-14T12:59:06.866853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:44.533325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965435+0000","last_change":"2023-07-14T12:57:39.153977+0000","last_active":"2023-07-14T12:58:07.965435+0000","last_peered":"2023-07-14T12:58:07.965435+0000","last_clean":"2023-07-14T12:58:07.965435+0000","last_became_active":"2023-07-14T12:57:39.153675+0000","last_became_peered":"2023-07-14T12:57:39.153675+0000","last_unstale":"2023-07-14T12:58:07.965435+0000","last_undegraded":"2023-07-14T12:58:07.965435+0000","last_fullsized":"2023-07-14T12:58:07.965435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:56.670099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.879198+0000","last_change":"2023-07-14T12:57:40.157076+0000","last_active":"2023-07-14T12:59:06.879198+0000","last_peered":"2023-07-14T12:59:06.879198+0000","last_clean":"2023-07-14T12:59:06.879198+0000","last_became_active":"2023-07-14T12:57:40.156652+0000","last_became_peered":"2023-07-14T12:57:40.156652+0000","last_unstale":"2023-07-14T12:59:06.879198+0000","last_undegraded":"2023-07-14T12:59:06.879198+0000","last_fullsized":"2023-07-14T12:59:06.879198+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:51.608575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963702+0000","last_change":"2023-07-14T12:57:39.145123+0000","last_active":"2023-07-14T12:58:07.963702+0000","last_peered":"2023-07-14T12:58:07.963702+0000","last_clean":"2023-07-14T12:58:07.963702+0000","last_became_active":"2023-07-14T12:57:39.144768+0000","last_became_peered":"2023-07-14T12:57:39.144768+0000","last_unstale":"2023-07-14T12:58:07.963702+0000","last_undegraded":"2023-07-14T12:58:07.963702+0000","last_fullsized":"2023-07-14T12:58:07.963702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:13:21.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878293+0000","last_change":"2023-07-14T12:57:40.167084+0000","last_active":"2023-07-14T12:59:06.878293+0000","last_peered":"2023-07-14T12:59:06.878293+0000","last_clean":"2023-07-14T12:59:06.878293+0000","last_became_active":"2023-07-14T12:57:40.166654+0000","last_became_peered":"2023-07-14T12:57:40.166654+0000","last_unstale":"2023-07-14T12:59:06.878293+0000","last_undegraded":"2023-07-14T12:59:06.878293+0000","last_fullsized":"2023-07-14T12:59:06.878293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:01:54.429150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963132+0000","last_change":"2023-07-14T12:57:39.137432+0000","last_active":"2023-07-14T12:58:07.963132+0000","last_peered":"2023-07-14T12:58:07.963132+0000","last_clean":"2023-07-14T12:58:07.963132+0000","last_became_active":"2023-07-14T12:57:39.137124+0000","last_became_peered":"2023-07-14T12:57:39.137124+0000","last_unstale":"2023-07-14T12:58:07.963132+0000","last_undegraded":"2023-07-14T12:58:07.963132+0000","last_fullsized":"2023-07-14T12:58:07.963132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:50.638289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.876649+0000","last_change":"2023-07-14T12:57:40.167477+0000","last_active":"2023-07-14T12:59:06.876649+0000","last_peered":"2023-07-14T12:59:06.876649+0000","last_clean":"2023-07-14T12:59:06.876649+0000","last_became_active":"2023-07-14T12:57:40.167177+0000","last_became_peered":"2023-07-14T12:57:40.167177+0000","last_unstale":"2023-07-14T12:59:06.876649+0000","last_undegraded":"2023-07-14T12:59:06.876649+0000","last_fullsized":"2023-07-14T12:59:06.876649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:39:35.566121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":128,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:24.398014+0000","last_change":"2023-07-14T12:57:39.146569+0000","last_active":"2023-07-14T12:59:24.398014+0000","last_peered":"2023-07-14T12:59:24.398014+0000","last_clean":"2023-07-14T12:59:24.398014+0000","last_became_active":"2023-07-14T12:57:39.146251+0000","last_became_peered":"2023-07-14T12:57:39.146251+0000","last_unstale":"2023-07-14T12:59:24.398014+0000","last_undegraded":"2023-07-14T12:59:24.398014+0000","last_fullsized":"2023-07-14T12:59:24.398014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:33.372913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.853293+0000","last_change":"2023-07-14T12:57:40.160511+0000","last_active":"2023-07-14T12:59:06.853293+0000","last_peered":"2023-07-14T12:59:06.853293+0000","last_clean":"2023-07-14T12:59:06.853293+0000","last_became_active":"2023-07-14T12:57:40.160152+0000","last_became_peered":"2023-07-14T12:57:40.160152+0000","last_unstale":"2023-07-14T12:59:06.853293+0000","last_undegraded":"2023-07-14T12:59:06.853293+0000","last_fullsized":"2023-07-14T12:59:06.853293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:05.198459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.119603+0000","last_change":"2023-07-14T12:58:08.119603+0000","last_active":"2023-07-14T12:58:08.119603+0000","last_peered":"2023-07-14T12:58:08.119603+0000","last_clean":"2023-07-14T12:58:08.119603+0000","last_became_active":"2023-07-14T12:58:08.115814+0000","last_became_peered":"2023-07-14T12:58:08.115814+0000","last_unstale":"2023-07-14T12:58:08.119603+0000","last_undegraded":"2023-07-14T12:58:08.119603+0000","last_fullsized":"2023-07-14T12:58:08.119603+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:49.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867830+0000","last_change":"2023-07-14T12:58:07.967463+0000","last_active":"2023-07-14T12:59:06.867830+0000","last_peered":"2023-07-14T12:59:06.867830+0000","last_clean":"2023-07-14T12:59:06.867830+0000","last_became_active":"2023-07-14T12:58:07.967136+0000","last_became_peered":"2023-07-14T12:58:07.967136+0000","last_unstale":"2023-07-14T12:59:06.867830+0000","last_undegraded":"2023-07-14T12:59:06.867830+0000","last_fullsized":"2023-07-14T12:59:06.867830+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:53.152331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961797+0000","last_change":"2023-07-14T12:57:39.145352+0000","last_active":"2023-07-14T12:58:07.961797+0000","last_peered":"2023-07-14T12:58:07.961797+0000","last_clean":"2023-07-14T12:58:07.961797+0000","last_became_active":"2023-07-14T12:57:39.145018+0000","last_became_peered":"2023-07-14T12:57:39.145018+0000","last_unstale":"2023-07-14T12:58:07.961797+0000","last_undegraded":"2023-07-14T12:58:07.961797+0000","last_fullsized":"2023-07-14T12:58:07.961797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:46:13.836721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.865933+0000","last_change":"2023-07-14T12:57:40.173457+0000","last_active":"2023-07-14T12:59:06.865933+0000","last_peered":"2023-07-14T12:59:06.865933+0000","last_clean":"2023-07-14T12:59:06.865933+0000","last_became_active":"2023-07-14T12:57:40.173080+0000","last_became_peered":"2023-07-14T12:57:40.173080+0000","last_unstale":"2023-07-14T12:59:06.865933+0000","last_undegraded":"2023-07-14T12:59:06.865933+0000","last_fullsized":"2023-07-14T12:59:06.865933+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:18.222106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113467+0000","last_change":"2023-07-14T12:57:39.145383+0000","last_active":"2023-07-14T12:58:08.113467+0000","last_peered":"2023-07-14T12:58:08.113467+0000","last_clean":"2023-07-14T12:58:08.113467+0000","last_became_active":"2023-07-14T12:57:39.145088+0000","last_became_peered":"2023-07-14T12:57:39.145088+0000","last_unstale":"2023-07-14T12:58:08.113467+0000","last_undegraded":"2023-07-14T12:58:08.113467+0000","last_fullsized":"2023-07-14T12:58:08.113467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:32.979153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868706+0000","last_change":"2023-07-14T12:57:40.162123+0000","last_active":"2023-07-14T12:59:06.868706+0000","last_peered":"2023-07-14T12:59:06.868706+0000","last_clean":"2023-07-14T12:59:06.868706+0000","last_became_active":"2023-07-14T12:57:40.160789+0000","last_became_peered":"2023-07-14T12:57:40.160789+0000","last_unstale":"2023-07-14T12:59:06.868706+0000","last_undegraded":"2023-07-14T12:59:06.868706+0000","last_fullsized":"2023-07-14T12:59:06.868706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:24.181158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:23.188752+0000","last_change":"2023-07-14T12:57:39.139524+0000","last_active":"2023-07-14T12:59:23.188752+0000","last_peered":"2023-07-14T12:59:23.188752+0000","last_clean":"2023-07-14T12:59:23.188752+0000","last_became_active":"2023-07-14T12:57:39.139176+0000","last_became_peered":"2023-07-14T12:57:39.139176+0000","last_unstale":"2023-07-14T12:59:23.188752+0000","last_undegraded":"2023-07-14T12:59:23.188752+0000","last_fullsized":"2023-07-14T12:59:23.188752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:27.070260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.880493+0000","last_change":"2023-07-14T12:57:40.168729+0000","last_active":"2023-07-14T12:59:06.880493+0000","last_peered":"2023-07-14T12:59:06.880493+0000","last_clean":"2023-07-14T12:59:06.880493+0000","last_became_active":"2023-07-14T12:57:40.168408+0000","last_became_peered":"2023-07-14T12:57:40.168408+0000","last_unstale":"2023-07-14T12:59:06.880493+0000","last_undegraded":"2023-07-14T12:59:06.880493+0000","last_fullsized":"2023-07-14T12:59:06.880493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:58:20.491077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958510+0000","last_change":"2023-07-14T12:57:39.140744+0000","last_active":"2023-07-14T12:58:07.958510+0000","last_peered":"2023-07-14T12:58:07.958510+0000","last_clean":"2023-07-14T12:58:07.958510+0000","last_became_active":"2023-07-14T12:57:39.140391+0000","last_became_peered":"2023-07-14T12:57:39.140391+0000","last_unstale":"2023-07-14T12:58:07.958510+0000","last_undegraded":"2023-07-14T12:58:07.958510+0000","last_fullsized":"2023-07-14T12:58:07.958510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:01.023100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.873963+0000","last_change":"2023-07-14T12:57:40.165552+0000","last_active":"2023-07-14T12:59:06.873963+0000","last_peered":"2023-07-14T12:59:06.873963+0000","last_clean":"2023-07-14T12:59:06.873963+0000","last_became_active":"2023-07-14T12:57:40.165214+0000","last_became_peered":"2023-07-14T12:57:40.165214+0000","last_unstale":"2023-07-14T12:59:06.873963+0000","last_undegraded":"2023-07-14T12:59:06.873963+0000","last_fullsized":"2023-07-14T12:59:06.873963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:15.528292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113790+0000","last_change":"2023-07-14T12:57:39.150311+0000","last_active":"2023-07-14T12:58:08.113790+0000","last_peered":"2023-07-14T12:58:08.113790+0000","last_clean":"2023-07-14T12:58:08.113790+0000","last_became_active":"2023-07-14T12:57:39.149885+0000","last_became_peered":"2023-07-14T12:57:39.149885+0000","last_unstale":"2023-07-14T12:58:08.113790+0000","last_undegraded":"2023-07-14T12:58:08.113790+0000","last_fullsized":"2023-07-14T12:58:08.113790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:56.722568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878693+0000","last_change":"2023-07-14T12:57:40.161845+0000","last_active":"2023-07-14T12:59:06.878693+0000","last_peered":"2023-07-14T12:59:06.878693+0000","last_clean":"2023-07-14T12:59:06.878693+0000","last_became_active":"2023-07-14T12:57:40.160895+0000","last_became_peered":"2023-07-14T12:57:40.160895+0000","last_unstale":"2023-07-14T12:59:06.878693+0000","last_undegraded":"2023-07-14T12:59:06.878693+0000","last_fullsized":"2023-07-14T12:59:06.878693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:20:16.547464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'32","reported_seq":258,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:23.405124+0000","last_change":"2023-07-14T12:57:39.142584+0000","last_active":"2023-07-14T12:59:23.405124+0000","last_peered":"2023-07-14T12:59:23.405124+0000","last_clean":"2023-07-14T12:59:23.405124+0000","last_became_active":"2023-07-14T12:57:39.142239+0000","last_became_peered":"2023-07-14T12:57:39.142239+0000","last_unstale":"2023-07-14T12:59:23.405124+0000","last_undegraded":"2023-07-14T12:59:23.405124+0000","last_fullsized":"2023-07-14T12:59:23.405124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:56.022427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59844,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":162,"num_write":33,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.861434+0000","last_change":"2023-07-14T12:57:40.170013+0000","last_active":"2023-07-14T12:59:06.861434+0000","last_peered":"2023-07-14T12:59:06.861434+0000","last_clean":"2023-07-14T12:59:06.861434+0000","last_became_active":"2023-07-14T12:57:40.169177+0000","last_became_peered":"2023-07-14T12:57:40.169177+0000","last_unstale":"2023-07-14T12:59:06.861434+0000","last_undegraded":"2023-07-14T12:59:06.861434+0000","last_fullsized":"2023-07-14T12:59:06.861434+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:42.957456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.978704+0000","last_change":"2023-07-14T12:58:07.978239+0000","last_active":"2023-07-14T12:58:07.978704+0000","last_peered":"2023-07-14T12:58:07.978704+0000","last_clean":"2023-07-14T12:58:07.978704+0000","last_became_active":"2023-07-14T12:58:07.967195+0000","last_became_peered":"2023-07-14T12:58:07.967195+0000","last_unstale":"2023-07-14T12:58:07.978704+0000","last_undegraded":"2023-07-14T12:58:07.978704+0000","last_fullsized":"2023-07-14T12:58:07.978704+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:05.124879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.865208+0000","last_change":"2023-07-14T12:57:40.158098+0000","last_active":"2023-07-14T12:59:06.865208+0000","last_peered":"2023-07-14T12:59:06.865208+0000","last_clean":"2023-07-14T12:59:06.865208+0000","last_became_active":"2023-07-14T12:57:40.157736+0000","last_became_peered":"2023-07-14T12:57:40.157736+0000","last_unstale":"2023-07-14T12:59:06.865208+0000","last_undegraded":"2023-07-14T12:59:06.865208+0000","last_fullsized":"2023-07-14T12:59:06.865208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:04:59.371098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113762+0000","last_change":"2023-07-14T12:57:39.135784+0000","last_active":"2023-07-14T12:58:08.113762+0000","last_peered":"2023-07-14T12:58:08.113762+0000","last_clean":"2023-07-14T12:58:08.113762+0000","last_became_active":"2023-07-14T12:57:39.135480+0000","last_became_peered":"2023-07-14T12:57:39.135480+0000","last_unstale":"2023-07-14T12:58:08.113762+0000","last_undegraded":"2023-07-14T12:58:08.113762+0000","last_fullsized":"2023-07-14T12:58:08.113762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:33:37.574910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870560+0000","last_change":"2023-07-14T12:57:40.162548+0000","last_active":"2023-07-14T12:59:06.870560+0000","last_peered":"2023-07-14T12:59:06.870560+0000","last_clean":"2023-07-14T12:59:06.870560+0000","last_became_active":"2023-07-14T12:57:40.162191+0000","last_became_peered":"2023-07-14T12:57:40.162191+0000","last_unstale":"2023-07-14T12:59:06.870560+0000","last_undegraded":"2023-07-14T12:59:06.870560+0000","last_fullsized":"2023-07-14T12:59:06.870560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:04.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:23.416335+0000","last_change":"2023-07-14T12:57:39.145533+0000","last_active":"2023-07-14T12:59:23.416335+0000","last_peered":"2023-07-14T12:59:23.416335+0000","last_clean":"2023-07-14T12:59:23.416335+0000","last_became_active":"2023-07-14T12:57:39.145201+0000","last_became_peered":"2023-07-14T12:57:39.145201+0000","last_unstale":"2023-07-14T12:59:23.416335+0000","last_undegraded":"2023-07-14T12:59:23.416335+0000","last_fullsized":"2023-07-14T12:59:23.416335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:46.324639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1023,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.857816+0000","last_change":"2023-07-14T12:57:40.160047+0000","last_active":"2023-07-14T12:59:06.857816+0000","last_peered":"2023-07-14T12:59:06.857816+0000","last_clean":"2023-07-14T12:59:06.857816+0000","last_became_active":"2023-07-14T12:57:40.159751+0000","last_became_peered":"2023-07-14T12:57:40.159751+0000","last_unstale":"2023-07-14T12:59:06.857816+0000","last_undegraded":"2023-07-14T12:59:06.857816+0000","last_fullsized":"2023-07-14T12:59:06.857816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:16.874363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.130840+0000","last_change":"2023-07-14T12:58:08.130840+0000","last_active":"2023-07-14T12:58:08.130840+0000","last_peered":"2023-07-14T12:58:08.130840+0000","last_clean":"2023-07-14T12:58:08.130840+0000","last_became_active":"2023-07-14T12:58:08.116583+0000","last_became_peered":"2023-07-14T12:58:08.116583+0000","last_unstale":"2023-07-14T12:58:08.130840+0000","last_undegraded":"2023-07-14T12:58:08.130840+0000","last_fullsized":"2023-07-14T12:58:08.130840+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:07:34.361949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.875167+0000","last_change":"2023-07-14T12:57:40.173741+0000","last_active":"2023-07-14T12:59:06.875167+0000","last_peered":"2023-07-14T12:59:06.875167+0000","last_clean":"2023-07-14T12:59:06.875167+0000","last_became_active":"2023-07-14T12:57:40.173427+0000","last_became_peered":"2023-07-14T12:57:40.173427+0000","last_unstale":"2023-07-14T12:59:06.875167+0000","last_undegraded":"2023-07-14T12:59:06.875167+0000","last_fullsized":"2023-07-14T12:59:06.875167+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:41:16.366763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963223+0000","last_change":"2023-07-14T12:57:39.140979+0000","last_active":"2023-07-14T12:58:07.963223+0000","last_peered":"2023-07-14T12:58:07.963223+0000","last_clean":"2023-07-14T12:58:07.963223+0000","last_became_active":"2023-07-14T12:57:39.140692+0000","last_became_peered":"2023-07-14T12:57:39.140692+0000","last_unstale":"2023-07-14T12:58:07.963223+0000","last_undegraded":"2023-07-14T12:58:07.963223+0000","last_fullsized":"2023-07-14T12:58:07.963223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:01:09.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867229+0000","last_change":"2023-07-14T12:57:40.164258+0000","last_active":"2023-07-14T12:59:06.867229+0000","last_peered":"2023-07-14T12:59:06.867229+0000","last_clean":"2023-07-14T12:59:06.867229+0000","last_became_active":"2023-07-14T12:57:40.163911+0000","last_became_peered":"2023-07-14T12:57:40.163911+0000","last_unstale":"2023-07-14T12:59:06.867229+0000","last_undegraded":"2023-07-14T12:59:06.867229+0000","last_fullsized":"2023-07-14T12:59:06.867229+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:45.474358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959321+0000","last_change":"2023-07-14T12:57:39.151301+0000","last_active":"2023-07-14T12:58:07.959321+0000","last_peered":"2023-07-14T12:58:07.959321+0000","last_clean":"2023-07-14T12:58:07.959321+0000","last_became_active":"2023-07-14T12:57:39.150948+0000","last_became_peered":"2023-07-14T12:57:39.150948+0000","last_unstale":"2023-07-14T12:58:07.959321+0000","last_undegraded":"2023-07-14T12:58:07.959321+0000","last_fullsized":"2023-07-14T12:58:07.959321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:11.221824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869578+0000","last_change":"2023-07-14T12:57:40.158591+0000","last_active":"2023-07-14T12:59:06.869578+0000","last_peered":"2023-07-14T12:59:06.869578+0000","last_clean":"2023-07-14T12:59:06.869578+0000","last_became_active":"2023-07-14T12:57:40.158229+0000","last_became_peered":"2023-07-14T12:57:40.158229+0000","last_unstale":"2023-07-14T12:59:06.869578+0000","last_undegraded":"2023-07-14T12:59:06.869578+0000","last_fullsized":"2023-07-14T12:59:06.869578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:48.116113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957827+0000","last_change":"2023-07-14T12:57:39.152151+0000","last_active":"2023-07-14T12:58:07.957827+0000","last_peered":"2023-07-14T12:58:07.957827+0000","last_clean":"2023-07-14T12:58:07.957827+0000","last_became_active":"2023-07-14T12:57:39.151859+0000","last_became_peered":"2023-07-14T12:57:39.151859+0000","last_unstale":"2023-07-14T12:58:07.957827+0000","last_undegraded":"2023-07-14T12:58:07.957827+0000","last_fullsized":"2023-07-14T12:58:07.957827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:19:10.573132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867586+0000","last_change":"2023-07-14T12:57:40.166604+0000","last_active":"2023-07-14T12:59:06.867586+0000","last_peered":"2023-07-14T12:59:06.867586+0000","last_clean":"2023-07-14T12:59:06.867586+0000","last_became_active":"2023-07-14T12:57:40.166265+0000","last_became_peered":"2023-07-14T12:57:40.166265+0000","last_unstale":"2023-07-14T12:59:06.867586+0000","last_undegraded":"2023-07-14T12:59:06.867586+0000","last_fullsized":"2023-07-14T12:59:06.867586+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:01.157573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.865245+0000","last_change":"2023-07-14T12:57:40.169910+0000","last_active":"2023-07-14T12:59:06.865245+0000","last_peered":"2023-07-14T12:59:06.865245+0000","last_clean":"2023-07-14T12:59:06.865245+0000","last_became_active":"2023-07-14T12:57:40.169621+0000","last_became_peered":"2023-07-14T12:57:40.169621+0000","last_unstale":"2023-07-14T12:59:06.865245+0000","last_undegraded":"2023-07-14T12:59:06.865245+0000","last_fullsized":"2023-07-14T12:59:06.865245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:14.831482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:26.422239+0000","last_change":"2023-07-14T12:57:39.144463+0000","last_active":"2023-07-14T12:59:26.422239+0000","last_peered":"2023-07-14T12:59:26.422239+0000","last_clean":"2023-07-14T12:59:26.422239+0000","last_became_active":"2023-07-14T12:57:39.142094+0000","last_became_peered":"2023-07-14T12:57:39.142094+0000","last_unstale":"2023-07-14T12:59:26.422239+0000","last_undegraded":"2023-07-14T12:59:26.422239+0000","last_fullsized":"2023-07-14T12:59:26.422239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:11:20.958238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.876605+0000","last_change":"2023-07-14T12:57:40.163588+0000","last_active":"2023-07-14T12:59:06.876605+0000","last_peered":"2023-07-14T12:59:06.876605+0000","last_clean":"2023-07-14T12:59:06.876605+0000","last_became_active":"2023-07-14T12:57:40.162611+0000","last_became_peered":"2023-07-14T12:57:40.162611+0000","last_unstale":"2023-07-14T12:59:06.876605+0000","last_undegraded":"2023-07-14T12:59:06.876605+0000","last_fullsized":"2023-07-14T12:59:06.876605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:21:59.184916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113974+0000","last_change":"2023-07-14T12:57:39.143581+0000","last_active":"2023-07-14T12:58:08.113974+0000","last_peered":"2023-07-14T12:58:08.113974+0000","last_clean":"2023-07-14T12:58:08.113974+0000","last_became_active":"2023-07-14T12:57:39.143257+0000","last_became_peered":"2023-07-14T12:57:39.143257+0000","last_unstale":"2023-07-14T12:58:08.113974+0000","last_undegraded":"2023-07-14T12:58:08.113974+0000","last_fullsized":"2023-07-14T12:58:08.113974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:30.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":351,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957918+0000","last_change":"2023-07-14T12:56:23.360103+0000","last_active":"2023-07-14T12:58:07.957918+0000","last_peered":"2023-07-14T12:58:07.957918+0000","last_clean":"2023-07-14T12:58:07.957918+0000","last_became_active":"2023-07-14T12:56:23.359608+0000","last_became_peered":"2023-07-14T12:56:23.359608+0000","last_unstale":"2023-07-14T12:58:07.957918+0000","last_undegraded":"2023-07-14T12:58:07.957918+0000","last_fullsized":"2023-07-14T12:58:07.957918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.397328+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:52:52.622736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869371+0000","last_change":"2023-07-14T12:57:40.158039+0000","last_active":"2023-07-14T12:59:06.869371+0000","last_peered":"2023-07-14T12:59:06.869371+0000","last_clean":"2023-07-14T12:59:06.869371+0000","last_became_active":"2023-07-14T12:57:40.157629+0000","last_became_peered":"2023-07-14T12:57:40.157629+0000","last_unstale":"2023-07-14T12:59:06.869371+0000","last_undegraded":"2023-07-14T12:59:06.869371+0000","last_fullsized":"2023-07-14T12:59:06.869371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:18.205760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958150+0000","last_change":"2023-07-14T12:57:39.146449+0000","last_active":"2023-07-14T12:58:07.958150+0000","last_peered":"2023-07-14T12:58:07.958150+0000","last_clean":"2023-07-14T12:58:07.958150+0000","last_became_active":"2023-07-14T12:57:39.146109+0000","last_became_peered":"2023-07-14T12:57:39.146109+0000","last_unstale":"2023-07-14T12:58:07.958150+0000","last_undegraded":"2023-07-14T12:58:07.958150+0000","last_fullsized":"2023-07-14T12:58:07.958150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:15.222237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963386+0000","last_change":"2023-07-14T12:57:39.149417+0000","last_active":"2023-07-14T12:58:07.963386+0000","last_peered":"2023-07-14T12:58:07.963386+0000","last_clean":"2023-07-14T12:58:07.963386+0000","last_became_active":"2023-07-14T12:57:39.149097+0000","last_became_peered":"2023-07-14T12:57:39.149097+0000","last_unstale":"2023-07-14T12:58:07.963386+0000","last_undegraded":"2023-07-14T12:58:07.963386+0000","last_fullsized":"2023-07-14T12:58:07.963386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:10.550476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868801+0000","last_change":"2023-07-14T12:57:40.160881+0000","last_active":"2023-07-14T12:59:06.868801+0000","last_peered":"2023-07-14T12:59:06.868801+0000","last_clean":"2023-07-14T12:59:06.868801+0000","last_became_active":"2023-07-14T12:57:40.158570+0000","last_became_peered":"2023-07-14T12:57:40.158570+0000","last_unstale":"2023-07-14T12:59:06.868801+0000","last_undegraded":"2023-07-14T12:59:06.868801+0000","last_fullsized":"2023-07-14T12:59:06.868801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:46.644633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:08.903948+0000","last_change":"2023-07-14T12:57:39.142805+0000","last_active":"2023-07-14T12:59:08.903948+0000","last_peered":"2023-07-14T12:59:08.903948+0000","last_clean":"2023-07-14T12:59:08.903948+0000","last_became_active":"2023-07-14T12:57:39.142417+0000","last_became_peered":"2023-07-14T12:57:39.142417+0000","last_unstale":"2023-07-14T12:59:08.903948+0000","last_undegraded":"2023-07-14T12:59:08.903948+0000","last_fullsized":"2023-07-14T12:59:08.903948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:01:14.949862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866590+0000","last_change":"2023-07-14T12:57:40.171695+0000","last_active":"2023-07-14T12:59:06.866590+0000","last_peered":"2023-07-14T12:59:06.866590+0000","last_clean":"2023-07-14T12:59:06.866590+0000","last_became_active":"2023-07-14T12:57:40.171344+0000","last_became_peered":"2023-07-14T12:57:40.171344+0000","last_unstale":"2023-07-14T12:59:06.866590+0000","last_undegraded":"2023-07-14T12:59:06.866590+0000","last_fullsized":"2023-07-14T12:59:06.866590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:49.528964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113794+0000","last_change":"2023-07-14T12:57:39.141065+0000","last_active":"2023-07-14T12:58:08.113794+0000","last_peered":"2023-07-14T12:58:08.113794+0000","last_clean":"2023-07-14T12:58:08.113794+0000","last_became_active":"2023-07-14T12:57:39.140681+0000","last_became_peered":"2023-07-14T12:57:39.140681+0000","last_unstale":"2023-07-14T12:58:08.113794+0000","last_undegraded":"2023-07-14T12:58:08.113794+0000","last_fullsized":"2023-07-14T12:58:08.113794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:38:35.851889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.872326+0000","last_change":"2023-07-14T12:57:40.158403+0000","last_active":"2023-07-14T12:59:06.872326+0000","last_peered":"2023-07-14T12:59:06.872326+0000","last_clean":"2023-07-14T12:59:06.872326+0000","last_became_active":"2023-07-14T12:57:40.158077+0000","last_became_peered":"2023-07-14T12:57:40.158077+0000","last_unstale":"2023-07-14T12:59:06.872326+0000","last_undegraded":"2023-07-14T12:59:06.872326+0000","last_fullsized":"2023-07-14T12:59:06.872326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:27:14.759138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.112919+0000","last_change":"2023-07-14T12:57:39.139613+0000","last_active":"2023-07-14T12:58:08.112919+0000","last_peered":"2023-07-14T12:58:08.112919+0000","last_clean":"2023-07-14T12:58:08.112919+0000","last_became_active":"2023-07-14T12:57:39.139306+0000","last_became_peered":"2023-07-14T12:57:39.139306+0000","last_unstale":"2023-07-14T12:58:08.112919+0000","last_undegraded":"2023-07-14T12:58:08.112919+0000","last_fullsized":"2023-07-14T12:58:08.112919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:16:13.426604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.831149+0000","last_change":"2023-07-14T12:57:40.169715+0000","last_active":"2023-07-14T12:59:06.831149+0000","last_peered":"2023-07-14T12:59:06.831149+0000","last_clean":"2023-07-14T12:59:06.831149+0000","last_became_active":"2023-07-14T12:57:40.169319+0000","last_became_peered":"2023-07-14T12:57:40.169319+0000","last_unstale":"2023-07-14T12:59:06.831149+0000","last_undegraded":"2023-07-14T12:59:06.831149+0000","last_fullsized":"2023-07-14T12:59:06.831149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:49.187041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.964905+0000","last_change":"2023-07-14T12:57:39.134058+0000","last_active":"2023-07-14T12:58:07.964905+0000","last_peered":"2023-07-14T12:58:07.964905+0000","last_clean":"2023-07-14T12:58:07.964905+0000","last_became_active":"2023-07-14T12:57:39.133143+0000","last_became_peered":"2023-07-14T12:57:39.133143+0000","last_unstale":"2023-07-14T12:58:07.964905+0000","last_undegraded":"2023-07-14T12:58:07.964905+0000","last_fullsized":"2023-07-14T12:58:07.964905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:22:41.049828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.875376+0000","last_change":"2023-07-14T12:57:40.164106+0000","last_active":"2023-07-14T12:59:06.875376+0000","last_peered":"2023-07-14T12:59:06.875376+0000","last_clean":"2023-07-14T12:59:06.875376+0000","last_became_active":"2023-07-14T12:57:40.163768+0000","last_became_peered":"2023-07-14T12:57:40.163768+0000","last_unstale":"2023-07-14T12:59:06.875376+0000","last_undegraded":"2023-07-14T12:59:06.875376+0000","last_fullsized":"2023-07-14T12:59:06.875376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:27.922121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.971006+0000","last_change":"2023-07-14T12:58:07.970517+0000","last_active":"2023-07-14T12:58:07.971006+0000","last_peered":"2023-07-14T12:58:07.971006+0000","last_clean":"2023-07-14T12:58:07.971006+0000","last_became_active":"2023-07-14T12:58:07.967121+0000","last_became_peered":"2023-07-14T12:58:07.967121+0000","last_unstale":"2023-07-14T12:58:07.971006+0000","last_undegraded":"2023-07-14T12:58:07.971006+0000","last_fullsized":"2023-07-14T12:58:07.971006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:48:35.651155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.871293+0000","last_change":"2023-07-14T12:57:40.163373+0000","last_active":"2023-07-14T12:59:06.871293+0000","last_peered":"2023-07-14T12:59:06.871293+0000","last_clean":"2023-07-14T12:59:06.871293+0000","last_became_active":"2023-07-14T12:57:40.162852+0000","last_became_peered":"2023-07-14T12:57:40.162852+0000","last_unstale":"2023-07-14T12:59:06.871293+0000","last_undegraded":"2023-07-14T12:59:06.871293+0000","last_fullsized":"2023-07-14T12:59:06.871293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:38.396243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963013+0000","last_change":"2023-07-14T12:57:39.143961+0000","last_active":"2023-07-14T12:58:07.963013+0000","last_peered":"2023-07-14T12:58:07.963013+0000","last_clean":"2023-07-14T12:58:07.963013+0000","last_became_active":"2023-07-14T12:57:39.143599+0000","last_became_peered":"2023-07-14T12:57:39.143599+0000","last_unstale":"2023-07-14T12:58:07.963013+0000","last_undegraded":"2023-07-14T12:58:07.963013+0000","last_fullsized":"2023-07-14T12:58:07.963013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:25.216766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878725+0000","last_change":"2023-07-14T12:57:40.157972+0000","last_active":"2023-07-14T12:59:06.878725+0000","last_peered":"2023-07-14T12:59:06.878725+0000","last_clean":"2023-07-14T12:59:06.878725+0000","last_became_active":"2023-07-14T12:57:40.157645+0000","last_became_peered":"2023-07-14T12:57:40.157645+0000","last_unstale":"2023-07-14T12:59:06.878725+0000","last_undegraded":"2023-07-14T12:59:06.878725+0000","last_fullsized":"2023-07-14T12:59:06.878725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:54:33.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965731+0000","last_change":"2023-07-14T12:57:39.153405+0000","last_active":"2023-07-14T12:58:07.965731+0000","last_peered":"2023-07-14T12:58:07.965731+0000","last_clean":"2023-07-14T12:58:07.965731+0000","last_became_active":"2023-07-14T12:57:39.153029+0000","last_became_peered":"2023-07-14T12:57:39.153029+0000","last_unstale":"2023-07-14T12:58:07.965731+0000","last_undegraded":"2023-07-14T12:58:07.965731+0000","last_fullsized":"2023-07-14T12:58:07.965731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:47:58.753892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.877188+0000","last_change":"2023-07-14T12:57:40.163910+0000","last_active":"2023-07-14T12:59:06.877188+0000","last_peered":"2023-07-14T12:59:06.877188+0000","last_clean":"2023-07-14T12:59:06.877188+0000","last_became_active":"2023-07-14T12:57:40.163539+0000","last_became_peered":"2023-07-14T12:57:40.163539+0000","last_unstale":"2023-07-14T12:59:06.877188+0000","last_undegraded":"2023-07-14T12:59:06.877188+0000","last_fullsized":"2023-07-14T12:59:06.877188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:12.543412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113454+0000","last_change":"2023-07-14T12:57:39.132649+0000","last_active":"2023-07-14T12:58:08.113454+0000","last_peered":"2023-07-14T12:58:08.113454+0000","last_clean":"2023-07-14T12:58:08.113454+0000","last_became_active":"2023-07-14T12:57:39.132295+0000","last_became_peered":"2023-07-14T12:57:39.132295+0000","last_unstale":"2023-07-14T12:58:08.113454+0000","last_undegraded":"2023-07-14T12:58:08.113454+0000","last_fullsized":"2023-07-14T12:58:08.113454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:19.495427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.862100+0000","last_change":"2023-07-14T12:57:40.166285+0000","last_active":"2023-07-14T12:59:06.862100+0000","last_peered":"2023-07-14T12:59:06.862100+0000","last_clean":"2023-07-14T12:59:06.862100+0000","last_became_active":"2023-07-14T12:57:40.165968+0000","last_became_peered":"2023-07-14T12:57:40.165968+0000","last_unstale":"2023-07-14T12:59:06.862100+0000","last_undegraded":"2023-07-14T12:59:06.862100+0000","last_fullsized":"2023-07-14T12:59:06.862100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:22.071229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961885+0000","last_change":"2023-07-14T12:57:39.150988+0000","last_active":"2023-07-14T12:58:07.961885+0000","last_peered":"2023-07-14T12:58:07.961885+0000","last_clean":"2023-07-14T12:58:07.961885+0000","last_became_active":"2023-07-14T12:57:39.150552+0000","last_became_peered":"2023-07-14T12:57:39.150552+0000","last_unstale":"2023-07-14T12:58:07.961885+0000","last_undegraded":"2023-07-14T12:58:07.961885+0000","last_fullsized":"2023-07-14T12:58:07.961885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:04:27.733757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868282+0000","last_change":"2023-07-14T12:57:40.169729+0000","last_active":"2023-07-14T12:59:06.868282+0000","last_peered":"2023-07-14T12:59:06.868282+0000","last_clean":"2023-07-14T12:59:06.868282+0000","last_became_active":"2023-07-14T12:57:40.169432+0000","last_became_peered":"2023-07-14T12:57:40.169432+0000","last_unstale":"2023-07-14T12:59:06.868282+0000","last_undegraded":"2023-07-14T12:59:06.868282+0000","last_fullsized":"2023-07-14T12:59:06.868282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:27:50.731427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867770+0000","last_change":"2023-07-14T12:57:40.167668+0000","last_active":"2023-07-14T12:59:06.867770+0000","last_peered":"2023-07-14T12:59:06.867770+0000","last_clean":"2023-07-14T12:59:06.867770+0000","last_became_active":"2023-07-14T12:57:40.167328+0000","last_became_peered":"2023-07-14T12:57:40.167328+0000","last_unstale":"2023-07-14T12:59:06.867770+0000","last_undegraded":"2023-07-14T12:59:06.867770+0000","last_fullsized":"2023-07-14T12:59:06.867770+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:24.623266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.861260+0000","last_change":"2023-07-14T12:57:40.161340+0000","last_active":"2023-07-14T12:59:06.861260+0000","last_peered":"2023-07-14T12:59:06.861260+0000","last_clean":"2023-07-14T12:59:06.861260+0000","last_became_active":"2023-07-14T12:57:40.161024+0000","last_became_peered":"2023-07-14T12:57:40.161024+0000","last_unstale":"2023-07-14T12:59:06.861260+0000","last_undegraded":"2023-07-14T12:59:06.861260+0000","last_fullsized":"2023-07-14T12:59:06.861260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:56.043017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870956+0000","last_change":"2023-07-14T12:57:40.159287+0000","last_active":"2023-07-14T12:59:06.870956+0000","last_peered":"2023-07-14T12:59:06.870956+0000","last_clean":"2023-07-14T12:59:06.870956+0000","last_became_active":"2023-07-14T12:57:40.158889+0000","last_became_peered":"2023-07-14T12:57:40.158889+0000","last_unstale":"2023-07-14T12:59:06.870956+0000","last_undegraded":"2023-07-14T12:59:06.870956+0000","last_fullsized":"2023-07-14T12:59:06.870956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:27.078113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.874752+0000","last_change":"2023-07-14T12:57:40.168898+0000","last_active":"2023-07-14T12:59:06.874752+0000","last_peered":"2023-07-14T12:59:06.874752+0000","last_clean":"2023-07-14T12:59:06.874752+0000","last_became_active":"2023-07-14T12:57:40.168596+0000","last_became_peered":"2023-07-14T12:57:40.168596+0000","last_unstale":"2023-07-14T12:59:06.874752+0000","last_undegraded":"2023-07-14T12:59:06.874752+0000","last_fullsized":"2023-07-14T12:59:06.874752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:18.836992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.873481+0000","last_change":"2023-07-14T12:57:40.156267+0000","last_active":"2023-07-14T12:59:06.873481+0000","last_peered":"2023-07-14T12:59:06.873481+0000","last_clean":"2023-07-14T12:59:06.873481+0000","last_became_active":"2023-07-14T12:57:40.155909+0000","last_became_peered":"2023-07-14T12:57:40.155909+0000","last_unstale":"2023-07-14T12:59:06.873481+0000","last_undegraded":"2023-07-14T12:59:06.873481+0000","last_fullsized":"2023-07-14T12:59:06.873481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:07.081173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866738+0000","last_change":"2023-07-14T12:57:40.162956+0000","last_active":"2023-07-14T12:59:06.866738+0000","last_peered":"2023-07-14T12:59:06.866738+0000","last_clean":"2023-07-14T12:59:06.866738+0000","last_became_active":"2023-07-14T12:57:40.162373+0000","last_became_peered":"2023-07-14T12:57:40.162373+0000","last_unstale":"2023-07-14T12:59:06.866738+0000","last_undegraded":"2023-07-14T12:59:06.866738+0000","last_fullsized":"2023-07-14T12:59:06.866738+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:15.307049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.879456+0000","last_change":"2023-07-14T12:57:40.158655+0000","last_active":"2023-07-14T12:59:06.879456+0000","last_peered":"2023-07-14T12:59:06.879456+0000","last_clean":"2023-07-14T12:59:06.879456+0000","last_became_active":"2023-07-14T12:57:40.158290+0000","last_became_peered":"2023-07-14T12:57:40.158290+0000","last_unstale":"2023-07-14T12:59:06.879456+0000","last_undegraded":"2023-07-14T12:59:06.879456+0000","last_fullsized":"2023-07-14T12:59:06.879456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:02:22.373566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.859587+0000","last_change":"2023-07-14T12:57:40.164132+0000","last_active":"2023-07-14T12:59:06.859587+0000","last_peered":"2023-07-14T12:59:06.859587+0000","last_clean":"2023-07-14T12:59:06.859587+0000","last_became_active":"2023-07-14T12:57:40.163774+0000","last_became_peered":"2023-07-14T12:57:40.163774+0000","last_unstale":"2023-07-14T12:59:06.859587+0000","last_undegraded":"2023-07-14T12:59:06.859587+0000","last_fullsized":"2023-07-14T12:59:06.859587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:30.562785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868125+0000","last_change":"2023-07-14T12:57:40.171046+0000","last_active":"2023-07-14T12:59:06.868125+0000","last_peered":"2023-07-14T12:59:06.868125+0000","last_clean":"2023-07-14T12:59:06.868125+0000","last_became_active":"2023-07-14T12:57:40.170727+0000","last_became_peered":"2023-07-14T12:57:40.170727+0000","last_unstale":"2023-07-14T12:59:06.868125+0000","last_undegraded":"2023-07-14T12:59:06.868125+0000","last_fullsized":"2023-07-14T12:59:06.868125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:44.795580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.864235+0000","last_change":"2023-07-14T12:57:40.171636+0000","last_active":"2023-07-14T12:59:06.864235+0000","last_peered":"2023-07-14T12:59:06.864235+0000","last_clean":"2023-07-14T12:59:06.864235+0000","last_became_active":"2023-07-14T12:57:40.171365+0000","last_became_peered":"2023-07-14T12:57:40.171365+0000","last_unstale":"2023-07-14T12:59:06.864235+0000","last_undegraded":"2023-07-14T12:59:06.864235+0000","last_fullsized":"2023-07-14T12:59:06.864235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:10.582323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878104+0000","last_change":"2023-07-14T12:57:40.162963+0000","last_active":"2023-07-14T12:59:06.878104+0000","last_peered":"2023-07-14T12:59:06.878104+0000","last_clean":"2023-07-14T12:59:06.878104+0000","last_became_active":"2023-07-14T12:57:40.162614+0000","last_became_peered":"2023-07-14T12:57:40.162614+0000","last_unstale":"2023-07-14T12:59:06.878104+0000","last_undegraded":"2023-07-14T12:59:06.878104+0000","last_fullsized":"2023-07-14T12:59:06.878104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:46.953808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.873797+0000","last_change":"2023-07-14T12:57:40.156138+0000","last_active":"2023-07-14T12:59:06.873797+0000","last_peered":"2023-07-14T12:59:06.873797+0000","last_clean":"2023-07-14T12:59:06.873797+0000","last_became_active":"2023-07-14T12:57:40.155785+0000","last_became_peered":"2023-07-14T12:57:40.155785+0000","last_unstale":"2023-07-14T12:59:06.873797+0000","last_undegraded":"2023-07-14T12:59:06.873797+0000","last_fullsized":"2023-07-14T12:59:06.873797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:45.189290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866624+0000","last_change":"2023-07-14T12:57:40.163978+0000","last_active":"2023-07-14T12:59:06.866624+0000","last_peered":"2023-07-14T12:59:06.866624+0000","last_clean":"2023-07-14T12:59:06.866624+0000","last_became_active":"2023-07-14T12:57:40.163620+0000","last_became_peered":"2023-07-14T12:57:40.163620+0000","last_unstale":"2023-07-14T12:59:06.866624+0000","last_undegraded":"2023-07-14T12:59:06.866624+0000","last_fullsized":"2023-07-14T12:59:06.866624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:48.986548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":215126,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64324,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":630,"num_read_kb":384,"num_write":161,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":146,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":192972,"data_compressed":4806,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351010,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":459210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":9.1430000000000007,"5min":9.1430000000000007,"15min":9.1430000000000007},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67600000000000005,"15min":0.68799999999999994},"min":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92800000000000005,"5min":1.097,"15min":1.097},"last":0.64800000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59899999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.042,"5min":1.111,"15min":1.111},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93300000000000005,"5min":1.341,"15min":1.341},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.41499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92500000000000004,"5min":1.347,"15min":1.347},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92800000000000005,"5min":1.506,"15min":1.506},"last":0.84799999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.3959999999999999,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81799999999999995,"15min":0.81399999999999995},"min":{"1min":0.623,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0640000000000001,"5min":1.542,"15min":1.542},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.80500000000000005},"min":{"1min":0.51500000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":1.411,"15min":1.411},"last":1.024}]},{"osd":5,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94299999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.79700000000000004,"15min":0.80400000000000005},"min":{"1min":0.46600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.028,"5min":1.881,"15min":1.881},"last":0.94499999999999995}]},{"osd":6,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92600000000000005,"15min":0.92800000000000005},"min":{"1min":0.74199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1220000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.95599999999999996,"5min":1.373,"15min":1.373},"last":0.92800000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":1.097},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.1180000000000001}]},{"osd":9,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.96099999999999997,"15min":0.91800000000000004},"min":{"1min":0.66300000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":9.2210000000000001,"5min":9.2210000000000001,"15min":9.2210000000000001},"last":1.133},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96399999999999997,"15min":0.96099999999999997},"min":{"1min":0.70799999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.1679999999999999}]},{"osd":10,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.68000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.093,"5min":1.633,"15min":1.633},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.95199999999999996,"15min":0.95999999999999996},"min":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.069,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1579999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612647,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1097728,"data_stored":1110942,"data_compressed":37730,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82699999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.034,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.92000000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85999999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.82299999999999995}]},{"osd":4,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89800000000000002,"5min":1.391,"15min":1.391},"last":0.75}]},{"osd":5,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.65700000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95599999999999996,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.996,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.95299999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.90000000000000002,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.83999999999999997,"15min":0.86299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93899999999999995,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.872}]},{"osd":7,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.86599999999999999,"15min":0.874},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.98099999999999998,"5min":1.298,"15min":1.298},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92200000000000004,"15min":0.93600000000000005},"min":{"1min":0.61199999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.018,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.92200000000000004}]},{"osd":9,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.94599999999999995,"15min":0.96999999999999997},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":0.998,"5min":1.746,"15min":1.746},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.052,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.85299999999999998}]},{"osd":11,"last update":"Fri Jul 14 12:58:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91200000000000003,"15min":0.91700000000000004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.069,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.145,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.032}]}]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.0150000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.80300000000000005},"min":{"1min":0.53000000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.3120000000000001,"5min":1.383,"15min":1.383},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.753,"15min":0.747},"min":{"1min":0.51400000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.68400000000000005,"15min":0.68100000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":3.4550000000000001,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.2050000000000001,"5min":3.2050000000000001,"15min":3.2050000000000001},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.83799999999999997,"15min":0.88400000000000001},"min":{"1min":0.54000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85699999999999998,"15min":0.89300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.89500000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.623},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85599999999999998,"15min":0.879},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86099999999999999,"15min":0.89000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":3.173,"5min":3.173,"15min":3.173},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.88900000000000001,"15min":0.93999999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.94399999999999995,"15min":0.98099999999999998},"min":{"1min":0.61799999999999999,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.97799999999999998,"15min":1.014},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":0.73199999999999998}]},{"osd":8,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.95999999999999996,"15min":1.012},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3109999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.97499999999999998,"15min":1.0209999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.66900000000000004}]},{"osd":10,"last update":"Fri Jul 14 12:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.96899999999999997},"min":{"1min":0.622,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1879999999999999,"5min":3.1389999999999998,"15min":3.1389999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.70399999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.82399999999999995}]}]},{"osd":8,"up_from":60,"seq":257698037812,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6559999999999999,"5min":1.855,"15min":1.855},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6220000000000001,"5min":1.847,"15min":1.847},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.52800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.746,"15min":0.73499999999999999},"min":{"1min":0.625,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.024,"5min":1.802,"15min":1.802},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.628,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1200000000000001,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.67300000000000004}]},{"osd":3,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.90300000000000002,"15min":0.97799999999999998},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5249999999999999,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82899999999999996,"15min":0.85999999999999999},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.48,"5min":1.825,"15min":1.825},"last":0.78200000000000003}]},{"osd":4,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.137,"5min":1.3,"15min":1.3},"last":0.88},{"interface":"front","average":{"1min":0.75,"5min":0.80100000000000005,"15min":0.81000000000000005},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94599999999999995,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75800000000000001,"15min":0.78400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0720000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.93700000000000006},"min":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.575,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.92600000000000005,"15min":0.95099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1899999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.014,"5min":1.73,"15min":1.73},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.92400000000000004,"15min":0.93500000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2490000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.999}]},{"osd":9,"last update":"Fri Jul 14 12:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.71799999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3779999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.018},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88500000000000001,"15min":0.89100000000000001},"min":{"1min":0.69199999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.93899999999999995}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.91600000000000004,"15min":0.88600000000000001},"min":{"1min":0.79900000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.127,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88700000000000001,"15min":0.86899999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.103,"5min":1.161,"15min":1.161},"last":0.89600000000000002}]},{"osd":11,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.103}]}]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":1011712,"data_stored":1051416,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66900000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81499999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.016,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.54200000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.85299999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77700000000000002,"15min":0.76500000000000001},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.091,"5min":1.397,"15min":1.397},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.70599999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0009999999999999,"5min":1.169,"15min":1.169},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.67900000000000005,"15min":0.70799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.81000000000000005,"15min":0.84199999999999997},"min":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.83399999999999996},"min":{"1min":0.61799999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84199999999999997,"15min":0.85499999999999998},"min":{"1min":0.55800000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.85799999999999998,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.1459999999999999,"5min":1.639,"15min":1.639},"last":0.89100000000000001}]},{"osd":8,"last update":"Fri Jul 14 12:58:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.82799999999999996,"15min":0.80400000000000005},"min":{"1min":0.69399999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83599999999999997,"15min":0.82599999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.78000000000000003}]},{"osd":9,"last update":"Fri Jul 14 12:59:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.405,"5min":1.004,"15min":0.93200000000000005},"min":{"1min":0.67300000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":9.7870000000000008,"5min":9.7870000000000008,"15min":9.7870000000000008},"last":0.873}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88900000000000001,"15min":0.91700000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.135,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93000000000000005,"15min":0.93400000000000005},"min":{"1min":0.64100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1699999999999999,"5min":1.276,"15min":1.276},"last":0.60699999999999998}]},{"osd":11,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.92900000000000005}]}]},{"osd":6,"up_from":47,"seq":201863462974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":458807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53300000000000003,"15min":0.51200000000000001},"min":{"1min":0.34499999999999997,"5min":0.307,"15min":0.307},"max":{"1min":1.458,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.847,"5min":2.081,"15min":2.081},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.71899999999999997},"min":{"1min":0.54600000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77400000000000002,"15min":0.73499999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.6319999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.755}]},{"osd":2,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.73499999999999999,"15min":0.70799999999999996},"min":{"1min":0.52900000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.59299999999999997,"5min":0.44,"15min":0.44},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68999999999999995,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.45900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.706,"5min":2.113,"15min":2.113},"last":0.504}]},{"osd":4,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.752,"15min":0.73199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.59599999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.83399999999999996,"15min":0.84599999999999997},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85299999999999998,"15min":0.83299999999999996},"min":{"1min":0.64400000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84499999999999997,"15min":0.82399999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.74099999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.89600000000000002,"15min":0.91700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93200000000000005,"15min":0.94999999999999996},"min":{"1min":0.72399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.625}]},{"osd":9,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.878,"15min":0.91300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.93600000000000005,"15min":0.97399999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5940000000000001,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.80800000000000005}]},{"osd":10,"last update":"Fri Jul 14 12:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":1.0309999999999999,"15min":1.091},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":0.91500000000000004,"5min":4.109,"15min":4.109},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.93200000000000005,"15min":0.93899999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.98999999999999999,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":1007616,"data_stored":518165,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.625,"15min":0.57299999999999995},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":1.038,"15min":1.038},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65900000000000003,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40799999999999997,"15min":0.40500000000000003},"max":{"1min":1.024,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.76400000000000001,"15min":0.66100000000000003},"min":{"1min":0.69299999999999995,"5min":0.41099999999999998,"15min":0.34000000000000002},"max":{"1min":1.127,"5min":1.131,"15min":1.131},"last":1.2},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.70699999999999996,"15min":0.65500000000000003},"min":{"1min":0.64100000000000001,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.98099999999999998,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.90900000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.55400000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94099999999999995,"5min":0.997,"15min":0.997},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.018,"5min":0.81299999999999994,"15min":0.73099999999999998},"min":{"1min":0.61299999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":5.1369999999999996,"5min":5.1369999999999996,"15min":5.1369999999999996},"last":1.0800000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.61299999999999999,"15min":0.54700000000000004},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0580000000000001,"5min":1.079,"15min":1.079},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.44500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85599999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Jul 14 12:59:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.74399999999999999,"15min":0.68500000000000005},"min":{"1min":0.56899999999999995,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0149999999999999,"5min":1.115,"15min":1.115},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.76200000000000001,"15min":0.72599999999999998},"min":{"1min":0.66700000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0820000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.95799999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74299999999999999,"15min":0.70899999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0960000000000001,"5min":0.875,"15min":0.80700000000000005},"min":{"1min":0.56899999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":5.1749999999999998,"5min":5.1749999999999998,"15min":5.1749999999999998},"last":1.2350000000000001}]},{"osd":7,"last update":"Fri Jul 14 12:59:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.79800000000000004,"15min":0.71999999999999997},"min":{"1min":0.66500000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2330000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.73699999999999999,"15min":0.65300000000000002},"min":{"1min":0.60299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1439999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.97299999999999998}]},{"osd":8,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.83899999999999997,"15min":0.80300000000000005},"min":{"1min":0.71999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.91100000000000003,"15min":0.875},"min":{"1min":0.61699999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.1559999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.292}]},{"osd":9,"last update":"Fri Jul 14 12:59:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.90800000000000003,"15min":0.88300000000000001},"min":{"1min":0.59199999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.1559999999999997,"5min":5.1559999999999997,"15min":5.1559999999999997},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.02,"5min":1,"15min":1.0069999999999999},"min":{"1min":0.80800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.304,"5min":1.496,"15min":1.496},"last":1.266}]},{"osd":10,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.046,"15min":1.048},"min":{"1min":0.82099999999999995,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.3160000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.89900000000000002,"15min":0.89200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.095}]},{"osd":11,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":1.179}]}]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":974848,"data_stored":460072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.66400000000000003,"15min":0.61099999999999999},"min":{"1min":0.40699999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.0069999999999997,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.69699999999999995,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":6.8099999999999996,"5min":6.8099999999999996,"15min":6.8099999999999996},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Jul 14 12:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":1.046,"15min":1.046},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.70599999999999996,"15min":0.64200000000000002},"min":{"1min":0.46100000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.90300000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.3579999999999997,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.3899999999999997,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":0.84099999999999997}]},{"osd":4,"last update":"Fri Jul 14 12:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.749,"15min":0.69899999999999995},"min":{"1min":0.47199999999999998,"5min":0.44,"15min":0.44},"max":{"1min":4.0960000000000001,"5min":4.0960000000000001,"15min":4.0960000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.032,"5min":0.77000000000000002,"15min":0.69599999999999995},"min":{"1min":0.48399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":6.9550000000000001,"5min":6.9550000000000001,"15min":6.9550000000000001},"last":0.78800000000000003}]},{"osd":5,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.753,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.363,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.87},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.754},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.085,"5min":4.1769999999999996,"15min":4.1769999999999996},"last":1.01}]},{"osd":6,"last update":"Fri Jul 14 12:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.71199999999999997,"15min":0.70199999999999996},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":6.8739999999999997,"5min":6.8739999999999997,"15min":6.8739999999999997},"last":1.135},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.754,"15min":0.73299999999999998},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.4240000000000004,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1200000000000001,"5min":1.155,"15min":1.155},"last":0.751},{"interface":"front","average":{"1min":0.873,"5min":0.79700000000000004,"15min":0.78400000000000003},"min":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.61799999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.60999999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.3239999999999998,"5min":4.3239999999999998,"15min":4.3239999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.89100000000000001,"15min":0.88900000000000001},"min":{"1min":0.65000000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":1.0629999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:59:00 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.89100000000000001,"15min":0.91300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":7.0350000000000001,"5min":7.0350000000000001,"15min":7.0350000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.004,"5min":0.89500000000000002,"15min":0.91600000000000004},"min":{"1min":0.5,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.2729999999999999}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.55100000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.171,"5min":4.0579999999999998,"15min":4.0579999999999998},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.94599999999999995,"15min":0.92700000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7889999999999999,"5min":6.992,"15min":6.992},"last":1.2190000000000001}]},{"osd":11,"last update":"Fri Jul 14 12:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.90700000000000003,"15min":0.88200000000000001},"min":{"1min":0.623,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.21,"5min":4.21,"15min":4.21},"last":1.25},{"interface":"front","average":{"1min":1.198,"5min":0.94599999999999995,"15min":0.90400000000000003},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":6.9169999999999998,"5min":6.9169999999999998,"15min":6.9169999999999998},"last":1.294}]}]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":1019904,"data_stored":519804,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":0.86499999999999999,"15min":0.89400000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.61899999999999999,"15min":0.59699999999999998},"min":{"1min":0.54900000000000004,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.67800000000000005,"15min":0.65800000000000003},"min":{"1min":0.56100000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92800000000000005,"5min":1.0549999999999999,"15min":1.819},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.53000000000000003,"5min":0.42199999999999999,"15min":0.41699999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":1.841},"last":0.80500000000000005}]},{"osd":3,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.77100000000000002,"15min":0.72299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":6.4779999999999998,"15min":6.4779999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.46200000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.878,"5min":1.629,"15min":1.629},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Jul 14 12:59:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.60299999999999998,"15min":0.50900000000000001},"min":{"1min":0.502,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93799999999999994,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.629,"15min":0.54500000000000004},"min":{"1min":0.58499999999999996,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.78000000000000003,"15min":0.74199999999999999},"min":{"1min":0.69199999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.76900000000000002,"15min":0.73699999999999999},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.69299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77800000000000002}]},{"osd":8,"last update":"Fri Jul 14 12:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0069999999999999,"5min":1.222,"15min":1.222},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.79600000000000004,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.98899999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:58:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":0.93999999999999995,"15min":0.84699999999999998},"min":{"1min":0.73199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":6.5179999999999998,"5min":6.5179999999999998,"15min":6.5179999999999998},"last":1.014},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83499999999999996,"15min":0.81699999999999995},"min":{"1min":0.63300000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.93400000000000005}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.92000000000000004,"15min":0.88600000000000001},"min":{"1min":0.78400000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.044}]},{"osd":11,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":1.056},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.079}]}]},{"osd":3,"up_from":26,"seq":111669149774,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":458793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47199999999999998,"15min":0.42999999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81200000000000006,"5min":1.165,"15min":1.165},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51100000000000001,"15min":0.45900000000000002},"min":{"1min":0.36599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73599999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.67500000000000004},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98699999999999999,"5min":6.867,"15min":6.867},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81100000000000005,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.004,"5min":6.8860000000000001,"15min":6.8860000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.75600000000000001,"15min":0.69199999999999995},"min":{"1min":0.52400000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.747,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.94299999999999995,"5min":6.9020000000000001,"15min":6.9020000000000001},"last":0.84499999999999997}]},{"osd":4,"last update":"Fri Jul 14 12:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80800000000000005,"15min":0.72899999999999998},"min":{"1min":0.48399999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.7490000000000001,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.754,"15min":0.71699999999999997},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.621}]},{"osd":5,"last update":"Fri Jul 14 12:59:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.79500000000000004,"15min":0.78900000000000003},"min":{"1min":0.58499999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.1890000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.73799999999999999},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Jul 14 12:58:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.77000000000000002,"15min":0.68600000000000005},"min":{"1min":0.435,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.4290000000000003,"5min":7.4290000000000003,"15min":7.4290000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.248,"5min":0.80900000000000005,"15min":0.70199999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":12.958,"5min":12.958,"15min":12.958},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:59:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.63600000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.036,"5min":0.85899999999999999,"15min":0.79300000000000004},"min":{"1min":0.69099999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.2670000000000003,"5min":4.2670000000000003,"15min":4.2670000000000003},"last":0.76200000000000001}]},{"osd":8,"last update":"Fri Jul 14 12:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2010000000000001,"5min":1.206,"15min":1.206},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1859999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.80500000000000005}]},{"osd":9,"last update":"Fri Jul 14 12:58:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":7.3700000000000001,"5min":7.3700000000000001,"15min":7.3700000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81999999999999995,"15min":0.82999999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.749}]},{"osd":10,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.89100000000000001,"15min":0.89900000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0649999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.93200000000000005,"15min":0.94199999999999995},"min":{"1min":0.68500000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.1679999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.82499999999999996}]},{"osd":11,"last update":"Fri Jul 14 12:58:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.871}]}]},{"osd":4,"up_from":34,"seq":146028888136,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77600000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:58:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.46400000000000002},"min":{"1min":0.34399999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.65100000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.5,"15min":0.46200000000000002},"min":{"1min":0.40100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79900000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Jul 14 12:58:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.73999999999999999,"15min":0.68700000000000006},"min":{"1min":0.58799999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.099,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71799999999999997,"15min":0.70399999999999996},"min":{"1min":0.57399999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.78800000000000003,"15min":0.69799999999999995},"min":{"1min":0.53300000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":7.0250000000000004,"5min":7.0250000000000004,"15min":7.0250000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.056,"5min":0.74099999999999999,"15min":0.67300000000000004},"min":{"1min":0.496,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:59:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.877},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.73899999999999999,"15min":0.70399999999999996},"min":{"1min":0.58399999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.93000000000000005,"5min":1.002,"15min":1.002},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":0.91600000000000004,"15min":0.81899999999999995},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":9.6229999999999993,"5min":9.6229999999999993,"15min":9.6229999999999993},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.4630000000000001,"5min":0.88900000000000001,"15min":0.79000000000000004},"min":{"1min":0.52800000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":9.6590000000000007,"5min":9.6590000000000007,"15min":9.6590000000000007},"last":0.746}]},{"osd":7,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89600000000000002,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.751,"15min":0.749},"min":{"1min":0.57499999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98899999999999999,"5min":1.129,"15min":1.129},"last":0.69599999999999995}]},{"osd":8,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.875,"15min":0.86499999999999999},"min":{"1min":0.65900000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.143,"5min":1.234,"15min":1.234},"last":0.99099999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:58:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.93799999999999994,"15min":0.89800000000000002},"min":{"1min":0.63100000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.0919999999999996,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.872,"15min":0.85199999999999998},"min":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.82399999999999995}]},{"osd":10,"last update":"Fri Jul 14 12:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.93100000000000005,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1970000000000001,"5min":1.337,"15min":1.337},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82499999999999996,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98299999999999998,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.93500000000000005}]},{"osd":11,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.0189999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724612,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":1028096,"data_stored":1050996,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61699999999999999,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85499999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91600000000000004,"5min":0.997,"15min":0.997},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69799999999999995,"15min":0.63100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.69599999999999995,"15min":0.625},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53000000000000003,"15min":0.503},"min":{"1min":0.38800000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79900000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.54100000000000004,"15min":0.48799999999999999},"min":{"1min":0.41799999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.028,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.501,"5min":0.434,"15min":0.434},"max":{"1min":0.996,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.78100000000000003}]},{"osd":4,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75800000000000001,"15min":0.68000000000000005},"min":{"1min":0.55700000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0269999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.75,"15min":0.70799999999999996},"min":{"1min":0.57099999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1080000000000001,"5min":1.139,"15min":1.139},"last":0.755}]},{"osd":6,"last update":"Fri Jul 14 12:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.749,"15min":0.753},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98199999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76900000000000002,"15min":0.78400000000000003},"min":{"1min":0.50900000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.018,"5min":1.28,"15min":1.28},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Jul 14 12:59:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.69399999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.84799999999999998},"min":{"1min":0.51700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.218,"5min":1.236,"15min":1.236},"last":0.92700000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.88400000000000001}]},{"osd":9,"last update":"Fri Jul 14 12:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.873,"15min":0.871},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1499999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.84899999999999998},"min":{"1min":0.67200000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1379999999999999,"5min":1.286,"15min":1.286},"last":0.96699999999999997}]},{"osd":10,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.86799999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.874,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34486,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59844,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61483,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":61857,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:59:30.273 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-07-14T12:59:30.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T12:59:30.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:29 smithi135 ceph-mon[97338]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2023-07-14T12:59:30.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:29 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1051245130' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:30.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.477+0000 7f16ae7ff700 1 -- 172.21.15.17:0/4126152976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16a8100cf0 msgr2=0x7f16a8101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:30.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.477+0000 7f16ae7ff700 1 --2- 172.21.15.17:0/4126152976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16a8100cf0 0x7f16a8101140 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f169c009990 tx=0x7f169c009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.477+0000 7f16ae7ff700 1 -- 172.21.15.17:0/4126152976 shutdown_connections 2023-07-14T12:59:30.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.478+0000 7f16ae7ff700 1 --2- 172.21.15.17:0/4126152976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16a8101680 0x7f16a8107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.478+0000 7f16ae7ff700 1 --2- 172.21.15.17:0/4126152976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16a80ffb00 0x7f16a80fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.478+0000 7f16ae7ff700 1 --2- 172.21.15.17:0/4126152976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16a8100cf0 0x7f16a8101140 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.478+0000 7f16ae7ff700 1 -- 172.21.15.17:0/4126152976 >> 172.21.15.17:0/4126152976 conn(0x7f16a80fb0e0 msgr2=0x7f16a80fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:30.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.478+0000 7f16ae7ff700 1 -- 172.21.15.17:0/4126152976 shutdown_connections 2023-07-14T12:59:30.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.478+0000 7f16ae7ff700 1 -- 172.21.15.17:0/4126152976 wait complete. 2023-07-14T12:59:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.479+0000 7f16ae7ff700 1 Processor -- start 2023-07-14T12:59:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.479+0000 7f16ae7ff700 1 -- start start 2023-07-14T12:59:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.480+0000 7f16ae7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16a80ffb00 0x7f16a8197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.480+0000 7f16ae7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16a8100cf0 0x7f16a8197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.480+0000 7f16ae7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16a8101680 0x7f16a819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:30.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.480+0000 7f16ae7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a819f4b0 con 0x7f16a8101680 2023-07-14T12:59:30.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.480+0000 7f16ae7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a819f5f0 con 0x7f16a8100cf0 2023-07-14T12:59:30.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.480+0000 7f16ae7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a819f780 con 0x7f16a80ffb00 2023-07-14T12:59:30.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.480+0000 7f16acd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16a8101680 0x7f16a819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:30.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.480+0000 7f16acd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16a8101680 0x7f16a819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51892/0 (socket says 172.21.15.17:51892) 2023-07-14T12:59:30.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.480+0000 7f16acd9c700 1 -- 172.21.15.17:0/3365617875 learned_addr learned my addr 172.21.15.17:0/3365617875 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:30.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.480+0000 7f16a7fff700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16a80ffb00 0x7f16a8197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:30.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.480+0000 7f16a77fe700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16a8100cf0 0x7f16a8197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:30.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.481+0000 7f16acd9c700 1 -- 172.21.15.17:0/3365617875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16a80ffb00 msgr2=0x7f16a8197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:30.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.481+0000 7f16acd9c700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16a80ffb00 0x7f16a8197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.481+0000 7f16acd9c700 1 -- 172.21.15.17:0/3365617875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16a8100cf0 msgr2=0x7f16a8197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:30.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.481+0000 7f16acd9c700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16a8100cf0 0x7f16a8197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.481+0000 7f16acd9c700 1 -- 172.21.15.17:0/3365617875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c0095f0 con 0x7f16a8101680 2023-07-14T12:59:30.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.481+0000 7f16acd9c700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16a8101680 0x7f16a819eee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f16a0007ee0 tx=0x7f16a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:30.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.481+0000 7f16a57fa700 1 -- 172.21.15.17:0/3365617875 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a0017070 con 0x7f16a8101680 2023-07-14T12:59:30.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.481+0000 7f16a57fa700 1 -- 172.21.15.17:0/3365617875 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16a000f040 con 0x7f16a8101680 2023-07-14T12:59:30.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.481+0000 7f16a57fa700 1 -- 172.21.15.17:0/3365617875 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a0005570 con 0x7f16a8101680 2023-07-14T12:59:30.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.481+0000 7f16ae7ff700 1 -- 172.21.15.17:0/3365617875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a819fa60 con 0x7f16a8101680 2023-07-14T12:59:30.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.481+0000 7f16ae7ff700 1 -- 172.21.15.17:0/3365617875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a819ff20 con 0x7f16a8101680 2023-07-14T12:59:30.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.482+0000 7f16ae7ff700 1 -- 172.21.15.17:0/3365617875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a810b1d0 con 0x7f16a8101680 2023-07-14T12:59:30.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.484+0000 7f16a57fa700 1 -- 172.21.15.17:0/3365617875 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f16a000db20 con 0x7f16a8101680 2023-07-14T12:59:30.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.486+0000 7f16a57fa700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f16900a11a0 0x7f16900a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:30.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.486+0000 7f16a57fa700 1 -- 172.21.15.17:0/3365617875 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f16a00cc070 con 0x7f16a8101680 2023-07-14T12:59:30.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.486+0000 7f16a7fff700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f16900a11a0 0x7f16900a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:30.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.487+0000 7f16a7fff700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f16900a11a0 0x7f16900a3650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f16a8100b50 tx=0x7f169800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:30.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.490+0000 7f16a57fa700 1 -- 172.21.15.17:0/3365617875 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f16a00fe790 con 0x7f16a8101680 2023-07-14T12:59:30.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.696+0000 7f16ae7ff700 1 -- 172.21.15.17:0/3365617875 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16a8107630 con 0x7f16900a11a0 2023-07-14T12:59:30.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.706+0000 7f16a57fa700 1 -- 172.21.15.17:0/3365617875 <== mgr.14150 v2:172.21.15.17:6800/2034486077 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343950 (secure 0 0 0) 0x7f16a8107630 con 0x7f16900a11a0 2023-07-14T12:59:30.743 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 -- 172.21.15.17:0/3365617875 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f16900a11a0 msgr2=0x7f16900a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:30.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f16900a11a0 0x7f16900a3650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f16a8100b50 tx=0x7f169800b410 comp rx=0 tx=0).stop 2023-07-14T12:59:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 -- 172.21.15.17:0/3365617875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16a8101680 msgr2=0x7f16a819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16a8101680 0x7f16a819eee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f16a0007ee0 tx=0x7f16a000d3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 -- 172.21.15.17:0/3365617875 shutdown_connections 2023-07-14T12:59:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f16900a11a0 0x7f16900a3650 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16a8101680 0x7f16a819eee0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16a80ffb00 0x7f16a8197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 --2- 172.21.15.17:0/3365617875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16a8100cf0 0x7f16a8197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 -- 172.21.15.17:0/3365617875 >> 172.21.15.17:0/3365617875 conn(0x7f16a80fb0e0 msgr2=0x7f16a80fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 -- 172.21.15.17:0/3365617875 shutdown_connections 2023-07-14T12:59:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.711+0000 7f16ae7ff700 1 -- 172.21.15.17:0/3365617875 wait complete. 2023-07-14T12:59:30.747 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2023-07-14T12:59:30.760 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2023-07-14T12:59:28.864082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654938,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":766,"num_read_kb":503,"num_write":344,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1180882,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":780,"ondisk_log_size":780,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335060,"kb_used_data":11636,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124606764,"statfs":{"total":1151940427776,"available":1151597326336,"internally_reserved":0,"allocated":11915264,"data_stored":7466734,"data_compressed":113190,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1449,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003150"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.881025+0000","last_change":"2023-07-14T12:57:40.168203+0000","last_active":"2023-07-14T12:59:06.881025+0000","last_peered":"2023-07-14T12:59:06.881025+0000","last_clean":"2023-07-14T12:59:06.881025+0000","last_became_active":"2023-07-14T12:57:40.164682+0000","last_became_peered":"2023-07-14T12:57:40.164682+0000","last_unstale":"2023-07-14T12:59:06.881025+0000","last_undegraded":"2023-07-14T12:59:06.881025+0000","last_fullsized":"2023-07-14T12:59:06.881025+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:18:39.005726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.872934+0000","last_change":"2023-07-14T12:57:40.168194+0000","last_active":"2023-07-14T12:59:06.872934+0000","last_peered":"2023-07-14T12:59:06.872934+0000","last_clean":"2023-07-14T12:59:06.872934+0000","last_became_active":"2023-07-14T12:57:40.167825+0000","last_became_peered":"2023-07-14T12:57:40.167825+0000","last_unstale":"2023-07-14T12:59:06.872934+0000","last_undegraded":"2023-07-14T12:59:06.872934+0000","last_fullsized":"2023-07-14T12:59:06.872934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:23:35.037851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.879101+0000","last_change":"2023-07-14T12:57:40.162824+0000","last_active":"2023-07-14T12:59:06.879101+0000","last_peered":"2023-07-14T12:59:06.879101+0000","last_clean":"2023-07-14T12:59:06.879101+0000","last_became_active":"2023-07-14T12:57:40.162526+0000","last_became_peered":"2023-07-14T12:57:40.162526+0000","last_unstale":"2023-07-14T12:59:06.879101+0000","last_undegraded":"2023-07-14T12:59:06.879101+0000","last_fullsized":"2023-07-14T12:59:06.879101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:01:27.137266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.859900+0000","last_change":"2023-07-14T12:57:40.160772+0000","last_active":"2023-07-14T12:59:06.859900+0000","last_peered":"2023-07-14T12:59:06.859900+0000","last_clean":"2023-07-14T12:59:06.859900+0000","last_became_active":"2023-07-14T12:57:40.160315+0000","last_became_peered":"2023-07-14T12:57:40.160315+0000","last_unstale":"2023-07-14T12:59:06.859900+0000","last_undegraded":"2023-07-14T12:59:06.859900+0000","last_fullsized":"2023-07-14T12:59:06.859900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:47:48.047786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869216+0000","last_change":"2023-07-14T12:57:40.160868+0000","last_active":"2023-07-14T12:59:06.869216+0000","last_peered":"2023-07-14T12:59:06.869216+0000","last_clean":"2023-07-14T12:59:06.869216+0000","last_became_active":"2023-07-14T12:57:40.160558+0000","last_became_peered":"2023-07-14T12:57:40.160558+0000","last_unstale":"2023-07-14T12:59:06.869216+0000","last_undegraded":"2023-07-14T12:59:06.869216+0000","last_fullsized":"2023-07-14T12:59:06.869216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:21:57.315978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.872638+0000","last_change":"2023-07-14T12:57:40.166305+0000","last_active":"2023-07-14T12:59:06.872638+0000","last_peered":"2023-07-14T12:59:06.872638+0000","last_clean":"2023-07-14T12:59:06.872638+0000","last_became_active":"2023-07-14T12:57:40.166012+0000","last_became_peered":"2023-07-14T12:57:40.166012+0000","last_unstale":"2023-07-14T12:59:06.872638+0000","last_undegraded":"2023-07-14T12:59:06.872638+0000","last_fullsized":"2023-07-14T12:59:06.872638+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:03:06.167704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.855384+0000","last_change":"2023-07-14T12:57:40.163312+0000","last_active":"2023-07-14T12:59:06.855384+0000","last_peered":"2023-07-14T12:59:06.855384+0000","last_clean":"2023-07-14T12:59:06.855384+0000","last_became_active":"2023-07-14T12:57:40.163030+0000","last_became_peered":"2023-07-14T12:57:40.163030+0000","last_unstale":"2023-07-14T12:59:06.855384+0000","last_undegraded":"2023-07-14T12:59:06.855384+0000","last_fullsized":"2023-07-14T12:59:06.855384+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:45:41.303341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869384+0000","last_change":"2023-07-14T12:58:08.115121+0000","last_active":"2023-07-14T12:59:06.869384+0000","last_peered":"2023-07-14T12:59:06.869384+0000","last_clean":"2023-07-14T12:59:06.869384+0000","last_became_active":"2023-07-14T12:58:08.114736+0000","last_became_peered":"2023-07-14T12:58:08.114736+0000","last_unstale":"2023-07-14T12:59:06.869384+0000","last_undegraded":"2023-07-14T12:59:06.869384+0000","last_fullsized":"2023-07-14T12:59:06.869384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:30:27.815140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.880702+0000","last_change":"2023-07-14T12:57:40.170263+0000","last_active":"2023-07-14T12:59:06.880702+0000","last_peered":"2023-07-14T12:59:06.880702+0000","last_clean":"2023-07-14T12:59:06.880702+0000","last_became_active":"2023-07-14T12:57:40.169952+0000","last_became_peered":"2023-07-14T12:57:40.169952+0000","last_unstale":"2023-07-14T12:59:06.880702+0000","last_undegraded":"2023-07-14T12:59:06.880702+0000","last_fullsized":"2023-07-14T12:59:06.880702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:07:08.714595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866126+0000","last_change":"2023-07-14T12:57:40.165359+0000","last_active":"2023-07-14T12:59:06.866126+0000","last_peered":"2023-07-14T12:59:06.866126+0000","last_clean":"2023-07-14T12:59:06.866126+0000","last_became_active":"2023-07-14T12:57:40.164918+0000","last_became_peered":"2023-07-14T12:57:40.164918+0000","last_unstale":"2023-07-14T12:59:06.866126+0000","last_undegraded":"2023-07-14T12:59:06.866126+0000","last_fullsized":"2023-07-14T12:59:06.866126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:57:54.633792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.877061+0000","last_change":"2023-07-14T12:57:40.160524+0000","last_active":"2023-07-14T12:59:06.877061+0000","last_peered":"2023-07-14T12:59:06.877061+0000","last_clean":"2023-07-14T12:59:06.877061+0000","last_became_active":"2023-07-14T12:57:40.160215+0000","last_became_peered":"2023-07-14T12:57:40.160215+0000","last_unstale":"2023-07-14T12:59:06.877061+0000","last_undegraded":"2023-07-14T12:59:06.877061+0000","last_fullsized":"2023-07-14T12:59:06.877061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:39:21.213962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870167+0000","last_change":"2023-07-14T12:58:07.964366+0000","last_active":"2023-07-14T12:59:06.870167+0000","last_peered":"2023-07-14T12:59:06.870167+0000","last_clean":"2023-07-14T12:59:06.870167+0000","last_became_active":"2023-07-14T12:58:07.963981+0000","last_became_peered":"2023-07-14T12:58:07.963981+0000","last_unstale":"2023-07-14T12:59:06.870167+0000","last_undegraded":"2023-07-14T12:59:06.870167+0000","last_fullsized":"2023-07-14T12:59:06.870167+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:28:52.971393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870190+0000","last_change":"2023-07-14T12:57:40.162166+0000","last_active":"2023-07-14T12:59:06.870190+0000","last_peered":"2023-07-14T12:59:06.870190+0000","last_clean":"2023-07-14T12:59:06.870190+0000","last_became_active":"2023-07-14T12:57:40.161750+0000","last_became_peered":"2023-07-14T12:57:40.161750+0000","last_unstale":"2023-07-14T12:59:06.870190+0000","last_undegraded":"2023-07-14T12:59:06.870190+0000","last_fullsized":"2023-07-14T12:59:06.870190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:19:28.054997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.871810+0000","last_change":"2023-07-14T12:57:40.160556+0000","last_active":"2023-07-14T12:59:06.871810+0000","last_peered":"2023-07-14T12:59:06.871810+0000","last_clean":"2023-07-14T12:59:06.871810+0000","last_became_active":"2023-07-14T12:57:40.159974+0000","last_became_peered":"2023-07-14T12:57:40.159974+0000","last_unstale":"2023-07-14T12:59:06.871810+0000","last_undegraded":"2023-07-14T12:59:06.871810+0000","last_fullsized":"2023-07-14T12:59:06.871810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:35:12.700407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870639+0000","last_change":"2023-07-14T12:57:40.169116+0000","last_active":"2023-07-14T12:59:06.870639+0000","last_peered":"2023-07-14T12:59:06.870639+0000","last_clean":"2023-07-14T12:59:06.870639+0000","last_became_active":"2023-07-14T12:57:40.168714+0000","last_became_peered":"2023-07-14T12:57:40.168714+0000","last_unstale":"2023-07-14T12:59:06.870639+0000","last_undegraded":"2023-07-14T12:59:06.870639+0000","last_fullsized":"2023-07-14T12:59:06.870639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:17:06.970124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.880546+0000","last_change":"2023-07-14T12:57:40.162621+0000","last_active":"2023-07-14T12:59:06.880546+0000","last_peered":"2023-07-14T12:59:06.880546+0000","last_clean":"2023-07-14T12:59:06.880546+0000","last_became_active":"2023-07-14T12:57:40.162329+0000","last_became_peered":"2023-07-14T12:57:40.162329+0000","last_unstale":"2023-07-14T12:59:06.880546+0000","last_undegraded":"2023-07-14T12:59:06.880546+0000","last_fullsized":"2023-07-14T12:59:06.880546+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:16:19.671402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.881150+0000","last_change":"2023-07-14T12:57:40.172697+0000","last_active":"2023-07-14T12:59:06.881150+0000","last_peered":"2023-07-14T12:59:06.881150+0000","last_clean":"2023-07-14T12:59:06.881150+0000","last_became_active":"2023-07-14T12:57:40.172366+0000","last_became_peered":"2023-07-14T12:57:40.172366+0000","last_unstale":"2023-07-14T12:59:06.881150+0000","last_undegraded":"2023-07-14T12:59:06.881150+0000","last_fullsized":"2023-07-14T12:59:06.881150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:48:57.950996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.877348+0000","last_change":"2023-07-14T12:57:40.166669+0000","last_active":"2023-07-14T12:59:06.877348+0000","last_peered":"2023-07-14T12:59:06.877348+0000","last_clean":"2023-07-14T12:59:06.877348+0000","last_became_active":"2023-07-14T12:57:40.166367+0000","last_became_peered":"2023-07-14T12:57:40.166367+0000","last_unstale":"2023-07-14T12:59:06.877348+0000","last_undegraded":"2023-07-14T12:59:06.877348+0000","last_fullsized":"2023-07-14T12:59:06.877348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:32:55.001814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869373+0000","last_change":"2023-07-14T12:57:40.159133+0000","last_active":"2023-07-14T12:59:06.869373+0000","last_peered":"2023-07-14T12:59:06.869373+0000","last_clean":"2023-07-14T12:59:06.869373+0000","last_became_active":"2023-07-14T12:57:40.158819+0000","last_became_peered":"2023-07-14T12:57:40.158819+0000","last_unstale":"2023-07-14T12:59:06.869373+0000","last_undegraded":"2023-07-14T12:59:06.869373+0000","last_fullsized":"2023-07-14T12:59:06.869373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:34.782295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959654+0000","last_change":"2023-07-14T12:57:39.144919+0000","last_active":"2023-07-14T12:58:07.959654+0000","last_peered":"2023-07-14T12:58:07.959654+0000","last_clean":"2023-07-14T12:58:07.959654+0000","last_became_active":"2023-07-14T12:57:39.144604+0000","last_became_peered":"2023-07-14T12:57:39.144604+0000","last_unstale":"2023-07-14T12:58:07.959654+0000","last_undegraded":"2023-07-14T12:58:07.959654+0000","last_fullsized":"2023-07-14T12:58:07.959654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:32:41.249364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866853+0000","last_change":"2023-07-14T12:57:40.165754+0000","last_active":"2023-07-14T12:59:06.866853+0000","last_peered":"2023-07-14T12:59:06.866853+0000","last_clean":"2023-07-14T12:59:06.866853+0000","last_became_active":"2023-07-14T12:57:40.165416+0000","last_became_peered":"2023-07-14T12:57:40.165416+0000","last_unstale":"2023-07-14T12:59:06.866853+0000","last_undegraded":"2023-07-14T12:59:06.866853+0000","last_fullsized":"2023-07-14T12:59:06.866853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:57:44.533325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965435+0000","last_change":"2023-07-14T12:57:39.153977+0000","last_active":"2023-07-14T12:58:07.965435+0000","last_peered":"2023-07-14T12:58:07.965435+0000","last_clean":"2023-07-14T12:58:07.965435+0000","last_became_active":"2023-07-14T12:57:39.153675+0000","last_became_peered":"2023-07-14T12:57:39.153675+0000","last_unstale":"2023-07-14T12:58:07.965435+0000","last_undegraded":"2023-07-14T12:58:07.965435+0000","last_fullsized":"2023-07-14T12:58:07.965435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:38:56.670099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.879198+0000","last_change":"2023-07-14T12:57:40.157076+0000","last_active":"2023-07-14T12:59:06.879198+0000","last_peered":"2023-07-14T12:59:06.879198+0000","last_clean":"2023-07-14T12:59:06.879198+0000","last_became_active":"2023-07-14T12:57:40.156652+0000","last_became_peered":"2023-07-14T12:57:40.156652+0000","last_unstale":"2023-07-14T12:59:06.879198+0000","last_undegraded":"2023-07-14T12:59:06.879198+0000","last_fullsized":"2023-07-14T12:59:06.879198+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:07:51.608575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963702+0000","last_change":"2023-07-14T12:57:39.145123+0000","last_active":"2023-07-14T12:58:07.963702+0000","last_peered":"2023-07-14T12:58:07.963702+0000","last_clean":"2023-07-14T12:58:07.963702+0000","last_became_active":"2023-07-14T12:57:39.144768+0000","last_became_peered":"2023-07-14T12:57:39.144768+0000","last_unstale":"2023-07-14T12:58:07.963702+0000","last_undegraded":"2023-07-14T12:58:07.963702+0000","last_fullsized":"2023-07-14T12:58:07.963702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:13:21.627658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878293+0000","last_change":"2023-07-14T12:57:40.167084+0000","last_active":"2023-07-14T12:59:06.878293+0000","last_peered":"2023-07-14T12:59:06.878293+0000","last_clean":"2023-07-14T12:59:06.878293+0000","last_became_active":"2023-07-14T12:57:40.166654+0000","last_became_peered":"2023-07-14T12:57:40.166654+0000","last_unstale":"2023-07-14T12:59:06.878293+0000","last_undegraded":"2023-07-14T12:59:06.878293+0000","last_fullsized":"2023-07-14T12:59:06.878293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:01:54.429150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963132+0000","last_change":"2023-07-14T12:57:39.137432+0000","last_active":"2023-07-14T12:58:07.963132+0000","last_peered":"2023-07-14T12:58:07.963132+0000","last_clean":"2023-07-14T12:58:07.963132+0000","last_became_active":"2023-07-14T12:57:39.137124+0000","last_became_peered":"2023-07-14T12:57:39.137124+0000","last_unstale":"2023-07-14T12:58:07.963132+0000","last_undegraded":"2023-07-14T12:58:07.963132+0000","last_fullsized":"2023-07-14T12:58:07.963132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:09:50.638289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.876649+0000","last_change":"2023-07-14T12:57:40.167477+0000","last_active":"2023-07-14T12:59:06.876649+0000","last_peered":"2023-07-14T12:59:06.876649+0000","last_clean":"2023-07-14T12:59:06.876649+0000","last_became_active":"2023-07-14T12:57:40.167177+0000","last_became_peered":"2023-07-14T12:57:40.167177+0000","last_unstale":"2023-07-14T12:59:06.876649+0000","last_undegraded":"2023-07-14T12:59:06.876649+0000","last_fullsized":"2023-07-14T12:59:06.876649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:39:35.566121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":128,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:24.398014+0000","last_change":"2023-07-14T12:57:39.146569+0000","last_active":"2023-07-14T12:59:24.398014+0000","last_peered":"2023-07-14T12:59:24.398014+0000","last_clean":"2023-07-14T12:59:24.398014+0000","last_became_active":"2023-07-14T12:57:39.146251+0000","last_became_peered":"2023-07-14T12:57:39.146251+0000","last_unstale":"2023-07-14T12:59:24.398014+0000","last_undegraded":"2023-07-14T12:59:24.398014+0000","last_fullsized":"2023-07-14T12:59:24.398014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:33.372913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.853293+0000","last_change":"2023-07-14T12:57:40.160511+0000","last_active":"2023-07-14T12:59:06.853293+0000","last_peered":"2023-07-14T12:59:06.853293+0000","last_clean":"2023-07-14T12:59:06.853293+0000","last_became_active":"2023-07-14T12:57:40.160152+0000","last_became_peered":"2023-07-14T12:57:40.160152+0000","last_unstale":"2023-07-14T12:59:06.853293+0000","last_undegraded":"2023-07-14T12:59:06.853293+0000","last_fullsized":"2023-07-14T12:59:06.853293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:05.198459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.119603+0000","last_change":"2023-07-14T12:58:08.119603+0000","last_active":"2023-07-14T12:58:08.119603+0000","last_peered":"2023-07-14T12:58:08.119603+0000","last_clean":"2023-07-14T12:58:08.119603+0000","last_became_active":"2023-07-14T12:58:08.115814+0000","last_became_peered":"2023-07-14T12:58:08.115814+0000","last_unstale":"2023-07-14T12:58:08.119603+0000","last_undegraded":"2023-07-14T12:58:08.119603+0000","last_fullsized":"2023-07-14T12:58:08.119603+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:08:49.130958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867830+0000","last_change":"2023-07-14T12:58:07.967463+0000","last_active":"2023-07-14T12:59:06.867830+0000","last_peered":"2023-07-14T12:59:06.867830+0000","last_clean":"2023-07-14T12:59:06.867830+0000","last_became_active":"2023-07-14T12:58:07.967136+0000","last_became_peered":"2023-07-14T12:58:07.967136+0000","last_unstale":"2023-07-14T12:59:06.867830+0000","last_undegraded":"2023-07-14T12:59:06.867830+0000","last_fullsized":"2023-07-14T12:59:06.867830+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:54:53.152331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961797+0000","last_change":"2023-07-14T12:57:39.145352+0000","last_active":"2023-07-14T12:58:07.961797+0000","last_peered":"2023-07-14T12:58:07.961797+0000","last_clean":"2023-07-14T12:58:07.961797+0000","last_became_active":"2023-07-14T12:57:39.145018+0000","last_became_peered":"2023-07-14T12:57:39.145018+0000","last_unstale":"2023-07-14T12:58:07.961797+0000","last_undegraded":"2023-07-14T12:58:07.961797+0000","last_fullsized":"2023-07-14T12:58:07.961797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:46:13.836721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.865933+0000","last_change":"2023-07-14T12:57:40.173457+0000","last_active":"2023-07-14T12:59:06.865933+0000","last_peered":"2023-07-14T12:59:06.865933+0000","last_clean":"2023-07-14T12:59:06.865933+0000","last_became_active":"2023-07-14T12:57:40.173080+0000","last_became_peered":"2023-07-14T12:57:40.173080+0000","last_unstale":"2023-07-14T12:59:06.865933+0000","last_undegraded":"2023-07-14T12:59:06.865933+0000","last_fullsized":"2023-07-14T12:59:06.865933+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:18.222106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113467+0000","last_change":"2023-07-14T12:57:39.145383+0000","last_active":"2023-07-14T12:58:08.113467+0000","last_peered":"2023-07-14T12:58:08.113467+0000","last_clean":"2023-07-14T12:58:08.113467+0000","last_became_active":"2023-07-14T12:57:39.145088+0000","last_became_peered":"2023-07-14T12:57:39.145088+0000","last_unstale":"2023-07-14T12:58:08.113467+0000","last_undegraded":"2023-07-14T12:58:08.113467+0000","last_fullsized":"2023-07-14T12:58:08.113467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:23:32.979153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868706+0000","last_change":"2023-07-14T12:57:40.162123+0000","last_active":"2023-07-14T12:59:06.868706+0000","last_peered":"2023-07-14T12:59:06.868706+0000","last_clean":"2023-07-14T12:59:06.868706+0000","last_became_active":"2023-07-14T12:57:40.160789+0000","last_became_peered":"2023-07-14T12:57:40.160789+0000","last_unstale":"2023-07-14T12:59:06.868706+0000","last_undegraded":"2023-07-14T12:59:06.868706+0000","last_fullsized":"2023-07-14T12:59:06.868706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:03:24.181158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:23.188752+0000","last_change":"2023-07-14T12:57:39.139524+0000","last_active":"2023-07-14T12:59:23.188752+0000","last_peered":"2023-07-14T12:59:23.188752+0000","last_clean":"2023-07-14T12:59:23.188752+0000","last_became_active":"2023-07-14T12:57:39.139176+0000","last_became_peered":"2023-07-14T12:57:39.139176+0000","last_unstale":"2023-07-14T12:59:23.188752+0000","last_undegraded":"2023-07-14T12:59:23.188752+0000","last_fullsized":"2023-07-14T12:59:23.188752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:27.070260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.880493+0000","last_change":"2023-07-14T12:57:40.168729+0000","last_active":"2023-07-14T12:59:06.880493+0000","last_peered":"2023-07-14T12:59:06.880493+0000","last_clean":"2023-07-14T12:59:06.880493+0000","last_became_active":"2023-07-14T12:57:40.168408+0000","last_became_peered":"2023-07-14T12:57:40.168408+0000","last_unstale":"2023-07-14T12:59:06.880493+0000","last_undegraded":"2023-07-14T12:59:06.880493+0000","last_fullsized":"2023-07-14T12:59:06.880493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:58:20.491077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958510+0000","last_change":"2023-07-14T12:57:39.140744+0000","last_active":"2023-07-14T12:58:07.958510+0000","last_peered":"2023-07-14T12:58:07.958510+0000","last_clean":"2023-07-14T12:58:07.958510+0000","last_became_active":"2023-07-14T12:57:39.140391+0000","last_became_peered":"2023-07-14T12:57:39.140391+0000","last_unstale":"2023-07-14T12:58:07.958510+0000","last_undegraded":"2023-07-14T12:58:07.958510+0000","last_fullsized":"2023-07-14T12:58:07.958510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:50:01.023100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.873963+0000","last_change":"2023-07-14T12:57:40.165552+0000","last_active":"2023-07-14T12:59:06.873963+0000","last_peered":"2023-07-14T12:59:06.873963+0000","last_clean":"2023-07-14T12:59:06.873963+0000","last_became_active":"2023-07-14T12:57:40.165214+0000","last_became_peered":"2023-07-14T12:57:40.165214+0000","last_unstale":"2023-07-14T12:59:06.873963+0000","last_undegraded":"2023-07-14T12:59:06.873963+0000","last_fullsized":"2023-07-14T12:59:06.873963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:15.528292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113790+0000","last_change":"2023-07-14T12:57:39.150311+0000","last_active":"2023-07-14T12:58:08.113790+0000","last_peered":"2023-07-14T12:58:08.113790+0000","last_clean":"2023-07-14T12:58:08.113790+0000","last_became_active":"2023-07-14T12:57:39.149885+0000","last_became_peered":"2023-07-14T12:57:39.149885+0000","last_unstale":"2023-07-14T12:58:08.113790+0000","last_undegraded":"2023-07-14T12:58:08.113790+0000","last_fullsized":"2023-07-14T12:58:08.113790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:56.722568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878693+0000","last_change":"2023-07-14T12:57:40.161845+0000","last_active":"2023-07-14T12:59:06.878693+0000","last_peered":"2023-07-14T12:59:06.878693+0000","last_clean":"2023-07-14T12:59:06.878693+0000","last_became_active":"2023-07-14T12:57:40.160895+0000","last_became_peered":"2023-07-14T12:57:40.160895+0000","last_unstale":"2023-07-14T12:59:06.878693+0000","last_undegraded":"2023-07-14T12:59:06.878693+0000","last_fullsized":"2023-07-14T12:59:06.878693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:20:16.547464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'32","reported_seq":258,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:23.405124+0000","last_change":"2023-07-14T12:57:39.142584+0000","last_active":"2023-07-14T12:59:23.405124+0000","last_peered":"2023-07-14T12:59:23.405124+0000","last_clean":"2023-07-14T12:59:23.405124+0000","last_became_active":"2023-07-14T12:57:39.142239+0000","last_became_peered":"2023-07-14T12:57:39.142239+0000","last_unstale":"2023-07-14T12:59:23.405124+0000","last_undegraded":"2023-07-14T12:59:23.405124+0000","last_fullsized":"2023-07-14T12:59:23.405124+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:06:56.022427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59844,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":162,"num_write":33,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.861434+0000","last_change":"2023-07-14T12:57:40.170013+0000","last_active":"2023-07-14T12:59:06.861434+0000","last_peered":"2023-07-14T12:59:06.861434+0000","last_clean":"2023-07-14T12:59:06.861434+0000","last_became_active":"2023-07-14T12:57:40.169177+0000","last_became_peered":"2023-07-14T12:57:40.169177+0000","last_unstale":"2023-07-14T12:59:06.861434+0000","last_undegraded":"2023-07-14T12:59:06.861434+0000","last_fullsized":"2023-07-14T12:59:06.861434+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:10:42.957456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.978704+0000","last_change":"2023-07-14T12:58:07.978239+0000","last_active":"2023-07-14T12:58:07.978704+0000","last_peered":"2023-07-14T12:58:07.978704+0000","last_clean":"2023-07-14T12:58:07.978704+0000","last_became_active":"2023-07-14T12:58:07.967195+0000","last_became_peered":"2023-07-14T12:58:07.967195+0000","last_unstale":"2023-07-14T12:58:07.978704+0000","last_undegraded":"2023-07-14T12:58:07.978704+0000","last_fullsized":"2023-07-14T12:58:07.978704+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:14:05.124879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.865208+0000","last_change":"2023-07-14T12:57:40.158098+0000","last_active":"2023-07-14T12:59:06.865208+0000","last_peered":"2023-07-14T12:59:06.865208+0000","last_clean":"2023-07-14T12:59:06.865208+0000","last_became_active":"2023-07-14T12:57:40.157736+0000","last_became_peered":"2023-07-14T12:57:40.157736+0000","last_unstale":"2023-07-14T12:59:06.865208+0000","last_undegraded":"2023-07-14T12:59:06.865208+0000","last_fullsized":"2023-07-14T12:59:06.865208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:04:59.371098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113762+0000","last_change":"2023-07-14T12:57:39.135784+0000","last_active":"2023-07-14T12:58:08.113762+0000","last_peered":"2023-07-14T12:58:08.113762+0000","last_clean":"2023-07-14T12:58:08.113762+0000","last_became_active":"2023-07-14T12:57:39.135480+0000","last_became_peered":"2023-07-14T12:57:39.135480+0000","last_unstale":"2023-07-14T12:58:08.113762+0000","last_undegraded":"2023-07-14T12:58:08.113762+0000","last_fullsized":"2023-07-14T12:58:08.113762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:33:37.574910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870560+0000","last_change":"2023-07-14T12:57:40.162548+0000","last_active":"2023-07-14T12:59:06.870560+0000","last_peered":"2023-07-14T12:59:06.870560+0000","last_clean":"2023-07-14T12:59:06.870560+0000","last_became_active":"2023-07-14T12:57:40.162191+0000","last_became_peered":"2023-07-14T12:57:40.162191+0000","last_unstale":"2023-07-14T12:59:06.870560+0000","last_undegraded":"2023-07-14T12:59:06.870560+0000","last_fullsized":"2023-07-14T12:59:06.870560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:13:04.971179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'4","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:23.416335+0000","last_change":"2023-07-14T12:57:39.145533+0000","last_active":"2023-07-14T12:59:23.416335+0000","last_peered":"2023-07-14T12:59:23.416335+0000","last_clean":"2023-07-14T12:59:23.416335+0000","last_became_active":"2023-07-14T12:57:39.145201+0000","last_became_peered":"2023-07-14T12:57:39.145201+0000","last_unstale":"2023-07-14T12:59:23.416335+0000","last_undegraded":"2023-07-14T12:59:23.416335+0000","last_fullsized":"2023-07-14T12:59:23.416335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T13:56:46.324639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1023,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.857816+0000","last_change":"2023-07-14T12:57:40.160047+0000","last_active":"2023-07-14T12:59:06.857816+0000","last_peered":"2023-07-14T12:59:06.857816+0000","last_clean":"2023-07-14T12:59:06.857816+0000","last_became_active":"2023-07-14T12:57:40.159751+0000","last_became_peered":"2023-07-14T12:57:40.159751+0000","last_unstale":"2023-07-14T12:59:06.857816+0000","last_undegraded":"2023-07-14T12:59:06.857816+0000","last_fullsized":"2023-07-14T12:59:06.857816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:38:16.874363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.130840+0000","last_change":"2023-07-14T12:58:08.130840+0000","last_active":"2023-07-14T12:58:08.130840+0000","last_peered":"2023-07-14T12:58:08.130840+0000","last_clean":"2023-07-14T12:58:08.130840+0000","last_became_active":"2023-07-14T12:58:08.116583+0000","last_became_peered":"2023-07-14T12:58:08.116583+0000","last_unstale":"2023-07-14T12:58:08.130840+0000","last_undegraded":"2023-07-14T12:58:08.130840+0000","last_fullsized":"2023-07-14T12:58:08.130840+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:07:34.361949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.875167+0000","last_change":"2023-07-14T12:57:40.173741+0000","last_active":"2023-07-14T12:59:06.875167+0000","last_peered":"2023-07-14T12:59:06.875167+0000","last_clean":"2023-07-14T12:59:06.875167+0000","last_became_active":"2023-07-14T12:57:40.173427+0000","last_became_peered":"2023-07-14T12:57:40.173427+0000","last_unstale":"2023-07-14T12:59:06.875167+0000","last_undegraded":"2023-07-14T12:59:06.875167+0000","last_fullsized":"2023-07-14T12:59:06.875167+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:41:16.366763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963223+0000","last_change":"2023-07-14T12:57:39.140979+0000","last_active":"2023-07-14T12:58:07.963223+0000","last_peered":"2023-07-14T12:58:07.963223+0000","last_clean":"2023-07-14T12:58:07.963223+0000","last_became_active":"2023-07-14T12:57:39.140692+0000","last_became_peered":"2023-07-14T12:57:39.140692+0000","last_unstale":"2023-07-14T12:58:07.963223+0000","last_undegraded":"2023-07-14T12:58:07.963223+0000","last_fullsized":"2023-07-14T12:58:07.963223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:01:09.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867229+0000","last_change":"2023-07-14T12:57:40.164258+0000","last_active":"2023-07-14T12:59:06.867229+0000","last_peered":"2023-07-14T12:59:06.867229+0000","last_clean":"2023-07-14T12:59:06.867229+0000","last_became_active":"2023-07-14T12:57:40.163911+0000","last_became_peered":"2023-07-14T12:57:40.163911+0000","last_unstale":"2023-07-14T12:59:06.867229+0000","last_undegraded":"2023-07-14T12:59:06.867229+0000","last_fullsized":"2023-07-14T12:59:06.867229+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:18:45.474358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.959321+0000","last_change":"2023-07-14T12:57:39.151301+0000","last_active":"2023-07-14T12:58:07.959321+0000","last_peered":"2023-07-14T12:58:07.959321+0000","last_clean":"2023-07-14T12:58:07.959321+0000","last_became_active":"2023-07-14T12:57:39.150948+0000","last_became_peered":"2023-07-14T12:57:39.150948+0000","last_unstale":"2023-07-14T12:58:07.959321+0000","last_undegraded":"2023-07-14T12:58:07.959321+0000","last_fullsized":"2023-07-14T12:58:07.959321+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:35:11.221824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869578+0000","last_change":"2023-07-14T12:57:40.158591+0000","last_active":"2023-07-14T12:59:06.869578+0000","last_peered":"2023-07-14T12:59:06.869578+0000","last_clean":"2023-07-14T12:59:06.869578+0000","last_became_active":"2023-07-14T12:57:40.158229+0000","last_became_peered":"2023-07-14T12:57:40.158229+0000","last_unstale":"2023-07-14T12:59:06.869578+0000","last_undegraded":"2023-07-14T12:59:06.869578+0000","last_fullsized":"2023-07-14T12:59:06.869578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:48:48.116113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957827+0000","last_change":"2023-07-14T12:57:39.152151+0000","last_active":"2023-07-14T12:58:07.957827+0000","last_peered":"2023-07-14T12:58:07.957827+0000","last_clean":"2023-07-14T12:58:07.957827+0000","last_became_active":"2023-07-14T12:57:39.151859+0000","last_became_peered":"2023-07-14T12:57:39.151859+0000","last_unstale":"2023-07-14T12:58:07.957827+0000","last_undegraded":"2023-07-14T12:58:07.957827+0000","last_fullsized":"2023-07-14T12:58:07.957827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:19:10.573132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867586+0000","last_change":"2023-07-14T12:57:40.166604+0000","last_active":"2023-07-14T12:59:06.867586+0000","last_peered":"2023-07-14T12:59:06.867586+0000","last_clean":"2023-07-14T12:59:06.867586+0000","last_became_active":"2023-07-14T12:57:40.166265+0000","last_became_peered":"2023-07-14T12:57:40.166265+0000","last_unstale":"2023-07-14T12:59:06.867586+0000","last_undegraded":"2023-07-14T12:59:06.867586+0000","last_fullsized":"2023-07-14T12:59:06.867586+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:32:01.157573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.865245+0000","last_change":"2023-07-14T12:57:40.169910+0000","last_active":"2023-07-14T12:59:06.865245+0000","last_peered":"2023-07-14T12:59:06.865245+0000","last_clean":"2023-07-14T12:59:06.865245+0000","last_became_active":"2023-07-14T12:57:40.169621+0000","last_became_peered":"2023-07-14T12:57:40.169621+0000","last_unstale":"2023-07-14T12:59:06.865245+0000","last_undegraded":"2023-07-14T12:59:06.865245+0000","last_fullsized":"2023-07-14T12:59:06.865245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:14.831482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:26.422239+0000","last_change":"2023-07-14T12:57:39.144463+0000","last_active":"2023-07-14T12:59:26.422239+0000","last_peered":"2023-07-14T12:59:26.422239+0000","last_clean":"2023-07-14T12:59:26.422239+0000","last_became_active":"2023-07-14T12:57:39.142094+0000","last_became_peered":"2023-07-14T12:57:39.142094+0000","last_unstale":"2023-07-14T12:59:26.422239+0000","last_undegraded":"2023-07-14T12:59:26.422239+0000","last_fullsized":"2023-07-14T12:59:26.422239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:11:20.958238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.876605+0000","last_change":"2023-07-14T12:57:40.163588+0000","last_active":"2023-07-14T12:59:06.876605+0000","last_peered":"2023-07-14T12:59:06.876605+0000","last_clean":"2023-07-14T12:59:06.876605+0000","last_became_active":"2023-07-14T12:57:40.162611+0000","last_became_peered":"2023-07-14T12:57:40.162611+0000","last_unstale":"2023-07-14T12:59:06.876605+0000","last_undegraded":"2023-07-14T12:59:06.876605+0000","last_fullsized":"2023-07-14T12:59:06.876605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:21:59.184916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113974+0000","last_change":"2023-07-14T12:57:39.143581+0000","last_active":"2023-07-14T12:58:08.113974+0000","last_peered":"2023-07-14T12:58:08.113974+0000","last_clean":"2023-07-14T12:58:08.113974+0000","last_became_active":"2023-07-14T12:57:39.143257+0000","last_became_peered":"2023-07-14T12:57:39.143257+0000","last_unstale":"2023-07-14T12:58:08.113974+0000","last_undegraded":"2023-07-14T12:58:08.113974+0000","last_fullsized":"2023-07-14T12:58:08.113974+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T14:04:30.442500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":351,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.957918+0000","last_change":"2023-07-14T12:56:23.360103+0000","last_active":"2023-07-14T12:58:07.957918+0000","last_peered":"2023-07-14T12:58:07.957918+0000","last_clean":"2023-07-14T12:58:07.957918+0000","last_became_active":"2023-07-14T12:56:23.359608+0000","last_became_peered":"2023-07-14T12:56:23.359608+0000","last_unstale":"2023-07-14T12:58:07.957918+0000","last_undegraded":"2023-07-14T12:58:07.957918+0000","last_fullsized":"2023-07-14T12:58:07.957918+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:52:45.397328+0000","last_clean_scrub_stamp":"2023-07-14T12:52:45.397328+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T12:52:52.622736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.869371+0000","last_change":"2023-07-14T12:57:40.158039+0000","last_active":"2023-07-14T12:59:06.869371+0000","last_peered":"2023-07-14T12:59:06.869371+0000","last_clean":"2023-07-14T12:59:06.869371+0000","last_became_active":"2023-07-14T12:57:40.157629+0000","last_became_peered":"2023-07-14T12:57:40.157629+0000","last_unstale":"2023-07-14T12:59:06.869371+0000","last_undegraded":"2023-07-14T12:59:06.869371+0000","last_fullsized":"2023-07-14T12:59:06.869371+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:04:18.205760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.958150+0000","last_change":"2023-07-14T12:57:39.146449+0000","last_active":"2023-07-14T12:58:07.958150+0000","last_peered":"2023-07-14T12:58:07.958150+0000","last_clean":"2023-07-14T12:58:07.958150+0000","last_became_active":"2023-07-14T12:57:39.146109+0000","last_became_peered":"2023-07-14T12:57:39.146109+0000","last_unstale":"2023-07-14T12:58:07.958150+0000","last_undegraded":"2023-07-14T12:58:07.958150+0000","last_fullsized":"2023-07-14T12:58:07.958150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:15.222237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963386+0000","last_change":"2023-07-14T12:57:39.149417+0000","last_active":"2023-07-14T12:58:07.963386+0000","last_peered":"2023-07-14T12:58:07.963386+0000","last_clean":"2023-07-14T12:58:07.963386+0000","last_became_active":"2023-07-14T12:57:39.149097+0000","last_became_peered":"2023-07-14T12:57:39.149097+0000","last_unstale":"2023-07-14T12:58:07.963386+0000","last_undegraded":"2023-07-14T12:58:07.963386+0000","last_fullsized":"2023-07-14T12:58:07.963386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:15:10.550476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868801+0000","last_change":"2023-07-14T12:57:40.160881+0000","last_active":"2023-07-14T12:59:06.868801+0000","last_peered":"2023-07-14T12:59:06.868801+0000","last_clean":"2023-07-14T12:59:06.868801+0000","last_became_active":"2023-07-14T12:57:40.158570+0000","last_became_peered":"2023-07-14T12:57:40.158570+0000","last_unstale":"2023-07-14T12:59:06.868801+0000","last_undegraded":"2023-07-14T12:59:06.868801+0000","last_fullsized":"2023-07-14T12:59:06.868801+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:08:46.644633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:08.903948+0000","last_change":"2023-07-14T12:57:39.142805+0000","last_active":"2023-07-14T12:59:08.903948+0000","last_peered":"2023-07-14T12:59:08.903948+0000","last_clean":"2023-07-14T12:59:08.903948+0000","last_became_active":"2023-07-14T12:57:39.142417+0000","last_became_peered":"2023-07-14T12:57:39.142417+0000","last_unstale":"2023-07-14T12:59:08.903948+0000","last_undegraded":"2023-07-14T12:59:08.903948+0000","last_fullsized":"2023-07-14T12:59:08.903948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:01:14.949862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866590+0000","last_change":"2023-07-14T12:57:40.171695+0000","last_active":"2023-07-14T12:59:06.866590+0000","last_peered":"2023-07-14T12:59:06.866590+0000","last_clean":"2023-07-14T12:59:06.866590+0000","last_became_active":"2023-07-14T12:57:40.171344+0000","last_became_peered":"2023-07-14T12:57:40.171344+0000","last_unstale":"2023-07-14T12:59:06.866590+0000","last_undegraded":"2023-07-14T12:59:06.866590+0000","last_fullsized":"2023-07-14T12:59:06.866590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:49.528964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113794+0000","last_change":"2023-07-14T12:57:39.141065+0000","last_active":"2023-07-14T12:58:08.113794+0000","last_peered":"2023-07-14T12:58:08.113794+0000","last_clean":"2023-07-14T12:58:08.113794+0000","last_became_active":"2023-07-14T12:57:39.140681+0000","last_became_peered":"2023-07-14T12:57:39.140681+0000","last_unstale":"2023-07-14T12:58:08.113794+0000","last_undegraded":"2023-07-14T12:58:08.113794+0000","last_fullsized":"2023-07-14T12:58:08.113794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:38:35.851889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.872326+0000","last_change":"2023-07-14T12:57:40.158403+0000","last_active":"2023-07-14T12:59:06.872326+0000","last_peered":"2023-07-14T12:59:06.872326+0000","last_clean":"2023-07-14T12:59:06.872326+0000","last_became_active":"2023-07-14T12:57:40.158077+0000","last_became_peered":"2023-07-14T12:57:40.158077+0000","last_unstale":"2023-07-14T12:59:06.872326+0000","last_undegraded":"2023-07-14T12:59:06.872326+0000","last_fullsized":"2023-07-14T12:59:06.872326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:27:14.759138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.112919+0000","last_change":"2023-07-14T12:57:39.139613+0000","last_active":"2023-07-14T12:58:08.112919+0000","last_peered":"2023-07-14T12:58:08.112919+0000","last_clean":"2023-07-14T12:58:08.112919+0000","last_became_active":"2023-07-14T12:57:39.139306+0000","last_became_peered":"2023-07-14T12:57:39.139306+0000","last_unstale":"2023-07-14T12:58:08.112919+0000","last_undegraded":"2023-07-14T12:58:08.112919+0000","last_fullsized":"2023-07-14T12:58:08.112919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:16:13.426604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.831149+0000","last_change":"2023-07-14T12:57:40.169715+0000","last_active":"2023-07-14T12:59:06.831149+0000","last_peered":"2023-07-14T12:59:06.831149+0000","last_clean":"2023-07-14T12:59:06.831149+0000","last_became_active":"2023-07-14T12:57:40.169319+0000","last_became_peered":"2023-07-14T12:57:40.169319+0000","last_unstale":"2023-07-14T12:59:06.831149+0000","last_undegraded":"2023-07-14T12:59:06.831149+0000","last_fullsized":"2023-07-14T12:59:06.831149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:49.187041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.964905+0000","last_change":"2023-07-14T12:57:39.134058+0000","last_active":"2023-07-14T12:58:07.964905+0000","last_peered":"2023-07-14T12:58:07.964905+0000","last_clean":"2023-07-14T12:58:07.964905+0000","last_became_active":"2023-07-14T12:57:39.133143+0000","last_became_peered":"2023-07-14T12:57:39.133143+0000","last_unstale":"2023-07-14T12:58:07.964905+0000","last_undegraded":"2023-07-14T12:58:07.964905+0000","last_fullsized":"2023-07-14T12:58:07.964905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:22:41.049828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.875376+0000","last_change":"2023-07-14T12:57:40.164106+0000","last_active":"2023-07-14T12:59:06.875376+0000","last_peered":"2023-07-14T12:59:06.875376+0000","last_clean":"2023-07-14T12:59:06.875376+0000","last_became_active":"2023-07-14T12:57:40.163768+0000","last_became_peered":"2023-07-14T12:57:40.163768+0000","last_unstale":"2023-07-14T12:59:06.875376+0000","last_undegraded":"2023-07-14T12:59:06.875376+0000","last_fullsized":"2023-07-14T12:59:06.875376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:27.922121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.971006+0000","last_change":"2023-07-14T12:58:07.970517+0000","last_active":"2023-07-14T12:58:07.971006+0000","last_peered":"2023-07-14T12:58:07.971006+0000","last_clean":"2023-07-14T12:58:07.971006+0000","last_became_active":"2023-07-14T12:58:07.967121+0000","last_became_peered":"2023-07-14T12:58:07.967121+0000","last_unstale":"2023-07-14T12:58:07.971006+0000","last_undegraded":"2023-07-14T12:58:07.971006+0000","last_fullsized":"2023-07-14T12:58:07.971006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:48:35.651155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.871293+0000","last_change":"2023-07-14T12:57:40.163373+0000","last_active":"2023-07-14T12:59:06.871293+0000","last_peered":"2023-07-14T12:59:06.871293+0000","last_clean":"2023-07-14T12:59:06.871293+0000","last_became_active":"2023-07-14T12:57:40.162852+0000","last_became_peered":"2023-07-14T12:57:40.162852+0000","last_unstale":"2023-07-14T12:59:06.871293+0000","last_undegraded":"2023-07-14T12:59:06.871293+0000","last_fullsized":"2023-07-14T12:59:06.871293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:38.396243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.963013+0000","last_change":"2023-07-14T12:57:39.143961+0000","last_active":"2023-07-14T12:58:07.963013+0000","last_peered":"2023-07-14T12:58:07.963013+0000","last_clean":"2023-07-14T12:58:07.963013+0000","last_became_active":"2023-07-14T12:57:39.143599+0000","last_became_peered":"2023-07-14T12:57:39.143599+0000","last_unstale":"2023-07-14T12:58:07.963013+0000","last_undegraded":"2023-07-14T12:58:07.963013+0000","last_fullsized":"2023-07-14T12:58:07.963013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:55:25.216766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878725+0000","last_change":"2023-07-14T12:57:40.157972+0000","last_active":"2023-07-14T12:59:06.878725+0000","last_peered":"2023-07-14T12:59:06.878725+0000","last_clean":"2023-07-14T12:59:06.878725+0000","last_became_active":"2023-07-14T12:57:40.157645+0000","last_became_peered":"2023-07-14T12:57:40.157645+0000","last_unstale":"2023-07-14T12:59:06.878725+0000","last_undegraded":"2023-07-14T12:59:06.878725+0000","last_fullsized":"2023-07-14T12:59:06.878725+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:54:33.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.965731+0000","last_change":"2023-07-14T12:57:39.153405+0000","last_active":"2023-07-14T12:58:07.965731+0000","last_peered":"2023-07-14T12:58:07.965731+0000","last_clean":"2023-07-14T12:58:07.965731+0000","last_became_active":"2023-07-14T12:57:39.153029+0000","last_became_peered":"2023-07-14T12:57:39.153029+0000","last_unstale":"2023-07-14T12:58:07.965731+0000","last_undegraded":"2023-07-14T12:58:07.965731+0000","last_fullsized":"2023-07-14T12:58:07.965731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:47:58.753892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.877188+0000","last_change":"2023-07-14T12:57:40.163910+0000","last_active":"2023-07-14T12:59:06.877188+0000","last_peered":"2023-07-14T12:59:06.877188+0000","last_clean":"2023-07-14T12:59:06.877188+0000","last_became_active":"2023-07-14T12:57:40.163539+0000","last_became_peered":"2023-07-14T12:57:40.163539+0000","last_unstale":"2023-07-14T12:59:06.877188+0000","last_undegraded":"2023-07-14T12:59:06.877188+0000","last_fullsized":"2023-07-14T12:59:06.877188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:12.543412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:08.113454+0000","last_change":"2023-07-14T12:57:39.132649+0000","last_active":"2023-07-14T12:58:08.113454+0000","last_peered":"2023-07-14T12:58:08.113454+0000","last_clean":"2023-07-14T12:58:08.113454+0000","last_became_active":"2023-07-14T12:57:39.132295+0000","last_became_peered":"2023-07-14T12:57:39.132295+0000","last_unstale":"2023-07-14T12:58:08.113454+0000","last_undegraded":"2023-07-14T12:58:08.113454+0000","last_fullsized":"2023-07-14T12:58:08.113454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T15:40:19.495427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.862100+0000","last_change":"2023-07-14T12:57:40.166285+0000","last_active":"2023-07-14T12:59:06.862100+0000","last_peered":"2023-07-14T12:59:06.862100+0000","last_clean":"2023-07-14T12:59:06.862100+0000","last_became_active":"2023-07-14T12:57:40.165968+0000","last_became_peered":"2023-07-14T12:57:40.165968+0000","last_unstale":"2023-07-14T12:59:06.862100+0000","last_undegraded":"2023-07-14T12:59:06.862100+0000","last_fullsized":"2023-07-14T12:59:06.862100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:28:22.071229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:58:07.961885+0000","last_change":"2023-07-14T12:57:39.150988+0000","last_active":"2023-07-14T12:58:07.961885+0000","last_peered":"2023-07-14T12:58:07.961885+0000","last_clean":"2023-07-14T12:58:07.961885+0000","last_became_active":"2023-07-14T12:57:39.150552+0000","last_became_peered":"2023-07-14T12:57:39.150552+0000","last_unstale":"2023-07-14T12:58:07.961885+0000","last_undegraded":"2023-07-14T12:58:07.961885+0000","last_fullsized":"2023-07-14T12:58:07.961885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:38.100813+0000","last_clean_scrub_stamp":"2023-07-14T12:57:38.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:04:27.733757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868282+0000","last_change":"2023-07-14T12:57:40.169729+0000","last_active":"2023-07-14T12:59:06.868282+0000","last_peered":"2023-07-14T12:59:06.868282+0000","last_clean":"2023-07-14T12:59:06.868282+0000","last_became_active":"2023-07-14T12:57:40.169432+0000","last_became_peered":"2023-07-14T12:57:40.169432+0000","last_unstale":"2023-07-14T12:59:06.868282+0000","last_undegraded":"2023-07-14T12:59:06.868282+0000","last_fullsized":"2023-07-14T12:59:06.868282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:27:50.731427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.867770+0000","last_change":"2023-07-14T12:57:40.167668+0000","last_active":"2023-07-14T12:59:06.867770+0000","last_peered":"2023-07-14T12:59:06.867770+0000","last_clean":"2023-07-14T12:59:06.867770+0000","last_became_active":"2023-07-14T12:57:40.167328+0000","last_became_peered":"2023-07-14T12:57:40.167328+0000","last_unstale":"2023-07-14T12:59:06.867770+0000","last_undegraded":"2023-07-14T12:59:06.867770+0000","last_fullsized":"2023-07-14T12:59:06.867770+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:05:24.623266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.861260+0000","last_change":"2023-07-14T12:57:40.161340+0000","last_active":"2023-07-14T12:59:06.861260+0000","last_peered":"2023-07-14T12:59:06.861260+0000","last_clean":"2023-07-14T12:59:06.861260+0000","last_became_active":"2023-07-14T12:57:40.161024+0000","last_became_peered":"2023-07-14T12:57:40.161024+0000","last_unstale":"2023-07-14T12:59:06.861260+0000","last_undegraded":"2023-07-14T12:59:06.861260+0000","last_fullsized":"2023-07-14T12:59:06.861260+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T17:52:56.043017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.870956+0000","last_change":"2023-07-14T12:57:40.159287+0000","last_active":"2023-07-14T12:59:06.870956+0000","last_peered":"2023-07-14T12:59:06.870956+0000","last_clean":"2023-07-14T12:59:06.870956+0000","last_became_active":"2023-07-14T12:57:40.158889+0000","last_became_peered":"2023-07-14T12:57:40.158889+0000","last_unstale":"2023-07-14T12:59:06.870956+0000","last_undegraded":"2023-07-14T12:59:06.870956+0000","last_fullsized":"2023-07-14T12:59:06.870956+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:56:27.078113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.874752+0000","last_change":"2023-07-14T12:57:40.168898+0000","last_active":"2023-07-14T12:59:06.874752+0000","last_peered":"2023-07-14T12:59:06.874752+0000","last_clean":"2023-07-14T12:59:06.874752+0000","last_became_active":"2023-07-14T12:57:40.168596+0000","last_became_peered":"2023-07-14T12:57:40.168596+0000","last_unstale":"2023-07-14T12:59:06.874752+0000","last_undegraded":"2023-07-14T12:59:06.874752+0000","last_fullsized":"2023-07-14T12:59:06.874752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:18.836992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.873481+0000","last_change":"2023-07-14T12:57:40.156267+0000","last_active":"2023-07-14T12:59:06.873481+0000","last_peered":"2023-07-14T12:59:06.873481+0000","last_clean":"2023-07-14T12:59:06.873481+0000","last_became_active":"2023-07-14T12:57:40.155909+0000","last_became_peered":"2023-07-14T12:57:40.155909+0000","last_unstale":"2023-07-14T12:59:06.873481+0000","last_undegraded":"2023-07-14T12:59:06.873481+0000","last_fullsized":"2023-07-14T12:59:06.873481+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:07.081173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866738+0000","last_change":"2023-07-14T12:57:40.162956+0000","last_active":"2023-07-14T12:59:06.866738+0000","last_peered":"2023-07-14T12:59:06.866738+0000","last_clean":"2023-07-14T12:59:06.866738+0000","last_became_active":"2023-07-14T12:57:40.162373+0000","last_became_peered":"2023-07-14T12:57:40.162373+0000","last_unstale":"2023-07-14T12:59:06.866738+0000","last_undegraded":"2023-07-14T12:59:06.866738+0000","last_fullsized":"2023-07-14T12:59:06.866738+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:32:15.307049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.879456+0000","last_change":"2023-07-14T12:57:40.158655+0000","last_active":"2023-07-14T12:59:06.879456+0000","last_peered":"2023-07-14T12:59:06.879456+0000","last_clean":"2023-07-14T12:59:06.879456+0000","last_became_active":"2023-07-14T12:57:40.158290+0000","last_became_peered":"2023-07-14T12:57:40.158290+0000","last_unstale":"2023-07-14T12:59:06.879456+0000","last_undegraded":"2023-07-14T12:59:06.879456+0000","last_fullsized":"2023-07-14T12:59:06.879456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:02:22.373566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.859587+0000","last_change":"2023-07-14T12:57:40.164132+0000","last_active":"2023-07-14T12:59:06.859587+0000","last_peered":"2023-07-14T12:59:06.859587+0000","last_clean":"2023-07-14T12:59:06.859587+0000","last_became_active":"2023-07-14T12:57:40.163774+0000","last_became_peered":"2023-07-14T12:57:40.163774+0000","last_unstale":"2023-07-14T12:59:06.859587+0000","last_undegraded":"2023-07-14T12:59:06.859587+0000","last_fullsized":"2023-07-14T12:59:06.859587+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:31:30.562785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.868125+0000","last_change":"2023-07-14T12:57:40.171046+0000","last_active":"2023-07-14T12:59:06.868125+0000","last_peered":"2023-07-14T12:59:06.868125+0000","last_clean":"2023-07-14T12:59:06.868125+0000","last_became_active":"2023-07-14T12:57:40.170727+0000","last_became_peered":"2023-07-14T12:57:40.170727+0000","last_unstale":"2023-07-14T12:59:06.868125+0000","last_undegraded":"2023-07-14T12:59:06.868125+0000","last_fullsized":"2023-07-14T12:59:06.868125+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T16:05:44.795580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.864235+0000","last_change":"2023-07-14T12:57:40.171636+0000","last_active":"2023-07-14T12:59:06.864235+0000","last_peered":"2023-07-14T12:59:06.864235+0000","last_clean":"2023-07-14T12:59:06.864235+0000","last_became_active":"2023-07-14T12:57:40.171365+0000","last_became_peered":"2023-07-14T12:57:40.171365+0000","last_unstale":"2023-07-14T12:59:06.864235+0000","last_undegraded":"2023-07-14T12:59:06.864235+0000","last_fullsized":"2023-07-14T12:59:06.864235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:58:10.582323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.878104+0000","last_change":"2023-07-14T12:57:40.162963+0000","last_active":"2023-07-14T12:59:06.878104+0000","last_peered":"2023-07-14T12:59:06.878104+0000","last_clean":"2023-07-14T12:59:06.878104+0000","last_became_active":"2023-07-14T12:57:40.162614+0000","last_became_peered":"2023-07-14T12:57:40.162614+0000","last_unstale":"2023-07-14T12:59:06.878104+0000","last_undegraded":"2023-07-14T12:59:06.878104+0000","last_fullsized":"2023-07-14T12:59:06.878104+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:46.953808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.873797+0000","last_change":"2023-07-14T12:57:40.156138+0000","last_active":"2023-07-14T12:59:06.873797+0000","last_peered":"2023-07-14T12:59:06.873797+0000","last_clean":"2023-07-14T12:59:06.873797+0000","last_became_active":"2023-07-14T12:57:40.155785+0000","last_became_peered":"2023-07-14T12:57:40.155785+0000","last_unstale":"2023-07-14T12:59:06.873797+0000","last_undegraded":"2023-07-14T12:59:06.873797+0000","last_fullsized":"2023-07-14T12:59:06.873797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:03:45.189290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-07-14T12:59:06.866624+0000","last_change":"2023-07-14T12:57:40.163978+0000","last_active":"2023-07-14T12:59:06.866624+0000","last_peered":"2023-07-14T12:59:06.866624+0000","last_clean":"2023-07-14T12:59:06.866624+0000","last_became_active":"2023-07-14T12:57:40.163620+0000","last_became_peered":"2023-07-14T12:57:40.163620+0000","last_unstale":"2023-07-14T12:59:06.866624+0000","last_undegraded":"2023-07-14T12:59:06.866624+0000","last_fullsized":"2023-07-14T12:59:06.866624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T12:57:39.117622+0000","last_clean_scrub_stamp":"2023-07-14T12:57:39.117622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:48.986548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":215126,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64324,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":630,"num_read_kb":384,"num_write":161,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":146,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":192972,"data_compressed":4806,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351010,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":459210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.70699999999999996,"15min":0.66500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":9.1430000000000007,"5min":9.1430000000000007,"15min":9.1430000000000007},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67600000000000005,"15min":0.68799999999999994},"min":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92800000000000005,"5min":1.097,"15min":1.097},"last":0.64800000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59899999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.042,"5min":1.111,"15min":1.111},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93300000000000005,"5min":1.341,"15min":1.341},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.41499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92500000000000004,"5min":1.347,"15min":1.347},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.378,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92800000000000005,"5min":1.506,"15min":1.506},"last":0.84799999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:59:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.3959999999999999,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81799999999999995,"15min":0.81399999999999995},"min":{"1min":0.623,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0640000000000001,"5min":1.542,"15min":1.542},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79500000000000004,"15min":0.80500000000000005},"min":{"1min":0.51500000000000001,"5min":0.496,"15min":0.496},"max":{"1min":0.90200000000000002,"5min":1.411,"15min":1.411},"last":1.024}]},{"osd":5,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70499999999999996},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94299999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.79700000000000004,"15min":0.80400000000000005},"min":{"1min":0.46600000000000003,"5min":0.37,"15min":0.37},"max":{"1min":1.028,"5min":1.881,"15min":1.881},"last":0.94499999999999995}]},{"osd":6,"last update":"Fri Jul 14 12:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.92600000000000005,"15min":0.92800000000000005},"min":{"1min":0.74199999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1220000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.95599999999999996,"5min":1.373,"15min":1.373},"last":0.92800000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":1.097},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.1180000000000001}]},{"osd":9,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.96099999999999997,"15min":0.91800000000000004},"min":{"1min":0.66300000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":9.2210000000000001,"5min":9.2210000000000001,"15min":9.2210000000000001},"last":1.133},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.96399999999999997,"15min":0.96099999999999997},"min":{"1min":0.70799999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.1679999999999999}]},{"osd":10,"last update":"Fri Jul 14 12:58:46 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.68000000000000005,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.093,"5min":1.633,"15min":1.633},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.95199999999999996,"15min":0.95999999999999996},"min":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.069,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.1579999999999999}]}]},{"osd":10,"up_from":73,"seq":313532612647,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1097728,"data_stored":1110942,"data_compressed":37730,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.82699999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.435,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.034,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.92000000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.89900000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.44500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.53400000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85999999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.82299999999999995}]},{"osd":4,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.433,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81200000000000006,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71999999999999997,"15min":0.72399999999999998},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89800000000000002,"5min":1.391,"15min":1.391},"last":0.75}]},{"osd":5,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.65700000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95599999999999996,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88200000000000001,"15min":0.89100000000000001},"min":{"1min":0.61199999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.996,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.95299999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.90000000000000002,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.83999999999999997,"15min":0.86299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93899999999999995,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.872}]},{"osd":7,"last update":"Fri Jul 14 12:57:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.86599999999999999,"15min":0.874},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.98099999999999998,"5min":1.298,"15min":1.298},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.92200000000000004,"15min":0.93600000000000005},"min":{"1min":0.61199999999999999,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.018,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.92200000000000004}]},{"osd":9,"last update":"Fri Jul 14 12:58:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.94599999999999995,"15min":0.96999999999999997},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":0.998,"5min":1.746,"15min":1.746},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.052,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":0.85299999999999998}]},{"osd":11,"last update":"Fri Jul 14 12:58:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.91200000000000003,"15min":0.91700000000000004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.069,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.145,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.032}]}]},{"osd":9,"up_from":68,"seq":292057776173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.0150000000000001,"5min":3.0150000000000001,"15min":3.0150000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.80300000000000005},"min":{"1min":0.53000000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.3120000000000001,"5min":1.383,"15min":1.383},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.753,"15min":0.747},"min":{"1min":0.51400000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.68400000000000005,"15min":0.68100000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":3.4550000000000001,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71599999999999997,"15min":0.72499999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.2050000000000001,"5min":3.2050000000000001,"15min":3.2050000000000001},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.83799999999999997,"15min":0.88400000000000001},"min":{"1min":0.54000000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85699999999999998,"15min":0.89300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.89500000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.623},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.85599999999999998,"15min":0.879},"min":{"1min":0.55500000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86099999999999999,"15min":0.89000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":3.173,"5min":3.173,"15min":3.173},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.88900000000000001,"15min":0.93999999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.94399999999999995,"15min":0.98099999999999998},"min":{"1min":0.61799999999999999,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.97799999999999998,"15min":1.014},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":0.73199999999999998}]},{"osd":8,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.95999999999999996,"15min":1.012},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3109999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.97499999999999998,"15min":1.0209999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.66900000000000004}]},{"osd":10,"last update":"Fri Jul 14 12:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.96899999999999997},"min":{"1min":0.622,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1879999999999999,"5min":3.1389999999999998,"15min":3.1389999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.92300000000000004,"15min":0.93500000000000005},"min":{"1min":0.70399999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.82399999999999995}]}]},{"osd":8,"up_from":60,"seq":257698037812,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76800000000000002,"15min":0.77500000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6559999999999999,"5min":1.855,"15min":1.855},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.6220000000000001,"5min":1.847,"15min":1.847},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.52800000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.746,"15min":0.73499999999999999},"min":{"1min":0.625,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.024,"5min":1.802,"15min":1.802},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.628,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.377,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1200000000000001,"5min":2.5739999999999998,"15min":2.5739999999999998},"last":0.67300000000000004}]},{"osd":3,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.90300000000000002,"15min":0.97799999999999998},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.5249999999999999,"5min":4.6529999999999996,"15min":4.6529999999999996},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82899999999999996,"15min":0.85999999999999999},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.48,"5min":1.825,"15min":1.825},"last":0.78200000000000003}]},{"osd":4,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.137,"5min":1.3,"15min":1.3},"last":0.88},{"interface":"front","average":{"1min":0.75,"5min":0.80100000000000005,"15min":0.81000000000000005},"min":{"1min":0.46600000000000003,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94599999999999995,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75800000000000001,"15min":0.78400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0720000000000001,"5min":2.2890000000000001,"15min":2.2890000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.42899999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.93700000000000006},"min":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.575,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.92600000000000005,"15min":0.95099999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1899999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.61199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.014,"5min":1.73,"15min":1.73},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.92400000000000004,"15min":0.93500000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.2490000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.999}]},{"osd":9,"last update":"Fri Jul 14 12:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.71799999999999997,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3779999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.018},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88500000000000001,"15min":0.89100000000000001},"min":{"1min":0.69199999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.93899999999999995}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.91600000000000004,"15min":0.88600000000000001},"min":{"1min":0.79900000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.127,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88700000000000001,"15min":0.86899999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.103,"5min":1.161,"15min":1.161},"last":0.89600000000000002}]},{"osd":11,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.103}]}]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":1011712,"data_stored":1051416,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:57:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64500000000000002},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.68200000000000005,"15min":0.67000000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.66900000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81499999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.016,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.54200000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.85299999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.0249999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.77700000000000002,"15min":0.76500000000000001},"min":{"1min":0.497,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.091,"5min":1.397,"15min":1.397},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.68899999999999995,"15min":0.70599999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0009999999999999,"5min":1.169,"15min":1.169},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.67900000000000005,"15min":0.70799999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.81000000000000005,"15min":0.84199999999999997},"min":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.83399999999999996},"min":{"1min":0.61799999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89900000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84199999999999997,"15min":0.85499999999999998},"min":{"1min":0.55800000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.85799999999999998,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.1459999999999999,"5min":1.639,"15min":1.639},"last":0.89100000000000001}]},{"osd":8,"last update":"Fri Jul 14 12:58:26 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.82799999999999996,"15min":0.80400000000000005},"min":{"1min":0.69399999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83599999999999997,"15min":0.82599999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.78000000000000003}]},{"osd":9,"last update":"Fri Jul 14 12:59:01 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.61099999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.405,"5min":1.004,"15min":0.93200000000000005},"min":{"1min":0.67300000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":9.7870000000000008,"5min":9.7870000000000008,"15min":9.7870000000000008},"last":0.873}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88900000000000001,"15min":0.91700000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.135,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.93000000000000005,"15min":0.93400000000000005},"min":{"1min":0.64100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1699999999999999,"5min":1.276,"15min":1.276},"last":0.60699999999999998}]},{"osd":11,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.92900000000000005}]}]},{"osd":6,"up_from":47,"seq":201863462974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":954368,"data_stored":458807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53300000000000003,"15min":0.51200000000000001},"min":{"1min":0.34499999999999997,"5min":0.307,"15min":0.307},"max":{"1min":1.458,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.847,"5min":2.081,"15min":2.081},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.71899999999999997},"min":{"1min":0.54600000000000004,"5min":0.503,"15min":0.503},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77400000000000002,"15min":0.73499999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.6319999999999999,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.755}]},{"osd":2,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.73499999999999999,"15min":0.70799999999999996},"min":{"1min":0.52900000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.59299999999999997,"5min":0.44,"15min":0.44},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68999999999999995,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.68200000000000005,"15min":0.69099999999999995},"min":{"1min":0.45900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.706,"5min":2.113,"15min":2.113},"last":0.504}]},{"osd":4,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.752,"15min":0.73199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.59599999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.83399999999999996,"15min":0.84599999999999997},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85299999999999998,"15min":0.83299999999999996},"min":{"1min":0.64400000000000002,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.84499999999999997,"15min":0.82399999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.74099999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:58:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.89600000000000002,"15min":0.91700000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93200000000000005,"15min":0.94999999999999996},"min":{"1min":0.72399999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":0.625}]},{"osd":9,"last update":"Fri Jul 14 12:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.878,"15min":0.91300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.93600000000000005,"15min":0.97399999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.5940000000000001,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.80800000000000005}]},{"osd":10,"last update":"Fri Jul 14 12:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":1.0309999999999999,"15min":1.091},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":0.91500000000000004,"5min":4.109,"15min":4.109},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.93200000000000005,"15min":0.93899999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.98999999999999999,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":1007616,"data_stored":518165,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.625,"15min":0.57299999999999995},"min":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":1.038,"15min":1.038},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65900000000000003,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40799999999999997,"15min":0.40500000000000003},"max":{"1min":1.024,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.76400000000000001,"15min":0.66100000000000003},"min":{"1min":0.69299999999999995,"5min":0.41099999999999998,"15min":0.34000000000000002},"max":{"1min":1.127,"5min":1.131,"15min":1.131},"last":1.2},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.70699999999999996,"15min":0.65500000000000003},"min":{"1min":0.64100000000000001,"5min":0.42499999999999999,"15min":0.41699999999999998},"max":{"1min":0.98099999999999998,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.90900000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.55400000000000005,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.94099999999999995,"5min":0.997,"15min":0.997},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.018,"5min":0.81299999999999994,"15min":0.73099999999999998},"min":{"1min":0.61299999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":5.1369999999999996,"5min":5.1369999999999996,"15min":5.1369999999999996},"last":1.0800000000000001}]},{"osd":4,"last update":"Fri Jul 14 12:58:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.61299999999999999,"15min":0.54700000000000004},"min":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0580000000000001,"5min":1.079,"15min":1.079},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.44500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85599999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Jul 14 12:59:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.74399999999999999,"15min":0.68500000000000005},"min":{"1min":0.56899999999999995,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0149999999999999,"5min":1.115,"15min":1.115},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.76200000000000001,"15min":0.72599999999999998},"min":{"1min":0.66700000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0820000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.95799999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74299999999999999,"15min":0.70899999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0960000000000001,"5min":0.875,"15min":0.80700000000000005},"min":{"1min":0.56899999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":5.1749999999999998,"5min":5.1749999999999998,"15min":5.1749999999999998},"last":1.2350000000000001}]},{"osd":7,"last update":"Fri Jul 14 12:59:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.79800000000000004,"15min":0.71999999999999997},"min":{"1min":0.66500000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2330000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.73699999999999999,"15min":0.65300000000000002},"min":{"1min":0.60299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1439999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.97299999999999998}]},{"osd":8,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.83899999999999997,"15min":0.80300000000000005},"min":{"1min":0.71999999999999997,"5min":0.443,"15min":0.443},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.91100000000000003,"15min":0.875},"min":{"1min":0.61699999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.1559999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.292}]},{"osd":9,"last update":"Fri Jul 14 12:59:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.90800000000000003,"15min":0.88300000000000001},"min":{"1min":0.59199999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.1559999999999997,"5min":5.1559999999999997,"15min":5.1559999999999997},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.02,"5min":1,"15min":1.0069999999999999},"min":{"1min":0.80800000000000005,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.304,"5min":1.496,"15min":1.496},"last":1.266}]},{"osd":10,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.046,"15min":1.048},"min":{"1min":0.82099999999999995,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.3160000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.89900000000000002,"15min":0.89200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.095}]},{"osd":11,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":1.179}]}]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":974848,"data_stored":460072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.66400000000000003,"15min":0.61099999999999999},"min":{"1min":0.40699999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.0069999999999997,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.69699999999999995,"15min":0.60599999999999998},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":6.8099999999999996,"5min":6.8099999999999996,"15min":6.8099999999999996},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Jul 14 12:58:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90500000000000003,"5min":1.046,"15min":1.046},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.70599999999999996,"15min":0.64200000000000002},"min":{"1min":0.46100000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.90300000000000002}]},{"osd":3,"last update":"Fri Jul 14 12:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.3579999999999997,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.3899999999999997,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":0.84099999999999997}]},{"osd":4,"last update":"Fri Jul 14 12:58:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.749,"15min":0.69899999999999995},"min":{"1min":0.47199999999999998,"5min":0.44,"15min":0.44},"max":{"1min":4.0960000000000001,"5min":4.0960000000000001,"15min":4.0960000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.032,"5min":0.77000000000000002,"15min":0.69599999999999995},"min":{"1min":0.48399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":6.9550000000000001,"5min":6.9550000000000001,"15min":6.9550000000000001},"last":0.78800000000000003}]},{"osd":5,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.753,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.363,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.87},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.754},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.085,"5min":4.1769999999999996,"15min":4.1769999999999996},"last":1.01}]},{"osd":6,"last update":"Fri Jul 14 12:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.71199999999999997,"15min":0.70199999999999996},"min":{"1min":0.33300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":6.8739999999999997,"5min":6.8739999999999997,"15min":6.8739999999999997},"last":1.135},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.754,"15min":0.73299999999999998},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.4240000000000004,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1200000000000001,"5min":1.155,"15min":1.155},"last":0.751},{"interface":"front","average":{"1min":0.873,"5min":0.79700000000000004,"15min":0.78400000000000003},"min":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.61799999999999999}]},{"osd":8,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.60999999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":4.3239999999999998,"5min":4.3239999999999998,"15min":4.3239999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.89100000000000001,"15min":0.88900000000000001},"min":{"1min":0.65000000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.1420000000000003,"5min":4.1420000000000003,"15min":4.1420000000000003},"last":1.0629999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:59:00 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.89100000000000001,"15min":0.91300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":7.0350000000000001,"5min":7.0350000000000001,"15min":7.0350000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.004,"5min":0.89500000000000002,"15min":0.91600000000000004},"min":{"1min":0.5,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.2729999999999999}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.91200000000000003,"15min":0.91400000000000003},"min":{"1min":0.55100000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.171,"5min":4.0579999999999998,"15min":4.0579999999999998},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.94599999999999995,"15min":0.92700000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.7889999999999999,"5min":6.992,"15min":6.992},"last":1.2190000000000001}]},{"osd":11,"last update":"Fri Jul 14 12:58:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.90700000000000003,"15min":0.88200000000000001},"min":{"1min":0.623,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.21,"5min":4.21,"15min":4.21},"last":1.25},{"interface":"front","average":{"1min":1.198,"5min":0.94599999999999995,"15min":0.90400000000000003},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":6.9169999999999998,"5min":6.9169999999999998,"15min":6.9169999999999998},"last":1.294}]}]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":1019904,"data_stored":519804,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.42399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":0.86499999999999999,"15min":0.89400000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.61899999999999999,"15min":0.59699999999999998},"min":{"1min":0.54900000000000004,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Jul 14 12:58:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.67800000000000005,"15min":0.65800000000000003},"min":{"1min":0.56100000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92800000000000005,"5min":1.0549999999999999,"15min":1.819},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.53000000000000003,"5min":0.42199999999999999,"15min":0.41699999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":1.841},"last":0.80500000000000005}]},{"osd":3,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.77100000000000002,"15min":0.72299999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.83599999999999997,"5min":6.4779999999999998,"15min":6.4779999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.46200000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.878,"5min":1.629,"15min":1.629},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Jul 14 12:59:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.60299999999999998,"15min":0.50900000000000001},"min":{"1min":0.502,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93799999999999994,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.629,"15min":0.54500000000000004},"min":{"1min":0.58499999999999996,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.78000000000000003,"15min":0.74199999999999999},"min":{"1min":0.69199999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.76900000000000002,"15min":0.73699999999999999},"min":{"1min":0.47399999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Jul 14 12:56:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.56599999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76800000000000002,"15min":0.76200000000000001},"min":{"1min":0.69299999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77800000000000002}]},{"osd":8,"last update":"Fri Jul 14 12:59:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.75900000000000001,"15min":0.73799999999999999},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0069999999999999,"5min":1.222,"15min":1.222},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.79600000000000004,"15min":0.74199999999999999},"min":{"1min":0.54800000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.98899999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:58:58 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":0.93999999999999995,"15min":0.84699999999999998},"min":{"1min":0.73199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":6.5179999999999998,"5min":6.5179999999999998,"15min":6.5179999999999998},"last":1.014},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83499999999999996,"15min":0.81699999999999995},"min":{"1min":0.63300000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.93400000000000005}]},{"osd":10,"last update":"Fri Jul 14 12:59:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65100000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0109999999999999,"5min":0.92000000000000004,"15min":0.88600000000000001},"min":{"1min":0.78400000000000003,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.044}]},{"osd":11,"last update":"Fri Jul 14 12:58:41 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":1.056},{"interface":"front","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.079}]}]},{"osd":3,"up_from":26,"seq":111669149774,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":458793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.47199999999999998,"15min":0.42999999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81200000000000006,"5min":1.165,"15min":1.165},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51100000000000001,"15min":0.45900000000000002},"min":{"1min":0.36599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73599999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.67500000000000004},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98699999999999999,"5min":6.867,"15min":6.867},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81100000000000005,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.004,"5min":6.8860000000000001,"15min":6.8860000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.75600000000000001,"15min":0.69199999999999995},"min":{"1min":0.52400000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.238,"5min":3.238,"15min":3.238},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.747,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.94299999999999995,"5min":6.9020000000000001,"15min":6.9020000000000001},"last":0.84499999999999997}]},{"osd":4,"last update":"Fri Jul 14 12:58:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80800000000000005,"15min":0.72899999999999998},"min":{"1min":0.48399999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.7490000000000001,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.754,"15min":0.71699999999999997},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.621}]},{"osd":5,"last update":"Fri Jul 14 12:59:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.79500000000000004,"15min":0.78900000000000003},"min":{"1min":0.58499999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.1890000000000001,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.73799999999999999},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.80500000000000005}]},{"osd":6,"last update":"Fri Jul 14 12:58:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.77000000000000002,"15min":0.68600000000000005},"min":{"1min":0.435,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.4290000000000003,"5min":7.4290000000000003,"15min":7.4290000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.248,"5min":0.80900000000000005,"15min":0.70199999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":12.958,"5min":12.958,"15min":12.958},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Jul 14 12:59:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.63600000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.036,"5min":0.85899999999999999,"15min":0.79300000000000004},"min":{"1min":0.69099999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":4.2670000000000003,"5min":4.2670000000000003,"15min":4.2670000000000003},"last":0.76200000000000001}]},{"osd":8,"last update":"Fri Jul 14 12:57:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.86199999999999999,"15min":0.86299999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2010000000000001,"5min":1.206,"15min":1.206},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1859999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.80500000000000005}]},{"osd":9,"last update":"Fri Jul 14 12:58:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":0.97999999999999998,"15min":0.95399999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":7.3700000000000001,"5min":7.3700000000000001,"15min":7.3700000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81999999999999995,"15min":0.82999999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.749}]},{"osd":10,"last update":"Fri Jul 14 12:59:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.89100000000000001,"15min":0.89900000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0649999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.93200000000000005,"15min":0.94199999999999995},"min":{"1min":0.68500000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.1679999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.82499999999999996}]},{"osd":11,"last update":"Fri Jul 14 12:58:43 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.871}]}]},{"osd":4,"up_from":34,"seq":146028888136,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":459785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:56:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.77600000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Jul 14 12:58:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.46400000000000002},"min":{"1min":0.34399999999999997,"5min":0.222,"15min":0.222},"max":{"1min":0.65100000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.5,"15min":0.46200000000000002},"min":{"1min":0.40100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79900000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.50800000000000001}]},{"osd":2,"last update":"Fri Jul 14 12:58:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.73999999999999999,"15min":0.68700000000000006},"min":{"1min":0.58799999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.099,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71799999999999997,"15min":0.70399999999999996},"min":{"1min":0.57399999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96199999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Jul 14 12:58:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.78800000000000003,"15min":0.69799999999999995},"min":{"1min":0.53300000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":7.0250000000000004,"5min":7.0250000000000004,"15min":7.0250000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.056,"5min":0.74099999999999999,"15min":0.67300000000000004},"min":{"1min":0.496,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Jul 14 12:59:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.877},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.73899999999999999,"15min":0.70399999999999996},"min":{"1min":0.58399999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.93000000000000005,"5min":1.002,"15min":1.002},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":0.91600000000000004,"15min":0.81899999999999995},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":9.6229999999999993,"5min":9.6229999999999993,"15min":9.6229999999999993},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.4630000000000001,"5min":0.88900000000000001,"15min":0.79000000000000004},"min":{"1min":0.52800000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":9.6590000000000007,"5min":9.6590000000000007,"15min":9.6590000000000007},"last":0.746}]},{"osd":7,"last update":"Fri Jul 14 12:59:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.69099999999999995},"min":{"1min":0.47999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89600000000000002,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.751,"15min":0.749},"min":{"1min":0.57499999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98899999999999999,"5min":1.129,"15min":1.129},"last":0.69599999999999995}]},{"osd":8,"last update":"Fri Jul 14 12:58:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97699999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.875,"15min":0.86499999999999999},"min":{"1min":0.65900000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.143,"5min":1.234,"15min":1.234},"last":0.99099999999999999}]},{"osd":9,"last update":"Fri Jul 14 12:58:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":0.93799999999999994,"15min":0.89800000000000002},"min":{"1min":0.63100000000000001,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.0919999999999996,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.872,"15min":0.85199999999999998},"min":{"1min":0.60899999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":0.82399999999999995}]},{"osd":10,"last update":"Fri Jul 14 12:59:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.93100000000000005,"15min":0.92400000000000004},"min":{"1min":0.67200000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1970000000000001,"5min":1.337,"15min":1.337},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82499999999999996,"15min":0.81100000000000005},"min":{"1min":0.59399999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98299999999999998,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.93500000000000005}]},{"osd":11,"last update":"Fri Jul 14 12:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.0189999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724612,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":1028096,"data_stored":1050996,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61699999999999999,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85499999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91600000000000004,"5min":0.997,"15min":0.997},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69799999999999995,"15min":0.63100000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.69599999999999995,"15min":0.625},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53000000000000003,"15min":0.503},"min":{"1min":0.38800000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79900000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.54100000000000004,"15min":0.48799999999999999},"min":{"1min":0.41799999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.47399999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.028,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.501,"5min":0.434,"15min":0.434},"max":{"1min":0.996,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.78100000000000003}]},{"osd":4,"last update":"Fri Jul 14 12:59:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75800000000000001,"15min":0.68000000000000005},"min":{"1min":0.55700000000000005,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0269999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.75,"15min":0.70799999999999996},"min":{"1min":0.57099999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1080000000000001,"5min":1.139,"15min":1.139},"last":0.755}]},{"osd":6,"last update":"Fri Jul 14 12:58:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.749,"15min":0.753},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98199999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76900000000000002,"15min":0.78400000000000003},"min":{"1min":0.50900000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.018,"5min":1.28,"15min":1.28},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Jul 14 12:59:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.69399999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.84799999999999998},"min":{"1min":0.51700000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.218,"5min":1.236,"15min":1.236},"last":0.92700000000000005}]},{"osd":8,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51200000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.88400000000000001}]},{"osd":9,"last update":"Fri Jul 14 12:59:00 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.873,"15min":0.871},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1499999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.85899999999999999,"15min":0.84899999999999998},"min":{"1min":0.67200000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1379999999999999,"5min":1.286,"15min":1.286},"last":0.96699999999999997}]},{"osd":10,"last update":"Fri Jul 14 12:58:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.86799999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.874,"15min":0.871},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34486,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36128,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59844,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61483,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":61857,"data_compressed":1602,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T12:59:30.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:59:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.977+0000 7fa87fbff700 1 -- 172.21.15.17:0/3604986790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8781005b0 msgr2=0x7fa878102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.977+0000 7fa87fbff700 1 --2- 172.21.15.17:0/3604986790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8781005b0 0x7fa878102990 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa874009990 tx=0x7fa874009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.977+0000 7fa87fbff700 1 -- 172.21.15.17:0/3604986790 shutdown_connections 2023-07-14T12:59:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.977+0000 7fa87fbff700 1 --2- 172.21.15.17:0/3604986790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8781057f0 0x7fa878107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.977+0000 7fa87fbff700 1 --2- 172.21.15.17:0/3604986790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8781005b0 0x7fa878102990 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.977+0000 7fa87fbff700 1 --2- 172.21.15.17:0/3604986790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa878102ed0 0x7fa8781052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.977+0000 7fa87fbff700 1 -- 172.21.15.17:0/3604986790 >> 172.21.15.17:0/3604986790 conn(0x7fa8780f9fd0 msgr2=0x7fa8780fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.977+0000 7fa87fbff700 1 -- 172.21.15.17:0/3604986790 shutdown_connections 2023-07-14T12:59:31.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.977+0000 7fa87fbff700 1 -- 172.21.15.17:0/3604986790 wait complete. 2023-07-14T12:59:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.978+0000 7fa87fbff700 1 Processor -- start 2023-07-14T12:59:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.978+0000 7fa87fbff700 1 -- start start 2023-07-14T12:59:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.978+0000 7fa87fbff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8781005b0 0x7fa8780fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.978+0000 7fa87fbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa878102ed0 0x7fa8780fe560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.978+0000 7fa87fbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8781057f0 0x7fa8780feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.978+0000 7fa87fbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780ff240 con 0x7fa8781057f0 2023-07-14T12:59:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.978+0000 7fa87fbff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780ff3b0 con 0x7fa8781005b0 2023-07-14T12:59:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.978+0000 7fa87fbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87819f7a0 con 0x7fa878102ed0 2023-07-14T12:59:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.979+0000 7fa87e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8781057f0 0x7fa8780feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.979+0000 7fa87e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8781057f0 0x7fa8780feaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51904/0 (socket says 172.21.15.17:51904) 2023-07-14T12:59:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.979+0000 7fa87e19c700 1 -- 172.21.15.17:0/1618184614 learned_addr learned my addr 172.21.15.17:0/1618184614 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:31.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.979+0000 7fa87d99b700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8781005b0 0x7fa8780fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.979+0000 7fa87d19a700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa878102ed0 0x7fa8780fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.979+0000 7fa87e19c700 1 -- 172.21.15.17:0/1618184614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa878102ed0 msgr2=0x7fa8780fe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.979+0000 7fa87e19c700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa878102ed0 0x7fa8780fe560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.979+0000 7fa87e19c700 1 -- 172.21.15.17:0/1618184614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8781005b0 msgr2=0x7fa8780fff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.979+0000 7fa87e19c700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8781005b0 0x7fa8780fff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.979+0000 7fa87e19c700 1 -- 172.21.15.17:0/1618184614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8740095f0 con 0x7fa8781057f0 2023-07-14T12:59:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.979+0000 7fa87e19c700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8781057f0 0x7fa8780feaa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa87000ef30 tx=0x7fa87000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.980+0000 7fa86effd700 1 -- 172.21.15.17:0/1618184614 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870018070 con 0x7fa8781057f0 2023-07-14T12:59:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.980+0000 7fa86effd700 1 -- 172.21.15.17:0/1618184614 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa87000f040 con 0x7fa8781057f0 2023-07-14T12:59:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.980+0000 7fa87fbff700 1 -- 172.21.15.17:0/1618184614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87819fa20 con 0x7fa8781057f0 2023-07-14T12:59:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.980+0000 7fa86effd700 1 -- 172.21.15.17:0/1618184614 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000cbc0 con 0x7fa8781057f0 2023-07-14T12:59:31.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.980+0000 7fa87fbff700 1 -- 172.21.15.17:0/1618184614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87819ff80 con 0x7fa8781057f0 2023-07-14T12:59:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.981+0000 7fa87fbff700 1 -- 172.21.15.17:0/1618184614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8780fbb40 con 0x7fa8781057f0 2023-07-14T12:59:31.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.983+0000 7fa86effd700 1 -- 172.21.15.17:0/1618184614 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa87000cd80 con 0x7fa8781057f0 2023-07-14T12:59:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.985+0000 7fa86effd700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa8640a1220 0x7fa8640a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.986+0000 7fa86effd700 1 -- 172.21.15.17:0/1618184614 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa8700cc330 con 0x7fa8781057f0 2023-07-14T12:59:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.986+0000 7fa87d99b700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa8640a1220 0x7fa8640a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.986+0000 7fa87d99b700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa8640a1220 0x7fa8640a36d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa874006010 tx=0x7fa87400b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:30.989+0000 7fa86effd700 1 -- 172.21.15.17:0/1618184614 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa870095ae0 con 0x7fa8781057f0 2023-07-14T12:59:31.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:30 smithi017 ceph-mon[95536]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:59:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.207+0000 7fa87fbff700 1 -- 172.21.15.17:0/1618184614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa87802c850 con 0x7fa8781057f0 2023-07-14T12:59:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.208+0000 7fa86effd700 1 -- 172.21.15.17:0/1618184614 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22469 (secure 0 0 0) 0x7fa870099100 con 0x7fa8781057f0 2023-07-14T12:59:31.239 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:31.239 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":88,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:58:07.945460+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:59:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 -- 172.21.15.17:0/1618184614 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa8640a1220 msgr2=0x7fa8640a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa8640a1220 0x7fa8640a36d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa874006010 tx=0x7fa87400b260 comp rx=0 tx=0).stop 2023-07-14T12:59:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 -- 172.21.15.17:0/1618184614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8781057f0 msgr2=0x7fa8780feaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8781057f0 0x7fa8780feaa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa87000ef30 tx=0x7fa87000c3a0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 -- 172.21.15.17:0/1618184614 shutdown_connections 2023-07-14T12:59:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa8640a1220 0x7fa8640a36d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8781057f0 0x7fa8780feaa0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8781005b0 0x7fa8780fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 --2- 172.21.15.17:0/1618184614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa878102ed0 0x7fa8780fe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 -- 172.21.15.17:0/1618184614 >> 172.21.15.17:0/1618184614 conn(0x7fa8780f9fd0 msgr2=0x7fa878101210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 -- 172.21.15.17:0/1618184614 shutdown_connections 2023-07-14T12:59:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.211+0000 7fa87fbff700 1 -- 172.21.15.17:0/1618184614 wait complete. 2023-07-14T12:59:31.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:30 smithi131 ceph-mon[96953]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:59:31.259 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:57:37.876360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:57:39.117456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T12:59:31.260 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T12:59:31.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:30 smithi135 ceph-mon[97338]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:59:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.436+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3251754140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd64072f70 msgr2=0x7fdd640733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.436+0000 7fdd6b9ff700 1 --2- 172.21.15.17:0/3251754140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd64072f70 0x7fdd640733e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009990 tx=0x7fdd54009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.436+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3251754140 shutdown_connections 2023-07-14T12:59:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.436+0000 7fdd6b9ff700 1 --2- 172.21.15.17:0/3251754140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd641079b0 0x7fdd64109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.436+0000 7fdd6b9ff700 1 --2- 172.21.15.17:0/3251754140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd64074550 0x7fdd640729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.436+0000 7fdd6b9ff700 1 --2- 172.21.15.17:0/3251754140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd64072f70 0x7fdd640733e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.436+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3251754140 >> 172.21.15.17:0/3251754140 conn(0x7fdd640fb130 msgr2=0x7fdd640fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.437+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3251754140 shutdown_connections 2023-07-14T12:59:31.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.437+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3251754140 wait complete. 2023-07-14T12:59:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd6b9ff700 1 Processor -- start 2023-07-14T12:59:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd6b9ff700 1 -- start start 2023-07-14T12:59:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd6b9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd64072f70 0x7fdd64197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd6b9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd64074550 0x7fdd64197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd6b9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd641079b0 0x7fdd6419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd6b9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6419f4b0 con 0x7fdd641079b0 2023-07-14T12:59:31.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd6b9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6419f5f0 con 0x7fdd64074550 2023-07-14T12:59:31.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd6b9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6419f780 con 0x7fdd64072f70 2023-07-14T12:59:31.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd69f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd641079b0 0x7fdd6419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd69f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd641079b0 0x7fdd6419eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51922/0 (socket says 172.21.15.17:51922) 2023-07-14T12:59:31.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd69f9c700 1 -- 172.21.15.17:0/3406916932 learned_addr learned my addr 172.21.15.17:0/3406916932 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd68f9a700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd64074550 0x7fdd64197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.438+0000 7fdd6979b700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd64072f70 0x7fdd64197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.439+0000 7fdd69f9c700 1 -- 172.21.15.17:0/3406916932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd64072f70 msgr2=0x7fdd64197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.439+0000 7fdd69f9c700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd64072f70 0x7fdd64197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.439+0000 7fdd69f9c700 1 -- 172.21.15.17:0/3406916932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd64074550 msgr2=0x7fdd64197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.439+0000 7fdd69f9c700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd64074550 0x7fdd64197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.439+0000 7fdd69f9c700 1 -- 172.21.15.17:0/3406916932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540095f0 con 0x7fdd641079b0 2023-07-14T12:59:31.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.439+0000 7fdd69f9c700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd641079b0 0x7fdd6419eee0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c007ee0 tx=0x7fdd5c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:31.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.439+0000 7fdd5a7fc700 1 -- 172.21.15.17:0/3406916932 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c017070 con 0x7fdd641079b0 2023-07-14T12:59:31.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.439+0000 7fdd5a7fc700 1 -- 172.21.15.17:0/3406916932 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd5c00f040 con 0x7fdd641079b0 2023-07-14T12:59:31.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.439+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3406916932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6419fa60 con 0x7fdd641079b0 2023-07-14T12:59:31.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.439+0000 7fdd5a7fc700 1 -- 172.21.15.17:0/3406916932 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c005570 con 0x7fdd641079b0 2023-07-14T12:59:31.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.439+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3406916932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6419ff70 con 0x7fdd641079b0 2023-07-14T12:59:31.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.440+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3406916932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd64106060 con 0x7fdd641079b0 2023-07-14T12:59:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.442+0000 7fdd5a7fc700 1 -- 172.21.15.17:0/3406916932 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fdd5c00db20 con 0x7fdd641079b0 2023-07-14T12:59:31.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.445+0000 7fdd5a7fc700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdd500a1150 0x7fdd500a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.445+0000 7fdd5a7fc700 1 -- 172.21.15.17:0/3406916932 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fdd5c0cc010 con 0x7fdd641079b0 2023-07-14T12:59:31.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.445+0000 7fdd6979b700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdd500a1150 0x7fdd500a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.446+0000 7fdd6979b700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdd500a1150 0x7fdd500a3600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdd64074920 tx=0x7fdd6000a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.449+0000 7fdd5a7fc700 1 -- 172.21.15.17:0/3406916932 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fdd5c095790 con 0x7fdd641079b0 2023-07-14T12:59:31.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.656+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3406916932 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd640611c0 con 0x7fdd641079b0 2023-07-14T12:59:31.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.656+0000 7fdd5a7fc700 1 -- 172.21.15.17:0/3406916932 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd5c098db0 con 0x7fdd641079b0 2023-07-14T12:59:31.686 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T12:59:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3406916932 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdd500a1150 msgr2=0x7fdd500a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdd500a1150 0x7fdd500a3600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdd64074920 tx=0x7fdd6000a380 comp rx=0 tx=0).stop 2023-07-14T12:59:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3406916932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd641079b0 msgr2=0x7fdd6419eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd641079b0 0x7fdd6419eee0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c007ee0 tx=0x7fdd5c00d3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3406916932 shutdown_connections 2023-07-14T12:59:31.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fdd500a1150 0x7fdd500a3600 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd641079b0 0x7fdd6419eee0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd64072f70 0x7fdd64197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 --2- 172.21.15.17:0/3406916932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd64074550 0x7fdd64197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3406916932 >> 172.21.15.17:0/3406916932 conn(0x7fdd640fb130 msgr2=0x7fdd640fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3406916932 shutdown_connections 2023-07-14T12:59:31.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.659+0000 7fdd6b9ff700 1 -- 172.21.15.17:0/3406916932 wait complete. 2023-07-14T12:59:31.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T12:59:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.883+0000 7f8b0edff700 1 -- 172.21.15.17:0/3427758636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b08100cd0 msgr2=0x7f8b08101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.883+0000 7f8b0edff700 1 --2- 172.21.15.17:0/3427758636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b08100cd0 0x7f8b08101120 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8af4009990 tx=0x7f8af4009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.884+0000 7f8b0edff700 1 -- 172.21.15.17:0/3427758636 shutdown_connections 2023-07-14T12:59:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.884+0000 7f8b0edff700 1 --2- 172.21.15.17:0/3427758636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b08101660 0x7f8b08107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.884+0000 7f8b0edff700 1 --2- 172.21.15.17:0/3427758636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b080ffae0 0x7f8b080ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.884+0000 7f8b0edff700 1 --2- 172.21.15.17:0/3427758636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b08100cd0 0x7f8b08101120 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.884+0000 7f8b0edff700 1 -- 172.21.15.17:0/3427758636 >> 172.21.15.17:0/3427758636 conn(0x7f8b080fb0e0 msgr2=0x7f8b080fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:31.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.884+0000 7f8b0edff700 1 -- 172.21.15.17:0/3427758636 shutdown_connections 2023-07-14T12:59:31.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.884+0000 7f8b0edff700 1 -- 172.21.15.17:0/3427758636 wait complete. 2023-07-14T12:59:31.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.885+0000 7f8b0edff700 1 Processor -- start 2023-07-14T12:59:31.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.885+0000 7f8b0edff700 1 -- start start 2023-07-14T12:59:31.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.885+0000 7f8b0edff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b080ffae0 0x7f8b081957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.885+0000 7f8b0edff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b08100cd0 0x7f8b08195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.885+0000 7f8b0edff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b08101660 0x7f8b0819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.885+0000 7f8b0edff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0819d310 con 0x7f8b08100cd0 2023-07-14T12:59:31.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.885+0000 7f8b0edff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0819d450 con 0x7f8b08101660 2023-07-14T12:59:31.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.885+0000 7f8b0edff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0819d5e0 con 0x7f8b080ffae0 2023-07-14T12:59:31.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.886+0000 7f8b07fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b08100cd0 0x7f8b08195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.886+0000 7f8b07fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b08100cd0 0x7f8b08195d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51932/0 (socket says 172.21.15.17:51932) 2023-07-14T12:59:31.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.886+0000 7f8b07fff700 1 -- 172.21.15.17:0/2684202256 learned_addr learned my addr 172.21.15.17:0/2684202256 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:31.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.886+0000 7f8b0cb9b700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b080ffae0 0x7f8b081957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.886+0000 7f8b0d39c700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b08101660 0x7f8b0819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.886+0000 7f8b07fff700 1 -- 172.21.15.17:0/2684202256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b080ffae0 msgr2=0x7f8b081957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.886+0000 7f8b07fff700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b080ffae0 0x7f8b081957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.886+0000 7f8b07fff700 1 -- 172.21.15.17:0/2684202256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b08101660 msgr2=0x7f8b0819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:31.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.886+0000 7f8b07fff700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b08101660 0x7f8b0819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:31.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.886+0000 7f8b07fff700 1 -- 172.21.15.17:0/2684202256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af40095f0 con 0x7f8b08100cd0 2023-07-14T12:59:31.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.886+0000 7f8b07fff700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b08100cd0 0x7f8b08195d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8af4005910 tx=0x7f8af4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:31.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.887+0000 7f8b05ffb700 1 -- 172.21.15.17:0/2684202256 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af401d070 con 0x7f8b08100cd0 2023-07-14T12:59:31.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.887+0000 7f8b0edff700 1 -- 172.21.15.17:0/2684202256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0819d860 con 0x7f8b08100cd0 2023-07-14T12:59:31.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.887+0000 7f8b05ffb700 1 -- 172.21.15.17:0/2684202256 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8af400be10 con 0x7f8b08100cd0 2023-07-14T12:59:31.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.887+0000 7f8b05ffb700 1 -- 172.21.15.17:0/2684202256 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af4022e30 con 0x7f8b08100cd0 2023-07-14T12:59:31.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.887+0000 7f8b0edff700 1 -- 172.21.15.17:0/2684202256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0819dc90 con 0x7f8b08100cd0 2023-07-14T12:59:31.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.888+0000 7f8b0edff700 1 -- 172.21.15.17:0/2684202256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b081071a0 con 0x7f8b08100cd0 2023-07-14T12:59:31.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.890+0000 7f8b05ffb700 1 -- 172.21.15.17:0/2684202256 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f8af4022600 con 0x7f8b08100cd0 2023-07-14T12:59:31.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.891+0000 7f8b05ffb700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8af80a1150 0x7f8af80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:31.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.891+0000 7f8b05ffb700 1 -- 172.21.15.17:0/2684202256 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f8af40ce520 con 0x7f8b08100cd0 2023-07-14T12:59:31.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.891+0000 7f8b0cb9b700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8af80a1150 0x7f8af80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:31.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.892+0000 7f8b0cb9b700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8af80a1150 0x7f8af80a3600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8b08100b30 tx=0x7f8afc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:31.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:31.893+0000 7f8b05ffb700 1 -- 172.21.15.17:0/2684202256 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f8af4097cd0 con 0x7f8b08100cd0 2023-07-14T12:59:32.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.103+0000 7f8b0edff700 1 -- 172.21.15.17:0/2684202256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b0802c9e0 con 0x7f8b08100cd0 2023-07-14T12:59:32.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.103+0000 7f8b05ffb700 1 -- 172.21.15.17:0/2684202256 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8af409b2f0 con 0x7f8b08100cd0 2023-07-14T12:59:32.134 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-07-14T12:59:32.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 -- 172.21.15.17:0/2684202256 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8af80a1150 msgr2=0x7f8af80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:32.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8af80a1150 0x7f8af80a3600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8b08100b30 tx=0x7f8afc009260 comp rx=0 tx=0).stop 2023-07-14T12:59:32.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 -- 172.21.15.17:0/2684202256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b08100cd0 msgr2=0x7f8b08195d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b08100cd0 0x7f8b08195d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8af4005910 tx=0x7f8af4005740 comp rx=0 tx=0).stop 2023-07-14T12:59:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 -- 172.21.15.17:0/2684202256 shutdown_connections 2023-07-14T12:59:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f8af80a1150 0x7f8af80a3600 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b08101660 0x7f8b0819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b080ffae0 0x7f8b081957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 --2- 172.21.15.17:0/2684202256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b08100cd0 0x7f8b08195d20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 -- 172.21.15.17:0/2684202256 >> 172.21.15.17:0/2684202256 conn(0x7f8b080fb0e0 msgr2=0x7f8b081042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:32.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 -- 172.21.15.17:0/2684202256 shutdown_connections 2023-07-14T12:59:32.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.106+0000 7f8b0edff700 1 -- 172.21.15.17:0/2684202256 wait complete. 2023-07-14T12:59:32.155 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T12:59:32.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:31 smithi131 ceph-mon[96953]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:59:32.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:31 smithi131 ceph-mon[96953]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:59:32.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:31 smithi131 ceph-mon[96953]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1023 B/s wr, 7 op/s 2023-07-14T12:59:32.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:31 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1618184614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:32.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:31 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3406916932' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:32.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:31 smithi017 ceph-mon[95536]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:59:32.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:31 smithi017 ceph-mon[95536]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:59:32.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:31 smithi017 ceph-mon[95536]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1023 B/s wr, 7 op/s 2023-07-14T12:59:32.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:31 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1618184614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:32.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:31 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3406916932' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:32.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.334+0000 7f30f9fff700 1 -- 172.21.15.17:0/3585801285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f40ffae0 msgr2=0x7f30f40ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:32.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.334+0000 7f30f9fff700 1 --2- 172.21.15.17:0/3585801285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f40ffae0 0x7f30f40ffef0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009990 tx=0x7f30e4009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.334+0000 7f30f9fff700 1 -- 172.21.15.17:0/3585801285 shutdown_connections 2023-07-14T12:59:32.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.334+0000 7f30f9fff700 1 --2- 172.21.15.17:0/3585801285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30f4101660 0x7f30f4107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.334+0000 7f30f9fff700 1 --2- 172.21.15.17:0/3585801285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f40ffae0 0x7f30f40ffef0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.334+0000 7f30f9fff700 1 --2- 172.21.15.17:0/3585801285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f4100cd0 0x7f30f4101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.334+0000 7f30f9fff700 1 -- 172.21.15.17:0/3585801285 >> 172.21.15.17:0/3585801285 conn(0x7f30f40fb0e0 msgr2=0x7f30f40fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:32.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.334+0000 7f30f9fff700 1 -- 172.21.15.17:0/3585801285 shutdown_connections 2023-07-14T12:59:32.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.334+0000 7f30f9fff700 1 -- 172.21.15.17:0/3585801285 wait complete. 2023-07-14T12:59:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.335+0000 7f30f9fff700 1 Processor -- start 2023-07-14T12:59:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.335+0000 7f30f9fff700 1 -- start start 2023-07-14T12:59:32.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f9fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f40ffae0 0x7f30f40742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f9fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f4100cd0 0x7f30f4072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f9fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30f4101660 0x7f30f4072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f9fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40735e0 con 0x7f30f40ffae0 2023-07-14T12:59:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f9fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f4073750 con 0x7f30f4100cd0 2023-07-14T12:59:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f9fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f419f840 con 0x7f30f4101660 2023-07-14T12:59:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f40ffae0 0x7f30f40742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:32.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f40ffae0 0x7f30f40742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51948/0 (socket says 172.21.15.17:51948) 2023-07-14T12:59:32.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f37fe700 1 -- 172.21.15.17:0/1554211119 learned_addr learned my addr 172.21.15.17:0/1554211119 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:32.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f3fff700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30f4101660 0x7f30f4072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:32.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f2ffd700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f4100cd0 0x7f30f4072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:32.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f37fe700 1 -- 172.21.15.17:0/1554211119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30f4101660 msgr2=0x7f30f4072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:32.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f37fe700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30f4101660 0x7f30f4072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f37fe700 1 -- 172.21.15.17:0/1554211119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f4100cd0 msgr2=0x7f30f4072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:32.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.336+0000 7f30f37fe700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f4100cd0 0x7f30f4072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.337+0000 7f30f37fe700 1 -- 172.21.15.17:0/1554211119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e40095f0 con 0x7f30f40ffae0 2023-07-14T12:59:32.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.337+0000 7f30f2ffd700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f4100cd0 0x7f30f4072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:32.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.337+0000 7f30f37fe700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f40ffae0 0x7f30f40742c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f30e4005910 tx=0x7f30e4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:32.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.337+0000 7f30f0ff9700 1 -- 172.21.15.17:0/1554211119 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e401d070 con 0x7f30f40ffae0 2023-07-14T12:59:32.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.337+0000 7f30f0ff9700 1 -- 172.21.15.17:0/1554211119 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30e400bed0 con 0x7f30f40ffae0 2023-07-14T12:59:32.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.337+0000 7f30f9fff700 1 -- 172.21.15.17:0/1554211119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f419fac0 con 0x7f30f40ffae0 2023-07-14T12:59:32.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.337+0000 7f30f0ff9700 1 -- 172.21.15.17:0/1554211119 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4022e00 con 0x7f30f40ffae0 2023-07-14T12:59:32.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.337+0000 7f30f9fff700 1 -- 172.21.15.17:0/1554211119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f419ff40 con 0x7f30f40ffae0 2023-07-14T12:59:32.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.338+0000 7f30f9fff700 1 -- 172.21.15.17:0/1554211119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f41071a0 con 0x7f30f40ffae0 2023-07-14T12:59:32.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.340+0000 7f30f0ff9700 1 -- 172.21.15.17:0/1554211119 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f30e4022600 con 0x7f30f40ffae0 2023-07-14T12:59:32.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.342+0000 7f30f0ff9700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30dc0a11d0 0x7f30dc0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:32.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.342+0000 7f30f0ff9700 1 -- 172.21.15.17:0/1554211119 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f30e40cde30 con 0x7f30f40ffae0 2023-07-14T12:59:32.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.342+0000 7f30f2ffd700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30dc0a11d0 0x7f30dc0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:32.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.343+0000 7f30f2ffd700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30dc0a11d0 0x7f30dc0a3680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009cb0 tx=0x7f30e8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:32.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.345+0000 7f30f0ff9700 1 -- 172.21.15.17:0/1554211119 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f30e40975e0 con 0x7f30f40ffae0 2023-07-14T12:59:32.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:31 smithi135 ceph-mon[97338]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:59:32.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:31 smithi135 ceph-mon[97338]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T12:59:32.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:31 smithi135 ceph-mon[97338]: pgmap v360: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1023 B/s wr, 7 op/s 2023-07-14T12:59:32.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:31 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1618184614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:32.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:31 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3406916932' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T12:59:32.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.556+0000 7f30f9fff700 1 -- 172.21.15.17:0/1554211119 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30f4061120 con 0x7f30f40ffae0 2023-07-14T12:59:32.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.557+0000 7f30f0ff9700 1 -- 172.21.15.17:0/1554211119 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30e409ac00 con 0x7f30f40ffae0 2023-07-14T12:59:32.587 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-07-14T12:59:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.559+0000 7f30f9fff700 1 -- 172.21.15.17:0/1554211119 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30dc0a11d0 msgr2=0x7f30dc0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:32.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.559+0000 7f30f9fff700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30dc0a11d0 0x7f30dc0a3680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009cb0 tx=0x7f30e8009260 comp rx=0 tx=0).stop 2023-07-14T12:59:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.559+0000 7f30f9fff700 1 -- 172.21.15.17:0/1554211119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f40ffae0 msgr2=0x7f30f40742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.559+0000 7f30f9fff700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f40ffae0 0x7f30f40742c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f30e4005910 tx=0x7f30e4005740 comp rx=0 tx=0).stop 2023-07-14T12:59:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.559+0000 7f30f9fff700 1 -- 172.21.15.17:0/1554211119 shutdown_connections 2023-07-14T12:59:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.559+0000 7f30f9fff700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f30dc0a11d0 0x7f30dc0a3680 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.559+0000 7f30f9fff700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30f4101660 0x7f30f4072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.559+0000 7f30f9fff700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30f40ffae0 0x7f30f40742c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.559+0000 7f30f9fff700 1 --2- 172.21.15.17:0/1554211119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f4100cd0 0x7f30f4072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.559+0000 7f30f9fff700 1 -- 172.21.15.17:0/1554211119 >> 172.21.15.17:0/1554211119 conn(0x7f30f40fb0e0 msgr2=0x7f30f41042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.560+0000 7f30f9fff700 1 -- 172.21.15.17:0/1554211119 shutdown_connections 2023-07-14T12:59:32.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.560+0000 7f30f9fff700 1 -- 172.21.15.17:0/1554211119 wait complete. 2023-07-14T12:59:32.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:59:32.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.782+0000 7f0e81bff700 1 -- 172.21.15.17:0/430931712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c0744f0 msgr2=0x7f0e7c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:32.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.782+0000 7f0e81bff700 1 --2- 172.21.15.17:0/430931712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c0744f0 0x7f0e7c072940 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009990 tx=0x7f0e6c009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.782+0000 7f0e81bff700 1 -- 172.21.15.17:0/430931712 shutdown_connections 2023-07-14T12:59:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.782+0000 7f0e81bff700 1 --2- 172.21.15.17:0/430931712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e7c1079a0 0x7f0e7c109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.782+0000 7f0e81bff700 1 --2- 172.21.15.17:0/430931712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c0744f0 0x7f0e7c072940 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.782+0000 7f0e81bff700 1 --2- 172.21.15.17:0/430931712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c072f10 0x7f0e7c073380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.782+0000 7f0e81bff700 1 -- 172.21.15.17:0/430931712 >> 172.21.15.17:0/430931712 conn(0x7f0e7c0fb130 msgr2=0x7f0e7c0fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.782+0000 7f0e81bff700 1 -- 172.21.15.17:0/430931712 shutdown_connections 2023-07-14T12:59:32.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.782+0000 7f0e81bff700 1 -- 172.21.15.17:0/430931712 wait complete. 2023-07-14T12:59:32.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.783+0000 7f0e81bff700 1 Processor -- start 2023-07-14T12:59:32.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.783+0000 7f0e81bff700 1 -- start start 2023-07-14T12:59:32.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e81bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e7c072f10 0x7f0e7c197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:32.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e81bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c0744f0 0x7f0e7c197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:32.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e81bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c1079a0 0x7f0e7c19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:32.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e81bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c19f3c0 con 0x7f0e7c0744f0 2023-07-14T12:59:32.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e81bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c19f500 con 0x7f0e7c1079a0 2023-07-14T12:59:32.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e81bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c19f690 con 0x7f0e7c072f10 2023-07-14T12:59:32.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e7affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c0744f0 0x7f0e7c197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:32.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e7affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c0744f0 0x7f0e7c197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51974/0 (socket says 172.21.15.17:51974) 2023-07-14T12:59:32.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e7affd700 1 -- 172.21.15.17:0/2720750285 learned_addr learned my addr 172.21.15.17:0/2720750285 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:32.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e7b7fe700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e7c072f10 0x7f0e7c197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:32.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e7bfff700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c1079a0 0x7f0e7c19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:32.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e7affd700 1 -- 172.21.15.17:0/2720750285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e7c072f10 msgr2=0x7f0e7c197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:32.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e7affd700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e7c072f10 0x7f0e7c197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e7affd700 1 -- 172.21.15.17:0/2720750285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c1079a0 msgr2=0x7f0e7c19edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:32.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e7affd700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c1079a0 0x7f0e7c19edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.784+0000 7f0e7affd700 1 -- 172.21.15.17:0/2720750285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c0095f0 con 0x7f0e7c0744f0 2023-07-14T12:59:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.785+0000 7f0e7affd700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c0744f0 0x7f0e7c197d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c9b0 tx=0x7f0e7000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.785+0000 7f0e78ff9700 1 -- 172.21.15.17:0/2720750285 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70007b00 con 0x7f0e7c0744f0 2023-07-14T12:59:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.785+0000 7f0e78ff9700 1 -- 172.21.15.17:0/2720750285 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e70007c60 con 0x7f0e7c0744f0 2023-07-14T12:59:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.785+0000 7f0e78ff9700 1 -- 172.21.15.17:0/2720750285 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70018660 con 0x7f0e7c0744f0 2023-07-14T12:59:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.785+0000 7f0e81bff700 1 -- 172.21.15.17:0/2720750285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c19f970 con 0x7f0e7c0744f0 2023-07-14T12:59:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.785+0000 7f0e81bff700 1 -- 172.21.15.17:0/2720750285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c19fe30 con 0x7f0e7c0744f0 2023-07-14T12:59:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.786+0000 7f0e81bff700 1 -- 172.21.15.17:0/2720750285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c1067f0 con 0x7f0e7c0744f0 2023-07-14T12:59:32.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.788+0000 7f0e78ff9700 1 -- 172.21.15.17:0/2720750285 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f0e7000f450 con 0x7f0e7c0744f0 2023-07-14T12:59:32.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.790+0000 7f0e78ff9700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0e640a1220 0x7f0e640a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:32.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.790+0000 7f0e78ff9700 1 -- 172.21.15.17:0/2720750285 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f0e700cc8c0 con 0x7f0e7c0744f0 2023-07-14T12:59:32.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.790+0000 7f0e7b7fe700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0e640a1220 0x7f0e640a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:32.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.791+0000 7f0e7b7fe700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0e640a1220 0x7f0e640a36d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00b5c0 tx=0x7f0e6c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:32.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:32.793+0000 7f0e78ff9700 1 -- 172.21.15.17:0/2720750285 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0e70095fe0 con 0x7f0e7c0744f0 2023-07-14T12:59:33.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.045+0000 7f0e81bff700 1 -- 172.21.15.17:0/2720750285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e7c02c850 con 0x7f0e7c0744f0 2023-07-14T12:59:33.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.046+0000 7f0e78ff9700 1 -- 172.21.15.17:0/2720750285 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10845 (secure 0 0 0) 0x7f0e7000fe60 con 0x7f0e7c0744f0 2023-07-14T12:59:33.076 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:33.076 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T12:57:45.208579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:59:33.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.048+0000 7f0e81bff700 1 -- 172.21.15.17:0/2720750285 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0e640a1220 msgr2=0x7f0e640a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.048+0000 7f0e81bff700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0e640a1220 0x7f0e640a36d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c00b5c0 tx=0x7f0e6c005fb0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.048+0000 7f0e81bff700 1 -- 172.21.15.17:0/2720750285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c0744f0 msgr2=0x7f0e7c197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.048+0000 7f0e81bff700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c0744f0 0x7f0e7c197d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c9b0 tx=0x7f0e7000ccc0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.048+0000 7f0e81bff700 1 -- 172.21.15.17:0/2720750285 shutdown_connections 2023-07-14T12:59:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.048+0000 7f0e81bff700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f0e640a1220 0x7f0e640a36d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.048+0000 7f0e81bff700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e7c1079a0 0x7f0e7c19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.048+0000 7f0e81bff700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e7c072f10 0x7f0e7c197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.048+0000 7f0e81bff700 1 --2- 172.21.15.17:0/2720750285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e7c0744f0 0x7f0e7c197d80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.048+0000 7f0e81bff700 1 -- 172.21.15.17:0/2720750285 >> 172.21.15.17:0/2720750285 conn(0x7f0e7c0fb130 msgr2=0x7f0e7c103930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.049+0000 7f0e81bff700 1 -- 172.21.15.17:0/2720750285 shutdown_connections 2023-07-14T12:59:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.049+0000 7f0e81bff700 1 -- 172.21.15.17:0/2720750285 wait complete. 2023-07-14T12:59:33.080 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2023-07-14T12:59:33.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T12:59:33.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:32 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2684202256' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:33.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:32 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1554211119' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:33.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.271+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2138190979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cbc0ffb00 msgr2=0x7f1cbc0fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.271+0000 7f1cc1fff700 1 --2- 172.21.15.17:0/2138190979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cbc0ffb00 0x7f1cbc0fff10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0098f0 tx=0x7f1cac009c00 comp rx=0 tx=0).stop 2023-07-14T12:59:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.271+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2138190979 shutdown_connections 2023-07-14T12:59:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.271+0000 7f1cc1fff700 1 --2- 172.21.15.17:0/2138190979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cbc101680 0x7f1cbc107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.271+0000 7f1cc1fff700 1 --2- 172.21.15.17:0/2138190979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cbc0ffb00 0x7f1cbc0fff10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.271+0000 7f1cc1fff700 1 --2- 172.21.15.17:0/2138190979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cbc100cf0 0x7f1cbc101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.271+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2138190979 >> 172.21.15.17:0/2138190979 conn(0x7f1cbc0fb0e0 msgr2=0x7f1cbc0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:33.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.271+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2138190979 shutdown_connections 2023-07-14T12:59:33.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.271+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2138190979 wait complete. 2023-07-14T12:59:33.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.272+0000 7f1cc1fff700 1 Processor -- start 2023-07-14T12:59:33.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.272+0000 7f1cc1fff700 1 -- start start 2023-07-14T12:59:33.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.272+0000 7f1cc1fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cbc0ffb00 0x7f1cbc1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.272+0000 7f1cc1fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cbc100cf0 0x7f1cbc197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.272+0000 7f1cc1fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cbc101680 0x7f1cbc19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.272+0000 7f1cc1fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc19f540 con 0x7f1cbc101680 2023-07-14T12:59:33.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.272+0000 7f1cc1fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc19f680 con 0x7f1cbc100cf0 2023-07-14T12:59:33.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.272+0000 7f1cc1fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc19f810 con 0x7f1cbc0ffb00 2023-07-14T12:59:33.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cbbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cbc101680 0x7f1cbc19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cbbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cbc101680 0x7f1cbc19ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51990/0 (socket says 172.21.15.17:51990) 2023-07-14T12:59:33.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cbbfff700 1 -- 172.21.15.17:0/2245742415 learned_addr learned my addr 172.21.15.17:0/2245742415 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:33.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cbb7fe700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cbc0ffb00 0x7f1cbc1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cbaffd700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cbc100cf0 0x7f1cbc197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cbbfff700 1 -- 172.21.15.17:0/2245742415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cbc0ffb00 msgr2=0x7f1cbc1979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cbbfff700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cbc0ffb00 0x7f1cbc1979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cbbfff700 1 -- 172.21.15.17:0/2245742415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cbc100cf0 msgr2=0x7f1cbc197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cbbfff700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cbc100cf0 0x7f1cbc197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cbbfff700 1 -- 172.21.15.17:0/2245742415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb4009d00 con 0x7f1cbc101680 2023-07-14T12:59:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cbbfff700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cbc101680 0x7f1cbc19ef70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400e3c0 tx=0x7f1cb400e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.273+0000 7f1cb8ff9700 1 -- 172.21.15.17:0/2245742415 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40092d0 con 0x7f1cbc101680 2023-07-14T12:59:33.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.274+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2245742415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac009520 con 0x7f1cbc101680 2023-07-14T12:59:33.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.274+0000 7f1cb8ff9700 1 -- 172.21.15.17:0/2245742415 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cb400f040 con 0x7f1cbc101680 2023-07-14T12:59:33.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.274+0000 7f1cb8ff9700 1 -- 172.21.15.17:0/2245742415 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4007bf0 con 0x7f1cbc101680 2023-07-14T12:59:33.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.274+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2245742415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc19fe70 con 0x7f1cbc101680 2023-07-14T12:59:33.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.275+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2245742415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cbc192030 con 0x7f1cbc101680 2023-07-14T12:59:33.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.277+0000 7f1cb8ff9700 1 -- 172.21.15.17:0/2245742415 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f1cb4007d50 con 0x7f1cbc101680 2023-07-14T12:59:33.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.278+0000 7f1cb8ff9700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1ca40a11a0 0x7f1ca40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.278+0000 7f1cb8ff9700 1 -- 172.21.15.17:0/2245742415 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f1cb40cc7c0 con 0x7f1cbc101680 2023-07-14T12:59:33.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.278+0000 7f1cbb7fe700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1ca40a11a0 0x7f1ca40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.279+0000 7f1cbb7fe700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1ca40a11a0 0x7f1ca40a3650 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009fd0 tx=0x7f1cac019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:33.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.282+0000 7f1cb8ff9700 1 -- 172.21.15.17:0/2245742415 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1cb4095f70 con 0x7f1cbc101680 2023-07-14T12:59:33.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:32 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2684202256' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:33.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:32 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1554211119' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:33.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:32 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2684202256' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T12:59:33.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:32 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1554211119' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T12:59:33.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.492+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2245742415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cbc02c850 con 0x7f1cbc101680 2023-07-14T12:59:33.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.493+0000 7f1cb8ff9700 1 -- 172.21.15.17:0/2245742415 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22469 (secure 0 0 0) 0x7f1cb4099590 con 0x7f1cbc101680 2023-07-14T12:59:33.524 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:33.524 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":88,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T12:58:07.945460+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T12:59:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2245742415 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1ca40a11a0 msgr2=0x7f1ca40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1ca40a11a0 0x7f1ca40a3650 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009fd0 tx=0x7f1cac019040 comp rx=0 tx=0).stop 2023-07-14T12:59:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2245742415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cbc101680 msgr2=0x7f1cbc19ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cbc101680 0x7f1cbc19ef70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400e3c0 tx=0x7f1cb400e6d0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2245742415 shutdown_connections 2023-07-14T12:59:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f1ca40a11a0 0x7f1ca40a3650 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1cbc101680 0x7f1cbc19ef70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1cbc0ffb00 0x7f1cbc1979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 --2- 172.21.15.17:0/2245742415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1cbc100cf0 0x7f1cbc197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2245742415 >> 172.21.15.17:0/2245742415 conn(0x7f1cbc0fb0e0 msgr2=0x7f1cbc1066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2245742415 shutdown_connections 2023-07-14T12:59:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.496+0000 7f1cc1fff700 1 -- 172.21.15.17:0/2245742415 wait complete. 2023-07-14T12:59:33.545 DEBUG:tasks.fwd_scrub:Yielding 2023-07-14T12:59:33.546 INFO:teuthology.run_tasks:Running task exec... 2023-07-14T12:59:33.558 INFO:teuthology.task.exec:Executing custom commands... 2023-07-14T12:59:33.558 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2023-07-14T12:59:33.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-07-14T12:59:33.559 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-07-14T12:59:33.559 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T12:59:33.559 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T12:59:33.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.732+0000 7fe67cfff700 1 -- 172.21.15.17:0/3305787722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe678074550 msgr2=0x7fe6780729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.732+0000 7fe67cfff700 1 --2- 172.21.15.17:0/3305787722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe678074550 0x7fe6780729a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe668009990 tx=0x7fe668009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.732+0000 7fe67cfff700 1 -- 172.21.15.17:0/3305787722 shutdown_connections 2023-07-14T12:59:33.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.732+0000 7fe67cfff700 1 --2- 172.21.15.17:0/3305787722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67810c0d0 0x7fe67810e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.733+0000 7fe67cfff700 1 --2- 172.21.15.17:0/3305787722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe678074550 0x7fe6780729a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.733+0000 7fe67cfff700 1 --2- 172.21.15.17:0/3305787722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe678072f70 0x7fe6780733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.733+0000 7fe67cfff700 1 -- 172.21.15.17:0/3305787722 >> 172.21.15.17:0/3305787722 conn(0x7fe6780fb0e0 msgr2=0x7fe6780fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:33.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.733+0000 7fe67cfff700 1 -- 172.21.15.17:0/3305787722 shutdown_connections 2023-07-14T12:59:33.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.733+0000 7fe67cfff700 1 -- 172.21.15.17:0/3305787722 wait complete. 2023-07-14T12:59:33.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.734+0000 7fe67cfff700 1 Processor -- start 2023-07-14T12:59:33.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.734+0000 7fe67cfff700 1 -- start start 2023-07-14T12:59:33.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.734+0000 7fe67cfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe678072f70 0x7fe67819bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.734+0000 7fe67cfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe678074550 0x7fe67819c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.734+0000 7fe67cfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe67810c0d0 0x7fe67819d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.734+0000 7fe67cfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67819d910 con 0x7fe678072f70 2023-07-14T12:59:33.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.734+0000 7fe67cfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67819da80 con 0x7fe67810c0d0 2023-07-14T12:59:33.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.734+0000 7fe67cfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67819dc40 con 0x7fe678074550 2023-07-14T12:59:33.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe67659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe678072f70 0x7fe67819bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe67659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe678072f70 0x7fe67819bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51994/0 (socket says 172.21.15.17:51994) 2023-07-14T12:59:33.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe67659c700 1 -- 172.21.15.17:0/1504333301 learned_addr learned my addr 172.21.15.17:0/1504333301 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:33.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe675d9b700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe678074550 0x7fe67819c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe676d9d700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe67810c0d0 0x7fe67819d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe67659c700 1 -- 172.21.15.17:0/1504333301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe678074550 msgr2=0x7fe67819c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe67659c700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe678074550 0x7fe67819c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe67659c700 1 -- 172.21.15.17:0/1504333301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe67810c0d0 msgr2=0x7fe67819d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe67659c700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe67810c0d0 0x7fe67819d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe67659c700 1 -- 172.21.15.17:0/1504333301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680095f0 con 0x7fe678072f70 2023-07-14T12:59:33.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe676d9d700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe67810c0d0 0x7fe67819d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:33.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.735+0000 7fe67659c700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe678072f70 0x7fe67819bef0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe6680098e0 tx=0x7fe668004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:33.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.736+0000 7fe6677fe700 1 -- 172.21.15.17:0/1504333301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66801d070 con 0x7fe678072f70 2023-07-14T12:59:33.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.736+0000 7fe67cfff700 1 -- 172.21.15.17:0/1504333301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67819dec0 con 0x7fe678072f70 2023-07-14T12:59:33.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.736+0000 7fe6677fe700 1 -- 172.21.15.17:0/1504333301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe66800be30 con 0x7fe678072f70 2023-07-14T12:59:33.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.736+0000 7fe6677fe700 1 -- 172.21.15.17:0/1504333301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668022df0 con 0x7fe678072f70 2023-07-14T12:59:33.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.736+0000 7fe67cfff700 1 -- 172.21.15.17:0/1504333301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6781a46e0 con 0x7fe678072f70 2023-07-14T12:59:33.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.737+0000 7fe67cfff700 1 -- 172.21.15.17:0/1504333301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe678101c20 con 0x7fe678072f70 2023-07-14T12:59:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.740+0000 7fe6677fe700 1 -- 172.21.15.17:0/1504333301 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fe668022470 con 0x7fe678072f70 2023-07-14T12:59:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.742+0000 7fe6677fe700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6600a1150 0x7fe6600a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.742+0000 7fe6677fe700 1 -- 172.21.15.17:0/1504333301 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fe6680cde80 con 0x7fe678072f70 2023-07-14T12:59:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.742+0000 7fe675d9b700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6600a1150 0x7fe6600a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.743+0000 7fe675d9b700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6600a1150 0x7fe6600a3600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe678074270 tx=0x7fe66c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.746+0000 7fe6677fe700 1 -- 172.21.15.17:0/1504333301 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe668097630 con 0x7fe678072f70 2023-07-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.747+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/1004997450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d08100600 msgr2=0x7f4d081029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.747+0000 7f4d0d9ff700 1 --2- 172.21.15.17:0/1004997450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d08100600 0x7f4d081029e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009990 tx=0x7f4cf8009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.747+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/1004997450 shutdown_connections 2023-07-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.747+0000 7f4d0d9ff700 1 --2- 172.21.15.17:0/1004997450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d08105840 0x7f4d08107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.747+0000 7f4d0d9ff700 1 --2- 172.21.15.17:0/1004997450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d08100600 0x7f4d081029e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.747+0000 7f4d0d9ff700 1 --2- 172.21.15.17:0/1004997450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d08102f20 0x7f4d08105300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.747+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/1004997450 >> 172.21.15.17:0/1004997450 conn(0x7f4d080fa000 msgr2=0x7f4d080fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:33.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.747+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/1004997450 shutdown_connections 2023-07-14T12:59:33.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.747+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/1004997450 wait complete. 2023-07-14T12:59:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.748+0000 7f4d0d9ff700 1 Processor -- start 2023-07-14T12:59:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.748+0000 7f4d0d9ff700 1 -- start start 2023-07-14T12:59:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.748+0000 7f4d0d9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d08100600 0x7f4d080fff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.748+0000 7f4d0d9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d08102f20 0x7f4d080fe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.748+0000 7f4d0d9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d08105840 0x7f4d080feaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.748+0000 7f4d0d9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080ff290 con 0x7f4d08105840 2023-07-14T12:59:33.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.748+0000 7f4d0d9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080ff400 con 0x7f4d08100600 2023-07-14T12:59:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.748+0000 7f4d0d9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0819f7f0 con 0x7f4d08102f20 2023-07-14T12:59:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.749+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d08105840 0x7f4d080feaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.749+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d08105840 0x7f4d080feaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52016/0 (socket says 172.21.15.17:52016) 2023-07-14T12:59:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.749+0000 7f4d077fe700 1 -- 172.21.15.17:0/980076267 learned_addr learned my addr 172.21.15.17:0/980076267 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.749+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d08100600 0x7f4d080fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.749+0000 7f4d067fc700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d08102f20 0x7f4d080fe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.749+0000 7f4d077fe700 1 -- 172.21.15.17:0/980076267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d08102f20 msgr2=0x7f4d080fe5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.749+0000 7f4d077fe700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d08102f20 0x7f4d080fe5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.749+0000 7f4d077fe700 1 -- 172.21.15.17:0/980076267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d08100600 msgr2=0x7f4d080fff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.749+0000 7f4d077fe700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d08100600 0x7f4d080fff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.749+0000 7f4d077fe700 1 -- 172.21.15.17:0/980076267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf80095f0 con 0x7f4d08105840 2023-07-14T12:59:33.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.750+0000 7f4d077fe700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d08105840 0x7f4d080feaf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4d00007ee0 tx=0x7f4d0000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:33.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.750+0000 7f4d0c9fd700 1 -- 172.21.15.17:0/980076267 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00017070 con 0x7f4d08105840 2023-07-14T12:59:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.750+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/980076267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0819fad0 con 0x7f4d08105840 2023-07-14T12:59:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.750+0000 7f4d0c9fd700 1 -- 172.21.15.17:0/980076267 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d0000f040 con 0x7f4d08105840 2023-07-14T12:59:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.750+0000 7f4d0c9fd700 1 -- 172.21.15.17:0/980076267 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00005570 con 0x7f4d08105840 2023-07-14T12:59:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.750+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/980076267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d081a0030 con 0x7f4d08105840 2023-07-14T12:59:33.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.754+0000 7f4d0c9fd700 1 -- 172.21.15.17:0/980076267 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f4d0000db20 con 0x7f4d08105840 2023-07-14T12:59:33.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.755+0000 7f4d21343b80 1 Processor -- start 2023-07-14T12:59:33.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.756+0000 7f4d21343b80 1 -- start start 2023-07-14T12:59:33.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.756+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.756+0000 7f4d0c9fd700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4cf00a1150 0x7f4cf00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.756+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23e5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.756+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23e6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.756+0000 7f4d21343b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f22e9d30 con 0x5595f23e4550 2023-07-14T12:59:33.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.756+0000 7f4d21343b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f233cac0 con 0x5595f23e5cf0 2023-07-14T12:59:33.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.756+0000 7f4d21343b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f2335f50 con 0x5595f23e4ea0 2023-07-14T12:59:33.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.756+0000 7f4d0c9fd700 1 -- 172.21.15.17:0/980076267 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f4d000cc010 con 0x7f4d08105840 2023-07-14T12:59:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.756+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.756+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52022/0 (socket says 172.21.15.17:52022) 2023-07-14T12:59:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.757+0000 7f4d06ffd700 1 -- 172.21.15.17:0/1638115056 learned_addr learned my addr 172.21.15.17:0/1638115056 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.757+0000 7f4d067fc700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4cf00a1150 0x7f4cf00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.757+0000 7f4d077fe700 1 --2- 172.21.15.17:0/1638115056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23e6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.757+0000 7f4d067fc700 1 --2- 172.21.15.17:0/1638115056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.757+0000 7f4d06ffd700 1 -- 172.21.15.17:0/1638115056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 msgr2=0x5595f23e5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:33.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.757+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/1638115056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23e5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.757+0000 7f4d06ffd700 1 -- 172.21.15.17:0/1638115056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 msgr2=0x5595f23e6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:33.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.757+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/1638115056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23e6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.757+0000 7f4d06ffd700 1 -- 172.21.15.17:0/1638115056 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f2163e60 con 0x5595f23e4550 2023-07-14T12:59:33.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.757+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/1638115056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e4960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80098e0 tx=0x7f4cf8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4148b21315cd84 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:33.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.757+0000 7f4d067fc700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4cf00a1150 0x7f4cf00a3600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00b6c0 tx=0x7f4cfc005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:33.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.758+0000 7f4cedffb700 1 -- 172.21.15.17:0/1638115056 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf801d070 con 0x5595f23e4550 2023-07-14T12:59:33.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.758+0000 7f4cedffb700 1 -- 172.21.15.17:0/1638115056 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4cf801e040 con 0x5595f23e4550 2023-07-14T12:59:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.758+0000 7f4cedffb700 1 -- 172.21.15.17:0/1638115056 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8004760 con 0x5595f23e4550 2023-07-14T12:59:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.758+0000 7f4d21343b80 1 -- 172.21.15.17:0/1638115056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 msgr2=0x5595f23e4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.758+0000 7f4d21343b80 1 --2- 172.21.15.17:0/1638115056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e4960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80098e0 tx=0x7f4cf8009f90 comp rx=0 tx=0).stop 2023-07-14T12:59:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.758+0000 7f4d21343b80 1 -- 172.21.15.17:0/1638115056 shutdown_connections 2023-07-14T12:59:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.758+0000 7f4d21343b80 1 --2- 172.21.15.17:0/1638115056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23e6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.758+0000 7f4d21343b80 1 --2- 172.21.15.17:0/1638115056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e4960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.758+0000 7f4d21343b80 1 --2- 172.21.15.17:0/1638115056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23e5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.758+0000 7f4d21343b80 1 -- 172.21.15.17:0/1638115056 >> 172.21.15.17:0/1638115056 conn(0x5595f23d9e20 msgr2=0x5595f23df250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.759+0000 7f4d21343b80 1 -- 172.21.15.17:0/1638115056 shutdown_connections 2023-07-14T12:59:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.759+0000 7f4d21343b80 1 -- 172.21.15.17:0/1638115056 wait complete. 2023-07-14T12:59:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.759+0000 7f4d21343b80 1 -- start start 2023-07-14T12:59:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.759+0000 7f4d21343b80 1 Processor -- start 2023-07-14T12:59:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23ee130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23ee670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d21343b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f22d5b40 con 0x5595f23e4550 2023-07-14T12:59:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d21343b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f22d5840 con 0x5595f23e5cf0 2023-07-14T12:59:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d21343b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f21b99a0 con 0x5595f23e4ea0 2023-07-14T12:59:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d21343b80 10 client.0 _ll_register_callbacks cb 0x5595f22d37e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23ee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d077fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49232/0 (socket says 172.21.15.17:49232) 2023-07-14T12:59:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d077fe700 1 -- 172.21.15.17:0/3991196522 learned_addr learned my addr 172.21.15.17:0/3991196522 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:33.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.760+0000 7f4d067fc700 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23ee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.761+0000 7f4d077fe700 1 -- 172.21.15.17:0/3991196522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 msgr2=0x5595f23ee670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:33.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.761+0000 7f4d077fe700 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23ee670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.761+0000 7f4d077fe700 1 -- 172.21.15.17:0/3991196522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 msgr2=0x5595f23ee130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:33.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.761+0000 7f4d077fe700 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23ee130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.761+0000 7f4d077fe700 1 -- 172.21.15.17:0/3991196522 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d081087f0 con 0x5595f23e5cf0 2023-07-14T12:59:33.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.761+0000 7f4d067fc700 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23ee670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.761+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23ee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.761+0000 7f4d077fe700 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23f56b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d00095ec0 tx=0x7f4d00098f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93102832c7401a23 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.761+0000 7f4ce6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T12:59:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.761+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/3991196522 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00004c40 con 0x5595f23e5cf0 2023-07-14T12:59:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.762+0000 7f4d21343b80 1 -- 172.21.15.17:0/3991196522 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595f228f570 con 0x5595f23e5cf0 2023-07-14T12:59:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.762+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/3991196522 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f4d00099450 con 0x5595f23e5cf0 2023-07-14T12:59:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.762+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/3991196522 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d0009d480 con 0x5595f23e5cf0 2023-07-14T12:59:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.762+0000 7f4d21343b80 10 client.25247 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:33.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.762+0000 7f4d21343b80 1 -- 172.21.15.17:0/3991196522 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5595f214cce0 con 0x5595f23e5cf0 2023-07-14T12:59:33.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.762+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/3991196522 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5595f228f570 con 0x5595f23e5cf0 2023-07-14T12:59:33.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.763+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/3991196522 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d00098940 con 0x5595f23e5cf0 2023-07-14T12:59:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.763+0000 7f4d21343b80 10 client.25247 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.763+0000 7f4d21343b80 10 client.25247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T12:59:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.763+0000 7f4d21343b80 20 client.25247 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.763+0000 7f4d21343b80 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5595f23f9ee0 0x5595f23fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.763+0000 7f4d21343b80 4 client.25247 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:59:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.763+0000 7f4d21343b80 1 -- 172.21.15.17:0/3991196522 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595f232ef30 con 0x5595f23f9ee0 2023-07-14T12:59:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.763+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5595f23f9ee0 0x5595f23fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.764+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5595f23f9ee0 0x5595f23fc2c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a17425c61ae9f009 server_cookie=4a09fd760397f8a7 in_seq=0 out_seq=0 2023-07-14T12:59:33.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.764+0000 7f4ce6ffd700 10 client.25247 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:33.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/3991196522 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5595f232ef30 con 0x5595f23f9ee0 2023-07-14T12:59:33.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4ce6ffd700 10 client.25247 handle_command_reply: tid=0 2023-07-14T12:59:33.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 1 client.25247 shutdown 2023-07-14T12:59:33.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 1 -- 172.21.15.17:0/3991196522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 msgr2=0x5595f23f56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23f56b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d00095ec0 tx=0x7f4d00098f90 comp rx=0 tx=0).stop 2023-07-14T12:59:33.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 1 -- 172.21.15.17:0/3991196522 shutdown_connections 2023-07-14T12:59:33.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5595f23f9ee0 0x5595f23fc2c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23f56b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4ce6ffd700 0 client.25247 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:33.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23ee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 1 --2- 172.21.15.17:0/3991196522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23ee670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 1 -- 172.21.15.17:0/3991196522 >> 172.21.15.17:0/3991196522 conn(0x5595f23d9e20 msgr2=0x5595f23de930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:33.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 1 -- 172.21.15.17:0/3991196522 shutdown_connections 2023-07-14T12:59:33.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 1 -- 172.21.15.17:0/3991196522 wait complete. 2023-07-14T12:59:33.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.765+0000 7f4d21343b80 20 client.25247 trim_cache size 0 max 16384 2023-07-14T12:59:33.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.783+0000 7f4d21343b80 1 Processor -- start 2023-07-14T12:59:33.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.783+0000 7f4d21343b80 1 -- start start 2023-07-14T12:59:33.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.783+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.783+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.783+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23f5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.783+0000 7f4d21343b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f23ed5e0 con 0x5595f23e4550 2023-07-14T12:59:33.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.783+0000 7f4d21343b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f23edca0 con 0x5595f23e5cf0 2023-07-14T12:59:33.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.783+0000 7f4d21343b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f23e5270 con 0x5595f23e4ea0 2023-07-14T12:59:33.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d06ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52032/0 (socket says 172.21.15.17:52032) 2023-07-14T12:59:33.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d06ffd700 1 -- 172.21.15.17:0/4138382959 learned_addr learned my addr 172.21.15.17:0/4138382959 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:33.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d077fe700 1 --2- 172.21.15.17:0/4138382959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d067fc700 1 --2- 172.21.15.17:0/4138382959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d06ffd700 1 -- 172.21.15.17:0/4138382959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 msgr2=0x5595f23e90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:33.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/4138382959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23e90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d06ffd700 1 -- 172.21.15.17:0/4138382959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 msgr2=0x5595f23f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:33.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/4138382959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d06ffd700 1 -- 172.21.15.17:0/4138382959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595f23ed170 con 0x5595f23e4550 2023-07-14T12:59:33.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d067fc700 1 --2- 172.21.15.17:0/4138382959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23e90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:59:33.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.784+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/4138382959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e8bb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8006010 tx=0x7f4cf8009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddde8830020761f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:33.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.785+0000 7f4cee7fc700 1 -- 172.21.15.17:0/4138382959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf801d040 con 0x5595f23e4550 2023-07-14T12:59:33.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.785+0000 7f4cee7fc700 1 -- 172.21.15.17:0/4138382959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4cf80058e0 con 0x5595f23e4550 2023-07-14T12:59:33.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.785+0000 7f4cee7fc700 1 -- 172.21.15.17:0/4138382959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8034e60 con 0x5595f23e4550 2023-07-14T12:59:33.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.785+0000 7f4d21343b80 1 -- 172.21.15.17:0/4138382959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 msgr2=0x5595f23e8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.785+0000 7f4d21343b80 1 --2- 172.21.15.17:0/4138382959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e8bb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8006010 tx=0x7f4cf8009510 comp rx=0 tx=0).stop 2023-07-14T12:59:33.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.786+0000 7f4d21343b80 1 -- 172.21.15.17:0/4138382959 shutdown_connections 2023-07-14T12:59:33.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.786+0000 7f4d21343b80 1 --2- 172.21.15.17:0/4138382959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e5cf0 0x5595f23f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.786+0000 7f4d21343b80 1 --2- 172.21.15.17:0/4138382959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4550 0x5595f23e8bb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.786+0000 7f4d21343b80 1 --2- 172.21.15.17:0/4138382959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e4ea0 0x5595f23e90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.786+0000 7f4d21343b80 1 -- 172.21.15.17:0/4138382959 >> 172.21.15.17:0/4138382959 conn(0x5595f23d9e20 msgr2=0x5595f23ec050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.786+0000 7f4d21343b80 1 -- 172.21.15.17:0/4138382959 shutdown_connections 2023-07-14T12:59:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.786+0000 7f4d21343b80 1 -- 172.21.15.17:0/4138382959 wait complete. 2023-07-14T12:59:33.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.786+0000 7f4d21343b80 1 -- start start 2023-07-14T12:59:33.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.786+0000 7f4d21343b80 1 Processor -- start 2023-07-14T12:59:33.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e4550 0x5595f23f5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4ea0 0x5595f23f5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d21343b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e5cf0 0x5595f23f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d21343b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f23f21b0 con 0x5595f23e4ea0 2023-07-14T12:59:33.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d21343b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f23f2320 con 0x5595f23e4550 2023-07-14T12:59:33.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d21343b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595f23f24e0 con 0x5595f23e5cf0 2023-07-14T12:59:33.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d21343b80 10 client.0 _ll_register_callbacks cb 0x7f4d00004fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:33.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d067fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4ea0 0x5595f23f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d067fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4ea0 0x5595f23f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52040/0 (socket says 172.21.15.17:52040) 2023-07-14T12:59:33.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d067fc700 1 -- 172.21.15.17:0/121950033 learned_addr learned my addr 172.21.15.17:0/121950033 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e4550 0x5595f23f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d077fe700 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e5cf0 0x5595f23f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d067fc700 1 -- 172.21.15.17:0/121950033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e5cf0 msgr2=0x5595f23f1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d067fc700 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e5cf0 0x5595f23f1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d067fc700 1 -- 172.21.15.17:0/121950033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e4550 msgr2=0x5595f23f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d067fc700 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e4550 0x5595f23f5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.787+0000 7f4d067fc700 1 -- 172.21.15.17:0/121950033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595f2163e60 con 0x5595f23e4ea0 2023-07-14T12:59:33.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.788+0000 7f4d067fc700 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4ea0 0x5595f23f5540 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc004340 tx=0x7f4cfc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00b0cc7eabe7985 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.788+0000 7f4ce6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.788+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/121950033 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc003b90 con 0x5595f23e4ea0 2023-07-14T12:59:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.788+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/121950033 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f4cfc003cf0 con 0x5595f23e4ea0 2023-07-14T12:59:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.788+0000 7f4d21343b80 1 -- 172.21.15.17:0/121950033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4cf801e040 con 0x5595f23e4ea0 2023-07-14T12:59:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.788+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/121950033 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cfc02b470 con 0x5595f23e4ea0 2023-07-14T12:59:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.788+0000 7f4d21343b80 10 client.15447 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:33.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.788+0000 7f4d21343b80 1 -- 172.21.15.17:0/121950033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5595f23e6390 con 0x5595f23e4ea0 2023-07-14T12:59:33.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.789+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/121950033 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4cf801e040 con 0x5595f23e4ea0 2023-07-14T12:59:33.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.789+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/121950033 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4cfc022570 con 0x5595f23e4ea0 2023-07-14T12:59:33.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.789+0000 7f4d21343b80 10 client.15447 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:33.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.789+0000 7f4d21343b80 10 client.15447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T12:59:33.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.789+0000 7f4d21343b80 20 client.15447 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:33.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.789+0000 7f4d21343b80 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5595f244f410 0x5595f2451820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:33.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.789+0000 7f4d21343b80 4 client.15447 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T12:59:33.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.789+0000 7f4d21343b80 1 -- 172.21.15.17:0/121950033 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5595f22f10d0 con 0x5595f244f410 2023-07-14T12:59:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.789+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5595f244f410 0x5595f2451820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.790+0000 7f4d06ffd700 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5595f244f410 0x5595f2451820 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83aa1ad79aea5b64 server_cookie=a17e3710c4ac0f1c in_seq=0 out_seq=0 2023-07-14T12:59:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.790+0000 7f4ce6ffd700 10 client.15447 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4ce6ffd700 1 -- 172.21.15.17:0/121950033 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5595f22f10d0 con 0x5595f244f410 2023-07-14T12:59:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4ce6ffd700 10 client.15447 handle_command_reply: tid=0 2023-07-14T12:59:33.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4d21343b80 1 client.15447 shutdown 2023-07-14T12:59:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4d21343b80 1 -- 172.21.15.17:0/121950033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4ea0 msgr2=0x5595f23f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4d21343b80 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4ea0 0x5595f23f5540 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc004340 tx=0x7f4cfc0047c0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4d21343b80 1 -- 172.21.15.17:0/121950033 shutdown_connections 2023-07-14T12:59:33.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4d21343b80 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5595f244f410 0x5595f2451820 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4d21343b80 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595f23e5cf0 0x5595f23f1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4d21343b80 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595f23e4550 0x5595f23f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4ce6ffd700 0 client.15447 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:33.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4d21343b80 1 --2- 172.21.15.17:0/121950033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595f23e4ea0 0x5595f23f5540 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.791+0000 7f4d21343b80 1 -- 172.21.15.17:0/121950033 >> 172.21.15.17:0/121950033 conn(0x5595f23d9e20 msgr2=0x5595f23ec050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:33.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.792+0000 7f4d21343b80 1 -- 172.21.15.17:0/121950033 shutdown_connections 2023-07-14T12:59:33.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.792+0000 7f4d21343b80 1 -- 172.21.15.17:0/121950033 wait complete. 2023-07-14T12:59:33.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.792+0000 7f4d21343b80 20 client.15447 trim_cache size 0 max 16384 2023-07-14T12:59:33.829 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:59:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T12:59:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "69b24344-35bc-4484-8e84-1c874514aeb3", 2023-07-14T12:59:33.829 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T12:59:33.830 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:59:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.792+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/980076267 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4cf00a1150 msgr2=0x7f4cf00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.792+0000 7f4d0d9ff700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4cf00a1150 0x7f4cf00a3600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00b6c0 tx=0x7f4cfc005d20 comp rx=0 tx=0).stop 2023-07-14T12:59:33.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.792+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/980076267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d08105840 msgr2=0x7f4d080feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:33.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.792+0000 7f4d0d9ff700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d08105840 0x7f4d080feaf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4d00007ee0 tx=0x7f4d0000d3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.793+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/980076267 shutdown_connections 2023-07-14T12:59:33.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.793+0000 7f4d0d9ff700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f4cf00a1150 0x7f4cf00a3600 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.793+0000 7f4d0d9ff700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d08105840 0x7f4d080feaf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.793+0000 7f4d0d9ff700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d08100600 0x7f4d080fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.793+0000 7f4d0d9ff700 1 --2- 172.21.15.17:0/980076267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d08102f20 0x7f4d080fe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:33.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.793+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/980076267 >> 172.21.15.17:0/980076267 conn(0x7f4d080fa000 msgr2=0x7f4d08101260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:33.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.793+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/980076267 shutdown_connections 2023-07-14T12:59:33.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:33.793+0000 7f4d0d9ff700 1 -- 172.21.15.17:0/980076267 wait complete. 2023-07-14T12:59:33.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T12:59:34.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.019+0000 7f74dddff700 1 -- 172.21.15.17:0/1597030650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d81079a0 msgr2=0x7f74d8109e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.019+0000 7f74dddff700 1 --2- 172.21.15.17:0/1597030650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d81079a0 0x7f74d8109e20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f74d000b0a0 tx=0x7f74d000b3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.019+0000 7f74dddff700 1 -- 172.21.15.17:0/1597030650 shutdown_connections 2023-07-14T12:59:34.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.019+0000 7f74dddff700 1 --2- 172.21.15.17:0/1597030650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d81079a0 0x7f74d8109e20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.019+0000 7f74dddff700 1 --2- 172.21.15.17:0/1597030650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d8074550 0x7f74d80729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.019+0000 7f74dddff700 1 --2- 172.21.15.17:0/1597030650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8072f70 0x7f74d80733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.019+0000 7f74dddff700 1 -- 172.21.15.17:0/1597030650 >> 172.21.15.17:0/1597030650 conn(0x7f74d80fb0e0 msgr2=0x7f74d80fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.019+0000 7f74dddff700 1 -- 172.21.15.17:0/1597030650 shutdown_connections 2023-07-14T12:59:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.020+0000 7f74dddff700 1 -- 172.21.15.17:0/1597030650 wait complete. 2023-07-14T12:59:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.021+0000 7f74dddff700 1 Processor -- start 2023-07-14T12:59:34.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.021+0000 7f74dddff700 1 -- start start 2023-07-14T12:59:34.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74dddff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d8072f70 0x7f74d8197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74dddff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8074550 0x7f74d8197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74dddff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d81079a0 0x7f74d819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74dddff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d819f5f0 con 0x7f74d8072f70 2023-07-14T12:59:34.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74dddff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d819f730 con 0x7f74d8074550 2023-07-14T12:59:34.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74dddff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d819f8c0 con 0x7f74d81079a0 2023-07-14T12:59:34.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74d77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d8072f70 0x7f74d8197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74d77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d8072f70 0x7f74d8197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52064/0 (socket says 172.21.15.17:52064) 2023-07-14T12:59:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74d77fe700 1 -- 172.21.15.17:0/3348691701 learned_addr learned my addr 172.21.15.17:0/3348691701 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74d7fff700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d81079a0 0x7f74d819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8074550 0x7f74d8197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74d77fe700 1 -- 172.21.15.17:0/3348691701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d81079a0 msgr2=0x7f74d819f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.022+0000 7f74d77fe700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d81079a0 0x7f74d819f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.023+0000 7f74d77fe700 1 -- 172.21.15.17:0/3348691701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8074550 msgr2=0x7f74d8197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.023+0000 7f74d77fe700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8074550 0x7f74d8197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.023+0000 7f74d77fe700 1 -- 172.21.15.17:0/3348691701 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d0009d00 con 0x7f74d8072f70 2023-07-14T12:59:34.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.023+0000 7f74d77fe700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d8072f70 0x7f74d8197a70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f74c800d950 tx=0x7f74c800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.023+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3348691701 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8004220 con 0x7f74d8072f70 2023-07-14T12:59:34.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.023+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3348691701 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74c8007620 con 0x7f74d8072f70 2023-07-14T12:59:34.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.023+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3348691701 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8005530 con 0x7f74d8072f70 2023-07-14T12:59:34.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.023+0000 7f74dddff700 1 -- 172.21.15.17:0/3348691701 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d819fba0 con 0x7f74d8072f70 2023-07-14T12:59:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.023+0000 7f74dddff700 1 -- 172.21.15.17:0/3348691701 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d81a0060 con 0x7f74d8072f70 2023-07-14T12:59:34.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.027+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3348691701 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f74c8004750 con 0x7f74d8072f70 2023-07-14T12:59:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.028+0000 7f74f16e1b80 1 Processor -- start 2023-07-14T12:59:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.028+0000 7f74f16e1b80 1 -- start start 2023-07-14T12:59:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.028+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f5d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.028+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5de20 0x55b1d6f5e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.028+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f5f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.028+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6e62cb0 con 0x55b1d6f5de20 2023-07-14T12:59:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.028+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6eb5a40 con 0x55b1d6f5ec70 2023-07-14T12:59:34.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.028+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6eaeed0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.029+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f5d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.029+0000 7f74d77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5de20 0x55b1d6f5e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.029+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f5d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58282/0 (socket says 172.21.15.17:58282) 2023-07-14T12:59:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.029+0000 7f74d7fff700 1 -- 172.21.15.17:0/2291515987 learned_addr learned my addr 172.21.15.17:0/2291515987 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.029+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/2291515987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f5f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.029+0000 7f74d7fff700 1 -- 172.21.15.17:0/2291515987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 msgr2=0x55b1d6f5f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.029+0000 7f74d7fff700 1 --2- 172.21.15.17:0/2291515987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f5f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.029+0000 7f74d7fff700 1 -- 172.21.15.17:0/2291515987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5de20 msgr2=0x55b1d6f5e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.029+0000 7f74d7fff700 1 --2- 172.21.15.17:0/2291515987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5de20 0x55b1d6f5e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.029+0000 7f74d7fff700 1 -- 172.21.15.17:0/2291515987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1d6cdcde0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.029+0000 7f74d4ff9700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74c00a11d0 0x7f74c00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.030+0000 7f74d7fff700 1 --2- 172.21.15.17:0/2291515987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f5d8e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f74d00079c0 tx=0x7f74d00093d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fd3f8accb871d5e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.030+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3348691701 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f74c80cc700 con 0x7f74d8072f70 2023-07-14T12:59:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.030+0000 7f74d77fe700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74c00a11d0 0x7f74c00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.030+0000 7f74bdffb700 1 -- 172.21.15.17:0/2291515987 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d000e040 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.030+0000 7f74bdffb700 1 -- 172.21.15.17:0/2291515987 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74d00076e0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.030+0000 7f74bdffb700 1 -- 172.21.15.17:0/2291515987 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0003dc0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.031+0000 7f74d77fe700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74c00a11d0 0x7f74c00a3680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f74c8095fe0 tx=0x7f74c80d2530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.031+0000 7f74f16e1b80 1 -- 172.21.15.17:0/2291515987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5d4d0 msgr2=0x55b1d6f5d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.031+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/2291515987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f5d8e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f74d00079c0 tx=0x7f74d00093d0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.031+0000 7f74f16e1b80 1 -- 172.21.15.17:0/2291515987 shutdown_connections 2023-07-14T12:59:34.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.031+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/2291515987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f5f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.031+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/2291515987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f5d8e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.031+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/2291515987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5de20 0x55b1d6f5e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.031+0000 7f74f16e1b80 1 -- 172.21.15.17:0/2291515987 >> 172.21.15.17:0/2291515987 conn(0x55b1d6f52da0 msgr2=0x55b1d6f581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.031+0000 7f74f16e1b80 1 -- 172.21.15.17:0/2291515987 shutdown_connections 2023-07-14T12:59:34.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.031+0000 7f74f16e1b80 1 -- 172.21.15.17:0/2291515987 wait complete. 2023-07-14T12:59:34.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.032+0000 7f74f16e1b80 1 -- start start 2023-07-14T12:59:34.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.032+0000 7f74f16e1b80 1 Processor -- start 2023-07-14T12:59:34.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.032+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.032+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5de20 0x55b1d6f675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.032+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f6e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.032+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6e4eac0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.032+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6e4e7c0 con 0x55b1d6f5de20 2023-07-14T12:59:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.032+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6d32920 con 0x55b1d6f5ec70 2023-07-14T12:59:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.032+0000 7f74f16e1b80 10 client.0 _ll_register_callbacks cb 0x55b1d6e4c760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52084/0 (socket says 172.21.15.17:52084) 2023-07-14T12:59:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74d7fff700 1 -- 172.21.15.17:0/870565407 learned_addr learned my addr 172.21.15.17:0/870565407 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5de20 0x55b1d6f675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74d7fff700 1 -- 172.21.15.17:0/870565407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5ec70 msgr2=0x55b1d6f6e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74d7fff700 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f6e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74d7fff700 1 -- 172.21.15.17:0/870565407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5de20 msgr2=0x55b1d6f675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74d7fff700 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5de20 0x55b1d6f675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74d7fff700 1 -- 172.21.15.17:0/870565407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d810aa40 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74d7fff700 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f670b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f74d000b3f0 tx=0x7f74d0007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02cdaaa60df36b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.033+0000 7f74b6ffd700 1 -- 172.21.15.17:0/870565407 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d000e030 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74f16e1b80 1 -- 172.21.15.17:0/870565407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1d6e084f0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74b6ffd700 1 -- 172.21.15.17:0/870565407 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f74d000f070 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74b6ffd700 1 -- 172.21.15.17:0/870565407 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74d00052b0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74f16e1b80 10 client.15459 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:34.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74f16e1b80 1 -- 172.21.15.17:0/870565407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55b1d6cc5c60 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74b6ffd700 1 -- 172.21.15.17:0/870565407 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74d0036020 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74b6ffd700 1 -- 172.21.15.17:0/870565407 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f74d0019050 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74f16e1b80 10 client.15459 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:34.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74f16e1b80 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T12:59:34.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74f16e1b80 20 client.15459 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:34.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b1d6f72960 0x55b1d6f74d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74f16e1b80 4 client.15459 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:59:34.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.034+0000 7f74f16e1b80 1 -- 172.21.15.17:0/870565407 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1d6ea7eb0 con 0x55b1d6f72960 2023-07-14T12:59:34.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.035+0000 7fe67cfff700 1 -- 172.21.15.17:0/1504333301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe67802cb00 con 0x7fe678072f70 2023-07-14T12:59:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.035+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b1d6f72960 0x55b1d6f74d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.035+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b1d6f72960 0x55b1d6f74d70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31ae5cd015e5fa62 server_cookie=3aac5c352902c773 in_seq=0 out_seq=0 2023-07-14T12:59:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.035+0000 7f74b6ffd700 10 client.15459 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.036+0000 7f74b6ffd700 1 -- 172.21.15.17:0/870565407 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b1d6ea7eb0 con 0x55b1d6f72960 2023-07-14T12:59:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.036+0000 7f74b6ffd700 10 client.15459 handle_command_reply: tid=0 2023-07-14T12:59:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.036+0000 7f74f16e1b80 1 client.15459 shutdown 2023-07-14T12:59:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.036+0000 7f74f16e1b80 1 -- 172.21.15.17:0/870565407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 msgr2=0x55b1d6f670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.036+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f670b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f74d000b3f0 tx=0x7f74d0007c40 comp rx=0 tx=0).stop 2023-07-14T12:59:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.037+0000 7f74f16e1b80 1 -- 172.21.15.17:0/870565407 shutdown_connections 2023-07-14T12:59:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.037+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b1d6f72960 0x55b1d6f74d70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.037+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f6e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.037+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f670b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.037+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/870565407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5de20 0x55b1d6f675f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.037+0000 7f74b6ffd700 0 client.15459 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.037+0000 7f74f16e1b80 1 -- 172.21.15.17:0/870565407 >> 172.21.15.17:0/870565407 conn(0x55b1d6f52da0 msgr2=0x55b1d6f578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.037+0000 7f74f16e1b80 1 -- 172.21.15.17:0/870565407 shutdown_connections 2023-07-14T12:59:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.037+0000 7f74f16e1b80 1 -- 172.21.15.17:0/870565407 wait complete. 2023-07-14T12:59:34.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.037+0000 7f74f16e1b80 20 client.15459 trim_cache size 0 max 16384 2023-07-14T12:59:34.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.054+0000 7f74f16e1b80 1 Processor -- start 2023-07-14T12:59:34.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.054+0000 7f74f16e1b80 1 -- start start 2023-07-14T12:59:34.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f578b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5de20 0x55b1d6f6e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f61af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6f52970 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6f753d0 con 0x55b1d6f5ec70 2023-07-14T12:59:34.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6f64d70 con 0x55b1d6f5de20 2023-07-14T12:59:34.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52088/0 (socket says 172.21.15.17:52088) 2023-07-14T12:59:34.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74d7fff700 1 -- 172.21.15.17:0/675283332 learned_addr learned my addr 172.21.15.17:0/675283332 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:34.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/675283332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5de20 0x55b1d6f6e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74d7fff700 1 --2- 172.21.15.17:0/675283332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f61af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74d7fff700 1 -- 172.21.15.17:0/675283332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5de20 msgr2=0x55b1d6f6e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74d7fff700 1 --2- 172.21.15.17:0/675283332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5de20 0x55b1d6f6e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74d7fff700 1 -- 172.21.15.17:0/675283332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 msgr2=0x55b1d6f61af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74d7fff700 1 --2- 172.21.15.17:0/675283332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f61af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.055+0000 7f74d7fff700 1 -- 172.21.15.17:0/675283332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1d6d03250 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74d7fff700 1 --2- 172.21.15.17:0/675283332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f578b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009cd0 tx=0x7f74d00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1edb05f0ff85c29 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74be7fc700 1 -- 172.21.15.17:0/675283332 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d000e040 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74be7fc700 1 -- 172.21.15.17:0/675283332 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74d0036070 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74be7fc700 1 -- 172.21.15.17:0/675283332 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d00057b0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74f16e1b80 1 -- 172.21.15.17:0/675283332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 msgr2=0x55b1d6f578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/675283332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f578b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009cd0 tx=0x7f74d00093d0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74f16e1b80 1 -- 172.21.15.17:0/675283332 shutdown_connections 2023-07-14T12:59:34.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/675283332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f61af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/675283332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f578b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/675283332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5de20 0x55b1d6f6e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74f16e1b80 1 -- 172.21.15.17:0/675283332 >> 172.21.15.17:0/675283332 conn(0x55b1d6f52da0 msgr2=0x55b1d6f79690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.056+0000 7f74f16e1b80 1 -- 172.21.15.17:0/675283332 shutdown_connections 2023-07-14T12:59:34.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.057+0000 7f74f16e1b80 1 -- 172.21.15.17:0/675283332 wait complete. 2023-07-14T12:59:34.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.057+0000 7f74f16e1b80 1 -- start start 2023-07-14T12:59:34.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.057+0000 7f74f16e1b80 1 Processor -- start 2023-07-14T12:59:34.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.057+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f6e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.057+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5de20 0x55b1d6f6ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.057+0000 7f74f16e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f6b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6f6b7b0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6f6e770 con 0x55b1d6f5ec70 2023-07-14T12:59:34.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74f16e1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1d6f6e900 con 0x55b1d6f5de20 2023-07-14T12:59:34.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74f16e1b80 10 client.0 _ll_register_callbacks cb 0x7f74c80d2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:34.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f6e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f6e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52100/0 (socket says 172.21.15.17:52100) 2023-07-14T12:59:34.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74d7fff700 1 -- 172.21.15.17:0/1821812805 learned_addr learned my addr 172.21.15.17:0/1821812805 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:34.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5de20 0x55b1d6f6ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74d7fff700 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f6b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74d7fff700 1 -- 172.21.15.17:0/1821812805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5de20 msgr2=0x55b1d6f6ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74d7fff700 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5de20 0x55b1d6f6ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74d7fff700 1 -- 172.21.15.17:0/1821812805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 msgr2=0x55b1d6f6b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74d7fff700 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f6b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74d7fff700 1 -- 172.21.15.17:0/1821812805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1d6cc5c60 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.058+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5de20 0x55b1d6f6ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:34.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.059+0000 7f74d7fff700 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f6e0f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f74d0035040 tx=0x7f74d00097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72da12a6cacb295 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.059+0000 7f74b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:34.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.059+0000 7f74b6ffd700 1 -- 172.21.15.17:0/1821812805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d000e070 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.059+0000 7f74f16e1b80 1 -- 172.21.15.17:0/1821812805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74d00076e0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.059+0000 7f74b6ffd700 1 -- 172.21.15.17:0/1821812805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f74d0037080 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.059+0000 7f74b6ffd700 1 -- 172.21.15.17:0/1821812805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74d000bb60 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.059+0000 7f74f16e1b80 10 client.15465 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:34.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.059+0000 7f74f16e1b80 1 -- 172.21.15.17:0/1821812805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55b1d6cdb2b0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.059+0000 7f74b6ffd700 1 -- 172.21.15.17:0/1821812805 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74d00076e0 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.060+0000 7f74b6ffd700 1 -- 172.21.15.17:0/1821812805 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f74d0044030 con 0x55b1d6f5d4d0 2023-07-14T12:59:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.060+0000 7f74f16e1b80 10 client.15465 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.060+0000 7f74f16e1b80 10 client.15465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T12:59:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.060+0000 7f74f16e1b80 20 client.15465 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.060+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b1d6fc7b30 0x55b1d6fc9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.060+0000 7f74f16e1b80 4 client.15465 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T12:59:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.060+0000 7f74f16e1b80 1 -- 172.21.15.17:0/1821812805 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b1d6e6a050 con 0x55b1d6fc7b30 2023-07-14T12:59:34.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.060+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b1d6fc7b30 0x55b1d6fc9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b1d6fc7b30 0x55b1d6fc9f40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5916f9090214f995 server_cookie=5159befff0af900b in_seq=0 out_seq=0 2023-07-14T12:59:34.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74b6ffd700 10 client.15465 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:34.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74b6ffd700 1 -- 172.21.15.17:0/1821812805 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b1d6e6a050 con 0x55b1d6fc7b30 2023-07-14T12:59:34.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74b6ffd700 10 client.15465 handle_command_reply: tid=0 2023-07-14T12:59:34.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74f16e1b80 1 client.15465 shutdown 2023-07-14T12:59:34.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74f16e1b80 1 -- 172.21.15.17:0/1821812805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 msgr2=0x55b1d6f6e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f6e0f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f74d0035040 tx=0x7f74d00097c0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74f16e1b80 1 -- 172.21.15.17:0/1821812805 shutdown_connections 2023-07-14T12:59:34.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b1d6fc7b30 0x55b1d6fc9f40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1d6f5ec70 0x55b1d6f6b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b1d6f5d4d0 0x55b1d6f6e0f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74f16e1b80 1 --2- 172.21.15.17:0/1821812805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1d6f5de20 0x55b1d6f6ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74f16e1b80 1 -- 172.21.15.17:0/1821812805 >> 172.21.15.17:0/1821812805 conn(0x55b1d6f52da0 msgr2=0x55b1d6f578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.061+0000 7f74b6ffd700 0 client.15465 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:34.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74f16e1b80 1 -- 172.21.15.17:0/1821812805 shutdown_connections 2023-07-14T12:59:34.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74f16e1b80 1 -- 172.21.15.17:0/1821812805 wait complete. 2023-07-14T12:59:34.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74f16e1b80 20 client.15465 trim_cache size 0 max 16384 2023-07-14T12:59:34.100 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:59:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T12:59:34.100 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T12:59:34.101 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:59:34.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74dddff700 1 -- 172.21.15.17:0/3348691701 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74c00a11d0 msgr2=0x7f74c00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74dddff700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74c00a11d0 0x7f74c00a3680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f74c8095fe0 tx=0x7f74c80d2530 comp rx=0 tx=0).stop 2023-07-14T12:59:34.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74dddff700 1 -- 172.21.15.17:0/3348691701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d8072f70 msgr2=0x7f74d8197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74dddff700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d8072f70 0x7f74d8197a70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f74c800d950 tx=0x7f74c800dc60 comp rx=0 tx=0).stop 2023-07-14T12:59:34.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74dddff700 1 -- 172.21.15.17:0/3348691701 shutdown_connections 2023-07-14T12:59:34.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74dddff700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f74c00a11d0 0x7f74c00a3680 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74dddff700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d81079a0 0x7f74d819f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74dddff700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d8072f70 0x7f74d8197a70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74dddff700 1 --2- 172.21.15.17:0/3348691701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8074550 0x7f74d8197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.062+0000 7f74dddff700 1 -- 172.21.15.17:0/3348691701 >> 172.21.15.17:0/3348691701 conn(0x7f74d80fb0e0 msgr2=0x7f74d80fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.063+0000 7f74dddff700 1 -- 172.21.15.17:0/3348691701 shutdown_connections 2023-07-14T12:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.063+0000 7f74dddff700 1 -- 172.21.15.17:0/3348691701 wait complete. 2023-07-14T12:59:34.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:33 smithi017 ceph-mon[95536]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-07-14T12:59:34.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:33 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2720750285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:34.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:33 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2245742415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:34.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:33 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T12:59:34.106 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:33 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:34.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:33 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T12:59:34.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:33 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:34.107 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:33 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T12:59:34.109 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T12:59:34.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T12:59:34.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:33 smithi131 ceph-mon[96953]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-07-14T12:59:34.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:33 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2720750285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:34.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:33 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2245742415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:34.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:33 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T12:59:34.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:33 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:34.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:33 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T12:59:34.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:33 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:34.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:33 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T12:59:34.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.284+0000 7f75f39ff700 1 -- 172.21.15.17:0/783240702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75ec100cf0 msgr2=0x7f75ec101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.284+0000 7f75f39ff700 1 --2- 172.21.15.17:0/783240702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75ec100cf0 0x7f75ec101140 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009990 tx=0x7f75dc009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.284+0000 7f75f39ff700 1 -- 172.21.15.17:0/783240702 shutdown_connections 2023-07-14T12:59:34.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.284+0000 7f75f39ff700 1 --2- 172.21.15.17:0/783240702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75ec101680 0x7f75ec107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.284+0000 7f75f39ff700 1 --2- 172.21.15.17:0/783240702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75ec0ffb00 0x7f75ec0fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.284+0000 7f75f39ff700 1 --2- 172.21.15.17:0/783240702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75ec100cf0 0x7f75ec101140 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.284+0000 7f75f39ff700 1 -- 172.21.15.17:0/783240702 >> 172.21.15.17:0/783240702 conn(0x7f75ec0fb0e0 msgr2=0x7f75ec0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.284+0000 7f75f39ff700 1 -- 172.21.15.17:0/783240702 shutdown_connections 2023-07-14T12:59:34.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.284+0000 7f75f39ff700 1 -- 172.21.15.17:0/783240702 wait complete. 2023-07-14T12:59:34.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.285+0000 7f75f39ff700 1 Processor -- start 2023-07-14T12:59:34.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.285+0000 7f75f39ff700 1 -- start start 2023-07-14T12:59:34.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f39ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75ec0ffb00 0x7f75ec0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f39ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75ec100cf0 0x7f75ec072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f39ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75ec101680 0x7f75ec072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f39ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0735e0 con 0x7f75ec100cf0 2023-07-14T12:59:34.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f39ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec073750 con 0x7f75ec101680 2023-07-14T12:59:34.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f39ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec19f7d0 con 0x7f75ec0ffb00 2023-07-14T12:59:34.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f0f9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75ec100cf0 0x7f75ec072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f0f9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75ec100cf0 0x7f75ec072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52122/0 (socket says 172.21.15.17:52122) 2023-07-14T12:59:34.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f0f9a700 1 -- 172.21.15.17:0/2556635350 learned_addr learned my addr 172.21.15.17:0/2556635350 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:34.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f179b700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75ec0ffb00 0x7f75ec0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f0f9a700 1 -- 172.21.15.17:0/2556635350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75ec0ffb00 msgr2=0x7f75ec0742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f0f9a700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75ec0ffb00 0x7f75ec0742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f0f9a700 1 -- 172.21.15.17:0/2556635350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75ec101680 msgr2=0x7f75ec072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f1f9c700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75ec101680 0x7f75ec072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f0f9a700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75ec101680 0x7f75ec072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f0f9a700 1 -- 172.21.15.17:0/2556635350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc0095f0 con 0x7f75ec100cf0 2023-07-14T12:59:34.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.286+0000 7f75f1f9c700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75ec101680 0x7f75ec072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:59:34.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.287+0000 7f75f0f9a700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75ec100cf0 0x7f75ec072900 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f75dc005f50 tx=0x7f75dc0040b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.287+0000 7f75e27fc700 1 -- 172.21.15.17:0/2556635350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc01d070 con 0x7f75ec100cf0 2023-07-14T12:59:34.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.287+0000 7f75e27fc700 1 -- 172.21.15.17:0/2556635350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75dc0041d0 con 0x7f75ec100cf0 2023-07-14T12:59:34.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.287+0000 7f75f39ff700 1 -- 172.21.15.17:0/2556635350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec19fa50 con 0x7f75ec100cf0 2023-07-14T12:59:34.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.287+0000 7f75e27fc700 1 -- 172.21.15.17:0/2556635350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00f6c0 con 0x7f75ec100cf0 2023-07-14T12:59:34.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.287+0000 7f75f39ff700 1 -- 172.21.15.17:0/2556635350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec19fed0 con 0x7f75ec100cf0 2023-07-14T12:59:34.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.288+0000 7f75f39ff700 1 -- 172.21.15.17:0/2556635350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ec1070c0 con 0x7f75ec100cf0 2023-07-14T12:59:34.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.290+0000 7f75e27fc700 1 -- 172.21.15.17:0/2556635350 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7f75dc022470 con 0x7f75ec100cf0 2023-07-14T12:59:34.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.291+0000 7f75e27fc700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75d80a1220 0x7f75d80a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.292+0000 7f75e27fc700 1 -- 172.21.15.17:0/2556635350 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f75dc0ce740 con 0x7f75ec100cf0 2023-07-14T12:59:34.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.292+0000 7f75f179b700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75d80a1220 0x7f75d80a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.292+0000 7f75f179b700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75d80a1220 0x7f75d80a36d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75ec100b50 tx=0x7f75e8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.293+0000 7f75e27fc700 1 -- 172.21.15.17:0/2556635350 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f75dc097ef0 con 0x7f75ec100cf0 2023-07-14T12:59:34.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:33 smithi135 ceph-mon[97338]: pgmap v361: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2023-07-14T12:59:34.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:33 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2720750285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:34.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:33 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2245742415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T12:59:34.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:33 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T12:59:34.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:33 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:34.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:33 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T12:59:34.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:33 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:34.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:33 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T12:59:34.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.549+0000 7f75f39ff700 1 -- 172.21.15.17:0/2556635350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75ec02c850 con 0x7f75ec100cf0 2023-07-14T12:59:34.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.550+0000 7f75e27fc700 1 -- 172.21.15.17:0/2556635350 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10845 (secure 0 0 0) 0x7f75dc09b510 con 0x7f75ec100cf0 2023-07-14T12:59:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T12:57:45.208579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T12:59:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.552+0000 7f75f39ff700 1 -- 172.21.15.17:0/2556635350 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75d80a1220 msgr2=0x7f75d80a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.552+0000 7f75f39ff700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75d80a1220 0x7f75d80a36d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75ec100b50 tx=0x7f75e8009260 comp rx=0 tx=0).stop 2023-07-14T12:59:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.552+0000 7f75f39ff700 1 -- 172.21.15.17:0/2556635350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75ec100cf0 msgr2=0x7f75ec072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.552+0000 7f75f39ff700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75ec100cf0 0x7f75ec072900 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f75dc005f50 tx=0x7f75dc0040b0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.552+0000 7f75f39ff700 1 -- 172.21.15.17:0/2556635350 shutdown_connections 2023-07-14T12:59:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.552+0000 7f75f39ff700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f75d80a1220 0x7f75d80a36d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.552+0000 7f75f39ff700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f75ec101680 0x7f75ec072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.552+0000 7f75f39ff700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75ec0ffb00 0x7f75ec0742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.552+0000 7f75f39ff700 1 --2- 172.21.15.17:0/2556635350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75ec100cf0 0x7f75ec072900 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.552+0000 7f75f39ff700 1 -- 172.21.15.17:0/2556635350 >> 172.21.15.17:0/2556635350 conn(0x7f75ec0fb0e0 msgr2=0x7f75ec104200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.553+0000 7f75f39ff700 1 -- 172.21.15.17:0/2556635350 shutdown_connections 2023-07-14T12:59:34.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.553+0000 7f75f39ff700 1 -- 172.21.15.17:0/2556635350 wait complete. 2023-07-14T12:59:34.585 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2023-07-14T12:59:34.601 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T12:59:34.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.777+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2512658860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e40ffae0 msgr2=0x7fa5e40ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.777+0000 7fa5ebbff700 1 --2- 172.21.15.17:0/2512658860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e40ffae0 0x7fa5e40ffef0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009990 tx=0x7fa5e0009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.777+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2512658860 shutdown_connections 2023-07-14T12:59:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.777+0000 7fa5ebbff700 1 --2- 172.21.15.17:0/2512658860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e4101660 0x7fa5e4107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.777+0000 7fa5ebbff700 1 --2- 172.21.15.17:0/2512658860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e40ffae0 0x7fa5e40ffef0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.777+0000 7fa5ebbff700 1 --2- 172.21.15.17:0/2512658860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5e4100cd0 0x7fa5e4101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.777+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2512658860 >> 172.21.15.17:0/2512658860 conn(0x7fa5e40fb0e0 msgr2=0x7fa5e40fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.777+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2512658860 shutdown_connections 2023-07-14T12:59:34.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.777+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2512658860 wait complete. 2023-07-14T12:59:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.779+0000 7fa5ebbff700 1 Processor -- start 2023-07-14T12:59:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.779+0000 7fa5ebbff700 1 -- start start 2023-07-14T12:59:34.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.779+0000 7fa5ebbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5e40ffae0 0x7fa5e41957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.779+0000 7fa5ebbff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e4100cd0 0x7fa5e4195ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.779+0000 7fa5ebbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e4101660 0x7fa5e419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.779+0000 7fa5ebbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e419d320 con 0x7fa5e4101660 2023-07-14T12:59:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.779+0000 7fa5ebbff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e419d460 con 0x7fa5e4100cd0 2023-07-14T12:59:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.779+0000 7fa5ebbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e419d5f0 con 0x7fa5e40ffae0 2023-07-14T12:59:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.780+0000 7fa5ea19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e4101660 0x7fa5e419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.780+0000 7fa5e999b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5e40ffae0 0x7fa5e41957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.780+0000 7fa5ea19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e4101660 0x7fa5e419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52136/0 (socket says 172.21.15.17:52136) 2023-07-14T12:59:34.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.780+0000 7fa5ea19c700 1 -- 172.21.15.17:0/2501488486 learned_addr learned my addr 172.21.15.17:0/2501488486 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:34.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.780+0000 7fa5e919a700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e4100cd0 0x7fa5e4195ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.780+0000 7fa5ea19c700 1 -- 172.21.15.17:0/2501488486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5e40ffae0 msgr2=0x7fa5e41957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.780+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5e40ffae0 0x7fa5e41957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.780+0000 7fa5ea19c700 1 -- 172.21.15.17:0/2501488486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e4100cd0 msgr2=0x7fa5e4195ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.780+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e4100cd0 0x7fa5e4195ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.780+0000 7fa5ea19c700 1 -- 172.21.15.17:0/2501488486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e00095f0 con 0x7fa5e4101660 2023-07-14T12:59:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.780+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e4101660 0x7fa5e419cd50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc007ee0 tx=0x7fa5dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.781+0000 7fa5daffd700 1 -- 172.21.15.17:0/2501488486 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc017070 con 0x7fa5e4101660 2023-07-14T12:59:34.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.781+0000 7fa5daffd700 1 -- 172.21.15.17:0/2501488486 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5dc00f040 con 0x7fa5e4101660 2023-07-14T12:59:34.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.781+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2501488486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e419d8d0 con 0x7fa5e4101660 2023-07-14T12:59:34.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.781+0000 7fa5daffd700 1 -- 172.21.15.17:0/2501488486 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc005710 con 0x7fa5e4101660 2023-07-14T12:59:34.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.781+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2501488486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e419dde0 con 0x7fa5e4101660 2023-07-14T12:59:34.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.784+0000 7fa5daffd700 1 -- 172.21.15.17:0/2501488486 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 135715+0+0 (secure 0 0 0) 0x7fa5dc005870 con 0x7fa5e4101660 2023-07-14T12:59:34.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.785+0000 7fa5ff465b80 1 Processor -- start 2023-07-14T12:59:34.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.785+0000 7fa5ff465b80 1 -- start start 2023-07-14T12:59:34.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.785+0000 7fa5daffd700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa5d00a1150 0x7fa5d00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a8134d0 0x559b1a8138e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a813e20 0x559b1a8146e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a8150e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5daffd700 1 -- 172.21.15.17:0/2501488486 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa5dc0cc140 con 0x7fa5e4101660 2023-07-14T12:59:34.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a718cb0 con 0x559b1a814c70 2023-07-14T12:59:34.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a76ba40 con 0x559b1a813e20 2023-07-14T12:59:34.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a764ed0 con 0x559b1a8134d0 2023-07-14T12:59:34.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5e919a700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa5d00a1150 0x7fa5d00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ea19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a8150e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5e999b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a8134d0 0x559b1a8138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ea19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a8150e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52138/0 (socket says 172.21.15.17:52138) 2023-07-14T12:59:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ea19c700 1 -- 172.21.15.17:0/1763413167 learned_addr learned my addr 172.21.15.17:0/1763413167 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5e919a700 1 --2- 172.21.15.17:0/1763413167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a813e20 0x559b1a8146e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ea19c700 1 -- 172.21.15.17:0/1763413167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a8134d0 msgr2=0x559b1a8138e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/1763413167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a8134d0 0x559b1a8138e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ea19c700 1 -- 172.21.15.17:0/1763413167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a813e20 msgr2=0x559b1a8146e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.786+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/1763413167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a813e20 0x559b1a8146e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.787+0000 7fa5ea19c700 1 -- 172.21.15.17:0/1763413167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b1a592de0 con 0x559b1a814c70 2023-07-14T12:59:34.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.787+0000 7fa5e919a700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa5d00a1150 0x7fa5d00a3600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4005950 tx=0x7fa5d4013980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.787+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/1763413167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a8150e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0a1440 tx=0x7fa5dc00df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e263e58a8f6a5d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.787+0000 7fa5cffff700 1 -- 172.21.15.17:0/1763413167 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc095040 con 0x559b1a814c70 2023-07-14T12:59:34.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.787+0000 7fa5cffff700 1 -- 172.21.15.17:0/1763413167 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5dc098e80 con 0x559b1a814c70 2023-07-14T12:59:34.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.787+0000 7fa5cffff700 1 -- 172.21.15.17:0/1763413167 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0840c0 con 0x559b1a814c70 2023-07-14T12:59:34.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.788+0000 7fa5ff465b80 1 -- 172.21.15.17:0/1763413167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 msgr2=0x559b1a8150e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.788+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/1763413167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a8150e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0a1440 tx=0x7fa5dc00df60 comp rx=0 tx=0).stop 2023-07-14T12:59:34.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.788+0000 7fa5ff465b80 1 -- 172.21.15.17:0/1763413167 shutdown_connections 2023-07-14T12:59:34.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.788+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/1763413167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a8150e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.788+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/1763413167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a8134d0 0x559b1a8138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.788+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/1763413167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a813e20 0x559b1a8146e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.788+0000 7fa5ff465b80 1 -- 172.21.15.17:0/1763413167 >> 172.21.15.17:0/1763413167 conn(0x559b1a808da0 msgr2=0x559b1a80e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.788+0000 7fa5ff465b80 1 -- 172.21.15.17:0/1763413167 shutdown_connections 2023-07-14T12:59:34.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.788+0000 7fa5ff465b80 1 -- 172.21.15.17:0/1763413167 wait complete. 2023-07-14T12:59:34.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.788+0000 7fa5ff465b80 1 -- start start 2023-07-14T12:59:34.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.789+0000 7fa5ff465b80 1 Processor -- start 2023-07-14T12:59:34.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.789+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a8215c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.789+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a813e20 0x559b1a821b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.789+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a814c70 0x559b1a828b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.789+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a704ac0 con 0x559b1a8134d0 2023-07-14T12:59:34.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.789+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a7047c0 con 0x559b1a814c70 2023-07-14T12:59:34.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.789+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a5e8920 con 0x559b1a813e20 2023-07-14T12:59:34.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.789+0000 7fa5ff465b80 10 client.0 _ll_register_callbacks cb 0x559b1a702760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:34.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.789+0000 7fa5e999b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a8215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.789+0000 7fa5e999b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a8215c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52154/0 (socket says 172.21.15.17:52154) 2023-07-14T12:59:34.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.789+0000 7fa5e999b700 1 -- 172.21.15.17:0/3608560659 learned_addr learned my addr 172.21.15.17:0/3608560659 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:34.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5e919a700 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a813e20 0x559b1a821b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a814c70 0x559b1a828b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5e999b700 1 -- 172.21.15.17:0/3608560659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a813e20 msgr2=0x559b1a821b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5e999b700 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a813e20 0x559b1a821b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5e999b700 1 -- 172.21.15.17:0/3608560659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a814c70 msgr2=0x559b1a828b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5e999b700 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a814c70 0x559b1a828b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5e999b700 1 -- 172.21.15.17:0/3608560659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e419dde0 con 0x559b1a8134d0 2023-07-14T12:59:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a814c70 0x559b1a828b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T12:59:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5e999b700 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a8215c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009990 tx=0x7fa5e0005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738b79674572cd2f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/3608560659 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e001d070 con 0x559b1a8134d0 2023-07-14T12:59:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/3608560659 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa5e000bd20 con 0x559b1a8134d0 2023-07-14T12:59:34.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.790+0000 7fa5ff465b80 1 -- 172.21.15.17:0/3608560659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b1a6be4f0 con 0x559b1a8134d0 2023-07-14T12:59:34.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.791+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/3608560659 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5e0009ee0 con 0x559b1a8134d0 2023-07-14T12:59:34.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.791+0000 7fa5ff465b80 10 client.15483 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:34.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.791+0000 7fa5ff465b80 1 -- 172.21.15.17:0/3608560659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x559b1a57bc60 con 0x559b1a8134d0 2023-07-14T12:59:34.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.791+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/3608560659 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559b1a6be4f0 con 0x559b1a8134d0 2023-07-14T12:59:34.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.791+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/3608560659 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa5e0003960 con 0x559b1a8134d0 2023-07-14T12:59:34.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.791+0000 7fa5ff465b80 10 client.15483 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:34.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.791+0000 7fa5ff465b80 10 client.15483 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T12:59:34.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.791+0000 7fa5ff465b80 20 client.15483 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:34.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.791+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559b1a82d310 0x559b1a82f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.791+0000 7fa5ff465b80 4 client.15483 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:59:34.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.791+0000 7fa5ff465b80 1 -- 172.21.15.17:0/3608560659 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b1a75deb0 con 0x559b1a82d310 2023-07-14T12:59:34.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.792+0000 7fa5e919a700 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559b1a82d310 0x559b1a82f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.792+0000 7fa5e919a700 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559b1a82d310 0x559b1a82f720 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3d4173d2b3313620 server_cookie=50dd054f799c9106 in_seq=0 out_seq=0 2023-07-14T12:59:34.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.792+0000 7fa5cd7fa700 10 client.15483 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T12:59:34.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.793+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/3608560659 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559b1a75deb0 con 0x559b1a82d310 2023-07-14T12:59:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.793+0000 7fa5cd7fa700 10 client.15483 handle_command_reply: tid=0 2023-07-14T12:59:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.793+0000 7fa5ff465b80 1 client.15483 shutdown 2023-07-14T12:59:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.793+0000 7fa5ff465b80 1 -- 172.21.15.17:0/3608560659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 msgr2=0x559b1a8215c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.793+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a8215c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009990 tx=0x7fa5e0005320 comp rx=0 tx=0).stop 2023-07-14T12:59:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.794+0000 7fa5ff465b80 1 -- 172.21.15.17:0/3608560659 shutdown_connections 2023-07-14T12:59:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.794+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a814c70 0x559b1a828b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.794+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a8215c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.794+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559b1a82d310 0x559b1a82f720 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.794+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/3608560659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a813e20 0x559b1a821b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.794+0000 7fa5ff465b80 1 -- 172.21.15.17:0/3608560659 >> 172.21.15.17:0/3608560659 conn(0x559b1a808da0 msgr2=0x559b1a80d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.794+0000 7fa5cd7fa700 0 client.15483 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T12:59:34.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.794+0000 7fa5ff465b80 1 -- 172.21.15.17:0/3608560659 shutdown_connections 2023-07-14T12:59:34.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.794+0000 7fa5ff465b80 1 -- 172.21.15.17:0/3608560659 wait complete. 2023-07-14T12:59:34.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.794+0000 7fa5ff465b80 20 client.15483 trim_cache size 0 max 16384 2023-07-14T12:59:34.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.807+0000 7fa5ff465b80 1 Processor -- start 2023-07-14T12:59:34.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.807+0000 7fa5ff465b80 1 -- start start 2023-07-14T12:59:34.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a815040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a813e20 0x559b1a828b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a814c70 0x559b1a81c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a80fd00 con 0x559b1a8134d0 2023-07-14T12:59:34.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a805ef0 con 0x559b1a813e20 2023-07-14T12:59:34.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a82d010 con 0x559b1a814c70 2023-07-14T12:59:34.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5e999b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a815040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5e999b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a815040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52166/0 (socket says 172.21.15.17:52166) 2023-07-14T12:59:34.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5e999b700 1 -- 172.21.15.17:0/1917285837 learned_addr learned my addr 172.21.15.17:0/1917285837 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:34.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5e919a700 1 --2- 172.21.15.17:0/1917285837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a813e20 0x559b1a828b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/1917285837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a814c70 0x559b1a81c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5e999b700 1 -- 172.21.15.17:0/1917285837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a814c70 msgr2=0x559b1a81c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5e999b700 1 --2- 172.21.15.17:0/1917285837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a814c70 0x559b1a81c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5e999b700 1 -- 172.21.15.17:0/1917285837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a813e20 msgr2=0x559b1a828b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5e999b700 1 --2- 172.21.15.17:0/1917285837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a813e20 0x559b1a828b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5e999b700 1 -- 172.21.15.17:0/1917285837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b1a5b9250 con 0x559b1a8134d0 2023-07-14T12:59:34.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5e919a700 1 --2- 172.21.15.17:0/1917285837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a813e20 0x559b1a828b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:34.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.808+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/1917285837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a814c70 0x559b1a81c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:34.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.809+0000 7fa5e999b700 1 --2- 172.21.15.17:0/1917285837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a815040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0003c90 tx=0x7fa5e000bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1423d166a6825170 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.809+0000 7fa5d8bff700 1 -- 172.21.15.17:0/1917285837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e001d030 con 0x559b1a8134d0 2023-07-14T12:59:34.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.809+0000 7fa5d8bff700 1 -- 172.21.15.17:0/1917285837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5e001e040 con 0x559b1a8134d0 2023-07-14T12:59:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.809+0000 7fa5d8bff700 1 -- 172.21.15.17:0/1917285837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0004bd0 con 0x559b1a8134d0 2023-07-14T12:59:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.810+0000 7fa5ff465b80 1 -- 172.21.15.17:0/1917285837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 msgr2=0x559b1a815040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.810+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/1917285837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a815040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0003c90 tx=0x7fa5e000bb30 comp rx=0 tx=0).stop 2023-07-14T12:59:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.810+0000 7fa5ff465b80 1 -- 172.21.15.17:0/1917285837 shutdown_connections 2023-07-14T12:59:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.810+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/1917285837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a814c70 0x559b1a81c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.810+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/1917285837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a8134d0 0x559b1a815040 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.810+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/1917285837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a813e20 0x559b1a828b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.810+0000 7fa5ff465b80 1 -- 172.21.15.17:0/1917285837 >> 172.21.15.17:0/1917285837 conn(0x559b1a808da0 msgr2=0x559b1a834080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.810+0000 7fa5ff465b80 1 -- 172.21.15.17:0/1917285837 shutdown_connections 2023-07-14T12:59:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.810+0000 7fa5ff465b80 1 -- 172.21.15.17:0/1917285837 wait complete. 2023-07-14T12:59:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.810+0000 7fa5ff465b80 1 -- start start 2023-07-14T12:59:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.811+0000 7fa5ff465b80 1 Processor -- start 2023-07-14T12:59:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.811+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a8134d0 0x559b1a824650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.811+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a813e20 0x559b1a824b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.811+0000 7fa5ff465b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a827bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.811+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a8280f0 con 0x559b1a814c70 2023-07-14T12:59:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.811+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a828260 con 0x559b1a8134d0 2023-07-14T12:59:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.811+0000 7fa5ff465b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b1a828420 con 0x559b1a813e20 2023-07-14T12:59:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.811+0000 7fa5ff465b80 10 client.0 _ll_register_callbacks cb 0x7fa5e000ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.811+0000 7fa5ea19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a827bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5ea19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a827bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52172/0 (socket says 172.21.15.17:52172) 2023-07-14T12:59:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5ea19c700 1 -- 172.21.15.17:0/584714978 learned_addr learned my addr 172.21.15.17:0/584714978 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5e999b700 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a8134d0 0x559b1a824650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5e919a700 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a813e20 0x559b1a824b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5ea19c700 1 -- 172.21.15.17:0/584714978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a813e20 msgr2=0x559b1a824b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a813e20 0x559b1a824b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5ea19c700 1 -- 172.21.15.17:0/584714978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a8134d0 msgr2=0x559b1a824650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a8134d0 0x559b1a824650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5ea19c700 1 -- 172.21.15.17:0/584714978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b1a57bc60 con 0x559b1a814c70 2023-07-14T12:59:34.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5ea19c700 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a827bb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc000f80 tx=0x7fa5dc007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3554af51c3ab30 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/584714978 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc095040 con 0x559b1a814c70 2023-07-14T12:59:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/584714978 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa5dc099520 con 0x559b1a814c70 2023-07-14T12:59:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.812+0000 7fa5ff465b80 1 -- 172.21.15.17:0/584714978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5dc098e80 con 0x559b1a814c70 2023-07-14T12:59:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.813+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/584714978 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5dc0a1970 con 0x559b1a814c70 2023-07-14T12:59:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.813+0000 7fa5ff465b80 10 client.15489 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:34.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.813+0000 7fa5ff465b80 1 -- 172.21.15.17:0/584714978 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x559b1a5912b0 con 0x559b1a814c70 2023-07-14T12:59:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.813+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/584714978 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa5dc098e80 con 0x559b1a814c70 2023-07-14T12:59:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.813+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/584714978 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa5dc0651a0 con 0x559b1a814c70 2023-07-14T12:59:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.813+0000 7fa5ff465b80 10 client.15489 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.813+0000 7fa5ff465b80 10 client.15489 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T12:59:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.813+0000 7fa5ff465b80 20 client.15489 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.813+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559b1a881b00 0x559b1a883f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.813+0000 7fa5ff465b80 4 client.15489 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T12:59:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.813+0000 7fa5ff465b80 1 -- 172.21.15.17:0/584714978 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559b1a720050 con 0x559b1a881b00 2023-07-14T12:59:34.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.814+0000 7fa5e999b700 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559b1a881b00 0x559b1a883f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:34.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.814+0000 7fa5e999b700 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559b1a881b00 0x559b1a883f10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d20385d8829dbb5 server_cookie=25489141e94f2af9 in_seq=0 out_seq=0 2023-07-14T12:59:34.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.814+0000 7fa5cd7fa700 10 client.15489 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T12:59:34.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.814+0000 7fa5cd7fa700 1 -- 172.21.15.17:0/584714978 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559b1a720050 con 0x559b1a881b00 2023-07-14T12:59:34.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.814+0000 7fa5cd7fa700 10 client.15489 handle_command_reply: tid=0 2023-07-14T12:59:34.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.814+0000 7fa5ff465b80 1 client.15489 shutdown 2023-07-14T12:59:34.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.814+0000 7fa5ff465b80 1 -- 172.21.15.17:0/584714978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 msgr2=0x559b1a827bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.814+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a827bb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc000f80 tx=0x7fa5dc007f10 comp rx=0 tx=0).stop 2023-07-14T12:59:34.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ff465b80 1 -- 172.21.15.17:0/584714978 shutdown_connections 2023-07-14T12:59:34.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559b1a814c70 0x559b1a827bb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559b1a8134d0 0x559b1a824650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559b1a881b00 0x559b1a883f10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ff465b80 1 --2- 172.21.15.17:0/584714978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b1a813e20 0x559b1a824b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5cd7fa700 0 client.15489 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T12:59:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ff465b80 1 -- 172.21.15.17:0/584714978 >> 172.21.15.17:0/584714978 conn(0x559b1a808da0 msgr2=0x559b1a81c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ff465b80 1 -- 172.21.15.17:0/584714978 shutdown_connections 2023-07-14T12:59:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ff465b80 1 -- 172.21.15.17:0/584714978 wait complete. 2023-07-14T12:59:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ff465b80 20 client.15489 trim_cache size 0 max 16384 2023-07-14T12:59:34.853 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T12:59:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2501488486 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa5d00a1150 msgr2=0x7fa5d00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ebbff700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa5d00a1150 0x7fa5d00a3600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4005950 tx=0x7fa5d4013980 comp rx=0 tx=0).stop 2023-07-14T12:59:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2501488486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e4101660 msgr2=0x7fa5e419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.815+0000 7fa5ebbff700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e4101660 0x7fa5e419cd50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc007ee0 tx=0x7fa5dc00d3b0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.816+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2501488486 shutdown_connections 2023-07-14T12:59:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.816+0000 7fa5ebbff700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa5d00a1150 0x7fa5d00a3600 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.816+0000 7fa5ebbff700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5e4101660 0x7fa5e419cd50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.816+0000 7fa5ebbff700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5e40ffae0 0x7fa5e41957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.816+0000 7fa5ebbff700 1 --2- 172.21.15.17:0/2501488486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e4100cd0 0x7fa5e4195ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.816+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2501488486 >> 172.21.15.17:0/2501488486 conn(0x7fa5e40fb0e0 msgr2=0x7fa5e40fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.816+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2501488486 shutdown_connections 2023-07-14T12:59:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.816+0000 7fa5ebbff700 1 -- 172.21.15.17:0/2501488486 wait complete. 2023-07-14T12:59:34.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T12:59:35.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.984+0000 7fe6677fe700 1 -- 172.21.15.17:0/1504333301 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7fe668097a00 con 0x7fe678072f70 2023-07-14T12:59:35.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.984+0000 7fe6677fe700 1 -- 172.21.15.17:0/1504333301 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe668077330 con 0x7fe678072f70 2023-07-14T12:59:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.986+0000 7fe67cfff700 1 -- 172.21.15.17:0/1504333301 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6600a1150 msgr2=0x7fe6600a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.986+0000 7fe67cfff700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6600a1150 0x7fe6600a3600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe678074270 tx=0x7fe66c009260 comp rx=0 tx=0).stop 2023-07-14T12:59:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.986+0000 7fe67cfff700 1 -- 172.21.15.17:0/1504333301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe678072f70 msgr2=0x7fe67819bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.986+0000 7fe67cfff700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe678072f70 0x7fe67819bef0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe6680098e0 tx=0x7fe668004730 comp rx=0 tx=0).stop 2023-07-14T12:59:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.987+0000 7fe67cfff700 1 -- 172.21.15.17:0/1504333301 shutdown_connections 2023-07-14T12:59:35.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.987+0000 7fe67cfff700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fe6600a1150 0x7fe6600a3600 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.987+0000 7fe67cfff700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe67810c0d0 0x7fe67819d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.987+0000 7fe67cfff700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe678072f70 0x7fe67819bef0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.987+0000 7fe67cfff700 1 --2- 172.21.15.17:0/1504333301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe678074550 0x7fe67819c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.987+0000 7fe67cfff700 1 -- 172.21.15.17:0/1504333301 >> 172.21.15.17:0/1504333301 conn(0x7fe6780fb0e0 msgr2=0x7fe6780fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.987+0000 7fe67cfff700 1 -- 172.21.15.17:0/1504333301 shutdown_connections 2023-07-14T12:59:35.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:34.987+0000 7fe67cfff700 1 -- 172.21.15.17:0/1504333301 wait complete. 2023-07-14T12:59:35.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-07-14T12:59:35.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.048+0000 7fadf05ff700 1 -- 172.21.15.17:0/3571079888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade8100560 msgr2=0x7fade8102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.048+0000 7fadf05ff700 1 --2- 172.21.15.17:0/3571079888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade8100560 0x7fade8102940 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fade4009990 tx=0x7fade4009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.048+0000 7fadf05ff700 1 -- 172.21.15.17:0/3571079888 shutdown_connections 2023-07-14T12:59:35.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.048+0000 7fadf05ff700 1 --2- 172.21.15.17:0/3571079888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fade81057a0 0x7fade8107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.048+0000 7fadf05ff700 1 --2- 172.21.15.17:0/3571079888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade8100560 0x7fade8102940 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.048+0000 7fadf05ff700 1 --2- 172.21.15.17:0/3571079888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fade8102e80 0x7fade8105260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.048+0000 7fadf05ff700 1 -- 172.21.15.17:0/3571079888 >> 172.21.15.17:0/3571079888 conn(0x7fade80fa000 msgr2=0x7fade80fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.048+0000 7fadf05ff700 1 -- 172.21.15.17:0/3571079888 shutdown_connections 2023-07-14T12:59:35.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.048+0000 7fadf05ff700 1 -- 172.21.15.17:0/3571079888 wait complete. 2023-07-14T12:59:35.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.050+0000 7fadf05ff700 1 Processor -- start 2023-07-14T12:59:35.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.050+0000 7fadf05ff700 1 -- start start 2023-07-14T12:59:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.050+0000 7fadf05ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade8100560 0x7fade80ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.050+0000 7fadf05ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fade8102e80 0x7fade80fe510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadf05ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fade81057a0 0x7fade80fea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadf05ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade80ff1f0 con 0x7fade8100560 2023-07-14T12:59:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadf05ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade80ff360 con 0x7fade8102e80 2023-07-14T12:59:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadf05ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade819f7f0 con 0x7fade81057a0 2023-07-14T12:59:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadee39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade8100560 0x7fade80ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadee39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade8100560 0x7fade80ffed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50714/0 (socket says 172.21.15.17:50714) 2023-07-14T12:59:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadee39b700 1 -- 172.21.15.17:0/2195508561 learned_addr learned my addr 172.21.15.17:0/2195508561 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fade81057a0 0x7fade80fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadedb9a700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fade8102e80 0x7fade80fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadee39b700 1 -- 172.21.15.17:0/2195508561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fade81057a0 msgr2=0x7fade80fea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadee39b700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fade81057a0 0x7fade80fea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadee39b700 1 -- 172.21.15.17:0/2195508561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fade8102e80 msgr2=0x7fade80fe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadee39b700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fade8102e80 0x7fade80fe510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.051+0000 7fadee39b700 1 -- 172.21.15.17:0/2195508561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade40095f0 con 0x7fade8100560 2023-07-14T12:59:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.052+0000 7fadee39b700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade8100560 0x7fade80ffed0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fade40098e0 tx=0x7fade4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.052+0000 7faddf7fe700 1 -- 172.21.15.17:0/2195508561 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade401d070 con 0x7fade8100560 2023-07-14T12:59:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.052+0000 7fadf05ff700 1 -- 172.21.15.17:0/2195508561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade819fa70 con 0x7fade8100560 2023-07-14T12:59:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.052+0000 7faddf7fe700 1 -- 172.21.15.17:0/2195508561 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fade400bdb0 con 0x7fade8100560 2023-07-14T12:59:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.052+0000 7faddf7fe700 1 -- 172.21.15.17:0/2195508561 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade4022d20 con 0x7fade8100560 2023-07-14T12:59:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.052+0000 7fadf05ff700 1 -- 172.21.15.17:0/2195508561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade819fef0 con 0x7fade8100560 2023-07-14T12:59:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.057+0000 7fae03ecdb80 1 Processor -- start 2023-07-14T12:59:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.057+0000 7fae03ecdb80 1 -- start start 2023-07-14T12:59:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.057+0000 7faddf7fe700 1 -- 172.21.15.17:0/2195508561 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7fade400b920 con 0x7fade8100560 2023-07-14T12:59:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.058+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 0x560aef1de8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.058+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dee20 0x560aef1df6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.058+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dfc70 0x560aef1e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.058+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aef0e3cb0 con 0x560aef1dfc70 2023-07-14T12:59:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.058+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aef136a40 con 0x560aef1de4d0 2023-07-14T12:59:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.058+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aef12fed0 con 0x560aef1dee20 2023-07-14T12:59:35.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.058+0000 7fadeeb9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 0x560aef1de8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.058+0000 7fadeeb9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 0x560aef1de8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33334/0 (socket says 172.21.15.17:33334) 2023-07-14T12:59:35.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.058+0000 7fadeeb9c700 1 -- 172.21.15.17:0/1957758252 learned_addr learned my addr 172.21.15.17:0/1957758252 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.058+0000 7fadee39b700 1 --2- 172.21.15.17:0/1957758252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dee20 0x560aef1df6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.058+0000 7fadedb9a700 1 --2- 172.21.15.17:0/1957758252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dfc70 0x560aef1e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.059+0000 7fadeeb9c700 1 -- 172.21.15.17:0/1957758252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dee20 msgr2=0x560aef1df6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.059+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/1957758252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dee20 0x560aef1df6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.059+0000 7fadeeb9c700 1 -- 172.21.15.17:0/1957758252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dfc70 msgr2=0x560aef1e00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.059+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/1957758252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dfc70 0x560aef1e00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.059+0000 7fadeeb9c700 1 -- 172.21.15.17:0/1957758252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560aeef5dde0 con 0x560aef1de4d0 2023-07-14T12:59:35.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.059+0000 7fadee39b700 1 --2- 172.21.15.17:0/1957758252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dee20 0x560aef1df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.060+0000 7faddf7fe700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fadd40a11a0 0x7fadd40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.061+0000 7faddf7fe700 1 -- 172.21.15.17:0/2195508561 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fade40cdf90 con 0x7fade8100560 2023-07-14T12:59:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.061+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/1957758252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 0x560aef1de8e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fade0011600 tx=0x7fade0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e374c93302bafd31 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.062+0000 7faddcbfe700 1 -- 172.21.15.17:0/1957758252 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade000e040 con 0x560aef1de4d0 2023-07-14T12:59:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.062+0000 7fadee39b700 1 -- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fadd40a11a0 msgr2=0x7fadd40a3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk reading from fd=14 : -104 Unknown error -104 2023-07-14T12:59:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.062+0000 7fadee39b700 1 -- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fadd40a11a0 msgr2=0x7fadd40a3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-07-14T12:59:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.062+0000 7fadee39b700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fadd40a11a0 0x7fadd40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2023-07-14T12:59:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.062+0000 7faddcbfe700 1 -- 172.21.15.17:0/1957758252 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fade000f040 con 0x560aef1de4d0 2023-07-14T12:59:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.062+0000 7faddcbfe700 1 -- 172.21.15.17:0/1957758252 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0004730 con 0x560aef1de4d0 2023-07-14T12:59:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.062+0000 7fadee39b700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fadd40a11a0 0x7fadd40a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:59:35.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.063+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1957758252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 msgr2=0x560aef1de8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.063+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1957758252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 0x560aef1de8e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fade0011600 tx=0x7fade0009920 comp rx=0 tx=0).stop 2023-07-14T12:59:35.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.063+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1957758252 shutdown_connections 2023-07-14T12:59:35.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.063+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1957758252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dfc70 0x560aef1e00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.063+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1957758252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 0x560aef1de8e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.063+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1957758252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dee20 0x560aef1df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.063+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1957758252 >> 172.21.15.17:0/1957758252 conn(0x560aef1d3da0 msgr2=0x560aef1d91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.063+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1957758252 shutdown_connections 2023-07-14T12:59:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.063+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1957758252 wait complete. 2023-07-14T12:59:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.064+0000 7fae03ecdb80 1 -- start start 2023-07-14T12:59:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.064+0000 7fae03ecdb80 1 Processor -- start 2023-07-14T12:59:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.065+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1de4d0 0x560aef1f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.065+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.065+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1dfc70 0x560aef1f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.065+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aef0cfac0 con 0x560aef1dee20 2023-07-14T12:59:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.065+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aef0cf7c0 con 0x560aef1dfc70 2023-07-14T12:59:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.065+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aeefb3920 con 0x560aef1de4d0 2023-07-14T12:59:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.065+0000 7fae03ecdb80 10 client.0 _ll_register_callbacks cb 0x560aef0cd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.066+0000 7fadedb9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.066+0000 7fadedb9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50746/0 (socket says 172.21.15.17:50746) 2023-07-14T12:59:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.066+0000 7fadedb9a700 1 -- 172.21.15.17:0/3158489984 learned_addr learned my addr 172.21.15.17:0/3158489984 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.067+0000 7fadedb9a700 1 -- 172.21.15.17:0/3158489984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1de4d0 msgr2=0x560aef1f09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.067+0000 7fadedb9a700 1 --2- 172.21.15.17:0/3158489984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1de4d0 0x560aef1f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.067+0000 7fadedb9a700 1 -- 172.21.15.17:0/3158489984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1dfc70 msgr2=0x560aef1f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.067+0000 7fadedb9a700 1 --2- 172.21.15.17:0/3158489984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1dfc70 0x560aef1f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.067+0000 7fadedb9a700 1 -- 172.21.15.17:0/3158489984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade00112b0 con 0x560aef1dee20 2023-07-14T12:59:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.067+0000 7fadedb9a700 1 --2- 172.21.15.17:0/3158489984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f0f00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fadd8011830 tx=0x7fadd8011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35d888735ea9970 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.067+0000 7fadd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.068+0000 7fadd1ffb700 1 -- 172.21.15.17:0/3158489984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8016070 con 0x560aef1dee20 2023-07-14T12:59:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.068+0000 7fadd1ffb700 1 -- 172.21.15.17:0/3158489984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fadd800f940 con 0x560aef1dee20 2023-07-14T12:59:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.068+0000 7fae03ecdb80 1 -- 172.21.15.17:0/3158489984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560aef0894f0 con 0x560aef1dee20 2023-07-14T12:59:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.068+0000 7fadd1ffb700 1 -- 172.21.15.17:0/3158489984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadd800fb40 con 0x560aef1dee20 2023-07-14T12:59:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.068+0000 7fae03ecdb80 10 client.15501 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.068+0000 7fae03ecdb80 1 -- 172.21.15.17:0/3158489984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x560aeef46c60 con 0x560aef1dee20 2023-07-14T12:59:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.068+0000 7fadd1ffb700 1 -- 172.21.15.17:0/3158489984 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560aef0894f0 con 0x560aef1dee20 2023-07-14T12:59:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.068+0000 7fadd1ffb700 1 -- 172.21.15.17:0/3158489984 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fadd8023020 con 0x560aef1dee20 2023-07-14T12:59:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.069+0000 7fae03ecdb80 10 client.15501 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.069+0000 7fae03ecdb80 10 client.15501 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T12:59:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.069+0000 7fae03ecdb80 20 client.15501 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.069+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/3158489984 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x560aef1fc8a0 0x560aef1fecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.069+0000 7fae03ecdb80 4 client.15501 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:59:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.069+0000 7fae03ecdb80 1 -- 172.21.15.17:0/3158489984 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560aef128eb0 con 0x560aef1fc8a0 2023-07-14T12:59:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.069+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/3158489984 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x560aef1fc8a0 0x560aef1fecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.070+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/3158489984 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x560aef1fc8a0 0x560aef1fecb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f87201e6a7f192c1 server_cookie=bfcbf0654cfa3fc4 in_seq=0 out_seq=0 2023-07-14T12:59:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.070+0000 7fadd1ffb700 10 client.15501 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T12:59:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.071+0000 7fadd1ffb700 1 -- 172.21.15.17:0/3158489984 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560aef128eb0 con 0x560aef1fc8a0 2023-07-14T12:59:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.071+0000 7fadd1ffb700 10 client.15501 handle_command_reply: tid=0 2023-07-14T12:59:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.071+0000 7fae03ecdb80 1 client.15501 shutdown 2023-07-14T12:59:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.071+0000 7fae03ecdb80 1 -- 172.21.15.17:0/3158489984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 msgr2=0x560aef1f0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.071+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/3158489984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f0f00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fadd8011830 tx=0x7fadd8011bf0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.072+0000 7fae03ecdb80 1 -- 172.21.15.17:0/3158489984 shutdown_connections 2023-07-14T12:59:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.072+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/3158489984 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x560aef1fc8a0 0x560aef1fecb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.072+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/3158489984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1dfc70 0x560aef1f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.072+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/3158489984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1de4d0 0x560aef1f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.072+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/3158489984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f0f00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.072+0000 7fae03ecdb80 1 -- 172.21.15.17:0/3158489984 >> 172.21.15.17:0/3158489984 conn(0x560aef1d3da0 msgr2=0x560aef1d88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.072+0000 7fadd1ffb700 0 client.15501 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T12:59:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.072+0000 7fae03ecdb80 1 -- 172.21.15.17:0/3158489984 shutdown_connections 2023-07-14T12:59:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.072+0000 7fae03ecdb80 1 -- 172.21.15.17:0/3158489984 wait complete. 2023-07-14T12:59:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.072+0000 7fae03ecdb80 20 client.15501 trim_cache size 0 max 16384 2023-07-14T12:59:35.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:34 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1504333301' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-07-14T12:59:35.112 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:34 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2556635350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:35.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.089+0000 7fae03ecdb80 1 Processor -- start 2023-07-14T12:59:35.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.089+0000 7fae03ecdb80 1 -- start start 2023-07-14T12:59:35.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1de4d0 0x560aef1e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1dee20 0x560aef1f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dfc70 0x560aef1fe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aef1f1b40 con 0x560aef1de4d0 2023-07-14T12:59:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aef1f0770 con 0x560aef1dee20 2023-07-14T12:59:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aef1fc570 con 0x560aef1dfc70 2023-07-14T12:59:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fadeeb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1de4d0 0x560aef1e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fadeeb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1de4d0 0x560aef1e6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50762/0 (socket says 172.21.15.17:50762) 2023-07-14T12:59:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fadeeb9c700 1 -- 172.21.15.17:0/1023218865 learned_addr learned my addr 172.21.15.17:0/1023218865 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fadeeb9c700 1 -- 172.21.15.17:0/1023218865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dfc70 msgr2=0x560aef1fe8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/1023218865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dfc70 0x560aef1fe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fadeeb9c700 1 -- 172.21.15.17:0/1023218865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1dee20 msgr2=0x560aef1f7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/1023218865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1dee20 0x560aef1f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.090+0000 7fadeeb9c700 1 -- 172.21.15.17:0/1023218865 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560aeef84250 con 0x560aef1de4d0 2023-07-14T12:59:35.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.091+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/1023218865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1de4d0 0x560aef1e6e80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fade00094a0 tx=0x7fade0006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958c9e54afada884 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.091+0000 7faddd3ff700 1 -- 172.21.15.17:0/1023218865 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade000e070 con 0x560aef1de4d0 2023-07-14T12:59:35.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.091+0000 7faddd3ff700 1 -- 172.21.15.17:0/1023218865 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fade0003e90 con 0x560aef1de4d0 2023-07-14T12:59:35.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.091+0000 7faddd3ff700 1 -- 172.21.15.17:0/1023218865 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0007d40 con 0x560aef1de4d0 2023-07-14T12:59:35.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.092+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1023218865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1de4d0 msgr2=0x560aef1e6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.092+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1023218865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1de4d0 0x560aef1e6e80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fade00094a0 tx=0x7fade0006000 comp rx=0 tx=0).stop 2023-07-14T12:59:35.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.092+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1023218865 shutdown_connections 2023-07-14T12:59:35.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.092+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1023218865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dfc70 0x560aef1fe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.092+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1023218865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1de4d0 0x560aef1e6e80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.092+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1023218865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1dee20 0x560aef1f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.092+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1023218865 >> 172.21.15.17:0/1023218865 conn(0x560aef1d3da0 msgr2=0x560aef2035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.092+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1023218865 shutdown_connections 2023-07-14T12:59:35.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.093+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1023218865 wait complete. 2023-07-14T12:59:35.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.093+0000 7fae03ecdb80 1 -- start start 2023-07-14T12:59:35.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.093+0000 7fae03ecdb80 1 Processor -- start 2023-07-14T12:59:35.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.094+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 0x560aef1f4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.094+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.094+0000 7fae03ecdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dfc70 0x560aef1f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.094+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aef1f7820 con 0x560aef1dee20 2023-07-14T12:59:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.094+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aef1f7990 con 0x560aef1de4d0 2023-07-14T12:59:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.094+0000 7fae03ecdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560aef1f7b50 con 0x560aef1dfc70 2023-07-14T12:59:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.094+0000 7fae03ecdb80 10 client.0 _ll_register_callbacks cb 0x7fadd8009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.094+0000 7fadedb9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.094+0000 7fadedb9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50764/0 (socket says 172.21.15.17:50764) 2023-07-14T12:59:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.094+0000 7fadedb9a700 1 -- 172.21.15.17:0/1306331457 learned_addr learned my addr 172.21.15.17:0/1306331457 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.094+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 0x560aef1f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fadedb9a700 1 -- 172.21.15.17:0/1306331457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dfc70 msgr2=0x560aef1f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fadedb9a700 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dfc70 0x560aef1f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fadedb9a700 1 -- 172.21.15.17:0/1306331457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 msgr2=0x560aef1f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fadedb9a700 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 0x560aef1f4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fadedb9a700 1 -- 172.21.15.17:0/1306331457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560aeef5dde0 con 0x560aef1dee20 2023-07-14T12:59:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 0x560aef1f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fadedb9a700 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f4670 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fadd801ad20 tx=0x7fadd800ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf23e6089f1c7b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fadd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fadd1ffb700 1 -- 172.21.15.17:0/1306331457 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8016070 con 0x560aef1dee20 2023-07-14T12:59:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1306331457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fade000f040 con 0x560aef1dee20 2023-07-14T12:59:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fadd1ffb700 1 -- 172.21.15.17:0/1306331457 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fadd8000e40 con 0x560aef1dee20 2023-07-14T12:59:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.095+0000 7fadd1ffb700 1 -- 172.21.15.17:0/1306331457 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadd80223a0 con 0x560aef1dee20 2023-07-14T12:59:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.096+0000 7fae03ecdb80 10 client.15513 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.096+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1306331457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x560aeef5c2b0 con 0x560aef1dee20 2023-07-14T12:59:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.096+0000 7fadd1ffb700 1 -- 172.21.15.17:0/1306331457 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fade000f040 con 0x560aef1dee20 2023-07-14T12:59:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.096+0000 7fadd1ffb700 1 -- 172.21.15.17:0/1306331457 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fadd80226b0 con 0x560aef1dee20 2023-07-14T12:59:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.096+0000 7fae03ecdb80 10 client.15513 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.096+0000 7fae03ecdb80 10 client.15513 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T12:59:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.096+0000 7fae03ecdb80 20 client.15513 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.096+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x560aef251740 0x560aef253b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.096+0000 7fae03ecdb80 4 client.15513 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T12:59:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.096+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1306331457 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560aef0eb050 con 0x560aef251740 2023-07-14T12:59:35.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.098+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x560aef251740 0x560aef253b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.099+0000 7fadeeb9c700 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x560aef251740 0x560aef253b50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90d93ec009eac39f server_cookie=d5bc5847a9a1c88b in_seq=0 out_seq=0 2023-07-14T12:59:35.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.099+0000 7fadd1ffb700 10 client.15513 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T12:59:35.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fadd1ffb700 1 -- 172.21.15.17:0/1306331457 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560aef0eb050 con 0x560aef251740 2023-07-14T12:59:35.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fadd1ffb700 10 client.15513 handle_command_reply: tid=0 2023-07-14T12:59:35.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 1 client.15513 shutdown 2023-07-14T12:59:35.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1306331457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 msgr2=0x560aef1f4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f4670 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fadd801ad20 tx=0x7fadd800ffa0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1306331457 shutdown_connections 2023-07-14T12:59:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aef1dfc70 0x560aef1f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x560aef251740 0x560aef253b50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560aef1de4d0 0x560aef1f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 1 --2- 172.21.15.17:0/1306331457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560aef1dee20 0x560aef1f4670 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1306331457 >> 172.21.15.17:0/1306331457 conn(0x560aef1d3da0 msgr2=0x560aef1fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fadd1ffb700 0 client.15513 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T12:59:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1306331457 shutdown_connections 2023-07-14T12:59:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 1 -- 172.21.15.17:0/1306331457 wait complete. 2023-07-14T12:59:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.100+0000 7fae03ecdb80 20 client.15513 trim_cache size 0 max 16384 2023-07-14T12:59:35.136 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T12:59:35.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 -- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fadd40a11a0 msgr2=0x7fadd40a3650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:59:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fadd40a11a0 0x7fadd40a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 -- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade8100560 msgr2=0x7fade80ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade8100560 0x7fade80ffed0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fade40098e0 tx=0x7fade4004730 comp rx=0 tx=0).stop 2023-07-14T12:59:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 -- 172.21.15.17:0/2195508561 shutdown_connections 2023-07-14T12:59:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fadd40a11a0 0x7fadd40a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fade81057a0 0x7fade80fea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade8100560 0x7fade80ffed0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 --2- 172.21.15.17:0/2195508561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fade8102e80 0x7fade80fe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 -- 172.21.15.17:0/2195508561 >> 172.21.15.17:0/2195508561 conn(0x7fade80fa000 msgr2=0x7fade81011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 -- 172.21.15.17:0/2195508561 shutdown_connections 2023-07-14T12:59:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.101+0000 7fadf05ff700 1 -- 172.21.15.17:0/2195508561 wait complete. 2023-07-14T12:59:35.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T12:59:35.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:34 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1504333301' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-07-14T12:59:35.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:34 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2556635350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:35.247 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: ignoring --setuser ceph since I am not root 2023-07-14T12:59:35.248 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: ignoring --setgroup ceph since I am not root 2023-07-14T12:59:35.248 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:35 smithi131 ceph-mgr[98433]: -- 172.21.15.131:0/608050025 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5578ad78b1e0 con 0x5578ad760c00 2023-07-14T12:59:35.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.257+0000 7ff8451ff700 1 -- 172.21.15.17:0/3430614838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff840100d70 msgr2=0x7ff8401031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.257+0000 7ff8451ff700 1 --2- 172.21.15.17:0/3430614838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff840100d70 0x7ff8401031f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff8340098f0 tx=0x7ff834009c00 comp rx=0 tx=0).stop 2023-07-14T12:59:35.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.257+0000 7ff8451ff700 1 -- 172.21.15.17:0/3430614838 shutdown_connections 2023-07-14T12:59:35.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.257+0000 7ff8451ff700 1 --2- 172.21.15.17:0/3430614838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff840103730 0x7ff840103bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.257+0000 7ff8451ff700 1 --2- 172.21.15.17:0/3430614838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8400fe410 0x7ff840100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.257+0000 7ff8451ff700 1 --2- 172.21.15.17:0/3430614838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff840100d70 0x7ff8401031f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.257+0000 7ff8451ff700 1 -- 172.21.15.17:0/3430614838 >> 172.21.15.17:0/3430614838 conn(0x7ff8400fa000 msgr2=0x7ff8400fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.258+0000 7ff8451ff700 1 -- 172.21.15.17:0/3430614838 shutdown_connections 2023-07-14T12:59:35.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.258+0000 7ff8451ff700 1 -- 172.21.15.17:0/3430614838 wait complete. 2023-07-14T12:59:35.290 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:34 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1504333301' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-07-14T12:59:35.290 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:34 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2556635350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T12:59:35.290 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: ignoring --setuser ceph since I am not root 2023-07-14T12:59:35.290 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: ignoring --setgroup ceph since I am not root 2023-07-14T12:59:35.291 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:35 smithi135 ceph-mgr[99319]: -- 172.21.15.135:0/3327202205 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563be81ab1e0 con 0x563be8180800 2023-07-14T12:59:35.291 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:35.258+0000 7f8e1a2ea200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:59:35.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.259+0000 7ff8451ff700 1 Processor -- start 2023-07-14T12:59:35.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.259+0000 7ff8451ff700 1 -- start start 2023-07-14T12:59:35.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.260+0000 7ff8451ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8400fe410 0x7ff84019bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.260+0000 7ff8451ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff840100d70 0x7ff84019c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.260+0000 7ff8451ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff840103730 0x7ff84019d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.260+0000 7ff8451ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84019d8f0 con 0x7ff840100d70 2023-07-14T12:59:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.260+0000 7ff8451ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84019da60 con 0x7ff840103730 2023-07-14T12:59:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.260+0000 7ff8451ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84019dc20 con 0x7ff8400fe410 2023-07-14T12:59:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.260+0000 7ff83ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8400fe410 0x7ff84019bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.260+0000 7ff83e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff840100d70 0x7ff84019c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.260+0000 7ff83ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8400fe410 0x7ff84019bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:32796/0 (socket says 172.21.15.17:32796) 2023-07-14T12:59:35.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.260+0000 7ff83ed9d700 1 -- 172.21.15.17:0/892445272 learned_addr learned my addr 172.21.15.17:0/892445272 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.260+0000 7ff83f59e700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff840103730 0x7ff84019d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff83ed9d700 1 -- 172.21.15.17:0/892445272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff840103730 msgr2=0x7ff84019d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff83ed9d700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff840103730 0x7ff84019d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff83ed9d700 1 -- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff840100d70 msgr2=0x7ff84019c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff83ed9d700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff840100d70 0x7ff84019c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff83ed9d700 1 -- 172.21.15.17:0/892445272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834009520 con 0x7ff8400fe410 2023-07-14T12:59:35.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff83f59e700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff840103730 0x7ff84019d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:35.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff83e59c700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff840100d70 0x7ff84019c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:35.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff83ed9d700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8400fe410 0x7ff84019bed0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff83000e970 tx=0x7ff83000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff827fff700 1 -- 172.21.15.17:0/892445272 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830009790 con 0x7ff8400fe410 2023-07-14T12:59:35.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff8451ff700 1 -- 172.21.15.17:0/892445272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84019df00 con 0x7ff8400fe410 2023-07-14T12:59:35.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff827fff700 1 -- 172.21.15.17:0/892445272 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff83000c7e0 con 0x7ff8400fe410 2023-07-14T12:59:35.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.261+0000 7ff827fff700 1 -- 172.21.15.17:0/892445272 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830003bd0 con 0x7ff8400fe410 2023-07-14T12:59:35.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.262+0000 7ff8451ff700 1 -- 172.21.15.17:0/892445272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8401a46c0 con 0x7ff8400fe410 2023-07-14T12:59:35.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.263+0000 7ff8451ff700 1 -- 172.21.15.17:0/892445272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8400fbb70 con 0x7ff8400fe410 2023-07-14T12:59:35.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.265+0000 7ff827fff700 1 -- 172.21.15.17:0/892445272 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7ff83000c950 con 0x7ff8400fe410 2023-07-14T12:59:35.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.267+0000 7ff827fff700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff8280a11a0 0x7ff8280a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.267+0000 7ff83e59c700 1 -- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff8280a11a0 msgr2=0x7ff8280a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:35.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.267+0000 7ff827fff700 1 -- 172.21.15.17:0/892445272 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7ff830014070 con 0x7ff8400fe410 2023-07-14T12:59:35.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.267+0000 7ff83e59c700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff8280a11a0 0x7ff8280a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:59:35.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.274+0000 7ff827fff700 1 -- 172.21.15.17:0/892445272 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff8300962b0 con 0x7ff8400fe410 2023-07-14T12:59:35.445 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: ignoring --setuser ceph since I am not root 2023-07-14T12:59:35.445 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: ignoring --setgroup ceph since I am not root 2023-07-14T12:59:35.445 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:35.303+0000 7f6466177200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:59:35.446 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:35.414+0000 7f6466177200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:59:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.418+0000 7fafe159d700 1 -- 172.21.15.17:0/1108209131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc0febf0 msgr2=0x7fafdc0ff060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.418+0000 7fafe159d700 1 --2- 172.21.15.17:0/1108209131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc0febf0 0x7fafdc0ff060 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009990 tx=0x7fafc4009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.418+0000 7fafe159d700 1 -- 172.21.15.17:0/1108209131 shutdown_connections 2023-07-14T12:59:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.418+0000 7fafe159d700 1 --2- 172.21.15.17:0/1108209131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ff5a0 0x7fafdc0ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.418+0000 7fafe159d700 1 --2- 172.21.15.17:0/1108209131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0fe2a0 0x7fafdc0fe6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.418+0000 7fafe159d700 1 --2- 172.21.15.17:0/1108209131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc0febf0 0x7fafdc0ff060 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.418+0000 7fafe159d700 1 -- 172.21.15.17:0/1108209131 >> 172.21.15.17:0/1108209131 conn(0x7fafdc0f9ed0 msgr2=0x7fafdc0fc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.418+0000 7fafe159d700 1 -- 172.21.15.17:0/1108209131 shutdown_connections 2023-07-14T12:59:35.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.418+0000 7fafe159d700 1 -- 172.21.15.17:0/1108209131 wait complete. 2023-07-14T12:59:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.419+0000 7fafe159d700 1 Processor -- start 2023-07-14T12:59:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafe159d700 1 -- start start 2023-07-14T12:59:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafe159d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc0fe2a0 0x7fafdc1976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafe159d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0febf0 0x7fafdc197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafe159d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ff5a0 0x7fafdc19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafe159d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc19f250 con 0x7fafdc0fe2a0 2023-07-14T12:59:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafe159d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc19f390 con 0x7fafdc0ff5a0 2023-07-14T12:59:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafe159d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc19f520 con 0x7fafdc0febf0 2023-07-14T12:59:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafd3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0febf0 0x7fafdc197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafdbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc0fe2a0 0x7fafdc1976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafd3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0febf0 0x7fafdc197c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:32814/0 (socket says 172.21.15.17:32814) 2023-07-14T12:59:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafd3fff700 1 -- 172.21.15.17:0/4198547116 learned_addr learned my addr 172.21.15.17:0/4198547116 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.420+0000 7fafe0d9c700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ff5a0 0x7fafdc19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.421+0000 7fafd3fff700 1 -- 172.21.15.17:0/4198547116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ff5a0 msgr2=0x7fafdc19ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.421+0000 7fafd3fff700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ff5a0 0x7fafdc19ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.421+0000 7fafd3fff700 1 -- 172.21.15.17:0/4198547116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc0fe2a0 msgr2=0x7fafdc1976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.421+0000 7fafd3fff700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc0fe2a0 0x7fafdc1976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.421+0000 7fafd3fff700 1 -- 172.21.15.17:0/4198547116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40095f0 con 0x7fafdc0febf0 2023-07-14T12:59:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.421+0000 7fafd3fff700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0febf0 0x7fafdc197c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fafc40098e0 tx=0x7fafc4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.421+0000 7fafd9ffb700 1 -- 172.21.15.17:0/4198547116 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc401d070 con 0x7fafdc0febf0 2023-07-14T12:59:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.421+0000 7fafe159d700 1 -- 172.21.15.17:0/4198547116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafdc19f7a0 con 0x7fafdc0febf0 2023-07-14T12:59:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.421+0000 7fafd9ffb700 1 -- 172.21.15.17:0/4198547116 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fafc400bdb0 con 0x7fafdc0febf0 2023-07-14T12:59:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.422+0000 7fafd9ffb700 1 -- 172.21.15.17:0/4198547116 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4022d20 con 0x7fafdc0febf0 2023-07-14T12:59:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.422+0000 7fafe159d700 1 -- 172.21.15.17:0/4198547116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafdc19fc20 con 0x7fafdc0febf0 2023-07-14T12:59:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.425+0000 7fafd9ffb700 1 -- 172.21.15.17:0/4198547116 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7fafc400b920 con 0x7fafdc0febf0 2023-07-14T12:59:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.427+0000 7fafd9ffb700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc80a1240 0x7fafc80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.427+0000 7fafdbfff700 1 -- 172.21.15.17:0/4198547116 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc80a1240 msgr2=0x7fafc80a36f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.427+0000 7fafd9ffb700 1 -- 172.21.15.17:0/4198547116 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fafc40cdfb0 con 0x7fafdc0febf0 2023-07-14T12:59:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.427+0000 7fafdbfff700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc80a1240 0x7fafc80a36f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:59:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.428+0000 7faff6182b80 1 Processor -- start 2023-07-14T12:59:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.429+0000 7faff6182b80 1 -- start start 2023-07-14T12:59:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.429+0000 7faff6182b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.429+0000 7faff6182b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 0x55bc7a7aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.429+0000 7faff6182b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 0x55bc7a7ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.429+0000 7faff6182b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a6aecb0 con 0x55bc7a7aae30 2023-07-14T12:59:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.429+0000 7faff6182b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a701a40 con 0x55bc7a7aa070 2023-07-14T12:59:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.429+0000 7faff6182b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a6faed0 con 0x55bc7a7a9720 2023-07-14T12:59:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.429+0000 7fafdbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafdbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:32824/0 (socket says 172.21.15.17:32824) 2023-07-14T12:59:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafdbfff700 1 -- 172.21.15.17:0/659280825 learned_addr learned my addr 172.21.15.17:0/659280825 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafd3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 0x55bc7a7aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafe0d9c700 1 --2- 172.21.15.17:0/659280825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 0x55bc7a7ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafdbfff700 1 -- 172.21.15.17:0/659280825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 msgr2=0x55bc7a7aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafdbfff700 1 --2- 172.21.15.17:0/659280825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 0x55bc7a7aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafdbfff700 1 -- 172.21.15.17:0/659280825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 msgr2=0x55bc7a7ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafdbfff700 1 --2- 172.21.15.17:0/659280825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 0x55bc7a7ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafdbfff700 1 -- 172.21.15.17:0/659280825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc7a528de0 con 0x55bc7a7a9720 2023-07-14T12:59:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafe0d9c700 1 --2- 172.21.15.17:0/659280825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 0x55bc7a7ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:35.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafd3fff700 1 --2- 172.21.15.17:0/659280825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 0x55bc7a7aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:35.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.430+0000 7fafdbfff700 1 --2- 172.21.15.17:0/659280825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7a9b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009e80 tx=0x7fafcc011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9046e4e0fb9fab93 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.431+0000 7fafd27fc700 1 -- 172.21.15.17:0/659280825 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc011c80 con 0x55bc7a7a9720 2023-07-14T12:59:35.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.431+0000 7fafd27fc700 1 -- 172.21.15.17:0/659280825 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fafcc011de0 con 0x55bc7a7a9720 2023-07-14T12:59:35.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.431+0000 7fafd27fc700 1 -- 172.21.15.17:0/659280825 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc003e60 con 0x55bc7a7a9720 2023-07-14T12:59:35.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.432+0000 7faff6182b80 1 -- 172.21.15.17:0/659280825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 msgr2=0x55bc7a7a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.432+0000 7faff6182b80 1 --2- 172.21.15.17:0/659280825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7a9b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009e80 tx=0x7fafcc011720 comp rx=0 tx=0).stop 2023-07-14T12:59:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.432+0000 7faff6182b80 1 -- 172.21.15.17:0/659280825 shutdown_connections 2023-07-14T12:59:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.432+0000 7faff6182b80 1 --2- 172.21.15.17:0/659280825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 0x55bc7a7ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.432+0000 7faff6182b80 1 --2- 172.21.15.17:0/659280825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7a9b30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.432+0000 7faff6182b80 1 --2- 172.21.15.17:0/659280825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 0x55bc7a7aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.432+0000 7faff6182b80 1 -- 172.21.15.17:0/659280825 >> 172.21.15.17:0/659280825 conn(0x55bc7a79eff0 msgr2=0x55bc7a7a4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.432+0000 7faff6182b80 1 -- 172.21.15.17:0/659280825 shutdown_connections 2023-07-14T12:59:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.432+0000 7faff6182b80 1 -- 172.21.15.17:0/659280825 wait complete. 2023-07-14T12:59:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.433+0000 7faff6182b80 1 -- start start 2023-07-14T12:59:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.433+0000 7faff6182b80 1 Processor -- start 2023-07-14T12:59:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7faff6182b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7a9720 0x55bc7a7b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7faff6182b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7aa070 0x55bc7a7b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7faff6182b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aae30 0x55bc7a7ba900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7faff6182b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a69aac0 con 0x55bc7a7a9720 2023-07-14T12:59:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7faff6182b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a69a7c0 con 0x55bc7a7aae30 2023-07-14T12:59:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7faff6182b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a57e920 con 0x55bc7a7aa070 2023-07-14T12:59:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7faff6182b80 10 client.0 _ll_register_callbacks cb 0x55bc7a698760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7fafdbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7a9720 0x55bc7a7b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7fafd3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7aa070 0x55bc7a7b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7fafdbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7a9720 0x55bc7a7b3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50840/0 (socket says 172.21.15.17:50840) 2023-07-14T12:59:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7fafdbfff700 1 -- 172.21.15.17:0/2470099274 learned_addr learned my addr 172.21.15.17:0/2470099274 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7fafe0d9c700 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aae30 0x55bc7a7ba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7fafd3fff700 1 -- 172.21.15.17:0/2470099274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aae30 msgr2=0x55bc7a7ba900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7fafd3fff700 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aae30 0x55bc7a7ba900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7fafd3fff700 1 -- 172.21.15.17:0/2470099274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7a9720 msgr2=0x55bc7a7b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7fafd3fff700 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7a9720 0x55bc7a7b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.434+0000 7fafd3fff700 1 -- 172.21.15.17:0/2470099274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafdc19fc20 con 0x55bc7a7aa070 2023-07-14T12:59:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.435+0000 7fafd3fff700 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7aa070 0x55bc7a7b38c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fafc409b120 tx=0x7fafc4009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0356ffc87c3fa8c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.435+0000 7fafbb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T12:59:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.435+0000 7fafbb7fe700 1 -- 172.21.15.17:0/2470099274 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40b1030 con 0x55bc7a7aa070 2023-07-14T12:59:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.435+0000 7faff6182b80 1 -- 172.21.15.17:0/2470099274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc7a6544f0 con 0x55bc7a7aa070 2023-07-14T12:59:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7fafbb7fe700 1 -- 172.21.15.17:0/2470099274 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fafc40b2070 con 0x55bc7a7aa070 2023-07-14T12:59:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7fafbb7fe700 1 -- 172.21.15.17:0/2470099274 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafc409b420 con 0x55bc7a7aa070 2023-07-14T12:59:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7faff6182b80 10 client.25297 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7faff6182b80 1 -- 172.21.15.17:0/2470099274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7fafcc009ae0 con 0x55bc7a7aa070 2023-07-14T12:59:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7fafbb7fe700 1 -- 172.21.15.17:0/2470099274 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fafc40c9020 con 0x55bc7a7aa070 2023-07-14T12:59:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7fafbb7fe700 1 -- 172.21.15.17:0/2470099274 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fafc409f0b0 con 0x55bc7a7aa070 2023-07-14T12:59:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7faff6182b80 10 client.25297 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7faff6182b80 10 client.25297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T12:59:35.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7faff6182b80 20 client.25297 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7faff6182b80 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bc7a7bed40 0x55bc7a7c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7faff6182b80 4 client.25297 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:59:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.436+0000 7faff6182b80 1 -- 172.21.15.17:0/2470099274 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc7a6f3eb0 con 0x55bc7a7bed40 2023-07-14T12:59:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.437+0000 7fafdbfff700 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bc7a7bed40 0x55bc7a7c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.438+0000 7fafbb7fe700 10 client.25297 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.438+0000 7fafdbfff700 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bc7a7bed40 0x55bc7a7c1120 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=113fa3828d115e91 server_cookie=94e4c1d41952294 in_seq=0 out_seq=0 2023-07-14T12:59:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.438+0000 7fafbb7fe700 1 -- 172.21.15.17:0/2470099274 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bc7a6f3eb0 con 0x55bc7a7bed40 2023-07-14T12:59:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7fafbb7fe700 10 client.25297 handle_command_reply: tid=0 2023-07-14T12:59:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7faff6182b80 1 client.25297 shutdown 2023-07-14T12:59:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7faff6182b80 1 -- 172.21.15.17:0/2470099274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7aa070 msgr2=0x55bc7a7b38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7faff6182b80 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7aa070 0x55bc7a7b38c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fafc409b120 tx=0x7fafc4009310 comp rx=0 tx=0).stop 2023-07-14T12:59:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7faff6182b80 1 -- 172.21.15.17:0/2470099274 shutdown_connections 2023-07-14T12:59:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7faff6182b80 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bc7a7bed40 0x55bc7a7c1120 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7faff6182b80 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aae30 0x55bc7a7ba900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7faff6182b80 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7a9720 0x55bc7a7b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7faff6182b80 1 --2- 172.21.15.17:0/2470099274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7aa070 0x55bc7a7b38c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7faff6182b80 1 -- 172.21.15.17:0/2470099274 >> 172.21.15.17:0/2470099274 conn(0x55bc7a79eff0 msgr2=0x55bc7a7a3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7fafbb7fe700 0 client.25297 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7faff6182b80 1 -- 172.21.15.17:0/2470099274 shutdown_connections 2023-07-14T12:59:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.439+0000 7faff6182b80 1 -- 172.21.15.17:0/2470099274 wait complete. 2023-07-14T12:59:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.440+0000 7faff6182b80 20 client.25297 trim_cache size 0 max 16384 2023-07-14T12:59:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.467+0000 7faff6182b80 1 Processor -- start 2023-07-14T12:59:35.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.467+0000 7faff6182b80 1 -- start start 2023-07-14T12:59:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7ff83e59c700 1 -- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff8280a11a0 msgr2=0x7ff8280a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:35.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7ff83e59c700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff8280a11a0 0x7ff8280a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T12:59:35.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7faff6182b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7a9720 0x55bc7a7a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7faff6182b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aa070 0x55bc7a7ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7faff6182b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7aae30 0x55bc7a7c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7faff6182b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a79eb70 con 0x55bc7a7aa070 2023-07-14T12:59:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7faff6182b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a7b0fd0 con 0x55bc7a7a9720 2023-07-14T12:59:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7faff6182b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a7aa690 con 0x55bc7a7aae30 2023-07-14T12:59:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7fafd3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aa070 0x55bc7a7ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7fafdbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7a9720 0x55bc7a7a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7fafd3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aa070 0x55bc7a7ba8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50842/0 (socket says 172.21.15.17:50842) 2023-07-14T12:59:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7fafd3fff700 1 -- 172.21.15.17:0/2589893528 learned_addr learned my addr 172.21.15.17:0/2589893528 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.468+0000 7fafe0d9c700 1 --2- 172.21.15.17:0/2589893528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7aae30 0x55bc7a7c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.469+0000 7fafdbfff700 1 -- 172.21.15.17:0/2589893528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7aae30 msgr2=0x55bc7a7c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.469+0000 7fafdbfff700 1 --2- 172.21.15.17:0/2589893528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7aae30 0x55bc7a7c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.469+0000 7fafdbfff700 1 -- 172.21.15.17:0/2589893528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aa070 msgr2=0x55bc7a7ba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.469+0000 7fafdbfff700 1 --2- 172.21.15.17:0/2589893528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aa070 0x55bc7a7ba8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.469+0000 7fafdbfff700 1 -- 172.21.15.17:0/2589893528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc7a511c60 con 0x55bc7a7a9720 2023-07-14T12:59:35.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.469+0000 7fafdbfff700 1 --2- 172.21.15.17:0/2589893528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7a9720 0x55bc7a7a9af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55bc7a7c1a00 tx=0x7fafcc003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97ce248ede4e2598 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.469+0000 7fafd2ffd700 1 -- 172.21.15.17:0/2589893528 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc02c070 con 0x55bc7a7a9720 2023-07-14T12:59:35.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.469+0000 7fafd2ffd700 1 -- 172.21.15.17:0/2589893528 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fafcc0285e0 con 0x55bc7a7a9720 2023-07-14T12:59:35.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.469+0000 7fafd2ffd700 1 -- 172.21.15.17:0/2589893528 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc028d80 con 0x55bc7a7a9720 2023-07-14T12:59:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.470+0000 7faff6182b80 1 -- 172.21.15.17:0/2589893528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7a9720 msgr2=0x55bc7a7a9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.470+0000 7faff6182b80 1 --2- 172.21.15.17:0/2589893528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7a9720 0x55bc7a7a9af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55bc7a7c1a00 tx=0x7fafcc003680 comp rx=0 tx=0).stop 2023-07-14T12:59:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.470+0000 7faff6182b80 1 -- 172.21.15.17:0/2589893528 shutdown_connections 2023-07-14T12:59:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.470+0000 7faff6182b80 1 --2- 172.21.15.17:0/2589893528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7aae30 0x55bc7a7c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.470+0000 7faff6182b80 1 --2- 172.21.15.17:0/2589893528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7a9720 0x55bc7a7a9af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.470+0000 7faff6182b80 1 --2- 172.21.15.17:0/2589893528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aa070 0x55bc7a7ba8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.470+0000 7faff6182b80 1 -- 172.21.15.17:0/2589893528 >> 172.21.15.17:0/2589893528 conn(0x55bc7a79eff0 msgr2=0x55bc7a7a4430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.470+0000 7faff6182b80 1 -- 172.21.15.17:0/2589893528 shutdown_connections 2023-07-14T12:59:35.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.471+0000 7faff6182b80 1 -- 172.21.15.17:0/2589893528 wait complete. 2023-07-14T12:59:35.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.471+0000 7faff6182b80 1 -- start start 2023-07-14T12:59:35.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.471+0000 7faff6182b80 1 Processor -- start 2023-07-14T12:59:35.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.472+0000 7faff6182b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.472+0000 7faff6182b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 0x55bc7a7b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.472+0000 7faff6182b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 0x55bc7a7b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.472+0000 7faff6182b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a7ba400 con 0x55bc7a7aae30 2023-07-14T12:59:35.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.472+0000 7faff6182b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a7ba570 con 0x55bc7a7aa070 2023-07-14T12:59:35.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.472+0000 7faff6182b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7a7ba730 con 0x55bc7a7a9720 2023-07-14T12:59:35.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.472+0000 7faff6182b80 10 client.0 _ll_register_callbacks cb 0x7fafc409af60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:35.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.472+0000 7fafdbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.472+0000 7fafd3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 0x55bc7a7b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.472+0000 7fafdbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7b6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:32846/0 (socket says 172.21.15.17:32846) 2023-07-14T12:59:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.472+0000 7fafdbfff700 1 -- 172.21.15.17:0/256018897 learned_addr learned my addr 172.21.15.17:0/256018897 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.473+0000 7fafe0d9c700 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 0x55bc7a7b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.473+0000 7fafdbfff700 1 -- 172.21.15.17:0/256018897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 msgr2=0x55bc7a7b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.473+0000 7fafdbfff700 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 0x55bc7a7b6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.473+0000 7fafdbfff700 1 -- 172.21.15.17:0/256018897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 msgr2=0x55bc7a7b9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.473+0000 7fafdbfff700 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 0x55bc7a7b9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.473+0000 7fafdbfff700 1 -- 172.21.15.17:0/256018897 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc7a528de0 con 0x55bc7a7a9720 2023-07-14T12:59:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.473+0000 7fafd3fff700 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 0x55bc7a7b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.473+0000 7fafe0d9c700 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 0x55bc7a7b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T12:59:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.473+0000 7fafdbfff700 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7b6a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fafcc003bb0 tx=0x7fafcc011b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6dd8c8f1afb8d48 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.473+0000 7fafbb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T12:59:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.473+0000 7fafbb7fe700 1 -- 172.21.15.17:0/256018897 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc02c070 con 0x55bc7a7a9720 2023-07-14T12:59:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7faff6182b80 1 -- 172.21.15.17:0/256018897 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fafcc011de0 con 0x55bc7a7a9720 2023-07-14T12:59:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7fafbb7fe700 1 -- 172.21.15.17:0/256018897 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fafcc028360 con 0x55bc7a7a9720 2023-07-14T12:59:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7fafbb7fe700 1 -- 172.21.15.17:0/256018897 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafcc0039d0 con 0x55bc7a7a9720 2023-07-14T12:59:35.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7faff6182b80 10 client.25303 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:35.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7faff6182b80 1 -- 172.21.15.17:0/256018897 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55bc7a54f250 con 0x55bc7a7a9720 2023-07-14T12:59:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7fafbb7fe700 1 -- 172.21.15.17:0/256018897 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fafcc011de0 con 0x55bc7a7a9720 2023-07-14T12:59:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7fafbb7fe700 1 -- 172.21.15.17:0/256018897 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fafcc0247f0 con 0x55bc7a7a9720 2023-07-14T12:59:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7faff6182b80 10 client.25303 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7faff6182b80 10 client.25303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T12:59:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7faff6182b80 20 client.25303 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7faff6182b80 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bc7a813920 0x55bc7a815d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7faff6182b80 4 client.25303 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T12:59:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.474+0000 7faff6182b80 1 -- 172.21.15.17:0/256018897 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bc7a6b6050 con 0x55bc7a813920 2023-07-14T12:59:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.475+0000 7fafd3fff700 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bc7a813920 0x55bc7a815d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.475+0000 7fafd3fff700 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bc7a813920 0x55bc7a815d30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3b59b24a0e5efb3 server_cookie=3eca1f6e9483a6cb in_seq=0 out_seq=0 2023-07-14T12:59:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.475+0000 7fafbb7fe700 10 client.25303 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7fafbb7fe700 1 -- 172.21.15.17:0/256018897 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bc7a6b6050 con 0x55bc7a813920 2023-07-14T12:59:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7fafbb7fe700 10 client.25303 handle_command_reply: tid=0 2023-07-14T12:59:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 1 client.25303 shutdown 2023-07-14T12:59:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 1 -- 172.21.15.17:0/256018897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 msgr2=0x55bc7a7b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7b6a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fafcc003bb0 tx=0x7fafcc011b20 comp rx=0 tx=0).stop 2023-07-14T12:59:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 1 -- 172.21.15.17:0/256018897 shutdown_connections 2023-07-14T12:59:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bc7a813920 0x55bc7a815d30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bc7a7aae30 0x55bc7a7b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bc7a7a9720 0x55bc7a7b6a50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7fafbb7fe700 0 client.25303 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 1 --2- 172.21.15.17:0/256018897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bc7a7aa070 0x55bc7a7b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 1 -- 172.21.15.17:0/256018897 >> 172.21.15.17:0/256018897 conn(0x55bc7a79eff0 msgr2=0x55bc7a7b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 1 -- 172.21.15.17:0/256018897 shutdown_connections 2023-07-14T12:59:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 1 -- 172.21.15.17:0/256018897 wait complete. 2023-07-14T12:59:35.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.476+0000 7faff6182b80 20 client.25303 trim_cache size 0 max 16384 2023-07-14T12:59:35.515 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T12:59:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 -- 172.21.15.17:0/4198547116 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc80a1240 msgr2=0x7fafc80a36f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:59:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc80a1240 0x7fafc80a36f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 -- 172.21.15.17:0/4198547116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0febf0 msgr2=0x7fafdc197c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0febf0 0x7fafdc197c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fafc40098e0 tx=0x7fafc4004730 comp rx=0 tx=0).stop 2023-07-14T12:59:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 -- 172.21.15.17:0/4198547116 shutdown_connections 2023-07-14T12:59:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fafc80a1240 0x7fafc80a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fafdc0ff5a0 0x7fafdc19ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafdc0fe2a0 0x7fafdc1976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 --2- 172.21.15.17:0/4198547116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc0febf0 0x7fafdc197c10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 -- 172.21.15.17:0/4198547116 >> 172.21.15.17:0/4198547116 conn(0x7fafdc0f9ed0 msgr2=0x7fafdc0fbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 -- 172.21.15.17:0/4198547116 shutdown_connections 2023-07-14T12:59:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.477+0000 7fafe159d700 1 -- 172.21.15.17:0/4198547116 wait complete. 2023-07-14T12:59:35.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.547+0000 7ff8451ff700 1 -- 172.21.15.17:0/892445272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7ff84002ca80 con 0x7ff8400fe410 2023-07-14T12:59:35.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.555+0000 7ff827fff700 1 -- 172.21.15.17:0/892445272 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff8300998d0 con 0x7ff8400fe410 2023-07-14T12:59:35.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 -- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff8280a11a0 msgr2=0x7ff8280a3650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:59:35.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff8280a11a0 0x7ff8280a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 -- 172.21.15.17:0/892445272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8400fe410 msgr2=0x7ff84019bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8400fe410 0x7ff84019bed0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff83000e970 tx=0x7ff83000ec80 comp rx=0 tx=0).stop 2023-07-14T12:59:35.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 -- 172.21.15.17:0/892445272 shutdown_connections 2023-07-14T12:59:35.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7ff8280a11a0 0x7ff8280a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff840103730 0x7ff84019d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8400fe410 0x7ff84019bed0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 --2- 172.21.15.17:0/892445272 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff840100d70 0x7ff84019c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 -- 172.21.15.17:0/892445272 >> 172.21.15.17:0/892445272 conn(0x7ff8400fa000 msgr2=0x7ff8400ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 -- 172.21.15.17:0/892445272 shutdown_connections 2023-07-14T12:59:35.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.558+0000 7ff8451ff700 1 -- 172.21.15.17:0/892445272 wait complete. 2023-07-14T12:59:35.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-07-14T12:59:35.629 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:35.259+0000 7f7e7b9d5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T12:59:35.629 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:35.363+0000 7f7e7b9d5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:59:35.630 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:35.479+0000 7f7e7b9d5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:59:35.633 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:35.365+0000 7f8e1a2ea200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T12:59:35.634 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:35.482+0000 7f8e1a2ea200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:59:35.634 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:35.603+0000 7f8e1a2ea200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:59:35.719 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:35.558+0000 7f6466177200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T12:59:35.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.781+0000 7f99f75ff700 1 -- 172.21.15.17:0/3693982274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99f0074550 msgr2=0x7f99f00729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.781+0000 7f99f75ff700 1 --2- 172.21.15.17:0/3693982274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99f0074550 0x7f99f00729a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009990 tx=0x7f99ec009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.781+0000 7f99f75ff700 1 -- 172.21.15.17:0/3693982274 shutdown_connections 2023-07-14T12:59:35.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.781+0000 7f99f75ff700 1 --2- 172.21.15.17:0/3693982274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99f010c0e0 0x7f99f010e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.781+0000 7f99f75ff700 1 --2- 172.21.15.17:0/3693982274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99f0074550 0x7f99f00729a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.781+0000 7f99f75ff700 1 --2- 172.21.15.17:0/3693982274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f0072f70 0x7f99f00733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.781+0000 7f99f75ff700 1 -- 172.21.15.17:0/3693982274 >> 172.21.15.17:0/3693982274 conn(0x7f99f00fb130 msgr2=0x7f99f00fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:35.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.781+0000 7f99f75ff700 1 -- 172.21.15.17:0/3693982274 shutdown_connections 2023-07-14T12:59:35.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.781+0000 7f99f75ff700 1 -- 172.21.15.17:0/3693982274 wait complete. 2023-07-14T12:59:35.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.782+0000 7f99f75ff700 1 Processor -- start 2023-07-14T12:59:35.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.782+0000 7f99f75ff700 1 -- start start 2023-07-14T12:59:35.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.782+0000 7f99f75ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f0072f70 0x7f99f019be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.782+0000 7f99f75ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99f0074550 0x7f99f019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.782+0000 7f99f75ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99f010c0e0 0x7f99f019d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.782+0000 7f99f75ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f019d8b0 con 0x7f99f0072f70 2023-07-14T12:59:35.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.782+0000 7f99f75ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f019da20 con 0x7f99f010c0e0 2023-07-14T12:59:35.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.782+0000 7f99f75ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f019dbe0 con 0x7f99f0074550 2023-07-14T12:59:35.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f539b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f0072f70 0x7f99f019be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f539b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f0072f70 0x7f99f019be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50858/0 (socket says 172.21.15.17:50858) 2023-07-14T12:59:35.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f539b700 1 -- 172.21.15.17:0/3501967883 learned_addr learned my addr 172.21.15.17:0/3501967883 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:35.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f4b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99f0074550 0x7f99f019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f5b9c700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99f010c0e0 0x7f99f019d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:35.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f4b9a700 1 -- 172.21.15.17:0/3501967883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99f010c0e0 msgr2=0x7f99f019d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f4b9a700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99f010c0e0 0x7f99f019d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f4b9a700 1 -- 172.21.15.17:0/3501967883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f0072f70 msgr2=0x7f99f019be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:35.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f4b9a700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f0072f70 0x7f99f019be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:35.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f4b9a700 1 -- 172.21.15.17:0/3501967883 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec0095f0 con 0x7f99f0074550 2023-07-14T12:59:35.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f5b9c700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99f010c0e0 0x7f99f019d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:35.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.783+0000 7f99f4b9a700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99f0074550 0x7f99f019c3d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f99e000e9c0 tx=0x7f99e000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:35.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.784+0000 7f99e67fc700 1 -- 172.21.15.17:0/3501967883 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0004220 con 0x7f99f0074550 2023-07-14T12:59:35.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.784+0000 7f99f75ff700 1 -- 172.21.15.17:0/3501967883 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f019dec0 con 0x7f99f0074550 2023-07-14T12:59:35.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.784+0000 7f99e67fc700 1 -- 172.21.15.17:0/3501967883 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99e0004380 con 0x7f99f0074550 2023-07-14T12:59:35.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.784+0000 7f99e67fc700 1 -- 172.21.15.17:0/3501967883 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0003b40 con 0x7f99f0074550 2023-07-14T12:59:35.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.784+0000 7f99f75ff700 1 -- 172.21.15.17:0/3501967883 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f01a4680 con 0x7f99f0074550 2023-07-14T12:59:35.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.785+0000 7f99f75ff700 1 -- 172.21.15.17:0/3501967883 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f0101c30 con 0x7f99f0074550 2023-07-14T12:59:35.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.787+0000 7f99e67fc700 1 -- 172.21.15.17:0/3501967883 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7f99e0003ca0 con 0x7f99f0074550 2023-07-14T12:59:35.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.789+0000 7f99e67fc700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99dc0a11a0 0x7f99dc0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:35.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.789+0000 7f99f539b700 1 -- 172.21.15.17:0/3501967883 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99dc0a11a0 msgr2=0x7f99dc0a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:35.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.789+0000 7f99e67fc700 1 -- 172.21.15.17:0/3501967883 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f99e0014070 con 0x7f99f0074550 2023-07-14T12:59:35.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.789+0000 7f99f539b700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99dc0a11a0 0x7f99dc0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:59:35.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.794+0000 7f99e67fc700 1 -- 172.21.15.17:0/3501967883 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f99e0096430 con 0x7f99f0074550 2023-07-14T12:59:35.948 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:35.824+0000 7f8e1a2ea200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:59:35.996 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:35.599+0000 7f7e7b9d5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:59:35.996 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:35.818+0000 7f7e7b9d5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:59:36.003 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:35.689+0000 7f6466177200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T12:59:36.003 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:35.923+0000 7f6466177200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T12:59:36.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.990+0000 7f99f539b700 1 -- 172.21.15.17:0/3501967883 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99dc0a11a0 msgr2=0x7f99dc0a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:36.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:35.990+0000 7f99f539b700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99dc0a11a0 0x7f99dc0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T12:59:36.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.010+0000 7f99f75ff700 1 -- 172.21.15.17:0/3501967883 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f99f004e2f0 con 0x7f99f0074550 2023-07-14T12:59:36.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.018+0000 7f99e67fc700 1 -- 172.21.15.17:0/3501967883 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f99e0099a50 con 0x7f99f0074550 2023-07-14T12:59:36.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.020+0000 7f99f75ff700 1 -- 172.21.15.17:0/3501967883 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99dc0a11a0 msgr2=0x7f99dc0a3650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:59:36.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.020+0000 7f99f75ff700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99dc0a11a0 0x7f99dc0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.020+0000 7f99f75ff700 1 -- 172.21.15.17:0/3501967883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99f0074550 msgr2=0x7f99f019c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.020+0000 7f99f75ff700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99f0074550 0x7f99f019c3d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f99e000e9c0 tx=0x7f99e000ecd0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.020+0000 7f99f75ff700 1 -- 172.21.15.17:0/3501967883 shutdown_connections 2023-07-14T12:59:36.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.020+0000 7f99f75ff700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f99dc0a11a0 0x7f99dc0a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.020+0000 7f99f75ff700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99f010c0e0 0x7f99f019d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.020+0000 7f99f75ff700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99f0072f70 0x7f99f019be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.020+0000 7f99f75ff700 1 --2- 172.21.15.17:0/3501967883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99f0074550 0x7f99f019c3d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.020+0000 7f99f75ff700 1 -- 172.21.15.17:0/3501967883 >> 172.21.15.17:0/3501967883 conn(0x7f99f00fb130 msgr2=0x7f99f00fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:36.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.021+0000 7f99f75ff700 1 -- 172.21.15.17:0/3501967883 shutdown_connections 2023-07-14T12:59:36.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.021+0000 7f99f75ff700 1 -- 172.21.15.17:0/3501967883 wait complete. 2023-07-14T12:59:36.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M' 2023-07-14T12:59:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.242+0000 7fcdec1ff700 1 -- 172.21.15.17:0/942466318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcde4074550 msgr2=0x7fcde40729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.242+0000 7fcdec1ff700 1 --2- 172.21.15.17:0/942466318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcde4074550 0x7fcde40729a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcde00098f0 tx=0x7fcde0009c00 comp rx=0 tx=0).stop 2023-07-14T12:59:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.242+0000 7fcdec1ff700 1 -- 172.21.15.17:0/942466318 shutdown_connections 2023-07-14T12:59:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.242+0000 7fcdec1ff700 1 --2- 172.21.15.17:0/942466318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde410c060 0x7fcde410e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.242+0000 7fcdec1ff700 1 --2- 172.21.15.17:0/942466318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcde4074550 0x7fcde40729a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.242+0000 7fcdec1ff700 1 --2- 172.21.15.17:0/942466318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcde4072f70 0x7fcde40733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.242+0000 7fcdec1ff700 1 -- 172.21.15.17:0/942466318 >> 172.21.15.17:0/942466318 conn(0x7fcde40fb090 msgr2=0x7fcde40fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:36.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.242+0000 7fcdec1ff700 1 -- 172.21.15.17:0/942466318 shutdown_connections 2023-07-14T12:59:36.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.242+0000 7fcdec1ff700 1 -- 172.21.15.17:0/942466318 wait complete. 2023-07-14T12:59:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.243+0000 7fcdec1ff700 1 Processor -- start 2023-07-14T12:59:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.243+0000 7fcdec1ff700 1 -- start start 2023-07-14T12:59:36.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.244+0000 7fcdec1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde4072f70 0x7fcde419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.244+0000 7fcdec1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcde4074550 0x7fcde419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.244+0000 7fcdec1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcde410c060 0x7fcde41a3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.244+0000 7fcdec1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde41a3940 con 0x7fcde4072f70 2023-07-14T12:59:36.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.244+0000 7fcdec1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde41a3a80 con 0x7fcde4074550 2023-07-14T12:59:36.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.244+0000 7fcdec1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde41a3c10 con 0x7fcde410c060 2023-07-14T12:59:36.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.244+0000 7fcde9f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde4072f70 0x7fcde419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.244+0000 7fcde9f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde4072f70 0x7fcde419bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50874/0 (socket says 172.21.15.17:50874) 2023-07-14T12:59:36.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.244+0000 7fcde9f9b700 1 -- 172.21.15.17:0/2249462195 learned_addr learned my addr 172.21.15.17:0/2249462195 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:36.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.244+0000 7fcdea79c700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcde410c060 0x7fcde41a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.244+0000 7fcde979a700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcde4074550 0x7fcde419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.245+0000 7fcde9f9b700 1 -- 172.21.15.17:0/2249462195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcde410c060 msgr2=0x7fcde41a3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.245+0000 7fcde9f9b700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcde410c060 0x7fcde41a3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.245+0000 7fcde9f9b700 1 -- 172.21.15.17:0/2249462195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcde4074550 msgr2=0x7fcde419c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.245+0000 7fcde9f9b700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcde4074550 0x7fcde419c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.245+0000 7fcde9f9b700 1 -- 172.21.15.17:0/2249462195 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0009520 con 0x7fcde4072f70 2023-07-14T12:59:36.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.245+0000 7fcde9f9b700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde4072f70 0x7fcde419bdc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009fd0 tx=0x7fcde000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:36.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.245+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde001c070 con 0x7fcde4072f70 2023-07-14T12:59:36.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.245+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcde000f7b0 con 0x7fcde4072f70 2023-07-14T12:59:36.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.245+0000 7fcdec1ff700 1 -- 172.21.15.17:0/2249462195 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde41a3e90 con 0x7fcde4072f70 2023-07-14T12:59:36.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.245+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0003970 con 0x7fcde4072f70 2023-07-14T12:59:36.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.245+0000 7fcdec1ff700 1 -- 172.21.15.17:0/2249462195 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde41a4200 con 0x7fcde4072f70 2023-07-14T12:59:36.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.246+0000 7fcdec1ff700 1 -- 172.21.15.17:0/2249462195 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde4101bb0 con 0x7fcde4072f70 2023-07-14T12:59:36.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.250+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7fcde0020030 con 0x7fcde4072f70 2023-07-14T12:59:36.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.251+0000 7fcddaffd700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 0x7fcdd00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.251+0000 7fcde979a700 1 -- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 msgr2=0x7fcdd00a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:36.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.251+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fcde00cdae0 con 0x7fcde4072f70 2023-07-14T12:59:36.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.251+0000 7fcde979a700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 0x7fcdd00a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:59:36.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.252+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcde0097290 con 0x7fcde4072f70 2023-07-14T12:59:36.347 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:35 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1504333301' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-07-14T12:59:36.347 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:35 smithi131 ceph-mon[96953]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-07-14T12:59:36.348 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:35 smithi131 ceph-mon[96953]: from='client.? ' entity='client.admin' 2023-07-14T12:59:36.348 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:36 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:36.201+0000 7f7e7b9d5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:59:36.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:35 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1504333301' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-07-14T12:59:36.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:35 smithi017 ceph-mon[95536]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-07-14T12:59:36.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:35 smithi017 ceph-mon[95536]: from='client.? ' entity='client.admin' 2023-07-14T12:59:36.357 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:35 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1504333301' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-07-14T12:59:36.357 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:35 smithi135 ceph-mon[97338]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-07-14T12:59:36.357 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:35 smithi135 ceph-mon[97338]: from='client.? ' entity='client.admin' 2023-07-14T12:59:36.358 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:36 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:36.211+0000 7f8e1a2ea200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:59:36.358 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:36 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:36.327+0000 7f8e1a2ea200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:59:36.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.452+0000 7fcde979a700 1 -- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 msgr2=0x7fcdd00a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:36.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.452+0000 7fcde979a700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 0x7fcdd00a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T12:59:36.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.490+0000 7fcdec1ff700 1 -- 172.21.15.17:0/2249462195 --> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcde4060950 con 0x7fcdd00a11a0 2023-07-14T12:59:36.525 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T12:59:36.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T12:59:36.631 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:36 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:36.316+0000 7f7e7b9d5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:59:36.632 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:36 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:36.479+0000 7f7e7b9d5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:59:36.640 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:36 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:36.489+0000 7f8e1a2ea200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:59:36.665 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:36.342+0000 7f6466177200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T12:59:36.665 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:36.462+0000 7f6466177200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T12:59:36.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.707+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2580084514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8100cd0 msgr2=0x7f17b8101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.707+0000 7f17bc9ff700 1 --2- 172.21.15.17:0/2580084514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8100cd0 0x7f17b8101120 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f17ac009990 tx=0x7f17ac009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.707+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2580084514 shutdown_connections 2023-07-14T12:59:36.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.707+0000 7f17bc9ff700 1 --2- 172.21.15.17:0/2580084514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8101660 0x7f17b8107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.707+0000 7f17bc9ff700 1 --2- 172.21.15.17:0/2580084514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17b80ffae0 0x7f17b80ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.707+0000 7f17bc9ff700 1 --2- 172.21.15.17:0/2580084514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8100cd0 0x7f17b8101120 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.707+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2580084514 >> 172.21.15.17:0/2580084514 conn(0x7f17b80fb0e0 msgr2=0x7f17b80fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:36.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.707+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2580084514 shutdown_connections 2023-07-14T12:59:36.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.707+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2580084514 wait complete. 2023-07-14T12:59:36.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.708+0000 7f17bc9ff700 1 Processor -- start 2023-07-14T12:59:36.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.708+0000 7f17bc9ff700 1 -- start start 2023-07-14T12:59:36.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17bc9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b80ffae0 0x7f17b80742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17bc9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100cd0 0x7f17b8072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17bc9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17b8101660 0x7f17b8072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17bc9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80735e0 con 0x7f17b80ffae0 2023-07-14T12:59:36.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17bc9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8073750 con 0x7f17b8101660 2023-07-14T12:59:36.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17bc9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b819f7a0 con 0x7f17b8100cd0 2023-07-14T12:59:36.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17b659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b80ffae0 0x7f17b80742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17b659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b80ffae0 0x7f17b80742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50882/0 (socket says 172.21.15.17:50882) 2023-07-14T12:59:36.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17b659c700 1 -- 172.21.15.17:0/2485295471 learned_addr learned my addr 172.21.15.17:0/2485295471 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:36.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17b5d9b700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100cd0 0x7f17b8072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17b6d9d700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17b8101660 0x7f17b8072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17b659c700 1 -- 172.21.15.17:0/2485295471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100cd0 msgr2=0x7f17b8072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17b659c700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100cd0 0x7f17b8072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17b659c700 1 -- 172.21.15.17:0/2485295471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17b8101660 msgr2=0x7f17b8072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17b659c700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17b8101660 0x7f17b8072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.709+0000 7f17b659c700 1 -- 172.21.15.17:0/2485295471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac0095f0 con 0x7f17b80ffae0 2023-07-14T12:59:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.710+0000 7f17b659c700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b80ffae0 0x7f17b80742c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f17a800e970 tx=0x7f17a800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.710+0000 7f17a77fe700 1 -- 172.21.15.17:0/2485295471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8009790 con 0x7f17b80ffae0 2023-07-14T12:59:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.710+0000 7f17a77fe700 1 -- 172.21.15.17:0/2485295471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17a800c7e0 con 0x7f17b80ffae0 2023-07-14T12:59:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.710+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2485295471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b819fa80 con 0x7f17b80ffae0 2023-07-14T12:59:36.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.710+0000 7f17a77fe700 1 -- 172.21.15.17:0/2485295471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8003bd0 con 0x7f17b80ffae0 2023-07-14T12:59:36.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.710+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2485295471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b819ff90 con 0x7f17b80ffae0 2023-07-14T12:59:36.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.715+0000 7f17a77fe700 1 -- 172.21.15.17:0/2485295471 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7f17a800c950 con 0x7f17b80ffae0 2023-07-14T12:59:36.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.716+0000 7f17d02e0b80 1 Processor -- start 2023-07-14T12:59:36.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.716+0000 7f17d02e0b80 1 -- start start 2023-07-14T12:59:36.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb34960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb35760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb36160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eda39d30 con 0x55a4edb34ea0 2023-07-14T12:59:36.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eda8cac0 con 0x55a4edb34550 2023-07-14T12:59:36.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eda85f50 con 0x55a4edb35cf0 2023-07-14T12:59:36.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17b6d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb34960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17b659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb35760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17b6d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb34960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33526/0 (socket says 172.21.15.17:33526) 2023-07-14T12:59:36.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17b6d9d700 1 -- 172.21.15.17:0/3433135558 learned_addr learned my addr 172.21.15.17:0/3433135558 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:36.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17b5d9b700 1 --2- 172.21.15.17:0/3433135558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb36160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.717+0000 7f17a77fe700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f17a00a11a0 0x7f17a00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17b6d9d700 1 -- 172.21.15.17:0/2485295471 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f17a00a11a0 msgr2=0x7f17a00a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:36.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17b659c700 1 -- 172.21.15.17:0/3433135558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 msgr2=0x55a4edb36160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:36.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17b659c700 1 --2- 172.21.15.17:0/3433135558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb36160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17b659c700 1 -- 172.21.15.17:0/3433135558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 msgr2=0x55a4edb34960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:36.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17b659c700 1 --2- 172.21.15.17:0/3433135558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb34960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17a77fe700 1 -- 172.21.15.17:0/2485295471 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f17a8014070 con 0x7f17b80ffae0 2023-07-14T12:59:36.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17b659c700 1 -- 172.21.15.17:0/3433135558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4ed8b3e60 con 0x55a4edb34ea0 2023-07-14T12:59:36.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17b5d9b700 1 --2- 172.21.15.17:0/3433135558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb36160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:36.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17b6d9d700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f17a00a11a0 0x7f17a00a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:59:36.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17b659c700 1 --2- 172.21.15.17:0/3433135558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb35760 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f17a8096970 tx=0x7f17a8003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbffa37ec8c5eb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:36.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17a4ff9700 1 -- 172.21.15.17:0/3433135558 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8096240 con 0x55a4edb34ea0 2023-07-14T12:59:36.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17a4ff9700 1 -- 172.21.15.17:0/3433135558 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17a80cfe90 con 0x55a4edb34ea0 2023-07-14T12:59:36.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.718+0000 7f17a4ff9700 1 -- 172.21.15.17:0/3433135558 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8096610 con 0x55a4edb34ea0 2023-07-14T12:59:36.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.719+0000 7f17d02e0b80 1 -- 172.21.15.17:0/3433135558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 msgr2=0x55a4edb35760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.719+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/3433135558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb35760 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f17a8096970 tx=0x7f17a8003680 comp rx=0 tx=0).stop 2023-07-14T12:59:36.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.719+0000 7f17d02e0b80 1 -- 172.21.15.17:0/3433135558 shutdown_connections 2023-07-14T12:59:36.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.719+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/3433135558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb36160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.719+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/3433135558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb34960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.719+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/3433135558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb35760 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.719+0000 7f17d02e0b80 1 -- 172.21.15.17:0/3433135558 >> 172.21.15.17:0/3433135558 conn(0x55a4edb29e20 msgr2=0x55a4edb2f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:36.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.719+0000 7f17d02e0b80 1 -- 172.21.15.17:0/3433135558 shutdown_connections 2023-07-14T12:59:36.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.720+0000 7f17d02e0b80 1 -- 172.21.15.17:0/3433135558 wait complete. 2023-07-14T12:59:36.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.720+0000 7f17d02e0b80 1 -- start start 2023-07-14T12:59:36.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.720+0000 7f17d02e0b80 1 Processor -- start 2023-07-14T12:59:36.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.721+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb3e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.721+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb3e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.721+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb45710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.721+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eda25b40 con 0x55a4edb34ea0 2023-07-14T12:59:36.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.721+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eda25840 con 0x55a4edb34550 2023-07-14T12:59:36.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.721+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4ed9099a0 con 0x55a4edb35cf0 2023-07-14T12:59:36.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.721+0000 7f17d02e0b80 10 client.0 _ll_register_callbacks cb 0x55a4eda237e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:36.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.721+0000 7f17b5d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb3e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.721+0000 7f17b659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb3e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.722+0000 7f17b659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb3e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33540/0 (socket says 172.21.15.17:33540) 2023-07-14T12:59:36.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.722+0000 7f17b659c700 1 -- 172.21.15.17:0/2523291618 learned_addr learned my addr 172.21.15.17:0/2523291618 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:36.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.722+0000 7f17b6d9d700 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb45710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.722+0000 7f17b659c700 1 -- 172.21.15.17:0/2523291618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 msgr2=0x55a4edb45710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:36.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.722+0000 7f17b659c700 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb45710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.722+0000 7f17b659c700 1 -- 172.21.15.17:0/2523291618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 msgr2=0x55a4edb3e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:36.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.722+0000 7f17b659c700 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb3e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.722+0000 7f17b659c700 1 -- 172.21.15.17:0/2523291618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b8108850 con 0x55a4edb34550 2023-07-14T12:59:36.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.722+0000 7f17b659c700 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb3e190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f17a80ca5c0 tx=0x7f17a8095b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87d6c9152cfe35f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.722+0000 7f179dffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T12:59:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f179dffb700 1 -- 172.21.15.17:0/2523291618 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a800cc50 con 0x55a4edb34550 2023-07-14T12:59:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f179dffb700 1 -- 172.21.15.17:0/2523291618 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f17a8099f00 con 0x55a4edb34550 2023-07-14T12:59:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2523291618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4ed9df570 con 0x55a4edb34550 2023-07-14T12:59:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f179dffb700 1 -- 172.21.15.17:0/2523291618 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17a80993f0 con 0x55a4edb34550 2023-07-14T12:59:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f17d02e0b80 10 client.25358 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:36.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2523291618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f17b819ff90 con 0x55a4edb34550 2023-07-14T12:59:36.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f179dffb700 1 -- 172.21.15.17:0/2523291618 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a4ed9df570 con 0x55a4edb34550 2023-07-14T12:59:36.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f179dffb700 1 -- 172.21.15.17:0/2523291618 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f17a80581f0 con 0x55a4edb34550 2023-07-14T12:59:36.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f17d02e0b80 10 client.25358 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:36.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f17d02e0b80 10 client.25358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T12:59:36.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f17d02e0b80 20 client.25358 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:36.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4edb49c30 0x55a4edb4c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f17d02e0b80 4 client.25358 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:59:36.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.723+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2523291618 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4eda7ef30 con 0x55a4edb49c30 2023-07-14T12:59:36.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.724+0000 7f17b5d9b700 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4edb49c30 0x55a4edb4c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.724+0000 7f179dffb700 10 client.25358 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:36.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.724+0000 7f17b5d9b700 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4edb49c30 0x55a4edb4c010 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ebfa163b2fb9692 server_cookie=6ca2e25340e79cab in_seq=0 out_seq=0 2023-07-14T12:59:36.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f179dffb700 1 -- 172.21.15.17:0/2523291618 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a4eda7ef30 con 0x55a4edb49c30 2023-07-14T12:59:36.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f179dffb700 10 client.25358 handle_command_reply: tid=0 2023-07-14T12:59:36.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f17d02e0b80 1 client.25358 shutdown 2023-07-14T12:59:36.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2523291618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 msgr2=0x55a4edb3e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb3e190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f17a80ca5c0 tx=0x7f17a8095b20 comp rx=0 tx=0).stop 2023-07-14T12:59:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2523291618 shutdown_connections 2023-07-14T12:59:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4edb49c30 0x55a4edb4c010 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb45710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb3e190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2523291618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb3e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f179dffb700 0 client.25358 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:36.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.725+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2523291618 >> 172.21.15.17:0/2523291618 conn(0x55a4edb29e20 msgr2=0x55a4edb2e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:36.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.726+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2523291618 shutdown_connections 2023-07-14T12:59:36.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.726+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2523291618 wait complete. 2023-07-14T12:59:36.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.726+0000 7f17d02e0b80 20 client.25358 trim_cache size 0 max 16384 2023-07-14T12:59:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.743+0000 7f17d02e0b80 1 Processor -- start 2023-07-14T12:59:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17d02e0b80 1 -- start start 2023-07-14T12:59:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb3df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb456d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb3e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4edb3be10 con 0x55a4edb34ea0 2023-07-14T12:59:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4edb50b90 con 0x55a4edb34550 2023-07-14T12:59:36.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4edb3e9c0 con 0x55a4edb35cf0 2023-07-14T12:59:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17b5d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17b6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb3e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17b6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb3e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:32916/0 (socket says 172.21.15.17:32916) 2023-07-14T12:59:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17b659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb3df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.744+0000 7f17b6d9d700 1 -- 172.21.15.17:0/3600979774 learned_addr learned my addr 172.21.15.17:0/3600979774 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:36.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.745+0000 7f17b6d9d700 1 -- 172.21.15.17:0/3600979774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 msgr2=0x55a4edb3df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.745+0000 7f17b6d9d700 1 --2- 172.21.15.17:0/3600979774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb3df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.745+0000 7f17b6d9d700 1 -- 172.21.15.17:0/3600979774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 msgr2=0x55a4edb456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.745+0000 7f17b6d9d700 1 --2- 172.21.15.17:0/3600979774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.745+0000 7f17b6d9d700 1 -- 172.21.15.17:0/3600979774 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4ed89cce0 con 0x55a4edb35cf0 2023-07-14T12:59:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.745+0000 7f17b6d9d700 1 --2- 172.21.15.17:0/3600979774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb3e480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009b40 tx=0x7f17b0009b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd5675649913bfaa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.745+0000 7f17a57fa700 1 -- 172.21.15.17:0/3600979774 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b00045d0 con 0x55a4edb35cf0 2023-07-14T12:59:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.745+0000 7f17a57fa700 1 -- 172.21.15.17:0/3600979774 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17b000f040 con 0x55a4edb35cf0 2023-07-14T12:59:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.745+0000 7f17a57fa700 1 -- 172.21.15.17:0/3600979774 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0017670 con 0x55a4edb35cf0 2023-07-14T12:59:36.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.746+0000 7f17d02e0b80 1 -- 172.21.15.17:0/3600979774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 msgr2=0x55a4edb3e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.746+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/3600979774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb3e480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009b40 tx=0x7f17b0009b70 comp rx=0 tx=0).stop 2023-07-14T12:59:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.746+0000 7f17d02e0b80 1 -- 172.21.15.17:0/3600979774 shutdown_connections 2023-07-14T12:59:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.746+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/3600979774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb3e480 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.746+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/3600979774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb3df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.746+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/3600979774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.746+0000 7f17d02e0b80 1 -- 172.21.15.17:0/3600979774 >> 172.21.15.17:0/3600979774 conn(0x55a4edb29e20 msgr2=0x55a4edb38b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.746+0000 7f17d02e0b80 1 -- 172.21.15.17:0/3600979774 shutdown_connections 2023-07-14T12:59:36.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.746+0000 7f17d02e0b80 1 -- 172.21.15.17:0/3600979774 wait complete. 2023-07-14T12:59:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.747+0000 7f17d02e0b80 1 -- start start 2023-07-14T12:59:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.747+0000 7f17d02e0b80 1 Processor -- start 2023-07-14T12:59:36.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.747+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb42820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.747+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb42d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.747+0000 7f17d02e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb43d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.747+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4edb442b0 con 0x55a4edb34ea0 2023-07-14T12:59:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.747+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4edb44420 con 0x55a4edb34550 2023-07-14T12:59:36.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.747+0000 7f17d02e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4edb445e0 con 0x55a4edb35cf0 2023-07-14T12:59:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.747+0000 7f17d02e0b80 10 client.0 _ll_register_callbacks cb 0x7f17b00094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f17b5d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb42d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f17b659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb42820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f17b5d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb42d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50908/0 (socket says 172.21.15.17:50908) 2023-07-14T12:59:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f17b6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb43d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f17b5d9b700 1 -- 172.21.15.17:0/2708798906 learned_addr learned my addr 172.21.15.17:0/2708798906 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f17b5d9b700 1 -- 172.21.15.17:0/2708798906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 msgr2=0x55a4edb43d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:36.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f17b5d9b700 1 --2- 172.21.15.17:0/2708798906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb43d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f17b5d9b700 1 -- 172.21.15.17:0/2708798906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 msgr2=0x55a4edb42820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f17b5d9b700 1 --2- 172.21.15.17:0/2708798906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb42820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f17b5d9b700 1 -- 172.21.15.17:0/2708798906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b0009880 con 0x55a4edb34ea0 2023-07-14T12:59:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f17b5d9b700 1 --2- 172.21.15.17:0/2708798906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb42d60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f17ac000c00 tx=0x7f17ac0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55a3b77d8870406 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:36.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.748+0000 7f179dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T12:59:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.749+0000 7f179dffb700 1 -- 172.21.15.17:0/2708798906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac02c070 con 0x55a4edb34ea0 2023-07-14T12:59:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.749+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2708798906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17a80cfe90 con 0x55a4edb34ea0 2023-07-14T12:59:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.749+0000 7f179dffb700 1 -- 172.21.15.17:0/2708798906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f17ac003680 con 0x55a4edb34ea0 2023-07-14T12:59:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.749+0000 7f179dffb700 1 -- 172.21.15.17:0/2708798906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17ac01d040 con 0x55a4edb34ea0 2023-07-14T12:59:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.749+0000 7f17d02e0b80 10 client.15579 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:36.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.749+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2708798906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55a4ed8da2d0 con 0x55a4edb34ea0 2023-07-14T12:59:36.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.749+0000 7f179dffb700 1 -- 172.21.15.17:0/2708798906 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17a80cfe90 con 0x55a4edb34ea0 2023-07-14T12:59:36.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.749+0000 7f179dffb700 1 -- 172.21.15.17:0/2708798906 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f17ac00bb60 con 0x55a4edb34ea0 2023-07-14T12:59:36.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.749+0000 7f17d02e0b80 10 client.15579 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:36.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.750+0000 7f17d02e0b80 10 client.15579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T12:59:36.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.750+0000 7f17d02e0b80 20 client.15579 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.750+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2708798906 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4edb9fea0 0x55a4edba22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.750+0000 7f17d02e0b80 4 client.15579 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T12:59:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.750+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2708798906 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a4eda410d0 con 0x55a4edb9fea0 2023-07-14T12:59:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.750+0000 7f17b659c700 1 --2- 172.21.15.17:0/2708798906 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4edb9fea0 0x55a4edba22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.751+0000 7f17b659c700 1 --2- 172.21.15.17:0/2708798906 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4edb9fea0 0x55a4edba22b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dba1265bf3399c5e server_cookie=3357d9cb4bd8cf4a in_seq=0 out_seq=0 2023-07-14T12:59:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.751+0000 7f179dffb700 10 client.15579 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:36.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f179dffb700 1 -- 172.21.15.17:0/2708798906 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a4eda410d0 con 0x55a4edb9fea0 2023-07-14T12:59:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f179dffb700 10 client.15579 handle_command_reply: tid=0 2023-07-14T12:59:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 1 client.15579 shutdown 2023-07-14T12:59:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2708798906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 msgr2=0x55a4edb42d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2708798906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb42d60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f17ac000c00 tx=0x7f17ac0093b0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2708798906 shutdown_connections 2023-07-14T12:59:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2708798906 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4edb9fea0 0x55a4edba22b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2708798906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4edb35cf0 0x55a4edb43d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2708798906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4edb34550 0x55a4edb42820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 1 --2- 172.21.15.17:0/2708798906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4edb34ea0 0x55a4edb42d60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2708798906 >> 172.21.15.17:0/2708798906 conn(0x55a4edb29e20 msgr2=0x55a4edb38b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f179dffb700 0 client.15579 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2708798906 shutdown_connections 2023-07-14T12:59:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 1 -- 172.21.15.17:0/2708798906 wait complete. 2023-07-14T12:59:36.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.752+0000 7f17d02e0b80 20 client.15579 trim_cache size 0 max 16384 2023-07-14T12:59:36.796 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:59:36.796 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T12:59:36.796 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "38559417-0fb7-48b5-b816-1849660affd2", 2023-07-14T12:59:36.796 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T12:59:36.797 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:59:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2485295471 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f17a00a11a0 msgr2=0x7f17a00a3650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:59:36.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f17a00a11a0 0x7f17a00a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2485295471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b80ffae0 msgr2=0x7f17b80742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:36.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b80ffae0 0x7f17b80742c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f17a800e970 tx=0x7f17a800ec80 comp rx=0 tx=0).stop 2023-07-14T12:59:36.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2485295471 shutdown_connections 2023-07-14T12:59:36.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7f17a00a11a0 0x7f17a00a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17b8101660 0x7f17b8072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b80ffae0 0x7f17b80742c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 --2- 172.21.15.17:0/2485295471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100cd0 0x7f17b8072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:36.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2485295471 >> 172.21.15.17:0/2485295471 conn(0x7f17b80fb0e0 msgr2=0x7f17b8104260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:36.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2485295471 shutdown_connections 2023-07-14T12:59:36.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.753+0000 7f17bc9ff700 1 -- 172.21.15.17:0/2485295471 wait complete. 2023-07-14T12:59:36.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T12:59:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.853+0000 7fcde979a700 1 -- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 msgr2=0x7fcdd00a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:36.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.853+0000 7fcde979a700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 0x7fcdd00a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T12:59:36.948 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:36 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:36.609+0000 7f8e1a2ea200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:59:36.996 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:36 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:36.600+0000 7f7e7b9d5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:59:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.984+0000 7fa363bff700 1 -- 172.21.15.17:0/59440564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa35c102e80 msgr2=0x7fa35c105260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:37.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.984+0000 7fa363bff700 1 --2- 172.21.15.17:0/59440564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa35c102e80 0x7fa35c105260 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009990 tx=0x7fa34c009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.984+0000 7fa363bff700 1 -- 172.21.15.17:0/59440564 shutdown_connections 2023-07-14T12:59:37.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.984+0000 7fa363bff700 1 --2- 172.21.15.17:0/59440564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa35c1057a0 0x7fa35c107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.984+0000 7fa363bff700 1 --2- 172.21.15.17:0/59440564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa35c100560 0x7fa35c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.984+0000 7fa363bff700 1 --2- 172.21.15.17:0/59440564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa35c102e80 0x7fa35c105260 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.984+0000 7fa363bff700 1 -- 172.21.15.17:0/59440564 >> 172.21.15.17:0/59440564 conn(0x7fa35c0fa000 msgr2=0x7fa35c0fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:37.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.985+0000 7fa363bff700 1 -- 172.21.15.17:0/59440564 shutdown_connections 2023-07-14T12:59:37.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.985+0000 7fa363bff700 1 -- 172.21.15.17:0/59440564 wait complete. 2023-07-14T12:59:37.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa363bff700 1 Processor -- start 2023-07-14T12:59:37.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa363bff700 1 -- start start 2023-07-14T12:59:37.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa363bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa35c100560 0x7fa35c195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa363bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa35c102e80 0x7fa35c195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa363bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa35c1057a0 0x7fa35c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa363bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c19d310 con 0x7fa35c102e80 2023-07-14T12:59:37.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa363bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c19d450 con 0x7fa35c1057a0 2023-07-14T12:59:37.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa363bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c19d5e0 con 0x7fa35c100560 2023-07-14T12:59:37.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa36119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa35c102e80 0x7fa35c195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa36119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa35c102e80 0x7fa35c195cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50918/0 (socket says 172.21.15.17:50918) 2023-07-14T12:59:37.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa36199b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa35c100560 0x7fa35c195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa36119a700 1 -- 172.21.15.17:0/596133105 learned_addr learned my addr 172.21.15.17:0/596133105 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:37.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.986+0000 7fa36219c700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa35c1057a0 0x7fa35c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.987+0000 7fa36199b700 1 -- 172.21.15.17:0/596133105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa35c1057a0 msgr2=0x7fa35c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:37.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.987+0000 7fa36199b700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa35c1057a0 0x7fa35c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.987+0000 7fa36199b700 1 -- 172.21.15.17:0/596133105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa35c102e80 msgr2=0x7fa35c195cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.987+0000 7fa36199b700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa35c102e80 0x7fa35c195cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.987+0000 7fa36199b700 1 -- 172.21.15.17:0/596133105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c0095f0 con 0x7fa35c100560 2023-07-14T12:59:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.987+0000 7fa36119a700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa35c102e80 0x7fa35c195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.987+0000 7fa36199b700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa35c100560 0x7fa35c195790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa35800e9f0 tx=0x7fa35800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.987+0000 7fa352ffd700 1 -- 172.21.15.17:0/596133105 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35800c9c0 con 0x7fa35c100560 2023-07-14T12:59:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.988+0000 7fa363bff700 1 -- 172.21.15.17:0/596133105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35c19d8c0 con 0x7fa35c100560 2023-07-14T12:59:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.988+0000 7fa352ffd700 1 -- 172.21.15.17:0/596133105 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa358010430 con 0x7fa35c100560 2023-07-14T12:59:37.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.988+0000 7fa352ffd700 1 -- 172.21.15.17:0/596133105 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358018680 con 0x7fa35c100560 2023-07-14T12:59:37.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.988+0000 7fa363bff700 1 -- 172.21.15.17:0/596133105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35c19de20 con 0x7fa35c100560 2023-07-14T12:59:37.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.991+0000 7fa352ffd700 1 -- 172.21.15.17:0/596133105 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) v1 ==== 135732+0+0 (secure 0 0 0) 0x7fa3580105a0 con 0x7fa35c100560 2023-07-14T12:59:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.992+0000 7fa377524b80 1 Processor -- start 2023-07-14T12:59:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.992+0000 7fa352ffd700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa3480a1220 0x7fa3480a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa377524b80 1 -- start start 2023-07-14T12:59:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa36219c700 1 -- 172.21.15.17:0/596133105 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa3480a1220 msgr2=0x7fa3480a36d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa352ffd700 1 -- 172.21.15.17:0/596133105 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa358014070 con 0x7fa35c100560 2023-07-14T12:59:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa36219c700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa3480a1220 0x7fa3480a36d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T12:59:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa377524b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789ddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa377524b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789de230 0x5559789deaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa377524b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789df4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa377524b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559788decb0 con 0x5559789dd8e0 2023-07-14T12:59:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa377524b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555978931a40 con 0x5559789de230 2023-07-14T12:59:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa377524b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55597892aed0 con 0x5559789df080 2023-07-14T12:59:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa36199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789ddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa36119a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789de230 0x5559789deaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa36199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789ddcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50930/0 (socket says 172.21.15.17:50930) 2023-07-14T12:59:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa36199b700 1 -- 172.21.15.17:0/2565168546 learned_addr learned my addr 172.21.15.17:0/2565168546 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.993+0000 7fa36219c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789df4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.994+0000 7fa36199b700 1 -- 172.21.15.17:0/2565168546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 msgr2=0x5559789df4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.994+0000 7fa36199b700 1 --2- 172.21.15.17:0/2565168546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789df4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.994+0000 7fa36199b700 1 -- 172.21.15.17:0/2565168546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789de230 msgr2=0x5559789deaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.994+0000 7fa36199b700 1 --2- 172.21.15.17:0/2565168546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789de230 0x5559789deaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.994+0000 7fa36199b700 1 -- 172.21.15.17:0/2565168546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555978758de0 con 0x5559789dd8e0 2023-07-14T12:59:37.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.994+0000 7fa36219c700 1 --2- 172.21.15.17:0/2565168546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789df4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:37.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.994+0000 7fa36119a700 1 --2- 172.21.15.17:0/2565168546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789de230 0x5559789deaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:37.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.994+0000 7fa36199b700 1 --2- 172.21.15.17:0/2565168546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789ddcf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa358099dd0 tx=0x7fa358099a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef232bae1f8871ba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:37.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.994+0000 7fa347fff700 1 -- 172.21.15.17:0/2565168546 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358099e40 con 0x5559789dd8e0 2023-07-14T12:59:37.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.994+0000 7fa347fff700 1 -- 172.21.15.17:0/2565168546 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa35809de70 con 0x5559789dd8e0 2023-07-14T12:59:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.994+0000 7fa347fff700 1 -- 172.21.15.17:0/2565168546 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580a1e00 con 0x5559789dd8e0 2023-07-14T12:59:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.995+0000 7fa377524b80 1 -- 172.21.15.17:0/2565168546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 msgr2=0x5559789ddcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.995+0000 7fa377524b80 1 --2- 172.21.15.17:0/2565168546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789ddcf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa358099dd0 tx=0x7fa358099a00 comp rx=0 tx=0).stop 2023-07-14T12:59:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.995+0000 7fa377524b80 1 -- 172.21.15.17:0/2565168546 shutdown_connections 2023-07-14T12:59:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.995+0000 7fa377524b80 1 --2- 172.21.15.17:0/2565168546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789df4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.995+0000 7fa377524b80 1 --2- 172.21.15.17:0/2565168546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789ddcf0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.995+0000 7fa377524b80 1 --2- 172.21.15.17:0/2565168546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789de230 0x5559789deaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.995+0000 7fa377524b80 1 -- 172.21.15.17:0/2565168546 >> 172.21.15.17:0/2565168546 conn(0x5559789ceda0 msgr2=0x5559789d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.995+0000 7fa377524b80 1 -- 172.21.15.17:0/2565168546 shutdown_connections 2023-07-14T12:59:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.995+0000 7fa377524b80 1 -- 172.21.15.17:0/2565168546 wait complete. 2023-07-14T12:59:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.996+0000 7fa377524b80 1 -- start start 2023-07-14T12:59:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.996+0000 7fa377524b80 1 Processor -- start 2023-07-14T12:59:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa377524b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 0x5559789e7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa377524b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 0x5559789e7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa377524b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789eea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa377524b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559788caac0 con 0x5559789de230 2023-07-14T12:59:37.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa377524b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559788ca7c0 con 0x5559789dd8e0 2023-07-14T12:59:37.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa377524b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559787ae920 con 0x5559789df080 2023-07-14T12:59:37.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa377524b80 10 client.0 _ll_register_callbacks cb 0x5559788c8760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:37.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 0x5559789e7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36199b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 0x5559789e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36199b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 0x5559789e7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33576/0 (socket says 172.21.15.17:33576) 2023-07-14T12:59:37.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 0x5559789e7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50944/0 (socket says 172.21.15.17:50944) 2023-07-14T12:59:37.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36219c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36199b700 1 -- 172.21.15.17:0/2520467782 learned_addr learned my addr 172.21.15.17:0/2520467782 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:37.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36199b700 1 -- 172.21.15.17:0/2520467782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 msgr2=0x5559789eea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:37.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36199b700 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789eea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36199b700 1 -- 172.21.15.17:0/2520467782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 msgr2=0x5559789e7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:37.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36199b700 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 0x5559789e7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36199b700 1 -- 172.21.15.17:0/2520467782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35c1087f0 con 0x5559789dd8e0 2023-07-14T12:59:37.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.997+0000 7fa36219c700 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789eea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.998+0000 7fa36199b700 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 0x5559789e7500 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa358099b40 tx=0x7fa3580a2170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8857b489cabee3a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.998+0000 7fa3457fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T12:59:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.998+0000 7fa3457fa700 1 -- 172.21.15.17:0/2520467782 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35800cd20 con 0x5559789dd8e0 2023-07-14T12:59:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.998+0000 7fa377524b80 1 -- 172.21.15.17:0/2520467782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559788844f0 con 0x5559789dd8e0 2023-07-14T12:59:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.998+0000 7fa3457fa700 1 -- 172.21.15.17:0/2520467782 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa3580a2290 con 0x5559789dd8e0 2023-07-14T12:59:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.998+0000 7fa3457fa700 1 -- 172.21.15.17:0/2520467782 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa358099e40 con 0x5559789dd8e0 2023-07-14T12:59:37.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.998+0000 7fa377524b80 10 client.25376 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.998+0000 7fa377524b80 1 -- 172.21.15.17:0/2520467782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7fa35400f260 con 0x5559789dd8e0 2023-07-14T12:59:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.998+0000 7fa3457fa700 1 -- 172.21.15.17:0/2520467782 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa35807c020 con 0x5559789dd8e0 2023-07-14T12:59:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.999+0000 7fa3457fa700 1 -- 172.21.15.17:0/2520467782 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa3580b2290 con 0x5559789dd8e0 2023-07-14T12:59:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.999+0000 7fa377524b80 10 client.25376 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.999+0000 7fa377524b80 10 client.25376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T12:59:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.999+0000 7fa377524b80 20 client.25376 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:37.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.999+0000 7fa377524b80 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559789f2fc0 0x5559789f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.999+0000 7fa377524b80 4 client.25376 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T12:59:37.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.999+0000 7fa377524b80 1 -- 172.21.15.17:0/2520467782 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555978923eb0 con 0x5559789f2fc0 2023-07-14T12:59:37.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:36.999+0000 7fa36119a700 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559789f2fc0 0x5559789f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.000+0000 7fa36119a700 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559789f2fc0 0x5559789f53d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb786c3eb0707a8 server_cookie=93c8149c1a642c39 in_seq=0 out_seq=0 2023-07-14T12:59:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.000+0000 7fa3457fa700 10 client.25376 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.000+0000 7fa3457fa700 1 -- 172.21.15.17:0/2520467782 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555978923eb0 con 0x5559789f2fc0 2023-07-14T12:59:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.000+0000 7fa3457fa700 10 client.25376 handle_command_reply: tid=0 2023-07-14T12:59:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.000+0000 7fa377524b80 1 client.25376 shutdown 2023-07-14T12:59:37.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa377524b80 1 -- 172.21.15.17:0/2520467782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 msgr2=0x5559789e7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa377524b80 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 0x5559789e7500 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa358099b40 tx=0x7fa3580a2170 comp rx=0 tx=0).stop 2023-07-14T12:59:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa377524b80 1 -- 172.21.15.17:0/2520467782 shutdown_connections 2023-07-14T12:59:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa377524b80 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559789f2fc0 0x5559789f53d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa377524b80 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789eea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa377524b80 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 0x5559789e7500 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa377524b80 1 --2- 172.21.15.17:0/2520467782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 0x5559789e7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa3457fa700 0 client.25376 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa377524b80 1 -- 172.21.15.17:0/2520467782 >> 172.21.15.17:0/2520467782 conn(0x5559789ceda0 msgr2=0x5559789d38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa377524b80 1 -- 172.21.15.17:0/2520467782 shutdown_connections 2023-07-14T12:59:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa377524b80 1 -- 172.21.15.17:0/2520467782 wait complete. 2023-07-14T12:59:37.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.001+0000 7fa377524b80 20 client.25376 trim_cache size 0 max 16384 2023-07-14T12:59:37.044 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:36.634+0000 7f6466177200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T12:59:37.044 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:36.775+0000 7f6466177200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T12:59:37.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.020+0000 7fa377524b80 1 Processor -- start 2023-07-14T12:59:37.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.020+0000 7fa377524b80 1 -- start start 2023-07-14T12:59:37.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.020+0000 7fa377524b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.020+0000 7fa377524b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789de230 0x5559789eea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.020+0000 7fa377524b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789df080 0x5559789e1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.020+0000 7fa377524b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559789de850 con 0x5559789dd8e0 2023-07-14T12:59:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.020+0000 7fa377524b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559789e69b0 con 0x5559789df080 2023-07-14T12:59:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.020+0000 7fa377524b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559789d5a00 con 0x5559789de230 2023-07-14T12:59:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.021+0000 7fa36199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.021+0000 7fa36199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789d3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50952/0 (socket says 172.21.15.17:50952) 2023-07-14T12:59:37.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.021+0000 7fa36119a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789de230 0x5559789eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.021+0000 7fa36199b700 1 -- 172.21.15.17:0/405127574 learned_addr learned my addr 172.21.15.17:0/405127574 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.021+0000 7fa36219c700 1 --2- 172.21.15.17:0/405127574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789df080 0x5559789e1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.021+0000 7fa36199b700 1 -- 172.21.15.17:0/405127574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789de230 msgr2=0x5559789eea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.021+0000 7fa36199b700 1 --2- 172.21.15.17:0/405127574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789de230 0x5559789eea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.021+0000 7fa36199b700 1 -- 172.21.15.17:0/405127574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789df080 msgr2=0x5559789e1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.021+0000 7fa36199b700 1 --2- 172.21.15.17:0/405127574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789df080 0x5559789e1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.021+0000 7fa36199b700 1 -- 172.21.15.17:0/405127574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c19de20 con 0x5559789dd8e0 2023-07-14T12:59:37.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.021+0000 7fa36119a700 1 --2- 172.21.15.17:0/405127574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789de230 0x5559789eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:37.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.022+0000 7fa36199b700 1 --2- 172.21.15.17:0/405127574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789d3fe0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa358096340 tx=0x7fa358010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190dfdc266e63d13 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:37.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.022+0000 7fa350bff700 1 -- 172.21.15.17:0/405127574 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580a2290 con 0x5559789dd8e0 2023-07-14T12:59:37.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.022+0000 7fa350bff700 1 -- 172.21.15.17:0/405127574 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa35807c030 con 0x5559789dd8e0 2023-07-14T12:59:37.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.022+0000 7fa350bff700 1 -- 172.21.15.17:0/405127574 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358095c30 con 0x5559789dd8e0 2023-07-14T12:59:37.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.022+0000 7fa377524b80 1 -- 172.21.15.17:0/405127574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 msgr2=0x5559789d3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:37.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.022+0000 7fa377524b80 1 --2- 172.21.15.17:0/405127574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789d3fe0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa358096340 tx=0x7fa358010a70 comp rx=0 tx=0).stop 2023-07-14T12:59:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.023+0000 7fa377524b80 1 -- 172.21.15.17:0/405127574 shutdown_connections 2023-07-14T12:59:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.023+0000 7fa377524b80 1 --2- 172.21.15.17:0/405127574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789df080 0x5559789e1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.023+0000 7fa377524b80 1 --2- 172.21.15.17:0/405127574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789dd8e0 0x5559789d3fe0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.023+0000 7fa377524b80 1 --2- 172.21.15.17:0/405127574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789de230 0x5559789eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.023+0000 7fa377524b80 1 -- 172.21.15.17:0/405127574 >> 172.21.15.17:0/405127574 conn(0x5559789ceda0 msgr2=0x5559789f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.023+0000 7fa377524b80 1 -- 172.21.15.17:0/405127574 shutdown_connections 2023-07-14T12:59:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.023+0000 7fa377524b80 1 -- 172.21.15.17:0/405127574 wait complete. 2023-07-14T12:59:37.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.023+0000 7fa377524b80 1 -- start start 2023-07-14T12:59:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.023+0000 7fa377524b80 1 Processor -- start 2023-07-14T12:59:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa377524b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 0x5559789ee220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa377524b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 0x5559789ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa377524b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa377524b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559789eb200 con 0x5559789de230 2023-07-14T12:59:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa377524b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559789eb370 con 0x5559789dd8e0 2023-07-14T12:59:37.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa377524b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559789eb530 con 0x5559789df080 2023-07-14T12:59:37.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa377524b80 10 client.0 _ll_register_callbacks cb 0x7fa3540097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T12:59:37.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa36119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 0x5559789ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa36199b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 0x5559789ee220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa36119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 0x5559789ee760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50962/0 (socket says 172.21.15.17:50962) 2023-07-14T12:59:37.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa36119a700 1 -- 172.21.15.17:0/653555638 learned_addr learned my addr 172.21.15.17:0/653555638 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:37.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa36219c700 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa36199b700 1 -- 172.21.15.17:0/653555638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 msgr2=0x5559789eacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:37.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa36199b700 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789eacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa36199b700 1 -- 172.21.15.17:0/653555638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 msgr2=0x5559789ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T12:59:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa36199b700 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 0x5559789ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.024+0000 7fa36199b700 1 -- 172.21.15.17:0/653555638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34c003ab0 con 0x5559789dd8e0 2023-07-14T12:59:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.025+0000 7fa36199b700 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 0x5559789ee220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa3580adfd0 tx=0x7fa3580962b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8914b55138c73491 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.025+0000 7fa3457fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T12:59:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.025+0000 7fa3457fa700 1 -- 172.21.15.17:0/653555638 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3580ca270 con 0x5559789dd8e0 2023-07-14T12:59:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.025+0000 7fa3457fa700 1 -- 172.21.15.17:0/653555638 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa35807d080 con 0x5559789dd8e0 2023-07-14T12:59:37.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.025+0000 7fa377524b80 1 -- 172.21.15.17:0/653555638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa35809de70 con 0x5559789dd8e0 2023-07-14T12:59:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.025+0000 7fa3457fa700 1 -- 172.21.15.17:0/653555638 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3580ca3d0 con 0x5559789dd8e0 2023-07-14T12:59:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.025+0000 7fa377524b80 10 client.25382 fetch_fsmap learned FSMap version 22 2023-07-14T12:59:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.025+0000 7fa377524b80 1 -- 172.21.15.17:0/653555638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7fa35400f260 con 0x5559789dd8e0 2023-07-14T12:59:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.025+0000 7fa3457fa700 1 -- 172.21.15.17:0/653555638 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa35809de70 con 0x5559789dd8e0 2023-07-14T12:59:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.026+0000 7fa3457fa700 1 -- 172.21.15.17:0/653555638 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa358098da0 con 0x5559789dd8e0 2023-07-14T12:59:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.026+0000 7fa377524b80 10 client.25382 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T12:59:37.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.026+0000 7fa377524b80 10 client.25382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T12:59:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.026+0000 7fa377524b80 20 client.25382 populate_metadata read hostname 'smithi017' 2023-07-14T12:59:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.026+0000 7fa377524b80 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555978a47df0 0x555978a4a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.026+0000 7fa377524b80 4 client.25382 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T12:59:37.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.026+0000 7fa377524b80 1 -- 172.21.15.17:0/653555638 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5559788e6050 con 0x555978a47df0 2023-07-14T12:59:37.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.026+0000 7fa36119a700 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555978a47df0 0x555978a4a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:37.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa36119a700 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555978a47df0 0x555978a4a200 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=775d115b20ca57fc server_cookie=b19baee501828091 in_seq=0 out_seq=0 2023-07-14T12:59:37.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa3457fa700 10 client.25382 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:37.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa3457fa700 1 -- 172.21.15.17:0/653555638 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5559788e6050 con 0x555978a47df0 2023-07-14T12:59:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa3457fa700 10 client.25382 handle_command_reply: tid=0 2023-07-14T12:59:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa377524b80 1 client.25382 shutdown 2023-07-14T12:59:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa377524b80 1 -- 172.21.15.17:0/653555638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 msgr2=0x5559789ee220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa377524b80 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 0x5559789ee220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa3580adfd0 tx=0x7fa3580962b0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa377524b80 1 -- 172.21.15.17:0/653555638 shutdown_connections 2023-07-14T12:59:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa377524b80 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555978a47df0 0x555978a4a200 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa377524b80 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559789df080 0x5559789eacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa377524b80 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559789dd8e0 0x5559789ee220 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa377524b80 1 --2- 172.21.15.17:0/653555638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559789de230 0x5559789ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa3457fa700 0 client.25382 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T12:59:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa377524b80 1 -- 172.21.15.17:0/653555638 >> 172.21.15.17:0/653555638 conn(0x5559789ceda0 msgr2=0x5559789d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa377524b80 1 -- 172.21.15.17:0/653555638 shutdown_connections 2023-07-14T12:59:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.027+0000 7fa377524b80 1 -- 172.21.15.17:0/653555638 wait complete. 2023-07-14T12:59:37.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa377524b80 20 client.25382 trim_cache size 0 max 16384 2023-07-14T12:59:37.066 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T12:59:37.066 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T12:59:37.066 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T12:59:37.066 INFO:teuthology.orchestra.run.smithi017.stdout: "38559417-0fb7-48b5-b816-1849660affd2": { 2023-07-14T12:59:37.066 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T12:59:37.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "38559417-0fb7-48b5-b816-1849660affd2", 2023-07-14T12:59:37.067 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T12:59:37.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T12:59:37.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T12:59:37.067 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T12:59:37.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 -- 172.21.15.17:0/596133105 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa3480a1220 msgr2=0x7fa3480a36d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:59:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa3480a1220 0x7fa3480a36d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 -- 172.21.15.17:0/596133105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa35c100560 msgr2=0x7fa35c195790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa35c100560 0x7fa35c195790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa35800e9f0 tx=0x7fa35800ed00 comp rx=0 tx=0).stop 2023-07-14T12:59:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 -- 172.21.15.17:0/596133105 shutdown_connections 2023-07-14T12:59:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fa3480a1220 0x7fa3480a36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa35c1057a0 0x7fa35c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa35c100560 0x7fa35c195790 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 --2- 172.21.15.17:0/596133105 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa35c102e80 0x7fa35c195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 -- 172.21.15.17:0/596133105 >> 172.21.15.17:0/596133105 conn(0x7fa35c0fa000 msgr2=0x7fa35c1011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 -- 172.21.15.17:0/596133105 shutdown_connections 2023-07-14T12:59:37.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.028+0000 7fa363bff700 1 -- 172.21.15.17:0/596133105 wait complete. 2023-07-14T12:59:37.078 INFO:tasks.cephfs.filesystem:scrub status for tag:38559417-0fb7-48b5-b816-1849660affd2 - {'path': '/', 'tag': '38559417-0fb7-48b5-b816-1849660affd2', 'options': 'recursive,force'} 2023-07-14T12:59:37.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:37 smithi017 ceph-mon[95536]: from='client.? ' entity='client.admin' 2023-07-14T12:59:37.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:37 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T12:59:37.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:37 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:37.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:37 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T12:59:37.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:37 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:37.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:37 smithi135 ceph-mon[97338]: from='client.? ' entity='client.admin' 2023-07-14T12:59:37.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:37 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T12:59:37.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:37 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:37.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:37 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T12:59:37.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:37 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:37.449 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:37 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:37.149+0000 7f8e1a2ea200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:59:37.496 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:37 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:37.142+0000 7f7e7b9d5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:59:37.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:37 smithi131 ceph-mon[96953]: from='client.? ' entity='client.admin' 2023-07-14T12:59:37.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:37 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T12:59:37.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:37 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:37.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:37 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T12:59:37.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:37 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T12:59:37.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.654+0000 7fcde979a700 1 -- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 msgr2=0x7fcdd00a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:37.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:37.654+0000 7fcde979a700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 0x7fcdd00a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T12:59:37.856 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:37 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:37.353+0000 7f6466177200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T12:59:38.198 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:37 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:37.883+0000 7f8e1a2ea200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T12:59:38.198 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:38 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:38.092+0000 7f8e1a2ea200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:59:38.246 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:37 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:37.877+0000 7f7e7b9d5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T12:59:38.246 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:38 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:38.084+0000 7f7e7b9d5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:59:38.606 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:38.128+0000 7f6466177200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T12:59:38.606 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:38.341+0000 7f6466177200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T12:59:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:39.256+0000 7fcde979a700 1 -- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 msgr2=0x7fcdd00a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:39.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:39.256+0000 7fcde979a700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 0x7fcdd00a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-07-14T12:59:39.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:38 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T12:59:39.396 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:39 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:39.023+0000 7f7e7b9d5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:59:39.397 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:39 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:39.143+0000 7f7e7b9d5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:59:39.397 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:38 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T12:59:39.405 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:38 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T12:59:39.405 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:39 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:39.033+0000 7f8e1a2ea200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:59:39.406 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:39 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:39.153+0000 7f8e1a2ea200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:59:39.406 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:39 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:39.375+0000 7f8e1a2ea200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:59:39.716 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:39 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:39.330+0000 7f6466177200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:59:39.716 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:39 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:39.455+0000 7f6466177200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T12:59:39.746 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:39 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:39.365+0000 7f7e7b9d5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:59:40.026 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:39 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:39.720+0000 7f7e7b9d5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T12:59:40.042 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:39 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:39.735+0000 7f8e1a2ea200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T12:59:40.090 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:39 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:39.686+0000 7f6466177200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T12:59:40.356 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:40 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:40.060+0000 7f6466177200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T12:59:40.448 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:40 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:40.012+0000 7f8e1a2ea200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:59:40.448 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:40 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:40.205+0000 7f8e1a2ea200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:59:40.496 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:39 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:39.995+0000 7f7e7b9d5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:59:40.496 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:40 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:40.190+0000 7f7e7b9d5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:59:40.856 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:40 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:40.345+0000 7f6466177200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T12:59:40.856 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:40 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:40.548+0000 7f6466177200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T12:59:40.948 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:40 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:40.547+0000 7f8e1a2ea200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:59:40.996 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:40 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:40.531+0000 7f7e7b9d5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:59:41.356 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:40 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:40.906+0000 7f6466177200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T12:59:41.746 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:41 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:41.451+0000 7f7e7b9d5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:59:41.747 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:41 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:41.622+0000 7f7e7b9d5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:59:41.912 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:41 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:41.470+0000 7f8e1a2ea200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:59:41.912 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:41 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:41.639+0000 7f8e1a2ea200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:59:42.198 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:41 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:41.882+0000 7f8e1a2ea200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:59:42.198 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:42 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:42.027+0000 7f8e1a2ea200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:59:42.246 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:41 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:41.864+0000 7f7e7b9d5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:59:42.247 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:42 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:42.010+0000 7f7e7b9d5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:59:42.341 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:41.874+0000 7f6466177200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T12:59:42.341 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:42 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:42.055+0000 7f6466177200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T12:59:42.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:42.459+0000 7fcde979a700 1 -- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 msgr2=0x7fcdd00a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2034486077 2023-07-14T12:59:42.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:42.459+0000 7fcde979a700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 0x7fcdd00a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-07-14T12:59:42.606 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:42 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:42.310+0000 7f6466177200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T12:59:42.606 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:42 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:42.464+0000 7f6466177200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T12:59:42.698 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:42 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:42.300+0000 7f8e1a2ea200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:59:42.746 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:42 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:42.282+0000 7f7e7b9d5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:59:43.106 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:42 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:42.749+0000 7f6466177200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T12:59:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:43.409+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 20) v1 ==== 135732+0+0 (secure 0 0 0) 0x7fcde0097660 con 0x7fcde4072f70 2023-07-14T12:59:43.698 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z[99254]: 2023-07-14T12:59:43.357+0000 7f8e1a2ea200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:59:43.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: Standby manager daemon y restarted 2023-07-14T12:59:43.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: Standby manager daemon y started 2023-07-14T12:59:43.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-14T12:59:43.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:59:43.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-14T12:59:43.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:59:43.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: Standby manager daemon z restarted 2023-07-14T12:59:43.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: Standby manager daemon z started 2023-07-14T12:59:43.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-14T12:59:43.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:59:43.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-14T12:59:43.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:43 smithi135 ceph-mon[97338]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:59:43.747 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y[98409]: 2023-07-14T12:59:43.344+0000 7f7e7b9d5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:59:43.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: Standby manager daemon y restarted 2023-07-14T12:59:43.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: Standby manager daemon y started 2023-07-14T12:59:43.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-14T12:59:43.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:59:43.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-14T12:59:43.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:59:43.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: Standby manager daemon z restarted 2023-07-14T12:59:43.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: Standby manager daemon z started 2023-07-14T12:59:43.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-14T12:59:43.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:59:43.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-14T12:59:43.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:43 smithi131 ceph-mon[96953]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:59:43.856 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: Standby manager daemon y restarted 2023-07-14T12:59:43.856 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: Standby manager daemon y started 2023-07-14T12:59:43.857 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-14T12:59:43.857 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:59:43.857 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-14T12:59:43.857 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.131:0/4213611933' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:59:43.857 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: Standby manager daemon z restarted 2023-07-14T12:59:43.857 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: Standby manager daemon z started 2023-07-14T12:59:43.857 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-14T12:59:43.858 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T12:59:43.858 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-14T12:59:43.858 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-mon[95536]: from='mgr.? 172.21.15.135:0/1681415627' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T12:59:43.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:43.877+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mgrmap(e 21) v1 ==== 135400+0+0 (secure 0 0 0) 0x7fcde00cb630 con 0x7fcde4072f70 2023-07-14T12:59:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:43.878+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 msgr2=0x7fcdd00a3650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T12:59:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:43.878+0000 7fcddaffd700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/2034486077,v1:172.21.15.17:6801/2034486077] conn(0x7fcdd00a11a0 0x7fcdd00a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:44.213 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:43 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:43.861+0000 7f6466177200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T12:59:44.214 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:44.089+0000 7f63c15ce700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:59:44.214 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:44.089+0000 7f63c15ce700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:59:44.214 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:44.089+0000 7f63c15ce700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:59:44.214 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:44.089+0000 7f63c15ce700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:59:44.214 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:44.089+0000 7f63c15ce700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:59:44.214 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:44.089+0000 7f63c3dd3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:59:44.215 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:44.089+0000 7f63c3dd3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:59:44.215 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:44.089+0000 7f63c3dd3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:59:44.215 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:44.089+0000 7f63c3dd3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:59:44.215 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T12:59:44.089+0000 7f63c3dd3700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T12:59:44.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: mgrmap e20: x(active, since 9m), standbys: z, y 2023-07-14T12:59:44.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: Active manager daemon x restarted 2023-07-14T12:59:44.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: Activating manager daemon x 2023-07-14T12:59:44.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: osdmap e89: 12 total, 12 up, 12 in 2023-07-14T12:59:44.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: mgrmap e21: x(active, starting, since 0.0145734s), standbys: z, y 2023-07-14T12:59:44.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:59:44.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:59:44.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:59:44.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-14T12:59:44.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-14T12:59:44.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-14T12:59:44.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-14T12:59:44.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-14T12:59:44.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-14T12:59:44.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-14T12:59:44.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-14T12:59:44.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-14T12:59:44.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-14T12:59:44.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-14T12:59:44.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-14T12:59:44.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-14T12:59:44.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-14T12:59:44.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-14T12:59:44.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:59:44.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:59:44.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:59:44.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:59:44.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:59:44.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:59:44.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:59:44.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:59:44.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:59:44.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:59:44.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:59:44.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:59:44.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-14T12:59:44.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-14T12:59:44.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-14T12:59:44.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: Manager daemon x is now available 2023-07-14T12:59:44.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:59:44.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:59:44.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T12:59:44.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T12:59:44.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T12:59:44.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:44 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T12:59:44.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: mgrmap e20: x(active, since 9m), standbys: z, y 2023-07-14T12:59:44.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: Active manager daemon x restarted 2023-07-14T12:59:44.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: Activating manager daemon x 2023-07-14T12:59:44.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: osdmap e89: 12 total, 12 up, 12 in 2023-07-14T12:59:44.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: mgrmap e21: x(active, starting, since 0.0145734s), standbys: z, y 2023-07-14T12:59:44.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:59:44.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:59:44.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:59:44.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-14T12:59:44.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-14T12:59:44.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-14T12:59:44.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-14T12:59:44.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-14T12:59:44.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-14T12:59:44.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-14T12:59:44.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-14T12:59:44.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-14T12:59:44.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-14T12:59:44.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-14T12:59:44.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-14T12:59:44.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-14T12:59:44.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-14T12:59:44.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-14T12:59:44.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:59:44.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:59:44.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:59:44.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:59:44.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:59:44.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:59:44.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:59:44.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:59:44.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:59:44.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:59:44.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:59:44.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:59:44.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-14T12:59:44.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-14T12:59:44.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-14T12:59:44.709 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: Manager daemon x is now available 2023-07-14T12:59:44.709 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:59:44.709 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:59:44.710 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T12:59:44.710 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T12:59:44.710 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T12:59:44.710 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:44 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T12:59:44.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: mgrmap e20: x(active, since 9m), standbys: z, y 2023-07-14T12:59:44.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: Active manager daemon x restarted 2023-07-14T12:59:44.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: Activating manager daemon x 2023-07-14T12:59:44.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: osdmap e89: 12 total, 12 up, 12 in 2023-07-14T12:59:44.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: mgrmap e21: x(active, starting, since 0.0145734s), standbys: z, y 2023-07-14T12:59:44.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T12:59:44.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T12:59:44.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T12:59:44.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-14T12:59:44.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-14T12:59:44.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-14T12:59:44.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-14T12:59:44.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-14T12:59:44.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-14T12:59:44.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-14T12:59:44.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-14T12:59:44.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-14T12:59:44.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-14T12:59:44.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-14T12:59:44.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-14T12:59:44.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-14T12:59:44.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-14T12:59:44.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-14T12:59:44.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T12:59:44.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T12:59:44.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T12:59:44.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T12:59:44.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T12:59:44.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T12:59:44.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T12:59:44.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T12:59:44.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T12:59:44.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T12:59:44.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T12:59:44.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T12:59:44.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-14T12:59:44.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-14T12:59:44.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-14T12:59:44.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: Manager daemon x is now available 2023-07-14T12:59:44.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:59:44.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:59:44.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T12:59:44.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T12:59:44.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T12:59:44.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:44 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T12:59:44.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.885+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 <== mon.0 v2:172.21.15.17:3300/0 9 ==== mgrmap(e 22) v1 ==== 135527+0+0 (secure 0 0 0) 0x7fcde00bfd30 con 0x7fcde4072f70 2023-07-14T12:59:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.885+0000 7fcddaffd700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcdd001b4a0 0x7fcdd001b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.885+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 --> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcde4060950 con 0x7fcdd001b4a0 2023-07-14T12:59:44.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.890+0000 7fcde979a700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcdd001b4a0 0x7fcdd001b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:44.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.894+0000 7fcde979a700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcdd001b4a0 0x7fcdd001b870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcde4074270 tx=0x7fcdd4009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:44.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.956+0000 7fcddaffd700 1 -- 172.21.15.17:0/2249462195 <== mgr.15525 v2:172.21.15.17:6800/3916014154 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcde4060950 con 0x7fcdd001b4a0 2023-07-14T12:59:44.987 INFO:teuthology.orchestra.run.smithi017.stdout:Schedule set for path / 2023-07-14T12:59:44.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.959+0000 7fcdec1ff700 1 -- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcdd001b4a0 msgr2=0x7fcdd001b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:44.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.959+0000 7fcdec1ff700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcdd001b4a0 0x7fcdd001b870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcde4074270 tx=0x7fcdd4009260 comp rx=0 tx=0).stop 2023-07-14T12:59:44.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.959+0000 7fcdec1ff700 1 -- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde4072f70 msgr2=0x7fcde419bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:44.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.959+0000 7fcdec1ff700 1 --2- 172.21.15.17:0/2249462195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcde4072f70 0x7fcde419bdc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009fd0 tx=0x7fcde000b790 comp rx=0 tx=0).stop 2023-07-14T12:59:44.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.959+0000 7fcdea79c700 1 -- 172.21.15.17:0/2249462195 reap_dead start 2023-07-14T12:59:44.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.959+0000 7fcdec1ff700 1 -- 172.21.15.17:0/2249462195 shutdown_connections 2023-07-14T12:59:44.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.959+0000 7fcdec1ff700 1 -- 172.21.15.17:0/2249462195 >> 172.21.15.17:0/2249462195 conn(0x7fcde40fb090 msgr2=0x7fcde40fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:44.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.959+0000 7fcdec1ff700 1 -- 172.21.15.17:0/2249462195 shutdown_connections 2023-07-14T12:59:44.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:44.959+0000 7fcdec1ff700 1 -- 172.21.15.17:0/2249462195 wait complete. 2023-07-14T12:59:45.009 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h' 2023-07-14T12:59:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.206+0000 7ff5897ff700 1 -- 172.21.15.17:0/1376144162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff584074550 msgr2=0x7ff5840729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.206+0000 7ff5897ff700 1 --2- 172.21.15.17:0/1376144162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff584074550 0x7ff5840729a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff574009990 tx=0x7ff574009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.206+0000 7ff5897ff700 1 -- 172.21.15.17:0/1376144162 shutdown_connections 2023-07-14T12:59:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.206+0000 7ff5897ff700 1 --2- 172.21.15.17:0/1376144162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff58410c0e0 0x7ff58410e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.206+0000 7ff5897ff700 1 --2- 172.21.15.17:0/1376144162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff584074550 0x7ff5840729a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.206+0000 7ff5897ff700 1 --2- 172.21.15.17:0/1376144162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584072f70 0x7ff5840733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.206+0000 7ff5897ff700 1 -- 172.21.15.17:0/1376144162 >> 172.21.15.17:0/1376144162 conn(0x7ff5840fb130 msgr2=0x7ff5840fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.206+0000 7ff5897ff700 1 -- 172.21.15.17:0/1376144162 shutdown_connections 2023-07-14T12:59:45.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.206+0000 7ff5897ff700 1 -- 172.21.15.17:0/1376144162 wait complete. 2023-07-14T12:59:45.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.207+0000 7ff5897ff700 1 Processor -- start 2023-07-14T12:59:45.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.207+0000 7ff5897ff700 1 -- start start 2023-07-14T12:59:45.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.207+0000 7ff5897ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584072f70 0x7ff58419bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:45.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.207+0000 7ff5897ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff584074550 0x7ff58419c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.207+0000 7ff5897ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58410c0e0 0x7ff58419d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff5897ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58419d8e0 con 0x7ff584072f70 2023-07-14T12:59:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff5897ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58419da50 con 0x7ff584074550 2023-07-14T12:59:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff5897ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58419dc10 con 0x7ff58410c0e0 2023-07-14T12:59:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff582ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584072f70 0x7ff58419bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff582ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584072f70 0x7ff58419bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44918/0 (socket says 172.21.15.17:44918) 2023-07-14T12:59:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff5827fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff584074550 0x7ff58419c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff582ffd700 1 -- 172.21.15.17:0/2393104464 learned_addr learned my addr 172.21.15.17:0/2393104464 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:45.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff5837fe700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58410c0e0 0x7ff58419d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:45.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff582ffd700 1 -- 172.21.15.17:0/2393104464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58410c0e0 msgr2=0x7ff58419d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:45.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff582ffd700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58410c0e0 0x7ff58419d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff582ffd700 1 -- 172.21.15.17:0/2393104464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff584074550 msgr2=0x7ff58419c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:45.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff582ffd700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff584074550 0x7ff58419c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff582ffd700 1 -- 172.21.15.17:0/2393104464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5740095f0 con 0x7ff584072f70 2023-07-14T12:59:45.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.208+0000 7ff5827fc700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff584074550 0x7ff58419c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:45.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.209+0000 7ff582ffd700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584072f70 0x7ff58419bec0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff574005910 tx=0x7ff574005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:45.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.209+0000 7ff56bfff700 1 -- 172.21.15.17:0/2393104464 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57401d070 con 0x7ff584072f70 2023-07-14T12:59:45.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.209+0000 7ff5897ff700 1 -- 172.21.15.17:0/2393104464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58419de90 con 0x7ff584072f70 2023-07-14T12:59:45.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.209+0000 7ff56bfff700 1 -- 172.21.15.17:0/2393104464 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff57400bdb0 con 0x7ff584072f70 2023-07-14T12:59:45.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.209+0000 7ff56bfff700 1 -- 172.21.15.17:0/2393104464 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574022d40 con 0x7ff584072f70 2023-07-14T12:59:45.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.209+0000 7ff5897ff700 1 -- 172.21.15.17:0/2393104464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5841a46b0 con 0x7ff584072f70 2023-07-14T12:59:45.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.210+0000 7ff5897ff700 1 -- 172.21.15.17:0/2393104464 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff584101c30 con 0x7ff584072f70 2023-07-14T12:59:45.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.212+0000 7ff56bfff700 1 -- 172.21.15.17:0/2393104464 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 22) v1 ==== 135527+0+0 (secure 0 0 0) 0x7ff574022470 con 0x7ff584072f70 2023-07-14T12:59:45.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.214+0000 7ff56bfff700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff56c0a0f50 0x7ff56c0a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:45.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.214+0000 7ff56bfff700 1 -- 172.21.15.17:0/2393104464 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff5740ce250 con 0x7ff584072f70 2023-07-14T12:59:45.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.214+0000 7ff5827fc700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff56c0a0f50 0x7ff56c0a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:45.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.215+0000 7ff5827fc700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff56c0a0f50 0x7ff56c0a3400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff584074270 tx=0x7ff578009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:45.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.217+0000 7ff56bfff700 1 -- 172.21.15.17:0/2393104464 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff574097c30 con 0x7ff584072f70 2023-07-14T12:59:45.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.465+0000 7ff5897ff700 1 -- 172.21.15.17:0/2393104464 --> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}) v1 -- 0x7ff584060950 con 0x7ff56c0a0f50 2023-07-14T12:59:45.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.526+0000 7ff56bfff700 1 -- 172.21.15.17:0/2393104464 <== mgr.15525 v2:172.21.15.17:6800/3916014154 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7ff584060950 con 0x7ff56c0a0f50 2023-07-14T12:59:45.557 INFO:teuthology.orchestra.run.smithi017.stdout:Retention added to path / 2023-07-14T12:59:45.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 -- 172.21.15.17:0/2393104464 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff56c0a0f50 msgr2=0x7ff56c0a3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:45.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff56c0a0f50 0x7ff56c0a3400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff584074270 tx=0x7ff578009260 comp rx=0 tx=0).stop 2023-07-14T12:59:45.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 -- 172.21.15.17:0/2393104464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584072f70 msgr2=0x7ff58419bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:45.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584072f70 0x7ff58419bec0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff574005910 tx=0x7ff574005740 comp rx=0 tx=0).stop 2023-07-14T12:59:45.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 -- 172.21.15.17:0/2393104464 shutdown_connections 2023-07-14T12:59:45.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff56c0a0f50 0x7ff56c0a3400 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58410c0e0 0x7ff58419d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff584072f70 0x7ff58419bec0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 --2- 172.21.15.17:0/2393104464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff584074550 0x7ff58419c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 -- 172.21.15.17:0/2393104464 >> 172.21.15.17:0/2393104464 conn(0x7ff5840fb130 msgr2=0x7ff5840fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 -- 172.21.15.17:0/2393104464 shutdown_connections 2023-07-14T12:59:45.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.529+0000 7ff5897ff700 1 -- 172.21.15.17:0/2393104464 wait complete. 2023-07-14T12:59:45.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-07-14T12:59:45.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.758+0000 7fd4333ff700 1 -- 172.21.15.17:0/3797353573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42c074550 msgr2=0x7fd42c0729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:45.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.758+0000 7fd4333ff700 1 --2- 172.21.15.17:0/3797353573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42c074550 0x7fd42c0729a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd428009990 tx=0x7fd428009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.759+0000 7fd4333ff700 1 -- 172.21.15.17:0/3797353573 shutdown_connections 2023-07-14T12:59:45.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.759+0000 7fd4333ff700 1 --2- 172.21.15.17:0/3797353573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd42c107950 0x7fd42c109dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.759+0000 7fd4333ff700 1 --2- 172.21.15.17:0/3797353573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42c074550 0x7fd42c0729a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.759+0000 7fd4333ff700 1 --2- 172.21.15.17:0/3797353573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd42c072f70 0x7fd42c0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.759+0000 7fd4333ff700 1 -- 172.21.15.17:0/3797353573 >> 172.21.15.17:0/3797353573 conn(0x7fd42c0fb090 msgr2=0x7fd42c0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:45.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.759+0000 7fd4333ff700 1 -- 172.21.15.17:0/3797353573 shutdown_connections 2023-07-14T12:59:45.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.759+0000 7fd4333ff700 1 -- 172.21.15.17:0/3797353573 wait complete. 2023-07-14T12:59:45.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.760+0000 7fd4333ff700 1 Processor -- start 2023-07-14T12:59:45.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.760+0000 7fd4333ff700 1 -- start start 2023-07-14T12:59:45.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.760+0000 7fd4333ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42c072f70 0x7fd42c197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:45.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.760+0000 7fd4333ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd42c074550 0x7fd42c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:45.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.760+0000 7fd4333ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd42c107950 0x7fd42c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:45.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.760+0000 7fd4333ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c19f4a0 con 0x7fd42c107950 2023-07-14T12:59:45.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.760+0000 7fd4333ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c19f5e0 con 0x7fd42c074550 2023-07-14T12:59:45.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.760+0000 7fd4333ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c19f770 con 0x7fd42c072f70 2023-07-14T12:59:45.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.761+0000 7fd43119b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42c072f70 0x7fd42c197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:45.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.761+0000 7fd43119b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42c072f70 0x7fd42c197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:42158/0 (socket says 172.21.15.17:42158) 2023-07-14T12:59:45.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.761+0000 7fd43119b700 1 -- 172.21.15.17:0/1606982764 learned_addr learned my addr 172.21.15.17:0/1606982764 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:45.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.761+0000 7fd43199c700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd42c107950 0x7fd42c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:45.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.761+0000 7fd43099a700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd42c074550 0x7fd42c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:45.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.761+0000 7fd43119b700 1 -- 172.21.15.17:0/1606982764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd42c074550 msgr2=0x7fd42c197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:45.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.761+0000 7fd43119b700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd42c074550 0x7fd42c197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.761+0000 7fd43119b700 1 -- 172.21.15.17:0/1606982764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd42c107950 msgr2=0x7fd42c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:45.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.761+0000 7fd43119b700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd42c107950 0x7fd42c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:45.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.761+0000 7fd43119b700 1 -- 172.21.15.17:0/1606982764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c009520 con 0x7fd42c072f70 2023-07-14T12:59:45.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.761+0000 7fd43119b700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42c072f70 0x7fd42c197920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4280059d0 tx=0x7fd4280057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:45.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.762+0000 7fd4227fc700 1 -- 172.21.15.17:0/1606982764 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42801d070 con 0x7fd42c072f70 2023-07-14T12:59:45.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.762+0000 7fd4227fc700 1 -- 172.21.15.17:0/1606982764 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd42800be30 con 0x7fd42c072f70 2023-07-14T12:59:45.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.762+0000 7fd4227fc700 1 -- 172.21.15.17:0/1606982764 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42800fe20 con 0x7fd42c072f70 2023-07-14T12:59:45.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.762+0000 7fd4333ff700 1 -- 172.21.15.17:0/1606982764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4280095f0 con 0x7fd42c072f70 2023-07-14T12:59:45.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.762+0000 7fd4333ff700 1 -- 172.21.15.17:0/1606982764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c19fd10 con 0x7fd42c072f70 2023-07-14T12:59:45.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.763+0000 7fd4333ff700 1 -- 172.21.15.17:0/1606982764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42c106000 con 0x7fd42c072f70 2023-07-14T12:59:45.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.765+0000 7fd4227fc700 1 -- 172.21.15.17:0/1606982764 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 22) v1 ==== 135527+0+0 (secure 0 0 0) 0x7fd42800f5f0 con 0x7fd42c072f70 2023-07-14T12:59:45.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.767+0000 7fd4227fc700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4180a0fd0 0x7fd4180a3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:45.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.767+0000 7fd4227fc700 1 -- 172.21.15.17:0/1606982764 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd4280cd7c0 con 0x7fd42c072f70 2023-07-14T12:59:45.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.767+0000 7fd43099a700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4180a0fd0 0x7fd4180a3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:45.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.768+0000 7fd43099a700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4180a0fd0 0x7fd4180a3480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd42c074270 tx=0x7fd41c009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:45.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.771+0000 7fd4227fc700 1 -- 172.21.15.17:0/1606982764 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fd4280971a0 con 0x7fd42c072f70 2023-07-14T12:59:45.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:45.895+0000 7fd4227fc700 1 -- 172.21.15.17:0/1606982764 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 23) v1 ==== 135891+0+0 (secure 0 0 0) 0x7fd428097570 con 0x7fd42c072f70 2023-07-14T12:59:46.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.031+0000 7fd4333ff700 1 -- 172.21.15.17:0/1606982764 --> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fd42c060950 con 0x7fd4180a0fd0 2023-07-14T12:59:46.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.039+0000 7fd4227fc700 1 -- 172.21.15.17:0/1606982764 <== mgr.15525 v2:172.21.15.17:6800/3916014154 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7fd42c060950 con 0x7fd4180a0fd0 2023-07-14T12:59:46.070 INFO:teuthology.orchestra.run.smithi017.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:59:44", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-07-14T12:59:46.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 -- 172.21.15.17:0/1606982764 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4180a0fd0 msgr2=0x7fd4180a3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:46.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4180a0fd0 0x7fd4180a3480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd42c074270 tx=0x7fd41c009260 comp rx=0 tx=0).stop 2023-07-14T12:59:46.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 -- 172.21.15.17:0/1606982764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42c072f70 msgr2=0x7fd42c197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:46.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42c072f70 0x7fd42c197920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4280059d0 tx=0x7fd4280057c0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 -- 172.21.15.17:0/1606982764 shutdown_connections 2023-07-14T12:59:46.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4180a0fd0 0x7fd4180a3480 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd42c107950 0x7fd42c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd42c072f70 0x7fd42c197920 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 --2- 172.21.15.17:0/1606982764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd42c074550 0x7fd42c197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 -- 172.21.15.17:0/1606982764 >> 172.21.15.17:0/1606982764 conn(0x7fd42c0fb090 msgr2=0x7fd42c0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:46.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 -- 172.21.15.17:0/1606982764 shutdown_connections 2023-07-14T12:59:46.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.042+0000 7fd4333ff700 1 -- 172.21.15.17:0/1606982764 wait complete. 2023-07-14T12:59:46.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-07-14T12:59:46.159 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:45 smithi017 ceph-mon[95536]: [14/Jul/2023:12:59:44] ENGINE Bus STARTING 2023-07-14T12:59:46.159 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:45 smithi017 ceph-mon[95536]: [14/Jul/2023:12:59:44] ENGINE Serving on http://172.21.15.17:8765 2023-07-14T12:59:46.159 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:45 smithi017 ceph-mon[95536]: [14/Jul/2023:12:59:44] ENGINE Serving on https://172.21.15.17:7150 2023-07-14T12:59:46.159 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:45 smithi017 ceph-mon[95536]: [14/Jul/2023:12:59:44] ENGINE Bus STARTED 2023-07-14T12:59:46.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:45 smithi017 ceph-mon[95536]: mgrmap e22: x(active, since 1.0216s), standbys: z, y 2023-07-14T12:59:46.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:45 smithi017 ceph-mon[95536]: from='client.15561 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:46.160 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:45 smithi017 ceph-mon[95536]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:46.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:45 smithi135 ceph-mon[97338]: [14/Jul/2023:12:59:44] ENGINE Bus STARTING 2023-07-14T12:59:46.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:45 smithi135 ceph-mon[97338]: [14/Jul/2023:12:59:44] ENGINE Serving on http://172.21.15.17:8765 2023-07-14T12:59:46.199 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:45 smithi135 ceph-mon[97338]: [14/Jul/2023:12:59:44] ENGINE Serving on https://172.21.15.17:7150 2023-07-14T12:59:46.199 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:45 smithi135 ceph-mon[97338]: [14/Jul/2023:12:59:44] ENGINE Bus STARTED 2023-07-14T12:59:46.199 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:45 smithi135 ceph-mon[97338]: mgrmap e22: x(active, since 1.0216s), standbys: z, y 2023-07-14T12:59:46.199 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:45 smithi135 ceph-mon[97338]: from='client.15561 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:46.199 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:45 smithi135 ceph-mon[97338]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:46.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:45 smithi131 ceph-mon[96953]: [14/Jul/2023:12:59:44] ENGINE Bus STARTING 2023-07-14T12:59:46.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:45 smithi131 ceph-mon[96953]: [14/Jul/2023:12:59:44] ENGINE Serving on http://172.21.15.17:8765 2023-07-14T12:59:46.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:45 smithi131 ceph-mon[96953]: [14/Jul/2023:12:59:44] ENGINE Serving on https://172.21.15.17:7150 2023-07-14T12:59:46.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:45 smithi131 ceph-mon[96953]: [14/Jul/2023:12:59:44] ENGINE Bus STARTED 2023-07-14T12:59:46.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:45 smithi131 ceph-mon[96953]: mgrmap e22: x(active, since 1.0216s), standbys: z, y 2023-07-14T12:59:46.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:45 smithi131 ceph-mon[96953]: from='client.15561 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:46.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:45 smithi131 ceph-mon[96953]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:46.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.274+0000 7f5500bff700 1 -- 172.21.15.17:0/933814775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54fc072f70 msgr2=0x7f54fc0733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:46.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.274+0000 7f5500bff700 1 --2- 172.21.15.17:0/933814775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54fc072f70 0x7f54fc0733e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f54f0009990 tx=0x7f54f0009ca0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.274+0000 7f5500bff700 1 -- 172.21.15.17:0/933814775 shutdown_connections 2023-07-14T12:59:46.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.274+0000 7f5500bff700 1 --2- 172.21.15.17:0/933814775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc1079d0 0x7f54fc109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.274+0000 7f5500bff700 1 --2- 172.21.15.17:0/933814775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54fc074550 0x7f54fc0729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.274+0000 7f5500bff700 1 --2- 172.21.15.17:0/933814775 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54fc072f70 0x7f54fc0733e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.274+0000 7f5500bff700 1 -- 172.21.15.17:0/933814775 >> 172.21.15.17:0/933814775 conn(0x7f54fc0fb130 msgr2=0x7f54fc0fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.274+0000 7f5500bff700 1 -- 172.21.15.17:0/933814775 shutdown_connections 2023-07-14T12:59:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.274+0000 7f5500bff700 1 -- 172.21.15.17:0/933814775 wait complete. 2023-07-14T12:59:46.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.275+0000 7f5500bff700 1 Processor -- start 2023-07-14T12:59:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f5500bff700 1 -- start start 2023-07-14T12:59:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f5500bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54fc072f70 0x7f54fc197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f5500bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54fc074550 0x7f54fc197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f5500bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc1079d0 0x7f54fc198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f5500bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1994d0 con 0x7f54fc074550 2023-07-14T12:59:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f5500bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc199640 con 0x7f54fc1079d0 2023-07-14T12:59:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f5500bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc199800 con 0x7f54fc072f70 2023-07-14T12:59:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f54f9d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54fc074550 0x7f54fc197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f54fad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc1079d0 0x7f54fc198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f54fa59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54fc072f70 0x7f54fc197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f54f9d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54fc074550 0x7f54fc197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44958/0 (socket says 172.21.15.17:44958) 2023-07-14T12:59:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.276+0000 7f54f9d9b700 1 -- 172.21.15.17:0/239419247 learned_addr learned my addr 172.21.15.17:0/239419247 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T12:59:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f54fad9d700 1 -- 172.21.15.17:0/239419247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54fc072f70 msgr2=0x7f54fc197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:46.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f54fad9d700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54fc072f70 0x7f54fc197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f54fad9d700 1 -- 172.21.15.17:0/239419247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54fc074550 msgr2=0x7f54fc197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f54fad9d700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54fc074550 0x7f54fc197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f54fad9d700 1 -- 172.21.15.17:0/239419247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f00095f0 con 0x7f54fc1079d0 2023-07-14T12:59:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f54f9d9b700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54fc074550 0x7f54fc197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T12:59:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f54fad9d700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc1079d0 0x7f54fc198e70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f54f400efc0 tx=0x7f54f400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f54eb7fe700 1 -- 172.21.15.17:0/239419247 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4018070 con 0x7f54fc1079d0 2023-07-14T12:59:46.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f5500bff700 1 -- 172.21.15.17:0/239419247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc199a80 con 0x7f54fc1079d0 2023-07-14T12:59:46.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f54eb7fe700 1 -- 172.21.15.17:0/239419247 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f54f400f040 con 0x7f54fc1079d0 2023-07-14T12:59:46.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f54eb7fe700 1 -- 172.21.15.17:0/239419247 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f400cba0 con 0x7f54fc1079d0 2023-07-14T12:59:46.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.277+0000 7f5500bff700 1 -- 172.21.15.17:0/239419247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc1a02a0 con 0x7f54fc1079d0 2023-07-14T12:59:46.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.278+0000 7f5500bff700 1 -- 172.21.15.17:0/239419247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc106080 con 0x7f54fc1079d0 2023-07-14T12:59:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.280+0000 7f54eb7fe700 1 -- 172.21.15.17:0/239419247 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 23) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f54f4003a00 con 0x7f54fc1079d0 2023-07-14T12:59:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.281+0000 7f54eb7fe700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54e40a1350 0x7f54e40a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T12:59:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.282+0000 7f54eb7fe700 1 -- 172.21.15.17:0/239419247 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f54f40cc990 con 0x7f54fc1079d0 2023-07-14T12:59:46.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.282+0000 7f54fa59c700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54e40a1350 0x7f54e40a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T12:59:46.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.282+0000 7f54fa59c700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54e40a1350 0x7f54e40a3800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54fc074920 tx=0x7f54ec009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T12:59:46.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.285+0000 7f54eb7fe700 1 -- 172.21.15.17:0/239419247 <== mon.2 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f54f4095cd0 con 0x7f54fc1079d0 2023-07-14T12:59:46.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.546+0000 7f5500bff700 1 -- 172.21.15.17:0/239419247 --> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f54fc060950 con 0x7f54e40a1350 2023-07-14T12:59:46.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.553+0000 7f54eb7fe700 1 -- 172.21.15.17:0/239419247 <== mgr.15525 v2:172.21.15.17:6800/3916014154 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f54fc060950 con 0x7f54e40a1350 2023-07-14T12:59:46.584 INFO:teuthology.orchestra.run.smithi017.stdout:/ 1M 6M3h 2023-07-14T12:59:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 -- 172.21.15.17:0/239419247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54e40a1350 msgr2=0x7f54e40a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:46.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54e40a1350 0x7f54e40a3800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54fc074920 tx=0x7f54ec009260 comp rx=0 tx=0).stop 2023-07-14T12:59:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 -- 172.21.15.17:0/239419247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc1079d0 msgr2=0x7f54fc198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T12:59:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc1079d0 0x7f54fc198e70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f54f400efc0 tx=0x7f54f400c3a0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 -- 172.21.15.17:0/239419247 shutdown_connections 2023-07-14T12:59:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54e40a1350 0x7f54e40a3800 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc1079d0 0x7f54fc198e70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54fc072f70 0x7f54fc197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 --2- 172.21.15.17:0/239419247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54fc074550 0x7f54fc197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T12:59:46.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 -- 172.21.15.17:0/239419247 >> 172.21.15.17:0/239419247 conn(0x7f54fc0fb130 msgr2=0x7f54fc0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T12:59:46.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 -- 172.21.15.17:0/239419247 shutdown_connections 2023-07-14T12:59:46.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T12:59:46.556+0000 7f5500bff700 1 -- 172.21.15.17:0/239419247 wait complete. 2023-07-14T12:59:46.605 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-07-14T12:59:46.706 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-07-14T12:59:46.716 INFO:teuthology.run_tasks:Running task background_exec... 2023-07-14T12:59:46.734 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2023-07-14T12:59:46.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-07-14T12:59:46.739 INFO:teuthology.run_tasks:Running task exec... 2023-07-14T12:59:46.748 INFO:teuthology.task.exec:Executing custom commands... 2023-07-14T12:59:46.748 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi017.front.sepia.ceph.com 2023-07-14T12:59:46.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-07-14T12:59:46.857 INFO:teuthology.orchestra.run.smithi017.stdout:total 0 2023-07-14T12:59:46.892 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem Size Used Avail Use% Mounted on 2023-07-14T12:59:46.893 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-fuse 340G 0 340G 0% /tmp/cephfs 2023-07-14T12:59:46.897 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-07-14T12:59:47.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-07-14T12:59:47.130 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:46 smithi017 ceph-mon[95536]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:47.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:46 smithi017 ceph-mon[95536]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:47.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:46 smithi017 ceph-mon[95536]: mgrmap e23: x(active, since 2s), standbys: z, y 2023-07-14T12:59:47.131 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:46 smithi017 ceph-mon[95536]: from='client.25399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:47.148 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-07-14T12:59:47.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:46 smithi135 ceph-mon[97338]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:47.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:46 smithi135 ceph-mon[97338]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:47.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:46 smithi135 ceph-mon[97338]: mgrmap e23: x(active, since 2s), standbys: z, y 2023-07-14T12:59:47.199 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:46 smithi135 ceph-mon[97338]: from='client.25399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:47.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:46 smithi131 ceph-mon[96953]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:47.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:46 smithi131 ceph-mon[96953]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:47.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:46 smithi131 ceph-mon[96953]: mgrmap e23: x(active, since 2s), standbys: z, y 2023-07-14T12:59:47.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:46 smithi131 ceph-mon[96953]: from='client.25399 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:48.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:47 smithi135 ceph-mon[97338]: from='client.25436 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:48.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:47 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:48.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:47 smithi131 ceph-mon[96953]: from='client.25436 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:48.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:47 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:48.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:47 smithi017 ceph-mon[95536]: from='client.25436 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T12:59:48.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:47 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:48 smithi135 ceph-mon[97338]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:49.198 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:48 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.199 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:48 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.199 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:48 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.199 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:48 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.199 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:48 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:48 smithi131 ceph-mon[96953]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:49.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:48 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:48 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:48 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:48 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:48 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:48 smithi017 ceph-mon[95536]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:49.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:48 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:48 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:48 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:48 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:49.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:48 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.338 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.339 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.339 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.339 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.339 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.339 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.339 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.339 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T12:59:50.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T12:59:50.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.340 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T12:59:50.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T12:59:50.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T12:59:50.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T12:59:50.343 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:59:50.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:59:50.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Updating smithi017:/etc/ceph/ceph.conf 2023-07-14T12:59:50.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Updating smithi131:/etc/ceph/ceph.conf 2023-07-14T12:59:50.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Updating smithi135:/etc/ceph/ceph.conf 2023-07-14T12:59:50.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:50.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:59:50.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Updating smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:59:50.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:50 smithi017 ceph-mon[95536]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:59:50.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T12:59:50.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T12:59:50.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T12:59:50.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T12:59:50.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T12:59:50.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T12:59:50.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:59:50.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:59:50.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Updating smithi017:/etc/ceph/ceph.conf 2023-07-14T12:59:50.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Updating smithi131:/etc/ceph/ceph.conf 2023-07-14T12:59:50.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Updating smithi135:/etc/ceph/ceph.conf 2023-07-14T12:59:50.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:50.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:59:50.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Updating smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:59:50.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:50 smithi131 ceph-mon[96953]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:59:50.673 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-07-14T12:59:50.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T12:59:50.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T12:59:50.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T12:59:50.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T12:59:50.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:50.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T12:59:50.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T12:59:50.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T12:59:50.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:59:50.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:59:50.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Updating smithi017:/etc/ceph/ceph.conf 2023-07-14T12:59:50.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Updating smithi131:/etc/ceph/ceph.conf 2023-07-14T12:59:50.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Updating smithi135:/etc/ceph/ceph.conf 2023-07-14T12:59:50.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T12:59:50.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:59:50.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Updating smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:59:50.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:50 smithi135 ceph-mon[97338]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T12:59:50.776 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-07-14T12:59:50.782 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-07-14T12:59:50.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-07-14T12:59:51.007 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/: 2023-07-14T12:59:51.007 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-07-14T12:59:51.008 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T12:59:51.008 INFO:teuthology.orchestra.run.smithi017.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 .. 2023-07-14T12:59:51.008 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 data 2023-07-14T12:59:51.008 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T12:59:51.008 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data: 2023-07-14T12:59:51.008 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T12:59:51.008 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T12:59:51.009 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 .. 2023-07-14T12:59:51.013 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-07-14T12:59:51.145 INFO:teuthology.orchestra.run.smithi017.stdout:[Service] 2023-07-14T12:59:51.145 INFO:teuthology.orchestra.run.smithi017.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-07-14T12:59:51.145 INFO:teuthology.orchestra.run.smithi017.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-07-14T12:59:51.151 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-07-14T12:59:51.359 INFO:teuthology.orchestra.run.smithi017.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-07-14T12:59:52.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:59:52.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:59:52.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:59:52.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:59:52.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:59:52.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.249 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.249 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.249 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:59:52.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:59:52.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:59:52.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:59:52.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:59:52.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:59:52.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:59:52.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2023-07-14T12:59:52.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: Updating smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:59:52.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: Updating smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:59:52.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:52.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:53.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:52 smithi131 ceph-mon[96953]: Updating smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:59:53.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:52 smithi131 ceph-mon[96953]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 133 KiB/s wr, 50 op/s 2023-07-14T12:59:53.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:52 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:59:53.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:52 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:59:53.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:52 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:59:53.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:52 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:53.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:52 smithi017 ceph-mon[95536]: Updating smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:59:53.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:52 smithi017 ceph-mon[95536]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 133 KiB/s wr, 50 op/s 2023-07-14T12:59:53.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:52 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:59:53.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:52 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:59:53.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:52 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:59:53.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:52 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:53.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:52 smithi135 ceph-mon[97338]: Updating smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T12:59:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:52 smithi135 ceph-mon[97338]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 133 KiB/s wr, 50 op/s 2023-07-14T12:59:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:52 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T12:59:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:52 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T12:59:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:52 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T12:59:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:52 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T12:59:55.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:54 smithi131 ceph-mon[96953]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 39 op/s 2023-07-14T12:59:55.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:54 smithi017 ceph-mon[95536]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 39 op/s 2023-07-14T12:59:55.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:54 smithi135 ceph-mon[97338]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 39 op/s 2023-07-14T12:59:57.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:56 smithi131 ceph-mon[96953]: pgmap v9: 97 pgs: 97 active+clean; 21 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.9 MiB/s wr, 53 op/s 2023-07-14T12:59:57.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:56 smithi017 ceph-mon[95536]: pgmap v9: 97 pgs: 97 active+clean; 21 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.9 MiB/s wr, 53 op/s 2023-07-14T12:59:57.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:56 smithi135 ceph-mon[97338]: pgmap v9: 97 pgs: 97 active+clean; 21 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.9 MiB/s wr, 53 op/s 2023-07-14T12:59:59.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 12:59:58 smithi131 ceph-mon[96953]: pgmap v10: 97 pgs: 97 active+clean; 21 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 1.7 MiB/s wr, 49 op/s 2023-07-14T12:59:59.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 12:59:58 smithi017 ceph-mon[95536]: pgmap v10: 97 pgs: 97 active+clean; 21 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 1.7 MiB/s wr, 49 op/s 2023-07-14T12:59:59.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 12:59:58 smithi135 ceph-mon[97338]: pgmap v10: 97 pgs: 97 active+clean; 21 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 1.7 MiB/s wr, 49 op/s 2023-07-14T13:00:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.986+0000 7f64ae1ff700 1 -- 172.21.15.17:0/2449239920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a8105b10 msgr2=0x7f64a8105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.986+0000 7f64ae1ff700 1 --2- 172.21.15.17:0/2449239920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a8105b10 0x7f64a8105ee0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6498009990 tx=0x7f6498009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.986+0000 7f64ae1ff700 1 -- 172.21.15.17:0/2449239920 shutdown_connections 2023-07-14T13:00:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.986+0000 7f64ae1ff700 1 --2- 172.21.15.17:0/2449239920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81004b0 0x7f64a810c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.986+0000 7f64ae1ff700 1 --2- 172.21.15.17:0/2449239920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a8105b10 0x7f64a8105ee0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.986+0000 7f64ae1ff700 1 --2- 172.21.15.17:0/2449239920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64a80ffb00 0x7f64a80fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.986+0000 7f64ae1ff700 1 -- 172.21.15.17:0/2449239920 >> 172.21.15.17:0/2449239920 conn(0x7f64a80fb600 msgr2=0x7f64a80fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.986+0000 7f64ae1ff700 1 -- 172.21.15.17:0/2449239920 shutdown_connections 2023-07-14T13:00:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.986+0000 7f64ae1ff700 1 -- 172.21.15.17:0/2449239920 wait complete. 2023-07-14T13:00:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.987+0000 7f64ae1ff700 1 Processor -- start 2023-07-14T13:00:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.987+0000 7f64ae1ff700 1 -- start start 2023-07-14T13:00:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64ae1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64a80ffb00 0x7f64a819bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64ae1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81004b0 0x7f64a819c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64ae1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a8105b10 0x7f64a8195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64ae1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a81960a0 con 0x7f64a8105b10 2023-07-14T13:00:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64ae1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a8196210 con 0x7f64a80ffb00 2023-07-14T13:00:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64ae1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a81963d0 con 0x7f64a81004b0 2023-07-14T13:00:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64a7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a8105b10 0x7f64a8195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64a77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64a80ffb00 0x7f64a819bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64a7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a8105b10 0x7f64a8195a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38424/0 (socket says 172.21.15.17:38424) 2023-07-14T13:00:00.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64a7fff700 1 -- 172.21.15.17:0/753563778 learned_addr learned my addr 172.21.15.17:0/753563778 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64a6ffd700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81004b0 0x7f64a819c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64a7fff700 1 -- 172.21.15.17:0/753563778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81004b0 msgr2=0x7f64a819c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64a7fff700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81004b0 0x7f64a819c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64a7fff700 1 -- 172.21.15.17:0/753563778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64a80ffb00 msgr2=0x7f64a819bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:00.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64a7fff700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64a80ffb00 0x7f64a819bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.988+0000 7f64a7fff700 1 -- 172.21.15.17:0/753563778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64980095f0 con 0x7f64a8105b10 2023-07-14T13:00:00.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.989+0000 7f64a7fff700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a8105b10 0x7f64a8195a30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f64a000ef30 tx=0x7f64a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:00.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.989+0000 7f64a4ff9700 1 -- 172.21.15.17:0/753563778 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a0018070 con 0x7f64a8105b10 2023-07-14T13:00:00.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.989+0000 7f64a4ff9700 1 -- 172.21.15.17:0/753563778 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64a000f040 con 0x7f64a8105b10 2023-07-14T13:00:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.989+0000 7f64ae1ff700 1 -- 172.21.15.17:0/753563778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a8196650 con 0x7f64a8105b10 2023-07-14T13:00:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.989+0000 7f64a4ff9700 1 -- 172.21.15.17:0/753563778 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a000cbc0 con 0x7f64a8105b10 2023-07-14T13:00:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.989+0000 7f64ae1ff700 1 -- 172.21.15.17:0/753563778 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a8072920 con 0x7f64a8105b10 2023-07-14T13:00:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.993+0000 7f64a4ff9700 1 -- 172.21.15.17:0/753563778 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 23) v1 ==== 135891+0+0 (secure 0 0 0) 0x7f64a000cd80 con 0x7f64a8105b10 2023-07-14T13:00:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.995+0000 7f64c1b8ab80 1 Processor -- start 2023-07-14T13:00:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.995+0000 7f64c1b8ab80 1 -- start start 2023-07-14T13:00:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.995+0000 7f64a4ff9700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64900a1350 0x7f64900a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.995+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c367b6b0 0x5592c3824d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.995+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c38252d0 0x5592c381f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.995+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c381f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.995+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c3724c50 con 0x5592c38252d0 2023-07-14T13:00:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.995+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c37779e0 con 0x5592c381f580 2023-07-14T13:00:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.995+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c3770e70 con 0x5592c367b6b0 2023-07-14T13:00:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.995+0000 7f64a4ff9700 1 -- 172.21.15.17:0/753563778 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f64a00cc6b0 con 0x7f64a8105b10 2023-07-14T13:00:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.996+0000 7f64a7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c381f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.996+0000 7f64a7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c381f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:50688/0 (socket says 172.21.15.17:50688) 2023-07-14T13:00:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.996+0000 7f64a7fff700 1 -- 172.21.15.17:0/1123165927 learned_addr learned my addr 172.21.15.17:0/1123165927 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.996+0000 7f64a77fe700 1 --2- 172.21.15.17:0/1123165927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c367b6b0 0x5592c3824d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.996+0000 7f64a6ffd700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64900a1350 0x7f64900a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.996+0000 7f64a7fff700 1 -- 172.21.15.17:0/1123165927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c367b6b0 msgr2=0x5592c3824d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.996+0000 7f64a7fff700 1 --2- 172.21.15.17:0/1123165927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c367b6b0 0x5592c3824d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.996+0000 7f64a7fff700 1 -- 172.21.15.17:0/1123165927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c38252d0 msgr2=0x5592c381f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.996+0000 7f64a7fff700 1 --2- 172.21.15.17:0/1123165927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c38252d0 0x5592c381f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.996+0000 7f64a7fff700 1 -- 172.21.15.17:0/1123165927 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592c359ed80 con 0x5592c381f580 2023-07-14T13:00:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.997+0000 7f64a7fff700 1 --2- 172.21.15.17:0/1123165927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c381f9d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f64a000ef00 tx=0x7f64a0099230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d55849efd96752c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.997+0000 7f64a6ffd700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64900a1350 0x7f64900a3800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x5592c381bb40 tx=0x7f649c007850 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.997+0000 7f648dffb700 1 -- 172.21.15.17:0/1123165927 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a00133e0 con 0x5592c381f580 2023-07-14T13:00:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.997+0000 7f648dffb700 1 -- 172.21.15.17:0/1123165927 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64a00996f0 con 0x5592c381f580 2023-07-14T13:00:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.997+0000 7f648dffb700 1 -- 172.21.15.17:0/1123165927 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a0099950 con 0x5592c381f580 2023-07-14T13:00:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.998+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/1123165927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 msgr2=0x5592c381f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.998+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/1123165927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c381f9d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f64a000ef00 tx=0x7f64a0099230 comp rx=0 tx=0).stop 2023-07-14T13:00:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.998+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/1123165927 shutdown_connections 2023-07-14T13:00:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.998+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/1123165927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c381f9d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.998+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/1123165927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c367b6b0 0x5592c3824d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.998+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/1123165927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c38252d0 0x5592c381f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.998+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/1123165927 >> 172.21.15.17:0/1123165927 conn(0x5592c3814be0 msgr2=0x5592c3819f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.998+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/1123165927 shutdown_connections 2023-07-14T13:00:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.998+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/1123165927 wait complete. 2023-07-14T13:00:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.999+0000 7f64c1b8ab80 1 -- start start 2023-07-14T13:00:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.999+0000 7f64c1b8ab80 1 Processor -- start 2023-07-14T13:00:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.999+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c382b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.999+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c3828850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.999+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c38252d0 0x5592c3828f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.999+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c3710a60 con 0x5592c367b6b0 2023-07-14T13:00:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.999+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c3710760 con 0x5592c381f580 2023-07-14T13:00:00.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T12:59:59.999+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c35f48c0 con 0x5592c38252d0 2023-07-14T13:00:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64c1b8ab80 10 client.0 _ll_register_callbacks cb 0x5592c370e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c382b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a6ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c3828850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c382b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38446/0 (socket says 172.21.15.17:38446) 2023-07-14T13:00:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a77fe700 1 -- 172.21.15.17:0/22879116 learned_addr learned my addr 172.21.15.17:0/22879116 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a7fff700 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c38252d0 0x5592c3828f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a77fe700 1 -- 172.21.15.17:0/22879116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c38252d0 msgr2=0x5592c3828f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a77fe700 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c38252d0 0x5592c3828f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a77fe700 1 -- 172.21.15.17:0/22879116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 msgr2=0x5592c3828850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a77fe700 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c3828850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a77fe700 1 -- 172.21.15.17:0/22879116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a8072920 con 0x5592c367b6b0 2023-07-14T13:00:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a6ffd700 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c3828850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.000+0000 7f64a7fff700 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c38252d0 0x5592c3828f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.001+0000 7f64a77fe700 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c382b640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6498009990 tx=0x7f6498005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a062b56a5f606058 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.001+0000 7f6486ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.001+0000 7f6486ffd700 1 -- 172.21.15.17:0/22879116 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649801d070 con 0x5592c367b6b0 2023-07-14T13:00:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.001+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/22879116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5592c36ca490 con 0x5592c367b6b0 2023-07-14T13:00:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.001+0000 7f6486ffd700 1 -- 172.21.15.17:0/22879116 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6498004500 con 0x5592c367b6b0 2023-07-14T13:00:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.002+0000 7f6486ffd700 1 -- 172.21.15.17:0/22879116 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64980046c0 con 0x5592c367b6b0 2023-07-14T13:00:00.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.002+0000 7f64c1b8ab80 10 client.15663 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.002+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/22879116 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5592c3587c00 con 0x5592c367b6b0 2023-07-14T13:00:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.002+0000 7f6486ffd700 1 -- 172.21.15.17:0/22879116 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5592c36ca490 con 0x5592c367b6b0 2023-07-14T13:00:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.002+0000 7f6486ffd700 1 -- 172.21.15.17:0/22879116 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f649800f8a0 con 0x5592c367b6b0 2023-07-14T13:00:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.002+0000 7f64c1b8ab80 10 client.15663 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.002+0000 7f64c1b8ab80 10 client.15663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.002+0000 7f64c1b8ab80 20 client.15663 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:00.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.002+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592c3838b80 0x5592c383af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.002+0000 7f64c1b8ab80 4 client.15663 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.002+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/22879116 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592c3769e50 con 0x5592c3838b80 2023-07-14T13:00:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.003+0000 7f64a6ffd700 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592c3838b80 0x5592c383af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.003+0000 7f6486ffd700 10 client.15663 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.003+0000 7f64a6ffd700 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592c3838b80 0x5592c383af90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2397738949e72868 server_cookie=788f1ed296266441 in_seq=0 out_seq=0 2023-07-14T13:00:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f6486ffd700 1 -- 172.21.15.17:0/22879116 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5592c3769e50 con 0x5592c3838b80 2023-07-14T13:00:00.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f6486ffd700 10 client.15663 handle_command_reply: tid=0 2023-07-14T13:00:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f64c1b8ab80 1 client.15663 shutdown 2023-07-14T13:00:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/22879116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 msgr2=0x5592c382b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c382b640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6498009990 tx=0x7f6498005a90 comp rx=0 tx=0).stop 2023-07-14T13:00:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/22879116 shutdown_connections 2023-07-14T13:00:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592c3838b80 0x5592c383af90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c38252d0 0x5592c3828f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c382b640 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/22879116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c3828850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f6486ffd700 0 client.15663 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.004+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/22879116 >> 172.21.15.17:0/22879116 conn(0x5592c3814be0 msgr2=0x5592c38194e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.005+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/22879116 shutdown_connections 2023-07-14T13:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.005+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/22879116 wait complete. 2023-07-14T13:00:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.005+0000 7f64c1b8ab80 20 client.15663 trim_cache size 0 max 16384 2023-07-14T13:00:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.025+0000 7f64c1b8ab80 1 Processor -- start 2023-07-14T13:00:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.025+0000 7f64c1b8ab80 1 -- start start 2023-07-14T13:00:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c381f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c382fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c38252d0 0x5592c3824120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c3829590 con 0x5592c367b6b0 2023-07-14T13:00:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c381ab70 con 0x5592c381f580 2023-07-14T13:00:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c38249c0 con 0x5592c38252d0 2023-07-14T13:00:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64a77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c381f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64a77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c381f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38458/0 (socket says 172.21.15.17:38458) 2023-07-14T13:00:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64a77fe700 1 -- 172.21.15.17:0/4281756741 learned_addr learned my addr 172.21.15.17:0/4281756741 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64a6ffd700 1 --2- 172.21.15.17:0/4281756741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c382fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64a7fff700 1 --2- 172.21.15.17:0/4281756741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c38252d0 0x5592c3824120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.026+0000 7f64a77fe700 1 -- 172.21.15.17:0/4281756741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c38252d0 msgr2=0x5592c3824120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.027+0000 7f64a77fe700 1 --2- 172.21.15.17:0/4281756741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c38252d0 0x5592c3824120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.027+0000 7f64a77fe700 1 -- 172.21.15.17:0/4281756741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 msgr2=0x5592c382fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.027+0000 7f64a77fe700 1 --2- 172.21.15.17:0/4281756741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c382fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.027+0000 7f64a77fe700 1 -- 172.21.15.17:0/4281756741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592c35c51f0 con 0x5592c367b6b0 2023-07-14T13:00:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.027+0000 7f64a6ffd700 1 --2- 172.21.15.17:0/4281756741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c382fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.027+0000 7f64a77fe700 1 --2- 172.21.15.17:0/4281756741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c381f040 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6498006010 tx=0x7f6498005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae7929806f7fb70 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.027+0000 7f648e7fc700 1 -- 172.21.15.17:0/4281756741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649801d040 con 0x5592c367b6b0 2023-07-14T13:00:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.027+0000 7f648e7fc700 1 -- 172.21.15.17:0/4281756741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f649801e040 con 0x5592c367b6b0 2023-07-14T13:00:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.027+0000 7f648e7fc700 1 -- 172.21.15.17:0/4281756741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6498024810 con 0x5592c367b6b0 2023-07-14T13:00:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.028+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/4281756741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 msgr2=0x5592c381f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.028+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/4281756741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c381f040 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6498006010 tx=0x7f6498005f00 comp rx=0 tx=0).stop 2023-07-14T13:00:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.028+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/4281756741 shutdown_connections 2023-07-14T13:00:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.028+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/4281756741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c38252d0 0x5592c3824120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.028+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/4281756741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c381f040 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.028+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/4281756741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c381f580 0x5592c382fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.028+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/4281756741 >> 172.21.15.17:0/4281756741 conn(0x5592c3814be0 msgr2=0x5592c3823a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.028+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/4281756741 shutdown_connections 2023-07-14T13:00:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.029+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/4281756741 wait complete. 2023-07-14T13:00:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.029+0000 7f64c1b8ab80 1 -- start start 2023-07-14T13:00:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.029+0000 7f64c1b8ab80 1 Processor -- start 2023-07-14T13:00:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c38280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c381f580 0x5592c38285e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64c1b8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c38252d0 0x5592c3826e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c3827340 con 0x5592c367b6b0 2023-07-14T13:00:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c38274b0 con 0x5592c38252d0 2023-07-14T13:00:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64c1b8ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c3827670 con 0x5592c381f580 2023-07-14T13:00:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64c1b8ab80 10 client.0 _ll_register_callbacks cb 0x7f6498005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64a77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c38280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64a77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c38280a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38472/0 (socket says 172.21.15.17:38472) 2023-07-14T13:00:00.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64a77fe700 1 -- 172.21.15.17:0/3815641584 learned_addr learned my addr 172.21.15.17:0/3815641584 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64a7fff700 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c38252d0 0x5592c3826e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64a6ffd700 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c381f580 0x5592c38285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64a7fff700 1 -- 172.21.15.17:0/3815641584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c381f580 msgr2=0x5592c38285e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.030+0000 7f64a7fff700 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c381f580 0x5592c38285e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f64a7fff700 1 -- 172.21.15.17:0/3815641584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 msgr2=0x5592c38280a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f64a7fff700 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c38280a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f64a7fff700 1 -- 172.21.15.17:0/3815641584 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649c012ae0 con 0x5592c38252d0 2023-07-14T13:00:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f64a77fe700 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c38280a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f64a7fff700 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c38252d0 0x5592c3826e00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f64a009d8e0 tx=0x7f64a00060e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce4511f4782ab23f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f6486ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:00:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f6486ffd700 1 -- 172.21.15.17:0/3815641584 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a00133e0 con 0x5592c38252d0 2023-07-14T13:00:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f6486ffd700 1 -- 172.21.15.17:0/3815641584 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f64a009d720 con 0x5592c38252d0 2023-07-14T13:00:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/3815641584 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64a00996f0 con 0x5592c38252d0 2023-07-14T13:00:00.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f6486ffd700 1 -- 172.21.15.17:0/3815641584 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64a00a1ab0 con 0x5592c38252d0 2023-07-14T13:00:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f64c1b8ab80 10 client.25454 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.031+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/3815641584 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5592c3587c00 con 0x5592c38252d0 2023-07-14T13:00:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.032+0000 7f6486ffd700 1 -- 172.21.15.17:0/3815641584 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64a00996f0 con 0x5592c38252d0 2023-07-14T13:00:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.032+0000 7f6486ffd700 1 -- 172.21.15.17:0/3815641584 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f64a00954e0 con 0x5592c38252d0 2023-07-14T13:00:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.032+0000 7f64c1b8ab80 10 client.25454 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.032+0000 7f64c1b8ab80 10 client.25454 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.032+0000 7f64c1b8ab80 20 client.25454 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.032+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592c388d3c0 0x5592c388f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.032+0000 7f64c1b8ab80 4 client.25454 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:00:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.032+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/3815641584 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5592c372bff0 con 0x5592c388d3c0 2023-07-14T13:00:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.032+0000 7f64a77fe700 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592c388d3c0 0x5592c388f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.033+0000 7f64a77fe700 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592c388d3c0 0x5592c388f7a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10230e2a1a61e858 server_cookie=5f63951508148129 in_seq=0 out_seq=0 2023-07-14T13:00:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.033+0000 7f6486ffd700 10 client.25454 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:00.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.657+0000 7f6486ffd700 1 -- 172.21.15.17:0/3815641584 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5592c372bff0 con 0x5592c388d3c0 2023-07-14T13:00:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.657+0000 7f6486ffd700 10 client.25454 handle_command_reply: tid=0 2023-07-14T13:00:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 1 client.25454 shutdown 2023-07-14T13:00:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/3815641584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c38252d0 msgr2=0x5592c3826e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c38252d0 0x5592c3826e00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f64a009d8e0 tx=0x7f64a00060e0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/3815641584 shutdown_connections 2023-07-14T13:00:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592c388d3c0 0x5592c388f7a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592c38252d0 0x5592c3826e00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592c367b6b0 0x5592c38280a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 1 --2- 172.21.15.17:0/3815641584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c381f580 0x5592c38285e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f6486ffd700 0 client.25454 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:00.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/3815641584 >> 172.21.15.17:0/3815641584 conn(0x5592c3814be0 msgr2=0x5592c3825a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:00.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/3815641584 shutdown_connections 2023-07-14T13:00:00.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 1 -- 172.21.15.17:0/3815641584 wait complete. 2023-07-14T13:00:00.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.658+0000 7f64c1b8ab80 20 client.25454 trim_cache size 0 max 16384 2023-07-14T13:00:00.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:00:00.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:00:00.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:00:00.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:00:00.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 -- 172.21.15.17:0/753563778 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64900a1350 msgr2=0x7f64900a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:00.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64900a1350 0x7f64900a3800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x5592c381bb40 tx=0x7f649c007850 comp rx=0 tx=0).stop 2023-07-14T13:00:00.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 -- 172.21.15.17:0/753563778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a8105b10 msgr2=0x7f64a8195a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:00.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a8105b10 0x7f64a8195a30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f64a000ef30 tx=0x7f64a000c3a0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 -- 172.21.15.17:0/753563778 shutdown_connections 2023-07-14T13:00:00.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64900a1350 0x7f64900a3800 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64a8105b10 0x7f64a8195a30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64a80ffb00 0x7f64a819bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 --2- 172.21.15.17:0/753563778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81004b0 0x7f64a819c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:00.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 -- 172.21.15.17:0/753563778 >> 172.21.15.17:0/753563778 conn(0x7f64a80fb600 msgr2=0x7f64a80fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:00.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 -- 172.21.15.17:0/753563778 shutdown_connections 2023-07-14T13:00:00.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:00.659+0000 7f64ae1ff700 1 -- 172.21.15.17:0/753563778 wait complete. 2023-07-14T13:00:00.971 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 13:00:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T13:00:00.597+0000 7f63a3252700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:00:00.971 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 13:00:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T13:00:00.597+0000 7f63a3252700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:00:00.971 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 13:00:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T13:00:00.597+0000 7f63a3252700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:00:00.971 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 13:00:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T13:00:00.597+0000 7f63a3252700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:00:00.971 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 13:00:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T13:00:00.597+0000 7f63a3252700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T13:00:01.246 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:00 smithi131 ceph-mon[96953]: pgmap v11: 97 pgs: 97 active+clean; 23 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 63 op/s 2023-07-14T13:00:01.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:00 smithi131 ceph-mon[96953]: overall HEALTH_OK 2023-07-14T13:00:01.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:00 smithi017 ceph-mon[95536]: pgmap v11: 97 pgs: 97 active+clean; 23 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 63 op/s 2023-07-14T13:00:01.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:00 smithi017 ceph-mon[95536]: overall HEALTH_OK 2023-07-14T13:00:01.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:00 smithi135 ceph-mon[97338]: pgmap v11: 97 pgs: 97 active+clean; 23 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 63 op/s 2023-07-14T13:00:01.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:00 smithi135 ceph-mon[97338]: overall HEALTH_OK 2023-07-14T13:00:03.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:02 smithi131 ceph-mon[96953]: pgmap v12: 97 pgs: 97 active+clean; 35 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 3.6 MiB/s wr, 117 op/s 2023-07-14T13:00:03.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:02 smithi131 ceph-mon[96953]: mgrmap e24: x(active, since 18s), standbys: z, y 2023-07-14T13:00:03.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:02 smithi017 ceph-mon[95536]: pgmap v12: 97 pgs: 97 active+clean; 35 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 3.6 MiB/s wr, 117 op/s 2023-07-14T13:00:03.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:02 smithi017 ceph-mon[95536]: mgrmap e24: x(active, since 18s), standbys: z, y 2023-07-14T13:00:03.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:02 smithi135 ceph-mon[97338]: pgmap v12: 97 pgs: 97 active+clean; 35 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 3.6 MiB/s wr, 117 op/s 2023-07-14T13:00:03.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:02 smithi135 ceph-mon[97338]: mgrmap e24: x(active, since 18s), standbys: z, y 2023-07-14T13:00:05.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:04 smithi131 ceph-mon[96953]: pgmap v13: 97 pgs: 97 active+clean; 35 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 3.6 MiB/s wr, 88 op/s 2023-07-14T13:00:05.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:04 smithi017 ceph-mon[95536]: pgmap v13: 97 pgs: 97 active+clean; 35 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 3.6 MiB/s wr, 88 op/s 2023-07-14T13:00:05.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:04 smithi135 ceph-mon[97338]: pgmap v13: 97 pgs: 97 active+clean; 35 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 3.6 MiB/s wr, 88 op/s 2023-07-14T13:00:07.038 INFO:teuthology.orchestra.run.smithi017.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-07-14T13:00:07.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-07-14T13:00:07.078 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:00:07.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:06 smithi131 ceph-mon[96953]: pgmap v14: 97 pgs: 97 active+clean; 47 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 5.1 MiB/s wr, 285 op/s 2023-07-14T13:00:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.309+0000 7f30853ff700 1 -- 172.21.15.17:0/4027301468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080072830 msgr2=0x7f3080072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.309+0000 7f30853ff700 1 --2- 172.21.15.17:0/4027301468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080072830 0x7f3080072c00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3070009990 tx=0x7f3070009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.310+0000 7f30853ff700 1 -- 172.21.15.17:0/4027301468 shutdown_connections 2023-07-14T13:00:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.310+0000 7f30853ff700 1 --2- 172.21.15.17:0/4027301468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f308010c390 0x7f308010e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.310+0000 7f30853ff700 1 --2- 172.21.15.17:0/4027301468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080072830 0x7f3080072c00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.310+0000 7f30853ff700 1 --2- 172.21.15.17:0/4027301468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3080073140 0x7f308010be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.310+0000 7f30853ff700 1 -- 172.21.15.17:0/4027301468 >> 172.21.15.17:0/4027301468 conn(0x7f30800fb610 msgr2=0x7f30800fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.310+0000 7f30853ff700 1 -- 172.21.15.17:0/4027301468 shutdown_connections 2023-07-14T13:00:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.310+0000 7f30853ff700 1 -- 172.21.15.17:0/4027301468 wait complete. 2023-07-14T13:00:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.311+0000 7f30853ff700 1 Processor -- start 2023-07-14T13:00:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.311+0000 7f30853ff700 1 -- start start 2023-07-14T13:00:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.311+0000 7f30853ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080072830 0x7f3080197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.311+0000 7f30853ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3080073140 0x7f30801982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.311+0000 7f30853ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f308010c390 0x7f308019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.311+0000 7f30853ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308019cd40 con 0x7f3080072830 2023-07-14T13:00:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.311+0000 7f30853ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308019ceb0 con 0x7f3080073140 2023-07-14T13:00:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.311+0000 7f30853ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308019d070 con 0x7f308010c390 2023-07-14T13:00:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.312+0000 7f307effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080072830 0x7f3080197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.312+0000 7f307effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080072830 0x7f3080197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36660/0 (socket says 172.21.15.17:36660) 2023-07-14T13:00:07.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.312+0000 7f307effd700 1 -- 172.21.15.17:0/507723849 learned_addr learned my addr 172.21.15.17:0/507723849 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.312+0000 7f307f7fe700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f308010c390 0x7f308019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.312+0000 7f307e7fc700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3080073140 0x7f30801982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.312+0000 7f307effd700 1 -- 172.21.15.17:0/507723849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f308010c390 msgr2=0x7f308019c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.312+0000 7f307effd700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f308010c390 0x7f308019c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.312+0000 7f307effd700 1 -- 172.21.15.17:0/507723849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3080073140 msgr2=0x7f30801982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.312+0000 7f307effd700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3080073140 0x7f30801982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.312+0000 7f307effd700 1 -- 172.21.15.17:0/507723849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700095f0 con 0x7f3080072830 2023-07-14T13:00:07.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.312+0000 7f307effd700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080072830 0x7f3080197d60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3070000c00 tx=0x7f3070004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:07.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.313+0000 7f3067fff700 1 -- 172.21.15.17:0/507723849 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307001d070 con 0x7f3080072830 2023-07-14T13:00:07.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.313+0000 7f3067fff700 1 -- 172.21.15.17:0/507723849 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3070022470 con 0x7f3080072830 2023-07-14T13:00:07.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.313+0000 7f3067fff700 1 -- 172.21.15.17:0/507723849 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3070017650 con 0x7f3080072830 2023-07-14T13:00:07.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.313+0000 7f30853ff700 1 -- 172.21.15.17:0/507723849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308019d2f0 con 0x7f3080072830 2023-07-14T13:00:07.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.313+0000 7f30853ff700 1 -- 172.21.15.17:0/507723849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30801a4b90 con 0x7f3080072830 2023-07-14T13:00:07.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.317+0000 7f3067fff700 1 -- 172.21.15.17:0/507723849 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f30700225e0 con 0x7f3080072830 2023-07-14T13:00:07.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.319+0000 7f3067fff700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f30680a1460 0x7f30680a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.319+0000 7f3098d32b80 1 Processor -- start 2023-07-14T13:00:07.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.319+0000 7f3098d32b80 1 -- start start 2023-07-14T13:00:07.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.319+0000 7f3067fff700 1 -- 172.21.15.17:0/507723849 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f30700ce360 con 0x7f3080072830 2023-07-14T13:00:07.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.319+0000 7f307e7fc700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f30680a1460 0x7f30680a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a02892d0 0x55e0a02896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a0294590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0294ad0 0x55e0a0296eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f3098d32b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a018fcb0 con 0x55e0a0289be0 2023-07-14T13:00:07.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f3098d32b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a01e2a40 con 0x55e0a0294ad0 2023-07-14T13:00:07.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f3098d32b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a01dbed0 con 0x55e0a02892d0 2023-07-14T13:00:07.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f307e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a0294590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f307e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a0294590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36674/0 (socket says 172.21.15.17:36674) 2023-07-14T13:00:07.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f307effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a02892d0 0x55e0a02896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f307e7fc700 1 -- 172.21.15.17:0/2990924810 learned_addr learned my addr 172.21.15.17:0/2990924810 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:07.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f307e7fc700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f30680a1460 0x7f30680a3910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3080199370 tx=0x7f3074009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:07.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.320+0000 7f307f7fe700 1 --2- 172.21.15.17:0/2990924810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0294ad0 0x55e0a0296eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.321+0000 7f307effd700 1 -- 172.21.15.17:0/2990924810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0294ad0 msgr2=0x55e0a0296eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:07.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.321+0000 7f307effd700 1 --2- 172.21.15.17:0/2990924810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0294ad0 0x55e0a0296eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.321+0000 7f307effd700 1 -- 172.21.15.17:0/2990924810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 msgr2=0x55e0a0294590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:07.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.321+0000 7f307effd700 1 --2- 172.21.15.17:0/2990924810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a0294590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.321+0000 7f307effd700 1 -- 172.21.15.17:0/2990924810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0a0009de0 con 0x55e0a02892d0 2023-07-14T13:00:07.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.321+0000 7f307f7fe700 1 --2- 172.21.15.17:0/2990924810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0294ad0 0x55e0a0296eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:07.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.321+0000 7f307e7fc700 1 --2- 172.21.15.17:0/2990924810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a0294590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:07.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.321+0000 7f307effd700 1 --2- 172.21.15.17:0/2990924810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a02892d0 0x55e0a02896a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f30700cb980 tx=0x7f307009b110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bea7d755ffb8119d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:07.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.321+0000 7f30657fa700 1 -- 172.21.15.17:0/2990924810 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307009f120 con 0x55e0a02892d0 2023-07-14T13:00:07.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.321+0000 7f30657fa700 1 -- 172.21.15.17:0/2990924810 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30700228c0 con 0x55e0a02892d0 2023-07-14T13:00:07.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.321+0000 7f30657fa700 1 -- 172.21.15.17:0/2990924810 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307009a7b0 con 0x55e0a02892d0 2023-07-14T13:00:07.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.322+0000 7f3098d32b80 1 -- 172.21.15.17:0/2990924810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a02892d0 msgr2=0x55e0a02896a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.322+0000 7f3098d32b80 1 --2- 172.21.15.17:0/2990924810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a02892d0 0x55e0a02896a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f30700cb980 tx=0x7f307009b110 comp rx=0 tx=0).stop 2023-07-14T13:00:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.322+0000 7f3098d32b80 1 -- 172.21.15.17:0/2990924810 shutdown_connections 2023-07-14T13:00:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.322+0000 7f3098d32b80 1 --2- 172.21.15.17:0/2990924810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0294ad0 0x55e0a0296eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.322+0000 7f3098d32b80 1 --2- 172.21.15.17:0/2990924810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a02892d0 0x55e0a02896a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.322+0000 7f3098d32b80 1 --2- 172.21.15.17:0/2990924810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a0294590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.322+0000 7f3098d32b80 1 -- 172.21.15.17:0/2990924810 >> 172.21.15.17:0/2990924810 conn(0x55e0a027fda0 msgr2=0x55e0a02856a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:07.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.322+0000 7f3098d32b80 1 -- 172.21.15.17:0/2990924810 shutdown_connections 2023-07-14T13:00:07.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.322+0000 7f3098d32b80 1 -- 172.21.15.17:0/2990924810 wait complete. 2023-07-14T13:00:07.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.323+0000 7f3098d32b80 1 -- start start 2023-07-14T13:00:07.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.323+0000 7f3098d32b80 1 Processor -- start 2023-07-14T13:00:07.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a02892d0 0x55e0a0294ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a02953e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0294ad0 0x55e0a0295920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f3098d32b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a017bac0 con 0x55e0a0289be0 2023-07-14T13:00:07.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f3098d32b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a017b7c0 con 0x55e0a02892d0 2023-07-14T13:00:07.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f3098d32b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a005f920 con 0x55e0a0294ad0 2023-07-14T13:00:07.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f3098d32b80 10 client.0 _ll_register_callbacks cb 0x55e0a0179760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:07.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f307e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a02953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f307e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a02953e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36682/0 (socket says 172.21.15.17:36682) 2023-07-14T13:00:07.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f307e7fc700 1 -- 172.21.15.17:0/402731806 learned_addr learned my addr 172.21.15.17:0/402731806 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:07.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f307effd700 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a02892d0 0x55e0a0294ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.324+0000 7f307f7fe700 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0294ad0 0x55e0a0295920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f307effd700 1 -- 172.21.15.17:0/402731806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0294ad0 msgr2=0x55e0a0295920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:07.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f307effd700 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0294ad0 0x55e0a0295920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f307effd700 1 -- 172.21.15.17:0/402731806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 msgr2=0x55e0a02953e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:07.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f307effd700 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a02953e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f307effd700 1 -- 172.21.15.17:0/402731806 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3074011a70 con 0x55e0a02892d0 2023-07-14T13:00:07.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f307e7fc700 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a02953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:07.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f307effd700 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a02892d0 0x55e0a0294ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3070099610 tx=0x7f30700a3420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e5dcf2668204e15 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:07.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f3062ff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:00:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f3062ff5700 1 -- 172.21.15.17:0/402731806 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307009f120 con 0x55e0a02892d0 2023-07-14T13:00:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f3062ff5700 1 -- 172.21.15.17:0/402731806 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f307009f2f0 con 0x55e0a02892d0 2023-07-14T13:00:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f3098d32b80 1 -- 172.21.15.17:0/402731806 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0a01354f0 con 0x55e0a02892d0 2023-07-14T13:00:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f3062ff5700 1 -- 172.21.15.17:0/402731806 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30700a3490 con 0x55e0a02892d0 2023-07-14T13:00:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f3098d32b80 10 client.25472 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.325+0000 7f3098d32b80 1 -- 172.21.15.17:0/402731806 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f30801a4b90 con 0x55e0a02892d0 2023-07-14T13:00:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.326+0000 7f3062ff5700 1 -- 172.21.15.17:0/402731806 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e0a01354f0 con 0x55e0a02892d0 2023-07-14T13:00:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.326+0000 7f3062ff5700 1 -- 172.21.15.17:0/402731806 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f30700970b0 con 0x55e0a02892d0 2023-07-14T13:00:07.362 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:06 smithi017 ceph-mon[95536]: pgmap v14: 97 pgs: 97 active+clean; 47 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 5.1 MiB/s wr, 285 op/s 2023-07-14T13:00:07.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.326+0000 7f3098d32b80 10 client.25472 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:07.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.326+0000 7f3098d32b80 10 client.25472 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:07.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.326+0000 7f3098d32b80 20 client.25472 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.326+0000 7f3098d32b80 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0a02a3c10 0x55e0a02a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.326+0000 7f3098d32b80 4 client.25472 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.326+0000 7f3098d32b80 1 -- 172.21.15.17:0/402731806 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0a01d4eb0 con 0x55e0a02a3c10 2023-07-14T13:00:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.326+0000 7f307e7fc700 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0a02a3c10 0x55e0a02a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.327+0000 7f307e7fc700 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0a02a3c10 0x55e0a02a5ff0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc96edc5df506f95 server_cookie=2f753beb358d46e8 in_seq=0 out_seq=0 2023-07-14T13:00:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.327+0000 7f3062ff5700 10 client.25472 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3062ff5700 1 -- 172.21.15.17:0/402731806 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e0a01d4eb0 con 0x55e0a02a3c10 2023-07-14T13:00:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3062ff5700 10 client.25472 handle_command_reply: tid=0 2023-07-14T13:00:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3098d32b80 1 client.25472 shutdown 2023-07-14T13:00:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3098d32b80 1 -- 172.21.15.17:0/402731806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a02892d0 msgr2=0x55e0a0294ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3098d32b80 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a02892d0 0x55e0a0294ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3070099610 tx=0x7f30700a3420 comp rx=0 tx=0).stop 2023-07-14T13:00:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3098d32b80 1 -- 172.21.15.17:0/402731806 shutdown_connections 2023-07-14T13:00:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3098d32b80 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0a02a3c10 0x55e0a02a5ff0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3098d32b80 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0294ad0 0x55e0a0295920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3098d32b80 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a02892d0 0x55e0a0294ea0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3062ff5700 0 client.25472 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3098d32b80 1 --2- 172.21.15.17:0/402731806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a0289be0 0x55e0a02953e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3098d32b80 1 -- 172.21.15.17:0/402731806 >> 172.21.15.17:0/402731806 conn(0x55e0a027fda0 msgr2=0x55e0a0285290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3098d32b80 1 -- 172.21.15.17:0/402731806 shutdown_connections 2023-07-14T13:00:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.328+0000 7f3098d32b80 1 -- 172.21.15.17:0/402731806 wait complete. 2023-07-14T13:00:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.329+0000 7f3098d32b80 20 client.25472 trim_cache size 0 max 16384 2023-07-14T13:00:07.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.350+0000 7f3098d32b80 1 Processor -- start 2023-07-14T13:00:07.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.350+0000 7f3098d32b80 1 -- start start 2023-07-14T13:00:07.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.350+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a028e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.350+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0289be0 0x55e0a0298ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.350+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0294ad0 0x55e0a028ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.350+0000 7f3098d32b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a01354f0 con 0x55e0a02892d0 2023-07-14T13:00:07.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.350+0000 7f3098d32b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a029fd90 con 0x55e0a0289be0 2023-07-14T13:00:07.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.350+0000 7f3098d32b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a027f970 con 0x55e0a0294ad0 2023-07-14T13:00:07.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.351+0000 7f307effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a028e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.351+0000 7f307e7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0289be0 0x55e0a0298ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.351+0000 7f307effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a028e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36696/0 (socket says 172.21.15.17:36696) 2023-07-14T13:00:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.351+0000 7f307effd700 1 -- 172.21.15.17:0/3118883075 learned_addr learned my addr 172.21.15.17:0/3118883075 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.351+0000 7f307f7fe700 1 --2- 172.21.15.17:0/3118883075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0294ad0 0x55e0a028ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.351+0000 7f307e7fc700 1 -- 172.21.15.17:0/3118883075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0294ad0 msgr2=0x55e0a028ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.351+0000 7f307e7fc700 1 --2- 172.21.15.17:0/3118883075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0294ad0 0x55e0a028ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.351+0000 7f307e7fc700 1 -- 172.21.15.17:0/3118883075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 msgr2=0x55e0a028e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.351+0000 7f307e7fc700 1 --2- 172.21.15.17:0/3118883075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a028e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.351+0000 7f307e7fc700 1 -- 172.21.15.17:0/3118883075 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e09fff2c60 con 0x55e0a0289be0 2023-07-14T13:00:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.351+0000 7f307effd700 1 --2- 172.21.15.17:0/3118883075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a028e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.352+0000 7f307e7fc700 1 --2- 172.21.15.17:0/3118883075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0289be0 0x55e0a0298ed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55e0a02a68d0 tx=0x7f3074014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ff69d5bcfd1efcf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.352+0000 7f3065ffb700 1 -- 172.21.15.17:0/3118883075 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074025040 con 0x55e0a0289be0 2023-07-14T13:00:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.352+0000 7f3065ffb700 1 -- 172.21.15.17:0/3118883075 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3074016070 con 0x55e0a0289be0 2023-07-14T13:00:07.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.352+0000 7f3065ffb700 1 -- 172.21.15.17:0/3118883075 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307401fba0 con 0x55e0a0289be0 2023-07-14T13:00:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.353+0000 7f3098d32b80 1 -- 172.21.15.17:0/3118883075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0289be0 msgr2=0x55e0a0298ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.353+0000 7f3098d32b80 1 --2- 172.21.15.17:0/3118883075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0289be0 0x55e0a0298ed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55e0a02a68d0 tx=0x7f3074014000 comp rx=0 tx=0).stop 2023-07-14T13:00:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.353+0000 7f3098d32b80 1 -- 172.21.15.17:0/3118883075 shutdown_connections 2023-07-14T13:00:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.353+0000 7f3098d32b80 1 --2- 172.21.15.17:0/3118883075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0294ad0 0x55e0a028ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.353+0000 7f3098d32b80 1 --2- 172.21.15.17:0/3118883075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a028e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.353+0000 7f3098d32b80 1 --2- 172.21.15.17:0/3118883075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0289be0 0x55e0a0298ed0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.353+0000 7f3098d32b80 1 -- 172.21.15.17:0/3118883075 >> 172.21.15.17:0/3118883075 conn(0x55e0a027fda0 msgr2=0x55e0a029f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:07.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.353+0000 7f3098d32b80 1 -- 172.21.15.17:0/3118883075 shutdown_connections 2023-07-14T13:00:07.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.353+0000 7f3098d32b80 1 -- 172.21.15.17:0/3118883075 wait complete. 2023-07-14T13:00:07.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.354+0000 7f3098d32b80 1 -- start start 2023-07-14T13:00:07.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.354+0000 7f3098d32b80 1 Processor -- start 2023-07-14T13:00:07.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.354+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a0298ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.354+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0289be0 0x55e0a0297210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.354+0000 7f3098d32b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0294ad0 0x55e0a0297750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.354+0000 7f3098d32b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a0297e30 con 0x55e0a02892d0 2023-07-14T13:00:07.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f3098d32b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a0297fa0 con 0x55e0a0294ad0 2023-07-14T13:00:07.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f3098d32b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a02f7ab0 con 0x55e0a0289be0 2023-07-14T13:00:07.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f3098d32b80 10 client.0 _ll_register_callbacks cb 0x55e0a0179760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:07.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f307effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a0298ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f307effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a0298ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36712/0 (socket says 172.21.15.17:36712) 2023-07-14T13:00:07.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f307effd700 1 -- 172.21.15.17:0/1041043651 learned_addr learned my addr 172.21.15.17:0/1041043651 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:07.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f307f7fe700 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0294ad0 0x55e0a0297750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f307e7fc700 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0289be0 0x55e0a0297210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f307effd700 1 -- 172.21.15.17:0/1041043651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0289be0 msgr2=0x55e0a0297210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:07.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f307effd700 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0289be0 0x55e0a0297210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f307effd700 1 -- 172.21.15.17:0/1041043651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0294ad0 msgr2=0x55e0a0297750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:07.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f307effd700 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0294ad0 0x55e0a0297750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.355+0000 7f307effd700 1 -- 172.21.15.17:0/1041043651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30801a4b90 con 0x55e0a02892d0 2023-07-14T13:00:07.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.356+0000 7f3062ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:07.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.356+0000 7f307effd700 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a0298ee0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3070006010 tx=0x7f30700cbe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07974bbe9db58ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:07.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.356+0000 7f3062ff5700 1 -- 172.21.15.17:0/1041043651 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3070084cd0 con 0x55e0a02892d0 2023-07-14T13:00:07.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.356+0000 7f3062ff5700 1 -- 172.21.15.17:0/1041043651 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f307009f2f0 con 0x55e0a02892d0 2023-07-14T13:00:07.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.356+0000 7f3098d32b80 1 -- 172.21.15.17:0/1041043651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30700228c0 con 0x55e0a02892d0 2023-07-14T13:00:07.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.356+0000 7f3062ff5700 1 -- 172.21.15.17:0/1041043651 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f307009f120 con 0x55e0a02892d0 2023-07-14T13:00:07.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.356+0000 7f3098d32b80 10 client.15693 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:07.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.356+0000 7f3098d32b80 1 -- 172.21.15.17:0/1041043651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f307402a950 con 0x55e0a02892d0 2023-07-14T13:00:07.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.356+0000 7f3062ff5700 1 -- 172.21.15.17:0/1041043651 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30700228c0 con 0x55e0a02892d0 2023-07-14T13:00:07.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.356+0000 7f3062ff5700 1 -- 172.21.15.17:0/1041043651 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f307009a220 con 0x55e0a02892d0 2023-07-14T13:00:07.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.357+0000 7f3098d32b80 10 client.15693 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:07.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.357+0000 7f3098d32b80 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:07.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.357+0000 7f3098d32b80 20 client.15693 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:07.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.357+0000 7f3098d32b80 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0a02f8bd0 0x55e0a02fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.357+0000 7f3098d32b80 4 client.15693 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:00:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.357+0000 7f3098d32b80 1 -- 172.21.15.17:0/1041043651 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e0a0197050 con 0x55e0a02f8bd0 2023-07-14T13:00:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.357+0000 7f307e7fc700 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0a02f8bd0 0x55e0a02fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f307e7fc700 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0a02f8bd0 0x55e0a02fafe0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fb59d643a0b65bc server_cookie=b83261a9868cc1a0 in_seq=0 out_seq=0 2023-07-14T13:00:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3062ff5700 10 client.15693 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3062ff5700 1 -- 172.21.15.17:0/1041043651 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e0a0197050 con 0x55e0a02f8bd0 2023-07-14T13:00:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3062ff5700 10 client.15693 handle_command_reply: tid=0 2023-07-14T13:00:07.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3098d32b80 1 client.15693 shutdown 2023-07-14T13:00:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3098d32b80 1 -- 172.21.15.17:0/1041043651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 msgr2=0x55e0a0298ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3098d32b80 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a0298ee0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3070006010 tx=0x7f30700cbe90 comp rx=0 tx=0).stop 2023-07-14T13:00:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3098d32b80 1 -- 172.21.15.17:0/1041043651 shutdown_connections 2023-07-14T13:00:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3098d32b80 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0a02f8bd0 0x55e0a02fafe0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3098d32b80 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0a0294ad0 0x55e0a0297750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3098d32b80 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0a02892d0 0x55e0a0298ee0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3062ff5700 0 client.15693 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3098d32b80 1 --2- 172.21.15.17:0/1041043651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0a0289be0 0x55e0a0297210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3098d32b80 1 -- 172.21.15.17:0/1041043651 >> 172.21.15.17:0/1041043651 conn(0x55e0a027fda0 msgr2=0x55e0a02933c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.358+0000 7f3098d32b80 1 -- 172.21.15.17:0/1041043651 shutdown_connections 2023-07-14T13:00:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.359+0000 7f3098d32b80 1 -- 172.21.15.17:0/1041043651 wait complete. 2023-07-14T13:00:07.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.359+0000 7f3098d32b80 20 client.15693 trim_cache size 0 max 16384 2023-07-14T13:00:07.397 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:00:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:00:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:00:07.397 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:00:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.359+0000 7f30853ff700 1 -- 172.21.15.17:0/507723849 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f30680a1460 msgr2=0x7f30680a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.359+0000 7f30853ff700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f30680a1460 0x7f30680a3910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3080199370 tx=0x7f3074009260 comp rx=0 tx=0).stop 2023-07-14T13:00:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.359+0000 7f30853ff700 1 -- 172.21.15.17:0/507723849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080072830 msgr2=0x7f3080197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.359+0000 7f30853ff700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080072830 0x7f3080197d60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3070000c00 tx=0x7f3070004730 comp rx=0 tx=0).stop 2023-07-14T13:00:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.360+0000 7f30853ff700 1 -- 172.21.15.17:0/507723849 shutdown_connections 2023-07-14T13:00:07.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.360+0000 7f30853ff700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f30680a1460 0x7f30680a3910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.360+0000 7f30853ff700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f308010c390 0x7f308019c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.360+0000 7f30853ff700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3080072830 0x7f3080197d60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.360+0000 7f30853ff700 1 --2- 172.21.15.17:0/507723849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3080073140 0x7f30801982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.360+0000 7f30853ff700 1 -- 172.21.15.17:0/507723849 >> 172.21.15.17:0/507723849 conn(0x7f30800fb610 msgr2=0x7f30800fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.360+0000 7f30853ff700 1 -- 172.21.15.17:0/507723849 shutdown_connections 2023-07-14T13:00:07.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.360+0000 7f30853ff700 1 -- 172.21.15.17:0/507723849 wait complete. 2023-07-14T13:00:07.408 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:00:07.409 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:00:07.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:06 smithi135 ceph-mon[97338]: pgmap v14: 97 pgs: 97 active+clean; 47 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 5.1 MiB/s wr, 285 op/s 2023-07-14T13:00:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.602+0000 7fa6343ff700 1 -- 172.21.15.17:0/1689166353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c0ffad0 msgr2=0x7fa62c0fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.602+0000 7fa6343ff700 1 --2- 172.21.15.17:0/1689166353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c0ffad0 0x7fa62c0fff40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009990 tx=0x7fa61c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.602+0000 7fa6343ff700 1 -- 172.21.15.17:0/1689166353 shutdown_connections 2023-07-14T13:00:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.602+0000 7fa6343ff700 1 --2- 172.21.15.17:0/1689166353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa62c100480 0x7fa62c10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.602+0000 7fa6343ff700 1 --2- 172.21.15.17:0/1689166353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa62c105ae0 0x7fa62c105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.602+0000 7fa6343ff700 1 --2- 172.21.15.17:0/1689166353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c0ffad0 0x7fa62c0fff40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.602+0000 7fa6343ff700 1 -- 172.21.15.17:0/1689166353 >> 172.21.15.17:0/1689166353 conn(0x7fa62c0fb590 msgr2=0x7fa62c0fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.602+0000 7fa6343ff700 1 -- 172.21.15.17:0/1689166353 shutdown_connections 2023-07-14T13:00:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.602+0000 7fa6343ff700 1 -- 172.21.15.17:0/1689166353 wait complete. 2023-07-14T13:00:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.603+0000 7fa6343ff700 1 Processor -- start 2023-07-14T13:00:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.603+0000 7fa6343ff700 1 -- start start 2023-07-14T13:00:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.604+0000 7fa6343ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa62c0ffad0 0x7fa62c19dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.604+0000 7fa6343ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa62c100480 0x7fa62c19e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.604+0000 7fa6343ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c105ae0 0x7fa62c197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.604+0000 7fa6343ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c1981a0 con 0x7fa62c105ae0 2023-07-14T13:00:07.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.604+0000 7fa6343ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c198310 con 0x7fa62c0ffad0 2023-07-14T13:00:07.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.604+0000 7fa6343ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c1984d0 con 0x7fa62c100480 2023-07-14T13:00:07.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.604+0000 7fa63299c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c105ae0 0x7fa62c197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.604+0000 7fa63299c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c105ae0 0x7fa62c197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36736/0 (socket says 172.21.15.17:36736) 2023-07-14T13:00:07.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.604+0000 7fa63299c700 1 -- 172.21.15.17:0/2288131798 learned_addr learned my addr 172.21.15.17:0/2288131798 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:07.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.604+0000 7fa63199a700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa62c100480 0x7fa62c19e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.604+0000 7fa63219b700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa62c0ffad0 0x7fa62c19dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.605+0000 7fa63299c700 1 -- 172.21.15.17:0/2288131798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa62c100480 msgr2=0x7fa62c19e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.605+0000 7fa63299c700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa62c100480 0x7fa62c19e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.605+0000 7fa63299c700 1 -- 172.21.15.17:0/2288131798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa62c0ffad0 msgr2=0x7fa62c19dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.605+0000 7fa63299c700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa62c0ffad0 0x7fa62c19dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.605+0000 7fa63299c700 1 -- 172.21.15.17:0/2288131798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0095f0 con 0x7fa62c105ae0 2023-07-14T13:00:07.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.605+0000 7fa63299c700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c105ae0 0x7fa62c197b30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa62400ef30 tx=0x7fa62400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:07.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.605+0000 7fa6237fe700 1 -- 172.21.15.17:0/2288131798 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624018070 con 0x7fa62c105ae0 2023-07-14T13:00:07.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.605+0000 7fa6237fe700 1 -- 172.21.15.17:0/2288131798 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa62400f040 con 0x7fa62c105ae0 2023-07-14T13:00:07.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.605+0000 7fa6343ff700 1 -- 172.21.15.17:0/2288131798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c198750 con 0x7fa62c105ae0 2023-07-14T13:00:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.605+0000 7fa6237fe700 1 -- 172.21.15.17:0/2288131798 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62400cbc0 con 0x7fa62c105ae0 2023-07-14T13:00:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.605+0000 7fa6343ff700 1 -- 172.21.15.17:0/2288131798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c1a4ab0 con 0x7fa62c105ae0 2023-07-14T13:00:07.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.607+0000 7fa6343ff700 1 -- 172.21.15.17:0/2288131798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c067300 con 0x7fa62c105ae0 2023-07-14T13:00:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.610+0000 7fa6237fe700 1 -- 172.21.15.17:0/2288131798 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fa624007500 con 0x7fa62c105ae0 2023-07-14T13:00:07.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.611+0000 7fa6237fe700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6180a14b0 0x7fa6180a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.611+0000 7fa6237fe700 1 -- 172.21.15.17:0/2288131798 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa6240cca20 con 0x7fa62c105ae0 2023-07-14T13:00:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.612+0000 7fa63219b700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6180a14b0 0x7fa6180a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:07.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.612+0000 7fa63219b700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6180a14b0 0x7fa6180a3960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa628009be0 tx=0x7fa628009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:07.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.617+0000 7fa6237fe700 1 -- 172.21.15.17:0/2288131798 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa624095c80 con 0x7fa62c105ae0 2023-07-14T13:00:07.823 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/: 2023-07-14T13:00:07.824 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-07-14T13:00:07.824 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 12:59 . 2023-07-14T13:00:07.824 INFO:teuthology.orchestra.run.smithi017.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 12:59 .. 2023-07-14T13:00:07.824 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 data 2023-07-14T13:00:07.824 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:07.824 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data: 2023-07-14T13:00:07.825 INFO:teuthology.orchestra.run.smithi017.stdout:total 40 2023-07-14T13:00:07.825 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 . 2023-07-14T13:00:07.825 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 12:59 .. 2023-07-14T13:00:07.825 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22095369 Jul 14 12:59 base 2023-07-14T13:00:07.825 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Jul 14 12:59 global 2023-07-14T13:00:07.825 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 log 2023-07-14T13:00:07.825 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_commit_ts 2023-07-14T13:00:07.826 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_dynshmem 2023-07-14T13:00:07.826 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Jul 14 12:59 pg_hba.conf 2023-07-14T13:00:07.826 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Jul 14 12:59 pg_ident.conf 2023-07-14T13:00:07.826 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 14 13:00 pg_logical 2023-07-14T13:00:07.826 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 pg_multixact 2023-07-14T13:00:07.826 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 pg_notify 2023-07-14T13:00:07.826 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_replslot 2023-07-14T13:00:07.826 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_serial 2023-07-14T13:00:07.827 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_snapshots 2023-07-14T13:00:07.827 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_stat 2023-07-14T13:00:07.827 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_stat_tmp 2023-07-14T13:00:07.827 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 pg_subtrans 2023-07-14T13:00:07.827 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_tblspc 2023-07-14T13:00:07.827 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_twophase 2023-07-14T13:00:07.827 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 14 12:59 PG_VERSION 2023-07-14T13:00:07.828 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 12:59 pg_wal 2023-07-14T13:00:07.828 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 pg_xact 2023-07-14T13:00:07.828 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Jul 14 12:59 postgresql.auto.conf 2023-07-14T13:00:07.828 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Jul 14 12:59 postgresql.conf 2023-07-14T13:00:07.828 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:07.828 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base: 2023-07-14T13:00:07.828 INFO:teuthology.orchestra.run.smithi017.stdout:total 3 2023-07-14T13:00:07.828 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22095369 Jul 14 12:59 . 2023-07-14T13:00:07.829 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:07.829 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Jul 14 12:59 1 2023-07-14T13:00:07.829 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Jul 14 12:59 12346 2023-07-14T13:00:07.829 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Jul 14 13:00 12347 2023-07-14T13:00:07.829 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:07.829 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/1: 2023-07-14T13:00:07.829 INFO:teuthology.orchestra.run.smithi017.stdout:total 7194 2023-07-14T13:00:07.830 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Jul 14 12:59 . 2023-07-14T13:00:07.830 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22095369 Jul 14 12:59 .. 2023-07-14T13:00:07.830 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 112 2023-07-14T13:00:07.830 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 113 2023-07-14T13:00:07.830 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 14 12:59 12182 2023-07-14T13:00:07.830 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12182_fsm 2023-07-14T13:00:07.830 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12182_vm 2023-07-14T13:00:07.830 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12184 2023-07-14T13:00:07.831 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12186 2023-07-14T13:00:07.831 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12187 2023-07-14T13:00:07.831 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12187_fsm 2023-07-14T13:00:07.831 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12187_vm 2023-07-14T13:00:07.831 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12189 2023-07-14T13:00:07.831 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12191 2023-07-14T13:00:07.831 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192 2023-07-14T13:00:07.831 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12192_fsm 2023-07-14T13:00:07.832 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192_vm 2023-07-14T13:00:07.832 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12194 2023-07-14T13:00:07.832 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12196 2023-07-14T13:00:07.832 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12197 2023-07-14T13:00:07.832 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12197_fsm 2023-07-14T13:00:07.832 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12197_vm 2023-07-14T13:00:07.832 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12199 2023-07-14T13:00:07.833 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12201 2023-07-14T13:00:07.833 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12202 2023-07-14T13:00:07.833 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12202_fsm 2023-07-14T13:00:07.833 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12202_vm 2023-07-14T13:00:07.833 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12204 2023-07-14T13:00:07.833 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12206 2023-07-14T13:00:07.833 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12207 2023-07-14T13:00:07.833 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12207_fsm 2023-07-14T13:00:07.834 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12207_vm 2023-07-14T13:00:07.834 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12209 2023-07-14T13:00:07.834 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12211 2023-07-14T13:00:07.834 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12212 2023-07-14T13:00:07.834 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12214 2023-07-14T13:00:07.834 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12216 2023-07-14T13:00:07.834 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 14 12:59 1247 2023-07-14T13:00:07.834 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1247_fsm 2023-07-14T13:00:07.835 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1247_vm 2023-07-14T13:00:07.835 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 14 12:59 1249 2023-07-14T13:00:07.835 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1249_fsm 2023-07-14T13:00:07.835 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1249_vm 2023-07-14T13:00:07.835 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 14 12:59 1255 2023-07-14T13:00:07.835 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1255_fsm 2023-07-14T13:00:07.835 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1255_vm 2023-07-14T13:00:07.835 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 14 12:59 1259 2023-07-14T13:00:07.836 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1259_fsm 2023-07-14T13:00:07.836 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1259_vm 2023-07-14T13:00:07.836 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1417 2023-07-14T13:00:07.836 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1417_vm 2023-07-14T13:00:07.836 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1418 2023-07-14T13:00:07.836 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1418_vm 2023-07-14T13:00:07.836 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 174 2023-07-14T13:00:07.837 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 175 2023-07-14T13:00:07.837 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2187 2023-07-14T13:00:07.837 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2224 2023-07-14T13:00:07.837 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2224_vm 2023-07-14T13:00:07.837 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2328 2023-07-14T13:00:07.837 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2328_vm 2023-07-14T13:00:07.837 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2336 2023-07-14T13:00:07.837 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2336_vm 2023-07-14T13:00:07.838 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2337 2023-07-14T13:00:07.838 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2600 2023-07-14T13:00:07.838 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2600_fsm 2023-07-14T13:00:07.838 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2600_vm 2023-07-14T13:00:07.838 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2601 2023-07-14T13:00:07.838 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2601_fsm 2023-07-14T13:00:07.838 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2601_vm 2023-07-14T13:00:07.839 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2602 2023-07-14T13:00:07.839 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2602_fsm 2023-07-14T13:00:07.839 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2602_vm 2023-07-14T13:00:07.839 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2603 2023-07-14T13:00:07.839 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2603_fsm 2023-07-14T13:00:07.839 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2603_vm 2023-07-14T13:00:07.839 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2604 2023-07-14T13:00:07.839 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2604_vm 2023-07-14T13:00:07.840 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2605 2023-07-14T13:00:07.840 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2605_fsm 2023-07-14T13:00:07.840 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2605_vm 2023-07-14T13:00:07.840 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2606 2023-07-14T13:00:07.840 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2606_fsm 2023-07-14T13:00:07.840 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2606_vm 2023-07-14T13:00:07.840 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2607 2023-07-14T13:00:07.840 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2607_fsm 2023-07-14T13:00:07.841 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2607_vm 2023-07-14T13:00:07.841 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jul 14 12:59 2608 2023-07-14T13:00:07.841 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2608_fsm 2023-07-14T13:00:07.841 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2608_vm 2023-07-14T13:00:07.841 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 14 12:59 2609 2023-07-14T13:00:07.841 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2609_fsm 2023-07-14T13:00:07.841 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2609_vm 2023-07-14T13:00:07.842 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2610 2023-07-14T13:00:07.842 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2610_fsm 2023-07-14T13:00:07.842 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2610_vm 2023-07-14T13:00:07.842 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2611 2023-07-14T13:00:07.842 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2611_vm 2023-07-14T13:00:07.842 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2612 2023-07-14T13:00:07.842 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2612_fsm 2023-07-14T13:00:07.842 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2612_vm 2023-07-14T13:00:07.843 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2613 2023-07-14T13:00:07.843 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2613_vm 2023-07-14T13:00:07.843 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2615 2023-07-14T13:00:07.843 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2615_fsm 2023-07-14T13:00:07.843 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2615_vm 2023-07-14T13:00:07.843 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2616 2023-07-14T13:00:07.843 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2616_fsm 2023-07-14T13:00:07.843 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2616_vm 2023-07-14T13:00:07.844 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 14 12:59 2617 2023-07-14T13:00:07.844 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2617_fsm 2023-07-14T13:00:07.844 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2617_vm 2023-07-14T13:00:07.844 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 14 12:59 2618 2023-07-14T13:00:07.844 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2618_fsm 2023-07-14T13:00:07.844 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2618_vm 2023-07-14T13:00:07.844 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jul 14 12:59 2619 2023-07-14T13:00:07.844 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2619_fsm 2023-07-14T13:00:07.845 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2619_vm 2023-07-14T13:00:07.845 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2620 2023-07-14T13:00:07.845 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2620_vm 2023-07-14T13:00:07.845 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2650 2023-07-14T13:00:07.845 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2651 2023-07-14T13:00:07.845 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2652 2023-07-14T13:00:07.845 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2653 2023-07-14T13:00:07.845 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2654 2023-07-14T13:00:07.846 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2655 2023-07-14T13:00:07.846 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2656 2023-07-14T13:00:07.846 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2657 2023-07-14T13:00:07.846 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 14 12:59 2658 2023-07-14T13:00:07.846 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 12:59 2659 2023-07-14T13:00:07.846 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2660 2023-07-14T13:00:07.846 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2661 2023-07-14T13:00:07.847 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2662 2023-07-14T13:00:07.847 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2663 2023-07-14T13:00:07.847 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2664 2023-07-14T13:00:07.847 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2665 2023-07-14T13:00:07.847 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2666 2023-07-14T13:00:07.847 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2667 2023-07-14T13:00:07.847 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2668 2023-07-14T13:00:07.847 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2669 2023-07-14T13:00:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2670 2023-07-14T13:00:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jul 14 12:59 2673 2023-07-14T13:00:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 14 12:59 2674 2023-07-14T13:00:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 14 12:59 2675 2023-07-14T13:00:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2678 2023-07-14T13:00:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2679 2023-07-14T13:00:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2680 2023-07-14T13:00:07.848 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2681 2023-07-14T13:00:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2682 2023-07-14T13:00:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2683 2023-07-14T13:00:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2684 2023-07-14T13:00:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2685 2023-07-14T13:00:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2686 2023-07-14T13:00:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2687 2023-07-14T13:00:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2688 2023-07-14T13:00:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2689 2023-07-14T13:00:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 12:59 2690 2023-07-14T13:00:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 14 12:59 2691 2023-07-14T13:00:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2692 2023-07-14T13:00:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2693 2023-07-14T13:00:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2696 2023-07-14T13:00:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2699 2023-07-14T13:00:07.850 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2701 2023-07-14T13:00:07.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2702 2023-07-14T13:00:07.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2703 2023-07-14T13:00:07.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2704 2023-07-14T13:00:07.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2753 2023-07-14T13:00:07.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2753_fsm 2023-07-14T13:00:07.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2753_vm 2023-07-14T13:00:07.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2754 2023-07-14T13:00:07.851 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2755 2023-07-14T13:00:07.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2756 2023-07-14T13:00:07.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2757 2023-07-14T13:00:07.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2830 2023-07-14T13:00:07.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2830_vm 2023-07-14T13:00:07.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2831 2023-07-14T13:00:07.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2832 2023-07-14T13:00:07.852 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2832_vm 2023-07-14T13:00:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2833 2023-07-14T13:00:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2834 2023-07-14T13:00:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2834_vm 2023-07-14T13:00:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2835 2023-07-14T13:00:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2836 2023-07-14T13:00:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2836_vm 2023-07-14T13:00:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2837 2023-07-14T13:00:07.853 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 14 12:59 2838 2023-07-14T13:00:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2838_fsm 2023-07-14T13:00:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2838_vm 2023-07-14T13:00:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2839 2023-07-14T13:00:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2840 2023-07-14T13:00:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2840_fsm 2023-07-14T13:00:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2840_vm 2023-07-14T13:00:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2841 2023-07-14T13:00:07.854 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2995 2023-07-14T13:00:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2995_vm 2023-07-14T13:00:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2996 2023-07-14T13:00:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3079 2023-07-14T13:00:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3079_fsm 2023-07-14T13:00:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3079_vm 2023-07-14T13:00:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3080 2023-07-14T13:00:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3081 2023-07-14T13:00:07.855 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3085 2023-07-14T13:00:07.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3118 2023-07-14T13:00:07.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3118_vm 2023-07-14T13:00:07.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3119 2023-07-14T13:00:07.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3164 2023-07-14T13:00:07.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3256 2023-07-14T13:00:07.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3256_vm 2023-07-14T13:00:07.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3257 2023-07-14T13:00:07.856 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3258 2023-07-14T13:00:07.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3350 2023-07-14T13:00:07.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3350_vm 2023-07-14T13:00:07.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3351 2023-07-14T13:00:07.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3379 2023-07-14T13:00:07.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3380 2023-07-14T13:00:07.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3381 2023-07-14T13:00:07.857 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3381_vm 2023-07-14T13:00:07.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3394 2023-07-14T13:00:07.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3394_fsm 2023-07-14T13:00:07.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3394_vm 2023-07-14T13:00:07.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3395 2023-07-14T13:00:07.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3439 2023-07-14T13:00:07.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3439_vm 2023-07-14T13:00:07.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3440 2023-07-14T13:00:07.858 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 3455 2023-07-14T13:00:07.859 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3456 2023-07-14T13:00:07.859 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3456_fsm 2023-07-14T13:00:07.859 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3456_vm 2023-07-14T13:00:07.859 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3466 2023-07-14T13:00:07.859 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3466_vm 2023-07-14T13:00:07.859 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3467 2023-07-14T13:00:07.859 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3468 2023-07-14T13:00:07.859 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3501 2023-07-14T13:00:07.860 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3501_vm 2023-07-14T13:00:07.860 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3502 2023-07-14T13:00:07.860 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3503 2023-07-14T13:00:07.860 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3534 2023-07-14T13:00:07.860 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3541 2023-07-14T13:00:07.860 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3541_fsm 2023-07-14T13:00:07.860 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3541_vm 2023-07-14T13:00:07.861 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3542 2023-07-14T13:00:07.861 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3574 2023-07-14T13:00:07.861 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3575 2023-07-14T13:00:07.861 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3576 2023-07-14T13:00:07.861 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3576_vm 2023-07-14T13:00:07.861 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3596 2023-07-14T13:00:07.861 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3596_vm 2023-07-14T13:00:07.861 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3597 2023-07-14T13:00:07.862 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3598 2023-07-14T13:00:07.862 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3598_vm 2023-07-14T13:00:07.862 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3599 2023-07-14T13:00:07.862 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3600 2023-07-14T13:00:07.862 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3600_fsm 2023-07-14T13:00:07.862 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3600_vm 2023-07-14T13:00:07.862 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3601 2023-07-14T13:00:07.862 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3601_fsm 2023-07-14T13:00:07.863 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3601_vm 2023-07-14T13:00:07.863 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3602 2023-07-14T13:00:07.863 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3602_fsm 2023-07-14T13:00:07.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.910+0000 7fa6343ff700 1 -- 172.21.15.17:0/2288131798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa62c198fd0 con 0x7fa62c105ae0 2023-07-14T13:00:07.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.910+0000 7fa6237fe700 1 -- 172.21.15.17:0/2288131798 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+10845 (secure 0 0 0) 0x7fa6240992a0 con 0x7fa62c105ae0 2023-07-14T13:00:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:07.941 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T12:57:45.208579+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:00:07.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 -- 172.21.15.17:0/2288131798 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6180a14b0 msgr2=0x7fa6180a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6180a14b0 0x7fa6180a3960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa628009be0 tx=0x7fa628009260 comp rx=0 tx=0).stop 2023-07-14T13:00:07.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 -- 172.21.15.17:0/2288131798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c105ae0 msgr2=0x7fa62c197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:07.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c105ae0 0x7fa62c197b30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa62400ef30 tx=0x7fa62400c3a0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 -- 172.21.15.17:0/2288131798 shutdown_connections 2023-07-14T13:00:07.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6180a14b0 0x7fa6180a3960 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa62c105ae0 0x7fa62c197b30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa62c0ffad0 0x7fa62c19dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 --2- 172.21.15.17:0/2288131798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa62c100480 0x7fa62c19e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:07.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 -- 172.21.15.17:0/2288131798 >> 172.21.15.17:0/2288131798 conn(0x7fa62c0fb590 msgr2=0x7fa62c072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:07.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 -- 172.21.15.17:0/2288131798 shutdown_connections 2023-07-14T13:00:07.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:07.913+0000 7fa6343ff700 1 -- 172.21.15.17:0/2288131798 wait complete. 2023-07-14T13:00:07.945 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2023-07-14T13:00:07.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:00:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.168+0000 7fe3089ff700 1 -- 172.21.15.17:0/2964046144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe304073140 msgr2=0x7fe30410be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.168+0000 7fe3089ff700 1 --2- 172.21.15.17:0/2964046144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe304073140 0x7fe30410be80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009990 tx=0x7fe2f8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.168+0000 7fe3089ff700 1 -- 172.21.15.17:0/2964046144 shutdown_connections 2023-07-14T13:00:08.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.168+0000 7fe3089ff700 1 --2- 172.21.15.17:0/2964046144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe30410c3c0 0x7fe30410e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.168+0000 7fe3089ff700 1 --2- 172.21.15.17:0/2964046144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe304072830 0x7fe304072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.168+0000 7fe3089ff700 1 --2- 172.21.15.17:0/2964046144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe304073140 0x7fe30410be80 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.168+0000 7fe3089ff700 1 -- 172.21.15.17:0/2964046144 >> 172.21.15.17:0/2964046144 conn(0x7fe3040fb600 msgr2=0x7fe3040fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.168+0000 7fe3089ff700 1 -- 172.21.15.17:0/2964046144 shutdown_connections 2023-07-14T13:00:08.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.168+0000 7fe3089ff700 1 -- 172.21.15.17:0/2964046144 wait complete. 2023-07-14T13:00:08.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.169+0000 7fe3089ff700 1 Processor -- start 2023-07-14T13:00:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.170+0000 7fe3089ff700 1 -- start start 2023-07-14T13:00:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.170+0000 7fe3089ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe304072830 0x7fe304197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.170+0000 7fe3089ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe304073140 0x7fe3041982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.170+0000 7fe3089ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30410c3c0 0x7fe30419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.170+0000 7fe3089ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30419cd40 con 0x7fe30410c3c0 2023-07-14T13:00:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.170+0000 7fe3089ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30419ceb0 con 0x7fe304072830 2023-07-14T13:00:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.170+0000 7fe3089ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30419d070 con 0x7fe304073140 2023-07-14T13:00:08.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe302d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30410c3c0 0x7fe30419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe301d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe304073140 0x7fe3041982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe30259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe304072830 0x7fe304197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe302d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30410c3c0 0x7fe30419c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36744/0 (socket says 172.21.15.17:36744) 2023-07-14T13:00:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe301d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe304073140 0x7fe3041982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:53428/0 (socket says 172.21.15.17:53428) 2023-07-14T13:00:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe302d9d700 1 -- 172.21.15.17:0/2371753789 learned_addr learned my addr 172.21.15.17:0/2371753789 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe301d9b700 1 -- 172.21.15.17:0/2371753789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe304072830 msgr2=0x7fe304197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe301d9b700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe304072830 0x7fe304197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe301d9b700 1 -- 172.21.15.17:0/2371753789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30410c3c0 msgr2=0x7fe30419c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe301d9b700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30410c3c0 0x7fe30419c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe301d9b700 1 -- 172.21.15.17:0/2371753789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f80095f0 con 0x7fe304073140 2023-07-14T13:00:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe302d9d700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30410c3c0 0x7fe30419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:08.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.171+0000 7fe30259c700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe304072830 0x7fe304197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.172+0000 7fe301d9b700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe304073140 0x7fe3041982a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80098e0 tx=0x7fe2f8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.172+0000 7fe2f37fe700 1 -- 172.21.15.17:0/2371753789 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f801d070 con 0x7fe304073140 2023-07-14T13:00:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.172+0000 7fe3089ff700 1 -- 172.21.15.17:0/2371753789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30419d2f0 con 0x7fe304073140 2023-07-14T13:00:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.172+0000 7fe2f37fe700 1 -- 172.21.15.17:0/2371753789 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2f8022470 con 0x7fe304073140 2023-07-14T13:00:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.172+0000 7fe2f37fe700 1 -- 172.21.15.17:0/2371753789 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8017650 con 0x7fe304073140 2023-07-14T13:00:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.172+0000 7fe3089ff700 1 -- 172.21.15.17:0/2371753789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3041a4b90 con 0x7fe304073140 2023-07-14T13:00:08.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.176+0000 7fe2f37fe700 1 -- 172.21.15.17:0/2371753789 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fe2f80225e0 con 0x7fe304073140 2023-07-14T13:00:08.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.177+0000 7fe31c403b80 1 Processor -- start 2023-07-14T13:00:08.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.177+0000 7fe31c403b80 1 -- start start 2023-07-14T13:00:08.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.177+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae7606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.177+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae76b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.177+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae76bad0 0x55f9ae76deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.177+0000 7fe31c403b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae666cb0 con 0x55f9ae7602d0 2023-07-14T13:00:08.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.177+0000 7fe31c403b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae6b9a40 con 0x55f9ae760be0 2023-07-14T13:00:08.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.177+0000 7fe31c403b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae6b2ed0 con 0x55f9ae76bad0 2023-07-14T13:00:08.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe302d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae7606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe302d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae7606a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36760/0 (socket says 172.21.15.17:36760) 2023-07-14T13:00:08.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe302d9d700 1 -- 172.21.15.17:0/4004470630 learned_addr learned my addr 172.21.15.17:0/4004470630 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe301d9b700 1 --2- 172.21.15.17:0/4004470630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae76bad0 0x55f9ae76deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe30259c700 1 --2- 172.21.15.17:0/4004470630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae76b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe302d9d700 1 -- 172.21.15.17:0/4004470630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae76bad0 msgr2=0x55f9ae76deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe302d9d700 1 --2- 172.21.15.17:0/4004470630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae76bad0 0x55f9ae76deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe302d9d700 1 -- 172.21.15.17:0/4004470630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 msgr2=0x55f9ae76b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe302d9d700 1 --2- 172.21.15.17:0/4004470630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae76b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe302d9d700 1 -- 172.21.15.17:0/4004470630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9ae4e0de0 con 0x55f9ae7602d0 2023-07-14T13:00:08.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe30259c700 1 --2- 172.21.15.17:0/4004470630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae76b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:08.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.178+0000 7fe2f37fe700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe2ec0a1460 0x7fe2ec0a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.179+0000 7fe2f37fe700 1 -- 172.21.15.17:0/2371753789 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe2f80ce2f0 con 0x7fe304073140 2023-07-14T13:00:08.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.179+0000 7fe302d9d700 1 --2- 172.21.15.17:0/4004470630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae7606a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0078d0 tx=0x7fe2fc009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefa4212a42a581d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.179+0000 7fe30259c700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe2ec0a1460 0x7fe2ec0a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.179+0000 7fe2f0ff9700 1 -- 172.21.15.17:0/4004470630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc003a00 con 0x55f9ae7602d0 2023-07-14T13:00:08.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.179+0000 7fe2f0ff9700 1 -- 172.21.15.17:0/4004470630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2fc00f040 con 0x55f9ae7602d0 2023-07-14T13:00:08.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.179+0000 7fe2f0ff9700 1 -- 172.21.15.17:0/4004470630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc004280 con 0x55f9ae7602d0 2023-07-14T13:00:08.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.180+0000 7fe31c403b80 1 -- 172.21.15.17:0/4004470630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 msgr2=0x55f9ae7606a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.180+0000 7fe30259c700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe2ec0a1460 0x7fe2ec0a3910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4012680 tx=0x7fe2f4009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.180+0000 7fe31c403b80 1 --2- 172.21.15.17:0/4004470630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae7606a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0078d0 tx=0x7fe2fc009230 comp rx=0 tx=0).stop 2023-07-14T13:00:08.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.180+0000 7fe31c403b80 1 -- 172.21.15.17:0/4004470630 shutdown_connections 2023-07-14T13:00:08.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.180+0000 7fe31c403b80 1 --2- 172.21.15.17:0/4004470630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae76bad0 0x55f9ae76deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.180+0000 7fe31c403b80 1 --2- 172.21.15.17:0/4004470630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae7606a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.180+0000 7fe31c403b80 1 --2- 172.21.15.17:0/4004470630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae76b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.180+0000 7fe31c403b80 1 -- 172.21.15.17:0/4004470630 >> 172.21.15.17:0/4004470630 conn(0x55f9ae756da0 msgr2=0x55f9ae75c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.180+0000 7fe31c403b80 1 -- 172.21.15.17:0/4004470630 shutdown_connections 2023-07-14T13:00:08.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.180+0000 7fe31c403b80 1 -- 172.21.15.17:0/4004470630 wait complete. 2023-07-14T13:00:08.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.181+0000 7fe31c403b80 1 -- start start 2023-07-14T13:00:08.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.181+0000 7fe31c403b80 1 Processor -- start 2023-07-14T13:00:08.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.181+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae76b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.181+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae768800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.181+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae76bad0 0x55f9ae768f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.181+0000 7fe31c403b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae652ac0 con 0x55f9ae7602d0 2023-07-14T13:00:08.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.181+0000 7fe31c403b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae6527c0 con 0x55f9ae760be0 2023-07-14T13:00:08.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.181+0000 7fe31c403b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae536920 con 0x55f9ae76bad0 2023-07-14T13:00:08.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.181+0000 7fe31c403b80 10 client.0 _ll_register_callbacks cb 0x55f9ae650760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:08.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe30259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae76b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe30259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae76b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36770/0 (socket says 172.21.15.17:36770) 2023-07-14T13:00:08.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe30259c700 1 -- 172.21.15.17:0/3295171546 learned_addr learned my addr 172.21.15.17:0/3295171546 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe302d9d700 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae76bad0 0x55f9ae768f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe301d9b700 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae768800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe30259c700 1 -- 172.21.15.17:0/3295171546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae76bad0 msgr2=0x55f9ae768f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe30259c700 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae76bad0 0x55f9ae768f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe30259c700 1 -- 172.21.15.17:0/3295171546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 msgr2=0x55f9ae768800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe30259c700 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae768800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe30259c700 1 -- 172.21.15.17:0/3295171546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2fc007500 con 0x55f9ae7602d0 2023-07-14T13:00:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe301d9b700 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae768800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:00:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe30259c700 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae76b510 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe2f401dac0 tx=0x7fe2f40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9de28c589183925 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.182+0000 7fe2e9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.183+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/3295171546 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4022070 con 0x55f9ae7602d0 2023-07-14T13:00:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.183+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/3295171546 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe2f4004830 con 0x55f9ae7602d0 2023-07-14T13:00:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.183+0000 7fe31c403b80 1 -- 172.21.15.17:0/3295171546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9ae60c4f0 con 0x55f9ae7602d0 2023-07-14T13:00:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.183+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/3295171546 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2f4017070 con 0x55f9ae7602d0 2023-07-14T13:00:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.183+0000 7fe31c403b80 10 client.15711 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.183+0000 7fe31c403b80 1 -- 172.21.15.17:0/3295171546 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55f9ae4c9c60 con 0x55f9ae7602d0 2023-07-14T13:00:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.183+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/3295171546 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f9ae60c4f0 con 0x55f9ae7602d0 2023-07-14T13:00:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.183+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/3295171546 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe2f400fac0 con 0x55f9ae7602d0 2023-07-14T13:00:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.184+0000 7fe31c403b80 10 client.15711 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.184+0000 7fe31c403b80 10 client.15711 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:00:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.184+0000 7fe31c403b80 20 client.15711 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.184+0000 7fe31c403b80 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55f9ae77b4d0 0x55f9ae77d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.184+0000 7fe31c403b80 4 client.15711 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.184+0000 7fe31c403b80 1 -- 172.21.15.17:0/3295171546 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9ae6abeb0 con 0x55f9ae77b4d0 2023-07-14T13:00:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.184+0000 7fe301d9b700 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55f9ae77b4d0 0x55f9ae77d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.185+0000 7fe301d9b700 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55f9ae77b4d0 0x55f9ae77d8e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c1f513d27a25ff7 server_cookie=1f5f7c16ee1a057b in_seq=0 out_seq=0 2023-07-14T13:00:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.185+0000 7fe2e9ffb700 10 client.15711 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:00:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.185+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/3295171546 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f9ae6abeb0 con 0x55f9ae77b4d0 2023-07-14T13:00:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.185+0000 7fe2e9ffb700 10 client.15711 handle_command_reply: tid=0 2023-07-14T13:00:08.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 1 client.15711 shutdown 2023-07-14T13:00:08.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 1 -- 172.21.15.17:0/3295171546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 msgr2=0x55f9ae76b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae76b510 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe2f401dac0 tx=0x7fe2f40047c0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 1 -- 172.21.15.17:0/3295171546 shutdown_connections 2023-07-14T13:00:08.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55f9ae77b4d0 0x55f9ae77d8e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae76bad0 0x55f9ae768f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae7602d0 0x55f9ae76b510 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 1 --2- 172.21.15.17:0/3295171546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae768800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe2e9ffb700 0 client.15711 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:00:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 1 -- 172.21.15.17:0/3295171546 >> 172.21.15.17:0/3295171546 conn(0x55f9ae756da0 msgr2=0x55f9ae75c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 1 -- 172.21.15.17:0/3295171546 shutdown_connections 2023-07-14T13:00:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 1 -- 172.21.15.17:0/3295171546 wait complete. 2023-07-14T13:00:08.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.186+0000 7fe31c403b80 20 client.15711 trim_cache size 0 max 16384 2023-07-14T13:00:08.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.200+0000 7fe31c403b80 1 Processor -- start 2023-07-14T13:00:08.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.200+0000 7fe31c403b80 1 -- start start 2023-07-14T13:00:08.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.201+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae7602d0 0x55f9ae76b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.201+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae760be0 0x55f9ae767fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.201+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 0x55f9ae768500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.201+0000 7fe31c403b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae756970 con 0x55f9ae76bad0 2023-07-14T13:00:08.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.201+0000 7fe31c403b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae75d4d0 con 0x55f9ae7602d0 2023-07-14T13:00:08.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.201+0000 7fe31c403b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae7621a0 con 0x55f9ae760be0 2023-07-14T13:00:08.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.201+0000 7fe302d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 0x55f9ae768500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.201+0000 7fe302d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 0x55f9ae768500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36774/0 (socket says 172.21.15.17:36774) 2023-07-14T13:00:08.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.201+0000 7fe302d9d700 1 -- 172.21.15.17:0/2559854442 learned_addr learned my addr 172.21.15.17:0/2559854442 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.201+0000 7fe30259c700 1 --2- 172.21.15.17:0/2559854442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae7602d0 0x55f9ae76b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.201+0000 7fe301d9b700 1 --2- 172.21.15.17:0/2559854442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae760be0 0x55f9ae767fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.202+0000 7fe302d9d700 1 -- 172.21.15.17:0/2559854442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae760be0 msgr2=0x55f9ae767fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.202+0000 7fe302d9d700 1 --2- 172.21.15.17:0/2559854442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae760be0 0x55f9ae767fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.202+0000 7fe302d9d700 1 -- 172.21.15.17:0/2559854442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae7602d0 msgr2=0x55f9ae76b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.202+0000 7fe302d9d700 1 --2- 172.21.15.17:0/2559854442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae7602d0 0x55f9ae76b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.202+0000 7fe302d9d700 1 -- 172.21.15.17:0/2559854442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9ae507250 con 0x55f9ae76bad0 2023-07-14T13:00:08.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.202+0000 7fe301d9b700 1 --2- 172.21.15.17:0/2559854442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae760be0 0x55f9ae767fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:00:08.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.202+0000 7fe302d9d700 1 --2- 172.21.15.17:0/2559854442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 0x55f9ae768500 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc007f70 tx=0x7fe2fc007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30af9d66f04fea03 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.202+0000 7fe2f17fa700 1 -- 172.21.15.17:0/2559854442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc004cc0 con 0x55f9ae76bad0 2023-07-14T13:00:08.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.202+0000 7fe2f17fa700 1 -- 172.21.15.17:0/2559854442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2fc015ae0 con 0x55f9ae76bad0 2023-07-14T13:00:08.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.202+0000 7fe2f17fa700 1 -- 172.21.15.17:0/2559854442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc005980 con 0x55f9ae76bad0 2023-07-14T13:00:08.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.203+0000 7fe31c403b80 1 -- 172.21.15.17:0/2559854442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 msgr2=0x55f9ae768500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.203+0000 7fe31c403b80 1 --2- 172.21.15.17:0/2559854442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 0x55f9ae768500 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc007f70 tx=0x7fe2fc007810 comp rx=0 tx=0).stop 2023-07-14T13:00:08.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.203+0000 7fe31c403b80 1 -- 172.21.15.17:0/2559854442 shutdown_connections 2023-07-14T13:00:08.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.203+0000 7fe31c403b80 1 --2- 172.21.15.17:0/2559854442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 0x55f9ae768500 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.203+0000 7fe31c403b80 1 --2- 172.21.15.17:0/2559854442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae7602d0 0x55f9ae76b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.203+0000 7fe31c403b80 1 --2- 172.21.15.17:0/2559854442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae760be0 0x55f9ae767fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.203+0000 7fe31c403b80 1 -- 172.21.15.17:0/2559854442 >> 172.21.15.17:0/2559854442 conn(0x55f9ae756da0 msgr2=0x55f9ae763b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.203+0000 7fe31c403b80 1 -- 172.21.15.17:0/2559854442 shutdown_connections 2023-07-14T13:00:08.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.203+0000 7fe31c403b80 1 -- 172.21.15.17:0/2559854442 wait complete. 2023-07-14T13:00:08.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.204+0000 7fe31c403b80 1 -- start start 2023-07-14T13:00:08.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.204+0000 7fe31c403b80 1 Processor -- start 2023-07-14T13:00:08.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae7602d0 0x55f9ae772300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae7705f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe31c403b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 0x55f9ae770b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe31c403b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae771070 con 0x55f9ae76bad0 2023-07-14T13:00:08.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe31c403b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae7711e0 con 0x55f9ae760be0 2023-07-14T13:00:08.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe31c403b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9ae7713a0 con 0x55f9ae7602d0 2023-07-14T13:00:08.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe31c403b80 10 client.0 _ll_register_callbacks cb 0x7fe2f401d880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:08.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe302d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 0x55f9ae770b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe30259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae7602d0 0x55f9ae772300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe30259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae7602d0 0x55f9ae772300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:53456/0 (socket says 172.21.15.17:53456) 2023-07-14T13:00:08.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe30259c700 1 -- 172.21.15.17:0/2331559870 learned_addr learned my addr 172.21.15.17:0/2331559870 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe301d9b700 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae7705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe302d9d700 1 -- 172.21.15.17:0/2331559870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae7602d0 msgr2=0x55f9ae772300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe302d9d700 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae7602d0 0x55f9ae772300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe302d9d700 1 -- 172.21.15.17:0/2331559870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 msgr2=0x55f9ae7705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe302d9d700 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae7705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe302d9d700 1 -- 172.21.15.17:0/2331559870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9ae4e0de0 con 0x55f9ae76bad0 2023-07-14T13:00:08.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.205+0000 7fe301d9b700 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae7705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:08.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.206+0000 7fe302d9d700 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 0x55f9ae770b30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009760 tx=0x7fe2fc015880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19dbf0ee05ddcaf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.206+0000 7fe2e9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:08.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.206+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/2331559870 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc004e00 con 0x55f9ae76bad0 2023-07-14T13:00:08.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.206+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/2331559870 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe2fc003c10 con 0x55f9ae76bad0 2023-07-14T13:00:08.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.206+0000 7fe31c403b80 1 -- 172.21.15.17:0/2331559870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe2fc00f040 con 0x55f9ae76bad0 2023-07-14T13:00:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.206+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/2331559870 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2fc003dd0 con 0x55f9ae76bad0 2023-07-14T13:00:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.206+0000 7fe31c403b80 10 client.15717 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.206+0000 7fe31c403b80 1 -- 172.21.15.17:0/2331559870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55f9ae4df2b0 con 0x55f9ae76bad0 2023-07-14T13:00:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.207+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/2331559870 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2fc00f040 con 0x55f9ae76bad0 2023-07-14T13:00:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.207+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/2331559870 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe2fc024020 con 0x55f9ae76bad0 2023-07-14T13:00:08.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.207+0000 7fe31c403b80 10 client.15717 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:08.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.207+0000 7fe31c403b80 10 client.15717 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:00:08.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.207+0000 7fe31c403b80 20 client.15717 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:08.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.207+0000 7fe31c403b80 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55f9ae7d01e0 0x55f9ae7d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.207+0000 7fe31c403b80 4 client.15717 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:00:08.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.207+0000 7fe31c403b80 1 -- 172.21.15.17:0/2331559870 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f9ae66e050 con 0x55f9ae7d01e0 2023-07-14T13:00:08.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.207+0000 7fe30259c700 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55f9ae7d01e0 0x55f9ae7d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.208+0000 7fe30259c700 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55f9ae7d01e0 0x55f9ae7d25c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a70a920631ca0044 server_cookie=9bd11bd98bb4c4be in_seq=0 out_seq=0 2023-07-14T13:00:08.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.208+0000 7fe2e9ffb700 10 client.15717 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:00:08.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.208+0000 7fe2e9ffb700 1 -- 172.21.15.17:0/2331559870 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f9ae66e050 con 0x55f9ae7d01e0 2023-07-14T13:00:08.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.208+0000 7fe2e9ffb700 10 client.15717 handle_command_reply: tid=0 2023-07-14T13:00:08.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.208+0000 7fe31c403b80 1 client.15717 shutdown 2023-07-14T13:00:08.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe31c403b80 1 -- 172.21.15.17:0/2331559870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 msgr2=0x55f9ae770b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe31c403b80 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 0x55f9ae770b30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009760 tx=0x7fe2fc015880 comp rx=0 tx=0).stop 2023-07-14T13:00:08.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe31c403b80 1 -- 172.21.15.17:0/2331559870 shutdown_connections 2023-07-14T13:00:08.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe31c403b80 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f9ae76bad0 0x55f9ae770b30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe31c403b80 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55f9ae7d01e0 0x55f9ae7d25c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe31c403b80 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ae7602d0 0x55f9ae772300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe31c403b80 1 --2- 172.21.15.17:0/2331559870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f9ae760be0 0x55f9ae7705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe2e9ffb700 0 client.15717 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:00:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe31c403b80 1 -- 172.21.15.17:0/2331559870 >> 172.21.15.17:0/2331559870 conn(0x55f9ae756da0 msgr2=0x55f9ae7623e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe31c403b80 1 -- 172.21.15.17:0/2331559870 shutdown_connections 2023-07-14T13:00:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe31c403b80 1 -- 172.21.15.17:0/2331559870 wait complete. 2023-07-14T13:00:08.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.209+0000 7fe31c403b80 20 client.15717 trim_cache size 0 max 16384 2023-07-14T13:00:08.247 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:00:08.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 -- 172.21.15.17:0/2371753789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe2ec0a1460 msgr2=0x7fe2ec0a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe2ec0a1460 0x7fe2ec0a3910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4012680 tx=0x7fe2f4009260 comp rx=0 tx=0).stop 2023-07-14T13:00:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 -- 172.21.15.17:0/2371753789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe304073140 msgr2=0x7fe3041982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe304073140 0x7fe3041982a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80098e0 tx=0x7fe2f8004730 comp rx=0 tx=0).stop 2023-07-14T13:00:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 -- 172.21.15.17:0/2371753789 shutdown_connections 2023-07-14T13:00:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe2ec0a1460 0x7fe2ec0a3910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe30410c3c0 0x7fe30419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe304072830 0x7fe304197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 --2- 172.21.15.17:0/2371753789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe304073140 0x7fe3041982a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 -- 172.21.15.17:0/2371753789 >> 172.21.15.17:0/2371753789 conn(0x7fe3040fb600 msgr2=0x7fe3040fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 -- 172.21.15.17:0/2371753789 shutdown_connections 2023-07-14T13:00:08.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.210+0000 7fe3089ff700 1 -- 172.21.15.17:0/2371753789 wait complete. 2023-07-14T13:00:08.249 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:07 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2288131798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:00:08.259 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:07 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2288131798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:00:08.263 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:00:08.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:07 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2288131798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:00:08.487 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3602_vm 2023-07-14T13:00:08.487 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3603 2023-07-14T13:00:08.488 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3603_fsm 2023-07-14T13:00:08.488 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3603_vm 2023-07-14T13:00:08.488 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3604 2023-07-14T13:00:08.488 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3605 2023-07-14T13:00:08.488 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3606 2023-07-14T13:00:08.488 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3607 2023-07-14T13:00:08.488 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3608 2023-07-14T13:00:08.489 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 3609 2023-07-14T13:00:08.489 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3712 2023-07-14T13:00:08.489 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3764 2023-07-14T13:00:08.489 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3764_fsm 2023-07-14T13:00:08.489 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3764_vm 2023-07-14T13:00:08.489 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3766 2023-07-14T13:00:08.489 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3767 2023-07-14T13:00:08.490 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3997 2023-07-14T13:00:08.490 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 5002 2023-07-14T13:00:08.490 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 548 2023-07-14T13:00:08.490 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 549 2023-07-14T13:00:08.490 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6102 2023-07-14T13:00:08.490 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6102_vm 2023-07-14T13:00:08.490 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6104 2023-07-14T13:00:08.490 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6104_vm 2023-07-14T13:00:08.491 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6106 2023-07-14T13:00:08.491 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6106_vm 2023-07-14T13:00:08.491 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6110 2023-07-14T13:00:08.491 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6111 2023-07-14T13:00:08.491 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6112 2023-07-14T13:00:08.491 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6113 2023-07-14T13:00:08.491 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6117 2023-07-14T13:00:08.492 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 826 2023-07-14T13:00:08.492 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 826_vm 2023-07-14T13:00:08.492 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 827 2023-07-14T13:00:08.492 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 828 2023-07-14T13:00:08.492 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 14 12:59 pg_filenode.map 2023-07-14T13:00:08.492 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 14 12:59 PG_VERSION 2023-07-14T13:00:08.492 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:08.493 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-07-14T13:00:08.493 INFO:teuthology.orchestra.run.smithi017.stdout:total 7194 2023-07-14T13:00:08.493 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Jul 14 12:59 . 2023-07-14T13:00:08.493 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22095369 Jul 14 12:59 .. 2023-07-14T13:00:08.493 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 112 2023-07-14T13:00:08.493 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 113 2023-07-14T13:00:08.493 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 14 12:59 12182 2023-07-14T13:00:08.493 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12182_fsm 2023-07-14T13:00:08.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12182_vm 2023-07-14T13:00:08.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12184 2023-07-14T13:00:08.494 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12186 2023-07-14T13:00:08.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12187 2023-07-14T13:00:08.495 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12187_fsm 2023-07-14T13:00:08.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12187_vm 2023-07-14T13:00:08.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12189 2023-07-14T13:00:08.496 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12191 2023-07-14T13:00:08.497 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192 2023-07-14T13:00:08.497 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12192_fsm 2023-07-14T13:00:08.497 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192_vm 2023-07-14T13:00:08.497 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12194 2023-07-14T13:00:08.498 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12196 2023-07-14T13:00:08.498 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12197 2023-07-14T13:00:08.498 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12197_fsm 2023-07-14T13:00:08.498 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12197_vm 2023-07-14T13:00:08.499 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12199 2023-07-14T13:00:08.499 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12201 2023-07-14T13:00:08.499 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12202 2023-07-14T13:00:08.500 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12202_fsm 2023-07-14T13:00:08.500 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12202_vm 2023-07-14T13:00:08.500 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12204 2023-07-14T13:00:08.500 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12206 2023-07-14T13:00:08.500 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12207 2023-07-14T13:00:08.501 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12207_fsm 2023-07-14T13:00:08.501 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12207_vm 2023-07-14T13:00:08.501 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12209 2023-07-14T13:00:08.501 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12211 2023-07-14T13:00:08.502 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12212 2023-07-14T13:00:08.502 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12214 2023-07-14T13:00:08.502 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12216 2023-07-14T13:00:08.502 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 14 12:59 1247 2023-07-14T13:00:08.503 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1247_fsm 2023-07-14T13:00:08.503 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1247_vm 2023-07-14T13:00:08.503 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 14 12:59 1249 2023-07-14T13:00:08.503 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1249_fsm 2023-07-14T13:00:08.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1249_vm 2023-07-14T13:00:08.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 14 12:59 1255 2023-07-14T13:00:08.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1255_fsm 2023-07-14T13:00:08.504 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1255_vm 2023-07-14T13:00:08.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 14 12:59 1259 2023-07-14T13:00:08.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1259_fsm 2023-07-14T13:00:08.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1259_vm 2023-07-14T13:00:08.505 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1417 2023-07-14T13:00:08.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1417_vm 2023-07-14T13:00:08.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1418 2023-07-14T13:00:08.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1418_vm 2023-07-14T13:00:08.506 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 174 2023-07-14T13:00:08.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 175 2023-07-14T13:00:08.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2187 2023-07-14T13:00:08.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2224 2023-07-14T13:00:08.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2224_vm 2023-07-14T13:00:08.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2328 2023-07-14T13:00:08.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2328_vm 2023-07-14T13:00:08.507 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2336 2023-07-14T13:00:08.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2336_vm 2023-07-14T13:00:08.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2337 2023-07-14T13:00:08.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2600 2023-07-14T13:00:08.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2600_fsm 2023-07-14T13:00:08.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2600_vm 2023-07-14T13:00:08.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2601 2023-07-14T13:00:08.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2601_fsm 2023-07-14T13:00:08.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2601_vm 2023-07-14T13:00:08.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2602 2023-07-14T13:00:08.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2602_fsm 2023-07-14T13:00:08.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2602_vm 2023-07-14T13:00:08.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2603 2023-07-14T13:00:08.509 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2603_fsm 2023-07-14T13:00:08.510 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2603_vm 2023-07-14T13:00:08.510 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2604 2023-07-14T13:00:08.510 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2604_vm 2023-07-14T13:00:08.510 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2605 2023-07-14T13:00:08.510 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2605_fsm 2023-07-14T13:00:08.510 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2605_vm 2023-07-14T13:00:08.510 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2606 2023-07-14T13:00:08.511 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2606_fsm 2023-07-14T13:00:08.511 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2606_vm 2023-07-14T13:00:08.511 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2607 2023-07-14T13:00:08.511 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2607_fsm 2023-07-14T13:00:08.511 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2607_vm 2023-07-14T13:00:08.511 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jul 14 12:59 2608 2023-07-14T13:00:08.511 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2608_fsm 2023-07-14T13:00:08.512 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2608_vm 2023-07-14T13:00:08.512 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 14 12:59 2609 2023-07-14T13:00:08.512 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2609_fsm 2023-07-14T13:00:08.512 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2609_vm 2023-07-14T13:00:08.512 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2610 2023-07-14T13:00:08.512 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2610_fsm 2023-07-14T13:00:08.512 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2610_vm 2023-07-14T13:00:08.513 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2611 2023-07-14T13:00:08.513 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2611_vm 2023-07-14T13:00:08.513 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2612 2023-07-14T13:00:08.513 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2612_fsm 2023-07-14T13:00:08.513 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2612_vm 2023-07-14T13:00:08.513 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2613 2023-07-14T13:00:08.513 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2613_vm 2023-07-14T13:00:08.514 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2615 2023-07-14T13:00:08.514 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2615_fsm 2023-07-14T13:00:08.514 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2615_vm 2023-07-14T13:00:08.514 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2616 2023-07-14T13:00:08.514 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2616_fsm 2023-07-14T13:00:08.514 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2616_vm 2023-07-14T13:00:08.514 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 14 12:59 2617 2023-07-14T13:00:08.515 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2617_fsm 2023-07-14T13:00:08.515 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2617_vm 2023-07-14T13:00:08.515 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 14 12:59 2618 2023-07-14T13:00:08.515 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2618_fsm 2023-07-14T13:00:08.515 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2618_vm 2023-07-14T13:00:08.515 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jul 14 12:59 2619 2023-07-14T13:00:08.516 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2619_fsm 2023-07-14T13:00:08.516 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2619_vm 2023-07-14T13:00:08.516 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2620 2023-07-14T13:00:08.516 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2620_vm 2023-07-14T13:00:08.516 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2650 2023-07-14T13:00:08.516 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2651 2023-07-14T13:00:08.516 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2652 2023-07-14T13:00:08.517 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2653 2023-07-14T13:00:08.517 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2654 2023-07-14T13:00:08.517 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2655 2023-07-14T13:00:08.517 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2656 2023-07-14T13:00:08.517 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2657 2023-07-14T13:00:08.517 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 14 12:59 2658 2023-07-14T13:00:08.517 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 12:59 2659 2023-07-14T13:00:08.518 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2660 2023-07-14T13:00:08.518 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2661 2023-07-14T13:00:08.518 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2662 2023-07-14T13:00:08.518 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2663 2023-07-14T13:00:08.518 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2664 2023-07-14T13:00:08.518 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2665 2023-07-14T13:00:08.519 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2666 2023-07-14T13:00:08.519 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2667 2023-07-14T13:00:08.519 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2668 2023-07-14T13:00:08.519 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2669 2023-07-14T13:00:08.519 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2670 2023-07-14T13:00:08.519 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jul 14 12:59 2673 2023-07-14T13:00:08.519 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 14 12:59 2674 2023-07-14T13:00:08.520 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 14 12:59 2675 2023-07-14T13:00:08.520 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2678 2023-07-14T13:00:08.520 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2679 2023-07-14T13:00:08.520 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2680 2023-07-14T13:00:08.520 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2681 2023-07-14T13:00:08.520 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2682 2023-07-14T13:00:08.520 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2683 2023-07-14T13:00:08.521 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2684 2023-07-14T13:00:08.521 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2685 2023-07-14T13:00:08.521 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2686 2023-07-14T13:00:08.521 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2687 2023-07-14T13:00:08.521 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2688 2023-07-14T13:00:08.521 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2689 2023-07-14T13:00:08.521 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 12:59 2690 2023-07-14T13:00:08.522 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 14 12:59 2691 2023-07-14T13:00:08.522 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2692 2023-07-14T13:00:08.522 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2693 2023-07-14T13:00:08.522 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2696 2023-07-14T13:00:08.522 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2699 2023-07-14T13:00:08.522 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2701 2023-07-14T13:00:08.522 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2702 2023-07-14T13:00:08.523 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2703 2023-07-14T13:00:08.523 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2704 2023-07-14T13:00:08.523 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2753 2023-07-14T13:00:08.523 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2753_fsm 2023-07-14T13:00:08.523 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2753_vm 2023-07-14T13:00:08.523 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2754 2023-07-14T13:00:08.523 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2755 2023-07-14T13:00:08.524 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2756 2023-07-14T13:00:08.524 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2757 2023-07-14T13:00:08.524 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2830 2023-07-14T13:00:08.524 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2830_vm 2023-07-14T13:00:08.524 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2831 2023-07-14T13:00:08.524 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2832 2023-07-14T13:00:08.525 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2832_vm 2023-07-14T13:00:08.525 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2833 2023-07-14T13:00:08.525 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2834 2023-07-14T13:00:08.525 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2834_vm 2023-07-14T13:00:08.525 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2835 2023-07-14T13:00:08.525 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2836 2023-07-14T13:00:08.525 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2836_vm 2023-07-14T13:00:08.525 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2837 2023-07-14T13:00:08.526 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 14 12:59 2838 2023-07-14T13:00:08.526 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2838_fsm 2023-07-14T13:00:08.526 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2838_vm 2023-07-14T13:00:08.526 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2839 2023-07-14T13:00:08.526 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2840 2023-07-14T13:00:08.526 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2840_fsm 2023-07-14T13:00:08.526 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2840_vm 2023-07-14T13:00:08.527 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2841 2023-07-14T13:00:08.527 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2995 2023-07-14T13:00:08.527 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2995_vm 2023-07-14T13:00:08.527 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2996 2023-07-14T13:00:08.527 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3079 2023-07-14T13:00:08.527 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3079_fsm 2023-07-14T13:00:08.527 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3079_vm 2023-07-14T13:00:08.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3080 2023-07-14T13:00:08.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3081 2023-07-14T13:00:08.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3085 2023-07-14T13:00:08.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3118 2023-07-14T13:00:08.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3118_vm 2023-07-14T13:00:08.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3119 2023-07-14T13:00:08.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3164 2023-07-14T13:00:08.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3256 2023-07-14T13:00:08.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3256_vm 2023-07-14T13:00:08.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3257 2023-07-14T13:00:08.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3258 2023-07-14T13:00:08.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3350 2023-07-14T13:00:08.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3350_vm 2023-07-14T13:00:08.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3351 2023-07-14T13:00:08.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3379 2023-07-14T13:00:08.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3380 2023-07-14T13:00:08.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3381 2023-07-14T13:00:08.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3381_vm 2023-07-14T13:00:08.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3394 2023-07-14T13:00:08.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3394_fsm 2023-07-14T13:00:08.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3394_vm 2023-07-14T13:00:08.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3395 2023-07-14T13:00:08.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3439 2023-07-14T13:00:08.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3439_vm 2023-07-14T13:00:08.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3440 2023-07-14T13:00:08.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 3455 2023-07-14T13:00:08.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3456 2023-07-14T13:00:08.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3456_fsm 2023-07-14T13:00:08.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3456_vm 2023-07-14T13:00:08.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3466 2023-07-14T13:00:08.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3466_vm 2023-07-14T13:00:08.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3467 2023-07-14T13:00:08.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3468 2023-07-14T13:00:08.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3501 2023-07-14T13:00:08.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3501_vm 2023-07-14T13:00:08.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3502 2023-07-14T13:00:08.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3503 2023-07-14T13:00:08.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3534 2023-07-14T13:00:08.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3541 2023-07-14T13:00:08.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3541_fsm 2023-07-14T13:00:08.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3541_vm 2023-07-14T13:00:08.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3542 2023-07-14T13:00:08.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3574 2023-07-14T13:00:08.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3575 2023-07-14T13:00:08.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3576 2023-07-14T13:00:08.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3576_vm 2023-07-14T13:00:08.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3596 2023-07-14T13:00:08.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3596_vm 2023-07-14T13:00:08.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3597 2023-07-14T13:00:08.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3598 2023-07-14T13:00:08.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3598_vm 2023-07-14T13:00:08.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3599 2023-07-14T13:00:08.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3600 2023-07-14T13:00:08.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3600_fsm 2023-07-14T13:00:08.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3600_vm 2023-07-14T13:00:08.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3601 2023-07-14T13:00:08.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3601_fsm 2023-07-14T13:00:08.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3601_vm 2023-07-14T13:00:08.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3602 2023-07-14T13:00:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.462+0000 7f1fb83ff700 1 -- 172.21.15.17:0/391816064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fb0100490 msgr2=0x7f1fb010c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.462+0000 7f1fb83ff700 1 --2- 172.21.15.17:0/391816064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fb0100490 0x7f1fb010c920 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800b0a0 tx=0x7f1fa800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.462+0000 7f1fb83ff700 1 -- 172.21.15.17:0/391816064 shutdown_connections 2023-07-14T13:00:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.462+0000 7f1fb83ff700 1 --2- 172.21.15.17:0/391816064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fb0100490 0x7f1fb010c920 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.462+0000 7f1fb83ff700 1 --2- 172.21.15.17:0/391816064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb0105af0 0x7f1fb0105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.462+0000 7f1fb83ff700 1 --2- 172.21.15.17:0/391816064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb00ffae0 0x7f1fb00fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.462+0000 7f1fb83ff700 1 -- 172.21.15.17:0/391816064 >> 172.21.15.17:0/391816064 conn(0x7f1fb00fb5e0 msgr2=0x7f1fb00fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.463+0000 7f1fb83ff700 1 -- 172.21.15.17:0/391816064 shutdown_connections 2023-07-14T13:00:08.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.463+0000 7f1fb83ff700 1 -- 172.21.15.17:0/391816064 wait complete. 2023-07-14T13:00:08.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.464+0000 7f1fb83ff700 1 Processor -- start 2023-07-14T13:00:08.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.464+0000 7f1fb83ff700 1 -- start start 2023-07-14T13:00:08.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.465+0000 7f1fb83ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb00ffae0 0x7f1fb0197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.465+0000 7f1fb83ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb0100490 0x7f1fb0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.465+0000 7f1fb83ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fb0105af0 0x7f1fb019c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.465+0000 7f1fb83ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb019cdd0 con 0x7f1fb0105af0 2023-07-14T13:00:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.465+0000 7f1fb83ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb019cf40 con 0x7f1fb00ffae0 2023-07-14T13:00:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.465+0000 7f1fb83ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb019d100 con 0x7f1fb0100490 2023-07-14T13:00:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.465+0000 7f1fb699c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fb0105af0 0x7f1fb019c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.465+0000 7f1fb699c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fb0105af0 0x7f1fb019c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36808/0 (socket says 172.21.15.17:36808) 2023-07-14T13:00:08.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.465+0000 7f1fb699c700 1 -- 172.21.15.17:0/421088381 learned_addr learned my addr 172.21.15.17:0/421088381 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.465+0000 7f1fb599a700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb0100490 0x7f1fb0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.465+0000 7f1fb619b700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb00ffae0 0x7f1fb0197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.466+0000 7f1fb699c700 1 -- 172.21.15.17:0/421088381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb0100490 msgr2=0x7f1fb0198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.466+0000 7f1fb699c700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb0100490 0x7f1fb0198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.466+0000 7f1fb699c700 1 -- 172.21.15.17:0/421088381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb00ffae0 msgr2=0x7f1fb0197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.466+0000 7f1fb699c700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb00ffae0 0x7f1fb0197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.466+0000 7f1fb699c700 1 -- 172.21.15.17:0/421088381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8009d00 con 0x7f1fb0105af0 2023-07-14T13:00:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.466+0000 7f1fb699c700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fb0105af0 0x7f1fb019c790 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800b070 tx=0x7f1fa800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.466+0000 7f1fa77fe700 1 -- 172.21.15.17:0/421088381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa800e040 con 0x7f1fb0105af0 2023-07-14T13:00:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.466+0000 7f1fa77fe700 1 -- 172.21.15.17:0/421088381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fa8009480 con 0x7f1fb0105af0 2023-07-14T13:00:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.466+0000 7f1fb83ff700 1 -- 172.21.15.17:0/421088381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb019d380 con 0x7f1fb0105af0 2023-07-14T13:00:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.466+0000 7f1fa77fe700 1 -- 172.21.15.17:0/421088381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8005040 con 0x7f1fb0105af0 2023-07-14T13:00:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.467+0000 7f1fb83ff700 1 -- 172.21.15.17:0/421088381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb01a4c20 con 0x7f1fb0105af0 2023-07-14T13:00:08.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.470+0000 7f1fa77fe700 1 -- 172.21.15.17:0/421088381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f1fa801d480 con 0x7f1fb0105af0 2023-07-14T13:00:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.472+0000 7f1fcbc5cb80 1 Processor -- start 2023-07-14T13:00:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.472+0000 7f1fcbc5cb80 1 -- start start 2023-07-14T13:00:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.472+0000 7f1fa77fe700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1f9c0a1460 0x7f1f9c0a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.472+0000 7f1fa77fe700 1 -- 172.21.15.17:0/421088381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1fa80ce0c0 con 0x7f1fb0105af0 2023-07-14T13:00:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.472+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.472+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7a2be0 0x561f6a7ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.472+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7adad0 0x561f6a7afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a6a8cb0 con 0x561f6a7a22d0 2023-07-14T13:00:08.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a6fba40 con 0x561f6a7a2be0 2023-07-14T13:00:08.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a6f4ed0 con 0x561f6a7adad0 2023-07-14T13:00:08.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fb599a700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1f9c0a1460 0x7f1f9c0a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fb619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fb619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7a26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36822/0 (socket says 172.21.15.17:36822) 2023-07-14T13:00:08.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fb599a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7a2be0 0x561f6a7ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fb619b700 1 -- 172.21.15.17:0/4249373122 learned_addr learned my addr 172.21.15.17:0/4249373122 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fb699c700 1 --2- 172.21.15.17:0/4249373122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7adad0 0x561f6a7afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fb619b700 1 -- 172.21.15.17:0/4249373122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7adad0 msgr2=0x561f6a7afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fb619b700 1 --2- 172.21.15.17:0/4249373122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7adad0 0x561f6a7afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fb619b700 1 -- 172.21.15.17:0/4249373122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7a2be0 msgr2=0x561f6a7ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.473+0000 7f1fb619b700 1 --2- 172.21.15.17:0/4249373122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7a2be0 0x561f6a7ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.474+0000 7f1fb619b700 1 -- 172.21.15.17:0/4249373122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f6a522de0 con 0x561f6a7a22d0 2023-07-14T13:00:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.474+0000 7f1fb599a700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1f9c0a1460 0x7f1f9c0a3910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0199400 tx=0x7f1fa0009f90 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.474+0000 7f1fb619b700 1 --2- 172.21.15.17:0/4249373122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7a26a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009d00 tx=0x7f1fac011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38016700e82119e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.474+0000 7f1fa4bfe700 1 -- 172.21.15.17:0/4249373122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac004230 con 0x561f6a7a22d0 2023-07-14T13:00:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.474+0000 7f1fa4bfe700 1 -- 172.21.15.17:0/4249373122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fac004390 con 0x561f6a7a22d0 2023-07-14T13:00:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.474+0000 7f1fa4bfe700 1 -- 172.21.15.17:0/4249373122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac019680 con 0x561f6a7a22d0 2023-07-14T13:00:08.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.475+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/4249373122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 msgr2=0x561f6a7a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.475+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/4249373122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7a26a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009d00 tx=0x7f1fac011720 comp rx=0 tx=0).stop 2023-07-14T13:00:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.475+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/4249373122 shutdown_connections 2023-07-14T13:00:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.475+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/4249373122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7adad0 0x561f6a7afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.475+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/4249373122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7a26a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.475+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/4249373122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7a2be0 0x561f6a7ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.475+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/4249373122 >> 172.21.15.17:0/4249373122 conn(0x561f6a798da0 msgr2=0x561f6a79e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.475+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/4249373122 shutdown_connections 2023-07-14T13:00:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.475+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/4249373122 wait complete. 2023-07-14T13:00:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.476+0000 7f1fcbc5cb80 1 -- start start 2023-07-14T13:00:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.476+0000 7f1fcbc5cb80 1 Processor -- start 2023-07-14T13:00:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.476+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7a22d0 0x561f6a7ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.476+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7aa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.476+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7adad0 0x561f6a7aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.476+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a694ac0 con 0x561f6a7a2be0 2023-07-14T13:00:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.476+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a6947c0 con 0x561f6a7adad0 2023-07-14T13:00:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.476+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a578920 con 0x561f6a7a22d0 2023-07-14T13:00:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fcbc5cb80 10 client.0 _ll_register_callbacks cb 0x561f6a692760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fb599a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fb599a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36824/0 (socket says 172.21.15.17:36824) 2023-07-14T13:00:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fb599a700 1 -- 172.21.15.17:0/1474219575 learned_addr learned my addr 172.21.15.17:0/1474219575 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fb619b700 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7a22d0 0x561f6a7ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fb699c700 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7adad0 0x561f6a7aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fb599a700 1 -- 172.21.15.17:0/1474219575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7a22d0 msgr2=0x561f6a7ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fb599a700 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7a22d0 0x561f6a7ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fb599a700 1 -- 172.21.15.17:0/1474219575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7adad0 msgr2=0x561f6a7aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fb599a700 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7adad0 0x561f6a7aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fb599a700 1 -- 172.21.15.17:0/1474219575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac009960 con 0x561f6a7a2be0 2023-07-14T13:00:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.477+0000 7f1fb699c700 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7adad0 0x561f6a7aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:08.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.478+0000 7f1fb599a700 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7aa780 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00208d0 tx=0x7f1fa00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ad7c58c2c98ba4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.478+0000 7f1f99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:08.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.478+0000 7f1f99ffb700 1 -- 172.21.15.17:0/1474219575 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0018040 con 0x561f6a7a2be0 2023-07-14T13:00:08.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.478+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/1474219575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f6a64e4f0 con 0x561f6a7a2be0 2023-07-14T13:00:08.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.478+0000 7f1f99ffb700 1 -- 172.21.15.17:0/1474219575 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1fa0004a30 con 0x561f6a7a2be0 2023-07-14T13:00:08.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.478+0000 7f1f99ffb700 1 -- 172.21.15.17:0/1474219575 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fa0004bf0 con 0x561f6a7a2be0 2023-07-14T13:00:08.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.478+0000 7f1fcbc5cb80 10 client.15729 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.478+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/1474219575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x561f6a50bc60 con 0x561f6a7a2be0 2023-07-14T13:00:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.479+0000 7f1f99ffb700 1 -- 172.21.15.17:0/1474219575 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561f6a64e4f0 con 0x561f6a7a2be0 2023-07-14T13:00:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.479+0000 7f1f99ffb700 1 -- 172.21.15.17:0/1474219575 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1fa00108a0 con 0x561f6a7a2be0 2023-07-14T13:00:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.479+0000 7f1fcbc5cb80 10 client.15729 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.479+0000 7f1fcbc5cb80 10 client.15729 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:00:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.479+0000 7f1fcbc5cb80 20 client.15729 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.479+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561f6a7bd390 0x561f6a7bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.479+0000 7f1fcbc5cb80 4 client.15729 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.479+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/1474219575 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f6a6edeb0 con 0x561f6a7bd390 2023-07-14T13:00:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.479+0000 7f1fb619b700 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561f6a7bd390 0x561f6a7bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.480+0000 7f1fb619b700 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561f6a7bd390 0x561f6a7bf7a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=249489c81571d4a2 server_cookie=98858b60ecef5508 in_seq=0 out_seq=0 2023-07-14T13:00:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.480+0000 7f1f99ffb700 10 client.15729 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:00:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1f99ffb700 1 -- 172.21.15.17:0/1474219575 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561f6a6edeb0 con 0x561f6a7bd390 2023-07-14T13:00:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1f99ffb700 10 client.15729 handle_command_reply: tid=0 2023-07-14T13:00:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1fcbc5cb80 1 client.15729 shutdown 2023-07-14T13:00:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/1474219575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 msgr2=0x561f6a7aa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7aa780 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00208d0 tx=0x7f1fa00047c0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/1474219575 shutdown_connections 2023-07-14T13:00:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561f6a7bd390 0x561f6a7bf7a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7adad0 0x561f6a7aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7a22d0 0x561f6a7ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1f99ffb700 0 client.15729 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:00:08.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/1474219575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7aa780 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/1474219575 >> 172.21.15.17:0/1474219575 conn(0x561f6a798da0 msgr2=0x561f6a79e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/1474219575 shutdown_connections 2023-07-14T13:00:08.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.481+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/1474219575 wait complete. 2023-07-14T13:00:08.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.482+0000 7f1fcbc5cb80 20 client.15729 trim_cache size 0 max 16384 2023-07-14T13:00:08.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.500+0000 7f1fcbc5cb80 1 Processor -- start 2023-07-14T13:00:08.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.500+0000 7f1fcbc5cb80 1 -- start start 2023-07-14T13:00:08.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.500+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7aae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.500+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7a2be0 0x561f6a7c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.500+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7adad0 0x561f6a7b9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.500+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a79fd50 con 0x561f6a7a22d0 2023-07-14T13:00:08.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.500+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a7ab4f0 con 0x561f6a7a2be0 2023-07-14T13:00:08.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.500+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a79f360 con 0x561f6a7adad0 2023-07-14T13:00:08.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.501+0000 7f1fb619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.501+0000 7f1fb619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7aae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36838/0 (socket says 172.21.15.17:36838) 2023-07-14T13:00:08.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.501+0000 7f1fb619b700 1 -- 172.21.15.17:0/3575265417 learned_addr learned my addr 172.21.15.17:0/3575265417 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.501+0000 7f1fb699c700 1 --2- 172.21.15.17:0/3575265417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7adad0 0x561f6a7b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.501+0000 7f1fb599a700 1 --2- 172.21.15.17:0/3575265417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7a2be0 0x561f6a7c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.501+0000 7f1fb619b700 1 -- 172.21.15.17:0/3575265417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7adad0 msgr2=0x561f6a7b9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.501+0000 7f1fb619b700 1 --2- 172.21.15.17:0/3575265417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7adad0 0x561f6a7b9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.501+0000 7f1fb619b700 1 -- 172.21.15.17:0/3575265417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7a2be0 msgr2=0x561f6a7c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.501+0000 7f1fb619b700 1 --2- 172.21.15.17:0/3575265417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7a2be0 0x561f6a7c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.501+0000 7f1fb619b700 1 -- 172.21.15.17:0/3575265417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f6a549250 con 0x561f6a7a22d0 2023-07-14T13:00:08.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.501+0000 7f1fb619b700 1 --2- 172.21.15.17:0/3575265417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7aae60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1fac014040 tx=0x7f1fac011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501942a614698ebe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.502+0000 7f1fa53ff700 1 -- 172.21.15.17:0/3575265417 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0041c0 con 0x561f6a7a22d0 2023-07-14T13:00:08.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.502+0000 7f1fa53ff700 1 -- 172.21.15.17:0/3575265417 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fac009eb0 con 0x561f6a7a22d0 2023-07-14T13:00:08.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.502+0000 7f1fa53ff700 1 -- 172.21.15.17:0/3575265417 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac02aa50 con 0x561f6a7a22d0 2023-07-14T13:00:08.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.502+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/3575265417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 msgr2=0x561f6a7aae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.502+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/3575265417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7aae60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1fac014040 tx=0x7f1fac011720 comp rx=0 tx=0).stop 2023-07-14T13:00:08.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.503+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/3575265417 shutdown_connections 2023-07-14T13:00:08.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.503+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/3575265417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7adad0 0x561f6a7b9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.503+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/3575265417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a22d0 0x561f6a7aae60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.503+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/3575265417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7a2be0 0x561f6a7c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.503+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/3575265417 >> 172.21.15.17:0/3575265417 conn(0x561f6a798da0 msgr2=0x561f6a79a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.503+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/3575265417 shutdown_connections 2023-07-14T13:00:08.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.503+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/3575265417 wait complete. 2023-07-14T13:00:08.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.503+0000 7f1fcbc5cb80 1 -- start start 2023-07-14T13:00:08.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.503+0000 7f1fcbc5cb80 1 Processor -- start 2023-07-14T13:00:08.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7a22d0 0x561f6a7b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fcbc5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7adad0 0x561f6a7b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a7b4230 con 0x561f6a7a2be0 2023-07-14T13:00:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a7b43a0 con 0x561f6a7adad0 2023-07-14T13:00:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fcbc5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6a7b4560 con 0x561f6a7a22d0 2023-07-14T13:00:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fcbc5cb80 10 client.0 _ll_register_callbacks cb 0x7f1fa0020480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fb599a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fb619b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7a22d0 0x561f6a7b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fb599a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36842/0 (socket says 172.21.15.17:36842) 2023-07-14T13:00:08.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fb599a700 1 -- 172.21.15.17:0/2315478855 learned_addr learned my addr 172.21.15.17:0/2315478855 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.504+0000 7f1fb699c700 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7adad0 0x561f6a7b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.505+0000 7f1fb599a700 1 -- 172.21.15.17:0/2315478855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7a22d0 msgr2=0x561f6a7b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.505+0000 7f1fb599a700 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7a22d0 0x561f6a7b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.505+0000 7f1fb599a700 1 -- 172.21.15.17:0/2315478855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7adad0 msgr2=0x561f6a7b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.505+0000 7f1fb599a700 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7adad0 0x561f6a7b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.505+0000 7f1fb599a700 1 -- 172.21.15.17:0/2315478855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f6a522de0 con 0x561f6a7a2be0 2023-07-14T13:00:08.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.505+0000 7f1fb599a700 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7b2c60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0010cb0 tx=0x7f1fa0034780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fc64d6fa91de7f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.505+0000 7f1f99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:08.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.505+0000 7f1f99ffb700 1 -- 172.21.15.17:0/2315478855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0018040 con 0x561f6a7a2be0 2023-07-14T13:00:08.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.505+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/2315478855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1fac004390 con 0x561f6a7a2be0 2023-07-14T13:00:08.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.505+0000 7f1f99ffb700 1 -- 172.21.15.17:0/2315478855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1fa0034d80 con 0x561f6a7a2be0 2023-07-14T13:00:08.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.506+0000 7f1f99ffb700 1 -- 172.21.15.17:0/2315478855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fa0005ce0 con 0x561f6a7a2be0 2023-07-14T13:00:08.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.506+0000 7f1fcbc5cb80 10 client.15735 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:08.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.506+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/2315478855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x561f6a5212b0 con 0x561f6a7a2be0 2023-07-14T13:00:08.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.506+0000 7f1f99ffb700 1 -- 172.21.15.17:0/2315478855 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fac004390 con 0x561f6a7a2be0 2023-07-14T13:00:08.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.506+0000 7f1f99ffb700 1 -- 172.21.15.17:0/2315478855 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1fa002ab50 con 0x561f6a7a2be0 2023-07-14T13:00:08.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.506+0000 7f1fcbc5cb80 10 client.15735 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:08.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.506+0000 7f1fcbc5cb80 10 client.15735 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:00:08.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.506+0000 7f1fcbc5cb80 20 client.15735 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:08.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.506+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561f6a8124b0 0x561f6a8148c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.506+0000 7f1fcbc5cb80 4 client.15735 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:00:08.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.506+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/2315478855 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561f6a6b0050 con 0x561f6a8124b0 2023-07-14T13:00:08.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.507+0000 7f1fb619b700 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561f6a8124b0 0x561f6a8148c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.507+0000 7f1fb619b700 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561f6a8124b0 0x561f6a8148c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=17f8f3eb52c85ed1 server_cookie=9bf4505b19c07877 in_seq=0 out_seq=0 2023-07-14T13:00:08.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.507+0000 7f1f99ffb700 10 client.15735 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:00:08.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1f99ffb700 1 -- 172.21.15.17:0/2315478855 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561f6a6b0050 con 0x561f6a8124b0 2023-07-14T13:00:08.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1f99ffb700 10 client.15735 handle_command_reply: tid=0 2023-07-14T13:00:08.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 1 client.15735 shutdown 2023-07-14T13:00:08.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/2315478855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 msgr2=0x561f6a7b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7b2c60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0010cb0 tx=0x7f1fa0034780 comp rx=0 tx=0).stop 2023-07-14T13:00:08.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/2315478855 shutdown_connections 2023-07-14T13:00:08.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561f6a8124b0 0x561f6a8148c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561f6a7adad0 0x561f6a7b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f6a7a22d0 0x561f6a7b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 1 --2- 172.21.15.17:0/2315478855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561f6a7a2be0 0x561f6a7b2c60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/2315478855 >> 172.21.15.17:0/2315478855 conn(0x561f6a798da0 msgr2=0x561f6a7b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1f99ffb700 0 client.15735 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:00:08.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/2315478855 shutdown_connections 2023-07-14T13:00:08.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 1 -- 172.21.15.17:0/2315478855 wait complete. 2023-07-14T13:00:08.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.508+0000 7f1fcbc5cb80 20 client.15735 trim_cache size 0 max 16384 2023-07-14T13:00:08.576 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:00:08.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 -- 172.21.15.17:0/421088381 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1f9c0a1460 msgr2=0x7f1f9c0a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1f9c0a1460 0x7f1f9c0a3910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0199400 tx=0x7f1fa0009f90 comp rx=0 tx=0).stop 2023-07-14T13:00:08.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 -- 172.21.15.17:0/421088381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fb0105af0 msgr2=0x7f1fb019c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fb0105af0 0x7f1fb019c790 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800b070 tx=0x7f1fa800bce0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 -- 172.21.15.17:0/421088381 shutdown_connections 2023-07-14T13:00:08.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1f9c0a1460 0x7f1f9c0a3910 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fb0105af0 0x7f1fb019c790 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fb00ffae0 0x7f1fb0197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 --2- 172.21.15.17:0/421088381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb0100490 0x7f1fb0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 -- 172.21.15.17:0/421088381 >> 172.21.15.17:0/421088381 conn(0x7f1fb00fb5e0 msgr2=0x7f1fb010ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 -- 172.21.15.17:0/421088381 shutdown_connections 2023-07-14T13:00:08.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.509+0000 7f1fb83ff700 1 -- 172.21.15.17:0/421088381 wait complete. 2023-07-14T13:00:08.579 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:00:08.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.783+0000 7f132d1ff700 1 -- 172.21.15.17:0/4203523959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13280731c0 msgr2=0x7f132810bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.783+0000 7f132d1ff700 1 --2- 172.21.15.17:0/4203523959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13280731c0 0x7f132810bdd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f131c009990 tx=0x7f131c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.783+0000 7f132d1ff700 1 -- 172.21.15.17:0/4203523959 shutdown_connections 2023-07-14T13:00:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.783+0000 7f132d1ff700 1 --2- 172.21.15.17:0/4203523959 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f132810c310 0x7f132810e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.783+0000 7f132d1ff700 1 --2- 172.21.15.17:0/4203523959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13280728b0 0x7f1328072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.783+0000 7f132d1ff700 1 --2- 172.21.15.17:0/4203523959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13280731c0 0x7f132810bdd0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.783+0000 7f132d1ff700 1 -- 172.21.15.17:0/4203523959 >> 172.21.15.17:0/4203523959 conn(0x7f13280fb5f0 msgr2=0x7f13280fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.783+0000 7f132d1ff700 1 -- 172.21.15.17:0/4203523959 shutdown_connections 2023-07-14T13:00:08.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.783+0000 7f132d1ff700 1 -- 172.21.15.17:0/4203523959 wait complete. 2023-07-14T13:00:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.784+0000 7f132d1ff700 1 Processor -- start 2023-07-14T13:00:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.785+0000 7f132d1ff700 1 -- start start 2023-07-14T13:00:08.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.785+0000 7f132d1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13280728b0 0x7f1328197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.785+0000 7f132d1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13280731c0 0x7f13281982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.785+0000 7f132d1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f132810c310 0x7f132819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.785+0000 7f132d1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132819cd80 con 0x7f13280731c0 2023-07-14T13:00:08.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.785+0000 7f132d1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132819cef0 con 0x7f132810c310 2023-07-14T13:00:08.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.785+0000 7f132d1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132819d0b0 con 0x7f13280728b0 2023-07-14T13:00:08.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.785+0000 7f132659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13280731c0 0x7f13281982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.785+0000 7f132659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13280731c0 0x7f13281982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36860/0 (socket says 172.21.15.17:36860) 2023-07-14T13:00:08.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.785+0000 7f132659c700 1 -- 172.21.15.17:0/1653898667 learned_addr learned my addr 172.21.15.17:0/1653898667 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.785+0000 7f132759e700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f132810c310 0x7f132819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.786+0000 7f1326d9d700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13280728b0 0x7f1328197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.786+0000 7f132659c700 1 -- 172.21.15.17:0/1653898667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13280728b0 msgr2=0x7f1328197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.786+0000 7f132659c700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13280728b0 0x7f1328197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.786+0000 7f132659c700 1 -- 172.21.15.17:0/1653898667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f132810c310 msgr2=0x7f132819c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.786+0000 7f132659c700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f132810c310 0x7f132819c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.786+0000 7f132659c700 1 -- 172.21.15.17:0/1653898667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c0095f0 con 0x7f13280731c0 2023-07-14T13:00:08.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.786+0000 7f1326d9d700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13280728b0 0x7f1328197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:08.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.786+0000 7f132659c700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13280731c0 0x7f13281982e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f131c006010 tx=0x7f131c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.786+0000 7f130ffff700 1 -- 172.21.15.17:0/1653898667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c01d070 con 0x7f13280731c0 2023-07-14T13:00:08.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.786+0000 7f130ffff700 1 -- 172.21.15.17:0/1653898667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f131c004000 con 0x7f13280731c0 2023-07-14T13:00:08.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.786+0000 7f130ffff700 1 -- 172.21.15.17:0/1653898667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c022c00 con 0x7f13280731c0 2023-07-14T13:00:08.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.787+0000 7f132d1ff700 1 -- 172.21.15.17:0/1653898667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132819d330 con 0x7f13280731c0 2023-07-14T13:00:08.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.787+0000 7f132d1ff700 1 -- 172.21.15.17:0/1653898667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132819d5b0 con 0x7f13280731c0 2023-07-14T13:00:08.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.790+0000 7f130ffff700 1 -- 172.21.15.17:0/1653898667 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f131c022470 con 0x7f13280731c0 2023-07-14T13:00:08.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.792+0000 7f1340c04b80 1 Processor -- start 2023-07-14T13:00:08.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.792+0000 7f1340c04b80 1 -- start start 2023-07-14T13:00:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.792+0000 7f130ffff700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f13100a1460 0x7f13100a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.792+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93eb2d0 0x5635b93eb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.792+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 0x5635b93f6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.792+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.792+0000 7f1340c04b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b92f1cb0 con 0x5635b93f6ad0 2023-07-14T13:00:08.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.792+0000 7f1340c04b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b9344a40 con 0x5635b93eb2d0 2023-07-14T13:00:08.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.792+0000 7f1340c04b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b933ded0 con 0x5635b93ebbe0 2023-07-14T13:00:08.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.792+0000 7f130ffff700 1 -- 172.21.15.17:0/1653898667 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f131c0ce300 con 0x7f13280731c0 2023-07-14T13:00:08.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132759e700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f13100a1460 0x7f13100a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 0x5635b93f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93f8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36866/0 (socket says 172.21.15.17:36866) 2023-07-14T13:00:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132759e700 1 -- 172.21.15.17:0/1055450266 learned_addr learned my addr 172.21.15.17:0/1055450266 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f1326d9d700 1 --2- 172.21.15.17:0/1055450266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93eb2d0 0x5635b93eb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132659c700 1 -- 172.21.15.17:0/1055450266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93eb2d0 msgr2=0x5635b93eb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132659c700 1 --2- 172.21.15.17:0/1055450266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93eb2d0 0x5635b93eb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132659c700 1 -- 172.21.15.17:0/1055450266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 msgr2=0x5635b93f8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132659c700 1 --2- 172.21.15.17:0/1055450266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93f8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132659c700 1 -- 172.21.15.17:0/1055450266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635b916bde0 con 0x5635b93ebbe0 2023-07-14T13:00:08.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f1326d9d700 1 --2- 172.21.15.17:0/1055450266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93eb2d0 0x5635b93eb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:08.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132759e700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f13100a1460 0x7f13100a3910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1320009fd0 tx=0x7f1320009d00 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.793+0000 7f132659c700 1 --2- 172.21.15.17:0/1055450266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 0x5635b93f6590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f131c0cb920 tx=0x7f131c095f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=462d6c9687b3b596 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.794+0000 7f130d7fa700 1 -- 172.21.15.17:0/1055450266 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c09ace0 con 0x5635b93ebbe0 2023-07-14T13:00:08.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.794+0000 7f130d7fa700 1 -- 172.21.15.17:0/1055450266 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f131c01c770 con 0x5635b93ebbe0 2023-07-14T13:00:08.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.794+0000 7f130d7fa700 1 -- 172.21.15.17:0/1055450266 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c09b380 con 0x5635b93ebbe0 2023-07-14T13:00:08.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.794+0000 7f1340c04b80 1 -- 172.21.15.17:0/1055450266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 msgr2=0x5635b93f6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.794+0000 7f1340c04b80 1 --2- 172.21.15.17:0/1055450266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 0x5635b93f6590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f131c0cb920 tx=0x7f131c095f90 comp rx=0 tx=0).stop 2023-07-14T13:00:08.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.795+0000 7f1340c04b80 1 -- 172.21.15.17:0/1055450266 shutdown_connections 2023-07-14T13:00:08.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.795+0000 7f1340c04b80 1 --2- 172.21.15.17:0/1055450266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.795+0000 7f1340c04b80 1 --2- 172.21.15.17:0/1055450266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93eb2d0 0x5635b93eb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.795+0000 7f1340c04b80 1 --2- 172.21.15.17:0/1055450266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 0x5635b93f6590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.795+0000 7f1340c04b80 1 -- 172.21.15.17:0/1055450266 >> 172.21.15.17:0/1055450266 conn(0x5635b93e1da0 msgr2=0x5635b93e76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.795+0000 7f1340c04b80 1 -- 172.21.15.17:0/1055450266 shutdown_connections 2023-07-14T13:00:08.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.795+0000 7f1340c04b80 1 -- 172.21.15.17:0/1055450266 wait complete. 2023-07-14T13:00:08.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.795+0000 7f1340c04b80 1 -- start start 2023-07-14T13:00:08.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.795+0000 7f1340c04b80 1 Processor -- start 2023-07-14T13:00:08.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.796+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93eb2d0 0x5635b93faa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.796+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93ebbe0 0x5635b93fafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.796+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.796+0000 7f1340c04b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b92ddac0 con 0x5635b93f6ad0 2023-07-14T13:00:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.796+0000 7f1340c04b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b92dd7c0 con 0x5635b93ebbe0 2023-07-14T13:00:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.796+0000 7f1340c04b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b91c1920 con 0x5635b93eb2d0 2023-07-14T13:00:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.796+0000 7f1340c04b80 10 client.0 _ll_register_callbacks cb 0x5635b92db760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.796+0000 7f132759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.796+0000 7f132759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36880/0 (socket says 172.21.15.17:36880) 2023-07-14T13:00:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.796+0000 7f132759e700 1 -- 172.21.15.17:0/528615421 learned_addr learned my addr 172.21.15.17:0/528615421 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.796+0000 7f1326d9d700 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93eb2d0 0x5635b93faa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.797+0000 7f132659c700 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93ebbe0 0x5635b93fafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.797+0000 7f132759e700 1 -- 172.21.15.17:0/528615421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93eb2d0 msgr2=0x5635b93faa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.797+0000 7f132759e700 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93eb2d0 0x5635b93faa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.797+0000 7f132759e700 1 -- 172.21.15.17:0/528615421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93ebbe0 msgr2=0x5635b93fafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.797+0000 7f132759e700 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93ebbe0 0x5635b93fafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.797+0000 7f132759e700 1 -- 172.21.15.17:0/528615421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132819d330 con 0x5635b93f6ad0 2023-07-14T13:00:08.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.797+0000 7f132759e700 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93f5a40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f13200076e0 tx=0x7f1320009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f156c12ca7f1660d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.797+0000 7f130aff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:08.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.797+0000 7f130aff5700 1 -- 172.21.15.17:0/528615421 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200097e0 con 0x5635b93f6ad0 2023-07-14T13:00:08.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.797+0000 7f130aff5700 1 -- 172.21.15.17:0/528615421 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f132001bdd0 con 0x5635b93f6ad0 2023-07-14T13:00:08.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.797+0000 7f1340c04b80 1 -- 172.21.15.17:0/528615421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5635b92974f0 con 0x5635b93f6ad0 2023-07-14T13:00:08.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.798+0000 7f130aff5700 1 -- 172.21.15.17:0/528615421 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1320030460 con 0x5635b93f6ad0 2023-07-14T13:00:08.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.798+0000 7f1340c04b80 10 client.15747 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:08.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.798+0000 7f1340c04b80 1 -- 172.21.15.17:0/528615421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5635b9154c60 con 0x5635b93f6ad0 2023-07-14T13:00:08.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.798+0000 7f130aff5700 1 -- 172.21.15.17:0/528615421 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5635b92974f0 con 0x5635b93f6ad0 2023-07-14T13:00:08.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.798+0000 7f130aff5700 1 -- 172.21.15.17:0/528615421 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f13200253c0 con 0x5635b93f6ad0 2023-07-14T13:00:08.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.798+0000 7f1340c04b80 10 client.15747 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:08.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.798+0000 7f1340c04b80 10 client.15747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:08.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.798+0000 7f1340c04b80 20 client.15747 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:08.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.798+0000 7f1340c04b80 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635b9406020 0x5635b9408430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.799+0000 7f1340c04b80 4 client.15747 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:08.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.799+0000 7f1340c04b80 1 -- 172.21.15.17:0/528615421 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635b9336eb0 con 0x5635b9406020 2023-07-14T13:00:08.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.799+0000 7f1326d9d700 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635b9406020 0x5635b9408430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.800+0000 7f1326d9d700 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635b9406020 0x5635b9408430 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=966ac3411cc9199f server_cookie=ea89f810e5d62aa1 in_seq=0 out_seq=0 2023-07-14T13:00:08.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.800+0000 7f130aff5700 10 client.15747 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:08.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f130aff5700 1 -- 172.21.15.17:0/528615421 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5635b9336eb0 con 0x5635b9406020 2023-07-14T13:00:08.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f130aff5700 10 client.15747 handle_command_reply: tid=0 2023-07-14T13:00:08.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 1 client.15747 shutdown 2023-07-14T13:00:08.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 1 -- 172.21.15.17:0/528615421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 msgr2=0x5635b93f5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93f5a40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f13200076e0 tx=0x7f1320009100 comp rx=0 tx=0).stop 2023-07-14T13:00:08.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 1 -- 172.21.15.17:0/528615421 shutdown_connections 2023-07-14T13:00:08.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635b9406020 0x5635b9408430 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93f5a40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93eb2d0 0x5635b93faa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f130aff5700 0 client.15747 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:08.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 1 --2- 172.21.15.17:0/528615421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93ebbe0 0x5635b93fafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 1 -- 172.21.15.17:0/528615421 >> 172.21.15.17:0/528615421 conn(0x5635b93e1da0 msgr2=0x5635b93e7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 1 -- 172.21.15.17:0/528615421 shutdown_connections 2023-07-14T13:00:08.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 1 -- 172.21.15.17:0/528615421 wait complete. 2023-07-14T13:00:08.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.801+0000 7f1340c04b80 20 client.15747 trim_cache size 0 max 16384 2023-07-14T13:00:08.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.819+0000 7f1340c04b80 1 Processor -- start 2023-07-14T13:00:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.819+0000 7f1340c04b80 1 -- start start 2023-07-14T13:00:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.819+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93eb2d0 0x5635b9408430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.819+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 0x5635b93f5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.819+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93f6ad0 0x5635b93f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.819+0000 7f1340c04b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b93f72a0 con 0x5635b93eb2d0 2023-07-14T13:00:08.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.819+0000 7f1340c04b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b93ed1a0 con 0x5635b93f6ad0 2023-07-14T13:00:08.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.819+0000 7f1340c04b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b93f3fd0 con 0x5635b93ebbe0 2023-07-14T13:00:08.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.819+0000 7f1326d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93eb2d0 0x5635b9408430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.819+0000 7f1326d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93eb2d0 0x5635b9408430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36882/0 (socket says 172.21.15.17:36882) 2023-07-14T13:00:08.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.819+0000 7f1326d9d700 1 -- 172.21.15.17:0/2034481739 learned_addr learned my addr 172.21.15.17:0/2034481739 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.820+0000 7f1326d9d700 1 -- 172.21.15.17:0/2034481739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 msgr2=0x5635b93f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.820+0000 7f132659c700 1 --2- 172.21.15.17:0/2034481739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 0x5635b93f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.820+0000 7f1326d9d700 1 --2- 172.21.15.17:0/2034481739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 0x5635b93f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.820+0000 7f1326d9d700 1 -- 172.21.15.17:0/2034481739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93f6ad0 msgr2=0x5635b93f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.820+0000 7f1326d9d700 1 --2- 172.21.15.17:0/2034481739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93f6ad0 0x5635b93f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.820+0000 7f1326d9d700 1 -- 172.21.15.17:0/2034481739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635b9192250 con 0x5635b93eb2d0 2023-07-14T13:00:08.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.820+0000 7f132659c700 1 --2- 172.21.15.17:0/2034481739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 0x5635b93f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:00:08.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.820+0000 7f1326d9d700 1 --2- 172.21.15.17:0/2034481739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93eb2d0 0x5635b9408430 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f131800b780 tx=0x7f13180043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603b4b5228b066a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.820+0000 7f130dffb700 1 -- 172.21.15.17:0/2034481739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318017040 con 0x5635b93eb2d0 2023-07-14T13:00:08.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.820+0000 7f130dffb700 1 -- 172.21.15.17:0/2034481739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f131801d580 con 0x5635b93eb2d0 2023-07-14T13:00:08.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.820+0000 7f130dffb700 1 -- 172.21.15.17:0/2034481739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13180126b0 con 0x5635b93eb2d0 2023-07-14T13:00:08.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.821+0000 7f1340c04b80 1 -- 172.21.15.17:0/2034481739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93eb2d0 msgr2=0x5635b9408430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.821+0000 7f1340c04b80 1 --2- 172.21.15.17:0/2034481739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93eb2d0 0x5635b9408430 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f131800b780 tx=0x7f13180043d0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.821+0000 7f1340c04b80 1 -- 172.21.15.17:0/2034481739 shutdown_connections 2023-07-14T13:00:08.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.821+0000 7f1340c04b80 1 --2- 172.21.15.17:0/2034481739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93f6ad0 0x5635b93f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.821+0000 7f1340c04b80 1 --2- 172.21.15.17:0/2034481739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93eb2d0 0x5635b9408430 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.821+0000 7f1340c04b80 1 --2- 172.21.15.17:0/2034481739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93ebbe0 0x5635b93f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.821+0000 7f1340c04b80 1 -- 172.21.15.17:0/2034481739 >> 172.21.15.17:0/2034481739 conn(0x5635b93e1da0 msgr2=0x5635b93fb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.821+0000 7f1340c04b80 1 -- 172.21.15.17:0/2034481739 shutdown_connections 2023-07-14T13:00:08.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.821+0000 7f1340c04b80 1 -- 172.21.15.17:0/2034481739 wait complete. 2023-07-14T13:00:08.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.822+0000 7f1340c04b80 1 -- start start 2023-07-14T13:00:08.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.822+0000 7f1340c04b80 1 Processor -- start 2023-07-14T13:00:08.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.822+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93eb2d0 0x5635b9402250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.822+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93ebbe0 0x5635b9402790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.822+0000 7f1340c04b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93fead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.822+0000 7f1340c04b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b93ff1b0 con 0x5635b93f6ad0 2023-07-14T13:00:08.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.822+0000 7f1340c04b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b93ff320 con 0x5635b93ebbe0 2023-07-14T13:00:08.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f1340c04b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b93ff4e0 con 0x5635b93eb2d0 2023-07-14T13:00:08.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f1340c04b80 10 client.0 _ll_register_callbacks cb 0x7f1320019c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:08.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f132759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93fead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f132759e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93fead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36894/0 (socket says 172.21.15.17:36894) 2023-07-14T13:00:08.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f132759e700 1 -- 172.21.15.17:0/1305174509 learned_addr learned my addr 172.21.15.17:0/1305174509 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:08.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f132659c700 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93ebbe0 0x5635b9402790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f1326d9d700 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93eb2d0 0x5635b9402250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f132659c700 1 -- 172.21.15.17:0/1305174509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93eb2d0 msgr2=0x5635b9402250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f132659c700 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93eb2d0 0x5635b9402250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f132659c700 1 -- 172.21.15.17:0/1305174509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 msgr2=0x5635b93fead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:08.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f132659c700 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93fead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f132659c700 1 -- 172.21.15.17:0/1305174509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131800be10 con 0x5635b93ebbe0 2023-07-14T13:00:08.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f132759e700 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93fead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:08.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.823+0000 7f1326d9d700 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93eb2d0 0x5635b9402250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:08.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.824+0000 7f132659c700 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93ebbe0 0x5635b9402790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b5c0 tx=0x7f131c02efb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88f1b38044babb03 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:08.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.824+0000 7f130aff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:00:08.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.824+0000 7f130aff5700 1 -- 172.21.15.17:0/1305174509 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c01c130 con 0x5635b93ebbe0 2023-07-14T13:00:08.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.824+0000 7f130aff5700 1 -- 172.21.15.17:0/1305174509 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f131c004170 con 0x5635b93ebbe0 2023-07-14T13:00:08.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.824+0000 7f1340c04b80 1 -- 172.21.15.17:0/1305174509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f131c01c770 con 0x5635b93ebbe0 2023-07-14T13:00:08.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.824+0000 7f130aff5700 1 -- 172.21.15.17:0/1305174509 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f131c09ace0 con 0x5635b93ebbe0 2023-07-14T13:00:08.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.824+0000 7f1340c04b80 10 client.25532 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:08.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.824+0000 7f1340c04b80 1 -- 172.21.15.17:0/1305174509 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5635b916a2b0 con 0x5635b93ebbe0 2023-07-14T13:00:08.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.825+0000 7f130aff5700 1 -- 172.21.15.17:0/1305174509 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f131c01c770 con 0x5635b93ebbe0 2023-07-14T13:00:08.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.825+0000 7f130aff5700 1 -- 172.21.15.17:0/1305174509 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f131c09b5e0 con 0x5635b93ebbe0 2023-07-14T13:00:08.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.825+0000 7f1340c04b80 10 client.25532 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:08.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.825+0000 7f1340c04b80 10 client.25532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:08.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.825+0000 7f1340c04b80 20 client.25532 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:08.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.825+0000 7f1340c04b80 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635b945ad50 0x5635b945d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:08.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.825+0000 7f1340c04b80 4 client.25532 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:00:08.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.825+0000 7f1340c04b80 1 -- 172.21.15.17:0/1305174509 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5635b92f9050 con 0x5635b945ad50 2023-07-14T13:00:08.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.825+0000 7f1326d9d700 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635b945ad50 0x5635b945d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:08.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.826+0000 7f1326d9d700 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635b945ad50 0x5635b945d160 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7afdafd55e50da9e server_cookie=adaaf5c52f319946 in_seq=0 out_seq=0 2023-07-14T13:00:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.826+0000 7f130aff5700 10 client.25532 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f130aff5700 1 -- 172.21.15.17:0/1305174509 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5635b92f9050 con 0x5635b945ad50 2023-07-14T13:00:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f130aff5700 10 client.25532 handle_command_reply: tid=0 2023-07-14T13:00:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 1 client.25532 shutdown 2023-07-14T13:00:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 1 -- 172.21.15.17:0/1305174509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93ebbe0 msgr2=0x5635b9402790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93ebbe0 0x5635b9402790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b5c0 tx=0x7f131c02efb0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 1 -- 172.21.15.17:0/1305174509 shutdown_connections 2023-07-14T13:00:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635b945ad50 0x5635b945d160 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635b93f6ad0 0x5635b93fead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635b93eb2d0 0x5635b9402250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f130aff5700 0 client.25532 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 1 --2- 172.21.15.17:0/1305174509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635b93ebbe0 0x5635b9402790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 1 -- 172.21.15.17:0/1305174509 >> 172.21.15.17:0/1305174509 conn(0x5635b93e1da0 msgr2=0x5635b93f0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 1 -- 172.21.15.17:0/1305174509 shutdown_connections 2023-07-14T13:00:08.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 1 -- 172.21.15.17:0/1305174509 wait complete. 2023-07-14T13:00:08.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.827+0000 7f1340c04b80 20 client.25532 trim_cache size 0 max 16384 2023-07-14T13:00:08.866 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:00:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 -- 172.21.15.17:0/1653898667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f13100a1460 msgr2=0x7f13100a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f13100a1460 0x7f13100a3910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1320009fd0 tx=0x7f1320009d00 comp rx=0 tx=0).stop 2023-07-14T13:00:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 -- 172.21.15.17:0/1653898667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13280731c0 msgr2=0x7f13281982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13280731c0 0x7f13281982e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f131c006010 tx=0x7f131c005740 comp rx=0 tx=0).stop 2023-07-14T13:00:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 -- 172.21.15.17:0/1653898667 shutdown_connections 2023-07-14T13:00:08.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f13100a1460 0x7f13100a3910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f132810c310 0x7f132819c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13280728b0 0x7f1328197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 --2- 172.21.15.17:0/1653898667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13280731c0 0x7f13281982e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:08.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 -- 172.21.15.17:0/1653898667 >> 172.21.15.17:0/1653898667 conn(0x7f13280fb5f0 msgr2=0x7f132810e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:08.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 -- 172.21.15.17:0/1653898667 shutdown_connections 2023-07-14T13:00:08.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:08.828+0000 7f132d1ff700 1 -- 172.21.15.17:0/1653898667 wait complete. 2023-07-14T13:00:09.118 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3602_fsm 2023-07-14T13:00:09.119 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3602_vm 2023-07-14T13:00:09.119 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3603 2023-07-14T13:00:09.119 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3603_fsm 2023-07-14T13:00:09.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3603_vm 2023-07-14T13:00:09.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3604 2023-07-14T13:00:09.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3605 2023-07-14T13:00:09.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3606 2023-07-14T13:00:09.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3607 2023-07-14T13:00:09.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3608 2023-07-14T13:00:09.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 3609 2023-07-14T13:00:09.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3712 2023-07-14T13:00:09.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3764 2023-07-14T13:00:09.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3764_fsm 2023-07-14T13:00:09.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3764_vm 2023-07-14T13:00:09.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3766 2023-07-14T13:00:09.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3767 2023-07-14T13:00:09.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3997 2023-07-14T13:00:09.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 5002 2023-07-14T13:00:09.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 548 2023-07-14T13:00:09.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 549 2023-07-14T13:00:09.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6102 2023-07-14T13:00:09.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6102_vm 2023-07-14T13:00:09.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6104 2023-07-14T13:00:09.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6104_vm 2023-07-14T13:00:09.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6106 2023-07-14T13:00:09.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6106_vm 2023-07-14T13:00:09.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6110 2023-07-14T13:00:09.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6111 2023-07-14T13:00:09.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6112 2023-07-14T13:00:09.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6113 2023-07-14T13:00:09.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6117 2023-07-14T13:00:09.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 826 2023-07-14T13:00:09.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 826_vm 2023-07-14T13:00:09.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 827 2023-07-14T13:00:09.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 828 2023-07-14T13:00:09.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 14 12:59 pg_filenode.map 2023-07-14T13:00:09.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 14 12:59 PG_VERSION 2023-07-14T13:00:09.125 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.125 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-07-14T13:00:09.125 INFO:teuthology.orchestra.run.smithi017.stdout:total 7194 2023-07-14T13:00:09.125 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Jul 14 13:00 . 2023-07-14T13:00:09.125 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22095369 Jul 14 12:59 .. 2023-07-14T13:00:09.125 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 112 2023-07-14T13:00:09.125 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 113 2023-07-14T13:00:09.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 14 13:00 12182 2023-07-14T13:00:09.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12182_fsm 2023-07-14T13:00:09.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12182_vm 2023-07-14T13:00:09.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 12184 2023-07-14T13:00:09.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12186 2023-07-14T13:00:09.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12187 2023-07-14T13:00:09.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12187_fsm 2023-07-14T13:00:09.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12187_vm 2023-07-14T13:00:09.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 12189 2023-07-14T13:00:09.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12191 2023-07-14T13:00:09.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192 2023-07-14T13:00:09.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12192_fsm 2023-07-14T13:00:09.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192_vm 2023-07-14T13:00:09.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 12194 2023-07-14T13:00:09.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12196 2023-07-14T13:00:09.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12197 2023-07-14T13:00:09.128 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12197_fsm 2023-07-14T13:00:09.129 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12197_vm 2023-07-14T13:00:09.129 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 12199 2023-07-14T13:00:09.129 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12201 2023-07-14T13:00:09.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12202 2023-07-14T13:00:09.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12202_fsm 2023-07-14T13:00:09.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12202_vm 2023-07-14T13:00:09.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12204 2023-07-14T13:00:09.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12206 2023-07-14T13:00:09.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12207 2023-07-14T13:00:09.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12207_fsm 2023-07-14T13:00:09.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12207_vm 2023-07-14T13:00:09.132 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12209 2023-07-14T13:00:09.132 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12211 2023-07-14T13:00:09.132 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12212 2023-07-14T13:00:09.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 12214 2023-07-14T13:00:09.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12216 2023-07-14T13:00:09.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 14 13:00 1247 2023-07-14T13:00:09.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1247_fsm 2023-07-14T13:00:09.134 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1247_vm 2023-07-14T13:00:09.134 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 14 13:00 1249 2023-07-14T13:00:09.134 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 1249_fsm 2023-07-14T13:00:09.135 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 1249_vm 2023-07-14T13:00:09.135 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 14 13:00 1255 2023-07-14T13:00:09.135 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 1255_fsm 2023-07-14T13:00:09.135 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 1255_vm 2023-07-14T13:00:09.136 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 14 13:00 1259 2023-07-14T13:00:09.136 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 1259_fsm 2023-07-14T13:00:09.136 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1259_vm 2023-07-14T13:00:09.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1417 2023-07-14T13:00:09.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 1417_vm 2023-07-14T13:00:09.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 1418 2023-07-14T13:00:09.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 1418_vm 2023-07-14T13:00:09.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 174 2023-07-14T13:00:09.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 175 2023-07-14T13:00:09.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2187 2023-07-14T13:00:09.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2224 2023-07-14T13:00:09.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2224_vm 2023-07-14T13:00:09.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2328 2023-07-14T13:00:09.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2328_vm 2023-07-14T13:00:09.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2336 2023-07-14T13:00:09.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2336_vm 2023-07-14T13:00:09.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2337 2023-07-14T13:00:09.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2600 2023-07-14T13:00:09.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2600_fsm 2023-07-14T13:00:09.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2600_vm 2023-07-14T13:00:09.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2601 2023-07-14T13:00:09.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2601_fsm 2023-07-14T13:00:09.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2601_vm 2023-07-14T13:00:09.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 13:00 2602 2023-07-14T13:00:09.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2602_fsm 2023-07-14T13:00:09.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2602_vm 2023-07-14T13:00:09.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 13:00 2603 2023-07-14T13:00:09.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2603_fsm 2023-07-14T13:00:09.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2603_vm 2023-07-14T13:00:09.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2604 2023-07-14T13:00:09.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2604_vm 2023-07-14T13:00:09.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2605 2023-07-14T13:00:09.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2605_fsm 2023-07-14T13:00:09.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2605_vm 2023-07-14T13:00:09.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2606 2023-07-14T13:00:09.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2606_fsm 2023-07-14T13:00:09.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2606_vm 2023-07-14T13:00:09.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2607 2023-07-14T13:00:09.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2607_fsm 2023-07-14T13:00:09.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2607_vm 2023-07-14T13:00:09.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jul 14 13:00 2608 2023-07-14T13:00:09.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2608_fsm 2023-07-14T13:00:09.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2608_vm 2023-07-14T13:00:09.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 14 13:00 2609 2023-07-14T13:00:09.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2609_fsm 2023-07-14T13:00:09.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2609_vm 2023-07-14T13:00:09.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2610 2023-07-14T13:00:09.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2610_fsm 2023-07-14T13:00:09.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2610_vm 2023-07-14T13:00:09.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2611 2023-07-14T13:00:09.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2611_vm 2023-07-14T13:00:09.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2612 2023-07-14T13:00:09.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2612_fsm 2023-07-14T13:00:09.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2612_vm 2023-07-14T13:00:09.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2613 2023-07-14T13:00:09.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2613_vm 2023-07-14T13:00:09.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2615 2023-07-14T13:00:09.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2615_fsm 2023-07-14T13:00:09.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2615_vm 2023-07-14T13:00:09.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2616 2023-07-14T13:00:09.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2616_fsm 2023-07-14T13:00:09.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2616_vm 2023-07-14T13:00:09.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 14 13:00 2617 2023-07-14T13:00:09.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2617_fsm 2023-07-14T13:00:09.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2617_vm 2023-07-14T13:00:09.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 14 13:00 2618 2023-07-14T13:00:09.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2618_fsm 2023-07-14T13:00:09.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2618_vm 2023-07-14T13:00:09.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jul 14 13:00 2619 2023-07-14T13:00:09.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2619_fsm 2023-07-14T13:00:09.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2619_vm 2023-07-14T13:00:09.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2620 2023-07-14T13:00:09.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2620_vm 2023-07-14T13:00:09.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2650 2023-07-14T13:00:09.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2651 2023-07-14T13:00:09.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2652 2023-07-14T13:00:09.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 13:00 2653 2023-07-14T13:00:09.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 13:00 2654 2023-07-14T13:00:09.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 13:00 2655 2023-07-14T13:00:09.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2656 2023-07-14T13:00:09.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2657 2023-07-14T13:00:09.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 14 13:00 2658 2023-07-14T13:00:09.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 13:00 2659 2023-07-14T13:00:09.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2660 2023-07-14T13:00:09.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2661 2023-07-14T13:00:09.148 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2662 2023-07-14T13:00:09.148 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 13:00 2663 2023-07-14T13:00:09.148 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2664 2023-07-14T13:00:09.148 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2665 2023-07-14T13:00:09.148 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2666 2023-07-14T13:00:09.148 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2667 2023-07-14T13:00:09.148 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2668 2023-07-14T13:00:09.148 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2669 2023-07-14T13:00:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2670 2023-07-14T13:00:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jul 14 13:00 2673 2023-07-14T13:00:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 14 13:00 2674 2023-07-14T13:00:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 14 13:00 2675 2023-07-14T13:00:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2678 2023-07-14T13:00:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2679 2023-07-14T13:00:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2680 2023-07-14T13:00:09.149 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2681 2023-07-14T13:00:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2682 2023-07-14T13:00:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2683 2023-07-14T13:00:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2684 2023-07-14T13:00:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2685 2023-07-14T13:00:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2686 2023-07-14T13:00:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2687 2023-07-14T13:00:09.150 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 13:00 2688 2023-07-14T13:00:09.151 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 13:00 2689 2023-07-14T13:00:09.151 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 13:00 2690 2023-07-14T13:00:09.151 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 14 13:00 2691 2023-07-14T13:00:09.151 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2692 2023-07-14T13:00:09.151 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2693 2023-07-14T13:00:09.151 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2696 2023-07-14T13:00:09.151 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2699 2023-07-14T13:00:09.151 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2701 2023-07-14T13:00:09.152 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2702 2023-07-14T13:00:09.152 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2703 2023-07-14T13:00:09.152 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 13:00 2704 2023-07-14T13:00:09.152 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2753 2023-07-14T13:00:09.152 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2753_fsm 2023-07-14T13:00:09.152 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2753_vm 2023-07-14T13:00:09.152 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2754 2023-07-14T13:00:09.152 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2755 2023-07-14T13:00:09.153 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 13:00 2756 2023-07-14T13:00:09.153 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2757 2023-07-14T13:00:09.153 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2830 2023-07-14T13:00:09.153 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2830_vm 2023-07-14T13:00:09.153 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2831 2023-07-14T13:00:09.153 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2832 2023-07-14T13:00:09.153 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2832_vm 2023-07-14T13:00:09.153 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2833 2023-07-14T13:00:09.154 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2834 2023-07-14T13:00:09.154 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2834_vm 2023-07-14T13:00:09.154 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2835 2023-07-14T13:00:09.154 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2836 2023-07-14T13:00:09.154 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2836_vm 2023-07-14T13:00:09.154 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2837 2023-07-14T13:00:09.154 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 14 13:00 2838 2023-07-14T13:00:09.154 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2838_fsm 2023-07-14T13:00:09.155 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2838_vm 2023-07-14T13:00:09.155 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2839 2023-07-14T13:00:09.155 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2840 2023-07-14T13:00:09.155 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2840_fsm 2023-07-14T13:00:09.155 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2840_vm 2023-07-14T13:00:09.155 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2841 2023-07-14T13:00:09.155 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2995 2023-07-14T13:00:09.155 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2995_vm 2023-07-14T13:00:09.156 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2996 2023-07-14T13:00:09.156 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3079 2023-07-14T13:00:09.156 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3079_fsm 2023-07-14T13:00:09.156 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3079_vm 2023-07-14T13:00:09.156 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3080 2023-07-14T13:00:09.156 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3081 2023-07-14T13:00:09.156 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3085 2023-07-14T13:00:09.157 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3118 2023-07-14T13:00:09.157 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3118_vm 2023-07-14T13:00:09.157 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3119 2023-07-14T13:00:09.157 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3164 2023-07-14T13:00:09.157 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3256 2023-07-14T13:00:09.157 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3256_vm 2023-07-14T13:00:09.157 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3257 2023-07-14T13:00:09.157 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3258 2023-07-14T13:00:09.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3350 2023-07-14T13:00:09.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3350_vm 2023-07-14T13:00:09.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3351 2023-07-14T13:00:09.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3379 2023-07-14T13:00:09.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3380 2023-07-14T13:00:09.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3381 2023-07-14T13:00:09.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3381_vm 2023-07-14T13:00:09.158 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3394 2023-07-14T13:00:09.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3394_fsm 2023-07-14T13:00:09.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3394_vm 2023-07-14T13:00:09.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3395 2023-07-14T13:00:09.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3439 2023-07-14T13:00:09.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3439_vm 2023-07-14T13:00:09.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3440 2023-07-14T13:00:09.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 13:00 3455 2023-07-14T13:00:09.159 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3456 2023-07-14T13:00:09.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3456_fsm 2023-07-14T13:00:09.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3456_vm 2023-07-14T13:00:09.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3466 2023-07-14T13:00:09.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3466_vm 2023-07-14T13:00:09.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3467 2023-07-14T13:00:09.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3468 2023-07-14T13:00:09.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3501 2023-07-14T13:00:09.160 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3501_vm 2023-07-14T13:00:09.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3502 2023-07-14T13:00:09.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3503 2023-07-14T13:00:09.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3534 2023-07-14T13:00:09.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3541 2023-07-14T13:00:09.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3541_fsm 2023-07-14T13:00:09.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3541_vm 2023-07-14T13:00:09.161 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3542 2023-07-14T13:00:09.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3574 2023-07-14T13:00:09.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3575 2023-07-14T13:00:09.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3576 2023-07-14T13:00:09.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3576_vm 2023-07-14T13:00:09.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3596 2023-07-14T13:00:09.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3596_vm 2023-07-14T13:00:09.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3597 2023-07-14T13:00:09.162 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3598 2023-07-14T13:00:09.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3598_vm 2023-07-14T13:00:09.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3599 2023-07-14T13:00:09.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3600 2023-07-14T13:00:09.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3600_fsm 2023-07-14T13:00:09.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3600_vm 2023-07-14T13:00:09.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3601 2023-07-14T13:00:09.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3601_fsm 2023-07-14T13:00:09.163 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3601_vm 2023-07-14T13:00:09.164 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3602 2023-07-14T13:00:09.217 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3602_fsm 2023-07-14T13:00:09.217 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3602_vm 2023-07-14T13:00:09.218 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3603 2023-07-14T13:00:09.218 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3603_fsm 2023-07-14T13:00:09.218 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3603_vm 2023-07-14T13:00:09.218 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3604 2023-07-14T13:00:09.218 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3605 2023-07-14T13:00:09.219 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3606 2023-07-14T13:00:09.219 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3607 2023-07-14T13:00:09.219 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3608 2023-07-14T13:00:09.219 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 13:00 3609 2023-07-14T13:00:09.219 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3712 2023-07-14T13:00:09.219 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3764 2023-07-14T13:00:09.219 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3764_fsm 2023-07-14T13:00:09.220 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3764_vm 2023-07-14T13:00:09.220 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3766 2023-07-14T13:00:09.220 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3767 2023-07-14T13:00:09.220 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3997 2023-07-14T13:00:09.220 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 5002 2023-07-14T13:00:09.220 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 548 2023-07-14T13:00:09.220 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 549 2023-07-14T13:00:09.221 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6102 2023-07-14T13:00:09.221 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6102_vm 2023-07-14T13:00:09.221 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6104 2023-07-14T13:00:09.221 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6104_vm 2023-07-14T13:00:09.221 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6106 2023-07-14T13:00:09.221 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6106_vm 2023-07-14T13:00:09.221 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 6110 2023-07-14T13:00:09.221 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 6111 2023-07-14T13:00:09.222 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 6112 2023-07-14T13:00:09.222 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6113 2023-07-14T13:00:09.222 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 6117 2023-07-14T13:00:09.222 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 826 2023-07-14T13:00:09.222 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 826_vm 2023-07-14T13:00:09.222 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 827 2023-07-14T13:00:09.222 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 828 2023-07-14T13:00:09.222 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 14 13:00 pg_filenode.map 2023-07-14T13:00:09.223 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 14 13:00 PG_VERSION 2023-07-14T13:00:09.223 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.223 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/global: 2023-07-14T13:00:09.223 INFO:teuthology.orchestra.run.smithi017.stdout:total 554 2023-07-14T13:00:09.223 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Jul 14 12:59 . 2023-07-14T13:00:09.223 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.223 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1136 2023-07-14T13:00:09.224 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1136_fsm 2023-07-14T13:00:09.224 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1136_vm 2023-07-14T13:00:09.224 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 1137 2023-07-14T13:00:09.224 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1213 2023-07-14T13:00:09.224 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1213_fsm 2023-07-14T13:00:09.224 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1213_vm 2023-07-14T13:00:09.224 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1214 2023-07-14T13:00:09.225 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1214_fsm 2023-07-14T13:00:09.225 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1214_vm 2023-07-14T13:00:09.225 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 1232 2023-07-14T13:00:09.225 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 1233 2023-07-14T13:00:09.225 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1260 2023-07-14T13:00:09.225 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1260_fsm 2023-07-14T13:00:09.225 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1260_vm 2023-07-14T13:00:09.225 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1261 2023-07-14T13:00:09.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1261_fsm 2023-07-14T13:00:09.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1261_vm 2023-07-14T13:00:09.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 1262 2023-07-14T13:00:09.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1262_fsm 2023-07-14T13:00:09.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1262_vm 2023-07-14T13:00:09.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2396 2023-07-14T13:00:09.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2396_fsm 2023-07-14T13:00:09.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2396_vm 2023-07-14T13:00:09.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2397 2023-07-14T13:00:09.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2671 2023-07-14T13:00:09.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2672 2023-07-14T13:00:09.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2676 2023-07-14T13:00:09.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2677 2023-07-14T13:00:09.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2694 2023-07-14T13:00:09.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2695 2023-07-14T13:00:09.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2697 2023-07-14T13:00:09.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2698 2023-07-14T13:00:09.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2846 2023-07-14T13:00:09.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2846_vm 2023-07-14T13:00:09.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2847 2023-07-14T13:00:09.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2964 2023-07-14T13:00:09.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2964_vm 2023-07-14T13:00:09.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2965 2023-07-14T13:00:09.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2966 2023-07-14T13:00:09.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2966_vm 2023-07-14T13:00:09.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2967 2023-07-14T13:00:09.230 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3592 2023-07-14T13:00:09.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:08 smithi131 ceph-mon[96953]: pgmap v15: 97 pgs: 97 active+clean; 47 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 3.5 MiB/s wr, 266 op/s 2023-07-14T13:00:09.284 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:08 smithi135 ceph-mon[97338]: pgmap v15: 97 pgs: 97 active+clean; 47 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 3.5 MiB/s wr, 266 op/s 2023-07-14T13:00:09.285 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3592_vm 2023-07-14T13:00:09.285 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3593 2023-07-14T13:00:09.285 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 4060 2023-07-14T13:00:09.285 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 4060_vm 2023-07-14T13:00:09.286 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 4061 2023-07-14T13:00:09.286 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6000 2023-07-14T13:00:09.286 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6000_vm 2023-07-14T13:00:09.286 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6001 2023-07-14T13:00:09.286 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6002 2023-07-14T13:00:09.286 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6100 2023-07-14T13:00:09.287 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6100_vm 2023-07-14T13:00:09.287 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6114 2023-07-14T13:00:09.287 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6115 2023-07-14T13:00:09.287 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 pg_control 2023-07-14T13:00:09.287 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 14 12:59 pg_filenode.map 2023-07-14T13:00:09.287 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.288 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/log: 2023-07-14T13:00:09.288 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.288 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 . 2023-07-14T13:00:09.288 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.288 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.288 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-07-14T13:00:09.288 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.289 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.289 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.289 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.289 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-07-14T13:00:09.289 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.289 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.289 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.290 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.290 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-07-14T13:00:09.290 INFO:teuthology.orchestra.run.smithi017.stdout:total 3 2023-07-14T13:00:09.290 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 14 13:00 . 2023-07-14T13:00:09.290 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.290 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 mappings 2023-07-14T13:00:09.290 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 14 13:00 replorigin_checkpoint 2023-07-14T13:00:09.290 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 snapshots 2023-07-14T13:00:09.291 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.291 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-07-14T13:00:09.291 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.291 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.291 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 14 13:00 .. 2023-07-14T13:00:09.291 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.291 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-07-14T13:00:09.292 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.292 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.292 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 14 13:00 .. 2023-07-14T13:00:09.292 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.292 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-07-14T13:00:09.292 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-07-14T13:00:09.293 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 . 2023-07-14T13:00:09.293 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.293 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 members 2023-07-14T13:00:09.293 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 offsets 2023-07-14T13:00:09.293 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.293 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-07-14T13:00:09.293 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-07-14T13:00:09.294 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 . 2023-07-14T13:00:09.294 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 .. 2023-07-14T13:00:09.294 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 0000 2023-07-14T13:00:09.294 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.294 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-07-14T13:00:09.294 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-07-14T13:00:09.294 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 . 2023-07-14T13:00:09.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:08 smithi017 ceph-mon[95536]: pgmap v15: 97 pgs: 97 active+clean; 47 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 3.5 MiB/s wr, 266 op/s 2023-07-14T13:00:09.359 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 .. 2023-07-14T13:00:09.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 0000 2023-07-14T13:00:09.360 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.360 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-07-14T13:00:09.360 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-07-14T13:00:09.360 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 . 2023-07-14T13:00:09.360 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 0000 2023-07-14T13:00:09.361 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.361 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-07-14T13:00:09.361 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.361 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.361 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.361 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.361 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-07-14T13:00:09.362 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.362 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.362 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.362 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.362 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-07-14T13:00:09.362 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.362 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.362 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.363 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.363 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-07-14T13:00:09.363 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.363 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.363 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.363 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.363 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-07-14T13:00:09.364 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.364 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.364 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.364 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.364 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-07-14T13:00:09.364 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-07-14T13:00:09.365 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 . 2023-07-14T13:00:09.365 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 0000 2023-07-14T13:00:09.365 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.365 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-07-14T13:00:09.365 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.365 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.366 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.366 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.366 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-07-14T13:00:09.366 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.366 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.366 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.366 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.367 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-07-14T13:00:09.367 INFO:teuthology.orchestra.run.smithi017.stdout:total 16386 2023-07-14T13:00:09.367 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 12:59 . 2023-07-14T13:00:09.367 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:00 000000010000000000000001 2023-07-14T13:00:09.367 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 archive_status 2023-07-14T13:00:09.367 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.367 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-07-14T13:00:09.368 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:00:09.368 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:00:09.368 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 12:59 .. 2023-07-14T13:00:09.368 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:09.368 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-07-14T13:00:09.368 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-07-14T13:00:09.368 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 . 2023-07-14T13:00:09.369 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39508298 Jul 14 13:00 .. 2023-07-14T13:00:09.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 0000 2023-07-14T13:00:09.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-07-14T13:00:09.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 500 -i' 2023-07-14T13:00:09.880 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:00:09.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:00:09.905 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-07-14T13:00:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-07-14T13:00:09.965 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-07-14T13:00:09.972 INFO:teuthology.orchestra.run.smithi017.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-07-14T13:00:10.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.079+0000 7f5ba59ff700 1 -- 172.21.15.17:0/4126374206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba0105ae0 msgr2=0x7f5ba0105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.079+0000 7f5ba59ff700 1 --2- 172.21.15.17:0/4126374206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba0105ae0 0x7f5ba0105eb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009990 tx=0x7f5b90009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.079+0000 7f5ba59ff700 1 -- 172.21.15.17:0/4126374206 shutdown_connections 2023-07-14T13:00:10.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.079+0000 7f5ba59ff700 1 --2- 172.21.15.17:0/4126374206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0100480 0x7f5ba010c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.079+0000 7f5ba59ff700 1 --2- 172.21.15.17:0/4126374206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba0105ae0 0x7f5ba0105eb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.079+0000 7f5ba59ff700 1 --2- 172.21.15.17:0/4126374206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ba00ffad0 0x7f5ba00fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.079+0000 7f5ba59ff700 1 -- 172.21.15.17:0/4126374206 >> 172.21.15.17:0/4126374206 conn(0x7f5ba00fb5f0 msgr2=0x7f5ba00fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.080+0000 7f5ba59ff700 1 -- 172.21.15.17:0/4126374206 shutdown_connections 2023-07-14T13:00:10.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.080+0000 7f5ba59ff700 1 -- 172.21.15.17:0/4126374206 wait complete. 2023-07-14T13:00:10.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.081+0000 7f5ba59ff700 1 Processor -- start 2023-07-14T13:00:10.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.081+0000 7f5ba59ff700 1 -- start start 2023-07-14T13:00:10.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.081+0000 7f5ba59ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00ffad0 0x7f5ba0197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5ba59ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ba0100480 0x7f5ba0198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5ba59ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0105ae0 0x7f5ba019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5ba59ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba019cdb0 con 0x7f5ba00ffad0 2023-07-14T13:00:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5ba59ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba019cf20 con 0x7f5ba0105ae0 2023-07-14T13:00:10.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5ba59ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba019d0e0 con 0x7f5ba0100480 2023-07-14T13:00:10.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00ffad0 0x7f5ba0197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00ffad0 0x7f5ba0197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36908/0 (socket says 172.21.15.17:36908) 2023-07-14T13:00:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9effd700 1 -- 172.21.15.17:0/857883473 learned_addr learned my addr 172.21.15.17:0/857883473 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0105ae0 0x7f5ba019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ba0100480 0x7f5ba0198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9effd700 1 -- 172.21.15.17:0/857883473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ba0100480 msgr2=0x7f5ba0198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9effd700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ba0100480 0x7f5ba0198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9effd700 1 -- 172.21.15.17:0/857883473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0105ae0 msgr2=0x7f5ba019c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9effd700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0105ae0 0x7f5ba019c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9effd700 1 -- 172.21.15.17:0/857883473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98009c40 con 0x7f5ba00ffad0 2023-07-14T13:00:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0105ae0 0x7f5ba019c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.082+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ba0100480 0x7f5ba0198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.083+0000 7f5b9effd700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00ffad0 0x7f5ba0197dd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5b90000c00 tx=0x7f5b90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.083+0000 7f5ba49fd700 1 -- 172.21.15.17:0/857883473 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9001d070 con 0x7f5ba00ffad0 2023-07-14T13:00:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.083+0000 7f5ba49fd700 1 -- 172.21.15.17:0/857883473 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b90022470 con 0x7f5ba00ffad0 2023-07-14T13:00:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.083+0000 7f5ba59ff700 1 -- 172.21.15.17:0/857883473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b900095f0 con 0x7f5ba00ffad0 2023-07-14T13:00:10.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.083+0000 7f5ba49fd700 1 -- 172.21.15.17:0/857883473 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90017650 con 0x7f5ba00ffad0 2023-07-14T13:00:10.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.083+0000 7f5ba59ff700 1 -- 172.21.15.17:0/857883473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba019d5f0 con 0x7f5ba00ffad0 2023-07-14T13:00:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.089+0000 7f5ba49fd700 1 -- 172.21.15.17:0/857883473 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f5b900225e0 con 0x7f5ba00ffad0 2023-07-14T13:00:10.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.089+0000 7f5bb92e0b80 1 Processor -- start 2023-07-14T13:00:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.089+0000 7f5bb92e0b80 1 -- start start 2023-07-14T13:00:10.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.090+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c51350 0x562e43c51720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.090+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 0x562e43c5c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.090+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 0x562e43c5ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.090+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43b57d30 con 0x562e43c5cb50 2023-07-14T13:00:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.090+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43baaac0 con 0x562e43c51350 2023-07-14T13:00:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.090+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43ba3f50 con 0x562e43c51c60 2023-07-14T13:00:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.090+0000 7f5b9e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 0x562e43c5ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.090+0000 7f5b9e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 0x562e43c5ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36910/0 (socket says 172.21.15.17:36910) 2023-07-14T13:00:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.090+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/974825250 learned_addr learned my addr 172.21.15.17:0/974825250 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:10.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.090+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/974825250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c51350 0x562e43c51720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.090+0000 7f5b9effd700 1 --2- 172.21.15.17:0/974825250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 0x562e43c5c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/974825250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 msgr2=0x562e43c5c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/974825250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 0x562e43c5c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/974825250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c51350 msgr2=0x562e43c51720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/974825250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c51350 0x562e43c51720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/974825250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e439d1e60 con 0x562e43c5cb50 2023-07-14T13:00:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5ba49fd700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5b880a13e0 0x7f5b880a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/974825250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 0x562e43c5ef30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5b940115f0 tx=0x7f5b94011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15e0e3046755c96 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5ba49fd700 1 -- 172.21.15.17:0/857883473 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5b900ce1e0 con 0x7f5ba00ffad0 2023-07-14T13:00:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5b85ffb700 1 -- 172.21.15.17:0/974825250 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94004030 con 0x562e43c5cb50 2023-07-14T13:00:10.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5b880a13e0 0x7f5b880a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5b85ffb700 1 -- 172.21.15.17:0/974825250 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b94003680 con 0x562e43c5cb50 2023-07-14T13:00:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.091+0000 7f5b85ffb700 1 -- 172.21.15.17:0/974825250 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94019620 con 0x562e43c5cb50 2023-07-14T13:00:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.092+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/974825250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 msgr2=0x562e43c5ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.092+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5b880a13e0 0x7f5b880a3890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b98009fd0 tx=0x7f5b9800b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.092+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/974825250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 0x562e43c5ef30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5b940115f0 tx=0x7f5b94011900 comp rx=0 tx=0).stop 2023-07-14T13:00:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.092+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/974825250 shutdown_connections 2023-07-14T13:00:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.092+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/974825250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 0x562e43c5ef30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.092+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/974825250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c51350 0x562e43c51720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.092+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/974825250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 0x562e43c5c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.092+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/974825250 >> 172.21.15.17:0/974825250 conn(0x562e43c47e20 msgr2=0x562e43c4d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.092+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/974825250 shutdown_connections 2023-07-14T13:00:10.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.093+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/974825250 wait complete. 2023-07-14T13:00:10.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.093+0000 7f5bb92e0b80 1 -- start start 2023-07-14T13:00:10.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.093+0000 7f5bb92e0b80 1 Processor -- start 2023-07-14T13:00:10.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51350 0x562e43c5c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c597b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 0x562e43c59ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43b43b40 con 0x562e43c51c60 2023-07-14T13:00:10.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43b43840 con 0x562e43c5cb50 2023-07-14T13:00:10.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43a279a0 con 0x562e43c51350 2023-07-14T13:00:10.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5bb92e0b80 10 client.0 _ll_register_callbacks cb 0x562e43b417e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:10.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5b9e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5b9f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 0x562e43c59ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5b9f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 0x562e43c59ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36078/0 (socket says 172.21.15.17:36078) 2023-07-14T13:00:10.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5b9e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36914/0 (socket says 172.21.15.17:36914) 2023-07-14T13:00:10.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5b9f7fe700 1 -- 172.21.15.17:0/3289148889 learned_addr learned my addr 172.21.15.17:0/3289148889 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:10.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.094+0000 7f5b9effd700 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51350 0x562e43c5c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.095+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/3289148889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51350 msgr2=0x562e43c5c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.095+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51350 0x562e43c5c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.095+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/3289148889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 msgr2=0x562e43c59ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.095+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 0x562e43c59ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.095+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/3289148889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b94009d50 con 0x562e43c51c60 2023-07-14T13:00:10.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.095+0000 7f5b9effd700 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51350 0x562e43c5c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:10.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.095+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c597b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400a010 tx=0x7f5b940042b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122097f3eb2e1cc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.095+0000 7f5b7effd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:10.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.095+0000 7f5b7effd700 1 -- 172.21.15.17:0/3289148889 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94004590 con 0x562e43c51c60 2023-07-14T13:00:10.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.095+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3289148889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e43afd570 con 0x562e43c51c60 2023-07-14T13:00:10.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.095+0000 7f5b7effd700 1 -- 172.21.15.17:0/3289148889 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5b94005ce0 con 0x562e43c51c60 2023-07-14T13:00:10.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.096+0000 7f5b7effd700 1 -- 172.21.15.17:0/3289148889 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b94005250 con 0x562e43c51c60 2023-07-14T13:00:10.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.096+0000 7f5bb92e0b80 10 client.15765 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:10.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.096+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3289148889 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x562e439bace0 con 0x562e43c51c60 2023-07-14T13:00:10.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.096+0000 7f5b7effd700 1 -- 172.21.15.17:0/3289148889 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562e43afd570 con 0x562e43c51c60 2023-07-14T13:00:10.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.096+0000 7f5b7effd700 1 -- 172.21.15.17:0/3289148889 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5b94021040 con 0x562e43c51c60 2023-07-14T13:00:10.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.096+0000 7f5bb92e0b80 10 client.15765 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:10.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.096+0000 7f5bb92e0b80 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:10.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.096+0000 7f5bb92e0b80 20 client.15765 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:10.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.096+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e43c6c340 0x562e43c6e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.096+0000 7f5bb92e0b80 4 client.15765 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:10.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.096+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3289148889 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e43b9cf30 con 0x562e43c6c340 2023-07-14T13:00:10.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.097+0000 7f5b9effd700 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e43c6c340 0x562e43c6e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.097+0000 7f5b7effd700 10 client.15765 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:10.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.097+0000 7f5b9effd700 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e43c6c340 0x562e43c6e750 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df0fb751855d6900 server_cookie=68f5d0a520d4729a in_seq=0 out_seq=0 2023-07-14T13:00:10.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.098+0000 7f5b7effd700 1 -- 172.21.15.17:0/3289148889 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562e43b9cf30 con 0x562e43c6c340 2023-07-14T13:00:10.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.098+0000 7f5b7effd700 10 client.15765 handle_command_reply: tid=0 2023-07-14T13:00:10.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.098+0000 7f5bb92e0b80 1 client.15765 shutdown 2023-07-14T13:00:10.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.098+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3289148889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 msgr2=0x562e43c597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.098+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c597b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400a010 tx=0x7f5b940042b0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.099+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3289148889 shutdown_connections 2023-07-14T13:00:10.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.099+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e43c6c340 0x562e43c6e750 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.099+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 0x562e43c59ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.099+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51350 0x562e43c5c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.099+0000 7f5b7effd700 0 client.15765 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:10.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.099+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/3289148889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c597b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.099+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3289148889 >> 172.21.15.17:0/3289148889 conn(0x562e43c47e20 msgr2=0x562e43c4d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.099+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3289148889 shutdown_connections 2023-07-14T13:00:10.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.099+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3289148889 wait complete. 2023-07-14T13:00:10.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.099+0000 7f5bb92e0b80 20 client.15765 trim_cache size 0 max 16384 2023-07-14T13:00:10.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.117+0000 7f5bb92e0b80 1 Processor -- start 2023-07-14T13:00:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.117+0000 7f5bb92e0b80 1 -- start start 2023-07-14T13:00:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.117+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51350 0x562e43c53b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.117+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c5df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.117+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 0x562e43c5e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.117+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43c49f70 con 0x562e43c51c60 2023-07-14T13:00:10.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.117+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43c525f0 con 0x562e43c5cb50 2023-07-14T13:00:10.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.117+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43c5a570 con 0x562e43c51350 2023-07-14T13:00:10.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c5df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c5df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36924/0 (socket says 172.21.15.17:36924) 2023-07-14T13:00:10.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/3192553671 learned_addr learned my addr 172.21.15.17:0/3192553671 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:10.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/3192553671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 0x562e43c5e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9effd700 1 --2- 172.21.15.17:0/3192553671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51350 0x562e43c53b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/3192553671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51350 msgr2=0x562e43c53b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/3192553671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51350 0x562e43c53b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/3192553671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 msgr2=0x562e43c5e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/3192553671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 0x562e43c5e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/3192553671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e43c49660 con 0x562e43c51c60 2023-07-14T13:00:10.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/3192553671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 0x562e43c5e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:10.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/3192553671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c5df30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5b94004f10 tx=0x7f5b94011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9005c0b49534ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.118+0000 7f5b867fc700 1 -- 172.21.15.17:0/3192553671 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94003e80 con 0x562e43c51c60 2023-07-14T13:00:10.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.119+0000 7f5b867fc700 1 -- 172.21.15.17:0/3192553671 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b94023600 con 0x562e43c51c60 2023-07-14T13:00:10.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.119+0000 7f5b867fc700 1 -- 172.21.15.17:0/3192553671 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94023d90 con 0x562e43c51c60 2023-07-14T13:00:10.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.119+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3192553671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 msgr2=0x562e43c5df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.119+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/3192553671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c5df30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5b94004f10 tx=0x7f5b94011900 comp rx=0 tx=0).stop 2023-07-14T13:00:10.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.119+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3192553671 shutdown_connections 2023-07-14T13:00:10.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.119+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/3192553671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c5cb50 0x562e43c5e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.119+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/3192553671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51350 0x562e43c53b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.119+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/3192553671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c51c60 0x562e43c5df30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.119+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3192553671 >> 172.21.15.17:0/3192553671 conn(0x562e43c47e20 msgr2=0x562e43c53460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.119+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3192553671 shutdown_connections 2023-07-14T13:00:10.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.120+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/3192553671 wait complete. 2023-07-14T13:00:10.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.120+0000 7f5bb92e0b80 1 -- start start 2023-07-14T13:00:10.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.120+0000 7f5bb92e0b80 1 Processor -- start 2023-07-14T13:00:10.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.120+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c51350 0x562e43c5ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.120+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 0x562e43c604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5bb92e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 0x562e43cc0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43c60d60 con 0x562e43c5cb50 2023-07-14T13:00:10.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43cc0760 con 0x562e43c51350 2023-07-14T13:00:10.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5bb92e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e43cc08a0 con 0x562e43c51c60 2023-07-14T13:00:10.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5bb92e0b80 10 client.0 _ll_register_callbacks cb 0x7f5b900d1b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:10.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5b9e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 0x562e43c604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5b9f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 0x562e43cc0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5b9e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 0x562e43c604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:53644/0 (socket says 172.21.15.17:53644) 2023-07-14T13:00:10.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/2567408056 learned_addr learned my addr 172.21.15.17:0/2567408056 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:10.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5b9effd700 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c51350 0x562e43c5ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/2567408056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c51350 msgr2=0x562e43c5ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c51350 0x562e43c5ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/2567408056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 msgr2=0x562e43cc0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 0x562e43cc0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5b9e7fc700 1 -- 172.21.15.17:0/2567408056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e439bace0 con 0x562e43c51c60 2023-07-14T13:00:10.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.121+0000 7f5b9f7fe700 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 0x562e43cc0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:10.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.122+0000 7f5b9e7fc700 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 0x562e43c604e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009fb0 tx=0x7f5b94024cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d944bdf2fb20f92 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.122+0000 7f5b7effd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:00:10.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.122+0000 7f5b7effd700 1 -- 172.21.15.17:0/2567408056 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94043070 con 0x562e43c51c60 2023-07-14T13:00:10.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.122+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/2567408056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b94003680 con 0x562e43c51c60 2023-07-14T13:00:10.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.122+0000 7f5b7effd700 1 -- 172.21.15.17:0/2567408056 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5b94000e40 con 0x562e43c51c60 2023-07-14T13:00:10.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.122+0000 7f5b7effd700 1 -- 172.21.15.17:0/2567408056 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b94003e80 con 0x562e43c51c60 2023-07-14T13:00:10.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.122+0000 7f5bb92e0b80 10 client.25513 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:10.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.122+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/2567408056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x562e439f82d0 con 0x562e43c51c60 2023-07-14T13:00:10.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.123+0000 7f5b7effd700 1 -- 172.21.15.17:0/2567408056 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b94003680 con 0x562e43c51c60 2023-07-14T13:00:10.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.123+0000 7f5b7effd700 1 -- 172.21.15.17:0/2567408056 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5b94046030 con 0x562e43c51c60 2023-07-14T13:00:10.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.123+0000 7f5bb92e0b80 10 client.25513 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:10.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.123+0000 7f5bb92e0b80 10 client.25513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:10.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.123+0000 7f5bb92e0b80 20 client.25513 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:10.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.123+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e43cc1b10 0x562e43cc3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.123+0000 7f5bb92e0b80 4 client.25513 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:00:10.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.123+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/2567408056 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562e43b5f0d0 con 0x562e43cc1b10 2023-07-14T13:00:10.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.123+0000 7f5b9effd700 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e43cc1b10 0x562e43cc3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.124+0000 7f5b9effd700 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e43cc1b10 0x562e43cc3ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e748b40c0f29eed8 server_cookie=e799e19f30f354a9 in_seq=0 out_seq=0 2023-07-14T13:00:10.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.124+0000 7f5b7effd700 10 client.25513 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:10.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5b7effd700 1 -- 172.21.15.17:0/2567408056 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562e43b5f0d0 con 0x562e43cc1b10 2023-07-14T13:00:10.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5b7effd700 10 client.25513 handle_command_reply: tid=0 2023-07-14T13:00:10.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5bb92e0b80 1 client.25513 shutdown 2023-07-14T13:00:10.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/2567408056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 msgr2=0x562e43c604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 0x562e43c604e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009fb0 tx=0x7f5b94024cc0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/2567408056 shutdown_connections 2023-07-14T13:00:10.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e43cc1b10 0x562e43cc3ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e43c5cb50 0x562e43cc0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e43c51350 0x562e43c5ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5b7effd700 0 client.25513 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:10.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5bb92e0b80 1 --2- 172.21.15.17:0/2567408056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e43c51c60 0x562e43c604e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/2567408056 >> 172.21.15.17:0/2567408056 conn(0x562e43c47e20 msgr2=0x562e43c53cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/2567408056 shutdown_connections 2023-07-14T13:00:10.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.125+0000 7f5bb92e0b80 1 -- 172.21.15.17:0/2567408056 wait complete. 2023-07-14T13:00:10.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5bb92e0b80 20 client.25513 trim_cache size 0 max 16384 2023-07-14T13:00:10.166 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:00:10.166 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:00:10.166 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "248e08f9-108f-44d3-9c54-860ed0f7b931", 2023-07-14T13:00:10.166 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:00:10.166 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:00:10.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5ba59ff700 1 -- 172.21.15.17:0/857883473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5b880a13e0 msgr2=0x7f5b880a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5ba59ff700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5b880a13e0 0x7f5b880a3890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b98009fd0 tx=0x7f5b9800b040 comp rx=0 tx=0).stop 2023-07-14T13:00:10.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5ba59ff700 1 -- 172.21.15.17:0/857883473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00ffad0 msgr2=0x7f5ba0197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5ba59ff700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00ffad0 0x7f5ba0197dd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5b90000c00 tx=0x7f5b90004730 comp rx=0 tx=0).stop 2023-07-14T13:00:10.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5ba59ff700 1 -- 172.21.15.17:0/857883473 shutdown_connections 2023-07-14T13:00:10.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5ba59ff700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5b880a13e0 0x7f5b880a3890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5ba59ff700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0105ae0 0x7f5ba019c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5ba59ff700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00ffad0 0x7f5ba0197dd0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5ba59ff700 1 --2- 172.21.15.17:0/857883473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ba0100480 0x7f5ba0198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5ba59ff700 1 -- 172.21.15.17:0/857883473 >> 172.21.15.17:0/857883473 conn(0x7f5ba00fb5f0 msgr2=0x7f5ba010ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.126+0000 7f5ba59ff700 1 -- 172.21.15.17:0/857883473 shutdown_connections 2023-07-14T13:00:10.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.127+0000 7f5ba59ff700 1 -- 172.21.15.17:0/857883473 wait complete. 2023-07-14T13:00:10.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:00:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:creating tables... 2023-07-14T13:00:10.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.427+0000 7f358c5ff700 1 -- 172.21.15.17:0/974933164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840fe880 msgr2=0x7f35840fec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.427+0000 7f358c5ff700 1 --2- 172.21.15.17:0/974933164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840fe880 0x7f35840fec50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3580009990 tx=0x7f3580009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.428+0000 7f358c5ff700 1 -- 172.21.15.17:0/974933164 shutdown_connections 2023-07-14T13:00:10.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.428+0000 7f358c5ff700 1 --2- 172.21.15.17:0/974933164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f358410c430 0x7f358410e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.428+0000 7f358c5ff700 1 --2- 172.21.15.17:0/974933164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840fe880 0x7f35840fec50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.428+0000 7f358c5ff700 1 --2- 172.21.15.17:0/974933164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35840ff190 0x7f358410bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.428+0000 7f358c5ff700 1 -- 172.21.15.17:0/974933164 >> 172.21.15.17:0/974933164 conn(0x7f35840fa4b0 msgr2=0x7f35840fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.428+0000 7f358c5ff700 1 -- 172.21.15.17:0/974933164 shutdown_connections 2023-07-14T13:00:10.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.428+0000 7f358c5ff700 1 -- 172.21.15.17:0/974933164 wait complete. 2023-07-14T13:00:10.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.429+0000 7f358c5ff700 1 Processor -- start 2023-07-14T13:00:10.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.429+0000 7f358c5ff700 1 -- start start 2023-07-14T13:00:10.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.429+0000 7f358c5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840fe880 0x7f3584197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.429+0000 7f358c5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35840ff190 0x7f35841982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.429+0000 7f358c5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358410c430 0x7f358419c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.429+0000 7f358c5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358419cd70 con 0x7f35840fe880 2023-07-14T13:00:10.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.429+0000 7f358c5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358419cee0 con 0x7f35840ff190 2023-07-14T13:00:10.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.429+0000 7f358c5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358419d0a0 con 0x7f358410c430 2023-07-14T13:00:10.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.430+0000 7f358a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840fe880 0x7f3584197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.430+0000 7f358a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840fe880 0x7f3584197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36954/0 (socket says 172.21.15.17:36954) 2023-07-14T13:00:10.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.430+0000 7f358a39b700 1 -- 172.21.15.17:0/2509900163 learned_addr learned my addr 172.21.15.17:0/2509900163 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:10.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.430+0000 7f358ab9c700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358410c430 0x7f358419c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.430+0000 7f3589b9a700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35840ff190 0x7f35841982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.430+0000 7f358a39b700 1 -- 172.21.15.17:0/2509900163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358410c430 msgr2=0x7f358419c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.430+0000 7f358a39b700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358410c430 0x7f358419c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.430+0000 7f358a39b700 1 -- 172.21.15.17:0/2509900163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35840ff190 msgr2=0x7f35841982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.430+0000 7f358a39b700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35840ff190 0x7f35841982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.430+0000 7f358a39b700 1 -- 172.21.15.17:0/2509900163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35800095f0 con 0x7f35840fe880 2023-07-14T13:00:10.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.430+0000 7f358a39b700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840fe880 0x7f3584197d90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3580005740 tx=0x7f3580005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.431+0000 7f357b7fe700 1 -- 172.21.15.17:0/2509900163 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358001d070 con 0x7f35840fe880 2023-07-14T13:00:10.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.431+0000 7f358c5ff700 1 -- 172.21.15.17:0/2509900163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358419d320 con 0x7f35840fe880 2023-07-14T13:00:10.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.431+0000 7f357b7fe700 1 -- 172.21.15.17:0/2509900163 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3580022470 con 0x7f35840fe880 2023-07-14T13:00:10.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.431+0000 7f357b7fe700 1 -- 172.21.15.17:0/2509900163 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580017650 con 0x7f35840fe880 2023-07-14T13:00:10.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.431+0000 7f358c5ff700 1 -- 172.21.15.17:0/2509900163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35841a4bc0 con 0x7f35840fe880 2023-07-14T13:00:10.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.434+0000 7f357b7fe700 1 -- 172.21.15.17:0/2509900163 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f35800225e0 con 0x7f35840fe880 2023-07-14T13:00:10.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.436+0000 7f359ff3eb80 1 Processor -- start 2023-07-14T13:00:10.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.436+0000 7f359ff3eb80 1 -- start start 2023-07-14T13:00:10.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.436+0000 7f357b7fe700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35700a1460 0x7f35700a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.436+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d92d0 0x55d77e0d96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.436+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 0x55d77e0e4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.436+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.436+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77dfdfcb0 con 0x55d77e0e4ad0 2023-07-14T13:00:10.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.436+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77e032a40 con 0x55d77e0d92d0 2023-07-14T13:00:10.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.436+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77e02bed0 con 0x55d77e0d9be0 2023-07-14T13:00:10.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.436+0000 7f357b7fe700 1 -- 172.21.15.17:0/2509900163 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f35800ce250 con 0x7f35840fe880 2023-07-14T13:00:10.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.437+0000 7f358ab9c700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35700a1460 0x7f35700a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.437+0000 7f358ab9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.437+0000 7f358a39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d92d0 0x55d77e0d96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.437+0000 7f358ab9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36956/0 (socket says 172.21.15.17:36956) 2023-07-14T13:00:10.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.437+0000 7f358ab9c700 1 -- 172.21.15.17:0/2896132912 learned_addr learned my addr 172.21.15.17:0/2896132912 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:10.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.437+0000 7f358a39b700 1 -- 172.21.15.17:0/2896132912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 msgr2=0x55d77e0e4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.437+0000 7f358a39b700 1 --2- 172.21.15.17:0/2896132912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 0x55d77e0e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.437+0000 7f358a39b700 1 -- 172.21.15.17:0/2896132912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 msgr2=0x55d77e0e6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.437+0000 7f358a39b700 1 --2- 172.21.15.17:0/2896132912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.437+0000 7f358a39b700 1 -- 172.21.15.17:0/2896132912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d77de59de0 con 0x55d77e0d92d0 2023-07-14T13:00:10.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.437+0000 7f358ab9c700 1 --2- 172.21.15.17:0/2896132912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:10.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.438+0000 7f358ab9c700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35700a1460 0x7f35700a3910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f357c009550 tx=0x7f357c009320 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.438+0000 7f358a39b700 1 --2- 172.21.15.17:0/2896132912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d92d0 0x55d77e0d96a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f35800cb830 tx=0x7f3580096e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2461593c54f6ac7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.438+0000 7f3578bfe700 1 -- 172.21.15.17:0/2896132912 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358009acb0 con 0x55d77e0d92d0 2023-07-14T13:00:10.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.438+0000 7f3578bfe700 1 -- 172.21.15.17:0/2896132912 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f358009aad0 con 0x55d77e0d92d0 2023-07-14T13:00:10.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.438+0000 7f3578bfe700 1 -- 172.21.15.17:0/2896132912 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358002a360 con 0x55d77e0d92d0 2023-07-14T13:00:10.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.439+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2896132912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d92d0 msgr2=0x55d77e0d96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.439+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/2896132912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d92d0 0x55d77e0d96a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f35800cb830 tx=0x7f3580096e60 comp rx=0 tx=0).stop 2023-07-14T13:00:10.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.439+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2896132912 shutdown_connections 2023-07-14T13:00:10.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.439+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/2896132912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.439+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/2896132912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d92d0 0x55d77e0d96a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.439+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/2896132912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 0x55d77e0e4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.439+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2896132912 >> 172.21.15.17:0/2896132912 conn(0x55d77e0cfda0 msgr2=0x55d77e0d56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.439+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2896132912 shutdown_connections 2023-07-14T13:00:10.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.439+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2896132912 wait complete. 2023-07-14T13:00:10.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.440+0000 7f359ff3eb80 1 -- start start 2023-07-14T13:00:10.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.440+0000 7f359ff3eb80 1 Processor -- start 2023-07-14T13:00:10.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.440+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.440+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 0x55d77e0e8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.440+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.440+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77dfcbac0 con 0x55d77e0d92d0 2023-07-14T13:00:10.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.440+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77dfcb7c0 con 0x55d77e0e4ad0 2023-07-14T13:00:10.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.440+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77deaf920 con 0x55d77e0d9be0 2023-07-14T13:00:10.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.440+0000 7f359ff3eb80 10 client.0 _ll_register_callbacks cb 0x55d77dfc9760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:10.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.441+0000 7f358a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.441+0000 7f358a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36966/0 (socket says 172.21.15.17:36966) 2023-07-14T13:00:10.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.441+0000 7f358a39b700 1 -- 172.21.15.17:0/1245946751 learned_addr learned my addr 172.21.15.17:0/1245946751 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:10.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.441+0000 7f3589b9a700 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 0x55d77e0e8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.441+0000 7f358a39b700 1 -- 172.21.15.17:0/1245946751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 msgr2=0x55d77e0e8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.441+0000 7f358a39b700 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 0x55d77e0e8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.441+0000 7f358a39b700 1 -- 172.21.15.17:0/1245946751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0e4ad0 msgr2=0x55d77e0e39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.441+0000 7f358a39b700 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.441+0000 7f358a39b700 1 -- 172.21.15.17:0/1245946751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c01a960 con 0x55d77e0d92d0 2023-07-14T13:00:10.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.441+0000 7f358a39b700 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e8a20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f35800cb890 tx=0x7f358009acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfab46060c5e3bf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.441+0000 7f356dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:10.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f356dffb700 1 -- 172.21.15.17:0/1245946751 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580016da0 con 0x55d77e0d92d0 2023-07-14T13:00:10.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1245946751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d77df854f0 con 0x55d77e0d92d0 2023-07-14T13:00:10.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f356dffb700 1 -- 172.21.15.17:0/1245946751 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f358002a360 con 0x55d77e0d92d0 2023-07-14T13:00:10.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f356dffb700 1 -- 172.21.15.17:0/1245946751 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f358009b170 con 0x55d77e0d92d0 2023-07-14T13:00:10.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f359ff3eb80 10 client.15783 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:10.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1245946751 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f35841a4bc0 con 0x55d77e0d92d0 2023-07-14T13:00:10.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f356dffb700 1 -- 172.21.15.17:0/1245946751 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35800cb020 con 0x55d77e0d92d0 2023-07-14T13:00:10.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f356dffb700 1 -- 172.21.15.17:0/1245946751 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f358009b3d0 con 0x55d77e0d92d0 2023-07-14T13:00:10.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f359ff3eb80 10 client.15783 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:10.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f359ff3eb80 10 client.15783 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:10.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f359ff3eb80 20 client.15783 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:10.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.442+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d77e0f3bc0 0x55d77e0f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.443+0000 7f359ff3eb80 4 client.15783 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:10.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.443+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1245946751 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d77e024eb0 con 0x55d77e0f3bc0 2023-07-14T13:00:10.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.443+0000 7f3589b9a700 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d77e0f3bc0 0x55d77e0f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.443+0000 7f3589b9a700 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d77e0f3bc0 0x55d77e0f5fa0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90423f161970dde0 server_cookie=e0a20a665a2cec09 in_seq=0 out_seq=0 2023-07-14T13:00:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.443+0000 7f356dffb700 10 client.15783 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.444+0000 7f356dffb700 1 -- 172.21.15.17:0/1245946751 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d77e024eb0 con 0x55d77e0f3bc0 2023-07-14T13:00:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.444+0000 7f356dffb700 10 client.15783 handle_command_reply: tid=0 2023-07-14T13:00:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.444+0000 7f359ff3eb80 1 client.15783 shutdown 2023-07-14T13:00:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.444+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1245946751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 msgr2=0x55d77e0e8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.444+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e8a20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f35800cb890 tx=0x7f358009acb0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.444+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1245946751 shutdown_connections 2023-07-14T13:00:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.444+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d77e0f3bc0 0x55d77e0f5fa0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.445+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.445+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e8a20 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.445+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/1245946751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 0x55d77e0e8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.445+0000 7f356dffb700 0 client.15783 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:10.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.445+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1245946751 >> 172.21.15.17:0/1245946751 conn(0x55d77e0cfda0 msgr2=0x55d77e0d5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.445+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1245946751 shutdown_connections 2023-07-14T13:00:10.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.445+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1245946751 wait complete. 2023-07-14T13:00:10.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.445+0000 7f359ff3eb80 20 client.15783 trim_cache size 0 max 16384 2023-07-14T13:00:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.465+0000 7f359ff3eb80 1 Processor -- start 2023-07-14T13:00:10.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.465+0000 7f359ff3eb80 1 -- start start 2023-07-14T13:00:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.465+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.465+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 0x55d77e0e36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.465+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77e0cf9c0 con 0x55d77e0d92d0 2023-07-14T13:00:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77e0e5010 con 0x55d77e0e4ad0 2023-07-14T13:00:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77e0dadd0 con 0x55d77e0d9be0 2023-07-14T13:00:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f358a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f358a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36978/0 (socket says 172.21.15.17:36978) 2023-07-14T13:00:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f358a39b700 1 -- 172.21.15.17:0/1012762988 learned_addr learned my addr 172.21.15.17:0/1012762988 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f358ab9c700 1 --2- 172.21.15.17:0/1012762988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f3589b9a700 1 --2- 172.21.15.17:0/1012762988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 0x55d77e0e36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f358a39b700 1 -- 172.21.15.17:0/1012762988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 msgr2=0x55d77e0e36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f358a39b700 1 --2- 172.21.15.17:0/1012762988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 0x55d77e0e36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f358a39b700 1 -- 172.21.15.17:0/1012762988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0e4ad0 msgr2=0x55d77e0e86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f358a39b700 1 --2- 172.21.15.17:0/1012762988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.466+0000 7f358a39b700 1 -- 172.21.15.17:0/1012762988 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d77de42c60 con 0x55d77e0d92d0 2023-07-14T13:00:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.467+0000 7f358a39b700 1 --2- 172.21.15.17:0/1012762988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e3180 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3580006010 tx=0x7f3580096e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35dddccf1a207b63 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.467+0000 7f35793ff700 1 -- 172.21.15.17:0/1012762988 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358009a8f0 con 0x55d77e0d92d0 2023-07-14T13:00:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.467+0000 7f35793ff700 1 -- 172.21.15.17:0/1012762988 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35800cb040 con 0x55d77e0d92d0 2023-07-14T13:00:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.467+0000 7f35793ff700 1 -- 172.21.15.17:0/1012762988 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35800a3530 con 0x55d77e0d92d0 2023-07-14T13:00:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.467+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1012762988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 msgr2=0x55d77e0e3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.467+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/1012762988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e3180 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3580006010 tx=0x7f3580096e40 comp rx=0 tx=0).stop 2023-07-14T13:00:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.468+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1012762988 shutdown_connections 2023-07-14T13:00:10.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.468+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/1012762988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0e4ad0 0x55d77e0e86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.468+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/1012762988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0d92d0 0x55d77e0e3180 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.468+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/1012762988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d9be0 0x55d77e0e36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.468+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1012762988 >> 172.21.15.17:0/1012762988 conn(0x55d77e0cfda0 msgr2=0x55d77e0ded40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.468+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1012762988 shutdown_connections 2023-07-14T13:00:10.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.468+0000 7f359ff3eb80 1 -- 172.21.15.17:0/1012762988 wait complete. 2023-07-14T13:00:10.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.468+0000 7f359ff3eb80 1 -- start start 2023-07-14T13:00:10.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f359ff3eb80 1 Processor -- start 2023-07-14T13:00:10.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d92d0 0x55d77e0f0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d9be0 0x55d77e0ec590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f359ff3eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77e0ed010 con 0x55d77e0e4ad0 2023-07-14T13:00:10.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77e0ed180 con 0x55d77e0d9be0 2023-07-14T13:00:10.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f359ff3eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77e0ed340 con 0x55d77e0d92d0 2023-07-14T13:00:10.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f359ff3eb80 10 client.0 _ll_register_callbacks cb 0x7f357c008790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:10.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f358ab9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f358ab9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0ecad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36994/0 (socket says 172.21.15.17:36994) 2023-07-14T13:00:10.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f358ab9c700 1 -- 172.21.15.17:0/2030579739 learned_addr learned my addr 172.21.15.17:0/2030579739 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:10.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.469+0000 7f358a39b700 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d92d0 0x55d77e0f0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f3589b9a700 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d9be0 0x55d77e0ec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f358ab9c700 1 -- 172.21.15.17:0/2030579739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d92d0 msgr2=0x55d77e0f0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f358ab9c700 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d92d0 0x55d77e0f0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f358ab9c700 1 -- 172.21.15.17:0/2030579739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d9be0 msgr2=0x55d77e0ec590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:10.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f358ab9c700 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d9be0 0x55d77e0ec590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f358ab9c700 1 -- 172.21.15.17:0/2030579739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35841a4bc0 con 0x55d77e0e4ad0 2023-07-14T13:00:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f3589b9a700 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d9be0 0x55d77e0ec590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f358a39b700 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d92d0 0x55d77e0f0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f358ab9c700 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0ecad0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f357c01a770 tx=0x7f357c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e53ce3566c6ed6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f356dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f356dffb700 1 -- 172.21.15.17:0/2030579739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c00e070 con 0x55d77e0e4ad0 2023-07-14T13:00:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2030579739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f358009aad0 con 0x55d77e0e4ad0 2023-07-14T13:00:10.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.470+0000 7f356dffb700 1 -- 172.21.15.17:0/2030579739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f357c021040 con 0x55d77e0e4ad0 2023-07-14T13:00:10.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.471+0000 7f356dffb700 1 -- 172.21.15.17:0/2030579739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f357c008590 con 0x55d77e0e4ad0 2023-07-14T13:00:10.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.471+0000 7f359ff3eb80 10 client.15789 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:10.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.471+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2030579739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x55d77de80250 con 0x55d77e0e4ad0 2023-07-14T13:00:10.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.471+0000 7f356dffb700 1 -- 172.21.15.17:0/2030579739 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f358009aad0 con 0x55d77e0e4ad0 2023-07-14T13:00:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.471+0000 7f356dffb700 1 -- 172.21.15.17:0/2030579739 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f357c0263f0 con 0x55d77e0e4ad0 2023-07-14T13:00:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.471+0000 7f359ff3eb80 10 client.15789 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.471+0000 7f359ff3eb80 10 client.15789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.471+0000 7f359ff3eb80 20 client.15789 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.471+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d77e148ed0 0x55d77e14b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.471+0000 7f359ff3eb80 4 client.15789 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:00:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.471+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2030579739 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d77dfe7050 con 0x55d77e148ed0 2023-07-14T13:00:10.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.472+0000 7f358a39b700 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d77e148ed0 0x55d77e14b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:10.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.472+0000 7f356dffb700 10 client.15789 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:10.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.472+0000 7f358a39b700 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d77e148ed0 0x55d77e14b2e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c090d427c68a432 server_cookie=6bfcf8b1aa646ed2 in_seq=0 out_seq=0 2023-07-14T13:00:10.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f356dffb700 1 -- 172.21.15.17:0/2030579739 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d77dfe7050 con 0x55d77e148ed0 2023-07-14T13:00:10.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f356dffb700 10 client.15789 handle_command_reply: tid=0 2023-07-14T13:00:10.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f359ff3eb80 1 client.15789 shutdown 2023-07-14T13:00:10.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2030579739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 msgr2=0x55d77e0ecad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0ecad0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f357c01a770 tx=0x7f357c004ad0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2030579739 shutdown_connections 2023-07-14T13:00:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d77e148ed0 0x55d77e14b2e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d77e0e4ad0 0x55d77e0ecad0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d77e0d92d0 0x55d77e0f0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f359ff3eb80 1 --2- 172.21.15.17:0/2030579739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d77e0d9be0 0x55d77e0ec590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2030579739 >> 172.21.15.17:0/2030579739 conn(0x55d77e0cfda0 msgr2=0x55d77e0e9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f356dffb700 0 client.15789 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:10.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2030579739 shutdown_connections 2023-07-14T13:00:10.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.473+0000 7f359ff3eb80 1 -- 172.21.15.17:0/2030579739 wait complete. 2023-07-14T13:00:10.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.474+0000 7f359ff3eb80 20 client.15789 trim_cache size 0 max 16384 2023-07-14T13:00:10.512 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:00:10.512 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:00:10.512 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:00:10.513 INFO:teuthology.orchestra.run.smithi017.stdout: "248e08f9-108f-44d3-9c54-860ed0f7b931": { 2023-07-14T13:00:10.513 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:00:10.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "248e08f9-108f-44d3-9c54-860ed0f7b931", 2023-07-14T13:00:10.514 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:00:10.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:00:10.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:00:10.514 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:00:10.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.474+0000 7f358c5ff700 1 -- 172.21.15.17:0/2509900163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35700a1460 msgr2=0x7f35700a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.474+0000 7f358c5ff700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35700a1460 0x7f35700a3910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f357c009550 tx=0x7f357c009320 comp rx=0 tx=0).stop 2023-07-14T13:00:10.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.474+0000 7f358c5ff700 1 -- 172.21.15.17:0/2509900163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840fe880 msgr2=0x7f3584197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:10.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.474+0000 7f358c5ff700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840fe880 0x7f3584197d90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3580005740 tx=0x7f3580005770 comp rx=0 tx=0).stop 2023-07-14T13:00:10.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.474+0000 7f358c5ff700 1 -- 172.21.15.17:0/2509900163 shutdown_connections 2023-07-14T13:00:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.474+0000 7f358c5ff700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35700a1460 0x7f35700a3910 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.474+0000 7f358c5ff700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358410c430 0x7f358419c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.474+0000 7f358c5ff700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35840fe880 0x7f3584197d90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.474+0000 7f358c5ff700 1 --2- 172.21.15.17:0/2509900163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35840ff190 0x7f35841982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.474+0000 7f358c5ff700 1 -- 172.21.15.17:0/2509900163 >> 172.21.15.17:0/2509900163 conn(0x7f35840fa4b0 msgr2=0x7f358410e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.475+0000 7f358c5ff700 1 -- 172.21.15.17:0/2509900163 shutdown_connections 2023-07-14T13:00:10.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:10.475+0000 7f358c5ff700 1 -- 172.21.15.17:0/2509900163 wait complete. 2023-07-14T13:00:10.524 INFO:tasks.cephfs.filesystem:scrub status for tag:248e08f9-108f-44d3-9c54-860ed0f7b931 - {'path': '/', 'tag': '248e08f9-108f-44d3-9c54-860ed0f7b931', 'options': 'recursive,force'} 2023-07-14T13:00:11.223 INFO:teuthology.orchestra.run.smithi017.stderr:100000 of 50000000 tuples (0%) done (elapsed 0.83 s, remaining 413.67 s) 2023-07-14T13:00:11.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:10 smithi131 ceph-mon[96953]: pgmap v16: 97 pgs: 97 active+clean; 47 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 3.5 MiB/s wr, 266 op/s 2023-07-14T13:00:11.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:10 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:00:11.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:10 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:11.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:10 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:00:11.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:10 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:11.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:10 smithi017 ceph-mon[95536]: pgmap v16: 97 pgs: 97 active+clean; 47 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 3.5 MiB/s wr, 266 op/s 2023-07-14T13:00:11.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:10 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:00:11.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:10 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:11.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:10 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:00:11.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:10 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:11.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:10 smithi135 ceph-mon[97338]: pgmap v16: 97 pgs: 97 active+clean; 47 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 3.5 MiB/s wr, 266 op/s 2023-07-14T13:00:11.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:10 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:00:11.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:10 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:11.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:10 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:00:11.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:10 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:13.149 INFO:teuthology.orchestra.run.smithi017.stderr:200000 of 50000000 tuples (0%) done (elapsed 2.75 s, remaining 685.94 s) 2023-07-14T13:00:13.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:12 smithi017 ceph-mon[95536]: pgmap v17: 97 pgs: 97 active+clean; 49 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 3.2 MiB/s wr, 285 op/s 2023-07-14T13:00:13.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:12 smithi135 ceph-mon[97338]: pgmap v17: 97 pgs: 97 active+clean; 49 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 3.2 MiB/s wr, 285 op/s 2023-07-14T13:00:13.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:12 smithi131 ceph-mon[96953]: pgmap v17: 97 pgs: 97 active+clean; 49 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 3.2 MiB/s wr, 285 op/s 2023-07-14T13:00:13.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.854+0000 7f724b1ff700 1 -- 172.21.15.17:0/1449469984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7244105b10 msgr2=0x7f7244105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:13.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.854+0000 7f724b1ff700 1 --2- 172.21.15.17:0/1449469984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7244105b10 0x7f7244105ee0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7238009990 tx=0x7f7238009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.855+0000 7f724b1ff700 1 -- 172.21.15.17:0/1449469984 shutdown_connections 2023-07-14T13:00:13.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.855+0000 7f724b1ff700 1 --2- 172.21.15.17:0/1449469984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72441004b0 0x7f724410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.855+0000 7f724b1ff700 1 --2- 172.21.15.17:0/1449469984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7244105b10 0x7f7244105ee0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.855+0000 7f724b1ff700 1 --2- 172.21.15.17:0/1449469984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72440ffb00 0x7f72440fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.855+0000 7f724b1ff700 1 -- 172.21.15.17:0/1449469984 >> 172.21.15.17:0/1449469984 conn(0x7f72440fb600 msgr2=0x7f72440fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.855+0000 7f724b1ff700 1 -- 172.21.15.17:0/1449469984 shutdown_connections 2023-07-14T13:00:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.855+0000 7f724b1ff700 1 -- 172.21.15.17:0/1449469984 wait complete. 2023-07-14T13:00:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.856+0000 7f724b1ff700 1 Processor -- start 2023-07-14T13:00:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.856+0000 7f724b1ff700 1 -- start start 2023-07-14T13:00:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.856+0000 7f724b1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72440ffb00 0x7f7244197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f724b1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72441004b0 0x7f7244198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f724b1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7244105b10 0x7f724419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f724b1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724419cf10 con 0x7f7244105b10 2023-07-14T13:00:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f724b1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724419d080 con 0x7f72441004b0 2023-07-14T13:00:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f724b1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724419d240 con 0x7f72440ffb00 2023-07-14T13:00:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f7248f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72440ffb00 0x7f7244197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f7248f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72440ffb00 0x7f7244197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:53726/0 (socket says 172.21.15.17:53726) 2023-07-14T13:00:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f7248f9b700 1 -- 172.21.15.17:0/4162402757 learned_addr learned my addr 172.21.15.17:0/4162402757 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f724979c700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7244105b10 0x7f724419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f7243fff700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72441004b0 0x7f7244198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f724979c700 1 -- 172.21.15.17:0/4162402757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72440ffb00 msgr2=0x7f7244197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f724979c700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72440ffb00 0x7f7244197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f724979c700 1 -- 172.21.15.17:0/4162402757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72441004b0 msgr2=0x7f7244198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f724979c700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72441004b0 0x7f7244198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.857+0000 7f724979c700 1 -- 172.21.15.17:0/4162402757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72380095f0 con 0x7f7244105b10 2023-07-14T13:00:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.858+0000 7f724979c700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7244105b10 0x7f724419c8d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f723c00cc50 tx=0x7f723c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.858+0000 7f7241ffb700 1 -- 172.21.15.17:0/4162402757 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c00aa90 con 0x7f7244105b10 2023-07-14T13:00:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.858+0000 7f7241ffb700 1 -- 172.21.15.17:0/4162402757 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f723c00abf0 con 0x7f7244105b10 2023-07-14T13:00:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.858+0000 7f7241ffb700 1 -- 172.21.15.17:0/4162402757 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c0115e0 con 0x7f7244105b10 2023-07-14T13:00:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.858+0000 7f724b1ff700 1 -- 172.21.15.17:0/4162402757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724419d520 con 0x7f7244105b10 2023-07-14T13:00:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.858+0000 7f724b1ff700 1 -- 172.21.15.17:0/4162402757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72441a4d60 con 0x7f7244105b10 2023-07-14T13:00:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.862+0000 7f7241ffb700 1 -- 172.21.15.17:0/4162402757 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f723c012420 con 0x7f7244105b10 2023-07-14T13:00:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.863+0000 7f7241ffb700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f72340a13e0 0x7f72340a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.864+0000 7f7241ffb700 1 -- 172.21.15.17:0/4162402757 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f723c0ccf70 con 0x7f7244105b10 2023-07-14T13:00:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.864+0000 7f7248f9b700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f72340a13e0 0x7f72340a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.864+0000 7f725ea8bb80 1 Processor -- start 2023-07-14T13:00:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.864+0000 7f725ea8bb80 1 -- start start 2023-07-14T13:00:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b82d0 0x5612665b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b2580 0x5612665b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612664b7c50 con 0x5612665b2580 2023-07-14T13:00:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56126650a9e0 con 0x5612665b82d0 2023-07-14T13:00:13.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561266503e70 con 0x56126640e6b0 2023-07-14T13:00:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f7248f9b700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f72340a13e0 0x7f72340a3890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7238006010 tx=0x7f723800b540 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f724979c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b2580 0x5612665b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f724979c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b2580 0x5612665b29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37018/0 (socket says 172.21.15.17:37018) 2023-07-14T13:00:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f724979c700 1 -- 172.21.15.17:0/37956141 learned_addr learned my addr 172.21.15.17:0/37956141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f7248f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.865+0000 7f7243fff700 1 --2- 172.21.15.17:0/37956141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b82d0 0x5612665b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.866+0000 7f724979c700 1 -- 172.21.15.17:0/37956141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 msgr2=0x5612665b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.866+0000 7f724979c700 1 --2- 172.21.15.17:0/37956141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.866+0000 7f724979c700 1 -- 172.21.15.17:0/37956141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b82d0 msgr2=0x5612665b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.866+0000 7f724979c700 1 --2- 172.21.15.17:0/37956141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b82d0 0x5612665b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.866+0000 7f724979c700 1 -- 172.21.15.17:0/37956141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561266331d80 con 0x5612665b2580 2023-07-14T13:00:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.866+0000 7f7243fff700 1 --2- 172.21.15.17:0/37956141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b82d0 0x5612665b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.866+0000 7f724979c700 1 --2- 172.21.15.17:0/37956141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b2580 0x5612665b29d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f723c0a1e30 tx=0x7f723c099a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2ec6f8c15ac1bd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.866+0000 7f722effd700 1 -- 172.21.15.17:0/37956141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c00ad60 con 0x5612665b2580 2023-07-14T13:00:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.866+0000 7f722effd700 1 -- 172.21.15.17:0/37956141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f723c099f10 con 0x5612665b2580 2023-07-14T13:00:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.866+0000 7f722effd700 1 -- 172.21.15.17:0/37956141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c0a1ed0 con 0x5612665b2580 2023-07-14T13:00:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.867+0000 7f725ea8bb80 1 -- 172.21.15.17:0/37956141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b2580 msgr2=0x5612665b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.867+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/37956141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b2580 0x5612665b29d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f723c0a1e30 tx=0x7f723c099a50 comp rx=0 tx=0).stop 2023-07-14T13:00:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.867+0000 7f725ea8bb80 1 -- 172.21.15.17:0/37956141 shutdown_connections 2023-07-14T13:00:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.867+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/37956141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b2580 0x5612665b29d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.867+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/37956141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.867+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/37956141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b82d0 0x5612665b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.867+0000 7f725ea8bb80 1 -- 172.21.15.17:0/37956141 >> 172.21.15.17:0/37956141 conn(0x5612665a7be0 msgr2=0x5612665acf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.867+0000 7f725ea8bb80 1 -- 172.21.15.17:0/37956141 shutdown_connections 2023-07-14T13:00:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.867+0000 7f725ea8bb80 1 -- 172.21.15.17:0/37956141 wait complete. 2023-07-14T13:00:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.868+0000 7f725ea8bb80 1 -- start start 2023-07-14T13:00:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.868+0000 7f725ea8bb80 1 Processor -- start 2023-07-14T13:00:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56126640e6b0 0x5612665be5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5612665b2580 0x5612665bb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b82d0 0x5612665bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612664a3a60 con 0x56126640e6b0 2023-07-14T13:00:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612664a3760 con 0x5612665b82d0 2023-07-14T13:00:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612663878c0 con 0x5612665b2580 2023-07-14T13:00:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f725ea8bb80 10 client.0 _ll_register_callbacks cb 0x5612664a1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f7248f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56126640e6b0 0x5612665be5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f7248f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56126640e6b0 0x5612665be5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37032/0 (socket says 172.21.15.17:37032) 2023-07-14T13:00:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f7248f9b700 1 -- 172.21.15.17:0/2849100757 learned_addr learned my addr 172.21.15.17:0/2849100757 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f7243fff700 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5612665b2580 0x5612665bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.869+0000 7f724979c700 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b82d0 0x5612665bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.870+0000 7f7248f9b700 1 -- 172.21.15.17:0/2849100757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5612665b2580 msgr2=0x5612665bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.870+0000 7f7248f9b700 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5612665b2580 0x5612665bb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.870+0000 7f7248f9b700 1 -- 172.21.15.17:0/2849100757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b82d0 msgr2=0x5612665bbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.870+0000 7f7248f9b700 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b82d0 0x5612665bbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.870+0000 7f7248f9b700 1 -- 172.21.15.17:0/2849100757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72300078a0 con 0x56126640e6b0 2023-07-14T13:00:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.870+0000 7f7248f9b700 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56126640e6b0 0x5612665be5a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f723800bf30 tx=0x7f723801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b687d8ba47b603 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.870+0000 7f7223fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.870+0000 7f7223fff700 1 -- 172.21.15.17:0/2849100757 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7238004500 con 0x56126640e6b0 2023-07-14T13:00:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.870+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2849100757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56126645d490 con 0x56126640e6b0 2023-07-14T13:00:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.870+0000 7f7223fff700 1 -- 172.21.15.17:0/2849100757 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7238004660 con 0x56126640e6b0 2023-07-14T13:00:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.871+0000 7f7223fff700 1 -- 172.21.15.17:0/2849100757 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7238004820 con 0x56126640e6b0 2023-07-14T13:00:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.871+0000 7f725ea8bb80 10 client.15801 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.871+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2849100757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x7f72441a4d60 con 0x56126640e6b0 2023-07-14T13:00:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.871+0000 7f7223fff700 1 -- 172.21.15.17:0/2849100757 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f723803d020 con 0x56126640e6b0 2023-07-14T13:00:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.871+0000 7f7223fff700 1 -- 172.21.15.17:0/2849100757 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7238039800 con 0x56126640e6b0 2023-07-14T13:00:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.871+0000 7f725ea8bb80 10 client.15801 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.871+0000 7f725ea8bb80 10 client.15801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.871+0000 7f725ea8bb80 20 client.15801 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.871+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5612665cbbd0 0x5612665cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.871+0000 7f725ea8bb80 4 client.15801 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.871+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2849100757 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612664fce50 con 0x5612665cbbd0 2023-07-14T13:00:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.872+0000 7f7243fff700 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5612665cbbd0 0x5612665cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.873+0000 7f7243fff700 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5612665cbbd0 0x5612665cdfe0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f62549eabb9e6d8d server_cookie=dacc70935cb7760f in_seq=0 out_seq=0 2023-07-14T13:00:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.873+0000 7f7223fff700 10 client.15801 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.873+0000 7f7223fff700 1 -- 172.21.15.17:0/2849100757 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5612664fce50 con 0x5612665cbbd0 2023-07-14T13:00:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.873+0000 7f7223fff700 10 client.15801 handle_command_reply: tid=0 2023-07-14T13:00:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.873+0000 7f725ea8bb80 1 client.15801 shutdown 2023-07-14T13:00:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2849100757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56126640e6b0 msgr2=0x5612665be5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56126640e6b0 0x5612665be5a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f723800bf30 tx=0x7f723801a050 comp rx=0 tx=0).stop 2023-07-14T13:00:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2849100757 shutdown_connections 2023-07-14T13:00:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5612665cbbd0 0x5612665cdfe0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b82d0 0x5612665bbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56126640e6b0 0x5612665be5a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f7223fff700 0 client.15801 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2849100757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5612665b2580 0x5612665bb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2849100757 >> 172.21.15.17:0/2849100757 conn(0x5612665a7be0 msgr2=0x5612665ac4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2849100757 shutdown_connections 2023-07-14T13:00:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2849100757 wait complete. 2023-07-14T13:00:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.874+0000 7f725ea8bb80 20 client.15801 trim_cache size 0 max 16384 2023-07-14T13:00:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.894+0000 7f725ea8bb80 1 Processor -- start 2023-07-14T13:00:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.894+0000 7f725ea8bb80 1 -- start start 2023-07-14T13:00:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.895+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665be140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.895+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b2580 0x5612665acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.895+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.895+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612665add50 con 0x5612665b82d0 2023-07-14T13:00:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.895+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612665bc7b0 con 0x5612665b2580 2023-07-14T13:00:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.895+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612665bce00 con 0x56126640e6b0 2023-07-14T13:00:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.895+0000 7f724979c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.895+0000 7f724979c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665bafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37036/0 (socket says 172.21.15.17:37036) 2023-07-14T13:00:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.895+0000 7f724979c700 1 -- 172.21.15.17:0/189274226 learned_addr learned my addr 172.21.15.17:0/189274226 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.895+0000 7f7243fff700 1 --2- 172.21.15.17:0/189274226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b2580 0x5612665acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.895+0000 7f7248f9b700 1 --2- 172.21.15.17:0/189274226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.896+0000 7f724979c700 1 -- 172.21.15.17:0/189274226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 msgr2=0x5612665be140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.896+0000 7f724979c700 1 --2- 172.21.15.17:0/189274226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665be140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.896+0000 7f724979c700 1 -- 172.21.15.17:0/189274226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b2580 msgr2=0x5612665acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.896+0000 7f724979c700 1 --2- 172.21.15.17:0/189274226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b2580 0x5612665acc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.896+0000 7f724979c700 1 -- 172.21.15.17:0/189274226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56126631ac00 con 0x5612665b82d0 2023-07-14T13:00:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.896+0000 7f724979c700 1 --2- 172.21.15.17:0/189274226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665bafe0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f723c00cc20 tx=0x7f723c018f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bed125dc31fb89 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.896+0000 7f722f7fe700 1 -- 172.21.15.17:0/189274226 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c09df40 con 0x5612665b82d0 2023-07-14T13:00:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.896+0000 7f722f7fe700 1 -- 172.21.15.17:0/189274226 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f723c0ca5a0 con 0x5612665b82d0 2023-07-14T13:00:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.896+0000 7f722f7fe700 1 -- 172.21.15.17:0/189274226 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c099400 con 0x5612665b82d0 2023-07-14T13:00:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.897+0000 7f725ea8bb80 1 -- 172.21.15.17:0/189274226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 msgr2=0x5612665bafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.897+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/189274226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665bafe0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f723c00cc20 tx=0x7f723c018f90 comp rx=0 tx=0).stop 2023-07-14T13:00:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.897+0000 7f725ea8bb80 1 -- 172.21.15.17:0/189274226 shutdown_connections 2023-07-14T13:00:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.897+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/189274226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665bafe0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.897+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/189274226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665be140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.897+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/189274226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b2580 0x5612665acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.897+0000 7f725ea8bb80 1 -- 172.21.15.17:0/189274226 >> 172.21.15.17:0/189274226 conn(0x5612665a7be0 msgr2=0x5612665b9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.897+0000 7f725ea8bb80 1 -- 172.21.15.17:0/189274226 shutdown_connections 2023-07-14T13:00:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.897+0000 7f725ea8bb80 1 -- 172.21.15.17:0/189274226 wait complete. 2023-07-14T13:00:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.898+0000 7f725ea8bb80 1 -- start start 2023-07-14T13:00:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.898+0000 7f725ea8bb80 1 Processor -- start 2023-07-14T13:00:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.898+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665c2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b2580 0x5612665c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f725ea8bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612665c1560 con 0x5612665b82d0 2023-07-14T13:00:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612665c16d0 con 0x5612665b2580 2023-07-14T13:00:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f725ea8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612665c1890 con 0x56126640e6b0 2023-07-14T13:00:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f725ea8bb80 10 client.0 _ll_register_callbacks cb 0x5612664a1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f724979c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f724979c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665c0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37052/0 (socket says 172.21.15.17:37052) 2023-07-14T13:00:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f724979c700 1 -- 172.21.15.17:0/2234682769 learned_addr learned my addr 172.21.15.17:0/2234682769 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f7248f9b700 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f7243fff700 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b2580 0x5612665c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f724979c700 1 -- 172.21.15.17:0/2234682769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 msgr2=0x5612665c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.899+0000 7f724979c700 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665c2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.900+0000 7f724979c700 1 -- 172.21.15.17:0/2234682769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b2580 msgr2=0x5612665c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.900+0000 7f724979c700 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b2580 0x5612665c2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.900+0000 7f724979c700 1 -- 172.21.15.17:0/2234682769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561266331d80 con 0x5612665b82d0 2023-07-14T13:00:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.900+0000 7f724979c700 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665c0e90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f723c00afd0 tx=0x7f723c0b83f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64aa590445150a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.900+0000 7f7223fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.900+0000 7f7223fff700 1 -- 172.21.15.17:0/2234682769 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c00ad60 con 0x5612665b82d0 2023-07-14T13:00:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.900+0000 7f7223fff700 1 -- 172.21.15.17:0/2234682769 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f723c0126d0 con 0x5612665b82d0 2023-07-14T13:00:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.900+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2234682769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f723c099f10 con 0x5612665b82d0 2023-07-14T13:00:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.900+0000 7f7223fff700 1 -- 172.21.15.17:0/2234682769 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f723c0a2360 con 0x5612665b82d0 2023-07-14T13:00:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.900+0000 7f725ea8bb80 10 client.15807 fetch_fsmap learned FSMap version 22 2023-07-14T13:00:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.900+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2234682769 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) v3 -- 0x5612663581f0 con 0x5612665b82d0 2023-07-14T13:00:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.901+0000 7f7223fff700 1 -- 172.21.15.17:0/2234682769 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f723c099f10 con 0x5612665b82d0 2023-07-14T13:00:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.901+0000 7f7223fff700 1 -- 172.21.15.17:0/2234682769 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f723c094b20 con 0x5612665b82d0 2023-07-14T13:00:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.901+0000 7f725ea8bb80 10 client.15807 fetch_fsmap finished waiting for FSMap version 22 2023-07-14T13:00:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.901+0000 7f725ea8bb80 10 client.15807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.901+0000 7f725ea8bb80 20 client.15807 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.901+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561266620830 0x561266622c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.901+0000 7f725ea8bb80 4 client.15807 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:00:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.901+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2234682769 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5612664beff0 con 0x561266620830 2023-07-14T13:00:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.901+0000 7f7248f9b700 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561266620830 0x561266622c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.902+0000 7f7248f9b700 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561266620830 0x561266622c10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88af79e7ce1d0b2a server_cookie=6548b3737ad9aa06 in_seq=0 out_seq=0 2023-07-14T13:00:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:13.902+0000 7f7223fff700 10 client.15807 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:14.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f7223fff700 1 -- 172.21.15.17:0/2234682769 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5612664beff0 con 0x561266620830 2023-07-14T13:00:14.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f7223fff700 10 client.15807 handle_command_reply: tid=0 2023-07-14T13:00:14.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f725ea8bb80 1 client.15807 shutdown 2023-07-14T13:00:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2234682769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 msgr2=0x5612665c0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665c0e90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f723c00afd0 tx=0x7f723c0b83f0 comp rx=0 tx=0).stop 2023-07-14T13:00:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2234682769 shutdown_connections 2023-07-14T13:00:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561266620830 0x561266622c10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5612665b82d0 0x5612665c0e90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56126640e6b0 0x5612665c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f7223fff700 0 client.15807 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f725ea8bb80 1 --2- 172.21.15.17:0/2234682769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612665b2580 0x5612665c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2234682769 >> 172.21.15.17:0/2234682769 conn(0x5612665a7be0 msgr2=0x5612665b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.033+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2234682769 shutdown_connections 2023-07-14T13:00:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.034+0000 7f725ea8bb80 1 -- 172.21.15.17:0/2234682769 wait complete. 2023-07-14T13:00:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.034+0000 7f725ea8bb80 20 client.15807 trim_cache size 0 max 16384 2023-07-14T13:00:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:00:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:00:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:00:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:00:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.034+0000 7f724b1ff700 1 -- 172.21.15.17:0/4162402757 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f72340a13e0 msgr2=0x7f72340a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.034+0000 7f724b1ff700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f72340a13e0 0x7f72340a3890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7238006010 tx=0x7f723800b540 comp rx=0 tx=0).stop 2023-07-14T13:00:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.034+0000 7f724b1ff700 1 -- 172.21.15.17:0/4162402757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7244105b10 msgr2=0x7f724419c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.034+0000 7f724b1ff700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7244105b10 0x7f724419c8d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f723c00cc50 tx=0x7f723c00cf60 comp rx=0 tx=0).stop 2023-07-14T13:00:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.035+0000 7f724b1ff700 1 -- 172.21.15.17:0/4162402757 shutdown_connections 2023-07-14T13:00:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.035+0000 7f724b1ff700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f72340a13e0 0x7f72340a3890 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.035+0000 7f724b1ff700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7244105b10 0x7f724419c8d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.035+0000 7f724b1ff700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72440ffb00 0x7f7244197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.035+0000 7f724b1ff700 1 --2- 172.21.15.17:0/4162402757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72441004b0 0x7f7244198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.035+0000 7f724b1ff700 1 -- 172.21.15.17:0/4162402757 >> 172.21.15.17:0/4162402757 conn(0x7f72440fb600 msgr2=0x7f72440fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.035+0000 7f724b1ff700 1 -- 172.21.15.17:0/4162402757 shutdown_connections 2023-07-14T13:00:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:14.035+0000 7f724b1ff700 1 -- 172.21.15.17:0/4162402757 wait complete. 2023-07-14T13:00:14.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:13 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:00:14.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:13 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:00:14.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:13 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:00:15.128 INFO:teuthology.orchestra.run.smithi017.stderr:300000 of 50000000 tuples (0%) done (elapsed 4.73 s, remaining 784.21 s) 2023-07-14T13:00:15.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:14 smithi017 ceph-mon[95536]: pgmap v18: 97 pgs: 97 active+clean; 49 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.7 MiB/s wr, 231 op/s 2023-07-14T13:00:15.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:14 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:00:15.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:14 smithi135 ceph-mon[97338]: pgmap v18: 97 pgs: 97 active+clean; 49 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.7 MiB/s wr, 231 op/s 2023-07-14T13:00:15.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:14 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:00:15.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:14 smithi131 ceph-mon[96953]: pgmap v18: 97 pgs: 97 active+clean; 49 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.7 MiB/s wr, 231 op/s 2023-07-14T13:00:15.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:14 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:00:16.451 INFO:teuthology.orchestra.run.smithi017.stderr:400000 of 50000000 tuples (0%) done (elapsed 6.06 s, remaining 751.03 s) 2023-07-14T13:00:17.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:17 smithi017 ceph-mon[95536]: pgmap v19: 97 pgs: 97 active+clean; 114 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 11 MiB/s wr, 365 op/s 2023-07-14T13:00:17.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:17 smithi135 ceph-mon[97338]: pgmap v19: 97 pgs: 97 active+clean; 114 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 11 MiB/s wr, 365 op/s 2023-07-14T13:00:17.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:17 smithi131 ceph-mon[96953]: pgmap v19: 97 pgs: 97 active+clean; 114 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 11 MiB/s wr, 365 op/s 2023-07-14T13:00:18.395 INFO:teuthology.orchestra.run.smithi017.stderr:500000 of 50000000 tuples (1%) done (elapsed 8.00 s, remaining 792.03 s) 2023-07-14T13:00:19.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:19 smithi017 ceph-mon[95536]: pgmap v20: 97 pgs: 97 active+clean; 114 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 9.4 MiB/s wr, 167 op/s 2023-07-14T13:00:19.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:19 smithi135 ceph-mon[97338]: pgmap v20: 97 pgs: 97 active+clean; 114 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 9.4 MiB/s wr, 167 op/s 2023-07-14T13:00:19.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:19 smithi131 ceph-mon[96953]: pgmap v20: 97 pgs: 97 active+clean; 114 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 9.4 MiB/s wr, 167 op/s 2023-07-14T13:00:19.733 INFO:teuthology.orchestra.run.smithi017.stderr:600000 of 50000000 tuples (1%) done (elapsed 9.34 s, remaining 768.88 s) 2023-07-14T13:00:20.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:20 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:00:20.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:20 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:00:20.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:20 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:00:21.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:21 smithi017 ceph-mon[95536]: pgmap v21: 97 pgs: 97 active+clean; 138 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 13 MiB/s wr, 168 op/s 2023-07-14T13:00:21.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:21 smithi135 ceph-mon[97338]: pgmap v21: 97 pgs: 97 active+clean; 138 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 13 MiB/s wr, 168 op/s 2023-07-14T13:00:21.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:21 smithi131 ceph-mon[96953]: pgmap v21: 97 pgs: 97 active+clean; 138 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 13 MiB/s wr, 168 op/s 2023-07-14T13:00:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:700000 of 50000000 tuples (1%) done (elapsed 11.17 s, remaining 786.64 s) 2023-07-14T13:00:23.356 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:23 smithi017 ceph-mon[95536]: pgmap v22: 97 pgs: 97 active+clean; 177 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 21 MiB/s wr, 178 op/s 2023-07-14T13:00:23.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:23 smithi135 ceph-mon[97338]: pgmap v22: 97 pgs: 97 active+clean; 177 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 21 MiB/s wr, 178 op/s 2023-07-14T13:00:23.473 INFO:teuthology.orchestra.run.smithi017.stderr:800000 of 50000000 tuples (1%) done (elapsed 13.08 s, remaining 804.29 s) 2023-07-14T13:00:23.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:23 smithi131 ceph-mon[96953]: pgmap v22: 97 pgs: 97 active+clean; 177 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 21 MiB/s wr, 178 op/s 2023-07-14T13:00:24.819 INFO:teuthology.orchestra.run.smithi017.stderr:900000 of 50000000 tuples (1%) done (elapsed 14.42 s, remaining 786.91 s) 2023-07-14T13:00:25.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:25 smithi017 ceph-mon[95536]: pgmap v23: 97 pgs: 97 active+clean; 177 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 20 MiB/s wr, 144 op/s 2023-07-14T13:00:25.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:25 smithi135 ceph-mon[97338]: pgmap v23: 97 pgs: 97 active+clean; 177 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 20 MiB/s wr, 144 op/s 2023-07-14T13:00:25.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:25 smithi131 ceph-mon[96953]: pgmap v23: 97 pgs: 97 active+clean; 177 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 20 MiB/s wr, 144 op/s 2023-07-14T13:00:26.696 INFO:teuthology.orchestra.run.smithi017.stderr:1000000 of 50000000 tuples (2%) done (elapsed 16.30 s, remaining 798.78 s) 2023-07-14T13:00:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.207+0000 7f2c2fdff700 1 -- 172.21.15.17:0/962473601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c280685b0 msgr2=0x7f2c28104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.207+0000 7f2c2fdff700 1 --2- 172.21.15.17:0/962473601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c280685b0 0x7f2c28104770 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2c180099c0 tx=0x7f2c18009cd0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.207+0000 7f2c2fdff700 1 -- 172.21.15.17:0/962473601 shutdown_connections 2023-07-14T13:00:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.207+0000 7f2c2fdff700 1 --2- 172.21.15.17:0/962473601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c28104e50 0x7f2c2810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.207+0000 7f2c2fdff700 1 --2- 172.21.15.17:0/962473601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c28067c10 0x7f2c28067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.207+0000 7f2c2fdff700 1 --2- 172.21.15.17:0/962473601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c280685b0 0x7f2c28104770 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.207+0000 7f2c2fdff700 1 -- 172.21.15.17:0/962473601 >> 172.21.15.17:0/962473601 conn(0x7f2c28074760 msgr2=0x7f2c28074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.207+0000 7f2c2fdff700 1 -- 172.21.15.17:0/962473601 shutdown_connections 2023-07-14T13:00:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.207+0000 7f2c2fdff700 1 -- 172.21.15.17:0/962473601 wait complete. 2023-07-14T13:00:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.208+0000 7f2c2fdff700 1 Processor -- start 2023-07-14T13:00:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.209+0000 7f2c2fdff700 1 -- start start 2023-07-14T13:00:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.209+0000 7f2c2fdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c28067c10 0x7f2c28197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.209+0000 7f2c2fdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c280685b0 0x7f2c281982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.209+0000 7f2c2fdff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c28104e50 0x7f2c2819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.209+0000 7f2c2fdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2819cec0 con 0x7f2c280685b0 2023-07-14T13:00:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.209+0000 7f2c2fdff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2819d030 con 0x7f2c28104e50 2023-07-14T13:00:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.209+0000 7f2c2fdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2819d1f0 con 0x7f2c28067c10 2023-07-14T13:00:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.209+0000 7f2c2d39a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c280685b0 0x7f2c281982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.209+0000 7f2c2d39a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c280685b0 0x7f2c281982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34048/0 (socket says 172.21.15.17:34048) 2023-07-14T13:00:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.209+0000 7f2c2d39a700 1 -- 172.21.15.17:0/2489449075 learned_addr learned my addr 172.21.15.17:0/2489449075 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.209+0000 7f2c2db9b700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c28067c10 0x7f2c28197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c28104e50 0x7f2c2819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c2d39a700 1 -- 172.21.15.17:0/2489449075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c28067c10 msgr2=0x7f2c28197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c28067c10 0x7f2c28197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c2d39a700 1 -- 172.21.15.17:0/2489449075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c28104e50 msgr2=0x7f2c2819c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c28104e50 0x7f2c2819c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c2d39a700 1 -- 172.21.15.17:0/2489449075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180095f0 con 0x7f2c280685b0 2023-07-14T13:00:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c28104e50 0x7f2c2819c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:00:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c280685b0 0x7f2c281982b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009fd0 tx=0x7f2c18009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c1effd700 1 -- 172.21.15.17:0/2489449075 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1801d070 con 0x7f2c280685b0 2023-07-14T13:00:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c2fdff700 1 -- 172.21.15.17:0/2489449075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2819d470 con 0x7f2c280685b0 2023-07-14T13:00:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c1effd700 1 -- 172.21.15.17:0/2489449075 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c180059a0 con 0x7f2c280685b0 2023-07-14T13:00:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.210+0000 7f2c1effd700 1 -- 172.21.15.17:0/2489449075 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18022e60 con 0x7f2c280685b0 2023-07-14T13:00:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.211+0000 7f2c2fdff700 1 -- 172.21.15.17:0/2489449075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c281a4d10 con 0x7f2c280685b0 2023-07-14T13:00:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.215+0000 7f2c1effd700 1 -- 172.21.15.17:0/2489449075 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f2c18022600 con 0x7f2c280685b0 2023-07-14T13:00:27.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.216+0000 7f2c4380eb80 1 Processor -- start 2023-07-14T13:00:27.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.217+0000 7f2c4380eb80 1 -- start start 2023-07-14T13:00:27.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.217+0000 7f2c1effd700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c140a13e0 0x7f2c140a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.217+0000 7f2c1effd700 1 -- 172.21.15.17:0/2489449075 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2c180cde60 con 0x7f2c280685b0 2023-07-14T13:00:27.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.217+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.217+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.217+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.217+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc3cdc50 con 0x562cbc4c8580 2023-07-14T13:00:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.217+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc4209e0 con 0x562cbc3246b0 2023-07-14T13:00:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.217+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc419e70 con 0x562cbc4ce2d0 2023-07-14T13:00:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.217+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c140a13e0 0x7f2c140a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2db9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2e39c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2db9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4cdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60514/0 (socket says 172.21.15.17:60514) 2023-07-14T13:00:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2db9b700 1 -- 172.21.15.17:0/407647694 learned_addr learned my addr 172.21.15.17:0/407647694 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2d39a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2d39a700 1 -- 172.21.15.17:0/407647694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 msgr2=0x562cbc4cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/407647694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2d39a700 1 -- 172.21.15.17:0/407647694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 msgr2=0x562cbc4c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/407647694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2d39a700 1 -- 172.21.15.17:0/407647694 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cbc247d80 con 0x562cbc4ce2d0 2023-07-14T13:00:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/407647694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4c8040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2c180cb480 tx=0x7f2c1809ac10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1978058fc78aa767 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.218+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c140a13e0 0x7f2c140a3890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c20011700 tx=0x7f2c2001cb40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.219+0000 7f2c13fff700 1 -- 172.21.15.17:0/407647694 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1809adc0 con 0x562cbc4ce2d0 2023-07-14T13:00:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.219+0000 7f2c13fff700 1 -- 172.21.15.17:0/407647694 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c1809edf0 con 0x562cbc4ce2d0 2023-07-14T13:00:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.219+0000 7f2c13fff700 1 -- 172.21.15.17:0/407647694 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c180a2f50 con 0x562cbc4ce2d0 2023-07-14T13:00:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.219+0000 7f2c4380eb80 1 -- 172.21.15.17:0/407647694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 msgr2=0x562cbc4c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.219+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/407647694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4c8040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2c180cb480 tx=0x7f2c1809ac10 comp rx=0 tx=0).stop 2023-07-14T13:00:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.219+0000 7f2c4380eb80 1 -- 172.21.15.17:0/407647694 shutdown_connections 2023-07-14T13:00:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.219+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/407647694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.219+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/407647694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.219+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/407647694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4c8040 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.219+0000 7f2c4380eb80 1 -- 172.21.15.17:0/407647694 >> 172.21.15.17:0/407647694 conn(0x562cbc4bdbe0 msgr2=0x562cbc4c2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.220+0000 7f2c4380eb80 1 -- 172.21.15.17:0/407647694 shutdown_connections 2023-07-14T13:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.220+0000 7f2c4380eb80 1 -- 172.21.15.17:0/407647694 wait complete. 2023-07-14T13:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.220+0000 7f2c4380eb80 1 -- start start 2023-07-14T13:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.221+0000 7f2c4380eb80 1 Processor -- start 2023-07-14T13:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.221+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4d7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.221+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4d7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.221+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.221+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc3b9a60 con 0x562cbc4c8580 2023-07-14T13:00:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.221+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc3b9760 con 0x562cbc3246b0 2023-07-14T13:00:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.221+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc29d8c0 con 0x562cbc4ce2d0 2023-07-14T13:00:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.221+0000 7f2c4380eb80 10 client.0 _ll_register_callbacks cb 0x562cbc3b7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2d39a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4d7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2d39a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4d7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34066/0 (socket says 172.21.15.17:34066) 2023-07-14T13:00:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2d39a700 1 -- 172.21.15.17:0/738869948 learned_addr learned my addr 172.21.15.17:0/738869948 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2db9b700 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4d7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2e39c700 1 -- 172.21.15.17:0/738869948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 msgr2=0x562cbc4d7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:27.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4d7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2e39c700 1 -- 172.21.15.17:0/738869948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 msgr2=0x562cbc4d7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:27.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4d7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2e39c700 1 -- 172.21.15.17:0/738869948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c281a4d10 con 0x562cbc4ce2d0 2023-07-14T13:00:27.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4d7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:27.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4d1590 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2c2001cfd0 tx=0x7f2c20023000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1c341050cb9c219 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.222+0000 7f2c117fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:00:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.223+0000 7f2c117fa700 1 -- 172.21.15.17:0/738869948 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20009d20 con 0x562cbc4ce2d0 2023-07-14T13:00:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.223+0000 7f2c117fa700 1 -- 172.21.15.17:0/738869948 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2c2001c720 con 0x562cbc4ce2d0 2023-07-14T13:00:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.223+0000 7f2c4380eb80 1 -- 172.21.15.17:0/738869948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562cbc373490 con 0x562cbc4ce2d0 2023-07-14T13:00:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.223+0000 7f2c117fa700 1 -- 172.21.15.17:0/738869948 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c2001c8e0 con 0x562cbc4ce2d0 2023-07-14T13:00:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.223+0000 7f2c4380eb80 10 client.25555 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.223+0000 7f2c4380eb80 1 -- 172.21.15.17:0/738869948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x562cbc230c00 con 0x562cbc4ce2d0 2023-07-14T13:00:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.223+0000 7f2c117fa700 1 -- 172.21.15.17:0/738869948 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562cbc373490 con 0x562cbc4ce2d0 2023-07-14T13:00:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.223+0000 7f2c117fa700 1 -- 172.21.15.17:0/738869948 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2c2003b430 con 0x562cbc4ce2d0 2023-07-14T13:00:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.224+0000 7f2c4380eb80 10 client.25555 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.224+0000 7f2c4380eb80 10 client.25555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.224+0000 7f2c4380eb80 20 client.25555 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.224+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562cbc4e1820 0x562cbc4e3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.224+0000 7f2c4380eb80 4 client.25555 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.224+0000 7f2c4380eb80 1 -- 172.21.15.17:0/738869948 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562cbc412e50 con 0x562cbc4e1820 2023-07-14T13:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.224+0000 7f2c2db9b700 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562cbc4e1820 0x562cbc4e3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.225+0000 7f2c2db9b700 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562cbc4e1820 0x562cbc4e3c30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34b5f2c057d16683 server_cookie=9154454821d48e5 in_seq=0 out_seq=0 2023-07-14T13:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.225+0000 7f2c117fa700 10 client.25555 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.225+0000 7f2c117fa700 1 -- 172.21.15.17:0/738869948 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562cbc412e50 con 0x562cbc4e1820 2023-07-14T13:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.225+0000 7f2c117fa700 10 client.25555 handle_command_reply: tid=0 2023-07-14T13:00:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 1 client.25555 shutdown 2023-07-14T13:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 1 -- 172.21.15.17:0/738869948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 msgr2=0x562cbc4d1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4d1590 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2c2001cfd0 tx=0x7f2c20023000 comp rx=0 tx=0).stop 2023-07-14T13:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 1 -- 172.21.15.17:0/738869948 shutdown_connections 2023-07-14T13:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562cbc4e1820 0x562cbc4e3c30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4d1590 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4d7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c117fa700 0 client.25555 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/738869948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4d7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 1 -- 172.21.15.17:0/738869948 >> 172.21.15.17:0/738869948 conn(0x562cbc4bdbe0 msgr2=0x562cbc4c24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 1 -- 172.21.15.17:0/738869948 shutdown_connections 2023-07-14T13:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 1 -- 172.21.15.17:0/738869948 wait complete. 2023-07-14T13:00:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.226+0000 7f2c4380eb80 20 client.25555 trim_cache size 0 max 16384 2023-07-14T13:00:27.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.243+0000 7f2c4380eb80 1 Processor -- start 2023-07-14T13:00:27.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.243+0000 7f2c4380eb80 1 -- start start 2023-07-14T13:00:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.244+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.244+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.244+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.244+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc373490 con 0x562cbc4c8580 2023-07-14T13:00:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.244+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc4cda10 con 0x562cbc3246b0 2023-07-14T13:00:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.244+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc4cfb10 con 0x562cbc4ce2d0 2023-07-14T13:00:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.244+0000 7f2c2d39a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.244+0000 7f2c2d39a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34078/0 (socket says 172.21.15.17:34078) 2023-07-14T13:00:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.244+0000 7f2c2d39a700 1 -- 172.21.15.17:0/1160270255 learned_addr learned my addr 172.21.15.17:0/1160270255 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.244+0000 7f2c2db9b700 1 --2- 172.21.15.17:0/1160270255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.244+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/1160270255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.245+0000 7f2c2d39a700 1 -- 172.21.15.17:0/1160270255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 msgr2=0x562cbc4d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.245+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/1160270255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.245+0000 7f2c2d39a700 1 -- 172.21.15.17:0/1160270255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 msgr2=0x562cbc4c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.245+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/1160270255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.245+0000 7f2c2d39a700 1 -- 172.21.15.17:0/1160270255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cbc26e1f0 con 0x562cbc4c8580 2023-07-14T13:00:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.245+0000 7f2c2db9b700 1 --2- 172.21.15.17:0/1160270255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.245+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/1160270255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.245+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/1160270255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4cf190 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2c1809ad00 tx=0x7f2c1801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f408ae66fbe789d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.245+0000 7f2c1cbff700 1 -- 172.21.15.17:0/1160270255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c180b9120 con 0x562cbc4c8580 2023-07-14T13:00:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.245+0000 7f2c1cbff700 1 -- 172.21.15.17:0/1160270255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c1809adc0 con 0x562cbc4c8580 2023-07-14T13:00:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.245+0000 7f2c1cbff700 1 -- 172.21.15.17:0/1160270255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c180a2f50 con 0x562cbc4c8580 2023-07-14T13:00:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.246+0000 7f2c4380eb80 1 -- 172.21.15.17:0/1160270255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 msgr2=0x562cbc4cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.246+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/1160270255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4cf190 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2c1809ad00 tx=0x7f2c1801a040 comp rx=0 tx=0).stop 2023-07-14T13:00:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.246+0000 7f2c4380eb80 1 -- 172.21.15.17:0/1160270255 shutdown_connections 2023-07-14T13:00:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.246+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/1160270255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc4d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.246+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/1160270255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc3246b0 0x562cbc4c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.246+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/1160270255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc4c8580 0x562cbc4cf190 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.246+0000 7f2c4380eb80 1 -- 172.21.15.17:0/1160270255 >> 172.21.15.17:0/1160270255 conn(0x562cbc4bdbe0 msgr2=0x562cbc4d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:27.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.246+0000 7f2c4380eb80 1 -- 172.21.15.17:0/1160270255 shutdown_connections 2023-07-14T13:00:27.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.246+0000 7f2c4380eb80 1 -- 172.21.15.17:0/1160270255 wait complete. 2023-07-14T13:00:27.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.247+0000 7f2c4380eb80 1 -- start start 2023-07-14T13:00:27.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.247+0000 7f2c4380eb80 1 Processor -- start 2023-07-14T13:00:27.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.247+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc3246b0 0x562cbc4d56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.247+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc4c8580 0x562cbc4d5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.247+0000 7f2c4380eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc52e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc52ebb0 con 0x562cbc3246b0 2023-07-14T13:00:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc52ed20 con 0x562cbc4c8580 2023-07-14T13:00:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c4380eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cbc52eee0 con 0x562cbc4ce2d0 2023-07-14T13:00:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c4380eb80 10 client.0 _ll_register_callbacks cb 0x7f2c2001cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c2db9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc3246b0 0x562cbc4d56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c2db9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc3246b0 0x562cbc4d56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34086/0 (socket says 172.21.15.17:34086) 2023-07-14T13:00:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c2db9b700 1 -- 172.21.15.17:0/3323066687 learned_addr learned my addr 172.21.15.17:0/3323066687 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc52e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc4c8580 0x562cbc4d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c2db9b700 1 -- 172.21.15.17:0/3323066687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 msgr2=0x562cbc52e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c2db9b700 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc52e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c2db9b700 1 -- 172.21.15.17:0/3323066687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc4c8580 msgr2=0x562cbc4d5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c2db9b700 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc4c8580 0x562cbc4d5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.248+0000 7f2c2db9b700 1 -- 172.21.15.17:0/3323066687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c24009bc0 con 0x562cbc3246b0 2023-07-14T13:00:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.249+0000 7f2c2e39c700 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc52e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.249+0000 7f2c2db9b700 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc3246b0 0x562cbc4d56e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2c24004790 tx=0x7f2c2401ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e82fbea38c7ed5d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.249+0000 7f2c117fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.249+0000 7f2c117fa700 1 -- 172.21.15.17:0/3323066687 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24017040 con 0x562cbc3246b0 2023-07-14T13:00:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.249+0000 7f2c4380eb80 1 -- 172.21.15.17:0/3323066687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c1809edf0 con 0x562cbc3246b0 2023-07-14T13:00:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.249+0000 7f2c117fa700 1 -- 172.21.15.17:0/3323066687 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2c240109a0 con 0x562cbc3246b0 2023-07-14T13:00:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.249+0000 7f2c117fa700 1 -- 172.21.15.17:0/3323066687 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c24010b60 con 0x562cbc3246b0 2023-07-14T13:00:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.249+0000 7f2c4380eb80 10 client.15825 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.249+0000 7f2c4380eb80 1 -- 172.21.15.17:0/3323066687 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x562cbc247d80 con 0x562cbc3246b0 2023-07-14T13:00:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.250+0000 7f2c117fa700 1 -- 172.21.15.17:0/3323066687 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c1809edf0 con 0x562cbc3246b0 2023-07-14T13:00:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.250+0000 7f2c117fa700 1 -- 172.21.15.17:0/3323066687 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2c240051e0 con 0x562cbc3246b0 2023-07-14T13:00:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.250+0000 7f2c4380eb80 10 client.15825 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.250+0000 7f2c4380eb80 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.250+0000 7f2c4380eb80 20 client.15825 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.250+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562cbc536780 0x562cbc538b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.250+0000 7f2c4380eb80 4 client.15825 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:00:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.250+0000 7f2c4380eb80 1 -- 172.21.15.17:0/3323066687 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562cbc3d4ff0 con 0x562cbc536780 2023-07-14T13:00:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.250+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562cbc536780 0x562cbc538b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.251+0000 7f2c2d39a700 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562cbc536780 0x562cbc538b90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d991950ce35e2c6b server_cookie=7c9003f4b3a94bd6 in_seq=0 out_seq=0 2023-07-14T13:00:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.251+0000 7f2c117fa700 10 client.15825 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c117fa700 1 -- 172.21.15.17:0/3323066687 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562cbc3d4ff0 con 0x562cbc536780 2023-07-14T13:00:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c117fa700 10 client.15825 handle_command_reply: tid=0 2023-07-14T13:00:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 1 client.15825 shutdown 2023-07-14T13:00:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 1 -- 172.21.15.17:0/3323066687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc3246b0 msgr2=0x562cbc4d56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc3246b0 0x562cbc4d56e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2c24004790 tx=0x7f2c2401ff00 comp rx=0 tx=0).stop 2023-07-14T13:00:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 1 -- 172.21.15.17:0/3323066687 shutdown_connections 2023-07-14T13:00:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562cbc536780 0x562cbc538b90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562cbc4ce2d0 0x562cbc52e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562cbc3246b0 0x562cbc4d56e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 1 --2- 172.21.15.17:0/3323066687 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562cbc4c8580 0x562cbc4d5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c117fa700 0 client.15825 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 1 -- 172.21.15.17:0/3323066687 >> 172.21.15.17:0/3323066687 conn(0x562cbc4bdbe0 msgr2=0x562cbc4ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 1 -- 172.21.15.17:0/3323066687 shutdown_connections 2023-07-14T13:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 1 -- 172.21.15.17:0/3323066687 wait complete. 2023-07-14T13:00:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.268+0000 7f2c4380eb80 20 client.15825 trim_cache size 0 max 16384 2023-07-14T13:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:00:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.269+0000 7f2c2fdff700 1 -- 172.21.15.17:0/2489449075 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c140a13e0 msgr2=0x7f2c140a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.269+0000 7f2c2fdff700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c140a13e0 0x7f2c140a3890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c20011700 tx=0x7f2c2001cb40 comp rx=0 tx=0).stop 2023-07-14T13:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.269+0000 7f2c2fdff700 1 -- 172.21.15.17:0/2489449075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c280685b0 msgr2=0x7f2c281982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.269+0000 7f2c2fdff700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c280685b0 0x7f2c281982b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009fd0 tx=0x7f2c18009580 comp rx=0 tx=0).stop 2023-07-14T13:00:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.269+0000 7f2c2fdff700 1 -- 172.21.15.17:0/2489449075 shutdown_connections 2023-07-14T13:00:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.269+0000 7f2c2fdff700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c140a13e0 0x7f2c140a3890 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.269+0000 7f2c2fdff700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c28104e50 0x7f2c2819c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.269+0000 7f2c2fdff700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c28067c10 0x7f2c28197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.269+0000 7f2c2fdff700 1 --2- 172.21.15.17:0/2489449075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c280685b0 0x7f2c281982b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.269+0000 7f2c2fdff700 1 -- 172.21.15.17:0/2489449075 >> 172.21.15.17:0/2489449075 conn(0x7f2c28074760 msgr2=0x7f2c280fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.269+0000 7f2c2fdff700 1 -- 172.21.15.17:0/2489449075 shutdown_connections 2023-07-14T13:00:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:27.270+0000 7f2c2fdff700 1 -- 172.21.15.17:0/2489449075 wait complete. 2023-07-14T13:00:27.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:27 smithi017 ceph-mon[95536]: pgmap v24: 97 pgs: 97 active+clean; 246 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 32 MiB/s wr, 158 op/s 2023-07-14T13:00:27.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:27 smithi135 ceph-mon[97338]: pgmap v24: 97 pgs: 97 active+clean; 246 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 32 MiB/s wr, 158 op/s 2023-07-14T13:00:27.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:27 smithi131 ceph-mon[96953]: pgmap v24: 97 pgs: 97 active+clean; 246 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 32 MiB/s wr, 158 op/s 2023-07-14T13:00:28.592 INFO:teuthology.orchestra.run.smithi017.stderr:1100000 of 50000000 tuples (2%) done (elapsed 18.20 s, remaining 808.93 s) 2023-07-14T13:00:29.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:29 smithi017 ceph-mon[95536]: pgmap v25: 97 pgs: 97 active+clean; 246 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:00:29.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:29 smithi135 ceph-mon[97338]: pgmap v25: 97 pgs: 97 active+clean; 246 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:00:29.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:29 smithi131 ceph-mon[96953]: pgmap v25: 97 pgs: 97 active+clean; 246 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:00:29.921 INFO:teuthology.orchestra.run.smithi017.stderr:1200000 of 50000000 tuples (2%) done (elapsed 19.53 s, remaining 794.07 s) 2023-07-14T13:00:31.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:31 smithi017 ceph-mon[95536]: pgmap v26: 97 pgs: 97 active+clean; 266 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-14T13:00:31.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:31 smithi135 ceph-mon[97338]: pgmap v26: 97 pgs: 97 active+clean; 266 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-14T13:00:31.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:31 smithi131 ceph-mon[96953]: pgmap v26: 97 pgs: 97 active+clean; 266 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-14T13:00:31.704 INFO:teuthology.orchestra.run.smithi017.stderr:1300000 of 50000000 tuples (2%) done (elapsed 21.31 s, remaining 798.26 s) 2023-07-14T13:00:33.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:33 smithi017 ceph-mon[95536]: pgmap v27: 97 pgs: 97 active+clean; 314 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 31 MiB/s wr, 38 op/s 2023-07-14T13:00:33.441 INFO:teuthology.orchestra.run.smithi017.stderr:1400000 of 50000000 tuples (2%) done (elapsed 23.05 s, remaining 800.03 s) 2023-07-14T13:00:33.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:33 smithi135 ceph-mon[97338]: pgmap v27: 97 pgs: 97 active+clean; 314 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 31 MiB/s wr, 38 op/s 2023-07-14T13:00:33.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:33 smithi131 ceph-mon[96953]: pgmap v27: 97 pgs: 97 active+clean; 314 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 31 MiB/s wr, 38 op/s 2023-07-14T13:00:34.780 INFO:teuthology.orchestra.run.smithi017.stderr:1500000 of 50000000 tuples (3%) done (elapsed 24.39 s, remaining 788.46 s) 2023-07-14T13:00:35.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:35 smithi017 ceph-mon[95536]: pgmap v28: 97 pgs: 97 active+clean; 314 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 23 MiB/s wr, 28 op/s 2023-07-14T13:00:35.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:35 smithi135 ceph-mon[97338]: pgmap v28: 97 pgs: 97 active+clean; 314 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 23 MiB/s wr, 28 op/s 2023-07-14T13:00:35.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:35 smithi131 ceph-mon[96953]: pgmap v28: 97 pgs: 97 active+clean; 314 MiB data, 492 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 23 MiB/s wr, 28 op/s 2023-07-14T13:00:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:1600000 of 50000000 tuples (3%) done (elapsed 26.25 s, remaining 794.12 s) 2023-07-14T13:00:37.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:37 smithi017 ceph-mon[95536]: pgmap v29: 97 pgs: 97 active+clean; 386 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 35 MiB/s wr, 39 op/s 2023-07-14T13:00:37.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:37 smithi135 ceph-mon[97338]: pgmap v29: 97 pgs: 97 active+clean; 386 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 35 MiB/s wr, 39 op/s 2023-07-14T13:00:37.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:37 smithi131 ceph-mon[96953]: pgmap v29: 97 pgs: 97 active+clean; 386 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 35 MiB/s wr, 39 op/s 2023-07-14T13:00:37.998 INFO:teuthology.orchestra.run.smithi017.stderr:1700000 of 50000000 tuples (3%) done (elapsed 27.60 s, remaining 784.21 s) 2023-07-14T13:00:39.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:39 smithi017 ceph-mon[95536]: pgmap v30: 97 pgs: 97 active+clean; 386 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-07-14T13:00:39.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:39 smithi135 ceph-mon[97338]: pgmap v30: 97 pgs: 97 active+clean; 386 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-07-14T13:00:39.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:39 smithi131 ceph-mon[96953]: pgmap v30: 97 pgs: 97 active+clean; 386 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 MiB/s wr, 25 op/s 2023-07-14T13:00:39.860 INFO:teuthology.orchestra.run.smithi017.stderr:1800000 of 50000000 tuples (3%) done (elapsed 29.47 s, remaining 789.02 s) 2023-07-14T13:00:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.451+0000 7faced99d700 1 -- 172.21.15.17:0/2645879965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face80ff930 msgr2=0x7face80ffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.451+0000 7faced99d700 1 --2- 172.21.15.17:0/2645879965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face80ff930 0x7face80ffda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7facd40098f0 tx=0x7facd4009c00 comp rx=0 tx=0).stop 2023-07-14T13:00:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.451+0000 7faced99d700 1 -- 172.21.15.17:0/2645879965 shutdown_connections 2023-07-14T13:00:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.451+0000 7faced99d700 1 --2- 172.21.15.17:0/2645879965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face81002e0 0x7face810c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.451+0000 7faced99d700 1 --2- 172.21.15.17:0/2645879965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face8105940 0x7face8105d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.451+0000 7faced99d700 1 --2- 172.21.15.17:0/2645879965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face80ff930 0x7face80ffda0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.451+0000 7faced99d700 1 -- 172.21.15.17:0/2645879965 >> 172.21.15.17:0/2645879965 conn(0x7face80fb450 msgr2=0x7face80fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.451+0000 7faced99d700 1 -- 172.21.15.17:0/2645879965 shutdown_connections 2023-07-14T13:00:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.451+0000 7faced99d700 1 -- 172.21.15.17:0/2645879965 wait complete. 2023-07-14T13:00:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.452+0000 7faced99d700 1 Processor -- start 2023-07-14T13:00:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.452+0000 7faced99d700 1 -- start start 2023-07-14T13:00:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7faced99d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face80ff930 0x7face8072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7faced99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face81002e0 0x7face8072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7faced99d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8105940 0x7face81a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7faced99d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face8073580 con 0x7face8105940 2023-07-14T13:00:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7faced99d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face81a40c0 con 0x7face80ff930 2023-07-14T13:00:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7faced99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face81a4200 con 0x7face81002e0 2023-07-14T13:00:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7facec99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face80ff930 0x7face8072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7faced19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8105940 0x7face81a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7face7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face81002e0 0x7face8072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7face7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face81002e0 0x7face8072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59192/0 (socket says 172.21.15.17:59192) 2023-07-14T13:00:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7face7fff700 1 -- 172.21.15.17:0/1953300255 learned_addr learned my addr 172.21.15.17:0/1953300255 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7faced19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8105940 0x7face81a3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60936/0 (socket says 172.21.15.17:60936) 2023-07-14T13:00:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.453+0000 7facec99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face80ff930 0x7face8072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54344/0 (socket says 172.21.15.17:54344) 2023-07-14T13:00:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.454+0000 7face7fff700 1 -- 172.21.15.17:0/1953300255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face80ff930 msgr2=0x7face8072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.454+0000 7face7fff700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face80ff930 0x7face8072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.454+0000 7face7fff700 1 -- 172.21.15.17:0/1953300255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8105940 msgr2=0x7face81a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.454+0000 7face7fff700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8105940 0x7face81a3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.454+0000 7face7fff700 1 -- 172.21.15.17:0/1953300255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd4009520 con 0x7face81002e0 2023-07-14T13:00:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.454+0000 7face7fff700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face81002e0 0x7face8072d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7facd4009810 tx=0x7facd400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.454+0000 7face5ffb700 1 -- 172.21.15.17:0/1953300255 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd401c070 con 0x7face81002e0 2023-07-14T13:00:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.455+0000 7faced99d700 1 -- 172.21.15.17:0/1953300255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face81a4400 con 0x7face81002e0 2023-07-14T13:00:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.455+0000 7face5ffb700 1 -- 172.21.15.17:0/1953300255 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facd400baf0 con 0x7face81002e0 2023-07-14T13:00:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.455+0000 7face5ffb700 1 -- 172.21.15.17:0/1953300255 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4004930 con 0x7face81002e0 2023-07-14T13:00:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.455+0000 7faced99d700 1 -- 172.21.15.17:0/1953300255 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face81a4880 con 0x7face81002e0 2023-07-14T13:00:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.459+0000 7face5ffb700 1 -- 172.21.15.17:0/1953300255 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7facd4020070 con 0x7face81002e0 2023-07-14T13:00:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.460+0000 7face5ffb700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7facd80a13e0 0x7facd80a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.461+0000 7face5ffb700 1 -- 172.21.15.17:0/1953300255 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7facd40cdc30 con 0x7face81002e0 2023-07-14T13:00:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.461+0000 7fad02581b80 1 Processor -- start 2023-07-14T13:00:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.461+0000 7facec99b700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7facd80a13e0 0x7facd80a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.461+0000 7fad02581b80 1 -- start start 2023-07-14T13:00:40.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.461+0000 7fad02581b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be89806b0 0x555be8b29f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.461+0000 7fad02581b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a470 0x555be8b241a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.461+0000 7fad02581b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be8b2a8c0 0x555be8b24700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7fad02581b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be8a29c50 con 0x555be89806b0 2023-07-14T13:00:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7fad02581b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be8a7c9e0 con 0x555be8b2a470 2023-07-14T13:00:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7fad02581b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be8a75e70 con 0x555be8b2a8c0 2023-07-14T13:00:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7facec99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be89806b0 0x555be8b29f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7facec99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be89806b0 0x555be8b29f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60938/0 (socket says 172.21.15.17:60938) 2023-07-14T13:00:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7facec99b700 1 -- 172.21.15.17:0/2438266467 learned_addr learned my addr 172.21.15.17:0/2438266467 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7face7fff700 1 --2- 172.21.15.17:0/2438266467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a470 0x555be8b241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7faced19c700 1 --2- 172.21.15.17:0/2438266467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be8b2a8c0 0x555be8b24700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7facec99b700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7facd80a13e0 0x7facd80a3890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7face8100a70 tx=0x7facdc011440 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7facec99b700 1 -- 172.21.15.17:0/2438266467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be8b2a8c0 msgr2=0x555be8b24700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7facec99b700 1 --2- 172.21.15.17:0/2438266467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be8b2a8c0 0x555be8b24700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7facec99b700 1 -- 172.21.15.17:0/2438266467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a470 msgr2=0x555be8b241a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7facec99b700 1 --2- 172.21.15.17:0/2438266467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a470 0x555be8b241a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.462+0000 7facec99b700 1 -- 172.21.15.17:0/2438266467 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555be88a3d80 con 0x555be89806b0 2023-07-14T13:00:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.463+0000 7facec99b700 1 --2- 172.21.15.17:0/2438266467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be89806b0 0x555be8b29f30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7facdc011e40 tx=0x7facdc01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeaa4e6c235fb62a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.463+0000 7facd2ffd700 1 -- 172.21.15.17:0/2438266467 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc01de70 con 0x555be89806b0 2023-07-14T13:00:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.463+0000 7facd2ffd700 1 -- 172.21.15.17:0/2438266467 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facdc00f850 con 0x555be89806b0 2023-07-14T13:00:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.463+0000 7facd2ffd700 1 -- 172.21.15.17:0/2438266467 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc00e6f0 con 0x555be89806b0 2023-07-14T13:00:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.464+0000 7fad02581b80 1 -- 172.21.15.17:0/2438266467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be89806b0 msgr2=0x555be8b29f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.464+0000 7fad02581b80 1 --2- 172.21.15.17:0/2438266467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be89806b0 0x555be8b29f30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7facdc011e40 tx=0x7facdc01c000 comp rx=0 tx=0).stop 2023-07-14T13:00:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.464+0000 7fad02581b80 1 -- 172.21.15.17:0/2438266467 shutdown_connections 2023-07-14T13:00:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.464+0000 7fad02581b80 1 --2- 172.21.15.17:0/2438266467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be8b2a8c0 0x555be8b24700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.464+0000 7fad02581b80 1 --2- 172.21.15.17:0/2438266467 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be89806b0 0x555be8b29f30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.464+0000 7fad02581b80 1 --2- 172.21.15.17:0/2438266467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a470 0x555be8b241a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.464+0000 7fad02581b80 1 -- 172.21.15.17:0/2438266467 >> 172.21.15.17:0/2438266467 conn(0x555be8b19d40 msgr2=0x555be8b1f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.464+0000 7fad02581b80 1 -- 172.21.15.17:0/2438266467 shutdown_connections 2023-07-14T13:00:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.464+0000 7fad02581b80 1 -- 172.21.15.17:0/2438266467 wait complete. 2023-07-14T13:00:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.465+0000 7fad02581b80 1 -- start start 2023-07-14T13:00:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.465+0000 7fad02581b80 1 Processor -- start 2023-07-14T13:00:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7fad02581b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be89806b0 0x555be8b30800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7fad02581b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 0x555be8b2da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7fad02581b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a8c0 0x555be8b2e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7fad02581b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be8a15a60 con 0x555be8b2a470 2023-07-14T13:00:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7fad02581b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be8a15760 con 0x555be8b2a8c0 2023-07-14T13:00:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7fad02581b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be88f98c0 con 0x555be89806b0 2023-07-14T13:00:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7fad02581b80 10 client.0 _ll_register_callbacks cb 0x555be8a13700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7face7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 0x555be8b2da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7face7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 0x555be8b2da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60946/0 (socket says 172.21.15.17:60946) 2023-07-14T13:00:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7face7fff700 1 -- 172.21.15.17:0/2374350476 learned_addr learned my addr 172.21.15.17:0/2374350476 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7facec99b700 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be89806b0 0x555be8b30800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7faced19c700 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a8c0 0x555be8b2e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7face7fff700 1 -- 172.21.15.17:0/2374350476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be89806b0 msgr2=0x555be8b30800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7face7fff700 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be89806b0 0x555be8b30800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7face7fff700 1 -- 172.21.15.17:0/2374350476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a8c0 msgr2=0x555be8b2e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7face7fff700 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a8c0 0x555be8b2e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.466+0000 7face7fff700 1 -- 172.21.15.17:0/2374350476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc011b80 con 0x555be8b2a470 2023-07-14T13:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.467+0000 7faced19c700 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a8c0 0x555be8b2e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.467+0000 7face7fff700 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 0x555be8b2da10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7facd409ab20 tx=0x7facd409a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab64f31433afeed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.467+0000 7facc7fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.467+0000 7facc7fff700 1 -- 172.21.15.17:0/2374350476 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40ba040 con 0x555be8b2a470 2023-07-14T13:00:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.467+0000 7facc7fff700 1 -- 172.21.15.17:0/2374350476 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7facd409adf0 con 0x555be8b2a470 2023-07-14T13:00:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.467+0000 7fad02581b80 1 -- 172.21.15.17:0/2374350476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555be89cf490 con 0x555be8b2a470 2023-07-14T13:00:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.468+0000 7facc7fff700 1 -- 172.21.15.17:0/2374350476 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7facd40053c0 con 0x555be8b2a470 2023-07-14T13:00:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.468+0000 7fad02581b80 10 client.15837 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.468+0000 7fad02581b80 1 -- 172.21.15.17:0/2374350476 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x555be888cc00 con 0x555be8b2a470 2023-07-14T13:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.468+0000 7facc7fff700 1 -- 172.21.15.17:0/2374350476 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555be89cf490 con 0x555be8b2a470 2023-07-14T13:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.468+0000 7facc7fff700 1 -- 172.21.15.17:0/2374350476 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7facd40a2ac0 con 0x555be8b2a470 2023-07-14T13:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.468+0000 7fad02581b80 10 client.15837 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.468+0000 7fad02581b80 10 client.15837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.468+0000 7fad02581b80 20 client.15837 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.468+0000 7fad02581b80 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555be8b3d9b0 0x555be8b3fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.468+0000 7fad02581b80 4 client.15837 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.468+0000 7fad02581b80 1 -- 172.21.15.17:0/2374350476 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555be8a6ee50 con 0x555be8b3d9b0 2023-07-14T13:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.469+0000 7facec99b700 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555be8b3d9b0 0x555be8b3fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.470+0000 7facec99b700 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555be8b3d9b0 0x555be8b3fdc0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70c4f8bc643a17e8 server_cookie=36b453ff971cc1c4 in_seq=0 out_seq=0 2023-07-14T13:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.470+0000 7facc7fff700 10 client.15837 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.470+0000 7facc7fff700 1 -- 172.21.15.17:0/2374350476 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555be8a6ee50 con 0x555be8b3d9b0 2023-07-14T13:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.470+0000 7facc7fff700 10 client.15837 handle_command_reply: tid=0 2023-07-14T13:00:40.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.470+0000 7fad02581b80 1 client.15837 shutdown 2023-07-14T13:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7fad02581b80 1 -- 172.21.15.17:0/2374350476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 msgr2=0x555be8b2da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7fad02581b80 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 0x555be8b2da10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7facd409ab20 tx=0x7facd409a5e0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7fad02581b80 1 -- 172.21.15.17:0/2374350476 shutdown_connections 2023-07-14T13:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7fad02581b80 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555be8b3d9b0 0x555be8b3fdc0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7fad02581b80 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a8c0 0x555be8b2e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7fad02581b80 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be89806b0 0x555be8b30800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7fad02581b80 1 --2- 172.21.15.17:0/2374350476 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 0x555be8b2da10 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7fad02581b80 1 -- 172.21.15.17:0/2374350476 >> 172.21.15.17:0/2374350476 conn(0x555be8b19d40 msgr2=0x555be8b1e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7facc7fff700 0 client.15837 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7fad02581b80 1 -- 172.21.15.17:0/2374350476 shutdown_connections 2023-07-14T13:00:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7fad02581b80 1 -- 172.21.15.17:0/2374350476 wait complete. 2023-07-14T13:00:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.471+0000 7fad02581b80 20 client.15837 trim_cache size 0 max 16384 2023-07-14T13:00:40.525 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:00:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.494+0000 7fad02581b80 1 Processor -- start 2023-07-14T13:00:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.494+0000 7fad02581b80 1 -- start start 2023-07-14T13:00:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.495+0000 7fad02581b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be89806b0 0x555be8b34e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.495+0000 7fad02581b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a470 0x555be8b30330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.495+0000 7fad02581b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a8c0 0x555be8b1edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.495+0000 7fad02581b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be8a6ee50 con 0x555be8b2a8c0 2023-07-14T13:00:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.495+0000 7fad02581b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be89cf490 con 0x555be8b2a470 2023-07-14T13:00:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.495+0000 7fad02581b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be8b209c0 con 0x555be89806b0 2023-07-14T13:00:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.495+0000 7faced19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a8c0 0x555be8b1edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.495+0000 7faced19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a8c0 0x555be8b1edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60950/0 (socket says 172.21.15.17:60950) 2023-07-14T13:00:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.495+0000 7faced19c700 1 -- 172.21.15.17:0/284913650 learned_addr learned my addr 172.21.15.17:0/284913650 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.495+0000 7face7fff700 1 --2- 172.21.15.17:0/284913650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a470 0x555be8b30330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.496+0000 7facec99b700 1 --2- 172.21.15.17:0/284913650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be89806b0 0x555be8b34e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.496+0000 7face7fff700 1 -- 172.21.15.17:0/284913650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be89806b0 msgr2=0x555be8b34e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.496+0000 7face7fff700 1 --2- 172.21.15.17:0/284913650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be89806b0 0x555be8b34e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.496+0000 7face7fff700 1 -- 172.21.15.17:0/284913650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a8c0 msgr2=0x555be8b1edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.496+0000 7face7fff700 1 --2- 172.21.15.17:0/284913650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a8c0 0x555be8b1edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.496+0000 7face7fff700 1 -- 172.21.15.17:0/284913650 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555be88ca1f0 con 0x555be8b2a470 2023-07-14T13:00:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.496+0000 7face7fff700 1 --2- 172.21.15.17:0/284913650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a470 0x555be8b30330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7facd4098ee0 tx=0x7facd4096ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f69c39573ca661 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.497+0000 7facd37fe700 1 -- 172.21.15.17:0/284913650 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40ba040 con 0x555be8b2a470 2023-07-14T13:00:40.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.497+0000 7facd37fe700 1 -- 172.21.15.17:0/284913650 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facd40053c0 con 0x555be8b2a470 2023-07-14T13:00:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.497+0000 7facd37fe700 1 -- 172.21.15.17:0/284913650 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd409a080 con 0x555be8b2a470 2023-07-14T13:00:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.498+0000 7fad02581b80 1 -- 172.21.15.17:0/284913650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a470 msgr2=0x555be8b30330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.498+0000 7fad02581b80 1 --2- 172.21.15.17:0/284913650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a470 0x555be8b30330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7facd4098ee0 tx=0x7facd4096ed0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.498+0000 7fad02581b80 1 -- 172.21.15.17:0/284913650 shutdown_connections 2023-07-14T13:00:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.498+0000 7fad02581b80 1 --2- 172.21.15.17:0/284913650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a8c0 0x555be8b1edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.498+0000 7fad02581b80 1 --2- 172.21.15.17:0/284913650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be89806b0 0x555be8b34e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.498+0000 7fad02581b80 1 --2- 172.21.15.17:0/284913650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be8b2a470 0x555be8b30330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.498+0000 7fad02581b80 1 -- 172.21.15.17:0/284913650 >> 172.21.15.17:0/284913650 conn(0x555be8b19d40 msgr2=0x555be8b27b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.498+0000 7fad02581b80 1 -- 172.21.15.17:0/284913650 shutdown_connections 2023-07-14T13:00:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.498+0000 7fad02581b80 1 -- 172.21.15.17:0/284913650 wait complete. 2023-07-14T13:00:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.499+0000 7fad02581b80 1 -- start start 2023-07-14T13:00:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.499+0000 7fad02581b80 1 Processor -- start 2023-07-14T13:00:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.500+0000 7fad02581b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be89806b0 0x555be8b25990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.500+0000 7fad02581b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 0x555be8b25ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.500+0000 7fad02581b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be8b2a8c0 0x555be8b26410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.500+0000 7fad02581b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be8b26950 con 0x555be8b2a470 2023-07-14T13:00:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.500+0000 7fad02581b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be8b26a90 con 0x555be89806b0 2023-07-14T13:00:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.500+0000 7fad02581b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555be8b26c50 con 0x555be8b2a8c0 2023-07-14T13:00:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.500+0000 7fad02581b80 10 client.0 _ll_register_callbacks cb 0x7facd409aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.500+0000 7face7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 0x555be8b25ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.500+0000 7facec99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be89806b0 0x555be8b25990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.500+0000 7facec99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be89806b0 0x555be8b25990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54388/0 (socket says 172.21.15.17:54388) 2023-07-14T13:00:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.500+0000 7facec99b700 1 -- 172.21.15.17:0/3758009861 learned_addr learned my addr 172.21.15.17:0/3758009861 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.501+0000 7faced19c700 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be8b2a8c0 0x555be8b26410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.501+0000 7facec99b700 1 -- 172.21.15.17:0/3758009861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be8b2a8c0 msgr2=0x555be8b26410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.501+0000 7facec99b700 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be8b2a8c0 0x555be8b26410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.501+0000 7facec99b700 1 -- 172.21.15.17:0/3758009861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 msgr2=0x555be8b25ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.501+0000 7facec99b700 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 0x555be8b25ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.501+0000 7facec99b700 1 -- 172.21.15.17:0/3758009861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555be888cc00 con 0x555be89806b0 2023-07-14T13:00:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.501+0000 7face7fff700 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 0x555be8b25ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.501+0000 7facec99b700 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be89806b0 0x555be8b25990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7facdc009aa0 tx=0x7facdc009740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34e68eb945b1b9e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.501+0000 7facc7fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:00:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.502+0000 7facc7fff700 1 -- 172.21.15.17:0/3758009861 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc036070 con 0x555be89806b0 2023-07-14T13:00:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.502+0000 7facc7fff700 1 -- 172.21.15.17:0/3758009861 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7facdc02b030 con 0x555be89806b0 2023-07-14T13:00:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.502+0000 7fad02581b80 1 -- 172.21.15.17:0/3758009861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7facdc00f850 con 0x555be89806b0 2023-07-14T13:00:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.502+0000 7facc7fff700 1 -- 172.21.15.17:0/3758009861 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7facdc005ce0 con 0x555be89806b0 2023-07-14T13:00:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.502+0000 7fad02581b80 10 client.25613 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.502+0000 7fad02581b80 1 -- 172.21.15.17:0/3758009861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x555be88a2250 con 0x555be89806b0 2023-07-14T13:00:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.503+0000 7facc7fff700 1 -- 172.21.15.17:0/3758009861 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facdc00f850 con 0x555be89806b0 2023-07-14T13:00:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.503+0000 7facc7fff700 1 -- 172.21.15.17:0/3758009861 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7facdc039020 con 0x555be89806b0 2023-07-14T13:00:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.503+0000 7fad02581b80 10 client.25613 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.503+0000 7fad02581b80 10 client.25613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:40.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.503+0000 7fad02581b80 20 client.25613 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.503+0000 7fad02581b80 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555be8b92260 0x555be8b94670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.503+0000 7fad02581b80 4 client.25613 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:00:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.503+0000 7fad02581b80 1 -- 172.21.15.17:0/3758009861 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555be8a30ff0 con 0x555be8b92260 2023-07-14T13:00:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.503+0000 7face7fff700 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555be8b92260 0x555be8b94670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.504+0000 7face7fff700 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555be8b92260 0x555be8b94670 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e05978b4a2bfa56 server_cookie=acfcc916dbfba448 in_seq=0 out_seq=0 2023-07-14T13:00:40.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.504+0000 7facc7fff700 10 client.25613 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.522+0000 7facc7fff700 1 -- 172.21.15.17:0/3758009861 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555be8a30ff0 con 0x555be8b92260 2023-07-14T13:00:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.522+0000 7facc7fff700 10 client.25613 handle_command_reply: tid=0 2023-07-14T13:00:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.522+0000 7fad02581b80 1 client.25613 shutdown 2023-07-14T13:00:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.522+0000 7fad02581b80 1 -- 172.21.15.17:0/3758009861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be89806b0 msgr2=0x555be8b25990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.522+0000 7fad02581b80 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be89806b0 0x555be8b25990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7facdc009aa0 tx=0x7facdc009740 comp rx=0 tx=0).stop 2023-07-14T13:00:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.523+0000 7fad02581b80 1 -- 172.21.15.17:0/3758009861 shutdown_connections 2023-07-14T13:00:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.523+0000 7fad02581b80 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555be8b92260 0x555be8b94670 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.523+0000 7fad02581b80 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555be8b2a8c0 0x555be8b26410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.523+0000 7fad02581b80 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555be89806b0 0x555be8b25990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.523+0000 7fad02581b80 1 --2- 172.21.15.17:0/3758009861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555be8b2a470 0x555be8b25ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.523+0000 7fad02581b80 1 -- 172.21.15.17:0/3758009861 >> 172.21.15.17:0/3758009861 conn(0x555be8b19d40 msgr2=0x555be8b2ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.523+0000 7facc7fff700 0 client.25613 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.523+0000 7fad02581b80 1 -- 172.21.15.17:0/3758009861 shutdown_connections 2023-07-14T13:00:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.523+0000 7fad02581b80 1 -- 172.21.15.17:0/3758009861 wait complete. 2023-07-14T13:00:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.523+0000 7fad02581b80 20 client.25613 trim_cache size 0 max 16384 2023-07-14T13:00:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:00:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:00:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:00:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:00:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 -- 172.21.15.17:0/1953300255 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7facd80a13e0 msgr2=0x7facd80a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7facd80a13e0 0x7facd80a3890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7face8100a70 tx=0x7facdc011440 comp rx=0 tx=0).stop 2023-07-14T13:00:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 -- 172.21.15.17:0/1953300255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face81002e0 msgr2=0x7face8072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face81002e0 0x7face8072d50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7facd4009810 tx=0x7facd400fa00 comp rx=0 tx=0).stop 2023-07-14T13:00:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 -- 172.21.15.17:0/1953300255 shutdown_connections 2023-07-14T13:00:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7facd80a13e0 0x7facd80a3890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8105940 0x7face81a3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7face80ff930 0x7face8072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 --2- 172.21.15.17:0/1953300255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7face81002e0 0x7face8072d50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 -- 172.21.15.17:0/1953300255 >> 172.21.15.17:0/1953300255 conn(0x7face80fb450 msgr2=0x7face80fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 -- 172.21.15.17:0/1953300255 shutdown_connections 2023-07-14T13:00:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:40.524+0000 7faced99d700 1 -- 172.21.15.17:0/1953300255 wait complete. 2023-07-14T13:00:40.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.748+0000 7f46dc7ff700 1 -- 172.21.15.17:0/4273816096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d410a070 msgr2=0x7f46d410c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.748+0000 7f46dc7ff700 1 --2- 172.21.15.17:0/4273816096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d410a070 0x7f46d410c4b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009990 tx=0x7f46cc009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.748+0000 7f46dc7ff700 1 -- 172.21.15.17:0/4273816096 shutdown_connections 2023-07-14T13:00:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.748+0000 7f46dc7ff700 1 --2- 172.21.15.17:0/4273816096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d410a070 0x7f46d410c4b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.748+0000 7f46dc7ff700 1 --2- 172.21.15.17:0/4273816096 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46d4100ca0 0x7f46d4101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.748+0000 7f46dc7ff700 1 --2- 172.21.15.17:0/4273816096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d41015b0 0x7f46d4109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.748+0000 7f46dc7ff700 1 -- 172.21.15.17:0/4273816096 >> 172.21.15.17:0/4273816096 conn(0x7f46d40fa4b0 msgr2=0x7f46d40fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.748+0000 7f46dc7ff700 1 -- 172.21.15.17:0/4273816096 shutdown_connections 2023-07-14T13:00:40.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.748+0000 7f46dc7ff700 1 -- 172.21.15.17:0/4273816096 wait complete. 2023-07-14T13:00:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.750+0000 7f46dc7ff700 1 Processor -- start 2023-07-14T13:00:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.750+0000 7f46dc7ff700 1 -- start start 2023-07-14T13:00:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.750+0000 7f46dc7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d4100ca0 0x7f46d419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.750+0000 7f46dc7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d41015b0 0x7f46d419c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.750+0000 7f46dc7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46d410a070 0x7f46d4195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.750+0000 7f46dc7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d41961a0 con 0x7f46d41015b0 2023-07-14T13:00:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.750+0000 7f46dc7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d4196310 con 0x7f46d410a070 2023-07-14T13:00:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.750+0000 7f46dc7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d41964d0 con 0x7f46d4100ca0 2023-07-14T13:00:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.751+0000 7f46d9d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d41015b0 0x7f46d419c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.751+0000 7f46d9d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d41015b0 0x7f46d419c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60970/0 (socket says 172.21.15.17:60970) 2023-07-14T13:00:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.751+0000 7f46d9d9a700 1 -- 172.21.15.17:0/1951505398 learned_addr learned my addr 172.21.15.17:0/1951505398 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:40.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.751+0000 7f46dad9c700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46d410a070 0x7f46d4195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.751+0000 7f46da59b700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d4100ca0 0x7f46d419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.751+0000 7f46d9d9a700 1 -- 172.21.15.17:0/1951505398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d4100ca0 msgr2=0x7f46d419bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.751+0000 7f46d9d9a700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d4100ca0 0x7f46d419bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.751+0000 7f46d9d9a700 1 -- 172.21.15.17:0/1951505398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46d410a070 msgr2=0x7f46d4195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.751+0000 7f46d9d9a700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46d410a070 0x7f46d4195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.751+0000 7f46d9d9a700 1 -- 172.21.15.17:0/1951505398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc0095f0 con 0x7f46d41015b0 2023-07-14T13:00:40.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.751+0000 7f46d9d9a700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d41015b0 0x7f46d419c000 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f46c400d950 tx=0x7f46c400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.752+0000 7f46cb7fe700 1 -- 172.21.15.17:0/1951505398 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c400f890 con 0x7f46d41015b0 2023-07-14T13:00:40.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.752+0000 7f46dc7ff700 1 -- 172.21.15.17:0/1951505398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d41967b0 con 0x7f46d41015b0 2023-07-14T13:00:40.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.752+0000 7f46cb7fe700 1 -- 172.21.15.17:0/1951505398 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46c400fe80 con 0x7f46d41015b0 2023-07-14T13:00:40.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.752+0000 7f46cb7fe700 1 -- 172.21.15.17:0/1951505398 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c400e3b0 con 0x7f46d41015b0 2023-07-14T13:00:40.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.752+0000 7f46dc7ff700 1 -- 172.21.15.17:0/1951505398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d41a2ab0 con 0x7f46d41015b0 2023-07-14T13:00:40.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.757+0000 7f46cb7fe700 1 -- 172.21.15.17:0/1951505398 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f46c4010460 con 0x7f46d41015b0 2023-07-14T13:00:40.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.758+0000 7f46f0114b80 1 Processor -- start 2023-07-14T13:00:40.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.758+0000 7f46f0114b80 1 -- start start 2023-07-14T13:00:40.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.758+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c7166a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.758+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c716be0 0x55cb2c7259a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.758+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c725ee0 0x55cb2c7282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.758+0000 7f46f0114b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c61ccb0 con 0x55cb2c7162d0 2023-07-14T13:00:40.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.758+0000 7f46f0114b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c66fa40 con 0x55cb2c725ee0 2023-07-14T13:00:40.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.758+0000 7f46f0114b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c668ed0 con 0x55cb2c716be0 2023-07-14T13:00:40.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46dad9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c7166a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46dad9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c7166a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60986/0 (socket says 172.21.15.17:60986) 2023-07-14T13:00:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46dad9c700 1 -- 172.21.15.17:0/2579785877 learned_addr learned my addr 172.21.15.17:0/2579785877 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46da59b700 1 --2- 172.21.15.17:0/2579785877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c716be0 0x55cb2c7259a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46cb7fe700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f46c00a13e0 0x7f46c00a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46d9d9a700 1 --2- 172.21.15.17:0/2579785877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c725ee0 0x55cb2c7282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46da59b700 1 -- 172.21.15.17:0/2579785877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c725ee0 msgr2=0x55cb2c7282c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46da59b700 1 --2- 172.21.15.17:0/2579785877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c725ee0 0x55cb2c7282c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46da59b700 1 -- 172.21.15.17:0/2579785877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 msgr2=0x55cb2c7166a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46da59b700 1 --2- 172.21.15.17:0/2579785877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c7166a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46cb7fe700 1 -- 172.21.15.17:0/1951505398 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f46c40cccf0 con 0x7f46d41015b0 2023-07-14T13:00:40.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46da59b700 1 -- 172.21.15.17:0/2579785877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb2c496de0 con 0x55cb2c716be0 2023-07-14T13:00:40.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46dad9c700 1 --2- 172.21.15.17:0/2579785877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c7166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:40.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.759+0000 7f46dad9c700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f46c00a13e0 0x7f46c00a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.760+0000 7f46da59b700 1 --2- 172.21.15.17:0/2579785877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c716be0 0x55cb2c7259a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f46d0011580 tx=0x7f46d0009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77ac499141747b8f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.760+0000 7f46c8ff9700 1 -- 172.21.15.17:0/2579785877 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000e040 con 0x55cb2c716be0 2023-07-14T13:00:40.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.760+0000 7f46c8ff9700 1 -- 172.21.15.17:0/2579785877 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46d000f040 con 0x55cb2c716be0 2023-07-14T13:00:40.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.760+0000 7f46c8ff9700 1 -- 172.21.15.17:0/2579785877 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0004050 con 0x55cb2c716be0 2023-07-14T13:00:40.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.761+0000 7f46dad9c700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f46c00a13e0 0x7f46c00a3890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009990 tx=0x7f46cc009310 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.761+0000 7f46f0114b80 1 -- 172.21.15.17:0/2579785877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c716be0 msgr2=0x55cb2c7259a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.761+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2579785877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c716be0 0x55cb2c7259a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f46d0011580 tx=0x7f46d0009920 comp rx=0 tx=0).stop 2023-07-14T13:00:40.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.761+0000 7f46f0114b80 1 -- 172.21.15.17:0/2579785877 shutdown_connections 2023-07-14T13:00:40.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.761+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2579785877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c725ee0 0x55cb2c7282c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.761+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2579785877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c7166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.761+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2579785877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c716be0 0x55cb2c7259a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.761+0000 7f46f0114b80 1 -- 172.21.15.17:0/2579785877 >> 172.21.15.17:0/2579785877 conn(0x55cb2c70cda0 msgr2=0x55cb2c7126a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.761+0000 7f46f0114b80 1 -- 172.21.15.17:0/2579785877 shutdown_connections 2023-07-14T13:00:40.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.761+0000 7f46f0114b80 1 -- 172.21.15.17:0/2579785877 wait complete. 2023-07-14T13:00:40.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.762+0000 7f46f0114b80 1 -- start start 2023-07-14T13:00:40.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.762+0000 7f46f0114b80 1 Processor -- start 2023-07-14T13:00:40.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.762+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c7162d0 0x55cb2c7258e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.762+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c716be0 0x55cb2c722b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.762+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c725ee0 0x55cb2c723170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.762+0000 7f46f0114b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c608ac0 con 0x55cb2c716be0 2023-07-14T13:00:40.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46f0114b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c6087c0 con 0x55cb2c7162d0 2023-07-14T13:00:40.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46f0114b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c4ec920 con 0x55cb2c725ee0 2023-07-14T13:00:40.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46f0114b80 10 client.0 _ll_register_callbacks cb 0x55cb2c606760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:40.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46d9d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c716be0 0x55cb2c722b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46d9d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c716be0 0x55cb2c722b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60990/0 (socket says 172.21.15.17:60990) 2023-07-14T13:00:40.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46d9d9a700 1 -- 172.21.15.17:0/1064172869 learned_addr learned my addr 172.21.15.17:0/1064172869 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:40.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46da59b700 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c7162d0 0x55cb2c7258e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46dad9c700 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c725ee0 0x55cb2c723170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46d9d9a700 1 -- 172.21.15.17:0/1064172869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c725ee0 msgr2=0x55cb2c723170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46d9d9a700 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c725ee0 0x55cb2c723170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46d9d9a700 1 -- 172.21.15.17:0/1064172869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c7162d0 msgr2=0x55cb2c7258e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46d9d9a700 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c7162d0 0x55cb2c7258e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.763+0000 7f46d9d9a700 1 -- 172.21.15.17:0/1064172869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d410d170 con 0x55cb2c716be0 2023-07-14T13:00:40.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.764+0000 7f46d9d9a700 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c716be0 0x55cb2c722b60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f46c400b2f0 tx=0x7f46c4099620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe2affc8f988686 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.764+0000 7f46bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:40.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.764+0000 7f46bdffb700 1 -- 172.21.15.17:0/1064172869 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4099bc0 con 0x55cb2c716be0 2023-07-14T13:00:40.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.764+0000 7f46f0114b80 1 -- 172.21.15.17:0/1064172869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb2c5c24f0 con 0x55cb2c716be0 2023-07-14T13:00:40.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.764+0000 7f46bdffb700 1 -- 172.21.15.17:0/1064172869 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f46c409dbf0 con 0x55cb2c716be0 2023-07-14T13:00:40.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.764+0000 7f46bdffb700 1 -- 172.21.15.17:0/1064172869 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46c40b2210 con 0x55cb2c716be0 2023-07-14T13:00:40.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.764+0000 7f46f0114b80 10 client.15855 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:40.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.764+0000 7f46f0114b80 1 -- 172.21.15.17:0/1064172869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f46d0011230 con 0x55cb2c716be0 2023-07-14T13:00:40.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.765+0000 7f46bdffb700 1 -- 172.21.15.17:0/1064172869 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46c40b6080 con 0x55cb2c716be0 2023-07-14T13:00:40.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.765+0000 7f46bdffb700 1 -- 172.21.15.17:0/1064172869 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f46c40990b0 con 0x55cb2c716be0 2023-07-14T13:00:40.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.765+0000 7f46f0114b80 10 client.15855 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:40.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.765+0000 7f46f0114b80 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:40.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.765+0000 7f46f0114b80 20 client.15855 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:40.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.765+0000 7f46f0114b80 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cb2c735790 0x55cb2c737ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.765+0000 7f46f0114b80 4 client.15855 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:40.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.765+0000 7f46f0114b80 1 -- 172.21.15.17:0/1064172869 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb2c661eb0 con 0x55cb2c735790 2023-07-14T13:00:40.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.765+0000 7f46da59b700 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cb2c735790 0x55cb2c737ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.766+0000 7f46da59b700 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cb2c735790 0x55cb2c737ba0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78ed9c550bb073db server_cookie=1e676db7b70b4007 in_seq=0 out_seq=0 2023-07-14T13:00:40.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.766+0000 7f46bdffb700 10 client.15855 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:40.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46bdffb700 1 -- 172.21.15.17:0/1064172869 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cb2c661eb0 con 0x55cb2c735790 2023-07-14T13:00:40.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46bdffb700 10 client.15855 handle_command_reply: tid=0 2023-07-14T13:00:40.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46f0114b80 1 client.15855 shutdown 2023-07-14T13:00:40.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46f0114b80 1 -- 172.21.15.17:0/1064172869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c716be0 msgr2=0x55cb2c722b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46f0114b80 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c716be0 0x55cb2c722b60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f46c400b2f0 tx=0x7f46c4099620 comp rx=0 tx=0).stop 2023-07-14T13:00:40.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46f0114b80 1 -- 172.21.15.17:0/1064172869 shutdown_connections 2023-07-14T13:00:40.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46f0114b80 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cb2c735790 0x55cb2c737ba0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46f0114b80 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c725ee0 0x55cb2c723170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46f0114b80 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c7162d0 0x55cb2c7258e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46f0114b80 1 --2- 172.21.15.17:0/1064172869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c716be0 0x55cb2c722b60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46f0114b80 1 -- 172.21.15.17:0/1064172869 >> 172.21.15.17:0/1064172869 conn(0x55cb2c70cda0 msgr2=0x55cb2c712230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46bdffb700 0 client.15855 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:40.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46f0114b80 1 -- 172.21.15.17:0/1064172869 shutdown_connections 2023-07-14T13:00:40.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.767+0000 7f46f0114b80 1 -- 172.21.15.17:0/1064172869 wait complete. 2023-07-14T13:00:40.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.768+0000 7f46f0114b80 20 client.15855 trim_cache size 0 max 16384 2023-07-14T13:00:40.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.786+0000 7f46f0114b80 1 Processor -- start 2023-07-14T13:00:40.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.786+0000 7f46f0114b80 1 -- start start 2023-07-14T13:00:40.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.786+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c72c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.786+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c716be0 0x55cb2c725410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.786+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c725ee0 0x55cb2c71de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.786+0000 7f46f0114b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c713d20 con 0x55cb2c7162d0 2023-07-14T13:00:40.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.786+0000 7f46f0114b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c717540 con 0x55cb2c725ee0 2023-07-14T13:00:40.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.786+0000 7f46f0114b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c717dd0 con 0x55cb2c716be0 2023-07-14T13:00:40.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.787+0000 7f46da59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c72c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.787+0000 7f46da59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c72c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32774/0 (socket says 172.21.15.17:32774) 2023-07-14T13:00:40.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.787+0000 7f46da59b700 1 -- 172.21.15.17:0/2138688989 learned_addr learned my addr 172.21.15.17:0/2138688989 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:40.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.787+0000 7f46d9d9a700 1 --2- 172.21.15.17:0/2138688989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c716be0 0x55cb2c725410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.787+0000 7f46dad9c700 1 --2- 172.21.15.17:0/2138688989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c725ee0 0x55cb2c71de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.787+0000 7f46da59b700 1 -- 172.21.15.17:0/2138688989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c716be0 msgr2=0x55cb2c725410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.787+0000 7f46da59b700 1 --2- 172.21.15.17:0/2138688989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c716be0 0x55cb2c725410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.787+0000 7f46da59b700 1 -- 172.21.15.17:0/2138688989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c725ee0 msgr2=0x55cb2c71de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.787+0000 7f46da59b700 1 --2- 172.21.15.17:0/2138688989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c725ee0 0x55cb2c71de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.787+0000 7f46da59b700 1 -- 172.21.15.17:0/2138688989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb2c47fc60 con 0x55cb2c7162d0 2023-07-14T13:00:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.787+0000 7f46da59b700 1 --2- 172.21.15.17:0/2138688989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c72c8f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f46d0011580 tx=0x7f46d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74c1b5d4e043f45 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.788+0000 7f46c97fa700 1 -- 172.21.15.17:0/2138688989 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000e050 con 0x55cb2c7162d0 2023-07-14T13:00:40.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.788+0000 7f46c97fa700 1 -- 172.21.15.17:0/2138688989 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46d0009630 con 0x55cb2c7162d0 2023-07-14T13:00:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.788+0000 7f46c97fa700 1 -- 172.21.15.17:0/2138688989 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0026bd0 con 0x55cb2c7162d0 2023-07-14T13:00:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.789+0000 7f46f0114b80 1 -- 172.21.15.17:0/2138688989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 msgr2=0x55cb2c72c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.789+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2138688989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c72c8f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f46d0011580 tx=0x7f46d000b040 comp rx=0 tx=0).stop 2023-07-14T13:00:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.789+0000 7f46f0114b80 1 -- 172.21.15.17:0/2138688989 shutdown_connections 2023-07-14T13:00:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.789+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2138688989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c725ee0 0x55cb2c71de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.789+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2138688989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c72c8f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.789+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2138688989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c716be0 0x55cb2c725410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.789+0000 7f46f0114b80 1 -- 172.21.15.17:0/2138688989 >> 172.21.15.17:0/2138688989 conn(0x55cb2c70cda0 msgr2=0x55cb2c7377a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.789+0000 7f46f0114b80 1 -- 172.21.15.17:0/2138688989 shutdown_connections 2023-07-14T13:00:40.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.789+0000 7f46f0114b80 1 -- 172.21.15.17:0/2138688989 wait complete. 2023-07-14T13:00:40.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.790+0000 7f46f0114b80 1 -- start start 2023-07-14T13:00:40.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.790+0000 7f46f0114b80 1 Processor -- start 2023-07-14T13:00:40.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.791+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c72c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.791+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c716be0 0x55cb2c728d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.791+0000 7f46f0114b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c725ee0 0x55cb2c729260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.791+0000 7f46f0114b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c729970 con 0x55cb2c7162d0 2023-07-14T13:00:40.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.791+0000 7f46f0114b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c729ae0 con 0x55cb2c716be0 2023-07-14T13:00:40.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.791+0000 7f46f0114b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2c789650 con 0x55cb2c725ee0 2023-07-14T13:00:40.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.792+0000 7f46f0114b80 10 client.0 _ll_register_callbacks cb 0x7f46c4099990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:40.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.792+0000 7f46d9d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c716be0 0x55cb2c728d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.792+0000 7f46dad9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c725ee0 0x55cb2c729260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.792+0000 7f46d9d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c716be0 0x55cb2c728d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54432/0 (socket says 172.21.15.17:54432) 2023-07-14T13:00:40.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.792+0000 7f46d9d9a700 1 -- 172.21.15.17:0/2832697622 learned_addr learned my addr 172.21.15.17:0/2832697622 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:40.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.792+0000 7f46da59b700 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c72c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.792+0000 7f46d9d9a700 1 -- 172.21.15.17:0/2832697622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c725ee0 msgr2=0x55cb2c729260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.792+0000 7f46d9d9a700 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c725ee0 0x55cb2c729260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.792+0000 7f46d9d9a700 1 -- 172.21.15.17:0/2832697622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 msgr2=0x55cb2c72c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:40.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.792+0000 7f46d9d9a700 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c72c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.793+0000 7f46d9d9a700 1 -- 172.21.15.17:0/2832697622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb2c496de0 con 0x55cb2c716be0 2023-07-14T13:00:40.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.793+0000 7f46d9d9a700 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c716be0 0x55cb2c728d20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f46c40960c0 tx=0x7f46c4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d26ee6aa941b5520 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:40.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.793+0000 7f46bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:00:40.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.793+0000 7f46bdffb700 1 -- 172.21.15.17:0/2832697622 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4014050 con 0x55cb2c716be0 2023-07-14T13:00:40.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.793+0000 7f46bdffb700 1 -- 172.21.15.17:0/2832697622 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f46c409a020 con 0x55cb2c716be0 2023-07-14T13:00:40.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.793+0000 7f46f0114b80 1 -- 172.21.15.17:0/2832697622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46d000f040 con 0x55cb2c716be0 2023-07-14T13:00:40.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.793+0000 7f46bdffb700 1 -- 172.21.15.17:0/2832697622 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46c40ca020 con 0x55cb2c716be0 2023-07-14T13:00:40.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.793+0000 7f46f0114b80 10 client.25631 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:40.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.794+0000 7f46f0114b80 1 -- 172.21.15.17:0/2832697622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55cb2c4bd250 con 0x55cb2c716be0 2023-07-14T13:00:40.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.794+0000 7f46bdffb700 1 -- 172.21.15.17:0/2832697622 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46d000f040 con 0x55cb2c716be0 2023-07-14T13:00:40.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.794+0000 7f46bdffb700 1 -- 172.21.15.17:0/2832697622 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f46c40ca710 con 0x55cb2c716be0 2023-07-14T13:00:40.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.794+0000 7f46f0114b80 10 client.25631 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:40.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.794+0000 7f46f0114b80 10 client.25631 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:40.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.794+0000 7f46f0114b80 20 client.25631 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:40.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.794+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cb2c78a880 0x55cb2c78cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:40.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.794+0000 7f46f0114b80 4 client.25631 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:00:40.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.794+0000 7f46f0114b80 1 -- 172.21.15.17:0/2832697622 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cb2c624050 con 0x55cb2c78a880 2023-07-14T13:00:40.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.795+0000 7f46da59b700 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cb2c78a880 0x55cb2c78cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:40.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.795+0000 7f46bdffb700 10 client.25631 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:40.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.795+0000 7f46da59b700 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cb2c78a880 0x55cb2c78cc90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d9b24d8f2b411bf server_cookie=7940aa98a3ff5fd9 in_seq=0 out_seq=0 2023-07-14T13:00:40.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46bdffb700 1 -- 172.21.15.17:0/2832697622 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55cb2c624050 con 0x55cb2c78a880 2023-07-14T13:00:40.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46bdffb700 10 client.25631 handle_command_reply: tid=0 2023-07-14T13:00:40.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 1 client.25631 shutdown 2023-07-14T13:00:40.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 1 -- 172.21.15.17:0/2832697622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c716be0 msgr2=0x55cb2c728d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c716be0 0x55cb2c728d20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f46c40960c0 tx=0x7f46c4000bc0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 1 -- 172.21.15.17:0/2832697622 shutdown_connections 2023-07-14T13:00:40.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cb2c78a880 0x55cb2c78cc90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb2c725ee0 0x55cb2c729260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46bdffb700 0 client.25631 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:40.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb2c7162d0 0x55cb2c72c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 1 --2- 172.21.15.17:0/2832697622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2c716be0 0x55cb2c728d20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 1 -- 172.21.15.17:0/2832697622 >> 172.21.15.17:0/2832697622 conn(0x55cb2c70cda0 msgr2=0x55cb2c71de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 1 -- 172.21.15.17:0/2832697622 shutdown_connections 2023-07-14T13:00:40.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 1 -- 172.21.15.17:0/2832697622 wait complete. 2023-07-14T13:00:40.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.796+0000 7f46f0114b80 20 client.25631 trim_cache size 0 max 16384 2023-07-14T13:00:40.839 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:00:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:00:40.839 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:00:40.839 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:00:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 -- 172.21.15.17:0/1951505398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f46c00a13e0 msgr2=0x7f46c00a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f46c00a13e0 0x7f46c00a3890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009990 tx=0x7f46cc009310 comp rx=0 tx=0).stop 2023-07-14T13:00:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 -- 172.21.15.17:0/1951505398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d41015b0 msgr2=0x7f46d419c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d41015b0 0x7f46d419c000 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f46c400d950 tx=0x7f46c400dc60 comp rx=0 tx=0).stop 2023-07-14T13:00:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 -- 172.21.15.17:0/1951505398 shutdown_connections 2023-07-14T13:00:40.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f46c00a13e0 0x7f46c00a3890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46d410a070 0x7f46d4195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46d4100ca0 0x7f46d419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 --2- 172.21.15.17:0/1951505398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d41015b0 0x7f46d419c000 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:40.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 -- 172.21.15.17:0/1951505398 >> 172.21.15.17:0/1951505398 conn(0x7f46d40fa4b0 msgr2=0x7f46d410c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:40.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 -- 172.21.15.17:0/1951505398 shutdown_connections 2023-07-14T13:00:40.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:40.797+0000 7f46dc7ff700 1 -- 172.21.15.17:0/1951505398 wait complete. 2023-07-14T13:00:40.848 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:00:40.848 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:00:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.090+0000 7ff0ddfff700 1 -- 172.21.15.17:0/1331223211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8072850 msgr2=0x7ff0d8072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.090+0000 7ff0ddfff700 1 --2- 172.21.15.17:0/1331223211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8072850 0x7ff0d8072c20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009990 tx=0x7ff0c8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.090+0000 7ff0ddfff700 1 -- 172.21.15.17:0/1331223211 shutdown_connections 2023-07-14T13:00:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.090+0000 7ff0ddfff700 1 --2- 172.21.15.17:0/1331223211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d810c390 0x7ff0d810e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.090+0000 7ff0ddfff700 1 --2- 172.21.15.17:0/1331223211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8072850 0x7ff0d8072c20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.090+0000 7ff0ddfff700 1 --2- 172.21.15.17:0/1331223211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d8073160 0x7ff0d810be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.090+0000 7ff0ddfff700 1 -- 172.21.15.17:0/1331223211 >> 172.21.15.17:0/1331223211 conn(0x7ff0d80fb630 msgr2=0x7ff0d80fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:41.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.090+0000 7ff0ddfff700 1 -- 172.21.15.17:0/1331223211 shutdown_connections 2023-07-14T13:00:41.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.090+0000 7ff0ddfff700 1 -- 172.21.15.17:0/1331223211 wait complete. 2023-07-14T13:00:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.091+0000 7ff0ddfff700 1 Processor -- start 2023-07-14T13:00:41.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.091+0000 7ff0ddfff700 1 -- start start 2023-07-14T13:00:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.092+0000 7ff0ddfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d8072850 0x7ff0d8197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.092+0000 7ff0ddfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8073160 0x7ff0d8198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.092+0000 7ff0ddfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d810c390 0x7ff0d819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.092+0000 7ff0ddfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d819cd30 con 0x7ff0d8073160 2023-07-14T13:00:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.092+0000 7ff0ddfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d819cea0 con 0x7ff0d8072850 2023-07-14T13:00:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.092+0000 7ff0ddfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d819d060 con 0x7ff0d810c390 2023-07-14T13:00:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.092+0000 7ff0d6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8073160 0x7ff0d8198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.092+0000 7ff0d77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d8072850 0x7ff0d8197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.092+0000 7ff0d6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8073160 0x7ff0d8198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32800/0 (socket says 172.21.15.17:32800) 2023-07-14T13:00:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.092+0000 7ff0d6ffd700 1 -- 172.21.15.17:0/2087191855 learned_addr learned my addr 172.21.15.17:0/2087191855 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.092+0000 7ff0d7fff700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d810c390 0x7ff0d819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.093+0000 7ff0d6ffd700 1 -- 172.21.15.17:0/2087191855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d810c390 msgr2=0x7ff0d819c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.093+0000 7ff0d6ffd700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d810c390 0x7ff0d819c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.093+0000 7ff0d6ffd700 1 -- 172.21.15.17:0/2087191855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d8072850 msgr2=0x7ff0d8197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.093+0000 7ff0d6ffd700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d8072850 0x7ff0d8197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.093+0000 7ff0d6ffd700 1 -- 172.21.15.17:0/2087191855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c80095f0 con 0x7ff0d8073160 2023-07-14T13:00:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.093+0000 7ff0d77fe700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d8072850 0x7ff0d8197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.093+0000 7ff0d6ffd700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8073160 0x7ff0d8198290 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00e9a0 tx=0x7ff0cc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.093+0000 7ff0d4ff9700 1 -- 172.21.15.17:0/2087191855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc009790 con 0x7ff0d8073160 2023-07-14T13:00:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.093+0000 7ff0d4ff9700 1 -- 172.21.15.17:0/2087191855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0cc010430 con 0x7ff0d8073160 2023-07-14T13:00:41.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.094+0000 7ff0ddfff700 1 -- 172.21.15.17:0/2087191855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d819d340 con 0x7ff0d8073160 2023-07-14T13:00:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.094+0000 7ff0d4ff9700 1 -- 172.21.15.17:0/2087191855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00cea0 con 0x7ff0d8073160 2023-07-14T13:00:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.094+0000 7ff0ddfff700 1 -- 172.21.15.17:0/2087191855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d81a4b80 con 0x7ff0d8073160 2023-07-14T13:00:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.095+0000 7ff0ddfff700 1 -- 172.21.15.17:0/2087191855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d81075a0 con 0x7ff0d8073160 2023-07-14T13:00:41.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.097+0000 7ff0d4ff9700 1 -- 172.21.15.17:0/2087191855 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7ff0cc0105a0 con 0x7ff0d8073160 2023-07-14T13:00:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.098+0000 7ff0d4ff9700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff0c00a14b0 0x7ff0c00a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.098+0000 7ff0d4ff9700 1 -- 172.21.15.17:0/2087191855 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff0cc014070 con 0x7ff0d8073160 2023-07-14T13:00:41.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.099+0000 7ff0d77fe700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff0c00a14b0 0x7ff0c00a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.099+0000 7ff0d77fe700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff0c00a14b0 0x7ff0c00a3960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8006010 tx=0x7ff0c800b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:41.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.101+0000 7ff0d4ff9700 1 -- 172.21.15.17:0/2087191855 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff0cc096500 con 0x7ff0d8073160 2023-07-14T13:00:41.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:41 smithi017 ceph-mon[95536]: pgmap v31: 97 pgs: 97 active+clean; 422 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 28 op/s 2023-07-14T13:00:41.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.392+0000 7ff0ddfff700 1 -- 172.21.15.17:0/2087191855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0d8067300 con 0x7ff0d8073160 2023-07-14T13:00:41.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.393+0000 7ff0d4ff9700 1 -- 172.21.15.17:0/2087191855 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10848 (secure 0 0 0) 0x7ff0cc099b20 con 0x7ff0d8073160 2023-07-14T13:00:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:00:41.425 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:00:19.002295+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:00:41.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 -- 172.21.15.17:0/2087191855 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff0c00a14b0 msgr2=0x7ff0c00a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff0c00a14b0 0x7ff0c00a3960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8006010 tx=0x7ff0c800b260 comp rx=0 tx=0).stop 2023-07-14T13:00:41.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 -- 172.21.15.17:0/2087191855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8073160 msgr2=0x7ff0d8198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8073160 0x7ff0d8198290 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00e9a0 tx=0x7ff0cc00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 -- 172.21.15.17:0/2087191855 shutdown_connections 2023-07-14T13:00:41.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff0c00a14b0 0x7ff0c00a3960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d810c390 0x7ff0d819c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d8072850 0x7ff0d8197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 --2- 172.21.15.17:0/2087191855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8073160 0x7ff0d8198290 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 -- 172.21.15.17:0/2087191855 >> 172.21.15.17:0/2087191855 conn(0x7ff0d80fb630 msgr2=0x7ff0d810e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:41.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 -- 172.21.15.17:0/2087191855 shutdown_connections 2023-07-14T13:00:41.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.396+0000 7ff0ddfff700 1 -- 172.21.15.17:0/2087191855 wait complete. 2023-07-14T13:00:41.429 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2023-07-14T13:00:41.447 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:00:41.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:41 smithi135 ceph-mon[97338]: pgmap v31: 97 pgs: 97 active+clean; 422 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 28 op/s 2023-07-14T13:00:41.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:41 smithi131 ceph-mon[96953]: pgmap v31: 97 pgs: 97 active+clean; 422 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 28 op/s 2023-07-14T13:00:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.656+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/681320927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e681015b0 msgr2=0x7f8e68109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.656+0000 7f8e6c9ff700 1 --2- 172.21.15.17:0/681320927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e681015b0 0x7f8e68109aa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009990 tx=0x7f8e5c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.656+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/681320927 shutdown_connections 2023-07-14T13:00:41.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.656+0000 7f8e6c9ff700 1 --2- 172.21.15.17:0/681320927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e6810a070 0x7f8e6810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.656+0000 7f8e6c9ff700 1 --2- 172.21.15.17:0/681320927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e68100ca0 0x7f8e68101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.656+0000 7f8e6c9ff700 1 --2- 172.21.15.17:0/681320927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e681015b0 0x7f8e68109aa0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.656+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/681320927 >> 172.21.15.17:0/681320927 conn(0x7f8e680fa4b0 msgr2=0x7f8e680fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:41.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.657+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/681320927 shutdown_connections 2023-07-14T13:00:41.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.657+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/681320927 wait complete. 2023-07-14T13:00:41.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.658+0000 7f8e6c9ff700 1 Processor -- start 2023-07-14T13:00:41.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.658+0000 7f8e6c9ff700 1 -- start start 2023-07-14T13:00:41.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.658+0000 7f8e6c9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e68100ca0 0x7f8e6819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.658+0000 7f8e6c9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e681015b0 0x7f8e6819bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.658+0000 7f8e6c9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e6810a070 0x7f8e68195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.658+0000 7f8e6c9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e681960a0 con 0x7f8e68100ca0 2023-07-14T13:00:41.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e6c9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68196210 con 0x7f8e681015b0 2023-07-14T13:00:41.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e6c9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e681963d0 con 0x7f8e6810a070 2023-07-14T13:00:41.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e6659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e68100ca0 0x7f8e6819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e6659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e68100ca0 0x7f8e6819b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32822/0 (socket says 172.21.15.17:32822) 2023-07-14T13:00:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e6659c700 1 -- 172.21.15.17:0/113479628 learned_addr learned my addr 172.21.15.17:0/113479628 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e65d9b700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e681015b0 0x7f8e6819bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e66d9d700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e6810a070 0x7f8e68195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e6659c700 1 -- 172.21.15.17:0/113479628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e6810a070 msgr2=0x7f8e68195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e6659c700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e6810a070 0x7f8e68195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e6659c700 1 -- 172.21.15.17:0/113479628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e681015b0 msgr2=0x7f8e6819bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e6659c700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e681015b0 0x7f8e6819bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e6659c700 1 -- 172.21.15.17:0/113479628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c0095f0 con 0x7f8e68100ca0 2023-07-14T13:00:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.659+0000 7f8e66d9d700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e6810a070 0x7f8e68195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.660+0000 7f8e6659c700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e68100ca0 0x7f8e6819b9c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800e9a0 tx=0x7f8e5800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.660+0000 7f8e577fe700 1 -- 172.21.15.17:0/113479628 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58009790 con 0x7f8e68100ca0 2023-07-14T13:00:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.660+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/113479628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e681966b0 con 0x7f8e68100ca0 2023-07-14T13:00:41.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.660+0000 7f8e577fe700 1 -- 172.21.15.17:0/113479628 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e5800cbd0 con 0x7f8e68100ca0 2023-07-14T13:00:41.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.660+0000 7f8e577fe700 1 -- 172.21.15.17:0/113479628 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58018680 con 0x7f8e68100ca0 2023-07-14T13:00:41.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.660+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/113479628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e681a29b0 con 0x7f8e68100ca0 2023-07-14T13:00:41.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.664+0000 7f8e577fe700 1 -- 172.21.15.17:0/113479628 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f8e5800cd40 con 0x7f8e68100ca0 2023-07-14T13:00:41.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.665+0000 7f8e80247b80 1 Processor -- start 2023-07-14T13:00:41.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.665+0000 7f8e80247b80 1 -- start start 2023-07-14T13:00:41.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.665+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 0x5588e8711ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.665+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e8711ff0 0x5588e871c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.665+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e871cee0 0x5588e871f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.665+0000 7f8e80247b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e8613cb0 con 0x5588e8711ff0 2023-07-14T13:00:41.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.665+0000 7f8e80247b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e8666a40 con 0x5588e87116e0 2023-07-14T13:00:41.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.665+0000 7f8e80247b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e865fed0 con 0x5588e871cee0 2023-07-14T13:00:41.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e6659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e8711ff0 0x5588e871c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e66d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 0x5588e8711ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e6659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e8711ff0 0x5588e871c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32824/0 (socket says 172.21.15.17:32824) 2023-07-14T13:00:41.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e66d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 0x5588e8711ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54476/0 (socket says 172.21.15.17:54476) 2023-07-14T13:00:41.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e577fe700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8e500a13e0 0x7f8e500a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e6659c700 1 -- 172.21.15.17:0/199522162 learned_addr learned my addr 172.21.15.17:0/199522162 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:41.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e65d9b700 1 --2- 172.21.15.17:0/199522162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e871cee0 0x5588e871f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e577fe700 1 -- 172.21.15.17:0/113479628 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f8e58014070 con 0x7f8e68100ca0 2023-07-14T13:00:41.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e65d9b700 1 -- 172.21.15.17:0/199522162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 msgr2=0x5588e8711ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:41.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e65d9b700 1 --2- 172.21.15.17:0/199522162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 0x5588e8711ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e65d9b700 1 -- 172.21.15.17:0/199522162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e8711ff0 msgr2=0x5588e871c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:41.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e66d9d700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8e500a13e0 0x7f8e500a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e65d9b700 1 --2- 172.21.15.17:0/199522162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e8711ff0 0x5588e871c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.666+0000 7f8e65d9b700 1 -- 172.21.15.17:0/199522162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588e848dde0 con 0x5588e871cee0 2023-07-14T13:00:41.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.667+0000 7f8e65d9b700 1 --2- 172.21.15.17:0/199522162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e871cee0 0x5588e871f2c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098e0 tx=0x7f8e5c005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=937f52e84a3d538c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:41.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.667+0000 7f8e66d9d700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8e500a13e0 0x7f8e500a3890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e6819c6c0 tx=0x7f8e60004b40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:41.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.667+0000 7f8e54ff9700 1 -- 172.21.15.17:0/199522162 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c01d070 con 0x5588e871cee0 2023-07-14T13:00:41.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.667+0000 7f8e54ff9700 1 -- 172.21.15.17:0/199522162 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e5c01e040 con 0x5588e871cee0 2023-07-14T13:00:41.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.667+0000 7f8e54ff9700 1 -- 172.21.15.17:0/199522162 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c004760 con 0x5588e871cee0 2023-07-14T13:00:41.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.668+0000 7f8e80247b80 1 -- 172.21.15.17:0/199522162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e871cee0 msgr2=0x5588e871f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.668+0000 7f8e80247b80 1 --2- 172.21.15.17:0/199522162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e871cee0 0x5588e871f2c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098e0 tx=0x7f8e5c005f00 comp rx=0 tx=0).stop 2023-07-14T13:00:41.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.668+0000 7f8e80247b80 1 -- 172.21.15.17:0/199522162 shutdown_connections 2023-07-14T13:00:41.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.668+0000 7f8e80247b80 1 --2- 172.21.15.17:0/199522162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e871cee0 0x5588e871f2c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.668+0000 7f8e80247b80 1 --2- 172.21.15.17:0/199522162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 0x5588e8711ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.668+0000 7f8e80247b80 1 --2- 172.21.15.17:0/199522162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e8711ff0 0x5588e871c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.668+0000 7f8e80247b80 1 -- 172.21.15.17:0/199522162 >> 172.21.15.17:0/199522162 conn(0x5588e8703da0 msgr2=0x5588e87096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:41.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.668+0000 7f8e80247b80 1 -- 172.21.15.17:0/199522162 shutdown_connections 2023-07-14T13:00:41.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.668+0000 7f8e80247b80 1 -- 172.21.15.17:0/199522162 wait complete. 2023-07-14T13:00:41.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.669+0000 7f8e80247b80 1 -- start start 2023-07-14T13:00:41.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.669+0000 7f8e80247b80 1 Processor -- start 2023-07-14T13:00:41.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 0x5588e871c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e8711ff0 0x5588e8719b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e871a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e80247b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e85ffac0 con 0x5588e871cee0 2023-07-14T13:00:41.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e80247b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e85ff7c0 con 0x5588e87116e0 2023-07-14T13:00:41.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e80247b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e84e3920 con 0x5588e8711ff0 2023-07-14T13:00:41.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e80247b80 10 client.0 _ll_register_callbacks cb 0x5588e85fd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:41.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e66d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e871a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e66d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e871a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32840/0 (socket says 172.21.15.17:32840) 2023-07-14T13:00:41.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e66d9d700 1 -- 172.21.15.17:0/4277463108 learned_addr learned my addr 172.21.15.17:0/4277463108 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:41.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e65d9b700 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e8711ff0 0x5588e8719b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.670+0000 7f8e6659c700 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 0x5588e871c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e6659c700 1 -- 172.21.15.17:0/4277463108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e8711ff0 msgr2=0x5588e8719b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:41.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e6659c700 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e8711ff0 0x5588e8719b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e6659c700 1 -- 172.21.15.17:0/4277463108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 msgr2=0x5588e871a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:41.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e6659c700 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e871a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e6659c700 1 -- 172.21.15.17:0/4277463108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6810d170 con 0x5588e87116e0 2023-07-14T13:00:41.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e6659c700 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 0x5588e871c890 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e580ca8d0 tx=0x7f8e58099c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99a6d41b48c5cb9a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:41.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:00:41.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e66d9d700 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e871a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:41.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e4dffb700 1 -- 172.21.15.17:0/4277463108 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e580a22b0 con 0x5588e87116e0 2023-07-14T13:00:41.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e80247b80 1 -- 172.21.15.17:0/4277463108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588e85b94f0 con 0x5588e87116e0 2023-07-14T13:00:41.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e4dffb700 1 -- 172.21.15.17:0/4277463108 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f8e5809a0f0 con 0x5588e87116e0 2023-07-14T13:00:41.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e4dffb700 1 -- 172.21.15.17:0/4277463108 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e580cf2f0 con 0x5588e87116e0 2023-07-14T13:00:41.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e80247b80 10 client.25649 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:41.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.671+0000 7f8e80247b80 1 -- 172.21.15.17:0/4277463108 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5588e8476c60 con 0x5588e87116e0 2023-07-14T13:00:41.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.672+0000 7f8e4dffb700 1 -- 172.21.15.17:0/4277463108 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5588e85b94f0 con 0x5588e87116e0 2023-07-14T13:00:41.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.672+0000 7f8e4dffb700 1 -- 172.21.15.17:0/4277463108 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8e58095ee0 con 0x5588e87116e0 2023-07-14T13:00:41.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.672+0000 7f8e80247b80 10 client.25649 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:41.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.672+0000 7f8e80247b80 10 client.25649 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:00:41.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.672+0000 7f8e80247b80 20 client.25649 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:41.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.672+0000 7f8e80247b80 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5588e872c7d0 0x5588e872ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.672+0000 7f8e80247b80 4 client.25649 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:41.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.672+0000 7f8e80247b80 1 -- 172.21.15.17:0/4277463108 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588e8658eb0 con 0x5588e872c7d0 2023-07-14T13:00:41.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.673+0000 7f8e65d9b700 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5588e872c7d0 0x5588e872ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.673+0000 7f8e65d9b700 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5588e872c7d0 0x5588e872ebe0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e980965a4c7ad3 server_cookie=f76bbd70271923f3 in_seq=0 out_seq=0 2023-07-14T13:00:41.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.673+0000 7f8e4dffb700 10 client.25649 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:00:41.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e4dffb700 1 -- 172.21.15.17:0/4277463108 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5588e8658eb0 con 0x5588e872c7d0 2023-07-14T13:00:41.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e4dffb700 10 client.25649 handle_command_reply: tid=0 2023-07-14T13:00:41.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e80247b80 1 client.25649 shutdown 2023-07-14T13:00:41.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e80247b80 1 -- 172.21.15.17:0/4277463108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 msgr2=0x5588e871c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e80247b80 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 0x5588e871c890 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e580ca8d0 tx=0x7f8e58099c30 comp rx=0 tx=0).stop 2023-07-14T13:00:41.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e80247b80 1 -- 172.21.15.17:0/4277463108 shutdown_connections 2023-07-14T13:00:41.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e80247b80 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e871a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e80247b80 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e87116e0 0x5588e871c890 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e80247b80 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5588e872c7d0 0x5588e872ebe0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e80247b80 1 --2- 172.21.15.17:0/4277463108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e8711ff0 0x5588e8719b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e80247b80 1 -- 172.21.15.17:0/4277463108 >> 172.21.15.17:0/4277463108 conn(0x5588e8703da0 msgr2=0x5588e8709230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:41.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e4dffb700 0 client.25649 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:00:41.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e80247b80 1 -- 172.21.15.17:0/4277463108 shutdown_connections 2023-07-14T13:00:41.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.674+0000 7f8e80247b80 1 -- 172.21.15.17:0/4277463108 wait complete. 2023-07-14T13:00:41.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.675+0000 7f8e80247b80 20 client.25649 trim_cache size 0 max 16384 2023-07-14T13:00:41.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.690+0000 7f8e80247b80 1 Processor -- start 2023-07-14T13:00:41.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.690+0000 7f8e80247b80 1 -- start start 2023-07-14T13:00:41.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.690+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e87116e0 0x5588e87238c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.690+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e8711ff0 0x5588e871c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.690+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8716e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.690+0000 7f8e80247b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e87039a0 con 0x5588e871cee0 2023-07-14T13:00:41.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.690+0000 7f8e80247b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e87131e0 con 0x5588e8711ff0 2023-07-14T13:00:41.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.690+0000 7f8e80247b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e8718100 con 0x5588e87116e0 2023-07-14T13:00:41.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.691+0000 7f8e66d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8716e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.691+0000 7f8e66d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8716e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32856/0 (socket says 172.21.15.17:32856) 2023-07-14T13:00:41.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.691+0000 7f8e66d9d700 1 -- 172.21.15.17:0/3882699952 learned_addr learned my addr 172.21.15.17:0/3882699952 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:41.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.691+0000 7f8e6659c700 1 --2- 172.21.15.17:0/3882699952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e87116e0 0x5588e87238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.691+0000 7f8e65d9b700 1 --2- 172.21.15.17:0/3882699952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e8711ff0 0x5588e871c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.691+0000 7f8e66d9d700 1 -- 172.21.15.17:0/3882699952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e87116e0 msgr2=0x5588e87238c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:41.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.691+0000 7f8e66d9d700 1 --2- 172.21.15.17:0/3882699952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e87116e0 0x5588e87238c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.691+0000 7f8e66d9d700 1 -- 172.21.15.17:0/3882699952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e8711ff0 msgr2=0x5588e871c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:41.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.691+0000 7f8e66d9d700 1 --2- 172.21.15.17:0/3882699952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e8711ff0 0x5588e871c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.691+0000 7f8e66d9d700 1 -- 172.21.15.17:0/3882699952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588e84b4250 con 0x5588e871cee0 2023-07-14T13:00:41.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.691+0000 7f8e6659c700 1 --2- 172.21.15.17:0/3882699952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e87116e0 0x5588e87238c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:41.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.692+0000 7f8e66d9d700 1 --2- 172.21.15.17:0/3882699952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8716e30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8e600094f0 tx=0x7f8e60009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce56ae80805d96c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:41.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.692+0000 7f8e557fa700 1 -- 172.21.15.17:0/3882699952 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000e040 con 0x5588e871cee0 2023-07-14T13:00:41.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.692+0000 7f8e557fa700 1 -- 172.21.15.17:0/3882699952 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e6000f040 con 0x5588e871cee0 2023-07-14T13:00:41.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.692+0000 7f8e557fa700 1 -- 172.21.15.17:0/3882699952 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60005020 con 0x5588e871cee0 2023-07-14T13:00:41.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.693+0000 7f8e80247b80 1 -- 172.21.15.17:0/3882699952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 msgr2=0x5588e8716e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.693+0000 7f8e80247b80 1 --2- 172.21.15.17:0/3882699952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8716e30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8e600094f0 tx=0x7f8e60009920 comp rx=0 tx=0).stop 2023-07-14T13:00:41.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.693+0000 7f8e80247b80 1 -- 172.21.15.17:0/3882699952 shutdown_connections 2023-07-14T13:00:41.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.693+0000 7f8e80247b80 1 --2- 172.21.15.17:0/3882699952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8716e30 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.693+0000 7f8e80247b80 1 --2- 172.21.15.17:0/3882699952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e87116e0 0x5588e87238c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.693+0000 7f8e80247b80 1 --2- 172.21.15.17:0/3882699952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e8711ff0 0x5588e871c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.693+0000 7f8e80247b80 1 -- 172.21.15.17:0/3882699952 >> 172.21.15.17:0/3882699952 conn(0x5588e8703da0 msgr2=0x5588e8714ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:41.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.693+0000 7f8e80247b80 1 -- 172.21.15.17:0/3882699952 shutdown_connections 2023-07-14T13:00:41.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.693+0000 7f8e80247b80 1 -- 172.21.15.17:0/3882699952 wait complete. 2023-07-14T13:00:41.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.693+0000 7f8e80247b80 1 -- start start 2023-07-14T13:00:41.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.694+0000 7f8e80247b80 1 Processor -- start 2023-07-14T13:00:41.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.694+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e87116e0 0x5588e8778a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.694+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e8711ff0 0x5588e8778fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.694+0000 7f8e80247b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8774620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.694+0000 7f8e80247b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e8774d00 con 0x5588e871cee0 2023-07-14T13:00:41.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.694+0000 7f8e80247b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e8774e70 con 0x5588e8711ff0 2023-07-14T13:00:41.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.694+0000 7f8e80247b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e8775030 con 0x5588e87116e0 2023-07-14T13:00:41.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.694+0000 7f8e80247b80 10 client.0 _ll_register_callbacks cb 0x5588e85fd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:41.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.694+0000 7f8e66d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8774620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e66d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8774620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32862/0 (socket says 172.21.15.17:32862) 2023-07-14T13:00:41.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e66d9d700 1 -- 172.21.15.17:0/370993840 learned_addr learned my addr 172.21.15.17:0/370993840 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:41.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e65d9b700 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e8711ff0 0x5588e8778fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e6659c700 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e87116e0 0x5588e8778a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e66d9d700 1 -- 172.21.15.17:0/370993840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e87116e0 msgr2=0x5588e8778a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:41.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e66d9d700 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e87116e0 0x5588e8778a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e66d9d700 1 -- 172.21.15.17:0/370993840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e8711ff0 msgr2=0x5588e8778fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:41.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e66d9d700 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e8711ff0 0x5588e8778fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e66d9d700 1 -- 172.21.15.17:0/370993840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588e8476c60 con 0x5588e871cee0 2023-07-14T13:00:41.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e66d9d700 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8774620 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8e60004e60 tx=0x7f8e60009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2ce674eaea948 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:41.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:41.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.695+0000 7f8e4dffb700 1 -- 172.21.15.17:0/370993840 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000e030 con 0x5588e871cee0 2023-07-14T13:00:41.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.696+0000 7f8e80247b80 1 -- 172.21.15.17:0/370993840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e5c01e040 con 0x5588e871cee0 2023-07-14T13:00:41.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.696+0000 7f8e4dffb700 1 -- 172.21.15.17:0/370993840 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f8e6001e070 con 0x5588e871cee0 2023-07-14T13:00:41.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.696+0000 7f8e4dffb700 1 -- 172.21.15.17:0/370993840 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e60018720 con 0x5588e871cee0 2023-07-14T13:00:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.696+0000 7f8e80247b80 10 client.15885 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.696+0000 7f8e80247b80 1 -- 172.21.15.17:0/370993840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f8e60019710 con 0x5588e871cee0 2023-07-14T13:00:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.696+0000 7f8e4dffb700 1 -- 172.21.15.17:0/370993840 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e5c01e040 con 0x5588e871cee0 2023-07-14T13:00:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.696+0000 7f8e4dffb700 1 -- 172.21.15.17:0/370993840 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8e60012070 con 0x5588e871cee0 2023-07-14T13:00:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.696+0000 7f8e80247b80 10 client.15885 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.697+0000 7f8e80247b80 10 client.15885 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:00:41.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.697+0000 7f8e80247b80 20 client.15885 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.697+0000 7f8e80247b80 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5588e87816a0 0x5588e8783ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.697+0000 7f8e80247b80 4 client.15885 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:00:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.697+0000 7f8e80247b80 1 -- 172.21.15.17:0/370993840 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5588e861b050 con 0x5588e87816a0 2023-07-14T13:00:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.697+0000 7f8e6659c700 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5588e87816a0 0x5588e8783ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.697+0000 7f8e6659c700 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5588e87816a0 0x5588e8783ab0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d956d70a4327f7f6 server_cookie=88ce68912b30906 in_seq=0 out_seq=0 2023-07-14T13:00:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.697+0000 7f8e4dffb700 10 client.15885 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:00:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e4dffb700 1 -- 172.21.15.17:0/370993840 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5588e861b050 con 0x5588e87816a0 2023-07-14T13:00:41.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e4dffb700 10 client.15885 handle_command_reply: tid=0 2023-07-14T13:00:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 1 client.15885 shutdown 2023-07-14T13:00:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 1 -- 172.21.15.17:0/370993840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 msgr2=0x5588e8774620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8774620 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8e60004e60 tx=0x7f8e60009b20 comp rx=0 tx=0).stop 2023-07-14T13:00:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 1 -- 172.21.15.17:0/370993840 shutdown_connections 2023-07-14T13:00:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5588e871cee0 0x5588e8774620 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5588e87816a0 0x5588e8783ab0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588e87116e0 0x5588e8778a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 1 --2- 172.21.15.17:0/370993840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5588e8711ff0 0x5588e8778fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 1 -- 172.21.15.17:0/370993840 >> 172.21.15.17:0/370993840 conn(0x5588e8703da0 msgr2=0x5588e87137f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:41.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e4dffb700 0 client.15885 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:00:41.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 1 -- 172.21.15.17:0/370993840 shutdown_connections 2023-07-14T13:00:41.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 1 -- 172.21.15.17:0/370993840 wait complete. 2023-07-14T13:00:41.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.698+0000 7f8e80247b80 20 client.15885 trim_cache size 0 max 16384 2023-07-14T13:00:41.737 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:00:41.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/113479628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8e500a13e0 msgr2=0x7f8e500a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8e500a13e0 0x7f8e500a3890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e6819c6c0 tx=0x7f8e60004b40 comp rx=0 tx=0).stop 2023-07-14T13:00:41.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/113479628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e68100ca0 msgr2=0x7f8e6819b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e68100ca0 0x7f8e6819b9c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800e9a0 tx=0x7f8e5800ecb0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/113479628 shutdown_connections 2023-07-14T13:00:41.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8e500a13e0 0x7f8e500a3890 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e6810a070 0x7f8e68195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e68100ca0 0x7f8e6819b9c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 --2- 172.21.15.17:0/113479628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e681015b0 0x7f8e6819bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/113479628 >> 172.21.15.17:0/113479628 conn(0x7f8e680fa4b0 msgr2=0x7f8e6810c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:41.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/113479628 shutdown_connections 2023-07-14T13:00:41.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.699+0000 7f8e6c9ff700 1 -- 172.21.15.17:0/113479628 wait complete. 2023-07-14T13:00:41.750 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:00:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:1900000 of 50000000 tuples (3%) done (elapsed 31.37 s, remaining 794.04 s) 2023-07-14T13:00:41.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.950+0000 7fb9663ff700 1 -- 172.21.15.17:0/725699990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015b0 msgr2=0x7fb960109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.950+0000 7fb9663ff700 1 --2- 172.21.15.17:0/725699990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015b0 0x7fb960109aa0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb954009990 tx=0x7fb954009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.951+0000 7fb9663ff700 1 -- 172.21.15.17:0/725699990 shutdown_connections 2023-07-14T13:00:41.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.951+0000 7fb9663ff700 1 --2- 172.21.15.17:0/725699990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb96010a070 0x7fb96010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.951+0000 7fb9663ff700 1 --2- 172.21.15.17:0/725699990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb960100ca0 0x7fb960101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.951+0000 7fb9663ff700 1 --2- 172.21.15.17:0/725699990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9601015b0 0x7fb960109aa0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.951+0000 7fb9663ff700 1 -- 172.21.15.17:0/725699990 >> 172.21.15.17:0/725699990 conn(0x7fb9600fa4b0 msgr2=0x7fb9600fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:41.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.951+0000 7fb9663ff700 1 -- 172.21.15.17:0/725699990 shutdown_connections 2023-07-14T13:00:41.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.951+0000 7fb9663ff700 1 -- 172.21.15.17:0/725699990 wait complete. 2023-07-14T13:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.952+0000 7fb9663ff700 1 Processor -- start 2023-07-14T13:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.952+0000 7fb9663ff700 1 -- start start 2023-07-14T13:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.953+0000 7fb9663ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb960100ca0 0x7fb960197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.953+0000 7fb9663ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9601015b0 0x7fb9601982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.953+0000 7fb9663ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96010a070 0x7fb96019c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.953+0000 7fb9663ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96019cd50 con 0x7fb96010a070 2023-07-14T13:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.953+0000 7fb9663ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96019cec0 con 0x7fb9601015b0 2023-07-14T13:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.953+0000 7fb9663ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96019d080 con 0x7fb960100ca0 2023-07-14T13:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.953+0000 7fb96499c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96010a070 0x7fb96019c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.953+0000 7fb96499c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96010a070 0x7fb96019c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32874/0 (socket says 172.21.15.17:32874) 2023-07-14T13:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.953+0000 7fb96499c700 1 -- 172.21.15.17:0/2062517370 learned_addr learned my addr 172.21.15.17:0/2062517370 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:41.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.953+0000 7fb95ffff700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb960100ca0 0x7fb960197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.953+0000 7fb95f7fe700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9601015b0 0x7fb9601982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.954+0000 7fb96499c700 1 -- 172.21.15.17:0/2062517370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb960100ca0 msgr2=0x7fb960197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.954+0000 7fb96499c700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb960100ca0 0x7fb960197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.954+0000 7fb96499c700 1 -- 172.21.15.17:0/2062517370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9601015b0 msgr2=0x7fb9601982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.954+0000 7fb96499c700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9601015b0 0x7fb9601982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.954+0000 7fb96499c700 1 -- 172.21.15.17:0/2062517370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9540095f0 con 0x7fb96010a070 2023-07-14T13:00:41.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.954+0000 7fb96499c700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96010a070 0x7fb96019c710 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb95800ef30 tx=0x7fb95800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:41.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.954+0000 7fb95d7fa700 1 -- 172.21.15.17:0/2062517370 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958018070 con 0x7fb96010a070 2023-07-14T13:00:41.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.954+0000 7fb95d7fa700 1 -- 172.21.15.17:0/2062517370 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb95800f040 con 0x7fb96010a070 2023-07-14T13:00:41.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.954+0000 7fb9663ff700 1 -- 172.21.15.17:0/2062517370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96019d300 con 0x7fb96010a070 2023-07-14T13:00:41.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.954+0000 7fb95d7fa700 1 -- 172.21.15.17:0/2062517370 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95800cbc0 con 0x7fb96010a070 2023-07-14T13:00:41.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.954+0000 7fb9663ff700 1 -- 172.21.15.17:0/2062517370 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9601a4ba0 con 0x7fb96010a070 2023-07-14T13:00:41.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.958+0000 7fb95d7fa700 1 -- 172.21.15.17:0/2062517370 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7fb95800cd60 con 0x7fb96010a070 2023-07-14T13:00:41.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.960+0000 7fb979cfdb80 1 Processor -- start 2023-07-14T13:00:41.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.960+0000 7fb979cfdb80 1 -- start start 2023-07-14T13:00:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb95d7fa700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9480a1460 0x7fb9480a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b97486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9748be0 0x55e0b9753590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9753ad0 0x55e0b9755eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b964ecb0 con 0x55e0b97482d0 2023-07-14T13:00:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b96a1a40 con 0x55e0b9753ad0 2023-07-14T13:00:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b969aed0 con 0x55e0b9748be0 2023-07-14T13:00:41.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb95d7fa700 1 -- 172.21.15.17:0/2062517370 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb9580cc930 con 0x7fb96010a070 2023-07-14T13:00:41.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb95ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b97486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb95ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b97486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32884/0 (socket says 172.21.15.17:32884) 2023-07-14T13:00:41.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb95ffff700 1 -- 172.21.15.17:0/2778929922 learned_addr learned my addr 172.21.15.17:0/2778929922 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:41.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb96499c700 1 --2- 172.21.15.17:0/2778929922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9753ad0 0x55e0b9755eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.961+0000 7fb95f7fe700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9480a1460 0x7fb9480a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.962+0000 7fb95f7fe700 1 --2- 172.21.15.17:0/2778929922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9748be0 0x55e0b9753590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.962+0000 7fb95ffff700 1 -- 172.21.15.17:0/2778929922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9748be0 msgr2=0x55e0b9753590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.962+0000 7fb95ffff700 1 --2- 172.21.15.17:0/2778929922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9748be0 0x55e0b9753590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.962+0000 7fb95ffff700 1 -- 172.21.15.17:0/2778929922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9753ad0 msgr2=0x55e0b9755eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.962+0000 7fb95ffff700 1 --2- 172.21.15.17:0/2778929922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9753ad0 0x55e0b9755eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.962+0000 7fb95ffff700 1 -- 172.21.15.17:0/2778929922 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0b94c8de0 con 0x55e0b97482d0 2023-07-14T13:00:41.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.962+0000 7fb95f7fe700 1 --2- 172.21.15.17:0/2778929922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9748be0 0x55e0b9753590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:00:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.962+0000 7fb95ffff700 1 --2- 172.21.15.17:0/2778929922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b97486a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb95000bd70 tx=0x7fb9500106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d242fa970d9e30a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.962+0000 7fb95f7fe700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9480a1460 0x7fb9480a3910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb960199380 tx=0x7fb95401a040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.962+0000 7fb9467fc700 1 -- 172.21.15.17:0/2778929922 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb950010db0 con 0x55e0b97482d0 2023-07-14T13:00:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.963+0000 7fb9467fc700 1 -- 172.21.15.17:0/2778929922 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb950015070 con 0x55e0b97482d0 2023-07-14T13:00:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.963+0000 7fb9467fc700 1 -- 172.21.15.17:0/2778929922 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9500116a0 con 0x55e0b97482d0 2023-07-14T13:00:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.963+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2778929922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 msgr2=0x55e0b97486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.963+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/2778929922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b97486a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb95000bd70 tx=0x7fb9500106b0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.963+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2778929922 shutdown_connections 2023-07-14T13:00:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.963+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/2778929922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9753ad0 0x55e0b9755eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.963+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/2778929922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b97486a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:41.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.963+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/2778929922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9748be0 0x55e0b9753590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.963+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2778929922 >> 172.21.15.17:0/2778929922 conn(0x55e0b973eda0 msgr2=0x55e0b97446a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.964+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2778929922 shutdown_connections 2023-07-14T13:00:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.964+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2778929922 wait complete. 2023-07-14T13:00:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.964+0000 7fb979cfdb80 1 -- start start 2023-07-14T13:00:42.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.965+0000 7fb979cfdb80 1 Processor -- start 2023-07-14T13:00:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.965+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b9753520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.965+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9748be0 0x55e0b9750730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.965+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9753ad0 0x55e0b9750e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.965+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b963aac0 con 0x55e0b97482d0 2023-07-14T13:00:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.965+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b963a7c0 con 0x55e0b9748be0 2023-07-14T13:00:42.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.965+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b951e920 con 0x55e0b9753ad0 2023-07-14T13:00:42.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.965+0000 7fb979cfdb80 10 client.0 _ll_register_callbacks cb 0x55e0b9638760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:42.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.965+0000 7fb95ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b9753520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb95ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b9753520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32898/0 (socket says 172.21.15.17:32898) 2023-07-14T13:00:42.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb95ffff700 1 -- 172.21.15.17:0/3824649707 learned_addr learned my addr 172.21.15.17:0/3824649707 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:42.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb95f7fe700 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9748be0 0x55e0b9750730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb96499c700 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9753ad0 0x55e0b9750e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb95ffff700 1 -- 172.21.15.17:0/3824649707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9753ad0 msgr2=0x55e0b9750e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb95ffff700 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9753ad0 0x55e0b9750e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb95ffff700 1 -- 172.21.15.17:0/3824649707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9748be0 msgr2=0x55e0b9750730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb95ffff700 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9748be0 0x55e0b9750730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb95ffff700 1 -- 172.21.15.17:0/3824649707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95000b9a0 con 0x55e0b97482d0 2023-07-14T13:00:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb95f7fe700 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9748be0 0x55e0b9750730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb95ffff700 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b9753520 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb95000b6c0 tx=0x7fb95001dff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11397abde46d083e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.966+0000 7fb93f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.967+0000 7fb93f7fe700 1 -- 172.21.15.17:0/3824649707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb950020040 con 0x55e0b97482d0 2023-07-14T13:00:42.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.967+0000 7fb979cfdb80 1 -- 172.21.15.17:0/3824649707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0b95f44f0 con 0x55e0b97482d0 2023-07-14T13:00:42.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.967+0000 7fb93f7fe700 1 -- 172.21.15.17:0/3824649707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb950017070 con 0x55e0b97482d0 2023-07-14T13:00:42.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.967+0000 7fb93f7fe700 1 -- 172.21.15.17:0/3824649707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb950004230 con 0x55e0b97482d0 2023-07-14T13:00:42.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.967+0000 7fb979cfdb80 10 client.15897 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:42.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.967+0000 7fb979cfdb80 1 -- 172.21.15.17:0/3824649707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e0b94b1c60 con 0x55e0b97482d0 2023-07-14T13:00:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.968+0000 7fb93f7fe700 1 -- 172.21.15.17:0/3824649707 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb950034020 con 0x55e0b97482d0 2023-07-14T13:00:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.968+0000 7fb93f7fe700 1 -- 172.21.15.17:0/3824649707 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb950003840 con 0x55e0b97482d0 2023-07-14T13:00:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.968+0000 7fb979cfdb80 10 client.15897 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.968+0000 7fb979cfdb80 10 client.15897 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:00:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.968+0000 7fb979cfdb80 20 client.15897 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.968+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55e0b9763310 0x55e0b9765720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.968+0000 7fb979cfdb80 4 client.15897 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:42.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.968+0000 7fb979cfdb80 1 -- 172.21.15.17:0/3824649707 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0b9693eb0 con 0x55e0b9763310 2023-07-14T13:00:42.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.968+0000 7fb95f7fe700 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55e0b9763310 0x55e0b9765720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.969+0000 7fb95f7fe700 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55e0b9763310 0x55e0b9765720 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=147b3fd67d4b8e2a server_cookie=a1d7faadcdb7f1da in_seq=0 out_seq=0 2023-07-14T13:00:42.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.969+0000 7fb93f7fe700 10 client.15897 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:00:42.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb93f7fe700 1 -- 172.21.15.17:0/3824649707 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e0b9693eb0 con 0x55e0b9763310 2023-07-14T13:00:42.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb93f7fe700 10 client.15897 handle_command_reply: tid=0 2023-07-14T13:00:42.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb979cfdb80 1 client.15897 shutdown 2023-07-14T13:00:42.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb979cfdb80 1 -- 172.21.15.17:0/3824649707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 msgr2=0x55e0b9753520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b9753520 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb95000b6c0 tx=0x7fb95001dff0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb979cfdb80 1 -- 172.21.15.17:0/3824649707 shutdown_connections 2023-07-14T13:00:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9753ad0 0x55e0b9750e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b97482d0 0x55e0b9753520 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55e0b9763310 0x55e0b9765720 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/3824649707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9748be0 0x55e0b9750730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb979cfdb80 1 -- 172.21.15.17:0/3824649707 >> 172.21.15.17:0/3824649707 conn(0x55e0b973eda0 msgr2=0x55e0b9744230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb93f7fe700 0 client.15897 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:00:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb979cfdb80 1 -- 172.21.15.17:0/3824649707 shutdown_connections 2023-07-14T13:00:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.970+0000 7fb979cfdb80 1 -- 172.21.15.17:0/3824649707 wait complete. 2023-07-14T13:00:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.971+0000 7fb979cfdb80 20 client.15897 trim_cache size 0 max 16384 2023-07-14T13:00:42.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.989+0000 7fb979cfdb80 1 Processor -- start 2023-07-14T13:00:42.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.990+0000 7fb979cfdb80 1 -- start start 2023-07-14T13:00:42.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.990+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b97482d0 0x55e0b9753050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.990+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9748be0 0x55e0b974ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.990+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b9753ad0 0x55e0b974bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.990+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b974fca0 con 0x55e0b9753ad0 2023-07-14T13:00:42.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.990+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b974fe10 con 0x55e0b97482d0 2023-07-14T13:00:42.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.990+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b976a420 con 0x55e0b9748be0 2023-07-14T13:00:42.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.991+0000 7fb96499c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b9753ad0 0x55e0b974bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.991+0000 7fb96499c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b9753ad0 0x55e0b974bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32912/0 (socket says 172.21.15.17:32912) 2023-07-14T13:00:42.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.991+0000 7fb96499c700 1 -- 172.21.15.17:0/109928139 learned_addr learned my addr 172.21.15.17:0/109928139 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:42.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.991+0000 7fb96499c700 1 -- 172.21.15.17:0/109928139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9748be0 msgr2=0x55e0b974ba30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:00:42.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.991+0000 7fb96499c700 1 --2- 172.21.15.17:0/109928139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9748be0 0x55e0b974ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.991+0000 7fb96499c700 1 -- 172.21.15.17:0/109928139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b97482d0 msgr2=0x55e0b9753050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:00:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.991+0000 7fb96499c700 1 --2- 172.21.15.17:0/109928139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b97482d0 0x55e0b9753050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.991+0000 7fb96499c700 1 -- 172.21.15.17:0/109928139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0b94ef250 con 0x55e0b9753ad0 2023-07-14T13:00:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.991+0000 7fb96499c700 1 --2- 172.21.15.17:0/109928139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b9753ad0 0x55e0b974bf70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb958099820 tx=0x7fb9580060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7591fc41b0ca69 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.992+0000 7fb946ffd700 1 -- 172.21.15.17:0/109928139 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958099890 con 0x55e0b9753ad0 2023-07-14T13:00:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.992+0000 7fb946ffd700 1 -- 172.21.15.17:0/109928139 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb95809d8c0 con 0x55e0b9753ad0 2023-07-14T13:00:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.992+0000 7fb946ffd700 1 -- 172.21.15.17:0/109928139 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958098fe0 con 0x55e0b9753ad0 2023-07-14T13:00:42.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.993+0000 7fb979cfdb80 1 -- 172.21.15.17:0/109928139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b9753ad0 msgr2=0x55e0b974bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.993+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/109928139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b9753ad0 0x55e0b974bf70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb958099820 tx=0x7fb9580060e0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.993+0000 7fb979cfdb80 1 -- 172.21.15.17:0/109928139 shutdown_connections 2023-07-14T13:00:42.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.993+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/109928139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b9753ad0 0x55e0b974bf70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.993+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/109928139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b97482d0 0x55e0b9753050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.993+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/109928139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b9748be0 0x55e0b974ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.993+0000 7fb979cfdb80 1 -- 172.21.15.17:0/109928139 >> 172.21.15.17:0/109928139 conn(0x55e0b973eda0 msgr2=0x55e0b9742e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:42.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.995+0000 7fb979cfdb80 1 -- 172.21.15.17:0/109928139 shutdown_connections 2023-07-14T13:00:42.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.995+0000 7fb979cfdb80 1 -- 172.21.15.17:0/109928139 wait complete. 2023-07-14T13:00:42.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.995+0000 7fb979cfdb80 1 -- start start 2023-07-14T13:00:42.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.996+0000 7fb979cfdb80 1 Processor -- start 2023-07-14T13:00:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.996+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9753ad0 0x55e0b9758b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.996+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b975a770 0x55e0b9759060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.996+0000 7fb979cfdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b97595a0 0x55e0b97bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.996+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b97bff90 con 0x55e0b975a770 2023-07-14T13:00:42.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.996+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b97c0100 con 0x55e0b9753ad0 2023-07-14T13:00:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.996+0000 7fb979cfdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b97c02c0 con 0x55e0b97595a0 2023-07-14T13:00:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.996+0000 7fb979cfdb80 10 client.0 _ll_register_callbacks cb 0x7fb958004c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.997+0000 7fb95ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9753ad0 0x55e0b9758b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.997+0000 7fb96499c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b97595a0 0x55e0b97bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.997+0000 7fb96499c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b97595a0 0x55e0b97bf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59390/0 (socket says 172.21.15.17:59390) 2023-07-14T13:00:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.997+0000 7fb95ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9753ad0 0x55e0b9758b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54564/0 (socket says 172.21.15.17:54564) 2023-07-14T13:00:42.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.997+0000 7fb96499c700 1 -- 172.21.15.17:0/2859035566 learned_addr learned my addr 172.21.15.17:0/2859035566 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.997+0000 7fb95f7fe700 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b975a770 0x55e0b9759060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.997+0000 7fb96499c700 1 -- 172.21.15.17:0/2859035566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9753ad0 msgr2=0x55e0b9758b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.997+0000 7fb96499c700 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9753ad0 0x55e0b9758b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.997+0000 7fb96499c700 1 -- 172.21.15.17:0/2859035566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b975a770 msgr2=0x55e0b9759060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.997+0000 7fb96499c700 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b975a770 0x55e0b9759060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.997+0000 7fb96499c700 1 -- 172.21.15.17:0/2859035566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9601a4ba0 con 0x55e0b97595a0 2023-07-14T13:00:42.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.998+0000 7fb96499c700 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b97595a0 0x55e0b97bf9d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb958000f80 tx=0x7fb958099900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37506e7e25cba9d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:42.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.998+0000 7fb93f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:00:42.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.998+0000 7fb93f7fe700 1 -- 172.21.15.17:0/2859035566 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958098f80 con 0x55e0b97595a0 2023-07-14T13:00:42.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.998+0000 7fb93f7fe700 1 -- 172.21.15.17:0/2859035566 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb958099af0 con 0x55e0b97595a0 2023-07-14T13:00:42.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.998+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2859035566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb950015070 con 0x55e0b97595a0 2023-07-14T13:00:42.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.998+0000 7fb93f7fe700 1 -- 172.21.15.17:0/2859035566 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb958099cb0 con 0x55e0b97595a0 2023-07-14T13:00:42.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.998+0000 7fb979cfdb80 10 client.25633 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:42.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.998+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2859035566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e0b94c72b0 con 0x55e0b97595a0 2023-07-14T13:00:42.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.999+0000 7fb93f7fe700 1 -- 172.21.15.17:0/2859035566 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb950015070 con 0x55e0b97595a0 2023-07-14T13:00:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.999+0000 7fb93f7fe700 1 -- 172.21.15.17:0/2859035566 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb95809dd20 con 0x55e0b97595a0 2023-07-14T13:00:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.999+0000 7fb979cfdb80 10 client.25633 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.999+0000 7fb979cfdb80 10 client.25633 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:00:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.999+0000 7fb979cfdb80 20 client.25633 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.999+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55e0b97c1610 0x55e0b97c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.999+0000 7fb979cfdb80 4 client.25633 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:00:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.999+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2859035566 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e0b9656050 con 0x55e0b97c1610 2023-07-14T13:00:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:41.999+0000 7fb95ffff700 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55e0b97c1610 0x55e0b97c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.000+0000 7fb93f7fe700 10 client.25633 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:00:42.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.000+0000 7fb95ffff700 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55e0b97c1610 0x55e0b97c3a20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=33726c276c6c31fd server_cookie=baf7bd02d1587c3 in_seq=0 out_seq=0 2023-07-14T13:00:42.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.000+0000 7fb93f7fe700 1 -- 172.21.15.17:0/2859035566 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e0b9656050 con 0x55e0b97c1610 2023-07-14T13:00:42.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.000+0000 7fb93f7fe700 10 client.25633 handle_command_reply: tid=0 2023-07-14T13:00:42.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.000+0000 7fb979cfdb80 1 client.25633 shutdown 2023-07-14T13:00:42.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.000+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2859035566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b97595a0 msgr2=0x55e0b97bf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.000+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b97595a0 0x55e0b97bf9d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb958000f80 tx=0x7fb958099900 comp rx=0 tx=0).stop 2023-07-14T13:00:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.001+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2859035566 shutdown_connections 2023-07-14T13:00:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.001+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0b97595a0 0x55e0b97bf9d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.001+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55e0b97c1610 0x55e0b97c3a20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.001+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0b9753ad0 0x55e0b9758b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.001+0000 7fb979cfdb80 1 --2- 172.21.15.17:0/2859035566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0b975a770 0x55e0b9759060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.001+0000 7fb93f7fe700 0 client.25633 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:00:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.001+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2859035566 >> 172.21.15.17:0/2859035566 conn(0x55e0b973eda0 msgr2=0x55e0b974ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.001+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2859035566 shutdown_connections 2023-07-14T13:00:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.001+0000 7fb979cfdb80 1 -- 172.21.15.17:0/2859035566 wait complete. 2023-07-14T13:00:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.001+0000 7fb979cfdb80 20 client.25633 trim_cache size 0 max 16384 2023-07-14T13:00:42.040 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:00:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.002+0000 7fb9663ff700 1 -- 172.21.15.17:0/2062517370 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9480a1460 msgr2=0x7fb9480a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.002+0000 7fb9663ff700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9480a1460 0x7fb9480a3910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb960199380 tx=0x7fb95401a040 comp rx=0 tx=0).stop 2023-07-14T13:00:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.002+0000 7fb9663ff700 1 -- 172.21.15.17:0/2062517370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96010a070 msgr2=0x7fb96019c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.002+0000 7fb9663ff700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96010a070 0x7fb96019c710 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb95800ef30 tx=0x7fb95800c3a0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.002+0000 7fb9663ff700 1 -- 172.21.15.17:0/2062517370 shutdown_connections 2023-07-14T13:00:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.002+0000 7fb9663ff700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9480a1460 0x7fb9480a3910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.002+0000 7fb9663ff700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96010a070 0x7fb96019c710 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.002+0000 7fb9663ff700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb960100ca0 0x7fb960197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.002+0000 7fb9663ff700 1 --2- 172.21.15.17:0/2062517370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9601015b0 0x7fb9601982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.002+0000 7fb9663ff700 1 -- 172.21.15.17:0/2062517370 >> 172.21.15.17:0/2062517370 conn(0x7fb9600fa4b0 msgr2=0x7fb96010c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.002+0000 7fb9663ff700 1 -- 172.21.15.17:0/2062517370 shutdown_connections 2023-07-14T13:00:42.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.003+0000 7fb9663ff700 1 -- 172.21.15.17:0/2062517370 wait complete. 2023-07-14T13:00:42.051 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:00:42.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.302+0000 7f7b317ff700 1 -- 172.21.15.17:0/4136100356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2c10a040 msgr2=0x7f7b2c10c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.302+0000 7f7b317ff700 1 --2- 172.21.15.17:0/4136100356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2c10a040 0x7f7b2c10c4b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400b0a0 tx=0x7f7b2400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.302+0000 7f7b317ff700 1 -- 172.21.15.17:0/4136100356 shutdown_connections 2023-07-14T13:00:42.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.302+0000 7f7b317ff700 1 --2- 172.21.15.17:0/4136100356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2c10a040 0x7f7b2c10c4b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.302+0000 7f7b317ff700 1 --2- 172.21.15.17:0/4136100356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b2c100d00 0x7f7b2c1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.302+0000 7f7b317ff700 1 --2- 172.21.15.17:0/4136100356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b2c101610 0x7f7b2c109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.302+0000 7f7b317ff700 1 -- 172.21.15.17:0/4136100356 >> 172.21.15.17:0/4136100356 conn(0x7f7b2c0fa4b0 msgr2=0x7f7b2c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:42.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.303+0000 7f7b317ff700 1 -- 172.21.15.17:0/4136100356 shutdown_connections 2023-07-14T13:00:42.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.303+0000 7f7b317ff700 1 -- 172.21.15.17:0/4136100356 wait complete. 2023-07-14T13:00:42.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.304+0000 7f7b317ff700 1 Processor -- start 2023-07-14T13:00:42.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.304+0000 7f7b317ff700 1 -- start start 2023-07-14T13:00:42.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.304+0000 7f7b317ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2c100d00 0x7f7b2c19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.304+0000 7f7b317ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b2c101610 0x7f7b2c19bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.304+0000 7f7b317ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b2c10a040 0x7f7b2c195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.304+0000 7f7b317ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c1960a0 con 0x7f7b2c100d00 2023-07-14T13:00:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.304+0000 7f7b317ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c196210 con 0x7f7b2c101610 2023-07-14T13:00:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.304+0000 7f7b317ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c1963d0 con 0x7f7b2c10a040 2023-07-14T13:00:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.305+0000 7f7b2affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2c100d00 0x7f7b2c19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.305+0000 7f7b2affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2c100d00 0x7f7b2c19b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32938/0 (socket says 172.21.15.17:32938) 2023-07-14T13:00:42.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.305+0000 7f7b2affd700 1 -- 172.21.15.17:0/2370715316 learned_addr learned my addr 172.21.15.17:0/2370715316 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:42.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.305+0000 7f7b2a7fc700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b2c101610 0x7f7b2c19bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.305+0000 7f7b2b7fe700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b2c10a040 0x7f7b2c195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.305+0000 7f7b2affd700 1 -- 172.21.15.17:0/2370715316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b2c10a040 msgr2=0x7f7b2c195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.305+0000 7f7b2affd700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b2c10a040 0x7f7b2c195a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.305+0000 7f7b2affd700 1 -- 172.21.15.17:0/2370715316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b2c101610 msgr2=0x7f7b2c19bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.305+0000 7f7b2affd700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b2c101610 0x7f7b2c19bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.305+0000 7f7b2affd700 1 -- 172.21.15.17:0/2370715316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b24009d00 con 0x7f7b2c100d00 2023-07-14T13:00:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.306+0000 7f7b2affd700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2c100d00 0x7f7b2c19b9c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00e9a0 tx=0x7f7b1c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.306+0000 7f7b13fff700 1 -- 172.21.15.17:0/2370715316 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c009790 con 0x7f7b2c100d00 2023-07-14T13:00:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.306+0000 7f7b317ff700 1 -- 172.21.15.17:0/2370715316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c1966b0 con 0x7f7b2c100d00 2023-07-14T13:00:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.306+0000 7f7b13fff700 1 -- 172.21.15.17:0/2370715316 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b1c00cbd0 con 0x7f7b2c100d00 2023-07-14T13:00:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.306+0000 7f7b13fff700 1 -- 172.21.15.17:0/2370715316 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c018680 con 0x7f7b2c100d00 2023-07-14T13:00:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.306+0000 7f7b317ff700 1 -- 172.21.15.17:0/2370715316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c1a29b0 con 0x7f7b2c100d00 2023-07-14T13:00:42.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.310+0000 7f7b13fff700 1 -- 172.21.15.17:0/2370715316 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f7b1c00cd40 con 0x7f7b2c100d00 2023-07-14T13:00:42.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.311+0000 7f7b45109b80 1 Processor -- start 2023-07-14T13:00:42.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.311+0000 7f7b45109b80 1 -- start start 2023-07-14T13:00:42.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.311+0000 7f7b13fff700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b140a13e0 0x7f7b140a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.311+0000 7f7b13fff700 1 -- 172.21.15.17:0/2370715316 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7b1c014070 con 0x7f7b2c100d00 2023-07-14T13:00:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b2b7fe700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b140a13e0 0x7f7b140a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec01a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 0x5636ec0299a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 0x5636ec02c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b45109b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ebf20cb0 con 0x5636ec029ee0 2023-07-14T13:00:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b45109b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ebf73a40 con 0x5636ec01abe0 2023-07-14T13:00:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b45109b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ebf6ced0 con 0x5636ec01a2d0 2023-07-14T13:00:42.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b2a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 0x5636ec0299a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b2affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec01a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b2affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec01a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59436/0 (socket says 172.21.15.17:59436) 2023-07-14T13:00:42.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b2a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 0x5636ec0299a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54592/0 (socket says 172.21.15.17:54592) 2023-07-14T13:00:42.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b2affd700 1 -- 172.21.15.17:0/981262685 learned_addr learned my addr 172.21.15.17:0/981262685 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.312+0000 7f7b2b7fe700 1 --2- 172.21.15.17:0/981262685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 0x5636ec02c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.313+0000 7f7b2b7fe700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b140a13e0 0x7f7b140a3890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400b070 tx=0x7f7b240094a0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.313+0000 7f7b2a7fc700 1 -- 172.21.15.17:0/981262685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 msgr2=0x5636ec01a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.313+0000 7f7b2a7fc700 1 --2- 172.21.15.17:0/981262685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec01a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.313+0000 7f7b2a7fc700 1 -- 172.21.15.17:0/981262685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 msgr2=0x5636ec02c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.313+0000 7f7b2a7fc700 1 --2- 172.21.15.17:0/981262685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 0x5636ec02c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.313+0000 7f7b2a7fc700 1 -- 172.21.15.17:0/981262685 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636ebd9ade0 con 0x5636ec01abe0 2023-07-14T13:00:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.313+0000 7f7b2a7fc700 1 --2- 172.21.15.17:0/981262685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 0x5636ec0299a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009c80 tx=0x7f7b20009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71bfc9078550af97 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:42.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.313+0000 7f7b117fa700 1 -- 172.21.15.17:0/981262685 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20011cb0 con 0x5636ec01abe0 2023-07-14T13:00:42.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.313+0000 7f7b117fa700 1 -- 172.21.15.17:0/981262685 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b20011e10 con 0x5636ec01abe0 2023-07-14T13:00:42.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.313+0000 7f7b117fa700 1 -- 172.21.15.17:0/981262685 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20005280 con 0x5636ec01abe0 2023-07-14T13:00:42.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.314+0000 7f7b45109b80 1 -- 172.21.15.17:0/981262685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 msgr2=0x5636ec0299a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.314+0000 7f7b45109b80 1 --2- 172.21.15.17:0/981262685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 0x5636ec0299a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009c80 tx=0x7f7b20009f90 comp rx=0 tx=0).stop 2023-07-14T13:00:42.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.314+0000 7f7b45109b80 1 -- 172.21.15.17:0/981262685 shutdown_connections 2023-07-14T13:00:42.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.314+0000 7f7b45109b80 1 --2- 172.21.15.17:0/981262685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 0x5636ec02c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.314+0000 7f7b45109b80 1 --2- 172.21.15.17:0/981262685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec01a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.314+0000 7f7b45109b80 1 --2- 172.21.15.17:0/981262685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 0x5636ec0299a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.314+0000 7f7b45109b80 1 -- 172.21.15.17:0/981262685 >> 172.21.15.17:0/981262685 conn(0x5636ec010da0 msgr2=0x5636ec0166a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:42.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.314+0000 7f7b45109b80 1 -- 172.21.15.17:0/981262685 shutdown_connections 2023-07-14T13:00:42.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.314+0000 7f7b45109b80 1 -- 172.21.15.17:0/981262685 wait complete. 2023-07-14T13:00:42.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.315+0000 7f7b45109b80 1 -- start start 2023-07-14T13:00:42.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.315+0000 7f7b45109b80 1 Processor -- start 2023-07-14T13:00:42.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.316+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01a2d0 0x5636ec029550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.316+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec01abe0 0x5636ec022790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.316+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec029ee0 0x5636ec022cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.316+0000 7f7b45109b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ebf0cac0 con 0x5636ec01abe0 2023-07-14T13:00:42.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.316+0000 7f7b45109b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ebf0c7c0 con 0x5636ec01a2d0 2023-07-14T13:00:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.316+0000 7f7b45109b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ebdf0920 con 0x5636ec029ee0 2023-07-14T13:00:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.316+0000 7f7b45109b80 10 client.0 _ll_register_callbacks cb 0x5636ebf0a760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.316+0000 7f7b2affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01a2d0 0x5636ec029550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.316+0000 7f7b2affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01a2d0 0x5636ec029550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54596/0 (socket says 172.21.15.17:54596) 2023-07-14T13:00:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.316+0000 7f7b2affd700 1 -- 172.21.15.17:0/1077570951 learned_addr learned my addr 172.21.15.17:0/1077570951 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.316+0000 7f7b2b7fe700 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec029ee0 0x5636ec022cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.317+0000 7f7b2affd700 1 -- 172.21.15.17:0/1077570951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec029ee0 msgr2=0x5636ec022cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.317+0000 7f7b2affd700 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec029ee0 0x5636ec022cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.317+0000 7f7b2affd700 1 -- 172.21.15.17:0/1077570951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec01abe0 msgr2=0x5636ec022790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.317+0000 7f7b2affd700 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec01abe0 0x5636ec022790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.317+0000 7f7b2affd700 1 -- 172.21.15.17:0/1077570951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b200098e0 con 0x5636ec01a2d0 2023-07-14T13:00:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.317+0000 7f7b2affd700 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01a2d0 0x5636ec029550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00e970 tx=0x7f7b1c09a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe5a4f843ccfa0d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.317+0000 7f7b0eff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:00:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.317+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1077570951 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0a2540 con 0x5636ec01a2d0 2023-07-14T13:00:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.317+0000 7f7b45109b80 1 -- 172.21.15.17:0/1077570951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636ebec64f0 con 0x5636ec01a2d0 2023-07-14T13:00:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.317+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1077570951 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7b1c0cd030 con 0x5636ec01a2d0 2023-07-14T13:00:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.317+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1077570951 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b1c0b8270 con 0x5636ec01a2d0 2023-07-14T13:00:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.318+0000 7f7b45109b80 10 client.25682 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.318+0000 7f7b45109b80 1 -- 172.21.15.17:0/1077570951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5636ebd83c60 con 0x5636ec01a2d0 2023-07-14T13:00:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.318+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1077570951 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b1c0c8020 con 0x5636ec01a2d0 2023-07-14T13:00:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.318+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1077570951 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7b1c095ee0 con 0x5636ec01a2d0 2023-07-14T13:00:42.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.318+0000 7f7b45109b80 10 client.25682 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.318+0000 7f7b45109b80 10 client.25682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.318+0000 7f7b45109b80 20 client.25682 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.318+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5636ec03dcd0 0x5636ec0400e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.318+0000 7f7b45109b80 4 client.25682 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.318+0000 7f7b45109b80 1 -- 172.21.15.17:0/1077570951 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636ebf65eb0 con 0x5636ec03dcd0 2023-07-14T13:00:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.319+0000 7f7b2a7fc700 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5636ec03dcd0 0x5636ec0400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.320+0000 7f7b2a7fc700 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5636ec03dcd0 0x5636ec0400e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12bd320d3b4db547 server_cookie=db3815ee9172d3cb in_seq=0 out_seq=0 2023-07-14T13:00:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.320+0000 7f7b0eff5700 10 client.25682 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.320+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1077570951 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5636ebf65eb0 con 0x5636ec03dcd0 2023-07-14T13:00:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.320+0000 7f7b0eff5700 10 client.25682 handle_command_reply: tid=0 2023-07-14T13:00:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.320+0000 7f7b45109b80 1 client.25682 shutdown 2023-07-14T13:00:42.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b45109b80 1 -- 172.21.15.17:0/1077570951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01a2d0 msgr2=0x5636ec029550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01a2d0 0x5636ec029550 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00e970 tx=0x7f7b1c09a630 comp rx=0 tx=0).stop 2023-07-14T13:00:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b45109b80 1 -- 172.21.15.17:0/1077570951 shutdown_connections 2023-07-14T13:00:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5636ec03dcd0 0x5636ec0400e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec029ee0 0x5636ec022cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01a2d0 0x5636ec029550 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1077570951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec01abe0 0x5636ec022790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b0eff5700 0 client.25682 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b45109b80 1 -- 172.21.15.17:0/1077570951 >> 172.21.15.17:0/1077570951 conn(0x5636ec010da0 msgr2=0x5636ec016290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b45109b80 1 -- 172.21.15.17:0/1077570951 shutdown_connections 2023-07-14T13:00:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b45109b80 1 -- 172.21.15.17:0/1077570951 wait complete. 2023-07-14T13:00:42.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.321+0000 7f7b45109b80 20 client.25682 trim_cache size 0 max 16384 2023-07-14T13:00:42.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:42 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2087191855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:00:42.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.336+0000 7f7b45109b80 1 Processor -- start 2023-07-14T13:00:42.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.336+0000 7f7b45109b80 1 -- start start 2023-07-14T13:00:42.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec01d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 0x5636ec0290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 0x5636ec01fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b45109b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ec023d70 con 0x5636ec029ee0 2023-07-14T13:00:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b45109b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ec016be0 con 0x5636ec01abe0 2023-07-14T13:00:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b45109b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ec00def0 con 0x5636ec01a2d0 2023-07-14T13:00:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b2b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 0x5636ec01fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b2affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec01d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b2b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 0x5636ec01fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32964/0 (socket says 172.21.15.17:32964) 2023-07-14T13:00:42.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b2affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec01d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59454/0 (socket says 172.21.15.17:59454) 2023-07-14T13:00:42.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b2b7fe700 1 -- 172.21.15.17:0/315909300 learned_addr learned my addr 172.21.15.17:0/315909300 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:42.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.337+0000 7f7b2a7fc700 1 --2- 172.21.15.17:0/315909300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 0x5636ec0290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.338+0000 7f7b2b7fe700 1 -- 172.21.15.17:0/315909300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 msgr2=0x5636ec01d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.338+0000 7f7b2b7fe700 1 --2- 172.21.15.17:0/315909300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec01d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.338+0000 7f7b2b7fe700 1 -- 172.21.15.17:0/315909300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 msgr2=0x5636ec0290f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.338+0000 7f7b2b7fe700 1 --2- 172.21.15.17:0/315909300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 0x5636ec0290f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.338+0000 7f7b2b7fe700 1 -- 172.21.15.17:0/315909300 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636ebdc1250 con 0x5636ec029ee0 2023-07-14T13:00:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.338+0000 7f7b2affd700 1 --2- 172.21.15.17:0/315909300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec01d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.338+0000 7f7b2a7fc700 1 --2- 172.21.15.17:0/315909300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 0x5636ec0290f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:42.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.338+0000 7f7b2b7fe700 1 --2- 172.21.15.17:0/315909300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 0x5636ec01fa20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7b24015000 tx=0x7f7b24020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab952b12ee63d11 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.338+0000 7f7b11ffb700 1 -- 172.21.15.17:0/315909300 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2400e040 con 0x5636ec029ee0 2023-07-14T13:00:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.338+0000 7f7b11ffb700 1 -- 172.21.15.17:0/315909300 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b24004c50 con 0x5636ec029ee0 2023-07-14T13:00:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.338+0000 7f7b11ffb700 1 -- 172.21.15.17:0/315909300 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2402a9b0 con 0x5636ec029ee0 2023-07-14T13:00:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.339+0000 7f7b45109b80 1 -- 172.21.15.17:0/315909300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 msgr2=0x5636ec01fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.339+0000 7f7b45109b80 1 --2- 172.21.15.17:0/315909300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 0x5636ec01fa20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7b24015000 tx=0x7f7b24020000 comp rx=0 tx=0).stop 2023-07-14T13:00:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.339+0000 7f7b45109b80 1 -- 172.21.15.17:0/315909300 shutdown_connections 2023-07-14T13:00:42.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.339+0000 7f7b45109b80 1 --2- 172.21.15.17:0/315909300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec029ee0 0x5636ec01fa20 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.339+0000 7f7b45109b80 1 --2- 172.21.15.17:0/315909300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec01d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.339+0000 7f7b45109b80 1 --2- 172.21.15.17:0/315909300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec01abe0 0x5636ec0290f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.339+0000 7f7b45109b80 1 -- 172.21.15.17:0/315909300 >> 172.21.15.17:0/315909300 conn(0x5636ec010da0 msgr2=0x5636ec01da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.340+0000 7f7b45109b80 1 -- 172.21.15.17:0/315909300 shutdown_connections 2023-07-14T13:00:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.340+0000 7f7b45109b80 1 -- 172.21.15.17:0/315909300 wait complete. 2023-07-14T13:00:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.340+0000 7f7b45109b80 1 -- start start 2023-07-14T13:00:42.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.340+0000 7f7b45109b80 1 Processor -- start 2023-07-14T13:00:42.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec03a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec01abe0 0x5636ec038d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b45109b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec029ee0 0x5636ec039260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b45109b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ec039950 con 0x5636ec01abe0 2023-07-14T13:00:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b45109b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ec039ac0 con 0x5636ec029ee0 2023-07-14T13:00:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b45109b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636ec091ba0 con 0x5636ec01a2d0 2023-07-14T13:00:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b45109b80 10 client.0 _ll_register_callbacks cb 0x5636ebf0a760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:42.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b2a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec01abe0 0x5636ec038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b2a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec01abe0 0x5636ec038d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32972/0 (socket says 172.21.15.17:32972) 2023-07-14T13:00:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b2a7fc700 1 -- 172.21.15.17:0/1883934744 learned_addr learned my addr 172.21.15.17:0/1883934744 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b2affd700 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec03a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.341+0000 7f7b2b7fe700 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec029ee0 0x5636ec039260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.342+0000 7f7b2a7fc700 1 -- 172.21.15.17:0/1883934744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 msgr2=0x5636ec03a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.342+0000 7f7b2a7fc700 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec03a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.342+0000 7f7b2a7fc700 1 -- 172.21.15.17:0/1883934744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec029ee0 msgr2=0x5636ec039260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.342+0000 7f7b2a7fc700 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec029ee0 0x5636ec039260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.342+0000 7f7b2a7fc700 1 -- 172.21.15.17:0/1883934744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636ebd83c60 con 0x5636ec01abe0 2023-07-14T13:00:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.342+0000 7f7b2affd700 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec03a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.342+0000 7f7b2b7fe700 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec029ee0 0x5636ec039260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.342+0000 7f7b2a7fc700 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec01abe0 0x5636ec038d20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x5636ec023d40 tx=0x7f7b20009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e683fc0a2c49ed2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:42.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.342+0000 7f7b0eff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1883934744 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20011bf0 con 0x5636ec01abe0 2023-07-14T13:00:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1883934744 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7b20028af0 con 0x5636ec01abe0 2023-07-14T13:00:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b45109b80 1 -- 172.21.15.17:0/1883934744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b20011e10 con 0x5636ec01abe0 2023-07-14T13:00:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1883934744 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b20028cb0 con 0x5636ec01abe0 2023-07-14T13:00:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b45109b80 10 client.15918 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b45109b80 1 -- 172.21.15.17:0/1883934744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f7b2001d040 con 0x5636ec01abe0 2023-07-14T13:00:42.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1883934744 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b20011e10 con 0x5636ec01abe0 2023-07-14T13:00:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1883934744 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7b20003ad0 con 0x5636ec01abe0 2023-07-14T13:00:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b45109b80 10 client.15918 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b45109b80 10 client.15918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b45109b80 20 client.15918 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.343+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5636ec093110 0x5636ec095520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.344+0000 7f7b45109b80 4 client.15918 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:00:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.344+0000 7f7b45109b80 1 -- 172.21.15.17:0/1883934744 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5636ebf28050 con 0x5636ec093110 2023-07-14T13:00:42.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.344+0000 7f7b2affd700 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5636ec093110 0x5636ec095520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.344+0000 7f7b2affd700 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5636ec093110 0x5636ec095520 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c640a31c6229d5f0 server_cookie=27ff5814b9e29fc0 in_seq=0 out_seq=0 2023-07-14T13:00:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.344+0000 7f7b0eff5700 10 client.15918 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b0eff5700 1 -- 172.21.15.17:0/1883934744 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5636ebf28050 con 0x5636ec093110 2023-07-14T13:00:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b0eff5700 10 client.15918 handle_command_reply: tid=0 2023-07-14T13:00:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 1 client.15918 shutdown 2023-07-14T13:00:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 1 -- 172.21.15.17:0/1883934744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec01abe0 msgr2=0x5636ec038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec01abe0 0x5636ec038d20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x5636ec023d40 tx=0x7f7b20009280 comp rx=0 tx=0).stop 2023-07-14T13:00:42.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 1 -- 172.21.15.17:0/1883934744 shutdown_connections 2023-07-14T13:00:42.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5636ec093110 0x5636ec095520 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5636ec029ee0 0x5636ec039260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5636ec01a2d0 0x5636ec03a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b0eff5700 0 client.15918 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:42.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 1 --2- 172.21.15.17:0/1883934744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5636ec01abe0 0x5636ec038d20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 1 -- 172.21.15.17:0/1883934744 >> 172.21.15.17:0/1883934744 conn(0x5636ec010da0 msgr2=0x5636ec01c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:42.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 1 -- 172.21.15.17:0/1883934744 shutdown_connections 2023-07-14T13:00:42.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 1 -- 172.21.15.17:0/1883934744 wait complete. 2023-07-14T13:00:42.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.345+0000 7f7b45109b80 20 client.15918 trim_cache size 0 max 16384 2023-07-14T13:00:42.384 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:00:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 -- 172.21.15.17:0/2370715316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b140a13e0 msgr2=0x7f7b140a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b140a13e0 0x7f7b140a3890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400b070 tx=0x7f7b240094a0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 -- 172.21.15.17:0/2370715316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2c100d00 msgr2=0x7f7b2c19b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:42.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2c100d00 0x7f7b2c19b9c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00e9a0 tx=0x7f7b1c00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 -- 172.21.15.17:0/2370715316 shutdown_connections 2023-07-14T13:00:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b140a13e0 0x7f7b140a3890 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b2c10a040 0x7f7b2c195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b2c100d00 0x7f7b2c19b9c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 --2- 172.21.15.17:0/2370715316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b2c101610 0x7f7b2c19bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 -- 172.21.15.17:0/2370715316 >> 172.21.15.17:0/2370715316 conn(0x7f7b2c0fa4b0 msgr2=0x7f7b2c10c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:42.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 -- 172.21.15.17:0/2370715316 shutdown_connections 2023-07-14T13:00:42.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:42.346+0000 7f7b317ff700 1 -- 172.21.15.17:0/2370715316 wait complete. 2023-07-14T13:00:42.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:42 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2087191855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:00:42.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:42 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2087191855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:00:43.017 INFO:teuthology.orchestra.run.smithi017.stderr:2000000 of 50000000 tuples (4%) done (elapsed 32.62 s, remaining 782.93 s) 2023-07-14T13:00:43.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:43 smithi017 ceph-mon[95536]: pgmap v32: 97 pgs: 97 active+clean; 458 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 MiB/s wr, 33 op/s 2023-07-14T13:00:43.398 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:00:43.399 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:00:43.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:43 smithi135 ceph-mon[97338]: pgmap v32: 97 pgs: 97 active+clean; 458 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 MiB/s wr, 33 op/s 2023-07-14T13:00:43.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:43 smithi131 ceph-mon[96953]: pgmap v32: 97 pgs: 97 active+clean; 458 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 MiB/s wr, 33 op/s 2023-07-14T13:00:43.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.609+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/219733659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b44100d00 msgr2=0x7f1b441010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.609+0000 7f1b4b3ff700 1 --2- 172.21.15.17:0/219733659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b44100d00 0x7f1b441010d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009990 tx=0x7f1b40009ca0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.609+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/219733659 shutdown_connections 2023-07-14T13:00:43.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.609+0000 7f1b4b3ff700 1 --2- 172.21.15.17:0/219733659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b4410a040 0x7f1b4410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.609+0000 7f1b4b3ff700 1 --2- 172.21.15.17:0/219733659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b44100d00 0x7f1b441010d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.609+0000 7f1b4b3ff700 1 --2- 172.21.15.17:0/219733659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b44101610 0x7f1b44109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.609+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/219733659 >> 172.21.15.17:0/219733659 conn(0x7f1b440fa4b0 msgr2=0x7f1b440fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:43.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.609+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/219733659 shutdown_connections 2023-07-14T13:00:43.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.609+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/219733659 wait complete. 2023-07-14T13:00:43.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.610+0000 7f1b4b3ff700 1 Processor -- start 2023-07-14T13:00:43.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4b3ff700 1 -- start start 2023-07-14T13:00:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4b3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b44100d00 0x7f1b44197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b44101610 0x7f1b441982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4b3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b4410a040 0x7f1b4419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4b3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4419cd50 con 0x7f1b4410a040 2023-07-14T13:00:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4b3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4419cec0 con 0x7f1b44100d00 2023-07-14T13:00:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4419d080 con 0x7f1b44101610 2023-07-14T13:00:43.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b4410a040 0x7f1b4419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b4410a040 0x7f1b4419c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32994/0 (socket says 172.21.15.17:32994) 2023-07-14T13:00:43.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b44100d00 0x7f1b44197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4999c700 1 -- 172.21.15.17:0/3590929029 learned_addr learned my addr 172.21.15.17:0/3590929029 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:43.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.611+0000 7f1b4899a700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b44101610 0x7f1b441982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.612+0000 7f1b4999c700 1 -- 172.21.15.17:0/3590929029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b44101610 msgr2=0x7f1b441982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.612+0000 7f1b4999c700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b44101610 0x7f1b441982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.612+0000 7f1b4999c700 1 -- 172.21.15.17:0/3590929029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b44100d00 msgr2=0x7f1b44197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.612+0000 7f1b4999c700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b44100d00 0x7f1b44197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.612+0000 7f1b4999c700 1 -- 172.21.15.17:0/3590929029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400095f0 con 0x7f1b4410a040 2023-07-14T13:00:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.612+0000 7f1b4999c700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b4410a040 0x7f1b4419c710 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00ef30 tx=0x7f1b3c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.612+0000 7f1b3a7fc700 1 -- 172.21.15.17:0/3590929029 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c018070 con 0x7f1b4410a040 2023-07-14T13:00:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.612+0000 7f1b3a7fc700 1 -- 172.21.15.17:0/3590929029 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b3c00f040 con 0x7f1b4410a040 2023-07-14T13:00:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.612+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/3590929029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4419d300 con 0x7f1b4410a040 2023-07-14T13:00:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.612+0000 7f1b3a7fc700 1 -- 172.21.15.17:0/3590929029 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c00cbc0 con 0x7f1b4410a040 2023-07-14T13:00:43.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.613+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/3590929029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b441a4ba0 con 0x7f1b4410a040 2023-07-14T13:00:43.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.616+0000 7f1b3a7fc700 1 -- 172.21.15.17:0/3590929029 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f1b3c00cd60 con 0x7f1b4410a040 2023-07-14T13:00:43.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.617+0000 7f1b5ecb3b80 1 Processor -- start 2023-07-14T13:00:43.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.618+0000 7f1b5ecb3b80 1 -- start start 2023-07-14T13:00:43.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.618+0000 7f1b3a7fc700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b300a1460 0x7f1b300a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.618+0000 7f1b3a7fc700 1 -- 172.21.15.17:0/3590929029 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1b3c0cc970 con 0x7f1b4410a040 2023-07-14T13:00:43.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.618+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 0x556bb2c5a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.618+0000 7f1b4899a700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b300a1460 0x7f1b300a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.618+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5ac60 0x556bb2c65610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.618+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 0x556bb2c67f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.618+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2b60d30 con 0x556bb2c5a350 2023-07-14T13:00:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.618+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2bb3ac0 con 0x556bb2c65b50 2023-07-14T13:00:43.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.618+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2bacf50 con 0x556bb2c5ac60 2023-07-14T13:00:43.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4999c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 0x556bb2c67f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 0x556bb2c5a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4999c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 0x556bb2c67f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54638/0 (socket says 172.21.15.17:54638) 2023-07-14T13:00:43.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4999c700 1 -- 172.21.15.17:0/3061044975 learned_addr learned my addr 172.21.15.17:0/3061044975 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:43.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4899a700 1 --2- 172.21.15.17:0/3061044975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5ac60 0x556bb2c65610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4919b700 1 -- 172.21.15.17:0/3061044975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5ac60 msgr2=0x556bb2c65610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4919b700 1 --2- 172.21.15.17:0/3061044975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5ac60 0x556bb2c65610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4919b700 1 -- 172.21.15.17:0/3061044975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 msgr2=0x556bb2c67f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4919b700 1 --2- 172.21.15.17:0/3061044975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 0x556bb2c67f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4919b700 1 -- 172.21.15.17:0/3061044975 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bb29dae60 con 0x556bb2c5a350 2023-07-14T13:00:43.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4999c700 1 --2- 172.21.15.17:0/3061044975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 0x556bb2c67f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:43.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4899a700 1 --2- 172.21.15.17:0/3061044975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5ac60 0x556bb2c65610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:43.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.619+0000 7f1b4899a700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b300a1460 0x7f1b300a3910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400b6c0 tx=0x7f1b34012890 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:43.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.620+0000 7f1b4919b700 1 --2- 172.21.15.17:0/3061044975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 0x556bb2c5a720 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1b400098e0 tx=0x7f1b40005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f2772c4d1603b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:43.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.620+0000 7f1b2f7fe700 1 -- 172.21.15.17:0/3061044975 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4001d070 con 0x556bb2c5a350 2023-07-14T13:00:43.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.620+0000 7f1b2f7fe700 1 -- 172.21.15.17:0/3061044975 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b4001e040 con 0x556bb2c5a350 2023-07-14T13:00:43.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.620+0000 7f1b2f7fe700 1 -- 172.21.15.17:0/3061044975 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40004830 con 0x556bb2c5a350 2023-07-14T13:00:43.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.621+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/3061044975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 msgr2=0x556bb2c5a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.621+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/3061044975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 0x556bb2c5a720 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1b400098e0 tx=0x7f1b40005c00 comp rx=0 tx=0).stop 2023-07-14T13:00:43.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.621+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/3061044975 shutdown_connections 2023-07-14T13:00:43.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.621+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/3061044975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 0x556bb2c67f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.621+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/3061044975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 0x556bb2c5a720 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.621+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/3061044975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5ac60 0x556bb2c65610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.621+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/3061044975 >> 172.21.15.17:0/3061044975 conn(0x556bb2c50e20 msgr2=0x556bb2c56720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:43.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.621+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/3061044975 shutdown_connections 2023-07-14T13:00:43.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.621+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/3061044975 wait complete. 2023-07-14T13:00:43.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.621+0000 7f1b5ecb3b80 1 -- start start 2023-07-14T13:00:43.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.622+0000 7f1b5ecb3b80 1 Processor -- start 2023-07-14T13:00:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.622+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5a350 0x556bb2c65590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.622+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5ac60 0x556bb2c627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.622+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 0x556bb2c62ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.622+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2b4cb40 con 0x556bb2c5ac60 2023-07-14T13:00:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.622+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2b4c840 con 0x556bb2c65b50 2023-07-14T13:00:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.622+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2a309a0 con 0x556bb2c5a350 2023-07-14T13:00:43.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.622+0000 7f1b5ecb3b80 10 client.0 _ll_register_callbacks cb 0x556bb2b4a7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b4899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5ac60 0x556bb2c627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b4899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5ac60 0x556bb2c627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33004/0 (socket says 172.21.15.17:33004) 2023-07-14T13:00:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b4899a700 1 -- 172.21.15.17:0/2004985312 learned_addr learned my addr 172.21.15.17:0/2004985312 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b4919b700 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5a350 0x556bb2c65590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b4999c700 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 0x556bb2c62ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b4899a700 1 -- 172.21.15.17:0/2004985312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5a350 msgr2=0x556bb2c65590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b4899a700 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5a350 0x556bb2c65590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b4899a700 1 -- 172.21.15.17:0/2004985312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 msgr2=0x556bb2c62ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b4899a700 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 0x556bb2c62ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b4899a700 1 -- 172.21.15.17:0/2004985312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b441a4ba0 con 0x556bb2c5ac60 2023-07-14T13:00:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b4899a700 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5ac60 0x556bb2c627a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400f7c0 tx=0x7f1b340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6c51781b00f696 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.623+0000 7f1b2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.624+0000 7f1b2cff9700 1 -- 172.21.15.17:0/2004985312 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34020810 con 0x556bb2c5ac60 2023-07-14T13:00:43.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.624+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2004985312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556bb2b06570 con 0x556bb2c5ac60 2023-07-14T13:00:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.624+0000 7f1b2cff9700 1 -- 172.21.15.17:0/2004985312 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1b34020970 con 0x556bb2c5ac60 2023-07-14T13:00:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.624+0000 7f1b2cff9700 1 -- 172.21.15.17:0/2004985312 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b34020b30 con 0x556bb2c5ac60 2023-07-14T13:00:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.624+0000 7f1b5ecb3b80 10 client.15930 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.624+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2004985312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f1b4410d170 con 0x556bb2c5ac60 2023-07-14T13:00:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.624+0000 7f1b2cff9700 1 -- 172.21.15.17:0/2004985312 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556bb2b06570 con 0x556bb2c5ac60 2023-07-14T13:00:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.625+0000 7f1b2cff9700 1 -- 172.21.15.17:0/2004985312 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1b34026020 con 0x556bb2c5ac60 2023-07-14T13:00:43.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.625+0000 7f1b5ecb3b80 10 client.15930 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.625+0000 7f1b5ecb3b80 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.625+0000 7f1b5ecb3b80 20 client.15930 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.625+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556bb2c753c0 0x556bb2c777f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.625+0000 7f1b5ecb3b80 4 client.15930 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.625+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2004985312 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556bb2ba5f30 con 0x556bb2c753c0 2023-07-14T13:00:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.625+0000 7f1b4919b700 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556bb2c753c0 0x556bb2c777f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.626+0000 7f1b4919b700 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556bb2c753c0 0x556bb2c777f0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed198076966653 server_cookie=1c37835b90446b31 in_seq=0 out_seq=0 2023-07-14T13:00:43.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.626+0000 7f1b2cff9700 10 client.15930 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b2cff9700 1 -- 172.21.15.17:0/2004985312 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556bb2ba5f30 con 0x556bb2c753c0 2023-07-14T13:00:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b2cff9700 10 client.15930 handle_command_reply: tid=0 2023-07-14T13:00:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b5ecb3b80 1 client.15930 shutdown 2023-07-14T13:00:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2004985312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5ac60 msgr2=0x556bb2c627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5ac60 0x556bb2c627a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400f7c0 tx=0x7f1b340047c0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2004985312 shutdown_connections 2023-07-14T13:00:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556bb2c753c0 0x556bb2c777f0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c65b50 0x556bb2c62ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5a350 0x556bb2c65590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/2004985312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5ac60 0x556bb2c627a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2004985312 >> 172.21.15.17:0/2004985312 conn(0x556bb2c50e20 msgr2=0x556bb2c562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b2cff9700 0 client.15930 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:43.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2004985312 shutdown_connections 2023-07-14T13:00:43.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.627+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2004985312 wait complete. 2023-07-14T13:00:43.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.628+0000 7f1b5ecb3b80 20 client.15930 trim_cache size 0 max 16384 2023-07-14T13:00:43.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.645+0000 7f1b5ecb3b80 1 Processor -- start 2023-07-14T13:00:43.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.646+0000 7f1b5ecb3b80 1 -- start start 2023-07-14T13:00:43.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.646+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c50e20 0x556bb2c62750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.646+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5a350 0x556bb2c650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.646+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 0x556bb2c5fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.646+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2c57de0 con 0x556bb2c50e20 2023-07-14T13:00:43.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.646+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2c5b5f0 con 0x556bb2c5ac60 2023-07-14T13:00:43.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.646+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2c5e3e0 con 0x556bb2c5a350 2023-07-14T13:00:43.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.646+0000 7f1b4919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c50e20 0x556bb2c62750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.646+0000 7f1b4919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c50e20 0x556bb2c62750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33014/0 (socket says 172.21.15.17:33014) 2023-07-14T13:00:43.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.646+0000 7f1b4919b700 1 -- 172.21.15.17:0/2721881531 learned_addr learned my addr 172.21.15.17:0/2721881531 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b4899a700 1 --2- 172.21.15.17:0/2721881531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5a350 0x556bb2c650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b4919b700 1 -- 172.21.15.17:0/2721881531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5a350 msgr2=0x556bb2c650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b4999c700 1 --2- 172.21.15.17:0/2721881531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 0x556bb2c5fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b4919b700 1 --2- 172.21.15.17:0/2721881531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5a350 0x556bb2c650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b4919b700 1 -- 172.21.15.17:0/2721881531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 msgr2=0x556bb2c5fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b4919b700 1 --2- 172.21.15.17:0/2721881531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 0x556bb2c5fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b4919b700 1 -- 172.21.15.17:0/2721881531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bb29c3ce0 con 0x556bb2c50e20 2023-07-14T13:00:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b4999c700 1 --2- 172.21.15.17:0/2721881531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 0x556bb2c5fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:00:43.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b4919b700 1 --2- 172.21.15.17:0/2721881531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c50e20 0x556bb2c62750 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009ce0 tx=0x7f1b4001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed5da29f8774eab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:43.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b2ffff700 1 -- 172.21.15.17:0/2721881531 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40032070 con 0x556bb2c50e20 2023-07-14T13:00:43.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b2ffff700 1 -- 172.21.15.17:0/2721881531 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b4000bc40 con 0x556bb2c50e20 2023-07-14T13:00:43.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.647+0000 7f1b2ffff700 1 -- 172.21.15.17:0/2721881531 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4001d040 con 0x556bb2c50e20 2023-07-14T13:00:43.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.648+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2721881531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c50e20 msgr2=0x556bb2c62750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.648+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/2721881531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c50e20 0x556bb2c62750 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009ce0 tx=0x7f1b4001a040 comp rx=0 tx=0).stop 2023-07-14T13:00:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.648+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2721881531 shutdown_connections 2023-07-14T13:00:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.648+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/2721881531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 0x556bb2c5fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.648+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/2721881531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c50e20 0x556bb2c62750 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.648+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/2721881531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c5a350 0x556bb2c650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.648+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2721881531 >> 172.21.15.17:0/2721881531 conn(0x556bb2c52680 msgr2=0x556bb2c62040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.648+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2721881531 shutdown_connections 2023-07-14T13:00:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.648+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/2721881531 wait complete. 2023-07-14T13:00:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.649+0000 7f1b5ecb3b80 1 -- start start 2023-07-14T13:00:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.649+0000 7f1b5ecb3b80 1 Processor -- start 2023-07-14T13:00:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c50e20 0x556bb2c6aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 0x556bb2c6b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b5ecb3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 0x556bb2cc92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2c6bb90 con 0x556bb2c5a350 2023-07-14T13:00:43.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2c6bd00 con 0x556bb2c5ac60 2023-07-14T13:00:43.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b5ecb3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb2cc97f0 con 0x556bb2c50e20 2023-07-14T13:00:43.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b5ecb3b80 10 client.0 _ll_register_callbacks cb 0x7f1b3400f3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:43.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b4899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 0x556bb2c6b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b4999c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 0x556bb2cc92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b4899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 0x556bb2c6b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33024/0 (socket says 172.21.15.17:33024) 2023-07-14T13:00:43.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b4899a700 1 -- 172.21.15.17:0/1399970578 learned_addr learned my addr 172.21.15.17:0/1399970578 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:43.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.650+0000 7f1b4919b700 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c50e20 0x556bb2c6aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b4899a700 1 -- 172.21.15.17:0/1399970578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c50e20 msgr2=0x556bb2c6aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b4899a700 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c50e20 0x556bb2c6aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b4899a700 1 -- 172.21.15.17:0/1399970578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 msgr2=0x556bb2cc92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b4899a700 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 0x556bb2cc92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b4899a700 1 -- 172.21.15.17:0/1399970578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bb29dae60 con 0x556bb2c5a350 2023-07-14T13:00:43.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b4999c700 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 0x556bb2cc92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:43.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b4919b700 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c50e20 0x556bb2c6aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:43.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b4899a700 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 0x556bb2c6b400 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400f7c0 tx=0x7f1b34028e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5cb731028ebe6a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:43.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:43.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b2cff9700 1 -- 172.21.15.17:0/1399970578 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400ff10 con 0x556bb2c5a350 2023-07-14T13:00:43.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/1399970578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b4001e040 con 0x556bb2c5a350 2023-07-14T13:00:43.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.651+0000 7f1b2cff9700 1 -- 172.21.15.17:0/1399970578 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1b34028480 con 0x556bb2c5a350 2023-07-14T13:00:43.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.652+0000 7f1b2cff9700 1 -- 172.21.15.17:0/1399970578 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b34012c90 con 0x556bb2c5a350 2023-07-14T13:00:43.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.652+0000 7f1b5ecb3b80 10 client.15936 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:43.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.652+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/1399970578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556bb2a012d0 con 0x556bb2c5a350 2023-07-14T13:00:43.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.652+0000 7f1b2cff9700 1 -- 172.21.15.17:0/1399970578 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b4001e040 con 0x556bb2c5a350 2023-07-14T13:00:43.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.652+0000 7f1b2cff9700 1 -- 172.21.15.17:0/1399970578 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1b3400f8a0 con 0x556bb2c5a350 2023-07-14T13:00:43.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.652+0000 7f1b5ecb3b80 10 client.15936 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:43.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.652+0000 7f1b5ecb3b80 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:43.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.652+0000 7f1b5ecb3b80 20 client.15936 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:43.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.652+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556bb2c65b50 0x556bb2cccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.652+0000 7f1b5ecb3b80 4 client.15936 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:00:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.652+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/1399970578 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556bb2b680d0 con 0x556bb2c65b50 2023-07-14T13:00:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.653+0000 7f1b4919b700 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556bb2c65b50 0x556bb2cccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.653+0000 7f1b2cff9700 10 client.15936 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:43.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.653+0000 7f1b4919b700 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556bb2c65b50 0x556bb2cccf60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12b09e7948265072 server_cookie=88d4c7f1efd4f9da in_seq=0 out_seq=0 2023-07-14T13:00:43.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.654+0000 7f1b2cff9700 1 -- 172.21.15.17:0/1399970578 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556bb2b680d0 con 0x556bb2c65b50 2023-07-14T13:00:43.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.654+0000 7f1b2cff9700 10 client.15936 handle_command_reply: tid=0 2023-07-14T13:00:43.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.654+0000 7f1b5ecb3b80 1 client.15936 shutdown 2023-07-14T13:00:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.654+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/1399970578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 msgr2=0x556bb2c6b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.654+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 0x556bb2c6b400 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400f7c0 tx=0x7f1b34028e30 comp rx=0 tx=0).stop 2023-07-14T13:00:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.655+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/1399970578 shutdown_connections 2023-07-14T13:00:43.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.655+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556bb2c65b50 0x556bb2cccf60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.655+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bb2c5ac60 0x556bb2cc92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.655+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bb2c50e20 0x556bb2c6aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.655+0000 7f1b5ecb3b80 1 --2- 172.21.15.17:0/1399970578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bb2c5a350 0x556bb2c6b400 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.655+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/1399970578 >> 172.21.15.17:0/1399970578 conn(0x556bb2c52680 msgr2=0x556bb2c60d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.655+0000 7f1b2cff9700 0 client.15936 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.655+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/1399970578 shutdown_connections 2023-07-14T13:00:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.655+0000 7f1b5ecb3b80 1 -- 172.21.15.17:0/1399970578 wait complete. 2023-07-14T13:00:43.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.655+0000 7f1b5ecb3b80 20 client.15936 trim_cache size 0 max 16384 2023-07-14T13:00:43.696 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:00:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:00:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "f3578cce-cbe4-4d2d-80c7-958bc9d580c0", 2023-07-14T13:00:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:00:43.697 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:00:43.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.655+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/3590929029 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b300a1460 msgr2=0x7f1b300a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.656+0000 7f1b4b3ff700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b300a1460 0x7f1b300a3910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400b6c0 tx=0x7f1b34012890 comp rx=0 tx=0).stop 2023-07-14T13:00:43.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.656+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/3590929029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b4410a040 msgr2=0x7f1b4419c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.656+0000 7f1b4b3ff700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b4410a040 0x7f1b4419c710 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00ef30 tx=0x7f1b3c00c3a0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.656+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/3590929029 shutdown_connections 2023-07-14T13:00:43.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.656+0000 7f1b4b3ff700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b300a1460 0x7f1b300a3910 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.656+0000 7f1b4b3ff700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b4410a040 0x7f1b4419c710 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.656+0000 7f1b4b3ff700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b44100d00 0x7f1b44197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.656+0000 7f1b4b3ff700 1 --2- 172.21.15.17:0/3590929029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b44101610 0x7f1b441982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.656+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/3590929029 >> 172.21.15.17:0/3590929029 conn(0x7f1b440fa4b0 msgr2=0x7f1b4410c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:43.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.656+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/3590929029 shutdown_connections 2023-07-14T13:00:43.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.656+0000 7f1b4b3ff700 1 -- 172.21.15.17:0/3590929029 wait complete. 2023-07-14T13:00:43.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:00:43.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.923+0000 7feb2d7ff700 1 -- 172.21.15.17:0/1714363659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb28100480 msgr2=0x7feb2810c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.923+0000 7feb2d7ff700 1 --2- 172.21.15.17:0/1714363659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb28100480 0x7feb2810c910 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7feb20009f90 tx=0x7feb2000b330 comp rx=0 tx=0).stop 2023-07-14T13:00:43.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.923+0000 7feb2d7ff700 1 -- 172.21.15.17:0/1714363659 shutdown_connections 2023-07-14T13:00:43.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.923+0000 7feb2d7ff700 1 --2- 172.21.15.17:0/1714363659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb28100480 0x7feb2810c910 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.924+0000 7feb2d7ff700 1 --2- 172.21.15.17:0/1714363659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb28105ae0 0x7feb28105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.924+0000 7feb2d7ff700 1 --2- 172.21.15.17:0/1714363659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb280ffad0 0x7feb280fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.924+0000 7feb2d7ff700 1 -- 172.21.15.17:0/1714363659 >> 172.21.15.17:0/1714363659 conn(0x7feb280fb5f0 msgr2=0x7feb280fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:43.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.924+0000 7feb2d7ff700 1 -- 172.21.15.17:0/1714363659 shutdown_connections 2023-07-14T13:00:43.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.924+0000 7feb2d7ff700 1 -- 172.21.15.17:0/1714363659 wait complete. 2023-07-14T13:00:43.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.925+0000 7feb2d7ff700 1 Processor -- start 2023-07-14T13:00:43.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.925+0000 7feb2d7ff700 1 -- start start 2023-07-14T13:00:43.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.925+0000 7feb2d7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffad0 0x7feb28197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.925+0000 7feb2d7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb28100480 0x7feb28198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.925+0000 7feb2d7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb28105ae0 0x7feb2819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.925+0000 7feb2d7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2819cdf0 con 0x7feb28100480 2023-07-14T13:00:43.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.925+0000 7feb2d7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2819cf60 con 0x7feb280ffad0 2023-07-14T13:00:43.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.925+0000 7feb2d7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2819d120 con 0x7feb28105ae0 2023-07-14T13:00:43.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffad0 0x7feb28197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb267fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb28100480 0x7feb28198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffad0 0x7feb28197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54686/0 (socket says 172.21.15.17:54686) 2023-07-14T13:00:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb26ffd700 1 -- 172.21.15.17:0/825748582 learned_addr learned my addr 172.21.15.17:0/825748582 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb277fe700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb28105ae0 0x7feb2819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb26ffd700 1 -- 172.21.15.17:0/825748582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb28105ae0 msgr2=0x7feb2819c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb26ffd700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb28105ae0 0x7feb2819c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb26ffd700 1 -- 172.21.15.17:0/825748582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb28100480 msgr2=0x7feb28198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb26ffd700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb28100480 0x7feb28198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb26ffd700 1 -- 172.21.15.17:0/825748582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb180095f0 con 0x7feb280ffad0 2023-07-14T13:00:43.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb267fc700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb28100480 0x7feb28198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:43.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.926+0000 7feb26ffd700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffad0 0x7feb28197e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb1800ec10 tx=0x7feb1800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:43.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.927+0000 7feb0ffff700 1 -- 172.21.15.17:0/825748582 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1800cc90 con 0x7feb280ffad0 2023-07-14T13:00:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.927+0000 7feb2d7ff700 1 -- 172.21.15.17:0/825748582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb20009c40 con 0x7feb280ffad0 2023-07-14T13:00:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.927+0000 7feb0ffff700 1 -- 172.21.15.17:0/825748582 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb1800cdf0 con 0x7feb280ffad0 2023-07-14T13:00:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.927+0000 7feb0ffff700 1 -- 172.21.15.17:0/825748582 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18003e80 con 0x7feb280ffad0 2023-07-14T13:00:43.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.927+0000 7feb2d7ff700 1 -- 172.21.15.17:0/825748582 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb281a4a60 con 0x7feb280ffad0 2023-07-14T13:00:43.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.931+0000 7feb0ffff700 1 -- 172.21.15.17:0/825748582 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7feb18004000 con 0x7feb280ffad0 2023-07-14T13:00:43.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.932+0000 7feb41152b80 1 Processor -- start 2023-07-14T13:00:43.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.932+0000 7feb41152b80 1 -- start start 2023-07-14T13:00:43.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.932+0000 7feb41152b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e4486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.933+0000 7feb41152b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e453590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.933+0000 7feb41152b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e455eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.933+0000 7feb41152b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e34ecb0 con 0x558a0e453ad0 2023-07-14T13:00:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.933+0000 7feb41152b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e3a1a40 con 0x558a0e448be0 2023-07-14T13:00:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.933+0000 7feb41152b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e39aed0 con 0x558a0e4482d0 2023-07-14T13:00:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.933+0000 7feb277fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e4486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.933+0000 7feb277fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e4486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59534/0 (socket says 172.21.15.17:59534) 2023-07-14T13:00:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.933+0000 7feb277fe700 1 -- 172.21.15.17:0/3150155759 learned_addr learned my addr 172.21.15.17:0/3150155759 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.933+0000 7feb26ffd700 1 --2- 172.21.15.17:0/3150155759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e453590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.933+0000 7feb267fc700 1 --2- 172.21.15.17:0/3150155759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e455eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.933+0000 7feb0ffff700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feb100a13e0 0x7feb100a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb0ffff700 1 -- 172.21.15.17:0/825748582 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7feb18014070 con 0x7feb280ffad0 2023-07-14T13:00:43.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb26ffd700 1 -- 172.21.15.17:0/3150155759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 msgr2=0x558a0e4486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb26ffd700 1 --2- 172.21.15.17:0/3150155759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e4486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb26ffd700 1 -- 172.21.15.17:0/3150155759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 msgr2=0x558a0e455eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb26ffd700 1 --2- 172.21.15.17:0/3150155759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e455eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb26ffd700 1 -- 172.21.15.17:0/3150155759 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a0e1c8de0 con 0x558a0e448be0 2023-07-14T13:00:43.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb277fe700 1 --2- 172.21.15.17:0/3150155759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e4486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:43.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb277fe700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feb100a13e0 0x7feb100a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb26ffd700 1 --2- 172.21.15.17:0/3150155759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e453590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feb180ca970 tx=0x7feb1800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fa2f8a2ca591349 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:43.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb0d7fa700 1 -- 172.21.15.17:0/3150155759 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18099d60 con 0x558a0e448be0 2023-07-14T13:00:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb0d7fa700 1 -- 172.21.15.17:0/3150155759 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb18099b80 con 0x558a0e448be0 2023-07-14T13:00:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.934+0000 7feb0d7fa700 1 -- 172.21.15.17:0/3150155759 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1806d840 con 0x558a0e448be0 2023-07-14T13:00:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.935+0000 7feb41152b80 1 -- 172.21.15.17:0/3150155759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 msgr2=0x558a0e453590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.935+0000 7feb41152b80 1 --2- 172.21.15.17:0/3150155759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e453590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feb180ca970 tx=0x7feb1800ef90 comp rx=0 tx=0).stop 2023-07-14T13:00:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.935+0000 7feb277fe700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feb100a13e0 0x7feb100a3890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb20007640 tx=0x7feb20009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.935+0000 7feb41152b80 1 -- 172.21.15.17:0/3150155759 shutdown_connections 2023-07-14T13:00:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.935+0000 7feb41152b80 1 --2- 172.21.15.17:0/3150155759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e455eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.935+0000 7feb41152b80 1 --2- 172.21.15.17:0/3150155759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e4486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.935+0000 7feb41152b80 1 --2- 172.21.15.17:0/3150155759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e453590 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.935+0000 7feb41152b80 1 -- 172.21.15.17:0/3150155759 >> 172.21.15.17:0/3150155759 conn(0x558a0e43eda0 msgr2=0x558a0e4446a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.935+0000 7feb41152b80 1 -- 172.21.15.17:0/3150155759 shutdown_connections 2023-07-14T13:00:43.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.935+0000 7feb41152b80 1 -- 172.21.15.17:0/3150155759 wait complete. 2023-07-14T13:00:43.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.936+0000 7feb41152b80 1 -- start start 2023-07-14T13:00:43.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.936+0000 7feb41152b80 1 Processor -- start 2023-07-14T13:00:43.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb41152b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e4482d0 0x558a0e450820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb41152b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e448be0 0x558a0e450d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb41152b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e4512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb41152b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e33aac0 con 0x558a0e453ad0 2023-07-14T13:00:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb41152b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e33a7c0 con 0x558a0e4482d0 2023-07-14T13:00:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb41152b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e21e920 con 0x558a0e448be0 2023-07-14T13:00:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb41152b80 10 client.0 _ll_register_callbacks cb 0x558a0e338760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e4482d0 0x558a0e450820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb267fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e448be0 0x558a0e450d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e4482d0 0x558a0e450820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54712/0 (socket says 172.21.15.17:54712) 2023-07-14T13:00:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb26ffd700 1 -- 172.21.15.17:0/427117028 learned_addr learned my addr 172.21.15.17:0/427117028 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb277fe700 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e4512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb267fc700 1 -- 172.21.15.17:0/427117028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e4482d0 msgr2=0x558a0e450820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb267fc700 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e4482d0 0x558a0e450820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb267fc700 1 -- 172.21.15.17:0/427117028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 msgr2=0x558a0e4512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.937+0000 7feb267fc700 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e4512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.938+0000 7feb267fc700 1 -- 172.21.15.17:0/427117028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2810d210 con 0x558a0e448be0 2023-07-14T13:00:43.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.938+0000 7feb26ffd700 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e4482d0 0x558a0e450820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:43.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.938+0000 7feb267fc700 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e448be0 0x558a0e450d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feb1c012cd0 tx=0x7feb1c009d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c0bee7eb6805952 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:43.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.938+0000 7feb0aff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:00:43.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.938+0000 7feb0aff5700 1 -- 172.21.15.17:0/427117028 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c017070 con 0x558a0e448be0 2023-07-14T13:00:43.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.938+0000 7feb41152b80 1 -- 172.21.15.17:0/427117028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a0e2f44f0 con 0x558a0e448be0 2023-07-14T13:00:43.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.938+0000 7feb0aff5700 1 -- 172.21.15.17:0/427117028 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7feb1c004050 con 0x558a0e448be0 2023-07-14T13:00:43.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.938+0000 7feb0aff5700 1 -- 172.21.15.17:0/427117028 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb1c004210 con 0x558a0e448be0 2023-07-14T13:00:43.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.938+0000 7feb41152b80 10 client.25678 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:43.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.938+0000 7feb41152b80 1 -- 172.21.15.17:0/427117028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7feb281a4a60 con 0x558a0e448be0 2023-07-14T13:00:43.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.939+0000 7feb0aff5700 1 -- 172.21.15.17:0/427117028 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558a0e2f44f0 con 0x558a0e448be0 2023-07-14T13:00:43.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.939+0000 7feb0aff5700 1 -- 172.21.15.17:0/427117028 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7feb1c0037a0 con 0x558a0e448be0 2023-07-14T13:00:43.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.939+0000 7feb41152b80 10 client.25678 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:43.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.939+0000 7feb41152b80 10 client.25678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:43.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.939+0000 7feb41152b80 20 client.25678 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:43.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.939+0000 7feb41152b80 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a0e463310 0x558a0e465720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.939+0000 7feb41152b80 4 client.25678 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:43.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.939+0000 7feb41152b80 1 -- 172.21.15.17:0/427117028 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a0e393eb0 con 0x558a0e463310 2023-07-14T13:00:43.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.939+0000 7feb26ffd700 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a0e463310 0x558a0e465720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.940+0000 7feb0aff5700 10 client.25678 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:43.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.940+0000 7feb26ffd700 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a0e463310 0x558a0e465720 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e2ac788fc9dc49 server_cookie=5a98e00b6ad8095a in_seq=0 out_seq=0 2023-07-14T13:00:43.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb0aff5700 1 -- 172.21.15.17:0/427117028 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558a0e393eb0 con 0x558a0e463310 2023-07-14T13:00:43.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb0aff5700 10 client.25678 handle_command_reply: tid=0 2023-07-14T13:00:43.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 1 client.25678 shutdown 2023-07-14T13:00:43.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 1 -- 172.21.15.17:0/427117028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e448be0 msgr2=0x558a0e450d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e448be0 0x558a0e450d60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feb1c012cd0 tx=0x7feb1c009d40 comp rx=0 tx=0).stop 2023-07-14T13:00:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 1 -- 172.21.15.17:0/427117028 shutdown_connections 2023-07-14T13:00:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a0e463310 0x558a0e465720 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e4512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e4482d0 0x558a0e450820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb0aff5700 0 client.25678 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:43.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 1 --2- 172.21.15.17:0/427117028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e448be0 0x558a0e450d60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 1 -- 172.21.15.17:0/427117028 >> 172.21.15.17:0/427117028 conn(0x558a0e43eda0 msgr2=0x558a0e444230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 1 -- 172.21.15.17:0/427117028 shutdown_connections 2023-07-14T13:00:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 1 -- 172.21.15.17:0/427117028 wait complete. 2023-07-14T13:00:43.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.941+0000 7feb41152b80 20 client.25678 trim_cache size 0 max 16384 2023-07-14T13:00:43.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.962+0000 7feb41152b80 1 Processor -- start 2023-07-14T13:00:43.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.962+0000 7feb41152b80 1 -- start start 2023-07-14T13:00:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.962+0000 7feb41152b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e45a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb41152b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e450d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb41152b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e4512d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb41152b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e449d60 con 0x558a0e453ad0 2023-07-14T13:00:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb41152b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e45a9f0 con 0x558a0e448be0 2023-07-14T13:00:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb41152b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e4488f0 con 0x558a0e4482d0 2023-07-14T13:00:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e45a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb277fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e4512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb267fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e450d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e45a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59552/0 (socket says 172.21.15.17:59552) 2023-07-14T13:00:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb26ffd700 1 -- 172.21.15.17:0/2245654553 learned_addr learned my addr 172.21.15.17:0/2245654553 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb26ffd700 1 -- 172.21.15.17:0/2245654553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 msgr2=0x558a0e450d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb26ffd700 1 --2- 172.21.15.17:0/2245654553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e450d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb26ffd700 1 -- 172.21.15.17:0/2245654553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 msgr2=0x558a0e4512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb26ffd700 1 --2- 172.21.15.17:0/2245654553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e4512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.963+0000 7feb26ffd700 1 -- 172.21.15.17:0/2245654553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a0e1b1c60 con 0x558a0e4482d0 2023-07-14T13:00:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.964+0000 7feb26ffd700 1 --2- 172.21.15.17:0/2245654553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e45a4b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feb1809a1b0 tx=0x7feb18004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18d0bb237c199dde server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:43.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.964+0000 7feb0dffb700 1 -- 172.21.15.17:0/2245654553 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb180d0750 con 0x558a0e4482d0 2023-07-14T13:00:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.964+0000 7feb0dffb700 1 -- 172.21.15.17:0/2245654553 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb18016330 con 0x558a0e4482d0 2023-07-14T13:00:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.964+0000 7feb0dffb700 1 -- 172.21.15.17:0/2245654553 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb180042b0 con 0x558a0e4482d0 2023-07-14T13:00:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.965+0000 7feb41152b80 1 -- 172.21.15.17:0/2245654553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 msgr2=0x558a0e45a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.965+0000 7feb41152b80 1 --2- 172.21.15.17:0/2245654553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e45a4b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feb1809a1b0 tx=0x7feb18004640 comp rx=0 tx=0).stop 2023-07-14T13:00:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.965+0000 7feb41152b80 1 -- 172.21.15.17:0/2245654553 shutdown_connections 2023-07-14T13:00:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.965+0000 7feb41152b80 1 --2- 172.21.15.17:0/2245654553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e453ad0 0x558a0e4512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.965+0000 7feb41152b80 1 --2- 172.21.15.17:0/2245654553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e4482d0 0x558a0e45a4b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.965+0000 7feb41152b80 1 --2- 172.21.15.17:0/2245654553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e450d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.965+0000 7feb41152b80 1 -- 172.21.15.17:0/2245654553 >> 172.21.15.17:0/2245654553 conn(0x558a0e43eda0 msgr2=0x558a0e45f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.965+0000 7feb41152b80 1 -- 172.21.15.17:0/2245654553 shutdown_connections 2023-07-14T13:00:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.965+0000 7feb41152b80 1 -- 172.21.15.17:0/2245654553 wait complete. 2023-07-14T13:00:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.965+0000 7feb41152b80 1 -- start start 2023-07-14T13:00:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.966+0000 7feb41152b80 1 Processor -- start 2023-07-14T13:00:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.966+0000 7feb41152b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e4482d0 0x558a0e4b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.966+0000 7feb41152b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e4b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.966+0000 7feb41152b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e453ad0 0x558a0e4af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.966+0000 7feb41152b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e4af710 con 0x558a0e4482d0 2023-07-14T13:00:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.966+0000 7feb41152b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e4af880 con 0x558a0e448be0 2023-07-14T13:00:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.966+0000 7feb41152b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e4afa40 con 0x558a0e453ad0 2023-07-14T13:00:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.966+0000 7feb41152b80 10 client.0 _ll_register_callbacks cb 0x7feb1c0127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb267fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e4b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb277fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e453ad0 0x558a0e4af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e4482d0 0x558a0e4b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb267fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e4b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54732/0 (socket says 172.21.15.17:54732) 2023-07-14T13:00:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb267fc700 1 -- 172.21.15.17:0/4134181820 learned_addr learned my addr 172.21.15.17:0/4134181820 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb277fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e453ad0 0x558a0e4af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59562/0 (socket says 172.21.15.17:59562) 2023-07-14T13:00:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb267fc700 1 -- 172.21.15.17:0/4134181820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e453ad0 msgr2=0x558a0e4af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb267fc700 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e453ad0 0x558a0e4af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb267fc700 1 -- 172.21.15.17:0/4134181820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e4482d0 msgr2=0x558a0e4b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb267fc700 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e4482d0 0x558a0e4b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb267fc700 1 -- 172.21.15.17:0/4134181820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a0e1c8de0 con 0x558a0e448be0 2023-07-14T13:00:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb26ffd700 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e4482d0 0x558a0e4b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb277fe700 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e453ad0 0x558a0e4af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:00:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb267fc700 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e4b0950 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x558a0e451d60 tx=0x7feb1c00fae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b24236d96937eb69 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.967+0000 7feb0aff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:00:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.968+0000 7feb0aff5700 1 -- 172.21.15.17:0/4134181820 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c017070 con 0x558a0e448be0 2023-07-14T13:00:44.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.968+0000 7feb41152b80 1 -- 172.21.15.17:0/4134181820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb18099b80 con 0x558a0e448be0 2023-07-14T13:00:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.968+0000 7feb0aff5700 1 -- 172.21.15.17:0/4134181820 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7feb1c02a070 con 0x558a0e448be0 2023-07-14T13:00:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.968+0000 7feb0aff5700 1 -- 172.21.15.17:0/4134181820 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb1c005b00 con 0x558a0e448be0 2023-07-14T13:00:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.968+0000 7feb41152b80 10 client.25721 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.968+0000 7feb41152b80 1 -- 172.21.15.17:0/4134181820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x558a0e1ef250 con 0x558a0e448be0 2023-07-14T13:00:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.969+0000 7feb0aff5700 1 -- 172.21.15.17:0/4134181820 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb18099b80 con 0x558a0e448be0 2023-07-14T13:00:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.969+0000 7feb0aff5700 1 -- 172.21.15.17:0/4134181820 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7feb1c039480 con 0x558a0e448be0 2023-07-14T13:00:44.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.969+0000 7feb41152b80 10 client.25721 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.969+0000 7feb41152b80 10 client.25721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.969+0000 7feb41152b80 20 client.25721 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.969+0000 7feb41152b80 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a0e4b8340 0x558a0e4ba750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.969+0000 7feb41152b80 4 client.25721 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:00:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.969+0000 7feb41152b80 1 -- 172.21.15.17:0/4134181820 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558a0e356050 con 0x558a0e4b8340 2023-07-14T13:00:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.969+0000 7feb26ffd700 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a0e4b8340 0x558a0e4ba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:44.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb26ffd700 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a0e4b8340 0x558a0e4ba750 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aff6b40f9b76bcaa server_cookie=803a265f52740388 in_seq=0 out_seq=0 2023-07-14T13:00:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb0aff5700 10 client.25721 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb0aff5700 1 -- 172.21.15.17:0/4134181820 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558a0e356050 con 0x558a0e4b8340 2023-07-14T13:00:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb0aff5700 10 client.25721 handle_command_reply: tid=0 2023-07-14T13:00:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb41152b80 1 client.25721 shutdown 2023-07-14T13:00:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb41152b80 1 -- 172.21.15.17:0/4134181820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 msgr2=0x558a0e4b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb41152b80 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e4b0950 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x558a0e451d60 tx=0x7feb1c00fae0 comp rx=0 tx=0).stop 2023-07-14T13:00:44.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb41152b80 1 -- 172.21.15.17:0/4134181820 shutdown_connections 2023-07-14T13:00:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb41152b80 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a0e4b8340 0x558a0e4ba750 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb41152b80 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a0e453ad0 0x558a0e4af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb41152b80 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a0e4482d0 0x558a0e4b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb41152b80 1 --2- 172.21.15.17:0/4134181820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a0e448be0 0x558a0e4b0950 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb0aff5700 0 client.25721 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.970+0000 7feb41152b80 1 -- 172.21.15.17:0/4134181820 >> 172.21.15.17:0/4134181820 conn(0x558a0e43eda0 msgr2=0x558a0e450d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.971+0000 7feb41152b80 1 -- 172.21.15.17:0/4134181820 shutdown_connections 2023-07-14T13:00:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.971+0000 7feb41152b80 1 -- 172.21.15.17:0/4134181820 wait complete. 2023-07-14T13:00:44.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.971+0000 7feb41152b80 20 client.25721 trim_cache size 0 max 16384 2023-07-14T13:00:44.010 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:00:44.010 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (2 inodes in the stack)", 2023-07-14T13:00:44.011 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:00:44.011 INFO:teuthology.orchestra.run.smithi017.stdout: "f3578cce-cbe4-4d2d-80c7-958bc9d580c0": { 2023-07-14T13:00:44.011 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:00:44.011 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "f3578cce-cbe4-4d2d-80c7-958bc9d580c0", 2023-07-14T13:00:44.011 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:00:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:00:44.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:00:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:00:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.971+0000 7feb2d7ff700 1 -- 172.21.15.17:0/825748582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feb100a13e0 msgr2=0x7feb100a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.971+0000 7feb2d7ff700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feb100a13e0 0x7feb100a3890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feb20007640 tx=0x7feb20009920 comp rx=0 tx=0).stop 2023-07-14T13:00:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.971+0000 7feb2d7ff700 1 -- 172.21.15.17:0/825748582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffad0 msgr2=0x7feb28197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.971+0000 7feb2d7ff700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffad0 0x7feb28197e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb1800ec10 tx=0x7feb1800ef20 comp rx=0 tx=0).stop 2023-07-14T13:00:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.972+0000 7feb2d7ff700 1 -- 172.21.15.17:0/825748582 shutdown_connections 2023-07-14T13:00:44.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.972+0000 7feb2d7ff700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feb100a13e0 0x7feb100a3890 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:44.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.972+0000 7feb2d7ff700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb28105ae0 0x7feb2819c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:44.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.972+0000 7feb2d7ff700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffad0 0x7feb28197e10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:44.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.972+0000 7feb2d7ff700 1 --2- 172.21.15.17:0/825748582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb28100480 0x7feb28198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:44.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.972+0000 7feb2d7ff700 1 -- 172.21.15.17:0/825748582 >> 172.21.15.17:0/825748582 conn(0x7feb280fb5f0 msgr2=0x7feb2810ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:44.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.972+0000 7feb2d7ff700 1 -- 172.21.15.17:0/825748582 shutdown_connections 2023-07-14T13:00:44.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:00:43.972+0000 7feb2d7ff700 1 -- 172.21.15.17:0/825748582 wait complete. 2023-07-14T13:00:44.022 INFO:tasks.cephfs.filesystem:scrub status for tag:f3578cce-cbe4-4d2d-80c7-958bc9d580c0 - {'path': '/', 'tag': 'f3578cce-cbe4-4d2d-80c7-958bc9d580c0', 'options': 'recursive,force'} 2023-07-14T13:00:44.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:44 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:00:44.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:44 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:44.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:44 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:00:44.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:44 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:00:44.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:44 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:44.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:44 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:00:44.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:44 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:00:44.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:44 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:44.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:44 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:00:44.896 INFO:teuthology.orchestra.run.smithi017.stderr:2100000 of 50000000 tuples (4%) done (elapsed 34.50 s, remaining 786.95 s) 2023-07-14T13:00:45.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:45 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:00:45.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:45 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:45 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:00:45.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:45 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:45 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:00:45.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:45 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:45 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:00:45.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:45 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:00:45.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:45 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:45 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:45 smithi017 ceph-mon[95536]: pgmap v33: 97 pgs: 97 active+clean; 458 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 21 op/s 2023-07-14T13:00:45.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:45 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:00:45.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:45 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:45 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:00:45.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:45 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:45 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:00:45.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:45 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:45 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:00:45.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:45 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:00:45.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:45 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:45 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:45 smithi135 ceph-mon[97338]: pgmap v33: 97 pgs: 97 active+clean; 458 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 21 op/s 2023-07-14T13:00:45.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:45 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:00:45.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:45 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:45 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:00:45.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:45 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:45 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:00:45.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:45 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:45 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:00:45.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:45 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:00:45.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:45 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:45 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:00:45.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:45 smithi131 ceph-mon[96953]: pgmap v33: 97 pgs: 97 active+clean; 458 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 21 op/s 2023-07-14T13:00:46.801 INFO:teuthology.orchestra.run.smithi017.stderr:2200000 of 50000000 tuples (4%) done (elapsed 36.41 s, remaining 791.01 s) 2023-07-14T13:00:47.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:47 smithi017 ceph-mon[95536]: pgmap v34: 97 pgs: 97 active+clean; 526 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 35 MiB/s wr, 100 op/s 2023-07-14T13:00:47.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:47 smithi135 ceph-mon[97338]: pgmap v34: 97 pgs: 97 active+clean; 526 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 35 MiB/s wr, 100 op/s 2023-07-14T13:00:47.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:47 smithi131 ceph-mon[96953]: pgmap v34: 97 pgs: 97 active+clean; 526 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 35 MiB/s wr, 100 op/s 2023-07-14T13:00:48.125 INFO:teuthology.orchestra.run.smithi017.stderr:2300000 of 50000000 tuples (4%) done (elapsed 37.73 s, remaining 782.49 s) 2023-07-14T13:00:49.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:49 smithi017 ceph-mon[95536]: pgmap v35: 97 pgs: 97 active+clean; 526 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 23 MiB/s wr, 89 op/s 2023-07-14T13:00:49.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:49 smithi135 ceph-mon[97338]: pgmap v35: 97 pgs: 97 active+clean; 526 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 23 MiB/s wr, 89 op/s 2023-07-14T13:00:49.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:49 smithi131 ceph-mon[96953]: pgmap v35: 97 pgs: 97 active+clean; 526 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 23 MiB/s wr, 89 op/s 2023-07-14T13:00:49.974 INFO:teuthology.orchestra.run.smithi017.stderr:2400000 of 50000000 tuples (4%) done (elapsed 39.58 s, remaining 784.99 s) 2023-07-14T13:00:51.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:51 smithi017 ceph-mon[95536]: pgmap v36: 97 pgs: 97 active+clean; 546 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 26 MiB/s wr, 91 op/s 2023-07-14T13:00:51.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:51 smithi135 ceph-mon[97338]: pgmap v36: 97 pgs: 97 active+clean; 546 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 26 MiB/s wr, 91 op/s 2023-07-14T13:00:51.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:51 smithi131 ceph-mon[96953]: pgmap v36: 97 pgs: 97 active+clean; 546 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 26 MiB/s wr, 91 op/s 2023-07-14T13:00:51.867 INFO:teuthology.orchestra.run.smithi017.stderr:2500000 of 50000000 tuples (5%) done (elapsed 41.47 s, remaining 787.98 s) 2023-07-14T13:00:53.250 INFO:teuthology.orchestra.run.smithi017.stderr:2600000 of 50000000 tuples (5%) done (elapsed 42.85 s, remaining 781.27 s) 2023-07-14T13:00:53.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:53 smithi017 ceph-mon[95536]: pgmap v37: 97 pgs: 97 active+clean; 598 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 29 MiB/s wr, 97 op/s 2023-07-14T13:00:53.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:53 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:00:53.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:53 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:53 smithi135 ceph-mon[97338]: pgmap v37: 97 pgs: 97 active+clean; 598 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 29 MiB/s wr, 97 op/s 2023-07-14T13:00:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:53 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:00:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:53 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:53.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:53 smithi131 ceph-mon[96953]: pgmap v37: 97 pgs: 97 active+clean; 598 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 29 MiB/s wr, 97 op/s 2023-07-14T13:00:53.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:53 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:00:53.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:53 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.727+0000 7efc9e5ff700 1 -- 172.21.15.17:0/953801601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc980685b0 msgr2=0x7efc98104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.727+0000 7efc9e5ff700 1 --2- 172.21.15.17:0/953801601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc980685b0 0x7efc98104770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0099c0 tx=0x7efc8c009cd0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.727+0000 7efc9e5ff700 1 -- 172.21.15.17:0/953801601 shutdown_connections 2023-07-14T13:00:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.727+0000 7efc9e5ff700 1 --2- 172.21.15.17:0/953801601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98104e50 0x7efc9810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.727+0000 7efc9e5ff700 1 --2- 172.21.15.17:0/953801601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc98067c10 0x7efc98067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.727+0000 7efc9e5ff700 1 --2- 172.21.15.17:0/953801601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc980685b0 0x7efc98104770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.727+0000 7efc9e5ff700 1 -- 172.21.15.17:0/953801601 >> 172.21.15.17:0/953801601 conn(0x7efc98074760 msgr2=0x7efc98074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.728+0000 7efc9e5ff700 1 -- 172.21.15.17:0/953801601 shutdown_connections 2023-07-14T13:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.728+0000 7efc9e5ff700 1 -- 172.21.15.17:0/953801601 wait complete. 2023-07-14T13:00:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.729+0000 7efc9e5ff700 1 Processor -- start 2023-07-14T13:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc9e5ff700 1 -- start start 2023-07-14T13:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc9e5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98067c10 0x7efc9810b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc9e5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc980685b0 0x7efc9810bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc9e5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc98104e50 0x7efc9819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc9e5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9819cdf0 con 0x7efc98067c10 2023-07-14T13:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc9e5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9819cf60 con 0x7efc98104e50 2023-07-14T13:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc9e5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9819d120 con 0x7efc980685b0 2023-07-14T13:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc9cb9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc98104e50 0x7efc9819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc977fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc980685b0 0x7efc9810bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc9cb9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc98104e50 0x7efc9819c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:50190/0 (socket says 172.21.15.17:50190) 2023-07-14T13:00:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc977fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc980685b0 0x7efc9810bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:43070/0 (socket says 172.21.15.17:43070) 2023-07-14T13:00:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.730+0000 7efc9cb9c700 1 -- 172.21.15.17:0/3698149354 learned_addr learned my addr 172.21.15.17:0/3698149354 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.731+0000 7efc97fff700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98067c10 0x7efc9810b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.731+0000 7efc9cb9c700 1 -- 172.21.15.17:0/3698149354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc980685b0 msgr2=0x7efc9810bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.731+0000 7efc9cb9c700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc980685b0 0x7efc9810bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.731+0000 7efc9cb9c700 1 -- 172.21.15.17:0/3698149354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98067c10 msgr2=0x7efc9810b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.731+0000 7efc9cb9c700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98067c10 0x7efc9810b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.731+0000 7efc9cb9c700 1 -- 172.21.15.17:0/3698149354 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c0095f0 con 0x7efc98104e50 2023-07-14T13:00:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.731+0000 7efc97fff700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98067c10 0x7efc9810b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:00:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.731+0000 7efc9cb9c700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc98104e50 0x7efc9819c820 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc9000ef30 tx=0x7efc9000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.731+0000 7efc957fa700 1 -- 172.21.15.17:0/3698149354 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90018070 con 0x7efc98104e50 2023-07-14T13:00:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.732+0000 7efc957fa700 1 -- 172.21.15.17:0/3698149354 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc9000f040 con 0x7efc98104e50 2023-07-14T13:00:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.732+0000 7efc957fa700 1 -- 172.21.15.17:0/3698149354 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000cc70 con 0x7efc98104e50 2023-07-14T13:00:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.732+0000 7efc9e5ff700 1 -- 172.21.15.17:0/3698149354 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9819d3a0 con 0x7efc98104e50 2023-07-14T13:00:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.732+0000 7efc9e5ff700 1 -- 172.21.15.17:0/3698149354 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9819d650 con 0x7efc98104e50 2023-07-14T13:00:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.737+0000 7efc957fa700 1 -- 172.21.15.17:0/3698149354 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7efc90007500 con 0x7efc98104e50 2023-07-14T13:00:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.738+0000 7efcb1ea1b80 1 Processor -- start 2023-07-14T13:00:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.738+0000 7efcb1ea1b80 1 -- start start 2023-07-14T13:00:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.739+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56434164c6b0 0x5643417f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.739+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 0x5643417f0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.739+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f0580 0x5643417f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.739+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643416f5c50 con 0x5643417f0580 2023-07-14T13:00:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.739+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643417489e0 con 0x56434164c6b0 2023-07-14T13:00:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.739+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564341741e70 con 0x5643417f62d0 2023-07-14T13:00:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.739+0000 7efc977fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56434164c6b0 0x5643417f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.739+0000 7efc97fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 0x5643417f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.739+0000 7efc97fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 0x5643417f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:43074/0 (socket says 172.21.15.17:43074) 2023-07-14T13:00:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.739+0000 7efc97fff700 1 -- 172.21.15.17:0/554075276 learned_addr learned my addr 172.21.15.17:0/554075276 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.740+0000 7efc977fe700 1 -- 172.21.15.17:0/554075276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 msgr2=0x5643417f0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.740+0000 7efc977fe700 1 --2- 172.21.15.17:0/554075276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 0x5643417f0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.740+0000 7efc977fe700 1 -- 172.21.15.17:0/554075276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f0580 msgr2=0x5643417f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.740+0000 7efc977fe700 1 --2- 172.21.15.17:0/554075276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f0580 0x5643417f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.740+0000 7efc977fe700 1 -- 172.21.15.17:0/554075276 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56434156fd80 con 0x56434164c6b0 2023-07-14T13:00:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.740+0000 7efc957fa700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efc800a1460 0x7efc800a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.740+0000 7efc957fa700 1 -- 172.21.15.17:0/3698149354 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7efc900cca70 con 0x7efc98104e50 2023-07-14T13:00:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.741+0000 7efc97fff700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efc800a1460 0x7efc800a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.741+0000 7efc977fe700 1 --2- 172.21.15.17:0/554075276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56434164c6b0 0x5643417f5d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0098e0 tx=0x7efc8c00b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bae7be319d535d5d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.741+0000 7efc7e7fc700 1 -- 172.21.15.17:0/554075276 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00ba80 con 0x56434164c6b0 2023-07-14T13:00:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.741+0000 7efc7e7fc700 1 -- 172.21.15.17:0/554075276 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc8c01e030 con 0x56434164c6b0 2023-07-14T13:00:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.741+0000 7efc7e7fc700 1 -- 172.21.15.17:0/554075276 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0039c0 con 0x56434164c6b0 2023-07-14T13:00:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.742+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/554075276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56434164c6b0 msgr2=0x5643417f5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.742+0000 7efc97fff700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efc800a1460 0x7efc800a3910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5643417ecb40 tx=0x7efc8800b680 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.742+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/554075276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56434164c6b0 0x5643417f5d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0098e0 tx=0x7efc8c00b790 comp rx=0 tx=0).stop 2023-07-14T13:00:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.743+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/554075276 shutdown_connections 2023-07-14T13:00:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.743+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/554075276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f0580 0x5643417f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.743+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/554075276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56434164c6b0 0x5643417f5d90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.743+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/554075276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 0x5643417f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.743+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/554075276 >> 172.21.15.17:0/554075276 conn(0x5643417e5be0 msgr2=0x5643417eaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.743+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/554075276 shutdown_connections 2023-07-14T13:00:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.743+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/554075276 wait complete. 2023-07-14T13:00:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.744+0000 7efcb1ea1b80 1 -- start start 2023-07-14T13:00:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.744+0000 7efcb1ea1b80 1 Processor -- start 2023-07-14T13:00:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56434164c6b0 0x5643417ff650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f0580 0x5643417ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f62d0 0x5643417f9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643416e1a60 con 0x5643417f62d0 2023-07-14T13:00:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643416e1760 con 0x56434164c6b0 2023-07-14T13:00:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643415c58c0 con 0x5643417f0580 2023-07-14T13:00:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efcb1ea1b80 10 client.0 _ll_register_callbacks cb 0x5643416df700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efc97fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56434164c6b0 0x5643417ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efc977fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f0580 0x5643417ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efc977fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f0580 0x5643417ffb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:43082/0 (socket says 172.21.15.17:43082) 2023-07-14T13:00:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efc977fe700 1 -- 172.21.15.17:0/1903161732 learned_addr learned my addr 172.21.15.17:0/1903161732 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.745+0000 7efc9cb9c700 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f62d0 0x5643417f9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.746+0000 7efc977fe700 1 -- 172.21.15.17:0/1903161732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56434164c6b0 msgr2=0x5643417ff650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.746+0000 7efc977fe700 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56434164c6b0 0x5643417ff650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.746+0000 7efc977fe700 1 -- 172.21.15.17:0/1903161732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f62d0 msgr2=0x5643417f9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.746+0000 7efc977fe700 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f62d0 0x5643417f9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.746+0000 7efc977fe700 1 -- 172.21.15.17:0/1903161732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9810d210 con 0x5643417f0580 2023-07-14T13:00:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.746+0000 7efc977fe700 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f0580 0x5643417ffb90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0094e0 tx=0x7efc8c00bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20cec491ca5beb82 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.746+0000 7efc777fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:00:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.747+0000 7efc777fe700 1 -- 172.21.15.17:0/1903161732 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c005480 con 0x5643417f0580 2023-07-14T13:00:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.747+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1903161732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56434169b490 con 0x5643417f0580 2023-07-14T13:00:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.747+0000 7efc777fe700 1 -- 172.21.15.17:0/1903161732 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7efc8c0055e0 con 0x5643417f0580 2023-07-14T13:00:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.747+0000 7efc777fe700 1 -- 172.21.15.17:0/1903161732 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc8c003760 con 0x5643417f0580 2023-07-14T13:00:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.747+0000 7efcb1ea1b80 10 client.25696 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.747+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1903161732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x564341558c00 con 0x5643417f0580 2023-07-14T13:00:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.748+0000 7efc777fe700 1 -- 172.21.15.17:0/1903161732 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56434169b490 con 0x5643417f0580 2023-07-14T13:00:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.748+0000 7efc777fe700 1 -- 172.21.15.17:0/1903161732 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7efc8c00f8e0 con 0x5643417f0580 2023-07-14T13:00:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.748+0000 7efcb1ea1b80 10 client.25696 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.748+0000 7efcb1ea1b80 10 client.25696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.748+0000 7efcb1ea1b80 20 client.25696 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.748+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5643418095d0 0x56434180b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.748+0000 7efcb1ea1b80 4 client.25696 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:00:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.748+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1903161732 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56434173ae50 con 0x5643418095d0 2023-07-14T13:00:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.749+0000 7efc97fff700 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5643418095d0 0x56434180b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.750+0000 7efc97fff700 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5643418095d0 0x56434180b9e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cebc3fa196fd6dbb server_cookie=c461d48d540ef1af in_seq=0 out_seq=0 2023-07-14T13:00:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.750+0000 7efc777fe700 10 client.25696 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efc777fe700 1 -- 172.21.15.17:0/1903161732 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56434173ae50 con 0x5643418095d0 2023-07-14T13:00:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efc777fe700 10 client.25696 handle_command_reply: tid=0 2023-07-14T13:00:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efcb1ea1b80 1 client.25696 shutdown 2023-07-14T13:00:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1903161732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f0580 msgr2=0x5643417ffb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f0580 0x5643417ffb90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0094e0 tx=0x7efc8c00bee0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1903161732 shutdown_connections 2023-07-14T13:00:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5643418095d0 0x56434180b9e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f62d0 0x5643417f9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56434164c6b0 0x5643417ff650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1903161732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f0580 0x5643417ffb90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1903161732 >> 172.21.15.17:0/1903161732 conn(0x5643417e5be0 msgr2=0x5643417ea4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efc777fe700 0 client.25696 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.751+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1903161732 shutdown_connections 2023-07-14T13:00:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.752+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1903161732 wait complete. 2023-07-14T13:00:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.752+0000 7efcb1ea1b80 20 client.25696 trim_cache size 0 max 16384 2023-07-14T13:00:53.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.778+0000 7efcb1ea1b80 1 Processor -- start 2023-07-14T13:00:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.778+0000 7efcb1ea1b80 1 -- start start 2023-07-14T13:00:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.778+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56434164c6b0 0x5643417f0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.778+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5643417f0580 0x5643417f0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.778+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 0x5643417eac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.778+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643417ecb70 con 0x56434164c6b0 2023-07-14T13:00:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.778+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643417ebff0 con 0x5643417f0580 2023-07-14T13:00:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.778+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643417ec970 con 0x5643417f62d0 2023-07-14T13:00:53.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.779+0000 7efc97fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56434164c6b0 0x5643417f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.779+0000 7efc9cb9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 0x5643417eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.779+0000 7efc97fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56434164c6b0 0x5643417f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48278/0 (socket says 172.21.15.17:48278) 2023-07-14T13:00:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.779+0000 7efc97fff700 1 -- 172.21.15.17:0/875916110 learned_addr learned my addr 172.21.15.17:0/875916110 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.779+0000 7efc977fe700 1 --2- 172.21.15.17:0/875916110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5643417f0580 0x5643417f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.779+0000 7efc9cb9c700 1 -- 172.21.15.17:0/875916110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5643417f0580 msgr2=0x5643417f0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.779+0000 7efc9cb9c700 1 --2- 172.21.15.17:0/875916110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5643417f0580 0x5643417f0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.779+0000 7efc9cb9c700 1 -- 172.21.15.17:0/875916110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56434164c6b0 msgr2=0x5643417f0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.779+0000 7efc9cb9c700 1 --2- 172.21.15.17:0/875916110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56434164c6b0 0x5643417f0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.779+0000 7efc9cb9c700 1 -- 172.21.15.17:0/875916110 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643417f9720 con 0x5643417f62d0 2023-07-14T13:00:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.779+0000 7efc9cb9c700 1 --2- 172.21.15.17:0/875916110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 0x5643417eac60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc900ca090 tx=0x7efc90099510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4456cafaaaf6289b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.780+0000 7efc7effd700 1 -- 172.21.15.17:0/875916110 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc900999d0 con 0x5643417f62d0 2023-07-14T13:00:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.780+0000 7efc7effd700 1 -- 172.21.15.17:0/875916110 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc9009da00 con 0x5643417f62d0 2023-07-14T13:00:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.780+0000 7efc7effd700 1 -- 172.21.15.17:0/875916110 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90098ec0 con 0x5643417f62d0 2023-07-14T13:00:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.781+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/875916110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 msgr2=0x5643417eac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.781+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/875916110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 0x5643417eac60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc900ca090 tx=0x7efc90099510 comp rx=0 tx=0).stop 2023-07-14T13:00:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.781+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/875916110 shutdown_connections 2023-07-14T13:00:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.781+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/875916110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5643417f62d0 0x5643417eac60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.781+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/875916110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56434164c6b0 0x5643417f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.781+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/875916110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5643417f0580 0x5643417f0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.781+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/875916110 >> 172.21.15.17:0/875916110 conn(0x5643417e5be0 msgr2=0x5643417fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.781+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/875916110 shutdown_connections 2023-07-14T13:00:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.781+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/875916110 wait complete. 2023-07-14T13:00:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.782+0000 7efcb1ea1b80 1 -- start start 2023-07-14T13:00:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.782+0000 7efcb1ea1b80 1 Processor -- start 2023-07-14T13:00:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.783+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56434164c6b0 0x564341803c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.783+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f0580 0x564341804190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.783+0000 7efcb1ea1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5643417f62d0 0x56434185c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.783+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564341804870 con 0x5643417f0580 2023-07-14T13:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.783+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56434185c9d0 con 0x5643417f62d0 2023-07-14T13:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.783+0000 7efcb1ea1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56434185cb10 con 0x56434164c6b0 2023-07-14T13:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.783+0000 7efcb1ea1b80 10 client.0 _ll_register_callbacks cb 0x7efc8800b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:00:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.783+0000 7efc977fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f0580 0x564341804190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.783+0000 7efc977fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f0580 0x564341804190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48284/0 (socket says 172.21.15.17:48284) 2023-07-14T13:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.783+0000 7efc977fe700 1 -- 172.21.15.17:0/1625140137 learned_addr learned my addr 172.21.15.17:0/1625140137 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.783+0000 7efc97fff700 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56434164c6b0 0x564341803c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.784+0000 7efc977fe700 1 -- 172.21.15.17:0/1625140137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56434164c6b0 msgr2=0x564341803c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:00:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.784+0000 7efc977fe700 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56434164c6b0 0x564341803c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.784+0000 7efc977fe700 1 -- 172.21.15.17:0/1625140137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5643417f62d0 msgr2=0x56434185c490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:00:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.784+0000 7efc977fe700 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5643417f62d0 0x56434185c490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.784+0000 7efc977fe700 1 -- 172.21.15.17:0/1625140137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9819d650 con 0x5643417f0580 2023-07-14T13:00:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.784+0000 7efc977fe700 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f0580 0x564341804190 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x5643417fae50 tx=0x7efc8c024420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86162dc01c0e818 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:00:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.784+0000 7efc777fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.784+0000 7efc777fe700 1 -- 172.21.15.17:0/1625140137 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00f870 con 0x5643417f0580 2023-07-14T13:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.784+0000 7efc777fe700 1 -- 172.21.15.17:0/1625140137 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7efc8c000e40 con 0x5643417f0580 2023-07-14T13:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.785+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1625140137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc8c01e030 con 0x5643417f0580 2023-07-14T13:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.785+0000 7efc777fe700 1 -- 172.21.15.17:0/1625140137 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc8c00f9d0 con 0x5643417f0580 2023-07-14T13:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.785+0000 7efcb1ea1b80 10 client.15969 fetch_fsmap learned FSMap version 24 2023-07-14T13:00:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.785+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1625140137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5643415961f0 con 0x5643417f0580 2023-07-14T13:00:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.785+0000 7efc777fe700 1 -- 172.21.15.17:0/1625140137 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc8c01e030 con 0x5643417f0580 2023-07-14T13:00:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.786+0000 7efc777fe700 1 -- 172.21.15.17:0/1625140137 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7efc8c003760 con 0x5643417f0580 2023-07-14T13:00:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.786+0000 7efcb1ea1b80 10 client.15969 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:00:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.786+0000 7efcb1ea1b80 10 client.15969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:00:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.786+0000 7efcb1ea1b80 20 client.15969 populate_metadata read hostname 'smithi017' 2023-07-14T13:00:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.786+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56434185ddc0 0x5643418601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:00:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.786+0000 7efcb1ea1b80 4 client.15969 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:00:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.786+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1625140137 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5643416fcff0 con 0x56434185ddc0 2023-07-14T13:00:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.787+0000 7efc97fff700 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56434185ddc0 0x5643418601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:00:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.787+0000 7efc777fe700 10 client.15969 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.787+0000 7efc97fff700 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56434185ddc0 0x5643418601d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ba836073246e9b2 server_cookie=93490108eea615d in_seq=0 out_seq=0 2023-07-14T13:00:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efc777fe700 1 -- 172.21.15.17:0/1625140137 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5643416fcff0 con 0x56434185ddc0 2023-07-14T13:00:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efc777fe700 10 client.15969 handle_command_reply: tid=0 2023-07-14T13:00:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efcb1ea1b80 1 client.15969 shutdown 2023-07-14T13:00:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1625140137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f0580 msgr2=0x564341804190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f0580 0x564341804190 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x5643417fae50 tx=0x7efc8c024420 comp rx=0 tx=0).stop 2023-07-14T13:00:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1625140137 shutdown_connections 2023-07-14T13:00:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56434185ddc0 0x5643418601d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5643417f62d0 0x56434185c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56434164c6b0 0x564341803c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efcb1ea1b80 1 --2- 172.21.15.17:0/1625140137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5643417f0580 0x564341804190 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1625140137 >> 172.21.15.17:0/1625140137 conn(0x5643417e5be0 msgr2=0x5643417f0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efc777fe700 0 client.15969 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:00:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.803+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1625140137 shutdown_connections 2023-07-14T13:00:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.804+0000 7efcb1ea1b80 1 -- 172.21.15.17:0/1625140137 wait complete. 2023-07-14T13:00:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.804+0000 7efcb1ea1b80 20 client.15969 trim_cache size 0 max 16384 2023-07-14T13:00:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:00:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:00:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:00:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:00:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.804+0000 7efc9e5ff700 1 -- 172.21.15.17:0/3698149354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efc800a1460 msgr2=0x7efc800a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.804+0000 7efc9e5ff700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efc800a1460 0x7efc800a3910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5643417ecb40 tx=0x7efc8800b680 comp rx=0 tx=0).stop 2023-07-14T13:00:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.804+0000 7efc9e5ff700 1 -- 172.21.15.17:0/3698149354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc98104e50 msgr2=0x7efc9819c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:00:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.804+0000 7efc9e5ff700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc98104e50 0x7efc9819c820 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc9000ef30 tx=0x7efc9000c3a0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.805+0000 7efc9e5ff700 1 -- 172.21.15.17:0/3698149354 shutdown_connections 2023-07-14T13:00:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.805+0000 7efc9e5ff700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efc800a1460 0x7efc800a3910 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.805+0000 7efc9e5ff700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc98104e50 0x7efc9819c820 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.805+0000 7efc9e5ff700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98067c10 0x7efc9810b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.805+0000 7efc9e5ff700 1 --2- 172.21.15.17:0/3698149354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc980685b0 0x7efc9810bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:00:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.805+0000 7efc9e5ff700 1 -- 172.21.15.17:0/3698149354 >> 172.21.15.17:0/3698149354 conn(0x7efc98074760 msgr2=0x7efc980fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:00:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.805+0000 7efc9e5ff700 1 -- 172.21.15.17:0/3698149354 shutdown_connections 2023-07-14T13:00:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:00:53.805+0000 7efc9e5ff700 1 -- 172.21.15.17:0/3698149354 wait complete. 2023-07-14T13:00:54.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:54 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:54 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:54 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:54 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:54 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:54 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:54 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:54 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:54 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:54 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:54 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:54 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:54 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:54 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:54.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:54 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:55.085 INFO:teuthology.orchestra.run.smithi017.stderr:2700000 of 50000000 tuples (5%) done (elapsed 44.69 s, remaining 782.90 s) 2023-07-14T13:00:55.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:55 smithi135 ceph-mon[97338]: pgmap v38: 97 pgs: 97 active+clean; 598 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 23 MiB/s wr, 90 op/s 2023-07-14T13:00:55.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:55 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:00:55.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:55 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:00:55.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:55 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:55.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:55 smithi131 ceph-mon[96953]: pgmap v38: 97 pgs: 97 active+clean; 598 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 23 MiB/s wr, 90 op/s 2023-07-14T13:00:55.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:55 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:00:55.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:55 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:00:55.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:55 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:55.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:55 smithi017 ceph-mon[95536]: pgmap v38: 97 pgs: 97 active+clean; 598 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 23 MiB/s wr, 90 op/s 2023-07-14T13:00:55.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:55 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:00:55.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:55 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:00:55.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:55 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:00:56.973 INFO:teuthology.orchestra.run.smithi017.stderr:2800000 of 50000000 tuples (5%) done (elapsed 46.58 s, remaining 785.17 s) 2023-07-14T13:00:57.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:57 smithi135 ceph-mon[97338]: pgmap v39: 97 pgs: 97 active+clean; 666 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 34 MiB/s wr, 102 op/s 2023-07-14T13:00:57.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:57 smithi131 ceph-mon[96953]: pgmap v39: 97 pgs: 97 active+clean; 666 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 34 MiB/s wr, 102 op/s 2023-07-14T13:00:57.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:57 smithi017 ceph-mon[95536]: pgmap v39: 97 pgs: 97 active+clean; 666 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 34 MiB/s wr, 102 op/s 2023-07-14T13:00:58.300 INFO:teuthology.orchestra.run.smithi017.stderr:2900000 of 50000000 tuples (5%) done (elapsed 47.90 s, remaining 778.04 s) 2023-07-14T13:00:59.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:00:59 smithi135 ceph-mon[97338]: pgmap v40: 97 pgs: 97 active+clean; 666 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-14T13:00:59.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:00:59 smithi131 ceph-mon[96953]: pgmap v40: 97 pgs: 97 active+clean; 666 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-14T13:00:59.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:00:59 smithi017 ceph-mon[95536]: pgmap v40: 97 pgs: 97 active+clean; 666 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-14T13:01:00.159 INFO:teuthology.orchestra.run.smithi017.stderr:3000000 of 50000000 tuples (6%) done (elapsed 49.76 s, remaining 779.63 s) 2023-07-14T13:01:01.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:01 smithi135 ceph-mon[97338]: pgmap v41: 97 pgs: 97 active+clean; 698 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-07-14T13:01:01.475 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:01 smithi017 ceph-mon[95536]: pgmap v41: 97 pgs: 97 active+clean; 698 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-07-14T13:01:01.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:01 smithi131 ceph-mon[96953]: pgmap v41: 97 pgs: 97 active+clean; 698 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 28 MiB/s wr, 25 op/s 2023-07-14T13:01:01.533 INFO:teuthology.orchestra.run.smithi017.stderr:3100000 of 50000000 tuples (6%) done (elapsed 51.13 s, remaining 773.62 s) 2023-07-14T13:01:03.358 INFO:teuthology.orchestra.run.smithi017.stderr:3200000 of 50000000 tuples (6%) done (elapsed 52.96 s, remaining 774.59 s) 2023-07-14T13:01:03.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:03 smithi135 ceph-mon[97338]: pgmap v42: 97 pgs: 97 active+clean; 736 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 31 op/s 2023-07-14T13:01:03.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:03 smithi131 ceph-mon[96953]: pgmap v42: 97 pgs: 97 active+clean; 736 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 31 op/s 2023-07-14T13:01:03.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:03 smithi017 ceph-mon[95536]: pgmap v42: 97 pgs: 97 active+clean; 736 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 31 op/s 2023-07-14T13:01:05.259 INFO:teuthology.orchestra.run.smithi017.stderr:3300000 of 50000000 tuples (6%) done (elapsed 54.86 s, remaining 776.40 s) 2023-07-14T13:01:05.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:05 smithi135 ceph-mon[97338]: pgmap v43: 97 pgs: 97 active+clean; 736 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:01:05.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:05 smithi131 ceph-mon[96953]: pgmap v43: 97 pgs: 97 active+clean; 736 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:01:05.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:05 smithi017 ceph-mon[95536]: pgmap v43: 97 pgs: 97 active+clean; 736 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:01:06.462 INFO:teuthology.orchestra.run.smithi017.stderr:3400000 of 50000000 tuples (6%) done (elapsed 56.07 s, remaining 768.44 s) 2023-07-14T13:01:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.982+0000 7f13a2bff700 1 -- 172.21.15.17:0/2455901527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c104e50 msgr2=0x7f139c10ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.982+0000 7f13a2bff700 1 --2- 172.21.15.17:0/2455901527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c104e50 0x7f139c10ca00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f139400b0d0 tx=0x7f139400b3e0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.983+0000 7f13a2bff700 1 -- 172.21.15.17:0/2455901527 shutdown_connections 2023-07-14T13:01:07.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.983+0000 7f13a2bff700 1 --2- 172.21.15.17:0/2455901527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c104e50 0x7f139c10ca00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.983+0000 7f13a2bff700 1 --2- 172.21.15.17:0/2455901527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f139c067c10 0x7f139c067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.983+0000 7f13a2bff700 1 --2- 172.21.15.17:0/2455901527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f139c0685b0 0x7f139c104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.983+0000 7f13a2bff700 1 -- 172.21.15.17:0/2455901527 >> 172.21.15.17:0/2455901527 conn(0x7f139c074760 msgr2=0x7f139c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.983+0000 7f13a2bff700 1 -- 172.21.15.17:0/2455901527 shutdown_connections 2023-07-14T13:01:07.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.983+0000 7f13a2bff700 1 -- 172.21.15.17:0/2455901527 wait complete. 2023-07-14T13:01:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.984+0000 7f13a2bff700 1 Processor -- start 2023-07-14T13:01:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.984+0000 7f13a2bff700 1 -- start start 2023-07-14T13:01:07.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.984+0000 7f13a2bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f139c067c10 0x7f139c197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.984+0000 7f13a2bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f139c0685b0 0x7f139c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.984+0000 7f13a2bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c104e50 0x7f139c19c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.984+0000 7f13a2bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c19d030 con 0x7f139c104e50 2023-07-14T13:01:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.984+0000 7f13a2bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c19d1a0 con 0x7f139c0685b0 2023-07-14T13:01:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.984+0000 7f13a2bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c19d360 con 0x7f139c067c10 2023-07-14T13:01:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f13a119c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c104e50 0x7f139c19c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f13a119c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c104e50 0x7f139c19c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60862/0 (socket says 172.21.15.17:60862) 2023-07-14T13:01:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f13a119c700 1 -- 172.21.15.17:0/689971747 learned_addr learned my addr 172.21.15.17:0/689971747 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f13a099b700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f139c067c10 0x7f139c197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f139bfff700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f139c0685b0 0x7f139c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f13a119c700 1 -- 172.21.15.17:0/689971747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f139c067c10 msgr2=0x7f139c197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f13a119c700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f139c067c10 0x7f139c197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f13a119c700 1 -- 172.21.15.17:0/689971747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f139c0685b0 msgr2=0x7f139c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f13a119c700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f139c0685b0 0x7f139c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f13a119c700 1 -- 172.21.15.17:0/689971747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394009d00 con 0x7f139c104e50 2023-07-14T13:01:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f139bfff700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f139c0685b0 0x7f139c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:01:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.985+0000 7f13a119c700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c104e50 0x7f139c19c9f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1394009fd0 tx=0x7f139400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.986+0000 7f1399ffb700 1 -- 172.21.15.17:0/689971747 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139400e040 con 0x7f139c104e50 2023-07-14T13:01:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.986+0000 7f13a2bff700 1 -- 172.21.15.17:0/689971747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c19d5e0 con 0x7f139c104e50 2023-07-14T13:01:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.986+0000 7f1399ffb700 1 -- 172.21.15.17:0/689971747 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1394003e10 con 0x7f139c104e50 2023-07-14T13:01:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.986+0000 7f1399ffb700 1 -- 172.21.15.17:0/689971747 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13940052a0 con 0x7f139c104e50 2023-07-14T13:01:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.986+0000 7f13a2bff700 1 -- 172.21.15.17:0/689971747 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c1a4e80 con 0x7f139c104e50 2023-07-14T13:01:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.989+0000 7f1399ffb700 1 -- 172.21.15.17:0/689971747 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f1394005400 con 0x7f139c104e50 2023-07-14T13:01:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.990+0000 7f13b6450b80 1 Processor -- start 2023-07-14T13:01:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.991+0000 7f13b6450b80 1 -- start start 2023-07-14T13:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.991+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f69ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.991+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f695040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.991+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f6959d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.991+0000 7f13b6450b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f59ac50 con 0x55ed8f695580 2023-07-14T13:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.991+0000 7f13b6450b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f5ed9e0 con 0x55ed8f69b2d0 2023-07-14T13:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.991+0000 7f13b6450b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f5e6e70 con 0x55ed8f4f16b0 2023-07-14T13:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.991+0000 7f1399ffb700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f138c0a13e0 0x7f138c0a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f13a099b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f695040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f13a099b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f695040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:43870/0 (socket says 172.21.15.17:43870) 2023-07-14T13:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f13a099b700 1 -- 172.21.15.17:0/4068623014 learned_addr learned my addr 172.21.15.17:0/4068623014 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f1399ffb700 1 -- 172.21.15.17:0/689971747 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f13940ce300 con 0x7f139c104e50 2023-07-14T13:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f139bfff700 1 --2- 172.21.15.17:0/4068623014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f69ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f139bfff700 1 --2- 172.21.15.17:0/4068623014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f6959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f13a119c700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f138c0a13e0 0x7f138c0a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f13a099b700 1 -- 172.21.15.17:0/4068623014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 msgr2=0x55ed8f69ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:07.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f13a099b700 1 --2- 172.21.15.17:0/4068623014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f69ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f13a099b700 1 -- 172.21.15.17:0/4068623014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 msgr2=0x55ed8f6959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f13a099b700 1 --2- 172.21.15.17:0/4068623014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f6959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.992+0000 7f13a099b700 1 -- 172.21.15.17:0/4068623014 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed8f414d80 con 0x55ed8f69b2d0 2023-07-14T13:01:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.993+0000 7f13a099b700 1 --2- 172.21.15.17:0/4068623014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f695040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1390009d80 tx=0x7f1390011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8253388c42004db1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.993+0000 7f13a119c700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f138c0a13e0 0x7f138c0a3890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13940cb940 tx=0x7f13940099e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.993+0000 7f1386ffd700 1 -- 172.21.15.17:0/4068623014 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390004230 con 0x55ed8f69b2d0 2023-07-14T13:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.993+0000 7f1386ffd700 1 -- 172.21.15.17:0/4068623014 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1390004390 con 0x55ed8f69b2d0 2023-07-14T13:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.993+0000 7f1386ffd700 1 -- 172.21.15.17:0/4068623014 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390019800 con 0x55ed8f69b2d0 2023-07-14T13:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.994+0000 7f13b6450b80 1 -- 172.21.15.17:0/4068623014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 msgr2=0x55ed8f695040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.994+0000 7f13b6450b80 1 --2- 172.21.15.17:0/4068623014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f695040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1390009d80 tx=0x7f1390011720 comp rx=0 tx=0).stop 2023-07-14T13:01:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.994+0000 7f13b6450b80 1 -- 172.21.15.17:0/4068623014 shutdown_connections 2023-07-14T13:01:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.994+0000 7f13b6450b80 1 --2- 172.21.15.17:0/4068623014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f6959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.994+0000 7f13b6450b80 1 --2- 172.21.15.17:0/4068623014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f69ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.994+0000 7f13b6450b80 1 --2- 172.21.15.17:0/4068623014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f695040 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.994+0000 7f13b6450b80 1 -- 172.21.15.17:0/4068623014 >> 172.21.15.17:0/4068623014 conn(0x55ed8f68abe0 msgr2=0x55ed8f68ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.994+0000 7f13b6450b80 1 -- 172.21.15.17:0/4068623014 shutdown_connections 2023-07-14T13:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.994+0000 7f13b6450b80 1 -- 172.21.15.17:0/4068623014 wait complete. 2023-07-14T13:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.995+0000 7f13b6450b80 1 -- start start 2023-07-14T13:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.995+0000 7f13b6450b80 1 Processor -- start 2023-07-14T13:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.995+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f6a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.995+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f69e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.995+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f69eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.995+0000 7f13b6450b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f586a60 con 0x55ed8f695580 2023-07-14T13:01:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.995+0000 7f13b6450b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f586760 con 0x55ed8f69b2d0 2023-07-14T13:01:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f13b6450b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f46a8c0 con 0x55ed8f4f16b0 2023-07-14T13:01:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f13b6450b80 10 client.0 _ll_register_callbacks cb 0x55ed8f584700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f139bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f6a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f13a099b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f69e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f139bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f6a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:46894/0 (socket says 172.21.15.17:46894) 2023-07-14T13:01:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f139bfff700 1 -- 172.21.15.17:0/2963342505 learned_addr learned my addr 172.21.15.17:0/2963342505 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f139bfff700 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f69eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f13a099b700 1 -- 172.21.15.17:0/2963342505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 msgr2=0x55ed8f6a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f13a099b700 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f6a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f13a099b700 1 -- 172.21.15.17:0/2963342505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 msgr2=0x55ed8f69eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f13a099b700 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f69eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f13a099b700 1 -- 172.21.15.17:0/2963342505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13900099e0 con 0x55ed8f695580 2023-07-14T13:01:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.996+0000 7f139bfff700 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f6a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.997+0000 7f13a099b700 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f69e840 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1390000c00 tx=0x7f1390003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9114921ef6ba7a52 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.997+0000 7f137bfff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:01:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.997+0000 7f137bfff700 1 -- 172.21.15.17:0/2963342505 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390005450 con 0x55ed8f695580 2023-07-14T13:01:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.997+0000 7f137bfff700 1 -- 172.21.15.17:0/2963342505 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1390005ce0 con 0x55ed8f695580 2023-07-14T13:01:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.997+0000 7f13b6450b80 1 -- 172.21.15.17:0/2963342505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed8f540490 con 0x55ed8f695580 2023-07-14T13:01:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.997+0000 7f137bfff700 1 -- 172.21.15.17:0/2963342505 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1390009ed0 con 0x55ed8f695580 2023-07-14T13:01:07.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.997+0000 7f13b6450b80 10 client.15981 fetch_fsmap learned FSMap version 24 2023-07-14T13:01:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.997+0000 7f13b6450b80 1 -- 172.21.15.17:0/2963342505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ed8f3fdc00 con 0x55ed8f695580 2023-07-14T13:01:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.998+0000 7f137bfff700 1 -- 172.21.15.17:0/2963342505 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ed8f540490 con 0x55ed8f695580 2023-07-14T13:01:07.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.998+0000 7f137bfff700 1 -- 172.21.15.17:0/2963342505 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1390021040 con 0x55ed8f695580 2023-07-14T13:01:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.998+0000 7f13b6450b80 10 client.15981 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:01:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.998+0000 7f13b6450b80 10 client.15981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.998+0000 7f13b6450b80 20 client.15981 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.998+0000 7f13b6450b80 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ed8f6aebc0 0x55ed8f6b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.998+0000 7f13b6450b80 4 client.15981 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:01:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.998+0000 7f13b6450b80 1 -- 172.21.15.17:0/2963342505 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed8f5dfe50 con 0x55ed8f6aebc0 2023-07-14T13:01:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.998+0000 7f139bfff700 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ed8f6aebc0 0x55ed8f6b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.999+0000 7f139bfff700 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ed8f6aebc0 0x55ed8f6b0fd0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=804078881052be69 server_cookie=41752c07e167da68 in_seq=0 out_seq=0 2023-07-14T13:01:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:06.999+0000 7f137bfff700 10 client.15981 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f137bfff700 1 -- 172.21.15.17:0/2963342505 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ed8f5dfe50 con 0x55ed8f6aebc0 2023-07-14T13:01:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f137bfff700 10 client.15981 handle_command_reply: tid=0 2023-07-14T13:01:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 1 client.15981 shutdown 2023-07-14T13:01:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 1 -- 172.21.15.17:0/2963342505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 msgr2=0x55ed8f69e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f69e840 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1390000c00 tx=0x7f1390003890 comp rx=0 tx=0).stop 2023-07-14T13:01:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 1 -- 172.21.15.17:0/2963342505 shutdown_connections 2023-07-14T13:01:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ed8f6aebc0 0x55ed8f6b0fd0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f69eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f6a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f137bfff700 0 client.15981 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 1 --2- 172.21.15.17:0/2963342505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f69e840 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 1 -- 172.21.15.17:0/2963342505 >> 172.21.15.17:0/2963342505 conn(0x55ed8f68abe0 msgr2=0x55ed8f68f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 1 -- 172.21.15.17:0/2963342505 shutdown_connections 2023-07-14T13:01:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 1 -- 172.21.15.17:0/2963342505 wait complete. 2023-07-14T13:01:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.000+0000 7f13b6450b80 20 client.15981 trim_cache size 0 max 16384 2023-07-14T13:01:07.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.019+0000 7f13b6450b80 1 Processor -- start 2023-07-14T13:01:07.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.019+0000 7f13b6450b80 1 -- start start 2023-07-14T13:01:07.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.019+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f695040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f6a5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f68fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f13b6450b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f69b6a0 con 0x55ed8f695580 2023-07-14T13:01:07.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f13b6450b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f691b50 con 0x55ed8f69b2d0 2023-07-14T13:01:07.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f13b6450b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f6916d0 con 0x55ed8f4f16b0 2023-07-14T13:01:07.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f139bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f695040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f13a099b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f6a5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f139bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f695040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:46902/0 (socket says 172.21.15.17:46902) 2023-07-14T13:01:07.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f139bfff700 1 -- 172.21.15.17:0/2094923143 learned_addr learned my addr 172.21.15.17:0/2094923143 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:07.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f139bfff700 1 --2- 172.21.15.17:0/2094923143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f68fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f13a099b700 1 -- 172.21.15.17:0/2094923143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 msgr2=0x55ed8f695040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:07.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f13a099b700 1 --2- 172.21.15.17:0/2094923143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f695040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f13a099b700 1 -- 172.21.15.17:0/2094923143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 msgr2=0x55ed8f68fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f13a099b700 1 --2- 172.21.15.17:0/2094923143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f68fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f13a099b700 1 -- 172.21.15.17:0/2094923143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed8f43b1f0 con 0x55ed8f695580 2023-07-14T13:01:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.020+0000 7f139bfff700 1 --2- 172.21.15.17:0/2094923143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f695040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.021+0000 7f13a099b700 1 --2- 172.21.15.17:0/2094923143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f6a5c60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1390009cd0 tx=0x7f1390004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f16d0d8c97923ec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.021+0000 7f13877fe700 1 -- 172.21.15.17:0/2094923143 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390009ed0 con 0x55ed8f695580 2023-07-14T13:01:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.021+0000 7f13877fe700 1 -- 172.21.15.17:0/2094923143 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1390003d90 con 0x55ed8f695580 2023-07-14T13:01:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.021+0000 7f13877fe700 1 -- 172.21.15.17:0/2094923143 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390005250 con 0x55ed8f695580 2023-07-14T13:01:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.022+0000 7f13b6450b80 1 -- 172.21.15.17:0/2094923143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 msgr2=0x55ed8f6a5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.022+0000 7f13b6450b80 1 --2- 172.21.15.17:0/2094923143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f6a5c60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1390009cd0 tx=0x7f1390004ef0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.022+0000 7f13b6450b80 1 -- 172.21.15.17:0/2094923143 shutdown_connections 2023-07-14T13:01:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.022+0000 7f13b6450b80 1 --2- 172.21.15.17:0/2094923143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f69b2d0 0x55ed8f68fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.022+0000 7f13b6450b80 1 --2- 172.21.15.17:0/2094923143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f4f16b0 0x55ed8f695040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.022+0000 7f13b6450b80 1 --2- 172.21.15.17:0/2094923143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f695580 0x55ed8f6a5c60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.022+0000 7f13b6450b80 1 -- 172.21.15.17:0/2094923143 >> 172.21.15.17:0/2094923143 conn(0x55ed8f68abe0 msgr2=0x55ed8f698a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:07.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.022+0000 7f13b6450b80 1 -- 172.21.15.17:0/2094923143 shutdown_connections 2023-07-14T13:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.022+0000 7f13b6450b80 1 -- 172.21.15.17:0/2094923143 wait complete. 2023-07-14T13:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.022+0000 7f13b6450b80 1 -- start start 2023-07-14T13:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.023+0000 7f13b6450b80 1 Processor -- start 2023-07-14T13:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.023+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f4f16b0 0x55ed8f6a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.023+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f695580 0x55ed8f696790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.023+0000 7f13b6450b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f69b2d0 0x55ed8f696cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.023+0000 7f13b6450b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f6973b0 con 0x55ed8f69b2d0 2023-07-14T13:01:07.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.023+0000 7f13b6450b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f697520 con 0x55ed8f4f16b0 2023-07-14T13:01:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.023+0000 7f13b6450b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed8f6976e0 con 0x55ed8f695580 2023-07-14T13:01:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.023+0000 7f13b6450b80 10 client.0 _ll_register_callbacks cb 0x7f138800b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f13a099b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f695580 0x55ed8f696790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f13a099b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f695580 0x55ed8f696790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:46914/0 (socket says 172.21.15.17:46914) 2023-07-14T13:01:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f13a099b700 1 -- 172.21.15.17:0/258011984 learned_addr learned my addr 172.21.15.17:0/258011984 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f139bfff700 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f4f16b0 0x55ed8f6a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f139bfff700 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f69b2d0 0x55ed8f696cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f13a099b700 1 -- 172.21.15.17:0/258011984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f4f16b0 msgr2=0x55ed8f6a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f13a099b700 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f4f16b0 0x55ed8f6a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f13a099b700 1 -- 172.21.15.17:0/258011984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f69b2d0 msgr2=0x55ed8f696cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f13a099b700 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f69b2d0 0x55ed8f696cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f13a099b700 1 -- 172.21.15.17:0/258011984 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138802a040 con 0x55ed8f695580 2023-07-14T13:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f139bfff700 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f69b2d0 0x55ed8f696cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f13a099b700 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f695580 0x55ed8f696790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55ed8f69b7e0 tx=0x7f1390009f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2be8d158d497cd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.024+0000 7f137bfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.025+0000 7f137bfff700 1 -- 172.21.15.17:0/258011984 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13900048f0 con 0x55ed8f695580 2023-07-14T13:01:07.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.025+0000 7f13b6450b80 1 -- 172.21.15.17:0/258011984 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1390004390 con 0x55ed8f695580 2023-07-14T13:01:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.025+0000 7f137bfff700 1 -- 172.21.15.17:0/258011984 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1390000e40 con 0x55ed8f695580 2023-07-14T13:01:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.025+0000 7f137bfff700 1 -- 172.21.15.17:0/258011984 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1390004a50 con 0x55ed8f695580 2023-07-14T13:01:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.025+0000 7f13b6450b80 10 client.25720 fetch_fsmap learned FSMap version 24 2023-07-14T13:01:07.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.025+0000 7f13b6450b80 1 -- 172.21.15.17:0/258011984 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ed8f3fdc00 con 0x55ed8f695580 2023-07-14T13:01:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.025+0000 7f137bfff700 1 -- 172.21.15.17:0/258011984 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1390004390 con 0x55ed8f695580 2023-07-14T13:01:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.025+0000 7f137bfff700 1 -- 172.21.15.17:0/258011984 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1390021070 con 0x55ed8f695580 2023-07-14T13:01:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.026+0000 7f13b6450b80 10 client.25720 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:01:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.026+0000 7f13b6450b80 10 client.25720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.026+0000 7f13b6450b80 20 client.25720 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.026+0000 7f13b6450b80 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ed8f702cf0 0x55ed8f705100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.026+0000 7f13b6450b80 4 client.25720 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:01:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.026+0000 7f13b6450b80 1 -- 172.21.15.17:0/258011984 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ed8f5a1ff0 con 0x55ed8f702cf0 2023-07-14T13:01:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.026+0000 7f139bfff700 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ed8f702cf0 0x55ed8f705100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.027+0000 7f139bfff700 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ed8f702cf0 0x55ed8f705100 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced8715b8c95fb9c server_cookie=b22904f8fd699eea in_seq=0 out_seq=0 2023-07-14T13:01:07.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.027+0000 7f137bfff700 10 client.25720 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:07.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.041+0000 7f137bfff700 1 -- 172.21.15.17:0/258011984 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ed8f5a1ff0 con 0x55ed8f702cf0 2023-07-14T13:01:07.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.041+0000 7f137bfff700 10 client.25720 handle_command_reply: tid=0 2023-07-14T13:01:07.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.041+0000 7f13b6450b80 1 client.25720 shutdown 2023-07-14T13:01:07.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f13b6450b80 1 -- 172.21.15.17:0/258011984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f695580 msgr2=0x55ed8f696790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:07.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f13b6450b80 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f695580 0x55ed8f696790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55ed8f69b7e0 tx=0x7f1390009f40 comp rx=0 tx=0).stop 2023-07-14T13:01:07.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f13b6450b80 1 -- 172.21.15.17:0/258011984 shutdown_connections 2023-07-14T13:01:07.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f13b6450b80 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ed8f702cf0 0x55ed8f705100 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f13b6450b80 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ed8f69b2d0 0x55ed8f696cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f137bfff700 0 client.25720 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f13b6450b80 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed8f4f16b0 0x55ed8f6a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f13b6450b80 1 --2- 172.21.15.17:0/258011984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ed8f695580 0x55ed8f696790 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f13b6450b80 1 -- 172.21.15.17:0/258011984 >> 172.21.15.17:0/258011984 conn(0x55ed8f68abe0 msgr2=0x55ed8f69b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f13b6450b80 1 -- 172.21.15.17:0/258011984 shutdown_connections 2023-07-14T13:01:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f13b6450b80 1 -- 172.21.15.17:0/258011984 wait complete. 2023-07-14T13:01:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.042+0000 7f13b6450b80 20 client.25720 trim_cache size 0 max 16384 2023-07-14T13:01:07.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:01:07.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:01:07.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:01:07.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:01:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 -- 172.21.15.17:0/689971747 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f138c0a13e0 msgr2=0x7f138c0a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f138c0a13e0 0x7f138c0a3890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13940cb940 tx=0x7f13940099e0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 -- 172.21.15.17:0/689971747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c104e50 msgr2=0x7f139c19c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c104e50 0x7f139c19c9f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1394009fd0 tx=0x7f139400cce0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 -- 172.21.15.17:0/689971747 shutdown_connections 2023-07-14T13:01:07.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f138c0a13e0 0x7f138c0a3890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f139c104e50 0x7f139c19c9f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f139c067c10 0x7f139c197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 --2- 172.21.15.17:0/689971747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f139c0685b0 0x7f139c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:07.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 -- 172.21.15.17:0/689971747 >> 172.21.15.17:0/689971747 conn(0x7f139c074760 msgr2=0x7f139c0fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:07.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 -- 172.21.15.17:0/689971747 shutdown_connections 2023-07-14T13:01:07.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:07.043+0000 7f13a2bff700 1 -- 172.21.15.17:0/689971747 wait complete. 2023-07-14T13:01:07.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:07 smithi135 ceph-mon[97338]: pgmap v44: 97 pgs: 97 active+clean; 828 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 MiB/s wr, 45 op/s 2023-07-14T13:01:07.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:07 smithi131 ceph-mon[96953]: pgmap v44: 97 pgs: 97 active+clean; 828 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 MiB/s wr, 45 op/s 2023-07-14T13:01:07.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:07 smithi017 ceph-mon[95536]: pgmap v44: 97 pgs: 97 active+clean; 828 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 MiB/s wr, 45 op/s 2023-07-14T13:01:08.379 INFO:teuthology.orchestra.run.smithi017.stderr:3500000 of 50000000 tuples (7%) done (elapsed 57.98 s, remaining 770.33 s) 2023-07-14T13:01:09.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:09 smithi135 ceph-mon[97338]: pgmap v45: 97 pgs: 97 active+clean; 828 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 33 op/s 2023-07-14T13:01:09.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:09 smithi131 ceph-mon[96953]: pgmap v45: 97 pgs: 97 active+clean; 828 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 33 op/s 2023-07-14T13:01:09.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:09 smithi017 ceph-mon[95536]: pgmap v45: 97 pgs: 97 active+clean; 828 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 33 op/s 2023-07-14T13:01:10.128 INFO:teuthology.orchestra.run.smithi017.stderr:3600000 of 50000000 tuples (7%) done (elapsed 59.73 s, remaining 769.88 s) 2023-07-14T13:01:11.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:11 smithi135 ceph-mon[97338]: pgmap v46: 97 pgs: 97 active+clean; 852 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-07-14T13:01:11.457 INFO:teuthology.orchestra.run.smithi017.stderr:3700000 of 50000000 tuples (7%) done (elapsed 61.06 s, remaining 764.10 s) 2023-07-14T13:01:11.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:11 smithi131 ceph-mon[96953]: pgmap v46: 97 pgs: 97 active+clean; 852 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-07-14T13:01:11.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:11 smithi017 ceph-mon[95536]: pgmap v46: 97 pgs: 97 active+clean; 852 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 35 op/s 2023-07-14T13:01:13.315 INFO:teuthology.orchestra.run.smithi017.stderr:3800000 of 50000000 tuples (7%) done (elapsed 62.92 s, remaining 764.98 s) 2023-07-14T13:01:13.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:13 smithi135 ceph-mon[97338]: pgmap v47: 97 pgs: 97 active+clean; 896 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 31 MiB/s wr, 47 op/s 2023-07-14T13:01:13.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:13 smithi131 ceph-mon[96953]: pgmap v47: 97 pgs: 97 active+clean; 896 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 31 MiB/s wr, 47 op/s 2023-07-14T13:01:13.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:13 smithi017 ceph-mon[95536]: pgmap v47: 97 pgs: 97 active+clean; 896 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 31 MiB/s wr, 47 op/s 2023-07-14T13:01:14.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:01:14.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.245+0000 7f0ba6bff700 1 -- 172.21.15.17:0/2350675370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba0105b10 msgr2=0x7f0ba0105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.245+0000 7f0ba6bff700 1 --2- 172.21.15.17:0/2350675370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba0105b10 0x7f0ba0105ee0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0b94009990 tx=0x7f0b94009ca0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.245+0000 7f0ba6bff700 1 -- 172.21.15.17:0/2350675370 shutdown_connections 2023-07-14T13:01:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.245+0000 7f0ba6bff700 1 --2- 172.21.15.17:0/2350675370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ba01004b0 0x7f0ba010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.245+0000 7f0ba6bff700 1 --2- 172.21.15.17:0/2350675370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba0105b10 0x7f0ba0105ee0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.245+0000 7f0ba6bff700 1 --2- 172.21.15.17:0/2350675370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba00ffb00 0x7f0ba00fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.245+0000 7f0ba6bff700 1 -- 172.21.15.17:0/2350675370 >> 172.21.15.17:0/2350675370 conn(0x7f0ba00fb600 msgr2=0x7f0ba00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:14.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.246+0000 7f0ba6bff700 1 -- 172.21.15.17:0/2350675370 shutdown_connections 2023-07-14T13:01:14.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.246+0000 7f0ba6bff700 1 -- 172.21.15.17:0/2350675370 wait complete. 2023-07-14T13:01:14.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.247+0000 7f0ba6bff700 1 Processor -- start 2023-07-14T13:01:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.247+0000 7f0ba6bff700 1 -- start start 2023-07-14T13:01:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.248+0000 7f0ba6bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ba00ffb00 0x7f0ba019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.248+0000 7f0ba6bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba01004b0 0x7f0ba019bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.248+0000 7f0ba6bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba0105b10 0x7f0ba01959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.248+0000 7f0ba6bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba0196050 con 0x7f0ba01004b0 2023-07-14T13:01:14.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.248+0000 7f0ba6bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba01961c0 con 0x7f0ba00ffb00 2023-07-14T13:01:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.248+0000 7f0ba6bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba0196380 con 0x7f0ba0105b10 2023-07-14T13:01:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.248+0000 7f0ba499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ba00ffb00 0x7f0ba019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.249+0000 7f0ba499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ba00ffb00 0x7f0ba019b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:43906/0 (socket says 172.21.15.17:43906) 2023-07-14T13:01:14.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.249+0000 7f0ba499b700 1 -- 172.21.15.17:0/124474555 learned_addr learned my addr 172.21.15.17:0/124474555 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:14.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.249+0000 7f0ba519c700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba0105b10 0x7f0ba01959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.249+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba01004b0 0x7f0ba019bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.249+0000 7f0ba519c700 1 -- 172.21.15.17:0/124474555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ba00ffb00 msgr2=0x7f0ba019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:14.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.249+0000 7f0ba519c700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ba00ffb00 0x7f0ba019b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.249+0000 7f0ba519c700 1 -- 172.21.15.17:0/124474555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba01004b0 msgr2=0x7f0ba019bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.249+0000 7f0ba519c700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba01004b0 0x7f0ba019bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.249+0000 7f0ba519c700 1 -- 172.21.15.17:0/124474555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c009520 con 0x7f0ba0105b10 2023-07-14T13:01:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.250+0000 7f0ba519c700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba0105b10 0x7f0ba01959f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800efc0 tx=0x7f0b9800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.250+0000 7f0b9dffb700 1 -- 172.21.15.17:0/124474555 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98018070 con 0x7f0ba0105b10 2023-07-14T13:01:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.250+0000 7f0b9dffb700 1 -- 172.21.15.17:0/124474555 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b9800f040 con 0x7f0ba0105b10 2023-07-14T13:01:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.250+0000 7f0ba6bff700 1 -- 172.21.15.17:0/124474555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b940095f0 con 0x7f0ba0105b10 2023-07-14T13:01:14.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.250+0000 7f0b9dffb700 1 -- 172.21.15.17:0/124474555 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9800cba0 con 0x7f0ba0105b10 2023-07-14T13:01:14.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.250+0000 7f0ba6bff700 1 -- 172.21.15.17:0/124474555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba0069f30 con 0x7f0ba0105b10 2023-07-14T13:01:14.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.255+0000 7f0b9dffb700 1 -- 172.21.15.17:0/124474555 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) v1 ==== 135948+0+0 (secure 0 0 0) 0x7f0b98003a00 con 0x7f0ba0105b10 2023-07-14T13:01:14.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.256+0000 7f0bba46cb80 1 Processor -- start 2023-07-14T13:01:14.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.256+0000 7f0bba46cb80 1 -- start start 2023-07-14T13:01:14.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea47fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea48a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea48d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea381cb0 con 0x5598ea47fff0 2023-07-14T13:01:14.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea3d4a40 con 0x5598ea48aee0 2023-07-14T13:01:14.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea3cded0 con 0x5598ea47f6e0 2023-07-14T13:01:14.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0b9ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea47fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0b9ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea47fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:46932/0 (socket says 172.21.15.17:46932) 2023-07-14T13:01:14.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0b9ffff700 1 -- 172.21.15.17:0/709687561 learned_addr learned my addr 172.21.15.17:0/709687561 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:14.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/709687561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea48d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0b9ffff700 1 -- 172.21.15.17:0/709687561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 msgr2=0x5598ea48d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:14.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/709687561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea48d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0b9ffff700 1 -- 172.21.15.17:0/709687561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 msgr2=0x5598ea48a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:14.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/709687561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea48a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0b9ffff700 1 -- 172.21.15.17:0/709687561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598ea1fbde0 con 0x5598ea47f6e0 2023-07-14T13:01:14.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.257+0000 7f0b9dffb700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b900a1460 0x7f0b900a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.258+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/709687561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea47fab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c011a10 tx=0x7f0b8c009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c3e307f1ccbb264 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:14.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.258+0000 7f0b9dffb700 1 -- 172.21.15.17:0/124474555 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0b980cc930 con 0x7f0ba0105b10 2023-07-14T13:01:14.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.258+0000 7f0ba499b700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b900a1460 0x7f0b900a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.258+0000 7f0b8affd700 1 -- 172.21.15.17:0/709687561 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c011110 con 0x5598ea47f6e0 2023-07-14T13:01:14.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.258+0000 7f0b8affd700 1 -- 172.21.15.17:0/709687561 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b8c0044c0 con 0x5598ea47f6e0 2023-07-14T13:01:14.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.258+0000 7f0b8affd700 1 -- 172.21.15.17:0/709687561 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c003ce0 con 0x5598ea47f6e0 2023-07-14T13:01:14.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.259+0000 7f0bba46cb80 1 -- 172.21.15.17:0/709687561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 msgr2=0x5598ea47fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:14.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.259+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/709687561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea47fab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c011a10 tx=0x7f0b8c009400 comp rx=0 tx=0).stop 2023-07-14T13:01:14.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.259+0000 7f0ba499b700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b900a1460 0x7f0b900a3910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b94005cd0 tx=0x7f0b94005c40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:14.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.259+0000 7f0bba46cb80 1 -- 172.21.15.17:0/709687561 shutdown_connections 2023-07-14T13:01:14.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.259+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/709687561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea48d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.259+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/709687561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea47fab0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.259+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/709687561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea48a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.259+0000 7f0bba46cb80 1 -- 172.21.15.17:0/709687561 >> 172.21.15.17:0/709687561 conn(0x5598ea471da0 msgr2=0x5598ea4776a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:14.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.259+0000 7f0bba46cb80 1 -- 172.21.15.17:0/709687561 shutdown_connections 2023-07-14T13:01:14.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.259+0000 7f0bba46cb80 1 -- 172.21.15.17:0/709687561 wait complete. 2023-07-14T13:01:14.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.260+0000 7f0bba46cb80 1 -- start start 2023-07-14T13:01:14.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.260+0000 7f0bba46cb80 1 Processor -- start 2023-07-14T13:01:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea48a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea483800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea483d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea36dac0 con 0x5598ea47fff0 2023-07-14T13:01:14.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea36d7c0 con 0x5598ea48aee0 2023-07-14T13:01:14.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea251920 con 0x5598ea47f6e0 2023-07-14T13:01:14.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0bba46cb80 10 client.0 _ll_register_callbacks cb 0x5598ea36b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:14.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0ba499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea48a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0ba499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea48a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:46940/0 (socket says 172.21.15.17:46940) 2023-07-14T13:01:14.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0ba499b700 1 -- 172.21.15.17:0/878719577 learned_addr learned my addr 172.21.15.17:0/878719577 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:14.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea483800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.261+0000 7f0ba519c700 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea483d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.262+0000 7f0ba499b700 1 -- 172.21.15.17:0/878719577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 msgr2=0x5598ea483d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:14.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.262+0000 7f0ba499b700 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea483d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.262+0000 7f0ba499b700 1 -- 172.21.15.17:0/878719577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 msgr2=0x5598ea483800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:14.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.262+0000 7f0ba499b700 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea483800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.262+0000 7f0ba499b700 1 -- 172.21.15.17:0/878719577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c019040 con 0x5598ea47f6e0 2023-07-14T13:01:14.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.262+0000 7f0ba499b700 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea48a550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400be70 tx=0x7f0b9400b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4afd7939624ecaa4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:14.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.262+0000 7f0b7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:01:14.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.262+0000 7f0b7ffff700 1 -- 172.21.15.17:0/878719577 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94004ea0 con 0x5598ea47f6e0 2023-07-14T13:01:14.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.262+0000 7f0bba46cb80 1 -- 172.21.15.17:0/878719577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598ea3274f0 con 0x5598ea47f6e0 2023-07-14T13:01:14.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.262+0000 7f0b7ffff700 1 -- 172.21.15.17:0/878719577 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0b9400f460 con 0x5598ea47f6e0 2023-07-14T13:01:14.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.263+0000 7f0b7ffff700 1 -- 172.21.15.17:0/878719577 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b9400bea0 con 0x5598ea47f6e0 2023-07-14T13:01:14.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.263+0000 7f0bba46cb80 10 client.25732 fetch_fsmap learned FSMap version 24 2023-07-14T13:01:14.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.263+0000 7f0bba46cb80 1 -- 172.21.15.17:0/878719577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5598ea1e4c60 con 0x5598ea47f6e0 2023-07-14T13:01:14.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.263+0000 7f0b7ffff700 1 -- 172.21.15.17:0/878719577 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b9403d020 con 0x5598ea47f6e0 2023-07-14T13:01:14.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.263+0000 7f0b7ffff700 1 -- 172.21.15.17:0/878719577 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0b940396c0 con 0x5598ea47f6e0 2023-07-14T13:01:14.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.263+0000 7f0bba46cb80 10 client.25732 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:01:14.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.263+0000 7f0bba46cb80 10 client.25732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:14.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.263+0000 7f0bba46cb80 20 client.25732 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:14.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.263+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5598ea49ec00 0x5598ea4a1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.263+0000 7f0bba46cb80 4 client.25732 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:01:14.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.263+0000 7f0bba46cb80 1 -- 172.21.15.17:0/878719577 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598ea3c6eb0 con 0x5598ea49ec00 2023-07-14T13:01:14.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.264+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5598ea49ec00 0x5598ea4a1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.264+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5598ea49ec00 0x5598ea4a1010 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3292dd23c59e0f95 server_cookie=5d9157e76c0045fe in_seq=0 out_seq=0 2023-07-14T13:01:14.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.264+0000 7f0b7ffff700 10 client.25732 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:14.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.265+0000 7f0b7ffff700 1 -- 172.21.15.17:0/878719577 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5598ea3c6eb0 con 0x5598ea49ec00 2023-07-14T13:01:14.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.265+0000 7f0b7ffff700 10 client.25732 handle_command_reply: tid=0 2023-07-14T13:01:14.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.265+0000 7f0bba46cb80 1 client.25732 shutdown 2023-07-14T13:01:14.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.265+0000 7f0bba46cb80 1 -- 172.21.15.17:0/878719577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 msgr2=0x5598ea48a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:14.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.265+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea48a550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400be70 tx=0x7f0b9400b260 comp rx=0 tx=0).stop 2023-07-14T13:01:14.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.266+0000 7f0bba46cb80 1 -- 172.21.15.17:0/878719577 shutdown_connections 2023-07-14T13:01:14.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.266+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5598ea49ec00 0x5598ea4a1010 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.266+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea483d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.266+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea48a550 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.266+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/878719577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea483800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.266+0000 7f0bba46cb80 1 -- 172.21.15.17:0/878719577 >> 172.21.15.17:0/878719577 conn(0x5598ea471da0 msgr2=0x5598ea477230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:14.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.266+0000 7f0b7ffff700 0 client.25732 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:14.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.266+0000 7f0bba46cb80 1 -- 172.21.15.17:0/878719577 shutdown_connections 2023-07-14T13:01:14.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.266+0000 7f0bba46cb80 1 -- 172.21.15.17:0/878719577 wait complete. 2023-07-14T13:01:14.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.266+0000 7f0bba46cb80 20 client.25732 trim_cache size 0 max 16384 2023-07-14T13:01:14.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.289+0000 7f0bba46cb80 1 Processor -- start 2023-07-14T13:01:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.289+0000 7f0bba46cb80 1 -- start start 2023-07-14T13:01:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.289+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea47f6e0 0x5598ea481f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.289+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47fff0 0x5598ea48a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.289+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea48aee0 0x5598ea483870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.289+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea481170 con 0x5598ea48aee0 2023-07-14T13:01:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.289+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea46efa0 con 0x5598ea47f6e0 2023-07-14T13:01:14.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.289+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea471970 con 0x5598ea47fff0 2023-07-14T13:01:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.290+0000 7f0ba499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea47f6e0 0x5598ea481f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.290+0000 7f0ba499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea47f6e0 0x5598ea481f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:43938/0 (socket says 172.21.15.17:43938) 2023-07-14T13:01:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.290+0000 7f0ba499b700 1 -- 172.21.15.17:0/3884649863 learned_addr learned my addr 172.21.15.17:0/3884649863 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.290+0000 7f0ba519c700 1 --2- 172.21.15.17:0/3884649863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea48aee0 0x5598ea483870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.290+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/3884649863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47fff0 0x5598ea48a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.290+0000 7f0ba499b700 1 -- 172.21.15.17:0/3884649863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47fff0 msgr2=0x5598ea48a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:14.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.290+0000 7f0ba499b700 1 --2- 172.21.15.17:0/3884649863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47fff0 0x5598ea48a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.290+0000 7f0ba499b700 1 -- 172.21.15.17:0/3884649863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea48aee0 msgr2=0x5598ea483870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:14.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.290+0000 7f0ba499b700 1 --2- 172.21.15.17:0/3884649863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea48aee0 0x5598ea483870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.290+0000 7f0ba499b700 1 -- 172.21.15.17:0/3884649863 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598ea4735e0 con 0x5598ea47f6e0 2023-07-14T13:01:14.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.290+0000 7f0ba519c700 1 --2- 172.21.15.17:0/3884649863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea48aee0 0x5598ea483870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:14.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.291+0000 7f0ba499b700 1 --2- 172.21.15.17:0/3884649863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea47f6e0 0x5598ea481f00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b940093f0 tx=0x7f0b94005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d913d808e74c7cc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:14.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.291+0000 7f0b8b7fe700 1 -- 172.21.15.17:0/3884649863 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94004d70 con 0x5598ea47f6e0 2023-07-14T13:01:14.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.291+0000 7f0b8b7fe700 1 -- 172.21.15.17:0/3884649863 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b9403d050 con 0x5598ea47f6e0 2023-07-14T13:01:14.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.291+0000 7f0b8b7fe700 1 -- 172.21.15.17:0/3884649863 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400fa90 con 0x5598ea47f6e0 2023-07-14T13:01:14.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.292+0000 7f0bba46cb80 1 -- 172.21.15.17:0/3884649863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea47f6e0 msgr2=0x5598ea481f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:14.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.292+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/3884649863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea47f6e0 0x5598ea481f00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b940093f0 tx=0x7f0b94005960 comp rx=0 tx=0).stop 2023-07-14T13:01:14.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.292+0000 7f0bba46cb80 1 -- 172.21.15.17:0/3884649863 shutdown_connections 2023-07-14T13:01:14.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.292+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/3884649863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea48aee0 0x5598ea483870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.292+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/3884649863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea47f6e0 0x5598ea481f00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.292+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/3884649863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47fff0 0x5598ea48a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.292+0000 7f0bba46cb80 1 -- 172.21.15.17:0/3884649863 >> 172.21.15.17:0/3884649863 conn(0x5598ea471da0 msgr2=0x5598ea4817f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:14.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.292+0000 7f0bba46cb80 1 -- 172.21.15.17:0/3884649863 shutdown_connections 2023-07-14T13:01:14.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.292+0000 7f0bba46cb80 1 -- 172.21.15.17:0/3884649863 wait complete. 2023-07-14T13:01:14.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.292+0000 7f0bba46cb80 1 -- start start 2023-07-14T13:01:14.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.293+0000 7f0bba46cb80 1 Processor -- start 2023-07-14T13:01:14.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.293+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea49b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.293+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea49b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.293+0000 7f0bba46cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea497740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.293+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea497d60 con 0x5598ea47fff0 2023-07-14T13:01:14.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.293+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea497ed0 con 0x5598ea48aee0 2023-07-14T13:01:14.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.293+0000 7f0bba46cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598ea498090 con 0x5598ea47f6e0 2023-07-14T13:01:14.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.293+0000 7f0bba46cb80 10 client.0 _ll_register_callbacks cb 0x5598ea36b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:14.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0ba499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea49b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0ba499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea49b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:46962/0 (socket says 172.21.15.17:46962) 2023-07-14T13:01:14.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0ba499b700 1 -- 172.21.15.17:0/124058909 learned_addr learned my addr 172.21.15.17:0/124058909 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:14.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0ba519c700 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea497740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea49b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0ba499b700 1 -- 172.21.15.17:0/124058909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 msgr2=0x5598ea497740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:14.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0ba499b700 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea497740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0ba499b700 1 -- 172.21.15.17:0/124058909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 msgr2=0x5598ea49b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:14.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0ba499b700 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea49b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0ba499b700 1 -- 172.21.15.17:0/124058909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba0069f30 con 0x5598ea47f6e0 2023-07-14T13:01:14.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea49b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:01:14.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0ba499b700 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea49b2e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b94039a50 tx=0x7f0b94039e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c558ae23ecc21d53 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:14.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.294+0000 7f0b7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:01:14.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.295+0000 7f0b7ffff700 1 -- 172.21.15.17:0/124058909 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94039870 con 0x5598ea47f6e0 2023-07-14T13:01:14.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.295+0000 7f0bba46cb80 1 -- 172.21.15.17:0/124058909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b8c0044c0 con 0x5598ea47f6e0 2023-07-14T13:01:14.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.295+0000 7f0b7ffff700 1 -- 172.21.15.17:0/124058909 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0b9403e080 con 0x5598ea47f6e0 2023-07-14T13:01:14.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.295+0000 7f0b7ffff700 1 -- 172.21.15.17:0/124058909 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b94004ea0 con 0x5598ea47f6e0 2023-07-14T13:01:14.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.295+0000 7f0bba46cb80 10 client.25738 fetch_fsmap learned FSMap version 24 2023-07-14T13:01:14.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.295+0000 7f0bba46cb80 1 -- 172.21.15.17:0/124058909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5598ea1e4c60 con 0x5598ea47f6e0 2023-07-14T13:01:14.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.295+0000 7f0b7ffff700 1 -- 172.21.15.17:0/124058909 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b8c0044c0 con 0x5598ea47f6e0 2023-07-14T13:01:14.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.296+0000 7f0b7ffff700 1 -- 172.21.15.17:0/124058909 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0b94042690 con 0x5598ea47f6e0 2023-07-14T13:01:14.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.296+0000 7f0bba46cb80 10 client.25738 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:01:14.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.296+0000 7f0bba46cb80 10 client.25738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:14.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.296+0000 7f0bba46cb80 20 client.25738 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:14.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.296+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5598ea4f36a0 0x5598ea4f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:14.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.296+0000 7f0bba46cb80 4 client.25738 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:01:14.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.296+0000 7f0bba46cb80 1 -- 172.21.15.17:0/124058909 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5598ea389050 con 0x5598ea4f36a0 2023-07-14T13:01:14.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.296+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5598ea4f36a0 0x5598ea4f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:14.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0b9ffff700 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5598ea4f36a0 0x5598ea4f5a80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ff1c94c561f125 server_cookie=a5e22cfdb069711f in_seq=0 out_seq=0 2023-07-14T13:01:14.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0b7ffff700 10 client.25738 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:14.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0b7ffff700 1 -- 172.21.15.17:0/124058909 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5598ea389050 con 0x5598ea4f36a0 2023-07-14T13:01:14.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0b7ffff700 10 client.25738 handle_command_reply: tid=0 2023-07-14T13:01:14.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0bba46cb80 1 client.25738 shutdown 2023-07-14T13:01:14.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0bba46cb80 1 -- 172.21.15.17:0/124058909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 msgr2=0x5598ea49b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea49b2e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b94039a50 tx=0x7f0b94039e70 comp rx=0 tx=0).stop 2023-07-14T13:01:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0bba46cb80 1 -- 172.21.15.17:0/124058909 shutdown_connections 2023-07-14T13:01:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5598ea4f36a0 0x5598ea4f5a80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5598ea48aee0 0x5598ea497740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598ea47f6e0 0x5598ea49b2e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0bba46cb80 1 --2- 172.21.15.17:0/124058909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5598ea47fff0 0x5598ea49b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0b7ffff700 0 client.25738 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.297+0000 7f0bba46cb80 1 -- 172.21.15.17:0/124058909 >> 172.21.15.17:0/124058909 conn(0x5598ea471da0 msgr2=0x5598ea483800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:14.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.298+0000 7f0bba46cb80 1 -- 172.21.15.17:0/124058909 shutdown_connections 2023-07-14T13:01:14.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.298+0000 7f0bba46cb80 1 -- 172.21.15.17:0/124058909 wait complete. 2023-07-14T13:01:14.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.298+0000 7f0bba46cb80 20 client.25738 trim_cache size 0 max 16384 2023-07-14T13:01:14.336 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:01:14.336 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (2 inodes in the stack)", 2023-07-14T13:01:14.337 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:01:14.337 INFO:teuthology.orchestra.run.smithi017.stdout: "f3578cce-cbe4-4d2d-80c7-958bc9d580c0": { 2023-07-14T13:01:14.337 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:01:14.337 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "f3578cce-cbe4-4d2d-80c7-958bc9d580c0", 2023-07-14T13:01:14.337 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:01:14.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:01:14.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:01:14.338 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:01:14.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.298+0000 7f0ba6bff700 1 -- 172.21.15.17:0/124474555 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b900a1460 msgr2=0x7f0b900a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:14.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.298+0000 7f0ba6bff700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b900a1460 0x7f0b900a3910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b94005cd0 tx=0x7f0b94005c40 comp rx=0 tx=0).stop 2023-07-14T13:01:14.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.298+0000 7f0ba6bff700 1 -- 172.21.15.17:0/124474555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba0105b10 msgr2=0x7f0ba01959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:14.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.298+0000 7f0ba6bff700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba0105b10 0x7f0ba01959f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800efc0 tx=0x7f0b9800c3a0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.299+0000 7f0ba6bff700 1 -- 172.21.15.17:0/124474555 shutdown_connections 2023-07-14T13:01:14.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.299+0000 7f0ba6bff700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b900a1460 0x7f0b900a3910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.299+0000 7f0ba6bff700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba0105b10 0x7f0ba01959f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.299+0000 7f0ba6bff700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ba00ffb00 0x7f0ba019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.299+0000 7f0ba6bff700 1 --2- 172.21.15.17:0/124474555 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ba01004b0 0x7f0ba019bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:14.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.299+0000 7f0ba6bff700 1 -- 172.21.15.17:0/124474555 >> 172.21.15.17:0/124474555 conn(0x7f0ba00fb600 msgr2=0x7f0ba0103610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:14.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.299+0000 7f0ba6bff700 1 -- 172.21.15.17:0/124474555 shutdown_connections 2023-07-14T13:01:14.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:14.299+0000 7f0ba6bff700 1 -- 172.21.15.17:0/124474555 wait complete. 2023-07-14T13:01:14.351 INFO:tasks.cephfs.filesystem:scrub status for tag:f3578cce-cbe4-4d2d-80c7-958bc9d580c0 - {'path': '/', 'tag': 'f3578cce-cbe4-4d2d-80c7-958bc9d580c0', 'options': 'recursive,force'} 2023-07-14T13:01:15.063 INFO:teuthology.orchestra.run.smithi017.stderr:3900000 of 50000000 tuples (7%) done (elapsed 64.67 s, remaining 764.40 s) 2023-07-14T13:01:15.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:15 smithi135 ceph-mon[97338]: pgmap v48: 97 pgs: 97 active+clean; 896 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 39 op/s 2023-07-14T13:01:15.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:15 smithi131 ceph-mon[96953]: pgmap v48: 97 pgs: 97 active+clean; 896 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 39 op/s 2023-07-14T13:01:15.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:15 smithi017 ceph-mon[95536]: pgmap v48: 97 pgs: 97 active+clean; 896 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 39 op/s 2023-07-14T13:01:16.432 INFO:teuthology.orchestra.run.smithi017.stderr:4000000 of 50000000 tuples (8%) done (elapsed 66.04 s, remaining 759.42 s) 2023-07-14T13:01:17.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:17 smithi135 ceph-mon[97338]: pgmap v49: 97 pgs: 97 active+clean; 969 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 36 MiB/s wr, 55 op/s 2023-07-14T13:01:17.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:17 smithi135 ceph-mon[97338]: mgrmap e25: x(active, since 92s), standbys: z, y 2023-07-14T13:01:17.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:17 smithi131 ceph-mon[96953]: pgmap v49: 97 pgs: 97 active+clean; 969 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 36 MiB/s wr, 55 op/s 2023-07-14T13:01:17.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:17 smithi131 ceph-mon[96953]: mgrmap e25: x(active, since 92s), standbys: z, y 2023-07-14T13:01:17.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:17 smithi017 ceph-mon[95536]: pgmap v49: 97 pgs: 97 active+clean; 969 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 36 MiB/s wr, 55 op/s 2023-07-14T13:01:17.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:17 smithi017 ceph-mon[95536]: mgrmap e25: x(active, since 92s), standbys: z, y 2023-07-14T13:01:18.147 INFO:teuthology.orchestra.run.smithi017.stderr:4100000 of 50000000 tuples (8%) done (elapsed 67.75 s, remaining 758.48 s) 2023-07-14T13:01:19.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:19 smithi135 ceph-mon[97338]: pgmap v50: 97 pgs: 97 active+clean; 969 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-07-14T13:01:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:4200000 of 50000000 tuples (8%) done (elapsed 69.10 s, remaining 753.50 s) 2023-07-14T13:01:19.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:19 smithi131 ceph-mon[96953]: pgmap v50: 97 pgs: 97 active+clean; 969 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-07-14T13:01:19.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:19 smithi017 ceph-mon[95536]: pgmap v50: 97 pgs: 97 active+clean; 969 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-07-14T13:01:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.217+0000 7f6e1d59d700 1 -- 172.21.15.17:0/1442480422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e181014a0 msgr2=0x7f6e18101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.217+0000 7f6e1d59d700 1 --2- 172.21.15.17:0/1442480422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e181014a0 0x7f6e18101910 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009990 tx=0x7f6e0c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.217+0000 7f6e1d59d700 1 -- 172.21.15.17:0/1442480422 shutdown_connections 2023-07-14T13:01:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.217+0000 7f6e1d59d700 1 --2- 172.21.15.17:0/1442480422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e18101e50 0x7f6e1810c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.217+0000 7f6e1d59d700 1 --2- 172.21.15.17:0/1442480422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e180ffd20 0x7f6e181000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.217+0000 7f6e1d59d700 1 --2- 172.21.15.17:0/1442480422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e181014a0 0x7f6e18101910 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.217+0000 7f6e1d59d700 1 -- 172.21.15.17:0/1442480422 >> 172.21.15.17:0/1442480422 conn(0x7f6e180fb440 msgr2=0x7f6e180fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.218+0000 7f6e1d59d700 1 -- 172.21.15.17:0/1442480422 shutdown_connections 2023-07-14T13:01:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.218+0000 7f6e1d59d700 1 -- 172.21.15.17:0/1442480422 wait complete. 2023-07-14T13:01:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.218+0000 7f6e1d59d700 1 Processor -- start 2023-07-14T13:01:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.219+0000 7f6e1d59d700 1 -- start start 2023-07-14T13:01:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.219+0000 7f6e1d59d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e180ffd20 0x7f6e1819b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.219+0000 7f6e1d59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e181014a0 0x7f6e1819bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.219+0000 7f6e1d59d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e18101e50 0x7f6e18195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.219+0000 7f6e1d59d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e18195e90 con 0x7f6e18101e50 2023-07-14T13:01:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.219+0000 7f6e1d59d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e18196000 con 0x7f6e180ffd20 2023-07-14T13:01:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.219+0000 7f6e1d59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e181961c0 con 0x7f6e181014a0 2023-07-14T13:01:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.219+0000 7f6e17fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e180ffd20 0x7f6e1819b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e177fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e181014a0 0x7f6e1819bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e1cd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e18101e50 0x7f6e18195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e17fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e180ffd20 0x7f6e1819b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60326/0 (socket says 172.21.15.17:60326) 2023-07-14T13:01:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e17fff700 1 -- 172.21.15.17:0/3203413305 learned_addr learned my addr 172.21.15.17:0/3203413305 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e17fff700 1 -- 172.21.15.17:0/3203413305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e181014a0 msgr2=0x7f6e1819bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e17fff700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e181014a0 0x7f6e1819bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e17fff700 1 -- 172.21.15.17:0/3203413305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e18101e50 msgr2=0x7f6e18195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e17fff700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e18101e50 0x7f6e18195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e17fff700 1 -- 172.21.15.17:0/3203413305 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c0095f0 con 0x7f6e180ffd20 2023-07-14T13:01:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e1cd9c700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e18101e50 0x7f6e18195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e177fe700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e181014a0 0x7f6e1819bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.220+0000 7f6e17fff700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e180ffd20 0x7f6e1819b6f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800e9a0 tx=0x7f6e0800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.221+0000 7f6e157fa700 1 -- 172.21.15.17:0/3203413305 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08009790 con 0x7f6e180ffd20 2023-07-14T13:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.221+0000 7f6e1d59d700 1 -- 172.21.15.17:0/3203413305 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e181964a0 con 0x7f6e180ffd20 2023-07-14T13:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.221+0000 7f6e157fa700 1 -- 172.21.15.17:0/3203413305 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e08010430 con 0x7f6e180ffd20 2023-07-14T13:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.221+0000 7f6e157fa700 1 -- 172.21.15.17:0/3203413305 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800cea0 con 0x7f6e180ffd20 2023-07-14T13:01:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.221+0000 7f6e1d59d700 1 -- 172.21.15.17:0/3203413305 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e181a2790 con 0x7f6e180ffd20 2023-07-14T13:01:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.225+0000 7f6e157fa700 1 -- 172.21.15.17:0/3203413305 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6e080105a0 con 0x7f6e180ffd20 2023-07-14T13:01:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.226+0000 7f6e321ffb80 1 Processor -- start 2023-07-14T13:01:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.226+0000 7f6e321ffb80 1 -- start start 2023-07-14T13:01:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.226+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851de46b0 0x560851f8df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.226+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 0x560851f881a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.226+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851f8e8c0 0x560851f88700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.226+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851e8dc50 con 0x560851f8e470 2023-07-14T13:01:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.226+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851ee09e0 con 0x560851f8e8c0 2023-07-14T13:01:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.226+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851ed9e70 con 0x560851de46b0 2023-07-14T13:01:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.226+0000 7f6e157fa700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e000a1340 0x7f6e000a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.227+0000 7f6e157fa700 1 -- 172.21.15.17:0/3203413305 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6e08014070 con 0x7f6e180ffd20 2023-07-14T13:01:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.227+0000 7f6e17fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 0x560851f881a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.227+0000 7f6e1cd9c700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e000a1340 0x7f6e000a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.227+0000 7f6e17fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 0x560851f881a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50896/0 (socket says 172.21.15.17:50896) 2023-07-14T13:01:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.227+0000 7f6e17fff700 1 -- 172.21.15.17:0/4220741674 learned_addr learned my addr 172.21.15.17:0/4220741674 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.227+0000 7f6e1cd9c700 1 --2- 172.21.15.17:0/4220741674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851de46b0 0x560851f8df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.227+0000 7f6e17fff700 1 -- 172.21.15.17:0/4220741674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851de46b0 msgr2=0x560851f8df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.227+0000 7f6e17fff700 1 --2- 172.21.15.17:0/4220741674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851de46b0 0x560851f8df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.227+0000 7f6e17fff700 1 -- 172.21.15.17:0/4220741674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851f8e8c0 msgr2=0x560851f88700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.227+0000 7f6e17fff700 1 --2- 172.21.15.17:0/4220741674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851f8e8c0 0x560851f88700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.227+0000 7f6e17fff700 1 -- 172.21.15.17:0/4220741674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560851d07d80 con 0x560851f8e470 2023-07-14T13:01:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.228+0000 7f6e1cd9c700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e000a1340 0x7f6e000a37f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e100088f0 tx=0x7f6e10009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.228+0000 7f6e17fff700 1 --2- 172.21.15.17:0/4220741674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 0x560851f881a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6e080969f0 tx=0x7f6e08099ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c5c4e59ef018aa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.228+0000 7f6dfe7fc700 1 -- 172.21.15.17:0/4220741674 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0809dfb0 con 0x560851f8e470 2023-07-14T13:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.228+0000 7f6dfe7fc700 1 -- 172.21.15.17:0/4220741674 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e080a23d0 con 0x560851f8e470 2023-07-14T13:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.228+0000 7f6dfe7fc700 1 -- 172.21.15.17:0/4220741674 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08008220 con 0x560851f8e470 2023-07-14T13:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.229+0000 7f6e321ffb80 1 -- 172.21.15.17:0/4220741674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 msgr2=0x560851f881a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.229+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/4220741674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 0x560851f881a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6e080969f0 tx=0x7f6e08099ac0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.229+0000 7f6e321ffb80 1 -- 172.21.15.17:0/4220741674 shutdown_connections 2023-07-14T13:01:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.229+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/4220741674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851f8e8c0 0x560851f88700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.229+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/4220741674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851de46b0 0x560851f8df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.229+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/4220741674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 0x560851f881a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.229+0000 7f6e321ffb80 1 -- 172.21.15.17:0/4220741674 >> 172.21.15.17:0/4220741674 conn(0x560851f7dd40 msgr2=0x560851f83340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.229+0000 7f6e321ffb80 1 -- 172.21.15.17:0/4220741674 shutdown_connections 2023-07-14T13:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.229+0000 7f6e321ffb80 1 -- 172.21.15.17:0/4220741674 wait complete. 2023-07-14T13:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.230+0000 7f6e321ffb80 1 -- start start 2023-07-14T13:01:20.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.230+0000 7f6e321ffb80 1 Processor -- start 2023-07-14T13:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.230+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f9bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.230+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e470 0x560851f9c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.230+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e8c0 0x560851f95f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.230+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851e79a60 con 0x560851f8e8c0 2023-07-14T13:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.230+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851e79760 con 0x560851de46b0 2023-07-14T13:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.230+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851d5d8c0 con 0x560851f8e470 2023-07-14T13:01:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e321ffb80 10 client.0 _ll_register_callbacks cb 0x560851e77700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e17fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f9bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e177fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e470 0x560851f9c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e17fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f9bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60344/0 (socket says 172.21.15.17:60344) 2023-07-14T13:01:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e177fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e470 0x560851f9c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39606/0 (socket says 172.21.15.17:39606) 2023-07-14T13:01:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e17fff700 1 -- 172.21.15.17:0/3493859116 learned_addr learned my addr 172.21.15.17:0/3493859116 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e1cd9c700 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e8c0 0x560851f95f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e17fff700 1 -- 172.21.15.17:0/3493859116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e470 msgr2=0x560851f9c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e17fff700 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e470 0x560851f9c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e17fff700 1 -- 172.21.15.17:0/3493859116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e8c0 msgr2=0x560851f95f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:20.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e17fff700 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e8c0 0x560851f95f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e17fff700 1 -- 172.21.15.17:0/3493859116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e181a2790 con 0x560851de46b0 2023-07-14T13:01:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.231+0000 7f6e177fe700 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e470 0x560851f9c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.232+0000 7f6e17fff700 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f9bc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e08000c00 tx=0x7f6e0800da90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b00386a7aeef64a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.232+0000 7f6df77fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:01:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.232+0000 7f6df77fe700 1 -- 172.21.15.17:0/3493859116 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08008430 con 0x560851de46b0 2023-07-14T13:01:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.232+0000 7f6df77fe700 1 -- 172.21.15.17:0/3493859116 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6e0809dfb0 con 0x560851de46b0 2023-07-14T13:01:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.232+0000 7f6e321ffb80 1 -- 172.21.15.17:0/3493859116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560851e33490 con 0x560851de46b0 2023-07-14T13:01:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.232+0000 7f6df77fe700 1 -- 172.21.15.17:0/3493859116 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e080b82a0 con 0x560851de46b0 2023-07-14T13:01:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.232+0000 7f6e321ffb80 10 client.25781 fetch_fsmap learned FSMap version 24 2023-07-14T13:01:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.232+0000 7f6e321ffb80 1 -- 172.21.15.17:0/3493859116 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560851cf0c00 con 0x560851de46b0 2023-07-14T13:01:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.232+0000 7f6df77fe700 1 -- 172.21.15.17:0/3493859116 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e0807c080 con 0x560851de46b0 2023-07-14T13:01:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.233+0000 7f6df77fe700 1 -- 172.21.15.17:0/3493859116 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6e08099470 con 0x560851de46b0 2023-07-14T13:01:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.233+0000 7f6e321ffb80 10 client.25781 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:01:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.233+0000 7f6e321ffb80 10 client.25781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.233+0000 7f6e321ffb80 20 client.25781 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.233+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560851fa5df0 0x560851fa8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.233+0000 7f6e321ffb80 4 client.25781 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:01:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.233+0000 7f6e321ffb80 1 -- 172.21.15.17:0/3493859116 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560851ed2e50 con 0x560851fa5df0 2023-07-14T13:01:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.233+0000 7f6e177fe700 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560851fa5df0 0x560851fa8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.234+0000 7f6e177fe700 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560851fa5df0 0x560851fa8200 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0d21bc700f58ead server_cookie=6b1039303ff8a02 in_seq=0 out_seq=0 2023-07-14T13:01:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.234+0000 7f6df77fe700 10 client.25781 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6df77fe700 1 -- 172.21.15.17:0/3493859116 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560851ed2e50 con 0x560851fa5df0 2023-07-14T13:01:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6df77fe700 10 client.25781 handle_command_reply: tid=0 2023-07-14T13:01:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 1 client.25781 shutdown 2023-07-14T13:01:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 1 -- 172.21.15.17:0/3493859116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 msgr2=0x560851f9bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f9bc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e08000c00 tx=0x7f6e0800da90 comp rx=0 tx=0).stop 2023-07-14T13:01:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 1 -- 172.21.15.17:0/3493859116 shutdown_connections 2023-07-14T13:01:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560851fa5df0 0x560851fa8200 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e8c0 0x560851f95f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f9bc90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/3493859116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e470 0x560851f9c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 1 -- 172.21.15.17:0/3493859116 >> 172.21.15.17:0/3493859116 conn(0x560851f7dd40 msgr2=0x560851f82640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6df77fe700 0 client.25781 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 1 -- 172.21.15.17:0/3493859116 shutdown_connections 2023-07-14T13:01:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 1 -- 172.21.15.17:0/3493859116 wait complete. 2023-07-14T13:01:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.235+0000 7f6e321ffb80 20 client.25781 trim_cache size 0 max 16384 2023-07-14T13:01:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.258+0000 7f6e321ffb80 1 Processor -- start 2023-07-14T13:01:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.258+0000 7f6e321ffb80 1 -- start start 2023-07-14T13:01:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.258+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f96080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.258+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 0x560851f95210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.258+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e8c0 0x560851f881a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.258+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851f88f70 con 0x560851f8e470 2023-07-14T13:01:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.258+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851f84c30 con 0x560851de46b0 2023-07-14T13:01:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.258+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851f8d1d0 con 0x560851f8e8c0 2023-07-14T13:01:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e177fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 0x560851f95210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e17fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f96080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e1cd9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e8c0 0x560851f881a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e17fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f96080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60346/0 (socket says 172.21.15.17:60346) 2023-07-14T13:01:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e17fff700 1 -- 172.21.15.17:0/57579806 learned_addr learned my addr 172.21.15.17:0/57579806 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e17fff700 1 -- 172.21.15.17:0/57579806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e8c0 msgr2=0x560851f881a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e17fff700 1 --2- 172.21.15.17:0/57579806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e8c0 0x560851f881a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e17fff700 1 -- 172.21.15.17:0/57579806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 msgr2=0x560851f95210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e17fff700 1 --2- 172.21.15.17:0/57579806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 0x560851f95210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e17fff700 1 -- 172.21.15.17:0/57579806 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560851d2e1f0 con 0x560851de46b0 2023-07-14T13:01:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e1cd9c700 1 --2- 172.21.15.17:0/57579806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e8c0 0x560851f881a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e177fe700 1 --2- 172.21.15.17:0/57579806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 0x560851f95210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.259+0000 7f6e17fff700 1 --2- 172.21.15.17:0/57579806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f96080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e080969f0 tx=0x7f6e0800dbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93fe73707ca2535e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.260+0000 7f6dfeffd700 1 -- 172.21.15.17:0/57579806 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e080998e0 con 0x560851de46b0 2023-07-14T13:01:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.260+0000 7f6dfeffd700 1 -- 172.21.15.17:0/57579806 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560851e33490 con 0x560851de46b0 2023-07-14T13:01:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.260+0000 7f6dfeffd700 1 -- 172.21.15.17:0/57579806 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e080ca170 con 0x560851de46b0 2023-07-14T13:01:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.260+0000 7f6e321ffb80 1 -- 172.21.15.17:0/57579806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 msgr2=0x560851f96080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.260+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/57579806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f96080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e080969f0 tx=0x7f6e0800dbb0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.261+0000 7f6e321ffb80 1 -- 172.21.15.17:0/57579806 shutdown_connections 2023-07-14T13:01:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.261+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/57579806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e8c0 0x560851f881a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.261+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/57579806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851de46b0 0x560851f96080 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.261+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/57579806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851f8e470 0x560851f95210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.261+0000 7f6e321ffb80 1 -- 172.21.15.17:0/57579806 >> 172.21.15.17:0/57579806 conn(0x560851f7dd40 msgr2=0x560851f89a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.261+0000 7f6e321ffb80 1 -- 172.21.15.17:0/57579806 shutdown_connections 2023-07-14T13:01:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.261+0000 7f6e321ffb80 1 -- 172.21.15.17:0/57579806 wait complete. 2023-07-14T13:01:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.261+0000 7f6e321ffb80 1 -- start start 2023-07-14T13:01:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.261+0000 7f6e321ffb80 1 Processor -- start 2023-07-14T13:01:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851de46b0 0x560851f998f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851f8e470 0x560851f99e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e321ffb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e8c0 0x560851ff8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851f9a5a0 con 0x560851de46b0 2023-07-14T13:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851f9a710 con 0x560851f8e470 2023-07-14T13:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e321ffb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560851ff91f0 con 0x560851f8e8c0 2023-07-14T13:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e321ffb80 10 client.0 _ll_register_callbacks cb 0x7f6e08099d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e177fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851f8e470 0x560851f99e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e17fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851de46b0 0x560851f998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e177fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851f8e470 0x560851f99e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60348/0 (socket says 172.21.15.17:60348) 2023-07-14T13:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e177fe700 1 -- 172.21.15.17:0/662507909 learned_addr learned my addr 172.21.15.17:0/662507909 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.262+0000 7f6e1cd9c700 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e8c0 0x560851ff8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.263+0000 7f6e177fe700 1 -- 172.21.15.17:0/662507909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e8c0 msgr2=0x560851ff8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.263+0000 7f6e177fe700 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e8c0 0x560851ff8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.263+0000 7f6e177fe700 1 -- 172.21.15.17:0/662507909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851de46b0 msgr2=0x560851f998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.263+0000 7f6e177fe700 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851de46b0 0x560851f998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.263+0000 7f6e177fe700 1 -- 172.21.15.17:0/662507909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1810d1a0 con 0x560851f8e470 2023-07-14T13:01:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.263+0000 7f6e177fe700 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851f8e470 0x560851f99e30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005910 tx=0x7f6e0c00be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb07400925e0e0d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.263+0000 7f6df77fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:01:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.264+0000 7f6df77fe700 1 -- 172.21.15.17:0/662507909 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c01d040 con 0x560851f8e470 2023-07-14T13:01:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.264+0000 7f6df77fe700 1 -- 172.21.15.17:0/662507909 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6e0c028b30 con 0x560851f8e470 2023-07-14T13:01:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.264+0000 7f6e321ffb80 1 -- 172.21.15.17:0/662507909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e080a23d0 con 0x560851f8e470 2023-07-14T13:01:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.264+0000 7f6df77fe700 1 -- 172.21.15.17:0/662507909 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e0c028cf0 con 0x560851f8e470 2023-07-14T13:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.264+0000 7f6e321ffb80 10 client.25787 fetch_fsmap learned FSMap version 24 2023-07-14T13:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.264+0000 7f6e321ffb80 1 -- 172.21.15.17:0/662507909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f6e10008d60 con 0x560851f8e470 2023-07-14T13:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.264+0000 7f6df77fe700 1 -- 172.21.15.17:0/662507909 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e080a23d0 con 0x560851f8e470 2023-07-14T13:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.264+0000 7f6df77fe700 1 -- 172.21.15.17:0/662507909 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 24) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6e0c005370 con 0x560851f8e470 2023-07-14T13:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.265+0000 7f6e321ffb80 10 client.25787 fetch_fsmap finished waiting for FSMap version 24 2023-07-14T13:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.265+0000 7f6e321ffb80 10 client.25787 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.265+0000 7f6e321ffb80 20 client.25787 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.265+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560851ffaa90 0x560851ffcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.265+0000 7f6e321ffb80 4 client.25787 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:01:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.265+0000 7f6e321ffb80 1 -- 172.21.15.17:0/662507909 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560851e94ff0 con 0x560851ffaa90 2023-07-14T13:01:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.265+0000 7f6e17fff700 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560851ffaa90 0x560851ffcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.266+0000 7f6e17fff700 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560851ffaa90 0x560851ffcea0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=123a90c2bd01f5b8 server_cookie=bdf1feccbd595e49 in_seq=0 out_seq=0 2023-07-14T13:01:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.266+0000 7f6df77fe700 10 client.25787 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6df77fe700 1 -- 172.21.15.17:0/662507909 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560851e94ff0 con 0x560851ffaa90 2023-07-14T13:01:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6df77fe700 10 client.25787 handle_command_reply: tid=0 2023-07-14T13:01:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6e321ffb80 1 client.25787 shutdown 2023-07-14T13:01:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6e321ffb80 1 -- 172.21.15.17:0/662507909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851f8e470 msgr2=0x560851f99e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851f8e470 0x560851f99e30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005910 tx=0x7f6e0c00be40 comp rx=0 tx=0).stop 2023-07-14T13:01:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6e321ffb80 1 -- 172.21.15.17:0/662507909 shutdown_connections 2023-07-14T13:01:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560851ffaa90 0x560851ffcea0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560851f8e8c0 0x560851ff8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560851de46b0 0x560851f998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6df77fe700 0 client.25787 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6e321ffb80 1 --2- 172.21.15.17:0/662507909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560851f8e470 0x560851f99e30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6e321ffb80 1 -- 172.21.15.17:0/662507909 >> 172.21.15.17:0/662507909 conn(0x560851f7dd40 msgr2=0x560851f8a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6e321ffb80 1 -- 172.21.15.17:0/662507909 shutdown_connections 2023-07-14T13:01:20.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.283+0000 7f6e321ffb80 1 -- 172.21.15.17:0/662507909 wait complete. 2023-07-14T13:01:20.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.284+0000 7f6e321ffb80 20 client.25787 trim_cache size 0 max 16384 2023-07-14T13:01:20.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:01:20.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:01:20.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:01:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:01:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.284+0000 7f6e1d59d700 1 -- 172.21.15.17:0/3203413305 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e000a1340 msgr2=0x7f6e000a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.284+0000 7f6e1d59d700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e000a1340 0x7f6e000a37f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e100088f0 tx=0x7f6e10009920 comp rx=0 tx=0).stop 2023-07-14T13:01:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.284+0000 7f6e1d59d700 1 -- 172.21.15.17:0/3203413305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e180ffd20 msgr2=0x7f6e1819b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.284+0000 7f6e1d59d700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e180ffd20 0x7f6e1819b6f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800e9a0 tx=0x7f6e0800ecb0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.284+0000 7f6e1d59d700 1 -- 172.21.15.17:0/3203413305 shutdown_connections 2023-07-14T13:01:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.284+0000 7f6e1d59d700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e000a1340 0x7f6e000a37f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.284+0000 7f6e1d59d700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e18101e50 0x7f6e18195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.284+0000 7f6e1d59d700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e180ffd20 0x7f6e1819b6f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.284+0000 7f6e1d59d700 1 --2- 172.21.15.17:0/3203413305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e181014a0 0x7f6e1819bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.284+0000 7f6e1d59d700 1 -- 172.21.15.17:0/3203413305 >> 172.21.15.17:0/3203413305 conn(0x7f6e180fb440 msgr2=0x7f6e180fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.285+0000 7f6e1d59d700 1 -- 172.21.15.17:0/3203413305 shutdown_connections 2023-07-14T13:01:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:20.285+0000 7f6e1d59d700 1 -- 172.21.15.17:0/3203413305 wait complete. 2023-07-14T13:01:21.361 INFO:teuthology.orchestra.run.smithi017.stderr:4300000 of 50000000 tuples (8%) done (elapsed 70.97 s, remaining 754.21 s) 2023-07-14T13:01:21.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:21 smithi135 ceph-mon[97338]: pgmap v51: 97 pgs: 97 active+clean; 992 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 35 op/s 2023-07-14T13:01:21.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:21 smithi131 ceph-mon[96953]: pgmap v51: 97 pgs: 97 active+clean; 992 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 35 op/s 2023-07-14T13:01:21.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:21 smithi017 ceph-mon[95536]: pgmap v51: 97 pgs: 97 active+clean; 992 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 35 op/s 2023-07-14T13:01:23.244 INFO:teuthology.orchestra.run.smithi017.stderr:4400000 of 50000000 tuples (8%) done (elapsed 72.85 s, remaining 754.98 s) 2023-07-14T13:01:23.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:23 smithi135 ceph-mon[97338]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-14T13:01:23.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:23 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:01:23.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:23 smithi131 ceph-mon[96953]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-14T13:01:23.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:23 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:01:23.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:23 smithi017 ceph-mon[95536]: pgmap v52: 97 pgs: 97 active+clean; 1.0 GiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-14T13:01:23.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:23 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:01:24.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:24 smithi135 ceph-mon[97338]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:01:24.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:24 smithi131 ceph-mon[96953]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:01:24.578 INFO:teuthology.orchestra.run.smithi017.stderr:4500000 of 50000000 tuples (9%) done (elapsed 74.18 s, remaining 750.07 s) 2023-07-14T13:01:24.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:24 smithi017 ceph-mon[95536]: pgmap v53: 97 pgs: 97 active+clean; 1.0 GiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:01:26.445 INFO:teuthology.orchestra.run.smithi017.stderr:4600000 of 50000000 tuples (9%) done (elapsed 76.05 s, remaining 750.58 s) 2023-07-14T13:01:27.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:26 smithi131 ceph-mon[96953]: pgmap v54: 97 pgs: 97 active+clean; 1.1 GiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 34 MiB/s wr, 41 op/s 2023-07-14T13:01:27.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:26 smithi017 ceph-mon[95536]: pgmap v54: 97 pgs: 97 active+clean; 1.1 GiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 34 MiB/s wr, 41 op/s 2023-07-14T13:01:27.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:26 smithi135 ceph-mon[97338]: pgmap v54: 97 pgs: 97 active+clean; 1.1 GiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 34 MiB/s wr, 41 op/s 2023-07-14T13:01:28.604 INFO:teuthology.orchestra.run.smithi017.stderr:4700000 of 50000000 tuples (9%) done (elapsed 78.21 s, remaining 753.79 s) 2023-07-14T13:01:29.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:28 smithi131 ceph-mon[96953]: pgmap v55: 97 pgs: 97 active+clean; 1.1 GiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:01:29.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:28 smithi017 ceph-mon[95536]: pgmap v55: 97 pgs: 97 active+clean; 1.1 GiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:01:29.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:28 smithi135 ceph-mon[97338]: pgmap v55: 97 pgs: 97 active+clean; 1.1 GiB data, 799 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:01:29.795 INFO:teuthology.orchestra.run.smithi017.stderr:4800000 of 50000000 tuples (9%) done (elapsed 79.40 s, remaining 747.68 s) 2023-07-14T13:01:31.247 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:30 smithi131 ceph-mon[96953]: pgmap v56: 97 pgs: 97 active+clean; 1.1 GiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 MiB/s wr, 30 op/s 2023-07-14T13:01:31.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:30 smithi017 ceph-mon[95536]: pgmap v56: 97 pgs: 97 active+clean; 1.1 GiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 MiB/s wr, 30 op/s 2023-07-14T13:01:31.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:30 smithi135 ceph-mon[97338]: pgmap v56: 97 pgs: 97 active+clean; 1.1 GiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 28 MiB/s wr, 30 op/s 2023-07-14T13:01:31.554 INFO:teuthology.orchestra.run.smithi017.stderr:4900000 of 50000000 tuples (9%) done (elapsed 81.16 s, remaining 746.99 s) 2023-07-14T13:01:33.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:32 smithi017 ceph-mon[95536]: pgmap v57: 97 pgs: 97 active+clean; 1.1 GiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 29 MiB/s wr, 32 op/s 2023-07-14T13:01:33.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:32 smithi135 ceph-mon[97338]: pgmap v57: 97 pgs: 97 active+clean; 1.1 GiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 29 MiB/s wr, 32 op/s 2023-07-14T13:01:33.454 INFO:teuthology.orchestra.run.smithi017.stderr:5000000 of 50000000 tuples (10%) done (elapsed 83.06 s, remaining 747.53 s) 2023-07-14T13:01:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.439+0000 7f313d39d700 1 -- 172.21.15.17:0/46514496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31381062b0 msgr2=0x7f3138067940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.439+0000 7f313d39d700 1 --2- 172.21.15.17:0/46514496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31381062b0 0x7f3138067940 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f312c009990 tx=0x7f312c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.439+0000 7f313d39d700 1 -- 172.21.15.17:0/46514496 shutdown_connections 2023-07-14T13:01:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.439+0000 7f313d39d700 1 --2- 172.21.15.17:0/46514496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3138068070 0x7f313810c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.439+0000 7f313d39d700 1 --2- 172.21.15.17:0/46514496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31381059a0 0x7f3138105d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.439+0000 7f313d39d700 1 --2- 172.21.15.17:0/46514496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31381062b0 0x7f3138067940 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.439+0000 7f313d39d700 1 -- 172.21.15.17:0/46514496 >> 172.21.15.17:0/46514496 conn(0x7f3138074770 msgr2=0x7f3138074b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.439+0000 7f313d39d700 1 -- 172.21.15.17:0/46514496 shutdown_connections 2023-07-14T13:01:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.439+0000 7f313d39d700 1 -- 172.21.15.17:0/46514496 wait complete. 2023-07-14T13:01:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.440+0000 7f313d39d700 1 Processor -- start 2023-07-14T13:01:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.441+0000 7f313d39d700 1 -- start start 2023-07-14T13:01:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.441+0000 7f313d39d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3138068070 0x7f313819da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.441+0000 7f313d39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31381059a0 0x7f313819df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.441+0000 7f313d39d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31381062b0 0x7f3138197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.441+0000 7f313d39d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31381980f0 con 0x7f3138068070 2023-07-14T13:01:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.441+0000 7f313d39d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3138198260 con 0x7f31381062b0 2023-07-14T13:01:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.441+0000 7f313d39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3138198420 con 0x7f31381059a0 2023-07-14T13:01:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.441+0000 7f3137fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3138068070 0x7f313819da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.442+0000 7f31377fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31381059a0 0x7f313819df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.442+0000 7f31377fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31381059a0 0x7f313819df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58708/0 (socket says 172.21.15.17:58708) 2023-07-14T13:01:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.442+0000 7f31377fe700 1 -- 172.21.15.17:0/1009325085 learned_addr learned my addr 172.21.15.17:0/1009325085 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.442+0000 7f313cb9c700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31381062b0 0x7f3138197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.442+0000 7f3137fff700 1 -- 172.21.15.17:0/1009325085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31381059a0 msgr2=0x7f313819df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.442+0000 7f3137fff700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31381059a0 0x7f313819df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.442+0000 7f3137fff700 1 -- 172.21.15.17:0/1009325085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31381062b0 msgr2=0x7f3138197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.442+0000 7f3137fff700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31381062b0 0x7f3138197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.442+0000 7f3137fff700 1 -- 172.21.15.17:0/1009325085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c0095f0 con 0x7f3138068070 2023-07-14T13:01:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.442+0000 7f3137fff700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3138068070 0x7f313819da10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f312800e9f0 tx=0x7f312800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.443+0000 7f31357fa700 1 -- 172.21.15.17:0/1009325085 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312800c9c0 con 0x7f3138068070 2023-07-14T13:01:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.443+0000 7f31357fa700 1 -- 172.21.15.17:0/1009325085 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3128010430 con 0x7f3138068070 2023-07-14T13:01:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.443+0000 7f31357fa700 1 -- 172.21.15.17:0/1009325085 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128018680 con 0x7f3138068070 2023-07-14T13:01:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.443+0000 7f313d39d700 1 -- 172.21.15.17:0/1009325085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3138198700 con 0x7f3138068070 2023-07-14T13:01:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.443+0000 7f313d39d700 1 -- 172.21.15.17:0/1009325085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31381a4a00 con 0x7f3138068070 2023-07-14T13:01:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.447+0000 7f31357fa700 1 -- 172.21.15.17:0/1009325085 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f31280105a0 con 0x7f3138068070 2023-07-14T13:01:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.448+0000 7f3151fb0b80 1 Processor -- start 2023-07-14T13:01:33.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.448+0000 7f3151fb0b80 1 -- start start 2023-07-14T13:01:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f31357fa700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f31200a1340 0x7f31200a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 0x55acd1d6ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1d70470 0x55acd1d6a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 0x55acd1d6a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1c6fc50 con 0x55acd1d70470 2023-07-14T13:01:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f31357fa700 1 -- 172.21.15.17:0/1009325085 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3128014070 con 0x7f3138068070 2023-07-14T13:01:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1cc29e0 con 0x55acd1d708c0 2023-07-14T13:01:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1cbbe70 con 0x55acd1bc66b0 2023-07-14T13:01:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f313cb9c700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f31200a1340 0x7f31200a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f313cb9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 0x55acd1d6a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f313cb9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 0x55acd1d6a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40094/0 (socket says 172.21.15.17:40094) 2023-07-14T13:01:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.449+0000 7f313cb9c700 1 -- 172.21.15.17:0/3795220603 learned_addr learned my addr 172.21.15.17:0/3795220603 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.450+0000 7f3137fff700 1 --2- 172.21.15.17:0/3795220603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 0x55acd1d6ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.450+0000 7f31377fe700 1 --2- 172.21.15.17:0/3795220603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1d70470 0x55acd1d6a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.450+0000 7f313cb9c700 1 -- 172.21.15.17:0/3795220603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 msgr2=0x55acd1d6ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.450+0000 7f313cb9c700 1 --2- 172.21.15.17:0/3795220603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 0x55acd1d6ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.450+0000 7f313cb9c700 1 -- 172.21.15.17:0/3795220603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1d70470 msgr2=0x55acd1d6a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.450+0000 7f313cb9c700 1 --2- 172.21.15.17:0/3795220603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1d70470 0x55acd1d6a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.450+0000 7f313cb9c700 1 -- 172.21.15.17:0/3795220603 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acd1ae9d80 con 0x55acd1d708c0 2023-07-14T13:01:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.450+0000 7f3137fff700 1 --2- 172.21.15.17:0/3795220603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 0x55acd1d6ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.450+0000 7f313cb9c700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f31200a1340 0x7f31200a37f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3130008c60 tx=0x7f3130009350 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:33.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.450+0000 7f313cb9c700 1 --2- 172.21.15.17:0/3795220603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 0x55acd1d6a700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3130009fc0 tx=0x7f313001d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b334552994ce724 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:33.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.451+0000 7f311e7fc700 1 -- 172.21.15.17:0/3795220603 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000e070 con 0x55acd1d708c0 2023-07-14T13:01:33.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.451+0000 7f311e7fc700 1 -- 172.21.15.17:0/3795220603 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f313000f040 con 0x55acd1d708c0 2023-07-14T13:01:33.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.451+0000 7f311e7fc700 1 -- 172.21.15.17:0/3795220603 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313001b970 con 0x55acd1d708c0 2023-07-14T13:01:33.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.452+0000 7f3151fb0b80 1 -- 172.21.15.17:0/3795220603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 msgr2=0x55acd1d6a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:33.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.452+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/3795220603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 0x55acd1d6a700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3130009fc0 tx=0x7f313001d000 comp rx=0 tx=0).stop 2023-07-14T13:01:33.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.452+0000 7f3151fb0b80 1 -- 172.21.15.17:0/3795220603 shutdown_connections 2023-07-14T13:01:33.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.452+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/3795220603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 0x55acd1d6a700 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.452+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/3795220603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 0x55acd1d6ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.452+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/3795220603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1d70470 0x55acd1d6a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.452+0000 7f3151fb0b80 1 -- 172.21.15.17:0/3795220603 >> 172.21.15.17:0/3795220603 conn(0x55acd1d5fd40 msgr2=0x55acd1d65340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.452+0000 7f3151fb0b80 1 -- 172.21.15.17:0/3795220603 shutdown_connections 2023-07-14T13:01:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.452+0000 7f3151fb0b80 1 -- 172.21.15.17:0/3795220603 wait complete. 2023-07-14T13:01:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.452+0000 7f3151fb0b80 1 -- start start 2023-07-14T13:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.453+0000 7f3151fb0b80 1 Processor -- start 2023-07-14T13:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.453+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 0x55acd1d79770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.453+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d79cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.453+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1d708c0 0x55acd1d73a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.453+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1c5ba60 con 0x55acd1bc66b0 2023-07-14T13:01:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.453+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1c5b760 con 0x55acd1d70470 2023-07-14T13:01:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.453+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1b3f8c0 con 0x55acd1d708c0 2023-07-14T13:01:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.453+0000 7f3151fb0b80 10 client.0 _ll_register_callbacks cb 0x55acd1c59700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f3137fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 0x55acd1d79770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f31377fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d79cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f3137fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 0x55acd1d79770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37144/0 (socket says 172.21.15.17:37144) 2023-07-14T13:01:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f31377fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d79cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40100/0 (socket says 172.21.15.17:40100) 2023-07-14T13:01:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f3137fff700 1 -- 172.21.15.17:0/947809388 learned_addr learned my addr 172.21.15.17:0/947809388 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f313cb9c700 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1d708c0 0x55acd1d73a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f31377fe700 1 -- 172.21.15.17:0/947809388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1d708c0 msgr2=0x55acd1d73a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f31377fe700 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1d708c0 0x55acd1d73a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f31377fe700 1 -- 172.21.15.17:0/947809388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 msgr2=0x55acd1d79770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f31377fe700 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 0x55acd1d79770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f31377fe700 1 -- 172.21.15.17:0/947809388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31381a4a00 con 0x55acd1d70470 2023-07-14T13:01:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f3137fff700 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 0x55acd1d79770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f313cb9c700 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1d708c0 0x55acd1d73a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f31377fe700 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d79cb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f312c006010 tx=0x7f312c0057e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad0b9dba7714c61a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.454+0000 7f31177fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:01:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.455+0000 7f31177fe700 1 -- 172.21.15.17:0/947809388 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c01d070 con 0x55acd1d70470 2023-07-14T13:01:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.455+0000 7f3151fb0b80 1 -- 172.21.15.17:0/947809388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55acd1c15490 con 0x55acd1d70470 2023-07-14T13:01:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.455+0000 7f31177fe700 1 -- 172.21.15.17:0/947809388 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f312c004500 con 0x55acd1d70470 2023-07-14T13:01:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.455+0000 7f31177fe700 1 -- 172.21.15.17:0/947809388 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f312c0046c0 con 0x55acd1d70470 2023-07-14T13:01:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.455+0000 7f3151fb0b80 10 client.25799 fetch_fsmap learned FSMap version 25 2023-07-14T13:01:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.455+0000 7f3151fb0b80 1 -- 172.21.15.17:0/947809388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f3130008da0 con 0x55acd1d70470 2023-07-14T13:01:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.455+0000 7f31177fe700 1 -- 172.21.15.17:0/947809388 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55acd1c15490 con 0x55acd1d70470 2023-07-14T13:01:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.456+0000 7f31177fe700 1 -- 172.21.15.17:0/947809388 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f312c00f6c0 con 0x55acd1d70470 2023-07-14T13:01:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.456+0000 7f3151fb0b80 10 client.25799 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:01:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.456+0000 7f3151fb0b80 10 client.25799 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.456+0000 7f3151fb0b80 20 client.25799 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.456+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55acd1d83c90 0x55acd1d860a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.456+0000 7f3151fb0b80 4 client.25799 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.456+0000 7f3151fb0b80 1 -- 172.21.15.17:0/947809388 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55acd1cb4e50 con 0x55acd1d83c90 2023-07-14T13:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.456+0000 7f3137fff700 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55acd1d83c90 0x55acd1d860a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.457+0000 7f3137fff700 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55acd1d83c90 0x55acd1d860a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94d015d77f55fafb server_cookie=70427abcf807ed07 in_seq=0 out_seq=0 2023-07-14T13:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.457+0000 7f31177fe700 10 client.25799 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f31177fe700 1 -- 172.21.15.17:0/947809388 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55acd1cb4e50 con 0x55acd1d83c90 2023-07-14T13:01:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f31177fe700 10 client.25799 handle_command_reply: tid=0 2023-07-14T13:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f3151fb0b80 1 client.25799 shutdown 2023-07-14T13:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f3151fb0b80 1 -- 172.21.15.17:0/947809388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 msgr2=0x55acd1d79cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d79cb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f312c006010 tx=0x7f312c0057e0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f3151fb0b80 1 -- 172.21.15.17:0/947809388 shutdown_connections 2023-07-14T13:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55acd1d83c90 0x55acd1d860a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1d708c0 0x55acd1d73a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 0x55acd1d79770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/947809388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d79cb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f31177fe700 0 client.25799 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f3151fb0b80 1 -- 172.21.15.17:0/947809388 >> 172.21.15.17:0/947809388 conn(0x55acd1d5fd40 msgr2=0x55acd1d64640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f3151fb0b80 1 -- 172.21.15.17:0/947809388 shutdown_connections 2023-07-14T13:01:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.458+0000 7f3151fb0b80 1 -- 172.21.15.17:0/947809388 wait complete. 2023-07-14T13:01:33.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:32 smithi131 ceph-mon[96953]: pgmap v57: 97 pgs: 97 active+clean; 1.1 GiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 29 MiB/s wr, 32 op/s 2023-07-14T13:01:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.459+0000 7f3151fb0b80 20 client.25799 trim_cache size 0 max 16384 2023-07-14T13:01:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.479+0000 7f3151fb0b80 1 Processor -- start 2023-07-14T13:01:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.479+0000 7f3151fb0b80 1 -- start start 2023-07-14T13:01:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 0x55acd1d73b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d6a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1d708c0 0x55acd1d71410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1cb4e50 con 0x55acd1bc66b0 2023-07-14T13:01:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1d812f0 con 0x55acd1d70470 2023-07-14T13:01:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1d66770 con 0x55acd1d708c0 2023-07-14T13:01:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f3137fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 0x55acd1d73b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f31377fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d6a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f313cb9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1d708c0 0x55acd1d71410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f31377fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d6a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40106/0 (socket says 172.21.15.17:40106) 2023-07-14T13:01:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f3137fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 0x55acd1d73b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37148/0 (socket says 172.21.15.17:37148) 2023-07-14T13:01:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.480+0000 7f31377fe700 1 -- 172.21.15.17:0/3575855410 learned_addr learned my addr 172.21.15.17:0/3575855410 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.481+0000 7f31377fe700 1 -- 172.21.15.17:0/3575855410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1d708c0 msgr2=0x55acd1d71410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.481+0000 7f31377fe700 1 --2- 172.21.15.17:0/3575855410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1d708c0 0x55acd1d71410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.481+0000 7f31377fe700 1 -- 172.21.15.17:0/3575855410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 msgr2=0x55acd1d73b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.481+0000 7f31377fe700 1 --2- 172.21.15.17:0/3575855410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 0x55acd1d73b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.481+0000 7f31377fe700 1 -- 172.21.15.17:0/3575855410 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acd1ad2c00 con 0x55acd1d70470 2023-07-14T13:01:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.481+0000 7f31377fe700 1 --2- 172.21.15.17:0/3575855410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d6a1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f312c005d10 tx=0x7f312c010f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c244a4ff4992cc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.481+0000 7f311effd700 1 -- 172.21.15.17:0/3575855410 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c01d050 con 0x55acd1d70470 2023-07-14T13:01:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.481+0000 7f311effd700 1 -- 172.21.15.17:0/3575855410 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f312c01e040 con 0x55acd1d70470 2023-07-14T13:01:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.481+0000 7f311effd700 1 -- 172.21.15.17:0/3575855410 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c023540 con 0x55acd1d70470 2023-07-14T13:01:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.482+0000 7f3151fb0b80 1 -- 172.21.15.17:0/3575855410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 msgr2=0x55acd1d6a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.482+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/3575855410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d6a1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f312c005d10 tx=0x7f312c010f90 comp rx=0 tx=0).stop 2023-07-14T13:01:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.482+0000 7f3151fb0b80 1 -- 172.21.15.17:0/3575855410 shutdown_connections 2023-07-14T13:01:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.482+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/3575855410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1d708c0 0x55acd1d71410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.482+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/3575855410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1bc66b0 0x55acd1d73b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.482+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/3575855410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d70470 0x55acd1d6a1a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.482+0000 7f3151fb0b80 1 -- 172.21.15.17:0/3575855410 >> 172.21.15.17:0/3575855410 conn(0x55acd1d5fd40 msgr2=0x55acd1d70d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.482+0000 7f3151fb0b80 1 -- 172.21.15.17:0/3575855410 shutdown_connections 2023-07-14T13:01:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.482+0000 7f3151fb0b80 1 -- 172.21.15.17:0/3575855410 wait complete. 2023-07-14T13:01:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.483+0000 7f3151fb0b80 1 -- start start 2023-07-14T13:01:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.483+0000 7f3151fb0b80 1 Processor -- start 2023-07-14T13:01:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.483+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 0x55acd1d77320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.483+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1d70470 0x55acd1d77860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3151fb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 0x55acd1d77da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1dd6b50 con 0x55acd1d70470 2023-07-14T13:01:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1dd6c90 con 0x55acd1d708c0 2023-07-14T13:01:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3151fb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd1dd6dd0 con 0x55acd1bc66b0 2023-07-14T13:01:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3151fb0b80 10 client.0 _ll_register_callbacks cb 0x7f312c005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f31377fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1d70470 0x55acd1d77860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3137fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 0x55acd1d77320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3137fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 0x55acd1d77320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58756/0 (socket says 172.21.15.17:58756) 2023-07-14T13:01:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3137fff700 1 -- 172.21.15.17:0/2375583967 learned_addr learned my addr 172.21.15.17:0/2375583967 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f313cb9c700 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 0x55acd1d77da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3137fff700 1 -- 172.21.15.17:0/2375583967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 msgr2=0x55acd1d77da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3137fff700 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 0x55acd1d77da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3137fff700 1 -- 172.21.15.17:0/2375583967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1d70470 msgr2=0x55acd1d77860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3137fff700 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1d70470 0x55acd1d77860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.484+0000 7f3137fff700 1 -- 172.21.15.17:0/2375583967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3130008da0 con 0x55acd1bc66b0 2023-07-14T13:01:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.485+0000 7f3137fff700 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 0x55acd1d77320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f31280968a0 tx=0x7f31280caa10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad6aef8c5980e330 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.485+0000 7f31177fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:01:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.485+0000 7f31177fe700 1 -- 172.21.15.17:0/2375583967 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128099520 con 0x55acd1bc66b0 2023-07-14T13:01:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.485+0000 7f3151fb0b80 1 -- 172.21.15.17:0/2375583967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f313000f040 con 0x55acd1bc66b0 2023-07-14T13:01:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.485+0000 7f31177fe700 1 -- 172.21.15.17:0/2375583967 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f312809de60 con 0x55acd1bc66b0 2023-07-14T13:01:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.485+0000 7f31177fe700 1 -- 172.21.15.17:0/2375583967 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31280b8210 con 0x55acd1bc66b0 2023-07-14T13:01:33.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.485+0000 7f3151fb0b80 10 client.25774 fetch_fsmap learned FSMap version 25 2023-07-14T13:01:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.485+0000 7f3151fb0b80 1 -- 172.21.15.17:0/2375583967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55acd1b101f0 con 0x55acd1bc66b0 2023-07-14T13:01:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.485+0000 7f31177fe700 1 -- 172.21.15.17:0/2375583967 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f313000f040 con 0x55acd1bc66b0 2023-07-14T13:01:33.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.485+0000 7f31177fe700 1 -- 172.21.15.17:0/2375583967 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f312800cb20 con 0x55acd1bc66b0 2023-07-14T13:01:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.485+0000 7f3151fb0b80 10 client.25774 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:01:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.486+0000 7f3151fb0b80 10 client.25774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.486+0000 7f3151fb0b80 20 client.25774 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.486+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55acd1dd8480 0x55acd1dda890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.486+0000 7f3151fb0b80 4 client.25774 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:01:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.486+0000 7f3151fb0b80 1 -- 172.21.15.17:0/2375583967 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55acd1c76ff0 con 0x55acd1dd8480 2023-07-14T13:01:33.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.486+0000 7f31377fe700 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55acd1dd8480 0x55acd1dda890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.486+0000 7f31377fe700 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55acd1dd8480 0x55acd1dda890 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccfbf86230f35514 server_cookie=b68a290176ee675d in_seq=0 out_seq=0 2023-07-14T13:01:33.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.486+0000 7f31177fe700 10 client.25774 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f31177fe700 1 -- 172.21.15.17:0/2375583967 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55acd1c76ff0 con 0x55acd1dd8480 2023-07-14T13:01:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f31177fe700 10 client.25774 handle_command_reply: tid=0 2023-07-14T13:01:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f3151fb0b80 1 client.25774 shutdown 2023-07-14T13:01:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f3151fb0b80 1 -- 172.21.15.17:0/2375583967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 msgr2=0x55acd1d77320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 0x55acd1d77320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f31280968a0 tx=0x7f31280caa10 comp rx=0 tx=0).stop 2023-07-14T13:01:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f3151fb0b80 1 -- 172.21.15.17:0/2375583967 shutdown_connections 2023-07-14T13:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55acd1dd8480 0x55acd1dda890 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55acd1d708c0 0x55acd1d77da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acd1bc66b0 0x55acd1d77320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f31177fe700 0 client.25774 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f3151fb0b80 1 --2- 172.21.15.17:0/2375583967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55acd1d70470 0x55acd1d77860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f3151fb0b80 1 -- 172.21.15.17:0/2375583967 >> 172.21.15.17:0/2375583967 conn(0x55acd1d5fd40 msgr2=0x55acd1d73970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f3151fb0b80 1 -- 172.21.15.17:0/2375583967 shutdown_connections 2023-07-14T13:01:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.502+0000 7f3151fb0b80 1 -- 172.21.15.17:0/2375583967 wait complete. 2023-07-14T13:01:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.503+0000 7f3151fb0b80 20 client.25774 trim_cache size 0 max 16384 2023-07-14T13:01:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:01:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:01:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:01:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:01:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.503+0000 7f313d39d700 1 -- 172.21.15.17:0/1009325085 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f31200a1340 msgr2=0x7f31200a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.503+0000 7f313d39d700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f31200a1340 0x7f31200a37f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3130008c60 tx=0x7f3130009350 comp rx=0 tx=0).stop 2023-07-14T13:01:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.503+0000 7f313d39d700 1 -- 172.21.15.17:0/1009325085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3138068070 msgr2=0x7f313819da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.503+0000 7f313d39d700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3138068070 0x7f313819da10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f312800e9f0 tx=0x7f312800ed00 comp rx=0 tx=0).stop 2023-07-14T13:01:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.503+0000 7f313d39d700 1 -- 172.21.15.17:0/1009325085 shutdown_connections 2023-07-14T13:01:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.503+0000 7f313d39d700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f31200a1340 0x7f31200a37f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.503+0000 7f313d39d700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31381062b0 0x7f3138197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.503+0000 7f313d39d700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3138068070 0x7f313819da10 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.503+0000 7f313d39d700 1 --2- 172.21.15.17:0/1009325085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31381059a0 0x7f313819df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.503+0000 7f313d39d700 1 -- 172.21.15.17:0/1009325085 >> 172.21.15.17:0/1009325085 conn(0x7f3138074770 msgr2=0x7f31380fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.504+0000 7f313d39d700 1 -- 172.21.15.17:0/1009325085 shutdown_connections 2023-07-14T13:01:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:33.504+0000 7f313d39d700 1 -- 172.21.15.17:0/1009325085 wait complete. 2023-07-14T13:01:34.801 INFO:teuthology.orchestra.run.smithi017.stderr:5100000 of 50000000 tuples (10%) done (elapsed 84.41 s, remaining 743.10 s) 2023-07-14T13:01:35.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:34 smithi017 ceph-mon[95536]: pgmap v58: 97 pgs: 97 active+clean; 1.1 GiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 MiB/s wr, 25 op/s 2023-07-14T13:01:35.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:34 smithi135 ceph-mon[97338]: pgmap v58: 97 pgs: 97 active+clean; 1.1 GiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 MiB/s wr, 25 op/s 2023-07-14T13:01:35.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:34 smithi131 ceph-mon[96953]: pgmap v58: 97 pgs: 97 active+clean; 1.1 GiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 22 MiB/s wr, 25 op/s 2023-07-14T13:01:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:5200000 of 50000000 tuples (10%) done (elapsed 86.26 s, remaining 743.20 s) 2023-07-14T13:01:37.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:36 smithi017 ceph-mon[95536]: pgmap v59: 97 pgs: 97 active+clean; 1.2 GiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 34 MiB/s wr, 40 op/s 2023-07-14T13:01:37.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:36 smithi135 ceph-mon[97338]: pgmap v59: 97 pgs: 97 active+clean; 1.2 GiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 34 MiB/s wr, 40 op/s 2023-07-14T13:01:37.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:36 smithi131 ceph-mon[96953]: pgmap v59: 97 pgs: 97 active+clean; 1.2 GiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 34 MiB/s wr, 40 op/s 2023-07-14T13:01:38.570 INFO:teuthology.orchestra.run.smithi017.stderr:5300000 of 50000000 tuples (10%) done (elapsed 88.17 s, remaining 743.66 s) 2023-07-14T13:01:39.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:38 smithi017 ceph-mon[95536]: pgmap v60: 97 pgs: 97 active+clean; 1.2 GiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:01:39.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:38 smithi135 ceph-mon[97338]: pgmap v60: 97 pgs: 97 active+clean; 1.2 GiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:01:39.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:38 smithi131 ceph-mon[96953]: pgmap v60: 97 pgs: 97 active+clean; 1.2 GiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:01:39.908 INFO:teuthology.orchestra.run.smithi017.stderr:5400000 of 50000000 tuples (10%) done (elapsed 89.51 s, remaining 739.31 s) 2023-07-14T13:01:40.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:39 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:01:40.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:39 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:01:40.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:39 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:01:40.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:39 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:01:40.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:39 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:01:40.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:39 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:01:41.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:40 smithi017 ceph-mon[95536]: pgmap v61: 97 pgs: 97 active+clean; 1.3 GiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 32 MiB/s wr, 42 op/s 2023-07-14T13:01:41.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:40 smithi135 ceph-mon[97338]: pgmap v61: 97 pgs: 97 active+clean; 1.3 GiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 32 MiB/s wr, 42 op/s 2023-07-14T13:01:41.497 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:40 smithi131 ceph-mon[96953]: pgmap v61: 97 pgs: 97 active+clean; 1.3 GiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 32 MiB/s wr, 42 op/s 2023-07-14T13:01:41.634 INFO:teuthology.orchestra.run.smithi017.stderr:5500000 of 50000000 tuples (11%) done (elapsed 91.24 s, remaining 738.21 s) 2023-07-14T13:01:42.941 INFO:teuthology.orchestra.run.smithi017.stderr:5600000 of 50000000 tuples (11%) done (elapsed 92.55 s, remaining 733.75 s) 2023-07-14T13:01:43.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:42 smithi017 ceph-mon[95536]: pgmap v62: 97 pgs: 97 active+clean; 1.3 GiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 28 MiB/s wr, 43 op/s 2023-07-14T13:01:43.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:42 smithi135 ceph-mon[97338]: pgmap v62: 97 pgs: 97 active+clean; 1.3 GiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 28 MiB/s wr, 43 op/s 2023-07-14T13:01:43.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:42 smithi131 ceph-mon[96953]: pgmap v62: 97 pgs: 97 active+clean; 1.3 GiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 28 MiB/s wr, 43 op/s 2023-07-14T13:01:44.353 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:01:44.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.564+0000 7f9b729ff700 1 -- 172.21.15.17:0/1628023081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b6c0ffae0 msgr2=0x7f9b6c0fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.564+0000 7f9b729ff700 1 --2- 172.21.15.17:0/1628023081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b6c0ffae0 0x7f9b6c0fff50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009990 tx=0x7f9b60009ca0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.565+0000 7f9b729ff700 1 -- 172.21.15.17:0/1628023081 shutdown_connections 2023-07-14T13:01:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.565+0000 7f9b729ff700 1 --2- 172.21.15.17:0/1628023081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c100490 0x7f9b6c10c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.565+0000 7f9b729ff700 1 --2- 172.21.15.17:0/1628023081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b6c105af0 0x7f9b6c105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.565+0000 7f9b729ff700 1 --2- 172.21.15.17:0/1628023081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b6c0ffae0 0x7f9b6c0fff50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.565+0000 7f9b729ff700 1 -- 172.21.15.17:0/1628023081 >> 172.21.15.17:0/1628023081 conn(0x7f9b6c0fb5e0 msgr2=0x7f9b6c0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.565+0000 7f9b729ff700 1 -- 172.21.15.17:0/1628023081 shutdown_connections 2023-07-14T13:01:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.565+0000 7f9b729ff700 1 -- 172.21.15.17:0/1628023081 wait complete. 2023-07-14T13:01:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.566+0000 7f9b729ff700 1 Processor -- start 2023-07-14T13:01:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.566+0000 7f9b729ff700 1 -- start start 2023-07-14T13:01:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.566+0000 7f9b729ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b6c0ffae0 0x7f9b6c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.566+0000 7f9b729ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c100490 0x7f9b6c19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.566+0000 7f9b729ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b6c105af0 0x7f9b6c195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.566+0000 7f9b729ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c195fe0 con 0x7f9b6c105af0 2023-07-14T13:01:44.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.566+0000 7f9b729ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c196150 con 0x7f9b6c100490 2023-07-14T13:01:44.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.566+0000 7f9b729ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c196310 con 0x7f9b6c0ffae0 2023-07-14T13:01:44.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.567+0000 7f9b70f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b6c105af0 0x7f9b6c195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.567+0000 7f9b6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c100490 0x7f9b6c19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.567+0000 7f9b6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c100490 0x7f9b6c19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59220/0 (socket says 172.21.15.17:59220) 2023-07-14T13:01:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.567+0000 7f9b70f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b6c105af0 0x7f9b6c195970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60344/0 (socket says 172.21.15.17:60344) 2023-07-14T13:01:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.567+0000 7f9b6b7fe700 1 -- 172.21.15.17:0/2466911179 learned_addr learned my addr 172.21.15.17:0/2466911179 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.567+0000 7f9b6bfff700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b6c0ffae0 0x7f9b6c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.567+0000 7f9b6b7fe700 1 -- 172.21.15.17:0/2466911179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b6c0ffae0 msgr2=0x7f9b6c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.567+0000 7f9b6b7fe700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b6c0ffae0 0x7f9b6c19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.567+0000 7f9b6b7fe700 1 -- 172.21.15.17:0/2466911179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b6c105af0 msgr2=0x7f9b6c195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.567+0000 7f9b6b7fe700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b6c105af0 0x7f9b6c195970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.567+0000 7f9b6b7fe700 1 -- 172.21.15.17:0/2466911179 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b600095f0 con 0x7f9b6c100490 2023-07-14T13:01:44.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.568+0000 7f9b6b7fe700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c100490 0x7f9b6c19be40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9b60000c00 tx=0x7f9b60004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:44.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.568+0000 7f9b697fa700 1 -- 172.21.15.17:0/2466911179 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6001d070 con 0x7f9b6c100490 2023-07-14T13:01:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.568+0000 7f9b697fa700 1 -- 172.21.15.17:0/2466911179 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b60022470 con 0x7f9b6c100490 2023-07-14T13:01:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.568+0000 7f9b729ff700 1 -- 172.21.15.17:0/2466911179 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6c196590 con 0x7f9b6c100490 2023-07-14T13:01:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.568+0000 7f9b697fa700 1 -- 172.21.15.17:0/2466911179 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60017650 con 0x7f9b6c100490 2023-07-14T13:01:44.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.568+0000 7f9b729ff700 1 -- 172.21.15.17:0/2466911179 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6c1a28f0 con 0x7f9b6c100490 2023-07-14T13:01:44.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.572+0000 7f9b697fa700 1 -- 172.21.15.17:0/2466911179 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9b600225e0 con 0x7f9b6c100490 2023-07-14T13:01:44.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.573+0000 7f9b86317b80 1 Processor -- start 2023-07-14T13:01:44.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b86317b80 1 -- start start 2023-07-14T13:01:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 0x55c08590c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 0x55c085917590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 0x55c085919eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b86317b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085812cb0 con 0x55c08590cbe0 2023-07-14T13:01:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b86317b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085865a40 con 0x55c08590c2d0 2023-07-14T13:01:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b86317b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c08585eed0 con 0x55c085917ad0 2023-07-14T13:01:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b70f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 0x55c08590c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b6bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 0x55c085917590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b70f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 0x55c08590c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59222/0 (socket says 172.21.15.17:59222) 2023-07-14T13:01:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b70f9c700 1 -- 172.21.15.17:0/2229025603 learned_addr learned my addr 172.21.15.17:0/2229025603 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.574+0000 7f9b6bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 0x55c085917590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60354/0 (socket says 172.21.15.17:60354) 2023-07-14T13:01:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.575+0000 7f9b6b7fe700 1 --2- 172.21.15.17:0/2229025603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 0x55c085919eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.575+0000 7f9b6bfff700 1 -- 172.21.15.17:0/2229025603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 msgr2=0x55c085919eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.575+0000 7f9b697fa700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b540a12c0 0x7f9b540a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.575+0000 7f9b6bfff700 1 --2- 172.21.15.17:0/2229025603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 0x55c085919eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.575+0000 7f9b6bfff700 1 -- 172.21.15.17:0/2229025603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 msgr2=0x55c08590c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:44.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.575+0000 7f9b6bfff700 1 --2- 172.21.15.17:0/2229025603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 0x55c08590c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.575+0000 7f9b6bfff700 1 -- 172.21.15.17:0/2229025603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c08568cde0 con 0x55c08590cbe0 2023-07-14T13:01:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.575+0000 7f9b697fa700 1 -- 172.21.15.17:0/2466911179 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f9b600ce170 con 0x7f9b6c100490 2023-07-14T13:01:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.575+0000 7f9b70f9c700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b540a12c0 0x7f9b540a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.575+0000 7f9b6bfff700 1 --2- 172.21.15.17:0/2229025603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 0x55c085917590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00bc00 tx=0x7f9b5c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d06ca1c3d651c4b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:44.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.575+0000 7f9b527fc700 1 -- 172.21.15.17:0/2229025603 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c010bc0 con 0x55c08590cbe0 2023-07-14T13:01:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.576+0000 7f9b527fc700 1 -- 172.21.15.17:0/2229025603 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b5c015070 con 0x55c08590cbe0 2023-07-14T13:01:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.576+0000 7f9b527fc700 1 -- 172.21.15.17:0/2229025603 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c004d20 con 0x55c08590cbe0 2023-07-14T13:01:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.576+0000 7f9b86317b80 1 -- 172.21.15.17:0/2229025603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 msgr2=0x55c085917590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.576+0000 7f9b70f9c700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b540a12c0 0x7f9b540a3770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009550 tx=0x7f9b64009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.576+0000 7f9b86317b80 1 --2- 172.21.15.17:0/2229025603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 0x55c085917590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00bc00 tx=0x7f9b5c00bf10 comp rx=0 tx=0).stop 2023-07-14T13:01:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.576+0000 7f9b86317b80 1 -- 172.21.15.17:0/2229025603 shutdown_connections 2023-07-14T13:01:44.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.576+0000 7f9b86317b80 1 --2- 172.21.15.17:0/2229025603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 0x55c085919eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.576+0000 7f9b86317b80 1 --2- 172.21.15.17:0/2229025603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 0x55c08590c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.577+0000 7f9b86317b80 1 --2- 172.21.15.17:0/2229025603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 0x55c085917590 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.577+0000 7f9b86317b80 1 -- 172.21.15.17:0/2229025603 >> 172.21.15.17:0/2229025603 conn(0x55c085902da0 msgr2=0x55c0859086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.577+0000 7f9b86317b80 1 -- 172.21.15.17:0/2229025603 shutdown_connections 2023-07-14T13:01:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.577+0000 7f9b86317b80 1 -- 172.21.15.17:0/2229025603 wait complete. 2023-07-14T13:01:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.577+0000 7f9b86317b80 1 -- start start 2023-07-14T13:01:44.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.577+0000 7f9b86317b80 1 Processor -- start 2023-07-14T13:01:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.578+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 0x55c0859174a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.578+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590cbe0 0x55c085914720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.578+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 0x55c085914d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.578+0000 7f9b86317b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0857feac0 con 0x55c08590c2d0 2023-07-14T13:01:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.578+0000 7f9b86317b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0857fe7c0 con 0x55c08590cbe0 2023-07-14T13:01:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.578+0000 7f9b86317b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0856e2920 con 0x55c085917ad0 2023-07-14T13:01:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.578+0000 7f9b86317b80 10 client.0 _ll_register_callbacks cb 0x55c0857fc760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.578+0000 7f9b6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590cbe0 0x55c085914720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.578+0000 7f9b6bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 0x55c0859174a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.578+0000 7f9b6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590cbe0 0x55c085914720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59234/0 (socket says 172.21.15.17:59234) 2023-07-14T13:01:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.578+0000 7f9b6b7fe700 1 -- 172.21.15.17:0/3535952021 learned_addr learned my addr 172.21.15.17:0/3535952021 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.579+0000 7f9b6b7fe700 1 -- 172.21.15.17:0/3535952021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 msgr2=0x55c085914d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.579+0000 7f9b6b7fe700 1 --2- 172.21.15.17:0/3535952021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 0x55c085914d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.579+0000 7f9b6b7fe700 1 -- 172.21.15.17:0/3535952021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 msgr2=0x55c0859174a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.579+0000 7f9b6b7fe700 1 --2- 172.21.15.17:0/3535952021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 0x55c0859174a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.579+0000 7f9b6b7fe700 1 -- 172.21.15.17:0/3535952021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c00b860 con 0x55c08590cbe0 2023-07-14T13:01:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.579+0000 7f9b6b7fe700 1 --2- 172.21.15.17:0/3535952021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590cbe0 0x55c085914720 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9b600a3170 tx=0x7f9b600cbe30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77a7728046009da0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:44.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.579+0000 7f9b4b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:01:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.579+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/3535952021 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6009a9d0 con 0x55c08590cbe0 2023-07-14T13:01:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.579+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/3535952021 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f9b600228c0 con 0x55c08590cbe0 2023-07-14T13:01:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.579+0000 7f9b86317b80 1 -- 172.21.15.17:0/3535952021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0857b84f0 con 0x55c08590cbe0 2023-07-14T13:01:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.579+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/3535952021 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b6009b0b0 con 0x55c08590cbe0 2023-07-14T13:01:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.580+0000 7f9b86317b80 10 client.25817 fetch_fsmap learned FSMap version 25 2023-07-14T13:01:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.580+0000 7f9b86317b80 1 -- 172.21.15.17:0/3535952021 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55c085675c60 con 0x55c08590cbe0 2023-07-14T13:01:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.580+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/3535952021 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c0857b84f0 con 0x55c08590cbe0 2023-07-14T13:01:44.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.580+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/3535952021 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9b600a3210 con 0x55c08590cbe0 2023-07-14T13:01:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.580+0000 7f9b86317b80 10 client.25817 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:01:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.580+0000 7f9b86317b80 10 client.25817 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.581+0000 7f9b86317b80 20 client.25817 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.581+0000 7f9b86317b80 1 --2- 172.21.15.17:0/3535952021 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c085927040 0x55c085929450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.581+0000 7f9b86317b80 4 client.25817 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:01:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.581+0000 7f9b86317b80 1 -- 172.21.15.17:0/3535952021 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c085857eb0 con 0x55c085927040 2023-07-14T13:01:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.581+0000 7f9b6bfff700 1 --2- 172.21.15.17:0/3535952021 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c085927040 0x55c085929450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.581+0000 7f9b6bfff700 1 --2- 172.21.15.17:0/3535952021 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c085927040 0x55c085929450 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=430ac52e6404d4a9 server_cookie=bb88866e924476a4 in_seq=0 out_seq=0 2023-07-14T13:01:44.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.581+0000 7f9b4b7fe700 10 client.25817 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:44.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.582+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/3535952021 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c085857eb0 con 0x55c085927040 2023-07-14T13:01:44.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.582+0000 7f9b4b7fe700 10 client.25817 handle_command_reply: tid=0 2023-07-14T13:01:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.582+0000 7f9b86317b80 1 client.25817 shutdown 2023-07-14T13:01:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b86317b80 1 -- 172.21.15.17:0/3535952021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590cbe0 msgr2=0x55c085914720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b86317b80 1 --2- 172.21.15.17:0/3535952021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590cbe0 0x55c085914720 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9b600a3170 tx=0x7f9b600cbe30 comp rx=0 tx=0).stop 2023-07-14T13:01:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b86317b80 1 -- 172.21.15.17:0/3535952021 shutdown_connections 2023-07-14T13:01:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b86317b80 1 --2- 172.21.15.17:0/3535952021 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c085927040 0x55c085929450 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b86317b80 1 --2- 172.21.15.17:0/3535952021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 0x55c085914d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b86317b80 1 --2- 172.21.15.17:0/3535952021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 0x55c0859174a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b4b7fe700 0 client.25817 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:44.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b86317b80 1 --2- 172.21.15.17:0/3535952021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590cbe0 0x55c085914720 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b86317b80 1 -- 172.21.15.17:0/3535952021 >> 172.21.15.17:0/3535952021 conn(0x55c085902da0 msgr2=0x55c085908230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:44.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b86317b80 1 -- 172.21.15.17:0/3535952021 shutdown_connections 2023-07-14T13:01:44.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b86317b80 1 -- 172.21.15.17:0/3535952021 wait complete. 2023-07-14T13:01:44.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.583+0000 7f9b86317b80 20 client.25817 trim_cache size 0 max 16384 2023-07-14T13:01:44.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.609+0000 7f9b86317b80 1 Processor -- start 2023-07-14T13:01:44.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.609+0000 7f9b86317b80 1 -- start start 2023-07-14T13:01:44.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.609+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 0x55c085916fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.609+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c08590cbe0 0x55c085913fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.609+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c085917ad0 0x55c085914500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.609+0000 7f9b86317b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c08590d540 con 0x55c08590c2d0 2023-07-14T13:01:44.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.609+0000 7f9b86317b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085912c80 con 0x55c085917ad0 2023-07-14T13:01:44.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.609+0000 7f9b86317b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085914a40 con 0x55c08590cbe0 2023-07-14T13:01:44.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.609+0000 7f9b6bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 0x55c085916fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.609+0000 7f9b6bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 0x55c085916fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60368/0 (socket says 172.21.15.17:60368) 2023-07-14T13:01:44.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.609+0000 7f9b6bfff700 1 -- 172.21.15.17:0/1727965513 learned_addr learned my addr 172.21.15.17:0/1727965513 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:44.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.610+0000 7f9b70f9c700 1 --2- 172.21.15.17:0/1727965513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c085917ad0 0x55c085914500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.610+0000 7f9b6b7fe700 1 --2- 172.21.15.17:0/1727965513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c08590cbe0 0x55c085913fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.610+0000 7f9b70f9c700 1 -- 172.21.15.17:0/1727965513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c08590cbe0 msgr2=0x55c085913fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:44.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.610+0000 7f9b70f9c700 1 --2- 172.21.15.17:0/1727965513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c08590cbe0 0x55c085913fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.610+0000 7f9b70f9c700 1 -- 172.21.15.17:0/1727965513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 msgr2=0x55c085916fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:44.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.610+0000 7f9b70f9c700 1 --2- 172.21.15.17:0/1727965513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 0x55c085916fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.610+0000 7f9b70f9c700 1 -- 172.21.15.17:0/1727965513 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0856b3250 con 0x55c085917ad0 2023-07-14T13:01:44.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.610+0000 7f9b6bfff700 1 --2- 172.21.15.17:0/1727965513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 0x55c085916fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:44.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.610+0000 7f9b70f9c700 1 --2- 172.21.15.17:0/1727965513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c085917ad0 0x55c085914500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9b64007d00 tx=0x7f9b6400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c164f75e939a27 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:44.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.611+0000 7f9b52ffd700 1 -- 172.21.15.17:0/1727965513 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6400e040 con 0x55c085917ad0 2023-07-14T13:01:44.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.611+0000 7f9b52ffd700 1 -- 172.21.15.17:0/1727965513 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b6400f040 con 0x55c085917ad0 2023-07-14T13:01:44.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.611+0000 7f9b52ffd700 1 -- 172.21.15.17:0/1727965513 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64022610 con 0x55c085917ad0 2023-07-14T13:01:44.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.611+0000 7f9b86317b80 1 -- 172.21.15.17:0/1727965513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c085917ad0 msgr2=0x55c085914500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.611+0000 7f9b86317b80 1 --2- 172.21.15.17:0/1727965513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c085917ad0 0x55c085914500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9b64007d00 tx=0x7f9b6400b040 comp rx=0 tx=0).stop 2023-07-14T13:01:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.611+0000 7f9b86317b80 1 -- 172.21.15.17:0/1727965513 shutdown_connections 2023-07-14T13:01:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.611+0000 7f9b86317b80 1 --2- 172.21.15.17:0/1727965513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c085917ad0 0x55c085914500 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.611+0000 7f9b86317b80 1 --2- 172.21.15.17:0/1727965513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590c2d0 0x55c085916fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.611+0000 7f9b86317b80 1 --2- 172.21.15.17:0/1727965513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c08590cbe0 0x55c085913fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.611+0000 7f9b86317b80 1 -- 172.21.15.17:0/1727965513 >> 172.21.15.17:0/1727965513 conn(0x55c085902da0 msgr2=0x55c08590fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:44.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.612+0000 7f9b86317b80 1 -- 172.21.15.17:0/1727965513 shutdown_connections 2023-07-14T13:01:44.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.612+0000 7f9b86317b80 1 -- 172.21.15.17:0/1727965513 wait complete. 2023-07-14T13:01:44.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.612+0000 7f9b86317b80 1 -- start start 2023-07-14T13:01:44.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.612+0000 7f9b86317b80 1 Processor -- start 2023-07-14T13:01:44.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.613+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 0x55c085978dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.613+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 0x55c085979300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.613+0000 7f9b86317b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 0x55c085973160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.613+0000 7f9b86317b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085973740 con 0x55c08590cbe0 2023-07-14T13:01:44.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.613+0000 7f9b86317b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0859738b0 con 0x55c08590c2d0 2023-07-14T13:01:44.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.613+0000 7f9b86317b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c085973a70 con 0x55c085917ad0 2023-07-14T13:01:44.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.613+0000 7f9b86317b80 10 client.0 _ll_register_callbacks cb 0x55c0857fc760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:44.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b6bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 0x55c085978dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b6b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 0x55c085979300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b6bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 0x55c085978dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59256/0 (socket says 172.21.15.17:59256) 2023-07-14T13:01:44.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b6bfff700 1 -- 172.21.15.17:0/4038584241 learned_addr learned my addr 172.21.15.17:0/4038584241 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:44.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b70f9c700 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 0x55c085973160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b6bfff700 1 -- 172.21.15.17:0/4038584241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 msgr2=0x55c085973160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:44.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b6bfff700 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 0x55c085973160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b6bfff700 1 -- 172.21.15.17:0/4038584241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 msgr2=0x55c085979300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:44.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b6bfff700 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 0x55c085979300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b6bfff700 1 -- 172.21.15.17:0/4038584241 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c08568cde0 con 0x55c08590c2d0 2023-07-14T13:01:44.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b6bfff700 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 0x55c085978dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c019000 tx=0x7f9b5c005710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4020073decf7d8a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:44.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.614+0000 7f9b4b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:01:44.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.615+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/4038584241 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0265b0 con 0x55c08590c2d0 2023-07-14T13:01:44.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.615+0000 7f9b86317b80 1 -- 172.21.15.17:0/4038584241 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b5c015070 con 0x55c08590c2d0 2023-07-14T13:01:44.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.615+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/4038584241 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f9b5c017070 con 0x55c08590c2d0 2023-07-14T13:01:44.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.615+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/4038584241 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b5c010eb0 con 0x55c08590c2d0 2023-07-14T13:01:44.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.615+0000 7f9b86317b80 10 client.25823 fetch_fsmap learned FSMap version 25 2023-07-14T13:01:44.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.615+0000 7f9b86317b80 1 -- 172.21.15.17:0/4038584241 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f9b64007e70 con 0x55c08590c2d0 2023-07-14T13:01:44.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.615+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/4038584241 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b5c015070 con 0x55c08590c2d0 2023-07-14T13:01:44.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.615+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/4038584241 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9b5c02d060 con 0x55c08590c2d0 2023-07-14T13:01:44.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.615+0000 7f9b86317b80 10 client.25823 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:01:44.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.616+0000 7f9b86317b80 10 client.25823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:44.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.616+0000 7f9b86317b80 20 client.25823 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:44.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.616+0000 7f9b86317b80 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c085980c80 0x55c085983090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:44.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.616+0000 7f9b86317b80 4 client.25823 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:01:44.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.616+0000 7f9b86317b80 1 -- 172.21.15.17:0/4038584241 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c08581a050 con 0x55c085980c80 2023-07-14T13:01:44.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.616+0000 7f9b6b7fe700 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c085980c80 0x55c085983090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:44.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.616+0000 7f9b4b7fe700 10 client.25823 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:44.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.616+0000 7f9b6b7fe700 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c085980c80 0x55c085983090 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9479da4645ed8fb9 server_cookie=faf7bab8502c3666 in_seq=0 out_seq=0 2023-07-14T13:01:44.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b4b7fe700 1 -- 172.21.15.17:0/4038584241 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c08581a050 con 0x55c085980c80 2023-07-14T13:01:44.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b4b7fe700 10 client.25823 handle_command_reply: tid=0 2023-07-14T13:01:44.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 1 client.25823 shutdown 2023-07-14T13:01:44.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 1 -- 172.21.15.17:0/4038584241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 msgr2=0x55c085978dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:44.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 0x55c085978dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c019000 tx=0x7f9b5c005710 comp rx=0 tx=0).stop 2023-07-14T13:01:44.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 1 -- 172.21.15.17:0/4038584241 shutdown_connections 2023-07-14T13:01:44.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c085980c80 0x55c085983090 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c085917ad0 0x55c085973160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c08590c2d0 0x55c085978dc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 1 --2- 172.21.15.17:0/4038584241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c08590cbe0 0x55c085979300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 1 -- 172.21.15.17:0/4038584241 >> 172.21.15.17:0/4038584241 conn(0x55c085902da0 msgr2=0x55c08590fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:44.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b4b7fe700 0 client.25823 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:44.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 1 -- 172.21.15.17:0/4038584241 shutdown_connections 2023-07-14T13:01:44.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 1 -- 172.21.15.17:0/4038584241 wait complete. 2023-07-14T13:01:44.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.617+0000 7f9b86317b80 20 client.25823 trim_cache size 0 max 16384 2023-07-14T13:01:44.656 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:01:44.656 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:01:44.657 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:01:44.657 INFO:teuthology.orchestra.run.smithi017.stdout: "f3578cce-cbe4-4d2d-80c7-958bc9d580c0": { 2023-07-14T13:01:44.657 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:01:44.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "f3578cce-cbe4-4d2d-80c7-958bc9d580c0", 2023-07-14T13:01:44.657 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:01:44.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:01:44.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:01:44.658 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:01:44.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 -- 172.21.15.17:0/2466911179 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b540a12c0 msgr2=0x7f9b540a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:44.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b540a12c0 0x7f9b540a3770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009550 tx=0x7f9b64009040 comp rx=0 tx=0).stop 2023-07-14T13:01:44.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 -- 172.21.15.17:0/2466911179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c100490 msgr2=0x7f9b6c19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:44.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c100490 0x7f9b6c19be40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9b60000c00 tx=0x7f9b60004730 comp rx=0 tx=0).stop 2023-07-14T13:01:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 -- 172.21.15.17:0/2466911179 shutdown_connections 2023-07-14T13:01:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b540a12c0 0x7f9b540a3770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b6c105af0 0x7f9b6c195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b6c0ffae0 0x7f9b6c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 --2- 172.21.15.17:0/2466911179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c100490 0x7f9b6c19be40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 -- 172.21.15.17:0/2466911179 >> 172.21.15.17:0/2466911179 conn(0x7f9b6c0fb5e0 msgr2=0x7f9b6c0fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:44.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 -- 172.21.15.17:0/2466911179 shutdown_connections 2023-07-14T13:01:44.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:01:44.618+0000 7f9b729ff700 1 -- 172.21.15.17:0/2466911179 wait complete. 2023-07-14T13:01:44.672 INFO:tasks.cephfs.filesystem:scrub status for tag:f3578cce-cbe4-4d2d-80c7-958bc9d580c0 - {'path': '/', 'tag': 'f3578cce-cbe4-4d2d-80c7-958bc9d580c0', 'options': 'recursive,force'} 2023-07-14T13:01:45.207 INFO:teuthology.orchestra.run.smithi017.stderr:5700000 of 50000000 tuples (11%) done (elapsed 94.81 s, remaining 736.87 s) 2023-07-14T13:01:45.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:44 smithi017 ceph-mon[95536]: pgmap v63: 97 pgs: 97 active+clean; 1.3 GiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 23 MiB/s wr, 39 op/s 2023-07-14T13:01:45.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:44 smithi135 ceph-mon[97338]: pgmap v63: 97 pgs: 97 active+clean; 1.3 GiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 23 MiB/s wr, 39 op/s 2023-07-14T13:01:45.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:44 smithi131 ceph-mon[96953]: pgmap v63: 97 pgs: 97 active+clean; 1.3 GiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 23 MiB/s wr, 39 op/s 2023-07-14T13:01:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.665+0000 7ffa36bff700 1 -- 172.21.15.17:0/2522522648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3010c340 msgr2=0x7ffa3010e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.665+0000 7ffa36bff700 1 --2- 172.21.15.17:0/2522522648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3010c340 0x7ffa3010e720 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800b0a0 tx=0x7ffa2800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.665+0000 7ffa36bff700 1 -- 172.21.15.17:0/2522522648 shutdown_connections 2023-07-14T13:01:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.665+0000 7ffa36bff700 1 --2- 172.21.15.17:0/2522522648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa3010c340 0x7ffa3010e720 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.665+0000 7ffa36bff700 1 --2- 172.21.15.17:0/2522522648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa300728b0 0x7ffa30072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.665+0000 7ffa36bff700 1 --2- 172.21.15.17:0/2522522648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa300731c0 0x7ffa3010be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.665+0000 7ffa36bff700 1 -- 172.21.15.17:0/2522522648 >> 172.21.15.17:0/2522522648 conn(0x7ffa300fb600 msgr2=0x7ffa300fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.665+0000 7ffa36bff700 1 -- 172.21.15.17:0/2522522648 shutdown_connections 2023-07-14T13:01:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.665+0000 7ffa36bff700 1 -- 172.21.15.17:0/2522522648 wait complete. 2023-07-14T13:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.666+0000 7ffa36bff700 1 Processor -- start 2023-07-14T13:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.667+0000 7ffa36bff700 1 -- start start 2023-07-14T13:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.667+0000 7ffa36bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa300728b0 0x7ffa30197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.667+0000 7ffa36bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa300731c0 0x7ffa301983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.667+0000 7ffa36bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa3010c340 0x7ffa3019ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.667+0000 7ffa36bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3019d060 con 0x7ffa300728b0 2023-07-14T13:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.667+0000 7ffa36bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3019d1d0 con 0x7ffa3010c340 2023-07-14T13:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.667+0000 7ffa36bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3019d390 con 0x7ffa300731c0 2023-07-14T13:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.667+0000 7ffa3499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa300728b0 0x7ffa30197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.667+0000 7ffa3499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa300728b0 0x7ffa30197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51878/0 (socket says 172.21.15.17:51878) 2023-07-14T13:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.667+0000 7ffa3499b700 1 -- 172.21.15.17:0/2403129824 learned_addr learned my addr 172.21.15.17:0/2403129824 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.667+0000 7ffa3519c700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa3010c340 0x7ffa3019ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa2ffff700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa300731c0 0x7ffa301983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa3499b700 1 -- 172.21.15.17:0/2403129824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa300731c0 msgr2=0x7ffa301983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa3499b700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa300731c0 0x7ffa301983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa3499b700 1 -- 172.21.15.17:0/2403129824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa3010c340 msgr2=0x7ffa3019ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa3499b700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa3010c340 0x7ffa3019ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa3499b700 1 -- 172.21.15.17:0/2403129824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28009d00 con 0x7ffa300728b0 2023-07-14T13:01:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa2ffff700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa300731c0 0x7ffa301983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:01:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa3519c700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa3010c340 0x7ffa3019ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa3499b700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa300728b0 0x7ffa30197e70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400e9a0 tx=0x7ffa2400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa2dffb700 1 -- 172.21.15.17:0/2403129824 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24009790 con 0x7ffa300728b0 2023-07-14T13:01:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa36bff700 1 -- 172.21.15.17:0/2403129824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3019d670 con 0x7ffa300728b0 2023-07-14T13:01:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa2dffb700 1 -- 172.21.15.17:0/2403129824 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa2400cbd0 con 0x7ffa300728b0 2023-07-14T13:01:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.668+0000 7ffa2dffb700 1 -- 172.21.15.17:0/2403129824 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24018680 con 0x7ffa300728b0 2023-07-14T13:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.669+0000 7ffa36bff700 1 -- 172.21.15.17:0/2403129824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa301a4eb0 con 0x7ffa300728b0 2023-07-14T13:01:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.672+0000 7ffa2dffb700 1 -- 172.21.15.17:0/2403129824 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ffa2400cd40 con 0x7ffa300728b0 2023-07-14T13:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.674+0000 7ffa4a466b80 1 Processor -- start 2023-07-14T13:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.674+0000 7ffa2dffb700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ffa200a12c0 0x7ffa200a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.674+0000 7ffa2dffb700 1 -- 172.21.15.17:0/2403129824 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ffa24014070 con 0x7ffa300728b0 2023-07-14T13:01:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.674+0000 7ffa4a466b80 1 -- start start 2023-07-14T13:01:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.674+0000 7ffa3519c700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ffa200a12c0 0x7ffa200a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7f0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 0x55976d7f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d6f5c50 con 0x55976d7f0580 2023-07-14T13:01:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d7489e0 con 0x55976d64c6b0 2023-07-14T13:01:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d741e70 con 0x55976d7f62d0 2023-07-14T13:01:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa3499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa3499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7f5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:50228/0 (socket says 172.21.15.17:50228) 2023-07-14T13:01:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa3499b700 1 -- 172.21.15.17:0/6578040 learned_addr learned my addr 172.21.15.17:0/6578040 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa2ffff700 1 --2- 172.21.15.17:0/6578040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa3499b700 1 -- 172.21.15.17:0/6578040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 msgr2=0x55976d7f0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa3519c700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ffa200a12c0 0x7ffa200a3770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa280062a0 tx=0x7ffa28006210 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa3499b700 1 --2- 172.21.15.17:0/6578040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7f0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa3499b700 1 -- 172.21.15.17:0/6578040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 msgr2=0x55976d7f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.675+0000 7ffa3519c700 1 --2- 172.21.15.17:0/6578040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 0x55976d7f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.676+0000 7ffa3499b700 1 --2- 172.21.15.17:0/6578040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 0x55976d7f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.676+0000 7ffa3499b700 1 -- 172.21.15.17:0/6578040 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55976d56fd80 con 0x55976d64c6b0 2023-07-14T13:01:46.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.676+0000 7ffa2ffff700 1 --2- 172.21.15.17:0/6578040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:01:46.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.676+0000 7ffa3519c700 1 --2- 172.21.15.17:0/6578040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 0x55976d7f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:01:46.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.676+0000 7ffa3499b700 1 --2- 172.21.15.17:0/6578040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7f5d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffa24096b00 tx=0x7ffa24099cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb613470c7f27d98 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:46.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.676+0000 7ffa1affd700 1 -- 172.21.15.17:0/6578040 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa240a24e0 con 0x55976d64c6b0 2023-07-14T13:01:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.676+0000 7ffa1affd700 1 -- 172.21.15.17:0/6578040 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa2409a2f0 con 0x55976d64c6b0 2023-07-14T13:01:46.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.676+0000 7ffa1affd700 1 -- 172.21.15.17:0/6578040 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa240a2270 con 0x55976d64c6b0 2023-07-14T13:01:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.677+0000 7ffa4a466b80 1 -- 172.21.15.17:0/6578040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 msgr2=0x55976d7f5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.677+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/6578040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7f5d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffa24096b00 tx=0x7ffa24099cc0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.677+0000 7ffa4a466b80 1 -- 172.21.15.17:0/6578040 shutdown_connections 2023-07-14T13:01:46.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.677+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/6578040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 0x55976d7f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.677+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/6578040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7f5d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.677+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/6578040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7f0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.677+0000 7ffa4a466b80 1 -- 172.21.15.17:0/6578040 >> 172.21.15.17:0/6578040 conn(0x55976d7e5be0 msgr2=0x55976d7eaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.677+0000 7ffa4a466b80 1 -- 172.21.15.17:0/6578040 shutdown_connections 2023-07-14T13:01:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.677+0000 7ffa4a466b80 1 -- 172.21.15.17:0/6578040 wait complete. 2023-07-14T13:01:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.678+0000 7ffa4a466b80 1 -- start start 2023-07-14T13:01:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.678+0000 7ffa4a466b80 1 Processor -- start 2023-07-14T13:01:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7fc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 0x55976d7f9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7fa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d6e1a60 con 0x55976d7f0580 2023-07-14T13:01:46.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d6e1760 con 0x55976d64c6b0 2023-07-14T13:01:46.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d5c58c0 con 0x55976d7f62d0 2023-07-14T13:01:46.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa4a466b80 10 client.0 _ll_register_callbacks cb 0x55976d6df700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:46.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa2ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 0x55976d7f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa3499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa3499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7fc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:50232/0 (socket says 172.21.15.17:50232) 2023-07-14T13:01:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa2ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 0x55976d7f9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51886/0 (socket says 172.21.15.17:51886) 2023-07-14T13:01:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa3499b700 1 -- 172.21.15.17:0/3269331632 learned_addr learned my addr 172.21.15.17:0/3269331632 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa3519c700 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7fa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa3499b700 1 -- 172.21.15.17:0/3269331632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 msgr2=0x55976d7fa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa3499b700 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7fa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa3499b700 1 -- 172.21.15.17:0/3269331632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 msgr2=0x55976d7f9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa3499b700 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 0x55976d7f9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa3499b700 1 -- 172.21.15.17:0/3269331632 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa301a4eb0 con 0x55976d64c6b0 2023-07-14T13:01:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.679+0000 7ffa2ffff700 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 0x55976d7f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.680+0000 7ffa3499b700 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7fc640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa2409a020 tx=0x7ffa24010960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6a2b096eb6708c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.680+0000 7ffa0ffff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:01:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.680+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3269331632 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa240b6070 con 0x55976d64c6b0 2023-07-14T13:01:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.680+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3269331632 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ffa240a24e0 con 0x55976d64c6b0 2023-07-14T13:01:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.680+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3269331632 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55976d69b490 con 0x55976d64c6b0 2023-07-14T13:01:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.680+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3269331632 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa24098430 con 0x55976d64c6b0 2023-07-14T13:01:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.680+0000 7ffa4a466b80 10 client.25835 fetch_fsmap learned FSMap version 25 2023-07-14T13:01:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.680+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3269331632 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55976d558c00 con 0x55976d64c6b0 2023-07-14T13:01:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.680+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3269331632 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55976d69b490 con 0x55976d64c6b0 2023-07-14T13:01:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.681+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3269331632 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ffa24010430 con 0x55976d64c6b0 2023-07-14T13:01:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.681+0000 7ffa4a466b80 10 client.25835 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:01:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.681+0000 7ffa4a466b80 10 client.25835 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.681+0000 7ffa4a466b80 20 client.25835 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.681+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55976d809740 0x55976d80bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.681+0000 7ffa4a466b80 4 client.25835 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:01:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.681+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3269331632 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55976d73ae50 con 0x55976d809740 2023-07-14T13:01:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.681+0000 7ffa2ffff700 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55976d809740 0x55976d80bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.682+0000 7ffa2ffff700 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55976d809740 0x55976d80bb50 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=916c0b4c5305ca6 server_cookie=445dbc523a77b26d in_seq=0 out_seq=0 2023-07-14T13:01:46.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.682+0000 7ffa0ffff700 10 client.25835 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:46.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.682+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3269331632 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55976d73ae50 con 0x55976d809740 2023-07-14T13:01:46.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.682+0000 7ffa0ffff700 10 client.25835 handle_command_reply: tid=0 2023-07-14T13:01:46.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 1 client.25835 shutdown 2023-07-14T13:01:46.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3269331632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 msgr2=0x55976d7fc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:46.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7fc640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa2409a020 tx=0x7ffa24010960 comp rx=0 tx=0).stop 2023-07-14T13:01:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3269331632 shutdown_connections 2023-07-14T13:01:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55976d809740 0x55976d80bb50 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7fa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d64c6b0 0x55976d7fc640 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa0ffff700 0 client.25835 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3269331632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d7f0580 0x55976d7f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3269331632 >> 172.21.15.17:0/3269331632 conn(0x55976d7e5be0 msgr2=0x55976d7ea4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3269331632 shutdown_connections 2023-07-14T13:01:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3269331632 wait complete. 2023-07-14T13:01:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.683+0000 7ffa4a466b80 20 client.25835 trim_cache size 0 max 16384 2023-07-14T13:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.701+0000 7ffa4a466b80 1 Processor -- start 2023-07-14T13:01:46.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.701+0000 7ffa4a466b80 1 -- start start 2023-07-14T13:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.702+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.702+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f0580 0x55976d7eac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.702+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d7f62d0 0x55976d7fc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.702+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d7faf10 con 0x55976d64c6b0 2023-07-14T13:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.702+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d7e2b80 con 0x55976d7f62d0 2023-07-14T13:01:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.702+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d7ec940 con 0x55976d7f0580 2023-07-14T13:01:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.702+0000 7ffa3499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.702+0000 7ffa3519c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d7f62d0 0x55976d7fc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.702+0000 7ffa3499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51890/0 (socket says 172.21.15.17:51890) 2023-07-14T13:01:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.702+0000 7ffa3499b700 1 -- 172.21.15.17:0/1821313656 learned_addr learned my addr 172.21.15.17:0/1821313656 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.702+0000 7ffa2ffff700 1 --2- 172.21.15.17:0/1821313656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f0580 0x55976d7eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.703+0000 7ffa3499b700 1 -- 172.21.15.17:0/1821313656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f0580 msgr2=0x55976d7eac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.703+0000 7ffa3499b700 1 --2- 172.21.15.17:0/1821313656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f0580 0x55976d7eac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.703+0000 7ffa3499b700 1 -- 172.21.15.17:0/1821313656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d7f62d0 msgr2=0x55976d7fc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.703+0000 7ffa3499b700 1 --2- 172.21.15.17:0/1821313656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d7f62d0 0x55976d7fc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.703+0000 7ffa3499b700 1 -- 172.21.15.17:0/1821313656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55976d5961f0 con 0x55976d64c6b0 2023-07-14T13:01:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.703+0000 7ffa3519c700 1 --2- 172.21.15.17:0/1821313656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d7f62d0 0x55976d7fc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.703+0000 7ffa3499b700 1 --2- 172.21.15.17:0/1821313656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7f71a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffa24096b00 tx=0x7ffa240109d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5be50d66c63e91e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.703+0000 7ffa1b7fe700 1 -- 172.21.15.17:0/1821313656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa240b6070 con 0x55976d64c6b0 2023-07-14T13:01:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.703+0000 7ffa1b7fe700 1 -- 172.21.15.17:0/1821313656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa240a24e0 con 0x55976d64c6b0 2023-07-14T13:01:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.703+0000 7ffa1b7fe700 1 -- 172.21.15.17:0/1821313656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa240105c0 con 0x55976d64c6b0 2023-07-14T13:01:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.704+0000 7ffa4a466b80 1 -- 172.21.15.17:0/1821313656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 msgr2=0x55976d7f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.704+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/1821313656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7f71a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffa24096b00 tx=0x7ffa240109d0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.704+0000 7ffa4a466b80 1 -- 172.21.15.17:0/1821313656 shutdown_connections 2023-07-14T13:01:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.704+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/1821313656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d7f62d0 0x55976d7fc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.704+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/1821313656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7f71a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.704+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/1821313656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f0580 0x55976d7eac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.704+0000 7ffa4a466b80 1 -- 172.21.15.17:0/1821313656 >> 172.21.15.17:0/1821313656 conn(0x55976d7e5be0 msgr2=0x55976d7f6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.704+0000 7ffa4a466b80 1 -- 172.21.15.17:0/1821313656 shutdown_connections 2023-07-14T13:01:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.704+0000 7ffa4a466b80 1 -- 172.21.15.17:0/1821313656 wait complete. 2023-07-14T13:01:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.705+0000 7ffa4a466b80 1 -- start start 2023-07-14T13:01:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.705+0000 7ffa4a466b80 1 Processor -- start 2023-07-14T13:01:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.705+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7fe380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.705+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d7f0580 0x55976d7fe8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa4a466b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7fee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d85c640 con 0x55976d64c6b0 2023-07-14T13:01:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d85c7b0 con 0x55976d7f0580 2023-07-14T13:01:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa4a466b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976d85c970 con 0x55976d7f62d0 2023-07-14T13:01:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa4a466b80 10 client.0 _ll_register_callbacks cb 0x7ffa24099f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa3499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa3499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7fe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51904/0 (socket says 172.21.15.17:51904) 2023-07-14T13:01:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa3499b700 1 -- 172.21.15.17:0/3373388994 learned_addr learned my addr 172.21.15.17:0/3373388994 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa3519c700 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa2ffff700 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d7f0580 0x55976d7fe8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa3499b700 1 -- 172.21.15.17:0/3373388994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 msgr2=0x55976d7fee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa3499b700 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7fee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa3499b700 1 -- 172.21.15.17:0/3373388994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d7f0580 msgr2=0x55976d7fe8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa3499b700 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d7f0580 0x55976d7fe8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.706+0000 7ffa3499b700 1 -- 172.21.15.17:0/3373388994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3010f3c0 con 0x55976d64c6b0 2023-07-14T13:01:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.707+0000 7ffa3499b700 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7fe380 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa24010790 tx=0x7ffa24010960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9817a45e101f5b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.707+0000 7ffa0ffff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:01:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.707+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3373388994 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa240b6070 con 0x55976d64c6b0 2023-07-14T13:01:46.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.707+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3373388994 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ffa24098430 con 0x55976d64c6b0 2023-07-14T13:01:46.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.707+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3373388994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa2409a2f0 con 0x55976d64c6b0 2023-07-14T13:01:46.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.707+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3373388994 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa240b84c0 con 0x55976d64c6b0 2023-07-14T13:01:46.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.707+0000 7ffa4a466b80 10 client.16071 fetch_fsmap learned FSMap version 25 2023-07-14T13:01:46.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.707+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3373388994 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55976d558c00 con 0x55976d64c6b0 2023-07-14T13:01:46.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.707+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3373388994 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa2409a2f0 con 0x55976d64c6b0 2023-07-14T13:01:46.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.707+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3373388994 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ffa240b2d00 con 0x55976d64c6b0 2023-07-14T13:01:46.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.708+0000 7ffa4a466b80 10 client.16071 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:01:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.708+0000 7ffa4a466b80 10 client.16071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.708+0000 7ffa4a466b80 20 client.16071 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.708+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55976d85dc50 0x55976d860060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.708+0000 7ffa4a466b80 4 client.16071 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:01:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.708+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3373388994 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55976d6fcff0 con 0x55976d85dc50 2023-07-14T13:01:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.708+0000 7ffa2ffff700 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55976d85dc50 0x55976d860060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.708+0000 7ffa2ffff700 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55976d85dc50 0x55976d860060 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c1c2624e7aa50f5 server_cookie=41b17ac64f221937 in_seq=0 out_seq=0 2023-07-14T13:01:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.708+0000 7ffa0ffff700 10 client.16071 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.722+0000 7ffa0ffff700 1 -- 172.21.15.17:0/3373388994 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55976d6fcff0 con 0x55976d85dc50 2023-07-14T13:01:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.722+0000 7ffa0ffff700 10 client.16071 handle_command_reply: tid=0 2023-07-14T13:01:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.722+0000 7ffa4a466b80 1 client.16071 shutdown 2023-07-14T13:01:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.722+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3373388994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 msgr2=0x55976d7fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.722+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7fe380 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa24010790 tx=0x7ffa24010960 comp rx=0 tx=0).stop 2023-07-14T13:01:46.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.722+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3373388994 shutdown_connections 2023-07-14T13:01:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.722+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55976d85dc50 0x55976d860060 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.722+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55976d7f62d0 0x55976d7fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.722+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55976d64c6b0 0x55976d7fe380 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.722+0000 7ffa0ffff700 0 client.16071 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.722+0000 7ffa4a466b80 1 --2- 172.21.15.17:0/3373388994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55976d7f0580 0x55976d7fe8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.723+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3373388994 >> 172.21.15.17:0/3373388994 conn(0x55976d7e5be0 msgr2=0x55976d7f5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.723+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3373388994 shutdown_connections 2023-07-14T13:01:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.723+0000 7ffa4a466b80 1 -- 172.21.15.17:0/3373388994 wait complete. 2023-07-14T13:01:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.723+0000 7ffa4a466b80 20 client.16071 trim_cache size 0 max 16384 2023-07-14T13:01:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:01:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:01:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:01:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:01:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 -- 172.21.15.17:0/2403129824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ffa200a12c0 msgr2=0x7ffa200a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ffa200a12c0 0x7ffa200a3770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffa280062a0 tx=0x7ffa28006210 comp rx=0 tx=0).stop 2023-07-14T13:01:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 -- 172.21.15.17:0/2403129824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa300728b0 msgr2=0x7ffa30197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa300728b0 0x7ffa30197e70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400e9a0 tx=0x7ffa2400ecb0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 -- 172.21.15.17:0/2403129824 shutdown_connections 2023-07-14T13:01:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ffa200a12c0 0x7ffa200a3770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa3010c340 0x7ffa3019ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa300728b0 0x7ffa30197e70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 --2- 172.21.15.17:0/2403129824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa300731c0 0x7ffa301983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 -- 172.21.15.17:0/2403129824 >> 172.21.15.17:0/2403129824 conn(0x7ffa300fb600 msgr2=0x7ffa3010e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 -- 172.21.15.17:0/2403129824 shutdown_connections 2023-07-14T13:01:46.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:46.724+0000 7ffa36bff700 1 -- 172.21.15.17:0/2403129824 wait complete. 2023-07-14T13:01:47.091 INFO:teuthology.orchestra.run.smithi017.stderr:5800000 of 50000000 tuples (11%) done (elapsed 96.70 s, remaining 736.88 s) 2023-07-14T13:01:47.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:46 smithi017 ceph-mon[95536]: pgmap v64: 97 pgs: 97 active+clean; 1.3 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 34 MiB/s wr, 50 op/s 2023-07-14T13:01:47.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:46 smithi135 ceph-mon[97338]: pgmap v64: 97 pgs: 97 active+clean; 1.3 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 34 MiB/s wr, 50 op/s 2023-07-14T13:01:47.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:46 smithi131 ceph-mon[96953]: pgmap v64: 97 pgs: 97 active+clean; 1.3 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 34 MiB/s wr, 50 op/s 2023-07-14T13:01:48.443 INFO:teuthology.orchestra.run.smithi017.stderr:5900000 of 50000000 tuples (11%) done (elapsed 98.05 s, remaining 732.86 s) 2023-07-14T13:01:49.357 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:48 smithi017 ceph-mon[95536]: pgmap v65: 97 pgs: 97 active+clean; 1.3 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 23 MiB/s wr, 35 op/s 2023-07-14T13:01:49.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:48 smithi135 ceph-mon[97338]: pgmap v65: 97 pgs: 97 active+clean; 1.3 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 23 MiB/s wr, 35 op/s 2023-07-14T13:01:49.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:48 smithi131 ceph-mon[96953]: pgmap v65: 97 pgs: 97 active+clean; 1.3 GiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 23 MiB/s wr, 35 op/s 2023-07-14T13:01:50.303 INFO:teuthology.orchestra.run.smithi017.stderr:6000000 of 50000000 tuples (12%) done (elapsed 99.91 s, remaining 732.65 s) 2023-07-14T13:01:51.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:50 smithi017 ceph-mon[95536]: pgmap v66: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 33 MiB/s wr, 49 op/s 2023-07-14T13:01:51.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:50 smithi135 ceph-mon[97338]: pgmap v66: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 33 MiB/s wr, 49 op/s 2023-07-14T13:01:51.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:51 smithi131 ceph-mon[96953]: pgmap v66: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 33 MiB/s wr, 49 op/s 2023-07-14T13:01:52.188 INFO:teuthology.orchestra.run.smithi017.stderr:6100000 of 50000000 tuples (12%) done (elapsed 101.79 s, remaining 732.57 s) 2023-07-14T13:01:53.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:53 smithi017 ceph-mon[95536]: pgmap v67: 97 pgs: 97 active+clean; 1.4 GiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-07-14T13:01:53.406 INFO:teuthology.orchestra.run.smithi017.stderr:6200000 of 50000000 tuples (12%) done (elapsed 103.01 s, remaining 727.72 s) 2023-07-14T13:01:53.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:53 smithi135 ceph-mon[97338]: pgmap v67: 97 pgs: 97 active+clean; 1.4 GiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-07-14T13:01:53.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:53 smithi131 ceph-mon[96953]: pgmap v67: 97 pgs: 97 active+clean; 1.4 GiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-07-14T13:01:55.321 INFO:teuthology.orchestra.run.smithi017.stderr:6300000 of 50000000 tuples (12%) done (elapsed 104.93 s, remaining 727.81 s) 2023-07-14T13:01:55.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:55 smithi017 ceph-mon[95536]: pgmap v68: 97 pgs: 97 active+clean; 1.4 GiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 26 op/s 2023-07-14T13:01:55.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:55 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:01:55.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:55 smithi135 ceph-mon[97338]: pgmap v68: 97 pgs: 97 active+clean; 1.4 GiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 26 op/s 2023-07-14T13:01:55.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:55 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:01:55.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:55 smithi131 ceph-mon[96953]: pgmap v68: 97 pgs: 97 active+clean; 1.4 GiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 26 op/s 2023-07-14T13:01:55.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:55 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:01:56.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:56 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:01:56.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:56 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:01:56.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:56 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:01:56.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:56 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:01:56.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:56 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:01:56.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:56 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:01:56.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:56 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:01:56.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:56 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:01:56.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:56 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:01:57.171 INFO:teuthology.orchestra.run.smithi017.stderr:6400000 of 50000000 tuples (12%) done (elapsed 106.78 s, remaining 727.41 s) 2023-07-14T13:01:57.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:57 smithi017 ceph-mon[95536]: pgmap v69: 97 pgs: 97 active+clean; 1.5 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 MiB/s wr, 37 op/s 2023-07-14T13:01:57.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:57 smithi135 ceph-mon[97338]: pgmap v69: 97 pgs: 97 active+clean; 1.5 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 MiB/s wr, 37 op/s 2023-07-14T13:01:57.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:57 smithi131 ceph-mon[96953]: pgmap v69: 97 pgs: 97 active+clean; 1.5 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 MiB/s wr, 37 op/s 2023-07-14T13:01:58.513 INFO:teuthology.orchestra.run.smithi017.stderr:6500000 of 50000000 tuples (13%) done (elapsed 108.12 s, remaining 723.56 s) 2023-07-14T13:01:59.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:01:59 smithi017 ceph-mon[95536]: pgmap v70: 97 pgs: 97 active+clean; 1.5 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:01:59.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:01:59 smithi135 ceph-mon[97338]: pgmap v70: 97 pgs: 97 active+clean; 1.5 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:01:59.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:01:59 smithi131 ceph-mon[96953]: pgmap v70: 97 pgs: 97 active+clean; 1.5 GiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 25 op/s 2023-07-14T13:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.888+0000 7fb8a7fff700 1 -- 172.21.15.17:0/2171892565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a81002e0 msgr2=0x7fb8a810c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.888+0000 7fb8a7fff700 1 --2- 172.21.15.17:0/2171892565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a81002e0 0x7fb8a810c770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000b0a0 tx=0x7fb8a000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.888+0000 7fb8a7fff700 1 -- 172.21.15.17:0/2171892565 shutdown_connections 2023-07-14T13:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.888+0000 7fb8a7fff700 1 --2- 172.21.15.17:0/2171892565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a81002e0 0x7fb8a810c770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.888+0000 7fb8a7fff700 1 --2- 172.21.15.17:0/2171892565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8105940 0x7fb8a8105d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.888+0000 7fb8a7fff700 1 --2- 172.21.15.17:0/2171892565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8a80ff930 0x7fb8a80ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.888+0000 7fb8a7fff700 1 -- 172.21.15.17:0/2171892565 >> 172.21.15.17:0/2171892565 conn(0x7fb8a80fb450 msgr2=0x7fb8a80fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.888+0000 7fb8a7fff700 1 -- 172.21.15.17:0/2171892565 shutdown_connections 2023-07-14T13:01:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.888+0000 7fb8a7fff700 1 -- 172.21.15.17:0/2171892565 wait complete. 2023-07-14T13:01:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.889+0000 7fb8a7fff700 1 Processor -- start 2023-07-14T13:01:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.889+0000 7fb8a7fff700 1 -- start start 2023-07-14T13:01:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8a80ff930 0x7fb8a819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a81002e0 0x7fb8a819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8105940 0x7fb8a8195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a7fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8196000 con 0x7fb8a8105940 2023-07-14T13:01:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a7fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8196170 con 0x7fb8a81002e0 2023-07-14T13:01:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a7fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8196330 con 0x7fb8a80ff930 2023-07-14T13:01:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8105940 0x7fb8a8195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8105940 0x7fb8a8195990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58824/0 (socket says 172.21.15.17:58824) 2023-07-14T13:01:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a77fe700 1 -- 172.21.15.17:0/33806366 learned_addr learned my addr 172.21.15.17:0/33806366 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a67fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a81002e0 0x7fb8a819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a6ffd700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8a80ff930 0x7fb8a819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a77fe700 1 -- 172.21.15.17:0/33806366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8a80ff930 msgr2=0x7fb8a819b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a77fe700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8a80ff930 0x7fb8a819b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a77fe700 1 -- 172.21.15.17:0/33806366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a81002e0 msgr2=0x7fb8a819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a77fe700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a81002e0 0x7fb8a819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.890+0000 7fb8a77fe700 1 -- 172.21.15.17:0/33806366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a0009d00 con 0x7fb8a8105940 2023-07-14T13:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.891+0000 7fb8a77fe700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8105940 0x7fb8a8195990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000b070 tx=0x7fb8a000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.891+0000 7fb88ffff700 1 -- 172.21.15.17:0/33806366 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000e040 con 0x7fb8a8105940 2023-07-14T13:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.891+0000 7fb8a7fff700 1 -- 172.21.15.17:0/33806366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a81965b0 con 0x7fb8a8105940 2023-07-14T13:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.891+0000 7fb8a7fff700 1 -- 172.21.15.17:0/33806366 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a81a2910 con 0x7fb8a8105940 2023-07-14T13:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.891+0000 7fb88ffff700 1 -- 172.21.15.17:0/33806366 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8a0009480 con 0x7fb8a8105940 2023-07-14T13:01:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.891+0000 7fb88ffff700 1 -- 172.21.15.17:0/33806366 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0005040 con 0x7fb8a8105940 2023-07-14T13:01:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.896+0000 7fb88ffff700 1 -- 172.21.15.17:0/33806366 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb8a001d480 con 0x7fb8a8105940 2023-07-14T13:01:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.897+0000 7fb8c11e0b80 1 Processor -- start 2023-07-14T13:01:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.897+0000 7fb8c11e0b80 1 -- start start 2023-07-14T13:01:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfded340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfde75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb88ffff700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb8900a1340 0x7fb8900a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfdedcd0 0x55b6cfde7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfce8c50 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfd3b9e0 con 0x55b6cfded880 2023-07-14T13:01:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfd34e70 con 0x55b6cfdedcd0 2023-07-14T13:01:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb88ffff700 1 -- 172.21.15.17:0/33806366 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb8a00cdd00 con 0x7fb8a8105940 2023-07-14T13:01:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb8a67fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfded340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb8a67fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfded340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58838/0 (socket says 172.21.15.17:58838) 2023-07-14T13:01:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb8a67fc700 1 -- 172.21.15.17:0/522927177 learned_addr learned my addr 172.21.15.17:0/522927177 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.898+0000 7fb8a6ffd700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb8900a1340 0x7fb8900a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.899+0000 7fb8a77fe700 1 --2- 172.21.15.17:0/522927177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfdedcd0 0x55b6cfde7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.899+0000 7fb8a67fc700 1 --2- 172.21.15.17:0/522927177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfde75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.899+0000 7fb8a67fc700 1 -- 172.21.15.17:0/522927177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfdedcd0 msgr2=0x55b6cfde7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.899+0000 7fb8a67fc700 1 --2- 172.21.15.17:0/522927177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfdedcd0 0x55b6cfde7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.899+0000 7fb8a67fc700 1 -- 172.21.15.17:0/522927177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 msgr2=0x55b6cfde75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.899+0000 7fb8a67fc700 1 --2- 172.21.15.17:0/522927177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfde75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.899+0000 7fb8a67fc700 1 -- 172.21.15.17:0/522927177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6cfb62d80 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.899+0000 7fb8a67fc700 1 --2- 172.21.15.17:0/522927177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfded340 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009f00 tx=0x7fb89c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e428f754ea7ffc0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.899+0000 7fb8a6ffd700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb8900a1340 0x7fb8900a37f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8100a70 tx=0x7fb898009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:59.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.900+0000 7fb88d7fa700 1 -- 172.21.15.17:0/522927177 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c018070 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.900+0000 7fb88d7fa700 1 -- 172.21.15.17:0/522927177 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb89c013e30 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.900+0000 7fb88d7fa700 1 -- 172.21.15.17:0/522927177 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c005680 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.900+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/522927177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 msgr2=0x55b6cfded340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:59.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.900+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/522927177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfded340 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009f00 tx=0x7fb89c009260 comp rx=0 tx=0).stop 2023-07-14T13:01:59.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.901+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/522927177 shutdown_connections 2023-07-14T13:01:59.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.901+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/522927177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfdedcd0 0x55b6cfde7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.901+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/522927177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfded340 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.901+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/522927177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfde75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.901+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/522927177 >> 172.21.15.17:0/522927177 conn(0x55b6cfdd8d40 msgr2=0x55b6cfdde340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:59.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.901+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/522927177 shutdown_connections 2023-07-14T13:01:59.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.901+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/522927177 wait complete. 2023-07-14T13:01:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.901+0000 7fb8c11e0b80 1 -- start start 2023-07-14T13:01:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.902+0000 7fb8c11e0b80 1 Processor -- start 2023-07-14T13:01:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfdf71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 0x55b6cfdf0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfcd4a60 con 0x55b6cfdedcd0 2023-07-14T13:01:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfcd4760 con 0x55b6cfded880 2023-07-14T13:01:59.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfbb88c0 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8c11e0b80 10 client.0 _ll_register_callbacks cb 0x55b6cfcd2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8a6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8a77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 0x55b6cfdf0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8a6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:53664/0 (socket says 172.21.15.17:53664) 2023-07-14T13:01:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8a67fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfdf71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8a6ffd700 1 -- 172.21.15.17:0/2427434058 learned_addr learned my addr 172.21.15.17:0/2427434058 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:59.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.903+0000 7fb8a77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 0x55b6cfdf0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58842/0 (socket says 172.21.15.17:58842) 2023-07-14T13:01:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.904+0000 7fb8a67fc700 1 -- 172.21.15.17:0/2427434058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfc3f6b0 msgr2=0x55b6cfdf6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.904+0000 7fb8a67fc700 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.904+0000 7fb8a67fc700 1 -- 172.21.15.17:0/2427434058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 msgr2=0x55b6cfdf0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.904+0000 7fb8a67fc700 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 0x55b6cfdf0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.904+0000 7fb8a67fc700 1 -- 172.21.15.17:0/2427434058 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89c013460 con 0x55b6cfded880 2023-07-14T13:01:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.904+0000 7fb8a77fe700 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 0x55b6cfdf0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:59.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.904+0000 7fb8a67fc700 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfdf71d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009f00 tx=0x7fb89c005180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=559c73f6ce9248d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.904+0000 7fb88aff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:01:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.904+0000 7fb88aff5700 1 -- 172.21.15.17:0/2427434058 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c024070 con 0x55b6cfded880 2023-07-14T13:01:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.904+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/2427434058 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6cfc8e490 con 0x55b6cfded880 2023-07-14T13:01:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.904+0000 7fb88aff5700 1 -- 172.21.15.17:0/2427434058 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb89c004260 con 0x55b6cfded880 2023-07-14T13:01:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.905+0000 7fb88aff5700 1 -- 172.21.15.17:0/2427434058 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb89c018040 con 0x55b6cfded880 2023-07-14T13:01:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.905+0000 7fb8c11e0b80 10 client.25853 fetch_fsmap learned FSMap version 25 2023-07-14T13:01:59.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.905+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/2427434058 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55b6cfb4bc00 con 0x55b6cfded880 2023-07-14T13:01:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.905+0000 7fb88aff5700 1 -- 172.21.15.17:0/2427434058 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b6cfc8e490 con 0x55b6cfded880 2023-07-14T13:01:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.905+0000 7fb88aff5700 1 -- 172.21.15.17:0/2427434058 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb89c01d070 con 0x55b6cfded880 2023-07-14T13:01:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.905+0000 7fb8c11e0b80 10 client.25853 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:01:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.905+0000 7fb8c11e0b80 10 client.25853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.905+0000 7fb8c11e0b80 20 client.25853 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.905+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6cfe01150 0x55b6cfe03560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.905+0000 7fb8c11e0b80 4 client.25853 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:01:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.905+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/2427434058 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6cfd2de50 con 0x55b6cfe01150 2023-07-14T13:01:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.906+0000 7fb8a6ffd700 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6cfe01150 0x55b6cfe03560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.906+0000 7fb88aff5700 10 client.25853 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.906+0000 7fb8a6ffd700 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6cfe01150 0x55b6cfe03560 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecba972de9500242 server_cookie=7e2d1ee60fdcabcd in_seq=0 out_seq=0 2023-07-14T13:01:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.907+0000 7fb88aff5700 1 -- 172.21.15.17:0/2427434058 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b6cfd2de50 con 0x55b6cfe01150 2023-07-14T13:01:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.907+0000 7fb88aff5700 10 client.25853 handle_command_reply: tid=0 2023-07-14T13:01:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.907+0000 7fb8c11e0b80 1 client.25853 shutdown 2023-07-14T13:01:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/2427434058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 msgr2=0x55b6cfdf71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfdf71d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009f00 tx=0x7fb89c005180 comp rx=0 tx=0).stop 2023-07-14T13:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/2427434058 shutdown_connections 2023-07-14T13:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6cfe01150 0x55b6cfe03560 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 0x55b6cfdf0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb88aff5700 0 client.25853 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:59.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/2427434058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfdf71d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/2427434058 >> 172.21.15.17:0/2427434058 conn(0x55b6cfdd8d40 msgr2=0x55b6cfde2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/2427434058 shutdown_connections 2023-07-14T13:01:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/2427434058 wait complete. 2023-07-14T13:01:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.908+0000 7fb8c11e0b80 20 client.25853 trim_cache size 0 max 16384 2023-07-14T13:01:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.925+0000 7fb8c11e0b80 1 Processor -- start 2023-07-14T13:01:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.925+0000 7fb8c11e0b80 1 -- start start 2023-07-14T13:01:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.925+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.925+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfded880 0x55b6cfdec000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.925+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 0x55b6cfdec540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.925+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfddae60 con 0x55b6cfdedcd0 2023-07-14T13:01:59.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.925+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfdf1410 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.925+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfdd5d80 con 0x55b6cfded880 2023-07-14T13:01:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a6ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a6ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35350/0 (socket says 172.21.15.17:35350) 2023-07-14T13:01:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a6ffd700 1 -- 172.21.15.17:0/361222098 learned_addr learned my addr 172.21.15.17:0/361222098 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a77fe700 1 --2- 172.21.15.17:0/361222098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 0x55b6cfdec540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a67fc700 1 --2- 172.21.15.17:0/361222098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfded880 0x55b6cfdec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a6ffd700 1 -- 172.21.15.17:0/361222098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfded880 msgr2=0x55b6cfdec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a6ffd700 1 --2- 172.21.15.17:0/361222098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfded880 0x55b6cfdec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a6ffd700 1 -- 172.21.15.17:0/361222098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 msgr2=0x55b6cfdec540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a6ffd700 1 --2- 172.21.15.17:0/361222098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 0x55b6cfdec540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a6ffd700 1 -- 172.21.15.17:0/361222098 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6cfb891f0 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a77fe700 1 --2- 172.21.15.17:0/361222098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 0x55b6cfdec540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.926+0000 7fb8a6ffd700 1 --2- 172.21.15.17:0/361222098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf0ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55b6cfe03e70 tx=0x7fb898013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df394a7757ae2281 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.927+0000 7fb88dffb700 1 -- 172.21.15.17:0/361222098 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898025070 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.927+0000 7fb88dffb700 1 -- 172.21.15.17:0/361222098 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb898015070 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.927+0000 7fb88dffb700 1 -- 172.21.15.17:0/361222098 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898025b20 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.927+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/361222098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfc3f6b0 msgr2=0x55b6cfdf0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.927+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/361222098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf0ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55b6cfe03e70 tx=0x7fb898013000 comp rx=0 tx=0).stop 2023-07-14T13:01:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.928+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/361222098 shutdown_connections 2023-07-14T13:01:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.928+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/361222098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfdedcd0 0x55b6cfdec540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.928+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/361222098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf0ed0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.928+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/361222098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfded880 0x55b6cfdec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.928+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/361222098 >> 172.21.15.17:0/361222098 conn(0x55b6cfdd8d40 msgr2=0x55b6cfdf07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.928+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/361222098 shutdown_connections 2023-07-14T13:01:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.928+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/361222098 wait complete. 2023-07-14T13:01:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.928+0000 7fb8c11e0b80 1 -- start start 2023-07-14T13:01:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.928+0000 7fb8c11e0b80 1 Processor -- start 2023-07-14T13:01:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfdf4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8c11e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfdedcd0 0x55b6cfe54010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfdf5810 con 0x55b6cfc3f6b0 2023-07-14T13:01:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfe54550 con 0x55b6cfded880 2023-07-14T13:01:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8c11e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cfe546c0 con 0x55b6cfdedcd0 2023-07-14T13:01:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8c11e0b80 10 client.0 _ll_register_callbacks cb 0x7fb8a0007930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:01:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8a6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8a67fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfdf4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8a6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58850/0 (socket says 172.21.15.17:58850) 2023-07-14T13:01:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8a6ffd700 1 -- 172.21.15.17:0/1976515353 learned_addr learned my addr 172.21.15.17:0/1976515353 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:01:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.929+0000 7fb8a77fe700 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfdedcd0 0x55b6cfe54010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb8a67fc700 1 -- 172.21.15.17:0/1976515353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfdedcd0 msgr2=0x55b6cfe54010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb8a67fc700 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfdedcd0 0x55b6cfe54010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb8a67fc700 1 -- 172.21.15.17:0/1976515353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 msgr2=0x55b6cfdf49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:01:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb8a67fc700 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb8a67fc700 1 -- 172.21.15.17:0/1976515353 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a81a2910 con 0x55b6cfded880 2023-07-14T13:01:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb8a6ffd700 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:01:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb8a67fc700 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfdf4f20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0097c0 tx=0x7fb89c010760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6391738d362e3c22 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:01:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb88aff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:01:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb88aff5700 1 -- 172.21.15.17:0/1976515353 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c024020 con 0x55b6cfded880 2023-07-14T13:01:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/1976515353 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb89c013e30 con 0x55b6cfded880 2023-07-14T13:01:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb88aff5700 1 -- 172.21.15.17:0/1976515353 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb89c000e40 con 0x55b6cfded880 2023-07-14T13:01:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb88aff5700 1 -- 172.21.15.17:0/1976515353 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb89c018070 con 0x55b6cfded880 2023-07-14T13:01:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb8c11e0b80 10 client.25859 fetch_fsmap learned FSMap version 25 2023-07-14T13:01:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.930+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/1976515353 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fb898010b90 con 0x55b6cfded880 2023-07-14T13:01:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.931+0000 7fb88aff5700 1 -- 172.21.15.17:0/1976515353 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb89c013e30 con 0x55b6cfded880 2023-07-14T13:01:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.931+0000 7fb88aff5700 1 -- 172.21.15.17:0/1976515353 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb89c03a070 con 0x55b6cfded880 2023-07-14T13:01:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.931+0000 7fb8c11e0b80 10 client.25859 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:01:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.931+0000 7fb8c11e0b80 10 client.25859 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:01:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.931+0000 7fb8c11e0b80 20 client.25859 populate_metadata read hostname 'smithi017' 2023-07-14T13:01:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.931+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6cfe55a50 0x55b6cfe57e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:01:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.931+0000 7fb8c11e0b80 4 client.25859 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:01:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.931+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/1976515353 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b6cfcefff0 con 0x55b6cfe55a50 2023-07-14T13:01:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.931+0000 7fb8a6ffd700 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6cfe55a50 0x55b6cfe57e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:01:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.932+0000 7fb88aff5700 10 client.25859 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.932+0000 7fb8a6ffd700 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6cfe55a50 0x55b6cfe57e60 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbfbb2c3a33ec6ac server_cookie=e5d43be18a017191 in_seq=0 out_seq=0 2023-07-14T13:01:59.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb88aff5700 1 -- 172.21.15.17:0/1976515353 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b6cfcefff0 con 0x55b6cfe55a50 2023-07-14T13:01:59.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb88aff5700 10 client.25859 handle_command_reply: tid=0 2023-07-14T13:01:59.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 1 client.25859 shutdown 2023-07-14T13:01:59.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/1976515353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 msgr2=0x55b6cfdf4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfdf4f20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0097c0 tx=0x7fb89c010760 comp rx=0 tx=0).stop 2023-07-14T13:01:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/1976515353 shutdown_connections 2023-07-14T13:01:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6cfe55a50 0x55b6cfe57e60 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6cfdedcd0 0x55b6cfe54010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6cfc3f6b0 0x55b6cfdf49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 1 --2- 172.21.15.17:0/1976515353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cfded880 0x55b6cfdf4f20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb88aff5700 0 client.25859 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:01:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/1976515353 >> 172.21.15.17:0/1976515353 conn(0x55b6cfdd8d40 msgr2=0x55b6cfdeff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/1976515353 shutdown_connections 2023-07-14T13:01:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 1 -- 172.21.15.17:0/1976515353 wait complete. 2023-07-14T13:01:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.946+0000 7fb8c11e0b80 20 client.25859 trim_cache size 0 max 16384 2023-07-14T13:01:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:01:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:01:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:01:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:01:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 -- 172.21.15.17:0/33806366 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb8900a1340 msgr2=0x7fb8900a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb8900a1340 0x7fb8900a37f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8100a70 tx=0x7fb898009260 comp rx=0 tx=0).stop 2023-07-14T13:01:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 -- 172.21.15.17:0/33806366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8105940 msgr2=0x7fb8a8195990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:01:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8105940 0x7fb8a8195990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000b070 tx=0x7fb8a000bce0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 -- 172.21.15.17:0/33806366 shutdown_connections 2023-07-14T13:01:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb8900a1340 0x7fb8900a37f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a8105940 0x7fb8a8195990 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8a80ff930 0x7fb8a819b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 --2- 172.21.15.17:0/33806366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a81002e0 0x7fb8a819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:01:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 -- 172.21.15.17:0/33806366 >> 172.21.15.17:0/33806366 conn(0x7fb8a80fb450 msgr2=0x7fb8a80fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:01:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 -- 172.21.15.17:0/33806366 shutdown_connections 2023-07-14T13:01:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:01:59.947+0000 7fb8a7fff700 1 -- 172.21.15.17:0/33806366 wait complete. 2023-07-14T13:02:00.420 INFO:teuthology.orchestra.run.smithi017.stderr:6600000 of 50000000 tuples (13%) done (elapsed 110.02 s, remaining 723.49 s) 2023-07-14T13:02:01.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:01 smithi017 ceph-mon[95536]: pgmap v71: 97 pgs: 97 active+clean; 1.5 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 MiB/s wr, 36 op/s 2023-07-14T13:02:01.449 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:01 smithi135 ceph-mon[97338]: pgmap v71: 97 pgs: 97 active+clean; 1.5 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 MiB/s wr, 36 op/s 2023-07-14T13:02:01.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:01 smithi131 ceph-mon[96953]: pgmap v71: 97 pgs: 97 active+clean; 1.5 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 MiB/s wr, 36 op/s 2023-07-14T13:02:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:6700000 of 50000000 tuples (13%) done (elapsed 111.92 s, remaining 723.31 s) 2023-07-14T13:02:03.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:03 smithi017 ceph-mon[95536]: pgmap v72: 97 pgs: 97 active+clean; 1.5 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-07-14T13:02:03.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:03 smithi135 ceph-mon[97338]: pgmap v72: 97 pgs: 97 active+clean; 1.5 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-07-14T13:02:03.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:03 smithi131 ceph-mon[96953]: pgmap v72: 97 pgs: 97 active+clean; 1.5 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-07-14T13:02:03.601 INFO:teuthology.orchestra.run.smithi017.stderr:6800000 of 50000000 tuples (13%) done (elapsed 113.21 s, remaining 719.19 s) 2023-07-14T13:02:05.259 INFO:teuthology.orchestra.run.smithi017.stderr:6900000 of 50000000 tuples (13%) done (elapsed 114.86 s, remaining 717.48 s) 2023-07-14T13:02:05.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:05 smithi017 ceph-mon[95536]: pgmap v73: 97 pgs: 97 active+clean; 1.5 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 21 op/s 2023-07-14T13:02:05.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:05 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:02:05.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:05 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:05.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:05 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:05.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:05 smithi135 ceph-mon[97338]: pgmap v73: 97 pgs: 97 active+clean; 1.5 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 21 op/s 2023-07-14T13:02:05.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:05 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:02:05.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:05 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:05.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:05 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:05.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:05 smithi131 ceph-mon[96953]: pgmap v73: 97 pgs: 97 active+clean; 1.5 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 21 op/s 2023-07-14T13:02:05.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:05 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:02:05.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:05 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:05.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:05 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:06.557 INFO:teuthology.orchestra.run.smithi017.stderr:7000000 of 50000000 tuples (14%) done (elapsed 116.16 s, remaining 713.56 s) 2023-07-14T13:02:07.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:07 smithi017 ceph-mon[95536]: pgmap v74: 97 pgs: 97 active+clean; 1.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 35 MiB/s wr, 55 op/s 2023-07-14T13:02:07.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:07 smithi135 ceph-mon[97338]: pgmap v74: 97 pgs: 97 active+clean; 1.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 35 MiB/s wr, 55 op/s 2023-07-14T13:02:07.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:07 smithi131 ceph-mon[96953]: pgmap v74: 97 pgs: 97 active+clean; 1.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 35 MiB/s wr, 55 op/s 2023-07-14T13:02:08.496 INFO:teuthology.orchestra.run.smithi017.stderr:7100000 of 50000000 tuples (14%) done (elapsed 118.10 s, remaining 713.59 s) 2023-07-14T13:02:09.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:09 smithi017 ceph-mon[95536]: pgmap v75: 97 pgs: 97 active+clean; 1.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 23 MiB/s wr, 44 op/s 2023-07-14T13:02:09.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:09 smithi135 ceph-mon[97338]: pgmap v75: 97 pgs: 97 active+clean; 1.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 23 MiB/s wr, 44 op/s 2023-07-14T13:02:09.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:09 smithi131 ceph-mon[96953]: pgmap v75: 97 pgs: 97 active+clean; 1.6 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 23 MiB/s wr, 44 op/s 2023-07-14T13:02:10.401 INFO:teuthology.orchestra.run.smithi017.stderr:7200000 of 50000000 tuples (14%) done (elapsed 120.00 s, remaining 713.36 s) 2023-07-14T13:02:11.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:11 smithi017 ceph-mon[95536]: pgmap v76: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 35 MiB/s wr, 54 op/s 2023-07-14T13:02:11.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:11 smithi135 ceph-mon[97338]: pgmap v76: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 35 MiB/s wr, 54 op/s 2023-07-14T13:02:11.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:11 smithi131 ceph-mon[96953]: pgmap v76: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 35 MiB/s wr, 54 op/s 2023-07-14T13:02:11.740 INFO:teuthology.orchestra.run.smithi017.stderr:7300000 of 50000000 tuples (14%) done (elapsed 121.34 s, remaining 709.78 s) 2023-07-14T13:02:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.119+0000 7fcbc27ff700 1 -- 172.21.15.17:0/1305674738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc0ffb00 msgr2=0x7fcbbc0fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.119+0000 7fcbc27ff700 1 --2- 172.21.15.17:0/1305674738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc0ffb00 0x7fcbbc0fff70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009990 tx=0x7fcbb0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.119+0000 7fcbc27ff700 1 -- 172.21.15.17:0/1305674738 shutdown_connections 2023-07-14T13:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.119+0000 7fcbc27ff700 1 --2- 172.21.15.17:0/1305674738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbbc1004b0 0x7fcbbc10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.119+0000 7fcbc27ff700 1 --2- 172.21.15.17:0/1305674738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbbc105b10 0x7fcbbc105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.119+0000 7fcbc27ff700 1 --2- 172.21.15.17:0/1305674738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc0ffb00 0x7fcbbc0fff70 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.119+0000 7fcbc27ff700 1 -- 172.21.15.17:0/1305674738 >> 172.21.15.17:0/1305674738 conn(0x7fcbbc0fb600 msgr2=0x7fcbbc0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:13.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.119+0000 7fcbc27ff700 1 -- 172.21.15.17:0/1305674738 shutdown_connections 2023-07-14T13:02:13.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.119+0000 7fcbc27ff700 1 -- 172.21.15.17:0/1305674738 wait complete. 2023-07-14T13:02:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.121+0000 7fcbc27ff700 1 Processor -- start 2023-07-14T13:02:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.121+0000 7fcbc27ff700 1 -- start start 2023-07-14T13:02:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.121+0000 7fcbc27ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbbc0ffb00 0x7fcbbc0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.121+0000 7fcbc27ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc1004b0 0x7fcbbc072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.121+0000 7fcbc27ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbbc105b10 0x7fcbbc1a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.121+0000 7fcbc27ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc1a4240 con 0x7fcbbc1004b0 2023-07-14T13:02:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.121+0000 7fcbc27ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc1a4380 con 0x7fcbbc105b10 2023-07-14T13:02:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.121+0000 7fcbc27ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc1a44f0 con 0x7fcbbc0ffb00 2023-07-14T13:02:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.122+0000 7fcbbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc1004b0 0x7fcbbc072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.122+0000 7fcbbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc1004b0 0x7fcbbc072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50246/0 (socket says 172.21.15.17:50246) 2023-07-14T13:02:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.122+0000 7fcbbb7fe700 1 -- 172.21.15.17:0/3242552312 learned_addr learned my addr 172.21.15.17:0/3242552312 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.122+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbbc0ffb00 0x7fcbbc0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.122+0000 7fcbc0d9c700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbbc105b10 0x7fcbbc1a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.122+0000 7fcbbb7fe700 1 -- 172.21.15.17:0/3242552312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbbc0ffb00 msgr2=0x7fcbbc0729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.122+0000 7fcbbb7fe700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbbc0ffb00 0x7fcbbc0729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.122+0000 7fcbbb7fe700 1 -- 172.21.15.17:0/3242552312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbbc105b10 msgr2=0x7fcbbc1a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.122+0000 7fcbbb7fe700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbbc105b10 0x7fcbbc1a3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.122+0000 7fcbbb7fe700 1 -- 172.21.15.17:0/3242552312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb00095f0 con 0x7fcbbc1004b0 2023-07-14T13:02:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.122+0000 7fcbc0d9c700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbbc105b10 0x7fcbbc1a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:02:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.123+0000 7fcbbb7fe700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc1004b0 0x7fcbbc072f30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0005910 tx=0x7fcbb00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.123+0000 7fcbb97fa700 1 -- 172.21.15.17:0/3242552312 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb001d070 con 0x7fcbbc1004b0 2023-07-14T13:02:13.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.123+0000 7fcbc27ff700 1 -- 172.21.15.17:0/3242552312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc1a4770 con 0x7fcbbc1004b0 2023-07-14T13:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.123+0000 7fcbb97fa700 1 -- 172.21.15.17:0/3242552312 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbb0021410 con 0x7fcbbc1004b0 2023-07-14T13:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.123+0000 7fcbb97fa700 1 -- 172.21.15.17:0/3242552312 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0017650 con 0x7fcbbc1004b0 2023-07-14T13:02:13.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.123+0000 7fcbc27ff700 1 -- 172.21.15.17:0/3242552312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc1a4c20 con 0x7fcbbc1004b0 2023-07-14T13:02:13.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.127+0000 7fcbb97fa700 1 -- 172.21.15.17:0/3242552312 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcbb000fb00 con 0x7fcbbc1004b0 2023-07-14T13:02:13.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.128+0000 7fcbd60dbb80 1 Processor -- start 2023-07-14T13:02:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbd60dbb80 1 -- start start 2023-07-14T13:02:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbb97fa700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcba40a12c0 0x7fcba40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbb97fa700 1 -- 172.21.15.17:0/3242552312 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcbb00ce1a0 con 0x7fcbbc1004b0 2023-07-14T13:02:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 0x5593d0185d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d01862d0 0x5593d0180040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d0180580 0x5593d01809d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593d0085c50 con 0x5593d01862d0 2023-07-14T13:02:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593d00d89e0 con 0x5593d0180580 2023-07-14T13:02:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593d00d1e70 con 0x5593cffdc6b0 2023-07-14T13:02:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbc0d9c700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcba40a12c0 0x7fcba40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d01862d0 0x5593d0180040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbbbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 0x5593d0185d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d01862d0 0x5593d0180040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50258/0 (socket says 172.21.15.17:50258) 2023-07-14T13:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbbb7fe700 1 -- 172.21.15.17:0/912700756 learned_addr learned my addr 172.21.15.17:0/912700756 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.129+0000 7fcbbbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 0x5593d0185d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54822/0 (socket says 172.21.15.17:54822) 2023-07-14T13:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.130+0000 7fcbc0d9c700 1 --2- 172.21.15.17:0/912700756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d0180580 0x5593d01809d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.130+0000 7fcbbbfff700 1 -- 172.21.15.17:0/912700756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d0180580 msgr2=0x5593d01809d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.130+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/912700756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d0180580 0x5593d01809d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.130+0000 7fcbbbfff700 1 -- 172.21.15.17:0/912700756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d01862d0 msgr2=0x5593d0180040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.130+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/912700756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d01862d0 0x5593d0180040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.130+0000 7fcbbbfff700 1 -- 172.21.15.17:0/912700756 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593cfeffd80 con 0x5593cffdc6b0 2023-07-14T13:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.130+0000 7fcbbb7fe700 1 --2- 172.21.15.17:0/912700756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d01862d0 0x5593d0180040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.130+0000 7fcbc0d9c700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcba40a12c0 0x7fcba40a3770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009690 tx=0x7fcbb4009bd0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.130+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/912700756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 0x5593d0185d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009cb0 tx=0x7fcbac0058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=676d90a2f6b232c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.131+0000 7fcba27fc700 1 -- 172.21.15.17:0/912700756 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac011ce0 con 0x5593cffdc6b0 2023-07-14T13:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.131+0000 7fcba27fc700 1 -- 172.21.15.17:0/912700756 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbac011e40 con 0x5593cffdc6b0 2023-07-14T13:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.131+0000 7fcba27fc700 1 -- 172.21.15.17:0/912700756 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac003e60 con 0x5593cffdc6b0 2023-07-14T13:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.131+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/912700756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 msgr2=0x5593d0185d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.131+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/912700756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 0x5593d0185d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009cb0 tx=0x7fcbac0058e0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.132+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/912700756 shutdown_connections 2023-07-14T13:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.132+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/912700756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d0180580 0x5593d01809d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.132+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/912700756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 0x5593d0185d90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.132+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/912700756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d01862d0 0x5593d0180040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.132+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/912700756 >> 172.21.15.17:0/912700756 conn(0x5593d0175be0 msgr2=0x5593d017af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.132+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/912700756 shutdown_connections 2023-07-14T13:02:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.132+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/912700756 wait complete. 2023-07-14T13:02:13.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.132+0000 7fcbd60dbb80 1 -- start start 2023-07-14T13:02:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.132+0000 7fcbd60dbb80 1 Processor -- start 2023-07-14T13:02:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.133+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d018c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.133+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593d0180580 0x5593d0189880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.133+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d01862d0 0x5593d0189fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.133+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593d0071a60 con 0x5593cffdc6b0 2023-07-14T13:02:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.133+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593d0071760 con 0x5593d01862d0 2023-07-14T13:02:13.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.133+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593cff558c0 con 0x5593d0180580 2023-07-14T13:02:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.133+0000 7fcbd60dbb80 10 client.0 _ll_register_callbacks cb 0x5593d006f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.133+0000 7fcbbbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d018c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.133+0000 7fcbbbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d018c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50262/0 (socket says 172.21.15.17:50262) 2023-07-14T13:02:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.133+0000 7fcbbbfff700 1 -- 172.21.15.17:0/3255141014 learned_addr learned my addr 172.21.15.17:0/3255141014 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcbbb7fe700 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593d0180580 0x5593d0189880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcbbbfff700 1 -- 172.21.15.17:0/3255141014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593d0180580 msgr2=0x5593d0189880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593d0180580 0x5593d0189880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcbbbfff700 1 -- 172.21.15.17:0/3255141014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d01862d0 msgr2=0x5593d0189fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d01862d0 0x5593d0189fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcbbbfff700 1 -- 172.21.15.17:0/3255141014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc1a4c20 con 0x5593cffdc6b0 2023-07-14T13:02:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcbbb7fe700 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593d0180580 0x5593d0189880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:02:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d018c600 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009310 tx=0x7fcbac003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f55d9493d03369b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcb9b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/3255141014 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac01a750 con 0x5593cffdc6b0 2023-07-14T13:02:13.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3255141014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593d002b490 con 0x5593cffdc6b0 2023-07-14T13:02:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.134+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/3255141014 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcbac01a8b0 con 0x5593cffdc6b0 2023-07-14T13:02:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.135+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/3255141014 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbac01aa70 con 0x5593cffdc6b0 2023-07-14T13:02:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.135+0000 7fcbd60dbb80 10 client.16101 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.135+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3255141014 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fcbac0098e0 con 0x5593cffdc6b0 2023-07-14T13:02:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.135+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/3255141014 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5593d002b490 con 0x5593cffdc6b0 2023-07-14T13:02:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.135+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/3255141014 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcbac023c00 con 0x5593cffdc6b0 2023-07-14T13:02:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.135+0000 7fcbd60dbb80 10 client.16101 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:13.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.135+0000 7fcbd60dbb80 10 client.16101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.135+0000 7fcbd60dbb80 20 client.16101 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.135+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593d0199ab0 0x5593d019bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.136+0000 7fcbd60dbb80 4 client.16101 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.136+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3255141014 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5593d00cae50 con 0x5593d0199ab0 2023-07-14T13:02:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.136+0000 7fcbbb7fe700 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593d0199ab0 0x5593d019bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.136+0000 7fcb9b7fe700 10 client.16101 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:13.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.136+0000 7fcbbb7fe700 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593d0199ab0 0x5593d019bec0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=212f34edbfbb7a7d server_cookie=48eff3835ef9ffed in_seq=0 out_seq=0 2023-07-14T13:02:13.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.137+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/3255141014 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5593d00cae50 con 0x5593d0199ab0 2023-07-14T13:02:13.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.137+0000 7fcb9b7fe700 10 client.16101 handle_command_reply: tid=0 2023-07-14T13:02:13.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.137+0000 7fcbd60dbb80 1 client.16101 shutdown 2023-07-14T13:02:13.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3255141014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 msgr2=0x5593d018c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:13.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d018c600 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009310 tx=0x7fcbac003730 comp rx=0 tx=0).stop 2023-07-14T13:02:13.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3255141014 shutdown_connections 2023-07-14T13:02:13.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593d0199ab0 0x5593d019bec0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d01862d0 0x5593d0189fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d018c600 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcb9b7fe700 0 client.16101 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/3255141014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593d0180580 0x5593d0189880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3255141014 >> 172.21.15.17:0/3255141014 conn(0x5593d0175be0 msgr2=0x5593d017a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3255141014 shutdown_connections 2023-07-14T13:02:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3255141014 wait complete. 2023-07-14T13:02:13.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.138+0000 7fcbd60dbb80 20 client.16101 trim_cache size 0 max 16384 2023-07-14T13:02:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.154+0000 7fcbd60dbb80 1 Processor -- start 2023-07-14T13:02:13.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.154+0000 7fcbd60dbb80 1 -- start start 2023-07-14T13:02:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.154+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d0180040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.154+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d0180580 0x5593d0189830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.154+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593d01862d0 0x5593d017ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.154+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593d017cbb0 con 0x5593cffdc6b0 2023-07-14T13:02:13.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.154+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593d0196550 con 0x5593d0180580 2023-07-14T13:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.154+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593d018a640 con 0x5593d01862d0 2023-07-14T13:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbbbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d0180040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbbbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d0180040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50270/0 (socket says 172.21.15.17:50270) 2023-07-14T13:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbbbfff700 1 -- 172.21.15.17:0/3340169532 learned_addr learned my addr 172.21.15.17:0/3340169532 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbc0d9c700 1 --2- 172.21.15.17:0/3340169532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593d01862d0 0x5593d017ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbbb7fe700 1 --2- 172.21.15.17:0/3340169532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d0180580 0x5593d0189830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbbbfff700 1 -- 172.21.15.17:0/3340169532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593d01862d0 msgr2=0x5593d017ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/3340169532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593d01862d0 0x5593d017ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbbbfff700 1 -- 172.21.15.17:0/3340169532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d0180580 msgr2=0x5593d0189830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/3340169532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d0180580 0x5593d0189830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbbbfff700 1 -- 172.21.15.17:0/3340169532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593d01a0ab0 con 0x5593cffdc6b0 2023-07-14T13:02:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbbb7fe700 1 --2- 172.21.15.17:0/3340169532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d0180580 0x5593d0189830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:02:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.155+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/3340169532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d0180040 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fcbac005c50 tx=0x7fcbac005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c614914fc9c93e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.156+0000 7fcba2ffd700 1 -- 172.21.15.17:0/3340169532 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac003dc0 con 0x5593cffdc6b0 2023-07-14T13:02:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.156+0000 7fcba2ffd700 1 -- 172.21.15.17:0/3340169532 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbac003850 con 0x5593cffdc6b0 2023-07-14T13:02:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.156+0000 7fcba2ffd700 1 -- 172.21.15.17:0/3340169532 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac023af0 con 0x5593cffdc6b0 2023-07-14T13:02:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.156+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3340169532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 msgr2=0x5593d0180040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.156+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/3340169532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d0180040 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fcbac005c50 tx=0x7fcbac005a00 comp rx=0 tx=0).stop 2023-07-14T13:02:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.156+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3340169532 shutdown_connections 2023-07-14T13:02:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.156+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/3340169532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593d01862d0 0x5593d017ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.156+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/3340169532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593cffdc6b0 0x5593d0180040 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.156+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/3340169532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d0180580 0x5593d0189830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.156+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3340169532 >> 172.21.15.17:0/3340169532 conn(0x5593d0175be0 msgr2=0x5593d0189120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.157+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3340169532 shutdown_connections 2023-07-14T13:02:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.157+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/3340169532 wait complete. 2023-07-14T13:02:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.157+0000 7fcbd60dbb80 1 -- start start 2023-07-14T13:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.157+0000 7fcbd60dbb80 1 Processor -- start 2023-07-14T13:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.158+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 0x5593d018ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.158+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d0180580 0x5593d018f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.158+0000 7fcbd60dbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d01862d0 0x5593d018f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.158+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593d01ecb10 con 0x5593d0180580 2023-07-14T13:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.158+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593d01ecc80 con 0x5593d01862d0 2023-07-14T13:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.158+0000 7fcbd60dbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593d01ece40 con 0x5593cffdc6b0 2023-07-14T13:02:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.158+0000 7fcbd60dbb80 10 client.0 _ll_register_callbacks cb 0x7fcbb00217f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d0180580 0x5593d018f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d0180580 0x5593d018f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50282/0 (socket says 172.21.15.17:50282) 2023-07-14T13:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbbb7fe700 1 -- 172.21.15.17:0/2937866659 learned_addr learned my addr 172.21.15.17:0/2937866659 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbc0d9c700 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d01862d0 0x5593d018f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 0x5593d018ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbc0d9c700 1 -- 172.21.15.17:0/2937866659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 msgr2=0x5593d018ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbc0d9c700 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 0x5593d018ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbc0d9c700 1 -- 172.21.15.17:0/2937866659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d0180580 msgr2=0x5593d018f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbc0d9c700 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d0180580 0x5593d018f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbc0d9c700 1 -- 172.21.15.17:0/2937866659 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac0098e0 con 0x5593d01862d0 2023-07-14T13:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbbb7fe700 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d0180580 0x5593d018f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcbc0d9c700 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d01862d0 0x5593d018f6f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x5593d00caf90 tx=0x7fcbb4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec4d53d3e0437bce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.159+0000 7fcb9b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:02:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.160+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/2937866659 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4009230 con 0x5593d01862d0 2023-07-14T13:02:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.160+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/2937866659 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcbac011e40 con 0x5593d01862d0 2023-07-14T13:02:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.160+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/2937866659 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcbb4014040 con 0x5593d01862d0 2023-07-14T13:02:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.160+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/2937866659 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbb401ab80 con 0x5593d01862d0 2023-07-14T13:02:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.160+0000 7fcbd60dbb80 10 client.25868 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.160+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/2937866659 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5593cfee8c00 con 0x5593d01862d0 2023-07-14T13:02:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.161+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/2937866659 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbac011e40 con 0x5593d01862d0 2023-07-14T13:02:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.161+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/2937866659 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcbb4025a80 con 0x5593d01862d0 2023-07-14T13:02:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.161+0000 7fcbd60dbb80 10 client.25868 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.161+0000 7fcbd60dbb80 10 client.25868 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.161+0000 7fcbd60dbb80 20 client.25868 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.161+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593d01ee5d0 0x5593d01f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.161+0000 7fcbd60dbb80 4 client.25868 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:02:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.161+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/2937866659 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5593d008cff0 con 0x5593d01ee5d0 2023-07-14T13:02:13.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.162+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593d01ee5d0 0x5593d01f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.162+0000 7fcb9b7fe700 10 client.25868 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.162+0000 7fcbbbfff700 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593d01ee5d0 0x5593d01f09e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebcdae4669a637e4 server_cookie=a5766163681109e in_seq=0 out_seq=0 2023-07-14T13:02:13.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.179+0000 7fcb9b7fe700 1 -- 172.21.15.17:0/2937866659 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5593d008cff0 con 0x5593d01ee5d0 2023-07-14T13:02:13.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.179+0000 7fcb9b7fe700 10 client.25868 handle_command_reply: tid=0 2023-07-14T13:02:13.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.179+0000 7fcbd60dbb80 1 client.25868 shutdown 2023-07-14T13:02:13.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/2937866659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d01862d0 msgr2=0x5593d018f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:13.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d01862d0 0x5593d018f6f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x5593d00caf90 tx=0x7fcbb4004ad0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/2937866659 shutdown_connections 2023-07-14T13:02:13.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593d01ee5d0 0x5593d01f09e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593d01862d0 0x5593d018f6f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593cffdc6b0 0x5593d018ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcb9b7fe700 0 client.25868 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:13.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcbd60dbb80 1 --2- 172.21.15.17:0/2937866659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593d0180580 0x5593d018f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/2937866659 >> 172.21.15.17:0/2937866659 conn(0x5593d0175be0 msgr2=0x5593d01852e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:13.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/2937866659 shutdown_connections 2023-07-14T13:02:13.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcbd60dbb80 1 -- 172.21.15.17:0/2937866659 wait complete. 2023-07-14T13:02:13.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.180+0000 7fcbd60dbb80 20 client.25868 trim_cache size 0 max 16384 2023-07-14T13:02:13.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:02:13.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:02:13.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:02:13.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:02:13.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 -- 172.21.15.17:0/3242552312 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcba40a12c0 msgr2=0x7fcba40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:13.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcba40a12c0 0x7fcba40a3770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009690 tx=0x7fcbb4009bd0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 -- 172.21.15.17:0/3242552312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc1004b0 msgr2=0x7fcbbc072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:13.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc1004b0 0x7fcbbc072f30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0005910 tx=0x7fcbb00047b0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 -- 172.21.15.17:0/3242552312 shutdown_connections 2023-07-14T13:02:13.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcba40a12c0 0x7fcba40a3770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbbc105b10 0x7fcbbc1a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbbc0ffb00 0x7fcbbc0729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 --2- 172.21.15.17:0/3242552312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbbc1004b0 0x7fcbbc072f30 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:13.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 -- 172.21.15.17:0/3242552312 >> 172.21.15.17:0/3242552312 conn(0x7fcbbc0fb600 msgr2=0x7fcbbc0fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:13.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 -- 172.21.15.17:0/3242552312 shutdown_connections 2023-07-14T13:02:13.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:13.181+0000 7fcbc27ff700 1 -- 172.21.15.17:0/3242552312 wait complete. 2023-07-14T13:02:13.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:13 smithi017 ceph-mon[95536]: pgmap v77: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-07-14T13:02:13.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:13 smithi135 ceph-mon[97338]: pgmap v77: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-07-14T13:02:13.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:13 smithi131 ceph-mon[96953]: pgmap v77: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-07-14T13:02:13.666 INFO:teuthology.orchestra.run.smithi017.stderr:7400000 of 50000000 tuples (14%) done (elapsed 123.27 s, remaining 709.64 s) 2023-07-14T13:02:14.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:14 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:02:14.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:14 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:02:14.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:14 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:02:14.673 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:02:14.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.879+0000 7fe063fff700 1 -- 172.21.15.17:0/3818869239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe064100380 msgr2=0x7fe06410c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:14.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.879+0000 7fe063fff700 1 --2- 172.21.15.17:0/3818869239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe064100380 0x7fe06410c810 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00b0a0 tx=0x7fe05c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.879+0000 7fe063fff700 1 -- 172.21.15.17:0/3818869239 shutdown_connections 2023-07-14T13:02:14.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.879+0000 7fe063fff700 1 --2- 172.21.15.17:0/3818869239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe064100380 0x7fe06410c810 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.879+0000 7fe063fff700 1 --2- 172.21.15.17:0/3818869239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0641059e0 0x7fe064105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.879+0000 7fe063fff700 1 --2- 172.21.15.17:0/3818869239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0640ff9d0 0x7fe0640ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.879+0000 7fe063fff700 1 -- 172.21.15.17:0/3818869239 >> 172.21.15.17:0/3818869239 conn(0x7fe0640fb4b0 msgr2=0x7fe0640fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:14.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.879+0000 7fe063fff700 1 -- 172.21.15.17:0/3818869239 shutdown_connections 2023-07-14T13:02:14.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.879+0000 7fe063fff700 1 -- 172.21.15.17:0/3818869239 wait complete. 2023-07-14T13:02:14.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.881+0000 7fe063fff700 1 Processor -- start 2023-07-14T13:02:14.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.881+0000 7fe063fff700 1 -- start start 2023-07-14T13:02:14.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe063fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0640ff9d0 0x7fe06419d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe063fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe064100380 0x7fe06419ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe063fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0641059e0 0x7fe064197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe063fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe064197f90 con 0x7fe064100380 2023-07-14T13:02:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe063fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe064198100 con 0x7fe0640ff9d0 2023-07-14T13:02:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe063fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0641982c0 con 0x7fe0641059e0 2023-07-14T13:02:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe0627fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe064100380 0x7fe06419ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe0637fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0641059e0 0x7fe064197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe062ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0640ff9d0 0x7fe06419d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe0637fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0641059e0 0x7fe064197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59660/0 (socket says 172.21.15.17:59660) 2023-07-14T13:02:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe0627fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe064100380 0x7fe06419ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53742/0 (socket says 172.21.15.17:53742) 2023-07-14T13:02:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe062ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0640ff9d0 0x7fe06419d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40028/0 (socket says 172.21.15.17:40028) 2023-07-14T13:02:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.882+0000 7fe0637fe700 1 -- 172.21.15.17:0/1049003650 learned_addr learned my addr 172.21.15.17:0/1049003650 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.883+0000 7fe0637fe700 1 -- 172.21.15.17:0/1049003650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0640ff9d0 msgr2=0x7fe06419d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.883+0000 7fe0637fe700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0640ff9d0 0x7fe06419d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.883+0000 7fe0637fe700 1 -- 172.21.15.17:0/1049003650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe064100380 msgr2=0x7fe06419ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.883+0000 7fe0637fe700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe064100380 0x7fe06419ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.883+0000 7fe0637fe700 1 -- 172.21.15.17:0/1049003650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c009d00 con 0x7fe0641059e0 2023-07-14T13:02:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.883+0000 7fe0637fe700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0641059e0 0x7fe064197920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00b780 tx=0x7fe05c00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:14.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.883+0000 7fe04bfff700 1 -- 172.21.15.17:0/1049003650 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c00e040 con 0x7fe0641059e0 2023-07-14T13:02:14.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.883+0000 7fe063fff700 1 -- 172.21.15.17:0/1049003650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe064198540 con 0x7fe0641059e0 2023-07-14T13:02:14.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.883+0000 7fe063fff700 1 -- 172.21.15.17:0/1049003650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0641a48a0 con 0x7fe0641059e0 2023-07-14T13:02:14.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.883+0000 7fe04bfff700 1 -- 172.21.15.17:0/1049003650 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe05c004e60 con 0x7fe0641059e0 2023-07-14T13:02:14.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.883+0000 7fe04bfff700 1 -- 172.21.15.17:0/1049003650 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0052a0 con 0x7fe0641059e0 2023-07-14T13:02:14.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.888+0000 7fe04bfff700 1 -- 172.21.15.17:0/1049003650 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe05c01d470 con 0x7fe0641059e0 2023-07-14T13:02:14.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.889+0000 7fe07cf2fb80 1 Processor -- start 2023-07-14T13:02:14.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.889+0000 7fe07cf2fb80 1 -- start start 2023-07-14T13:02:14.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.889+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c60718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c607b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c607bd30 0x5604c607e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c5f76cb0 con 0x5604c607bd30 2023-07-14T13:02:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c5fc9a40 con 0x5604c6071e00 2023-07-14T13:02:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c5fc2ed0 con 0x5604c60714f0 2023-07-14T13:02:14.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe0627fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c607bd30 0x5604c607e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe062ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c607b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe062ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c607b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40032/0 (socket says 172.21.15.17:40032) 2023-07-14T13:02:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe0627fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c60718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe062ffd700 1 -- 172.21.15.17:0/2623851650 learned_addr learned my addr 172.21.15.17:0/2623851650 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe062ffd700 1 -- 172.21.15.17:0/2623851650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 msgr2=0x5604c60718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe062ffd700 1 --2- 172.21.15.17:0/2623851650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c60718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe04bfff700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe04c0a1360 0x7fe04c0a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe062ffd700 1 -- 172.21.15.17:0/2623851650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c607bd30 msgr2=0x5604c607e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:14.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.890+0000 7fe062ffd700 1 --2- 172.21.15.17:0/2623851650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c607bd30 0x5604c607e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.891+0000 7fe062ffd700 1 -- 172.21.15.17:0/2623851650 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604c5df0de0 con 0x5604c6071e00 2023-07-14T13:02:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.891+0000 7fe04bfff700 1 -- 172.21.15.17:0/1049003650 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe05c0ce1d0 con 0x7fe0641059e0 2023-07-14T13:02:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.891+0000 7fe062ffd700 1 --2- 172.21.15.17:0/2623851650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c607b7f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe05400bd40 tx=0x7fe0540106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b3f6c7734db2a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.891+0000 7fe0637fe700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe04c0a1360 0x7fe04c0a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.891+0000 7fe0497fa700 1 -- 172.21.15.17:0/2623851650 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054010e10 con 0x5604c6071e00 2023-07-14T13:02:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.891+0000 7fe0497fa700 1 -- 172.21.15.17:0/2623851650 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe054015070 con 0x5604c6071e00 2023-07-14T13:02:14.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.891+0000 7fe0497fa700 1 -- 172.21.15.17:0/2623851650 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054005020 con 0x5604c6071e00 2023-07-14T13:02:14.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.892+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/2623851650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 msgr2=0x5604c607b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:14.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.892+0000 7fe0637fe700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe04c0a1360 0x7fe04c0a3810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0a31d0 tx=0x7fe05c00b3b0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:14.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.892+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/2623851650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c607b7f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe05400bd40 tx=0x7fe0540106b0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.892+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/2623851650 shutdown_connections 2023-07-14T13:02:14.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.893+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/2623851650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c607bd30 0x5604c607e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.893+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/2623851650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c60718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.893+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/2623851650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c607b7f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.893+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/2623851650 >> 172.21.15.17:0/2623851650 conn(0x5604c6066ff0 msgr2=0x5604c606c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:14.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.893+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/2623851650 shutdown_connections 2023-07-14T13:02:14.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.893+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/2623851650 wait complete. 2023-07-14T13:02:14.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.893+0000 7fe07cf2fb80 1 -- start start 2023-07-14T13:02:14.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.893+0000 7fe07cf2fb80 1 Processor -- start 2023-07-14T13:02:14.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.894+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c60714f0 0x5604c607b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.894+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c6078950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.894+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c607bd30 0x5604c6078f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.894+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c5f62ac0 con 0x5604c60714f0 2023-07-14T13:02:14.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.894+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c5f627c0 con 0x5604c6071e00 2023-07-14T13:02:14.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.894+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c5e46920 con 0x5604c607bd30 2023-07-14T13:02:14.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.894+0000 7fe07cf2fb80 10 client.0 _ll_register_callbacks cb 0x5604c5f60760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:14.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.895+0000 7fe062ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c6078950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.895+0000 7fe0627fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c60714f0 0x5604c607b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.895+0000 7fe0627fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c60714f0 0x5604c607b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53746/0 (socket says 172.21.15.17:53746) 2023-07-14T13:02:14.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.895+0000 7fe0627fc700 1 -- 172.21.15.17:0/168708496 learned_addr learned my addr 172.21.15.17:0/168708496 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:14.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.895+0000 7fe0627fc700 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c607bd30 0x5604c6078f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.895+0000 7fe0627fc700 1 -- 172.21.15.17:0/168708496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c607bd30 msgr2=0x5604c6078f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:14.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.895+0000 7fe0627fc700 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c607bd30 0x5604c6078f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.895+0000 7fe0627fc700 1 -- 172.21.15.17:0/168708496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 msgr2=0x5604c6078950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:14.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.895+0000 7fe0627fc700 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c6078950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.895+0000 7fe0627fc700 1 -- 172.21.15.17:0/168708496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05400b9a0 con 0x5604c60714f0 2023-07-14T13:02:14.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.896+0000 7fe0627fc700 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c60714f0 0x5604c607b6d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe058010f70 tx=0x7fe058009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c16d3222cdd6ed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:14.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.896+0000 7fe046ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:14.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.896+0000 7fe046ff5700 1 -- 172.21.15.17:0/168708496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058016070 con 0x5604c60714f0 2023-07-14T13:02:14.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.896+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/168708496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604c5f1c4f0 con 0x5604c60714f0 2023-07-14T13:02:14.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.896+0000 7fe046ff5700 1 -- 172.21.15.17:0/168708496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe05800ed90 con 0x5604c60714f0 2023-07-14T13:02:14.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.897+0000 7fe046ff5700 1 -- 172.21.15.17:0/168708496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe058004830 con 0x5604c60714f0 2023-07-14T13:02:14.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.897+0000 7fe07cf2fb80 10 client.16119 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:14.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.897+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/168708496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5604c5dd9c60 con 0x5604c60714f0 2023-07-14T13:02:14.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.897+0000 7fe046ff5700 1 -- 172.21.15.17:0/168708496 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5604c5f1c4f0 con 0x5604c60714f0 2023-07-14T13:02:14.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.897+0000 7fe046ff5700 1 -- 172.21.15.17:0/168708496 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe058005530 con 0x5604c60714f0 2023-07-14T13:02:14.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.897+0000 7fe07cf2fb80 10 client.16119 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:14.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.897+0000 7fe07cf2fb80 10 client.16119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:14.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.897+0000 7fe07cf2fb80 20 client.16119 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:14.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.898+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604c608b640 0x5604c608da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.898+0000 7fe07cf2fb80 4 client.16119 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:14.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.898+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/168708496 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604c5fbbeb0 con 0x5604c608b640 2023-07-14T13:02:14.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.898+0000 7fe062ffd700 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604c608b640 0x5604c608da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.899+0000 7fe046ff5700 10 client.16119 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:14.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.899+0000 7fe062ffd700 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604c608b640 0x5604c608da50 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72553690a78f74ca server_cookie=2e928a8cf342e6d4 in_seq=0 out_seq=0 2023-07-14T13:02:14.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe046ff5700 1 -- 172.21.15.17:0/168708496 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5604c5fbbeb0 con 0x5604c608b640 2023-07-14T13:02:14.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe046ff5700 10 client.16119 handle_command_reply: tid=0 2023-07-14T13:02:14.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe07cf2fb80 1 client.16119 shutdown 2023-07-14T13:02:14.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/168708496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c60714f0 msgr2=0x5604c607b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:14.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c60714f0 0x5604c607b6d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe058010f70 tx=0x7fe058009bd0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/168708496 shutdown_connections 2023-07-14T13:02:14.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604c608b640 0x5604c608da50 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c607bd30 0x5604c6078f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c60714f0 0x5604c607b6d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe046ff5700 0 client.16119 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:14.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/168708496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c6078950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.900+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/168708496 >> 172.21.15.17:0/168708496 conn(0x5604c6066ff0 msgr2=0x5604c606c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:14.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.901+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/168708496 shutdown_connections 2023-07-14T13:02:14.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.901+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/168708496 wait complete. 2023-07-14T13:02:14.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.901+0000 7fe07cf2fb80 20 client.16119 trim_cache size 0 max 16384 2023-07-14T13:02:14.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.926+0000 7fe07cf2fb80 1 Processor -- start 2023-07-14T13:02:14.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.926+0000 7fe07cf2fb80 1 -- start start 2023-07-14T13:02:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.926+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c6082810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.926+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c6071e00 0x5604c606b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.926+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c607bd30 0x5604c606c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.926+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c6072240 con 0x5604c6071e00 2023-07-14T13:02:14.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.926+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c6079f30 con 0x5604c607bd30 2023-07-14T13:02:14.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.926+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c6073790 con 0x5604c60714f0 2023-07-14T13:02:14.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.927+0000 7fe062ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c6071e00 0x5604c606b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.927+0000 7fe062ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c6071e00 0x5604c606b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53760/0 (socket says 172.21.15.17:53760) 2023-07-14T13:02:14.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.927+0000 7fe062ffd700 1 -- 172.21.15.17:0/1977974722 learned_addr learned my addr 172.21.15.17:0/1977974722 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:14.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.927+0000 7fe0627fc700 1 --2- 172.21.15.17:0/1977974722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c6082810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.927+0000 7fe0627fc700 1 --2- 172.21.15.17:0/1977974722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c607bd30 0x5604c606c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.927+0000 7fe062ffd700 1 -- 172.21.15.17:0/1977974722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 msgr2=0x5604c6082810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:14.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.927+0000 7fe062ffd700 1 --2- 172.21.15.17:0/1977974722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c6082810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.927+0000 7fe062ffd700 1 -- 172.21.15.17:0/1977974722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c607bd30 msgr2=0x5604c606c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:14.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.927+0000 7fe062ffd700 1 --2- 172.21.15.17:0/1977974722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c607bd30 0x5604c606c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.927+0000 7fe062ffd700 1 -- 172.21.15.17:0/1977974722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604c5e17250 con 0x5604c6071e00 2023-07-14T13:02:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.927+0000 7fe062ffd700 1 --2- 172.21.15.17:0/1977974722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c6071e00 0x5604c606b060 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe0540046e0 tx=0x7fe05400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309426e45abae0ae server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.928+0000 7fe049ffb700 1 -- 172.21.15.17:0/1977974722 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054021050 con 0x5604c6071e00 2023-07-14T13:02:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.928+0000 7fe049ffb700 1 -- 172.21.15.17:0/1977974722 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe054022040 con 0x5604c6071e00 2023-07-14T13:02:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.928+0000 7fe049ffb700 1 -- 172.21.15.17:0/1977974722 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054027870 con 0x5604c6071e00 2023-07-14T13:02:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.928+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/1977974722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c6071e00 msgr2=0x5604c606b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.928+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/1977974722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c6071e00 0x5604c606b060 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe0540046e0 tx=0x7fe05400b410 comp rx=0 tx=0).stop 2023-07-14T13:02:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.928+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/1977974722 shutdown_connections 2023-07-14T13:02:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.929+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/1977974722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c607bd30 0x5604c606c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.929+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/1977974722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c6082810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.929+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/1977974722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c6071e00 0x5604c606b060 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.929+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/1977974722 >> 172.21.15.17:0/1977974722 conn(0x5604c6066ff0 msgr2=0x5604c6087aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.929+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/1977974722 shutdown_connections 2023-07-14T13:02:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.929+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/1977974722 wait complete. 2023-07-14T13:02:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.929+0000 7fe07cf2fb80 1 -- start start 2023-07-14T13:02:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.929+0000 7fe07cf2fb80 1 Processor -- start 2023-07-14T13:02:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c6082760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c6080a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe07cf2fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c607bd30 0x5604c6080f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c6081520 con 0x5604c607bd30 2023-07-14T13:02:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c6081660 con 0x5604c6071e00 2023-07-14T13:02:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe07cf2fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c6081820 con 0x5604c60714f0 2023-07-14T13:02:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe07cf2fb80 10 client.0 _ll_register_callbacks cb 0x5604c5f60760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe0627fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c607bd30 0x5604c6080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe0627fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c6082760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe0627fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c6082760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59694/0 (socket says 172.21.15.17:59694) 2023-07-14T13:02:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe062ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c6080a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.930+0000 7fe0627fc700 1 -- 172.21.15.17:0/3396616381 learned_addr learned my addr 172.21.15.17:0/3396616381 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.931+0000 7fe0627fc700 1 -- 172.21.15.17:0/3396616381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 msgr2=0x5604c6080a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.931+0000 7fe0627fc700 1 --2- 172.21.15.17:0/3396616381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c6080a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.931+0000 7fe0627fc700 1 -- 172.21.15.17:0/3396616381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c607bd30 msgr2=0x5604c6080f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.931+0000 7fe0627fc700 1 --2- 172.21.15.17:0/3396616381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c607bd30 0x5604c6080f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.931+0000 7fe0627fc700 1 -- 172.21.15.17:0/3396616381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604c5df0de0 con 0x5604c60714f0 2023-07-14T13:02:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.931+0000 7fe0627fc700 1 --2- 172.21.15.17:0/3396616381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c6082760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe05801ea10 tx=0x7fe058000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b44a63462e504a5b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:14.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.931+0000 7fe046ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:02:14.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.931+0000 7fe046ff5700 1 -- 172.21.15.17:0/3396616381 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058016040 con 0x5604c60714f0 2023-07-14T13:02:14.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.932+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/3396616381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe054015070 con 0x5604c60714f0 2023-07-14T13:02:14.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.932+0000 7fe046ff5700 1 -- 172.21.15.17:0/3396616381 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe05801ed10 con 0x5604c60714f0 2023-07-14T13:02:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.932+0000 7fe046ff5700 1 -- 172.21.15.17:0/3396616381 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe05801eed0 con 0x5604c60714f0 2023-07-14T13:02:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.932+0000 7fe07cf2fb80 10 client.25852 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.932+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/3396616381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5604c5def2b0 con 0x5604c60714f0 2023-07-14T13:02:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.932+0000 7fe046ff5700 1 -- 172.21.15.17:0/3396616381 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe054015070 con 0x5604c60714f0 2023-07-14T13:02:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.932+0000 7fe046ff5700 1 -- 172.21.15.17:0/3396616381 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe058005080 con 0x5604c60714f0 2023-07-14T13:02:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.932+0000 7fe07cf2fb80 10 client.25852 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.933+0000 7fe07cf2fb80 10 client.25852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:14.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.933+0000 7fe07cf2fb80 20 client.25852 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.933+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/3396616381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604c60e0900 0x5604c60e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.933+0000 7fe07cf2fb80 4 client.25852 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:02:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.933+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/3396616381 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5604c5f7e050 con 0x5604c60e0900 2023-07-14T13:02:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.933+0000 7fe062ffd700 1 --2- 172.21.15.17:0/3396616381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604c60e0900 0x5604c60e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe062ffd700 1 --2- 172.21.15.17:0/3396616381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604c60e0900 0x5604c60e2d10 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ae1d4c4f52a05d3 server_cookie=1e0196adfc90f8ba in_seq=0 out_seq=0 2023-07-14T13:02:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe046ff5700 10 client.25852 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:14.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe046ff5700 1 -- 172.21.15.17:0/3396616381 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5604c5f7e050 con 0x5604c60e0900 2023-07-14T13:02:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe046ff5700 10 client.25852 handle_command_reply: tid=0 2023-07-14T13:02:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe07cf2fb80 1 client.25852 shutdown 2023-07-14T13:02:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/3396616381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 msgr2=0x5604c6082760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/3396616381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c6082760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe05801ea10 tx=0x7fe058000bc0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/3396616381 shutdown_connections 2023-07-14T13:02:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/3396616381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604c60e0900 0x5604c60e2d10 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/3396616381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604c607bd30 0x5604c6080f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/3396616381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604c60714f0 0x5604c6082760 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe046ff5700 0 client.25852 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe07cf2fb80 1 --2- 172.21.15.17:0/3396616381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604c6071e00 0x5604c6080a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/3396616381 >> 172.21.15.17:0/3396616381 conn(0x5604c6066ff0 msgr2=0x5604c6087aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/3396616381 shutdown_connections 2023-07-14T13:02:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.934+0000 7fe07cf2fb80 1 -- 172.21.15.17:0/3396616381 wait complete. 2023-07-14T13:02:14.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe07cf2fb80 20 client.25852 trim_cache size 0 max 16384 2023-07-14T13:02:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:02:14.974 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:02:14.974 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:02:14.974 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:02:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe063fff700 1 -- 172.21.15.17:0/1049003650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe04c0a1360 msgr2=0x7fe04c0a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe063fff700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe04c0a1360 0x7fe04c0a3810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0a31d0 tx=0x7fe05c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe063fff700 1 -- 172.21.15.17:0/1049003650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0641059e0 msgr2=0x7fe064197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe063fff700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0641059e0 0x7fe064197920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00b780 tx=0x7fe05c00bd60 comp rx=0 tx=0).stop 2023-07-14T13:02:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe063fff700 1 -- 172.21.15.17:0/1049003650 shutdown_connections 2023-07-14T13:02:14.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe063fff700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe04c0a1360 0x7fe04c0a3810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe063fff700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0641059e0 0x7fe064197920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe063fff700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0640ff9d0 0x7fe06419d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe063fff700 1 --2- 172.21.15.17:0/1049003650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe064100380 0x7fe06419ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe063fff700 1 -- 172.21.15.17:0/1049003650 >> 172.21.15.17:0/1049003650 conn(0x7fe0640fb4b0 msgr2=0x7fe064072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.935+0000 7fe063fff700 1 -- 172.21.15.17:0/1049003650 shutdown_connections 2023-07-14T13:02:14.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:14.936+0000 7fe063fff700 1 -- 172.21.15.17:0/1049003650 wait complete. 2023-07-14T13:02:14.985 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:02:14.986 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:02:15.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.186+0000 7f2038bff700 1 -- 172.21.15.17:0/3466311118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20340fe9d0 msgr2=0x7f20340fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.186+0000 7f2038bff700 1 --2- 172.21.15.17:0/3466311118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20340fe9d0 0x7f20340fee40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f201c009990 tx=0x7f201c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.186+0000 7f2038bff700 1 -- 172.21.15.17:0/3466311118 shutdown_connections 2023-07-14T13:02:15.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.186+0000 7f2038bff700 1 --2- 172.21.15.17:0/3466311118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20340ff380 0x7f203410b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.186+0000 7f2038bff700 1 --2- 172.21.15.17:0/3466311118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20341049e0 0x7f2034104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.186+0000 7f2038bff700 1 --2- 172.21.15.17:0/3466311118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20340fe9d0 0x7f20340fee40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.186+0000 7f2038bff700 1 -- 172.21.15.17:0/3466311118 >> 172.21.15.17:0/3466311118 conn(0x7f20340fa490 msgr2=0x7f20340fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:15.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.186+0000 7f2038bff700 1 -- 172.21.15.17:0/3466311118 shutdown_connections 2023-07-14T13:02:15.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.186+0000 7f2038bff700 1 -- 172.21.15.17:0/3466311118 wait complete. 2023-07-14T13:02:15.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.187+0000 7f2038bff700 1 Processor -- start 2023-07-14T13:02:15.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.187+0000 7f2038bff700 1 -- start start 2023-07-14T13:02:15.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.188+0000 7f2038bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fe9d0 0x7f203419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.188+0000 7f2038bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20340ff380 0x7f203419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.188+0000 7f2038bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20341049e0 0x7f2034195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.188+0000 7f2038bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2034195f80 con 0x7f20340ff380 2023-07-14T13:02:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.188+0000 7f2038bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20341960f0 con 0x7f20341049e0 2023-07-14T13:02:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.188+0000 7f2038bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20341962b0 con 0x7f20340fe9d0 2023-07-14T13:02:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.188+0000 7f202bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20340ff380 0x7f203419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.188+0000 7f202bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20340ff380 0x7f203419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53784/0 (socket says 172.21.15.17:53784) 2023-07-14T13:02:15.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.188+0000 7f202bfff700 1 -- 172.21.15.17:0/1909556200 learned_addr learned my addr 172.21.15.17:0/1909556200 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:15.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.189+0000 7f2032d9d700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20341049e0 0x7f2034195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.189+0000 7f203259c700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fe9d0 0x7f203419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.189+0000 7f202bfff700 1 -- 172.21.15.17:0/1909556200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fe9d0 msgr2=0x7f203419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.189+0000 7f202bfff700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fe9d0 0x7f203419b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.189+0000 7f202bfff700 1 -- 172.21.15.17:0/1909556200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20341049e0 msgr2=0x7f2034195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.189+0000 7f202bfff700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20341049e0 0x7f2034195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.189+0000 7f202bfff700 1 -- 172.21.15.17:0/1909556200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0095f0 con 0x7f20340ff380 2023-07-14T13:02:15.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.189+0000 7f203259c700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fe9d0 0x7f203419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:02:15.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.189+0000 7f202bfff700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20340ff380 0x7f203419bde0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f201c005740 tx=0x7f201c005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:15.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.189+0000 7f202b7fe700 1 -- 172.21.15.17:0/1909556200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c01d070 con 0x7f20340ff380 2023-07-14T13:02:15.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.190+0000 7f2038bff700 1 -- 172.21.15.17:0/1909556200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2034196530 con 0x7f20340ff380 2023-07-14T13:02:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.190+0000 7f202b7fe700 1 -- 172.21.15.17:0/1909556200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f201c022470 con 0x7f20340ff380 2023-07-14T13:02:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.190+0000 7f202b7fe700 1 -- 172.21.15.17:0/1909556200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c017650 con 0x7f20340ff380 2023-07-14T13:02:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.190+0000 7f2038bff700 1 -- 172.21.15.17:0/1909556200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20341a2890 con 0x7f20340ff380 2023-07-14T13:02:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.191+0000 7f2038bff700 1 -- 172.21.15.17:0/1909556200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2034067300 con 0x7f20340ff380 2023-07-14T13:02:15.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.193+0000 7f202b7fe700 1 -- 172.21.15.17:0/1909556200 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f201c00fb00 con 0x7f20340ff380 2023-07-14T13:02:15.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.195+0000 7f202b7fe700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20200a1300 0x7f20200a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.195+0000 7f202b7fe700 1 -- 172.21.15.17:0/1909556200 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f201c0ce9f0 con 0x7f20340ff380 2023-07-14T13:02:15.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.195+0000 7f203259c700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20200a1300 0x7f20200a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.196+0000 7f203259c700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20200a1300 0x7f20200a37b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20340ffb10 tx=0x7f202400b5f0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:15.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.198+0000 7f202b7fe700 1 -- 172.21.15.17:0/1909556200 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f201c097ea0 con 0x7f20340ff380 2023-07-14T13:02:15.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:15 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:02:15.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:15 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:02:15.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:15 smithi017 ceph-mon[95536]: pgmap v78: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-07-14T13:02:15.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:15 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:02:15.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:15 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:02:15.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:15 smithi135 ceph-mon[97338]: pgmap v78: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-07-14T13:02:15.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:15 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:02:15.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:15 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:02:15.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:15 smithi131 ceph-mon[96953]: pgmap v78: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-07-14T13:02:15.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.510+0000 7f2038bff700 1 -- 172.21.15.17:0/1909556200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2034196e20 con 0x7f20340ff380 2023-07-14T13:02:15.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.511+0000 7f202b7fe700 1 -- 172.21.15.17:0/1909556200 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+10851 (secure 0 0 0) 0x7f201c09b4c0 con 0x7f20340ff380 2023-07-14T13:02:15.543 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:02:15.543 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:01:22.126099+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:02:15.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 -- 172.21.15.17:0/1909556200 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20200a1300 msgr2=0x7f20200a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20200a1300 0x7f20200a37b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20340ffb10 tx=0x7f202400b5f0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 -- 172.21.15.17:0/1909556200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20340ff380 msgr2=0x7f203419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20340ff380 0x7f203419bde0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f201c005740 tx=0x7f201c005770 comp rx=0 tx=0).stop 2023-07-14T13:02:15.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 -- 172.21.15.17:0/1909556200 shutdown_connections 2023-07-14T13:02:15.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20200a1300 0x7f20200a37b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20341049e0 0x7f2034195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20340fe9d0 0x7f203419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 --2- 172.21.15.17:0/1909556200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20340ff380 0x7f203419bde0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 -- 172.21.15.17:0/1909556200 >> 172.21.15.17:0/1909556200 conn(0x7f20340fa490 msgr2=0x7f20340676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:15.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 -- 172.21.15.17:0/1909556200 shutdown_connections 2023-07-14T13:02:15.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.514+0000 7f2038bff700 1 -- 172.21.15.17:0/1909556200 wait complete. 2023-07-14T13:02:15.548 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2023-07-14T13:02:15.565 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:02:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:7500000 of 50000000 tuples (15%) done (elapsed 125.20 s, remaining 709.48 s) 2023-07-14T13:02:15.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.767+0000 7f3e701ff700 1 -- 172.21.15.17:0/3432053818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e68105ae0 msgr2=0x7f3e68105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.767+0000 7f3e701ff700 1 --2- 172.21.15.17:0/3432053818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e68105ae0 0x7f3e68105eb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009990 tx=0x7f3e64009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.767+0000 7f3e701ff700 1 -- 172.21.15.17:0/3432053818 shutdown_connections 2023-07-14T13:02:15.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.767+0000 7f3e701ff700 1 --2- 172.21.15.17:0/3432053818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e68100480 0x7f3e6810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.767+0000 7f3e701ff700 1 --2- 172.21.15.17:0/3432053818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e68105ae0 0x7f3e68105eb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.767+0000 7f3e701ff700 1 --2- 172.21.15.17:0/3432053818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e680ffad0 0x7f3e680fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.767+0000 7f3e701ff700 1 -- 172.21.15.17:0/3432053818 >> 172.21.15.17:0/3432053818 conn(0x7f3e680fb5f0 msgr2=0x7f3e680fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:15.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.768+0000 7f3e701ff700 1 -- 172.21.15.17:0/3432053818 shutdown_connections 2023-07-14T13:02:15.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.768+0000 7f3e701ff700 1 -- 172.21.15.17:0/3432053818 wait complete. 2023-07-14T13:02:15.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.769+0000 7f3e701ff700 1 Processor -- start 2023-07-14T13:02:15.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.769+0000 7f3e701ff700 1 -- start start 2023-07-14T13:02:15.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.769+0000 7f3e701ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e680ffad0 0x7f3e68072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.769+0000 7f3e701ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e68100480 0x7f3e68072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.769+0000 7f3e701ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e68105ae0 0x7f3e68073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.769+0000 7f3e701ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e681a3f40 con 0x7f3e68100480 2023-07-14T13:02:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.769+0000 7f3e701ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e681a40b0 con 0x7f3e680ffad0 2023-07-14T13:02:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.769+0000 7f3e701ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e681a4270 con 0x7f3e68105ae0 2023-07-14T13:02:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.770+0000 7f3e6d79a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e68100480 0x7f3e68072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.770+0000 7f3e6d79a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e68100480 0x7f3e68072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53794/0 (socket says 172.21.15.17:53794) 2023-07-14T13:02:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.770+0000 7f3e6d79a700 1 -- 172.21.15.17:0/3449941283 learned_addr learned my addr 172.21.15.17:0/3449941283 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.770+0000 7f3e6df9b700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e680ffad0 0x7f3e68072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.770+0000 7f3e6e79c700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e68105ae0 0x7f3e68073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.770+0000 7f3e6d79a700 1 -- 172.21.15.17:0/3449941283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e68105ae0 msgr2=0x7f3e68073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.770+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e68105ae0 0x7f3e68073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.770+0000 7f3e6d79a700 1 -- 172.21.15.17:0/3449941283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e680ffad0 msgr2=0x7f3e68072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.770+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e680ffad0 0x7f3e68072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.770+0000 7f3e6d79a700 1 -- 172.21.15.17:0/3449941283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e60009c40 con 0x7f3e68100480 2023-07-14T13:02:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.770+0000 7f3e6df9b700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e680ffad0 0x7f3e68072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:02:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.771+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e68100480 0x7f3e68072d50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800e9a0 tx=0x7f3e5800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.771+0000 7f3e5effd700 1 -- 172.21.15.17:0/3449941283 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58009790 con 0x7f3e68100480 2023-07-14T13:02:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.771+0000 7f3e5effd700 1 -- 172.21.15.17:0/3449941283 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e5800cbd0 con 0x7f3e68100480 2023-07-14T13:02:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.771+0000 7f3e5effd700 1 -- 172.21.15.17:0/3449941283 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58018680 con 0x7f3e68100480 2023-07-14T13:02:15.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.771+0000 7f3e701ff700 1 -- 172.21.15.17:0/3449941283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e640095f0 con 0x7f3e68100480 2023-07-14T13:02:15.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.771+0000 7f3e701ff700 1 -- 172.21.15.17:0/3449941283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e681a4880 con 0x7f3e68100480 2023-07-14T13:02:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.775+0000 7f3e5effd700 1 -- 172.21.15.17:0/3449941283 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3e5800cd40 con 0x7f3e68100480 2023-07-14T13:02:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.777+0000 7f3e5effd700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3e540a12c0 0x7f3e540a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.777+0000 7f3e83bfeb80 1 Processor -- start 2023-07-14T13:02:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.777+0000 7f3e5effd700 1 -- 172.21.15.17:0/3449941283 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3e58014070 con 0x7f3e68100480 2023-07-14T13:02:15.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.777+0000 7f3e6df9b700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3e540a12c0 0x7f3e540a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.777+0000 7f3e83bfeb80 1 -- start start 2023-07-14T13:02:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.777+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de85272d0 0x555de85276a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.777+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8527be0 0x555de8532590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.777+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de8532ad0 0x555de8534eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de842dcb0 con 0x555de8532ad0 2023-07-14T13:02:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de8480a40 con 0x555de8527be0 2023-07-14T13:02:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de8479ed0 con 0x555de85272d0 2023-07-14T13:02:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6e79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de8532ad0 0x555de8534eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6df9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de85272d0 0x555de85276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6d79a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8527be0 0x555de8532590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6e79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de8532ad0 0x555de8534eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53810/0 (socket says 172.21.15.17:53810) 2023-07-14T13:02:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6e79c700 1 -- 172.21.15.17:0/37871098 learned_addr learned my addr 172.21.15.17:0/37871098 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:15.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6d79a700 1 -- 172.21.15.17:0/37871098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de85272d0 msgr2=0x555de85276a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:15.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/37871098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de85272d0 0x555de85276a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6d79a700 1 -- 172.21.15.17:0/37871098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de8532ad0 msgr2=0x555de8534eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:15.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/37871098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de8532ad0 0x555de8534eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6df9b700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3e540a12c0 0x7f3e540a3770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400b2e0 tx=0x7f3e64005fd0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:15.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6d79a700 1 -- 172.21.15.17:0/37871098 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555de82a7de0 con 0x555de8527be0 2023-07-14T13:02:15.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.778+0000 7f3e6e79c700 1 --2- 172.21.15.17:0/37871098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de8532ad0 0x555de8534eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:15.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.779+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/37871098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8527be0 0x555de8532590 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e580ca7b0 tx=0x7f3e5809a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f430dd3f175afdd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:15.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.779+0000 7f3e53fff700 1 -- 172.21.15.17:0/37871098 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580a2580 con 0x555de8527be0 2023-07-14T13:02:15.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.779+0000 7f3e53fff700 1 -- 172.21.15.17:0/37871098 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e5809a390 con 0x555de8527be0 2023-07-14T13:02:15.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.779+0000 7f3e53fff700 1 -- 172.21.15.17:0/37871098 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580a2350 con 0x555de8527be0 2023-07-14T13:02:15.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.780+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/37871098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8527be0 msgr2=0x555de8532590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.780+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/37871098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8527be0 0x555de8532590 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e580ca7b0 tx=0x7f3e5809a130 comp rx=0 tx=0).stop 2023-07-14T13:02:15.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.780+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/37871098 shutdown_connections 2023-07-14T13:02:15.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.780+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/37871098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de8532ad0 0x555de8534eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.780+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/37871098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de85272d0 0x555de85276a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.780+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/37871098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8527be0 0x555de8532590 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.780+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/37871098 >> 172.21.15.17:0/37871098 conn(0x555de851dda0 msgr2=0x555de85236a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:15.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.780+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/37871098 shutdown_connections 2023-07-14T13:02:15.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.780+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/37871098 wait complete. 2023-07-14T13:02:15.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.780+0000 7f3e83bfeb80 1 -- start start 2023-07-14T13:02:15.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.781+0000 7f3e83bfeb80 1 Processor -- start 2023-07-14T13:02:15.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.781+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85272d0 0x555de852f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.781+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de852fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.781+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de85302d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.781+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de8419ac0 con 0x555de85272d0 2023-07-14T13:02:15.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.781+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de84197c0 con 0x555de8532ad0 2023-07-14T13:02:15.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.781+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de82fd920 con 0x555de8527be0 2023-07-14T13:02:15.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.781+0000 7f3e83bfeb80 10 client.0 _ll_register_callbacks cb 0x555de8417760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:15.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6df9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85272d0 0x555de852f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6df9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85272d0 0x555de852f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53826/0 (socket says 172.21.15.17:53826) 2023-07-14T13:02:15.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6df9b700 1 -- 172.21.15.17:0/3495448762 learned_addr learned my addr 172.21.15.17:0/3495448762 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:15.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6e79c700 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de85302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de852fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6df9b700 1 -- 172.21.15.17:0/3495448762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 msgr2=0x555de852fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:15.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6df9b700 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de852fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6df9b700 1 -- 172.21.15.17:0/3495448762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 msgr2=0x555de85302d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:15.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6df9b700 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de85302d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6df9b700 1 -- 172.21.15.17:0/3495448762 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e600092e0 con 0x555de85272d0 2023-07-14T13:02:15.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de852fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:02:15.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e6df9b700 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85272d0 0x555de852f850 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3e64015000 tx=0x7f3e64009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8da1a650ac0d44 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:15.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.782+0000 7f3e517fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:15.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.783+0000 7f3e517fa700 1 -- 172.21.15.17:0/3495448762 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64005460 con 0x555de85272d0 2023-07-14T13:02:15.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.783+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/3495448762 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555de83d34f0 con 0x555de85272d0 2023-07-14T13:02:15.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.783+0000 7f3e517fa700 1 -- 172.21.15.17:0/3495448762 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3e640055c0 con 0x555de85272d0 2023-07-14T13:02:15.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.783+0000 7f3e517fa700 1 -- 172.21.15.17:0/3495448762 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e64004730 con 0x555de85272d0 2023-07-14T13:02:15.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.783+0000 7f3e83bfeb80 10 client.16143 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:15.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.783+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/3495448762 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f3e681a4880 con 0x555de85272d0 2023-07-14T13:02:15.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.783+0000 7f3e517fa700 1 -- 172.21.15.17:0/3495448762 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555de83d34f0 con 0x555de85272d0 2023-07-14T13:02:15.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.784+0000 7f3e517fa700 1 -- 172.21.15.17:0/3495448762 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3e6402e960 con 0x555de85272d0 2023-07-14T13:02:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.784+0000 7f3e83bfeb80 10 client.16143 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.784+0000 7f3e83bfeb80 10 client.16143 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:02:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.784+0000 7f3e83bfeb80 20 client.16143 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.784+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x555de8542260 0x555de8544670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.784+0000 7f3e83bfeb80 4 client.16143 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.784+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/3495448762 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555de8472eb0 con 0x555de8542260 2023-07-14T13:02:15.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.784+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x555de8542260 0x555de8544670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.785+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x555de8542260 0x555de8544670 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6690229de7628d1f server_cookie=a21cfbd631420156 in_seq=0 out_seq=0 2023-07-14T13:02:15.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.785+0000 7f3e517fa700 10 client.16143 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:02:15.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.786+0000 7f3e517fa700 1 -- 172.21.15.17:0/3495448762 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555de8472eb0 con 0x555de8542260 2023-07-14T13:02:15.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.786+0000 7f3e517fa700 10 client.16143 handle_command_reply: tid=0 2023-07-14T13:02:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.786+0000 7f3e83bfeb80 1 client.16143 shutdown 2023-07-14T13:02:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.786+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/3495448762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85272d0 msgr2=0x555de852f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.786+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85272d0 0x555de852f850 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3e64015000 tx=0x7f3e64009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.787+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/3495448762 shutdown_connections 2023-07-14T13:02:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.787+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de85302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.787+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85272d0 0x555de852f850 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.787+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x555de8542260 0x555de8544670 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.787+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/3495448762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de852fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.787+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/3495448762 >> 172.21.15.17:0/3495448762 conn(0x555de851dda0 msgr2=0x555de8523230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.787+0000 7f3e517fa700 0 client.16143 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:02:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.787+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/3495448762 shutdown_connections 2023-07-14T13:02:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.787+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/3495448762 wait complete. 2023-07-14T13:02:15.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.787+0000 7f3e83bfeb80 20 client.16143 trim_cache size 0 max 16384 2023-07-14T13:02:15.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.804+0000 7f3e83bfeb80 1 Processor -- start 2023-07-14T13:02:15.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.804+0000 7f3e83bfeb80 1 -- start start 2023-07-14T13:02:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.804+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de853df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.804+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de8530130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.804+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de852e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.804+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de8528080 con 0x555de85238c0 2023-07-14T13:02:15.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.804+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de851fec0 con 0x555de8532ad0 2023-07-14T13:02:15.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.804+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de8530e30 con 0x555de8527be0 2023-07-14T13:02:15.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6e79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de852e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6e79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de852e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53834/0 (socket says 172.21.15.17:53834) 2023-07-14T13:02:15.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6e79c700 1 -- 172.21.15.17:0/2526253262 learned_addr learned my addr 172.21.15.17:0/2526253262 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:15.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6df9b700 1 --2- 172.21.15.17:0/2526253262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de853df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/2526253262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de8530130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6e79c700 1 -- 172.21.15.17:0/2526253262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 msgr2=0x555de853df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6e79c700 1 --2- 172.21.15.17:0/2526253262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de853df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6e79c700 1 -- 172.21.15.17:0/2526253262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 msgr2=0x555de8530130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6e79c700 1 --2- 172.21.15.17:0/2526253262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de8530130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6e79c700 1 -- 172.21.15.17:0/2526253262 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555de8290c60 con 0x555de85238c0 2023-07-14T13:02:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/2526253262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de8530130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:02:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.805+0000 7f3e6e79c700 1 --2- 172.21.15.17:0/2526253262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de852e730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3e600089d0 tx=0x7f3e6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d91b9e09e58663 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:15.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.806+0000 7f3e5cff9700 1 -- 172.21.15.17:0/2526253262 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000e040 con 0x555de85238c0 2023-07-14T13:02:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.806+0000 7f3e5cff9700 1 -- 172.21.15.17:0/2526253262 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e6000f040 con 0x555de85238c0 2023-07-14T13:02:15.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.806+0000 7f3e5cff9700 1 -- 172.21.15.17:0/2526253262 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60004280 con 0x555de85238c0 2023-07-14T13:02:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.806+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/2526253262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 msgr2=0x555de852e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.806+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/2526253262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de852e730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3e600089d0 tx=0x7f3e6000b040 comp rx=0 tx=0).stop 2023-07-14T13:02:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.806+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/2526253262 shutdown_connections 2023-07-14T13:02:15.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.806+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/2526253262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de852e730 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.806+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/2526253262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de853df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.806+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/2526253262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de8530130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.807+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/2526253262 >> 172.21.15.17:0/2526253262 conn(0x555de851dda0 msgr2=0x555de852e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:15.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.807+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/2526253262 shutdown_connections 2023-07-14T13:02:15.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.807+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/2526253262 wait complete. 2023-07-14T13:02:15.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.807+0000 7f3e83bfeb80 1 -- start start 2023-07-14T13:02:15.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.807+0000 7f3e83bfeb80 1 Processor -- start 2023-07-14T13:02:15.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.808+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de8537000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.808+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de85352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.808+0000 7f3e83bfeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de8535880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.808+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de8535f90 con 0x555de85238c0 2023-07-14T13:02:15.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.808+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de8536100 con 0x555de8532ad0 2023-07-14T13:02:15.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.808+0000 7f3e83bfeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555de8596130 con 0x555de8527be0 2023-07-14T13:02:15.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.808+0000 7f3e83bfeb80 10 client.0 _ll_register_callbacks cb 0x7f3e6400bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:15.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.808+0000 7f3e6df9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de8537000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.808+0000 7f3e6df9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de8537000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53836/0 (socket says 172.21.15.17:53836) 2023-07-14T13:02:15.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.808+0000 7f3e6df9b700 1 -- 172.21.15.17:0/909911316 learned_addr learned my addr 172.21.15.17:0/909911316 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:15.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.808+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de85352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e6df9b700 1 -- 172.21.15.17:0/909911316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 msgr2=0x555de85352c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:15.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e6df9b700 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de85352c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e6e79c700 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de8535880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e6df9b700 1 -- 172.21.15.17:0/909911316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 msgr2=0x555de8535880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:15.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e6df9b700 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de8535880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e6df9b700 1 -- 172.21.15.17:0/909911316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e60008620 con 0x555de85238c0 2023-07-14T13:02:15.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e6e79c700 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de8535880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:02:15.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e6df9b700 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de8537000 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3e64005020 tx=0x7f3e640049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3856976918833c70 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:15.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e517fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:15.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e517fa700 1 -- 172.21.15.17:0/909911316 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6402e600 con 0x555de85238c0 2023-07-14T13:02:15.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/909911316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e5809a390 con 0x555de85238c0 2023-07-14T13:02:15.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.809+0000 7f3e517fa700 1 -- 172.21.15.17:0/909911316 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3e64005660 con 0x555de85238c0 2023-07-14T13:02:15.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.810+0000 7f3e517fa700 1 -- 172.21.15.17:0/909911316 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e6402ee10 con 0x555de85238c0 2023-07-14T13:02:15.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.810+0000 7f3e83bfeb80 10 client.16149 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:15.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.810+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/909911316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x555de82ce250 con 0x555de85238c0 2023-07-14T13:02:15.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.810+0000 7f3e517fa700 1 -- 172.21.15.17:0/909911316 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e64050020 con 0x555de85238c0 2023-07-14T13:02:15.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.810+0000 7f3e517fa700 1 -- 172.21.15.17:0/909911316 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3e6404c830 con 0x555de85238c0 2023-07-14T13:02:15.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.810+0000 7f3e83bfeb80 10 client.16149 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:15.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.810+0000 7f3e83bfeb80 10 client.16149 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:02:15.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.810+0000 7f3e83bfeb80 20 client.16149 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:15.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.810+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x555de8597340 0x555de8599750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:15.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.810+0000 7f3e83bfeb80 4 client.16149 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:02:15.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.810+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/909911316 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555de8435050 con 0x555de8597340 2023-07-14T13:02:15.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.811+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x555de8597340 0x555de8599750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:15.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.811+0000 7f3e517fa700 10 client.16149 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:02:15.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.811+0000 7f3e6d79a700 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x555de8597340 0x555de8599750 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe6cdcdb40800110 server_cookie=e71c51014ba6ac7c in_seq=0 out_seq=0 2023-07-14T13:02:15.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e517fa700 1 -- 172.21.15.17:0/909911316 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555de8435050 con 0x555de8597340 2023-07-14T13:02:15.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e517fa700 10 client.16149 handle_command_reply: tid=0 2023-07-14T13:02:15.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 1 client.16149 shutdown 2023-07-14T13:02:15.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/909911316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 msgr2=0x555de8537000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de8537000 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3e64005020 tx=0x7f3e640049e0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/909911316 shutdown_connections 2023-07-14T13:02:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555de8532ad0 0x555de8535880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555de85238c0 0x555de8537000 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x555de8597340 0x555de8599750 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 1 --2- 172.21.15.17:0/909911316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555de8527be0 0x555de85352c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/909911316 >> 172.21.15.17:0/909911316 conn(0x555de851dda0 msgr2=0x555de8523140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:15.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e517fa700 0 client.16149 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:02:15.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/909911316 shutdown_connections 2023-07-14T13:02:15.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 1 -- 172.21.15.17:0/909911316 wait complete. 2023-07-14T13:02:15.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.812+0000 7f3e83bfeb80 20 client.16149 trim_cache size 0 max 16384 2023-07-14T13:02:15.863 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:02:15.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 -- 172.21.15.17:0/3449941283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3e540a12c0 msgr2=0x7f3e540a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3e540a12c0 0x7f3e540a3770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400b2e0 tx=0x7f3e64005fd0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 -- 172.21.15.17:0/3449941283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e68100480 msgr2=0x7f3e68072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:15.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e68100480 0x7f3e68072d50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800e9a0 tx=0x7f3e5800ed60 comp rx=0 tx=0).stop 2023-07-14T13:02:15.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 -- 172.21.15.17:0/3449941283 shutdown_connections 2023-07-14T13:02:15.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3e540a12c0 0x7f3e540a3770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e68105ae0 0x7f3e68073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e680ffad0 0x7f3e68072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 --2- 172.21.15.17:0/3449941283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e68100480 0x7f3e68072d50 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:15.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 -- 172.21.15.17:0/3449941283 >> 172.21.15.17:0/3449941283 conn(0x7f3e680fb5f0 msgr2=0x7f3e680fbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:15.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 -- 172.21.15.17:0/3449941283 shutdown_connections 2023-07-14T13:02:15.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:15.813+0000 7f3e701ff700 1 -- 172.21.15.17:0/3449941283 wait complete. 2023-07-14T13:02:15.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:02:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.118+0000 7efda17ff700 1 -- 172.21.15.17:0/2892723061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c100ca0 msgr2=0x7efd9c101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.118+0000 7efda17ff700 1 --2- 172.21.15.17:0/2892723061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c100ca0 0x7efd9c101070 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009990 tx=0x7efd8c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.118+0000 7efda17ff700 1 -- 172.21.15.17:0/2892723061 shutdown_connections 2023-07-14T13:02:16.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.118+0000 7efda17ff700 1 --2- 172.21.15.17:0/2892723061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c10a070 0x7efd9c10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.118+0000 7efda17ff700 1 --2- 172.21.15.17:0/2892723061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c100ca0 0x7efd9c101070 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.118+0000 7efda17ff700 1 --2- 172.21.15.17:0/2892723061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd9c1015b0 0x7efd9c109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.118+0000 7efda17ff700 1 -- 172.21.15.17:0/2892723061 >> 172.21.15.17:0/2892723061 conn(0x7efd9c0fa4b0 msgr2=0x7efd9c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.118+0000 7efda17ff700 1 -- 172.21.15.17:0/2892723061 shutdown_connections 2023-07-14T13:02:16.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.118+0000 7efda17ff700 1 -- 172.21.15.17:0/2892723061 wait complete. 2023-07-14T13:02:16.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.119+0000 7efda17ff700 1 Processor -- start 2023-07-14T13:02:16.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.120+0000 7efda17ff700 1 -- start start 2023-07-14T13:02:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.120+0000 7efda17ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd9c100ca0 0x7efd9c197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.120+0000 7efda17ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c1015b0 0x7efd9c198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.120+0000 7efda17ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c10a070 0x7efd9c19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.120+0000 7efda17ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c19cd30 con 0x7efd9c10a070 2023-07-14T13:02:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.120+0000 7efda17ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c19cea0 con 0x7efd9c100ca0 2023-07-14T13:02:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.120+0000 7efda17ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c19d060 con 0x7efd9c1015b0 2023-07-14T13:02:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.120+0000 7efd9affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd9c100ca0 0x7efd9c197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.120+0000 7efd9a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c1015b0 0x7efd9c198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.120+0000 7efd9affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd9c100ca0 0x7efd9c197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40150/0 (socket says 172.21.15.17:40150) 2023-07-14T13:02:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.120+0000 7efd9affd700 1 -- 172.21.15.17:0/2087041733 learned_addr learned my addr 172.21.15.17:0/2087041733 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.121+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c10a070 0x7efd9c19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.121+0000 7efd9affd700 1 -- 172.21.15.17:0/2087041733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c1015b0 msgr2=0x7efd9c198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.121+0000 7efd9affd700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c1015b0 0x7efd9c198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.121+0000 7efd9affd700 1 -- 172.21.15.17:0/2087041733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c10a070 msgr2=0x7efd9c19c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.121+0000 7efd9affd700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c10a070 0x7efd9c19c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.121+0000 7efd9affd700 1 -- 172.21.15.17:0/2087041733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c0095f0 con 0x7efd9c100ca0 2023-07-14T13:02:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.121+0000 7efd9a7fc700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c1015b0 0x7efd9c198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.121+0000 7efd9affd700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd9c100ca0 0x7efd9c197d50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd8c005740 tx=0x7efd8c005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.122+0000 7efd83fff700 1 -- 172.21.15.17:0/2087041733 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c01d070 con 0x7efd9c100ca0 2023-07-14T13:02:16.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.122+0000 7efda17ff700 1 -- 172.21.15.17:0/2087041733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9c19d2e0 con 0x7efd9c100ca0 2023-07-14T13:02:16.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.122+0000 7efd83fff700 1 -- 172.21.15.17:0/2087041733 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd8c022470 con 0x7efd9c100ca0 2023-07-14T13:02:16.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.122+0000 7efd83fff700 1 -- 172.21.15.17:0/2087041733 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8c017650 con 0x7efd9c100ca0 2023-07-14T13:02:16.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.122+0000 7efda17ff700 1 -- 172.21.15.17:0/2087041733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c1a4b80 con 0x7efd9c100ca0 2023-07-14T13:02:16.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.127+0000 7efd83fff700 1 -- 172.21.15.17:0/2087041733 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7efd8c00fb00 con 0x7efd9c100ca0 2023-07-14T13:02:16.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.128+0000 7efdb51d9b80 1 Processor -- start 2023-07-14T13:02:16.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.128+0000 7efdb51d9b80 1 -- start start 2023-07-14T13:02:16.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.128+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc843f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.128+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc844a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.128+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc844aad0 0x556bc844ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.128+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc8345cb0 con 0x556bc843f2d0 2023-07-14T13:02:16.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.128+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc8398a40 con 0x556bc843fbe0 2023-07-14T13:02:16.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.128+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc8391ed0 con 0x556bc844aad0 2023-07-14T13:02:16.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.129+0000 7efd9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc843f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.129+0000 7efd9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc843f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53856/0 (socket says 172.21.15.17:53856) 2023-07-14T13:02:16.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.129+0000 7efd9b7fe700 1 -- 172.21.15.17:0/1064080906 learned_addr learned my addr 172.21.15.17:0/1064080906 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:16.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.129+0000 7efd9affd700 1 --2- 172.21.15.17:0/1064080906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc844a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.129+0000 7efd9a7fc700 1 --2- 172.21.15.17:0/1064080906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc844aad0 0x556bc844ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.129+0000 7efd9b7fe700 1 -- 172.21.15.17:0/1064080906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc844aad0 msgr2=0x556bc844ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.129+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/1064080906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc844aad0 0x556bc844ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.129+0000 7efd9b7fe700 1 -- 172.21.15.17:0/1064080906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 msgr2=0x556bc844a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.129+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/1064080906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc844a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.129+0000 7efd9b7fe700 1 -- 172.21.15.17:0/1064080906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bc81bfde0 con 0x556bc843f2d0 2023-07-14T13:02:16.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.129+0000 7efd9affd700 1 --2- 172.21.15.17:0/1064080906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc844a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:02:16.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.130+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/1064080906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc843f6a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efd94003fa0 tx=0x7efd94009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9828d4d060b69d64 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.130+0000 7efd83fff700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd840a1340 0x7efd840a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.130+0000 7efd817fa700 1 -- 172.21.15.17:0/1064080906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94019070 con 0x556bc843f2d0 2023-07-14T13:02:16.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.130+0000 7efd83fff700 1 -- 172.21.15.17:0/2087041733 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7efd8c0ce1d0 con 0x7efd9c100ca0 2023-07-14T13:02:16.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.130+0000 7efd9affd700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd840a1340 0x7efd840a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.130+0000 7efd817fa700 1 -- 172.21.15.17:0/1064080906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd9400f040 con 0x556bc843f2d0 2023-07-14T13:02:16.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.130+0000 7efd817fa700 1 -- 172.21.15.17:0/1064080906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94007920 con 0x556bc843f2d0 2023-07-14T13:02:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.131+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1064080906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 msgr2=0x556bc843f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.131+0000 7efd9affd700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd840a1340 0x7efd840a37f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009ce0 tx=0x7efd8c097040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.131+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/1064080906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc843f6a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efd94003fa0 tx=0x7efd94009ba0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.131+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1064080906 shutdown_connections 2023-07-14T13:02:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.131+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/1064080906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc844aad0 0x556bc844ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.131+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/1064080906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc843f6a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.131+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/1064080906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc844a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.131+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1064080906 >> 172.21.15.17:0/1064080906 conn(0x556bc8435da0 msgr2=0x556bc843b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.131+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1064080906 shutdown_connections 2023-07-14T13:02:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.131+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1064080906 wait complete. 2023-07-14T13:02:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.132+0000 7efdb51d9b80 1 -- start start 2023-07-14T13:02:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.132+0000 7efdb51d9b80 1 Processor -- start 2023-07-14T13:02:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.132+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843f2d0 0x556bc844a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.132+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc8447790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc844aad0 0x556bc8447ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc8331ac0 con 0x556bc844aad0 2023-07-14T13:02:16.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc83317c0 con 0x556bc843fbe0 2023-07-14T13:02:16.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc8215920 con 0x556bc843f2d0 2023-07-14T13:02:16.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efdb51d9b80 10 client.0 _ll_register_callbacks cb 0x556bc832f760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:16.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efd9b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843f2d0 0x556bc844a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efd9b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843f2d0 0x556bc844a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59810/0 (socket says 172.21.15.17:59810) 2023-07-14T13:02:16.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efd9b7fe700 1 -- 172.21.15.17:0/3238522004 learned_addr learned my addr 172.21.15.17:0/3238522004 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:16.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc844aad0 0x556bc8447ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efd9a7fc700 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc8447790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efd9b7fe700 1 -- 172.21.15.17:0/3238522004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 msgr2=0x556bc8447790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc8447790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efd9b7fe700 1 -- 172.21.15.17:0/3238522004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc844aad0 msgr2=0x556bc8447ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc844aad0 0x556bc8447ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.133+0000 7efd9b7fe700 1 -- 172.21.15.17:0/3238522004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd94003bd0 con 0x556bc843f2d0 2023-07-14T13:02:16.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.134+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843f2d0 0x556bc844a580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efd94004f50 tx=0x7efd940094c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af2ebbbe0d973fce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.134+0000 7efd7eff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:02:16.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.134+0000 7efd7eff5700 1 -- 172.21.15.17:0/3238522004 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94019040 con 0x556bc843f2d0 2023-07-14T13:02:16.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.134+0000 7efd7eff5700 1 -- 172.21.15.17:0/3238522004 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7efd94004880 con 0x556bc843f2d0 2023-07-14T13:02:16.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.134+0000 7efdb51d9b80 1 -- 172.21.15.17:0/3238522004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556bc82eb4f0 con 0x556bc843f2d0 2023-07-14T13:02:16.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.134+0000 7efd7eff5700 1 -- 172.21.15.17:0/3238522004 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd94015680 con 0x556bc843f2d0 2023-07-14T13:02:16.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.134+0000 7efdb51d9b80 10 client.25888 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:16.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.134+0000 7efdb51d9b80 1 -- 172.21.15.17:0/3238522004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x556bc81a8c60 con 0x556bc843f2d0 2023-07-14T13:02:16.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.135+0000 7efd7eff5700 1 -- 172.21.15.17:0/3238522004 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556bc82eb4f0 con 0x556bc843f2d0 2023-07-14T13:02:16.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.135+0000 7efd7eff5700 1 -- 172.21.15.17:0/3238522004 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7efd9402b070 con 0x556bc843f2d0 2023-07-14T13:02:16.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.135+0000 7efdb51d9b80 10 client.25888 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:16.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.135+0000 7efdb51d9b80 10 client.25888 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:02:16.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.135+0000 7efdb51d9b80 20 client.25888 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:16.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.135+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556bc845a420 0x556bc845c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.135+0000 7efdb51d9b80 4 client.25888 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:16.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.135+0000 7efdb51d9b80 1 -- 172.21.15.17:0/3238522004 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556bc838aeb0 con 0x556bc845a420 2023-07-14T13:02:16.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.136+0000 7efd9a7fc700 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556bc845a420 0x556bc845c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.136+0000 7efd9a7fc700 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556bc845a420 0x556bc845c830 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4841ba01052f9801 server_cookie=fb421d747632f50a in_seq=0 out_seq=0 2023-07-14T13:02:16.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.136+0000 7efd7eff5700 10 client.25888 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:02:16.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.137+0000 7efd7eff5700 1 -- 172.21.15.17:0/3238522004 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556bc838aeb0 con 0x556bc845a420 2023-07-14T13:02:16.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.137+0000 7efd7eff5700 10 client.25888 handle_command_reply: tid=0 2023-07-14T13:02:16.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 1 client.25888 shutdown 2023-07-14T13:02:16.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 1 -- 172.21.15.17:0/3238522004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843f2d0 msgr2=0x556bc844a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843f2d0 0x556bc844a580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efd94004f50 tx=0x7efd940094c0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.175 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 1 -- 172.21.15.17:0/3238522004 shutdown_connections 2023-07-14T13:02:16.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc844aad0 0x556bc8447ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843f2d0 0x556bc844a580 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556bc845a420 0x556bc845c830 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/3238522004 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc8447790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efd7eff5700 0 client.25888 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:02:16.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 1 -- 172.21.15.17:0/3238522004 >> 172.21.15.17:0/3238522004 conn(0x556bc8435da0 msgr2=0x556bc843b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.176 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 1 -- 172.21.15.17:0/3238522004 shutdown_connections 2023-07-14T13:02:16.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 1 -- 172.21.15.17:0/3238522004 wait complete. 2023-07-14T13:02:16.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.138+0000 7efdb51d9b80 20 client.25888 trim_cache size 0 max 16384 2023-07-14T13:02:16.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.156+0000 7efdb51d9b80 1 Processor -- start 2023-07-14T13:02:16.188 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.156+0000 7efdb51d9b80 1 -- start start 2023-07-14T13:02:16.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.156+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc844a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.156+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc8442ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.156+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc844aad0 0x556bc8443010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.156+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc843cd20 con 0x556bc843f2d0 2023-07-14T13:02:16.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.156+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc84411a0 con 0x556bc843fbe0 2023-07-14T13:02:16.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.156+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc845ce90 con 0x556bc844aad0 2023-07-14T13:02:16.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.157+0000 7efd9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc844a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.157+0000 7efd9b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc844a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53870/0 (socket says 172.21.15.17:53870) 2023-07-14T13:02:16.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.157+0000 7efd9b7fe700 1 -- 172.21.15.17:0/2053995409 learned_addr learned my addr 172.21.15.17:0/2053995409 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:16.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.157+0000 7efd9b7fe700 1 -- 172.21.15.17:0/2053995409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc844aad0 msgr2=0x556bc8443010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:02:16.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.157+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/2053995409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc844aad0 0x556bc8443010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.157+0000 7efd9b7fe700 1 -- 172.21.15.17:0/2053995409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 msgr2=0x556bc8442ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.157+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/2053995409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc8442ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.157+0000 7efd9b7fe700 1 -- 172.21.15.17:0/2053995409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bc81e6250 con 0x556bc843f2d0 2023-07-14T13:02:16.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.158+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/2053995409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc844a0b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7efd94009550 tx=0x7efd94007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6036dac7e1d412f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.158+0000 7efd81ffb700 1 -- 172.21.15.17:0/2053995409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94019070 con 0x556bc843f2d0 2023-07-14T13:02:16.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.158+0000 7efd81ffb700 1 -- 172.21.15.17:0/2053995409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd94022750 con 0x556bc843f2d0 2023-07-14T13:02:16.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.158+0000 7efd81ffb700 1 -- 172.21.15.17:0/2053995409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94022bf0 con 0x556bc843f2d0 2023-07-14T13:02:16.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.159+0000 7efdb51d9b80 1 -- 172.21.15.17:0/2053995409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 msgr2=0x556bc844a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.159+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/2053995409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc844a0b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7efd94009550 tx=0x7efd94007ed0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.159+0000 7efdb51d9b80 1 -- 172.21.15.17:0/2053995409 shutdown_connections 2023-07-14T13:02:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.159+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/2053995409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc844aad0 0x556bc8443010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.159+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/2053995409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc843f2d0 0x556bc844a0b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.159+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/2053995409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843fbe0 0x556bc8442ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.159+0000 7efdb51d9b80 1 -- 172.21.15.17:0/2053995409 >> 172.21.15.17:0/2053995409 conn(0x556bc8435da0 msgr2=0x556bc8439e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.159+0000 7efdb51d9b80 1 -- 172.21.15.17:0/2053995409 shutdown_connections 2023-07-14T13:02:16.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.159+0000 7efdb51d9b80 1 -- 172.21.15.17:0/2053995409 wait complete. 2023-07-14T13:02:16.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.160+0000 7efdb51d9b80 1 -- start start 2023-07-14T13:02:16.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.160+0000 7efdb51d9b80 1 Processor -- start 2023-07-14T13:02:16.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.160+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843f2d0 0x556bc844f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.160+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843fbe0 0x556bc844fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.160+0000 7efdb51d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc844aad0 0x556bc84a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.161+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc84a7820 con 0x556bc844aad0 2023-07-14T13:02:16.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.161+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc84a7990 con 0x556bc843f2d0 2023-07-14T13:02:16.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.161+0000 7efdb51d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc84a7b50 con 0x556bc843fbe0 2023-07-14T13:02:16.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.161+0000 7efdb51d9b80 10 client.0 _ll_register_callbacks cb 0x7efd94007810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:16.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.161+0000 7efd9a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843fbe0 0x556bc844fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.161+0000 7efd9b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843f2d0 0x556bc844f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.161+0000 7efd9a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843fbe0 0x556bc844fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59814/0 (socket says 172.21.15.17:59814) 2023-07-14T13:02:16.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.161+0000 7efd9a7fc700 1 -- 172.21.15.17:0/1058506523 learned_addr learned my addr 172.21.15.17:0/1058506523 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:16.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.161+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc844aad0 0x556bc84a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.162+0000 7efd9a7fc700 1 -- 172.21.15.17:0/1058506523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843f2d0 msgr2=0x556bc844f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.162+0000 7efd9a7fc700 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843f2d0 0x556bc844f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.162+0000 7efd9a7fc700 1 -- 172.21.15.17:0/1058506523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc844aad0 msgr2=0x556bc84a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.162+0000 7efd9a7fc700 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc844aad0 0x556bc84a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.162+0000 7efd9a7fc700 1 -- 172.21.15.17:0/1058506523 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bc81a8c60 con 0x556bc843fbe0 2023-07-14T13:02:16.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.162+0000 7efd9a7fc700 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843fbe0 0x556bc844fc30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x556bc845d100 tx=0x7efd9001fd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=987d1e2a9a9cdfbe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.162+0000 7efd7eff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:02:16.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.162+0000 7efd7eff5700 1 -- 172.21.15.17:0/1058506523 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90016030 con 0x556bc843fbe0 2023-07-14T13:02:16.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.162+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1058506523 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd9400f040 con 0x556bc843fbe0 2023-07-14T13:02:16.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.162+0000 7efd7eff5700 1 -- 172.21.15.17:0/1058506523 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7efd90003e50 con 0x556bc843fbe0 2023-07-14T13:02:16.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.163+0000 7efd7eff5700 1 -- 172.21.15.17:0/1058506523 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd9001f0f0 con 0x556bc843fbe0 2023-07-14T13:02:16.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.163+0000 7efdb51d9b80 10 client.25891 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:16.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.163+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1058506523 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x556bc81be2b0 con 0x556bc843fbe0 2023-07-14T13:02:16.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.163+0000 7efd7eff5700 1 -- 172.21.15.17:0/1058506523 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd9400f040 con 0x556bc843fbe0 2023-07-14T13:02:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.163+0000 7efd7eff5700 1 -- 172.21.15.17:0/1058506523 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7efd90010a60 con 0x556bc843fbe0 2023-07-14T13:02:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.163+0000 7efdb51d9b80 10 client.25891 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.163+0000 7efdb51d9b80 10 client.25891 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:02:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.163+0000 7efdb51d9b80 20 client.25891 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.163+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556bc84af310 0x556bc84b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.163+0000 7efdb51d9b80 4 client.25891 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:02:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.163+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1058506523 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556bc834d050 con 0x556bc84af310 2023-07-14T13:02:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.164+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556bc84af310 0x556bc84b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.164+0000 7efd9b7fe700 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556bc84af310 0x556bc84b1720 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d417f6ea124a87af server_cookie=f6e9165025cf742d in_seq=0 out_seq=0 2023-07-14T13:02:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.164+0000 7efd7eff5700 10 client.25891 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:02:16.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efd7eff5700 1 -- 172.21.15.17:0/1058506523 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556bc834d050 con 0x556bc84af310 2023-07-14T13:02:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efd7eff5700 10 client.25891 handle_command_reply: tid=0 2023-07-14T13:02:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 1 client.25891 shutdown 2023-07-14T13:02:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1058506523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843fbe0 msgr2=0x556bc844fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843fbe0 0x556bc844fc30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x556bc845d100 tx=0x7efd9001fd90 comp rx=0 tx=0).stop 2023-07-14T13:02:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1058506523 shutdown_connections 2023-07-14T13:02:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556bc844aad0 0x556bc84a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556bc84af310 0x556bc84b1720 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556bc843f2d0 0x556bc844f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 1 --2- 172.21.15.17:0/1058506523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bc843fbe0 0x556bc844fc30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efd7eff5700 0 client.25891 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:02:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1058506523 >> 172.21.15.17:0/1058506523 conn(0x556bc8435da0 msgr2=0x556bc8442ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1058506523 shutdown_connections 2023-07-14T13:02:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 1 -- 172.21.15.17:0/1058506523 wait complete. 2023-07-14T13:02:16.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.165+0000 7efdb51d9b80 20 client.25891 trim_cache size 0 max 16384 2023-07-14T13:02:16.205 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:02:16.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 -- 172.21.15.17:0/2087041733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd840a1340 msgr2=0x7efd840a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd840a1340 0x7efd840a37f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009ce0 tx=0x7efd8c097040 comp rx=0 tx=0).stop 2023-07-14T13:02:16.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 -- 172.21.15.17:0/2087041733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd9c100ca0 msgr2=0x7efd9c197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd9c100ca0 0x7efd9c197d50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd8c005740 tx=0x7efd8c005770 comp rx=0 tx=0).stop 2023-07-14T13:02:16.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 -- 172.21.15.17:0/2087041733 shutdown_connections 2023-07-14T13:02:16.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd840a1340 0x7efd840a37f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd9c10a070 0x7efd9c19c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd9c100ca0 0x7efd9c197d50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 --2- 172.21.15.17:0/2087041733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd9c1015b0 0x7efd9c198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 -- 172.21.15.17:0/2087041733 >> 172.21.15.17:0/2087041733 conn(0x7efd9c0fa4b0 msgr2=0x7efd9c0fb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 -- 172.21.15.17:0/2087041733 shutdown_connections 2023-07-14T13:02:16.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.166+0000 7efda17ff700 1 -- 172.21.15.17:0/2087041733 wait complete. 2023-07-14T13:02:16.214 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:16 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1909556200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:02:16.217 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:02:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.410+0000 7febc0b9d700 1 -- 172.21.15.17:0/1078318765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febbc1003a0 msgr2=0x7febbc10c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.410+0000 7febc0b9d700 1 --2- 172.21.15.17:0/1078318765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febbc1003a0 0x7febbc10c830 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7febb400b0a0 tx=0x7febb400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.410+0000 7febc0b9d700 1 -- 172.21.15.17:0/1078318765 shutdown_connections 2023-07-14T13:02:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.410+0000 7febc0b9d700 1 --2- 172.21.15.17:0/1078318765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febbc1003a0 0x7febbc10c830 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.410+0000 7febc0b9d700 1 --2- 172.21.15.17:0/1078318765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc105a00 0x7febbc105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.410+0000 7febc0b9d700 1 --2- 172.21.15.17:0/1078318765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febbc0ff9f0 0x7febbc0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.410+0000 7febc0b9d700 1 -- 172.21.15.17:0/1078318765 >> 172.21.15.17:0/1078318765 conn(0x7febbc0fb4f0 msgr2=0x7febbc0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.410+0000 7febc0b9d700 1 -- 172.21.15.17:0/1078318765 shutdown_connections 2023-07-14T13:02:16.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.410+0000 7febc0b9d700 1 -- 172.21.15.17:0/1078318765 wait complete. 2023-07-14T13:02:16.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.412+0000 7febc0b9d700 1 Processor -- start 2023-07-14T13:02:16.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.412+0000 7febc0b9d700 1 -- start start 2023-07-14T13:02:16.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febc0b9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febbc0ff9f0 0x7febbc19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febc0b9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febbc1003a0 0x7febbc19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febc0b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc105a00 0x7febbc195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febc0b9d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc195df0 con 0x7febbc0ff9f0 2023-07-14T13:02:16.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febc0b9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc195f60 con 0x7febbc1003a0 2023-07-14T13:02:16.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febc0b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc196120 con 0x7febbc105a00 2023-07-14T13:02:16.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febbc0ff9f0 0x7febbc19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febbc0ff9f0 0x7febbc19b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53892/0 (socket says 172.21.15.17:53892) 2023-07-14T13:02:16.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febbb7fe700 1 -- 172.21.15.17:0/1122480015 learned_addr learned my addr 172.21.15.17:0/1122480015 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:16.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febbbfff700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc105a00 0x7febbc195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febbaffd700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febbc1003a0 0x7febbc19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febbb7fe700 1 -- 172.21.15.17:0/1122480015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc105a00 msgr2=0x7febbc195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febbb7fe700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc105a00 0x7febbc195780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febbb7fe700 1 -- 172.21.15.17:0/1122480015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febbc1003a0 msgr2=0x7febbc19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febbb7fe700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febbc1003a0 0x7febbc19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febbb7fe700 1 -- 172.21.15.17:0/1122480015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb4009d00 con 0x7febbc0ff9f0 2023-07-14T13:02:16.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.413+0000 7febbaffd700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febbc1003a0 0x7febbc19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:02:16.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.414+0000 7febbb7fe700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febbc0ff9f0 0x7febbc19b710 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7febac00e970 tx=0x7febac00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.414+0000 7febb8ff9700 1 -- 172.21.15.17:0/1122480015 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac009790 con 0x7febbc0ff9f0 2023-07-14T13:02:16.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.414+0000 7febc0b9d700 1 -- 172.21.15.17:0/1122480015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febbc196400 con 0x7febbc0ff9f0 2023-07-14T13:02:16.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.414+0000 7febb8ff9700 1 -- 172.21.15.17:0/1122480015 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febac0044b0 con 0x7febbc0ff9f0 2023-07-14T13:02:16.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.414+0000 7febb8ff9700 1 -- 172.21.15.17:0/1122480015 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac003dd0 con 0x7febbc0ff9f0 2023-07-14T13:02:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.414+0000 7febc0b9d700 1 -- 172.21.15.17:0/1122480015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febbc1a2700 con 0x7febbc0ff9f0 2023-07-14T13:02:16.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:16 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1909556200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:02:16.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.418+0000 7febb8ff9700 1 -- 172.21.15.17:0/1122480015 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7febac003f30 con 0x7febbc0ff9f0 2023-07-14T13:02:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.419+0000 7febd5726b80 1 Processor -- start 2023-07-14T13:02:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.420+0000 7febb8ff9700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feba40a1360 0x7feba40a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.420+0000 7febd5726b80 1 -- start start 2023-07-14T13:02:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.420+0000 7febb8ff9700 1 -- 172.21.15.17:0/1122480015 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7febac014070 con 0x7febbc0ff9f0 2023-07-14T13:02:16.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.420+0000 7febbbfff700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feba40a1360 0x7feba40a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.420+0000 7febd5726b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e332254f0 0x559e332258c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.420+0000 7febd5726b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3322f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.420+0000 7febd5726b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e3322fd30 0x559e33232110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.420+0000 7febd5726b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e3312acb0 con 0x559e332254f0 2023-07-14T13:02:16.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.420+0000 7febd5726b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e3317da40 con 0x559e33225e00 2023-07-14T13:02:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.420+0000 7febd5726b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e33176ed0 con 0x559e3322fd30 2023-07-14T13:02:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e332254f0 0x559e332258c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e332254f0 0x559e332258c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53904/0 (socket says 172.21.15.17:53904) 2023-07-14T13:02:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbb7fe700 1 -- 172.21.15.17:0/82199453 learned_addr learned my addr 172.21.15.17:0/82199453 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbaffd700 1 --2- 172.21.15.17:0/82199453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3322f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbbfff700 1 --2- 172.21.15.17:0/82199453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e3322fd30 0x559e33232110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbb7fe700 1 -- 172.21.15.17:0/82199453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e3322fd30 msgr2=0x559e33232110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbb7fe700 1 --2- 172.21.15.17:0/82199453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e3322fd30 0x559e33232110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbb7fe700 1 -- 172.21.15.17:0/82199453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 msgr2=0x559e3322f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbb7fe700 1 --2- 172.21.15.17:0/82199453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3322f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbbfff700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feba40a1360 0x7feba40a3810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febb40062a0 tx=0x7febb4006210 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbb7fe700 1 -- 172.21.15.17:0/82199453 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e32fa4de0 con 0x559e332254f0 2023-07-14T13:02:16.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.421+0000 7febbb7fe700 1 --2- 172.21.15.17:0/82199453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e332254f0 0x559e332258c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7febac0a1fb0 tx=0x7febac099ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b57c93a535b854c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.422+0000 7feba1ffb700 1 -- 172.21.15.17:0/82199453 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac09a090 con 0x559e332254f0 2023-07-14T13:02:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.422+0000 7feba1ffb700 1 -- 172.21.15.17:0/82199453 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febac09e0c0 con 0x559e332254f0 2023-07-14T13:02:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.422+0000 7feba1ffb700 1 -- 172.21.15.17:0/82199453 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0967a0 con 0x559e332254f0 2023-07-14T13:02:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.422+0000 7febd5726b80 1 -- 172.21.15.17:0/82199453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e332254f0 msgr2=0x559e332258c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.422+0000 7febd5726b80 1 --2- 172.21.15.17:0/82199453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e332254f0 0x559e332258c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7febac0a1fb0 tx=0x7febac099ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.423+0000 7febd5726b80 1 -- 172.21.15.17:0/82199453 shutdown_connections 2023-07-14T13:02:16.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.423+0000 7febd5726b80 1 --2- 172.21.15.17:0/82199453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e3322fd30 0x559e33232110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.423+0000 7febd5726b80 1 --2- 172.21.15.17:0/82199453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e332254f0 0x559e332258c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.423+0000 7febd5726b80 1 --2- 172.21.15.17:0/82199453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3322f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.423+0000 7febd5726b80 1 -- 172.21.15.17:0/82199453 >> 172.21.15.17:0/82199453 conn(0x559e3321aff0 msgr2=0x559e33220930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.423+0000 7febd5726b80 1 -- 172.21.15.17:0/82199453 shutdown_connections 2023-07-14T13:02:16.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.423+0000 7febd5726b80 1 -- 172.21.15.17:0/82199453 wait complete. 2023-07-14T13:02:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.423+0000 7febd5726b80 1 -- start start 2023-07-14T13:02:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.423+0000 7febd5726b80 1 Processor -- start 2023-07-14T13:02:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.424+0000 7febd5726b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e332254f0 0x559e3322f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.424+0000 7febd5726b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3322ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.424+0000 7febd5726b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.424+0000 7febd5726b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e33116ac0 con 0x559e3322fd30 2023-07-14T13:02:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.424+0000 7febd5726b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e331167c0 con 0x559e33225e00 2023-07-14T13:02:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.424+0000 7febd5726b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e32ffa920 con 0x559e332254f0 2023-07-14T13:02:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.424+0000 7febd5726b80 10 client.0 _ll_register_callbacks cb 0x559e33114760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.424+0000 7febbbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.424+0000 7febbbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53920/0 (socket says 172.21.15.17:53920) 2023-07-14T13:02:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.424+0000 7febbbfff700 1 -- 172.21.15.17:0/3558616303 learned_addr learned my addr 172.21.15.17:0/3558616303 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.424+0000 7febbaffd700 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3322ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.425+0000 7febbb7fe700 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e332254f0 0x559e3322f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.425+0000 7febbbfff700 1 -- 172.21.15.17:0/3558616303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e332254f0 msgr2=0x559e3322f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.425+0000 7febbbfff700 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e332254f0 0x559e3322f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.425+0000 7febbbfff700 1 -- 172.21.15.17:0/3558616303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 msgr2=0x559e3322ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.425+0000 7febbbfff700 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3322ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.425+0000 7febbbfff700 1 -- 172.21.15.17:0/3558616303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febbc1a2700 con 0x559e3322fd30 2023-07-14T13:02:16.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.425+0000 7febbaffd700 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3322ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.425+0000 7febbbfff700 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322d0e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7febb400b0a0 tx=0x7febb40099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954f17aaa1fb7b7b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.425+0000 7feb9affd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.426+0000 7feb9affd700 1 -- 172.21.15.17:0/3558616303 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400e040 con 0x559e3322fd30 2023-07-14T13:02:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.426+0000 7febd5726b80 1 -- 172.21.15.17:0/3558616303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e330d04f0 con 0x559e3322fd30 2023-07-14T13:02:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.426+0000 7feb9affd700 1 -- 172.21.15.17:0/3558616303 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7febb4023040 con 0x559e3322fd30 2023-07-14T13:02:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.426+0000 7feb9affd700 1 -- 172.21.15.17:0/3558616303 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7febb400bdb0 con 0x559e3322fd30 2023-07-14T13:02:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.426+0000 7febd5726b80 10 client.16179 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:16.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.426+0000 7febd5726b80 1 -- 172.21.15.17:0/3558616303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x559e32f8dc60 con 0x559e3322fd30 2023-07-14T13:02:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.426+0000 7feb9affd700 1 -- 172.21.15.17:0/3558616303 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559e330d04f0 con 0x559e3322fd30 2023-07-14T13:02:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.426+0000 7feb9affd700 1 -- 172.21.15.17:0/3558616303 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7febb4005840 con 0x559e3322fd30 2023-07-14T13:02:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.427+0000 7febd5726b80 10 client.16179 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.427+0000 7febd5726b80 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.427+0000 7febd5726b80 20 client.16179 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.427+0000 7febd5726b80 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e3323f7a0 0x559e33241bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.427+0000 7febd5726b80 4 client.16179 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.427+0000 7febd5726b80 1 -- 172.21.15.17:0/3558616303 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e3316feb0 con 0x559e3323f7a0 2023-07-14T13:02:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.427+0000 7febbb7fe700 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e3323f7a0 0x559e33241bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.428+0000 7febbb7fe700 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e3323f7a0 0x559e33241bb0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6b8a0fdcbff0c2 server_cookie=a0e841c55ccd842f in_seq=0 out_seq=0 2023-07-14T13:02:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.428+0000 7feb9affd700 10 client.16179 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.428+0000 7feb9affd700 1 -- 172.21.15.17:0/3558616303 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559e3316feb0 con 0x559e3323f7a0 2023-07-14T13:02:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7feb9affd700 10 client.16179 handle_command_reply: tid=0 2023-07-14T13:02:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 1 client.16179 shutdown 2023-07-14T13:02:16.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 1 -- 172.21.15.17:0/3558616303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 msgr2=0x559e3322d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322d0e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7febb400b0a0 tx=0x7febb40099e0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 1 -- 172.21.15.17:0/3558616303 shutdown_connections 2023-07-14T13:02:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e3323f7a0 0x559e33241bb0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322d0e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e332254f0 0x559e3322f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7feb9affd700 0 client.16179 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 1 --2- 172.21.15.17:0/3558616303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3322ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 1 -- 172.21.15.17:0/3558616303 >> 172.21.15.17:0/3558616303 conn(0x559e3321aff0 msgr2=0x559e332204c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 1 -- 172.21.15.17:0/3558616303 shutdown_connections 2023-07-14T13:02:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 1 -- 172.21.15.17:0/3558616303 wait complete. 2023-07-14T13:02:16.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.429+0000 7febd5726b80 20 client.16179 trim_cache size 0 max 16384 2023-07-14T13:02:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.444+0000 7febd5726b80 1 Processor -- start 2023-07-14T13:02:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.444+0000 7febd5726b80 1 -- start start 2023-07-14T13:02:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febd5726b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e332254f0 0x559e33236810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febd5726b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3323baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febd5726b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febd5726b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e330d04f0 con 0x559e3322fd30 2023-07-14T13:02:16.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febd5726b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e3322d6e0 con 0x559e33225e00 2023-07-14T13:02:16.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febd5726b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e33226980 con 0x559e332254f0 2023-07-14T13:02:16.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febbbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febbbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53928/0 (socket says 172.21.15.17:53928) 2023-07-14T13:02:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febbbfff700 1 -- 172.21.15.17:0/2211578002 learned_addr learned my addr 172.21.15.17:0/2211578002 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febbb7fe700 1 --2- 172.21.15.17:0/2211578002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e332254f0 0x559e33236810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febbaffd700 1 --2- 172.21.15.17:0/2211578002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3323baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febbbfff700 1 -- 172.21.15.17:0/2211578002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e332254f0 msgr2=0x559e33236810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febbbfff700 1 --2- 172.21.15.17:0/2211578002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e332254f0 0x559e33236810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febbbfff700 1 -- 172.21.15.17:0/2211578002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 msgr2=0x559e3323baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febbbfff700 1 --2- 172.21.15.17:0/2211578002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3323baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febbbfff700 1 -- 172.21.15.17:0/2211578002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e32fcb250 con 0x559e3322fd30 2023-07-14T13:02:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.445+0000 7febbaffd700 1 --2- 172.21.15.17:0/2211578002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3323baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:02:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.446+0000 7febbbfff700 1 --2- 172.21.15.17:0/2211578002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322f380 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7febb40061e0 tx=0x7febb40077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f450ebae880238af server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.446+0000 7feba27fc700 1 -- 172.21.15.17:0/2211578002 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400bd90 con 0x559e3322fd30 2023-07-14T13:02:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.446+0000 7feba27fc700 1 -- 172.21.15.17:0/2211578002 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febb4009400 con 0x559e3322fd30 2023-07-14T13:02:16.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.446+0000 7feba27fc700 1 -- 172.21.15.17:0/2211578002 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4012880 con 0x559e3322fd30 2023-07-14T13:02:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.447+0000 7febd5726b80 1 -- 172.21.15.17:0/2211578002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 msgr2=0x559e3322f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.447+0000 7febd5726b80 1 --2- 172.21.15.17:0/2211578002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322f380 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7febb40061e0 tx=0x7febb40077c0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.447+0000 7febd5726b80 1 -- 172.21.15.17:0/2211578002 shutdown_connections 2023-07-14T13:02:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.447+0000 7febd5726b80 1 --2- 172.21.15.17:0/2211578002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e3322f380 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.447+0000 7febd5726b80 1 --2- 172.21.15.17:0/2211578002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e332254f0 0x559e33236810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.447+0000 7febd5726b80 1 --2- 172.21.15.17:0/2211578002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e33225e00 0x559e3323baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.447+0000 7febd5726b80 1 -- 172.21.15.17:0/2211578002 >> 172.21.15.17:0/2211578002 conn(0x559e3321aff0 msgr2=0x559e33246510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.447+0000 7febd5726b80 1 -- 172.21.15.17:0/2211578002 shutdown_connections 2023-07-14T13:02:16.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.447+0000 7febd5726b80 1 -- 172.21.15.17:0/2211578002 wait complete. 2023-07-14T13:02:16.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.447+0000 7febd5726b80 1 -- start start 2023-07-14T13:02:16.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.448+0000 7febd5726b80 1 Processor -- start 2023-07-14T13:02:16.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.448+0000 7febd5726b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e332254f0 0x559e33234120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.448+0000 7febd5726b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e33225e00 0x559e33234660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.448+0000 7febd5726b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e33234bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.448+0000 7febd5726b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e33296c20 con 0x559e3322fd30 2023-07-14T13:02:16.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.448+0000 7febd5726b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e33296d90 con 0x559e332254f0 2023-07-14T13:02:16.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.448+0000 7febd5726b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e33296f50 con 0x559e33225e00 2023-07-14T13:02:16.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.448+0000 7febd5726b80 10 client.0 _ll_register_callbacks cb 0x7febb4007f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:16.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.448+0000 7febbb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e332254f0 0x559e33234120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.448+0000 7febbbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e33234bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.448+0000 7febbaffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e33225e00 0x559e33234660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7febbb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e332254f0 0x559e33234120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40254/0 (socket says 172.21.15.17:40254) 2023-07-14T13:02:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7febbb7fe700 1 -- 172.21.15.17:0/4101988962 learned_addr learned my addr 172.21.15.17:0/4101988962 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7febbaffd700 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e33225e00 0x559e33234660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59864/0 (socket says 172.21.15.17:59864) 2023-07-14T13:02:16.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7febbbfff700 1 -- 172.21.15.17:0/4101988962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e33225e00 msgr2=0x559e33234660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7febbbfff700 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e33225e00 0x559e33234660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7febbbfff700 1 -- 172.21.15.17:0/4101988962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e332254f0 msgr2=0x559e33234120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7febbbfff700 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e332254f0 0x559e33234120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7febbbfff700 1 -- 172.21.15.17:0/4101988962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e32f8dc60 con 0x559e3322fd30 2023-07-14T13:02:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7febbaffd700 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e33225e00 0x559e33234660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:16.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7febbb7fe700 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e332254f0 0x559e33234120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:16.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7febbbfff700 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e33234bc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7febb400d010 tx=0x7febb403bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3175603cdc2dbeaa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:16.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.449+0000 7feb9affd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:16.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.450+0000 7feb9affd700 1 -- 172.21.15.17:0/4101988962 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb401b430 con 0x559e3322fd30 2023-07-14T13:02:16.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.450+0000 7febd5726b80 1 -- 172.21.15.17:0/4101988962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febac09e0c0 con 0x559e3322fd30 2023-07-14T13:02:16.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.450+0000 7feb9affd700 1 -- 172.21.15.17:0/4101988962 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7febb401b590 con 0x559e3322fd30 2023-07-14T13:02:16.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.450+0000 7feb9affd700 1 -- 172.21.15.17:0/4101988962 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7febb401b750 con 0x559e3322fd30 2023-07-14T13:02:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.450+0000 7febd5726b80 10 client.16185 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.450+0000 7febd5726b80 1 -- 172.21.15.17:0/4101988962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x559e32fa32b0 con 0x559e3322fd30 2023-07-14T13:02:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.450+0000 7feb9affd700 1 -- 172.21.15.17:0/4101988962 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febac09e0c0 con 0x559e3322fd30 2023-07-14T13:02:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.450+0000 7feb9affd700 1 -- 172.21.15.17:0/4101988962 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7febb4043ae0 con 0x559e3322fd30 2023-07-14T13:02:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.450+0000 7febd5726b80 10 client.16185 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:16.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.450+0000 7febd5726b80 10 client.16185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.450+0000 7febd5726b80 20 client.16185 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.451+0000 7febd5726b80 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e332981f0 0x559e3329a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.451+0000 7febd5726b80 4 client.16185 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:02:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.451+0000 7febd5726b80 1 -- 172.21.15.17:0/4101988962 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559e33132050 con 0x559e332981f0 2023-07-14T13:02:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.451+0000 7febbb7fe700 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e332981f0 0x559e3329a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7febbb7fe700 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e332981f0 0x559e3329a5d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f240296edbe736e server_cookie=8e2af9999628103e in_seq=0 out_seq=0 2023-07-14T13:02:16.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7feb9affd700 10 client.16185 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7feb9affd700 1 -- 172.21.15.17:0/4101988962 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559e33132050 con 0x559e332981f0 2023-07-14T13:02:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7feb9affd700 10 client.16185 handle_command_reply: tid=0 2023-07-14T13:02:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7febd5726b80 1 client.16185 shutdown 2023-07-14T13:02:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7febd5726b80 1 -- 172.21.15.17:0/4101988962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 msgr2=0x559e33234bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7febd5726b80 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e33234bc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7febb400d010 tx=0x7febb403bed0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7febd5726b80 1 -- 172.21.15.17:0/4101988962 shutdown_connections 2023-07-14T13:02:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7febd5726b80 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e332981f0 0x559e3329a5d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7febd5726b80 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e3322fd30 0x559e33234bc0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7febd5726b80 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e332254f0 0x559e33234120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7febd5726b80 1 --2- 172.21.15.17:0/4101988962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e33225e00 0x559e33234660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7feb9affd700 0 client.16185 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.452+0000 7febd5726b80 1 -- 172.21.15.17:0/4101988962 >> 172.21.15.17:0/4101988962 conn(0x559e3321aff0 msgr2=0x559e3323baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.453+0000 7febd5726b80 1 -- 172.21.15.17:0/4101988962 shutdown_connections 2023-07-14T13:02:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.453+0000 7febd5726b80 1 -- 172.21.15.17:0/4101988962 wait complete. 2023-07-14T13:02:16.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.453+0000 7febd5726b80 20 client.16185 trim_cache size 0 max 16384 2023-07-14T13:02:16.496 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:02:16.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.453+0000 7febc0b9d700 1 -- 172.21.15.17:0/1122480015 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feba40a1360 msgr2=0x7feba40a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.453+0000 7febc0b9d700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feba40a1360 0x7feba40a3810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febb40062a0 tx=0x7febb4006210 comp rx=0 tx=0).stop 2023-07-14T13:02:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.453+0000 7febc0b9d700 1 -- 172.21.15.17:0/1122480015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febbc0ff9f0 msgr2=0x7febbc19b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.453+0000 7febc0b9d700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febbc0ff9f0 0x7febbc19b710 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7febac00e970 tx=0x7febac00ed30 comp rx=0 tx=0).stop 2023-07-14T13:02:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.454+0000 7febc0b9d700 1 -- 172.21.15.17:0/1122480015 shutdown_connections 2023-07-14T13:02:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.454+0000 7febc0b9d700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feba40a1360 0x7feba40a3810 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.454+0000 7febc0b9d700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc105a00 0x7febbc195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.454+0000 7febc0b9d700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febbc0ff9f0 0x7febbc19b710 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.454+0000 7febc0b9d700 1 --2- 172.21.15.17:0/1122480015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febbc1003a0 0x7febbc19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.454+0000 7febc0b9d700 1 -- 172.21.15.17:0/1122480015 >> 172.21.15.17:0/1122480015 conn(0x7febbc0fb4f0 msgr2=0x7febbc1067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.454+0000 7febc0b9d700 1 -- 172.21.15.17:0/1122480015 shutdown_connections 2023-07-14T13:02:16.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:16.454+0000 7febc0b9d700 1 -- 172.21.15.17:0/1122480015 wait complete. 2023-07-14T13:02:16.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:16 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1909556200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:02:16.894 INFO:teuthology.orchestra.run.smithi017.stderr:7600000 of 50000000 tuples (15%) done (elapsed 126.50 s, remaining 705.73 s) 2023-07-14T13:02:17.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:17 smithi017 ceph-mon[95536]: pgmap v79: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 35 MiB/s wr, 63 op/s 2023-07-14T13:02:17.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:17 smithi135 ceph-mon[97338]: pgmap v79: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 35 MiB/s wr, 63 op/s 2023-07-14T13:02:17.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:17 smithi131 ceph-mon[96953]: pgmap v79: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 35 MiB/s wr, 63 op/s 2023-07-14T13:02:17.513 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:02:17.513 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:02:17.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.723+0000 7fd0803ff700 1 -- 172.21.15.17:0/3958175858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078100480 msgr2=0x7fd07810c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:17.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.723+0000 7fd0803ff700 1 --2- 172.21.15.17:0/3958175858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078100480 0x7fd07810c910 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd07000b0a0 tx=0x7fd07000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.724+0000 7fd0803ff700 1 -- 172.21.15.17:0/3958175858 shutdown_connections 2023-07-14T13:02:17.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.724+0000 7fd0803ff700 1 --2- 172.21.15.17:0/3958175858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078100480 0x7fd07810c910 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.724+0000 7fd0803ff700 1 --2- 172.21.15.17:0/3958175858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd078105ae0 0x7fd078105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.724+0000 7fd0803ff700 1 --2- 172.21.15.17:0/3958175858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0780ffad0 0x7fd0780fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.724+0000 7fd0803ff700 1 -- 172.21.15.17:0/3958175858 >> 172.21.15.17:0/3958175858 conn(0x7fd0780fb5f0 msgr2=0x7fd0780fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:17.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.724+0000 7fd0803ff700 1 -- 172.21.15.17:0/3958175858 shutdown_connections 2023-07-14T13:02:17.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.724+0000 7fd0803ff700 1 -- 172.21.15.17:0/3958175858 wait complete. 2023-07-14T13:02:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.725+0000 7fd0803ff700 1 Processor -- start 2023-07-14T13:02:17.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.725+0000 7fd0803ff700 1 -- start start 2023-07-14T13:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.726+0000 7fd0803ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0780ffad0 0x7fd07819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.726+0000 7fd0803ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd078100480 0x7fd07819bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.726+0000 7fd0803ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078105ae0 0x7fd078195a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.726+0000 7fd0803ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd078196070 con 0x7fd078105ae0 2023-07-14T13:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.726+0000 7fd0803ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0781961e0 con 0x7fd0780ffad0 2023-07-14T13:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.726+0000 7fd0803ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0781963a0 con 0x7fd078100480 2023-07-14T13:02:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.726+0000 7fd07e19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0780ffad0 0x7fd07819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.726+0000 7fd07d99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd078100480 0x7fd07819bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.726+0000 7fd07e99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078105ae0 0x7fd078195a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.726+0000 7fd07e19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0780ffad0 0x7fd07819b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40262/0 (socket says 172.21.15.17:40262) 2023-07-14T13:02:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.726+0000 7fd07e19b700 1 -- 172.21.15.17:0/2527660293 learned_addr learned my addr 172.21.15.17:0/2527660293 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.727+0000 7fd07e99c700 1 -- 172.21.15.17:0/2527660293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd078100480 msgr2=0x7fd07819bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.727+0000 7fd07e99c700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd078100480 0x7fd07819bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.727+0000 7fd07e99c700 1 -- 172.21.15.17:0/2527660293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0780ffad0 msgr2=0x7fd07819b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.727+0000 7fd07e99c700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0780ffad0 0x7fd07819b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.727+0000 7fd07e99c700 1 -- 172.21.15.17:0/2527660293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070009d00 con 0x7fd078105ae0 2023-07-14T13:02:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.727+0000 7fd07e99c700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078105ae0 0x7fd078195a00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd070009fd0 tx=0x7fd07000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.727+0000 7fd06f7fe700 1 -- 172.21.15.17:0/2527660293 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07000e040 con 0x7fd078105ae0 2023-07-14T13:02:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.727+0000 7fd0803ff700 1 -- 172.21.15.17:0/2527660293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd078196620 con 0x7fd078105ae0 2023-07-14T13:02:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.727+0000 7fd06f7fe700 1 -- 172.21.15.17:0/2527660293 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd070009480 con 0x7fd078105ae0 2023-07-14T13:02:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.727+0000 7fd06f7fe700 1 -- 172.21.15.17:0/2527660293 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0700052a0 con 0x7fd078105ae0 2023-07-14T13:02:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.727+0000 7fd0803ff700 1 -- 172.21.15.17:0/2527660293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0781a2980 con 0x7fd078105ae0 2023-07-14T13:02:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.731+0000 7fd06f7fe700 1 -- 172.21.15.17:0/2527660293 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd07001d480 con 0x7fd078105ae0 2023-07-14T13:02:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.733+0000 7fd06f7fe700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0640a12c0 0x7fd0640a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.733+0000 7fd06f7fe700 1 -- 172.21.15.17:0/2527660293 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd0700cdca0 con 0x7fd078105ae0 2023-07-14T13:02:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.733+0000 7fd07e19b700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0640a12c0 0x7fd0640a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.735+0000 7fd07e19b700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0640a12c0 0x7fd0640a3770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd074005950 tx=0x7fd07400b500 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.735+0000 7fd093db4b80 1 Processor -- start 2023-07-14T13:02:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.736+0000 7fd093db4b80 1 -- start start 2023-07-14T13:02:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.736+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.736+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5c60 0x5581ab8c0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.736+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab8c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.770 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.736+0000 7fd093db4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab7bbd30 con 0x5581ab8b5350 2023-07-14T13:02:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.736+0000 7fd093db4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab80eac0 con 0x5581ab8c0b50 2023-07-14T13:02:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.736+0000 7fd093db4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab807f50 con 0x5581ab8b5c60 2023-07-14T13:02:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.736+0000 7fd07e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.736+0000 7fd07e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8b5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53968/0 (socket says 172.21.15.17:53968) 2023-07-14T13:02:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.736+0000 7fd07d99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5c60 0x5581ab8c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.736+0000 7fd07e19b700 1 -- 172.21.15.17:0/2334506512 learned_addr learned my addr 172.21.15.17:0/2334506512 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:17.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.737+0000 7fd07e99c700 1 --2- 172.21.15.17:0/2334506512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab8c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.737+0000 7fd07e19b700 1 -- 172.21.15.17:0/2334506512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5c60 msgr2=0x5581ab8c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:17.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.737+0000 7fd07e19b700 1 --2- 172.21.15.17:0/2334506512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5c60 0x5581ab8c0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.737+0000 7fd07e19b700 1 -- 172.21.15.17:0/2334506512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 msgr2=0x5581ab8c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:17.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.737+0000 7fd07e19b700 1 --2- 172.21.15.17:0/2334506512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab8c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.737+0000 7fd07e19b700 1 -- 172.21.15.17:0/2334506512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581ab635e60 con 0x5581ab8b5350 2023-07-14T13:02:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.737+0000 7fd07e19b700 1 --2- 172.21.15.17:0/2334506512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8b5720 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd074010f70 tx=0x7fd074013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c5e33e4e7d6606 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:17.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.738+0000 7fd06cbfe700 1 -- 172.21.15.17:0/2334506512 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074011db0 con 0x5581ab8b5350 2023-07-14T13:02:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.738+0000 7fd06cbfe700 1 -- 172.21.15.17:0/2334506512 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd074015070 con 0x5581ab8b5350 2023-07-14T13:02:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.738+0000 7fd06cbfe700 1 -- 172.21.15.17:0/2334506512 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074003d30 con 0x5581ab8b5350 2023-07-14T13:02:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.739+0000 7fd093db4b80 1 -- 172.21.15.17:0/2334506512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 msgr2=0x5581ab8b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.739+0000 7fd093db4b80 1 --2- 172.21.15.17:0/2334506512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8b5720 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd074010f70 tx=0x7fd074013000 comp rx=0 tx=0).stop 2023-07-14T13:02:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.739+0000 7fd093db4b80 1 -- 172.21.15.17:0/2334506512 shutdown_connections 2023-07-14T13:02:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.739+0000 7fd093db4b80 1 --2- 172.21.15.17:0/2334506512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab8c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.739+0000 7fd093db4b80 1 --2- 172.21.15.17:0/2334506512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8b5720 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.739+0000 7fd093db4b80 1 --2- 172.21.15.17:0/2334506512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5c60 0x5581ab8c0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.739+0000 7fd093db4b80 1 -- 172.21.15.17:0/2334506512 >> 172.21.15.17:0/2334506512 conn(0x5581ab8abe20 msgr2=0x5581ab8b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.739+0000 7fd093db4b80 1 -- 172.21.15.17:0/2334506512 shutdown_connections 2023-07-14T13:02:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.739+0000 7fd093db4b80 1 -- 172.21.15.17:0/2334506512 wait complete. 2023-07-14T13:02:17.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.740+0000 7fd093db4b80 1 -- start start 2023-07-14T13:02:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.740+0000 7fd093db4b80 1 Processor -- start 2023-07-14T13:02:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.741+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5350 0x5581ab8c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.741+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.741+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab8bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.741+0000 7fd093db4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab7a7b40 con 0x5581ab8b5c60 2023-07-14T13:02:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.741+0000 7fd093db4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab7a7840 con 0x5581ab8c0b50 2023-07-14T13:02:17.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.741+0000 7fd093db4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab68b9a0 con 0x5581ab8b5350 2023-07-14T13:02:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.741+0000 7fd093db4b80 10 client.0 _ll_register_callbacks cb 0x5581ab7a57e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.742+0000 7fd07d99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.742+0000 7fd07d99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53980/0 (socket says 172.21.15.17:53980) 2023-07-14T13:02:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.742+0000 7fd07d99a700 1 -- 172.21.15.17:0/1262051863 learned_addr learned my addr 172.21.15.17:0/1262051863 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.742+0000 7fd07e99c700 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab8bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.742+0000 7fd07e19b700 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5350 0x5581ab8c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.742+0000 7fd07d99a700 1 -- 172.21.15.17:0/1262051863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5350 msgr2=0x5581ab8c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.742+0000 7fd07d99a700 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5350 0x5581ab8c05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.742+0000 7fd07d99a700 1 -- 172.21.15.17:0/1262051863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 msgr2=0x5581ab8bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.742+0000 7fd07d99a700 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab8bdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.742+0000 7fd07d99a700 1 -- 172.21.15.17:0/1262051863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd074010c50 con 0x5581ab8b5c60 2023-07-14T13:02:17.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.742+0000 7fd07e99c700 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab8bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.743+0000 7fd07d99a700 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd850 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd0680127f0 tx=0x7fd068012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec4d1b19c362873 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.743+0000 7fd061ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:17.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.743+0000 7fd061ffb700 1 -- 172.21.15.17:0/1262051863 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068017070 con 0x5581ab8b5c60 2023-07-14T13:02:17.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.743+0000 7fd093db4b80 1 -- 172.21.15.17:0/1262051863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581ab761570 con 0x5581ab8b5c60 2023-07-14T13:02:17.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.743+0000 7fd061ffb700 1 -- 172.21.15.17:0/1262051863 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd06800f5c0 con 0x5581ab8b5c60 2023-07-14T13:02:17.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.743+0000 7fd061ffb700 1 -- 172.21.15.17:0/1262051863 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd06800f780 con 0x5581ab8b5c60 2023-07-14T13:02:17.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.743+0000 7fd093db4b80 10 client.16197 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:17.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.743+0000 7fd093db4b80 1 -- 172.21.15.17:0/1262051863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5581ab61ece0 con 0x5581ab8b5c60 2023-07-14T13:02:17.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.744+0000 7fd061ffb700 1 -- 172.21.15.17:0/1262051863 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5581ab761570 con 0x5581ab8b5c60 2023-07-14T13:02:17.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.744+0000 7fd061ffb700 1 -- 172.21.15.17:0/1262051863 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd068010870 con 0x5581ab8b5c60 2023-07-14T13:02:17.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.744+0000 7fd093db4b80 10 client.16197 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.744+0000 7fd093db4b80 10 client.16197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.744+0000 7fd093db4b80 20 client.16197 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:17.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.744+0000 7fd093db4b80 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5581ab8d0540 0x5581ab8d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.744+0000 7fd093db4b80 4 client.16197 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:17.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.744+0000 7fd093db4b80 1 -- 172.21.15.17:0/1262051863 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581ab800f30 con 0x5581ab8d0540 2023-07-14T13:02:17.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.745+0000 7fd07e19b700 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5581ab8d0540 0x5581ab8d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.745+0000 7fd07e19b700 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5581ab8d0540 0x5581ab8d2950 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4725ec3af917d89 server_cookie=9cca4eb258c28378 in_seq=0 out_seq=0 2023-07-14T13:02:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.745+0000 7fd061ffb700 10 client.16197 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.746+0000 7fd061ffb700 1 -- 172.21.15.17:0/1262051863 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5581ab800f30 con 0x5581ab8d0540 2023-07-14T13:02:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.746+0000 7fd061ffb700 10 client.16197 handle_command_reply: tid=0 2023-07-14T13:02:17.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.746+0000 7fd093db4b80 1 client.16197 shutdown 2023-07-14T13:02:17.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd093db4b80 1 -- 172.21.15.17:0/1262051863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 msgr2=0x5581ab8bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:17.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd093db4b80 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd850 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd0680127f0 tx=0x7fd068012b00 comp rx=0 tx=0).stop 2023-07-14T13:02:17.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd093db4b80 1 -- 172.21.15.17:0/1262051863 shutdown_connections 2023-07-14T13:02:17.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd093db4b80 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5581ab8d0540 0x5581ab8d2950 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd093db4b80 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab8bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd093db4b80 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5350 0x5581ab8c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd093db4b80 1 --2- 172.21.15.17:0/1262051863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd850 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd061ffb700 0 client.16197 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:17.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd093db4b80 1 -- 172.21.15.17:0/1262051863 >> 172.21.15.17:0/1262051863 conn(0x5581ab8abe20 msgr2=0x5581ab8b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:17.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd093db4b80 1 -- 172.21.15.17:0/1262051863 shutdown_connections 2023-07-14T13:02:17.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd093db4b80 1 -- 172.21.15.17:0/1262051863 wait complete. 2023-07-14T13:02:17.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.747+0000 7fd093db4b80 20 client.16197 trim_cache size 0 max 16384 2023-07-14T13:02:17.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.769+0000 7fd093db4b80 1 Processor -- start 2023-07-14T13:02:17.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.770+0000 7fd093db4b80 1 -- start start 2023-07-14T13:02:17.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.770+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8b5350 0x5581ab8bd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.770+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.770+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8c0b50 0x5581ab8baae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.770+0000 7fd093db4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab8b2dd0 con 0x5581ab8b5c60 2023-07-14T13:02:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.770+0000 7fd093db4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab8b8730 con 0x5581ab8b5350 2023-07-14T13:02:17.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.770+0000 7fd093db4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab8be9e0 con 0x5581ab8c0b50 2023-07-14T13:02:17.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.770+0000 7fd07d99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.770+0000 7fd07d99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53990/0 (socket says 172.21.15.17:53990) 2023-07-14T13:02:17.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.770+0000 7fd07d99a700 1 -- 172.21.15.17:0/2594804302 learned_addr learned my addr 172.21.15.17:0/2594804302 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:17.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.771+0000 7fd07e19b700 1 --2- 172.21.15.17:0/2594804302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8b5350 0x5581ab8bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.771+0000 7fd07e99c700 1 --2- 172.21.15.17:0/2594804302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8c0b50 0x5581ab8baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.771+0000 7fd07d99a700 1 -- 172.21.15.17:0/2594804302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8c0b50 msgr2=0x5581ab8baae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:17.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.771+0000 7fd07d99a700 1 --2- 172.21.15.17:0/2594804302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8c0b50 0x5581ab8baae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.771+0000 7fd07d99a700 1 -- 172.21.15.17:0/2594804302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8b5350 msgr2=0x5581ab8bd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:17.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.771+0000 7fd07d99a700 1 --2- 172.21.15.17:0/2594804302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8b5350 0x5581ab8bd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.771+0000 7fd07d99a700 1 -- 172.21.15.17:0/2594804302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581ab65c2d0 con 0x5581ab8b5c60 2023-07-14T13:02:17.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.771+0000 7fd07e99c700 1 --2- 172.21.15.17:0/2594804302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8c0b50 0x5581ab8baae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:02:17.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.771+0000 7fd07d99a700 1 --2- 172.21.15.17:0/2594804302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd550 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd068009340 tx=0x7fd0680096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36aa8d5113a11ba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:17.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.772+0000 7fd06d3ff700 1 -- 172.21.15.17:0/2594804302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068017070 con 0x5581ab8b5c60 2023-07-14T13:02:17.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.772+0000 7fd06d3ff700 1 -- 172.21.15.17:0/2594804302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd068018040 con 0x5581ab8b5c60 2023-07-14T13:02:17.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.772+0000 7fd06d3ff700 1 -- 172.21.15.17:0/2594804302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068003680 con 0x5581ab8b5c60 2023-07-14T13:02:17.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.772+0000 7fd093db4b80 1 -- 172.21.15.17:0/2594804302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 msgr2=0x5581ab8bd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:17.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.772+0000 7fd093db4b80 1 --2- 172.21.15.17:0/2594804302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd550 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd068009340 tx=0x7fd0680096d0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.772+0000 7fd093db4b80 1 -- 172.21.15.17:0/2594804302 shutdown_connections 2023-07-14T13:02:17.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.772+0000 7fd093db4b80 1 --2- 172.21.15.17:0/2594804302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8c0b50 0x5581ab8baae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.772+0000 7fd093db4b80 1 --2- 172.21.15.17:0/2594804302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8b5350 0x5581ab8bd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.772+0000 7fd093db4b80 1 --2- 172.21.15.17:0/2594804302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5c60 0x5581ab8bd550 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.772+0000 7fd093db4b80 1 -- 172.21.15.17:0/2594804302 >> 172.21.15.17:0/2594804302 conn(0x5581ab8abe20 msgr2=0x5581ab8c0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:17.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.773+0000 7fd093db4b80 1 -- 172.21.15.17:0/2594804302 shutdown_connections 2023-07-14T13:02:17.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.773+0000 7fd093db4b80 1 -- 172.21.15.17:0/2594804302 wait complete. 2023-07-14T13:02:17.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.773+0000 7fd093db4b80 1 -- start start 2023-07-14T13:02:17.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.773+0000 7fd093db4b80 1 Processor -- start 2023-07-14T13:02:17.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5c60 0x5581ab8c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.811 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd093db4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab9287e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd093db4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab8c6bf0 con 0x5581ab8b5350 2023-07-14T13:02:17.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd093db4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab8c6d60 con 0x5581ab8c0b50 2023-07-14T13:02:17.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd093db4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ab928d20 con 0x5581ab8b5c60 2023-07-14T13:02:17.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd093db4b80 10 client.0 _ll_register_callbacks cb 0x7fd068012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:17.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd07e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd07e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54006/0 (socket says 172.21.15.17:54006) 2023-07-14T13:02:17.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd07e19b700 1 -- 172.21.15.17:0/240811022 learned_addr learned my addr 172.21.15.17:0/240811022 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:17.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd07e99c700 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab9287e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd07e19b700 1 -- 172.21.15.17:0/240811022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5c60 msgr2=0x5581ab8c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:17.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd07e19b700 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5c60 0x5581ab8c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.774+0000 7fd07e19b700 1 -- 172.21.15.17:0/240811022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 msgr2=0x5581ab9287e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:17.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.775+0000 7fd07e19b700 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab9287e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.775+0000 7fd07e19b700 1 -- 172.21.15.17:0/240811022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581ab61ece0 con 0x5581ab8b5350 2023-07-14T13:02:17.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.775+0000 7fd07e99c700 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab9287e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:02:17.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.775+0000 7fd07e19b700 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8c5f20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd074011a00 tx=0x7fd074012d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bfdafd24866f9e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:17.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.775+0000 7fd061ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:17.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.775+0000 7fd061ffb700 1 -- 172.21.15.17:0/240811022 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074034c00 con 0x5581ab8b5350 2023-07-14T13:02:17.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.775+0000 7fd093db4b80 1 -- 172.21.15.17:0/240811022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd074015070 con 0x5581ab8b5350 2023-07-14T13:02:17.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.775+0000 7fd061ffb700 1 -- 172.21.15.17:0/240811022 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd074017070 con 0x5581ab8b5350 2023-07-14T13:02:17.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.775+0000 7fd061ffb700 1 -- 172.21.15.17:0/240811022 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd074034d60 con 0x5581ab8b5350 2023-07-14T13:02:17.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.775+0000 7fd093db4b80 10 client.16203 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:17.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.775+0000 7fd093db4b80 1 -- 172.21.15.17:0/240811022 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5581ab634330 con 0x5581ab8b5350 2023-07-14T13:02:17.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.776+0000 7fd061ffb700 1 -- 172.21.15.17:0/240811022 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd074015070 con 0x5581ab8b5350 2023-07-14T13:02:17.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.776+0000 7fd061ffb700 1 -- 172.21.15.17:0/240811022 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd074011440 con 0x5581ab8b5350 2023-07-14T13:02:17.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.776+0000 7fd093db4b80 10 client.16203 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:17.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.776+0000 7fd093db4b80 10 client.16203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:17.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.776+0000 7fd093db4b80 20 client.16203 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:17.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.776+0000 7fd093db4b80 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5581ab92a3c0 0x5581ab92c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:17.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.776+0000 7fd093db4b80 4 client.16203 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:02:17.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.776+0000 7fd093db4b80 1 -- 172.21.15.17:0/240811022 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5581ab7c30d0 con 0x5581ab92a3c0 2023-07-14T13:02:17.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.777+0000 7fd07d99a700 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5581ab92a3c0 0x5581ab92c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:17.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.777+0000 7fd07d99a700 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5581ab92a3c0 0x5581ab92c7d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=920bf4af55acea95 server_cookie=cef1b83f032ae3f9 in_seq=0 out_seq=0 2023-07-14T13:02:17.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.777+0000 7fd061ffb700 10 client.16203 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:17.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd061ffb700 1 -- 172.21.15.17:0/240811022 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5581ab7c30d0 con 0x5581ab92a3c0 2023-07-14T13:02:17.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd061ffb700 10 client.16203 handle_command_reply: tid=0 2023-07-14T13:02:17.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd093db4b80 1 client.16203 shutdown 2023-07-14T13:02:17.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd093db4b80 1 -- 172.21.15.17:0/240811022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 msgr2=0x5581ab8c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:17.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd093db4b80 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8c5f20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd074011a00 tx=0x7fd074012d70 comp rx=0 tx=0).stop 2023-07-14T13:02:17.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd093db4b80 1 -- 172.21.15.17:0/240811022 shutdown_connections 2023-07-14T13:02:17.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd093db4b80 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5581ab92a3c0 0x5581ab92c7d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd093db4b80 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5581ab8c0b50 0x5581ab9287e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd093db4b80 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5581ab8b5350 0x5581ab8c5f20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd093db4b80 1 --2- 172.21.15.17:0/240811022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5581ab8b5c60 0x5581ab8c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd093db4b80 1 -- 172.21.15.17:0/240811022 >> 172.21.15.17:0/240811022 conn(0x5581ab8abe20 msgr2=0x5581ab8b7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:17.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd061ffb700 0 client.16203 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:17.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd093db4b80 1 -- 172.21.15.17:0/240811022 shutdown_connections 2023-07-14T13:02:17.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.778+0000 7fd093db4b80 1 -- 172.21.15.17:0/240811022 wait complete. 2023-07-14T13:02:17.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.779+0000 7fd093db4b80 20 client.16203 trim_cache size 0 max 16384 2023-07-14T13:02:17.822 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:02:17.823 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:02:17.823 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "f136f0b0-2663-4f9c-9325-cc6328e96e79", 2023-07-14T13:02:17.823 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:02:17.823 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:02:17.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.779+0000 7fd0803ff700 1 -- 172.21.15.17:0/2527660293 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0640a12c0 msgr2=0x7fd0640a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:17.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.779+0000 7fd0803ff700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0640a12c0 0x7fd0640a3770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd074005950 tx=0x7fd07400b500 comp rx=0 tx=0).stop 2023-07-14T13:02:17.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.779+0000 7fd0803ff700 1 -- 172.21.15.17:0/2527660293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078105ae0 msgr2=0x7fd078195a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:17.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.779+0000 7fd0803ff700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078105ae0 0x7fd078195a00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd070009fd0 tx=0x7fd07000bce0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.779+0000 7fd0803ff700 1 -- 172.21.15.17:0/2527660293 shutdown_connections 2023-07-14T13:02:17.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.779+0000 7fd0803ff700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0640a12c0 0x7fd0640a3770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.779+0000 7fd0803ff700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd078105ae0 0x7fd078195a00 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.779+0000 7fd0803ff700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0780ffad0 0x7fd07819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.779+0000 7fd0803ff700 1 --2- 172.21.15.17:0/2527660293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd078100480 0x7fd07819bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:17.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.779+0000 7fd0803ff700 1 -- 172.21.15.17:0/2527660293 >> 172.21.15.17:0/2527660293 conn(0x7fd0780fb5f0 msgr2=0x7fd0781035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:17.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.780+0000 7fd0803ff700 1 -- 172.21.15.17:0/2527660293 shutdown_connections 2023-07-14T13:02:17.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:17.780+0000 7fd0803ff700 1 -- 172.21.15.17:0/2527660293 wait complete. 2023-07-14T13:02:17.834 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:02:18.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.052+0000 7f53585ff700 1 -- 172.21.15.17:0/3507545738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5350105ae0 msgr2=0x7f5350105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.052+0000 7f53585ff700 1 --2- 172.21.15.17:0/3507545738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5350105ae0 0x7f5350105eb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f534c009990 tx=0x7f534c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.052+0000 7f53585ff700 1 -- 172.21.15.17:0/3507545738 shutdown_connections 2023-07-14T13:02:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.052+0000 7f53585ff700 1 --2- 172.21.15.17:0/3507545738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5350100480 0x7f535010c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.052+0000 7f53585ff700 1 --2- 172.21.15.17:0/3507545738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5350105ae0 0x7f5350105eb0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.053+0000 7f53585ff700 1 --2- 172.21.15.17:0/3507545738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53500ffad0 0x7f53500fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.053+0000 7f53585ff700 1 -- 172.21.15.17:0/3507545738 >> 172.21.15.17:0/3507545738 conn(0x7f53500fb5f0 msgr2=0x7f53500fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.053+0000 7f53585ff700 1 -- 172.21.15.17:0/3507545738 shutdown_connections 2023-07-14T13:02:18.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.053+0000 7f53585ff700 1 -- 172.21.15.17:0/3507545738 wait complete. 2023-07-14T13:02:18.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.054+0000 7f53585ff700 1 Processor -- start 2023-07-14T13:02:18.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.054+0000 7f53585ff700 1 -- start start 2023-07-14T13:02:18.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f53585ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53500ffad0 0x7f535019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f53585ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5350100480 0x7f535019e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f53585ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5350105ae0 0x7f5350197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f53585ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53501982f0 con 0x7f5350100480 2023-07-14T13:02:18.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f53585ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350198460 con 0x7f53500ffad0 2023-07-14T13:02:18.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f53585ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5350198620 con 0x7f5350105ae0 2023-07-14T13:02:18.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f5355b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5350100480 0x7f535019e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f535639b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53500ffad0 0x7f535019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f5355b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5350100480 0x7f535019e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54026/0 (socket says 172.21.15.17:54026) 2023-07-14T13:02:18.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f535639b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53500ffad0 0x7f535019db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40332/0 (socket says 172.21.15.17:40332) 2023-07-14T13:02:18.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f5355b9a700 1 -- 172.21.15.17:0/2547062391 learned_addr learned my addr 172.21.15.17:0/2547062391 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:18.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.055+0000 7f5356b9c700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5350105ae0 0x7f5350197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.056+0000 7f5355b9a700 1 -- 172.21.15.17:0/2547062391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5350105ae0 msgr2=0x7f5350197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:18.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.056+0000 7f5355b9a700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5350105ae0 0x7f5350197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.056+0000 7f5355b9a700 1 -- 172.21.15.17:0/2547062391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53500ffad0 msgr2=0x7f535019db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:18.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.056+0000 7f5355b9a700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53500ffad0 0x7f535019db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.056+0000 7f5355b9a700 1 -- 172.21.15.17:0/2547062391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5340009520 con 0x7f5350100480 2023-07-14T13:02:18.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.056+0000 7f5356b9c700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5350105ae0 0x7f5350197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:18.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.056+0000 7f5355b9a700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5350100480 0x7f535019e080 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f534000eb30 tx=0x7f534000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:18.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.057+0000 7f53477fe700 1 -- 172.21.15.17:0/2547062391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340009880 con 0x7f5350100480 2023-07-14T13:02:18.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.057+0000 7f53585ff700 1 -- 172.21.15.17:0/2547062391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c0095f0 con 0x7f5350100480 2023-07-14T13:02:18.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.057+0000 7f53477fe700 1 -- 172.21.15.17:0/2547062391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53400044b0 con 0x7f5350100480 2023-07-14T13:02:18.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.057+0000 7f53477fe700 1 -- 172.21.15.17:0/2547062391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340003ce0 con 0x7f5350100480 2023-07-14T13:02:18.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.057+0000 7f53585ff700 1 -- 172.21.15.17:0/2547062391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53501a4ac0 con 0x7f5350100480 2023-07-14T13:02:18.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.062+0000 7f53477fe700 1 -- 172.21.15.17:0/2547062391 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5340003e40 con 0x7f5350100480 2023-07-14T13:02:18.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.062+0000 7f536bfa8b80 1 Processor -- start 2023-07-14T13:02:18.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.063+0000 7f536bfa8b80 1 -- start start 2023-07-14T13:02:18.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.063+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbe2d0 0x5616bdbbe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.063+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbebe0 0x5616bdbc9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.063+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 0x5616bdbcbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.063+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bdac4cb0 con 0x5616bdbc9ad0 2023-07-14T13:02:18.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.063+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bdb17a40 con 0x5616bdbbe2d0 2023-07-14T13:02:18.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.063+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bdb10ed0 con 0x5616bdbbebe0 2023-07-14T13:02:18.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.063+0000 7f5355b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 0x5616bdbcbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.063+0000 7f535639b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbebe0 0x5616bdbc9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.063+0000 7f5355b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 0x5616bdbcbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54036/0 (socket says 172.21.15.17:54036) 2023-07-14T13:02:18.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.063+0000 7f5355b9a700 1 -- 172.21.15.17:0/1004325185 learned_addr learned my addr 172.21.15.17:0/1004325185 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:18.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.064+0000 7f5356b9c700 1 --2- 172.21.15.17:0/1004325185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbe2d0 0x5616bdbbe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.064+0000 7f535639b700 1 -- 172.21.15.17:0/1004325185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbe2d0 msgr2=0x5616bdbbe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:18.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.064+0000 7f535639b700 1 --2- 172.21.15.17:0/1004325185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbe2d0 0x5616bdbbe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.064+0000 7f535639b700 1 -- 172.21.15.17:0/1004325185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 msgr2=0x5616bdbcbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:18.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.064+0000 7f535639b700 1 --2- 172.21.15.17:0/1004325185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 0x5616bdbcbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.064+0000 7f535639b700 1 -- 172.21.15.17:0/1004325185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616bd93ede0 con 0x5616bdbbebe0 2023-07-14T13:02:18.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.064+0000 7f53477fe700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f533c0a12c0 0x7f533c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.064+0000 7f535639b700 1 --2- 172.21.15.17:0/1004325185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbebe0 0x5616bdbc9590 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f534c005910 tx=0x7f534c005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=310d73bc901d9f9a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:18.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.064+0000 7f53477fe700 1 -- 172.21.15.17:0/2547062391 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5340014070 con 0x7f5350100480 2023-07-14T13:02:18.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.065+0000 7f5356b9c700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f533c0a12c0 0x7f533c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.065+0000 7f5344bfe700 1 -- 172.21.15.17:0/1004325185 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c01d070 con 0x5616bdbbebe0 2023-07-14T13:02:18.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.065+0000 7f5344bfe700 1 -- 172.21.15.17:0/1004325185 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f534c01e040 con 0x5616bdbbebe0 2023-07-14T13:02:18.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.065+0000 7f5344bfe700 1 -- 172.21.15.17:0/1004325185 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c004760 con 0x5616bdbbebe0 2023-07-14T13:02:18.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.065+0000 7f536bfa8b80 1 -- 172.21.15.17:0/1004325185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbebe0 msgr2=0x5616bdbc9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:18.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.065+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/1004325185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbebe0 0x5616bdbc9590 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f534c005910 tx=0x7f534c005f00 comp rx=0 tx=0).stop 2023-07-14T13:02:18.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.065+0000 7f5356b9c700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f533c0a12c0 0x7f533c0a3770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f535019e7d0 tx=0x7f534800b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:18.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.066+0000 7f536bfa8b80 1 -- 172.21.15.17:0/1004325185 shutdown_connections 2023-07-14T13:02:18.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.066+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/1004325185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 0x5616bdbcbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.066+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/1004325185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbe2d0 0x5616bdbbe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.066+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/1004325185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbebe0 0x5616bdbc9590 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.066+0000 7f536bfa8b80 1 -- 172.21.15.17:0/1004325185 >> 172.21.15.17:0/1004325185 conn(0x5616bdbb4da0 msgr2=0x5616bdbba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:18.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.066+0000 7f536bfa8b80 1 -- 172.21.15.17:0/1004325185 shutdown_connections 2023-07-14T13:02:18.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.066+0000 7f536bfa8b80 1 -- 172.21.15.17:0/1004325185 wait complete. 2023-07-14T13:02:18.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.066+0000 7f536bfa8b80 1 -- start start 2023-07-14T13:02:18.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.067+0000 7f536bfa8b80 1 Processor -- start 2023-07-14T13:02:18.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.067+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbe2d0 0x5616bdbc9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.067+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbebe0 0x5616bdbc6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.067+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 0x5616bdbc6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.067+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bdab0ac0 con 0x5616bdbc9ad0 2023-07-14T13:02:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.067+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bdab07c0 con 0x5616bdbbe2d0 2023-07-14T13:02:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.067+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bd994920 con 0x5616bdbbebe0 2023-07-14T13:02:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.067+0000 7f536bfa8b80 10 client.0 _ll_register_callbacks cb 0x5616bdaae760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.068+0000 7f5356b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 0x5616bdbc6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.068+0000 7f535639b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbe2d0 0x5616bdbc9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.068+0000 7f5356b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 0x5616bdbc6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54042/0 (socket says 172.21.15.17:54042) 2023-07-14T13:02:18.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.068+0000 7f5356b9c700 1 -- 172.21.15.17:0/3150099570 learned_addr learned my addr 172.21.15.17:0/3150099570 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:18.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.068+0000 7f5355b9a700 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbebe0 0x5616bdbc6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.068+0000 7f5356b9c700 1 -- 172.21.15.17:0/3150099570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbebe0 msgr2=0x5616bdbc6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:18.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.068+0000 7f5356b9c700 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbebe0 0x5616bdbc6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.068+0000 7f5356b9c700 1 -- 172.21.15.17:0/3150099570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbe2d0 msgr2=0x5616bdbc9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:18.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.068+0000 7f5356b9c700 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbe2d0 0x5616bdbc9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.068+0000 7f5356b9c700 1 -- 172.21.15.17:0/3150099570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535010d210 con 0x5616bdbc9ad0 2023-07-14T13:02:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.068+0000 7f5356b9c700 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 0x5616bdbc6cf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5348008ac0 tx=0x7f5348004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531452daea47601f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.069+0000 7f5339ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.069+0000 7f5339ffb700 1 -- 172.21.15.17:0/3150099570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800e900 con 0x5616bdbc9ad0 2023-07-14T13:02:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.069+0000 7f536bfa8b80 1 -- 172.21.15.17:0/3150099570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616bda6a4f0 con 0x5616bdbc9ad0 2023-07-14T13:02:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.069+0000 7f5339ffb700 1 -- 172.21.15.17:0/3150099570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5348003c60 con 0x5616bdbc9ad0 2023-07-14T13:02:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.069+0000 7f5339ffb700 1 -- 172.21.15.17:0/3150099570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f534800ea60 con 0x5616bdbc9ad0 2023-07-14T13:02:18.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.069+0000 7f536bfa8b80 10 client.16215 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:18.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.069+0000 7f536bfa8b80 1 -- 172.21.15.17:0/3150099570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5616bd927c60 con 0x5616bdbc9ad0 2023-07-14T13:02:18.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.069+0000 7f5339ffb700 1 -- 172.21.15.17:0/3150099570 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5616bda6a4f0 con 0x5616bdbc9ad0 2023-07-14T13:02:18.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.070+0000 7f5339ffb700 1 -- 172.21.15.17:0/3150099570 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f5348023c90 con 0x5616bdbc9ad0 2023-07-14T13:02:18.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.070+0000 7f536bfa8b80 10 client.16215 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:18.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.070+0000 7f536bfa8b80 10 client.16215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:18.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.070+0000 7f536bfa8b80 20 client.16215 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:18.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.070+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5616bdbd9330 0x5616bdbdb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.070+0000 7f536bfa8b80 4 client.16215 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:18.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.070+0000 7f536bfa8b80 1 -- 172.21.15.17:0/3150099570 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616bdb09eb0 con 0x5616bdbd9330 2023-07-14T13:02:18.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.070+0000 7f535639b700 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5616bdbd9330 0x5616bdbdb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.071+0000 7f535639b700 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5616bdbd9330 0x5616bdbdb740 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82405cd2161c9bda server_cookie=64bcf9a2525fbe67 in_seq=0 out_seq=0 2023-07-14T13:02:18.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.071+0000 7f5339ffb700 10 client.16215 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:18.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f5339ffb700 1 -- 172.21.15.17:0/3150099570 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5616bdb09eb0 con 0x5616bdbd9330 2023-07-14T13:02:18.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f5339ffb700 10 client.16215 handle_command_reply: tid=0 2023-07-14T13:02:18.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f536bfa8b80 1 client.16215 shutdown 2023-07-14T13:02:18.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f536bfa8b80 1 -- 172.21.15.17:0/3150099570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 msgr2=0x5616bdbc6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:18.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 0x5616bdbc6cf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5348008ac0 tx=0x7f5348004b40 comp rx=0 tx=0).stop 2023-07-14T13:02:18.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f536bfa8b80 1 -- 172.21.15.17:0/3150099570 shutdown_connections 2023-07-14T13:02:18.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5616bdbd9330 0x5616bdbdb740 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbc9ad0 0x5616bdbc6cf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbe2d0 0x5616bdbc9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/3150099570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbebe0 0x5616bdbc6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f536bfa8b80 1 -- 172.21.15.17:0/3150099570 >> 172.21.15.17:0/3150099570 conn(0x5616bdbb4da0 msgr2=0x5616bdbba290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.072+0000 7f5339ffb700 0 client.16215 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.073+0000 7f536bfa8b80 1 -- 172.21.15.17:0/3150099570 shutdown_connections 2023-07-14T13:02:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.073+0000 7f536bfa8b80 1 -- 172.21.15.17:0/3150099570 wait complete. 2023-07-14T13:02:18.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.073+0000 7f536bfa8b80 20 client.16215 trim_cache size 0 max 16384 2023-07-14T13:02:18.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.091+0000 7f536bfa8b80 1 Processor -- start 2023-07-14T13:02:18.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.092+0000 7f536bfa8b80 1 -- start start 2023-07-14T13:02:18.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.092+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbe2d0 0x5616bdbc8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.092+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbebe0 0x5616bdbc1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.092+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbc9ad0 0x5616bdbc1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.092+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bdbbf580 con 0x5616bdbbebe0 2023-07-14T13:02:18.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.092+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bdbd5d00 con 0x5616bdbc9ad0 2023-07-14T13:02:18.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.092+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bdbb4970 con 0x5616bdbbe2d0 2023-07-14T13:02:18.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.092+0000 7f5355b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbebe0 0x5616bdbc1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.092+0000 7f5355b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbebe0 0x5616bdbc1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54048/0 (socket says 172.21.15.17:54048) 2023-07-14T13:02:18.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.092+0000 7f5355b9a700 1 -- 172.21.15.17:0/5698761 learned_addr learned my addr 172.21.15.17:0/5698761 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:18.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.092+0000 7f5356b9c700 1 --2- 172.21.15.17:0/5698761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbc9ad0 0x5616bdbc1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.093+0000 7f535639b700 1 --2- 172.21.15.17:0/5698761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbe2d0 0x5616bdbc8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.093+0000 7f5355b9a700 1 -- 172.21.15.17:0/5698761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbe2d0 msgr2=0x5616bdbc8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:18.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.093+0000 7f5355b9a700 1 --2- 172.21.15.17:0/5698761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbe2d0 0x5616bdbc8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.093+0000 7f5355b9a700 1 -- 172.21.15.17:0/5698761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbc9ad0 msgr2=0x5616bdbc1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.093+0000 7f5355b9a700 1 --2- 172.21.15.17:0/5698761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbc9ad0 0x5616bdbc1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.093+0000 7f5355b9a700 1 -- 172.21.15.17:0/5698761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616bd965250 con 0x5616bdbbebe0 2023-07-14T13:02:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.093+0000 7f5356b9c700 1 --2- 172.21.15.17:0/5698761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbc9ad0 0x5616bdbc1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.093+0000 7f5355b9a700 1 --2- 172.21.15.17:0/5698761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbebe0 0x5616bdbc1a30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f534009a240 tx=0x7f53400d0a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8370496f740b9b19 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.093+0000 7f53453ff700 1 -- 172.21.15.17:0/5698761 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53400cd030 con 0x5616bdbbebe0 2023-07-14T13:02:18.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.093+0000 7f53453ff700 1 -- 172.21.15.17:0/5698761 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5340099df0 con 0x5616bdbbebe0 2023-07-14T13:02:18.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.093+0000 7f53453ff700 1 -- 172.21.15.17:0/5698761 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340004330 con 0x5616bdbbebe0 2023-07-14T13:02:18.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.094+0000 7f536bfa8b80 1 -- 172.21.15.17:0/5698761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbebe0 msgr2=0x5616bdbc1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:18.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.094+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/5698761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbebe0 0x5616bdbc1a30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f534009a240 tx=0x7f53400d0a80 comp rx=0 tx=0).stop 2023-07-14T13:02:18.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.094+0000 7f536bfa8b80 1 -- 172.21.15.17:0/5698761 shutdown_connections 2023-07-14T13:02:18.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.094+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/5698761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbc9ad0 0x5616bdbc1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.094+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/5698761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbbe2d0 0x5616bdbc8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.094+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/5698761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbebe0 0x5616bdbc1a30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.094+0000 7f536bfa8b80 1 -- 172.21.15.17:0/5698761 >> 172.21.15.17:0/5698761 conn(0x5616bdbb4da0 msgr2=0x5616bdbdb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:18.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.094+0000 7f536bfa8b80 1 -- 172.21.15.17:0/5698761 shutdown_connections 2023-07-14T13:02:18.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.094+0000 7f536bfa8b80 1 -- 172.21.15.17:0/5698761 wait complete. 2023-07-14T13:02:18.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.095+0000 7f536bfa8b80 1 -- start start 2023-07-14T13:02:18.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.095+0000 7f536bfa8b80 1 Processor -- start 2023-07-14T13:02:18.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.095+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbe2d0 0x5616bdbd0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.095+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbebe0 0x5616bdbce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f536bfa8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbc9ad0 0x5616bdbceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bdbcf150 con 0x5616bdbbe2d0 2023-07-14T13:02:18.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bdbcf290 con 0x5616bdbbebe0 2023-07-14T13:02:18.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f536bfa8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bdbcf450 con 0x5616bdbc9ad0 2023-07-14T13:02:18.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f536bfa8b80 10 client.0 _ll_register_callbacks cb 0x7f53480093d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:18.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f535639b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbe2d0 0x5616bdbd0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f535639b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbe2d0 0x5616bdbd0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54054/0 (socket says 172.21.15.17:54054) 2023-07-14T13:02:18.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f535639b700 1 -- 172.21.15.17:0/828740074 learned_addr learned my addr 172.21.15.17:0/828740074 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:18.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f5355b9a700 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbebe0 0x5616bdbce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f5356b9c700 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbc9ad0 0x5616bdbceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f535639b700 1 -- 172.21.15.17:0/828740074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbc9ad0 msgr2=0x5616bdbceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:18.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f535639b700 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbc9ad0 0x5616bdbceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f535639b700 1 -- 172.21.15.17:0/828740074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbebe0 msgr2=0x5616bdbce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:18.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f535639b700 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbebe0 0x5616bdbce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f535639b700 1 -- 172.21.15.17:0/828740074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616bd927c60 con 0x5616bdbbe2d0 2023-07-14T13:02:18.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f5356b9c700 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbc9ad0 0x5616bdbceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:02:18.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.096+0000 7f5355b9a700 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbebe0 0x5616bdbce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.097+0000 7f535639b700 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbe2d0 0x5616bdbd0380 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f534c009990 tx=0x7f534c0094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db876cff41efb207 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.097+0000 7f5339ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.097+0000 7f5339ffb700 1 -- 172.21.15.17:0/828740074 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c032040 con 0x5616bdbbe2d0 2023-07-14T13:02:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.097+0000 7f536bfa8b80 1 -- 172.21.15.17:0/828740074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f534c01e040 con 0x5616bdbbe2d0 2023-07-14T13:02:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.097+0000 7f5339ffb700 1 -- 172.21.15.17:0/828740074 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f534c0358d0 con 0x5616bdbbe2d0 2023-07-14T13:02:18.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.097+0000 7f5339ffb700 1 -- 172.21.15.17:0/828740074 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f534c01d040 con 0x5616bdbbe2d0 2023-07-14T13:02:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.097+0000 7f536bfa8b80 10 client.16221 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.097+0000 7f536bfa8b80 1 -- 172.21.15.17:0/828740074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f53501a4ac0 con 0x5616bdbbe2d0 2023-07-14T13:02:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.097+0000 7f5339ffb700 1 -- 172.21.15.17:0/828740074 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f534c044020 con 0x5616bdbbe2d0 2023-07-14T13:02:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.098+0000 7f5339ffb700 1 -- 172.21.15.17:0/828740074 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f534c035050 con 0x5616bdbbe2d0 2023-07-14T13:02:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.098+0000 7f536bfa8b80 10 client.16221 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.098+0000 7f536bfa8b80 10 client.16221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:18.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.098+0000 7f536bfa8b80 20 client.16221 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.098+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5616bdc2e340 0x5616bdc30750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.098+0000 7f536bfa8b80 4 client.16221 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:02:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.098+0000 7f536bfa8b80 1 -- 172.21.15.17:0/828740074 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5616bdacc050 con 0x5616bdc2e340 2023-07-14T13:02:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.098+0000 7f5355b9a700 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5616bdc2e340 0x5616bdc30750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.099+0000 7f5355b9a700 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5616bdc2e340 0x5616bdc30750 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7bee9cfced7cfcb server_cookie=cc9febdb7beee255 in_seq=0 out_seq=0 2023-07-14T13:02:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.099+0000 7f5339ffb700 10 client.16221 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:18.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.099+0000 7f5339ffb700 1 -- 172.21.15.17:0/828740074 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5616bdacc050 con 0x5616bdc2e340 2023-07-14T13:02:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.099+0000 7f5339ffb700 10 client.16221 handle_command_reply: tid=0 2023-07-14T13:02:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.099+0000 7f536bfa8b80 1 client.16221 shutdown 2023-07-14T13:02:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.099+0000 7f536bfa8b80 1 -- 172.21.15.17:0/828740074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbe2d0 msgr2=0x5616bdbd0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.099+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbe2d0 0x5616bdbd0380 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f534c009990 tx=0x7f534c0094b0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.099+0000 7f536bfa8b80 1 -- 172.21.15.17:0/828740074 shutdown_connections 2023-07-14T13:02:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.099+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5616bdc2e340 0x5616bdc30750 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.099+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616bdbc9ad0 0x5616bdbceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.100+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5616bdbbe2d0 0x5616bdbd0380 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.100+0000 7f536bfa8b80 1 --2- 172.21.15.17:0/828740074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5616bdbbebe0 0x5616bdbce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.100+0000 7f536bfa8b80 1 -- 172.21.15.17:0/828740074 >> 172.21.15.17:0/828740074 conn(0x5616bdbb4da0 msgr2=0x5616bdbc1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.100+0000 7f5339ffb700 0 client.16221 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.100+0000 7f536bfa8b80 1 -- 172.21.15.17:0/828740074 shutdown_connections 2023-07-14T13:02:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.100+0000 7f536bfa8b80 1 -- 172.21.15.17:0/828740074 wait complete. 2023-07-14T13:02:18.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.100+0000 7f536bfa8b80 20 client.16221 trim_cache size 0 max 16384 2023-07-14T13:02:18.141 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:02:18.141 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:02:18.141 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:02:18.141 INFO:teuthology.orchestra.run.smithi017.stdout: "f136f0b0-2663-4f9c-9325-cc6328e96e79": { 2023-07-14T13:02:18.141 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:02:18.142 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "f136f0b0-2663-4f9c-9325-cc6328e96e79", 2023-07-14T13:02:18.142 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:02:18.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:02:18.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:02:18.142 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:02:18.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 -- 172.21.15.17:0/2547062391 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f533c0a12c0 msgr2=0x7f533c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:18.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f533c0a12c0 0x7f533c0a3770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f535019e7d0 tx=0x7f534800b040 comp rx=0 tx=0).stop 2023-07-14T13:02:18.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 -- 172.21.15.17:0/2547062391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5350100480 msgr2=0x7f535019e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:18.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5350100480 0x7f535019e080 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f534000eb30 tx=0x7f534000ee40 comp rx=0 tx=0).stop 2023-07-14T13:02:18.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 -- 172.21.15.17:0/2547062391 shutdown_connections 2023-07-14T13:02:18.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f533c0a12c0 0x7f533c0a3770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5350105ae0 0x7f5350197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53500ffad0 0x7f535019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 --2- 172.21.15.17:0/2547062391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5350100480 0x7f535019e080 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:18.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 -- 172.21.15.17:0/2547062391 >> 172.21.15.17:0/2547062391 conn(0x7f53500fb5f0 msgr2=0x7f535010adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:18.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 -- 172.21.15.17:0/2547062391 shutdown_connections 2023-07-14T13:02:18.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:18.101+0000 7f53585ff700 1 -- 172.21.15.17:0/2547062391 wait complete. 2023-07-14T13:02:18.152 INFO:tasks.cephfs.filesystem:scrub status for tag:f136f0b0-2663-4f9c-9325-cc6328e96e79 - {'path': '/', 'tag': 'f136f0b0-2663-4f9c-9325-cc6328e96e79', 'options': 'recursive,force'} 2023-07-14T13:02:18.248 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:18 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:02:18.249 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:18 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:18.249 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:18 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:02:18.249 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:18 smithi131 ceph-mon[96953]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-14T13:02:18.249 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:18 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:18.250 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 13:02:17 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-b[122274]: 2023-07-14T13:02:17.803+0000 7f0425da4700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...4,head] /volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical/ auth{1=1,2=1} v1726 ap=2 f(v2 m2023-07-14T13:01:47.247614+0000 3=1+2) n(v2 rc2023-07-14T13:01:47.247614+0000 b8 4=1+3) old_inodes=2 (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/-@55} | dirtyscattered=0 request=0 lock=3 importing=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x564c11ab0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v478>,<0x10000000005/data v101>,<0x10000000003/postgres v23>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v37>,<0x10000000001/sv_0 v55>,<0x10000000000/_nogroup v41>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v1726>,<0x10000000005/data v709>,<0x10000000003/postgres v208>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v222>,<0x10000000001/sv_0 v240>,<0x10000000000/_nogroup v220>,<0x1/volumes v214>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-07-14T13:01:47.232781+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2023-07-14T13:01:47.247614+0000 b8 4=1+3)","memory_value.dirstat":"f(v2 m2023-07-14T13:01:47.247614+0000 3=1+2)","memory_value.rstat":"n(v2 rc2023-07-14T13:01:47.247614+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-07-14T13:02:18.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:18 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:02:18.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:18 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:18.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:18 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:02:18.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:18 smithi017 ceph-mon[95536]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-14T13:02:18.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:18 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:18.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:18 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:02:18.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:18 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:18.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:18 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:02:18.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:18 smithi135 ceph-mon[97338]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-14T13:02:18.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:18 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:18.788 INFO:teuthology.orchestra.run.smithi017.stderr:7700000 of 50000000 tuples (15%) done (elapsed 128.39 s, remaining 705.32 s) 2023-07-14T13:02:19.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:19 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:02:19.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:19 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:02:19.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:19 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:19.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:19 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:19.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:19 smithi017 ceph-mon[95536]: pgmap v80: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 29 op/s 2023-07-14T13:02:19.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:19 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:02:19.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:19 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:02:19.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:19 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:19.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:19 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:19.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:19 smithi135 ceph-mon[97338]: pgmap v80: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 29 op/s 2023-07-14T13:02:19.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:19 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:02:19.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:19 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:02:19.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:19 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:19.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:19 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:19.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:19 smithi131 ceph-mon[96953]: pgmap v80: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 23 MiB/s wr, 29 op/s 2023-07-14T13:02:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:7800000 of 50000000 tuples (15%) done (elapsed 130.14 s, remaining 704.12 s) 2023-07-14T13:02:21.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:21 smithi017 ceph-mon[95536]: pgmap v81: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 34 MiB/s wr, 126 op/s 2023-07-14T13:02:21.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:21 smithi135 ceph-mon[97338]: pgmap v81: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 34 MiB/s wr, 126 op/s 2023-07-14T13:02:21.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:21 smithi131 ceph-mon[96953]: pgmap v81: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 34 MiB/s wr, 126 op/s 2023-07-14T13:02:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:7900000 of 50000000 tuples (15%) done (elapsed 131.46 s, remaining 700.58 s) 2023-07-14T13:02:23.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:23 smithi017 ceph-mon[95536]: pgmap v82: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-07-14T13:02:23.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:23 smithi135 ceph-mon[97338]: pgmap v82: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-07-14T13:02:23.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:23 smithi131 ceph-mon[96953]: pgmap v82: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-07-14T13:02:23.734 INFO:teuthology.orchestra.run.smithi017.stderr:8000000 of 50000000 tuples (16%) done (elapsed 133.34 s, remaining 700.02 s) 2023-07-14T13:02:24.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:24 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:02:24.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:24 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:02:24.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:24 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:02:25.094 INFO:teuthology.orchestra.run.smithi017.stderr:8100000 of 50000000 tuples (16%) done (elapsed 134.70 s, remaining 696.77 s) 2023-07-14T13:02:25.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:25 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:02:25.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:25 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:02:25.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:25 smithi017 ceph-mon[95536]: pgmap v83: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-07-14T13:02:25.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:25 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:02:25.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:25 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:02:25.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:25 smithi135 ceph-mon[97338]: pgmap v83: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-07-14T13:02:25.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:25 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:02:25.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:25 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:02:25.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:25 smithi131 ceph-mon[96953]: pgmap v83: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-07-14T13:02:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.356+0000 7f58f4bff700 1 -- 172.21.15.17:0/470381733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f01004b0 msgr2=0x7f58f010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.356+0000 7f58f4bff700 1 --2- 172.21.15.17:0/470381733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f01004b0 0x7f58f010c940 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f58e800b0a0 tx=0x7f58e800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.356+0000 7f58f4bff700 1 -- 172.21.15.17:0/470381733 shutdown_connections 2023-07-14T13:02:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.356+0000 7f58f4bff700 1 --2- 172.21.15.17:0/470381733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f01004b0 0x7f58f010c940 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.356+0000 7f58f4bff700 1 --2- 172.21.15.17:0/470381733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58f0105b10 0x7f58f0105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.356+0000 7f58f4bff700 1 --2- 172.21.15.17:0/470381733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58f00ffb00 0x7f58f00fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.356+0000 7f58f4bff700 1 -- 172.21.15.17:0/470381733 >> 172.21.15.17:0/470381733 conn(0x7f58f00fb600 msgr2=0x7f58f00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:26.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.356+0000 7f58f4bff700 1 -- 172.21.15.17:0/470381733 shutdown_connections 2023-07-14T13:02:26.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.356+0000 7f58f4bff700 1 -- 172.21.15.17:0/470381733 wait complete. 2023-07-14T13:02:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.357+0000 7f58f4bff700 1 Processor -- start 2023-07-14T13:02:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.358+0000 7f58f4bff700 1 -- start start 2023-07-14T13:02:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.358+0000 7f58f4bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f00ffb00 0x7f58f00729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.358+0000 7f58f4bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58f01004b0 0x7f58f0072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.358+0000 7f58f4bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58f0105b10 0x7f58f01a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.358+0000 7f58f4bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f01a4370 con 0x7f58f00ffb00 2023-07-14T13:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.358+0000 7f58f4bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f01a44b0 con 0x7f58f01004b0 2023-07-14T13:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.358+0000 7f58f4bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f01a4620 con 0x7f58f0105b10 2023-07-14T13:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58ee59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f00ffb00 0x7f58f00729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58edd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58f01004b0 0x7f58f0072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58edd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58f01004b0 0x7f58f0072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:45858/0 (socket says 172.21.15.17:45858) 2023-07-14T13:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58eed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58f0105b10 0x7f58f01a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58ee59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f00ffb00 0x7f58f00729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44676/0 (socket says 172.21.15.17:44676) 2023-07-14T13:02:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58edd9b700 1 -- 172.21.15.17:0/349004261 learned_addr learned my addr 172.21.15.17:0/349004261 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58ee59c700 1 -- 172.21.15.17:0/349004261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58f0105b10 msgr2=0x7f58f01a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58ee59c700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58f0105b10 0x7f58f01a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58ee59c700 1 -- 172.21.15.17:0/349004261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58f01004b0 msgr2=0x7f58f0072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58ee59c700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58f01004b0 0x7f58f0072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58ee59c700 1 -- 172.21.15.17:0/349004261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8009d00 con 0x7f58f00ffb00 2023-07-14T13:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.359+0000 7f58ee59c700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f00ffb00 0x7f58f00729f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f58e000d950 tx=0x7f58e000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.360+0000 7f58df7fe700 1 -- 172.21.15.17:0/349004261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e000f890 con 0x7f58f00ffb00 2023-07-14T13:02:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.360+0000 7f58df7fe700 1 -- 172.21.15.17:0/349004261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58e000fe80 con 0x7f58f00ffb00 2023-07-14T13:02:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.360+0000 7f58df7fe700 1 -- 172.21.15.17:0/349004261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e000e3b0 con 0x7f58f00ffb00 2023-07-14T13:02:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.360+0000 7f58f4bff700 1 -- 172.21.15.17:0/349004261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f01a4900 con 0x7f58f00ffb00 2023-07-14T13:02:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.360+0000 7f58f4bff700 1 -- 172.21.15.17:0/349004261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f01a4dc0 con 0x7f58f00ffb00 2023-07-14T13:02:26.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.365+0000 7f58df7fe700 1 -- 172.21.15.17:0/349004261 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f58e000f9f0 con 0x7f58f00ffb00 2023-07-14T13:02:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.366+0000 7f590843fb80 1 Processor -- start 2023-07-14T13:02:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.366+0000 7f590843fb80 1 -- start start 2023-07-14T13:02:26.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.366+0000 7f590843fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdb596b0 0x5599cdd02d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.366+0000 7f590843fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 0x5599cdcfd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.366+0000 7f590843fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdcfd580 0x5599cdcfd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f590843fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdc02c50 con 0x5599cdd032d0 2023-07-14T13:02:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f590843fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdc559e0 con 0x5599cdb596b0 2023-07-14T13:02:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f590843fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdc4ee70 con 0x5599cdcfd580 2023-07-14T13:02:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58df7fe700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d80a12c0 0x7f58d80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58ee59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 0x5599cdcfd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58df7fe700 1 -- 172.21.15.17:0/349004261 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f58e00cc930 con 0x7f58f00ffb00 2023-07-14T13:02:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58ee59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 0x5599cdcfd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44682/0 (socket says 172.21.15.17:44682) 2023-07-14T13:02:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58ee59c700 1 -- 172.21.15.17:0/2892243287 learned_addr learned my addr 172.21.15.17:0/2892243287 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58eed9d700 1 --2- 172.21.15.17:0/2892243287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdb596b0 0x5599cdd02d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58eed9d700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d80a12c0 0x7f58d80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58edd9b700 1 --2- 172.21.15.17:0/2892243287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdcfd580 0x5599cdcfd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58ee59c700 1 -- 172.21.15.17:0/2892243287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdcfd580 msgr2=0x5599cdcfd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58ee59c700 1 --2- 172.21.15.17:0/2892243287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdcfd580 0x5599cdcfd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58ee59c700 1 -- 172.21.15.17:0/2892243287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdb596b0 msgr2=0x5599cdd02d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.367+0000 7f58ee59c700 1 --2- 172.21.15.17:0/2892243287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdb596b0 0x5599cdd02d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.368+0000 7f58ee59c700 1 -- 172.21.15.17:0/2892243287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599cda7cd80 con 0x5599cdd032d0 2023-07-14T13:02:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.368+0000 7f58ee59c700 1 --2- 172.21.15.17:0/2892243287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 0x5599cdcfd040 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f58e00964c0 tx=0x7f58e0064ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef93e327ee13a1d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.368+0000 7f58eed9d700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d80a12c0 0x7f58d80a3770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009610 tx=0x7f58e8006210 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.368+0000 7f58dcff9700 1 -- 172.21.15.17:0/2892243287 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e00106f0 con 0x5599cdd032d0 2023-07-14T13:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.368+0000 7f58dcff9700 1 -- 172.21.15.17:0/2892243287 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58e000fca0 con 0x5599cdd032d0 2023-07-14T13:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.368+0000 7f58dcff9700 1 -- 172.21.15.17:0/2892243287 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e00ca350 con 0x5599cdd032d0 2023-07-14T13:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.369+0000 7f590843fb80 1 -- 172.21.15.17:0/2892243287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 msgr2=0x5599cdcfd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.369+0000 7f590843fb80 1 --2- 172.21.15.17:0/2892243287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 0x5599cdcfd040 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f58e00964c0 tx=0x7f58e0064ea0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.369+0000 7f590843fb80 1 -- 172.21.15.17:0/2892243287 shutdown_connections 2023-07-14T13:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.369+0000 7f590843fb80 1 --2- 172.21.15.17:0/2892243287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdcfd580 0x5599cdcfd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.369+0000 7f590843fb80 1 --2- 172.21.15.17:0/2892243287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdb596b0 0x5599cdd02d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.369+0000 7f590843fb80 1 --2- 172.21.15.17:0/2892243287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 0x5599cdcfd040 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.369+0000 7f590843fb80 1 -- 172.21.15.17:0/2892243287 >> 172.21.15.17:0/2892243287 conn(0x5599cdcf2be0 msgr2=0x5599cdcf7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.369+0000 7f590843fb80 1 -- 172.21.15.17:0/2892243287 shutdown_connections 2023-07-14T13:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.369+0000 7f590843fb80 1 -- 172.21.15.17:0/2892243287 wait complete. 2023-07-14T13:02:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.370+0000 7f590843fb80 1 -- start start 2023-07-14T13:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.370+0000 7f590843fb80 1 Processor -- start 2023-07-14T13:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f590843fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 0x5599cdd14ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f590843fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdcfd580 0x5599cdd15400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f590843fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 0x5599cdd0f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f590843fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdbeea60 con 0x5599cdd032d0 2023-07-14T13:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f590843fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdbee760 con 0x5599cdcfd580 2023-07-14T13:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f590843fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdad28c0 con 0x5599cdb596b0 2023-07-14T13:02:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f590843fb80 10 client.0 _ll_register_callbacks cb 0x5599cdbec700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f58ee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 0x5599cdd14ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f58ee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 0x5599cdd14ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57838/0 (socket says 172.21.15.17:57838) 2023-07-14T13:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f58edd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdcfd580 0x5599cdd15400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f58ee59c700 1 -- 172.21.15.17:0/2542628665 learned_addr learned my addr 172.21.15.17:0/2542628665 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f58eed9d700 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 0x5599cdd0f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f58ee59c700 1 -- 172.21.15.17:0/2542628665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdcfd580 msgr2=0x5599cdd15400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f58ee59c700 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdcfd580 0x5599cdd15400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f58ee59c700 1 -- 172.21.15.17:0/2542628665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 msgr2=0x5599cdd0f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.371+0000 7f58ee59c700 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 0x5599cdd0f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.372+0000 7f58ee59c700 1 -- 172.21.15.17:0/2542628665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f01a4dc0 con 0x5599cdb596b0 2023-07-14T13:02:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.372+0000 7f58ee59c700 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 0x5599cdd14ec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f58e0099750 tx=0x7f58e00106f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46eb77b37e52c3bb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.372+0000 7f58d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:02:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.372+0000 7f58d5ffb700 1 -- 172.21.15.17:0/2542628665 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e00b2220 con 0x5599cdb596b0 2023-07-14T13:02:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.372+0000 7f58d5ffb700 1 -- 172.21.15.17:0/2542628665 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f58e009da80 con 0x5599cdb596b0 2023-07-14T13:02:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.372+0000 7f590843fb80 1 -- 172.21.15.17:0/2542628665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599cdba8490 con 0x5599cdb596b0 2023-07-14T13:02:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.372+0000 7f58d5ffb700 1 -- 172.21.15.17:0/2542628665 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58e00a1ea0 con 0x5599cdb596b0 2023-07-14T13:02:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.373+0000 7f590843fb80 10 client.25951 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.373+0000 7f590843fb80 1 -- 172.21.15.17:0/2542628665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5599cda65c00 con 0x5599cdb596b0 2023-07-14T13:02:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.373+0000 7f58d5ffb700 1 -- 172.21.15.17:0/2542628665 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5599cdba8490 con 0x5599cdb596b0 2023-07-14T13:02:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.373+0000 7f58d5ffb700 1 -- 172.21.15.17:0/2542628665 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f58e00ccd20 con 0x5599cdb596b0 2023-07-14T13:02:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.373+0000 7f590843fb80 10 client.25951 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.373+0000 7f590843fb80 10 client.25951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.373+0000 7f590843fb80 20 client.25951 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.373+0000 7f590843fb80 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5599cdd1f030 0x5599cdd21440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.373+0000 7f590843fb80 4 client.25951 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.373+0000 7f590843fb80 1 -- 172.21.15.17:0/2542628665 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599cdc47e50 con 0x5599cdd1f030 2023-07-14T13:02:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.374+0000 7f58edd9b700 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5599cdd1f030 0x5599cdd21440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.374+0000 7f58d5ffb700 10 client.25951 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.374+0000 7f58edd9b700 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5599cdd1f030 0x5599cdd21440 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34dcf44ed8e3c55c server_cookie=ce22d9246b33d5fc in_seq=0 out_seq=0 2023-07-14T13:02:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.375+0000 7f58d5ffb700 1 -- 172.21.15.17:0/2542628665 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5599cdc47e50 con 0x5599cdd1f030 2023-07-14T13:02:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.375+0000 7f58d5ffb700 10 client.25951 handle_command_reply: tid=0 2023-07-14T13:02:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.375+0000 7f590843fb80 1 client.25951 shutdown 2023-07-14T13:02:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.375+0000 7f590843fb80 1 -- 172.21.15.17:0/2542628665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 msgr2=0x5599cdd14ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.375+0000 7f590843fb80 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 0x5599cdd14ec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f58e0099750 tx=0x7f58e00106f0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.376+0000 7f590843fb80 1 -- 172.21.15.17:0/2542628665 shutdown_connections 2023-07-14T13:02:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.376+0000 7f590843fb80 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5599cdd1f030 0x5599cdd21440 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.376+0000 7f590843fb80 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdd032d0 0x5599cdd0f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.376+0000 7f590843fb80 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 0x5599cdd14ec0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.376+0000 7f590843fb80 1 --2- 172.21.15.17:0/2542628665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdcfd580 0x5599cdd15400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.376+0000 7f58d5ffb700 0 client.25951 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.376+0000 7f590843fb80 1 -- 172.21.15.17:0/2542628665 >> 172.21.15.17:0/2542628665 conn(0x5599cdcf2be0 msgr2=0x5599cdcf74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.376+0000 7f590843fb80 1 -- 172.21.15.17:0/2542628665 shutdown_connections 2023-07-14T13:02:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.376+0000 7f590843fb80 1 -- 172.21.15.17:0/2542628665 wait complete. 2023-07-14T13:02:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.376+0000 7f590843fb80 20 client.25951 trim_cache size 0 max 16384 2023-07-14T13:02:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.396+0000 7f590843fb80 1 Processor -- start 2023-07-14T13:02:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.396+0000 7f590843fb80 1 -- start start 2023-07-14T13:02:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.397+0000 7f590843fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 0x5599cdd02400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.397+0000 7f590843fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdcfd580 0x5599cdd05bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.397+0000 7f590843fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdd032d0 0x5599cdcff870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.397+0000 7f590843fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdcf9720 con 0x5599cdcfd580 2023-07-14T13:02:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.397+0000 7f590843fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdc47e50 con 0x5599cdd032d0 2023-07-14T13:02:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.397+0000 7f590843fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdd03810 con 0x5599cdb596b0 2023-07-14T13:02:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.397+0000 7f58edd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdcfd580 0x5599cdd05bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.397+0000 7f58edd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdcfd580 0x5599cdd05bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44692/0 (socket says 172.21.15.17:44692) 2023-07-14T13:02:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.397+0000 7f58edd9b700 1 -- 172.21.15.17:0/1277343957 learned_addr learned my addr 172.21.15.17:0/1277343957 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.397+0000 7f58eed9d700 1 --2- 172.21.15.17:0/1277343957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdd032d0 0x5599cdcff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.397+0000 7f58ee59c700 1 --2- 172.21.15.17:0/1277343957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 0x5599cdd02400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.398+0000 7f58edd9b700 1 -- 172.21.15.17:0/1277343957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 msgr2=0x5599cdd02400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.398+0000 7f58edd9b700 1 --2- 172.21.15.17:0/1277343957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 0x5599cdd02400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.398+0000 7f58edd9b700 1 -- 172.21.15.17:0/1277343957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdd032d0 msgr2=0x5599cdcff870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.398+0000 7f58edd9b700 1 --2- 172.21.15.17:0/1277343957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdd032d0 0x5599cdcff870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.398+0000 7f58edd9b700 1 -- 172.21.15.17:0/1277343957 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599cdd26030 con 0x5599cdcfd580 2023-07-14T13:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.398+0000 7f58edd9b700 1 --2- 172.21.15.17:0/1277343957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdcfd580 0x5599cdd05bf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f58f0074210 tx=0x7f58e400b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1e28a03b85b297 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.398+0000 7f58dd7fa700 1 -- 172.21.15.17:0/1277343957 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e4016030 con 0x5599cdcfd580 2023-07-14T13:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.398+0000 7f58dd7fa700 1 -- 172.21.15.17:0/1277343957 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58e4017040 con 0x5599cdcfd580 2023-07-14T13:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.398+0000 7f58dd7fa700 1 -- 172.21.15.17:0/1277343957 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e401d650 con 0x5599cdcfd580 2023-07-14T13:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.399+0000 7f590843fb80 1 -- 172.21.15.17:0/1277343957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdcfd580 msgr2=0x5599cdd05bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.399+0000 7f590843fb80 1 --2- 172.21.15.17:0/1277343957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdcfd580 0x5599cdd05bf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f58f0074210 tx=0x7f58e400b500 comp rx=0 tx=0).stop 2023-07-14T13:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.399+0000 7f590843fb80 1 -- 172.21.15.17:0/1277343957 shutdown_connections 2023-07-14T13:02:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.399+0000 7f590843fb80 1 --2- 172.21.15.17:0/1277343957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdd032d0 0x5599cdcff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.399+0000 7f590843fb80 1 --2- 172.21.15.17:0/1277343957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdb596b0 0x5599cdd02400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.399+0000 7f590843fb80 1 --2- 172.21.15.17:0/1277343957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdcfd580 0x5599cdd05bf0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.399+0000 7f590843fb80 1 -- 172.21.15.17:0/1277343957 >> 172.21.15.17:0/1277343957 conn(0x5599cdcf2be0 msgr2=0x5599cdcfd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.399+0000 7f590843fb80 1 -- 172.21.15.17:0/1277343957 shutdown_connections 2023-07-14T13:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.399+0000 7f590843fb80 1 -- 172.21.15.17:0/1277343957 wait complete. 2023-07-14T13:02:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.400+0000 7f590843fb80 1 -- start start 2023-07-14T13:02:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.400+0000 7f590843fb80 1 Processor -- start 2023-07-14T13:02:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f590843fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdb596b0 0x5599cdd14e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f590843fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdcfd580 0x5599cdd15360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f590843fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdd032d0 0x5599cdd13290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f590843fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdd13990 con 0x5599cdb596b0 2023-07-14T13:02:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f590843fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdd13b00 con 0x5599cdcfd580 2023-07-14T13:02:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f590843fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cdd13cc0 con 0x5599cdd032d0 2023-07-14T13:02:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f590843fb80 10 client.0 _ll_register_callbacks cb 0x5599cdbec700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f58ee59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdb596b0 0x5599cdd14e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f58ee59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdb596b0 0x5599cdd14e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44704/0 (socket says 172.21.15.17:44704) 2023-07-14T13:02:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f58edd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdcfd580 0x5599cdd15360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f58ee59c700 1 -- 172.21.15.17:0/1870898763 learned_addr learned my addr 172.21.15.17:0/1870898763 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.401+0000 7f58eed9d700 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdd032d0 0x5599cdd13290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f58ee59c700 1 -- 172.21.15.17:0/1870898763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdd032d0 msgr2=0x5599cdd13290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f58ee59c700 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdd032d0 0x5599cdd13290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f58ee59c700 1 -- 172.21.15.17:0/1870898763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdcfd580 msgr2=0x5599cdd15360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f58ee59c700 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdcfd580 0x5599cdd15360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f58ee59c700 1 -- 172.21.15.17:0/1870898763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e401fab0 con 0x5599cdb596b0 2023-07-14T13:02:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f58edd9b700 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdcfd580 0x5599cdd15360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f58ee59c700 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdb596b0 0x5599cdd14e20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f58e0005950 tx=0x7f58e0098000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9510189ed342df68 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f58d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f58d5ffb700 1 -- 172.21.15.17:0/1870898763 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0099590 con 0x5599cdb596b0 2023-07-14T13:02:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f58d5ffb700 1 -- 172.21.15.17:0/1870898763 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f58e009da80 con 0x5599cdb596b0 2023-07-14T13:02:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f590843fb80 1 -- 172.21.15.17:0/1870898763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58e000fca0 con 0x5599cdb596b0 2023-07-14T13:02:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f58d5ffb700 1 -- 172.21.15.17:0/1870898763 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58e00b2220 con 0x5599cdb596b0 2023-07-14T13:02:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f590843fb80 10 client.16239 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.402+0000 7f590843fb80 1 -- 172.21.15.17:0/1870898763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5599cdaa31f0 con 0x5599cdb596b0 2023-07-14T13:02:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.403+0000 7f58d5ffb700 1 -- 172.21.15.17:0/1870898763 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58e000fca0 con 0x5599cdb596b0 2023-07-14T13:02:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.403+0000 7f58d5ffb700 1 -- 172.21.15.17:0/1870898763 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f58e00a1a10 con 0x5599cdb596b0 2023-07-14T13:02:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.403+0000 7f590843fb80 10 client.16239 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.403+0000 7f590843fb80 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.403+0000 7f590843fb80 20 client.16239 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.403+0000 7f590843fb80 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5599cdd73c60 0x5599cdd76040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.403+0000 7f590843fb80 4 client.16239 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:02:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.403+0000 7f590843fb80 1 -- 172.21.15.17:0/1870898763 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5599cdc09ff0 con 0x5599cdd73c60 2023-07-14T13:02:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.404+0000 7f58edd9b700 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5599cdd73c60 0x5599cdd76040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.404+0000 7f58d5ffb700 10 client.16239 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.404+0000 7f58edd9b700 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5599cdd73c60 0x5599cdd76040 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11d55ac4d51f5fe4 server_cookie=cdde6535d0174745 in_seq=0 out_seq=0 2023-07-14T13:02:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f58d5ffb700 1 -- 172.21.15.17:0/1870898763 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5599cdc09ff0 con 0x5599cdd73c60 2023-07-14T13:02:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f58d5ffb700 10 client.16239 handle_command_reply: tid=0 2023-07-14T13:02:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 1 client.16239 shutdown 2023-07-14T13:02:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 1 -- 172.21.15.17:0/1870898763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdb596b0 msgr2=0x5599cdd14e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdb596b0 0x5599cdd14e20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f58e0005950 tx=0x7f58e0098000 comp rx=0 tx=0).stop 2023-07-14T13:02:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 1 -- 172.21.15.17:0/1870898763 shutdown_connections 2023-07-14T13:02:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5599cdd73c60 0x5599cdd76040 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599cdd032d0 0x5599cdd13290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5599cdb596b0 0x5599cdd14e20 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f58d5ffb700 0 client.16239 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 1 --2- 172.21.15.17:0/1870898763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599cdcfd580 0x5599cdd15360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 1 -- 172.21.15.17:0/1870898763 >> 172.21.15.17:0/1870898763 conn(0x5599cdcf2be0 msgr2=0x5599cdd03a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 1 -- 172.21.15.17:0/1870898763 shutdown_connections 2023-07-14T13:02:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 1 -- 172.21.15.17:0/1870898763 wait complete. 2023-07-14T13:02:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.418+0000 7f590843fb80 20 client.16239 trim_cache size 0 max 16384 2023-07-14T13:02:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:02:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:02:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:02:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:02:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.419+0000 7f58f4bff700 1 -- 172.21.15.17:0/349004261 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d80a12c0 msgr2=0x7f58d80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.419+0000 7f58f4bff700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d80a12c0 0x7f58d80a3770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009610 tx=0x7f58e8006210 comp rx=0 tx=0).stop 2023-07-14T13:02:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.419+0000 7f58f4bff700 1 -- 172.21.15.17:0/349004261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f00ffb00 msgr2=0x7f58f00729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.419+0000 7f58f4bff700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f00ffb00 0x7f58f00729f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f58e000d950 tx=0x7f58e000dc60 comp rx=0 tx=0).stop 2023-07-14T13:02:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.419+0000 7f58f4bff700 1 -- 172.21.15.17:0/349004261 shutdown_connections 2023-07-14T13:02:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.419+0000 7f58f4bff700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d80a12c0 0x7f58d80a3770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.419+0000 7f58f4bff700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58f0105b10 0x7f58f01a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.419+0000 7f58f4bff700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58f00ffb00 0x7f58f00729f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.419+0000 7f58f4bff700 1 --2- 172.21.15.17:0/349004261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58f01004b0 0x7f58f0072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.419+0000 7f58f4bff700 1 -- 172.21.15.17:0/349004261 >> 172.21.15.17:0/349004261 conn(0x7f58f00fb600 msgr2=0x7f58f00fbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.419+0000 7f58f4bff700 1 -- 172.21.15.17:0/349004261 shutdown_connections 2023-07-14T13:02:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:26.420+0000 7f58f4bff700 1 -- 172.21.15.17:0/349004261 wait complete. 2023-07-14T13:02:26.991 INFO:teuthology.orchestra.run.smithi017.stderr:8200000 of 50000000 tuples (16%) done (elapsed 136.60 s, remaining 696.30 s) 2023-07-14T13:02:27.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:27 smithi135 ceph-mon[97338]: pgmap v84: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 34 MiB/s wr, 127 op/s 2023-07-14T13:02:27.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:27 smithi131 ceph-mon[96953]: pgmap v84: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 34 MiB/s wr, 127 op/s 2023-07-14T13:02:27.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:27 smithi017 ceph-mon[95536]: pgmap v84: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 34 MiB/s wr, 127 op/s 2023-07-14T13:02:28.781 INFO:teuthology.orchestra.run.smithi017.stderr:8300000 of 50000000 tuples (16%) done (elapsed 138.38 s, remaining 695.26 s) 2023-07-14T13:02:29.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:29 smithi135 ceph-mon[97338]: pgmap v85: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 23 MiB/s wr, 107 op/s 2023-07-14T13:02:29.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:29 smithi131 ceph-mon[96953]: pgmap v85: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 23 MiB/s wr, 107 op/s 2023-07-14T13:02:29.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:29 smithi017 ceph-mon[95536]: pgmap v85: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 23 MiB/s wr, 107 op/s 2023-07-14T13:02:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:8400000 of 50000000 tuples (16%) done (elapsed 139.71 s, remaining 691.89 s) 2023-07-14T13:02:31.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:31 smithi135 ceph-mon[97338]: pgmap v86: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 34 MiB/s wr, 121 op/s 2023-07-14T13:02:31.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:31 smithi131 ceph-mon[96953]: pgmap v86: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 34 MiB/s wr, 121 op/s 2023-07-14T13:02:31.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:31 smithi017 ceph-mon[95536]: pgmap v86: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 34 MiB/s wr, 121 op/s 2023-07-14T13:02:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:8500000 of 50000000 tuples (17%) done (elapsed 141.60 s, remaining 691.32 s) 2023-07-14T13:02:33.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:33 smithi135 ceph-mon[97338]: pgmap v87: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:02:33.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:33 smithi131 ceph-mon[96953]: pgmap v87: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:02:33.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:33 smithi017 ceph-mon[95536]: pgmap v87: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:02:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:8600000 of 50000000 tuples (17%) done (elapsed 143.46 s, remaining 690.63 s) 2023-07-14T13:02:35.214 INFO:teuthology.orchestra.run.smithi017.stderr:8700000 of 50000000 tuples (17%) done (elapsed 144.82 s, remaining 687.47 s) 2023-07-14T13:02:35.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:35 smithi135 ceph-mon[97338]: pgmap v88: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:02:35.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:35 smithi131 ceph-mon[96953]: pgmap v88: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:02:35.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:35 smithi017 ceph-mon[95536]: pgmap v88: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:02:37.381 INFO:teuthology.orchestra.run.smithi017.stderr:8800000 of 50000000 tuples (17%) done (elapsed 146.98 s, remaining 688.16 s) 2023-07-14T13:02:37.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:37 smithi135 ceph-mon[97338]: pgmap v89: 97 pgs: 97 active+clean; 2.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 35 MiB/s wr, 35 op/s 2023-07-14T13:02:37.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:37 smithi131 ceph-mon[96953]: pgmap v89: 97 pgs: 97 active+clean; 2.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 35 MiB/s wr, 35 op/s 2023-07-14T13:02:37.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:37 smithi017 ceph-mon[95536]: pgmap v89: 97 pgs: 97 active+clean; 2.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 35 MiB/s wr, 35 op/s 2023-07-14T13:02:39.269 INFO:teuthology.orchestra.run.smithi017.stderr:8900000 of 50000000 tuples (17%) done (elapsed 148.87 s, remaining 687.49 s) 2023-07-14T13:02:39.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:39 smithi135 ceph-mon[97338]: pgmap v90: 97 pgs: 97 active+clean; 2.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:02:39.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:39 smithi131 ceph-mon[96953]: pgmap v90: 97 pgs: 97 active+clean; 2.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:02:39.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:39 smithi017 ceph-mon[95536]: pgmap v90: 97 pgs: 97 active+clean; 2.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 23 MiB/s wr, 24 op/s 2023-07-14T13:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.597+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/1432556148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb80731c0 msgr2=0x7fcfb81105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.597+0000 7fcfbe5ff700 1 --2- 172.21.15.17:0/1432556148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb80731c0 0x7fcfb81105d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009990 tx=0x7fcfac009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.597+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/1432556148 shutdown_connections 2023-07-14T13:02:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.597+0000 7fcfbe5ff700 1 --2- 172.21.15.17:0/1432556148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfb8110b10 0x7fcfb8112ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.597+0000 7fcfbe5ff700 1 --2- 172.21.15.17:0/1432556148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb80728b0 0x7fcfb8072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.597+0000 7fcfbe5ff700 1 --2- 172.21.15.17:0/1432556148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb80731c0 0x7fcfb81105d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.597+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/1432556148 >> 172.21.15.17:0/1432556148 conn(0x7fcfb80fb600 msgr2=0x7fcfb80fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.597+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/1432556148 shutdown_connections 2023-07-14T13:02:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.597+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/1432556148 wait complete. 2023-07-14T13:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.598+0000 7fcfbe5ff700 1 Processor -- start 2023-07-14T13:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.599+0000 7fcfbe5ff700 1 -- start start 2023-07-14T13:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.599+0000 7fcfbe5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfb80728b0 0x7fcfb819c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.599+0000 7fcfbe5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb80731c0 0x7fcfb819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.599+0000 7fcfbe5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb8110b10 0x7fcfb81a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.599+0000 7fcfbe5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb81a1390 con 0x7fcfb80731c0 2023-07-14T13:02:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.599+0000 7fcfbe5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb81a1500 con 0x7fcfb80728b0 2023-07-14T13:02:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.599+0000 7fcfbe5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb81a16c0 con 0x7fcfb8110b10 2023-07-14T13:02:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.599+0000 7fcfb77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb80731c0 0x7fcfb819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.600+0000 7fcfb77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb80731c0 0x7fcfb819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46840/0 (socket says 172.21.15.17:46840) 2023-07-14T13:02:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.600+0000 7fcfb77fe700 1 -- 172.21.15.17:0/560074616 learned_addr learned my addr 172.21.15.17:0/560074616 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.600+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfb80728b0 0x7fcfb819c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.600+0000 7fcfbcb9c700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb8110b10 0x7fcfb81a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.600+0000 7fcfb77fe700 1 -- 172.21.15.17:0/560074616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb8110b10 msgr2=0x7fcfb81a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.600+0000 7fcfb77fe700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb8110b10 0x7fcfb81a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.600+0000 7fcfb77fe700 1 -- 172.21.15.17:0/560074616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfb80728b0 msgr2=0x7fcfb819c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.600+0000 7fcfb77fe700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfb80728b0 0x7fcfb819c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.600+0000 7fcfb77fe700 1 -- 172.21.15.17:0/560074616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac0095f0 con 0x7fcfb80731c0 2023-07-14T13:02:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.600+0000 7fcfb77fe700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb80731c0 0x7fcfb819c6e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005910 tx=0x7fcfac009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.601+0000 7fcfb57fa700 1 -- 172.21.15.17:0/560074616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac01d070 con 0x7fcfb80731c0 2023-07-14T13:02:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.601+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/560074616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb81a1940 con 0x7fcfb80731c0 2023-07-14T13:02:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.601+0000 7fcfb57fa700 1 -- 172.21.15.17:0/560074616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfac003ec0 con 0x7fcfb80731c0 2023-07-14T13:02:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.601+0000 7fcfb57fa700 1 -- 172.21.15.17:0/560074616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00fb50 con 0x7fcfb80731c0 2023-07-14T13:02:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.601+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/560074616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb81a91e0 con 0x7fcfb80731c0 2023-07-14T13:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.604+0000 7fcfb57fa700 1 -- 172.21.15.17:0/560074616 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcfac00fd50 con 0x7fcfb80731c0 2023-07-14T13:02:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.606+0000 7fcfd1ee2b80 1 Processor -- start 2023-07-14T13:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.606+0000 7fcfd1ee2b80 1 -- start start 2023-07-14T13:02:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.606+0000 7fcfb57fa700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcfa00a12c0 0x7fcfa00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.606+0000 7fcfb57fa700 1 -- 172.21.15.17:0/560074616 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcfac0cdcf0 con 0x7fcfb80731c0 2023-07-14T13:02:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.606+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755fe5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.606+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755fe62d0 0x560755fe0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.606+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755ee5c50 con 0x560755fe0580 2023-07-14T13:02:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755f389e0 con 0x560755e3c6b0 2023-07-14T13:02:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755f31e70 con 0x560755fe62d0 2023-07-14T13:02:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfbcb9c700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcfa00a12c0 0x7fcfa00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfb7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755fe5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfb7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755fe5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:42728/0 (socket says 172.21.15.17:42728) 2023-07-14T13:02:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfb7fff700 1 -- 172.21.15.17:0/2372446814 learned_addr learned my addr 172.21.15.17:0/2372446814 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfbcb9c700 1 --2- 172.21.15.17:0/2372446814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfb77fe700 1 --2- 172.21.15.17:0/2372446814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755fe62d0 0x560755fe0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfb7fff700 1 -- 172.21.15.17:0/2372446814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755fe62d0 msgr2=0x560755fe0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/2372446814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755fe62d0 0x560755fe0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfb7fff700 1 -- 172.21.15.17:0/2372446814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 msgr2=0x560755fe09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/2372446814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.607+0000 7fcfb7fff700 1 -- 172.21.15.17:0/2372446814 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560755d5fd80 con 0x560755e3c6b0 2023-07-14T13:02:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.608+0000 7fcfbcb9c700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcfa00a12c0 0x7fcfa00a3770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8069ab0 tx=0x7fcfb0007950 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:39.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.608+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/2372446814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755fe5d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800bd70 tx=0x7fcfa80106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f117ee50efe21fda server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:39.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.608+0000 7fcf9e7fc700 1 -- 172.21.15.17:0/2372446814 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8010ec0 con 0x560755e3c6b0 2023-07-14T13:02:39.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.608+0000 7fcf9e7fc700 1 -- 172.21.15.17:0/2372446814 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfa8015070 con 0x560755e3c6b0 2023-07-14T13:02:39.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.608+0000 7fcf9e7fc700 1 -- 172.21.15.17:0/2372446814 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80116a0 con 0x560755e3c6b0 2023-07-14T13:02:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.609+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2372446814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 msgr2=0x560755fe5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.609+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/2372446814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755fe5d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800bd70 tx=0x7fcfa80106b0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.609+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2372446814 shutdown_connections 2023-07-14T13:02:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.609+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/2372446814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.609+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/2372446814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755fe5d90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.609+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/2372446814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755fe62d0 0x560755fe0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.609+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2372446814 >> 172.21.15.17:0/2372446814 conn(0x560755fd5be0 msgr2=0x560755fdaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.609+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2372446814 shutdown_connections 2023-07-14T13:02:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.609+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2372446814 wait complete. 2023-07-14T13:02:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.610+0000 7fcfd1ee2b80 1 -- start start 2023-07-14T13:02:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.610+0000 7fcfd1ee2b80 1 Processor -- start 2023-07-14T13:02:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.610+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 0x560755fec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.610+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 0x560755fe9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755ed1a60 con 0x560755fe0580 2023-07-14T13:02:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755ed1760 con 0x560755fe62d0 2023-07-14T13:02:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755db58c0 con 0x560755e3c6b0 2023-07-14T13:02:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfd1ee2b80 10 client.0 _ll_register_callbacks cb 0x560755ecf700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfb77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfb7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 0x560755fec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfb77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46854/0 (socket says 172.21.15.17:46854) 2023-07-14T13:02:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfb77fe700 1 -- 172.21.15.17:0/4281680411 learned_addr learned my addr 172.21.15.17:0/4281680411 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfbcb9c700 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 0x560755fe9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfb77fe700 1 -- 172.21.15.17:0/4281680411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 msgr2=0x560755fec510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfb77fe700 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 0x560755fec510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfb77fe700 1 -- 172.21.15.17:0/4281680411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 msgr2=0x560755fe9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfb77fe700 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 0x560755fe9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfb77fe700 1 -- 172.21.15.17:0/4281680411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa800b9a0 con 0x560755fe0580 2023-07-14T13:02:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 0x560755fec510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.611+0000 7fcfbcb9c700 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 0x560755fe9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.612+0000 7fcfb77fe700 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe9800 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcfac097360 tx=0x7fcfac09ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1666b7ba89b5e40a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.612+0000 7fcf977fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.612+0000 7fcf977fe700 1 -- 172.21.15.17:0/4281680411 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac09a550 con 0x560755fe0580 2023-07-14T13:02:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.612+0000 7fcf977fe700 1 -- 172.21.15.17:0/4281680411 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcfac09ee90 con 0x560755fe0580 2023-07-14T13:02:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.612+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4281680411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560755e8b490 con 0x560755fe0580 2023-07-14T13:02:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.612+0000 7fcf977fe700 1 -- 172.21.15.17:0/4281680411 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfac0a3220 con 0x560755fe0580 2023-07-14T13:02:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.612+0000 7fcfd1ee2b80 10 client.16251 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.612+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4281680411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x560755d48c00 con 0x560755fe0580 2023-07-14T13:02:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.613+0000 7fcf977fe700 1 -- 172.21.15.17:0/4281680411 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560755e8b490 con 0x560755fe0580 2023-07-14T13:02:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.613+0000 7fcf977fe700 1 -- 172.21.15.17:0/4281680411 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcfac0b8fa0 con 0x560755fe0580 2023-07-14T13:02:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.613+0000 7fcfd1ee2b80 10 client.16251 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.613+0000 7fcfd1ee2b80 10 client.16251 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.613+0000 7fcfd1ee2b80 20 client.16251 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.613+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560755ff96a0 0x560755ffbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.613+0000 7fcfd1ee2b80 4 client.16251 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.613+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4281680411 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560755f2ae50 con 0x560755ff96a0 2023-07-14T13:02:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.613+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560755ff96a0 0x560755ffbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.614+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560755ff96a0 0x560755ffbab0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc7901e666f64ea5 server_cookie=8642a8e06bb207a8 in_seq=0 out_seq=0 2023-07-14T13:02:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.614+0000 7fcf977fe700 10 client.16251 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcf977fe700 1 -- 172.21.15.17:0/4281680411 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560755f2ae50 con 0x560755ff96a0 2023-07-14T13:02:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcf977fe700 10 client.16251 handle_command_reply: tid=0 2023-07-14T13:02:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcfd1ee2b80 1 client.16251 shutdown 2023-07-14T13:02:39.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4281680411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 msgr2=0x560755fe9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe9800 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcfac097360 tx=0x7fcfac09ae60 comp rx=0 tx=0).stop 2023-07-14T13:02:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4281680411 shutdown_connections 2023-07-14T13:02:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560755ff96a0 0x560755ffbab0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 0x560755fe9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 0x560755fec510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/4281680411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe9800 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcf977fe700 0 client.16251 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:39.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4281680411 >> 172.21.15.17:0/4281680411 conn(0x560755fd5be0 msgr2=0x560755fd9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4281680411 shutdown_connections 2023-07-14T13:02:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.615+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4281680411 wait complete. 2023-07-14T13:02:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.616+0000 7fcfd1ee2b80 20 client.16251 trim_cache size 0 max 16384 2023-07-14T13:02:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.633+0000 7fcfd1ee2b80 1 Processor -- start 2023-07-14T13:02:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfd1ee2b80 1 -- start start 2023-07-14T13:02:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755ff0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755fe0580 0x560755fdac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe62d0 0x560755fec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755fe66a0 con 0x560755fe62d0 2023-07-14T13:02:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755fe4390 con 0x560755e3c6b0 2023-07-14T13:02:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755fead70 con 0x560755fe0580 2023-07-14T13:02:39.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfb7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755ff0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfbcb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe62d0 0x560755fec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfb7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755ff0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:42732/0 (socket says 172.21.15.17:42732) 2023-07-14T13:02:39.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfb7fff700 1 -- 172.21.15.17:0/4121455645 learned_addr learned my addr 172.21.15.17:0/4121455645 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:39.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.634+0000 7fcfb77fe700 1 --2- 172.21.15.17:0/4121455645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755fe0580 0x560755fdac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.635+0000 7fcfb7fff700 1 -- 172.21.15.17:0/4121455645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755fe0580 msgr2=0x560755fdac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.635+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/4121455645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755fe0580 0x560755fdac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.635+0000 7fcfb7fff700 1 -- 172.21.15.17:0/4121455645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe62d0 msgr2=0x560755fec0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.635+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/4121455645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe62d0 0x560755fec0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.635+0000 7fcfb7fff700 1 -- 172.21.15.17:0/4121455645 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607560006a0 con 0x560755e3c6b0 2023-07-14T13:02:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.635+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/4121455645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755ff0c60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcfa801f010 tx=0x7fcfa800b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24eec06f597d1644 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.635+0000 7fcf9effd700 1 -- 172.21.15.17:0/4121455645 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8022040 con 0x560755e3c6b0 2023-07-14T13:02:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.635+0000 7fcf9effd700 1 -- 172.21.15.17:0/4121455645 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfa8027de0 con 0x560755e3c6b0 2023-07-14T13:02:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.635+0000 7fcf9effd700 1 -- 172.21.15.17:0/4121455645 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80054a0 con 0x560755e3c6b0 2023-07-14T13:02:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.636+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4121455645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 msgr2=0x560755ff0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.636+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/4121455645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755ff0c60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcfa801f010 tx=0x7fcfa800b630 comp rx=0 tx=0).stop 2023-07-14T13:02:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.636+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4121455645 shutdown_connections 2023-07-14T13:02:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.636+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/4121455645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe62d0 0x560755fec0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.636+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/4121455645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755e3c6b0 0x560755ff0c60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.636+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/4121455645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755fe0580 0x560755fdac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.636+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4121455645 >> 172.21.15.17:0/4121455645 conn(0x560755fd5be0 msgr2=0x560755fe6900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.636+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4121455645 shutdown_connections 2023-07-14T13:02:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.636+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/4121455645 wait complete. 2023-07-14T13:02:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.637+0000 7fcfd1ee2b80 1 -- start start 2023-07-14T13:02:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.637+0000 7fcfd1ee2b80 1 Processor -- start 2023-07-14T13:02:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 0x560755fe2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfd1ee2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 0x560755fe1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755fe33c0 con 0x560755fe0580 2023-07-14T13:02:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755fe3530 con 0x560755fe62d0 2023-07-14T13:02:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfd1ee2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560755fe22e0 con 0x560755e3c6b0 2023-07-14T13:02:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfd1ee2b80 10 client.0 _ll_register_callbacks cb 0x7fcfac09a7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfb77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfbcb9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 0x560755fe1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfb77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46878/0 (socket says 172.21.15.17:46878) 2023-07-14T13:02:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfb77fe700 1 -- 172.21.15.17:0/2617103220 learned_addr learned my addr 172.21.15.17:0/2617103220 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 0x560755fe2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.638+0000 7fcfb77fe700 1 -- 172.21.15.17:0/2617103220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 msgr2=0x560755fe2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.639+0000 7fcfb77fe700 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 0x560755fe2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.639+0000 7fcfb77fe700 1 -- 172.21.15.17:0/2617103220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 msgr2=0x560755fe1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.639+0000 7fcfb77fe700 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 0x560755fe1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.639+0000 7fcfb77fe700 1 -- 172.21.15.17:0/2617103220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560755d5fd80 con 0x560755fe0580 2023-07-14T13:02:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.639+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 0x560755fe2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:02:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.639+0000 7fcfbcb9c700 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 0x560755fe1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.639+0000 7fcfb77fe700 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe1860 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcfac09ab60 tx=0x7fcfac009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffe735bb4994551 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.639+0000 7fcf977fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.639+0000 7fcf977fe700 1 -- 172.21.15.17:0/2617103220 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac09ee90 con 0x560755fe0580 2023-07-14T13:02:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.639+0000 7fcf977fe700 1 -- 172.21.15.17:0/2617103220 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcfac0a3220 con 0x560755fe0580 2023-07-14T13:02:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.639+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2617103220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfa8015070 con 0x560755fe0580 2023-07-14T13:02:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.640+0000 7fcf977fe700 1 -- 172.21.15.17:0/2617103220 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfac09a350 con 0x560755fe0580 2023-07-14T13:02:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.640+0000 7fcfd1ee2b80 10 client.16257 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.640+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2617103220 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x560755d861f0 con 0x560755fe0580 2023-07-14T13:02:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.640+0000 7fcf977fe700 1 -- 172.21.15.17:0/2617103220 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfa8015070 con 0x560755fe0580 2023-07-14T13:02:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.640+0000 7fcf977fe700 1 -- 172.21.15.17:0/2617103220 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcfac095b00 con 0x560755fe0580 2023-07-14T13:02:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.640+0000 7fcfd1ee2b80 10 client.16257 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.640+0000 7fcfd1ee2b80 10 client.16257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.640+0000 7fcfd1ee2b80 20 client.16257 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.640+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56075604e0e0 0x5607560504c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.640+0000 7fcfd1ee2b80 4 client.16257 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:02:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.640+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2617103220 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560755eecff0 con 0x56075604e0e0 2023-07-14T13:02:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.641+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56075604e0e0 0x5607560504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.641+0000 7fcfb7fff700 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56075604e0e0 0x5607560504c0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15eaf773928bfa05 server_cookie=ecb1ecb277918806 in_seq=0 out_seq=0 2023-07-14T13:02:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.641+0000 7fcf977fe700 10 client.16257 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:39.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.654+0000 7fcf977fe700 1 -- 172.21.15.17:0/2617103220 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560755eecff0 con 0x56075604e0e0 2023-07-14T13:02:39.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.654+0000 7fcf977fe700 10 client.16257 handle_command_reply: tid=0 2023-07-14T13:02:39.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.654+0000 7fcfd1ee2b80 1 client.16257 shutdown 2023-07-14T13:02:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2617103220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 msgr2=0x560755fe1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe1860 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcfac09ab60 tx=0x7fcfac009f50 comp rx=0 tx=0).stop 2023-07-14T13:02:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2617103220 shutdown_connections 2023-07-14T13:02:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56075604e0e0 0x5607560504c0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560755fe62d0 0x560755fe1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560755e3c6b0 0x560755fe2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcfd1ee2b80 1 --2- 172.21.15.17:0/2617103220 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560755fe0580 0x560755fe1860 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcf977fe700 0 client.16257 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:39.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2617103220 >> 172.21.15.17:0/2617103220 conn(0x560755fd5be0 msgr2=0x560755fe5210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:39.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2617103220 shutdown_connections 2023-07-14T13:02:39.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcfd1ee2b80 1 -- 172.21.15.17:0/2617103220 wait complete. 2023-07-14T13:02:39.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.655+0000 7fcfd1ee2b80 20 client.16257 trim_cache size 0 max 16384 2023-07-14T13:02:39.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:02:39.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:02:39.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:02:39.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:02:39.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/560074616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcfa00a12c0 msgr2=0x7fcfa00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:39.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcfa00a12c0 0x7fcfa00a3770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8069ab0 tx=0x7fcfb0007950 comp rx=0 tx=0).stop 2023-07-14T13:02:39.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/560074616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb80731c0 msgr2=0x7fcfb819c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb80731c0 0x7fcfb819c6e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fcfac005910 tx=0x7fcfac009580 comp rx=0 tx=0).stop 2023-07-14T13:02:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/560074616 shutdown_connections 2023-07-14T13:02:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcfa00a12c0 0x7fcfa00a3770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcfb8110b10 0x7fcfb81a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfb80728b0 0x7fcfb819c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 --2- 172.21.15.17:0/560074616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfb80731c0 0x7fcfb819c6e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/560074616 >> 172.21.15.17:0/560074616 conn(0x7fcfb80fb600 msgr2=0x7fcfb80fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:39.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/560074616 shutdown_connections 2023-07-14T13:02:39.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:39.656+0000 7fcfbe5ff700 1 -- 172.21.15.17:0/560074616 wait complete. 2023-07-14T13:02:40.515 INFO:teuthology.orchestra.run.smithi017.stderr:9000000 of 50000000 tuples (18%) done (elapsed 150.12 s, remaining 683.88 s) 2023-07-14T13:02:41.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:41 smithi135 ceph-mon[97338]: pgmap v91: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 34 MiB/s wr, 36 op/s 2023-07-14T13:02:41.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:41 smithi131 ceph-mon[96953]: pgmap v91: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 34 MiB/s wr, 36 op/s 2023-07-14T13:02:41.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:41 smithi017 ceph-mon[95536]: pgmap v91: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 34 MiB/s wr, 36 op/s 2023-07-14T13:02:42.407 INFO:teuthology.orchestra.run.smithi017.stderr:9100000 of 50000000 tuples (18%) done (elapsed 152.01 s, remaining 683.21 s) 2023-07-14T13:02:43.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:43 smithi135 ceph-mon[97338]: pgmap v92: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 22 op/s 2023-07-14T13:02:43.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:43 smithi131 ceph-mon[96953]: pgmap v92: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 22 op/s 2023-07-14T13:02:43.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:43 smithi017 ceph-mon[95536]: pgmap v92: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 22 op/s 2023-07-14T13:02:43.759 INFO:teuthology.orchestra.run.smithi017.stderr:9200000 of 50000000 tuples (18%) done (elapsed 153.36 s, remaining 680.13 s) 2023-07-14T13:02:45.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:45 smithi135 ceph-mon[97338]: pgmap v93: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 22 op/s 2023-07-14T13:02:45.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:45 smithi131 ceph-mon[96953]: pgmap v93: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 22 op/s 2023-07-14T13:02:45.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:45 smithi017 ceph-mon[95536]: pgmap v93: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 MiB/s wr, 22 op/s 2023-07-14T13:02:45.627 INFO:teuthology.orchestra.run.smithi017.stderr:9300000 of 50000000 tuples (18%) done (elapsed 155.23 s, remaining 679.35 s) 2023-07-14T13:02:47.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:47 smithi135 ceph-mon[97338]: pgmap v94: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 34 MiB/s wr, 32 op/s 2023-07-14T13:02:47.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:47 smithi131 ceph-mon[96953]: pgmap v94: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 34 MiB/s wr, 32 op/s 2023-07-14T13:02:47.520 INFO:teuthology.orchestra.run.smithi017.stderr:9400000 of 50000000 tuples (18%) done (elapsed 157.12 s, remaining 678.64 s) 2023-07-14T13:02:47.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:47 smithi017 ceph-mon[95536]: pgmap v94: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 34 MiB/s wr, 32 op/s 2023-07-14T13:02:48.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:02:48.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.368+0000 7f8853dff700 1 -- 172.21.15.17:0/840131486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f884c10a070 msgr2=0x7f884c10c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.368+0000 7f8853dff700 1 --2- 172.21.15.17:0/840131486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f884c10a070 0x7f884c10c4b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f884400b0a0 tx=0x7f884400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.368+0000 7f8853dff700 1 -- 172.21.15.17:0/840131486 shutdown_connections 2023-07-14T13:02:48.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.368+0000 7f8853dff700 1 --2- 172.21.15.17:0/840131486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f884c10a070 0x7f884c10c4b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.368+0000 7f8853dff700 1 --2- 172.21.15.17:0/840131486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c100ca0 0x7f884c101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.368+0000 7f8853dff700 1 --2- 172.21.15.17:0/840131486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f884c1015b0 0x7f884c109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.368+0000 7f8853dff700 1 -- 172.21.15.17:0/840131486 >> 172.21.15.17:0/840131486 conn(0x7f884c0fa4b0 msgr2=0x7f884c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:48.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.368+0000 7f8853dff700 1 -- 172.21.15.17:0/840131486 shutdown_connections 2023-07-14T13:02:48.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.369+0000 7f8853dff700 1 -- 172.21.15.17:0/840131486 wait complete. 2023-07-14T13:02:48.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.370+0000 7f8853dff700 1 Processor -- start 2023-07-14T13:02:48.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.370+0000 7f8853dff700 1 -- start start 2023-07-14T13:02:48.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.370+0000 7f8853dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f884c100ca0 0x7f884c19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.370+0000 7f8853dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c1015b0 0x7f884c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.370+0000 7f8853dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f884c10a070 0x7f884c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.370+0000 7f8853dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c196140 con 0x7f884c10a070 2023-07-14T13:02:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.370+0000 7f8853dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c1962b0 con 0x7f884c1015b0 2023-07-14T13:02:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.370+0000 7f8853dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c196470 con 0x7f884c100ca0 2023-07-14T13:02:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.371+0000 7f885239c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f884c10a070 0x7f884c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.371+0000 7f885139a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c1015b0 0x7f884c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.371+0000 7f885239c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f884c10a070 0x7f884c195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44914/0 (socket says 172.21.15.17:44914) 2023-07-14T13:02:48.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.371+0000 7f885239c700 1 -- 172.21.15.17:0/831495873 learned_addr learned my addr 172.21.15.17:0/831495873 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:48.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.371+0000 7f8851b9b700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f884c100ca0 0x7f884c19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.371+0000 7f885139a700 1 -- 172.21.15.17:0/831495873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f884c100ca0 msgr2=0x7f884c19ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.371+0000 7f885139a700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f884c100ca0 0x7f884c19ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.371+0000 7f885139a700 1 -- 172.21.15.17:0/831495873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f884c10a070 msgr2=0x7f884c195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.371+0000 7f885139a700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f884c10a070 0x7f884c195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.371+0000 7f885139a700 1 -- 172.21.15.17:0/831495873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844009d00 con 0x7f884c1015b0 2023-07-14T13:02:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.371+0000 7f885239c700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f884c10a070 0x7f884c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.372+0000 7f885139a700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c1015b0 0x7f884c19bfa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f883c00e9f0 tx=0x7f883c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.372+0000 7f8842ffd700 1 -- 172.21.15.17:0/831495873 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00c9c0 con 0x7f884c1015b0 2023-07-14T13:02:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.372+0000 7f8842ffd700 1 -- 172.21.15.17:0/831495873 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f883c010430 con 0x7f884c1015b0 2023-07-14T13:02:48.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.372+0000 7f8853dff700 1 -- 172.21.15.17:0/831495873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c196750 con 0x7f884c1015b0 2023-07-14T13:02:48.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.372+0000 7f8842ffd700 1 -- 172.21.15.17:0/831495873 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c018680 con 0x7f884c1015b0 2023-07-14T13:02:48.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.372+0000 7f8853dff700 1 -- 172.21.15.17:0/831495873 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c1a2a50 con 0x7f884c1015b0 2023-07-14T13:02:48.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.376+0000 7f8842ffd700 1 -- 172.21.15.17:0/831495873 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f883c0105a0 con 0x7f884c1015b0 2023-07-14T13:02:48.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.377+0000 7f8867623b80 1 Processor -- start 2023-07-14T13:02:48.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.377+0000 7f8867623b80 1 -- start start 2023-07-14T13:02:48.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f8867623b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 0x561dcb4b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f8867623b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f8867623b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4c2ad0 0x561dcb4c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f8867623b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb3bdcb0 con 0x561dcb4b72d0 2023-07-14T13:02:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f8867623b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb410a40 con 0x561dcb4c2ad0 2023-07-14T13:02:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f8867623b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb409ed0 con 0x561dcb4b7be0 2023-07-14T13:02:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f8842ffd700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f88380a12c0 0x7f88380a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f8851b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f885239c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 0x561dcb4b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f8842ffd700 1 -- 172.21.15.17:0/831495873 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f883c014070 con 0x7f884c1015b0 2023-07-14T13:02:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f8851b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60566/0 (socket says 172.21.15.17:60566) 2023-07-14T13:02:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f8851b9b700 1 -- 172.21.15.17:0/2508509146 learned_addr learned my addr 172.21.15.17:0/2508509146 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f885239c700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f88380a12c0 0x7f88380a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.378+0000 7f885139a700 1 --2- 172.21.15.17:0/2508509146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4c2ad0 0x561dcb4c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.379+0000 7f8851b9b700 1 -- 172.21.15.17:0/2508509146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4c2ad0 msgr2=0x561dcb4c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.379+0000 7f8851b9b700 1 --2- 172.21.15.17:0/2508509146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4c2ad0 0x561dcb4c4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.379+0000 7f8851b9b700 1 -- 172.21.15.17:0/2508509146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 msgr2=0x561dcb4b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.379+0000 7f8851b9b700 1 --2- 172.21.15.17:0/2508509146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 0x561dcb4b76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.379+0000 7f8851b9b700 1 -- 172.21.15.17:0/2508509146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dcb237de0 con 0x561dcb4b7be0 2023-07-14T13:02:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.379+0000 7f8851b9b700 1 --2- 172.21.15.17:0/2508509146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8848009d80 tx=0x7f8848011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc2b48930aa901b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.379+0000 7f885239c700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f88380a12c0 0x7f88380a3770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f884400b780 tx=0x7f88440099e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.379+0000 7f8837fff700 1 -- 172.21.15.17:0/2508509146 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848004230 con 0x561dcb4b7be0 2023-07-14T13:02:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.379+0000 7f8837fff700 1 -- 172.21.15.17:0/2508509146 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8848004390 con 0x561dcb4b7be0 2023-07-14T13:02:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.379+0000 7f8837fff700 1 -- 172.21.15.17:0/2508509146 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480197e0 con 0x561dcb4b7be0 2023-07-14T13:02:48.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.380+0000 7f8867623b80 1 -- 172.21.15.17:0/2508509146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4b7be0 msgr2=0x561dcb4c2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.380+0000 7f8867623b80 1 --2- 172.21.15.17:0/2508509146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8848009d80 tx=0x7f8848011720 comp rx=0 tx=0).stop 2023-07-14T13:02:48.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.380+0000 7f8867623b80 1 -- 172.21.15.17:0/2508509146 shutdown_connections 2023-07-14T13:02:48.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.380+0000 7f8867623b80 1 --2- 172.21.15.17:0/2508509146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4c2ad0 0x561dcb4c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.380+0000 7f8867623b80 1 --2- 172.21.15.17:0/2508509146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 0x561dcb4b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.380+0000 7f8867623b80 1 --2- 172.21.15.17:0/2508509146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2590 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.380+0000 7f8867623b80 1 -- 172.21.15.17:0/2508509146 >> 172.21.15.17:0/2508509146 conn(0x561dcb4adda0 msgr2=0x561dcb4b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:48.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.380+0000 7f8867623b80 1 -- 172.21.15.17:0/2508509146 shutdown_connections 2023-07-14T13:02:48.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.380+0000 7f8867623b80 1 -- 172.21.15.17:0/2508509146 wait complete. 2023-07-14T13:02:48.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.381+0000 7f8867623b80 1 -- start start 2023-07-14T13:02:48.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.381+0000 7f8867623b80 1 Processor -- start 2023-07-14T13:02:48.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8867623b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 0x561dcb4c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8867623b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b7be0 0x561dcb4bf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8867623b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 0x561dcb4bfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8867623b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb3a9ac0 con 0x561dcb4b72d0 2023-07-14T13:02:48.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8867623b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb3a97c0 con 0x561dcb4b7be0 2023-07-14T13:02:48.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8867623b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb28d920 con 0x561dcb4c2ad0 2023-07-14T13:02:48.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8867623b80 10 client.0 _ll_register_callbacks cb 0x561dcb3a7760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:48.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8851b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 0x561dcb4c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8851b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 0x561dcb4c24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44930/0 (socket says 172.21.15.17:44930) 2023-07-14T13:02:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8851b9b700 1 -- 172.21.15.17:0/2632174323 learned_addr learned my addr 172.21.15.17:0/2632174323 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f885139a700 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b7be0 0x561dcb4bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8851b9b700 1 -- 172.21.15.17:0/2632174323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 msgr2=0x561dcb4bfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.382+0000 7f8851b9b700 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 0x561dcb4bfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.383+0000 7f8851b9b700 1 -- 172.21.15.17:0/2632174323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b7be0 msgr2=0x561dcb4bf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:48.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.383+0000 7f8851b9b700 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b7be0 0x561dcb4bf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.383+0000 7f8851b9b700 1 -- 172.21.15.17:0/2632174323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88480099e0 con 0x561dcb4b72d0 2023-07-14T13:02:48.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.383+0000 7f8851b9b700 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 0x561dcb4c24d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8848003f50 tx=0x7f8848003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5ed77a8fb10b05 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:48.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.383+0000 7f88357fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:48.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.383+0000 7f88357fa700 1 -- 172.21.15.17:0/2632174323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848005450 con 0x561dcb4b72d0 2023-07-14T13:02:48.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.383+0000 7f8867623b80 1 -- 172.21.15.17:0/2632174323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561dcb3634f0 con 0x561dcb4b72d0 2023-07-14T13:02:48.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.383+0000 7f88357fa700 1 -- 172.21.15.17:0/2632174323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f8848004500 con 0x561dcb4b72d0 2023-07-14T13:02:48.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.384+0000 7f88357fa700 1 -- 172.21.15.17:0/2632174323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8848003bd0 con 0x561dcb4b72d0 2023-07-14T13:02:48.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.384+0000 7f8867623b80 10 client.16269 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:48.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.384+0000 7f8867623b80 1 -- 172.21.15.17:0/2632174323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x561dcb220c60 con 0x561dcb4b72d0 2023-07-14T13:02:48.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.384+0000 7f88357fa700 1 -- 172.21.15.17:0/2632174323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561dcb3634f0 con 0x561dcb4b72d0 2023-07-14T13:02:48.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.384+0000 7f88357fa700 1 -- 172.21.15.17:0/2632174323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f8848028020 con 0x561dcb4b72d0 2023-07-14T13:02:48.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.384+0000 7f8867623b80 10 client.16269 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:48.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.384+0000 7f8867623b80 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:48.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.384+0000 7f8867623b80 20 client.16269 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:48.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.384+0000 7f8867623b80 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561dcb4d2310 0x561dcb4d4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.384+0000 7f8867623b80 4 client.16269 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:48.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.384+0000 7f8867623b80 1 -- 172.21.15.17:0/2632174323 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561dcb402eb0 con 0x561dcb4d2310 2023-07-14T13:02:48.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.385+0000 7f885139a700 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561dcb4d2310 0x561dcb4d4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.385+0000 7f885139a700 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561dcb4d2310 0x561dcb4d4720 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb37c311a6f3666f server_cookie=983e5f7f6ce84110 in_seq=0 out_seq=0 2023-07-14T13:02:48.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.385+0000 7f88357fa700 10 client.16269 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:48.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.386+0000 7f88357fa700 1 -- 172.21.15.17:0/2632174323 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561dcb402eb0 con 0x561dcb4d2310 2023-07-14T13:02:48.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.386+0000 7f88357fa700 10 client.16269 handle_command_reply: tid=0 2023-07-14T13:02:48.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.386+0000 7f8867623b80 1 client.16269 shutdown 2023-07-14T13:02:48.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.386+0000 7f8867623b80 1 -- 172.21.15.17:0/2632174323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 msgr2=0x561dcb4c24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.386+0000 7f8867623b80 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 0x561dcb4c24d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8848003f50 tx=0x7f8848003930 comp rx=0 tx=0).stop 2023-07-14T13:02:48.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.386+0000 7f8867623b80 1 -- 172.21.15.17:0/2632174323 shutdown_connections 2023-07-14T13:02:48.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.386+0000 7f8867623b80 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561dcb4d2310 0x561dcb4d4720 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.386+0000 7f8867623b80 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 0x561dcb4bfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.387+0000 7f8867623b80 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b72d0 0x561dcb4c24d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.387+0000 7f8867623b80 1 --2- 172.21.15.17:0/2632174323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b7be0 0x561dcb4bf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.387+0000 7f8867623b80 1 -- 172.21.15.17:0/2632174323 >> 172.21.15.17:0/2632174323 conn(0x561dcb4adda0 msgr2=0x561dcb4b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:48.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.387+0000 7f88357fa700 0 client.16269 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:48.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.387+0000 7f8867623b80 1 -- 172.21.15.17:0/2632174323 shutdown_connections 2023-07-14T13:02:48.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.387+0000 7f8867623b80 1 -- 172.21.15.17:0/2632174323 wait complete. 2023-07-14T13:02:48.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.387+0000 7f8867623b80 20 client.16269 trim_cache size 0 max 16384 2023-07-14T13:02:48.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.408+0000 7f8867623b80 1 Processor -- start 2023-07-14T13:02:48.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.408+0000 7f8867623b80 1 -- start start 2023-07-14T13:02:48.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.408+0000 7f8867623b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b72d0 0x561dcb4c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.408+0000 7f8867623b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.408+0000 7f8867623b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 0x561dcb4baa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.408+0000 7f8867623b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb4b8dd0 con 0x561dcb4b7be0 2023-07-14T13:02:48.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.408+0000 7f8867623b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb4ced40 con 0x561dcb4b72d0 2023-07-14T13:02:48.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.408+0000 7f8867623b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb4d4a30 con 0x561dcb4c2ad0 2023-07-14T13:02:48.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.408+0000 7f885139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.408+0000 7f885139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44934/0 (socket says 172.21.15.17:44934) 2023-07-14T13:02:48.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.408+0000 7f885139a700 1 -- 172.21.15.17:0/3968238914 learned_addr learned my addr 172.21.15.17:0/3968238914 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:48.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.409+0000 7f8851b9b700 1 --2- 172.21.15.17:0/3968238914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b72d0 0x561dcb4c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.409+0000 7f885239c700 1 --2- 172.21.15.17:0/3968238914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 0x561dcb4baa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.409+0000 7f885139a700 1 -- 172.21.15.17:0/3968238914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 msgr2=0x561dcb4baa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:48.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.409+0000 7f885139a700 1 --2- 172.21.15.17:0/3968238914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 0x561dcb4baa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.409+0000 7f885139a700 1 -- 172.21.15.17:0/3968238914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b72d0 msgr2=0x561dcb4c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:48.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.409+0000 7f885139a700 1 --2- 172.21.15.17:0/3968238914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b72d0 0x561dcb4c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.409+0000 7f885139a700 1 -- 172.21.15.17:0/3968238914 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dcb25e250 con 0x561dcb4b7be0 2023-07-14T13:02:48.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.409+0000 7f885139a700 1 --2- 172.21.15.17:0/3968238914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2000 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f883c00e9c0 tx=0x7f883c0cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23335e7876319fbd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:48.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.409+0000 7f8840bff700 1 -- 172.21.15.17:0/3968238914 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0691e0 con 0x561dcb4b7be0 2023-07-14T13:02:48.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.409+0000 7f8840bff700 1 -- 172.21.15.17:0/3968238914 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f883c069070 con 0x561dcb4b7be0 2023-07-14T13:02:48.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.409+0000 7f8840bff700 1 -- 172.21.15.17:0/3968238914 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c09a130 con 0x561dcb4b7be0 2023-07-14T13:02:48.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.410+0000 7f8867623b80 1 -- 172.21.15.17:0/3968238914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 msgr2=0x561dcb4c2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.410+0000 7f8867623b80 1 --2- 172.21.15.17:0/3968238914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2000 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f883c00e9c0 tx=0x7f883c0cc040 comp rx=0 tx=0).stop 2023-07-14T13:02:48.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.410+0000 7f8867623b80 1 -- 172.21.15.17:0/3968238914 shutdown_connections 2023-07-14T13:02:48.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.410+0000 7f8867623b80 1 --2- 172.21.15.17:0/3968238914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 0x561dcb4baa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.410+0000 7f8867623b80 1 --2- 172.21.15.17:0/3968238914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b72d0 0x561dcb4c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.410+0000 7f8867623b80 1 --2- 172.21.15.17:0/3968238914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c2000 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.410+0000 7f8867623b80 1 -- 172.21.15.17:0/3968238914 >> 172.21.15.17:0/3968238914 conn(0x561dcb4adda0 msgr2=0x561dcb4d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:48.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.411+0000 7f8867623b80 1 -- 172.21.15.17:0/3968238914 shutdown_connections 2023-07-14T13:02:48.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.411+0000 7f8867623b80 1 -- 172.21.15.17:0/3968238914 wait complete. 2023-07-14T13:02:48.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.411+0000 7f8867623b80 1 -- start start 2023-07-14T13:02:48.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.411+0000 7f8867623b80 1 Processor -- start 2023-07-14T13:02:48.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.412+0000 7f8867623b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b72d0 0x561dcb4c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.412+0000 7f8867623b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.412+0000 7f8867623b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 0x561dcb4c5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.412+0000 7f8867623b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb4c5e60 con 0x561dcb4b7be0 2023-07-14T13:02:48.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.412+0000 7f8867623b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb4c5fd0 con 0x561dcb4b72d0 2023-07-14T13:02:48.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.412+0000 7f8867623b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dcb4c6190 con 0x561dcb4c2ad0 2023-07-14T13:02:48.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.412+0000 7f8867623b80 10 client.0 _ll_register_callbacks cb 0x7f8848005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:48.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.412+0000 7f885139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.412+0000 7f885139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44944/0 (socket says 172.21.15.17:44944) 2023-07-14T13:02:48.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.412+0000 7f885139a700 1 -- 172.21.15.17:0/1821453135 learned_addr learned my addr 172.21.15.17:0/1821453135 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:48.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.413+0000 7f8851b9b700 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b72d0 0x561dcb4c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.413+0000 7f885239c700 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 0x561dcb4c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.413+0000 7f885139a700 1 -- 172.21.15.17:0/1821453135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 msgr2=0x561dcb4c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:48.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.413+0000 7f885139a700 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 0x561dcb4c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.413+0000 7f885139a700 1 -- 172.21.15.17:0/1821453135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b72d0 msgr2=0x561dcb4c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:48.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.413+0000 7f885139a700 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b72d0 0x561dcb4c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.413+0000 7f885139a700 1 -- 172.21.15.17:0/1821453135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c1a2a50 con 0x561dcb4b7be0 2023-07-14T13:02:48.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.413+0000 7f885139a700 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c96d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f883c099bd0 tx=0x7f883c0a23a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72365292cff81d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:48.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.413+0000 7f88357fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:48.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.414+0000 7f88357fa700 1 -- 172.21.15.17:0/1821453135 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c099ed0 con 0x561dcb4b7be0 2023-07-14T13:02:48.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.414+0000 7f88357fa700 1 -- 172.21.15.17:0/1821453135 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f883c09df00 con 0x561dcb4b7be0 2023-07-14T13:02:48.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.414+0000 7f8867623b80 1 -- 172.21.15.17:0/1821453135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8848004390 con 0x561dcb4b7be0 2023-07-14T13:02:48.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.414+0000 7f88357fa700 1 -- 172.21.15.17:0/1821453135 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f883c0ca1a0 con 0x561dcb4b7be0 2023-07-14T13:02:48.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.414+0000 7f8867623b80 10 client.16275 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:48.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.414+0000 7f8867623b80 1 -- 172.21.15.17:0/1821453135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x561dcb2362b0 con 0x561dcb4b7be0 2023-07-14T13:02:48.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.414+0000 7f88357fa700 1 -- 172.21.15.17:0/1821453135 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8848004390 con 0x561dcb4b7be0 2023-07-14T13:02:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.414+0000 7f88357fa700 1 -- 172.21.15.17:0/1821453135 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f883c0adbd0 con 0x561dcb4b7be0 2023-07-14T13:02:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.415+0000 7f8867623b80 10 client.16275 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.415+0000 7f8867623b80 10 client.16275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.415+0000 7f8867623b80 20 client.16275 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.415+0000 7f8867623b80 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561dcb52b4f0 0x561dcb52d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.415+0000 7f8867623b80 4 client.16275 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:02:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.415+0000 7f8867623b80 1 -- 172.21.15.17:0/1821453135 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561dcb3c5050 con 0x561dcb52b4f0 2023-07-14T13:02:48.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.415+0000 7f8851b9b700 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561dcb52b4f0 0x561dcb52d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.416+0000 7f88357fa700 10 client.16275 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:48.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.416+0000 7f8851b9b700 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561dcb52b4f0 0x561dcb52d900 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5411e57375d5980 server_cookie=4eb9386e096bf125 in_seq=0 out_seq=0 2023-07-14T13:02:48.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f88357fa700 1 -- 172.21.15.17:0/1821453135 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561dcb3c5050 con 0x561dcb52b4f0 2023-07-14T13:02:48.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f88357fa700 10 client.16275 handle_command_reply: tid=0 2023-07-14T13:02:48.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 1 client.16275 shutdown 2023-07-14T13:02:48.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 1 -- 172.21.15.17:0/1821453135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 msgr2=0x561dcb4c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c96d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f883c099bd0 tx=0x7f883c0a23a0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 1 -- 172.21.15.17:0/1821453135 shutdown_connections 2023-07-14T13:02:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561dcb52b4f0 0x561dcb52d900 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561dcb4c2ad0 0x561dcb4c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561dcb4b72d0 0x561dcb4c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f88357fa700 0 client.16275 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 1 --2- 172.21.15.17:0/1821453135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561dcb4b7be0 0x561dcb4c96d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 1 -- 172.21.15.17:0/1821453135 >> 172.21.15.17:0/1821453135 conn(0x561dcb4adda0 msgr2=0x561dcb4baa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 1 -- 172.21.15.17:0/1821453135 shutdown_connections 2023-07-14T13:02:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 1 -- 172.21.15.17:0/1821453135 wait complete. 2023-07-14T13:02:48.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.417+0000 7f8867623b80 20 client.16275 trim_cache size 0 max 16384 2023-07-14T13:02:48.457 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:02:48.457 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:02:48.458 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:02:48.458 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:02:48.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.418+0000 7f8853dff700 1 -- 172.21.15.17:0/831495873 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f88380a12c0 msgr2=0x7f88380a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.418+0000 7f8853dff700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f88380a12c0 0x7f88380a3770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f884400b780 tx=0x7f88440099e0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.418+0000 7f8853dff700 1 -- 172.21.15.17:0/831495873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c1015b0 msgr2=0x7f884c19bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.418+0000 7f8853dff700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c1015b0 0x7f884c19bfa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f883c00e9f0 tx=0x7f883c00ed00 comp rx=0 tx=0).stop 2023-07-14T13:02:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.418+0000 7f8853dff700 1 -- 172.21.15.17:0/831495873 shutdown_connections 2023-07-14T13:02:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.418+0000 7f8853dff700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f88380a12c0 0x7f88380a3770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.418+0000 7f8853dff700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f884c10a070 0x7f884c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.418+0000 7f8853dff700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f884c100ca0 0x7f884c19ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.418+0000 7f8853dff700 1 --2- 172.21.15.17:0/831495873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f884c1015b0 0x7f884c19bfa0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.418+0000 7f8853dff700 1 -- 172.21.15.17:0/831495873 >> 172.21.15.17:0/831495873 conn(0x7f884c0fa4b0 msgr2=0x7f884c10c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:48.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.418+0000 7f8853dff700 1 -- 172.21.15.17:0/831495873 shutdown_connections 2023-07-14T13:02:48.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.419+0000 7f8853dff700 1 -- 172.21.15.17:0/831495873 wait complete. 2023-07-14T13:02:48.475 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:02:48.476 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:02:48.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.672+0000 7fe7ddbff700 1 -- 172.21.15.17:0/569925269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d80ffaf0 msgr2=0x7fe7d80fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.672+0000 7fe7ddbff700 1 --2- 172.21.15.17:0/569925269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d80ffaf0 0x7fe7d80fff60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009990 tx=0x7fe7cc009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.672+0000 7fe7ddbff700 1 -- 172.21.15.17:0/569925269 shutdown_connections 2023-07-14T13:02:48.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.672+0000 7fe7ddbff700 1 --2- 172.21.15.17:0/569925269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7d81004a0 0x7fe7d810c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.672+0000 7fe7ddbff700 1 --2- 172.21.15.17:0/569925269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7d8105b00 0x7fe7d8105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.672+0000 7fe7ddbff700 1 --2- 172.21.15.17:0/569925269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d80ffaf0 0x7fe7d80fff60 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.672+0000 7fe7ddbff700 1 -- 172.21.15.17:0/569925269 >> 172.21.15.17:0/569925269 conn(0x7fe7d80fb630 msgr2=0x7fe7d80fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:48.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.672+0000 7fe7ddbff700 1 -- 172.21.15.17:0/569925269 shutdown_connections 2023-07-14T13:02:48.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.672+0000 7fe7ddbff700 1 -- 172.21.15.17:0/569925269 wait complete. 2023-07-14T13:02:48.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.674+0000 7fe7ddbff700 1 Processor -- start 2023-07-14T13:02:48.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.674+0000 7fe7ddbff700 1 -- start start 2023-07-14T13:02:48.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.674+0000 7fe7ddbff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7d80ffaf0 0x7fe7d819dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.674+0000 7fe7ddbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7d81004a0 0x7fe7d819e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.674+0000 7fe7ddbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8105b00 0x7fe7d8197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.674+0000 7fe7ddbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d81981c0 con 0x7fe7d8105b00 2023-07-14T13:02:48.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.674+0000 7fe7ddbff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d8198330 con 0x7fe7d80ffaf0 2023-07-14T13:02:48.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.674+0000 7fe7ddbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d81984f0 con 0x7fe7d81004a0 2023-07-14T13:02:48.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.674+0000 7fe7d77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7d80ffaf0 0x7fe7d819dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.674+0000 7fe7d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8105b00 0x7fe7d8197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.675+0000 7fe7d77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7d80ffaf0 0x7fe7d819dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:32876/0 (socket says 172.21.15.17:32876) 2023-07-14T13:02:48.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.675+0000 7fe7d77fe700 1 -- 172.21.15.17:0/3719032316 learned_addr learned my addr 172.21.15.17:0/3719032316 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:48.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.675+0000 7fe7d6ffd700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7d81004a0 0x7fe7d819e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.675+0000 7fe7d7fff700 1 -- 172.21.15.17:0/3719032316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7d81004a0 msgr2=0x7fe7d819e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.675+0000 7fe7d7fff700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7d81004a0 0x7fe7d819e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.675+0000 7fe7d7fff700 1 -- 172.21.15.17:0/3719032316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7d80ffaf0 msgr2=0x7fe7d819dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:48.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.675+0000 7fe7d7fff700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7d80ffaf0 0x7fe7d819dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:48.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.675+0000 7fe7d7fff700 1 -- 172.21.15.17:0/3719032316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc0095f0 con 0x7fe7d8105b00 2023-07-14T13:02:48.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.675+0000 7fe7d77fe700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7d80ffaf0 0x7fe7d819dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:48.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.675+0000 7fe7d7fff700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8105b00 0x7fe7d8197b50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000efc0 tx=0x7fe7d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:48.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.676+0000 7fe7d4ff9700 1 -- 172.21.15.17:0/3719032316 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0018070 con 0x7fe7d8105b00 2023-07-14T13:02:48.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.676+0000 7fe7ddbff700 1 -- 172.21.15.17:0/3719032316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d8198770 con 0x7fe7d8105b00 2023-07-14T13:02:48.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.676+0000 7fe7d4ff9700 1 -- 172.21.15.17:0/3719032316 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7d000f040 con 0x7fe7d8105b00 2023-07-14T13:02:48.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.676+0000 7fe7d4ff9700 1 -- 172.21.15.17:0/3719032316 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d000cba0 con 0x7fe7d8105b00 2023-07-14T13:02:48.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.676+0000 7fe7ddbff700 1 -- 172.21.15.17:0/3719032316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d81a4ad0 con 0x7fe7d8105b00 2023-07-14T13:02:48.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.677+0000 7fe7ddbff700 1 -- 172.21.15.17:0/3719032316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d8067300 con 0x7fe7d8105b00 2023-07-14T13:02:48.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.680+0000 7fe7d4ff9700 1 -- 172.21.15.17:0/3719032316 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe7d0003a00 con 0x7fe7d8105b00 2023-07-14T13:02:48.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.681+0000 7fe7d4ff9700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7c00a1300 0x7fe7c00a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:48.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.681+0000 7fe7d4ff9700 1 -- 172.21.15.17:0/3719032316 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe7d00cd130 con 0x7fe7d8105b00 2023-07-14T13:02:48.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.682+0000 7fe7d77fe700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7c00a1300 0x7fe7c00a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:48.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.682+0000 7fe7d77fe700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7c00a1300 0x7fe7c00a37b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80103d0 tx=0x7fe7c8007480 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:48.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:48.684+0000 7fe7d4ff9700 1 -- 172.21.15.17:0/3719032316 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe7d0096620 con 0x7fe7d8105b00 2023-07-14T13:02:48.878 INFO:teuthology.orchestra.run.smithi017.stderr:9500000 of 50000000 tuples (19%) done (elapsed 158.48 s, remaining 675.63 s) 2023-07-14T13:02:49.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.008+0000 7fe7ddbff700 1 -- 172.21.15.17:0/3719032316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7d8198ff0 con 0x7fe7d8105b00 2023-07-14T13:02:49.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.009+0000 7fe7d4ff9700 1 -- 172.21.15.17:0/3719032316 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+10851 (secure 0 0 0) 0x7fe7d0099c40 con 0x7fe7d8105b00 2023-07-14T13:02:49.045 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:02:49.045 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:01:22.126099+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:02:49.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.012+0000 7fe7ddbff700 1 -- 172.21.15.17:0/3719032316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7c00a1300 msgr2=0x7fe7c00a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.012+0000 7fe7ddbff700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7c00a1300 0x7fe7c00a37b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80103d0 tx=0x7fe7c8007480 comp rx=0 tx=0).stop 2023-07-14T13:02:49.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.012+0000 7fe7ddbff700 1 -- 172.21.15.17:0/3719032316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8105b00 msgr2=0x7fe7d8197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.012+0000 7fe7ddbff700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8105b00 0x7fe7d8197b50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe7d000efc0 tx=0x7fe7d000c3a0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.012+0000 7fe7ddbff700 1 -- 172.21.15.17:0/3719032316 shutdown_connections 2023-07-14T13:02:49.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.012+0000 7fe7ddbff700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7c00a1300 0x7fe7c00a37b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.012+0000 7fe7ddbff700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7d8105b00 0x7fe7d8197b50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.012+0000 7fe7ddbff700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7d80ffaf0 0x7fe7d819dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.012+0000 7fe7ddbff700 1 --2- 172.21.15.17:0/3719032316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7d81004a0 0x7fe7d819e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.012+0000 7fe7ddbff700 1 -- 172.21.15.17:0/3719032316 >> 172.21.15.17:0/3719032316 conn(0x7fe7d80fb630 msgr2=0x7fe7d810ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.013+0000 7fe7ddbff700 1 -- 172.21.15.17:0/3719032316 shutdown_connections 2023-07-14T13:02:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.013+0000 7fe7ddbff700 1 -- 172.21.15.17:0/3719032316 wait complete. 2023-07-14T13:02:49.048 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2023-07-14T13:02:49.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:02:49.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.277+0000 7facba39d700 1 -- 172.21.15.17:0/954260914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb4073140 msgr2=0x7facb410bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.277+0000 7facba39d700 1 --2- 172.21.15.17:0/954260914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb4073140 0x7facb410bd70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7faca4009990 tx=0x7faca4009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.277+0000 7facba39d700 1 -- 172.21.15.17:0/954260914 shutdown_connections 2023-07-14T13:02:49.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.277+0000 7facba39d700 1 --2- 172.21.15.17:0/954260914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb410c2b0 0x7facb410e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.277+0000 7facba39d700 1 --2- 172.21.15.17:0/954260914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb4072830 0x7facb4072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.277+0000 7facba39d700 1 --2- 172.21.15.17:0/954260914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb4073140 0x7facb410bd70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.277+0000 7facba39d700 1 -- 172.21.15.17:0/954260914 >> 172.21.15.17:0/954260914 conn(0x7facb40fb4f0 msgr2=0x7facb40fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.277+0000 7facba39d700 1 -- 172.21.15.17:0/954260914 shutdown_connections 2023-07-14T13:02:49.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.277+0000 7facba39d700 1 -- 172.21.15.17:0/954260914 wait complete. 2023-07-14T13:02:49.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.278+0000 7facba39d700 1 Processor -- start 2023-07-14T13:02:49.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.278+0000 7facba39d700 1 -- start start 2023-07-14T13:02:49.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facba39d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4072830 0x7facb419d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facba39d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb4073140 0x7facb419ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facba39d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb410c2b0 0x7facb41978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facba39d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb4197f50 con 0x7facb410c2b0 2023-07-14T13:02:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facba39d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb41980c0 con 0x7facb4073140 2023-07-14T13:02:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facba39d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb4198280 con 0x7facb4072830 2023-07-14T13:02:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facb9b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb410c2b0 0x7facb41978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facb9b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb410c2b0 0x7facb41978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44960/0 (socket says 172.21.15.17:44960) 2023-07-14T13:02:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facb9b9c700 1 -- 172.21.15.17:0/1723618457 learned_addr learned my addr 172.21.15.17:0/1723618457 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facb8b9a700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb4073140 0x7facb419ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facb939b700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4072830 0x7facb419d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facb9b9c700 1 -- 172.21.15.17:0/1723618457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4072830 msgr2=0x7facb419d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facb9b9c700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4072830 0x7facb419d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facb9b9c700 1 -- 172.21.15.17:0/1723618457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb4073140 msgr2=0x7facb419ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facb9b9c700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb4073140 0x7facb419ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.279+0000 7facb9b9c700 1 -- 172.21.15.17:0/1723618457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40095f0 con 0x7facb410c2b0 2023-07-14T13:02:49.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.280+0000 7facb9b9c700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb410c2b0 0x7facb41978e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7facac007ee0 tx=0x7facac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.280+0000 7facaa7fc700 1 -- 172.21.15.17:0/1723618457 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac017070 con 0x7facb410c2b0 2023-07-14T13:02:49.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.280+0000 7facba39d700 1 -- 172.21.15.17:0/1723618457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb4198560 con 0x7facb410c2b0 2023-07-14T13:02:49.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.280+0000 7facaa7fc700 1 -- 172.21.15.17:0/1723618457 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facac00f040 con 0x7facb410c2b0 2023-07-14T13:02:49.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.280+0000 7facaa7fc700 1 -- 172.21.15.17:0/1723618457 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac005570 con 0x7facb410c2b0 2023-07-14T13:02:49.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.280+0000 7facba39d700 1 -- 172.21.15.17:0/1723618457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb41a4860 con 0x7facb410c2b0 2023-07-14T13:02:49.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.285+0000 7facaa7fc700 1 -- 172.21.15.17:0/1723618457 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7facac00db20 con 0x7facb410c2b0 2023-07-14T13:02:49.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.285+0000 7faccf002b80 1 Processor -- start 2023-07-14T13:02:49.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.286+0000 7faccf002b80 1 -- start start 2023-07-14T13:02:49.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.286+0000 7faccf002b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c444f0 0x55ddd0c448c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.286+0000 7faccf002b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c4e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.286+0000 7faccf002b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c51110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.286+0000 7faccf002b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0b49cb0 con 0x55ddd0c44e00 2023-07-14T13:02:49.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.286+0000 7faccf002b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0b9ca40 con 0x55ddd0c4ed30 2023-07-14T13:02:49.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.286+0000 7faccf002b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0b95ed0 con 0x55ddd0c444f0 2023-07-14T13:02:49.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.286+0000 7facb939b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c4e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facb939b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c4e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44970/0 (socket says 172.21.15.17:44970) 2023-07-14T13:02:49.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facb939b700 1 -- 172.21.15.17:0/3164871335 learned_addr learned my addr 172.21.15.17:0/3164871335 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facb8b9a700 1 --2- 172.21.15.17:0/3164871335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c51110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facb8b9a700 1 --2- 172.21.15.17:0/3164871335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c444f0 0x55ddd0c448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facaa7fc700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faca00a13e0 0x7faca00a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facb939b700 1 -- 172.21.15.17:0/3164871335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c444f0 msgr2=0x55ddd0c448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facb939b700 1 --2- 172.21.15.17:0/3164871335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c444f0 0x55ddd0c448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facb939b700 1 -- 172.21.15.17:0/3164871335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c4ed30 msgr2=0x55ddd0c51110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facb939b700 1 --2- 172.21.15.17:0/3164871335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c51110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facb939b700 1 -- 172.21.15.17:0/3164871335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddd09c3de0 con 0x55ddd0c44e00 2023-07-14T13:02:49.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facaa7fc700 1 -- 172.21.15.17:0/1723618457 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7facac0cc370 con 0x7facb410c2b0 2023-07-14T13:02:49.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.287+0000 7facb9b9c700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faca00a13e0 0x7faca00a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.288+0000 7facb939b700 1 --2- 172.21.15.17:0/3164871335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c4e7f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7facb0009d80 tx=0x7facb0011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d71c7db7c37300 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.288+0000 7fac9f7fe700 1 -- 172.21.15.17:0/3164871335 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0004230 con 0x55ddd0c44e00 2023-07-14T13:02:49.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.288+0000 7fac9f7fe700 1 -- 172.21.15.17:0/3164871335 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facb0004390 con 0x55ddd0c44e00 2023-07-14T13:02:49.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.288+0000 7fac9f7fe700 1 -- 172.21.15.17:0/3164871335 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0019790 con 0x55ddd0c44e00 2023-07-14T13:02:49.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.289+0000 7faccf002b80 1 -- 172.21.15.17:0/3164871335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 msgr2=0x55ddd0c4e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.289+0000 7faccf002b80 1 --2- 172.21.15.17:0/3164871335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c4e7f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7facb0009d80 tx=0x7facb0011720 comp rx=0 tx=0).stop 2023-07-14T13:02:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.289+0000 7facb9b9c700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faca00a13e0 0x7faca00a3890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7facac0a1370 tx=0x7facac007f10 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.289+0000 7faccf002b80 1 -- 172.21.15.17:0/3164871335 shutdown_connections 2023-07-14T13:02:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.289+0000 7faccf002b80 1 --2- 172.21.15.17:0/3164871335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c51110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.289+0000 7faccf002b80 1 --2- 172.21.15.17:0/3164871335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c444f0 0x55ddd0c448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.289+0000 7faccf002b80 1 --2- 172.21.15.17:0/3164871335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c4e7f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.289+0000 7faccf002b80 1 -- 172.21.15.17:0/3164871335 >> 172.21.15.17:0/3164871335 conn(0x55ddd0c39ff0 msgr2=0x55ddd0c3f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.289+0000 7faccf002b80 1 -- 172.21.15.17:0/3164871335 shutdown_connections 2023-07-14T13:02:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.289+0000 7faccf002b80 1 -- 172.21.15.17:0/3164871335 wait complete. 2023-07-14T13:02:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.290+0000 7faccf002b80 1 -- start start 2023-07-14T13:02:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.290+0000 7faccf002b80 1 Processor -- start 2023-07-14T13:02:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7faccf002b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0c4e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7faccf002b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c44e00 0x55ddd0c4b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7faccf002b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c4bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7faccf002b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0b35ac0 con 0x55ddd0c4ed30 2023-07-14T13:02:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7faccf002b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0b357c0 con 0x55ddd0c444f0 2023-07-14T13:02:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7faccf002b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0a19920 con 0x55ddd0c44e00 2023-07-14T13:02:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7faccf002b80 10 client.0 _ll_register_callbacks cb 0x55ddd0b33760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7facb8b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0c4e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7facb8b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c4bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7facb8b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0c4e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:32902/0 (socket says 172.21.15.17:32902) 2023-07-14T13:02:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7facb939b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c44e00 0x55ddd0c4b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.291+0000 7facb8b9a700 1 -- 172.21.15.17:0/1978703012 learned_addr learned my addr 172.21.15.17:0/1978703012 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.292+0000 7facb8b9a700 1 -- 172.21.15.17:0/1978703012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c44e00 msgr2=0x55ddd0c4b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.292+0000 7facb8b9a700 1 --2- 172.21.15.17:0/1978703012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c44e00 0x55ddd0c4b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.292+0000 7facb8b9a700 1 -- 172.21.15.17:0/1978703012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c4ed30 msgr2=0x55ddd0c4bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.292+0000 7facb8b9a700 1 --2- 172.21.15.17:0/1978703012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c4bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.292+0000 7facb8b9a700 1 -- 172.21.15.17:0/1978703012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb00099e0 con 0x55ddd0c444f0 2023-07-14T13:02:49.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.292+0000 7facb8b9a700 1 --2- 172.21.15.17:0/1978703012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0c4e660 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faca4000c00 tx=0x7faca4009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad572157b15a03 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.292+0000 7fac9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:02:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.292+0000 7fac9cff9700 1 -- 172.21.15.17:0/1978703012 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca402b9e0 con 0x55ddd0c444f0 2023-07-14T13:02:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.292+0000 7faccf002b80 1 -- 172.21.15.17:0/1978703012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ddd0aef4f0 con 0x55ddd0c444f0 2023-07-14T13:02:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.292+0000 7fac9cff9700 1 -- 172.21.15.17:0/1978703012 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7faca402bb40 con 0x55ddd0c444f0 2023-07-14T13:02:49.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.293+0000 7fac9cff9700 1 -- 172.21.15.17:0/1978703012 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7faca402bd00 con 0x55ddd0c444f0 2023-07-14T13:02:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.293+0000 7faccf002b80 10 client.26036 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.293+0000 7faccf002b80 1 -- 172.21.15.17:0/1978703012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ddd09acc60 con 0x55ddd0c444f0 2023-07-14T13:02:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.293+0000 7fac9cff9700 1 -- 172.21.15.17:0/1978703012 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ddd0aef4f0 con 0x55ddd0c444f0 2023-07-14T13:02:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.293+0000 7fac9cff9700 1 -- 172.21.15.17:0/1978703012 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7faca400fd20 con 0x55ddd0c444f0 2023-07-14T13:02:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.293+0000 7faccf002b80 10 client.26036 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.293+0000 7faccf002b80 10 client.26036 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:02:49.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.293+0000 7faccf002b80 20 client.26036 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:49.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.293+0000 7faccf002b80 1 --2- 172.21.15.17:0/1978703012 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55ddd0c5e6e0 0x55ddd0c60af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.293+0000 7faccf002b80 4 client.26036 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:49.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.293+0000 7faccf002b80 1 -- 172.21.15.17:0/1978703012 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ddd0b8eeb0 con 0x55ddd0c5e6e0 2023-07-14T13:02:49.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.294+0000 7facb939b700 1 --2- 172.21.15.17:0/1978703012 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55ddd0c5e6e0 0x55ddd0c60af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.294+0000 7facb939b700 1 --2- 172.21.15.17:0/1978703012 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55ddd0c5e6e0 0x55ddd0c60af0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e98674f3ceba2a8f server_cookie=d1ac19ff2d106845 in_seq=0 out_seq=0 2023-07-14T13:02:49.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.294+0000 7fac9cff9700 10 client.26036 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:02:49.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.295+0000 7fac9cff9700 1 -- 172.21.15.17:0/1978703012 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ddd0b8eeb0 con 0x55ddd0c5e6e0 2023-07-14T13:02:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.295+0000 7fac9cff9700 10 client.26036 handle_command_reply: tid=0 2023-07-14T13:02:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.295+0000 7faccf002b80 1 client.26036 shutdown 2023-07-14T13:02:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.295+0000 7faccf002b80 1 -- 172.21.15.17:0/1978703012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 msgr2=0x55ddd0c4e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.295+0000 7faccf002b80 1 --2- 172.21.15.17:0/1978703012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0c4e660 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faca4000c00 tx=0x7faca4009310 comp rx=0 tx=0).stop 2023-07-14T13:02:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.296+0000 7faccf002b80 1 -- 172.21.15.17:0/1978703012 shutdown_connections 2023-07-14T13:02:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.296+0000 7faccf002b80 1 --2- 172.21.15.17:0/1978703012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c4bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.296+0000 7faccf002b80 1 --2- 172.21.15.17:0/1978703012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0c4e660 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.296+0000 7faccf002b80 1 --2- 172.21.15.17:0/1978703012 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55ddd0c5e6e0 0x55ddd0c60af0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.296+0000 7faccf002b80 1 --2- 172.21.15.17:0/1978703012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c44e00 0x55ddd0c4b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.296+0000 7faccf002b80 1 -- 172.21.15.17:0/1978703012 >> 172.21.15.17:0/1978703012 conn(0x55ddd0c39ff0 msgr2=0x55ddd0c3f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.296+0000 7fac9cff9700 0 client.26036 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:02:49.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.296+0000 7faccf002b80 1 -- 172.21.15.17:0/1978703012 shutdown_connections 2023-07-14T13:02:49.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.296+0000 7faccf002b80 1 -- 172.21.15.17:0/1978703012 wait complete. 2023-07-14T13:02:49.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.296+0000 7faccf002b80 20 client.26036 trim_cache size 0 max 16384 2023-07-14T13:02:49.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.318+0000 7faccf002b80 1 Processor -- start 2023-07-14T13:02:49.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.318+0000 7faccf002b80 1 -- start start 2023-07-14T13:02:49.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.318+0000 7faccf002b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0c55810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.318+0000 7faccf002b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c5a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.318+0000 7faccf002b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c4e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.318+0000 7faccf002b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0c4c940 con 0x55ddd0c44e00 2023-07-14T13:02:49.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.318+0000 7faccf002b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0c45240 con 0x55ddd0c444f0 2023-07-14T13:02:49.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.318+0000 7faccf002b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0c4cec0 con 0x55ddd0c4ed30 2023-07-14T13:02:49.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.318+0000 7facb939b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c5a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.318+0000 7facb939b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c5a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44974/0 (socket says 172.21.15.17:44974) 2023-07-14T13:02:49.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.318+0000 7facb939b700 1 -- 172.21.15.17:0/3385428234 learned_addr learned my addr 172.21.15.17:0/3385428234 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.319+0000 7facb8b9a700 1 --2- 172.21.15.17:0/3385428234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0c55810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.319+0000 7facb8b9a700 1 --2- 172.21.15.17:0/3385428234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c4e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.319+0000 7facb939b700 1 -- 172.21.15.17:0/3385428234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c4ed30 msgr2=0x55ddd0c4e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.319+0000 7facb939b700 1 --2- 172.21.15.17:0/3385428234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c4e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.319+0000 7facb939b700 1 -- 172.21.15.17:0/3385428234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 msgr2=0x55ddd0c55810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.319+0000 7facb939b700 1 --2- 172.21.15.17:0/3385428234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0c55810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.319+0000 7facb939b700 1 -- 172.21.15.17:0/3385428234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddd09ea250 con 0x55ddd0c44e00 2023-07-14T13:02:49.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.319+0000 7facb939b700 1 --2- 172.21.15.17:0/3385428234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c5a980 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7facb0000c00 tx=0x7facb0005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ca036de2269ec6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.320+0000 7fac9ffff700 1 -- 172.21.15.17:0/3385428234 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0029070 con 0x55ddd0c44e00 2023-07-14T13:02:49.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.320+0000 7fac9ffff700 1 -- 172.21.15.17:0/3385428234 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facb002e070 con 0x55ddd0c44e00 2023-07-14T13:02:49.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.320+0000 7fac9ffff700 1 -- 172.21.15.17:0/3385428234 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0005040 con 0x55ddd0c44e00 2023-07-14T13:02:49.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.320+0000 7faccf002b80 1 -- 172.21.15.17:0/3385428234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 msgr2=0x55ddd0c5a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.320+0000 7faccf002b80 1 --2- 172.21.15.17:0/3385428234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c5a980 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7facb0000c00 tx=0x7facb0005fa0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.321+0000 7faccf002b80 1 -- 172.21.15.17:0/3385428234 shutdown_connections 2023-07-14T13:02:49.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.321+0000 7faccf002b80 1 --2- 172.21.15.17:0/3385428234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c4ed30 0x55ddd0c4e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.321+0000 7faccf002b80 1 --2- 172.21.15.17:0/3385428234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0c55810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.321+0000 7faccf002b80 1 --2- 172.21.15.17:0/3385428234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0c5a980 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.321+0000 7faccf002b80 1 -- 172.21.15.17:0/3385428234 >> 172.21.15.17:0/3385428234 conn(0x55ddd0c39ff0 msgr2=0x55ddd0c3e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.321+0000 7faccf002b80 1 -- 172.21.15.17:0/3385428234 shutdown_connections 2023-07-14T13:02:49.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.321+0000 7faccf002b80 1 -- 172.21.15.17:0/3385428234 wait complete. 2023-07-14T13:02:49.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.321+0000 7faccf002b80 1 -- start start 2023-07-14T13:02:49.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.321+0000 7faccf002b80 1 Processor -- start 2023-07-14T13:02:49.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7faccf002b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0cab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7faccf002b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0cabd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7faccf002b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c4ed30 0x55ddd0caa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7faccf002b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0caaae0 con 0x55ddd0c44e00 2023-07-14T13:02:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7faccf002b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0caac50 con 0x55ddd0c444f0 2023-07-14T13:02:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7faccf002b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd0caae10 con 0x55ddd0c4ed30 2023-07-14T13:02:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7faccf002b80 10 client.0 _ll_register_callbacks cb 0x55ddd0b33760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7facb939b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0cabd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7facb8b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0cab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7facb939b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0cabd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44990/0 (socket says 172.21.15.17:44990) 2023-07-14T13:02:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7facb8b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0cab7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:32924/0 (socket says 172.21.15.17:32924) 2023-07-14T13:02:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7facb939b700 1 -- 172.21.15.17:0/2594318731 learned_addr learned my addr 172.21.15.17:0/2594318731 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.322+0000 7facb8b9a700 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c4ed30 0x55ddd0caa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.323+0000 7facb939b700 1 -- 172.21.15.17:0/2594318731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c4ed30 msgr2=0x55ddd0caa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.323+0000 7facb939b700 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c4ed30 0x55ddd0caa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.323+0000 7facb939b700 1 -- 172.21.15.17:0/2594318731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 msgr2=0x55ddd0cab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.323+0000 7facb939b700 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0cab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.323+0000 7facb939b700 1 -- 172.21.15.17:0/2594318731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddd09c3de0 con 0x55ddd0c44e00 2023-07-14T13:02:49.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.323+0000 7facb8b9a700 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0cab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:49.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.323+0000 7facb939b700 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0cabd20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7facb0009340 tx=0x7facb0005180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e31513336dcaa9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.323+0000 7fac9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:49.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7fac9cff9700 1 -- 172.21.15.17:0/2594318731 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0029040 con 0x55ddd0c44e00 2023-07-14T13:02:49.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7faccf002b80 1 -- 172.21.15.17:0/2594318731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7facb0004390 con 0x55ddd0c44e00 2023-07-14T13:02:49.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7fac9cff9700 1 -- 172.21.15.17:0/2594318731 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7facb0005570 con 0x55ddd0c44e00 2023-07-14T13:02:49.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7fac9cff9700 1 -- 172.21.15.17:0/2594318731 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7facb0004500 con 0x55ddd0c44e00 2023-07-14T13:02:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7faccf002b80 10 client.16299 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7faccf002b80 1 -- 172.21.15.17:0/2594318731 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ddd09c22b0 con 0x55ddd0c44e00 2023-07-14T13:02:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7fac9cff9700 1 -- 172.21.15.17:0/2594318731 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facb0004390 con 0x55ddd0c44e00 2023-07-14T13:02:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7fac9cff9700 1 -- 172.21.15.17:0/2594318731 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7facb0011440 con 0x55ddd0c44e00 2023-07-14T13:02:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7faccf002b80 10 client.16299 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7faccf002b80 10 client.16299 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:02:49.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7faccf002b80 20 client.16299 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.324+0000 7faccf002b80 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55ddd0cb3470 0x55ddd0cb5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.325+0000 7faccf002b80 4 client.16299 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:02:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.325+0000 7faccf002b80 1 -- 172.21.15.17:0/2594318731 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ddd0b51050 con 0x55ddd0cb3470 2023-07-14T13:02:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.325+0000 7facb8b9a700 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55ddd0cb3470 0x55ddd0cb5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7facb8b9a700 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55ddd0cb3470 0x55ddd0cb5880 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b4a4b20f7ebc2d77 server_cookie=ba76f050435d753a in_seq=0 out_seq=0 2023-07-14T13:02:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7fac9cff9700 10 client.16299 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:02:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7fac9cff9700 1 -- 172.21.15.17:0/2594318731 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ddd0b51050 con 0x55ddd0cb3470 2023-07-14T13:02:49.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7fac9cff9700 10 client.16299 handle_command_reply: tid=0 2023-07-14T13:02:49.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7faccf002b80 1 client.16299 shutdown 2023-07-14T13:02:49.364 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:49 smithi017 ceph-mon[95536]: pgmap v95: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:02:49.364 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:49 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3719032316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:02:49.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7faccf002b80 1 -- 172.21.15.17:0/2594318731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 msgr2=0x55ddd0cabd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7faccf002b80 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0cabd20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7facb0009340 tx=0x7facb0005180 comp rx=0 tx=0).stop 2023-07-14T13:02:49.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7faccf002b80 1 -- 172.21.15.17:0/2594318731 shutdown_connections 2023-07-14T13:02:49.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7faccf002b80 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55ddd0cb3470 0x55ddd0cb5880 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7faccf002b80 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ddd0c4ed30 0x55ddd0caa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7faccf002b80 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ddd0c444f0 0x55ddd0cab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7fac9cff9700 0 client.16299 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:02:49.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7faccf002b80 1 --2- 172.21.15.17:0/2594318731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ddd0c44e00 0x55ddd0cabd20 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.326+0000 7faccf002b80 1 -- 172.21.15.17:0/2594318731 >> 172.21.15.17:0/2594318731 conn(0x55ddd0c39ff0 msgr2=0x55ddd0c46cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.327+0000 7faccf002b80 1 -- 172.21.15.17:0/2594318731 shutdown_connections 2023-07-14T13:02:49.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.327+0000 7faccf002b80 1 -- 172.21.15.17:0/2594318731 wait complete. 2023-07-14T13:02:49.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.327+0000 7faccf002b80 20 client.16299 trim_cache size 0 max 16384 2023-07-14T13:02:49.367 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:02:49.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.327+0000 7facba39d700 1 -- 172.21.15.17:0/1723618457 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faca00a13e0 msgr2=0x7faca00a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.327+0000 7facba39d700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faca00a13e0 0x7faca00a3890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7facac0a1370 tx=0x7facac007f10 comp rx=0 tx=0).stop 2023-07-14T13:02:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.327+0000 7facba39d700 1 -- 172.21.15.17:0/1723618457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb410c2b0 msgr2=0x7facb41978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.327+0000 7facba39d700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb410c2b0 0x7facb41978e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7facac007ee0 tx=0x7facac00d3b0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.327+0000 7facba39d700 1 -- 172.21.15.17:0/1723618457 shutdown_connections 2023-07-14T13:02:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.327+0000 7facba39d700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faca00a13e0 0x7faca00a3890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.328+0000 7facba39d700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facb410c2b0 0x7facb41978e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.328+0000 7facba39d700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb4072830 0x7facb419d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.328+0000 7facba39d700 1 --2- 172.21.15.17:0/1723618457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facb4073140 0x7facb419ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.328+0000 7facba39d700 1 -- 172.21.15.17:0/1723618457 >> 172.21.15.17:0/1723618457 conn(0x7facb40fb4f0 msgr2=0x7facb4103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.328+0000 7facba39d700 1 -- 172.21.15.17:0/1723618457 shutdown_connections 2023-07-14T13:02:49.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.328+0000 7facba39d700 1 -- 172.21.15.17:0/1723618457 wait complete. 2023-07-14T13:02:49.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:02:49.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:49 smithi135 ceph-mon[97338]: pgmap v95: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:02:49.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:49 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3719032316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:02:49.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:49 smithi131 ceph-mon[96953]: pgmap v95: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:02:49.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:49 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3719032316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:02:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.587+0000 7fe7c9dff700 1 -- 172.21.15.17:0/1241289661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c40ffad0 msgr2=0x7fe7c40fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.587+0000 7fe7c9dff700 1 --2- 172.21.15.17:0/1241289661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c40ffad0 0x7fe7c40fff40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009990 tx=0x7fe7b8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.587+0000 7fe7c9dff700 1 -- 172.21.15.17:0/1241289661 shutdown_connections 2023-07-14T13:02:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.587+0000 7fe7c9dff700 1 --2- 172.21.15.17:0/1241289661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c4100480 0x7fe7c410c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.587+0000 7fe7c9dff700 1 --2- 172.21.15.17:0/1241289661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c4105ae0 0x7fe7c4105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.587+0000 7fe7c9dff700 1 --2- 172.21.15.17:0/1241289661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c40ffad0 0x7fe7c40fff40 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.587+0000 7fe7c9dff700 1 -- 172.21.15.17:0/1241289661 >> 172.21.15.17:0/1241289661 conn(0x7fe7c40fb5f0 msgr2=0x7fe7c40fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.587+0000 7fe7c9dff700 1 -- 172.21.15.17:0/1241289661 shutdown_connections 2023-07-14T13:02:49.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.587+0000 7fe7c9dff700 1 -- 172.21.15.17:0/1241289661 wait complete. 2023-07-14T13:02:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.588+0000 7fe7c9dff700 1 Processor -- start 2023-07-14T13:02:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.588+0000 7fe7c9dff700 1 -- start start 2023-07-14T13:02:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.589+0000 7fe7c9dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c40ffad0 0x7fe7c419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.589+0000 7fe7c9dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c4100480 0x7fe7c419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.589+0000 7fe7c9dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c4105ae0 0x7fe7c4195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.589+0000 7fe7c9dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c4195f70 con 0x7fe7c4105ae0 2023-07-14T13:02:49.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.589+0000 7fe7c9dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c41960e0 con 0x7fe7c4100480 2023-07-14T13:02:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.589+0000 7fe7c9dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c41962a0 con 0x7fe7c40ffad0 2023-07-14T13:02:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.589+0000 7fe7c2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c4100480 0x7fe7c419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.589+0000 7fe7c3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c4105ae0 0x7fe7c4195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.589+0000 7fe7c2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c4100480 0x7fe7c419bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:32950/0 (socket says 172.21.15.17:32950) 2023-07-14T13:02:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.589+0000 7fe7c2ffd700 1 -- 172.21.15.17:0/3843753910 learned_addr learned my addr 172.21.15.17:0/3843753910 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.589+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c40ffad0 0x7fe7c419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c3fff700 1 -- 172.21.15.17:0/3843753910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c40ffad0 msgr2=0x7fe7c419b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c3fff700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c40ffad0 0x7fe7c419b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c3fff700 1 -- 172.21.15.17:0/3843753910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c4100480 msgr2=0x7fe7c419bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c3fff700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c4100480 0x7fe7c419bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c3fff700 1 -- 172.21.15.17:0/3843753910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b80095f0 con 0x7fe7c4105ae0 2023-07-14T13:02:49.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c4100480 0x7fe7c419bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c3fff700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c4105ae0 0x7fe7c4195900 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc007f10 tx=0x7fe7bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c0ff9700 1 -- 172.21.15.17:0/3843753910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc004db0 con 0x7fe7c4105ae0 2023-07-14T13:02:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c9dff700 1 -- 172.21.15.17:0/3843753910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c4196580 con 0x7fe7c4105ae0 2023-07-14T13:02:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c0ff9700 1 -- 172.21.15.17:0/3843753910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7bc00f040 con 0x7fe7c4105ae0 2023-07-14T13:02:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c0ff9700 1 -- 172.21.15.17:0/3843753910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc005960 con 0x7fe7c4105ae0 2023-07-14T13:02:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.590+0000 7fe7c9dff700 1 -- 172.21.15.17:0/3843753910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c41a2880 con 0x7fe7c4105ae0 2023-07-14T13:02:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.594+0000 7fe7c0ff9700 1 -- 172.21.15.17:0/3843753910 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe7bc00db20 con 0x7fe7c4105ae0 2023-07-14T13:02:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.595+0000 7fe7dd670b80 1 Processor -- start 2023-07-14T13:02:49.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.596+0000 7fe7dd670b80 1 -- start start 2023-07-14T13:02:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.596+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb23052d0 0x558cb23056a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.596+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2305be0 0x558cb23149a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.596+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 0x558cb23172c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.596+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb220bcb0 con 0x558cb23052d0 2023-07-14T13:02:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.596+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb225ea40 con 0x558cb2305be0 2023-07-14T13:02:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.596+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb2257ed0 con 0x558cb2314ee0 2023-07-14T13:02:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.596+0000 7fe7c2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb23052d0 0x558cb23056a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.596+0000 7fe7c2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb23052d0 0x558cb23056a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45016/0 (socket says 172.21.15.17:45016) 2023-07-14T13:02:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.596+0000 7fe7c2ffd700 1 -- 172.21.15.17:0/2011327423 learned_addr learned my addr 172.21.15.17:0/2011327423 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c0ff9700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7ac0a12c0 0x7fe7ac0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/2011327423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2305be0 0x558cb23149a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c0ff9700 1 -- 172.21.15.17:0/3843753910 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe7bc0cc5d0 con 0x7fe7c4105ae0 2023-07-14T13:02:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/2011327423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 0x558cb23172c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c37fe700 1 -- 172.21.15.17:0/2011327423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 msgr2=0x558cb23172c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/2011327423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 0x558cb23172c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c37fe700 1 -- 172.21.15.17:0/2011327423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb23052d0 msgr2=0x558cb23056a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/2011327423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb23052d0 0x558cb23056a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c37fe700 1 -- 172.21.15.17:0/2011327423 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cb2085de0 con 0x558cb2305be0 2023-07-14T13:02:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/2011327423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 0x558cb23172c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:02:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c3fff700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7ac0a12c0 0x7fe7ac0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.597+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/2011327423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2305be0 0x558cb23149a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4007b90 tx=0x7fe7b4007ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5adef7985d27ff64 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.598+0000 7fe7a9ffb700 1 -- 172.21.15.17:0/2011327423 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4004310 con 0x558cb2305be0 2023-07-14T13:02:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.598+0000 7fe7c3fff700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7ac0a12c0 0x7fe7ac0a3770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc007fd0 tx=0x7fe7bc004ad0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.598+0000 7fe7a9ffb700 1 -- 172.21.15.17:0/2011327423 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7b4010e10 con 0x558cb2305be0 2023-07-14T13:02:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.598+0000 7fe7a9ffb700 1 -- 172.21.15.17:0/2011327423 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4004e60 con 0x558cb2305be0 2023-07-14T13:02:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.598+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2011327423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2305be0 msgr2=0x558cb23149a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.598+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/2011327423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2305be0 0x558cb23149a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4007b90 tx=0x7fe7b4007ea0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.599+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2011327423 shutdown_connections 2023-07-14T13:02:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.599+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/2011327423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 0x558cb23172c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.599+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/2011327423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb23052d0 0x558cb23056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.599+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/2011327423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2305be0 0x558cb23149a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.599+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2011327423 >> 172.21.15.17:0/2011327423 conn(0x558cb22fbda0 msgr2=0x558cb23016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.599+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2011327423 shutdown_connections 2023-07-14T13:02:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.599+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2011327423 wait complete. 2023-07-14T13:02:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.599+0000 7fe7dd670b80 1 -- start start 2023-07-14T13:02:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.599+0000 7fe7dd670b80 1 Processor -- start 2023-07-14T13:02:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.600+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb23052d0 0x558cb23148d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.600+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2311b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.600+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 0x558cb23121d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.600+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb21f7ac0 con 0x558cb2305be0 2023-07-14T13:02:49.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.600+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb21f77c0 con 0x558cb23052d0 2023-07-14T13:02:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.600+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb20db920 con 0x558cb2314ee0 2023-07-14T13:02:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.600+0000 7fe7dd670b80 10 client.0 _ll_register_callbacks cb 0x558cb21f5760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.600+0000 7fe7c37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2311b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.600+0000 7fe7c37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2311b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45026/0 (socket says 172.21.15.17:45026) 2023-07-14T13:02:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.600+0000 7fe7c37fe700 1 -- 172.21.15.17:0/346906768 learned_addr learned my addr 172.21.15.17:0/346906768 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.601+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb23052d0 0x558cb23148d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.601+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 0x558cb23121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.601+0000 7fe7c37fe700 1 -- 172.21.15.17:0/346906768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 msgr2=0x558cb23121d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.601+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 0x558cb23121d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.601+0000 7fe7c37fe700 1 -- 172.21.15.17:0/346906768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb23052d0 msgr2=0x558cb23148d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.601+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb23052d0 0x558cb23148d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.601+0000 7fe7c37fe700 1 -- 172.21.15.17:0/346906768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b40077c0 con 0x558cb2305be0 2023-07-14T13:02:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.601+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 0x558cb23121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:02:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.601+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2311b50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4005fa0 tx=0x7fe7b4010bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d30223411833b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.601+0000 7fe7a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.602+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/346906768 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b401f070 con 0x558cb2305be0 2023-07-14T13:02:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.602+0000 7fe7dd670b80 1 -- 172.21.15.17:0/346906768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558cb21b14f0 con 0x558cb2305be0 2023-07-14T13:02:49.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.602+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/346906768 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe7b4004320 con 0x558cb2305be0 2023-07-14T13:02:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.602+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/346906768 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7b40044e0 con 0x558cb2305be0 2023-07-14T13:02:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.602+0000 7fe7dd670b80 10 client.16311 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:49.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.602+0000 7fe7dd670b80 1 -- 172.21.15.17:0/346906768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x558cb206ec60 con 0x558cb2305be0 2023-07-14T13:02:49.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.602+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/346906768 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558cb21b14f0 con 0x558cb2305be0 2023-07-14T13:02:49.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.602+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/346906768 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe7b40114d0 con 0x558cb2305be0 2023-07-14T13:02:49.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.602+0000 7fe7dd670b80 10 client.16311 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:49.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.602+0000 7fe7dd670b80 10 client.16311 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:02:49.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.602+0000 7fe7dd670b80 20 client.16311 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:49.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.603+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x558cb2324730 0x558cb2326b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.603+0000 7fe7dd670b80 4 client.16311 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.603+0000 7fe7dd670b80 1 -- 172.21.15.17:0/346906768 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558cb2250eb0 con 0x558cb2324730 2023-07-14T13:02:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.603+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x558cb2324730 0x558cb2326b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.604+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x558cb2324730 0x558cb2326b40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98748ce7b5d029e server_cookie=d8a0d64aec29c160 in_seq=0 out_seq=0 2023-07-14T13:02:49.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.604+0000 7fe7a2ffd700 10 client.16311 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:02:49.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.604+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/346906768 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558cb2250eb0 con 0x558cb2324730 2023-07-14T13:02:49.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.604+0000 7fe7a2ffd700 10 client.16311 handle_command_reply: tid=0 2023-07-14T13:02:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.604+0000 7fe7dd670b80 1 client.16311 shutdown 2023-07-14T13:02:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7dd670b80 1 -- 172.21.15.17:0/346906768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 msgr2=0x558cb2311b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2311b50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4005fa0 tx=0x7fe7b4010bb0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7dd670b80 1 -- 172.21.15.17:0/346906768 shutdown_connections 2023-07-14T13:02:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb2314ee0 0x558cb23121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x558cb2324730 0x558cb2326b40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb23052d0 0x558cb23148d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/346906768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2311b50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7a2ffd700 0 client.16311 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:02:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7dd670b80 1 -- 172.21.15.17:0/346906768 >> 172.21.15.17:0/346906768 conn(0x558cb22fbda0 msgr2=0x558cb2301290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7dd670b80 1 -- 172.21.15.17:0/346906768 shutdown_connections 2023-07-14T13:02:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7dd670b80 1 -- 172.21.15.17:0/346906768 wait complete. 2023-07-14T13:02:49.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.605+0000 7fe7dd670b80 20 client.16311 trim_cache size 0 max 16384 2023-07-14T13:02:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.620+0000 7fe7dd670b80 1 Processor -- start 2023-07-14T13:02:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.620+0000 7fe7dd670b80 1 -- start start 2023-07-14T13:02:49.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.621+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb23172c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.621+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2305be0 0x558cb2311310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.621+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2314ee0 0x558cb2320af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.621+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb2313130 con 0x558cb2314ee0 2023-07-14T13:02:49.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.621+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb23100b0 con 0x558cb2305be0 2023-07-14T13:02:49.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.621+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb23271a0 con 0x558cb23052d0 2023-07-14T13:02:49.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.621+0000 7fe7c2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2314ee0 0x558cb2320af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.621+0000 7fe7c2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb23172c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.621+0000 7fe7c2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb23172c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60720/0 (socket says 172.21.15.17:60720) 2023-07-14T13:02:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.621+0000 7fe7c2ffd700 1 -- 172.21.15.17:0/3640128663 learned_addr learned my addr 172.21.15.17:0/3640128663 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.621+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/3640128663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2305be0 0x558cb2311310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.622+0000 7fe7c2ffd700 1 -- 172.21.15.17:0/3640128663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2305be0 msgr2=0x558cb2311310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.622+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/3640128663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2305be0 0x558cb2311310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.622+0000 7fe7c2ffd700 1 -- 172.21.15.17:0/3640128663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2314ee0 msgr2=0x558cb2320af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.622+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/3640128663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2314ee0 0x558cb2320af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.622+0000 7fe7c2ffd700 1 -- 172.21.15.17:0/3640128663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cb20ac250 con 0x558cb23052d0 2023-07-14T13:02:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.622+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/3640128663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb23172c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80098e0 tx=0x7fe7b801a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fff9b5e8c66f620 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.622+0000 7fe7aa7fc700 1 -- 172.21.15.17:0/3640128663 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b801d040 con 0x558cb23052d0 2023-07-14T13:02:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.622+0000 7fe7aa7fc700 1 -- 172.21.15.17:0/3640128663 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7b8005730 con 0x558cb23052d0 2023-07-14T13:02:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.622+0000 7fe7aa7fc700 1 -- 172.21.15.17:0/3640128663 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b802e4d0 con 0x558cb23052d0 2023-07-14T13:02:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.623+0000 7fe7dd670b80 1 -- 172.21.15.17:0/3640128663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 msgr2=0x558cb23172c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.623+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/3640128663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb23172c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80098e0 tx=0x7fe7b801a040 comp rx=0 tx=0).stop 2023-07-14T13:02:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.623+0000 7fe7dd670b80 1 -- 172.21.15.17:0/3640128663 shutdown_connections 2023-07-14T13:02:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.623+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/3640128663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2314ee0 0x558cb2320af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.623+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/3640128663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb23172c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.623+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/3640128663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2305be0 0x558cb2311310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.623+0000 7fe7dd670b80 1 -- 172.21.15.17:0/3640128663 >> 172.21.15.17:0/3640128663 conn(0x558cb22fbda0 msgr2=0x558cb232b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.624+0000 7fe7dd670b80 1 -- 172.21.15.17:0/3640128663 shutdown_connections 2023-07-14T13:02:49.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.624+0000 7fe7dd670b80 1 -- 172.21.15.17:0/3640128663 wait complete. 2023-07-14T13:02:49.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.624+0000 7fe7dd670b80 1 -- start start 2023-07-14T13:02:49.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.624+0000 7fe7dd670b80 1 Processor -- start 2023-07-14T13:02:49.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.625+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb231b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.625+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2317a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.625+0000 7fe7dd670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2314ee0 0x558cb2317f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.625+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb23184b0 con 0x558cb2305be0 2023-07-14T13:02:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.625+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb2318620 con 0x558cb2314ee0 2023-07-14T13:02:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.625+0000 7fe7dd670b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb23187e0 con 0x558cb23052d0 2023-07-14T13:02:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.625+0000 7fe7dd670b80 10 client.0 _ll_register_callbacks cb 0x7fe7b8009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.625+0000 7fe7c2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb231b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.625+0000 7fe7c37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2317a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7c2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb231b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60734/0 (socket says 172.21.15.17:60734) 2023-07-14T13:02:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7c2ffd700 1 -- 172.21.15.17:0/2609341324 learned_addr learned my addr 172.21.15.17:0/2609341324 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7c37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2317a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45032/0 (socket says 172.21.15.17:45032) 2023-07-14T13:02:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2314ee0 0x558cb2317f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7c37fe700 1 -- 172.21.15.17:0/2609341324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 msgr2=0x558cb231b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb231b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7c37fe700 1 -- 172.21.15.17:0/2609341324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2314ee0 msgr2=0x558cb2317f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2314ee0 0x558cb2317f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7c37fe700 1 -- 172.21.15.17:0/2609341324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b8020040 con 0x558cb2305be0 2023-07-14T13:02:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb231b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7c37fe700 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2317a30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4000c00 tx=0x7fe7b4004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caa9275524137fe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.626+0000 7fe7a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.627+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/2609341324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b401f040 con 0x558cb2305be0 2023-07-14T13:02:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.627+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/2609341324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe7b4007500 con 0x558cb2305be0 2023-07-14T13:02:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.627+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2609341324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7b4010e10 con 0x558cb2305be0 2023-07-14T13:02:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.627+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/2609341324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7b4007ea0 con 0x558cb2305be0 2023-07-14T13:02:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.627+0000 7fe7dd670b80 10 client.16317 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.627+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2609341324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x558cb20842b0 con 0x558cb2305be0 2023-07-14T13:02:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.627+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/2609341324 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7b403a080 con 0x558cb2305be0 2023-07-14T13:02:49.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.628+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/2609341324 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe7b4003680 con 0x558cb2305be0 2023-07-14T13:02:49.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.628+0000 7fe7dd670b80 10 client.16317 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:49.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.628+0000 7fe7dd670b80 10 client.16317 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:02:49.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.628+0000 7fe7dd670b80 20 client.16317 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:49.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.628+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x558cb2379870 0x558cb237bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.628+0000 7fe7dd670b80 4 client.16317 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.628+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2609341324 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558cb2213050 con 0x558cb2379870 2023-07-14T13:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.628+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x558cb2379870 0x558cb237bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7c2ffd700 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x558cb2379870 0x558cb237bc80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fecd2a63a4034468 server_cookie=8732e5029fe8d072 in_seq=0 out_seq=0 2023-07-14T13:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7a2ffd700 10 client.16317 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7a2ffd700 1 -- 172.21.15.17:0/2609341324 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558cb2213050 con 0x558cb2379870 2023-07-14T13:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7a2ffd700 10 client.16317 handle_command_reply: tid=0 2023-07-14T13:02:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7dd670b80 1 client.16317 shutdown 2023-07-14T13:02:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2609341324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 msgr2=0x558cb2317a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2317a30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4000c00 tx=0x7fe7b4004550 comp rx=0 tx=0).stop 2023-07-14T13:02:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2609341324 shutdown_connections 2023-07-14T13:02:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x558cb2379870 0x558cb237bc80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558cb2314ee0 0x558cb2317f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558cb23052d0 0x558cb231b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7dd670b80 1 --2- 172.21.15.17:0/2609341324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558cb2305be0 0x558cb2317a30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2609341324 >> 172.21.15.17:0/2609341324 conn(0x558cb22fbda0 msgr2=0x558cb2320af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.629+0000 7fe7a2ffd700 0 client.16317 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:02:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.630+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2609341324 shutdown_connections 2023-07-14T13:02:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.630+0000 7fe7dd670b80 1 -- 172.21.15.17:0/2609341324 wait complete. 2023-07-14T13:02:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.630+0000 7fe7dd670b80 20 client.16317 trim_cache size 0 max 16384 2023-07-14T13:02:49.672 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:02:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.630+0000 7fe7c9dff700 1 -- 172.21.15.17:0/3843753910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7ac0a12c0 msgr2=0x7fe7ac0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.630+0000 7fe7c9dff700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7ac0a12c0 0x7fe7ac0a3770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc007fd0 tx=0x7fe7bc004ad0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.630+0000 7fe7c9dff700 1 -- 172.21.15.17:0/3843753910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c4105ae0 msgr2=0x7fe7c4195900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.630+0000 7fe7c9dff700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c4105ae0 0x7fe7c4195900 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc007f10 tx=0x7fe7bc00d3b0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.631+0000 7fe7c9dff700 1 -- 172.21.15.17:0/3843753910 shutdown_connections 2023-07-14T13:02:49.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.631+0000 7fe7c9dff700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe7ac0a12c0 0x7fe7ac0a3770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.631+0000 7fe7c9dff700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c4105ae0 0x7fe7c4195900 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.631+0000 7fe7c9dff700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c40ffad0 0x7fe7c419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.631+0000 7fe7c9dff700 1 --2- 172.21.15.17:0/3843753910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c4100480 0x7fe7c419bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.631+0000 7fe7c9dff700 1 -- 172.21.15.17:0/3843753910 >> 172.21.15.17:0/3843753910 conn(0x7fe7c40fb5f0 msgr2=0x7fe7c40fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.631+0000 7fe7c9dff700 1 -- 172.21.15.17:0/3843753910 shutdown_connections 2023-07-14T13:02:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.631+0000 7fe7c9dff700 1 -- 172.21.15.17:0/3843753910 wait complete. 2023-07-14T13:02:49.683 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:02:49.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.879+0000 7fa38f3ff700 1 -- 172.21.15.17:0/2891837414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38810a070 msgr2=0x7fa38810c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.879+0000 7fa38f3ff700 1 --2- 172.21.15.17:0/2891837414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38810a070 0x7fa38810c4b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa38000b0a0 tx=0x7fa38000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.879+0000 7fa38f3ff700 1 -- 172.21.15.17:0/2891837414 shutdown_connections 2023-07-14T13:02:49.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.879+0000 7fa38f3ff700 1 --2- 172.21.15.17:0/2891837414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38810a070 0x7fa38810c4b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.879+0000 7fa38f3ff700 1 --2- 172.21.15.17:0/2891837414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa388100ca0 0x7fa388101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.879+0000 7fa38f3ff700 1 --2- 172.21.15.17:0/2891837414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3881015b0 0x7fa388109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.879+0000 7fa38f3ff700 1 -- 172.21.15.17:0/2891837414 >> 172.21.15.17:0/2891837414 conn(0x7fa3880fa4b0 msgr2=0x7fa3880fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.879+0000 7fa38f3ff700 1 -- 172.21.15.17:0/2891837414 shutdown_connections 2023-07-14T13:02:49.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.879+0000 7fa38f3ff700 1 -- 172.21.15.17:0/2891837414 wait complete. 2023-07-14T13:02:49.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.881+0000 7fa38f3ff700 1 Processor -- start 2023-07-14T13:02:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.881+0000 7fa38f3ff700 1 -- start start 2023-07-14T13:02:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.881+0000 7fa38f3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa388100ca0 0x7fa38819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.881+0000 7fa38f3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3881015b0 0x7fa38819bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.881+0000 7fa38f3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38810a070 0x7fa388195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.881+0000 7fa38f3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881960a0 con 0x7fa38810a070 2023-07-14T13:02:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.881+0000 7fa38f3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa388196210 con 0x7fa388100ca0 2023-07-14T13:02:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.881+0000 7fa38f3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881963d0 con 0x7fa3881015b0 2023-07-14T13:02:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.882+0000 7fa38d99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38810a070 0x7fa388195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.882+0000 7fa38c99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3881015b0 0x7fa38819bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.882+0000 7fa38d99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38810a070 0x7fa388195a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45060/0 (socket says 172.21.15.17:45060) 2023-07-14T13:02:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.882+0000 7fa38d99c700 1 -- 172.21.15.17:0/875077601 learned_addr learned my addr 172.21.15.17:0/875077601 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.882+0000 7fa38d19b700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa388100ca0 0x7fa38819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.882+0000 7fa38d99c700 1 -- 172.21.15.17:0/875077601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3881015b0 msgr2=0x7fa38819bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.882+0000 7fa38d99c700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3881015b0 0x7fa38819bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.882+0000 7fa38d99c700 1 -- 172.21.15.17:0/875077601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa388100ca0 msgr2=0x7fa38819b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.882+0000 7fa38d99c700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa388100ca0 0x7fa38819b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.882+0000 7fa38d99c700 1 -- 172.21.15.17:0/875077601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa384009520 con 0x7fa38810a070 2023-07-14T13:02:49.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.883+0000 7fa38d99c700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38810a070 0x7fa388195a30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa38000b070 tx=0x7fa38000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.883+0000 7fa37e7fc700 1 -- 172.21.15.17:0/875077601 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000e040 con 0x7fa38810a070 2023-07-14T13:02:49.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.883+0000 7fa38f3ff700 1 -- 172.21.15.17:0/875077601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa380009d00 con 0x7fa38810a070 2023-07-14T13:02:49.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.883+0000 7fa37e7fc700 1 -- 172.21.15.17:0/875077601 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa380009480 con 0x7fa38810a070 2023-07-14T13:02:49.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.883+0000 7fa37e7fc700 1 -- 172.21.15.17:0/875077601 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380005040 con 0x7fa38810a070 2023-07-14T13:02:49.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.883+0000 7fa38f3ff700 1 -- 172.21.15.17:0/875077601 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3881a27d0 con 0x7fa38810a070 2023-07-14T13:02:49.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.887+0000 7fa37e7fc700 1 -- 172.21.15.17:0/875077601 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa38001d480 con 0x7fa38810a070 2023-07-14T13:02:49.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.889+0000 7fa3a2c5db80 1 Processor -- start 2023-07-14T13:02:49.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.889+0000 7fa3a2c5db80 1 -- start start 2023-07-14T13:02:49.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.889+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdc2d0 0x55a84dfdc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.889+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.889+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.889+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84dee2cb0 con 0x55a84dfe7ad0 2023-07-14T13:02:49.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.889+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84df35a40 con 0x55a84dfdc2d0 2023-07-14T13:02:49.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.889+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84df2eed0 con 0x55a84dfdcbe0 2023-07-14T13:02:49.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.889+0000 7fa37e7fc700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3740a12c0 0x7fa3740a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa37e7fc700 1 -- 172.21.15.17:0/875077601 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa3800cdf30 con 0x7fa38810a070 2023-07-14T13:02:49.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa38c99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa38c99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45066/0 (socket says 172.21.15.17:45066) 2023-07-14T13:02:49.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa38c99a700 1 -- 172.21.15.17:0/4167903352 learned_addr learned my addr 172.21.15.17:0/4167903352 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa38d99c700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3740a12c0 0x7fa3740a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa38c99a700 1 --2- 172.21.15.17:0/4167903352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdc2d0 0x55a84dfdc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa38d19b700 1 --2- 172.21.15.17:0/4167903352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa38d19b700 1 -- 172.21.15.17:0/4167903352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdc2d0 msgr2=0x55a84dfdc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa38d19b700 1 --2- 172.21.15.17:0/4167903352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdc2d0 0x55a84dfdc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa38d19b700 1 -- 172.21.15.17:0/4167903352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfe7ad0 msgr2=0x55a84dfe9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa38d19b700 1 --2- 172.21.15.17:0/4167903352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.890+0000 7fa38d19b700 1 -- 172.21.15.17:0/4167903352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a84dd5cde0 con 0x55a84dfdcbe0 2023-07-14T13:02:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.891+0000 7fa38c99a700 1 --2- 172.21.15.17:0/4167903352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.891+0000 7fa38d99c700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3740a12c0 0x7fa3740a3770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa380007fd0 tx=0x7fa380009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.891+0000 7fa38d19b700 1 --2- 172.21.15.17:0/4167903352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe7590 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa384009e40 tx=0x7fa384011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c53afa633130646a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.891+0000 7fa3737fe700 1 -- 172.21.15.17:0/4167903352 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384019630 con 0x55a84dfdcbe0 2023-07-14T13:02:49.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.891+0000 7fa3737fe700 1 -- 172.21.15.17:0/4167903352 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa384019c20 con 0x55a84dfdcbe0 2023-07-14T13:02:49.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.891+0000 7fa3737fe700 1 -- 172.21.15.17:0/4167903352 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38400eb90 con 0x55a84dfdcbe0 2023-07-14T13:02:49.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.892+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/4167903352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 msgr2=0x55a84dfe7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.892+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/4167903352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe7590 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa384009e40 tx=0x7fa384011720 comp rx=0 tx=0).stop 2023-07-14T13:02:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.892+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/4167903352 shutdown_connections 2023-07-14T13:02:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.892+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/4167903352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.892+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/4167903352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdc2d0 0x55a84dfdc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.892+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/4167903352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe7590 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.892+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/4167903352 >> 172.21.15.17:0/4167903352 conn(0x55a84dfd2da0 msgr2=0x55a84dfd86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.892+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/4167903352 shutdown_connections 2023-07-14T13:02:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.892+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/4167903352 wait complete. 2023-07-14T13:02:49.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.893+0000 7fa3a2c5db80 1 -- start start 2023-07-14T13:02:49.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.893+0000 7fa3a2c5db80 1 Processor -- start 2023-07-14T13:02:49.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.893+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.893+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.893+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.893+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84deceac0 con 0x55a84dfdc2d0 2023-07-14T13:02:49.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.893+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84dece7c0 con 0x55a84dfdcbe0 2023-07-14T13:02:49.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.893+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84ddb2920 con 0x55a84dfe7ad0 2023-07-14T13:02:49.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.894+0000 7fa3a2c5db80 10 client.0 _ll_register_callbacks cb 0x55a84decc760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:49.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.894+0000 7fa38c99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.894+0000 7fa38c99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45078/0 (socket says 172.21.15.17:45078) 2023-07-14T13:02:49.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.894+0000 7fa38c99a700 1 -- 172.21.15.17:0/307729470 learned_addr learned my addr 172.21.15.17:0/307729470 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.894+0000 7fa38d19b700 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.894+0000 7fa38c99a700 1 -- 172.21.15.17:0/307729470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfe7ad0 msgr2=0x55a84dfe4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.894+0000 7fa38c99a700 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.894+0000 7fa38c99a700 1 -- 172.21.15.17:0/307729470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdcbe0 msgr2=0x55a84dfe4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.894+0000 7fa38c99a700 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.894+0000 7fa38c99a700 1 -- 172.21.15.17:0/307729470 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37801b040 con 0x55a84dfdc2d0 2023-07-14T13:02:49.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.894+0000 7fa38c99a700 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe7510 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa378009e30 tx=0x7fa37800e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728dc0dda6acd646 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.895+0000 7fa370ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:49.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.895+0000 7fa370ff9700 1 -- 172.21.15.17:0/307729470 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800ee10 con 0x55a84dfdc2d0 2023-07-14T13:02:49.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.895+0000 7fa370ff9700 1 -- 172.21.15.17:0/307729470 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa378004830 con 0x55a84dfdc2d0 2023-07-14T13:02:49.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.895+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/307729470 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a84de884f0 con 0x55a84dfdc2d0 2023-07-14T13:02:49.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.895+0000 7fa370ff9700 1 -- 172.21.15.17:0/307729470 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3780049f0 con 0x55a84dfdc2d0 2023-07-14T13:02:49.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.895+0000 7fa3a2c5db80 10 client.16329 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:49.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.895+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/307729470 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fa384009a70 con 0x55a84dfdc2d0 2023-07-14T13:02:49.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.896+0000 7fa370ff9700 1 -- 172.21.15.17:0/307729470 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a84de884f0 con 0x55a84dfdc2d0 2023-07-14T13:02:49.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.896+0000 7fa370ff9700 1 -- 172.21.15.17:0/307729470 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa378005060 con 0x55a84dfdc2d0 2023-07-14T13:02:49.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.896+0000 7fa3a2c5db80 10 client.16329 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:49.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.896+0000 7fa3a2c5db80 10 client.16329 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:49.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.896+0000 7fa3a2c5db80 20 client.16329 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:49.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.896+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a84dff7460 0x55a84dff9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.896+0000 7fa3a2c5db80 4 client.16329 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:49.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.896+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/307729470 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a84df27eb0 con 0x55a84dff7460 2023-07-14T13:02:49.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.896+0000 7fa38d19b700 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a84dff7460 0x55a84dff9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.897+0000 7fa38d19b700 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a84dff7460 0x55a84dff9870 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79a08043ca09a4a9 server_cookie=77f86106c7b12c in_seq=0 out_seq=0 2023-07-14T13:02:49.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.897+0000 7fa370ff9700 10 client.16329 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:49.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa370ff9700 1 -- 172.21.15.17:0/307729470 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a84df27eb0 con 0x55a84dff7460 2023-07-14T13:02:49.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa370ff9700 10 client.16329 handle_command_reply: tid=0 2023-07-14T13:02:49.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa3a2c5db80 1 client.16329 shutdown 2023-07-14T13:02:49.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/307729470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 msgr2=0x55a84dfe7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe7510 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa378009e30 tx=0x7fa37800e690 comp rx=0 tx=0).stop 2023-07-14T13:02:49.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/307729470 shutdown_connections 2023-07-14T13:02:49.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a84dff7460 0x55a84dff9870 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe7510 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/307729470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa370ff9700 0 client.16329 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:49.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/307729470 >> 172.21.15.17:0/307729470 conn(0x55a84dfd2da0 msgr2=0x55a84dfd8290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/307729470 shutdown_connections 2023-07-14T13:02:49.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.898+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/307729470 wait complete. 2023-07-14T13:02:49.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.899+0000 7fa3a2c5db80 20 client.16329 trim_cache size 0 max 16384 2023-07-14T13:02:49.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.915+0000 7fa3a2c5db80 1 Processor -- start 2023-07-14T13:02:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.915+0000 7fa3a2c5db80 1 -- start start 2023-07-14T13:02:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.916+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.916+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.916+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.916+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84dfe5d70 con 0x55a84dfdc2d0 2023-07-14T13:02:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.916+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84dfe5710 con 0x55a84dfe7ad0 2023-07-14T13:02:49.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.916+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84dfde1a0 con 0x55a84dfdcbe0 2023-07-14T13:02:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.916+0000 7fa38c99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.916+0000 7fa38c99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45080/0 (socket says 172.21.15.17:45080) 2023-07-14T13:02:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.916+0000 7fa38c99a700 1 -- 172.21.15.17:0/3805778239 learned_addr learned my addr 172.21.15.17:0/3805778239 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.916+0000 7fa38d19b700 1 --2- 172.21.15.17:0/3805778239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.916+0000 7fa38c99a700 1 --2- 172.21.15.17:0/3805778239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.917+0000 7fa38c99a700 1 -- 172.21.15.17:0/3805778239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 msgr2=0x55a84dfe3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.917+0000 7fa38c99a700 1 --2- 172.21.15.17:0/3805778239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.917+0000 7fa38c99a700 1 -- 172.21.15.17:0/3805778239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfe7ad0 msgr2=0x55a84dfe44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.917+0000 7fa38c99a700 1 --2- 172.21.15.17:0/3805778239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.917+0000 7fa38c99a700 1 -- 172.21.15.17:0/3805778239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a84dd45c60 con 0x55a84dfdc2d0 2023-07-14T13:02:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.917+0000 7fa38d19b700 1 --2- 172.21.15.17:0/3805778239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.917+0000 7fa38c99a700 1 --2- 172.21.15.17:0/3805778239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe70b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa378005470 tx=0x7fa378000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde01c31d139b3e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.917+0000 7fa373fff700 1 -- 172.21.15.17:0/3805778239 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3780056e0 con 0x55a84dfdc2d0 2023-07-14T13:02:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.917+0000 7fa373fff700 1 -- 172.21.15.17:0/3805778239 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa378004cc0 con 0x55a84dfdc2d0 2023-07-14T13:02:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.917+0000 7fa373fff700 1 -- 172.21.15.17:0/3805778239 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa378020470 con 0x55a84dfdc2d0 2023-07-14T13:02:49.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.918+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/3805778239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 msgr2=0x55a84dfe70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.918+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/3805778239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe70b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa378005470 tx=0x7fa378000bc0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.918+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/3805778239 shutdown_connections 2023-07-14T13:02:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.918+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/3805778239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfe7ad0 0x55a84dfe44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.918+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/3805778239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdc2d0 0x55a84dfe70b0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.918+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/3805778239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfdcbe0 0x55a84dfe3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.918+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/3805778239 >> 172.21.15.17:0/3805778239 conn(0x55a84dfd2da0 msgr2=0x55a84dff3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.918+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/3805778239 shutdown_connections 2023-07-14T13:02:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.918+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/3805778239 wait complete. 2023-07-14T13:02:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.919+0000 7fa3a2c5db80 1 -- start start 2023-07-14T13:02:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.919+0000 7fa3a2c5db80 1 Processor -- start 2023-07-14T13:02:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.919+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdc2d0 0x55a84dfedef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.919+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdcbe0 0x55a84dfee430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.919+0000 7fa3a2c5db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfe7ad0 0x55a84dfec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.919+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84dfeca80 con 0x55a84dfdcbe0 2023-07-14T13:02:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.919+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84dfecbf0 con 0x55a84dfdc2d0 2023-07-14T13:02:49.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.919+0000 7fa3a2c5db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a84dfecdb0 con 0x55a84dfe7ad0 2023-07-14T13:02:49.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.920+0000 7fa3a2c5db80 10 client.0 _ll_register_callbacks cb 0x7fa3780139a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:49.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.920+0000 7fa38d19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdcbe0 0x55a84dfee430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.920+0000 7fa38c99a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdc2d0 0x55a84dfedef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.920+0000 7fa38d19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdcbe0 0x55a84dfee430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45094/0 (socket says 172.21.15.17:45094) 2023-07-14T13:02:49.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.920+0000 7fa38d19b700 1 -- 172.21.15.17:0/366752905 learned_addr learned my addr 172.21.15.17:0/366752905 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:49.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.920+0000 7fa38c99a700 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfe7ad0 0x55a84dfec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.920+0000 7fa38d19b700 1 -- 172.21.15.17:0/366752905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfe7ad0 msgr2=0x55a84dfec4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.920+0000 7fa38d19b700 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfe7ad0 0x55a84dfec4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.920+0000 7fa38d19b700 1 -- 172.21.15.17:0/366752905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdc2d0 msgr2=0x55a84dfedef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.920+0000 7fa38d19b700 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdc2d0 0x55a84dfedef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.920+0000 7fa38d19b700 1 -- 172.21.15.17:0/366752905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a84dd5cde0 con 0x55a84dfdcbe0 2023-07-14T13:02:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.921+0000 7fa38d19b700 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdcbe0 0x55a84dfee430 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa384013010 tx=0x7fa384005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5118edbd32ddc96a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.921+0000 7fa370ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:49.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.921+0000 7fa370ff9700 1 -- 172.21.15.17:0/366752905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384005250 con 0x55a84dfdcbe0 2023-07-14T13:02:49.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.921+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/366752905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa384019c20 con 0x55a84dfdcbe0 2023-07-14T13:02:49.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.921+0000 7fa370ff9700 1 -- 172.21.15.17:0/366752905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa3840053b0 con 0x55a84dfdcbe0 2023-07-14T13:02:49.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.921+0000 7fa370ff9700 1 -- 172.21.15.17:0/366752905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa384005570 con 0x55a84dfdcbe0 2023-07-14T13:02:49.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.921+0000 7fa3a2c5db80 10 client.16335 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:49.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.921+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/366752905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fa378034040 con 0x55a84dfdcbe0 2023-07-14T13:02:49.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.922+0000 7fa370ff9700 1 -- 172.21.15.17:0/366752905 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa384019c20 con 0x55a84dfdcbe0 2023-07-14T13:02:49.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.922+0000 7fa370ff9700 1 -- 172.21.15.17:0/366752905 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa384019660 con 0x55a84dfdcbe0 2023-07-14T13:02:49.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.922+0000 7fa3a2c5db80 10 client.16335 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:49.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.922+0000 7fa3a2c5db80 10 client.16335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:49.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.922+0000 7fa3a2c5db80 20 client.16335 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:49.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.922+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a84e04c530 0x55a84e04e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:49.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.922+0000 7fa3a2c5db80 4 client.16335 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:02:49.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.922+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/366752905 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a84deea050 con 0x55a84e04c530 2023-07-14T13:02:49.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.923+0000 7fa38c99a700 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a84e04c530 0x55a84e04e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:49.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.923+0000 7fa38c99a700 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a84e04c530 0x55a84e04e940 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=866b5c6bcb560eff server_cookie=5ea03312d472e427 in_seq=0 out_seq=0 2023-07-14T13:02:49.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.923+0000 7fa370ff9700 10 client.16335 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:49.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.923+0000 7fa370ff9700 1 -- 172.21.15.17:0/366752905 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a84deea050 con 0x55a84e04c530 2023-07-14T13:02:49.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.923+0000 7fa370ff9700 10 client.16335 handle_command_reply: tid=0 2023-07-14T13:02:49.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.923+0000 7fa3a2c5db80 1 client.16335 shutdown 2023-07-14T13:02:49.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/366752905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdcbe0 msgr2=0x55a84dfee430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdcbe0 0x55a84dfee430 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa384013010 tx=0x7fa384005fa0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/366752905 shutdown_connections 2023-07-14T13:02:49.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a84e04c530 0x55a84e04e940 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a84dfe7ad0 0x55a84dfec4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a84dfdc2d0 0x55a84dfedef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa3a2c5db80 1 --2- 172.21.15.17:0/366752905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a84dfdcbe0 0x55a84dfee430 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/366752905 >> 172.21.15.17:0/366752905 conn(0x55a84dfd2da0 msgr2=0x55a84dfde3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa370ff9700 0 client.16335 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:49.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/366752905 shutdown_connections 2023-07-14T13:02:49.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa3a2c5db80 1 -- 172.21.15.17:0/366752905 wait complete. 2023-07-14T13:02:49.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.924+0000 7fa3a2c5db80 20 client.16335 trim_cache size 0 max 16384 2023-07-14T13:02:49.968 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:02:49.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 -- 172.21.15.17:0/875077601 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3740a12c0 msgr2=0x7fa3740a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3740a12c0 0x7fa3740a3770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa380007fd0 tx=0x7fa380009040 comp rx=0 tx=0).stop 2023-07-14T13:02:49.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 -- 172.21.15.17:0/875077601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38810a070 msgr2=0x7fa388195a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:49.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38810a070 0x7fa388195a30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa38000b070 tx=0x7fa38000bce0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 -- 172.21.15.17:0/875077601 shutdown_connections 2023-07-14T13:02:49.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3740a12c0 0x7fa3740a3770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa38810a070 0x7fa388195a30 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa388100ca0 0x7fa38819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 --2- 172.21.15.17:0/875077601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3881015b0 0x7fa38819bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:49.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 -- 172.21.15.17:0/875077601 >> 172.21.15.17:0/875077601 conn(0x7fa3880fa4b0 msgr2=0x7fa38810c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:49.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 -- 172.21.15.17:0/875077601 shutdown_connections 2023-07-14T13:02:49.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:49.925+0000 7fa38f3ff700 1 -- 172.21.15.17:0/875077601 wait complete. 2023-07-14T13:02:50.847 INFO:teuthology.orchestra.run.smithi017.stderr:9600000 of 50000000 tuples (19%) done (elapsed 160.45 s, remaining 675.23 s) 2023-07-14T13:02:50.978 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:02:50.979 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:02:51.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.175+0000 7f404b3ff700 1 -- 172.21.15.17:0/960378732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40441015b0 msgr2=0x7f4044109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.175+0000 7f404b3ff700 1 --2- 172.21.15.17:0/960378732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40441015b0 0x7f4044109aa0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4034009990 tx=0x7f4034009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.175+0000 7f404b3ff700 1 -- 172.21.15.17:0/960378732 shutdown_connections 2023-07-14T13:02:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.175+0000 7f404b3ff700 1 --2- 172.21.15.17:0/960378732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f404410a070 0x7f404410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.175+0000 7f404b3ff700 1 --2- 172.21.15.17:0/960378732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4044100ca0 0x7f4044101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.175+0000 7f404b3ff700 1 --2- 172.21.15.17:0/960378732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40441015b0 0x7f4044109aa0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.175+0000 7f404b3ff700 1 -- 172.21.15.17:0/960378732 >> 172.21.15.17:0/960378732 conn(0x7f40440fa4b0 msgr2=0x7f40440fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.175+0000 7f404b3ff700 1 -- 172.21.15.17:0/960378732 shutdown_connections 2023-07-14T13:02:51.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.175+0000 7f404b3ff700 1 -- 172.21.15.17:0/960378732 wait complete. 2023-07-14T13:02:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.176+0000 7f404b3ff700 1 Processor -- start 2023-07-14T13:02:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.176+0000 7f404b3ff700 1 -- start start 2023-07-14T13:02:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.177+0000 7f404b3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4044100ca0 0x7f4044197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.177+0000 7f404b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40441015b0 0x7f40441982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.177+0000 7f404b3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f404410a070 0x7f404419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.177+0000 7f404b3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404419cd50 con 0x7f404410a070 2023-07-14T13:02:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.177+0000 7f404b3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404419cec0 con 0x7f4044100ca0 2023-07-14T13:02:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.177+0000 7f404b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404419d080 con 0x7f40441015b0 2023-07-14T13:02:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.177+0000 7f404999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f404410a070 0x7f404419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.177+0000 7f404999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f404410a070 0x7f404419c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45124/0 (socket says 172.21.15.17:45124) 2023-07-14T13:02:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.177+0000 7f404999c700 1 -- 172.21.15.17:0/1526660779 learned_addr learned my addr 172.21.15.17:0/1526660779 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.177+0000 7f404899a700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40441015b0 0x7f40441982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.177+0000 7f404919b700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4044100ca0 0x7f4044197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.178+0000 7f404999c700 1 -- 172.21.15.17:0/1526660779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40441015b0 msgr2=0x7f40441982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.178+0000 7f404999c700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40441015b0 0x7f40441982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.178+0000 7f404999c700 1 -- 172.21.15.17:0/1526660779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4044100ca0 msgr2=0x7f4044197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.178+0000 7f404999c700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4044100ca0 0x7f4044197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.178+0000 7f404999c700 1 -- 172.21.15.17:0/1526660779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340095f0 con 0x7f404410a070 2023-07-14T13:02:51.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.178+0000 7f404999c700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f404410a070 0x7f404419c710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f403c007ee0 tx=0x7f403c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.178+0000 7f403a7fc700 1 -- 172.21.15.17:0/1526660779 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c017070 con 0x7f404410a070 2023-07-14T13:02:51.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.178+0000 7f403a7fc700 1 -- 172.21.15.17:0/1526660779 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f403c00f040 con 0x7f404410a070 2023-07-14T13:02:51.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.178+0000 7f403a7fc700 1 -- 172.21.15.17:0/1526660779 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c005570 con 0x7f404410a070 2023-07-14T13:02:51.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.178+0000 7f404b3ff700 1 -- 172.21.15.17:0/1526660779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404419d360 con 0x7f404410a070 2023-07-14T13:02:51.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.178+0000 7f404b3ff700 1 -- 172.21.15.17:0/1526660779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40441a4ba0 con 0x7f404410a070 2023-07-14T13:02:51.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.182+0000 7f403a7fc700 1 -- 172.21.15.17:0/1526660779 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f403c00db20 con 0x7f404410a070 2023-07-14T13:02:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.184+0000 7f405ede6b80 1 Processor -- start 2023-07-14T13:02:51.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.184+0000 7f405ede6b80 1 -- start start 2023-07-14T13:02:51.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.184+0000 7f403a7fc700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40300a12c0 0x7f40300a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.184+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x562398201720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.184+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201c60 0x56239820c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.184+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239820cb50 0x56239820ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.184+0000 7f405ede6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562398107d30 con 0x562398201350 2023-07-14T13:02:51.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.184+0000 7f405ede6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56239815aac0 con 0x562398201c60 2023-07-14T13:02:51.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.184+0000 7f405ede6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562398153f50 con 0x56239820cb50 2023-07-14T13:02:51.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.184+0000 7f403a7fc700 1 -- 172.21.15.17:0/1526660779 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f403c0cc3d0 con 0x7f404410a070 2023-07-14T13:02:51.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404899a700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40300a12c0 0x7f40300a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x562398201720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x562398201720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45138/0 (socket says 172.21.15.17:45138) 2023-07-14T13:02:51.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404919b700 1 -- 172.21.15.17:0/569880567 learned_addr learned my addr 172.21.15.17:0/569880567 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:51.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404999c700 1 --2- 172.21.15.17:0/569880567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239820cb50 0x56239820ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404899a700 1 --2- 172.21.15.17:0/569880567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201c60 0x56239820c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404999c700 1 -- 172.21.15.17:0/569880567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201c60 msgr2=0x56239820c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404999c700 1 --2- 172.21.15.17:0/569880567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201c60 0x56239820c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404999c700 1 -- 172.21.15.17:0/569880567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 msgr2=0x562398201720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404999c700 1 --2- 172.21.15.17:0/569880567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x562398201720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404999c700 1 -- 172.21.15.17:0/569880567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562397f81e60 con 0x56239820cb50 2023-07-14T13:02:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.185+0000 7f404919b700 1 --2- 172.21.15.17:0/569880567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x562398201720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.186+0000 7f404999c700 1 --2- 172.21.15.17:0/569880567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239820cb50 0x56239820ef30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f403c0c9b70 tx=0x7f403c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e77c77821b25d129 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.186+0000 7f404899a700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40300a12c0 0x7f40300a3770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f403400b5c0 tx=0x7f4034005750 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.186+0000 7f402f7fe700 1 -- 172.21.15.17:0/569880567 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c004c40 con 0x56239820cb50 2023-07-14T13:02:51.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.186+0000 7f402f7fe700 1 -- 172.21.15.17:0/569880567 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f403c00ddd0 con 0x56239820cb50 2023-07-14T13:02:51.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.186+0000 7f402f7fe700 1 -- 172.21.15.17:0/569880567 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c095c00 con 0x56239820cb50 2023-07-14T13:02:51.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.187+0000 7f405ede6b80 1 -- 172.21.15.17:0/569880567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239820cb50 msgr2=0x56239820ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.187+0000 7f405ede6b80 1 --2- 172.21.15.17:0/569880567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239820cb50 0x56239820ef30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f403c0c9b70 tx=0x7f403c004ad0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.187+0000 7f405ede6b80 1 -- 172.21.15.17:0/569880567 shutdown_connections 2023-07-14T13:02:51.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.187+0000 7f405ede6b80 1 --2- 172.21.15.17:0/569880567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56239820cb50 0x56239820ef30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.187+0000 7f405ede6b80 1 --2- 172.21.15.17:0/569880567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x562398201720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.187+0000 7f405ede6b80 1 --2- 172.21.15.17:0/569880567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201c60 0x56239820c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.187+0000 7f405ede6b80 1 -- 172.21.15.17:0/569880567 >> 172.21.15.17:0/569880567 conn(0x5623981f7e20 msgr2=0x5623981fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.187+0000 7f405ede6b80 1 -- 172.21.15.17:0/569880567 shutdown_connections 2023-07-14T13:02:51.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.187+0000 7f405ede6b80 1 -- 172.21.15.17:0/569880567 wait complete. 2023-07-14T13:02:51.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.188+0000 7f405ede6b80 1 -- start start 2023-07-14T13:02:51.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.188+0000 7f405ede6b80 1 Processor -- start 2023-07-14T13:02:51.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.188+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201350 0x56239820c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201c60 0x562398209810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f405ede6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623980f3b40 con 0x56239820cb50 2023-07-14T13:02:51.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f405ede6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623980f3840 con 0x562398201c60 2023-07-14T13:02:51.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f405ede6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562397fd79a0 con 0x562398201350 2023-07-14T13:02:51.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f405ede6b80 10 client.0 _ll_register_callbacks cb 0x5623980f17e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:51.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f404999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f404999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45146/0 (socket says 172.21.15.17:45146) 2023-07-14T13:02:51.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f404999c700 1 -- 172.21.15.17:0/3618763136 learned_addr learned my addr 172.21.15.17:0/3618763136 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:51.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f404899a700 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201c60 0x562398209810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f404919b700 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201350 0x56239820c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f404999c700 1 -- 172.21.15.17:0/3618763136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201350 msgr2=0x56239820c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f404999c700 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201350 0x56239820c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f404999c700 1 -- 172.21.15.17:0/3618763136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201c60 msgr2=0x562398209810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f404999c700 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201c60 0x562398209810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.189+0000 7f404999c700 1 -- 172.21.15.17:0/3618763136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404000b9a0 con 0x56239820cb50 2023-07-14T13:02:51.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.190+0000 7f404999c700 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209f50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f403c00dfd0 tx=0x7f403c0ca0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e3647c2e293a45 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.190+0000 7f402cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:51.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.190+0000 7f402cff9700 1 -- 172.21.15.17:0/3618763136 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0994f0 con 0x56239820cb50 2023-07-14T13:02:51.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.190+0000 7f405ede6b80 1 -- 172.21.15.17:0/3618763136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623980ad570 con 0x56239820cb50 2023-07-14T13:02:51.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.190+0000 7f402cff9700 1 -- 172.21.15.17:0/3618763136 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f403c09d520 con 0x56239820cb50 2023-07-14T13:02:51.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.190+0000 7f402cff9700 1 -- 172.21.15.17:0/3618763136 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f403c0a1940 con 0x56239820cb50 2023-07-14T13:02:51.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.190+0000 7f405ede6b80 10 client.16347 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:51.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.190+0000 7f405ede6b80 1 -- 172.21.15.17:0/3618763136 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f40441a4ba0 con 0x56239820cb50 2023-07-14T13:02:51.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.191+0000 7f402cff9700 1 -- 172.21.15.17:0/3618763136 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f403c064020 con 0x56239820cb50 2023-07-14T13:02:51.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.191+0000 7f402cff9700 1 -- 172.21.15.17:0/3618763136 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f403c0c3d20 con 0x56239820cb50 2023-07-14T13:02:51.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.191+0000 7f405ede6b80 10 client.16347 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:51.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.191+0000 7f405ede6b80 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:51.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.191+0000 7f405ede6b80 20 client.16347 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:51.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.191+0000 7f405ede6b80 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56239821c2d0 0x56239821e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.191+0000 7f405ede6b80 4 client.16347 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:51.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.191+0000 7f405ede6b80 1 -- 172.21.15.17:0/3618763136 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56239814cf30 con 0x56239821c2d0 2023-07-14T13:02:51.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.191+0000 7f404919b700 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56239821c2d0 0x56239821e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.192+0000 7f404919b700 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56239821c2d0 0x56239821e6e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6a5a0c20d26869e server_cookie=c3a057e799583892 in_seq=0 out_seq=0 2023-07-14T13:02:51.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.192+0000 7f402cff9700 10 client.16347 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:51.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f402cff9700 1 -- 172.21.15.17:0/3618763136 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56239814cf30 con 0x56239821c2d0 2023-07-14T13:02:51.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f402cff9700 10 client.16347 handle_command_reply: tid=0 2023-07-14T13:02:51.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f405ede6b80 1 client.16347 shutdown 2023-07-14T13:02:51.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f405ede6b80 1 -- 172.21.15.17:0/3618763136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 msgr2=0x562398209f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f405ede6b80 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209f50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f403c00dfd0 tx=0x7f403c0ca0a0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f405ede6b80 1 -- 172.21.15.17:0/3618763136 shutdown_connections 2023-07-14T13:02:51.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f405ede6b80 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56239821c2d0 0x56239821e6e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f405ede6b80 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209f50 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f405ede6b80 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201350 0x56239820c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f405ede6b80 1 --2- 172.21.15.17:0/3618763136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201c60 0x562398209810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f405ede6b80 1 -- 172.21.15.17:0/3618763136 >> 172.21.15.17:0/3618763136 conn(0x5623981f7e20 msgr2=0x5623981fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.193+0000 7f402cff9700 0 client.16347 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:51.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.194+0000 7f405ede6b80 1 -- 172.21.15.17:0/3618763136 shutdown_connections 2023-07-14T13:02:51.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.194+0000 7f405ede6b80 1 -- 172.21.15.17:0/3618763136 wait complete. 2023-07-14T13:02:51.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.194+0000 7f405ede6b80 20 client.16347 trim_cache size 0 max 16384 2023-07-14T13:02:51.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.215+0000 7f405ede6b80 1 Processor -- start 2023-07-14T13:02:51.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.215+0000 7f405ede6b80 1 -- start start 2023-07-14T13:02:51.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.215+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201350 0x562398218a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201c60 0x562398208fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f405ede6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562398202240 con 0x56239820cb50 2023-07-14T13:02:51.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f405ede6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562398207d70 con 0x562398201350 2023-07-14T13:02:51.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f405ede6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56239820a6c0 con 0x562398201c60 2023-07-14T13:02:51.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f404999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f404999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45160/0 (socket says 172.21.15.17:45160) 2023-07-14T13:02:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f404919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201350 0x562398218a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f404999c700 1 -- 172.21.15.17:0/2223830115 learned_addr learned my addr 172.21.15.17:0/2223830115 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f404999c700 1 -- 172.21.15.17:0/2223830115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201c60 msgr2=0x562398208fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f404899a700 1 --2- 172.21.15.17:0/2223830115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201c60 0x562398208fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f404999c700 1 --2- 172.21.15.17:0/2223830115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201c60 0x562398208fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f404999c700 1 -- 172.21.15.17:0/2223830115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201350 msgr2=0x562398218a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f404999c700 1 --2- 172.21.15.17:0/2223830115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201350 0x562398218a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f404999c700 1 -- 172.21.15.17:0/2223830115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562397f6ace0 con 0x56239820cb50 2023-07-14T13:02:51.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.216+0000 7f404919b700 1 --2- 172.21.15.17:0/2223830115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201350 0x562398218a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:51.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.217+0000 7f404999c700 1 --2- 172.21.15.17:0/2223830115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209510 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f403c095f60 tx=0x7f403c0997a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5364d496b425ef0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.217+0000 7f402ffff700 1 -- 172.21.15.17:0/2223830115 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c099030 con 0x56239820cb50 2023-07-14T13:02:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.217+0000 7f402ffff700 1 -- 172.21.15.17:0/2223830115 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f403c064030 con 0x56239820cb50 2023-07-14T13:02:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.217+0000 7f402ffff700 1 -- 172.21.15.17:0/2223830115 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c0a1940 con 0x56239820cb50 2023-07-14T13:02:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.218+0000 7f405ede6b80 1 -- 172.21.15.17:0/2223830115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 msgr2=0x562398209510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.218+0000 7f405ede6b80 1 --2- 172.21.15.17:0/2223830115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209510 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f403c095f60 tx=0x7f403c0997a0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.218+0000 7f405ede6b80 1 -- 172.21.15.17:0/2223830115 shutdown_connections 2023-07-14T13:02:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.218+0000 7f405ede6b80 1 --2- 172.21.15.17:0/2223830115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56239820cb50 0x562398209510 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.218+0000 7f405ede6b80 1 --2- 172.21.15.17:0/2223830115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562398201350 0x562398218a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.218+0000 7f405ede6b80 1 --2- 172.21.15.17:0/2223830115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201c60 0x562398208fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.218+0000 7f405ede6b80 1 -- 172.21.15.17:0/2223830115 >> 172.21.15.17:0/2223830115 conn(0x5623981f7e20 msgr2=0x562398204b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.218+0000 7f405ede6b80 1 -- 172.21.15.17:0/2223830115 shutdown_connections 2023-07-14T13:02:51.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.218+0000 7f405ede6b80 1 -- 172.21.15.17:0/2223830115 wait complete. 2023-07-14T13:02:51.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.218+0000 7f405ede6b80 1 -- start start 2023-07-14T13:02:51.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.219+0000 7f405ede6b80 1 Processor -- start 2023-07-14T13:02:51.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.219+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x5623982136e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.219+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201c60 0x562398211b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.219+0000 7f405ede6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56239820cb50 0x5623982121c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.219+0000 7f405ede6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623982128a0 con 0x562398201350 2023-07-14T13:02:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.219+0000 7f405ede6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562398212a10 con 0x56239820cb50 2023-07-14T13:02:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.219+0000 7f405ede6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562398270190 con 0x562398201c60 2023-07-14T13:02:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.219+0000 7f405ede6b80 10 client.0 _ll_register_callbacks cb 0x5623980f17e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.219+0000 7f404919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x5623982136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.220+0000 7f404919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x5623982136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45164/0 (socket says 172.21.15.17:45164) 2023-07-14T13:02:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.220+0000 7f404919b700 1 -- 172.21.15.17:0/2109037194 learned_addr learned my addr 172.21.15.17:0/2109037194 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.220+0000 7f404999c700 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56239820cb50 0x5623982121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.220+0000 7f404899a700 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201c60 0x562398211b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.220+0000 7f404919b700 1 -- 172.21.15.17:0/2109037194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201c60 msgr2=0x562398211b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.220+0000 7f404919b700 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201c60 0x562398211b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.220+0000 7f404919b700 1 -- 172.21.15.17:0/2109037194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56239820cb50 msgr2=0x5623982121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.220+0000 7f404919b700 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56239820cb50 0x5623982121c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.220+0000 7f404919b700 1 -- 172.21.15.17:0/2109037194 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404000bd50 con 0x562398201350 2023-07-14T13:02:51.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.220+0000 7f404919b700 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x5623982136e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x56239821efb0 tx=0x7f404001ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e1b7b32c4213ec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.220+0000 7f402cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:51.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.221+0000 7f402cff9700 1 -- 172.21.15.17:0/2109037194 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040003880 con 0x562398201350 2023-07-14T13:02:51.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.221+0000 7f402cff9700 1 -- 172.21.15.17:0/2109037194 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f40400039e0 con 0x562398201350 2023-07-14T13:02:51.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.221+0000 7f405ede6b80 1 -- 172.21.15.17:0/2109037194 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f403c00ddd0 con 0x562398201350 2023-07-14T13:02:51.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.221+0000 7f402cff9700 1 -- 172.21.15.17:0/2109037194 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4040003ba0 con 0x562398201350 2023-07-14T13:02:51.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.221+0000 7f405ede6b80 10 client.16353 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:51.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.221+0000 7f405ede6b80 1 -- 172.21.15.17:0/2109037194 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7f40441a4ba0 con 0x562398201350 2023-07-14T13:02:51.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.221+0000 7f402cff9700 1 -- 172.21.15.17:0/2109037194 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f403c00ddd0 con 0x562398201350 2023-07-14T13:02:51.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.221+0000 7f402cff9700 1 -- 172.21.15.17:0/2109037194 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f404002f430 con 0x562398201350 2023-07-14T13:02:51.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.222+0000 7f405ede6b80 10 client.16353 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:51.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.222+0000 7f405ede6b80 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:51.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.222+0000 7f405ede6b80 20 client.16353 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.222+0000 7f405ede6b80 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562398271990 0x562398273da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.222+0000 7f405ede6b80 4 client.16353 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:02:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.222+0000 7f405ede6b80 1 -- 172.21.15.17:0/2109037194 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56239810f0d0 con 0x562398271990 2023-07-14T13:02:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.222+0000 7f404899a700 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562398271990 0x562398273da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.223+0000 7f404899a700 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562398271990 0x562398273da0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=228ac46b7ea0704e server_cookie=abdde6cebb4320ac in_seq=0 out_seq=0 2023-07-14T13:02:51.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.223+0000 7f402cff9700 10 client.16353 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:51.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.224+0000 7f402cff9700 1 -- 172.21.15.17:0/2109037194 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56239810f0d0 con 0x562398271990 2023-07-14T13:02:51.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.224+0000 7f402cff9700 10 client.16353 handle_command_reply: tid=0 2023-07-14T13:02:51.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.224+0000 7f405ede6b80 1 client.16353 shutdown 2023-07-14T13:02:51.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f405ede6b80 1 -- 172.21.15.17:0/2109037194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 msgr2=0x5623982136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f405ede6b80 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x5623982136e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x56239821efb0 tx=0x7f404001ed20 comp rx=0 tx=0).stop 2023-07-14T13:02:51.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f405ede6b80 1 -- 172.21.15.17:0/2109037194 shutdown_connections 2023-07-14T13:02:51.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f405ede6b80 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562398271990 0x562398273da0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f405ede6b80 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56239820cb50 0x5623982121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f405ede6b80 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562398201350 0x5623982136e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f405ede6b80 1 --2- 172.21.15.17:0/2109037194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562398201c60 0x562398211b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f405ede6b80 1 -- 172.21.15.17:0/2109037194 >> 172.21.15.17:0/2109037194 conn(0x5623981f7e20 msgr2=0x56239820b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f402cff9700 0 client.16353 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:51.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f405ede6b80 1 -- 172.21.15.17:0/2109037194 shutdown_connections 2023-07-14T13:02:51.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f405ede6b80 1 -- 172.21.15.17:0/2109037194 wait complete. 2023-07-14T13:02:51.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.225+0000 7f405ede6b80 20 client.16353 trim_cache size 0 max 16384 2023-07-14T13:02:51.268 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:02:51.268 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:02:51.268 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "9069ce0f-52f7-49c3-91a4-3feafc9baecd", 2023-07-14T13:02:51.268 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:02:51.268 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:02:51.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 -- 172.21.15.17:0/1526660779 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40300a12c0 msgr2=0x7f40300a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40300a12c0 0x7f40300a3770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f403400b5c0 tx=0x7f4034005750 comp rx=0 tx=0).stop 2023-07-14T13:02:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 -- 172.21.15.17:0/1526660779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f404410a070 msgr2=0x7f404419c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f404410a070 0x7f404419c710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f403c007ee0 tx=0x7f403c00d3b0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 -- 172.21.15.17:0/1526660779 shutdown_connections 2023-07-14T13:02:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40300a12c0 0x7f40300a3770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f404410a070 0x7f404419c710 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4044100ca0 0x7f4044197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 --2- 172.21.15.17:0/1526660779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40441015b0 0x7f40441982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 -- 172.21.15.17:0/1526660779 >> 172.21.15.17:0/1526660779 conn(0x7f40440fa4b0 msgr2=0x7f404410c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 -- 172.21.15.17:0/1526660779 shutdown_connections 2023-07-14T13:02:51.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.226+0000 7f404b3ff700 1 -- 172.21.15.17:0/1526660779 wait complete. 2023-07-14T13:02:51.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:02:51.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:51 smithi017 ceph-mon[95536]: pgmap v96: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 MiB/s wr, 32 op/s 2023-07-14T13:02:51.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:51 smithi135 ceph-mon[97338]: pgmap v96: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 MiB/s wr, 32 op/s 2023-07-14T13:02:51.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:51 smithi131 ceph-mon[96953]: pgmap v96: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 MiB/s wr, 32 op/s 2023-07-14T13:02:51.499 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 13:02:51 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-b[122274]: 2023-07-14T13:02:51.246+0000 7f0425da4700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...4,head] /volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical/ auth{1=1,2=1} v1726 ap=2 f(v2 m2023-07-14T13:01:47.247614+0000 3=1+2) n(v2 rc2023-07-14T13:01:47.247614+0000 b8 4=1+3) old_inodes=2 (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/-@57} | dirtyscattered=0 request=0 lock=3 importing=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x564c11ab0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v478>,<0x10000000005/data v101>,<0x10000000003/postgres v23>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v37>,<0x10000000001/sv_0 v55>,<0x10000000000/_nogroup v41>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v1726>,<0x10000000005/data v834>,<0x10000000003/postgres v247>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v265>,<0x10000000001/sv_0 v280>,<0x10000000000/_nogroup v262>,<0x1/volumes v253>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-07-14T13:01:47.232781+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2023-07-14T13:01:47.247614+0000 b8 4=1+3)","memory_value.dirstat":"f(v2 m2023-07-14T13:01:47.247614+0000 3=1+2)","memory_value.rstat":"n(v2 rc2023-07-14T13:01:47.247614+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-07-14T13:02:51.499 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 13:02:51 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-b[122274]: 2023-07-14T13:02:51.247+0000 7f0425da4700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000019 [...5,head] /volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp/ auth{1=1,2=1} v1834 ap=2 f(v20 m2023-07-14T13:02:10.059252+0000 3=3+0) n(v2 rc2023-07-14T13:02:10.059252+0000 b3321 4=3+1) old_inodes=3 (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/-@63} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x564c11aaf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v38>,<0x10000000005/data v101>,<0x10000000003/postgres v23>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v37>,<0x10000000001/sv_0 v55>,<0x10000000000/_nogroup v41>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v1834>,<0x10000000005/data v834>,<0x10000000003/postgres v247>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v265>,<0x10000000001/sv_0 v280>,<0x10000000000/_nogroup v262>,<0x1/volumes v253>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-07-14T13:02:10.045448+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2023-07-14T13:02:10.059252+0000 b3321 4=3+1)","memory_value.dirstat":"f(v20 m2023-07-14T13:02:10.059252+0000 3=3+0)","memory_value.rstat":"n(v2 rc2023-07-14T13:02:10.059252+0000 b3321 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-07-14T13:02:51.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.500+0000 7fa5a3bff700 1 -- 172.21.15.17:0/571723153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c1015b0 msgr2=0x7fa59c109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.500+0000 7fa5a3bff700 1 --2- 172.21.15.17:0/571723153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c1015b0 0x7fa59c109aa0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009990 tx=0x7fa58c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.500+0000 7fa5a3bff700 1 -- 172.21.15.17:0/571723153 shutdown_connections 2023-07-14T13:02:51.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.500+0000 7fa5a3bff700 1 --2- 172.21.15.17:0/571723153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa59c10a070 0x7fa59c10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.500+0000 7fa5a3bff700 1 --2- 172.21.15.17:0/571723153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa59c100ca0 0x7fa59c101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.500+0000 7fa5a3bff700 1 --2- 172.21.15.17:0/571723153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c1015b0 0x7fa59c109aa0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.500+0000 7fa5a3bff700 1 -- 172.21.15.17:0/571723153 >> 172.21.15.17:0/571723153 conn(0x7fa59c0fa4b0 msgr2=0x7fa59c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.500+0000 7fa5a3bff700 1 -- 172.21.15.17:0/571723153 shutdown_connections 2023-07-14T13:02:51.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.500+0000 7fa5a3bff700 1 -- 172.21.15.17:0/571723153 wait complete. 2023-07-14T13:02:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.501+0000 7fa5a3bff700 1 Processor -- start 2023-07-14T13:02:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.502+0000 7fa5a3bff700 1 -- start start 2023-07-14T13:02:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.502+0000 7fa5a3bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa59c100ca0 0x7fa59c19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.502+0000 7fa5a3bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c1015b0 0x7fa59c19bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.502+0000 7fa5a3bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa59c10a070 0x7fa59c195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.502+0000 7fa5a3bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c1960a0 con 0x7fa59c1015b0 2023-07-14T13:02:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.502+0000 7fa5a3bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c196210 con 0x7fa59c10a070 2023-07-14T13:02:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.502+0000 7fa5a3bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c1963d0 con 0x7fa59c100ca0 2023-07-14T13:02:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.502+0000 7fa5a119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c1015b0 0x7fa59c19bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.502+0000 7fa5a119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c1015b0 0x7fa59c19bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45188/0 (socket says 172.21.15.17:45188) 2023-07-14T13:02:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.502+0000 7fa5a199b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa59c100ca0 0x7fa59c19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.502+0000 7fa5a119a700 1 -- 172.21.15.17:0/920148168 learned_addr learned my addr 172.21.15.17:0/920148168 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.503+0000 7fa5a219c700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa59c10a070 0x7fa59c195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.503+0000 7fa5a119a700 1 -- 172.21.15.17:0/920148168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa59c100ca0 msgr2=0x7fa59c19b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.503+0000 7fa5a119a700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa59c100ca0 0x7fa59c19b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.503+0000 7fa5a119a700 1 -- 172.21.15.17:0/920148168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa59c10a070 msgr2=0x7fa59c195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.503+0000 7fa5a119a700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa59c10a070 0x7fa59c195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.503+0000 7fa5a119a700 1 -- 172.21.15.17:0/920148168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0095f0 con 0x7fa59c1015b0 2023-07-14T13:02:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.503+0000 7fa5a119a700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c1015b0 0x7fa59c19bf00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa58c005740 tx=0x7fa58c005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.504+0000 7fa592ffd700 1 -- 172.21.15.17:0/920148168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c01d070 con 0x7fa59c1015b0 2023-07-14T13:02:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.504+0000 7fa5a3bff700 1 -- 172.21.15.17:0/920148168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59c196650 con 0x7fa59c1015b0 2023-07-14T13:02:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.504+0000 7fa592ffd700 1 -- 172.21.15.17:0/920148168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa58c022470 con 0x7fa59c1015b0 2023-07-14T13:02:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.504+0000 7fa592ffd700 1 -- 172.21.15.17:0/920148168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c017650 con 0x7fa59c1015b0 2023-07-14T13:02:51.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.504+0000 7fa5a3bff700 1 -- 172.21.15.17:0/920148168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c1a29b0 con 0x7fa59c1015b0 2023-07-14T13:02:51.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.508+0000 7fa592ffd700 1 -- 172.21.15.17:0/920148168 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa58c00fb00 con 0x7fa59c1015b0 2023-07-14T13:02:51.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.509+0000 7fa5b75a9b80 1 Processor -- start 2023-07-14T13:02:51.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.509+0000 7fa5b75a9b80 1 -- start start 2023-07-14T13:02:51.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad112d0 0x55799ad116a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 0x55799ad209a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad232c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ac17cb0 con 0x55799ad20ee0 2023-07-14T13:02:51.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ac6aa40 con 0x55799ad11be0 2023-07-14T13:02:51.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ac63ed0 con 0x55799ad112d0 2023-07-14T13:02:51.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa5a119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa592ffd700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5880a12c0 0x7fa5880a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa5a119a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad232c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45194/0 (socket says 172.21.15.17:45194) 2023-07-14T13:02:51.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa5a119a700 1 -- 172.21.15.17:0/1454274958 learned_addr learned my addr 172.21.15.17:0/1454274958 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:51.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa5a219c700 1 --2- 172.21.15.17:0/1454274958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad112d0 0x55799ad116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.510+0000 7fa5a199b700 1 --2- 172.21.15.17:0/1454274958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 0x55799ad209a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa592ffd700 1 -- 172.21.15.17:0/920148168 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa58c0ce230 con 0x7fa59c1015b0 2023-07-14T13:02:51.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa5a219c700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5880a12c0 0x7fa5880a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa5a199b700 1 -- 172.21.15.17:0/1454274958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad112d0 msgr2=0x55799ad116a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa5a199b700 1 --2- 172.21.15.17:0/1454274958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad112d0 0x55799ad116a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa5a199b700 1 -- 172.21.15.17:0/1454274958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 msgr2=0x55799ad232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa5a199b700 1 --2- 172.21.15.17:0/1454274958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad232c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa5a199b700 1 -- 172.21.15.17:0/1454274958 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55799aa91de0 con 0x55799ad11be0 2023-07-14T13:02:51.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa5a119a700 1 --2- 172.21.15.17:0/1454274958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:51.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa5a199b700 1 --2- 172.21.15.17:0/1454274958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 0x55799ad209a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa598009cb0 tx=0x7fa598011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=449b3733421e5ab6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa587fff700 1 -- 172.21.15.17:0/1454274958 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598011d20 con 0x55799ad11be0 2023-07-14T13:02:51.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa587fff700 1 -- 172.21.15.17:0/1454274958 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa598011e80 con 0x55799ad11be0 2023-07-14T13:02:51.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.511+0000 7fa587fff700 1 -- 172.21.15.17:0/1454274958 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598005280 con 0x55799ad11be0 2023-07-14T13:02:51.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.512+0000 7fa5a219c700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5880a12c0 0x7fa5880a3770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa594003fd0 tx=0x7fa594004b40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.512+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/1454274958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 msgr2=0x55799ad209a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.512+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/1454274958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 0x55799ad209a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa598009cb0 tx=0x7fa598011440 comp rx=0 tx=0).stop 2023-07-14T13:02:51.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.512+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/1454274958 shutdown_connections 2023-07-14T13:02:51.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.512+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/1454274958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.512+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/1454274958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad112d0 0x55799ad116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.512+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/1454274958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 0x55799ad209a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.512+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/1454274958 >> 172.21.15.17:0/1454274958 conn(0x55799ad07da0 msgr2=0x55799ad0d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.512+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/1454274958 shutdown_connections 2023-07-14T13:02:51.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.513+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/1454274958 wait complete. 2023-07-14T13:02:51.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.513+0000 7fa5b75a9b80 1 -- start start 2023-07-14T13:02:51.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.513+0000 7fa5b75a9b80 1 Processor -- start 2023-07-14T13:02:51.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.514+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 0x55799ad20930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.514+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad11be0 0x55799ad1db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.514+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad1e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.514+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ac03ac0 con 0x55799ad20ee0 2023-07-14T13:02:51.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.514+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ac037c0 con 0x55799ad112d0 2023-07-14T13:02:51.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.514+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799aae7920 con 0x55799ad11be0 2023-07-14T13:02:51.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.514+0000 7fa5b75a9b80 10 client.0 _ll_register_callbacks cb 0x55799ac01760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:51.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad1e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a119a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad11be0 0x55799ad1db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad1e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45200/0 (socket says 172.21.15.17:45200) 2023-07-14T13:02:51.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a219c700 1 -- 172.21.15.17:0/4102812958 learned_addr learned my addr 172.21.15.17:0/4102812958 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:51.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a199b700 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 0x55799ad20930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a119a700 1 -- 172.21.15.17:0/4102812958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 msgr2=0x55799ad20930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a119a700 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 0x55799ad20930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a119a700 1 -- 172.21.15.17:0/4102812958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 msgr2=0x55799ad1e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a119a700 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad1e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a119a700 1 -- 172.21.15.17:0/4102812958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c1a29b0 con 0x55799ad11be0 2023-07-14T13:02:51.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a219c700 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad1e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:51.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5a119a700 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad11be0 0x55799ad1db40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa58c024000 tx=0x7fa58c005910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25eab3050f73f8a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.515+0000 7fa5857fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:02:51.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.516+0000 7fa5857fa700 1 -- 172.21.15.17:0/4102812958 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c09aee0 con 0x55799ad11be0 2023-07-14T13:02:51.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.516+0000 7fa5857fa700 1 -- 172.21.15.17:0/4102812958 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa58c09b3a0 con 0x55799ad11be0 2023-07-14T13:02:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.516+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/4102812958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55799ac5ceb0 con 0x55799ad11be0 2023-07-14T13:02:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.516+0000 7fa5857fa700 1 -- 172.21.15.17:0/4102812958 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa58c09ad00 con 0x55799ad11be0 2023-07-14T13:02:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.516+0000 7fa5b75a9b80 10 client.26068 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.516+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/4102812958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fa5980098e0 con 0x55799ad11be0 2023-07-14T13:02:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.516+0000 7fa5857fa700 1 -- 172.21.15.17:0/4102812958 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55799ac5ceb0 con 0x55799ad11be0 2023-07-14T13:02:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.516+0000 7fa5857fa700 1 -- 172.21.15.17:0/4102812958 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa58c0a10b0 con 0x55799ad11be0 2023-07-14T13:02:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.516+0000 7fa5b75a9b80 10 client.26068 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.516+0000 7fa5b75a9b80 10 client.26068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:51.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.517+0000 7fa5b75a9b80 20 client.26068 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:51.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.517+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55799ad304e0 0x55799ad328f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.517+0000 7fa5b75a9b80 4 client.26068 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:51.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.517+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/4102812958 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55799ac1f050 con 0x55799ad304e0 2023-07-14T13:02:51.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.517+0000 7fa5a199b700 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55799ad304e0 0x55799ad328f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.518+0000 7fa5a199b700 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55799ad304e0 0x55799ad328f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65edafb697a0df0d server_cookie=3884a2e135b136f5 in_seq=0 out_seq=0 2023-07-14T13:02:51.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.518+0000 7fa5857fa700 10 client.26068 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5857fa700 1 -- 172.21.15.17:0/4102812958 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55799ac1f050 con 0x55799ad304e0 2023-07-14T13:02:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5857fa700 10 client.26068 handle_command_reply: tid=0 2023-07-14T13:02:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 1 client.26068 shutdown 2023-07-14T13:02:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/4102812958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad11be0 msgr2=0x55799ad1db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad11be0 0x55799ad1db40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa58c024000 tx=0x7fa58c005910 comp rx=0 tx=0).stop 2023-07-14T13:02:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/4102812958 shutdown_connections 2023-07-14T13:02:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55799ad304e0 0x55799ad328f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad1e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 0x55799ad20930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5857fa700 0 client.26068 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:51.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/4102812958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad11be0 0x55799ad1db40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/4102812958 >> 172.21.15.17:0/4102812958 conn(0x55799ad07da0 msgr2=0x55799ad0d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/4102812958 shutdown_connections 2023-07-14T13:02:51.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/4102812958 wait complete. 2023-07-14T13:02:51.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.519+0000 7fa5b75a9b80 20 client.26068 trim_cache size 0 max 16384 2023-07-14T13:02:51.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.545+0000 7fa5b75a9b80 1 Processor -- start 2023-07-14T13:02:51.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.545+0000 7fa5b75a9b80 1 -- start start 2023-07-14T13:02:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.545+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 0x55799ad37250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.545+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad11be0 0x55799ad2cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.545+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad20ee0 0x55799ad20460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.545+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ad1e880 con 0x55799ad11be0 2023-07-14T13:02:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.545+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ad12330 con 0x55799ad112d0 2023-07-14T13:02:51.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.545+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ad12570 con 0x55799ad20ee0 2023-07-14T13:02:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a199b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 0x55799ad37250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a199b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 0x55799ad37250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33132/0 (socket says 172.21.15.17:33132) 2023-07-14T13:02:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a199b700 1 -- 172.21.15.17:0/2079372901 learned_addr learned my addr 172.21.15.17:0/2079372901 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a119a700 1 --2- 172.21.15.17:0/2079372901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad11be0 0x55799ad2cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a219c700 1 --2- 172.21.15.17:0/2079372901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad20ee0 0x55799ad20460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a199b700 1 -- 172.21.15.17:0/2079372901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad20ee0 msgr2=0x55799ad20460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a199b700 1 --2- 172.21.15.17:0/2079372901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad20ee0 0x55799ad20460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a199b700 1 -- 172.21.15.17:0/2079372901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad11be0 msgr2=0x55799ad2cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a199b700 1 --2- 172.21.15.17:0/2079372901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad11be0 0x55799ad2cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a199b700 1 -- 172.21.15.17:0/2079372901 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55799aa7ac60 con 0x55799ad112d0 2023-07-14T13:02:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a219c700 1 --2- 172.21.15.17:0/2079372901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad20ee0 0x55799ad20460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:02:51.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.546+0000 7fa5a199b700 1 --2- 172.21.15.17:0/2079372901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 0x55799ad37250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa598004cf0 tx=0x7fa598009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9fc464d5ae9cd76 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.547+0000 7fa590bff700 1 -- 172.21.15.17:0/2079372901 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598004a30 con 0x55799ad112d0 2023-07-14T13:02:51.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.547+0000 7fa590bff700 1 -- 172.21.15.17:0/2079372901 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa598004050 con 0x55799ad112d0 2023-07-14T13:02:51.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.547+0000 7fa590bff700 1 -- 172.21.15.17:0/2079372901 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5980038e0 con 0x55799ad112d0 2023-07-14T13:02:51.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.548+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2079372901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 msgr2=0x55799ad37250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.548+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/2079372901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 0x55799ad37250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa598004cf0 tx=0x7fa598009bb0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.548+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2079372901 shutdown_connections 2023-07-14T13:02:51.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.548+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/2079372901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad20ee0 0x55799ad20460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.548+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/2079372901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad112d0 0x55799ad37250 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.548+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/2079372901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad11be0 0x55799ad2cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.548+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2079372901 >> 172.21.15.17:0/2079372901 conn(0x55799ad07da0 msgr2=0x55799ad09310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.548+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2079372901 shutdown_connections 2023-07-14T13:02:51.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.548+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2079372901 wait complete. 2023-07-14T13:02:51.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.548+0000 7fa5b75a9b80 1 -- start start 2023-07-14T13:02:51.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.549+0000 7fa5b75a9b80 1 Processor -- start 2023-07-14T13:02:51.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.549+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad112d0 0x55799ad26d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.549+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 0x55799ad27260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.549+0000 7fa5b75a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad16510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.549+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ad27a00 con 0x55799ad20ee0 2023-07-14T13:02:51.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.549+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ad16a80 con 0x55799ad11be0 2023-07-14T13:02:51.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.549+0000 7fa5b75a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ad16c40 con 0x55799ad112d0 2023-07-14T13:02:51.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.549+0000 7fa5b75a9b80 10 client.0 _ll_register_callbacks cb 0x55799ac01760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:51.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.550+0000 7fa5a119a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 0x55799ad27260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.550+0000 7fa5a219c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad16510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.550+0000 7fa5a119a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 0x55799ad27260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33140/0 (socket says 172.21.15.17:33140) 2023-07-14T13:02:51.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.550+0000 7fa5a119a700 1 -- 172.21.15.17:0/2818605125 learned_addr learned my addr 172.21.15.17:0/2818605125 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:51.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.550+0000 7fa5a199b700 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad112d0 0x55799ad26d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.550+0000 7fa5a119a700 1 -- 172.21.15.17:0/2818605125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad112d0 msgr2=0x55799ad26d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.550+0000 7fa5a119a700 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad112d0 0x55799ad26d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.550+0000 7fa5a119a700 1 -- 172.21.15.17:0/2818605125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 msgr2=0x55799ad16510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:51.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.550+0000 7fa5a119a700 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad16510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.550+0000 7fa5a119a700 1 -- 172.21.15.17:0/2818605125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59801d040 con 0x55799ad11be0 2023-07-14T13:02:51.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.551+0000 7fa5a119a700 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 0x55799ad27260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa58c097dc0 tx=0x7fa58c0977d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4b4659b8c27be97 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:51.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.551+0000 7fa5857fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:02:51.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.551+0000 7fa5857fa700 1 -- 172.21.15.17:0/2818605125 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c09aee0 con 0x55799ad11be0 2023-07-14T13:02:51.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.551+0000 7fa5857fa700 1 -- 172.21.15.17:0/2818605125 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa58c09b3a0 con 0x55799ad11be0 2023-07-14T13:02:51.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.551+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2818605125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55799abbd4f0 con 0x55799ad11be0 2023-07-14T13:02:51.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.551+0000 7fa5857fa700 1 -- 172.21.15.17:0/2818605125 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa58c09f3d0 con 0x55799ad11be0 2023-07-14T13:02:51.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.551+0000 7fa5b75a9b80 10 client.26114 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:51.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.551+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2818605125 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55799aab8250 con 0x55799ad11be0 2023-07-14T13:02:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.552+0000 7fa5857fa700 1 -- 172.21.15.17:0/2818605125 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55799abbd4f0 con 0x55799ad11be0 2023-07-14T13:02:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.552+0000 7fa5857fa700 1 -- 172.21.15.17:0/2818605125 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa58c0a10d0 con 0x55799ad11be0 2023-07-14T13:02:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.552+0000 7fa5b75a9b80 10 client.26114 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.552+0000 7fa5b75a9b80 10 client.26114 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.552+0000 7fa5b75a9b80 20 client.26114 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.552+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55799ad896d0 0x55799ad8bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.552+0000 7fa5b75a9b80 4 client.26114 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:02:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.552+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2818605125 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55799aab2f70 con 0x55799ad896d0 2023-07-14T13:02:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.552+0000 7fa5a199b700 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55799ad896d0 0x55799ad8bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5857fa700 10 client.26114 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5a199b700 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55799ad896d0 0x55799ad8bae0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51a83153abdd56fe server_cookie=907c5416e2fa7366 in_seq=0 out_seq=0 2023-07-14T13:02:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5857fa700 1 -- 172.21.15.17:0/2818605125 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55799aab2f70 con 0x55799ad896d0 2023-07-14T13:02:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5857fa700 10 client.26114 handle_command_reply: tid=0 2023-07-14T13:02:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5b75a9b80 1 client.26114 shutdown 2023-07-14T13:02:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2818605125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 msgr2=0x55799ad27260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 0x55799ad27260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa58c097dc0 tx=0x7fa58c0977d0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2818605125 shutdown_connections 2023-07-14T13:02:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55799ad896d0 0x55799ad8bae0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55799ad20ee0 0x55799ad16510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55799ad112d0 0x55799ad26d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5b75a9b80 1 --2- 172.21.15.17:0/2818605125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799ad11be0 0x55799ad27260 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2818605125 >> 172.21.15.17:0/2818605125 conn(0x55799ad07da0 msgr2=0x55799ad18ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.553+0000 7fa5857fa700 0 client.26114 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.554+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2818605125 shutdown_connections 2023-07-14T13:02:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.554+0000 7fa5b75a9b80 1 -- 172.21.15.17:0/2818605125 wait complete. 2023-07-14T13:02:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.554+0000 7fa5b75a9b80 20 client.26114 trim_cache size 0 max 16384 2023-07-14T13:02:51.594 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:02:51.594 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:02:51.594 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:02:51.595 INFO:teuthology.orchestra.run.smithi017.stdout: "9069ce0f-52f7-49c3-91a4-3feafc9baecd": { 2023-07-14T13:02:51.595 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:02:51.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "9069ce0f-52f7-49c3-91a4-3feafc9baecd", 2023-07-14T13:02:51.595 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:02:51.595 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:02:51.595 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:02:51.595 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:02:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.554+0000 7fa5a3bff700 1 -- 172.21.15.17:0/920148168 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5880a12c0 msgr2=0x7fa5880a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.554+0000 7fa5a3bff700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5880a12c0 0x7fa5880a3770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa594003fd0 tx=0x7fa594004b40 comp rx=0 tx=0).stop 2023-07-14T13:02:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.554+0000 7fa5a3bff700 1 -- 172.21.15.17:0/920148168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c1015b0 msgr2=0x7fa59c19bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.554+0000 7fa5a3bff700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c1015b0 0x7fa59c19bf00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa58c005740 tx=0x7fa58c005770 comp rx=0 tx=0).stop 2023-07-14T13:02:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.555+0000 7fa5a3bff700 1 -- 172.21.15.17:0/920148168 shutdown_connections 2023-07-14T13:02:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.555+0000 7fa5a3bff700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5880a12c0 0x7fa5880a3770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.555+0000 7fa5a3bff700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa59c10a070 0x7fa59c195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.555+0000 7fa5a3bff700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa59c100ca0 0x7fa59c19b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.555+0000 7fa5a3bff700 1 --2- 172.21.15.17:0/920148168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa59c1015b0 0x7fa59c19bf00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.555+0000 7fa5a3bff700 1 -- 172.21.15.17:0/920148168 >> 172.21.15.17:0/920148168 conn(0x7fa59c0fa4b0 msgr2=0x7fa59c10c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.555+0000 7fa5a3bff700 1 -- 172.21.15.17:0/920148168 shutdown_connections 2023-07-14T13:02:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:02:51.555+0000 7fa5a3bff700 1 -- 172.21.15.17:0/920148168 wait complete. 2023-07-14T13:02:51.607 INFO:tasks.cephfs.filesystem:scrub status for tag:9069ce0f-52f7-49c3-91a4-3feafc9baecd - {'path': '/', 'tag': '9069ce0f-52f7-49c3-91a4-3feafc9baecd', 'options': 'recursive,force'} 2023-07-14T13:02:52.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:52 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:02:52.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:52 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:52.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:52 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:02:52.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:52 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:02:52.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:52 smithi135 ceph-mon[97338]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-14T13:02:52.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:52 smithi135 ceph-mon[97338]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2023-07-14T13:02:52.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:52 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:52.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:52 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:02:52.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:52 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:52.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:52 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:02:52.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:52 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:02:52.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:52 smithi131 ceph-mon[96953]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-14T13:02:52.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:52 smithi131 ceph-mon[96953]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2023-07-14T13:02:52.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:52 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:52.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:52 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:02:52.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:52 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:52.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:52 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:02:52.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:52 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:02:52.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:52 smithi017 ceph-mon[95536]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-14T13:02:52.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:52 smithi017 ceph-mon[95536]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2023-07-14T13:02:52.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:52 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:52.755 INFO:teuthology.orchestra.run.smithi017.stderr:9700000 of 50000000 tuples (19%) done (elapsed 162.36 s, remaining 674.54 s) 2023-07-14T13:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.832+0000 7f0ab75ff700 1 -- 172.21.15.17:0/1183618121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00728b0 msgr2=0x7f0ab0072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:52.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.832+0000 7f0ab75ff700 1 --2- 172.21.15.17:0/1183618121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00728b0 0x7f0ab0072c80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009990 tx=0x7f0aac009ca0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.832+0000 7f0ab75ff700 1 -- 172.21.15.17:0/1183618121 shutdown_connections 2023-07-14T13:02:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.832+0000 7f0ab75ff700 1 --2- 172.21.15.17:0/1183618121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ab0110b10 0x7f0ab0112ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.832+0000 7f0ab75ff700 1 --2- 172.21.15.17:0/1183618121 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00728b0 0x7f0ab0072c80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.832+0000 7f0ab75ff700 1 --2- 172.21.15.17:0/1183618121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab00731c0 0x7f0ab01105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.832+0000 7f0ab75ff700 1 -- 172.21.15.17:0/1183618121 >> 172.21.15.17:0/1183618121 conn(0x7f0ab00fb600 msgr2=0x7f0ab00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.833+0000 7f0ab75ff700 1 -- 172.21.15.17:0/1183618121 shutdown_connections 2023-07-14T13:02:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.833+0000 7f0ab75ff700 1 -- 172.21.15.17:0/1183618121 wait complete. 2023-07-14T13:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.834+0000 7f0ab75ff700 1 Processor -- start 2023-07-14T13:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.834+0000 7f0ab75ff700 1 -- start start 2023-07-14T13:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.834+0000 7f0ab75ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab00728b0 0x7f0ab019c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.834+0000 7f0ab75ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00731c0 0x7f0ab019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.834+0000 7f0ab75ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ab0110b10 0x7f0ab01a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.834+0000 7f0ab75ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01a12f0 con 0x7f0ab00731c0 2023-07-14T13:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.834+0000 7f0ab75ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01a1460 con 0x7f0ab0110b10 2023-07-14T13:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.834+0000 7f0ab75ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab01a1620 con 0x7f0ab00728b0 2023-07-14T13:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.835+0000 7f0ab539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab00728b0 0x7f0ab019c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.835+0000 7f0ab4b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00731c0 0x7f0ab019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.835+0000 7f0ab539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab00728b0 0x7f0ab019c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60878/0 (socket says 172.21.15.17:60878) 2023-07-14T13:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.835+0000 7f0ab539b700 1 -- 172.21.15.17:0/2466342594 learned_addr learned my addr 172.21.15.17:0/2466342594 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.835+0000 7f0ab5b9c700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ab0110b10 0x7f0ab01a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.835+0000 7f0ab4b9a700 1 -- 172.21.15.17:0/2466342594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab00728b0 msgr2=0x7f0ab019c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.835+0000 7f0ab4b9a700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab00728b0 0x7f0ab019c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.835+0000 7f0ab4b9a700 1 -- 172.21.15.17:0/2466342594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ab0110b10 msgr2=0x7f0ab01a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.835+0000 7f0ab4b9a700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ab0110b10 0x7f0ab01a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.835+0000 7f0ab4b9a700 1 -- 172.21.15.17:0/2466342594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac0095f0 con 0x7f0ab00731c0 2023-07-14T13:02:52.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.835+0000 7f0ab539b700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab00728b0 0x7f0ab019c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:02:52.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.836+0000 7f0ab4b9a700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00731c0 0x7f0ab019c640 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000d950 tx=0x7f0aa000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:52.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.836+0000 7f0aa67fc700 1 -- 172.21.15.17:0/2466342594 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa000f890 con 0x7f0ab00731c0 2023-07-14T13:02:52.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.836+0000 7f0ab75ff700 1 -- 172.21.15.17:0/2466342594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab01a1900 con 0x7f0ab00731c0 2023-07-14T13:02:52.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.836+0000 7f0aa67fc700 1 -- 172.21.15.17:0/2466342594 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0aa000fe80 con 0x7f0ab00731c0 2023-07-14T13:02:52.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.836+0000 7f0aa67fc700 1 -- 172.21.15.17:0/2466342594 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa000e3b0 con 0x7f0ab00731c0 2023-07-14T13:02:52.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.836+0000 7f0ab75ff700 1 -- 172.21.15.17:0/2466342594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab01a9140 con 0x7f0ab00731c0 2023-07-14T13:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.840+0000 7f0aa67fc700 1 -- 172.21.15.17:0/2466342594 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0aa000f9f0 con 0x7f0ab00731c0 2023-07-14T13:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.841+0000 7f0acae6ab80 1 Processor -- start 2023-07-14T13:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.842+0000 7f0acae6ab80 1 -- start start 2023-07-14T13:02:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.842+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b4699d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.842+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b469a2d0 0x55b3b4694040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.842+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b46949d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.842+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b4599c50 con 0x55b3b4694580 2023-07-14T13:02:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.842+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b45ec9e0 con 0x55b3b469a2d0 2023-07-14T13:02:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.842+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b45e5e70 con 0x55b3b44f06b0 2023-07-14T13:02:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.842+0000 7f0aa67fc700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a9c0a12c0 0x7f0a9c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab4b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b46949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab5b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b4699d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab5b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b4699d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60886/0 (socket says 172.21.15.17:60886) 2023-07-14T13:02:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0aa67fc700 1 -- 172.21.15.17:0/2466342594 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0aa00cc400 con 0x7f0ab00731c0 2023-07-14T13:02:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab5b9c700 1 -- 172.21.15.17:0/3664237819 learned_addr learned my addr 172.21.15.17:0/3664237819 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab4b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b46949d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45242/0 (socket says 172.21.15.17:45242) 2023-07-14T13:02:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab539b700 1 --2- 172.21.15.17:0/3664237819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b469a2d0 0x55b3b4694040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab5b9c700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a9c0a12c0 0x7f0a9c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab5b9c700 1 -- 172.21.15.17:0/3664237819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b469a2d0 msgr2=0x55b3b4694040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab5b9c700 1 --2- 172.21.15.17:0/3664237819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b469a2d0 0x55b3b4694040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab5b9c700 1 -- 172.21.15.17:0/3664237819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 msgr2=0x55b3b46949d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab5b9c700 1 --2- 172.21.15.17:0/3664237819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b46949d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.843+0000 7f0ab5b9c700 1 -- 172.21.15.17:0/3664237819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3b4413d80 con 0x55b3b44f06b0 2023-07-14T13:02:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.844+0000 7f0ab5b9c700 1 --2- 172.21.15.17:0/3664237819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b4699d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8014fc0 tx=0x7f0aa8018660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=900d2fd1e34aa802 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.844+0000 7f0ab5b9c700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a9c0a12c0 0x7f0a9c0a3770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8007b90 tx=0x7f0aa8009000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.844+0000 7f0a9b7fe700 1 -- 172.21.15.17:0/3664237819 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8004bb0 con 0x55b3b44f06b0 2023-07-14T13:02:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.844+0000 7f0a9b7fe700 1 -- 172.21.15.17:0/3664237819 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0aa801d070 con 0x55b3b44f06b0 2023-07-14T13:02:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.844+0000 7f0a9b7fe700 1 -- 172.21.15.17:0/3664237819 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8021680 con 0x55b3b44f06b0 2023-07-14T13:02:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.845+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3664237819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 msgr2=0x55b3b4699d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.845+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/3664237819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b4699d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8014fc0 tx=0x7f0aa8018660 comp rx=0 tx=0).stop 2023-07-14T13:02:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.845+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3664237819 shutdown_connections 2023-07-14T13:02:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.845+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/3664237819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b46949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.845+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/3664237819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b4699d90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.845+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/3664237819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b469a2d0 0x55b3b4694040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.845+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3664237819 >> 172.21.15.17:0/3664237819 conn(0x55b3b4689be0 msgr2=0x55b3b468ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.845+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3664237819 shutdown_connections 2023-07-14T13:02:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.845+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3664237819 wait complete. 2023-07-14T13:02:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.846+0000 7f0acae6ab80 1 -- start start 2023-07-14T13:02:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.846+0000 7f0acae6ab80 1 Processor -- start 2023-07-14T13:02:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b46a0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b469d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b469a2d0 0x55b3b469e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b4585a60 con 0x55b3b4694580 2023-07-14T13:02:52.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b4585760 con 0x55b3b469a2d0 2023-07-14T13:02:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b44698c0 con 0x55b3b44f06b0 2023-07-14T13:02:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0acae6ab80 10 client.0 _ll_register_callbacks cb 0x55b3b4583700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:52.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0ab4b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b469d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0ab4b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b469d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45252/0 (socket says 172.21.15.17:45252) 2023-07-14T13:02:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0ab539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b46a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0ab4b9a700 1 -- 172.21.15.17:0/3249276559 learned_addr learned my addr 172.21.15.17:0/3249276559 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0ab5b9c700 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b469a2d0 0x55b3b469e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0ab4b9a700 1 -- 172.21.15.17:0/3249276559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 msgr2=0x55b3b46a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0ab4b9a700 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b46a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0ab4b9a700 1 -- 172.21.15.17:0/3249276559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b469a2d0 msgr2=0x55b3b469e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0ab4b9a700 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b469a2d0 0x55b3b469e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.847+0000 7f0ab4b9a700 1 -- 172.21.15.17:0/3249276559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa8014b70 con 0x55b3b4694580 2023-07-14T13:02:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.848+0000 7f0ab4b9a700 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b469d920 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00959e0 tx=0x7f0aa008ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a7d49dfa5305c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.848+0000 7f0a98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.848+0000 7f0a98ff9700 1 -- 172.21.15.17:0/3249276559 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa009d350 con 0x55b3b4694580 2023-07-14T13:02:52.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.848+0000 7f0a98ff9700 1 -- 172.21.15.17:0/3249276559 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0aa000fca0 con 0x55b3b4694580 2023-07-14T13:02:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.848+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3249276559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b3b453f490 con 0x55b3b4694580 2023-07-14T13:02:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.848+0000 7f0a98ff9700 1 -- 172.21.15.17:0/3249276559 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aa00994e0 con 0x55b3b4694580 2023-07-14T13:02:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.848+0000 7f0acae6ab80 10 client.16383 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:52.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.848+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3249276559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55b3b43fcc00 con 0x55b3b4694580 2023-07-14T13:02:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.849+0000 7f0a98ff9700 1 -- 172.21.15.17:0/3249276559 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b3b453f490 con 0x55b3b4694580 2023-07-14T13:02:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.849+0000 7f0a98ff9700 1 -- 172.21.15.17:0/3249276559 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0aa00cb070 con 0x55b3b4694580 2023-07-14T13:02:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.849+0000 7f0acae6ab80 10 client.16383 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:52.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.849+0000 7f0acae6ab80 10 client.16383 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.849+0000 7f0acae6ab80 20 client.16383 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.849+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3b46adbb0 0x55b3b46affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.849+0000 7f0acae6ab80 4 client.16383 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:02:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.849+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3249276559 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b3b45dee50 con 0x55b3b46adbb0 2023-07-14T13:02:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.850+0000 7f0ab539b700 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3b46adbb0 0x55b3b46affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.850+0000 7f0ab539b700 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3b46adbb0 0x55b3b46affc0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e14e9777d83da849 server_cookie=2f4e525f40cb2048 in_seq=0 out_seq=0 2023-07-14T13:02:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.850+0000 7f0a98ff9700 10 client.16383 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0a98ff9700 1 -- 172.21.15.17:0/3249276559 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b3b45dee50 con 0x55b3b46adbb0 2023-07-14T13:02:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0a98ff9700 10 client.16383 handle_command_reply: tid=0 2023-07-14T13:02:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0acae6ab80 1 client.16383 shutdown 2023-07-14T13:02:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3249276559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 msgr2=0x55b3b469d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b469d920 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00959e0 tx=0x7f0aa008ee70 comp rx=0 tx=0).stop 2023-07-14T13:02:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3249276559 shutdown_connections 2023-07-14T13:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3b46adbb0 0x55b3b46affc0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b469a2d0 0x55b3b469e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b46a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0a98ff9700 0 client.16383 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/3249276559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b469d920 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.851+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3249276559 >> 172.21.15.17:0/3249276559 conn(0x55b3b4689be0 msgr2=0x55b3b468dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.852+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3249276559 shutdown_connections 2023-07-14T13:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.852+0000 7f0acae6ab80 1 -- 172.21.15.17:0/3249276559 wait complete. 2023-07-14T13:02:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.852+0000 7f0acae6ab80 20 client.16383 trim_cache size 0 max 16384 2023-07-14T13:02:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.868+0000 7f0acae6ab80 1 Processor -- start 2023-07-14T13:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.868+0000 7f0acae6ab80 1 -- start start 2023-07-14T13:02:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.868+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b4694040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.868+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b4694580 0x55b3b468ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.868+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b469a2d0 0x55b3b46a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.868+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b4699a10 con 0x55b3b469a2d0 2023-07-14T13:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.868+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b4690a70 con 0x55b3b4694580 2023-07-14T13:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.868+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b468bd00 con 0x55b3b44f06b0 2023-07-14T13:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.869+0000 7f0ab5b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b469a2d0 0x55b3b46a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.869+0000 7f0ab5b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b469a2d0 0x55b3b46a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45260/0 (socket says 172.21.15.17:45260) 2023-07-14T13:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.869+0000 7f0ab5b9c700 1 -- 172.21.15.17:0/4192543818 learned_addr learned my addr 172.21.15.17:0/4192543818 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.869+0000 7f0ab4b9a700 1 --2- 172.21.15.17:0/4192543818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b4694580 0x55b3b468ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.869+0000 7f0ab539b700 1 --2- 172.21.15.17:0/4192543818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b4694040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.869+0000 7f0ab5b9c700 1 -- 172.21.15.17:0/4192543818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 msgr2=0x55b3b4694040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.869+0000 7f0ab5b9c700 1 --2- 172.21.15.17:0/4192543818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b4694040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.869+0000 7f0ab5b9c700 1 -- 172.21.15.17:0/4192543818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b4694580 msgr2=0x55b3b468ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.869+0000 7f0ab5b9c700 1 --2- 172.21.15.17:0/4192543818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b4694580 0x55b3b468ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.869+0000 7f0ab5b9c700 1 -- 172.21.15.17:0/4192543818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3b443a1f0 con 0x55b3b469a2d0 2023-07-14T13:02:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.870+0000 7f0ab5b9c700 1 --2- 172.21.15.17:0/4192543818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b469a2d0 0x55b3b46a00c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8014e60 tx=0x7f0aa80079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488a164d21552a43 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.870+0000 7f0a9bfff700 1 -- 172.21.15.17:0/4192543818 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8003c00 con 0x55b3b469a2d0 2023-07-14T13:02:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.870+0000 7f0a9bfff700 1 -- 172.21.15.17:0/4192543818 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0aa8003d60 con 0x55b3b469a2d0 2023-07-14T13:02:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.870+0000 7f0a9bfff700 1 -- 172.21.15.17:0/4192543818 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8005530 con 0x55b3b469a2d0 2023-07-14T13:02:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.871+0000 7f0acae6ab80 1 -- 172.21.15.17:0/4192543818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b469a2d0 msgr2=0x55b3b46a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.871+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/4192543818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b469a2d0 0x55b3b46a00c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8014e60 tx=0x7f0aa80079d0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.871+0000 7f0acae6ab80 1 -- 172.21.15.17:0/4192543818 shutdown_connections 2023-07-14T13:02:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.871+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/4192543818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b469a2d0 0x55b3b46a00c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.871+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/4192543818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b44f06b0 0x55b3b4694040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.871+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/4192543818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b4694580 0x55b3b468ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.871+0000 7f0acae6ab80 1 -- 172.21.15.17:0/4192543818 >> 172.21.15.17:0/4192543818 conn(0x55b3b4689be0 msgr2=0x55b3b4697b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.871+0000 7f0acae6ab80 1 -- 172.21.15.17:0/4192543818 shutdown_connections 2023-07-14T13:02:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.871+0000 7f0acae6ab80 1 -- 172.21.15.17:0/4192543818 wait complete. 2023-07-14T13:02:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.871+0000 7f0acae6ab80 1 -- start start 2023-07-14T13:02:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.872+0000 7f0acae6ab80 1 Processor -- start 2023-07-14T13:02:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.872+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b44f06b0 0x55b3b46a2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.872+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b46a3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.872+0000 7f0acae6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b469a2d0 0x55b3b46faab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.872+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b46faff0 con 0x55b3b4694580 2023-07-14T13:02:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.872+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b46fb130 con 0x55b3b44f06b0 2023-07-14T13:02:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.872+0000 7f0acae6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3b46fb2f0 con 0x55b3b469a2d0 2023-07-14T13:02:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.872+0000 7f0acae6ab80 10 client.0 _ll_register_callbacks cb 0x55b3b4583700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:02:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.872+0000 7f0ab539b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b44f06b0 0x55b3b46a2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.873+0000 7f0ab4b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b46a3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.873+0000 7f0ab539b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b44f06b0 0x55b3b46a2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33198/0 (socket says 172.21.15.17:33198) 2023-07-14T13:02:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.873+0000 7f0ab539b700 1 -- 172.21.15.17:0/1685535805 learned_addr learned my addr 172.21.15.17:0/1685535805 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:02:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.873+0000 7f0ab5b9c700 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b469a2d0 0x55b3b46faab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.873+0000 7f0ab4b9a700 1 -- 172.21.15.17:0/1685535805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b469a2d0 msgr2=0x55b3b46faab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.873+0000 7f0ab4b9a700 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b469a2d0 0x55b3b46faab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.873+0000 7f0ab4b9a700 1 -- 172.21.15.17:0/1685535805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b44f06b0 msgr2=0x55b3b46a2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:02:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.873+0000 7f0ab4b9a700 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b44f06b0 0x55b3b46a2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.873+0000 7f0ab4b9a700 1 -- 172.21.15.17:0/1685535805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3b4413d80 con 0x55b3b4694580 2023-07-14T13:02:52.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.873+0000 7f0ab4b9a700 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b46a3380 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00991e0 tx=0x7f0aa0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7468627810919e56 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:02:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.873+0000 7f0a98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:02:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0a98ff9700 1 -- 172.21.15.17:0/1685535805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0098bd0 con 0x55b3b4694580 2023-07-14T13:02:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0acae6ab80 1 -- 172.21.15.17:0/1685535805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0aa801d070 con 0x55b3b4694580 2023-07-14T13:02:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0a98ff9700 1 -- 172.21.15.17:0/1685535805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0aa009a4d0 con 0x55b3b4694580 2023-07-14T13:02:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0a98ff9700 1 -- 172.21.15.17:0/1685535805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aa0095820 con 0x55b3b4694580 2023-07-14T13:02:52.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0acae6ab80 10 client.16389 fetch_fsmap learned FSMap version 25 2023-07-14T13:02:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0acae6ab80 1 -- 172.21.15.17:0/1685535805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55b3b4412250 con 0x55b3b4694580 2023-07-14T13:02:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0a98ff9700 1 -- 172.21.15.17:0/1685535805 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0aa0092020 con 0x55b3b4694580 2023-07-14T13:02:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0a98ff9700 1 -- 172.21.15.17:0/1685535805 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0aa00cb040 con 0x55b3b4694580 2023-07-14T13:02:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0acae6ab80 10 client.16389 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:02:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0acae6ab80 10 client.16389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:02:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0acae6ab80 20 client.16389 populate_metadata read hostname 'smithi017' 2023-07-14T13:02:52.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3b4702800 0x55b3b4704c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:02:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0acae6ab80 4 client.16389 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:02:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.874+0000 7f0acae6ab80 1 -- 172.21.15.17:0/1685535805 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b3b45a0ff0 con 0x55b3b4702800 2023-07-14T13:02:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.875+0000 7f0ab539b700 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3b4702800 0x55b3b4704c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:02:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.875+0000 7f0ab539b700 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3b4702800 0x55b3b4704c10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3438b9001f14ca0 server_cookie=ff1af2fb882508a8 in_seq=0 out_seq=0 2023-07-14T13:02:52.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.875+0000 7f0a98ff9700 10 client.16389 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0a98ff9700 1 -- 172.21.15.17:0/1685535805 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b3b45a0ff0 con 0x55b3b4702800 2023-07-14T13:02:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0a98ff9700 10 client.16389 handle_command_reply: tid=0 2023-07-14T13:02:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0acae6ab80 1 client.16389 shutdown 2023-07-14T13:02:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0acae6ab80 1 -- 172.21.15.17:0/1685535805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 msgr2=0x55b3b46a3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b46a3380 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00991e0 tx=0x7f0aa0010000 comp rx=0 tx=0).stop 2023-07-14T13:02:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0acae6ab80 1 -- 172.21.15.17:0/1685535805 shutdown_connections 2023-07-14T13:02:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3b4702800 0x55b3b4704c10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b469a2d0 0x55b3b46faab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3b44f06b0 0x55b3b46a2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0acae6ab80 1 --2- 172.21.15.17:0/1685535805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3b4694580 0x55b3b46a3380 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0acae6ab80 1 -- 172.21.15.17:0/1685535805 >> 172.21.15.17:0/1685535805 conn(0x55b3b4689be0 msgr2=0x55b3b4698ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0a98ff9700 0 client.16389 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:02:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0acae6ab80 1 -- 172.21.15.17:0/1685535805 shutdown_connections 2023-07-14T13:02:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.889+0000 7f0acae6ab80 1 -- 172.21.15.17:0/1685535805 wait complete. 2023-07-14T13:02:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.890+0000 7f0acae6ab80 20 client.16389 trim_cache size 0 max 16384 2023-07-14T13:02:52.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:02:52.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:02:52.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:02:52.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:02:52.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.890+0000 7f0ab75ff700 1 -- 172.21.15.17:0/2466342594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a9c0a12c0 msgr2=0x7f0a9c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:52.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.890+0000 7f0ab75ff700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a9c0a12c0 0x7f0a9c0a3770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8007b90 tx=0x7f0aa8009000 comp rx=0 tx=0).stop 2023-07-14T13:02:52.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.890+0000 7f0ab75ff700 1 -- 172.21.15.17:0/2466342594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00731c0 msgr2=0x7f0ab019c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:02:52.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.890+0000 7f0ab75ff700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00731c0 0x7f0ab019c640 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000d950 tx=0x7f0aa000dc60 comp rx=0 tx=0).stop 2023-07-14T13:02:52.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.890+0000 7f0ab75ff700 1 -- 172.21.15.17:0/2466342594 shutdown_connections 2023-07-14T13:02:52.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.890+0000 7f0ab75ff700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a9c0a12c0 0x7f0a9c0a3770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.890+0000 7f0ab75ff700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ab0110b10 0x7f0ab01a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.890+0000 7f0ab75ff700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ab00728b0 0x7f0ab019c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.890+0000 7f0ab75ff700 1 --2- 172.21.15.17:0/2466342594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00731c0 0x7f0ab019c640 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:02:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.890+0000 7f0ab75ff700 1 -- 172.21.15.17:0/2466342594 >> 172.21.15.17:0/2466342594 conn(0x7f0ab00fb600 msgr2=0x7f0ab00fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:02:52.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.891+0000 7f0ab75ff700 1 -- 172.21.15.17:0/2466342594 shutdown_connections 2023-07-14T13:02:52.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:02:52.891+0000 7f0ab75ff700 1 -- 172.21.15.17:0/2466342594 wait complete. 2023-07-14T13:02:53.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:53 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:02:53.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:53 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:53.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:53 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:53.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:53 smithi135 ceph-mon[97338]: pgmap v97: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-07-14T13:02:53.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:53 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:02:53.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:53 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:53.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:53 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:53.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:53 smithi131 ceph-mon[96953]: pgmap v97: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-07-14T13:02:53.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:53 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:02:53.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:53 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:53.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:53 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:02:53.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:53 smithi017 ceph-mon[95536]: pgmap v97: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-07-14T13:02:54.144 INFO:teuthology.orchestra.run.smithi017.stderr:9800000 of 50000000 tuples (19%) done (elapsed 163.75 s, remaining 671.70 s) 2023-07-14T13:02:55.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:55 smithi135 ceph-mon[97338]: pgmap v98: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-07-14T13:02:55.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:55 smithi131 ceph-mon[96953]: pgmap v98: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-07-14T13:02:55.566 INFO:teuthology.orchestra.run.smithi017.stderr:9900000 of 50000000 tuples (19%) done (elapsed 165.17 s, remaining 669.02 s) 2023-07-14T13:02:55.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:55 smithi017 ceph-mon[95536]: pgmap v98: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 19 op/s 2023-07-14T13:02:56.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:56 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:02:56.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:56 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:02:56.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:56 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:02:57.006 INFO:teuthology.orchestra.run.smithi017.stderr:10000000 of 50000000 tuples (20%) done (elapsed 166.61 s, remaining 666.44 s) 2023-07-14T13:02:57.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:57 smithi135 ceph-mon[97338]: pgmap v99: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 33 MiB/s wr, 134 op/s 2023-07-14T13:02:57.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:57 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:02:57.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:57 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:02:57.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:57 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:02:57.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:57 smithi131 ceph-mon[96953]: pgmap v99: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 33 MiB/s wr, 134 op/s 2023-07-14T13:02:57.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:57 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:02:57.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:57 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:02:57.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:57 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:02:57.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:57 smithi017 ceph-mon[95536]: pgmap v99: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 33 MiB/s wr, 134 op/s 2023-07-14T13:02:57.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:57 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:02:57.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:57 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:02:57.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:57 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:02:58.295 INFO:teuthology.orchestra.run.smithi017.stderr:10100000 of 50000000 tuples (20%) done (elapsed 167.90 s, remaining 663.28 s) 2023-07-14T13:02:59.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:59 smithi135 ceph-mon[97338]: pgmap v100: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 22 MiB/s wr, 124 op/s 2023-07-14T13:02:59.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:02:59 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:02:59.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:59 smithi131 ceph-mon[96953]: pgmap v100: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 22 MiB/s wr, 124 op/s 2023-07-14T13:02:59.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:02:59 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:02:59.585 INFO:teuthology.orchestra.run.smithi017.stderr:10200000 of 50000000 tuples (20%) done (elapsed 169.19 s, remaining 660.17 s) 2023-07-14T13:02:59.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:59 smithi017 ceph-mon[95536]: pgmap v100: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 22 MiB/s wr, 124 op/s 2023-07-14T13:02:59.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:02:59 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:03:00.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:00 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:03:00.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:00 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:03:00.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:00 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:03:00.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:00 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:03:00.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:00 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:03:00.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:00 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:03:00.985 INFO:teuthology.orchestra.run.smithi017.stderr:10300000 of 50000000 tuples (20%) done (elapsed 170.59 s, remaining 657.51 s) 2023-07-14T13:03:01.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:01 smithi135 ceph-mon[97338]: pgmap v101: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 33 MiB/s wr, 134 op/s 2023-07-14T13:03:01.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:01 smithi131 ceph-mon[96953]: pgmap v101: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 33 MiB/s wr, 134 op/s 2023-07-14T13:03:01.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:01 smithi017 ceph-mon[95536]: pgmap v101: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 33 MiB/s wr, 134 op/s 2023-07-14T13:03:02.243 INFO:teuthology.orchestra.run.smithi017.stderr:10400000 of 50000000 tuples (20%) done (elapsed 171.85 s, remaining 654.34 s) 2023-07-14T13:03:02.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:02 smithi135 ceph-mon[97338]: pgmap v102: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 22 MiB/s wr, 124 op/s 2023-07-14T13:03:02.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:02 smithi131 ceph-mon[96953]: pgmap v102: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 22 MiB/s wr, 124 op/s 2023-07-14T13:03:02.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:02 smithi017 ceph-mon[95536]: pgmap v102: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 22 MiB/s wr, 124 op/s 2023-07-14T13:03:03.499 INFO:teuthology.orchestra.run.smithi017.stderr:10500000 of 50000000 tuples (21%) done (elapsed 173.10 s, remaining 651.19 s) 2023-07-14T13:03:04.880 INFO:teuthology.orchestra.run.smithi017.stderr:10600000 of 50000000 tuples (21%) done (elapsed 174.48 s, remaining 648.55 s) 2023-07-14T13:03:05.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:04 smithi017 ceph-mon[95536]: pgmap v103: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 22 MiB/s wr, 124 op/s 2023-07-14T13:03:05.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:04 smithi135 ceph-mon[97338]: pgmap v103: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 22 MiB/s wr, 124 op/s 2023-07-14T13:03:05.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:04 smithi131 ceph-mon[96953]: pgmap v103: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 22 MiB/s wr, 124 op/s 2023-07-14T13:03:06.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.054+0000 7ff149dff700 1 -- 172.21.15.17:0/3287846435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1440ffb00 msgr2=0x7ff1440fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.054+0000 7ff149dff700 1 --2- 172.21.15.17:0/3287846435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1440ffb00 0x7ff1440fff70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff138009990 tx=0x7ff138009ca0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.055+0000 7ff149dff700 1 -- 172.21.15.17:0/3287846435 shutdown_connections 2023-07-14T13:03:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.055+0000 7ff149dff700 1 --2- 172.21.15.17:0/3287846435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1441004b0 0x7ff14410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.055+0000 7ff149dff700 1 --2- 172.21.15.17:0/3287846435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff144105b10 0x7ff144105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.055+0000 7ff149dff700 1 --2- 172.21.15.17:0/3287846435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1440ffb00 0x7ff1440fff70 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.055+0000 7ff149dff700 1 -- 172.21.15.17:0/3287846435 >> 172.21.15.17:0/3287846435 conn(0x7ff1440fb600 msgr2=0x7ff1440fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:06.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.055+0000 7ff149dff700 1 -- 172.21.15.17:0/3287846435 shutdown_connections 2023-07-14T13:03:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.055+0000 7ff149dff700 1 -- 172.21.15.17:0/3287846435 wait complete. 2023-07-14T13:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.056+0000 7ff149dff700 1 Processor -- start 2023-07-14T13:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.056+0000 7ff149dff700 1 -- start start 2023-07-14T13:03:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.056+0000 7ff149dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1440ffb00 0x7ff144197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.056+0000 7ff149dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1441004b0 0x7ff1441982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff149dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff144105b10 0x7ff14419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff149dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14419cf60 con 0x7ff1441004b0 2023-07-14T13:03:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff149dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14419d0d0 con 0x7ff144105b10 2023-07-14T13:03:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff149dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14419d290 con 0x7ff1440ffb00 2023-07-14T13:03:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff1437fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1440ffb00 0x7ff144197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff1437fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1440ffb00 0x7ff144197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59676/0 (socket says 172.21.15.17:59676) 2023-07-14T13:03:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff1437fe700 1 -- 172.21.15.17:0/2899016150 learned_addr learned my addr 172.21.15.17:0/2899016150 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff142ffd700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1441004b0 0x7ff1441982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff143fff700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff144105b10 0x7ff14419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff1437fe700 1 -- 172.21.15.17:0/2899016150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff144105b10 msgr2=0x7ff14419c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff1437fe700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff144105b10 0x7ff14419c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff1437fe700 1 -- 172.21.15.17:0/2899016150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1441004b0 msgr2=0x7ff1441982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff1437fe700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1441004b0 0x7ff1441982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.057+0000 7ff1437fe700 1 -- 172.21.15.17:0/2899016150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1380095f0 con 0x7ff1440ffb00 2023-07-14T13:03:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.058+0000 7ff1437fe700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1440ffb00 0x7ff144197d70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff13400d950 tx=0x7ff13400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.058+0000 7ff140ff9700 1 -- 172.21.15.17:0/2899016150 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400f890 con 0x7ff1440ffb00 2023-07-14T13:03:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.058+0000 7ff140ff9700 1 -- 172.21.15.17:0/2899016150 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff13400fe80 con 0x7ff1440ffb00 2023-07-14T13:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.058+0000 7ff149dff700 1 -- 172.21.15.17:0/2899016150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14419d570 con 0x7ff1440ffb00 2023-07-14T13:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.058+0000 7ff140ff9700 1 -- 172.21.15.17:0/2899016150 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400e3b0 con 0x7ff1440ffb00 2023-07-14T13:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.058+0000 7ff149dff700 1 -- 172.21.15.17:0/2899016150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1441a4db0 con 0x7ff1440ffb00 2023-07-14T13:03:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.062+0000 7ff140ff9700 1 -- 172.21.15.17:0/2899016150 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff134010460 con 0x7ff1440ffb00 2023-07-14T13:03:06.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.063+0000 7ff140ff9700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff12c0a12c0 0x7ff12c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.063+0000 7ff140ff9700 1 -- 172.21.15.17:0/2899016150 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff1340cca80 con 0x7ff1440ffb00 2023-07-14T13:03:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.064+0000 7ff142ffd700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff12c0a12c0 0x7ff12c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.064+0000 7ff15d801b80 1 Processor -- start 2023-07-14T13:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.064+0000 7ff15d801b80 1 -- start start 2023-07-14T13:03:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.064+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 0x55cfd6557d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.064+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd65582d0 0x55cfd6552040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.064+0000 7ff142ffd700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff12c0a12c0 0x7ff12c0a3770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff13800b5c0 tx=0x7ff138009f00 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.064+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd6552580 0x55cfd65529d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.064+0000 7ff15d801b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd6457c50 con 0x55cfd6552580 2023-07-14T13:03:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.064+0000 7ff15d801b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd64aa9e0 con 0x55cfd63ae6b0 2023-07-14T13:03:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.064+0000 7ff15d801b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd64a3e70 con 0x55cfd65582d0 2023-07-14T13:03:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.065+0000 7ff143fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd6552580 0x55cfd65529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.065+0000 7ff143fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd6552580 0x55cfd65529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39436/0 (socket says 172.21.15.17:39436) 2023-07-14T13:03:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.065+0000 7ff1437fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 0x55cfd6557d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.065+0000 7ff143fff700 1 -- 172.21.15.17:0/1625921339 learned_addr learned my addr 172.21.15.17:0/1625921339 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.065+0000 7ff142ffd700 1 --2- 172.21.15.17:0/1625921339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd65582d0 0x55cfd6552040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.065+0000 7ff1437fe700 1 -- 172.21.15.17:0/1625921339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd65582d0 msgr2=0x55cfd6552040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.065+0000 7ff1437fe700 1 --2- 172.21.15.17:0/1625921339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd65582d0 0x55cfd6552040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.065+0000 7ff1437fe700 1 -- 172.21.15.17:0/1625921339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd6552580 msgr2=0x55cfd65529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.065+0000 7ff1437fe700 1 --2- 172.21.15.17:0/1625921339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd6552580 0x55cfd65529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.065+0000 7ff1437fe700 1 -- 172.21.15.17:0/1625921339 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfd62d1d80 con 0x55cfd63ae6b0 2023-07-14T13:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.065+0000 7ff143fff700 1 --2- 172.21.15.17:0/1625921339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd6552580 0x55cfd65529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.066+0000 7ff1437fe700 1 --2- 172.21.15.17:0/1625921339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 0x55cfd6557d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1340ca1e0 tx=0x7ff134099590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c125cc6b2c8b2e8a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.066+0000 7ff129ffb700 1 -- 172.21.15.17:0/1625921339 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13409db90 con 0x55cfd63ae6b0 2023-07-14T13:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.066+0000 7ff129ffb700 1 -- 172.21.15.17:0/1625921339 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1340a1fb0 con 0x55cfd63ae6b0 2023-07-14T13:03:06.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.066+0000 7ff129ffb700 1 -- 172.21.15.17:0/1625921339 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340a1b20 con 0x55cfd63ae6b0 2023-07-14T13:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.067+0000 7ff15d801b80 1 -- 172.21.15.17:0/1625921339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 msgr2=0x55cfd6557d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.067+0000 7ff15d801b80 1 --2- 172.21.15.17:0/1625921339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 0x55cfd6557d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff1340ca1e0 tx=0x7ff134099590 comp rx=0 tx=0).stop 2023-07-14T13:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.067+0000 7ff15d801b80 1 -- 172.21.15.17:0/1625921339 shutdown_connections 2023-07-14T13:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.067+0000 7ff15d801b80 1 --2- 172.21.15.17:0/1625921339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd6552580 0x55cfd65529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.067+0000 7ff15d801b80 1 --2- 172.21.15.17:0/1625921339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 0x55cfd6557d90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.067+0000 7ff15d801b80 1 --2- 172.21.15.17:0/1625921339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd65582d0 0x55cfd6552040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.067+0000 7ff15d801b80 1 -- 172.21.15.17:0/1625921339 >> 172.21.15.17:0/1625921339 conn(0x55cfd6547be0 msgr2=0x55cfd654cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.067+0000 7ff15d801b80 1 -- 172.21.15.17:0/1625921339 shutdown_connections 2023-07-14T13:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.067+0000 7ff15d801b80 1 -- 172.21.15.17:0/1625921339 wait complete. 2023-07-14T13:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.068+0000 7ff15d801b80 1 -- start start 2023-07-14T13:03:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.068+0000 7ff15d801b80 1 Processor -- start 2023-07-14T13:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd63ae6b0 0x55cfd65614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd6552580 0x55cfd6561a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 0x55cfd655b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff15d801b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd6443a60 con 0x55cfd65582d0 2023-07-14T13:03:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff15d801b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd6443760 con 0x55cfd6552580 2023-07-14T13:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff15d801b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd63278c0 con 0x55cfd63ae6b0 2023-07-14T13:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff15d801b80 10 client.0 _ll_register_callbacks cb 0x55cfd6441700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff143fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 0x55cfd655b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff143fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 0x55cfd655b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39440/0 (socket says 172.21.15.17:39440) 2023-07-14T13:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff143fff700 1 -- 172.21.15.17:0/4047566471 learned_addr learned my addr 172.21.15.17:0/4047566471 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff1437fe700 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd63ae6b0 0x55cfd65614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff142ffd700 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd6552580 0x55cfd6561a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff143fff700 1 -- 172.21.15.17:0/4047566471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd63ae6b0 msgr2=0x55cfd65614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.069+0000 7ff143fff700 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd63ae6b0 0x55cfd65614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff143fff700 1 -- 172.21.15.17:0/4047566471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd6552580 msgr2=0x55cfd6561a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff143fff700 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd6552580 0x55cfd6561a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff143fff700 1 -- 172.21.15.17:0/4047566471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c003c50 con 0x55cfd65582d0 2023-07-14T13:03:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff1437fe700 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd63ae6b0 0x55cfd65614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff143fff700 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 0x55cfd655b800 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff13c006070 tx=0x7ff13c004330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866585a94cc07340 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff122ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff122ffd700 1 -- 172.21.15.17:0/4047566471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c016840 con 0x55cfd65582d0 2023-07-14T13:03:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff15d801b80 1 -- 172.21.15.17:0/4047566471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cfd63fd490 con 0x55cfd65582d0 2023-07-14T13:03:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff122ffd700 1 -- 172.21.15.17:0/4047566471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff13c0169a0 con 0x55cfd65582d0 2023-07-14T13:03:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff122ffd700 1 -- 172.21.15.17:0/4047566471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff13c016b60 con 0x55cfd65582d0 2023-07-14T13:03:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff15d801b80 10 client.16401 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.070+0000 7ff15d801b80 1 -- 172.21.15.17:0/4047566471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7ff1441a4db0 con 0x55cfd65582d0 2023-07-14T13:03:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.071+0000 7ff122ffd700 1 -- 172.21.15.17:0/4047566471 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cfd63fd490 con 0x55cfd65582d0 2023-07-14T13:03:06.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.071+0000 7ff122ffd700 1 -- 172.21.15.17:0/4047566471 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff13c007c80 con 0x55cfd65582d0 2023-07-14T13:03:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.071+0000 7ff15d801b80 10 client.16401 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.071+0000 7ff15d801b80 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.071+0000 7ff15d801b80 20 client.16401 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.071+0000 7ff15d801b80 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cfd656ba50 0x55cfd656de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.071+0000 7ff15d801b80 4 client.16401 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.071+0000 7ff15d801b80 1 -- 172.21.15.17:0/4047566471 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cfd649ce50 con 0x55cfd656ba50 2023-07-14T13:03:06.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.072+0000 7ff1437fe700 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cfd656ba50 0x55cfd656de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.072+0000 7ff1437fe700 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cfd656ba50 0x55cfd656de60 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a89b41c02fabdbe server_cookie=9ff1c58773f9df46 in_seq=0 out_seq=0 2023-07-14T13:03:06.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.072+0000 7ff122ffd700 10 client.16401 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff122ffd700 1 -- 172.21.15.17:0/4047566471 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cfd649ce50 con 0x55cfd656ba50 2023-07-14T13:03:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff122ffd700 10 client.16401 handle_command_reply: tid=0 2023-07-14T13:03:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff15d801b80 1 client.16401 shutdown 2023-07-14T13:03:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff15d801b80 1 -- 172.21.15.17:0/4047566471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 msgr2=0x55cfd655b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff15d801b80 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 0x55cfd655b800 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff13c006070 tx=0x7ff13c004330 comp rx=0 tx=0).stop 2023-07-14T13:03:06.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff15d801b80 1 -- 172.21.15.17:0/4047566471 shutdown_connections 2023-07-14T13:03:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff15d801b80 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cfd656ba50 0x55cfd656de60 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff15d801b80 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 0x55cfd655b800 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff15d801b80 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd63ae6b0 0x55cfd65614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff15d801b80 1 --2- 172.21.15.17:0/4047566471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd6552580 0x55cfd6561a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff122ffd700 0 client.16401 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff15d801b80 1 -- 172.21.15.17:0/4047566471 >> 172.21.15.17:0/4047566471 conn(0x55cfd6547be0 msgr2=0x55cfd654c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff15d801b80 1 -- 172.21.15.17:0/4047566471 shutdown_connections 2023-07-14T13:03:06.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.073+0000 7ff15d801b80 1 -- 172.21.15.17:0/4047566471 wait complete. 2023-07-14T13:03:06.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.074+0000 7ff15d801b80 20 client.16401 trim_cache size 0 max 16384 2023-07-14T13:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.092+0000 7ff15d801b80 1 Processor -- start 2023-07-14T13:03:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.092+0000 7ff15d801b80 1 -- start start 2023-07-14T13:03:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.093+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 0x55cfd6552040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.093+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd6552580 0x55cfd6557090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.093+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 0x55cfd65575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.093+0000 7ff15d801b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd63fd490 con 0x55cfd65582d0 2023-07-14T13:03:06.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.093+0000 7ff15d801b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd6556390 con 0x55cfd63ae6b0 2023-07-14T13:03:06.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.093+0000 7ff15d801b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd6569050 con 0x55cfd6552580 2023-07-14T13:03:06.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.093+0000 7ff1437fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 0x55cfd6552040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.093+0000 7ff143fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 0x55cfd65575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.093+0000 7ff1437fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 0x55cfd6552040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:42616/0 (socket says 172.21.15.17:42616) 2023-07-14T13:03:06.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.093+0000 7ff1437fe700 1 -- 172.21.15.17:0/2721768640 learned_addr learned my addr 172.21.15.17:0/2721768640 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:06.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.093+0000 7ff142ffd700 1 --2- 172.21.15.17:0/2721768640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd6552580 0x55cfd6557090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.094+0000 7ff1437fe700 1 -- 172.21.15.17:0/2721768640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd6552580 msgr2=0x55cfd6557090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.094+0000 7ff1437fe700 1 --2- 172.21.15.17:0/2721768640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd6552580 0x55cfd6557090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.094+0000 7ff1437fe700 1 -- 172.21.15.17:0/2721768640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 msgr2=0x55cfd65575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.094+0000 7ff1437fe700 1 --2- 172.21.15.17:0/2721768640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 0x55cfd65575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.094+0000 7ff1437fe700 1 -- 172.21.15.17:0/2721768640 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfd62bac00 con 0x55cfd63ae6b0 2023-07-14T13:03:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.094+0000 7ff143fff700 1 --2- 172.21.15.17:0/2721768640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 0x55cfd65575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:06.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.094+0000 7ff1437fe700 1 --2- 172.21.15.17:0/2721768640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 0x55cfd6552040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff134010710 tx=0x7ff134010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f2fbcf0f17d58e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.094+0000 7ff12a7fc700 1 -- 172.21.15.17:0/2721768640 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340994c0 con 0x55cfd63ae6b0 2023-07-14T13:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.094+0000 7ff12a7fc700 1 -- 172.21.15.17:0/2721768640 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff134097f80 con 0x55cfd63ae6b0 2023-07-14T13:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.094+0000 7ff12a7fc700 1 -- 172.21.15.17:0/2721768640 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340992b0 con 0x55cfd63ae6b0 2023-07-14T13:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.095+0000 7ff15d801b80 1 -- 172.21.15.17:0/2721768640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 msgr2=0x55cfd6552040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.095+0000 7ff15d801b80 1 --2- 172.21.15.17:0/2721768640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 0x55cfd6552040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff134010710 tx=0x7ff134010000 comp rx=0 tx=0).stop 2023-07-14T13:03:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.095+0000 7ff15d801b80 1 -- 172.21.15.17:0/2721768640 shutdown_connections 2023-07-14T13:03:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.095+0000 7ff15d801b80 1 --2- 172.21.15.17:0/2721768640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd65582d0 0x55cfd65575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.095+0000 7ff15d801b80 1 --2- 172.21.15.17:0/2721768640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd63ae6b0 0x55cfd6552040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.095+0000 7ff15d801b80 1 --2- 172.21.15.17:0/2721768640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd6552580 0x55cfd6557090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.095+0000 7ff15d801b80 1 -- 172.21.15.17:0/2721768640 >> 172.21.15.17:0/2721768640 conn(0x55cfd6547be0 msgr2=0x55cfd6556980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.095+0000 7ff15d801b80 1 -- 172.21.15.17:0/2721768640 shutdown_connections 2023-07-14T13:03:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.095+0000 7ff15d801b80 1 -- 172.21.15.17:0/2721768640 wait complete. 2023-07-14T13:03:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.095+0000 7ff15d801b80 1 -- start start 2023-07-14T13:03:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.096+0000 7ff15d801b80 1 Processor -- start 2023-07-14T13:03:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.096+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd63ae6b0 0x55cfd65605a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.096+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd6552580 0x55cfd6560ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.096+0000 7ff15d801b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd65582d0 0x55cfd6561020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.096+0000 7ff15d801b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd6561df0 con 0x55cfd63ae6b0 2023-07-14T13:03:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.096+0000 7ff15d801b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd65be910 con 0x55cfd65582d0 2023-07-14T13:03:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.096+0000 7ff15d801b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfd65beaa0 con 0x55cfd6552580 2023-07-14T13:03:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.096+0000 7ff15d801b80 10 client.0 _ll_register_callbacks cb 0x7ff13c009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff1437fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd63ae6b0 0x55cfd65605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff1437fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd63ae6b0 0x55cfd65605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39460/0 (socket says 172.21.15.17:39460) 2023-07-14T13:03:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff142ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd6552580 0x55cfd6560ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff1437fe700 1 -- 172.21.15.17:0/3412486579 learned_addr learned my addr 172.21.15.17:0/3412486579 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff143fff700 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd65582d0 0x55cfd6561020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff1437fe700 1 -- 172.21.15.17:0/3412486579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd6552580 msgr2=0x55cfd6560ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff1437fe700 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd6552580 0x55cfd6560ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff1437fe700 1 -- 172.21.15.17:0/3412486579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd65582d0 msgr2=0x55cfd6561020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff1437fe700 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd65582d0 0x55cfd6561020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff1437fe700 1 -- 172.21.15.17:0/3412486579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1441a4db0 con 0x55cfd63ae6b0 2023-07-14T13:03:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff1437fe700 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd63ae6b0 0x55cfd65605a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff134000c00 tx=0x7ff134010a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abc161779aed38e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff122ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff122ffd700 1 -- 172.21.15.17:0/3412486579 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13409a020 con 0x55cfd63ae6b0 2023-07-14T13:03:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff122ffd700 1 -- 172.21.15.17:0/3412486579 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff1340b9050 con 0x55cfd63ae6b0 2023-07-14T13:03:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.097+0000 7ff15d801b80 1 -- 172.21.15.17:0/3412486579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1340a1fb0 con 0x55cfd63ae6b0 2023-07-14T13:03:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.098+0000 7ff122ffd700 1 -- 172.21.15.17:0/3412486579 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff134099050 con 0x55cfd63ae6b0 2023-07-14T13:03:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.098+0000 7ff15d801b80 10 client.16407 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.098+0000 7ff15d801b80 1 -- 172.21.15.17:0/3412486579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55cfd62d1d80 con 0x55cfd63ae6b0 2023-07-14T13:03:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.098+0000 7ff122ffd700 1 -- 172.21.15.17:0/3412486579 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1340a1fb0 con 0x55cfd63ae6b0 2023-07-14T13:03:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.098+0000 7ff122ffd700 1 -- 172.21.15.17:0/3412486579 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff134095950 con 0x55cfd63ae6b0 2023-07-14T13:03:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.098+0000 7ff15d801b80 10 client.16407 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:06.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.098+0000 7ff15d801b80 10 client.16407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.098+0000 7ff15d801b80 20 client.16407 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.098+0000 7ff15d801b80 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cfd65bfd40 0x55cfd65c2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.098+0000 7ff15d801b80 4 client.16407 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:03:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.098+0000 7ff15d801b80 1 -- 172.21.15.17:0/3412486579 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cfd645eff0 con 0x55cfd65bfd40 2023-07-14T13:03:06.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.099+0000 7ff142ffd700 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cfd65bfd40 0x55cfd65c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.099+0000 7ff142ffd700 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cfd65bfd40 0x55cfd65c2150 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=496827a28464ee5e server_cookie=13e1ae9fbb98b04c in_seq=0 out_seq=0 2023-07-14T13:03:06.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.099+0000 7ff122ffd700 10 client.16407 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:06.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff122ffd700 1 -- 172.21.15.17:0/3412486579 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cfd645eff0 con 0x55cfd65bfd40 2023-07-14T13:03:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff122ffd700 10 client.16407 handle_command_reply: tid=0 2023-07-14T13:03:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 1 client.16407 shutdown 2023-07-14T13:03:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 1 -- 172.21.15.17:0/3412486579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd63ae6b0 msgr2=0x55cfd65605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd63ae6b0 0x55cfd65605a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff134000c00 tx=0x7ff134010a60 comp rx=0 tx=0).stop 2023-07-14T13:03:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 1 -- 172.21.15.17:0/3412486579 shutdown_connections 2023-07-14T13:03:06.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cfd65bfd40 0x55cfd65c2150 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cfd65582d0 0x55cfd6561020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cfd63ae6b0 0x55cfd65605a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 1 --2- 172.21.15.17:0/3412486579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd6552580 0x55cfd6560ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff122ffd700 0 client.16407 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 1 -- 172.21.15.17:0/3412486579 >> 172.21.15.17:0/3412486579 conn(0x55cfd6547be0 msgr2=0x55cfd6557210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 1 -- 172.21.15.17:0/3412486579 shutdown_connections 2023-07-14T13:03:06.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 1 -- 172.21.15.17:0/3412486579 wait complete. 2023-07-14T13:03:06.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.115+0000 7ff15d801b80 20 client.16407 trim_cache size 0 max 16384 2023-07-14T13:03:06.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:03:06.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:03:06.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:03:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:03:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 -- 172.21.15.17:0/2899016150 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff12c0a12c0 msgr2=0x7ff12c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:06.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff12c0a12c0 0x7ff12c0a3770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff13800b5c0 tx=0x7ff138009f00 comp rx=0 tx=0).stop 2023-07-14T13:03:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 -- 172.21.15.17:0/2899016150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1440ffb00 msgr2=0x7ff144197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1440ffb00 0x7ff144197d70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff13400d950 tx=0x7ff13400dc60 comp rx=0 tx=0).stop 2023-07-14T13:03:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 -- 172.21.15.17:0/2899016150 shutdown_connections 2023-07-14T13:03:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff12c0a12c0 0x7ff12c0a3770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff144105b10 0x7ff14419c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1440ffb00 0x7ff144197d70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 --2- 172.21.15.17:0/2899016150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1441004b0 0x7ff1441982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:06.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 -- 172.21.15.17:0/2899016150 >> 172.21.15.17:0/2899016150 conn(0x7ff1440fb600 msgr2=0x7ff1440fbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:06.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 -- 172.21.15.17:0/2899016150 shutdown_connections 2023-07-14T13:03:06.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:06.116+0000 7ff149dff700 1 -- 172.21.15.17:0/2899016150 wait complete. 2023-07-14T13:03:06.181 INFO:teuthology.orchestra.run.smithi017.stderr:10700000 of 50000000 tuples (21%) done (elapsed 175.78 s, remaining 645.64 s) 2023-07-14T13:03:07.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:06 smithi017 ceph-mon[95536]: pgmap v104: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 34 MiB/s wr, 145 op/s 2023-07-14T13:03:07.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:06 smithi135 ceph-mon[97338]: pgmap v104: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 34 MiB/s wr, 145 op/s 2023-07-14T13:03:07.482 INFO:teuthology.orchestra.run.smithi017.stderr:10800000 of 50000000 tuples (21%) done (elapsed 177.08 s, remaining 642.75 s) 2023-07-14T13:03:07.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:06 smithi131 ceph-mon[96953]: pgmap v104: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 34 MiB/s wr, 145 op/s 2023-07-14T13:03:08.789 INFO:teuthology.orchestra.run.smithi017.stderr:10900000 of 50000000 tuples (21%) done (elapsed 178.39 s, remaining 639.92 s) 2023-07-14T13:03:09.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:08 smithi017 ceph-mon[95536]: pgmap v105: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 30 op/s 2023-07-14T13:03:09.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:08 smithi135 ceph-mon[97338]: pgmap v105: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 30 op/s 2023-07-14T13:03:09.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:08 smithi131 ceph-mon[96953]: pgmap v105: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 30 op/s 2023-07-14T13:03:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:11000000 of 50000000 tuples (22%) done (elapsed 179.69 s, remaining 637.09 s) 2023-07-14T13:03:11.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:10 smithi017 ceph-mon[95536]: pgmap v106: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 34 MiB/s wr, 41 op/s 2023-07-14T13:03:11.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:10 smithi135 ceph-mon[97338]: pgmap v106: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 34 MiB/s wr, 41 op/s 2023-07-14T13:03:11.498 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:10 smithi131 ceph-mon[96953]: pgmap v106: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 34 MiB/s wr, 41 op/s 2023-07-14T13:03:11.500 INFO:teuthology.orchestra.run.smithi017.stderr:11100000 of 50000000 tuples (22%) done (elapsed 181.10 s, remaining 634.68 s) 2023-07-14T13:03:12.798 INFO:teuthology.orchestra.run.smithi017.stderr:11200000 of 50000000 tuples (22%) done (elapsed 182.40 s, remaining 631.89 s) 2023-07-14T13:03:13.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:12 smithi017 ceph-mon[95536]: pgmap v107: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 31 op/s 2023-07-14T13:03:13.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:12 smithi135 ceph-mon[97338]: pgmap v107: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 31 op/s 2023-07-14T13:03:13.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:12 smithi131 ceph-mon[96953]: pgmap v107: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 31 op/s 2023-07-14T13:03:14.086 INFO:teuthology.orchestra.run.smithi017.stderr:11300000 of 50000000 tuples (22%) done (elapsed 183.69 s, remaining 629.09 s) 2023-07-14T13:03:15.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:14 smithi017 ceph-mon[95536]: pgmap v108: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 31 op/s 2023-07-14T13:03:15.360 INFO:teuthology.orchestra.run.smithi017.stderr:11400000 of 50000000 tuples (22%) done (elapsed 184.96 s, remaining 626.28 s) 2023-07-14T13:03:15.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:14 smithi135 ceph-mon[97338]: pgmap v108: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 31 op/s 2023-07-14T13:03:15.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:14 smithi131 ceph-mon[96953]: pgmap v108: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 31 op/s 2023-07-14T13:03:16.726 INFO:teuthology.orchestra.run.smithi017.stderr:11500000 of 50000000 tuples (23%) done (elapsed 186.33 s, remaining 623.80 s) 2023-07-14T13:03:17.358 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:16 smithi017 ceph-mon[95536]: pgmap v109: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-07-14T13:03:17.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:16 smithi135 ceph-mon[97338]: pgmap v109: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-07-14T13:03:17.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:16 smithi131 ceph-mon[96953]: pgmap v109: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-07-14T13:03:17.989 INFO:teuthology.orchestra.run.smithi017.stderr:11600000 of 50000000 tuples (23%) done (elapsed 187.59 s, remaining 620.99 s) 2023-07-14T13:03:19.262 INFO:teuthology.orchestra.run.smithi017.stderr:11700000 of 50000000 tuples (23%) done (elapsed 188.87 s, remaining 618.25 s) 2023-07-14T13:03:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.294+0000 7f9a0999d700 1 -- 172.21.15.17:0/3654544524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04073160 msgr2=0x7f9a0410bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.294+0000 7f9a0999d700 1 --2- 172.21.15.17:0/3654544524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04073160 0x7f9a0410bcb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009990 tx=0x7f99f0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.294+0000 7f9a0999d700 1 -- 172.21.15.17:0/3654544524 shutdown_connections 2023-07-14T13:03:19.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.294+0000 7f9a0999d700 1 --2- 172.21.15.17:0/3654544524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a0410c1f0 0x7f9a0410e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.294+0000 7f9a0999d700 1 --2- 172.21.15.17:0/3654544524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a04072850 0x7f9a04072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.294+0000 7f9a0999d700 1 --2- 172.21.15.17:0/3654544524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04073160 0x7f9a0410bcb0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.294+0000 7f9a0999d700 1 -- 172.21.15.17:0/3654544524 >> 172.21.15.17:0/3654544524 conn(0x7f9a040fb470 msgr2=0x7f9a040fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.294+0000 7f9a0999d700 1 -- 172.21.15.17:0/3654544524 shutdown_connections 2023-07-14T13:03:19.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.294+0000 7f9a0999d700 1 -- 172.21.15.17:0/3654544524 wait complete. 2023-07-14T13:03:19.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.295+0000 7f9a0999d700 1 Processor -- start 2023-07-14T13:03:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.296+0000 7f9a0999d700 1 -- start start 2023-07-14T13:03:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.296+0000 7f9a0999d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04072850 0x7f9a0419d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.296+0000 7f9a0999d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a04073160 0x7f9a0419def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.296+0000 7f9a0999d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a0410c1f0 0x7f9a04197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.296+0000 7f9a0999d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04198090 con 0x7f9a04072850 2023-07-14T13:03:19.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.296+0000 7f9a0999d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04198200 con 0x7f9a0410c1f0 2023-07-14T13:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.296+0000 7f9a0999d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a041983c0 con 0x7f9a04073160 2023-07-14T13:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.297+0000 7f9a0899b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04072850 0x7f9a0419d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.297+0000 7f9a0899b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04072850 0x7f9a0419d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39064/0 (socket says 172.21.15.17:39064) 2023-07-14T13:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.297+0000 7f9a0899b700 1 -- 172.21.15.17:0/2574907012 learned_addr learned my addr 172.21.15.17:0/2574907012 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.297+0000 7f9a03fff700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a04073160 0x7f9a0419def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.297+0000 7f9a0919c700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a0410c1f0 0x7f9a04197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.297+0000 7f9a0899b700 1 -- 172.21.15.17:0/2574907012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a04073160 msgr2=0x7f9a0419def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.297+0000 7f9a0899b700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a04073160 0x7f9a0419def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.297+0000 7f9a0899b700 1 -- 172.21.15.17:0/2574907012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a0410c1f0 msgr2=0x7f9a04197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.297+0000 7f9a0899b700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a0410c1f0 0x7f9a04197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.297+0000 7f9a0899b700 1 -- 172.21.15.17:0/2574907012 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f00095f0 con 0x7f9a04072850 2023-07-14T13:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.297+0000 7f9a0899b700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04072850 0x7f9a0419d9b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f99f800e9a0 tx=0x7f99f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:19.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.298+0000 7f9a01ffb700 1 -- 172.21.15.17:0/2574907012 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8009790 con 0x7f9a04072850 2023-07-14T13:03:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.298+0000 7f9a0999d700 1 -- 172.21.15.17:0/2574907012 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a041986a0 con 0x7f9a04072850 2023-07-14T13:03:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.298+0000 7f9a01ffb700 1 -- 172.21.15.17:0/2574907012 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99f800cbd0 con 0x7f9a04072850 2023-07-14T13:03:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.298+0000 7f9a01ffb700 1 -- 172.21.15.17:0/2574907012 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8018680 con 0x7f9a04072850 2023-07-14T13:03:19.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.298+0000 7f9a0999d700 1 -- 172.21.15.17:0/2574907012 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a041a49a0 con 0x7f9a04072850 2023-07-14T13:03:19.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.303+0000 7f9a01ffb700 1 -- 172.21.15.17:0/2574907012 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f99f800cd40 con 0x7f9a04072850 2023-07-14T13:03:19.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.304+0000 7f9a1e47db80 1 Processor -- start 2023-07-14T13:03:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.304+0000 7f9a1e47db80 1 -- start start 2023-07-14T13:03:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.304+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 0x560003896f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.304+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560003897470 0x5600038911a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.304+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600038978c0 0x560003891700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.304+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003796c50 con 0x560003897470 2023-07-14T13:03:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.304+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600037e99e0 con 0x5600036ed6b0 2023-07-14T13:03:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.304+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600037e2e70 con 0x5600038978c0 2023-07-14T13:03:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a0899b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560003897470 0x5600038911a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a03fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600038978c0 0x560003891700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a01ffb700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f99f40a12c0 0x7f99f40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a03fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600038978c0 0x560003891700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41128/0 (socket says 172.21.15.17:41128) 2023-07-14T13:03:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a03fff700 1 -- 172.21.15.17:0/2395253811 learned_addr learned my addr 172.21.15.17:0/2395253811 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a0919c700 1 --2- 172.21.15.17:0/2395253811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 0x560003896f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a01ffb700 1 -- 172.21.15.17:0/2574907012 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f99f8014070 con 0x7f9a04072850 2023-07-14T13:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a03fff700 1 -- 172.21.15.17:0/2395253811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 msgr2=0x560003896f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a03fff700 1 --2- 172.21.15.17:0/2395253811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 0x560003896f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a0919c700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f99f40a12c0 0x7f99f40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a03fff700 1 -- 172.21.15.17:0/2395253811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560003897470 msgr2=0x5600038911a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a03fff700 1 --2- 172.21.15.17:0/2395253811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560003897470 0x5600038911a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.305+0000 7f9a03fff700 1 -- 172.21.15.17:0/2395253811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560003610d80 con 0x5600038978c0 2023-07-14T13:03:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.306+0000 7f9a03fff700 1 --2- 172.21.15.17:0/2395253811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600038978c0 0x560003891700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99f0000c00 tx=0x7f99f0005ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92606c6fa75ec86b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.306+0000 7f9a0919c700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f99f40a12c0 0x7f99f40a3770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009fd0 tx=0x7f99fc00b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.306+0000 7f99eeffd700 1 -- 172.21.15.17:0/2395253811 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0026070 con 0x5600038978c0 2023-07-14T13:03:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.306+0000 7f99eeffd700 1 -- 172.21.15.17:0/2395253811 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99f001e040 con 0x5600038978c0 2023-07-14T13:03:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.306+0000 7f99eeffd700 1 -- 172.21.15.17:0/2395253811 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f001d070 con 0x5600038978c0 2023-07-14T13:03:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.307+0000 7f9a1e47db80 1 -- 172.21.15.17:0/2395253811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600038978c0 msgr2=0x560003891700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.307+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/2395253811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600038978c0 0x560003891700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99f0000c00 tx=0x7f99f0005ec0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.307+0000 7f9a1e47db80 1 -- 172.21.15.17:0/2395253811 shutdown_connections 2023-07-14T13:03:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.307+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/2395253811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600038978c0 0x560003891700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.307+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/2395253811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 0x560003896f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.307+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/2395253811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560003897470 0x5600038911a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.307+0000 7f9a1e47db80 1 -- 172.21.15.17:0/2395253811 >> 172.21.15.17:0/2395253811 conn(0x560003886d40 msgr2=0x56000388c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.307+0000 7f9a1e47db80 1 -- 172.21.15.17:0/2395253811 shutdown_connections 2023-07-14T13:03:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.307+0000 7f9a1e47db80 1 -- 172.21.15.17:0/2395253811 wait complete. 2023-07-14T13:03:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.308+0000 7f9a1e47db80 1 -- start start 2023-07-14T13:03:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.308+0000 7f9a1e47db80 1 Processor -- start 2023-07-14T13:03:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 0x56000389d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560003897470 0x56000389a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600038978c0 0x56000389aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003782a60 con 0x5600038978c0 2023-07-14T13:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003782760 con 0x5600036ed6b0 2023-07-14T13:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600036668c0 con 0x560003897470 2023-07-14T13:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a1e47db80 10 client.0 _ll_register_callbacks cb 0x560003780700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a0919c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600038978c0 0x56000389aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a0899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 0x56000389d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a0899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 0x56000389d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:38492/0 (socket says 172.21.15.17:38492) 2023-07-14T13:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a0899b700 1 -- 172.21.15.17:0/3134827339 learned_addr learned my addr 172.21.15.17:0/3134827339 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.309+0000 7f9a03fff700 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560003897470 0x56000389a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.310+0000 7f9a0899b700 1 -- 172.21.15.17:0/3134827339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560003897470 msgr2=0x56000389a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.310+0000 7f9a0899b700 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560003897470 0x56000389a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.310+0000 7f9a0899b700 1 -- 172.21.15.17:0/3134827339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600038978c0 msgr2=0x56000389aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.310+0000 7f9a0899b700 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600038978c0 0x56000389aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.310+0000 7f9a0899b700 1 -- 172.21.15.17:0/3134827339 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0410f210 con 0x5600036ed6b0 2023-07-14T13:03:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.310+0000 7f9a03fff700 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560003897470 0x56000389a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.310+0000 7f9a0899b700 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 0x56000389d6c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c5b0 tx=0x7f99f80cac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe1adc9c32abb186 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.310+0000 7f99e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:03:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.310+0000 7f99e3fff700 1 -- 172.21.15.17:0/3134827339 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8099780 con 0x5600036ed6b0 2023-07-14T13:03:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.310+0000 7f99e3fff700 1 -- 172.21.15.17:0/3134827339 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f99f80a2050 con 0x5600036ed6b0 2023-07-14T13:03:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.310+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3134827339 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56000373c490 con 0x5600036ed6b0 2023-07-14T13:03:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.311+0000 7f99e3fff700 1 -- 172.21.15.17:0/3134827339 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99f80a2210 con 0x5600036ed6b0 2023-07-14T13:03:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.311+0000 7f9a1e47db80 10 client.26159 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.311+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3134827339 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5600035f9c00 con 0x5600036ed6b0 2023-07-14T13:03:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.311+0000 7f99e3fff700 1 -- 172.21.15.17:0/3134827339 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99f80c9070 con 0x5600036ed6b0 2023-07-14T13:03:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.311+0000 7f99e3fff700 1 -- 172.21.15.17:0/3134827339 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f99f8095e80 con 0x5600036ed6b0 2023-07-14T13:03:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.311+0000 7f9a1e47db80 10 client.26159 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.311+0000 7f9a1e47db80 10 client.26159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.311+0000 7f9a1e47db80 20 client.26159 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.311+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600038aac30 0x5600038ad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.311+0000 7f9a1e47db80 4 client.26159 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.311+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3134827339 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600037dbe50 con 0x5600038aac30 2023-07-14T13:03:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.312+0000 7f9a03fff700 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600038aac30 0x5600038ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.312+0000 7f9a03fff700 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600038aac30 0x5600038ad040 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71688e53490f9b36 server_cookie=8f6226812c1582e8 in_seq=0 out_seq=0 2023-07-14T13:03:19.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.312+0000 7f99e3fff700 10 client.26159 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.313+0000 7f99e3fff700 1 -- 172.21.15.17:0/3134827339 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5600037dbe50 con 0x5600038aac30 2023-07-14T13:03:19.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.313+0000 7f99e3fff700 10 client.26159 handle_command_reply: tid=0 2023-07-14T13:03:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.313+0000 7f9a1e47db80 1 client.26159 shutdown 2023-07-14T13:03:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.313+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3134827339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 msgr2=0x56000389d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:19.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.313+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 0x56000389d6c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c5b0 tx=0x7f99f80cac70 comp rx=0 tx=0).stop 2023-07-14T13:03:19.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.313+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3134827339 shutdown_connections 2023-07-14T13:03:19.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.313+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600038aac30 0x5600038ad040 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.314+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600038978c0 0x56000389aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.314+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600036ed6b0 0x56000389d6c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.314+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/3134827339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560003897470 0x56000389a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.314+0000 7f99e3fff700 0 client.26159 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.314+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3134827339 >> 172.21.15.17:0/3134827339 conn(0x560003886d40 msgr2=0x56000388b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:19.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.314+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3134827339 shutdown_connections 2023-07-14T13:03:19.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.314+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3134827339 wait complete. 2023-07-14T13:03:19.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.314+0000 7f9a1e47db80 20 client.26159 trim_cache size 0 max 16384 2023-07-14T13:03:19.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:19 smithi017 ceph-mon[95536]: pgmap v110: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:03:19.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.339+0000 7f9a1e47db80 1 Processor -- start 2023-07-14T13:03:19.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.339+0000 7f9a1e47db80 1 -- start start 2023-07-14T13:03:19.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.339+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600036ed6b0 0x560003898410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.339+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560003897470 0x5600038911a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.339+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600038978c0 0x56000389d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.339+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560003898950 con 0x5600038978c0 2023-07-14T13:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.339+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600038916e0 con 0x560003897470 2023-07-14T13:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.339+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600038923c0 con 0x5600036ed6b0 2023-07-14T13:03:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a0899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600036ed6b0 0x560003898410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a0919c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600038978c0 0x56000389d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a0899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600036ed6b0 0x560003898410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41158/0 (socket says 172.21.15.17:41158) 2023-07-14T13:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a0899b700 1 -- 172.21.15.17:0/3215638593 learned_addr learned my addr 172.21.15.17:0/3215638593 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a03fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560003897470 0x5600038911a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a0899b700 1 -- 172.21.15.17:0/3215638593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560003897470 msgr2=0x5600038911a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a0899b700 1 --2- 172.21.15.17:0/3215638593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560003897470 0x5600038911a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a0899b700 1 -- 172.21.15.17:0/3215638593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600038978c0 msgr2=0x56000389d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a0899b700 1 --2- 172.21.15.17:0/3215638593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600038978c0 0x56000389d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a0899b700 1 -- 172.21.15.17:0/3215638593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600036371f0 con 0x5600036ed6b0 2023-07-14T13:03:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a03fff700 1 --2- 172.21.15.17:0/3215638593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560003897470 0x5600038911a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.340+0000 7f9a0899b700 1 --2- 172.21.15.17:0/3215638593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600036ed6b0 0x560003898410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99f809a250 tx=0x7f99f80ca7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d115b5530c1349f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.341+0000 7f99ef7fe700 1 -- 172.21.15.17:0/3215638593 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80c6eb0 con 0x5600036ed6b0 2023-07-14T13:03:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.341+0000 7f99ef7fe700 1 -- 172.21.15.17:0/3215638593 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99f80c9070 con 0x5600036ed6b0 2023-07-14T13:03:19.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.341+0000 7f99ef7fe700 1 -- 172.21.15.17:0/3215638593 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80ca290 con 0x5600036ed6b0 2023-07-14T13:03:19.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.342+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3215638593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600036ed6b0 msgr2=0x560003898410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:19.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.342+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/3215638593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600036ed6b0 0x560003898410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99f809a250 tx=0x7f99f80ca7f0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.342+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3215638593 shutdown_connections 2023-07-14T13:03:19.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.342+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/3215638593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600038978c0 0x56000389d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.342+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/3215638593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600036ed6b0 0x560003898410 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.342+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/3215638593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560003897470 0x5600038911a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.342+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3215638593 >> 172.21.15.17:0/3215638593 conn(0x560003886d40 msgr2=0x560003897d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:19.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.342+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3215638593 shutdown_connections 2023-07-14T13:03:19.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.342+0000 7f9a1e47db80 1 -- 172.21.15.17:0/3215638593 wait complete. 2023-07-14T13:03:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.343+0000 7f9a1e47db80 1 -- start start 2023-07-14T13:03:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.343+0000 7f9a1e47db80 1 Processor -- start 2023-07-14T13:03:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.343+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600036ed6b0 0x5600038a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.343+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560003897470 0x56000389fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.343+0000 7f9a1e47db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600038978c0 0x5600038a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.343+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600038a23e0 con 0x5600036ed6b0 2023-07-14T13:03:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.343+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600038a0810 con 0x5600038978c0 2023-07-14T13:03:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.343+0000 7f9a1e47db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600038a0980 con 0x560003897470 2023-07-14T13:03:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.343+0000 7f9a1e47db80 10 client.0 _ll_register_callbacks cb 0x7f99f8099bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a0899b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600036ed6b0 0x5600038a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a0899b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600036ed6b0 0x5600038a1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39092/0 (socket says 172.21.15.17:39092) 2023-07-14T13:03:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a0899b700 1 -- 172.21.15.17:0/1176979553 learned_addr learned my addr 172.21.15.17:0/1176979553 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:19.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a03fff700 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560003897470 0x56000389fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a0919c700 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600038978c0 0x5600038a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a0899b700 1 -- 172.21.15.17:0/1176979553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560003897470 msgr2=0x56000389fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:19.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a0899b700 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560003897470 0x56000389fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a0899b700 1 -- 172.21.15.17:0/1176979553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600038978c0 msgr2=0x5600038a02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:19.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a0899b700 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600038978c0 0x5600038a02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a0899b700 1 -- 172.21.15.17:0/1176979553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560003610d80 con 0x5600036ed6b0 2023-07-14T13:03:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a0919c700 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600038978c0 0x5600038a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:03:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.344+0000 7f9a0899b700 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600036ed6b0 0x5600038a1b10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f99f800e970 tx=0x7f99f8010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c92bc4eb8c7ef55 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.345+0000 7f99e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.345+0000 7f99e3fff700 1 -- 172.21.15.17:0/1176979553 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8099780 con 0x5600036ed6b0 2023-07-14T13:03:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.345+0000 7f99e3fff700 1 -- 172.21.15.17:0/1176979553 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f99f80a2050 con 0x5600036ed6b0 2023-07-14T13:03:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.345+0000 7f9a1e47db80 1 -- 172.21.15.17:0/1176979553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99f001e040 con 0x5600036ed6b0 2023-07-14T13:03:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.345+0000 7f99e3fff700 1 -- 172.21.15.17:0/1176979553 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99f80963d0 con 0x5600036ed6b0 2023-07-14T13:03:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.345+0000 7f9a1e47db80 10 client.16425 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.345+0000 7f9a1e47db80 1 -- 172.21.15.17:0/1176979553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5600035f9c00 con 0x5600036ed6b0 2023-07-14T13:03:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.345+0000 7f99e3fff700 1 -- 172.21.15.17:0/1176979553 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99f001e040 con 0x5600036ed6b0 2023-07-14T13:03:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.345+0000 7f99e3fff700 1 -- 172.21.15.17:0/1176979553 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f99f80ca320 con 0x5600036ed6b0 2023-07-14T13:03:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.345+0000 7f9a1e47db80 10 client.16425 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.345+0000 7f9a1e47db80 10 client.16425 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.346+0000 7f9a1e47db80 20 client.16425 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.346+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600038ffae0 0x560003901ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.346+0000 7f9a1e47db80 4 client.16425 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:03:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.346+0000 7f9a1e47db80 1 -- 172.21.15.17:0/1176979553 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56000379dff0 con 0x5600038ffae0 2023-07-14T13:03:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.346+0000 7f9a03fff700 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600038ffae0 0x560003901ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.347+0000 7f9a03fff700 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600038ffae0 0x560003901ef0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47799eb5e5605286 server_cookie=21228925c02a7aa0 in_seq=0 out_seq=0 2023-07-14T13:03:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.347+0000 7f99e3fff700 10 client.16425 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f99e3fff700 1 -- 172.21.15.17:0/1176979553 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56000379dff0 con 0x5600038ffae0 2023-07-14T13:03:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f99e3fff700 10 client.16425 handle_command_reply: tid=0 2023-07-14T13:03:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f9a1e47db80 1 client.16425 shutdown 2023-07-14T13:03:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f9a1e47db80 1 -- 172.21.15.17:0/1176979553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600036ed6b0 msgr2=0x5600038a1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600036ed6b0 0x5600038a1b10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f99f800e970 tx=0x7f99f8010a70 comp rx=0 tx=0).stop 2023-07-14T13:03:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f9a1e47db80 1 -- 172.21.15.17:0/1176979553 shutdown_connections 2023-07-14T13:03:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600038ffae0 0x560003901ef0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600038978c0 0x5600038a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600036ed6b0 0x5600038a1b10 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f99e3fff700 0 client.16425 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f9a1e47db80 1 --2- 172.21.15.17:0/1176979553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560003897470 0x56000389fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f9a1e47db80 1 -- 172.21.15.17:0/1176979553 >> 172.21.15.17:0/1176979553 conn(0x560003886d40 msgr2=0x5600038962d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:19.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f9a1e47db80 1 -- 172.21.15.17:0/1176979553 shutdown_connections 2023-07-14T13:03:19.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.361+0000 7f9a1e47db80 1 -- 172.21.15.17:0/1176979553 wait complete. 2023-07-14T13:03:19.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a1e47db80 20 client.16425 trim_cache size 0 max 16384 2023-07-14T13:03:19.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:03:19.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:03:19.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:03:19.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:03:19.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a0999d700 1 -- 172.21.15.17:0/2574907012 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f99f40a12c0 msgr2=0x7f99f40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:19.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a0999d700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f99f40a12c0 0x7f99f40a3770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009fd0 tx=0x7f99fc00b040 comp rx=0 tx=0).stop 2023-07-14T13:03:19.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a0999d700 1 -- 172.21.15.17:0/2574907012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04072850 msgr2=0x7f9a0419d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:19.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a0999d700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04072850 0x7f9a0419d9b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f99f800e9a0 tx=0x7f99f800ecb0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a0999d700 1 -- 172.21.15.17:0/2574907012 shutdown_connections 2023-07-14T13:03:19.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a0999d700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f99f40a12c0 0x7f99f40a3770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a0999d700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a0410c1f0 0x7f9a04197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a0999d700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a04072850 0x7f9a0419d9b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a0999d700 1 --2- 172.21.15.17:0/2574907012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a04073160 0x7f9a0419def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:19.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a0999d700 1 -- 172.21.15.17:0/2574907012 >> 172.21.15.17:0/2574907012 conn(0x7f9a040fb470 msgr2=0x7f9a0410e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:19.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.362+0000 7f9a0999d700 1 -- 172.21.15.17:0/2574907012 shutdown_connections 2023-07-14T13:03:19.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:19.363+0000 7f9a0999d700 1 -- 172.21.15.17:0/2574907012 wait complete. 2023-07-14T13:03:19.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:19 smithi135 ceph-mon[97338]: pgmap v110: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:03:19.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:19 smithi131 ceph-mon[96953]: pgmap v110: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:03:20.665 INFO:teuthology.orchestra.run.smithi017.stderr:11800000 of 50000000 tuples (23%) done (elapsed 190.27 s, remaining 615.95 s) 2023-07-14T13:03:21.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:21 smithi017 ceph-mon[95536]: pgmap v111: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 MiB/s wr, 33 op/s 2023-07-14T13:03:21.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:21 smithi135 ceph-mon[97338]: pgmap v111: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 MiB/s wr, 33 op/s 2023-07-14T13:03:21.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:21 smithi131 ceph-mon[96953]: pgmap v111: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 MiB/s wr, 33 op/s 2023-07-14T13:03:21.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:03:21.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.806+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/2457859011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a781004b0 msgr2=0x7f0a7810c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:21.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.807+0000 7f0a7f1ff700 1 --2- 172.21.15.17:0/2457859011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a781004b0 0x7f0a7810c940 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000b0a0 tx=0x7f0a7000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.807+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/2457859011 shutdown_connections 2023-07-14T13:03:21.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.807+0000 7f0a7f1ff700 1 --2- 172.21.15.17:0/2457859011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a781004b0 0x7f0a7810c940 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.807+0000 7f0a7f1ff700 1 --2- 172.21.15.17:0/2457859011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a78105b10 0x7f0a78105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.807+0000 7f0a7f1ff700 1 --2- 172.21.15.17:0/2457859011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a780ffb00 0x7f0a780fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.807+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/2457859011 >> 172.21.15.17:0/2457859011 conn(0x7f0a780fb600 msgr2=0x7f0a780fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.807+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/2457859011 shutdown_connections 2023-07-14T13:03:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.807+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/2457859011 wait complete. 2023-07-14T13:03:21.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.808+0000 7f0a7f1ff700 1 Processor -- start 2023-07-14T13:03:21.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.809+0000 7f0a7f1ff700 1 -- start start 2023-07-14T13:03:21.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.809+0000 7f0a7f1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a780ffb00 0x7f0a7819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.809+0000 7f0a7f1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a781004b0 0x7f0a7819bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.809+0000 7f0a7f1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a78105b10 0x7f0a78195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.809+0000 7f0a7f1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a78196220 con 0x7f0a78105b10 2023-07-14T13:03:21.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.809+0000 7f0a7f1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a78196390 con 0x7f0a780ffb00 2023-07-14T13:03:21.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.809+0000 7f0a7f1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a78196550 con 0x7f0a781004b0 2023-07-14T13:03:21.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a7d79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a78105b10 0x7f0a78195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a7d79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a78105b10 0x7f0a78195a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39104/0 (socket says 172.21.15.17:39104) 2023-07-14T13:03:21.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a7d79c700 1 -- 172.21.15.17:0/1376053258 learned_addr learned my addr 172.21.15.17:0/1376053258 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:21.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a780ffb00 0x7f0a7819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a77fff700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a781004b0 0x7f0a7819bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a7d79c700 1 -- 172.21.15.17:0/1376053258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a781004b0 msgr2=0x7f0a7819bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:21.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a7d79c700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a781004b0 0x7f0a7819bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a7d79c700 1 -- 172.21.15.17:0/1376053258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a780ffb00 msgr2=0x7f0a7819ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:21.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a7d79c700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a780ffb00 0x7f0a7819ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a7d79c700 1 -- 172.21.15.17:0/1376053258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a70009d00 con 0x7f0a78105b10 2023-07-14T13:03:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a77fff700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a781004b0 0x7f0a7819bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.810+0000 7f0a7d79c700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a78105b10 0x7f0a78195a50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009fd0 tx=0x7f0a70004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.811+0000 7f0a75ffb700 1 -- 172.21.15.17:0/1376053258 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7000e040 con 0x7f0a78105b10 2023-07-14T13:03:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.811+0000 7f0a75ffb700 1 -- 172.21.15.17:0/1376053258 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a7000ceb0 con 0x7f0a78105b10 2023-07-14T13:03:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.811+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/1376053258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a781967d0 con 0x7f0a78105b10 2023-07-14T13:03:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.811+0000 7f0a75ffb700 1 -- 172.21.15.17:0/1376053258 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70005680 con 0x7f0a78105b10 2023-07-14T13:03:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.811+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/1376053258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a781a29f0 con 0x7f0a78105b10 2023-07-14T13:03:21.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.815+0000 7f0a75ffb700 1 -- 172.21.15.17:0/1376053258 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0a7001bd60 con 0x7f0a78105b10 2023-07-14T13:03:21.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.816+0000 7f0a92a9db80 1 Processor -- start 2023-07-14T13:03:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.816+0000 7f0a92a9db80 1 -- start start 2023-07-14T13:03:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.816+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246ca2d0 0x55c7246ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.816+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.816+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246d5ad0 0x55c7246d7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.816+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7245d0cb0 con 0x55c7246cabe0 2023-07-14T13:03:21.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.816+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c724623a40 con 0x55c7246ca2d0 2023-07-14T13:03:21.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.816+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c72461ced0 con 0x55c7246d5ad0 2023-07-14T13:03:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a7cf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a77fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246ca2d0 0x55c7246ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a7cf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39120/0 (socket says 172.21.15.17:39120) 2023-07-14T13:03:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/2063010050 learned_addr learned my addr 172.21.15.17:0/2063010050 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a75ffb700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a680a1340 0x7f0a680a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a77fff700 1 --2- 172.21.15.17:0/2063010050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246d5ad0 0x55c7246d7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a75ffb700 1 -- 172.21.15.17:0/1376053258 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0a700ce9a0 con 0x7f0a78105b10 2023-07-14T13:03:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a7d79c700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a680a1340 0x7f0a680a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/2063010050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246d5ad0 msgr2=0x55c7246d7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/2063010050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246d5ad0 0x55c7246d7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/2063010050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246ca2d0 msgr2=0x55c7246ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/2063010050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246ca2d0 0x55c7246ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.817+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/2063010050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c72444ade0 con 0x55c7246cabe0 2023-07-14T13:03:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.818+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/2063010050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d5590 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00bcf0 tx=0x7f0a6c0103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca39e50494f0e0b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.818+0000 7f0a7d79c700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a680a1340 0x7f0a680a37f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a700cc1a0 tx=0x7f0a70009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.818+0000 7f0a62ffd700 1 -- 172.21.15.17:0/2063010050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c010bf0 con 0x55c7246cabe0 2023-07-14T13:03:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.818+0000 7f0a62ffd700 1 -- 172.21.15.17:0/2063010050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a6c015070 con 0x55c7246cabe0 2023-07-14T13:03:21.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.818+0000 7f0a62ffd700 1 -- 172.21.15.17:0/2063010050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c004da0 con 0x55c7246cabe0 2023-07-14T13:03:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.819+0000 7f0a92a9db80 1 -- 172.21.15.17:0/2063010050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 msgr2=0x55c7246d5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.819+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/2063010050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d5590 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00bcf0 tx=0x7f0a6c0103d0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.819+0000 7f0a92a9db80 1 -- 172.21.15.17:0/2063010050 shutdown_connections 2023-07-14T13:03:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.819+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/2063010050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246d5ad0 0x55c7246d7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.819+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/2063010050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246ca2d0 0x55c7246ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.819+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/2063010050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d5590 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.819+0000 7f0a92a9db80 1 -- 172.21.15.17:0/2063010050 >> 172.21.15.17:0/2063010050 conn(0x55c7246c0da0 msgr2=0x55c7246c66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.819+0000 7f0a92a9db80 1 -- 172.21.15.17:0/2063010050 shutdown_connections 2023-07-14T13:03:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.819+0000 7f0a92a9db80 1 -- 172.21.15.17:0/2063010050 wait complete. 2023-07-14T13:03:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.820+0000 7f0a92a9db80 1 -- start start 2023-07-14T13:03:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.820+0000 7f0a92a9db80 1 Processor -- start 2023-07-14T13:03:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.821+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246ca2d0 0x55c7246d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.821+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.821+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246d5ad0 0x55c7246d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.821+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7245bcac0 con 0x55c7246cabe0 2023-07-14T13:03:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.821+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7245bc7c0 con 0x55c7246d5ad0 2023-07-14T13:03:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.821+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7244a0920 con 0x55c7246ca2d0 2023-07-14T13:03:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.821+0000 7f0a92a9db80 10 client.0 _ll_register_callbacks cb 0x55c7245ba760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.821+0000 7f0a7cf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.821+0000 7f0a7cf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39132/0 (socket says 172.21.15.17:39132) 2023-07-14T13:03:21.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.821+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/22829825 learned_addr learned my addr 172.21.15.17:0/22829825 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:21.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.822+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/22829825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246ca2d0 msgr2=0x55c7246d54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:21.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.822+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/22829825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246ca2d0 0x55c7246d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.822+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/22829825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246d5ad0 msgr2=0x55c7246d2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:21.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.822+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/22829825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246d5ad0 0x55c7246d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.822+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/22829825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c00b920 con 0x55c7246cabe0 2023-07-14T13:03:21.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.822+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/22829825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d26f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00bcc0 tx=0x7f0a6c010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec584def818f3dd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:21.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.822+0000 7f0a57fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.822+0000 7f0a57fff700 1 -- 172.21.15.17:0/22829825 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c020070 con 0x55c7246cabe0 2023-07-14T13:03:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.822+0000 7f0a92a9db80 1 -- 172.21.15.17:0/22829825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7245764f0 con 0x55c7246cabe0 2023-07-14T13:03:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.822+0000 7f0a57fff700 1 -- 172.21.15.17:0/22829825 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0a6c017070 con 0x55c7246cabe0 2023-07-14T13:03:21.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.823+0000 7f0a57fff700 1 -- 172.21.15.17:0/22829825 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a6c011650 con 0x55c7246cabe0 2023-07-14T13:03:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.823+0000 7f0a92a9db80 10 client.16437 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.823+0000 7f0a92a9db80 1 -- 172.21.15.17:0/22829825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55c724433c60 con 0x55c7246cabe0 2023-07-14T13:03:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.823+0000 7f0a57fff700 1 -- 172.21.15.17:0/22829825 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c7245764f0 con 0x55c7246cabe0 2023-07-14T13:03:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.823+0000 7f0a57fff700 1 -- 172.21.15.17:0/22829825 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0a6c01b840 con 0x55c7246cabe0 2023-07-14T13:03:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.823+0000 7f0a92a9db80 10 client.16437 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.823+0000 7f0a92a9db80 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.823+0000 7f0a92a9db80 20 client.16437 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:21.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.823+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/22829825 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c7246e97a0 0x55c7246ebbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.823+0000 7f0a92a9db80 4 client.16437 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.823+0000 7f0a92a9db80 1 -- 172.21.15.17:0/22829825 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c724615eb0 con 0x55c7246e97a0 2023-07-14T13:03:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.824+0000 7f0a77fff700 1 --2- 172.21.15.17:0/22829825 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c7246e97a0 0x55c7246ebbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.825+0000 7f0a77fff700 1 --2- 172.21.15.17:0/22829825 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c7246e97a0 0x55c7246ebbb0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=718a420511c16127 server_cookie=5dfb129b251a5a73 in_seq=0 out_seq=0 2023-07-14T13:03:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.825+0000 7f0a57fff700 10 client.16437 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.825+0000 7f0a57fff700 1 -- 172.21.15.17:0/22829825 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x7f0a6401e780 con 0x55c7246e97a0 2023-07-14T13:03:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.825+0000 7f0a57fff700 10 client.16437 handle_command_reply: tid=0 2023-07-14T13:03:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a92a9db80 1 client.16437 shutdown 2023-07-14T13:03:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a92a9db80 1 -- 172.21.15.17:0/22829825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 msgr2=0x55c7246d26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/22829825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d26f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00bcc0 tx=0x7f0a6c010cd0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a92a9db80 1 -- 172.21.15.17:0/22829825 shutdown_connections 2023-07-14T13:03:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/22829825 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c7246e97a0 0x55c7246ebbb0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/22829825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246d5ad0 0x55c7246d2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/22829825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246ca2d0 0x55c7246d54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/22829825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246d26f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a57fff700 0 client.16437 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a92a9db80 1 -- 172.21.15.17:0/22829825 >> 172.21.15.17:0/22829825 conn(0x55c7246c0da0 msgr2=0x55c7246c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a92a9db80 1 -- 172.21.15.17:0/22829825 shutdown_connections 2023-07-14T13:03:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.826+0000 7f0a92a9db80 1 -- 172.21.15.17:0/22829825 wait complete. 2023-07-14T13:03:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.827+0000 7f0a92a9db80 20 client.16437 trim_cache size 0 max 16384 2023-07-14T13:03:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.849+0000 7f0a92a9db80 1 Processor -- start 2023-07-14T13:03:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.849+0000 7f0a92a9db80 1 -- start start 2023-07-14T13:03:21.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246ca2d0 0x55c7246d7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246cabe0 0x55c7246c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246d5ad0 0x55c7246d5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7246d3300 con 0x55c7246ca2d0 2023-07-14T13:03:21.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7246d0c90 con 0x55c7246cabe0 2023-07-14T13:03:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7246c5350 con 0x55c7246d5ad0 2023-07-14T13:03:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a77fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246ca2d0 0x55c7246d7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a77fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246ca2d0 0x55c7246d7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39142/0 (socket says 172.21.15.17:39142) 2023-07-14T13:03:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a77fff700 1 -- 172.21.15.17:0/1066772411 learned_addr learned my addr 172.21.15.17:0/1066772411 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/1066772411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246cabe0 0x55c7246c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/1066772411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246d5ad0 msgr2=0x55c7246d5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/1066772411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246d5ad0 0x55c7246d5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/1066772411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246ca2d0 msgr2=0x55c7246d7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.850+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/1066772411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246ca2d0 0x55c7246d7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.851+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/1066772411 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c724471250 con 0x55c7246cabe0 2023-07-14T13:03:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.851+0000 7f0a77fff700 1 --2- 172.21.15.17:0/1066772411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246ca2d0 0x55c7246d7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.851+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/1066772411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246cabe0 0x55c7246c4e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00b630 tx=0x7f0a6c004690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38b67a85c5733d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.851+0000 7f0a637fe700 1 -- 172.21.15.17:0/1066772411 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c020070 con 0x55c7246cabe0 2023-07-14T13:03:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.851+0000 7f0a637fe700 1 -- 172.21.15.17:0/1066772411 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a6c010df0 con 0x55c7246cabe0 2023-07-14T13:03:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.851+0000 7f0a637fe700 1 -- 172.21.15.17:0/1066772411 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c011920 con 0x55c7246cabe0 2023-07-14T13:03:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.852+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1066772411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246cabe0 msgr2=0x55c7246c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.852+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/1066772411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246cabe0 0x55c7246c4e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00b630 tx=0x7f0a6c004690 comp rx=0 tx=0).stop 2023-07-14T13:03:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.852+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1066772411 shutdown_connections 2023-07-14T13:03:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.852+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/1066772411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246d5ad0 0x55c7246d5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.852+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/1066772411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246ca2d0 0x55c7246d7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.852+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/1066772411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246cabe0 0x55c7246c4e10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.852+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1066772411 >> 172.21.15.17:0/1066772411 conn(0x55c7246c0da0 msgr2=0x55c7246f0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.852+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1066772411 shutdown_connections 2023-07-14T13:03:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.852+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1066772411 wait complete. 2023-07-14T13:03:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.852+0000 7f0a92a9db80 1 -- start start 2023-07-14T13:03:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.853+0000 7f0a92a9db80 1 Processor -- start 2023-07-14T13:03:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246ca2d0 0x55c7246e0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246deac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a92a9db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246d5ad0 0x55c7246df000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7246df540 con 0x55c7246cabe0 2023-07-14T13:03:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7246df680 con 0x55c7246d5ad0 2023-07-14T13:03:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a92a9db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7246df840 con 0x55c7246ca2d0 2023-07-14T13:03:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a92a9db80 10 client.0 _ll_register_callbacks cb 0x7f0a6400bab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a7cf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246deac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a7cf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246deac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39148/0 (socket says 172.21.15.17:39148) 2023-07-14T13:03:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/1742074743 learned_addr learned my addr 172.21.15.17:0/1742074743 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a77fff700 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246d5ad0 0x55c7246df000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a77fff700 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246ca2d0 0x55c7246e0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/1742074743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246ca2d0 msgr2=0x55c7246e0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246ca2d0 0x55c7246e0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/1742074743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246d5ad0 msgr2=0x55c7246df000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246d5ad0 0x55c7246df000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.854+0000 7f0a7cf9b700 1 -- 172.21.15.17:0/1742074743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a640140b0 con 0x55c7246cabe0 2023-07-14T13:03:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.855+0000 7f0a7cf9b700 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246deac0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c010d10 tx=0x7f0a6c02c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e827e5b5879b41 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.855+0000 7f0a57fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.855+0000 7f0a57fff700 1 -- 172.21.15.17:0/1742074743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c020040 con 0x55c7246cabe0 2023-07-14T13:03:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.855+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1742074743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a6c015070 con 0x55c7246cabe0 2023-07-14T13:03:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.855+0000 7f0a57fff700 1 -- 172.21.15.17:0/1742074743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0a6c017070 con 0x55c7246cabe0 2023-07-14T13:03:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.855+0000 7f0a57fff700 1 -- 172.21.15.17:0/1742074743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a6c01be10 con 0x55c7246cabe0 2023-07-14T13:03:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.855+0000 7f0a92a9db80 10 client.16443 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.855+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1742074743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55c724433c60 con 0x55c7246cabe0 2023-07-14T13:03:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.856+0000 7f0a57fff700 1 -- 172.21.15.17:0/1742074743 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a6c015070 con 0x55c7246cabe0 2023-07-14T13:03:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.856+0000 7f0a57fff700 1 -- 172.21.15.17:0/1742074743 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0a6c02cb30 con 0x55c7246cabe0 2023-07-14T13:03:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.856+0000 7f0a92a9db80 10 client.16443 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.856+0000 7f0a92a9db80 10 client.16443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.856+0000 7f0a92a9db80 20 client.16443 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.856+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c72473e6b0 0x55c724740ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.856+0000 7f0a92a9db80 4 client.16443 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:03:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.856+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1742074743 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c7245d8050 con 0x55c72473e6b0 2023-07-14T13:03:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.856+0000 7f0a77fff700 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c72473e6b0 0x55c724740ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.857+0000 7f0a57fff700 10 client.16443 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:21.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.857+0000 7f0a77fff700 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c72473e6b0 0x55c724740ac0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=988dc334a3e0f459 server_cookie=7fee4351e754372c in_seq=0 out_seq=0 2023-07-14T13:03:21.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.857+0000 7f0a57fff700 1 -- 172.21.15.17:0/1742074743 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c7245d8050 con 0x55c72473e6b0 2023-07-14T13:03:21.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.857+0000 7f0a57fff700 10 client.16443 handle_command_reply: tid=0 2023-07-14T13:03:21.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.857+0000 7f0a92a9db80 1 client.16443 shutdown 2023-07-14T13:03:21.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.857+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1742074743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 msgr2=0x55c7246deac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:21.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.857+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246deac0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c010d10 tx=0x7f0a6c02c360 comp rx=0 tx=0).stop 2023-07-14T13:03:21.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.858+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1742074743 shutdown_connections 2023-07-14T13:03:21.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.858+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c72473e6b0 0x55c724740ac0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.858+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7246d5ad0 0x55c7246df000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.858+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7246ca2d0 0x55c7246e0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.858+0000 7f0a92a9db80 1 --2- 172.21.15.17:0/1742074743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c7246cabe0 0x55c7246deac0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.858+0000 7f0a57fff700 0 client.16443 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:21.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.858+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1742074743 >> 172.21.15.17:0/1742074743 conn(0x55c7246c0da0 msgr2=0x55c7246cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:21.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.858+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1742074743 shutdown_connections 2023-07-14T13:03:21.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.858+0000 7f0a92a9db80 1 -- 172.21.15.17:0/1742074743 wait complete. 2023-07-14T13:03:21.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.858+0000 7f0a92a9db80 20 client.16443 trim_cache size 0 max 16384 2023-07-14T13:03:21.898 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:03:21.898 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:03:21.899 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:03:21.899 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:03:21.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/1376053258 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a680a1340 msgr2=0x7f0a680a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:21.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a680a1340 0x7f0a680a37f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a700cc1a0 tx=0x7f0a70009040 comp rx=0 tx=0).stop 2023-07-14T13:03:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/1376053258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a78105b10 msgr2=0x7f0a78195a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a78105b10 0x7f0a78195a50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009fd0 tx=0x7f0a70004c80 comp rx=0 tx=0).stop 2023-07-14T13:03:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/1376053258 shutdown_connections 2023-07-14T13:03:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a680a1340 0x7f0a680a37f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a78105b10 0x7f0a78195a50 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a780ffb00 0x7f0a7819ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 --2- 172.21.15.17:0/1376053258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a781004b0 0x7f0a7819bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:21.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/1376053258 >> 172.21.15.17:0/1376053258 conn(0x7f0a780fb600 msgr2=0x7f0a780fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:21.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/1376053258 shutdown_connections 2023-07-14T13:03:21.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:21.859+0000 7f0a7f1ff700 1 -- 172.21.15.17:0/1376053258 wait complete. 2023-07-14T13:03:21.912 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:03:21.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:03:21.982 INFO:teuthology.orchestra.run.smithi017.stderr:11900000 of 50000000 tuples (23%) done (elapsed 191.59 s, remaining 613.40 s) 2023-07-14T13:03:22.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.105+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/1759380070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4105ae0 msgr2=0x7fa7f4105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.105+0000 7fa7fc1ff700 1 --2- 172.21.15.17:0/1759380070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4105ae0 0x7fa7f4105eb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009990 tx=0x7fa7f0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.106+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/1759380070 shutdown_connections 2023-07-14T13:03:22.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.106+0000 7fa7fc1ff700 1 --2- 172.21.15.17:0/1759380070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f4100480 0x7fa7f410c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.106+0000 7fa7fc1ff700 1 --2- 172.21.15.17:0/1759380070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f4105ae0 0x7fa7f4105eb0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.106+0000 7fa7fc1ff700 1 --2- 172.21.15.17:0/1759380070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7f40ffad0 0x7fa7f40fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.106+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/1759380070 >> 172.21.15.17:0/1759380070 conn(0x7fa7f40fb590 msgr2=0x7fa7f40fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:22.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.106+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/1759380070 shutdown_connections 2023-07-14T13:03:22.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.106+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/1759380070 wait complete. 2023-07-14T13:03:22.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.107+0000 7fa7fc1ff700 1 Processor -- start 2023-07-14T13:03:22.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.108+0000 7fa7fc1ff700 1 -- start start 2023-07-14T13:03:22.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.108+0000 7fa7fc1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f40ffad0 0x7fa7f419da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.108+0000 7fa7fc1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f4100480 0x7fa7f419df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.108+0000 7fa7fc1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7f4105ae0 0x7fa7f4197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.108+0000 7fa7fc1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4198110 con 0x7fa7f40ffad0 2023-07-14T13:03:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.108+0000 7fa7fc1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4198280 con 0x7fa7f4105ae0 2023-07-14T13:03:22.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.108+0000 7fa7fc1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4198440 con 0x7fa7f4100480 2023-07-14T13:03:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.109+0000 7fa7f9f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f40ffad0 0x7fa7f419da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.109+0000 7fa7f9f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f40ffad0 0x7fa7f419da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39160/0 (socket says 172.21.15.17:39160) 2023-07-14T13:03:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.109+0000 7fa7f979a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f4100480 0x7fa7f419df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.109+0000 7fa7f9f9b700 1 -- 172.21.15.17:0/835487427 learned_addr learned my addr 172.21.15.17:0/835487427 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.109+0000 7fa7fa79c700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7f4105ae0 0x7fa7f4197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.109+0000 7fa7f9f9b700 1 -- 172.21.15.17:0/835487427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f4100480 msgr2=0x7fa7f419df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.109+0000 7fa7f9f9b700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f4100480 0x7fa7f419df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.109+0000 7fa7f9f9b700 1 -- 172.21.15.17:0/835487427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7f4105ae0 msgr2=0x7fa7f4197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.109+0000 7fa7f9f9b700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7f4105ae0 0x7fa7f4197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.109+0000 7fa7f9f9b700 1 -- 172.21.15.17:0/835487427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00095f0 con 0x7fa7f40ffad0 2023-07-14T13:03:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.109+0000 7fa7f9f9b700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f40ffad0 0x7fa7f419da30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0005910 tx=0x7fa7f00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.110+0000 7fa7eaffd700 1 -- 172.21.15.17:0/835487427 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f001d070 con 0x7fa7f40ffad0 2023-07-14T13:03:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.110+0000 7fa7eaffd700 1 -- 172.21.15.17:0/835487427 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7f0021410 con 0x7fa7f40ffad0 2023-07-14T13:03:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.110+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/835487427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f41986c0 con 0x7fa7f40ffad0 2023-07-14T13:03:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.110+0000 7fa7eaffd700 1 -- 172.21.15.17:0/835487427 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0017650 con 0x7fa7f40ffad0 2023-07-14T13:03:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.110+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/835487427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f41a4a20 con 0x7fa7f40ffad0 2023-07-14T13:03:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.111+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/835487427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f4067300 con 0x7fa7f40ffad0 2023-07-14T13:03:22.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.114+0000 7fa7eaffd700 1 -- 172.21.15.17:0/835487427 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa7f000fb00 con 0x7fa7f40ffad0 2023-07-14T13:03:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.115+0000 7fa7eaffd700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa7e00a1300 0x7fa7e00a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.115+0000 7fa7eaffd700 1 -- 172.21.15.17:0/835487427 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa7f00ce130 con 0x7fa7f40ffad0 2023-07-14T13:03:22.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.116+0000 7fa7f979a700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa7e00a1300 0x7fa7e00a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.117+0000 7fa7f979a700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa7e00a1300 0x7fa7e00a37b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7f410cd40 tx=0x7fa7e4009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:22.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.121+0000 7fa7eaffd700 1 -- 172.21.15.17:0/835487427 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa7f00975e0 con 0x7fa7f40ffad0 2023-07-14T13:03:22.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.415+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/835487427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7f4198fb0 con 0x7fa7f40ffad0 2023-07-14T13:03:22.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.416+0000 7fa7eaffd700 1 -- 172.21.15.17:0/835487427 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+10851 (secure 0 0 0) 0x7fa7f009ac00 con 0x7fa7f40ffad0 2023-07-14T13:03:22.449 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:03:22.449 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:01:22.126099+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:03:22.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/835487427 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa7e00a1300 msgr2=0x7fa7e00a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa7e00a1300 0x7fa7e00a37b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7f410cd40 tx=0x7fa7e4009260 comp rx=0 tx=0).stop 2023-07-14T13:03:22.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/835487427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f40ffad0 msgr2=0x7fa7f419da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f40ffad0 0x7fa7f419da30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0005910 tx=0x7fa7f00047b0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/835487427 shutdown_connections 2023-07-14T13:03:22.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa7e00a1300 0x7fa7e00a37b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7f4105ae0 0x7fa7f4197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7f40ffad0 0x7fa7f419da30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 --2- 172.21.15.17:0/835487427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f4100480 0x7fa7f419df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/835487427 >> 172.21.15.17:0/835487427 conn(0x7fa7f40fb590 msgr2=0x7fa7f410ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:22.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/835487427 shutdown_connections 2023-07-14T13:03:22.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.419+0000 7fa7fc1ff700 1 -- 172.21.15.17:0/835487427 wait complete. 2023-07-14T13:03:22.455 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2023-07-14T13:03:22.471 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:03:22.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.666+0000 7f6ad71ff700 1 -- 172.21.15.17:0/3810027549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ad00731c0 msgr2=0x7f6ad010bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.666+0000 7f6ad71ff700 1 --2- 172.21.15.17:0/3810027549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ad00731c0 0x7f6ad010bde0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0009990 tx=0x7f6ac0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.666+0000 7f6ad71ff700 1 -- 172.21.15.17:0/3810027549 shutdown_connections 2023-07-14T13:03:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.666+0000 7f6ad71ff700 1 --2- 172.21.15.17:0/3810027549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ad010c320 0x7f6ad010e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.666+0000 7f6ad71ff700 1 --2- 172.21.15.17:0/3810027549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ad00728b0 0x7f6ad0072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.666+0000 7f6ad71ff700 1 --2- 172.21.15.17:0/3810027549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ad00731c0 0x7f6ad010bde0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.666+0000 7f6ad71ff700 1 -- 172.21.15.17:0/3810027549 >> 172.21.15.17:0/3810027549 conn(0x7f6ad00fb5e0 msgr2=0x7f6ad00fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:22.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.666+0000 7f6ad71ff700 1 -- 172.21.15.17:0/3810027549 shutdown_connections 2023-07-14T13:03:22.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.667+0000 7f6ad71ff700 1 -- 172.21.15.17:0/3810027549 wait complete. 2023-07-14T13:03:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.668+0000 7f6ad71ff700 1 Processor -- start 2023-07-14T13:03:22.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.668+0000 7f6ad71ff700 1 -- start start 2023-07-14T13:03:22.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.668+0000 7f6ad71ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ad00728b0 0x7f6ad019dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.668+0000 7f6ad71ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ad00731c0 0x7f6ad019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.668+0000 7f6ad71ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ad010c320 0x7f6ad0197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.668+0000 7f6ad71ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01981b0 con 0x7f6ad00728b0 2023-07-14T13:03:22.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.668+0000 7f6ad71ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad0198320 con 0x7f6ad00731c0 2023-07-14T13:03:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.668+0000 7f6ad71ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01984e0 con 0x7f6ad010c320 2023-07-14T13:03:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.668+0000 7f6ad4f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ad00728b0 0x7f6ad019dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.669+0000 7f6ad4f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ad00728b0 0x7f6ad019dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39170/0 (socket says 172.21.15.17:39170) 2023-07-14T13:03:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.669+0000 7f6ad4f9b700 1 -- 172.21.15.17:0/2577980717 learned_addr learned my addr 172.21.15.17:0/2577980717 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.669+0000 7f6ac7fff700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ad00731c0 0x7f6ad019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.669+0000 7f6ad579c700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ad010c320 0x7f6ad0197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.669+0000 7f6ad4f9b700 1 -- 172.21.15.17:0/2577980717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ad010c320 msgr2=0x7f6ad0197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.669+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ad010c320 0x7f6ad0197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.669+0000 7f6ad4f9b700 1 -- 172.21.15.17:0/2577980717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ad00731c0 msgr2=0x7f6ad019e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.669+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ad00731c0 0x7f6ad019e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.669+0000 7f6ad4f9b700 1 -- 172.21.15.17:0/2577980717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac00095f0 con 0x7f6ad00728b0 2023-07-14T13:03:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.669+0000 7f6ad579c700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ad010c320 0x7f6ad0197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.669+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ad00728b0 0x7f6ad019dad0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00d950 tx=0x7f6acc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.670+0000 7f6ac5ffb700 1 -- 172.21.15.17:0/2577980717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc009940 con 0x7f6ad00728b0 2023-07-14T13:03:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.670+0000 7f6ac5ffb700 1 -- 172.21.15.17:0/2577980717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6acc010460 con 0x7f6ad00728b0 2023-07-14T13:03:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.670+0000 7f6ac5ffb700 1 -- 172.21.15.17:0/2577980717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc00f620 con 0x7f6ad00728b0 2023-07-14T13:03:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.670+0000 7f6ad71ff700 1 -- 172.21.15.17:0/2577980717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad01987c0 con 0x7f6ad00728b0 2023-07-14T13:03:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.670+0000 7f6ad71ff700 1 -- 172.21.15.17:0/2577980717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad01a4ac0 con 0x7f6ad00728b0 2023-07-14T13:03:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.674+0000 7f6ac5ffb700 1 -- 172.21.15.17:0/2577980717 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6acc0105d0 con 0x7f6ad00728b0 2023-07-14T13:03:22.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.674+0000 7f6aeaa67b80 1 Processor -- start 2023-07-14T13:03:22.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.675+0000 7f6aeaa67b80 1 -- start start 2023-07-14T13:03:22.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.675+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f402d0 0x55e0f6f406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.675+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f4b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.675+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f4deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.675+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6e46cb0 con 0x55e0f6f4bad0 2023-07-14T13:03:22.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.675+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6e99a40 con 0x55e0f6f40be0 2023-07-14T13:03:22.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.675+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6e92ed0 con 0x55e0f6f402d0 2023-07-14T13:03:22.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.675+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f4deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.675+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f4deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39174/0 (socket says 172.21.15.17:39174) 2023-07-14T13:03:22.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.676+0000 7f6ac7fff700 1 -- 172.21.15.17:0/32154249 learned_addr learned my addr 172.21.15.17:0/32154249 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:22.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.676+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/32154249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f4b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.676+0000 7f6ad579c700 1 --2- 172.21.15.17:0/32154249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f402d0 0x55e0f6f406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.676+0000 7f6ac7fff700 1 -- 172.21.15.17:0/32154249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f402d0 msgr2=0x55e0f6f406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:22.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.676+0000 7f6ac7fff700 1 --2- 172.21.15.17:0/32154249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f402d0 0x55e0f6f406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.676+0000 7f6ac7fff700 1 -- 172.21.15.17:0/32154249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 msgr2=0x55e0f6f4b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.676+0000 7f6ac7fff700 1 --2- 172.21.15.17:0/32154249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f4b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.676+0000 7f6ac7fff700 1 -- 172.21.15.17:0/32154249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0f6cc0de0 con 0x55e0f6f4bad0 2023-07-14T13:03:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.676+0000 7f6ac7fff700 1 --2- 172.21.15.17:0/32154249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f4deb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00098e0 tx=0x7f6ac0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5185c07a02296b7c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.676+0000 7f6ac5ffb700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ab80a1340 0x7f6ab80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.677+0000 7f6ab6ffd700 1 -- 172.21.15.17:0/32154249 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac001d070 con 0x55e0f6f4bad0 2023-07-14T13:03:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.677+0000 7f6ab6ffd700 1 -- 172.21.15.17:0/32154249 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ac001e040 con 0x55e0f6f4bad0 2023-07-14T13:03:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.677+0000 7f6ac5ffb700 1 -- 172.21.15.17:0/2577980717 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6acc0ccae0 con 0x7f6ad00728b0 2023-07-14T13:03:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.677+0000 7f6ab6ffd700 1 -- 172.21.15.17:0/32154249 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0004500 con 0x55e0f6f4bad0 2023-07-14T13:03:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.677+0000 7f6ad579c700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ab80a1340 0x7f6ab80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.678+0000 7f6ad579c700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ab80a1340 0x7f6ab80a37f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6ad019e7d0 tx=0x7f6ac8009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.678+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/32154249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 msgr2=0x55e0f6f4deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.678+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/32154249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f4deb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00098e0 tx=0x7f6ac0009f90 comp rx=0 tx=0).stop 2023-07-14T13:03:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.678+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/32154249 shutdown_connections 2023-07-14T13:03:22.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.678+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/32154249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f4deb0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.678+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/32154249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f402d0 0x55e0f6f406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.678+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/32154249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f4b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.678+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/32154249 >> 172.21.15.17:0/32154249 conn(0x55e0f6f36da0 msgr2=0x55e0f6f3c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.678+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/32154249 shutdown_connections 2023-07-14T13:03:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.678+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/32154249 wait complete. 2023-07-14T13:03:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.679+0000 7f6aeaa67b80 1 -- start start 2023-07-14T13:03:22.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.679+0000 7f6aeaa67b80 1 Processor -- start 2023-07-14T13:03:22.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.679+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 0x55e0f6f4b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.679+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f40be0 0x55e0f6f48740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.679+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f48d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.679+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6e32ac0 con 0x55e0f6f402d0 2023-07-14T13:03:22.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.679+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6e327c0 con 0x55e0f6f4bad0 2023-07-14T13:03:22.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.679+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6d16920 con 0x55e0f6f40be0 2023-07-14T13:03:22.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.679+0000 7f6aeaa67b80 10 client.0 _ll_register_callbacks cb 0x55e0f6e30760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:22.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.680+0000 7f6ad4f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 0x55e0f6f4b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.680+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f40be0 0x55e0f6f48740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.680+0000 7f6ad4f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 0x55e0f6f4b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39178/0 (socket says 172.21.15.17:39178) 2023-07-14T13:03:22.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.680+0000 7f6ad4f9b700 1 -- 172.21.15.17:0/352989801 learned_addr learned my addr 172.21.15.17:0/352989801 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:22.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.680+0000 7f6ad579c700 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f48d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.680+0000 7f6ac7fff700 1 -- 172.21.15.17:0/352989801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f4bad0 msgr2=0x55e0f6f48d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:22.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.680+0000 7f6ac7fff700 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f48d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.680+0000 7f6ac7fff700 1 -- 172.21.15.17:0/352989801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 msgr2=0x55e0f6f4b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:22.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.680+0000 7f6ac7fff700 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 0x55e0f6f4b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.680+0000 7f6ac7fff700 1 -- 172.21.15.17:0/352989801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad010f3a0 con 0x55e0f6f40be0 2023-07-14T13:03:22.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.680+0000 7f6ad579c700 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f48d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:03:22.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.681+0000 7f6ac7fff700 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f40be0 0x55e0f6f48740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00098e0 tx=0x7f6ac0009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adf84608559f233 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:22.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.681+0000 7f6aaffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:03:22.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.681+0000 7f6aaffff700 1 -- 172.21.15.17:0/352989801 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac001d040 con 0x55e0f6f40be0 2023-07-14T13:03:22.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.681+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/352989801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0f6dec4f0 con 0x55e0f6f40be0 2023-07-14T13:03:22.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.681+0000 7f6aaffff700 1 -- 172.21.15.17:0/352989801 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6ac0005230 con 0x55e0f6f40be0 2023-07-14T13:03:22.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.681+0000 7f6aaffff700 1 -- 172.21.15.17:0/352989801 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ac00053f0 con 0x55e0f6f40be0 2023-07-14T13:03:22.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.681+0000 7f6aeaa67b80 10 client.26158 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:22.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.681+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/352989801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55e0f6ca9c60 con 0x55e0f6f40be0 2023-07-14T13:03:22.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.682+0000 7f6aaffff700 1 -- 172.21.15.17:0/352989801 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e0f6dec4f0 con 0x55e0f6f40be0 2023-07-14T13:03:22.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.682+0000 7f6aaffff700 1 -- 172.21.15.17:0/352989801 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6ac0003940 con 0x55e0f6f40be0 2023-07-14T13:03:22.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.682+0000 7f6aeaa67b80 10 client.26158 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:22.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.682+0000 7f6aeaa67b80 10 client.26158 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:03:22.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.682+0000 7f6aeaa67b80 20 client.26158 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:22.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.682+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55e0f6f5af80 0x55e0f6f5d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.682+0000 7f6aeaa67b80 4 client.26158 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:22.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.682+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/352989801 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0f6e8beb0 con 0x55e0f6f5af80 2023-07-14T13:03:22.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.683+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55e0f6f5af80 0x55e0f6f5d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.683+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55e0f6f5af80 0x55e0f6f5d390 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70b367ee620cd24a server_cookie=196c3b81bbbfe78 in_seq=0 out_seq=0 2023-07-14T13:03:22.731 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.683+0000 7f6aaffff700 10 client.26158 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:03:22.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aaffff700 1 -- 172.21.15.17:0/352989801 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e0f6e8beb0 con 0x55e0f6f5af80 2023-07-14T13:03:22.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aaffff700 10 client.26158 handle_command_reply: tid=0 2023-07-14T13:03:22.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aeaa67b80 1 client.26158 shutdown 2023-07-14T13:03:22.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/352989801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f40be0 msgr2=0x55e0f6f48740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f40be0 0x55e0f6f48740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00098e0 tx=0x7f6ac0009310 comp rx=0 tx=0).stop 2023-07-14T13:03:22.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/352989801 shutdown_connections 2023-07-14T13:03:22.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f48d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 0x55e0f6f4b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55e0f6f5af80 0x55e0f6f5d390 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/352989801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f40be0 0x55e0f6f48740 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aaffff700 0 client.26158 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:03:22.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/352989801 >> 172.21.15.17:0/352989801 conn(0x55e0f6f36da0 msgr2=0x55e0f6f3c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:22.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/352989801 shutdown_connections 2023-07-14T13:03:22.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.684+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/352989801 wait complete. 2023-07-14T13:03:22.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.685+0000 7f6aeaa67b80 20 client.26158 trim_cache size 0 max 16384 2023-07-14T13:03:22.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.700+0000 7f6aeaa67b80 1 Processor -- start 2023-07-14T13:03:22.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.700+0000 7f6aeaa67b80 1 -- start start 2023-07-14T13:03:22.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.700+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 0x55e0f6f524a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.700+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f57620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.700+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f4aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.700+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6f41540 con 0x55e0f6f402d0 2023-07-14T13:03:22.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.700+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6f3dce0 con 0x55e0f6f40be0 2023-07-14T13:03:22.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.700+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6f421a0 con 0x55e0f6f4bad0 2023-07-14T13:03:22.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ad4f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 0x55e0f6f524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ad4f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 0x55e0f6f524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39190/0 (socket says 172.21.15.17:39190) 2023-07-14T13:03:22.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ad4f9b700 1 -- 172.21.15.17:0/3779812698 learned_addr learned my addr 172.21.15.17:0/3779812698 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:22.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ac7fff700 1 --2- 172.21.15.17:0/3779812698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f57620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ad579c700 1 --2- 172.21.15.17:0/3779812698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f4aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ad4f9b700 1 -- 172.21.15.17:0/3779812698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f4bad0 msgr2=0x55e0f6f4aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:22.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/3779812698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f4aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ad4f9b700 1 -- 172.21.15.17:0/3779812698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 msgr2=0x55e0f6f57620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:22.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/3779812698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f57620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ad4f9b700 1 -- 172.21.15.17:0/3779812698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0f6ce7250 con 0x55e0f6f402d0 2023-07-14T13:03:22.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ad579c700 1 --2- 172.21.15.17:0/3779812698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f4aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:03:22.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.701+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/3779812698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 0x55e0f6f524a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6acc099b50 tx=0x7f6acc0ceef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ffb609c01485cb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.702+0000 7f6ab77fe700 1 -- 172.21.15.17:0/3779812698 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc099700 con 0x55e0f6f402d0 2023-07-14T13:03:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.702+0000 7f6ab77fe700 1 -- 172.21.15.17:0/3779812698 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6acc0cce90 con 0x55e0f6f402d0 2023-07-14T13:03:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.702+0000 7f6ab77fe700 1 -- 172.21.15.17:0/3779812698 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0a2010 con 0x55e0f6f402d0 2023-07-14T13:03:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.702+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3779812698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 msgr2=0x55e0f6f524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.702+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/3779812698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 0x55e0f6f524a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6acc099b50 tx=0x7f6acc0ceef0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.702+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3779812698 shutdown_connections 2023-07-14T13:03:22.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.702+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/3779812698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f4aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.702+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/3779812698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f402d0 0x55e0f6f524a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.702+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/3779812698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f57620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.703+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3779812698 >> 172.21.15.17:0/3779812698 conn(0x55e0f6f36da0 msgr2=0x55e0f6f61cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:22.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.703+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3779812698 shutdown_connections 2023-07-14T13:03:22.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.703+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3779812698 wait complete. 2023-07-14T13:03:22.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.703+0000 7f6aeaa67b80 1 -- start start 2023-07-14T13:03:22.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.703+0000 7f6aeaa67b80 1 Processor -- start 2023-07-14T13:03:22.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.704+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f402d0 0x55e0f6f45d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.704+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.704+0000 7f6aeaa67b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f449e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.704+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6f45090 con 0x55e0f6f4bad0 2023-07-14T13:03:22.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.704+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6f45200 con 0x55e0f6f40be0 2023-07-14T13:03:22.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.704+0000 7f6aeaa67b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f6f453c0 con 0x55e0f6f402d0 2023-07-14T13:03:22.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.704+0000 7f6aeaa67b80 10 client.0 _ll_register_callbacks cb 0x7f6acc0d1040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:22.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6ad579c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6ad579c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f449e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39206/0 (socket says 172.21.15.17:39206) 2023-07-14T13:03:22.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6ad579c700 1 -- 172.21.15.17:0/3048315822 learned_addr learned my addr 172.21.15.17:0/3048315822 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:22.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f402d0 0x55e0f6f45d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6ad579c700 1 -- 172.21.15.17:0/3048315822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f402d0 msgr2=0x55e0f6f45d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:22.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6ad579c700 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f402d0 0x55e0f6f45d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6ad579c700 1 -- 172.21.15.17:0/3048315822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 msgr2=0x55e0f6f462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:22.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6ad579c700 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6ad579c700 1 -- 172.21.15.17:0/3048315822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad01a4ac0 con 0x55e0f6f4bad0 2023-07-14T13:03:22.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6ad579c700 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f449e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8018c30 tx=0x7f6ac8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effcad03ab9695d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:22.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.705+0000 7f6aaffff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:22.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.706+0000 7f6aaffff700 1 -- 172.21.15.17:0/3048315822 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8007ea0 con 0x55e0f6f4bad0 2023-07-14T13:03:22.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.706+0000 7f6aaffff700 1 -- 172.21.15.17:0/3048315822 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6ac8024890 con 0x55e0f6f4bad0 2023-07-14T13:03:22.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.706+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3048315822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ac001e040 con 0x55e0f6f4bad0 2023-07-14T13:03:22.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.706+0000 7f6aaffff700 1 -- 172.21.15.17:0/3048315822 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ac8024a50 con 0x55e0f6f4bad0 2023-07-14T13:03:22.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.706+0000 7f6aeaa67b80 10 client.16467 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:22.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.706+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3048315822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55e0f6cbf2b0 con 0x55e0f6f4bad0 2023-07-14T13:03:22.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.706+0000 7f6aaffff700 1 -- 172.21.15.17:0/3048315822 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ac001e040 con 0x55e0f6f4bad0 2023-07-14T13:03:22.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.707+0000 7f6aaffff700 1 -- 172.21.15.17:0/3048315822 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6ac80233e0 con 0x55e0f6f4bad0 2023-07-14T13:03:22.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.707+0000 7f6aeaa67b80 10 client.16467 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:22.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.707+0000 7f6aeaa67b80 10 client.16467 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:03:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.707+0000 7f6aeaa67b80 20 client.16467 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.707+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55e0f6faff30 0x55e0f6fb2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.707+0000 7f6aeaa67b80 4 client.16467 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:03:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.707+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3048315822 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e0f6e4e050 con 0x55e0f6faff30 2023-07-14T13:03:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.707+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55e0f6faff30 0x55e0f6fb2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6ad4f9b700 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55e0f6faff30 0x55e0f6fb2340 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed33e3821e6f0f06 server_cookie=3e62b7de0ca0c51c in_seq=0 out_seq=0 2023-07-14T13:03:22.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aaffff700 10 client.16467 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:03:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aaffff700 1 -- 172.21.15.17:0/3048315822 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e0f6e4e050 con 0x55e0f6faff30 2023-07-14T13:03:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aaffff700 10 client.16467 handle_command_reply: tid=0 2023-07-14T13:03:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aeaa67b80 1 client.16467 shutdown 2023-07-14T13:03:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3048315822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 msgr2=0x55e0f6f449e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f449e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8018c30 tx=0x7f6ac8004ad0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3048315822 shutdown_connections 2023-07-14T13:03:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f6f4bad0 0x55e0f6f449e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55e0f6faff30 0x55e0f6fb2340 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f6f402d0 0x55e0f6f45d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aeaa67b80 1 --2- 172.21.15.17:0/3048315822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f6f40be0 0x55e0f6f462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3048315822 >> 172.21.15.17:0/3048315822 conn(0x55e0f6f36da0 msgr2=0x55e0f6f43a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aaffff700 0 client.16467 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:03:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.708+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3048315822 shutdown_connections 2023-07-14T13:03:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6aeaa67b80 1 -- 172.21.15.17:0/3048315822 wait complete. 2023-07-14T13:03:22.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6aeaa67b80 20 client.16467 trim_cache size 0 max 16384 2023-07-14T13:03:22.757 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:03:22.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6ad71ff700 1 -- 172.21.15.17:0/2577980717 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ab80a1340 msgr2=0x7f6ab80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6ad71ff700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ab80a1340 0x7f6ab80a37f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6ad019e7d0 tx=0x7f6ac8009040 comp rx=0 tx=0).stop 2023-07-14T13:03:22.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6ad71ff700 1 -- 172.21.15.17:0/2577980717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ad00728b0 msgr2=0x7f6ad019dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6ad71ff700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ad00728b0 0x7f6ad019dad0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00d950 tx=0x7f6acc00dc60 comp rx=0 tx=0).stop 2023-07-14T13:03:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6ad71ff700 1 -- 172.21.15.17:0/2577980717 shutdown_connections 2023-07-14T13:03:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6ad71ff700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ab80a1340 0x7f6ab80a37f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6ad71ff700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ad010c320 0x7f6ad0197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6ad71ff700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ad00728b0 0x7f6ad019dad0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6ad71ff700 1 --2- 172.21.15.17:0/2577980717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ad00731c0 0x7f6ad019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.709+0000 7f6ad71ff700 1 -- 172.21.15.17:0/2577980717 >> 172.21.15.17:0/2577980717 conn(0x7f6ad00fb5e0 msgr2=0x7f6ad010e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.710+0000 7f6ad71ff700 1 -- 172.21.15.17:0/2577980717 shutdown_connections 2023-07-14T13:03:22.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.710+0000 7f6ad71ff700 1 -- 172.21.15.17:0/2577980717 wait complete. 2023-07-14T13:03:22.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:03:22.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.958+0000 7ff34efff700 1 -- 172.21.15.17:0/1381441432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff348100490 msgr2=0x7ff34810c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.958+0000 7ff34efff700 1 --2- 172.21.15.17:0/1381441432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff348100490 0x7ff34810c920 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff34000b0a0 tx=0x7ff34000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.958+0000 7ff34efff700 1 -- 172.21.15.17:0/1381441432 shutdown_connections 2023-07-14T13:03:22.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.958+0000 7ff34efff700 1 --2- 172.21.15.17:0/1381441432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff348100490 0x7ff34810c920 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.958+0000 7ff34efff700 1 --2- 172.21.15.17:0/1381441432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff348105af0 0x7ff348105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.958+0000 7ff34efff700 1 --2- 172.21.15.17:0/1381441432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3480ffae0 0x7ff3480fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.958+0000 7ff34efff700 1 -- 172.21.15.17:0/1381441432 >> 172.21.15.17:0/1381441432 conn(0x7ff3480fb5e0 msgr2=0x7ff3480fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:22.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.959+0000 7ff34efff700 1 -- 172.21.15.17:0/1381441432 shutdown_connections 2023-07-14T13:03:22.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.959+0000 7ff34efff700 1 -- 172.21.15.17:0/1381441432 wait complete. 2023-07-14T13:03:22.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.960+0000 7ff34efff700 1 Processor -- start 2023-07-14T13:03:22.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.960+0000 7ff34efff700 1 -- start start 2023-07-14T13:03:22.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.960+0000 7ff34efff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3480ffae0 0x7ff348197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.960+0000 7ff34efff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff348100490 0x7ff3481982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.960+0000 7ff34efff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348105af0 0x7ff34819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.960+0000 7ff34efff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34819cd80 con 0x7ff3480ffae0 2023-07-14T13:03:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.960+0000 7ff34efff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34819cef0 con 0x7ff348100490 2023-07-14T13:03:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.960+0000 7ff34efff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34819d0b0 con 0x7ff348105af0 2023-07-14T13:03:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.961+0000 7ff34cd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3480ffae0 0x7ff348197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.961+0000 7ff347fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff348100490 0x7ff3481982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.961+0000 7ff34cd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3480ffae0 0x7ff348197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39220/0 (socket says 172.21.15.17:39220) 2023-07-14T13:03:22.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.961+0000 7ff34cd9b700 1 -- 172.21.15.17:0/3836041789 learned_addr learned my addr 172.21.15.17:0/3836041789 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.961+0000 7ff34d59c700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348105af0 0x7ff34819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.961+0000 7ff34cd9b700 1 -- 172.21.15.17:0/3836041789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348105af0 msgr2=0x7ff34819c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.961+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348105af0 0x7ff34819c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.961+0000 7ff34cd9b700 1 -- 172.21.15.17:0/3836041789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff348100490 msgr2=0x7ff3481982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.961+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff348100490 0x7ff3481982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.961+0000 7ff34cd9b700 1 -- 172.21.15.17:0/3836041789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340009d00 con 0x7ff3480ffae0 2023-07-14T13:03:22.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.961+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3480ffae0 0x7ff348197da0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00d950 tx=0x7ff33c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:22.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.962+0000 7ff345ffb700 1 -- 172.21.15.17:0/3836041789 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c00f890 con 0x7ff3480ffae0 2023-07-14T13:03:22.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.962+0000 7ff345ffb700 1 -- 172.21.15.17:0/3836041789 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff33c00fe80 con 0x7ff3480ffae0 2023-07-14T13:03:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.962+0000 7ff34efff700 1 -- 172.21.15.17:0/3836041789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34819d390 con 0x7ff3480ffae0 2023-07-14T13:03:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.962+0000 7ff345ffb700 1 -- 172.21.15.17:0/3836041789 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c00e3b0 con 0x7ff3480ffae0 2023-07-14T13:03:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.962+0000 7ff34efff700 1 -- 172.21.15.17:0/3836041789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3481a4bd0 con 0x7ff3480ffae0 2023-07-14T13:03:22.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.966+0000 7ff345ffb700 1 -- 172.21.15.17:0/3836041789 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff33c010460 con 0x7ff3480ffae0 2023-07-14T13:03:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.967+0000 7ff362974b80 1 Processor -- start 2023-07-14T13:03:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.968+0000 7ff362974b80 1 -- start start 2023-07-14T13:03:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.968+0000 7ff362974b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34ad2d0 0x5624c34ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.968+0000 7ff345ffb700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff3380a12c0 0x7ff3380a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.968+0000 7ff362974b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34adbe0 0x5624c34b8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.968+0000 7ff362974b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 0x5624c34baeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.968+0000 7ff362974b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c33b3cb0 con 0x5624c34b8ad0 2023-07-14T13:03:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.968+0000 7ff362974b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c3406a40 con 0x5624c34adbe0 2023-07-14T13:03:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.968+0000 7ff362974b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c33ffed0 con 0x5624c34ad2d0 2023-07-14T13:03:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.968+0000 7ff345ffb700 1 -- 172.21.15.17:0/3836041789 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff33c0cca40 con 0x7ff3480ffae0 2023-07-14T13:03:23.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.968+0000 7ff34d59c700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff3380a12c0 0x7ff3380a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff34d59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 0x5624c34baeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff34d59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 0x5624c34baeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39224/0 (socket says 172.21.15.17:39224) 2023-07-14T13:03:23.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff34d59c700 1 -- 172.21.15.17:0/2377366446 learned_addr learned my addr 172.21.15.17:0/2377366446 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:23.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/2377366446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34ad2d0 0x5624c34ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff347fff700 1 --2- 172.21.15.17:0/2377366446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34adbe0 0x5624c34b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff34d59c700 1 -- 172.21.15.17:0/2377366446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34ad2d0 msgr2=0x5624c34ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff34d59c700 1 --2- 172.21.15.17:0/2377366446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34ad2d0 0x5624c34ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff34d59c700 1 -- 172.21.15.17:0/2377366446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34adbe0 msgr2=0x5624c34b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff34d59c700 1 --2- 172.21.15.17:0/2377366446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34adbe0 0x5624c34b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff34d59c700 1 -- 172.21.15.17:0/2377366446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624c322dde0 con 0x5624c34b8ad0 2023-07-14T13:03:23.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff34d59c700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff3380a12c0 0x7ff3380a3770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff340015000 tx=0x7ff3400094a0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:23.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.969+0000 7ff34d59c700 1 --2- 172.21.15.17:0/2377366446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 0x5624c34baeb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff34000bcf0 tx=0x7ff340026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a3ea4a0c4748eb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:23.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.970+0000 7ff332ffd700 1 -- 172.21.15.17:0/2377366446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340026070 con 0x5624c34b8ad0 2023-07-14T13:03:23.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.970+0000 7ff332ffd700 1 -- 172.21.15.17:0/2377366446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff340008cc0 con 0x5624c34b8ad0 2023-07-14T13:03:23.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.970+0000 7ff332ffd700 1 -- 172.21.15.17:0/2377366446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000e040 con 0x5624c34b8ad0 2023-07-14T13:03:23.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.971+0000 7ff362974b80 1 -- 172.21.15.17:0/2377366446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 msgr2=0x5624c34baeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.971+0000 7ff362974b80 1 --2- 172.21.15.17:0/2377366446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 0x5624c34baeb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff34000bcf0 tx=0x7ff340026000 comp rx=0 tx=0).stop 2023-07-14T13:03:23.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.971+0000 7ff362974b80 1 -- 172.21.15.17:0/2377366446 shutdown_connections 2023-07-14T13:03:23.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.971+0000 7ff362974b80 1 --2- 172.21.15.17:0/2377366446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 0x5624c34baeb0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.971+0000 7ff362974b80 1 --2- 172.21.15.17:0/2377366446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34ad2d0 0x5624c34ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.971+0000 7ff362974b80 1 --2- 172.21.15.17:0/2377366446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34adbe0 0x5624c34b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.971+0000 7ff362974b80 1 -- 172.21.15.17:0/2377366446 >> 172.21.15.17:0/2377366446 conn(0x5624c34a3da0 msgr2=0x5624c34a96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:23.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.971+0000 7ff362974b80 1 -- 172.21.15.17:0/2377366446 shutdown_connections 2023-07-14T13:03:23.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.971+0000 7ff362974b80 1 -- 172.21.15.17:0/2377366446 wait complete. 2023-07-14T13:03:23.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.972+0000 7ff362974b80 1 -- start start 2023-07-14T13:03:23.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.972+0000 7ff362974b80 1 Processor -- start 2023-07-14T13:03:23.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.972+0000 7ff362974b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34ad2d0 0x5624c34b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.972+0000 7ff362974b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.972+0000 7ff362974b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 0x5624c34b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.972+0000 7ff362974b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c339fac0 con 0x5624c34b8ad0 2023-07-14T13:03:23.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.972+0000 7ff362974b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c339f7c0 con 0x5624c34ad2d0 2023-07-14T13:03:23.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.972+0000 7ff362974b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c3283920 con 0x5624c34adbe0 2023-07-14T13:03:23.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff362974b80 10 client.0 _ll_register_callbacks cb 0x5624c339d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:23.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff347fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff34d59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 0x5624c34b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff347fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41328/0 (socket says 172.21.15.17:41328) 2023-07-14T13:03:23.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff347fff700 1 -- 172.21.15.17:0/3923488182 learned_addr learned my addr 172.21.15.17:0/3923488182 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:23.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34ad2d0 0x5624c34b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff347fff700 1 -- 172.21.15.17:0/3923488182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34ad2d0 msgr2=0x5624c34b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff347fff700 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34ad2d0 0x5624c34b8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff347fff700 1 -- 172.21.15.17:0/3923488182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 msgr2=0x5624c34b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff347fff700 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 0x5624c34b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff347fff700 1 -- 172.21.15.17:0/3923488182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34810d220 con 0x5624c34adbe0 2023-07-14T13:03:23.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.973+0000 7ff34d59c700 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 0x5624c34b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:23.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.974+0000 7ff347fff700 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34b57a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff334012770 tx=0x7ff334012a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=442b63fee8b76f96 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:23.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.974+0000 7ff327fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:03:23.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.974+0000 7ff327fff700 1 -- 172.21.15.17:0/3923488182 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334017070 con 0x5624c34adbe0 2023-07-14T13:03:23.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.974+0000 7ff327fff700 1 -- 172.21.15.17:0/3923488182 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff334010430 con 0x5624c34adbe0 2023-07-14T13:03:23.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.974+0000 7ff362974b80 1 -- 172.21.15.17:0/3923488182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624c33594f0 con 0x5624c34adbe0 2023-07-14T13:03:23.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.974+0000 7ff327fff700 1 -- 172.21.15.17:0/3923488182 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3340105f0 con 0x5624c34adbe0 2023-07-14T13:03:23.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.974+0000 7ff362974b80 10 client.26173 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:23.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.974+0000 7ff362974b80 1 -- 172.21.15.17:0/3923488182 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5624c3216c60 con 0x5624c34adbe0 2023-07-14T13:03:23.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.975+0000 7ff327fff700 1 -- 172.21.15.17:0/3923488182 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5624c33594f0 con 0x5624c34adbe0 2023-07-14T13:03:23.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.975+0000 7ff327fff700 1 -- 172.21.15.17:0/3923488182 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff33401c710 con 0x5624c34adbe0 2023-07-14T13:03:23.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.975+0000 7ff362974b80 10 client.26173 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:23.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.975+0000 7ff362974b80 10 client.26173 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:03:23.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.975+0000 7ff362974b80 20 client.26173 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:23.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.975+0000 7ff362974b80 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x5624c34c8580 0x5624c34ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.975+0000 7ff362974b80 4 client.26173 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:23.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.975+0000 7ff362974b80 1 -- 172.21.15.17:0/3923488182 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624c33f8eb0 con 0x5624c34c8580 2023-07-14T13:03:23.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.976+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x5624c34c8580 0x5624c34ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.976+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x5624c34c8580 0x5624c34ca990 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=61448111abdaef93 server_cookie=7fbd2403b61c406e in_seq=0 out_seq=0 2023-07-14T13:03:23.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.976+0000 7ff327fff700 10 client.26173 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:03:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.977+0000 7ff327fff700 1 -- 172.21.15.17:0/3923488182 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5624c33f8eb0 con 0x5624c34c8580 2023-07-14T13:03:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.977+0000 7ff327fff700 10 client.26173 handle_command_reply: tid=0 2023-07-14T13:03:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.977+0000 7ff362974b80 1 client.26173 shutdown 2023-07-14T13:03:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff362974b80 1 -- 172.21.15.17:0/3923488182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 msgr2=0x5624c34b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff362974b80 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34b57a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff334012770 tx=0x7ff334012a80 comp rx=0 tx=0).stop 2023-07-14T13:03:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff362974b80 1 -- 172.21.15.17:0/3923488182 shutdown_connections 2023-07-14T13:03:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff362974b80 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34b8ad0 0x5624c34b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff362974b80 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x5624c34c8580 0x5624c34ca990 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff362974b80 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34ad2d0 0x5624c34b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff362974b80 1 --2- 172.21.15.17:0/3923488182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34b57a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff327fff700 0 client.26173 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:03:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff362974b80 1 -- 172.21.15.17:0/3923488182 >> 172.21.15.17:0/3923488182 conn(0x5624c34a3da0 msgr2=0x5624c34a9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff362974b80 1 -- 172.21.15.17:0/3923488182 shutdown_connections 2023-07-14T13:03:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff362974b80 1 -- 172.21.15.17:0/3923488182 wait complete. 2023-07-14T13:03:23.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.978+0000 7ff362974b80 20 client.26173 trim_cache size 0 max 16384 2023-07-14T13:03:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.993+0000 7ff362974b80 1 Processor -- start 2023-07-14T13:03:23.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.993+0000 7ff362974b80 1 -- start start 2023-07-14T13:03:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.994+0000 7ff362974b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.994+0000 7ff362974b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.994+0000 7ff362974b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34b8ad0 0x5624c34b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.994+0000 7ff362974b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c34a5ec0 con 0x5624c34ad2d0 2023-07-14T13:03:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.994+0000 7ff362974b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c34aedd0 con 0x5624c34b8ad0 2023-07-14T13:03:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.994+0000 7ff362974b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c34a0ef0 con 0x5624c34adbe0 2023-07-14T13:03:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.994+0000 7ff34cd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.994+0000 7ff34cd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39242/0 (socket says 172.21.15.17:39242) 2023-07-14T13:03:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.994+0000 7ff34cd9b700 1 -- 172.21.15.17:0/1190640813 learned_addr learned my addr 172.21.15.17:0/1190640813 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.994+0000 7ff347fff700 1 --2- 172.21.15.17:0/1190640813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.994+0000 7ff34d59c700 1 --2- 172.21.15.17:0/1190640813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34b8ad0 0x5624c34b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.995+0000 7ff34cd9b700 1 -- 172.21.15.17:0/1190640813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 msgr2=0x5624c34b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.995+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/1190640813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.995+0000 7ff34cd9b700 1 -- 172.21.15.17:0/1190640813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34b8ad0 msgr2=0x5624c34b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.995+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/1190640813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34b8ad0 0x5624c34b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.995+0000 7ff34cd9b700 1 -- 172.21.15.17:0/1190640813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624c3254250 con 0x5624c34ad2d0 2023-07-14T13:03:23.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.995+0000 7ff347fff700 1 --2- 172.21.15.17:0/1190640813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:23.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.995+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/1190640813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34c4780 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff33c010b10 tx=0x7ff33c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f34115029ea9b06 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:23.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.995+0000 7ff3337fe700 1 -- 172.21.15.17:0/1190640813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0983c0 con 0x5624c34ad2d0 2023-07-14T13:03:23.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.995+0000 7ff3337fe700 1 -- 172.21.15.17:0/1190640813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff33c097fa0 con 0x5624c34ad2d0 2023-07-14T13:03:23.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.995+0000 7ff3337fe700 1 -- 172.21.15.17:0/1190640813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0ca6a0 con 0x5624c34ad2d0 2023-07-14T13:03:23.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.996+0000 7ff362974b80 1 -- 172.21.15.17:0/1190640813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 msgr2=0x5624c34c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.996+0000 7ff362974b80 1 --2- 172.21.15.17:0/1190640813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34c4780 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff33c010b10 tx=0x7ff33c010000 comp rx=0 tx=0).stop 2023-07-14T13:03:23.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.996+0000 7ff362974b80 1 -- 172.21.15.17:0/1190640813 shutdown_connections 2023-07-14T13:03:23.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.996+0000 7ff362974b80 1 --2- 172.21.15.17:0/1190640813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34b8ad0 0x5624c34b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.996+0000 7ff362974b80 1 --2- 172.21.15.17:0/1190640813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34c4780 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.996+0000 7ff362974b80 1 --2- 172.21.15.17:0/1190640813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.996+0000 7ff362974b80 1 -- 172.21.15.17:0/1190640813 >> 172.21.15.17:0/1190640813 conn(0x5624c34a3da0 msgr2=0x5624c34a7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:23.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.996+0000 7ff362974b80 1 -- 172.21.15.17:0/1190640813 shutdown_connections 2023-07-14T13:03:23.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.996+0000 7ff362974b80 1 -- 172.21.15.17:0/1190640813 wait complete. 2023-07-14T13:03:23.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.996+0000 7ff362974b80 1 -- start start 2023-07-14T13:03:23.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.997+0000 7ff362974b80 1 Processor -- start 2023-07-14T13:03:23.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.997+0000 7ff362974b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34bd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.997+0000 7ff362974b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34bd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.997+0000 7ff362974b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34b8ad0 0x5624c351b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.997+0000 7ff362974b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c34be2c0 con 0x5624c34ad2d0 2023-07-14T13:03:23.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.997+0000 7ff362974b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c351b940 con 0x5624c34b8ad0 2023-07-14T13:03:23.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.997+0000 7ff362974b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624c351ba80 con 0x5624c34adbe0 2023-07-14T13:03:23.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.997+0000 7ff362974b80 10 client.0 _ll_register_callbacks cb 0x7ff334009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:23.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.997+0000 7ff34cd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34bd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.997+0000 7ff34cd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34bd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39254/0 (socket says 172.21.15.17:39254) 2023-07-14T13:03:23.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.997+0000 7ff34cd9b700 1 -- 172.21.15.17:0/1319007362 learned_addr learned my addr 172.21.15.17:0/1319007362 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:23.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff347fff700 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34bd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff34d59c700 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34b8ad0 0x5624c351b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff34cd9b700 1 -- 172.21.15.17:0/1319007362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 msgr2=0x5624c34bd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34bd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff34cd9b700 1 -- 172.21.15.17:0/1319007362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34b8ad0 msgr2=0x5624c351b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34b8ad0 0x5624c351b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff34cd9b700 1 -- 172.21.15.17:0/1319007362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3481a4bd0 con 0x5624c34ad2d0 2023-07-14T13:03:23.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff347fff700 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34bd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:23.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff34d59c700 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34b8ad0 0x5624c351b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:23.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff34cd9b700 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34bd490 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0965d0 tx=0x7ff33c099a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be44e5cf41866cd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:23.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff327fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:23.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.998+0000 7ff327fff700 1 -- 172.21.15.17:0/1319007362 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0b2320 con 0x5624c34ad2d0 2023-07-14T13:03:23.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff362974b80 1 -- 172.21.15.17:0/1319007362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff340008cc0 con 0x5624c34ad2d0 2023-07-14T13:03:23.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff327fff700 1 -- 172.21.15.17:0/1319007362 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff33c0b6030 con 0x5624c34ad2d0 2023-07-14T13:03:23.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff327fff700 1 -- 172.21.15.17:0/1319007362 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff33c0ca670 con 0x5624c34ad2d0 2023-07-14T13:03:23.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff362974b80 10 client.16485 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:23.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff362974b80 1 -- 172.21.15.17:0/1319007362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5624c322c2b0 con 0x5624c34ad2d0 2023-07-14T13:03:23.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff327fff700 1 -- 172.21.15.17:0/1319007362 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff33c063020 con 0x5624c34ad2d0 2023-07-14T13:03:23.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff327fff700 1 -- 172.21.15.17:0/1319007362 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff33c099050 con 0x5624c34ad2d0 2023-07-14T13:03:23.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff362974b80 10 client.16485 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:23.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff362974b80 10 client.16485 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:03:23.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff362974b80 20 client.16485 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:23.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff362974b80 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x5624c351cef0 0x5624c351f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff362974b80 4 client.16485 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:03:23.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:22.999+0000 7ff362974b80 1 -- 172.21.15.17:0/1319007362 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5624c33bb050 con 0x5624c351cef0 2023-07-14T13:03:23.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.000+0000 7ff347fff700 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x5624c351cef0 0x5624c351f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.000+0000 7ff347fff700 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x5624c351cef0 0x5624c351f300 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cfd5f77d91822874 server_cookie=ecb28f694b03f447 in_seq=0 out_seq=0 2023-07-14T13:03:23.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.000+0000 7ff327fff700 10 client.16485 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:03:23.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff327fff700 1 -- 172.21.15.17:0/1319007362 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5624c33bb050 con 0x5624c351cef0 2023-07-14T13:03:23.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff327fff700 10 client.16485 handle_command_reply: tid=0 2023-07-14T13:03:23.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 1 client.16485 shutdown 2023-07-14T13:03:23.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 1 -- 172.21.15.17:0/1319007362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 msgr2=0x5624c34bd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34bd490 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0965d0 tx=0x7ff33c099a60 comp rx=0 tx=0).stop 2023-07-14T13:03:23.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 1 -- 172.21.15.17:0/1319007362 shutdown_connections 2023-07-14T13:03:23.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x5624c351cef0 0x5624c351f300 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624c34b8ad0 0x5624c351b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5624c34ad2d0 0x5624c34bd490 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 1 --2- 172.21.15.17:0/1319007362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624c34adbe0 0x5624c34bd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 1 -- 172.21.15.17:0/1319007362 >> 172.21.15.17:0/1319007362 conn(0x5624c34a3da0 msgr2=0x5624c34b8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:23.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff327fff700 0 client.16485 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:03:23.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 1 -- 172.21.15.17:0/1319007362 shutdown_connections 2023-07-14T13:03:23.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 1 -- 172.21.15.17:0/1319007362 wait complete. 2023-07-14T13:03:23.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.001+0000 7ff362974b80 20 client.16485 trim_cache size 0 max 16384 2023-07-14T13:03:23.043 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:03:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 -- 172.21.15.17:0/3836041789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff3380a12c0 msgr2=0x7ff3380a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff3380a12c0 0x7ff3380a3770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff340015000 tx=0x7ff3400094a0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 -- 172.21.15.17:0/3836041789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3480ffae0 msgr2=0x7ff348197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3480ffae0 0x7ff348197da0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00d950 tx=0x7ff33c00dc60 comp rx=0 tx=0).stop 2023-07-14T13:03:23.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 -- 172.21.15.17:0/3836041789 shutdown_connections 2023-07-14T13:03:23.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff3380a12c0 0x7ff3380a3770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff348105af0 0x7ff34819c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3480ffae0 0x7ff348197da0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 --2- 172.21.15.17:0/3836041789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff348100490 0x7ff3481982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 -- 172.21.15.17:0/3836041789 >> 172.21.15.17:0/3836041789 conn(0x7ff3480fb5e0 msgr2=0x7ff34810ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:23.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 -- 172.21.15.17:0/3836041789 shutdown_connections 2023-07-14T13:03:23.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.002+0000 7ff34efff700 1 -- 172.21.15.17:0/3836041789 wait complete. 2023-07-14T13:03:23.056 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:03:23.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.250+0000 7fc4529ff700 1 -- 172.21.15.17:0/2730263334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc44c106fb0 msgr2=0x7fc44c10eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.250+0000 7fc4529ff700 1 --2- 172.21.15.17:0/2730263334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc44c106fb0 0x7fc44c10eb80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc44400b0d0 tx=0x7fc44400b3e0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.250+0000 7fc4529ff700 1 -- 172.21.15.17:0/2730263334 shutdown_connections 2023-07-14T13:03:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.250+0000 7fc4529ff700 1 --2- 172.21.15.17:0/2730263334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc44c106fb0 0x7fc44c10eb80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.250+0000 7fc4529ff700 1 --2- 172.21.15.17:0/2730263334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc44c101f70 0x7fc44c102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.250+0000 7fc4529ff700 1 --2- 172.21.15.17:0/2730263334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc44c102910 0x7fc44c1068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.250+0000 7fc4529ff700 1 -- 172.21.15.17:0/2730263334 >> 172.21.15.17:0/2730263334 conn(0x7fc44c0fd7e0 msgr2=0x7fc44c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.250+0000 7fc4529ff700 1 -- 172.21.15.17:0/2730263334 shutdown_connections 2023-07-14T13:03:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.250+0000 7fc4529ff700 1 -- 172.21.15.17:0/2730263334 wait complete. 2023-07-14T13:03:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.251+0000 7fc4529ff700 1 Processor -- start 2023-07-14T13:03:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.251+0000 7fc4529ff700 1 -- start start 2023-07-14T13:03:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.252+0000 7fc4529ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc44c101f70 0x7fc44c197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.252+0000 7fc4529ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc44c102910 0x7fc44c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.252+0000 7fc4529ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc44c106fb0 0x7fc44c19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.252+0000 7fc4529ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c19ce00 con 0x7fc44c102910 2023-07-14T13:03:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.252+0000 7fc4529ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c19cf70 con 0x7fc44c101f70 2023-07-14T13:03:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.252+0000 7fc4529ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c19d130 con 0x7fc44c106fb0 2023-07-14T13:03:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.252+0000 7fc44b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc44c102910 0x7fc44c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.252+0000 7fc44b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc44c102910 0x7fc44c198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39276/0 (socket says 172.21.15.17:39276) 2023-07-14T13:03:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.252+0000 7fc44b7fe700 1 -- 172.21.15.17:0/1831153030 learned_addr learned my addr 172.21.15.17:0/1831153030 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.252+0000 7fc44bfff700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc44c101f70 0x7fc44c197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.252+0000 7fc450f9c700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc44c106fb0 0x7fc44c19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.253+0000 7fc44b7fe700 1 -- 172.21.15.17:0/1831153030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc44c106fb0 msgr2=0x7fc44c19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.253+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc44c106fb0 0x7fc44c19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.253+0000 7fc44b7fe700 1 -- 172.21.15.17:0/1831153030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc44c101f70 msgr2=0x7fc44c197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.253+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc44c101f70 0x7fc44c197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.253+0000 7fc44b7fe700 1 -- 172.21.15.17:0/1831153030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc444009d00 con 0x7fc44c102910 2023-07-14T13:03:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.253+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc44c102910 0x7fc44c198360 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc44000e940 tx=0x7fc44000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:23.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.253+0000 7fc4497fa700 1 -- 172.21.15.17:0/1831153030 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440009730 con 0x7fc44c102910 2023-07-14T13:03:23.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.253+0000 7fc4497fa700 1 -- 172.21.15.17:0/1831153030 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc44000ee90 con 0x7fc44c102910 2023-07-14T13:03:23.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.253+0000 7fc4529ff700 1 -- 172.21.15.17:0/1831153030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44c19d410 con 0x7fc44c102910 2023-07-14T13:03:23.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.253+0000 7fc4497fa700 1 -- 172.21.15.17:0/1831153030 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440018420 con 0x7fc44c102910 2023-07-14T13:03:23.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.253+0000 7fc4529ff700 1 -- 172.21.15.17:0/1831153030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c1a4c50 con 0x7fc44c102910 2023-07-14T13:03:23.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.257+0000 7fc4497fa700 1 -- 172.21.15.17:0/1831153030 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc44000cbd0 con 0x7fc44c102910 2023-07-14T13:03:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.258+0000 7fc466290b80 1 Processor -- start 2023-07-14T13:03:23.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.259+0000 7fc466290b80 1 -- start start 2023-07-14T13:03:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.259+0000 7fc466290b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 0x555b0b1886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.259+0000 7fc466290b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b193590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.259+0000 7fc466290b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b193ad0 0x555b0b195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.259+0000 7fc466290b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0b08ecb0 con 0x555b0b188be0 2023-07-14T13:03:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.259+0000 7fc466290b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0b0e1a40 con 0x555b0b193ad0 2023-07-14T13:03:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.259+0000 7fc466290b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0b0daed0 con 0x555b0b1882d0 2023-07-14T13:03:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.259+0000 7fc44bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b193590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc44bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b193590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39278/0 (socket says 172.21.15.17:39278) 2023-07-14T13:03:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc44bfff700 1 -- 172.21.15.17:0/320085625 learned_addr learned my addr 172.21.15.17:0/320085625 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:23.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc450f9c700 1 --2- 172.21.15.17:0/320085625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 0x555b0b1886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc4497fa700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc4340a1340 0x7fc4340a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/320085625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b193ad0 0x555b0b195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc44bfff700 1 -- 172.21.15.17:0/320085625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 msgr2=0x555b0b1886a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc44bfff700 1 --2- 172.21.15.17:0/320085625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 0x555b0b1886a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc44bfff700 1 -- 172.21.15.17:0/320085625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b193ad0 msgr2=0x555b0b195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc44bfff700 1 --2- 172.21.15.17:0/320085625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b193ad0 0x555b0b195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc44bfff700 1 -- 172.21.15.17:0/320085625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b0af08de0 con 0x555b0b188be0 2023-07-14T13:03:23.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/320085625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b193ad0 0x555b0b195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:03:23.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc4497fa700 1 -- 172.21.15.17:0/1831153030 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc440014070 con 0x7fc44c102910 2023-07-14T13:03:23.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc450f9c700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc4340a1340 0x7fc4340a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.260+0000 7fc44bfff700 1 --2- 172.21.15.17:0/320085625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b193590 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc43c007cf0 tx=0x7fc43c0103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6014b6ca60405 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:23.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.261+0000 7fc4327fc700 1 -- 172.21.15.17:0/320085625 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c010d60 con 0x555b0b188be0 2023-07-14T13:03:23.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.261+0000 7fc4327fc700 1 -- 172.21.15.17:0/320085625 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc43c015070 con 0x555b0b188be0 2023-07-14T13:03:23.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.261+0000 7fc4327fc700 1 -- 172.21.15.17:0/320085625 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c019630 con 0x555b0b188be0 2023-07-14T13:03:23.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.261+0000 7fc466290b80 1 -- 172.21.15.17:0/320085625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 msgr2=0x555b0b193590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.261+0000 7fc466290b80 1 --2- 172.21.15.17:0/320085625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b193590 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc43c007cf0 tx=0x7fc43c0103d0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.261+0000 7fc450f9c700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc4340a1340 0x7fc4340a37f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc444009fd0 tx=0x7fc4440099e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:23.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.262+0000 7fc466290b80 1 -- 172.21.15.17:0/320085625 shutdown_connections 2023-07-14T13:03:23.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.262+0000 7fc466290b80 1 --2- 172.21.15.17:0/320085625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b193ad0 0x555b0b195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.262+0000 7fc466290b80 1 --2- 172.21.15.17:0/320085625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 0x555b0b1886a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.262+0000 7fc466290b80 1 --2- 172.21.15.17:0/320085625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b193590 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.262+0000 7fc466290b80 1 -- 172.21.15.17:0/320085625 >> 172.21.15.17:0/320085625 conn(0x555b0b17eda0 msgr2=0x555b0b1846a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:23.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.262+0000 7fc466290b80 1 -- 172.21.15.17:0/320085625 shutdown_connections 2023-07-14T13:03:23.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.262+0000 7fc466290b80 1 -- 172.21.15.17:0/320085625 wait complete. 2023-07-14T13:03:23.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.262+0000 7fc466290b80 1 -- start start 2023-07-14T13:03:23.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.263+0000 7fc466290b80 1 Processor -- start 2023-07-14T13:03:23.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.263+0000 7fc466290b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b1882d0 0x555b0b1934a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.263+0000 7fc466290b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b188be0 0x555b0b190720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.263+0000 7fc466290b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b193ad0 0x555b0b190da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.263+0000 7fc466290b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0b07aac0 con 0x555b0b1882d0 2023-07-14T13:03:23.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc466290b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0b07a7c0 con 0x555b0b188be0 2023-07-14T13:03:23.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc466290b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0af5e920 con 0x555b0b193ad0 2023-07-14T13:03:23.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc466290b80 10 client.0 _ll_register_callbacks cb 0x555b0b078760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:23.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc44bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b1882d0 0x555b0b1934a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc44bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b1882d0 0x555b0b1934a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39288/0 (socket says 172.21.15.17:39288) 2023-07-14T13:03:23.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc44bfff700 1 -- 172.21.15.17:0/1079671849 learned_addr learned my addr 172.21.15.17:0/1079671849 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:23.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b188be0 0x555b0b190720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc450f9c700 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b193ad0 0x555b0b190da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc44bfff700 1 -- 172.21.15.17:0/1079671849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b193ad0 msgr2=0x555b0b190da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc44bfff700 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b193ad0 0x555b0b190da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc44bfff700 1 -- 172.21.15.17:0/1079671849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b188be0 msgr2=0x555b0b190720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc44bfff700 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b188be0 0x555b0b190720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc44bfff700 1 -- 172.21.15.17:0/1079671849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c007920 con 0x555b0b1882d0 2023-07-14T13:03:23.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc450f9c700 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b193ad0 0x555b0b190da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:23.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.264+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b188be0 0x555b0b190720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:23.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.265+0000 7fc44bfff700 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b1882d0 0x555b0b1934a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc43c011db0 tx=0x7fc43c011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f68ec65054d0a2f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:23.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.265+0000 7fc42b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:23.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.265+0000 7fc42b7fe700 1 -- 172.21.15.17:0/1079671849 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c010e10 con 0x555b0b1882d0 2023-07-14T13:03:23.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.265+0000 7fc466290b80 1 -- 172.21.15.17:0/1079671849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b0b0344f0 con 0x555b0b1882d0 2023-07-14T13:03:23.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.265+0000 7fc42b7fe700 1 -- 172.21.15.17:0/1079671849 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc43c011440 con 0x555b0b1882d0 2023-07-14T13:03:23.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.265+0000 7fc42b7fe700 1 -- 172.21.15.17:0/1079671849 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc43c011600 con 0x555b0b1882d0 2023-07-14T13:03:23.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.265+0000 7fc466290b80 10 client.16497 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:23.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.265+0000 7fc466290b80 1 -- 172.21.15.17:0/1079671849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x555b0aef1c60 con 0x555b0b1882d0 2023-07-14T13:03:23.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.266+0000 7fc42b7fe700 1 -- 172.21.15.17:0/1079671849 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555b0b0344f0 con 0x555b0b1882d0 2023-07-14T13:03:23.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.266+0000 7fc42b7fe700 1 -- 172.21.15.17:0/1079671849 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc43c0052b0 con 0x555b0b1882d0 2023-07-14T13:03:23.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.266+0000 7fc466290b80 10 client.16497 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:23.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.266+0000 7fc466290b80 10 client.16497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:23.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.266+0000 7fc466290b80 20 client.16497 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:23.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.266+0000 7fc466290b80 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555b0b1a32d0 0x555b0b1a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.266+0000 7fc466290b80 4 client.16497 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:23.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.266+0000 7fc466290b80 1 -- 172.21.15.17:0/1079671849 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b0b0d3eb0 con 0x555b0b1a32d0 2023-07-14T13:03:23.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.267+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555b0b1a32d0 0x555b0b1a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.267+0000 7fc42b7fe700 10 client.16497 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:23.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.267+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555b0b1a32d0 0x555b0b1a56e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1939940841657f7c server_cookie=38459e84643e5cd2 in_seq=0 out_seq=0 2023-07-14T13:03:23.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc42b7fe700 1 -- 172.21.15.17:0/1079671849 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555b0b0d3eb0 con 0x555b0b1a32d0 2023-07-14T13:03:23.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc42b7fe700 10 client.16497 handle_command_reply: tid=0 2023-07-14T13:03:23.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc466290b80 1 client.16497 shutdown 2023-07-14T13:03:23.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc466290b80 1 -- 172.21.15.17:0/1079671849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b1882d0 msgr2=0x555b0b1934a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc466290b80 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b1882d0 0x555b0b1934a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc43c011db0 tx=0x7fc43c011c60 comp rx=0 tx=0).stop 2023-07-14T13:03:23.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc466290b80 1 -- 172.21.15.17:0/1079671849 shutdown_connections 2023-07-14T13:03:23.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc466290b80 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555b0b1a32d0 0x555b0b1a56e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc466290b80 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b193ad0 0x555b0b190da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc466290b80 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b1882d0 0x555b0b1934a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc42b7fe700 0 client.16497 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:23.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc466290b80 1 --2- 172.21.15.17:0/1079671849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b188be0 0x555b0b190720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.268+0000 7fc466290b80 1 -- 172.21.15.17:0/1079671849 >> 172.21.15.17:0/1079671849 conn(0x555b0b17eda0 msgr2=0x555b0b184230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:23.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.269+0000 7fc466290b80 1 -- 172.21.15.17:0/1079671849 shutdown_connections 2023-07-14T13:03:23.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.269+0000 7fc466290b80 1 -- 172.21.15.17:0/1079671849 wait complete. 2023-07-14T13:03:23.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.269+0000 7fc466290b80 20 client.16497 trim_cache size 0 max 16384 2023-07-14T13:03:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.285+0000 7fc466290b80 1 Processor -- start 2023-07-14T13:03:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.286+0000 7fc466290b80 1 -- start start 2023-07-14T13:03:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.286+0000 7fc466290b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b1882d0 0x555b0b193040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.286+0000 7fc466290b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b188be0 0x555b0b18ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.286+0000 7fc466290b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b193ad0 0x555b0b190460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.286+0000 7fc466290b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0b188fb0 con 0x555b0b193ad0 2023-07-14T13:03:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.286+0000 7fc466290b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0b191d00 con 0x555b0b1882d0 2023-07-14T13:03:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.286+0000 7fc466290b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0b191680 con 0x555b0b188be0 2023-07-14T13:03:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.286+0000 7fc450f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b193ad0 0x555b0b190460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.286+0000 7fc450f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b193ad0 0x555b0b190460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39302/0 (socket says 172.21.15.17:39302) 2023-07-14T13:03:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.286+0000 7fc450f9c700 1 -- 172.21.15.17:0/1707078423 learned_addr learned my addr 172.21.15.17:0/1707078423 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.287+0000 7fc44bfff700 1 --2- 172.21.15.17:0/1707078423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b1882d0 0x555b0b193040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.287+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/1707078423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b188be0 0x555b0b18ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.287+0000 7fc44bfff700 1 -- 172.21.15.17:0/1707078423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b188be0 msgr2=0x555b0b18ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.287+0000 7fc44bfff700 1 --2- 172.21.15.17:0/1707078423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b188be0 0x555b0b18ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.287+0000 7fc44bfff700 1 -- 172.21.15.17:0/1707078423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b193ad0 msgr2=0x555b0b190460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.287+0000 7fc44bfff700 1 --2- 172.21.15.17:0/1707078423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b193ad0 0x555b0b190460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.287+0000 7fc44bfff700 1 -- 172.21.15.17:0/1707078423 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b0af2f250 con 0x555b0b1882d0 2023-07-14T13:03:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.287+0000 7fc450f9c700 1 --2- 172.21.15.17:0/1707078423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b193ad0 0x555b0b190460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.287+0000 7fc44bfff700 1 --2- 172.21.15.17:0/1707078423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b1882d0 0x555b0b193040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc43c007c10 tx=0x7fc43c0107d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=719152143103b284 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.288+0000 7fc432ffd700 1 -- 172.21.15.17:0/1707078423 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c005b00 con 0x555b0b1882d0 2023-07-14T13:03:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.288+0000 7fc432ffd700 1 -- 172.21.15.17:0/1707078423 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc43c0118d0 con 0x555b0b1882d0 2023-07-14T13:03:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.288+0000 7fc432ffd700 1 -- 172.21.15.17:0/1707078423 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c004f60 con 0x555b0b1882d0 2023-07-14T13:03:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.289+0000 7fc466290b80 1 -- 172.21.15.17:0/1707078423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b1882d0 msgr2=0x555b0b193040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.289+0000 7fc466290b80 1 --2- 172.21.15.17:0/1707078423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b1882d0 0x555b0b193040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc43c007c10 tx=0x7fc43c0107d0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.289+0000 7fc466290b80 1 -- 172.21.15.17:0/1707078423 shutdown_connections 2023-07-14T13:03:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.289+0000 7fc466290b80 1 --2- 172.21.15.17:0/1707078423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b193ad0 0x555b0b190460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.289+0000 7fc466290b80 1 --2- 172.21.15.17:0/1707078423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b1882d0 0x555b0b193040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.289+0000 7fc466290b80 1 --2- 172.21.15.17:0/1707078423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b188be0 0x555b0b18ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.289+0000 7fc466290b80 1 -- 172.21.15.17:0/1707078423 >> 172.21.15.17:0/1707078423 conn(0x555b0b17eda0 msgr2=0x555b0b18ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.289+0000 7fc466290b80 1 -- 172.21.15.17:0/1707078423 shutdown_connections 2023-07-14T13:03:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.289+0000 7fc466290b80 1 -- 172.21.15.17:0/1707078423 wait complete. 2023-07-14T13:03:23.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.289+0000 7fc466290b80 1 -- start start 2023-07-14T13:03:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.290+0000 7fc466290b80 1 Processor -- start 2023-07-14T13:03:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.290+0000 7fc466290b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 0x555b0b1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.290+0000 7fc466290b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b199be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.290+0000 7fc466290b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b193ad0 0x555b0b1f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.290+0000 7fc466290b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0b19a350 con 0x555b0b188be0 2023-07-14T13:03:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.290+0000 7fc466290b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0b19a4c0 con 0x555b0b193ad0 2023-07-14T13:03:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.290+0000 7fc466290b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0b1f66f0 con 0x555b0b1882d0 2023-07-14T13:03:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.290+0000 7fc466290b80 10 client.0 _ll_register_callbacks cb 0x7fc43c007b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc44b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc44bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 0x555b0b1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc44b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39306/0 (socket says 172.21.15.17:39306) 2023-07-14T13:03:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc44bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 0x555b0b1996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41382/0 (socket says 172.21.15.17:41382) 2023-07-14T13:03:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc44b7fe700 1 -- 172.21.15.17:0/2672821950 learned_addr learned my addr 172.21.15.17:0/2672821950 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc450f9c700 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b193ad0 0x555b0b1f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc44b7fe700 1 -- 172.21.15.17:0/2672821950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 msgr2=0x555b0b1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 0x555b0b1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc44b7fe700 1 -- 172.21.15.17:0/2672821950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b193ad0 msgr2=0x555b0b1f61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b193ad0 0x555b0b1f61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc44b7fe700 1 -- 172.21.15.17:0/2672821950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c10f3c0 con 0x555b0b188be0 2023-07-14T13:03:23.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.291+0000 7fc44bfff700 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 0x555b0b1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc44b7fe700 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b199be0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc440096980 tx=0x7fc44006bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6587bbf84e6dee13 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc42b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc42b7fe700 1 -- 172.21.15.17:0/2672821950 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44009a370 con 0x555b0b188be0 2023-07-14T13:03:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc42b7fe700 1 -- 172.21.15.17:0/2672821950 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc440099f10 con 0x555b0b188be0 2023-07-14T13:03:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc466290b80 1 -- 172.21.15.17:0/2672821950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc43c015070 con 0x555b0b188be0 2023-07-14T13:03:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc42b7fe700 1 -- 172.21.15.17:0/2672821950 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4400691e0 con 0x555b0b188be0 2023-07-14T13:03:23.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc466290b80 10 client.16503 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc466290b80 1 -- 172.21.15.17:0/2672821950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x555b0aef1c60 con 0x555b0b188be0 2023-07-14T13:03:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc42b7fe700 1 -- 172.21.15.17:0/2672821950 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4400c8080 con 0x555b0b188be0 2023-07-14T13:03:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc42b7fe700 1 -- 172.21.15.17:0/2672821950 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc4400a1ed0 con 0x555b0b188be0 2023-07-14T13:03:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc466290b80 10 client.16503 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.292+0000 7fc466290b80 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.293+0000 7fc466290b80 20 client.16503 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.293+0000 7fc466290b80 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555b0b1f7e80 0x555b0b1fa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.293+0000 7fc466290b80 4 client.16503 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:03:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.293+0000 7fc466290b80 1 -- 172.21.15.17:0/2672821950 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555b0b096050 con 0x555b0b1f7e80 2023-07-14T13:03:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.293+0000 7fc44bfff700 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555b0b1f7e80 0x555b0b1fa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc44bfff700 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555b0b1f7e80 0x555b0b1fa290 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=544b96d28c08ad69 server_cookie=8578878f4237b0c9 in_seq=0 out_seq=0 2023-07-14T13:03:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc42b7fe700 10 client.16503 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc42b7fe700 1 -- 172.21.15.17:0/2672821950 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555b0b096050 con 0x555b0b1f7e80 2023-07-14T13:03:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc42b7fe700 10 client.16503 handle_command_reply: tid=0 2023-07-14T13:03:23.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc466290b80 1 client.16503 shutdown 2023-07-14T13:03:23.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc466290b80 1 -- 172.21.15.17:0/2672821950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 msgr2=0x555b0b199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc466290b80 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b199be0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc440096980 tx=0x7fc44006bf80 comp rx=0 tx=0).stop 2023-07-14T13:03:23.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc466290b80 1 -- 172.21.15.17:0/2672821950 shutdown_connections 2023-07-14T13:03:23.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc466290b80 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555b0b1f7e80 0x555b0b1fa290 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc466290b80 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555b0b193ad0 0x555b0b1f61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc466290b80 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b0b1882d0 0x555b0b1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc42b7fe700 0 client.16503 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:23.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc466290b80 1 --2- 172.21.15.17:0/2672821950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555b0b188be0 0x555b0b199be0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc466290b80 1 -- 172.21.15.17:0/2672821950 >> 172.21.15.17:0/2672821950 conn(0x555b0b17eda0 msgr2=0x555b0b18a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:23.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc466290b80 1 -- 172.21.15.17:0/2672821950 shutdown_connections 2023-07-14T13:03:23.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.294+0000 7fc466290b80 1 -- 172.21.15.17:0/2672821950 wait complete. 2023-07-14T13:03:23.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc466290b80 20 client.16503 trim_cache size 0 max 16384 2023-07-14T13:03:23.335 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:03:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 -- 172.21.15.17:0/1831153030 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc4340a1340 msgr2=0x7fc4340a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc4340a1340 0x7fc4340a37f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc444009fd0 tx=0x7fc4440099e0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 -- 172.21.15.17:0/1831153030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc44c102910 msgr2=0x7fc44c198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:23.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc44c102910 0x7fc44c198360 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc44000e940 tx=0x7fc44000ec50 comp rx=0 tx=0).stop 2023-07-14T13:03:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 -- 172.21.15.17:0/1831153030 shutdown_connections 2023-07-14T13:03:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc4340a1340 0x7fc4340a37f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc44c106fb0 0x7fc44c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc44c101f70 0x7fc44c197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 --2- 172.21.15.17:0/1831153030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc44c102910 0x7fc44c198360 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 -- 172.21.15.17:0/1831153030 >> 172.21.15.17:0/1831153030 conn(0x7fc44c0fd7e0 msgr2=0x7fc44c0fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:23.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 -- 172.21.15.17:0/1831153030 shutdown_connections 2023-07-14T13:03:23.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:23.295+0000 7fc4529ff700 1 -- 172.21.15.17:0/1831153030 wait complete. 2023-07-14T13:03:23.345 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:23 smithi017 ceph-mon[95536]: pgmap v112: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:03:23.345 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:23 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/835487427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:03:23.353 INFO:teuthology.orchestra.run.smithi017.stderr:12000000 of 50000000 tuples (24%) done (elapsed 192.96 s, remaining 611.03 s) 2023-07-14T13:03:23.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:23 smithi135 ceph-mon[97338]: pgmap v112: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:03:23.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:23 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/835487427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:03:23.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:23 smithi131 ceph-mon[96953]: pgmap v112: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:03:23.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:23 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/835487427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:03:24.349 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:03:24.349 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:03:24.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.549+0000 7fab921ff700 1 -- 172.21.15.17:0/566921291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c073180 msgr2=0x7fab8c10be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.549+0000 7fab921ff700 1 --2- 172.21.15.17:0/566921291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c073180 0x7fab8c10be20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fab80009990 tx=0x7fab80009ca0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.550+0000 7fab921ff700 1 -- 172.21.15.17:0/566921291 shutdown_connections 2023-07-14T13:03:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.550+0000 7fab921ff700 1 --2- 172.21.15.17:0/566921291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c10c360 0x7fab8c10e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.550+0000 7fab921ff700 1 --2- 172.21.15.17:0/566921291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c072870 0x7fab8c072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.550+0000 7fab921ff700 1 --2- 172.21.15.17:0/566921291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c073180 0x7fab8c10be20 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.550+0000 7fab921ff700 1 -- 172.21.15.17:0/566921291 >> 172.21.15.17:0/566921291 conn(0x7fab8c0fb5e0 msgr2=0x7fab8c0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.550+0000 7fab921ff700 1 -- 172.21.15.17:0/566921291 shutdown_connections 2023-07-14T13:03:24.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.550+0000 7fab921ff700 1 -- 172.21.15.17:0/566921291 wait complete. 2023-07-14T13:03:24.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.551+0000 7fab921ff700 1 Processor -- start 2023-07-14T13:03:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.551+0000 7fab921ff700 1 -- start start 2023-07-14T13:03:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab921ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c072870 0x7fab8c197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab921ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c073180 0x7fab8c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab921ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c10c360 0x7fab8c19c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab921ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c19cd80 con 0x7fab8c072870 2023-07-14T13:03:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab921ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c19cef0 con 0x7fab8c10c360 2023-07-14T13:03:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab921ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c19d0b0 con 0x7fab8c073180 2023-07-14T13:03:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab8b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c072870 0x7fab8c197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab8b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c072870 0x7fab8c197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39318/0 (socket says 172.21.15.17:39318) 2023-07-14T13:03:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab8b7fe700 1 -- 172.21.15.17:0/2553843336 learned_addr learned my addr 172.21.15.17:0/2553843336 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab8affd700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c073180 0x7fab8c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab8bfff700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c10c360 0x7fab8c19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab8b7fe700 1 -- 172.21.15.17:0/2553843336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c073180 msgr2=0x7fab8c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c073180 0x7fab8c1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab8b7fe700 1 -- 172.21.15.17:0/2553843336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c10c360 msgr2=0x7fab8c19c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c10c360 0x7fab8c19c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab8b7fe700 1 -- 172.21.15.17:0/2553843336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab800095f0 con 0x7fab8c072870 2023-07-14T13:03:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.552+0000 7fab8bfff700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c10c360 0x7fab8c19c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:03:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.553+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c072870 0x7fab8c197da0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00e9a0 tx=0x7fab7c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.553+0000 7fab88ff9700 1 -- 172.21.15.17:0/2553843336 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c009790 con 0x7fab8c072870 2023-07-14T13:03:24.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.553+0000 7fab921ff700 1 -- 172.21.15.17:0/2553843336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c19d390 con 0x7fab8c072870 2023-07-14T13:03:24.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.553+0000 7fab88ff9700 1 -- 172.21.15.17:0/2553843336 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab7c00cbd0 con 0x7fab8c072870 2023-07-14T13:03:24.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.553+0000 7fab88ff9700 1 -- 172.21.15.17:0/2553843336 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c018680 con 0x7fab8c072870 2023-07-14T13:03:24.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.553+0000 7fab921ff700 1 -- 172.21.15.17:0/2553843336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c1a4bd0 con 0x7fab8c072870 2023-07-14T13:03:24.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.556+0000 7fab88ff9700 1 -- 172.21.15.17:0/2553843336 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fab7c00cd40 con 0x7fab8c072870 2023-07-14T13:03:24.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.558+0000 7faba5a40b80 1 Processor -- start 2023-07-14T13:03:24.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.558+0000 7fab88ff9700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fab740a12c0 0x7fab740a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.558+0000 7fab88ff9700 1 -- 172.21.15.17:0/2553843336 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fab7c014070 con 0x7fab8c072870 2023-07-14T13:03:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.558+0000 7faba5a40b80 1 -- start start 2023-07-14T13:03:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.558+0000 7fab8bfff700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fab740a12c0 0x7fab740a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd2e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd39610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd3bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7faba5a40b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdc34d30 con 0x555ffdd2ec60 2023-07-14T13:03:24.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7faba5a40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdc87ac0 con 0x555ffdd2e350 2023-07-14T13:03:24.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7faba5a40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdc80f50 con 0x555ffdd39b50 2023-07-14T13:03:24.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7fab8affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd39610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7fab8affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd39610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39332/0 (socket says 172.21.15.17:39332) 2023-07-14T13:03:24.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7fab8affd700 1 -- 172.21.15.17:0/1796350268 learned_addr learned my addr 172.21.15.17:0/1796350268 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:24.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/1796350268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd2e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7fab8bfff700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fab740a12c0 0x7fab740a3770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab84009550 tx=0x7fab84009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.559+0000 7fab8bfff700 1 --2- 172.21.15.17:0/1796350268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd3bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.560+0000 7fab8affd700 1 -- 172.21.15.17:0/1796350268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 msgr2=0x555ffdd3bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.560+0000 7fab8affd700 1 --2- 172.21.15.17:0/1796350268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd3bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.560+0000 7fab8affd700 1 -- 172.21.15.17:0/1796350268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 msgr2=0x555ffdd2e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.560+0000 7fab8affd700 1 --2- 172.21.15.17:0/1796350268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd2e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.560+0000 7fab8affd700 1 -- 172.21.15.17:0/1796350268 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ffdaaee60 con 0x555ffdd2ec60 2023-07-14T13:03:24.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.560+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/1796350268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd2e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:24.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.560+0000 7fab8affd700 1 --2- 172.21.15.17:0/1796350268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd39610 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fab80009990 tx=0x7fab80005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33eca8df9cd3e7aa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.560+0000 7fab71ffb700 1 -- 172.21.15.17:0/1796350268 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8001d070 con 0x555ffdd2ec60 2023-07-14T13:03:24.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.560+0000 7fab71ffb700 1 -- 172.21.15.17:0/1796350268 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab8001e040 con 0x555ffdd2ec60 2023-07-14T13:03:24.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.560+0000 7fab71ffb700 1 -- 172.21.15.17:0/1796350268 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab80004830 con 0x555ffdd2ec60 2023-07-14T13:03:24.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.561+0000 7faba5a40b80 1 -- 172.21.15.17:0/1796350268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 msgr2=0x555ffdd39610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.561+0000 7faba5a40b80 1 --2- 172.21.15.17:0/1796350268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd39610 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fab80009990 tx=0x7fab80005f00 comp rx=0 tx=0).stop 2023-07-14T13:03:24.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.561+0000 7faba5a40b80 1 -- 172.21.15.17:0/1796350268 shutdown_connections 2023-07-14T13:03:24.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.561+0000 7faba5a40b80 1 --2- 172.21.15.17:0/1796350268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd3bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.561+0000 7faba5a40b80 1 --2- 172.21.15.17:0/1796350268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd2e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.561+0000 7faba5a40b80 1 --2- 172.21.15.17:0/1796350268 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd39610 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.561+0000 7faba5a40b80 1 -- 172.21.15.17:0/1796350268 >> 172.21.15.17:0/1796350268 conn(0x555ffdd24e20 msgr2=0x555ffdd2a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.561+0000 7faba5a40b80 1 -- 172.21.15.17:0/1796350268 shutdown_connections 2023-07-14T13:03:24.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.562+0000 7faba5a40b80 1 -- 172.21.15.17:0/1796350268 wait complete. 2023-07-14T13:03:24.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.562+0000 7faba5a40b80 1 -- start start 2023-07-14T13:03:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.562+0000 7faba5a40b80 1 Processor -- start 2023-07-14T13:03:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.563+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd39510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.563+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd36800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.563+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd36e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.563+0000 7faba5a40b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdc20b40 con 0x555ffdd2ec60 2023-07-14T13:03:24.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.563+0000 7faba5a40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdc20840 con 0x555ffdd2e350 2023-07-14T13:03:24.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.563+0000 7faba5a40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdb049a0 con 0x555ffdd39b50 2023-07-14T13:03:24.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.563+0000 7faba5a40b80 10 client.0 _ll_register_callbacks cb 0x555ffdc1e7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:24.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.563+0000 7fab8affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd36800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.564+0000 7fab8affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd36800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39348/0 (socket says 172.21.15.17:39348) 2023-07-14T13:03:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.564+0000 7fab8affd700 1 -- 172.21.15.17:0/3780555458 learned_addr learned my addr 172.21.15.17:0/3780555458 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.564+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd39510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.564+0000 7fab8bfff700 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd36e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.564+0000 7fab8b7fe700 1 -- 172.21.15.17:0/3780555458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 msgr2=0x555ffdd36e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.564+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd36e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.564+0000 7fab8b7fe700 1 -- 172.21.15.17:0/3780555458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 msgr2=0x555ffdd36800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.564+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd36800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.564+0000 7fab8b7fe700 1 -- 172.21.15.17:0/3780555458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c1a4bd0 con 0x555ffdd2e350 2023-07-14T13:03:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.564+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd39510 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0ca710 tx=0x7fab7c099f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bebbbd40b41fc8a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.564+0000 7fab6affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:03:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.565+0000 7fab6affd700 1 -- 172.21.15.17:0/3780555458 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0a24e0 con 0x555ffdd2e350 2023-07-14T13:03:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.565+0000 7fab6affd700 1 -- 172.21.15.17:0/3780555458 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fab7c0a2050 con 0x555ffdd2e350 2023-07-14T13:03:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.565+0000 7faba5a40b80 1 -- 172.21.15.17:0/3780555458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ffdbda570 con 0x555ffdd2e350 2023-07-14T13:03:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.565+0000 7fab6affd700 1 -- 172.21.15.17:0/3780555458 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab7c0a2210 con 0x555ffdd2e350 2023-07-14T13:03:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.565+0000 7faba5a40b80 10 client.26240 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.565+0000 7faba5a40b80 1 -- 172.21.15.17:0/3780555458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fab8c10f3b0 con 0x555ffdd2e350 2023-07-14T13:03:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.565+0000 7fab6affd700 1 -- 172.21.15.17:0/3780555458 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555ffdbda570 con 0x555ffdd2e350 2023-07-14T13:03:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.565+0000 7fab6affd700 1 -- 172.21.15.17:0/3780555458 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fab7c098ff0 con 0x555ffdd2e350 2023-07-14T13:03:24.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.565+0000 7faba5a40b80 10 client.26240 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.565+0000 7faba5a40b80 10 client.26240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.566+0000 7faba5a40b80 20 client.26240 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.566+0000 7faba5a40b80 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ffdd493d0 0x555ffdd4b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.566+0000 7faba5a40b80 4 client.26240 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.566+0000 7faba5a40b80 1 -- 172.21.15.17:0/3780555458 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ffdc79f30 con 0x555ffdd493d0 2023-07-14T13:03:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.566+0000 7fab8affd700 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ffdd493d0 0x555ffdd4b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.567+0000 7fab8affd700 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ffdd493d0 0x555ffdd4b7e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cacdb7a1e493b1b server_cookie=1cd4c56a3686ef83 in_seq=0 out_seq=0 2023-07-14T13:03:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.567+0000 7fab6affd700 10 client.26240 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7fab6affd700 1 -- 172.21.15.17:0/3780555458 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555ffdc79f30 con 0x555ffdd493d0 2023-07-14T13:03:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7fab6affd700 10 client.26240 handle_command_reply: tid=0 2023-07-14T13:03:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 1 client.26240 shutdown 2023-07-14T13:03:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 1 -- 172.21.15.17:0/3780555458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 msgr2=0x555ffdd39510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd39510 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0ca710 tx=0x7fab7c099f70 comp rx=0 tx=0).stop 2023-07-14T13:03:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 1 -- 172.21.15.17:0/3780555458 shutdown_connections 2023-07-14T13:03:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ffdd493d0 0x555ffdd4b7e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd36e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd39510 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7fab6affd700 0 client.26240 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 1 --2- 172.21.15.17:0/3780555458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd36800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 1 -- 172.21.15.17:0/3780555458 >> 172.21.15.17:0/3780555458 conn(0x555ffdd24e20 msgr2=0x555ffdd2a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 1 -- 172.21.15.17:0/3780555458 shutdown_connections 2023-07-14T13:03:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 1 -- 172.21.15.17:0/3780555458 wait complete. 2023-07-14T13:03:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.568+0000 7faba5a40b80 20 client.26240 trim_cache size 0 max 16384 2023-07-14T13:03:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.588+0000 7faba5a40b80 1 Processor -- start 2023-07-14T13:03:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.588+0000 7faba5a40b80 1 -- start start 2023-07-14T13:03:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.589+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd2e350 0x555ffdd40530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.589+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2ec60 0x555ffdd30b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.589+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd39b50 0x555ffdd36010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.589+0000 7faba5a40b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdd37d70 con 0x555ffdd39b50 2023-07-14T13:03:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.589+0000 7faba5a40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdd249f0 con 0x555ffdd2ec60 2023-07-14T13:03:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.589+0000 7faba5a40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdd40a70 con 0x555ffdd2e350 2023-07-14T13:03:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.589+0000 7fab8bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd39b50 0x555ffdd36010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.589+0000 7fab8b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd2e350 0x555ffdd40530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.589+0000 7fab8affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2ec60 0x555ffdd30b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.589+0000 7fab8bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd39b50 0x555ffdd36010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39354/0 (socket says 172.21.15.17:39354) 2023-07-14T13:03:24.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.589+0000 7fab8bfff700 1 -- 172.21.15.17:0/97828014 learned_addr learned my addr 172.21.15.17:0/97828014 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:24.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.590+0000 7fab8b7fe700 1 -- 172.21.15.17:0/97828014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2ec60 msgr2=0x555ffdd30b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.590+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/97828014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2ec60 0x555ffdd30b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.590+0000 7fab8b7fe700 1 -- 172.21.15.17:0/97828014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd39b50 msgr2=0x555ffdd36010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.590+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/97828014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd39b50 0x555ffdd36010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.590+0000 7fab8b7fe700 1 -- 172.21.15.17:0/97828014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ffda97ce0 con 0x555ffdd2e350 2023-07-14T13:03:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.590+0000 7fab8affd700 1 --2- 172.21.15.17:0/97828014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2ec60 0x555ffdd30b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:24.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.590+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/97828014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd2e350 0x555ffdd40530 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0a1fb0 tx=0x7fab7c096500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d621a55f1d5cd698 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.590+0000 7fab727fc700 1 -- 172.21.15.17:0/97828014 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c018ea0 con 0x555ffdd2e350 2023-07-14T13:03:24.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.590+0000 7fab727fc700 1 -- 172.21.15.17:0/97828014 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab7c0a24e0 con 0x555ffdd2e350 2023-07-14T13:03:24.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.590+0000 7fab727fc700 1 -- 172.21.15.17:0/97828014 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c095e80 con 0x555ffdd2e350 2023-07-14T13:03:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.591+0000 7faba5a40b80 1 -- 172.21.15.17:0/97828014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd2e350 msgr2=0x555ffdd40530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.591+0000 7faba5a40b80 1 --2- 172.21.15.17:0/97828014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd2e350 0x555ffdd40530 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab7c0a1fb0 tx=0x7fab7c096500 comp rx=0 tx=0).stop 2023-07-14T13:03:24.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.591+0000 7faba5a40b80 1 -- 172.21.15.17:0/97828014 shutdown_connections 2023-07-14T13:03:24.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.591+0000 7faba5a40b80 1 --2- 172.21.15.17:0/97828014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd39b50 0x555ffdd36010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.591+0000 7faba5a40b80 1 --2- 172.21.15.17:0/97828014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd2e350 0x555ffdd40530 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.591+0000 7faba5a40b80 1 --2- 172.21.15.17:0/97828014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2ec60 0x555ffdd30b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.591+0000 7faba5a40b80 1 -- 172.21.15.17:0/97828014 >> 172.21.15.17:0/97828014 conn(0x555ffdd24e20 msgr2=0x555ffdd30460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.591+0000 7faba5a40b80 1 -- 172.21.15.17:0/97828014 shutdown_connections 2023-07-14T13:03:24.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.591+0000 7faba5a40b80 1 -- 172.21.15.17:0/97828014 wait complete. 2023-07-14T13:03:24.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.592+0000 7faba5a40b80 1 -- start start 2023-07-14T13:03:24.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.592+0000 7faba5a40b80 1 Processor -- start 2023-07-14T13:03:24.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.592+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd97690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.592+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd97bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.592+0000 7faba5a40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd3f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.592+0000 7faba5a40b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdd3f920 con 0x555ffdd2ec60 2023-07-14T13:03:24.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.592+0000 7faba5a40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdd3fa90 con 0x555ffdd2e350 2023-07-14T13:03:24.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.592+0000 7faba5a40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ffdd3fc50 con 0x555ffdd39b50 2023-07-14T13:03:24.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.592+0000 7faba5a40b80 10 client.0 _ll_register_callbacks cb 0x7fab7c099bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:24.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.593+0000 7fab8affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd97bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.593+0000 7fab8affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd97bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39368/0 (socket says 172.21.15.17:39368) 2023-07-14T13:03:24.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.593+0000 7fab8affd700 1 -- 172.21.15.17:0/4169856987 learned_addr learned my addr 172.21.15.17:0/4169856987 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:24.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.593+0000 7fab8bfff700 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd3f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.593+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd97690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.593+0000 7fab8affd700 1 -- 172.21.15.17:0/4169856987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 msgr2=0x555ffdd3f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.593+0000 7fab8affd700 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd3f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.593+0000 7fab8affd700 1 -- 172.21.15.17:0/4169856987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 msgr2=0x555ffdd97690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.593+0000 7fab8affd700 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd97690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.593+0000 7fab8affd700 1 -- 172.21.15.17:0/4169856987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ffdaaee60 con 0x555ffdd2ec60 2023-07-14T13:03:24.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.593+0000 7fab8bfff700 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd3f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:24.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.594+0000 7fab8affd700 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd97bd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fab80009990 tx=0x7fab80009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe73cb58ce8b29de server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.594+0000 7fab6affd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:24.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.594+0000 7fab6affd700 1 -- 172.21.15.17:0/4169856987 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab80033070 con 0x555ffdd2ec60 2023-07-14T13:03:24.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.594+0000 7faba5a40b80 1 -- 172.21.15.17:0/4169856987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab8001e040 con 0x555ffdd2ec60 2023-07-14T13:03:24.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.594+0000 7fab6affd700 1 -- 172.21.15.17:0/4169856987 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fab80034520 con 0x555ffdd2ec60 2023-07-14T13:03:24.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.594+0000 7fab6affd700 1 -- 172.21.15.17:0/4169856987 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab8001d040 con 0x555ffdd2ec60 2023-07-14T13:03:24.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.594+0000 7faba5a40b80 10 client.16521 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:24.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.594+0000 7faba5a40b80 1 -- 172.21.15.17:0/4169856987 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fab8c10f3b0 con 0x555ffdd2ec60 2023-07-14T13:03:24.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.595+0000 7fab6affd700 1 -- 172.21.15.17:0/4169856987 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab8001e040 con 0x555ffdd2ec60 2023-07-14T13:03:24.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.595+0000 7fab6affd700 1 -- 172.21.15.17:0/4169856987 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fab8000bb30 con 0x555ffdd2ec60 2023-07-14T13:03:24.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.595+0000 7faba5a40b80 10 client.16521 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:24.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.595+0000 7faba5a40b80 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:24.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.595+0000 7faba5a40b80 20 client.16521 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:24.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.595+0000 7faba5a40b80 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ffdd9f1f0 0x555ffdda1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.595+0000 7faba5a40b80 4 client.16521 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:03:24.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.595+0000 7faba5a40b80 1 -- 172.21.15.17:0/4169856987 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555ffdc3c0d0 con 0x555ffdd9f1f0 2023-07-14T13:03:24.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.595+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ffdd9f1f0 0x555ffdda1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.596+0000 7fab8b7fe700 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ffdd9f1f0 0x555ffdda1600 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c004613b3f08a181 server_cookie=7a452ee0befe75b4 in_seq=0 out_seq=0 2023-07-14T13:03:24.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.596+0000 7fab6affd700 10 client.16521 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7fab6affd700 1 -- 172.21.15.17:0/4169856987 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555ffdc3c0d0 con 0x555ffdd9f1f0 2023-07-14T13:03:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7fab6affd700 10 client.16521 handle_command_reply: tid=0 2023-07-14T13:03:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7faba5a40b80 1 client.16521 shutdown 2023-07-14T13:03:24.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7faba5a40b80 1 -- 172.21.15.17:0/4169856987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 msgr2=0x555ffdd97bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7faba5a40b80 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd97bd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fab80009990 tx=0x7fab80009310 comp rx=0 tx=0).stop 2023-07-14T13:03:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7faba5a40b80 1 -- 172.21.15.17:0/4169856987 shutdown_connections 2023-07-14T13:03:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7faba5a40b80 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ffdd9f1f0 0x555ffdda1600 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7faba5a40b80 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ffdd39b50 0x555ffdd3f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7faba5a40b80 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ffdd2e350 0x555ffdd97690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7fab6affd700 0 client.16521 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:24.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7faba5a40b80 1 --2- 172.21.15.17:0/4169856987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ffdd2ec60 0x555ffdd97bd0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7faba5a40b80 1 -- 172.21.15.17:0/4169856987 >> 172.21.15.17:0/4169856987 conn(0x555ffdd24e20 msgr2=0x555ffdd30cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7faba5a40b80 1 -- 172.21.15.17:0/4169856987 shutdown_connections 2023-07-14T13:03:24.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.597+0000 7faba5a40b80 1 -- 172.21.15.17:0/4169856987 wait complete. 2023-07-14T13:03:24.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.598+0000 7faba5a40b80 20 client.16521 trim_cache size 0 max 16384 2023-07-14T13:03:24.644 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:03:24.644 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:03:24.645 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "c5013d2c-b99c-4f03-a363-e057e0aec215", 2023-07-14T13:03:24.645 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:03:24.645 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:03:24.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.598+0000 7fab921ff700 1 -- 172.21.15.17:0/2553843336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fab740a12c0 msgr2=0x7fab740a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.598+0000 7fab921ff700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fab740a12c0 0x7fab740a3770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab84009550 tx=0x7fab84009040 comp rx=0 tx=0).stop 2023-07-14T13:03:24.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.598+0000 7fab921ff700 1 -- 172.21.15.17:0/2553843336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c072870 msgr2=0x7fab8c197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.598+0000 7fab921ff700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c072870 0x7fab8c197da0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00e9a0 tx=0x7fab7c00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.598+0000 7fab921ff700 1 -- 172.21.15.17:0/2553843336 shutdown_connections 2023-07-14T13:03:24.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.598+0000 7fab921ff700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fab740a12c0 0x7fab740a3770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.598+0000 7fab921ff700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab8c10c360 0x7fab8c19c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.598+0000 7fab921ff700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab8c072870 0x7fab8c197da0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.598+0000 7fab921ff700 1 --2- 172.21.15.17:0/2553843336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab8c073180 0x7fab8c1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.598+0000 7fab921ff700 1 -- 172.21.15.17:0/2553843336 >> 172.21.15.17:0/2553843336 conn(0x7fab8c0fb5e0 msgr2=0x7fab8c10e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.599+0000 7fab921ff700 1 -- 172.21.15.17:0/2553843336 shutdown_connections 2023-07-14T13:03:24.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.599+0000 7fab921ff700 1 -- 172.21.15.17:0/2553843336 wait complete. 2023-07-14T13:03:24.654 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:03:24.805 INFO:teuthology.orchestra.run.smithi017.stderr:12100000 of 50000000 tuples (24%) done (elapsed 194.41 s, remaining 608.93 s) 2023-07-14T13:03:24.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.873+0000 7f2dc6dff700 1 -- 172.21.15.17:0/3550553275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc0068280 msgr2=0x7f2dc0104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.873+0000 7f2dc6dff700 1 --2- 172.21.15.17:0/3550553275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc0068280 0x7f2dc0104720 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0099c0 tx=0x7f2dac009cd0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.873+0000 7f2dc6dff700 1 -- 172.21.15.17:0/3550553275 shutdown_connections 2023-07-14T13:03:24.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.873+0000 7f2dc6dff700 1 --2- 172.21.15.17:0/3550553275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc0104e50 0x7f2dc010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.873+0000 7f2dc6dff700 1 --2- 172.21.15.17:0/3550553275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dc00678e0 0x7f2dc0067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.873+0000 7f2dc6dff700 1 --2- 172.21.15.17:0/3550553275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc0068280 0x7f2dc0104720 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.873+0000 7f2dc6dff700 1 -- 172.21.15.17:0/3550553275 >> 172.21.15.17:0/3550553275 conn(0x7f2dc0074b10 msgr2=0x7f2dc0074f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.873+0000 7f2dc6dff700 1 -- 172.21.15.17:0/3550553275 shutdown_connections 2023-07-14T13:03:24.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.874+0000 7f2dc6dff700 1 -- 172.21.15.17:0/3550553275 wait complete. 2023-07-14T13:03:24.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.875+0000 7f2dc6dff700 1 Processor -- start 2023-07-14T13:03:24.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.875+0000 7f2dc6dff700 1 -- start start 2023-07-14T13:03:24.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dc6dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dc00678e0 0x7f2dc00ff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dc6dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc0068280 0x7f2dc00ffaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dc6dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc0104e50 0x7f2dc01a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dc6dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc0100320 con 0x7f2dc0068280 2023-07-14T13:03:24.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dc6dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc01a42d0 con 0x7f2dc00678e0 2023-07-14T13:03:24.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dc6dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc01a4410 con 0x7f2dc0104e50 2023-07-14T13:03:24.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dbffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc0068280 0x7f2dc00ffaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dbffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc0068280 0x7f2dc00ffaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33936/0 (socket says 172.21.15.17:33936) 2023-07-14T13:03:24.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dc539c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc0104e50 0x7f2dc01a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dc4b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dc00678e0 0x7f2dc00ff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dbffff700 1 -- 172.21.15.17:0/2276739502 learned_addr learned my addr 172.21.15.17:0/2276739502 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:24.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dbffff700 1 -- 172.21.15.17:0/2276739502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc0104e50 msgr2=0x7f2dc01a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dbffff700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc0104e50 0x7f2dc01a3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dbffff700 1 -- 172.21.15.17:0/2276739502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dc00678e0 msgr2=0x7f2dc00ff5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dbffff700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dc00678e0 0x7f2dc00ff5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dbffff700 1 -- 172.21.15.17:0/2276739502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0095f0 con 0x7f2dc0068280 2023-07-14T13:03:24.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.876+0000 7f2dc4b9b700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dc00678e0 0x7f2dc00ff5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:24.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.877+0000 7f2dbffff700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc0068280 0x7f2dc00ffaf0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009990 tx=0x7f2dac009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.877+0000 7f2dbdffb700 1 -- 172.21.15.17:0/2276739502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac01d070 con 0x7f2dc0068280 2023-07-14T13:03:24.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.877+0000 7f2dbdffb700 1 -- 172.21.15.17:0/2276739502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2dac003ec0 con 0x7f2dc0068280 2023-07-14T13:03:24.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.877+0000 7f2dc6dff700 1 -- 172.21.15.17:0/2276739502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc01a4610 con 0x7f2dc0068280 2023-07-14T13:03:24.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.877+0000 7f2dbdffb700 1 -- 172.21.15.17:0/2276739502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac022bc0 con 0x7f2dc0068280 2023-07-14T13:03:24.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.877+0000 7f2dc6dff700 1 -- 172.21.15.17:0/2276739502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc01a4a90 con 0x7f2dc0068280 2023-07-14T13:03:24.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.881+0000 7f2dbdffb700 1 -- 172.21.15.17:0/2276739502 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2dac003a30 con 0x7f2dc0068280 2023-07-14T13:03:24.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.883+0000 7f2dbdffb700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2db00a1340 0x7f2db00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.883+0000 7f2dbdffb700 1 -- 172.21.15.17:0/2276739502 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2dac0ce080 con 0x7f2dc0068280 2023-07-14T13:03:24.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.883+0000 7f2dc4b9b700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2db00a1340 0x7f2db00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.883+0000 7f2dda81ab80 1 Processor -- start 2023-07-14T13:03:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.883+0000 7f2dda81ab80 1 -- start start 2023-07-14T13:03:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dc4b9b700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2db00a1340 0x7f2db00a37f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2db4007fd0 tx=0x7f2db40073d0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df182d0 0x55f97df186a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df23590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df25eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97de1ecb0 con 0x55f97df23ad0 2023-07-14T13:03:24.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97de71a40 con 0x55f97df18be0 2023-07-14T13:03:24.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97de6aed0 con 0x55f97df182d0 2023-07-14T13:03:24.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dbffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df23590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dc539c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df25eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dbffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df23590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55918/0 (socket says 172.21.15.17:55918) 2023-07-14T13:03:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dbffff700 1 -- 172.21.15.17:0/1808845837 learned_addr learned my addr 172.21.15.17:0/1808845837 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.884+0000 7f2dc4b9b700 1 --2- 172.21.15.17:0/1808845837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df182d0 0x55f97df186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.885+0000 7f2dbffff700 1 -- 172.21.15.17:0/1808845837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df182d0 msgr2=0x55f97df186a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.885+0000 7f2dbffff700 1 --2- 172.21.15.17:0/1808845837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df182d0 0x55f97df186a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.885+0000 7f2dbffff700 1 -- 172.21.15.17:0/1808845837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 msgr2=0x55f97df25eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.885+0000 7f2dbffff700 1 --2- 172.21.15.17:0/1808845837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df25eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.885+0000 7f2dbffff700 1 -- 172.21.15.17:0/1808845837 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f97dc98de0 con 0x55f97df18be0 2023-07-14T13:03:24.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.885+0000 7f2dc4b9b700 1 --2- 172.21.15.17:0/1808845837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df182d0 0x55f97df186a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:24.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.885+0000 7f2dbffff700 1 --2- 172.21.15.17:0/1808845837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df23590 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0976f0 tx=0x7f2dac09adb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894a7125476cfc10 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.885+0000 7f2daaffd700 1 -- 172.21.15.17:0/1808845837 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac003ce0 con 0x55f97df18be0 2023-07-14T13:03:24.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.885+0000 7f2daaffd700 1 -- 172.21.15.17:0/1808845837 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2dac09b1f0 con 0x55f97df18be0 2023-07-14T13:03:24.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.885+0000 7f2daaffd700 1 -- 172.21.15.17:0/1808845837 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac097900 con 0x55f97df18be0 2023-07-14T13:03:24.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.886+0000 7f2dda81ab80 1 -- 172.21.15.17:0/1808845837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 msgr2=0x55f97df23590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.886+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/1808845837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df23590 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0976f0 tx=0x7f2dac09adb0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.886+0000 7f2dda81ab80 1 -- 172.21.15.17:0/1808845837 shutdown_connections 2023-07-14T13:03:24.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.886+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/1808845837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df25eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.886+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/1808845837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df182d0 0x55f97df186a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.886+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/1808845837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df23590 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.886+0000 7f2dda81ab80 1 -- 172.21.15.17:0/1808845837 >> 172.21.15.17:0/1808845837 conn(0x55f97df0eda0 msgr2=0x55f97df146a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.886+0000 7f2dda81ab80 1 -- 172.21.15.17:0/1808845837 shutdown_connections 2023-07-14T13:03:24.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.886+0000 7f2dda81ab80 1 -- 172.21.15.17:0/1808845837 wait complete. 2023-07-14T13:03:24.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.887+0000 7f2dda81ab80 1 -- start start 2023-07-14T13:03:24.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.887+0000 7f2dda81ab80 1 Processor -- start 2023-07-14T13:03:24.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.888+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df182d0 0x55f97df28b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.888+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df18be0 0x55f97df29060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.888+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.888+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97de0aac0 con 0x55f97df23ad0 2023-07-14T13:03:24.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.888+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97de0a7c0 con 0x55f97df182d0 2023-07-14T13:03:24.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.888+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97dcee920 con 0x55f97df18be0 2023-07-14T13:03:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.888+0000 7f2dda81ab80 10 client.0 _ll_register_callbacks cb 0x55f97de08760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.888+0000 7f2dc4b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df182d0 0x55f97df28b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.888+0000 7f2dc4b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df182d0 0x55f97df28b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55930/0 (socket says 172.21.15.17:55930) 2023-07-14T13:03:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.888+0000 7f2dc539c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.888+0000 7f2dc4b9b700 1 -- 172.21.15.17:0/2482214104 learned_addr learned my addr 172.21.15.17:0/2482214104 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.889+0000 7f2dbffff700 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df18be0 0x55f97df29060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.889+0000 7f2dc4b9b700 1 -- 172.21.15.17:0/2482214104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df18be0 msgr2=0x55f97df29060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.889+0000 7f2dc4b9b700 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df18be0 0x55f97df29060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.889+0000 7f2dc4b9b700 1 -- 172.21.15.17:0/2482214104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 msgr2=0x55f97df229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.889+0000 7f2dc4b9b700 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.889+0000 7f2dc4b9b700 1 -- 172.21.15.17:0/2482214104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc01a4a90 con 0x55f97df182d0 2023-07-14T13:03:24.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.889+0000 7f2dc4b9b700 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df182d0 0x55f97df28b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2db4004500 tx=0x7f2db40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1461e8207e161174 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.889+0000 7f2d9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:03:24.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.890+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2482214104 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4004530 con 0x55f97df182d0 2023-07-14T13:03:24.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.890+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2482214104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f97ddc44f0 con 0x55f97df182d0 2023-07-14T13:03:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.890+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2482214104 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2db4017070 con 0x55f97df182d0 2023-07-14T13:03:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.890+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2482214104 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2db4011440 con 0x55f97df182d0 2023-07-14T13:03:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.890+0000 7f2dda81ab80 10 client.26258 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.890+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2482214104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55f97dc81c60 con 0x55f97df182d0 2023-07-14T13:03:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.890+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2482214104 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f97ddc44f0 con 0x55f97df182d0 2023-07-14T13:03:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.891+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2482214104 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2db40204a0 con 0x55f97df182d0 2023-07-14T13:03:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.891+0000 7f2dda81ab80 10 client.26258 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.891+0000 7f2dda81ab80 10 client.26258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.891+0000 7f2dda81ab80 20 client.26258 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.891+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f97df33020 0x55f97df35430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.891+0000 7f2dda81ab80 4 client.26258 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.891+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2482214104 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f97de63eb0 con 0x55f97df33020 2023-07-14T13:03:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.891+0000 7f2dbffff700 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f97df33020 0x55f97df35430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.892+0000 7f2dbffff700 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f97df33020 0x55f97df35430 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99878786bb89ab0d server_cookie=11297007aa4e8bec in_seq=0 out_seq=0 2023-07-14T13:03:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.892+0000 7f2d9ffff700 10 client.26258 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2482214104 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f97de63eb0 con 0x55f97df33020 2023-07-14T13:03:24.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2d9ffff700 10 client.26258 handle_command_reply: tid=0 2023-07-14T13:03:24.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2dda81ab80 1 client.26258 shutdown 2023-07-14T13:03:24.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2482214104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df182d0 msgr2=0x55f97df28b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df182d0 0x55f97df28b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2db4004500 tx=0x7f2db40047c0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2482214104 shutdown_connections 2023-07-14T13:03:24.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f97df33020 0x55f97df35430 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df182d0 0x55f97df28b20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2482214104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df18be0 0x55f97df29060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2482214104 >> 172.21.15.17:0/2482214104 conn(0x55f97df0eda0 msgr2=0x55f97df14230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2d9ffff700 0 client.26258 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:24.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2482214104 shutdown_connections 2023-07-14T13:03:24.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.893+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2482214104 wait complete. 2023-07-14T13:03:24.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.894+0000 7f2dda81ab80 20 client.26258 trim_cache size 0 max 16384 2023-07-14T13:03:24.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.914+0000 7f2dda81ab80 1 Processor -- start 2023-07-14T13:03:24.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.914+0000 7f2dda81ab80 1 -- start start 2023-07-14T13:03:24.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.914+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df182d0 0x55f97df1d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.914+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df14140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.914+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df14680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.914+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97df15d20 con 0x55f97df23ad0 2023-07-14T13:03:24.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.914+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97df19540 con 0x55f97df18be0 2023-07-14T13:03:24.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.914+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97df0e970 con 0x55f97df182d0 2023-07-14T13:03:24.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.915+0000 7f2dc539c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df14680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.915+0000 7f2dc539c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df14680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33950/0 (socket says 172.21.15.17:33950) 2023-07-14T13:03:24.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.915+0000 7f2dc4b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df182d0 0x55f97df1d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.915+0000 7f2dc539c700 1 -- 172.21.15.17:0/2692778055 learned_addr learned my addr 172.21.15.17:0/2692778055 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:24.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.915+0000 7f2dbffff700 1 --2- 172.21.15.17:0/2692778055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df14140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.915+0000 7f2dc539c700 1 -- 172.21.15.17:0/2692778055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df182d0 msgr2=0x55f97df1d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.915+0000 7f2dc539c700 1 --2- 172.21.15.17:0/2692778055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df182d0 0x55f97df1d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.915+0000 7f2dc539c700 1 -- 172.21.15.17:0/2692778055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 msgr2=0x55f97df14140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.915+0000 7f2dc539c700 1 --2- 172.21.15.17:0/2692778055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df14140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.915+0000 7f2dc539c700 1 -- 172.21.15.17:0/2692778055 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f97df105e0 con 0x55f97df23ad0 2023-07-14T13:03:24.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.915+0000 7f2dc539c700 1 --2- 172.21.15.17:0/2692778055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df14680 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009fb0 tx=0x7f2db8007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5166c32b1d94c586 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.916+0000 7f2dab7fe700 1 -- 172.21.15.17:0/2692778055 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8009ad0 con 0x55f97df23ad0 2023-07-14T13:03:24.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.916+0000 7f2dab7fe700 1 -- 172.21.15.17:0/2692778055 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2db800f040 con 0x55f97df23ad0 2023-07-14T13:03:24.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.916+0000 7f2dab7fe700 1 -- 172.21.15.17:0/2692778055 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8017840 con 0x55f97df23ad0 2023-07-14T13:03:24.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.917+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2692778055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 msgr2=0x55f97df14680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.917+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2692778055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df14680 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009fb0 tx=0x7f2db8007500 comp rx=0 tx=0).stop 2023-07-14T13:03:24.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.917+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2692778055 shutdown_connections 2023-07-14T13:03:24.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.917+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2692778055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df23ad0 0x55f97df14680 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.917+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2692778055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df182d0 0x55f97df1d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.917+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2692778055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df14140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.917+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2692778055 >> 172.21.15.17:0/2692778055 conn(0x55f97df0eda0 msgr2=0x55f97df12e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.917+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2692778055 shutdown_connections 2023-07-14T13:03:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.917+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2692778055 wait complete. 2023-07-14T13:03:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.917+0000 7f2dda81ab80 1 -- start start 2023-07-14T13:03:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.917+0000 7f2dda81ab80 1 Processor -- start 2023-07-14T13:03:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.918+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df182d0 0x55f97df80430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.918+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df80970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.918+0000 7f2dda81ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df23ad0 0x55f97df7ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.918+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97df7b410 con 0x55f97df182d0 2023-07-14T13:03:24.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.918+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97df7b580 con 0x55f97df18be0 2023-07-14T13:03:24.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.918+0000 7f2dda81ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97df7b740 con 0x55f97df23ad0 2023-07-14T13:03:24.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.918+0000 7f2dda81ab80 10 client.0 _ll_register_callbacks cb 0x7f2db4004030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:24.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.918+0000 7f2dc4b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df182d0 0x55f97df80430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2dc4b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df182d0 0x55f97df80430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33962/0 (socket says 172.21.15.17:33962) 2023-07-14T13:03:24.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2dc4b9b700 1 -- 172.21.15.17:0/2822562255 learned_addr learned my addr 172.21.15.17:0/2822562255 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:24.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2dbffff700 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df80970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2dc539c700 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df23ad0 0x55f97df7ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2dc4b9b700 1 -- 172.21.15.17:0/2822562255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df23ad0 msgr2=0x55f97df7ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2dc4b9b700 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df23ad0 0x55f97df7ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2dc4b9b700 1 -- 172.21.15.17:0/2822562255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 msgr2=0x55f97df80970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:24.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2dc4b9b700 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df80970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2dc4b9b700 1 -- 172.21.15.17:0/2822562255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db8009c30 con 0x55f97df182d0 2023-07-14T13:03:24.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2dbffff700 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df80970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:24.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2dc4b9b700 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df182d0 0x55f97df80430 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2db4007d50 tx=0x7f2db4007230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c7f94c88627e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:24.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.919+0000 7f2d9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:24.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.920+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2822562255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4020610 con 0x55f97df182d0 2023-07-14T13:03:24.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.920+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2822562255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2dac09b1f0 con 0x55f97df182d0 2023-07-14T13:03:24.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.920+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2822562255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2db4017070 con 0x55f97df182d0 2023-07-14T13:03:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.920+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2822562255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2db4010af0 con 0x55f97df182d0 2023-07-14T13:03:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.920+0000 7f2dda81ab80 10 client.16539 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.920+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2822562255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55f97dcbf250 con 0x55f97df182d0 2023-07-14T13:03:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.921+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2822562255 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2dac09b1f0 con 0x55f97df182d0 2023-07-14T13:03:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.921+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2822562255 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2db4029ca0 con 0x55f97df182d0 2023-07-14T13:03:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.921+0000 7f2dda81ab80 10 client.16539 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:24.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.921+0000 7f2dda81ab80 10 client.16539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:24.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.921+0000 7f2dda81ab80 20 client.16539 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:24.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.921+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f97df88240 0x55f97df8a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:24.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.921+0000 7f2dda81ab80 4 client.16539 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:03:24.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.921+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2822562255 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f97de26050 con 0x55f97df88240 2023-07-14T13:03:24.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.921+0000 7f2dbffff700 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f97df88240 0x55f97df8a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.922+0000 7f2dbffff700 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f97df88240 0x55f97df8a650 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281d25cb82c4bbc5 server_cookie=70cd4a08a83b7be8 in_seq=0 out_seq=0 2023-07-14T13:03:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.922+0000 7f2d9ffff700 10 client.16539 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.922+0000 7f2d9ffff700 1 -- 172.21.15.17:0/2822562255 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f97de26050 con 0x55f97df88240 2023-07-14T13:03:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.922+0000 7f2d9ffff700 10 client.16539 handle_command_reply: tid=0 2023-07-14T13:03:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.922+0000 7f2dda81ab80 1 client.16539 shutdown 2023-07-14T13:03:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2822562255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df182d0 msgr2=0x55f97df80430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df182d0 0x55f97df80430 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2db4007d50 tx=0x7f2db4007230 comp rx=0 tx=0).stop 2023-07-14T13:03:24.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2822562255 shutdown_connections 2023-07-14T13:03:24.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f97df88240 0x55f97df8a650 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f97df23ad0 0x55f97df7ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f97df182d0 0x55f97df80430 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2dda81ab80 1 --2- 172.21.15.17:0/2822562255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f97df18be0 0x55f97df80970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2822562255 >> 172.21.15.17:0/2822562255 conn(0x55f97df0eda0 msgr2=0x55f97df14140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2d9ffff700 0 client.16539 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:24.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2822562255 shutdown_connections 2023-07-14T13:03:24.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2dda81ab80 1 -- 172.21.15.17:0/2822562255 wait complete. 2023-07-14T13:03:24.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.923+0000 7f2dda81ab80 20 client.16539 trim_cache size 0 max 16384 2023-07-14T13:03:24.967 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:03:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:03:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:03:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: "c5013d2c-b99c-4f03-a363-e057e0aec215": { 2023-07-14T13:03:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:03:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "c5013d2c-b99c-4f03-a363-e057e0aec215", 2023-07-14T13:03:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:03:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:03:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:03:24.968 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:03:24.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 -- 172.21.15.17:0/2276739502 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2db00a1340 msgr2=0x7f2db00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2db00a1340 0x7f2db00a37f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2db4007fd0 tx=0x7f2db40073d0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 -- 172.21.15.17:0/2276739502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc0068280 msgr2=0x7f2dc00ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc0068280 0x7f2dc00ffaf0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009990 tx=0x7f2dac009580 comp rx=0 tx=0).stop 2023-07-14T13:03:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 -- 172.21.15.17:0/2276739502 shutdown_connections 2023-07-14T13:03:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2db00a1340 0x7f2db00a37f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc0104e50 0x7f2dc01a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2dc00678e0 0x7f2dc00ff5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 --2- 172.21.15.17:0/2276739502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dc0068280 0x7f2dc00ffaf0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:24.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 -- 172.21.15.17:0/2276739502 >> 172.21.15.17:0/2276739502 conn(0x7f2dc0074b10 msgr2=0x7f2dc0103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:24.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 -- 172.21.15.17:0/2276739502 shutdown_connections 2023-07-14T13:03:24.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:24.924+0000 7f2dc6dff700 1 -- 172.21.15.17:0/2276739502 wait complete. 2023-07-14T13:03:24.976 INFO:tasks.cephfs.filesystem:scrub status for tag:c5013d2c-b99c-4f03-a363-e057e0aec215 - {'path': '/', 'tag': 'c5013d2c-b99c-4f03-a363-e057e0aec215', 'options': 'recursive,force'} 2023-07-14T13:03:24.999 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 13:03:24 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-b[122274]: 2023-07-14T13:03:24.623+0000 7f0425da4700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000019 [...6,head] /volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp/ auth{1=1,2=1} v2157 ap=2 f(v30 m2023-07-14T13:03:10.114904+0000 3=3+0) n(v3 rc2023-07-14T13:03:10.114904+0000 b3321 4=3+1) old_inodes=4 (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/-@87} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x564c11aaf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v38>,<0x10000000005/data v101>,<0x10000000003/postgres v23>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v37>,<0x10000000001/sv_0 v55>,<0x10000000000/_nogroup v41>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v2157>,<0x10000000005/data v1046>,<0x10000000003/postgres v280>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v300>,<0x10000000001/sv_0 v315>,<0x10000000000/_nogroup v297>,<0x1/volumes v289>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-07-14T13:03:10.102645+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2023-07-14T13:03:10.114904+0000 b3321 4=3+1)","memory_value.dirstat":"f(v30 m2023-07-14T13:03:10.114904+0000 3=3+0)","memory_value.rstat":"n(v3 rc2023-07-14T13:03:10.114904+0000 b3321 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-07-14T13:03:24.999 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 13:03:24 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-b[122274]: 2023-07-14T13:03:24.624+0000 7f0425da4700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...5,head] /volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical/ auth{1=1,2=1} v2125 ap=2 f(v4 m2023-07-14T13:02:53.048678+0000 3=1+2) n(v3 rc2023-07-14T13:02:53.048678+0000 b8 4=1+3) old_inodes=3 (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/-@63} | dirtyscattered=0 request=0 lock=3 importing=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x564c11ab0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v478>,<0x10000000005/data v101>,<0x10000000003/postgres v23>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v37>,<0x10000000001/sv_0 v55>,<0x10000000000/_nogroup v41>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v2125>,<0x10000000005/data v1046>,<0x10000000003/postgres v280>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v300>,<0x10000000001/sv_0 v315>,<0x10000000000/_nogroup v297>,<0x1/volumes v289>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-07-14T13:02:53.030517+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2023-07-14T13:02:53.048678+0000 b8 4=1+3)","memory_value.dirstat":"f(v4 m2023-07-14T13:02:53.048678+0000 3=1+2)","memory_value.rstat":"n(v3 rc2023-07-14T13:02:53.048678+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-07-14T13:03:25.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:25 smithi017 ceph-mon[95536]: pgmap v113: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:03:25.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:25 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:03:25.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:25 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:25.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:25 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:03:25.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:25 smithi017 ceph-mon[95536]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2023-07-14T13:03:25.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:25 smithi017 ceph-mon[95536]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-14T13:03:25.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:25 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:25.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:25 smithi135 ceph-mon[97338]: pgmap v113: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:03:25.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:25 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:03:25.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:25 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:25.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:25 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:03:25.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:25 smithi135 ceph-mon[97338]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2023-07-14T13:03:25.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:25 smithi135 ceph-mon[97338]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-14T13:03:25.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:25 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:25.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:25 smithi131 ceph-mon[96953]: pgmap v113: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 22 op/s 2023-07-14T13:03:25.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:25 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:03:25.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:25 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:25.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:25 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:03:25.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:25 smithi131 ceph-mon[96953]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2023-07-14T13:03:25.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:25 smithi131 ceph-mon[96953]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-14T13:03:25.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:25 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:26.094 INFO:teuthology.orchestra.run.smithi017.stderr:12200000 of 50000000 tuples (24%) done (elapsed 195.70 s, remaining 606.34 s) 2023-07-14T13:03:26.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:26 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:03:26.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:26 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:03:26.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:26 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:26.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:26 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:26.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:26 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:03:26.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:26 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:03:26.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:26 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:26.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:26 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:26.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:26 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:03:26.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:26 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:03:26.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:26 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:26.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:26 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:27.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:27 smithi017 ceph-mon[95536]: pgmap v114: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 34 MiB/s wr, 114 op/s 2023-07-14T13:03:27.384 INFO:teuthology.orchestra.run.smithi017.stderr:12300000 of 50000000 tuples (24%) done (elapsed 196.99 s, remaining 603.77 s) 2023-07-14T13:03:27.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:27 smithi135 ceph-mon[97338]: pgmap v114: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 34 MiB/s wr, 114 op/s 2023-07-14T13:03:27.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:27 smithi131 ceph-mon[96953]: pgmap v114: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 34 MiB/s wr, 114 op/s 2023-07-14T13:03:28.683 INFO:teuthology.orchestra.run.smithi017.stderr:12400000 of 50000000 tuples (24%) done (elapsed 198.29 s, remaining 601.26 s) 2023-07-14T13:03:29.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:29 smithi017 ceph-mon[95536]: pgmap v115: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 23 MiB/s wr, 102 op/s 2023-07-14T13:03:29.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:29 smithi135 ceph-mon[97338]: pgmap v115: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 23 MiB/s wr, 102 op/s 2023-07-14T13:03:29.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:29 smithi131 ceph-mon[96953]: pgmap v115: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 23 MiB/s wr, 102 op/s 2023-07-14T13:03:30.058 INFO:teuthology.orchestra.run.smithi017.stderr:12500000 of 50000000 tuples (25%) done (elapsed 199.66 s, remaining 598.98 s) 2023-07-14T13:03:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:12600000 of 50000000 tuples (25%) done (elapsed 200.95 s, remaining 596.46 s) 2023-07-14T13:03:31.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:31 smithi017 ceph-mon[95536]: pgmap v116: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 34 MiB/s wr, 110 op/s 2023-07-14T13:03:31.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:31 smithi135 ceph-mon[97338]: pgmap v116: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 34 MiB/s wr, 110 op/s 2023-07-14T13:03:31.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:31 smithi131 ceph-mon[96953]: pgmap v116: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 34 MiB/s wr, 110 op/s 2023-07-14T13:03:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.523+0000 7f9fe4fff700 1 -- 172.21.15.17:0/3815426134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fe0102970 msgr2=0x7f9fe0106930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.523+0000 7f9fe4fff700 1 --2- 172.21.15.17:0/3815426134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fe0102970 0x7f9fe0106930 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40099c0 tx=0x7f9fd4009cd0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.523+0000 7f9fe4fff700 1 -- 172.21.15.17:0/3815426134 shutdown_connections 2023-07-14T13:03:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.523+0000 7f9fe4fff700 1 --2- 172.21.15.17:0/3815426134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fe0107010 0x7f9fe010ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.523+0000 7f9fe4fff700 1 --2- 172.21.15.17:0/3815426134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe0101fd0 0x7f9fe01023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.523+0000 7f9fe4fff700 1 --2- 172.21.15.17:0/3815426134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fe0102970 0x7f9fe0106930 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.523+0000 7f9fe4fff700 1 -- 172.21.15.17:0/3815426134 >> 172.21.15.17:0/3815426134 conn(0x7f9fe00fd840 msgr2=0x7f9fe00ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.524+0000 7f9fe4fff700 1 -- 172.21.15.17:0/3815426134 shutdown_connections 2023-07-14T13:03:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.524+0000 7f9fe4fff700 1 -- 172.21.15.17:0/3815426134 wait complete. 2023-07-14T13:03:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.525+0000 7f9fe4fff700 1 Processor -- start 2023-07-14T13:03:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.525+0000 7f9fe4fff700 1 -- start start 2023-07-14T13:03:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.525+0000 7f9fe4fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fe0101fd0 0x7f9fe0197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.525+0000 7f9fe4fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe0102970 0x7f9fe01982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.525+0000 7f9fe4fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fe0107010 0x7f9fe019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.525+0000 7f9fe4fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe019cf80 con 0x7f9fe0107010 2023-07-14T13:03:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.525+0000 7f9fe4fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe019d0f0 con 0x7f9fe0101fd0 2023-07-14T13:03:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.525+0000 7f9fe4fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe019d2b0 con 0x7f9fe0102970 2023-07-14T13:03:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.525+0000 7f9fded9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fe0107010 0x7f9fe019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.526+0000 7f9fded9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fe0107010 0x7f9fe019c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33972/0 (socket says 172.21.15.17:33972) 2023-07-14T13:03:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.526+0000 7f9fded9d700 1 -- 172.21.15.17:0/531668523 learned_addr learned my addr 172.21.15.17:0/531668523 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.526+0000 7f9fde59c700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fe0101fd0 0x7f9fe0197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.526+0000 7f9fddd9b700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe0102970 0x7f9fe01982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.526+0000 7f9fded9d700 1 -- 172.21.15.17:0/531668523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe0102970 msgr2=0x7f9fe01982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.526+0000 7f9fded9d700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe0102970 0x7f9fe01982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.526+0000 7f9fded9d700 1 -- 172.21.15.17:0/531668523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fe0101fd0 msgr2=0x7f9fe0197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.526+0000 7f9fded9d700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fe0101fd0 0x7f9fe0197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.526+0000 7f9fded9d700 1 -- 172.21.15.17:0/531668523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd40095f0 con 0x7f9fe0107010 2023-07-14T13:03:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.526+0000 7f9fded9d700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fe0107010 0x7f9fe019c940 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800ef30 tx=0x7f9fd800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.527+0000 7f9fcf7fe700 1 -- 172.21.15.17:0/531668523 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8018070 con 0x7f9fe0107010 2023-07-14T13:03:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.527+0000 7f9fe4fff700 1 -- 172.21.15.17:0/531668523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe019d530 con 0x7f9fe0107010 2023-07-14T13:03:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.527+0000 7f9fcf7fe700 1 -- 172.21.15.17:0/531668523 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9fd800f040 con 0x7f9fe0107010 2023-07-14T13:03:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.527+0000 7f9fcf7fe700 1 -- 172.21.15.17:0/531668523 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8003d00 con 0x7f9fe0107010 2023-07-14T13:03:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.527+0000 7f9fe4fff700 1 -- 172.21.15.17:0/531668523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe01a4dd0 con 0x7f9fe0107010 2023-07-14T13:03:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.530+0000 7f9fcf7fe700 1 -- 172.21.15.17:0/531668523 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9fd800caa0 con 0x7f9fe0107010 2023-07-14T13:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.532+0000 7f9fcf7fe700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9fc80a12c0 0x7f9fc80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.532+0000 7f9ff88e0b80 1 Processor -- start 2023-07-14T13:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.532+0000 7f9fcf7fe700 1 -- 172.21.15.17:0/531668523 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f9fd80cca00 con 0x7f9fe0107010 2023-07-14T13:03:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.532+0000 7f9ff88e0b80 1 -- start start 2023-07-14T13:03:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.532+0000 7f9fde59c700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9fc80a12c0 0x7f9fc80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.532+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 0x55d75f9e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.532+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9e4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.532+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f9e4580 0x55d75f9e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.532+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75f8e9c50 con 0x55d75f9ea2d0 2023-07-14T13:03:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.532+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75f93c9e0 con 0x55d75f8406b0 2023-07-14T13:03:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.532+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75f935e70 con 0x55d75f9e4580 2023-07-14T13:03:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.533+0000 7f9fde59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 0x55d75f9e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.533+0000 7f9fde59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 0x55d75f9e9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55976/0 (socket says 172.21.15.17:55976) 2023-07-14T13:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.533+0000 7f9fde59c700 1 -- 172.21.15.17:0/2870969283 learned_addr learned my addr 172.21.15.17:0/2870969283 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.533+0000 7f9fddd9b700 1 --2- 172.21.15.17:0/2870969283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.533+0000 7f9fde59c700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9fc80a12c0 0x7f9fc80a3770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009c40 tx=0x7f9fd0009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.533+0000 7f9fded9d700 1 --2- 172.21.15.17:0/2870969283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f9e4580 0x55d75f9e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.533+0000 7f9fde59c700 1 -- 172.21.15.17:0/2870969283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f9e4580 msgr2=0x55d75f9e49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.533+0000 7f9fde59c700 1 --2- 172.21.15.17:0/2870969283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f9e4580 0x55d75f9e49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.533+0000 7f9fde59c700 1 -- 172.21.15.17:0/2870969283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 msgr2=0x55d75f9e4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.533+0000 7f9fde59c700 1 --2- 172.21.15.17:0/2870969283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9e4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.533+0000 7f9fde59c700 1 -- 172.21.15.17:0/2870969283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d75f763d80 con 0x55d75f8406b0 2023-07-14T13:03:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.534+0000 7f9fde59c700 1 --2- 172.21.15.17:0/2870969283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 0x55d75f9e9d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0011e30 tx=0x7f9fd0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11e399f62393b71c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.534+0000 7f9fccff9700 1 -- 172.21.15.17:0/2870969283 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0012dc0 con 0x55d75f8406b0 2023-07-14T13:03:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.534+0000 7f9fccff9700 1 -- 172.21.15.17:0/2870969283 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9fd0016070 con 0x55d75f8406b0 2023-07-14T13:03:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.534+0000 7f9fccff9700 1 -- 172.21.15.17:0/2870969283 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000f610 con 0x55d75f8406b0 2023-07-14T13:03:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.535+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/2870969283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 msgr2=0x55d75f9e9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.535+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/2870969283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 0x55d75f9e9d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0011e30 tx=0x7f9fd0014000 comp rx=0 tx=0).stop 2023-07-14T13:03:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.535+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/2870969283 shutdown_connections 2023-07-14T13:03:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.535+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/2870969283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f9e4580 0x55d75f9e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.535+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/2870969283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 0x55d75f9e9d90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.535+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/2870969283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9e4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.535+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/2870969283 >> 172.21.15.17:0/2870969283 conn(0x55d75f9d9be0 msgr2=0x55d75f9def10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.535+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/2870969283 shutdown_connections 2023-07-14T13:03:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.535+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/2870969283 wait complete. 2023-07-14T13:03:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.535+0000 7f9ff88e0b80 1 -- start start 2023-07-14T13:03:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.536+0000 7f9ff88e0b80 1 Processor -- start 2023-07-14T13:03:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.536+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f8406b0 0x55d75f9f0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.536+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9e4580 0x55d75f9ed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.536+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f9ea2d0 0x55d75f9edfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.536+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75f8d5a60 con 0x55d75f9e4580 2023-07-14T13:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.536+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75f8d5760 con 0x55d75f9ea2d0 2023-07-14T13:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.536+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75f7b98c0 con 0x55d75f8406b0 2023-07-14T13:03:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.536+0000 7f9ff88e0b80 10 client.0 _ll_register_callbacks cb 0x55d75f8d3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fddd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9e4580 0x55d75f9ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fddd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9e4580 0x55d75f9ed880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33988/0 (socket says 172.21.15.17:33988) 2023-07-14T13:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fded9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f9ea2d0 0x55d75f9edfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fddd9b700 1 -- 172.21.15.17:0/1726622542 learned_addr learned my addr 172.21.15.17:0/1726622542 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fde59c700 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f8406b0 0x55d75f9f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fded9d700 1 -- 172.21.15.17:0/1726622542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f8406b0 msgr2=0x55d75f9f0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fded9d700 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f8406b0 0x55d75f9f0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fded9d700 1 -- 172.21.15.17:0/1726622542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9e4580 msgr2=0x55d75f9ed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fded9d700 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9e4580 0x55d75f9ed880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fded9d700 1 -- 172.21.15.17:0/1726622542 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd0011ae0 con 0x55d75f9ea2d0 2023-07-14T13:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fddd9b700 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9e4580 0x55d75f9ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fded9d700 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f9ea2d0 0x55d75f9edfc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80ca160 tx=0x7f9fd80997a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef1600015e608c50 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.537+0000 7f9fc5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.538+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/1726622542 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80b1070 con 0x55d75f9ea2d0 2023-07-14T13:03:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.538+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/1726622542 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d75f88f490 con 0x55d75f9ea2d0 2023-07-14T13:03:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.538+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/1726622542 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f9fd8099b70 con 0x55d75f9ea2d0 2023-07-14T13:03:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.538+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/1726622542 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fd809dba0 con 0x55d75f9ea2d0 2023-07-14T13:03:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.538+0000 7f9ff88e0b80 10 client.26276 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.538+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/1726622542 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55d75f74cc00 con 0x55d75f9ea2d0 2023-07-14T13:03:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.538+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/1726622542 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d75f88f490 con 0x55d75f9ea2d0 2023-07-14T13:03:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.539+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/1726622542 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9fd80a1aa0 con 0x55d75f9ea2d0 2023-07-14T13:03:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.539+0000 7f9ff88e0b80 10 client.26276 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.539+0000 7f9ff88e0b80 10 client.26276 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.539+0000 7f9ff88e0b80 20 client.26276 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.539+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d75f9fdb00 0x55d75f9fff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.539+0000 7f9ff88e0b80 4 client.26276 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.539+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/1726622542 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d75f92ee50 con 0x55d75f9fdb00 2023-07-14T13:03:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.539+0000 7f9fde59c700 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d75f9fdb00 0x55d75f9fff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.540+0000 7f9fde59c700 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d75f9fdb00 0x55d75f9fff10 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=209df07fbfb9681c server_cookie=6edbfcab9de48608 in_seq=0 out_seq=0 2023-07-14T13:03:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.540+0000 7f9fc5ffb700 10 client.26276 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.540+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/1726622542 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d75f92ee50 con 0x55d75f9fdb00 2023-07-14T13:03:32.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9fc5ffb700 10 client.26276 handle_command_reply: tid=0 2023-07-14T13:03:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 1 client.26276 shutdown 2023-07-14T13:03:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/1726622542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f9ea2d0 msgr2=0x55d75f9edfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f9ea2d0 0x55d75f9edfc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80ca160 tx=0x7f9fd80997a0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/1726622542 shutdown_connections 2023-07-14T13:03:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d75f9fdb00 0x55d75f9fff10 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f9ea2d0 0x55d75f9edfc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f8406b0 0x55d75f9f0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/1726622542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9e4580 0x55d75f9ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9fc5ffb700 0 client.26276 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/1726622542 >> 172.21.15.17:0/1726622542 conn(0x55d75f9d9be0 msgr2=0x55d75f9ddc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:32.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/1726622542 shutdown_connections 2023-07-14T13:03:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/1726622542 wait complete. 2023-07-14T13:03:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.541+0000 7f9ff88e0b80 20 client.26276 trim_cache size 0 max 16384 2023-07-14T13:03:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.559+0000 7f9ff88e0b80 1 Processor -- start 2023-07-14T13:03:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.559+0000 7f9ff88e0b80 1 -- start start 2023-07-14T13:03:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.559+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f8406b0 0x55d75f9eb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.559+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f9e4580 0x55d75f9dec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.559+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9ed040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.559+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75f88f4c0 con 0x55d75f9ea2d0 2023-07-14T13:03:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.559+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75f9e9a40 con 0x55d75f9e4580 2023-07-14T13:03:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.559+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75f9e0720 con 0x55d75f8406b0 2023-07-14T13:03:32.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.560+0000 7f9fded9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.560+0000 7f9fded9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9ed040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33998/0 (socket says 172.21.15.17:33998) 2023-07-14T13:03:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.560+0000 7f9fded9d700 1 -- 172.21.15.17:0/3534557622 learned_addr learned my addr 172.21.15.17:0/3534557622 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.560+0000 7f9fddd9b700 1 --2- 172.21.15.17:0/3534557622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f9e4580 0x55d75f9dec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.560+0000 7f9fde59c700 1 --2- 172.21.15.17:0/3534557622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f8406b0 0x55d75f9eb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.560+0000 7f9fded9d700 1 -- 172.21.15.17:0/3534557622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f8406b0 msgr2=0x55d75f9eb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.560+0000 7f9fded9d700 1 --2- 172.21.15.17:0/3534557622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f8406b0 0x55d75f9eb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.560+0000 7f9fded9d700 1 -- 172.21.15.17:0/3534557622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f9e4580 msgr2=0x55d75f9dec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.560+0000 7f9fded9d700 1 --2- 172.21.15.17:0/3534557622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f9e4580 0x55d75f9dec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.560+0000 7f9fded9d700 1 -- 172.21.15.17:0/3534557622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d75f78a1f0 con 0x55d75f9ea2d0 2023-07-14T13:03:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.561+0000 7f9fded9d700 1 --2- 172.21.15.17:0/3534557622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9ed040 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8096070 tx=0x7f9fd80ca0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8065ddf9be0b25de server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.561+0000 7f9fcd7fa700 1 -- 172.21.15.17:0/3534557622 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80b1070 con 0x55d75f9ea2d0 2023-07-14T13:03:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.561+0000 7f9fcd7fa700 1 -- 172.21.15.17:0/3534557622 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9fd8099b70 con 0x55d75f9ea2d0 2023-07-14T13:03:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.561+0000 7f9fcd7fa700 1 -- 172.21.15.17:0/3534557622 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80992c0 con 0x55d75f9ea2d0 2023-07-14T13:03:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.562+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/3534557622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 msgr2=0x55d75f9ed040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.562+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/3534557622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9ed040 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8096070 tx=0x7f9fd80ca0f0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.562+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/3534557622 shutdown_connections 2023-07-14T13:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.562+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/3534557622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9ed040 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.562+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/3534557622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f8406b0 0x55d75f9eb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.562+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/3534557622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f9e4580 0x55d75f9dec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.562+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/3534557622 >> 172.21.15.17:0/3534557622 conn(0x55d75f9d9be0 msgr2=0x55d75f9e7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.562+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/3534557622 shutdown_connections 2023-07-14T13:03:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.562+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/3534557622 wait complete. 2023-07-14T13:03:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.562+0000 7f9ff88e0b80 1 -- start start 2023-07-14T13:03:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.563+0000 7f9ff88e0b80 1 Processor -- start 2023-07-14T13:03:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.563+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 0x55d75f9f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.564+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f9e4580 0x55d75f9f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.564+0000 7f9ff88e0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9f3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.564+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75f9f3a60 con 0x55d75f9ea2d0 2023-07-14T13:03:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.564+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75fa509c0 con 0x55d75f8406b0 2023-07-14T13:03:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.564+0000 7f9ff88e0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75fa50b00 con 0x55d75f9e4580 2023-07-14T13:03:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.564+0000 7f9ff88e0b80 10 client.0 _ll_register_callbacks cb 0x7f9fd8095f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.564+0000 7f9fded9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.564+0000 7f9fded9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9f3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34014/0 (socket says 172.21.15.17:34014) 2023-07-14T13:03:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.564+0000 7f9fded9d700 1 -- 172.21.15.17:0/975259580 learned_addr learned my addr 172.21.15.17:0/975259580 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.564+0000 7f9fde59c700 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 0x55d75f9f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.564+0000 7f9fddd9b700 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f9e4580 0x55d75f9f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.565+0000 7f9fded9d700 1 -- 172.21.15.17:0/975259580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f9e4580 msgr2=0x55d75f9f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.565+0000 7f9fded9d700 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f9e4580 0x55d75f9f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.565+0000 7f9fded9d700 1 -- 172.21.15.17:0/975259580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 msgr2=0x55d75f9f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.565+0000 7f9fded9d700 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 0x55d75f9f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.565+0000 7f9fded9d700 1 -- 172.21.15.17:0/975259580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d75f74cc00 con 0x55d75f9ea2d0 2023-07-14T13:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.565+0000 7f9fded9d700 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9f3390 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8099340 tx=0x7f9fd8098120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25b576cac267e97 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.565+0000 7f9fc5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.565+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/975259580 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80b1070 con 0x55d75f9ea2d0 2023-07-14T13:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/975259580 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f9fd80a1f30 con 0x55d75f9ea2d0 2023-07-14T13:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/975259580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9fd0016070 con 0x55d75f9ea2d0 2023-07-14T13:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/975259580 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fd809dba0 con 0x55d75f9ea2d0 2023-07-14T13:03:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9ff88e0b80 10 client.16557 fetch_fsmap learned FSMap version 25 2023-07-14T13:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/975259580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55d75f762250 con 0x55d75f9ea2d0 2023-07-14T13:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/975259580 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9fd0016070 con 0x55d75f9ea2d0 2023-07-14T13:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/975259580 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 25) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9fd8083370 con 0x55d75f9ea2d0 2023-07-14T13:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9ff88e0b80 10 client.16557 fetch_fsmap finished waiting for FSMap version 25 2023-07-14T13:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9ff88e0b80 10 client.16557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9ff88e0b80 20 client.16557 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d75fa51d00 0x55d75fa54110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9ff88e0b80 4 client.16557 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:03:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.566+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/975259580 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d75f8f0ff0 con 0x55d75fa51d00 2023-07-14T13:03:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.567+0000 7f9fde59c700 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d75fa51d00 0x55d75fa54110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.567+0000 7f9fde59c700 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d75fa51d00 0x55d75fa54110 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77f7f523101f886b server_cookie=ba642932220b8c7b in_seq=0 out_seq=0 2023-07-14T13:03:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.567+0000 7f9fc5ffb700 10 client.16557 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9fc5ffb700 1 -- 172.21.15.17:0/975259580 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d75f8f0ff0 con 0x55d75fa51d00 2023-07-14T13:03:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9fc5ffb700 10 client.16557 handle_command_reply: tid=0 2023-07-14T13:03:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9ff88e0b80 1 client.16557 shutdown 2023-07-14T13:03:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/975259580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 msgr2=0x55d75f9f3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9f3390 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8099340 tx=0x7f9fd8098120 comp rx=0 tx=0).stop 2023-07-14T13:03:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/975259580 shutdown_connections 2023-07-14T13:03:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d75fa51d00 0x55d75fa54110 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d75f9ea2d0 0x55d75f9f3390 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d75f8406b0 0x55d75f9f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9ff88e0b80 1 --2- 172.21.15.17:0/975259580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d75f9e4580 0x55d75f9f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/975259580 >> 172.21.15.17:0/975259580 conn(0x55d75f9d9be0 msgr2=0x55d75f9e92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9fc5ffb700 0 client.16557 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/975259580 shutdown_connections 2023-07-14T13:03:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.580+0000 7f9ff88e0b80 1 -- 172.21.15.17:0/975259580 wait complete. 2023-07-14T13:03:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9ff88e0b80 20 client.16557 trim_cache size 0 max 16384 2023-07-14T13:03:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:03:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:03:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:03:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:03:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 -- 172.21.15.17:0/531668523 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9fc80a12c0 msgr2=0x7f9fc80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9fc80a12c0 0x7f9fc80a3770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009c40 tx=0x7f9fd0009260 comp rx=0 tx=0).stop 2023-07-14T13:03:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 -- 172.21.15.17:0/531668523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fe0107010 msgr2=0x7f9fe019c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fe0107010 0x7f9fe019c940 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800ef30 tx=0x7f9fd800c450 comp rx=0 tx=0).stop 2023-07-14T13:03:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 -- 172.21.15.17:0/531668523 shutdown_connections 2023-07-14T13:03:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9fc80a12c0 0x7f9fc80a3770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fe0107010 0x7f9fe019c940 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9fe0101fd0 0x7f9fe0197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 --2- 172.21.15.17:0/531668523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe0102970 0x7f9fe01982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 -- 172.21.15.17:0/531668523 >> 172.21.15.17:0/531668523 conn(0x7f9fe00fd840 msgr2=0x7f9fe00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 -- 172.21.15.17:0/531668523 shutdown_connections 2023-07-14T13:03:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:32.581+0000 7f9fe4fff700 1 -- 172.21.15.17:0/531668523 wait complete. 2023-07-14T13:03:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:12700000 of 50000000 tuples (25%) done (elapsed 202.22 s, remaining 593.93 s) 2023-07-14T13:03:33.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:33 smithi017 ceph-mon[95536]: pgmap v117: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 22 MiB/s wr, 99 op/s 2023-07-14T13:03:33.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:33 smithi135 ceph-mon[97338]: pgmap v117: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 22 MiB/s wr, 99 op/s 2023-07-14T13:03:33.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:33 smithi131 ceph-mon[96953]: pgmap v117: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 22 MiB/s wr, 99 op/s 2023-07-14T13:03:33.919 INFO:teuthology.orchestra.run.smithi017.stderr:12800000 of 50000000 tuples (25%) done (elapsed 203.52 s, remaining 591.49 s) 2023-07-14T13:03:34.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:34 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:03:34.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:34 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:03:34.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:34 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:03:35.276 INFO:teuthology.orchestra.run.smithi017.stderr:12900000 of 50000000 tuples (25%) done (elapsed 204.88 s, remaining 589.22 s) 2023-07-14T13:03:35.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:35 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:03:35.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:35 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:03:35.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:35 smithi017 ceph-mon[95536]: pgmap v118: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 22 MiB/s wr, 99 op/s 2023-07-14T13:03:35.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:35 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:03:35.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:35 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:03:35.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:35 smithi135 ceph-mon[97338]: pgmap v118: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 22 MiB/s wr, 99 op/s 2023-07-14T13:03:35.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:35 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:03:35.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:35 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:03:35.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:35 smithi131 ceph-mon[96953]: pgmap v118: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 22 MiB/s wr, 99 op/s 2023-07-14T13:03:36.555 INFO:teuthology.orchestra.run.smithi017.stderr:13000000 of 50000000 tuples (26%) done (elapsed 206.16 s, remaining 586.76 s) 2023-07-14T13:03:37.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:37 smithi017 ceph-mon[95536]: pgmap v119: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 34 MiB/s wr, 109 op/s 2023-07-14T13:03:37.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:37 smithi135 ceph-mon[97338]: pgmap v119: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 34 MiB/s wr, 109 op/s 2023-07-14T13:03:37.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:37 smithi131 ceph-mon[96953]: pgmap v119: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 34 MiB/s wr, 109 op/s 2023-07-14T13:03:37.854 INFO:teuthology.orchestra.run.smithi017.stderr:13100000 of 50000000 tuples (26%) done (elapsed 207.46 s, remaining 584.36 s) 2023-07-14T13:03:39.238 INFO:teuthology.orchestra.run.smithi017.stderr:13200000 of 50000000 tuples (26%) done (elapsed 208.84 s, remaining 582.22 s) 2023-07-14T13:03:39.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:39 smithi017 ceph-mon[95536]: pgmap v120: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-07-14T13:03:39.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:39 smithi135 ceph-mon[97338]: pgmap v120: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-07-14T13:03:39.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:39 smithi131 ceph-mon[96953]: pgmap v120: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-07-14T13:03:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:13300000 of 50000000 tuples (26%) done (elapsed 210.12 s, remaining 579.81 s) 2023-07-14T13:03:41.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:41 smithi017 ceph-mon[95536]: pgmap v121: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 34 MiB/s wr, 25 op/s 2023-07-14T13:03:41.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:41 smithi135 ceph-mon[97338]: pgmap v121: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 34 MiB/s wr, 25 op/s 2023-07-14T13:03:41.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:41 smithi131 ceph-mon[96953]: pgmap v121: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 34 MiB/s wr, 25 op/s 2023-07-14T13:03:41.812 INFO:teuthology.orchestra.run.smithi017.stderr:13400000 of 50000000 tuples (26%) done (elapsed 211.41 s, remaining 577.45 s) 2023-07-14T13:03:43.209 INFO:teuthology.orchestra.run.smithi017.stderr:13500000 of 50000000 tuples (27%) done (elapsed 212.81 s, remaining 575.38 s) 2023-07-14T13:03:43.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:43 smithi017 ceph-mon[95536]: pgmap v122: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 MiB/s wr, 17 op/s 2023-07-14T13:03:43.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:43 smithi135 ceph-mon[97338]: pgmap v122: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 MiB/s wr, 17 op/s 2023-07-14T13:03:43.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:43 smithi131 ceph-mon[96953]: pgmap v122: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 MiB/s wr, 17 op/s 2023-07-14T13:03:44.502 INFO:teuthology.orchestra.run.smithi017.stderr:13600000 of 50000000 tuples (27%) done (elapsed 214.11 s, remaining 573.05 s) 2023-07-14T13:03:45.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:45 smithi017 ceph-mon[95536]: pgmap v123: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 MiB/s wr, 17 op/s 2023-07-14T13:03:45.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:45 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:03:45.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:45 smithi135 ceph-mon[97338]: pgmap v123: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 MiB/s wr, 17 op/s 2023-07-14T13:03:45.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:45 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:03:45.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:45 smithi131 ceph-mon[96953]: pgmap v123: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 MiB/s wr, 17 op/s 2023-07-14T13:03:45.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:45 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:03:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.768+0000 7fd19a5ff700 1 -- 172.21.15.17:0/1327162758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd19410c350 msgr2=0x7fd19410e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.768+0000 7fd19a5ff700 1 --2- 172.21.15.17:0/1327162758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd19410c350 0x7fd19410e730 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00b0a0 tx=0x7fd18c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.768+0000 7fd19a5ff700 1 -- 172.21.15.17:0/1327162758 shutdown_connections 2023-07-14T13:03:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.768+0000 7fd19a5ff700 1 --2- 172.21.15.17:0/1327162758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd19410c350 0x7fd19410e730 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.768+0000 7fd19a5ff700 1 --2- 172.21.15.17:0/1327162758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940728b0 0x7fd194072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.768+0000 7fd19a5ff700 1 --2- 172.21.15.17:0/1327162758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1940731c0 0x7fd19410be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.768+0000 7fd19a5ff700 1 -- 172.21.15.17:0/1327162758 >> 172.21.15.17:0/1327162758 conn(0x7fd1940fb5f0 msgr2=0x7fd1940fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.768+0000 7fd19a5ff700 1 -- 172.21.15.17:0/1327162758 shutdown_connections 2023-07-14T13:03:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.768+0000 7fd19a5ff700 1 -- 172.21.15.17:0/1327162758 wait complete. 2023-07-14T13:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.769+0000 7fd19a5ff700 1 Processor -- start 2023-07-14T13:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.769+0000 7fd19a5ff700 1 -- start start 2023-07-14T13:03:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd19a5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1940728b0 0x7fd194197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd19a5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940731c0 0x7fd194198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd19a5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd19410c350 0x7fd19419c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd19a5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19419d010 con 0x7fd19410c350 2023-07-14T13:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd19a5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19419d180 con 0x7fd1940728b0 2023-07-14T13:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd19a5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19419d340 con 0x7fd1940731c0 2023-07-14T13:03:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd198b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd19410c350 0x7fd19419c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd198b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd19410c350 0x7fd19419c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40796/0 (socket says 172.21.15.17:40796) 2023-07-14T13:03:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd193fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1940728b0 0x7fd194197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd198b9c700 1 -- 172.21.15.17:0/691492383 learned_addr learned my addr 172.21.15.17:0/691492383 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd1937fe700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940731c0 0x7fd194198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd198b9c700 1 -- 172.21.15.17:0/691492383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940731c0 msgr2=0x7fd194198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd198b9c700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940731c0 0x7fd194198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd198b9c700 1 -- 172.21.15.17:0/691492383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1940728b0 msgr2=0x7fd194197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:45.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd198b9c700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1940728b0 0x7fd194197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.770+0000 7fd198b9c700 1 -- 172.21.15.17:0/691492383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c009d00 con 0x7fd19410c350 2023-07-14T13:03:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.771+0000 7fd198b9c700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd19410c350 0x7fd19419c9d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00b070 tx=0x7fd18c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.771+0000 7fd1917fa700 1 -- 172.21.15.17:0/691492383 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00e040 con 0x7fd19410c350 2023-07-14T13:03:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.771+0000 7fd19a5ff700 1 -- 172.21.15.17:0/691492383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19419d5c0 con 0x7fd19410c350 2023-07-14T13:03:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.771+0000 7fd1917fa700 1 -- 172.21.15.17:0/691492383 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd18c009480 con 0x7fd19410c350 2023-07-14T13:03:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.771+0000 7fd1917fa700 1 -- 172.21.15.17:0/691492383 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c005040 con 0x7fd19410c350 2023-07-14T13:03:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.771+0000 7fd19a5ff700 1 -- 172.21.15.17:0/691492383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1941a4e60 con 0x7fd19410c350 2023-07-14T13:03:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.775+0000 7fd1917fa700 1 -- 172.21.15.17:0/691492383 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd18c01d480 con 0x7fd19410c350 2023-07-14T13:03:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.777+0000 7fd1adeb0b80 1 Processor -- start 2023-07-14T13:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.777+0000 7fd1adeb0b80 1 -- start start 2023-07-14T13:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.777+0000 7fd1917fa700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd17c0a12c0 0x7fd17c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.778+0000 7fd1917fa700 1 -- 172.21.15.17:0/691492383 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd18c0ce040 con 0x7fd19410c350 2023-07-14T13:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.778+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec5663d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.778+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec56642d0 0x55cec565e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.778+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 0x55cec565e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.778+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec5563c50 con 0x55cec565e580 2023-07-14T13:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.778+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec55b69e0 con 0x55cec56642d0 2023-07-14T13:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.778+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec55afe70 con 0x55cec54ba6b0 2023-07-14T13:03:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.778+0000 7fd1937fe700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd17c0a12c0 0x7fd17c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.778+0000 7fd198b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 0x55cec565e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.778+0000 7fd198b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 0x55cec565e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40808/0 (socket says 172.21.15.17:40808) 2023-07-14T13:03:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.778+0000 7fd198b9c700 1 -- 172.21.15.17:0/3067428785 learned_addr learned my addr 172.21.15.17:0/3067428785 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.779+0000 7fd1937fe700 1 --2- 172.21.15.17:0/3067428785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec56642d0 0x55cec565e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.779+0000 7fd193fff700 1 --2- 172.21.15.17:0/3067428785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec5663d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.779+0000 7fd198b9c700 1 -- 172.21.15.17:0/3067428785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 msgr2=0x55cec5663d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.779+0000 7fd198b9c700 1 --2- 172.21.15.17:0/3067428785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec5663d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.779+0000 7fd198b9c700 1 -- 172.21.15.17:0/3067428785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec56642d0 msgr2=0x55cec565e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.779+0000 7fd198b9c700 1 --2- 172.21.15.17:0/3067428785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec56642d0 0x55cec565e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.779+0000 7fd1937fe700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd17c0a12c0 0x7fd17c0a3770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd194199640 tx=0x7fd188012780 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.779+0000 7fd198b9c700 1 -- 172.21.15.17:0/3067428785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cec53ddd80 con 0x55cec565e580 2023-07-14T13:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.779+0000 7fd198b9c700 1 --2- 172.21.15.17:0/3067428785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 0x55cec565e9d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0a3040 tx=0x7fd18c097620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df98a4c73e752e03 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.780+0000 7fd17a7fc700 1 -- 172.21.15.17:0/3067428785 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c09b1b0 con 0x55cec565e580 2023-07-14T13:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.780+0000 7fd17a7fc700 1 -- 172.21.15.17:0/3067428785 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd18c09f1e0 con 0x55cec565e580 2023-07-14T13:03:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.780+0000 7fd17a7fc700 1 -- 172.21.15.17:0/3067428785 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c09b650 con 0x55cec565e580 2023-07-14T13:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.781+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/3067428785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 msgr2=0x55cec565e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.781+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/3067428785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 0x55cec565e9d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0a3040 tx=0x7fd18c097620 comp rx=0 tx=0).stop 2023-07-14T13:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.781+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/3067428785 shutdown_connections 2023-07-14T13:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.781+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/3067428785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 0x55cec565e9d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.781+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/3067428785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec5663d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.781+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/3067428785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec56642d0 0x55cec565e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.781+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/3067428785 >> 172.21.15.17:0/3067428785 conn(0x55cec5653be0 msgr2=0x55cec5658f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.781+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/3067428785 shutdown_connections 2023-07-14T13:03:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.781+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/3067428785 wait complete. 2023-07-14T13:03:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.781+0000 7fd1adeb0b80 1 -- start start 2023-07-14T13:03:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.782+0000 7fd1adeb0b80 1 Processor -- start 2023-07-14T13:03:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.782+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec54ba6b0 0x55cec566d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.782+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec565e580 0x55cec566da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.782+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec56642d0 0x55cec5667710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.782+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec554fa60 con 0x55cec54ba6b0 2023-07-14T13:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.782+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec554f760 con 0x55cec565e580 2023-07-14T13:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.782+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec54338c0 con 0x55cec56642d0 2023-07-14T13:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.782+0000 7fd1adeb0b80 10 client.0 _ll_register_callbacks cb 0x55cec554d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.783+0000 7fd193fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec54ba6b0 0x55cec566d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.783+0000 7fd193fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec54ba6b0 0x55cec566d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40822/0 (socket says 172.21.15.17:40822) 2023-07-14T13:03:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.783+0000 7fd193fff700 1 -- 172.21.15.17:0/1032679532 learned_addr learned my addr 172.21.15.17:0/1032679532 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.783+0000 7fd198b9c700 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec56642d0 0x55cec5667710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.783+0000 7fd193fff700 1 -- 172.21.15.17:0/1032679532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec56642d0 msgr2=0x55cec5667710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.783+0000 7fd193fff700 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec56642d0 0x55cec5667710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.783+0000 7fd193fff700 1 -- 172.21.15.17:0/1032679532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec565e580 msgr2=0x55cec566da00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:03:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.783+0000 7fd193fff700 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec565e580 0x55cec566da00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.783+0000 7fd193fff700 1 -- 172.21.15.17:0/1032679532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1941a4e60 con 0x55cec54ba6b0 2023-07-14T13:03:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.783+0000 7fd198b9c700 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec56642d0 0x55cec5667710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.784+0000 7fd193fff700 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec54ba6b0 0x55cec566d4c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd184012860 tx=0x7fd184012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30048e84b63fb45a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.784+0000 7fd1737fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:45.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.784+0000 7fd1737fe700 1 -- 172.21.15.17:0/1032679532 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184017070 con 0x55cec54ba6b0 2023-07-14T13:03:45.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.784+0000 7fd1737fe700 1 -- 172.21.15.17:0/1032679532 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd18400f5e0 con 0x55cec54ba6b0 2023-07-14T13:03:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.784+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1032679532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cec5509490 con 0x55cec54ba6b0 2023-07-14T13:03:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.784+0000 7fd1737fe700 1 -- 172.21.15.17:0/1032679532 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1840122e0 con 0x55cec54ba6b0 2023-07-14T13:03:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.784+0000 7fd1adeb0b80 10 client.16569 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.784+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1032679532 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cec53c6c00 con 0x55cec54ba6b0 2023-07-14T13:03:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.785+0000 7fd1737fe700 1 -- 172.21.15.17:0/1032679532 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cec5509490 con 0x55cec54ba6b0 2023-07-14T13:03:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.785+0000 7fd1737fe700 1 -- 172.21.15.17:0/1032679532 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fd184010820 con 0x55cec54ba6b0 2023-07-14T13:03:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.785+0000 7fd1adeb0b80 10 client.16569 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.785+0000 7fd1adeb0b80 10 client.16569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.785+0000 7fd1adeb0b80 20 client.16569 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.785+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cec5677a80 0x55cec5679e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.785+0000 7fd1adeb0b80 4 client.16569 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.785+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1032679532 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cec55a8e50 con 0x55cec5677a80 2023-07-14T13:03:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.786+0000 7fd1937fe700 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cec5677a80 0x55cec5679e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.786+0000 7fd1937fe700 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cec5677a80 0x55cec5679e90 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=544a740d76e9d176 server_cookie=bd63a2fc3b3721f2 in_seq=0 out_seq=0 2023-07-14T13:03:45.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.786+0000 7fd1737fe700 10 client.16569 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:45.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1737fe700 1 -- 172.21.15.17:0/1032679532 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cec55a8e50 con 0x55cec5677a80 2023-07-14T13:03:45.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1737fe700 10 client.16569 handle_command_reply: tid=0 2023-07-14T13:03:45.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1adeb0b80 1 client.16569 shutdown 2023-07-14T13:03:45.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1032679532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec54ba6b0 msgr2=0x55cec566d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:45.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec54ba6b0 0x55cec566d4c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd184012860 tx=0x7fd184012b70 comp rx=0 tx=0).stop 2023-07-14T13:03:45.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1032679532 shutdown_connections 2023-07-14T13:03:45.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cec5677a80 0x55cec5679e90 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec56642d0 0x55cec5667710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec54ba6b0 0x55cec566d4c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1032679532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec565e580 0x55cec566da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1032679532 >> 172.21.15.17:0/1032679532 conn(0x55cec5653be0 msgr2=0x55cec56584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.787+0000 7fd1737fe700 0 client.16569 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.788+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1032679532 shutdown_connections 2023-07-14T13:03:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.788+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1032679532 wait complete. 2023-07-14T13:03:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.788+0000 7fd1adeb0b80 20 client.16569 trim_cache size 0 max 16384 2023-07-14T13:03:45.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd1adeb0b80 1 Processor -- start 2023-07-14T13:03:45.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd1adeb0b80 1 -- start start 2023-07-14T13:03:45.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec565e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec565e580 0x55cec5663190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec56642d0 0x55cec5658c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec5668cf0 con 0x55cec56642d0 2023-07-14T13:03:45.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec5663990 con 0x55cec565e580 2023-07-14T13:03:45.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec5662670 con 0x55cec54ba6b0 2023-07-14T13:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd198b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec56642d0 0x55cec5658c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd193fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec565e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd1937fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec565e580 0x55cec5663190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd193fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec565e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:46664/0 (socket says 172.21.15.17:46664) 2023-07-14T13:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd198b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec56642d0 0x55cec5658c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40832/0 (socket says 172.21.15.17:40832) 2023-07-14T13:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd1937fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec565e580 0x55cec5663190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41782/0 (socket says 172.21.15.17:41782) 2023-07-14T13:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.809+0000 7fd193fff700 1 -- 172.21.15.17:0/454920520 learned_addr learned my addr 172.21.15.17:0/454920520 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.810+0000 7fd1937fe700 1 -- 172.21.15.17:0/454920520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 msgr2=0x55cec565e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.810+0000 7fd1937fe700 1 --2- 172.21.15.17:0/454920520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec565e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.810+0000 7fd1937fe700 1 -- 172.21.15.17:0/454920520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec56642d0 msgr2=0x55cec5658c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.810+0000 7fd1937fe700 1 --2- 172.21.15.17:0/454920520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec56642d0 0x55cec5658c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.810+0000 7fd1937fe700 1 -- 172.21.15.17:0/454920520 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cec54041f0 con 0x55cec565e580 2023-07-14T13:03:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.810+0000 7fd1937fe700 1 --2- 172.21.15.17:0/454920520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec565e580 0x55cec5663190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55cec5668cc0 tx=0x7fd18801d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dd1ac0da9a7a8c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.810+0000 7fd17affd700 1 -- 172.21.15.17:0/454920520 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188017070 con 0x55cec565e580 2023-07-14T13:03:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.811+0000 7fd17affd700 1 -- 172.21.15.17:0/454920520 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd188025040 con 0x55cec565e580 2023-07-14T13:03:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.811+0000 7fd17affd700 1 -- 172.21.15.17:0/454920520 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188013ea0 con 0x55cec565e580 2023-07-14T13:03:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.811+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/454920520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec565e580 msgr2=0x55cec5663190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.811+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/454920520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec565e580 0x55cec5663190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55cec5668cc0 tx=0x7fd18801d000 comp rx=0 tx=0).stop 2023-07-14T13:03:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.811+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/454920520 shutdown_connections 2023-07-14T13:03:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.811+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/454920520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec56642d0 0x55cec5658c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.811+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/454920520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec565e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.811+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/454920520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec565e580 0x55cec5663190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.811+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/454920520 >> 172.21.15.17:0/454920520 conn(0x55cec5653be0 msgr2=0x55cec5662a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.811+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/454920520 shutdown_connections 2023-07-14T13:03:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.812+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/454920520 wait complete. 2023-07-14T13:03:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.812+0000 7fd1adeb0b80 1 -- start start 2023-07-14T13:03:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.812+0000 7fd1adeb0b80 1 Processor -- start 2023-07-14T13:03:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.813+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec566d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.813+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 0x55cec566d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.813+0000 7fd1adeb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec56642d0 0x55cec566b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.813+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec566bc90 con 0x55cec565e580 2023-07-14T13:03:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.813+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec566be00 con 0x55cec56642d0 2023-07-14T13:03:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.813+0000 7fd1adeb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cec566bfc0 con 0x55cec54ba6b0 2023-07-14T13:03:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.813+0000 7fd1adeb0b80 10 client.0 _ll_register_callbacks cb 0x7fd184009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd193fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec566d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd193fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec566d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:46670/0 (socket says 172.21.15.17:46670) 2023-07-14T13:03:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd193fff700 1 -- 172.21.15.17:0/1141771614 learned_addr learned my addr 172.21.15.17:0/1141771614 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd198b9c700 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec56642d0 0x55cec566b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd1937fe700 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 0x55cec566d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd1937fe700 1 -- 172.21.15.17:0/1141771614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 msgr2=0x55cec566d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd1937fe700 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec566d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd1937fe700 1 -- 172.21.15.17:0/1141771614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec56642d0 msgr2=0x55cec566b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd1937fe700 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec56642d0 0x55cec566b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd1937fe700 1 -- 172.21.15.17:0/1141771614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd188004040 con 0x55cec565e580 2023-07-14T13:03:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd193fff700 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec566d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.814+0000 7fd198b9c700 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec56642d0 0x55cec566b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.815+0000 7fd1937fe700 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 0x55cec566d710 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x55cec5668760 tx=0x7fd1880057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52365ed69640886e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.815+0000 7fd1737fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.815+0000 7fd1737fe700 1 -- 172.21.15.17:0/1141771614 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188034070 con 0x55cec565e580 2023-07-14T13:03:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.815+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1141771614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd18c09f1e0 con 0x55cec565e580 2023-07-14T13:03:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.815+0000 7fd1737fe700 1 -- 172.21.15.17:0/1141771614 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd188003c60 con 0x55cec565e580 2023-07-14T13:03:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.815+0000 7fd1737fe700 1 -- 172.21.15.17:0/1141771614 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd188017040 con 0x55cec565e580 2023-07-14T13:03:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.815+0000 7fd1adeb0b80 10 client.16575 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.815+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1141771614 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cec53dc250 con 0x55cec565e580 2023-07-14T13:03:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.815+0000 7fd1737fe700 1 -- 172.21.15.17:0/1141771614 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd18c09f1e0 con 0x55cec565e580 2023-07-14T13:03:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.816+0000 7fd1737fe700 1 -- 172.21.15.17:0/1141771614 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fd188037030 con 0x55cec565e580 2023-07-14T13:03:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.816+0000 7fd1adeb0b80 10 client.16575 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.816+0000 7fd1adeb0b80 10 client.16575 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.816+0000 7fd1adeb0b80 20 client.16575 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.816+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cec56cca80 0x55cec56cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.816+0000 7fd1adeb0b80 4 client.16575 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:03:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.816+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1141771614 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cec556aff0 con 0x55cec56cca80 2023-07-14T13:03:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.816+0000 7fd193fff700 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cec56cca80 0x55cec56cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.817+0000 7fd193fff700 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cec56cca80 0x55cec56cee90 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49e9844adc33f118 server_cookie=3f6f7fde64aa962f in_seq=0 out_seq=0 2023-07-14T13:03:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.817+0000 7fd1737fe700 10 client.16575 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1737fe700 1 -- 172.21.15.17:0/1141771614 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cec556aff0 con 0x55cec56cca80 2023-07-14T13:03:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1737fe700 10 client.16575 handle_command_reply: tid=0 2023-07-14T13:03:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1adeb0b80 1 client.16575 shutdown 2023-07-14T13:03:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1141771614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 msgr2=0x55cec566d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 0x55cec566d710 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x55cec5668760 tx=0x7fd1880057d0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1141771614 shutdown_connections 2023-07-14T13:03:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55cec56cca80 0x55cec56cee90 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec56642d0 0x55cec566b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cec54ba6b0 0x55cec566d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1737fe700 0 client.16575 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1adeb0b80 1 --2- 172.21.15.17:0/1141771614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cec565e580 0x55cec566d710 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1141771614 >> 172.21.15.17:0/1141771614 conn(0x55cec5653be0 msgr2=0x55cec5663180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1141771614 shutdown_connections 2023-07-14T13:03:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.830+0000 7fd1adeb0b80 1 -- 172.21.15.17:0/1141771614 wait complete. 2023-07-14T13:03:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.831+0000 7fd1adeb0b80 20 client.16575 trim_cache size 0 max 16384 2023-07-14T13:03:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:03:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:03:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:03:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:03:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.831+0000 7fd19a5ff700 1 -- 172.21.15.17:0/691492383 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd17c0a12c0 msgr2=0x7fd17c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.831+0000 7fd19a5ff700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd17c0a12c0 0x7fd17c0a3770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd194199640 tx=0x7fd188012780 comp rx=0 tx=0).stop 2023-07-14T13:03:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.831+0000 7fd19a5ff700 1 -- 172.21.15.17:0/691492383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd19410c350 msgr2=0x7fd19419c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.831+0000 7fd19a5ff700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd19410c350 0x7fd19419c9d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00b070 tx=0x7fd18c00bce0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.831+0000 7fd19a5ff700 1 -- 172.21.15.17:0/691492383 shutdown_connections 2023-07-14T13:03:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.831+0000 7fd19a5ff700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd17c0a12c0 0x7fd17c0a3770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.831+0000 7fd19a5ff700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd19410c350 0x7fd19419c9d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.831+0000 7fd19a5ff700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1940728b0 0x7fd194197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.831+0000 7fd19a5ff700 1 --2- 172.21.15.17:0/691492383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1940731c0 0x7fd194198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.831+0000 7fd19a5ff700 1 -- 172.21.15.17:0/691492383 >> 172.21.15.17:0/691492383 conn(0x7fd1940fb5f0 msgr2=0x7fd19410e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.832+0000 7fd19a5ff700 1 -- 172.21.15.17:0/691492383 shutdown_connections 2023-07-14T13:03:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:45.832+0000 7fd19a5ff700 1 -- 172.21.15.17:0/691492383 wait complete. 2023-07-14T13:03:45.964 INFO:teuthology.orchestra.run.smithi017.stderr:13700000 of 50000000 tuples (27%) done (elapsed 215.57 s, remaining 571.17 s) 2023-07-14T13:03:47.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:47 smithi017 ceph-mon[95536]: pgmap v124: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 34 MiB/s wr, 28 op/s 2023-07-14T13:03:47.418 INFO:teuthology.orchestra.run.smithi017.stderr:13800000 of 50000000 tuples (27%) done (elapsed 217.02 s, remaining 569.29 s) 2023-07-14T13:03:47.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:47 smithi135 ceph-mon[97338]: pgmap v124: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 34 MiB/s wr, 28 op/s 2023-07-14T13:03:47.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:47 smithi131 ceph-mon[96953]: pgmap v124: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 34 MiB/s wr, 28 op/s 2023-07-14T13:03:48.699 INFO:teuthology.orchestra.run.smithi017.stderr:13900000 of 50000000 tuples (27%) done (elapsed 218.30 s, remaining 566.96 s) 2023-07-14T13:03:49.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:49 smithi017 ceph-mon[95536]: pgmap v125: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-07-14T13:03:49.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:49 smithi135 ceph-mon[97338]: pgmap v125: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-07-14T13:03:49.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:49 smithi131 ceph-mon[96953]: pgmap v125: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-07-14T13:03:49.988 INFO:teuthology.orchestra.run.smithi017.stderr:14000000 of 50000000 tuples (28%) done (elapsed 219.59 s, remaining 564.66 s) 2023-07-14T13:03:51.276 INFO:teuthology.orchestra.run.smithi017.stderr:14100000 of 50000000 tuples (28%) done (elapsed 220.88 s, remaining 562.38 s) 2023-07-14T13:03:51.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:51 smithi017 ceph-mon[95536]: pgmap v126: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 33 MiB/s wr, 45 op/s 2023-07-14T13:03:51.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:51 smithi135 ceph-mon[97338]: pgmap v126: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 33 MiB/s wr, 45 op/s 2023-07-14T13:03:51.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:51 smithi131 ceph-mon[96953]: pgmap v126: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 33 MiB/s wr, 45 op/s 2023-07-14T13:03:52.652 INFO:teuthology.orchestra.run.smithi017.stderr:14200000 of 50000000 tuples (28%) done (elapsed 222.25 s, remaining 560.33 s) 2023-07-14T13:03:53.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:53 smithi017 ceph-mon[95536]: pgmap v127: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 22 MiB/s wr, 37 op/s 2023-07-14T13:03:53.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:53 smithi135 ceph-mon[97338]: pgmap v127: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 22 MiB/s wr, 37 op/s 2023-07-14T13:03:53.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:53 smithi131 ceph-mon[96953]: pgmap v127: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 22 MiB/s wr, 37 op/s 2023-07-14T13:03:53.949 INFO:teuthology.orchestra.run.smithi017.stderr:14300000 of 50000000 tuples (28%) done (elapsed 223.55 s, remaining 558.10 s) 2023-07-14T13:03:54.977 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:03:55.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.174+0000 7fdd907ff700 1 -- 172.21.15.17:0/2946320667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd880731c0 msgr2=0x7fdd8810bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.174+0000 7fdd907ff700 1 --2- 172.21.15.17:0/2946320667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd880731c0 0x7fdd8810bdd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009990 tx=0x7fdd78009ca0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.175+0000 7fdd907ff700 1 -- 172.21.15.17:0/2946320667 shutdown_connections 2023-07-14T13:03:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.175+0000 7fdd907ff700 1 --2- 172.21.15.17:0/2946320667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd8810c310 0x7fdd8810e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.175+0000 7fdd907ff700 1 --2- 172.21.15.17:0/2946320667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd880728b0 0x7fdd88072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.175+0000 7fdd907ff700 1 --2- 172.21.15.17:0/2946320667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd880731c0 0x7fdd8810bdd0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.175+0000 7fdd907ff700 1 -- 172.21.15.17:0/2946320667 >> 172.21.15.17:0/2946320667 conn(0x7fdd880fb5f0 msgr2=0x7fdd880fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.175+0000 7fdd907ff700 1 -- 172.21.15.17:0/2946320667 shutdown_connections 2023-07-14T13:03:55.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.175+0000 7fdd907ff700 1 -- 172.21.15.17:0/2946320667 wait complete. 2023-07-14T13:03:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.176+0000 7fdd907ff700 1 Processor -- start 2023-07-14T13:03:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.176+0000 7fdd907ff700 1 -- start start 2023-07-14T13:03:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.177+0000 7fdd907ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd880728b0 0x7fdd88197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.177+0000 7fdd907ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd880731c0 0x7fdd88198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.177+0000 7fdd907ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd8810c310 0x7fdd8819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.177+0000 7fdd907ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8819cd00 con 0x7fdd880728b0 2023-07-14T13:03:55.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.177+0000 7fdd907ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8819ce70 con 0x7fdd8810c310 2023-07-14T13:03:55.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.177+0000 7fdd907ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8819d030 con 0x7fdd880731c0 2023-07-14T13:03:55.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.177+0000 7fdd8e59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd880728b0 0x7fdd88197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.177+0000 7fdd8e59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd880728b0 0x7fdd88197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43188/0 (socket says 172.21.15.17:43188) 2023-07-14T13:03:55.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.177+0000 7fdd8e59b700 1 -- 172.21.15.17:0/3985727323 learned_addr learned my addr 172.21.15.17:0/3985727323 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:55.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.177+0000 7fdd8dd9a700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd880731c0 0x7fdd88198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.177+0000 7fdd8ed9c700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd8810c310 0x7fdd8819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.178+0000 7fdd8e59b700 1 -- 172.21.15.17:0/3985727323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd880731c0 msgr2=0x7fdd88198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.178+0000 7fdd8e59b700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd880731c0 0x7fdd88198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.178+0000 7fdd8e59b700 1 -- 172.21.15.17:0/3985727323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd8810c310 msgr2=0x7fdd8819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.178+0000 7fdd8e59b700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd8810c310 0x7fdd8819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.178+0000 7fdd8e59b700 1 -- 172.21.15.17:0/3985727323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd780095f0 con 0x7fdd880728b0 2023-07-14T13:03:55.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.178+0000 7fdd8e59b700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd880728b0 0x7fdd88197d20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400e9a0 tx=0x7fdd8400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:55.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.178+0000 7fdd7f7fe700 1 -- 172.21.15.17:0/3985727323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84009790 con 0x7fdd880728b0 2023-07-14T13:03:55.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.178+0000 7fdd907ff700 1 -- 172.21.15.17:0/3985727323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8819d310 con 0x7fdd880728b0 2023-07-14T13:03:55.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.178+0000 7fdd7f7fe700 1 -- 172.21.15.17:0/3985727323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd84010430 con 0x7fdd880728b0 2023-07-14T13:03:55.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.178+0000 7fdd7f7fe700 1 -- 172.21.15.17:0/3985727323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400cea0 con 0x7fdd880728b0 2023-07-14T13:03:55.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.178+0000 7fdd907ff700 1 -- 172.21.15.17:0/3985727323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd881a4b50 con 0x7fdd880728b0 2023-07-14T13:03:55.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.182+0000 7fdd7f7fe700 1 -- 172.21.15.17:0/3985727323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fdd840105a0 con 0x7fdd880728b0 2023-07-14T13:03:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.184+0000 7fdda41a4b80 1 Processor -- start 2023-07-14T13:03:55.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.184+0000 7fdda41a4b80 1 -- start start 2023-07-14T13:03:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdd7f7fe700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdd740a12c0 0x7fdd740a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5583652862d0 0x5583652866a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558365286be0 0x558365291590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 0x558365293eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdd7f7fe700 1 -- 172.21.15.17:0/3985727323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdd84014070 con 0x7fdd880728b0 2023-07-14T13:03:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836518ccb0 con 0x5583652862d0 2023-07-14T13:03:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583651dfa40 con 0x558365286be0 2023-07-14T13:03:55.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583651d8ed0 con 0x558365291ad0 2023-07-14T13:03:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdd8ed9c700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdd740a12c0 0x7fdd740a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdd8ed9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 0x558365293eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdd8ed9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 0x558365293eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:32850/0 (socket says 172.21.15.17:32850) 2023-07-14T13:03:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdd8ed9c700 1 -- 172.21.15.17:0/2127511338 learned_addr learned my addr 172.21.15.17:0/2127511338 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.185+0000 7fdd8dd9a700 1 --2- 172.21.15.17:0/2127511338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558365286be0 0x558365291590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.186+0000 7fdd8e59b700 1 --2- 172.21.15.17:0/2127511338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5583652862d0 0x5583652866a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.186+0000 7fdd8ed9c700 1 -- 172.21.15.17:0/2127511338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558365286be0 msgr2=0x558365291590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.186+0000 7fdd8ed9c700 1 --2- 172.21.15.17:0/2127511338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558365286be0 0x558365291590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.186+0000 7fdd8ed9c700 1 -- 172.21.15.17:0/2127511338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5583652862d0 msgr2=0x5583652866a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.186+0000 7fdd8ed9c700 1 --2- 172.21.15.17:0/2127511338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5583652862d0 0x5583652866a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.186+0000 7fdd8ed9c700 1 -- 172.21.15.17:0/2127511338 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558365006de0 con 0x558365291ad0 2023-07-14T13:03:55.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.186+0000 7fdd8ed9c700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdd740a12c0 0x7fdd740a3770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009550 tx=0x7fdd80009380 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:55.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.186+0000 7fdd8ed9c700 1 --2- 172.21.15.17:0/2127511338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 0x558365293eb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd8001aa50 tx=0x7fdd8001d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f7c575e7aa867d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:55.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.187+0000 7fdd7cff9700 1 -- 172.21.15.17:0/2127511338 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000e070 con 0x558365291ad0 2023-07-14T13:03:55.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.187+0000 7fdd7cff9700 1 -- 172.21.15.17:0/2127511338 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd8000f040 con 0x558365291ad0 2023-07-14T13:03:55.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.187+0000 7fdd7cff9700 1 -- 172.21.15.17:0/2127511338 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8001b9c0 con 0x558365291ad0 2023-07-14T13:03:55.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.188+0000 7fdda41a4b80 1 -- 172.21.15.17:0/2127511338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 msgr2=0x558365293eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.188+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/2127511338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 0x558365293eb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdd8001aa50 tx=0x7fdd8001d000 comp rx=0 tx=0).stop 2023-07-14T13:03:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.188+0000 7fdda41a4b80 1 -- 172.21.15.17:0/2127511338 shutdown_connections 2023-07-14T13:03:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.188+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/2127511338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 0x558365293eb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.188+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/2127511338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5583652862d0 0x5583652866a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.188+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/2127511338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558365286be0 0x558365291590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.188+0000 7fdda41a4b80 1 -- 172.21.15.17:0/2127511338 >> 172.21.15.17:0/2127511338 conn(0x55836527cda0 msgr2=0x5583652826a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.188+0000 7fdda41a4b80 1 -- 172.21.15.17:0/2127511338 shutdown_connections 2023-07-14T13:03:55.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.188+0000 7fdda41a4b80 1 -- 172.21.15.17:0/2127511338 wait complete. 2023-07-14T13:03:55.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.188+0000 7fdda41a4b80 1 -- start start 2023-07-14T13:03:55.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.189+0000 7fdda41a4b80 1 Processor -- start 2023-07-14T13:03:55.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.189+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583652862d0 0x558365291510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.189+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365286be0 0x55836528e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.189+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365291ad0 0x55836528eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.189+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558365178ac0 con 0x558365291ad0 2023-07-14T13:03:55.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.189+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583651787c0 con 0x5583652862d0 2023-07-14T13:03:55.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.189+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836505c920 con 0x558365286be0 2023-07-14T13:03:55.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.189+0000 7fdda41a4b80 10 client.0 _ll_register_callbacks cb 0x558365176760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:55.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.190+0000 7fdd8ed9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365291ad0 0x55836528eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.190+0000 7fdd8e59b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583652862d0 0x558365291510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.190+0000 7fdd8dd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365286be0 0x55836528e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.190+0000 7fdd8ed9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365291ad0 0x55836528eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43208/0 (socket says 172.21.15.17:43208) 2023-07-14T13:03:55.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.190+0000 7fdd8ed9c700 1 -- 172.21.15.17:0/1527757878 learned_addr learned my addr 172.21.15.17:0/1527757878 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:55.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.190+0000 7fdd8dd9a700 1 -- 172.21.15.17:0/1527757878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583652862d0 msgr2=0x558365291510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:55.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.190+0000 7fdd8dd9a700 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583652862d0 0x558365291510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.190+0000 7fdd8dd9a700 1 -- 172.21.15.17:0/1527757878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365291ad0 msgr2=0x55836528eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:55.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.190+0000 7fdd8dd9a700 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365291ad0 0x55836528eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.190+0000 7fdd8dd9a700 1 -- 172.21.15.17:0/1527757878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd80008dd0 con 0x558365286be0 2023-07-14T13:03:55.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.190+0000 7fdd8ed9c700 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365291ad0 0x55836528eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:55.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.191+0000 7fdd8dd9a700 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365286be0 0x55836528e790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdd78005910 tx=0x7fdd780057e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a445ca59b2bb0010 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:55.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.191+0000 7fdd71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:03:55.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.191+0000 7fdd71ffb700 1 -- 172.21.15.17:0/1527757878 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7801d070 con 0x558365286be0 2023-07-14T13:03:55.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.191+0000 7fdda41a4b80 1 -- 172.21.15.17:0/1527757878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583651324f0 con 0x558365286be0 2023-07-14T13:03:55.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.191+0000 7fdd71ffb700 1 -- 172.21.15.17:0/1527757878 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdd78004500 con 0x558365286be0 2023-07-14T13:03:55.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.191+0000 7fdd71ffb700 1 -- 172.21.15.17:0/1527757878 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd780046c0 con 0x558365286be0 2023-07-14T13:03:55.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.191+0000 7fdda41a4b80 10 client.26281 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:55.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.191+0000 7fdda41a4b80 1 -- 172.21.15.17:0/1527757878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558364fefc60 con 0x558365286be0 2023-07-14T13:03:55.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.192+0000 7fdd71ffb700 1 -- 172.21.15.17:0/1527757878 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5583651324f0 con 0x558365286be0 2023-07-14T13:03:55.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.192+0000 7fdd71ffb700 1 -- 172.21.15.17:0/1527757878 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fdd7800f800 con 0x558365286be0 2023-07-14T13:03:55.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.192+0000 7fdda41a4b80 10 client.26281 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:55.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.192+0000 7fdda41a4b80 10 client.26281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:55.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.192+0000 7fdda41a4b80 20 client.26281 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:55.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.192+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5583652a1470 0x5583652a3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.192+0000 7fdda41a4b80 4 client.26281 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:55.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.192+0000 7fdda41a4b80 1 -- 172.21.15.17:0/1527757878 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5583651d1eb0 con 0x5583652a1470 2023-07-14T13:03:55.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.192+0000 7fdd8e59b700 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5583652a1470 0x5583652a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.193+0000 7fdd8e59b700 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5583652a1470 0x5583652a3880 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a84d8042cf0bd48c server_cookie=9820b568b64b92f1 in_seq=0 out_seq=0 2023-07-14T13:03:55.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.193+0000 7fdd71ffb700 10 client.26281 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:55.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdd71ffb700 1 -- 172.21.15.17:0/1527757878 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5583651d1eb0 con 0x5583652a1470 2023-07-14T13:03:55.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdd71ffb700 10 client.26281 handle_command_reply: tid=0 2023-07-14T13:03:55.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdda41a4b80 1 client.26281 shutdown 2023-07-14T13:03:55.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdda41a4b80 1 -- 172.21.15.17:0/1527757878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365286be0 msgr2=0x55836528e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365286be0 0x55836528e790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdd78005910 tx=0x7fdd780057e0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdda41a4b80 1 -- 172.21.15.17:0/1527757878 shutdown_connections 2023-07-14T13:03:55.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5583652a1470 0x5583652a3880 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365291ad0 0x55836528eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583652862d0 0x558365291510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/1527757878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365286be0 0x55836528e790 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdda41a4b80 1 -- 172.21.15.17:0/1527757878 >> 172.21.15.17:0/1527757878 conn(0x55836527cda0 msgr2=0x558365282290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:55.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdd71ffb700 0 client.26281 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:55.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdda41a4b80 1 -- 172.21.15.17:0/1527757878 shutdown_connections 2023-07-14T13:03:55.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.194+0000 7fdda41a4b80 1 -- 172.21.15.17:0/1527757878 wait complete. 2023-07-14T13:03:55.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.195+0000 7fdda41a4b80 20 client.26281 trim_cache size 0 max 16384 2023-07-14T13:03:55.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.215+0000 7fdda41a4b80 1 Processor -- start 2023-07-14T13:03:55.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.216+0000 7fdda41a4b80 1 -- start start 2023-07-14T13:03:55.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.216+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583652862d0 0x55836529d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.216+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x558365289a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.216+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558365291ad0 0x558365289fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.216+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558365283d20 con 0x558365286be0 2023-07-14T13:03:55.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.216+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55836529eb60 con 0x558365291ad0 2023-07-14T13:03:55.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.216+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558365279f20 con 0x5583652862d0 2023-07-14T13:03:55.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.216+0000 7fdd8dd9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x558365289a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.216+0000 7fdd8dd9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x558365289a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43210/0 (socket says 172.21.15.17:43210) 2023-07-14T13:03:55.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.216+0000 7fdd8dd9a700 1 -- 172.21.15.17:0/2284312203 learned_addr learned my addr 172.21.15.17:0/2284312203 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:55.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.216+0000 7fdd8ed9c700 1 --2- 172.21.15.17:0/2284312203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558365291ad0 0x558365289fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.217+0000 7fdd8e59b700 1 --2- 172.21.15.17:0/2284312203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583652862d0 0x55836529d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.217+0000 7fdd8dd9a700 1 -- 172.21.15.17:0/2284312203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583652862d0 msgr2=0x55836529d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:55.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.217+0000 7fdd8dd9a700 1 --2- 172.21.15.17:0/2284312203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583652862d0 0x55836529d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.217+0000 7fdd8dd9a700 1 -- 172.21.15.17:0/2284312203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558365291ad0 msgr2=0x558365289fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:55.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.217+0000 7fdd8dd9a700 1 --2- 172.21.15.17:0/2284312203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558365291ad0 0x558365289fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.217+0000 7fdd8dd9a700 1 -- 172.21.15.17:0/2284312203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55836502d250 con 0x558365286be0 2023-07-14T13:03:55.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.217+0000 7fdd8dd9a700 1 --2- 172.21.15.17:0/2284312203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x558365289a90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdd780098e0 tx=0x7fdd780092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c37886d12ddd6c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:55.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.217+0000 7fdd7d7fa700 1 -- 172.21.15.17:0/2284312203 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7801d070 con 0x558365286be0 2023-07-14T13:03:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.217+0000 7fdd7d7fa700 1 -- 172.21.15.17:0/2284312203 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd7801e040 con 0x558365286be0 2023-07-14T13:03:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.217+0000 7fdd7d7fa700 1 -- 172.21.15.17:0/2284312203 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780239a0 con 0x558365286be0 2023-07-14T13:03:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.218+0000 7fdda41a4b80 1 -- 172.21.15.17:0/2284312203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 msgr2=0x558365289a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.218+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/2284312203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x558365289a90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdd780098e0 tx=0x7fdd780092b0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.218+0000 7fdda41a4b80 1 -- 172.21.15.17:0/2284312203 shutdown_connections 2023-07-14T13:03:55.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.218+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/2284312203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558365291ad0 0x558365289fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.218+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/2284312203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583652862d0 0x55836529d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.218+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/2284312203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x558365289a90 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.218+0000 7fdda41a4b80 1 -- 172.21.15.17:0/2284312203 >> 172.21.15.17:0/2284312203 conn(0x55836527cda0 msgr2=0x5583652a81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:55.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.218+0000 7fdda41a4b80 1 -- 172.21.15.17:0/2284312203 shutdown_connections 2023-07-14T13:03:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.218+0000 7fdda41a4b80 1 -- 172.21.15.17:0/2284312203 wait complete. 2023-07-14T13:03:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.219+0000 7fdda41a4b80 1 -- start start 2023-07-14T13:03:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.219+0000 7fdda41a4b80 1 Processor -- start 2023-07-14T13:03:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583652862d0 0x5583652ee590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x5583652eead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdda41a4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 0x5583652964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558365296a20 con 0x558365286be0 2023-07-14T13:03:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558365296b90 con 0x5583652862d0 2023-07-14T13:03:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdda41a4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558365296d50 con 0x558365291ad0 2023-07-14T13:03:55.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdda41a4b80 10 client.0 _ll_register_callbacks cb 0x7fdd78005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:55.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdd8dd9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x5583652eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdd8dd9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x5583652eead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43222/0 (socket says 172.21.15.17:43222) 2023-07-14T13:03:55.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdd8dd9a700 1 -- 172.21.15.17:0/3882180813 learned_addr learned my addr 172.21.15.17:0/3882180813 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdd8e59b700 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583652862d0 0x5583652ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.220+0000 7fdd8ed9c700 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 0x5583652964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdd8dd9a700 1 -- 172.21.15.17:0/3882180813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 msgr2=0x5583652964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdd8dd9a700 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 0x5583652964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdd8dd9a700 1 -- 172.21.15.17:0/3882180813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583652862d0 msgr2=0x5583652ee590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdd8dd9a700 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583652862d0 0x5583652ee590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdd8dd9a700 1 -- 172.21.15.17:0/3882180813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558364fefc60 con 0x558365286be0 2023-07-14T13:03:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdd8e59b700 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583652862d0 0x5583652ee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdd8dd9a700 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x5583652eead0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800fd00 tx=0x7fdd78005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d651ea965ebc3f55 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdd71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdd71ffb700 1 -- 172.21.15.17:0/3882180813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7801d030 con 0x558365286be0 2023-07-14T13:03:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdda41a4b80 1 -- 172.21.15.17:0/3882180813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd8000f040 con 0x558365286be0 2023-07-14T13:03:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdd71ffb700 1 -- 172.21.15.17:0/3882180813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdd78000e40 con 0x558365286be0 2023-07-14T13:03:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdd71ffb700 1 -- 172.21.15.17:0/3882180813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd7800f9b0 con 0x558365286be0 2023-07-14T13:03:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdda41a4b80 10 client.16593 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.221+0000 7fdda41a4b80 1 -- 172.21.15.17:0/3882180813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5583650052b0 con 0x558365286be0 2023-07-14T13:03:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.222+0000 7fdd71ffb700 1 -- 172.21.15.17:0/3882180813 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd8000f040 con 0x558365286be0 2023-07-14T13:03:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.222+0000 7fdd71ffb700 1 -- 172.21.15.17:0/3882180813 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fdd7800b710 con 0x558365286be0 2023-07-14T13:03:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.222+0000 7fdda41a4b80 10 client.16593 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.222+0000 7fdda41a4b80 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.222+0000 7fdda41a4b80 20 client.16593 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.222+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5583652f5f70 0x5583652f8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.222+0000 7fdda41a4b80 4 client.16593 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:03:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.222+0000 7fdda41a4b80 1 -- 172.21.15.17:0/3882180813 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558365194050 con 0x5583652f5f70 2023-07-14T13:03:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.222+0000 7fdd8e59b700 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5583652f5f70 0x5583652f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.223+0000 7fdd8e59b700 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5583652f5f70 0x5583652f8380 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e54a65645967383c server_cookie=81210337b832a48a in_seq=0 out_seq=0 2023-07-14T13:03:55.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.223+0000 7fdd71ffb700 10 client.16593 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:55.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.223+0000 7fdd71ffb700 1 -- 172.21.15.17:0/3882180813 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558365194050 con 0x5583652f5f70 2023-07-14T13:03:55.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.223+0000 7fdd71ffb700 10 client.16593 handle_command_reply: tid=0 2023-07-14T13:03:55.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.223+0000 7fdda41a4b80 1 client.16593 shutdown 2023-07-14T13:03:55.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.223+0000 7fdda41a4b80 1 -- 172.21.15.17:0/3882180813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 msgr2=0x5583652eead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.223+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x5583652eead0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800fd00 tx=0x7fdd78005a00 comp rx=0 tx=0).stop 2023-07-14T13:03:55.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.224+0000 7fdda41a4b80 1 -- 172.21.15.17:0/3882180813 shutdown_connections 2023-07-14T13:03:55.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.224+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5583652f5f70 0x5583652f8380 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.224+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558365291ad0 0x5583652964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.224+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5583652862d0 0x5583652ee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.224+0000 7fdd71ffb700 0 client.16593 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:55.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.224+0000 7fdda41a4b80 1 --2- 172.21.15.17:0/3882180813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558365286be0 0x5583652eead0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.224+0000 7fdda41a4b80 1 -- 172.21.15.17:0/3882180813 >> 172.21.15.17:0/3882180813 conn(0x55836527cda0 msgr2=0x558365289a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.224+0000 7fdda41a4b80 1 -- 172.21.15.17:0/3882180813 shutdown_connections 2023-07-14T13:03:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.224+0000 7fdda41a4b80 1 -- 172.21.15.17:0/3882180813 wait complete. 2023-07-14T13:03:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.224+0000 7fdda41a4b80 20 client.16593 trim_cache size 0 max 16384 2023-07-14T13:03:55.270 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:03:55.271 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:03:55.271 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:03:55.271 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:03:55.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 -- 172.21.15.17:0/3985727323 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdd740a12c0 msgr2=0x7fdd740a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdd740a12c0 0x7fdd740a3770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009550 tx=0x7fdd80009380 comp rx=0 tx=0).stop 2023-07-14T13:03:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 -- 172.21.15.17:0/3985727323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd880728b0 msgr2=0x7fdd88197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd880728b0 0x7fdd88197d20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400e9a0 tx=0x7fdd8400ecb0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 -- 172.21.15.17:0/3985727323 shutdown_connections 2023-07-14T13:03:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdd740a12c0 0x7fdd740a3770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd8810c310 0x7fdd8819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd880728b0 0x7fdd88197d20 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 --2- 172.21.15.17:0/3985727323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd880731c0 0x7fdd88198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 -- 172.21.15.17:0/3985727323 >> 172.21.15.17:0/3985727323 conn(0x7fdd880fb5f0 msgr2=0x7fdd8810e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:55.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 -- 172.21.15.17:0/3985727323 shutdown_connections 2023-07-14T13:03:55.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.225+0000 7fdd907ff700 1 -- 172.21.15.17:0/3985727323 wait complete. 2023-07-14T13:03:55.278 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:03:55.278 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:03:55.285 INFO:teuthology.orchestra.run.smithi017.stderr:14400000 of 50000000 tuples (28%) done (elapsed 224.89 s, remaining 555.97 s) 2023-07-14T13:03:55.348 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:55 smithi017 ceph-mon[95536]: pgmap v128: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 22 MiB/s wr, 37 op/s 2023-07-14T13:03:55.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:55 smithi135 ceph-mon[97338]: pgmap v128: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 22 MiB/s wr, 37 op/s 2023-07-14T13:03:55.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:55 smithi131 ceph-mon[96953]: pgmap v128: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 22 MiB/s wr, 37 op/s 2023-07-14T13:03:55.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.487+0000 7ff60119d700 1 -- 172.21.15.17:0/1293407224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5fc072850 msgr2=0x7ff5fc072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.487+0000 7ff60119d700 1 --2- 172.21.15.17:0/1293407224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5fc072850 0x7ff5fc072c20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009990 tx=0x7ff5ec009ca0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.487+0000 7ff60119d700 1 -- 172.21.15.17:0/1293407224 shutdown_connections 2023-07-14T13:03:55.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.487+0000 7ff60119d700 1 --2- 172.21.15.17:0/1293407224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc10c270 0x7ff5fc10e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.487+0000 7ff60119d700 1 --2- 172.21.15.17:0/1293407224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5fc072850 0x7ff5fc072c20 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.487+0000 7ff60119d700 1 --2- 172.21.15.17:0/1293407224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5fc073160 0x7ff5fc10bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.487+0000 7ff60119d700 1 -- 172.21.15.17:0/1293407224 >> 172.21.15.17:0/1293407224 conn(0x7ff5fc0fb4d0 msgr2=0x7ff5fc0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:55.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.487+0000 7ff60119d700 1 -- 172.21.15.17:0/1293407224 shutdown_connections 2023-07-14T13:03:55.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.487+0000 7ff60119d700 1 -- 172.21.15.17:0/1293407224 wait complete. 2023-07-14T13:03:55.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.488+0000 7ff60119d700 1 Processor -- start 2023-07-14T13:03:55.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.488+0000 7ff60119d700 1 -- start start 2023-07-14T13:03:55.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.489+0000 7ff60119d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc072850 0x7ff5fc19d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.489+0000 7ff60119d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5fc073160 0x7ff5fc19de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.489+0000 7ff60119d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5fc10c270 0x7ff5fc197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.489+0000 7ff60119d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc198100 con 0x7ff5fc073160 2023-07-14T13:03:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.489+0000 7ff60119d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc198270 con 0x7ff5fc10c270 2023-07-14T13:03:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.489+0000 7ff60119d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc198430 con 0x7ff5fc072850 2023-07-14T13:03:55.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.489+0000 7ff5fb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5fc073160 0x7ff5fc19de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.489+0000 7ff5fb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5fc073160 0x7ff5fc19de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43244/0 (socket says 172.21.15.17:43244) 2023-07-14T13:03:55.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.489+0000 7ff5fb7fe700 1 -- 172.21.15.17:0/852624730 learned_addr learned my addr 172.21.15.17:0/852624730 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:55.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.489+0000 7ff5fbfff700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc072850 0x7ff5fc19d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.489+0000 7ff60099c700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5fc10c270 0x7ff5fc197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.490+0000 7ff5fb7fe700 1 -- 172.21.15.17:0/852624730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc072850 msgr2=0x7ff5fc19d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.490+0000 7ff5fb7fe700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc072850 0x7ff5fc19d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.490+0000 7ff5fb7fe700 1 -- 172.21.15.17:0/852624730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5fc10c270 msgr2=0x7ff5fc197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.490+0000 7ff5fb7fe700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5fc10c270 0x7ff5fc197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.490+0000 7ff5fb7fe700 1 -- 172.21.15.17:0/852624730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec0095f0 con 0x7ff5fc073160 2023-07-14T13:03:55.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.490+0000 7ff60099c700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5fc10c270 0x7ff5fc197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:55.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.490+0000 7ff5fb7fe700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5fc073160 0x7ff5fc19de90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000d980 tx=0x7ff5f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:55.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.490+0000 7ff5f97fa700 1 -- 172.21.15.17:0/852624730 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0004220 con 0x7ff5fc073160 2023-07-14T13:03:55.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.490+0000 7ff5f97fa700 1 -- 172.21.15.17:0/852624730 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5f0007640 con 0x7ff5fc073160 2023-07-14T13:03:55.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.490+0000 7ff60119d700 1 -- 172.21.15.17:0/852624730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc198710 con 0x7ff5fc073160 2023-07-14T13:03:55.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.491+0000 7ff5f97fa700 1 -- 172.21.15.17:0/852624730 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f00055e0 con 0x7ff5fc073160 2023-07-14T13:03:55.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.491+0000 7ff60119d700 1 -- 172.21.15.17:0/852624730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc1a4920 con 0x7ff5fc073160 2023-07-14T13:03:55.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.492+0000 7ff60119d700 1 -- 172.21.15.17:0/852624730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc106b90 con 0x7ff5fc073160 2023-07-14T13:03:55.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.494+0000 7ff5f97fa700 1 -- 172.21.15.17:0/852624730 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff5f0004750 con 0x7ff5fc073160 2023-07-14T13:03:55.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.495+0000 7ff5f97fa700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff5e40a1430 0x7ff5e40a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:55.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.495+0000 7ff5f97fa700 1 -- 172.21.15.17:0/852624730 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff5f00ccf40 con 0x7ff5fc073160 2023-07-14T13:03:55.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.496+0000 7ff5fbfff700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff5e40a1430 0x7ff5e40a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:55.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.496+0000 7ff5fbfff700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff5e40a1430 0x7ff5e40a38e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec006010 tx=0x7ff5ec00b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:55.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.499+0000 7ff5f97fa700 1 -- 172.21.15.17:0/852624730 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff5f0096360 con 0x7ff5fc073160 2023-07-14T13:03:55.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.805+0000 7ff60119d700 1 -- 172.21.15.17:0/852624730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5fc106570 con 0x7ff5fc073160 2023-07-14T13:03:55.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.806+0000 7ff5f97fa700 1 -- 172.21.15.17:0/852624730 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10849 (secure 0 0 0) 0x7ff5f0016070 con 0x7ff5fc073160 2023-07-14T13:03:55.839 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:03:55.839 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:03:44.048836+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:03:55.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.808+0000 7ff60119d700 1 -- 172.21.15.17:0/852624730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff5e40a1430 msgr2=0x7ff5e40a38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.808+0000 7ff60119d700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff5e40a1430 0x7ff5e40a38e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec006010 tx=0x7ff5ec00b260 comp rx=0 tx=0).stop 2023-07-14T13:03:55.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.808+0000 7ff60119d700 1 -- 172.21.15.17:0/852624730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5fc073160 msgr2=0x7ff5fc19de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:55.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.808+0000 7ff60119d700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5fc073160 0x7ff5fc19de90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000d980 tx=0x7ff5f000dc90 comp rx=0 tx=0).stop 2023-07-14T13:03:55.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.809+0000 7ff60119d700 1 -- 172.21.15.17:0/852624730 shutdown_connections 2023-07-14T13:03:55.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.809+0000 7ff60119d700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff5e40a1430 0x7ff5e40a38e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.809+0000 7ff60119d700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5fc10c270 0x7ff5fc197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.809+0000 7ff60119d700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5fc072850 0x7ff5fc19d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.809+0000 7ff60119d700 1 --2- 172.21.15.17:0/852624730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5fc073160 0x7ff5fc19de90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:55.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.809+0000 7ff60119d700 1 -- 172.21.15.17:0/852624730 >> 172.21.15.17:0/852624730 conn(0x7ff5fc0fb4d0 msgr2=0x7ff5fc103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:55.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.809+0000 7ff60119d700 1 -- 172.21.15.17:0/852624730 shutdown_connections 2023-07-14T13:03:55.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:55.809+0000 7ff60119d700 1 -- 172.21.15.17:0/852624730 wait complete. 2023-07-14T13:03:55.844 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2023-07-14T13:03:55.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:03:56.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.068+0000 7f98603ff700 1 -- 172.21.15.17:0/2602086428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9858101f70 msgr2=0x7f9858102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.068+0000 7f98603ff700 1 --2- 172.21.15.17:0/2602086428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9858101f70 0x7f9858102340 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f98540099c0 tx=0x7f9854009cd0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.068+0000 7f98603ff700 1 -- 172.21.15.17:0/2602086428 shutdown_connections 2023-07-14T13:03:56.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.068+0000 7f98603ff700 1 --2- 172.21.15.17:0/2602086428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9858106fb0 0x7f985810eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.068+0000 7f98603ff700 1 --2- 172.21.15.17:0/2602086428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9858101f70 0x7f9858102340 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.068+0000 7f98603ff700 1 --2- 172.21.15.17:0/2602086428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9858102910 0x7f98581068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.068+0000 7f98603ff700 1 -- 172.21.15.17:0/2602086428 >> 172.21.15.17:0/2602086428 conn(0x7f98580fd7e0 msgr2=0x7f98580ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.068+0000 7f98603ff700 1 -- 172.21.15.17:0/2602086428 shutdown_connections 2023-07-14T13:03:56.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.068+0000 7f98603ff700 1 -- 172.21.15.17:0/2602086428 wait complete. 2023-07-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.070+0000 7f98603ff700 1 Processor -- start 2023-07-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.070+0000 7f98603ff700 1 -- start start 2023-07-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.070+0000 7f98603ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9858101f70 0x7f9858197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.070+0000 7f98603ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9858102910 0x7f9858198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.070+0000 7f98603ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9858106fb0 0x7f985819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.070+0000 7f98603ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985819cda0 con 0x7f9858102910 2023-07-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.070+0000 7f98603ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985819cf10 con 0x7f9858101f70 2023-07-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.070+0000 7f98603ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985819d0d0 con 0x7f9858106fb0 2023-07-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.071+0000 7f985e19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9858101f70 0x7f9858197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.071+0000 7f985d99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9858102910 0x7f9858198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.071+0000 7f985e19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9858101f70 0x7f9858197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41570/0 (socket says 172.21.15.17:41570) 2023-07-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.071+0000 7f985e19b700 1 -- 172.21.15.17:0/493467311 learned_addr learned my addr 172.21.15.17:0/493467311 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.071+0000 7f985e99c700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9858106fb0 0x7f985819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.071+0000 7f985e19b700 1 -- 172.21.15.17:0/493467311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9858106fb0 msgr2=0x7f985819c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.071+0000 7f985e19b700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9858106fb0 0x7f985819c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.071+0000 7f985e19b700 1 -- 172.21.15.17:0/493467311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9858102910 msgr2=0x7f9858198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.071+0000 7f985e19b700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9858102910 0x7f9858198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.071+0000 7f985e19b700 1 -- 172.21.15.17:0/493467311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98540095f0 con 0x7f9858101f70 2023-07-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.071+0000 7f985d99a700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9858102910 0x7f9858198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.072+0000 7f985e19b700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9858101f70 0x7f9858197dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9854000c00 tx=0x7f9854005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.075+0000 7f984f7fe700 1 -- 172.21.15.17:0/493467311 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985401d070 con 0x7f9858101f70 2023-07-14T13:03:56.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.075+0000 7f984f7fe700 1 -- 172.21.15.17:0/493467311 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f985400fe70 con 0x7f9858101f70 2023-07-14T13:03:56.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.075+0000 7f98603ff700 1 -- 172.21.15.17:0/493467311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985819d350 con 0x7f9858101f70 2023-07-14T13:03:56.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.075+0000 7f984f7fe700 1 -- 172.21.15.17:0/493467311 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98540173f0 con 0x7f9858101f70 2023-07-14T13:03:56.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.076+0000 7f98603ff700 1 -- 172.21.15.17:0/493467311 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98581a4bf0 con 0x7f9858101f70 2023-07-14T13:03:56.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.080+0000 7f984f7fe700 1 -- 172.21.15.17:0/493467311 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f985400f9e0 con 0x7f9858101f70 2023-07-14T13:03:56.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.081+0000 7f9873c8cb80 1 Processor -- start 2023-07-14T13:03:56.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.081+0000 7f9873c8cb80 1 -- start start 2023-07-14T13:03:56.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.081+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effc46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc4be0 0x5587effcf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f984f7fe700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f98440a1340 0x7f98440a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effcfad0 0x5587effd1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587efecacb0 con 0x5587effc42d0 2023-07-14T13:03:56.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587eff1da40 con 0x5587effc4be0 2023-07-14T13:03:56.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587eff16ed0 con 0x5587effcfad0 2023-07-14T13:03:56.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f985e99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effc46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f985e99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effc46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43258/0 (socket says 172.21.15.17:43258) 2023-07-14T13:03:56.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f985e99c700 1 -- 172.21.15.17:0/1202491553 learned_addr learned my addr 172.21.15.17:0/1202491553 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f985e19b700 1 --2- 172.21.15.17:0/1202491553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc4be0 0x5587effcf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f985d99a700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f98440a1340 0x7f98440a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f985e99c700 1 --2- 172.21.15.17:0/1202491553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effcfad0 0x5587effd1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f985e99c700 1 -- 172.21.15.17:0/1202491553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effcfad0 msgr2=0x5587effd1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f985e99c700 1 --2- 172.21.15.17:0/1202491553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effcfad0 0x5587effd1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f985e99c700 1 -- 172.21.15.17:0/1202491553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc4be0 msgr2=0x5587effcf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f985e99c700 1 --2- 172.21.15.17:0/1202491553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc4be0 0x5587effcf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.082+0000 7f985e99c700 1 -- 172.21.15.17:0/1202491553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587efd44de0 con 0x5587effc42d0 2023-07-14T13:03:56.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.083+0000 7f985e99c700 1 --2- 172.21.15.17:0/1202491553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effc46a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f9850003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f62ec64b1916ca3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.083+0000 7f984f7fe700 1 -- 172.21.15.17:0/493467311 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f9854022470 con 0x7f9858101f70 2023-07-14T13:03:56.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.083+0000 7f985d99a700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f98440a1340 0x7f98440a37f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98581993d0 tx=0x7f9848009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.083+0000 7f984cbfe700 1 -- 172.21.15.17:0/1202491553 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850009e80 con 0x5587effc42d0 2023-07-14T13:03:56.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.083+0000 7f984cbfe700 1 -- 172.21.15.17:0/1202491553 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f985000f040 con 0x5587effc42d0 2023-07-14T13:03:56.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.083+0000 7f984cbfe700 1 -- 172.21.15.17:0/1202491553 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850017670 con 0x5587effc42d0 2023-07-14T13:03:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.084+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1202491553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 msgr2=0x5587effc46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.084+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/1202491553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effc46a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f9850003ab0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.084+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1202491553 shutdown_connections 2023-07-14T13:03:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.084+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/1202491553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effcfad0 0x5587effd1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.084+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/1202491553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effc46a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.084+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/1202491553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc4be0 0x5587effcf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.084+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1202491553 >> 172.21.15.17:0/1202491553 conn(0x5587effbada0 msgr2=0x5587effc06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.084+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1202491553 shutdown_connections 2023-07-14T13:03:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.084+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1202491553 wait complete. 2023-07-14T13:03:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.085+0000 7f9873c8cb80 1 -- start start 2023-07-14T13:03:56.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.085+0000 7f9873c8cb80 1 Processor -- start 2023-07-14T13:03:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effcf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effc4be0 0x5587effcc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effcfad0 0x5587effcced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587efeb6ac0 con 0x5587effc42d0 2023-07-14T13:03:56.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587efeb67c0 con 0x5587effcfad0 2023-07-14T13:03:56.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587efd9a920 con 0x5587effc4be0 2023-07-14T13:03:56.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f9873c8cb80 10 client.0 _ll_register_callbacks cb 0x5587efeb4760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:56.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f985e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effcf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f985e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effcf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43274/0 (socket says 172.21.15.17:43274) 2023-07-14T13:03:56.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f985e19b700 1 -- 172.21.15.17:0/3309106901 learned_addr learned my addr 172.21.15.17:0/3309106901 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f985e99c700 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effcfad0 0x5587effcced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.086+0000 7f985d99a700 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effc4be0 0x5587effcc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f985e19b700 1 -- 172.21.15.17:0/3309106901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effc4be0 msgr2=0x5587effcc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f985e19b700 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effc4be0 0x5587effcc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f985e19b700 1 -- 172.21.15.17:0/3309106901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effcfad0 msgr2=0x5587effcced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f985e19b700 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effcfad0 0x5587effcced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f985e19b700 1 -- 172.21.15.17:0/3309106901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98500099c0 con 0x5587effc42d0 2023-07-14T13:03:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f985e99c700 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effcfad0 0x5587effcced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f985e19b700 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effcf510 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f985400b580 tx=0x7f98540845b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fac955fb85518f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f9841ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f9841ffb700 1 -- 172.21.15.17:0/3309106901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98540840c0 con 0x5587effc42d0 2023-07-14T13:03:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f9841ffb700 1 -- 172.21.15.17:0/3309106901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f985409eef0 con 0x5587effc42d0 2023-07-14T13:03:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f9873c8cb80 1 -- 172.21.15.17:0/3309106901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5587efe704f0 con 0x5587effc42d0 2023-07-14T13:03:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f9841ffb700 1 -- 172.21.15.17:0/3309106901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98540a3280 con 0x5587effc42d0 2023-07-14T13:03:56.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f9873c8cb80 10 client.16611 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:56.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.087+0000 7f9873c8cb80 1 -- 172.21.15.17:0/3309106901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5587efd2dc60 con 0x5587effc42d0 2023-07-14T13:03:56.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.088+0000 7f9841ffb700 1 -- 172.21.15.17:0/3309106901 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98540b2030 con 0x5587effc42d0 2023-07-14T13:03:56.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.088+0000 7f9841ffb700 1 -- 172.21.15.17:0/3309106901 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f985409a3b0 con 0x5587effc42d0 2023-07-14T13:03:56.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.088+0000 7f9873c8cb80 10 client.16611 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:56.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.088+0000 7f9873c8cb80 10 client.16611 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:03:56.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.088+0000 7f9873c8cb80 20 client.16611 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:56.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.088+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5587effdf090 0x5587effe14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.088+0000 7f9873c8cb80 4 client.16611 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:56.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.088+0000 7f9873c8cb80 1 -- 172.21.15.17:0/3309106901 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5587eff0feb0 con 0x5587effdf090 2023-07-14T13:03:56.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.089+0000 7f985d99a700 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5587effdf090 0x5587effe14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.089+0000 7f985d99a700 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5587effdf090 0x5587effe14a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=51110efba99a60f3 server_cookie=652015b9a665e418 in_seq=0 out_seq=0 2023-07-14T13:03:56.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.089+0000 7f9841ffb700 10 client.16611 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:03:56.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.090+0000 7f9841ffb700 1 -- 172.21.15.17:0/3309106901 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5587eff0feb0 con 0x5587effdf090 2023-07-14T13:03:56.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.090+0000 7f9841ffb700 10 client.16611 handle_command_reply: tid=0 2023-07-14T13:03:56.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.090+0000 7f9873c8cb80 1 client.16611 shutdown 2023-07-14T13:03:56.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9873c8cb80 1 -- 172.21.15.17:0/3309106901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 msgr2=0x5587effcf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effcf510 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f985400b580 tx=0x7f98540845b0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9873c8cb80 1 -- 172.21.15.17:0/3309106901 shutdown_connections 2023-07-14T13:03:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effcfad0 0x5587effcced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc42d0 0x5587effcf510 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5587effdf090 0x5587effe14a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/3309106901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effc4be0 0x5587effcc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9841ffb700 0 client.16611 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:03:56.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9873c8cb80 1 -- 172.21.15.17:0/3309106901 >> 172.21.15.17:0/3309106901 conn(0x5587effbada0 msgr2=0x5587effc0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9873c8cb80 1 -- 172.21.15.17:0/3309106901 shutdown_connections 2023-07-14T13:03:56.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9873c8cb80 1 -- 172.21.15.17:0/3309106901 wait complete. 2023-07-14T13:03:56.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.091+0000 7f9873c8cb80 20 client.16611 trim_cache size 0 max 16384 2023-07-14T13:03:56.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.107+0000 7f9873c8cb80 1 Processor -- start 2023-07-14T13:03:56.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.107+0000 7f9873c8cb80 1 -- start start 2023-07-14T13:03:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.107+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 0x5587effcf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.107+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effc4be0 0x5587effc9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effcfad0 0x5587effc9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587effc1d70 con 0x5587effcfad0 2023-07-14T13:03:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587effc5570 con 0x5587effc42d0 2023-07-14T13:03:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587effc5e50 con 0x5587effc4be0 2023-07-14T13:03:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f985e99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effcfad0 0x5587effc9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f985e99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effcfad0 0x5587effc9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43278/0 (socket says 172.21.15.17:43278) 2023-07-14T13:03:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f985e99c700 1 -- 172.21.15.17:0/2234776827 learned_addr learned my addr 172.21.15.17:0/2234776827 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f985d99a700 1 --2- 172.21.15.17:0/2234776827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effc4be0 0x5587effc9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f985e19b700 1 --2- 172.21.15.17:0/2234776827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 0x5587effcf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f985e99c700 1 -- 172.21.15.17:0/2234776827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effc4be0 msgr2=0x5587effc9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f985e99c700 1 --2- 172.21.15.17:0/2234776827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effc4be0 0x5587effc9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f985e99c700 1 -- 172.21.15.17:0/2234776827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 msgr2=0x5587effcf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f985e99c700 1 --2- 172.21.15.17:0/2234776827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 0x5587effcf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f985e99c700 1 -- 172.21.15.17:0/2234776827 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587efd6b250 con 0x5587effcfad0 2023-07-14T13:03:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.108+0000 7f985e19b700 1 --2- 172.21.15.17:0/2234776827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 0x5587effcf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.109+0000 7f985e99c700 1 --2- 172.21.15.17:0/2234776827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effcfad0 0x5587effc9f40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f9850009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb883a588b3f8858 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.109+0000 7f984d3ff700 1 -- 172.21.15.17:0/2234776827 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985000bea0 con 0x5587effcfad0 2023-07-14T13:03:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.109+0000 7f984d3ff700 1 -- 172.21.15.17:0/2234776827 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9850007ca0 con 0x5587effcfad0 2023-07-14T13:03:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.109+0000 7f984d3ff700 1 -- 172.21.15.17:0/2234776827 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985001a670 con 0x5587effcfad0 2023-07-14T13:03:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.110+0000 7f9873c8cb80 1 -- 172.21.15.17:0/2234776827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effcfad0 msgr2=0x5587effc9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.110+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/2234776827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effcfad0 0x5587effc9f40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f9850009490 comp rx=0 tx=0).stop 2023-07-14T13:03:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.110+0000 7f9873c8cb80 1 -- 172.21.15.17:0/2234776827 shutdown_connections 2023-07-14T13:03:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.110+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/2234776827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effcfad0 0x5587effc9f40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.110+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/2234776827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 0x5587effcf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.110+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/2234776827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effc4be0 0x5587effc9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.110+0000 7f9873c8cb80 1 -- 172.21.15.17:0/2234776827 >> 172.21.15.17:0/2234776827 conn(0x5587effbada0 msgr2=0x5587effdb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.110+0000 7f9873c8cb80 1 -- 172.21.15.17:0/2234776827 shutdown_connections 2023-07-14T13:03:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.110+0000 7f9873c8cb80 1 -- 172.21.15.17:0/2234776827 wait complete. 2023-07-14T13:03:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.110+0000 7f9873c8cb80 1 -- start start 2023-07-14T13:03:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.111+0000 7f9873c8cb80 1 Processor -- start 2023-07-14T13:03:56.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.111+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 0x5587effd4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.111+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc4be0 0x5587effd4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.111+0000 7f9873c8cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effcfad0 0x5587effd54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.111+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587f0032f60 con 0x5587effc4be0 2023-07-14T13:03:56.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.111+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587f00330a0 con 0x5587effc42d0 2023-07-14T13:03:56.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.111+0000 7f9873c8cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587f00331e0 con 0x5587effcfad0 2023-07-14T13:03:56.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.111+0000 7f9873c8cb80 10 client.0 _ll_register_callbacks cb 0x7f985409aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:56.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985d99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc4be0 0x5587effd4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985e19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 0x5587effd4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985d99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc4be0 0x5587effd4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43286/0 (socket says 172.21.15.17:43286) 2023-07-14T13:03:56.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985d99a700 1 -- 172.21.15.17:0/1907219714 learned_addr learned my addr 172.21.15.17:0/1907219714 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985e99c700 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effcfad0 0x5587effd54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985d99a700 1 -- 172.21.15.17:0/1907219714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effcfad0 msgr2=0x5587effd54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985d99a700 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effcfad0 0x5587effd54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985d99a700 1 -- 172.21.15.17:0/1907219714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 msgr2=0x5587effd4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985d99a700 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 0x5587effd4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985d99a700 1 -- 172.21.15.17:0/1907219714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985001e040 con 0x5587effc4be0 2023-07-14T13:03:56.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985e19b700 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 0x5587effd4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:56.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f985d99a700 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc4be0 0x5587effd4fb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9858069a80 tx=0x7f9848014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16741cf1e88b5ff server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.112+0000 7f9841ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:56.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.113+0000 7f9841ffb700 1 -- 172.21.15.17:0/1907219714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848026580 con 0x5587effc4be0 2023-07-14T13:03:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.113+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1907219714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5587efed2050 con 0x5587effc4be0 2023-07-14T13:03:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.113+0000 7f9841ffb700 1 -- 172.21.15.17:0/1907219714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f9848026bd0 con 0x5587effc4be0 2023-07-14T13:03:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.113+0000 7f9841ffb700 1 -- 172.21.15.17:0/1907219714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9848026d90 con 0x5587effc4be0 2023-07-14T13:03:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.113+0000 7f9873c8cb80 10 client.16617 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.113+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1907219714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5587efd432b0 con 0x5587effc4be0 2023-07-14T13:03:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.113+0000 7f9841ffb700 1 -- 172.21.15.17:0/1907219714 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5587efed2050 con 0x5587effc4be0 2023-07-14T13:03:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.114+0000 7f9841ffb700 1 -- 172.21.15.17:0/1907219714 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f9848038550 con 0x5587effc4be0 2023-07-14T13:03:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.114+0000 7f9873c8cb80 10 client.16617 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:56.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.114+0000 7f9873c8cb80 10 client.16617 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:03:56.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.114+0000 7f9873c8cb80 20 client.16617 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:56.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.114+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5587f0034950 0x5587f0036d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.114+0000 7f9873c8cb80 4 client.16617 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:03:56.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.114+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1907219714 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5587efd65f70 con 0x5587f0034950 2023-07-14T13:03:56.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.115+0000 7f985e19b700 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5587f0034950 0x5587f0036d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.115+0000 7f985e19b700 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5587f0034950 0x5587f0036d60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4d2e84ea1d777f68 server_cookie=dc99e91086c4430a in_seq=0 out_seq=0 2023-07-14T13:03:56.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.115+0000 7f9841ffb700 10 client.16617 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:03:56.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.115+0000 7f9841ffb700 1 -- 172.21.15.17:0/1907219714 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5587efd65f70 con 0x5587f0034950 2023-07-14T13:03:56.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.115+0000 7f9841ffb700 10 client.16617 handle_command_reply: tid=0 2023-07-14T13:03:56.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.115+0000 7f9873c8cb80 1 client.16617 shutdown 2023-07-14T13:03:56.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1907219714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc4be0 msgr2=0x5587effd4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc4be0 0x5587effd4fb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9858069a80 tx=0x7f9848014000 comp rx=0 tx=0).stop 2023-07-14T13:03:56.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1907219714 shutdown_connections 2023-07-14T13:03:56.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5587f0034950 0x5587f0036d60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5587effcfad0 0x5587effd54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587effc42d0 0x5587effd4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9873c8cb80 1 --2- 172.21.15.17:0/1907219714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5587effc4be0 0x5587effd4fb0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9841ffb700 0 client.16617 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:03:56.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1907219714 >> 172.21.15.17:0/1907219714 conn(0x5587effbada0 msgr2=0x5587effc63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1907219714 shutdown_connections 2023-07-14T13:03:56.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9873c8cb80 1 -- 172.21.15.17:0/1907219714 wait complete. 2023-07-14T13:03:56.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.116+0000 7f9873c8cb80 20 client.16617 trim_cache size 0 max 16384 2023-07-14T13:03:56.156 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:03:56.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 -- 172.21.15.17:0/493467311 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f98440a1340 msgr2=0x7f98440a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f98440a1340 0x7f98440a37f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98581993d0 tx=0x7f9848009260 comp rx=0 tx=0).stop 2023-07-14T13:03:56.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 -- 172.21.15.17:0/493467311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9858101f70 msgr2=0x7f9858197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9858101f70 0x7f9858197dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9854000c00 tx=0x7f9854005f10 comp rx=0 tx=0).stop 2023-07-14T13:03:56.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 -- 172.21.15.17:0/493467311 shutdown_connections 2023-07-14T13:03:56.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f98440a1340 0x7f98440a37f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9858106fb0 0x7f985819c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9858101f70 0x7f9858197dc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 --2- 172.21.15.17:0/493467311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9858102910 0x7f9858198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 -- 172.21.15.17:0/493467311 >> 172.21.15.17:0/493467311 conn(0x7f98580fd7e0 msgr2=0x7f98580fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 -- 172.21.15.17:0/493467311 shutdown_connections 2023-07-14T13:03:56.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.117+0000 7f98603ff700 1 -- 172.21.15.17:0/493467311 wait complete. 2023-07-14T13:03:56.167 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:56 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/852624730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:03:56.169 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:03:56.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.366+0000 7f5d01bff700 1 -- 172.21.15.17:0/1748691877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cfc0ffad0 msgr2=0x7f5cfc0fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.366+0000 7f5d01bff700 1 --2- 172.21.15.17:0/1748691877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cfc0ffad0 0x7f5cfc0fff40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009990 tx=0x7f5cf0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.366+0000 7f5d01bff700 1 -- 172.21.15.17:0/1748691877 shutdown_connections 2023-07-14T13:03:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.366+0000 7f5d01bff700 1 --2- 172.21.15.17:0/1748691877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cfc100480 0x7f5cfc10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.366+0000 7f5d01bff700 1 --2- 172.21.15.17:0/1748691877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cfc105ae0 0x7f5cfc105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.366+0000 7f5d01bff700 1 --2- 172.21.15.17:0/1748691877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cfc0ffad0 0x7f5cfc0fff40 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.366+0000 7f5d01bff700 1 -- 172.21.15.17:0/1748691877 >> 172.21.15.17:0/1748691877 conn(0x7f5cfc0fb5f0 msgr2=0x7f5cfc0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.366+0000 7f5d01bff700 1 -- 172.21.15.17:0/1748691877 shutdown_connections 2023-07-14T13:03:56.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.366+0000 7f5d01bff700 1 -- 172.21.15.17:0/1748691877 wait complete. 2023-07-14T13:03:56.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.367+0000 7f5d01bff700 1 Processor -- start 2023-07-14T13:03:56.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.367+0000 7f5d01bff700 1 -- start start 2023-07-14T13:03:56.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5d01bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cfc0ffad0 0x7f5cfc19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5d01bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cfc100480 0x7f5cfc19df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5d01bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cfc105ae0 0x7f5cfc197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5d01bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc198140 con 0x7f5cfc100480 2023-07-14T13:03:56.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5d01bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc1982b0 con 0x7f5cfc0ffad0 2023-07-14T13:03:56.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5d01bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc198470 con 0x7f5cfc105ae0 2023-07-14T13:03:56.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5cfb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cfc0ffad0 0x7f5cfc19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5cfaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cfc100480 0x7f5cfc19df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5cfb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cfc0ffad0 0x7f5cfc19da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41606/0 (socket says 172.21.15.17:41606) 2023-07-14T13:03:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/3402406934 learned_addr learned my addr 172.21.15.17:0/3402406934 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/3402406934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cfc105ae0 msgr2=0x7f5cfc197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5cfbfff700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cfc105ae0 0x7f5cfc197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cfc105ae0 0x7f5cfc197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/3402406934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cfc100480 msgr2=0x7f5cfc19df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cfc100480 0x7f5cfc19df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/3402406934 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00095f0 con 0x7f5cfc0ffad0 2023-07-14T13:03:56.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.368+0000 7f5cfaffd700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cfc100480 0x7f5cfc19df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:56.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.369+0000 7f5cfbfff700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cfc105ae0 0x7f5cfc197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:03:56.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.369+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cfc0ffad0 0x7f5cfc19da10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00e9a0 tx=0x7f5cec00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.369+0000 7f5cf8ff9700 1 -- 172.21.15.17:0/3402406934 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec009790 con 0x7f5cfc0ffad0 2023-07-14T13:03:56.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.369+0000 7f5cf8ff9700 1 -- 172.21.15.17:0/3402406934 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5cec00cbd0 con 0x7f5cfc0ffad0 2023-07-14T13:03:56.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.369+0000 7f5cf8ff9700 1 -- 172.21.15.17:0/3402406934 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec018680 con 0x7f5cfc0ffad0 2023-07-14T13:03:56.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.369+0000 7f5d01bff700 1 -- 172.21.15.17:0/3402406934 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc198750 con 0x7f5cfc0ffad0 2023-07-14T13:03:56.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.369+0000 7f5d01bff700 1 -- 172.21.15.17:0/3402406934 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc1a4ab0 con 0x7f5cfc0ffad0 2023-07-14T13:03:56.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.374+0000 7f5cf8ff9700 1 -- 172.21.15.17:0/3402406934 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5cec00cd40 con 0x7f5cfc0ffad0 2023-07-14T13:03:56.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.375+0000 7f5d154dfb80 1 Processor -- start 2023-07-14T13:03:56.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.375+0000 7f5d154dfb80 1 -- start start 2023-07-14T13:03:56.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 0x556af2f386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 0x556af2f43590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f43ad0 0x556af2f45eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2e3ecb0 con 0x556af2f38be0 2023-07-14T13:03:56.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2e91a40 con 0x556af2f43ad0 2023-07-14T13:03:56.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2e8aed0 con 0x556af2f382d0 2023-07-14T13:03:56.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5cf8ff9700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5ce40a1340 0x7f5ce40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5cfbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 0x556af2f386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5cf8ff9700 1 -- 172.21.15.17:0/3402406934 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5cec014070 con 0x7f5cfc0ffad0 2023-07-14T13:03:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5cfb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 0x556af2f43590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5cfbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 0x556af2f386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:32984/0 (socket says 172.21.15.17:32984) 2023-07-14T13:03:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5cfbfff700 1 -- 172.21.15.17:0/3847573146 learned_addr learned my addr 172.21.15.17:0/3847573146 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.376+0000 7f5cfbfff700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5ce40a1340 0x7f5ce40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.377+0000 7f5cfaffd700 1 --2- 172.21.15.17:0/3847573146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f43ad0 0x556af2f45eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.377+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/3847573146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 msgr2=0x556af2f386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.377+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/3847573146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 0x556af2f386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.377+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/3847573146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f43ad0 msgr2=0x556af2f45eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.377+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/3847573146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f43ad0 0x556af2f45eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.377+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/3847573146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556af2cb8de0 con 0x556af2f38be0 2023-07-14T13:03:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.377+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/3847573146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 0x556af2f43590 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0ca5f0 tx=0x7f5cec0998d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60579670ab5149a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.377+0000 7f5cfbfff700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5ce40a1340 0x7f5ce40a37f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40060b0 tx=0x7f5cf400b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.377+0000 7f5ce1ffb700 1 -- 172.21.15.17:0/3847573146 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0a23c0 con 0x556af2f38be0 2023-07-14T13:03:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.378+0000 7f5ce1ffb700 1 -- 172.21.15.17:0/3847573146 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5cec09a1d0 con 0x556af2f38be0 2023-07-14T13:03:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.378+0000 7f5ce1ffb700 1 -- 172.21.15.17:0/3847573146 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0a1f30 con 0x556af2f38be0 2023-07-14T13:03:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.378+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3847573146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 msgr2=0x556af2f43590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.378+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/3847573146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 0x556af2f43590 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0ca5f0 tx=0x7f5cec0998d0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.378+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3847573146 shutdown_connections 2023-07-14T13:03:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.378+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/3847573146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f43ad0 0x556af2f45eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.378+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/3847573146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 0x556af2f386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.378+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/3847573146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 0x556af2f43590 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.378+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3847573146 >> 172.21.15.17:0/3847573146 conn(0x556af2f2eda0 msgr2=0x556af2f346a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.379+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3847573146 shutdown_connections 2023-07-14T13:03:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.379+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3847573146 wait complete. 2023-07-14T13:03:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.379+0000 7f5d154dfb80 1 -- start start 2023-07-14T13:03:56.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.379+0000 7f5d154dfb80 1 Processor -- start 2023-07-14T13:03:56.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.380+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f382d0 0x556af2f43580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.380+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 0x556af2f40790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.380+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f43ad0 0x556af2f40ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.380+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2e2aac0 con 0x556af2f38be0 2023-07-14T13:03:56.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.380+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2e2a7c0 con 0x556af2f382d0 2023-07-14T13:03:56.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.380+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2d0e920 con 0x556af2f43ad0 2023-07-14T13:03:56.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.380+0000 7f5d154dfb80 10 client.0 _ll_register_callbacks cb 0x556af2e28760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:56.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.380+0000 7f5cfaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 0x556af2f40790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.380+0000 7f5cfaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 0x556af2f40790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43326/0 (socket says 172.21.15.17:43326) 2023-07-14T13:03:56.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.380+0000 7f5cfaffd700 1 -- 172.21.15.17:0/554091883 learned_addr learned my addr 172.21.15.17:0/554091883 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.380+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f382d0 0x556af2f43580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.381+0000 7f5cfbfff700 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f43ad0 0x556af2f40ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.381+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/554091883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f43ad0 msgr2=0x556af2f40ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.381+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f43ad0 0x556af2f40ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.381+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/554091883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 msgr2=0x556af2f40790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.381+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 0x556af2f40790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.381+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/554091883 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc1a4ab0 con 0x556af2f382d0 2023-07-14T13:03:56.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.381+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f382d0 0x556af2f43580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0982c0 tx=0x7f5cec0cab50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd5f0bff80a09981 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.381+0000 7f5cdaffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:03:56.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.381+0000 7f5cdaffd700 1 -- 172.21.15.17:0/554091883 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0a2140 con 0x556af2f382d0 2023-07-14T13:03:56.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.381+0000 7f5cdaffd700 1 -- 172.21.15.17:0/554091883 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5cec0b82a0 con 0x556af2f382d0 2023-07-14T13:03:56.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.381+0000 7f5d154dfb80 1 -- 172.21.15.17:0/554091883 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556af2de44f0 con 0x556af2f382d0 2023-07-14T13:03:56.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.382+0000 7f5cdaffd700 1 -- 172.21.15.17:0/554091883 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cec0ca170 con 0x556af2f382d0 2023-07-14T13:03:56.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.382+0000 7f5d154dfb80 10 client.26351 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:56.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.382+0000 7f5d154dfb80 1 -- 172.21.15.17:0/554091883 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556af2ca1c60 con 0x556af2f382d0 2023-07-14T13:03:56.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.382+0000 7f5cdaffd700 1 -- 172.21.15.17:0/554091883 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5cec07c080 con 0x556af2f382d0 2023-07-14T13:03:56.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.382+0000 7f5cdaffd700 1 -- 172.21.15.17:0/554091883 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f5cec095d60 con 0x556af2f382d0 2023-07-14T13:03:56.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.382+0000 7f5d154dfb80 10 client.26351 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:56.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.382+0000 7f5d154dfb80 10 client.26351 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:03:56.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.382+0000 7f5d154dfb80 20 client.26351 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:56.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.382+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556af2f53090 0x556af2f55470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.382+0000 7f5d154dfb80 4 client.26351 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:56.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.382+0000 7f5d154dfb80 1 -- 172.21.15.17:0/554091883 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556af2e83eb0 con 0x556af2f53090 2023-07-14T13:03:56.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.383+0000 7f5cfaffd700 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556af2f53090 0x556af2f55470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.383+0000 7f5cdaffd700 10 client.26351 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:03:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.383+0000 7f5cfaffd700 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556af2f53090 0x556af2f55470 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=afc4c168fddb64d6 server_cookie=63761f8032454944 in_seq=0 out_seq=0 2023-07-14T13:03:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5cdaffd700 1 -- 172.21.15.17:0/554091883 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556af2e83eb0 con 0x556af2f53090 2023-07-14T13:03:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5cdaffd700 10 client.26351 handle_command_reply: tid=0 2023-07-14T13:03:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5d154dfb80 1 client.26351 shutdown 2023-07-14T13:03:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5d154dfb80 1 -- 172.21.15.17:0/554091883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f382d0 msgr2=0x556af2f43580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f382d0 0x556af2f43580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0982c0 tx=0x7f5cec0cab50 comp rx=0 tx=0).stop 2023-07-14T13:03:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5d154dfb80 1 -- 172.21.15.17:0/554091883 shutdown_connections 2023-07-14T13:03:56.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f43ad0 0x556af2f40ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556af2f53090 0x556af2f55470 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f382d0 0x556af2f43580 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5cdaffd700 0 client.26351 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:03:56.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/554091883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f38be0 0x556af2f40790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.384+0000 7f5d154dfb80 1 -- 172.21.15.17:0/554091883 >> 172.21.15.17:0/554091883 conn(0x556af2f2eda0 msgr2=0x556af2f34230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.385+0000 7f5d154dfb80 1 -- 172.21.15.17:0/554091883 shutdown_connections 2023-07-14T13:03:56.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.385+0000 7f5d154dfb80 1 -- 172.21.15.17:0/554091883 wait complete. 2023-07-14T13:03:56.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.385+0000 7f5d154dfb80 20 client.26351 trim_cache size 0 max 16384 2023-07-14T13:03:56.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.400+0000 7f5d154dfb80 1 Processor -- start 2023-07-14T13:03:56.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.400+0000 7f5d154dfb80 1 -- start start 2023-07-14T13:03:56.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.401+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 0x556af2f3fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.401+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f38be0 0x556af2f430b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.401+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f43ad0 0x556af2f40030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.434 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.401+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2f5a190 con 0x556af2f43ad0 2023-07-14T13:03:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.401+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2f5a2d0 con 0x556af2f38be0 2023-07-14T13:03:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.401+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2f3b390 con 0x556af2f382d0 2023-07-14T13:03:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.401+0000 7f5cfbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f43ad0 0x556af2f40030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.401+0000 7f5cfb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 0x556af2f3fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.401+0000 7f5cfbfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f43ad0 0x556af2f40030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43334/0 (socket says 172.21.15.17:43334) 2023-07-14T13:03:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.401+0000 7f5cfaffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f38be0 0x556af2f430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.401+0000 7f5cfbfff700 1 -- 172.21.15.17:0/480637835 learned_addr learned my addr 172.21.15.17:0/480637835 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.402+0000 7f5cfaffd700 1 -- 172.21.15.17:0/480637835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 msgr2=0x556af2f3fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.402+0000 7f5cfaffd700 1 --2- 172.21.15.17:0/480637835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 0x556af2f3fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.402+0000 7f5cfaffd700 1 -- 172.21.15.17:0/480637835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f43ad0 msgr2=0x556af2f40030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.402+0000 7f5cfaffd700 1 --2- 172.21.15.17:0/480637835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f43ad0 0x556af2f40030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.402+0000 7f5cfaffd700 1 -- 172.21.15.17:0/480637835 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556af2cdf250 con 0x556af2f38be0 2023-07-14T13:03:56.437 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.402+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/480637835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 0x556af2f3fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:56.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.402+0000 7f5cfbfff700 1 --2- 172.21.15.17:0/480637835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f43ad0 0x556af2f40030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:56.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.402+0000 7f5cfaffd700 1 --2- 172.21.15.17:0/480637835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f38be0 0x556af2f430b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x556af2f55d80 tx=0x7f5cf0005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bd874d3705bb681 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.402+0000 7f5ce27fc700 1 -- 172.21.15.17:0/480637835 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf001d040 con 0x556af2f38be0 2023-07-14T13:03:56.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.402+0000 7f5ce27fc700 1 -- 172.21.15.17:0/480637835 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5cf001e040 con 0x556af2f38be0 2023-07-14T13:03:56.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.402+0000 7f5ce27fc700 1 -- 172.21.15.17:0/480637835 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0005360 con 0x556af2f38be0 2023-07-14T13:03:56.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.403+0000 7f5d154dfb80 1 -- 172.21.15.17:0/480637835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f38be0 msgr2=0x556af2f430b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.403+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/480637835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f38be0 0x556af2f430b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x556af2f55d80 tx=0x7f5cf0005960 comp rx=0 tx=0).stop 2023-07-14T13:03:56.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.403+0000 7f5d154dfb80 1 -- 172.21.15.17:0/480637835 shutdown_connections 2023-07-14T13:03:56.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.403+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/480637835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f43ad0 0x556af2f40030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.403+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/480637835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f382d0 0x556af2f3fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.403+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/480637835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f38be0 0x556af2f430b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.403+0000 7f5d154dfb80 1 -- 172.21.15.17:0/480637835 >> 172.21.15.17:0/480637835 conn(0x556af2f2eda0 msgr2=0x556af2f3ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.403+0000 7f5d154dfb80 1 -- 172.21.15.17:0/480637835 shutdown_connections 2023-07-14T13:03:56.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.403+0000 7f5d154dfb80 1 -- 172.21.15.17:0/480637835 wait complete. 2023-07-14T13:03:56.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.404+0000 7f5d154dfb80 1 -- start start 2023-07-14T13:03:56.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.404+0000 7f5d154dfb80 1 Processor -- start 2023-07-14T13:03:56.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.404+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f382d0 0x556af2f4a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.404+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f38be0 0x556af2f48920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.404+0000 7f5d154dfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f43ad0 0x556af2f48e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2f49530 con 0x556af2f382d0 2023-07-14T13:03:56.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2f496a0 con 0x556af2f43ad0 2023-07-14T13:03:56.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5d154dfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af2fa6f30 con 0x556af2f38be0 2023-07-14T13:03:56.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5d154dfb80 10 client.0 _ll_register_callbacks cb 0x7f5cf40114d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:56.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5cfb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f382d0 0x556af2f4a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5cfb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f382d0 0x556af2f4a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43350/0 (socket says 172.21.15.17:43350) 2023-07-14T13:03:56.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/3571453376 learned_addr learned my addr 172.21.15.17:0/3571453376 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5cfbfff700 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f43ad0 0x556af2f48e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5cfaffd700 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f38be0 0x556af2f48920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/3571453376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f38be0 msgr2=0x556af2f48920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f38be0 0x556af2f48920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/3571453376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f43ad0 msgr2=0x556af2f48e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f43ad0 0x556af2f48e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5cfb7fe700 1 -- 172.21.15.17:0/3571453376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cec018e70 con 0x556af2f382d0 2023-07-14T13:03:56.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.405+0000 7f5cfbfff700 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f43ad0 0x556af2f48e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:56.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.406+0000 7f5cfb7fe700 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f382d0 0x556af2f4a4a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5cec099c70 tx=0x7f5cec00e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9dc82ff70ca5e60 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.406+0000 7f5cdaffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:56.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.406+0000 7f5cdaffd700 1 -- 172.21.15.17:0/3571453376 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec095d60 con 0x556af2f382d0 2023-07-14T13:03:56.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.406+0000 7f5cdaffd700 1 -- 172.21.15.17:0/3571453376 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5cec078e40 con 0x556af2f382d0 2023-07-14T13:03:56.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.406+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3571453376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5cec09a1d0 con 0x556af2f382d0 2023-07-14T13:03:56.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.406+0000 7f5cdaffd700 1 -- 172.21.15.17:0/3571453376 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cec095ec0 con 0x556af2f382d0 2023-07-14T13:03:56.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.406+0000 7f5d154dfb80 10 client.16635 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.406+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3571453376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f5cf4011ac0 con 0x556af2f382d0 2023-07-14T13:03:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.406+0000 7f5cdaffd700 1 -- 172.21.15.17:0/3571453376 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5cec09a1d0 con 0x556af2f382d0 2023-07-14T13:03:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.407+0000 7f5cdaffd700 1 -- 172.21.15.17:0/3571453376 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f5cec0ca170 con 0x556af2f382d0 2023-07-14T13:03:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.407+0000 7f5d154dfb80 10 client.16635 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.407+0000 7f5d154dfb80 10 client.16635 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:03:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.407+0000 7f5d154dfb80 20 client.16635 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:56.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.407+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556af2fa7fa0 0x556af2faa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.407+0000 7f5d154dfb80 4 client.16635 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:03:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.407+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3571453376 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556af2e46050 con 0x556af2fa7fa0 2023-07-14T13:03:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.407+0000 7f5cfaffd700 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556af2fa7fa0 0x556af2faa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5cfaffd700 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556af2fa7fa0 0x556af2faa380 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d13aa332fc79acd9 server_cookie=edbd346a0a872aa3 in_seq=0 out_seq=0 2023-07-14T13:03:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5cdaffd700 10 client.16635 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:03:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5cdaffd700 1 -- 172.21.15.17:0/3571453376 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556af2e46050 con 0x556af2fa7fa0 2023-07-14T13:03:56.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5cdaffd700 10 client.16635 handle_command_reply: tid=0 2023-07-14T13:03:56.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5d154dfb80 1 client.16635 shutdown 2023-07-14T13:03:56.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3571453376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f382d0 msgr2=0x556af2f4a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f382d0 0x556af2f4a4a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5cec099c70 tx=0x7f5cec00e8f0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3571453376 shutdown_connections 2023-07-14T13:03:56.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556af2fa7fa0 0x556af2faa380 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556af2f43ad0 0x556af2f48e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556af2f382d0 0x556af2f4a4a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5d154dfb80 1 --2- 172.21.15.17:0/3571453376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556af2f38be0 0x556af2f48920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5cdaffd700 0 client.16635 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:03:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3571453376 >> 172.21.15.17:0/3571453376 conn(0x556af2f2eda0 msgr2=0x556af2f40000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3571453376 shutdown_connections 2023-07-14T13:03:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.408+0000 7f5d154dfb80 1 -- 172.21.15.17:0/3571453376 wait complete. 2023-07-14T13:03:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d154dfb80 20 client.16635 trim_cache size 0 max 16384 2023-07-14T13:03:56.449 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:03:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d01bff700 1 -- 172.21.15.17:0/3402406934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5ce40a1340 msgr2=0x7f5ce40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d01bff700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5ce40a1340 0x7f5ce40a37f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40060b0 tx=0x7f5cf400b040 comp rx=0 tx=0).stop 2023-07-14T13:03:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d01bff700 1 -- 172.21.15.17:0/3402406934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cfc0ffad0 msgr2=0x7f5cfc19da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d01bff700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cfc0ffad0 0x7f5cfc19da10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00e9a0 tx=0x7f5cec00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d01bff700 1 -- 172.21.15.17:0/3402406934 shutdown_connections 2023-07-14T13:03:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d01bff700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5ce40a1340 0x7f5ce40a37f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d01bff700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cfc105ae0 0x7f5cfc197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d01bff700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5cfc0ffad0 0x7f5cfc19da10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d01bff700 1 --2- 172.21.15.17:0/3402406934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cfc100480 0x7f5cfc19df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d01bff700 1 -- 172.21.15.17:0/3402406934 >> 172.21.15.17:0/3402406934 conn(0x7f5cfc0fb5f0 msgr2=0x7f5cfc10ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.409+0000 7f5d01bff700 1 -- 172.21.15.17:0/3402406934 shutdown_connections 2023-07-14T13:03:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.410+0000 7f5d01bff700 1 -- 172.21.15.17:0/3402406934 wait complete. 2023-07-14T13:03:56.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:56 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/852624730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:03:56.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:03:56.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:56 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/852624730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:03:56.655 INFO:teuthology.orchestra.run.smithi017.stderr:14500000 of 50000000 tuples (29%) done (elapsed 226.26 s, remaining 553.94 s) 2023-07-14T13:03:56.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.655+0000 7f63319ff700 1 -- 172.21.15.17:0/127664745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c100d00 msgr2=0x7f632c1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.655+0000 7f63319ff700 1 --2- 172.21.15.17:0/127664745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c100d00 0x7f632c1010d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f631c009990 tx=0x7f631c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.656+0000 7f63319ff700 1 -- 172.21.15.17:0/127664745 shutdown_connections 2023-07-14T13:03:56.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.656+0000 7f63319ff700 1 --2- 172.21.15.17:0/127664745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c10a040 0x7f632c10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.656+0000 7f63319ff700 1 --2- 172.21.15.17:0/127664745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c100d00 0x7f632c1010d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.656+0000 7f63319ff700 1 --2- 172.21.15.17:0/127664745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f632c101610 0x7f632c109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.656+0000 7f63319ff700 1 -- 172.21.15.17:0/127664745 >> 172.21.15.17:0/127664745 conn(0x7f632c0fa4b0 msgr2=0x7f632c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.656+0000 7f63319ff700 1 -- 172.21.15.17:0/127664745 shutdown_connections 2023-07-14T13:03:56.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.656+0000 7f63319ff700 1 -- 172.21.15.17:0/127664745 wait complete. 2023-07-14T13:03:56.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.657+0000 7f63319ff700 1 Processor -- start 2023-07-14T13:03:56.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.657+0000 7f63319ff700 1 -- start start 2023-07-14T13:03:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.658+0000 7f63319ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c100d00 0x7f632c197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.658+0000 7f63319ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f632c101610 0x7f632c1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.658+0000 7f63319ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c10a040 0x7f632c19c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.658+0000 7f63319ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c19cd50 con 0x7f632c100d00 2023-07-14T13:03:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.658+0000 7f63319ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c19cec0 con 0x7f632c101610 2023-07-14T13:03:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.658+0000 7f63319ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c19d080 con 0x7f632c10a040 2023-07-14T13:03:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.658+0000 7f632affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c100d00 0x7f632c197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.658+0000 7f632affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c100d00 0x7f632c197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43362/0 (socket says 172.21.15.17:43362) 2023-07-14T13:03:56.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.658+0000 7f632affd700 1 -- 172.21.15.17:0/1385451 learned_addr learned my addr 172.21.15.17:0/1385451 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.658+0000 7f632a7fc700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f632c101610 0x7f632c1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.658+0000 7f632b7fe700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c10a040 0x7f632c19c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f632affd700 1 -- 172.21.15.17:0/1385451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c10a040 msgr2=0x7f632c19c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f632affd700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c10a040 0x7f632c19c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f632affd700 1 -- 172.21.15.17:0/1385451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f632c101610 msgr2=0x7f632c1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f632affd700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f632c101610 0x7f632c1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f632affd700 1 -- 172.21.15.17:0/1385451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c0095f0 con 0x7f632c100d00 2023-07-14T13:03:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f632b7fe700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c10a040 0x7f632c19c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f632affd700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c100d00 0x7f632c197d70 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f631c005740 tx=0x7f631c005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f63309fd700 1 -- 172.21.15.17:0/1385451 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c01d070 con 0x7f632c100d00 2023-07-14T13:03:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f63319ff700 1 -- 172.21.15.17:0/1385451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632c19d300 con 0x7f632c100d00 2023-07-14T13:03:56.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f63309fd700 1 -- 172.21.15.17:0/1385451 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f631c022470 con 0x7f632c100d00 2023-07-14T13:03:56.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f63309fd700 1 -- 172.21.15.17:0/1385451 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c017650 con 0x7f632c100d00 2023-07-14T13:03:56.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.659+0000 7f63319ff700 1 -- 172.21.15.17:0/1385451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632c1a4ba0 con 0x7f632c100d00 2023-07-14T13:03:56.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.663+0000 7f63309fd700 1 -- 172.21.15.17:0/1385451 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f631c00fb00 con 0x7f632c100d00 2023-07-14T13:03:56.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.665+0000 7f63453d8b80 1 Processor -- start 2023-07-14T13:03:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.665+0000 7f63309fd700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63140a1340 0x7f63140a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.665+0000 7f63453d8b80 1 -- start start 2023-07-14T13:03:56.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.665+0000 7f63309fd700 1 -- 172.21.15.17:0/1385451 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f631c0ce210 con 0x7f632c100d00 2023-07-14T13:03:56.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.665+0000 7f632b7fe700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63140a1340 0x7f63140a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.665+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f6b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.665+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f6bbe0 0x559a87f76590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.665+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 0x559a87f78eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.665+0000 7f63453d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87e71cb0 con 0x559a87f76ad0 2023-07-14T13:03:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.665+0000 7f63453d8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87ec4a40 con 0x559a87f6b2d0 2023-07-14T13:03:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.665+0000 7f63453d8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87ebded0 con 0x559a87f6bbe0 2023-07-14T13:03:56.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.666+0000 7f632b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 0x559a87f78eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.666+0000 7f632affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f6b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.666+0000 7f632b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 0x559a87f78eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43364/0 (socket says 172.21.15.17:43364) 2023-07-14T13:03:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.666+0000 7f632b7fe700 1 -- 172.21.15.17:0/728690260 learned_addr learned my addr 172.21.15.17:0/728690260 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.666+0000 7f632a7fc700 1 --2- 172.21.15.17:0/728690260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f6bbe0 0x559a87f76590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.666+0000 7f632affd700 1 -- 172.21.15.17:0/728690260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f6bbe0 msgr2=0x559a87f76590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.666+0000 7f632affd700 1 --2- 172.21.15.17:0/728690260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f6bbe0 0x559a87f76590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.666+0000 7f632affd700 1 -- 172.21.15.17:0/728690260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 msgr2=0x559a87f78eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.666+0000 7f632affd700 1 --2- 172.21.15.17:0/728690260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 0x559a87f78eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.666+0000 7f632affd700 1 -- 172.21.15.17:0/728690260 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a87cebde0 con 0x559a87f6b2d0 2023-07-14T13:03:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.666+0000 7f632b7fe700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63140a1340 0x7f63140a37f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63240094f0 tx=0x7f6324007ba0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.667+0000 7f632affd700 1 --2- 172.21.15.17:0/728690260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f6b6a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f631c0cb970 tx=0x7f631c095f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab8a0befba05bee0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.667+0000 7f6311ffb700 1 -- 172.21.15.17:0/728690260 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c09b380 con 0x559a87f6b2d0 2023-07-14T13:03:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.667+0000 7f6311ffb700 1 -- 172.21.15.17:0/728690260 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f631c09f3b0 con 0x559a87f6b2d0 2023-07-14T13:03:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.667+0000 7f6311ffb700 1 -- 172.21.15.17:0/728690260 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c022850 con 0x559a87f6b2d0 2023-07-14T13:03:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.668+0000 7f63453d8b80 1 -- 172.21.15.17:0/728690260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 msgr2=0x559a87f6b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.668+0000 7f63453d8b80 1 --2- 172.21.15.17:0/728690260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f6b6a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f631c0cb970 tx=0x7f631c095f90 comp rx=0 tx=0).stop 2023-07-14T13:03:56.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.668+0000 7f63453d8b80 1 -- 172.21.15.17:0/728690260 shutdown_connections 2023-07-14T13:03:56.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.668+0000 7f63453d8b80 1 --2- 172.21.15.17:0/728690260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 0x559a87f78eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.668+0000 7f63453d8b80 1 --2- 172.21.15.17:0/728690260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f6b6a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.668+0000 7f63453d8b80 1 --2- 172.21.15.17:0/728690260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f6bbe0 0x559a87f76590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.668+0000 7f63453d8b80 1 -- 172.21.15.17:0/728690260 >> 172.21.15.17:0/728690260 conn(0x559a87f61da0 msgr2=0x559a87f676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.668+0000 7f63453d8b80 1 -- 172.21.15.17:0/728690260 shutdown_connections 2023-07-14T13:03:56.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.668+0000 7f63453d8b80 1 -- 172.21.15.17:0/728690260 wait complete. 2023-07-14T13:03:56.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.669+0000 7f63453d8b80 1 -- start start 2023-07-14T13:03:56.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.669+0000 7f63453d8b80 1 Processor -- start 2023-07-14T13:03:56.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.669+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6b2d0 0x559a87f76ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.669+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6bbe0 0x559a87f773e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.669+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f76ad0 0x559a87f77920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.669+0000 7f63453d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87e5dac0 con 0x559a87f6b2d0 2023-07-14T13:03:56.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.669+0000 7f63453d8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87e5d7c0 con 0x559a87f6bbe0 2023-07-14T13:03:56.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.669+0000 7f63453d8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87d41920 con 0x559a87f76ad0 2023-07-14T13:03:56.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.669+0000 7f63453d8b80 10 client.0 _ll_register_callbacks cb 0x559a87e5b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:56.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6b2d0 0x559a87f76ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6b2d0 0x559a87f76ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43376/0 (socket says 172.21.15.17:43376) 2023-07-14T13:03:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632affd700 1 -- 172.21.15.17:0/4052805517 learned_addr learned my addr 172.21.15.17:0/4052805517 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632b7fe700 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f76ad0 0x559a87f77920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632a7fc700 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6bbe0 0x559a87f773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632affd700 1 -- 172.21.15.17:0/4052805517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f76ad0 msgr2=0x559a87f77920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632affd700 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f76ad0 0x559a87f77920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632affd700 1 -- 172.21.15.17:0/4052805517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6bbe0 msgr2=0x559a87f773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632affd700 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6bbe0 0x559a87f773e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632affd700 1 -- 172.21.15.17:0/4052805517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632c1a4ba0 con 0x559a87f6b2d0 2023-07-14T13:03:56.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632a7fc700 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6bbe0 0x559a87f773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:56.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f632affd700 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6b2d0 0x559a87f76ea0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f631c097010 tx=0x7f631c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14b13800ab0d5a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.670+0000 7f630affd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:56.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f630affd700 1 -- 172.21.15.17:0/4052805517 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c09b380 con 0x559a87f6b2d0 2023-07-14T13:03:56.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f63453d8b80 1 -- 172.21.15.17:0/4052805517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a87e174f0 con 0x559a87f6b2d0 2023-07-14T13:03:56.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f630affd700 1 -- 172.21.15.17:0/4052805517 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f631c099720 con 0x559a87f6b2d0 2023-07-14T13:03:56.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f630affd700 1 -- 172.21.15.17:0/4052805517 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f631c022850 con 0x559a87f6b2d0 2023-07-14T13:03:56.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f63453d8b80 10 client.16647 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:56.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f63453d8b80 1 -- 172.21.15.17:0/4052805517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559a87cd4c60 con 0x559a87f6b2d0 2023-07-14T13:03:56.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f630affd700 1 -- 172.21.15.17:0/4052805517 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559a87e174f0 con 0x559a87f6b2d0 2023-07-14T13:03:56.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f630affd700 1 -- 172.21.15.17:0/4052805517 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f631c0a32b0 con 0x559a87f6b2d0 2023-07-14T13:03:56.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f63453d8b80 10 client.16647 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:56.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f63453d8b80 10 client.16647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:56.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f63453d8b80 20 client.16647 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:56.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f63453d8b80 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559a87f85bf0 0x559a87f87fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.671+0000 7f63453d8b80 4 client.16647 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:56.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.672+0000 7f63453d8b80 1 -- 172.21.15.17:0/4052805517 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a87eb6eb0 con 0x559a87f85bf0 2023-07-14T13:03:56.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.672+0000 7f632a7fc700 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559a87f85bf0 0x559a87f87fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.673+0000 7f632a7fc700 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559a87f85bf0 0x559a87f87fd0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a00c25e0fae785c0 server_cookie=bb29826bd7bfc464 in_seq=0 out_seq=0 2023-07-14T13:03:56.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.673+0000 7f630affd700 10 client.16647 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:56.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.673+0000 7f630affd700 1 -- 172.21.15.17:0/4052805517 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559a87eb6eb0 con 0x559a87f85bf0 2023-07-14T13:03:56.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.673+0000 7f630affd700 10 client.16647 handle_command_reply: tid=0 2023-07-14T13:03:56.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.673+0000 7f63453d8b80 1 client.16647 shutdown 2023-07-14T13:03:56.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f63453d8b80 1 -- 172.21.15.17:0/4052805517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6b2d0 msgr2=0x559a87f76ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f63453d8b80 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6b2d0 0x559a87f76ea0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f631c097010 tx=0x7f631c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f63453d8b80 1 -- 172.21.15.17:0/4052805517 shutdown_connections 2023-07-14T13:03:56.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f63453d8b80 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559a87f85bf0 0x559a87f87fd0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f63453d8b80 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f76ad0 0x559a87f77920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f63453d8b80 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6b2d0 0x559a87f76ea0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f63453d8b80 1 --2- 172.21.15.17:0/4052805517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6bbe0 0x559a87f773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f630affd700 0 client.16647 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:56.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f63453d8b80 1 -- 172.21.15.17:0/4052805517 >> 172.21.15.17:0/4052805517 conn(0x559a87f61da0 msgr2=0x559a87f67230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f63453d8b80 1 -- 172.21.15.17:0/4052805517 shutdown_connections 2023-07-14T13:03:56.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f63453d8b80 1 -- 172.21.15.17:0/4052805517 wait complete. 2023-07-14T13:03:56.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.674+0000 7f63453d8b80 20 client.16647 trim_cache size 0 max 16384 2023-07-14T13:03:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.690+0000 7f63453d8b80 1 Processor -- start 2023-07-14T13:03:56.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.690+0000 7f63453d8b80 1 -- start start 2023-07-14T13:03:56.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.690+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f75410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.690+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f6bbe0 0x559a87f81680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.690+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 0x559a87f6f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.690+0000 7f63453d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87f6c000 con 0x559a87f76ad0 2023-07-14T13:03:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.690+0000 7f63453d8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87f709f0 con 0x559a87f6b2d0 2023-07-14T13:03:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.690+0000 7f63453d8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87f619a0 con 0x559a87f6bbe0 2023-07-14T13:03:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 0x559a87f6f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 0x559a87f6f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43392/0 (socket says 172.21.15.17:43392) 2023-07-14T13:03:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632b7fe700 1 -- 172.21.15.17:0/3101335603 learned_addr learned my addr 172.21.15.17:0/3101335603 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632affd700 1 --2- 172.21.15.17:0/3101335603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f75410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632a7fc700 1 --2- 172.21.15.17:0/3101335603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f6bbe0 0x559a87f81680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632affd700 1 -- 172.21.15.17:0/3101335603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f6bbe0 msgr2=0x559a87f81680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632affd700 1 --2- 172.21.15.17:0/3101335603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f6bbe0 0x559a87f81680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632affd700 1 -- 172.21.15.17:0/3101335603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 msgr2=0x559a87f6f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632affd700 1 --2- 172.21.15.17:0/3101335603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 0x559a87f6f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632affd700 1 -- 172.21.15.17:0/3101335603 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a87d12250 con 0x559a87f6b2d0 2023-07-14T13:03:56.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632b7fe700 1 --2- 172.21.15.17:0/3101335603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 0x559a87f6f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:56.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.691+0000 7f632affd700 1 --2- 172.21.15.17:0/3101335603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f75410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f631c09b310 tx=0x7f631c00b490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3637ada429f419f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.692+0000 7f63127fc700 1 -- 172.21.15.17:0/3101335603 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c09a870 con 0x559a87f6b2d0 2023-07-14T13:03:56.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.692+0000 7f63127fc700 1 -- 172.21.15.17:0/3101335603 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f631c09b380 con 0x559a87f6b2d0 2023-07-14T13:03:56.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.692+0000 7f63127fc700 1 -- 172.21.15.17:0/3101335603 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c0a32b0 con 0x559a87f6b2d0 2023-07-14T13:03:56.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.692+0000 7f63453d8b80 1 -- 172.21.15.17:0/3101335603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 msgr2=0x559a87f75410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.692+0000 7f63453d8b80 1 --2- 172.21.15.17:0/3101335603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f75410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f631c09b310 tx=0x7f631c00b490 comp rx=0 tx=0).stop 2023-07-14T13:03:56.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.692+0000 7f63453d8b80 1 -- 172.21.15.17:0/3101335603 shutdown_connections 2023-07-14T13:03:56.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.692+0000 7f63453d8b80 1 --2- 172.21.15.17:0/3101335603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f76ad0 0x559a87f6f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.692+0000 7f63453d8b80 1 --2- 172.21.15.17:0/3101335603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f75410 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.692+0000 7f63453d8b80 1 --2- 172.21.15.17:0/3101335603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f6bbe0 0x559a87f81680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.692+0000 7f63453d8b80 1 -- 172.21.15.17:0/3101335603 >> 172.21.15.17:0/3101335603 conn(0x559a87f61da0 msgr2=0x559a87f82410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.693+0000 7f63453d8b80 1 -- 172.21.15.17:0/3101335603 shutdown_connections 2023-07-14T13:03:56.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.693+0000 7f63453d8b80 1 -- 172.21.15.17:0/3101335603 wait complete. 2023-07-14T13:03:56.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.693+0000 7f63453d8b80 1 -- start start 2023-07-14T13:03:56.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.694+0000 7f63453d8b80 1 Processor -- start 2023-07-14T13:03:56.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.694+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f7ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.694+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6bbe0 0x559a87f7b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.694+0000 7f63453d8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f76ad0 0x559a87f79080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.694+0000 7f63453d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87f79750 con 0x559a87f6bbe0 2023-07-14T13:03:56.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.694+0000 7f63453d8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87f798c0 con 0x559a87f6b2d0 2023-07-14T13:03:56.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.694+0000 7f63453d8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a87f79a80 con 0x559a87f76ad0 2023-07-14T13:03:56.730 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.694+0000 7f63453d8b80 10 client.0 _ll_register_callbacks cb 0x7f6324009230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:56.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.694+0000 7f632a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6bbe0 0x559a87f7b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f632a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6bbe0 0x559a87f7b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43396/0 (socket says 172.21.15.17:43396) 2023-07-14T13:03:56.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f632a7fc700 1 -- 172.21.15.17:0/3162124131 learned_addr learned my addr 172.21.15.17:0/3162124131 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:56.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f632affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f7ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f632b7fe700 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f76ad0 0x559a87f79080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f632a7fc700 1 -- 172.21.15.17:0/3162124131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f76ad0 msgr2=0x559a87f79080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f632a7fc700 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f76ad0 0x559a87f79080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f632a7fc700 1 -- 172.21.15.17:0/3162124131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 msgr2=0x559a87f7ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:56.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f632a7fc700 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f7ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f632a7fc700 1 -- 172.21.15.17:0/3162124131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63240176c0 con 0x559a87f6bbe0 2023-07-14T13:03:56.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f632affd700 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f7ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:56.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f632a7fc700 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6bbe0 0x559a87f7b0d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x559a87f888a0 tx=0x7f632001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93a1309428b2f07 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:56.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.695+0000 7f630affd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:56.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.696+0000 7f630affd700 1 -- 172.21.15.17:0/3162124131 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632001cb60 con 0x559a87f6bbe0 2023-07-14T13:03:56.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.696+0000 7f630affd700 1 -- 172.21.15.17:0/3162124131 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f632001ccc0 con 0x559a87f6bbe0 2023-07-14T13:03:56.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.696+0000 7f63453d8b80 1 -- 172.21.15.17:0/3162124131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f631c09f3b0 con 0x559a87f6bbe0 2023-07-14T13:03:56.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.696+0000 7f630affd700 1 -- 172.21.15.17:0/3162124131 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f632001c610 con 0x559a87f6bbe0 2023-07-14T13:03:56.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.696+0000 7f63453d8b80 10 client.16653 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:56.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.696+0000 7f63453d8b80 1 -- 172.21.15.17:0/3162124131 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559a87cd4c60 con 0x559a87f6bbe0 2023-07-14T13:03:56.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.696+0000 7f630affd700 1 -- 172.21.15.17:0/3162124131 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f631c09f3b0 con 0x559a87f6bbe0 2023-07-14T13:03:56.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.696+0000 7f630affd700 1 -- 172.21.15.17:0/3162124131 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f6320005350 con 0x559a87f6bbe0 2023-07-14T13:03:56.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.697+0000 7f63453d8b80 10 client.16653 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:56.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.697+0000 7f63453d8b80 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:56.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.697+0000 7f63453d8b80 20 client.16653 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:56.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.697+0000 7f63453d8b80 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559a87fdad70 0x559a87fdd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:56.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.697+0000 7f63453d8b80 4 client.16653 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:03:56.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.697+0000 7f63453d8b80 1 -- 172.21.15.17:0/3162124131 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559a87e79050 con 0x559a87fdad70 2023-07-14T13:03:56.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.697+0000 7f632affd700 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559a87fdad70 0x559a87fdd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:56.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f630affd700 10 client.16653 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:56.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f632affd700 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559a87fdad70 0x559a87fdd180 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd1ead8a5daed8b7 server_cookie=52790c60c854923c in_seq=0 out_seq=0 2023-07-14T13:03:56.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f630affd700 1 -- 172.21.15.17:0/3162124131 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559a87e79050 con 0x559a87fdad70 2023-07-14T13:03:56.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f630affd700 10 client.16653 handle_command_reply: tid=0 2023-07-14T13:03:56.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f63453d8b80 1 client.16653 shutdown 2023-07-14T13:03:56.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f63453d8b80 1 -- 172.21.15.17:0/3162124131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6bbe0 msgr2=0x559a87f7b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f63453d8b80 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6bbe0 0x559a87f7b0d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x559a87f888a0 tx=0x7f632001c480 comp rx=0 tx=0).stop 2023-07-14T13:03:56.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f63453d8b80 1 -- 172.21.15.17:0/3162124131 shutdown_connections 2023-07-14T13:03:56.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f63453d8b80 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559a87fdad70 0x559a87fdd180 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f63453d8b80 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a87f76ad0 0x559a87f79080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f63453d8b80 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a87f6b2d0 0x559a87f7ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f63453d8b80 1 --2- 172.21.15.17:0/3162124131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559a87f6bbe0 0x559a87f7b0d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f63453d8b80 1 -- 172.21.15.17:0/3162124131 >> 172.21.15.17:0/3162124131 conn(0x559a87f61da0 msgr2=0x559a87f81680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f630affd700 0 client.16653 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f63453d8b80 1 -- 172.21.15.17:0/3162124131 shutdown_connections 2023-07-14T13:03:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.698+0000 7f63453d8b80 1 -- 172.21.15.17:0/3162124131 wait complete. 2023-07-14T13:03:56.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.699+0000 7f63453d8b80 20 client.16653 trim_cache size 0 max 16384 2023-07-14T13:03:56.739 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:03:56.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.699+0000 7f63319ff700 1 -- 172.21.15.17:0/1385451 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63140a1340 msgr2=0x7f63140a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.699+0000 7f63319ff700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63140a1340 0x7f63140a37f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63240094f0 tx=0x7f6324007ba0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.699+0000 7f63319ff700 1 -- 172.21.15.17:0/1385451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c100d00 msgr2=0x7f632c197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.699+0000 7f63319ff700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c100d00 0x7f632c197d70 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f631c005740 tx=0x7f631c005770 comp rx=0 tx=0).stop 2023-07-14T13:03:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.699+0000 7f63319ff700 1 -- 172.21.15.17:0/1385451 shutdown_connections 2023-07-14T13:03:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.699+0000 7f63319ff700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63140a1340 0x7f63140a37f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.699+0000 7f63319ff700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f632c10a040 0x7f632c19c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.699+0000 7f63319ff700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f632c100d00 0x7f632c197d70 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.699+0000 7f63319ff700 1 --2- 172.21.15.17:0/1385451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f632c101610 0x7f632c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.699+0000 7f63319ff700 1 -- 172.21.15.17:0/1385451 >> 172.21.15.17:0/1385451 conn(0x7f632c0fa4b0 msgr2=0x7f632c10c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.700+0000 7f63319ff700 1 -- 172.21.15.17:0/1385451 shutdown_connections 2023-07-14T13:03:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:56.700+0000 7f63319ff700 1 -- 172.21.15.17:0/1385451 wait complete. 2023-07-14T13:03:57.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:57 smithi135 ceph-mon[97338]: pgmap v129: 97 pgs: 97 active+clean; 3.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 34 MiB/s wr, 49 op/s 2023-07-14T13:03:57.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:57 smithi131 ceph-mon[96953]: pgmap v129: 97 pgs: 97 active+clean; 3.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 34 MiB/s wr, 49 op/s 2023-07-14T13:03:57.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:57 smithi017 ceph-mon[95536]: pgmap v129: 97 pgs: 97 active+clean; 3.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 34 MiB/s wr, 49 op/s 2023-07-14T13:03:57.754 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:03:57.755 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:03:58.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.973+0000 7f1167fff700 1 -- 172.21.15.17:0/3281017869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11680ff1a0 msgr2=0x7f1168103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.973+0000 7f1167fff700 1 --2- 172.21.15.17:0/3281017869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11680ff1a0 0x7f1168103850 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f115c0098f0 tx=0x7f115c009c00 comp rx=0 tx=0).stop 2023-07-14T13:03:58.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.973+0000 7f1167fff700 1 -- 172.21.15.17:0/3281017869 shutdown_connections 2023-07-14T13:03:58.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.973+0000 7f1167fff700 1 --2- 172.21.15.17:0/3281017869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1168103d90 0x7f1168104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.973+0000 7f1167fff700 1 --2- 172.21.15.17:0/3281017869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11680fe890 0x7f11680fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.973+0000 7f1167fff700 1 --2- 172.21.15.17:0/3281017869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11680ff1a0 0x7f1168103850 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.973+0000 7f1167fff700 1 -- 172.21.15.17:0/3281017869 >> 172.21.15.17:0/3281017869 conn(0x7f11680745d0 msgr2=0x7f11680749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.973+0000 7f1167fff700 1 -- 172.21.15.17:0/3281017869 shutdown_connections 2023-07-14T13:03:58.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.973+0000 7f1167fff700 1 -- 172.21.15.17:0/3281017869 wait complete. 2023-07-14T13:03:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.974+0000 7f1167fff700 1 Processor -- start 2023-07-14T13:03:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.974+0000 7f1167fff700 1 -- start start 2023-07-14T13:03:58.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.975+0000 7f1167fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11680fe890 0x7f116819bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.975+0000 7f1167fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11680ff1a0 0x7f116819c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.975+0000 7f1167fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1168103d90 0x7f11681a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.975+0000 7f1167fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11681a0f20 con 0x7f11680fe890 2023-07-14T13:03:58.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.975+0000 7f1167fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11681a1090 con 0x7f1168103d90 2023-07-14T13:03:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.975+0000 7f1167fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11681a1250 con 0x7f11680ff1a0 2023-07-14T13:03:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.975+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11680fe890 0x7f116819bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.975+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11680fe890 0x7f116819bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43404/0 (socket says 172.21.15.17:43404) 2023-07-14T13:03:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.976+0000 7f1166ffd700 1 -- 172.21.15.17:0/3649275861 learned_addr learned my addr 172.21.15.17:0/3649275861 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:58.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.976+0000 7f11667fc700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11680ff1a0 0x7f116819c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.976+0000 7f11677fe700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1168103d90 0x7f11681a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.976+0000 7f1166ffd700 1 -- 172.21.15.17:0/3649275861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11680ff1a0 msgr2=0x7f116819c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.976+0000 7f1166ffd700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11680ff1a0 0x7f116819c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.976+0000 7f1166ffd700 1 -- 172.21.15.17:0/3649275861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1168103d90 msgr2=0x7f11681a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.976+0000 7f1166ffd700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1168103d90 0x7f11681a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.976+0000 7f1166ffd700 1 -- 172.21.15.17:0/3649275861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c009520 con 0x7f11680fe890 2023-07-14T13:03:58.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.976+0000 7f1166ffd700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11680fe890 0x7f116819bf40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f115800e9c0 tx=0x7f115800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.977+0000 7f114ffff700 1 -- 172.21.15.17:0/3649275861 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158004a30 con 0x7f11680fe890 2023-07-14T13:03:58.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.977+0000 7f114ffff700 1 -- 172.21.15.17:0/3649275861 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f115800cc50 con 0x7f11680fe890 2023-07-14T13:03:58.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.977+0000 7f114ffff700 1 -- 172.21.15.17:0/3649275861 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158005410 con 0x7f11680fe890 2023-07-14T13:03:58.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.977+0000 7f1167fff700 1 -- 172.21.15.17:0/3649275861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11681a1530 con 0x7f11680fe890 2023-07-14T13:03:58.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.977+0000 7f1167fff700 1 -- 172.21.15.17:0/3649275861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11681a8d70 con 0x7f11680fe890 2023-07-14T13:03:58.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.982+0000 7f114ffff700 1 -- 172.21.15.17:0/3649275861 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1158005570 con 0x7f11680fe890 2023-07-14T13:03:58.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.983+0000 7f1180db6b80 1 Processor -- start 2023-07-14T13:03:58.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.983+0000 7f1180db6b80 1 -- start start 2023-07-14T13:03:58.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 0x56468cfd0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfd0e80 0x56468cfda870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 0x56468cfdd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f1180db6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468ced5d30 con 0x56468cfd0e80 2023-07-14T13:03:58.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f1180db6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468cf28ac0 con 0x56468cfdadb0 2023-07-14T13:03:58.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f1180db6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468cf21f50 con 0x56468cfd0570 2023-07-14T13:03:58.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f114ffff700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11500a1460 0x7f11500a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f11677fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 0x56468cfd0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f11677fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 0x56468cfd0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:33104/0 (socket says 172.21.15.17:33104) 2023-07-14T13:03:58.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f11677fe700 1 -- 172.21.15.17:0/1259707017 learned_addr learned my addr 172.21.15.17:0/1259707017 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:58.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f1166ffd700 1 --2- 172.21.15.17:0/1259707017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfd0e80 0x56468cfda870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.984+0000 7f11667fc700 1 --2- 172.21.15.17:0/1259707017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 0x56468cfdd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.985+0000 7f11677fe700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11500a1460 0x7f11500a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.985+0000 7f11667fc700 1 -- 172.21.15.17:0/1259707017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 msgr2=0x56468cfd0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.985+0000 7f11667fc700 1 --2- 172.21.15.17:0/1259707017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 0x56468cfd0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.985+0000 7f11667fc700 1 -- 172.21.15.17:0/1259707017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfd0e80 msgr2=0x56468cfda870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.985+0000 7f11667fc700 1 --2- 172.21.15.17:0/1259707017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfd0e80 0x56468cfda870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.985+0000 7f114ffff700 1 -- 172.21.15.17:0/3649275861 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1158014070 con 0x7f11680fe890 2023-07-14T13:03:58.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.985+0000 7f11667fc700 1 -- 172.21.15.17:0/1259707017 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56468cd4fe60 con 0x56468cfdadb0 2023-07-14T13:03:58.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.985+0000 7f11667fc700 1 --2- 172.21.15.17:0/1259707017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 0x56468cfdd190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f115c009810 tx=0x7f115c005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a917141faffcf92 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.985+0000 7f11677fe700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11500a1460 0x7f11500a3910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1160009fd0 tx=0x7f1160004b40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.985+0000 7f114d7fa700 1 -- 172.21.15.17:0/1259707017 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c00fe60 con 0x56468cfdadb0 2023-07-14T13:03:58.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.986+0000 7f114d7fa700 1 -- 172.21.15.17:0/1259707017 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f115c01d040 con 0x56468cfdadb0 2023-07-14T13:03:58.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.986+0000 7f114d7fa700 1 -- 172.21.15.17:0/1259707017 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c005040 con 0x56468cfdadb0 2023-07-14T13:03:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.986+0000 7f1180db6b80 1 -- 172.21.15.17:0/1259707017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 msgr2=0x56468cfdd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.986+0000 7f1180db6b80 1 --2- 172.21.15.17:0/1259707017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 0x56468cfdd190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f115c009810 tx=0x7f115c005dc0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.986+0000 7f1180db6b80 1 -- 172.21.15.17:0/1259707017 shutdown_connections 2023-07-14T13:03:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.986+0000 7f1180db6b80 1 --2- 172.21.15.17:0/1259707017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 0x56468cfdd190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.986+0000 7f1180db6b80 1 --2- 172.21.15.17:0/1259707017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 0x56468cfd0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.986+0000 7f1180db6b80 1 --2- 172.21.15.17:0/1259707017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfd0e80 0x56468cfda870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.986+0000 7f1180db6b80 1 -- 172.21.15.17:0/1259707017 >> 172.21.15.17:0/1259707017 conn(0x56468cfc6070 msgr2=0x56468cfcb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.987+0000 7f1180db6b80 1 -- 172.21.15.17:0/1259707017 shutdown_connections 2023-07-14T13:03:58.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.987+0000 7f1180db6b80 1 -- 172.21.15.17:0/1259707017 wait complete. 2023-07-14T13:03:58.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.987+0000 7f1180db6b80 1 -- start start 2023-07-14T13:03:58.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.988+0000 7f1180db6b80 1 Processor -- start 2023-07-14T13:03:58.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.988+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfd0570 0x56468cfda720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.988+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0e80 0x56468cfd79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.988+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 0x56468cfd7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.988+0000 7f1180db6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468cec1b40 con 0x56468cfd0570 2023-07-14T13:03:58.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.988+0000 7f1180db6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468cec1840 con 0x56468cfdadb0 2023-07-14T13:03:58.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.988+0000 7f1180db6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468cda59a0 con 0x56468cfd0e80 2023-07-14T13:03:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.988+0000 7f1180db6b80 10 client.0 _ll_register_callbacks cb 0x56468cebf7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfd0570 0x56468cfda720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f11677fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 0x56468cfd7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfd0570 0x56468cfda720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43426/0 (socket says 172.21.15.17:43426) 2023-07-14T13:03:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f1166ffd700 1 -- 172.21.15.17:0/2575286163 learned_addr learned my addr 172.21.15.17:0/2575286163 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f11667fc700 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0e80 0x56468cfd79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f11677fe700 1 -- 172.21.15.17:0/2575286163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0e80 msgr2=0x56468cfd79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f11677fe700 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0e80 0x56468cfd79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f11677fe700 1 -- 172.21.15.17:0/2575286163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfd0570 msgr2=0x56468cfda720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f11677fe700 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfd0570 0x56468cfda720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f11677fe700 1 -- 172.21.15.17:0/2575286163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11681137a0 con 0x56468cfdadb0 2023-07-14T13:03:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f11677fe700 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 0x56468cfd7fd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f11600186f0 tx=0x7f1160004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdfb7fd91d239b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.989+0000 7f114aff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:03:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.990+0000 7f114aff5700 1 -- 172.21.15.17:0/2575286163 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000e040 con 0x56468cfdadb0 2023-07-14T13:03:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.990+0000 7f114aff5700 1 -- 172.21.15.17:0/2575286163 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1160003e10 con 0x56468cfdadb0 2023-07-14T13:03:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.990+0000 7f1180db6b80 1 -- 172.21.15.17:0/2575286163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56468ce7b570 con 0x56468cfdadb0 2023-07-14T13:03:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.990+0000 7f114aff5700 1 -- 172.21.15.17:0/2575286163 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1160004bb0 con 0x56468cfdadb0 2023-07-14T13:03:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.990+0000 7f1180db6b80 10 client.26387 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.990+0000 7f1180db6b80 1 -- 172.21.15.17:0/2575286163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56468cd38ce0 con 0x56468cfdadb0 2023-07-14T13:03:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.990+0000 7f114aff5700 1 -- 172.21.15.17:0/2575286163 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56468ce7b570 con 0x56468cfdadb0 2023-07-14T13:03:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.991+0000 7f114aff5700 1 -- 172.21.15.17:0/2575286163 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f11600041e0 con 0x56468cfdadb0 2023-07-14T13:03:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.991+0000 7f1180db6b80 10 client.26387 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:58.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.991+0000 7f1180db6b80 10 client.26387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:58.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.991+0000 7f1180db6b80 20 client.26387 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:58.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.991+0000 7f1180db6b80 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56468cfea7f0 0x56468cfecc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.991+0000 7f1180db6b80 4 client.26387 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:58.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.991+0000 7f1180db6b80 1 -- 172.21.15.17:0/2575286163 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56468cf1af30 con 0x56468cfea7f0 2023-07-14T13:03:58.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.991+0000 7f1166ffd700 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56468cfea7f0 0x56468cfecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.992+0000 7f1166ffd700 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56468cfea7f0 0x56468cfecc00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b348696fe0ff345 server_cookie=b604259e3c75c336 in_seq=0 out_seq=0 2023-07-14T13:03:58.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.992+0000 7f114aff5700 10 client.26387 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:58.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f114aff5700 1 -- 172.21.15.17:0/2575286163 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56468cf1af30 con 0x56468cfea7f0 2023-07-14T13:03:58.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f114aff5700 10 client.26387 handle_command_reply: tid=0 2023-07-14T13:03:58.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f1180db6b80 1 client.26387 shutdown 2023-07-14T13:03:58.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f1180db6b80 1 -- 172.21.15.17:0/2575286163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 msgr2=0x56468cfd7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f1180db6b80 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 0x56468cfd7fd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f11600186f0 tx=0x7f1160004ad0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f1180db6b80 1 -- 172.21.15.17:0/2575286163 shutdown_connections 2023-07-14T13:03:58.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f1180db6b80 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56468cfea7f0 0x56468cfecc00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f1180db6b80 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfdadb0 0x56468cfd7fd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f114aff5700 0 client.26387 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f1180db6b80 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfd0570 0x56468cfda720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f1180db6b80 1 --2- 172.21.15.17:0/2575286163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0e80 0x56468cfd79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f1180db6b80 1 -- 172.21.15.17:0/2575286163 >> 172.21.15.17:0/2575286163 conn(0x56468cfc6070 msgr2=0x56468cfcb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.993+0000 7f1180db6b80 1 -- 172.21.15.17:0/2575286163 shutdown_connections 2023-07-14T13:03:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.994+0000 7f1180db6b80 1 -- 172.21.15.17:0/2575286163 wait complete. 2023-07-14T13:03:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:57.994+0000 7f1180db6b80 20 client.26387 trim_cache size 0 max 16384 2023-07-14T13:03:58.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.018+0000 7f1180db6b80 1 Processor -- start 2023-07-14T13:03:58.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.018+0000 7f1180db6b80 1 -- start start 2023-07-14T13:03:58.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.018+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0570 0x56468cfe1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.018+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0e80 0x56468cfcb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.018+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 0x56468cfcba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.018+0000 7f1180db6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468cfe7dc0 con 0x56468cfdadb0 2023-07-14T13:03:58.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.018+0000 7f1180db6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468cfd8f80 con 0x56468cfd0570 2023-07-14T13:03:58.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.018+0000 7f1180db6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468cfcc660 con 0x56468cfd0e80 2023-07-14T13:03:58.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.019+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0570 0x56468cfe1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.019+0000 7f11677fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 0x56468cfcba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.019+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0570 0x56468cfe1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41742/0 (socket says 172.21.15.17:41742) 2023-07-14T13:03:58.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.019+0000 7f1166ffd700 1 -- 172.21.15.17:0/2919614295 learned_addr learned my addr 172.21.15.17:0/2919614295 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:58.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.019+0000 7f11667fc700 1 --2- 172.21.15.17:0/2919614295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0e80 0x56468cfcb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.019+0000 7f1166ffd700 1 -- 172.21.15.17:0/2919614295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0e80 msgr2=0x56468cfcb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.019+0000 7f1166ffd700 1 --2- 172.21.15.17:0/2919614295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0e80 0x56468cfcb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.019+0000 7f1166ffd700 1 -- 172.21.15.17:0/2919614295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 msgr2=0x56468cfcba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.019+0000 7f1166ffd700 1 --2- 172.21.15.17:0/2919614295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 0x56468cfcba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.019+0000 7f1166ffd700 1 -- 172.21.15.17:0/2919614295 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56468cd762d0 con 0x56468cfd0570 2023-07-14T13:03:58.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.019+0000 7f11677fe700 1 --2- 172.21.15.17:0/2919614295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 0x56468cfcba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:58.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.020+0000 7f1166ffd700 1 --2- 172.21.15.17:0/2919614295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0570 0x56468cfe1830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1158099e10 tx=0x7f11580cc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c83af5638ca03723 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.020+0000 7f114dffb700 1 -- 172.21.15.17:0/2919614295 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158099e80 con 0x56468cfd0570 2023-07-14T13:03:58.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.020+0000 7f114dffb700 1 -- 172.21.15.17:0/2919614295 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11580a22d0 con 0x56468cfd0570 2023-07-14T13:03:58.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.020+0000 7f114dffb700 1 -- 172.21.15.17:0/2919614295 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158096720 con 0x56468cfd0570 2023-07-14T13:03:58.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.021+0000 7f1180db6b80 1 -- 172.21.15.17:0/2919614295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0570 msgr2=0x56468cfe1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.021+0000 7f1180db6b80 1 --2- 172.21.15.17:0/2919614295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0570 0x56468cfe1830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1158099e10 tx=0x7f11580cc040 comp rx=0 tx=0).stop 2023-07-14T13:03:58.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.021+0000 7f1180db6b80 1 -- 172.21.15.17:0/2919614295 shutdown_connections 2023-07-14T13:03:58.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.021+0000 7f1180db6b80 1 --2- 172.21.15.17:0/2919614295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 0x56468cfcba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.021+0000 7f1180db6b80 1 --2- 172.21.15.17:0/2919614295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0570 0x56468cfe1830 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.021+0000 7f1180db6b80 1 --2- 172.21.15.17:0/2919614295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0e80 0x56468cfcb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.021+0000 7f1180db6b80 1 -- 172.21.15.17:0/2919614295 >> 172.21.15.17:0/2919614295 conn(0x56468cfc6070 msgr2=0x56468cfd2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.021+0000 7f1180db6b80 1 -- 172.21.15.17:0/2919614295 shutdown_connections 2023-07-14T13:03:58.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.021+0000 7f1180db6b80 1 -- 172.21.15.17:0/2919614295 wait complete. 2023-07-14T13:03:58.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.021+0000 7f1180db6b80 1 -- start start 2023-07-14T13:03:58.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.022+0000 7f1180db6b80 1 Processor -- start 2023-07-14T13:03:58.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.022+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 0x56468cfe0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.022+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0e80 0x56468cfe0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.022+0000 7f1180db6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 0x56468d03e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.022+0000 7f1180db6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468d03ebc0 con 0x56468cfdadb0 2023-07-14T13:03:58.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.022+0000 7f1180db6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468d03ed00 con 0x56468cfd0e80 2023-07-14T13:03:58.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.022+0000 7f1180db6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56468d03ee40 con 0x56468cfd0570 2023-07-14T13:03:58.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.022+0000 7f1180db6b80 10 client.0 _ll_register_callbacks cb 0x7f11600093f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:58.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.023+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 0x56468cfe0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.023+0000 7f11677fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 0x56468d03e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.023+0000 7f11667fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0e80 0x56468cfe0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.023+0000 7f11677fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 0x56468d03e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43446/0 (socket says 172.21.15.17:43446) 2023-07-14T13:03:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.023+0000 7f11677fe700 1 -- 172.21.15.17:0/1604258869 learned_addr learned my addr 172.21.15.17:0/1604258869 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.023+0000 7f11677fe700 1 -- 172.21.15.17:0/1604258869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 msgr2=0x56468cfe0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.023+0000 7f11677fe700 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 0x56468cfe0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.023+0000 7f11677fe700 1 -- 172.21.15.17:0/1604258869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0e80 msgr2=0x56468cfe0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.023+0000 7f11677fe700 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0e80 0x56468cfe0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.023+0000 7f11677fe700 1 -- 172.21.15.17:0/1604258869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56468cd38ce0 con 0x56468cfdadb0 2023-07-14T13:03:58.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.023+0000 7f1166ffd700 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 0x56468cfe0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:58.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.024+0000 7f11677fe700 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 0x56468d03e680 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1160009960 tx=0x7f116001aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fe809dd762c25b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.024+0000 7f114aff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:58.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.024+0000 7f114aff5700 1 -- 172.21.15.17:0/1604258869 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000e050 con 0x56468cfdadb0 2023-07-14T13:03:58.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.024+0000 7f114aff5700 1 -- 172.21.15.17:0/1604258869 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1160004db0 con 0x56468cfdadb0 2023-07-14T13:03:58.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.024+0000 7f1180db6b80 1 -- 172.21.15.17:0/1604258869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f115c01d040 con 0x56468cfdadb0 2023-07-14T13:03:58.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.025+0000 7f114aff5700 1 -- 172.21.15.17:0/1604258869 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f116000f580 con 0x56468cfdadb0 2023-07-14T13:03:58.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.025+0000 7f1180db6b80 10 client.16671 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:58.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.025+0000 7f1180db6b80 1 -- 172.21.15.17:0/1604258869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f11681a8d70 con 0x56468cfdadb0 2023-07-14T13:03:58.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.025+0000 7f114aff5700 1 -- 172.21.15.17:0/1604258869 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f115c01d040 con 0x56468cfdadb0 2023-07-14T13:03:58.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.025+0000 7f114aff5700 1 -- 172.21.15.17:0/1604258869 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f11600405b0 con 0x56468cfdadb0 2023-07-14T13:03:58.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.025+0000 7f1180db6b80 10 client.16671 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:58.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.025+0000 7f1180db6b80 10 client.16671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:58.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.025+0000 7f1180db6b80 20 client.16671 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:58.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.025+0000 7f1180db6b80 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56468d0405c0 0x56468d0429d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.025+0000 7f1180db6b80 4 client.16671 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:03:58.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.025+0000 7f1180db6b80 1 -- 172.21.15.17:0/1604258869 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56468cedd0d0 con 0x56468d0405c0 2023-07-14T13:03:58.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.026+0000 7f1166ffd700 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56468d0405c0 0x56468d0429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.026+0000 7f1166ffd700 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56468d0405c0 0x56468d0429d0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bdb464d225e1442 server_cookie=337ee0afcfa7baff in_seq=0 out_seq=0 2023-07-14T13:03:58.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.026+0000 7f114aff5700 10 client.16671 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:58.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.027+0000 7f114aff5700 1 -- 172.21.15.17:0/1604258869 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56468cedd0d0 con 0x56468d0405c0 2023-07-14T13:03:58.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.027+0000 7f114aff5700 10 client.16671 handle_command_reply: tid=0 2023-07-14T13:03:58.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.027+0000 7f1180db6b80 1 client.16671 shutdown 2023-07-14T13:03:58.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f1180db6b80 1 -- 172.21.15.17:0/1604258869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 msgr2=0x56468d03e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f1180db6b80 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 0x56468d03e680 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1160009960 tx=0x7f116001aa00 comp rx=0 tx=0).stop 2023-07-14T13:03:58.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f1180db6b80 1 -- 172.21.15.17:0/1604258869 shutdown_connections 2023-07-14T13:03:58.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f1180db6b80 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56468d0405c0 0x56468d0429d0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f1180db6b80 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56468cfdadb0 0x56468d03e680 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f1180db6b80 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56468cfd0570 0x56468cfe0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f1180db6b80 1 --2- 172.21.15.17:0/1604258869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56468cfd0e80 0x56468cfe0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f1180db6b80 1 -- 172.21.15.17:0/1604258869 >> 172.21.15.17:0/1604258869 conn(0x56468cfc6070 msgr2=0x56468cfcb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f114aff5700 0 client.16671 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:58.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f1180db6b80 1 -- 172.21.15.17:0/1604258869 shutdown_connections 2023-07-14T13:03:58.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f1180db6b80 1 -- 172.21.15.17:0/1604258869 wait complete. 2023-07-14T13:03:58.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.028+0000 7f1180db6b80 20 client.16671 trim_cache size 0 max 16384 2023-07-14T13:03:58.070 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:03:58.070 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:03:58.070 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:03:58.070 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:03:58.070 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:03:58.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.029+0000 7f1167fff700 1 -- 172.21.15.17:0/3649275861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11500a1460 msgr2=0x7f11500a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.029+0000 7f1167fff700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11500a1460 0x7f11500a3910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1160009fd0 tx=0x7f1160004b40 comp rx=0 tx=0).stop 2023-07-14T13:03:58.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.029+0000 7f1167fff700 1 -- 172.21.15.17:0/3649275861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11680fe890 msgr2=0x7f116819bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.029+0000 7f1167fff700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11680fe890 0x7f116819bf40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f115800e9c0 tx=0x7f115800ecd0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.030+0000 7f1167fff700 1 -- 172.21.15.17:0/3649275861 shutdown_connections 2023-07-14T13:03:58.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.030+0000 7f1167fff700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11500a1460 0x7f11500a3910 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.030+0000 7f1167fff700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1168103d90 0x7f11681a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.030+0000 7f1167fff700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11680fe890 0x7f116819bf40 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.030+0000 7f1167fff700 1 --2- 172.21.15.17:0/3649275861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11680ff1a0 0x7f116819c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.030+0000 7f1167fff700 1 -- 172.21.15.17:0/3649275861 >> 172.21.15.17:0/3649275861 conn(0x7f11680745d0 msgr2=0x7f1168101900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.030+0000 7f1167fff700 1 -- 172.21.15.17:0/3649275861 shutdown_connections 2023-07-14T13:03:58.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.030+0000 7f1167fff700 1 -- 172.21.15.17:0/3649275861 wait complete. 2023-07-14T13:03:58.092 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:03:58.187 INFO:teuthology.orchestra.run.smithi017.stderr:14600000 of 50000000 tuples (29%) done (elapsed 227.79 s, remaining 552.31 s) 2023-07-14T13:03:58.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:58 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:03:58.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.334+0000 7f2b563ff700 1 -- 172.21.15.17:0/2078617598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b500ffb00 msgr2=0x7f2b500fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.334+0000 7f2b563ff700 1 --2- 172.21.15.17:0/2078617598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b500ffb00 0x7f2b500fff70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009990 tx=0x7f2b44009ca0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.334+0000 7f2b563ff700 1 -- 172.21.15.17:0/2078617598 shutdown_connections 2023-07-14T13:03:58.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.335+0000 7f2b563ff700 1 --2- 172.21.15.17:0/2078617598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b501004b0 0x7f2b5010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.335+0000 7f2b563ff700 1 --2- 172.21.15.17:0/2078617598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b50105b10 0x7f2b50105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.335+0000 7f2b563ff700 1 --2- 172.21.15.17:0/2078617598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b500ffb00 0x7f2b500fff70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.335+0000 7f2b563ff700 1 -- 172.21.15.17:0/2078617598 >> 172.21.15.17:0/2078617598 conn(0x7f2b500fb600 msgr2=0x7f2b500fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.335+0000 7f2b563ff700 1 -- 172.21.15.17:0/2078617598 shutdown_connections 2023-07-14T13:03:58.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.335+0000 7f2b563ff700 1 -- 172.21.15.17:0/2078617598 wait complete. 2023-07-14T13:03:58.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.336+0000 7f2b563ff700 1 Processor -- start 2023-07-14T13:03:58.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.336+0000 7f2b563ff700 1 -- start start 2023-07-14T13:03:58.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b563ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b500ffb00 0x7f2b50197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b563ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b501004b0 0x7f2b50198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b563ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b50105b10 0x7f2b5019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b563ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5019cde0 con 0x7f2b50105b10 2023-07-14T13:03:58.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b563ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5019cf50 con 0x7f2b500ffb00 2023-07-14T13:03:58.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b563ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5019d110 con 0x7f2b501004b0 2023-07-14T13:03:58.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b500ffb00 0x7f2b50197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b500ffb00 0x7f2b50197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41770/0 (socket says 172.21.15.17:41770) 2023-07-14T13:03:58.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b4ffff700 1 -- 172.21.15.17:0/646398673 learned_addr learned my addr 172.21.15.17:0/646398673 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:58.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b4f7fe700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b501004b0 0x7f2b50198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b5499c700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b50105b10 0x7f2b5019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.337+0000 7f2b4ffff700 1 -- 172.21.15.17:0/646398673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b501004b0 msgr2=0x7f2b50198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.338+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b501004b0 0x7f2b50198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.338+0000 7f2b4ffff700 1 -- 172.21.15.17:0/646398673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b50105b10 msgr2=0x7f2b5019c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.338+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b50105b10 0x7f2b5019c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.338+0000 7f2b4ffff700 1 -- 172.21.15.17:0/646398673 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b440095f0 con 0x7f2b500ffb00 2023-07-14T13:03:58.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.338+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b500ffb00 0x7f2b50197e00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000d950 tx=0x7f2b4000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.338+0000 7f2b4d7fa700 1 -- 172.21.15.17:0/646398673 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000f890 con 0x7f2b500ffb00 2023-07-14T13:03:58.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.338+0000 7f2b4d7fa700 1 -- 172.21.15.17:0/646398673 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b4000fe80 con 0x7f2b500ffb00 2023-07-14T13:03:58.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.338+0000 7f2b4d7fa700 1 -- 172.21.15.17:0/646398673 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000e3b0 con 0x7f2b500ffb00 2023-07-14T13:03:58.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.338+0000 7f2b563ff700 1 -- 172.21.15.17:0/646398673 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5019d3f0 con 0x7f2b500ffb00 2023-07-14T13:03:58.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.339+0000 7f2b563ff700 1 -- 172.21.15.17:0/646398673 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b501a4c30 con 0x7f2b500ffb00 2023-07-14T13:03:58.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.342+0000 7f2b4d7fa700 1 -- 172.21.15.17:0/646398673 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2b40010460 con 0x7f2b500ffb00 2023-07-14T13:03:58.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.344+0000 7f2b69d4db80 1 Processor -- start 2023-07-14T13:03:58.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.344+0000 7f2b69d4db80 1 -- start start 2023-07-14T13:03:58.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.344+0000 7f2b4d7fa700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b380a1340 0x7f2b380a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.344+0000 7f2b4d7fa700 1 -- 172.21.15.17:0/646398673 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2b400cca00 con 0x7f2b500ffb00 2023-07-14T13:03:58.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847a72d0 0x5609847a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a7be0 0x5609847b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847b2ad0 0x5609847b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609846adcb0 con 0x5609847a72d0 2023-07-14T13:03:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560984700a40 con 0x5609847a7be0 2023-07-14T13:03:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609846f9ed0 con 0x5609847b2ad0 2023-07-14T13:03:58.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b5499c700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b380a1340 0x7f2b380a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a7be0 0x5609847b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b5499c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847b2ad0 0x5609847b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847a72d0 0x5609847a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a7be0 0x5609847b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41774/0 (socket says 172.21.15.17:41774) 2023-07-14T13:03:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.345+0000 7f2b4f7fe700 1 -- 172.21.15.17:0/3224714901 learned_addr learned my addr 172.21.15.17:0/3224714901 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:58.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.346+0000 7f2b5499c700 1 -- 172.21.15.17:0/3224714901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a7be0 msgr2=0x5609847b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.346+0000 7f2b5499c700 1 --2- 172.21.15.17:0/3224714901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a7be0 0x5609847b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.346+0000 7f2b5499c700 1 -- 172.21.15.17:0/3224714901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847a72d0 msgr2=0x5609847a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.346+0000 7f2b5499c700 1 --2- 172.21.15.17:0/3224714901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847a72d0 0x5609847a76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.346+0000 7f2b5499c700 1 -- 172.21.15.17:0/3224714901 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560984527de0 con 0x5609847b2ad0 2023-07-14T13:03:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.346+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/3224714901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847a72d0 0x5609847a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.346+0000 7f2b5499c700 1 --2- 172.21.15.17:0/3224714901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847b2ad0 0x5609847b4eb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b48008e80 tx=0x7f2b4801a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74664585fb256a60 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.346+0000 7f2b5499c700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b380a1340 0x7f2b380a37f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009550 tx=0x7f2b48013000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.347+0000 7f2b367fc700 1 -- 172.21.15.17:0/3224714901 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800e040 con 0x5609847b2ad0 2023-07-14T13:03:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.347+0000 7f2b367fc700 1 -- 172.21.15.17:0/3224714901 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b4800f040 con 0x5609847b2ad0 2023-07-14T13:03:58.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.347+0000 7f2b367fc700 1 -- 172.21.15.17:0/3224714901 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4801b990 con 0x5609847b2ad0 2023-07-14T13:03:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.347+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3224714901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847b2ad0 msgr2=0x5609847b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.347+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3224714901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847b2ad0 0x5609847b4eb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b48008e80 tx=0x7f2b4801a6c0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.348+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3224714901 shutdown_connections 2023-07-14T13:03:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.348+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3224714901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847b2ad0 0x5609847b4eb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.348+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3224714901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847a72d0 0x5609847a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.348+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3224714901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a7be0 0x5609847b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.348+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3224714901 >> 172.21.15.17:0/3224714901 conn(0x56098479dda0 msgr2=0x5609847a36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.348+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3224714901 shutdown_connections 2023-07-14T13:03:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.348+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3224714901 wait complete. 2023-07-14T13:03:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.348+0000 7f2b69d4db80 1 -- start start 2023-07-14T13:03:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.349+0000 7f2b69d4db80 1 Processor -- start 2023-07-14T13:03:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.349+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 0x5609847af820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.349+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 0x5609847afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.349+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 0x5609847b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.349+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560984699ac0 con 0x5609847b2ad0 2023-07-14T13:03:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.349+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609846997c0 con 0x5609847a72d0 2023-07-14T13:03:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.349+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56098457d920 con 0x5609847a7be0 2023-07-14T13:03:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.349+0000 7f2b69d4db80 10 client.0 _ll_register_callbacks cb 0x560984697760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:58.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 0x5609847af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 0x5609847afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 0x5609847afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:33166/0 (socket says 172.21.15.17:33166) 2023-07-14T13:03:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 0x5609847af820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41788/0 (socket says 172.21.15.17:41788) 2023-07-14T13:03:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b4f7fe700 1 -- 172.21.15.17:0/3104340381 learned_addr learned my addr 172.21.15.17:0/3104340381 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b5499c700 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 0x5609847b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b4ffff700 1 -- 172.21.15.17:0/3104340381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 msgr2=0x5609847afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 0x5609847afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b4ffff700 1 -- 172.21.15.17:0/3104340381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 msgr2=0x5609847b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 0x5609847b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b4ffff700 1 -- 172.21.15.17:0/3104340381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b501a4c30 con 0x5609847a72d0 2023-07-14T13:03:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b5499c700 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 0x5609847b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 0x5609847af820 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b400ca160 tx=0x7f2b40099ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9274341fcc45d305 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.350+0000 7f2b2f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:03:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.351+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/3104340381 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400a1f30 con 0x5609847a72d0 2023-07-14T13:03:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.351+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/3104340381 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2b40098fd0 con 0x5609847a72d0 2023-07-14T13:03:58.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.351+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3104340381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609846534f0 con 0x5609847a72d0 2023-07-14T13:03:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.351+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/3104340381 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b400b2200 con 0x5609847a72d0 2023-07-14T13:03:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.351+0000 7f2b69d4db80 10 client.26405 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.351+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3104340381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f2b48008a60 con 0x5609847a72d0 2023-07-14T13:03:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.351+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/3104340381 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5609846534f0 con 0x5609847a72d0 2023-07-14T13:03:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.351+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/3104340381 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f2b400958d0 con 0x5609847a72d0 2023-07-14T13:03:58.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.352+0000 7f2b69d4db80 10 client.26405 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.352+0000 7f2b69d4db80 10 client.26405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.352+0000 7f2b69d4db80 20 client.26405 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.352+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5609847c22a0 0x5609847c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.352+0000 7f2b69d4db80 4 client.26405 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.352+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3104340381 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609846f2eb0 con 0x5609847c22a0 2023-07-14T13:03:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.352+0000 7f2b4f7fe700 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5609847c22a0 0x5609847c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.353+0000 7f2b4f7fe700 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5609847c22a0 0x5609847c46b0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce52b0a0744c9405 server_cookie=8af36f78bc6b3c67 in_seq=0 out_seq=0 2023-07-14T13:03:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.353+0000 7f2b2f7fe700 10 client.26405 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/3104340381 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5609846f2eb0 con 0x5609847c22a0 2023-07-14T13:03:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b2f7fe700 10 client.26405 handle_command_reply: tid=0 2023-07-14T13:03:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b69d4db80 1 client.26405 shutdown 2023-07-14T13:03:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3104340381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 msgr2=0x5609847af820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 0x5609847af820 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b400ca160 tx=0x7f2b40099ae0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3104340381 shutdown_connections 2023-07-14T13:03:58.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5609847c22a0 0x5609847c46b0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 0x5609847b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 0x5609847af820 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3104340381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 0x5609847afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3104340381 >> 172.21.15.17:0/3104340381 conn(0x56098479dda0 msgr2=0x5609847a3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b2f7fe700 0 client.26405 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3104340381 shutdown_connections 2023-07-14T13:03:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.354+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3104340381 wait complete. 2023-07-14T13:03:58.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.355+0000 7f2b69d4db80 20 client.26405 trim_cache size 0 max 16384 2023-07-14T13:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.378+0000 7f2b69d4db80 1 Processor -- start 2023-07-14T13:03:58.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.378+0000 7f2b69d4db80 1 -- start start 2023-07-14T13:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.378+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a72d0 0x5609847b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.378+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847a7be0 0x5609847b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847b2ad0 0x5609847aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609847a8e30 con 0x5609847a7be0 2023-07-14T13:03:58.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609847a4d20 con 0x5609847b2ad0 2023-07-14T13:03:58.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609847b0e00 con 0x5609847a72d0 2023-07-14T13:03:58.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a72d0 0x5609847b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847a7be0 0x5609847b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a72d0 0x5609847b94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:33178/0 (socket says 172.21.15.17:33178) 2023-07-14T13:03:58.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b4ffff700 1 -- 172.21.15.17:0/3123466374 learned_addr learned my addr 172.21.15.17:0/3123466374 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:58.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b5499c700 1 --2- 172.21.15.17:0/3123466374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847b2ad0 0x5609847aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b4ffff700 1 -- 172.21.15.17:0/3123466374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847b2ad0 msgr2=0x5609847aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/3123466374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847b2ad0 0x5609847aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b4ffff700 1 -- 172.21.15.17:0/3123466374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847a7be0 msgr2=0x5609847b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/3123466374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847a7be0 0x5609847b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.379+0000 7f2b4ffff700 1 -- 172.21.15.17:0/3123466374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560984510c60 con 0x5609847a72d0 2023-07-14T13:03:58.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.380+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/3123466374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a72d0 0x5609847b94b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2b40096550 tx=0x7f2b40000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da1539e266c51329 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.380+0000 7f2b36ffd700 1 -- 172.21.15.17:0/3123466374 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400a1f30 con 0x5609847a72d0 2023-07-14T13:03:58.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.380+0000 7f2b36ffd700 1 -- 172.21.15.17:0/3123466374 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b400b2200 con 0x5609847a72d0 2023-07-14T13:03:58.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.380+0000 7f2b36ffd700 1 -- 172.21.15.17:0/3123466374 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400a1d00 con 0x5609847a72d0 2023-07-14T13:03:58.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.381+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3123466374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a72d0 msgr2=0x5609847b94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.381+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3123466374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a72d0 0x5609847b94b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2b40096550 tx=0x7f2b40000bc0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.381+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3123466374 shutdown_connections 2023-07-14T13:03:58.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.381+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3123466374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847b2ad0 0x5609847aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.381+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3123466374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a72d0 0x5609847b94b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.381+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/3123466374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847a7be0 0x5609847b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.381+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3123466374 >> 172.21.15.17:0/3123466374 conn(0x56098479dda0 msgr2=0x5609847be770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.381+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3123466374 shutdown_connections 2023-07-14T13:03:58.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.381+0000 7f2b69d4db80 1 -- 172.21.15.17:0/3123466374 wait complete. 2023-07-14T13:03:58.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.381+0000 7f2b69d4db80 1 -- start start 2023-07-14T13:03:58.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.382+0000 7f2b69d4db80 1 Processor -- start 2023-07-14T13:03:58.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 0x56098480a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 0x56098480a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b69d4db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 0x560984815170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56098480af90 con 0x5609847b2ad0 2023-07-14T13:03:58.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609848156b0 con 0x5609847a72d0 2023-07-14T13:03:58.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b69d4db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560984815870 con 0x5609847a7be0 2023-07-14T13:03:58.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b69d4db80 10 client.0 _ll_register_callbacks cb 0x7f2b40099510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:58.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 0x56098480a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 0x56098480a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b4f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 0x56098480a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:33194/0 (socket says 172.21.15.17:33194) 2023-07-14T13:03:58.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b4f7fe700 1 -- 172.21.15.17:0/1347510838 learned_addr learned my addr 172.21.15.17:0/1347510838 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:58.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b5499c700 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 0x560984815170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.383+0000 7f2b4f7fe700 1 -- 172.21.15.17:0/1347510838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 msgr2=0x56098480a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.384+0000 7f2b4f7fe700 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 0x56098480a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.384+0000 7f2b4f7fe700 1 -- 172.21.15.17:0/1347510838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 msgr2=0x560984815170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:58.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.384+0000 7f2b4f7fe700 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 0x560984815170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.384+0000 7f2b4f7fe700 1 -- 172.21.15.17:0/1347510838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b48008a60 con 0x5609847a7be0 2023-07-14T13:03:58.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.384+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 0x56098480a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:58.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.384+0000 7f2b5499c700 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 0x560984815170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:03:58.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.384+0000 7f2b4f7fe700 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 0x56098480a820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2b44000c00 tx=0x7f2b44005510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52a9aa64b74b1f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:58.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.384+0000 7f2b2f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:03:58.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.384+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/1347510838 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4401d040 con 0x5609847a7be0 2023-07-14T13:03:58.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.384+0000 7f2b69d4db80 1 -- 172.21.15.17:0/1347510838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b4800f040 con 0x5609847a7be0 2023-07-14T13:03:58.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.384+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/1347510838 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2b4400bb20 con 0x5609847a7be0 2023-07-14T13:03:58.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.385+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/1347510838 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b4400bce0 con 0x5609847a7be0 2023-07-14T13:03:58.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.385+0000 7f2b69d4db80 10 client.26380 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:58.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.385+0000 7f2b69d4db80 1 -- 172.21.15.17:0/1347510838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56098454e250 con 0x5609847a7be0 2023-07-14T13:03:58.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.385+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/1347510838 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b4800f040 con 0x5609847a7be0 2023-07-14T13:03:58.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.385+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/1347510838 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f2b44004d30 con 0x5609847a7be0 2023-07-14T13:03:58.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.385+0000 7f2b69d4db80 10 client.26380 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:58.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.385+0000 7f2b69d4db80 10 client.26380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:58.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.385+0000 7f2b69d4db80 20 client.26380 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:58.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.385+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560984817070 0x560984819480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:58.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.385+0000 7f2b69d4db80 4 client.26380 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:03:58.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.385+0000 7f2b69d4db80 1 -- 172.21.15.17:0/1347510838 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5609846b5050 con 0x560984817070 2023-07-14T13:03:58.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.386+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560984817070 0x560984819480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:58.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.386+0000 7f2b4ffff700 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560984817070 0x560984819480 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=782afb7dbb1fefee server_cookie=a5138c9338989202 in_seq=0 out_seq=0 2023-07-14T13:03:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.386+0000 7f2b2f7fe700 10 client.26380 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/1347510838 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5609846b5050 con 0x560984817070 2023-07-14T13:03:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b2f7fe700 10 client.26380 handle_command_reply: tid=0 2023-07-14T13:03:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b69d4db80 1 client.26380 shutdown 2023-07-14T13:03:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b69d4db80 1 -- 172.21.15.17:0/1347510838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 msgr2=0x56098480a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 0x56098480a820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2b44000c00 tx=0x7f2b44005510 comp rx=0 tx=0).stop 2023-07-14T13:03:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b69d4db80 1 -- 172.21.15.17:0/1347510838 shutdown_connections 2023-07-14T13:03:58.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560984817070 0x560984819480 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5609847b2ad0 0x560984815170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5609847a72d0 0x56098480a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b69d4db80 1 --2- 172.21.15.17:0/1347510838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609847a7be0 0x56098480a820 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b2f7fe700 0 client.26380 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:58.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b69d4db80 1 -- 172.21.15.17:0/1347510838 >> 172.21.15.17:0/1347510838 conn(0x56098479dda0 msgr2=0x5609847b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b69d4db80 1 -- 172.21.15.17:0/1347510838 shutdown_connections 2023-07-14T13:03:58.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.387+0000 7f2b69d4db80 1 -- 172.21.15.17:0/1347510838 wait complete. 2023-07-14T13:03:58.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b69d4db80 20 client.26380 trim_cache size 0 max 16384 2023-07-14T13:03:58.427 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:03:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:03:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:03:58.427 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:03:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:03:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:03:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:03:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:03:58.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:03:58.428 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:03:58.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 -- 172.21.15.17:0/646398673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b380a1340 msgr2=0x7f2b380a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b380a1340 0x7f2b380a37f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009550 tx=0x7f2b48013000 comp rx=0 tx=0).stop 2023-07-14T13:03:58.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 -- 172.21.15.17:0/646398673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b500ffb00 msgr2=0x7f2b50197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:58.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b500ffb00 0x7f2b50197e00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000d950 tx=0x7f2b4000dc60 comp rx=0 tx=0).stop 2023-07-14T13:03:58.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 -- 172.21.15.17:0/646398673 shutdown_connections 2023-07-14T13:03:58.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b380a1340 0x7f2b380a37f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b50105b10 0x7f2b5019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b500ffb00 0x7f2b50197e00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 --2- 172.21.15.17:0/646398673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b501004b0 0x7f2b50198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:58.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 -- 172.21.15.17:0/646398673 >> 172.21.15.17:0/646398673 conn(0x7f2b500fb600 msgr2=0x7f2b500fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:58.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 -- 172.21.15.17:0/646398673 shutdown_connections 2023-07-14T13:03:58.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:03:58.388+0000 7f2b563ff700 1 -- 172.21.15.17:0/646398673 wait complete. 2023-07-14T13:03:58.441 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:03:58.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:58 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:03:58.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:58 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:03:58.499 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 13:03:58 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-b[122274]: 2023-07-14T13:03:58.046+0000 7f0425da4700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000019 [...6,head] /volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp/ auth{1=1,2=1} v2157 ap=2 f(v30 m2023-07-14T13:03:10.114904+0000 3=3+0) n(v3 rc2023-07-14T13:03:10.114904+0000 b3321 4=3+1) old_inodes=4 (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15315=pAsLsXsFs/-@87} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x564c11aaf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v38>,<0x10000000005/data v101>,<0x10000000003/postgres v23>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v37>,<0x10000000001/sv_0 v55>,<0x10000000000/_nogroup v41>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v2157>,<0x10000000005/data v1225>,<0x10000000003/postgres v300>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v320>,<0x10000000001/sv_0 v337>,<0x10000000000/_nogroup v321>,<0x1/volumes v315>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-07-14T13:03:10.102645+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2023-07-14T13:03:10.114904+0000 b3321 4=3+1)","memory_value.dirstat":"f(v30 m2023-07-14T13:03:10.114904+0000 3=3+0)","memory_value.rstat":"n(v3 rc2023-07-14T13:03:10.114904+0000 b3321 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-07-14T13:03:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.989+0000 7fb4191ff700 1 -- 172.21.15.17:0/1286196034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141004b0 msgr2=0x7fb41410c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.989+0000 7fb4191ff700 1 --2- 172.21.15.17:0/1286196034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141004b0 0x7fb41410c940 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00b0a0 tx=0x7fb40c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.989+0000 7fb4191ff700 1 -- 172.21.15.17:0/1286196034 shutdown_connections 2023-07-14T13:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.989+0000 7fb4191ff700 1 --2- 172.21.15.17:0/1286196034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4141004b0 0x7fb41410c940 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.989+0000 7fb4191ff700 1 --2- 172.21.15.17:0/1286196034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb414105b10 0x7fb414105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.989+0000 7fb4191ff700 1 --2- 172.21.15.17:0/1286196034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4140ffb00 0x7fb4140fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.989+0000 7fb4191ff700 1 -- 172.21.15.17:0/1286196034 >> 172.21.15.17:0/1286196034 conn(0x7fb4140fb600 msgr2=0x7fb4140fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.989+0000 7fb4191ff700 1 -- 172.21.15.17:0/1286196034 shutdown_connections 2023-07-14T13:03:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.989+0000 7fb4191ff700 1 -- 172.21.15.17:0/1286196034 wait complete. 2023-07-14T13:03:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.990+0000 7fb4191ff700 1 Processor -- start 2023-07-14T13:03:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.990+0000 7fb4191ff700 1 -- start start 2023-07-14T13:03:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.991+0000 7fb4191ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4140ffb00 0x7fb414197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.991+0000 7fb4191ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4141004b0 0x7fb414198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.991+0000 7fb4191ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb414105b10 0x7fb41419c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.991+0000 7fb4191ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41419cfe0 con 0x7fb4140ffb00 2023-07-14T13:03:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.991+0000 7fb4191ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41419d150 con 0x7fb4141004b0 2023-07-14T13:03:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.991+0000 7fb4191ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41419d310 con 0x7fb414105b10 2023-07-14T13:03:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.991+0000 7fb412d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4140ffb00 0x7fb414197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.991+0000 7fb41259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4141004b0 0x7fb414198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.991+0000 7fb41259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4141004b0 0x7fb414198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41826/0 (socket says 172.21.15.17:41826) 2023-07-14T13:03:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.991+0000 7fb41259c700 1 -- 172.21.15.17:0/742872902 learned_addr learned my addr 172.21.15.17:0/742872902 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.991+0000 7fb41359e700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb414105b10 0x7fb41419c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.992+0000 7fb41259c700 1 -- 172.21.15.17:0/742872902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb414105b10 msgr2=0x7fb41419c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.992+0000 7fb41259c700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb414105b10 0x7fb41419c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.992+0000 7fb41259c700 1 -- 172.21.15.17:0/742872902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4140ffb00 msgr2=0x7fb414197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.992+0000 7fb41259c700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4140ffb00 0x7fb414197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.992+0000 7fb41259c700 1 -- 172.21.15.17:0/742872902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408009520 con 0x7fb4141004b0 2023-07-14T13:03:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.992+0000 7fb41359e700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb414105b10 0x7fb41419c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.992+0000 7fb41259c700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4141004b0 0x7fb414198330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb40800eb30 tx=0x7fb40800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.992+0000 7fb3fbfff700 1 -- 172.21.15.17:0/742872902 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408009880 con 0x7fb4141004b0 2023-07-14T13:03:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.992+0000 7fb4191ff700 1 -- 172.21.15.17:0/742872902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40c009d00 con 0x7fb4141004b0 2023-07-14T13:03:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.992+0000 7fb3fbfff700 1 -- 172.21.15.17:0/742872902 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4080044b0 con 0x7fb4141004b0 2023-07-14T13:03:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.992+0000 7fb3fbfff700 1 -- 172.21.15.17:0/742872902 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408003ce0 con 0x7fb4141004b0 2023-07-14T13:03:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.993+0000 7fb4191ff700 1 -- 172.21.15.17:0/742872902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4141a4c50 con 0x7fb4141004b0 2023-07-14T13:03:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.998+0000 7fb3fbfff700 1 -- 172.21.15.17:0/742872902 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb408003e40 con 0x7fb4141004b0 2023-07-14T13:03:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.998+0000 7fb42cb6db80 1 Processor -- start 2023-07-14T13:03:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb42cb6db80 1 -- start start 2023-07-14T13:03:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 0x55920a52bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a52c2d0 0x55920a526040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a5269d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a42bc50 con 0x55920a526580 2023-07-14T13:03:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a47e9e0 con 0x55920a52c2d0 2023-07-14T13:03:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a477e70 con 0x55920a3826b0 2023-07-14T13:03:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb412d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a52c2d0 0x55920a526040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb41359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 0x55920a52bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb41359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 0x55920a52bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:33222/0 (socket says 172.21.15.17:33222) 2023-07-14T13:03:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb41359e700 1 -- 172.21.15.17:0/1949209400 learned_addr learned my addr 172.21.15.17:0/1949209400 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb412d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a52c2d0 0x55920a526040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41828/0 (socket says 172.21.15.17:41828) 2023-07-14T13:03:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:58.999+0000 7fb41259c700 1 --2- 172.21.15.17:0/1949209400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a5269d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.000+0000 7fb41359e700 1 -- 172.21.15.17:0/1949209400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a52c2d0 msgr2=0x55920a526040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.000+0000 7fb41359e700 1 --2- 172.21.15.17:0/1949209400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a52c2d0 0x55920a526040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.000+0000 7fb41359e700 1 -- 172.21.15.17:0/1949209400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 msgr2=0x55920a5269d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.000+0000 7fb41359e700 1 --2- 172.21.15.17:0/1949209400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a5269d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.000+0000 7fb41359e700 1 -- 172.21.15.17:0/1949209400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55920a2a5d80 con 0x55920a3826b0 2023-07-14T13:03:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.000+0000 7fb3fbfff700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3fc0a12c0 0x7fb3fc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.000+0000 7fb3fbfff700 1 -- 172.21.15.17:0/742872902 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb408014070 con 0x7fb4141004b0 2023-07-14T13:03:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.000+0000 7fb41359e700 1 --2- 172.21.15.17:0/1949209400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 0x55920a52bd90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00b0a0 tx=0x7fb40c009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92260c16373121d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.000+0000 7fb412d9d700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3fc0a12c0 0x7fb3fc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.000+0000 7fb3f97fa700 1 -- 172.21.15.17:0/1949209400 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c00e040 con 0x55920a3826b0 2023-07-14T13:03:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.001+0000 7fb3f97fa700 1 -- 172.21.15.17:0/1949209400 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb40c0074e0 con 0x55920a3826b0 2023-07-14T13:03:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.001+0000 7fb3f97fa700 1 -- 172.21.15.17:0/1949209400 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c005040 con 0x55920a3826b0 2023-07-14T13:03:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.001+0000 7fb42cb6db80 1 -- 172.21.15.17:0/1949209400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 msgr2=0x55920a52bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.001+0000 7fb412d9d700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3fc0a12c0 0x7fb3fc0a3770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55920a522b40 tx=0x7fb404009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.001+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/1949209400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 0x55920a52bd90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00b0a0 tx=0x7fb40c009ba0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.002+0000 7fb42cb6db80 1 -- 172.21.15.17:0/1949209400 shutdown_connections 2023-07-14T13:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.002+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/1949209400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a5269d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.002+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/1949209400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 0x55920a52bd90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.002+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/1949209400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a52c2d0 0x55920a526040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.002+0000 7fb42cb6db80 1 -- 172.21.15.17:0/1949209400 >> 172.21.15.17:0/1949209400 conn(0x55920a51bbe0 msgr2=0x55920a520f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.002+0000 7fb42cb6db80 1 -- 172.21.15.17:0/1949209400 shutdown_connections 2023-07-14T13:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.002+0000 7fb42cb6db80 1 -- 172.21.15.17:0/1949209400 wait complete. 2023-07-14T13:03:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.002+0000 7fb42cb6db80 1 -- start start 2023-07-14T13:03:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.003+0000 7fb42cb6db80 1 Processor -- start 2023-07-14T13:03:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.003+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 0x55920a532610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.003+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a52f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.003+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a52c2d0 0x55920a530070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.003+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a417a60 con 0x55920a526580 2023-07-14T13:03:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.003+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a417760 con 0x55920a52c2d0 2023-07-14T13:03:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.003+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a2fb8c0 con 0x55920a3826b0 2023-07-14T13:03:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.003+0000 7fb42cb6db80 10 client.0 _ll_register_callbacks cb 0x55920a415700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.003+0000 7fb41259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a52f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.004+0000 7fb412d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 0x55920a532610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.004+0000 7fb41259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a52f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43542/0 (socket says 172.21.15.17:43542) 2023-07-14T13:03:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.004+0000 7fb41259c700 1 -- 172.21.15.17:0/2579936950 learned_addr learned my addr 172.21.15.17:0/2579936950 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.004+0000 7fb41359e700 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a52c2d0 0x55920a530070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.004+0000 7fb412d9d700 1 -- 172.21.15.17:0/2579936950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a52c2d0 msgr2=0x55920a530070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.004+0000 7fb412d9d700 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a52c2d0 0x55920a530070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.004+0000 7fb412d9d700 1 -- 172.21.15.17:0/2579936950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 msgr2=0x55920a52f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.004+0000 7fb412d9d700 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a52f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.004+0000 7fb412d9d700 1 -- 172.21.15.17:0/2579936950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41410d240 con 0x55920a3826b0 2023-07-14T13:03:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.004+0000 7fb412d9d700 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 0x55920a532610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb404004200 tx=0x7fb4040047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd58ec4fdca4a240 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.004+0000 7fb3f6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:03:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.005+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2579936950 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404017070 con 0x55920a3826b0 2023-07-14T13:03:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.005+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2579936950 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb404004510 con 0x55920a3826b0 2023-07-14T13:03:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.005+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2579936950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55920a3d1490 con 0x55920a3826b0 2023-07-14T13:03:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.005+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2579936950 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb404003ca0 con 0x55920a3826b0 2023-07-14T13:03:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.005+0000 7fb42cb6db80 10 client.26392 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.005+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2579936950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55920a28ec00 con 0x55920a3826b0 2023-07-14T13:03:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.005+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2579936950 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55920a3d1490 con 0x55920a3826b0 2023-07-14T13:03:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.005+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2579936950 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fb404005350 con 0x55920a3826b0 2023-07-14T13:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.006+0000 7fb42cb6db80 10 client.26392 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.006+0000 7fb42cb6db80 10 client.26392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.006+0000 7fb42cb6db80 20 client.26392 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.006+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55920a53fb80 0x55920a541f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.006+0000 7fb42cb6db80 4 client.26392 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.006+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2579936950 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55920a470e50 con 0x55920a53fb80 2023-07-14T13:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.006+0000 7fb41259c700 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55920a53fb80 0x55920a541f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.007+0000 7fb41259c700 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55920a53fb80 0x55920a541f90 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b11211336e1fe8f server_cookie=acb42a491dba5271 in_seq=0 out_seq=0 2023-07-14T13:03:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.007+0000 7fb3f6ff5700 10 client.26392 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.007+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2579936950 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55920a470e50 con 0x55920a53fb80 2023-07-14T13:03:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.007+0000 7fb3f6ff5700 10 client.26392 handle_command_reply: tid=0 2023-07-14T13:03:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 1 client.26392 shutdown 2023-07-14T13:03:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2579936950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 msgr2=0x55920a532610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 0x55920a532610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb404004200 tx=0x7fb4040047c0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2579936950 shutdown_connections 2023-07-14T13:03:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55920a53fb80 0x55920a541f90 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a52c2d0 0x55920a530070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a3826b0 0x55920a532610 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb3f6ff5700 0 client.26392 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2579936950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a52f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2579936950 >> 172.21.15.17:0/2579936950 conn(0x55920a51bbe0 msgr2=0x55920a51fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2579936950 shutdown_connections 2023-07-14T13:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2579936950 wait complete. 2023-07-14T13:03:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.008+0000 7fb42cb6db80 20 client.26392 trim_cache size 0 max 16384 2023-07-14T13:03:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb42cb6db80 1 Processor -- start 2023-07-14T13:03:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb42cb6db80 1 -- start start 2023-07-14T13:03:59.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a3826b0 0x55920a526040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a526580 0x55920a52f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a52c2d0 0x55920a520c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a51dd00 con 0x55920a3826b0 2023-07-14T13:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a53d280 con 0x55920a526580 2023-07-14T13:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a522990 con 0x55920a52c2d0 2023-07-14T13:03:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb412d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a3826b0 0x55920a526040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb412d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a3826b0 0x55920a526040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43556/0 (socket says 172.21.15.17:43556) 2023-07-14T13:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb41259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a526580 0x55920a52f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.029+0000 7fb412d9d700 1 -- 172.21.15.17:0/1651730217 learned_addr learned my addr 172.21.15.17:0/1651730217 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.030+0000 7fb41359e700 1 --2- 172.21.15.17:0/1651730217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a52c2d0 0x55920a520c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.030+0000 7fb412d9d700 1 -- 172.21.15.17:0/1651730217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a52c2d0 msgr2=0x55920a520c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.030+0000 7fb412d9d700 1 --2- 172.21.15.17:0/1651730217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a52c2d0 0x55920a520c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.030+0000 7fb412d9d700 1 -- 172.21.15.17:0/1651730217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a526580 msgr2=0x55920a52f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.030+0000 7fb412d9d700 1 --2- 172.21.15.17:0/1651730217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a526580 0x55920a52f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.030+0000 7fb412d9d700 1 -- 172.21.15.17:0/1651730217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55920a546bc0 con 0x55920a3826b0 2023-07-14T13:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.030+0000 7fb412d9d700 1 --2- 172.21.15.17:0/1651730217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a3826b0 0x55920a526040 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb404019040 tx=0x7fb4040039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ad773f502b69da server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.030+0000 7fb3f9ffb700 1 -- 172.21.15.17:0/1651730217 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404009ae0 con 0x55920a3826b0 2023-07-14T13:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.031+0000 7fb3f9ffb700 1 -- 172.21.15.17:0/1651730217 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb40401d750 con 0x55920a3826b0 2023-07-14T13:03:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.031+0000 7fb3f9ffb700 1 -- 172.21.15.17:0/1651730217 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404005350 con 0x55920a3826b0 2023-07-14T13:03:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.031+0000 7fb42cb6db80 1 -- 172.21.15.17:0/1651730217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a3826b0 msgr2=0x55920a526040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.031+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/1651730217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a3826b0 0x55920a526040 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb404019040 tx=0x7fb4040039e0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.031+0000 7fb42cb6db80 1 -- 172.21.15.17:0/1651730217 shutdown_connections 2023-07-14T13:03:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.031+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/1651730217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a52c2d0 0x55920a520c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.031+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/1651730217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a3826b0 0x55920a526040 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.031+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/1651730217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a526580 0x55920a52f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.031+0000 7fb42cb6db80 1 -- 172.21.15.17:0/1651730217 >> 172.21.15.17:0/1651730217 conn(0x55920a51bbe0 msgr2=0x55920a52f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.031+0000 7fb42cb6db80 1 -- 172.21.15.17:0/1651730217 shutdown_connections 2023-07-14T13:03:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.031+0000 7fb42cb6db80 1 -- 172.21.15.17:0/1651730217 wait complete. 2023-07-14T13:03:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.032+0000 7fb42cb6db80 1 -- start start 2023-07-14T13:03:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.032+0000 7fb42cb6db80 1 Processor -- start 2023-07-14T13:03:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a3826b0 0x55920a5366b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a536bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb42cb6db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a52c2d0 0x55920a534c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a535250 con 0x55920a526580 2023-07-14T13:03:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a5353c0 con 0x55920a3826b0 2023-07-14T13:03:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb42cb6db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920a535580 con 0x55920a52c2d0 2023-07-14T13:03:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb42cb6db80 10 client.0 _ll_register_callbacks cb 0x7fb404004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:03:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb41259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a536bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb412d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a3826b0 0x55920a5366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb41259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a536bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43568/0 (socket says 172.21.15.17:43568) 2023-07-14T13:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb41259c700 1 -- 172.21.15.17:0/2758113117 learned_addr learned my addr 172.21.15.17:0/2758113117 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.033+0000 7fb41359e700 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a52c2d0 0x55920a534c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.034+0000 7fb41259c700 1 -- 172.21.15.17:0/2758113117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a52c2d0 msgr2=0x55920a534c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.034+0000 7fb41259c700 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a52c2d0 0x55920a534c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.034+0000 7fb41259c700 1 -- 172.21.15.17:0/2758113117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a3826b0 msgr2=0x55920a5366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:03:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.034+0000 7fb41259c700 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a3826b0 0x55920a5366b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.034+0000 7fb41259c700 1 -- 172.21.15.17:0/2758113117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55920a28ec00 con 0x55920a526580 2023-07-14T13:03:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.034+0000 7fb412d9d700 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a3826b0 0x55920a5366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:03:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.034+0000 7fb41259c700 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a536bf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb408096d20 tx=0x7fb4080d0740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c38de00c20c147c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:03:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.034+0000 7fb3f6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:03:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.034+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2758113117 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080042f0 con 0x55920a526580 2023-07-14T13:03:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.034+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2758113117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb40c0074e0 con 0x55920a526580 2023-07-14T13:03:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.034+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2758113117 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb40801e2e0 con 0x55920a526580 2023-07-14T13:03:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.035+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2758113117 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb40800cbd0 con 0x55920a526580 2023-07-14T13:03:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.035+0000 7fb42cb6db80 10 client.16707 fetch_fsmap learned FSMap version 26 2023-07-14T13:03:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.035+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2758113117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55920a2cc1f0 con 0x55920a526580 2023-07-14T13:03:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.035+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2758113117 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4080b6020 con 0x55920a526580 2023-07-14T13:03:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.035+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2758113117 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fb40809a510 con 0x55920a526580 2023-07-14T13:03:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.035+0000 7fb42cb6db80 10 client.16707 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:03:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.035+0000 7fb42cb6db80 10 client.16707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:03:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.035+0000 7fb42cb6db80 20 client.16707 populate_metadata read hostname 'smithi017' 2023-07-14T13:03:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.035+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55920a594bd0 0x55920a596fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:03:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.035+0000 7fb42cb6db80 4 client.16707 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:03:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.035+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2758113117 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55920a432ff0 con 0x55920a594bd0 2023-07-14T13:03:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.036+0000 7fb412d9d700 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55920a594bd0 0x55920a596fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:03:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.036+0000 7fb3f6ff5700 10 client.16707 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.036+0000 7fb412d9d700 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55920a594bd0 0x55920a596fe0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93bf8cffba882519 server_cookie=d0ad89c49facc6d7 in_seq=0 out_seq=0 2023-07-14T13:03:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb3f6ff5700 1 -- 172.21.15.17:0/2758113117 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55920a432ff0 con 0x55920a594bd0 2023-07-14T13:03:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb3f6ff5700 10 client.16707 handle_command_reply: tid=0 2023-07-14T13:03:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb42cb6db80 1 client.16707 shutdown 2023-07-14T13:03:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2758113117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 msgr2=0x55920a536bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a536bf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb408096d20 tx=0x7fb4080d0740 comp rx=0 tx=0).stop 2023-07-14T13:03:59.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2758113117 shutdown_connections 2023-07-14T13:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55920a594bd0 0x55920a596fe0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55920a52c2d0 0x55920a534c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55920a3826b0 0x55920a5366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb42cb6db80 1 --2- 172.21.15.17:0/2758113117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55920a526580 0x55920a536bf0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb3f6ff5700 0 client.16707 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2758113117 >> 172.21.15.17:0/2758113117 conn(0x55920a51bbe0 msgr2=0x55920a52cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:59.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2758113117 shutdown_connections 2023-07-14T13:03:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.052+0000 7fb42cb6db80 1 -- 172.21.15.17:0/2758113117 wait complete. 2023-07-14T13:03:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.053+0000 7fb42cb6db80 20 client.16707 trim_cache size 0 max 16384 2023-07-14T13:03:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:03:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:03:59.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:03:59.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.053+0000 7fb4191ff700 1 -- 172.21.15.17:0/742872902 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3fc0a12c0 msgr2=0x7fb3fc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.053+0000 7fb4191ff700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3fc0a12c0 0x7fb3fc0a3770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55920a522b40 tx=0x7fb404009260 comp rx=0 tx=0).stop 2023-07-14T13:03:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.053+0000 7fb4191ff700 1 -- 172.21.15.17:0/742872902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4141004b0 msgr2=0x7fb414198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:03:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.053+0000 7fb4191ff700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4141004b0 0x7fb414198330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb40800eb30 tx=0x7fb40800ee40 comp rx=0 tx=0).stop 2023-07-14T13:03:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.053+0000 7fb4191ff700 1 -- 172.21.15.17:0/742872902 shutdown_connections 2023-07-14T13:03:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.053+0000 7fb4191ff700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3fc0a12c0 0x7fb3fc0a3770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.053+0000 7fb4191ff700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb414105b10 0x7fb41419c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.053+0000 7fb4191ff700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4140ffb00 0x7fb414197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.053+0000 7fb4191ff700 1 --2- 172.21.15.17:0/742872902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4141004b0 0x7fb414198330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:03:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.053+0000 7fb4191ff700 1 -- 172.21.15.17:0/742872902 >> 172.21.15.17:0/742872902 conn(0x7fb4140fb600 msgr2=0x7fb4140fbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:03:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.054+0000 7fb4191ff700 1 -- 172.21.15.17:0/742872902 shutdown_connections 2023-07-14T13:03:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:03:59.054+0000 7fb4191ff700 1 -- 172.21.15.17:0/742872902 wait complete. 2023-07-14T13:03:59.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:59 smithi135 ceph-mon[97338]: pgmap v130: 97 pgs: 97 active+clean; 3.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 22 MiB/s wr, 39 op/s 2023-07-14T13:03:59.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:59 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:03:59.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:59 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:59.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:59 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:03:59.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:59 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:03:59.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:59 smithi135 ceph-mon[97338]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2023-07-14T13:03:59.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:59 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:59.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:59 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:03:59.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:59 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:03:59.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:03:59 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:03:59.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:59 smithi131 ceph-mon[96953]: pgmap v130: 97 pgs: 97 active+clean; 3.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 22 MiB/s wr, 39 op/s 2023-07-14T13:03:59.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:59 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:03:59.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:59 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:59.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:59 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:03:59.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:59 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:03:59.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:59 smithi131 ceph-mon[96953]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2023-07-14T13:03:59.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:59 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:59.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:59 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:03:59.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:59 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:03:59.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:03:59 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:03:59.540 INFO:teuthology.orchestra.run.smithi017.stderr:14700000 of 50000000 tuples (29%) done (elapsed 229.14 s, remaining 550.25 s) 2023-07-14T13:03:59.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:59 smithi017 ceph-mon[95536]: pgmap v130: 97 pgs: 97 active+clean; 3.3 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 22 MiB/s wr, 39 op/s 2023-07-14T13:03:59.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:59 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:03:59.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:59 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:59.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:59 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:03:59.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:59 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:03:59.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:59 smithi017 ceph-mon[95536]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2023-07-14T13:03:59.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:59 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:03:59.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:59 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:03:59.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:59 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:03:59.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:03:59 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:04:00.818 INFO:teuthology.orchestra.run.smithi017.stderr:14800000 of 50000000 tuples (29%) done (elapsed 230.42 s, remaining 548.03 s) 2023-07-14T13:04:01.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:01 smithi135 ceph-mon[97338]: pgmap v131: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 33 MiB/s wr, 135 op/s 2023-07-14T13:04:01.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:01 smithi131 ceph-mon[96953]: pgmap v131: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 33 MiB/s wr, 135 op/s 2023-07-14T13:04:01.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:01 smithi017 ceph-mon[95536]: pgmap v131: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 33 MiB/s wr, 135 op/s 2023-07-14T13:04:02.232 INFO:teuthology.orchestra.run.smithi017.stderr:14900000 of 50000000 tuples (29%) done (elapsed 231.84 s, remaining 546.14 s) 2023-07-14T13:04:03.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:03 smithi135 ceph-mon[97338]: pgmap v132: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 22 MiB/s wr, 108 op/s 2023-07-14T13:04:03.486 INFO:teuthology.orchestra.run.smithi017.stderr:15000000 of 50000000 tuples (30%) done (elapsed 233.09 s, remaining 543.87 s) 2023-07-14T13:04:03.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:03 smithi131 ceph-mon[96953]: pgmap v132: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 22 MiB/s wr, 108 op/s 2023-07-14T13:04:03.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:03 smithi017 ceph-mon[95536]: pgmap v132: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 22 MiB/s wr, 108 op/s 2023-07-14T13:04:04.765 INFO:teuthology.orchestra.run.smithi017.stderr:15100000 of 50000000 tuples (30%) done (elapsed 234.37 s, remaining 541.69 s) 2023-07-14T13:04:05.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:05 smithi135 ceph-mon[97338]: pgmap v133: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 22 MiB/s wr, 108 op/s 2023-07-14T13:04:05.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:05 smithi131 ceph-mon[96953]: pgmap v133: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 22 MiB/s wr, 108 op/s 2023-07-14T13:04:05.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:05 smithi017 ceph-mon[95536]: pgmap v133: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 22 MiB/s wr, 108 op/s 2023-07-14T13:04:06.057 INFO:teuthology.orchestra.run.smithi017.stderr:15200000 of 50000000 tuples (30%) done (elapsed 235.66 s, remaining 539.54 s) 2023-07-14T13:04:07.413 INFO:teuthology.orchestra.run.smithi017.stderr:15300000 of 50000000 tuples (30%) done (elapsed 237.02 s, remaining 537.55 s) 2023-07-14T13:04:07.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:07 smithi135 ceph-mon[97338]: pgmap v134: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 34 MiB/s wr, 129 op/s 2023-07-14T13:04:07.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:07 smithi131 ceph-mon[96953]: pgmap v134: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 34 MiB/s wr, 129 op/s 2023-07-14T13:04:07.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:07 smithi017 ceph-mon[95536]: pgmap v134: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 34 MiB/s wr, 129 op/s 2023-07-14T13:04:08.677 INFO:teuthology.orchestra.run.smithi017.stderr:15400000 of 50000000 tuples (30%) done (elapsed 238.28 s, remaining 535.35 s) 2023-07-14T13:04:09.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:09 smithi135 ceph-mon[97338]: pgmap v135: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-07-14T13:04:09.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:09 smithi131 ceph-mon[96953]: pgmap v135: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-07-14T13:04:09.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:09 smithi017 ceph-mon[95536]: pgmap v135: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 22 MiB/s wr, 116 op/s 2023-07-14T13:04:09.972 INFO:teuthology.orchestra.run.smithi017.stderr:15500000 of 50000000 tuples (31%) done (elapsed 239.57 s, remaining 533.25 s) 2023-07-14T13:04:11.249 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:11 smithi131 ceph-mon[96953]: pgmap v136: 97 pgs: 97 active+clean; 3.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 33 MiB/s wr, 124 op/s 2023-07-14T13:04:11.368 INFO:teuthology.orchestra.run.smithi017.stderr:15600000 of 50000000 tuples (31%) done (elapsed 240.97 s, remaining 531.37 s) 2023-07-14T13:04:11.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:11 smithi135 ceph-mon[97338]: pgmap v136: 97 pgs: 97 active+clean; 3.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 33 MiB/s wr, 124 op/s 2023-07-14T13:04:11.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:11 smithi017 ceph-mon[95536]: pgmap v136: 97 pgs: 97 active+clean; 3.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 33 MiB/s wr, 124 op/s 2023-07-14T13:04:12.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.232+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/3574855438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101fb0 msgr2=0x7f2b44102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:12.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.232+0000 7f2b4b3ff700 1 --2- 172.21.15.17:0/3574855438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101fb0 0x7f2b44102380 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2b400099c0 tx=0x7f2b40009cd0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.233+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/3574855438 shutdown_connections 2023-07-14T13:04:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.233+0000 7f2b4b3ff700 1 --2- 172.21.15.17:0/3574855438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b44106ff0 0x7f2b4410ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.233+0000 7f2b4b3ff700 1 --2- 172.21.15.17:0/3574855438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101fb0 0x7f2b44102380 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.233+0000 7f2b4b3ff700 1 --2- 172.21.15.17:0/3574855438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44102950 0x7f2b44106910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.233+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/3574855438 >> 172.21.15.17:0/3574855438 conn(0x7f2b440fd800 msgr2=0x7f2b440ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.233+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/3574855438 shutdown_connections 2023-07-14T13:04:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.233+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/3574855438 wait complete. 2023-07-14T13:04:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.234+0000 7f2b4b3ff700 1 Processor -- start 2023-07-14T13:04:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.234+0000 7f2b4b3ff700 1 -- start start 2023-07-14T13:04:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.234+0000 7f2b4b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101fb0 0x7f2b44197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.234+0000 7f2b4b3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44102950 0x7f2b441982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.234+0000 7f2b4b3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b44106ff0 0x7f2b4419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.234+0000 7f2b4b3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4419cf70 con 0x7f2b44102950 2023-07-14T13:04:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4b3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4419d0e0 con 0x7f2b44106ff0 2023-07-14T13:04:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4419d2a0 con 0x7f2b44101fb0 2023-07-14T13:04:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101fb0 0x7f2b44197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44102950 0x7f2b441982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101fb0 0x7f2b44197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54460/0 (socket says 172.21.15.17:54460) 2023-07-14T13:04:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4919b700 1 -- 172.21.15.17:0/2020720859 learned_addr learned my addr 172.21.15.17:0/2020720859 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4999c700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b44106ff0 0x7f2b4419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4919b700 1 -- 172.21.15.17:0/2020720859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b44106ff0 msgr2=0x7f2b4419c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4919b700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b44106ff0 0x7f2b4419c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4919b700 1 -- 172.21.15.17:0/2020720859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44102950 msgr2=0x7f2b441982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4919b700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44102950 0x7f2b441982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.235+0000 7f2b4919b700 1 -- 172.21.15.17:0/2020720859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b34009520 con 0x7f2b44101fb0 2023-07-14T13:04:12.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.236+0000 7f2b4919b700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101fb0 0x7f2b44197d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b40005910 tx=0x7f2b4000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.236+0000 7f2b3a7fc700 1 -- 172.21.15.17:0/2020720859 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4001d070 con 0x7f2b44101fb0 2023-07-14T13:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.236+0000 7f2b3a7fc700 1 -- 172.21.15.17:0/2020720859 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b40005050 con 0x7f2b44101fb0 2023-07-14T13:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.236+0000 7f2b3a7fc700 1 -- 172.21.15.17:0/2020720859 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40004950 con 0x7f2b44101fb0 2023-07-14T13:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.236+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/2020720859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b400095f0 con 0x7f2b44101fb0 2023-07-14T13:04:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.236+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/2020720859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4419d760 con 0x7f2b44101fb0 2023-07-14T13:04:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.240+0000 7f2b3a7fc700 1 -- 172.21.15.17:0/2020720859 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2b400051c0 con 0x7f2b44101fb0 2023-07-14T13:04:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.241+0000 7f2b5ed95b80 1 Processor -- start 2023-07-14T13:04:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.241+0000 7f2b5ed95b80 1 -- start start 2023-07-14T13:04:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.241+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba49fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.241+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba49a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.241+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba49a580 0x55aaba49a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.241+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba39fc50 con 0x55aaba49a580 2023-07-14T13:04:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.241+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba3f29e0 con 0x55aaba2f66b0 2023-07-14T13:04:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.241+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba3ebe70 con 0x55aaba4a02d0 2023-07-14T13:04:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b4999c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba49fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b4919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba49a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b4999c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba49fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60910/0 (socket says 172.21.15.17:60910) 2023-07-14T13:04:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b4999c700 1 -- 172.21.15.17:0/269239753 learned_addr learned my addr 172.21.15.17:0/269239753 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b4899a700 1 --2- 172.21.15.17:0/269239753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba49a580 0x55aaba49a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b4999c700 1 -- 172.21.15.17:0/269239753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 msgr2=0x55aaba49a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b4999c700 1 --2- 172.21.15.17:0/269239753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba49a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b4999c700 1 -- 172.21.15.17:0/269239753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba49a580 msgr2=0x55aaba49a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b4999c700 1 --2- 172.21.15.17:0/269239753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba49a580 0x55aaba49a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b4999c700 1 -- 172.21.15.17:0/269239753 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aaba219d80 con 0x55aaba2f66b0 2023-07-14T13:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b3a7fc700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b300a12c0 0x7f2b300a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b3a7fc700 1 -- 172.21.15.17:0/2020720859 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2b400cda10 con 0x7f2b44101fb0 2023-07-14T13:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.242+0000 7f2b4999c700 1 --2- 172.21.15.17:0/269239753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba49fd90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c011680 tx=0x7f2b3c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=757c74012557cc0b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.243+0000 7f2b4919b700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b300a12c0 0x7f2b300a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.243+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/269239753 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00e040 con 0x55aaba2f66b0 2023-07-14T13:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.243+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/269239753 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b3c00f040 con 0x55aaba2f66b0 2023-07-14T13:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.243+0000 7f2b2f7fe700 1 -- 172.21.15.17:0/269239753 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c004730 con 0x55aaba2f66b0 2023-07-14T13:04:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.244+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/269239753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 msgr2=0x55aaba49fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.244+0000 7f2b4919b700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b300a12c0 0x7f2b300a3770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55aaba496b40 tx=0x7f2b400d3530 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.244+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/269239753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba49fd90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c011680 tx=0x7f2b3c009920 comp rx=0 tx=0).stop 2023-07-14T13:04:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.244+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/269239753 shutdown_connections 2023-07-14T13:04:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.244+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/269239753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba49a580 0x55aaba49a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.244+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/269239753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba49fd90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.244+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/269239753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba49a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.244+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/269239753 >> 172.21.15.17:0/269239753 conn(0x55aaba48fbe0 msgr2=0x55aaba494f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.244+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/269239753 shutdown_connections 2023-07-14T13:04:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.244+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/269239753 wait complete. 2023-07-14T13:04:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.244+0000 7f2b5ed95b80 1 -- start start 2023-07-14T13:04:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.245+0000 7f2b5ed95b80 1 Processor -- start 2023-07-14T13:04:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.245+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba4a6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.245+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba49a580 0x55aaba4a3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.245+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba4a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.245+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba38ba60 con 0x55aaba49a580 2023-07-14T13:04:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.245+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba38b760 con 0x55aaba2f66b0 2023-07-14T13:04:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.245+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba26f8c0 con 0x55aaba4a02d0 2023-07-14T13:04:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.245+0000 7f2b5ed95b80 10 client.0 _ll_register_callbacks cb 0x55aaba389700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.246+0000 7f2b4899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba49a580 0x55aaba4a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.246+0000 7f2b4999c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba4a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.246+0000 7f2b4999c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba4a6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60914/0 (socket says 172.21.15.17:60914) 2023-07-14T13:04:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.246+0000 7f2b4999c700 1 -- 172.21.15.17:0/814158033 learned_addr learned my addr 172.21.15.17:0/814158033 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.246+0000 7f2b4999c700 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba4a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.246+0000 7f2b4899a700 1 -- 172.21.15.17:0/814158033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 msgr2=0x55aaba4a3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.246+0000 7f2b4899a700 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba4a3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.246+0000 7f2b4899a700 1 -- 172.21.15.17:0/814158033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 msgr2=0x55aaba4a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.246+0000 7f2b4899a700 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba4a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.246+0000 7f2b4899a700 1 -- 172.21.15.17:0/814158033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c011330 con 0x55aaba49a580 2023-07-14T13:04:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.246+0000 7f2b4999c700 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba4a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.247+0000 7f2b4899a700 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba49a580 0x55aaba4a3820 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2b44069a70 tx=0x7f2b34011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82eb549d44551e37 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.247+0000 7f2b2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:04:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.247+0000 7f2b2cff9700 1 -- 172.21.15.17:0/814158033 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34016070 con 0x55aaba49a580 2023-07-14T13:04:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.247+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/814158033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aaba345490 con 0x55aaba49a580 2023-07-14T13:04:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.247+0000 7f2b2cff9700 1 -- 172.21.15.17:0/814158033 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2b34004320 con 0x55aaba49a580 2023-07-14T13:04:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.247+0000 7f2b2cff9700 1 -- 172.21.15.17:0/814158033 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b34004520 con 0x55aaba49a580 2023-07-14T13:04:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.247+0000 7f2b5ed95b80 10 client.16719 fetch_fsmap learned FSMap version 26 2023-07-14T13:04:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.247+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/814158033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55aaba202c00 con 0x55aaba49a580 2023-07-14T13:04:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.247+0000 7f2b2cff9700 1 -- 172.21.15.17:0/814158033 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aaba345490 con 0x55aaba49a580 2023-07-14T13:04:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.248+0000 7f2b2cff9700 1 -- 172.21.15.17:0/814158033 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f2b34005530 con 0x55aaba49a580 2023-07-14T13:04:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.248+0000 7f2b5ed95b80 10 client.16719 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:04:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.248+0000 7f2b5ed95b80 10 client.16719 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.248+0000 7f2b5ed95b80 20 client.16719 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.248+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aaba4b3b90 0x55aaba4b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.248+0000 7f2b5ed95b80 4 client.16719 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:04:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.248+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/814158033 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aaba3e4e50 con 0x55aaba4b3b90 2023-07-14T13:04:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.248+0000 7f2b4999c700 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aaba4b3b90 0x55aaba4b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.249+0000 7f2b4999c700 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aaba4b3b90 0x55aaba4b5fa0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7a257e927edb625 server_cookie=e865470480a19551 in_seq=0 out_seq=0 2023-07-14T13:04:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.249+0000 7f2b2cff9700 10 client.16719 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b2cff9700 1 -- 172.21.15.17:0/814158033 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55aaba3e4e50 con 0x55aaba4b3b90 2023-07-14T13:04:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b2cff9700 10 client.16719 handle_command_reply: tid=0 2023-07-14T13:04:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b5ed95b80 1 client.16719 shutdown 2023-07-14T13:04:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/814158033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba49a580 msgr2=0x55aaba4a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba49a580 0x55aaba4a3820 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2b44069a70 tx=0x7f2b34011a90 comp rx=0 tx=0).stop 2023-07-14T13:04:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/814158033 shutdown_connections 2023-07-14T13:04:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aaba4b3b90 0x55aaba4b5fa0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba4a3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba2f66b0 0x55aaba4a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/814158033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba49a580 0x55aaba4a3820 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/814158033 >> 172.21.15.17:0/814158033 conn(0x55aaba48fbe0 msgr2=0x55aaba493c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b2cff9700 0 client.16719 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/814158033 shutdown_connections 2023-07-14T13:04:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.250+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/814158033 wait complete. 2023-07-14T13:04:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.251+0000 7f2b5ed95b80 20 client.16719 trim_cache size 0 max 16384 2023-07-14T13:04:12.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.272+0000 7f2b5ed95b80 1 Processor -- start 2023-07-14T13:04:12.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.272+0000 7f2b5ed95b80 1 -- start start 2023-07-14T13:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.272+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba2f66b0 0x55aaba49a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.272+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba494c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba496bb0 con 0x55aaba2f66b0 2023-07-14T13:04:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba460060 con 0x55aaba49a580 2023-07-14T13:04:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba4a06a0 con 0x55aaba4a02d0 2023-07-14T13:04:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b4999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba2f66b0 0x55aaba49a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b4899a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b4899a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60928/0 (socket says 172.21.15.17:60928) 2023-07-14T13:04:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b4899a700 1 -- 172.21.15.17:0/2476867526 learned_addr learned my addr 172.21.15.17:0/2476867526 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b4999c700 1 --2- 172.21.15.17:0/2476867526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba494c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b4899a700 1 -- 172.21.15.17:0/2476867526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 msgr2=0x55aaba494c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b4899a700 1 --2- 172.21.15.17:0/2476867526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba494c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b4899a700 1 -- 172.21.15.17:0/2476867526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba2f66b0 msgr2=0x55aaba49a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b4899a700 1 --2- 172.21.15.17:0/2476867526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba2f66b0 0x55aaba49a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b4899a700 1 -- 172.21.15.17:0/2476867526 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aaba4babd0 con 0x55aaba49a580 2023-07-14T13:04:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.273+0000 7f2b4999c700 1 --2- 172.21.15.17:0/2476867526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba2f66b0 0x55aaba49a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.274+0000 7f2b4899a700 1 --2- 172.21.15.17:0/2476867526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a37d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2b34005950 tx=0x7f2b34003870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=545847b20e362c91 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.274+0000 7f2b2ffff700 1 -- 172.21.15.17:0/2476867526 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34016040 con 0x55aaba49a580 2023-07-14T13:04:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.274+0000 7f2b2ffff700 1 -- 172.21.15.17:0/2476867526 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b34003ea0 con 0x55aaba49a580 2023-07-14T13:04:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.274+0000 7f2b2ffff700 1 -- 172.21.15.17:0/2476867526 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3402caa0 con 0x55aaba49a580 2023-07-14T13:04:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.275+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/2476867526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 msgr2=0x55aaba4a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.275+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/2476867526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a37d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2b34005950 tx=0x7f2b34003870 comp rx=0 tx=0).stop 2023-07-14T13:04:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.275+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/2476867526 shutdown_connections 2023-07-14T13:04:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.275+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/2476867526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba4a02d0 0x55aaba494c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.275+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/2476867526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba2f66b0 0x55aaba49a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.275+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/2476867526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a37d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.275+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/2476867526 >> 172.21.15.17:0/2476867526 conn(0x55aaba48fbe0 msgr2=0x55aaba4a30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.275+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/2476867526 shutdown_connections 2023-07-14T13:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.275+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/2476867526 wait complete. 2023-07-14T13:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.275+0000 7f2b5ed95b80 1 -- start start 2023-07-14T13:04:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.276+0000 7f2b5ed95b80 1 Processor -- start 2023-07-14T13:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.276+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba2f66b0 0x55aaba4a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.276+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.276+0000 7f2b5ed95b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba4a02d0 0x55aaba4a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.276+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba506b80 con 0x55aaba4a02d0 2023-07-14T13:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.276+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba506cf0 con 0x55aaba49a580 2023-07-14T13:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.276+0000 7f2b5ed95b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaba506eb0 con 0x55aaba2f66b0 2023-07-14T13:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.276+0000 7f2b5ed95b80 10 client.0 _ll_register_callbacks cb 0x7f2b34009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b4999c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba2f66b0 0x55aaba4a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b4899a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b4899a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60940/0 (socket says 172.21.15.17:60940) 2023-07-14T13:04:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b4899a700 1 -- 172.21.15.17:0/3615428322 learned_addr learned my addr 172.21.15.17:0/3615428322 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b4999c700 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba4a02d0 0x55aaba4a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b4899a700 1 -- 172.21.15.17:0/3615428322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba2f66b0 msgr2=0x55aaba4a8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b4899a700 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba2f66b0 0x55aaba4a8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b4899a700 1 -- 172.21.15.17:0/3615428322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba4a02d0 msgr2=0x55aaba4a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b4899a700 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba4a02d0 0x55aaba4a96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b4899a700 1 -- 172.21.15.17:0/3615428322 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c028040 con 0x55aaba49a580 2023-07-14T13:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b4899a700 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a9190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b34006010 tx=0x7f2b340037f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2b720967e9fc739 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.277+0000 7f2b2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:04:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.278+0000 7f2b2cff9700 1 -- 172.21.15.17:0/3615428322 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3403b070 con 0x55aaba49a580 2023-07-14T13:04:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.278+0000 7f2b2cff9700 1 -- 172.21.15.17:0/3615428322 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2b34000e40 con 0x55aaba49a580 2023-07-14T13:04:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.278+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/3615428322 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b3c00f040 con 0x55aaba49a580 2023-07-14T13:04:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.278+0000 7f2b2cff9700 1 -- 172.21.15.17:0/3615428322 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b34016040 con 0x55aaba49a580 2023-07-14T13:04:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.278+0000 7f2b5ed95b80 10 client.26447 fetch_fsmap learned FSMap version 26 2023-07-14T13:04:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.278+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/3615428322 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55aaba202c00 con 0x55aaba49a580 2023-07-14T13:04:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.278+0000 7f2b2cff9700 1 -- 172.21.15.17:0/3615428322 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b3c00f040 con 0x55aaba49a580 2023-07-14T13:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.278+0000 7f2b2cff9700 1 -- 172.21.15.17:0/3615428322 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f2b3403e030 con 0x55aaba49a580 2023-07-14T13:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.279+0000 7f2b5ed95b80 10 client.26447 fetch_fsmap finished waiting for FSMap version 26 2023-07-14T13:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.279+0000 7f2b5ed95b80 10 client.26447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.279+0000 7f2b5ed95b80 20 client.26447 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.279+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aaba5081e0 0x55aaba50a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.279+0000 7f2b5ed95b80 4 client.26447 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.279+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/3615428322 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aaba3a6ff0 con 0x55aaba5081e0 2023-07-14T13:04:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.279+0000 7f2b4999c700 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aaba5081e0 0x55aaba50a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.279+0000 7f2b4999c700 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aaba5081e0 0x55aaba50a5c0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16f530909aba5478 server_cookie=81535f5c0be7f4cb in_seq=0 out_seq=0 2023-07-14T13:04:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.279+0000 7f2b2cff9700 10 client.26447 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b2cff9700 1 -- 172.21.15.17:0/3615428322 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aaba3a6ff0 con 0x55aaba5081e0 2023-07-14T13:04:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b2cff9700 10 client.26447 handle_command_reply: tid=0 2023-07-14T13:04:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 1 client.26447 shutdown 2023-07-14T13:04:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/3615428322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 msgr2=0x55aaba4a9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a9190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b34006010 tx=0x7f2b340037f0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/3615428322 shutdown_connections 2023-07-14T13:04:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aaba5081e0 0x55aaba50a5c0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aaba4a02d0 0x55aaba4a96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aaba2f66b0 0x55aaba4a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b2cff9700 0 client.26447 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 1 --2- 172.21.15.17:0/3615428322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaba49a580 0x55aaba4a9190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/3615428322 >> 172.21.15.17:0/3615428322 conn(0x55aaba48fbe0 msgr2=0x55aaba49f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/3615428322 shutdown_connections 2023-07-14T13:04:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 1 -- 172.21.15.17:0/3615428322 wait complete. 2023-07-14T13:04:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.294+0000 7f2b5ed95b80 20 client.26447 trim_cache size 0 max 16384 2023-07-14T13:04:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:04:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:04:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:04:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:04:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/2020720859 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b300a12c0 msgr2=0x7f2b300a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b300a12c0 0x7f2b300a3770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55aaba496b40 tx=0x7f2b400d3530 comp rx=0 tx=0).stop 2023-07-14T13:04:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/2020720859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101fb0 msgr2=0x7f2b44197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101fb0 0x7f2b44197d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b40005910 tx=0x7f2b4000f690 comp rx=0 tx=0).stop 2023-07-14T13:04:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/2020720859 shutdown_connections 2023-07-14T13:04:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b300a12c0 0x7f2b300a3770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b44106ff0 0x7f2b4419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b44101fb0 0x7f2b44197d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 --2- 172.21.15.17:0/2020720859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b44102950 0x7f2b441982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/2020720859 >> 172.21.15.17:0/2020720859 conn(0x7f2b440fd800 msgr2=0x7f2b441058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/2020720859 shutdown_connections 2023-07-14T13:04:12.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:12.295+0000 7f2b4b3ff700 1 -- 172.21.15.17:0/2020720859 wait complete. 2023-07-14T13:04:12.668 INFO:teuthology.orchestra.run.smithi017.stderr:15700000 of 50000000 tuples (31%) done (elapsed 242.27 s, remaining 529.29 s) 2023-07-14T13:04:13.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:13 smithi135 ceph-mon[97338]: pgmap v137: 97 pgs: 97 active+clean; 3.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 28 op/s 2023-07-14T13:04:13.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:13 smithi131 ceph-mon[96953]: pgmap v137: 97 pgs: 97 active+clean; 3.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 28 op/s 2023-07-14T13:04:13.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:13 smithi017 ceph-mon[95536]: pgmap v137: 97 pgs: 97 active+clean; 3.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 28 op/s 2023-07-14T13:04:13.954 INFO:teuthology.orchestra.run.smithi017.stderr:15800000 of 50000000 tuples (31%) done (elapsed 243.56 s, remaining 527.19 s) 2023-07-14T13:04:15.315 INFO:teuthology.orchestra.run.smithi017.stderr:15900000 of 50000000 tuples (31%) done (elapsed 244.92 s, remaining 525.26 s) 2023-07-14T13:04:15.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:15 smithi135 ceph-mon[97338]: pgmap v138: 97 pgs: 97 active+clean; 3.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 28 op/s 2023-07-14T13:04:15.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:15 smithi131 ceph-mon[96953]: pgmap v138: 97 pgs: 97 active+clean; 3.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 28 op/s 2023-07-14T13:04:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:15 smithi017 ceph-mon[95536]: pgmap v138: 97 pgs: 97 active+clean; 3.6 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 28 op/s 2023-07-14T13:04:16.615 INFO:teuthology.orchestra.run.smithi017.stderr:16000000 of 50000000 tuples (32%) done (elapsed 246.22 s, remaining 523.21 s) 2023-07-14T13:04:17.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:17 smithi135 ceph-mon[97338]: pgmap v139: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-07-14T13:04:17.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:17 smithi131 ceph-mon[96953]: pgmap v139: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-07-14T13:04:17.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:17 smithi017 ceph-mon[95536]: pgmap v139: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-07-14T13:04:17.878 INFO:teuthology.orchestra.run.smithi017.stderr:16100000 of 50000000 tuples (32%) done (elapsed 247.48 s, remaining 521.09 s) 2023-07-14T13:04:19.162 INFO:teuthology.orchestra.run.smithi017.stderr:16200000 of 50000000 tuples (32%) done (elapsed 248.76 s, remaining 519.03 s) 2023-07-14T13:04:19.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:19 smithi135 ceph-mon[97338]: pgmap v140: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 23 MiB/s wr, 22 op/s 2023-07-14T13:04:19.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:19 smithi131 ceph-mon[96953]: pgmap v140: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 23 MiB/s wr, 22 op/s 2023-07-14T13:04:19.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:19 smithi017 ceph-mon[95536]: pgmap v140: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 23 MiB/s wr, 22 op/s 2023-07-14T13:04:20.527 INFO:teuthology.orchestra.run.smithi017.stderr:16300000 of 50000000 tuples (32%) done (elapsed 250.13 s, remaining 517.14 s) 2023-07-14T13:04:21.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:21 smithi135 ceph-mon[97338]: pgmap v141: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 34 MiB/s wr, 31 op/s 2023-07-14T13:04:21.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:21 smithi131 ceph-mon[96953]: pgmap v141: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 34 MiB/s wr, 31 op/s 2023-07-14T13:04:21.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:21 smithi017 ceph-mon[95536]: pgmap v141: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 34 MiB/s wr, 31 op/s 2023-07-14T13:04:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:16400000 of 50000000 tuples (32%) done (elapsed 251.40 s, remaining 515.06 s) 2023-07-14T13:04:23.094 INFO:teuthology.orchestra.run.smithi017.stderr:16500000 of 50000000 tuples (33%) done (elapsed 252.70 s, remaining 513.05 s) 2023-07-14T13:04:23.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:23 smithi135 ceph-mon[97338]: pgmap v142: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-14T13:04:23.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:23 smithi131 ceph-mon[96953]: pgmap v142: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-14T13:04:23.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:23 smithi017 ceph-mon[95536]: pgmap v142: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-14T13:04:24.393 INFO:teuthology.orchestra.run.smithi017.stderr:16600000 of 50000000 tuples (33%) done (elapsed 254.00 s, remaining 511.05 s) 2023-07-14T13:04:25.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:25 smithi135 ceph-mon[97338]: pgmap v143: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-14T13:04:25.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:25 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:04:25.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:25 smithi131 ceph-mon[96953]: pgmap v143: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-14T13:04:25.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:25 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:04:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.468+0000 7f81e8d9d700 1 -- 172.21.15.17:0/2335591343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e4101e50 msgr2=0x7f81e410c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.468+0000 7f81e8d9d700 1 --2- 172.21.15.17:0/2335591343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e4101e50 0x7f81e410c8a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00b0a0 tx=0x7f81dc00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.468+0000 7f81e8d9d700 1 -- 172.21.15.17:0/2335591343 shutdown_connections 2023-07-14T13:04:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.468+0000 7f81e8d9d700 1 --2- 172.21.15.17:0/2335591343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e4101e50 0x7f81e410c8a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.468+0000 7f81e8d9d700 1 --2- 172.21.15.17:0/2335591343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81e40ffd20 0x7f81e41000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.468+0000 7f81e8d9d700 1 --2- 172.21.15.17:0/2335591343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e41014a0 0x7f81e4101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.468+0000 7f81e8d9d700 1 -- 172.21.15.17:0/2335591343 >> 172.21.15.17:0/2335591343 conn(0x7f81e40fb440 msgr2=0x7f81e40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.469+0000 7f81e8d9d700 1 -- 172.21.15.17:0/2335591343 shutdown_connections 2023-07-14T13:04:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.469+0000 7f81e8d9d700 1 -- 172.21.15.17:0/2335591343 wait complete. 2023-07-14T13:04:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.470+0000 7f81e8d9d700 1 Processor -- start 2023-07-14T13:04:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.470+0000 7f81e8d9d700 1 -- start start 2023-07-14T13:04:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.470+0000 7f81e8d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e40ffd20 0x7f81e419dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.470+0000 7f81e8d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81e41014a0 0x7f81e419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.470+0000 7f81e8d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e4101e50 0x7f81e4197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.470+0000 7f81e8d9d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e41981a0 con 0x7f81e4101e50 2023-07-14T13:04:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.470+0000 7f81e8d9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4198310 con 0x7f81e40ffd20 2023-07-14T13:04:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.470+0000 7f81e8d9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e41984d0 con 0x7f81e41014a0 2023-07-14T13:04:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e4101e50 0x7f81e4197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81e37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81e41014a0 0x7f81e419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81db7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e40ffd20 0x7f81e419dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81e37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81e41014a0 0x7f81e419e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55242/0 (socket says 172.21.15.17:55242) 2023-07-14T13:04:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e4101e50 0x7f81e4197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48028/0 (socket says 172.21.15.17:48028) 2023-07-14T13:04:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81e37fe700 1 -- 172.21.15.17:0/1572462090 learned_addr learned my addr 172.21.15.17:0/1572462090 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81db7fe700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e40ffd20 0x7f81e419dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40430/0 (socket says 172.21.15.17:40430) 2023-07-14T13:04:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81db7fe700 1 -- 172.21.15.17:0/1572462090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81e41014a0 msgr2=0x7f81e419e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81db7fe700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81e41014a0 0x7f81e419e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81db7fe700 1 -- 172.21.15.17:0/1572462090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e4101e50 msgr2=0x7f81e4197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81db7fe700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e4101e50 0x7f81e4197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81db7fe700 1 -- 172.21.15.17:0/1572462090 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4009520 con 0x7f81e40ffd20 2023-07-14T13:04:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81e37fe700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81e41014a0 0x7f81e419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81e3fff700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e4101e50 0x7f81e4197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.471+0000 7f81db7fe700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e40ffd20 0x7f81e419dac0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f81d400e9f0 tx=0x7f81d400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.472+0000 7f81e17fa700 1 -- 172.21.15.17:0/1572462090 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400cb70 con 0x7f81e40ffd20 2023-07-14T13:04:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.472+0000 7f81e8d9d700 1 -- 172.21.15.17:0/1572462090 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc009d00 con 0x7f81e40ffd20 2023-07-14T13:04:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.472+0000 7f81e17fa700 1 -- 172.21.15.17:0/1572462090 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81d400ee90 con 0x7f81e40ffd20 2023-07-14T13:04:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.472+0000 7f81e17fa700 1 -- 172.21.15.17:0/1572462090 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4003bc0 con 0x7f81e40ffd20 2023-07-14T13:04:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.472+0000 7f81e8d9d700 1 -- 172.21.15.17:0/1572462090 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e4198970 con 0x7f81e40ffd20 2023-07-14T13:04:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.477+0000 7f81e17fa700 1 -- 172.21.15.17:0/1572462090 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f81d4003e20 con 0x7f81e40ffd20 2023-07-14T13:04:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.478+0000 7f81fd905b80 1 Processor -- start 2023-07-14T13:04:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.478+0000 7f81fd905b80 1 -- start start 2023-07-14T13:04:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054189f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56405418a470 0x5640541841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a8c0 0x564054184700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81fd905b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564054089c50 con 0x564053fe06b0 2023-07-14T13:04:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81fd905b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640540dc9e0 con 0x56405418a8c0 2023-07-14T13:04:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81fd905b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640540d5e70 con 0x56405418a470 2023-07-14T13:04:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054189f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054189f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48040/0 (socket says 172.21.15.17:48040) 2023-07-14T13:04:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81e3fff700 1 -- 172.21.15.17:0/458294148 learned_addr learned my addr 172.21.15.17:0/458294148 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56405418a470 0x5640541841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81e37fe700 1 --2- 172.21.15.17:0/458294148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a8c0 0x564054184700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.479+0000 7f81e17fa700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f81d00a1340 0x7f81d00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.480+0000 7f81e17fa700 1 -- 172.21.15.17:0/1572462090 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f81d4014070 con 0x7f81e40ffd20 2023-07-14T13:04:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.480+0000 7f81e3fff700 1 -- 172.21.15.17:0/458294148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56405418a470 msgr2=0x5640541841a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.480+0000 7f81e3fff700 1 --2- 172.21.15.17:0/458294148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56405418a470 0x5640541841a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.480+0000 7f81e3fff700 1 -- 172.21.15.17:0/458294148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a8c0 msgr2=0x564054184700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.480+0000 7f81e3fff700 1 --2- 172.21.15.17:0/458294148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a8c0 0x564054184700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.480+0000 7f81e3fff700 1 -- 172.21.15.17:0/458294148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564053f03d80 con 0x564053fe06b0 2023-07-14T13:04:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.480+0000 7f81db7fe700 1 --2- 172.21.15.17:0/458294148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56405418a470 0x5640541841a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.480+0000 7f81e37fe700 1 --2- 172.21.15.17:0/458294148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a8c0 0x564054184700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.480+0000 7f81e3fff700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f81d00a1340 0x7f81d00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.480+0000 7f81e3fff700 1 --2- 172.21.15.17:0/458294148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054189f30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00b0a0 tx=0x7f81dc009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839f2618fc8220c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.481+0000 7f81d9ffb700 1 -- 172.21.15.17:0/458294148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00e040 con 0x564053fe06b0 2023-07-14T13:04:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.481+0000 7f81d9ffb700 1 -- 172.21.15.17:0/458294148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81dc0078c0 con 0x564053fe06b0 2023-07-14T13:04:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.481+0000 7f81d9ffb700 1 -- 172.21.15.17:0/458294148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc005110 con 0x564053fe06b0 2023-07-14T13:04:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.481+0000 7f81fd905b80 1 -- 172.21.15.17:0/458294148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 msgr2=0x564054189f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.481+0000 7f81fd905b80 1 --2- 172.21.15.17:0/458294148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054189f30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00b0a0 tx=0x7f81dc009c90 comp rx=0 tx=0).stop 2023-07-14T13:04:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.481+0000 7f81e3fff700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f81d00a1340 0x7f81d00a37f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f81dc029000 tx=0x7f81dc02a000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.482+0000 7f81fd905b80 1 -- 172.21.15.17:0/458294148 shutdown_connections 2023-07-14T13:04:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.482+0000 7f81fd905b80 1 --2- 172.21.15.17:0/458294148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a8c0 0x564054184700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.482+0000 7f81fd905b80 1 --2- 172.21.15.17:0/458294148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054189f30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.482+0000 7f81fd905b80 1 --2- 172.21.15.17:0/458294148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56405418a470 0x5640541841a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.482+0000 7f81fd905b80 1 -- 172.21.15.17:0/458294148 >> 172.21.15.17:0/458294148 conn(0x564054179d40 msgr2=0x56405417f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.482+0000 7f81fd905b80 1 -- 172.21.15.17:0/458294148 shutdown_connections 2023-07-14T13:04:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.482+0000 7f81fd905b80 1 -- 172.21.15.17:0/458294148 wait complete. 2023-07-14T13:04:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.482+0000 7f81fd905b80 1 -- start start 2023-07-14T13:04:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.482+0000 7f81fd905b80 1 Processor -- start 2023-07-14T13:04:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054190880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a470 0x56405418da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56405418a8c0 0x56405418e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81fd905b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564054075a60 con 0x564053fe06b0 2023-07-14T13:04:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81fd905b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564054075760 con 0x56405418a470 2023-07-14T13:04:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81fd905b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564053f598c0 con 0x56405418a8c0 2023-07-14T13:04:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81fd905b80 10 client.0 _ll_register_callbacks cb 0x564054073700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81db7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054190880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81db7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054190880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48044/0 (socket says 172.21.15.17:48044) 2023-07-14T13:04:25.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81db7fe700 1 -- 172.21.15.17:0/3396485125 learned_addr learned my addr 172.21.15.17:0/3396485125 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81e37fe700 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a470 0x56405418da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.483+0000 7f81e3fff700 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56405418a8c0 0x56405418e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.484+0000 7f81db7fe700 1 -- 172.21.15.17:0/3396485125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56405418a8c0 msgr2=0x56405418e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.484+0000 7f81db7fe700 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56405418a8c0 0x56405418e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.484+0000 7f81db7fe700 1 -- 172.21.15.17:0/3396485125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a470 msgr2=0x56405418da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.484+0000 7f81db7fe700 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a470 0x56405418da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.484+0000 7f81db7fe700 1 -- 172.21.15.17:0/3396485125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e4198970 con 0x564053fe06b0 2023-07-14T13:04:25.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.484+0000 7f81db7fe700 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054190880 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f81d400e9c0 tx=0x7f81d40d0530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2af4f535c58185 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.484+0000 7f81c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:04:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.484+0000 7f81c2ffd700 1 -- 172.21.15.17:0/3396485125 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4099960 con 0x564053fe06b0 2023-07-14T13:04:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.484+0000 7f81c2ffd700 1 -- 172.21.15.17:0/3396485125 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f81d409a000 con 0x564053fe06b0 2023-07-14T13:04:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81fd905b80 1 -- 172.21.15.17:0/3396485125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56405402f490 con 0x564053fe06b0 2023-07-14T13:04:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81c2ffd700 1 -- 172.21.15.17:0/3396485125 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81d409e030 con 0x564053fe06b0 2023-07-14T13:04:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81fd905b80 10 client.16737 fetch_fsmap learned FSMap version 27 2023-07-14T13:04:25.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81fd905b80 1 -- 172.21.15.17:0/3396485125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f81cc009d60 con 0x564053fe06b0 2023-07-14T13:04:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81c2ffd700 1 -- 172.21.15.17:0/3396485125 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56405402f490 con 0x564053fe06b0 2023-07-14T13:04:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81c2ffd700 1 -- 172.21.15.17:0/3396485125 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f81d4099610 con 0x564053fe06b0 2023-07-14T13:04:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81fd905b80 10 client.16737 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:04:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81fd905b80 10 client.16737 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81fd905b80 20 client.16737 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81fd905b80 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56405419dcf0 0x5640541a0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81fd905b80 4 client.16737 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:04:25.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.485+0000 7f81fd905b80 1 -- 172.21.15.17:0/3396485125 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640540cee50 con 0x56405419dcf0 2023-07-14T13:04:25.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.486+0000 7f81e37fe700 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56405419dcf0 0x5640541a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.486+0000 7f81c2ffd700 10 client.16737 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.486+0000 7f81e37fe700 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56405419dcf0 0x5640541a0100 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b9ace1632367a91 server_cookie=82bc9d4d4f0630e7 in_seq=0 out_seq=0 2023-07-14T13:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.487+0000 7f81c2ffd700 1 -- 172.21.15.17:0/3396485125 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5640540cee50 con 0x56405419dcf0 2023-07-14T13:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.487+0000 7f81c2ffd700 10 client.16737 handle_command_reply: tid=0 2023-07-14T13:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.487+0000 7f81fd905b80 1 client.16737 shutdown 2023-07-14T13:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.487+0000 7f81fd905b80 1 -- 172.21.15.17:0/3396485125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 msgr2=0x564054190880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.487+0000 7f81fd905b80 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054190880 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f81d400e9c0 tx=0x7f81d40d0530 comp rx=0 tx=0).stop 2023-07-14T13:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.488+0000 7f81fd905b80 1 -- 172.21.15.17:0/3396485125 shutdown_connections 2023-07-14T13:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.488+0000 7f81fd905b80 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56405419dcf0 0x5640541a0100 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.488+0000 7f81fd905b80 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56405418a8c0 0x56405418e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.488+0000 7f81fd905b80 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054190880 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.488+0000 7f81fd905b80 1 --2- 172.21.15.17:0/3396485125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a470 0x56405418da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.488+0000 7f81c2ffd700 0 client.16737 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.488+0000 7f81fd905b80 1 -- 172.21.15.17:0/3396485125 >> 172.21.15.17:0/3396485125 conn(0x564054179d40 msgr2=0x56405417e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.488+0000 7f81fd905b80 1 -- 172.21.15.17:0/3396485125 shutdown_connections 2023-07-14T13:04:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.488+0000 7f81fd905b80 1 -- 172.21.15.17:0/3396485125 wait complete. 2023-07-14T13:04:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.488+0000 7f81fd905b80 20 client.16737 trim_cache size 0 max 16384 2023-07-14T13:04:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.509+0000 7f81fd905b80 1 Processor -- start 2023-07-14T13:04:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.509+0000 7f81fd905b80 1 -- start start 2023-07-14T13:04:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564054179d40 0x5640541933d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054189280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a470 0x5640541869a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81fd905b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564054185180 con 0x564053fe06b0 2023-07-14T13:04:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81fd905b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564054189b80 con 0x56405418a470 2023-07-14T13:04:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81fd905b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640541841a0 con 0x564054179d40 2023-07-14T13:04:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81e37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054189280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564054179d40 0x5640541933d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81e3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a470 0x5640541869a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564054179d40 0x5640541933d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55266/0 (socket says 172.21.15.17:55266) 2023-07-14T13:04:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81db7fe700 1 -- 172.21.15.17:0/3543797886 learned_addr learned my addr 172.21.15.17:0/3543797886 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81e3fff700 1 -- 172.21.15.17:0/3543797886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564054179d40 msgr2=0x5640541933d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81e3fff700 1 --2- 172.21.15.17:0/3543797886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564054179d40 0x5640541933d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81e3fff700 1 -- 172.21.15.17:0/3543797886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 msgr2=0x564054189280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81e3fff700 1 --2- 172.21.15.17:0/3543797886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054189280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.510+0000 7f81e3fff700 1 -- 172.21.15.17:0/3543797886 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e410d1a0 con 0x56405418a470 2023-07-14T13:04:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.511+0000 7f81e37fe700 1 --2- 172.21.15.17:0/3543797886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054189280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.511+0000 7f81db7fe700 1 --2- 172.21.15.17:0/3543797886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564054179d40 0x5640541933d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.511+0000 7f81e3fff700 1 --2- 172.21.15.17:0/3543797886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a470 0x5640541869a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00b780 tx=0x7f81dc00b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e70d8d6cb967d17 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.511+0000 7f81da7fc700 1 -- 172.21.15.17:0/3543797886 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00e070 con 0x56405418a470 2023-07-14T13:04:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.511+0000 7f81da7fc700 1 -- 172.21.15.17:0/3543797886 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81dc003e90 con 0x56405418a470 2023-07-14T13:04:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.511+0000 7f81da7fc700 1 -- 172.21.15.17:0/3543797886 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc005960 con 0x56405418a470 2023-07-14T13:04:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.512+0000 7f81fd905b80 1 -- 172.21.15.17:0/3543797886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a470 msgr2=0x5640541869a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.512+0000 7f81fd905b80 1 --2- 172.21.15.17:0/3543797886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a470 0x5640541869a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00b780 tx=0x7f81dc00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.512+0000 7f81fd905b80 1 -- 172.21.15.17:0/3543797886 shutdown_connections 2023-07-14T13:04:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.512+0000 7f81fd905b80 1 --2- 172.21.15.17:0/3543797886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56405418a470 0x5640541869a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.512+0000 7f81fd905b80 1 --2- 172.21.15.17:0/3543797886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564054179d40 0x5640541933d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.512+0000 7f81fd905b80 1 --2- 172.21.15.17:0/3543797886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564053fe06b0 0x564054189280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.512+0000 7f81fd905b80 1 -- 172.21.15.17:0/3543797886 >> 172.21.15.17:0/3543797886 conn(0x564054184740 msgr2=0x564054188b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.512+0000 7f81fd905b80 1 -- 172.21.15.17:0/3543797886 shutdown_connections 2023-07-14T13:04:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.512+0000 7f81fd905b80 1 -- 172.21.15.17:0/3543797886 wait complete. 2023-07-14T13:04:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.513+0000 7f81fd905b80 1 -- start start 2023-07-14T13:04:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.513+0000 7f81fd905b80 1 Processor -- start 2023-07-14T13:04:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.513+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564053fe06b0 0x5640541e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.513+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564054179d40 0x5640541e6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81fd905b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56405418a470 0x5640541ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81fd905b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640541ea8a0 con 0x56405418a470 2023-07-14T13:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81fd905b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640541eaa10 con 0x564054179d40 2023-07-14T13:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81fd905b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640541eabd0 con 0x564053fe06b0 2023-07-14T13:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81fd905b80 10 client.0 _ll_register_callbacks cb 0x564054073700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564053fe06b0 0x5640541e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81db7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564053fe06b0 0x5640541e5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55268/0 (socket says 172.21.15.17:55268) 2023-07-14T13:04:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56405418a470 0x5640541ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81db7fe700 1 -- 172.21.15.17:0/2482212731 learned_addr learned my addr 172.21.15.17:0/2482212731 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81e37fe700 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564054179d40 0x5640541e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81db7fe700 1 -- 172.21.15.17:0/2482212731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564054179d40 msgr2=0x5640541e6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81db7fe700 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564054179d40 0x5640541e6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81db7fe700 1 -- 172.21.15.17:0/2482212731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56405418a470 msgr2=0x5640541ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81db7fe700 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56405418a470 0x5640541ea2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.514+0000 7f81db7fe700 1 -- 172.21.15.17:0/2482212731 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc012a50 con 0x564053fe06b0 2023-07-14T13:04:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.515+0000 7f81db7fe700 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564053fe06b0 0x5640541e5d30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81d4099f90 tx=0x7f81d400e940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5401d16a36b1650e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.515+0000 7f81c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.515+0000 7f81c2ffd700 1 -- 172.21.15.17:0/2482212731 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4099960 con 0x564053fe06b0 2023-07-14T13:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.515+0000 7f81c2ffd700 1 -- 172.21.15.17:0/2482212731 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f81d40a2150 con 0x564053fe06b0 2023-07-14T13:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.515+0000 7f81fd905b80 1 -- 172.21.15.17:0/2482212731 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81dc0078c0 con 0x564053fe06b0 2023-07-14T13:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.515+0000 7f81c2ffd700 1 -- 172.21.15.17:0/2482212731 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81d409a000 con 0x564053fe06b0 2023-07-14T13:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.515+0000 7f81fd905b80 10 client.26434 fetch_fsmap learned FSMap version 27 2023-07-14T13:04:25.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.515+0000 7f81fd905b80 1 -- 172.21.15.17:0/2482212731 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f81cc009d60 con 0x564053fe06b0 2023-07-14T13:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.515+0000 7f81c2ffd700 1 -- 172.21.15.17:0/2482212731 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81dc0078c0 con 0x564053fe06b0 2023-07-14T13:04:25.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.516+0000 7f81c2ffd700 1 -- 172.21.15.17:0/2482212731 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f81d4095f80 con 0x564053fe06b0 2023-07-14T13:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.516+0000 7f81fd905b80 10 client.26434 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.516+0000 7f81fd905b80 10 client.26434 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.516+0000 7f81fd905b80 20 client.26434 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.516+0000 7f81fd905b80 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56405418a8c0 0x5640541f5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.516+0000 7f81fd905b80 4 client.26434 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.516+0000 7f81fd905b80 1 -- 172.21.15.17:0/2482212731 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564054090ff0 con 0x56405418a8c0 2023-07-14T13:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.517+0000 7f81e37fe700 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56405418a8c0 0x5640541f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.517+0000 7f81e37fe700 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56405418a8c0 0x5640541f5190 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffd5fc10f3db6879 server_cookie=d2e7ff672ec4f199 in_seq=0 out_seq=0 2023-07-14T13:04:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.517+0000 7f81c2ffd700 10 client.26434 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81c2ffd700 1 -- 172.21.15.17:0/2482212731 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564054090ff0 con 0x56405418a8c0 2023-07-14T13:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81c2ffd700 10 client.26434 handle_command_reply: tid=0 2023-07-14T13:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81fd905b80 1 client.26434 shutdown 2023-07-14T13:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81fd905b80 1 -- 172.21.15.17:0/2482212731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564053fe06b0 msgr2=0x5640541e5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81fd905b80 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564053fe06b0 0x5640541e5d30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81d4099f90 tx=0x7f81d400e940 comp rx=0 tx=0).stop 2023-07-14T13:04:25.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81fd905b80 1 -- 172.21.15.17:0/2482212731 shutdown_connections 2023-07-14T13:04:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81fd905b80 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56405418a8c0 0x5640541f5190 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81fd905b80 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56405418a470 0x5640541ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81fd905b80 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564053fe06b0 0x5640541e5d30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81fd905b80 1 --2- 172.21.15.17:0/2482212731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564054179d40 0x5640541e6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81c2ffd700 0 client.26434 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.531+0000 7f81fd905b80 1 -- 172.21.15.17:0/2482212731 >> 172.21.15.17:0/2482212731 conn(0x564054184740 msgr2=0x564054189400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:25.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.532+0000 7f81fd905b80 1 -- 172.21.15.17:0/2482212731 shutdown_connections 2023-07-14T13:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.532+0000 7f81fd905b80 1 -- 172.21.15.17:0/2482212731 wait complete. 2023-07-14T13:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.532+0000 7f81fd905b80 20 client.26434 trim_cache size 0 max 16384 2023-07-14T13:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:04:25.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:04:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:04:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:04:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.532+0000 7f81e8d9d700 1 -- 172.21.15.17:0/1572462090 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f81d00a1340 msgr2=0x7f81d00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.532+0000 7f81e8d9d700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f81d00a1340 0x7f81d00a37f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f81dc029000 tx=0x7f81dc02a000 comp rx=0 tx=0).stop 2023-07-14T13:04:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.532+0000 7f81e8d9d700 1 -- 172.21.15.17:0/1572462090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e40ffd20 msgr2=0x7f81e419dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.532+0000 7f81e8d9d700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e40ffd20 0x7f81e419dac0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f81d400e9f0 tx=0x7f81d400ed00 comp rx=0 tx=0).stop 2023-07-14T13:04:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.532+0000 7f81e8d9d700 1 -- 172.21.15.17:0/1572462090 shutdown_connections 2023-07-14T13:04:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.533+0000 7f81e8d9d700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f81d00a1340 0x7f81d00a37f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.533+0000 7f81e8d9d700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81e4101e50 0x7f81e4197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.533+0000 7f81e8d9d700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e40ffd20 0x7f81e419dac0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.533+0000 7f81e8d9d700 1 --2- 172.21.15.17:0/1572462090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81e41014a0 0x7f81e419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.533+0000 7f81e8d9d700 1 -- 172.21.15.17:0/1572462090 >> 172.21.15.17:0/1572462090 conn(0x7f81e40fb440 msgr2=0x7f81e410acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.533+0000 7f81e8d9d700 1 -- 172.21.15.17:0/1572462090 shutdown_connections 2023-07-14T13:04:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:25.533+0000 7f81e8d9d700 1 -- 172.21.15.17:0/1572462090 wait complete. 2023-07-14T13:04:25.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:25 smithi017 ceph-mon[95536]: pgmap v143: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-14T13:04:25.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:25 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:04:25.799 INFO:teuthology.orchestra.run.smithi017.stderr:16700000 of 50000000 tuples (33%) done (elapsed 255.40 s, remaining 509.27 s) 2023-07-14T13:04:27.083 INFO:teuthology.orchestra.run.smithi017.stderr:16800000 of 50000000 tuples (33%) done (elapsed 256.69 s, remaining 507.26 s) 2023-07-14T13:04:27.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:27 smithi135 ceph-mon[97338]: pgmap v144: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 34 MiB/s wr, 32 op/s 2023-07-14T13:04:27.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:27 smithi131 ceph-mon[96953]: pgmap v144: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 34 MiB/s wr, 32 op/s 2023-07-14T13:04:27.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:27 smithi017 ceph-mon[95536]: pgmap v144: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 34 MiB/s wr, 32 op/s 2023-07-14T13:04:28.360 INFO:teuthology.orchestra.run.smithi017.stderr:16900000 of 50000000 tuples (33%) done (elapsed 257.96 s, remaining 505.24 s) 2023-07-14T13:04:28.442 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:04:28.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.664+0000 7f747f3ff700 1 -- 172.21.15.17:0/2066331237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478100480 msgr2=0x7f747810c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:28.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.664+0000 7f747f3ff700 1 --2- 172.21.15.17:0/2066331237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478100480 0x7f747810c910 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f747000b0a0 tx=0x7f747000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.664+0000 7f747f3ff700 1 -- 172.21.15.17:0/2066331237 shutdown_connections 2023-07-14T13:04:28.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.664+0000 7f747f3ff700 1 --2- 172.21.15.17:0/2066331237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478100480 0x7f747810c910 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.664+0000 7f747f3ff700 1 --2- 172.21.15.17:0/2066331237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7478105ae0 0x7f7478105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.664+0000 7f747f3ff700 1 --2- 172.21.15.17:0/2066331237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74780ffad0 0x7f74780fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.664+0000 7f747f3ff700 1 -- 172.21.15.17:0/2066331237 >> 172.21.15.17:0/2066331237 conn(0x7f74780fb5f0 msgr2=0x7f74780fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:28.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.664+0000 7f747f3ff700 1 -- 172.21.15.17:0/2066331237 shutdown_connections 2023-07-14T13:04:28.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.664+0000 7f747f3ff700 1 -- 172.21.15.17:0/2066331237 wait complete. 2023-07-14T13:04:28.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.666+0000 7f747f3ff700 1 Processor -- start 2023-07-14T13:04:28.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.666+0000 7f747f3ff700 1 -- start start 2023-07-14T13:04:28.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.666+0000 7f747f3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74780ffad0 0x7f7478197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.666+0000 7f747f3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478100480 0x7f7478198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.666+0000 7f747f3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7478105ae0 0x7f747819c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.666+0000 7f747f3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747819cd90 con 0x7f7478100480 2023-07-14T13:04:28.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.666+0000 7f747f3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747819cf00 con 0x7f7478105ae0 2023-07-14T13:04:28.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.666+0000 7f747f3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747819d0c0 con 0x7f74780ffad0 2023-07-14T13:04:28.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.667+0000 7f747d19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74780ffad0 0x7f7478197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.667+0000 7f747d19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74780ffad0 0x7f7478197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55284/0 (socket says 172.21.15.17:55284) 2023-07-14T13:04:28.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.667+0000 7f747c99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478100480 0x7f7478198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.667+0000 7f747d19b700 1 -- 172.21.15.17:0/1253778103 learned_addr learned my addr 172.21.15.17:0/1253778103 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.667+0000 7f747d99c700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7478105ae0 0x7f747819c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.667+0000 7f747d19b700 1 -- 172.21.15.17:0/1253778103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7478105ae0 msgr2=0x7f747819c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.667+0000 7f747d19b700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7478105ae0 0x7f747819c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.667+0000 7f747d19b700 1 -- 172.21.15.17:0/1253778103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478100480 msgr2=0x7f7478198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.667+0000 7f747d19b700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478100480 0x7f7478198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.667+0000 7f747d19b700 1 -- 172.21.15.17:0/1253778103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7470009d00 con 0x7f74780ffad0 2023-07-14T13:04:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.667+0000 7f747d19b700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74780ffad0 0x7f7478197e00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f747400e9a0 tx=0x7f747400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.668+0000 7f746e7fc700 1 -- 172.21.15.17:0/1253778103 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7474009790 con 0x7f74780ffad0 2023-07-14T13:04:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.668+0000 7f746e7fc700 1 -- 172.21.15.17:0/1253778103 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7474010430 con 0x7f74780ffad0 2023-07-14T13:04:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.668+0000 7f747f3ff700 1 -- 172.21.15.17:0/1253778103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747819d3a0 con 0x7f74780ffad0 2023-07-14T13:04:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.668+0000 7f746e7fc700 1 -- 172.21.15.17:0/1253778103 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400cea0 con 0x7f74780ffad0 2023-07-14T13:04:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.668+0000 7f747f3ff700 1 -- 172.21.15.17:0/1253778103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74781a4be0 con 0x7f74780ffad0 2023-07-14T13:04:28.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.671+0000 7f746e7fc700 1 -- 172.21.15.17:0/1253778103 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f74740105a0 con 0x7f74780ffad0 2023-07-14T13:04:28.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.673+0000 7f746e7fc700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74640a12c0 0x7f74640a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.673+0000 7f746e7fc700 1 -- 172.21.15.17:0/1253778103 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7474014070 con 0x7f74780ffad0 2023-07-14T13:04:28.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.673+0000 7f747c99a700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74640a12c0 0x7f74640a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.674+0000 7f7492ddeb80 1 Processor -- start 2023-07-14T13:04:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.674+0000 7f7492ddeb80 1 -- start start 2023-07-14T13:04:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.674+0000 7f747c99a700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74640a12c0 0x7f74640a3770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f74781993c0 tx=0x7f7468009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.674+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c55e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.674+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55ebe0 0x556e0c569590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.674+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c56beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.674+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c464cb0 con 0x556e0c55ebe0 2023-07-14T13:04:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.674+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c4b7a40 con 0x556e0c569ad0 2023-07-14T13:04:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.674+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c4b0ed0 con 0x556e0c55e2d0 2023-07-14T13:04:28.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.675+0000 7f747d19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c55e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.675+0000 7f747d19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c55e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55290/0 (socket says 172.21.15.17:55290) 2023-07-14T13:04:28.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.675+0000 7f747c99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55ebe0 0x556e0c569590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.675+0000 7f747d19b700 1 -- 172.21.15.17:0/3832440457 learned_addr learned my addr 172.21.15.17:0/3832440457 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:28.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.675+0000 7f747d99c700 1 --2- 172.21.15.17:0/3832440457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c56beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.675+0000 7f747d19b700 1 -- 172.21.15.17:0/3832440457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 msgr2=0x556e0c56beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:28.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.675+0000 7f747d19b700 1 --2- 172.21.15.17:0/3832440457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c56beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.675+0000 7f747d19b700 1 -- 172.21.15.17:0/3832440457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55ebe0 msgr2=0x556e0c569590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:28.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.675+0000 7f747d19b700 1 --2- 172.21.15.17:0/3832440457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55ebe0 0x556e0c569590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.675+0000 7f747d19b700 1 -- 172.21.15.17:0/3832440457 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e0c2dede0 con 0x556e0c55e2d0 2023-07-14T13:04:28.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.675+0000 7f747d19b700 1 --2- 172.21.15.17:0/3832440457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c55e6a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7474096a00 tx=0x7f7474099970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8815278429584f49 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:28.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.676+0000 7f74637fe700 1 -- 172.21.15.17:0/3832440457 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747409dfc0 con 0x556e0c55e2d0 2023-07-14T13:04:28.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.676+0000 7f74637fe700 1 -- 172.21.15.17:0/3832440457 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74740a23e0 con 0x556e0c55e2d0 2023-07-14T13:04:28.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.676+0000 7f74637fe700 1 -- 172.21.15.17:0/3832440457 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740a1f50 con 0x556e0c55e2d0 2023-07-14T13:04:28.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.676+0000 7f7492ddeb80 1 -- 172.21.15.17:0/3832440457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 msgr2=0x556e0c55e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:28.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.676+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/3832440457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c55e6a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7474096a00 tx=0x7f7474099970 comp rx=0 tx=0).stop 2023-07-14T13:04:28.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.676+0000 7f7492ddeb80 1 -- 172.21.15.17:0/3832440457 shutdown_connections 2023-07-14T13:04:28.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.676+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/3832440457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c56beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.676+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/3832440457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c55e6a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.676+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/3832440457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55ebe0 0x556e0c569590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.676+0000 7f7492ddeb80 1 -- 172.21.15.17:0/3832440457 >> 172.21.15.17:0/3832440457 conn(0x556e0c554da0 msgr2=0x556e0c55a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:28.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.677+0000 7f7492ddeb80 1 -- 172.21.15.17:0/3832440457 shutdown_connections 2023-07-14T13:04:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.677+0000 7f7492ddeb80 1 -- 172.21.15.17:0/3832440457 wait complete. 2023-07-14T13:04:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.677+0000 7f7492ddeb80 1 -- start start 2023-07-14T13:04:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.677+0000 7f7492ddeb80 1 Processor -- start 2023-07-14T13:04:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55e2d0 0x556e0c569580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 0x556e0c566800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c566f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c450ac0 con 0x556e0c55e2d0 2023-07-14T13:04:28.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c4507c0 con 0x556e0c569ad0 2023-07-14T13:04:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c334920 con 0x556e0c55ebe0 2023-07-14T13:04:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f7492ddeb80 10 client.0 _ll_register_callbacks cb 0x556e0c44e760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f747d19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55e2d0 0x556e0c569580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f747d19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55e2d0 0x556e0c569580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48090/0 (socket says 172.21.15.17:48090) 2023-07-14T13:04:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f747d99c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c566f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f747d19b700 1 -- 172.21.15.17:0/1559697776 learned_addr learned my addr 172.21.15.17:0/1559697776 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:28.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.678+0000 7f747c99a700 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 0x556e0c566800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.679+0000 7f747d19b700 1 -- 172.21.15.17:0/1559697776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 msgr2=0x556e0c566800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:28.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.679+0000 7f747d19b700 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 0x556e0c566800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.679+0000 7f747d19b700 1 -- 172.21.15.17:0/1559697776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 msgr2=0x556e0c566f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.679+0000 7f747d19b700 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c566f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.679+0000 7f747d19b700 1 -- 172.21.15.17:0/1559697776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74781a4be0 con 0x556e0c55e2d0 2023-07-14T13:04:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.679+0000 7f747d19b700 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55e2d0 0x556e0c569580 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7474099c90 tx=0x7f747409a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17b0c2904cde637 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.679+0000 7f7460ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:04:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.679+0000 7f7460ff9700 1 -- 172.21.15.17:0/1559697776 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747409dfc0 con 0x556e0c55e2d0 2023-07-14T13:04:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.679+0000 7f7460ff9700 1 -- 172.21.15.17:0/1559697776 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f74740a2160 con 0x556e0c55e2d0 2023-07-14T13:04:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.679+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1559697776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e0c40a4f0 con 0x556e0c55e2d0 2023-07-14T13:04:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.680+0000 7f7460ff9700 1 -- 172.21.15.17:0/1559697776 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74740b8200 con 0x556e0c55e2d0 2023-07-14T13:04:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.680+0000 7f7492ddeb80 10 client.16755 fetch_fsmap learned FSMap version 27 2023-07-14T13:04:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.680+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1559697776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556e0c2c7c60 con 0x556e0c55e2d0 2023-07-14T13:04:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.680+0000 7f7460ff9700 1 -- 172.21.15.17:0/1559697776 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556e0c40a4f0 con 0x556e0c55e2d0 2023-07-14T13:04:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.680+0000 7f7460ff9700 1 -- 172.21.15.17:0/1559697776 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7474094ba0 con 0x556e0c55e2d0 2023-07-14T13:04:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.680+0000 7f7492ddeb80 10 client.16755 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:04:28.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.680+0000 7f7492ddeb80 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.680+0000 7f7492ddeb80 20 client.16755 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.680+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556e0c578fd0 0x556e0c57b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.680+0000 7f7492ddeb80 4 client.16755 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:04:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.680+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1559697776 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e0c4a9eb0 con 0x556e0c578fd0 2023-07-14T13:04:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.681+0000 7f747c99a700 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556e0c578fd0 0x556e0c57b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.681+0000 7f747c99a700 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556e0c578fd0 0x556e0c57b3e0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72397072e92717a7 server_cookie=f56f13b04932d069 in_seq=0 out_seq=0 2023-07-14T13:04:28.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.681+0000 7f7460ff9700 10 client.16755 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:28.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.682+0000 7f7460ff9700 1 -- 172.21.15.17:0/1559697776 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556e0c4a9eb0 con 0x556e0c578fd0 2023-07-14T13:04:28.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.682+0000 7f7460ff9700 10 client.16755 handle_command_reply: tid=0 2023-07-14T13:04:28.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.682+0000 7f7492ddeb80 1 client.16755 shutdown 2023-07-14T13:04:28.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.682+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1559697776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55e2d0 msgr2=0x556e0c569580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:28.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.682+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55e2d0 0x556e0c569580 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7474099c90 tx=0x7f747409a4a0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.683+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1559697776 shutdown_connections 2023-07-14T13:04:28.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.683+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556e0c578fd0 0x556e0c57b3e0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.683+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c566f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.683+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55e2d0 0x556e0c569580 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.683+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1559697776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 0x556e0c566800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.683+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1559697776 >> 172.21.15.17:0/1559697776 conn(0x556e0c554da0 msgr2=0x556e0c55a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:28.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.683+0000 7f7460ff9700 0 client.16755 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:28.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.683+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1559697776 shutdown_connections 2023-07-14T13:04:28.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.683+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1559697776 wait complete. 2023-07-14T13:04:28.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.683+0000 7f7492ddeb80 20 client.16755 trim_cache size 0 max 16384 2023-07-14T13:04:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.703+0000 7f7492ddeb80 1 Processor -- start 2023-07-14T13:04:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.703+0000 7f7492ddeb80 1 -- start start 2023-07-14T13:04:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.703+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c569120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.703+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55ebe0 0x556e0c566030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.703+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c566570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.703+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c567780 con 0x556e0c55ebe0 2023-07-14T13:04:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.703+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c55f160 con 0x556e0c569ad0 2023-07-14T13:04:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.703+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c55e8f0 con 0x556e0c55e2d0 2023-07-14T13:04:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.703+0000 7f747d19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c569120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.703+0000 7f747c99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55ebe0 0x556e0c566030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.704+0000 7f747d19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c569120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55300/0 (socket says 172.21.15.17:55300) 2023-07-14T13:04:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.704+0000 7f747d19b700 1 -- 172.21.15.17:0/2255171619 learned_addr learned my addr 172.21.15.17:0/2255171619 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.704+0000 7f747d99c700 1 --2- 172.21.15.17:0/2255171619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c566570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.704+0000 7f747d19b700 1 -- 172.21.15.17:0/2255171619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 msgr2=0x556e0c566570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.704+0000 7f747d19b700 1 --2- 172.21.15.17:0/2255171619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c566570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.704+0000 7f747d19b700 1 -- 172.21.15.17:0/2255171619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55ebe0 msgr2=0x556e0c566030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.704+0000 7f747d19b700 1 --2- 172.21.15.17:0/2255171619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55ebe0 0x556e0c566030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.704+0000 7f747d19b700 1 -- 172.21.15.17:0/2255171619 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e0c305250 con 0x556e0c55e2d0 2023-07-14T13:04:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.704+0000 7f747d99c700 1 --2- 172.21.15.17:0/2255171619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c566570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:04:28.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.704+0000 7f747d19b700 1 --2- 172.21.15.17:0/2255171619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c569120 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f747400c2d0 tx=0x7f7474099e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92df364dad51bd19 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.704+0000 7f7463fff700 1 -- 172.21.15.17:0/2255171619 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7474095f20 con 0x556e0c55e2d0 2023-07-14T13:04:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.705+0000 7f7463fff700 1 -- 172.21.15.17:0/2255171619 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f747409dfc0 con 0x556e0c55e2d0 2023-07-14T13:04:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.705+0000 7f7463fff700 1 -- 172.21.15.17:0/2255171619 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7474098450 con 0x556e0c55e2d0 2023-07-14T13:04:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.705+0000 7f7492ddeb80 1 -- 172.21.15.17:0/2255171619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 msgr2=0x556e0c569120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.705+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/2255171619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c569120 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f747400c2d0 tx=0x7f7474099e90 comp rx=0 tx=0).stop 2023-07-14T13:04:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.705+0000 7f7492ddeb80 1 -- 172.21.15.17:0/2255171619 shutdown_connections 2023-07-14T13:04:28.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.705+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/2255171619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c569ad0 0x556e0c566570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.705+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/2255171619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55e2d0 0x556e0c569120 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.705+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/2255171619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c55ebe0 0x556e0c566030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.705+0000 7f7492ddeb80 1 -- 172.21.15.17:0/2255171619 >> 172.21.15.17:0/2255171619 conn(0x556e0c554da0 msgr2=0x556e0c561bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:28.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.705+0000 7f7492ddeb80 1 -- 172.21.15.17:0/2255171619 shutdown_connections 2023-07-14T13:04:28.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.706+0000 7f7492ddeb80 1 -- 172.21.15.17:0/2255171619 wait complete. 2023-07-14T13:04:28.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.706+0000 7f7492ddeb80 1 -- start start 2023-07-14T13:04:28.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.706+0000 7f7492ddeb80 1 Processor -- start 2023-07-14T13:04:28.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c55e2d0 0x556e0c570170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 0x556e0c5706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f7492ddeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c569ad0 0x556e0c56e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c56ed40 con 0x556e0c569ad0 2023-07-14T13:04:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c56eeb0 con 0x556e0c55e2d0 2023-07-14T13:04:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f7492ddeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0c56f070 con 0x556e0c55ebe0 2023-07-14T13:04:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f7492ddeb80 10 client.0 _ll_register_callbacks cb 0x7f74680096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f747d99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c569ad0 0x556e0c56e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f747c99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 0x556e0c5706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f747d19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c55e2d0 0x556e0c570170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f747d19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c55e2d0 0x556e0c570170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40542/0 (socket says 172.21.15.17:40542) 2023-07-14T13:04:28.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f747c99a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 0x556e0c5706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55316/0 (socket says 172.21.15.17:55316) 2023-07-14T13:04:28.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.707+0000 7f747d19b700 1 -- 172.21.15.17:0/1101173258 learned_addr learned my addr 172.21.15.17:0/1101173258 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:28.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.708+0000 7f747c99a700 1 -- 172.21.15.17:0/1101173258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c55e2d0 msgr2=0x556e0c570170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:28.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.708+0000 7f747c99a700 1 --2- 172.21.15.17:0/1101173258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c55e2d0 0x556e0c570170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.708+0000 7f747c99a700 1 -- 172.21.15.17:0/1101173258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c569ad0 msgr2=0x556e0c56e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:28.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.708+0000 7f747c99a700 1 --2- 172.21.15.17:0/1101173258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c569ad0 0x556e0c56e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.708+0000 7f747c99a700 1 -- 172.21.15.17:0/1101173258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e0c2c7c60 con 0x556e0c55ebe0 2023-07-14T13:04:28.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.708+0000 7f747c99a700 1 --2- 172.21.15.17:0/1101173258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 0x556e0c5706b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x556e0c57bcf0 tx=0x7f74680047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2914bbb67c0d53b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.708+0000 7f7460ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:04:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.708+0000 7f7460ff9700 1 -- 172.21.15.17:0/1101173258 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468022040 con 0x556e0c55ebe0 2023-07-14T13:04:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.708+0000 7f7460ff9700 1 -- 172.21.15.17:0/1101173258 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f746802a270 con 0x556e0c55ebe0 2023-07-14T13:04:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.708+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1101173258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74740a23e0 con 0x556e0c55ebe0 2023-07-14T13:04:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.709+0000 7f7460ff9700 1 -- 172.21.15.17:0/1101173258 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f746802aea0 con 0x556e0c55ebe0 2023-07-14T13:04:28.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.709+0000 7f7492ddeb80 10 client.26452 fetch_fsmap learned FSMap version 27 2023-07-14T13:04:28.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.709+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1101173258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556e0c2dd2b0 con 0x556e0c55ebe0 2023-07-14T13:04:28.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.709+0000 7f7460ff9700 1 -- 172.21.15.17:0/1101173258 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74740a23e0 con 0x556e0c55ebe0 2023-07-14T13:04:28.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.709+0000 7f7460ff9700 1 -- 172.21.15.17:0/1101173258 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f746803c430 con 0x556e0c55ebe0 2023-07-14T13:04:28.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.709+0000 7f7492ddeb80 10 client.26452 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:04:28.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.709+0000 7f7492ddeb80 10 client.26452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:28.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.709+0000 7f7492ddeb80 20 client.26452 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:28.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.709+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1101173258 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556e0c5ce210 0x556e0c5d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:28.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.709+0000 7f7492ddeb80 4 client.26452 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:04:28.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.709+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1101173258 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556e0c46c050 con 0x556e0c5ce210 2023-07-14T13:04:28.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.710+0000 7f747d19b700 1 --2- 172.21.15.17:0/1101173258 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556e0c5ce210 0x556e0c5d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:28.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.710+0000 7f747d19b700 1 --2- 172.21.15.17:0/1101173258 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556e0c5ce210 0x556e0c5d0620 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94b21aa59f20c868 server_cookie=fcf37c43b6fc8d42 in_seq=0 out_seq=0 2023-07-14T13:04:28.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.710+0000 7f7460ff9700 10 client.26452 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:28.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.710+0000 7f7460ff9700 1 -- 172.21.15.17:0/1101173258 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x556e0c46c050 con 0x556e0c5ce210 2023-07-14T13:04:28.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.710+0000 7f7460ff9700 10 client.26452 handle_command_reply: tid=0 2023-07-14T13:04:28.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.710+0000 7f7492ddeb80 1 client.26452 shutdown 2023-07-14T13:04:28.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1101173258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 msgr2=0x556e0c5706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:28.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1101173258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 0x556e0c5706b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x556e0c57bcf0 tx=0x7f74680047c0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1101173258 shutdown_connections 2023-07-14T13:04:28.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1101173258 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556e0c5ce210 0x556e0c5d0620 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1101173258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556e0c569ad0 0x556e0c56e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1101173258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0c55e2d0 0x556e0c570170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7460ff9700 0 client.26452 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:28.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7492ddeb80 1 --2- 172.21.15.17:0/1101173258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556e0c55ebe0 0x556e0c5706b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1101173258 >> 172.21.15.17:0/1101173258 conn(0x556e0c554da0 msgr2=0x556e0c5603e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:28.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1101173258 shutdown_connections 2023-07-14T13:04:28.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7492ddeb80 1 -- 172.21.15.17:0/1101173258 wait complete. 2023-07-14T13:04:28.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.711+0000 7f7492ddeb80 20 client.26452 trim_cache size 0 max 16384 2023-07-14T13:04:28.753 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:04:28.753 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:04:28.753 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:04:28.753 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:04:28.753 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:04:28.753 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:04:28.753 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:04:28.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:04:28.754 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:04:28.754 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:04:28.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 -- 172.21.15.17:0/1253778103 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74640a12c0 msgr2=0x7f74640a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74640a12c0 0x7f74640a3770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f74781993c0 tx=0x7f7468009260 comp rx=0 tx=0).stop 2023-07-14T13:04:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 -- 172.21.15.17:0/1253778103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74780ffad0 msgr2=0x7f7478197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74780ffad0 0x7f7478197e00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f747400e9a0 tx=0x7f747400ecb0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 -- 172.21.15.17:0/1253778103 shutdown_connections 2023-07-14T13:04:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74640a12c0 0x7f74640a3770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7478105ae0 0x7f747819c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74780ffad0 0x7f7478197e00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 --2- 172.21.15.17:0/1253778103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7478100480 0x7f7478198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:28.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 -- 172.21.15.17:0/1253778103 >> 172.21.15.17:0/1253778103 conn(0x7f74780fb5f0 msgr2=0x7f74780fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:28.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 -- 172.21.15.17:0/1253778103 shutdown_connections 2023-07-14T13:04:28.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:28.712+0000 7f747f3ff700 1 -- 172.21.15.17:0/1253778103 wait complete. 2023-07-14T13:04:28.767 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:04:29.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:29 smithi135 ceph-mon[97338]: pgmap v145: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 17 op/s 2023-07-14T13:04:29.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:29 smithi131 ceph-mon[96953]: pgmap v145: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 17 op/s 2023-07-14T13:04:29.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:29 smithi017 ceph-mon[95536]: pgmap v145: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 17 op/s 2023-07-14T13:04:29.781 INFO:teuthology.orchestra.run.smithi017.stderr:17000000 of 50000000 tuples (34%) done (elapsed 259.38 s, remaining 503.51 s) 2023-07-14T13:04:31.052 INFO:teuthology.orchestra.run.smithi017.stderr:17100000 of 50000000 tuples (34%) done (elapsed 260.65 s, remaining 501.49 s) 2023-07-14T13:04:31.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:31 smithi135 ceph-mon[97338]: pgmap v146: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 MiB/s wr, 28 op/s 2023-07-14T13:04:31.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:31 smithi131 ceph-mon[96953]: pgmap v146: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 MiB/s wr, 28 op/s 2023-07-14T13:04:31.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:31 smithi017 ceph-mon[95536]: pgmap v146: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 MiB/s wr, 28 op/s 2023-07-14T13:04:32.325 INFO:teuthology.orchestra.run.smithi017.stderr:17200000 of 50000000 tuples (34%) done (elapsed 261.93 s, remaining 499.49 s) 2023-07-14T13:04:33.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:33 smithi135 ceph-mon[97338]: pgmap v147: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 19 op/s 2023-07-14T13:04:33.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:33 smithi131 ceph-mon[96953]: pgmap v147: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 19 op/s 2023-07-14T13:04:33.594 INFO:teuthology.orchestra.run.smithi017.stderr:17300000 of 50000000 tuples (34%) done (elapsed 263.20 s, remaining 497.49 s) 2023-07-14T13:04:33.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:33 smithi017 ceph-mon[95536]: pgmap v147: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 19 op/s 2023-07-14T13:04:34.988 INFO:teuthology.orchestra.run.smithi017.stderr:17400000 of 50000000 tuples (34%) done (elapsed 264.59 s, remaining 495.73 s) 2023-07-14T13:04:35.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:35 smithi135 ceph-mon[97338]: pgmap v148: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 19 op/s 2023-07-14T13:04:35.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:35 smithi131 ceph-mon[96953]: pgmap v148: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 19 op/s 2023-07-14T13:04:35.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:35 smithi017 ceph-mon[95536]: pgmap v148: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 19 op/s 2023-07-14T13:04:36.286 INFO:teuthology.orchestra.run.smithi017.stderr:17500000 of 50000000 tuples (35%) done (elapsed 265.89 s, remaining 493.79 s) 2023-07-14T13:04:37.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:37 smithi135 ceph-mon[97338]: pgmap v149: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 35 MiB/s wr, 28 op/s 2023-07-14T13:04:37.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:37 smithi131 ceph-mon[96953]: pgmap v149: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 35 MiB/s wr, 28 op/s 2023-07-14T13:04:37.592 INFO:teuthology.orchestra.run.smithi017.stderr:17600000 of 50000000 tuples (35%) done (elapsed 267.19 s, remaining 491.88 s) 2023-07-14T13:04:37.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:37 smithi017 ceph-mon[95536]: pgmap v149: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 35 MiB/s wr, 28 op/s 2023-07-14T13:04:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.705+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/3678954753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b341004b0 msgr2=0x7f7b3410c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.705+0000 7f7b3c1ff700 1 --2- 172.21.15.17:0/3678954753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b341004b0 0x7f7b3410c940 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c00b0a0 tx=0x7f7b2c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.705+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/3678954753 shutdown_connections 2023-07-14T13:04:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.705+0000 7f7b3c1ff700 1 --2- 172.21.15.17:0/3678954753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b341004b0 0x7f7b3410c940 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.705+0000 7f7b3c1ff700 1 --2- 172.21.15.17:0/3678954753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b34105b10 0x7f7b34105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.705+0000 7f7b3c1ff700 1 --2- 172.21.15.17:0/3678954753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b340ffb00 0x7f7b340fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.705+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/3678954753 >> 172.21.15.17:0/3678954753 conn(0x7f7b340fb600 msgr2=0x7f7b340fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.705+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/3678954753 shutdown_connections 2023-07-14T13:04:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.705+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/3678954753 wait complete. 2023-07-14T13:04:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.706+0000 7f7b3c1ff700 1 Processor -- start 2023-07-14T13:04:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.706+0000 7f7b3c1ff700 1 -- start start 2023-07-14T13:04:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b3c1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b340ffb00 0x7f7b340729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b3c1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b341004b0 0x7f7b34072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b3c1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b34105b10 0x7f7b341a3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b3c1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341a4350 con 0x7f7b34105b10 2023-07-14T13:04:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b3c1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341a4490 con 0x7f7b341004b0 2023-07-14T13:04:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b3c1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341a4600 con 0x7f7b340ffb00 2023-07-14T13:04:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b39f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b340ffb00 0x7f7b340729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b3a79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b34105b10 0x7f7b341a3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b39f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b340ffb00 0x7f7b340729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:49010/0 (socket says 172.21.15.17:49010) 2023-07-14T13:04:38.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b39f9b700 1 -- 172.21.15.17:0/2988929437 learned_addr learned my addr 172.21.15.17:0/2988929437 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b3979a700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b341004b0 0x7f7b34072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b39f9b700 1 -- 172.21.15.17:0/2988929437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b341004b0 msgr2=0x7f7b34072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b341004b0 0x7f7b34072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b39f9b700 1 -- 172.21.15.17:0/2988929437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b34105b10 msgr2=0x7f7b341a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b34105b10 0x7f7b341a3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.707+0000 7f7b39f9b700 1 -- 172.21.15.17:0/2988929437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c009d00 con 0x7f7b340ffb00 2023-07-14T13:04:38.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.708+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b340ffb00 0x7f7b340729f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000e9a0 tx=0x7f7b3000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:38.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.708+0000 7f7b2affd700 1 -- 172.21.15.17:0/2988929437 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30009790 con 0x7f7b340ffb00 2023-07-14T13:04:38.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.708+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/2988929437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b341a48e0 con 0x7f7b340ffb00 2023-07-14T13:04:38.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.708+0000 7f7b2affd700 1 -- 172.21.15.17:0/2988929437 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b30010430 con 0x7f7b340ffb00 2023-07-14T13:04:38.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.708+0000 7f7b2affd700 1 -- 172.21.15.17:0/2988929437 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3000cea0 con 0x7f7b340ffb00 2023-07-14T13:04:38.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.708+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/2988929437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b341a4e40 con 0x7f7b340ffb00 2023-07-14T13:04:38.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.712+0000 7f7b2affd700 1 -- 172.21.15.17:0/2988929437 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7b300105a0 con 0x7f7b340ffb00 2023-07-14T13:04:38.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.713+0000 7f7b4fbe4b80 1 Processor -- start 2023-07-14T13:04:38.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.713+0000 7f7b4fbe4b80 1 -- start start 2023-07-14T13:04:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 0x55f4017c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017c42d0 0x55f4017be040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4016c3c50 con 0x55f4017c42d0 2023-07-14T13:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4017169e0 con 0x55f4017be580 2023-07-14T13:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f40170fe70 con 0x55f40161a6b0 2023-07-14T13:04:38.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b2affd700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b200a12c0 0x7f7b200a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b2affd700 1 -- 172.21.15.17:0/2988929437 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7b30014070 con 0x7f7b340ffb00 2023-07-14T13:04:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b39f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017c42d0 0x55f4017be040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b3a79c700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b200a12c0 0x7f7b200a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b39f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017c42d0 0x55f4017be040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37540/0 (socket says 172.21.15.17:37540) 2023-07-14T13:04:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b39f9b700 1 -- 172.21.15.17:0/1861310380 learned_addr learned my addr 172.21.15.17:0/1861310380 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b3979a700 1 --2- 172.21.15.17:0/1861310380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.714+0000 7f7b3a79c700 1 --2- 172.21.15.17:0/1861310380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 0x55f4017c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.715+0000 7f7b39f9b700 1 -- 172.21.15.17:0/1861310380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 msgr2=0x55f4017c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.715+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/1861310380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 0x55f4017c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.715+0000 7f7b39f9b700 1 -- 172.21.15.17:0/1861310380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 msgr2=0x55f4017be9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:38.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.715+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/1861310380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017be9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.715+0000 7f7b39f9b700 1 -- 172.21.15.17:0/1861310380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f40153dd80 con 0x55f4017c42d0 2023-07-14T13:04:38.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.715+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/1861310380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017c42d0 0x55f4017be040 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009230 tx=0x7f7b300998c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebe4b444386307d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:38.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.715+0000 7f7b3a79c700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b200a12c0 0x7f7b200a3770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0062a0 tx=0x7f7b2c006000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:38.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.715+0000 7f7b1ffff700 1 -- 172.21.15.17:0/1861310380 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30010880 con 0x55f4017c42d0 2023-07-14T13:04:38.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.715+0000 7f7b1ffff700 1 -- 172.21.15.17:0/1861310380 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b3001c1c0 con 0x55f4017c42d0 2023-07-14T13:04:38.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.715+0000 7f7b1ffff700 1 -- 172.21.15.17:0/1861310380 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300073c0 con 0x55f4017c42d0 2023-07-14T13:04:38.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.716+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/1861310380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017c42d0 msgr2=0x55f4017be040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:38.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.716+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/1861310380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017c42d0 0x55f4017be040 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009230 tx=0x7f7b300998c0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.716+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/1861310380 shutdown_connections 2023-07-14T13:04:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.716+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/1861310380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.716+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/1861310380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 0x55f4017c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.716+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/1861310380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017c42d0 0x55f4017be040 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.716+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/1861310380 >> 172.21.15.17:0/1861310380 conn(0x55f4017b3be0 msgr2=0x55f4017b8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:38.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.716+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/1861310380 shutdown_connections 2023-07-14T13:04:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.716+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/1861310380 wait complete. 2023-07-14T13:04:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.717+0000 7f7b4fbe4b80 1 -- start start 2023-07-14T13:04:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.717+0000 7f7b4fbe4b80 1 Processor -- start 2023-07-14T13:04:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f40161a6b0 0x55f4017ca550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017c42d0 0x55f4017c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4016afa60 con 0x55f40161a6b0 2023-07-14T13:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4016af760 con 0x55f4017be580 2023-07-14T13:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4015938c0 con 0x55f4017c42d0 2023-07-14T13:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b4fbe4b80 10 client.0 _ll_register_callbacks cb 0x55f4016ad700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b3979a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b3a79c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017c42d0 0x55f4017c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b3a79c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017c42d0 0x55f4017c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:49024/0 (socket says 172.21.15.17:49024) 2023-07-14T13:04:38.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b3a79c700 1 -- 172.21.15.17:0/2352831359 learned_addr learned my addr 172.21.15.17:0/2352831359 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b3979a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:42258/0 (socket says 172.21.15.17:42258) 2023-07-14T13:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f40161a6b0 0x55f4017ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b3a79c700 1 -- 172.21.15.17:0/2352831359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 msgr2=0x55f4017c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.718+0000 7f7b3a79c700 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.719+0000 7f7b3a79c700 1 -- 172.21.15.17:0/2352831359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f40161a6b0 msgr2=0x55f4017ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.719+0000 7f7b3a79c700 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f40161a6b0 0x55f4017ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.719+0000 7f7b3a79c700 1 -- 172.21.15.17:0/2352831359 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b341a4e40 con 0x55f4017c42d0 2023-07-14T13:04:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.719+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f40161a6b0 0x55f4017ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.719+0000 7f7b3a79c700 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017c42d0 0x55f4017c7dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c015000 tx=0x7f7b2c0099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d774c16b86bd5911 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.719+0000 7f7b1d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:04:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.719+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/2352831359 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c02f070 con 0x55f4017c42d0 2023-07-14T13:04:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.719+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/2352831359 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f401669490 con 0x55f4017c42d0 2023-07-14T13:04:38.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.719+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/2352831359 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7b2c025040 con 0x55f4017c42d0 2023-07-14T13:04:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.720+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/2352831359 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b2c003d50 con 0x55f4017c42d0 2023-07-14T13:04:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.720+0000 7f7b4fbe4b80 10 client.26464 fetch_fsmap learned FSMap version 27 2023-07-14T13:04:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.720+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/2352831359 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f401526c00 con 0x55f4017c42d0 2023-07-14T13:04:38.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.720+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/2352831359 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f401669490 con 0x55f4017c42d0 2023-07-14T13:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.720+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/2352831359 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7b2c032020 con 0x55f4017c42d0 2023-07-14T13:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.720+0000 7f7b4fbe4b80 10 client.26464 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.720+0000 7f7b4fbe4b80 10 client.26464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.720+0000 7f7b4fbe4b80 20 client.26464 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:38.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.720+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4017d7b90 0x55f4017d9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.720+0000 7f7b4fbe4b80 4 client.26464 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.720+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/2352831359 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f401708e50 con 0x55f4017d7b90 2023-07-14T13:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.721+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4017d7b90 0x55f4017d9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.721+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4017d7b90 0x55f4017d9fa0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e71cd5cf8fc2bbae server_cookie=e991d32ea33b98a9 in_seq=0 out_seq=0 2023-07-14T13:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.721+0000 7f7b1d7fa700 10 client.26464 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/2352831359 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f401708e50 con 0x55f4017d7b90 2023-07-14T13:04:38.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b1d7fa700 10 client.26464 handle_command_reply: tid=0 2023-07-14T13:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b4fbe4b80 1 client.26464 shutdown 2023-07-14T13:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/2352831359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017c42d0 msgr2=0x55f4017c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017c42d0 0x55f4017c7dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c015000 tx=0x7f7b2c0099e0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/2352831359 shutdown_connections 2023-07-14T13:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4017d7b90 0x55f4017d9fa0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017c42d0 0x55f4017c7dc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f40161a6b0 0x55f4017ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/2352831359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b1d7fa700 0 client.26464 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.722+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/2352831359 >> 172.21.15.17:0/2352831359 conn(0x55f4017b3be0 msgr2=0x55f4017b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.723+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/2352831359 shutdown_connections 2023-07-14T13:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.723+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/2352831359 wait complete. 2023-07-14T13:04:38.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.723+0000 7f7b4fbe4b80 20 client.26464 trim_cache size 0 max 16384 2023-07-14T13:04:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.739+0000 7f7b4fbe4b80 1 Processor -- start 2023-07-14T13:04:38.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.739+0000 7f7b4fbe4b80 1 -- start start 2023-07-14T13:04:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.739+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017b3be0 0x55f4017be040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.739+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f40161a6b0 0x55f4017c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.739+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.739+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4017c23c0 con 0x55f40161a6b0 2023-07-14T13:04:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.739+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4017c58a0 con 0x55f4017be580 2023-07-14T13:04:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.739+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4017c5d90 con 0x55f4017b3be0 2023-07-14T13:04:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.739+0000 7f7b3979a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f40161a6b0 0x55f4017c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.739+0000 7f7b39f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017b3be0 0x55f4017be040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b39f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017b3be0 0x55f4017be040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:49028/0 (socket says 172.21.15.17:49028) 2023-07-14T13:04:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b39f9b700 1 -- 172.21.15.17:0/3814176521 learned_addr learned my addr 172.21.15.17:0/3814176521 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b3a79c700 1 --2- 172.21.15.17:0/3814176521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b39f9b700 1 -- 172.21.15.17:0/3814176521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 msgr2=0x55f4017cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/3814176521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b39f9b700 1 -- 172.21.15.17:0/3814176521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f40161a6b0 msgr2=0x55f4017c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/3814176521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f40161a6b0 0x55f4017c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b39f9b700 1 -- 172.21.15.17:0/3814176521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4017debd0 con 0x55f4017b3be0 2023-07-14T13:04:38.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b3a79c700 1 --2- 172.21.15.17:0/3814176521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:04:38.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/3814176521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017b3be0 0x55f4017be040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b30099c60 tx=0x7f7b30099930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce7c988df2182757 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:38.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b28ff9700 1 -- 172.21.15.17:0/3814176521 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30010880 con 0x55f4017b3be0 2023-07-14T13:04:38.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b28ff9700 1 -- 172.21.15.17:0/3814176521 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b3009df90 con 0x55f4017b3be0 2023-07-14T13:04:38.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.740+0000 7f7b28ff9700 1 -- 172.21.15.17:0/3814176521 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3009a420 con 0x55f4017b3be0 2023-07-14T13:04:38.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.741+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3814176521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017b3be0 msgr2=0x55f4017be040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.741+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/3814176521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017b3be0 0x55f4017be040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7b30099c60 tx=0x7f7b30099930 comp rx=0 tx=0).stop 2023-07-14T13:04:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.741+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3814176521 shutdown_connections 2023-07-14T13:04:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.741+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/3814176521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017be580 0x55f4017cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.741+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/3814176521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4017b3be0 0x55f4017be040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.741+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/3814176521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f40161a6b0 0x55f4017c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.741+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3814176521 >> 172.21.15.17:0/3814176521 conn(0x55f4017d3770 msgr2=0x55f4017c2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.741+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3814176521 shutdown_connections 2023-07-14T13:04:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.741+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3814176521 wait complete. 2023-07-14T13:04:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.742+0000 7f7b4fbe4b80 1 -- start start 2023-07-14T13:04:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.742+0000 7f7b4fbe4b80 1 Processor -- start 2023-07-14T13:04:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 0x55f4017ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017b3be0 0x55f4017cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b4fbe4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017be580 0x55f4017ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4017cd250 con 0x55f4017be580 2023-07-14T13:04:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4017cd3c0 con 0x55f4017b3be0 2023-07-14T13:04:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b4fbe4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4017cd580 con 0x55f40161a6b0 2023-07-14T13:04:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b4fbe4b80 10 client.0 _ll_register_callbacks cb 0x55f4016ad700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b39f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 0x55f4017ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b39f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 0x55f4017ce550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:49032/0 (socket says 172.21.15.17:49032) 2023-07-14T13:04:38.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b39f9b700 1 -- 172.21.15.17:0/3275565380 learned_addr learned my addr 172.21.15.17:0/3275565380 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:38.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b3a79c700 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017be580 0x55f4017ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.743+0000 7f7b3979a700 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017b3be0 0x55f4017cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b39f9b700 1 -- 172.21.15.17:0/3275565380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017b3be0 msgr2=0x55f4017cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:38.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017b3be0 0x55f4017cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b39f9b700 1 -- 172.21.15.17:0/3275565380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017be580 msgr2=0x55f4017ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:38.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017be580 0x55f4017ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b39f9b700 1 -- 172.21.15.17:0/3275565380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f40153dd80 con 0x55f40161a6b0 2023-07-14T13:04:38.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b39f9b700 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 0x55f4017ce550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009230 tx=0x7f7b300074d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aa8be642e34e3f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:38.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b1d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:04:38.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/3275565380 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300a23b0 con 0x55f40161a6b0 2023-07-14T13:04:38.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/3275565380 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7b30098300 con 0x55f40161a6b0 2023-07-14T13:04:38.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3275565380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b3001c1c0 con 0x55f40161a6b0 2023-07-14T13:04:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/3275565380 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b30099450 con 0x55f40161a6b0 2023-07-14T13:04:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b4fbe4b80 10 client.26470 fetch_fsmap learned FSMap version 27 2023-07-14T13:04:38.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.744+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3275565380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f4015641f0 con 0x55f40161a6b0 2023-07-14T13:04:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.745+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/3275565380 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b3001c1c0 con 0x55f40161a6b0 2023-07-14T13:04:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.745+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/3275565380 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7b300a1f20 con 0x55f40161a6b0 2023-07-14T13:04:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.745+0000 7f7b4fbe4b80 10 client.26470 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:04:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.745+0000 7f7b4fbe4b80 10 client.26470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.745+0000 7f7b4fbe4b80 20 client.26470 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.745+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4017c42d0 0x55f40182e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:38.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.745+0000 7f7b4fbe4b80 4 client.26470 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:04:38.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.745+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3275565380 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f4016caff0 con 0x55f4017c42d0 2023-07-14T13:04:38.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.745+0000 7f7b3979a700 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4017c42d0 0x55f40182e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:38.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.746+0000 7f7b3979a700 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4017c42d0 0x55f40182e790 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1aaeaaad1812075 server_cookie=612b7f5d58c113cc in_seq=0 out_seq=0 2023-07-14T13:04:38.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.746+0000 7f7b1d7fa700 10 client.26470 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:38.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b1d7fa700 1 -- 172.21.15.17:0/3275565380 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f4016caff0 con 0x55f4017c42d0 2023-07-14T13:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b1d7fa700 10 client.26470 handle_command_reply: tid=0 2023-07-14T13:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 1 client.26470 shutdown 2023-07-14T13:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3275565380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 msgr2=0x55f4017ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 0x55f4017ce550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009230 tx=0x7f7b300074d0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3275565380 shutdown_connections 2023-07-14T13:04:38.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4017c42d0 0x55f40182e790 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4017be580 0x55f4017ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f40161a6b0 0x55f4017ce550 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b1d7fa700 0 client.26470 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 1 --2- 172.21.15.17:0/3275565380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4017b3be0 0x55f4017cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3275565380 >> 172.21.15.17:0/3275565380 conn(0x55f4017d3770 msgr2=0x55f4017c3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3275565380 shutdown_connections 2023-07-14T13:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 1 -- 172.21.15.17:0/3275565380 wait complete. 2023-07-14T13:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.760+0000 7f7b4fbe4b80 20 client.26470 trim_cache size 0 max 16384 2023-07-14T13:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:04:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:04:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:04:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/2988929437 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b200a12c0 msgr2=0x7f7b200a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b200a12c0 0x7f7b200a3770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0062a0 tx=0x7f7b2c006000 comp rx=0 tx=0).stop 2023-07-14T13:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/2988929437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b340ffb00 msgr2=0x7f7b340729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b340ffb00 0x7f7b340729f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000e9a0 tx=0x7f7b3000ecb0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/2988929437 shutdown_connections 2023-07-14T13:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7b200a12c0 0x7f7b200a3770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b34105b10 0x7f7b341a3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b340ffb00 0x7f7b340729f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 --2- 172.21.15.17:0/2988929437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b341004b0 0x7f7b34072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/2988929437 >> 172.21.15.17:0/2988929437 conn(0x7f7b340fb600 msgr2=0x7f7b340fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/2988929437 shutdown_connections 2023-07-14T13:04:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:38.761+0000 7f7b3c1ff700 1 -- 172.21.15.17:0/2988929437 wait complete. 2023-07-14T13:04:39.067 INFO:teuthology.orchestra.run.smithi017.stderr:17700000 of 50000000 tuples (35%) done (elapsed 268.67 s, remaining 490.28 s) 2023-07-14T13:04:39.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:39 smithi135 ceph-mon[97338]: pgmap v150: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 19 op/s 2023-07-14T13:04:39.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:39 smithi131 ceph-mon[96953]: pgmap v150: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 19 op/s 2023-07-14T13:04:39.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:39 smithi017 ceph-mon[95536]: pgmap v150: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 19 op/s 2023-07-14T13:04:40.377 INFO:teuthology.orchestra.run.smithi017.stderr:17800000 of 50000000 tuples (35%) done (elapsed 269.98 s, remaining 488.39 s) 2023-07-14T13:04:41.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:41 smithi135 ceph-mon[97338]: pgmap v151: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 34 MiB/s wr, 53 op/s 2023-07-14T13:04:41.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:41 smithi131 ceph-mon[96953]: pgmap v151: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 34 MiB/s wr, 53 op/s 2023-07-14T13:04:41.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:41 smithi017 ceph-mon[95536]: pgmap v151: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 34 MiB/s wr, 53 op/s 2023-07-14T13:04:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:17900000 of 50000000 tuples (35%) done (elapsed 271.26 s, remaining 486.44 s) 2023-07-14T13:04:43.048 INFO:teuthology.orchestra.run.smithi017.stderr:18000000 of 50000000 tuples (36%) done (elapsed 272.65 s, remaining 484.71 s) 2023-07-14T13:04:43.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:43 smithi135 ceph-mon[97338]: pgmap v152: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 41 op/s 2023-07-14T13:04:43.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:43 smithi131 ceph-mon[96953]: pgmap v152: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 41 op/s 2023-07-14T13:04:43.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:43 smithi017 ceph-mon[95536]: pgmap v152: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 41 op/s 2023-07-14T13:04:44.348 INFO:teuthology.orchestra.run.smithi017.stderr:18100000 of 50000000 tuples (36%) done (elapsed 273.95 s, remaining 482.82 s) 2023-07-14T13:04:45.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:45 smithi135 ceph-mon[97338]: pgmap v153: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 41 op/s 2023-07-14T13:04:45.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:45 smithi131 ceph-mon[96953]: pgmap v153: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 41 op/s 2023-07-14T13:04:45.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:45 smithi017 ceph-mon[95536]: pgmap v153: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 41 op/s 2023-07-14T13:04:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:18200000 of 50000000 tuples (36%) done (elapsed 275.28 s, remaining 480.99 s) 2023-07-14T13:04:46.991 INFO:teuthology.orchestra.run.smithi017.stderr:18300000 of 50000000 tuples (36%) done (elapsed 276.59 s, remaining 479.13 s) 2023-07-14T13:04:47.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:46 smithi017 ceph-mon[95536]: pgmap v154: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 34 MiB/s wr, 58 op/s 2023-07-14T13:04:47.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:46 smithi135 ceph-mon[97338]: pgmap v154: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 34 MiB/s wr, 58 op/s 2023-07-14T13:04:47.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:46 smithi131 ceph-mon[96953]: pgmap v154: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 34 MiB/s wr, 58 op/s 2023-07-14T13:04:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:18400000 of 50000000 tuples (36%) done (elapsed 277.99 s, remaining 477.42 s) 2023-07-14T13:04:49.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:49 smithi017 ceph-mon[95536]: pgmap v155: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 22 MiB/s wr, 50 op/s 2023-07-14T13:04:49.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:49 smithi135 ceph-mon[97338]: pgmap v155: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 22 MiB/s wr, 50 op/s 2023-07-14T13:04:49.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:49 smithi131 ceph-mon[96953]: pgmap v155: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 22 MiB/s wr, 50 op/s 2023-07-14T13:04:50.489 INFO:teuthology.orchestra.run.smithi017.stderr:18500000 of 50000000 tuples (37%) done (elapsed 280.09 s, remaining 476.91 s) 2023-07-14T13:04:51.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:51 smithi017 ceph-mon[95536]: pgmap v156: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 31 MiB/s wr, 68 op/s 2023-07-14T13:04:51.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:51 smithi135 ceph-mon[97338]: pgmap v156: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 31 MiB/s wr, 68 op/s 2023-07-14T13:04:51.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:51 smithi131 ceph-mon[96953]: pgmap v156: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 31 MiB/s wr, 68 op/s 2023-07-14T13:04:51.768 INFO:teuthology.orchestra.run.smithi017.stderr:18600000 of 50000000 tuples (37%) done (elapsed 281.37 s, remaining 475.00 s) 2023-07-14T13:04:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.933+0000 7fb2bb19d700 1 -- 172.21.15.17:0/3942431982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2b4101db0 msgr2=0x7fb2b4102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.933+0000 7fb2bb19d700 1 --2- 172.21.15.17:0/3942431982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2b4101db0 0x7fb2b4102180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00099c0 tx=0x7fb2b0009cd0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.933+0000 7fb2bb19d700 1 -- 172.21.15.17:0/3942431982 shutdown_connections 2023-07-14T13:04:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.933+0000 7fb2bb19d700 1 --2- 172.21.15.17:0/3942431982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2b4106df0 0x7fb2b410e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.934+0000 7fb2bb19d700 1 --2- 172.21.15.17:0/3942431982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2b4101db0 0x7fb2b4102180 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.934+0000 7fb2bb19d700 1 --2- 172.21.15.17:0/3942431982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2b4102750 0x7fb2b4106710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.934+0000 7fb2bb19d700 1 -- 172.21.15.17:0/3942431982 >> 172.21.15.17:0/3942431982 conn(0x7fb2b40fd660 msgr2=0x7fb2b40ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.934+0000 7fb2bb19d700 1 -- 172.21.15.17:0/3942431982 shutdown_connections 2023-07-14T13:04:51.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.934+0000 7fb2bb19d700 1 -- 172.21.15.17:0/3942431982 wait complete. 2023-07-14T13:04:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.935+0000 7fb2bb19d700 1 Processor -- start 2023-07-14T13:04:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.935+0000 7fb2bb19d700 1 -- start start 2023-07-14T13:04:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.935+0000 7fb2bb19d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2b4101db0 0x7fb2b419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.935+0000 7fb2bb19d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2b4102750 0x7fb2b419df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.935+0000 7fb2bb19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2b4106df0 0x7fb2b4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.935+0000 7fb2bb19d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41980d0 con 0x7fb2b4101db0 2023-07-14T13:04:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.935+0000 7fb2bb19d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4198240 con 0x7fb2b4102750 2023-07-14T13:04:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.935+0000 7fb2bb19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4198400 con 0x7fb2b4106df0 2023-07-14T13:04:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2ba19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2b4101db0 0x7fb2b419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2ba19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2b4101db0 0x7fb2b419d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39488/0 (socket says 172.21.15.17:39488) 2023-07-14T13:04:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2ba19b700 1 -- 172.21.15.17:0/1983951851 learned_addr learned my addr 172.21.15.17:0/1983951851 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2ba99c700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2b4106df0 0x7fb2b4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2b999a700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2b4102750 0x7fb2b419df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2ba99c700 1 -- 172.21.15.17:0/1983951851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2b4102750 msgr2=0x7fb2b419df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2ba99c700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2b4102750 0x7fb2b419df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2ba99c700 1 -- 172.21.15.17:0/1983951851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2b4101db0 msgr2=0x7fb2b419d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2ba99c700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2b4101db0 0x7fb2b419d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2ba99c700 1 -- 172.21.15.17:0/1983951851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac009c40 con 0x7fb2b4106df0 2023-07-14T13:04:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2ba19b700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2b4101db0 0x7fb2b419d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:51.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.936+0000 7fb2ba99c700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2b4106df0 0x7fb2b4197a60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00efb0 tx=0x7fb2ac00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:51.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.937+0000 7fb2ab7fe700 1 -- 172.21.15.17:0/1983951851 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac003a00 con 0x7fb2b4106df0 2023-07-14T13:04:51.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.937+0000 7fb2ab7fe700 1 -- 172.21.15.17:0/1983951851 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2ac00f040 con 0x7fb2b4106df0 2023-07-14T13:04:51.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.937+0000 7fb2ab7fe700 1 -- 172.21.15.17:0/1983951851 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0044d0 con 0x7fb2b4106df0 2023-07-14T13:04:51.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.937+0000 7fb2bb19d700 1 -- 172.21.15.17:0/1983951851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b00095f0 con 0x7fb2b4106df0 2023-07-14T13:04:51.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.937+0000 7fb2bb19d700 1 -- 172.21.15.17:0/1983951851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b41a4800 con 0x7fb2b4106df0 2023-07-14T13:04:51.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.942+0000 7fb2ab7fe700 1 -- 172.21.15.17:0/1983951851 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb2ac00cbc0 con 0x7fb2b4106df0 2023-07-14T13:04:51.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.943+0000 7fb2cfdd0b80 1 Processor -- start 2023-07-14T13:04:51.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.943+0000 7fb2cfdd0b80 1 -- start start 2023-07-14T13:04:51.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.943+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7836f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad78311a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad7831700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad7736c50 con 0x55bad7837470 2023-07-14T13:04:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad77899e0 con 0x55bad768d6b0 2023-07-14T13:04:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad7782e70 con 0x55bad78378c0 2023-07-14T13:04:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2ab7fe700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb2a00a1340 0x7fb2a00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:51.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2b999a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7836f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:51.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2b999a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7836f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35368/0 (socket says 172.21.15.17:35368) 2023-07-14T13:04:51.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2b999a700 1 -- 172.21.15.17:0/4094775950 learned_addr learned my addr 172.21.15.17:0/4094775950 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:51.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2ab7fe700 1 -- 172.21.15.17:0/1983951851 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb2ac0cc760 con 0x7fb2b4106df0 2023-07-14T13:04:51.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2b999a700 1 --2- 172.21.15.17:0/4094775950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad7831700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:51.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2ba19b700 1 --2- 172.21.15.17:0/4094775950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad78311a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:51.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.944+0000 7fb2ba99c700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb2a00a1340 0x7fb2a00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:51.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.945+0000 7fb2b999a700 1 -- 172.21.15.17:0/4094775950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 msgr2=0x55bad7831700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:51.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.945+0000 7fb2b999a700 1 --2- 172.21.15.17:0/4094775950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad7831700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.945+0000 7fb2b999a700 1 -- 172.21.15.17:0/4094775950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 msgr2=0x55bad78311a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:51.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.945+0000 7fb2b999a700 1 --2- 172.21.15.17:0/4094775950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad78311a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.945+0000 7fb2b999a700 1 -- 172.21.15.17:0/4094775950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bad75b0d80 con 0x55bad768d6b0 2023-07-14T13:04:51.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.945+0000 7fb2ba99c700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb2a00a1340 0x7fb2a00a37f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009fd0 tx=0x7fb2ac009f30 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:51.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.945+0000 7fb2b999a700 1 --2- 172.21.15.17:0/4094775950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7836f30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009fd0 tx=0x7fb2a4009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ffde050c946a3d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:51.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.945+0000 7fb2a8bfe700 1 -- 172.21.15.17:0/4094775950 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4013e10 con 0x55bad768d6b0 2023-07-14T13:04:51.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.945+0000 7fb2a8bfe700 1 -- 172.21.15.17:0/4094775950 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2a4013120 con 0x55bad768d6b0 2023-07-14T13:04:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.945+0000 7fb2a8bfe700 1 -- 172.21.15.17:0/4094775950 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400e610 con 0x55bad768d6b0 2023-07-14T13:04:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.946+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/4094775950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 msgr2=0x55bad7836f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:51.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.946+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/4094775950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7836f30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009fd0 tx=0x7fb2a4009750 comp rx=0 tx=0).stop 2023-07-14T13:04:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.946+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/4094775950 shutdown_connections 2023-07-14T13:04:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.946+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/4094775950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad7831700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.946+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/4094775950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7836f30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.946+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/4094775950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad78311a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.946+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/4094775950 >> 172.21.15.17:0/4094775950 conn(0x55bad7826d40 msgr2=0x55bad782c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:51.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.946+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/4094775950 shutdown_connections 2023-07-14T13:04:51.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.946+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/4094775950 wait complete. 2023-07-14T13:04:51.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.947+0000 7fb2cfdd0b80 1 -- start start 2023-07-14T13:04:51.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.947+0000 7fb2cfdd0b80 1 Processor -- start 2023-07-14T13:04:51.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.948+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad768d6b0 0x55bad783d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:51.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.948+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad7837470 0x55bad783aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:51.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.948+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad78378c0 0x55bad783b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:51.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.948+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad7722a60 con 0x55bad768d6b0 2023-07-14T13:04:51.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.948+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad7722760 con 0x55bad78378c0 2023-07-14T13:04:51.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.948+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad76068c0 con 0x55bad7837470 2023-07-14T13:04:51.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.948+0000 7fb2cfdd0b80 10 client.0 _ll_register_callbacks cb 0x55bad7720700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:51.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.949+0000 7fb2b999a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad768d6b0 0x55bad783d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:51.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.949+0000 7fb2b999a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad768d6b0 0x55bad783d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39502/0 (socket says 172.21.15.17:39502) 2023-07-14T13:04:51.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.949+0000 7fb2b999a700 1 -- 172.21.15.17:0/3231990001 learned_addr learned my addr 172.21.15.17:0/3231990001 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.949+0000 7fb2ba19b700 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad7837470 0x55bad783aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.949+0000 7fb2b999a700 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad78378c0 0x55bad783b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.949+0000 7fb2b999a700 1 -- 172.21.15.17:0/3231990001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad7837470 msgr2=0x55bad783aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.949+0000 7fb2b999a700 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad7837470 0x55bad783aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.949+0000 7fb2b999a700 1 -- 172.21.15.17:0/3231990001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad78378c0 msgr2=0x55bad783b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.949+0000 7fb2b999a700 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad78378c0 0x55bad783b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.949+0000 7fb2b999a700 1 -- 172.21.15.17:0/3231990001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a401b040 con 0x55bad768d6b0 2023-07-14T13:04:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.950+0000 7fb2b999a700 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad768d6b0 0x55bad783d780 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009340 tx=0x7fb2a4015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac18fbec082553f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.950+0000 7fb29dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:04:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.950+0000 7fb29dffb700 1 -- 172.21.15.17:0/3231990001 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4013ea0 con 0x55bad768d6b0 2023-07-14T13:04:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.950+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/3231990001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bad76dc490 con 0x55bad768d6b0 2023-07-14T13:04:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.950+0000 7fb29dffb700 1 -- 172.21.15.17:0/3231990001 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb2a4010870 con 0x55bad768d6b0 2023-07-14T13:04:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.951+0000 7fb29dffb700 1 -- 172.21.15.17:0/3231990001 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2a4004050 con 0x55bad768d6b0 2023-07-14T13:04:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.951+0000 7fb2cfdd0b80 10 client.16791 fetch_fsmap learned FSMap version 27 2023-07-14T13:04:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.951+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/3231990001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bad7599c00 con 0x55bad768d6b0 2023-07-14T13:04:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.951+0000 7fb29dffb700 1 -- 172.21.15.17:0/3231990001 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bad76dc490 con 0x55bad768d6b0 2023-07-14T13:04:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.951+0000 7fb29dffb700 1 -- 172.21.15.17:0/3231990001 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb2a4004750 con 0x55bad768d6b0 2023-07-14T13:04:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.951+0000 7fb2cfdd0b80 10 client.16791 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:04:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.951+0000 7fb2cfdd0b80 10 client.16791 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.951+0000 7fb2cfdd0b80 20 client.16791 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.951+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bad784ac10 0x55bad784d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.951+0000 7fb2cfdd0b80 4 client.16791 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:04:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.951+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/3231990001 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bad777be50 con 0x55bad784ac10 2023-07-14T13:04:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.952+0000 7fb2ba19b700 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bad784ac10 0x55bad784d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.952+0000 7fb29dffb700 10 client.16791 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.952+0000 7fb2ba19b700 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bad784ac10 0x55bad784d020 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43373eb9b31259aa server_cookie=7e23b0df39d548bd in_seq=0 out_seq=0 2023-07-14T13:04:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.953+0000 7fb29dffb700 1 -- 172.21.15.17:0/3231990001 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bad777be50 con 0x55bad784ac10 2023-07-14T13:04:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.953+0000 7fb29dffb700 10 client.16791 handle_command_reply: tid=0 2023-07-14T13:04:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.953+0000 7fb2cfdd0b80 1 client.16791 shutdown 2023-07-14T13:04:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.953+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/3231990001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad768d6b0 msgr2=0x55bad783d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.953+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad768d6b0 0x55bad783d780 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009340 tx=0x7fb2a4015040 comp rx=0 tx=0).stop 2023-07-14T13:04:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.954+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/3231990001 shutdown_connections 2023-07-14T13:04:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.954+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bad784ac10 0x55bad784d020 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.954+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad78378c0 0x55bad783b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.954+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad768d6b0 0x55bad783d780 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.954+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/3231990001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad7837470 0x55bad783aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.954+0000 7fb29dffb700 0 client.16791 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.954+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/3231990001 >> 172.21.15.17:0/3231990001 conn(0x55bad7826d40 msgr2=0x55bad782b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.954+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/3231990001 shutdown_connections 2023-07-14T13:04:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.954+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/3231990001 wait complete. 2023-07-14T13:04:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.954+0000 7fb2cfdd0b80 20 client.16791 trim_cache size 0 max 16384 2023-07-14T13:04:52.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.971+0000 7fb2cfdd0b80 1 Processor -- start 2023-07-14T13:04:52.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.971+0000 7fb2cfdd0b80 1 -- start start 2023-07-14T13:04:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.971+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7841d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.971+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad78383a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.971+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad783d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.971+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad782cf10 con 0x55bad7837470 2023-07-14T13:04:52.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.971+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad78311a0 con 0x55bad768d6b0 2023-07-14T13:04:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.971+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad783bfe0 con 0x55bad78378c0 2023-07-14T13:04:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2b999a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7841d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2ba19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad78383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2b999a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7841d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35378/0 (socket says 172.21.15.17:35378) 2023-07-14T13:04:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2b999a700 1 -- 172.21.15.17:0/1653379439 learned_addr learned my addr 172.21.15.17:0/1653379439 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2b999a700 1 --2- 172.21.15.17:0/1653379439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad783d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:52.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2b999a700 1 -- 172.21.15.17:0/1653379439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 msgr2=0x55bad783d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2b999a700 1 --2- 172.21.15.17:0/1653379439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad783d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2b999a700 1 -- 172.21.15.17:0/1653379439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 msgr2=0x55bad78383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2b999a700 1 --2- 172.21.15.17:0/1653379439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad78383a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2b999a700 1 -- 172.21.15.17:0/1653379439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bad7851c10 con 0x55bad768d6b0 2023-07-14T13:04:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2ba19b700 1 --2- 172.21.15.17:0/1653379439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad78383a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:52.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.972+0000 7fb2b999a700 1 --2- 172.21.15.17:0/1653379439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7841d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4013e00 tx=0x7fb2a4023040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=475de1edabc126f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.973+0000 7fb2a93ff700 1 -- 172.21.15.17:0/1653379439 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4013ea0 con 0x55bad768d6b0 2023-07-14T13:04:52.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.973+0000 7fb2a93ff700 1 -- 172.21.15.17:0/1653379439 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2a4004d50 con 0x55bad768d6b0 2023-07-14T13:04:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.973+0000 7fb2a93ff700 1 -- 172.21.15.17:0/1653379439 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a401f3c0 con 0x55bad768d6b0 2023-07-14T13:04:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.973+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/1653379439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 msgr2=0x55bad7841d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.973+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/1653379439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7841d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4013e00 tx=0x7fb2a4023040 comp rx=0 tx=0).stop 2023-07-14T13:04:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.974+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/1653379439 shutdown_connections 2023-07-14T13:04:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.974+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/1653379439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad783d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.974+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/1653379439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad7841d80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.974+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/1653379439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad78383a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.974+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/1653379439 >> 172.21.15.17:0/1653379439 conn(0x55bad7826d40 msgr2=0x55bad7837c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.974+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/1653379439 shutdown_connections 2023-07-14T13:04:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.974+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/1653379439 wait complete. 2023-07-14T13:04:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.974+0000 7fb2cfdd0b80 1 -- start start 2023-07-14T13:04:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.974+0000 7fb2cfdd0b80 1 Processor -- start 2023-07-14T13:04:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad783dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad783e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2cfdd0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad783e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad789dc30 con 0x55bad7837470 2023-07-14T13:04:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad789dda0 con 0x55bad768d6b0 2023-07-14T13:04:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2cfdd0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bad789df60 con 0x55bad78378c0 2023-07-14T13:04:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2cfdd0b80 10 client.0 _ll_register_callbacks cb 0x7fb2a4013720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2b999a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad783dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2ba19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad783e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2b999a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad783dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35388/0 (socket says 172.21.15.17:35388) 2023-07-14T13:04:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2b999a700 1 -- 172.21.15.17:0/2539627818 learned_addr learned my addr 172.21.15.17:0/2539627818 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.975+0000 7fb2b999a700 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad783e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.976+0000 7fb2ba19b700 1 -- 172.21.15.17:0/2539627818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 msgr2=0x55bad783e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.976+0000 7fb2ba19b700 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad783e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.976+0000 7fb2ba19b700 1 -- 172.21.15.17:0/2539627818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 msgr2=0x55bad783dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.976+0000 7fb2ba19b700 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad783dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.976+0000 7fb2ba19b700 1 -- 172.21.15.17:0/2539627818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b410f200 con 0x55bad7837470 2023-07-14T13:04:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.976+0000 7fb2ba19b700 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad783e2a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x55bad783bfb0 tx=0x7fb2b0028ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89979d59db5ae2b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.976+0000 7fb29dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:04:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.976+0000 7fb29dffb700 1 -- 172.21.15.17:0/2539627818 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0028240 con 0x55bad7837470 2023-07-14T13:04:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.976+0000 7fb29dffb700 1 -- 172.21.15.17:0/2539627818 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb2b00283a0 con 0x55bad7837470 2023-07-14T13:04:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.976+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/2539627818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb2a4013120 con 0x55bad7837470 2023-07-14T13:04:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.977+0000 7fb29dffb700 1 -- 172.21.15.17:0/2539627818 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2b0028e50 con 0x55bad7837470 2023-07-14T13:04:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.977+0000 7fb2cfdd0b80 10 client.16797 fetch_fsmap learned FSMap version 27 2023-07-14T13:04:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.977+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/2539627818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55bad7599c00 con 0x55bad7837470 2023-07-14T13:04:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.977+0000 7fb29dffb700 1 -- 172.21.15.17:0/2539627818 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2a4013120 con 0x55bad7837470 2023-07-14T13:04:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.977+0000 7fb29dffb700 1 -- 172.21.15.17:0/2539627818 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb2b00099f0 con 0x55bad7837470 2023-07-14T13:04:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.977+0000 7fb2cfdd0b80 10 client.16797 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:04:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.977+0000 7fb2cfdd0b80 10 client.16797 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.977+0000 7fb2cfdd0b80 20 client.16797 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.977+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bad789f5a0 0x55bad78a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.977+0000 7fb2cfdd0b80 4 client.16797 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:04:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.977+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/2539627818 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bad773dff0 con 0x55bad789f5a0 2023-07-14T13:04:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.978+0000 7fb2b999a700 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bad789f5a0 0x55bad78a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.978+0000 7fb2b999a700 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bad789f5a0 0x55bad78a19b0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85de448bef55c954 server_cookie=b7f68d9357ba3107 in_seq=0 out_seq=0 2023-07-14T13:04:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.978+0000 7fb29dffb700 10 client.16797 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb29dffb700 1 -- 172.21.15.17:0/2539627818 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bad773dff0 con 0x55bad789f5a0 2023-07-14T13:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb29dffb700 10 client.16797 handle_command_reply: tid=0 2023-07-14T13:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 1 client.16797 shutdown 2023-07-14T13:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/2539627818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 msgr2=0x55bad783e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad783e2a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x55bad783bfb0 tx=0x7fb2b0028ad0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/2539627818 shutdown_connections 2023-07-14T13:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bad789f5a0 0x55bad78a19b0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bad78378c0 0x55bad783e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bad768d6b0 0x55bad783dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 1 --2- 172.21.15.17:0/2539627818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bad7837470 0x55bad783e2a0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb29dffb700 0 client.16797 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/2539627818 >> 172.21.15.17:0/2539627818 conn(0x55bad7826d40 msgr2=0x55bad7838520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/2539627818 shutdown_connections 2023-07-14T13:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 1 -- 172.21.15.17:0/2539627818 wait complete. 2023-07-14T13:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.997+0000 7fb2cfdd0b80 20 client.16797 trim_cache size 0 max 16384 2023-07-14T13:04:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:04:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:04:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:04:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:04:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 -- 172.21.15.17:0/1983951851 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb2a00a1340 msgr2=0x7fb2a00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb2a00a1340 0x7fb2a00a37f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009fd0 tx=0x7fb2ac009f30 comp rx=0 tx=0).stop 2023-07-14T13:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 -- 172.21.15.17:0/1983951851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2b4106df0 msgr2=0x7fb2b4197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2b4106df0 0x7fb2b4197a60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00efb0 tx=0x7fb2ac00c3a0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 -- 172.21.15.17:0/1983951851 shutdown_connections 2023-07-14T13:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb2a00a1340 0x7fb2a00a37f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2b4106df0 0x7fb2b4197a60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2b4101db0 0x7fb2b419d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 --2- 172.21.15.17:0/1983951851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2b4102750 0x7fb2b419df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 -- 172.21.15.17:0/1983951851 >> 172.21.15.17:0/1983951851 conn(0x7fb2b40fd660 msgr2=0x7fb2b4105750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 -- 172.21.15.17:0/1983951851 shutdown_connections 2023-07-14T13:04:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:04:51.998+0000 7fb2bb19d700 1 -- 172.21.15.17:0/1983951851 wait complete. 2023-07-14T13:04:53.206 INFO:teuthology.orchestra.run.smithi017.stderr:18700000 of 50000000 tuples (37%) done (elapsed 282.81 s, remaining 473.36 s) 2023-07-14T13:04:53.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:53 smithi017 ceph-mon[95536]: pgmap v157: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 21 MiB/s wr, 34 op/s 2023-07-14T13:04:53.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:53 smithi135 ceph-mon[97338]: pgmap v157: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 21 MiB/s wr, 34 op/s 2023-07-14T13:04:53.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:53 smithi131 ceph-mon[96953]: pgmap v157: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 21 MiB/s wr, 34 op/s 2023-07-14T13:04:54.555 INFO:teuthology.orchestra.run.smithi017.stderr:18800000 of 50000000 tuples (37%) done (elapsed 284.16 s, remaining 471.58 s) 2023-07-14T13:04:55.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:55 smithi017 ceph-mon[95536]: pgmap v158: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 21 MiB/s wr, 34 op/s 2023-07-14T13:04:55.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:55 smithi135 ceph-mon[97338]: pgmap v158: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 21 MiB/s wr, 34 op/s 2023-07-14T13:04:55.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:55 smithi131 ceph-mon[96953]: pgmap v158: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 21 MiB/s wr, 34 op/s 2023-07-14T13:04:55.886 INFO:teuthology.orchestra.run.smithi017.stderr:18900000 of 50000000 tuples (37%) done (elapsed 285.49 s, remaining 469.77 s) 2023-07-14T13:04:57.250 INFO:teuthology.orchestra.run.smithi017.stderr:19000000 of 50000000 tuples (38%) done (elapsed 286.85 s, remaining 468.02 s) 2023-07-14T13:04:57.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:57 smithi017 ceph-mon[95536]: pgmap v159: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 32 MiB/s wr, 58 op/s 2023-07-14T13:04:57.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:57 smithi135 ceph-mon[97338]: pgmap v159: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 32 MiB/s wr, 58 op/s 2023-07-14T13:04:57.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:57 smithi131 ceph-mon[96953]: pgmap v159: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 32 MiB/s wr, 58 op/s 2023-07-14T13:04:58.660 INFO:teuthology.orchestra.run.smithi017.stderr:19100000 of 50000000 tuples (38%) done (elapsed 288.26 s, remaining 466.35 s) 2023-07-14T13:04:58.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:04:59.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.997+0000 7fcb513ff700 1 -- 172.21.15.17:0/3452939593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c1015b0 msgr2=0x7fcb4c109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:59.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.997+0000 7fcb513ff700 1 --2- 172.21.15.17:0/3452939593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c1015b0 0x7fcb4c109aa0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcb400098f0 tx=0x7fcb40009c00 comp rx=0 tx=0).stop 2023-07-14T13:04:59.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.998+0000 7fcb513ff700 1 -- 172.21.15.17:0/3452939593 shutdown_connections 2023-07-14T13:04:59.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.998+0000 7fcb513ff700 1 --2- 172.21.15.17:0/3452939593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb4c10a070 0x7fcb4c10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.998+0000 7fcb513ff700 1 --2- 172.21.15.17:0/3452939593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c100ca0 0x7fcb4c101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.998+0000 7fcb513ff700 1 --2- 172.21.15.17:0/3452939593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c1015b0 0x7fcb4c109aa0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.998+0000 7fcb513ff700 1 -- 172.21.15.17:0/3452939593 >> 172.21.15.17:0/3452939593 conn(0x7fcb4c0fa4b0 msgr2=0x7fcb4c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:59.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.998+0000 7fcb513ff700 1 -- 172.21.15.17:0/3452939593 shutdown_connections 2023-07-14T13:04:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.998+0000 7fcb513ff700 1 -- 172.21.15.17:0/3452939593 wait complete. 2023-07-14T13:04:59.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.999+0000 7fcb513ff700 1 Processor -- start 2023-07-14T13:04:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.999+0000 7fcb513ff700 1 -- start start 2023-07-14T13:04:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.999+0000 7fcb513ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb4c100ca0 0x7fcb4c197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.999+0000 7fcb513ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c1015b0 0x7fcb4c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.999+0000 7fcb513ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c10a070 0x7fcb4c19c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.999+0000 7fcb513ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c19cd70 con 0x7fcb4c100ca0 2023-07-14T13:04:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.999+0000 7fcb513ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c19cee0 con 0x7fcb4c1015b0 2023-07-14T13:04:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:58.999+0000 7fcb513ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c19d0a0 con 0x7fcb4c10a070 2023-07-14T13:04:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.000+0000 7fcb4b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c10a070 0x7fcb4c19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.000+0000 7fcb4b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c10a070 0x7fcb4c19c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41786/0 (socket says 172.21.15.17:41786) 2023-07-14T13:04:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.000+0000 7fcb4affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb4c100ca0 0x7fcb4c197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.000+0000 7fcb4b7fe700 1 -- 172.21.15.17:0/2957285468 learned_addr learned my addr 172.21.15.17:0/2957285468 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.000+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c1015b0 0x7fcb4c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.000+0000 7fcb4b7fe700 1 -- 172.21.15.17:0/2957285468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c1015b0 msgr2=0x7fcb4c1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.000+0000 7fcb4b7fe700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c1015b0 0x7fcb4c1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.000+0000 7fcb4b7fe700 1 -- 172.21.15.17:0/2957285468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb4c100ca0 msgr2=0x7fcb4c197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.000+0000 7fcb4b7fe700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb4c100ca0 0x7fcb4c197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.000+0000 7fcb4b7fe700 1 -- 172.21.15.17:0/2957285468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40009520 con 0x7fcb4c10a070 2023-07-14T13:04:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.001+0000 7fcb4b7fe700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c10a070 0x7fcb4c19c730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400ef30 tx=0x7fcb4400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.001+0000 7fcb33fff700 1 -- 172.21.15.17:0/2957285468 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44018070 con 0x7fcb4c10a070 2023-07-14T13:04:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.001+0000 7fcb513ff700 1 -- 172.21.15.17:0/2957285468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c19d320 con 0x7fcb4c10a070 2023-07-14T13:04:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.001+0000 7fcb33fff700 1 -- 172.21.15.17:0/2957285468 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb4400f040 con 0x7fcb4c10a070 2023-07-14T13:04:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.001+0000 7fcb33fff700 1 -- 172.21.15.17:0/2957285468 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400cbb0 con 0x7fcb4c10a070 2023-07-14T13:04:59.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.001+0000 7fcb513ff700 1 -- 172.21.15.17:0/2957285468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c1a4bc0 con 0x7fcb4c10a070 2023-07-14T13:04:59.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.007+0000 7fcb33fff700 1 -- 172.21.15.17:0/2957285468 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcb4400cd70 con 0x7fcb4c10a070 2023-07-14T13:04:59.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.008+0000 7fcb64ce4b80 1 Processor -- start 2023-07-14T13:04:59.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.009+0000 7fcb64ce4b80 1 -- start start 2023-07-14T13:04:59.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.009+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826d2d0 0x5556c826d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.009+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826dbe0 0x5556c8280da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.009+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c82812e0 0x5556c82836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.009+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c8173cb0 con 0x5556c82812e0 2023-07-14T13:04:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.009+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c81c6a40 con 0x5556c826d2d0 2023-07-14T13:04:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.009+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c81bfed0 con 0x5556c826dbe0 2023-07-14T13:04:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb4a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826d2d0 0x5556c826d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb4a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826d2d0 0x5556c826d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44980/0 (socket says 172.21.15.17:44980) 2023-07-14T13:04:59.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/2925828665 learned_addr learned my addr 172.21.15.17:0/2925828665 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb4affd700 1 --2- 172.21.15.17:0/2925828665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826dbe0 0x5556c8280da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb33fff700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcb340a12c0 0x7fcb340a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/2925828665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c82812e0 0x5556c82836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/2925828665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826dbe0 msgr2=0x5556c8280da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/2925828665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826dbe0 0x5556c8280da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/2925828665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c82812e0 msgr2=0x5556c82836c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/2925828665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c82812e0 0x5556c82836c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/2925828665 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556c7fedde0 con 0x5556c826d2d0 2023-07-14T13:04:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.010+0000 7fcb33fff700 1 -- 172.21.15.17:0/2957285468 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcb440cc780 con 0x7fcb4c10a070 2023-07-14T13:04:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.011+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/2925828665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826d2d0 0x5556c826d6a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb400098f0 tx=0x7fcb40019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e738a8595489f409 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.011+0000 7fcb4b7fe700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcb340a12c0 0x7fcb340a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.011+0000 7fcb317fa700 1 -- 172.21.15.17:0/2925828665 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40010e20 con 0x5556c826d2d0 2023-07-14T13:04:59.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.011+0000 7fcb317fa700 1 -- 172.21.15.17:0/2925828665 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb4000f8f0 con 0x5556c826d2d0 2023-07-14T13:04:59.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.011+0000 7fcb317fa700 1 -- 172.21.15.17:0/2925828665 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40005600 con 0x5556c826d2d0 2023-07-14T13:04:59.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.013+0000 7fcb4b7fe700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcb340a12c0 0x7fcb340a3770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009f40 tx=0x7fcb44009ed0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:59.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.013+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2925828665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826d2d0 msgr2=0x5556c826d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:59.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.013+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/2925828665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826d2d0 0x5556c826d6a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb400098f0 tx=0x7fcb40019040 comp rx=0 tx=0).stop 2023-07-14T13:04:59.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.013+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2925828665 shutdown_connections 2023-07-14T13:04:59.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.013+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/2925828665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c82812e0 0x5556c82836c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.013+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/2925828665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826d2d0 0x5556c826d6a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.013+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/2925828665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826dbe0 0x5556c8280da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.013+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2925828665 >> 172.21.15.17:0/2925828665 conn(0x5556c8263da0 msgr2=0x5556c82696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:59.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.013+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2925828665 shutdown_connections 2023-07-14T13:04:59.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.013+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2925828665 wait complete. 2023-07-14T13:04:59.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.014+0000 7fcb64ce4b80 1 -- start start 2023-07-14T13:04:59.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.014+0000 7fcb64ce4b80 1 Processor -- start 2023-07-14T13:04:59.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.015+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.015+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826dbe0 0x5556c827e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.015+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c82812e0 0x5556c827e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.015+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c815fac0 con 0x5556c826dbe0 2023-07-14T13:04:59.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.015+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c815f7c0 con 0x5556c82812e0 2023-07-14T13:04:59.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.015+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c8043920 con 0x5556c826d2d0 2023-07-14T13:04:59.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.016+0000 7fcb64ce4b80 10 client.0 _ll_register_callbacks cb 0x5556c815d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:59.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.016+0000 7fcb4a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.016+0000 7fcb4a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41810/0 (socket says 172.21.15.17:41810) 2023-07-14T13:04:59.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.016+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/3577090908 learned_addr learned my addr 172.21.15.17:0/3577090908 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:59.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.016+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c82812e0 0x5556c827e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.016+0000 7fcb4affd700 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826dbe0 0x5556c827e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.016+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/3577090908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c82812e0 msgr2=0x5556c827e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:59.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.016+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c82812e0 0x5556c827e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.017+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/3577090908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826dbe0 msgr2=0x5556c827e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.017+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826dbe0 0x5556c827e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.017+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/3577090908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4001f040 con 0x5556c826d2d0 2023-07-14T13:04:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.017+0000 7fcb4affd700 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826dbe0 0x5556c827e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:04:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.017+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000fdd0 tx=0x7fcb400051e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e795f10cad085a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.017+0000 7fcb2eff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:04:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.017+0000 7fcb2eff5700 1 -- 172.21.15.17:0/3577090908 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000f460 con 0x5556c826d2d0 2023-07-14T13:04:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.017+0000 7fcb2eff5700 1 -- 172.21.15.17:0/3577090908 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcb4000f5c0 con 0x5556c826d2d0 2023-07-14T13:04:59.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.017+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3577090908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5556c81b8eb0 con 0x5556c826d2d0 2023-07-14T13:04:59.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.018+0000 7fcb2eff5700 1 -- 172.21.15.17:0/3577090908 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb4000f780 con 0x5556c826d2d0 2023-07-14T13:04:59.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.018+0000 7fcb64ce4b80 10 client.26500 fetch_fsmap learned FSMap version 27 2023-07-14T13:04:59.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.018+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3577090908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5556c7fd6c60 con 0x5556c826d2d0 2023-07-14T13:04:59.054 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.018+0000 7fcb2eff5700 1 -- 172.21.15.17:0/3577090908 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5556c81b8eb0 con 0x5556c826d2d0 2023-07-14T13:04:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.019+0000 7fcb2eff5700 1 -- 172.21.15.17:0/3577090908 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcb40015020 con 0x5556c826d2d0 2023-07-14T13:04:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.019+0000 7fcb64ce4b80 10 client.26500 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:04:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.019+0000 7fcb64ce4b80 10 client.26500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.019+0000 7fcb64ce4b80 20 client.26500 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.019+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5556c8290710 0x5556c8292af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.019+0000 7fcb64ce4b80 4 client.26500 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:04:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.019+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3577090908 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5556c817b050 con 0x5556c8290710 2023-07-14T13:04:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.019+0000 7fcb4affd700 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5556c8290710 0x5556c8292af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.020+0000 7fcb4affd700 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5556c8290710 0x5556c8292af0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54901cd3b06a2e9f server_cookie=246d22c6e058498a in_seq=0 out_seq=0 2023-07-14T13:04:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.020+0000 7fcb2eff5700 10 client.26500 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.021+0000 7fcb2eff5700 1 -- 172.21.15.17:0/3577090908 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5556c817b050 con 0x5556c8290710 2023-07-14T13:04:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.021+0000 7fcb2eff5700 10 client.26500 handle_command_reply: tid=0 2023-07-14T13:04:59.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.021+0000 7fcb64ce4b80 1 client.26500 shutdown 2023-07-14T13:04:59.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.021+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3577090908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 msgr2=0x5556c8280d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:59.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.021+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000fdd0 tx=0x7fcb400051e0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.022+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3577090908 shutdown_connections 2023-07-14T13:04:59.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.022+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5556c8290710 0x5556c8292af0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.022+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c82812e0 0x5556c827e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.022+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280d90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.022+0000 7fcb2eff5700 0 client.26500 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:59.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.022+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/3577090908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826dbe0 0x5556c827e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.022+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3577090908 >> 172.21.15.17:0/3577090908 conn(0x5556c8263da0 msgr2=0x5556c8269230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:59.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.022+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3577090908 shutdown_connections 2023-07-14T13:04:59.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.022+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3577090908 wait complete. 2023-07-14T13:04:59.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.022+0000 7fcb64ce4b80 20 client.26500 trim_cache size 0 max 16384 2023-07-14T13:04:59.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.042+0000 7fcb64ce4b80 1 Processor -- start 2023-07-14T13:04:59.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.042+0000 7fcb64ce4b80 1 -- start start 2023-07-14T13:04:59.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.043+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.043+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 0x5556c827d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.043+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c82812e0 0x5556c827dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.043+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c826e540 con 0x5556c82812e0 2023-07-14T13:04:59.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.043+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c826ad00 con 0x5556c826dbe0 2023-07-14T13:04:59.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.043+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c827f5f0 con 0x5556c826d2d0 2023-07-14T13:04:59.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.043+0000 7fcb4a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.043+0000 7fcb4a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41822/0 (socket says 172.21.15.17:41822) 2023-07-14T13:04:59.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.043+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/3368557130 learned_addr learned my addr 172.21.15.17:0/3368557130 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:59.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.043+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/3368557130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c82812e0 0x5556c827dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.043+0000 7fcb4affd700 1 --2- 172.21.15.17:0/3368557130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 0x5556c827d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.044+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/3368557130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 msgr2=0x5556c827d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.044+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/3368557130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 0x5556c827d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.044+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/3368557130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c82812e0 msgr2=0x5556c827dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.044+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/3368557130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c82812e0 0x5556c827dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.044+0000 7fcb4a7fc700 1 -- 172.21.15.17:0/3368557130 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556c8014250 con 0x5556c826d2d0 2023-07-14T13:04:59.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.044+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/3368557130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000a010 tx=0x7fcb400051e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5059b9b7242f872 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:59.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.044+0000 7fcb31ffb700 1 -- 172.21.15.17:0/3368557130 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40005070 con 0x5556c826d2d0 2023-07-14T13:04:59.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.044+0000 7fcb31ffb700 1 -- 172.21.15.17:0/3368557130 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb4000f8f0 con 0x5556c826d2d0 2023-07-14T13:04:59.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.044+0000 7fcb31ffb700 1 -- 172.21.15.17:0/3368557130 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000ee60 con 0x5556c826d2d0 2023-07-14T13:04:59.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.045+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3368557130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 msgr2=0x5556c8280930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:59.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.045+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/3368557130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000a010 tx=0x7fcb400051e0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.045+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3368557130 shutdown_connections 2023-07-14T13:04:59.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.045+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/3368557130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c82812e0 0x5556c827dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.045+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/3368557130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c826d2d0 0x5556c8280930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.045+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/3368557130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 0x5556c827d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.045+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3368557130 >> 172.21.15.17:0/3368557130 conn(0x5556c8263da0 msgr2=0x5556c8267e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:59.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.045+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3368557130 shutdown_connections 2023-07-14T13:04:59.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.045+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/3368557130 wait complete. 2023-07-14T13:04:59.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.046+0000 7fcb64ce4b80 1 -- start start 2023-07-14T13:04:59.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.046+0000 7fcb64ce4b80 1 Processor -- start 2023-07-14T13:04:59.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.046+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826d2d0 0x5556c8285e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 0x5556c82863d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb64ce4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c82812e0 0x5556c82e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c82e3a00 con 0x5556c826d2d0 2023-07-14T13:04:59.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c82e3b40 con 0x5556c826dbe0 2023-07-14T13:04:59.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb64ce4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556c82e3d00 con 0x5556c82812e0 2023-07-14T13:04:59.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb64ce4b80 10 client.0 _ll_register_callbacks cb 0x7fcb4000fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:04:59.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb4a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c82812e0 0x5556c82e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb4affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 0x5556c82863d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb4a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826d2d0 0x5556c8285e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb4affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 0x5556c82863d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:45004/0 (socket says 172.21.15.17:45004) 2023-07-14T13:04:59.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb4a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826d2d0 0x5556c8285e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55466/0 (socket says 172.21.15.17:55466) 2023-07-14T13:04:59.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.047+0000 7fcb4affd700 1 -- 172.21.15.17:0/2077801935 learned_addr learned my addr 172.21.15.17:0/2077801935 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:04:59.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.048+0000 7fcb4affd700 1 -- 172.21.15.17:0/2077801935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c82812e0 msgr2=0x5556c82e34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:59.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.048+0000 7fcb4affd700 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c82812e0 0x5556c82e34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.048+0000 7fcb4affd700 1 -- 172.21.15.17:0/2077801935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826d2d0 msgr2=0x5556c8285e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:04:59.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.048+0000 7fcb4affd700 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826d2d0 0x5556c8285e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.048+0000 7fcb4affd700 1 -- 172.21.15.17:0/2077801935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556c7fd6c60 con 0x5556c826dbe0 2023-07-14T13:04:59.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.048+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826d2d0 0x5556c8285e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:04:59.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.048+0000 7fcb4affd700 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 0x5556c82863d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5556c827f5c0 tx=0x7fcb3c01fa40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d78247a7f6571c1c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:04:59.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.048+0000 7fcb2eff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:04:59.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.048+0000 7fcb2eff5700 1 -- 172.21.15.17:0/2077801935 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c004b00 con 0x5556c826dbe0 2023-07-14T13:04:59.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.048+0000 7fcb2eff5700 1 -- 172.21.15.17:0/2077801935 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcb3c004c60 con 0x5556c826dbe0 2023-07-14T13:04:59.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.048+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2077801935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5556c800ef70 con 0x5556c826dbe0 2023-07-14T13:04:59.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.049+0000 7fcb2eff5700 1 -- 172.21.15.17:0/2077801935 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb3c004e20 con 0x5556c826dbe0 2023-07-14T13:04:59.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.049+0000 7fcb64ce4b80 10 client.26537 fetch_fsmap learned FSMap version 27 2023-07-14T13:04:59.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.049+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2077801935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5556c7fec2b0 con 0x5556c826dbe0 2023-07-14T13:04:59.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.049+0000 7fcb2eff5700 1 -- 172.21.15.17:0/2077801935 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5556c800ef70 con 0x5556c826dbe0 2023-07-14T13:04:59.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.049+0000 7fcb2eff5700 1 -- 172.21.15.17:0/2077801935 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcb3c0106f0 con 0x5556c826dbe0 2023-07-14T13:04:59.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.049+0000 7fcb64ce4b80 10 client.26537 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:04:59.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.049+0000 7fcb64ce4b80 10 client.26537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:04:59.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.049+0000 7fcb64ce4b80 20 client.26537 populate_metadata read hostname 'smithi017' 2023-07-14T13:04:59.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.049+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5556c82e54e0 0x5556c82e78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:04:59.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.049+0000 7fcb64ce4b80 4 client.26537 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:04:59.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.050+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2077801935 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5556c8043f60 con 0x5556c82e54e0 2023-07-14T13:04:59.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.050+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5556c82e54e0 0x5556c82e78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:04:59.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.050+0000 7fcb4a7fc700 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5556c82e54e0 0x5556c82e78f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d182e5e08b84323 server_cookie=7c032465f48a7eef in_seq=0 out_seq=0 2023-07-14T13:04:59.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.050+0000 7fcb2eff5700 10 client.26537 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:59.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb2eff5700 1 -- 172.21.15.17:0/2077801935 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5556c8043f60 con 0x5556c82e54e0 2023-07-14T13:04:59.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb2eff5700 10 client.26537 handle_command_reply: tid=0 2023-07-14T13:04:59.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb64ce4b80 1 client.26537 shutdown 2023-07-14T13:04:59.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2077801935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 msgr2=0x5556c82863d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:59.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 0x5556c82863d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5556c827f5c0 tx=0x7fcb3c01fa40 comp rx=0 tx=0).stop 2023-07-14T13:04:59.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2077801935 shutdown_connections 2023-07-14T13:04:59.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5556c82e54e0 0x5556c82e78f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556c82812e0 0x5556c82e34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5556c826d2d0 0x5556c8285e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb64ce4b80 1 --2- 172.21.15.17:0/2077801935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5556c826dbe0 0x5556c82863d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb2eff5700 0 client.26537 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:04:59.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2077801935 >> 172.21.15.17:0/2077801935 conn(0x5556c8263da0 msgr2=0x5556c826f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:59.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2077801935 shutdown_connections 2023-07-14T13:04:59.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.051+0000 7fcb64ce4b80 1 -- 172.21.15.17:0/2077801935 wait complete. 2023-07-14T13:04:59.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb64ce4b80 20 client.26537 trim_cache size 0 max 16384 2023-07-14T13:04:59.091 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:04:59.092 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:04:59.092 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:04:59.092 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:04:59.092 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:04:59.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:04:59.092 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:04:59.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:04:59.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:04:59.093 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:04:59.093 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 -- 172.21.15.17:0/2957285468 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcb340a12c0 msgr2=0x7fcb340a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:59.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcb340a12c0 0x7fcb340a3770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009f40 tx=0x7fcb44009ed0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 -- 172.21.15.17:0/2957285468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c10a070 msgr2=0x7fcb4c19c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:04:59.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c10a070 0x7fcb4c19c730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400ef30 tx=0x7fcb4400c3a0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 -- 172.21.15.17:0/2957285468 shutdown_connections 2023-07-14T13:04:59.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcb340a12c0 0x7fcb340a3770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb4c10a070 0x7fcb4c19c730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb4c100ca0 0x7fcb4c197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 --2- 172.21.15.17:0/2957285468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c1015b0 0x7fcb4c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:04:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 -- 172.21.15.17:0/2957285468 >> 172.21.15.17:0/2957285468 conn(0x7fcb4c0fa4b0 msgr2=0x7fcb4c0fb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:04:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 -- 172.21.15.17:0/2957285468 shutdown_connections 2023-07-14T13:04:59.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:04:59.052+0000 7fcb513ff700 1 -- 172.21.15.17:0/2957285468 wait complete. 2023-07-14T13:04:59.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:59 smithi017 ceph-mon[95536]: pgmap v160: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 20 MiB/s wr, 41 op/s 2023-07-14T13:04:59.104 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:04:59 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:04:59.107 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:04:59.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:59 smithi135 ceph-mon[97338]: pgmap v160: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 20 MiB/s wr, 41 op/s 2023-07-14T13:04:59.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:04:59 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:04:59.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:59 smithi131 ceph-mon[96953]: pgmap v160: 97 pgs: 97 active+clean; 4.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 20 MiB/s wr, 41 op/s 2023-07-14T13:04:59.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:04:59 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:05:00.106 INFO:teuthology.orchestra.run.smithi017.stderr:19200000 of 50000000 tuples (38%) done (elapsed 289.71 s, remaining 464.74 s) 2023-07-14T13:05:00.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:00 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:05:00.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:00 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:05:00.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:00 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:05:00.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:00 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:05:00.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:00 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:05:00.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:00 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:05:00.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:00 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:05:00.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:00 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:05:00.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:00 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:05:01.359 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:01 smithi017 ceph-mon[95536]: pgmap v161: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 31 MiB/s wr, 77 op/s 2023-07-14T13:05:01.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:01 smithi135 ceph-mon[97338]: pgmap v161: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 31 MiB/s wr, 77 op/s 2023-07-14T13:05:01.471 INFO:teuthology.orchestra.run.smithi017.stderr:19300000 of 50000000 tuples (38%) done (elapsed 291.07 s, remaining 463.00 s) 2023-07-14T13:05:01.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:01 smithi131 ceph-mon[96953]: pgmap v161: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 31 MiB/s wr, 77 op/s 2023-07-14T13:05:02.768 INFO:teuthology.orchestra.run.smithi017.stderr:19400000 of 50000000 tuples (38%) done (elapsed 292.37 s, remaining 461.16 s) 2023-07-14T13:05:03.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:03 smithi017 ceph-mon[95536]: pgmap v162: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 59 op/s 2023-07-14T13:05:03.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:03 smithi135 ceph-mon[97338]: pgmap v162: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 59 op/s 2023-07-14T13:05:03.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:03 smithi131 ceph-mon[96953]: pgmap v162: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 59 op/s 2023-07-14T13:05:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:19500000 of 50000000 tuples (39%) done (elapsed 293.76 s, remaining 459.48 s) 2023-07-14T13:05:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.170+0000 7f740fbff700 1 -- 172.21.15.17:0/3312633213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7408105b10 msgr2=0x7f7408105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.170+0000 7f740fbff700 1 --2- 172.21.15.17:0/3312633213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7408105b10 0x7f7408105ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7404009990 tx=0x7f7404009ca0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.170+0000 7f740fbff700 1 -- 172.21.15.17:0/3312633213 shutdown_connections 2023-07-14T13:05:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.170+0000 7f740fbff700 1 --2- 172.21.15.17:0/3312633213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74081004b0 0x7f740810c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.170+0000 7f740fbff700 1 --2- 172.21.15.17:0/3312633213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7408105b10 0x7f7408105ee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.170+0000 7f740fbff700 1 --2- 172.21.15.17:0/3312633213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74080ffb00 0x7f74080fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.170+0000 7f740fbff700 1 -- 172.21.15.17:0/3312633213 >> 172.21.15.17:0/3312633213 conn(0x7f74080fb600 msgr2=0x7f74080fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.170+0000 7f740fbff700 1 -- 172.21.15.17:0/3312633213 shutdown_connections 2023-07-14T13:05:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.170+0000 7f740fbff700 1 -- 172.21.15.17:0/3312633213 wait complete. 2023-07-14T13:05:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.171+0000 7f740fbff700 1 Processor -- start 2023-07-14T13:05:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.172+0000 7f740fbff700 1 -- start start 2023-07-14T13:05:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.172+0000 7f740fbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74080ffb00 0x7f7408197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.172+0000 7f740fbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74081004b0 0x7f74081982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.172+0000 7f740fbff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7408105b10 0x7f740819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.172+0000 7f740fbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740819cf50 con 0x7f74081004b0 2023-07-14T13:05:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.172+0000 7f740fbff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740819d0c0 con 0x7f7408105b10 2023-07-14T13:05:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.172+0000 7f740fbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740819d280 con 0x7f74080ffb00 2023-07-14T13:05:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740d99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74080ffb00 0x7f7408197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740d19a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74081004b0 0x7f74081982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740d99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74080ffb00 0x7f7408197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37686/0 (socket says 172.21.15.17:37686) 2023-07-14T13:05:05.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740d99b700 1 -- 172.21.15.17:0/1431898963 learned_addr learned my addr 172.21.15.17:0/1431898963 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:05.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740e19c700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7408105b10 0x7f740819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740d99b700 1 -- 172.21.15.17:0/1431898963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7408105b10 msgr2=0x7f740819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:05.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740d99b700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7408105b10 0x7f740819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740d99b700 1 -- 172.21.15.17:0/1431898963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74081004b0 msgr2=0x7f74081982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740d99b700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74081004b0 0x7f74081982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740d99b700 1 -- 172.21.15.17:0/1431898963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8009520 con 0x7f74080ffb00 2023-07-14T13:05:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740d19a700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74081004b0 0x7f74081982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.173+0000 7f740d99b700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74080ffb00 0x7f7408197d60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7404005740 tx=0x7f7404005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.174+0000 7f73feffd700 1 -- 172.21.15.17:0/1431898963 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740401d070 con 0x7f74080ffb00 2023-07-14T13:05:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.174+0000 7f740fbff700 1 -- 172.21.15.17:0/1431898963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7400009c40 con 0x7f74080ffb00 2023-07-14T13:05:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.174+0000 7f73feffd700 1 -- 172.21.15.17:0/1431898963 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7404022470 con 0x7f74080ffb00 2023-07-14T13:05:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.174+0000 7f73feffd700 1 -- 172.21.15.17:0/1431898963 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404017650 con 0x7f74080ffb00 2023-07-14T13:05:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.174+0000 7f740fbff700 1 -- 172.21.15.17:0/1431898963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74040095f0 con 0x7f74080ffb00 2023-07-14T13:05:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.178+0000 7f73feffd700 1 -- 172.21.15.17:0/1431898963 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f740400fb00 con 0x7f74080ffb00 2023-07-14T13:05:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.179+0000 7f7423472b80 1 Processor -- start 2023-07-14T13:05:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.179+0000 7f7423472b80 1 -- start start 2023-07-14T13:05:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f73feffd700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f73f40a1340 0x7f73f40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f7423472b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 0x564e32251d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f7423472b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e3224c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f7423472b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 0x564e3224c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f7423472b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e32151c50 con 0x564e3224c580 2023-07-14T13:05:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f7423472b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e321a49e0 con 0x564e322522d0 2023-07-14T13:05:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f7423472b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e3219de70 con 0x564e320a86b0 2023-07-14T13:05:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f73feffd700 1 -- 172.21.15.17:0/1431898963 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f74040ce0e0 con 0x7f74080ffb00 2023-07-14T13:05:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f740d99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 0x564e32251d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f740d99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 0x564e32251d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37702/0 (socket says 172.21.15.17:37702) 2023-07-14T13:05:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f740d99b700 1 -- 172.21.15.17:0/434064615 learned_addr learned my addr 172.21.15.17:0/434064615 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f740e19c700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f73f40a1340 0x7f73f40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f740d19a700 1 --2- 172.21.15.17:0/434064615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e3224c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.180+0000 7f740e19c700 1 --2- 172.21.15.17:0/434064615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 0x564e3224c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.181+0000 7f740d99b700 1 -- 172.21.15.17:0/434064615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 msgr2=0x564e3224c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:05.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.181+0000 7f740d99b700 1 --2- 172.21.15.17:0/434064615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e3224c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.181+0000 7f740d99b700 1 -- 172.21.15.17:0/434064615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 msgr2=0x564e3224c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.181+0000 7f740d99b700 1 --2- 172.21.15.17:0/434064615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 0x564e3224c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.181+0000 7f740d99b700 1 -- 172.21.15.17:0/434064615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e31fcbd80 con 0x564e320a86b0 2023-07-14T13:05:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.181+0000 7f740d19a700 1 --2- 172.21.15.17:0/434064615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e3224c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.181+0000 7f740d99b700 1 --2- 172.21.15.17:0/434064615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 0x564e32251d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7404008000 tx=0x7f7404005910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0b28a02d03ee4d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.181+0000 7f73f3fff700 1 -- 172.21.15.17:0/434064615 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740409ad90 con 0x564e320a86b0 2023-07-14T13:05:05.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.181+0000 7f73f3fff700 1 -- 172.21.15.17:0/434064615 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f740409abb0 con 0x564e320a86b0 2023-07-14T13:05:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.181+0000 7f73f3fff700 1 -- 172.21.15.17:0/434064615 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740409f280 con 0x564e320a86b0 2023-07-14T13:05:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.182+0000 7f740e19c700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f73f40a1340 0x7f73f40a37f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7400009550 tx=0x7f7400009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.182+0000 7f7423472b80 1 -- 172.21.15.17:0/434064615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 msgr2=0x564e32251d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.182+0000 7f7423472b80 1 --2- 172.21.15.17:0/434064615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 0x564e32251d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7404008000 tx=0x7f7404005910 comp rx=0 tx=0).stop 2023-07-14T13:05:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.182+0000 7f7423472b80 1 -- 172.21.15.17:0/434064615 shutdown_connections 2023-07-14T13:05:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.182+0000 7f7423472b80 1 --2- 172.21.15.17:0/434064615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 0x564e3224c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.182+0000 7f7423472b80 1 --2- 172.21.15.17:0/434064615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 0x564e32251d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.182+0000 7f7423472b80 1 --2- 172.21.15.17:0/434064615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e3224c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.182+0000 7f7423472b80 1 -- 172.21.15.17:0/434064615 >> 172.21.15.17:0/434064615 conn(0x564e32241be0 msgr2=0x564e32246f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.182+0000 7f7423472b80 1 -- 172.21.15.17:0/434064615 shutdown_connections 2023-07-14T13:05:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.182+0000 7f7423472b80 1 -- 172.21.15.17:0/434064615 wait complete. 2023-07-14T13:05:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.183+0000 7f7423472b80 1 -- start start 2023-07-14T13:05:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.183+0000 7f7423472b80 1 Processor -- start 2023-07-14T13:05:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f7423472b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e320a86b0 0x564e32263b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f7423472b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3224c580 0x564e322640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f7423472b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e3225ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f7423472b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e3213da60 con 0x564e320a86b0 2023-07-14T13:05:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f7423472b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e3213d760 con 0x564e322522d0 2023-07-14T13:05:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f7423472b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e320218c0 con 0x564e3224c580 2023-07-14T13:05:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f7423472b80 10 client.0 _ll_register_callbacks cb 0x564e3213b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f740d99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e320a86b0 0x564e32263b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f740d19a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3224c580 0x564e322640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f740d99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e320a86b0 0x564e32263b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41974/0 (socket says 172.21.15.17:41974) 2023-07-14T13:05:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f740d99b700 1 -- 172.21.15.17:0/1009510918 learned_addr learned my addr 172.21.15.17:0/1009510918 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f740e19c700 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e3225ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f740d99b700 1 -- 172.21.15.17:0/1009510918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3224c580 msgr2=0x564e322640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f740d99b700 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3224c580 0x564e322640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f740d99b700 1 -- 172.21.15.17:0/1009510918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 msgr2=0x564e3225ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.184+0000 7f740d99b700 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e3225ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.185+0000 7f740d99b700 1 -- 172.21.15.17:0/1009510918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f8009e20 con 0x564e320a86b0 2023-07-14T13:05:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.185+0000 7f740e19c700 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e3225ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.185+0000 7f740d99b700 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e320a86b0 0x564e32263b70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f740409b1e0 tx=0x7f740401be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b141a261d3def3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.185+0000 7f73f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:05:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.185+0000 7f73f17fa700 1 -- 172.21.15.17:0/1009510918 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740401b0c0 con 0x564e320a86b0 2023-07-14T13:05:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.185+0000 7f73f17fa700 1 -- 172.21.15.17:0/1009510918 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f74040a1110 con 0x564e320a86b0 2023-07-14T13:05:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.185+0000 7f7423472b80 1 -- 172.21.15.17:0/1009510918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e320f7490 con 0x564e320a86b0 2023-07-14T13:05:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.185+0000 7f73f17fa700 1 -- 172.21.15.17:0/1009510918 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f740409f070 con 0x564e320a86b0 2023-07-14T13:05:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.185+0000 7f7423472b80 10 client.16827 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.185+0000 7f7423472b80 1 -- 172.21.15.17:0/1009510918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f74040095f0 con 0x564e320a86b0 2023-07-14T13:05:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.186+0000 7f73f17fa700 1 -- 172.21.15.17:0/1009510918 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74040c9080 con 0x564e320a86b0 2023-07-14T13:05:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.186+0000 7f73f17fa700 1 -- 172.21.15.17:0/1009510918 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f740409a740 con 0x564e320a86b0 2023-07-14T13:05:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.186+0000 7f7423472b80 10 client.16827 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.186+0000 7f7423472b80 10 client.16827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.186+0000 7f7423472b80 20 client.16827 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:05.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.186+0000 7f7423472b80 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564e3226daf0 0x564e3226fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.186+0000 7f7423472b80 4 client.16827 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:05:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.186+0000 7f7423472b80 1 -- 172.21.15.17:0/1009510918 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e32196e50 con 0x564e3226daf0 2023-07-14T13:05:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.186+0000 7f740d19a700 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564e3226daf0 0x564e3226fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.187+0000 7f740d19a700 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564e3226daf0 0x564e3226fed0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ff8350e60e67632 server_cookie=b4b186e2135969dd in_seq=0 out_seq=0 2023-07-14T13:05:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.187+0000 7f73f17fa700 10 client.16827 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.187+0000 7f73f17fa700 1 -- 172.21.15.17:0/1009510918 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564e32196e50 con 0x564e3226daf0 2023-07-14T13:05:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f73f17fa700 10 client.16827 handle_command_reply: tid=0 2023-07-14T13:05:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 1 client.16827 shutdown 2023-07-14T13:05:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 1 -- 172.21.15.17:0/1009510918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e320a86b0 msgr2=0x564e32263b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e320a86b0 0x564e32263b70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f740409b1e0 tx=0x7f740401be30 comp rx=0 tx=0).stop 2023-07-14T13:05:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 1 -- 172.21.15.17:0/1009510918 shutdown_connections 2023-07-14T13:05:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564e3226daf0 0x564e3226fed0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e3225ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e320a86b0 0x564e32263b70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 1 --2- 172.21.15.17:0/1009510918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3224c580 0x564e322640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f73f17fa700 0 client.16827 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 1 -- 172.21.15.17:0/1009510918 >> 172.21.15.17:0/1009510918 conn(0x564e32241be0 msgr2=0x564e322464e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 1 -- 172.21.15.17:0/1009510918 shutdown_connections 2023-07-14T13:05:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 1 -- 172.21.15.17:0/1009510918 wait complete. 2023-07-14T13:05:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.188+0000 7f7423472b80 20 client.16827 trim_cache size 0 max 16384 2023-07-14T13:05:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.208+0000 7f7423472b80 1 Processor -- start 2023-07-14T13:05:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.208+0000 7f7423472b80 1 -- start start 2023-07-14T13:05:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.208+0000 7f7423472b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e320a86b0 0x564e3224c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.208+0000 7f7423472b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3224c580 0x564e3225def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.208+0000 7f7423472b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e322522d0 0x564e3225b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.208+0000 7f7423472b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e32250540 con 0x564e322522d0 2023-07-14T13:05:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.208+0000 7f7423472b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e3225bd60 con 0x564e320a86b0 2023-07-14T13:05:05.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.208+0000 7f7423472b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e3223eb40 con 0x564e3224c580 2023-07-14T13:05:05.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e322522d0 0x564e3225b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740d99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e320a86b0 0x564e3224c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740d19a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3224c580 0x564e3225def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740e19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e322522d0 0x564e3225b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41986/0 (socket says 172.21.15.17:41986) 2023-07-14T13:05:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740d99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e320a86b0 0x564e3224c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57338/0 (socket says 172.21.15.17:57338) 2023-07-14T13:05:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740e19c700 1 -- 172.21.15.17:0/1835558264 learned_addr learned my addr 172.21.15.17:0/1835558264 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740d19a700 1 -- 172.21.15.17:0/1835558264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e320a86b0 msgr2=0x564e3224c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740d19a700 1 --2- 172.21.15.17:0/1835558264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e320a86b0 0x564e3224c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740d19a700 1 -- 172.21.15.17:0/1835558264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e322522d0 msgr2=0x564e3225b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740d19a700 1 --2- 172.21.15.17:0/1835558264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e322522d0 0x564e3225b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740d19a700 1 -- 172.21.15.17:0/1835558264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e31fb4c00 con 0x564e3224c580 2023-07-14T13:05:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.209+0000 7f740d19a700 1 --2- 172.21.15.17:0/1835558264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3224c580 0x564e3225def0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x564e322707e0 tx=0x7f73f8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e904a522bbf1af2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f73fcbff700 1 -- 172.21.15.17:0/1835558264 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8017070 con 0x564e3224c580 2023-07-14T13:05:05.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f73fcbff700 1 -- 172.21.15.17:0/1835558264 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73f8018040 con 0x564e3224c580 2023-07-14T13:05:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f73fcbff700 1 -- 172.21.15.17:0/1835558264 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8021590 con 0x564e3224c580 2023-07-14T13:05:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f7423472b80 1 -- 172.21.15.17:0/1835558264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3224c580 msgr2=0x564e3225def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f7423472b80 1 --2- 172.21.15.17:0/1835558264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3224c580 0x564e3225def0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x564e322707e0 tx=0x7f73f8009260 comp rx=0 tx=0).stop 2023-07-14T13:05:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f7423472b80 1 -- 172.21.15.17:0/1835558264 shutdown_connections 2023-07-14T13:05:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f7423472b80 1 --2- 172.21.15.17:0/1835558264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e322522d0 0x564e3225b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f7423472b80 1 --2- 172.21.15.17:0/1835558264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e320a86b0 0x564e3224c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f7423472b80 1 --2- 172.21.15.17:0/1835558264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3224c580 0x564e3225def0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f7423472b80 1 -- 172.21.15.17:0/1835558264 >> 172.21.15.17:0/1835558264 conn(0x564e32241be0 msgr2=0x564e3225b110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f7423472b80 1 -- 172.21.15.17:0/1835558264 shutdown_connections 2023-07-14T13:05:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.210+0000 7f7423472b80 1 -- 172.21.15.17:0/1835558264 wait complete. 2023-07-14T13:05:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.211+0000 7f7423472b80 1 -- start start 2023-07-14T13:05:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.211+0000 7f7423472b80 1 Processor -- start 2023-07-14T13:05:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f7423472b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 0x564e32263cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f7423472b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 0x564e32261fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f7423472b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e322624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f7423472b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e32262a30 con 0x564e3224c580 2023-07-14T13:05:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f7423472b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e32262ba0 con 0x564e322522d0 2023-07-14T13:05:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f7423472b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e32262d60 con 0x564e320a86b0 2023-07-14T13:05:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f7423472b80 10 client.0 _ll_register_callbacks cb 0x7f7400008510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f740d19a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 0x564e32261fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f740d99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 0x564e32263cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f740d19a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 0x564e32261fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41998/0 (socket says 172.21.15.17:41998) 2023-07-14T13:05:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f740d19a700 1 -- 172.21.15.17:0/2503573624 learned_addr learned my addr 172.21.15.17:0/2503573624 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f740e19c700 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e322624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f740d99b700 1 -- 172.21.15.17:0/2503573624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 msgr2=0x564e322624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f740d99b700 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e322624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f740d99b700 1 -- 172.21.15.17:0/2503573624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 msgr2=0x564e32261fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f740d99b700 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 0x564e32261fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f740d99b700 1 -- 172.21.15.17:0/2503573624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f8012ab0 con 0x564e320a86b0 2023-07-14T13:05:05.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.212+0000 7f740d19a700 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 0x564e32261fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:05.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.213+0000 7f740d99b700 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 0x564e32263cc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7404005f50 tx=0x7f740409ae50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d4663429b26fb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:05.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.213+0000 7f73f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:05:05.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.213+0000 7f73f17fa700 1 -- 172.21.15.17:0/2503573624 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74040a3380 con 0x564e320a86b0 2023-07-14T13:05:05.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.213+0000 7f73f17fa700 1 -- 172.21.15.17:0/2503573624 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f74040a1110 con 0x564e320a86b0 2023-07-14T13:05:05.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.213+0000 7f7423472b80 1 -- 172.21.15.17:0/2503573624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f740409abb0 con 0x564e320a86b0 2023-07-14T13:05:05.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.213+0000 7f73f17fa700 1 -- 172.21.15.17:0/2503573624 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7404097590 con 0x564e320a86b0 2023-07-14T13:05:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.213+0000 7f7423472b80 10 client.26524 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.213+0000 7f7423472b80 1 -- 172.21.15.17:0/2503573624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564e31ff21f0 con 0x564e320a86b0 2023-07-14T13:05:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.213+0000 7f73f17fa700 1 -- 172.21.15.17:0/2503573624 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f740409abb0 con 0x564e320a86b0 2023-07-14T13:05:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.214+0000 7f73f17fa700 1 -- 172.21.15.17:0/2503573624 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f74040b3ba0 con 0x564e320a86b0 2023-07-14T13:05:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.214+0000 7f7423472b80 10 client.26524 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.214+0000 7f7423472b80 10 client.26524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.214+0000 7f7423472b80 20 client.26524 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.214+0000 7f7423472b80 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564e322c2930 0x564e322c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.214+0000 7f7423472b80 4 client.26524 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:05:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.214+0000 7f7423472b80 1 -- 172.21.15.17:0/2503573624 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564e32158ff0 con 0x564e322c2930 2023-07-14T13:05:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.214+0000 7f740d19a700 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564e322c2930 0x564e322c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.215+0000 7f740d19a700 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564e322c2930 0x564e322c4d10 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10b5a7aac94f4b39 server_cookie=68104fefeda09e5d in_seq=0 out_seq=0 2023-07-14T13:05:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.215+0000 7f73f17fa700 10 client.26524 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.230+0000 7f73f17fa700 1 -- 172.21.15.17:0/2503573624 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564e32158ff0 con 0x564e322c2930 2023-07-14T13:05:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.230+0000 7f73f17fa700 10 client.26524 handle_command_reply: tid=0 2023-07-14T13:05:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.230+0000 7f7423472b80 1 client.26524 shutdown 2023-07-14T13:05:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f7423472b80 1 -- 172.21.15.17:0/2503573624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 msgr2=0x564e32263cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f7423472b80 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 0x564e32263cc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7404005f50 tx=0x7f740409ae50 comp rx=0 tx=0).stop 2023-07-14T13:05:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f7423472b80 1 -- 172.21.15.17:0/2503573624 shutdown_connections 2023-07-14T13:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f7423472b80 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564e322c2930 0x564e322c4d10 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f7423472b80 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564e322522d0 0x564e322624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f7423472b80 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e320a86b0 0x564e32263cc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f73f17fa700 0 client.26524 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f7423472b80 1 --2- 172.21.15.17:0/2503573624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564e3224c580 0x564e32261fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f7423472b80 1 -- 172.21.15.17:0/2503573624 >> 172.21.15.17:0/2503573624 conn(0x564e32241be0 msgr2=0x564e322511e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f7423472b80 1 -- 172.21.15.17:0/2503573624 shutdown_connections 2023-07-14T13:05:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f7423472b80 1 -- 172.21.15.17:0/2503573624 wait complete. 2023-07-14T13:05:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.231+0000 7f7423472b80 20 client.26524 trim_cache size 0 max 16384 2023-07-14T13:05:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:05:05.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:05:05.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:05:05.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:05:05.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 -- 172.21.15.17:0/1431898963 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f73f40a1340 msgr2=0x7f73f40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:05.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f73f40a1340 0x7f73f40a37f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7400009550 tx=0x7f7400009920 comp rx=0 tx=0).stop 2023-07-14T13:05:05.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 -- 172.21.15.17:0/1431898963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74080ffb00 msgr2=0x7f7408197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:05.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74080ffb00 0x7f7408197d60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7404005740 tx=0x7f7404005770 comp rx=0 tx=0).stop 2023-07-14T13:05:05.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 -- 172.21.15.17:0/1431898963 shutdown_connections 2023-07-14T13:05:05.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f73f40a1340 0x7f73f40a37f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7408105b10 0x7f740819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74080ffb00 0x7f7408197d60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 --2- 172.21.15.17:0/1431898963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74081004b0 0x7f74081982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 -- 172.21.15.17:0/1431898963 >> 172.21.15.17:0/1431898963 conn(0x7f74080fb600 msgr2=0x7f740810aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 -- 172.21.15.17:0/1431898963 shutdown_connections 2023-07-14T13:05:05.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:05.232+0000 7f740fbff700 1 -- 172.21.15.17:0/1431898963 wait complete. 2023-07-14T13:05:05.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:05 smithi017 ceph-mon[95536]: pgmap v163: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 59 op/s 2023-07-14T13:05:05.445 INFO:teuthology.orchestra.run.smithi017.stderr:19600000 of 50000000 tuples (39%) done (elapsed 295.05 s, remaining 457.62 s) 2023-07-14T13:05:05.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:05 smithi135 ceph-mon[97338]: pgmap v163: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 59 op/s 2023-07-14T13:05:05.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:05 smithi131 ceph-mon[96953]: pgmap v163: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 59 op/s 2023-07-14T13:05:06.774 INFO:teuthology.orchestra.run.smithi017.stderr:19700000 of 50000000 tuples (39%) done (elapsed 296.38 s, remaining 455.85 s) 2023-07-14T13:05:07.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:07 smithi017 ceph-mon[95536]: pgmap v164: 97 pgs: 97 active+clean; 4.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 33 MiB/s wr, 81 op/s 2023-07-14T13:05:07.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:07 smithi135 ceph-mon[97338]: pgmap v164: 97 pgs: 97 active+clean; 4.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 33 MiB/s wr, 81 op/s 2023-07-14T13:05:07.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:07 smithi131 ceph-mon[96953]: pgmap v164: 97 pgs: 97 active+clean; 4.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 33 MiB/s wr, 81 op/s 2023-07-14T13:05:08.183 INFO:teuthology.orchestra.run.smithi017.stderr:19800000 of 50000000 tuples (39%) done (elapsed 297.79 s, remaining 454.20 s) 2023-07-14T13:05:09.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:09 smithi017 ceph-mon[95536]: pgmap v165: 97 pgs: 97 active+clean; 4.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 22 MiB/s wr, 58 op/s 2023-07-14T13:05:09.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:09 smithi135 ceph-mon[97338]: pgmap v165: 97 pgs: 97 active+clean; 4.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 22 MiB/s wr, 58 op/s 2023-07-14T13:05:09.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:09 smithi131 ceph-mon[96953]: pgmap v165: 97 pgs: 97 active+clean; 4.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 22 MiB/s wr, 58 op/s 2023-07-14T13:05:09.507 INFO:teuthology.orchestra.run.smithi017.stderr:19900000 of 50000000 tuples (39%) done (elapsed 299.11 s, remaining 452.42 s) 2023-07-14T13:05:10.857 INFO:teuthology.orchestra.run.smithi017.stderr:20000000 of 50000000 tuples (40%) done (elapsed 300.46 s, remaining 450.69 s) 2023-07-14T13:05:11.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:11 smithi017 ceph-mon[95536]: pgmap v166: 97 pgs: 97 active+clean; 4.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:05:11.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:11 smithi135 ceph-mon[97338]: pgmap v166: 97 pgs: 97 active+clean; 4.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:05:11.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:11 smithi131 ceph-mon[96953]: pgmap v166: 97 pgs: 97 active+clean; 4.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:05:12.261 INFO:teuthology.orchestra.run.smithi017.stderr:20100000 of 50000000 tuples (40%) done (elapsed 301.86 s, remaining 449.04 s) 2023-07-14T13:05:13.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:13 smithi017 ceph-mon[95536]: pgmap v167: 97 pgs: 97 active+clean; 4.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 55 op/s 2023-07-14T13:05:13.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:13 smithi135 ceph-mon[97338]: pgmap v167: 97 pgs: 97 active+clean; 4.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 55 op/s 2023-07-14T13:05:13.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:13 smithi131 ceph-mon[96953]: pgmap v167: 97 pgs: 97 active+clean; 4.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 55 op/s 2023-07-14T13:05:13.565 INFO:teuthology.orchestra.run.smithi017.stderr:20200000 of 50000000 tuples (40%) done (elapsed 303.17 s, remaining 447.25 s) 2023-07-14T13:05:15.025 INFO:teuthology.orchestra.run.smithi017.stderr:20300000 of 50000000 tuples (40%) done (elapsed 304.63 s, remaining 445.69 s) 2023-07-14T13:05:15.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:15 smithi017 ceph-mon[95536]: pgmap v168: 97 pgs: 97 active+clean; 4.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 55 op/s 2023-07-14T13:05:15.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:15 smithi135 ceph-mon[97338]: pgmap v168: 97 pgs: 97 active+clean; 4.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 55 op/s 2023-07-14T13:05:15.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:15 smithi131 ceph-mon[96953]: pgmap v168: 97 pgs: 97 active+clean; 4.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 55 op/s 2023-07-14T13:05:16.348 INFO:teuthology.orchestra.run.smithi017.stderr:20400000 of 50000000 tuples (40%) done (elapsed 305.95 s, remaining 443.93 s) 2023-07-14T13:05:17.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:17 smithi017 ceph-mon[95536]: pgmap v169: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:05:17.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:17 smithi135 ceph-mon[97338]: pgmap v169: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:05:17.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:17 smithi131 ceph-mon[96953]: pgmap v169: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:05:17.760 INFO:teuthology.orchestra.run.smithi017.stderr:20500000 of 50000000 tuples (41%) done (elapsed 307.36 s, remaining 442.30 s) 2023-07-14T13:05:18.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.417+0000 7f8cce99d700 1 -- 172.21.15.17:0/1979462821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81014a0 msgr2=0x7f8cc8101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:18.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.417+0000 7f8cce99d700 1 --2- 172.21.15.17:0/1979462821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81014a0 0x7f8cc8101910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8009990 tx=0x7f8cb8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.417+0000 7f8cce99d700 1 -- 172.21.15.17:0/1979462821 shutdown_connections 2023-07-14T13:05:18.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.417+0000 7f8cce99d700 1 --2- 172.21.15.17:0/1979462821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8101e50 0x7f8cc810c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.417+0000 7f8cce99d700 1 --2- 172.21.15.17:0/1979462821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc80ffd20 0x7f8cc81000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.417+0000 7f8cce99d700 1 --2- 172.21.15.17:0/1979462821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81014a0 0x7f8cc8101910 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.417+0000 7f8cce99d700 1 -- 172.21.15.17:0/1979462821 >> 172.21.15.17:0/1979462821 conn(0x7f8cc80fb440 msgr2=0x7f8cc80fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:18.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.417+0000 7f8cce99d700 1 -- 172.21.15.17:0/1979462821 shutdown_connections 2023-07-14T13:05:18.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.417+0000 7f8cce99d700 1 -- 172.21.15.17:0/1979462821 wait complete. 2023-07-14T13:05:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.418+0000 7f8cce99d700 1 Processor -- start 2023-07-14T13:05:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.418+0000 7f8cce99d700 1 -- start start 2023-07-14T13:05:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8cce99d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc80ffd20 0x7f8cc819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8cce99d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81014a0 0x7f8cc819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8cce99d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8101e50 0x7f8cc81958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8cce99d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc8196080 con 0x7f8cc80ffd20 2023-07-14T13:05:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8cce99d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc81961f0 con 0x7f8cc8101e50 2023-07-14T13:05:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8cce99d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc81963b0 con 0x7f8cc81014a0 2023-07-14T13:05:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8ccd99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc80ffd20 0x7f8cc819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8ccd19a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81014a0 0x7f8cc819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8ccd99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc80ffd20 0x7f8cc819b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44112/0 (socket says 172.21.15.17:44112) 2023-07-14T13:05:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8ccd99b700 1 -- 172.21.15.17:0/2937711288 learned_addr learned my addr 172.21.15.17:0/2937711288 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8cce19c700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8101e50 0x7f8cc81958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8ccd19a700 1 -- 172.21.15.17:0/2937711288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8101e50 msgr2=0x7f8cc81958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8101e50 0x7f8cc81958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8ccd19a700 1 -- 172.21.15.17:0/2937711288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc80ffd20 msgr2=0x7f8cc819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc80ffd20 0x7f8cc819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8ccd19a700 1 -- 172.21.15.17:0/2937711288 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc4009520 con 0x7f8cc81014a0 2023-07-14T13:05:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.419+0000 7f8ccd99b700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc80ffd20 0x7f8cc819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.420+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81014a0 0x7f8cc819be10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80098e0 tx=0x7f8cb8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.420+0000 7f8cbeffd700 1 -- 172.21.15.17:0/2937711288 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb801d070 con 0x7f8cc81014a0 2023-07-14T13:05:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.420+0000 7f8cce99d700 1 -- 172.21.15.17:0/2937711288 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb80095f0 con 0x7f8cc81014a0 2023-07-14T13:05:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.420+0000 7f8cbeffd700 1 -- 172.21.15.17:0/2937711288 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cb8022470 con 0x7f8cc81014a0 2023-07-14T13:05:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.420+0000 7f8cbeffd700 1 -- 172.21.15.17:0/2937711288 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8017650 con 0x7f8cc81014a0 2023-07-14T13:05:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.420+0000 7f8cce99d700 1 -- 172.21.15.17:0/2937711288 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc81a2850 con 0x7f8cc81014a0 2023-07-14T13:05:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.425+0000 7f8cbeffd700 1 -- 172.21.15.17:0/2937711288 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8cb80225e0 con 0x7f8cc81014a0 2023-07-14T13:05:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.426+0000 7f8ce360fb80 1 Processor -- start 2023-07-14T13:05:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.426+0000 7f8ce360fb80 1 -- start start 2023-07-14T13:05:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f2e06b0 0x56285f489f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f4841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f484700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f389c50 con 0x56285f2e06b0 2023-07-14T13:05:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f3dc9e0 con 0x56285f48a8c0 2023-07-14T13:05:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f3d5e70 con 0x56285f48a470 2023-07-14T13:05:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8cbeffd700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb40a12c0 0x7f8cb40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8ccd99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f4841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8cbeffd700 1 -- 172.21.15.17:0/2937711288 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f8cb80cdff0 con 0x7f8cc81014a0 2023-07-14T13:05:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8ccd99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f4841a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58024/0 (socket says 172.21.15.17:58024) 2023-07-14T13:05:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8ccd99b700 1 -- 172.21.15.17:0/3182218294 learned_addr learned my addr 172.21.15.17:0/3182218294 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8cce19c700 1 --2- 172.21.15.17:0/3182218294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f2e06b0 0x56285f489f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.427+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/3182218294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f484700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.428+0000 7f8ccd99b700 1 -- 172.21.15.17:0/3182218294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 msgr2=0x56285f484700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.428+0000 7f8ccd99b700 1 --2- 172.21.15.17:0/3182218294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f484700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.428+0000 7f8ccd99b700 1 -- 172.21.15.17:0/3182218294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f2e06b0 msgr2=0x56285f489f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.428+0000 7f8cce19c700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb40a12c0 0x7f8cb40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.428+0000 7f8ccd99b700 1 --2- 172.21.15.17:0/3182218294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f2e06b0 0x56285f489f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.428+0000 7f8ccd99b700 1 -- 172.21.15.17:0/3182218294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56285f203d80 con 0x56285f48a470 2023-07-14T13:05:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.428+0000 7f8ccd99b700 1 --2- 172.21.15.17:0/3182218294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f4841a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4011840 tx=0x7f8cc4011b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1f86ac19073aac5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.428+0000 7f8cb3fff700 1 -- 172.21.15.17:0/3182218294 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4011030 con 0x56285f48a470 2023-07-14T13:05:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.428+0000 7f8cb3fff700 1 -- 172.21.15.17:0/3182218294 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cc4011190 con 0x56285f48a470 2023-07-14T13:05:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.428+0000 7f8cb3fff700 1 -- 172.21.15.17:0/3182218294 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4010890 con 0x56285f48a470 2023-07-14T13:05:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.429+0000 7f8ce360fb80 1 -- 172.21.15.17:0/3182218294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 msgr2=0x56285f4841a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.429+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/3182218294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f4841a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4011840 tx=0x7f8cc4011b50 comp rx=0 tx=0).stop 2023-07-14T13:05:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.429+0000 7f8cce19c700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb40a12c0 0x7f8cb40a3770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009ec0 tx=0x7f8cc000b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.429+0000 7f8ce360fb80 1 -- 172.21.15.17:0/3182218294 shutdown_connections 2023-07-14T13:05:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.429+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/3182218294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f484700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.429+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/3182218294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f2e06b0 0x56285f489f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.429+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/3182218294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f4841a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.429+0000 7f8ce360fb80 1 -- 172.21.15.17:0/3182218294 >> 172.21.15.17:0/3182218294 conn(0x56285f479d40 msgr2=0x56285f47f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.429+0000 7f8ce360fb80 1 -- 172.21.15.17:0/3182218294 shutdown_connections 2023-07-14T13:05:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.429+0000 7f8ce360fb80 1 -- 172.21.15.17:0/3182218294 wait complete. 2023-07-14T13:05:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.430+0000 7f8ce360fb80 1 -- start start 2023-07-14T13:05:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.430+0000 7f8ce360fb80 1 Processor -- start 2023-07-14T13:05:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f48dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 0x56285f48e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f48e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f375a60 con 0x56285f48a470 2023-07-14T13:05:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f375760 con 0x56285f48a8c0 2023-07-14T13:05:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f2598c0 con 0x56285f2e06b0 2023-07-14T13:05:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8ce360fb80 10 client.0 _ll_register_callbacks cb 0x56285f373700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8ccd99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f48dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8ccd19a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 0x56285f48e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8ccd99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f48dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58032/0 (socket says 172.21.15.17:58032) 2023-07-14T13:05:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8ccd99b700 1 -- 172.21.15.17:0/582637311 learned_addr learned my addr 172.21.15.17:0/582637311 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.431+0000 7f8cce19c700 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f48e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.432+0000 7f8ccd99b700 1 -- 172.21.15.17:0/582637311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 msgr2=0x56285f48e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.432+0000 7f8ccd99b700 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f48e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.432+0000 7f8ccd99b700 1 -- 172.21.15.17:0/582637311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 msgr2=0x56285f48e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.432+0000 7f8ccd99b700 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 0x56285f48e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.432+0000 7f8ccd99b700 1 -- 172.21.15.17:0/582637311 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc40114a0 con 0x56285f2e06b0 2023-07-14T13:05:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.432+0000 7f8ccd99b700 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f48dae0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4005d60 tx=0x7f8cc400fce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea62e0d459a8915 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.432+0000 7f8cb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:05:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.432+0000 7f8cb17fa700 1 -- 172.21.15.17:0/582637311 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4011300 con 0x56285f2e06b0 2023-07-14T13:05:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.432+0000 7f8cb17fa700 1 -- 172.21.15.17:0/582637311 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f8cc4004240 con 0x56285f2e06b0 2023-07-14T13:05:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.432+0000 7f8ce360fb80 1 -- 172.21.15.17:0/582637311 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56285f32f490 con 0x56285f2e06b0 2023-07-14T13:05:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.433+0000 7f8cb17fa700 1 -- 172.21.15.17:0/582637311 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cc4004400 con 0x56285f2e06b0 2023-07-14T13:05:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.433+0000 7f8ce360fb80 10 client.26536 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.433+0000 7f8ce360fb80 1 -- 172.21.15.17:0/582637311 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56285f1ecc00 con 0x56285f2e06b0 2023-07-14T13:05:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.433+0000 7f8cb17fa700 1 -- 172.21.15.17:0/582637311 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56285f32f490 con 0x56285f2e06b0 2023-07-14T13:05:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.433+0000 7f8cb17fa700 1 -- 172.21.15.17:0/582637311 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8cc4019410 con 0x56285f2e06b0 2023-07-14T13:05:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.433+0000 7f8ce360fb80 10 client.26536 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.433+0000 7f8ce360fb80 10 client.26536 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.433+0000 7f8ce360fb80 20 client.26536 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.433+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56285f4a2070 0x56285f4a4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.433+0000 7f8ce360fb80 4 client.26536 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:05:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.433+0000 7f8ce360fb80 1 -- 172.21.15.17:0/582637311 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56285f3cee50 con 0x56285f4a2070 2023-07-14T13:05:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.434+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56285f4a2070 0x56285f4a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.434+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56285f4a2070 0x56285f4a4450 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b64dfdf89ba800b server_cookie=ddbdc019322a07d0 in_seq=0 out_seq=0 2023-07-14T13:05:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.434+0000 7f8cb17fa700 10 client.26536 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.435+0000 7f8cb17fa700 1 -- 172.21.15.17:0/582637311 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56285f3cee50 con 0x56285f4a2070 2023-07-14T13:05:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.435+0000 7f8cb17fa700 10 client.26536 handle_command_reply: tid=0 2023-07-14T13:05:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.435+0000 7f8ce360fb80 1 client.26536 shutdown 2023-07-14T13:05:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.435+0000 7f8ce360fb80 1 -- 172.21.15.17:0/582637311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 msgr2=0x56285f48dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.435+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f48dae0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4005d60 tx=0x7f8cc400fce0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.435+0000 7f8ce360fb80 1 -- 172.21.15.17:0/582637311 shutdown_connections 2023-07-14T13:05:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.435+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56285f4a2070 0x56285f4a4450 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.435+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f48e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.436+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f48dae0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.436+0000 7f8cb17fa700 0 client.26536 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.436+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/582637311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 0x56285f48e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.436+0000 7f8ce360fb80 1 -- 172.21.15.17:0/582637311 >> 172.21.15.17:0/582637311 conn(0x56285f479d40 msgr2=0x56285f47e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.436+0000 7f8ce360fb80 1 -- 172.21.15.17:0/582637311 shutdown_connections 2023-07-14T13:05:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.436+0000 7f8ce360fb80 1 -- 172.21.15.17:0/582637311 wait complete. 2023-07-14T13:05:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.436+0000 7f8ce360fb80 20 client.26536 trim_cache size 0 max 16384 2023-07-14T13:05:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ce360fb80 1 Processor -- start 2023-07-14T13:05:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ce360fb80 1 -- start start 2023-07-14T13:05:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f2e06b0 0x56285f4841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f499290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a8c0 0x56285f48b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f49e0c0 con 0x56285f48a8c0 2023-07-14T13:05:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f488720 con 0x56285f2e06b0 2023-07-14T13:05:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f4997d0 con 0x56285f48a470 2023-07-14T13:05:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ccd19a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f499290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ccd99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f2e06b0 0x56285f4841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8cce19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a8c0 0x56285f48b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ccd19a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f499290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58038/0 (socket says 172.21.15.17:58038) 2023-07-14T13:05:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ccd99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f2e06b0 0x56285f4841a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35602/0 (socket says 172.21.15.17:35602) 2023-07-14T13:05:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.455+0000 7f8ccd19a700 1 -- 172.21.15.17:0/1743253185 learned_addr learned my addr 172.21.15.17:0/1743253185 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.456+0000 7f8ccd19a700 1 -- 172.21.15.17:0/1743253185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f2e06b0 msgr2=0x56285f4841a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.456+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/1743253185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f2e06b0 0x56285f4841a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.456+0000 7f8ccd19a700 1 -- 172.21.15.17:0/1743253185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a8c0 msgr2=0x56285f48b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.456+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/1743253185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a8c0 0x56285f48b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.456+0000 7f8ccd19a700 1 -- 172.21.15.17:0/1743253185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56285f22a1f0 con 0x56285f48a470 2023-07-14T13:05:18.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.456+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/1743253185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f499290 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8cb809b130 tx=0x7f8cb800bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b81f340130ac06d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:18.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.456+0000 7f8cbcbff700 1 -- 172.21.15.17:0/1743253185 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb809b1a0 con 0x56285f48a470 2023-07-14T13:05:18.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.456+0000 7f8cbcbff700 1 -- 172.21.15.17:0/1743253185 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cb809f1d0 con 0x56285f48a470 2023-07-14T13:05:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.456+0000 7f8cbcbff700 1 -- 172.21.15.17:0/1743253185 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb80cba10 con 0x56285f48a470 2023-07-14T13:05:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.457+0000 7f8ce360fb80 1 -- 172.21.15.17:0/1743253185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 msgr2=0x56285f499290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.457+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/1743253185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f499290 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8cb809b130 tx=0x7f8cb800bfd0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.457+0000 7f8ce360fb80 1 -- 172.21.15.17:0/1743253185 shutdown_connections 2023-07-14T13:05:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.457+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/1743253185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a8c0 0x56285f48b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.457+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/1743253185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f2e06b0 0x56285f4841a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.457+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/1743253185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f48a470 0x56285f499290 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.457+0000 7f8ce360fb80 1 -- 172.21.15.17:0/1743253185 >> 172.21.15.17:0/1743253185 conn(0x56285f479d40 msgr2=0x56285f48acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.457+0000 7f8ce360fb80 1 -- 172.21.15.17:0/1743253185 shutdown_connections 2023-07-14T13:05:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.457+0000 7f8ce360fb80 1 -- 172.21.15.17:0/1743253185 wait complete. 2023-07-14T13:05:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.458+0000 7f8ce360fb80 1 -- start start 2023-07-14T13:05:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.458+0000 7f8ce360fb80 1 Processor -- start 2023-07-14T13:05:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.458+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f486c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.458+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 0x56285f487170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.458+0000 7f8ce360fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f485990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f485ed0 con 0x56285f48a470 2023-07-14T13:05:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f486040 con 0x56285f48a8c0 2023-07-14T13:05:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ce360fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285f486200 con 0x56285f2e06b0 2023-07-14T13:05:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ce360fb80 10 client.0 _ll_register_callbacks cb 0x7f8cc40116c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ccd99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f486c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ccd19a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 0x56285f487170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ccd99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f486c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58052/0 (socket says 172.21.15.17:58052) 2023-07-14T13:05:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ccd19a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 0x56285f487170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44150/0 (socket says 172.21.15.17:44150) 2023-07-14T13:05:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ccd99b700 1 -- 172.21.15.17:0/895244438 learned_addr learned my addr 172.21.15.17:0/895244438 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8cce19c700 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f485990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ccd19a700 1 -- 172.21.15.17:0/895244438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 msgr2=0x56285f486c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f486c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ccd19a700 1 -- 172.21.15.17:0/895244438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 msgr2=0x56285f485990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f485990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ccd19a700 1 -- 172.21.15.17:0/895244438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc81a2850 con 0x56285f48a470 2023-07-14T13:05:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.459+0000 7f8ccd99b700 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f486c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.460+0000 7f8ccd19a700 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 0x56285f487170 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8cb809aea0 tx=0x7f8cb8005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb8266b26e7f604 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.460+0000 7f8cb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:05:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.460+0000 7f8cb17fa700 1 -- 172.21.15.17:0/895244438 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb80cbc10 con 0x56285f48a470 2023-07-14T13:05:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.460+0000 7f8cb17fa700 1 -- 172.21.15.17:0/895244438 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f8cb807b070 con 0x56285f48a470 2023-07-14T13:05:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.460+0000 7f8ce360fb80 1 -- 172.21.15.17:0/895244438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8cc4011190 con 0x56285f48a470 2023-07-14T13:05:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.460+0000 7f8cb17fa700 1 -- 172.21.15.17:0/895244438 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cb809b400 con 0x56285f48a470 2023-07-14T13:05:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.460+0000 7f8ce360fb80 10 client.16851 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.460+0000 7f8ce360fb80 1 -- 172.21.15.17:0/895244438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56285f202250 con 0x56285f48a470 2023-07-14T13:05:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.460+0000 7f8cb17fa700 1 -- 172.21.15.17:0/895244438 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cc4011190 con 0x56285f48a470 2023-07-14T13:05:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.461+0000 7f8cb17fa700 1 -- 172.21.15.17:0/895244438 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8cb80b0d90 con 0x56285f48a470 2023-07-14T13:05:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.461+0000 7f8ce360fb80 10 client.16851 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.461+0000 7f8ce360fb80 10 client.16851 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.461+0000 7f8ce360fb80 20 client.16851 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.461+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56285f4f6af0 0x56285f4f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.461+0000 7f8ce360fb80 4 client.16851 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:05:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.461+0000 7f8ce360fb80 1 -- 172.21.15.17:0/895244438 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56285f390ff0 con 0x56285f4f6af0 2023-07-14T13:05:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.461+0000 7f8ccd99b700 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56285f4f6af0 0x56285f4f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.462+0000 7f8ccd99b700 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56285f4f6af0 0x56285f4f8f00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d301b7cedfa3ee8 server_cookie=a04658a553b4c049 in_seq=0 out_seq=0 2023-07-14T13:05:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.462+0000 7f8cb17fa700 10 client.16851 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8cb17fa700 1 -- 172.21.15.17:0/895244438 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56285f390ff0 con 0x56285f4f6af0 2023-07-14T13:05:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8cb17fa700 10 client.16851 handle_command_reply: tid=0 2023-07-14T13:05:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8ce360fb80 1 client.16851 shutdown 2023-07-14T13:05:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8ce360fb80 1 -- 172.21.15.17:0/895244438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 msgr2=0x56285f487170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:18.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 0x56285f487170 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8cb809aea0 tx=0x7f8cb8005f10 comp rx=0 tx=0).stop 2023-07-14T13:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8ce360fb80 1 -- 172.21.15.17:0/895244438 shutdown_connections 2023-07-14T13:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56285f4f6af0 0x56285f4f8f00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56285f48a8c0 0x56285f485990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56285f2e06b0 0x56285f486c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8ce360fb80 1 --2- 172.21.15.17:0/895244438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56285f48a470 0x56285f487170 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8ce360fb80 1 -- 172.21.15.17:0/895244438 >> 172.21.15.17:0/895244438 conn(0x56285f479d40 msgr2=0x56285f48cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.478+0000 7f8cb17fa700 0 client.16851 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:18.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.479+0000 7f8ce360fb80 1 -- 172.21.15.17:0/895244438 shutdown_connections 2023-07-14T13:05:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.479+0000 7f8ce360fb80 1 -- 172.21.15.17:0/895244438 wait complete. 2023-07-14T13:05:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.479+0000 7f8ce360fb80 20 client.16851 trim_cache size 0 max 16384 2023-07-14T13:05:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:05:18.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:05:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:05:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:05:18.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.479+0000 7f8cce99d700 1 -- 172.21.15.17:0/2937711288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb40a12c0 msgr2=0x7f8cb40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.479+0000 7f8cce99d700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb40a12c0 0x7f8cb40a3770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009ec0 tx=0x7f8cc000b040 comp rx=0 tx=0).stop 2023-07-14T13:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.479+0000 7f8cce99d700 1 -- 172.21.15.17:0/2937711288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81014a0 msgr2=0x7f8cc819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.479+0000 7f8cce99d700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81014a0 0x7f8cc819be10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80098e0 tx=0x7f8cb8004730 comp rx=0 tx=0).stop 2023-07-14T13:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.480+0000 7f8cce99d700 1 -- 172.21.15.17:0/2937711288 shutdown_connections 2023-07-14T13:05:18.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.480+0000 7f8cce99d700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb40a12c0 0x7f8cb40a3770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.480+0000 7f8cce99d700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8101e50 0x7f8cc81958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.480+0000 7f8cce99d700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc80ffd20 0x7f8cc819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.480+0000 7f8cce99d700 1 --2- 172.21.15.17:0/2937711288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81014a0 0x7f8cc819be10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.480+0000 7f8cce99d700 1 -- 172.21.15.17:0/2937711288 >> 172.21.15.17:0/2937711288 conn(0x7f8cc80fb440 msgr2=0x7f8cc80fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.480+0000 7f8cce99d700 1 -- 172.21.15.17:0/2937711288 shutdown_connections 2023-07-14T13:05:18.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:18.480+0000 7f8cce99d700 1 -- 172.21.15.17:0/2937711288 wait complete. 2023-07-14T13:05:19.080 INFO:teuthology.orchestra.run.smithi017.stderr:20600000 of 50000000 tuples (41%) done (elapsed 308.68 s, remaining 440.55 s) 2023-07-14T13:05:19.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:19 smithi017 ceph-mon[95536]: pgmap v170: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:05:19.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:19 smithi135 ceph-mon[97338]: pgmap v170: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:05:19.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:19 smithi131 ceph-mon[96953]: pgmap v170: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:05:20.369 INFO:teuthology.orchestra.run.smithi017.stderr:20700000 of 50000000 tuples (41%) done (elapsed 309.97 s, remaining 438.75 s) 2023-07-14T13:05:21.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:21 smithi017 ceph-mon[95536]: pgmap v171: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 33 MiB/s wr, 98 op/s 2023-07-14T13:05:21.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:21 smithi135 ceph-mon[97338]: pgmap v171: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 33 MiB/s wr, 98 op/s 2023-07-14T13:05:21.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:21 smithi131 ceph-mon[96953]: pgmap v171: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 33 MiB/s wr, 98 op/s 2023-07-14T13:05:21.749 INFO:teuthology.orchestra.run.smithi017.stderr:20800000 of 50000000 tuples (41%) done (elapsed 311.35 s, remaining 437.09 s) 2023-07-14T13:05:23.038 INFO:teuthology.orchestra.run.smithi017.stderr:20900000 of 50000000 tuples (41%) done (elapsed 312.64 s, remaining 435.30 s) 2023-07-14T13:05:23.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:23 smithi017 ceph-mon[95536]: pgmap v172: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:05:23.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:23 smithi135 ceph-mon[97338]: pgmap v172: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:05:23.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:23 smithi131 ceph-mon[96953]: pgmap v172: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:05:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:21000000 of 50000000 tuples (42%) done (elapsed 313.97 s, remaining 433.58 s) 2023-07-14T13:05:25.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:25 smithi017 ceph-mon[95536]: pgmap v173: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:05:25.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:25 smithi135 ceph-mon[97338]: pgmap v173: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:05:25.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:25 smithi131 ceph-mon[96953]: pgmap v173: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:05:25.659 INFO:teuthology.orchestra.run.smithi017.stderr:21100000 of 50000000 tuples (42%) done (elapsed 315.26 s, remaining 431.80 s) 2023-07-14T13:05:27.055 INFO:teuthology.orchestra.run.smithi017.stderr:21200000 of 50000000 tuples (42%) done (elapsed 316.66 s, remaining 430.18 s) 2023-07-14T13:05:27.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:27 smithi017 ceph-mon[95536]: pgmap v174: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 33 MiB/s wr, 83 op/s 2023-07-14T13:05:27.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:27 smithi135 ceph-mon[97338]: pgmap v174: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 33 MiB/s wr, 83 op/s 2023-07-14T13:05:27.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:27 smithi131 ceph-mon[96953]: pgmap v174: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 33 MiB/s wr, 83 op/s 2023-07-14T13:05:28.358 INFO:teuthology.orchestra.run.smithi017.stderr:21300000 of 50000000 tuples (42%) done (elapsed 317.96 s, remaining 428.42 s) 2023-07-14T13:05:29.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:05:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.302+0000 7f8c271ff700 1 -- 172.21.15.17:0/783272118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c20105ab0 msgr2=0x7f8c20105e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.302+0000 7f8c271ff700 1 --2- 172.21.15.17:0/783272118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c20105ab0 0x7f8c20105e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009990 tx=0x7f8c14009ca0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.302+0000 7f8c271ff700 1 -- 172.21.15.17:0/783272118 shutdown_connections 2023-07-14T13:05:29.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.302+0000 7f8c271ff700 1 --2- 172.21.15.17:0/783272118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c20100450 0x7f8c2010c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.302+0000 7f8c271ff700 1 --2- 172.21.15.17:0/783272118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c20105ab0 0x7f8c20105e80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.302+0000 7f8c271ff700 1 --2- 172.21.15.17:0/783272118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c200ffaa0 0x7f8c200fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.302+0000 7f8c271ff700 1 -- 172.21.15.17:0/783272118 >> 172.21.15.17:0/783272118 conn(0x7f8c200fb5a0 msgr2=0x7f8c200fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:29.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.302+0000 7f8c271ff700 1 -- 172.21.15.17:0/783272118 shutdown_connections 2023-07-14T13:05:29.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.302+0000 7f8c271ff700 1 -- 172.21.15.17:0/783272118 wait complete. 2023-07-14T13:05:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.304+0000 7f8c271ff700 1 Processor -- start 2023-07-14T13:05:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.304+0000 7f8c271ff700 1 -- start start 2023-07-14T13:05:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.305+0000 7f8c271ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c200ffaa0 0x7f8c2019b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.305+0000 7f8c271ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c20100450 0x7f8c2019bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.305+0000 7f8c271ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c20105ab0 0x7f8c201958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.305+0000 7f8c271ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20195f20 con 0x7f8c200ffaa0 2023-07-14T13:05:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.305+0000 7f8c271ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20196090 con 0x7f8c20105ab0 2023-07-14T13:05:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.305+0000 7f8c271ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c20196250 con 0x7f8c20100450 2023-07-14T13:05:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.305+0000 7f8c24f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c200ffaa0 0x7f8c2019b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.305+0000 7f8c24f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c200ffaa0 0x7f8c2019b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48684/0 (socket says 172.21.15.17:48684) 2023-07-14T13:05:29.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.305+0000 7f8c24f9b700 1 -- 172.21.15.17:0/1238164861 learned_addr learned my addr 172.21.15.17:0/1238164861 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:29.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.305+0000 7f8c1ffff700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c20100450 0x7f8c2019bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.306+0000 7f8c24f9b700 1 -- 172.21.15.17:0/1238164861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c20100450 msgr2=0x7f8c2019bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.306+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c20100450 0x7f8c2019bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.306+0000 7f8c24f9b700 1 -- 172.21.15.17:0/1238164861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c20105ab0 msgr2=0x7f8c201958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.306+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c20105ab0 0x7f8c201958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.306+0000 7f8c24f9b700 1 -- 172.21.15.17:0/1238164861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c140095f0 con 0x7f8c200ffaa0 2023-07-14T13:05:29.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.306+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c200ffaa0 0x7f8c2019b840 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8c14005910 tx=0x7f8c14005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:29.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.306+0000 7f8c1dffb700 1 -- 172.21.15.17:0/1238164861 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1401d070 con 0x7f8c200ffaa0 2023-07-14T13:05:29.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.307+0000 7f8c1dffb700 1 -- 172.21.15.17:0/1238164861 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c14022470 con 0x7f8c200ffaa0 2023-07-14T13:05:29.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.307+0000 7f8c1dffb700 1 -- 172.21.15.17:0/1238164861 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14017650 con 0x7f8c200ffaa0 2023-07-14T13:05:29.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.307+0000 7f8c271ff700 1 -- 172.21.15.17:0/1238164861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c201964d0 con 0x7f8c200ffaa0 2023-07-14T13:05:29.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.307+0000 7f8c271ff700 1 -- 172.21.15.17:0/1238164861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c201a2830 con 0x7f8c200ffaa0 2023-07-14T13:05:29.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.311+0000 7f8c1dffb700 1 -- 172.21.15.17:0/1238164861 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8c140225e0 con 0x7f8c200ffaa0 2023-07-14T13:05:29.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.312+0000 7f8c3aa7cb80 1 Processor -- start 2023-07-14T13:05:29.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.312+0000 7f8c3aa7cb80 1 -- start start 2023-07-14T13:05:29.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.313+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32ab2d0 0x561fe32ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.313+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32abbe0 0x561fe32b6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.313+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.313+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe31b1cb0 con 0x561fe32ab2d0 2023-07-14T13:05:29.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.313+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe3204a40 con 0x561fe32b6ad0 2023-07-14T13:05:29.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.313+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe31fded0 con 0x561fe32abbe0 2023-07-14T13:05:29.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.313+0000 7f8c1dffb700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8c100a12c0 0x7f8c100a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.313+0000 7f8c1dffb700 1 -- 172.21.15.17:0/1238164861 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f8c140cdfb0 con 0x7f8c200ffaa0 2023-07-14T13:05:29.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.313+0000 7f8c24f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32abbe0 0x561fe32b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.313+0000 7f8c2579c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32ab2d0 0x561fe32ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c1ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c2579c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32ab2d0 0x561fe32ab6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48696/0 (socket says 172.21.15.17:48696) 2023-07-14T13:05:29.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c2579c700 1 -- 172.21.15.17:0/3894808605 learned_addr learned my addr 172.21.15.17:0/3894808605 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:29.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c2579c700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8c100a12c0 0x7f8c100a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c24f9b700 1 -- 172.21.15.17:0/3894808605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 msgr2=0x561fe32b8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:29.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/3894808605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c24f9b700 1 -- 172.21.15.17:0/3894808605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32ab2d0 msgr2=0x561fe32ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:29.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/3894808605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32ab2d0 0x561fe32ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c24f9b700 1 -- 172.21.15.17:0/3894808605 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fe302bde0 con 0x561fe32abbe0 2023-07-14T13:05:29.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/3894808605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32abbe0 0x561fe32b6590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c140cb860 tx=0x7f8c1409adb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3855e4c23ce464cf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:29.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c0affd700 1 -- 172.21.15.17:0/3894808605 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c140cbea0 con 0x561fe32abbe0 2023-07-14T13:05:29.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.314+0000 7f8c0affd700 1 -- 172.21.15.17:0/3894808605 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c1409b270 con 0x561fe32abbe0 2023-07-14T13:05:29.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.315+0000 7f8c0affd700 1 -- 172.21.15.17:0/3894808605 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14099730 con 0x561fe32abbe0 2023-07-14T13:05:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.315+0000 7f8c2579c700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8c100a12c0 0x7f8c100a3770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009550 tx=0x7f8c18009b60 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.315+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3894808605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32abbe0 msgr2=0x561fe32b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.315+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/3894808605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32abbe0 0x561fe32b6590 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c140cb860 tx=0x7f8c1409adb0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.315+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3894808605 shutdown_connections 2023-07-14T13:05:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.315+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/3894808605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.315+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/3894808605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32ab2d0 0x561fe32ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.315+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/3894808605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32abbe0 0x561fe32b6590 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.315+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3894808605 >> 172.21.15.17:0/3894808605 conn(0x561fe32a1da0 msgr2=0x561fe32a76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:29.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.315+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3894808605 shutdown_connections 2023-07-14T13:05:29.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.316+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3894808605 wait complete. 2023-07-14T13:05:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.316+0000 7f8c3aa7cb80 1 -- start start 2023-07-14T13:05:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.316+0000 7f8c3aa7cb80 1 Processor -- start 2023-07-14T13:05:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe319dac0 con 0x561fe32abbe0 2023-07-14T13:05:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe319d7c0 con 0x561fe32b6ad0 2023-07-14T13:05:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe3081920 con 0x561fe32ab2d0 2023-07-14T13:05:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c3aa7cb80 10 client.0 _ll_register_callbacks cb 0x561fe319b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c1ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c24f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c24f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47110/0 (socket says 172.21.15.17:47110) 2023-07-14T13:05:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c1ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48712/0 (socket says 172.21.15.17:48712) 2023-07-14T13:05:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c24f9b700 1 -- 172.21.15.17:0/3344393030 learned_addr learned my addr 172.21.15.17:0/3344393030 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.317+0000 7f8c2579c700 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8c24f9b700 1 -- 172.21.15.17:0/3344393030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 msgr2=0x561fe32b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8c24f9b700 1 -- 172.21.15.17:0/3344393030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 msgr2=0x561fe32b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32b73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8c24f9b700 1 -- 172.21.15.17:0/3344393030 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c201a2830 con 0x561fe32ab2d0 2023-07-14T13:05:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32b6ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c1409af70 tx=0x7f8c140ce1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a917be9c8769e960 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8bfffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:05:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8bfffff700 1 -- 172.21.15.17:0/3344393030 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c140cbea0 con 0x561fe32ab2d0 2023-07-14T13:05:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8bfffff700 1 -- 172.21.15.17:0/3344393030 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f8c1409f2a0 con 0x561fe32ab2d0 2023-07-14T13:05:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3344393030 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fe31574f0 con 0x561fe32ab2d0 2023-07-14T13:05:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8bfffff700 1 -- 172.21.15.17:0/3344393030 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c1409a760 con 0x561fe32ab2d0 2023-07-14T13:05:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8c3aa7cb80 10 client.26554 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.318+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3344393030 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561fe3014c60 con 0x561fe32ab2d0 2023-07-14T13:05:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.319+0000 7f8bfffff700 1 -- 172.21.15.17:0/3344393030 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561fe31574f0 con 0x561fe32ab2d0 2023-07-14T13:05:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.319+0000 7f8bfffff700 1 -- 172.21.15.17:0/3344393030 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8c140b3bc0 con 0x561fe32ab2d0 2023-07-14T13:05:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.319+0000 7f8c3aa7cb80 10 client.26554 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.319+0000 7f8c3aa7cb80 10 client.26554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.319+0000 7f8c3aa7cb80 20 client.26554 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.319+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fe32ca000 0x561fe32cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.319+0000 7f8c3aa7cb80 4 client.26554 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:05:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.319+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3344393030 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fe31f6eb0 con 0x561fe32ca000 2023-07-14T13:05:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.319+0000 7f8c1ffff700 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fe32ca000 0x561fe32cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.320+0000 7f8c1ffff700 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fe32ca000 0x561fe32cc3e0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=918c35c2d20cb435 server_cookie=591c72bed0f24a37 in_seq=0 out_seq=0 2023-07-14T13:05:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.320+0000 7f8bfffff700 10 client.26554 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8bfffff700 1 -- 172.21.15.17:0/3344393030 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561fe31f6eb0 con 0x561fe32ca000 2023-07-14T13:05:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8bfffff700 10 client.26554 handle_command_reply: tid=0 2023-07-14T13:05:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8c3aa7cb80 1 client.26554 shutdown 2023-07-14T13:05:29.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3344393030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 msgr2=0x561fe32b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32b6ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c1409af70 tx=0x7f8c140ce1f0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3344393030 shutdown_connections 2023-07-14T13:05:29.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fe32ca000 0x561fe32cc3e0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32b6ea0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8bfffff700 0 client.26554 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:29.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/3344393030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3344393030 >> 172.21.15.17:0/3344393030 conn(0x561fe32a1da0 msgr2=0x561fe32a7230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:29.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3344393030 shutdown_connections 2023-07-14T13:05:29.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.321+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/3344393030 wait complete. 2023-07-14T13:05:29.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.322+0000 7f8c3aa7cb80 20 client.26554 trim_cache size 0 max 16384 2023-07-14T13:05:29.363 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:29 smithi017 ceph-mon[95536]: pgmap v175: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 47 op/s 2023-07-14T13:05:29.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.339+0000 7f8c3aa7cb80 1 Processor -- start 2023-07-14T13:05:29.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.339+0000 7f8c3aa7cb80 1 -- start start 2023-07-14T13:05:29.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.339+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32baed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.339+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe32a84d0 con 0x561fe32abbe0 2023-07-14T13:05:29.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe32b6180 con 0x561fe32b6ad0 2023-07-14T13:05:29.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe32b4120 con 0x561fe32ab2d0 2023-07-14T13:05:29.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c24f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32baed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c24f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32baed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47120/0 (socket says 172.21.15.17:47120) 2023-07-14T13:05:29.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c24f9b700 1 -- 172.21.15.17:0/1387045942 learned_addr learned my addr 172.21.15.17:0/1387045942 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:29.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c1ffff700 1 --2- 172.21.15.17:0/1387045942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c2579c700 1 --2- 172.21.15.17:0/1387045942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c24f9b700 1 -- 172.21.15.17:0/1387045942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 msgr2=0x561fe32b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:29.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/1387045942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c24f9b700 1 -- 172.21.15.17:0/1387045942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 msgr2=0x561fe32b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:29.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/1387045942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c24f9b700 1 -- 172.21.15.17:0/1387045942 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fe3052250 con 0x561fe32ab2d0 2023-07-14T13:05:29.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.340+0000 7f8c1ffff700 1 --2- 172.21.15.17:0/1387045942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:29.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.341+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/1387045942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32baed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8c14000c00 tx=0x7f8c1409f120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7daada35410e3d1d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:29.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.341+0000 7f8c0b7fe700 1 -- 172.21.15.17:0/1387045942 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14063080 con 0x561fe32ab2d0 2023-07-14T13:05:29.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.341+0000 7f8c0b7fe700 1 -- 172.21.15.17:0/1387045942 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c1409adb0 con 0x561fe32ab2d0 2023-07-14T13:05:29.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.341+0000 7f8c0b7fe700 1 -- 172.21.15.17:0/1387045942 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1409b970 con 0x561fe32ab2d0 2023-07-14T13:05:29.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.341+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/1387045942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 msgr2=0x561fe32baed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.341+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/1387045942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32baed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8c14000c00 tx=0x7f8c1409f120 comp rx=0 tx=0).stop 2023-07-14T13:05:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.342+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/1387045942 shutdown_connections 2023-07-14T13:05:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.342+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/1387045942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.342+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/1387045942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32baed0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.342+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/1387045942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.342+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/1387045942 >> 172.21.15.17:0/1387045942 conn(0x561fe32a1da0 msgr2=0x561fe32b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.342+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/1387045942 shutdown_connections 2023-07-14T13:05:29.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.342+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/1387045942 wait complete. 2023-07-14T13:05:29.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.342+0000 7f8c3aa7cb80 1 -- start start 2023-07-14T13:05:29.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.342+0000 7f8c3aa7cb80 1 Processor -- start 2023-07-14T13:05:29.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32ba7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32bad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c3aa7cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe32b9280 con 0x561fe32abbe0 2023-07-14T13:05:29.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe32b93f0 con 0x561fe32b6ad0 2023-07-14T13:05:29.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c3aa7cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe32b95b0 con 0x561fe32ab2d0 2023-07-14T13:05:29.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c3aa7cb80 10 client.0 _ll_register_callbacks cb 0x7f8c0c009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:29.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c1ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32bad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c24f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32ba7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c1ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32bad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48730/0 (socket says 172.21.15.17:48730) 2023-07-14T13:05:29.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c1ffff700 1 -- 172.21.15.17:0/2847023999 learned_addr learned my addr 172.21.15.17:0/2847023999 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:29.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.343+0000 7f8c2579c700 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8c24f9b700 1 -- 172.21.15.17:0/2847023999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 msgr2=0x561fe32b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:29.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8c24f9b700 1 -- 172.21.15.17:0/2847023999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 msgr2=0x561fe32bad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:29.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32bad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8c24f9b700 1 -- 172.21.15.17:0/2847023999 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fe3014c60 con 0x561fe32ab2d0 2023-07-14T13:05:29.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8c2579c700 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:29.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8c24f9b700 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32ba7e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8c14097ce0 tx=0x7f8c1409bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a9823a36a395178 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:29.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8bfffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:05:29.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8bfffff700 1 -- 172.21.15.17:0/2847023999 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c140cbea0 con 0x561fe32ab2d0 2023-07-14T13:05:29.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8bfffff700 1 -- 172.21.15.17:0/2847023999 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f8c140a31a0 con 0x561fe32ab2d0 2023-07-14T13:05:29.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/2847023999 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c1409b270 con 0x561fe32ab2d0 2023-07-14T13:05:29.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8bfffff700 1 -- 172.21.15.17:0/2847023999 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c140b92a0 con 0x561fe32ab2d0 2023-07-14T13:05:29.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8c3aa7cb80 10 client.26560 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:29.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.344+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/2847023999 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561fe302a2b0 con 0x561fe32ab2d0 2023-07-14T13:05:29.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.345+0000 7f8bfffff700 1 -- 172.21.15.17:0/2847023999 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c1409b270 con 0x561fe32ab2d0 2023-07-14T13:05:29.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.345+0000 7f8bfffff700 1 -- 172.21.15.17:0/2847023999 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8c1409a1d0 con 0x561fe32ab2d0 2023-07-14T13:05:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.345+0000 7f8c3aa7cb80 10 client.26560 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.345+0000 7f8c3aa7cb80 10 client.26560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.345+0000 7f8c3aa7cb80 20 client.26560 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.345+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fe331ea30 0x561fe3320e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.345+0000 7f8c3aa7cb80 4 client.26560 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:05:29.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.345+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/2847023999 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561fe31b9050 con 0x561fe331ea30 2023-07-14T13:05:29.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.345+0000 7f8c1ffff700 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fe331ea30 0x561fe3320e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:29.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8c1ffff700 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fe331ea30 0x561fe3320e10 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34e7f1107b67d9d6 server_cookie=918326a72cb30213 in_seq=0 out_seq=0 2023-07-14T13:05:29.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8bfffff700 10 client.26560 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:29.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8bfffff700 1 -- 172.21.15.17:0/2847023999 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561fe31b9050 con 0x561fe331ea30 2023-07-14T13:05:29.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8bfffff700 10 client.26560 handle_command_reply: tid=0 2023-07-14T13:05:29.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8c3aa7cb80 1 client.26560 shutdown 2023-07-14T13:05:29.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/2847023999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 msgr2=0x561fe32ba7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32ba7e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8c14097ce0 tx=0x7f8c1409bf30 comp rx=0 tx=0).stop 2023-07-14T13:05:29.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/2847023999 shutdown_connections 2023-07-14T13:05:29.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fe331ea30 0x561fe3320e10 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fe32b6ad0 0x561fe32b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fe32ab2d0 0x561fe32ba7e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8c3aa7cb80 1 --2- 172.21.15.17:0/2847023999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fe32abbe0 0x561fe32bad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8bfffff700 0 client.26560 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.346+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/2847023999 >> 172.21.15.17:0/2847023999 conn(0x561fe32a1da0 msgr2=0x561fe32b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.347+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/2847023999 shutdown_connections 2023-07-14T13:05:29.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.347+0000 7f8c3aa7cb80 1 -- 172.21.15.17:0/2847023999 wait complete. 2023-07-14T13:05:29.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.347+0000 7f8c3aa7cb80 20 client.26560 trim_cache size 0 max 16384 2023-07-14T13:05:29.389 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:05:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:05:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:05:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:05:29.389 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:05:29.390 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:05:29.390 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:05:29.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:05:29.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:05:29.390 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:05:29.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.347+0000 7f8c271ff700 1 -- 172.21.15.17:0/1238164861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8c100a12c0 msgr2=0x7f8c100a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.347+0000 7f8c271ff700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8c100a12c0 0x7f8c100a3770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009550 tx=0x7f8c18009b60 comp rx=0 tx=0).stop 2023-07-14T13:05:29.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.347+0000 7f8c271ff700 1 -- 172.21.15.17:0/1238164861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c200ffaa0 msgr2=0x7f8c2019b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:29.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.347+0000 7f8c271ff700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c200ffaa0 0x7f8c2019b840 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8c14005910 tx=0x7f8c14005740 comp rx=0 tx=0).stop 2023-07-14T13:05:29.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.348+0000 7f8c271ff700 1 -- 172.21.15.17:0/1238164861 shutdown_connections 2023-07-14T13:05:29.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.348+0000 7f8c271ff700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8c100a12c0 0x7f8c100a3770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.348+0000 7f8c271ff700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c20105ab0 0x7f8c201958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.348+0000 7f8c271ff700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c200ffaa0 0x7f8c2019b840 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.348+0000 7f8c271ff700 1 --2- 172.21.15.17:0/1238164861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c20100450 0x7f8c2019bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:29.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.348+0000 7f8c271ff700 1 -- 172.21.15.17:0/1238164861 >> 172.21.15.17:0/1238164861 conn(0x7f8c200fb5a0 msgr2=0x7f8c200fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:29.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.348+0000 7f8c271ff700 1 -- 172.21.15.17:0/1238164861 shutdown_connections 2023-07-14T13:05:29.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:29.348+0000 7f8c271ff700 1 -- 172.21.15.17:0/1238164861 wait complete. 2023-07-14T13:05:29.401 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:05:29.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:29 smithi135 ceph-mon[97338]: pgmap v175: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 47 op/s 2023-07-14T13:05:29.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:29 smithi131 ceph-mon[96953]: pgmap v175: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 47 op/s 2023-07-14T13:05:29.681 INFO:teuthology.orchestra.run.smithi017.stderr:21400000 of 50000000 tuples (42%) done (elapsed 319.28 s, remaining 426.71 s) 2023-07-14T13:05:30.944 INFO:teuthology.orchestra.run.smithi017.stderr:21500000 of 50000000 tuples (43%) done (elapsed 320.55 s, remaining 424.91 s) 2023-07-14T13:05:31.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:31 smithi017 ceph-mon[95536]: pgmap v176: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 56 op/s 2023-07-14T13:05:31.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:31 smithi135 ceph-mon[97338]: pgmap v176: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 56 op/s 2023-07-14T13:05:31.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:31 smithi131 ceph-mon[96953]: pgmap v176: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 56 op/s 2023-07-14T13:05:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.674+0000 7f72787ff700 1 -- 172.21.15.17:0/615766625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72700685b0 msgr2=0x7f7270104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.674+0000 7f72787ff700 1 --2- 172.21.15.17:0/615766625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72700685b0 0x7f7270104770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7260009990 tx=0x7f7260009ca0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.674+0000 7f72787ff700 1 -- 172.21.15.17:0/615766625 shutdown_connections 2023-07-14T13:05:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.674+0000 7f72787ff700 1 --2- 172.21.15.17:0/615766625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270104e50 0x7f727010ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.674+0000 7f72787ff700 1 --2- 172.21.15.17:0/615766625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7270067c10 0x7f7270067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.674+0000 7f72787ff700 1 --2- 172.21.15.17:0/615766625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72700685b0 0x7f7270104770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.674+0000 7f72787ff700 1 -- 172.21.15.17:0/615766625 >> 172.21.15.17:0/615766625 conn(0x7f7270074760 msgr2=0x7f7270074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.674+0000 7f72787ff700 1 -- 172.21.15.17:0/615766625 shutdown_connections 2023-07-14T13:05:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.674+0000 7f72787ff700 1 -- 172.21.15.17:0/615766625 wait complete. 2023-07-14T13:05:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.675+0000 7f72787ff700 1 Processor -- start 2023-07-14T13:05:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.675+0000 7f72787ff700 1 -- start start 2023-07-14T13:05:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.676+0000 7f72787ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7270067c10 0x7f7270197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.676+0000 7f72787ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72700685b0 0x7f7270198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.676+0000 7f72787ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270104e50 0x7f727019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.676+0000 7f72787ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727019ceb0 con 0x7f7270104e50 2023-07-14T13:05:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.676+0000 7f72787ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727019d020 con 0x7f72700685b0 2023-07-14T13:05:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.676+0000 7f72787ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727019d1e0 con 0x7f7270067c10 2023-07-14T13:05:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.676+0000 7f7276d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270104e50 0x7f727019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.676+0000 7f727659b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7270067c10 0x7f7270197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.676+0000 7f727659b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7270067c10 0x7f7270197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47142/0 (socket says 172.21.15.17:47142) 2023-07-14T13:05:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.676+0000 7f727659b700 1 -- 172.21.15.17:0/3224658644 learned_addr learned my addr 172.21.15.17:0/3224658644 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.676+0000 7f7275d9a700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72700685b0 0x7f7270198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.677+0000 7f727659b700 1 -- 172.21.15.17:0/3224658644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72700685b0 msgr2=0x7f7270198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.677+0000 7f727659b700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72700685b0 0x7f7270198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.677+0000 7f727659b700 1 -- 172.21.15.17:0/3224658644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270104e50 msgr2=0x7f727019c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.677+0000 7f727659b700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270104e50 0x7f727019c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.677+0000 7f727659b700 1 -- 172.21.15.17:0/3224658644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72600095f0 con 0x7f7270067c10 2023-07-14T13:05:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.677+0000 7f7276d9c700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270104e50 0x7f727019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.677+0000 7f727659b700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7270067c10 0x7f7270197d30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f726c00e9a0 tx=0x7f726c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.677+0000 7f72677fe700 1 -- 172.21.15.17:0/3224658644 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c009790 con 0x7f7270067c10 2023-07-14T13:05:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.677+0000 7f72787ff700 1 -- 172.21.15.17:0/3224658644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727019d4c0 con 0x7f7270067c10 2023-07-14T13:05:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.677+0000 7f72677fe700 1 -- 172.21.15.17:0/3224658644 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f726c010430 con 0x7f7270067c10 2023-07-14T13:05:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.678+0000 7f72677fe700 1 -- 172.21.15.17:0/3224658644 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00cea0 con 0x7f7270067c10 2023-07-14T13:05:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.678+0000 7f72787ff700 1 -- 172.21.15.17:0/3224658644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72701a4d00 con 0x7f7270067c10 2023-07-14T13:05:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.682+0000 7f72677fe700 1 -- 172.21.15.17:0/3224658644 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f726c0105a0 con 0x7f7270067c10 2023-07-14T13:05:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.683+0000 7f728c04db80 1 Processor -- start 2023-07-14T13:05:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.683+0000 7f728c04db80 1 -- start start 2023-07-14T13:05:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f72677fe700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f725c0a1340 0x7f725c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f728c04db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 0x55f693447d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f72677fe700 1 -- 172.21.15.17:0/3224658644 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f726c014070 con 0x7f7270067c10 2023-07-14T13:05:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f728c04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6934482d0 0x55f693442040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f728c04db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f693442580 0x55f6934429d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f728c04db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f693347c50 con 0x55f69329e6b0 2023-07-14T13:05:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f728c04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69339a9e0 con 0x55f6934482d0 2023-07-14T13:05:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f728c04db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f693393e70 con 0x55f693442580 2023-07-14T13:05:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f7276d9c700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f725c0a1340 0x7f725c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f727659b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 0x55f693447d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f727659b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 0x55f693447d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48750/0 (socket says 172.21.15.17:48750) 2023-07-14T13:05:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f727659b700 1 -- 172.21.15.17:0/3962250109 learned_addr learned my addr 172.21.15.17:0/3962250109 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.684+0000 7f7275d9a700 1 --2- 172.21.15.17:0/3962250109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6934482d0 0x55f693442040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.685+0000 7f727659b700 1 -- 172.21.15.17:0/3962250109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f693442580 msgr2=0x55f6934429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.685+0000 7f727659b700 1 --2- 172.21.15.17:0/3962250109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f693442580 0x55f6934429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.685+0000 7f727659b700 1 -- 172.21.15.17:0/3962250109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6934482d0 msgr2=0x55f693442040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.685+0000 7f727659b700 1 --2- 172.21.15.17:0/3962250109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6934482d0 0x55f693442040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.685+0000 7f727659b700 1 -- 172.21.15.17:0/3962250109 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6931c1d80 con 0x55f69329e6b0 2023-07-14T13:05:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.685+0000 7f7276d9c700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f725c0a1340 0x7f725c0a37f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7268003e40 tx=0x7f7268009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.685+0000 7f727659b700 1 --2- 172.21.15.17:0/3962250109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 0x55f693447d90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f726c0969f0 tx=0x7f726c099bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339d2bbdd8d1972a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.685+0000 7f7264ff9700 1 -- 172.21.15.17:0/3962250109 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c09dfb0 con 0x55f69329e6b0 2023-07-14T13:05:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.685+0000 7f7264ff9700 1 -- 172.21.15.17:0/3962250109 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f726c0a23d0 con 0x55f69329e6b0 2023-07-14T13:05:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.685+0000 7f7264ff9700 1 -- 172.21.15.17:0/3962250109 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c0a1f40 con 0x55f69329e6b0 2023-07-14T13:05:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.686+0000 7f728c04db80 1 -- 172.21.15.17:0/3962250109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 msgr2=0x55f693447d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.686+0000 7f728c04db80 1 --2- 172.21.15.17:0/3962250109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 0x55f693447d90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f726c0969f0 tx=0x7f726c099bd0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.686+0000 7f728c04db80 1 -- 172.21.15.17:0/3962250109 shutdown_connections 2023-07-14T13:05:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.686+0000 7f728c04db80 1 --2- 172.21.15.17:0/3962250109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f693442580 0x55f6934429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.686+0000 7f728c04db80 1 --2- 172.21.15.17:0/3962250109 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 0x55f693447d90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.686+0000 7f728c04db80 1 --2- 172.21.15.17:0/3962250109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6934482d0 0x55f693442040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.686+0000 7f728c04db80 1 -- 172.21.15.17:0/3962250109 >> 172.21.15.17:0/3962250109 conn(0x55f693437be0 msgr2=0x55f69343cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.686+0000 7f728c04db80 1 -- 172.21.15.17:0/3962250109 shutdown_connections 2023-07-14T13:05:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.686+0000 7f728c04db80 1 -- 172.21.15.17:0/3962250109 wait complete. 2023-07-14T13:05:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.687+0000 7f728c04db80 1 -- start start 2023-07-14T13:05:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.687+0000 7f728c04db80 1 Processor -- start 2023-07-14T13:05:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f728c04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 0x55f69344e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f728c04db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f693442580 0x55f69344b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f728c04db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6934482d0 0x55f69344c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f728c04db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f693333a60 con 0x55f693442580 2023-07-14T13:05:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f728c04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f693333760 con 0x55f69329e6b0 2023-07-14T13:05:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f728c04db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6932178c0 con 0x55f6934482d0 2023-07-14T13:05:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f728c04db80 10 client.0 _ll_register_callbacks cb 0x55f693331700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f727659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 0x55f69344e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f7275d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f693442580 0x55f69344b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f7276d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6934482d0 0x55f69344c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f727659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 0x55f69344e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58834/0 (socket says 172.21.15.17:58834) 2023-07-14T13:05:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.688+0000 7f727659b700 1 -- 172.21.15.17:0/3095475545 learned_addr learned my addr 172.21.15.17:0/3095475545 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f727659b700 1 -- 172.21.15.17:0/3095475545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6934482d0 msgr2=0x55f69344c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f727659b700 1 --2- 172.21.15.17:0/3095475545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6934482d0 0x55f69344c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f727659b700 1 -- 172.21.15.17:0/3095475545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f693442580 msgr2=0x55f69344b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f727659b700 1 --2- 172.21.15.17:0/3095475545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f693442580 0x55f69344b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f727659b700 1 -- 172.21.15.17:0/3095475545 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72701a4d00 con 0x55f69329e6b0 2023-07-14T13:05:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f727659b700 1 --2- 172.21.15.17:0/3095475545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 0x55f69344e670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f726c00c4c0 tx=0x7f726c099720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b60131b338e0d30 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f7259ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:05:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f7259ffb700 1 -- 172.21.15.17:0/3095475545 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c09dfb0 con 0x55f69329e6b0 2023-07-14T13:05:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f7259ffb700 1 -- 172.21.15.17:0/3095475545 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f726c0a2150 con 0x55f69329e6b0 2023-07-14T13:05:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f728c04db80 1 -- 172.21.15.17:0/3095475545 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6932ed490 con 0x55f69329e6b0 2023-07-14T13:05:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f7259ffb700 1 -- 172.21.15.17:0/3095475545 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f726c0b82c0 con 0x55f69329e6b0 2023-07-14T13:05:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.689+0000 7f728c04db80 10 client.26600 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.690+0000 7f728c04db80 1 -- 172.21.15.17:0/3095475545 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f6931aac00 con 0x55f69329e6b0 2023-07-14T13:05:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.690+0000 7f7259ffb700 1 -- 172.21.15.17:0/3095475545 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f726c07c070 con 0x55f69329e6b0 2023-07-14T13:05:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.690+0000 7f7259ffb700 1 -- 172.21.15.17:0/3095475545 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f726c095d70 con 0x55f69329e6b0 2023-07-14T13:05:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.690+0000 7f728c04db80 10 client.26600 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.690+0000 7f728c04db80 10 client.26600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.690+0000 7f728c04db80 20 client.26600 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.690+0000 7f728c04db80 1 --2- 172.21.15.17:0/3095475545 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f69345b7f0 0x55f69345dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.690+0000 7f728c04db80 4 client.26600 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:05:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.690+0000 7f728c04db80 1 -- 172.21.15.17:0/3095475545 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f69338ce50 con 0x55f69345b7f0 2023-07-14T13:05:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.691+0000 7f7275d9a700 1 --2- 172.21.15.17:0/3095475545 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f69345b7f0 0x55f69345dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.691+0000 7f7275d9a700 1 --2- 172.21.15.17:0/3095475545 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f69345b7f0 0x55f69345dc00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5775efb0a1f71e server_cookie=37faff861f502b74 in_seq=0 out_seq=0 2023-07-14T13:05:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.691+0000 7f7259ffb700 10 client.26600 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:31.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f7259ffb700 1 -- 172.21.15.17:0/3095475545 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f69338ce50 con 0x55f69345b7f0 2023-07-14T13:05:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f7259ffb700 10 client.26600 handle_command_reply: tid=0 2023-07-14T13:05:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f728c04db80 1 client.26600 shutdown 2023-07-14T13:05:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f728c04db80 1 -- 172.21.15.17:0/3095475545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 msgr2=0x55f69344e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f728c04db80 1 --2- 172.21.15.17:0/3095475545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 0x55f69344e670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f726c00c4c0 tx=0x7f726c099720 comp rx=0 tx=0).stop 2023-07-14T13:05:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f728c04db80 1 -- 172.21.15.17:0/3095475545 shutdown_connections 2023-07-14T13:05:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f728c04db80 1 --2- 172.21.15.17:0/3095475545 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f69345b7f0 0x55f69345dc00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f728c04db80 1 --2- 172.21.15.17:0/3095475545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6934482d0 0x55f69344c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f728c04db80 1 --2- 172.21.15.17:0/3095475545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 0x55f69344e670 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f7259ffb700 0 client.26600 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f728c04db80 1 --2- 172.21.15.17:0/3095475545 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f693442580 0x55f69344b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.692+0000 7f728c04db80 1 -- 172.21.15.17:0/3095475545 >> 172.21.15.17:0/3095475545 conn(0x55f693437be0 msgr2=0x55f69343c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.693+0000 7f728c04db80 1 -- 172.21.15.17:0/3095475545 shutdown_connections 2023-07-14T13:05:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.693+0000 7f728c04db80 1 -- 172.21.15.17:0/3095475545 wait complete. 2023-07-14T13:05:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.693+0000 7f728c04db80 20 client.26600 trim_cache size 0 max 16384 2023-07-14T13:05:31.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.712+0000 7f728c04db80 1 Processor -- start 2023-07-14T13:05:31.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.712+0000 7f728c04db80 1 -- start start 2023-07-14T13:05:31.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.712+0000 7f728c04db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 0x55f693447200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.712+0000 7f728c04db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f693442580 0x55f69344e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.712+0000 7f728c04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6934482d0 0x55f69343cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.712+0000 7f728c04db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69343e720 con 0x55f69329e6b0 2023-07-14T13:05:31.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.712+0000 7f728c04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f69343dfa0 con 0x55f6934482d0 2023-07-14T13:05:31.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.712+0000 7f728c04db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f693449ec0 con 0x55f693442580 2023-07-14T13:05:31.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f727659b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 0x55f693447200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f7275d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f693442580 0x55f69344e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f7275d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f693442580 0x55f69344e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47160/0 (socket says 172.21.15.17:47160) 2023-07-14T13:05:31.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f7275d9a700 1 -- 172.21.15.17:0/2609004800 learned_addr learned my addr 172.21.15.17:0/2609004800 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f7276d9c700 1 --2- 172.21.15.17:0/2609004800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6934482d0 0x55f69343cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f7275d9a700 1 -- 172.21.15.17:0/2609004800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6934482d0 msgr2=0x55f69343cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f7275d9a700 1 --2- 172.21.15.17:0/2609004800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6934482d0 0x55f69343cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f7275d9a700 1 -- 172.21.15.17:0/2609004800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 msgr2=0x55f693447200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f7275d9a700 1 --2- 172.21.15.17:0/2609004800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 0x55f693447200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f7275d9a700 1 -- 172.21.15.17:0/2609004800 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f693462830 con 0x55f693442580 2023-07-14T13:05:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f7276d9c700 1 --2- 172.21.15.17:0/2609004800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6934482d0 0x55f69343cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.713+0000 7f7275d9a700 1 --2- 172.21.15.17:0/2609004800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f693442580 0x55f69344e210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7270068980 tx=0x7f7260005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdbe77975044eeb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.714+0000 7f72657fa700 1 -- 172.21.15.17:0/2609004800 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726002a070 con 0x55f693442580 2023-07-14T13:05:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.714+0000 7f72657fa700 1 -- 172.21.15.17:0/2609004800 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f726001e040 con 0x55f693442580 2023-07-14T13:05:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.714+0000 7f72657fa700 1 -- 172.21.15.17:0/2609004800 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726001d040 con 0x55f693442580 2023-07-14T13:05:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.714+0000 7f728c04db80 1 -- 172.21.15.17:0/2609004800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f693442580 msgr2=0x55f69344e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.714+0000 7f728c04db80 1 --2- 172.21.15.17:0/2609004800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f693442580 0x55f69344e210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7270068980 tx=0x7f7260005fb0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.715+0000 7f728c04db80 1 -- 172.21.15.17:0/2609004800 shutdown_connections 2023-07-14T13:05:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.715+0000 7f728c04db80 1 --2- 172.21.15.17:0/2609004800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f6934482d0 0x55f69343cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.715+0000 7f728c04db80 1 --2- 172.21.15.17:0/2609004800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f69329e6b0 0x55f693447200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.715+0000 7f728c04db80 1 --2- 172.21.15.17:0/2609004800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f693442580 0x55f69344e210 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.715+0000 7f728c04db80 1 -- 172.21.15.17:0/2609004800 >> 172.21.15.17:0/2609004800 conn(0x55f693437be0 msgr2=0x55f693446af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.715+0000 7f728c04db80 1 -- 172.21.15.17:0/2609004800 shutdown_connections 2023-07-14T13:05:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.715+0000 7f728c04db80 1 -- 172.21.15.17:0/2609004800 wait complete. 2023-07-14T13:05:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.715+0000 7f728c04db80 1 -- start start 2023-07-14T13:05:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.715+0000 7f728c04db80 1 Processor -- start 2023-07-14T13:05:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f728c04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 0x55f693452640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f728c04db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f693442580 0x55f693452b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f728c04db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6934482d0 0x55f693450c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f728c04db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f693451220 con 0x55f693442580 2023-07-14T13:05:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f728c04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f693451390 con 0x55f69329e6b0 2023-07-14T13:05:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f728c04db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f693451550 con 0x55f6934482d0 2023-07-14T13:05:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f728c04db80 10 client.0 _ll_register_callbacks cb 0x7f72680097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f727659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 0x55f693452640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f7275d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f693442580 0x55f693452b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f727659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 0x55f693452640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58856/0 (socket says 172.21.15.17:58856) 2023-07-14T13:05:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f727659b700 1 -- 172.21.15.17:0/4212758216 learned_addr learned my addr 172.21.15.17:0/4212758216 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.716+0000 7f7276d9c700 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6934482d0 0x55f693450c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.717+0000 7f7275d9a700 1 -- 172.21.15.17:0/4212758216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6934482d0 msgr2=0x55f693450c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.717+0000 7f7275d9a700 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6934482d0 0x55f693450c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.717+0000 7f7275d9a700 1 -- 172.21.15.17:0/4212758216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 msgr2=0x55f693452640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.717+0000 7f7275d9a700 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 0x55f693452640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.717+0000 7f7275d9a700 1 -- 172.21.15.17:0/4212758216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727010d210 con 0x55f693442580 2023-07-14T13:05:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.717+0000 7f7275d9a700 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f693442580 0x55f693452b80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f726000b650 tx=0x7f7260005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee235b2aedf86ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.717+0000 7f7259ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:05:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.717+0000 7f7259ffb700 1 -- 172.21.15.17:0/4212758216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726002a070 con 0x55f693442580 2023-07-14T13:05:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.717+0000 7f728c04db80 1 -- 172.21.15.17:0/4212758216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f726c0a23d0 con 0x55f693442580 2023-07-14T13:05:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.717+0000 7f7259ffb700 1 -- 172.21.15.17:0/4212758216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f726000bcc0 con 0x55f693442580 2023-07-14T13:05:31.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.718+0000 7f7259ffb700 1 -- 172.21.15.17:0/4212758216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f726001d040 con 0x55f693442580 2023-07-14T13:05:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.718+0000 7f728c04db80 10 client.16887 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.718+0000 7f728c04db80 1 -- 172.21.15.17:0/4212758216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f6931e81f0 con 0x55f693442580 2023-07-14T13:05:31.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.718+0000 7f7259ffb700 1 -- 172.21.15.17:0/4212758216 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7260040080 con 0x55f693442580 2023-07-14T13:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.718+0000 7f7259ffb700 1 -- 172.21.15.17:0/4212758216 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7260033460 con 0x55f693442580 2023-07-14T13:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.718+0000 7f728c04db80 10 client.16887 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.718+0000 7f728c04db80 10 client.16887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.718+0000 7f728c04db80 20 client.16887 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.718+0000 7f728c04db80 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f6934b0360 0x55f6934b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.718+0000 7f728c04db80 4 client.16887 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:05:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.718+0000 7f728c04db80 1 -- 172.21.15.17:0/4212758216 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f69334eff0 con 0x55f6934b0360 2023-07-14T13:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.719+0000 7f727659b700 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f6934b0360 0x55f6934b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.719+0000 7f7259ffb700 10 client.16887 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.719+0000 7f727659b700 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f6934b0360 0x55f6934b2740 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bd3aa521b583404 server_cookie=8b3ee1816d94ce4f in_seq=0 out_seq=0 2023-07-14T13:05:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f7259ffb700 1 -- 172.21.15.17:0/4212758216 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f69334eff0 con 0x55f6934b0360 2023-07-14T13:05:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f7259ffb700 10 client.16887 handle_command_reply: tid=0 2023-07-14T13:05:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 1 client.16887 shutdown 2023-07-14T13:05:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 1 -- 172.21.15.17:0/4212758216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f693442580 msgr2=0x55f693452b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f693442580 0x55f693452b80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f726000b650 tx=0x7f7260005740 comp rx=0 tx=0).stop 2023-07-14T13:05:31.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 1 -- 172.21.15.17:0/4212758216 shutdown_connections 2023-07-14T13:05:31.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f6934b0360 0x55f6934b2740 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6934482d0 0x55f693450c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f69329e6b0 0x55f693452640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f7259ffb700 0 client.16887 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:31.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 1 --2- 172.21.15.17:0/4212758216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f693442580 0x55f693452b80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 1 -- 172.21.15.17:0/4212758216 >> 172.21.15.17:0/4212758216 conn(0x55f693437be0 msgr2=0x55f693447380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 1 -- 172.21.15.17:0/4212758216 shutdown_connections 2023-07-14T13:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 1 -- 172.21.15.17:0/4212758216 wait complete. 2023-07-14T13:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.734+0000 7f728c04db80 20 client.16887 trim_cache size 0 max 16384 2023-07-14T13:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:05:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:05:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:05:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.735+0000 7f72787ff700 1 -- 172.21.15.17:0/3224658644 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f725c0a1340 msgr2=0x7f725c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.735+0000 7f72787ff700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f725c0a1340 0x7f725c0a37f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7268003e40 tx=0x7f7268009920 comp rx=0 tx=0).stop 2023-07-14T13:05:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.735+0000 7f72787ff700 1 -- 172.21.15.17:0/3224658644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7270067c10 msgr2=0x7f7270197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.735+0000 7f72787ff700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7270067c10 0x7f7270197d30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f726c00e9a0 tx=0x7f726c00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.735+0000 7f72787ff700 1 -- 172.21.15.17:0/3224658644 shutdown_connections 2023-07-14T13:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.735+0000 7f72787ff700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f725c0a1340 0x7f725c0a37f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.735+0000 7f72787ff700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7270104e50 0x7f727019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.735+0000 7f72787ff700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7270067c10 0x7f7270197d30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.735+0000 7f72787ff700 1 --2- 172.21.15.17:0/3224658644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72700685b0 0x7f7270198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.735+0000 7f72787ff700 1 -- 172.21.15.17:0/3224658644 >> 172.21.15.17:0/3224658644 conn(0x7f7270074760 msgr2=0x7f72700fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.735+0000 7f72787ff700 1 -- 172.21.15.17:0/3224658644 shutdown_connections 2023-07-14T13:05:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:31.736+0000 7f72787ff700 1 -- 172.21.15.17:0/3224658644 wait complete. 2023-07-14T13:05:32.804 INFO:teuthology.orchestra.run.smithi017.stderr:21600000 of 50000000 tuples (43%) done (elapsed 322.41 s, remaining 423.90 s) 2023-07-14T13:05:33.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:33 smithi017 ceph-mon[95536]: pgmap v177: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 26 op/s 2023-07-14T13:05:33.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:33 smithi135 ceph-mon[97338]: pgmap v177: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 26 op/s 2023-07-14T13:05:33.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:33 smithi131 ceph-mon[96953]: pgmap v177: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 26 op/s 2023-07-14T13:05:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:21700000 of 50000000 tuples (43%) done (elapsed 323.73 s, remaining 422.19 s) 2023-07-14T13:05:35.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:35 smithi017 ceph-mon[95536]: pgmap v178: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 26 op/s 2023-07-14T13:05:35.444 INFO:teuthology.orchestra.run.smithi017.stderr:21800000 of 50000000 tuples (43%) done (elapsed 325.05 s, remaining 420.47 s) 2023-07-14T13:05:35.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:35 smithi135 ceph-mon[97338]: pgmap v178: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 26 op/s 2023-07-14T13:05:35.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:35 smithi131 ceph-mon[96953]: pgmap v178: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 26 op/s 2023-07-14T13:05:36.884 INFO:teuthology.orchestra.run.smithi017.stderr:21900000 of 50000000 tuples (43%) done (elapsed 326.49 s, remaining 418.92 s) 2023-07-14T13:05:37.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:37 smithi017 ceph-mon[95536]: pgmap v179: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 34 MiB/s wr, 45 op/s 2023-07-14T13:05:37.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:37 smithi135 ceph-mon[97338]: pgmap v179: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 34 MiB/s wr, 45 op/s 2023-07-14T13:05:37.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:37 smithi131 ceph-mon[96953]: pgmap v179: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 34 MiB/s wr, 45 op/s 2023-07-14T13:05:38.196 INFO:teuthology.orchestra.run.smithi017.stderr:22000000 of 50000000 tuples (44%) done (elapsed 327.80 s, remaining 417.20 s) 2023-07-14T13:05:39.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:39 smithi017 ceph-mon[95536]: pgmap v180: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 23 MiB/s wr, 26 op/s 2023-07-14T13:05:39.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:39 smithi135 ceph-mon[97338]: pgmap v180: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 23 MiB/s wr, 26 op/s 2023-07-14T13:05:39.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:39 smithi131 ceph-mon[96953]: pgmap v180: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 23 MiB/s wr, 26 op/s 2023-07-14T13:05:39.518 INFO:teuthology.orchestra.run.smithi017.stderr:22100000 of 50000000 tuples (44%) done (elapsed 329.12 s, remaining 415.50 s) 2023-07-14T13:05:40.934 INFO:teuthology.orchestra.run.smithi017.stderr:22200000 of 50000000 tuples (44%) done (elapsed 330.54 s, remaining 413.91 s) 2023-07-14T13:05:41.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:41 smithi017 ceph-mon[95536]: pgmap v181: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 34 MiB/s wr, 49 op/s 2023-07-14T13:05:41.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:41 smithi135 ceph-mon[97338]: pgmap v181: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 34 MiB/s wr, 49 op/s 2023-07-14T13:05:41.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:41 smithi131 ceph-mon[96953]: pgmap v181: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 34 MiB/s wr, 49 op/s 2023-07-14T13:05:42.269 INFO:teuthology.orchestra.run.smithi017.stderr:22300000 of 50000000 tuples (44%) done (elapsed 331.87 s, remaining 412.23 s) 2023-07-14T13:05:43.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:43 smithi017 ceph-mon[95536]: pgmap v182: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-14T13:05:43.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:43 smithi135 ceph-mon[97338]: pgmap v182: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-14T13:05:43.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:43 smithi131 ceph-mon[96953]: pgmap v182: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-14T13:05:43.569 INFO:teuthology.orchestra.run.smithi017.stderr:22400000 of 50000000 tuples (44%) done (elapsed 333.17 s, remaining 410.51 s) 2023-07-14T13:05:44.922 INFO:teuthology.orchestra.run.smithi017.stderr:22500000 of 50000000 tuples (45%) done (elapsed 334.52 s, remaining 408.86 s) 2023-07-14T13:05:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.911+0000 7f89c0fff700 1 -- 172.21.15.17:0/873432443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc105b60 msgr2=0x7f89bc105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.911+0000 7f89c0fff700 1 --2- 172.21.15.17:0/873432443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc105b60 0x7f89bc105f30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f89ac009990 tx=0x7f89ac009ca0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.911+0000 7f89c0fff700 1 -- 172.21.15.17:0/873432443 shutdown_connections 2023-07-14T13:05:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.911+0000 7f89c0fff700 1 --2- 172.21.15.17:0/873432443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc1004e0 0x7f89bc10c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.911+0000 7f89c0fff700 1 --2- 172.21.15.17:0/873432443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc105b60 0x7f89bc105f30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.911+0000 7f89c0fff700 1 --2- 172.21.15.17:0/873432443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc0ffb30 0x7f89bc0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.911+0000 7f89c0fff700 1 -- 172.21.15.17:0/873432443 >> 172.21.15.17:0/873432443 conn(0x7f89bc0fb5f0 msgr2=0x7f89bc0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.911+0000 7f89c0fff700 1 -- 172.21.15.17:0/873432443 shutdown_connections 2023-07-14T13:05:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.911+0000 7f89c0fff700 1 -- 172.21.15.17:0/873432443 wait complete. 2023-07-14T13:05:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.912+0000 7f89c0fff700 1 Processor -- start 2023-07-14T13:05:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.913+0000 7f89c0fff700 1 -- start start 2023-07-14T13:05:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.913+0000 7f89c0fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc0ffb30 0x7f89bc19dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.913+0000 7f89c0fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc1004e0 0x7f89bc19e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.913+0000 7f89c0fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc105b60 0x7f89bc197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.913+0000 7f89c0fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc198150 con 0x7f89bc0ffb30 2023-07-14T13:05:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.913+0000 7f89c0fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc1982c0 con 0x7f89bc105b60 2023-07-14T13:05:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.913+0000 7f89c0fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc198480 con 0x7f89bc1004e0 2023-07-14T13:05:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.913+0000 7f89ba59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc0ffb30 0x7f89bc19dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.914+0000 7f89ba59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc0ffb30 0x7f89bc19dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54954/0 (socket says 172.21.15.17:54954) 2023-07-14T13:05:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.914+0000 7f89ba59c700 1 -- 172.21.15.17:0/1692106163 learned_addr learned my addr 172.21.15.17:0/1692106163 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.914+0000 7f89b9d9b700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc1004e0 0x7f89bc19e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.914+0000 7f89bad9d700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc105b60 0x7f89bc197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.914+0000 7f89ba59c700 1 -- 172.21.15.17:0/1692106163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc1004e0 msgr2=0x7f89bc19e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.914+0000 7f89ba59c700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc1004e0 0x7f89bc19e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.914+0000 7f89ba59c700 1 -- 172.21.15.17:0/1692106163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc105b60 msgr2=0x7f89bc197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.914+0000 7f89ba59c700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc105b60 0x7f89bc197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.914+0000 7f89ba59c700 1 -- 172.21.15.17:0/1692106163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0095f0 con 0x7f89bc0ffb30 2023-07-14T13:05:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.914+0000 7f89b9d9b700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc1004e0 0x7f89bc19e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.914+0000 7f89ba59c700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc0ffb30 0x7f89bc19dc80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f89ac005740 tx=0x7f89ac005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.915+0000 7f89ab7fe700 1 -- 172.21.15.17:0/1692106163 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac01d070 con 0x7f89bc0ffb30 2023-07-14T13:05:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.915+0000 7f89ab7fe700 1 -- 172.21.15.17:0/1692106163 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89ac022470 con 0x7f89bc0ffb30 2023-07-14T13:05:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.915+0000 7f89c0fff700 1 -- 172.21.15.17:0/1692106163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89bc198700 con 0x7f89bc0ffb30 2023-07-14T13:05:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.915+0000 7f89ab7fe700 1 -- 172.21.15.17:0/1692106163 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac017650 con 0x7f89bc0ffb30 2023-07-14T13:05:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.915+0000 7f89c0fff700 1 -- 172.21.15.17:0/1692106163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89bc1a4c70 con 0x7f89bc0ffb30 2023-07-14T13:05:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.918+0000 7f89ab7fe700 1 -- 172.21.15.17:0/1692106163 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f89ac0225e0 con 0x7f89bc0ffb30 2023-07-14T13:05:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.920+0000 7f89d49f3b80 1 Processor -- start 2023-07-14T13:05:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.920+0000 7f89d49f3b80 1 -- start start 2023-07-14T13:05:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.920+0000 7f89ab7fe700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89a40a1340 0x7f89a40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b638d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b6392d0 0x56402b633040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89ab7fe700 1 -- 172.21.15.17:0/1692106163 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f89ac0cdfa0 con 0x7f89bc0ffb30 2023-07-14T13:05:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b633580 0x56402b6339d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b538c50 con 0x56402b48f6b0 2023-07-14T13:05:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b58b9e0 con 0x56402b633580 2023-07-14T13:05:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b584e70 con 0x56402b6392d0 2023-07-14T13:05:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89bad9d700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89a40a1340 0x7f89a40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89b9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b6392d0 0x56402b633040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89b9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b6392d0 0x56402b633040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54526/0 (socket says 172.21.15.17:54526) 2023-07-14T13:05:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89b9d9b700 1 -- 172.21.15.17:0/3281449722 learned_addr learned my addr 172.21.15.17:0/3281449722 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.921+0000 7f89bad9d700 1 --2- 172.21.15.17:0/3281449722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b633580 0x56402b6339d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89ba59c700 1 --2- 172.21.15.17:0/3281449722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b638d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89b9d9b700 1 -- 172.21.15.17:0/3281449722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b633580 msgr2=0x56402b6339d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89b9d9b700 1 --2- 172.21.15.17:0/3281449722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b633580 0x56402b6339d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89b9d9b700 1 -- 172.21.15.17:0/3281449722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 msgr2=0x56402b638d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89b9d9b700 1 --2- 172.21.15.17:0/3281449722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b638d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89b9d9b700 1 -- 172.21.15.17:0/3281449722 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56402b3b2d80 con 0x56402b6392d0 2023-07-14T13:05:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89bad9d700 1 --2- 172.21.15.17:0/3281449722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b633580 0x56402b6339d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89b9d9b700 1 --2- 172.21.15.17:0/3281449722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b6392d0 0x56402b633040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89b00115f0 tx=0x7f89b0011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fc77640012f8c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89bad9d700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89a40a1340 0x7f89a40a37f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009ec0 tx=0x7f89b4009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89a8ff9700 1 -- 172.21.15.17:0/3281449722 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0004030 con 0x56402b6392d0 2023-07-14T13:05:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89a8ff9700 1 -- 172.21.15.17:0/3281449722 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89b0003680 con 0x56402b6392d0 2023-07-14T13:05:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.922+0000 7f89a8ff9700 1 -- 172.21.15.17:0/3281449722 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b0019690 con 0x56402b6392d0 2023-07-14T13:05:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.923+0000 7f89d49f3b80 1 -- 172.21.15.17:0/3281449722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b6392d0 msgr2=0x56402b633040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.923+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/3281449722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b6392d0 0x56402b633040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89b00115f0 tx=0x7f89b0011900 comp rx=0 tx=0).stop 2023-07-14T13:05:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.923+0000 7f89d49f3b80 1 -- 172.21.15.17:0/3281449722 shutdown_connections 2023-07-14T13:05:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.923+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/3281449722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b633580 0x56402b6339d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.923+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/3281449722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b638d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.923+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/3281449722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b6392d0 0x56402b633040 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.923+0000 7f89d49f3b80 1 -- 172.21.15.17:0/3281449722 >> 172.21.15.17:0/3281449722 conn(0x56402b628be0 msgr2=0x56402b62df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.923+0000 7f89d49f3b80 1 -- 172.21.15.17:0/3281449722 shutdown_connections 2023-07-14T13:05:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.923+0000 7f89d49f3b80 1 -- 172.21.15.17:0/3281449722 wait complete. 2023-07-14T13:05:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.924+0000 7f89d49f3b80 1 -- start start 2023-07-14T13:05:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.924+0000 7f89d49f3b80 1 Processor -- start 2023-07-14T13:05:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b63c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b63ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 0x56402b63d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b524a60 con 0x56402b48f6b0 2023-07-14T13:05:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b524760 con 0x56402b6392d0 2023-07-14T13:05:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b4088c0 con 0x56402b633580 2023-07-14T13:05:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89d49f3b80 10 client.0 _ll_register_callbacks cb 0x56402b522700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89b9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b63ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89ba59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b63c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89b9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b63ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54542/0 (socket says 172.21.15.17:54542) 2023-07-14T13:05:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89b9d9b700 1 -- 172.21.15.17:0/1890081328 learned_addr learned my addr 172.21.15.17:0/1890081328 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.925+0000 7f89bad9d700 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 0x56402b63d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.926+0000 7f89b9d9b700 1 -- 172.21.15.17:0/1890081328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 msgr2=0x56402b63d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.926+0000 7f89b9d9b700 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 0x56402b63d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.926+0000 7f89b9d9b700 1 -- 172.21.15.17:0/1890081328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 msgr2=0x56402b63c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.926+0000 7f89b9d9b700 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b63c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.926+0000 7f89b9d9b700 1 -- 172.21.15.17:0/1890081328 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b0009d50 con 0x56402b633580 2023-07-14T13:05:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.926+0000 7f89b9d9b700 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b63ce70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f89b0000c00 tx=0x7f89b00052f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4703831bd31c47e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.926+0000 7f89a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:05:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.926+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1890081328 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b00056f0 con 0x56402b633580 2023-07-14T13:05:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.926+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1890081328 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56402b4de490 con 0x56402b633580 2023-07-14T13:05:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.926+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1890081328 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f89b0005ce0 con 0x56402b633580 2023-07-14T13:05:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.927+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1890081328 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89b0003eb0 con 0x56402b633580 2023-07-14T13:05:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.927+0000 7f89d49f3b80 10 client.26587 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.927+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1890081328 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56402b39bc00 con 0x56402b633580 2023-07-14T13:05:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.927+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1890081328 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56402b4de490 con 0x56402b633580 2023-07-14T13:05:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.927+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1890081328 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f89b0004c70 con 0x56402b633580 2023-07-14T13:05:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.927+0000 7f89d49f3b80 10 client.26587 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.927+0000 7f89d49f3b80 10 client.26587 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.927+0000 7f89d49f3b80 20 client.26587 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.927+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402b64cae0 0x56402b64eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.927+0000 7f89d49f3b80 4 client.26587 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:05:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.927+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1890081328 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56402b57de50 con 0x56402b64cae0 2023-07-14T13:05:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.928+0000 7f89ba59c700 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402b64cae0 0x56402b64eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.928+0000 7f89ba59c700 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402b64cae0 0x56402b64eef0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b3240a3d39b5b6d server_cookie=b1c916074a68f839 in_seq=0 out_seq=0 2023-07-14T13:05:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.928+0000 7f89a1ffb700 10 client.26587 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.929+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1890081328 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56402b57de50 con 0x56402b64cae0 2023-07-14T13:05:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.929+0000 7f89a1ffb700 10 client.26587 handle_command_reply: tid=0 2023-07-14T13:05:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.929+0000 7f89d49f3b80 1 client.26587 shutdown 2023-07-14T13:05:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.929+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1890081328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 msgr2=0x56402b63ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.929+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b63ce70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f89b0000c00 tx=0x7f89b00052f0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.929+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1890081328 shutdown_connections 2023-07-14T13:05:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.930+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402b64cae0 0x56402b64eef0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.930+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 0x56402b63d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.930+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b63c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.930+0000 7f89a1ffb700 0 client.26587 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.930+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1890081328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b63ce70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.930+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1890081328 >> 172.21.15.17:0/1890081328 conn(0x56402b628be0 msgr2=0x56402b62d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.930+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1890081328 shutdown_connections 2023-07-14T13:05:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.930+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1890081328 wait complete. 2023-07-14T13:05:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.930+0000 7f89d49f3b80 20 client.26587 trim_cache size 0 max 16384 2023-07-14T13:05:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.949+0000 7f89d49f3b80 1 Processor -- start 2023-07-14T13:05:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.949+0000 7f89d49f3b80 1 -- start start 2023-07-14T13:05:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b48f6b0 0x56402b633040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b643c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b6392d0 0x56402b6381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b6396a0 con 0x56402b6392d0 2023-07-14T13:05:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b63ae90 con 0x56402b48f6b0 2023-07-14T13:05:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b6376a0 con 0x56402b633580 2023-07-14T13:05:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89b9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b643c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89ba59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b48f6b0 0x56402b633040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89ba59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b48f6b0 0x56402b633040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49962/0 (socket says 172.21.15.17:49962) 2023-07-14T13:05:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89bad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b6392d0 0x56402b6381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89b9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b643c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54548/0 (socket says 172.21.15.17:54548) 2023-07-14T13:05:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.950+0000 7f89ba59c700 1 -- 172.21.15.17:0/2233876203 learned_addr learned my addr 172.21.15.17:0/2233876203 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.951+0000 7f89ba59c700 1 -- 172.21.15.17:0/2233876203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 msgr2=0x56402b643c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.951+0000 7f89ba59c700 1 --2- 172.21.15.17:0/2233876203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b643c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.951+0000 7f89ba59c700 1 -- 172.21.15.17:0/2233876203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b6392d0 msgr2=0x56402b6381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.951+0000 7f89ba59c700 1 --2- 172.21.15.17:0/2233876203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b6392d0 0x56402b6381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.951+0000 7f89ba59c700 1 -- 172.21.15.17:0/2233876203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56402b3d91f0 con 0x56402b48f6b0 2023-07-14T13:05:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.951+0000 7f89ba59c700 1 --2- 172.21.15.17:0/2233876203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b48f6b0 0x56402b633040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f89ac097610 tx=0x7f89ac01a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb289813bf91b37c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.951+0000 7f89a97fa700 1 -- 172.21.15.17:0/2233876203 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac09f140 con 0x56402b48f6b0 2023-07-14T13:05:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.951+0000 7f89a97fa700 1 -- 172.21.15.17:0/2233876203 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89ac0a34d0 con 0x56402b48f6b0 2023-07-14T13:05:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.951+0000 7f89a97fa700 1 -- 172.21.15.17:0/2233876203 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac09b370 con 0x56402b48f6b0 2023-07-14T13:05:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.952+0000 7f89d49f3b80 1 -- 172.21.15.17:0/2233876203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b48f6b0 msgr2=0x56402b633040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.952+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/2233876203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b48f6b0 0x56402b633040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f89ac097610 tx=0x7f89ac01a040 comp rx=0 tx=0).stop 2023-07-14T13:05:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.952+0000 7f89d49f3b80 1 -- 172.21.15.17:0/2233876203 shutdown_connections 2023-07-14T13:05:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.952+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/2233876203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b6392d0 0x56402b6381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.952+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/2233876203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b48f6b0 0x56402b633040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.952+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/2233876203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b643c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.952+0000 7f89d49f3b80 1 -- 172.21.15.17:0/2233876203 >> 172.21.15.17:0/2233876203 conn(0x56402b628be0 msgr2=0x56402b637ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.952+0000 7f89d49f3b80 1 -- 172.21.15.17:0/2233876203 shutdown_connections 2023-07-14T13:05:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.952+0000 7f89d49f3b80 1 -- 172.21.15.17:0/2233876203 wait complete. 2023-07-14T13:05:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.953+0000 7f89d49f3b80 1 -- start start 2023-07-14T13:05:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.953+0000 7f89d49f3b80 1 Processor -- start 2023-07-14T13:05:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.953+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b6436a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.953+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b643be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.953+0000 7f89d49f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 0x56402b641c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.953+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b6422d0 con 0x56402b48f6b0 2023-07-14T13:05:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.953+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b642440 con 0x56402b6392d0 2023-07-14T13:05:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.953+0000 7f89d49f3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402b642600 con 0x56402b633580 2023-07-14T13:05:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89d49f3b80 10 client.0 _ll_register_callbacks cb 0x7f89b0011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89ba59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b6436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89bad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 0x56402b641c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89bad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 0x56402b641c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49964/0 (socket says 172.21.15.17:49964) 2023-07-14T13:05:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89bad9d700 1 -- 172.21.15.17:0/1241246671 learned_addr learned my addr 172.21.15.17:0/1241246671 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89b9d9b700 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b643be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89bad9d700 1 -- 172.21.15.17:0/1241246671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 msgr2=0x56402b643be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89bad9d700 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b643be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89bad9d700 1 -- 172.21.15.17:0/1241246671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 msgr2=0x56402b6436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89bad9d700 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b6436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89bad9d700 1 -- 172.21.15.17:0/1241246671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89bc1a4c70 con 0x56402b6392d0 2023-07-14T13:05:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.954+0000 7f89ba59c700 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b6436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.955+0000 7f89bad9d700 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 0x56402b641c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89b4015980 tx=0x7f89b400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2da2aa8b6ff9f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.955+0000 7f89a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:05:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.955+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1241246671 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400e040 con 0x56402b6392d0 2023-07-14T13:05:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.955+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1241246671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f89b0003680 con 0x56402b6392d0 2023-07-14T13:05:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.955+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1241246671 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f89b4003c00 con 0x56402b6392d0 2023-07-14T13:05:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.956+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1241246671 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89b4003dc0 con 0x56402b6392d0 2023-07-14T13:05:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.956+0000 7f89d49f3b80 10 client.26624 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.956+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1241246671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56402b3b1250 con 0x56402b6392d0 2023-07-14T13:05:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.956+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1241246671 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89b0003680 con 0x56402b6392d0 2023-07-14T13:05:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.956+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1241246671 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f89b402e030 con 0x56402b6392d0 2023-07-14T13:05:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.956+0000 7f89d49f3b80 10 client.26624 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.956+0000 7f89d49f3b80 10 client.26624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.956+0000 7f89d49f3b80 20 client.26624 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.956+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402b6a1b50 0x56402b6a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.956+0000 7f89d49f3b80 4 client.26624 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:05:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.956+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1241246671 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56402b53fff0 con 0x56402b6a1b50 2023-07-14T13:05:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.957+0000 7f89ba59c700 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402b6a1b50 0x56402b6a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.957+0000 7f89ba59c700 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402b6a1b50 0x56402b6a3f60 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c94f969eeb1845f2 server_cookie=e6d1d7d31a1d1ae4 in_seq=0 out_seq=0 2023-07-14T13:05:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.957+0000 7f89a1ffb700 10 client.26624 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89a1ffb700 1 -- 172.21.15.17:0/1241246671 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56402b53fff0 con 0x56402b6a1b50 2023-07-14T13:05:45.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89a1ffb700 10 client.26624 handle_command_reply: tid=0 2023-07-14T13:05:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 1 client.26624 shutdown 2023-07-14T13:05:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1241246671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 msgr2=0x56402b641c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 0x56402b641c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f89b4015980 tx=0x7f89b400b040 comp rx=0 tx=0).stop 2023-07-14T13:05:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1241246671 shutdown_connections 2023-07-14T13:05:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402b6a1b50 0x56402b6a3f60 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56402b6392d0 0x56402b641c50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402b48f6b0 0x56402b6436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 1 --2- 172.21.15.17:0/1241246671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402b633580 0x56402b643be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89a1ffb700 0 client.26624 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1241246671 >> 172.21.15.17:0/1241246671 conn(0x56402b628be0 msgr2=0x56402b63b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1241246671 shutdown_connections 2023-07-14T13:05:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 1 -- 172.21.15.17:0/1241246671 wait complete. 2023-07-14T13:05:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.975+0000 7f89d49f3b80 20 client.26624 trim_cache size 0 max 16384 2023-07-14T13:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:05:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:05:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:05:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 -- 172.21.15.17:0/1692106163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89a40a1340 msgr2=0x7f89a40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89a40a1340 0x7f89a40a37f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009ec0 tx=0x7f89b4009920 comp rx=0 tx=0).stop 2023-07-14T13:05:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 -- 172.21.15.17:0/1692106163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc0ffb30 msgr2=0x7f89bc19dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc0ffb30 0x7f89bc19dc80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f89ac005740 tx=0x7f89ac005770 comp rx=0 tx=0).stop 2023-07-14T13:05:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 -- 172.21.15.17:0/1692106163 shutdown_connections 2023-07-14T13:05:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89a40a1340 0x7f89a40a37f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89bc105b60 0x7f89bc197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89bc0ffb30 0x7f89bc19dc80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 --2- 172.21.15.17:0/1692106163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89bc1004e0 0x7f89bc19e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 -- 172.21.15.17:0/1692106163 >> 172.21.15.17:0/1692106163 conn(0x7f89bc0fb5f0 msgr2=0x7f89bc10ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 -- 172.21.15.17:0/1692106163 shutdown_connections 2023-07-14T13:05:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:44.976+0000 7f89c0fff700 1 -- 172.21.15.17:0/1692106163 wait complete. 2023-07-14T13:05:45.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:45 smithi017 ceph-mon[95536]: pgmap v183: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-14T13:05:45.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:45 smithi135 ceph-mon[97338]: pgmap v183: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-14T13:05:45.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:45 smithi131 ceph-mon[96953]: pgmap v183: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-14T13:05:46.340 INFO:teuthology.orchestra.run.smithi017.stderr:22600000 of 50000000 tuples (45%) done (elapsed 335.94 s, remaining 407.29 s) 2023-07-14T13:05:47.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:47 smithi135 ceph-mon[97338]: pgmap v184: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 34 MiB/s wr, 68 op/s 2023-07-14T13:05:47.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:47 smithi131 ceph-mon[96953]: pgmap v184: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 34 MiB/s wr, 68 op/s 2023-07-14T13:05:47.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:47 smithi017 ceph-mon[95536]: pgmap v184: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 34 MiB/s wr, 68 op/s 2023-07-14T13:05:49.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:49 smithi135 ceph-mon[97338]: pgmap v185: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 22 MiB/s wr, 50 op/s 2023-07-14T13:05:49.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:49 smithi131 ceph-mon[96953]: pgmap v185: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 22 MiB/s wr, 50 op/s 2023-07-14T13:05:49.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:49 smithi017 ceph-mon[95536]: pgmap v185: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 22 MiB/s wr, 50 op/s 2023-07-14T13:05:50.367 INFO:teuthology.orchestra.run.smithi017.stderr:22700000 of 50000000 tuples (45%) done (elapsed 339.97 s, remaining 408.86 s) 2023-07-14T13:05:51.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:51 smithi135 ceph-mon[97338]: pgmap v186: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 27 MiB/s wr, 68 op/s 2023-07-14T13:05:51.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:51 smithi131 ceph-mon[96953]: pgmap v186: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 27 MiB/s wr, 68 op/s 2023-07-14T13:05:51.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:51 smithi017 ceph-mon[95536]: pgmap v186: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 27 MiB/s wr, 68 op/s 2023-07-14T13:05:51.679 INFO:teuthology.orchestra.run.smithi017.stderr:22800000 of 50000000 tuples (45%) done (elapsed 341.28 s, remaining 407.14 s) 2023-07-14T13:05:53.108 INFO:teuthology.orchestra.run.smithi017.stderr:22900000 of 50000000 tuples (45%) done (elapsed 342.71 s, remaining 405.57 s) 2023-07-14T13:05:53.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:53 smithi135 ceph-mon[97338]: pgmap v187: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 16 MiB/s wr, 44 op/s 2023-07-14T13:05:53.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:53 smithi131 ceph-mon[96953]: pgmap v187: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 16 MiB/s wr, 44 op/s 2023-07-14T13:05:53.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:53 smithi017 ceph-mon[95536]: pgmap v187: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 16 MiB/s wr, 44 op/s 2023-07-14T13:05:54.457 INFO:teuthology.orchestra.run.smithi017.stderr:23000000 of 50000000 tuples (46%) done (elapsed 344.06 s, remaining 403.89 s) 2023-07-14T13:05:55.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:55 smithi135 ceph-mon[97338]: pgmap v188: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 16 MiB/s wr, 44 op/s 2023-07-14T13:05:55.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:55 smithi131 ceph-mon[96953]: pgmap v188: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 16 MiB/s wr, 44 op/s 2023-07-14T13:05:55.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:55 smithi017 ceph-mon[95536]: pgmap v188: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 16 MiB/s wr, 44 op/s 2023-07-14T13:05:55.780 INFO:teuthology.orchestra.run.smithi017.stderr:23100000 of 50000000 tuples (46%) done (elapsed 345.38 s, remaining 402.20 s) 2023-07-14T13:05:57.104 INFO:teuthology.orchestra.run.smithi017.stderr:23200000 of 50000000 tuples (46%) done (elapsed 346.71 s, remaining 400.51 s) 2023-07-14T13:05:57.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:57 smithi135 ceph-mon[97338]: pgmap v189: 97 pgs: 97 active+clean; 5.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-14T13:05:57.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:57 smithi131 ceph-mon[96953]: pgmap v189: 97 pgs: 97 active+clean; 5.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-14T13:05:57.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:57 smithi017 ceph-mon[95536]: pgmap v189: 97 pgs: 97 active+clean; 5.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-14T13:05:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.152+0000 7f2e877ff700 1 -- 172.21.15.17:0/3357942777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e80101f30 msgr2=0x7f2e80102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.152+0000 7f2e877ff700 1 --2- 172.21.15.17:0/3357942777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e80101f30 0x7f2e80102300 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009920 tx=0x7f2e7c009c30 comp rx=0 tx=0).stop 2023-07-14T13:05:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.152+0000 7f2e877ff700 1 -- 172.21.15.17:0/3357942777 shutdown_connections 2023-07-14T13:05:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.152+0000 7f2e877ff700 1 --2- 172.21.15.17:0/3357942777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e80106f70 0x7f2e8010eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.152+0000 7f2e877ff700 1 --2- 172.21.15.17:0/3357942777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e80101f30 0x7f2e80102300 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.152+0000 7f2e877ff700 1 --2- 172.21.15.17:0/3357942777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e801028d0 0x7f2e80106890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.153+0000 7f2e877ff700 1 -- 172.21.15.17:0/3357942777 >> 172.21.15.17:0/3357942777 conn(0x7f2e800fd780 msgr2=0x7f2e800ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.153+0000 7f2e877ff700 1 -- 172.21.15.17:0/3357942777 shutdown_connections 2023-07-14T13:05:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.153+0000 7f2e877ff700 1 -- 172.21.15.17:0/3357942777 wait complete. 2023-07-14T13:05:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.154+0000 7f2e877ff700 1 Processor -- start 2023-07-14T13:05:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.154+0000 7f2e877ff700 1 -- start start 2023-07-14T13:05:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.155+0000 7f2e877ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e80101f30 0x7f2e80074a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.155+0000 7f2e877ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e801028d0 0x7f2e80074f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.155+0000 7f2e877ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e80106f70 0x7f2e800754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.155+0000 7f2e877ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e801a8470 con 0x7f2e801028d0 2023-07-14T13:05:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.155+0000 7f2e877ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e801a85e0 con 0x7f2e80106f70 2023-07-14T13:05:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.155+0000 7f2e877ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e801a87a0 con 0x7f2e80101f30 2023-07-14T13:05:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.155+0000 7f2e8559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e80101f30 0x7f2e80074a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.155+0000 7f2e8559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e80101f30 0x7f2e80074a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50396/0 (socket says 172.21.15.17:50396) 2023-07-14T13:05:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.155+0000 7f2e8559b700 1 -- 172.21.15.17:0/1799343177 learned_addr learned my addr 172.21.15.17:0/1799343177 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.155+0000 7f2e85d9c700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e80106f70 0x7f2e800754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.156+0000 7f2e84d9a700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e801028d0 0x7f2e80074f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.156+0000 7f2e8559b700 1 -- 172.21.15.17:0/1799343177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e80106f70 msgr2=0x7f2e800754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.156+0000 7f2e8559b700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e80106f70 0x7f2e800754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.156+0000 7f2e8559b700 1 -- 172.21.15.17:0/1799343177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e801028d0 msgr2=0x7f2e80074f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.156+0000 7f2e8559b700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e801028d0 0x7f2e80074f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.156+0000 7f2e8559b700 1 -- 172.21.15.17:0/1799343177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c009520 con 0x7f2e80101f30 2023-07-14T13:05:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.156+0000 7f2e8559b700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e80101f30 0x7f2e80074a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009230 tx=0x7f2e7c00fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.157+0000 7f2e767fc700 1 -- 172.21.15.17:0/1799343177 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c01c070 con 0x7f2e80101f30 2023-07-14T13:05:58.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.157+0000 7f2e767fc700 1 -- 172.21.15.17:0/1799343177 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e7c005040 con 0x7f2e80101f30 2023-07-14T13:05:58.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.157+0000 7f2e767fc700 1 -- 172.21.15.17:0/1799343177 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c004b60 con 0x7f2e80101f30 2023-07-14T13:05:58.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.157+0000 7f2e877ff700 1 -- 172.21.15.17:0/1799343177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e801a8a20 con 0x7f2e80101f30 2023-07-14T13:05:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.157+0000 7f2e877ff700 1 -- 172.21.15.17:0/1799343177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e801a8df0 con 0x7f2e80101f30 2023-07-14T13:05:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.162+0000 7f2e767fc700 1 -- 172.21.15.17:0/1799343177 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2e7c0051b0 con 0x7f2e80101f30 2023-07-14T13:05:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.163+0000 7f2e9b032b80 1 Processor -- start 2023-07-14T13:05:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.163+0000 7f2e9b032b80 1 -- start start 2023-07-14T13:05:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9ef4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 0x55f3b9eef040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 0x55f3b9eef9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e767fc700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2e6c0a1340 0x7f2e6c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9df4c50 con 0x55f3b9ef52d0 2023-07-14T13:05:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9e479e0 con 0x55f3b9eef580 2023-07-14T13:05:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9e40e70 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e767fc700 1 -- 172.21.15.17:0/1799343177 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2e7c0cdf40 con 0x7f2e80101f30 2023-07-14T13:05:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e8559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 0x55f3b9eef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e8559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 0x55f3b9eef040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46090/0 (socket says 172.21.15.17:46090) 2023-07-14T13:05:58.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e8559b700 1 -- 172.21.15.17:0/1817144458 learned_addr learned my addr 172.21.15.17:0/1817144458 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:58.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e85d9c700 1 --2- 172.21.15.17:0/1817144458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 0x55f3b9eef9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e85d9c700 1 --2- 172.21.15.17:0/1817144458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9ef4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.164+0000 7f2e84d9a700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2e6c0a1340 0x7f2e6c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.165+0000 7f2e8559b700 1 -- 172.21.15.17:0/1817144458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 msgr2=0x55f3b9ef4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.165+0000 7f2e8559b700 1 --2- 172.21.15.17:0/1817144458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9ef4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.165+0000 7f2e8559b700 1 -- 172.21.15.17:0/1817144458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 msgr2=0x55f3b9eef9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.165+0000 7f2e8559b700 1 --2- 172.21.15.17:0/1817144458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 0x55f3b9eef9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.165+0000 7f2e8559b700 1 -- 172.21.15.17:0/1817144458 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3b9c6ed80 con 0x55f3b9ef52d0 2023-07-14T13:05:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.165+0000 7f2e85d9c700 1 --2- 172.21.15.17:0/1817144458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9ef4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.165+0000 7f2e8559b700 1 --2- 172.21.15.17:0/1817144458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 0x55f3b9eef040 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009810 tx=0x7f2e7c097560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7776fba06b532bc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.165+0000 7f2e6b7fe700 1 -- 172.21.15.17:0/1817144458 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0cb470 con 0x55f3b9ef52d0 2023-07-14T13:05:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.165+0000 7f2e84d9a700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2e6c0a1340 0x7f2e6c0a37f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e80076210 tx=0x7f2e7000b410 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.165+0000 7f2e6b7fe700 1 -- 172.21.15.17:0/1817144458 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e7c09b0f0 con 0x55f3b9ef52d0 2023-07-14T13:05:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.165+0000 7f2e6b7fe700 1 -- 172.21.15.17:0/1817144458 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c004cc0 con 0x55f3b9ef52d0 2023-07-14T13:05:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.166+0000 7f2e9b032b80 1 -- 172.21.15.17:0/1817144458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 msgr2=0x55f3b9eef040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.166+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/1817144458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 0x55f3b9eef040 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009810 tx=0x7f2e7c097560 comp rx=0 tx=0).stop 2023-07-14T13:05:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.166+0000 7f2e9b032b80 1 -- 172.21.15.17:0/1817144458 shutdown_connections 2023-07-14T13:05:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.166+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/1817144458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 0x55f3b9eef9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.166+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/1817144458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9ef4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.166+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/1817144458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 0x55f3b9eef040 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.166+0000 7f2e9b032b80 1 -- 172.21.15.17:0/1817144458 >> 172.21.15.17:0/1817144458 conn(0x55f3b9ee4be0 msgr2=0x55f3b9ee9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.166+0000 7f2e9b032b80 1 -- 172.21.15.17:0/1817144458 shutdown_connections 2023-07-14T13:05:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.166+0000 7f2e9b032b80 1 -- 172.21.15.17:0/1817144458 wait complete. 2023-07-14T13:05:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.167+0000 7f2e9b032b80 1 -- start start 2023-07-14T13:05:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.167+0000 7f2e9b032b80 1 Processor -- start 2023-07-14T13:05:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9efe230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9eef580 0x55f3b9efe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9ef52d0 0x55f3b9ef84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9de0a60 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9de0760 con 0x55f3b9ef52d0 2023-07-14T13:05:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9cc48c0 con 0x55f3b9eef580 2023-07-14T13:05:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e9b032b80 10 client.0 _ll_register_callbacks cb 0x55f3b9dde700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e8559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9efe230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e84d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9eef580 0x55f3b9efe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e8559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9efe230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46094/0 (socket says 172.21.15.17:46094) 2023-07-14T13:05:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e8559b700 1 -- 172.21.15.17:0/2444100329 learned_addr learned my addr 172.21.15.17:0/2444100329 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.168+0000 7f2e85d9c700 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9ef52d0 0x55f3b9ef84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.169+0000 7f2e84d9a700 1 -- 172.21.15.17:0/2444100329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9ef52d0 msgr2=0x55f3b9ef84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.169+0000 7f2e84d9a700 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9ef52d0 0x55f3b9ef84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.169+0000 7f2e84d9a700 1 -- 172.21.15.17:0/2444100329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 msgr2=0x55f3b9efe230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.169+0000 7f2e84d9a700 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9efe230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.169+0000 7f2e84d9a700 1 -- 172.21.15.17:0/2444100329 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e78008840 con 0x55f3b9eef580 2023-07-14T13:05:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.169+0000 7f2e84d9a700 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9eef580 0x55f3b9efe770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e70005950 tx=0x7f2e700047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9c5b3e7de3884cf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.169+0000 7f2e68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:05:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.169+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2444100329 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7001e620 con 0x55f3b9eef580 2023-07-14T13:05:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.169+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2444100329 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3b9d9a490 con 0x55f3b9eef580 2023-07-14T13:05:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.169+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2444100329 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2e70017070 con 0x55f3b9eef580 2023-07-14T13:05:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.170+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2444100329 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e7001e780 con 0x55f3b9eef580 2023-07-14T13:05:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.170+0000 7f2e9b032b80 10 client.26605 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.170+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2444100329 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f2e7c0c9040 con 0x55f3b9eef580 2023-07-14T13:05:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.170+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2444100329 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3b9d9a490 con 0x55f3b9eef580 2023-07-14T13:05:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.170+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2444100329 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2e7002f8d0 con 0x55f3b9eef580 2023-07-14T13:05:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.170+0000 7f2e9b032b80 10 client.26605 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.170+0000 7f2e9b032b80 10 client.26605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.170+0000 7f2e9b032b80 20 client.26605 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.170+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3b9f086e0 0x55f3b9f0aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.170+0000 7f2e9b032b80 4 client.26605 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:05:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.170+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2444100329 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3b9e39e50 con 0x55f3b9f086e0 2023-07-14T13:05:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.171+0000 7f2e8559b700 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3b9f086e0 0x55f3b9f0aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.171+0000 7f2e8559b700 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3b9f086e0 0x55f3b9f0aaf0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=959630b39858535e server_cookie=cf11861552b1279b in_seq=0 out_seq=0 2023-07-14T13:05:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.171+0000 7f2e68ff9700 10 client.26605 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.172+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2444100329 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f3b9e39e50 con 0x55f3b9f086e0 2023-07-14T13:05:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.172+0000 7f2e68ff9700 10 client.26605 handle_command_reply: tid=0 2023-07-14T13:05:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.172+0000 7f2e9b032b80 1 client.26605 shutdown 2023-07-14T13:05:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.172+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2444100329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9eef580 msgr2=0x55f3b9efe770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.172+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9eef580 0x55f3b9efe770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e70005950 tx=0x7f2e700047c0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.173+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2444100329 shutdown_connections 2023-07-14T13:05:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.173+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3b9f086e0 0x55f3b9f0aaf0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.173+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9ef52d0 0x55f3b9ef84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.173+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9efe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.173+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2444100329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9eef580 0x55f3b9efe770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.173+0000 7f2e68ff9700 0 client.26605 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.173+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2444100329 >> 172.21.15.17:0/2444100329 conn(0x55f3b9ee4be0 msgr2=0x55f3b9ee94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.173+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2444100329 shutdown_connections 2023-07-14T13:05:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.173+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2444100329 wait complete. 2023-07-14T13:05:58.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.173+0000 7f2e9b032b80 20 client.26605 trim_cache size 0 max 16384 2023-07-14T13:05:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.188+0000 7f2e9b032b80 1 Processor -- start 2023-07-14T13:05:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.188+0000 7f2e9b032b80 1 -- start start 2023-07-14T13:05:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9eef040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 0x55f3b9ef6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 0x55f3b9ef8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9e39e50 con 0x55f3b9ef52d0 2023-07-14T13:05:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9d9a490 con 0x55f3b9eef580 2023-07-14T13:05:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9f05e30 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e84d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 0x55f3b9ef6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e8559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9eef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e8559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9eef040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50430/0 (socket says 172.21.15.17:50430) 2023-07-14T13:05:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e84d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 0x55f3b9ef6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57096/0 (socket says 172.21.15.17:57096) 2023-07-14T13:05:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e8559b700 1 -- 172.21.15.17:0/2656333941 learned_addr learned my addr 172.21.15.17:0/2656333941 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e85d9c700 1 --2- 172.21.15.17:0/2656333941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 0x55f3b9ef8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e8559b700 1 -- 172.21.15.17:0/2656333941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 msgr2=0x55f3b9ef6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e8559b700 1 --2- 172.21.15.17:0/2656333941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 0x55f3b9ef6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e8559b700 1 -- 172.21.15.17:0/2656333941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 msgr2=0x55f3b9ef8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e8559b700 1 --2- 172.21.15.17:0/2656333941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 0x55f3b9ef8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e8559b700 1 -- 172.21.15.17:0/2656333941 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3b9f0f720 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.189+0000 7f2e84d9a700 1 --2- 172.21.15.17:0/2656333941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 0x55f3b9ef6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.190+0000 7f2e8559b700 1 --2- 172.21.15.17:0/2656333941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9eef040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009810 tx=0x7f2e7c0bc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bdcc255654341a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.190+0000 7f2e6bfff700 1 -- 172.21.15.17:0/2656333941 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0b2070 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.190+0000 7f2e6bfff700 1 -- 172.21.15.17:0/2656333941 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e7c09f1a0 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.190+0000 7f2e6bfff700 1 -- 172.21.15.17:0/2656333941 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c004cc0 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.191+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2656333941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 msgr2=0x55f3b9eef040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.191+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2656333941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9eef040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009810 tx=0x7f2e7c0bc040 comp rx=0 tx=0).stop 2023-07-14T13:05:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.191+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2656333941 shutdown_connections 2023-07-14T13:05:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.191+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2656333941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9ef52d0 0x55f3b9ef8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.191+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2656333941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9eef040 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.191+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2656333941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9eef580 0x55f3b9ef6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.191+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2656333941 >> 172.21.15.17:0/2656333941 conn(0x55f3b9ee4be0 msgr2=0x55f3b9ef7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.191+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2656333941 shutdown_connections 2023-07-14T13:05:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.191+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2656333941 wait complete. 2023-07-14T13:05:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.191+0000 7f2e9b032b80 1 -- start start 2023-07-14T13:05:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e9b032b80 1 Processor -- start 2023-07-14T13:05:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9efbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9eef580 0x55f3b9efc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e9b032b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9ef52d0 0x55f3b9efc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9f5b5d0 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9f5b740 con 0x55f3b9ef52d0 2023-07-14T13:05:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e9b032b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b9f5b900 con 0x55f3b9eef580 2023-07-14T13:05:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e9b032b80 10 client.0 _ll_register_callbacks cb 0x7f2e70010c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e8559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9efbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e8559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9efbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46108/0 (socket says 172.21.15.17:46108) 2023-07-14T13:05:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e8559b700 1 -- 172.21.15.17:0/2271329305 learned_addr learned my addr 172.21.15.17:0/2271329305 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.192+0000 7f2e84d9a700 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9eef580 0x55f3b9efc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.193+0000 7f2e85d9c700 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9ef52d0 0x55f3b9efc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.193+0000 7f2e8559b700 1 -- 172.21.15.17:0/2271329305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9eef580 msgr2=0x55f3b9efc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.193+0000 7f2e8559b700 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9eef580 0x55f3b9efc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.193+0000 7f2e8559b700 1 -- 172.21.15.17:0/2271329305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9ef52d0 msgr2=0x55f3b9efc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.193+0000 7f2e8559b700 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9ef52d0 0x55f3b9efc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.193+0000 7f2e8559b700 1 -- 172.21.15.17:0/2271329305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c0c9040 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.193+0000 7f2e8559b700 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9efbde0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009c70 tx=0x7f2e7c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29fb1db5a3086f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.193+0000 7f2e68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:05:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.193+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2271329305 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0b2070 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.193+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2271329305 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2e7c0a34b0 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2271329305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e7c09b0f0 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2271329305 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e7c0cb590 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e9b032b80 10 client.16920 fetch_fsmap learned FSMap version 27 2023-07-14T13:05:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2271329305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f3b9c6ed80 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2271329305 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e7c09b0f0 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2271329305 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2e7c0c5890 con 0x55f3b9d4b6b0 2023-07-14T13:05:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e9b032b80 10 client.16920 fetch_fsmap finished waiting for FSMap version 27 2023-07-14T13:05:58.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e9b032b80 10 client.16920 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e9b032b80 20 client.16920 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3b9f5cb40 0x55f3b9f5ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e9b032b80 4 client.16920 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:05:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.194+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2271329305 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f3b9dfbff0 con 0x55f3b9f5cb40 2023-07-14T13:05:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.195+0000 7f2e84d9a700 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3b9f5cb40 0x55f3b9f5ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.196+0000 7f2e84d9a700 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3b9f5cb40 0x55f3b9f5ef20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99bd6e6e6046e0af server_cookie=355c41b6a24c1c49 in_seq=0 out_seq=0 2023-07-14T13:05:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.196+0000 7f2e68ff9700 10 client.16920 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.213+0000 7f2e68ff9700 1 -- 172.21.15.17:0/2271329305 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f3b9dfbff0 con 0x55f3b9f5cb40 2023-07-14T13:05:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.213+0000 7f2e68ff9700 10 client.16920 handle_command_reply: tid=0 2023-07-14T13:05:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.213+0000 7f2e9b032b80 1 client.16920 shutdown 2023-07-14T13:05:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.214+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2271329305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 msgr2=0x55f3b9efbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.214+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9efbde0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009c70 tx=0x7f2e7c009260 comp rx=0 tx=0).stop 2023-07-14T13:05:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.214+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2271329305 shutdown_connections 2023-07-14T13:05:58.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.214+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3b9f5cb40 0x55f3b9f5ef20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.214+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3b9ef52d0 0x55f3b9efc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.214+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3b9d4b6b0 0x55f3b9efbde0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.214+0000 7f2e9b032b80 1 --2- 172.21.15.17:0/2271329305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3b9eef580 0x55f3b9efc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.214+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2271329305 >> 172.21.15.17:0/2271329305 conn(0x55f3b9ee4be0 msgr2=0x55f3b9ef5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.214+0000 7f2e68ff9700 0 client.16920 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.214+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2271329305 shutdown_connections 2023-07-14T13:05:58.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.214+0000 7f2e9b032b80 1 -- 172.21.15.17:0/2271329305 wait complete. 2023-07-14T13:05:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.215+0000 7f2e9b032b80 20 client.16920 trim_cache size 0 max 16384 2023-07-14T13:05:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:05:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:05:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:05:58.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:05:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.215+0000 7f2e877ff700 1 -- 172.21.15.17:0/1799343177 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2e6c0a1340 msgr2=0x7f2e6c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.215+0000 7f2e877ff700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2e6c0a1340 0x7f2e6c0a37f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e80076210 tx=0x7f2e7000b410 comp rx=0 tx=0).stop 2023-07-14T13:05:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.215+0000 7f2e877ff700 1 -- 172.21.15.17:0/1799343177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e80101f30 msgr2=0x7f2e80074a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:58.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.215+0000 7f2e877ff700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e80101f30 0x7f2e80074a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009230 tx=0x7f2e7c00fa00 comp rx=0 tx=0).stop 2023-07-14T13:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.215+0000 7f2e877ff700 1 -- 172.21.15.17:0/1799343177 shutdown_connections 2023-07-14T13:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.215+0000 7f2e877ff700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2e6c0a1340 0x7f2e6c0a37f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.215+0000 7f2e877ff700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e80106f70 0x7f2e800754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.215+0000 7f2e877ff700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e80101f30 0x7f2e80074a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.215+0000 7f2e877ff700 1 --2- 172.21.15.17:0/1799343177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e801028d0 0x7f2e80074f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.215+0000 7f2e877ff700 1 -- 172.21.15.17:0/1799343177 >> 172.21.15.17:0/1799343177 conn(0x7f2e800fd780 msgr2=0x7f2e800fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.216+0000 7f2e877ff700 1 -- 172.21.15.17:0/1799343177 shutdown_connections 2023-07-14T13:05:58.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:05:58.216+0000 7f2e877ff700 1 -- 172.21.15.17:0/1799343177 wait complete. 2023-07-14T13:05:58.564 INFO:teuthology.orchestra.run.smithi017.stderr:23300000 of 50000000 tuples (46%) done (elapsed 348.17 s, remaining 398.97 s) 2023-07-14T13:05:59.403 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:05:59.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:05:59 smithi135 ceph-mon[97338]: pgmap v190: 97 pgs: 97 active+clean; 5.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 16 MiB/s wr, 47 op/s 2023-07-14T13:05:59.476 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:05:59 smithi017 ceph-mon[95536]: pgmap v190: 97 pgs: 97 active+clean; 5.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 16 MiB/s wr, 47 op/s 2023-07-14T13:05:59.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:05:59 smithi131 ceph-mon[96953]: pgmap v190: 97 pgs: 97 active+clean; 5.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 16 MiB/s wr, 47 op/s 2023-07-14T13:05:59.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.607+0000 7fec177ff700 1 -- 172.21.15.17:0/301993070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec10105ae0 msgr2=0x7fec10105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.607+0000 7fec177ff700 1 --2- 172.21.15.17:0/301993070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec10105ae0 0x7fec10105eb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009990 tx=0x7fec0c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.607+0000 7fec177ff700 1 -- 172.21.15.17:0/301993070 shutdown_connections 2023-07-14T13:05:59.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.607+0000 7fec177ff700 1 --2- 172.21.15.17:0/301993070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec10100480 0x7fec1010c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.607+0000 7fec177ff700 1 --2- 172.21.15.17:0/301993070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec10105ae0 0x7fec10105eb0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.607+0000 7fec177ff700 1 --2- 172.21.15.17:0/301993070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec100ffad0 0x7fec100fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.607+0000 7fec177ff700 1 -- 172.21.15.17:0/301993070 >> 172.21.15.17:0/301993070 conn(0x7fec100fb5f0 msgr2=0x7fec100fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:59.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.607+0000 7fec177ff700 1 -- 172.21.15.17:0/301993070 shutdown_connections 2023-07-14T13:05:59.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.607+0000 7fec177ff700 1 -- 172.21.15.17:0/301993070 wait complete. 2023-07-14T13:05:59.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.608+0000 7fec177ff700 1 Processor -- start 2023-07-14T13:05:59.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec177ff700 1 -- start start 2023-07-14T13:05:59.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec177ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec100ffad0 0x7fec10072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec177ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec10100480 0x7fec10072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec177ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec10105ae0 0x7fec101a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec177ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec10073580 con 0x7fec100ffad0 2023-07-14T13:05:59.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec177ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec101a4260 con 0x7fec10105ae0 2023-07-14T13:05:59.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec177ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec101a43a0 con 0x7fec10100480 2023-07-14T13:05:59.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec1559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec100ffad0 0x7fec10072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec14d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec10100480 0x7fec10072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec1559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec100ffad0 0x7fec10072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46128/0 (socket says 172.21.15.17:46128) 2023-07-14T13:05:59.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec1559b700 1 -- 172.21.15.17:0/912501065 learned_addr learned my addr 172.21.15.17:0/912501065 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:59.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec14d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec10100480 0x7fec10072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50460/0 (socket says 172.21.15.17:50460) 2023-07-14T13:05:59.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.609+0000 7fec15d9c700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec10105ae0 0x7fec101a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.610+0000 7fec1559b700 1 -- 172.21.15.17:0/912501065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec10100480 msgr2=0x7fec10072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.610+0000 7fec1559b700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec10100480 0x7fec10072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.610+0000 7fec1559b700 1 -- 172.21.15.17:0/912501065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec10105ae0 msgr2=0x7fec101a3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.610+0000 7fec1559b700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec10105ae0 0x7fec101a3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.610+0000 7fec1559b700 1 -- 172.21.15.17:0/912501065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0095f0 con 0x7fec100ffad0 2023-07-14T13:05:59.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.610+0000 7fec14d9a700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec10100480 0x7fec10072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:59.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.610+0000 7fec1559b700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec100ffad0 0x7fec10072810 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fec0c000c00 tx=0x7fec0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.610+0000 7fec067fc700 1 -- 172.21.15.17:0/912501065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c01d070 con 0x7fec100ffad0 2023-07-14T13:05:59.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.610+0000 7fec177ff700 1 -- 172.21.15.17:0/912501065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec101a45a0 con 0x7fec100ffad0 2023-07-14T13:05:59.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.610+0000 7fec067fc700 1 -- 172.21.15.17:0/912501065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec0c022470 con 0x7fec100ffad0 2023-07-14T13:05:59.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.611+0000 7fec067fc700 1 -- 172.21.15.17:0/912501065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c017650 con 0x7fec100ffad0 2023-07-14T13:05:59.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.611+0000 7fec177ff700 1 -- 172.21.15.17:0/912501065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec101a49c0 con 0x7fec100ffad0 2023-07-14T13:05:59.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.614+0000 7fec067fc700 1 -- 172.21.15.17:0/912501065 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fec0c0225e0 con 0x7fec100ffad0 2023-07-14T13:05:59.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.615+0000 7fec2b112b80 1 Processor -- start 2023-07-14T13:05:59.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec2b112b80 1 -- start start 2023-07-14T13:05:59.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 0x55c14047d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c140488590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c14048aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec2b112b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c140383cb0 con 0x55c140488ad0 2023-07-14T13:05:59.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec2b112b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1403d6a40 con 0x55c14047dbe0 2023-07-14T13:05:59.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec2b112b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1403cfed0 con 0x55c14047d2d0 2023-07-14T13:05:59.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec067fc700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febfc0a12c0 0x7febfc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec1559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c140488590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec1559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c140488590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57132/0 (socket says 172.21.15.17:57132) 2023-07-14T13:05:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec1559b700 1 -- 172.21.15.17:0/1729991118 learned_addr learned my addr 172.21.15.17:0/1729991118 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:59.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.616+0000 7fec15d9c700 1 --2- 172.21.15.17:0/1729991118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 0x55c14047d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7fec14d9a700 1 --2- 172.21.15.17:0/1729991118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c14048aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7fec15d9c700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febfc0a12c0 0x7febfc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7fec1559b700 1 -- 172.21.15.17:0/1729991118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 msgr2=0x55c14047d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:59.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7fec1559b700 1 --2- 172.21.15.17:0/1729991118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 0x55c14047d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7fec1559b700 1 -- 172.21.15.17:0/1729991118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 msgr2=0x55c14048aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:59.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7fec1559b700 1 --2- 172.21.15.17:0/1729991118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c14048aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7fec067fc700 1 -- 172.21.15.17:0/912501065 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fec0c0ce130 con 0x7fec100ffad0 2023-07-14T13:05:59.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7fec1559b700 1 -- 172.21.15.17:0/1729991118 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1401fdde0 con 0x55c14047dbe0 2023-07-14T13:05:59.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7fec15d9c700 1 --2- 172.21.15.17:0/1729991118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 0x55c14047d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:05:59.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7fec1559b700 1 --2- 172.21.15.17:0/1729991118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c140488590 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0977e0 tx=0x7fec0c02a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2bc5b300d1fb6ff server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7fec15d9c700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febfc0a12c0 0x7febfc0a3770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fec10074920 tx=0x7fec08009100 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.617+0000 7febfb7fe700 1 -- 172.21.15.17:0/1729991118 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c09ac40 con 0x55c14047dbe0 2023-07-14T13:05:59.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.618+0000 7febfb7fe700 1 -- 172.21.15.17:0/1729991118 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec0c0228c0 con 0x55c14047dbe0 2023-07-14T13:05:59.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.618+0000 7febfb7fe700 1 -- 172.21.15.17:0/1729991118 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c09b540 con 0x55c14047dbe0 2023-07-14T13:05:59.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.618+0000 7fec2b112b80 1 -- 172.21.15.17:0/1729991118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 msgr2=0x55c140488590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.618+0000 7fec2b112b80 1 --2- 172.21.15.17:0/1729991118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c140488590 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0977e0 tx=0x7fec0c02a000 comp rx=0 tx=0).stop 2023-07-14T13:05:59.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.618+0000 7fec2b112b80 1 -- 172.21.15.17:0/1729991118 shutdown_connections 2023-07-14T13:05:59.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.618+0000 7fec2b112b80 1 --2- 172.21.15.17:0/1729991118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c14048aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.618+0000 7fec2b112b80 1 --2- 172.21.15.17:0/1729991118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 0x55c14047d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.618+0000 7fec2b112b80 1 --2- 172.21.15.17:0/1729991118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c140488590 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.618+0000 7fec2b112b80 1 -- 172.21.15.17:0/1729991118 >> 172.21.15.17:0/1729991118 conn(0x55c140473da0 msgr2=0x55c1404796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:59.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.618+0000 7fec2b112b80 1 -- 172.21.15.17:0/1729991118 shutdown_connections 2023-07-14T13:05:59.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.618+0000 7fec2b112b80 1 -- 172.21.15.17:0/1729991118 wait complete. 2023-07-14T13:05:59.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.619+0000 7fec2b112b80 1 -- start start 2023-07-14T13:05:59.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.619+0000 7fec2b112b80 1 Processor -- start 2023-07-14T13:05:59.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c14047d2d0 0x55c14048db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c14048e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c140488ad0 0x55c1404879b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec2b112b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c14036fac0 con 0x55c14047d2d0 2023-07-14T13:05:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec2b112b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c14036f7c0 con 0x55c14047dbe0 2023-07-14T13:05:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec2b112b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c140253920 con 0x55c140488ad0 2023-07-14T13:05:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec2b112b80 10 client.0 _ll_register_callbacks cb 0x55c14036d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec1559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c14047d2d0 0x55c14048db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec1559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c14047d2d0 0x55c14048db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46154/0 (socket says 172.21.15.17:46154) 2023-07-14T13:05:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec1559b700 1 -- 172.21.15.17:0/1287899861 learned_addr learned my addr 172.21.15.17:0/1287899861 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec15d9c700 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c140488ad0 0x55c1404879b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.620+0000 7fec14d9a700 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c14048e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.621+0000 7fec1559b700 1 -- 172.21.15.17:0/1287899861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c140488ad0 msgr2=0x55c1404879b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.621+0000 7fec1559b700 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c140488ad0 0x55c1404879b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.621+0000 7fec1559b700 1 -- 172.21.15.17:0/1287899861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 msgr2=0x55c14048e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.621+0000 7fec1559b700 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c14048e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.621+0000 7fec1559b700 1 -- 172.21.15.17:0/1287899861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec101a49c0 con 0x55c14047d2d0 2023-07-14T13:05:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.621+0000 7fec15d9c700 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c140488ad0 0x55c1404879b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:05:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.621+0000 7fec1559b700 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c14047d2d0 0x55c14048db30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0a3170 tx=0x7fec0c0ce3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3a0474cf0eef77 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.621+0000 7febf8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:05:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.621+0000 7febf8ff9700 1 -- 172.21.15.17:0/1287899861 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c09ac40 con 0x55c14047d2d0 2023-07-14T13:05:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.621+0000 7fec2b112b80 1 -- 172.21.15.17:0/1287899861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1403294f0 con 0x55c14047d2d0 2023-07-14T13:05:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.621+0000 7febf8ff9700 1 -- 172.21.15.17:0/1287899861 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fec0c09b2e0 con 0x55c14047d2d0 2023-07-14T13:05:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.622+0000 7febf8ff9700 1 -- 172.21.15.17:0/1287899861 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec0c0a36a0 con 0x55c14047d2d0 2023-07-14T13:05:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.622+0000 7fec2b112b80 10 client.16932 fetch_fsmap learned FSMap version 28 2023-07-14T13:05:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.622+0000 7fec2b112b80 1 -- 172.21.15.17:0/1287899861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55c1401e6c60 con 0x55c14047d2d0 2023-07-14T13:05:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.622+0000 7febf8ff9700 1 -- 172.21.15.17:0/1287899861 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c1403294f0 con 0x55c14047d2d0 2023-07-14T13:05:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.622+0000 7febf8ff9700 1 -- 172.21.15.17:0/1287899861 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fec0c0970d0 con 0x55c14047d2d0 2023-07-14T13:05:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.622+0000 7fec2b112b80 10 client.16932 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T13:05:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.622+0000 7fec2b112b80 10 client.16932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.622+0000 7fec2b112b80 20 client.16932 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:59.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.622+0000 7fec2b112b80 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c140497bf0 0x55c140499fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.622+0000 7fec2b112b80 4 client.16932 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:05:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.622+0000 7fec2b112b80 1 -- 172.21.15.17:0/1287899861 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1403c8eb0 con 0x55c140497bf0 2023-07-14T13:05:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.623+0000 7fec14d9a700 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c140497bf0 0x55c140499fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.623+0000 7fec14d9a700 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c140497bf0 0x55c140499fd0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5f428c24972bbad server_cookie=69d941c6c5774bb2 in_seq=0 out_seq=0 2023-07-14T13:05:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.623+0000 7febf8ff9700 10 client.16932 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7febf8ff9700 1 -- 172.21.15.17:0/1287899861 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c1403c8eb0 con 0x55c140497bf0 2023-07-14T13:05:59.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7febf8ff9700 10 client.16932 handle_command_reply: tid=0 2023-07-14T13:05:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7fec2b112b80 1 client.16932 shutdown 2023-07-14T13:05:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7fec2b112b80 1 -- 172.21.15.17:0/1287899861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c14047d2d0 msgr2=0x55c14048db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7fec2b112b80 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c14047d2d0 0x55c14048db30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0a3170 tx=0x7fec0c0ce3e0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7fec2b112b80 1 -- 172.21.15.17:0/1287899861 shutdown_connections 2023-07-14T13:05:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7fec2b112b80 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c140497bf0 0x55c140499fd0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7fec2b112b80 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c140488ad0 0x55c1404879b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7fec2b112b80 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c14047d2d0 0x55c14048db30 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7febf8ff9700 0 client.16932 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:59.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7fec2b112b80 1 --2- 172.21.15.17:0/1287899861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c14048e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.624+0000 7fec2b112b80 1 -- 172.21.15.17:0/1287899861 >> 172.21.15.17:0/1287899861 conn(0x55c140473da0 msgr2=0x55c140479290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:59.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.625+0000 7fec2b112b80 1 -- 172.21.15.17:0/1287899861 shutdown_connections 2023-07-14T13:05:59.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.625+0000 7fec2b112b80 1 -- 172.21.15.17:0/1287899861 wait complete. 2023-07-14T13:05:59.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.625+0000 7fec2b112b80 20 client.16932 trim_cache size 0 max 16384 2023-07-14T13:05:59.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.644+0000 7fec2b112b80 1 Processor -- start 2023-07-14T13:05:59.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.644+0000 7fec2b112b80 1 -- start start 2023-07-14T13:05:59.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.644+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 0x55c140487960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.644+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c140482240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.644+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c14048d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.644+0000 7fec2b112b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c14047e590 con 0x55c140488ad0 2023-07-14T13:05:59.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.644+0000 7fec2b112b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c140489390 con 0x55c14047dbe0 2023-07-14T13:05:59.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.644+0000 7fec2b112b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c140473970 con 0x55c14047d2d0 2023-07-14T13:05:59.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.645+0000 7fec1559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 0x55c140487960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.645+0000 7fec15d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c14048d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.645+0000 7fec14d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c140482240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.645+0000 7fec1559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 0x55c140487960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50478/0 (socket says 172.21.15.17:50478) 2023-07-14T13:05:59.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.645+0000 7fec1559b700 1 -- 172.21.15.17:0/245210353 learned_addr learned my addr 172.21.15.17:0/245210353 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:59.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.645+0000 7fec1559b700 1 -- 172.21.15.17:0/245210353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 msgr2=0x55c140482240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:59.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.645+0000 7fec1559b700 1 --2- 172.21.15.17:0/245210353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c140482240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.645+0000 7fec1559b700 1 -- 172.21.15.17:0/245210353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 msgr2=0x55c14048d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:59.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.645+0000 7fec1559b700 1 --2- 172.21.15.17:0/245210353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c14048d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.645+0000 7fec1559b700 1 -- 172.21.15.17:0/245210353 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c140224250 con 0x55c14047d2d0 2023-07-14T13:05:59.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.645+0000 7fec1559b700 1 --2- 172.21.15.17:0/245210353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 0x55c140487960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0977e0 tx=0x7fec0c097530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4e98aa64d7914fc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.646+0000 7febfbfff700 1 -- 172.21.15.17:0/245210353 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0092b0 con 0x55c14047d2d0 2023-07-14T13:05:59.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.646+0000 7febfbfff700 1 -- 172.21.15.17:0/245210353 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec0c09ac40 con 0x55c14047d2d0 2023-07-14T13:05:59.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.646+0000 7febfbfff700 1 -- 172.21.15.17:0/245210353 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0970d0 con 0x55c14047d2d0 2023-07-14T13:05:59.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.646+0000 7fec2b112b80 1 -- 172.21.15.17:0/245210353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 msgr2=0x55c140487960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.646+0000 7fec2b112b80 1 --2- 172.21.15.17:0/245210353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 0x55c140487960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0977e0 tx=0x7fec0c097530 comp rx=0 tx=0).stop 2023-07-14T13:05:59.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.647+0000 7fec2b112b80 1 -- 172.21.15.17:0/245210353 shutdown_connections 2023-07-14T13:05:59.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.647+0000 7fec2b112b80 1 --2- 172.21.15.17:0/245210353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c14048d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.647+0000 7fec2b112b80 1 --2- 172.21.15.17:0/245210353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047d2d0 0x55c140487960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.647+0000 7fec2b112b80 1 --2- 172.21.15.17:0/245210353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047dbe0 0x55c140482240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.647+0000 7fec2b112b80 1 -- 172.21.15.17:0/245210353 >> 172.21.15.17:0/245210353 conn(0x55c140473da0 msgr2=0x55c140487250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:59.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.647+0000 7fec2b112b80 1 -- 172.21.15.17:0/245210353 shutdown_connections 2023-07-14T13:05:59.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.647+0000 7fec2b112b80 1 -- 172.21.15.17:0/245210353 wait complete. 2023-07-14T13:05:59.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.647+0000 7fec2b112b80 1 -- start start 2023-07-14T13:05:59.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.647+0000 7fec2b112b80 1 Processor -- start 2023-07-14T13:05:59.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047d2d0 0x55c1404dfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047dbe0 0x55c1404e0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec2b112b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c1404eaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec2b112b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1404eafd0 con 0x55c140488ad0 2023-07-14T13:05:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec2b112b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1404eb110 con 0x55c14047d2d0 2023-07-14T13:05:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec2b112b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1404eb250 con 0x55c14047dbe0 2023-07-14T13:05:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec2b112b80 10 client.0 _ll_register_callbacks cb 0x7fec0c09b0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:05:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec14d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047dbe0 0x55c1404e0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec1559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047d2d0 0x55c1404dfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec14d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047dbe0 0x55c1404e0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50492/0 (socket says 172.21.15.17:50492) 2023-07-14T13:05:59.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec15d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c1404eaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec14d9a700 1 -- 172.21.15.17:0/2637259416 learned_addr learned my addr 172.21.15.17:0/2637259416 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:05:59.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.648+0000 7fec1559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047d2d0 0x55c1404dfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57154/0 (socket says 172.21.15.17:57154) 2023-07-14T13:05:59.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.649+0000 7fec14d9a700 1 -- 172.21.15.17:0/2637259416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047d2d0 msgr2=0x55c1404dfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:59.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.649+0000 7fec14d9a700 1 --2- 172.21.15.17:0/2637259416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047d2d0 0x55c1404dfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.649+0000 7fec14d9a700 1 -- 172.21.15.17:0/2637259416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 msgr2=0x55c1404eaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:05:59.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.649+0000 7fec14d9a700 1 --2- 172.21.15.17:0/2637259416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c1404eaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.649+0000 7fec14d9a700 1 -- 172.21.15.17:0/2637259416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1401e6c60 con 0x55c14047dbe0 2023-07-14T13:05:59.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.649+0000 7fec14d9a700 1 --2- 172.21.15.17:0/2637259416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047dbe0 0x55c1404e0140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55c140489330 tx=0x7fec00012450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6ff9ce5d3302773 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:05:59.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.649+0000 7febf8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:05:59.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.649+0000 7febf8ff9700 1 -- 172.21.15.17:0/2637259416 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00017040 con 0x55c14047dbe0 2023-07-14T13:05:59.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7fec2b112b80 1 -- 172.21.15.17:0/2637259416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec0c0228c0 con 0x55c14047dbe0 2023-07-14T13:05:59.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7febf8ff9700 1 -- 172.21.15.17:0/2637259416 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fec000204e0 con 0x55c14047dbe0 2023-07-14T13:05:59.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7febf8ff9700 1 -- 172.21.15.17:0/2637259416 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec00004830 con 0x55c14047dbe0 2023-07-14T13:05:59.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7fec2b112b80 10 client.26629 fetch_fsmap learned FSMap version 28 2023-07-14T13:05:59.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7fec2b112b80 1 -- 172.21.15.17:0/2637259416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55c1401fc2b0 con 0x55c14047dbe0 2023-07-14T13:05:59.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7febf8ff9700 1 -- 172.21.15.17:0/2637259416 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec0c0228c0 con 0x55c14047dbe0 2023-07-14T13:05:59.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7febf8ff9700 1 -- 172.21.15.17:0/2637259416 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fec00005580 con 0x55c14047dbe0 2023-07-14T13:05:59.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7fec2b112b80 10 client.26629 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T13:05:59.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7fec2b112b80 10 client.26629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:05:59.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7fec2b112b80 20 client.26629 populate_metadata read hostname 'smithi017' 2023-07-14T13:05:59.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7fec2b112b80 1 --2- 172.21.15.17:0/2637259416 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c1404ec940 0x55c1404eed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:05:59.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7fec2b112b80 4 client.26629 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:05:59.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.650+0000 7fec2b112b80 1 -- 172.21.15.17:0/2637259416 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c14038b050 con 0x55c1404ec940 2023-07-14T13:05:59.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.651+0000 7fec1559b700 1 --2- 172.21.15.17:0/2637259416 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c1404ec940 0x55c1404eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:05:59.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec1559b700 1 --2- 172.21.15.17:0/2637259416 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c1404ec940 0x55c1404eed50 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c33024180e7f313 server_cookie=2379ef01a69054d in_seq=0 out_seq=0 2023-07-14T13:05:59.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7febf8ff9700 10 client.26629 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:59.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7febf8ff9700 1 -- 172.21.15.17:0/2637259416 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c14038b050 con 0x55c1404ec940 2023-07-14T13:05:59.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7febf8ff9700 10 client.26629 handle_command_reply: tid=0 2023-07-14T13:05:59.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 1 client.26629 shutdown 2023-07-14T13:05:59.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 1 -- 172.21.15.17:0/2637259416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047dbe0 msgr2=0x55c1404e0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 1 --2- 172.21.15.17:0/2637259416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047dbe0 0x55c1404e0140 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55c140489330 tx=0x7fec00012450 comp rx=0 tx=0).stop 2023-07-14T13:05:59.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 1 -- 172.21.15.17:0/2637259416 shutdown_connections 2023-07-14T13:05:59.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 1 --2- 172.21.15.17:0/2637259416 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c1404ec940 0x55c1404eed50 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 1 --2- 172.21.15.17:0/2637259416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c140488ad0 0x55c1404eaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 1 --2- 172.21.15.17:0/2637259416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c14047d2d0 0x55c1404dfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 1 --2- 172.21.15.17:0/2637259416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c14047dbe0 0x55c1404e0140 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7febf8ff9700 0 client.26629 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:05:59.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 1 -- 172.21.15.17:0/2637259416 >> 172.21.15.17:0/2637259416 conn(0x55c140473da0 msgr2=0x55c140479140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:59.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 1 -- 172.21.15.17:0/2637259416 shutdown_connections 2023-07-14T13:05:59.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 1 -- 172.21.15.17:0/2637259416 wait complete. 2023-07-14T13:05:59.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.652+0000 7fec2b112b80 20 client.26629 trim_cache size 0 max 16384 2023-07-14T13:05:59.694 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:05:59.694 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:05:59.694 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:05:59.694 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:05:59.695 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:05:59.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:05:59.695 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:05:59.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:05:59.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:05:59.695 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:05:59.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 -- 172.21.15.17:0/912501065 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febfc0a12c0 msgr2=0x7febfc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febfc0a12c0 0x7febfc0a3770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fec10074920 tx=0x7fec08009100 comp rx=0 tx=0).stop 2023-07-14T13:05:59.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 -- 172.21.15.17:0/912501065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec100ffad0 msgr2=0x7fec10072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:05:59.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec100ffad0 0x7fec10072810 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fec0c000c00 tx=0x7fec0c004730 comp rx=0 tx=0).stop 2023-07-14T13:05:59.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 -- 172.21.15.17:0/912501065 shutdown_connections 2023-07-14T13:05:59.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febfc0a12c0 0x7febfc0a3770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fec10105ae0 0x7fec101a3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec100ffad0 0x7fec10072810 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 --2- 172.21.15.17:0/912501065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec10100480 0x7fec10072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:05:59.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 -- 172.21.15.17:0/912501065 >> 172.21.15.17:0/912501065 conn(0x7fec100fb5f0 msgr2=0x7fec100fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:05:59.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 -- 172.21.15.17:0/912501065 shutdown_connections 2023-07-14T13:05:59.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:05:59.653+0000 7fec177ff700 1 -- 172.21.15.17:0/912501065 wait complete. 2023-07-14T13:05:59.706 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:05:59.933 INFO:teuthology.orchestra.run.smithi017.stderr:23400000 of 50000000 tuples (46%) done (elapsed 349.54 s, remaining 397.33 s) 2023-07-14T13:06:00.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:00 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:00.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:00 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:06:00.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:00 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:00.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:00 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:06:00.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:00 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:00.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:00 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:06:01.412 INFO:teuthology.orchestra.run.smithi017.stderr:23500000 of 50000000 tuples (47%) done (elapsed 351.01 s, remaining 395.82 s) 2023-07-14T13:06:01.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:01 smithi135 ceph-mon[97338]: pgmap v191: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 27 MiB/s wr, 78 op/s 2023-07-14T13:06:01.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:01 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:06:01.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:01 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:06:01.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:01 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:06:01.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:01 smithi131 ceph-mon[96953]: pgmap v191: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 27 MiB/s wr, 78 op/s 2023-07-14T13:06:01.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:01 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:06:01.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:01 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:06:01.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:01 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:06:01.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:01 smithi017 ceph-mon[95536]: pgmap v191: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 27 MiB/s wr, 78 op/s 2023-07-14T13:06:01.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:01 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:06:01.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:01 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:06:01.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:01 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:06:02.824 INFO:teuthology.orchestra.run.smithi017.stderr:23600000 of 50000000 tuples (47%) done (elapsed 352.43 s, remaining 394.24 s) 2023-07-14T13:06:03.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:03 smithi135 ceph-mon[97338]: pgmap v192: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 61 op/s 2023-07-14T13:06:03.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:03 smithi131 ceph-mon[96953]: pgmap v192: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 61 op/s 2023-07-14T13:06:03.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:03 smithi017 ceph-mon[95536]: pgmap v192: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 61 op/s 2023-07-14T13:06:04.137 INFO:teuthology.orchestra.run.smithi017.stderr:23700000 of 50000000 tuples (47%) done (elapsed 353.74 s, remaining 392.55 s) 2023-07-14T13:06:05.449 INFO:teuthology.orchestra.run.smithi017.stderr:23800000 of 50000000 tuples (47%) done (elapsed 355.05 s, remaining 390.85 s) 2023-07-14T13:06:05.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:05 smithi135 ceph-mon[97338]: pgmap v193: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 61 op/s 2023-07-14T13:06:05.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:05 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:05.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:05 smithi135 ceph-mon[97338]: osdmap e90: 12 total, 12 up, 12 in 2023-07-14T13:06:05.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:05 smithi131 ceph-mon[96953]: pgmap v193: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 61 op/s 2023-07-14T13:06:05.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:05 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:05.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:05 smithi131 ceph-mon[96953]: osdmap e90: 12 total, 12 up, 12 in 2023-07-14T13:06:05.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:05 smithi017 ceph-mon[95536]: pgmap v193: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 61 op/s 2023-07-14T13:06:05.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:05 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:05.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:05 smithi017 ceph-mon[95536]: osdmap e90: 12 total, 12 up, 12 in 2023-07-14T13:06:06.748 INFO:teuthology.orchestra.run.smithi017.stderr:23900000 of 50000000 tuples (47%) done (elapsed 356.35 s, remaining 389.15 s) 2023-07-14T13:06:07.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:07 smithi135 ceph-mon[97338]: pgmap v195: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 26 MiB/s wr, 95 op/s 2023-07-14T13:06:07.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:07 smithi131 ceph-mon[96953]: pgmap v195: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 26 MiB/s wr, 95 op/s 2023-07-14T13:06:07.506 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:07 smithi017 ceph-mon[95536]: pgmap v195: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 26 MiB/s wr, 95 op/s 2023-07-14T13:06:08.214 INFO:teuthology.orchestra.run.smithi017.stderr:24000000 of 50000000 tuples (48%) done (elapsed 357.82 s, remaining 387.63 s) 2023-07-14T13:06:09.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:09 smithi135 ceph-mon[97338]: pgmap v196: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 26 MiB/s wr, 95 op/s 2023-07-14T13:06:09.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:09 smithi131 ceph-mon[96953]: pgmap v196: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 26 MiB/s wr, 95 op/s 2023-07-14T13:06:09.520 INFO:teuthology.orchestra.run.smithi017.stderr:24100000 of 50000000 tuples (48%) done (elapsed 359.12 s, remaining 385.94 s) 2023-07-14T13:06:09.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:09 smithi017 ceph-mon[95536]: pgmap v196: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 26 MiB/s wr, 95 op/s 2023-07-14T13:06:10.861 INFO:teuthology.orchestra.run.smithi017.stderr:24200000 of 50000000 tuples (48%) done (elapsed 360.46 s, remaining 384.29 s) 2023-07-14T13:06:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.390+0000 7f9c037ff700 1 -- 172.21.15.17:0/1207668445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bfc10c540 msgr2=0x7f9bfc10e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.390+0000 7f9c037ff700 1 --2- 172.21.15.17:0/1207668445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bfc10c540 0x7f9bfc10e920 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400b0a0 tx=0x7f9bf400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.390+0000 7f9c037ff700 1 -- 172.21.15.17:0/1207668445 shutdown_connections 2023-07-14T13:06:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.390+0000 7f9c037ff700 1 --2- 172.21.15.17:0/1207668445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bfc10c540 0x7f9bfc10e920 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.390+0000 7f9c037ff700 1 --2- 172.21.15.17:0/1207668445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bfc0679a0 0x7f9bfc067d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.390+0000 7f9c037ff700 1 --2- 172.21.15.17:0/1207668445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bfc0682b0 0x7f9bfc10c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.390+0000 7f9c037ff700 1 -- 172.21.15.17:0/1207668445 >> 172.21.15.17:0/1207668445 conn(0x7f9bfc074760 msgr2=0x7f9bfc074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.390+0000 7f9c037ff700 1 -- 172.21.15.17:0/1207668445 shutdown_connections 2023-07-14T13:06:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.390+0000 7f9c037ff700 1 -- 172.21.15.17:0/1207668445 wait complete. 2023-07-14T13:06:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.391+0000 7f9c037ff700 1 Processor -- start 2023-07-14T13:06:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c037ff700 1 -- start start 2023-07-14T13:06:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c037ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bfc0679a0 0x7f9bfc197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c037ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bfc0682b0 0x7f9bfc198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c037ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bfc10c540 0x7f9bfc19caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c037ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc19d0e0 con 0x7f9bfc10c540 2023-07-14T13:06:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c037ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc19d250 con 0x7f9bfc0682b0 2023-07-14T13:06:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c037ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc19d410 con 0x7f9bfc0679a0 2023-07-14T13:06:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c0159b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bfc0679a0 0x7f9bfc197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c0159b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bfc0679a0 0x7f9bfc197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:36202/0 (socket says 172.21.15.17:36202) 2023-07-14T13:06:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c0159b700 1 -- 172.21.15.17:0/2480171681 learned_addr learned my addr 172.21.15.17:0/2480171681 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c00d9a700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bfc0682b0 0x7f9bfc198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.392+0000 7f9c01d9c700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bfc10c540 0x7f9bfc19caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.393+0000 7f9c0159b700 1 -- 172.21.15.17:0/2480171681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bfc0682b0 msgr2=0x7f9bfc198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.393+0000 7f9c0159b700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bfc0682b0 0x7f9bfc198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.393+0000 7f9c0159b700 1 -- 172.21.15.17:0/2480171681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bfc10c540 msgr2=0x7f9bfc19caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.393+0000 7f9c0159b700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bfc10c540 0x7f9bfc19caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.393+0000 7f9c0159b700 1 -- 172.21.15.17:0/2480171681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf4009d00 con 0x7f9bfc0679a0 2023-07-14T13:06:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.393+0000 7f9c00d9a700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bfc0682b0 0x7f9bfc198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.393+0000 7f9c01d9c700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bfc10c540 0x7f9bfc19caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.393+0000 7f9c0159b700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bfc0679a0 0x7f9bfc197ef0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800e9a0 tx=0x7f9bf800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.393+0000 7f9bf27fc700 1 -- 172.21.15.17:0/2480171681 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8009790 con 0x7f9bfc0679a0 2023-07-14T13:06:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.393+0000 7f9bf27fc700 1 -- 172.21.15.17:0/2480171681 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bf8010430 con 0x7f9bfc0679a0 2023-07-14T13:06:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.394+0000 7f9c037ff700 1 -- 172.21.15.17:0/2480171681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bfc19d6f0 con 0x7f9bfc0679a0 2023-07-14T13:06:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.394+0000 7f9bf27fc700 1 -- 172.21.15.17:0/2480171681 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf800cea0 con 0x7f9bfc0679a0 2023-07-14T13:06:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.394+0000 7f9c037ff700 1 -- 172.21.15.17:0/2480171681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bfc1a4f30 con 0x7f9bfc0679a0 2023-07-14T13:06:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.398+0000 7f9bf27fc700 1 -- 172.21.15.17:0/2480171681 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9bf80105a0 con 0x7f9bfc0679a0 2023-07-14T13:06:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.398+0000 7f9c17192b80 1 Processor -- start 2023-07-14T13:06:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.399+0000 7f9c17192b80 1 -- start start 2023-07-14T13:06:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.399+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 0x558458d13d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.399+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d142d0 0x558458d0e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.399+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458d0e580 0x558458d0e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.399+0000 7f9c17192b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458c13c50 con 0x558458b6a6b0 2023-07-14T13:06:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.399+0000 7f9c17192b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458c669e0 con 0x558458d0e580 2023-07-14T13:06:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.399+0000 7f9c17192b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458c5fe70 con 0x558458d142d0 2023-07-14T13:06:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9c01d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 0x558458d13d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9c01d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 0x558458d13d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35064/0 (socket says 172.21.15.17:35064) 2023-07-14T13:06:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9c01d9c700 1 -- 172.21.15.17:0/2439223216 learned_addr learned my addr 172.21.15.17:0/2439223216 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9c0159b700 1 --2- 172.21.15.17:0/2439223216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d142d0 0x558458d0e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9c00d9a700 1 --2- 172.21.15.17:0/2439223216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458d0e580 0x558458d0e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9c01d9c700 1 -- 172.21.15.17:0/2439223216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d142d0 msgr2=0x558458d0e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9c01d9c700 1 --2- 172.21.15.17:0/2439223216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d142d0 0x558458d0e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9c01d9c700 1 -- 172.21.15.17:0/2439223216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458d0e580 msgr2=0x558458d0e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9c01d9c700 1 --2- 172.21.15.17:0/2439223216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458d0e580 0x558458d0e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9bf27fc700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9be80a12c0 0x7f9be80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9c01d9c700 1 -- 172.21.15.17:0/2439223216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558458a8dd80 con 0x558458b6a6b0 2023-07-14T13:06:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9c0159b700 1 --2- 172.21.15.17:0/2439223216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d142d0 0x558458d0e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.400+0000 7f9bf27fc700 1 -- 172.21.15.17:0/2480171681 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9bf8014070 con 0x7f9bfc0679a0 2023-07-14T13:06:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.401+0000 7f9c01d9c700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9be80a12c0 0x7f9be80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.401+0000 7f9c01d9c700 1 --2- 172.21.15.17:0/2439223216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 0x558458d13d90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400b0a0 tx=0x7f9bf4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a98b15a534415 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.401+0000 7f9be77fe700 1 -- 172.21.15.17:0/2439223216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400e040 con 0x558458b6a6b0 2023-07-14T13:06:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.401+0000 7f9be77fe700 1 -- 172.21.15.17:0/2439223216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bf4007660 con 0x558458b6a6b0 2023-07-14T13:06:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.401+0000 7f9be77fe700 1 -- 172.21.15.17:0/2439223216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40054d0 con 0x558458b6a6b0 2023-07-14T13:06:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.402+0000 7f9c17192b80 1 -- 172.21.15.17:0/2439223216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 msgr2=0x558458d13d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.402+0000 7f9c01d9c700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9be80a12c0 0x7f9be80a3770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4028000 tx=0x7f9bf402b000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.402+0000 7f9c17192b80 1 --2- 172.21.15.17:0/2439223216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 0x558458d13d90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400b0a0 tx=0x7f9bf4009b80 comp rx=0 tx=0).stop 2023-07-14T13:06:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.402+0000 7f9c17192b80 1 -- 172.21.15.17:0/2439223216 shutdown_connections 2023-07-14T13:06:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.402+0000 7f9c17192b80 1 --2- 172.21.15.17:0/2439223216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458d0e580 0x558458d0e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.402+0000 7f9c17192b80 1 --2- 172.21.15.17:0/2439223216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 0x558458d13d90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.402+0000 7f9c17192b80 1 --2- 172.21.15.17:0/2439223216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d142d0 0x558458d0e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.402+0000 7f9c17192b80 1 -- 172.21.15.17:0/2439223216 >> 172.21.15.17:0/2439223216 conn(0x558458d03be0 msgr2=0x558458d08f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.402+0000 7f9c17192b80 1 -- 172.21.15.17:0/2439223216 shutdown_connections 2023-07-14T13:06:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.402+0000 7f9c17192b80 1 -- 172.21.15.17:0/2439223216 wait complete. 2023-07-14T13:06:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.403+0000 7f9c17192b80 1 -- start start 2023-07-14T13:06:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.403+0000 7f9c17192b80 1 Processor -- start 2023-07-14T13:06:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.404+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 0x558458d1a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.404+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d177a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.404+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 0x558458d17d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.404+0000 7f9c17192b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458bffa60 con 0x558458d142d0 2023-07-14T13:06:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.404+0000 7f9c17192b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458bff760 con 0x558458b6a6b0 2023-07-14T13:06:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.404+0000 7f9c17192b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458ae38c0 con 0x558458d0e580 2023-07-14T13:06:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.404+0000 7f9c17192b80 10 client.0 _ll_register_callbacks cb 0x558458bfd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.404+0000 7f9c0159b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 0x558458d1a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.404+0000 7f9c01d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 0x558458d17d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.404+0000 7f9c0159b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 0x558458d1a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39208/0 (socket says 172.21.15.17:39208) 2023-07-14T13:06:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.404+0000 7f9c0159b700 1 -- 172.21.15.17:0/331598214 learned_addr learned my addr 172.21.15.17:0/331598214 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.405+0000 7f9c00d9a700 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.405+0000 7f9c0159b700 1 -- 172.21.15.17:0/331598214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 msgr2=0x558458d177a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.405+0000 7f9c0159b700 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d177a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.405+0000 7f9c0159b700 1 -- 172.21.15.17:0/331598214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 msgr2=0x558458d17d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.405+0000 7f9c0159b700 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 0x558458d17d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.405+0000 7f9c0159b700 1 -- 172.21.15.17:0/331598214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bfc10f420 con 0x558458b6a6b0 2023-07-14T13:06:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.405+0000 7f9c01d9c700 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 0x558458d17d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.405+0000 7f9c0159b700 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 0x558458d1a590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800e970 tx=0x7f9bf80cabc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78648baa408a6286 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.405+0000 7f9be4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:06:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.405+0000 7f9be4ff9700 1 -- 172.21.15.17:0/331598214 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8010880 con 0x558458b6a6b0 2023-07-14T13:06:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.405+0000 7f9be4ff9700 1 -- 172.21.15.17:0/331598214 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9bf8099fe0 con 0x558458b6a6b0 2023-07-14T13:06:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9c17192b80 1 -- 172.21.15.17:0/331598214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558458bb9490 con 0x558458b6a6b0 2023-07-14T13:06:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9be4ff9700 1 -- 172.21.15.17:0/331598214 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bf809e010 con 0x558458b6a6b0 2023-07-14T13:06:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9c17192b80 10 client.26672 fetch_fsmap learned FSMap version 29 2023-07-14T13:06:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9c17192b80 1 -- 172.21.15.17:0/331598214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x558458a76c00 con 0x558458b6a6b0 2023-07-14T13:06:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9be4ff9700 1 -- 172.21.15.17:0/331598214 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558458bb9490 con 0x558458b6a6b0 2023-07-14T13:06:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9be4ff9700 1 -- 172.21.15.17:0/331598214 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9bf8095f40 con 0x558458b6a6b0 2023-07-14T13:06:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9c17192b80 10 client.26672 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T13:06:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9c17192b80 10 client.26672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:06:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9c17192b80 20 client.26672 populate_metadata read hostname 'smithi017' 2023-07-14T13:06:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9c17192b80 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558458d27c30 0x558458d2a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9c17192b80 4 client.26672 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:06:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.406+0000 7f9c17192b80 1 -- 172.21.15.17:0/331598214 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558458c58e50 con 0x558458d27c30 2023-07-14T13:06:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.407+0000 7f9c00d9a700 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558458d27c30 0x558458d2a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.407+0000 7f9c00d9a700 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558458d27c30 0x558458d2a040 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a975e953527da601 server_cookie=4f87b591ef258a61 in_seq=0 out_seq=0 2023-07-14T13:06:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.407+0000 7f9be4ff9700 10 client.26672 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.408+0000 7f9be4ff9700 1 -- 172.21.15.17:0/331598214 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558458c58e50 con 0x558458d27c30 2023-07-14T13:06:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.408+0000 7f9be4ff9700 10 client.26672 handle_command_reply: tid=0 2023-07-14T13:06:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.408+0000 7f9c17192b80 1 client.26672 shutdown 2023-07-14T13:06:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.408+0000 7f9c17192b80 1 -- 172.21.15.17:0/331598214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 msgr2=0x558458d1a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.408+0000 7f9c17192b80 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 0x558458d1a590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800e970 tx=0x7f9bf80cabc0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.409+0000 7f9c17192b80 1 -- 172.21.15.17:0/331598214 shutdown_connections 2023-07-14T13:06:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.409+0000 7f9c17192b80 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558458d27c30 0x558458d2a040 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.409+0000 7f9c17192b80 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 0x558458d17d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.409+0000 7f9c17192b80 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 0x558458d1a590 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.409+0000 7f9c17192b80 1 --2- 172.21.15.17:0/331598214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d177a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.409+0000 7f9c17192b80 1 -- 172.21.15.17:0/331598214 >> 172.21.15.17:0/331598214 conn(0x558458d03be0 msgr2=0x558458d084e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.409+0000 7f9be4ff9700 0 client.26672 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.409+0000 7f9c17192b80 1 -- 172.21.15.17:0/331598214 shutdown_connections 2023-07-14T13:06:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.409+0000 7f9c17192b80 1 -- 172.21.15.17:0/331598214 wait complete. 2023-07-14T13:06:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.409+0000 7f9c17192b80 20 client.26672 trim_cache size 0 max 16384 2023-07-14T13:06:11.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:11 smithi135 ceph-mon[97338]: pgmap v197: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 26 MiB/s wr, 89 op/s 2023-07-14T13:06:11.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:11 smithi135 ceph-mon[97338]: osdmap e91: 12 total, 12 up, 12 in 2023-07-14T13:06:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.426+0000 7f9c17192b80 1 Processor -- start 2023-07-14T13:06:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.426+0000 7f9c17192b80 1 -- start start 2023-07-14T13:06:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.426+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 0x558458d0e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.426+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d1ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.426+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458d142d0 0x558458d08c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.426+0000 7f9c17192b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458d00bb0 con 0x558458b6a6b0 2023-07-14T13:06:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.426+0000 7f9c17192b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458d25200 con 0x558458d142d0 2023-07-14T13:06:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.426+0000 7f9c17192b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458d15d00 con 0x558458d0e580 2023-07-14T13:06:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c0159b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 0x558458d0e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c00d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d1ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c00d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d1ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:36232/0 (socket says 172.21.15.17:36232) 2023-07-14T13:06:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c00d9a700 1 -- 172.21.15.17:0/3330190882 learned_addr learned my addr 172.21.15.17:0/3330190882 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c01d9c700 1 --2- 172.21.15.17:0/3330190882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458d142d0 0x558458d08c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c0159b700 1 -- 172.21.15.17:0/3330190882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 msgr2=0x558458d1ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c0159b700 1 --2- 172.21.15.17:0/3330190882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d1ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c0159b700 1 -- 172.21.15.17:0/3330190882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458d142d0 msgr2=0x558458d08c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c0159b700 1 --2- 172.21.15.17:0/3330190882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458d142d0 0x558458d08c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c0159b700 1 -- 172.21.15.17:0/3330190882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558458ab41f0 con 0x558458b6a6b0 2023-07-14T13:06:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c00d9a700 1 --2- 172.21.15.17:0/3330190882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d1ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.427+0000 7f9c0159b700 1 --2- 172.21.15.17:0/3330190882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 0x558458d0e040 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8099ce0 tx=0x7f9bf809a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e8e22c6911f8d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.428+0000 7f9be7fff700 1 -- 172.21.15.17:0/3330190882 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8099fe0 con 0x558458b6a6b0 2023-07-14T13:06:11.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.428+0000 7f9be7fff700 1 -- 172.21.15.17:0/3330190882 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bf80ce070 con 0x558458b6a6b0 2023-07-14T13:06:11.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.428+0000 7f9be7fff700 1 -- 172.21.15.17:0/3330190882 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8095dd0 con 0x558458b6a6b0 2023-07-14T13:06:11.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.428+0000 7f9c17192b80 1 -- 172.21.15.17:0/3330190882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 msgr2=0x558458d0e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.428+0000 7f9c17192b80 1 --2- 172.21.15.17:0/3330190882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 0x558458d0e040 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8099ce0 tx=0x7f9bf809a5a0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.428+0000 7f9c17192b80 1 -- 172.21.15.17:0/3330190882 shutdown_connections 2023-07-14T13:06:11.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.428+0000 7f9c17192b80 1 --2- 172.21.15.17:0/3330190882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458d142d0 0x558458d08c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.428+0000 7f9c17192b80 1 --2- 172.21.15.17:0/3330190882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458b6a6b0 0x558458d0e040 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.428+0000 7f9c17192b80 1 --2- 172.21.15.17:0/3330190882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d1ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.428+0000 7f9c17192b80 1 -- 172.21.15.17:0/3330190882 >> 172.21.15.17:0/3330190882 conn(0x558458d03be0 msgr2=0x558458d15190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:11.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.429+0000 7f9c17192b80 1 -- 172.21.15.17:0/3330190882 shutdown_connections 2023-07-14T13:06:11.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.429+0000 7f9c17192b80 1 -- 172.21.15.17:0/3330190882 wait complete. 2023-07-14T13:06:11.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.429+0000 7f9c17192b80 1 -- start start 2023-07-14T13:06:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.429+0000 7f9c17192b80 1 Processor -- start 2023-07-14T13:06:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 0x558458d10d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d0f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c17192b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 0x558458d0fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c17192b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458d11360 con 0x558458d142d0 2023-07-14T13:06:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c17192b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458d114d0 con 0x558458b6a6b0 2023-07-14T13:06:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c17192b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558458d10210 con 0x558458d0e580 2023-07-14T13:06:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c17192b80 10 client.0 _ll_register_callbacks cb 0x558458bfd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c00d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d0f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c01d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 0x558458d0fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c0159b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 0x558458d10d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c00d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d0f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:36234/0 (socket says 172.21.15.17:36234) 2023-07-14T13:06:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.430+0000 7f9c00d9a700 1 -- 172.21.15.17:0/65481184 learned_addr learned my addr 172.21.15.17:0/65481184 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.431+0000 7f9c0159b700 1 -- 172.21.15.17:0/65481184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 msgr2=0x558458d0f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.431+0000 7f9c0159b700 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d0f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.431+0000 7f9c0159b700 1 -- 172.21.15.17:0/65481184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 msgr2=0x558458d0fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.431+0000 7f9c0159b700 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 0x558458d0fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.431+0000 7f9c0159b700 1 -- 172.21.15.17:0/65481184 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec012170 con 0x558458b6a6b0 2023-07-14T13:06:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.431+0000 7f9c01d9c700 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 0x558458d0fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.431+0000 7f9c0159b700 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 0x558458d10d40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8096a50 tx=0x7f9bf8005b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f165d5b663cff401 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.431+0000 7f9be4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:06:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.431+0000 7f9be4ff9700 1 -- 172.21.15.17:0/65481184 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80a2430 con 0x558458b6a6b0 2023-07-14T13:06:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.431+0000 7f9be4ff9700 1 -- 172.21.15.17:0/65481184 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9bf8099fe0 con 0x558458b6a6b0 2023-07-14T13:06:11.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.431+0000 7f9c17192b80 1 -- 172.21.15.17:0/65481184 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9bf4007660 con 0x558458b6a6b0 2023-07-14T13:06:11.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9be4ff9700 1 -- 172.21.15.17:0/65481184 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bf8095dd0 con 0x558458b6a6b0 2023-07-14T13:06:11.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9c17192b80 10 client.26678 fetch_fsmap learned FSMap version 29 2023-07-14T13:06:11.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9c17192b80 1 -- 172.21.15.17:0/65481184 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x558458a76c00 con 0x558458b6a6b0 2023-07-14T13:06:11.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9be4ff9700 1 -- 172.21.15.17:0/65481184 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bf4007660 con 0x558458b6a6b0 2023-07-14T13:06:11.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9be4ff9700 1 -- 172.21.15.17:0/65481184 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9bf80b8030 con 0x558458b6a6b0 2023-07-14T13:06:11.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9c17192b80 10 client.26678 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T13:06:11.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9c17192b80 10 client.26678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:06:11.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9c17192b80 20 client.26678 populate_metadata read hostname 'smithi017' 2023-07-14T13:06:11.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9c17192b80 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558458d7c720 0x558458d7eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9c17192b80 4 client.26678 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:06:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9c17192b80 1 -- 172.21.15.17:0/65481184 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558458c1aff0 con 0x558458d7c720 2023-07-14T13:06:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.432+0000 7f9c00d9a700 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558458d7c720 0x558458d7eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.433+0000 7f9be4ff9700 10 client.26678 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.433+0000 7f9c00d9a700 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558458d7c720 0x558458d7eb30 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=960541408deb4392 server_cookie=e0ec42076a1863df in_seq=0 out_seq=0 2023-07-14T13:06:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9be4ff9700 1 -- 172.21.15.17:0/65481184 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558458c1aff0 con 0x558458d7c720 2023-07-14T13:06:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9be4ff9700 10 client.26678 handle_command_reply: tid=0 2023-07-14T13:06:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9c17192b80 1 client.26678 shutdown 2023-07-14T13:06:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9c17192b80 1 -- 172.21.15.17:0/65481184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 msgr2=0x558458d10d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9c17192b80 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 0x558458d10d40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8096a50 tx=0x7f9bf8005b40 comp rx=0 tx=0).stop 2023-07-14T13:06:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9c17192b80 1 -- 172.21.15.17:0/65481184 shutdown_connections 2023-07-14T13:06:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9c17192b80 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558458d7c720 0x558458d7eb30 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9c17192b80 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558458d142d0 0x558458d0fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9c17192b80 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558458b6a6b0 0x558458d10d40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9c17192b80 1 --2- 172.21.15.17:0/65481184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558458d0e580 0x558458d0f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9be4ff9700 0 client.26678 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9c17192b80 1 -- 172.21.15.17:0/65481184 >> 172.21.15.17:0/65481184 conn(0x558458d03be0 msgr2=0x558458d15f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9c17192b80 1 -- 172.21.15.17:0/65481184 shutdown_connections 2023-07-14T13:06:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.453+0000 7f9c17192b80 1 -- 172.21.15.17:0/65481184 wait complete. 2023-07-14T13:06:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c17192b80 20 client.26678 trim_cache size 0 max 16384 2023-07-14T13:06:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:06:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:06:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:06:11.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:06:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c037ff700 1 -- 172.21.15.17:0/2480171681 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9be80a12c0 msgr2=0x7f9be80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c037ff700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9be80a12c0 0x7f9be80a3770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4028000 tx=0x7f9bf402b000 comp rx=0 tx=0).stop 2023-07-14T13:06:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c037ff700 1 -- 172.21.15.17:0/2480171681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bfc0679a0 msgr2=0x7f9bfc197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c037ff700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bfc0679a0 0x7f9bfc197ef0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800e9a0 tx=0x7f9bf800ecb0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c037ff700 1 -- 172.21.15.17:0/2480171681 shutdown_connections 2023-07-14T13:06:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c037ff700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9be80a12c0 0x7f9be80a3770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c037ff700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9bfc10c540 0x7f9bfc19caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c037ff700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9bfc0679a0 0x7f9bfc197ef0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c037ff700 1 --2- 172.21.15.17:0/2480171681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9bfc0682b0 0x7f9bfc198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c037ff700 1 -- 172.21.15.17:0/2480171681 >> 172.21.15.17:0/2480171681 conn(0x7f9bfc074760 msgr2=0x7f9bfc0fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.454+0000 7f9c037ff700 1 -- 172.21.15.17:0/2480171681 shutdown_connections 2023-07-14T13:06:11.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:11.455+0000 7f9c037ff700 1 -- 172.21.15.17:0/2480171681 wait complete. 2023-07-14T13:06:11.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:11 smithi131 ceph-mon[96953]: pgmap v197: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 26 MiB/s wr, 89 op/s 2023-07-14T13:06:11.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:11 smithi131 ceph-mon[96953]: osdmap e91: 12 total, 12 up, 12 in 2023-07-14T13:06:11.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:11 smithi017 ceph-mon[95536]: pgmap v197: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 26 MiB/s wr, 89 op/s 2023-07-14T13:06:11.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:11 smithi017 ceph-mon[95536]: osdmap e91: 12 total, 12 up, 12 in 2023-07-14T13:06:12.294 INFO:teuthology.orchestra.run.smithi017.stderr:24300000 of 50000000 tuples (48%) done (elapsed 361.90 s, remaining 382.75 s) 2023-07-14T13:06:13.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:13 smithi135 ceph-mon[97338]: pgmap v199: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 33 MiB/s wr, 112 op/s 2023-07-14T13:06:13.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:13 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:13.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:13 smithi131 ceph-mon[96953]: pgmap v199: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 33 MiB/s wr, 112 op/s 2023-07-14T13:06:13.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:13 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:13.604 INFO:teuthology.orchestra.run.smithi017.stderr:24400000 of 50000000 tuples (48%) done (elapsed 363.21 s, remaining 381.07 s) 2023-07-14T13:06:13.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:13 smithi017 ceph-mon[95536]: pgmap v199: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 33 MiB/s wr, 112 op/s 2023-07-14T13:06:13.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:13 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:14.888 INFO:teuthology.orchestra.run.smithi017.stderr:24500000 of 50000000 tuples (49%) done (elapsed 364.49 s, remaining 379.37 s) 2023-07-14T13:06:15.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:15 smithi135 ceph-mon[97338]: pgmap v200: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 26 MiB/s wr, 91 op/s 2023-07-14T13:06:15.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:15 smithi131 ceph-mon[96953]: pgmap v200: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 26 MiB/s wr, 91 op/s 2023-07-14T13:06:15.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:15 smithi017 ceph-mon[95536]: pgmap v200: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 26 MiB/s wr, 91 op/s 2023-07-14T13:06:16.205 INFO:teuthology.orchestra.run.smithi017.stderr:24600000 of 50000000 tuples (49%) done (elapsed 365.81 s, remaining 377.70 s) 2023-07-14T13:06:17.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:17 smithi135 ceph-mon[97338]: pgmap v201: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 79 op/s 2023-07-14T13:06:17.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:17 smithi131 ceph-mon[96953]: pgmap v201: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 79 op/s 2023-07-14T13:06:17.521 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:17 smithi017 ceph-mon[95536]: pgmap v201: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 79 op/s 2023-07-14T13:06:17.588 INFO:teuthology.orchestra.run.smithi017.stderr:24700000 of 50000000 tuples (49%) done (elapsed 367.19 s, remaining 376.11 s) 2023-07-14T13:06:18.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:18 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:18.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:18 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:18.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:18 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:06:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:24800000 of 50000000 tuples (49%) done (elapsed 368.46 s, remaining 374.41 s) 2023-07-14T13:06:19.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:19 smithi135 ceph-mon[97338]: pgmap v202: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 79 op/s 2023-07-14T13:06:19.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:19 smithi131 ceph-mon[96953]: pgmap v202: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 79 op/s 2023-07-14T13:06:19.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:19 smithi017 ceph-mon[95536]: pgmap v202: 97 pgs: 97 active+clean; 5.6 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 26 MiB/s wr, 79 op/s 2023-07-14T13:06:20.193 INFO:teuthology.orchestra.run.smithi017.stderr:24900000 of 50000000 tuples (49%) done (elapsed 369.80 s, remaining 372.77 s) 2023-07-14T13:06:21.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:21 smithi135 ceph-mon[97338]: pgmap v203: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 27 MiB/s wr, 74 op/s 2023-07-14T13:06:21.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:21 smithi131 ceph-mon[96953]: pgmap v203: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 27 MiB/s wr, 74 op/s 2023-07-14T13:06:21.605 INFO:teuthology.orchestra.run.smithi017.stderr:25000000 of 50000000 tuples (50%) done (elapsed 371.21 s, remaining 371.21 s) 2023-07-14T13:06:21.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:21 smithi017 ceph-mon[95536]: pgmap v203: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 27 MiB/s wr, 74 op/s 2023-07-14T13:06:22.890 INFO:teuthology.orchestra.run.smithi017.stderr:25100000 of 50000000 tuples (50%) done (elapsed 372.49 s, remaining 369.52 s) 2023-07-14T13:06:23.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:23 smithi135 ceph-mon[97338]: pgmap v204: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 68 op/s 2023-07-14T13:06:23.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:23 smithi131 ceph-mon[96953]: pgmap v204: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 68 op/s 2023-07-14T13:06:23.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:23 smithi017 ceph-mon[95536]: pgmap v204: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 68 op/s 2023-07-14T13:06:24.160 INFO:teuthology.orchestra.run.smithi017.stderr:25200000 of 50000000 tuples (50%) done (elapsed 373.76 s, remaining 367.83 s) 2023-07-14T13:06:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.621+0000 7fedcef9d700 1 -- 172.21.15.17:0/1385507896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedc8068070 msgr2=0x7fedc810c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.621+0000 7fedcef9d700 1 --2- 172.21.15.17:0/1385507896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedc8068070 0x7fedc810c760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fedc000b0a0 tx=0x7fedc000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.621+0000 7fedcef9d700 1 -- 172.21.15.17:0/1385507896 shutdown_connections 2023-07-14T13:06:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.621+0000 7fedcef9d700 1 --2- 172.21.15.17:0/1385507896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedc8068070 0x7fedc810c760 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.621+0000 7fedcef9d700 1 --2- 172.21.15.17:0/1385507896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc81059a0 0x7fedc8105d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.621+0000 7fedcef9d700 1 --2- 172.21.15.17:0/1385507896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc81062b0 0x7fedc8067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.621+0000 7fedcef9d700 1 -- 172.21.15.17:0/1385507896 >> 172.21.15.17:0/1385507896 conn(0x7fedc8074770 msgr2=0x7fedc8074b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.621+0000 7fedcef9d700 1 -- 172.21.15.17:0/1385507896 shutdown_connections 2023-07-14T13:06:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.621+0000 7fedcef9d700 1 -- 172.21.15.17:0/1385507896 wait complete. 2023-07-14T13:06:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.623+0000 7fedcef9d700 1 Processor -- start 2023-07-14T13:06:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.623+0000 7fedcef9d700 1 -- start start 2023-07-14T13:06:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.623+0000 7fedcef9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc8068070 0x7fedc819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.623+0000 7fedcef9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc81059a0 0x7fedc819df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedcef9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedc81062b0 0x7fedc8197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedcef9d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8198130 con 0x7fedc8068070 2023-07-14T13:06:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedcef9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc81982a0 con 0x7fedc81059a0 2023-07-14T13:06:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedcef9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8198460 con 0x7fedc81062b0 2023-07-14T13:06:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedcdf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc8068070 0x7fedc819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedcdf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc8068070 0x7fedc819da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44566/0 (socket says 172.21.15.17:44566) 2023-07-14T13:06:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedcd79a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc81059a0 0x7fedc819df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedcdf9b700 1 -- 172.21.15.17:0/3082275549 learned_addr learned my addr 172.21.15.17:0/3082275549 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedce79c700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedc81062b0 0x7fedc8197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedce79c700 1 -- 172.21.15.17:0/3082275549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc81059a0 msgr2=0x7fedc819df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedce79c700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc81059a0 0x7fedc819df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedce79c700 1 -- 172.21.15.17:0/3082275549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc8068070 msgr2=0x7fedc819da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedce79c700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc8068070 0x7fedc819da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedce79c700 1 -- 172.21.15.17:0/3082275549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0009d00 con 0x7fedc81062b0 2023-07-14T13:06:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.624+0000 7fedcd79a700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc81059a0 0x7fedc819df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.625+0000 7fedce79c700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedc81062b0 0x7fedc8197ac0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009fd0 tx=0x7fedc0007840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.625+0000 7fedbeffd700 1 -- 172.21.15.17:0/3082275549 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000e040 con 0x7fedc81062b0 2023-07-14T13:06:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.625+0000 7fedbeffd700 1 -- 172.21.15.17:0/3082275549 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedc0003e90 con 0x7fedc81062b0 2023-07-14T13:06:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.625+0000 7fedcef9d700 1 -- 172.21.15.17:0/3082275549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc81986e0 con 0x7fedc81062b0 2023-07-14T13:06:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.625+0000 7fedbeffd700 1 -- 172.21.15.17:0/3082275549 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0005040 con 0x7fedc81062b0 2023-07-14T13:06:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.625+0000 7fedcef9d700 1 -- 172.21.15.17:0/3082275549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc81a4a40 con 0x7fedc81062b0 2023-07-14T13:06:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.629+0000 7fedbeffd700 1 -- 172.21.15.17:0/3082275549 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fedc001d610 con 0x7fedc81062b0 2023-07-14T13:06:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.630+0000 7fedbeffd700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fedb40a1340 0x7fedb40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.630+0000 7fedbeffd700 1 -- 172.21.15.17:0/3082275549 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fedc00cdd40 con 0x7fedc81062b0 2023-07-14T13:06:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.630+0000 7fede3b3db80 1 Processor -- start 2023-07-14T13:06:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.631+0000 7fedcdf9b700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fedb40a1340 0x7fedb40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.631+0000 7fede3b3db80 1 -- start start 2023-07-14T13:06:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.631+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda60f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.631+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda5b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.631+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda618c0 0x557edda5b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.631+0000 7fede3b3db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edd960c50 con 0x557edda618c0 2023-07-14T13:06:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.631+0000 7fede3b3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edd9b39e0 con 0x557edd8b76b0 2023-07-14T13:06:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.631+0000 7fede3b3db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edd9ace70 con 0x557edda61470 2023-07-14T13:06:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.631+0000 7fedcdf9b700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fedb40a1340 0x7fedb40a37f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009d20 tx=0x7fedc4009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedcdf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda60f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedcd79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda5b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedce79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda618c0 0x557edda5b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedcd79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda5b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:43970/0 (socket says 172.21.15.17:43970) 2023-07-14T13:06:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedcdf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda60f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49122/0 (socket says 172.21.15.17:49122) 2023-07-14T13:06:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedcd79a700 1 -- 172.21.15.17:0/477228619 learned_addr learned my addr 172.21.15.17:0/477228619 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedcd79a700 1 -- 172.21.15.17:0/477228619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 msgr2=0x557edda60f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedcd79a700 1 --2- 172.21.15.17:0/477228619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda60f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedcd79a700 1 -- 172.21.15.17:0/477228619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda618c0 msgr2=0x557edda5b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedcd79a700 1 --2- 172.21.15.17:0/477228619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda618c0 0x557edda5b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedcd79a700 1 -- 172.21.15.17:0/477228619 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557edd7dad80 con 0x557edda61470 2023-07-14T13:06:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedce79c700 1 --2- 172.21.15.17:0/477228619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda618c0 0x557edda5b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.632+0000 7fedcd79a700 1 --2- 172.21.15.17:0/477228619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda5b1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fedb80114f0 tx=0x7fedb8011800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=286db43652ee6660 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.633+0000 7fedb3fff700 1 -- 172.21.15.17:0/477228619 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8004a30 con 0x557edda61470 2023-07-14T13:06:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.633+0000 7fedb3fff700 1 -- 172.21.15.17:0/477228619 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedb80054b0 con 0x557edda61470 2023-07-14T13:06:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.633+0000 7fedb3fff700 1 -- 172.21.15.17:0/477228619 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800e830 con 0x557edda61470 2023-07-14T13:06:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.634+0000 7fede3b3db80 1 -- 172.21.15.17:0/477228619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 msgr2=0x557edda5b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.634+0000 7fede3b3db80 1 --2- 172.21.15.17:0/477228619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda5b1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fedb80114f0 tx=0x7fedb8011800 comp rx=0 tx=0).stop 2023-07-14T13:06:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.634+0000 7fede3b3db80 1 -- 172.21.15.17:0/477228619 shutdown_connections 2023-07-14T13:06:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.634+0000 7fede3b3db80 1 --2- 172.21.15.17:0/477228619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda618c0 0x557edda5b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.634+0000 7fede3b3db80 1 --2- 172.21.15.17:0/477228619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda60f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.634+0000 7fede3b3db80 1 --2- 172.21.15.17:0/477228619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda5b1a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.634+0000 7fede3b3db80 1 -- 172.21.15.17:0/477228619 >> 172.21.15.17:0/477228619 conn(0x557edda50d40 msgr2=0x557edda56340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.634+0000 7fede3b3db80 1 -- 172.21.15.17:0/477228619 shutdown_connections 2023-07-14T13:06:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.634+0000 7fede3b3db80 1 -- 172.21.15.17:0/477228619 wait complete. 2023-07-14T13:06:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.634+0000 7fede3b3db80 1 -- start start 2023-07-14T13:06:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.635+0000 7fede3b3db80 1 Processor -- start 2023-07-14T13:06:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.635+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edd8b76b0 0x557edda677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.635+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda64a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.635+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edda618c0 0x557edda650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.635+0000 7fede3b3db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edd94ca60 con 0x557edd8b76b0 2023-07-14T13:06:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.635+0000 7fede3b3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edd94c760 con 0x557edda618c0 2023-07-14T13:06:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.635+0000 7fede3b3db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edd8308c0 con 0x557edda61470 2023-07-14T13:06:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fede3b3db80 10 client.0 _ll_register_callbacks cb 0x557edd94a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedcdf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edd8b76b0 0x557edda677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedcd79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda64a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedcd79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda64a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:43982/0 (socket says 172.21.15.17:43982) 2023-07-14T13:06:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedcd79a700 1 -- 172.21.15.17:0/3221039353 learned_addr learned my addr 172.21.15.17:0/3221039353 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedcdf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edd8b76b0 0x557edda677c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44586/0 (socket says 172.21.15.17:44586) 2023-07-14T13:06:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedce79c700 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edda618c0 0x557edda650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedcd79a700 1 -- 172.21.15.17:0/3221039353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edda618c0 msgr2=0x557edda650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedcd79a700 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edda618c0 0x557edda650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedcd79a700 1 -- 172.21.15.17:0/3221039353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edd8b76b0 msgr2=0x557edda677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedcd79a700 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edd8b76b0 0x557edda677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedcd79a700 1 -- 172.21.15.17:0/3221039353 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc81a4a40 con 0x557edda61470 2023-07-14T13:06:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.636+0000 7fedce79c700 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edda618c0 0x557edda650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.637+0000 7fedcd79a700 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda64a40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009790 tx=0x7fedb8005d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=874fca9df1c1c203 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.637+0000 7fedb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:06:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.637+0000 7fedb17fa700 1 -- 172.21.15.17:0/3221039353 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80049e0 con 0x557edda61470 2023-07-14T13:06:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.637+0000 7fedb17fa700 1 -- 172.21.15.17:0/3221039353 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fedb8004b40 con 0x557edda61470 2023-07-14T13:06:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.637+0000 7fede3b3db80 1 -- 172.21.15.17:0/3221039353 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557edd906490 con 0x557edda61470 2023-07-14T13:06:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.637+0000 7fedb17fa700 1 -- 172.21.15.17:0/3221039353 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedb8004d00 con 0x557edda61470 2023-07-14T13:06:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.637+0000 7fede3b3db80 10 client.26659 fetch_fsmap learned FSMap version 31 2023-07-14T13:06:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.637+0000 7fede3b3db80 1 -- 172.21.15.17:0/3221039353 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fedb8009c90 con 0x557edda61470 2023-07-14T13:06:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.638+0000 7fedb17fa700 1 -- 172.21.15.17:0/3221039353 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557edd906490 con 0x557edda61470 2023-07-14T13:06:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.638+0000 7fedb17fa700 1 -- 172.21.15.17:0/3221039353 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fedb8021040 con 0x557edda61470 2023-07-14T13:06:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.638+0000 7fede3b3db80 10 client.26659 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:06:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.638+0000 7fede3b3db80 10 client.26659 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:06:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.638+0000 7fede3b3db80 20 client.26659 populate_metadata read hostname 'smithi017' 2023-07-14T13:06:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.638+0000 7fede3b3db80 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557edda74c70 0x557edda77080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.638+0000 7fede3b3db80 4 client.26659 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:06:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.638+0000 7fede3b3db80 1 -- 172.21.15.17:0/3221039353 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557edd9a5e50 con 0x557edda74c70 2023-07-14T13:06:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.638+0000 7fedcdf9b700 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557edda74c70 0x557edda77080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.639+0000 7fedb17fa700 10 client.26659 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.639+0000 7fedcdf9b700 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557edda74c70 0x557edda77080 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51034536175dfd4e server_cookie=b587d59efb96e45b in_seq=0 out_seq=0 2023-07-14T13:06:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fedb17fa700 1 -- 172.21.15.17:0/3221039353 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557edd9a5e50 con 0x557edda74c70 2023-07-14T13:06:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fedb17fa700 10 client.26659 handle_command_reply: tid=0 2023-07-14T13:06:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fede3b3db80 1 client.26659 shutdown 2023-07-14T13:06:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fede3b3db80 1 -- 172.21.15.17:0/3221039353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 msgr2=0x557edda64a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fede3b3db80 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda64a40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009790 tx=0x7fedb8005d20 comp rx=0 tx=0).stop 2023-07-14T13:06:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fede3b3db80 1 -- 172.21.15.17:0/3221039353 shutdown_connections 2023-07-14T13:06:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fede3b3db80 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557edda74c70 0x557edda77080 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fede3b3db80 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edda618c0 0x557edda650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fede3b3db80 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edd8b76b0 0x557edda677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fede3b3db80 1 --2- 172.21.15.17:0/3221039353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda61470 0x557edda64a40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fede3b3db80 1 -- 172.21.15.17:0/3221039353 >> 172.21.15.17:0/3221039353 conn(0x557edda50d40 msgr2=0x557edda55640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fedb17fa700 0 client.26659 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fede3b3db80 1 -- 172.21.15.17:0/3221039353 shutdown_connections 2023-07-14T13:06:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.640+0000 7fede3b3db80 1 -- 172.21.15.17:0/3221039353 wait complete. 2023-07-14T13:06:24.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.641+0000 7fede3b3db80 20 client.26659 trim_cache size 0 max 16384 2023-07-14T13:06:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fede3b3db80 1 Processor -- start 2023-07-14T13:06:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fede3b3db80 1 -- start start 2023-07-14T13:06:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda6be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda55dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda61470 0x557edda56300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fede3b3db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edd906490 con 0x557edda61470 2023-07-14T13:06:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fede3b3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edda52e60 con 0x557edd8b76b0 2023-07-14T13:06:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fede3b3db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edda5c180 con 0x557edda50d40 2023-07-14T13:06:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fedcdf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda6be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fedce79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda61470 0x557edda56300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fedcdf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda6be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:43994/0 (socket says 172.21.15.17:43994) 2023-07-14T13:06:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.662+0000 7fedcdf9b700 1 -- 172.21.15.17:0/3897227181 learned_addr learned my addr 172.21.15.17:0/3897227181 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.663+0000 7fedcd79a700 1 --2- 172.21.15.17:0/3897227181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda55dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.663+0000 7fedcdf9b700 1 -- 172.21.15.17:0/3897227181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 msgr2=0x557edda55dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.663+0000 7fedcdf9b700 1 --2- 172.21.15.17:0/3897227181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda55dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.663+0000 7fedcdf9b700 1 -- 172.21.15.17:0/3897227181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda61470 msgr2=0x557edda56300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.663+0000 7fedcdf9b700 1 --2- 172.21.15.17:0/3897227181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda61470 0x557edda56300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.663+0000 7fedcdf9b700 1 -- 172.21.15.17:0/3897227181 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557edd7c3c00 con 0x557edda50d40 2023-07-14T13:06:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.663+0000 7fedcdf9b700 1 --2- 172.21.15.17:0/3897227181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda6be00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009be0 tx=0x7fedc4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=248cd1829feb0003 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.664+0000 7fedbcff9700 1 -- 172.21.15.17:0/3897227181 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4022040 con 0x557edda50d40 2023-07-14T13:06:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.664+0000 7fedbcff9700 1 -- 172.21.15.17:0/3897227181 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedc402f070 con 0x557edda50d40 2023-07-14T13:06:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.664+0000 7fedbcff9700 1 -- 172.21.15.17:0/3897227181 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4005020 con 0x557edda50d40 2023-07-14T13:06:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.664+0000 7fede3b3db80 1 -- 172.21.15.17:0/3897227181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 msgr2=0x557edda6be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.664+0000 7fede3b3db80 1 --2- 172.21.15.17:0/3897227181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda6be00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009be0 tx=0x7fedc4014000 comp rx=0 tx=0).stop 2023-07-14T13:06:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.664+0000 7fede3b3db80 1 -- 172.21.15.17:0/3897227181 shutdown_connections 2023-07-14T13:06:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.664+0000 7fede3b3db80 1 --2- 172.21.15.17:0/3897227181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda61470 0x557edda56300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.664+0000 7fede3b3db80 1 --2- 172.21.15.17:0/3897227181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda6be00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.664+0000 7fede3b3db80 1 --2- 172.21.15.17:0/3897227181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda55dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.664+0000 7fede3b3db80 1 -- 172.21.15.17:0/3897227181 >> 172.21.15.17:0/3897227181 conn(0x557edda70910 msgr2=0x557edda5ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.665+0000 7fede3b3db80 1 -- 172.21.15.17:0/3897227181 shutdown_connections 2023-07-14T13:06:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.665+0000 7fede3b3db80 1 -- 172.21.15.17:0/3897227181 wait complete. 2023-07-14T13:06:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.665+0000 7fede3b3db80 1 -- start start 2023-07-14T13:06:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.665+0000 7fede3b3db80 1 Processor -- start 2023-07-14T13:06:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda5dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda5e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fede3b3db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda61470 0x557edda5c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fede3b3db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edda6c420 con 0x557edda61470 2023-07-14T13:06:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fede3b3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edda5ced0 con 0x557edd8b76b0 2023-07-14T13:06:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fede3b3db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557edda5d090 con 0x557edda50d40 2023-07-14T13:06:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fede3b3db80 10 client.0 _ll_register_callbacks cb 0x7fedc00074e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fedce79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda61470 0x557edda5c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fedcd79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda5e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fedcdf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda5dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fedcd79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda5e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44010/0 (socket says 172.21.15.17:44010) 2023-07-14T13:06:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fedce79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda61470 0x557edda5c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44612/0 (socket says 172.21.15.17:44612) 2023-07-14T13:06:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fedcdf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda5dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49144/0 (socket says 172.21.15.17:49144) 2023-07-14T13:06:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.666+0000 7fedcd79a700 1 -- 172.21.15.17:0/1994038159 learned_addr learned my addr 172.21.15.17:0/1994038159 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.667+0000 7fedcd79a700 1 -- 172.21.15.17:0/1994038159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 msgr2=0x557edda5dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.667+0000 7fedcd79a700 1 --2- 172.21.15.17:0/1994038159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda5dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.667+0000 7fedcd79a700 1 -- 172.21.15.17:0/1994038159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda61470 msgr2=0x557edda5c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.667+0000 7fedcd79a700 1 --2- 172.21.15.17:0/1994038159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda61470 0x557edda5c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.667+0000 7fedcd79a700 1 -- 172.21.15.17:0/1994038159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc4017070 con 0x557edda50d40 2023-07-14T13:06:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.667+0000 7fedcd79a700 1 --2- 172.21.15.17:0/1994038159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda5e170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fedb8005440 tx=0x7fedb8004c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee9df52b4e21e7f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.667+0000 7fedb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:06:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.667+0000 7fedb17fa700 1 -- 172.21.15.17:0/1994038159 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8009290 con 0x557edda50d40 2023-07-14T13:06:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.667+0000 7fedb17fa700 1 -- 172.21.15.17:0/1994038159 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fedb8000e40 con 0x557edda50d40 2023-07-14T13:06:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fede3b3db80 1 -- 172.21.15.17:0/1994038159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fedb80054b0 con 0x557edda50d40 2023-07-14T13:06:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fedb17fa700 1 -- 172.21.15.17:0/1994038159 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedb8003890 con 0x557edda50d40 2023-07-14T13:06:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fede3b3db80 10 client.26665 fetch_fsmap learned FSMap version 31 2023-07-14T13:06:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fede3b3db80 1 -- 172.21.15.17:0/1994038159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x557edd8011f0 con 0x557edda50d40 2023-07-14T13:06:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fedb17fa700 1 -- 172.21.15.17:0/1994038159 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedb803e020 con 0x557edda50d40 2023-07-14T13:06:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fedb17fa700 1 -- 172.21.15.17:0/1994038159 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fedb8021040 con 0x557edda50d40 2023-07-14T13:06:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fede3b3db80 10 client.26665 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:06:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fede3b3db80 10 client.26665 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:06:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fede3b3db80 20 client.26665 populate_metadata read hostname 'smithi017' 2023-07-14T13:06:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fede3b3db80 1 --2- 172.21.15.17:0/1994038159 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557edda618c0 0x557eddacb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fede3b3db80 4 client.26665 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:06:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.668+0000 7fede3b3db80 1 -- 172.21.15.17:0/1994038159 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557edd967ff0 con 0x557edda618c0 2023-07-14T13:06:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.669+0000 7fedcdf9b700 1 --2- 172.21.15.17:0/1994038159 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557edda618c0 0x557eddacb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:24.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.670+0000 7fedcdf9b700 1 --2- 172.21.15.17:0/1994038159 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557edda618c0 0x557eddacb740 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8c082428a510d22 server_cookie=45cf8bbd6281ed3 in_seq=0 out_seq=0 2023-07-14T13:06:24.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.670+0000 7fedb17fa700 10 client.26665 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fedb17fa700 1 -- 172.21.15.17:0/1994038159 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557edd967ff0 con 0x557edda618c0 2023-07-14T13:06:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fedb17fa700 10 client.26665 handle_command_reply: tid=0 2023-07-14T13:06:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fede3b3db80 1 client.26665 shutdown 2023-07-14T13:06:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fede3b3db80 1 -- 172.21.15.17:0/1994038159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 msgr2=0x557edda5e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fede3b3db80 1 --2- 172.21.15.17:0/1994038159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda5e170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fedb8005440 tx=0x7fedb8004c10 comp rx=0 tx=0).stop 2023-07-14T13:06:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fede3b3db80 1 -- 172.21.15.17:0/1994038159 shutdown_connections 2023-07-14T13:06:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fede3b3db80 1 --2- 172.21.15.17:0/1994038159 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557edda618c0 0x557eddacb740 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fede3b3db80 1 --2- 172.21.15.17:0/1994038159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557edda61470 0x557edda5c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fede3b3db80 1 --2- 172.21.15.17:0/1994038159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557edd8b76b0 0x557edda5dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fede3b3db80 1 --2- 172.21.15.17:0/1994038159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557edda50d40 0x557edda5e170 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fedb17fa700 0 client.26665 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fede3b3db80 1 -- 172.21.15.17:0/1994038159 >> 172.21.15.17:0/1994038159 conn(0x557edda70910 msgr2=0x557edda62520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fede3b3db80 1 -- 172.21.15.17:0/1994038159 shutdown_connections 2023-07-14T13:06:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.686+0000 7fede3b3db80 1 -- 172.21.15.17:0/1994038159 wait complete. 2023-07-14T13:06:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.687+0000 7fede3b3db80 20 client.26665 trim_cache size 0 max 16384 2023-07-14T13:06:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:06:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:06:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:06:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:06:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.687+0000 7fedcef9d700 1 -- 172.21.15.17:0/3082275549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fedb40a1340 msgr2=0x7fedb40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.687+0000 7fedcef9d700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fedb40a1340 0x7fedb40a37f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009d20 tx=0x7fedc4009260 comp rx=0 tx=0).stop 2023-07-14T13:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.687+0000 7fedcef9d700 1 -- 172.21.15.17:0/3082275549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedc81062b0 msgr2=0x7fedc8197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.687+0000 7fedcef9d700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedc81062b0 0x7fedc8197ac0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009fd0 tx=0x7fedc0007840 comp rx=0 tx=0).stop 2023-07-14T13:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.688+0000 7fedcef9d700 1 -- 172.21.15.17:0/3082275549 shutdown_connections 2023-07-14T13:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.688+0000 7fedcef9d700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fedb40a1340 0x7fedb40a37f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.688+0000 7fedcef9d700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedc81062b0 0x7fedc8197ac0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.688+0000 7fedcef9d700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedc8068070 0x7fedc819da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.688+0000 7fedcef9d700 1 --2- 172.21.15.17:0/3082275549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedc81059a0 0x7fedc819df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.688+0000 7fedcef9d700 1 -- 172.21.15.17:0/3082275549 >> 172.21.15.17:0/3082275549 conn(0x7fedc8074770 msgr2=0x7fedc80fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.688+0000 7fedcef9d700 1 -- 172.21.15.17:0/3082275549 shutdown_connections 2023-07-14T13:06:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:24.688+0000 7fedcef9d700 1 -- 172.21.15.17:0/3082275549 wait complete. 2023-07-14T13:06:25.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:25 smithi135 ceph-mon[97338]: pgmap v205: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 62 op/s 2023-07-14T13:06:25.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:25 smithi131 ceph-mon[96953]: pgmap v205: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 62 op/s 2023-07-14T13:06:25.571 INFO:teuthology.orchestra.run.smithi017.stderr:25300000 of 50000000 tuples (50%) done (elapsed 375.17 s, remaining 366.27 s) 2023-07-14T13:06:25.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:25 smithi017 ceph-mon[95536]: pgmap v205: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 62 op/s 2023-07-14T13:06:26.897 INFO:teuthology.orchestra.run.smithi017.stderr:25400000 of 50000000 tuples (50%) done (elapsed 376.50 s, remaining 364.64 s) 2023-07-14T13:06:27.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:27 smithi135 ceph-mon[97338]: pgmap v206: 97 pgs: 97 active+clean; 5.8 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 34 MiB/s wr, 78 op/s 2023-07-14T13:06:27.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:27 smithi131 ceph-mon[96953]: pgmap v206: 97 pgs: 97 active+clean; 5.8 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 34 MiB/s wr, 78 op/s 2023-07-14T13:06:27.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:27 smithi017 ceph-mon[95536]: pgmap v206: 97 pgs: 97 active+clean; 5.8 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 34 MiB/s wr, 78 op/s 2023-07-14T13:06:28.423 INFO:teuthology.orchestra.run.smithi017.stderr:25500000 of 50000000 tuples (51%) done (elapsed 378.02 s, remaining 363.20 s) 2023-07-14T13:06:29.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:29 smithi135 ceph-mon[97338]: pgmap v207: 97 pgs: 97 active+clean; 5.8 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-07-14T13:06:29.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:29 smithi131 ceph-mon[96953]: pgmap v207: 97 pgs: 97 active+clean; 5.8 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-07-14T13:06:29.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:29 smithi017 ceph-mon[95536]: pgmap v207: 97 pgs: 97 active+clean; 5.8 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 MiB/s wr, 38 op/s 2023-07-14T13:06:29.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:06:29.783 INFO:teuthology.orchestra.run.smithi017.stderr:25600000 of 50000000 tuples (51%) done (elapsed 379.38 s, remaining 361.60 s) 2023-07-14T13:06:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.917+0000 7fd4391ff700 1 -- 172.21.15.17:0/4219079696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd434100490 msgr2=0x7fd43410c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.917+0000 7fd4391ff700 1 --2- 172.21.15.17:0/4219079696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd434100490 0x7fd43410c920 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00b0a0 tx=0x7fd42c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.917+0000 7fd4391ff700 1 -- 172.21.15.17:0/4219079696 shutdown_connections 2023-07-14T13:06:29.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.917+0000 7fd4391ff700 1 --2- 172.21.15.17:0/4219079696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd434100490 0x7fd43410c920 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.917+0000 7fd4391ff700 1 --2- 172.21.15.17:0/4219079696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd434105af0 0x7fd434105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.917+0000 7fd4391ff700 1 --2- 172.21.15.17:0/4219079696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4340ffae0 0x7fd4340fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.917+0000 7fd4391ff700 1 -- 172.21.15.17:0/4219079696 >> 172.21.15.17:0/4219079696 conn(0x7fd4340fb5e0 msgr2=0x7fd4340fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.917+0000 7fd4391ff700 1 -- 172.21.15.17:0/4219079696 shutdown_connections 2023-07-14T13:06:29.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.917+0000 7fd4391ff700 1 -- 172.21.15.17:0/4219079696 wait complete. 2023-07-14T13:06:29.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.919+0000 7fd4391ff700 1 Processor -- start 2023-07-14T13:06:29.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.919+0000 7fd4391ff700 1 -- start start 2023-07-14T13:06:29.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.919+0000 7fd4391ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4340ffae0 0x7fd43419b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.919+0000 7fd4391ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd434100490 0x7fd43419bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.919+0000 7fd4391ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd434105af0 0x7fd434195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.919+0000 7fd4391ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341960b0 con 0x7fd4340ffae0 2023-07-14T13:06:29.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.919+0000 7fd4391ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd434196220 con 0x7fd434105af0 2023-07-14T13:06:29.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.919+0000 7fd4391ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4341963e0 con 0x7fd434100490 2023-07-14T13:06:29.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.920+0000 7fd43259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd434100490 0x7fd43419bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.920+0000 7fd43259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd434100490 0x7fd43419bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:42824/0 (socket says 172.21.15.17:42824) 2023-07-14T13:06:29.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.920+0000 7fd43259c700 1 -- 172.21.15.17:0/2089324827 learned_addr learned my addr 172.21.15.17:0/2089324827 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:29.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.920+0000 7fd432d9d700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4340ffae0 0x7fd43419b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.920+0000 7fd43359e700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd434105af0 0x7fd434195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.920+0000 7fd43259c700 1 -- 172.21.15.17:0/2089324827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd434105af0 msgr2=0x7fd434195a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:29.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.920+0000 7fd43259c700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd434105af0 0x7fd434195a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.920+0000 7fd43259c700 1 -- 172.21.15.17:0/2089324827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4340ffae0 msgr2=0x7fd43419b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:29.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.920+0000 7fd43259c700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4340ffae0 0x7fd43419b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.920+0000 7fd43259c700 1 -- 172.21.15.17:0/2089324827 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c009d00 con 0x7fd434100490 2023-07-14T13:06:29.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.920+0000 7fd43359e700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd434105af0 0x7fd434195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:29.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.921+0000 7fd43259c700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd434100490 0x7fd43419bf10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd42800e9a0 tx=0x7fd42800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:29.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.921+0000 7fd41bfff700 1 -- 172.21.15.17:0/2089324827 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428009790 con 0x7fd434100490 2023-07-14T13:06:29.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.921+0000 7fd41bfff700 1 -- 172.21.15.17:0/2089324827 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd42800cbd0 con 0x7fd434100490 2023-07-14T13:06:29.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.921+0000 7fd4391ff700 1 -- 172.21.15.17:0/2089324827 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4341966c0 con 0x7fd434100490 2023-07-14T13:06:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.921+0000 7fd41bfff700 1 -- 172.21.15.17:0/2089324827 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428018680 con 0x7fd434100490 2023-07-14T13:06:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.921+0000 7fd4391ff700 1 -- 172.21.15.17:0/2089324827 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd434072920 con 0x7fd434100490 2023-07-14T13:06:29.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.925+0000 7fd41bfff700 1 -- 172.21.15.17:0/2089324827 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd42800cd40 con 0x7fd434100490 2023-07-14T13:06:29.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.927+0000 7fd44cbe6b80 1 Processor -- start 2023-07-14T13:06:29.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.927+0000 7fd44cbe6b80 1 -- start start 2023-07-14T13:06:29.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.927+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b492d0 0x5604d3b496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.927+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b54590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.927+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b54ad0 0x5604d3b56eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.927+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d3a4fcb0 con 0x5604d3b492d0 2023-07-14T13:06:29.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.927+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d3aa2a40 con 0x5604d3b49be0 2023-07-14T13:06:29.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.927+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d3a9bed0 con 0x5604d3b54ad0 2023-07-14T13:06:29.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.927+0000 7fd41bfff700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd41c0a1340 0x7fd41c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd432d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b54590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd43359e700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd41c0a1340 0x7fd41c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd41bfff700 1 -- 172.21.15.17:0/2089324827 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd428014070 con 0x7fd434100490 2023-07-14T13:06:29.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd432d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b54590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58512/0 (socket says 172.21.15.17:58512) 2023-07-14T13:06:29.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd432d9d700 1 -- 172.21.15.17:0/495781502 learned_addr learned my addr 172.21.15.17:0/495781502 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:29.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd43259c700 1 --2- 172.21.15.17:0/495781502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b54ad0 0x5604d3b56eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd43359e700 1 --2- 172.21.15.17:0/495781502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b492d0 0x5604d3b496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd432d9d700 1 -- 172.21.15.17:0/495781502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b54ad0 msgr2=0x5604d3b56eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd432d9d700 1 --2- 172.21.15.17:0/495781502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b54ad0 0x5604d3b56eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd432d9d700 1 -- 172.21.15.17:0/495781502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b492d0 msgr2=0x5604d3b496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd432d9d700 1 --2- 172.21.15.17:0/495781502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b492d0 0x5604d3b496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd432d9d700 1 -- 172.21.15.17:0/495781502 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604d38c9de0 con 0x5604d3b49be0 2023-07-14T13:06:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.928+0000 7fd43259c700 1 --2- 172.21.15.17:0/495781502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b54ad0 0x5604d3b56eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.929+0000 7fd43359e700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd41c0a1340 0x7fd41c0a37f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00b780 tx=0x7fd42c009540 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.929+0000 7fd432d9d700 1 --2- 172.21.15.17:0/495781502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b54590 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd424004590 tx=0x7fd424009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeea46e17200a24b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:29.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.929+0000 7fd4197fa700 1 -- 172.21.15.17:0/495781502 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424017040 con 0x5604d3b49be0 2023-07-14T13:06:29.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.929+0000 7fd4197fa700 1 -- 172.21.15.17:0/495781502 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd424009e60 con 0x5604d3b49be0 2023-07-14T13:06:29.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.929+0000 7fd4197fa700 1 -- 172.21.15.17:0/495781502 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42401b420 con 0x5604d3b49be0 2023-07-14T13:06:29.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.930+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/495781502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 msgr2=0x5604d3b54590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:29.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.930+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/495781502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b54590 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd424004590 tx=0x7fd424009260 comp rx=0 tx=0).stop 2023-07-14T13:06:29.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.930+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/495781502 shutdown_connections 2023-07-14T13:06:29.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.930+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/495781502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b54ad0 0x5604d3b56eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.930+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/495781502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b492d0 0x5604d3b496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.930+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/495781502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b54590 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.930+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/495781502 >> 172.21.15.17:0/495781502 conn(0x5604d3b3fda0 msgr2=0x5604d3b456a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:29.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.930+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/495781502 shutdown_connections 2023-07-14T13:06:29.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.930+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/495781502 wait complete. 2023-07-14T13:06:29.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.931+0000 7fd44cbe6b80 1 -- start start 2023-07-14T13:06:29.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.931+0000 7fd44cbe6b80 1 Processor -- start 2023-07-14T13:06:29.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.931+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b54430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.931+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b49be0 0x5604d3b516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.931+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b54ad0 0x5604d3b51c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d3a3bac0 con 0x5604d3b49be0 2023-07-14T13:06:29.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d3a3b7c0 con 0x5604d3b54ad0 2023-07-14T13:06:29.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d391f920 con 0x5604d3b492d0 2023-07-14T13:06:29.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd44cbe6b80 10 client.0 _ll_register_callbacks cb 0x5604d3a39760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:29.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd432d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b54430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd432d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b54430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:42852/0 (socket says 172.21.15.17:42852) 2023-07-14T13:06:29.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd432d9d700 1 -- 172.21.15.17:0/575118152 learned_addr learned my addr 172.21.15.17:0/575118152 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:29.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd43359e700 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b54ad0 0x5604d3b51c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd43259c700 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b49be0 0x5604d3b516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd43259c700 1 -- 172.21.15.17:0/575118152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 msgr2=0x5604d3b54430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd43259c700 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b54430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd43259c700 1 -- 172.21.15.17:0/575118152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b54ad0 msgr2=0x5604d3b51c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd43259c700 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b54ad0 0x5604d3b51c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd43259c700 1 -- 172.21.15.17:0/575118152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd434072920 con 0x5604d3b49be0 2023-07-14T13:06:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd432d9d700 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b54430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.932+0000 7fd43359e700 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b54ad0 0x5604d3b51c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.933+0000 7fd43259c700 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b49be0 0x5604d3b516b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd4280ca690 tx=0x7fd4280cabf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f01bbd1999d84a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.933+0000 7fd416ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:06:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.933+0000 7fd416ff5700 1 -- 172.21.15.17:0/575118152 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42809a010 con 0x5604d3b49be0 2023-07-14T13:06:29.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.933+0000 7fd416ff5700 1 -- 172.21.15.17:0/575118152 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd42809e040 con 0x5604d3b49be0 2023-07-14T13:06:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.933+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/575118152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604d39f54f0 con 0x5604d3b49be0 2023-07-14T13:06:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.933+0000 7fd416ff5700 1 -- 172.21.15.17:0/575118152 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4280b8440 con 0x5604d3b49be0 2023-07-14T13:06:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.933+0000 7fd44cbe6b80 10 client.16986 fetch_fsmap learned FSMap version 31 2023-07-14T13:06:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.933+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/575118152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fd4240041f0 con 0x5604d3b49be0 2023-07-14T13:06:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.934+0000 7fd416ff5700 1 -- 172.21.15.17:0/575118152 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5604d39f54f0 con 0x5604d3b49be0 2023-07-14T13:06:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.934+0000 7fd416ff5700 1 -- 172.21.15.17:0/575118152 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd428095e90 con 0x5604d3b49be0 2023-07-14T13:06:29.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.934+0000 7fd44cbe6b80 10 client.16986 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:06:29.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.934+0000 7fd44cbe6b80 10 client.16986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:06:29.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.934+0000 7fd44cbe6b80 20 client.16986 populate_metadata read hostname 'smithi017' 2023-07-14T13:06:29.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.934+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604d3b64290 0x5604d3b666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.934+0000 7fd44cbe6b80 4 client.16986 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:06:29.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.934+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/575118152 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604d3a94eb0 con 0x5604d3b64290 2023-07-14T13:06:29.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.934+0000 7fd432d9d700 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604d3b64290 0x5604d3b666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.935+0000 7fd432d9d700 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604d3b64290 0x5604d3b666a0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1146fbb6518a5a7 server_cookie=bb9d24b325374406 in_seq=0 out_seq=0 2023-07-14T13:06:29.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.935+0000 7fd416ff5700 10 client.16986 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:29.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd416ff5700 1 -- 172.21.15.17:0/575118152 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5604d3a94eb0 con 0x5604d3b64290 2023-07-14T13:06:29.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd416ff5700 10 client.16986 handle_command_reply: tid=0 2023-07-14T13:06:29.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd44cbe6b80 1 client.16986 shutdown 2023-07-14T13:06:29.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/575118152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b49be0 msgr2=0x5604d3b516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:29.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b49be0 0x5604d3b516b0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd4280ca690 tx=0x7fd4280cabf0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/575118152 shutdown_connections 2023-07-14T13:06:29.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604d3b64290 0x5604d3b666a0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b54ad0 0x5604d3b51c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b54430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/575118152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b49be0 0x5604d3b516b0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/575118152 >> 172.21.15.17:0/575118152 conn(0x5604d3b3fda0 msgr2=0x5604d3b45290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:29.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd416ff5700 0 client.16986 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:29.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/575118152 shutdown_connections 2023-07-14T13:06:29.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.936+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/575118152 wait complete. 2023-07-14T13:06:29.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.937+0000 7fd44cbe6b80 20 client.16986 trim_cache size 0 max 16384 2023-07-14T13:06:29.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.957+0000 7fd44cbe6b80 1 Processor -- start 2023-07-14T13:06:29.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.957+0000 7fd44cbe6b80 1 -- start start 2023-07-14T13:06:29.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.957+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b53fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.957+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b55eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 0x5604d3b563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:29.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d3b619e0 con 0x5604d3b54ad0 2023-07-14T13:06:29.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d3b4c510 con 0x5604d3b49be0 2023-07-14T13:06:29.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d3b3f9f0 con 0x5604d3b492d0 2023-07-14T13:06:29.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd43359e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 0x5604d3b563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd43259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b55eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd432d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b53fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:29.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd43259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b55eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58520/0 (socket says 172.21.15.17:58520) 2023-07-14T13:06:29.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd432d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b53fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:42858/0 (socket says 172.21.15.17:42858) 2023-07-14T13:06:29.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd43259c700 1 -- 172.21.15.17:0/3740324239 learned_addr learned my addr 172.21.15.17:0/3740324239 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:29.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd43359e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 0x5604d3b563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45600/0 (socket says 172.21.15.17:45600) 2023-07-14T13:06:29.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd43259c700 1 -- 172.21.15.17:0/3740324239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 msgr2=0x5604d3b53fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:29.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd43259c700 1 --2- 172.21.15.17:0/3740324239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b53fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd43259c700 1 -- 172.21.15.17:0/3740324239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 msgr2=0x5604d3b563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:29.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd43259c700 1 --2- 172.21.15.17:0/3740324239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 0x5604d3b563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:29.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd43259c700 1 -- 172.21.15.17:0/3740324239 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604d3b56fc0 con 0x5604d3b49be0 2023-07-14T13:06:29.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd43359e700 1 --2- 172.21.15.17:0/3740324239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 0x5604d3b563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:29.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.958+0000 7fd432d9d700 1 --2- 172.21.15.17:0/3740324239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b53fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:29.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.959+0000 7fd43259c700 1 --2- 172.21.15.17:0/3740324239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b55eb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd428099fa0 tx=0x7fd428099c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc0a2baf0f4dfba8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:29.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.959+0000 7fd419ffb700 1 -- 172.21.15.17:0/3740324239 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4280b8440 con 0x5604d3b49be0 2023-07-14T13:06:29.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.959+0000 7fd419ffb700 1 -- 172.21.15.17:0/3740324239 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd42809e040 con 0x5604d3b49be0 2023-07-14T13:06:29.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.959+0000 7fd419ffb700 1 -- 172.21.15.17:0/3740324239 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4280a1fd0 con 0x5604d3b49be0 2023-07-14T13:06:30.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.960+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3740324239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 msgr2=0x5604d3b55eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:30.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.960+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/3740324239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b55eb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd428099fa0 tx=0x7fd428099c80 comp rx=0 tx=0).stop 2023-07-14T13:06:30.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.960+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3740324239 shutdown_connections 2023-07-14T13:06:30.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.960+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/3740324239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 0x5604d3b563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.960+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/3740324239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b492d0 0x5604d3b53fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.960+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/3740324239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b49be0 0x5604d3b55eb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.960+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3740324239 >> 172.21.15.17:0/3740324239 conn(0x5604d3b3fda0 msgr2=0x5604d3b60640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:30.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.960+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3740324239 shutdown_connections 2023-07-14T13:06:30.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.960+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3740324239 wait complete. 2023-07-14T13:06:30.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.961+0000 7fd44cbe6b80 1 -- start start 2023-07-14T13:06:30.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.961+0000 7fd44cbe6b80 1 Processor -- start 2023-07-14T13:06:30.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.961+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b492d0 0x5604d3b59360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:30.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.961+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b49be0 0x5604d3b598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:30.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.961+0000 7fd44cbe6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 0x5604d3bb1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:30.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.961+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d3bb1660 con 0x5604d3b54ad0 2023-07-14T13:06:30.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.961+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d3bb17d0 con 0x5604d3b492d0 2023-07-14T13:06:30.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.961+0000 7fd44cbe6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604d3bb1990 con 0x5604d3b49be0 2023-07-14T13:06:30.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.961+0000 7fd44cbe6b80 10 client.0 _ll_register_callbacks cb 0x7fd428099bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:30.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.962+0000 7fd432d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b492d0 0x5604d3b59360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:30.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.962+0000 7fd432d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b492d0 0x5604d3b59360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58524/0 (socket says 172.21.15.17:58524) 2023-07-14T13:06:30.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.962+0000 7fd432d9d700 1 -- 172.21.15.17:0/3508563754 learned_addr learned my addr 172.21.15.17:0/3508563754 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:30.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.962+0000 7fd43359e700 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 0x5604d3bb1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:30.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.962+0000 7fd43259c700 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b49be0 0x5604d3b598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:30.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.962+0000 7fd432d9d700 1 -- 172.21.15.17:0/3508563754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b49be0 msgr2=0x5604d3b598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:30.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.962+0000 7fd432d9d700 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b49be0 0x5604d3b598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.962+0000 7fd432d9d700 1 -- 172.21.15.17:0/3508563754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 msgr2=0x5604d3bb1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:30.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.962+0000 7fd432d9d700 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 0x5604d3bb1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.962+0000 7fd432d9d700 1 -- 172.21.15.17:0/3508563754 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604d38c9de0 con 0x5604d3b492d0 2023-07-14T13:06:30.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.962+0000 7fd43259c700 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b49be0 0x5604d3b598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:30.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.963+0000 7fd432d9d700 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b492d0 0x5604d3b59360 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd424012810 tx=0x7fd424003f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82b419f371592ada server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:30.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.963+0000 7fd416ff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:06:30.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.963+0000 7fd416ff5700 1 -- 172.21.15.17:0/3508563754 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42402a070 con 0x5604d3b492d0 2023-07-14T13:06:30.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.963+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3508563754 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd424009e60 con 0x5604d3b492d0 2023-07-14T13:06:30.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.963+0000 7fd416ff5700 1 -- 172.21.15.17:0/3508563754 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd42402c420 con 0x5604d3b492d0 2023-07-14T13:06:30.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.963+0000 7fd416ff5700 1 -- 172.21.15.17:0/3508563754 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd424017040 con 0x5604d3b492d0 2023-07-14T13:06:30.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.963+0000 7fd44cbe6b80 10 client.26714 fetch_fsmap learned FSMap version 31 2023-07-14T13:06:30.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.963+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3508563754 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fd43410d220 con 0x5604d3b492d0 2023-07-14T13:06:30.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.964+0000 7fd416ff5700 1 -- 172.21.15.17:0/3508563754 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd424009e60 con 0x5604d3b492d0 2023-07-14T13:06:30.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.964+0000 7fd416ff5700 1 -- 172.21.15.17:0/3508563754 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd42402cbd0 con 0x5604d3b492d0 2023-07-14T13:06:30.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.964+0000 7fd44cbe6b80 10 client.26714 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:06:30.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.964+0000 7fd44cbe6b80 10 client.26714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:06:30.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.964+0000 7fd44cbe6b80 20 client.26714 populate_metadata read hostname 'smithi017' 2023-07-14T13:06:30.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.964+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604d3bb9190 0x5604d3bbb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:30.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.964+0000 7fd44cbe6b80 4 client.26714 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:06:30.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.964+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3508563754 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5604d3a57050 con 0x5604d3bb9190 2023-07-14T13:06:30.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.964+0000 7fd43259c700 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604d3bb9190 0x5604d3bbb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:30.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd43259c700 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604d3bb9190 0x5604d3bbb5a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a505c3f426f336fe server_cookie=41fac5266560b95 in_seq=0 out_seq=0 2023-07-14T13:06:30.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd416ff5700 10 client.26714 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:30.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd416ff5700 1 -- 172.21.15.17:0/3508563754 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5604d3a57050 con 0x5604d3bb9190 2023-07-14T13:06:30.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd416ff5700 10 client.26714 handle_command_reply: tid=0 2023-07-14T13:06:30.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd44cbe6b80 1 client.26714 shutdown 2023-07-14T13:06:30.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3508563754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b492d0 msgr2=0x5604d3b59360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:30.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b492d0 0x5604d3b59360 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd424012810 tx=0x7fd424003f30 comp rx=0 tx=0).stop 2023-07-14T13:06:30.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3508563754 shutdown_connections 2023-07-14T13:06:30.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604d3bb9190 0x5604d3bbb5a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604d3b54ad0 0x5604d3bb1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604d3b492d0 0x5604d3b59360 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd44cbe6b80 1 --2- 172.21.15.17:0/3508563754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604d3b49be0 0x5604d3b598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3508563754 >> 172.21.15.17:0/3508563754 conn(0x5604d3b3fda0 msgr2=0x5604d3b4b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:30.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd416ff5700 0 client.26714 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:30.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.965+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3508563754 shutdown_connections 2023-07-14T13:06:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd44cbe6b80 1 -- 172.21.15.17:0/3508563754 wait complete. 2023-07-14T13:06:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd44cbe6b80 20 client.26714 trim_cache size 0 max 16384 2023-07-14T13:06:30.016 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:06:30.016 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:06:30.016 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:06:30.016 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:06:30.016 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:06:30.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:06:30.017 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:06:30.017 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:06:30.017 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:06:30.017 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:06:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd4391ff700 1 -- 172.21.15.17:0/2089324827 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd41c0a1340 msgr2=0x7fd41c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd4391ff700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd41c0a1340 0x7fd41c0a37f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00b780 tx=0x7fd42c009540 comp rx=0 tx=0).stop 2023-07-14T13:06:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd4391ff700 1 -- 172.21.15.17:0/2089324827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd434100490 msgr2=0x7fd43419bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd4391ff700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd434100490 0x7fd43419bf10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd42800e9a0 tx=0x7fd42800ecb0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd4391ff700 1 -- 172.21.15.17:0/2089324827 shutdown_connections 2023-07-14T13:06:30.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd4391ff700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd41c0a1340 0x7fd41c0a37f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd4391ff700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd434105af0 0x7fd434195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd4391ff700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4340ffae0 0x7fd43419b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd4391ff700 1 --2- 172.21.15.17:0/2089324827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd434100490 0x7fd43419bf10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.966+0000 7fd4391ff700 1 -- 172.21.15.17:0/2089324827 >> 172.21.15.17:0/2089324827 conn(0x7fd4340fb5e0 msgr2=0x7fd4340fbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.967+0000 7fd4391ff700 1 -- 172.21.15.17:0/2089324827 shutdown_connections 2023-07-14T13:06:30.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:06:29.967+0000 7fd4391ff700 1 -- 172.21.15.17:0/2089324827 wait complete. 2023-07-14T13:06:30.020 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:06:31.264 INFO:teuthology.orchestra.run.smithi017.stderr:25700000 of 50000000 tuples (51%) done (elapsed 380.87 s, remaining 360.12 s) 2023-07-14T13:06:31.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:31 smithi135 ceph-mon[97338]: pgmap v208: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 33 MiB/s wr, 55 op/s 2023-07-14T13:06:31.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:31 smithi131 ceph-mon[96953]: pgmap v208: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 33 MiB/s wr, 55 op/s 2023-07-14T13:06:31.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:31 smithi017 ceph-mon[95536]: pgmap v208: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 33 MiB/s wr, 55 op/s 2023-07-14T13:06:32.560 INFO:teuthology.orchestra.run.smithi017.stderr:25800000 of 50000000 tuples (51%) done (elapsed 382.16 s, remaining 358.46 s) 2023-07-14T13:06:33.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:33 smithi131 ceph-mon[96953]: pgmap v209: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 22 MiB/s wr, 32 op/s 2023-07-14T13:06:33.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:33 smithi017 ceph-mon[95536]: pgmap v209: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 22 MiB/s wr, 32 op/s 2023-07-14T13:06:33.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:33 smithi135 ceph-mon[97338]: pgmap v209: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 22 MiB/s wr, 32 op/s 2023-07-14T13:06:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:25900000 of 50000000 tuples (51%) done (elapsed 383.46 s, remaining 356.81 s) 2023-07-14T13:06:34.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:34 smithi131 ceph-mon[96953]: pgmap v210: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 22 MiB/s wr, 32 op/s 2023-07-14T13:06:34.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:34 smithi017 ceph-mon[95536]: pgmap v210: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 22 MiB/s wr, 32 op/s 2023-07-14T13:06:34.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:34 smithi135 ceph-mon[97338]: pgmap v210: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 22 MiB/s wr, 32 op/s 2023-07-14T13:06:35.237 INFO:teuthology.orchestra.run.smithi017.stderr:26000000 of 50000000 tuples (52%) done (elapsed 384.84 s, remaining 355.24 s) 2023-07-14T13:06:36.660 INFO:teuthology.orchestra.run.smithi017.stderr:26100000 of 50000000 tuples (52%) done (elapsed 386.26 s, remaining 353.70 s) 2023-07-14T13:06:37.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:37 smithi017 ceph-mon[95536]: pgmap v211: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 33 MiB/s wr, 54 op/s 2023-07-14T13:06:37.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:37 smithi135 ceph-mon[97338]: pgmap v211: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 33 MiB/s wr, 54 op/s 2023-07-14T13:06:37.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:37 smithi131 ceph-mon[96953]: pgmap v211: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 33 MiB/s wr, 54 op/s 2023-07-14T13:06:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.842+0000 7fa3649ff700 1 -- 172.21.15.17:0/1011121168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360100500 msgr2=0x7fa36010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.842+0000 7fa3649ff700 1 --2- 172.21.15.17:0/1011121168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360100500 0x7fa36010c940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa35800b0a0 tx=0x7fa35800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.842+0000 7fa3649ff700 1 -- 172.21.15.17:0/1011121168 shutdown_connections 2023-07-14T13:06:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.842+0000 7fa3649ff700 1 --2- 172.21.15.17:0/1011121168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360100500 0x7fa36010c940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.842+0000 7fa3649ff700 1 --2- 172.21.15.17:0/1011121168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa360105b80 0x7fa360105f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.842+0000 7fa3649ff700 1 --2- 172.21.15.17:0/1011121168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3600ffb50 0x7fa3600fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.842+0000 7fa3649ff700 1 -- 172.21.15.17:0/1011121168 >> 172.21.15.17:0/1011121168 conn(0x7fa3600fb650 msgr2=0x7fa3600fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.842+0000 7fa3649ff700 1 -- 172.21.15.17:0/1011121168 shutdown_connections 2023-07-14T13:06:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.842+0000 7fa3649ff700 1 -- 172.21.15.17:0/1011121168 wait complete. 2023-07-14T13:06:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.843+0000 7fa3649ff700 1 Processor -- start 2023-07-14T13:06:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa3649ff700 1 -- start start 2023-07-14T13:06:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa3649ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3600ffb50 0x7fa360197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa3649ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa360100500 0x7fa360198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa3649ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360105b80 0x7fa36019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa3649ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36019cfc0 con 0x7fa360100500 2023-07-14T13:06:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa3649ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36019d130 con 0x7fa3600ffb50 2023-07-14T13:06:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa3649ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36019d2f0 con 0x7fa360105b80 2023-07-14T13:06:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa360100500 0x7fa360198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa360100500 0x7fa360198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56808/0 (socket says 172.21.15.17:56808) 2023-07-14T13:06:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa35dd9b700 1 -- 172.21.15.17:0/840152283 learned_addr learned my addr 172.21.15.17:0/840152283 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa35e59c700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3600ffb50 0x7fa360197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.844+0000 7fa35ed9d700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360105b80 0x7fa36019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.845+0000 7fa35dd9b700 1 -- 172.21.15.17:0/840152283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360105b80 msgr2=0x7fa36019c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.845+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360105b80 0x7fa36019c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.845+0000 7fa35dd9b700 1 -- 172.21.15.17:0/840152283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3600ffb50 msgr2=0x7fa360197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.845+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3600ffb50 0x7fa360197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.845+0000 7fa35dd9b700 1 -- 172.21.15.17:0/840152283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358009d00 con 0x7fa360100500 2023-07-14T13:06:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.845+0000 7fa35e59c700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3600ffb50 0x7fa360197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.845+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa360100500 0x7fa360198310 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa35400e9c0 tx=0x7fa35400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.845+0000 7fa34f7fe700 1 -- 172.21.15.17:0/840152283 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540097b0 con 0x7fa360100500 2023-07-14T13:06:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.845+0000 7fa3649ff700 1 -- 172.21.15.17:0/840152283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36019d5d0 con 0x7fa360100500 2023-07-14T13:06:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.845+0000 7fa34f7fe700 1 -- 172.21.15.17:0/840152283 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa354004cc0 con 0x7fa360100500 2023-07-14T13:06:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.845+0000 7fa34f7fe700 1 -- 172.21.15.17:0/840152283 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354005530 con 0x7fa360100500 2023-07-14T13:06:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.846+0000 7fa3649ff700 1 -- 172.21.15.17:0/840152283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3601a4e10 con 0x7fa360100500 2023-07-14T13:06:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.849+0000 7fa34f7fe700 1 -- 172.21.15.17:0/840152283 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa354004750 con 0x7fa360100500 2023-07-14T13:06:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.851+0000 7fa34f7fe700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3480a12c0 0x7fa3480a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.851+0000 7fa378340b80 1 Processor -- start 2023-07-14T13:06:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.851+0000 7fa34f7fe700 1 -- 172.21.15.17:0/840152283 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa354014070 con 0x7fa360100500 2023-07-14T13:06:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.851+0000 7fa378340b80 1 -- start start 2023-07-14T13:06:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.851+0000 7fa35e59c700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3480a12c0 0x7fa3480a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.851+0000 7fa378340b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 0x55bfbe933d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.851+0000 7fa378340b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 0x55bfbe92e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.851+0000 7fa378340b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 0x55bfbe92e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.851+0000 7fa378340b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe833c50 con 0x55bfbe78a6b0 2023-07-14T13:06:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.851+0000 7fa378340b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe8869e0 con 0x55bfbe92e580 2023-07-14T13:06:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.851+0000 7fa378340b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe87fe70 con 0x55bfbe9342d0 2023-07-14T13:06:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 0x55bfbe92e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 0x55bfbe92e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 0x55bfbe92e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49740/0 (socket says 172.21.15.17:49740) 2023-07-14T13:06:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 0x55bfbe92e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48306/0 (socket says 172.21.15.17:48306) 2023-07-14T13:06:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35ed9d700 1 -- 172.21.15.17:0/2307523782 learned_addr learned my addr 172.21.15.17:0/2307523782 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35e59c700 1 --2- 172.21.15.17:0/2307523782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 0x55bfbe933d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35e59c700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3480a12c0 0x7fa3480a3770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa350011550 tx=0x7fa350009f90 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35ed9d700 1 -- 172.21.15.17:0/2307523782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 msgr2=0x55bfbe92e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35ed9d700 1 --2- 172.21.15.17:0/2307523782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 0x55bfbe92e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35ed9d700 1 -- 172.21.15.17:0/2307523782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 msgr2=0x55bfbe933d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35ed9d700 1 --2- 172.21.15.17:0/2307523782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 0x55bfbe933d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35ed9d700 1 -- 172.21.15.17:0/2307523782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfbe6add80 con 0x55bfbe92e580 2023-07-14T13:06:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/2307523782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 0x55bfbe92e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.852+0000 7fa35ed9d700 1 --2- 172.21.15.17:0/2307523782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 0x55bfbe92e9d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa358015000 tx=0x7fa358009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ea444fa8ac9d9a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.853+0000 7fa34cff9700 1 -- 172.21.15.17:0/2307523782 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35800e040 con 0x55bfbe92e580 2023-07-14T13:06:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.853+0000 7fa34cff9700 1 -- 172.21.15.17:0/2307523782 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa358009460 con 0x55bfbe92e580 2023-07-14T13:06:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.853+0000 7fa34cff9700 1 -- 172.21.15.17:0/2307523782 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358004cb0 con 0x55bfbe92e580 2023-07-14T13:06:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.854+0000 7fa378340b80 1 -- 172.21.15.17:0/2307523782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 msgr2=0x55bfbe92e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.854+0000 7fa378340b80 1 --2- 172.21.15.17:0/2307523782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 0x55bfbe92e9d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa358015000 tx=0x7fa358009c20 comp rx=0 tx=0).stop 2023-07-14T13:06:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.854+0000 7fa378340b80 1 -- 172.21.15.17:0/2307523782 shutdown_connections 2023-07-14T13:06:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.854+0000 7fa378340b80 1 --2- 172.21.15.17:0/2307523782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 0x55bfbe92e9d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.854+0000 7fa378340b80 1 --2- 172.21.15.17:0/2307523782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 0x55bfbe933d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.854+0000 7fa378340b80 1 --2- 172.21.15.17:0/2307523782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 0x55bfbe92e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.854+0000 7fa378340b80 1 -- 172.21.15.17:0/2307523782 >> 172.21.15.17:0/2307523782 conn(0x55bfbe923be0 msgr2=0x55bfbe928f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.854+0000 7fa378340b80 1 -- 172.21.15.17:0/2307523782 shutdown_connections 2023-07-14T13:06:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.854+0000 7fa378340b80 1 -- 172.21.15.17:0/2307523782 wait complete. 2023-07-14T13:06:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.854+0000 7fa378340b80 1 -- start start 2023-07-14T13:06:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.855+0000 7fa378340b80 1 Processor -- start 2023-07-14T13:06:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.855+0000 7fa378340b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 0x55bfbe93a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.855+0000 7fa378340b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 0x55bfbe937820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.855+0000 7fa378340b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 0x55bfbe937f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.855+0000 7fa378340b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe81fa60 con 0x55bfbe78a6b0 2023-07-14T13:06:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.855+0000 7fa378340b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe81f760 con 0x55bfbe92e580 2023-07-14T13:06:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.855+0000 7fa378340b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe7038c0 con 0x55bfbe9342d0 2023-07-14T13:06:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.856+0000 7fa378340b80 10 client.0 _ll_register_callbacks cb 0x55bfbe81d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.856+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 0x55bfbe93a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.856+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 0x55bfbe937820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.856+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 0x55bfbe93a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56816/0 (socket says 172.21.15.17:56816) 2023-07-14T13:06:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.856+0000 7fa35e59c700 1 -- 172.21.15.17:0/3085358015 learned_addr learned my addr 172.21.15.17:0/3085358015 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.856+0000 7fa35ed9d700 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 0x55bfbe937f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.856+0000 7fa35e59c700 1 -- 172.21.15.17:0/3085358015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 msgr2=0x55bfbe937f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.856+0000 7fa35e59c700 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 0x55bfbe937f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.856+0000 7fa35e59c700 1 -- 172.21.15.17:0/3085358015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 msgr2=0x55bfbe937820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.856+0000 7fa35e59c700 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 0x55bfbe937820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.856+0000 7fa35e59c700 1 -- 172.21.15.17:0/3085358015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3601a4e10 con 0x55bfbe78a6b0 2023-07-14T13:06:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.857+0000 7fa35e59c700 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 0x55bfbe93a610 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa35000fb80 tx=0x7fa3500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31851b0e6d52f3c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.857+0000 7fa345ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:06:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.857+0000 7fa345ffb700 1 -- 172.21.15.17:0/3085358015 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35001ed10 con 0x55bfbe78a6b0 2023-07-14T13:06:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.857+0000 7fa345ffb700 1 -- 172.21.15.17:0/3085358015 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa350004030 con 0x55bfbe78a6b0 2023-07-14T13:06:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.857+0000 7fa378340b80 1 -- 172.21.15.17:0/3085358015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfbe7d9490 con 0x55bfbe78a6b0 2023-07-14T13:06:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.857+0000 7fa345ffb700 1 -- 172.21.15.17:0/3085358015 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa35000fe90 con 0x55bfbe78a6b0 2023-07-14T13:06:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.857+0000 7fa378340b80 10 client.17004 fetch_fsmap learned FSMap version 31 2023-07-14T13:06:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.857+0000 7fa378340b80 1 -- 172.21.15.17:0/3085358015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fa36010d240 con 0x55bfbe78a6b0 2023-07-14T13:06:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.858+0000 7fa345ffb700 1 -- 172.21.15.17:0/3085358015 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bfbe7d9490 con 0x55bfbe78a6b0 2023-07-14T13:06:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.858+0000 7fa345ffb700 1 -- 172.21.15.17:0/3085358015 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa350031470 con 0x55bfbe78a6b0 2023-07-14T13:06:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.858+0000 7fa378340b80 10 client.17004 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:06:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.858+0000 7fa378340b80 10 client.17004 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:06:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.858+0000 7fa378340b80 20 client.17004 populate_metadata read hostname 'smithi017' 2023-07-14T13:06:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.858+0000 7fa378340b80 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfbe947b90 0x55bfbe949fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.858+0000 7fa378340b80 4 client.17004 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:06:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.858+0000 7fa378340b80 1 -- 172.21.15.17:0/3085358015 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bfbe878e50 con 0x55bfbe947b90 2023-07-14T13:06:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.858+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfbe947b90 0x55bfbe949fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.859+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfbe947b90 0x55bfbe949fa0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5cf7ce89ae7cbfa server_cookie=28b7ac05421ef582 in_seq=0 out_seq=0 2023-07-14T13:06:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.859+0000 7fa345ffb700 10 client.17004 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa345ffb700 1 -- 172.21.15.17:0/3085358015 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bfbe878e50 con 0x55bfbe947b90 2023-07-14T13:06:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa345ffb700 10 client.17004 handle_command_reply: tid=0 2023-07-14T13:06:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 1 client.17004 shutdown 2023-07-14T13:06:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 1 -- 172.21.15.17:0/3085358015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 msgr2=0x55bfbe93a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 0x55bfbe93a610 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa35000fb80 tx=0x7fa3500047c0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 1 -- 172.21.15.17:0/3085358015 shutdown_connections 2023-07-14T13:06:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfbe947b90 0x55bfbe949fa0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe9342d0 0x55bfbe937f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe78a6b0 0x55bfbe93a610 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 1 --2- 172.21.15.17:0/3085358015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe92e580 0x55bfbe937820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa345ffb700 0 client.17004 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 1 -- 172.21.15.17:0/3085358015 >> 172.21.15.17:0/3085358015 conn(0x55bfbe923be0 msgr2=0x55bfbe9284e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 1 -- 172.21.15.17:0/3085358015 shutdown_connections 2023-07-14T13:06:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 1 -- 172.21.15.17:0/3085358015 wait complete. 2023-07-14T13:06:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.860+0000 7fa378340b80 20 client.17004 trim_cache size 0 max 16384 2023-07-14T13:06:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.882+0000 7fa378340b80 1 Processor -- start 2023-07-14T13:06:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.882+0000 7fa378340b80 1 -- start start 2023-07-14T13:06:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa378340b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 0x55bfbe92e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa378340b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 0x55bfbe9377d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa378340b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe9342d0 0x55bfbe93ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa378340b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe929ee0 con 0x55bfbe9342d0 2023-07-14T13:06:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa378340b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe938540 con 0x55bfbe78a6b0 2023-07-14T13:06:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa378340b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe9255f0 con 0x55bfbe92e580 2023-07-14T13:06:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 0x55bfbe9377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 0x55bfbe9377d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48314/0 (socket says 172.21.15.17:48314) 2023-07-14T13:06:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa35dd9b700 1 -- 172.21.15.17:0/977212304 learned_addr learned my addr 172.21.15.17:0/977212304 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa35ed9d700 1 --2- 172.21.15.17:0/977212304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe9342d0 0x55bfbe93ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa35e59c700 1 --2- 172.21.15.17:0/977212304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 0x55bfbe92e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa35dd9b700 1 -- 172.21.15.17:0/977212304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 msgr2=0x55bfbe92e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/977212304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 0x55bfbe92e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa35dd9b700 1 -- 172.21.15.17:0/977212304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe9342d0 msgr2=0x55bfbe93ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/977212304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe9342d0 0x55bfbe93ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa35dd9b700 1 -- 172.21.15.17:0/977212304 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfbe696c00 con 0x55bfbe92e580 2023-07-14T13:06:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.883+0000 7fa35e59c700 1 --2- 172.21.15.17:0/977212304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 0x55bfbe92e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.884+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/977212304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 0x55bfbe9377d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa3540cade0 tx=0x7fa35409d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a544236da3efe36 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.884+0000 7fa34d7fa700 1 -- 172.21.15.17:0/977212304 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400b2c0 con 0x55bfbe92e580 2023-07-14T13:06:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.884+0000 7fa34d7fa700 1 -- 172.21.15.17:0/977212304 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa35409a160 con 0x55bfbe92e580 2023-07-14T13:06:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.884+0000 7fa34d7fa700 1 -- 172.21.15.17:0/977212304 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa354098620 con 0x55bfbe92e580 2023-07-14T13:06:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.885+0000 7fa378340b80 1 -- 172.21.15.17:0/977212304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 msgr2=0x55bfbe9377d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.885+0000 7fa378340b80 1 --2- 172.21.15.17:0/977212304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 0x55bfbe9377d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa3540cade0 tx=0x7fa35409d040 comp rx=0 tx=0).stop 2023-07-14T13:06:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.885+0000 7fa378340b80 1 -- 172.21.15.17:0/977212304 shutdown_connections 2023-07-14T13:06:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.885+0000 7fa378340b80 1 --2- 172.21.15.17:0/977212304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe9342d0 0x55bfbe93ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.885+0000 7fa378340b80 1 --2- 172.21.15.17:0/977212304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 0x55bfbe92e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.885+0000 7fa378340b80 1 --2- 172.21.15.17:0/977212304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 0x55bfbe9377d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.885+0000 7fa378340b80 1 -- 172.21.15.17:0/977212304 >> 172.21.15.17:0/977212304 conn(0x55bfbe923be0 msgr2=0x55bfbe9370c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.885+0000 7fa378340b80 1 -- 172.21.15.17:0/977212304 shutdown_connections 2023-07-14T13:06:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.885+0000 7fa378340b80 1 -- 172.21.15.17:0/977212304 wait complete. 2023-07-14T13:06:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.886+0000 7fa378340b80 1 -- start start 2023-07-14T13:06:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.886+0000 7fa378340b80 1 Processor -- start 2023-07-14T13:06:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.886+0000 7fa378340b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 0x55bfbe994d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.886+0000 7fa378340b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 0x55bfbe9952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa378340b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe9342d0 0x55bfbe9939c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa378340b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe994080 con 0x55bfbe9342d0 2023-07-14T13:06:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa378340b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe9941f0 con 0x55bfbe78a6b0 2023-07-14T13:06:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa378340b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfbe9943b0 con 0x55bfbe92e580 2023-07-14T13:06:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa378340b80 10 client.0 _ll_register_callbacks cb 0x7fa35000f940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 0x55bfbe994d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 0x55bfbe9952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 0x55bfbe994d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49756/0 (socket says 172.21.15.17:49756) 2023-07-14T13:06:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35e59c700 1 -- 172.21.15.17:0/2803883748 learned_addr learned my addr 172.21.15.17:0/2803883748 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 0x55bfbe9952b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48324/0 (socket says 172.21.15.17:48324) 2023-07-14T13:06:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35ed9d700 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe9342d0 0x55bfbe9939c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35e59c700 1 -- 172.21.15.17:0/2803883748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 msgr2=0x55bfbe9952b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35e59c700 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 0x55bfbe9952b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35e59c700 1 -- 172.21.15.17:0/2803883748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe9342d0 msgr2=0x55bfbe9939c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35e59c700 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe9342d0 0x55bfbe9939c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35e59c700 1 -- 172.21.15.17:0/2803883748 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36019d5d0 con 0x55bfbe78a6b0 2023-07-14T13:06:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.887+0000 7fa35ed9d700 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe9342d0 0x55bfbe9939c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.888+0000 7fa35e59c700 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 0x55bfbe994d70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa3500317d0 tx=0x7fa35000ff80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e83d1be166f2340a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.888+0000 7fa345ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:06:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.888+0000 7fa345ffb700 1 -- 172.21.15.17:0/2803883748 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350031b70 con 0x55bfbe78a6b0 2023-07-14T13:06:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.888+0000 7fa378340b80 1 -- 172.21.15.17:0/2803883748 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa358009460 con 0x55bfbe78a6b0 2023-07-14T13:06:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.888+0000 7fa345ffb700 1 -- 172.21.15.17:0/2803883748 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa35001eb10 con 0x55bfbe78a6b0 2023-07-14T13:06:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.889+0000 7fa345ffb700 1 -- 172.21.15.17:0/2803883748 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa35001ecd0 con 0x55bfbe78a6b0 2023-07-14T13:06:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.889+0000 7fa378340b80 10 client.26732 fetch_fsmap learned FSMap version 31 2023-07-14T13:06:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.889+0000 7fa378340b80 1 -- 172.21.15.17:0/2803883748 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55bfbe6d41f0 con 0x55bfbe78a6b0 2023-07-14T13:06:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.889+0000 7fa345ffb700 1 -- 172.21.15.17:0/2803883748 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa35003e020 con 0x55bfbe78a6b0 2023-07-14T13:06:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.889+0000 7fa345ffb700 1 -- 172.21.15.17:0/2803883748 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa350003aa0 con 0x55bfbe78a6b0 2023-07-14T13:06:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.889+0000 7fa378340b80 10 client.26732 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:06:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.889+0000 7fa378340b80 10 client.26732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:06:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.889+0000 7fa378340b80 20 client.26732 populate_metadata read hostname 'smithi017' 2023-07-14T13:06:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.890+0000 7fa378340b80 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfbe99cb80 0x55bfbe99ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.890+0000 7fa378340b80 4 client.26732 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:06:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.890+0000 7fa378340b80 1 -- 172.21.15.17:0/2803883748 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bfbe83aff0 con 0x55bfbe99cb80 2023-07-14T13:06:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.890+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfbe99cb80 0x55bfbe99ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.891+0000 7fa35dd9b700 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfbe99cb80 0x55bfbe99ef90 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80d9d41536805cc8 server_cookie=825307aa28ee865d in_seq=0 out_seq=0 2023-07-14T13:06:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.891+0000 7fa345ffb700 10 client.26732 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa345ffb700 1 -- 172.21.15.17:0/2803883748 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bfbe83aff0 con 0x55bfbe99cb80 2023-07-14T13:06:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa345ffb700 10 client.26732 handle_command_reply: tid=0 2023-07-14T13:06:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa378340b80 1 client.26732 shutdown 2023-07-14T13:06:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa378340b80 1 -- 172.21.15.17:0/2803883748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 msgr2=0x55bfbe994d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa378340b80 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 0x55bfbe994d70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa3500317d0 tx=0x7fa35000ff80 comp rx=0 tx=0).stop 2023-07-14T13:06:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa378340b80 1 -- 172.21.15.17:0/2803883748 shutdown_connections 2023-07-14T13:06:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa378340b80 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfbe99cb80 0x55bfbe99ef90 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa378340b80 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfbe9342d0 0x55bfbe9939c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa378340b80 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfbe78a6b0 0x55bfbe994d70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa378340b80 1 --2- 172.21.15.17:0/2803883748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfbe92e580 0x55bfbe9952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa345ffb700 0 client.26732 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.907+0000 7fa378340b80 1 -- 172.21.15.17:0/2803883748 >> 172.21.15.17:0/2803883748 conn(0x55bfbe923be0 msgr2=0x55bfbe9329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.908+0000 7fa378340b80 1 -- 172.21.15.17:0/2803883748 shutdown_connections 2023-07-14T13:06:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.908+0000 7fa378340b80 1 -- 172.21.15.17:0/2803883748 wait complete. 2023-07-14T13:06:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.908+0000 7fa378340b80 20 client.26732 trim_cache size 0 max 16384 2023-07-14T13:06:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:06:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:06:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:06:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:06:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 -- 172.21.15.17:0/840152283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3480a12c0 msgr2=0x7fa3480a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3480a12c0 0x7fa3480a3770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa350011550 tx=0x7fa350009f90 comp rx=0 tx=0).stop 2023-07-14T13:06:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 -- 172.21.15.17:0/840152283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa360100500 msgr2=0x7fa360198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa360100500 0x7fa360198310 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa35400e9c0 tx=0x7fa35400ecd0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 -- 172.21.15.17:0/840152283 shutdown_connections 2023-07-14T13:06:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa3480a12c0 0x7fa3480a3770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa360105b80 0x7fa36019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3600ffb50 0x7fa360197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 --2- 172.21.15.17:0/840152283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa360100500 0x7fa360198310 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 -- 172.21.15.17:0/840152283 >> 172.21.15.17:0/840152283 conn(0x7fa3600fb650 msgr2=0x7fa3600fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 -- 172.21.15.17:0/840152283 shutdown_connections 2023-07-14T13:06:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:37.909+0000 7fa3649ff700 1 -- 172.21.15.17:0/840152283 wait complete. 2023-07-14T13:06:37.987 INFO:teuthology.orchestra.run.smithi017.stderr:26200000 of 50000000 tuples (52%) done (elapsed 387.59 s, remaining 352.08 s) 2023-07-14T13:06:39.348 INFO:teuthology.orchestra.run.smithi017.stderr:26300000 of 50000000 tuples (52%) done (elapsed 388.95 s, remaining 350.50 s) 2023-07-14T13:06:39.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:39 smithi017 ceph-mon[95536]: pgmap v212: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 21 MiB/s wr, 37 op/s 2023-07-14T13:06:39.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:39 smithi135 ceph-mon[97338]: pgmap v212: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 21 MiB/s wr, 37 op/s 2023-07-14T13:06:39.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:39 smithi131 ceph-mon[96953]: pgmap v212: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 21 MiB/s wr, 37 op/s 2023-07-14T13:06:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:26400000 of 50000000 tuples (52%) done (elapsed 390.39 s, remaining 348.99 s) 2023-07-14T13:06:41.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:41 smithi017 ceph-mon[95536]: pgmap v213: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 32 MiB/s wr, 82 op/s 2023-07-14T13:06:41.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:41 smithi135 ceph-mon[97338]: pgmap v213: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 32 MiB/s wr, 82 op/s 2023-07-14T13:06:41.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:41 smithi131 ceph-mon[96953]: pgmap v213: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 32 MiB/s wr, 82 op/s 2023-07-14T13:06:42.070 INFO:teuthology.orchestra.run.smithi017.stderr:26500000 of 50000000 tuples (53%) done (elapsed 391.67 s, remaining 347.33 s) 2023-07-14T13:06:43.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:43 smithi017 ceph-mon[95536]: pgmap v214: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 22 MiB/s wr, 66 op/s 2023-07-14T13:06:43.394 INFO:teuthology.orchestra.run.smithi017.stderr:26600000 of 50000000 tuples (53%) done (elapsed 393.00 s, remaining 345.72 s) 2023-07-14T13:06:43.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:43 smithi135 ceph-mon[97338]: pgmap v214: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 22 MiB/s wr, 66 op/s 2023-07-14T13:06:43.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:43 smithi131 ceph-mon[96953]: pgmap v214: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 22 MiB/s wr, 66 op/s 2023-07-14T13:06:44.830 INFO:teuthology.orchestra.run.smithi017.stderr:26700000 of 50000000 tuples (53%) done (elapsed 394.43 s, remaining 344.20 s) 2023-07-14T13:06:45.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:45 smithi017 ceph-mon[95536]: pgmap v215: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 22 MiB/s wr, 66 op/s 2023-07-14T13:06:45.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:45 smithi135 ceph-mon[97338]: pgmap v215: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 22 MiB/s wr, 66 op/s 2023-07-14T13:06:45.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:45 smithi131 ceph-mon[96953]: pgmap v215: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 22 MiB/s wr, 66 op/s 2023-07-14T13:06:46.128 INFO:teuthology.orchestra.run.smithi017.stderr:26800000 of 50000000 tuples (53%) done (elapsed 395.73 s, remaining 342.57 s) 2023-07-14T13:06:47.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:47 smithi017 ceph-mon[95536]: pgmap v216: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:06:47.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:47 smithi135 ceph-mon[97338]: pgmap v216: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:06:47.485 INFO:teuthology.orchestra.run.smithi017.stderr:26900000 of 50000000 tuples (53%) done (elapsed 397.09 s, remaining 340.99 s) 2023-07-14T13:06:47.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:47 smithi131 ceph-mon[96953]: pgmap v216: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:06:48.894 INFO:teuthology.orchestra.run.smithi017.stderr:27000000 of 50000000 tuples (54%) done (elapsed 398.50 s, remaining 339.46 s) 2023-07-14T13:06:49.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:49 smithi017 ceph-mon[95536]: pgmap v217: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:06:49.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:49 smithi135 ceph-mon[97338]: pgmap v217: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:06:49.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:49 smithi131 ceph-mon[96953]: pgmap v217: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:06:50.189 INFO:teuthology.orchestra.run.smithi017.stderr:27100000 of 50000000 tuples (54%) done (elapsed 399.79 s, remaining 337.83 s) 2023-07-14T13:06:51.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.078+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/1824061604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b940ffdc0 msgr2=0x7f2b94100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.078+0000 7f2b9c5ff700 1 --2- 172.21.15.17:0/1824061604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b940ffdc0 0x7f2b94100190 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2b900099c0 tx=0x7f2b90009cd0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.078+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/1824061604 shutdown_connections 2023-07-14T13:06:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.078+0000 7f2b9c5ff700 1 --2- 172.21.15.17:0/1824061604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b94104e00 0x7f2b9410c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.078+0000 7f2b9c5ff700 1 --2- 172.21.15.17:0/1824061604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b940ffdc0 0x7f2b94100190 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.078+0000 7f2b9c5ff700 1 --2- 172.21.15.17:0/1824061604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b94100760 0x7f2b94104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.078+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/1824061604 >> 172.21.15.17:0/1824061604 conn(0x7f2b940fb650 msgr2=0x7f2b940fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.078+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/1824061604 shutdown_connections 2023-07-14T13:06:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.078+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/1824061604 wait complete. 2023-07-14T13:06:51.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.079+0000 7f2b9c5ff700 1 Processor -- start 2023-07-14T13:06:51.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.079+0000 7f2b9c5ff700 1 -- start start 2023-07-14T13:06:51.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.080+0000 7f2b9c5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b940ffdc0 0x7f2b94197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.080+0000 7f2b9c5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b94100760 0x7f2b941982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.080+0000 7f2b9c5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b94104e00 0x7f2b9419c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.080+0000 7f2b9c5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9419cf80 con 0x7f2b94104e00 2023-07-14T13:06:51.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.080+0000 7f2b9c5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9419d0f0 con 0x7f2b94100760 2023-07-14T13:06:51.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.080+0000 7f2b9c5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9419d2b0 con 0x7f2b940ffdc0 2023-07-14T13:06:51.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.080+0000 7f2b9a39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b940ffdc0 0x7f2b94197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.080+0000 7f2b9a39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b940ffdc0 0x7f2b94197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34718/0 (socket says 172.21.15.17:34718) 2023-07-14T13:06:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.080+0000 7f2b9ab9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b94104e00 0x7f2b9419c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.080+0000 7f2b9a39b700 1 -- 172.21.15.17:0/3928804743 learned_addr learned my addr 172.21.15.17:0/3928804743 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.080+0000 7f2b99b9a700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b94100760 0x7f2b941982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.081+0000 7f2b9a39b700 1 -- 172.21.15.17:0/3928804743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b94100760 msgr2=0x7f2b941982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.081+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b94100760 0x7f2b941982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.081+0000 7f2b9a39b700 1 -- 172.21.15.17:0/3928804743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b94104e00 msgr2=0x7f2b9419c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.081+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b94104e00 0x7f2b9419c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.081+0000 7f2b9a39b700 1 -- 172.21.15.17:0/3928804743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b84009520 con 0x7f2b940ffdc0 2023-07-14T13:06:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.081+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b940ffdc0 0x7f2b94197d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b90005910 tx=0x7f2b9000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.081+0000 7f2b8b7fe700 1 -- 172.21.15.17:0/3928804743 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9001d070 con 0x7f2b940ffdc0 2023-07-14T13:06:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.081+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/3928804743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b900095f0 con 0x7f2b940ffdc0 2023-07-14T13:06:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.081+0000 7f2b8b7fe700 1 -- 172.21.15.17:0/3928804743 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b90005050 con 0x7f2b940ffdc0 2023-07-14T13:06:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.081+0000 7f2b8b7fe700 1 -- 172.21.15.17:0/3928804743 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90004950 con 0x7f2b940ffdc0 2023-07-14T13:06:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.082+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/3928804743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9419d7c0 con 0x7f2b940ffdc0 2023-07-14T13:06:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.085+0000 7f2b8b7fe700 1 -- 172.21.15.17:0/3928804743 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2b900051c0 con 0x7f2b940ffdc0 2023-07-14T13:06:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.086+0000 7f2bafedeb80 1 Processor -- start 2023-07-14T13:06:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.087+0000 7f2bafedeb80 1 -- start start 2023-07-14T13:06:51.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.087+0000 7f2b8b7fe700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b800a12c0 0x7f2b800a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.087+0000 7f2b8b7fe700 1 -- 172.21.15.17:0/3928804743 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2b900cda60 con 0x7f2b940ffdc0 2023-07-14T13:06:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.087+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 0x55c2150fdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.087+0000 7f2b9ab9c700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b800a12c0 0x7f2b800a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.087+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150fe2d0 0x55c2150f8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.087+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2150f8580 0x55c2150f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.087+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c214ffdc50 con 0x55c214f546b0 2023-07-14T13:06:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.087+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2150509e0 con 0x55c2150f8580 2023-07-14T13:06:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.087+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c215049e70 con 0x55c2150fe2d0 2023-07-14T13:06:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 0x55c2150fdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 0x55c2150fdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59604/0 (socket says 172.21.15.17:59604) 2023-07-14T13:06:51.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9a39b700 1 -- 172.21.15.17:0/4148967827 learned_addr learned my addr 172.21.15.17:0/4148967827 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9ab9c700 1 --2- 172.21.15.17:0/4148967827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2150f8580 0x55c2150f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b99b9a700 1 --2- 172.21.15.17:0/4148967827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150fe2d0 0x55c2150f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9a39b700 1 -- 172.21.15.17:0/4148967827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150fe2d0 msgr2=0x55c2150f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/4148967827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150fe2d0 0x55c2150f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9a39b700 1 -- 172.21.15.17:0/4148967827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2150f8580 msgr2=0x55c2150f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/4148967827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2150f8580 0x55c2150f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9a39b700 1 -- 172.21.15.17:0/4148967827 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c214e77d80 con 0x55c214f546b0 2023-07-14T13:06:51.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9ab9c700 1 --2- 172.21.15.17:0/4148967827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2150f8580 0x55c2150f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:06:51.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9ab9c700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b800a12c0 0x7f2b800a3770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00f870 tx=0x7f2b8c00fc30 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:51.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.088+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/4148967827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 0x55c2150fdd90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2b90097080 tx=0x7f2b9009ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6439c9ab8ae8bd20 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:51.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.089+0000 7f2b88bfe700 1 -- 172.21.15.17:0/4148967827 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90098d80 con 0x55c214f546b0 2023-07-14T13:06:51.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.089+0000 7f2b88bfe700 1 -- 172.21.15.17:0/4148967827 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b9009ade0 con 0x55c214f546b0 2023-07-14T13:06:51.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.089+0000 7f2b88bfe700 1 -- 172.21.15.17:0/4148967827 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b900a2cd0 con 0x55c214f546b0 2023-07-14T13:06:51.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.089+0000 7f2bafedeb80 1 -- 172.21.15.17:0/4148967827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 msgr2=0x55c2150fdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.089+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/4148967827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 0x55c2150fdd90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2b90097080 tx=0x7f2b9009ac70 comp rx=0 tx=0).stop 2023-07-14T13:06:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.090+0000 7f2bafedeb80 1 -- 172.21.15.17:0/4148967827 shutdown_connections 2023-07-14T13:06:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.090+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/4148967827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2150f8580 0x55c2150f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.090+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/4148967827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 0x55c2150fdd90 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.090+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/4148967827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150fe2d0 0x55c2150f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.090+0000 7f2bafedeb80 1 -- 172.21.15.17:0/4148967827 >> 172.21.15.17:0/4148967827 conn(0x55c2150edbe0 msgr2=0x55c2150f2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:51.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.090+0000 7f2bafedeb80 1 -- 172.21.15.17:0/4148967827 shutdown_connections 2023-07-14T13:06:51.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.090+0000 7f2bafedeb80 1 -- 172.21.15.17:0/4148967827 wait complete. 2023-07-14T13:06:51.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.090+0000 7f2bafedeb80 1 -- start start 2023-07-14T13:06:51.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.091+0000 7f2bafedeb80 1 Processor -- start 2023-07-14T13:06:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.091+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c2151072f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.091+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2150f8580 0x55c215107830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.091+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150fe2d0 0x55c215101650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.091+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c214fe9a60 con 0x55c2150f8580 2023-07-14T13:06:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.091+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c214fe9760 con 0x55c214f546b0 2023-07-14T13:06:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.091+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c214ecd8c0 con 0x55c2150fe2d0 2023-07-14T13:06:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.092+0000 7f2bafedeb80 10 client.0 _ll_register_callbacks cb 0x55c214fe7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:51.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.092+0000 7f2b9a39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c2151072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.092+0000 7f2b99b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2150f8580 0x55c215107830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.092+0000 7f2b9a39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c2151072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54712/0 (socket says 172.21.15.17:54712) 2023-07-14T13:06:51.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.092+0000 7f2b9a39b700 1 -- 172.21.15.17:0/2234720742 learned_addr learned my addr 172.21.15.17:0/2234720742 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:51.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.092+0000 7f2b9ab9c700 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150fe2d0 0x55c215101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.092+0000 7f2b9a39b700 1 -- 172.21.15.17:0/2234720742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150fe2d0 msgr2=0x55c215101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:51.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.092+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150fe2d0 0x55c215101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.092+0000 7f2b9a39b700 1 -- 172.21.15.17:0/2234720742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2150f8580 msgr2=0x55c215107830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.092+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2150f8580 0x55c215107830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.092+0000 7f2b9a39b700 1 -- 172.21.15.17:0/2234720742 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9419d7c0 con 0x55c214f546b0 2023-07-14T13:06:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.093+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c2151072f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b9009a880 tx=0x7f2b9009a7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da1d635496566425 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.093+0000 7f2b7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:06:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.093+0000 7f2b7dffb700 1 -- 172.21.15.17:0/2234720742 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9009a340 con 0x55c214f546b0 2023-07-14T13:06:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.093+0000 7f2b7dffb700 1 -- 172.21.15.17:0/2234720742 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2b900b3270 con 0x55c214f546b0 2023-07-14T13:06:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.093+0000 7f2bafedeb80 1 -- 172.21.15.17:0/2234720742 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c214fa3490 con 0x55c214f546b0 2023-07-14T13:06:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.093+0000 7f2b7dffb700 1 -- 172.21.15.17:0/2234720742 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b900a2ab0 con 0x55c214f546b0 2023-07-14T13:06:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.093+0000 7f2bafedeb80 10 client.26744 fetch_fsmap learned FSMap version 31 2023-07-14T13:06:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.093+0000 7f2bafedeb80 1 -- 172.21.15.17:0/2234720742 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55c214e60c00 con 0x55c214f546b0 2023-07-14T13:06:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.093+0000 7f2b7dffb700 1 -- 172.21.15.17:0/2234720742 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c214fa3490 con 0x55c214f546b0 2023-07-14T13:06:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.094+0000 7f2b7dffb700 1 -- 172.21.15.17:0/2234720742 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2b90004b60 con 0x55c214f546b0 2023-07-14T13:06:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.094+0000 7f2bafedeb80 10 client.26744 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:06:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.094+0000 7f2bafedeb80 10 client.26744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:06:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.094+0000 7f2bafedeb80 20 client.26744 populate_metadata read hostname 'smithi017' 2023-07-14T13:06:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.094+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2151113a0 0x55c2151137b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.094+0000 7f2bafedeb80 4 client.26744 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:06:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.094+0000 7f2bafedeb80 1 -- 172.21.15.17:0/2234720742 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c215042e50 con 0x55c2151113a0 2023-07-14T13:06:51.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.094+0000 7f2b99b9a700 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2151113a0 0x55c2151137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.095+0000 7f2b99b9a700 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2151113a0 0x55c2151137b0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3cda30fd3e56a50 server_cookie=7109dc82b8b2416a in_seq=0 out_seq=0 2023-07-14T13:06:51.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.095+0000 7f2b7dffb700 10 client.26744 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:51.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.095+0000 7f2b7dffb700 1 -- 172.21.15.17:0/2234720742 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c215042e50 con 0x55c2151113a0 2023-07-14T13:06:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.095+0000 7f2b7dffb700 10 client.26744 handle_command_reply: tid=0 2023-07-14T13:06:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.095+0000 7f2bafedeb80 1 client.26744 shutdown 2023-07-14T13:06:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2bafedeb80 1 -- 172.21.15.17:0/2234720742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 msgr2=0x55c2151072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c2151072f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b9009a880 tx=0x7f2b9009a7f0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2bafedeb80 1 -- 172.21.15.17:0/2234720742 shutdown_connections 2023-07-14T13:06:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2151113a0 0x55c2151137b0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150fe2d0 0x55c215101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c2151072f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/2234720742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2150f8580 0x55c215107830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2bafedeb80 1 -- 172.21.15.17:0/2234720742 >> 172.21.15.17:0/2234720742 conn(0x55c2150edbe0 msgr2=0x55c2150f24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2b7dffb700 0 client.26744 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2bafedeb80 1 -- 172.21.15.17:0/2234720742 shutdown_connections 2023-07-14T13:06:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2bafedeb80 1 -- 172.21.15.17:0/2234720742 wait complete. 2023-07-14T13:06:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.096+0000 7f2bafedeb80 20 client.26744 trim_cache size 0 max 16384 2023-07-14T13:06:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.113+0000 7f2bafedeb80 1 Processor -- start 2023-07-14T13:06:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.113+0000 7f2bafedeb80 1 -- start start 2023-07-14T13:06:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 0x55c215107800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 0x55c2150ff010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2150fe2d0 0x55c2150f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2150f8fd0 con 0x55c214f546b0 2023-07-14T13:06:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2150fd9c0 con 0x55c2150fe2d0 2023-07-14T13:06:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2150ffbb0 con 0x55c2150f8580 2023-07-14T13:06:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2b99b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 0x55c2150ff010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2b9a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 0x55c215107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2b99b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 0x55c2150ff010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34732/0 (socket says 172.21.15.17:34732) 2023-07-14T13:06:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2b99b9a700 1 -- 172.21.15.17:0/4093983307 learned_addr learned my addr 172.21.15.17:0/4093983307 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2b9ab9c700 1 --2- 172.21.15.17:0/4093983307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2150fe2d0 0x55c2150f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2b9a39b700 1 -- 172.21.15.17:0/4093983307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 msgr2=0x55c2150ff010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/4093983307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 0x55c2150ff010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2b9a39b700 1 -- 172.21.15.17:0/4093983307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2150fe2d0 msgr2=0x55c2150f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/4093983307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2150fe2d0 0x55c2150f2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2b9a39b700 1 -- 172.21.15.17:0/4093983307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c214e9e1f0 con 0x55c214f546b0 2023-07-14T13:06:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.114+0000 7f2b99b9a700 1 --2- 172.21.15.17:0/4093983307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 0x55c2150ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:06:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.115+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/4093983307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 0x55c215107800 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2b900975f0 tx=0x7f2b90009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c840a184f9216e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.115+0000 7f2b893ff700 1 -- 172.21.15.17:0/4093983307 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9009a340 con 0x55c214f546b0 2023-07-14T13:06:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.115+0000 7f2b893ff700 1 -- 172.21.15.17:0/4093983307 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b90098d80 con 0x55c214f546b0 2023-07-14T13:06:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.115+0000 7f2b893ff700 1 -- 172.21.15.17:0/4093983307 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90004ad0 con 0x55c214f546b0 2023-07-14T13:06:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.116+0000 7f2bafedeb80 1 -- 172.21.15.17:0/4093983307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 msgr2=0x55c215107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.116+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/4093983307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 0x55c215107800 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2b900975f0 tx=0x7f2b90009cd0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.116+0000 7f2bafedeb80 1 -- 172.21.15.17:0/4093983307 shutdown_connections 2023-07-14T13:06:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.116+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/4093983307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2150fe2d0 0x55c2150f2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.116+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/4093983307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c214f546b0 0x55c215107800 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.116+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/4093983307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 0x55c2150ff010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.116+0000 7f2bafedeb80 1 -- 172.21.15.17:0/4093983307 >> 172.21.15.17:0/4093983307 conn(0x55c2150edbe0 msgr2=0x55c2150fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.116+0000 7f2bafedeb80 1 -- 172.21.15.17:0/4093983307 shutdown_connections 2023-07-14T13:06:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.116+0000 7f2bafedeb80 1 -- 172.21.15.17:0/4093983307 wait complete. 2023-07-14T13:06:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.116+0000 7f2bafedeb80 1 -- start start 2023-07-14T13:06:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.117+0000 7f2bafedeb80 1 Processor -- start 2023-07-14T13:06:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.117+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c21510a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.117+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 0x55c21510a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.117+0000 7f2bafedeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2150fe2d0 0x55c215164210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.117+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c21510ae10 con 0x55c2150fe2d0 2023-07-14T13:06:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.117+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c215164750 con 0x55c214f546b0 2023-07-14T13:06:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.117+0000 7f2bafedeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c215164890 con 0x55c2150f8580 2023-07-14T13:06:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.117+0000 7f2bafedeb80 10 client.0 _ll_register_callbacks cb 0x55c214fe7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:06:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b9a39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c21510a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b9a39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c21510a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54736/0 (socket says 172.21.15.17:54736) 2023-07-14T13:06:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b9a39b700 1 -- 172.21.15.17:0/3703123698 learned_addr learned my addr 172.21.15.17:0/3703123698 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:06:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b9ab9c700 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2150fe2d0 0x55c215164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b99b9a700 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 0x55c21510a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b9a39b700 1 -- 172.21.15.17:0/3703123698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 msgr2=0x55c21510a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 0x55c21510a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b9a39b700 1 -- 172.21.15.17:0/3703123698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2150fe2d0 msgr2=0x55c215164210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:06:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2150fe2d0 0x55c215164210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b9a39b700 1 -- 172.21.15.17:0/3703123698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8401fa40 con 0x55c214f546b0 2023-07-14T13:06:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b9a39b700 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c21510a210 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b90000c00 tx=0x7f2b900cb6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd335b8f78b6bbd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:06:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.118+0000 7f2b7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:06:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.119+0000 7f2b7dffb700 1 -- 172.21.15.17:0/3703123698 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9009a340 con 0x55c214f546b0 2023-07-14T13:06:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.119+0000 7f2b7dffb700 1 -- 172.21.15.17:0/3703123698 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2b90099df0 con 0x55c214f546b0 2023-07-14T13:06:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.119+0000 7f2bafedeb80 1 -- 172.21.15.17:0/3703123698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c215004ff0 con 0x55c214f546b0 2023-07-14T13:06:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.119+0000 7f2b7dffb700 1 -- 172.21.15.17:0/3703123698 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b90098d80 con 0x55c214f546b0 2023-07-14T13:06:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.119+0000 7f2bafedeb80 10 client.26750 fetch_fsmap learned FSMap version 31 2023-07-14T13:06:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.119+0000 7f2bafedeb80 1 -- 172.21.15.17:0/3703123698 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55c214e60c00 con 0x55c214f546b0 2023-07-14T13:06:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.119+0000 7f2b7dffb700 1 -- 172.21.15.17:0/3703123698 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c215004ff0 con 0x55c214f546b0 2023-07-14T13:06:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.120+0000 7f2b7dffb700 1 -- 172.21.15.17:0/3703123698 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2b90096970 con 0x55c214f546b0 2023-07-14T13:06:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.120+0000 7f2bafedeb80 10 client.26750 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:06:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.120+0000 7f2bafedeb80 10 client.26750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:06:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.120+0000 7f2bafedeb80 20 client.26750 populate_metadata read hostname 'smithi017' 2023-07-14T13:06:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.120+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c215165a60 0x55c215167e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:06:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.120+0000 7f2bafedeb80 4 client.26750 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:06:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.120+0000 7f2bafedeb80 1 -- 172.21.15.17:0/3703123698 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c214e98f10 con 0x55c215165a60 2023-07-14T13:06:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.120+0000 7f2b99b9a700 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c215165a60 0x55c215167e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:06:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.121+0000 7f2b99b9a700 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c215165a60 0x55c215167e40 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef854db973522bf2 server_cookie=8a01e2dadba3fd69 in_seq=0 out_seq=0 2023-07-14T13:06:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.121+0000 7f2b7dffb700 10 client.26750 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2b7dffb700 1 -- 172.21.15.17:0/3703123698 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c214e98f10 con 0x55c215165a60 2023-07-14T13:06:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2b7dffb700 10 client.26750 handle_command_reply: tid=0 2023-07-14T13:06:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2bafedeb80 1 client.26750 shutdown 2023-07-14T13:06:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2bafedeb80 1 -- 172.21.15.17:0/3703123698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 msgr2=0x55c21510a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c21510a210 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b90000c00 tx=0x7f2b900cb6d0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2bafedeb80 1 -- 172.21.15.17:0/3703123698 shutdown_connections 2023-07-14T13:06:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c215165a60 0x55c215167e40 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2150fe2d0 0x55c215164210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c214f546b0 0x55c21510a210 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2b7dffb700 0 client.26750 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:06:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2bafedeb80 1 --2- 172.21.15.17:0/3703123698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2150f8580 0x55c21510a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.139+0000 7f2bafedeb80 1 -- 172.21.15.17:0/3703123698 >> 172.21.15.17:0/3703123698 conn(0x55c2150edbe0 msgr2=0x55c2150ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.140+0000 7f2bafedeb80 1 -- 172.21.15.17:0/3703123698 shutdown_connections 2023-07-14T13:06:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.140+0000 7f2bafedeb80 1 -- 172.21.15.17:0/3703123698 wait complete. 2023-07-14T13:06:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.140+0000 7f2bafedeb80 20 client.26750 trim_cache size 0 max 16384 2023-07-14T13:06:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:06:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:06:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:06:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:06:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.140+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/3928804743 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b800a12c0 msgr2=0x7f2b800a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.140+0000 7f2b9c5ff700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b800a12c0 0x7f2b800a3770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00f870 tx=0x7f2b8c00fc30 comp rx=0 tx=0).stop 2023-07-14T13:06:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.140+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/3928804743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b940ffdc0 msgr2=0x7f2b94197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:06:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.140+0000 7f2b9c5ff700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b940ffdc0 0x7f2b94197d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b90005910 tx=0x7f2b9000f690 comp rx=0 tx=0).stop 2023-07-14T13:06:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.141+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/3928804743 shutdown_connections 2023-07-14T13:06:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.141+0000 7f2b9c5ff700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2b800a12c0 0x7f2b800a3770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.141+0000 7f2b9c5ff700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b94104e00 0x7f2b9419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.141+0000 7f2b9c5ff700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b940ffdc0 0x7f2b94197d90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.141+0000 7f2b9c5ff700 1 --2- 172.21.15.17:0/3928804743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b94100760 0x7f2b941982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:06:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.141+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/3928804743 >> 172.21.15.17:0/3928804743 conn(0x7f2b940fb650 msgr2=0x7f2b940fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:06:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.141+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/3928804743 shutdown_connections 2023-07-14T13:06:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:06:51.141+0000 7f2b9c5ff700 1 -- 172.21.15.17:0/3928804743 wait complete. 2023-07-14T13:06:51.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:51 smithi017 ceph-mon[95536]: pgmap v218: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 33 MiB/s wr, 93 op/s 2023-07-14T13:06:51.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:51 smithi135 ceph-mon[97338]: pgmap v218: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 33 MiB/s wr, 93 op/s 2023-07-14T13:06:51.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:51 smithi131 ceph-mon[96953]: pgmap v218: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 33 MiB/s wr, 93 op/s 2023-07-14T13:06:51.526 INFO:teuthology.orchestra.run.smithi017.stderr:27200000 of 50000000 tuples (54%) done (elapsed 401.13 s, remaining 336.24 s) 2023-07-14T13:06:52.832 INFO:teuthology.orchestra.run.smithi017.stderr:27300000 of 50000000 tuples (54%) done (elapsed 402.43 s, remaining 334.62 s) 2023-07-14T13:06:53.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:53 smithi017 ceph-mon[95536]: pgmap v219: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 48 op/s 2023-07-14T13:06:53.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:53 smithi135 ceph-mon[97338]: pgmap v219: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 48 op/s 2023-07-14T13:06:53.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:53 smithi131 ceph-mon[96953]: pgmap v219: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 48 op/s 2023-07-14T13:06:54.227 INFO:teuthology.orchestra.run.smithi017.stderr:27400000 of 50000000 tuples (54%) done (elapsed 403.83 s, remaining 333.09 s) 2023-07-14T13:06:55.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:55 smithi017 ceph-mon[95536]: pgmap v220: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 48 op/s 2023-07-14T13:06:55.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:55 smithi135 ceph-mon[97338]: pgmap v220: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 48 op/s 2023-07-14T13:06:55.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:55 smithi131 ceph-mon[96953]: pgmap v220: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 22 MiB/s wr, 48 op/s 2023-07-14T13:06:55.508 INFO:teuthology.orchestra.run.smithi017.stderr:27500000 of 50000000 tuples (55%) done (elapsed 405.11 s, remaining 331.45 s) 2023-07-14T13:06:56.833 INFO:teuthology.orchestra.run.smithi017.stderr:27600000 of 50000000 tuples (55%) done (elapsed 406.43 s, remaining 329.86 s) 2023-07-14T13:06:57.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:57 smithi017 ceph-mon[95536]: pgmap v221: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 33 MiB/s wr, 72 op/s 2023-07-14T13:06:57.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:57 smithi135 ceph-mon[97338]: pgmap v221: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 33 MiB/s wr, 72 op/s 2023-07-14T13:06:57.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:57 smithi131 ceph-mon[96953]: pgmap v221: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 33 MiB/s wr, 72 op/s 2023-07-14T13:06:58.145 INFO:teuthology.orchestra.run.smithi017.stderr:27700000 of 50000000 tuples (55%) done (elapsed 407.75 s, remaining 328.26 s) 2023-07-14T13:06:59.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:06:59 smithi017 ceph-mon[95536]: pgmap v222: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 22 MiB/s wr, 47 op/s 2023-07-14T13:06:59.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:06:59 smithi135 ceph-mon[97338]: pgmap v222: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 22 MiB/s wr, 47 op/s 2023-07-14T13:06:59.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:06:59 smithi131 ceph-mon[96953]: pgmap v222: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 22 MiB/s wr, 47 op/s 2023-07-14T13:06:59.554 INFO:teuthology.orchestra.run.smithi017.stderr:27800000 of 50000000 tuples (55%) done (elapsed 409.16 s, remaining 326.74 s) 2023-07-14T13:07:00.021 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:07:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.233+0000 7f5a3afff700 1 -- 172.21.15.17:0/3167833196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a34100ca0 msgr2=0x7f5a34101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.233+0000 7f5a3afff700 1 --2- 172.21.15.17:0/3167833196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a34100ca0 0x7f5a34101070 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009990 tx=0x7f5a28009ca0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.233+0000 7f5a3afff700 1 -- 172.21.15.17:0/3167833196 shutdown_connections 2023-07-14T13:07:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.233+0000 7f5a3afff700 1 --2- 172.21.15.17:0/3167833196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a3410a070 0x7f5a3410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.233+0000 7f5a3afff700 1 --2- 172.21.15.17:0/3167833196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a34100ca0 0x7f5a34101070 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.233+0000 7f5a3afff700 1 --2- 172.21.15.17:0/3167833196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a341015b0 0x7f5a34109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.233+0000 7f5a3afff700 1 -- 172.21.15.17:0/3167833196 >> 172.21.15.17:0/3167833196 conn(0x7f5a340fa4b0 msgr2=0x7f5a340fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.233+0000 7f5a3afff700 1 -- 172.21.15.17:0/3167833196 shutdown_connections 2023-07-14T13:07:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.233+0000 7f5a3afff700 1 -- 172.21.15.17:0/3167833196 wait complete. 2023-07-14T13:07:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.234+0000 7f5a3afff700 1 Processor -- start 2023-07-14T13:07:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.234+0000 7f5a3afff700 1 -- start start 2023-07-14T13:07:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.235+0000 7f5a3afff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a34100ca0 0x7f5a34109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.235+0000 7f5a3afff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a341015b0 0x7f5a34106650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.235+0000 7f5a3afff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a3410a070 0x7f5a34106b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.235+0000 7f5a3afff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34107190 con 0x7f5a3410a070 2023-07-14T13:07:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.235+0000 7f5a3afff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a34107300 con 0x7f5a341015b0 2023-07-14T13:07:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.235+0000 7f5a3afff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a341074c0 con 0x7f5a34100ca0 2023-07-14T13:07:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.235+0000 7f5a38d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a34100ca0 0x7f5a34109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.235+0000 7f5a38d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a34100ca0 0x7f5a34109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50314/0 (socket says 172.21.15.17:50314) 2023-07-14T13:07:00.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.235+0000 7f5a38d9b700 1 -- 172.21.15.17:0/3653472176 learned_addr learned my addr 172.21.15.17:0/3653472176 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.235+0000 7f5a33fff700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a341015b0 0x7f5a34106650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.236+0000 7f5a3959c700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a3410a070 0x7f5a34106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.236+0000 7f5a38d9b700 1 -- 172.21.15.17:0/3653472176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a341015b0 msgr2=0x7f5a34106650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.236+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a341015b0 0x7f5a34106650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.236+0000 7f5a38d9b700 1 -- 172.21.15.17:0/3653472176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a3410a070 msgr2=0x7f5a34106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.236+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a3410a070 0x7f5a34106b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.236+0000 7f5a38d9b700 1 -- 172.21.15.17:0/3653472176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a280095f0 con 0x7f5a34100ca0 2023-07-14T13:07:00.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.236+0000 7f5a3959c700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a3410a070 0x7f5a34106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:07:00.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.236+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a34100ca0 0x7f5a34109640 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5a28000c00 tx=0x7f5a28004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:00.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.237+0000 7f5a31ffb700 1 -- 172.21.15.17:0/3653472176 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2801d070 con 0x7f5a34100ca0 2023-07-14T13:07:00.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.237+0000 7f5a31ffb700 1 -- 172.21.15.17:0/3653472176 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a28022470 con 0x7f5a34100ca0 2023-07-14T13:07:00.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.237+0000 7f5a31ffb700 1 -- 172.21.15.17:0/3653472176 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28017650 con 0x7f5a34100ca0 2023-07-14T13:07:00.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.237+0000 7f5a3afff700 1 -- 172.21.15.17:0/3653472176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a341a8990 con 0x7f5a34100ca0 2023-07-14T13:07:00.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.237+0000 7f5a3afff700 1 -- 172.21.15.17:0/3653472176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a341a8dc0 con 0x7f5a34100ca0 2023-07-14T13:07:00.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.242+0000 7f5a31ffb700 1 -- 172.21.15.17:0/3653472176 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5a280225e0 con 0x7f5a34100ca0 2023-07-14T13:07:00.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.243+0000 7f5a4e94bb80 1 Processor -- start 2023-07-14T13:07:00.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.243+0000 7f5a4e94bb80 1 -- start start 2023-07-14T13:07:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.244+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be5752d0 0x55b0be5756a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.244+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be575be0 0x55b0be580590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.244+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 0x55b0be582eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.244+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be47bcb0 con 0x55b0be5752d0 2023-07-14T13:07:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.244+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be4cea40 con 0x55b0be580ad0 2023-07-14T13:07:00.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.244+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be4c7ed0 con 0x55b0be575be0 2023-07-14T13:07:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.244+0000 7f5a3959c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be5752d0 0x55b0be5756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.244+0000 7f5a33fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 0x55b0be582eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.244+0000 7f5a3959c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be5752d0 0x55b0be5756a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52452/0 (socket says 172.21.15.17:52452) 2023-07-14T13:07:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.244+0000 7f5a3959c700 1 -- 172.21.15.17:0/365572747 learned_addr learned my addr 172.21.15.17:0/365572747 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.244+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/365572747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be575be0 0x55b0be580590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.245+0000 7f5a31ffb700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a240a1340 0x7f5a240a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.245+0000 7f5a3959c700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a240a1340 0x7f5a240a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.245+0000 7f5a33fff700 1 -- 172.21.15.17:0/365572747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be575be0 msgr2=0x55b0be580590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.245+0000 7f5a33fff700 1 --2- 172.21.15.17:0/365572747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be575be0 0x55b0be580590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.245+0000 7f5a31ffb700 1 -- 172.21.15.17:0/3653472176 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5a280ce130 con 0x7f5a34100ca0 2023-07-14T13:07:00.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.245+0000 7f5a33fff700 1 -- 172.21.15.17:0/365572747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be5752d0 msgr2=0x55b0be5756a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:00.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.245+0000 7f5a33fff700 1 --2- 172.21.15.17:0/365572747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be5752d0 0x55b0be5756a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.245+0000 7f5a33fff700 1 -- 172.21.15.17:0/365572747 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0be2f5de0 con 0x55b0be580ad0 2023-07-14T13:07:00.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.245+0000 7f5a33fff700 1 --2- 172.21.15.17:0/365572747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 0x55b0be582eb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5a3410b660 tx=0x7f5a20009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=713b69b32244e322 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:00.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.246+0000 7f5a3959c700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a240a1340 0x7f5a240a37f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0094f0 tx=0x7f5a2c004b40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:00.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.246+0000 7f5a1effd700 1 -- 172.21.15.17:0/365572747 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20011c80 con 0x55b0be580ad0 2023-07-14T13:07:00.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.246+0000 7f5a1effd700 1 -- 172.21.15.17:0/365572747 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a20011de0 con 0x55b0be580ad0 2023-07-14T13:07:00.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.246+0000 7f5a1effd700 1 -- 172.21.15.17:0/365572747 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20005280 con 0x55b0be580ad0 2023-07-14T13:07:00.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.247+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/365572747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 msgr2=0x55b0be582eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:00.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.247+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/365572747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 0x55b0be582eb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5a3410b660 tx=0x7f5a20009f60 comp rx=0 tx=0).stop 2023-07-14T13:07:00.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.247+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/365572747 shutdown_connections 2023-07-14T13:07:00.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.247+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/365572747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 0x55b0be582eb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.247+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/365572747 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be5752d0 0x55b0be5756a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.247+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/365572747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be575be0 0x55b0be580590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.247+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/365572747 >> 172.21.15.17:0/365572747 conn(0x55b0be56bda0 msgr2=0x55b0be5716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:00.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.247+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/365572747 shutdown_connections 2023-07-14T13:07:00.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.248+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/365572747 wait complete. 2023-07-14T13:07:00.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.248+0000 7f5a4e94bb80 1 -- start start 2023-07-14T13:07:00.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.248+0000 7f5a4e94bb80 1 Processor -- start 2023-07-14T13:07:00.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.249+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be580560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.249+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be575be0 0x55b0be57d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.249+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be580ad0 0x55b0be57df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.249+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be467ac0 con 0x55b0be580ad0 2023-07-14T13:07:00.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.249+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be4677c0 con 0x55b0be575be0 2023-07-14T13:07:00.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.249+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be34b920 con 0x55b0be5752d0 2023-07-14T13:07:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.249+0000 7f5a4e94bb80 10 client.0 _ll_register_callbacks cb 0x55b0be465760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.250+0000 7f5a38d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be580560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.250+0000 7f5a38d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be580560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50332/0 (socket says 172.21.15.17:50332) 2023-07-14T13:07:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.250+0000 7f5a38d9b700 1 -- 172.21.15.17:0/3756005668 learned_addr learned my addr 172.21.15.17:0/3756005668 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.250+0000 7f5a33fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be575be0 0x55b0be57d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.250+0000 7f5a38d9b700 1 -- 172.21.15.17:0/3756005668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be575be0 msgr2=0x55b0be57d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.250+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/3756005668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be575be0 0x55b0be57d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.250+0000 7f5a38d9b700 1 -- 172.21.15.17:0/3756005668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be580ad0 msgr2=0x55b0be57df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:00.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.250+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/3756005668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be580ad0 0x55b0be57df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.250+0000 7f5a38d9b700 1 -- 172.21.15.17:0/3756005668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a200098e0 con 0x55b0be5752d0 2023-07-14T13:07:00.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.250+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/3756005668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be580560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800f740 tx=0x7f5a28096f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8204787cdef4da65 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:00.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.250+0000 7f5a13fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:07:00.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.251+0000 7f5a13fff700 1 -- 172.21.15.17:0/3756005668 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2809f120 con 0x55b0be5752d0 2023-07-14T13:07:00.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.251+0000 7f5a13fff700 1 -- 172.21.15.17:0/3756005668 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5a280228c0 con 0x55b0be5752d0 2023-07-14T13:07:00.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.251+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/3756005668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0be4214f0 con 0x55b0be5752d0 2023-07-14T13:07:00.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.251+0000 7f5a13fff700 1 -- 172.21.15.17:0/3756005668 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a2809adf0 con 0x55b0be5752d0 2023-07-14T13:07:00.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.251+0000 7f5a4e94bb80 10 client.26731 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:00.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.251+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/3756005668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55b0be2dec60 con 0x55b0be5752d0 2023-07-14T13:07:00.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.251+0000 7f5a13fff700 1 -- 172.21.15.17:0/3756005668 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b0be4214f0 con 0x55b0be5752d0 2023-07-14T13:07:00.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.251+0000 7f5a13fff700 1 -- 172.21.15.17:0/3756005668 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5a280a31e0 con 0x55b0be5752d0 2023-07-14T13:07:00.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.252+0000 7f5a4e94bb80 10 client.26731 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:00.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.252+0000 7f5a4e94bb80 10 client.26731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:00.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.252+0000 7f5a4e94bb80 20 client.26731 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:00.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.252+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/3756005668 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0be590100 0x55b0be592510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.252+0000 7f5a4e94bb80 4 client.26731 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:07:00.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.252+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/3756005668 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0be4c0eb0 con 0x55b0be590100 2023-07-14T13:07:00.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.252+0000 7f5a33fff700 1 --2- 172.21.15.17:0/3756005668 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0be590100 0x55b0be592510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.253+0000 7f5a33fff700 1 --2- 172.21.15.17:0/3756005668 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0be590100 0x55b0be592510 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb7b34373d5952a3 server_cookie=3e3f5d95eb359282 in_seq=0 out_seq=0 2023-07-14T13:07:00.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.253+0000 7f5a13fff700 10 client.26731 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:00.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.254+0000 7f5a13fff700 1 -- 172.21.15.17:0/3756005668 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b0be4c0eb0 con 0x55b0be590100 2023-07-14T13:07:00.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.254+0000 7f5a13fff700 10 client.26731 handle_command_reply: tid=0 2023-07-14T13:07:00.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.254+0000 7f5a4e94bb80 1 client.26731 shutdown 2023-07-14T13:07:00.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.254+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/3756005668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 msgr2=0x55b0be580560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:00.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.254+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/3756005668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be580560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800f740 tx=0x7f5a28096f50 comp rx=0 tx=0).stop 2023-07-14T13:07:00.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.255+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/3756005668 shutdown_connections 2023-07-14T13:07:00.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.255+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/3756005668 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0be590100 0x55b0be592510 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.255+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/3756005668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be580ad0 0x55b0be57df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.255+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/3756005668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be580560 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.255+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/3756005668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be575be0 0x55b0be57d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.255+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/3756005668 >> 172.21.15.17:0/3756005668 conn(0x55b0be56bda0 msgr2=0x55b0be571290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:00.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.255+0000 7f5a13fff700 0 client.26731 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:00.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.255+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/3756005668 shutdown_connections 2023-07-14T13:07:00.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.255+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/3756005668 wait complete. 2023-07-14T13:07:00.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.255+0000 7f5a4e94bb80 20 client.26731 trim_cache size 0 max 16384 2023-07-14T13:07:00.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.284+0000 7f5a4e94bb80 1 Processor -- start 2023-07-14T13:07:00.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.284+0000 7f5a4e94bb80 1 -- start start 2023-07-14T13:07:00.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.285+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be5752d0 0x55b0be58c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.285+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be575be0 0x55b0be580100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.285+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be580ad0 0x55b0be57d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.285+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be5761c0 con 0x55b0be575be0 2023-07-14T13:07:00.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.285+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be56b970 con 0x55b0be5752d0 2023-07-14T13:07:00.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.285+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be5793c0 con 0x55b0be580ad0 2023-07-14T13:07:00.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.285+0000 7f5a3959c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be580ad0 0x55b0be57d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.285+0000 7f5a38d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be5752d0 0x55b0be58c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.285+0000 7f5a3959c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be580ad0 0x55b0be57d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50334/0 (socket says 172.21.15.17:50334) 2023-07-14T13:07:00.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.285+0000 7f5a3959c700 1 -- 172.21.15.17:0/4108328892 learned_addr learned my addr 172.21.15.17:0/4108328892 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:00.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.286+0000 7f5a33fff700 1 --2- 172.21.15.17:0/4108328892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be575be0 0x55b0be580100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.286+0000 7f5a38d9b700 1 -- 172.21.15.17:0/4108328892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be580ad0 msgr2=0x55b0be57d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:00.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.286+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/4108328892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be580ad0 0x55b0be57d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.286+0000 7f5a38d9b700 1 -- 172.21.15.17:0/4108328892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be575be0 msgr2=0x55b0be580100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:00.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.286+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/4108328892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be575be0 0x55b0be580100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.286+0000 7f5a38d9b700 1 -- 172.21.15.17:0/4108328892 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0be31c250 con 0x55b0be5752d0 2023-07-14T13:07:00.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.286+0000 7f5a3959c700 1 --2- 172.21.15.17:0/4108328892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be580ad0 0x55b0be57d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:00.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.286+0000 7f5a33fff700 1 --2- 172.21.15.17:0/4108328892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be575be0 0x55b0be580100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:07:00.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.286+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/4108328892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be5752d0 0x55b0be58c7e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a28022c70 tx=0x7f5a28009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58c1009deb1c694f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:00.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.286+0000 7f5a1f7fe700 1 -- 172.21.15.17:0/4108328892 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2809f120 con 0x55b0be5752d0 2023-07-14T13:07:00.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.286+0000 7f5a1f7fe700 1 -- 172.21.15.17:0/4108328892 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a2809adf0 con 0x55b0be5752d0 2023-07-14T13:07:00.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.287+0000 7f5a1f7fe700 1 -- 172.21.15.17:0/4108328892 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2809aa70 con 0x55b0be5752d0 2023-07-14T13:07:00.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.287+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/4108328892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be5752d0 msgr2=0x55b0be58c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:00.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.287+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/4108328892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be5752d0 0x55b0be58c7e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a28022c70 tx=0x7f5a28009ca0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.288+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/4108328892 shutdown_connections 2023-07-14T13:07:00.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.288+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/4108328892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be580ad0 0x55b0be57d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.288+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/4108328892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be5752d0 0x55b0be58c7e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.288+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/4108328892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be575be0 0x55b0be580100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.288+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/4108328892 >> 172.21.15.17:0/4108328892 conn(0x55b0be56bda0 msgr2=0x55b0be596e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:00.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.288+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/4108328892 shutdown_connections 2023-07-14T13:07:00.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.288+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/4108328892 wait complete. 2023-07-14T13:07:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.288+0000 7f5a4e94bb80 1 -- start start 2023-07-14T13:07:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.289+0000 7f5a4e94bb80 1 Processor -- start 2023-07-14T13:07:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.289+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be587170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.289+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be575be0 0x55b0be5876b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.289+0000 7f5a4e94bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 0x55b0be585630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.289+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be585d40 con 0x55b0be575be0 2023-07-14T13:07:00.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.289+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be585eb0 con 0x55b0be580ad0 2023-07-14T13:07:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.289+0000 7f5a4e94bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0be586070 con 0x55b0be5752d0 2023-07-14T13:07:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.289+0000 7f5a4e94bb80 10 client.0 _ll_register_callbacks cb 0x55b0be465760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.290+0000 7f5a38d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be587170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.290+0000 7f5a33fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be575be0 0x55b0be5876b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.290+0000 7f5a3959c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 0x55b0be585630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.290+0000 7f5a38d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be587170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50348/0 (socket says 172.21.15.17:50348) 2023-07-14T13:07:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.290+0000 7f5a38d9b700 1 -- 172.21.15.17:0/1389770516 learned_addr learned my addr 172.21.15.17:0/1389770516 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:00.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.290+0000 7f5a38d9b700 1 -- 172.21.15.17:0/1389770516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 msgr2=0x55b0be585630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.290+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 0x55b0be585630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.290+0000 7f5a38d9b700 1 -- 172.21.15.17:0/1389770516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be575be0 msgr2=0x55b0be5876b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.290+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be575be0 0x55b0be5876b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.290+0000 7f5a38d9b700 1 -- 172.21.15.17:0/1389770516 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2c0175d0 con 0x55b0be5752d0 2023-07-14T13:07:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.290+0000 7f5a3959c700 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 0x55b0be585630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.291+0000 7f5a38d9b700 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be587170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5a280a3140 tx=0x7f5a2809a9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=487fb5e04efd83b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.291+0000 7f5a13fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:07:00.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.291+0000 7f5a13fff700 1 -- 172.21.15.17:0/1389770516 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2809aa70 con 0x55b0be5752d0 2023-07-14T13:07:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.291+0000 7f5a13fff700 1 -- 172.21.15.17:0/1389770516 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5a280228c0 con 0x55b0be5752d0 2023-07-14T13:07:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.291+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/1389770516 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a20011de0 con 0x55b0be5752d0 2023-07-14T13:07:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.291+0000 7f5a13fff700 1 -- 172.21.15.17:0/1389770516 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a2809f120 con 0x55b0be5752d0 2023-07-14T13:07:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.291+0000 7f5a4e94bb80 10 client.26737 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.291+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/1389770516 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55b0be2dec60 con 0x55b0be5752d0 2023-07-14T13:07:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.291+0000 7f5a13fff700 1 -- 172.21.15.17:0/1389770516 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a20011de0 con 0x55b0be5752d0 2023-07-14T13:07:00.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.292+0000 7f5a13fff700 1 -- 172.21.15.17:0/1389770516 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5a28084ab0 con 0x55b0be5752d0 2023-07-14T13:07:00.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.292+0000 7f5a4e94bb80 10 client.26737 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:00.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.292+0000 7f5a4e94bb80 10 client.26737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:00.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.292+0000 7f5a4e94bb80 20 client.26737 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:00.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.292+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0be5e4d60 0x55b0be5e7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:00.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.292+0000 7f5a4e94bb80 4 client.26737 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:07:00.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.292+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/1389770516 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b0be483050 con 0x55b0be5e4d60 2023-07-14T13:07:00.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.292+0000 7f5a33fff700 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0be5e4d60 0x55b0be5e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:00.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.293+0000 7f5a33fff700 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0be5e4d60 0x55b0be5e7140 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f3b2cb10efa83f8 server_cookie=cc91a1d0a7e9da18 in_seq=0 out_seq=0 2023-07-14T13:07:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.293+0000 7f5a13fff700 10 client.26737 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.293+0000 7f5a13fff700 1 -- 172.21.15.17:0/1389770516 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b0be483050 con 0x55b0be5e4d60 2023-07-14T13:07:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.293+0000 7f5a13fff700 10 client.26737 handle_command_reply: tid=0 2023-07-14T13:07:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.293+0000 7f5a4e94bb80 1 client.26737 shutdown 2023-07-14T13:07:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/1389770516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 msgr2=0x55b0be587170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be587170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5a280a3140 tx=0x7f5a2809a9b0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/1389770516 shutdown_connections 2023-07-14T13:07:00.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0be5e4d60 0x55b0be5e7140 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0be580ad0 0x55b0be585630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0be5752d0 0x55b0be587170 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a4e94bb80 1 --2- 172.21.15.17:0/1389770516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0be575be0 0x55b0be5876b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/1389770516 >> 172.21.15.17:0/1389770516 conn(0x55b0be56bda0 msgr2=0x55b0be58c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a13fff700 0 client.26737 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/1389770516 shutdown_connections 2023-07-14T13:07:00.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a4e94bb80 1 -- 172.21.15.17:0/1389770516 wait complete. 2023-07-14T13:07:00.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.294+0000 7f5a4e94bb80 20 client.26737 trim_cache size 0 max 16384 2023-07-14T13:07:00.336 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:07:00.336 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:07:00.336 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:07:00.336 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:07:00.336 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:07:00.337 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:07:00.337 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:07:00.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:07:00.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:07:00.337 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:07:00.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.295+0000 7f5a3afff700 1 -- 172.21.15.17:0/3653472176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a240a1340 msgr2=0x7f5a240a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:00.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.295+0000 7f5a3afff700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a240a1340 0x7f5a240a37f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0094f0 tx=0x7f5a2c004b40 comp rx=0 tx=0).stop 2023-07-14T13:07:00.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.295+0000 7f5a3afff700 1 -- 172.21.15.17:0/3653472176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a34100ca0 msgr2=0x7f5a34109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:00.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.295+0000 7f5a3afff700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a34100ca0 0x7f5a34109640 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5a28000c00 tx=0x7f5a28004730 comp rx=0 tx=0).stop 2023-07-14T13:07:00.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.296+0000 7f5a3afff700 1 -- 172.21.15.17:0/3653472176 shutdown_connections 2023-07-14T13:07:00.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.296+0000 7f5a3afff700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a240a1340 0x7f5a240a37f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.296+0000 7f5a3afff700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a3410a070 0x7f5a34106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.296+0000 7f5a3afff700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a34100ca0 0x7f5a34109640 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.296+0000 7f5a3afff700 1 --2- 172.21.15.17:0/3653472176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a341015b0 0x7f5a34106650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:00.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.296+0000 7f5a3afff700 1 -- 172.21.15.17:0/3653472176 >> 172.21.15.17:0/3653472176 conn(0x7f5a340fa4b0 msgr2=0x7f5a3410c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:00.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.296+0000 7f5a3afff700 1 -- 172.21.15.17:0/3653472176 shutdown_connections 2023-07-14T13:07:00.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:00.296+0000 7f5a3afff700 1 -- 172.21.15.17:0/3653472176 wait complete. 2023-07-14T13:07:00.354 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:07:00.951 INFO:teuthology.orchestra.run.smithi017.stderr:27900000 of 50000000 tuples (55%) done (elapsed 410.55 s, remaining 325.20 s) 2023-07-14T13:07:01.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:01 smithi017 ceph-mon[95536]: pgmap v223: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 33 MiB/s wr, 70 op/s 2023-07-14T13:07:01.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:01 smithi135 ceph-mon[97338]: pgmap v223: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 33 MiB/s wr, 70 op/s 2023-07-14T13:07:01.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:01 smithi131 ceph-mon[96953]: pgmap v223: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 33 MiB/s wr, 70 op/s 2023-07-14T13:07:02.320 INFO:teuthology.orchestra.run.smithi017.stderr:28000000 of 50000000 tuples (56%) done (elapsed 411.92 s, remaining 323.65 s) 2023-07-14T13:07:02.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:02 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:07:02.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:02 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:07:02.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:02 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:07:03.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:03 smithi017 ceph-mon[95536]: pgmap v224: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 46 op/s 2023-07-14T13:07:03.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:03 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:07:03.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:03 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:07:03.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:03 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:07:03.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:03 smithi135 ceph-mon[97338]: pgmap v224: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 46 op/s 2023-07-14T13:07:03.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:03 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:07:03.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:03 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:07:03.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:03 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:07:03.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:03 smithi131 ceph-mon[96953]: pgmap v224: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 46 op/s 2023-07-14T13:07:03.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:03 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:07:03.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:03 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:07:03.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:03 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:07:03.650 INFO:teuthology.orchestra.run.smithi017.stderr:28100000 of 50000000 tuples (56%) done (elapsed 413.25 s, remaining 322.07 s) 2023-07-14T13:07:04.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.307+0000 7f244c1ff700 1 -- 172.21.15.17:0/2232799478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2444105b10 msgr2=0x7f2444105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:04.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.307+0000 7f244c1ff700 1 --2- 172.21.15.17:0/2232799478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2444105b10 0x7f2444105ee0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f2440009990 tx=0x7f2440009ca0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.307+0000 7f244c1ff700 1 -- 172.21.15.17:0/2232799478 shutdown_connections 2023-07-14T13:07:04.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.307+0000 7f244c1ff700 1 --2- 172.21.15.17:0/2232799478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24441004b0 0x7f244410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.307+0000 7f244c1ff700 1 --2- 172.21.15.17:0/2232799478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2444105b10 0x7f2444105ee0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.307+0000 7f244c1ff700 1 --2- 172.21.15.17:0/2232799478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24440ffb00 0x7f24440fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.307+0000 7f244c1ff700 1 -- 172.21.15.17:0/2232799478 >> 172.21.15.17:0/2232799478 conn(0x7f24440fb600 msgr2=0x7f24440fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:04.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.307+0000 7f244c1ff700 1 -- 172.21.15.17:0/2232799478 shutdown_connections 2023-07-14T13:07:04.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.308+0000 7f244c1ff700 1 -- 172.21.15.17:0/2232799478 wait complete. 2023-07-14T13:07:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.309+0000 7f244c1ff700 1 Processor -- start 2023-07-14T13:07:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.309+0000 7f244c1ff700 1 -- start start 2023-07-14T13:07:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.309+0000 7f244c1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24440ffb00 0x7f2444197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.309+0000 7f244c1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24441004b0 0x7f2444198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.309+0000 7f244c1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2444105b10 0x7f244419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.309+0000 7f244c1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244419cf20 con 0x7f2444105b10 2023-07-14T13:07:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.309+0000 7f244c1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244419d090 con 0x7f24440ffb00 2023-07-14T13:07:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.309+0000 7f244c1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244419d250 con 0x7f24441004b0 2023-07-14T13:07:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f2449f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24440ffb00 0x7f2444197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f2449f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24440ffb00 0x7f2444197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60608/0 (socket says 172.21.15.17:60608) 2023-07-14T13:07:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f2449f9b700 1 -- 172.21.15.17:0/939438354 learned_addr learned my addr 172.21.15.17:0/939438354 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f244979a700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24441004b0 0x7f2444198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f244a79c700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2444105b10 0x7f244419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f2449f9b700 1 -- 172.21.15.17:0/939438354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24441004b0 msgr2=0x7f2444198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f2449f9b700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24441004b0 0x7f2444198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f2449f9b700 1 -- 172.21.15.17:0/939438354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2444105b10 msgr2=0x7f244419c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f2449f9b700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2444105b10 0x7f244419c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f2449f9b700 1 -- 172.21.15.17:0/939438354 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24400095f0 con 0x7f24440ffb00 2023-07-14T13:07:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f244979a700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24441004b0 0x7f2444198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f244a79c700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2444105b10 0x7f244419c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.310+0000 7f2449f9b700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24440ffb00 0x7f2444197d30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2440005740 tx=0x7f2440005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.311+0000 7f243affd700 1 -- 172.21.15.17:0/939438354 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244001d070 con 0x7f24440ffb00 2023-07-14T13:07:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.311+0000 7f244c1ff700 1 -- 172.21.15.17:0/939438354 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244419d4d0 con 0x7f24440ffb00 2023-07-14T13:07:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.311+0000 7f243affd700 1 -- 172.21.15.17:0/939438354 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2440022470 con 0x7f24440ffb00 2023-07-14T13:07:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.311+0000 7f243affd700 1 -- 172.21.15.17:0/939438354 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440017650 con 0x7f24440ffb00 2023-07-14T13:07:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.311+0000 7f244c1ff700 1 -- 172.21.15.17:0/939438354 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24441a4d70 con 0x7f24440ffb00 2023-07-14T13:07:04.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.315+0000 7f243affd700 1 -- 172.21.15.17:0/939438354 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f24400225e0 con 0x7f24440ffb00 2023-07-14T13:07:04.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.317+0000 7f245fb85b80 1 Processor -- start 2023-07-14T13:07:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.317+0000 7f245fb85b80 1 -- start start 2023-07-14T13:07:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.317+0000 7f243affd700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f24300a12c0 0x7f24300a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.317+0000 7f243affd700 1 -- 172.21.15.17:0/939438354 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f24400ce050 con 0x7f24440ffb00 2023-07-14T13:07:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.317+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x557353153d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.317+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x55735314e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.317+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55735314e580 0x55735314e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.317+0000 7f245fb85b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557353053c50 con 0x55735314e580 2023-07-14T13:07:04.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.317+0000 7f245fb85b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573530a69e0 con 0x557352faa6b0 2023-07-14T13:07:04.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.317+0000 7f245fb85b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735309fe70 con 0x5573531542d0 2023-07-14T13:07:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.318+0000 7f244a79c700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f24300a12c0 0x7f24300a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.318+0000 7f2449f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x557353153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.318+0000 7f2449f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x557353153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60614/0 (socket says 172.21.15.17:60614) 2023-07-14T13:07:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.318+0000 7f2449f9b700 1 -- 172.21.15.17:0/4107558989 learned_addr learned my addr 172.21.15.17:0/4107558989 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.318+0000 7f244979a700 1 --2- 172.21.15.17:0/4107558989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x55735314e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.318+0000 7f2449f9b700 1 -- 172.21.15.17:0/4107558989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 msgr2=0x55735314e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.318+0000 7f2449f9b700 1 --2- 172.21.15.17:0/4107558989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x55735314e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.318+0000 7f2449f9b700 1 -- 172.21.15.17:0/4107558989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55735314e580 msgr2=0x55735314e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.318+0000 7f2449f9b700 1 --2- 172.21.15.17:0/4107558989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55735314e580 0x55735314e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.318+0000 7f2449f9b700 1 -- 172.21.15.17:0/4107558989 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557352ecdd80 con 0x557352faa6b0 2023-07-14T13:07:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.318+0000 7f2449f9b700 1 --2- 172.21.15.17:0/4107558989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x557353153d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2440097c10 tx=0x7f2440005910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=578ed242e4e270c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.319+0000 7f244a79c700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f24300a12c0 0x7f24300a3770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f243c003f30 tx=0x7f243c009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.319+0000 7f242ffff700 1 -- 172.21.15.17:0/4107558989 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244009ab00 con 0x557352faa6b0 2023-07-14T13:07:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.319+0000 7f242ffff700 1 -- 172.21.15.17:0/4107558989 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f244009b1a0 con 0x557352faa6b0 2023-07-14T13:07:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.319+0000 7f242ffff700 1 -- 172.21.15.17:0/4107558989 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244009b660 con 0x557352faa6b0 2023-07-14T13:07:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.319+0000 7f245fb85b80 1 -- 172.21.15.17:0/4107558989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 msgr2=0x557353153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.319+0000 7f245fb85b80 1 --2- 172.21.15.17:0/4107558989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x557353153d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2440097c10 tx=0x7f2440005910 comp rx=0 tx=0).stop 2023-07-14T13:07:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.320+0000 7f245fb85b80 1 -- 172.21.15.17:0/4107558989 shutdown_connections 2023-07-14T13:07:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.320+0000 7f245fb85b80 1 --2- 172.21.15.17:0/4107558989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55735314e580 0x55735314e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.320+0000 7f245fb85b80 1 --2- 172.21.15.17:0/4107558989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x557353153d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.320+0000 7f245fb85b80 1 --2- 172.21.15.17:0/4107558989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x55735314e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.320+0000 7f245fb85b80 1 -- 172.21.15.17:0/4107558989 >> 172.21.15.17:0/4107558989 conn(0x557353143be0 msgr2=0x557353148f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.320+0000 7f245fb85b80 1 -- 172.21.15.17:0/4107558989 shutdown_connections 2023-07-14T13:07:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.320+0000 7f245fb85b80 1 -- 172.21.15.17:0/4107558989 wait complete. 2023-07-14T13:07:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.320+0000 7f245fb85b80 1 -- start start 2023-07-14T13:07:04.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.321+0000 7f245fb85b80 1 Processor -- start 2023-07-14T13:07:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.321+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.321+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55735314e580 0x55735315d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.321+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573531542d0 0x557353157640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.321+0000 7f245fb85b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735303fa60 con 0x5573531542d0 2023-07-14T13:07:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.321+0000 7f245fb85b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735303f760 con 0x557352faa6b0 2023-07-14T13:07:04.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.321+0000 7f245fb85b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557352f238c0 con 0x55735314e580 2023-07-14T13:07:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.321+0000 7f245fb85b80 10 client.0 _ll_register_callbacks cb 0x55735303d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f2449f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f244a79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573531542d0 0x557353157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f244979a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55735314e580 0x55735315d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f2449f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60622/0 (socket says 172.21.15.17:60622) 2023-07-14T13:07:04.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f2449f9b700 1 -- 172.21.15.17:0/491268653 learned_addr learned my addr 172.21.15.17:0/491268653 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f244a79c700 1 -- 172.21.15.17:0/491268653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55735314e580 msgr2=0x55735315d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f244a79c700 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55735314e580 0x55735315d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f244a79c700 1 -- 172.21.15.17:0/491268653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 msgr2=0x55735315d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f244a79c700 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f244a79c700 1 -- 172.21.15.17:0/491268653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24441a4d70 con 0x5573531542d0 2023-07-14T13:07:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f2449f9b700 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f244979a700 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55735314e580 0x55735315d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f244a79c700 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573531542d0 0x557353157640 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f243c004010 tx=0x7f243c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec27bc8f98fdb45a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.322+0000 7f242d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:07:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.323+0000 7f242d7fa700 1 -- 172.21.15.17:0/491268653 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c017da0 con 0x5573531542d0 2023-07-14T13:07:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.323+0000 7f245fb85b80 1 -- 172.21.15.17:0/491268653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557352ff9490 con 0x5573531542d0 2023-07-14T13:07:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.323+0000 7f242d7fa700 1 -- 172.21.15.17:0/491268653 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f243c01d040 con 0x5573531542d0 2023-07-14T13:07:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.323+0000 7f242d7fa700 1 -- 172.21.15.17:0/491268653 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f243c003c00 con 0x5573531542d0 2023-07-14T13:07:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.323+0000 7f245fb85b80 10 client.17052 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.323+0000 7f245fb85b80 1 -- 172.21.15.17:0/491268653 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x557352eb6c00 con 0x5573531542d0 2023-07-14T13:07:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.323+0000 7f242d7fa700 1 -- 172.21.15.17:0/491268653 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557352ff9490 con 0x5573531542d0 2023-07-14T13:07:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.324+0000 7f242d7fa700 1 -- 172.21.15.17:0/491268653 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f243c0183f0 con 0x5573531542d0 2023-07-14T13:07:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.324+0000 7f245fb85b80 10 client.17052 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.324+0000 7f245fb85b80 10 client.17052 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.324+0000 7f245fb85b80 20 client.17052 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.324+0000 7f245fb85b80 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5573531679b0 0x557353169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.324+0000 7f245fb85b80 4 client.17052 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:07:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.324+0000 7f245fb85b80 1 -- 172.21.15.17:0/491268653 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557353098e50 con 0x5573531679b0 2023-07-14T13:07:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.324+0000 7f2449f9b700 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5573531679b0 0x557353169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.325+0000 7f242d7fa700 10 client.17052 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.325+0000 7f2449f9b700 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5573531679b0 0x557353169dc0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=536cf63e5f8285bd server_cookie=5a5ee5cbaf073444 in_seq=0 out_seq=0 2023-07-14T13:07:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.325+0000 7f242d7fa700 1 -- 172.21.15.17:0/491268653 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557353098e50 con 0x5573531679b0 2023-07-14T13:07:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.325+0000 7f242d7fa700 10 client.17052 handle_command_reply: tid=0 2023-07-14T13:07:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 1 client.17052 shutdown 2023-07-14T13:07:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 1 -- 172.21.15.17:0/491268653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573531542d0 msgr2=0x557353157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573531542d0 0x557353157640 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f243c004010 tx=0x7f243c004ad0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 1 -- 172.21.15.17:0/491268653 shutdown_connections 2023-07-14T13:07:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5573531679b0 0x557353169dc0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5573531542d0 0x557353157640 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 1 --2- 172.21.15.17:0/491268653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55735314e580 0x55735315d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 1 -- 172.21.15.17:0/491268653 >> 172.21.15.17:0/491268653 conn(0x557353143be0 msgr2=0x5573531484e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f242d7fa700 0 client.17052 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 1 -- 172.21.15.17:0/491268653 shutdown_connections 2023-07-14T13:07:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 1 -- 172.21.15.17:0/491268653 wait complete. 2023-07-14T13:07:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.326+0000 7f245fb85b80 20 client.17052 trim_cache size 0 max 16384 2023-07-14T13:07:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.344+0000 7f245fb85b80 1 Processor -- start 2023-07-14T13:07:04.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.344+0000 7f245fb85b80 1 -- start start 2023-07-14T13:07:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.344+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557352faa6b0 0x55735314e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.344+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55735314e580 0x557353155190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.344+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x557353148c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.344+0000 7f245fb85b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557353098e50 con 0x557352faa6b0 2023-07-14T13:07:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.344+0000 7f245fb85b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557352ff9490 con 0x55735314e580 2023-07-14T13:07:04.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.344+0000 7f245fb85b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735314a020 con 0x5573531542d0 2023-07-14T13:07:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.345+0000 7f244a79c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x557353148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.345+0000 7f2449f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557352faa6b0 0x55735314e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.345+0000 7f244a79c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x557353148c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50386/0 (socket says 172.21.15.17:50386) 2023-07-14T13:07:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.345+0000 7f244a79c700 1 -- 172.21.15.17:0/2631887174 learned_addr learned my addr 172.21.15.17:0/2631887174 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:04.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.345+0000 7f244979a700 1 --2- 172.21.15.17:0/2631887174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55735314e580 0x557353155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.345+0000 7f244a79c700 1 -- 172.21.15.17:0/2631887174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55735314e580 msgr2=0x557353155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:04.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.345+0000 7f244a79c700 1 --2- 172.21.15.17:0/2631887174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55735314e580 0x557353155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.345+0000 7f244a79c700 1 -- 172.21.15.17:0/2631887174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557352faa6b0 msgr2=0x55735314e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.345+0000 7f244a79c700 1 --2- 172.21.15.17:0/2631887174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557352faa6b0 0x55735314e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.345+0000 7f244a79c700 1 -- 172.21.15.17:0/2631887174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55735316e9f0 con 0x5573531542d0 2023-07-14T13:07:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.345+0000 7f2449f9b700 1 --2- 172.21.15.17:0/2631887174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557352faa6b0 0x55735314e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.346+0000 7f244a79c700 1 --2- 172.21.15.17:0/2631887174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x557353148c60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f243c0061e0 tx=0x7f243c0189a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14a89d11411db267 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:04.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.346+0000 7f2438ff9700 1 -- 172.21.15.17:0/2631887174 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0183f0 con 0x5573531542d0 2023-07-14T13:07:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.346+0000 7f2438ff9700 1 -- 172.21.15.17:0/2631887174 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f243c00f040 con 0x5573531542d0 2023-07-14T13:07:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.346+0000 7f2438ff9700 1 -- 172.21.15.17:0/2631887174 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c038730 con 0x5573531542d0 2023-07-14T13:07:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.347+0000 7f245fb85b80 1 -- 172.21.15.17:0/2631887174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 msgr2=0x557353148c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.347+0000 7f245fb85b80 1 --2- 172.21.15.17:0/2631887174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x557353148c60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f243c0061e0 tx=0x7f243c0189a0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.347+0000 7f245fb85b80 1 -- 172.21.15.17:0/2631887174 shutdown_connections 2023-07-14T13:07:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.347+0000 7f245fb85b80 1 --2- 172.21.15.17:0/2631887174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x557353148c60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.347+0000 7f245fb85b80 1 --2- 172.21.15.17:0/2631887174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557352faa6b0 0x55735314e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.347+0000 7f245fb85b80 1 --2- 172.21.15.17:0/2631887174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55735314e580 0x557353155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.347+0000 7f245fb85b80 1 -- 172.21.15.17:0/2631887174 >> 172.21.15.17:0/2631887174 conn(0x557353143be0 msgr2=0x557353157560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.347+0000 7f245fb85b80 1 -- 172.21.15.17:0/2631887174 shutdown_connections 2023-07-14T13:07:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.347+0000 7f245fb85b80 1 -- 172.21.15.17:0/2631887174 wait complete. 2023-07-14T13:07:04.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.348+0000 7f245fb85b80 1 -- start start 2023-07-14T13:07:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.348+0000 7f245fb85b80 1 Processor -- start 2023-07-14T13:07:04.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55735314e580 0x55735315b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f245fb85b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x55735315b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f245fb85b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573531ba9a0 con 0x55735314e580 2023-07-14T13:07:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f245fb85b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573531bab10 con 0x557352faa6b0 2023-07-14T13:07:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f245fb85b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573531bacd0 con 0x5573531542d0 2023-07-14T13:07:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f245fb85b80 10 client.0 _ll_register_callbacks cb 0x7f243c00e890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:04.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f2449f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f2449f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60648/0 (socket says 172.21.15.17:60648) 2023-07-14T13:07:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f2449f9b700 1 -- 172.21.15.17:0/3344949621 learned_addr learned my addr 172.21.15.17:0/3344949621 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f244979a700 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55735314e580 0x55735315b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f244a79c700 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x55735315b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f244a79c700 1 -- 172.21.15.17:0/3344949621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 msgr2=0x55735315af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:04.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f244a79c700 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f244a79c700 1 -- 172.21.15.17:0/3344949621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55735314e580 msgr2=0x55735315b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.349+0000 7f244a79c700 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55735314e580 0x55735315b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.350+0000 7f244a79c700 1 -- 172.21.15.17:0/3344949621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557352ecdd80 con 0x5573531542d0 2023-07-14T13:07:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.350+0000 7f2449f9b700 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.350+0000 7f244a79c700 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x55735315b9e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f243c004010 tx=0x7f243c018620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e46e079bd5b681e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.350+0000 7f242d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:07:04.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.350+0000 7f242d7fa700 1 -- 172.21.15.17:0/3344949621 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c004e90 con 0x5573531542d0 2023-07-14T13:07:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.350+0000 7f245fb85b80 1 -- 172.21.15.17:0/3344949621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f244009b1a0 con 0x5573531542d0 2023-07-14T13:07:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.350+0000 7f242d7fa700 1 -- 172.21.15.17:0/3344949621 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f243c017a20 con 0x5573531542d0 2023-07-14T13:07:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f242d7fa700 1 -- 172.21.15.17:0/3344949621 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f243c017be0 con 0x5573531542d0 2023-07-14T13:07:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f245fb85b80 10 client.26755 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f245fb85b80 1 -- 172.21.15.17:0/3344949621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x557352eb6c00 con 0x5573531542d0 2023-07-14T13:07:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f242d7fa700 1 -- 172.21.15.17:0/3344949621 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f244009b1a0 con 0x5573531542d0 2023-07-14T13:07:04.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f242d7fa700 1 -- 172.21.15.17:0/3344949621 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f243c041450 con 0x5573531542d0 2023-07-14T13:07:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f245fb85b80 10 client.26755 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f245fb85b80 10 client.26755 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f245fb85b80 20 client.26755 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f245fb85b80 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5573531bbf60 0x5573531be340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f245fb85b80 4 client.26755 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:07:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f245fb85b80 1 -- 172.21.15.17:0/3344949621 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55735305aff0 con 0x5573531bbf60 2023-07-14T13:07:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.351+0000 7f2449f9b700 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5573531bbf60 0x5573531be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.352+0000 7f2449f9b700 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5573531bbf60 0x5573531be340 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=399f7f7cc6588f8a server_cookie=67620dab0f5826b8 in_seq=0 out_seq=0 2023-07-14T13:07:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.352+0000 7f242d7fa700 10 client.26755 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f242d7fa700 1 -- 172.21.15.17:0/3344949621 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55735305aff0 con 0x5573531bbf60 2023-07-14T13:07:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f242d7fa700 10 client.26755 handle_command_reply: tid=0 2023-07-14T13:07:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f245fb85b80 1 client.26755 shutdown 2023-07-14T13:07:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f245fb85b80 1 -- 172.21.15.17:0/3344949621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 msgr2=0x55735315b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f245fb85b80 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x55735315b9e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f243c004010 tx=0x7f243c018620 comp rx=0 tx=0).stop 2023-07-14T13:07:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f245fb85b80 1 -- 172.21.15.17:0/3344949621 shutdown_connections 2023-07-14T13:07:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f245fb85b80 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5573531bbf60 0x5573531be340 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f245fb85b80 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573531542d0 0x55735315b9e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f245fb85b80 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557352faa6b0 0x55735315af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f242d7fa700 0 client.26755 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f245fb85b80 1 --2- 172.21.15.17:0/3344949621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55735314e580 0x55735315b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f245fb85b80 1 -- 172.21.15.17:0/3344949621 >> 172.21.15.17:0/3344949621 conn(0x557353143be0 msgr2=0x557353155df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f245fb85b80 1 -- 172.21.15.17:0/3344949621 shutdown_connections 2023-07-14T13:07:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.370+0000 7f245fb85b80 1 -- 172.21.15.17:0/3344949621 wait complete. 2023-07-14T13:07:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.371+0000 7f245fb85b80 20 client.26755 trim_cache size 0 max 16384 2023-07-14T13:07:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:07:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:07:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:07:04.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:07:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.371+0000 7f244c1ff700 1 -- 172.21.15.17:0/939438354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f24300a12c0 msgr2=0x7f24300a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.371+0000 7f244c1ff700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f24300a12c0 0x7f24300a3770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f243c003f30 tx=0x7f243c009920 comp rx=0 tx=0).stop 2023-07-14T13:07:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.371+0000 7f244c1ff700 1 -- 172.21.15.17:0/939438354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24440ffb00 msgr2=0x7f2444197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.371+0000 7f244c1ff700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24440ffb00 0x7f2444197d30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2440005740 tx=0x7f2440005770 comp rx=0 tx=0).stop 2023-07-14T13:07:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.371+0000 7f244c1ff700 1 -- 172.21.15.17:0/939438354 shutdown_connections 2023-07-14T13:07:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.371+0000 7f244c1ff700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f24300a12c0 0x7f24300a3770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.371+0000 7f244c1ff700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2444105b10 0x7f244419c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.371+0000 7f244c1ff700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24440ffb00 0x7f2444197d30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.371+0000 7f244c1ff700 1 --2- 172.21.15.17:0/939438354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24441004b0 0x7f2444198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.371+0000 7f244c1ff700 1 -- 172.21.15.17:0/939438354 >> 172.21.15.17:0/939438354 conn(0x7f24440fb600 msgr2=0x7f244410ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.372+0000 7f244c1ff700 1 -- 172.21.15.17:0/939438354 shutdown_connections 2023-07-14T13:07:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:04.372+0000 7f244c1ff700 1 -- 172.21.15.17:0/939438354 wait complete. 2023-07-14T13:07:05.099 INFO:teuthology.orchestra.run.smithi017.stderr:28200000 of 50000000 tuples (56%) done (elapsed 414.70 s, remaining 320.58 s) 2023-07-14T13:07:05.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:05 smithi017 ceph-mon[95536]: pgmap v225: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 46 op/s 2023-07-14T13:07:05.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:05 smithi017 ceph-mon[95536]: osdmap e92: 12 total, 12 up, 12 in 2023-07-14T13:07:05.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:05 smithi135 ceph-mon[97338]: pgmap v225: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 46 op/s 2023-07-14T13:07:05.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:05 smithi135 ceph-mon[97338]: osdmap e92: 12 total, 12 up, 12 in 2023-07-14T13:07:05.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:05 smithi131 ceph-mon[96953]: pgmap v225: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 46 op/s 2023-07-14T13:07:05.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:05 smithi131 ceph-mon[96953]: osdmap e92: 12 total, 12 up, 12 in 2023-07-14T13:07:06.406 INFO:teuthology.orchestra.run.smithi017.stderr:28300000 of 50000000 tuples (56%) done (elapsed 416.01 s, remaining 318.99 s) 2023-07-14T13:07:07.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:07 smithi017 ceph-mon[95536]: pgmap v227: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 86 op/s 2023-07-14T13:07:07.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:07 smithi135 ceph-mon[97338]: pgmap v227: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 86 op/s 2023-07-14T13:07:07.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:07 smithi131 ceph-mon[96953]: pgmap v227: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 86 op/s 2023-07-14T13:07:07.689 INFO:teuthology.orchestra.run.smithi017.stderr:28400000 of 50000000 tuples (56%) done (elapsed 417.29 s, remaining 317.38 s) 2023-07-14T13:07:09.108 INFO:teuthology.orchestra.run.smithi017.stderr:28500000 of 50000000 tuples (57%) done (elapsed 418.71 s, remaining 315.87 s) 2023-07-14T13:07:09.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:09 smithi135 ceph-mon[97338]: pgmap v228: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 86 op/s 2023-07-14T13:07:09.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:09 smithi131 ceph-mon[96953]: pgmap v228: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 86 op/s 2023-07-14T13:07:09.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:09 smithi017 ceph-mon[95536]: pgmap v228: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 86 op/s 2023-07-14T13:07:10.482 INFO:teuthology.orchestra.run.smithi017.stderr:28600000 of 50000000 tuples (57%) done (elapsed 420.08 s, remaining 314.33 s) 2023-07-14T13:07:11.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:11 smithi135 ceph-mon[97338]: pgmap v229: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 85 op/s 2023-07-14T13:07:11.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:11 smithi135 ceph-mon[97338]: osdmap e93: 12 total, 12 up, 12 in 2023-07-14T13:07:11.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:11 smithi131 ceph-mon[96953]: pgmap v229: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 85 op/s 2023-07-14T13:07:11.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:11 smithi131 ceph-mon[96953]: osdmap e93: 12 total, 12 up, 12 in 2023-07-14T13:07:11.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:11 smithi017 ceph-mon[95536]: pgmap v229: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 85 op/s 2023-07-14T13:07:11.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:11 smithi017 ceph-mon[95536]: osdmap e93: 12 total, 12 up, 12 in 2023-07-14T13:07:11.791 INFO:teuthology.orchestra.run.smithi017.stderr:28700000 of 50000000 tuples (57%) done (elapsed 421.39 s, remaining 312.74 s) 2023-07-14T13:07:13.088 INFO:teuthology.orchestra.run.smithi017.stderr:28800000 of 50000000 tuples (57%) done (elapsed 422.69 s, remaining 311.15 s) 2023-07-14T13:07:13.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:13 smithi135 ceph-mon[97338]: pgmap v231: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 33 MiB/s wr, 107 op/s 2023-07-14T13:07:13.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:13 smithi131 ceph-mon[96953]: pgmap v231: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 33 MiB/s wr, 107 op/s 2023-07-14T13:07:13.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:13 smithi017 ceph-mon[95536]: pgmap v231: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 33 MiB/s wr, 107 op/s 2023-07-14T13:07:14.483 INFO:teuthology.orchestra.run.smithi017.stderr:28900000 of 50000000 tuples (57%) done (elapsed 424.08 s, remaining 309.63 s) 2023-07-14T13:07:15.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:15 smithi135 ceph-mon[97338]: pgmap v232: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 86 op/s 2023-07-14T13:07:15.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:15 smithi131 ceph-mon[96953]: pgmap v232: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 86 op/s 2023-07-14T13:07:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:15 smithi017 ceph-mon[95536]: pgmap v232: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 86 op/s 2023-07-14T13:07:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:29000000 of 50000000 tuples (58%) done (elapsed 425.42 s, remaining 308.06 s) 2023-07-14T13:07:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:29100000 of 50000000 tuples (58%) done (elapsed 426.77 s, remaining 306.51 s) 2023-07-14T13:07:17.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:17 smithi135 ceph-mon[97338]: pgmap v233: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 57 op/s 2023-07-14T13:07:17.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:17 smithi131 ceph-mon[96953]: pgmap v233: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 57 op/s 2023-07-14T13:07:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.531+0000 7fcb085ff700 1 -- 172.21.15.17:0/2787738972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb000685b0 msgr2=0x7fcb00104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.531+0000 7fcb085ff700 1 --2- 172.21.15.17:0/2787738972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb000685b0 0x7fcb00104770 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009920 tx=0x7fcaf0009c30 comp rx=0 tx=0).stop 2023-07-14T13:07:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.531+0000 7fcb085ff700 1 -- 172.21.15.17:0/2787738972 shutdown_connections 2023-07-14T13:07:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.531+0000 7fcb085ff700 1 --2- 172.21.15.17:0/2787738972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb00104e50 0x7fcb0010ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.531+0000 7fcb085ff700 1 --2- 172.21.15.17:0/2787738972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb00067c10 0x7fcb00067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.531+0000 7fcb085ff700 1 --2- 172.21.15.17:0/2787738972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb000685b0 0x7fcb00104770 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.531+0000 7fcb085ff700 1 -- 172.21.15.17:0/2787738972 >> 172.21.15.17:0/2787738972 conn(0x7fcb00074760 msgr2=0x7fcb00074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.531+0000 7fcb085ff700 1 -- 172.21.15.17:0/2787738972 shutdown_connections 2023-07-14T13:07:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.531+0000 7fcb085ff700 1 -- 172.21.15.17:0/2787738972 wait complete. 2023-07-14T13:07:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.532+0000 7fcb085ff700 1 Processor -- start 2023-07-14T13:07:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.533+0000 7fcb085ff700 1 -- start start 2023-07-14T13:07:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.533+0000 7fcb085ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb00067c10 0x7fcb0019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.533+0000 7fcb085ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb000685b0 0x7fcb0019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.533+0000 7fcb085ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb00104e50 0x7fcb00195a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.533+0000 7fcb085ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00196070 con 0x7fcb000685b0 2023-07-14T13:07:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.533+0000 7fcb085ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb001961e0 con 0x7fcb00104e50 2023-07-14T13:07:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.533+0000 7fcb085ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb001963a0 con 0x7fcb00067c10 2023-07-14T13:07:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.533+0000 7fcb05b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb000685b0 0x7fcb0019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.534+0000 7fcb0639b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb00067c10 0x7fcb0019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.534+0000 7fcb0639b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb00067c10 0x7fcb0019bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58028/0 (socket says 172.21.15.17:58028) 2023-07-14T13:07:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.534+0000 7fcb0639b700 1 -- 172.21.15.17:0/3960976594 learned_addr learned my addr 172.21.15.17:0/3960976594 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.534+0000 7fcb06b9c700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb00104e50 0x7fcb00195a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.534+0000 7fcb0639b700 1 -- 172.21.15.17:0/3960976594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb00104e50 msgr2=0x7fcb00195a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.534+0000 7fcb0639b700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb00104e50 0x7fcb00195a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.534+0000 7fcb0639b700 1 -- 172.21.15.17:0/3960976594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb000685b0 msgr2=0x7fcb0019c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.534+0000 7fcb0639b700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb000685b0 0x7fcb0019c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.534+0000 7fcb0639b700 1 -- 172.21.15.17:0/3960976594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf0009520 con 0x7fcb00067c10 2023-07-14T13:07:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.534+0000 7fcb05b9a700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb000685b0 0x7fcb0019c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.534+0000 7fcb0639b700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb00067c10 0x7fcb0019bba0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00e9a0 tx=0x7fcafc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.535+0000 7fcaf77fe700 1 -- 172.21.15.17:0/3960976594 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc009790 con 0x7fcb00067c10 2023-07-14T13:07:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.535+0000 7fcb085ff700 1 -- 172.21.15.17:0/3960976594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb00196680 con 0x7fcb00067c10 2023-07-14T13:07:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.535+0000 7fcaf77fe700 1 -- 172.21.15.17:0/3960976594 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcafc010430 con 0x7fcb00067c10 2023-07-14T13:07:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.535+0000 7fcaf77fe700 1 -- 172.21.15.17:0/3960976594 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00cea0 con 0x7fcb00067c10 2023-07-14T13:07:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.535+0000 7fcb085ff700 1 -- 172.21.15.17:0/3960976594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb001a2b90 con 0x7fcb00067c10 2023-07-14T13:07:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.539+0000 7fcaf77fe700 1 -- 172.21.15.17:0/3960976594 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcafc0105a0 con 0x7fcb00067c10 2023-07-14T13:07:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.540+0000 7fcaf77fe700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcaec0a12c0 0x7fcaec0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.540+0000 7fcb1bf8bb80 1 Processor -- start 2023-07-14T13:07:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.541+0000 7fcaf77fe700 1 -- 172.21.15.17:0/3960976594 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcafc014070 con 0x7fcb00067c10 2023-07-14T13:07:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.541+0000 7fcb1bf8bb80 1 -- start start 2023-07-14T13:07:17.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.541+0000 7fcb05b9a700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcaec0a12c0 0x7fcaec0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.541+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4e8b26b0 0x556d4ea601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.541+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea606e0 0x556d4ea5a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.541+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4ea5a990 0x556d4ea5ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.541+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4e95bc50 con 0x556d4ea606e0 2023-07-14T13:07:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.541+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4e9ae9e0 con 0x556d4ea5a990 2023-07-14T13:07:17.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.541+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4e9a7e70 con 0x556d4e8b26b0 2023-07-14T13:07:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb06b9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4ea5a990 0x556d4ea5ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb06b9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4ea5a990 0x556d4ea5ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52864/0 (socket says 172.21.15.17:52864) 2023-07-14T13:07:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb0639b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4e8b26b0 0x556d4ea601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb06b9c700 1 -- 172.21.15.17:0/3245273652 learned_addr learned my addr 172.21.15.17:0/3245273652 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb05b9a700 1 --2- 172.21.15.17:0/3245273652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea606e0 0x556d4ea5a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb0639b700 1 -- 172.21.15.17:0/3245273652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4ea5a990 msgr2=0x556d4ea5ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb0639b700 1 --2- 172.21.15.17:0/3245273652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4ea5a990 0x556d4ea5ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb0639b700 1 -- 172.21.15.17:0/3245273652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea606e0 msgr2=0x556d4ea5a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb0639b700 1 --2- 172.21.15.17:0/3245273652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea606e0 0x556d4ea5a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb05b9a700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcaec0a12c0 0x7fcaec0a3770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00098f0 tx=0x7fcaf000f460 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb0639b700 1 -- 172.21.15.17:0/3245273652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d4e7d5d80 con 0x556d4e8b26b0 2023-07-14T13:07:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcb0639b700 1 --2- 172.21.15.17:0/3245273652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4e8b26b0 0x556d4ea601a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0ca6c0 tx=0x7fcafc099a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8cd821ff501be2f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.542+0000 7fcaf4bfe700 1 -- 172.21.15.17:0/3245273652 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc09e070 con 0x556d4e8b26b0 2023-07-14T13:07:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.543+0000 7fcaf4bfe700 1 -- 172.21.15.17:0/3245273652 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcafc0a2490 con 0x556d4e8b26b0 2023-07-14T13:07:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.543+0000 7fcaf4bfe700 1 -- 172.21.15.17:0/3245273652 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc0a2260 con 0x556d4e8b26b0 2023-07-14T13:07:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.543+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/3245273652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4e8b26b0 msgr2=0x556d4ea601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.543+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/3245273652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4e8b26b0 0x556d4ea601a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0ca6c0 tx=0x7fcafc099a70 comp rx=0 tx=0).stop 2023-07-14T13:07:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.543+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/3245273652 shutdown_connections 2023-07-14T13:07:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.543+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/3245273652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4ea5a990 0x556d4ea5ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.543+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/3245273652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4e8b26b0 0x556d4ea601a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.543+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/3245273652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea606e0 0x556d4ea5a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.543+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/3245273652 >> 172.21.15.17:0/3245273652 conn(0x556d4ea4bbe0 msgr2=0x556d4ea50f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.544+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/3245273652 shutdown_connections 2023-07-14T13:07:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.544+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/3245273652 wait complete. 2023-07-14T13:07:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.544+0000 7fcb1bf8bb80 1 -- start start 2023-07-14T13:07:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.544+0000 7fcb1bf8bb80 1 Processor -- start 2023-07-14T13:07:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4e8b26b0 0x556d4ea669c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea5a990 0x556d4ea63d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4ea606e0 0x556d4ea643d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4e947a60 con 0x556d4e8b26b0 2023-07-14T13:07:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4e947760 con 0x556d4ea606e0 2023-07-14T13:07:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4e82b8c0 con 0x556d4ea5a990 2023-07-14T13:07:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb1bf8bb80 10 client.0 _ll_register_callbacks cb 0x556d4e945700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb05b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea5a990 0x556d4ea63d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb0639b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4e8b26b0 0x556d4ea669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb05b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea5a990 0x556d4ea63d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58044/0 (socket says 172.21.15.17:58044) 2023-07-14T13:07:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb05b9a700 1 -- 172.21.15.17:0/2343919326 learned_addr learned my addr 172.21.15.17:0/2343919326 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.545+0000 7fcb06b9c700 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4ea606e0 0x556d4ea643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.546+0000 7fcb05b9a700 1 -- 172.21.15.17:0/2343919326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4ea606e0 msgr2=0x556d4ea643d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.546+0000 7fcb05b9a700 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4ea606e0 0x556d4ea643d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.546+0000 7fcb05b9a700 1 -- 172.21.15.17:0/2343919326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4e8b26b0 msgr2=0x556d4ea669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.546+0000 7fcb05b9a700 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4e8b26b0 0x556d4ea669c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.546+0000 7fcb05b9a700 1 -- 172.21.15.17:0/2343919326 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb001a2b90 con 0x556d4ea5a990 2023-07-14T13:07:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.546+0000 7fcb0639b700 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4e8b26b0 0x556d4ea669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.546+0000 7fcb05b9a700 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea5a990 0x556d4ea63d50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005c10 tx=0x7fcaf0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77cdffae8b63f713 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.546+0000 7fcae9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:07:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.546+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2343919326 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000bbd0 con 0x556d4ea5a990 2023-07-14T13:07:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.546+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2343919326 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d4e901490 con 0x556d4ea5a990 2023-07-14T13:07:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.546+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2343919326 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcaf0005040 con 0x556d4ea5a990 2023-07-14T13:07:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.547+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2343919326 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaf0005200 con 0x556d4ea5a990 2023-07-14T13:07:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.547+0000 7fcb1bf8bb80 10 client.26767 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.547+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2343919326 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556d4e7bec00 con 0x556d4ea5a990 2023-07-14T13:07:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.547+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2343919326 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556d4e901490 con 0x556d4ea5a990 2023-07-14T13:07:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.547+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2343919326 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcaf0025410 con 0x556d4ea5a990 2023-07-14T13:07:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.547+0000 7fcb1bf8bb80 10 client.26767 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.547+0000 7fcb1bf8bb80 10 client.26767 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.547+0000 7fcb1bf8bb80 20 client.26767 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.547+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556d4ea74090 0x556d4ea764a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.547+0000 7fcb1bf8bb80 4 client.26767 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:07:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.547+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2343919326 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d4e9a0e50 con 0x556d4ea74090 2023-07-14T13:07:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.548+0000 7fcb0639b700 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556d4ea74090 0x556d4ea764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.548+0000 7fcae9ffb700 10 client.26767 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.548+0000 7fcb0639b700 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556d4ea74090 0x556d4ea764a0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=981097f9f29343ca server_cookie=a8728e19cfd6d9d8 in_seq=0 out_seq=0 2023-07-14T13:07:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2343919326 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556d4e9a0e50 con 0x556d4ea74090 2023-07-14T13:07:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcae9ffb700 10 client.26767 handle_command_reply: tid=0 2023-07-14T13:07:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcb1bf8bb80 1 client.26767 shutdown 2023-07-14T13:07:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2343919326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea5a990 msgr2=0x556d4ea63d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea5a990 0x556d4ea63d50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0005c10 tx=0x7fcaf0009c30 comp rx=0 tx=0).stop 2023-07-14T13:07:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2343919326 shutdown_connections 2023-07-14T13:07:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556d4ea74090 0x556d4ea764a0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4ea606e0 0x556d4ea643d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcae9ffb700 0 client.26767 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4e8b26b0 0x556d4ea669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2343919326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea5a990 0x556d4ea63d50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.549+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2343919326 >> 172.21.15.17:0/2343919326 conn(0x556d4ea4bbe0 msgr2=0x556d4ea504e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.550+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2343919326 shutdown_connections 2023-07-14T13:07:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.550+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2343919326 wait complete. 2023-07-14T13:07:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.550+0000 7fcb1bf8bb80 20 client.26767 trim_cache size 0 max 16384 2023-07-14T13:07:17.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.567+0000 7fcb1bf8bb80 1 Processor -- start 2023-07-14T13:07:17.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.567+0000 7fcb1bf8bb80 1 -- start start 2023-07-14T13:07:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.568+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4e8b26b0 0x556d4ea5a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.568+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 0x556d4ea63640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.568+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 0x556d4ea6b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.568+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4ea60ab0 con 0x556d4ea5a990 2023-07-14T13:07:17.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.568+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4ea63b80 con 0x556d4e8b26b0 2023-07-14T13:07:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.568+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4ea48c00 con 0x556d4ea606e0 2023-07-14T13:07:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.568+0000 7fcb05b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 0x556d4ea63640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.568+0000 7fcb06b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 0x556d4ea6b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.568+0000 7fcb0639b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4e8b26b0 0x556d4ea5a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.568+0000 7fcb06b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 0x556d4ea6b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58048/0 (socket says 172.21.15.17:58048) 2023-07-14T13:07:17.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.568+0000 7fcb06b9c700 1 -- 172.21.15.17:0/2511641158 learned_addr learned my addr 172.21.15.17:0/2511641158 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.569+0000 7fcb06b9c700 1 -- 172.21.15.17:0/2511641158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4e8b26b0 msgr2=0x556d4ea5a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.569+0000 7fcb06b9c700 1 --2- 172.21.15.17:0/2511641158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4e8b26b0 0x556d4ea5a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.569+0000 7fcb06b9c700 1 -- 172.21.15.17:0/2511641158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 msgr2=0x556d4ea63640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.569+0000 7fcb06b9c700 1 --2- 172.21.15.17:0/2511641158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 0x556d4ea63640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.569+0000 7fcb06b9c700 1 -- 172.21.15.17:0/2511641158 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d4e7fc1f0 con 0x556d4ea606e0 2023-07-14T13:07:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.569+0000 7fcb05b9a700 1 --2- 172.21.15.17:0/2511641158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 0x556d4ea63640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:17.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.569+0000 7fcb06b9c700 1 --2- 172.21.15.17:0/2511641158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 0x556d4ea6b070 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80129d0 tx=0x7fcaf80099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aa394146811b597 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.569+0000 7fcaf53ff700 1 -- 172.21.15.17:0/2511641158 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800e040 con 0x556d4ea606e0 2023-07-14T13:07:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.569+0000 7fcaf53ff700 1 -- 172.21.15.17:0/2511641158 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcaf800f040 con 0x556d4ea606e0 2023-07-14T13:07:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.569+0000 7fcaf53ff700 1 -- 172.21.15.17:0/2511641158 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8007a60 con 0x556d4ea606e0 2023-07-14T13:07:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.570+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2511641158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 msgr2=0x556d4ea6b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.570+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2511641158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 0x556d4ea6b070 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcaf80129d0 tx=0x7fcaf80099e0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.570+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2511641158 shutdown_connections 2023-07-14T13:07:17.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.570+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2511641158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 0x556d4ea6b070 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.570+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2511641158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4e8b26b0 0x556d4ea5a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.570+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2511641158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 0x556d4ea63640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.570+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2511641158 >> 172.21.15.17:0/2511641158 conn(0x556d4ea4bbe0 msgr2=0x556d4ea5df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.570+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2511641158 shutdown_connections 2023-07-14T13:07:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.570+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2511641158 wait complete. 2023-07-14T13:07:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.571+0000 7fcb1bf8bb80 1 -- start start 2023-07-14T13:07:17.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.571+0000 7fcb1bf8bb80 1 Processor -- start 2023-07-14T13:07:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.571+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4e8b26b0 0x556d4ea69060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 0x556d4ea695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb1bf8bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 0x556d4ea69ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4eac6fe0 con 0x556d4ea5a990 2023-07-14T13:07:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4eac7150 con 0x556d4e8b26b0 2023-07-14T13:07:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb1bf8bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d4eac7310 con 0x556d4ea606e0 2023-07-14T13:07:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb1bf8bb80 10 client.0 _ll_register_callbacks cb 0x7fcaf000f820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb05b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 0x556d4ea695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb05b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 0x556d4ea695a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59398/0 (socket says 172.21.15.17:59398) 2023-07-14T13:07:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb05b9a700 1 -- 172.21.15.17:0/2982835381 learned_addr learned my addr 172.21.15.17:0/2982835381 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb0639b700 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4e8b26b0 0x556d4ea69060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb06b9c700 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 0x556d4ea69ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.572+0000 7fcb0639b700 1 -- 172.21.15.17:0/2982835381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 msgr2=0x556d4ea69ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.573+0000 7fcb0639b700 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 0x556d4ea69ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.573+0000 7fcb0639b700 1 -- 172.21.15.17:0/2982835381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 msgr2=0x556d4ea695a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.573+0000 7fcb0639b700 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 0x556d4ea695a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.573+0000 7fcb0639b700 1 -- 172.21.15.17:0/2982835381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d4e7bec00 con 0x556d4e8b26b0 2023-07-14T13:07:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.573+0000 7fcb05b9a700 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 0x556d4ea695a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.573+0000 7fcb06b9c700 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 0x556d4ea69ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.573+0000 7fcb0639b700 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4e8b26b0 0x556d4ea69060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcafc098390 tx=0x7fcafc010b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33b2f4d485043b41 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.573+0000 7fcae9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:07:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.573+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2982835381 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc099730 con 0x556d4e8b26b0 2023-07-14T13:07:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.573+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2982835381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcafc0a2490 con 0x556d4e8b26b0 2023-07-14T13:07:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.573+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2982835381 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcafc0b8240 con 0x556d4e8b26b0 2023-07-14T13:07:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.574+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2982835381 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcafc0b8400 con 0x556d4e8b26b0 2023-07-14T13:07:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.574+0000 7fcb1bf8bb80 10 client.26804 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.574+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2982835381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fcaf8012680 con 0x556d4e8b26b0 2023-07-14T13:07:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.574+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2982835381 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcafc0a2490 con 0x556d4e8b26b0 2023-07-14T13:07:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.574+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2982835381 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcafc095f50 con 0x556d4e8b26b0 2023-07-14T13:07:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.574+0000 7fcb1bf8bb80 10 client.26804 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.574+0000 7fcb1bf8bb80 10 client.26804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.574+0000 7fcb1bf8bb80 20 client.26804 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.574+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556d4eac8830 0x556d4eacac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.574+0000 7fcb1bf8bb80 4 client.26804 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:07:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.574+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2982835381 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556d4e962ff0 con 0x556d4eac8830 2023-07-14T13:07:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.575+0000 7fcb05b9a700 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556d4eac8830 0x556d4eacac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.575+0000 7fcb05b9a700 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556d4eac8830 0x556d4eacac40 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9406f68e5a5aa27 server_cookie=26f46ad655530f1d in_seq=0 out_seq=0 2023-07-14T13:07:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.575+0000 7fcae9ffb700 10 client.26804 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:17.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:17 smithi017 ceph-mon[95536]: pgmap v233: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 57 op/s 2023-07-14T13:07:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.592+0000 7fcae9ffb700 1 -- 172.21.15.17:0/2982835381 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556d4e962ff0 con 0x556d4eac8830 2023-07-14T13:07:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.592+0000 7fcae9ffb700 10 client.26804 handle_command_reply: tid=0 2023-07-14T13:07:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.592+0000 7fcb1bf8bb80 1 client.26804 shutdown 2023-07-14T13:07:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2982835381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4e8b26b0 msgr2=0x556d4ea69060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4e8b26b0 0x556d4ea69060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcafc098390 tx=0x7fcafc010b80 comp rx=0 tx=0).stop 2023-07-14T13:07:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2982835381 shutdown_connections 2023-07-14T13:07:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556d4eac8830 0x556d4eacac40 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d4ea606e0 0x556d4ea69ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556d4e8b26b0 0x556d4ea69060 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcb1bf8bb80 1 --2- 172.21.15.17:0/2982835381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556d4ea5a990 0x556d4ea695a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcae9ffb700 0 client.26804 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2982835381 >> 172.21.15.17:0/2982835381 conn(0x556d4ea4bbe0 msgr2=0x556d4ea60ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2982835381 shutdown_connections 2023-07-14T13:07:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcb1bf8bb80 1 -- 172.21.15.17:0/2982835381 wait complete. 2023-07-14T13:07:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.593+0000 7fcb1bf8bb80 20 client.26804 trim_cache size 0 max 16384 2023-07-14T13:07:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:07:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:07:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:07:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:07:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 -- 172.21.15.17:0/3960976594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcaec0a12c0 msgr2=0x7fcaec0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcaec0a12c0 0x7fcaec0a3770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00098f0 tx=0x7fcaf000f460 comp rx=0 tx=0).stop 2023-07-14T13:07:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 -- 172.21.15.17:0/3960976594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb00067c10 msgr2=0x7fcb0019bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb00067c10 0x7fcb0019bba0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00e9a0 tx=0x7fcafc00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 -- 172.21.15.17:0/3960976594 shutdown_connections 2023-07-14T13:07:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcaec0a12c0 0x7fcaec0a3770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb00104e50 0x7fcb00195a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb00067c10 0x7fcb0019bba0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 --2- 172.21.15.17:0/3960976594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb000685b0 0x7fcb0019c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:17.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 -- 172.21.15.17:0/3960976594 >> 172.21.15.17:0/3960976594 conn(0x7fcb00074760 msgr2=0x7fcb000fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:17.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 -- 172.21.15.17:0/3960976594 shutdown_connections 2023-07-14T13:07:17.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:17.594+0000 7fcb085ff700 1 -- 172.21.15.17:0/3960976594 wait complete. 2023-07-14T13:07:18.494 INFO:teuthology.orchestra.run.smithi017.stderr:29200000 of 50000000 tuples (58%) done (elapsed 428.09 s, remaining 304.94 s) 2023-07-14T13:07:19.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:19 smithi135 ceph-mon[97338]: pgmap v234: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 57 op/s 2023-07-14T13:07:19.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:19 smithi131 ceph-mon[96953]: pgmap v234: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 57 op/s 2023-07-14T13:07:19.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:19 smithi017 ceph-mon[95536]: pgmap v234: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 57 op/s 2023-07-14T13:07:19.877 INFO:teuthology.orchestra.run.smithi017.stderr:29300000 of 50000000 tuples (58%) done (elapsed 429.48 s, remaining 303.42 s) 2023-07-14T13:07:21.180 INFO:teuthology.orchestra.run.smithi017.stderr:29400000 of 50000000 tuples (58%) done (elapsed 430.78 s, remaining 301.84 s) 2023-07-14T13:07:21.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:21 smithi135 ceph-mon[97338]: pgmap v235: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 27 MiB/s wr, 62 op/s 2023-07-14T13:07:21.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:21 smithi131 ceph-mon[96953]: pgmap v235: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 27 MiB/s wr, 62 op/s 2023-07-14T13:07:21.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:21 smithi017 ceph-mon[95536]: pgmap v235: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 27 MiB/s wr, 62 op/s 2023-07-14T13:07:22.576 INFO:teuthology.orchestra.run.smithi017.stderr:29500000 of 50000000 tuples (59%) done (elapsed 432.18 s, remaining 300.33 s) 2023-07-14T13:07:23.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:23 smithi135 ceph-mon[97338]: pgmap v236: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 57 op/s 2023-07-14T13:07:23.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:23 smithi131 ceph-mon[96953]: pgmap v236: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 57 op/s 2023-07-14T13:07:23.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:23 smithi017 ceph-mon[95536]: pgmap v236: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 25 MiB/s wr, 57 op/s 2023-07-14T13:07:24.021 INFO:teuthology.orchestra.run.smithi017.stderr:29600000 of 50000000 tuples (59%) done (elapsed 433.62 s, remaining 298.85 s) 2023-07-14T13:07:25.392 INFO:teuthology.orchestra.run.smithi017.stderr:29700000 of 50000000 tuples (59%) done (elapsed 434.99 s, remaining 297.32 s) 2023-07-14T13:07:25.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:25 smithi135 ceph-mon[97338]: pgmap v237: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 23 MiB/s wr, 52 op/s 2023-07-14T13:07:25.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:25 smithi131 ceph-mon[96953]: pgmap v237: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 23 MiB/s wr, 52 op/s 2023-07-14T13:07:25.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:25 smithi017 ceph-mon[95536]: pgmap v237: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 23 MiB/s wr, 52 op/s 2023-07-14T13:07:26.716 INFO:teuthology.orchestra.run.smithi017.stderr:29800000 of 50000000 tuples (59%) done (elapsed 436.32 s, remaining 295.76 s) 2023-07-14T13:07:27.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:27 smithi135 ceph-mon[97338]: pgmap v238: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 33 MiB/s wr, 95 op/s 2023-07-14T13:07:27.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:27 smithi131 ceph-mon[96953]: pgmap v238: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 33 MiB/s wr, 95 op/s 2023-07-14T13:07:27.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:27 smithi017 ceph-mon[95536]: pgmap v238: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 33 MiB/s wr, 95 op/s 2023-07-14T13:07:28.039 INFO:teuthology.orchestra.run.smithi017.stderr:29900000 of 50000000 tuples (59%) done (elapsed 437.64 s, remaining 294.20 s) 2023-07-14T13:07:29.452 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:29 smithi135 ceph-mon[97338]: pgmap v239: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:07:29.476 INFO:teuthology.orchestra.run.smithi017.stderr:30000000 of 50000000 tuples (60%) done (elapsed 439.08 s, remaining 292.72 s) 2023-07-14T13:07:29.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:29 smithi131 ceph-mon[96953]: pgmap v239: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:07:29.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:29 smithi017 ceph-mon[95536]: pgmap v239: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:07:30.354 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:07:30.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.573+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3939162413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e34100490 msgr2=0x7f6e3410c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.573+0000 7f6e3b3ff700 1 --2- 172.21.15.17:0/3939162413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e34100490 0x7f6e3410c920 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00b0a0 tx=0x7f6e2c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.573+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3939162413 shutdown_connections 2023-07-14T13:07:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.573+0000 7f6e3b3ff700 1 --2- 172.21.15.17:0/3939162413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e34100490 0x7f6e3410c920 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.573+0000 7f6e3b3ff700 1 --2- 172.21.15.17:0/3939162413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e34105af0 0x7f6e34105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.573+0000 7f6e3b3ff700 1 --2- 172.21.15.17:0/3939162413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e340ffae0 0x7f6e340fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.573+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3939162413 >> 172.21.15.17:0/3939162413 conn(0x7f6e340fb5e0 msgr2=0x7f6e340fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.573+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3939162413 shutdown_connections 2023-07-14T13:07:30.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.573+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3939162413 wait complete. 2023-07-14T13:07:30.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.574+0000 7f6e3b3ff700 1 Processor -- start 2023-07-14T13:07:30.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3b3ff700 1 -- start start 2023-07-14T13:07:30.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e340ffae0 0x7f6e34197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3b3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e34100490 0x7f6e34198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3b3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e34105af0 0x7f6e3419c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3b3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3419cdd0 con 0x7f6e34105af0 2023-07-14T13:07:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3b3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3419cf40 con 0x7f6e34100490 2023-07-14T13:07:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3419d100 con 0x7f6e340ffae0 2023-07-14T13:07:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e340ffae0 0x7f6e34197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3899a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e34100490 0x7f6e34198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e34105af0 0x7f6e3419c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e340ffae0 0x7f6e34197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38886/0 (socket says 172.21.15.17:38886) 2023-07-14T13:07:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.575+0000 7f6e3919b700 1 -- 172.21.15.17:0/3784926459 learned_addr learned my addr 172.21.15.17:0/3784926459 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.576+0000 7f6e3999c700 1 -- 172.21.15.17:0/3784926459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e340ffae0 msgr2=0x7f6e34197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.576+0000 7f6e3999c700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e340ffae0 0x7f6e34197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.576+0000 7f6e3999c700 1 -- 172.21.15.17:0/3784926459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e34100490 msgr2=0x7f6e34198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.576+0000 7f6e3999c700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e34100490 0x7f6e34198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.576+0000 7f6e3999c700 1 -- 172.21.15.17:0/3784926459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c009d00 con 0x7f6e34105af0 2023-07-14T13:07:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.576+0000 7f6e3919b700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e340ffae0 0x7f6e34197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.576+0000 7f6e3999c700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e34105af0 0x7f6e3419c790 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00b0a0 tx=0x7f6e2c008ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.577+0000 7f6e2a7fc700 1 -- 172.21.15.17:0/3784926459 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c00e040 con 0x7f6e34105af0 2023-07-14T13:07:30.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.577+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3784926459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3419d380 con 0x7f6e34105af0 2023-07-14T13:07:30.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.577+0000 7f6e2a7fc700 1 -- 172.21.15.17:0/3784926459 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e2c01d470 con 0x7f6e34105af0 2023-07-14T13:07:30.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.577+0000 7f6e2a7fc700 1 -- 172.21.15.17:0/3784926459 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c0052a0 con 0x7f6e34105af0 2023-07-14T13:07:30.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.577+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3784926459 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e341a4c20 con 0x7f6e34105af0 2023-07-14T13:07:30.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.580+0000 7f6e2a7fc700 1 -- 172.21.15.17:0/3784926459 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6e2c01d5e0 con 0x7f6e34105af0 2023-07-14T13:07:30.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.581+0000 7f6e4ed42b80 1 Processor -- start 2023-07-14T13:07:30.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.582+0000 7f6e4ed42b80 1 -- start start 2023-07-14T13:07:30.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.582+0000 7f6e2a7fc700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e200a12c0 0x7f6e200a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.582+0000 7f6e2a7fc700 1 -- 172.21.15.17:0/3784926459 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6e2c0ce120 con 0x7f6e34105af0 2023-07-14T13:07:30.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.582+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 0x55821df946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.582+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821df9f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.582+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df9fad0 0x55821dfa1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.582+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821de9acb0 con 0x55821df9fad0 2023-07-14T13:07:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.582+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821deeda40 con 0x55821df94be0 2023-07-14T13:07:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.582+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821dee6ed0 con 0x55821df942d0 2023-07-14T13:07:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.582+0000 7f6e3899a700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e200a12c0 0x7f6e200a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.583+0000 7f6e3899a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821df9f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.583+0000 7f6e3919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 0x55821df946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.583+0000 7f6e3899a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821df9f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41684/0 (socket says 172.21.15.17:41684) 2023-07-14T13:07:30.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.583+0000 7f6e3899a700 1 -- 172.21.15.17:0/2980794077 learned_addr learned my addr 172.21.15.17:0/2980794077 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:30.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.583+0000 7f6e3999c700 1 --2- 172.21.15.17:0/2980794077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df9fad0 0x55821dfa1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.583+0000 7f6e3919b700 1 -- 172.21.15.17:0/2980794077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 msgr2=0x55821df9f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.583+0000 7f6e3919b700 1 --2- 172.21.15.17:0/2980794077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821df9f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.583+0000 7f6e3919b700 1 -- 172.21.15.17:0/2980794077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df9fad0 msgr2=0x55821dfa1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.583+0000 7f6e3919b700 1 --2- 172.21.15.17:0/2980794077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df9fad0 0x55821dfa1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.583+0000 7f6e3919b700 1 -- 172.21.15.17:0/2980794077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55821dd14de0 con 0x55821df942d0 2023-07-14T13:07:30.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.583+0000 7f6e3999c700 1 --2- 172.21.15.17:0/2980794077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df9fad0 0x55821dfa1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:30.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.584+0000 7f6e3899a700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e200a12c0 0x7f6e200a3770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6e24013a70 tx=0x7f6e24009c00 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.584+0000 7f6e3919b700 1 --2- 172.21.15.17:0/2980794077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 0x55821df946a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6e300114c0 tx=0x7f6e300117d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7f14190004d63ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.584+0000 7f6e1f7fe700 1 -- 172.21.15.17:0/2980794077 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30004230 con 0x55821df942d0 2023-07-14T13:07:30.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.584+0000 7f6e1f7fe700 1 -- 172.21.15.17:0/2980794077 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e30004390 con 0x55821df942d0 2023-07-14T13:07:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.584+0000 7f6e1f7fe700 1 -- 172.21.15.17:0/2980794077 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000e7d0 con 0x55821df942d0 2023-07-14T13:07:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.585+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2980794077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 msgr2=0x55821df946a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.585+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2980794077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 0x55821df946a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6e300114c0 tx=0x7f6e300117d0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.585+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2980794077 shutdown_connections 2023-07-14T13:07:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.585+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2980794077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df9fad0 0x55821dfa1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.585+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2980794077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 0x55821df946a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.585+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2980794077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821df9f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.585+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2980794077 >> 172.21.15.17:0/2980794077 conn(0x55821df8ada0 msgr2=0x55821df906a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.585+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2980794077 shutdown_connections 2023-07-14T13:07:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.585+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2980794077 wait complete. 2023-07-14T13:07:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.586+0000 7f6e4ed42b80 1 -- start start 2023-07-14T13:07:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.586+0000 7f6e4ed42b80 1 Processor -- start 2023-07-14T13:07:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df942d0 0x55821df9f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821df9c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df9fad0 0x55821df9ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821de86ac0 con 0x55821df942d0 2023-07-14T13:07:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821de867c0 con 0x55821df94be0 2023-07-14T13:07:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821dd6a920 con 0x55821df9fad0 2023-07-14T13:07:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e4ed42b80 10 client.0 _ll_register_callbacks cb 0x55821de84760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e3919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df942d0 0x55821df9f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e3899a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821df9c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e3899a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821df9c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41700/0 (socket says 172.21.15.17:41700) 2023-07-14T13:07:30.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e3899a700 1 -- 172.21.15.17:0/3611671750 learned_addr learned my addr 172.21.15.17:0/3611671750 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:30.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.587+0000 7f6e3999c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df9fad0 0x55821df9ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.588+0000 7f6e3899a700 1 -- 172.21.15.17:0/3611671750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df9fad0 msgr2=0x55821df9ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.588+0000 7f6e3899a700 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df9fad0 0x55821df9ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.588+0000 7f6e3899a700 1 -- 172.21.15.17:0/3611671750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df942d0 msgr2=0x55821df9f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.588+0000 7f6e3899a700 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df942d0 0x55821df9f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.588+0000 7f6e3899a700 1 -- 172.21.15.17:0/3611671750 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e341a4c20 con 0x55821df94be0 2023-07-14T13:07:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.588+0000 7f6e3999c700 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df9fad0 0x55821df9ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.588+0000 7f6e3899a700 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821df9c730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e240043c0 tx=0x7f6e2401d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4af409ec8bd8606 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.588+0000 7f6e1cff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:07:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.588+0000 7f6e1cff9700 1 -- 172.21.15.17:0/3611671750 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400fcf0 con 0x55821df94be0 2023-07-14T13:07:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.588+0000 7f6e1cff9700 1 -- 172.21.15.17:0/3611671750 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6e24025030 con 0x55821df94be0 2023-07-14T13:07:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.588+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/3611671750 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55821de404f0 con 0x55821df94be0 2023-07-14T13:07:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.589+0000 7f6e1cff9700 1 -- 172.21.15.17:0/3611671750 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e2400fe50 con 0x55821df94be0 2023-07-14T13:07:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.589+0000 7f6e4ed42b80 10 client.26816 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.589+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/3611671750 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f6e30009ce0 con 0x55821df94be0 2023-07-14T13:07:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.589+0000 7f6e1cff9700 1 -- 172.21.15.17:0/3611671750 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55821de404f0 con 0x55821df94be0 2023-07-14T13:07:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.589+0000 7f6e1cff9700 1 -- 172.21.15.17:0/3611671750 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6e240335d0 con 0x55821df94be0 2023-07-14T13:07:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.589+0000 7f6e4ed42b80 10 client.26816 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.589+0000 7f6e4ed42b80 10 client.26816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.589+0000 7f6e4ed42b80 20 client.26816 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.589+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55821dfaf470 0x55821dfb1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.589+0000 7f6e4ed42b80 4 client.26816 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:07:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.589+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/3611671750 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55821dedfeb0 con 0x55821dfaf470 2023-07-14T13:07:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.590+0000 7f6e3919b700 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55821dfaf470 0x55821dfb1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.590+0000 7f6e3919b700 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55821dfaf470 0x55821dfb1880 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dddf39c35d3ee37 server_cookie=5a173a68ed9c005c in_seq=0 out_seq=0 2023-07-14T13:07:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.590+0000 7f6e1cff9700 10 client.26816 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.591+0000 7f6e1cff9700 1 -- 172.21.15.17:0/3611671750 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55821dedfeb0 con 0x55821dfaf470 2023-07-14T13:07:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.591+0000 7f6e1cff9700 10 client.26816 handle_command_reply: tid=0 2023-07-14T13:07:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.591+0000 7f6e4ed42b80 1 client.26816 shutdown 2023-07-14T13:07:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/3611671750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 msgr2=0x55821df9c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821df9c730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e240043c0 tx=0x7f6e2401d000 comp rx=0 tx=0).stop 2023-07-14T13:07:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/3611671750 shutdown_connections 2023-07-14T13:07:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55821dfaf470 0x55821dfb1880 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df9fad0 0x55821df9ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df942d0 0x55821df9f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e1cff9700 0 client.26816 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/3611671750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821df9c730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/3611671750 >> 172.21.15.17:0/3611671750 conn(0x55821df8ada0 msgr2=0x55821df90230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/3611671750 shutdown_connections 2023-07-14T13:07:30.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/3611671750 wait complete. 2023-07-14T13:07:30.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.592+0000 7f6e4ed42b80 20 client.26816 trim_cache size 0 max 16384 2023-07-14T13:07:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.612+0000 7f6e4ed42b80 1 Processor -- start 2023-07-14T13:07:30.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.612+0000 7f6e4ed42b80 1 -- start start 2023-07-14T13:07:30.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.613+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df8ada0 0x55821dfab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.613+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df942d0 0x55821df9f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.613+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df94be0 0x55821df999c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.613+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821df95540 con 0x55821df942d0 2023-07-14T13:07:30.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.613+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821df91ce0 con 0x55821df8ada0 2023-07-14T13:07:30.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.613+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821df9d470 con 0x55821df94be0 2023-07-14T13:07:30.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.613+0000 7f6e3919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df8ada0 0x55821dfab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.613+0000 7f6e3899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df942d0 0x55821df9f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.613+0000 7f6e3919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df8ada0 0x55821dfab7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41714/0 (socket says 172.21.15.17:41714) 2023-07-14T13:07:30.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.613+0000 7f6e3919b700 1 -- 172.21.15.17:0/2338122147 learned_addr learned my addr 172.21.15.17:0/2338122147 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:30.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.613+0000 7f6e3999c700 1 --2- 172.21.15.17:0/2338122147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df94be0 0x55821df999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.614+0000 7f6e3919b700 1 -- 172.21.15.17:0/2338122147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df94be0 msgr2=0x55821df999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.614+0000 7f6e3919b700 1 --2- 172.21.15.17:0/2338122147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df94be0 0x55821df999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.614+0000 7f6e3919b700 1 -- 172.21.15.17:0/2338122147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df942d0 msgr2=0x55821df9f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.614+0000 7f6e3919b700 1 --2- 172.21.15.17:0/2338122147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df942d0 0x55821df9f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.614+0000 7f6e3919b700 1 -- 172.21.15.17:0/2338122147 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55821dcfdc60 con 0x55821df8ada0 2023-07-14T13:07:30.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.614+0000 7f6e3899a700 1 --2- 172.21.15.17:0/2338122147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df942d0 0x55821df9f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:30.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.614+0000 7f6e3919b700 1 --2- 172.21.15.17:0/2338122147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df8ada0 0x55821dfab7c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6e30011b20 tx=0x7f6e300117d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f2d9685f734c86d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.614+0000 7f6e1ffff700 1 -- 172.21.15.17:0/2338122147 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30005620 con 0x55821df8ada0 2023-07-14T13:07:30.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.614+0000 7f6e1ffff700 1 -- 172.21.15.17:0/2338122147 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e3002e070 con 0x55821df8ada0 2023-07-14T13:07:30.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.614+0000 7f6e1ffff700 1 -- 172.21.15.17:0/2338122147 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30004570 con 0x55821df8ada0 2023-07-14T13:07:30.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.615+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2338122147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df8ada0 msgr2=0x55821dfab7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.615+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2338122147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df8ada0 0x55821dfab7c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6e30011b20 tx=0x7f6e300117d0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.615+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2338122147 shutdown_connections 2023-07-14T13:07:30.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.615+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2338122147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df94be0 0x55821df999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.615+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2338122147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df8ada0 0x55821dfab7c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.615+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2338122147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df942d0 0x55821df9f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.615+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2338122147 >> 172.21.15.17:0/2338122147 conn(0x55821df8c600 msgr2=0x55821df8ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.615+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2338122147 shutdown_connections 2023-07-14T13:07:30.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.616+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2338122147 wait complete. 2023-07-14T13:07:30.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.616+0000 7f6e4ed42b80 1 -- start start 2023-07-14T13:07:30.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.616+0000 7f6e4ed42b80 1 Processor -- start 2023-07-14T13:07:30.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df8ada0 0x55821dfa6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 0x55821dfa4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e4ed42b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821dfa4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821dfa55d0 con 0x55821df8ada0 2023-07-14T13:07:30.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821dfa5740 con 0x55821df94be0 2023-07-14T13:07:30.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e4ed42b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55821e003300 con 0x55821df942d0 2023-07-14T13:07:30.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e4ed42b80 10 client.0 _ll_register_callbacks cb 0x55821de84760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:30.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e3919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df8ada0 0x55821dfa6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e3899a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 0x55821dfa4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e3899a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 0x55821dfa4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38932/0 (socket says 172.21.15.17:38932) 2023-07-14T13:07:30.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e3919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df8ada0 0x55821dfa6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47586/0 (socket says 172.21.15.17:47586) 2023-07-14T13:07:30.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e3899a700 1 -- 172.21.15.17:0/2036806381 learned_addr learned my addr 172.21.15.17:0/2036806381 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:30.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.617+0000 7f6e3999c700 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821dfa4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.618+0000 7f6e3899a700 1 -- 172.21.15.17:0/2036806381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 msgr2=0x55821dfa4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.618+0000 7f6e3899a700 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821dfa4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.618+0000 7f6e3899a700 1 -- 172.21.15.17:0/2036806381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df8ada0 msgr2=0x55821dfa6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.618+0000 7f6e3899a700 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df8ada0 0x55821dfa6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.618+0000 7f6e3899a700 1 -- 172.21.15.17:0/2036806381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e30009ce0 con 0x55821df942d0 2023-07-14T13:07:30.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.618+0000 7f6e3919b700 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df8ada0 0x55821dfa6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:30.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.618+0000 7f6e3899a700 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 0x55821dfa4920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55821df9dce0 tx=0x7f6e24033c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55c03f7d2a10f156 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.618+0000 7f6e1cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:07:30.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.618+0000 7f6e1cff9700 1 -- 172.21.15.17:0/2036806381 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400fbc0 con 0x55821df942d0 2023-07-14T13:07:30.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.618+0000 7f6e1cff9700 1 -- 172.21.15.17:0/2036806381 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6e24025070 con 0x55821df942d0 2023-07-14T13:07:30.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.618+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2036806381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e30004390 con 0x55821df942d0 2023-07-14T13:07:30.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.619+0000 7f6e1cff9700 1 -- 172.21.15.17:0/2036806381 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e2400fd20 con 0x55821df942d0 2023-07-14T13:07:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.619+0000 7f6e4ed42b80 10 client.26791 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.619+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2036806381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55821dd14de0 con 0x55821df942d0 2023-07-14T13:07:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.619+0000 7f6e1cff9700 1 -- 172.21.15.17:0/2036806381 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6e30004390 con 0x55821df942d0 2023-07-14T13:07:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.619+0000 7f6e1cff9700 1 -- 172.21.15.17:0/2036806381 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6e24005500 con 0x55821df942d0 2023-07-14T13:07:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.619+0000 7f6e4ed42b80 10 client.26791 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.619+0000 7f6e4ed42b80 10 client.26791 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.619+0000 7f6e4ed42b80 20 client.26791 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.619+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55821df9fad0 0x55821e006aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.619+0000 7f6e4ed42b80 4 client.26791 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:07:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.619+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2036806381 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55821dea2050 con 0x55821df9fad0 2023-07-14T13:07:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.620+0000 7f6e3919b700 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55821df9fad0 0x55821e006aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e1cff9700 10 client.26791 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e3919b700 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55821df9fad0 0x55821e006aa0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=434b0f29dc75ea1e server_cookie=9f801b5c290aad64 in_seq=0 out_seq=0 2023-07-14T13:07:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e1cff9700 1 -- 172.21.15.17:0/2036806381 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55821dea2050 con 0x55821df9fad0 2023-07-14T13:07:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e1cff9700 10 client.26791 handle_command_reply: tid=0 2023-07-14T13:07:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e4ed42b80 1 client.26791 shutdown 2023-07-14T13:07:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2036806381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 msgr2=0x55821dfa4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 0x55821dfa4920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55821df9dce0 tx=0x7f6e24033c50 comp rx=0 tx=0).stop 2023-07-14T13:07:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2036806381 shutdown_connections 2023-07-14T13:07:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55821df9fad0 0x55821e006aa0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55821df94be0 0x55821dfa4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55821df8ada0 0x55821dfa6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e4ed42b80 1 --2- 172.21.15.17:0/2036806381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55821df942d0 0x55821dfa4920 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2036806381 >> 172.21.15.17:0/2036806381 conn(0x55821df8c600 msgr2=0x55821df97a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e1cff9700 0 client.26791 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2036806381 shutdown_connections 2023-07-14T13:07:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.621+0000 7f6e4ed42b80 1 -- 172.21.15.17:0/2036806381 wait complete. 2023-07-14T13:07:30.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e4ed42b80 20 client.26791 trim_cache size 0 max 16384 2023-07-14T13:07:30.663 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:07:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:07:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:07:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:07:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:07:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:07:30.664 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:07:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:07:30.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:07:30.665 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:07:30.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3784926459 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e200a12c0 msgr2=0x7f6e200a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e3b3ff700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e200a12c0 0x7f6e200a3770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6e24013a70 tx=0x7f6e24009c00 comp rx=0 tx=0).stop 2023-07-14T13:07:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3784926459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e34105af0 msgr2=0x7f6e3419c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e3b3ff700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e34105af0 0x7f6e3419c790 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00b0a0 tx=0x7f6e2c008ea0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3784926459 shutdown_connections 2023-07-14T13:07:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e3b3ff700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6e200a12c0 0x7f6e200a3770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e3b3ff700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e34105af0 0x7f6e3419c790 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e3b3ff700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e340ffae0 0x7f6e34197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e3b3ff700 1 --2- 172.21.15.17:0/3784926459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e34100490 0x7f6e34198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3784926459 >> 172.21.15.17:0/3784926459 conn(0x7f6e340fb5e0 msgr2=0x7f6e3410ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.622+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3784926459 shutdown_connections 2023-07-14T13:07:30.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:07:30.623+0000 7f6e3b3ff700 1 -- 172.21.15.17:0/3784926459 wait complete. 2023-07-14T13:07:30.679 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:07:30.795 INFO:teuthology.orchestra.run.smithi017.stderr:30100000 of 50000000 tuples (60%) done (elapsed 440.40 s, remaining 291.16 s) 2023-07-14T13:07:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.772+0000 7f55f77ff700 1 -- 172.21.15.17:0/386832813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f00ffb30 msgr2=0x7f55f00fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.772+0000 7f55f77ff700 1 --2- 172.21.15.17:0/386832813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f00ffb30 0x7f55f00fffa0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009990 tx=0x7f55e0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.772+0000 7f55f77ff700 1 -- 172.21.15.17:0/386832813 shutdown_connections 2023-07-14T13:07:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.772+0000 7f55f77ff700 1 --2- 172.21.15.17:0/386832813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f01004e0 0x7f55f010c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.772+0000 7f55f77ff700 1 --2- 172.21.15.17:0/386832813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55f0105b60 0x7f55f0105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.772+0000 7f55f77ff700 1 --2- 172.21.15.17:0/386832813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f00ffb30 0x7f55f00fffa0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.772+0000 7f55f77ff700 1 -- 172.21.15.17:0/386832813 >> 172.21.15.17:0/386832813 conn(0x7f55f00fb5f0 msgr2=0x7f55f00fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.772+0000 7f55f77ff700 1 -- 172.21.15.17:0/386832813 shutdown_connections 2023-07-14T13:07:30.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.772+0000 7f55f77ff700 1 -- 172.21.15.17:0/386832813 wait complete. 2023-07-14T13:07:30.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.774+0000 7f55f77ff700 1 Processor -- start 2023-07-14T13:07:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.774+0000 7f55f77ff700 1 -- start start 2023-07-14T13:07:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.775+0000 7f55f77ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f00ffb30 0x7f55f0197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.775+0000 7f55f77ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f01004e0 0x7f55f0198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.775+0000 7f55f77ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55f0105b60 0x7f55f019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.775+0000 7f55f77ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f019bdc0 con 0x7f55f00ffb30 2023-07-14T13:07:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.775+0000 7f55f77ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f019bf30 con 0x7f55f01004e0 2023-07-14T13:07:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.775+0000 7f55f77ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f019c0f0 con 0x7f55f0105b60 2023-07-14T13:07:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.775+0000 7f55f559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f00ffb30 0x7f55f0197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.775+0000 7f55f559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f00ffb30 0x7f55f0197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47604/0 (socket says 172.21.15.17:47604) 2023-07-14T13:07:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.775+0000 7f55f4d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f01004e0 0x7f55f0198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.775+0000 7f55f559b700 1 -- 172.21.15.17:0/3321879574 learned_addr learned my addr 172.21.15.17:0/3321879574 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.775+0000 7f55f5d9c700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55f0105b60 0x7f55f019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.776+0000 7f55f4d9a700 1 -- 172.21.15.17:0/3321879574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55f0105b60 msgr2=0x7f55f019b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.776+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55f0105b60 0x7f55f019b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.776+0000 7f55f4d9a700 1 -- 172.21.15.17:0/3321879574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f00ffb30 msgr2=0x7f55f0197cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.776+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f00ffb30 0x7f55f0197cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.776+0000 7f55f4d9a700 1 -- 172.21.15.17:0/3321879574 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e00095f0 con 0x7f55f01004e0 2023-07-14T13:07:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.776+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f01004e0 0x7f55f0198200 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f55e0005910 tx=0x7f55e0005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.777+0000 7f55e67fc700 1 -- 172.21.15.17:0/3321879574 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e001d070 con 0x7f55f01004e0 2023-07-14T13:07:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.777+0000 7f55e67fc700 1 -- 172.21.15.17:0/3321879574 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55e0022470 con 0x7f55f01004e0 2023-07-14T13:07:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.777+0000 7f55e67fc700 1 -- 172.21.15.17:0/3321879574 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e0017650 con 0x7f55f01004e0 2023-07-14T13:07:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.777+0000 7f55f77ff700 1 -- 172.21.15.17:0/3321879574 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f019c370 con 0x7f55f01004e0 2023-07-14T13:07:30.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.777+0000 7f55f77ff700 1 -- 172.21.15.17:0/3321879574 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f01a4b50 con 0x7f55f01004e0 2023-07-14T13:07:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.781+0000 7f55e67fc700 1 -- 172.21.15.17:0/3321879574 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f55e00225e0 con 0x7f55f01004e0 2023-07-14T13:07:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.782+0000 7f560b1d7b80 1 Processor -- start 2023-07-14T13:07:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.782+0000 7f560b1d7b80 1 -- start start 2023-07-14T13:07:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b0446b0 0x55994b1edd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1ee2d0 0x55994b1e8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b1e8580 0x55994b1e89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994b0edc50 con 0x55994b1ee2d0 2023-07-14T13:07:30.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994b1409e0 con 0x55994b1e8580 2023-07-14T13:07:30.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994b139e70 con 0x55994b0446b0 2023-07-14T13:07:30.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f55e67fc700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55dc0a12c0 0x7f55dc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f55f5d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b0446b0 0x55994b1edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f55f559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1ee2d0 0x55994b1e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f55f5d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b0446b0 0x55994b1edd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38960/0 (socket says 172.21.15.17:38960) 2023-07-14T13:07:30.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f55f5d9c700 1 -- 172.21.15.17:0/2508861982 learned_addr learned my addr 172.21.15.17:0/2508861982 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:30.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.783+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/2508861982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b1e8580 0x55994b1e89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.784+0000 7f55e67fc700 1 -- 172.21.15.17:0/3321879574 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f55e00ce0a0 con 0x7f55f01004e0 2023-07-14T13:07:30.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.784+0000 7f55f5d9c700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55dc0a12c0 0x7f55dc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.784+0000 7f55f4d9a700 1 -- 172.21.15.17:0/2508861982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b0446b0 msgr2=0x55994b1edd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.784+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/2508861982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b0446b0 0x55994b1edd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.784+0000 7f55f4d9a700 1 -- 172.21.15.17:0/2508861982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1ee2d0 msgr2=0x55994b1e8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.784+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/2508861982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1ee2d0 0x55994b1e8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.784+0000 7f55f4d9a700 1 -- 172.21.15.17:0/2508861982 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55994af67d80 con 0x55994b1e8580 2023-07-14T13:07:30.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.784+0000 7f55f559b700 1 --2- 172.21.15.17:0/2508861982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1ee2d0 0x55994b1e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:30.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.784+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/2508861982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b1e8580 0x55994b1e89d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f55e00cb7b0 tx=0x7f55e006d230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69df561be3a0ecf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.785+0000 7f55f5d9c700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55dc0a12c0 0x7f55dc0a3770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f55e800fb80 tx=0x7f55e8004b40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.785+0000 7f55db7fe700 1 -- 172.21.15.17:0/2508861982 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e009b1c0 con 0x55994b1e8580 2023-07-14T13:07:30.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.785+0000 7f55db7fe700 1 -- 172.21.15.17:0/2508861982 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55e009f1f0 con 0x55994b1e8580 2023-07-14T13:07:30.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.785+0000 7f55db7fe700 1 -- 172.21.15.17:0/2508861982 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e0015e80 con 0x55994b1e8580 2023-07-14T13:07:30.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.785+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2508861982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b1e8580 msgr2=0x55994b1e89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.785+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/2508861982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b1e8580 0x55994b1e89d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f55e00cb7b0 tx=0x7f55e006d230 comp rx=0 tx=0).stop 2023-07-14T13:07:30.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.785+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2508861982 shutdown_connections 2023-07-14T13:07:30.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.785+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/2508861982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b1e8580 0x55994b1e89d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.785+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/2508861982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b0446b0 0x55994b1edd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.786+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/2508861982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1ee2d0 0x55994b1e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.786+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2508861982 >> 172.21.15.17:0/2508861982 conn(0x55994b1ddbe0 msgr2=0x55994b1e2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.786+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2508861982 shutdown_connections 2023-07-14T13:07:30.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.786+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2508861982 wait complete. 2023-07-14T13:07:30.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.786+0000 7f560b1d7b80 1 -- start start 2023-07-14T13:07:30.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.786+0000 7f560b1d7b80 1 Processor -- start 2023-07-14T13:07:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.787+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.787+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1e8580 0x55994b1f7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.787+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1ee2d0 0x55994b1f1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.787+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994b0d9a60 con 0x55994b1e8580 2023-07-14T13:07:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.787+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994b0d9760 con 0x55994b0446b0 2023-07-14T13:07:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.787+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994afbd8c0 con 0x55994b1ee2d0 2023-07-14T13:07:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.787+0000 7f560b1d7b80 10 client.0 _ll_register_callbacks cb 0x55994b0d7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.787+0000 7f55f559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.787+0000 7f55f559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41768/0 (socket says 172.21.15.17:41768) 2023-07-14T13:07:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.787+0000 7f55f559b700 1 -- 172.21.15.17:0/1494490645 learned_addr learned my addr 172.21.15.17:0/1494490645 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.787+0000 7f55f5d9c700 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1ee2d0 0x55994b1f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.788+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1e8580 0x55994b1f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.788+0000 7f55f559b700 1 -- 172.21.15.17:0/1494490645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1ee2d0 msgr2=0x55994b1f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.788+0000 7f55f559b700 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1ee2d0 0x55994b1f1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.788+0000 7f55f559b700 1 -- 172.21.15.17:0/1494490645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1e8580 msgr2=0x55994b1f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.788+0000 7f55f559b700 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1e8580 0x55994b1f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.788+0000 7f55f559b700 1 -- 172.21.15.17:0/1494490645 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ec0078d0 con 0x55994b0446b0 2023-07-14T13:07:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.788+0000 7f55f559b700 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f7310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0116f0 tx=0x7f55ec011a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ea5947c56da6ba4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.788+0000 7f55d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:07:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.788+0000 7f55d8ff9700 1 -- 172.21.15.17:0/1494490645 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec016070 con 0x55994b0446b0 2023-07-14T13:07:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.788+0000 7f560b1d7b80 1 -- 172.21.15.17:0/1494490645 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55994b093490 con 0x55994b0446b0 2023-07-14T13:07:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.788+0000 7f55d8ff9700 1 -- 172.21.15.17:0/1494490645 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f55ec004240 con 0x55994b0446b0 2023-07-14T13:07:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.789+0000 7f55d8ff9700 1 -- 172.21.15.17:0/1494490645 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55ec004400 con 0x55994b0446b0 2023-07-14T13:07:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.789+0000 7f560b1d7b80 10 client.26834 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.789+0000 7f560b1d7b80 1 -- 172.21.15.17:0/1494490645 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f55f01a4b50 con 0x55994b0446b0 2023-07-14T13:07:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.789+0000 7f55d8ff9700 1 -- 172.21.15.17:0/1494490645 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55994b093490 con 0x55994b0446b0 2023-07-14T13:07:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.789+0000 7f55d8ff9700 1 -- 172.21.15.17:0/1494490645 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f55ec01b650 con 0x55994b0446b0 2023-07-14T13:07:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.789+0000 7f560b1d7b80 10 client.26834 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.789+0000 7f560b1d7b80 10 client.26834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.789+0000 7f560b1d7b80 20 client.26834 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.790+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55994b201830 0x55994b203c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.790+0000 7f560b1d7b80 4 client.26834 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:07:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.790+0000 7f560b1d7b80 1 -- 172.21.15.17:0/1494490645 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55994b132e50 con 0x55994b201830 2023-07-14T13:07:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.790+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55994b201830 0x55994b203c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.790+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55994b201830 0x55994b203c40 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7837ce01ce8e5623 server_cookie=9020a96de026a32e in_seq=0 out_seq=0 2023-07-14T13:07:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.790+0000 7f55d8ff9700 10 client.26834 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.791+0000 7f55d8ff9700 1 -- 172.21.15.17:0/1494490645 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55994b132e50 con 0x55994b201830 2023-07-14T13:07:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.791+0000 7f55d8ff9700 10 client.26834 handle_command_reply: tid=0 2023-07-14T13:07:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.791+0000 7f560b1d7b80 1 client.26834 shutdown 2023-07-14T13:07:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.791+0000 7f560b1d7b80 1 -- 172.21.15.17:0/1494490645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 msgr2=0x55994b1f7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.791+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f7310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0116f0 tx=0x7f55ec011a00 comp rx=0 tx=0).stop 2023-07-14T13:07:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.792+0000 7f560b1d7b80 1 -- 172.21.15.17:0/1494490645 shutdown_connections 2023-07-14T13:07:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.792+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55994b201830 0x55994b203c40 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.792+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1ee2d0 0x55994b1f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.792+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f7310 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.792+0000 7f55d8ff9700 0 client.26834 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.792+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/1494490645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1e8580 0x55994b1f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.792+0000 7f560b1d7b80 1 -- 172.21.15.17:0/1494490645 >> 172.21.15.17:0/1494490645 conn(0x55994b1ddbe0 msgr2=0x55994b1e24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.792+0000 7f560b1d7b80 1 -- 172.21.15.17:0/1494490645 shutdown_connections 2023-07-14T13:07:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.792+0000 7f560b1d7b80 1 -- 172.21.15.17:0/1494490645 wait complete. 2023-07-14T13:07:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.792+0000 7f560b1d7b80 20 client.26834 trim_cache size 0 max 16384 2023-07-14T13:07:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.811+0000 7f560b1d7b80 1 Processor -- start 2023-07-14T13:07:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.811+0000 7f560b1d7b80 1 -- start start 2023-07-14T13:07:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1e8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1e8580 0x55994b1f1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1ee2d0 0x55994b1ef010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994b0934c0 con 0x55994b1e8580 2023-07-14T13:07:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994b1e3a30 con 0x55994b0446b0 2023-07-14T13:07:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994b1ae060 con 0x55994b1ee2d0 2023-07-14T13:07:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f55f559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f55f5d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1ee2d0 0x55994b1ef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f55f4d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1e8580 0x55994b1f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f55f559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1e8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41774/0 (socket says 172.21.15.17:41774) 2023-07-14T13:07:30.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f55f559b700 1 -- 172.21.15.17:0/4291978421 learned_addr learned my addr 172.21.15.17:0/4291978421 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f55f5d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1ee2d0 0x55994b1ef010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38966/0 (socket says 172.21.15.17:38966) 2023-07-14T13:07:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f55f4d9a700 1 -- 172.21.15.17:0/4291978421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1ee2d0 msgr2=0x55994b1ef010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/4291978421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1ee2d0 0x55994b1ef010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f55f4d9a700 1 -- 172.21.15.17:0/4291978421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 msgr2=0x55994b1e8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/4291978421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1e8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.812+0000 7f55f4d9a700 1 -- 172.21.15.17:0/4291978421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55994b1e8c40 con 0x55994b1e8580 2023-07-14T13:07:30.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.813+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/4291978421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1e8580 0x55994b1f1690 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f55e00cb7b0 tx=0x7f55e0097500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d766daa9e5b9ae6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.813+0000 7f55dbfff700 1 -- 172.21.15.17:0/4291978421 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e0099560 con 0x55994b1e8580 2023-07-14T13:07:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.813+0000 7f55dbfff700 1 -- 172.21.15.17:0/4291978421 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55e0015d80 con 0x55994b1e8580 2023-07-14T13:07:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.813+0000 7f55dbfff700 1 -- 172.21.15.17:0/4291978421 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00228c0 con 0x55994b1e8580 2023-07-14T13:07:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.814+0000 7f560b1d7b80 1 -- 172.21.15.17:0/4291978421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1e8580 msgr2=0x55994b1f1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.814+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/4291978421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1e8580 0x55994b1f1690 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f55e00cb7b0 tx=0x7f55e0097500 comp rx=0 tx=0).stop 2023-07-14T13:07:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.814+0000 7f560b1d7b80 1 -- 172.21.15.17:0/4291978421 shutdown_connections 2023-07-14T13:07:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.814+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/4291978421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1ee2d0 0x55994b1ef010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.814+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/4291978421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1e8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.814+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/4291978421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1e8580 0x55994b1f1690 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.814+0000 7f560b1d7b80 1 -- 172.21.15.17:0/4291978421 >> 172.21.15.17:0/4291978421 conn(0x55994b1ddbe0 msgr2=0x55994b1ee900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.814+0000 7f560b1d7b80 1 -- 172.21.15.17:0/4291978421 shutdown_connections 2023-07-14T13:07:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.814+0000 7f560b1d7b80 1 -- 172.21.15.17:0/4291978421 wait complete. 2023-07-14T13:07:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.814+0000 7f560b1d7b80 1 -- start start 2023-07-14T13:07:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.815+0000 7f560b1d7b80 1 Processor -- start 2023-07-14T13:07:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.815+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.815+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1e8580 0x55994b1f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.815+0000 7f560b1d7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1ee2d0 0x55994b1f5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.815+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994b254730 con 0x55994b1ee2d0 2023-07-14T13:07:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.815+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994b2548a0 con 0x55994b0446b0 2023-07-14T13:07:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.815+0000 7f560b1d7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994b254a60 con 0x55994b1e8580 2023-07-14T13:07:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.815+0000 7f560b1d7b80 10 client.0 _ll_register_callbacks cb 0x7f55ec007c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f4d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1e8580 0x55994b1f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f4d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1e8580 0x55994b1f53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38974/0 (socket says 172.21.15.17:38974) 2023-07-14T13:07:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41776/0 (socket says 172.21.15.17:41776) 2023-07-14T13:07:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f4d9a700 1 -- 172.21.15.17:0/2834152571 learned_addr learned my addr 172.21.15.17:0/2834152571 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f5d9c700 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1ee2d0 0x55994b1f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f4d9a700 1 -- 172.21.15.17:0/2834152571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 msgr2=0x55994b1f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f4d9a700 1 -- 172.21.15.17:0/2834152571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1ee2d0 msgr2=0x55994b1f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1ee2d0 0x55994b1f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f4d9a700 1 -- 172.21.15.17:0/2834152571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55994af67d80 con 0x55994b1e8580 2023-07-14T13:07:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.816+0000 7f55f559b700 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.817+0000 7f55f4d9a700 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1e8580 0x55994b1f53c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f55e009b150 tx=0x7f55e0005810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=306fea7145528e4b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.817+0000 7f55d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:07:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.817+0000 7f55d8ff9700 1 -- 172.21.15.17:0/2834152571 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e009af90 con 0x55994b1e8580 2023-07-14T13:07:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.817+0000 7f55d8ff9700 1 -- 172.21.15.17:0/2834152571 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f55e0099560 con 0x55994b1e8580 2023-07-14T13:07:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.817+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2834152571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f55e009f1f0 con 0x55994b1e8580 2023-07-14T13:07:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.817+0000 7f55d8ff9700 1 -- 172.21.15.17:0/2834152571 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55e00978d0 con 0x55994b1e8580 2023-07-14T13:07:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.817+0000 7f560b1d7b80 10 client.26809 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.817+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2834152571 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55994af50c00 con 0x55994b1e8580 2023-07-14T13:07:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.817+0000 7f55d8ff9700 1 -- 172.21.15.17:0/2834152571 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55e009f1f0 con 0x55994b1e8580 2023-07-14T13:07:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.817+0000 7f55d8ff9700 1 -- 172.21.15.17:0/2834152571 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f55e009b420 con 0x55994b1e8580 2023-07-14T13:07:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.818+0000 7f560b1d7b80 10 client.26809 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.818+0000 7f560b1d7b80 10 client.26809 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.818+0000 7f560b1d7b80 20 client.26809 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.818+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55994b255cd0 0x55994b2580e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.818+0000 7f560b1d7b80 4 client.26809 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:07:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.818+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2834152571 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55994b0f4ff0 con 0x55994b255cd0 2023-07-14T13:07:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.818+0000 7f55f559b700 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55994b255cd0 0x55994b2580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.819+0000 7f55f559b700 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55994b255cd0 0x55994b2580e0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=402e0b1b9cff90e1 server_cookie=ba91b3987d07c025 in_seq=0 out_seq=0 2023-07-14T13:07:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.819+0000 7f55d8ff9700 10 client.26809 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f55d8ff9700 1 -- 172.21.15.17:0/2834152571 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55994b0f4ff0 con 0x55994b255cd0 2023-07-14T13:07:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f55d8ff9700 10 client.26809 handle_command_reply: tid=0 2023-07-14T13:07:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f560b1d7b80 1 client.26809 shutdown 2023-07-14T13:07:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2834152571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1e8580 msgr2=0x55994b1f53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1e8580 0x55994b1f53c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f55e009b150 tx=0x7f55e0005810 comp rx=0 tx=0).stop 2023-07-14T13:07:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2834152571 shutdown_connections 2023-07-14T13:07:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55994b255cd0 0x55994b2580e0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55994b1ee2d0 0x55994b1f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55994b0446b0 0x55994b1f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f55d8ff9700 0 client.26809 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f560b1d7b80 1 --2- 172.21.15.17:0/2834152571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55994b1e8580 0x55994b1f53c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.832+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2834152571 >> 172.21.15.17:0/2834152571 conn(0x55994b1ddbe0 msgr2=0x55994b1f1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2834152571 shutdown_connections 2023-07-14T13:07:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f560b1d7b80 1 -- 172.21.15.17:0/2834152571 wait complete. 2023-07-14T13:07:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f560b1d7b80 20 client.26809 trim_cache size 0 max 16384 2023-07-14T13:07:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:07:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:07:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:07:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:07:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f55f77ff700 1 -- 172.21.15.17:0/3321879574 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55dc0a12c0 msgr2=0x7f55dc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f55f77ff700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55dc0a12c0 0x7f55dc0a3770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f55e800fb80 tx=0x7f55e8004b40 comp rx=0 tx=0).stop 2023-07-14T13:07:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f55f77ff700 1 -- 172.21.15.17:0/3321879574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f01004e0 msgr2=0x7f55f0198200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f55f77ff700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f01004e0 0x7f55f0198200 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f55e0005910 tx=0x7f55e0005720 comp rx=0 tx=0).stop 2023-07-14T13:07:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f55f77ff700 1 -- 172.21.15.17:0/3321879574 shutdown_connections 2023-07-14T13:07:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f55f77ff700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55dc0a12c0 0x7f55dc0a3770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f55f77ff700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55f0105b60 0x7f55f019b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f55f77ff700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55f00ffb30 0x7f55f0197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f55f77ff700 1 --2- 172.21.15.17:0/3321879574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f01004e0 0x7f55f0198200 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:30.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.833+0000 7f55f77ff700 1 -- 172.21.15.17:0/3321879574 >> 172.21.15.17:0/3321879574 conn(0x7f55f00fb5f0 msgr2=0x7f55f010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.834+0000 7f55f77ff700 1 -- 172.21.15.17:0/3321879574 shutdown_connections 2023-07-14T13:07:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:30.834+0000 7f55f77ff700 1 -- 172.21.15.17:0/3321879574 wait complete. 2023-07-14T13:07:31.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:31 smithi135 ceph-mon[97338]: pgmap v240: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:07:31.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:31 smithi131 ceph-mon[96953]: pgmap v240: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:07:31.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:31 smithi017 ceph-mon[95536]: pgmap v240: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 33 MiB/s wr, 91 op/s 2023-07-14T13:07:32.188 INFO:teuthology.orchestra.run.smithi017.stderr:30200000 of 50000000 tuples (60%) done (elapsed 441.79 s, remaining 289.65 s) 2023-07-14T13:07:33.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:33 smithi135 ceph-mon[97338]: pgmap v241: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:07:33.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:33 smithi131 ceph-mon[96953]: pgmap v241: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:07:33.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:33 smithi017 ceph-mon[95536]: pgmap v241: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:07:33.657 INFO:teuthology.orchestra.run.smithi017.stderr:30300000 of 50000000 tuples (60%) done (elapsed 443.26 s, remaining 288.19 s) 2023-07-14T13:07:35.034 INFO:teuthology.orchestra.run.smithi017.stderr:30400000 of 50000000 tuples (60%) done (elapsed 444.63 s, remaining 286.67 s) 2023-07-14T13:07:35.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:35 smithi135 ceph-mon[97338]: pgmap v242: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:07:35.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:35 smithi131 ceph-mon[96953]: pgmap v242: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:07:35.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:35 smithi017 ceph-mon[95536]: pgmap v242: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:07:36.584 INFO:teuthology.orchestra.run.smithi017.stderr:30500000 of 50000000 tuples (61%) done (elapsed 446.19 s, remaining 285.27 s) 2023-07-14T13:07:37.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:37 smithi135 ceph-mon[97338]: pgmap v243: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 33 MiB/s wr, 108 op/s 2023-07-14T13:07:37.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:37 smithi131 ceph-mon[96953]: pgmap v243: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 33 MiB/s wr, 108 op/s 2023-07-14T13:07:37.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:37 smithi017 ceph-mon[95536]: pgmap v243: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 33 MiB/s wr, 108 op/s 2023-07-14T13:07:37.904 INFO:teuthology.orchestra.run.smithi017.stderr:30600000 of 50000000 tuples (61%) done (elapsed 447.50 s, remaining 283.71 s) 2023-07-14T13:07:39.348 INFO:teuthology.orchestra.run.smithi017.stderr:30700000 of 50000000 tuples (61%) done (elapsed 448.95 s, remaining 282.24 s) 2023-07-14T13:07:39.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:39 smithi135 ceph-mon[97338]: pgmap v244: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:07:39.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:39 smithi131 ceph-mon[96953]: pgmap v244: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:07:39.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:39 smithi017 ceph-mon[95536]: pgmap v244: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:07:40.680 INFO:teuthology.orchestra.run.smithi017.stderr:30800000 of 50000000 tuples (61%) done (elapsed 450.28 s, remaining 280.69 s) 2023-07-14T13:07:41.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:41 smithi135 ceph-mon[97338]: pgmap v245: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 32 MiB/s wr, 97 op/s 2023-07-14T13:07:41.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:41 smithi131 ceph-mon[96953]: pgmap v245: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 32 MiB/s wr, 97 op/s 2023-07-14T13:07:41.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:41 smithi017 ceph-mon[95536]: pgmap v245: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 32 MiB/s wr, 97 op/s 2023-07-14T13:07:41.998 INFO:teuthology.orchestra.run.smithi017.stderr:30900000 of 50000000 tuples (61%) done (elapsed 451.60 s, remaining 279.14 s) 2023-07-14T13:07:43.380 INFO:teuthology.orchestra.run.smithi017.stderr:31000000 of 50000000 tuples (62%) done (elapsed 452.98 s, remaining 277.63 s) 2023-07-14T13:07:43.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:43 smithi135 ceph-mon[97338]: pgmap v246: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 21 MiB/s wr, 75 op/s 2023-07-14T13:07:43.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:43 smithi131 ceph-mon[96953]: pgmap v246: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 21 MiB/s wr, 75 op/s 2023-07-14T13:07:43.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:43 smithi017 ceph-mon[95536]: pgmap v246: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 21 MiB/s wr, 75 op/s 2023-07-14T13:07:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.006+0000 7f8d13fff700 1 -- 172.21.15.17:0/1590050309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d14101e50 msgr2=0x7f8d1410c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.006+0000 7f8d13fff700 1 --2- 172.21.15.17:0/1590050309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d14101e50 0x7f8d1410c8a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00b0a0 tx=0x7f8d0c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.006+0000 7f8d13fff700 1 -- 172.21.15.17:0/1590050309 shutdown_connections 2023-07-14T13:07:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.006+0000 7f8d13fff700 1 --2- 172.21.15.17:0/1590050309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d14101e50 0x7f8d1410c8a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.006+0000 7f8d13fff700 1 --2- 172.21.15.17:0/1590050309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d140ffd20 0x7f8d141000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.006+0000 7f8d13fff700 1 --2- 172.21.15.17:0/1590050309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d141014a0 0x7f8d14101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.006+0000 7f8d13fff700 1 -- 172.21.15.17:0/1590050309 >> 172.21.15.17:0/1590050309 conn(0x7f8d140fb440 msgr2=0x7f8d140fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.006+0000 7f8d13fff700 1 -- 172.21.15.17:0/1590050309 shutdown_connections 2023-07-14T13:07:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.006+0000 7f8d13fff700 1 -- 172.21.15.17:0/1590050309 wait complete. 2023-07-14T13:07:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.007+0000 7f8d13fff700 1 Processor -- start 2023-07-14T13:07:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.007+0000 7f8d13fff700 1 -- start start 2023-07-14T13:07:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d13fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d140ffd20 0x7f8d1419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d13fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d141014a0 0x7f8d1419be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d13fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d14101e50 0x7f8d14195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d13fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d141960d0 con 0x7f8d140ffd20 2023-07-14T13:07:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d13fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14196240 con 0x7f8d14101e50 2023-07-14T13:07:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d13fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14196400 con 0x7f8d141014a0 2023-07-14T13:07:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d140ffd20 0x7f8d1419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d140ffd20 0x7f8d1419b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48354/0 (socket says 172.21.15.17:48354) 2023-07-14T13:07:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d127fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d141014a0 0x7f8d1419be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d12ffd700 1 -- 172.21.15.17:0/2719492512 learned_addr learned my addr 172.21.15.17:0/2719492512 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d137fe700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d14101e50 0x7f8d14195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d12ffd700 1 -- 172.21.15.17:0/2719492512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d141014a0 msgr2=0x7f8d1419be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d141014a0 0x7f8d1419be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d12ffd700 1 -- 172.21.15.17:0/2719492512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d14101e50 msgr2=0x7f8d14195900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:44.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d14101e50 0x7f8d14195900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d12ffd700 1 -- 172.21.15.17:0/2719492512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c009d00 con 0x7f8d140ffd20 2023-07-14T13:07:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.008+0000 7f8d127fc700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d141014a0 0x7f8d1419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.009+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d140ffd20 0x7f8d1419b920 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400e9a0 tx=0x7f8d0400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:44.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.009+0000 7f8cfbfff700 1 -- 172.21.15.17:0/2719492512 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04009790 con 0x7f8d140ffd20 2023-07-14T13:07:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.009+0000 7f8d13fff700 1 -- 172.21.15.17:0/2719492512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d141966e0 con 0x7f8d140ffd20 2023-07-14T13:07:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.009+0000 7f8d13fff700 1 -- 172.21.15.17:0/2719492512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d141a28f0 con 0x7f8d140ffd20 2023-07-14T13:07:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.009+0000 7f8cfbfff700 1 -- 172.21.15.17:0/2719492512 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d04010430 con 0x7f8d140ffd20 2023-07-14T13:07:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.009+0000 7f8cfbfff700 1 -- 172.21.15.17:0/2719492512 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400cea0 con 0x7f8d140ffd20 2023-07-14T13:07:44.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.013+0000 7f8cfbfff700 1 -- 172.21.15.17:0/2719492512 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8d0400ca10 con 0x7f8d140ffd20 2023-07-14T13:07:44.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.014+0000 7f8d2cf57b80 1 Processor -- start 2023-07-14T13:07:44.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.015+0000 7f8d2cf57b80 1 -- start start 2023-07-14T13:07:44.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.015+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea44ca6b0 0x564ea4678340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.015+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea46725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.015+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea4678cd0 0x564ea4672b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.015+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea4573c50 con 0x564ea44ca6b0 2023-07-14T13:07:44.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.015+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea45c69e0 con 0x564ea4678880 2023-07-14T13:07:44.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.015+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea45bfe70 con 0x564ea4678cd0 2023-07-14T13:07:44.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8cfbfff700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cfc0a1340 0x7f8cfc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea46725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea46725b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35510/0 (socket says 172.21.15.17:35510) 2023-07-14T13:07:44.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8d12ffd700 1 -- 172.21.15.17:0/381010565 learned_addr learned my addr 172.21.15.17:0/381010565 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:44.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8d137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea44ca6b0 0x564ea4678340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8d137fe700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cfc0a1340 0x7f8cfc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8cfbfff700 1 -- 172.21.15.17:0/2719492512 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8d04014070 con 0x7f8d140ffd20 2023-07-14T13:07:44.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8d127fc700 1 --2- 172.21.15.17:0/381010565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea4678cd0 0x564ea4672b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8d12ffd700 1 -- 172.21.15.17:0/381010565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea4678cd0 msgr2=0x564ea4672b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:44.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/381010565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea4678cd0 0x564ea4672b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8d12ffd700 1 -- 172.21.15.17:0/381010565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea44ca6b0 msgr2=0x564ea4678340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:44.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/381010565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea44ca6b0 0x564ea4678340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.016+0000 7f8d12ffd700 1 -- 172.21.15.17:0/381010565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ea43edd80 con 0x564ea4678880 2023-07-14T13:07:44.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.017+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/381010565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea46725b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8d04096830 tx=0x7f8d0406be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c711bfbb204179bd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:44.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.017+0000 7f8d137fe700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cfc0a1340 0x7f8cfc0a37f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0062a0 tx=0x7f8d0c006210 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:44.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.017+0000 7f8cf97fa700 1 -- 172.21.15.17:0/381010565 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400ccc0 con 0x564ea4678880 2023-07-14T13:07:44.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.017+0000 7f8cf97fa700 1 -- 172.21.15.17:0/381010565 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d04099dc0 con 0x564ea4678880 2023-07-14T13:07:44.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.017+0000 7f8cf97fa700 1 -- 172.21.15.17:0/381010565 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0409a020 con 0x564ea4678880 2023-07-14T13:07:44.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.018+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/381010565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 msgr2=0x564ea46725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:44.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.018+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/381010565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea46725b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8d04096830 tx=0x7f8d0406be30 comp rx=0 tx=0).stop 2023-07-14T13:07:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.018+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/381010565 shutdown_connections 2023-07-14T13:07:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.018+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/381010565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea4678cd0 0x564ea4672b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.018+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/381010565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea44ca6b0 0x564ea4678340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.018+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/381010565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea46725b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.018+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/381010565 >> 172.21.15.17:0/381010565 conn(0x564ea4663d40 msgr2=0x564ea4669340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.018+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/381010565 shutdown_connections 2023-07-14T13:07:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.018+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/381010565 wait complete. 2023-07-14T13:07:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.019+0000 7f8d2cf57b80 1 -- start start 2023-07-14T13:07:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.019+0000 7f8d2cf57b80 1 Processor -- start 2023-07-14T13:07:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.019+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea44ca6b0 0x564ea467ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.019+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea4678880 0x564ea467be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.019+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea467c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.019+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea455fa60 con 0x564ea4678cd0 2023-07-14T13:07:44.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.019+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea455f760 con 0x564ea44ca6b0 2023-07-14T13:07:44.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.019+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea44438c0 con 0x564ea4678880 2023-07-14T13:07:44.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d2cf57b80 10 client.0 _ll_register_callbacks cb 0x564ea455d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:44.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea44ca6b0 0x564ea467ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea467c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d127fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea4678880 0x564ea467be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea44ca6b0 0x564ea467ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35522/0 (socket says 172.21.15.17:35522) 2023-07-14T13:07:44.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d127fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea4678880 0x564ea467be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50082/0 (socket says 172.21.15.17:50082) 2023-07-14T13:07:44.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d12ffd700 1 -- 172.21.15.17:0/2561743379 learned_addr learned my addr 172.21.15.17:0/2561743379 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:44.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d137fe700 1 -- 172.21.15.17:0/2561743379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea4678880 msgr2=0x564ea467be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:44.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d137fe700 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea4678880 0x564ea467be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d137fe700 1 -- 172.21.15.17:0/2561743379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea44ca6b0 msgr2=0x564ea467ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:44.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d137fe700 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea44ca6b0 0x564ea467ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d137fe700 1 -- 172.21.15.17:0/2561743379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d141a28f0 con 0x564ea4678cd0 2023-07-14T13:07:44.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.020+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea44ca6b0 0x564ea467ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:44.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.021+0000 7f8d137fe700 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea467c530 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009fd0 tx=0x7f8d0c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4d785bbcfe1a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:44.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.021+0000 7f8cf6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:07:44.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.021+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/2561743379 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00e070 con 0x564ea4678cd0 2023-07-14T13:07:44.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.021+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/2561743379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ea4519490 con 0x564ea4678cd0 2023-07-14T13:07:44.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.021+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/2561743379 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8d0c01f640 con 0x564ea4678cd0 2023-07-14T13:07:44.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.021+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/2561743379 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d0c01f800 con 0x564ea4678cd0 2023-07-14T13:07:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.021+0000 7f8d2cf57b80 10 client.17124 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.021+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/2561743379 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x564ea43d6c00 con 0x564ea4678cd0 2023-07-14T13:07:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.022+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/2561743379 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564ea4519490 con 0x564ea4678cd0 2023-07-14T13:07:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.022+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/2561743379 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8d0c0358e0 con 0x564ea4678cd0 2023-07-14T13:07:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.022+0000 7f8d2cf57b80 10 client.17124 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.022+0000 7f8d2cf57b80 10 client.17124 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.022+0000 7f8d2cf57b80 20 client.17124 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.022+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564ea468c270 0x564ea468e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.022+0000 7f8d2cf57b80 4 client.17124 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:07:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.022+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/2561743379 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ea45b8e50 con 0x564ea468c270 2023-07-14T13:07:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.022+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564ea468c270 0x564ea468e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.023+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564ea468c270 0x564ea468e680 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d3dd903f9f02394 server_cookie=ec06e496c0fadb3e in_seq=0 out_seq=0 2023-07-14T13:07:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.023+0000 7f8cf6ff5700 10 client.17124 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.023+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/2561743379 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564ea45b8e50 con 0x564ea468c270 2023-07-14T13:07:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.023+0000 7f8cf6ff5700 10 client.17124 handle_command_reply: tid=0 2023-07-14T13:07:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 1 client.17124 shutdown 2023-07-14T13:07:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/2561743379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 msgr2=0x564ea467c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea467c530 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009fd0 tx=0x7f8d0c0099e0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/2561743379 shutdown_connections 2023-07-14T13:07:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564ea468c270 0x564ea468e680 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea467c530 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea44ca6b0 0x564ea467ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/2561743379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea4678880 0x564ea467be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8cf6ff5700 0 client.17124 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/2561743379 >> 172.21.15.17:0/2561743379 conn(0x564ea4663d40 msgr2=0x564ea4668640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/2561743379 shutdown_connections 2023-07-14T13:07:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/2561743379 wait complete. 2023-07-14T13:07:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.024+0000 7f8d2cf57b80 20 client.17124 trim_cache size 0 max 16384 2023-07-14T13:07:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.042+0000 7f8d2cf57b80 1 Processor -- start 2023-07-14T13:07:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.042+0000 7f8d2cf57b80 1 -- start start 2023-07-14T13:07:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea46832a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea467e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea4674db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea467d020 con 0x564ea4678cd0 2023-07-14T13:07:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea466aba0 con 0x564ea4678880 2023-07-14T13:07:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea4688100 con 0x564ea44ca6b0 2023-07-14T13:07:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea46832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d127fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea467e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d127fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea467e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35538/0 (socket says 172.21.15.17:35538) 2023-07-14T13:07:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea46832a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50090/0 (socket says 172.21.15.17:50090) 2023-07-14T13:07:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d127fc700 1 -- 172.21.15.17:0/4254274331 learned_addr learned my addr 172.21.15.17:0/4254274331 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.043+0000 7f8d137fe700 1 --2- 172.21.15.17:0/4254274331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea4674db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.044+0000 7f8d12ffd700 1 -- 172.21.15.17:0/4254274331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 msgr2=0x564ea467e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.044+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/4254274331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea467e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.044+0000 7f8d12ffd700 1 -- 172.21.15.17:0/4254274331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 msgr2=0x564ea4674db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:44.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.044+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/4254274331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea4674db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.044+0000 7f8d12ffd700 1 -- 172.21.15.17:0/4254274331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ea46932b0 con 0x564ea44ca6b0 2023-07-14T13:07:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.044+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/4254274331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea46832a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400c2d0 tx=0x7f8d04099a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3c08a5adc77c7d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.044+0000 7f8cf9ffb700 1 -- 172.21.15.17:0/4254274331 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d040a2210 con 0x564ea44ca6b0 2023-07-14T13:07:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.044+0000 7f8cf9ffb700 1 -- 172.21.15.17:0/4254274331 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d040860b0 con 0x564ea44ca6b0 2023-07-14T13:07:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.044+0000 7f8cf9ffb700 1 -- 172.21.15.17:0/4254274331 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d040a1fe0 con 0x564ea44ca6b0 2023-07-14T13:07:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.045+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/4254274331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 msgr2=0x564ea46832a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.045+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/4254274331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea46832a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400c2d0 tx=0x7f8d04099a30 comp rx=0 tx=0).stop 2023-07-14T13:07:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.045+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/4254274331 shutdown_connections 2023-07-14T13:07:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.045+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/4254274331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea4674db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.045+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/4254274331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea46832a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.045+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/4254274331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea467e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.045+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/4254274331 >> 172.21.15.17:0/4254274331 conn(0x564ea4663d40 msgr2=0x564ea467be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.045+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/4254274331 shutdown_connections 2023-07-14T13:07:44.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.045+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/4254274331 wait complete. 2023-07-14T13:07:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.046+0000 7f8d2cf57b80 1 -- start start 2023-07-14T13:07:44.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.046+0000 7f8d2cf57b80 1 Processor -- start 2023-07-14T13:07:44.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.046+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea467b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.046+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea467bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.046+0000 7f8d2cf57b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea467a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.046+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea467ab80 con 0x564ea4678cd0 2023-07-14T13:07:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.046+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea467acf0 con 0x564ea4678880 2023-07-14T13:07:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.046+0000 7f8d2cf57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea467aeb0 con 0x564ea44ca6b0 2023-07-14T13:07:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d2cf57b80 10 client.0 _ll_register_callbacks cb 0x564ea455d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea467b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d127fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea467bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d12ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea467b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50094/0 (socket says 172.21.15.17:50094) 2023-07-14T13:07:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d12ffd700 1 -- 172.21.15.17:0/675380330 learned_addr learned my addr 172.21.15.17:0/675380330 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d137fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea467a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d12ffd700 1 -- 172.21.15.17:0/675380330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 msgr2=0x564ea467bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/675380330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea467bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d12ffd700 1 -- 172.21.15.17:0/675380330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 msgr2=0x564ea467a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/675380330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea467a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d12ffd700 1 -- 172.21.15.17:0/675380330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ea43edd80 con 0x564ea44ca6b0 2023-07-14T13:07:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8d12ffd700 1 --2- 172.21.15.17:0/675380330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea467b9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8d04086010 tx=0x7f8d040ccee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc65cbdd8cc214f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.047+0000 7f8cf6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:07:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/675380330 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0409a220 con 0x564ea44ca6b0 2023-07-14T13:07:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/675380330 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8d04086e40 con 0x564ea44ca6b0 2023-07-14T13:07:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/675380330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d04099dc0 con 0x564ea44ca6b0 2023-07-14T13:07:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/675380330 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d040ca1a0 con 0x564ea44ca6b0 2023-07-14T13:07:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8d2cf57b80 10 client.26827 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/675380330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x564ea44141f0 con 0x564ea44ca6b0 2023-07-14T13:07:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/675380330 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d04099dc0 con 0x564ea44ca6b0 2023-07-14T13:07:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/675380330 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8d040cab90 con 0x564ea44ca6b0 2023-07-14T13:07:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8d2cf57b80 10 client.26827 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8d2cf57b80 10 client.26827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8d2cf57b80 20 client.26827 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/675380330 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564ea46e0b80 0x564ea46e2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8d2cf57b80 4 client.26827 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:07:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.048+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/675380330 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564ea457aff0 con 0x564ea46e0b80 2023-07-14T13:07:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.049+0000 7f8d127fc700 1 --2- 172.21.15.17:0/675380330 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564ea46e0b80 0x564ea46e2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.049+0000 7f8cf6ff5700 10 client.26827 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.049+0000 7f8d127fc700 1 --2- 172.21.15.17:0/675380330 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564ea46e0b80 0x564ea46e2f90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6b1a1b4551b3654 server_cookie=f886f1a964af688f in_seq=0 out_seq=0 2023-07-14T13:07:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.065+0000 7f8cf6ff5700 1 -- 172.21.15.17:0/675380330 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564ea457aff0 con 0x564ea46e0b80 2023-07-14T13:07:44.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.065+0000 7f8cf6ff5700 10 client.26827 handle_command_reply: tid=0 2023-07-14T13:07:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.065+0000 7f8d2cf57b80 1 client.26827 shutdown 2023-07-14T13:07:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.065+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/675380330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 msgr2=0x564ea467b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.065+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/675380330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea467b9c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8d04086010 tx=0x7f8d040ccee0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.066+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/675380330 shutdown_connections 2023-07-14T13:07:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.066+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/675380330 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564ea46e0b80 0x564ea46e2f90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.066+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/675380330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564ea4678cd0 0x564ea467a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.066+0000 7f8cf6ff5700 0 client.26827 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.066+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/675380330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ea44ca6b0 0x564ea467b9c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.066+0000 7f8d2cf57b80 1 --2- 172.21.15.17:0/675380330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ea4678880 0x564ea467bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.066+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/675380330 >> 172.21.15.17:0/675380330 conn(0x564ea4663d40 msgr2=0x564ea4679930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.066+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/675380330 shutdown_connections 2023-07-14T13:07:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.066+0000 7f8d2cf57b80 1 -- 172.21.15.17:0/675380330 wait complete. 2023-07-14T13:07:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.066+0000 7f8d2cf57b80 20 client.26827 trim_cache size 0 max 16384 2023-07-14T13:07:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:07:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:07:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:07:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:07:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 -- 172.21.15.17:0/2719492512 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cfc0a1340 msgr2=0x7f8cfc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cfc0a1340 0x7f8cfc0a37f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0062a0 tx=0x7f8d0c006210 comp rx=0 tx=0).stop 2023-07-14T13:07:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 -- 172.21.15.17:0/2719492512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d140ffd20 msgr2=0x7f8d1419b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d140ffd20 0x7f8d1419b920 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400e9a0 tx=0x7f8d0400ecb0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 -- 172.21.15.17:0/2719492512 shutdown_connections 2023-07-14T13:07:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cfc0a1340 0x7f8cfc0a37f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d14101e50 0x7f8d14195900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d140ffd20 0x7f8d1419b920 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 --2- 172.21.15.17:0/2719492512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d141014a0 0x7f8d1419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 -- 172.21.15.17:0/2719492512 >> 172.21.15.17:0/2719492512 conn(0x7f8d140fb440 msgr2=0x7f8d140fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 -- 172.21.15.17:0/2719492512 shutdown_connections 2023-07-14T13:07:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:44.067+0000 7f8d13fff700 1 -- 172.21.15.17:0/2719492512 wait complete. 2023-07-14T13:07:44.716 INFO:teuthology.orchestra.run.smithi017.stderr:31100000 of 50000000 tuples (62%) done (elapsed 454.32 s, remaining 276.10 s) 2023-07-14T13:07:45.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:45 smithi135 ceph-mon[97338]: pgmap v247: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 21 MiB/s wr, 75 op/s 2023-07-14T13:07:45.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:45 smithi131 ceph-mon[96953]: pgmap v247: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 21 MiB/s wr, 75 op/s 2023-07-14T13:07:45.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:45 smithi017 ceph-mon[95536]: pgmap v247: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 21 MiB/s wr, 75 op/s 2023-07-14T13:07:46.026 INFO:teuthology.orchestra.run.smithi017.stderr:31200000 of 50000000 tuples (62%) done (elapsed 455.63 s, remaining 274.54 s) 2023-07-14T13:07:47.337 INFO:teuthology.orchestra.run.smithi017.stderr:31300000 of 50000000 tuples (62%) done (elapsed 456.94 s, remaining 272.99 s) 2023-07-14T13:07:47.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:47 smithi135 ceph-mon[97338]: pgmap v248: 97 pgs: 97 active+clean; 7.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 32 MiB/s wr, 99 op/s 2023-07-14T13:07:47.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:47 smithi131 ceph-mon[96953]: pgmap v248: 97 pgs: 97 active+clean; 7.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 32 MiB/s wr, 99 op/s 2023-07-14T13:07:47.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:47 smithi017 ceph-mon[95536]: pgmap v248: 97 pgs: 97 active+clean; 7.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 32 MiB/s wr, 99 op/s 2023-07-14T13:07:48.722 INFO:teuthology.orchestra.run.smithi017.stderr:31400000 of 50000000 tuples (62%) done (elapsed 458.32 s, remaining 271.49 s) 2023-07-14T13:07:49.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:49 smithi135 ceph-mon[97338]: pgmap v249: 97 pgs: 97 active+clean; 7.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 21 MiB/s wr, 56 op/s 2023-07-14T13:07:49.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:49 smithi131 ceph-mon[96953]: pgmap v249: 97 pgs: 97 active+clean; 7.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 21 MiB/s wr, 56 op/s 2023-07-14T13:07:49.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:49 smithi017 ceph-mon[95536]: pgmap v249: 97 pgs: 97 active+clean; 7.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 21 MiB/s wr, 56 op/s 2023-07-14T13:07:50.039 INFO:teuthology.orchestra.run.smithi017.stderr:31500000 of 50000000 tuples (63%) done (elapsed 459.64 s, remaining 269.95 s) 2023-07-14T13:07:51.337 INFO:teuthology.orchestra.run.smithi017.stderr:31600000 of 50000000 tuples (63%) done (elapsed 460.94 s, remaining 268.39 s) 2023-07-14T13:07:51.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:51 smithi135 ceph-mon[97338]: pgmap v250: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 33 MiB/s wr, 89 op/s 2023-07-14T13:07:51.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:51 smithi131 ceph-mon[96953]: pgmap v250: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 33 MiB/s wr, 89 op/s 2023-07-14T13:07:51.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:51 smithi017 ceph-mon[95536]: pgmap v250: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 33 MiB/s wr, 89 op/s 2023-07-14T13:07:52.723 INFO:teuthology.orchestra.run.smithi017.stderr:31700000 of 50000000 tuples (63%) done (elapsed 462.32 s, remaining 266.89 s) 2023-07-14T13:07:53.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:53 smithi135 ceph-mon[97338]: pgmap v251: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 56 op/s 2023-07-14T13:07:53.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:53 smithi131 ceph-mon[96953]: pgmap v251: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 56 op/s 2023-07-14T13:07:53.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:53 smithi017 ceph-mon[95536]: pgmap v251: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 56 op/s 2023-07-14T13:07:54.052 INFO:teuthology.orchestra.run.smithi017.stderr:31800000 of 50000000 tuples (63%) done (elapsed 463.65 s, remaining 265.36 s) 2023-07-14T13:07:55.403 INFO:teuthology.orchestra.run.smithi017.stderr:31900000 of 50000000 tuples (63%) done (elapsed 465.00 s, remaining 263.84 s) 2023-07-14T13:07:55.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:55 smithi135 ceph-mon[97338]: pgmap v252: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 56 op/s 2023-07-14T13:07:55.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:55 smithi131 ceph-mon[96953]: pgmap v252: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 56 op/s 2023-07-14T13:07:55.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:55 smithi017 ceph-mon[95536]: pgmap v252: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 22 MiB/s wr, 56 op/s 2023-07-14T13:07:56.795 INFO:teuthology.orchestra.run.smithi017.stderr:32000000 of 50000000 tuples (64%) done (elapsed 466.40 s, remaining 262.35 s) 2023-07-14T13:07:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.237+0000 7eff353ff700 1 -- 172.21.15.17:0/2883721917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff30105b10 msgr2=0x7eff30105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.237+0000 7eff353ff700 1 --2- 172.21.15.17:0/2883721917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff30105b10 0x7eff30105ee0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7eff20009990 tx=0x7eff20009ca0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.237+0000 7eff353ff700 1 -- 172.21.15.17:0/2883721917 shutdown_connections 2023-07-14T13:07:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.237+0000 7eff353ff700 1 --2- 172.21.15.17:0/2883721917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff301004b0 0x7eff3010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.237+0000 7eff353ff700 1 --2- 172.21.15.17:0/2883721917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff30105b10 0x7eff30105ee0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.237+0000 7eff353ff700 1 --2- 172.21.15.17:0/2883721917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff300ffb00 0x7eff300fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.237+0000 7eff353ff700 1 -- 172.21.15.17:0/2883721917 >> 172.21.15.17:0/2883721917 conn(0x7eff300fb600 msgr2=0x7eff300fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.237+0000 7eff353ff700 1 -- 172.21.15.17:0/2883721917 shutdown_connections 2023-07-14T13:07:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.237+0000 7eff353ff700 1 -- 172.21.15.17:0/2883721917 wait complete. 2023-07-14T13:07:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.238+0000 7eff353ff700 1 Processor -- start 2023-07-14T13:07:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.238+0000 7eff353ff700 1 -- start start 2023-07-14T13:07:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff353ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff300ffb00 0x7eff30197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff353ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff301004b0 0x7eff301982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff353ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff30105b10 0x7eff3019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff353ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3019cf60 con 0x7eff300ffb00 2023-07-14T13:07:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff353ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3019d0d0 con 0x7eff30105b10 2023-07-14T13:07:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff353ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3019d290 con 0x7eff301004b0 2023-07-14T13:07:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff2e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff301004b0 0x7eff301982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff2effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff300ffb00 0x7eff30197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff2e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff301004b0 0x7eff301982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60188/0 (socket says 172.21.15.17:60188) 2023-07-14T13:07:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff2e7fc700 1 -- 172.21.15.17:0/1368353730 learned_addr learned my addr 172.21.15.17:0/1368353730 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff2f7fe700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff30105b10 0x7eff3019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff2e7fc700 1 -- 172.21.15.17:0/1368353730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff30105b10 msgr2=0x7eff3019c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff30105b10 0x7eff3019c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff2e7fc700 1 -- 172.21.15.17:0/1368353730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff300ffb00 msgr2=0x7eff30197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff300ffb00 0x7eff30197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff2e7fc700 1 -- 172.21.15.17:0/1368353730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff24009520 con 0x7eff301004b0 2023-07-14T13:07:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.239+0000 7eff2effd700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff300ffb00 0x7eff30197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.240+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff301004b0 0x7eff301982b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7eff2400eb30 tx=0x7eff2400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.240+0000 7eff17fff700 1 -- 172.21.15.17:0/1368353730 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24009880 con 0x7eff301004b0 2023-07-14T13:07:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.240+0000 7eff17fff700 1 -- 172.21.15.17:0/1368353730 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff240044b0 con 0x7eff301004b0 2023-07-14T13:07:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.240+0000 7eff353ff700 1 -- 172.21.15.17:0/1368353730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff200095f0 con 0x7eff301004b0 2023-07-14T13:07:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.240+0000 7eff17fff700 1 -- 172.21.15.17:0/1368353730 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24003ce0 con 0x7eff301004b0 2023-07-14T13:07:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.240+0000 7eff353ff700 1 -- 172.21.15.17:0/1368353730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3019d760 con 0x7eff301004b0 2023-07-14T13:07:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.244+0000 7eff17fff700 1 -- 172.21.15.17:0/1368353730 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7eff24003e40 con 0x7eff301004b0 2023-07-14T13:07:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.245+0000 7eff17fff700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7eff180a1340 0x7eff180a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.245+0000 7eff48dd6b80 1 Processor -- start 2023-07-14T13:07:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.245+0000 7eff17fff700 1 -- 172.21.15.17:0/1368353730 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7eff24014070 con 0x7eff301004b0 2023-07-14T13:07:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.246+0000 7eff2effd700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7eff180a1340 0x7eff180a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.246+0000 7eff48dd6b80 1 -- start start 2023-07-14T13:07:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.246+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27268b6b0 0x55d27283d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.246+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d272837850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.246+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283ded0 0x55d272837dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.246+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d272734c50 con 0x55d27268b6b0 2023-07-14T13:07:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.246+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2727879e0 con 0x55d27283da80 2023-07-14T13:07:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.246+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d272780e70 con 0x55d27283ded0 2023-07-14T13:07:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.246+0000 7eff2e7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d272837850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.246+0000 7eff2f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283ded0 0x55d272837dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.246+0000 7eff2e7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d272837850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41582/0 (socket says 172.21.15.17:41582) 2023-07-14T13:07:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.247+0000 7eff2e7fc700 1 -- 172.21.15.17:0/3521523277 learned_addr learned my addr 172.21.15.17:0/3521523277 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.247+0000 7eff2effd700 1 --2- 172.21.15.17:0/3521523277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27268b6b0 0x55d27283d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.247+0000 7eff2effd700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7eff180a1340 0x7eff180a37f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7eff20006010 tx=0x7eff2000bca0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.247+0000 7eff2e7fc700 1 -- 172.21.15.17:0/3521523277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283ded0 msgr2=0x55d272837dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.247+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/3521523277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283ded0 0x55d272837dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.247+0000 7eff2e7fc700 1 -- 172.21.15.17:0/3521523277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27268b6b0 msgr2=0x55d27283d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.247+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/3521523277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27268b6b0 0x55d27283d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.247+0000 7eff2e7fc700 1 -- 172.21.15.17:0/3521523277 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2725aed80 con 0x55d27283da80 2023-07-14T13:07:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.247+0000 7eff2f7fe700 1 --2- 172.21.15.17:0/3521523277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283ded0 0x55d272837dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.247+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/3521523277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d272837850 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7eff240a2160 tx=0x7eff24099eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4d0ca527be56999 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.248+0000 7eff157fa700 1 -- 172.21.15.17:0/3521523277 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2400cbd0 con 0x55d27283da80 2023-07-14T13:07:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.248+0000 7eff157fa700 1 -- 172.21.15.17:0/3521523277 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff2409a240 con 0x55d27283da80 2023-07-14T13:07:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.248+0000 7eff157fa700 1 -- 172.21.15.17:0/3521523277 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24004350 con 0x55d27283da80 2023-07-14T13:07:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.248+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3521523277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 msgr2=0x55d272837850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.248+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3521523277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d272837850 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7eff240a2160 tx=0x7eff24099eb0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.248+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3521523277 shutdown_connections 2023-07-14T13:07:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.248+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3521523277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283ded0 0x55d272837dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.248+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3521523277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27268b6b0 0x55d27283d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.248+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3521523277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d272837850 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.248+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3521523277 >> 172.21.15.17:0/3521523277 conn(0x55d272824be0 msgr2=0x55d272829f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.249+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3521523277 shutdown_connections 2023-07-14T13:07:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.249+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3521523277 wait complete. 2023-07-14T13:07:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.249+0000 7eff48dd6b80 1 -- start start 2023-07-14T13:07:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.250+0000 7eff48dd6b80 1 Processor -- start 2023-07-14T13:07:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.250+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 0x55d272841110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.250+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283da80 0x55d272841650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.250+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 0x55d272841b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.250+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d272720a60 con 0x55d27283ded0 2023-07-14T13:07:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.250+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d272720760 con 0x55d27268b6b0 2023-07-14T13:07:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.250+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2726048c0 con 0x55d27283da80 2023-07-14T13:07:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff48dd6b80 10 client.0 _ll_register_callbacks cb 0x55d27271e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283da80 0x55d272841650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 0x55d272841110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283da80 0x55d272841650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60214/0 (socket says 172.21.15.17:60214) 2023-07-14T13:07:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2e7fc700 1 -- 172.21.15.17:0/2770364867 learned_addr learned my addr 172.21.15.17:0/2770364867 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2f7fe700 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 0x55d272841b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2e7fc700 1 -- 172.21.15.17:0/2770364867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 msgr2=0x55d272841110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 0x55d272841110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2e7fc700 1 -- 172.21.15.17:0/2770364867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 msgr2=0x55d272841b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 0x55d272841b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2e7fc700 1 -- 172.21.15.17:0/2770364867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff28011230 con 0x55d27283da80 2023-07-14T13:07:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2f7fe700 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 0x55d272841b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:07:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283da80 0x55d272841650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7eff24096740 tx=0x7eff240043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c897ea89b9183f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.251+0000 7eff12ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:07:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff12ff5700 1 -- 172.21.15.17:0/2770364867 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2409e270 con 0x55d27283da80 2023-07-14T13:07:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff12ff5700 1 -- 172.21.15.17:0/2770364867 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7eff240a2690 con 0x55d27283da80 2023-07-14T13:07:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff48dd6b80 1 -- 172.21.15.17:0/2770364867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2726da490 con 0x55d27283da80 2023-07-14T13:07:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff12ff5700 1 -- 172.21.15.17:0/2770364867 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff24099940 con 0x55d27283da80 2023-07-14T13:07:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff48dd6b80 10 client.26839 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff48dd6b80 1 -- 172.21.15.17:0/2770364867 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7eff3019d760 con 0x55d27283da80 2023-07-14T13:07:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff12ff5700 1 -- 172.21.15.17:0/2770364867 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d2726da490 con 0x55d27283da80 2023-07-14T13:07:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff12ff5700 1 -- 172.21.15.17:0/2770364867 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7eff24096030 con 0x55d27283da80 2023-07-14T13:07:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff48dd6b80 10 client.26839 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff48dd6b80 10 client.26839 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff48dd6b80 20 client.26839 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.252+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d272850f70 0x55d272853380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.253+0000 7eff48dd6b80 4 client.26839 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:07:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.253+0000 7eff48dd6b80 1 -- 172.21.15.17:0/2770364867 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d272779e50 con 0x55d272850f70 2023-07-14T13:07:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.253+0000 7eff2effd700 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d272850f70 0x55d272853380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.253+0000 7eff2effd700 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d272850f70 0x55d272853380 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ecd70c5481973e7 server_cookie=b4a7471e51c1f0d0 in_seq=0 out_seq=0 2023-07-14T13:07:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.253+0000 7eff12ff5700 10 client.26839 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.254+0000 7eff12ff5700 1 -- 172.21.15.17:0/2770364867 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d272779e50 con 0x55d272850f70 2023-07-14T13:07:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.254+0000 7eff12ff5700 10 client.26839 handle_command_reply: tid=0 2023-07-14T13:07:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.254+0000 7eff48dd6b80 1 client.26839 shutdown 2023-07-14T13:07:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.254+0000 7eff48dd6b80 1 -- 172.21.15.17:0/2770364867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283da80 msgr2=0x55d272841650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.254+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283da80 0x55d272841650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7eff24096740 tx=0x7eff240043d0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.254+0000 7eff48dd6b80 1 -- 172.21.15.17:0/2770364867 shutdown_connections 2023-07-14T13:07:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.254+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d272850f70 0x55d272853380 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.255+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 0x55d272841b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.255+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 0x55d272841110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.255+0000 7eff12ff5700 0 client.26839 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.255+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/2770364867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283da80 0x55d272841650 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.255+0000 7eff48dd6b80 1 -- 172.21.15.17:0/2770364867 >> 172.21.15.17:0/2770364867 conn(0x55d272824be0 msgr2=0x55d2728294e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.255+0000 7eff48dd6b80 1 -- 172.21.15.17:0/2770364867 shutdown_connections 2023-07-14T13:07:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.255+0000 7eff48dd6b80 1 -- 172.21.15.17:0/2770364867 wait complete. 2023-07-14T13:07:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.255+0000 7eff48dd6b80 20 client.26839 trim_cache size 0 max 16384 2023-07-14T13:07:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.271+0000 7eff48dd6b80 1 Processor -- start 2023-07-14T13:07:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff48dd6b80 1 -- start start 2023-07-14T13:07:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27268b6b0 0x55d2728484a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d27283e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 0x55d27283e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d272821e40 con 0x55d27283ded0 2023-07-14T13:07:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d272779e80 con 0x55d27283da80 2023-07-14T13:07:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d27282b020 con 0x55d27268b6b0 2023-07-14T13:07:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff2e7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d27283e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff2effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27268b6b0 0x55d2728484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff2e7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d27283e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41598/0 (socket says 172.21.15.17:41598) 2023-07-14T13:07:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff2effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27268b6b0 0x55d2728484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60230/0 (socket says 172.21.15.17:60230) 2023-07-14T13:07:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff2e7fc700 1 -- 172.21.15.17:0/3469639588 learned_addr learned my addr 172.21.15.17:0/3469639588 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.272+0000 7eff2f7fe700 1 --2- 172.21.15.17:0/3469639588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 0x55d27283e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.273+0000 7eff2effd700 1 -- 172.21.15.17:0/3469639588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 msgr2=0x55d27283e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.273+0000 7eff2effd700 1 --2- 172.21.15.17:0/3469639588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d27283e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.273+0000 7eff2effd700 1 -- 172.21.15.17:0/3469639588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 msgr2=0x55d27283e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.273+0000 7eff2effd700 1 --2- 172.21.15.17:0/3469639588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 0x55d27283e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.273+0000 7eff2effd700 1 -- 172.21.15.17:0/3469639588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d272840c80 con 0x55d27268b6b0 2023-07-14T13:07:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.273+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/3469639588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d27283e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:07:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.273+0000 7eff2f7fe700 1 --2- 172.21.15.17:0/3469639588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 0x55d27283e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:07:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.273+0000 7eff2effd700 1 --2- 172.21.15.17:0/3469639588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27268b6b0 0x55d2728484a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7eff20005910 tx=0x7eff20022000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1c9dba3afc0eb51 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.273+0000 7eff15ffb700 1 -- 172.21.15.17:0/3469639588 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2002b040 con 0x55d27268b6b0 2023-07-14T13:07:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.273+0000 7eff15ffb700 1 -- 172.21.15.17:0/3469639588 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff2001e040 con 0x55d27268b6b0 2023-07-14T13:07:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.273+0000 7eff15ffb700 1 -- 172.21.15.17:0/3469639588 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000f480 con 0x55d27268b6b0 2023-07-14T13:07:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.274+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3469639588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27268b6b0 msgr2=0x55d2728484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.274+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3469639588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27268b6b0 0x55d2728484a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7eff20005910 tx=0x7eff20022000 comp rx=0 tx=0).stop 2023-07-14T13:07:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.274+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3469639588 shutdown_connections 2023-07-14T13:07:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.274+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3469639588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283ded0 0x55d27283e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.274+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3469639588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27268b6b0 0x55d2728484a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.274+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3469639588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27283da80 0x55d27283e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.274+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3469639588 >> 172.21.15.17:0/3469639588 conn(0x55d272824be0 msgr2=0x55d27283b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.274+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3469639588 shutdown_connections 2023-07-14T13:07:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.274+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3469639588 wait complete. 2023-07-14T13:07:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.275+0000 7eff48dd6b80 1 -- start start 2023-07-14T13:07:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.275+0000 7eff48dd6b80 1 Processor -- start 2023-07-14T13:07:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 0x55d27289e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283da80 0x55d27289e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff48dd6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283ded0 0x55d272846490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d272846a60 con 0x55d27283da80 2023-07-14T13:07:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d272846bd0 con 0x55d27268b6b0 2023-07-14T13:07:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff48dd6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d272846d90 con 0x55d27283ded0 2023-07-14T13:07:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff48dd6b80 10 client.0 _ll_register_callbacks cb 0x7eff28009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:07:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff2e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283da80 0x55d27289e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff2effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 0x55d27289e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff2effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 0x55d27289e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41610/0 (socket says 172.21.15.17:41610) 2023-07-14T13:07:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff2effd700 1 -- 172.21.15.17:0/3415317627 learned_addr learned my addr 172.21.15.17:0/3415317627 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:07:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff2f7fe700 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283ded0 0x55d272846490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.276+0000 7eff2effd700 1 -- 172.21.15.17:0/3415317627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283ded0 msgr2=0x55d272846490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.277+0000 7eff2effd700 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283ded0 0x55d272846490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.277+0000 7eff2effd700 1 -- 172.21.15.17:0/3415317627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283da80 msgr2=0x55d27289e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:07:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.277+0000 7eff2effd700 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283da80 0x55d27289e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.277+0000 7eff2effd700 1 -- 172.21.15.17:0/3415317627 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3019d760 con 0x55d27268b6b0 2023-07-14T13:07:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.277+0000 7eff2effd700 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 0x55d27289e130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7eff2000b2a0 tx=0x7eff20033420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b212a30502e6798 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:07:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.277+0000 7eff12ff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:07:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.277+0000 7eff12ff5700 1 -- 172.21.15.17:0/3415317627 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20033a40 con 0x55d27268b6b0 2023-07-14T13:07:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.277+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3415317627 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff2409a240 con 0x55d27268b6b0 2023-07-14T13:07:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.277+0000 7eff12ff5700 1 -- 172.21.15.17:0/3415317627 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7eff20033ba0 con 0x55d27268b6b0 2023-07-14T13:07:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.278+0000 7eff12ff5700 1 -- 172.21.15.17:0/3415317627 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff20033d60 con 0x55d27268b6b0 2023-07-14T13:07:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.278+0000 7eff48dd6b80 10 client.26876 fetch_fsmap learned FSMap version 31 2023-07-14T13:07:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.278+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3415317627 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7eff3010d240 con 0x55d27268b6b0 2023-07-14T13:07:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.278+0000 7eff12ff5700 1 -- 172.21.15.17:0/3415317627 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff2409a240 con 0x55d27268b6b0 2023-07-14T13:07:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.278+0000 7eff12ff5700 1 -- 172.21.15.17:0/3415317627 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7eff2000f460 con 0x55d27268b6b0 2023-07-14T13:07:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.278+0000 7eff48dd6b80 10 client.26876 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:07:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.278+0000 7eff48dd6b80 10 client.26876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:07:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.278+0000 7eff48dd6b80 20 client.26876 populate_metadata read hostname 'smithi017' 2023-07-14T13:07:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.278+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d2728a5a50 0x55d2728a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:07:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.278+0000 7eff48dd6b80 4 client.26876 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:07:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.278+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3415317627 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d27273bff0 con 0x55d2728a5a50 2023-07-14T13:07:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.279+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d2728a5a50 0x55d2728a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:07:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.279+0000 7eff2e7fc700 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d2728a5a50 0x55d2728a7e30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51511a92820bffdb server_cookie=d7c0aaad750b8c73 in_seq=0 out_seq=0 2023-07-14T13:07:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.279+0000 7eff12ff5700 10 client.26876 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff12ff5700 1 -- 172.21.15.17:0/3415317627 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d27273bff0 con 0x55d2728a5a50 2023-07-14T13:07:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff12ff5700 10 client.26876 handle_command_reply: tid=0 2023-07-14T13:07:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff48dd6b80 1 client.26876 shutdown 2023-07-14T13:07:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3415317627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 msgr2=0x55d27289e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 0x55d27289e130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7eff2000b2a0 tx=0x7eff20033420 comp rx=0 tx=0).stop 2023-07-14T13:07:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3415317627 shutdown_connections 2023-07-14T13:07:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d2728a5a50 0x55d2728a7e30 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d27283ded0 0x55d272846490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d27268b6b0 0x55d27289e130 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff48dd6b80 1 --2- 172.21.15.17:0/3415317627 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d27283da80 0x55d27289e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff12ff5700 0 client.26876 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:07:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3415317627 >> 172.21.15.17:0/3415317627 conn(0x55d272824be0 msgr2=0x55d27283c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3415317627 shutdown_connections 2023-07-14T13:07:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.293+0000 7eff48dd6b80 1 -- 172.21.15.17:0/3415317627 wait complete. 2023-07-14T13:07:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.294+0000 7eff48dd6b80 20 client.26876 trim_cache size 0 max 16384 2023-07-14T13:07:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:07:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:07:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:07:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:07:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.294+0000 7eff353ff700 1 -- 172.21.15.17:0/1368353730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7eff180a1340 msgr2=0x7eff180a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.294+0000 7eff353ff700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7eff180a1340 0x7eff180a37f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7eff20006010 tx=0x7eff2000bca0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.294+0000 7eff353ff700 1 -- 172.21.15.17:0/1368353730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff301004b0 msgr2=0x7eff301982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:07:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.294+0000 7eff353ff700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff301004b0 0x7eff301982b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7eff2400eb30 tx=0x7eff2400ee40 comp rx=0 tx=0).stop 2023-07-14T13:07:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.295+0000 7eff353ff700 1 -- 172.21.15.17:0/1368353730 shutdown_connections 2023-07-14T13:07:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.295+0000 7eff353ff700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7eff180a1340 0x7eff180a37f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.295+0000 7eff353ff700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff30105b10 0x7eff3019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.295+0000 7eff353ff700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff300ffb00 0x7eff30197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.295+0000 7eff353ff700 1 --2- 172.21.15.17:0/1368353730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff301004b0 0x7eff301982b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:07:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.295+0000 7eff353ff700 1 -- 172.21.15.17:0/1368353730 >> 172.21.15.17:0/1368353730 conn(0x7eff300fb600 msgr2=0x7eff3010aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:07:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.295+0000 7eff353ff700 1 -- 172.21.15.17:0/1368353730 shutdown_connections 2023-07-14T13:07:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:07:57.295+0000 7eff353ff700 1 -- 172.21.15.17:0/1368353730 wait complete. 2023-07-14T13:07:57.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:57 smithi135 ceph-mon[97338]: pgmap v253: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 MiB/s wr, 89 op/s 2023-07-14T13:07:57.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:57 smithi131 ceph-mon[96953]: pgmap v253: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 MiB/s wr, 89 op/s 2023-07-14T13:07:57.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:57 smithi017 ceph-mon[95536]: pgmap v253: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 MiB/s wr, 89 op/s 2023-07-14T13:07:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:32100000 of 50000000 tuples (64%) done (elapsed 467.70 s, remaining 260.81 s) 2023-07-14T13:07:59.387 INFO:teuthology.orchestra.run.smithi017.stderr:32200000 of 50000000 tuples (64%) done (elapsed 468.99 s, remaining 259.25 s) 2023-07-14T13:07:59.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:07:59 smithi135 ceph-mon[97338]: pgmap v254: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 64 op/s 2023-07-14T13:07:59.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:07:59 smithi131 ceph-mon[96953]: pgmap v254: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 64 op/s 2023-07-14T13:07:59.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:07:59 smithi017 ceph-mon[95536]: pgmap v254: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 MiB/s wr, 64 op/s 2023-07-14T13:08:00.680 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:08:00.743 INFO:teuthology.orchestra.run.smithi017.stderr:32300000 of 50000000 tuples (64%) done (elapsed 470.34 s, remaining 257.74 s) 2023-07-14T13:08:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.876+0000 7f2636fff700 1 -- 172.21.15.17:0/1989388303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630102910 msgr2=0x7f26301068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.876+0000 7f2636fff700 1 --2- 172.21.15.17:0/1989388303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630102910 0x7f26301068d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f261c0099c0 tx=0x7f261c009cd0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.876+0000 7f2636fff700 1 -- 172.21.15.17:0/1989388303 shutdown_connections 2023-07-14T13:08:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.876+0000 7f2636fff700 1 --2- 172.21.15.17:0/1989388303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2630106fb0 0x7f263010eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.877+0000 7f2636fff700 1 --2- 172.21.15.17:0/1989388303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2630101f70 0x7f2630102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.877+0000 7f2636fff700 1 --2- 172.21.15.17:0/1989388303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630102910 0x7f26301068d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.877+0000 7f2636fff700 1 -- 172.21.15.17:0/1989388303 >> 172.21.15.17:0/1989388303 conn(0x7f26300fd7e0 msgr2=0x7f26300ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.877+0000 7f2636fff700 1 -- 172.21.15.17:0/1989388303 shutdown_connections 2023-07-14T13:08:00.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.877+0000 7f2636fff700 1 -- 172.21.15.17:0/1989388303 wait complete. 2023-07-14T13:08:00.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.878+0000 7f2636fff700 1 Processor -- start 2023-07-14T13:08:00.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.878+0000 7f2636fff700 1 -- start start 2023-07-14T13:08:00.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.879+0000 7f2636fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2630101f70 0x7f2630197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.879+0000 7f2636fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630102910 0x7f26301982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.879+0000 7f2636fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2630106fb0 0x7f263019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.879+0000 7f2636fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263019cd40 con 0x7f2630106fb0 2023-07-14T13:08:00.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.879+0000 7f2636fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263019ceb0 con 0x7f2630101f70 2023-07-14T13:08:00.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.879+0000 7f2636fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263019d070 con 0x7f2630102910 2023-07-14T13:08:00.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.879+0000 7f2634d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2630101f70 0x7f2630197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.879+0000 7f263559c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2630106fb0 0x7f263019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.879+0000 7f262ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630102910 0x7f26301982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.879+0000 7f2634d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2630101f70 0x7f2630197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41622/0 (socket says 172.21.15.17:41622) 2023-07-14T13:08:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.879+0000 7f2634d9b700 1 -- 172.21.15.17:0/2990434165 learned_addr learned my addr 172.21.15.17:0/2990434165 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.880+0000 7f262ffff700 1 -- 172.21.15.17:0/2990434165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2630101f70 msgr2=0x7f2630197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.880+0000 7f262ffff700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2630101f70 0x7f2630197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.880+0000 7f262ffff700 1 -- 172.21.15.17:0/2990434165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2630106fb0 msgr2=0x7f263019c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.880+0000 7f262ffff700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2630106fb0 0x7f263019c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.880+0000 7f262ffff700 1 -- 172.21.15.17:0/2990434165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0095f0 con 0x7f2630102910 2023-07-14T13:08:00.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.880+0000 7f263559c700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2630106fb0 0x7f263019c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.880+0000 7f262ffff700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630102910 0x7f26301982a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f261c0098e0 tx=0x7f261c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.880+0000 7f262dffb700 1 -- 172.21.15.17:0/2990434165 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c01d070 con 0x7f2630102910 2023-07-14T13:08:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.881+0000 7f262dffb700 1 -- 172.21.15.17:0/2990434165 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f261c005050 con 0x7f2630102910 2023-07-14T13:08:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.881+0000 7f262dffb700 1 -- 172.21.15.17:0/2990434165 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c004970 con 0x7f2630102910 2023-07-14T13:08:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.881+0000 7f2636fff700 1 -- 172.21.15.17:0/2990434165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263019d2f0 con 0x7f2630102910 2023-07-14T13:08:00.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.881+0000 7f2636fff700 1 -- 172.21.15.17:0/2990434165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263019d570 con 0x7f2630102910 2023-07-14T13:08:00.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.885+0000 7f262dffb700 1 -- 172.21.15.17:0/2990434165 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f261c005430 con 0x7f2630102910 2023-07-14T13:08:00.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.886+0000 7f262dffb700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f26200a1340 0x7f26200a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.886+0000 7f262dffb700 1 -- 172.21.15.17:0/2990434165 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f261c0cd690 con 0x7f2630102910 2023-07-14T13:08:00.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.886+0000 7f2634d9b700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f26200a1340 0x7f26200a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.887+0000 7f264a832b80 1 Processor -- start 2023-07-14T13:08:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.887+0000 7f264a832b80 1 -- start start 2023-07-14T13:08:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.887+0000 7f264a832b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 0x55ba126ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.887+0000 7f264a832b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126f9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.887+0000 7f264a832b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126f9ad0 0x55ba126fbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.887+0000 7f264a832b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba125f4cb0 con 0x55ba126ee2d0 2023-07-14T13:08:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.887+0000 7f264a832b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba12647a40 con 0x55ba126eebe0 2023-07-14T13:08:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.887+0000 7f264a832b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba12640ed0 con 0x55ba126f9ad0 2023-07-14T13:08:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.887+0000 7f2634d9b700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f26200a1340 0x7f26200a37f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2624009d20 tx=0x7f2624009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f2634d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 0x55ba126ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f2634d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 0x55ba126ee6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36310/0 (socket says 172.21.15.17:36310) 2023-07-14T13:08:00.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f2634d9b700 1 -- 172.21.15.17:0/1738892677 learned_addr learned my addr 172.21.15.17:0/1738892677 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f262ffff700 1 --2- 172.21.15.17:0/1738892677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f263559c700 1 --2- 172.21.15.17:0/1738892677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126f9ad0 0x55ba126fbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f262ffff700 1 -- 172.21.15.17:0/1738892677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126f9ad0 msgr2=0x55ba126fbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f262ffff700 1 --2- 172.21.15.17:0/1738892677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126f9ad0 0x55ba126fbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f262ffff700 1 -- 172.21.15.17:0/1738892677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 msgr2=0x55ba126ee6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f262ffff700 1 --2- 172.21.15.17:0/1738892677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 0x55ba126ee6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f262ffff700 1 -- 172.21.15.17:0/1738892677 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba1246ede0 con 0x55ba126eebe0 2023-07-14T13:08:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f2634d9b700 1 --2- 172.21.15.17:0/1738892677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 0x55ba126ee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.888+0000 7f262ffff700 1 --2- 172.21.15.17:0/1738892677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126f9590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f261c0cada0 tx=0x7f261c09a690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6184231c4e2b265d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:00.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.889+0000 7f261affd700 1 -- 172.21.15.17:0/1738892677 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c09e7e0 con 0x55ba126eebe0 2023-07-14T13:08:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.889+0000 7f261affd700 1 -- 172.21.15.17:0/1738892677 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f261c0a2b70 con 0x55ba126eebe0 2023-07-14T13:08:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.889+0000 7f261affd700 1 -- 172.21.15.17:0/1738892677 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c09aa10 con 0x55ba126eebe0 2023-07-14T13:08:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.889+0000 7f264a832b80 1 -- 172.21.15.17:0/1738892677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 msgr2=0x55ba126f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.889+0000 7f264a832b80 1 --2- 172.21.15.17:0/1738892677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126f9590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f261c0cada0 tx=0x7f261c09a690 comp rx=0 tx=0).stop 2023-07-14T13:08:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.890+0000 7f264a832b80 1 -- 172.21.15.17:0/1738892677 shutdown_connections 2023-07-14T13:08:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.890+0000 7f264a832b80 1 --2- 172.21.15.17:0/1738892677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126f9ad0 0x55ba126fbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.890+0000 7f264a832b80 1 --2- 172.21.15.17:0/1738892677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 0x55ba126ee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.890+0000 7f264a832b80 1 --2- 172.21.15.17:0/1738892677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126f9590 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.890+0000 7f264a832b80 1 -- 172.21.15.17:0/1738892677 >> 172.21.15.17:0/1738892677 conn(0x55ba126e4da0 msgr2=0x55ba126ea6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:00.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.890+0000 7f264a832b80 1 -- 172.21.15.17:0/1738892677 shutdown_connections 2023-07-14T13:08:00.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.890+0000 7f264a832b80 1 -- 172.21.15.17:0/1738892677 wait complete. 2023-07-14T13:08:00.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.890+0000 7f264a832b80 1 -- start start 2023-07-14T13:08:00.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.891+0000 7f264a832b80 1 Processor -- start 2023-07-14T13:08:00.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.891+0000 7f264a832b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 0x55ba126feb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.891+0000 7f264a832b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126ff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.891+0000 7f264a832b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126f9ad0 0x55ba126f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.891+0000 7f264a832b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba125e0ac0 con 0x55ba126ee2d0 2023-07-14T13:08:00.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.891+0000 7f264a832b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba125e07c0 con 0x55ba126eebe0 2023-07-14T13:08:00.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.891+0000 7f264a832b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba124c4920 con 0x55ba126f9ad0 2023-07-14T13:08:00.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.892+0000 7f264a832b80 10 client.0 _ll_register_callbacks cb 0x55ba125de760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:00.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.892+0000 7f262ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.892+0000 7f263559c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126f9ad0 0x55ba126f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.892+0000 7f2634d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 0x55ba126feb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.892+0000 7f262ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126ff090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41632/0 (socket says 172.21.15.17:41632) 2023-07-14T13:08:00.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.892+0000 7f262ffff700 1 -- 172.21.15.17:0/430254538 learned_addr learned my addr 172.21.15.17:0/430254538 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:00.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.892+0000 7f262ffff700 1 -- 172.21.15.17:0/430254538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126f9ad0 msgr2=0x55ba126f8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:00.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.892+0000 7f262ffff700 1 --2- 172.21.15.17:0/430254538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126f9ad0 0x55ba126f8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.892+0000 7f262ffff700 1 -- 172.21.15.17:0/430254538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 msgr2=0x55ba126feb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.892+0000 7f262ffff700 1 --2- 172.21.15.17:0/430254538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 0x55ba126feb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.892+0000 7f262ffff700 1 -- 172.21.15.17:0/430254538 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2624017070 con 0x55ba126eebe0 2023-07-14T13:08:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.893+0000 7f262ffff700 1 --2- 172.21.15.17:0/430254538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126ff090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f261c009fd0 tx=0x7f261c09e7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33348960af7ccf37 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.893+0000 7f260ffff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:08:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.893+0000 7f260ffff700 1 -- 172.21.15.17:0/430254538 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c099ea0 con 0x55ba126eebe0 2023-07-14T13:08:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.893+0000 7f260ffff700 1 -- 172.21.15.17:0/430254538 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f261c098c10 con 0x55ba126eebe0 2023-07-14T13:08:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.893+0000 7f264a832b80 1 -- 172.21.15.17:0/430254538 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba1259a4f0 con 0x55ba126eebe0 2023-07-14T13:08:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.893+0000 7f260ffff700 1 -- 172.21.15.17:0/430254538 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f261c09aa10 con 0x55ba126eebe0 2023-07-14T13:08:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.893+0000 7f264a832b80 10 client.26888 fetch_fsmap learned FSMap version 31 2023-07-14T13:08:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.893+0000 7f264a832b80 1 -- 172.21.15.17:0/430254538 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f263019d2f0 con 0x55ba126eebe0 2023-07-14T13:08:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.893+0000 7f260ffff700 1 -- 172.21.15.17:0/430254538 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ba1259a4f0 con 0x55ba126eebe0 2023-07-14T13:08:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.893+0000 7f260ffff700 1 -- 172.21.15.17:0/430254538 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f261c004ad0 con 0x55ba126eebe0 2023-07-14T13:08:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.894+0000 7f264a832b80 10 client.26888 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:08:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.894+0000 7f264a832b80 10 client.26888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.894+0000 7f264a832b80 20 client.26888 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:00.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.894+0000 7f264a832b80 1 --2- 172.21.15.17:0/430254538 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ba12708b10 0x55ba1270aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.894+0000 7f264a832b80 4 client.26888 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:08:00.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.894+0000 7f264a832b80 1 -- 172.21.15.17:0/430254538 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba12639eb0 con 0x55ba12708b10 2023-07-14T13:08:00.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.894+0000 7f2634d9b700 1 --2- 172.21.15.17:0/430254538 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ba12708b10 0x55ba1270aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.895+0000 7f2634d9b700 1 --2- 172.21.15.17:0/430254538 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ba12708b10 0x55ba1270aef0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b60e05804ce12094 server_cookie=d2f8efdfdeb85fa5 in_seq=0 out_seq=0 2023-07-14T13:08:00.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.895+0000 7f260ffff700 10 client.26888 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:00.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.895+0000 7f260ffff700 1 -- 172.21.15.17:0/430254538 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ba12639eb0 con 0x55ba12708b10 2023-07-14T13:08:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f260ffff700 10 client.26888 handle_command_reply: tid=0 2023-07-14T13:08:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 1 client.26888 shutdown 2023-07-14T13:08:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 1 -- 172.21.15.17:0/430254538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 msgr2=0x55ba126ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 1 --2- 172.21.15.17:0/430254538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126ff090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f261c009fd0 tx=0x7f261c09e7e0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 1 -- 172.21.15.17:0/430254538 shutdown_connections 2023-07-14T13:08:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 1 --2- 172.21.15.17:0/430254538 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ba12708b10 0x55ba1270aef0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 1 --2- 172.21.15.17:0/430254538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126f9ad0 0x55ba126f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 1 --2- 172.21.15.17:0/430254538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126ee2d0 0x55ba126feb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f260ffff700 0 client.26888 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 1 --2- 172.21.15.17:0/430254538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126ff090 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 1 -- 172.21.15.17:0/430254538 >> 172.21.15.17:0/430254538 conn(0x55ba126e4da0 msgr2=0x55ba126ea290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 1 -- 172.21.15.17:0/430254538 shutdown_connections 2023-07-14T13:08:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 1 -- 172.21.15.17:0/430254538 wait complete. 2023-07-14T13:08:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.896+0000 7f264a832b80 20 client.26888 trim_cache size 0 max 16384 2023-07-14T13:08:00.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.918+0000 7f264a832b80 1 Processor -- start 2023-07-14T13:08:00.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.918+0000 7f264a832b80 1 -- start start 2023-07-14T13:08:00.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.918+0000 7f264a832b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 0x55ba126ea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.918+0000 7f264a832b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126ea710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.918+0000 7f264a832b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 0x55ba126f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.918+0000 7f264a832b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba126ebd50 con 0x55ba126f9ad0 2023-07-14T13:08:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.918+0000 7f264a832b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba126ef570 con 0x55ba126eebe0 2023-07-14T13:08:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.918+0000 7f264a832b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba126eb3b0 con 0x55ba126ee2d0 2023-07-14T13:08:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.918+0000 7f263559c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 0x55ba126f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.919+0000 7f263559c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 0x55ba126f82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36332/0 (socket says 172.21.15.17:36332) 2023-07-14T13:08:00.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.919+0000 7f2634d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 0x55ba126ea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.919+0000 7f263559c700 1 -- 172.21.15.17:0/2170928302 learned_addr learned my addr 172.21.15.17:0/2170928302 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:00.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.919+0000 7f262ffff700 1 --2- 172.21.15.17:0/2170928302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126ea710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.919+0000 7f263559c700 1 -- 172.21.15.17:0/2170928302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 msgr2=0x55ba126ea1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:00.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.919+0000 7f263559c700 1 --2- 172.21.15.17:0/2170928302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 0x55ba126ea1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.919+0000 7f263559c700 1 -- 172.21.15.17:0/2170928302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 msgr2=0x55ba126ea710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:00.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.919+0000 7f263559c700 1 --2- 172.21.15.17:0/2170928302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126ea710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.919+0000 7f263559c700 1 -- 172.21.15.17:0/2170928302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba12457c60 con 0x55ba126f9ad0 2023-07-14T13:08:00.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.919+0000 7f262ffff700 1 --2- 172.21.15.17:0/2170928302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126ea710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.919+0000 7f263559c700 1 --2- 172.21.15.17:0/2170928302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 0x55ba126f82a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f262800eaf0 tx=0x7f2628009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7ca505627bf33a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.920+0000 7f261b7fe700 1 -- 172.21.15.17:0/2170928302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628017880 con 0x55ba126f9ad0 2023-07-14T13:08:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.920+0000 7f261b7fe700 1 -- 172.21.15.17:0/2170928302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f262800f040 con 0x55ba126f9ad0 2023-07-14T13:08:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.920+0000 7f261b7fe700 1 -- 172.21.15.17:0/2170928302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628007d40 con 0x55ba126f9ad0 2023-07-14T13:08:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.921+0000 7f264a832b80 1 -- 172.21.15.17:0/2170928302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 msgr2=0x55ba126f82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.921+0000 7f264a832b80 1 --2- 172.21.15.17:0/2170928302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 0x55ba126f82a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f262800eaf0 tx=0x7f2628009920 comp rx=0 tx=0).stop 2023-07-14T13:08:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.921+0000 7f264a832b80 1 -- 172.21.15.17:0/2170928302 shutdown_connections 2023-07-14T13:08:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.921+0000 7f264a832b80 1 --2- 172.21.15.17:0/2170928302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 0x55ba126f82a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.921+0000 7f264a832b80 1 --2- 172.21.15.17:0/2170928302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 0x55ba126ea1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.921+0000 7f264a832b80 1 --2- 172.21.15.17:0/2170928302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba126ea710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.921+0000 7f264a832b80 1 -- 172.21.15.17:0/2170928302 >> 172.21.15.17:0/2170928302 conn(0x55ba126e4da0 msgr2=0x55ba126f3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.921+0000 7f264a832b80 1 -- 172.21.15.17:0/2170928302 shutdown_connections 2023-07-14T13:08:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.921+0000 7f264a832b80 1 -- 172.21.15.17:0/2170928302 wait complete. 2023-07-14T13:08:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.921+0000 7f264a832b80 1 -- start start 2023-07-14T13:08:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.921+0000 7f264a832b80 1 Processor -- start 2023-07-14T13:08:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f264a832b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 0x55ba127562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f264a832b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba127567e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f264a832b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 0x55ba12750930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f264a832b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba12751040 con 0x55ba126f9ad0 2023-07-14T13:08:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f264a832b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba127511b0 con 0x55ba126eebe0 2023-07-14T13:08:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f264a832b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba12751370 con 0x55ba126ee2d0 2023-07-14T13:08:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f264a832b80 10 client.0 _ll_register_callbacks cb 0x7f2624009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f2634d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 0x55ba127562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f263559c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 0x55ba12750930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f262ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba127567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f2634d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 0x55ba127562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60306/0 (socket says 172.21.15.17:60306) 2023-07-14T13:08:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.922+0000 7f2634d9b700 1 -- 172.21.15.17:0/3401218442 learned_addr learned my addr 172.21.15.17:0/3401218442 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.923+0000 7f263559c700 1 -- 172.21.15.17:0/3401218442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 msgr2=0x55ba127562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.923+0000 7f263559c700 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 0x55ba127562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.923+0000 7f263559c700 1 -- 172.21.15.17:0/3401218442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 msgr2=0x55ba127567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.923+0000 7f263559c700 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba127567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.923+0000 7f263559c700 1 -- 172.21.15.17:0/3401218442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263019d2f0 con 0x55ba126f9ad0 2023-07-14T13:08:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.923+0000 7f2634d9b700 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 0x55ba127562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.923+0000 7f263559c700 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 0x55ba12750930 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f262800eaf0 tx=0x7f2628008fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cb303c286e7086 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.923+0000 7f260ffff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:08:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.924+0000 7f260ffff700 1 -- 172.21.15.17:0/3401218442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26280092e0 con 0x55ba126f9ad0 2023-07-14T13:08:00.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.924+0000 7f264a832b80 1 -- 172.21.15.17:0/3401218442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f261c0a2b70 con 0x55ba126f9ad0 2023-07-14T13:08:00.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.924+0000 7f260ffff700 1 -- 172.21.15.17:0/3401218442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2628017880 con 0x55ba126f9ad0 2023-07-14T13:08:00.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.924+0000 7f260ffff700 1 -- 172.21.15.17:0/3401218442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2628017a40 con 0x55ba126f9ad0 2023-07-14T13:08:00.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.924+0000 7f264a832b80 10 client.17166 fetch_fsmap learned FSMap version 31 2023-07-14T13:08:00.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.924+0000 7f264a832b80 1 -- 172.21.15.17:0/3401218442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f262800e7a0 con 0x55ba126f9ad0 2023-07-14T13:08:00.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.924+0000 7f260ffff700 1 -- 172.21.15.17:0/3401218442 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f261c0a2b70 con 0x55ba126f9ad0 2023-07-14T13:08:00.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.924+0000 7f260ffff700 1 -- 172.21.15.17:0/3401218442 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2628020a60 con 0x55ba126f9ad0 2023-07-14T13:08:00.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.924+0000 7f264a832b80 10 client.17166 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:08:00.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.924+0000 7f264a832b80 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:00.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.925+0000 7f264a832b80 20 client.17166 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:00.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.925+0000 7f264a832b80 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ba1275e170 0x55ba12760580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:00.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.925+0000 7f264a832b80 4 client.17166 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:08:00.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.925+0000 7f264a832b80 1 -- 172.21.15.17:0/3401218442 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ba125fc050 con 0x55ba1275e170 2023-07-14T13:08:00.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.925+0000 7f2634d9b700 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ba1275e170 0x55ba12760580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:00.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f260ffff700 10 client.17166 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:00.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f2634d9b700 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ba1275e170 0x55ba12760580 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=741f92b6b935cd42 server_cookie=c521b6783c218162 in_seq=0 out_seq=0 2023-07-14T13:08:00.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f260ffff700 1 -- 172.21.15.17:0/3401218442 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ba125fc050 con 0x55ba1275e170 2023-07-14T13:08:00.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f260ffff700 10 client.17166 handle_command_reply: tid=0 2023-07-14T13:08:00.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f264a832b80 1 client.17166 shutdown 2023-07-14T13:08:00.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f264a832b80 1 -- 172.21.15.17:0/3401218442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 msgr2=0x55ba12750930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:00.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f264a832b80 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 0x55ba12750930 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f262800eaf0 tx=0x7f2628008fc0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f264a832b80 1 -- 172.21.15.17:0/3401218442 shutdown_connections 2023-07-14T13:08:00.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f264a832b80 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ba1275e170 0x55ba12760580 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f264a832b80 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ba126f9ad0 0x55ba12750930 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f260ffff700 0 client.17166 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:00.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f264a832b80 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ba126ee2d0 0x55ba127562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f264a832b80 1 --2- 172.21.15.17:0/3401218442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba126eebe0 0x55ba127567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.926+0000 7f264a832b80 1 -- 172.21.15.17:0/3401218442 >> 172.21.15.17:0/3401218442 conn(0x55ba126e4da0 msgr2=0x55ba126ea160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:00.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.927+0000 7f264a832b80 1 -- 172.21.15.17:0/3401218442 shutdown_connections 2023-07-14T13:08:00.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.927+0000 7f264a832b80 1 -- 172.21.15.17:0/3401218442 wait complete. 2023-07-14T13:08:00.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.927+0000 7f264a832b80 20 client.17166 trim_cache size 0 max 16384 2023-07-14T13:08:00.969 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:08:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:08:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:08:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:08:00.969 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:08:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:08:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:08:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:08:00.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:08:00.970 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:08:00.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.927+0000 7f2636fff700 1 -- 172.21.15.17:0/2990434165 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f26200a1340 msgr2=0x7f26200a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:00.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.927+0000 7f2636fff700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f26200a1340 0x7f26200a37f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2624009d20 tx=0x7f2624009260 comp rx=0 tx=0).stop 2023-07-14T13:08:00.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.927+0000 7f2636fff700 1 -- 172.21.15.17:0/2990434165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630102910 msgr2=0x7f26301982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:00.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.927+0000 7f2636fff700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630102910 0x7f26301982a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f261c0098e0 tx=0x7f261c00f690 comp rx=0 tx=0).stop 2023-07-14T13:08:00.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.928+0000 7f2636fff700 1 -- 172.21.15.17:0/2990434165 shutdown_connections 2023-07-14T13:08:00.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.928+0000 7f2636fff700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f26200a1340 0x7f26200a37f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.928+0000 7f2636fff700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2630106fb0 0x7f263019c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.928+0000 7f2636fff700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2630101f70 0x7f2630197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.928+0000 7f2636fff700 1 --2- 172.21.15.17:0/2990434165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2630102910 0x7f26301982a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:00.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.928+0000 7f2636fff700 1 -- 172.21.15.17:0/2990434165 >> 172.21.15.17:0/2990434165 conn(0x7f26300fd7e0 msgr2=0x7f26300fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:00.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.928+0000 7f2636fff700 1 -- 172.21.15.17:0/2990434165 shutdown_connections 2023-07-14T13:08:00.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:00.928+0000 7f2636fff700 1 -- 172.21.15.17:0/2990434165 wait complete. 2023-07-14T13:08:00.983 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:08:01.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:01 smithi135 ceph-mon[97338]: pgmap v255: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 34 MiB/s wr, 89 op/s 2023-07-14T13:08:01.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:01 smithi131 ceph-mon[96953]: pgmap v255: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 34 MiB/s wr, 89 op/s 2023-07-14T13:08:01.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:01 smithi017 ceph-mon[95536]: pgmap v255: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 34 MiB/s wr, 89 op/s 2023-07-14T13:08:02.173 INFO:teuthology.orchestra.run.smithi017.stderr:32400000 of 50000000 tuples (64%) done (elapsed 471.77 s, remaining 256.27 s) 2023-07-14T13:08:03.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:03 smithi135 ceph-mon[97338]: pgmap v256: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 57 op/s 2023-07-14T13:08:03.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:03 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:08:03.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:03 smithi131 ceph-mon[96953]: pgmap v256: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 57 op/s 2023-07-14T13:08:03.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:03 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:08:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:32500000 of 50000000 tuples (65%) done (elapsed 473.14 s, remaining 254.77 s) 2023-07-14T13:08:03.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:03 smithi017 ceph-mon[95536]: pgmap v256: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 57 op/s 2023-07-14T13:08:03.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:03 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:08:04.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:04 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:08:04.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:04 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:08:04.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:04 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:08:04.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:04 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:08:04.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:04 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:08:04.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:04 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:08:04.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:04 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:08:04.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:04 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:08:04.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:04 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:08:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:32600000 of 50000000 tuples (65%) done (elapsed 474.47 s, remaining 253.24 s) 2023-07-14T13:08:05.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:05 smithi135 ceph-mon[97338]: pgmap v257: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 57 op/s 2023-07-14T13:08:05.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:05 smithi131 ceph-mon[96953]: pgmap v257: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 57 op/s 2023-07-14T13:08:05.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:05 smithi017 ceph-mon[95536]: pgmap v257: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 57 op/s 2023-07-14T13:08:06.196 INFO:teuthology.orchestra.run.smithi017.stderr:32700000 of 50000000 tuples (65%) done (elapsed 475.80 s, remaining 251.72 s) 2023-07-14T13:08:07.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:07 smithi135 ceph-mon[97338]: pgmap v258: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 94 op/s 2023-07-14T13:08:07.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:07 smithi131 ceph-mon[96953]: pgmap v258: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 94 op/s 2023-07-14T13:08:07.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:07 smithi017 ceph-mon[95536]: pgmap v258: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 94 op/s 2023-07-14T13:08:07.619 INFO:teuthology.orchestra.run.smithi017.stderr:32800000 of 50000000 tuples (65%) done (elapsed 477.22 s, remaining 250.25 s) 2023-07-14T13:08:09.059 INFO:teuthology.orchestra.run.smithi017.stderr:32900000 of 50000000 tuples (65%) done (elapsed 478.66 s, remaining 248.79 s) 2023-07-14T13:08:09.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:09 smithi135 ceph-mon[97338]: pgmap v259: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 22 MiB/s wr, 62 op/s 2023-07-14T13:08:09.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:09 smithi131 ceph-mon[96953]: pgmap v259: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 22 MiB/s wr, 62 op/s 2023-07-14T13:08:09.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:09 smithi017 ceph-mon[95536]: pgmap v259: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 22 MiB/s wr, 62 op/s 2023-07-14T13:08:10.425 INFO:teuthology.orchestra.run.smithi017.stderr:33000000 of 50000000 tuples (66%) done (elapsed 480.03 s, remaining 247.29 s) 2023-07-14T13:08:10.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:10 smithi135 ceph-mon[97338]: osdmap e94: 12 total, 12 up, 12 in 2023-07-14T13:08:10.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:10 smithi131 ceph-mon[96953]: osdmap e94: 12 total, 12 up, 12 in 2023-07-14T13:08:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.483+0000 7fca687ff700 1 -- 172.21.15.17:0/2904719631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca60067c10 msgr2=0x7fca60067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.483+0000 7fca687ff700 1 --2- 172.21.15.17:0/2904719631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca60067c10 0x7fca60067fe0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0099c0 tx=0x7fca5c009cd0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.483+0000 7fca687ff700 1 -- 172.21.15.17:0/2904719631 shutdown_connections 2023-07-14T13:08:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.483+0000 7fca687ff700 1 --2- 172.21.15.17:0/2904719631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca60104e50 0x7fca6010ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.483+0000 7fca687ff700 1 --2- 172.21.15.17:0/2904719631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca60067c10 0x7fca60067fe0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.483+0000 7fca687ff700 1 --2- 172.21.15.17:0/2904719631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca600685b0 0x7fca60104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.483+0000 7fca687ff700 1 -- 172.21.15.17:0/2904719631 >> 172.21.15.17:0/2904719631 conn(0x7fca60074760 msgr2=0x7fca60074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.483+0000 7fca687ff700 1 -- 172.21.15.17:0/2904719631 shutdown_connections 2023-07-14T13:08:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.483+0000 7fca687ff700 1 -- 172.21.15.17:0/2904719631 wait complete. 2023-07-14T13:08:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.484+0000 7fca687ff700 1 Processor -- start 2023-07-14T13:08:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca687ff700 1 -- start start 2023-07-14T13:08:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca687ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca60067c10 0x7fca60197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca687ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca600685b0 0x7fca60198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca687ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca60104e50 0x7fca6019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca687ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6019bdc0 con 0x7fca60104e50 2023-07-14T13:08:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca687ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6019bf30 con 0x7fca60067c10 2023-07-14T13:08:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca687ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6019c0f0 con 0x7fca600685b0 2023-07-14T13:08:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca6659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca60067c10 0x7fca60197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca65d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca600685b0 0x7fca60198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca66d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca60104e50 0x7fca6019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca6659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca60067c10 0x7fca60197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:38270/0 (socket says 172.21.15.17:38270) 2023-07-14T13:08:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca6659b700 1 -- 172.21.15.17:0/868283392 learned_addr learned my addr 172.21.15.17:0/868283392 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.485+0000 7fca65d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca600685b0 0x7fca60198200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39230/0 (socket says 172.21.15.17:39230) 2023-07-14T13:08:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.486+0000 7fca65d9a700 1 -- 172.21.15.17:0/868283392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca60067c10 msgr2=0x7fca60197cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.486+0000 7fca65d9a700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca60067c10 0x7fca60197cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.486+0000 7fca65d9a700 1 -- 172.21.15.17:0/868283392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca60104e50 msgr2=0x7fca6019b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.486+0000 7fca65d9a700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca60104e50 0x7fca6019b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.486+0000 7fca65d9a700 1 -- 172.21.15.17:0/868283392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c0095f0 con 0x7fca600685b0 2023-07-14T13:08:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.486+0000 7fca66d9c700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca60104e50 0x7fca6019b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.486+0000 7fca6659b700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca60067c10 0x7fca60197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.486+0000 7fca65d9a700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca600685b0 0x7fca60198200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fca60068980 tx=0x7fca5000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.486+0000 7fca577fe700 1 -- 172.21.15.17:0/868283392 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50010900 con 0x7fca600685b0 2023-07-14T13:08:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.486+0000 7fca687ff700 1 -- 172.21.15.17:0/868283392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6019c3d0 con 0x7fca600685b0 2023-07-14T13:08:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.486+0000 7fca577fe700 1 -- 172.21.15.17:0/868283392 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5000c430 con 0x7fca600685b0 2023-07-14T13:08:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.487+0000 7fca577fe700 1 -- 172.21.15.17:0/868283392 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50018680 con 0x7fca600685b0 2023-07-14T13:08:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.487+0000 7fca687ff700 1 -- 172.21.15.17:0/868283392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca601a4d30 con 0x7fca600685b0 2023-07-14T13:08:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.490+0000 7fca577fe700 1 -- 172.21.15.17:0/868283392 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fca5000c5a0 con 0x7fca600685b0 2023-07-14T13:08:10.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.492+0000 7fca7c171b80 1 Processor -- start 2023-07-14T13:08:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.492+0000 7fca7c171b80 1 -- start start 2023-07-14T13:08:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.492+0000 7fca577fe700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca4c0a12c0 0x7fca4c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.492+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558264eb46b0 0x55826505dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.492+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55826505e2d0 0x558265058040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.492+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x5582650589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.492+0000 7fca7c171b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558264f5dc50 con 0x558264eb46b0 2023-07-14T13:08:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.492+0000 7fca7c171b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558264fb09e0 con 0x55826505e2d0 2023-07-14T13:08:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.492+0000 7fca7c171b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558264fa9e70 con 0x558265058580 2023-07-14T13:08:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.492+0000 7fca577fe700 1 -- 172.21.15.17:0/868283392 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fca50014070 con 0x7fca600685b0 2023-07-14T13:08:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca6659b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558264eb46b0 0x55826505dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca6659b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558264eb46b0 0x55826505dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37374/0 (socket says 172.21.15.17:37374) 2023-07-14T13:08:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca6659b700 1 -- 172.21.15.17:0/1763030758 learned_addr learned my addr 172.21.15.17:0/1763030758 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca66d9c700 1 --2- 172.21.15.17:0/1763030758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x5582650589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca65d9a700 1 --2- 172.21.15.17:0/1763030758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55826505e2d0 0x558265058040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca66d9c700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca4c0a12c0 0x7fca4c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca65d9a700 1 -- 172.21.15.17:0/1763030758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 msgr2=0x5582650589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca65d9a700 1 --2- 172.21.15.17:0/1763030758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x5582650589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca65d9a700 1 -- 172.21.15.17:0/1763030758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558264eb46b0 msgr2=0x55826505dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca65d9a700 1 --2- 172.21.15.17:0/1763030758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558264eb46b0 0x55826505dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca65d9a700 1 -- 172.21.15.17:0/1763030758 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558264dd7d80 con 0x55826505e2d0 2023-07-14T13:08:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca6659b700 1 --2- 172.21.15.17:0/1763030758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558264eb46b0 0x55826505dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.493+0000 7fca66d9c700 1 --2- 172.21.15.17:0/1763030758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x5582650589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.494+0000 7fca65d9a700 1 --2- 172.21.15.17:0/1763030758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55826505e2d0 0x558265058040 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca500ca540 tx=0x7fca50099820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fb0e5d9aec1612d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.494+0000 7fca66d9c700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca4c0a12c0 0x7fca4c0a3770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca58009fd0 tx=0x7fca5800b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.494+0000 7fca54ff9700 1 -- 172.21.15.17:0/1763030758 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50099ec0 con 0x55826505e2d0 2023-07-14T13:08:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.494+0000 7fca54ff9700 1 -- 172.21.15.17:0/1763030758 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5009def0 con 0x55826505e2d0 2023-07-14T13:08:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.494+0000 7fca54ff9700 1 -- 172.21.15.17:0/1763030758 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50099610 con 0x55826505e2d0 2023-07-14T13:08:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.495+0000 7fca7c171b80 1 -- 172.21.15.17:0/1763030758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55826505e2d0 msgr2=0x558265058040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.495+0000 7fca7c171b80 1 --2- 172.21.15.17:0/1763030758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55826505e2d0 0x558265058040 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca500ca540 tx=0x7fca50099820 comp rx=0 tx=0).stop 2023-07-14T13:08:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.495+0000 7fca7c171b80 1 -- 172.21.15.17:0/1763030758 shutdown_connections 2023-07-14T13:08:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.495+0000 7fca7c171b80 1 --2- 172.21.15.17:0/1763030758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x5582650589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.495+0000 7fca7c171b80 1 --2- 172.21.15.17:0/1763030758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558264eb46b0 0x55826505dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.495+0000 7fca7c171b80 1 --2- 172.21.15.17:0/1763030758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55826505e2d0 0x558265058040 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.495+0000 7fca7c171b80 1 -- 172.21.15.17:0/1763030758 >> 172.21.15.17:0/1763030758 conn(0x55826504dbe0 msgr2=0x558265052f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.495+0000 7fca7c171b80 1 -- 172.21.15.17:0/1763030758 shutdown_connections 2023-07-14T13:08:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.495+0000 7fca7c171b80 1 -- 172.21.15.17:0/1763030758 wait complete. 2023-07-14T13:08:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.495+0000 7fca7c171b80 1 -- start start 2023-07-14T13:08:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.496+0000 7fca7c171b80 1 Processor -- start 2023-07-14T13:08:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.496+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558264eb46b0 0x5582650618c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.496+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558265058580 0x558265061e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.496+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x558265062340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.496+0000 7fca7c171b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558264f49a60 con 0x55826505e2d0 2023-07-14T13:08:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.496+0000 7fca7c171b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558264f49760 con 0x558265058580 2023-07-14T13:08:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.496+0000 7fca7c171b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558264e2d8c0 con 0x558264eb46b0 2023-07-14T13:08:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.496+0000 7fca7c171b80 10 client.0 _ll_register_callbacks cb 0x558264f47700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca6659b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558264eb46b0 0x5582650618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca6659b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558264eb46b0 0x5582650618c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39248/0 (socket says 172.21.15.17:39248) 2023-07-14T13:08:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca6659b700 1 -- 172.21.15.17:0/1297646682 learned_addr learned my addr 172.21.15.17:0/1297646682 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca65d9a700 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558265058580 0x558265061e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca66d9c700 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x558265062340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca6659b700 1 -- 172.21.15.17:0/1297646682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558265058580 msgr2=0x558265061e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca6659b700 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558265058580 0x558265061e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca6659b700 1 -- 172.21.15.17:0/1297646682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 msgr2=0x558265062340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca6659b700 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x558265062340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca6659b700 1 -- 172.21.15.17:0/1297646682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6010d210 con 0x558264eb46b0 2023-07-14T13:08:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca6659b700 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558264eb46b0 0x5582650618c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca5c005cd0 tx=0x7fca5c0052e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fab6657bcebb41c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.497+0000 7fca49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:08:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.498+0000 7fca49ffb700 1 -- 172.21.15.17:0/1297646682 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c003960 con 0x558264eb46b0 2023-07-14T13:08:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.498+0000 7fca49ffb700 1 -- 172.21.15.17:0/1297646682 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fca5c003ac0 con 0x558264eb46b0 2023-07-14T13:08:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.498+0000 7fca7c171b80 1 -- 172.21.15.17:0/1297646682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558264f03490 con 0x558264eb46b0 2023-07-14T13:08:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.498+0000 7fca49ffb700 1 -- 172.21.15.17:0/1297646682 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca5c003c80 con 0x558264eb46b0 2023-07-14T13:08:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.498+0000 7fca7c171b80 10 client.26875 fetch_fsmap learned FSMap version 31 2023-07-14T13:08:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.498+0000 7fca7c171b80 1 -- 172.21.15.17:0/1297646682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fca58008a90 con 0x558264eb46b0 2023-07-14T13:08:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.498+0000 7fca49ffb700 1 -- 172.21.15.17:0/1297646682 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558264f03490 con 0x558264eb46b0 2023-07-14T13:08:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.498+0000 7fca49ffb700 1 -- 172.21.15.17:0/1297646682 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fca5c00f460 con 0x558264eb46b0 2023-07-14T13:08:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.498+0000 7fca7c171b80 10 client.26875 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:08:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.498+0000 7fca7c171b80 10 client.26875 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.498+0000 7fca7c171b80 20 client.26875 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.499+0000 7fca7c171b80 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558265071bb0 0x558265073fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.499+0000 7fca7c171b80 4 client.26875 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:08:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.499+0000 7fca7c171b80 1 -- 172.21.15.17:0/1297646682 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558264fa2e50 con 0x558265071bb0 2023-07-14T13:08:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.499+0000 7fca65d9a700 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558265071bb0 0x558265073fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.499+0000 7fca65d9a700 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558265071bb0 0x558265073fc0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fae59e19864a935d server_cookie=e87ed5331bc67a5c in_seq=0 out_seq=0 2023-07-14T13:08:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.499+0000 7fca49ffb700 10 client.26875 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.500+0000 7fca49ffb700 1 -- 172.21.15.17:0/1297646682 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558264fa2e50 con 0x558265071bb0 2023-07-14T13:08:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.500+0000 7fca49ffb700 10 client.26875 handle_command_reply: tid=0 2023-07-14T13:08:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.500+0000 7fca7c171b80 1 client.26875 shutdown 2023-07-14T13:08:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca7c171b80 1 -- 172.21.15.17:0/1297646682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558264eb46b0 msgr2=0x5582650618c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca7c171b80 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558264eb46b0 0x5582650618c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca5c005cd0 tx=0x7fca5c0052e0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca7c171b80 1 -- 172.21.15.17:0/1297646682 shutdown_connections 2023-07-14T13:08:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca7c171b80 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558265071bb0 0x558265073fc0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca7c171b80 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x558265062340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca7c171b80 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558264eb46b0 0x5582650618c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca7c171b80 1 --2- 172.21.15.17:0/1297646682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558265058580 0x558265061e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca7c171b80 1 -- 172.21.15.17:0/1297646682 >> 172.21.15.17:0/1297646682 conn(0x55826504dbe0 msgr2=0x5582650524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca49ffb700 0 client.26875 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca7c171b80 1 -- 172.21.15.17:0/1297646682 shutdown_connections 2023-07-14T13:08:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca7c171b80 1 -- 172.21.15.17:0/1297646682 wait complete. 2023-07-14T13:08:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.501+0000 7fca7c171b80 20 client.26875 trim_cache size 0 max 16384 2023-07-14T13:08:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.518+0000 7fca7c171b80 1 Processor -- start 2023-07-14T13:08:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.518+0000 7fca7c171b80 1 -- start start 2023-07-14T13:08:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.518+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265058040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.518+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x55826505d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.518+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x558265062170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.518+0000 7fca7c171b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55826505da50 con 0x55826505e2d0 2023-07-14T13:08:10.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.518+0000 7fca7c171b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55826505e160 con 0x558264eb46b0 2023-07-14T13:08:10.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.518+0000 7fca7c171b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55826506f240 con 0x558265058580 2023-07-14T13:08:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca65d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x55826505d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca6659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265058040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca66d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x558265062170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca6659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265058040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:38290/0 (socket says 172.21.15.17:38290) 2023-07-14T13:08:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca6659b700 1 -- 172.21.15.17:0/4206251682 learned_addr learned my addr 172.21.15.17:0/4206251682 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca65d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x55826505d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39258/0 (socket says 172.21.15.17:39258) 2023-07-14T13:08:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca6659b700 1 -- 172.21.15.17:0/4206251682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 msgr2=0x55826505d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca6659b700 1 --2- 172.21.15.17:0/4206251682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x55826505d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca6659b700 1 -- 172.21.15.17:0/4206251682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 msgr2=0x558265062170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca6659b700 1 --2- 172.21.15.17:0/4206251682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x558265062170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca6659b700 1 -- 172.21.15.17:0/4206251682 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca601a4d30 con 0x558264eb46b0 2023-07-14T13:08:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.519+0000 7fca65d9a700 1 --2- 172.21.15.17:0/4206251682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x55826505d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.520+0000 7fca6659b700 1 --2- 172.21.15.17:0/4206251682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265058040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00f7c0 tx=0x7fca5c009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=349aef837d5a3fc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.520+0000 7fca557fa700 1 -- 172.21.15.17:0/4206251682 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c00b630 con 0x558264eb46b0 2023-07-14T13:08:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.520+0000 7fca557fa700 1 -- 172.21.15.17:0/4206251682 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5c039070 con 0x558264eb46b0 2023-07-14T13:08:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.520+0000 7fca557fa700 1 -- 172.21.15.17:0/4206251682 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0246e0 con 0x558264eb46b0 2023-07-14T13:08:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.521+0000 7fca7c171b80 1 -- 172.21.15.17:0/4206251682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 msgr2=0x558265058040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.521+0000 7fca7c171b80 1 --2- 172.21.15.17:0/4206251682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265058040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00f7c0 tx=0x7fca5c009cd0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.521+0000 7fca7c171b80 1 -- 172.21.15.17:0/4206251682 shutdown_connections 2023-07-14T13:08:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.521+0000 7fca7c171b80 1 --2- 172.21.15.17:0/4206251682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x558265062170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.521+0000 7fca7c171b80 1 --2- 172.21.15.17:0/4206251682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265058040 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.521+0000 7fca7c171b80 1 --2- 172.21.15.17:0/4206251682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x55826505d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.521+0000 7fca7c171b80 1 -- 172.21.15.17:0/4206251682 >> 172.21.15.17:0/4206251682 conn(0x55826504dbe0 msgr2=0x558265060090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.521+0000 7fca7c171b80 1 -- 172.21.15.17:0/4206251682 shutdown_connections 2023-07-14T13:08:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.521+0000 7fca7c171b80 1 -- 172.21.15.17:0/4206251682 wait complete. 2023-07-14T13:08:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.521+0000 7fca7c171b80 1 -- start start 2023-07-14T13:08:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.522+0000 7fca7c171b80 1 Processor -- start 2023-07-14T13:08:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.522+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265066b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.522+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x558265067090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.522+0000 7fca7c171b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x5582650c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.522+0000 7fca7c171b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558265067770 con 0x55826505e2d0 2023-07-14T13:08:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.522+0000 7fca7c171b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582650c4fb0 con 0x558264eb46b0 2023-07-14T13:08:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.522+0000 7fca7c171b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582650c50f0 con 0x558265058580 2023-07-14T13:08:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.522+0000 7fca7c171b80 10 client.0 _ll_register_callbacks cb 0x7fca5c00be50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.522+0000 7fca6659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca6659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265066b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:38302/0 (socket says 172.21.15.17:38302) 2023-07-14T13:08:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca6659b700 1 -- 172.21.15.17:0/2360840229 learned_addr learned my addr 172.21.15.17:0/2360840229 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca65d9a700 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x558265067090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca66d9c700 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x5582650c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca6659b700 1 -- 172.21.15.17:0/2360840229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 msgr2=0x558265067090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca6659b700 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x558265067090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca6659b700 1 -- 172.21.15.17:0/2360840229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 msgr2=0x5582650c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca6659b700 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x5582650c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca6659b700 1 -- 172.21.15.17:0/2360840229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558264dd7d80 con 0x558264eb46b0 2023-07-14T13:08:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca65d9a700 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x558265067090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca6659b700 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265066b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca5c005ff0 tx=0x7fca5c00b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afa1aa10fec49d42 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.523+0000 7fca49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:08:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.524+0000 7fca49ffb700 1 -- 172.21.15.17:0/2360840229 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c003960 con 0x558264eb46b0 2023-07-14T13:08:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.524+0000 7fca49ffb700 1 -- 172.21.15.17:0/2360840229 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fca5c000e40 con 0x558264eb46b0 2023-07-14T13:08:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.524+0000 7fca7c171b80 1 -- 172.21.15.17:0/2360840229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca5009def0 con 0x558264eb46b0 2023-07-14T13:08:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.524+0000 7fca49ffb700 1 -- 172.21.15.17:0/2360840229 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca5c003ac0 con 0x558264eb46b0 2023-07-14T13:08:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.524+0000 7fca7c171b80 10 client.26912 fetch_fsmap learned FSMap version 31 2023-07-14T13:08:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.524+0000 7fca7c171b80 1 -- 172.21.15.17:0/2360840229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fca58008a90 con 0x558264eb46b0 2023-07-14T13:08:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.524+0000 7fca49ffb700 1 -- 172.21.15.17:0/2360840229 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5009def0 con 0x558264eb46b0 2023-07-14T13:08:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.525+0000 7fca49ffb700 1 -- 172.21.15.17:0/2360840229 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fca5c024c00 con 0x558264eb46b0 2023-07-14T13:08:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.525+0000 7fca7c171b80 10 client.26912 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:08:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.525+0000 7fca7c171b80 10 client.26912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.525+0000 7fca7c171b80 20 client.26912 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.525+0000 7fca7c171b80 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5582650c6420 0x5582650c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.525+0000 7fca7c171b80 4 client.26912 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:08:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.525+0000 7fca7c171b80 1 -- 172.21.15.17:0/2360840229 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558264f64ff0 con 0x5582650c6420 2023-07-14T13:08:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.525+0000 7fca65d9a700 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5582650c6420 0x5582650c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.526+0000 7fca65d9a700 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5582650c6420 0x5582650c8830 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f41a7b7b1cdb6f14 server_cookie=4881d95467c060e6 in_seq=0 out_seq=0 2023-07-14T13:08:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.526+0000 7fca49ffb700 10 client.26912 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.539+0000 7fca49ffb700 1 -- 172.21.15.17:0/2360840229 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558264f64ff0 con 0x5582650c6420 2023-07-14T13:08:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.539+0000 7fca49ffb700 10 client.26912 handle_command_reply: tid=0 2023-07-14T13:08:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.539+0000 7fca7c171b80 1 client.26912 shutdown 2023-07-14T13:08:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca7c171b80 1 -- 172.21.15.17:0/2360840229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 msgr2=0x558265066b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca7c171b80 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265066b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca5c005ff0 tx=0x7fca5c00b630 comp rx=0 tx=0).stop 2023-07-14T13:08:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca7c171b80 1 -- 172.21.15.17:0/2360840229 shutdown_connections 2023-07-14T13:08:10.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca7c171b80 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5582650c6420 0x5582650c8830 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca7c171b80 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55826505e2d0 0x5582650c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca7c171b80 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558264eb46b0 0x558265066b50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca49ffb700 0 client.26912 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca7c171b80 1 --2- 172.21.15.17:0/2360840229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558265058580 0x558265067090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca7c171b80 1 -- 172.21.15.17:0/2360840229 >> 172.21.15.17:0/2360840229 conn(0x55826504dbe0 msgr2=0x55826505f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca7c171b80 1 -- 172.21.15.17:0/2360840229 shutdown_connections 2023-07-14T13:08:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca7c171b80 1 -- 172.21.15.17:0/2360840229 wait complete. 2023-07-14T13:08:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.540+0000 7fca7c171b80 20 client.26912 trim_cache size 0 max 16384 2023-07-14T13:08:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:08:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:08:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:08:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:08:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 -- 172.21.15.17:0/868283392 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca4c0a12c0 msgr2=0x7fca4c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca4c0a12c0 0x7fca4c0a3770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca58009fd0 tx=0x7fca5800b040 comp rx=0 tx=0).stop 2023-07-14T13:08:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 -- 172.21.15.17:0/868283392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca600685b0 msgr2=0x7fca60198200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca600685b0 0x7fca60198200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fca60068980 tx=0x7fca5000eca0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 -- 172.21.15.17:0/868283392 shutdown_connections 2023-07-14T13:08:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca4c0a12c0 0x7fca4c0a3770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca60104e50 0x7fca6019b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca60067c10 0x7fca60197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 --2- 172.21.15.17:0/868283392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca600685b0 0x7fca60198200 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 -- 172.21.15.17:0/868283392 >> 172.21.15.17:0/868283392 conn(0x7fca60074760 msgr2=0x7fca600fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 -- 172.21.15.17:0/868283392 shutdown_connections 2023-07-14T13:08:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:10.541+0000 7fca687ff700 1 -- 172.21.15.17:0/868283392 wait complete. 2023-07-14T13:08:10.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:10 smithi017 ceph-mon[95536]: osdmap e94: 12 total, 12 up, 12 in 2023-07-14T13:08:11.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:11 smithi131 ceph-mon[96953]: pgmap v261: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 67 op/s 2023-07-14T13:08:11.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:11 smithi131 ceph-mon[96953]: osdmap e95: 12 total, 12 up, 12 in 2023-07-14T13:08:11.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:11 smithi017 ceph-mon[95536]: pgmap v261: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 67 op/s 2023-07-14T13:08:11.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:11 smithi017 ceph-mon[95536]: osdmap e95: 12 total, 12 up, 12 in 2023-07-14T13:08:11.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:11 smithi135 ceph-mon[97338]: pgmap v261: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 67 op/s 2023-07-14T13:08:11.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:11 smithi135 ceph-mon[97338]: osdmap e95: 12 total, 12 up, 12 in 2023-07-14T13:08:11.851 INFO:teuthology.orchestra.run.smithi017.stderr:33100000 of 50000000 tuples (66%) done (elapsed 481.45 s, remaining 245.82 s) 2023-07-14T13:08:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:33200000 of 50000000 tuples (66%) done (elapsed 482.75 s, remaining 244.29 s) 2023-07-14T13:08:13.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:13 smithi131 ceph-mon[96953]: pgmap v263: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 83 op/s 2023-07-14T13:08:13.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:13 smithi017 ceph-mon[95536]: pgmap v263: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 83 op/s 2023-07-14T13:08:13.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:13 smithi135 ceph-mon[97338]: pgmap v263: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 MiB/s wr, 83 op/s 2023-07-14T13:08:14.478 INFO:teuthology.orchestra.run.smithi017.stderr:33300000 of 50000000 tuples (66%) done (elapsed 484.08 s, remaining 242.77 s) 2023-07-14T13:08:15.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:15 smithi131 ceph-mon[96953]: pgmap v264: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 28 op/s 2023-07-14T13:08:15.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:15 smithi017 ceph-mon[95536]: pgmap v264: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 28 op/s 2023-07-14T13:08:15.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:15 smithi135 ceph-mon[97338]: pgmap v264: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 28 op/s 2023-07-14T13:08:15.847 INFO:teuthology.orchestra.run.smithi017.stderr:33400000 of 50000000 tuples (66%) done (elapsed 485.45 s, remaining 241.27 s) 2023-07-14T13:08:17.260 INFO:teuthology.orchestra.run.smithi017.stderr:33500000 of 50000000 tuples (67%) done (elapsed 486.86 s, remaining 239.80 s) 2023-07-14T13:08:17.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:17 smithi131 ceph-mon[96953]: pgmap v265: 97 pgs: 97 active+clean; 7.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 33 MiB/s wr, 67 op/s 2023-07-14T13:08:17.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:17 smithi017 ceph-mon[95536]: pgmap v265: 97 pgs: 97 active+clean; 7.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 33 MiB/s wr, 67 op/s 2023-07-14T13:08:17.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:17 smithi135 ceph-mon[97338]: pgmap v265: 97 pgs: 97 active+clean; 7.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 33 MiB/s wr, 67 op/s 2023-07-14T13:08:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:33600000 of 50000000 tuples (67%) done (elapsed 488.16 s, remaining 238.27 s) 2023-07-14T13:08:19.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:19 smithi131 ceph-mon[96953]: pgmap v266: 97 pgs: 97 active+clean; 7.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 30 MiB/s wr, 61 op/s 2023-07-14T13:08:19.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:19 smithi017 ceph-mon[95536]: pgmap v266: 97 pgs: 97 active+clean; 7.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 30 MiB/s wr, 61 op/s 2023-07-14T13:08:19.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:19 smithi135 ceph-mon[97338]: pgmap v266: 97 pgs: 97 active+clean; 7.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 30 MiB/s wr, 61 op/s 2023-07-14T13:08:19.877 INFO:teuthology.orchestra.run.smithi017.stderr:33700000 of 50000000 tuples (67%) done (elapsed 489.48 s, remaining 236.75 s) 2023-07-14T13:08:21.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:21 smithi131 ceph-mon[96953]: pgmap v267: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 27 MiB/s wr, 60 op/s 2023-07-14T13:08:21.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:21 smithi017 ceph-mon[95536]: pgmap v267: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 27 MiB/s wr, 60 op/s 2023-07-14T13:08:21.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:21 smithi135 ceph-mon[97338]: pgmap v267: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 27 MiB/s wr, 60 op/s 2023-07-14T13:08:22.461 INFO:teuthology.orchestra.run.smithi017.stderr:33800000 of 50000000 tuples (67%) done (elapsed 492.06 s, remaining 235.84 s) 2023-07-14T13:08:22.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:22 smithi131 ceph-mon[96953]: pgmap v268: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-14T13:08:22.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:22 smithi017 ceph-mon[95536]: pgmap v268: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-14T13:08:22.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:22 smithi135 ceph-mon[97338]: pgmap v268: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-14T13:08:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.713+0000 7f1d983ff700 1 -- 172.21.15.17:0/3862384941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d901004e0 msgr2=0x7f1d9010c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.713+0000 7f1d983ff700 1 --2- 172.21.15.17:0/3862384941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d901004e0 0x7f1d9010c920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800b0a0 tx=0x7f1d8800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.713+0000 7f1d983ff700 1 -- 172.21.15.17:0/3862384941 shutdown_connections 2023-07-14T13:08:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.713+0000 7f1d983ff700 1 --2- 172.21.15.17:0/3862384941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d901004e0 0x7f1d9010c920 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.713+0000 7f1d983ff700 1 --2- 172.21.15.17:0/3862384941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d90105b60 0x7f1d90105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.713+0000 7f1d983ff700 1 --2- 172.21.15.17:0/3862384941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900ffb30 0x7f1d900fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.713+0000 7f1d983ff700 1 -- 172.21.15.17:0/3862384941 >> 172.21.15.17:0/3862384941 conn(0x7f1d900fb5f0 msgr2=0x7f1d900fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.713+0000 7f1d983ff700 1 -- 172.21.15.17:0/3862384941 shutdown_connections 2023-07-14T13:08:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.713+0000 7f1d983ff700 1 -- 172.21.15.17:0/3862384941 wait complete. 2023-07-14T13:08:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.714+0000 7f1d983ff700 1 Processor -- start 2023-07-14T13:08:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.715+0000 7f1d983ff700 1 -- start start 2023-07-14T13:08:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.715+0000 7f1d983ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900ffb30 0x7f1d900729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.715+0000 7f1d983ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d901004e0 0x7f1d90072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.715+0000 7f1d983ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d90105b60 0x7f1d901a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.715+0000 7f1d983ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d901a4300 con 0x7f1d901004e0 2023-07-14T13:08:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.715+0000 7f1d983ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d901a4440 con 0x7f1d900ffb30 2023-07-14T13:08:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.715+0000 7f1d983ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d901a45b0 con 0x7f1d90105b60 2023-07-14T13:08:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9619b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900ffb30 0x7f1d900729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9599a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d901004e0 0x7f1d90072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9619b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900ffb30 0x7f1d900729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56786/0 (socket says 172.21.15.17:56786) 2023-07-14T13:08:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9619b700 1 -- 172.21.15.17:0/957192221 learned_addr learned my addr 172.21.15.17:0/957192221 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9699c700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d90105b60 0x7f1d901a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9619b700 1 -- 172.21.15.17:0/957192221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d90105b60 msgr2=0x7f1d901a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9619b700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d90105b60 0x7f1d901a3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9619b700 1 -- 172.21.15.17:0/957192221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d901004e0 msgr2=0x7f1d90072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9619b700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d901004e0 0x7f1d90072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9619b700 1 -- 172.21.15.17:0/957192221 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c009520 con 0x7f1d900ffb30 2023-07-14T13:08:23.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9699c700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d90105b60 0x7f1d901a3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:23.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9599a700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d901004e0 0x7f1d90072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:23.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.716+0000 7f1d9619b700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900ffb30 0x7f1d900729f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00eb30 tx=0x7f1d8c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:23.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.717+0000 7f1d877fe700 1 -- 172.21.15.17:0/957192221 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c009880 con 0x7f1d900ffb30 2023-07-14T13:08:23.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.717+0000 7f1d983ff700 1 -- 172.21.15.17:0/957192221 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d88009d00 con 0x7f1d900ffb30 2023-07-14T13:08:23.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.717+0000 7f1d877fe700 1 -- 172.21.15.17:0/957192221 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d8c0044b0 con 0x7f1d900ffb30 2023-07-14T13:08:23.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.717+0000 7f1d877fe700 1 -- 172.21.15.17:0/957192221 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c003ce0 con 0x7f1d900ffb30 2023-07-14T13:08:23.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.717+0000 7f1d983ff700 1 -- 172.21.15.17:0/957192221 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d901a4c60 con 0x7f1d900ffb30 2023-07-14T13:08:23.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.721+0000 7f1d877fe700 1 -- 172.21.15.17:0/957192221 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1d8c003e40 con 0x7f1d900ffb30 2023-07-14T13:08:23.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.722+0000 7f1dabcddb80 1 Processor -- start 2023-07-14T13:08:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.722+0000 7f1dabcddb80 1 -- start start 2023-07-14T13:08:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.722+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8925a6b0 0x559d89403d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.722+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d894042d0 0x559d893fe040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d893fe580 0x559d893fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89303c50 con 0x559d894042d0 2023-07-14T13:08:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d893569e0 con 0x559d8925a6b0 2023-07-14T13:08:23.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8934fe70 con 0x559d893fe580 2023-07-14T13:08:23.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d9699c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8925a6b0 0x559d89403d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d9699c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8925a6b0 0x559d89403d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56798/0 (socket says 172.21.15.17:56798) 2023-07-14T13:08:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d9699c700 1 -- 172.21.15.17:0/276928303 learned_addr learned my addr 172.21.15.17:0/276928303 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d9619b700 1 --2- 172.21.15.17:0/276928303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d894042d0 0x559d893fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d9599a700 1 --2- 172.21.15.17:0/276928303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d893fe580 0x559d893fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d877fe700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1d7c0a12c0 0x7f1d7c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d9599a700 1 -- 172.21.15.17:0/276928303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8925a6b0 msgr2=0x559d89403d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d9599a700 1 --2- 172.21.15.17:0/276928303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8925a6b0 0x559d89403d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d9599a700 1 -- 172.21.15.17:0/276928303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d894042d0 msgr2=0x559d893fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:23.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d9599a700 1 --2- 172.21.15.17:0/276928303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d894042d0 0x559d893fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d9599a700 1 -- 172.21.15.17:0/276928303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d8917dd80 con 0x559d893fe580 2023-07-14T13:08:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.723+0000 7f1d877fe700 1 -- 172.21.15.17:0/957192221 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1d8c014070 con 0x7f1d900ffb30 2023-07-14T13:08:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.724+0000 7f1d9699c700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1d7c0a12c0 0x7f1d7c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.724+0000 7f1d9599a700 1 --2- 172.21.15.17:0/276928303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d893fe580 0x559d893fe9d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d800114c0 tx=0x7f1d800117d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b15473ed79bece3d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.724+0000 7f1d84bfe700 1 -- 172.21.15.17:0/276928303 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80004230 con 0x559d893fe580 2023-07-14T13:08:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.724+0000 7f1d84bfe700 1 -- 172.21.15.17:0/276928303 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d80004cc0 con 0x559d893fe580 2023-07-14T13:08:23.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.724+0000 7f1d84bfe700 1 -- 172.21.15.17:0/276928303 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800055f0 con 0x559d893fe580 2023-07-14T13:08:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.725+0000 7f1dabcddb80 1 -- 172.21.15.17:0/276928303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d893fe580 msgr2=0x559d893fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.725+0000 7f1d9699c700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1d7c0a12c0 0x7f1d7c0a3770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800d010 tx=0x7f1d880099e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.725+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/276928303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d893fe580 0x559d893fe9d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1d800114c0 tx=0x7f1d800117d0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.725+0000 7f1dabcddb80 1 -- 172.21.15.17:0/276928303 shutdown_connections 2023-07-14T13:08:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.725+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/276928303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d893fe580 0x559d893fe9d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.725+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/276928303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8925a6b0 0x559d89403d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.725+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/276928303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d894042d0 0x559d893fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.725+0000 7f1dabcddb80 1 -- 172.21.15.17:0/276928303 >> 172.21.15.17:0/276928303 conn(0x559d893f3be0 msgr2=0x559d893f8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.725+0000 7f1dabcddb80 1 -- 172.21.15.17:0/276928303 shutdown_connections 2023-07-14T13:08:23.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.725+0000 7f1dabcddb80 1 -- 172.21.15.17:0/276928303 wait complete. 2023-07-14T13:08:23.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.726+0000 7f1dabcddb80 1 -- start start 2023-07-14T13:08:23.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.726+0000 7f1dabcddb80 1 Processor -- start 2023-07-14T13:08:23.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.726+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 0x559d8940a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.726+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d893fe580 0x559d89407770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d894042d0 0x559d89407d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d892efa60 con 0x559d893fe580 2023-07-14T13:08:23.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d892ef760 con 0x559d894042d0 2023-07-14T13:08:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d891d38c0 con 0x559d8925a6b0 2023-07-14T13:08:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1dabcddb80 10 client.0 _ll_register_callbacks cb 0x559d892ed700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1d9619b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 0x559d8940a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1d9599a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d893fe580 0x559d89407770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1d9699c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d894042d0 0x559d89407d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1d9619b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 0x559d8940a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:56146/0 (socket says 172.21.15.17:56146) 2023-07-14T13:08:23.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1d9619b700 1 -- 172.21.15.17:0/2270288714 learned_addr learned my addr 172.21.15.17:0/2270288714 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1d9619b700 1 -- 172.21.15.17:0/2270288714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d894042d0 msgr2=0x559d89407d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1d9619b700 1 --2- 172.21.15.17:0/2270288714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d894042d0 0x559d89407d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1d9619b700 1 -- 172.21.15.17:0/2270288714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d893fe580 msgr2=0x559d89407770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1d9619b700 1 --2- 172.21.15.17:0/2270288714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d893fe580 0x559d89407770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.727+0000 7f1d9619b700 1 -- 172.21.15.17:0/2270288714 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d80009c90 con 0x559d8925a6b0 2023-07-14T13:08:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.728+0000 7f1d9619b700 1 --2- 172.21.15.17:0/2270288714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 0x559d8940a560 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c000c00 tx=0x7f1d8c09a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf8d4377a85eba5d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.728+0000 7f1d79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:08:23.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.728+0000 7f1d79ffb700 1 -- 172.21.15.17:0/2270288714 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0042f0 con 0x559d8925a6b0 2023-07-14T13:08:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.728+0000 7f1d79ffb700 1 -- 172.21.15.17:0/2270288714 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1d8c094e40 con 0x559d8925a6b0 2023-07-14T13:08:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.728+0000 7f1dabcddb80 1 -- 172.21.15.17:0/2270288714 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d892a9490 con 0x559d8925a6b0 2023-07-14T13:08:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.728+0000 7f1d79ffb700 1 -- 172.21.15.17:0/2270288714 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d8c00cdd0 con 0x559d8925a6b0 2023-07-14T13:08:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.728+0000 7f1dabcddb80 10 client.26893 fetch_fsmap learned FSMap version 31 2023-07-14T13:08:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.728+0000 7f1dabcddb80 1 -- 172.21.15.17:0/2270288714 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x559d89166c00 con 0x559d8925a6b0 2023-07-14T13:08:23.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.728+0000 7f1d79ffb700 1 -- 172.21.15.17:0/2270288714 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559d892a9490 con 0x559d8925a6b0 2023-07-14T13:08:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.728+0000 7f1d79ffb700 1 -- 172.21.15.17:0/2270288714 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1d8c0d0c40 con 0x559d8925a6b0 2023-07-14T13:08:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.729+0000 7f1dabcddb80 10 client.26893 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:08:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.729+0000 7f1dabcddb80 10 client.26893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.729+0000 7f1dabcddb80 20 client.26893 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.729+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/2270288714 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d89417aa0 0x559d89419eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.729+0000 7f1dabcddb80 4 client.26893 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:08:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.729+0000 7f1dabcddb80 1 -- 172.21.15.17:0/2270288714 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d89348e50 con 0x559d89417aa0 2023-07-14T13:08:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.729+0000 7f1d9599a700 1 --2- 172.21.15.17:0/2270288714 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d89417aa0 0x559d89419eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.730+0000 7f1d79ffb700 10 client.26893 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:23.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.730+0000 7f1d9599a700 1 --2- 172.21.15.17:0/2270288714 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d89417aa0 0x559d89419eb0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd333411e4751277 server_cookie=77b646de60f61adb in_seq=0 out_seq=0 2023-07-14T13:08:23.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.730+0000 7f1d79ffb700 1 -- 172.21.15.17:0/2270288714 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559d89348e50 con 0x559d89417aa0 2023-07-14T13:08:23.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.730+0000 7f1d79ffb700 10 client.26893 handle_command_reply: tid=0 2023-07-14T13:08:23.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.730+0000 7f1dabcddb80 1 client.26893 shutdown 2023-07-14T13:08:23.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1dabcddb80 1 -- 172.21.15.17:0/2270288714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 msgr2=0x559d8940a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/2270288714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 0x559d8940a560 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c000c00 tx=0x7f1d8c09a000 comp rx=0 tx=0).stop 2023-07-14T13:08:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1dabcddb80 1 -- 172.21.15.17:0/2270288714 shutdown_connections 2023-07-14T13:08:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/2270288714 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d89417aa0 0x559d89419eb0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/2270288714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d894042d0 0x559d89407d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/2270288714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 0x559d8940a560 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/2270288714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d893fe580 0x559d89407770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1d79ffb700 0 client.26893 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1dabcddb80 1 -- 172.21.15.17:0/2270288714 >> 172.21.15.17:0/2270288714 conn(0x559d893f3be0 msgr2=0x559d893f7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1dabcddb80 1 -- 172.21.15.17:0/2270288714 shutdown_connections 2023-07-14T13:08:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1dabcddb80 1 -- 172.21.15.17:0/2270288714 wait complete. 2023-07-14T13:08:23.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.731+0000 7f1dabcddb80 20 client.26893 trim_cache size 0 max 16384 2023-07-14T13:08:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.752+0000 7f1dabcddb80 1 Processor -- start 2023-07-14T13:08:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1dabcddb80 1 -- start start 2023-07-14T13:08:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 0x559d893fe040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89407770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d894042d0 0x559d8940ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d893f0bb0 con 0x559d894042d0 2023-07-14T13:08:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d893fa800 con 0x559d893fe580 2023-07-14T13:08:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89405d20 con 0x559d8925a6b0 2023-07-14T13:08:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1d9599a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89407770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1d9619b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 0x559d893fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1d9599a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89407770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56824/0 (socket says 172.21.15.17:56824) 2023-07-14T13:08:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1d9599a700 1 -- 172.21.15.17:0/3664695884 learned_addr learned my addr 172.21.15.17:0/3664695884 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.753+0000 7f1d9699c700 1 --2- 172.21.15.17:0/3664695884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d894042d0 0x559d8940ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.754+0000 7f1d9599a700 1 -- 172.21.15.17:0/3664695884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 msgr2=0x559d893fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.754+0000 7f1d9599a700 1 --2- 172.21.15.17:0/3664695884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 0x559d893fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.754+0000 7f1d9599a700 1 -- 172.21.15.17:0/3664695884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d894042d0 msgr2=0x559d8940ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.754+0000 7f1d9599a700 1 --2- 172.21.15.17:0/3664695884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d894042d0 0x559d8940ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.754+0000 7f1d9599a700 1 -- 172.21.15.17:0/3664695884 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d8941eae0 con 0x559d893fe580 2023-07-14T13:08:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.754+0000 7f1d9619b700 1 --2- 172.21.15.17:0/3664695884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 0x559d893fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.754+0000 7f1d9599a700 1 --2- 172.21.15.17:0/3664695884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89407770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1d80005950 tx=0x7f1d80009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81c1672f79b772df server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.754+0000 7f1d853ff700 1 -- 172.21.15.17:0/3664695884 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80004e30 con 0x559d893fe580 2023-07-14T13:08:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.754+0000 7f1d853ff700 1 -- 172.21.15.17:0/3664695884 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d80005650 con 0x559d893fe580 2023-07-14T13:08:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.754+0000 7f1d853ff700 1 -- 172.21.15.17:0/3664695884 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800042a0 con 0x559d893fe580 2023-07-14T13:08:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.755+0000 7f1dabcddb80 1 -- 172.21.15.17:0/3664695884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 msgr2=0x559d89407770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.755+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/3664695884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89407770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1d80005950 tx=0x7f1d80009750 comp rx=0 tx=0).stop 2023-07-14T13:08:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.755+0000 7f1dabcddb80 1 -- 172.21.15.17:0/3664695884 shutdown_connections 2023-07-14T13:08:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.755+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/3664695884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d894042d0 0x559d8940ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.755+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/3664695884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8925a6b0 0x559d893fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.755+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/3664695884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89407770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.755+0000 7f1dabcddb80 1 -- 172.21.15.17:0/3664695884 >> 172.21.15.17:0/3664695884 conn(0x559d893f3be0 msgr2=0x559d89407060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.755+0000 7f1dabcddb80 1 -- 172.21.15.17:0/3664695884 shutdown_connections 2023-07-14T13:08:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.756+0000 7f1dabcddb80 1 -- 172.21.15.17:0/3664695884 wait complete. 2023-07-14T13:08:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.756+0000 7f1dabcddb80 1 -- start start 2023-07-14T13:08:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.756+0000 7f1dabcddb80 1 Processor -- start 2023-07-14T13:08:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8925a6b0 0x559d89400ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89401020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1dabcddb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d894042d0 0x559d893ff790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d893ffcd0 con 0x559d8925a6b0 2023-07-14T13:08:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d893ffe40 con 0x559d893fe580 2023-07-14T13:08:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1dabcddb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d89400000 con 0x559d894042d0 2023-07-14T13:08:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1dabcddb80 10 client.0 _ll_register_callbacks cb 0x7f1d8c0d0780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1d9619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8925a6b0 0x559d89400ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1d9599a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89401020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1d9599a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89401020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56840/0 (socket says 172.21.15.17:56840) 2023-07-14T13:08:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1d9599a700 1 -- 172.21.15.17:0/234866535 learned_addr learned my addr 172.21.15.17:0/234866535 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.757+0000 7f1d9699c700 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d894042d0 0x559d893ff790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1d9619b700 1 -- 172.21.15.17:0/234866535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d894042d0 msgr2=0x559d893ff790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1d9619b700 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d894042d0 0x559d893ff790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1d9619b700 1 -- 172.21.15.17:0/234866535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 msgr2=0x559d89401020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1d9619b700 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89401020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1d9619b700 1 -- 172.21.15.17:0/234866535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d89166c00 con 0x559d8925a6b0 2023-07-14T13:08:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1d9599a700 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89401020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1d9619b700 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8925a6b0 0x559d89400ae0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0caeb0 tx=0x7f1d8c096620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2f43b2214efa25 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1d79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:08:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1d79ffb700 1 -- 172.21.15.17:0/234866535 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c09a690 con 0x559d8925a6b0 2023-07-14T13:08:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1d79ffb700 1 -- 172.21.15.17:0/234866535 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1d8c094e40 con 0x559d8925a6b0 2023-07-14T13:08:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1dabcddb80 1 -- 172.21.15.17:0/234866535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d80004cc0 con 0x559d8925a6b0 2023-07-14T13:08:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1d79ffb700 1 -- 172.21.15.17:0/234866535 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d8c00cdd0 con 0x559d8925a6b0 2023-07-14T13:08:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1dabcddb80 10 client.17202 fetch_fsmap learned FSMap version 31 2023-07-14T13:08:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.758+0000 7f1dabcddb80 1 -- 172.21.15.17:0/234866535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f1d8001d040 con 0x559d8925a6b0 2023-07-14T13:08:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.759+0000 7f1d79ffb700 1 -- 172.21.15.17:0/234866535 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d80004cc0 con 0x559d8925a6b0 2023-07-14T13:08:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.759+0000 7f1d79ffb700 1 -- 172.21.15.17:0/234866535 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1d8c0b4d90 con 0x559d8925a6b0 2023-07-14T13:08:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.759+0000 7f1dabcddb80 10 client.17202 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:08:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.759+0000 7f1dabcddb80 10 client.17202 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.759+0000 7f1dabcddb80 20 client.17202 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.759+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8946c650 0x559d8946ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.759+0000 7f1dabcddb80 4 client.17202 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:08:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.759+0000 7f1dabcddb80 1 -- 172.21.15.17:0/234866535 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559d8930aff0 con 0x559d8946c650 2023-07-14T13:08:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.759+0000 7f1d9599a700 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8946c650 0x559d8946ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.760+0000 7f1d79ffb700 10 client.17202 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.760+0000 7f1d9599a700 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8946c650 0x559d8946ea60 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7bce86b078d5db6 server_cookie=966cbe1f20bb37cd in_seq=0 out_seq=0 2023-07-14T13:08:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:33900000 of 50000000 tuples (67%) done (elapsed 493.40 s, remaining 234.33 s) 2023-07-14T13:08:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.773+0000 7f1d79ffb700 1 -- 172.21.15.17:0/234866535 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559d8930aff0 con 0x559d8946c650 2023-07-14T13:08:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.773+0000 7f1d79ffb700 10 client.17202 handle_command_reply: tid=0 2023-07-14T13:08:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.773+0000 7f1dabcddb80 1 client.17202 shutdown 2023-07-14T13:08:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.773+0000 7f1dabcddb80 1 -- 172.21.15.17:0/234866535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8925a6b0 msgr2=0x559d89400ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.773+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8925a6b0 0x559d89400ae0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0caeb0 tx=0x7f1d8c096620 comp rx=0 tx=0).stop 2023-07-14T13:08:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.774+0000 7f1dabcddb80 1 -- 172.21.15.17:0/234866535 shutdown_connections 2023-07-14T13:08:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.774+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8946c650 0x559d8946ea60 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.774+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d894042d0 0x559d893ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.774+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8925a6b0 0x559d89400ae0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.774+0000 7f1dabcddb80 1 --2- 172.21.15.17:0/234866535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d893fe580 0x559d89401020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.774+0000 7f1dabcddb80 1 -- 172.21.15.17:0/234866535 >> 172.21.15.17:0/234866535 conn(0x559d893f3be0 msgr2=0x559d89404900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.774+0000 7f1d79ffb700 0 client.17202 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.774+0000 7f1dabcddb80 1 -- 172.21.15.17:0/234866535 shutdown_connections 2023-07-14T13:08:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.774+0000 7f1dabcddb80 1 -- 172.21.15.17:0/234866535 wait complete. 2023-07-14T13:08:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.775+0000 7f1dabcddb80 20 client.17202 trim_cache size 0 max 16384 2023-07-14T13:08:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:08:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:08:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:08:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:08:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.775+0000 7f1d983ff700 1 -- 172.21.15.17:0/957192221 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1d7c0a12c0 msgr2=0x7f1d7c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.775+0000 7f1d983ff700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1d7c0a12c0 0x7f1d7c0a3770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800d010 tx=0x7f1d880099e0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.775+0000 7f1d983ff700 1 -- 172.21.15.17:0/957192221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900ffb30 msgr2=0x7f1d900729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.775+0000 7f1d983ff700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900ffb30 0x7f1d900729f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00eb30 tx=0x7f1d8c00ee40 comp rx=0 tx=0).stop 2023-07-14T13:08:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.776+0000 7f1d983ff700 1 -- 172.21.15.17:0/957192221 shutdown_connections 2023-07-14T13:08:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.776+0000 7f1d983ff700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1d7c0a12c0 0x7f1d7c0a3770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.776+0000 7f1d983ff700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d90105b60 0x7f1d901a3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.776+0000 7f1d983ff700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d900ffb30 0x7f1d900729f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.776+0000 7f1d983ff700 1 --2- 172.21.15.17:0/957192221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d901004e0 0x7f1d90072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.776+0000 7f1d983ff700 1 -- 172.21.15.17:0/957192221 >> 172.21.15.17:0/957192221 conn(0x7f1d900fb5f0 msgr2=0x7f1d90103650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.776+0000 7f1d983ff700 1 -- 172.21.15.17:0/957192221 shutdown_connections 2023-07-14T13:08:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:23.776+0000 7f1d983ff700 1 -- 172.21.15.17:0/957192221 wait complete. 2023-07-14T13:08:25.099 INFO:teuthology.orchestra.run.smithi017.stderr:34000000 of 50000000 tuples (68%) done (elapsed 494.70 s, remaining 232.80 s) 2023-07-14T13:08:25.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:25 smithi017 ceph-mon[95536]: pgmap v269: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 22 MiB/s wr, 50 op/s 2023-07-14T13:08:25.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:25 smithi135 ceph-mon[97338]: pgmap v269: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 22 MiB/s wr, 50 op/s 2023-07-14T13:08:25.501 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:25 smithi131 ceph-mon[96953]: pgmap v269: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 22 MiB/s wr, 50 op/s 2023-07-14T13:08:26.531 INFO:teuthology.orchestra.run.smithi017.stderr:34100000 of 50000000 tuples (68%) done (elapsed 496.13 s, remaining 231.33 s) 2023-07-14T13:08:27.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:27 smithi017 ceph-mon[95536]: pgmap v270: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 31 MiB/s wr, 72 op/s 2023-07-14T13:08:27.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:27 smithi135 ceph-mon[97338]: pgmap v270: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 31 MiB/s wr, 72 op/s 2023-07-14T13:08:27.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:27 smithi131 ceph-mon[96953]: pgmap v270: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 31 MiB/s wr, 72 op/s 2023-07-14T13:08:27.866 INFO:teuthology.orchestra.run.smithi017.stderr:34200000 of 50000000 tuples (68%) done (elapsed 497.47 s, remaining 229.82 s) 2023-07-14T13:08:29.170 INFO:teuthology.orchestra.run.smithi017.stderr:34300000 of 50000000 tuples (68%) done (elapsed 498.77 s, remaining 228.30 s) 2023-07-14T13:08:29.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:29 smithi017 ceph-mon[95536]: pgmap v271: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 20 MiB/s wr, 46 op/s 2023-07-14T13:08:29.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:29 smithi135 ceph-mon[97338]: pgmap v271: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 20 MiB/s wr, 46 op/s 2023-07-14T13:08:29.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:29 smithi131 ceph-mon[96953]: pgmap v271: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 20 MiB/s wr, 46 op/s 2023-07-14T13:08:30.521 INFO:teuthology.orchestra.run.smithi017.stderr:34400000 of 50000000 tuples (68%) done (elapsed 500.12 s, remaining 226.80 s) 2023-07-14T13:08:30.983 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:08:31.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.199+0000 7f6ef69ff700 1 -- 172.21.15.17:0/4262672782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef00728b0 msgr2=0x7f6ef0072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.199+0000 7f6ef69ff700 1 --2- 172.21.15.17:0/4262672782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef00728b0 0x7f6ef0072c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00098f0 tx=0x7f6ee0009c00 comp rx=0 tx=0).stop 2023-07-14T13:08:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.200+0000 7f6ef69ff700 1 -- 172.21.15.17:0/4262672782 shutdown_connections 2023-07-14T13:08:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.200+0000 7f6ef69ff700 1 --2- 172.21.15.17:0/4262672782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef010c310 0x7f6ef010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.200+0000 7f6ef69ff700 1 --2- 172.21.15.17:0/4262672782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef00728b0 0x7f6ef0072c80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.200+0000 7f6ef69ff700 1 --2- 172.21.15.17:0/4262672782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef00731c0 0x7f6ef010bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.200+0000 7f6ef69ff700 1 -- 172.21.15.17:0/4262672782 >> 172.21.15.17:0/4262672782 conn(0x7f6ef00fb5f0 msgr2=0x7f6ef00fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.200+0000 7f6ef69ff700 1 -- 172.21.15.17:0/4262672782 shutdown_connections 2023-07-14T13:08:31.237 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.200+0000 7f6ef69ff700 1 -- 172.21.15.17:0/4262672782 wait complete. 2023-07-14T13:08:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.201+0000 7f6ef69ff700 1 Processor -- start 2023-07-14T13:08:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.201+0000 7f6ef69ff700 1 -- start start 2023-07-14T13:08:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6ef69ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef00728b0 0x7f6ef0197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6ef69ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef00731c0 0x7f6ef01982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6ef69ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef010c310 0x7f6ef019c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6ef69ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef019cd90 con 0x7f6ef00731c0 2023-07-14T13:08:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6ef69ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef019cf00 con 0x7f6ef010c310 2023-07-14T13:08:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6ef69ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef019d0c0 con 0x7f6ef00728b0 2023-07-14T13:08:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef00728b0 0x7f6ef0197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef00728b0 0x7f6ef0197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54840/0 (socket says 172.21.15.17:54840) 2023-07-14T13:08:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6eeffff700 1 -- 172.21.15.17:0/3362683180 learned_addr learned my addr 172.21.15.17:0/3362683180 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6ef4f9c700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef010c310 0x7f6ef019c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6eef7fe700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef00731c0 0x7f6ef01982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6eeffff700 1 -- 172.21.15.17:0/3362683180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef010c310 msgr2=0x7f6ef019c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:31.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.202+0000 7f6eeffff700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef010c310 0x7f6ef019c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.203+0000 7f6eeffff700 1 -- 172.21.15.17:0/3362683180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef00731c0 msgr2=0x7f6ef01982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.203+0000 7f6eeffff700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef00731c0 0x7f6ef01982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.203+0000 7f6eeffff700 1 -- 172.21.15.17:0/3362683180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee40095f0 con 0x7f6ef00728b0 2023-07-14T13:08:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.203+0000 7f6eeffff700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef00728b0 0x7f6ef0197db0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009810 tx=0x7f6ee000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.203+0000 7f6eed7fa700 1 -- 172.21.15.17:0/3362683180 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee001c070 con 0x7f6ef00728b0 2023-07-14T13:08:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.203+0000 7f6ef69ff700 1 -- 172.21.15.17:0/3362683180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee0009520 con 0x7f6ef00728b0 2023-07-14T13:08:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.203+0000 7f6eed7fa700 1 -- 172.21.15.17:0/3362683180 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ee000baf0 con 0x7f6ef00728b0 2023-07-14T13:08:31.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.203+0000 7f6eed7fa700 1 -- 172.21.15.17:0/3362683180 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0004930 con 0x7f6ef00728b0 2023-07-14T13:08:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.203+0000 7f6ef69ff700 1 -- 172.21.15.17:0/3362683180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef01a4a00 con 0x7f6ef00728b0 2023-07-14T13:08:31.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.207+0000 7f6eed7fa700 1 -- 172.21.15.17:0/3362683180 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6ee0020070 con 0x7f6ef00728b0 2023-07-14T13:08:31.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.209+0000 7f6f0a28fb80 1 Processor -- start 2023-07-14T13:08:31.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.209+0000 7f6f0a28fb80 1 -- start start 2023-07-14T13:08:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.209+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.209+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c3be0 0x5557483ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.209+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483cead0 0x5557483d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.209+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557482c9cb0 con 0x5557483cead0 2023-07-14T13:08:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.209+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55574831ca40 con 0x5557483c32d0 2023-07-14T13:08:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.209+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555748315ed0 con 0x5557483c3be0 2023-07-14T13:08:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6ef4f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6ef4f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483c36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44140/0 (socket says 172.21.15.17:44140) 2023-07-14T13:08:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6ef4f9c700 1 -- 172.21.15.17:0/2299738233 learned_addr learned my addr 172.21.15.17:0/2299738233 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6eef7fe700 1 --2- 172.21.15.17:0/2299738233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483cead0 0x5557483d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6eeffff700 1 --2- 172.21.15.17:0/2299738233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c3be0 0x5557483ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6eed7fa700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ed80a12c0 0x7f6ed80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6eed7fa700 1 -- 172.21.15.17:0/3362683180 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6ee00cd9a0 con 0x7f6ef00728b0 2023-07-14T13:08:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6ef4f9c700 1 -- 172.21.15.17:0/2299738233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c3be0 msgr2=0x5557483ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6ef4f9c700 1 --2- 172.21.15.17:0/2299738233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c3be0 0x5557483ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6ef4f9c700 1 -- 172.21.15.17:0/2299738233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483cead0 msgr2=0x5557483d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6ef4f9c700 1 --2- 172.21.15.17:0/2299738233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483cead0 0x5557483d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6ef4f9c700 1 -- 172.21.15.17:0/2299738233 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555748143de0 con 0x5557483c32d0 2023-07-14T13:08:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.210+0000 7f6ef4f9c700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ed80a12c0 0x7f6ed80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.211+0000 7f6ef4f9c700 1 --2- 172.21.15.17:0/2299738233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483c36a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8011790 tx=0x7f6ee8011aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a906d3975a55234 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.211+0000 7f6ed67fc700 1 -- 172.21.15.17:0/2299738233 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee800e040 con 0x5557483c32d0 2023-07-14T13:08:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.211+0000 7f6ef4f9c700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ed80a12c0 0x7f6ed80a3770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8022000 tx=0x7f6ee801f000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.211+0000 7f6ed67fc700 1 -- 172.21.15.17:0/2299738233 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ee800f040 con 0x5557483c32d0 2023-07-14T13:08:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.211+0000 7f6ed67fc700 1 -- 172.21.15.17:0/2299738233 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80236b0 con 0x5557483c32d0 2023-07-14T13:08:31.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.212+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2299738233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 msgr2=0x5557483c36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.212+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/2299738233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483c36a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8011790 tx=0x7f6ee8011aa0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.212+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2299738233 shutdown_connections 2023-07-14T13:08:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.212+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/2299738233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483cead0 0x5557483d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.212+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/2299738233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483c36a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.212+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/2299738233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c3be0 0x5557483ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.212+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2299738233 >> 172.21.15.17:0/2299738233 conn(0x5557483b9da0 msgr2=0x5557483bf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.212+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2299738233 shutdown_connections 2023-07-14T13:08:31.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.212+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2299738233 wait complete. 2023-07-14T13:08:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.213+0000 7f6f0a28fb80 1 -- start start 2023-07-14T13:08:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.213+0000 7f6f0a28fb80 1 Processor -- start 2023-07-14T13:08:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483c3be0 0x5557483cb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483cead0 0x5557483cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557482b5ac0 con 0x5557483c3be0 2023-07-14T13:08:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557482b57c0 con 0x5557483c32d0 2023-07-14T13:08:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555748199920 con 0x5557483cead0 2023-07-14T13:08:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6f0a28fb80 10 client.0 _ll_register_callbacks cb 0x5557482b3760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6eef7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483c3be0 0x5557483cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44152/0 (socket says 172.21.15.17:44152) 2023-07-14T13:08:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6eeffff700 1 -- 172.21.15.17:0/474516891 learned_addr learned my addr 172.21.15.17:0/474516891 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:31.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6ef4f9c700 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483cead0 0x5557483cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6eeffff700 1 -- 172.21.15.17:0/474516891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483cead0 msgr2=0x5557483cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6eeffff700 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483cead0 0x5557483cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6eeffff700 1 -- 172.21.15.17:0/474516891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483c3be0 msgr2=0x5557483cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6eeffff700 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483c3be0 0x5557483cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6eeffff700 1 -- 172.21.15.17:0/474516891 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee8011380 con 0x5557483c32d0 2023-07-14T13:08:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.214+0000 7f6eef7fe700 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483c3be0 0x5557483cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:31.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.215+0000 7f6eeffff700 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ee009a820 tx=0x7f6ee000bc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1179c5cfdd6cf1b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.215+0000 7f6ecf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:08:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.215+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/474516891 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee009a210 con 0x5557483c32d0 2023-07-14T13:08:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.215+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/474516891 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6ee00a2ee0 con 0x5557483c32d0 2023-07-14T13:08:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.215+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/474516891 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55574826f4f0 con 0x5557483c32d0 2023-07-14T13:08:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.215+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/474516891 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ee00053c0 con 0x5557483c32d0 2023-07-14T13:08:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.215+0000 7f6f0a28fb80 10 client.26942 fetch_fsmap learned FSMap version 31 2023-07-14T13:08:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.215+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/474516891 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55574812cc60 con 0x5557483c32d0 2023-07-14T13:08:31.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.215+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/474516891 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55574826f4f0 con 0x5557483c32d0 2023-07-14T13:08:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.216+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/474516891 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6ee00a2a50 con 0x5557483c32d0 2023-07-14T13:08:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.216+0000 7f6f0a28fb80 10 client.26942 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:08:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.216+0000 7f6f0a28fb80 10 client.26942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.216+0000 7f6f0a28fb80 20 client.26942 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.216+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5557483de070 0x5557483e0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.216+0000 7f6f0a28fb80 4 client.26942 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:08:31.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.216+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/474516891 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55574830eeb0 con 0x5557483de070 2023-07-14T13:08:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.216+0000 7f6eef7fe700 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5557483de070 0x5557483e0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.217+0000 7f6ecf7fe700 10 client.26942 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:31.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.217+0000 7f6eef7fe700 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5557483de070 0x5557483e0480 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae5ee46cf6540b5 server_cookie=de3f426b1d49aa09 in_seq=0 out_seq=0 2023-07-14T13:08:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/474516891 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55574830eeb0 con 0x5557483de070 2023-07-14T13:08:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6ecf7fe700 10 client.26942 handle_command_reply: tid=0 2023-07-14T13:08:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6f0a28fb80 1 client.26942 shutdown 2023-07-14T13:08:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/474516891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 msgr2=0x5557483ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ee009a820 tx=0x7f6ee000bc60 comp rx=0 tx=0).stop 2023-07-14T13:08:31.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/474516891 shutdown_connections 2023-07-14T13:08:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5557483de070 0x5557483e0480 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483cead0 0x5557483cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce560 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/474516891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483c3be0 0x5557483cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6ecf7fe700 0 client.26942 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/474516891 >> 172.21.15.17:0/474516891 conn(0x5557483b9da0 msgr2=0x5557483bf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:31.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/474516891 shutdown_connections 2023-07-14T13:08:31.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.218+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/474516891 wait complete. 2023-07-14T13:08:31.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.219+0000 7f6f0a28fb80 20 client.26942 trim_cache size 0 max 16384 2023-07-14T13:08:31.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.244+0000 7f6f0a28fb80 1 Processor -- start 2023-07-14T13:08:31.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.244+0000 7f6f0a28fb80 1 -- start start 2023-07-14T13:08:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.244+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.244+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c3be0 0x5557483c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.244+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483cead0 0x5557483c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.244+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557483b9970 con 0x5557483cead0 2023-07-14T13:08:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.244+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557483c51a0 con 0x5557483c32d0 2023-07-14T13:08:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.244+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557483da3a0 con 0x5557483c3be0 2023-07-14T13:08:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6eef7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c3be0 0x5557483c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44164/0 (socket says 172.21.15.17:44164) 2023-07-14T13:08:31.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6eeffff700 1 -- 172.21.15.17:0/1573173412 learned_addr learned my addr 172.21.15.17:0/1573173412 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6ef4f9c700 1 --2- 172.21.15.17:0/1573173412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483cead0 0x5557483c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6eeffff700 1 -- 172.21.15.17:0/1573173412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c3be0 msgr2=0x5557483c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6eeffff700 1 --2- 172.21.15.17:0/1573173412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c3be0 0x5557483c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6eeffff700 1 -- 172.21.15.17:0/1573173412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483cead0 msgr2=0x5557483c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6eeffff700 1 --2- 172.21.15.17:0/1573173412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483cead0 0x5557483c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6eeffff700 1 -- 172.21.15.17:0/1573173412 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55574816a250 con 0x5557483c32d0 2023-07-14T13:08:31.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6eef7fe700 1 --2- 172.21.15.17:0/1573173412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c3be0 0x5557483c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:31.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6ef4f9c700 1 --2- 172.21.15.17:0/1573173412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483cead0 0x5557483c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:31.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.245+0000 7f6eeffff700 1 --2- 172.21.15.17:0/1573173412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0005e90 tx=0x7f6ee0096910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29262f7eef586538 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:31.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.246+0000 7f6ed6ffd700 1 -- 172.21.15.17:0/1573173412 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00053c0 con 0x5557483c32d0 2023-07-14T13:08:31.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.246+0000 7f6ed6ffd700 1 -- 172.21.15.17:0/1573173412 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ee0096c70 con 0x5557483c32d0 2023-07-14T13:08:31.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.246+0000 7f6ed6ffd700 1 -- 172.21.15.17:0/1573173412 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00b3110 con 0x5557483c32d0 2023-07-14T13:08:31.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.246+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/1573173412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 msgr2=0x5557483ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.246+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/1573173412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0005e90 tx=0x7f6ee0096910 comp rx=0 tx=0).stop 2023-07-14T13:08:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.246+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/1573173412 shutdown_connections 2023-07-14T13:08:31.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.246+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/1573173412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483cead0 0x5557483c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.246+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/1573173412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483c32d0 0x5557483ce100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.246+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/1573173412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c3be0 0x5557483c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.246+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/1573173412 >> 172.21.15.17:0/1573173412 conn(0x5557483b9da0 msgr2=0x5557483d9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:31.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.247+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/1573173412 shutdown_connections 2023-07-14T13:08:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.247+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/1573173412 wait complete. 2023-07-14T13:08:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.247+0000 7f6f0a28fb80 1 -- start start 2023-07-14T13:08:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.247+0000 7f6f0a28fb80 1 Processor -- start 2023-07-14T13:08:31.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c32d0 0x55574842b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483c3be0 0x55574842b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6f0a28fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483cead0 0x5557483d34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557483d3a10 con 0x5557483c3be0 2023-07-14T13:08:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557483d3b80 con 0x5557483cead0 2023-07-14T13:08:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6f0a28fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557483d3d40 con 0x5557483c32d0 2023-07-14T13:08:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6f0a28fb80 10 client.0 _ll_register_callbacks cb 0x7f6ee009a660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c32d0 0x55574842b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6eeffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c32d0 0x55574842b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54872/0 (socket says 172.21.15.17:54872) 2023-07-14T13:08:31.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6ef4f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483cead0 0x5557483d34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6eeffff700 1 -- 172.21.15.17:0/2763524834 learned_addr learned my addr 172.21.15.17:0/2763524834 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6eef7fe700 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483c3be0 0x55574842b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6eeffff700 1 -- 172.21.15.17:0/2763524834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483cead0 msgr2=0x5557483d34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6eeffff700 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483cead0 0x5557483d34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6eeffff700 1 -- 172.21.15.17:0/2763524834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483c3be0 msgr2=0x55574842b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:31.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6eeffff700 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483c3be0 0x55574842b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.248+0000 7f6eeffff700 1 -- 172.21.15.17:0/2763524834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee4021a50 con 0x5557483c32d0 2023-07-14T13:08:31.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.249+0000 7f6eeffff700 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c32d0 0x55574842b1d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ee002e040 tx=0x7f6ee00a2c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=904aaa7eead6a543 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:31.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.249+0000 7f6ecf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:08:31.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.249+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/2763524834 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee009a210 con 0x5557483c32d0 2023-07-14T13:08:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.249+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/2763524834 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6ee00a2ee0 con 0x5557483c32d0 2023-07-14T13:08:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.249+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2763524834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ee800f040 con 0x5557483c32d0 2023-07-14T13:08:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.249+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/2763524834 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ee00053c0 con 0x5557483c32d0 2023-07-14T13:08:31.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.249+0000 7f6f0a28fb80 10 client.26917 fetch_fsmap learned FSMap version 31 2023-07-14T13:08:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.249+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2763524834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f6ee8027070 con 0x5557483c32d0 2023-07-14T13:08:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.250+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/2763524834 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ee800f040 con 0x5557483c32d0 2023-07-14T13:08:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.250+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/2763524834 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6ee0004a90 con 0x5557483c32d0 2023-07-14T13:08:31.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.250+0000 7f6f0a28fb80 10 client.26917 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:08:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.250+0000 7f6f0a28fb80 10 client.26917 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.250+0000 7f6f0a28fb80 20 client.26917 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.250+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555748432a90 0x555748434e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:31.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.250+0000 7f6f0a28fb80 4 client.26917 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:08:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.250+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2763524834 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5557482d1050 con 0x555748432a90 2023-07-14T13:08:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.250+0000 7f6eef7fe700 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555748432a90 0x555748434e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.251+0000 7f6eef7fe700 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555748432a90 0x555748434e70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=534793df335d7921 server_cookie=248e96c4085e8974 in_seq=0 out_seq=0 2023-07-14T13:08:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.251+0000 7f6ecf7fe700 10 client.26917 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.251+0000 7f6ecf7fe700 1 -- 172.21.15.17:0/2763524834 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5557482d1050 con 0x555748432a90 2023-07-14T13:08:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.251+0000 7f6ecf7fe700 10 client.26917 handle_command_reply: tid=0 2023-07-14T13:08:31.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.251+0000 7f6f0a28fb80 1 client.26917 shutdown 2023-07-14T13:08:31.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.251+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2763524834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c32d0 msgr2=0x55574842b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:31.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.251+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c32d0 0x55574842b1d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ee002e040 tx=0x7f6ee00a2c80 comp rx=0 tx=0).stop 2023-07-14T13:08:31.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2763524834 shutdown_connections 2023-07-14T13:08:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555748432a90 0x555748434e70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557483cead0 0x5557483d34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5557483c32d0 0x55574842b1d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6f0a28fb80 1 --2- 172.21.15.17:0/2763524834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5557483c3be0 0x55574842b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2763524834 >> 172.21.15.17:0/2763524834 conn(0x5557483b9da0 msgr2=0x5557483c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6ecf7fe700 0 client.26917 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2763524834 shutdown_connections 2023-07-14T13:08:31.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6f0a28fb80 1 -- 172.21.15.17:0/2763524834 wait complete. 2023-07-14T13:08:31.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6f0a28fb80 20 client.26917 trim_cache size 0 max 16384 2023-07-14T13:08:31.304 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:08:31.305 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:08:31.305 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:08:31.305 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:08:31.306 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:08:31.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:08:31.306 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:08:31.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:08:31.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:08:31.307 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:08:31.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6ef69ff700 1 -- 172.21.15.17:0/3362683180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ed80a12c0 msgr2=0x7f6ed80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:31.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.252+0000 7f6ef69ff700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ed80a12c0 0x7f6ed80a3770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8022000 tx=0x7f6ee801f000 comp rx=0 tx=0).stop 2023-07-14T13:08:31.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.253+0000 7f6ef69ff700 1 -- 172.21.15.17:0/3362683180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef00728b0 msgr2=0x7f6ef0197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:31.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.253+0000 7f6ef69ff700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef00728b0 0x7f6ef0197db0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0009810 tx=0x7f6ee000fa00 comp rx=0 tx=0).stop 2023-07-14T13:08:31.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.253+0000 7f6ef69ff700 1 -- 172.21.15.17:0/3362683180 shutdown_connections 2023-07-14T13:08:31.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.253+0000 7f6ef69ff700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6ed80a12c0 0x7f6ed80a3770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.253+0000 7f6ef69ff700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ef010c310 0x7f6ef019c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.253+0000 7f6ef69ff700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef00728b0 0x7f6ef0197db0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.253+0000 7f6ef69ff700 1 --2- 172.21.15.17:0/3362683180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef00731c0 0x7f6ef01982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:31.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.253+0000 7f6ef69ff700 1 -- 172.21.15.17:0/3362683180 >> 172.21.15.17:0/3362683180 conn(0x7f6ef00fb5f0 msgr2=0x7f6ef00fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:31.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.253+0000 7f6ef69ff700 1 -- 172.21.15.17:0/3362683180 shutdown_connections 2023-07-14T13:08:31.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:08:31.253+0000 7f6ef69ff700 1 -- 172.21.15.17:0/3362683180 wait complete. 2023-07-14T13:08:31.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:31 smithi017 ceph-mon[95536]: pgmap v272: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 31 MiB/s wr, 86 op/s 2023-07-14T13:08:31.311 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:08:31.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:31 smithi135 ceph-mon[97338]: pgmap v272: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 31 MiB/s wr, 86 op/s 2023-07-14T13:08:31.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:31 smithi131 ceph-mon[96953]: pgmap v272: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 31 MiB/s wr, 86 op/s 2023-07-14T13:08:31.959 INFO:teuthology.orchestra.run.smithi017.stderr:34500000 of 50000000 tuples (69%) done (elapsed 501.56 s, remaining 225.34 s) 2023-07-14T13:08:33.265 INFO:teuthology.orchestra.run.smithi017.stderr:34600000 of 50000000 tuples (69%) done (elapsed 502.87 s, remaining 223.82 s) 2023-07-14T13:08:33.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:33 smithi017 ceph-mon[95536]: pgmap v273: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 20 MiB/s wr, 61 op/s 2023-07-14T13:08:33.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:33 smithi135 ceph-mon[97338]: pgmap v273: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 20 MiB/s wr, 61 op/s 2023-07-14T13:08:33.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:33 smithi131 ceph-mon[96953]: pgmap v273: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 20 MiB/s wr, 61 op/s 2023-07-14T13:08:34.640 INFO:teuthology.orchestra.run.smithi017.stderr:34700000 of 50000000 tuples (69%) done (elapsed 504.24 s, remaining 222.33 s) 2023-07-14T13:08:35.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:35 smithi017 ceph-mon[95536]: pgmap v274: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 20 MiB/s wr, 61 op/s 2023-07-14T13:08:35.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:35 smithi135 ceph-mon[97338]: pgmap v274: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 20 MiB/s wr, 61 op/s 2023-07-14T13:08:35.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:35 smithi131 ceph-mon[96953]: pgmap v274: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 20 MiB/s wr, 61 op/s 2023-07-14T13:08:36.093 INFO:teuthology.orchestra.run.smithi017.stderr:34800000 of 50000000 tuples (69%) done (elapsed 505.69 s, remaining 220.88 s) 2023-07-14T13:08:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.949+0000 7f626a59d700 1 -- 172.21.15.17:0/799519104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6264072830 msgr2=0x7f6264072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.949+0000 7f626a59d700 1 --2- 172.21.15.17:0/799519104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6264072830 0x7f6264072c00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6260009990 tx=0x7f6260009ca0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.949+0000 7f626a59d700 1 -- 172.21.15.17:0/799519104 shutdown_connections 2023-07-14T13:08:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.949+0000 7f626a59d700 1 --2- 172.21.15.17:0/799519104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f626410c210 0x7f626410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.949+0000 7f626a59d700 1 --2- 172.21.15.17:0/799519104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6264072830 0x7f6264072c00 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.949+0000 7f626a59d700 1 --2- 172.21.15.17:0/799519104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6264073140 0x7f626410bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.949+0000 7f626a59d700 1 -- 172.21.15.17:0/799519104 >> 172.21.15.17:0/799519104 conn(0x7f62640fb470 msgr2=0x7f62640fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.949+0000 7f626a59d700 1 -- 172.21.15.17:0/799519104 shutdown_connections 2023-07-14T13:08:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.949+0000 7f626a59d700 1 -- 172.21.15.17:0/799519104 wait complete. 2023-07-14T13:08:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.950+0000 7f626a59d700 1 Processor -- start 2023-07-14T13:08:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.950+0000 7f626a59d700 1 -- start start 2023-07-14T13:08:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.950+0000 7f626a59d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6264072830 0x7f626419d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.950+0000 7f626a59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6264073140 0x7f626419de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.950+0000 7f626a59d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626410c210 0x7f62641979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.950+0000 7f626a59d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6264198030 con 0x7f626410c210 2023-07-14T13:08:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.950+0000 7f626a59d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62641981a0 con 0x7f6264072830 2023-07-14T13:08:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.950+0000 7f626a59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6264198360 con 0x7f6264073140 2023-07-14T13:08:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.951+0000 7f626959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6264072830 0x7f626419d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.951+0000 7f6268d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6264073140 0x7f626419de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.951+0000 7f626959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6264072830 0x7f626419d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:37734/0 (socket says 172.21.15.17:37734) 2023-07-14T13:08:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.951+0000 7f626959b700 1 -- 172.21.15.17:0/909242350 learned_addr learned my addr 172.21.15.17:0/909242350 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.951+0000 7f6269d9c700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626410c210 0x7f62641979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.951+0000 7f6268d9a700 1 -- 172.21.15.17:0/909242350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6264072830 msgr2=0x7f626419d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.951+0000 7f6268d9a700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6264072830 0x7f626419d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.951+0000 7f6268d9a700 1 -- 172.21.15.17:0/909242350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626410c210 msgr2=0x7f62641979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.951+0000 7f6268d9a700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626410c210 0x7f62641979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.951+0000 7f6268d9a700 1 -- 172.21.15.17:0/909242350 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600095f0 con 0x7f6264073140 2023-07-14T13:08:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.952+0000 7f6268d9a700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6264073140 0x7f626419de90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f625400e9f0 tx=0x7f625400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.952+0000 7f625a7fc700 1 -- 172.21.15.17:0/909242350 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625400c9c0 con 0x7f6264073140 2023-07-14T13:08:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.952+0000 7f626a59d700 1 -- 172.21.15.17:0/909242350 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6264198640 con 0x7f6264073140 2023-07-14T13:08:36.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.952+0000 7f625a7fc700 1 -- 172.21.15.17:0/909242350 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6254010430 con 0x7f6264073140 2023-07-14T13:08:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.952+0000 7f625a7fc700 1 -- 172.21.15.17:0/909242350 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254018680 con 0x7f6264073140 2023-07-14T13:08:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.952+0000 7f626a59d700 1 -- 172.21.15.17:0/909242350 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62641a4940 con 0x7f6264073140 2023-07-14T13:08:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.956+0000 7f625a7fc700 1 -- 172.21.15.17:0/909242350 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f62540105a0 con 0x7f6264073140 2023-07-14T13:08:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.957+0000 7f627f151b80 1 Processor -- start 2023-07-14T13:08:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.957+0000 7f627f151b80 1 -- start start 2023-07-14T13:08:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.957+0000 7f625a7fc700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62500a12c0 0x7f62500a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.957+0000 7f627f151b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 0x55651137cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.957+0000 7f627f151b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d470 0x5565113771a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.957+0000 7f627f151b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d8c0 0x556511377700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.957+0000 7f627f151b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55651127cc50 con 0x55651137d470 2023-07-14T13:08:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.957+0000 7f627f151b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565112cf9e0 con 0x5565111d36b0 2023-07-14T13:08:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.957+0000 7f627f151b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565112c8e70 con 0x55651137d8c0 2023-07-14T13:08:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f625a7fc700 1 -- 172.21.15.17:0/909242350 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6254014070 con 0x7f6264073140 2023-07-14T13:08:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f6269d9c700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62500a12c0 0x7f62500a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f626959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 0x55651137cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f626959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 0x55651137cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:37738/0 (socket says 172.21.15.17:37738) 2023-07-14T13:08:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f626959b700 1 -- 172.21.15.17:0/1132988632 learned_addr learned my addr 172.21.15.17:0/1132988632 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f6268d9a700 1 --2- 172.21.15.17:0/1132988632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d470 0x5565113771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:36.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f6269d9c700 1 --2- 172.21.15.17:0/1132988632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d8c0 0x556511377700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f626959b700 1 -- 172.21.15.17:0/1132988632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d8c0 msgr2=0x556511377700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f626959b700 1 --2- 172.21.15.17:0/1132988632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d8c0 0x556511377700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f626959b700 1 -- 172.21.15.17:0/1132988632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d470 msgr2=0x5565113771a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f626959b700 1 --2- 172.21.15.17:0/1132988632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d470 0x5565113771a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f626959b700 1 -- 172.21.15.17:0/1132988632 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565110f6d80 con 0x5565111d36b0 2023-07-14T13:08:37.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.958+0000 7f6269d9c700 1 --2- 172.21.15.17:0/1132988632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d8c0 0x556511377700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.959+0000 7f626959b700 1 --2- 172.21.15.17:0/1132988632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 0x55651137cf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6260005bf0 tx=0x7f6260005c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90b4c52bd528e2b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.959+0000 7f6269d9c700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62500a12c0 0x7f62500a3770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55651137dcd0 tx=0x7f625c009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.959+0000 7f624f7fe700 1 -- 172.21.15.17:0/1132988632 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626001d070 con 0x5565111d36b0 2023-07-14T13:08:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.959+0000 7f624f7fe700 1 -- 172.21.15.17:0/1132988632 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f626001e040 con 0x5565111d36b0 2023-07-14T13:08:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.959+0000 7f624f7fe700 1 -- 172.21.15.17:0/1132988632 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260004900 con 0x5565111d36b0 2023-07-14T13:08:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.960+0000 7f627f151b80 1 -- 172.21.15.17:0/1132988632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 msgr2=0x55651137cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.960+0000 7f627f151b80 1 --2- 172.21.15.17:0/1132988632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 0x55651137cf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6260005bf0 tx=0x7f6260005c20 comp rx=0 tx=0).stop 2023-07-14T13:08:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.960+0000 7f627f151b80 1 -- 172.21.15.17:0/1132988632 shutdown_connections 2023-07-14T13:08:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.960+0000 7f627f151b80 1 --2- 172.21.15.17:0/1132988632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d8c0 0x556511377700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.960+0000 7f627f151b80 1 --2- 172.21.15.17:0/1132988632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 0x55651137cf30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.960+0000 7f627f151b80 1 --2- 172.21.15.17:0/1132988632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d470 0x5565113771a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.960+0000 7f627f151b80 1 -- 172.21.15.17:0/1132988632 >> 172.21.15.17:0/1132988632 conn(0x55651136cd40 msgr2=0x556511372340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.960+0000 7f627f151b80 1 -- 172.21.15.17:0/1132988632 shutdown_connections 2023-07-14T13:08:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.960+0000 7f627f151b80 1 -- 172.21.15.17:0/1132988632 wait complete. 2023-07-14T13:08:37.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.961+0000 7f627f151b80 1 -- start start 2023-07-14T13:08:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.961+0000 7f627f151b80 1 Processor -- start 2023-07-14T13:08:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.961+0000 7f627f151b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 0x5565113836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.961+0000 7f627f151b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 0x556511380940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.961+0000 7f627f151b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d8c0 0x556511380ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.961+0000 7f627f151b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511268a60 con 0x55651137d8c0 2023-07-14T13:08:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.961+0000 7f627f151b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556511268760 con 0x5565111d36b0 2023-07-14T13:08:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.961+0000 7f627f151b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55651114c8c0 con 0x55651137d470 2023-07-14T13:08:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f627f151b80 10 client.0 _ll_register_callbacks cb 0x556511266700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f6268d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 0x556511380940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f626959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 0x5565113836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f6268d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 0x556511380940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44186/0 (socket says 172.21.15.17:44186) 2023-07-14T13:08:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f626959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 0x5565113836c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:37742/0 (socket says 172.21.15.17:37742) 2023-07-14T13:08:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f6268d9a700 1 -- 172.21.15.17:0/3896521659 learned_addr learned my addr 172.21.15.17:0/3896521659 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:37.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f6269d9c700 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d8c0 0x556511380ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f6268d9a700 1 -- 172.21.15.17:0/3896521659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 msgr2=0x5565113836c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f6268d9a700 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 0x5565113836c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f6268d9a700 1 -- 172.21.15.17:0/3896521659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d8c0 msgr2=0x556511380ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f6268d9a700 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d8c0 0x556511380ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.962+0000 7f6268d9a700 1 -- 172.21.15.17:0/3896521659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626410f1f0 con 0x55651137d470 2023-07-14T13:08:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.963+0000 7f6268d9a700 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 0x556511380940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6254099ee0 tx=0x7f6254010880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1013c056c122b20 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.963+0000 7f624cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:08:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.963+0000 7f624cff9700 1 -- 172.21.15.17:0/3896521659 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625409df80 con 0x55651137d470 2023-07-14T13:08:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.963+0000 7f624cff9700 1 -- 172.21.15.17:0/3896521659 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f62540a23a0 con 0x55651137d470 2023-07-14T13:08:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.963+0000 7f627f151b80 1 -- 172.21.15.17:0/3896521659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556511222490 con 0x55651137d470 2023-07-14T13:08:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.963+0000 7f624cff9700 1 -- 172.21.15.17:0/3896521659 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62540b82e0 con 0x55651137d470 2023-07-14T13:08:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.963+0000 7f627f151b80 10 client.26929 fetch_fsmap learned FSMap version 31 2023-07-14T13:08:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.963+0000 7f627f151b80 1 -- 172.21.15.17:0/3896521659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5565110dfc00 con 0x55651137d470 2023-07-14T13:08:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.963+0000 7f624cff9700 1 -- 172.21.15.17:0/3896521659 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556511222490 con 0x55651137d470 2023-07-14T13:08:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.963+0000 7f624cff9700 1 -- 172.21.15.17:0/3896521659 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6254095d40 con 0x55651137d470 2023-07-14T13:08:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.964+0000 7f627f151b80 10 client.26929 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:08:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.964+0000 7f627f151b80 10 client.26929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.964+0000 7f627f151b80 20 client.26929 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.964+0000 7f627f151b80 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556511390d90 0x5565113931a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.964+0000 7f627f151b80 4 client.26929 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:08:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.964+0000 7f627f151b80 1 -- 172.21.15.17:0/3896521659 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565112c1e50 con 0x556511390d90 2023-07-14T13:08:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.964+0000 7f626959b700 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556511390d90 0x5565113931a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.965+0000 7f626959b700 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556511390d90 0x5565113931a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adf0cb087f82c991 server_cookie=4c9c8f47c2945659 in_seq=0 out_seq=0 2023-07-14T13:08:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.965+0000 7f624cff9700 10 client.26929 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.965+0000 7f624cff9700 1 -- 172.21.15.17:0/3896521659 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5565112c1e50 con 0x556511390d90 2023-07-14T13:08:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.965+0000 7f624cff9700 10 client.26929 handle_command_reply: tid=0 2023-07-14T13:08:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.965+0000 7f627f151b80 1 client.26929 shutdown 2023-07-14T13:08:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f627f151b80 1 -- 172.21.15.17:0/3896521659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 msgr2=0x556511380940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f627f151b80 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 0x556511380940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6254099ee0 tx=0x7f6254010880 comp rx=0 tx=0).stop 2023-07-14T13:08:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f627f151b80 1 -- 172.21.15.17:0/3896521659 shutdown_connections 2023-07-14T13:08:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f627f151b80 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556511390d90 0x5565113931a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f627f151b80 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d8c0 0x556511380ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f627f151b80 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565111d36b0 0x5565113836c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f627f151b80 1 --2- 172.21.15.17:0/3896521659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 0x556511380940 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f624cff9700 0 client.26929 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f627f151b80 1 -- 172.21.15.17:0/3896521659 >> 172.21.15.17:0/3896521659 conn(0x55651136cd40 msgr2=0x556511370db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f627f151b80 1 -- 172.21.15.17:0/3896521659 shutdown_connections 2023-07-14T13:08:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f627f151b80 1 -- 172.21.15.17:0/3896521659 wait complete. 2023-07-14T13:08:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.966+0000 7f627f151b80 20 client.26929 trim_cache size 0 max 16384 2023-07-14T13:08:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.989+0000 7f627f151b80 1 Processor -- start 2023-07-14T13:08:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.989+0000 7f627f151b80 1 -- start start 2023-07-14T13:08:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.989+0000 7f627f151b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565111d36b0 0x55651137e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.989+0000 7f627f151b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 0x556511371dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.989+0000 7f627f151b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55651137d8c0 0x556511372300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.989+0000 7f627f151b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565113783c0 con 0x5565111d36b0 2023-07-14T13:08:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.989+0000 7f627f151b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55651137d2c0 con 0x55651137d8c0 2023-07-14T13:08:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.989+0000 7f627f151b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55651137e950 con 0x55651137d470 2023-07-14T13:08:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.989+0000 7f6268d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 0x556511371dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.989+0000 7f626959b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565111d36b0 0x55651137e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.990+0000 7f626959b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565111d36b0 0x55651137e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52612/0 (socket says 172.21.15.17:52612) 2023-07-14T13:08:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.990+0000 7f626959b700 1 -- 172.21.15.17:0/3315237622 learned_addr learned my addr 172.21.15.17:0/3315237622 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.990+0000 7f6269d9c700 1 --2- 172.21.15.17:0/3315237622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55651137d8c0 0x556511372300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.990+0000 7f6268d9a700 1 -- 172.21.15.17:0/3315237622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55651137d8c0 msgr2=0x556511372300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.990+0000 7f6268d9a700 1 --2- 172.21.15.17:0/3315237622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55651137d8c0 0x556511372300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.990+0000 7f6268d9a700 1 -- 172.21.15.17:0/3315237622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565111d36b0 msgr2=0x55651137e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.990+0000 7f6268d9a700 1 --2- 172.21.15.17:0/3315237622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565111d36b0 0x55651137e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.990+0000 7f6268d9a700 1 -- 172.21.15.17:0/3315237622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556511397dd0 con 0x55651137d470 2023-07-14T13:08:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.990+0000 7f626959b700 1 --2- 172.21.15.17:0/3315237622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565111d36b0 0x55651137e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.990+0000 7f6268d9a700 1 --2- 172.21.15.17:0/3315237622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 0x556511371dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f62540982a0 tx=0x7f625409a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54efdf8f4cbe6bb4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.990+0000 7f624ffff700 1 -- 172.21.15.17:0/3315237622 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540b82e0 con 0x55651137d470 2023-07-14T13:08:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.991+0000 7f624ffff700 1 -- 172.21.15.17:0/3315237622 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6254099220 con 0x55651137d470 2023-07-14T13:08:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.991+0000 7f624ffff700 1 -- 172.21.15.17:0/3315237622 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254094c80 con 0x55651137d470 2023-07-14T13:08:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.991+0000 7f627f151b80 1 -- 172.21.15.17:0/3315237622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 msgr2=0x556511371dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.991+0000 7f627f151b80 1 --2- 172.21.15.17:0/3315237622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 0x556511371dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f62540982a0 tx=0x7f625409a0d0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.991+0000 7f627f151b80 1 -- 172.21.15.17:0/3315237622 shutdown_connections 2023-07-14T13:08:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.991+0000 7f627f151b80 1 --2- 172.21.15.17:0/3315237622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55651137d8c0 0x556511372300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.991+0000 7f627f151b80 1 --2- 172.21.15.17:0/3315237622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565111d36b0 0x55651137e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.991+0000 7f627f151b80 1 --2- 172.21.15.17:0/3315237622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55651137d470 0x556511371dc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.991+0000 7f627f151b80 1 -- 172.21.15.17:0/3315237622 >> 172.21.15.17:0/3315237622 conn(0x55651136cd40 msgr2=0x55651137dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.991+0000 7f627f151b80 1 -- 172.21.15.17:0/3315237622 shutdown_connections 2023-07-14T13:08:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.991+0000 7f627f151b80 1 -- 172.21.15.17:0/3315237622 wait complete. 2023-07-14T13:08:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.992+0000 7f627f151b80 1 -- start start 2023-07-14T13:08:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.992+0000 7f627f151b80 1 Processor -- start 2023-07-14T13:08:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f627f151b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565111d36b0 0x556511385cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f627f151b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d470 0x5565113861f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f627f151b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55651137d8c0 0x556511386730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f627f151b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565113e3d30 con 0x55651137d470 2023-07-14T13:08:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f627f151b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565113e3ea0 con 0x55651137d8c0 2023-07-14T13:08:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f627f151b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565113e4060 con 0x5565111d36b0 2023-07-14T13:08:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f627f151b80 10 client.0 _ll_register_callbacks cb 0x7f6254099ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f626959b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565111d36b0 0x556511385cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f6268d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d470 0x5565113861f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f626959b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565111d36b0 0x556511385cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44208/0 (socket says 172.21.15.17:44208) 2023-07-14T13:08:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f626959b700 1 -- 172.21.15.17:0/456871212 learned_addr learned my addr 172.21.15.17:0/456871212 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f6268d9a700 1 -- 172.21.15.17:0/456871212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565111d36b0 msgr2=0x556511385cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f6269d9c700 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55651137d8c0 0x556511386730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f6268d9a700 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565111d36b0 0x556511385cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f6268d9a700 1 -- 172.21.15.17:0/456871212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55651137d8c0 msgr2=0x556511386730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f6268d9a700 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55651137d8c0 0x556511386730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f6268d9a700 1 -- 172.21.15.17:0/456871212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565110f6d80 con 0x55651137d470 2023-07-14T13:08:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f626959b700 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565111d36b0 0x556511385cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.993+0000 7f6269d9c700 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55651137d8c0 0x556511386730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:08:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.994+0000 7f6268d9a700 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d470 0x5565113861f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f62540982a0 tx=0x7f6254099960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac95d9fa922dab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.994+0000 7f624cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:08:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.994+0000 7f624cff9700 1 -- 172.21.15.17:0/456871212 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540a2110 con 0x55651137d470 2023-07-14T13:08:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.994+0000 7f627f151b80 1 -- 172.21.15.17:0/456871212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f626001e040 con 0x55651137d470 2023-07-14T13:08:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.994+0000 7f624cff9700 1 -- 172.21.15.17:0/456871212 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f62540b82e0 con 0x55651137d470 2023-07-14T13:08:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.994+0000 7f624cff9700 1 -- 172.21.15.17:0/456871212 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62540a23a0 con 0x55651137d470 2023-07-14T13:08:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.994+0000 7f627f151b80 10 client.17238 fetch_fsmap learned FSMap version 31 2023-07-14T13:08:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.994+0000 7f627f151b80 1 -- 172.21.15.17:0/456871212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5565110dfc00 con 0x55651137d470 2023-07-14T13:08:37.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.995+0000 7f624cff9700 1 -- 172.21.15.17:0/456871212 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f626001e040 con 0x55651137d470 2023-07-14T13:08:37.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.995+0000 7f624cff9700 1 -- 172.21.15.17:0/456871212 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 31) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f62540ca290 con 0x55651137d470 2023-07-14T13:08:37.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.995+0000 7f627f151b80 10 client.17238 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T13:08:37.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.995+0000 7f627f151b80 10 client.17238 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:37.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.995+0000 7f627f151b80 20 client.17238 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:37.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.995+0000 7f627f151b80 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565113e52f0 0x5565113e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:37.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.995+0000 7f627f151b80 4 client.17238 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:08:37.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.995+0000 7f627f151b80 1 -- 172.21.15.17:0/456871212 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556511283ff0 con 0x5565113e52f0 2023-07-14T13:08:37.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.995+0000 7f626959b700 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565113e52f0 0x5565113e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:37.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.996+0000 7f626959b700 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565113e52f0 0x5565113e76d0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61522f8ab017499b server_cookie=1868b20d2160bb18 in_seq=0 out_seq=0 2023-07-14T13:08:37.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:36.996+0000 7f624cff9700 10 client.17238 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f624cff9700 1 -- 172.21.15.17:0/456871212 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556511283ff0 con 0x5565113e52f0 2023-07-14T13:08:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f624cff9700 10 client.17238 handle_command_reply: tid=0 2023-07-14T13:08:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f627f151b80 1 client.17238 shutdown 2023-07-14T13:08:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f627f151b80 1 -- 172.21.15.17:0/456871212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d470 msgr2=0x5565113861f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f627f151b80 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d470 0x5565113861f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f62540982a0 tx=0x7f6254099960 comp rx=0 tx=0).stop 2023-07-14T13:08:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f627f151b80 1 -- 172.21.15.17:0/456871212 shutdown_connections 2023-07-14T13:08:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f627f151b80 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565113e52f0 0x5565113e76d0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f627f151b80 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55651137d8c0 0x556511386730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f627f151b80 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565111d36b0 0x556511385cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f627f151b80 1 --2- 172.21.15.17:0/456871212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55651137d470 0x5565113861f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f624cff9700 0 client.17238 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f627f151b80 1 -- 172.21.15.17:0/456871212 >> 172.21.15.17:0/456871212 conn(0x55651136cd40 msgr2=0x556511382250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f627f151b80 1 -- 172.21.15.17:0/456871212 shutdown_connections 2023-07-14T13:08:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.009+0000 7f627f151b80 1 -- 172.21.15.17:0/456871212 wait complete. 2023-07-14T13:08:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f627f151b80 20 client.17238 trim_cache size 0 max 16384 2023-07-14T13:08:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:08:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:08:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:08:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:08:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f626a59d700 1 -- 172.21.15.17:0/909242350 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62500a12c0 msgr2=0x7f62500a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f626a59d700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62500a12c0 0x7f62500a3770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55651137dcd0 tx=0x7f625c009920 comp rx=0 tx=0).stop 2023-07-14T13:08:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f626a59d700 1 -- 172.21.15.17:0/909242350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6264073140 msgr2=0x7f626419de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f626a59d700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6264073140 0x7f626419de90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f625400e9f0 tx=0x7f625400ed00 comp rx=0 tx=0).stop 2023-07-14T13:08:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f626a59d700 1 -- 172.21.15.17:0/909242350 shutdown_connections 2023-07-14T13:08:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f626a59d700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62500a12c0 0x7f62500a3770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f626a59d700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f626410c210 0x7f62641979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f626a59d700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6264072830 0x7f626419d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f626a59d700 1 --2- 172.21.15.17:0/909242350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6264073140 0x7f626419de90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f626a59d700 1 -- 172.21.15.17:0/909242350 >> 172.21.15.17:0/909242350 conn(0x7f62640fb470 msgr2=0x7f626410e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.010+0000 7f626a59d700 1 -- 172.21.15.17:0/909242350 shutdown_connections 2023-07-14T13:08:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:37.011+0000 7f626a59d700 1 -- 172.21.15.17:0/909242350 wait complete. 2023-07-14T13:08:37.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:37 smithi017 ceph-mon[95536]: pgmap v275: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 31 MiB/s wr, 98 op/s 2023-07-14T13:08:37.441 INFO:teuthology.orchestra.run.smithi017.stderr:34900000 of 50000000 tuples (69%) done (elapsed 507.04 s, remaining 219.38 s) 2023-07-14T13:08:37.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:37 smithi135 ceph-mon[97338]: pgmap v275: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 31 MiB/s wr, 98 op/s 2023-07-14T13:08:37.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:37 smithi131 ceph-mon[96953]: pgmap v275: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 31 MiB/s wr, 98 op/s 2023-07-14T13:08:38.361 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:38 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:08:38.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:38 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:08:38.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:38 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:08:38.746 INFO:teuthology.orchestra.run.smithi017.stderr:35000000 of 50000000 tuples (70%) done (elapsed 508.35 s, remaining 217.86 s) 2023-07-14T13:08:39.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:39 smithi135 ceph-mon[97338]: pgmap v276: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 22 MiB/s wr, 76 op/s 2023-07-14T13:08:39.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:39 smithi131 ceph-mon[96953]: pgmap v276: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 22 MiB/s wr, 76 op/s 2023-07-14T13:08:39.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:39 smithi017 ceph-mon[95536]: pgmap v276: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 22 MiB/s wr, 76 op/s 2023-07-14T13:08:40.056 INFO:teuthology.orchestra.run.smithi017.stderr:35100000 of 50000000 tuples (70%) done (elapsed 509.66 s, remaining 216.35 s) 2023-07-14T13:08:41.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:41 smithi135 ceph-mon[97338]: pgmap v277: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 33 MiB/s wr, 112 op/s 2023-07-14T13:08:41.463 INFO:teuthology.orchestra.run.smithi017.stderr:35200000 of 50000000 tuples (70%) done (elapsed 511.06 s, remaining 214.88 s) 2023-07-14T13:08:41.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:41 smithi131 ceph-mon[96953]: pgmap v277: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 33 MiB/s wr, 112 op/s 2023-07-14T13:08:41.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:41 smithi017 ceph-mon[95536]: pgmap v277: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 33 MiB/s wr, 112 op/s 2023-07-14T13:08:43.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:43 smithi135 ceph-mon[97338]: pgmap v278: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 22 MiB/s wr, 72 op/s 2023-07-14T13:08:43.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:43 smithi131 ceph-mon[96953]: pgmap v278: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 22 MiB/s wr, 72 op/s 2023-07-14T13:08:43.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:43 smithi017 ceph-mon[95536]: pgmap v278: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 22 MiB/s wr, 72 op/s 2023-07-14T13:08:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:35300000 of 50000000 tuples (70%) done (elapsed 514.20 s, remaining 214.13 s) 2023-07-14T13:08:45.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:45 smithi135 ceph-mon[97338]: pgmap v279: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 22 MiB/s wr, 72 op/s 2023-07-14T13:08:45.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:45 smithi131 ceph-mon[96953]: pgmap v279: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 22 MiB/s wr, 72 op/s 2023-07-14T13:08:45.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:45 smithi017 ceph-mon[95536]: pgmap v279: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 22 MiB/s wr, 72 op/s 2023-07-14T13:08:45.908 INFO:teuthology.orchestra.run.smithi017.stderr:35400000 of 50000000 tuples (70%) done (elapsed 515.51 s, remaining 212.61 s) 2023-07-14T13:08:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:35500000 of 50000000 tuples (71%) done (elapsed 516.80 s, remaining 211.09 s) 2023-07-14T13:08:47.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:47 smithi135 ceph-mon[97338]: pgmap v280: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 29 MiB/s wr, 91 op/s 2023-07-14T13:08:47.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:47 smithi131 ceph-mon[96953]: pgmap v280: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 29 MiB/s wr, 91 op/s 2023-07-14T13:08:47.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:47 smithi017 ceph-mon[95536]: pgmap v280: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 29 MiB/s wr, 91 op/s 2023-07-14T13:08:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:35600000 of 50000000 tuples (71%) done (elapsed 518.21 s, remaining 209.61 s) 2023-07-14T13:08:49.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:49 smithi135 ceph-mon[97338]: pgmap v281: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 18 MiB/s wr, 54 op/s 2023-07-14T13:08:49.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:49 smithi131 ceph-mon[96953]: pgmap v281: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 18 MiB/s wr, 54 op/s 2023-07-14T13:08:49.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:49 smithi017 ceph-mon[95536]: pgmap v281: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 18 MiB/s wr, 54 op/s 2023-07-14T13:08:49.975 INFO:teuthology.orchestra.run.smithi017.stderr:35700000 of 50000000 tuples (71%) done (elapsed 519.57 s, remaining 208.12 s) 2023-07-14T13:08:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.176+0000 7f15d93ff700 1 -- 172.21.15.17:0/156421856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4102970 msgr2=0x7f15d4106930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.176+0000 7f15d93ff700 1 --2- 172.21.15.17:0/156421856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4102970 0x7f15d4106930 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009920 tx=0x7f15c8009c30 comp rx=0 tx=0).stop 2023-07-14T13:08:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.176+0000 7f15d93ff700 1 -- 172.21.15.17:0/156421856 shutdown_connections 2023-07-14T13:08:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.176+0000 7f15d93ff700 1 --2- 172.21.15.17:0/156421856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15d4107010 0x7f15d410ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.176+0000 7f15d93ff700 1 --2- 172.21.15.17:0/156421856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15d4101fd0 0x7f15d41023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.176+0000 7f15d93ff700 1 --2- 172.21.15.17:0/156421856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4102970 0x7f15d4106930 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.176+0000 7f15d93ff700 1 -- 172.21.15.17:0/156421856 >> 172.21.15.17:0/156421856 conn(0x7f15d40fd840 msgr2=0x7f15d40ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.176+0000 7f15d93ff700 1 -- 172.21.15.17:0/156421856 shutdown_connections 2023-07-14T13:08:50.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.176+0000 7f15d93ff700 1 -- 172.21.15.17:0/156421856 wait complete. 2023-07-14T13:08:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.177+0000 7f15d93ff700 1 Processor -- start 2023-07-14T13:08:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.177+0000 7f15d93ff700 1 -- start start 2023-07-14T13:08:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d93ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4101fd0 0x7f15d4197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d93ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15d4102970 0x7f15d4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d93ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15d4107010 0x7f15d419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d93ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d419d030 con 0x7f15d4101fd0 2023-07-14T13:08:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d93ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d419d1a0 con 0x7f15d4107010 2023-07-14T13:08:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d93ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d419d360 con 0x7f15d4102970 2023-07-14T13:08:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4101fd0 0x7f15d4197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15d4102970 0x7f15d4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15d4102970 0x7f15d4198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38786/0 (socket says 172.21.15.17:38786) 2023-07-14T13:08:50.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d27fc700 1 -- 172.21.15.17:0/837549652 learned_addr learned my addr 172.21.15.17:0/837549652 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d37fe700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15d4107010 0x7f15d419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d27fc700 1 -- 172.21.15.17:0/837549652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15d4107010 msgr2=0x7f15d419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d27fc700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15d4107010 0x7f15d419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d27fc700 1 -- 172.21.15.17:0/837549652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4101fd0 msgr2=0x7f15d4197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d27fc700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4101fd0 0x7f15d4197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.178+0000 7f15d27fc700 1 -- 172.21.15.17:0/837549652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c8009520 con 0x7f15d4102970 2023-07-14T13:08:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.179+0000 7f15d27fc700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15d4102970 0x7f15d4198380 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009230 tx=0x7f15c800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.179+0000 7f15bbfff700 1 -- 172.21.15.17:0/837549652 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c801c070 con 0x7f15d4102970 2023-07-14T13:08:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.179+0000 7f15d93ff700 1 -- 172.21.15.17:0/837549652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d419d5e0 con 0x7f15d4102970 2023-07-14T13:08:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.179+0000 7f15bbfff700 1 -- 172.21.15.17:0/837549652 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15c800baf0 con 0x7f15d4102970 2023-07-14T13:08:50.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.179+0000 7f15bbfff700 1 -- 172.21.15.17:0/837549652 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c80038e0 con 0x7f15d4102970 2023-07-14T13:08:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.179+0000 7f15d93ff700 1 -- 172.21.15.17:0/837549652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d41a4e80 con 0x7f15d4102970 2023-07-14T13:08:50.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.183+0000 7f15bbfff700 1 -- 172.21.15.17:0/837549652 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f15c8020030 con 0x7f15d4102970 2023-07-14T13:08:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.184+0000 7f15ecd5cb80 1 Processor -- start 2023-07-14T13:08:50.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.184+0000 7f15ecd5cb80 1 -- start start 2023-07-14T13:08:50.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15bbfff700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f15bc0a12c0 0x7f15bc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15bbfff700 1 -- 172.21.15.17:0/837549652 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f15c80cdb70 con 0x7f15d4102970 2023-07-14T13:08:50.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edb7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb82d0 0x55611edb2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 0x55611edb29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611ecb7c50 con 0x55611edb82d0 2023-07-14T13:08:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611ed0a9e0 con 0x55611edb2580 2023-07-14T13:08:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611ed03e70 con 0x55611ec0e6b0 2023-07-14T13:08:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15d37fe700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f15bc0a12c0 0x7f15bc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15d2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edb7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15d37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 0x55611edb29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15d2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edb7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38798/0 (socket says 172.21.15.17:38798) 2023-07-14T13:08:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15d2ffd700 1 -- 172.21.15.17:0/2515693975 learned_addr learned my addr 172.21.15.17:0/2515693975 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.185+0000 7f15d27fc700 1 --2- 172.21.15.17:0/2515693975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb82d0 0x55611edb2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.186+0000 7f15d2ffd700 1 -- 172.21.15.17:0/2515693975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 msgr2=0x55611edb29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.186+0000 7f15d2ffd700 1 --2- 172.21.15.17:0/2515693975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 0x55611edb29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.186+0000 7f15d2ffd700 1 -- 172.21.15.17:0/2515693975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb82d0 msgr2=0x55611edb2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.186+0000 7f15d2ffd700 1 --2- 172.21.15.17:0/2515693975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb82d0 0x55611edb2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.186+0000 7f15d2ffd700 1 -- 172.21.15.17:0/2515693975 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55611eb31d80 con 0x55611ec0e6b0 2023-07-14T13:08:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.186+0000 7f15d27fc700 1 --2- 172.21.15.17:0/2515693975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb82d0 0x55611edb2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:08:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.186+0000 7f15d37fe700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f15bc0a12c0 0x7f15bc0a3770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009ec0 tx=0x7f15cc013250 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.186+0000 7f15d2ffd700 1 --2- 172.21.15.17:0/2515693975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edb7d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009d60 tx=0x7f15c4011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6cc7a9cb9dd3534 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.186+0000 7f15b97fa700 1 -- 172.21.15.17:0/2515693975 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4019630 con 0x55611ec0e6b0 2023-07-14T13:08:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.186+0000 7f15b97fa700 1 -- 172.21.15.17:0/2515693975 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15c4019c20 con 0x55611ec0e6b0 2023-07-14T13:08:50.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.186+0000 7f15b97fa700 1 -- 172.21.15.17:0/2515693975 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c400ea80 con 0x55611ec0e6b0 2023-07-14T13:08:50.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.187+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2515693975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 msgr2=0x55611edb7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.187+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/2515693975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edb7d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009d60 tx=0x7f15c4011720 comp rx=0 tx=0).stop 2023-07-14T13:08:50.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.187+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2515693975 shutdown_connections 2023-07-14T13:08:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.187+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/2515693975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 0x55611edb29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.187+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/2515693975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edb7d90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.187+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/2515693975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb82d0 0x55611edb2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.187+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2515693975 >> 172.21.15.17:0/2515693975 conn(0x55611eda7be0 msgr2=0x55611edacf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.187+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2515693975 shutdown_connections 2023-07-14T13:08:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.188+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2515693975 wait complete. 2023-07-14T13:08:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.188+0000 7f15ecd5cb80 1 -- start start 2023-07-14T13:08:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.188+0000 7f15ecd5cb80 1 Processor -- start 2023-07-14T13:08:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611ec0e6b0 0x55611edbe5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 0x55611edbb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611edb82d0 0x55611edbbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611eca3a60 con 0x55611edb2580 2023-07-14T13:08:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611eca3760 con 0x55611ec0e6b0 2023-07-14T13:08:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611eb878c0 con 0x55611edb82d0 2023-07-14T13:08:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15ecd5cb80 10 client.0 _ll_register_callbacks cb 0x55611eca1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15d2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611ec0e6b0 0x55611edbe5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15d27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 0x55611edbb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15d2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611ec0e6b0 0x55611edbe5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:47886/0 (socket says 172.21.15.17:47886) 2023-07-14T13:08:50.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15d2ffd700 1 -- 172.21.15.17:0/407805076 learned_addr learned my addr 172.21.15.17:0/407805076 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:50.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.189+0000 7f15d37fe700 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611edb82d0 0x55611edbbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.190+0000 7f15d2ffd700 1 -- 172.21.15.17:0/407805076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611edb82d0 msgr2=0x55611edbbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:50.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.190+0000 7f15d2ffd700 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611edb82d0 0x55611edbbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.190+0000 7f15d2ffd700 1 -- 172.21.15.17:0/407805076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 msgr2=0x55611edbb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:50.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.190+0000 7f15d2ffd700 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 0x55611edbb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.190+0000 7f15d2ffd700 1 -- 172.21.15.17:0/407805076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c40099c0 con 0x55611ec0e6b0 2023-07-14T13:08:50.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.190+0000 7f15d2ffd700 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611ec0e6b0 0x55611edbe5f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f15c40093c0 tx=0x7f15c4019ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f701fe15eb9c83dd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:50.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.190+0000 7f15b6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:08:50.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.190+0000 7f15b6ff5700 1 -- 172.21.15.17:0/407805076 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4005240 con 0x55611ec0e6b0 2023-07-14T13:08:50.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.190+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/407805076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55611ec5d490 con 0x55611ec0e6b0 2023-07-14T13:08:50.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.190+0000 7f15b6ff5700 1 -- 172.21.15.17:0/407805076 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f15c40053a0 con 0x55611ec0e6b0 2023-07-14T13:08:50.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.191+0000 7f15b6ff5700 1 -- 172.21.15.17:0/407805076 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15c4005560 con 0x55611ec0e6b0 2023-07-14T13:08:50.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.191+0000 7f15ecd5cb80 10 client.26975 fetch_fsmap learned FSMap version 32 2023-07-14T13:08:50.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.191+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/407805076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55611eb1ac00 con 0x55611ec0e6b0 2023-07-14T13:08:50.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.191+0000 7f15b6ff5700 1 -- 172.21.15.17:0/407805076 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55611ec5d490 con 0x55611ec0e6b0 2023-07-14T13:08:50.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.191+0000 7f15b6ff5700 1 -- 172.21.15.17:0/407805076 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 32) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f15c400e840 con 0x55611ec0e6b0 2023-07-14T13:08:50.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.191+0000 7f15ecd5cb80 10 client.26975 fetch_fsmap finished waiting for FSMap version 32 2023-07-14T13:08:50.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.191+0000 7f15ecd5cb80 10 client.26975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:50.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.191+0000 7f15ecd5cb80 20 client.26975 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:50.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.191+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55611edcba00 0x55611edcde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.191+0000 7f15ecd5cb80 4 client.26975 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:08:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.191+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/407805076 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55611ecfce50 con 0x55611edcba00 2023-07-14T13:08:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.192+0000 7f15d27fc700 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55611edcba00 0x55611edcde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.192+0000 7f15d27fc700 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55611edcba00 0x55611edcde10 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=237712182eae2a9d server_cookie=e2d3e205fdec228a in_seq=0 out_seq=0 2023-07-14T13:08:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.192+0000 7f15b6ff5700 10 client.26975 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15b6ff5700 1 -- 172.21.15.17:0/407805076 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55611ecfce50 con 0x55611edcba00 2023-07-14T13:08:50.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15b6ff5700 10 client.26975 handle_command_reply: tid=0 2023-07-14T13:08:50.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15ecd5cb80 1 client.26975 shutdown 2023-07-14T13:08:50.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/407805076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611ec0e6b0 msgr2=0x55611edbe5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611ec0e6b0 0x55611edbe5f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f15c40093c0 tx=0x7f15c4019ab0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/407805076 shutdown_connections 2023-07-14T13:08:50.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55611edcba00 0x55611edcde10 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611edb82d0 0x55611edbbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611ec0e6b0 0x55611edbe5f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15b6ff5700 0 client.26975 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/407805076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 0x55611edbb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/407805076 >> 172.21.15.17:0/407805076 conn(0x55611eda7be0 msgr2=0x55611edac4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.193+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/407805076 shutdown_connections 2023-07-14T13:08:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.194+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/407805076 wait complete. 2023-07-14T13:08:50.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.194+0000 7f15ecd5cb80 20 client.26975 trim_cache size 0 max 16384 2023-07-14T13:08:50.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.209+0000 7f15ecd5cb80 1 Processor -- start 2023-07-14T13:08:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.209+0000 7f15ecd5cb80 1 -- start start 2023-07-14T13:08:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611ec0e6b0 0x55611edb2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 0x55611edb7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611edb82d0 0x55611edacc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611edbc630 con 0x55611ec0e6b0 2023-07-14T13:08:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611eda4be0 con 0x55611edb2580 2023-07-14T13:08:50.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611edadfe0 con 0x55611edb82d0 2023-07-14T13:08:50.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611edb82d0 0x55611edacc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d27fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 0x55611edb7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611ec0e6b0 0x55611edb2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611edb82d0 0x55611edacc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38824/0 (socket says 172.21.15.17:38824) 2023-07-14T13:08:50.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d37fe700 1 -- 172.21.15.17:0/3290141376 learned_addr learned my addr 172.21.15.17:0/3290141376 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:50.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d27fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 0x55611edb7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:47900/0 (socket says 172.21.15.17:47900) 2023-07-14T13:08:50.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d27fc700 1 -- 172.21.15.17:0/3290141376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611edb82d0 msgr2=0x55611edacc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:50.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d27fc700 1 --2- 172.21.15.17:0/3290141376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611edb82d0 0x55611edacc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d27fc700 1 -- 172.21.15.17:0/3290141376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611ec0e6b0 msgr2=0x55611edb2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:50.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d27fc700 1 --2- 172.21.15.17:0/3290141376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611ec0e6b0 0x55611edb2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d27fc700 1 -- 172.21.15.17:0/3290141376 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55611eb581f0 con 0x55611edb2580 2023-07-14T13:08:50.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.210+0000 7f15d2ffd700 1 --2- 172.21.15.17:0/3290141376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611ec0e6b0 0x55611edb2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:50.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.211+0000 7f15d27fc700 1 --2- 172.21.15.17:0/3290141376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 0x55611edb7150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f15c80cb2e0 tx=0x7f15c8019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ac95fae2a2d059b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:50.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.211+0000 7f15b9ffb700 1 -- 172.21.15.17:0/3290141376 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c809ed20 con 0x55611edb2580 2023-07-14T13:08:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.211+0000 7f15b9ffb700 1 -- 172.21.15.17:0/3290141376 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15c80a30b0 con 0x55611edb2580 2023-07-14T13:08:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.211+0000 7f15b9ffb700 1 -- 172.21.15.17:0/3290141376 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c8005140 con 0x55611edb2580 2023-07-14T13:08:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.212+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/3290141376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 msgr2=0x55611edb7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.212+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/3290141376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 0x55611edb7150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f15c80cb2e0 tx=0x7f15c8019040 comp rx=0 tx=0).stop 2023-07-14T13:08:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.212+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/3290141376 shutdown_connections 2023-07-14T13:08:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.212+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/3290141376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611edb82d0 0x55611edacc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.212+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/3290141376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611ec0e6b0 0x55611edb2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.212+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/3290141376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb2580 0x55611edb7150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.212+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/3290141376 >> 172.21.15.17:0/3290141376 conn(0x55611eda7be0 msgr2=0x55611edb6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.212+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/3290141376 shutdown_connections 2023-07-14T13:08:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.212+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/3290141376 wait complete. 2023-07-14T13:08:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.212+0000 7f15ecd5cb80 1 -- start start 2023-07-14T13:08:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15ecd5cb80 1 Processor -- start 2023-07-14T13:08:50.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edc0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 0x55611edc1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15ecd5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb82d0 0x55611ee1e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611ee1ee00 con 0x55611edb2580 2023-07-14T13:08:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611ee1ef40 con 0x55611edb82d0 2023-07-14T13:08:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15ecd5cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55611ee1f0b0 con 0x55611ec0e6b0 2023-07-14T13:08:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15ecd5cb80 10 client.0 _ll_register_callbacks cb 0x7f15cc01e050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:08:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15d27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 0x55611edc1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15d2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edc0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15d2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edc0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38834/0 (socket says 172.21.15.17:38834) 2023-07-14T13:08:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.214+0000 7f15d2ffd700 1 -- 172.21.15.17:0/2123198641 learned_addr learned my addr 172.21.15.17:0/2123198641 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:08:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.213+0000 7f15d27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 0x55611edc1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49626/0 (socket says 172.21.15.17:49626) 2023-07-14T13:08:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.214+0000 7f15d37fe700 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb82d0 0x55611ee1e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.214+0000 7f15d2ffd700 1 -- 172.21.15.17:0/2123198641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb82d0 msgr2=0x55611ee1e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:50.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.214+0000 7f15d2ffd700 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb82d0 0x55611ee1e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.214+0000 7f15d2ffd700 1 -- 172.21.15.17:0/2123198641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 msgr2=0x55611edc1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:08:50.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.214+0000 7f15d2ffd700 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 0x55611edc1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.214+0000 7f15d2ffd700 1 -- 172.21.15.17:0/2123198641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55611eb1ac00 con 0x55611ec0e6b0 2023-07-14T13:08:50.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.214+0000 7f15d27fc700 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 0x55611edc1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:08:50.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.214+0000 7f15d2ffd700 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edc0e40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009720 tx=0x7f15c40236b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f933a7aff7c15aa1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:08:50.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.214+0000 7f15b6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:08:50.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.214+0000 7f15b6ff5700 1 -- 172.21.15.17:0/2123198641 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c400e9d0 con 0x55611ec0e6b0 2023-07-14T13:08:50.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15b6ff5700 1 -- 172.21.15.17:0/2123198641 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f15c40050b0 con 0x55611ec0e6b0 2023-07-14T13:08:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2123198641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15c4019c20 con 0x55611ec0e6b0 2023-07-14T13:08:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15b6ff5700 1 -- 172.21.15.17:0/2123198641 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15c4005270 con 0x55611ec0e6b0 2023-07-14T13:08:50.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15ecd5cb80 10 client.26953 fetch_fsmap learned FSMap version 32 2023-07-14T13:08:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2123198641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f15d41a4e80 con 0x55611ec0e6b0 2023-07-14T13:08:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15b6ff5700 1 -- 172.21.15.17:0/2123198641 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15c4019c20 con 0x55611ec0e6b0 2023-07-14T13:08:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15b6ff5700 1 -- 172.21.15.17:0/2123198641 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f15c40053d0 con 0x55611ec0e6b0 2023-07-14T13:08:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15ecd5cb80 10 client.26953 fetch_fsmap finished waiting for FSMap version 32 2023-07-14T13:08:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15ecd5cb80 10 client.26953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:08:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15ecd5cb80 20 client.26953 populate_metadata read hostname 'smithi017' 2023-07-14T13:08:50.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55611ee20400 0x55611ee227e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:08:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15ecd5cb80 4 client.26953 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:08:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.215+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2123198641 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55611ecbeff0 con 0x55611ee20400 2023-07-14T13:08:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.216+0000 7f15d27fc700 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55611ee20400 0x55611ee227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:08:50.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.216+0000 7f15d27fc700 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55611ee20400 0x55611ee227e0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b74eafad40a759df server_cookie=73173c80a8aefcf1 in_seq=0 out_seq=0 2023-07-14T13:08:50.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.216+0000 7f15b6ff5700 10 client.26953 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15b6ff5700 1 -- 172.21.15.17:0/2123198641 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55611ecbeff0 con 0x55611ee20400 2023-07-14T13:08:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15b6ff5700 10 client.26953 handle_command_reply: tid=0 2023-07-14T13:08:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15ecd5cb80 1 client.26953 shutdown 2023-07-14T13:08:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2123198641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 msgr2=0x55611edc0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edc0e40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009720 tx=0x7f15c40236b0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2123198641 shutdown_connections 2023-07-14T13:08:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55611ee20400 0x55611ee227e0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55611edb82d0 0x55611ee1e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55611ec0e6b0 0x55611edc0e40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15ecd5cb80 1 --2- 172.21.15.17:0/2123198641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55611edb2580 0x55611edc1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15b6ff5700 0 client.26953 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:08:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2123198641 >> 172.21.15.17:0/2123198641 conn(0x55611eda7be0 msgr2=0x55611edb8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2123198641 shutdown_connections 2023-07-14T13:08:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.230+0000 7f15ecd5cb80 1 -- 172.21.15.17:0/2123198641 wait complete. 2023-07-14T13:08:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.231+0000 7f15ecd5cb80 20 client.26953 trim_cache size 0 max 16384 2023-07-14T13:08:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:08:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:08:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:08:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:08:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.231+0000 7f15d93ff700 1 -- 172.21.15.17:0/837549652 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f15bc0a12c0 msgr2=0x7f15bc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.231+0000 7f15d93ff700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f15bc0a12c0 0x7f15bc0a3770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009ec0 tx=0x7f15cc013250 comp rx=0 tx=0).stop 2023-07-14T13:08:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.231+0000 7f15d93ff700 1 -- 172.21.15.17:0/837549652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15d4102970 msgr2=0x7f15d4198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:08:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.231+0000 7f15d93ff700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15d4102970 0x7f15d4198380 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009230 tx=0x7f15c800fa00 comp rx=0 tx=0).stop 2023-07-14T13:08:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.231+0000 7f15d93ff700 1 -- 172.21.15.17:0/837549652 shutdown_connections 2023-07-14T13:08:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.231+0000 7f15d93ff700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f15bc0a12c0 0x7f15bc0a3770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.231+0000 7f15d93ff700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15d4107010 0x7f15d419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.231+0000 7f15d93ff700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4101fd0 0x7f15d4197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.231+0000 7f15d93ff700 1 --2- 172.21.15.17:0/837549652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15d4102970 0x7f15d4198380 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:08:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.231+0000 7f15d93ff700 1 -- 172.21.15.17:0/837549652 >> 172.21.15.17:0/837549652 conn(0x7f15d40fd840 msgr2=0x7f15d40fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:08:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.232+0000 7f15d93ff700 1 -- 172.21.15.17:0/837549652 shutdown_connections 2023-07-14T13:08:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:08:50.232+0000 7f15d93ff700 1 -- 172.21.15.17:0/837549652 wait complete. 2023-07-14T13:08:51.296 INFO:teuthology.orchestra.run.smithi017.stderr:35800000 of 50000000 tuples (71%) done (elapsed 520.90 s, remaining 206.61 s) 2023-07-14T13:08:51.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:51 smithi135 ceph-mon[97338]: pgmap v282: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 29 MiB/s wr, 77 op/s 2023-07-14T13:08:51.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:51 smithi131 ceph-mon[96953]: pgmap v282: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 29 MiB/s wr, 77 op/s 2023-07-14T13:08:51.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:51 smithi017 ceph-mon[95536]: pgmap v282: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 29 MiB/s wr, 77 op/s 2023-07-14T13:08:52.700 INFO:teuthology.orchestra.run.smithi017.stderr:35900000 of 50000000 tuples (71%) done (elapsed 522.30 s, remaining 205.14 s) 2023-07-14T13:08:53.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:53 smithi135 ceph-mon[97338]: pgmap v283: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 18 MiB/s wr, 41 op/s 2023-07-14T13:08:53.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:53 smithi131 ceph-mon[96953]: pgmap v283: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 18 MiB/s wr, 41 op/s 2023-07-14T13:08:53.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:53 smithi017 ceph-mon[95536]: pgmap v283: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 18 MiB/s wr, 41 op/s 2023-07-14T13:08:55.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:55 smithi135 ceph-mon[97338]: pgmap v284: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 18 MiB/s wr, 41 op/s 2023-07-14T13:08:55.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:55 smithi131 ceph-mon[96953]: pgmap v284: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 18 MiB/s wr, 41 op/s 2023-07-14T13:08:55.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:55 smithi017 ceph-mon[95536]: pgmap v284: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 18 MiB/s wr, 41 op/s 2023-07-14T13:08:55.614 INFO:teuthology.orchestra.run.smithi017.stderr:36000000 of 50000000 tuples (72%) done (elapsed 525.21 s, remaining 204.25 s) 2023-07-14T13:08:56.914 INFO:teuthology.orchestra.run.smithi017.stderr:36100000 of 50000000 tuples (72%) done (elapsed 526.51 s, remaining 202.73 s) 2023-07-14T13:08:57.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:57 smithi135 ceph-mon[97338]: pgmap v285: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 60 op/s 2023-07-14T13:08:57.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:57 smithi131 ceph-mon[96953]: pgmap v285: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 60 op/s 2023-07-14T13:08:57.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:57 smithi017 ceph-mon[95536]: pgmap v285: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 26 MiB/s wr, 60 op/s 2023-07-14T13:08:58.526 INFO:teuthology.orchestra.run.smithi017.stderr:36200000 of 50000000 tuples (72%) done (elapsed 528.13 s, remaining 201.33 s) 2023-07-14T13:08:59.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:08:59 smithi135 ceph-mon[97338]: pgmap v286: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 19 MiB/s wr, 41 op/s 2023-07-14T13:08:59.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:08:59 smithi131 ceph-mon[96953]: pgmap v286: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 19 MiB/s wr, 41 op/s 2023-07-14T13:08:59.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:08:59 smithi017 ceph-mon[95536]: pgmap v286: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 19 MiB/s wr, 41 op/s 2023-07-14T13:08:59.814 INFO:teuthology.orchestra.run.smithi017.stderr:36300000 of 50000000 tuples (72%) done (elapsed 529.41 s, remaining 199.81 s) 2023-07-14T13:09:01.137 INFO:teuthology.orchestra.run.smithi017.stderr:36400000 of 50000000 tuples (72%) done (elapsed 530.74 s, remaining 198.30 s) 2023-07-14T13:09:01.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:09:01.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:01 smithi135 ceph-mon[97338]: pgmap v287: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 29 MiB/s wr, 65 op/s 2023-07-14T13:09:01.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:01 smithi131 ceph-mon[96953]: pgmap v287: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 29 MiB/s wr, 65 op/s 2023-07-14T13:09:01.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.528+0000 7fe605dff700 1 -- 172.21.15.17:0/2105478705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe60010c380 msgr2=0x7fe60010e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:01.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.528+0000 7fe605dff700 1 --2- 172.21.15.17:0/2105478705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe60010c380 0x7fe60010e760 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009f90 tx=0x7fe5f800b330 comp rx=0 tx=0).stop 2023-07-14T13:09:01.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.528+0000 7fe605dff700 1 -- 172.21.15.17:0/2105478705 shutdown_connections 2023-07-14T13:09:01.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.528+0000 7fe605dff700 1 --2- 172.21.15.17:0/2105478705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe60010c380 0x7fe60010e760 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.528+0000 7fe605dff700 1 --2- 172.21.15.17:0/2105478705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe600072850 0x7fe600072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.528+0000 7fe605dff700 1 --2- 172.21.15.17:0/2105478705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe600073160 0x7fe60010be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.528+0000 7fe605dff700 1 -- 172.21.15.17:0/2105478705 >> 172.21.15.17:0/2105478705 conn(0x7fe6000fb5e0 msgr2=0x7fe6000fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:01.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.528+0000 7fe605dff700 1 -- 172.21.15.17:0/2105478705 shutdown_connections 2023-07-14T13:09:01.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.528+0000 7fe605dff700 1 -- 172.21.15.17:0/2105478705 wait complete. 2023-07-14T13:09:01.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.529+0000 7fe605dff700 1 Processor -- start 2023-07-14T13:09:01.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.529+0000 7fe605dff700 1 -- start start 2023-07-14T13:09:01.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.530+0000 7fe605dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe600072850 0x7fe600197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.530+0000 7fe605dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe600073160 0x7fe6001983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.530+0000 7fe605dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe60010c380 0x7fe60019c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.530+0000 7fe605dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60019ce40 con 0x7fe600072850 2023-07-14T13:09:01.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.530+0000 7fe605dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60019cfb0 con 0x7fe600073160 2023-07-14T13:09:01.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.530+0000 7fe605dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60019d170 con 0x7fe60010c380 2023-07-14T13:09:01.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.530+0000 7fe5feffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe600073160 0x7fe6001983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.530+0000 7fe5feffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe600073160 0x7fe6001983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40074/0 (socket says 172.21.15.17:40074) 2023-07-14T13:09:01.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.530+0000 7fe5feffd700 1 -- 172.21.15.17:0/4072484077 learned_addr learned my addr 172.21.15.17:0/4072484077 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:01.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.530+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe600072850 0x7fe600197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.530+0000 7fe5fffff700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe60010c380 0x7fe60019c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.531+0000 7fe5feffd700 1 -- 172.21.15.17:0/4072484077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe60010c380 msgr2=0x7fe60019c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:01.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.531+0000 7fe5feffd700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe60010c380 0x7fe60019c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.531+0000 7fe5feffd700 1 -- 172.21.15.17:0/4072484077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe600072850 msgr2=0x7fe600197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:01.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.531+0000 7fe5feffd700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe600072850 0x7fe600197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.531+0000 7fe5feffd700 1 -- 172.21.15.17:0/4072484077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8009c40 con 0x7fe600073160 2023-07-14T13:09:01.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.531+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe600072850 0x7fe600197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:01.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.531+0000 7fe5feffd700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe600073160 0x7fe6001983a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400e9a0 tx=0x7fe5f400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:01.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.532+0000 7fe5fcff9700 1 -- 172.21.15.17:0/4072484077 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4009790 con 0x7fe600073160 2023-07-14T13:09:01.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.532+0000 7fe5fcff9700 1 -- 172.21.15.17:0/4072484077 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5f400ce50 con 0x7fe600073160 2023-07-14T13:09:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.532+0000 7fe5fcff9700 1 -- 172.21.15.17:0/4072484077 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4018420 con 0x7fe600073160 2023-07-14T13:09:01.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.532+0000 7fe605dff700 1 -- 172.21.15.17:0/4072484077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60019d450 con 0x7fe600073160 2023-07-14T13:09:01.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.532+0000 7fe605dff700 1 -- 172.21.15.17:0/4072484077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6001a4c90 con 0x7fe600073160 2023-07-14T13:09:01.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.537+0000 7fe5fcff9700 1 -- 172.21.15.17:0/4072484077 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe5f4010430 con 0x7fe600073160 2023-07-14T13:09:01.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.538+0000 7fe6197cfb80 1 Processor -- start 2023-07-14T13:09:01.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.538+0000 7fe6197cfb80 1 -- start start 2023-07-14T13:09:01.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.539+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a597f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.539+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f5be0 0x561a59800590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.539+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a59800ad0 0x561a59802eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.539+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a596fbcb0 con 0x561a597f5be0 2023-07-14T13:09:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.539+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a5974ea40 con 0x561a597f52d0 2023-07-14T13:09:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.539+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a59747ed0 con 0x561a59800ad0 2023-07-14T13:09:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.539+0000 7fe5fffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a597f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.539+0000 7fe5fffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a597f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40076/0 (socket says 172.21.15.17:40076) 2023-07-14T13:09:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.539+0000 7fe5fffff700 1 -- 172.21.15.17:0/2230578142 learned_addr learned my addr 172.21.15.17:0/2230578142 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.539+0000 7fe5feffd700 1 --2- 172.21.15.17:0/2230578142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a59800ad0 0x561a59802eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.539+0000 7fe5fcff9700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe5e80a1340 0x7fe5e80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.540+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/2230578142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f5be0 0x561a59800590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.540+0000 7fe5fcff9700 1 -- 172.21.15.17:0/4072484077 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe5f4014070 con 0x7fe600073160 2023-07-14T13:09:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.540+0000 7fe5feffd700 1 -- 172.21.15.17:0/2230578142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 msgr2=0x561a597f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.540+0000 7fe5feffd700 1 --2- 172.21.15.17:0/2230578142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a597f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.540+0000 7fe5feffd700 1 -- 172.21.15.17:0/2230578142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f5be0 msgr2=0x561a59800590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:01.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.540+0000 7fe5feffd700 1 --2- 172.21.15.17:0/2230578142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f5be0 0x561a59800590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.540+0000 7fe5feffd700 1 -- 172.21.15.17:0/2230578142 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a59575de0 con 0x561a59800ad0 2023-07-14T13:09:01.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.540+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/2230578142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f5be0 0x561a59800590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:01.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.540+0000 7fe5fffff700 1 --2- 172.21.15.17:0/2230578142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a597f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:01.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.540+0000 7fe5fffff700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe5e80a1340 0x7fe5e80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.540+0000 7fe5feffd700 1 --2- 172.21.15.17:0/2230578142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a59800ad0 0x561a59802eb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40ca520 tx=0x7fe5f4099880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fb20764a33fe8e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:01.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.541+0000 7fe5e5ffb700 1 -- 172.21.15.17:0/2230578142 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4099ea0 con 0x561a59800ad0 2023-07-14T13:09:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.541+0000 7fe5e5ffb700 1 -- 172.21.15.17:0/2230578142 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5f409ded0 con 0x561a59800ad0 2023-07-14T13:09:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.541+0000 7fe5e5ffb700 1 -- 172.21.15.17:0/2230578142 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f409a360 con 0x561a59800ad0 2023-07-14T13:09:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.542+0000 7fe6197cfb80 1 -- 172.21.15.17:0/2230578142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a59800ad0 msgr2=0x561a59802eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.542+0000 7fe5fffff700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe5e80a1340 0x7fe5e80a37f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009f90 tx=0x7fe5f8009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.542+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/2230578142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a59800ad0 0x561a59802eb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40ca520 tx=0x7fe5f4099880 comp rx=0 tx=0).stop 2023-07-14T13:09:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.542+0000 7fe6197cfb80 1 -- 172.21.15.17:0/2230578142 shutdown_connections 2023-07-14T13:09:01.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.542+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/2230578142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a59800ad0 0x561a59802eb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.542+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/2230578142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a597f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.542+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/2230578142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f5be0 0x561a59800590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.542+0000 7fe6197cfb80 1 -- 172.21.15.17:0/2230578142 >> 172.21.15.17:0/2230578142 conn(0x561a597ebda0 msgr2=0x561a597f16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.542+0000 7fe6197cfb80 1 -- 172.21.15.17:0/2230578142 shutdown_connections 2023-07-14T13:09:01.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.542+0000 7fe6197cfb80 1 -- 172.21.15.17:0/2230578142 wait complete. 2023-07-14T13:09:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.543+0000 7fe6197cfb80 1 -- start start 2023-07-14T13:09:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.543+0000 7fe6197cfb80 1 Processor -- start 2023-07-14T13:09:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f52d0 0x561a59800550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f5be0 0x561a597fd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a59800ad0 0x561a597fdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a596e7ac0 con 0x561a597f52d0 2023-07-14T13:09:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a596e77c0 con 0x561a59800ad0 2023-07-14T13:09:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a595cb920 con 0x561a597f5be0 2023-07-14T13:09:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe6197cfb80 10 client.0 _ll_register_callbacks cb 0x561a596e5760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe5ff7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f52d0 0x561a59800550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe5ff7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f52d0 0x561a59800550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46288/0 (socket says 172.21.15.17:46288) 2023-07-14T13:09:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/715173792 learned_addr learned my addr 172.21.15.17:0/715173792 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe5fffff700 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a59800ad0 0x561a597fdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.544+0000 7fe5feffd700 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f5be0 0x561a597fd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.545+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/715173792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f5be0 msgr2=0x561a597fd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.545+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f5be0 0x561a597fd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.545+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/715173792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a59800ad0 msgr2=0x561a597fdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.545+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a59800ad0 0x561a597fdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.545+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/715173792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60010f3a0 con 0x561a597f52d0 2023-07-14T13:09:01.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.545+0000 7fe5feffd700 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f5be0 0x561a597fd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.545+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f52d0 0x561a59800550 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00129f0 tx=0x7fe5f0012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faefdfdd48e8e210 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.545+0000 7fe5deffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:09:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.545+0000 7fe5deffd700 1 -- 172.21.15.17:0/715173792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0017070 con 0x561a597f52d0 2023-07-14T13:09:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.545+0000 7fe5deffd700 1 -- 172.21.15.17:0/715173792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe5f0004030 con 0x561a597f52d0 2023-07-14T13:09:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.545+0000 7fe6197cfb80 1 -- 172.21.15.17:0/715173792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a596a14f0 con 0x561a597f52d0 2023-07-14T13:09:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.546+0000 7fe5deffd700 1 -- 172.21.15.17:0/715173792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5f0004230 con 0x561a597f52d0 2023-07-14T13:09:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.546+0000 7fe6197cfb80 10 client.17268 fetch_fsmap learned FSMap version 32 2023-07-14T13:09:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.546+0000 7fe6197cfb80 1 -- 172.21.15.17:0/715173792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7fe6001a4c90 con 0x561a597f52d0 2023-07-14T13:09:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.546+0000 7fe5deffd700 1 -- 172.21.15.17:0/715173792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561a596a14f0 con 0x561a597f52d0 2023-07-14T13:09:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.546+0000 7fe5deffd700 1 -- 172.21.15.17:0/715173792 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 32) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fe5f0003710 con 0x561a597f52d0 2023-07-14T13:09:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.547+0000 7fe6197cfb80 10 client.17268 fetch_fsmap finished waiting for FSMap version 32 2023-07-14T13:09:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.547+0000 7fe6197cfb80 10 client.17268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.547+0000 7fe6197cfb80 20 client.17268 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.547+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a59810380 0x561a59812790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.547+0000 7fe6197cfb80 4 client.17268 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:09:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.547+0000 7fe6197cfb80 1 -- 172.21.15.17:0/715173792 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a59740eb0 con 0x561a59810380 2023-07-14T13:09:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.547+0000 7fe5feffd700 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a59810380 0x561a59812790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.548+0000 7fe5deffd700 10 client.17268 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.548+0000 7fe5feffd700 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a59810380 0x561a59812790 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58b0a9e38a01e7d5 server_cookie=e3f5e309b8453936 in_seq=0 out_seq=0 2023-07-14T13:09:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.548+0000 7fe5deffd700 1 -- 172.21.15.17:0/715173792 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561a59740eb0 con 0x561a59810380 2023-07-14T13:09:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.548+0000 7fe5deffd700 10 client.17268 handle_command_reply: tid=0 2023-07-14T13:09:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.548+0000 7fe6197cfb80 1 client.17268 shutdown 2023-07-14T13:09:01.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe6197cfb80 1 -- 172.21.15.17:0/715173792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f52d0 msgr2=0x561a59800550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:01.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f52d0 0x561a59800550 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00129f0 tx=0x7fe5f0012d00 comp rx=0 tx=0).stop 2023-07-14T13:09:01.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe6197cfb80 1 -- 172.21.15.17:0/715173792 shutdown_connections 2023-07-14T13:09:01.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a59810380 0x561a59812790 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a59800ad0 0x561a597fdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a597f52d0 0x561a59800550 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/715173792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f5be0 0x561a597fd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe6197cfb80 1 -- 172.21.15.17:0/715173792 >> 172.21.15.17:0/715173792 conn(0x561a597ebda0 msgr2=0x561a597f1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:01.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe5deffd700 0 client.17268 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:01.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe6197cfb80 1 -- 172.21.15.17:0/715173792 shutdown_connections 2023-07-14T13:09:01.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe6197cfb80 1 -- 172.21.15.17:0/715173792 wait complete. 2023-07-14T13:09:01.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.549+0000 7fe6197cfb80 20 client.17268 trim_cache size 0 max 16384 2023-07-14T13:09:01.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.570+0000 7fe6197cfb80 1 Processor -- start 2023-07-14T13:09:01.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.570+0000 7fe6197cfb80 1 -- start start 2023-07-14T13:09:01.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.570+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a598000f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.570+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f5be0 0x561a597fcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.570+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a59800ad0 0x561a597fd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.570+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a597f71a0 con 0x561a59800ad0 2023-07-14T13:09:01.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.570+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a597f6dd0 con 0x561a597f52d0 2023-07-14T13:09:01.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.570+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a597fbd30 con 0x561a597f5be0 2023-07-14T13:09:01.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.571+0000 7fe5ff7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a598000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.571+0000 7fe5fffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a59800ad0 0x561a597fd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.571+0000 7fe5feffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f5be0 0x561a597fcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.571+0000 7fe5ff7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a598000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40092/0 (socket says 172.21.15.17:40092) 2023-07-14T13:09:01.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.571+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/3713333765 learned_addr learned my addr 172.21.15.17:0/3713333765 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:01.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.571+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/3713333765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f5be0 msgr2=0x561a597fcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:01.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.571+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/3713333765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f5be0 0x561a597fcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.571+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/3713333765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a59800ad0 msgr2=0x561a597fd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:01.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.571+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/3713333765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a59800ad0 0x561a597fd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.571+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/3713333765 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a5955ec60 con 0x561a597f52d0 2023-07-14T13:09:01.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.571+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/3713333765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a598000f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00123c0 tx=0x7fe5f0003c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a522076225b6900 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:01.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.572+0000 7fe5e67fc700 1 -- 172.21.15.17:0/3713333765 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0017070 con 0x561a597f52d0 2023-07-14T13:09:01.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.572+0000 7fe5e67fc700 1 -- 172.21.15.17:0/3713333765 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5f0012e90 con 0x561a597f52d0 2023-07-14T13:09:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.572+0000 7fe5e67fc700 1 -- 172.21.15.17:0/3713333765 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000f900 con 0x561a597f52d0 2023-07-14T13:09:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.572+0000 7fe6197cfb80 1 -- 172.21.15.17:0/3713333765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 msgr2=0x561a598000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.572+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/3713333765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a598000f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00123c0 tx=0x7fe5f0003c40 comp rx=0 tx=0).stop 2023-07-14T13:09:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.572+0000 7fe6197cfb80 1 -- 172.21.15.17:0/3713333765 shutdown_connections 2023-07-14T13:09:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.572+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/3713333765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a59800ad0 0x561a597fd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.572+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/3713333765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f52d0 0x561a598000f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.572+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/3713333765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f5be0 0x561a597fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.572+0000 7fe6197cfb80 1 -- 172.21.15.17:0/3713333765 >> 172.21.15.17:0/3713333765 conn(0x561a597ebda0 msgr2=0x561a5980c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.573+0000 7fe6197cfb80 1 -- 172.21.15.17:0/3713333765 shutdown_connections 2023-07-14T13:09:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.573+0000 7fe6197cfb80 1 -- 172.21.15.17:0/3713333765 wait complete. 2023-07-14T13:09:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.573+0000 7fe6197cfb80 1 -- start start 2023-07-14T13:09:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.573+0000 7fe6197cfb80 1 Processor -- start 2023-07-14T13:09:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f52d0 0x561a59807260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f5be0 0x561a59805550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe6197cfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a59800ad0 0x561a59805a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a59805fd0 con 0x561a59800ad0 2023-07-14T13:09:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a59806140 con 0x561a597f5be0 2023-07-14T13:09:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe6197cfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a59806300 con 0x561a597f52d0 2023-07-14T13:09:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe6197cfb80 10 client.0 _ll_register_callbacks cb 0x7fe5f0012600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe5ff7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f52d0 0x561a59807260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe5feffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f5be0 0x561a59805550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe5ff7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f52d0 0x561a59807260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40818/0 (socket says 172.21.15.17:40818) 2023-07-14T13:09:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/1307521748 learned_addr learned my addr 172.21.15.17:0/1307521748 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.574+0000 7fe5fffff700 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a59800ad0 0x561a59805a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.575+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/1307521748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f5be0 msgr2=0x561a59805550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.575+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f5be0 0x561a59805550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.575+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/1307521748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a59800ad0 msgr2=0x561a59805a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.575+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a59800ad0 0x561a59805a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.575+0000 7fe5ff7fe700 1 -- 172.21.15.17:0/1307521748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6001a4c90 con 0x561a597f52d0 2023-07-14T13:09:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.575+0000 7fe5feffd700 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f5be0 0x561a59805550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.575+0000 7fe5ff7fe700 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f52d0 0x561a59807260 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009350 tx=0x7fe5f0003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1853bcb0e1c378c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.575+0000 7fe5deffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:09:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.575+0000 7fe5deffd700 1 -- 172.21.15.17:0/1307521748 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0017070 con 0x561a597f52d0 2023-07-14T13:09:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.575+0000 7fe5deffd700 1 -- 172.21.15.17:0/1307521748 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe5f002a030 con 0x561a597f52d0 2023-07-14T13:09:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.575+0000 7fe6197cfb80 1 -- 172.21.15.17:0/1307521748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe5f409ded0 con 0x561a597f52d0 2023-07-14T13:09:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.576+0000 7fe5deffd700 1 -- 172.21.15.17:0/1307521748 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5f0005480 con 0x561a597f52d0 2023-07-14T13:09:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.576+0000 7fe6197cfb80 10 client.26971 fetch_fsmap learned FSMap version 32 2023-07-14T13:09:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.576+0000 7fe6197cfb80 1 -- 172.21.15.17:0/1307521748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x561a5959c250 con 0x561a597f52d0 2023-07-14T13:09:01.620 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:01 smithi017 ceph-mon[95536]: pgmap v287: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 29 MiB/s wr, 65 op/s 2023-07-14T13:09:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.576+0000 7fe5deffd700 1 -- 172.21.15.17:0/1307521748 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5f409ded0 con 0x561a597f52d0 2023-07-14T13:09:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.576+0000 7fe5deffd700 1 -- 172.21.15.17:0/1307521748 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fe5f0025480 con 0x561a597f52d0 2023-07-14T13:09:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.576+0000 7fe6197cfb80 10 client.26971 fetch_fsmap finished waiting for FSMap version 32 2023-07-14T13:09:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.576+0000 7fe6197cfb80 10 client.26971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.576+0000 7fe6197cfb80 20 client.26971 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.576+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a5986da00 0x561a5986fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.577+0000 7fe6197cfb80 4 client.26971 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:09:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.577+0000 7fe6197cfb80 1 -- 172.21.15.17:0/1307521748 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561a59703050 con 0x561a5986da00 2023-07-14T13:09:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.577+0000 7fe5feffd700 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a5986da00 0x561a5986fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.577+0000 7fe5feffd700 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a5986da00 0x561a5986fe10 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37016d65216509ea server_cookie=cbf4135c5a794fef in_seq=0 out_seq=0 2023-07-14T13:09:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.577+0000 7fe5deffd700 10 client.26971 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe5deffd700 1 -- 172.21.15.17:0/1307521748 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561a59703050 con 0x561a5986da00 2023-07-14T13:09:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe5deffd700 10 client.26971 handle_command_reply: tid=0 2023-07-14T13:09:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe6197cfb80 1 client.26971 shutdown 2023-07-14T13:09:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe6197cfb80 1 -- 172.21.15.17:0/1307521748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f52d0 msgr2=0x561a59807260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f52d0 0x561a59807260 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009350 tx=0x7fe5f0003f10 comp rx=0 tx=0).stop 2023-07-14T13:09:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe6197cfb80 1 -- 172.21.15.17:0/1307521748 shutdown_connections 2023-07-14T13:09:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a5986da00 0x561a5986fe10 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a59800ad0 0x561a59805a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a597f52d0 0x561a59807260 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe6197cfb80 1 --2- 172.21.15.17:0/1307521748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a597f5be0 0x561a59805550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe6197cfb80 1 -- 172.21.15.17:0/1307521748 >> 172.21.15.17:0/1307521748 conn(0x561a597ebda0 msgr2=0x561a597f73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe5deffd700 0 client.26971 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe6197cfb80 1 -- 172.21.15.17:0/1307521748 shutdown_connections 2023-07-14T13:09:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.578+0000 7fe6197cfb80 1 -- 172.21.15.17:0/1307521748 wait complete. 2023-07-14T13:09:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.579+0000 7fe6197cfb80 20 client.26971 trim_cache size 0 max 16384 2023-07-14T13:09:01.626 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:09:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:09:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:09:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:09:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:09:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:09:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:09:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:09:01.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:09:01.627 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:09:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.579+0000 7fe605dff700 1 -- 172.21.15.17:0/4072484077 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe5e80a1340 msgr2=0x7fe5e80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.579+0000 7fe605dff700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe5e80a1340 0x7fe5e80a37f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009f90 tx=0x7fe5f8009920 comp rx=0 tx=0).stop 2023-07-14T13:09:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.579+0000 7fe605dff700 1 -- 172.21.15.17:0/4072484077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe600073160 msgr2=0x7fe6001983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.579+0000 7fe605dff700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe600073160 0x7fe6001983a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400e9a0 tx=0x7fe5f400ecb0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.579+0000 7fe605dff700 1 -- 172.21.15.17:0/4072484077 shutdown_connections 2023-07-14T13:09:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.579+0000 7fe605dff700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe5e80a1340 0x7fe5e80a37f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.579+0000 7fe605dff700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe60010c380 0x7fe60019c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.579+0000 7fe605dff700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe600072850 0x7fe600197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.579+0000 7fe605dff700 1 --2- 172.21.15.17:0/4072484077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe600073160 0x7fe6001983a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.579+0000 7fe605dff700 1 -- 172.21.15.17:0/4072484077 >> 172.21.15.17:0/4072484077 conn(0x7fe6000fb5e0 msgr2=0x7fe60010e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.580+0000 7fe605dff700 1 -- 172.21.15.17:0/4072484077 shutdown_connections 2023-07-14T13:09:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:01.580+0000 7fe605dff700 1 -- 172.21.15.17:0/4072484077 wait complete. 2023-07-14T13:09:01.635 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:09:02.599 INFO:teuthology.orchestra.run.smithi017.stderr:36500000 of 50000000 tuples (73%) done (elapsed 532.20 s, remaining 196.84 s) 2023-07-14T13:09:03.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.410+0000 7f7cb01ff700 1 -- 172.21.15.17:0/1676968696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca80685b0 msgr2=0x7f7ca8104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:03.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.410+0000 7f7cb01ff700 1 --2- 172.21.15.17:0/1676968696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca80685b0 0x7f7ca8104770 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009920 tx=0x7f7c98009c30 comp rx=0 tx=0).stop 2023-07-14T13:09:03.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.411+0000 7f7cb01ff700 1 -- 172.21.15.17:0/1676968696 shutdown_connections 2023-07-14T13:09:03.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.411+0000 7f7cb01ff700 1 --2- 172.21.15.17:0/1676968696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ca8104e50 0x7f7ca810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.411+0000 7f7cb01ff700 1 --2- 172.21.15.17:0/1676968696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca8067c10 0x7f7ca8067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.411+0000 7f7cb01ff700 1 --2- 172.21.15.17:0/1676968696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca80685b0 0x7f7ca8104770 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.411+0000 7f7cb01ff700 1 -- 172.21.15.17:0/1676968696 >> 172.21.15.17:0/1676968696 conn(0x7f7ca8074760 msgr2=0x7f7ca8074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.411+0000 7f7cb01ff700 1 -- 172.21.15.17:0/1676968696 shutdown_connections 2023-07-14T13:09:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.411+0000 7f7cb01ff700 1 -- 172.21.15.17:0/1676968696 wait complete. 2023-07-14T13:09:03.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.412+0000 7f7cb01ff700 1 Processor -- start 2023-07-14T13:09:03.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.412+0000 7f7cb01ff700 1 -- start start 2023-07-14T13:09:03.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.412+0000 7f7cb01ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ca8067c10 0x7f7ca8197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.412+0000 7f7cb01ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca80685b0 0x7f7ca8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.412+0000 7f7cb01ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca8104e50 0x7f7ca819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.412+0000 7f7cb01ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca819cff0 con 0x7f7ca8104e50 2023-07-14T13:09:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.412+0000 7f7cb01ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca819d160 con 0x7f7ca8067c10 2023-07-14T13:09:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.412+0000 7f7cb01ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca819d320 con 0x7f7ca80685b0 2023-07-14T13:09:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.413+0000 7f7cadf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ca8067c10 0x7f7ca8197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.413+0000 7f7cadf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ca8067c10 0x7f7ca8197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40118/0 (socket says 172.21.15.17:40118) 2023-07-14T13:09:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.413+0000 7f7cadf9b700 1 -- 172.21.15.17:0/2354628651 learned_addr learned my addr 172.21.15.17:0/2354628651 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.413+0000 7f7cad79a700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca80685b0 0x7f7ca8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.413+0000 7f7cae79c700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca8104e50 0x7f7ca819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.413+0000 7f7cadf9b700 1 -- 172.21.15.17:0/2354628651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca80685b0 msgr2=0x7f7ca8198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.413+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca80685b0 0x7f7ca8198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.413+0000 7f7cadf9b700 1 -- 172.21.15.17:0/2354628651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca8104e50 msgr2=0x7f7ca819c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.413+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca8104e50 0x7f7ca819c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.413+0000 7f7cadf9b700 1 -- 172.21.15.17:0/2354628651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c98009520 con 0x7f7ca8067c10 2023-07-14T13:09:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.413+0000 7f7cad79a700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca80685b0 0x7f7ca8198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.414+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ca8067c10 0x7f7ca8197e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400e9c0 tx=0x7f7ca400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.414+0000 7f7c9effd700 1 -- 172.21.15.17:0/2354628651 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4004a30 con 0x7f7ca8067c10 2023-07-14T13:09:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.414+0000 7f7cb01ff700 1 -- 172.21.15.17:0/2354628651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca819d600 con 0x7f7ca8067c10 2023-07-14T13:09:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.414+0000 7f7c9effd700 1 -- 172.21.15.17:0/2354628651 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ca400cc50 con 0x7f7ca8067c10 2023-07-14T13:09:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.414+0000 7f7c9effd700 1 -- 172.21.15.17:0/2354628651 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4005410 con 0x7f7ca8067c10 2023-07-14T13:09:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.414+0000 7f7cb01ff700 1 -- 172.21.15.17:0/2354628651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca81a4e40 con 0x7f7ca8067c10 2023-07-14T13:09:03.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:03 smithi135 ceph-mon[97338]: pgmap v288: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 42 op/s 2023-07-14T13:09:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.418+0000 7f7c9effd700 1 -- 172.21.15.17:0/2354628651 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7ca4005570 con 0x7f7ca8067c10 2023-07-14T13:09:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.418+0000 7f7cc3b13b80 1 Processor -- start 2023-07-14T13:09:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.419+0000 7f7cc3b13b80 1 -- start start 2023-07-14T13:09:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.419+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 0x562b5eaa8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.419+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5eaa92d0 0x562b5eaa3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.419+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 0x562b5eaa39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.419+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5e9a8c50 con 0x562b5e8ff6b0 2023-07-14T13:09:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.419+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5e9fb9e0 con 0x562b5eaa3580 2023-07-14T13:09:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.419+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5e9f4e70 con 0x562b5eaa92d0 2023-07-14T13:09:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7cadf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5eaa92d0 0x562b5eaa3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7c9effd700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7c940a12c0 0x7f7c940a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7cae79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 0x562b5eaa8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7cae79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 0x562b5eaa8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46338/0 (socket says 172.21.15.17:46338) 2023-07-14T13:09:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7cad79a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 0x562b5eaa39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7cae79c700 1 -- 172.21.15.17:0/2985354360 learned_addr learned my addr 172.21.15.17:0/2985354360 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7c9effd700 1 -- 172.21.15.17:0/2354628651 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7ca4014070 con 0x7f7ca8067c10 2023-07-14T13:09:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7cae79c700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7c940a12c0 0x7f7c940a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7cad79a700 1 -- 172.21.15.17:0/2985354360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5eaa92d0 msgr2=0x562b5eaa3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7cad79a700 1 --2- 172.21.15.17:0/2985354360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5eaa92d0 0x562b5eaa3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7cad79a700 1 -- 172.21.15.17:0/2985354360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 msgr2=0x562b5eaa8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7cad79a700 1 --2- 172.21.15.17:0/2985354360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 0x562b5eaa8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.420+0000 7f7cad79a700 1 -- 172.21.15.17:0/2985354360 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b5e822d80 con 0x562b5eaa3580 2023-07-14T13:09:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.421+0000 7f7cad79a700 1 --2- 172.21.15.17:0/2985354360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 0x562b5eaa39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c98000c00 tx=0x7f7c98005b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c01fd8bdd53b5ea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.421+0000 7f7cae79c700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7c940a12c0 0x7f7c940a3770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000fb80 tx=0x7f7ca0004b40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.421+0000 7f7c93fff700 1 -- 172.21.15.17:0/2985354360 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9801c050 con 0x562b5eaa3580 2023-07-14T13:09:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.421+0000 7f7c93fff700 1 -- 172.21.15.17:0/2985354360 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c9801d040 con 0x562b5eaa3580 2023-07-14T13:09:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.421+0000 7f7c93fff700 1 -- 172.21.15.17:0/2985354360 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c980052a0 con 0x562b5eaa3580 2023-07-14T13:09:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.422+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2985354360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 msgr2=0x562b5eaa39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.422+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/2985354360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 0x562b5eaa39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c98000c00 tx=0x7f7c98005b60 comp rx=0 tx=0).stop 2023-07-14T13:09:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.422+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2985354360 shutdown_connections 2023-07-14T13:09:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.422+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/2985354360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 0x562b5eaa39d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.422+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/2985354360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 0x562b5eaa8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.422+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/2985354360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5eaa92d0 0x562b5eaa3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.422+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2985354360 >> 172.21.15.17:0/2985354360 conn(0x562b5ea98be0 msgr2=0x562b5ea9df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.422+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2985354360 shutdown_connections 2023-07-14T13:09:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.422+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2985354360 wait complete. 2023-07-14T13:09:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.423+0000 7f7cc3b13b80 1 -- start start 2023-07-14T13:09:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.423+0000 7f7cc3b13b80 1 Processor -- start 2023-07-14T13:09:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.423+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 0x562b5eaaf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.423+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5eaa3580 0x562b5eaac790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.423+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa92d0 0x562b5eaacd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.423+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5e994a60 con 0x562b5eaa3580 2023-07-14T13:09:03.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.423+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5e994760 con 0x562b5eaa92d0 2023-07-14T13:09:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.423+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5e8788c0 con 0x562b5e8ff6b0 2023-07-14T13:09:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.423+0000 7f7cc3b13b80 10 client.0 _ll_register_callbacks cb 0x562b5e992700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7cad79a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5eaa3580 0x562b5eaac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7cadf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 0x562b5eaaf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7cad79a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5eaa3580 0x562b5eaac790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46348/0 (socket says 172.21.15.17:46348) 2023-07-14T13:09:03.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7cad79a700 1 -- 172.21.15.17:0/3217132364 learned_addr learned my addr 172.21.15.17:0/3217132364 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:03.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7cae79c700 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa92d0 0x562b5eaacd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7cadf9b700 1 -- 172.21.15.17:0/3217132364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa92d0 msgr2=0x562b5eaacd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:03.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa92d0 0x562b5eaacd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7cadf9b700 1 -- 172.21.15.17:0/3217132364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5eaa3580 msgr2=0x562b5eaac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:03.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5eaa3580 0x562b5eaac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7cadf9b700 1 -- 172.21.15.17:0/3217132364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca810d210 con 0x562b5e8ff6b0 2023-07-14T13:09:03.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 0x562b5eaaf510 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40ca570 tx=0x7f7ca4099a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33fbb21fd2e895df server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.424+0000 7f7c917fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:09:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.425+0000 7f7c917fa700 1 -- 172.21.15.17:0/3217132364 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca409a350 con 0x562b5e8ff6b0 2023-07-14T13:09:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.425+0000 7f7c917fa700 1 -- 172.21.15.17:0/3217132364 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7ca400cdc0 con 0x562b5e8ff6b0 2023-07-14T13:09:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.425+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/3217132364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b5e94e490 con 0x562b5e8ff6b0 2023-07-14T13:09:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.425+0000 7f7c917fa700 1 -- 172.21.15.17:0/3217132364 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ca40caa00 con 0x562b5e8ff6b0 2023-07-14T13:09:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.425+0000 7f7cc3b13b80 10 client.26983 fetch_fsmap learned FSMap version 32 2023-07-14T13:09:03.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.425+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/3217132364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x562b5e80bc00 con 0x562b5e8ff6b0 2023-07-14T13:09:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.425+0000 7f7c917fa700 1 -- 172.21.15.17:0/3217132364 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562b5e94e490 con 0x562b5e8ff6b0 2023-07-14T13:09:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.425+0000 7f7c917fa700 1 -- 172.21.15.17:0/3217132364 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f7ca40993e0 con 0x562b5e8ff6b0 2023-07-14T13:09:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.425+0000 7f7cc3b13b80 10 client.26983 fetch_fsmap finished waiting for FSMap version 32 2023-07-14T13:09:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.425+0000 7f7cc3b13b80 10 client.26983 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.425+0000 7f7cc3b13b80 20 client.26983 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.426+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b5eabcb20 0x562b5eabef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.426+0000 7f7cc3b13b80 4 client.26983 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:09:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.426+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/3217132364 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b5e9ede50 con 0x562b5eabcb20 2023-07-14T13:09:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.426+0000 7f7cad79a700 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b5eabcb20 0x562b5eabef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.426+0000 7f7cad79a700 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b5eabcb20 0x562b5eabef30 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35f783d6c203dbce server_cookie=541eec22a3c7465b in_seq=0 out_seq=0 2023-07-14T13:09:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.426+0000 7f7c917fa700 10 client.26983 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.427+0000 7f7c917fa700 1 -- 172.21.15.17:0/3217132364 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562b5e9ede50 con 0x562b5eabcb20 2023-07-14T13:09:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.427+0000 7f7c917fa700 10 client.26983 handle_command_reply: tid=0 2023-07-14T13:09:03.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.427+0000 7f7cc3b13b80 1 client.26983 shutdown 2023-07-14T13:09:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/3217132364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 msgr2=0x562b5eaaf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 0x562b5eaaf510 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40ca570 tx=0x7f7ca4099a90 comp rx=0 tx=0).stop 2023-07-14T13:09:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/3217132364 shutdown_connections 2023-07-14T13:09:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b5eabcb20 0x562b5eabef30 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa92d0 0x562b5eaacd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7c917fa700 0 client.26983 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:03.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 0x562b5eaaf510 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/3217132364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5eaa3580 0x562b5eaac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/3217132364 >> 172.21.15.17:0/3217132364 conn(0x562b5ea98be0 msgr2=0x562b5ea9cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:03.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/3217132364 shutdown_connections 2023-07-14T13:09:03.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/3217132364 wait complete. 2023-07-14T13:09:03.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.428+0000 7f7cc3b13b80 20 client.26983 trim_cache size 0 max 16384 2023-07-14T13:09:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.447+0000 7f7cc3b13b80 1 Processor -- start 2023-07-14T13:09:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.447+0000 7f7cc3b13b80 1 -- start start 2023-07-14T13:09:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.447+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 0x562b5eab3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.447+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5eaa3580 0x562b5eaaa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.447+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa92d0 0x562b5eaaf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.447+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5ea69060 con 0x562b5eaa3580 2023-07-14T13:09:03.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.447+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5eaa96a0 con 0x562b5eaa92d0 2023-07-14T13:09:03.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.447+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5eaba120 con 0x562b5e8ff6b0 2023-07-14T13:09:03.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.447+0000 7f7cad79a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5eaa3580 0x562b5eaaa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.447+0000 7f7cadf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 0x562b5eab3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7cadf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 0x562b5eab3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40870/0 (socket says 172.21.15.17:40870) 2023-07-14T13:09:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7cadf9b700 1 -- 172.21.15.17:0/1211941768 learned_addr learned my addr 172.21.15.17:0/1211941768 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7cae79c700 1 --2- 172.21.15.17:0/1211941768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa92d0 0x562b5eaaf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7cadf9b700 1 -- 172.21.15.17:0/1211941768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa92d0 msgr2=0x562b5eaaf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/1211941768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa92d0 0x562b5eaaf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7cadf9b700 1 -- 172.21.15.17:0/1211941768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5eaa3580 msgr2=0x562b5eaaa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/1211941768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5eaa3580 0x562b5eaaa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7cadf9b700 1 -- 172.21.15.17:0/1211941768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b5e8491f0 con 0x562b5e8ff6b0 2023-07-14T13:09:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/1211941768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 0x562b5eab3bd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400f010 tx=0x7f7ca40caa80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b637b3bdad16f706 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7c9cff9700 1 -- 172.21.15.17:0/1211941768 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca400cdc0 con 0x562b5e8ff6b0 2023-07-14T13:09:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7c9cff9700 1 -- 172.21.15.17:0/1211941768 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ca4093040 con 0x562b5e8ff6b0 2023-07-14T13:09:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.448+0000 7f7c9cff9700 1 -- 172.21.15.17:0/1211941768 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca409df20 con 0x562b5e8ff6b0 2023-07-14T13:09:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.449+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/1211941768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 msgr2=0x562b5eab3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:03.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.449+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/1211941768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 0x562b5eab3bd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400f010 tx=0x7f7ca40caa80 comp rx=0 tx=0).stop 2023-07-14T13:09:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.449+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/1211941768 shutdown_connections 2023-07-14T13:09:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.449+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/1211941768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa92d0 0x562b5eaaf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.449+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/1211941768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5e8ff6b0 0x562b5eab3bd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.449+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/1211941768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5eaa3580 0x562b5eaaa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.449+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/1211941768 >> 172.21.15.17:0/1211941768 conn(0x562b5ea98be0 msgr2=0x562b5eaa9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.449+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/1211941768 shutdown_connections 2023-07-14T13:09:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.449+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/1211941768 wait complete. 2023-07-14T13:09:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.450+0000 7f7cc3b13b80 1 -- start start 2023-07-14T13:09:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.450+0000 7f7cc3b13b80 1 Processor -- start 2023-07-14T13:09:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 0x562b5eaa5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 0x562b5eaa4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cc3b13b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5eaa92d0 0x562b5eaa4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5eaa62a0 con 0x562b5e8ff6b0 2023-07-14T13:09:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5eaa6410 con 0x562b5eaa3580 2023-07-14T13:09:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cc3b13b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5eaa5210 con 0x562b5eaa92d0 2023-07-14T13:09:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cc3b13b80 10 client.0 _ll_register_callbacks cb 0x562b5e992700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cadf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 0x562b5eaa5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cad79a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 0x562b5eaa4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cadf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 0x562b5eaa5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46356/0 (socket says 172.21.15.17:46356) 2023-07-14T13:09:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cadf9b700 1 -- 172.21.15.17:0/2723844686 learned_addr learned my addr 172.21.15.17:0/2723844686 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cad79a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 0x562b5eaa4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40168/0 (socket says 172.21.15.17:40168) 2023-07-14T13:09:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.451+0000 7f7cae79c700 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5eaa92d0 0x562b5eaa4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7cadf9b700 1 -- 172.21.15.17:0/2723844686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5eaa92d0 msgr2=0x562b5eaa4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5eaa92d0 0x562b5eaa4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7cadf9b700 1 -- 172.21.15.17:0/2723844686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 msgr2=0x562b5eaa4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 0x562b5eaa4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7cadf9b700 1 -- 172.21.15.17:0/2723844686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b5e80bc00 con 0x562b5e8ff6b0 2023-07-14T13:09:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7cadf9b700 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 0x562b5eaa5ce0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009fd0 tx=0x7f7ca40ca650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10994ebf3fd478a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7c917fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:09:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7c917fa700 1 -- 172.21.15.17:0/2723844686 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca409a350 con 0x562b5e8ff6b0 2023-07-14T13:09:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2723844686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c9801d040 con 0x562b5e8ff6b0 2023-07-14T13:09:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7c917fa700 1 -- 172.21.15.17:0/2723844686 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7ca400b2c0 con 0x562b5e8ff6b0 2023-07-14T13:09:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7c917fa700 1 -- 172.21.15.17:0/2723844686 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ca40ca460 con 0x562b5e8ff6b0 2023-07-14T13:09:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7cc3b13b80 10 client.17292 fetch_fsmap learned FSMap version 32 2023-07-14T13:09:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.452+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2723844686 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x562b5e821250 con 0x562b5e8ff6b0 2023-07-14T13:09:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.453+0000 7f7c917fa700 1 -- 172.21.15.17:0/2723844686 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c9801d040 con 0x562b5e8ff6b0 2023-07-14T13:09:03.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.453+0000 7f7c917fa700 1 -- 172.21.15.17:0/2723844686 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 32) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f7ca4098f70 con 0x562b5e8ff6b0 2023-07-14T13:09:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.453+0000 7f7cc3b13b80 10 client.17292 fetch_fsmap finished waiting for FSMap version 32 2023-07-14T13:09:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.453+0000 7f7cc3b13b80 10 client.17292 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.453+0000 7f7cc3b13b80 20 client.17292 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.453+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b5eb11530 0x562b5eb13910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.453+0000 7f7cc3b13b80 4 client.17292 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:09:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.453+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2723844686 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562b5e9afff0 con 0x562b5eb11530 2023-07-14T13:09:03.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.453+0000 7f7cad79a700 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b5eb11530 0x562b5eb13910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:03.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.454+0000 7f7c917fa700 10 client.17292 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:03.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.454+0000 7f7cad79a700 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b5eb11530 0x562b5eb13910 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abacfde9a5f29f48 server_cookie=d28617d378f78612 in_seq=0 out_seq=0 2023-07-14T13:09:03.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:03 smithi131 ceph-mon[96953]: pgmap v288: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 42 op/s 2023-07-14T13:09:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7c917fa700 1 -- 172.21.15.17:0/2723844686 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562b5e9afff0 con 0x562b5eb11530 2023-07-14T13:09:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7c917fa700 10 client.17292 handle_command_reply: tid=0 2023-07-14T13:09:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 1 client.17292 shutdown 2023-07-14T13:09:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2723844686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 msgr2=0x562b5eaa5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 0x562b5eaa5ce0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009fd0 tx=0x7f7ca40ca650 comp rx=0 tx=0).stop 2023-07-14T13:09:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2723844686 shutdown_connections 2023-07-14T13:09:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b5eb11530 0x562b5eb13910 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b5eaa92d0 0x562b5eaa4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b5e8ff6b0 0x562b5eaa5ce0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7c917fa700 0 client.17292 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 1 --2- 172.21.15.17:0/2723844686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b5eaa3580 0x562b5eaa4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2723844686 >> 172.21.15.17:0/2723844686 conn(0x562b5ea98be0 msgr2=0x562b5eaaa320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2723844686 shutdown_connections 2023-07-14T13:09:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 1 -- 172.21.15.17:0/2723844686 wait complete. 2023-07-14T13:09:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.468+0000 7f7cc3b13b80 20 client.17292 trim_cache size 0 max 16384 2023-07-14T13:09:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:09:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:09:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:09:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:09:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 -- 172.21.15.17:0/2354628651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7c940a12c0 msgr2=0x7f7c940a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7c940a12c0 0x7f7c940a3770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000fb80 tx=0x7f7ca0004b40 comp rx=0 tx=0).stop 2023-07-14T13:09:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 -- 172.21.15.17:0/2354628651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ca8067c10 msgr2=0x7f7ca8197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ca8067c10 0x7f7ca8197e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400e9c0 tx=0x7f7ca400ecd0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 -- 172.21.15.17:0/2354628651 shutdown_connections 2023-07-14T13:09:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f7c940a12c0 0x7f7c940a3770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca8104e50 0x7f7ca819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ca8067c10 0x7f7ca8197e00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 --2- 172.21.15.17:0/2354628651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ca80685b0 0x7f7ca8198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 -- 172.21.15.17:0/2354628651 >> 172.21.15.17:0/2354628651 conn(0x7f7ca8074760 msgr2=0x7f7ca80fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 -- 172.21.15.17:0/2354628651 shutdown_connections 2023-07-14T13:09:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:03.469+0000 7f7cb01ff700 1 -- 172.21.15.17:0/2354628651 wait complete. 2023-07-14T13:09:03.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:03 smithi017 ceph-mon[95536]: pgmap v288: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 42 op/s 2023-07-14T13:09:03.933 INFO:teuthology.orchestra.run.smithi017.stderr:36600000 of 50000000 tuples (73%) done (elapsed 533.53 s, remaining 195.34 s) 2023-07-14T13:09:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:36700000 of 50000000 tuples (73%) done (elapsed 535.02 s, remaining 193.89 s) 2023-07-14T13:09:05.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:05 smithi135 ceph-mon[97338]: pgmap v289: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 42 op/s 2023-07-14T13:09:05.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:05 smithi135 ceph-mon[97338]: osdmap e96: 12 total, 12 up, 12 in 2023-07-14T13:09:05.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:05 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:09:05.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:05 smithi131 ceph-mon[96953]: pgmap v289: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 42 op/s 2023-07-14T13:09:05.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:05 smithi131 ceph-mon[96953]: osdmap e96: 12 total, 12 up, 12 in 2023-07-14T13:09:05.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:05 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:09:05.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:05 smithi017 ceph-mon[95536]: pgmap v289: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 18 MiB/s wr, 42 op/s 2023-07-14T13:09:05.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:05 smithi017 ceph-mon[95536]: osdmap e96: 12 total, 12 up, 12 in 2023-07-14T13:09:05.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:05 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:09:06.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:06 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:09:06.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:06 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:09:06.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:06 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:09:06.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:06 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:09:06.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:06 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:09:06.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:06 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:09:06.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:06 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:09:06.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:06 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:09:06.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:06 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:09:06.707 INFO:teuthology.orchestra.run.smithi017.stderr:36800000 of 50000000 tuples (73%) done (elapsed 536.31 s, remaining 192.37 s) 2023-07-14T13:09:07.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:07 smithi135 ceph-mon[97338]: pgmap v291: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 72 op/s 2023-07-14T13:09:07.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:07 smithi131 ceph-mon[96953]: pgmap v291: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 72 op/s 2023-07-14T13:09:07.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:07 smithi017 ceph-mon[95536]: pgmap v291: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 72 op/s 2023-07-14T13:09:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:36900000 of 50000000 tuples (73%) done (elapsed 537.74 s, remaining 190.90 s) 2023-07-14T13:09:09.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:09 smithi135 ceph-mon[97338]: pgmap v292: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 72 op/s 2023-07-14T13:09:09.460 INFO:teuthology.orchestra.run.smithi017.stderr:37000000 of 50000000 tuples (74%) done (elapsed 539.06 s, remaining 189.40 s) 2023-07-14T13:09:09.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:09 smithi131 ceph-mon[96953]: pgmap v292: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 72 op/s 2023-07-14T13:09:09.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:09 smithi017 ceph-mon[95536]: pgmap v292: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 72 op/s 2023-07-14T13:09:10.789 INFO:teuthology.orchestra.run.smithi017.stderr:37100000 of 50000000 tuples (74%) done (elapsed 540.39 s, remaining 187.90 s) 2023-07-14T13:09:11.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:11 smithi135 ceph-mon[97338]: pgmap v293: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 26 MiB/s wr, 82 op/s 2023-07-14T13:09:11.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:11 smithi135 ceph-mon[97338]: osdmap e97: 12 total, 12 up, 12 in 2023-07-14T13:09:11.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:11 smithi131 ceph-mon[96953]: pgmap v293: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 26 MiB/s wr, 82 op/s 2023-07-14T13:09:11.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:11 smithi131 ceph-mon[96953]: osdmap e97: 12 total, 12 up, 12 in 2023-07-14T13:09:11.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:11 smithi017 ceph-mon[95536]: pgmap v293: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 26 MiB/s wr, 82 op/s 2023-07-14T13:09:11.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:11 smithi017 ceph-mon[95536]: osdmap e97: 12 total, 12 up, 12 in 2023-07-14T13:09:12.122 INFO:teuthology.orchestra.run.smithi017.stderr:37200000 of 50000000 tuples (74%) done (elapsed 541.72 s, remaining 186.40 s) 2023-07-14T13:09:13.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:13 smithi135 ceph-mon[97338]: pgmap v295: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 33 MiB/s wr, 103 op/s 2023-07-14T13:09:13.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:13 smithi131 ceph-mon[96953]: pgmap v295: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 33 MiB/s wr, 103 op/s 2023-07-14T13:09:13.506 INFO:teuthology.orchestra.run.smithi017.stderr:37300000 of 50000000 tuples (74%) done (elapsed 543.11 s, remaining 184.92 s) 2023-07-14T13:09:13.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:13 smithi017 ceph-mon[95536]: pgmap v295: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 33 MiB/s wr, 103 op/s 2023-07-14T13:09:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:37400000 of 50000000 tuples (74%) done (elapsed 544.38 s, remaining 183.40 s) 2023-07-14T13:09:15.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:15 smithi135 ceph-mon[97338]: pgmap v296: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 MiB/s wr, 84 op/s 2023-07-14T13:09:15.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:15 smithi131 ceph-mon[96953]: pgmap v296: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 MiB/s wr, 84 op/s 2023-07-14T13:09:15.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:15 smithi017 ceph-mon[95536]: pgmap v296: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 MiB/s wr, 84 op/s 2023-07-14T13:09:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.636+0000 7f9a7bbff700 1 -- 172.21.15.17:0/1701376826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a74067c10 msgr2=0x7f9a74067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.636+0000 7f9a7bbff700 1 --2- 172.21.15.17:0/1701376826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a74067c10 0x7f9a74067fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9a700099c0 tx=0x7f9a70009cd0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.637+0000 7f9a7bbff700 1 -- 172.21.15.17:0/1701376826 shutdown_connections 2023-07-14T13:09:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.637+0000 7f9a7bbff700 1 --2- 172.21.15.17:0/1701376826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a74104e50 0x7f9a7410ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.637+0000 7f9a7bbff700 1 --2- 172.21.15.17:0/1701376826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a74067c10 0x7f9a74067fe0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.637+0000 7f9a7bbff700 1 --2- 172.21.15.17:0/1701376826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a740685b0 0x7f9a74104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.637+0000 7f9a7bbff700 1 -- 172.21.15.17:0/1701376826 >> 172.21.15.17:0/1701376826 conn(0x7f9a74074760 msgr2=0x7f9a74074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:16.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.637+0000 7f9a7bbff700 1 -- 172.21.15.17:0/1701376826 shutdown_connections 2023-07-14T13:09:16.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.637+0000 7f9a7bbff700 1 -- 172.21.15.17:0/1701376826 wait complete. 2023-07-14T13:09:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.638+0000 7f9a7bbff700 1 Processor -- start 2023-07-14T13:09:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.638+0000 7f9a7bbff700 1 -- start start 2023-07-14T13:09:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.638+0000 7f9a7bbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a74067c10 0x7f9a74197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.638+0000 7f9a7bbff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a740685b0 0x7f9a74198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.638+0000 7f9a7bbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a74104e50 0x7f9a7419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.638+0000 7f9a7bbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7419cf20 con 0x7f9a74067c10 2023-07-14T13:09:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.638+0000 7f9a7bbff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7419d090 con 0x7f9a740685b0 2023-07-14T13:09:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.638+0000 7f9a7bbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7419d250 con 0x7f9a74104e50 2023-07-14T13:09:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.639+0000 7f9a7999b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a74067c10 0x7f9a74197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.639+0000 7f9a7999b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a74067c10 0x7f9a74197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33660/0 (socket says 172.21.15.17:33660) 2023-07-14T13:09:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.639+0000 7f9a7999b700 1 -- 172.21.15.17:0/2270819112 learned_addr learned my addr 172.21.15.17:0/2270819112 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.639+0000 7f9a7919a700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a740685b0 0x7f9a74198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.639+0000 7f9a7a19c700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a74104e50 0x7f9a7419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.639+0000 7f9a7999b700 1 -- 172.21.15.17:0/2270819112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a74104e50 msgr2=0x7f9a7419c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.639+0000 7f9a7999b700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a74104e50 0x7f9a7419c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.639+0000 7f9a7999b700 1 -- 172.21.15.17:0/2270819112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a740685b0 msgr2=0x7f9a74198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.639+0000 7f9a7999b700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a740685b0 0x7f9a74198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.639+0000 7f9a7999b700 1 -- 172.21.15.17:0/2270819112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a700095f0 con 0x7f9a74067c10 2023-07-14T13:09:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.639+0000 7f9a7999b700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a74067c10 0x7f9a74197d30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9a70005910 tx=0x7f9a70009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:16.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.640+0000 7f9a6affd700 1 -- 172.21.15.17:0/2270819112 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7001d070 con 0x7f9a74067c10 2023-07-14T13:09:16.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.640+0000 7f9a7bbff700 1 -- 172.21.15.17:0/2270819112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7419d4d0 con 0x7f9a74067c10 2023-07-14T13:09:16.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.640+0000 7f9a6affd700 1 -- 172.21.15.17:0/2270819112 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a70022470 con 0x7f9a74067c10 2023-07-14T13:09:16.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.640+0000 7f9a6affd700 1 -- 172.21.15.17:0/2270819112 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70017650 con 0x7f9a74067c10 2023-07-14T13:09:16.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.640+0000 7f9a7bbff700 1 -- 172.21.15.17:0/2270819112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a741a4d70 con 0x7f9a74067c10 2023-07-14T13:09:16.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.645+0000 7f9a6affd700 1 -- 172.21.15.17:0/2270819112 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9a700225e0 con 0x7f9a74067c10 2023-07-14T13:09:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.646+0000 7f9a8f580b80 1 Processor -- start 2023-07-14T13:09:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.646+0000 7f9a8f580b80 1 -- start start 2023-07-14T13:09:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56256861c2d0 0x562568616040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562568616580 0x5625686169d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256851bc50 con 0x56256861c2d0 2023-07-14T13:09:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256856e9e0 con 0x562568616580 2023-07-14T13:09:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562568567e70 con 0x5625684726b0 2023-07-14T13:09:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a7a19c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a7a19c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34602/0 (socket says 172.21.15.17:34602) 2023-07-14T13:09:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a7a19c700 1 -- 172.21.15.17:0/2567429890 learned_addr learned my addr 172.21.15.17:0/2567429890 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a7919a700 1 --2- 172.21.15.17:0/2567429890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562568616580 0x5625686169d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a7999b700 1 --2- 172.21.15.17:0/2567429890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56256861c2d0 0x562568616040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.647+0000 7f9a6affd700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9a600a1340 0x7f9a600a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a7919a700 1 -- 172.21.15.17:0/2567429890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 msgr2=0x56256861bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a7919a700 1 --2- 172.21.15.17:0/2567429890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a7919a700 1 -- 172.21.15.17:0/2567429890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56256861c2d0 msgr2=0x562568616040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a7919a700 1 --2- 172.21.15.17:0/2567429890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56256861c2d0 0x562568616040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a7919a700 1 -- 172.21.15.17:0/2567429890 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562568395d80 con 0x562568616580 2023-07-14T13:09:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a7a19c700 1 --2- 172.21.15.17:0/2567429890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a6affd700 1 -- 172.21.15.17:0/2270819112 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9a700cdc80 con 0x7f9a74067c10 2023-07-14T13:09:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a7999b700 1 --2- 172.21.15.17:0/2567429890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56256861c2d0 0x562568616040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a7919a700 1 --2- 172.21.15.17:0/2567429890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562568616580 0x5625686169d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a740733d0 tx=0x7f9a64009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c26a1d007f86fb8e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a7a19c700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9a600a1340 0x7f9a600a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a5ffff700 1 -- 172.21.15.17:0/2567429890 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64011c80 con 0x562568616580 2023-07-14T13:09:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a5ffff700 1 -- 172.21.15.17:0/2567429890 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a64011de0 con 0x562568616580 2023-07-14T13:09:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.648+0000 7f9a5ffff700 1 -- 172.21.15.17:0/2567429890 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64005280 con 0x562568616580 2023-07-14T13:09:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.649+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2567429890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562568616580 msgr2=0x5625686169d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.649+0000 7f9a7a19c700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9a600a1340 0x7f9a600a37f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0116b0 tx=0x7f9a6c009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.649+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/2567429890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562568616580 0x5625686169d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a740733d0 tx=0x7f9a64009f60 comp rx=0 tx=0).stop 2023-07-14T13:09:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.649+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2567429890 shutdown_connections 2023-07-14T13:09:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.649+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/2567429890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562568616580 0x5625686169d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.649+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/2567429890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.649+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/2567429890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56256861c2d0 0x562568616040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.649+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2567429890 >> 172.21.15.17:0/2567429890 conn(0x56256860bbe0 msgr2=0x562568610f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.649+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2567429890 shutdown_connections 2023-07-14T13:09:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.649+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2567429890 wait complete. 2023-07-14T13:09:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.650+0000 7f9a8f580b80 1 -- start start 2023-07-14T13:09:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.650+0000 7f9a8f580b80 1 Processor -- start 2023-07-14T13:09:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.651+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.651+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x56256861fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.651+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56256861c2d0 0x562568620380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.651+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562568507a60 con 0x562568616580 2023-07-14T13:09:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.651+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562568507760 con 0x56256861c2d0 2023-07-14T13:09:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.651+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625683eb8c0 con 0x5625684726b0 2023-07-14T13:09:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.651+0000 7f9a8f580b80 10 client.0 _ll_register_callbacks cb 0x562568505700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.651+0000 7f9a7999b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.651+0000 7f9a7999b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34610/0 (socket says 172.21.15.17:34610) 2023-07-14T13:09:16.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.651+0000 7f9a7999b700 1 -- 172.21.15.17:0/2055939565 learned_addr learned my addr 172.21.15.17:0/2055939565 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.651+0000 7f9a7a19c700 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56256861c2d0 0x562568620380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.652+0000 7f9a7919a700 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x56256861fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.652+0000 7f9a7999b700 1 -- 172.21.15.17:0/2055939565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56256861c2d0 msgr2=0x562568620380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.652+0000 7f9a7999b700 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56256861c2d0 0x562568620380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.652+0000 7f9a7999b700 1 -- 172.21.15.17:0/2055939565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 msgr2=0x56256861fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.652+0000 7f9a7999b700 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x56256861fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.652+0000 7f9a7999b700 1 -- 172.21.15.17:0/2055939565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c011330 con 0x5625684726b0 2023-07-14T13:09:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.652+0000 7f9a7999b700 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861f900 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000bf80 tx=0x7f9a70022ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ba6674ca4f8ae76 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.652+0000 7f9a5d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:09:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.652+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/2055939565 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7009ada0 con 0x5625684726b0 2023-07-14T13:09:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.652+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/2055939565 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9a7009edd0 con 0x5625684726b0 2023-07-14T13:09:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.652+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2055939565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625684c1490 con 0x5625684726b0 2023-07-14T13:09:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.653+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/2055939565 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a700a3160 con 0x5625684726b0 2023-07-14T13:09:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.653+0000 7f9a8f580b80 10 client.27001 fetch_fsmap learned FSMap version 32 2023-07-14T13:09:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.653+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2055939565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f9a640098e0 con 0x5625684726b0 2023-07-14T13:09:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.653+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/2055939565 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5625684c1490 con 0x5625684726b0 2023-07-14T13:09:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.653+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/2055939565 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f9a70096b90 con 0x5625684726b0 2023-07-14T13:09:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.653+0000 7f9a8f580b80 10 client.27001 fetch_fsmap finished waiting for FSMap version 32 2023-07-14T13:09:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.653+0000 7f9a8f580b80 10 client.27001 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.653+0000 7f9a8f580b80 20 client.27001 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.653+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56256862f880 0x562568631c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.653+0000 7f9a8f580b80 4 client.27001 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:09:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.653+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2055939565 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562568560e50 con 0x56256862f880 2023-07-14T13:09:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.654+0000 7f9a7919a700 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56256862f880 0x562568631c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.654+0000 7f9a7919a700 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56256862f880 0x562568631c90 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39475bab1289be7b server_cookie=a685d6621f66d654 in_seq=0 out_seq=0 2023-07-14T13:09:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.654+0000 7f9a5d7fa700 10 client.27001 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/2055939565 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562568560e50 con 0x56256862f880 2023-07-14T13:09:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a5d7fa700 10 client.27001 handle_command_reply: tid=0 2023-07-14T13:09:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a8f580b80 1 client.27001 shutdown 2023-07-14T13:09:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2055939565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 msgr2=0x56256861f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861f900 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000bf80 tx=0x7f9a70022ba0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2055939565 shutdown_connections 2023-07-14T13:09:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56256862f880 0x562568631c90 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56256861c2d0 0x562568620380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x56256861f900 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/2055939565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x56256861fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a5d7fa700 0 client.27001 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.655+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2055939565 >> 172.21.15.17:0/2055939565 conn(0x56256860bbe0 msgr2=0x5625686104e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.656+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2055939565 shutdown_connections 2023-07-14T13:09:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.656+0000 7f9a8f580b80 1 -- 172.21.15.17:0/2055939565 wait complete. 2023-07-14T13:09:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.656+0000 7f9a8f580b80 20 client.27001 trim_cache size 0 max 16384 2023-07-14T13:09:16.701 INFO:teuthology.orchestra.run.smithi017.stderr:37500000 of 50000000 tuples (75%) done (elapsed 546.30 s, remaining 182.10 s) 2023-07-14T13:09:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.678+0000 7f9a8f580b80 1 Processor -- start 2023-07-14T13:09:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.678+0000 7f9a8f580b80 1 -- start start 2023-07-14T13:09:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.678+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625684726b0 0x562568616040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.678+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x56256861b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.678+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56256861c2d0 0x5625686201b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.678+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625685dc060 con 0x562568616580 2023-07-14T13:09:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.678+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256861ba10 con 0x5625684726b0 2023-07-14T13:09:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.678+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56256861c6a0 con 0x56256861c2d0 2023-07-14T13:09:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.679+0000 7f9a7999b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625684726b0 0x562568616040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.679+0000 7f9a7a19c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56256861c2d0 0x5625686201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.679+0000 7f9a7999b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625684726b0 0x562568616040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:42316/0 (socket says 172.21.15.17:42316) 2023-07-14T13:09:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.679+0000 7f9a7999b700 1 -- 172.21.15.17:0/292281559 learned_addr learned my addr 172.21.15.17:0/292281559 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.679+0000 7f9a7919a700 1 --2- 172.21.15.17:0/292281559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x56256861b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.679+0000 7f9a7999b700 1 -- 172.21.15.17:0/292281559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56256861c2d0 msgr2=0x5625686201b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.679+0000 7f9a7999b700 1 --2- 172.21.15.17:0/292281559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56256861c2d0 0x5625686201b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.679+0000 7f9a7999b700 1 -- 172.21.15.17:0/292281559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 msgr2=0x56256861b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.679+0000 7f9a7999b700 1 --2- 172.21.15.17:0/292281559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x56256861b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.679+0000 7f9a7999b700 1 -- 172.21.15.17:0/292281559 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56256837ec00 con 0x5625684726b0 2023-07-14T13:09:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.679+0000 7f9a7999b700 1 --2- 172.21.15.17:0/292281559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625684726b0 0x562568616040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000b580 tx=0x7f9a700a3070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=686927a1fdaf0e2c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.680+0000 7f9a68bff700 1 -- 172.21.15.17:0/292281559 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70096f10 con 0x5625684726b0 2023-07-14T13:09:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.680+0000 7f9a68bff700 1 -- 172.21.15.17:0/292281559 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a7009edd0 con 0x5625684726b0 2023-07-14T13:09:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.680+0000 7f9a68bff700 1 -- 172.21.15.17:0/292281559 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7009a290 con 0x5625684726b0 2023-07-14T13:09:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.680+0000 7f9a8f580b80 1 -- 172.21.15.17:0/292281559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625684726b0 msgr2=0x562568616040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.680+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/292281559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625684726b0 0x562568616040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000b580 tx=0x7f9a700a3070 comp rx=0 tx=0).stop 2023-07-14T13:09:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.681+0000 7f9a8f580b80 1 -- 172.21.15.17:0/292281559 shutdown_connections 2023-07-14T13:09:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.681+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/292281559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56256861c2d0 0x5625686201b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.681+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/292281559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625684726b0 0x562568616040 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.681+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/292281559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x56256861b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.681+0000 7f9a8f580b80 1 -- 172.21.15.17:0/292281559 >> 172.21.15.17:0/292281559 conn(0x56256860bbe0 msgr2=0x56256861c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.681+0000 7f9a8f580b80 1 -- 172.21.15.17:0/292281559 shutdown_connections 2023-07-14T13:09:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.681+0000 7f9a8f580b80 1 -- 172.21.15.17:0/292281559 wait complete. 2023-07-14T13:09:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.681+0000 7f9a8f580b80 1 -- start start 2023-07-14T13:09:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.681+0000 7f9a8f580b80 1 Processor -- start 2023-07-14T13:09:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.682+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x562568626ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.682+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x562568624fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.682+0000 7f9a8f580b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56256861c2d0 0x5625686254e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.682+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562568625bb0 con 0x562568616580 2023-07-14T13:09:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.682+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562568625d20 con 0x56256861c2d0 2023-07-14T13:09:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.682+0000 7f9a8f580b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562568683750 con 0x5625684726b0 2023-07-14T13:09:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.682+0000 7f9a8f580b80 10 client.0 _ll_register_callbacks cb 0x7f9a700970e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.682+0000 7f9a7999b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x562568626ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.682+0000 7f9a7919a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x562568624fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.682+0000 7f9a7999b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x562568626ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34628/0 (socket says 172.21.15.17:34628) 2023-07-14T13:09:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.682+0000 7f9a7999b700 1 -- 172.21.15.17:0/3778312183 learned_addr learned my addr 172.21.15.17:0/3778312183 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a7a19c700 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56256861c2d0 0x5625686254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a7999b700 1 -- 172.21.15.17:0/3778312183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56256861c2d0 msgr2=0x5625686254e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a7999b700 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56256861c2d0 0x5625686254e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a7999b700 1 -- 172.21.15.17:0/3778312183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 msgr2=0x562568624fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a7999b700 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x562568624fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a7999b700 1 -- 172.21.15.17:0/3778312183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a640098e0 con 0x5625684726b0 2023-07-14T13:09:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a7919a700 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x562568624fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a7999b700 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x562568626ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009fd0 tx=0x7f9a70096ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0a0a58d232aba4e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a5d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:09:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/3778312183 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7009a490 con 0x5625684726b0 2023-07-14T13:09:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/3778312183 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9a700a3160 con 0x5625684726b0 2023-07-14T13:09:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.683+0000 7f9a8f580b80 1 -- 172.21.15.17:0/3778312183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a64011de0 con 0x5625684726b0 2023-07-14T13:09:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/3778312183 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a700cbae0 con 0x5625684726b0 2023-07-14T13:09:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a8f580b80 10 client.27007 fetch_fsmap learned FSMap version 32 2023-07-14T13:09:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a8f580b80 1 -- 172.21.15.17:0/3778312183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5625683bc1f0 con 0x5625684726b0 2023-07-14T13:09:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/3778312183 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a64011de0 con 0x5625684726b0 2023-07-14T13:09:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/3778312183 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f9a700b3350 con 0x5625684726b0 2023-07-14T13:09:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a8f580b80 10 client.27007 fetch_fsmap finished waiting for FSMap version 32 2023-07-14T13:09:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a8f580b80 10 client.27007 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a8f580b80 20 client.27007 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5625686848e0 0x562568686cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a8f580b80 4 client.27007 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:09:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a8f580b80 1 -- 172.21.15.17:0/3778312183 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562568522ff0 con 0x5625686848e0 2023-07-14T13:09:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.684+0000 7f9a7919a700 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5625686848e0 0x562568686cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.685+0000 7f9a5d7fa700 10 client.27007 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.685+0000 7f9a7919a700 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5625686848e0 0x562568686cc0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b9eff4e989bfa4b server_cookie=143c99795c0de008 in_seq=0 out_seq=0 2023-07-14T13:09:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a5d7fa700 1 -- 172.21.15.17:0/3778312183 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562568522ff0 con 0x5625686848e0 2023-07-14T13:09:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a5d7fa700 10 client.27007 handle_command_reply: tid=0 2023-07-14T13:09:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 1 client.27007 shutdown 2023-07-14T13:09:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 1 -- 172.21.15.17:0/3778312183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 msgr2=0x562568626ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x562568626ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009fd0 tx=0x7f9a70096ff0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 1 -- 172.21.15.17:0/3778312183 shutdown_connections 2023-07-14T13:09:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5625686848e0 0x562568686cc0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56256861c2d0 0x5625686254e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5625684726b0 0x562568626ce0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a5d7fa700 0 client.27007 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 1 --2- 172.21.15.17:0/3778312183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562568616580 0x562568624fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 1 -- 172.21.15.17:0/3778312183 >> 172.21.15.17:0/3778312183 conn(0x56256860bbe0 msgr2=0x56256861fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 1 -- 172.21.15.17:0/3778312183 shutdown_connections 2023-07-14T13:09:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 1 -- 172.21.15.17:0/3778312183 wait complete. 2023-07-14T13:09:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.699+0000 7f9a8f580b80 20 client.27007 trim_cache size 0 max 16384 2023-07-14T13:09:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:09:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:09:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:09:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:09:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 -- 172.21.15.17:0/2270819112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9a600a1340 msgr2=0x7f9a600a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:16.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9a600a1340 0x7f9a600a37f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0116b0 tx=0x7f9a6c009040 comp rx=0 tx=0).stop 2023-07-14T13:09:16.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 -- 172.21.15.17:0/2270819112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a74067c10 msgr2=0x7f9a74197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:16.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a74067c10 0x7f9a74197d30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9a70005910 tx=0x7f9a70009580 comp rx=0 tx=0).stop 2023-07-14T13:09:16.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 -- 172.21.15.17:0/2270819112 shutdown_connections 2023-07-14T13:09:16.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9a600a1340 0x7f9a600a37f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a74104e50 0x7f9a7419c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a74067c10 0x7f9a74197d30 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 --2- 172.21.15.17:0/2270819112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a740685b0 0x7f9a74198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 -- 172.21.15.17:0/2270819112 >> 172.21.15.17:0/2270819112 conn(0x7f9a74074760 msgr2=0x7f9a740fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 -- 172.21.15.17:0/2270819112 shutdown_connections 2023-07-14T13:09:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:16.700+0000 7f9a7bbff700 1 -- 172.21.15.17:0/2270819112 wait complete. 2023-07-14T13:09:17.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:17 smithi135 ceph-mon[97338]: pgmap v297: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 72 op/s 2023-07-14T13:09:17.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:17 smithi131 ceph-mon[96953]: pgmap v297: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 72 op/s 2023-07-14T13:09:17.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:17 smithi017 ceph-mon[95536]: pgmap v297: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 72 op/s 2023-07-14T13:09:18.089 INFO:teuthology.orchestra.run.smithi017.stderr:37600000 of 50000000 tuples (75%) done (elapsed 547.69 s, remaining 180.62 s) 2023-07-14T13:09:19.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:19 smithi135 ceph-mon[97338]: pgmap v298: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 72 op/s 2023-07-14T13:09:19.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:19 smithi131 ceph-mon[96953]: pgmap v298: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 72 op/s 2023-07-14T13:09:19.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:19 smithi017 ceph-mon[95536]: pgmap v298: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 72 op/s 2023-07-14T13:09:19.928 INFO:teuthology.orchestra.run.smithi017.stderr:37700000 of 50000000 tuples (75%) done (elapsed 549.53 s, remaining 179.29 s) 2023-07-14T13:09:21.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:21 smithi135 ceph-mon[97338]: pgmap v299: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 27 MiB/s wr, 49 op/s 2023-07-14T13:09:21.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:21 smithi131 ceph-mon[96953]: pgmap v299: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 27 MiB/s wr, 49 op/s 2023-07-14T13:09:21.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:21 smithi017 ceph-mon[95536]: pgmap v299: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 27 MiB/s wr, 49 op/s 2023-07-14T13:09:21.792 INFO:teuthology.orchestra.run.smithi017.stderr:37800000 of 50000000 tuples (75%) done (elapsed 551.39 s, remaining 177.96 s) 2023-07-14T13:09:23.144 INFO:teuthology.orchestra.run.smithi017.stderr:37900000 of 50000000 tuples (75%) done (elapsed 552.74 s, remaining 176.47 s) 2023-07-14T13:09:23.453 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:23 smithi135 ceph-mon[97338]: pgmap v300: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 MiB/s wr, 45 op/s 2023-07-14T13:09:23.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:23 smithi131 ceph-mon[96953]: pgmap v300: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 MiB/s wr, 45 op/s 2023-07-14T13:09:23.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:23 smithi017 ceph-mon[95536]: pgmap v300: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 25 MiB/s wr, 45 op/s 2023-07-14T13:09:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:38000000 of 50000000 tuples (76%) done (elapsed 554.21 s, remaining 175.01 s) 2023-07-14T13:09:25.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:25 smithi135 ceph-mon[97338]: pgmap v301: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-14T13:09:25.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:25 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:09:25.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:25 smithi131 ceph-mon[96953]: pgmap v301: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-14T13:09:25.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:25 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:09:25.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:25 smithi017 ceph-mon[95536]: pgmap v301: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-14T13:09:25.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:25 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:09:25.907 INFO:teuthology.orchestra.run.smithi017.stderr:38100000 of 50000000 tuples (76%) done (elapsed 555.51 s, remaining 173.50 s) 2023-07-14T13:09:27.234 INFO:teuthology.orchestra.run.smithi017.stderr:38200000 of 50000000 tuples (76%) done (elapsed 556.83 s, remaining 172.01 s) 2023-07-14T13:09:27.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:27 smithi135 ceph-mon[97338]: pgmap v302: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 34 MiB/s wr, 70 op/s 2023-07-14T13:09:27.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:27 smithi131 ceph-mon[96953]: pgmap v302: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 34 MiB/s wr, 70 op/s 2023-07-14T13:09:27.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:27 smithi017 ceph-mon[95536]: pgmap v302: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 34 MiB/s wr, 70 op/s 2023-07-14T13:09:28.614 INFO:teuthology.orchestra.run.smithi017.stderr:38300000 of 50000000 tuples (76%) done (elapsed 558.21 s, remaining 170.52 s) 2023-07-14T13:09:29.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:29 smithi135 ceph-mon[97338]: pgmap v303: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 22 MiB/s wr, 43 op/s 2023-07-14T13:09:29.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:29 smithi131 ceph-mon[96953]: pgmap v303: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 22 MiB/s wr, 43 op/s 2023-07-14T13:09:29.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:29 smithi017 ceph-mon[95536]: pgmap v303: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 22 MiB/s wr, 43 op/s 2023-07-14T13:09:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.874+0000 7f543efff700 1 -- 172.21.15.17:0/1503973295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54380fea30 msgr2=0x7f54380feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.874+0000 7f543efff700 1 --2- 172.21.15.17:0/1503973295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54380fea30 0x7f54380feea0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5424009990 tx=0x7f5424009ca0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.875+0000 7f543efff700 1 -- 172.21.15.17:0/1503973295 shutdown_connections 2023-07-14T13:09:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.875+0000 7f543efff700 1 --2- 172.21.15.17:0/1503973295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54380ff3e0 0x7f543810b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.875+0000 7f543efff700 1 --2- 172.21.15.17:0/1503973295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5438104a30 0x7f5438104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.875+0000 7f543efff700 1 --2- 172.21.15.17:0/1503973295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54380fea30 0x7f54380feea0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.875+0000 7f543efff700 1 -- 172.21.15.17:0/1503973295 >> 172.21.15.17:0/1503973295 conn(0x7f5438074760 msgr2=0x7f5438074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.875+0000 7f543efff700 1 -- 172.21.15.17:0/1503973295 shutdown_connections 2023-07-14T13:09:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.875+0000 7f543efff700 1 -- 172.21.15.17:0/1503973295 wait complete. 2023-07-14T13:09:29.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.876+0000 7f543efff700 1 Processor -- start 2023-07-14T13:09:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.877+0000 7f543efff700 1 -- start start 2023-07-14T13:09:29.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.877+0000 7f543efff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54380fea30 0x7f543819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.877+0000 7f543efff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54380ff3e0 0x7f543819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.877+0000 7f543efff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5438104a30 0x7f5438195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.877+0000 7f543efff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5438196000 con 0x7f54380fea30 2023-07-14T13:09:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.877+0000 7f543efff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5438196170 con 0x7f54380ff3e0 2023-07-14T13:09:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.877+0000 7f543efff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5438196330 con 0x7f5438104a30 2023-07-14T13:09:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.877+0000 7f543cd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54380fea30 0x7f543819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.878+0000 7f5437fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54380ff3e0 0x7f543819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.878+0000 7f543d59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5438104a30 0x7f5438195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.878+0000 7f543d59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5438104a30 0x7f5438195990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40320/0 (socket says 172.21.15.17:40320) 2023-07-14T13:09:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.878+0000 7f5437fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54380ff3e0 0x7f543819c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:43848/0 (socket says 172.21.15.17:43848) 2023-07-14T13:09:29.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.878+0000 7f543d59c700 1 -- 172.21.15.17:0/4124297549 learned_addr learned my addr 172.21.15.17:0/4124297549 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.878+0000 7f543d59c700 1 -- 172.21.15.17:0/4124297549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54380ff3e0 msgr2=0x7f543819c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.878+0000 7f543d59c700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54380ff3e0 0x7f543819c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.878+0000 7f543d59c700 1 -- 172.21.15.17:0/4124297549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54380fea30 msgr2=0x7f543819bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.878+0000 7f543d59c700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54380fea30 0x7f543819bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.878+0000 7f543d59c700 1 -- 172.21.15.17:0/4124297549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54240095f0 con 0x7f5438104a30 2023-07-14T13:09:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.878+0000 7f543d59c700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5438104a30 0x7f5438195990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f543000ef30 tx=0x7f543000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.879+0000 7f5435ffb700 1 -- 172.21.15.17:0/4124297549 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430018070 con 0x7f5438104a30 2023-07-14T13:09:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.879+0000 7f5435ffb700 1 -- 172.21.15.17:0/4124297549 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f543000f040 con 0x7f5438104a30 2023-07-14T13:09:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.879+0000 7f5435ffb700 1 -- 172.21.15.17:0/4124297549 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543000cbc0 con 0x7f5438104a30 2023-07-14T13:09:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.879+0000 7f543efff700 1 -- 172.21.15.17:0/4124297549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54381965b0 con 0x7f5438104a30 2023-07-14T13:09:29.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.879+0000 7f543efff700 1 -- 172.21.15.17:0/4124297549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5438100740 con 0x7f5438104a30 2023-07-14T13:09:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.883+0000 7f5435ffb700 1 -- 172.21.15.17:0/4124297549 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f543000cd80 con 0x7f5438104a30 2023-07-14T13:09:29.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.884+0000 7f54528c3b80 1 Processor -- start 2023-07-14T13:09:29.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.884+0000 7f54528c3b80 1 -- start start 2023-07-14T13:09:29.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.884+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e87033bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.884+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e87033c2d0 0x55e870336040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.884+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e870336580 0x55e8703369d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f54528c3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87023bc50 con 0x55e87033c2d0 2023-07-14T13:09:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f54528c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87028e9e0 con 0x55e8701926b0 2023-07-14T13:09:29.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f54528c3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e870287e70 con 0x55e870336580 2023-07-14T13:09:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f5437fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e87033bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f543cd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e87033c2d0 0x55e870336040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f5437fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e87033bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:43854/0 (socket says 172.21.15.17:43854) 2023-07-14T13:09:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f5437fff700 1 -- 172.21.15.17:0/1948988934 learned_addr learned my addr 172.21.15.17:0/1948988934 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f5437fff700 1 --2- 172.21.15.17:0/1948988934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e870336580 0x55e8703369d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f543cd9b700 1 -- 172.21.15.17:0/1948988934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e870336580 msgr2=0x55e8703369d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f543cd9b700 1 --2- 172.21.15.17:0/1948988934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e870336580 0x55e8703369d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f543cd9b700 1 -- 172.21.15.17:0/1948988934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 msgr2=0x55e87033bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:29.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f543cd9b700 1 --2- 172.21.15.17:0/1948988934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e87033bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f543cd9b700 1 -- 172.21.15.17:0/1948988934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8700b5d80 con 0x55e87033c2d0 2023-07-14T13:09:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.885+0000 7f5435ffb700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54280a12c0 0x7f54280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.886+0000 7f5435ffb700 1 -- 172.21.15.17:0/4124297549 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f54300cc820 con 0x7f5438104a30 2023-07-14T13:09:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.886+0000 7f543cd9b700 1 --2- 172.21.15.17:0/1948988934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e87033c2d0 0x55e870336040 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f542c009c80 tx=0x7f542c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9db03e7ac5152d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.886+0000 7f5437fff700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54280a12c0 0x7f54280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.886+0000 7f5422ffd700 1 -- 172.21.15.17:0/1948988934 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c011cb0 con 0x55e87033c2d0 2023-07-14T13:09:29.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.886+0000 7f5422ffd700 1 -- 172.21.15.17:0/1948988934 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f542c011e10 con 0x55e87033c2d0 2023-07-14T13:09:29.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.886+0000 7f5422ffd700 1 -- 172.21.15.17:0/1948988934 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c005020 con 0x55e87033c2d0 2023-07-14T13:09:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.887+0000 7f5437fff700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54280a12c0 0x7f54280a3770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5424000c00 tx=0x7f542401a040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.887+0000 7f54528c3b80 1 -- 172.21.15.17:0/1948988934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e87033c2d0 msgr2=0x55e870336040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.887+0000 7f54528c3b80 1 --2- 172.21.15.17:0/1948988934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e87033c2d0 0x55e870336040 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f542c009c80 tx=0x7f542c009f90 comp rx=0 tx=0).stop 2023-07-14T13:09:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.887+0000 7f54528c3b80 1 -- 172.21.15.17:0/1948988934 shutdown_connections 2023-07-14T13:09:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.887+0000 7f54528c3b80 1 --2- 172.21.15.17:0/1948988934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e870336580 0x55e8703369d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.887+0000 7f54528c3b80 1 --2- 172.21.15.17:0/1948988934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e87033bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.887+0000 7f54528c3b80 1 --2- 172.21.15.17:0/1948988934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e87033c2d0 0x55e870336040 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.887+0000 7f54528c3b80 1 -- 172.21.15.17:0/1948988934 >> 172.21.15.17:0/1948988934 conn(0x55e87032bbe0 msgr2=0x55e870330f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.887+0000 7f54528c3b80 1 -- 172.21.15.17:0/1948988934 shutdown_connections 2023-07-14T13:09:29.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.887+0000 7f54528c3b80 1 -- 172.21.15.17:0/1948988934 wait complete. 2023-07-14T13:09:29.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.888+0000 7f54528c3b80 1 -- start start 2023-07-14T13:09:29.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.888+0000 7f54528c3b80 1 Processor -- start 2023-07-14T13:09:29.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e870342630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 0x55e87033ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f54528c3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e870227a60 con 0x55e870336580 2023-07-14T13:09:29.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f54528c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e870227760 con 0x55e8701926b0 2023-07-14T13:09:29.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f54528c3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87010b8c0 con 0x55e87033c2d0 2023-07-14T13:09:29.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f54528c3b80 10 client.0 _ll_register_callbacks cb 0x55e870225700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:29.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f543d59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 0x55e87033ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f543d59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 0x55e87033ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40328/0 (socket says 172.21.15.17:40328) 2023-07-14T13:09:29.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f5437fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f543d59c700 1 -- 172.21.15.17:0/1351146144 learned_addr learned my addr 172.21.15.17:0/1351146144 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:29.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.889+0000 7f543cd9b700 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e870342630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.890+0000 7f543cd9b700 1 -- 172.21.15.17:0/1351146144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 msgr2=0x55e87033ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:29.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.890+0000 7f543cd9b700 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 0x55e87033ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.890+0000 7f543cd9b700 1 -- 172.21.15.17:0/1351146144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 msgr2=0x55e87033f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:29.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.890+0000 7f543cd9b700 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.890+0000 7f543cd9b700 1 -- 172.21.15.17:0/1351146144 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c0098e0 con 0x55e8701926b0 2023-07-14T13:09:29.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.890+0000 7f543d59c700 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 0x55e87033ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:29.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.890+0000 7f543cd9b700 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e870342630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f542c000c00 tx=0x7f542c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc69c0dd3446390c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.890+0000 7f5417fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:09:29.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.891+0000 7f5417fff700 1 -- 172.21.15.17:0/1351146144 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c005d50 con 0x55e8701926b0 2023-07-14T13:09:29.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.891+0000 7f54528c3b80 1 -- 172.21.15.17:0/1351146144 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8701e1490 con 0x55e8701926b0 2023-07-14T13:09:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.891+0000 7f5417fff700 1 -- 172.21.15.17:0/1351146144 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f542c003680 con 0x55e8701926b0 2023-07-14T13:09:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.891+0000 7f5417fff700 1 -- 172.21.15.17:0/1351146144 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f542c003840 con 0x55e8701926b0 2023-07-14T13:09:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.891+0000 7f54528c3b80 10 client.27047 fetch_fsmap learned FSMap version 34 2023-07-14T13:09:29.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.891+0000 7f54528c3b80 1 -- 172.21.15.17:0/1351146144 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e87009ec00 con 0x55e8701926b0 2023-07-14T13:09:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.891+0000 7f5417fff700 1 -- 172.21.15.17:0/1351146144 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e8701e1490 con 0x55e8701926b0 2023-07-14T13:09:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.891+0000 7f5417fff700 1 -- 172.21.15.17:0/1351146144 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f542c020070 con 0x55e8701926b0 2023-07-14T13:09:29.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.892+0000 7f54528c3b80 10 client.27047 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:09:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.892+0000 7f54528c3b80 10 client.27047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.892+0000 7f54528c3b80 20 client.27047 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.892+0000 7f54528c3b80 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e87034fa20 0x55e870351e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.892+0000 7f54528c3b80 4 client.27047 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:09:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.892+0000 7f54528c3b80 1 -- 172.21.15.17:0/1351146144 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e870280e50 con 0x55e87034fa20 2023-07-14T13:09:29.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.892+0000 7f5437fff700 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e87034fa20 0x55e870351e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.893+0000 7f5437fff700 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e87034fa20 0x55e870351e30 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32746c482910dbdd server_cookie=ab9e33ad902f75e1 in_seq=0 out_seq=0 2023-07-14T13:09:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.893+0000 7f5417fff700 10 client.27047 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f5417fff700 1 -- 172.21.15.17:0/1351146144 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e870280e50 con 0x55e87034fa20 2023-07-14T13:09:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f5417fff700 10 client.27047 handle_command_reply: tid=0 2023-07-14T13:09:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f54528c3b80 1 client.27047 shutdown 2023-07-14T13:09:29.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f54528c3b80 1 -- 172.21.15.17:0/1351146144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 msgr2=0x55e870342630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f54528c3b80 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e870342630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f542c000c00 tx=0x7f542c004270 comp rx=0 tx=0).stop 2023-07-14T13:09:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f54528c3b80 1 -- 172.21.15.17:0/1351146144 shutdown_connections 2023-07-14T13:09:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f54528c3b80 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e87034fa20 0x55e870351e30 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f54528c3b80 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 0x55e87033ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f54528c3b80 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e870342630 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f5417fff700 0 client.27047 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f54528c3b80 1 --2- 172.21.15.17:0/1351146144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f54528c3b80 1 -- 172.21.15.17:0/1351146144 >> 172.21.15.17:0/1351146144 conn(0x55e87032bbe0 msgr2=0x55e8703304e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f54528c3b80 1 -- 172.21.15.17:0/1351146144 shutdown_connections 2023-07-14T13:09:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.894+0000 7f54528c3b80 1 -- 172.21.15.17:0/1351146144 wait complete. 2023-07-14T13:09:29.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.895+0000 7f54528c3b80 20 client.27047 trim_cache size 0 max 16384 2023-07-14T13:09:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.911+0000 7f54528c3b80 1 Processor -- start 2023-07-14T13:09:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.911+0000 7f54528c3b80 1 -- start start 2023-07-14T13:09:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8701926b0 0x55e870336040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e87033c2d0 0x55e870346c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f54528c3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e870331e80 con 0x55e870336580 2023-07-14T13:09:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f54528c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87033a5e0 con 0x55e87033c2d0 2023-07-14T13:09:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f54528c3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e870340cd0 con 0x55e8701926b0 2023-07-14T13:09:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f5437fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f543cd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8701926b0 0x55e870336040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f5437fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57780/0 (socket says 172.21.15.17:57780) 2023-07-14T13:09:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f5437fff700 1 -- 172.21.15.17:0/387533851 learned_addr learned my addr 172.21.15.17:0/387533851 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f543d59c700 1 --2- 172.21.15.17:0/387533851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e87033c2d0 0x55e870346c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f543cd9b700 1 -- 172.21.15.17:0/387533851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e87033c2d0 msgr2=0x55e870346c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f543cd9b700 1 --2- 172.21.15.17:0/387533851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e87033c2d0 0x55e870346c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f543cd9b700 1 -- 172.21.15.17:0/387533851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 msgr2=0x55e87033f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f543cd9b700 1 --2- 172.21.15.17:0/387533851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.912+0000 7f543cd9b700 1 -- 172.21.15.17:0/387533851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8700dc1f0 con 0x55e8701926b0 2023-07-14T13:09:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.913+0000 7f543cd9b700 1 --2- 172.21.15.17:0/387533851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8701926b0 0x55e870336040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f542c011de0 tx=0x7f542c004670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aed39194ccafb8e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.913+0000 7f54237fe700 1 -- 172.21.15.17:0/387533851 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c005d50 con 0x55e8701926b0 2023-07-14T13:09:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.913+0000 7f54237fe700 1 -- 172.21.15.17:0/387533851 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f542c0042e0 con 0x55e8701926b0 2023-07-14T13:09:29.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.913+0000 7f54237fe700 1 -- 172.21.15.17:0/387533851 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c021760 con 0x55e8701926b0 2023-07-14T13:09:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.914+0000 7f54528c3b80 1 -- 172.21.15.17:0/387533851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8701926b0 msgr2=0x55e870336040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.914+0000 7f54528c3b80 1 --2- 172.21.15.17:0/387533851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8701926b0 0x55e870336040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f542c011de0 tx=0x7f542c004670 comp rx=0 tx=0).stop 2023-07-14T13:09:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.914+0000 7f54528c3b80 1 -- 172.21.15.17:0/387533851 shutdown_connections 2023-07-14T13:09:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.914+0000 7f54528c3b80 1 --2- 172.21.15.17:0/387533851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e87033c2d0 0x55e870346c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.914+0000 7f54528c3b80 1 --2- 172.21.15.17:0/387533851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8701926b0 0x55e870336040 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.914+0000 7f54528c3b80 1 --2- 172.21.15.17:0/387533851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.914+0000 7f54528c3b80 1 -- 172.21.15.17:0/387533851 >> 172.21.15.17:0/387533851 conn(0x55e87032bbe0 msgr2=0x55e87033f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.914+0000 7f54528c3b80 1 -- 172.21.15.17:0/387533851 shutdown_connections 2023-07-14T13:09:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.914+0000 7f54528c3b80 1 -- 172.21.15.17:0/387533851 wait complete. 2023-07-14T13:09:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.914+0000 7f54528c3b80 1 -- start start 2023-07-14T13:09:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.915+0000 7f54528c3b80 1 Processor -- start 2023-07-14T13:09:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.915+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e87033ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.915+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.915+0000 7f54528c3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 0x55e87033e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.915+0000 7f54528c3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87033ee60 con 0x55e870336580 2023-07-14T13:09:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.915+0000 7f54528c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87033efd0 con 0x55e8701926b0 2023-07-14T13:09:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.915+0000 7f54528c3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87033f190 con 0x55e87033c2d0 2023-07-14T13:09:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.915+0000 7f54528c3b80 10 client.0 _ll_register_callbacks cb 0x7f542c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.916+0000 7f543cd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e87033ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.916+0000 7f543cd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e87033ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:43882/0 (socket says 172.21.15.17:43882) 2023-07-14T13:09:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.916+0000 7f543cd9b700 1 -- 172.21.15.17:0/3741405916 learned_addr learned my addr 172.21.15.17:0/3741405916 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.916+0000 7f5437fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.916+0000 7f543d59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 0x55e87033e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.916+0000 7f543cd9b700 1 -- 172.21.15.17:0/3741405916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 msgr2=0x55e87033e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.916+0000 7f543cd9b700 1 --2- 172.21.15.17:0/3741405916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 0x55e87033e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.916+0000 7f543cd9b700 1 -- 172.21.15.17:0/3741405916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 msgr2=0x55e87033e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.916+0000 7f543cd9b700 1 --2- 172.21.15.17:0/3741405916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.916+0000 7f543cd9b700 1 -- 172.21.15.17:0/3741405916 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e87009ec00 con 0x55e8701926b0 2023-07-14T13:09:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.916+0000 7f543cd9b700 1 --2- 172.21.15.17:0/3741405916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e87033ddc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f542c005d60 tx=0x7f542c019f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43f6f14902db666a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.917+0000 7f5417fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:09:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.917+0000 7f5417fff700 1 -- 172.21.15.17:0/3741405916 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c03b070 con 0x55e8701926b0 2023-07-14T13:09:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.917+0000 7f54528c3b80 1 -- 172.21.15.17:0/3741405916 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e870242ff0 con 0x55e8701926b0 2023-07-14T13:09:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.917+0000 7f5417fff700 1 -- 172.21.15.17:0/3741405916 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f542c019430 con 0x55e8701926b0 2023-07-14T13:09:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.917+0000 7f5417fff700 1 -- 172.21.15.17:0/3741405916 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f542c019610 con 0x55e8701926b0 2023-07-14T13:09:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.917+0000 7f54528c3b80 10 client.27053 fetch_fsmap learned FSMap version 34 2023-07-14T13:09:29.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.917+0000 7f54528c3b80 1 -- 172.21.15.17:0/3741405916 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e8700b4250 con 0x55e8701926b0 2023-07-14T13:09:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.918+0000 7f5417fff700 1 -- 172.21.15.17:0/3741405916 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e870242ff0 con 0x55e8701926b0 2023-07-14T13:09:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.918+0000 7f5417fff700 1 -- 172.21.15.17:0/3741405916 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f542c020070 con 0x55e8701926b0 2023-07-14T13:09:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.918+0000 7f54528c3b80 10 client.27053 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:09:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.918+0000 7f54528c3b80 10 client.27053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.918+0000 7f54528c3b80 20 client.27053 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.918+0000 7f54528c3b80 1 --2- 172.21.15.17:0/3741405916 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e8703a3f10 0x55e8703a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:29.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.918+0000 7f54528c3b80 4 client.27053 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:09:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.918+0000 7f54528c3b80 1 -- 172.21.15.17:0/3741405916 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e8700d6f10 con 0x55e8703a3f10 2023-07-14T13:09:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.918+0000 7f5437fff700 1 --2- 172.21.15.17:0/3741405916 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e8703a3f10 0x55e8703a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.919+0000 7f5437fff700 1 --2- 172.21.15.17:0/3741405916 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e8703a3f10 0x55e8703a62f0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1ba7378e8ff6189 server_cookie=9647e28a39b7c7e in_seq=0 out_seq=0 2023-07-14T13:09:29.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.919+0000 7f5417fff700 10 client.27053 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:29.960 INFO:teuthology.orchestra.run.smithi017.stderr:38400000 of 50000000 tuples (76%) done (elapsed 559.56 s, remaining 169.03 s) 2023-07-14T13:09:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f5417fff700 1 -- 172.21.15.17:0/3741405916 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e8700d6f10 con 0x55e8703a3f10 2023-07-14T13:09:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f5417fff700 10 client.27053 handle_command_reply: tid=0 2023-07-14T13:09:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f54528c3b80 1 client.27053 shutdown 2023-07-14T13:09:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f54528c3b80 1 -- 172.21.15.17:0/3741405916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 msgr2=0x55e87033ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f54528c3b80 1 --2- 172.21.15.17:0/3741405916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e87033ddc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f542c005d60 tx=0x7f542c019f10 comp rx=0 tx=0).stop 2023-07-14T13:09:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f54528c3b80 1 -- 172.21.15.17:0/3741405916 shutdown_connections 2023-07-14T13:09:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f54528c3b80 1 --2- 172.21.15.17:0/3741405916 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e8703a3f10 0x55e8703a62f0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f54528c3b80 1 --2- 172.21.15.17:0/3741405916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e87033c2d0 0x55e87033e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f54528c3b80 1 --2- 172.21.15.17:0/3741405916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e8701926b0 0x55e87033ddc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f54528c3b80 1 --2- 172.21.15.17:0/3741405916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e870336580 0x55e87033e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f5417fff700 0 client.27053 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.932+0000 7f54528c3b80 1 -- 172.21.15.17:0/3741405916 >> 172.21.15.17:0/3741405916 conn(0x55e87032bbe0 msgr2=0x55e87033b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.933+0000 7f54528c3b80 1 -- 172.21.15.17:0/3741405916 shutdown_connections 2023-07-14T13:09:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.933+0000 7f54528c3b80 1 -- 172.21.15.17:0/3741405916 wait complete. 2023-07-14T13:09:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.933+0000 7f54528c3b80 20 client.27053 trim_cache size 0 max 16384 2023-07-14T13:09:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:09:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:09:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:09:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:09:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.933+0000 7f543efff700 1 -- 172.21.15.17:0/4124297549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54280a12c0 msgr2=0x7f54280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.933+0000 7f543efff700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54280a12c0 0x7f54280a3770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5424000c00 tx=0x7f542401a040 comp rx=0 tx=0).stop 2023-07-14T13:09:29.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.933+0000 7f543efff700 1 -- 172.21.15.17:0/4124297549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5438104a30 msgr2=0x7f5438195990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:29.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.933+0000 7f543efff700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5438104a30 0x7f5438195990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f543000ef30 tx=0x7f543000c3a0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.934+0000 7f543efff700 1 -- 172.21.15.17:0/4124297549 shutdown_connections 2023-07-14T13:09:29.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.934+0000 7f543efff700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54280a12c0 0x7f54280a3770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.934+0000 7f543efff700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5438104a30 0x7f5438195990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.934+0000 7f543efff700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54380fea30 0x7f543819bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.934+0000 7f543efff700 1 --2- 172.21.15.17:0/4124297549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54380ff3e0 0x7f543819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:29.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.934+0000 7f543efff700 1 -- 172.21.15.17:0/4124297549 >> 172.21.15.17:0/4124297549 conn(0x7f5438074760 msgr2=0x7f54380679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:29.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.934+0000 7f543efff700 1 -- 172.21.15.17:0/4124297549 shutdown_connections 2023-07-14T13:09:29.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:29.934+0000 7f543efff700 1 -- 172.21.15.17:0/4124297549 wait complete. 2023-07-14T13:09:30.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:30 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:09:30.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:30 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:09:30.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:30 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:09:31.291 INFO:teuthology.orchestra.run.smithi017.stderr:38500000 of 50000000 tuples (77%) done (elapsed 560.89 s, remaining 167.54 s) 2023-07-14T13:09:31.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:31 smithi131 ceph-mon[96953]: pgmap v304: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 34 MiB/s wr, 65 op/s 2023-07-14T13:09:31.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:31 smithi017 ceph-mon[95536]: pgmap v304: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 34 MiB/s wr, 65 op/s 2023-07-14T13:09:31.636 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:09:31.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:31 smithi135 ceph-mon[97338]: pgmap v304: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 34 MiB/s wr, 65 op/s 2023-07-14T13:09:31.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.900+0000 7f86679ff700 1 -- 172.21.15.17:0/2370004525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86601004b0 msgr2=0x7f866010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.900+0000 7f86679ff700 1 --2- 172.21.15.17:0/2370004525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86601004b0 0x7f866010c940 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8658009f90 tx=0x7f865800b330 comp rx=0 tx=0).stop 2023-07-14T13:09:31.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.900+0000 7f86679ff700 1 -- 172.21.15.17:0/2370004525 shutdown_connections 2023-07-14T13:09:31.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.900+0000 7f86679ff700 1 --2- 172.21.15.17:0/2370004525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86601004b0 0x7f866010c940 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.900+0000 7f86679ff700 1 --2- 172.21.15.17:0/2370004525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8660105b10 0x7f8660105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.900+0000 7f86679ff700 1 --2- 172.21.15.17:0/2370004525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86600ffb00 0x7f86600fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.900+0000 7f86679ff700 1 -- 172.21.15.17:0/2370004525 >> 172.21.15.17:0/2370004525 conn(0x7f86600fb600 msgr2=0x7f86600fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:31.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.900+0000 7f86679ff700 1 -- 172.21.15.17:0/2370004525 shutdown_connections 2023-07-14T13:09:31.938 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.900+0000 7f86679ff700 1 -- 172.21.15.17:0/2370004525 wait complete. 2023-07-14T13:09:31.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.901+0000 7f86679ff700 1 Processor -- start 2023-07-14T13:09:31.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.901+0000 7f86679ff700 1 -- start start 2023-07-14T13:09:31.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f86679ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86600ffb00 0x7f866019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f86679ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86601004b0 0x7f866019bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f86679ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8660105b10 0x7f8660195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f86679ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86601960d0 con 0x7f8660105b10 2023-07-14T13:09:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f86679ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660196240 con 0x7f86601004b0 2023-07-14T13:09:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f86679ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660196400 con 0x7f86600ffb00 2023-07-14T13:09:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f866579b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86600ffb00 0x7f866019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f8664f9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86601004b0 0x7f866019bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f8665f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8660105b10 0x7f8660195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f866579b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86600ffb00 0x7f866019b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40374/0 (socket says 172.21.15.17:40374) 2023-07-14T13:09:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f8664f9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86601004b0 0x7f866019bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:43902/0 (socket says 172.21.15.17:43902) 2023-07-14T13:09:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.902+0000 7f866579b700 1 -- 172.21.15.17:0/917135347 learned_addr learned my addr 172.21.15.17:0/917135347 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f866579b700 1 -- 172.21.15.17:0/917135347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86601004b0 msgr2=0x7f866019bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f866579b700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86601004b0 0x7f866019bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f866579b700 1 -- 172.21.15.17:0/917135347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8660105b10 msgr2=0x7f8660195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f866579b700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8660105b10 0x7f8660195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f866579b700 1 -- 172.21.15.17:0/917135347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500095f0 con 0x7f86600ffb00 2023-07-14T13:09:31.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f8664f9a700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86601004b0 0x7f866019bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:31.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f8665f9c700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8660105b10 0x7f8660195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:31.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f866579b700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86600ffb00 0x7f866019b9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f865c00eb30 tx=0x7f865c00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f86567fc700 1 -- 172.21.15.17:0/917135347 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c009880 con 0x7f86600ffb00 2023-07-14T13:09:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f86567fc700 1 -- 172.21.15.17:0/917135347 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f865c0044b0 con 0x7f86600ffb00 2023-07-14T13:09:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f86567fc700 1 -- 172.21.15.17:0/917135347 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c003ce0 con 0x7f86600ffb00 2023-07-14T13:09:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.903+0000 7f86679ff700 1 -- 172.21.15.17:0/917135347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c009520 con 0x7f86600ffb00 2023-07-14T13:09:31.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.904+0000 7f86679ff700 1 -- 172.21.15.17:0/917135347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8658009c40 con 0x7f86600ffb00 2023-07-14T13:09:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.908+0000 7f86567fc700 1 -- 172.21.15.17:0/917135347 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f865c003e40 con 0x7f86600ffb00 2023-07-14T13:09:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.908+0000 7f867b37bb80 1 Processor -- start 2023-07-14T13:09:31.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f867b37bb80 1 -- start start 2023-07-14T13:09:31.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 0x55c15b05a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 0x55c15b067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f867b37bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15af60cb0 con 0x55c15b05a2d0 2023-07-14T13:09:31.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f867b37bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15afb3a40 con 0x55c15b065ad0 2023-07-14T13:09:31.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f867b37bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15afaced0 con 0x55c15b05abe0 2023-07-14T13:09:31.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f8665f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 0x55c15b05a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f8664f9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 0x55c15b067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f866579b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f8665f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 0x55c15b05a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57810/0 (socket says 172.21.15.17:57810) 2023-07-14T13:09:31.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.909+0000 7f8665f9c700 1 -- 172.21.15.17:0/449001863 learned_addr learned my addr 172.21.15.17:0/449001863 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:31.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.910+0000 7f8664f9a700 1 -- 172.21.15.17:0/449001863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 msgr2=0x55c15b065590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:31.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.910+0000 7f8664f9a700 1 --2- 172.21.15.17:0/449001863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b065590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.910+0000 7f8664f9a700 1 -- 172.21.15.17:0/449001863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 msgr2=0x55c15b05a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:31.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.910+0000 7f8664f9a700 1 --2- 172.21.15.17:0/449001863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 0x55c15b05a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.910+0000 7f8664f9a700 1 -- 172.21.15.17:0/449001863 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c15addade0 con 0x55c15b065ad0 2023-07-14T13:09:31.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.910+0000 7f86567fc700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f864c0a1340 0x7f864c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.910+0000 7f86567fc700 1 -- 172.21.15.17:0/917135347 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f865c014070 con 0x7f86600ffb00 2023-07-14T13:09:31.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.910+0000 7f8664f9a700 1 --2- 172.21.15.17:0/449001863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 0x55c15b067eb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8650005fd0 tx=0x7f8650013dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64737cfba258827b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.910+0000 7f8665f9c700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f864c0a1340 0x7f864c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.911+0000 7f864b7fe700 1 -- 172.21.15.17:0/449001863 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650018070 con 0x55c15b065ad0 2023-07-14T13:09:31.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.911+0000 7f864b7fe700 1 -- 172.21.15.17:0/449001863 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f865000edf0 con 0x55c15b065ad0 2023-07-14T13:09:31.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.911+0000 7f864b7fe700 1 -- 172.21.15.17:0/449001863 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650003900 con 0x55c15b065ad0 2023-07-14T13:09:31.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.912+0000 7f867b37bb80 1 -- 172.21.15.17:0/449001863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 msgr2=0x55c15b067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.912+0000 7f867b37bb80 1 --2- 172.21.15.17:0/449001863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 0x55c15b067eb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8650005fd0 tx=0x7f8650013dd0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.912+0000 7f8665f9c700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f864c0a1340 0x7f864c0a37f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8658015000 tx=0x7f86580096c0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.912+0000 7f867b37bb80 1 -- 172.21.15.17:0/449001863 shutdown_connections 2023-07-14T13:09:31.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.912+0000 7f867b37bb80 1 --2- 172.21.15.17:0/449001863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 0x55c15b067eb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.912+0000 7f867b37bb80 1 --2- 172.21.15.17:0/449001863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 0x55c15b05a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.912+0000 7f867b37bb80 1 --2- 172.21.15.17:0/449001863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b065590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.912+0000 7f867b37bb80 1 -- 172.21.15.17:0/449001863 >> 172.21.15.17:0/449001863 conn(0x55c15b050da0 msgr2=0x55c15b0566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:31.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.912+0000 7f867b37bb80 1 -- 172.21.15.17:0/449001863 shutdown_connections 2023-07-14T13:09:31.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.912+0000 7f867b37bb80 1 -- 172.21.15.17:0/449001863 wait complete. 2023-07-14T13:09:31.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.912+0000 7f867b37bb80 1 -- start start 2023-07-14T13:09:31.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.913+0000 7f867b37bb80 1 Processor -- start 2023-07-14T13:09:31.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.913+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 0x55c15b065530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.913+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b0627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.913+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 0x55c15b062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.913+0000 7f867b37bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15af4cac0 con 0x55c15b05a2d0 2023-07-14T13:09:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.913+0000 7f867b37bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15af4c7c0 con 0x55c15b065ad0 2023-07-14T13:09:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.913+0000 7f867b37bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15ae30920 con 0x55c15b05abe0 2023-07-14T13:09:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.913+0000 7f867b37bb80 10 client.0 _ll_register_callbacks cb 0x55c15af4a760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f866579b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 0x55c15b065530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f8664f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b0627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f8665f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 0x55c15b062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f866579b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 0x55c15b065530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57818/0 (socket says 172.21.15.17:57818) 2023-07-14T13:09:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f8664f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b0627b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40392/0 (socket says 172.21.15.17:40392) 2023-07-14T13:09:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f866579b700 1 -- 172.21.15.17:0/1149797070 learned_addr learned my addr 172.21.15.17:0/1149797070 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f8665f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 0x55c15b062ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:43926/0 (socket says 172.21.15.17:43926) 2023-07-14T13:09:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f8665f9c700 1 -- 172.21.15.17:0/1149797070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 msgr2=0x55c15b0627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:31.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f8665f9c700 1 --2- 172.21.15.17:0/1149797070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b0627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f8665f9c700 1 -- 172.21.15.17:0/1149797070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 msgr2=0x55c15b065530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f8665f9c700 1 --2- 172.21.15.17:0/1149797070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 0x55c15b065530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f8665f9c700 1 -- 172.21.15.17:0/1149797070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86500137d0 con 0x55c15b065ad0 2023-07-14T13:09:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f8665f9c700 1 --2- 172.21.15.17:0/1149797070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 0x55c15b062ef0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8658007bf0 tx=0x7f8658009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f2cbdd408141590 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.914+0000 7f8648ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:09:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.915+0000 7f8648ff9700 1 -- 172.21.15.17:0/1149797070 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800e040 con 0x55c15b065ad0 2023-07-14T13:09:31.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.915+0000 7f867b37bb80 1 -- 172.21.15.17:0/1149797070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c15af064f0 con 0x55c15b065ad0 2023-07-14T13:09:31.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.915+0000 7f8648ff9700 1 -- 172.21.15.17:0/1149797070 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8658023070 con 0x55c15b065ad0 2023-07-14T13:09:31.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.915+0000 7f8648ff9700 1 -- 172.21.15.17:0/1149797070 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f865800be80 con 0x55c15b065ad0 2023-07-14T13:09:31.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.915+0000 7f867b37bb80 10 client.27065 fetch_fsmap learned FSMap version 34 2023-07-14T13:09:31.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.915+0000 7f867b37bb80 1 -- 172.21.15.17:0/1149797070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c15adc3c60 con 0x55c15b065ad0 2023-07-14T13:09:31.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.915+0000 7f8648ff9700 1 -- 172.21.15.17:0/1149797070 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c15af064f0 con 0x55c15b065ad0 2023-07-14T13:09:31.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.916+0000 7f8648ff9700 1 -- 172.21.15.17:0/1149797070 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f8658005350 con 0x55c15b065ad0 2023-07-14T13:09:31.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.916+0000 7f867b37bb80 10 client.27065 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:09:31.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.916+0000 7f867b37bb80 10 client.27065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:31.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.916+0000 7f867b37bb80 20 client.27065 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:31.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.916+0000 7f867b37bb80 1 --2- 172.21.15.17:0/1149797070 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c15b0752e0 0x55c15b0776f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.916+0000 7f867b37bb80 4 client.27065 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:09:31.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.916+0000 7f867b37bb80 1 -- 172.21.15.17:0/1149797070 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c15afa5eb0 con 0x55c15b0752e0 2023-07-14T13:09:31.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.916+0000 7f866579b700 1 --2- 172.21.15.17:0/1149797070 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c15b0752e0 0x55c15b0776f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.917+0000 7f866579b700 1 --2- 172.21.15.17:0/1149797070 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c15b0752e0 0x55c15b0776f0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca39ea6e97b7af5d server_cookie=915a55b63dfb8ae5 in_seq=0 out_seq=0 2023-07-14T13:09:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.917+0000 7f8648ff9700 10 client.27065 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f8648ff9700 1 -- 172.21.15.17:0/1149797070 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c15afa5eb0 con 0x55c15b0752e0 2023-07-14T13:09:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f8648ff9700 10 client.27065 handle_command_reply: tid=0 2023-07-14T13:09:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 1 client.27065 shutdown 2023-07-14T13:09:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 1 -- 172.21.15.17:0/1149797070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 msgr2=0x55c15b062ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 1 --2- 172.21.15.17:0/1149797070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 0x55c15b062ef0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8658007bf0 tx=0x7f8658009920 comp rx=0 tx=0).stop 2023-07-14T13:09:31.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 1 -- 172.21.15.17:0/1149797070 shutdown_connections 2023-07-14T13:09:31.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 1 --2- 172.21.15.17:0/1149797070 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c15b0752e0 0x55c15b0776f0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 1 --2- 172.21.15.17:0/1149797070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b065ad0 0x55c15b062ef0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 1 --2- 172.21.15.17:0/1149797070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05a2d0 0x55c15b065530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f8648ff9700 0 client.27065 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:31.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 1 --2- 172.21.15.17:0/1149797070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b0627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 1 -- 172.21.15.17:0/1149797070 >> 172.21.15.17:0/1149797070 conn(0x55c15b050da0 msgr2=0x55c15b056290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:31.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 1 -- 172.21.15.17:0/1149797070 shutdown_connections 2023-07-14T13:09:31.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 1 -- 172.21.15.17:0/1149797070 wait complete. 2023-07-14T13:09:31.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.918+0000 7f867b37bb80 20 client.27065 trim_cache size 0 max 16384 2023-07-14T13:09:31.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.947+0000 7f867b37bb80 1 Processor -- start 2023-07-14T13:09:31.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.947+0000 7f867b37bb80 1 -- start start 2023-07-14T13:09:31.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.947+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b050da0 0x55c15b054e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.947+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05a2d0 0x55c15b0650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.947+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05abe0 0x55c15b061f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.947+0000 7f867b37bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b05d1e0 con 0x55c15b05abe0 2023-07-14T13:09:31.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.947+0000 7f867b37bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b05e360 con 0x55c15b050da0 2023-07-14T13:09:31.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.947+0000 7f867b37bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b055350 con 0x55c15b05a2d0 2023-07-14T13:09:31.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.948+0000 7f8664f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05a2d0 0x55c15b0650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.948+0000 7f8664f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05a2d0 0x55c15b0650d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40398/0 (socket says 172.21.15.17:40398) 2023-07-14T13:09:31.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.948+0000 7f8664f9a700 1 -- 172.21.15.17:0/3727617744 learned_addr learned my addr 172.21.15.17:0/3727617744 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:31.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.948+0000 7f8665f9c700 1 --2- 172.21.15.17:0/3727617744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05abe0 0x55c15b061f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.948+0000 7f8664f9a700 1 -- 172.21.15.17:0/3727617744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b050da0 msgr2=0x55c15b054e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.948+0000 7f866579b700 1 --2- 172.21.15.17:0/3727617744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b050da0 0x55c15b054e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.948+0000 7f8664f9a700 1 --2- 172.21.15.17:0/3727617744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b050da0 0x55c15b054e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.948+0000 7f8664f9a700 1 -- 172.21.15.17:0/3727617744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05abe0 msgr2=0x55c15b061f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.948+0000 7f8664f9a700 1 --2- 172.21.15.17:0/3727617744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05abe0 0x55c15b061f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.948+0000 7f8664f9a700 1 -- 172.21.15.17:0/3727617744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c15ae01250 con 0x55c15b05a2d0 2023-07-14T13:09:31.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.949+0000 7f8665f9c700 1 --2- 172.21.15.17:0/3727617744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05abe0 0x55c15b061f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:31.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.949+0000 7f866579b700 1 --2- 172.21.15.17:0/3727617744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b050da0 0x55c15b054e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:09:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.949+0000 7f8664f9a700 1 --2- 172.21.15.17:0/3727617744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05a2d0 0x55c15b0650d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8650009890 tx=0x7f8650005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb82c8c5a08e28c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.949+0000 7f864bfff700 1 -- 172.21.15.17:0/3727617744 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650018040 con 0x55c15b05a2d0 2023-07-14T13:09:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.949+0000 7f864bfff700 1 -- 172.21.15.17:0/3727617744 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86500055a0 con 0x55c15b05a2d0 2023-07-14T13:09:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.949+0000 7f864bfff700 1 -- 172.21.15.17:0/3727617744 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650003a70 con 0x55c15b05a2d0 2023-07-14T13:09:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.950+0000 7f867b37bb80 1 -- 172.21.15.17:0/3727617744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05a2d0 msgr2=0x55c15b0650d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.950+0000 7f867b37bb80 1 --2- 172.21.15.17:0/3727617744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05a2d0 0x55c15b0650d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8650009890 tx=0x7f8650005e80 comp rx=0 tx=0).stop 2023-07-14T13:09:31.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.950+0000 7f867b37bb80 1 -- 172.21.15.17:0/3727617744 shutdown_connections 2023-07-14T13:09:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.950+0000 7f867b37bb80 1 --2- 172.21.15.17:0/3727617744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b05abe0 0x55c15b061f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.950+0000 7f867b37bb80 1 --2- 172.21.15.17:0/3727617744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b050da0 0x55c15b054e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.950+0000 7f867b37bb80 1 --2- 172.21.15.17:0/3727617744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05a2d0 0x55c15b0650d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.950+0000 7f867b37bb80 1 -- 172.21.15.17:0/3727617744 >> 172.21.15.17:0/3727617744 conn(0x55c15b063060 msgr2=0x55c15b0717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.950+0000 7f867b37bb80 1 -- 172.21.15.17:0/3727617744 shutdown_connections 2023-07-14T13:09:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.950+0000 7f867b37bb80 1 -- 172.21.15.17:0/3727617744 wait complete. 2023-07-14T13:09:31.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.951+0000 7f867b37bb80 1 -- start start 2023-07-14T13:09:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.951+0000 7f867b37bb80 1 Processor -- start 2023-07-14T13:09:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b050da0 0x55c15b06b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b05a2d0 0x55c15b06b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f867b37bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f867b37bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b06bd50 con 0x55c15b050da0 2023-07-14T13:09:31.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f867b37bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b0c96f0 con 0x55c15b05a2d0 2023-07-14T13:09:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f867b37bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15b0c9830 con 0x55c15b05abe0 2023-07-14T13:09:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f867b37bb80 10 client.0 _ll_register_callbacks cb 0x7f8658003a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f866579b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b050da0 0x55c15b06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f866579b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b050da0 0x55c15b06b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57840/0 (socket says 172.21.15.17:57840) 2023-07-14T13:09:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f866579b700 1 -- 172.21.15.17:0/4120998935 learned_addr learned my addr 172.21.15.17:0/4120998935 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f8665f9c700 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.952+0000 7f8664f9a700 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b05a2d0 0x55c15b06b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.953+0000 7f8665f9c700 1 -- 172.21.15.17:0/4120998935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b05a2d0 msgr2=0x55c15b06b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:31.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.953+0000 7f8665f9c700 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b05a2d0 0x55c15b06b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.953+0000 7f8665f9c700 1 -- 172.21.15.17:0/4120998935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b050da0 msgr2=0x55c15b06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:31.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.953+0000 7f8665f9c700 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b050da0 0x55c15b06b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:31.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.953+0000 7f8665f9c700 1 -- 172.21.15.17:0/4120998935 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c15adc3c60 con 0x55c15b05abe0 2023-07-14T13:09:31.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.953+0000 7f8665f9c700 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b0c91b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8658005700 tx=0x7f86580055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cd9d43d4e953eb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:31.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.953+0000 7f8648ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:09:31.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.953+0000 7f8648ff9700 1 -- 172.21.15.17:0/4120998935 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800e030 con 0x55c15b05abe0 2023-07-14T13:09:31.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.953+0000 7f8648ff9700 1 -- 172.21.15.17:0/4120998935 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8658023040 con 0x55c15b05abe0 2023-07-14T13:09:31.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.953+0000 7f867b37bb80 1 -- 172.21.15.17:0/4120998935 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f865000edf0 con 0x55c15b05abe0 2023-07-14T13:09:31.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.954+0000 7f8648ff9700 1 -- 172.21.15.17:0/4120998935 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f865802a860 con 0x55c15b05abe0 2023-07-14T13:09:31.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.954+0000 7f867b37bb80 10 client.27043 fetch_fsmap learned FSMap version 34 2023-07-14T13:09:31.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.954+0000 7f867b37bb80 1 -- 172.21.15.17:0/4120998935 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c15addade0 con 0x55c15b05abe0 2023-07-14T13:09:31.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.954+0000 7f8648ff9700 1 -- 172.21.15.17:0/4120998935 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f865804a020 con 0x55c15b05abe0 2023-07-14T13:09:31.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.954+0000 7f8648ff9700 1 -- 172.21.15.17:0/4120998935 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f865803db20 con 0x55c15b05abe0 2023-07-14T13:09:31.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.954+0000 7f867b37bb80 10 client.27043 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:09:31.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.954+0000 7f867b37bb80 10 client.27043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:31.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.954+0000 7f867b37bb80 20 client.27043 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:31.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.954+0000 7f867b37bb80 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c15b065ad0 0x55c15b0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:31.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.954+0000 7f867b37bb80 4 client.27043 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:09:31.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.954+0000 7f867b37bb80 1 -- 172.21.15.17:0/4120998935 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c15af68050 con 0x55c15b065ad0 2023-07-14T13:09:31.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.955+0000 7f866579b700 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c15b065ad0 0x55c15b0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:31.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.955+0000 7f8648ff9700 10 client.27043 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:31.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.955+0000 7f866579b700 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c15b065ad0 0x55c15b0ccac0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5be204e037d5af3e server_cookie=dcf5f65dbc2ec450 in_seq=0 out_seq=0 2023-07-14T13:09:31.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f8648ff9700 1 -- 172.21.15.17:0/4120998935 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c15af68050 con 0x55c15b065ad0 2023-07-14T13:09:31.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f8648ff9700 10 client.27043 handle_command_reply: tid=0 2023-07-14T13:09:31.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f867b37bb80 1 client.27043 shutdown 2023-07-14T13:09:31.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f867b37bb80 1 -- 172.21.15.17:0/4120998935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 msgr2=0x55c15b0c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f867b37bb80 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b0c91b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8658005700 tx=0x7f86580055a0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f867b37bb80 1 -- 172.21.15.17:0/4120998935 shutdown_connections 2023-07-14T13:09:32.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f867b37bb80 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c15b065ad0 0x55c15b0ccac0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f867b37bb80 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c15b05abe0 0x55c15b0c91b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f8648ff9700 0 client.27043 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f867b37bb80 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c15b050da0 0x55c15b06b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f867b37bb80 1 --2- 172.21.15.17:0/4120998935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c15b05a2d0 0x55c15b06b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f867b37bb80 1 -- 172.21.15.17:0/4120998935 >> 172.21.15.17:0/4120998935 conn(0x55c15b063060 msgr2=0x55c15b05c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f867b37bb80 1 -- 172.21.15.17:0/4120998935 shutdown_connections 2023-07-14T13:09:32.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.956+0000 7f867b37bb80 1 -- 172.21.15.17:0/4120998935 wait complete. 2023-07-14T13:09:32.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.957+0000 7f867b37bb80 20 client.27043 trim_cache size 0 max 16384 2023-07-14T13:09:32.002 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:09:32.002 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:09:32.002 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:09:32.003 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:09:32.003 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:09:32.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:09:32.003 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:09:32.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:09:32.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:09:32.004 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:09:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.957+0000 7f86679ff700 1 -- 172.21.15.17:0/917135347 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f864c0a1340 msgr2=0x7f864c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.957+0000 7f86679ff700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f864c0a1340 0x7f864c0a37f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8658015000 tx=0x7f86580096c0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.957+0000 7f86679ff700 1 -- 172.21.15.17:0/917135347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86600ffb00 msgr2=0x7f866019b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.957+0000 7f86679ff700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86600ffb00 0x7f866019b9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f865c00eb30 tx=0x7f865c00ee40 comp rx=0 tx=0).stop 2023-07-14T13:09:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.957+0000 7f86679ff700 1 -- 172.21.15.17:0/917135347 shutdown_connections 2023-07-14T13:09:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.957+0000 7f86679ff700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f864c0a1340 0x7f864c0a37f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.957+0000 7f86679ff700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8660105b10 0x7f8660195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.957+0000 7f86679ff700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86600ffb00 0x7f866019b9f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.957+0000 7f86679ff700 1 --2- 172.21.15.17:0/917135347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86601004b0 0x7f866019bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.957+0000 7f86679ff700 1 -- 172.21.15.17:0/917135347 >> 172.21.15.17:0/917135347 conn(0x7f86600fb600 msgr2=0x7f86600fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.958+0000 7f86679ff700 1 -- 172.21.15.17:0/917135347 shutdown_connections 2023-07-14T13:09:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:09:31.958+0000 7f86679ff700 1 -- 172.21.15.17:0/917135347 wait complete. 2023-07-14T13:09:32.012 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:09:32.773 INFO:teuthology.orchestra.run.smithi017.stderr:38600000 of 50000000 tuples (77%) done (elapsed 562.37 s, remaining 166.09 s) 2023-07-14T13:09:33.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:33 smithi131 ceph-mon[96953]: pgmap v305: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-07-14T13:09:33.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:33 smithi017 ceph-mon[95536]: pgmap v305: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-07-14T13:09:33.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:33 smithi135 ceph-mon[97338]: pgmap v305: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-07-14T13:09:34.072 INFO:teuthology.orchestra.run.smithi017.stderr:38700000 of 50000000 tuples (77%) done (elapsed 563.67 s, remaining 164.59 s) 2023-07-14T13:09:35.392 INFO:teuthology.orchestra.run.smithi017.stderr:38800000 of 50000000 tuples (77%) done (elapsed 564.99 s, remaining 163.09 s) 2023-07-14T13:09:35.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:35 smithi131 ceph-mon[96953]: pgmap v306: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-07-14T13:09:35.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:35 smithi017 ceph-mon[95536]: pgmap v306: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-07-14T13:09:35.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:35 smithi135 ceph-mon[97338]: pgmap v306: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 22 MiB/s wr, 52 op/s 2023-07-14T13:09:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:38900000 of 50000000 tuples (77%) done (elapsed 566.30 s, remaining 161.59 s) 2023-07-14T13:09:37.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:37 smithi131 ceph-mon[96953]: pgmap v307: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 33 MiB/s wr, 82 op/s 2023-07-14T13:09:37.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:37 smithi017 ceph-mon[95536]: pgmap v307: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 33 MiB/s wr, 82 op/s 2023-07-14T13:09:37.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:37 smithi135 ceph-mon[97338]: pgmap v307: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 33 MiB/s wr, 82 op/s 2023-07-14T13:09:38.095 INFO:teuthology.orchestra.run.smithi017.stderr:39000000 of 50000000 tuples (78%) done (elapsed 567.70 s, remaining 160.12 s) 2023-07-14T13:09:39.400 INFO:teuthology.orchestra.run.smithi017.stderr:39100000 of 50000000 tuples (78%) done (elapsed 569.00 s, remaining 158.62 s) 2023-07-14T13:09:39.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:39 smithi131 ceph-mon[96953]: pgmap v308: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 22 MiB/s wr, 53 op/s 2023-07-14T13:09:39.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:39 smithi017 ceph-mon[95536]: pgmap v308: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 22 MiB/s wr, 53 op/s 2023-07-14T13:09:39.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:39 smithi135 ceph-mon[97338]: pgmap v308: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 22 MiB/s wr, 53 op/s 2023-07-14T13:09:41.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:41 smithi131 ceph-mon[96953]: pgmap v309: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 33 MiB/s wr, 63 op/s 2023-07-14T13:09:41.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:41 smithi017 ceph-mon[95536]: pgmap v309: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 33 MiB/s wr, 63 op/s 2023-07-14T13:09:41.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:41 smithi135 ceph-mon[97338]: pgmap v309: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 33 MiB/s wr, 63 op/s 2023-07-14T13:09:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.096+0000 7f0d25bff700 1 -- 172.21.15.17:0/3128264975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d20105b10 msgr2=0x7f0d20105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.096+0000 7f0d25bff700 1 --2- 172.21.15.17:0/3128264975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d20105b10 0x7f0d20105ee0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009990 tx=0x7f0d10009ca0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.096+0000 7f0d25bff700 1 -- 172.21.15.17:0/3128264975 shutdown_connections 2023-07-14T13:09:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.096+0000 7f0d25bff700 1 --2- 172.21.15.17:0/3128264975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d201004b0 0x7f0d2010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.096+0000 7f0d25bff700 1 --2- 172.21.15.17:0/3128264975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d20105b10 0x7f0d20105ee0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.096+0000 7f0d25bff700 1 --2- 172.21.15.17:0/3128264975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d200ffb00 0x7f0d200fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.096+0000 7f0d25bff700 1 -- 172.21.15.17:0/3128264975 >> 172.21.15.17:0/3128264975 conn(0x7f0d200fb600 msgr2=0x7f0d200fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:43.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.096+0000 7f0d25bff700 1 -- 172.21.15.17:0/3128264975 shutdown_connections 2023-07-14T13:09:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.096+0000 7f0d25bff700 1 -- 172.21.15.17:0/3128264975 wait complete. 2023-07-14T13:09:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.097+0000 7f0d25bff700 1 Processor -- start 2023-07-14T13:09:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.097+0000 7f0d25bff700 1 -- start start 2023-07-14T13:09:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d25bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d200ffb00 0x7f0d200729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d25bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d201004b0 0x7f0d20072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d25bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d20105b10 0x7f0d201a3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d25bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201a4350 con 0x7f0d201004b0 2023-07-14T13:09:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d25bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201a4490 con 0x7f0d20105b10 2023-07-14T13:09:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d25bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201a4600 con 0x7f0d200ffb00 2023-07-14T13:09:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d1effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d201004b0 0x7f0d20072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d200ffb00 0x7f0d200729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d200ffb00 0x7f0d200729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35162/0 (socket says 172.21.15.17:35162) 2023-07-14T13:09:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d1effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d201004b0 0x7f0d20072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58330/0 (socket says 172.21.15.17:58330) 2023-07-14T13:09:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/1697069020 learned_addr learned my addr 172.21.15.17:0/1697069020 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d1ffff700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d20105b10 0x7f0d201a3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d1effd700 1 -- 172.21.15.17:0/1697069020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d200ffb00 msgr2=0x7f0d200729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d1effd700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d200ffb00 0x7f0d200729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d1effd700 1 -- 172.21.15.17:0/1697069020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d20105b10 msgr2=0x7f0d201a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.098+0000 7f0d1effd700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d20105b10 0x7f0d201a3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.099+0000 7f0d1effd700 1 -- 172.21.15.17:0/1697069020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d100095f0 con 0x7f0d201004b0 2023-07-14T13:09:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.099+0000 7f0d1effd700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d201004b0 0x7f0d20072f30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400e9f0 tx=0x7f0d1400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.099+0000 7f0d1cff9700 1 -- 172.21.15.17:0/1697069020 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400c9c0 con 0x7f0d201004b0 2023-07-14T13:09:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.099+0000 7f0d25bff700 1 -- 172.21.15.17:0/1697069020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d201a48e0 con 0x7f0d201004b0 2023-07-14T13:09:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.099+0000 7f0d1cff9700 1 -- 172.21.15.17:0/1697069020 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d14010430 con 0x7f0d201004b0 2023-07-14T13:09:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.099+0000 7f0d1cff9700 1 -- 172.21.15.17:0/1697069020 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14018680 con 0x7f0d201004b0 2023-07-14T13:09:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.099+0000 7f0d25bff700 1 -- 172.21.15.17:0/1697069020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d201a4e40 con 0x7f0d201004b0 2023-07-14T13:09:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.102+0000 7f0d1cff9700 1 -- 172.21.15.17:0/1697069020 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0d140105a0 con 0x7f0d201004b0 2023-07-14T13:09:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.104+0000 7f0d1cff9700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0d080a12c0 0x7f0d080a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.104+0000 7f0d39606b80 1 Processor -- start 2023-07-14T13:09:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.104+0000 7f0d1cff9700 1 -- 172.21.15.17:0/1697069020 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0d14014070 con 0x7f0d201004b0 2023-07-14T13:09:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.104+0000 7f0d1f7fe700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0d080a12c0 0x7f0d080a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.104+0000 7f0d39606b80 1 -- start start 2023-07-14T13:09:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be2896b0 0x5559be432d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be4332d0 0x5559be42d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be42d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d39606b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be332c50 con 0x5559be4332d0 2023-07-14T13:09:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d39606b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be3859e0 con 0x5559be2896b0 2023-07-14T13:09:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d39606b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be37ee70 con 0x5559be42d580 2023-07-14T13:09:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1f7fe700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0d080a12c0 0x7f0d080a3770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d10006010 tx=0x7f0d1000b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be4332d0 0x5559be42d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be4332d0 0x5559be42d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58346/0 (socket says 172.21.15.17:58346) 2023-07-14T13:09:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be2896b0 0x5559be432d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be42d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1effd700 1 -- 172.21.15.17:0/3196132557 learned_addr learned my addr 172.21.15.17:0/3196132557 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1ffff700 1 -- 172.21.15.17:0/3196132557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be2896b0 msgr2=0x5559be432d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1ffff700 1 --2- 172.21.15.17:0/3196132557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be2896b0 0x5559be432d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1ffff700 1 -- 172.21.15.17:0/3196132557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be4332d0 msgr2=0x5559be42d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1ffff700 1 --2- 172.21.15.17:0/3196132557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be4332d0 0x5559be42d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1ffff700 1 -- 172.21.15.17:0/3196132557 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559be1acd80 con 0x5559be42d580 2023-07-14T13:09:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.105+0000 7f0d1effd700 1 --2- 172.21.15.17:0/3196132557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be4332d0 0x5559be42d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.106+0000 7f0d1ffff700 1 --2- 172.21.15.17:0/3196132557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be42d9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0d18011580 tx=0x7f0d18009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5feebef0e6e47f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.106+0000 7f0d05ffb700 1 -- 172.21.15.17:0/3196132557 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800e040 con 0x5559be42d580 2023-07-14T13:09:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.106+0000 7f0d05ffb700 1 -- 172.21.15.17:0/3196132557 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d1800f040 con 0x5559be42d580 2023-07-14T13:09:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.106+0000 7f0d05ffb700 1 -- 172.21.15.17:0/3196132557 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18004300 con 0x5559be42d580 2023-07-14T13:09:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.107+0000 7f0d39606b80 1 -- 172.21.15.17:0/3196132557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 msgr2=0x5559be42d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.107+0000 7f0d39606b80 1 --2- 172.21.15.17:0/3196132557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be42d9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0d18011580 tx=0x7f0d18009920 comp rx=0 tx=0).stop 2023-07-14T13:09:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.107+0000 7f0d39606b80 1 -- 172.21.15.17:0/3196132557 shutdown_connections 2023-07-14T13:09:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.107+0000 7f0d39606b80 1 --2- 172.21.15.17:0/3196132557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be42d9d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.107+0000 7f0d39606b80 1 --2- 172.21.15.17:0/3196132557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be2896b0 0x5559be432d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.107+0000 7f0d39606b80 1 --2- 172.21.15.17:0/3196132557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be4332d0 0x5559be42d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.107+0000 7f0d39606b80 1 -- 172.21.15.17:0/3196132557 >> 172.21.15.17:0/3196132557 conn(0x5559be422be0 msgr2=0x5559be427f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.107+0000 7f0d39606b80 1 -- 172.21.15.17:0/3196132557 shutdown_connections 2023-07-14T13:09:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.107+0000 7f0d39606b80 1 -- 172.21.15.17:0/3196132557 wait complete. 2023-07-14T13:09:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.107+0000 7f0d39606b80 1 -- start start 2023-07-14T13:09:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.108+0000 7f0d39606b80 1 Processor -- start 2023-07-14T13:09:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.108+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be2896b0 0x5559be4394f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.108+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be42d580 0x5559be436770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.108+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be436d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.108+0000 7f0d39606b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be31ea60 con 0x5559be42d580 2023-07-14T13:09:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.108+0000 7f0d39606b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be31e760 con 0x5559be4332d0 2023-07-14T13:09:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.108+0000 7f0d39606b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be2028c0 con 0x5559be2896b0 2023-07-14T13:09:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.108+0000 7f0d39606b80 10 client.0 _ll_register_callbacks cb 0x5559be31c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.108+0000 7f0d1effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be42d580 0x5559be436770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be2896b0 0x5559be4394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be2896b0 0x5559be4394f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35184/0 (socket says 172.21.15.17:35184) 2023-07-14T13:09:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/2573462494 learned_addr learned my addr 172.21.15.17:0/2573462494 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0d1ffff700 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be436d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/2573462494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 msgr2=0x5559be436d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0d1f7fe700 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be436d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/2573462494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be42d580 msgr2=0x5559be436770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0d1f7fe700 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be42d580 0x5559be436770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/2573462494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d201a4e40 con 0x5559be2896b0 2023-07-14T13:09:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0d1f7fe700 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be2896b0 0x5559be4394f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000bee0 tx=0x7f0d1001a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afddea85e52b1e52 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0cfeffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:09:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.109+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2573462494 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1000f460 con 0x5559be2896b0 2023-07-14T13:09:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0d39606b80 1 -- 172.21.15.17:0/2573462494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559be2d8490 con 0x5559be2896b0 2023-07-14T13:09:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2573462494 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0d1000f5c0 con 0x5559be2896b0 2023-07-14T13:09:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2573462494 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d1000f780 con 0x5559be2896b0 2023-07-14T13:09:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0d39606b80 10 client.27055 fetch_fsmap learned FSMap version 34 2023-07-14T13:09:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0d39606b80 1 -- 172.21.15.17:0/2573462494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f0d18011230 con 0x5559be2896b0 2023-07-14T13:09:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2573462494 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d1003c020 con 0x5559be2896b0 2023-07-14T13:09:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2573462494 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f0d1002f860 con 0x5559be2896b0 2023-07-14T13:09:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0d39606b80 10 client.27055 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:09:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0d39606b80 10 client.27055 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0d39606b80 20 client.27055 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:43.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559be446a80 0x5559be448e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0d39606b80 4 client.27055 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:09:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.110+0000 7f0d39606b80 1 -- 172.21.15.17:0/2573462494 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559be377e50 con 0x5559be446a80 2023-07-14T13:09:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.111+0000 7f0d1effd700 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559be446a80 0x5559be448e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.111+0000 7f0d1effd700 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559be446a80 0x5559be448e90 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac6099e3c2aea444 server_cookie=35c2e8bc4770766f in_seq=0 out_seq=0 2023-07-14T13:09:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.111+0000 7f0cfeffd700 10 client.27055 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2573462494 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5559be377e50 con 0x5559be446a80 2023-07-14T13:09:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0cfeffd700 10 client.27055 handle_command_reply: tid=0 2023-07-14T13:09:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 1 client.27055 shutdown 2023-07-14T13:09:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 1 -- 172.21.15.17:0/2573462494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be2896b0 msgr2=0x5559be4394f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be2896b0 0x5559be4394f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000bee0 tx=0x7f0d1001a050 comp rx=0 tx=0).stop 2023-07-14T13:09:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 1 -- 172.21.15.17:0/2573462494 shutdown_connections 2023-07-14T13:09:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559be446a80 0x5559be448e90 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be436d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be2896b0 0x5559be4394f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0cfeffd700 0 client.27055 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2573462494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be42d580 0x5559be436770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 1 -- 172.21.15.17:0/2573462494 >> 172.21.15.17:0/2573462494 conn(0x5559be422be0 msgr2=0x5559be426c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 1 -- 172.21.15.17:0/2573462494 shutdown_connections 2023-07-14T13:09:43.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 1 -- 172.21.15.17:0/2573462494 wait complete. 2023-07-14T13:09:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.113+0000 7f0d39606b80 20 client.27055 trim_cache size 0 max 16384 2023-07-14T13:09:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.128+0000 7f0d39606b80 1 Processor -- start 2023-07-14T13:09:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.128+0000 7f0d39606b80 1 -- start start 2023-07-14T13:09:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.128+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be434010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be439090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d39606b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be428e30 con 0x5559be2896b0 2023-07-14T13:09:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d39606b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be434d30 con 0x5559be4332d0 2023-07-14T13:09:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d39606b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be431560 con 0x5559be42d580 2023-07-14T13:09:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58366/0 (socket says 172.21.15.17:58366) 2023-07-14T13:09:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/3583909259 learned_addr learned my addr 172.21.15.17:0/3583909259 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d1ffff700 1 --2- 172.21.15.17:0/3583909259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be439090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d1effd700 1 --2- 172.21.15.17:0/3583909259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be434010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/3583909259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 msgr2=0x5559be434010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d1f7fe700 1 --2- 172.21.15.17:0/3583909259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be434010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/3583909259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 msgr2=0x5559be439090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d1f7fe700 1 --2- 172.21.15.17:0/3583909259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be439090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/3583909259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559be195c00 con 0x5559be2896b0 2023-07-14T13:09:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.129+0000 7f0d1f7fe700 1 --2- 172.21.15.17:0/3583909259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc60 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f0d100051b0 tx=0x7f0d1000b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd6b61935421c4b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.130+0000 7f0d067fc700 1 -- 172.21.15.17:0/3583909259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10005620 con 0x5559be2896b0 2023-07-14T13:09:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.130+0000 7f0d067fc700 1 -- 172.21.15.17:0/3583909259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d1003c070 con 0x5559be2896b0 2023-07-14T13:09:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.130+0000 7f0d067fc700 1 -- 172.21.15.17:0/3583909259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10024be0 con 0x5559be2896b0 2023-07-14T13:09:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.130+0000 7f0d39606b80 1 -- 172.21.15.17:0/3583909259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 msgr2=0x5559be43dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.130+0000 7f0d39606b80 1 --2- 172.21.15.17:0/3583909259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc60 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f0d100051b0 tx=0x7f0d1000b2d0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.130+0000 7f0d39606b80 1 -- 172.21.15.17:0/3583909259 shutdown_connections 2023-07-14T13:09:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.130+0000 7f0d39606b80 1 --2- 172.21.15.17:0/3583909259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be439090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.130+0000 7f0d39606b80 1 --2- 172.21.15.17:0/3583909259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc60 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.130+0000 7f0d39606b80 1 --2- 172.21.15.17:0/3583909259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be434010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.130+0000 7f0d39606b80 1 -- 172.21.15.17:0/3583909259 >> 172.21.15.17:0/3583909259 conn(0x5559be422be0 msgr2=0x5559be433900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.131+0000 7f0d39606b80 1 -- 172.21.15.17:0/3583909259 shutdown_connections 2023-07-14T13:09:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.131+0000 7f0d39606b80 1 -- 172.21.15.17:0/3583909259 wait complete. 2023-07-14T13:09:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.131+0000 7f0d39606b80 1 -- start start 2023-07-14T13:09:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.131+0000 7f0d39606b80 1 Processor -- start 2023-07-14T13:09:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be42e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d39606b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be42ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d39606b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be42f210 con 0x5559be2896b0 2023-07-14T13:09:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d39606b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be42f380 con 0x5559be4332d0 2023-07-14T13:09:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d39606b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559be42f540 con 0x5559be42d580 2023-07-14T13:09:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d39606b80 10 client.0 _ll_register_callbacks cb 0x5559be31c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58372/0 (socket says 172.21.15.17:58372) 2023-07-14T13:09:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/2843169157 learned_addr learned my addr 172.21.15.17:0/2843169157 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d1effd700 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be42e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d1ffff700 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be42ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/2843169157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 msgr2=0x5559be42e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d1f7fe700 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be42e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/2843169157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 msgr2=0x5559be42ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d1f7fe700 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be42ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d1f7fe700 1 -- 172.21.15.17:0/2843169157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d18011230 con 0x5559be2896b0 2023-07-14T13:09:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.132+0000 7f0d1ffff700 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be42ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:09:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.133+0000 7f0d1f7fe700 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0d1002fc40 tx=0x7f0d1002fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d856a09cdde252 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.133+0000 7f0cfeffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:09:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.133+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2843169157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10024730 con 0x5559be2896b0 2023-07-14T13:09:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.133+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2843169157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0d1003d080 con 0x5559be2896b0 2023-07-14T13:09:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.133+0000 7f0d39606b80 1 -- 172.21.15.17:0/2843169157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d1800f040 con 0x5559be2896b0 2023-07-14T13:09:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.133+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2843169157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d10024890 con 0x5559be2896b0 2023-07-14T13:09:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.133+0000 7f0d39606b80 10 client.17361 fetch_fsmap learned FSMap version 34 2023-07-14T13:09:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.133+0000 7f0d39606b80 1 -- 172.21.15.17:0/2843169157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5559be1d31f0 con 0x5559be2896b0 2023-07-14T13:09:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.133+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2843169157 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d1800f040 con 0x5559be2896b0 2023-07-14T13:09:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.133+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2843169157 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f0d10042b40 con 0x5559be2896b0 2023-07-14T13:09:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.134+0000 7f0d39606b80 10 client.17361 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:09:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.134+0000 7f0d39606b80 10 client.17361 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.134+0000 7f0d39606b80 20 client.17361 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.134+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559be49b830 0x5559be49dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.134+0000 7f0d39606b80 4 client.17361 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:09:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.134+0000 7f0d39606b80 1 -- 172.21.15.17:0/2843169157 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5559be339ff0 con 0x5559be49b830 2023-07-14T13:09:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.134+0000 7f0d1effd700 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559be49b830 0x5559be49dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.134+0000 7f0d1effd700 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559be49b830 0x5559be49dc10 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a60ae85b9427873 server_cookie=deac6e6a9a5c20d4 in_seq=0 out_seq=0 2023-07-14T13:09:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.134+0000 7f0cfeffd700 10 client.17361 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0cfeffd700 1 -- 172.21.15.17:0/2843169157 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5559be339ff0 con 0x5559be49b830 2023-07-14T13:09:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0cfeffd700 10 client.17361 handle_command_reply: tid=0 2023-07-14T13:09:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 1 client.17361 shutdown 2023-07-14T13:09:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 1 -- 172.21.15.17:0/2843169157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 msgr2=0x5559be43dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0d1002fc40 tx=0x7f0d1002fa80 comp rx=0 tx=0).stop 2023-07-14T13:09:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 1 -- 172.21.15.17:0/2843169157 shutdown_connections 2023-07-14T13:09:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5559be49b830 0x5559be49dc10 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5559be4332d0 0x5559be42ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5559be2896b0 0x5559be43dc70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0cfeffd700 0 client.17361 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 1 --2- 172.21.15.17:0/2843169157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5559be42d580 0x5559be42e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 1 -- 172.21.15.17:0/2843169157 >> 172.21.15.17:0/2843169157 conn(0x5559be422be0 msgr2=0x5559be434190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 1 -- 172.21.15.17:0/2843169157 shutdown_connections 2023-07-14T13:09:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 1 -- 172.21.15.17:0/2843169157 wait complete. 2023-07-14T13:09:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d39606b80 20 client.17361 trim_cache size 0 max 16384 2023-07-14T13:09:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:09:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:09:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:09:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:09:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d25bff700 1 -- 172.21.15.17:0/1697069020 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0d080a12c0 msgr2=0x7f0d080a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d25bff700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0d080a12c0 0x7f0d080a3770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d10006010 tx=0x7f0d1000b260 comp rx=0 tx=0).stop 2023-07-14T13:09:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d25bff700 1 -- 172.21.15.17:0/1697069020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d201004b0 msgr2=0x7f0d20072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.150+0000 7f0d25bff700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d201004b0 0x7f0d20072f30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400e9f0 tx=0x7f0d1400ed00 comp rx=0 tx=0).stop 2023-07-14T13:09:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.151+0000 7f0d25bff700 1 -- 172.21.15.17:0/1697069020 shutdown_connections 2023-07-14T13:09:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.151+0000 7f0d25bff700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0d080a12c0 0x7f0d080a3770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.151+0000 7f0d25bff700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d20105b10 0x7f0d201a3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.151+0000 7f0d25bff700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d200ffb00 0x7f0d200729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.151+0000 7f0d25bff700 1 --2- 172.21.15.17:0/1697069020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d201004b0 0x7f0d20072f30 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.151+0000 7f0d25bff700 1 -- 172.21.15.17:0/1697069020 >> 172.21.15.17:0/1697069020 conn(0x7f0d200fb600 msgr2=0x7f0d200fbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.151+0000 7f0d25bff700 1 -- 172.21.15.17:0/1697069020 shutdown_connections 2023-07-14T13:09:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:43.151+0000 7f0d25bff700 1 -- 172.21.15.17:0/1697069020 wait complete. 2023-07-14T13:09:43.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:43 smithi131 ceph-mon[96953]: pgmap v310: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 22 MiB/s wr, 40 op/s 2023-07-14T13:09:43.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:43 smithi017 ceph-mon[95536]: pgmap v310: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 22 MiB/s wr, 40 op/s 2023-07-14T13:09:43.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:43 smithi135 ceph-mon[97338]: pgmap v310: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 22 MiB/s wr, 40 op/s 2023-07-14T13:09:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:39200000 of 50000000 tuples (78%) done (elapsed 574.62 s, remaining 158.31 s) 2023-07-14T13:09:45.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:45 smithi131 ceph-mon[96953]: pgmap v311: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 22 MiB/s wr, 40 op/s 2023-07-14T13:09:45.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:45 smithi017 ceph-mon[95536]: pgmap v311: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 22 MiB/s wr, 40 op/s 2023-07-14T13:09:45.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:45 smithi135 ceph-mon[97338]: pgmap v311: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 22 MiB/s wr, 40 op/s 2023-07-14T13:09:46.334 INFO:teuthology.orchestra.run.smithi017.stderr:39300000 of 50000000 tuples (78%) done (elapsed 575.93 s, remaining 156.81 s) 2023-07-14T13:09:47.362 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:47 smithi017 ceph-mon[95536]: pgmap v312: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 24 MiB/s wr, 49 op/s 2023-07-14T13:09:47.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:47 smithi135 ceph-mon[97338]: pgmap v312: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 24 MiB/s wr, 49 op/s 2023-07-14T13:09:47.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:47 smithi131 ceph-mon[96953]: pgmap v312: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 24 MiB/s wr, 49 op/s 2023-07-14T13:09:47.761 INFO:teuthology.orchestra.run.smithi017.stderr:39400000 of 50000000 tuples (78%) done (elapsed 577.36 s, remaining 155.33 s) 2023-07-14T13:09:49.125 INFO:teuthology.orchestra.run.smithi017.stderr:39500000 of 50000000 tuples (79%) done (elapsed 578.73 s, remaining 153.84 s) 2023-07-14T13:09:49.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:49 smithi135 ceph-mon[97338]: pgmap v313: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 18 op/s 2023-07-14T13:09:49.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:49 smithi131 ceph-mon[96953]: pgmap v313: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 18 op/s 2023-07-14T13:09:49.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:49 smithi017 ceph-mon[95536]: pgmap v313: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 18 op/s 2023-07-14T13:09:50.739 INFO:teuthology.orchestra.run.smithi017.stderr:39600000 of 50000000 tuples (79%) done (elapsed 580.34 s, remaining 152.41 s) 2023-07-14T13:09:51.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:51 smithi135 ceph-mon[97338]: pgmap v314: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 43 op/s 2023-07-14T13:09:51.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:51 smithi131 ceph-mon[96953]: pgmap v314: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 43 op/s 2023-07-14T13:09:51.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:51 smithi017 ceph-mon[95536]: pgmap v314: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 23 MiB/s wr, 43 op/s 2023-07-14T13:09:52.177 INFO:teuthology.orchestra.run.smithi017.stderr:39700000 of 50000000 tuples (79%) done (elapsed 581.78 s, remaining 150.94 s) 2023-07-14T13:09:53.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:53 smithi135 ceph-mon[97338]: pgmap v315: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 33 op/s 2023-07-14T13:09:53.487 INFO:teuthology.orchestra.run.smithi017.stderr:39800000 of 50000000 tuples (79%) done (elapsed 583.09 s, remaining 149.43 s) 2023-07-14T13:09:53.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:53 smithi131 ceph-mon[96953]: pgmap v315: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 33 op/s 2023-07-14T13:09:53.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:53 smithi017 ceph-mon[95536]: pgmap v315: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 33 op/s 2023-07-14T13:09:54.802 INFO:teuthology.orchestra.run.smithi017.stderr:39900000 of 50000000 tuples (79%) done (elapsed 584.40 s, remaining 147.93 s) 2023-07-14T13:09:55.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:55 smithi135 ceph-mon[97338]: pgmap v316: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 33 op/s 2023-07-14T13:09:55.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:55 smithi131 ceph-mon[96953]: pgmap v316: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 33 op/s 2023-07-14T13:09:55.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:55 smithi017 ceph-mon[95536]: pgmap v316: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 33 op/s 2023-07-14T13:09:56.120 INFO:teuthology.orchestra.run.smithi017.stderr:40000000 of 50000000 tuples (80%) done (elapsed 585.72 s, remaining 146.43 s) 2023-07-14T13:09:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.318+0000 7fb580fff700 1 -- 172.21.15.17:0/1717688086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c0731c0 msgr2=0x7fb57c10be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.318+0000 7fb580fff700 1 --2- 172.21.15.17:0/1717688086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c0731c0 0x7fb57c10be10 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb570009990 tx=0x7fb570009ca0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.319+0000 7fb580fff700 1 -- 172.21.15.17:0/1717688086 shutdown_connections 2023-07-14T13:09:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.319+0000 7fb580fff700 1 --2- 172.21.15.17:0/1717688086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb57c10c350 0x7fb57c10e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.319+0000 7fb580fff700 1 --2- 172.21.15.17:0/1717688086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0728b0 0x7fb57c072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.319+0000 7fb580fff700 1 --2- 172.21.15.17:0/1717688086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c0731c0 0x7fb57c10be10 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.319+0000 7fb580fff700 1 -- 172.21.15.17:0/1717688086 >> 172.21.15.17:0/1717688086 conn(0x7fb57c0fb5f0 msgr2=0x7fb57c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.319+0000 7fb580fff700 1 -- 172.21.15.17:0/1717688086 shutdown_connections 2023-07-14T13:09:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.319+0000 7fb580fff700 1 -- 172.21.15.17:0/1717688086 wait complete. 2023-07-14T13:09:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.320+0000 7fb580fff700 1 Processor -- start 2023-07-14T13:09:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.320+0000 7fb580fff700 1 -- start start 2023-07-14T13:09:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.320+0000 7fb580fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c0728b0 0x7fb57c197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.320+0000 7fb580fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0731c0 0x7fb57c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.320+0000 7fb580fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb57c10c350 0x7fb57c19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb580fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c19cf20 con 0x7fb57c0728b0 2023-07-14T13:09:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb580fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c19d090 con 0x7fb57c10c350 2023-07-14T13:09:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb580fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c19d250 con 0x7fb57c0731c0 2023-07-14T13:09:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb57a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c0728b0 0x7fb57c197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb579d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0731c0 0x7fb57c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb57a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c0728b0 0x7fb57c197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58514/0 (socket says 172.21.15.17:58514) 2023-07-14T13:09:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb57a59c700 1 -- 172.21.15.17:0/3684469541 learned_addr learned my addr 172.21.15.17:0/3684469541 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb57ad9d700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb57c10c350 0x7fb57c19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb57a59c700 1 -- 172.21.15.17:0/3684469541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0731c0 msgr2=0x7fb57c198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb57a59c700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0731c0 0x7fb57c198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb57a59c700 1 -- 172.21.15.17:0/3684469541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb57c10c350 msgr2=0x7fb57c19c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb57a59c700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb57c10c350 0x7fb57c19c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.321+0000 7fb57a59c700 1 -- 172.21.15.17:0/3684469541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700095f0 con 0x7fb57c0728b0 2023-07-14T13:09:56.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.322+0000 7fb57a59c700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c0728b0 0x7fb57c197d30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00e9a0 tx=0x7fb56c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.322+0000 7fb56b7fe700 1 -- 172.21.15.17:0/3684469541 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c009790 con 0x7fb57c0728b0 2023-07-14T13:09:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.322+0000 7fb56b7fe700 1 -- 172.21.15.17:0/3684469541 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb56c010430 con 0x7fb57c0728b0 2023-07-14T13:09:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.322+0000 7fb580fff700 1 -- 172.21.15.17:0/3684469541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c19d530 con 0x7fb57c0728b0 2023-07-14T13:09:56.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.322+0000 7fb56b7fe700 1 -- 172.21.15.17:0/3684469541 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c00cea0 con 0x7fb57c0728b0 2023-07-14T13:09:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.322+0000 7fb580fff700 1 -- 172.21.15.17:0/3684469541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c1a4d70 con 0x7fb57c0728b0 2023-07-14T13:09:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.326+0000 7fb56b7fe700 1 -- 172.21.15.17:0/3684469541 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb56c0105a0 con 0x7fb57c0728b0 2023-07-14T13:09:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.328+0000 7fb59490cb80 1 Processor -- start 2023-07-14T13:09:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.328+0000 7fb56b7fe700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5640a12c0 0x7fb5640a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.328+0000 7fb56b7fe700 1 -- 172.21.15.17:0/3684469541 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb56c014070 con 0x7fb57c0728b0 2023-07-14T13:09:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.328+0000 7fb59490cb80 1 -- start start 2023-07-14T13:09:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.328+0000 7fb57ad9d700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5640a12c0 0x7fb5640a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.329+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afa3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.329+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11afa81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.329+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afa86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.329+0000 7fb59490cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11aea0c50 con 0x55d11afa3f80 2023-07-14T13:09:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.329+0000 7fb59490cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11aef39e0 con 0x55d11afa43f0 2023-07-14T13:09:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.329+0000 7fb59490cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11aeece70 con 0x55d11adf76b0 2023-07-14T13:09:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.329+0000 7fb579d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11afa81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.329+0000 7fb579d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11afa81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58530/0 (socket says 172.21.15.17:58530) 2023-07-14T13:09:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.329+0000 7fb579d9b700 1 -- 172.21.15.17:0/2107367557 learned_addr learned my addr 172.21.15.17:0/2107367557 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.329+0000 7fb57ad9d700 1 --2- 172.21.15.17:0/2107367557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afa86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.329+0000 7fb57a59c700 1 --2- 172.21.15.17:0/2107367557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afa3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.330+0000 7fb57ad9d700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5640a12c0 0x7fb5640a3770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb57400f590 tx=0x7fb57400b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.330+0000 7fb579d9b700 1 -- 172.21.15.17:0/2107367557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 msgr2=0x55d11afa3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.330+0000 7fb579d9b700 1 --2- 172.21.15.17:0/2107367557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afa3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.330+0000 7fb579d9b700 1 -- 172.21.15.17:0/2107367557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 msgr2=0x55d11afa86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.330+0000 7fb579d9b700 1 --2- 172.21.15.17:0/2107367557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afa86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.330+0000 7fb579d9b700 1 -- 172.21.15.17:0/2107367557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d11ad1ad80 con 0x55d11afa3f80 2023-07-14T13:09:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.330+0000 7fb579d9b700 1 --2- 172.21.15.17:0/2107367557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11afa81a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb570009990 tx=0x7fb570005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfbd90940e00c69 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.330+0000 7fb568ff9700 1 -- 172.21.15.17:0/2107367557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57001d070 con 0x55d11afa3f80 2023-07-14T13:09:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.330+0000 7fb568ff9700 1 -- 172.21.15.17:0/2107367557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb57001e040 con 0x55d11afa3f80 2023-07-14T13:09:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.330+0000 7fb568ff9700 1 -- 172.21.15.17:0/2107367557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570004850 con 0x55d11afa3f80 2023-07-14T13:09:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.331+0000 7fb59490cb80 1 -- 172.21.15.17:0/2107367557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 msgr2=0x55d11afa81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.331+0000 7fb59490cb80 1 --2- 172.21.15.17:0/2107367557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11afa81a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb570009990 tx=0x7fb570005f00 comp rx=0 tx=0).stop 2023-07-14T13:09:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.331+0000 7fb59490cb80 1 -- 172.21.15.17:0/2107367557 shutdown_connections 2023-07-14T13:09:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.331+0000 7fb59490cb80 1 --2- 172.21.15.17:0/2107367557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afa86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.331+0000 7fb59490cb80 1 --2- 172.21.15.17:0/2107367557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afa3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.331+0000 7fb59490cb80 1 --2- 172.21.15.17:0/2107367557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11afa81a0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.331+0000 7fb59490cb80 1 -- 172.21.15.17:0/2107367557 >> 172.21.15.17:0/2107367557 conn(0x55d11af90be0 msgr2=0x55d11af95f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.331+0000 7fb59490cb80 1 -- 172.21.15.17:0/2107367557 shutdown_connections 2023-07-14T13:09:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.331+0000 7fb59490cb80 1 -- 172.21.15.17:0/2107367557 wait complete. 2023-07-14T13:09:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.332+0000 7fb59490cb80 1 -- start start 2023-07-14T13:09:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.332+0000 7fb59490cb80 1 Processor -- start 2023-07-14T13:09:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.333+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afb2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.333+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11afb33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.333+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.333+0000 7fb59490cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11ae8ca60 con 0x55d11afa3f80 2023-07-14T13:09:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.333+0000 7fb59490cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11ae8c760 con 0x55d11afa43f0 2023-07-14T13:09:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.333+0000 7fb59490cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11ad708c0 con 0x55d11adf76b0 2023-07-14T13:09:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.333+0000 7fb59490cb80 10 client.0 _ll_register_callbacks cb 0x55d11ae8a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.333+0000 7fb57a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afb2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb579d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11afb33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb57a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afb2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45618/0 (socket says 172.21.15.17:45618) 2023-07-14T13:09:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb57a59c700 1 -- 172.21.15.17:0/766035594 learned_addr learned my addr 172.21.15.17:0/766035594 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb57ad9d700 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb57a59c700 1 -- 172.21.15.17:0/766035594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 msgr2=0x55d11afad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb57a59c700 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb57a59c700 1 -- 172.21.15.17:0/766035594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 msgr2=0x55d11afb33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb57a59c700 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11afb33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb57a59c700 1 -- 172.21.15.17:0/766035594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c10f3d0 con 0x55d11adf76b0 2023-07-14T13:09:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb579d9b700 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11afb33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb57a59c700 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afb2e90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb56c099d40 tx=0x7fb56c010970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc2ac17fc5633d34 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb561ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:09:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.334+0000 7fb561ffb700 1 -- 172.21.15.17:0/766035594 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0a2490 con 0x55d11adf76b0 2023-07-14T13:09:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb561ffb700 1 -- 172.21.15.17:0/766035594 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb56c0a2000 con 0x55d11adf76b0 2023-07-14T13:09:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb59490cb80 1 -- 172.21.15.17:0/766035594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d11ae46490 con 0x55d11adf76b0 2023-07-14T13:09:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb561ffb700 1 -- 172.21.15.17:0/766035594 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb56c0a21c0 con 0x55d11adf76b0 2023-07-14T13:09:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb59490cb80 10 client.27073 fetch_fsmap learned FSMap version 34 2023-07-14T13:09:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb59490cb80 1 -- 172.21.15.17:0/766035594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55d11ad03c00 con 0x55d11adf76b0 2023-07-14T13:09:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb561ffb700 1 -- 172.21.15.17:0/766035594 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d11ae46490 con 0x55d11adf76b0 2023-07-14T13:09:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb561ffb700 1 -- 172.21.15.17:0/766035594 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7fb56c095fc0 con 0x55d11adf76b0 2023-07-14T13:09:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb59490cb80 10 client.27073 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:09:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb59490cb80 10 client.27073 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb59490cb80 20 client.27073 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb59490cb80 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d11afbd380 0x55d11afbf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb59490cb80 4 client.27073 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:09:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.335+0000 7fb59490cb80 1 -- 172.21.15.17:0/766035594 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d11aee5e50 con 0x55d11afbd380 2023-07-14T13:09:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.336+0000 7fb579d9b700 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d11afbd380 0x55d11afbf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.336+0000 7fb561ffb700 10 client.27073 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.336+0000 7fb579d9b700 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d11afbd380 0x55d11afbf790 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b851d94e29dec673 server_cookie=b4adb6f71eda0eeb in_seq=0 out_seq=0 2023-07-14T13:09:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.337+0000 7fb561ffb700 1 -- 172.21.15.17:0/766035594 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d11aee5e50 con 0x55d11afbd380 2023-07-14T13:09:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.337+0000 7fb561ffb700 10 client.27073 handle_command_reply: tid=0 2023-07-14T13:09:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.337+0000 7fb59490cb80 1 client.27073 shutdown 2023-07-14T13:09:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb59490cb80 1 -- 172.21.15.17:0/766035594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 msgr2=0x55d11afb2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb59490cb80 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afb2e90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb56c099d40 tx=0x7fb56c010970 comp rx=0 tx=0).stop 2023-07-14T13:09:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb59490cb80 1 -- 172.21.15.17:0/766035594 shutdown_connections 2023-07-14T13:09:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb59490cb80 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d11afbd380 0x55d11afbf790 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb59490cb80 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb561ffb700 0 client.27073 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb59490cb80 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afb2e90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb59490cb80 1 --2- 172.21.15.17:0/766035594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11afb33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb59490cb80 1 -- 172.21.15.17:0/766035594 >> 172.21.15.17:0/766035594 conn(0x55d11af90be0 msgr2=0x55d11af954e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb59490cb80 1 -- 172.21.15.17:0/766035594 shutdown_connections 2023-07-14T13:09:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb59490cb80 1 -- 172.21.15.17:0/766035594 wait complete. 2023-07-14T13:09:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.338+0000 7fb59490cb80 20 client.27073 trim_cache size 0 max 16384 2023-07-14T13:09:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.361+0000 7fb59490cb80 1 Processor -- start 2023-07-14T13:09:56.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.361+0000 7fb59490cb80 1 -- start start 2023-07-14T13:09:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.361+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afa85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.361+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11af95c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.361+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afa5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.361+0000 7fb59490cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11af96a40 con 0x55d11afa3f80 2023-07-14T13:09:56.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.361+0000 7fb59490cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11af97030 con 0x55d11afa43f0 2023-07-14T13:09:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.361+0000 7fb59490cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11afae6c0 con 0x55d11adf76b0 2023-07-14T13:09:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb579d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11af95c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb57ad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afa5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb57a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afa85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb57ad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afa5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49668/0 (socket says 172.21.15.17:49668) 2023-07-14T13:09:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb57ad9d700 1 -- 172.21.15.17:0/2708364386 learned_addr learned my addr 172.21.15.17:0/2708364386 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:56.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb57ad9d700 1 -- 172.21.15.17:0/2708364386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 msgr2=0x55d11afa85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb57ad9d700 1 --2- 172.21.15.17:0/2708364386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afa85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb57ad9d700 1 -- 172.21.15.17:0/2708364386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 msgr2=0x55d11af95c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb57ad9d700 1 --2- 172.21.15.17:0/2708364386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11af95c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb57ad9d700 1 -- 172.21.15.17:0/2708364386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d11afc43c0 con 0x55d11afa43f0 2023-07-14T13:09:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb579d9b700 1 --2- 172.21.15.17:0/2708364386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11af95c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:09:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.362+0000 7fb57ad9d700 1 --2- 172.21.15.17:0/2708364386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afa5fd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb574009390 tx=0x7fb57401c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd542e3b0e014338 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.363+0000 7fb5697fa700 1 -- 172.21.15.17:0/2708364386 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400e040 con 0x55d11afa43f0 2023-07-14T13:09:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.363+0000 7fb5697fa700 1 -- 172.21.15.17:0/2708364386 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb57400f040 con 0x55d11afa43f0 2023-07-14T13:09:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.363+0000 7fb5697fa700 1 -- 172.21.15.17:0/2708364386 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574017df0 con 0x55d11afa43f0 2023-07-14T13:09:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.364+0000 7fb59490cb80 1 -- 172.21.15.17:0/2708364386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 msgr2=0x55d11afa5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.364+0000 7fb59490cb80 1 --2- 172.21.15.17:0/2708364386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afa5fd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb574009390 tx=0x7fb57401c000 comp rx=0 tx=0).stop 2023-07-14T13:09:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.364+0000 7fb59490cb80 1 -- 172.21.15.17:0/2708364386 shutdown_connections 2023-07-14T13:09:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.364+0000 7fb59490cb80 1 --2- 172.21.15.17:0/2708364386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11afa5fd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.364+0000 7fb59490cb80 1 --2- 172.21.15.17:0/2708364386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11adf76b0 0x55d11afa85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.364+0000 7fb59490cb80 1 --2- 172.21.15.17:0/2708364386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11afa3f80 0x55d11af95c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.364+0000 7fb59490cb80 1 -- 172.21.15.17:0/2708364386 >> 172.21.15.17:0/2708364386 conn(0x55d11af90be0 msgr2=0x55d11afad070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.364+0000 7fb59490cb80 1 -- 172.21.15.17:0/2708364386 shutdown_connections 2023-07-14T13:09:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.364+0000 7fb59490cb80 1 -- 172.21.15.17:0/2708364386 wait complete. 2023-07-14T13:09:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.364+0000 7fb59490cb80 1 -- start start 2023-07-14T13:09:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb59490cb80 1 Processor -- start 2023-07-14T13:09:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11adf76b0 0x55d11afb0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11afa3f80 0x55d11afb1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb59490cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11b010240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb59490cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11afb1a20 con 0x55d11adf76b0 2023-07-14T13:09:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb59490cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11b010780 con 0x55d11afa43f0 2023-07-14T13:09:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb59490cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d11b0108c0 con 0x55d11afa3f80 2023-07-14T13:09:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb59490cb80 10 client.0 _ll_register_callbacks cb 0x7fb56c099c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:09:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb579d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11afa3f80 0x55d11afb1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb57a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11adf76b0 0x55d11afb0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb57ad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11b010240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb579d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11afa3f80 0x55d11afb1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45630/0 (socket says 172.21.15.17:45630) 2023-07-14T13:09:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.365+0000 7fb579d9b700 1 -- 172.21.15.17:0/367227238 learned_addr learned my addr 172.21.15.17:0/367227238 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:09:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.366+0000 7fb57ad9d700 1 -- 172.21.15.17:0/367227238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11afa3f80 msgr2=0x55d11afb1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.366+0000 7fb57ad9d700 1 --2- 172.21.15.17:0/367227238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11afa3f80 0x55d11afb1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.366+0000 7fb57ad9d700 1 -- 172.21.15.17:0/367227238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11adf76b0 msgr2=0x55d11afb0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:09:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.366+0000 7fb57ad9d700 1 --2- 172.21.15.17:0/367227238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11adf76b0 0x55d11afb0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.366+0000 7fb57ad9d700 1 -- 172.21.15.17:0/367227238 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d11ad1ad80 con 0x55d11afa43f0 2023-07-14T13:09:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.366+0000 7fb57ad9d700 1 --2- 172.21.15.17:0/367227238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11b010240 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55d11ae465d0 tx=0x7fb574017670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebcc9b25dc8f5de server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:09:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.366+0000 7fb561ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:09:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.367+0000 7fb561ffb700 1 -- 172.21.15.17:0/367227238 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400e070 con 0x55d11afa43f0 2023-07-14T13:09:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.367+0000 7fb59490cb80 1 -- 172.21.15.17:0/367227238 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb57001e040 con 0x55d11afa43f0 2023-07-14T13:09:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.367+0000 7fb561ffb700 1 -- 172.21.15.17:0/367227238 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb5740093c0 con 0x55d11afa43f0 2023-07-14T13:09:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.367+0000 7fb561ffb700 1 -- 172.21.15.17:0/367227238 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb574017e20 con 0x55d11afa43f0 2023-07-14T13:09:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.367+0000 7fb59490cb80 10 client.27104 fetch_fsmap learned FSMap version 34 2023-07-14T13:09:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.367+0000 7fb59490cb80 1 -- 172.21.15.17:0/367227238 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7fb574009040 con 0x55d11afa43f0 2023-07-14T13:09:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.367+0000 7fb561ffb700 1 -- 172.21.15.17:0/367227238 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb57001e040 con 0x55d11afa43f0 2023-07-14T13:09:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.367+0000 7fb561ffb700 1 -- 172.21.15.17:0/367227238 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7fb5740154b0 con 0x55d11afa43f0 2023-07-14T13:09:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.368+0000 7fb59490cb80 10 client.27104 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:09:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.368+0000 7fb59490cb80 10 client.27104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:09:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.368+0000 7fb59490cb80 20 client.27104 populate_metadata read hostname 'smithi017' 2023-07-14T13:09:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.368+0000 7fb59490cb80 1 --2- 172.21.15.17:0/367227238 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d11afbd380 0x55d11b013f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:09:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.368+0000 7fb59490cb80 4 client.27104 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:09:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.368+0000 7fb59490cb80 1 -- 172.21.15.17:0/367227238 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d11aea7ff0 con 0x55d11afbd380 2023-07-14T13:09:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.368+0000 7fb57a59c700 1 --2- 172.21.15.17:0/367227238 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d11afbd380 0x55d11b013f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:09:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.369+0000 7fb561ffb700 10 client.27104 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.369+0000 7fb57a59c700 1 --2- 172.21.15.17:0/367227238 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d11afbd380 0x55d11b013f50 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0d61a320d4dda9f server_cookie=d4234c50e244ec81 in_seq=0 out_seq=0 2023-07-14T13:09:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.380+0000 7fb561ffb700 1 -- 172.21.15.17:0/367227238 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d11aea7ff0 con 0x55d11afbd380 2023-07-14T13:09:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.380+0000 7fb561ffb700 10 client.27104 handle_command_reply: tid=0 2023-07-14T13:09:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.380+0000 7fb59490cb80 1 client.27104 shutdown 2023-07-14T13:09:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb59490cb80 1 -- 172.21.15.17:0/367227238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 msgr2=0x55d11b010240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb59490cb80 1 --2- 172.21.15.17:0/367227238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11b010240 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55d11ae465d0 tx=0x7fb574017670 comp rx=0 tx=0).stop 2023-07-14T13:09:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb59490cb80 1 -- 172.21.15.17:0/367227238 shutdown_connections 2023-07-14T13:09:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb59490cb80 1 --2- 172.21.15.17:0/367227238 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d11afbd380 0x55d11b013f50 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb59490cb80 1 --2- 172.21.15.17:0/367227238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d11afa43f0 0x55d11b010240 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb561ffb700 0 client.27104 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:09:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb59490cb80 1 --2- 172.21.15.17:0/367227238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d11adf76b0 0x55d11afb0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb59490cb80 1 --2- 172.21.15.17:0/367227238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d11afa3f80 0x55d11afb1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb59490cb80 1 -- 172.21.15.17:0/367227238 >> 172.21.15.17:0/367227238 conn(0x55d11af90be0 msgr2=0x55d11afa85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb59490cb80 1 -- 172.21.15.17:0/367227238 shutdown_connections 2023-07-14T13:09:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb59490cb80 1 -- 172.21.15.17:0/367227238 wait complete. 2023-07-14T13:09:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.381+0000 7fb59490cb80 20 client.27104 trim_cache size 0 max 16384 2023-07-14T13:09:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:09:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:09:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:09:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:09:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 -- 172.21.15.17:0/3684469541 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5640a12c0 msgr2=0x7fb5640a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5640a12c0 0x7fb5640a3770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb57400f590 tx=0x7fb57400b040 comp rx=0 tx=0).stop 2023-07-14T13:09:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 -- 172.21.15.17:0/3684469541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c0728b0 msgr2=0x7fb57c197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:09:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c0728b0 0x7fb57c197d30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00e9a0 tx=0x7fb56c00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 -- 172.21.15.17:0/3684469541 shutdown_connections 2023-07-14T13:09:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5640a12c0 0x7fb5640a3770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb57c10c350 0x7fb57c19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57c0728b0 0x7fb57c197d30 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 --2- 172.21.15.17:0/3684469541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0731c0 0x7fb57c198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:09:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 -- 172.21.15.17:0/3684469541 >> 172.21.15.17:0/3684469541 conn(0x7fb57c0fb5f0 msgr2=0x7fb57c10e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:09:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 -- 172.21.15.17:0/3684469541 shutdown_connections 2023-07-14T13:09:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:09:56.382+0000 7fb580fff700 1 -- 172.21.15.17:0/3684469541 wait complete. 2023-07-14T13:09:57.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:57 smithi135 ceph-mon[97338]: pgmap v317: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 23 MiB/s wr, 66 op/s 2023-07-14T13:09:57.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:57 smithi131 ceph-mon[96953]: pgmap v317: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 23 MiB/s wr, 66 op/s 2023-07-14T13:09:57.568 INFO:teuthology.orchestra.run.smithi017.stderr:40100000 of 50000000 tuples (80%) done (elapsed 587.17 s, remaining 144.96 s) 2023-07-14T13:09:57.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:57 smithi017 ceph-mon[95536]: pgmap v317: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 23 MiB/s wr, 66 op/s 2023-07-14T13:09:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:40200000 of 50000000 tuples (80%) done (elapsed 588.47 s, remaining 143.46 s) 2023-07-14T13:09:59.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:09:59 smithi135 ceph-mon[97338]: pgmap v318: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 21 MiB/s wr, 58 op/s 2023-07-14T13:09:59.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:09:59 smithi131 ceph-mon[96953]: pgmap v318: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 21 MiB/s wr, 58 op/s 2023-07-14T13:09:59.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:09:59 smithi017 ceph-mon[95536]: pgmap v318: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 21 MiB/s wr, 58 op/s 2023-07-14T13:10:00.184 INFO:teuthology.orchestra.run.smithi017.stderr:40300000 of 50000000 tuples (80%) done (elapsed 589.78 s, remaining 141.96 s) 2023-07-14T13:10:00.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:00 smithi135 ceph-mon[97338]: overall HEALTH_OK 2023-07-14T13:10:00.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:00 smithi131 ceph-mon[96953]: overall HEALTH_OK 2023-07-14T13:10:00.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:00 smithi017 ceph-mon[95536]: overall HEALTH_OK 2023-07-14T13:10:01.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:01 smithi135 ceph-mon[97338]: pgmap v319: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 33 MiB/s wr, 94 op/s 2023-07-14T13:10:01.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:01 smithi131 ceph-mon[96953]: pgmap v319: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 33 MiB/s wr, 94 op/s 2023-07-14T13:10:01.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:01 smithi017 ceph-mon[95536]: pgmap v319: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 33 MiB/s wr, 94 op/s 2023-07-14T13:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:40400000 of 50000000 tuples (80%) done (elapsed 591.21 s, remaining 140.49 s) 2023-07-14T13:10:02.013 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:10:02.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.227+0000 7f495a7ff700 1 -- 172.21.15.17:0/932305611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49540fe8a0 msgr2=0x7f49540fec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.227+0000 7f495a7ff700 1 --2- 172.21.15.17:0/932305611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49540fe8a0 0x7f49540fec70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4944009990 tx=0x7f4944009ca0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.227+0000 7f495a7ff700 1 -- 172.21.15.17:0/932305611 shutdown_connections 2023-07-14T13:10:02.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.227+0000 7f495a7ff700 1 --2- 172.21.15.17:0/932305611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f495410c450 0x7f495410e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.227+0000 7f495a7ff700 1 --2- 172.21.15.17:0/932305611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49540fe8a0 0x7f49540fec70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.227+0000 7f495a7ff700 1 --2- 172.21.15.17:0/932305611 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49540ff1b0 0x7f495410bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.227+0000 7f495a7ff700 1 -- 172.21.15.17:0/932305611 >> 172.21.15.17:0/932305611 conn(0x7f49540fa4b0 msgr2=0x7f49540fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.227+0000 7f495a7ff700 1 -- 172.21.15.17:0/932305611 shutdown_connections 2023-07-14T13:10:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.228+0000 7f495a7ff700 1 -- 172.21.15.17:0/932305611 wait complete. 2023-07-14T13:10:02.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.229+0000 7f495a7ff700 1 Processor -- start 2023-07-14T13:10:02.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.229+0000 7f495a7ff700 1 -- start start 2023-07-14T13:10:02.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.229+0000 7f495a7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49540fe8a0 0x7f4954197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.229+0000 7f495a7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49540ff1b0 0x7f4954198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.229+0000 7f495a7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f495410c450 0x7f495419c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.229+0000 7f495a7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495419cdf0 con 0x7f495410c450 2023-07-14T13:10:02.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.229+0000 7f495a7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495419cf60 con 0x7f49540fe8a0 2023-07-14T13:10:02.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.229+0000 7f495a7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495419d120 con 0x7f49540ff1b0 2023-07-14T13:10:02.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f49537fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49540ff1b0 0x7f4954198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f4953fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49540fe8a0 0x7f4954197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f49537fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49540ff1b0 0x7f4954198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45654/0 (socket says 172.21.15.17:45654) 2023-07-14T13:10:02.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f49537fe700 1 -- 172.21.15.17:0/2828399924 learned_addr learned my addr 172.21.15.17:0/2828399924 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:02.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f4953fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49540fe8a0 0x7f4954197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49706/0 (socket says 172.21.15.17:49706) 2023-07-14T13:10:02.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f4958d9c700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f495410c450 0x7f495419c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f49537fe700 1 -- 172.21.15.17:0/2828399924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49540fe8a0 msgr2=0x7f4954197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f49537fe700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49540fe8a0 0x7f4954197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f49537fe700 1 -- 172.21.15.17:0/2828399924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f495410c450 msgr2=0x7f495419c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f49537fe700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f495410c450 0x7f495419c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f49537fe700 1 -- 172.21.15.17:0/2828399924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49440095f0 con 0x7f49540ff1b0 2023-07-14T13:10:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f4953fff700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49540fe8a0 0x7f4954197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.230+0000 7f49537fe700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49540ff1b0 0x7f4954198350 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f494800e9a0 tx=0x7f494800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.231+0000 7f49517fa700 1 -- 172.21.15.17:0/2828399924 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948009790 con 0x7f49540ff1b0 2023-07-14T13:10:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.231+0000 7f495a7ff700 1 -- 172.21.15.17:0/2828399924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495419d400 con 0x7f49540ff1b0 2023-07-14T13:10:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.231+0000 7f49517fa700 1 -- 172.21.15.17:0/2828399924 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f494800cbd0 con 0x7f49540ff1b0 2023-07-14T13:10:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.231+0000 7f49517fa700 1 -- 172.21.15.17:0/2828399924 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948018680 con 0x7f49540ff1b0 2023-07-14T13:10:02.270 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.231+0000 7f495a7ff700 1 -- 172.21.15.17:0/2828399924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49541a4c40 con 0x7f49540ff1b0 2023-07-14T13:10:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.234+0000 7f49517fa700 1 -- 172.21.15.17:0/2828399924 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f494800cd40 con 0x7f49540ff1b0 2023-07-14T13:10:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.236+0000 7f496e1b3b80 1 Processor -- start 2023-07-14T13:10:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.236+0000 7f496e1b3b80 1 -- start start 2023-07-14T13:10:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded89be0 0x5600ded94590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded94ad0 0x5600ded96eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dec8fcb0 con 0x5600ded89be0 2023-07-14T13:10:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dece2a40 con 0x5600ded94ad0 2023-07-14T13:10:02.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600decdbed0 con 0x5600ded892d0 2023-07-14T13:10:02.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f4958d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f4958d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded896a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45656/0 (socket says 172.21.15.17:45656) 2023-07-14T13:10:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f4958d9c700 1 -- 172.21.15.17:0/175853510 learned_addr learned my addr 172.21.15.17:0/175853510 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f4953fff700 1 --2- 172.21.15.17:0/175853510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded89be0 0x5600ded94590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f49537fe700 1 --2- 172.21.15.17:0/175853510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded94ad0 0x5600ded96eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f49517fa700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f493c0a1340 0x7f493c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.237+0000 7f4958d9c700 1 -- 172.21.15.17:0/175853510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded94ad0 msgr2=0x5600ded96eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:02.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.238+0000 7f4958d9c700 1 --2- 172.21.15.17:0/175853510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded94ad0 0x5600ded96eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.238+0000 7f4958d9c700 1 -- 172.21.15.17:0/175853510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded89be0 msgr2=0x5600ded94590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:02.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.238+0000 7f4958d9c700 1 --2- 172.21.15.17:0/175853510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded89be0 0x5600ded94590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.238+0000 7f4958d9c700 1 -- 172.21.15.17:0/175853510 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600deb09de0 con 0x5600ded892d0 2023-07-14T13:10:02.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.238+0000 7f49517fa700 1 -- 172.21.15.17:0/2828399924 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4948014070 con 0x7f49540ff1b0 2023-07-14T13:10:02.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.238+0000 7f4958d9c700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f493c0a1340 0x7f493c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.238+0000 7f4958d9c700 1 --2- 172.21.15.17:0/175853510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded896a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f494c0094a0 tx=0x7f494c0094d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9ce025980c335bd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:02.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.238+0000 7f493a7fc700 1 -- 172.21.15.17:0/175853510 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c00e070 con 0x5600ded892d0 2023-07-14T13:10:02.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.238+0000 7f493a7fc700 1 -- 172.21.15.17:0/175853510 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f494c026070 con 0x5600ded892d0 2023-07-14T13:10:02.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.238+0000 7f493a7fc700 1 -- 172.21.15.17:0/175853510 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c021620 con 0x5600ded892d0 2023-07-14T13:10:02.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.239+0000 7f4958d9c700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f493c0a1340 0x7f493c0a37f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f494c021000 tx=0x7f494c022000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:02.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.239+0000 7f496e1b3b80 1 -- 172.21.15.17:0/175853510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 msgr2=0x5600ded896a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.239+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/175853510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded896a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f494c0094a0 tx=0x7f494c0094d0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.239+0000 7f496e1b3b80 1 -- 172.21.15.17:0/175853510 shutdown_connections 2023-07-14T13:10:02.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.239+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/175853510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded94ad0 0x5600ded96eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.239+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/175853510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded896a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.239+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/175853510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded89be0 0x5600ded94590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.239+0000 7f496e1b3b80 1 -- 172.21.15.17:0/175853510 >> 172.21.15.17:0/175853510 conn(0x5600ded7fda0 msgr2=0x5600ded856a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:02.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.239+0000 7f496e1b3b80 1 -- 172.21.15.17:0/175853510 shutdown_connections 2023-07-14T13:10:02.279 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.239+0000 7f496e1b3b80 1 -- 172.21.15.17:0/175853510 wait complete. 2023-07-14T13:10:02.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.240+0000 7f496e1b3b80 1 -- start start 2023-07-14T13:10:02.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.240+0000 7f496e1b3b80 1 Processor -- start 2023-07-14T13:10:02.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded892d0 0x5600ded944a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded89be0 0x5600ded916b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded94ad0 0x5600ded91cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dec7bac0 con 0x5600ded89be0 2023-07-14T13:10:02.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dec7b7c0 con 0x5600ded892d0 2023-07-14T13:10:02.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600deb5f920 con 0x5600ded94ad0 2023-07-14T13:10:02.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f496e1b3b80 10 client.0 _ll_register_callbacks cb 0x5600dec79760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:02.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f49537fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded89be0 0x5600ded916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f4953fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded892d0 0x5600ded944a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f4953fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded892d0 0x5600ded944a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49724/0 (socket says 172.21.15.17:49724) 2023-07-14T13:10:02.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f4953fff700 1 -- 172.21.15.17:0/2250771362 learned_addr learned my addr 172.21.15.17:0/2250771362 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:02.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.241+0000 7f4958d9c700 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded94ad0 0x5600ded91cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.242+0000 7f4953fff700 1 -- 172.21.15.17:0/2250771362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded94ad0 msgr2=0x5600ded91cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.242+0000 7f4953fff700 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded94ad0 0x5600ded91cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.242+0000 7f4953fff700 1 -- 172.21.15.17:0/2250771362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded89be0 msgr2=0x5600ded916b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.242+0000 7f4953fff700 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded89be0 0x5600ded916b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.242+0000 7f4953fff700 1 -- 172.21.15.17:0/2250771362 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c0090a0 con 0x5600ded892d0 2023-07-14T13:10:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.242+0000 7f4953fff700 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded892d0 0x5600ded944a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4944015000 tx=0x7f4944005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0c74f6cd7452327 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:02.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.242+0000 7f49337fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:10:02.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.242+0000 7f49337fe700 1 -- 172.21.15.17:0/2250771362 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494401d070 con 0x5600ded892d0 2023-07-14T13:10:02.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.242+0000 7f49337fe700 1 -- 172.21.15.17:0/2250771362 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4944004910 con 0x5600ded892d0 2023-07-14T13:10:02.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.242+0000 7f496e1b3b80 1 -- 172.21.15.17:0/2250771362 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600dec354f0 con 0x5600ded892d0 2023-07-14T13:10:02.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.243+0000 7f49337fe700 1 -- 172.21.15.17:0/2250771362 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4944004ad0 con 0x5600ded892d0 2023-07-14T13:10:02.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.243+0000 7f496e1b3b80 10 client.27116 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:02.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.243+0000 7f496e1b3b80 1 -- 172.21.15.17:0/2250771362 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5600deaf2c60 con 0x5600ded892d0 2023-07-14T13:10:02.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.243+0000 7f49337fe700 1 -- 172.21.15.17:0/2250771362 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4944033020 con 0x5600ded892d0 2023-07-14T13:10:02.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.243+0000 7f49337fe700 1 -- 172.21.15.17:0/2250771362 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f494400fc70 con 0x5600ded892d0 2023-07-14T13:10:02.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.243+0000 7f496e1b3b80 10 client.27116 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:02.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.243+0000 7f496e1b3b80 10 client.27116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:02.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.243+0000 7f496e1b3b80 20 client.27116 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:02.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.243+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600deda4440 0x5600deda6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.243+0000 7f496e1b3b80 4 client.27116 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:10:02.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.243+0000 7f496e1b3b80 1 -- 172.21.15.17:0/2250771362 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600decd4eb0 con 0x5600deda4440 2023-07-14T13:10:02.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.244+0000 7f49537fe700 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600deda4440 0x5600deda6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.244+0000 7f49537fe700 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600deda4440 0x5600deda6850 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a68be003b8134389 server_cookie=3afa5f142b07b939 in_seq=0 out_seq=0 2023-07-14T13:10:02.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.244+0000 7f49337fe700 10 client.27116 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:02.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.245+0000 7f49337fe700 1 -- 172.21.15.17:0/2250771362 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5600decd4eb0 con 0x5600deda4440 2023-07-14T13:10:02.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.245+0000 7f49337fe700 10 client.27116 handle_command_reply: tid=0 2023-07-14T13:10:02.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.245+0000 7f496e1b3b80 1 client.27116 shutdown 2023-07-14T13:10:02.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.245+0000 7f496e1b3b80 1 -- 172.21.15.17:0/2250771362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded892d0 msgr2=0x5600ded944a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.245+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded892d0 0x5600ded944a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4944015000 tx=0x7f4944005270 comp rx=0 tx=0).stop 2023-07-14T13:10:02.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.246+0000 7f496e1b3b80 1 -- 172.21.15.17:0/2250771362 shutdown_connections 2023-07-14T13:10:02.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.246+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600deda4440 0x5600deda6850 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.246+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded94ad0 0x5600ded91cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.246+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded892d0 0x5600ded944a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.246+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/2250771362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded89be0 0x5600ded916b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.246+0000 7f49337fe700 0 client.27116 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:02.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.246+0000 7f496e1b3b80 1 -- 172.21.15.17:0/2250771362 >> 172.21.15.17:0/2250771362 conn(0x5600ded7fda0 msgr2=0x5600ded85230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:02.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.246+0000 7f496e1b3b80 1 -- 172.21.15.17:0/2250771362 shutdown_connections 2023-07-14T13:10:02.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.246+0000 7f496e1b3b80 1 -- 172.21.15.17:0/2250771362 wait complete. 2023-07-14T13:10:02.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.246+0000 7f496e1b3b80 20 client.27116 trim_cache size 0 max 16384 2023-07-14T13:10:02.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.267+0000 7f496e1b3b80 1 Processor -- start 2023-07-14T13:10:02.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.267+0000 7f496e1b3b80 1 -- start start 2023-07-14T13:10:02.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.267+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded93fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.267+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 0x5600ded8c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.267+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded94ad0 0x5600ded8ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.267+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ded81ec0 con 0x5600ded94ad0 2023-07-14T13:10:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.267+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ded84520 con 0x5600ded89be0 2023-07-14T13:10:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.267+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ded8c4e0 con 0x5600ded892d0 2023-07-14T13:10:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.268+0000 7f4953fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded93fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.268+0000 7f49537fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 0x5600ded8c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.268+0000 7f4953fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded93fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45670/0 (socket says 172.21.15.17:45670) 2023-07-14T13:10:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.268+0000 7f4953fff700 1 -- 172.21.15.17:0/4041835911 learned_addr learned my addr 172.21.15.17:0/4041835911 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:02.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.268+0000 7f4958d9c700 1 --2- 172.21.15.17:0/4041835911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded94ad0 0x5600ded8ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.268+0000 7f4953fff700 1 -- 172.21.15.17:0/4041835911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 msgr2=0x5600ded8c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.268+0000 7f4953fff700 1 --2- 172.21.15.17:0/4041835911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 0x5600ded8c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.268+0000 7f4953fff700 1 -- 172.21.15.17:0/4041835911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded94ad0 msgr2=0x5600ded8ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.268+0000 7f4953fff700 1 --2- 172.21.15.17:0/4041835911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded94ad0 0x5600ded8ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.268+0000 7f4953fff700 1 -- 172.21.15.17:0/4041835911 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600deb30250 con 0x5600ded892d0 2023-07-14T13:10:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.268+0000 7f4953fff700 1 --2- 172.21.15.17:0/4041835911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded93fd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4944024450 tx=0x7f4944009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7bfec9c1391a6e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.269+0000 7f493affd700 1 -- 172.21.15.17:0/4041835911 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494401d040 con 0x5600ded892d0 2023-07-14T13:10:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.269+0000 7f493affd700 1 -- 172.21.15.17:0/4041835911 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4944033070 con 0x5600ded892d0 2023-07-14T13:10:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.269+0000 7f493affd700 1 -- 172.21.15.17:0/4041835911 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944024710 con 0x5600ded892d0 2023-07-14T13:10:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.269+0000 7f496e1b3b80 1 -- 172.21.15.17:0/4041835911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 msgr2=0x5600ded93fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.269+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/4041835911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded93fd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4944024450 tx=0x7f4944009290 comp rx=0 tx=0).stop 2023-07-14T13:10:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.269+0000 7f496e1b3b80 1 -- 172.21.15.17:0/4041835911 shutdown_connections 2023-07-14T13:10:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.269+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/4041835911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded94ad0 0x5600ded8ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.269+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/4041835911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded892d0 0x5600ded93fd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.269+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/4041835911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 0x5600ded8c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.269+0000 7f496e1b3b80 1 -- 172.21.15.17:0/4041835911 >> 172.21.15.17:0/4041835911 conn(0x5600ded7fda0 msgr2=0x5600ded83e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.269+0000 7f496e1b3b80 1 -- 172.21.15.17:0/4041835911 shutdown_connections 2023-07-14T13:10:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.270+0000 7f496e1b3b80 1 -- 172.21.15.17:0/4041835911 wait complete. 2023-07-14T13:10:02.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.270+0000 7f496e1b3b80 1 -- start start 2023-07-14T13:10:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.270+0000 7f496e1b3b80 1 Processor -- start 2023-07-14T13:10:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded892d0 0x5600ded9afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 0x5600ded9b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f496e1b3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded94ad0 0x5600ded99510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ded99ae0 con 0x5600ded892d0 2023-07-14T13:10:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ded99c50 con 0x5600ded89be0 2023-07-14T13:10:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f496e1b3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600ded99e10 con 0x5600ded94ad0 2023-07-14T13:10:02.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f496e1b3b80 10 client.0 _ll_register_callbacks cb 0x7f494400bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f4953fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded892d0 0x5600ded9afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f49537fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 0x5600ded9b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f49537fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 0x5600ded9b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49746/0 (socket says 172.21.15.17:49746) 2023-07-14T13:10:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f49537fe700 1 -- 172.21.15.17:0/3224174813 learned_addr learned my addr 172.21.15.17:0/3224174813 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.271+0000 7f4958d9c700 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded94ad0 0x5600ded99510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.272+0000 7f49537fe700 1 -- 172.21.15.17:0/3224174813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded94ad0 msgr2=0x5600ded99510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:02.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.272+0000 7f49537fe700 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded94ad0 0x5600ded99510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.272+0000 7f49537fe700 1 -- 172.21.15.17:0/3224174813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded892d0 msgr2=0x5600ded9afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:02.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.272+0000 7f49537fe700 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded892d0 0x5600ded9afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.272+0000 7f49537fe700 1 -- 172.21.15.17:0/3224174813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600deaf2c60 con 0x5600ded89be0 2023-07-14T13:10:02.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.272+0000 7f49537fe700 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 0x5600ded9b520 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4948099ce0 tx=0x7f49480cf1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21fde8054120469c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:02.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.272+0000 7f49337fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:10:02.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.272+0000 7f49337fe700 1 -- 172.21.15.17:0/3224174813 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494809a440 con 0x5600ded89be0 2023-07-14T13:10:02.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.272+0000 7f496e1b3b80 1 -- 172.21.15.17:0/3224174813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f494c026070 con 0x5600ded89be0 2023-07-14T13:10:02.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.272+0000 7f49337fe700 1 -- 172.21.15.17:0/3224174813 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4948099fe0 con 0x5600ded89be0 2023-07-14T13:10:02.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.273+0000 7f49337fe700 1 -- 172.21.15.17:0/3224174813 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f494809e010 con 0x5600ded89be0 2023-07-14T13:10:02.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.273+0000 7f496e1b3b80 10 client.27122 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.273+0000 7f496e1b3b80 1 -- 172.21.15.17:0/3224174813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5600deb082b0 con 0x5600ded89be0 2023-07-14T13:10:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.273+0000 7f49337fe700 1 -- 172.21.15.17:0/3224174813 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f49480c8080 con 0x5600ded89be0 2023-07-14T13:10:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.273+0000 7f49337fe700 1 -- 172.21.15.17:0/3224174813 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f49480a1fa0 con 0x5600ded89be0 2023-07-14T13:10:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.273+0000 7f496e1b3b80 10 client.27122 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.273+0000 7f496e1b3b80 10 client.27122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.273+0000 7f496e1b3b80 20 client.27122 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:02.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.273+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600dedf9530 0x5600dedfb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.273+0000 7f496e1b3b80 4 client.27122 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:10:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.273+0000 7f496e1b3b80 1 -- 172.21.15.17:0/3224174813 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5600dec97050 con 0x5600dedf9530 2023-07-14T13:10:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.274+0000 7f4953fff700 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600dedf9530 0x5600dedfb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.274+0000 7f4953fff700 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600dedf9530 0x5600dedfb940 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1475814e0b22a12f server_cookie=ab0bf41d0f622406 in_seq=0 out_seq=0 2023-07-14T13:10:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.274+0000 7f49337fe700 10 client.27122 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f49337fe700 1 -- 172.21.15.17:0/3224174813 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5600dec97050 con 0x5600dedf9530 2023-07-14T13:10:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f49337fe700 10 client.27122 handle_command_reply: tid=0 2023-07-14T13:10:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 1 client.27122 shutdown 2023-07-14T13:10:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 1 -- 172.21.15.17:0/3224174813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 msgr2=0x5600ded9b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 0x5600ded9b520 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4948099ce0 tx=0x7f49480cf1a0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 1 -- 172.21.15.17:0/3224174813 shutdown_connections 2023-07-14T13:10:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5600dedf9530 0x5600dedfb940 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600ded94ad0 0x5600ded99510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5600ded892d0 0x5600ded9afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 1 --2- 172.21.15.17:0/3224174813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600ded89be0 0x5600ded9b520 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f49337fe700 0 client.27122 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 1 -- 172.21.15.17:0/3224174813 >> 172.21.15.17:0/3224174813 conn(0x5600ded7fda0 msgr2=0x5600ded8c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 1 -- 172.21.15.17:0/3224174813 shutdown_connections 2023-07-14T13:10:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 1 -- 172.21.15.17:0/3224174813 wait complete. 2023-07-14T13:10:02.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.275+0000 7f496e1b3b80 20 client.27122 trim_cache size 0 max 16384 2023-07-14T13:10:02.318 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:10:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:10:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:10:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:10:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:10:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:10:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:10:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:10:02.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:10:02.320 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:10:02.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 -- 172.21.15.17:0/2828399924 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f493c0a1340 msgr2=0x7f493c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f493c0a1340 0x7f493c0a37f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f494c021000 tx=0x7f494c022000 comp rx=0 tx=0).stop 2023-07-14T13:10:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 -- 172.21.15.17:0/2828399924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49540ff1b0 msgr2=0x7f4954198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49540ff1b0 0x7f4954198350 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f494800e9a0 tx=0x7f494800ecb0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 -- 172.21.15.17:0/2828399924 shutdown_connections 2023-07-14T13:10:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f493c0a1340 0x7f493c0a37f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f495410c450 0x7f495419c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49540fe8a0 0x7f4954197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 --2- 172.21.15.17:0/2828399924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f49540ff1b0 0x7f4954198350 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 -- 172.21.15.17:0/2828399924 >> 172.21.15.17:0/2828399924 conn(0x7f49540fa4b0 msgr2=0x7f49540fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 -- 172.21.15.17:0/2828399924 shutdown_connections 2023-07-14T13:10:02.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:02.276+0000 7f495a7ff700 1 -- 172.21.15.17:0/2828399924 wait complete. 2023-07-14T13:10:02.330 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:10:02.967 INFO:teuthology.orchestra.run.smithi017.stderr:40500000 of 50000000 tuples (81%) done (elapsed 592.57 s, remaining 139.00 s) 2023-07-14T13:10:03.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:03 smithi135 ceph-mon[97338]: pgmap v320: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:10:03.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:03 smithi131 ceph-mon[96953]: pgmap v320: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:10:03.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:03 smithi017 ceph-mon[95536]: pgmap v320: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:10:04.387 INFO:teuthology.orchestra.run.smithi017.stderr:40600000 of 50000000 tuples (81%) done (elapsed 593.99 s, remaining 137.52 s) 2023-07-14T13:10:05.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:05 smithi135 ceph-mon[97338]: pgmap v321: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:10:05.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:05 smithi135 ceph-mon[97338]: osdmap e98: 12 total, 12 up, 12 in 2023-07-14T13:10:05.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:05 smithi131 ceph-mon[96953]: pgmap v321: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:10:05.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:05 smithi131 ceph-mon[96953]: osdmap e98: 12 total, 12 up, 12 in 2023-07-14T13:10:05.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:05 smithi017 ceph-mon[95536]: pgmap v321: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:10:05.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:05 smithi017 ceph-mon[95536]: osdmap e98: 12 total, 12 up, 12 in 2023-07-14T13:10:05.814 INFO:teuthology.orchestra.run.smithi017.stderr:40700000 of 50000000 tuples (81%) done (elapsed 595.41 s, remaining 136.05 s) 2023-07-14T13:10:06.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:06 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:10:06.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:06 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:10:06.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:06 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:10:07.164 INFO:teuthology.orchestra.run.smithi017.stderr:40800000 of 50000000 tuples (81%) done (elapsed 596.76 s, remaining 134.56 s) 2023-07-14T13:10:07.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:07 smithi135 ceph-mon[97338]: pgmap v323: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 26 MiB/s wr, 98 op/s 2023-07-14T13:10:07.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:07 smithi131 ceph-mon[96953]: pgmap v323: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 26 MiB/s wr, 98 op/s 2023-07-14T13:10:07.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:07 smithi017 ceph-mon[95536]: pgmap v323: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 26 MiB/s wr, 98 op/s 2023-07-14T13:10:08.534 INFO:teuthology.orchestra.run.smithi017.stderr:40900000 of 50000000 tuples (81%) done (elapsed 598.13 s, remaining 133.08 s) 2023-07-14T13:10:09.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:09 smithi135 ceph-mon[97338]: pgmap v324: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 26 MiB/s wr, 98 op/s 2023-07-14T13:10:09.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:09 smithi131 ceph-mon[96953]: pgmap v324: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 26 MiB/s wr, 98 op/s 2023-07-14T13:10:09.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.575+0000 7f274a7ff700 1 -- 172.21.15.17:0/146646202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2744067c10 msgr2=0x7f2744067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:09.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.575+0000 7f274a7ff700 1 --2- 172.21.15.17:0/146646202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2744067c10 0x7f2744067fe0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27340099c0 tx=0x7f2734009cd0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.575+0000 7f274a7ff700 1 -- 172.21.15.17:0/146646202 shutdown_connections 2023-07-14T13:10:09.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.575+0000 7f274a7ff700 1 --2- 172.21.15.17:0/146646202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2744104e50 0x7f274410ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.575+0000 7f274a7ff700 1 --2- 172.21.15.17:0/146646202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2744067c10 0x7f2744067fe0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.575+0000 7f274a7ff700 1 --2- 172.21.15.17:0/146646202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27440685b0 0x7f2744104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.575+0000 7f274a7ff700 1 -- 172.21.15.17:0/146646202 >> 172.21.15.17:0/146646202 conn(0x7f2744074760 msgr2=0x7f2744074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.575+0000 7f274a7ff700 1 -- 172.21.15.17:0/146646202 shutdown_connections 2023-07-14T13:10:09.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.575+0000 7f274a7ff700 1 -- 172.21.15.17:0/146646202 wait complete. 2023-07-14T13:10:09.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:09 smithi017 ceph-mon[95536]: pgmap v324: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 26 MiB/s wr, 98 op/s 2023-07-14T13:10:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.577+0000 7f274a7ff700 1 Processor -- start 2023-07-14T13:10:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.577+0000 7f274a7ff700 1 -- start start 2023-07-14T13:10:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.577+0000 7f274a7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2744067c10 0x7f274419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.577+0000 7f274a7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27440685b0 0x7f274419c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.577+0000 7f274a7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2744104e50 0x7f2744195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f274a7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2744195fa0 con 0x7f27440685b0 2023-07-14T13:10:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f274a7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2744196110 con 0x7f2744104e50 2023-07-14T13:10:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f274a7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27441962d0 con 0x7f2744067c10 2023-07-14T13:10:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f2743fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2744067c10 0x7f274419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f27437fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27440685b0 0x7f274419c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f2743fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2744067c10 0x7f274419bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41894/0 (socket says 172.21.15.17:41894) 2023-07-14T13:10:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f2743fff700 1 -- 172.21.15.17:0/1546023951 learned_addr learned my addr 172.21.15.17:0/1546023951 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f27437fe700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27440685b0 0x7f274419c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53664/0 (socket says 172.21.15.17:53664) 2023-07-14T13:10:09.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f2748d9c700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2744104e50 0x7f2744195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f27437fe700 1 -- 172.21.15.17:0/1546023951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2744067c10 msgr2=0x7f274419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f27437fe700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2744067c10 0x7f274419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f27437fe700 1 -- 172.21.15.17:0/1546023951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2744104e50 msgr2=0x7f2744195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f27437fe700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2744104e50 0x7f2744195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f27437fe700 1 -- 172.21.15.17:0/1546023951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738009520 con 0x7f27440685b0 2023-07-14T13:10:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.578+0000 7f2743fff700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2744067c10 0x7f274419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.579+0000 7f27437fe700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27440685b0 0x7f274419c010 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2744068980 tx=0x7f273800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.579+0000 7f27417fa700 1 -- 172.21.15.17:0/1546023951 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738004220 con 0x7f27440685b0 2023-07-14T13:10:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.579+0000 7f27417fa700 1 -- 172.21.15.17:0/1546023951 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2738004380 con 0x7f27440685b0 2023-07-14T13:10:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.579+0000 7f274a7ff700 1 -- 172.21.15.17:0/1546023951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c009c40 con 0x7f27440685b0 2023-07-14T13:10:09.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.579+0000 7f27417fa700 1 -- 172.21.15.17:0/1546023951 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738003bc0 con 0x7f27440685b0 2023-07-14T13:10:09.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.579+0000 7f274a7ff700 1 -- 172.21.15.17:0/1546023951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27340095f0 con 0x7f27440685b0 2023-07-14T13:10:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.583+0000 7f27417fa700 1 -- 172.21.15.17:0/1546023951 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f273800c760 con 0x7f27440685b0 2023-07-14T13:10:09.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.584+0000 7f275e07ab80 1 Processor -- start 2023-07-14T13:10:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.585+0000 7f275e07ab80 1 -- start start 2023-07-14T13:10:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.585+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c49640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.585+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 0x55da15c4ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.585+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49ff0 0x55da15c4e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.585+0000 7f275e07ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15b4ac50 con 0x55da15c49ff0 2023-07-14T13:10:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.585+0000 7f275e07ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15b9d9e0 con 0x55da15aa16b0 2023-07-14T13:10:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.585+0000 7f275e07ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15b96e70 con 0x55da15c49b80 2023-07-14T13:10:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.585+0000 7f2748d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c49640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.585+0000 7f2743fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 0x55da15c4ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.585+0000 7f2748d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c49640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:38160/0 (socket says 172.21.15.17:38160) 2023-07-14T13:10:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.585+0000 7f2748d9c700 1 -- 172.21.15.17:0/2568130804 learned_addr learned my addr 172.21.15.17:0/2568130804 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.586+0000 7f27417fa700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f272c0a1340 0x7f272c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.586+0000 7f27437fe700 1 --2- 172.21.15.17:0/2568130804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49ff0 0x55da15c4e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.586+0000 7f2743fff700 1 -- 172.21.15.17:0/2568130804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 msgr2=0x55da15c49640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.586+0000 7f2743fff700 1 --2- 172.21.15.17:0/2568130804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c49640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.586+0000 7f2743fff700 1 -- 172.21.15.17:0/2568130804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49ff0 msgr2=0x55da15c4e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.586+0000 7f27417fa700 1 -- 172.21.15.17:0/1546023951 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f2738014070 con 0x7f27440685b0 2023-07-14T13:10:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.586+0000 7f2743fff700 1 --2- 172.21.15.17:0/2568130804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49ff0 0x55da15c4e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.586+0000 7f2743fff700 1 -- 172.21.15.17:0/2568130804 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da159c4d80 con 0x55da15c49b80 2023-07-14T13:10:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.586+0000 7f2748d9c700 1 --2- 172.21.15.17:0/2568130804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c49640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:10:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.586+0000 7f2748d9c700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f272c0a1340 0x7f272c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.586+0000 7f2743fff700 1 --2- 172.21.15.17:0/2568130804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 0x55da15c4ddc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2734009fd0 tx=0x7f2734005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd62aa22bb98ab9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.587+0000 7f272a7fc700 1 -- 172.21.15.17:0/2568130804 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734005070 con 0x55da15c49b80 2023-07-14T13:10:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.587+0000 7f272a7fc700 1 -- 172.21.15.17:0/2568130804 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f273401e040 con 0x55da15c49b80 2023-07-14T13:10:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.587+0000 7f272a7fc700 1 -- 172.21.15.17:0/2568130804 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734003dd0 con 0x55da15c49b80 2023-07-14T13:10:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.587+0000 7f275e07ab80 1 -- 172.21.15.17:0/2568130804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 msgr2=0x55da15c4ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.587+0000 7f2748d9c700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f272c0a1340 0x7f272c0a37f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f273c0091e0 tx=0x7f273c004ad0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.587+0000 7f275e07ab80 1 --2- 172.21.15.17:0/2568130804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 0x55da15c4ddc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2734009fd0 tx=0x7f2734005bc0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.588+0000 7f275e07ab80 1 -- 172.21.15.17:0/2568130804 shutdown_connections 2023-07-14T13:10:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.588+0000 7f275e07ab80 1 --2- 172.21.15.17:0/2568130804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49ff0 0x55da15c4e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.588+0000 7f275e07ab80 1 --2- 172.21.15.17:0/2568130804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c49640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.588+0000 7f275e07ab80 1 --2- 172.21.15.17:0/2568130804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 0x55da15c4ddc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.588+0000 7f275e07ab80 1 -- 172.21.15.17:0/2568130804 >> 172.21.15.17:0/2568130804 conn(0x55da15c3abe0 msgr2=0x55da15c3ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.588+0000 7f275e07ab80 1 -- 172.21.15.17:0/2568130804 shutdown_connections 2023-07-14T13:10:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.588+0000 7f275e07ab80 1 -- 172.21.15.17:0/2568130804 wait complete. 2023-07-14T13:10:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.588+0000 7f275e07ab80 1 -- start start 2023-07-14T13:10:09.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.589+0000 7f275e07ab80 1 Processor -- start 2023-07-14T13:10:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.589+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15aa16b0 0x55da15c58a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.589+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49b80 0x55da15c58f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.589+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15c49ff0 0x55da15c52ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.589+0000 7f275e07ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15b36a60 con 0x55da15c49b80 2023-07-14T13:10:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.589+0000 7f275e07ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15b36760 con 0x55da15c49ff0 2023-07-14T13:10:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.589+0000 7f275e07ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15a1a8c0 con 0x55da15aa16b0 2023-07-14T13:10:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.589+0000 7f275e07ab80 10 client.0 _ll_register_callbacks cb 0x55da15b34700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f2743fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15aa16b0 0x55da15c58a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f2743fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15aa16b0 0x55da15c58a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41918/0 (socket says 172.21.15.17:41918) 2023-07-14T13:10:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f27437fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49b80 0x55da15c58f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f2743fff700 1 -- 172.21.15.17:0/2328299802 learned_addr learned my addr 172.21.15.17:0/2328299802 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f2748d9c700 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15c49ff0 0x55da15c52ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f2743fff700 1 -- 172.21.15.17:0/2328299802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15c49ff0 msgr2=0x55da15c52ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f2743fff700 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15c49ff0 0x55da15c52ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f2743fff700 1 -- 172.21.15.17:0/2328299802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49b80 msgr2=0x55da15c58f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f2743fff700 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49b80 0x55da15c58f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f2743fff700 1 -- 172.21.15.17:0/2328299802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274410d210 con 0x55da15aa16b0 2023-07-14T13:10:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f2743fff700 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15aa16b0 0x55da15c58a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2734005b10 tx=0x7f2734005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=431abec29559f727 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.590+0000 7f27237fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:10:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.591+0000 7f27237fe700 1 -- 172.21.15.17:0/2328299802 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734003b70 con 0x55da15aa16b0 2023-07-14T13:10:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.591+0000 7f27237fe700 1 -- 172.21.15.17:0/2328299802 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f2734003cd0 con 0x55da15aa16b0 2023-07-14T13:10:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.591+0000 7f275e07ab80 1 -- 172.21.15.17:0/2328299802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da15af0490 con 0x55da15aa16b0 2023-07-14T13:10:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.591+0000 7f27237fe700 1 -- 172.21.15.17:0/2328299802 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f273400bdc0 con 0x55da15aa16b0 2023-07-14T13:10:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.591+0000 7f275e07ab80 10 client.27109 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.591+0000 7f275e07ab80 1 -- 172.21.15.17:0/2328299802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55da159adc00 con 0x55da15aa16b0 2023-07-14T13:10:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.591+0000 7f27237fe700 1 -- 172.21.15.17:0/2328299802 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55da15af0490 con 0x55da15aa16b0 2023-07-14T13:10:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.592+0000 7f27237fe700 1 -- 172.21.15.17:0/2328299802 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f273400f460 con 0x55da15aa16b0 2023-07-14T13:10:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.592+0000 7f275e07ab80 10 client.27109 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.592+0000 7f275e07ab80 10 client.27109 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.592+0000 7f275e07ab80 20 client.27109 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.592+0000 7f275e07ab80 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55da15c629d0 0x55da15c64db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.592+0000 7f275e07ab80 4 client.27109 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:10:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.592+0000 7f275e07ab80 1 -- 172.21.15.17:0/2328299802 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da15b8fe50 con 0x55da15c629d0 2023-07-14T13:10:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.592+0000 7f27437fe700 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55da15c629d0 0x55da15c64db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.593+0000 7f27437fe700 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55da15c629d0 0x55da15c64db0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b805c4d425666ce1 server_cookie=10759400ecbcf35 in_seq=0 out_seq=0 2023-07-14T13:10:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.593+0000 7f27237fe700 10 client.27109 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f27237fe700 1 -- 172.21.15.17:0/2328299802 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55da15b8fe50 con 0x55da15c629d0 2023-07-14T13:10:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f27237fe700 10 client.27109 handle_command_reply: tid=0 2023-07-14T13:10:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 1 client.27109 shutdown 2023-07-14T13:10:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 1 -- 172.21.15.17:0/2328299802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15aa16b0 msgr2=0x55da15c58a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15aa16b0 0x55da15c58a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2734005b10 tx=0x7f2734005740 comp rx=0 tx=0).stop 2023-07-14T13:10:09.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 1 -- 172.21.15.17:0/2328299802 shutdown_connections 2023-07-14T13:10:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55da15c629d0 0x55da15c64db0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15c49ff0 0x55da15c52ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15aa16b0 0x55da15c58a50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f27237fe700 0 client.27109 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 1 --2- 172.21.15.17:0/2328299802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49b80 0x55da15c58f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 1 -- 172.21.15.17:0/2328299802 >> 172.21.15.17:0/2328299802 conn(0x55da15c3abe0 msgr2=0x55da15c3f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 1 -- 172.21.15.17:0/2328299802 shutdown_connections 2023-07-14T13:10:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 1 -- 172.21.15.17:0/2328299802 wait complete. 2023-07-14T13:10:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.594+0000 7f275e07ab80 20 client.27109 trim_cache size 0 max 16384 2023-07-14T13:10:09.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.612+0000 7f275e07ab80 1 Processor -- start 2023-07-14T13:10:09.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.612+0000 7f275e07ab80 1 -- start start 2023-07-14T13:10:09.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.612+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c52dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.612+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 0x55da15c44740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.612+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49ff0 0x55da15c3fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.612+0000 7f275e07ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15c54280 con 0x55da15c49ff0 2023-07-14T13:10:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.612+0000 7f275e07ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15c37bb0 con 0x55da15aa16b0 2023-07-14T13:10:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.612+0000 7f275e07ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15c51200 con 0x55da15c49b80 2023-07-14T13:10:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f2748d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49ff0 0x55da15c3fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f27437fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 0x55da15c44740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f27437fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 0x55da15c44740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41930/0 (socket says 172.21.15.17:41930) 2023-07-14T13:10:09.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f2748d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49ff0 0x55da15c3fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53678/0 (socket says 172.21.15.17:53678) 2023-07-14T13:10:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f27437fe700 1 -- 172.21.15.17:0/3844051785 learned_addr learned my addr 172.21.15.17:0/3844051785 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f2743fff700 1 --2- 172.21.15.17:0/3844051785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c52dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f27437fe700 1 -- 172.21.15.17:0/3844051785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 msgr2=0x55da15c52dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f27437fe700 1 --2- 172.21.15.17:0/3844051785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c52dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f27437fe700 1 -- 172.21.15.17:0/3844051785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49ff0 msgr2=0x55da15c3fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f27437fe700 1 --2- 172.21.15.17:0/3844051785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49ff0 0x55da15c3fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f27437fe700 1 -- 172.21.15.17:0/3844051785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da159eb1f0 con 0x55da15c49b80 2023-07-14T13:10:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f27437fe700 1 --2- 172.21.15.17:0/3844051785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 0x55da15c44740 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f273809a170 tx=0x7f273806d300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d73c943a376035ae server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.613+0000 7f272affd700 1 -- 172.21.15.17:0/3844051785 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380044f0 con 0x55da15c49b80 2023-07-14T13:10:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.614+0000 7f272affd700 1 -- 172.21.15.17:0/3844051785 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f273809a1e0 con 0x55da15c49b80 2023-07-14T13:10:09.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.614+0000 7f272affd700 1 -- 172.21.15.17:0/3844051785 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380986a0 con 0x55da15c49b80 2023-07-14T13:10:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.614+0000 7f275e07ab80 1 -- 172.21.15.17:0/3844051785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 msgr2=0x55da15c44740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.614+0000 7f275e07ab80 1 --2- 172.21.15.17:0/3844051785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 0x55da15c44740 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f273809a170 tx=0x7f273806d300 comp rx=0 tx=0).stop 2023-07-14T13:10:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.614+0000 7f275e07ab80 1 -- 172.21.15.17:0/3844051785 shutdown_connections 2023-07-14T13:10:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.614+0000 7f275e07ab80 1 --2- 172.21.15.17:0/3844051785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49ff0 0x55da15c3fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.614+0000 7f275e07ab80 1 --2- 172.21.15.17:0/3844051785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c52dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.614+0000 7f275e07ab80 1 --2- 172.21.15.17:0/3844051785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49b80 0x55da15c44740 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.614+0000 7f275e07ab80 1 -- 172.21.15.17:0/3844051785 >> 172.21.15.17:0/3844051785 conn(0x55da15c3abe0 msgr2=0x55da15c44030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:09.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.614+0000 7f275e07ab80 1 -- 172.21.15.17:0/3844051785 shutdown_connections 2023-07-14T13:10:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.614+0000 7f275e07ab80 1 -- 172.21.15.17:0/3844051785 wait complete. 2023-07-14T13:10:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.615+0000 7f275e07ab80 1 -- start start 2023-07-14T13:10:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.615+0000 7f275e07ab80 1 Processor -- start 2023-07-14T13:10:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c58a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49b80 0x55da15c58f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f275e07ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49ff0 0x55da15c56f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f275e07ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15c575d0 con 0x55da15c49b80 2023-07-14T13:10:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f275e07ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15c57740 con 0x55da15aa16b0 2023-07-14T13:10:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f275e07ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da15c57900 con 0x55da15c49ff0 2023-07-14T13:10:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f275e07ab80 10 client.0 _ll_register_callbacks cb 0x7f2734009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f2748d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49ff0 0x55da15c56f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f2748d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49ff0 0x55da15c56f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41940/0 (socket says 172.21.15.17:41940) 2023-07-14T13:10:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f2748d9c700 1 -- 172.21.15.17:0/1110026371 learned_addr learned my addr 172.21.15.17:0/1110026371 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f2743fff700 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c58a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f27437fe700 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49b80 0x55da15c58f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f2748d9c700 1 -- 172.21.15.17:0/1110026371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 msgr2=0x55da15c58a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f2748d9c700 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c58a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f2748d9c700 1 -- 172.21.15.17:0/1110026371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49b80 msgr2=0x55da15c58f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f2748d9c700 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49b80 0x55da15c58f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.616+0000 7f2748d9c700 1 -- 172.21.15.17:0/1110026371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27340095f0 con 0x55da15c49ff0 2023-07-14T13:10:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.617+0000 7f27437fe700 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49b80 0x55da15c58f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.617+0000 7f2748d9c700 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49ff0 0x55da15c56f00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f273c007f00 tx=0x7f273c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=586aa467a0f61f5b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.617+0000 7f27237fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:10:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.617+0000 7f27237fe700 1 -- 172.21.15.17:0/1110026371 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c01c040 con 0x55da15c49ff0 2023-07-14T13:10:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.617+0000 7f27237fe700 1 -- 172.21.15.17:0/1110026371 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f273c017de0 con 0x55da15c49ff0 2023-07-14T13:10:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.617+0000 7f275e07ab80 1 -- 172.21.15.17:0/1110026371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f273401e040 con 0x55da15c49ff0 2023-07-14T13:10:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f27237fe700 1 -- 172.21.15.17:0/1110026371 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f273c00e040 con 0x55da15c49ff0 2023-07-14T13:10:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f275e07ab80 10 client.27115 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f275e07ab80 1 -- 172.21.15.17:0/1110026371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55da159c3250 con 0x55da15c49ff0 2023-07-14T13:10:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f27237fe700 1 -- 172.21.15.17:0/1110026371 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f273401e040 con 0x55da15c49ff0 2023-07-14T13:10:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f27237fe700 1 -- 172.21.15.17:0/1110026371 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f273c022070 con 0x55da15c49ff0 2023-07-14T13:10:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f275e07ab80 10 client.27115 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f275e07ab80 10 client.27115 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f275e07ab80 20 client.27115 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f275e07ab80 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55da15c629d0 0x55da15cb9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f275e07ab80 4 client.27115 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:10:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f275e07ab80 1 -- 172.21.15.17:0/1110026371 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55da15b51ff0 con 0x55da15c629d0 2023-07-14T13:10:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.618+0000 7f2743fff700 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55da15c629d0 0x55da15cb9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.619+0000 7f2743fff700 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55da15c629d0 0x55da15cb9b80 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be20f6a153bebf66 server_cookie=d147a81c29bfd00 in_seq=0 out_seq=0 2023-07-14T13:10:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.619+0000 7f27237fe700 10 client.27115 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f27237fe700 1 -- 172.21.15.17:0/1110026371 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55da15b51ff0 con 0x55da15c629d0 2023-07-14T13:10:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f27237fe700 10 client.27115 handle_command_reply: tid=0 2023-07-14T13:10:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 1 client.27115 shutdown 2023-07-14T13:10:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 1 -- 172.21.15.17:0/1110026371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49ff0 msgr2=0x55da15c56f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49ff0 0x55da15c56f00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f273c007f00 tx=0x7f273c00b040 comp rx=0 tx=0).stop 2023-07-14T13:10:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 1 -- 172.21.15.17:0/1110026371 shutdown_connections 2023-07-14T13:10:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55da15c629d0 0x55da15cb9b80 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da15c49ff0 0x55da15c56f00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da15aa16b0 0x55da15c58a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 1 --2- 172.21.15.17:0/1110026371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55da15c49b80 0x55da15c58f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f27237fe700 0 client.27115 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 1 -- 172.21.15.17:0/1110026371 >> 172.21.15.17:0/1110026371 conn(0x55da15c3abe0 msgr2=0x55da15c51450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 1 -- 172.21.15.17:0/1110026371 shutdown_connections 2023-07-14T13:10:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 1 -- 172.21.15.17:0/1110026371 wait complete. 2023-07-14T13:10:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.632+0000 7f275e07ab80 20 client.27115 trim_cache size 0 max 16384 2023-07-14T13:10:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:10:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:10:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:10:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:10:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 -- 172.21.15.17:0/1546023951 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f272c0a1340 msgr2=0x7f272c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f272c0a1340 0x7f272c0a37f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f273c0091e0 tx=0x7f273c004ad0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 -- 172.21.15.17:0/1546023951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27440685b0 msgr2=0x7f274419c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27440685b0 0x7f274419c010 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2744068980 tx=0x7f273800eca0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 -- 172.21.15.17:0/1546023951 shutdown_connections 2023-07-14T13:10:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f272c0a1340 0x7f272c0a37f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2744104e50 0x7f2744195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2744067c10 0x7f274419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 --2- 172.21.15.17:0/1546023951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27440685b0 0x7f274419c010 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 -- 172.21.15.17:0/1546023951 >> 172.21.15.17:0/1546023951 conn(0x7f2744074760 msgr2=0x7f27440fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 -- 172.21.15.17:0/1546023951 shutdown_connections 2023-07-14T13:10:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:09.633+0000 7f274a7ff700 1 -- 172.21.15.17:0/1546023951 wait complete. 2023-07-14T13:10:09.949 INFO:teuthology.orchestra.run.smithi017.stderr:41000000 of 50000000 tuples (82%) done (elapsed 599.55 s, remaining 131.61 s) 2023-07-14T13:10:10.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: pgmap v325: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 95 op/s 2023-07-14T13:10:10.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:10 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: pgmap v325: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 95 op/s 2023-07-14T13:10:10.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:10 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:10.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: pgmap v325: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 95 op/s 2023-07-14T13:10:10.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:10.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:10 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.468 INFO:teuthology.orchestra.run.smithi017.stderr:41100000 of 50000000 tuples (82%) done (elapsed 601.07 s, remaining 130.16 s) 2023-07-14T13:10:11.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T13:10:11.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:10:11.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T13:10:11.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T13:10:11.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T13:10:11.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:10:11.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:10:11.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:10:11.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:11.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:11 smithi017 ceph-mon[95536]: osdmap e99: 12 total, 12 up, 12 in 2023-07-14T13:10:11.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T13:10:11.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:10:11.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T13:10:11.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T13:10:11.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T13:10:11.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:10:11.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:10:11.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:10:11.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:11.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:11 smithi135 ceph-mon[97338]: osdmap e99: 12 total, 12 up, 12 in 2023-07-14T13:10:11.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T13:10:11.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:10:11.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:10:11.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T13:10:11.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T13:10:11.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T13:10:11.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:10:11.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:10:11.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:10:11.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:10:11.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:11 smithi131 ceph-mon[96953]: osdmap e99: 12 total, 12 up, 12 in 2023-07-14T13:10:12.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:12 smithi135 ceph-mon[97338]: pgmap v327: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 32 MiB/s wr, 119 op/s 2023-07-14T13:10:12.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:12 smithi131 ceph-mon[96953]: pgmap v327: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 32 MiB/s wr, 119 op/s 2023-07-14T13:10:12.860 INFO:teuthology.orchestra.run.smithi017.stderr:41200000 of 50000000 tuples (82%) done (elapsed 602.46 s, remaining 128.68 s) 2023-07-14T13:10:12.862 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:12 smithi017 ceph-mon[95536]: pgmap v327: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 32 MiB/s wr, 119 op/s 2023-07-14T13:10:14.149 INFO:teuthology.orchestra.run.smithi017.stderr:41300000 of 50000000 tuples (82%) done (elapsed 603.75 s, remaining 127.18 s) 2023-07-14T13:10:15.362 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:15 smithi017 ceph-mon[95536]: pgmap v328: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 96 op/s 2023-07-14T13:10:15.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:15 smithi135 ceph-mon[97338]: pgmap v328: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 96 op/s 2023-07-14T13:10:15.502 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:15 smithi131 ceph-mon[96953]: pgmap v328: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 26 MiB/s wr, 96 op/s 2023-07-14T13:10:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:41400000 of 50000000 tuples (82%) done (elapsed 605.63 s, remaining 125.81 s) 2023-07-14T13:10:17.325 INFO:teuthology.orchestra.run.smithi017.stderr:41500000 of 50000000 tuples (83%) done (elapsed 606.92 s, remaining 124.31 s) 2023-07-14T13:10:17.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:17 smithi135 ceph-mon[97338]: pgmap v329: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-07-14T13:10:17.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:17 smithi131 ceph-mon[96953]: pgmap v329: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-07-14T13:10:17.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:17 smithi017 ceph-mon[95536]: pgmap v329: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-07-14T13:10:19.209 INFO:teuthology.orchestra.run.smithi017.stderr:41600000 of 50000000 tuples (83%) done (elapsed 608.81 s, remaining 122.93 s) 2023-07-14T13:10:19.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:19 smithi135 ceph-mon[97338]: pgmap v330: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-07-14T13:10:19.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:19 smithi131 ceph-mon[96953]: pgmap v330: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-07-14T13:10:19.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:19 smithi017 ceph-mon[95536]: pgmap v330: 97 pgs: 97 active+clean; 8.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-07-14T13:10:21.088 INFO:teuthology.orchestra.run.smithi017.stderr:41700000 of 50000000 tuples (83%) done (elapsed 610.69 s, remaining 121.55 s) 2023-07-14T13:10:21.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:21 smithi135 ceph-mon[97338]: pgmap v331: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 27 MiB/s wr, 43 op/s 2023-07-14T13:10:21.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:21 smithi131 ceph-mon[96953]: pgmap v331: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 27 MiB/s wr, 43 op/s 2023-07-14T13:10:21.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:21 smithi017 ceph-mon[95536]: pgmap v331: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 27 MiB/s wr, 43 op/s 2023-07-14T13:10:22.559 INFO:teuthology.orchestra.run.smithi017.stderr:41800000 of 50000000 tuples (83%) done (elapsed 612.16 s, remaining 120.09 s) 2023-07-14T13:10:22.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.799+0000 7f607639d700 1 -- 172.21.15.17:0/1575462895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070073140 msgr2=0x7f607010bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:22.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.799+0000 7f607639d700 1 --2- 172.21.15.17:0/1575462895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070073140 0x7f607010bcd0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f60600098f0 tx=0x7f6060009c00 comp rx=0 tx=0).stop 2023-07-14T13:10:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.800+0000 7f607639d700 1 -- 172.21.15.17:0/1575462895 shutdown_connections 2023-07-14T13:10:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.800+0000 7f607639d700 1 --2- 172.21.15.17:0/1575462895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f607010c210 0x7f607010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.800+0000 7f607639d700 1 --2- 172.21.15.17:0/1575462895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6070072830 0x7f6070072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.800+0000 7f607639d700 1 --2- 172.21.15.17:0/1575462895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070073140 0x7f607010bcd0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.800+0000 7f607639d700 1 -- 172.21.15.17:0/1575462895 >> 172.21.15.17:0/1575462895 conn(0x7f60700fb470 msgr2=0x7f60700fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.800+0000 7f607639d700 1 -- 172.21.15.17:0/1575462895 shutdown_connections 2023-07-14T13:10:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.800+0000 7f607639d700 1 -- 172.21.15.17:0/1575462895 wait complete. 2023-07-14T13:10:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.801+0000 7f607639d700 1 Processor -- start 2023-07-14T13:10:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.801+0000 7f607639d700 1 -- start start 2023-07-14T13:10:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.801+0000 7f607639d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070072830 0x7f607019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.801+0000 7f607639d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6070073140 0x7f607019ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.801+0000 7f607639d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f607010c210 0x7f6070197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.801+0000 7f607639d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6070198070 con 0x7f6070072830 2023-07-14T13:10:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.801+0000 7f607639d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60701981e0 con 0x7f6070073140 2023-07-14T13:10:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.801+0000 7f607639d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60701983a0 con 0x7f607010c210 2023-07-14T13:10:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.802+0000 7f607539b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070072830 0x7f607019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.802+0000 7f6075b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f607010c210 0x7f6070197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.802+0000 7f607539b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070072830 0x7f607019d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48724/0 (socket says 172.21.15.17:48724) 2023-07-14T13:10:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.802+0000 7f6074b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6070073140 0x7f607019ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.802+0000 7f607539b700 1 -- 172.21.15.17:0/1871712734 learned_addr learned my addr 172.21.15.17:0/1871712734 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.802+0000 7f6075b9c700 1 -- 172.21.15.17:0/1871712734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6070073140 msgr2=0x7f607019ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.802+0000 7f6075b9c700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6070073140 0x7f607019ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.802+0000 7f6075b9c700 1 -- 172.21.15.17:0/1871712734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070072830 msgr2=0x7f607019d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.802+0000 7f6075b9c700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070072830 0x7f607019d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.802+0000 7f6075b9c700 1 -- 172.21.15.17:0/1871712734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6060009520 con 0x7f607010c210 2023-07-14T13:10:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.802+0000 7f607539b700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070072830 0x7f607019d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.803+0000 7f6075b9c700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f607010c210 0x7f6070197a00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f606800efc0 tx=0x7f606800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.803+0000 7f60667fc700 1 -- 172.21.15.17:0/1871712734 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068018070 con 0x7f607010c210 2023-07-14T13:10:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.803+0000 7f607639d700 1 -- 172.21.15.17:0/1871712734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6070198620 con 0x7f607010c210 2023-07-14T13:10:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.803+0000 7f60667fc700 1 -- 172.21.15.17:0/1871712734 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f606800f040 con 0x7f607010c210 2023-07-14T13:10:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.803+0000 7f60667fc700 1 -- 172.21.15.17:0/1871712734 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800cba0 con 0x7f607010c210 2023-07-14T13:10:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.803+0000 7f607639d700 1 -- 172.21.15.17:0/1871712734 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60701a4980 con 0x7f607010c210 2023-07-14T13:10:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.807+0000 7f60667fc700 1 -- 172.21.15.17:0/1871712734 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6068003a00 con 0x7f607010c210 2023-07-14T13:10:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.808+0000 7f608af07b80 1 Processor -- start 2023-07-14T13:10:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.808+0000 7f608af07b80 1 -- start start 2023-07-14T13:10:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.808+0000 7f608af07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4bd5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.808+0000 7f608af07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.808+0000 7f608af07b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bd0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.808+0000 7f608af07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f4ad5c50 con 0x55f7f4bd6470 2023-07-14T13:10:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.808+0000 7f608af07b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f4b289e0 con 0x55f7f4bd68c0 2023-07-14T13:10:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.808+0000 7f608af07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f4b21e70 con 0x55f7f4a2c6b0 2023-07-14T13:10:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f6074b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4bd5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f607539b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f6074b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4bd5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44132/0 (socket says 172.21.15.17:44132) 2023-07-14T13:10:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f6074b9a700 1 -- 172.21.15.17:0/2281857322 learned_addr learned my addr 172.21.15.17:0/2281857322 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f6074b9a700 1 --2- 172.21.15.17:0/2281857322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bd0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f607539b700 1 -- 172.21.15.17:0/2281857322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 msgr2=0x55f7f4bd5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f607539b700 1 --2- 172.21.15.17:0/2281857322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4bd5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f607539b700 1 -- 172.21.15.17:0/2281857322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd68c0 msgr2=0x55f7f4bd0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f607539b700 1 --2- 172.21.15.17:0/2281857322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bd0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f607539b700 1 -- 172.21.15.17:0/2281857322 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7f494fd80 con 0x55f7f4bd6470 2023-07-14T13:10:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f607539b700 1 --2- 172.21.15.17:0/2281857322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd01a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f606c011570 tx=0x7f606c011880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387b5881f1f2d8d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.809+0000 7f60667fc700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f605c0a12c0 0x7f605c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.810+0000 7f60667fc700 1 -- 172.21.15.17:0/1871712734 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f60680cc5c0 con 0x7f607010c210 2023-07-14T13:10:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.810+0000 7f605b7fe700 1 -- 172.21.15.17:0/2281857322 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c004230 con 0x55f7f4bd6470 2023-07-14T13:10:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.810+0000 7f6074b9a700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f605c0a12c0 0x7f605c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.810+0000 7f605b7fe700 1 -- 172.21.15.17:0/2281857322 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f606c004390 con 0x55f7f4bd6470 2023-07-14T13:10:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.810+0000 7f605b7fe700 1 -- 172.21.15.17:0/2281857322 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c019790 con 0x55f7f4bd6470 2023-07-14T13:10:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.811+0000 7f6074b9a700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f605c0a12c0 0x7f605c0a3770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55f7f4bd6cd0 tx=0x7f6060005dc0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.811+0000 7f608af07b80 1 -- 172.21.15.17:0/2281857322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd6470 msgr2=0x55f7f4bd01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.811+0000 7f608af07b80 1 --2- 172.21.15.17:0/2281857322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd01a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f606c011570 tx=0x7f606c011880 comp rx=0 tx=0).stop 2023-07-14T13:10:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.811+0000 7f608af07b80 1 -- 172.21.15.17:0/2281857322 shutdown_connections 2023-07-14T13:10:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.811+0000 7f608af07b80 1 --2- 172.21.15.17:0/2281857322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bd0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.811+0000 7f608af07b80 1 --2- 172.21.15.17:0/2281857322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4bd5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.811+0000 7f608af07b80 1 --2- 172.21.15.17:0/2281857322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd01a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.811+0000 7f608af07b80 1 -- 172.21.15.17:0/2281857322 >> 172.21.15.17:0/2281857322 conn(0x55f7f4bc5d40 msgr2=0x55f7f4bcb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.811+0000 7f608af07b80 1 -- 172.21.15.17:0/2281857322 shutdown_connections 2023-07-14T13:10:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.811+0000 7f608af07b80 1 -- 172.21.15.17:0/2281857322 wait complete. 2023-07-14T13:10:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.812+0000 7f608af07b80 1 -- start start 2023-07-14T13:10:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.812+0000 7f608af07b80 1 Processor -- start 2023-07-14T13:10:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.813+0000 7f608af07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4bdc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.813+0000 7f608af07b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.813+0000 7f608af07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bda070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.813+0000 7f608af07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f4ac1a60 con 0x55f7f4bd68c0 2023-07-14T13:10:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.813+0000 7f608af07b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f4ac1760 con 0x55f7f4bd6470 2023-07-14T13:10:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.813+0000 7f608af07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f49a58c0 con 0x55f7f4a2c6b0 2023-07-14T13:10:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.813+0000 7f608af07b80 10 client.0 _ll_register_callbacks cb 0x55f7f4abf700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.813+0000 7f6074b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.813+0000 7f6074b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:50728/0 (socket says 172.21.15.17:50728) 2023-07-14T13:10:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.813+0000 7f6074b9a700 1 -- 172.21.15.17:0/3610450741 learned_addr learned my addr 172.21.15.17:0/3610450741 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.814+0000 7f6075b9c700 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bda070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.814+0000 7f607539b700 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4bdc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.814+0000 7f6074b9a700 1 -- 172.21.15.17:0/3610450741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 msgr2=0x55f7f4bdc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.814+0000 7f6074b9a700 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4bdc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.814+0000 7f6074b9a700 1 -- 172.21.15.17:0/3610450741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 msgr2=0x55f7f4bda070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:22.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.814+0000 7f6074b9a700 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bda070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.814+0000 7f6074b9a700 1 -- 172.21.15.17:0/3610450741 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606c009d90 con 0x55f7f4bd6470 2023-07-14T13:10:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.814+0000 7f6074b9a700 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd9a40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f60600098f0 tx=0x7f6060009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2504a09211ac5b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:22.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.814+0000 7f6058ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:10:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.815+0000 7f6058ff9700 1 -- 172.21.15.17:0/3610450741 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606002e070 con 0x55f7f4bd6470 2023-07-14T13:10:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.815+0000 7f6058ff9700 1 -- 172.21.15.17:0/3610450741 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6060005490 con 0x55f7f4bd6470 2023-07-14T13:10:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.815+0000 7f608af07b80 1 -- 172.21.15.17:0/3610450741 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7f4a7b490 con 0x55f7f4bd6470 2023-07-14T13:10:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.815+0000 7f6058ff9700 1 -- 172.21.15.17:0/3610450741 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6060005650 con 0x55f7f4bd6470 2023-07-14T13:10:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.815+0000 7f608af07b80 10 client.27152 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.815+0000 7f608af07b80 1 -- 172.21.15.17:0/3610450741 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f7f4938c00 con 0x55f7f4bd6470 2023-07-14T13:10:22.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.815+0000 7f6058ff9700 1 -- 172.21.15.17:0/3610450741 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f7f4a7b490 con 0x55f7f4bd6470 2023-07-14T13:10:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.816+0000 7f6058ff9700 1 -- 172.21.15.17:0/3610450741 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f6060003a00 con 0x55f7f4bd6470 2023-07-14T13:10:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.816+0000 7f608af07b80 10 client.27152 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.816+0000 7f608af07b80 10 client.27152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.816+0000 7f608af07b80 20 client.27152 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.816+0000 7f608af07b80 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7f4be9cc0 0x55f7f4bec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.816+0000 7f608af07b80 4 client.27152 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:10:22.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.816+0000 7f608af07b80 1 -- 172.21.15.17:0/3610450741 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7f4b1ae50 con 0x55f7f4be9cc0 2023-07-14T13:10:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.816+0000 7f607539b700 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7f4be9cc0 0x55f7f4bec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.817+0000 7f607539b700 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7f4be9cc0 0x55f7f4bec0d0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6055d81dc69557a server_cookie=c9d319a9dd2ac8a7 in_seq=0 out_seq=0 2023-07-14T13:10:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.817+0000 7f6058ff9700 10 client.27152 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.817+0000 7f6058ff9700 1 -- 172.21.15.17:0/3610450741 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f7f4b1ae50 con 0x55f7f4be9cc0 2023-07-14T13:10:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.817+0000 7f6058ff9700 10 client.27152 handle_command_reply: tid=0 2023-07-14T13:10:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.817+0000 7f608af07b80 1 client.27152 shutdown 2023-07-14T13:10:22.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.818+0000 7f608af07b80 1 -- 172.21.15.17:0/3610450741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 msgr2=0x55f7f4bd9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.818+0000 7f608af07b80 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd9a40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f60600098f0 tx=0x7f6060009260 comp rx=0 tx=0).stop 2023-07-14T13:10:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.818+0000 7f608af07b80 1 -- 172.21.15.17:0/3610450741 shutdown_connections 2023-07-14T13:10:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.818+0000 7f608af07b80 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7f4be9cc0 0x55f7f4bec0d0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.818+0000 7f608af07b80 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bda070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.818+0000 7f608af07b80 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4bdc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.818+0000 7f608af07b80 1 --2- 172.21.15.17:0/3610450741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd9a40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.818+0000 7f6058ff9700 0 client.27152 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.818+0000 7f608af07b80 1 -- 172.21.15.17:0/3610450741 >> 172.21.15.17:0/3610450741 conn(0x55f7f4bc5d40 msgr2=0x55f7f4bca640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.818+0000 7f608af07b80 1 -- 172.21.15.17:0/3610450741 shutdown_connections 2023-07-14T13:10:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.818+0000 7f608af07b80 1 -- 172.21.15.17:0/3610450741 wait complete. 2023-07-14T13:10:22.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.819+0000 7f608af07b80 20 client.27152 trim_cache size 0 max 16384 2023-07-14T13:10:22.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.840+0000 7f608af07b80 1 Processor -- start 2023-07-14T13:10:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.840+0000 7f608af07b80 1 -- start start 2023-07-14T13:10:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.841+0000 7f608af07b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4be0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.841+0000 7f608af07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.841+0000 7f608af07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bdc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.841+0000 7f608af07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f4bd0230 con 0x55f7f4bd68c0 2023-07-14T13:10:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.841+0000 7f608af07b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f4bd0d00 con 0x55f7f4a2c6b0 2023-07-14T13:10:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.841+0000 7f608af07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f4bd7fc0 con 0x55f7f4bd6470 2023-07-14T13:10:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.841+0000 7f6074b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.841+0000 7f6074b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44150/0 (socket says 172.21.15.17:44150) 2023-07-14T13:10:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.841+0000 7f607539b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4be0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.841+0000 7f6074b9a700 1 -- 172.21.15.17:0/2433881102 learned_addr learned my addr 172.21.15.17:0/2433881102 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.841+0000 7f6075b9c700 1 --2- 172.21.15.17:0/2433881102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bdc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.842+0000 7f6074b9a700 1 -- 172.21.15.17:0/2433881102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4a2c6b0 msgr2=0x55f7f4be0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.842+0000 7f6074b9a700 1 --2- 172.21.15.17:0/2433881102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4be0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.842+0000 7f6074b9a700 1 -- 172.21.15.17:0/2433881102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 msgr2=0x55f7f4bdc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.842+0000 7f6074b9a700 1 --2- 172.21.15.17:0/2433881102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bdc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.842+0000 7f6074b9a700 1 -- 172.21.15.17:0/2433881102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7f49761f0 con 0x55f7f4bd6470 2023-07-14T13:10:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.842+0000 7f6074b9a700 1 --2- 172.21.15.17:0/2433881102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd5250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6060009810 tx=0x7f606000fc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd2208de1664419b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.842+0000 7f605bfff700 1 -- 172.21.15.17:0/2433881102 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606002e040 con 0x55f7f4bd6470 2023-07-14T13:10:22.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.842+0000 7f605bfff700 1 -- 172.21.15.17:0/2433881102 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6060003680 con 0x55f7f4bd6470 2023-07-14T13:10:22.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.842+0000 7f605bfff700 1 -- 172.21.15.17:0/2433881102 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606000b940 con 0x55f7f4bd6470 2023-07-14T13:10:22.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.843+0000 7f608af07b80 1 -- 172.21.15.17:0/2433881102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4bd6470 msgr2=0x55f7f4bd5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:22.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.843+0000 7f608af07b80 1 --2- 172.21.15.17:0/2433881102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd5250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6060009810 tx=0x7f606000fc20 comp rx=0 tx=0).stop 2023-07-14T13:10:22.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.843+0000 7f608af07b80 1 -- 172.21.15.17:0/2433881102 shutdown_connections 2023-07-14T13:10:22.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.843+0000 7f608af07b80 1 --2- 172.21.15.17:0/2433881102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bdc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.843+0000 7f608af07b80 1 --2- 172.21.15.17:0/2433881102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4be0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.843+0000 7f608af07b80 1 --2- 172.21.15.17:0/2433881102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd5250 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.843+0000 7f608af07b80 1 -- 172.21.15.17:0/2433881102 >> 172.21.15.17:0/2433881102 conn(0x55f7f4bc5d40 msgr2=0x55f7f4bd4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.844+0000 7f608af07b80 1 -- 172.21.15.17:0/2433881102 shutdown_connections 2023-07-14T13:10:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.844+0000 7f608af07b80 1 -- 172.21.15.17:0/2433881102 wait complete. 2023-07-14T13:10:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.844+0000 7f608af07b80 1 -- start start 2023-07-14T13:10:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.844+0000 7f608af07b80 1 Processor -- start 2023-07-14T13:10:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.845+0000 7f608af07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4be0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.845+0000 7f608af07b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.845+0000 7f608af07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bd1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.845+0000 7f608af07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f4bd24f0 con 0x55f7f4bd68c0 2023-07-14T13:10:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.845+0000 7f608af07b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f4bd2660 con 0x55f7f4bd6470 2023-07-14T13:10:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.845+0000 7f608af07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f4bd2820 con 0x55f7f4a2c6b0 2023-07-14T13:10:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.845+0000 7f608af07b80 10 client.0 _ll_register_callbacks cb 0x55f7f4abf700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.845+0000 7f607539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4be0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.845+0000 7f6075b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bd1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.845+0000 7f6075b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bd1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48764/0 (socket says 172.21.15.17:48764) 2023-07-14T13:10:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.845+0000 7f6075b9c700 1 -- 172.21.15.17:0/2135235620 learned_addr learned my addr 172.21.15.17:0/2135235620 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.846+0000 7f6074b9a700 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.846+0000 7f6075b9c700 1 -- 172.21.15.17:0/2135235620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 msgr2=0x55f7f4be0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.846+0000 7f6075b9c700 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4be0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.846+0000 7f6075b9c700 1 -- 172.21.15.17:0/2135235620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 msgr2=0x55f7f4bd1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.846+0000 7f6075b9c700 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.846+0000 7f6075b9c700 1 -- 172.21.15.17:0/2135235620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7f4938c00 con 0x55f7f4bd68c0 2023-07-14T13:10:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.846+0000 7f6075b9c700 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bd1fb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f606800ef90 tx=0x7f6068099040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab5a2d72ad8c9a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.846+0000 7f6058ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:10:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.846+0000 7f6058ff9700 1 -- 172.21.15.17:0/2135235620 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606809d710 con 0x55f7f4bd68c0 2023-07-14T13:10:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.847+0000 7f6058ff9700 1 -- 172.21.15.17:0/2135235620 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f60680a1aa0 con 0x55f7f4bd68c0 2023-07-14T13:10:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.847+0000 7f608af07b80 1 -- 172.21.15.17:0/2135235620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f606c004390 con 0x55f7f4bd68c0 2023-07-14T13:10:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.847+0000 7f6058ff9700 1 -- 172.21.15.17:0/2135235620 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6068099940 con 0x55f7f4bd68c0 2023-07-14T13:10:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.847+0000 7f608af07b80 10 client.17433 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.847+0000 7f608af07b80 1 -- 172.21.15.17:0/2135235620 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f7f494e250 con 0x55f7f4bd68c0 2023-07-14T13:10:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.847+0000 7f6058ff9700 1 -- 172.21.15.17:0/2135235620 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f606c004390 con 0x55f7f4bd68c0 2023-07-14T13:10:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.847+0000 7f6058ff9700 1 -- 172.21.15.17:0/2135235620 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f60680a1610 con 0x55f7f4bd68c0 2023-07-14T13:10:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.847+0000 7f608af07b80 10 client.17433 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.847+0000 7f608af07b80 10 client.17433 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.847+0000 7f608af07b80 20 client.17433 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.848+0000 7f608af07b80 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7f4c3ef40 0x55f7f4c41350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.848+0000 7f608af07b80 4 client.17433 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:10:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.848+0000 7f608af07b80 1 -- 172.21.15.17:0/2135235620 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f7f4adcff0 con 0x55f7f4c3ef40 2023-07-14T13:10:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.848+0000 7f607539b700 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7f4c3ef40 0x55f7f4c41350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.849+0000 7f607539b700 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7f4c3ef40 0x55f7f4c41350 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8094740f228ac59 server_cookie=7dcb48f06317f04c in_seq=0 out_seq=0 2023-07-14T13:10:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.849+0000 7f6058ff9700 10 client.17433 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f6058ff9700 1 -- 172.21.15.17:0/2135235620 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f7f4adcff0 con 0x55f7f4c3ef40 2023-07-14T13:10:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f6058ff9700 10 client.17433 handle_command_reply: tid=0 2023-07-14T13:10:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f608af07b80 1 client.17433 shutdown 2023-07-14T13:10:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f608af07b80 1 -- 172.21.15.17:0/2135235620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 msgr2=0x55f7f4bd1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f608af07b80 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bd1fb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f606800ef90 tx=0x7f6068099040 comp rx=0 tx=0).stop 2023-07-14T13:10:22.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f608af07b80 1 -- 172.21.15.17:0/2135235620 shutdown_connections 2023-07-14T13:10:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f608af07b80 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7f4c3ef40 0x55f7f4c41350 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f608af07b80 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7f4bd68c0 0x55f7f4bd1fb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f608af07b80 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7f4a2c6b0 0x55f7f4be0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f6058ff9700 0 client.17433 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f608af07b80 1 --2- 172.21.15.17:0/2135235620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7f4bd6470 0x55f7f4bd1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f608af07b80 1 -- 172.21.15.17:0/2135235620 >> 172.21.15.17:0/2135235620 conn(0x55f7f4bc5d40 msgr2=0x55f7f4bd53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f608af07b80 1 -- 172.21.15.17:0/2135235620 shutdown_connections 2023-07-14T13:10:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.868+0000 7f608af07b80 1 -- 172.21.15.17:0/2135235620 wait complete. 2023-07-14T13:10:22.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.869+0000 7f608af07b80 20 client.17433 trim_cache size 0 max 16384 2023-07-14T13:10:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:10:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:10:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:10:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:10:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.869+0000 7f607639d700 1 -- 172.21.15.17:0/1871712734 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f605c0a12c0 msgr2=0x7f605c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.869+0000 7f607639d700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f605c0a12c0 0x7f605c0a3770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55f7f4bd6cd0 tx=0x7f6060005dc0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.870+0000 7f607639d700 1 -- 172.21.15.17:0/1871712734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f607010c210 msgr2=0x7f6070197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.870+0000 7f607639d700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f607010c210 0x7f6070197a00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f606800efc0 tx=0x7f606800c3a0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.870+0000 7f607639d700 1 -- 172.21.15.17:0/1871712734 shutdown_connections 2023-07-14T13:10:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.870+0000 7f607639d700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f605c0a12c0 0x7f605c0a3770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.870+0000 7f607639d700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f607010c210 0x7f6070197a00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.870+0000 7f607639d700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6070072830 0x7f607019d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.870+0000 7f607639d700 1 --2- 172.21.15.17:0/1871712734 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6070073140 0x7f607019ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.870+0000 7f607639d700 1 -- 172.21.15.17:0/1871712734 >> 172.21.15.17:0/1871712734 conn(0x7f60700fb470 msgr2=0x7f607010e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.870+0000 7f607639d700 1 -- 172.21.15.17:0/1871712734 shutdown_connections 2023-07-14T13:10:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:22.870+0000 7f607639d700 1 -- 172.21.15.17:0/1871712734 wait complete. 2023-07-14T13:10:23.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:23 smithi135 ceph-mon[97338]: pgmap v332: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 40 op/s 2023-07-14T13:10:23.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:23 smithi131 ceph-mon[96953]: pgmap v332: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 40 op/s 2023-07-14T13:10:23.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:23 smithi017 ceph-mon[95536]: pgmap v332: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 40 op/s 2023-07-14T13:10:23.853 INFO:teuthology.orchestra.run.smithi017.stderr:41900000 of 50000000 tuples (83%) done (elapsed 613.45 s, remaining 118.59 s) 2023-07-14T13:10:25.190 INFO:teuthology.orchestra.run.smithi017.stderr:42000000 of 50000000 tuples (84%) done (elapsed 614.79 s, remaining 117.10 s) 2023-07-14T13:10:25.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:25 smithi135 ceph-mon[97338]: pgmap v333: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 23 MiB/s wr, 36 op/s 2023-07-14T13:10:25.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:25 smithi131 ceph-mon[96953]: pgmap v333: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 23 MiB/s wr, 36 op/s 2023-07-14T13:10:25.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:25 smithi017 ceph-mon[95536]: pgmap v333: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 23 MiB/s wr, 36 op/s 2023-07-14T13:10:26.526 INFO:teuthology.orchestra.run.smithi017.stderr:42100000 of 50000000 tuples (84%) done (elapsed 616.13 s, remaining 115.62 s) 2023-07-14T13:10:27.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:27 smithi135 ceph-mon[97338]: pgmap v334: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 34 MiB/s wr, 60 op/s 2023-07-14T13:10:27.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:27 smithi131 ceph-mon[96953]: pgmap v334: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 34 MiB/s wr, 60 op/s 2023-07-14T13:10:27.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:27 smithi017 ceph-mon[95536]: pgmap v334: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 34 MiB/s wr, 60 op/s 2023-07-14T13:10:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:42200000 of 50000000 tuples (84%) done (elapsed 617.55 s, remaining 114.14 s) 2023-07-14T13:10:29.271 INFO:teuthology.orchestra.run.smithi017.stderr:42300000 of 50000000 tuples (84%) done (elapsed 618.87 s, remaining 112.65 s) 2023-07-14T13:10:29.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:29 smithi135 ceph-mon[97338]: pgmap v335: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 36 op/s 2023-07-14T13:10:29.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:29 smithi131 ceph-mon[96953]: pgmap v335: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 36 op/s 2023-07-14T13:10:29.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:29 smithi017 ceph-mon[95536]: pgmap v335: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 36 op/s 2023-07-14T13:10:30.606 INFO:teuthology.orchestra.run.smithi017.stderr:42400000 of 50000000 tuples (84%) done (elapsed 620.21 s, remaining 111.17 s) 2023-07-14T13:10:31.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:31 smithi135 ceph-mon[97338]: pgmap v336: 97 pgs: 97 active+clean; 8.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 34 MiB/s wr, 76 op/s 2023-07-14T13:10:31.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:31 smithi131 ceph-mon[96953]: pgmap v336: 97 pgs: 97 active+clean; 8.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 34 MiB/s wr, 76 op/s 2023-07-14T13:10:31.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:31 smithi017 ceph-mon[95536]: pgmap v336: 97 pgs: 97 active+clean; 8.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 34 MiB/s wr, 76 op/s 2023-07-14T13:10:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:42500000 of 50000000 tuples (85%) done (elapsed 621.65 s, remaining 109.70 s) 2023-07-14T13:10:32.331 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:10:32.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.523+0000 7f1244fff700 1 -- 172.21.15.17:0/1751760316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1240100ca0 msgr2=0x7f1240101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.523+0000 7f1244fff700 1 --2- 172.21.15.17:0/1751760316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1240100ca0 0x7f1240101070 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1230009990 tx=0x7f1230009ca0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.524+0000 7f1244fff700 1 -- 172.21.15.17:0/1751760316 shutdown_connections 2023-07-14T13:10:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.524+0000 7f1244fff700 1 --2- 172.21.15.17:0/1751760316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f124010a070 0x7f124010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.524+0000 7f1244fff700 1 --2- 172.21.15.17:0/1751760316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1240100ca0 0x7f1240101070 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.524+0000 7f1244fff700 1 --2- 172.21.15.17:0/1751760316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12401015b0 0x7f1240109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.524+0000 7f1244fff700 1 -- 172.21.15.17:0/1751760316 >> 172.21.15.17:0/1751760316 conn(0x7f12400fa4b0 msgr2=0x7f12400fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.524+0000 7f1244fff700 1 -- 172.21.15.17:0/1751760316 shutdown_connections 2023-07-14T13:10:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.524+0000 7f1244fff700 1 -- 172.21.15.17:0/1751760316 wait complete. 2023-07-14T13:10:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.526+0000 7f1244fff700 1 Processor -- start 2023-07-14T13:10:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.526+0000 7f1244fff700 1 -- start start 2023-07-14T13:10:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.526+0000 7f1244fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1240100ca0 0x7f124019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.526+0000 7f1244fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12401015b0 0x7f124019be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.526+0000 7f1244fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124010a070 0x7f1240195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.526+0000 7f1244fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240196000 con 0x7f124010a070 2023-07-14T13:10:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.526+0000 7f1244fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240196170 con 0x7f12401015b0 2023-07-14T13:10:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.526+0000 7f1244fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1240196330 con 0x7f1240100ca0 2023-07-14T13:10:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.527+0000 7f123e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1240100ca0 0x7f124019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.527+0000 7f123ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124010a070 0x7f1240195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.527+0000 7f123dd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12401015b0 0x7f124019be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.527+0000 7f123e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1240100ca0 0x7f124019b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60106/0 (socket says 172.21.15.17:60106) 2023-07-14T13:10:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.527+0000 7f123e59c700 1 -- 172.21.15.17:0/3057157723 learned_addr learned my addr 172.21.15.17:0/3057157723 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.527+0000 7f123e59c700 1 -- 172.21.15.17:0/3057157723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12401015b0 msgr2=0x7f124019be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.527+0000 7f123e59c700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12401015b0 0x7f124019be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.527+0000 7f123e59c700 1 -- 172.21.15.17:0/3057157723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124010a070 msgr2=0x7f1240195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.527+0000 7f123e59c700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124010a070 0x7f1240195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.527+0000 7f123e59c700 1 -- 172.21.15.17:0/3057157723 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12300095f0 con 0x7f1240100ca0 2023-07-14T13:10:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.527+0000 7f123ed9d700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124010a070 0x7f1240195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.528+0000 7f123e59c700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1240100ca0 0x7f124019b920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1230000c00 tx=0x7f1230004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.528+0000 7f122f7fe700 1 -- 172.21.15.17:0/3057157723 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123001d070 con 0x7f1240100ca0 2023-07-14T13:10:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.528+0000 7f1244fff700 1 -- 172.21.15.17:0/3057157723 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12401965b0 con 0x7f1240100ca0 2023-07-14T13:10:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.528+0000 7f122f7fe700 1 -- 172.21.15.17:0/3057157723 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1230022470 con 0x7f1240100ca0 2023-07-14T13:10:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.528+0000 7f122f7fe700 1 -- 172.21.15.17:0/3057157723 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230017650 con 0x7f1240100ca0 2023-07-14T13:10:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.528+0000 7f1244fff700 1 -- 172.21.15.17:0/3057157723 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12401a2910 con 0x7f1240100ca0 2023-07-14T13:10:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.533+0000 7f122f7fe700 1 -- 172.21.15.17:0/3057157723 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f12300225e0 con 0x7f1240100ca0 2023-07-14T13:10:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.534+0000 7f1258a10b80 1 Processor -- start 2023-07-14T13:10:32.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.534+0000 7f1258a10b80 1 -- start start 2023-07-14T13:10:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.534+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563103ffa2d0 0x563103ffa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.534+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104005590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.534+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563104005ad0 0x563104007eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.535+0000 7f1258a10b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563103f00cb0 con 0x563103ffa2d0 2023-07-14T13:10:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.535+0000 7f1258a10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563103f53a40 con 0x563103ffabe0 2023-07-14T13:10:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.535+0000 7f1258a10b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563103f4ced0 con 0x563104005ad0 2023-07-14T13:10:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.535+0000 7f123ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563103ffa2d0 0x563103ffa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.535+0000 7f123e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104005590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.535+0000 7f123ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563103ffa2d0 0x563103ffa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54430/0 (socket says 172.21.15.17:54430) 2023-07-14T13:10:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.535+0000 7f123ed9d700 1 -- 172.21.15.17:0/1299897575 learned_addr learned my addr 172.21.15.17:0/1299897575 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.535+0000 7f123dd9b700 1 --2- 172.21.15.17:0/1299897575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563104005ad0 0x563104007eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.535+0000 7f122f7fe700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12280a12c0 0x7f12280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.535+0000 7f123e59c700 1 -- 172.21.15.17:0/1299897575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563104005ad0 msgr2=0x563104007eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.535+0000 7f123e59c700 1 --2- 172.21.15.17:0/1299897575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563104005ad0 0x563104007eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.536+0000 7f122f7fe700 1 -- 172.21.15.17:0/3057157723 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f12300ce0f0 con 0x7f1240100ca0 2023-07-14T13:10:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.536+0000 7f123e59c700 1 -- 172.21.15.17:0/1299897575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563103ffa2d0 msgr2=0x563103ffa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.536+0000 7f123e59c700 1 --2- 172.21.15.17:0/1299897575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563103ffa2d0 0x563103ffa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.536+0000 7f123e59c700 1 -- 172.21.15.17:0/1299897575 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563103d7ade0 con 0x563103ffabe0 2023-07-14T13:10:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.536+0000 7f123ed9d700 1 --2- 172.21.15.17:0/1299897575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563103ffa2d0 0x563103ffa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.536+0000 7f123ed9d700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12280a12c0 0x7f12280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.536+0000 7f123e59c700 1 --2- 172.21.15.17:0/1299897575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104005590 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f12300cb800 tx=0x7f1230009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65e00785969d2dd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.536+0000 7f122cff9700 1 -- 172.21.15.17:0/1299897575 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300a1110 con 0x563103ffabe0 2023-07-14T13:10:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.536+0000 7f122cff9700 1 -- 172.21.15.17:0/1299897575 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f123009afe0 con 0x563103ffabe0 2023-07-14T13:10:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.536+0000 7f122cff9700 1 -- 172.21.15.17:0/1299897575 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300142a0 con 0x563103ffabe0 2023-07-14T13:10:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.537+0000 7f123ed9d700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12280a12c0 0x7f12280a3770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1238009ec0 tx=0x7f1238004ad0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.537+0000 7f1258a10b80 1 -- 172.21.15.17:0/1299897575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 msgr2=0x563104005590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.537+0000 7f1258a10b80 1 --2- 172.21.15.17:0/1299897575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104005590 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f12300cb800 tx=0x7f1230009ca0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.537+0000 7f1258a10b80 1 -- 172.21.15.17:0/1299897575 shutdown_connections 2023-07-14T13:10:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.537+0000 7f1258a10b80 1 --2- 172.21.15.17:0/1299897575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563104005ad0 0x563104007eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.537+0000 7f1258a10b80 1 --2- 172.21.15.17:0/1299897575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563103ffa2d0 0x563103ffa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.537+0000 7f1258a10b80 1 --2- 172.21.15.17:0/1299897575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104005590 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.537+0000 7f1258a10b80 1 -- 172.21.15.17:0/1299897575 >> 172.21.15.17:0/1299897575 conn(0x563103ff0da0 msgr2=0x563103ff66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.537+0000 7f1258a10b80 1 -- 172.21.15.17:0/1299897575 shutdown_connections 2023-07-14T13:10:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.538+0000 7f1258a10b80 1 -- 172.21.15.17:0/1299897575 wait complete. 2023-07-14T13:10:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.538+0000 7f1258a10b80 1 -- start start 2023-07-14T13:10:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.538+0000 7f1258a10b80 1 Processor -- start 2023-07-14T13:10:32.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.539+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffa2d0 0x563104005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.539+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffabe0 0x5631040023d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.539+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104002910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.539+0000 7f1258a10b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563103eecac0 con 0x563104005ad0 2023-07-14T13:10:32.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.539+0000 7f1258a10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563103eec7c0 con 0x563103ffa2d0 2023-07-14T13:10:32.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.539+0000 7f1258a10b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563103dd0920 con 0x563103ffabe0 2023-07-14T13:10:32.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.539+0000 7f1258a10b80 10 client.0 _ll_register_callbacks cb 0x563103eea760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.539+0000 7f123e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffa2d0 0x563104005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.539+0000 7f123e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffa2d0 0x563104005150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44548/0 (socket says 172.21.15.17:44548) 2023-07-14T13:10:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.539+0000 7f123e59c700 1 -- 172.21.15.17:0/1003318803 learned_addr learned my addr 172.21.15.17:0/1003318803 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.539+0000 7f123ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104002910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.540+0000 7f123dd9b700 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffabe0 0x5631040023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.540+0000 7f123e59c700 1 -- 172.21.15.17:0/1003318803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffabe0 msgr2=0x5631040023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:32.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.540+0000 7f123e59c700 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffabe0 0x5631040023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.540+0000 7f123e59c700 1 -- 172.21.15.17:0/1003318803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 msgr2=0x563104002910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.540+0000 7f123e59c700 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104002910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.540+0000 7f123e59c700 1 -- 172.21.15.17:0/1003318803 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1238003bb0 con 0x563103ffa2d0 2023-07-14T13:10:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.540+0000 7f123e59c700 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffa2d0 0x563104005150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f12300a30a0 tx=0x7f12300d19c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0ee2880a394cd08 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.540+0000 7f1225ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:10:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.540+0000 7f1225ffb700 1 -- 172.21.15.17:0/1003318803 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300a1110 con 0x563103ffa2d0 2023-07-14T13:10:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.540+0000 7f1225ffb700 1 -- 172.21.15.17:0/1003318803 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f12300228c0 con 0x563103ffa2d0 2023-07-14T13:10:32.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.540+0000 7f1258a10b80 1 -- 172.21.15.17:0/1003318803 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563103ea64f0 con 0x563103ffa2d0 2023-07-14T13:10:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.541+0000 7f1225ffb700 1 -- 172.21.15.17:0/1003318803 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12300142a0 con 0x563103ffa2d0 2023-07-14T13:10:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.541+0000 7f1258a10b80 10 client.27170 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.541+0000 7f1258a10b80 1 -- 172.21.15.17:0/1003318803 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f12401a2910 con 0x563103ffa2d0 2023-07-14T13:10:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.541+0000 7f1225ffb700 1 -- 172.21.15.17:0/1003318803 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563103ea64f0 con 0x563103ffa2d0 2023-07-14T13:10:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.541+0000 7f1225ffb700 1 -- 172.21.15.17:0/1003318803 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f123009b470 con 0x563103ffa2d0 2023-07-14T13:10:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.541+0000 7f1258a10b80 10 client.27170 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:32.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.541+0000 7f1258a10b80 10 client.27170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.541+0000 7f1258a10b80 20 client.27170 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.541+0000 7f1258a10b80 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563104018f40 0x56310401b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.541+0000 7f1258a10b80 4 client.27170 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:10:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.541+0000 7f1258a10b80 1 -- 172.21.15.17:0/1003318803 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563103f45eb0 con 0x563104018f40 2023-07-14T13:10:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.542+0000 7f123dd9b700 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563104018f40 0x56310401b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.542+0000 7f1225ffb700 10 client.27170 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:32.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.542+0000 7f123dd9b700 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563104018f40 0x56310401b320 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2f1eb74656d1fdc server_cookie=37e89b5030b7d36b in_seq=0 out_seq=0 2023-07-14T13:10:32.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.543+0000 7f1225ffb700 1 -- 172.21.15.17:0/1003318803 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563103f45eb0 con 0x563104018f40 2023-07-14T13:10:32.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.543+0000 7f1225ffb700 10 client.27170 handle_command_reply: tid=0 2023-07-14T13:10:32.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.543+0000 7f1258a10b80 1 client.27170 shutdown 2023-07-14T13:10:32.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1258a10b80 1 -- 172.21.15.17:0/1003318803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffa2d0 msgr2=0x563104005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:32.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1258a10b80 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffa2d0 0x563104005150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f12300a30a0 tx=0x7f12300d19c0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1258a10b80 1 -- 172.21.15.17:0/1003318803 shutdown_connections 2023-07-14T13:10:32.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1258a10b80 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563104018f40 0x56310401b320 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1258a10b80 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104002910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1258a10b80 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffa2d0 0x563104005150 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1225ffb700 0 client.27170 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1258a10b80 1 --2- 172.21.15.17:0/1003318803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffabe0 0x5631040023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1258a10b80 1 -- 172.21.15.17:0/1003318803 >> 172.21.15.17:0/1003318803 conn(0x563103ff0da0 msgr2=0x563103ff6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1258a10b80 1 -- 172.21.15.17:0/1003318803 shutdown_connections 2023-07-14T13:10:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1258a10b80 1 -- 172.21.15.17:0/1003318803 wait complete. 2023-07-14T13:10:32.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.544+0000 7f1258a10b80 20 client.27170 trim_cache size 0 max 16384 2023-07-14T13:10:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.567+0000 7f1258a10b80 1 Processor -- start 2023-07-14T13:10:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.567+0000 7f1258a10b80 1 -- start start 2023-07-14T13:10:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.567+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 0x563104010830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.567+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104014fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.567+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104015510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.567+0000 7f1258a10b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563103ff7d20 con 0x563104005ad0 2023-07-14T13:10:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.567+0000 7f1258a10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563103ffb540 con 0x563103ffabe0 2023-07-14T13:10:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.567+0000 7f1258a10b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563103ffbd60 con 0x563103ffa2d0 2023-07-14T13:10:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 0x563104010830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104015510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 0x563104010830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60120/0 (socket says 172.21.15.17:60120) 2023-07-14T13:10:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123e59c700 1 -- 172.21.15.17:0/4067203949 learned_addr learned my addr 172.21.15.17:0/4067203949 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123dd9b700 1 --2- 172.21.15.17:0/4067203949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104014fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123dd9b700 1 -- 172.21.15.17:0/4067203949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 msgr2=0x563104010830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123dd9b700 1 --2- 172.21.15.17:0/4067203949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 0x563104010830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123dd9b700 1 -- 172.21.15.17:0/4067203949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 msgr2=0x563104015510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123dd9b700 1 --2- 172.21.15.17:0/4067203949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104015510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123dd9b700 1 -- 172.21.15.17:0/4067203949 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563103d63c60 con 0x563103ffabe0 2023-07-14T13:10:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123e59c700 1 --2- 172.21.15.17:0/4067203949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 0x563104010830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.568+0000 7f123ed9d700 1 --2- 172.21.15.17:0/4067203949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104015510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.569+0000 7f123dd9b700 1 --2- 172.21.15.17:0/4067203949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104014fd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x56310401bbd0 tx=0x7f1234009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e44f4c86933b8ef server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.569+0000 7f122d7fa700 1 -- 172.21.15.17:0/4067203949 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123401f2d0 con 0x563103ffabe0 2023-07-14T13:10:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.569+0000 7f122d7fa700 1 -- 172.21.15.17:0/4067203949 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1234018040 con 0x563103ffabe0 2023-07-14T13:10:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.569+0000 7f122d7fa700 1 -- 172.21.15.17:0/4067203949 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234010c70 con 0x563103ffabe0 2023-07-14T13:10:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.570+0000 7f1258a10b80 1 -- 172.21.15.17:0/4067203949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 msgr2=0x563104014fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.570+0000 7f1258a10b80 1 --2- 172.21.15.17:0/4067203949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104014fd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x56310401bbd0 tx=0x7f1234009260 comp rx=0 tx=0).stop 2023-07-14T13:10:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.570+0000 7f1258a10b80 1 -- 172.21.15.17:0/4067203949 shutdown_connections 2023-07-14T13:10:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.570+0000 7f1258a10b80 1 --2- 172.21.15.17:0/4067203949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104015510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.570+0000 7f1258a10b80 1 --2- 172.21.15.17:0/4067203949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 0x563104010830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.570+0000 7f1258a10b80 1 --2- 172.21.15.17:0/4067203949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104014fd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.570+0000 7f1258a10b80 1 -- 172.21.15.17:0/4067203949 >> 172.21.15.17:0/4067203949 conn(0x563103ff0da0 msgr2=0x563103ffd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.570+0000 7f1258a10b80 1 -- 172.21.15.17:0/4067203949 shutdown_connections 2023-07-14T13:10:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.570+0000 7f1258a10b80 1 -- 172.21.15.17:0/4067203949 wait complete. 2023-07-14T13:10:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.570+0000 7f1258a10b80 1 -- start start 2023-07-14T13:10:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.571+0000 7f1258a10b80 1 Processor -- start 2023-07-14T13:10:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 0x563104066550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104066a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f1258a10b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104060d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f1258a10b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563104061340 con 0x563104005ad0 2023-07-14T13:10:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f1258a10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631040614b0 con 0x563103ffabe0 2023-07-14T13:10:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f1258a10b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563104061670 con 0x563103ffa2d0 2023-07-14T13:10:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f1258a10b80 10 client.0 _ll_register_callbacks cb 0x7f1238009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f123dd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104066a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f123e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 0x563104066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f123dd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104066a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44572/0 (socket says 172.21.15.17:44572) 2023-07-14T13:10:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f123dd9b700 1 -- 172.21.15.17:0/2780207925 learned_addr learned my addr 172.21.15.17:0/2780207925 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.572+0000 7f123ed9d700 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104060d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.573+0000 7f123dd9b700 1 -- 172.21.15.17:0/2780207925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 msgr2=0x563104066550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.573+0000 7f123dd9b700 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 0x563104066550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.573+0000 7f123dd9b700 1 -- 172.21.15.17:0/2780207925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 msgr2=0x563104060d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.573+0000 7f123dd9b700 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104060d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.573+0000 7f123dd9b700 1 -- 172.21.15.17:0/2780207925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12401a2910 con 0x563103ffabe0 2023-07-14T13:10:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.573+0000 7f123dd9b700 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104066a90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x563103f00cd0 tx=0x7f123401f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a43ab4f983b8cd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.573+0000 7f1225ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:10:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.573+0000 7f1225ffb700 1 -- 172.21.15.17:0/2780207925 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234010a70 con 0x563103ffabe0 2023-07-14T13:10:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.573+0000 7f1258a10b80 1 -- 172.21.15.17:0/2780207925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f123009afe0 con 0x563103ffabe0 2023-07-14T13:10:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.573+0000 7f1225ffb700 1 -- 172.21.15.17:0/2780207925 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f123401f5b0 con 0x563103ffabe0 2023-07-14T13:10:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.574+0000 7f1225ffb700 1 -- 172.21.15.17:0/2780207925 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1234010bd0 con 0x563103ffabe0 2023-07-14T13:10:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.574+0000 7f1258a10b80 10 client.27176 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.574+0000 7f1258a10b80 1 -- 172.21.15.17:0/2780207925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f12380047c0 con 0x563103ffabe0 2023-07-14T13:10:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.574+0000 7f1225ffb700 1 -- 172.21.15.17:0/2780207925 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f123009afe0 con 0x563103ffabe0 2023-07-14T13:10:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.574+0000 7f1225ffb700 1 -- 172.21.15.17:0/2780207925 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f123401d410 con 0x563103ffabe0 2023-07-14T13:10:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.574+0000 7f1258a10b80 10 client.27176 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.574+0000 7f1258a10b80 10 client.27176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.574+0000 7f1258a10b80 20 client.27176 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.574+0000 7f1258a10b80 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56310406e3a0 0x5631040707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.574+0000 7f1258a10b80 4 client.27176 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:10:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.574+0000 7f1258a10b80 1 -- 172.21.15.17:0/2780207925 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563103f08050 con 0x56310406e3a0 2023-07-14T13:10:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.575+0000 7f123e59c700 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56310406e3a0 0x5631040707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.575+0000 7f1225ffb700 10 client.27176 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.575+0000 7f123e59c700 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56310406e3a0 0x5631040707b0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca8c2c02470d1ed4 server_cookie=2e07989f314c2d79 in_seq=0 out_seq=0 2023-07-14T13:10:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1225ffb700 1 -- 172.21.15.17:0/2780207925 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563103f08050 con 0x56310406e3a0 2023-07-14T13:10:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1225ffb700 10 client.27176 handle_command_reply: tid=0 2023-07-14T13:10:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 1 client.27176 shutdown 2023-07-14T13:10:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 1 -- 172.21.15.17:0/2780207925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 msgr2=0x563104066a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104066a90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x563103f00cd0 tx=0x7f123401f230 comp rx=0 tx=0).stop 2023-07-14T13:10:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 1 -- 172.21.15.17:0/2780207925 shutdown_connections 2023-07-14T13:10:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56310406e3a0 0x5631040707b0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563104005ad0 0x563104060d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563103ffa2d0 0x563104066550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 1 --2- 172.21.15.17:0/2780207925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563103ffabe0 0x563104066a90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1225ffb700 0 client.27176 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 1 -- 172.21.15.17:0/2780207925 >> 172.21.15.17:0/2780207925 conn(0x563103ff0da0 msgr2=0x563104014fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 1 -- 172.21.15.17:0/2780207925 shutdown_connections 2023-07-14T13:10:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 1 -- 172.21.15.17:0/2780207925 wait complete. 2023-07-14T13:10:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.576+0000 7f1258a10b80 20 client.27176 trim_cache size 0 max 16384 2023-07-14T13:10:32.622 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:10:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:10:32.622 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:10:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:10:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:10:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:10:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:10:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:10:32.623 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:10:32.624 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:10:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 -- 172.21.15.17:0/3057157723 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12280a12c0 msgr2=0x7f12280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12280a12c0 0x7f12280a3770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1238009ec0 tx=0x7f1238004ad0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 -- 172.21.15.17:0/3057157723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1240100ca0 msgr2=0x7f124019b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1240100ca0 0x7f124019b920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1230000c00 tx=0x7f1230004730 comp rx=0 tx=0).stop 2023-07-14T13:10:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 -- 172.21.15.17:0/3057157723 shutdown_connections 2023-07-14T13:10:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12280a12c0 0x7f12280a3770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124010a070 0x7f1240195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1240100ca0 0x7f124019b920 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 --2- 172.21.15.17:0/3057157723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12401015b0 0x7f124019be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 -- 172.21.15.17:0/3057157723 >> 172.21.15.17:0/3057157723 conn(0x7f12400fa4b0 msgr2=0x7f12400fb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:32.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 -- 172.21.15.17:0/3057157723 shutdown_connections 2023-07-14T13:10:32.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:10:32.577+0000 7f1244fff700 1 -- 172.21.15.17:0/3057157723 wait complete. 2023-07-14T13:10:32.633 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:10:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:42600000 of 50000000 tuples (85%) done (elapsed 622.97 s, remaining 108.22 s) 2023-07-14T13:10:33.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:33 smithi135 ceph-mon[97338]: pgmap v337: 97 pgs: 97 active+clean; 8.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-07-14T13:10:33.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:33 smithi131 ceph-mon[96953]: pgmap v337: 97 pgs: 97 active+clean; 8.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-07-14T13:10:33.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:33 smithi017 ceph-mon[95536]: pgmap v337: 97 pgs: 97 active+clean; 8.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-07-14T13:10:34.697 INFO:teuthology.orchestra.run.smithi017.stderr:42700000 of 50000000 tuples (85%) done (elapsed 624.30 s, remaining 106.73 s) 2023-07-14T13:10:35.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:35 smithi135 ceph-mon[97338]: pgmap v338: 97 pgs: 97 active+clean; 8.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-07-14T13:10:35.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:35 smithi131 ceph-mon[96953]: pgmap v338: 97 pgs: 97 active+clean; 8.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-07-14T13:10:35.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:35 smithi017 ceph-mon[95536]: pgmap v338: 97 pgs: 97 active+clean; 8.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-07-14T13:10:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.047+0000 7f68ca1ff700 1 -- 172.21.15.17:0/2089110500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68c4101fd0 msgr2=0x7f68c41023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.047+0000 7f68ca1ff700 1 --2- 172.21.15.17:0/2089110500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68c4101fd0 0x7f68c41023a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009990 tx=0x7f68b4009ca0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.048+0000 7f68ca1ff700 1 -- 172.21.15.17:0/2089110500 shutdown_connections 2023-07-14T13:10:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.048+0000 7f68ca1ff700 1 --2- 172.21.15.17:0/2089110500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68c4107010 0x7f68c410ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.048+0000 7f68ca1ff700 1 --2- 172.21.15.17:0/2089110500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68c4101fd0 0x7f68c41023a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.048+0000 7f68ca1ff700 1 --2- 172.21.15.17:0/2089110500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68c4102970 0x7f68c4106930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.048+0000 7f68ca1ff700 1 -- 172.21.15.17:0/2089110500 >> 172.21.15.17:0/2089110500 conn(0x7f68c40fd840 msgr2=0x7f68c40ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.048+0000 7f68ca1ff700 1 -- 172.21.15.17:0/2089110500 shutdown_connections 2023-07-14T13:10:36.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.048+0000 7f68ca1ff700 1 -- 172.21.15.17:0/2089110500 wait complete. 2023-07-14T13:10:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.049+0000 7f68ca1ff700 1 Processor -- start 2023-07-14T13:10:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.049+0000 7f68ca1ff700 1 -- start start 2023-07-14T13:10:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.049+0000 7f68ca1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68c4101fd0 0x7f68c4197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.049+0000 7f68ca1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68c4102970 0x7f68c4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68ca1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68c4107010 0x7f68c419c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68ca1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c419cfe0 con 0x7f68c4107010 2023-07-14T13:10:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68ca1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c419d150 con 0x7f68c4101fd0 2023-07-14T13:10:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68ca1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c419d310 con 0x7f68c4102970 2023-07-14T13:10:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68c3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68c4107010 0x7f68c419c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68c2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68c4102970 0x7f68c4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68c37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68c4101fd0 0x7f68c4197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68c3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68c4107010 0x7f68c419c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54346/0 (socket says 172.21.15.17:54346) 2023-07-14T13:10:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68c3fff700 1 -- 172.21.15.17:0/304660118 learned_addr learned my addr 172.21.15.17:0/304660118 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68c37fe700 1 -- 172.21.15.17:0/304660118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68c4102970 msgr2=0x7f68c4198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68c37fe700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68c4102970 0x7f68c4198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68c37fe700 1 -- 172.21.15.17:0/304660118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68c4107010 msgr2=0x7f68c419c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68c37fe700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68c4107010 0x7f68c419c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.050+0000 7f68c37fe700 1 -- 172.21.15.17:0/304660118 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b8009520 con 0x7f68c4101fd0 2023-07-14T13:10:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.051+0000 7f68c37fe700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68c4101fd0 0x7f68c4197df0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000c00 tx=0x7f68b4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.051+0000 7f68c0ff9700 1 -- 172.21.15.17:0/304660118 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b401d070 con 0x7f68c4101fd0 2023-07-14T13:10:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.051+0000 7f68ca1ff700 1 -- 172.21.15.17:0/304660118 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b40095f0 con 0x7f68c4101fd0 2023-07-14T13:10:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.051+0000 7f68c0ff9700 1 -- 172.21.15.17:0/304660118 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68b4021410 con 0x7f68c4101fd0 2023-07-14T13:10:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.051+0000 7f68c0ff9700 1 -- 172.21.15.17:0/304660118 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4017650 con 0x7f68c4101fd0 2023-07-14T13:10:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.051+0000 7f68ca1ff700 1 -- 172.21.15.17:0/304660118 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c419d820 con 0x7f68c4101fd0 2023-07-14T13:10:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.056+0000 7f68c0ff9700 1 -- 172.21.15.17:0/304660118 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f68b4021580 con 0x7f68c4101fd0 2023-07-14T13:10:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.057+0000 7f68ddc03b80 1 Processor -- start 2023-07-14T13:10:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.057+0000 7f68ddc03b80 1 -- start start 2023-07-14T13:10:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 0x5652f29a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f29a12d0 0x5652f299b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 0x5652f299b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f28a0c50 con 0x5652f29a12d0 2023-07-14T13:10:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f28f39e0 con 0x5652f299b580 2023-07-14T13:10:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f28ece70 con 0x5652f27f76b0 2023-07-14T13:10:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68c3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 0x5652f29a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68c37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f29a12d0 0x5652f299b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68c3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 0x5652f29a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60650/0 (socket says 172.21.15.17:60650) 2023-07-14T13:10:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68c3fff700 1 -- 172.21.15.17:0/1510175393 learned_addr learned my addr 172.21.15.17:0/1510175393 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68c2ffd700 1 --2- 172.21.15.17:0/1510175393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 0x5652f299b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68c3fff700 1 -- 172.21.15.17:0/1510175393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 msgr2=0x5652f299b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68c3fff700 1 --2- 172.21.15.17:0/1510175393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 0x5652f299b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68c0ff9700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68ac0a12c0 0x7f68ac0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68c3fff700 1 -- 172.21.15.17:0/1510175393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f29a12d0 msgr2=0x5652f299b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68c3fff700 1 --2- 172.21.15.17:0/1510175393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f29a12d0 0x5652f299b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.058+0000 7f68c3fff700 1 -- 172.21.15.17:0/1510175393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652f271ad80 con 0x5652f27f76b0 2023-07-14T13:10:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.059+0000 7f68c0ff9700 1 -- 172.21.15.17:0/304660118 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f68b40cdf30 con 0x7f68c4101fd0 2023-07-14T13:10:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.059+0000 7f68c3fff700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68ac0a12c0 0x7f68ac0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.059+0000 7f68c3fff700 1 --2- 172.21.15.17:0/1510175393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 0x5652f29a0d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00e690 tx=0x7f68bc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f91a5b5afe61caf5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.059+0000 7f68a9ffb700 1 -- 172.21.15.17:0/1510175393 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00e040 con 0x5652f27f76b0 2023-07-14T13:10:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.059+0000 7f68a9ffb700 1 -- 172.21.15.17:0/1510175393 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68bc00f040 con 0x5652f27f76b0 2023-07-14T13:10:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.060+0000 7f68a9ffb700 1 -- 172.21.15.17:0/1510175393 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc015670 con 0x5652f27f76b0 2023-07-14T13:10:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.060+0000 7f68ddc03b80 1 -- 172.21.15.17:0/1510175393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 msgr2=0x5652f29a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.060+0000 7f68c3fff700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68ac0a12c0 0x7f68ac0a3770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f68bc020000 tx=0x7f68bc023000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.060+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/1510175393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 0x5652f29a0d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00e690 tx=0x7f68bc009920 comp rx=0 tx=0).stop 2023-07-14T13:10:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.060+0000 7f68ddc03b80 1 -- 172.21.15.17:0/1510175393 shutdown_connections 2023-07-14T13:10:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.060+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/1510175393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 0x5652f299b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.060+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/1510175393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 0x5652f29a0d90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.060+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/1510175393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f29a12d0 0x5652f299b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.060+0000 7f68ddc03b80 1 -- 172.21.15.17:0/1510175393 >> 172.21.15.17:0/1510175393 conn(0x5652f2990be0 msgr2=0x5652f2995f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.061+0000 7f68ddc03b80 1 -- 172.21.15.17:0/1510175393 shutdown_connections 2023-07-14T13:10:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.061+0000 7f68ddc03b80 1 -- 172.21.15.17:0/1510175393 wait complete. 2023-07-14T13:10:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.061+0000 7f68ddc03b80 1 -- start start 2023-07-14T13:10:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.061+0000 7f68ddc03b80 1 Processor -- start 2023-07-14T13:10:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f27f76b0 0x5652f29a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f299b580 0x5652f29a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f29a12d0 0x5652f29a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f288ca60 con 0x5652f27f76b0 2023-07-14T13:10:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f288c760 con 0x5652f29a12d0 2023-07-14T13:10:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f27708c0 con 0x5652f299b580 2023-07-14T13:10:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68ddc03b80 10 client.0 _ll_register_callbacks cb 0x5652f288a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68c2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f299b580 0x5652f29a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68c3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f29a12d0 0x5652f29a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68c37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f27f76b0 0x5652f29a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68c2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f299b580 0x5652f29a47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60660/0 (socket says 172.21.15.17:60660) 2023-07-14T13:10:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.062+0000 7f68c2ffd700 1 -- 172.21.15.17:0/4053515588 learned_addr learned my addr 172.21.15.17:0/4053515588 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.063+0000 7f68c2ffd700 1 -- 172.21.15.17:0/4053515588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f29a12d0 msgr2=0x5652f29a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.063+0000 7f68c2ffd700 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f29a12d0 0x5652f29a4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.063+0000 7f68c2ffd700 1 -- 172.21.15.17:0/4053515588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f27f76b0 msgr2=0x5652f29a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.063+0000 7f68c2ffd700 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f27f76b0 0x5652f29a7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.063+0000 7f68c2ffd700 1 -- 172.21.15.17:0/4053515588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc00e370 con 0x5652f299b580 2023-07-14T13:10:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.063+0000 7f68c37fe700 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f27f76b0 0x5652f29a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.063+0000 7f68c2ffd700 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f299b580 0x5652f29a47a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f68b8011970 tx=0x7f68b8011c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffa4184c5de203f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.063+0000 7f68a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:10:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.063+0000 7f68a2ffd700 1 -- 172.21.15.17:0/4053515588 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8016070 con 0x5652f299b580 2023-07-14T13:10:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.063+0000 7f68a2ffd700 1 -- 172.21.15.17:0/4053515588 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f68b800fb00 con 0x5652f299b580 2023-07-14T13:10:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.063+0000 7f68ddc03b80 1 -- 172.21.15.17:0/4053515588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652f2846490 con 0x5652f299b580 2023-07-14T13:10:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.064+0000 7f68a2ffd700 1 -- 172.21.15.17:0/4053515588 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68b800fcc0 con 0x5652f299b580 2023-07-14T13:10:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.064+0000 7f68ddc03b80 10 client.27163 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.064+0000 7f68ddc03b80 1 -- 172.21.15.17:0/4053515588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5652f2703c00 con 0x5652f299b580 2023-07-14T13:10:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.064+0000 7f68a2ffd700 1 -- 172.21.15.17:0/4053515588 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68b8027020 con 0x5652f299b580 2023-07-14T13:10:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.064+0000 7f68a2ffd700 1 -- 172.21.15.17:0/4053515588 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f68b8021070 con 0x5652f299b580 2023-07-14T13:10:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.064+0000 7f68ddc03b80 10 client.27163 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.064+0000 7f68ddc03b80 10 client.27163 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.064+0000 7f68ddc03b80 20 client.27163 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.064+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5652f29b4b40 0x5652f29b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.064+0000 7f68ddc03b80 4 client.27163 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:10:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.064+0000 7f68ddc03b80 1 -- 172.21.15.17:0/4053515588 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652f28e5e50 con 0x5652f29b4b40 2023-07-14T13:10:36.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.065+0000 7f68c37fe700 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5652f29b4b40 0x5652f29b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.065+0000 7f68c37fe700 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5652f29b4b40 0x5652f29b6f50 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13124adddf999363 server_cookie=dc239f15dcb7b0a8 in_seq=0 out_seq=0 2023-07-14T13:10:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.065+0000 7f68a2ffd700 10 client.27163 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.066+0000 7f68a2ffd700 1 -- 172.21.15.17:0/4053515588 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5652f28e5e50 con 0x5652f29b4b40 2023-07-14T13:10:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.066+0000 7f68a2ffd700 10 client.27163 handle_command_reply: tid=0 2023-07-14T13:10:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.066+0000 7f68ddc03b80 1 client.27163 shutdown 2023-07-14T13:10:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.066+0000 7f68ddc03b80 1 -- 172.21.15.17:0/4053515588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f299b580 msgr2=0x5652f29a47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.066+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f299b580 0x5652f29a47a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f68b8011970 tx=0x7f68b8011c80 comp rx=0 tx=0).stop 2023-07-14T13:10:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.067+0000 7f68ddc03b80 1 -- 172.21.15.17:0/4053515588 shutdown_connections 2023-07-14T13:10:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.067+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5652f29b4b40 0x5652f29b6f50 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.067+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f29a12d0 0x5652f29a4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.067+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f27f76b0 0x5652f29a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.067+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/4053515588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f299b580 0x5652f29a47a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.067+0000 7f68a2ffd700 0 client.27163 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.067+0000 7f68ddc03b80 1 -- 172.21.15.17:0/4053515588 >> 172.21.15.17:0/4053515588 conn(0x5652f2990be0 msgr2=0x5652f29954e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.067+0000 7f68ddc03b80 1 -- 172.21.15.17:0/4053515588 shutdown_connections 2023-07-14T13:10:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.067+0000 7f68ddc03b80 1 -- 172.21.15.17:0/4053515588 wait complete. 2023-07-14T13:10:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.067+0000 7f68ddc03b80 20 client.27163 trim_cache size 0 max 16384 2023-07-14T13:10:36.113 INFO:teuthology.orchestra.run.smithi017.stderr:42800000 of 50000000 tuples (85%) done (elapsed 625.71 s, remaining 105.26 s) 2023-07-14T13:10:36.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.084+0000 7f68ddc03b80 1 Processor -- start 2023-07-14T13:10:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.084+0000 7f68ddc03b80 1 -- start start 2023-07-14T13:10:36.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.084+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f27f76b0 0x5652f29abc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.084+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f299b580 0x5652f29a2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.084+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f29a12d0 0x5652f29a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.084+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f298dbb0 con 0x5652f299b580 2023-07-14T13:10:36.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.084+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f299bfd0 con 0x5652f27f76b0 2023-07-14T13:10:36.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.084+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f299f540 con 0x5652f29a12d0 2023-07-14T13:10:36.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f299b580 0x5652f29a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f27f76b0 0x5652f29abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f27f76b0 0x5652f29abc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59670/0 (socket says 172.21.15.17:59670) 2023-07-14T13:10:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c37fe700 1 -- 172.21.15.17:0/3921446224 learned_addr learned my addr 172.21.15.17:0/3921446224 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f299b580 0x5652f29a2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54376/0 (socket says 172.21.15.17:54376) 2023-07-14T13:10:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c3fff700 1 --2- 172.21.15.17:0/3921446224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f29a12d0 0x5652f29a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c2ffd700 1 -- 172.21.15.17:0/3921446224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f29a12d0 msgr2=0x5652f29a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:36.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c2ffd700 1 --2- 172.21.15.17:0/3921446224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f29a12d0 0x5652f29a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c2ffd700 1 -- 172.21.15.17:0/3921446224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f27f76b0 msgr2=0x5652f29abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:36.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c2ffd700 1 --2- 172.21.15.17:0/3921446224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f27f76b0 0x5652f29abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c2ffd700 1 -- 172.21.15.17:0/3921446224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652f27411f0 con 0x5652f299b580 2023-07-14T13:10:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c3fff700 1 --2- 172.21.15.17:0/3921446224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f29a12d0 0x5652f29a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:10:36.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c37fe700 1 --2- 172.21.15.17:0/3921446224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f27f76b0 0x5652f29abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.085+0000 7f68c2ffd700 1 --2- 172.21.15.17:0/3921446224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f299b580 0x5652f29a2010 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f68b800ffd0 tx=0x7f68b8009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ce6a02f7ebeffa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.086+0000 7f68aa7fc700 1 -- 172.21.15.17:0/3921446224 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8016030 con 0x5652f299b580 2023-07-14T13:10:36.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.086+0000 7f68aa7fc700 1 -- 172.21.15.17:0/3921446224 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68b8027030 con 0x5652f299b580 2023-07-14T13:10:36.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.086+0000 7f68aa7fc700 1 -- 172.21.15.17:0/3921446224 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8005360 con 0x5652f299b580 2023-07-14T13:10:36.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.087+0000 7f68ddc03b80 1 -- 172.21.15.17:0/3921446224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f299b580 msgr2=0x5652f29a2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:36.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.087+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/3921446224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f299b580 0x5652f29a2010 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f68b800ffd0 tx=0x7f68b8009480 comp rx=0 tx=0).stop 2023-07-14T13:10:36.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.087+0000 7f68ddc03b80 1 -- 172.21.15.17:0/3921446224 shutdown_connections 2023-07-14T13:10:36.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.087+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/3921446224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f29a12d0 0x5652f29a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.087+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/3921446224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f27f76b0 0x5652f29abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.087+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/3921446224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f299b580 0x5652f29a2010 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.087+0000 7f68ddc03b80 1 -- 172.21.15.17:0/3921446224 >> 172.21.15.17:0/3921446224 conn(0x5652f2990be0 msgr2=0x5652f29a1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:36.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.087+0000 7f68ddc03b80 1 -- 172.21.15.17:0/3921446224 shutdown_connections 2023-07-14T13:10:36.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.087+0000 7f68ddc03b80 1 -- 172.21.15.17:0/3921446224 wait complete. 2023-07-14T13:10:36.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.087+0000 7f68ddc03b80 1 -- start start 2023-07-14T13:10:36.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.088+0000 7f68ddc03b80 1 Processor -- start 2023-07-14T13:10:36.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.088+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 0x5652f29abc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.088+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 0x5652f299cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.088+0000 7f68ddc03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f29a12d0 0x5652f299d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.088+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f299d7f0 con 0x5652f29a12d0 2023-07-14T13:10:36.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.088+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f299d960 con 0x5652f299b580 2023-07-14T13:10:36.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.088+0000 7f68ddc03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f2a08a00 con 0x5652f27f76b0 2023-07-14T13:10:36.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.088+0000 7f68ddc03b80 10 client.0 _ll_register_callbacks cb 0x7f68b8011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:36.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 0x5652f29abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 0x5652f299cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 0x5652f299cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59672/0 (socket says 172.21.15.17:59672) 2023-07-14T13:10:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c2ffd700 1 -- 172.21.15.17:0/621053295 learned_addr learned my addr 172.21.15.17:0/621053295 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c3fff700 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f29a12d0 0x5652f299d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c37fe700 1 -- 172.21.15.17:0/621053295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 msgr2=0x5652f299cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c37fe700 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 0x5652f299cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c37fe700 1 -- 172.21.15.17:0/621053295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f29a12d0 msgr2=0x5652f299d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:36.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c37fe700 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f29a12d0 0x5652f299d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c37fe700 1 -- 172.21.15.17:0/621053295 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c419d820 con 0x5652f27f76b0 2023-07-14T13:10:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c2ffd700 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 0x5652f299cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68c37fe700 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 0x5652f29abc70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f68b409adb0 tx=0x7f68b40ce0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1af21abb2daa09fe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.089+0000 7f68a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:10:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68a2ffd700 1 -- 172.21.15.17:0/621053295 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40b2070 con 0x5652f27f76b0 2023-07-14T13:10:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68a2ffd700 1 -- 172.21.15.17:0/621053295 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f68b409b0b0 con 0x5652f27f76b0 2023-07-14T13:10:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68ddc03b80 1 -- 172.21.15.17:0/621053295 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68bc00f040 con 0x5652f27f76b0 2023-07-14T13:10:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68a2ffd700 1 -- 172.21.15.17:0/621053295 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68b409ae80 con 0x5652f27f76b0 2023-07-14T13:10:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68ddc03b80 10 client.27169 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68ddc03b80 1 -- 172.21.15.17:0/621053295 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5652f2703c00 con 0x5652f27f76b0 2023-07-14T13:10:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68a2ffd700 1 -- 172.21.15.17:0/621053295 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68b40c9080 con 0x5652f27f76b0 2023-07-14T13:10:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68a2ffd700 1 -- 172.21.15.17:0/621053295 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f68b40aed20 con 0x5652f27f76b0 2023-07-14T13:10:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68ddc03b80 10 client.27169 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:36.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68ddc03b80 10 client.27169 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68ddc03b80 20 client.27169 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5652f2a09c00 0x5652f2a0bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68ddc03b80 4 client.27169 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:10:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.090+0000 7f68ddc03b80 1 -- 172.21.15.17:0/621053295 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5652f28a7ff0 con 0x5652f2a09c00 2023-07-14T13:10:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.091+0000 7f68c2ffd700 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5652f2a09c00 0x5652f2a0bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:36.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.091+0000 7f68a2ffd700 10 client.27169 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.091+0000 7f68c2ffd700 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5652f2a09c00 0x5652f2a0bfe0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87b007374c95919f server_cookie=8bbb9d6665c94e01 in_seq=0 out_seq=0 2023-07-14T13:10:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68a2ffd700 1 -- 172.21.15.17:0/621053295 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5652f28a7ff0 con 0x5652f2a09c00 2023-07-14T13:10:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68a2ffd700 10 client.27169 handle_command_reply: tid=0 2023-07-14T13:10:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68ddc03b80 1 client.27169 shutdown 2023-07-14T13:10:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68ddc03b80 1 -- 172.21.15.17:0/621053295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 msgr2=0x5652f29abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 0x5652f29abc70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f68b409adb0 tx=0x7f68b40ce0f0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68ddc03b80 1 -- 172.21.15.17:0/621053295 shutdown_connections 2023-07-14T13:10:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5652f2a09c00 0x5652f2a0bfe0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5652f29a12d0 0x5652f299d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68a2ffd700 0 client.27169 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652f27f76b0 0x5652f29abc70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68ddc03b80 1 --2- 172.21.15.17:0/621053295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652f299b580 0x5652f299cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68ddc03b80 1 -- 172.21.15.17:0/621053295 >> 172.21.15.17:0/621053295 conn(0x5652f2990be0 msgr2=0x5652f29a2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68ddc03b80 1 -- 172.21.15.17:0/621053295 shutdown_connections 2023-07-14T13:10:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.106+0000 7f68ddc03b80 1 -- 172.21.15.17:0/621053295 wait complete. 2023-07-14T13:10:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.107+0000 7f68ddc03b80 20 client.27169 trim_cache size 0 max 16384 2023-07-14T13:10:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:10:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:10:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:10:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:10:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.107+0000 7f68ca1ff700 1 -- 172.21.15.17:0/304660118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68ac0a12c0 msgr2=0x7f68ac0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.107+0000 7f68ca1ff700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68ac0a12c0 0x7f68ac0a3770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f68bc020000 tx=0x7f68bc023000 comp rx=0 tx=0).stop 2023-07-14T13:10:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.107+0000 7f68ca1ff700 1 -- 172.21.15.17:0/304660118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68c4101fd0 msgr2=0x7f68c4197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.107+0000 7f68ca1ff700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68c4101fd0 0x7f68c4197df0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f68b4000c00 tx=0x7f68b4005740 comp rx=0 tx=0).stop 2023-07-14T13:10:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.108+0000 7f68ca1ff700 1 -- 172.21.15.17:0/304660118 shutdown_connections 2023-07-14T13:10:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.108+0000 7f68ca1ff700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68ac0a12c0 0x7f68ac0a3770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.108+0000 7f68ca1ff700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68c4107010 0x7f68c419c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.108+0000 7f68ca1ff700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68c4101fd0 0x7f68c4197df0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.108+0000 7f68ca1ff700 1 --2- 172.21.15.17:0/304660118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68c4102970 0x7f68c4198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.108+0000 7f68ca1ff700 1 -- 172.21.15.17:0/304660118 >> 172.21.15.17:0/304660118 conn(0x7f68c40fd840 msgr2=0x7f68c4105970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.108+0000 7f68ca1ff700 1 -- 172.21.15.17:0/304660118 shutdown_connections 2023-07-14T13:10:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:36.108+0000 7f68ca1ff700 1 -- 172.21.15.17:0/304660118 wait complete. 2023-07-14T13:10:37.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:37 smithi135 ceph-mon[97338]: pgmap v339: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 33 MiB/s wr, 100 op/s 2023-07-14T13:10:37.501 INFO:teuthology.orchestra.run.smithi017.stderr:42900000 of 50000000 tuples (85%) done (elapsed 627.10 s, remaining 103.79 s) 2023-07-14T13:10:37.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:37 smithi131 ceph-mon[96953]: pgmap v339: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 33 MiB/s wr, 100 op/s 2023-07-14T13:10:37.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:37 smithi017 ceph-mon[95536]: pgmap v339: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 33 MiB/s wr, 100 op/s 2023-07-14T13:10:38.795 INFO:teuthology.orchestra.run.smithi017.stderr:43000000 of 50000000 tuples (86%) done (elapsed 628.39 s, remaining 102.30 s) 2023-07-14T13:10:39.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:39 smithi135 ceph-mon[97338]: pgmap v340: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 22 MiB/s wr, 76 op/s 2023-07-14T13:10:39.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:39 smithi131 ceph-mon[96953]: pgmap v340: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 22 MiB/s wr, 76 op/s 2023-07-14T13:10:39.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:39 smithi017 ceph-mon[95536]: pgmap v340: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 22 MiB/s wr, 76 op/s 2023-07-14T13:10:40.239 INFO:teuthology.orchestra.run.smithi017.stderr:43100000 of 50000000 tuples (86%) done (elapsed 629.84 s, remaining 100.83 s) 2023-07-14T13:10:41.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:41 smithi135 ceph-mon[97338]: pgmap v341: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 33 MiB/s wr, 115 op/s 2023-07-14T13:10:41.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:41 smithi131 ceph-mon[96953]: pgmap v341: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 33 MiB/s wr, 115 op/s 2023-07-14T13:10:41.595 INFO:teuthology.orchestra.run.smithi017.stderr:43200000 of 50000000 tuples (86%) done (elapsed 631.19 s, remaining 99.35 s) 2023-07-14T13:10:41.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:41 smithi017 ceph-mon[95536]: pgmap v341: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 33 MiB/s wr, 115 op/s 2023-07-14T13:10:43.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:43 smithi135 ceph-mon[97338]: pgmap v342: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 75 op/s 2023-07-14T13:10:43.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:43 smithi131 ceph-mon[96953]: pgmap v342: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 75 op/s 2023-07-14T13:10:43.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:43 smithi017 ceph-mon[95536]: pgmap v342: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 75 op/s 2023-07-14T13:10:45.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:45 smithi135 ceph-mon[97338]: pgmap v343: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 75 op/s 2023-07-14T13:10:45.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:45 smithi131 ceph-mon[96953]: pgmap v343: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 75 op/s 2023-07-14T13:10:45.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:45 smithi017 ceph-mon[95536]: pgmap v343: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 22 MiB/s wr, 75 op/s 2023-07-14T13:10:47.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:47 smithi135 ceph-mon[97338]: pgmap v344: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 28 MiB/s wr, 99 op/s 2023-07-14T13:10:47.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:47 smithi131 ceph-mon[96953]: pgmap v344: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 28 MiB/s wr, 99 op/s 2023-07-14T13:10:47.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:47 smithi017 ceph-mon[95536]: pgmap v344: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 28 MiB/s wr, 99 op/s 2023-07-14T13:10:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.272+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/4201563534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d280ffb30 msgr2=0x7f2d280fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.272+0000 7f2d2f5ff700 1 --2- 172.21.15.17:0/4201563534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d280ffb30 0x7f2d280fffa0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009990 tx=0x7f2d18009ca0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.272+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/4201563534 shutdown_connections 2023-07-14T13:10:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.272+0000 7f2d2f5ff700 1 --2- 172.21.15.17:0/4201563534 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d281004e0 0x7f2d2810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.272+0000 7f2d2f5ff700 1 --2- 172.21.15.17:0/4201563534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d28105b60 0x7f2d28105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.272+0000 7f2d2f5ff700 1 --2- 172.21.15.17:0/4201563534 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d280ffb30 0x7f2d280fffa0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.272+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/4201563534 >> 172.21.15.17:0/4201563534 conn(0x7f2d280fb5f0 msgr2=0x7f2d280fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:49.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.272+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/4201563534 shutdown_connections 2023-07-14T13:10:49.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.272+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/4201563534 wait complete. 2023-07-14T13:10:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.274+0000 7f2d2f5ff700 1 Processor -- start 2023-07-14T13:10:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.274+0000 7f2d2f5ff700 1 -- start start 2023-07-14T13:10:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.274+0000 7f2d2f5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d280ffb30 0x7f2d2819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2f5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d281004e0 0x7f2d2819bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2f5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d28105b60 0x7f2d28195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2f5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28195f80 con 0x7f2d281004e0 2023-07-14T13:10:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2f5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d281960f0 con 0x7f2d28105b60 2023-07-14T13:10:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2f5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d281962b0 con 0x7f2d280ffb30 2023-07-14T13:10:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2cb9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d281004e0 0x7f2d2819bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2db9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d28105b60 0x7f2d28195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2cb9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d281004e0 0x7f2d2819bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51540/0 (socket says 172.21.15.17:51540) 2023-07-14T13:10:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2cb9a700 1 -- 172.21.15.17:0/1115218112 learned_addr learned my addr 172.21.15.17:0/1115218112 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2d39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d280ffb30 0x7f2d2819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2db9c700 1 -- 172.21.15.17:0/1115218112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d280ffb30 msgr2=0x7f2d2819bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2db9c700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d280ffb30 0x7f2d2819bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2db9c700 1 -- 172.21.15.17:0/1115218112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d281004e0 msgr2=0x7f2d2819bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2db9c700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d281004e0 0x7f2d2819bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2db9c700 1 -- 172.21.15.17:0/1115218112 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180095f0 con 0x7f2d28105b60 2023-07-14T13:10:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d280ffb30 0x7f2d2819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.275+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d281004e0 0x7f2d2819bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.276+0000 7f2d2db9c700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d28105b60 0x7f2d28195910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000efc0 tx=0x7f2d2000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.276+0000 7f2d1e7fc700 1 -- 172.21.15.17:0/1115218112 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20018070 con 0x7f2d28105b60 2023-07-14T13:10:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.276+0000 7f2d1e7fc700 1 -- 172.21.15.17:0/1115218112 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d2000f040 con 0x7f2d28105b60 2023-07-14T13:10:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.276+0000 7f2d1e7fc700 1 -- 172.21.15.17:0/1115218112 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000cba0 con 0x7f2d28105b60 2023-07-14T13:10:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.276+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/1115218112 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d28196530 con 0x7f2d28105b60 2023-07-14T13:10:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.276+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/1115218112 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d281a2aa0 con 0x7f2d28105b60 2023-07-14T13:10:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.279+0000 7f2d1e7fc700 1 -- 172.21.15.17:0/1115218112 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2d20003a00 con 0x7f2d28105b60 2023-07-14T13:10:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.280+0000 7f2d43002b80 1 Processor -- start 2023-07-14T13:10:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.280+0000 7f2d43002b80 1 -- start start 2023-07-14T13:10:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b55640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d6b55b80 0x55f2d6b59dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b5a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d43002b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d6a56c50 con 0x55f2d6b55ff0 2023-07-14T13:10:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d43002b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d6aa99e0 con 0x55f2d6b55b80 2023-07-14T13:10:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d43002b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d6aa2e70 con 0x55f2d69ad6b0 2023-07-14T13:10:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d2cb9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b55640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d1e7fc700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d140a12c0 0x7f2d140a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d2cb9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b55640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:56958/0 (socket says 172.21.15.17:56958) 2023-07-14T13:10:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d2cb9a700 1 -- 172.21.15.17:0/2840502508 learned_addr learned my addr 172.21.15.17:0/2840502508 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/2840502508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d6b55b80 0x55f2d6b59dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/2840502508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b5a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.281+0000 7f2d1e7fc700 1 -- 172.21.15.17:0/1115218112 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2d200cc840 con 0x7f2d28105b60 2023-07-14T13:10:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.282+0000 7f2d2db9c700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d140a12c0 0x7f2d140a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.282+0000 7f2d2d39b700 1 -- 172.21.15.17:0/2840502508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d69ad6b0 msgr2=0x55f2d6b55640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.282+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/2840502508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b55640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.282+0000 7f2d2d39b700 1 -- 172.21.15.17:0/2840502508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55ff0 msgr2=0x55f2d6b5a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.282+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/2840502508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b5a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.282+0000 7f2d2d39b700 1 -- 172.21.15.17:0/2840502508 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2d68d0d80 con 0x55f2d6b55b80 2023-07-14T13:10:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.282+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/2840502508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b55640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.282+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/2840502508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d6b55b80 0x55f2d6b59dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2d240114f0 tx=0x7f2d24011800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d23fabcb5b54337a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.282+0000 7f2d2db9c700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d140a12c0 0x7f2d140a3770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2d200c9fb0 tx=0x7f2d20004c50 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.282+0000 7f2d137fe700 1 -- 172.21.15.17:0/2840502508 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24011310 con 0x55f2d6b55b80 2023-07-14T13:10:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.283+0000 7f2d137fe700 1 -- 172.21.15.17:0/2840502508 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d240044c0 con 0x55f2d6b55b80 2023-07-14T13:10:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.283+0000 7f2d137fe700 1 -- 172.21.15.17:0/2840502508 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2401a680 con 0x55f2d6b55b80 2023-07-14T13:10:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.283+0000 7f2d43002b80 1 -- 172.21.15.17:0/2840502508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d6b55b80 msgr2=0x55f2d6b59dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.283+0000 7f2d43002b80 1 --2- 172.21.15.17:0/2840502508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d6b55b80 0x55f2d6b59dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2d240114f0 tx=0x7f2d24011800 comp rx=0 tx=0).stop 2023-07-14T13:10:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.283+0000 7f2d43002b80 1 -- 172.21.15.17:0/2840502508 shutdown_connections 2023-07-14T13:10:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.283+0000 7f2d43002b80 1 --2- 172.21.15.17:0/2840502508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b5a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.283+0000 7f2d43002b80 1 --2- 172.21.15.17:0/2840502508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b55640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.283+0000 7f2d43002b80 1 --2- 172.21.15.17:0/2840502508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d6b55b80 0x55f2d6b59dc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.283+0000 7f2d43002b80 1 -- 172.21.15.17:0/2840502508 >> 172.21.15.17:0/2840502508 conn(0x55f2d6b46be0 msgr2=0x55f2d6b4bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.283+0000 7f2d43002b80 1 -- 172.21.15.17:0/2840502508 shutdown_connections 2023-07-14T13:10:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.283+0000 7f2d43002b80 1 -- 172.21.15.17:0/2840502508 wait complete. 2023-07-14T13:10:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.284+0000 7f2d43002b80 1 -- start start 2023-07-14T13:10:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.284+0000 7f2d43002b80 1 Processor -- start 2023-07-14T13:10:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.284+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b61910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.284+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 0x55f2d6b5ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b5f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d43002b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d6a42a60 con 0x55f2d6b55ff0 2023-07-14T13:10:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d43002b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d6a42760 con 0x55f2d69ad6b0 2023-07-14T13:10:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d43002b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d69268c0 con 0x55f2d6b55b80 2023-07-14T13:10:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d43002b80 10 client.0 _ll_register_callbacks cb 0x55f2d6a40700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d2cb9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b61910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d2d39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 0x55f2d6b5ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d2cb9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b5f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d2d39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 0x55f2d6b5ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:56974/0 (socket says 172.21.15.17:56974) 2023-07-14T13:10:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d2d39b700 1 -- 172.21.15.17:0/471389872 learned_addr learned my addr 172.21.15.17:0/471389872 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d2cb9a700 1 -- 172.21.15.17:0/471389872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 msgr2=0x55f2d6b5ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/471389872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 0x55f2d6b5ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d2cb9a700 1 -- 172.21.15.17:0/471389872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55ff0 msgr2=0x55f2d6b5f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/471389872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b5f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.285+0000 7f2d2cb9a700 1 -- 172.21.15.17:0/471389872 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d18020040 con 0x55f2d69ad6b0 2023-07-14T13:10:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.286+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/471389872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b61910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005750 tx=0x7f2d18009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8660f13173746231 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.286+0000 7f2d10ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:10:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.286+0000 7f2d10ff9700 1 -- 172.21.15.17:0/471389872 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18030070 con 0x55f2d69ad6b0 2023-07-14T13:10:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.286+0000 7f2d43002b80 1 -- 172.21.15.17:0/471389872 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2d69fc490 con 0x55f2d69ad6b0 2023-07-14T13:10:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.286+0000 7f2d10ff9700 1 -- 172.21.15.17:0/471389872 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2d1800be50 con 0x55f2d69ad6b0 2023-07-14T13:10:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.286+0000 7f2d10ff9700 1 -- 172.21.15.17:0/471389872 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d18005020 con 0x55f2d69ad6b0 2023-07-14T13:10:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.287+0000 7f2d43002b80 10 client.27206 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.287+0000 7f2d43002b80 1 -- 172.21.15.17:0/471389872 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f2d24009c90 con 0x55f2d69ad6b0 2023-07-14T13:10:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.287+0000 7f2d10ff9700 1 -- 172.21.15.17:0/471389872 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f2d69fc490 con 0x55f2d69ad6b0 2023-07-14T13:10:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.287+0000 7f2d10ff9700 1 -- 172.21.15.17:0/471389872 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f2d18033020 con 0x55f2d69ad6b0 2023-07-14T13:10:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.287+0000 7f2d43002b80 10 client.27206 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.287+0000 7f2d43002b80 10 client.27206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.287+0000 7f2d43002b80 20 client.27206 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.287+0000 7f2d43002b80 1 --2- 172.21.15.17:0/471389872 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f2d6b6ef60 0x55f2d6b71370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.288+0000 7f2d43002b80 4 client.27206 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:10:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.288+0000 7f2d43002b80 1 -- 172.21.15.17:0/471389872 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2d6a9be50 con 0x55f2d6b6ef60 2023-07-14T13:10:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.288+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/471389872 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f2d6b6ef60 0x55f2d6b71370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.289+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/471389872 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f2d6b6ef60 0x55f2d6b71370 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd6c8a10cc0a7200 server_cookie=7026dfd2cfc76747 in_seq=0 out_seq=0 2023-07-14T13:10:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.289+0000 7f2d10ff9700 10 client.27206 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d10ff9700 1 -- 172.21.15.17:0/471389872 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f2d6a9be50 con 0x55f2d6b6ef60 2023-07-14T13:10:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d10ff9700 10 client.27206 handle_command_reply: tid=0 2023-07-14T13:10:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d43002b80 1 client.27206 shutdown 2023-07-14T13:10:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d43002b80 1 -- 172.21.15.17:0/471389872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 msgr2=0x55f2d6b61910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d43002b80 1 --2- 172.21.15.17:0/471389872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b61910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005750 tx=0x7f2d18009ca0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d43002b80 1 -- 172.21.15.17:0/471389872 shutdown_connections 2023-07-14T13:10:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d43002b80 1 --2- 172.21.15.17:0/471389872 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f2d6b6ef60 0x55f2d6b71370 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d43002b80 1 --2- 172.21.15.17:0/471389872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b5f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d43002b80 1 --2- 172.21.15.17:0/471389872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b61910 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d43002b80 1 --2- 172.21.15.17:0/471389872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 0x55f2d6b5ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d10ff9700 0 client.27206 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d43002b80 1 -- 172.21.15.17:0/471389872 >> 172.21.15.17:0/471389872 conn(0x55f2d6b46be0 msgr2=0x55f2d6b4b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d43002b80 1 -- 172.21.15.17:0/471389872 shutdown_connections 2023-07-14T13:10:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.290+0000 7f2d43002b80 1 -- 172.21.15.17:0/471389872 wait complete. 2023-07-14T13:10:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.291+0000 7f2d43002b80 20 client.27206 trim_cache size 0 max 16384 2023-07-14T13:10:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.311+0000 7f2d43002b80 1 Processor -- start 2023-07-14T13:10:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.311+0000 7f2d43002b80 1 -- start start 2023-07-14T13:10:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.311+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b66120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55b80 0x55f2d6b5c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b4bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d43002b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d6b43c00 con 0x55f2d6b55b80 2023-07-14T13:10:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d43002b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d6b17060 con 0x55f2d69ad6b0 2023-07-14T13:10:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d43002b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d6b6b8e0 con 0x55f2d6b55ff0 2023-07-14T13:10:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d2cb9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b66120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d2d39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55b80 0x55f2d6b5c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d2cb9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b66120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:48824/0 (socket says 172.21.15.17:48824) 2023-07-14T13:10:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d2cb9a700 1 -- 172.21.15.17:0/3437745153 learned_addr learned my addr 172.21.15.17:0/3437745153 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/3437745153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b4bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d2d39b700 1 -- 172.21.15.17:0/3437745153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55ff0 msgr2=0x55f2d6b4bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/3437745153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b4bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d2d39b700 1 -- 172.21.15.17:0/3437745153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 msgr2=0x55f2d6b66120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/3437745153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b66120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d2d39b700 1 -- 172.21.15.17:0/3437745153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2d68b9c00 con 0x55f2d6b55b80 2023-07-14T13:10:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.312+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/3437745153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b66120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:10:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.313+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/3437745153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55b80 0x55f2d6b5c460 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009790 tx=0x7f2d24004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b6b1908fad9153 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.313+0000 7f2d13fff700 1 -- 172.21.15.17:0/3437745153 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2402ad30 con 0x55f2d6b55b80 2023-07-14T13:10:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.313+0000 7f2d13fff700 1 -- 172.21.15.17:0/3437745153 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d24020040 con 0x55f2d6b55b80 2023-07-14T13:10:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.313+0000 7f2d13fff700 1 -- 172.21.15.17:0/3437745153 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d240053c0 con 0x55f2d6b55b80 2023-07-14T13:10:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.314+0000 7f2d43002b80 1 -- 172.21.15.17:0/3437745153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55b80 msgr2=0x55f2d6b5c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.314+0000 7f2d43002b80 1 --2- 172.21.15.17:0/3437745153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55b80 0x55f2d6b5c460 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009790 tx=0x7f2d24004630 comp rx=0 tx=0).stop 2023-07-14T13:10:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.314+0000 7f2d43002b80 1 -- 172.21.15.17:0/3437745153 shutdown_connections 2023-07-14T13:10:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.314+0000 7f2d43002b80 1 --2- 172.21.15.17:0/3437745153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55ff0 0x55f2d6b4bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.314+0000 7f2d43002b80 1 --2- 172.21.15.17:0/3437745153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b66120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.314+0000 7f2d43002b80 1 --2- 172.21.15.17:0/3437745153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d6b55b80 0x55f2d6b5c460 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.314+0000 7f2d43002b80 1 -- 172.21.15.17:0/3437745153 >> 172.21.15.17:0/3437745153 conn(0x55f2d6b46be0 msgr2=0x55f2d6b508c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.314+0000 7f2d43002b80 1 -- 172.21.15.17:0/3437745153 shutdown_connections 2023-07-14T13:10:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.314+0000 7f2d43002b80 1 -- 172.21.15.17:0/3437745153 wait complete. 2023-07-14T13:10:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.315+0000 7f2d43002b80 1 -- start start 2023-07-14T13:10:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.315+0000 7f2d43002b80 1 Processor -- start 2023-07-14T13:10:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.316+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b64300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.316+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 0x55f2d6b64840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.316+0000 7f2d43002b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d6b55ff0 0x55f2d6bc1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.316+0000 7f2d43002b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d6bc2320 con 0x55f2d69ad6b0 2023-07-14T13:10:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.316+0000 7f2d43002b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d6bc2460 con 0x55f2d6b55ff0 2023-07-14T13:10:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.316+0000 7f2d43002b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2d6bc25d0 con 0x55f2d6b55b80 2023-07-14T13:10:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.316+0000 7f2d43002b80 10 client.0 _ll_register_callbacks cb 0x7f2d1802b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:10:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.316+0000 7f2d2cb9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b64300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.316+0000 7f2d2cb9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b64300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51568/0 (socket says 172.21.15.17:51568) 2023-07-14T13:10:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.316+0000 7f2d2cb9a700 1 -- 172.21.15.17:0/812831777 learned_addr learned my addr 172.21.15.17:0/812831777 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:10:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.316+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d6b55ff0 0x55f2d6bc1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 0x55f2d6b64840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d2cb9a700 1 -- 172.21.15.17:0/812831777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 msgr2=0x55f2d6b64840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 0x55f2d6b64840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d2cb9a700 1 -- 172.21.15.17:0/812831777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d6b55ff0 msgr2=0x55f2d6bc1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:10:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d6b55ff0 0x55f2d6bc1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d2cb9a700 1 -- 172.21.15.17:0/812831777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d24009c90 con 0x55f2d69ad6b0 2023-07-14T13:10:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 0x55f2d6b64840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:10:49.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d2cb9a700 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b64300 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2d1802b880 tx=0x7f2d18005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aee97f300bafb2c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:10:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d10ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:10:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d10ff9700 1 -- 172.21.15.17:0/812831777 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18030040 con 0x55f2d69ad6b0 2023-07-14T13:10:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d10ff9700 1 -- 172.21.15.17:0/812831777 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2d18000e40 con 0x55f2d69ad6b0 2023-07-14T13:10:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.317+0000 7f2d43002b80 1 -- 172.21.15.17:0/812831777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d240044c0 con 0x55f2d69ad6b0 2023-07-14T13:10:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.318+0000 7f2d10ff9700 1 -- 172.21.15.17:0/812831777 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d180051c0 con 0x55f2d69ad6b0 2023-07-14T13:10:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.318+0000 7f2d43002b80 10 client.17487 fetch_fsmap learned FSMap version 34 2023-07-14T13:10:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.318+0000 7f2d43002b80 1 -- 172.21.15.17:0/812831777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f2d68d0d80 con 0x55f2d69ad6b0 2023-07-14T13:10:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.318+0000 7f2d10ff9700 1 -- 172.21.15.17:0/812831777 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d240044c0 con 0x55f2d69ad6b0 2023-07-14T13:10:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.318+0000 7f2d10ff9700 1 -- 172.21.15.17:0/812831777 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f2d180099c0 con 0x55f2d69ad6b0 2023-07-14T13:10:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.319+0000 7f2d43002b80 10 client.17487 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:10:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.319+0000 7f2d43002b80 10 client.17487 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:10:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.319+0000 7f2d43002b80 20 client.17487 populate_metadata read hostname 'smithi017' 2023-07-14T13:10:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.319+0000 7f2d43002b80 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f2d6bc3950 0x55f2d6bc5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:10:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.319+0000 7f2d43002b80 4 client.17487 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:10:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.319+0000 7f2d43002b80 1 -- 172.21.15.17:0/812831777 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f2d6a5dff0 con 0x55f2d6bc3950 2023-07-14T13:10:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.319+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f2d6bc3950 0x55f2d6bc5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:10:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.321+0000 7f2d2d39b700 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f2d6bc3950 0x55f2d6bc5d60 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=380ea2fd31a39294 server_cookie=d5b3c4d9c3b5e0b6 in_seq=0 out_seq=0 2023-07-14T13:10:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.321+0000 7f2d10ff9700 10 client.17487 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.339+0000 7f2d10ff9700 1 -- 172.21.15.17:0/812831777 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f2d6a5dff0 con 0x55f2d6bc3950 2023-07-14T13:10:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.339+0000 7f2d10ff9700 10 client.17487 handle_command_reply: tid=0 2023-07-14T13:10:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.339+0000 7f2d43002b80 1 client.17487 shutdown 2023-07-14T13:10:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d43002b80 1 -- 172.21.15.17:0/812831777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d69ad6b0 msgr2=0x55f2d6b64300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d43002b80 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b64300 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2d1802b880 tx=0x7f2d18005550 comp rx=0 tx=0).stop 2023-07-14T13:10:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d43002b80 1 -- 172.21.15.17:0/812831777 shutdown_connections 2023-07-14T13:10:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d43002b80 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f2d6bc3950 0x55f2d6bc5d60 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d43002b80 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f2d6b55ff0 0x55f2d6bc1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d43002b80 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f2d69ad6b0 0x55f2d6b64300 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d43002b80 1 --2- 172.21.15.17:0/812831777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f2d6b55b80 0x55f2d6b64840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d43002b80 1 -- 172.21.15.17:0/812831777 >> 172.21.15.17:0/812831777 conn(0x55f2d6b46be0 msgr2=0x55f2d6b6a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d10ff9700 0 client.17487 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:10:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d43002b80 1 -- 172.21.15.17:0/812831777 shutdown_connections 2023-07-14T13:10:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d43002b80 1 -- 172.21.15.17:0/812831777 wait complete. 2023-07-14T13:10:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.340+0000 7f2d43002b80 20 client.17487 trim_cache size 0 max 16384 2023-07-14T13:10:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:10:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:10:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:10:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:10:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/1115218112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d140a12c0 msgr2=0x7f2d140a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d140a12c0 0x7f2d140a3770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2d200c9fb0 tx=0x7f2d20004c50 comp rx=0 tx=0).stop 2023-07-14T13:10:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/1115218112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d28105b60 msgr2=0x7f2d28195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:10:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d28105b60 0x7f2d28195910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000efc0 tx=0x7f2d2000c3a0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/1115218112 shutdown_connections 2023-07-14T13:10:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d140a12c0 0x7f2d140a3770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d28105b60 0x7f2d28195910 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d280ffb30 0x7f2d2819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 --2- 172.21.15.17:0/1115218112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d281004e0 0x7f2d2819bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:10:49.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/1115218112 >> 172.21.15.17:0/1115218112 conn(0x7f2d280fb5f0 msgr2=0x7f2d281037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:10:49.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/1115218112 shutdown_connections 2023-07-14T13:10:49.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:10:49.341+0000 7f2d2f5ff700 1 -- 172.21.15.17:0/1115218112 wait complete. 2023-07-14T13:10:49.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:49 smithi135 ceph-mon[97338]: pgmap v345: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 17 MiB/s wr, 63 op/s 2023-07-14T13:10:49.489 INFO:teuthology.orchestra.run.smithi017.stderr:43300000 of 50000000 tuples (86%) done (elapsed 639.09 s, remaining 98.89 s) 2023-07-14T13:10:49.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:49 smithi131 ceph-mon[96953]: pgmap v345: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 17 MiB/s wr, 63 op/s 2023-07-14T13:10:49.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:49 smithi017 ceph-mon[95536]: pgmap v345: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 17 MiB/s wr, 63 op/s 2023-07-14T13:10:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:43400000 of 50000000 tuples (86%) done (elapsed 640.40 s, remaining 97.39 s) 2023-07-14T13:10:51.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:51 smithi135 ceph-mon[97338]: pgmap v346: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 18 MiB/s wr, 73 op/s 2023-07-14T13:10:51.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:51 smithi131 ceph-mon[96953]: pgmap v346: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 18 MiB/s wr, 73 op/s 2023-07-14T13:10:51.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:51 smithi017 ceph-mon[95536]: pgmap v346: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 18 MiB/s wr, 73 op/s 2023-07-14T13:10:52.261 INFO:teuthology.orchestra.run.smithi017.stderr:43500000 of 50000000 tuples (87%) done (elapsed 641.86 s, remaining 95.91 s) 2023-07-14T13:10:53.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:53 smithi135 ceph-mon[97338]: pgmap v347: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.6 MiB/s wr, 34 op/s 2023-07-14T13:10:53.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:53 smithi131 ceph-mon[96953]: pgmap v347: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.6 MiB/s wr, 34 op/s 2023-07-14T13:10:53.611 INFO:teuthology.orchestra.run.smithi017.stderr:43600000 of 50000000 tuples (87%) done (elapsed 643.21 s, remaining 94.42 s) 2023-07-14T13:10:53.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:53 smithi017 ceph-mon[95536]: pgmap v347: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.6 MiB/s wr, 34 op/s 2023-07-14T13:10:54.975 INFO:teuthology.orchestra.run.smithi017.stderr:43700000 of 50000000 tuples (87%) done (elapsed 644.57 s, remaining 92.92 s) 2023-07-14T13:10:55.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:55 smithi135 ceph-mon[97338]: pgmap v348: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.6 MiB/s wr, 34 op/s 2023-07-14T13:10:55.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:55 smithi131 ceph-mon[96953]: pgmap v348: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.6 MiB/s wr, 34 op/s 2023-07-14T13:10:55.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:55 smithi017 ceph-mon[95536]: pgmap v348: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 7.6 MiB/s wr, 34 op/s 2023-07-14T13:10:56.317 INFO:teuthology.orchestra.run.smithi017.stderr:43800000 of 50000000 tuples (87%) done (elapsed 645.92 s, remaining 91.43 s) 2023-07-14T13:10:57.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:57 smithi135 ceph-mon[97338]: pgmap v349: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 18 MiB/s wr, 66 op/s 2023-07-14T13:10:57.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:57 smithi131 ceph-mon[96953]: pgmap v349: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 18 MiB/s wr, 66 op/s 2023-07-14T13:10:57.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:57 smithi017 ceph-mon[95536]: pgmap v349: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 18 MiB/s wr, 66 op/s 2023-07-14T13:10:57.715 INFO:teuthology.orchestra.run.smithi017.stderr:43900000 of 50000000 tuples (87%) done (elapsed 647.31 s, remaining 89.95 s) 2023-07-14T13:10:59.001 INFO:teuthology.orchestra.run.smithi017.stderr:44000000 of 50000000 tuples (88%) done (elapsed 648.60 s, remaining 88.45 s) 2023-07-14T13:10:59.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:10:59 smithi135 ceph-mon[97338]: pgmap v350: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 12 MiB/s wr, 42 op/s 2023-07-14T13:10:59.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:10:59 smithi131 ceph-mon[96953]: pgmap v350: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 12 MiB/s wr, 42 op/s 2023-07-14T13:10:59.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:10:59 smithi017 ceph-mon[95536]: pgmap v350: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 12 MiB/s wr, 42 op/s 2023-07-14T13:11:00.333 INFO:teuthology.orchestra.run.smithi017.stderr:44100000 of 50000000 tuples (88%) done (elapsed 649.93 s, remaining 86.95 s) 2023-07-14T13:11:01.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:01 smithi135 ceph-mon[97338]: pgmap v351: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 24 MiB/s wr, 75 op/s 2023-07-14T13:11:01.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:01 smithi131 ceph-mon[96953]: pgmap v351: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 24 MiB/s wr, 75 op/s 2023-07-14T13:11:01.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:01 smithi017 ceph-mon[95536]: pgmap v351: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 24 MiB/s wr, 75 op/s 2023-07-14T13:11:01.786 INFO:teuthology.orchestra.run.smithi017.stderr:44200000 of 50000000 tuples (88%) done (elapsed 651.38 s, remaining 85.48 s) 2023-07-14T13:11:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.516+0000 7fb9c6fff700 1 -- 172.21.15.17:0/708888126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c00685b0 msgr2=0x7fb9c0104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.516+0000 7fb9c6fff700 1 --2- 172.21.15.17:0/708888126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c00685b0 0x7fb9c0104770 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0099c0 tx=0x7fb9ac009cd0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.516+0000 7fb9c6fff700 1 -- 172.21.15.17:0/708888126 shutdown_connections 2023-07-14T13:11:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.516+0000 7fb9c6fff700 1 --2- 172.21.15.17:0/708888126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9c0104e50 0x7fb9c010ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.516+0000 7fb9c6fff700 1 --2- 172.21.15.17:0/708888126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c0067c10 0x7fb9c0067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.516+0000 7fb9c6fff700 1 --2- 172.21.15.17:0/708888126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c00685b0 0x7fb9c0104770 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.516+0000 7fb9c6fff700 1 -- 172.21.15.17:0/708888126 >> 172.21.15.17:0/708888126 conn(0x7fb9c0074760 msgr2=0x7fb9c0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.516+0000 7fb9c6fff700 1 -- 172.21.15.17:0/708888126 shutdown_connections 2023-07-14T13:11:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.516+0000 7fb9c6fff700 1 -- 172.21.15.17:0/708888126 wait complete. 2023-07-14T13:11:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.517+0000 7fb9c6fff700 1 Processor -- start 2023-07-14T13:11:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9c6fff700 1 -- start start 2023-07-14T13:11:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9c6fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9c0067c10 0x7fb9c019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9c6fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00685b0 0x7fb9c019c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9c6fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c0104e50 0x7fb9c0195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9c6fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0195ff0 con 0x7fb9c0104e50 2023-07-14T13:11:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9c6fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0196160 con 0x7fb9c00685b0 2023-07-14T13:11:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9c6fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0196320 con 0x7fb9c0067c10 2023-07-14T13:11:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9c4d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9c0067c10 0x7fb9c019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9c559c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c0104e50 0x7fb9c0195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9bffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00685b0 0x7fb9c019c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9c4d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9c0067c10 0x7fb9c019bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48526/0 (socket says 172.21.15.17:48526) 2023-07-14T13:11:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.518+0000 7fb9c4d9b700 1 -- 172.21.15.17:0/2127173816 learned_addr learned my addr 172.21.15.17:0/2127173816 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.519+0000 7fb9bffff700 1 -- 172.21.15.17:0/2127173816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9c0067c10 msgr2=0x7fb9c019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.519+0000 7fb9bffff700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9c0067c10 0x7fb9c019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.519+0000 7fb9bffff700 1 -- 172.21.15.17:0/2127173816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c0104e50 msgr2=0x7fb9c0195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.519+0000 7fb9bffff700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c0104e50 0x7fb9c0195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.519+0000 7fb9bffff700 1 -- 172.21.15.17:0/2127173816 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0095f0 con 0x7fb9c00685b0 2023-07-14T13:11:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.519+0000 7fb9c559c700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c0104e50 0x7fb9c0195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.519+0000 7fb9bffff700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00685b0 0x7fb9c019c060 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0098e0 tx=0x7fb9ac00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.519+0000 7fb9bdffb700 1 -- 172.21.15.17:0/2127173816 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac01d070 con 0x7fb9c00685b0 2023-07-14T13:11:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.519+0000 7fb9bdffb700 1 -- 172.21.15.17:0/2127173816 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9ac005050 con 0x7fb9c00685b0 2023-07-14T13:11:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.519+0000 7fb9bdffb700 1 -- 172.21.15.17:0/2127173816 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac004950 con 0x7fb9c00685b0 2023-07-14T13:11:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.519+0000 7fb9c6fff700 1 -- 172.21.15.17:0/2127173816 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c01965a0 con 0x7fb9c00685b0 2023-07-14T13:11:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.520+0000 7fb9c6fff700 1 -- 172.21.15.17:0/2127173816 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c01967f0 con 0x7fb9c00685b0 2023-07-14T13:11:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.523+0000 7fb9bdffb700 1 -- 172.21.15.17:0/2127173816 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb9ac0051c0 con 0x7fb9c00685b0 2023-07-14T13:11:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.525+0000 7fb9da9afb80 1 Processor -- start 2023-07-14T13:11:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.525+0000 7fb9bdffb700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9b00a12c0 0x7fb9b00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.525+0000 7fb9da9afb80 1 -- start start 2023-07-14T13:11:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.525+0000 7fb9bdffb700 1 -- 172.21.15.17:0/2127173816 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb9ac0cd7e0 con 0x7fb9c00685b0 2023-07-14T13:11:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.525+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fe6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.525+0000 7fb9c559c700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9b00a12c0 0x7fb9b00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.525+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6680 0x55c027fe0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.525+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6ad0 0x55c027fe09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.525+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c027ee1c50 con 0x55c027e386b0 2023-07-14T13:11:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.525+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c027f349e0 con 0x55c027fe6680 2023-07-14T13:11:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.525+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c027f2de70 con 0x55c027fe6ad0 2023-07-14T13:11:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9c4d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fe6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9bffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6680 0x55c027fe0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9bffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6680 0x55c027fe0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58496/0 (socket says 172.21.15.17:58496) 2023-07-14T13:11:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9bffff700 1 -- 172.21.15.17:0/1193177497 learned_addr learned my addr 172.21.15.17:0/1193177497 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9c559c700 1 --2- 172.21.15.17:0/1193177497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6ad0 0x55c027fe09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9c4d9b700 1 -- 172.21.15.17:0/1193177497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6ad0 msgr2=0x55c027fe09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9c4d9b700 1 --2- 172.21.15.17:0/1193177497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6ad0 0x55c027fe09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9c4d9b700 1 -- 172.21.15.17:0/1193177497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6680 msgr2=0x55c027fe0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9c4d9b700 1 --2- 172.21.15.17:0/1193177497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6680 0x55c027fe0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9c4d9b700 1 -- 172.21.15.17:0/1193177497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c027d5bd80 con 0x55c027e386b0 2023-07-14T13:11:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9c559c700 1 --2- 172.21.15.17:0/1193177497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6ad0 0x55c027fe09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:11:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.526+0000 7fb9c4d9b700 1 --2- 172.21.15.17:0/1193177497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fe6140 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009d10 tx=0x7fb9b4011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac72346449eba01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.527+0000 7fb9c559c700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9b00a12c0 0x7fb9b00a3770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb9c019c820 tx=0x7fb9b8009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.527+0000 7fb9aaffd700 1 -- 172.21.15.17:0/1193177497 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4004250 con 0x55c027e386b0 2023-07-14T13:11:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.527+0000 7fb9aaffd700 1 -- 172.21.15.17:0/1193177497 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9b4004cc0 con 0x55c027e386b0 2023-07-14T13:11:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.527+0000 7fb9aaffd700 1 -- 172.21.15.17:0/1193177497 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4005410 con 0x55c027e386b0 2023-07-14T13:11:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.528+0000 7fb9da9afb80 1 -- 172.21.15.17:0/1193177497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 msgr2=0x55c027fe6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.528+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/1193177497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fe6140 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009d10 tx=0x7fb9b4011720 comp rx=0 tx=0).stop 2023-07-14T13:11:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.528+0000 7fb9da9afb80 1 -- 172.21.15.17:0/1193177497 shutdown_connections 2023-07-14T13:11:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.528+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/1193177497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6ad0 0x55c027fe09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.528+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/1193177497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fe6140 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.528+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/1193177497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6680 0x55c027fe0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.528+0000 7fb9da9afb80 1 -- 172.21.15.17:0/1193177497 >> 172.21.15.17:0/1193177497 conn(0x55c027fd1be0 msgr2=0x55c027fd6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.528+0000 7fb9da9afb80 1 -- 172.21.15.17:0/1193177497 shutdown_connections 2023-07-14T13:11:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.528+0000 7fb9da9afb80 1 -- 172.21.15.17:0/1193177497 wait complete. 2023-07-14T13:11:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.529+0000 7fb9da9afb80 1 -- start start 2023-07-14T13:11:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.529+0000 7fb9da9afb80 1 Processor -- start 2023-07-14T13:11:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027e386b0 0x55c027fec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fe9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027fe6ad0 0x55c027fea180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c027ecda60 con 0x55c027fe6ad0 2023-07-14T13:11:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c027ecd760 con 0x55c027e386b0 2023-07-14T13:11:02.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c027db18c0 con 0x55c027fe6680 2023-07-14T13:11:02.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9da9afb80 10 client.0 _ll_register_callbacks cb 0x55c027ecb700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:02.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9c4d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027e386b0 0x55c027fec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9c559c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027fe6ad0 0x55c027fea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9c559c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027fe6ad0 0x55c027fea180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45214/0 (socket says 172.21.15.17:45214) 2023-07-14T13:11:02.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9c559c700 1 -- 172.21.15.17:0/598120757 learned_addr learned my addr 172.21.15.17:0/598120757 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:02.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.530+0000 7fb9c4d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027e386b0 0x55c027fec8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58498/0 (socket says 172.21.15.17:58498) 2023-07-14T13:11:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.531+0000 7fb9c4d9b700 1 -- 172.21.15.17:0/598120757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 msgr2=0x55c027fe9c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:11:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.531+0000 7fb9c4d9b700 1 --2- 172.21.15.17:0/598120757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fe9c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.531+0000 7fb9c4d9b700 1 -- 172.21.15.17:0/598120757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027fe6ad0 msgr2=0x55c027fea180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.531+0000 7fb9c4d9b700 1 --2- 172.21.15.17:0/598120757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027fe6ad0 0x55c027fea180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.531+0000 7fb9c4d9b700 1 -- 172.21.15.17:0/598120757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b4009970 con 0x55c027e386b0 2023-07-14T13:11:02.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.531+0000 7fb9c4d9b700 1 --2- 172.21.15.17:0/598120757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027e386b0 0x55c027fec8e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40044a0 tx=0x7fb9b4005d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac32b45338f156d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.532+0000 7fb99ffff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:11:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.532+0000 7fb99ffff700 1 -- 172.21.15.17:0/598120757 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4004a10 con 0x55c027e386b0 2023-07-14T13:11:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.532+0000 7fb99ffff700 1 -- 172.21.15.17:0/598120757 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb9b4005000 con 0x55c027e386b0 2023-07-14T13:11:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.532+0000 7fb9da9afb80 1 -- 172.21.15.17:0/598120757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c027e87490 con 0x55c027e386b0 2023-07-14T13:11:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.532+0000 7fb99ffff700 1 -- 172.21.15.17:0/598120757 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9b4005200 con 0x55c027e386b0 2023-07-14T13:11:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.532+0000 7fb9da9afb80 10 client.27224 fetch_fsmap learned FSMap version 34 2023-07-14T13:11:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.532+0000 7fb9da9afb80 1 -- 172.21.15.17:0/598120757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c027d44c00 con 0x55c027e386b0 2023-07-14T13:11:02.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.533+0000 7fb99ffff700 1 -- 172.21.15.17:0/598120757 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c027e87490 con 0x55c027e386b0 2023-07-14T13:11:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.533+0000 7fb99ffff700 1 -- 172.21.15.17:0/598120757 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7fb9b4022400 con 0x55c027e386b0 2023-07-14T13:11:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.533+0000 7fb9da9afb80 10 client.27224 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:11:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.533+0000 7fb9da9afb80 10 client.27224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.533+0000 7fb9da9afb80 20 client.27224 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.533+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/598120757 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c027fdfd60 0x55c028000980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.533+0000 7fb9da9afb80 4 client.27224 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:11:02.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.533+0000 7fb9da9afb80 1 -- 172.21.15.17:0/598120757 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c027f26e50 con 0x55c027fdfd60 2023-07-14T13:11:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.533+0000 7fb9bffff700 1 --2- 172.21.15.17:0/598120757 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c027fdfd60 0x55c028000980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.534+0000 7fb9bffff700 1 --2- 172.21.15.17:0/598120757 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c027fdfd60 0x55c028000980 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be5c274f2ec3dbef server_cookie=2a8a304582a63386 in_seq=0 out_seq=0 2023-07-14T13:11:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.534+0000 7fb99ffff700 10 client.27224 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb99ffff700 1 -- 172.21.15.17:0/598120757 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c027f26e50 con 0x55c027fdfd60 2023-07-14T13:11:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb99ffff700 10 client.27224 handle_command_reply: tid=0 2023-07-14T13:11:02.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb9da9afb80 1 client.27224 shutdown 2023-07-14T13:11:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb9da9afb80 1 -- 172.21.15.17:0/598120757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027e386b0 msgr2=0x55c027fec8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/598120757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027e386b0 0x55c027fec8e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40044a0 tx=0x7fb9b4005d90 comp rx=0 tx=0).stop 2023-07-14T13:11:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb9da9afb80 1 -- 172.21.15.17:0/598120757 shutdown_connections 2023-07-14T13:11:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/598120757 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c027fdfd60 0x55c028000980 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/598120757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027fe6ad0 0x55c027fea180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/598120757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027e386b0 0x55c027fec8e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb99ffff700 0 client.27224 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/598120757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fe9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.535+0000 7fb9da9afb80 1 -- 172.21.15.17:0/598120757 >> 172.21.15.17:0/598120757 conn(0x55c027fd1be0 msgr2=0x55c027fd5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.536+0000 7fb9da9afb80 1 -- 172.21.15.17:0/598120757 shutdown_connections 2023-07-14T13:11:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.536+0000 7fb9da9afb80 1 -- 172.21.15.17:0/598120757 wait complete. 2023-07-14T13:11:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.536+0000 7fb9da9afb80 20 client.27224 trim_cache size 0 max 16384 2023-07-14T13:11:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.559+0000 7fb9da9afb80 1 Processor -- start 2023-07-14T13:11:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.559+0000 7fb9da9afb80 1 -- start start 2023-07-14T13:11:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fe7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fe0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6ad0 0x55c027fec410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c027e87490 con 0x55c027e386b0 2023-07-14T13:11:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c027fa2060 con 0x55c027fe6ad0 2023-07-14T13:11:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c027feb1e0 con 0x55c027fe6680 2023-07-14T13:11:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9bffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fe0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9c4d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fe7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9bffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fe0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48548/0 (socket says 172.21.15.17:48548) 2023-07-14T13:11:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9bffff700 1 -- 172.21.15.17:0/3851107202 learned_addr learned my addr 172.21.15.17:0/3851107202 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9c4d9b700 1 --2- 172.21.15.17:0/3851107202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fe7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45230/0 (socket says 172.21.15.17:45230) 2023-07-14T13:11:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.560+0000 7fb9c559c700 1 --2- 172.21.15.17:0/3851107202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6ad0 0x55c027fec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.561+0000 7fb9bffff700 1 -- 172.21.15.17:0/3851107202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6ad0 msgr2=0x55c027fec410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.561+0000 7fb9bffff700 1 --2- 172.21.15.17:0/3851107202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6ad0 0x55c027fec410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.561+0000 7fb9bffff700 1 -- 172.21.15.17:0/3851107202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 msgr2=0x55c027fe7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.561+0000 7fb9bffff700 1 --2- 172.21.15.17:0/3851107202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fe7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.561+0000 7fb9bffff700 1 -- 172.21.15.17:0/3851107202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c027d821f0 con 0x55c027fe6680 2023-07-14T13:11:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.561+0000 7fb9bffff700 1 --2- 172.21.15.17:0/3851107202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fe0990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac096db0 tx=0x7fb9ac0ba040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a91f2e81d7d27099 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.561+0000 7fb9ab7fe700 1 -- 172.21.15.17:0/3851107202 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0b8ea0 con 0x55c027fe6680 2023-07-14T13:11:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.561+0000 7fb9ab7fe700 1 -- 172.21.15.17:0/3851107202 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9ac098ca0 con 0x55c027fe6680 2023-07-14T13:11:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.561+0000 7fb9ab7fe700 1 -- 172.21.15.17:0/3851107202 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac09ab60 con 0x55c027fe6680 2023-07-14T13:11:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.562+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3851107202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 msgr2=0x55c027fe0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.562+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/3851107202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fe0990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac096db0 tx=0x7fb9ac0ba040 comp rx=0 tx=0).stop 2023-07-14T13:11:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.563+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3851107202 shutdown_connections 2023-07-14T13:11:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.563+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/3851107202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6ad0 0x55c027fec410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.563+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/3851107202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fe7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.563+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/3851107202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fe0990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.563+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3851107202 >> 172.21.15.17:0/3851107202 conn(0x55c027fd1be0 msgr2=0x55c027fe0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.563+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3851107202 shutdown_connections 2023-07-14T13:11:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.563+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3851107202 wait complete. 2023-07-14T13:11:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.564+0000 7fb9da9afb80 1 -- start start 2023-07-14T13:11:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.565+0000 7fb9da9afb80 1 Processor -- start 2023-07-14T13:11:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.565+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fef280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.565+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.565+0000 7fb9da9afb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6ad0 0x55c02804b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.565+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02804b630 con 0x55c027e386b0 2023-07-14T13:11:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.565+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02804b7a0 con 0x55c027fe6ad0 2023-07-14T13:11:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.565+0000 7fb9da9afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02804b960 con 0x55c027fe6680 2023-07-14T13:11:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.565+0000 7fb9da9afb80 10 client.0 _ll_register_callbacks cb 0x7fb9ac096d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.566+0000 7fb9bffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.566+0000 7fb9bffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fef7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48558/0 (socket says 172.21.15.17:48558) 2023-07-14T13:11:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.566+0000 7fb9c4d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.566+0000 7fb9bffff700 1 -- 172.21.15.17:0/3952965671 learned_addr learned my addr 172.21.15.17:0/3952965671 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.566+0000 7fb9c559c700 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6ad0 0x55c02804b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.566+0000 7fb9bffff700 1 -- 172.21.15.17:0/3952965671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6ad0 msgr2=0x55c02804b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.566+0000 7fb9bffff700 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6ad0 0x55c02804b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.566+0000 7fb9bffff700 1 -- 172.21.15.17:0/3952965671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 msgr2=0x55c027fef280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.566+0000 7fb9bffff700 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fef280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.566+0000 7fb9bffff700 1 -- 172.21.15.17:0/3952965671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c01965a0 con 0x55c027fe6680 2023-07-14T13:11:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.567+0000 7fb9bffff700 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fef7c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009d50 tx=0x7fb9ac09a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8422e7fc8ecf9792 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.567+0000 7fb99ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:11:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.567+0000 7fb99ffff700 1 -- 172.21.15.17:0/3952965671 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0b8c00 con 0x55c027fe6680 2023-07-14T13:11:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.567+0000 7fb99ffff700 1 -- 172.21.15.17:0/3952965671 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb9ac099df0 con 0x55c027fe6680 2023-07-14T13:11:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.568+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3952965671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9b4004cc0 con 0x55c027fe6680 2023-07-14T13:11:02.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.568+0000 7fb99ffff700 1 -- 172.21.15.17:0/3952965671 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9ac0056b0 con 0x55c027fe6680 2023-07-14T13:11:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.568+0000 7fb9da9afb80 10 client.27199 fetch_fsmap learned FSMap version 34 2023-07-14T13:11:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.568+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3952965671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c027d5a250 con 0x55c027fe6680 2023-07-14T13:11:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.568+0000 7fb99ffff700 1 -- 172.21.15.17:0/3952965671 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9b4004cc0 con 0x55c027fe6680 2023-07-14T13:11:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.569+0000 7fb99ffff700 1 -- 172.21.15.17:0/3952965671 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7fb9ac0a28c0 con 0x55c027fe6680 2023-07-14T13:11:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.569+0000 7fb9da9afb80 10 client.27199 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:11:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.569+0000 7fb9da9afb80 10 client.27199 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.569+0000 7fb9da9afb80 20 client.27199 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.569+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c028052d30 0x55c028055140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.569+0000 7fb9da9afb80 4 client.27199 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:11:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.569+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3952965671 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c027ee8ff0 con 0x55c028052d30 2023-07-14T13:11:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.570+0000 7fb9c4d9b700 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c028052d30 0x55c028055140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.571+0000 7fb9c4d9b700 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c028052d30 0x55c028055140 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdef64c1e7c53618 server_cookie=ba1c78f4de2321ea in_seq=0 out_seq=0 2023-07-14T13:11:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.571+0000 7fb99ffff700 10 client.27199 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb99ffff700 1 -- 172.21.15.17:0/3952965671 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c027ee8ff0 con 0x55c028052d30 2023-07-14T13:11:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb99ffff700 10 client.27199 handle_command_reply: tid=0 2023-07-14T13:11:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb9da9afb80 1 client.27199 shutdown 2023-07-14T13:11:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3952965671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 msgr2=0x55c027fef7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fef7c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009d50 tx=0x7fb9ac09a6d0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3952965671 shutdown_connections 2023-07-14T13:11:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c028052d30 0x55c028055140 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c027fe6ad0 0x55c02804b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c027e386b0 0x55c027fef280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb9da9afb80 1 --2- 172.21.15.17:0/3952965671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c027fe6680 0x55c027fef7c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3952965671 >> 172.21.15.17:0/3952965671 conn(0x55c027fd1be0 msgr2=0x55c027fe7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.587+0000 7fb99ffff700 0 client.27199 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.588+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3952965671 shutdown_connections 2023-07-14T13:11:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.588+0000 7fb9da9afb80 1 -- 172.21.15.17:0/3952965671 wait complete. 2023-07-14T13:11:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.588+0000 7fb9da9afb80 20 client.27199 trim_cache size 0 max 16384 2023-07-14T13:11:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:11:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:11:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:11:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:11:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 -- 172.21.15.17:0/2127173816 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9b00a12c0 msgr2=0x7fb9b00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9b00a12c0 0x7fb9b00a3770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb9c019c820 tx=0x7fb9b8009920 comp rx=0 tx=0).stop 2023-07-14T13:11:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 -- 172.21.15.17:0/2127173816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00685b0 msgr2=0x7fb9c019c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00685b0 0x7fb9c019c060 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0098e0 tx=0x7fb9ac00f690 comp rx=0 tx=0).stop 2023-07-14T13:11:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 -- 172.21.15.17:0/2127173816 shutdown_connections 2023-07-14T13:11:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9b00a12c0 0x7fb9b00a3770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c0104e50 0x7fb9c0195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9c0067c10 0x7fb9c019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 --2- 172.21.15.17:0/2127173816 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9c00685b0 0x7fb9c019c060 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 -- 172.21.15.17:0/2127173816 >> 172.21.15.17:0/2127173816 conn(0x7fb9c0074760 msgr2=0x7fb9c00fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 -- 172.21.15.17:0/2127173816 shutdown_connections 2023-07-14T13:11:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:02.589+0000 7fb9c6fff700 1 -- 172.21.15.17:0/2127173816 wait complete. 2023-07-14T13:11:02.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:11:02.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.837+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/795236259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a54100ca0 msgr2=0x7f3a54101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.837+0000 7f3a5c5ff700 1 --2- 172.21.15.17:0/795236259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a54100ca0 0x7f3a54101070 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009990 tx=0x7f3a50009ca0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.837+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/795236259 shutdown_connections 2023-07-14T13:11:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.837+0000 7f3a5c5ff700 1 --2- 172.21.15.17:0/795236259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a5410a070 0x7f3a5410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.837+0000 7f3a5c5ff700 1 --2- 172.21.15.17:0/795236259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a54100ca0 0x7f3a54101070 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.837+0000 7f3a5c5ff700 1 --2- 172.21.15.17:0/795236259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a541015b0 0x7f3a54109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.837+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/795236259 >> 172.21.15.17:0/795236259 conn(0x7f3a540fa4b0 msgr2=0x7f3a540fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.837+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/795236259 shutdown_connections 2023-07-14T13:11:02.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.837+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/795236259 wait complete. 2023-07-14T13:11:02.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.839+0000 7f3a5c5ff700 1 Processor -- start 2023-07-14T13:11:02.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.839+0000 7f3a5c5ff700 1 -- start start 2023-07-14T13:11:02.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.839+0000 7f3a5c5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54100ca0 0x7f3a54197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.839+0000 7f3a5c5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a541015b0 0x7f3a541982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.839+0000 7f3a5c5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a5410a070 0x7f3a5419c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.839+0000 7f3a5c5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5419cd70 con 0x7f3a541015b0 2023-07-14T13:11:02.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.839+0000 7f3a5c5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5419cee0 con 0x7f3a54100ca0 2023-07-14T13:11:02.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.839+0000 7f3a5c5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5419d0a0 con 0x7f3a5410a070 2023-07-14T13:11:02.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.840+0000 7f3a5a39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54100ca0 0x7f3a54197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.840+0000 7f3a59b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a541015b0 0x7f3a541982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.840+0000 7f3a5a39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54100ca0 0x7f3a54197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58526/0 (socket says 172.21.15.17:58526) 2023-07-14T13:11:02.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.840+0000 7f3a5a39b700 1 -- 172.21.15.17:0/2559064462 learned_addr learned my addr 172.21.15.17:0/2559064462 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:02.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.840+0000 7f3a5ab9c700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a5410a070 0x7f3a5419c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.840+0000 7f3a59b9a700 1 -- 172.21.15.17:0/2559064462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a5410a070 msgr2=0x7f3a5419c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.840+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a5410a070 0x7f3a5419c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.840+0000 7f3a59b9a700 1 -- 172.21.15.17:0/2559064462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54100ca0 msgr2=0x7f3a54197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.840+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54100ca0 0x7f3a54197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.840+0000 7f3a59b9a700 1 -- 172.21.15.17:0/2559064462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a500095f0 con 0x7f3a541015b0 2023-07-14T13:11:02.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.840+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a541015b0 0x7f3a541982d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400e9f0 tx=0x7f3a4400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.841+0000 7f3a4b7fe700 1 -- 172.21.15.17:0/2559064462 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400c9c0 con 0x7f3a541015b0 2023-07-14T13:11:02.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.841+0000 7f3a4b7fe700 1 -- 172.21.15.17:0/2559064462 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a44010430 con 0x7f3a541015b0 2023-07-14T13:11:02.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.841+0000 7f3a4b7fe700 1 -- 172.21.15.17:0/2559064462 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44018680 con 0x7f3a541015b0 2023-07-14T13:11:02.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.841+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/2559064462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5419d380 con 0x7f3a541015b0 2023-07-14T13:11:02.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.841+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/2559064462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a541a4bc0 con 0x7f3a541015b0 2023-07-14T13:11:02.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.845+0000 7f3a4b7fe700 1 -- 172.21.15.17:0/2559064462 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3a440105a0 con 0x7f3a541015b0 2023-07-14T13:11:02.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.846+0000 7f3a6ffdcb80 1 Processor -- start 2023-07-14T13:11:02.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.846+0000 7f3a6ffdcb80 1 -- start start 2023-07-14T13:11:02.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.847+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 0x56221366b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.847+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56221366bbe0 0x562213676590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.847+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562213676ad0 0x562213678eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.847+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562213571cb0 con 0x56221366bbe0 2023-07-14T13:11:02.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.847+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622135c4a40 con 0x56221366b2d0 2023-07-14T13:11:02.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.847+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622135bded0 con 0x562213676ad0 2023-07-14T13:11:02.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.847+0000 7f3a4b7fe700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3a400a1340 0x7f3a400a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.847+0000 7f3a5ab9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 0x56221366b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.847+0000 7f3a5a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56221366bbe0 0x562213676590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.847+0000 7f3a5ab9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 0x56221366b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58534/0 (socket says 172.21.15.17:58534) 2023-07-14T13:11:02.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.847+0000 7f3a5ab9c700 1 -- 172.21.15.17:0/559689308 learned_addr learned my addr 172.21.15.17:0/559689308 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:02.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.848+0000 7f3a4b7fe700 1 -- 172.21.15.17:0/2559064462 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3a44014070 con 0x7f3a541015b0 2023-07-14T13:11:02.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.848+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/559689308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562213676ad0 0x562213678eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.848+0000 7f3a5ab9c700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3a400a1340 0x7f3a400a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.848+0000 7f3a5ab9c700 1 -- 172.21.15.17:0/559689308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562213676ad0 msgr2=0x562213678eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.848+0000 7f3a5ab9c700 1 --2- 172.21.15.17:0/559689308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562213676ad0 0x562213678eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.848+0000 7f3a5ab9c700 1 -- 172.21.15.17:0/559689308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56221366bbe0 msgr2=0x562213676590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.848+0000 7f3a5ab9c700 1 --2- 172.21.15.17:0/559689308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56221366bbe0 0x562213676590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.848+0000 7f3a5ab9c700 1 -- 172.21.15.17:0/559689308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622133ebde0 con 0x56221366b2d0 2023-07-14T13:11:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.848+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/559689308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562213676ad0 0x562213678eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:02.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.848+0000 7f3a5a39b700 1 --2- 172.21.15.17:0/559689308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56221366bbe0 0x562213676590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:02.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.848+0000 7f3a5ab9c700 1 --2- 172.21.15.17:0/559689308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 0x56221366b6a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c008ad0 tx=0x7f3a4c008de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d5133bc46f432c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.849+0000 7f3a5ab9c700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3a400a1340 0x7f3a400a37f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c011000 tx=0x7f3a4c01e000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.849+0000 7f3a48bfe700 1 -- 172.21.15.17:0/559689308 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c00e070 con 0x56221366b2d0 2023-07-14T13:11:02.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.849+0000 7f3a48bfe700 1 -- 172.21.15.17:0/559689308 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a4c00f040 con 0x56221366b2d0 2023-07-14T13:11:02.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.849+0000 7f3a48bfe700 1 -- 172.21.15.17:0/559689308 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c022820 con 0x56221366b2d0 2023-07-14T13:11:02.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.849+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/559689308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 msgr2=0x56221366b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.849+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/559689308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 0x56221366b6a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c008ad0 tx=0x7f3a4c008de0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.850+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/559689308 shutdown_connections 2023-07-14T13:11:02.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.850+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/559689308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562213676ad0 0x562213678eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.850+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/559689308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 0x56221366b6a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.850+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/559689308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56221366bbe0 0x562213676590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.850+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/559689308 >> 172.21.15.17:0/559689308 conn(0x562213661da0 msgr2=0x5622136676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.850+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/559689308 shutdown_connections 2023-07-14T13:11:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.850+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/559689308 wait complete. 2023-07-14T13:11:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.850+0000 7f3a6ffdcb80 1 -- start start 2023-07-14T13:11:02.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.851+0000 7f3a6ffdcb80 1 Processor -- start 2023-07-14T13:11:02.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.851+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366b2d0 0x562213676560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.851+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 0x5622136737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.851+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562213676ad0 0x562213673f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221355dac0 con 0x562213676ad0 2023-07-14T13:11:02.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221355d7c0 con 0x56221366bbe0 2023-07-14T13:11:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562213441920 con 0x56221366b2d0 2023-07-14T13:11:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a6ffdcb80 10 client.0 _ll_register_callbacks cb 0x56221355b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a5a39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366b2d0 0x562213676560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a5a39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366b2d0 0x562213676560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48600/0 (socket says 172.21.15.17:48600) 2023-07-14T13:11:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a5a39b700 1 -- 172.21.15.17:0/1368770794 learned_addr learned my addr 172.21.15.17:0/1368770794 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:02.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a59b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 0x5622136737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a5ab9c700 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562213676ad0 0x562213673f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a5a39b700 1 -- 172.21.15.17:0/1368770794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 msgr2=0x5622136737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a5a39b700 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 0x5622136737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a5a39b700 1 -- 172.21.15.17:0/1368770794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562213676ad0 msgr2=0x562213673f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a5a39b700 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562213676ad0 0x562213673f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.852+0000 7f3a5a39b700 1 -- 172.21.15.17:0/1368770794 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5410d170 con 0x56221366b2d0 2023-07-14T13:11:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.853+0000 7f3a5a39b700 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366b2d0 0x562213676560 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3a50005830 tx=0x7f3a50005c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f781cb1ef68b991 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.853+0000 7f3a3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:11:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.853+0000 7f3a3dffb700 1 -- 172.21.15.17:0/1368770794 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5001d070 con 0x56221366b2d0 2023-07-14T13:11:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.853+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/1368770794 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622135174f0 con 0x56221366b2d0 2023-07-14T13:11:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.853+0000 7f3a3dffb700 1 -- 172.21.15.17:0/1368770794 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3a50004500 con 0x56221366b2d0 2023-07-14T13:11:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.853+0000 7f3a3dffb700 1 -- 172.21.15.17:0/1368770794 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a500046c0 con 0x56221366b2d0 2023-07-14T13:11:02.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.853+0000 7f3a6ffdcb80 10 client.27211 fetch_fsmap learned FSMap version 34 2023-07-14T13:11:02.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.853+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/1368770794 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f3a541a4bc0 con 0x56221366b2d0 2023-07-14T13:11:02.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.854+0000 7f3a3dffb700 1 -- 172.21.15.17:0/1368770794 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5622135174f0 con 0x56221366b2d0 2023-07-14T13:11:02.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.854+0000 7f3a3dffb700 1 -- 172.21.15.17:0/1368770794 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f3a5000f930 con 0x56221366b2d0 2023-07-14T13:11:02.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.854+0000 7f3a6ffdcb80 10 client.27211 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:11:02.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.854+0000 7f3a6ffdcb80 10 client.27211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:02.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.854+0000 7f3a6ffdcb80 20 client.27211 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:02.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.854+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562213686360 0x562213688770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.854+0000 7f3a6ffdcb80 4 client.27211 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:11:02.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.854+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/1368770794 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622135b6eb0 con 0x562213686360 2023-07-14T13:11:02.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.855+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562213686360 0x562213688770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.855+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562213686360 0x562213688770 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee1222d9991725b5 server_cookie=ca0941cd235c4bfc in_seq=0 out_seq=0 2023-07-14T13:11:02.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.855+0000 7f3a3dffb700 10 client.27211 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:02.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a3dffb700 1 -- 172.21.15.17:0/1368770794 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5622135b6eb0 con 0x562213686360 2023-07-14T13:11:02.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a3dffb700 10 client.27211 handle_command_reply: tid=0 2023-07-14T13:11:02.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a6ffdcb80 1 client.27211 shutdown 2023-07-14T13:11:02.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/1368770794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366b2d0 msgr2=0x562213676560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366b2d0 0x562213676560 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3a50005830 tx=0x7f3a50005c20 comp rx=0 tx=0).stop 2023-07-14T13:11:02.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/1368770794 shutdown_connections 2023-07-14T13:11:02.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562213686360 0x562213688770 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562213676ad0 0x562213673f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366b2d0 0x562213676560 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/1368770794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 0x5622136737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a3dffb700 0 client.27211 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:02.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/1368770794 >> 172.21.15.17:0/1368770794 conn(0x562213661da0 msgr2=0x562213667230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.856+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/1368770794 shutdown_connections 2023-07-14T13:11:02.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.857+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/1368770794 wait complete. 2023-07-14T13:11:02.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.857+0000 7f3a6ffdcb80 20 client.27211 trim_cache size 0 max 16384 2023-07-14T13:11:02.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.883+0000 7f3a6ffdcb80 1 Processor -- start 2023-07-14T13:11:02.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.883+0000 7f3a6ffdcb80 1 -- start start 2023-07-14T13:11:02.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.883+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 0x562213676090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.883+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366bbe0 0x562213670a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.883+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562213676ad0 0x562213670f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.883+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221366c1a0 con 0x562213676ad0 2023-07-14T13:11:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.883+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562213663ef0 con 0x56221366b2d0 2023-07-14T13:11:02.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.883+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221365ef80 con 0x56221366bbe0 2023-07-14T13:11:02.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.883+0000 7f3a59b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366bbe0 0x562213670a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a5a39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 0x562213676090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a59b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366bbe0 0x562213670a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48606/0 (socket says 172.21.15.17:48606) 2023-07-14T13:11:02.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a59b9a700 1 -- 172.21.15.17:0/3220931078 learned_addr learned my addr 172.21.15.17:0/3220931078 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:02.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a5a39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 0x562213676090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58546/0 (socket says 172.21.15.17:58546) 2023-07-14T13:11:02.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a5ab9c700 1 --2- 172.21.15.17:0/3220931078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562213676ad0 0x562213670f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a59b9a700 1 -- 172.21.15.17:0/3220931078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 msgr2=0x562213676090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/3220931078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 0x562213676090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a59b9a700 1 -- 172.21.15.17:0/3220931078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562213676ad0 msgr2=0x562213670f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/3220931078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562213676ad0 0x562213670f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a59b9a700 1 -- 172.21.15.17:0/3220931078 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c0086b0 con 0x56221366bbe0 2023-07-14T13:11:02.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/3220931078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366bbe0 0x562213670a50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3a44096900 tx=0x7f3a4408f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1937db9cdf872de7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.884+0000 7f3a493ff700 1 -- 172.21.15.17:0/3220931078 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44010880 con 0x56221366bbe0 2023-07-14T13:11:02.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.885+0000 7f3a493ff700 1 -- 172.21.15.17:0/3220931078 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a440b1070 con 0x56221366bbe0 2023-07-14T13:11:02.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.885+0000 7f3a493ff700 1 -- 172.21.15.17:0/3220931078 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4409a2f0 con 0x56221366bbe0 2023-07-14T13:11:02.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.885+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/3220931078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366bbe0 msgr2=0x562213670a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.885+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/3220931078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366bbe0 0x562213670a50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3a44096900 tx=0x7f3a4408f820 comp rx=0 tx=0).stop 2023-07-14T13:11:02.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.885+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/3220931078 shutdown_connections 2023-07-14T13:11:02.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.885+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/3220931078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562213676ad0 0x562213670f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.885+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/3220931078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366b2d0 0x562213676090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.885+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/3220931078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56221366bbe0 0x562213670a50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.885+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/3220931078 >> 172.21.15.17:0/3220931078 conn(0x562213661da0 msgr2=0x562213682700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.885+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/3220931078 shutdown_connections 2023-07-14T13:11:02.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.885+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/3220931078 wait complete. 2023-07-14T13:11:02.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.886+0000 7f3a6ffdcb80 1 -- start start 2023-07-14T13:11:02.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.886+0000 7f3a6ffdcb80 1 Processor -- start 2023-07-14T13:11:02.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56221366b2d0 0x56221367d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 0x56221367b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a6ffdcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562213676ad0 0x56221367bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221367c460 con 0x56221366b2d0 2023-07-14T13:11:02.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221367c5d0 con 0x56221366bbe0 2023-07-14T13:11:02.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a6ffdcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622136da230 con 0x562213676ad0 2023-07-14T13:11:02.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a6ffdcb80 10 client.0 _ll_register_callbacks cb 0x7f3a50005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:02.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a59b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 0x56221367b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a5a39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56221366b2d0 0x56221367d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a59b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 0x56221367b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58556/0 (socket says 172.21.15.17:58556) 2023-07-14T13:11:02.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a59b9a700 1 -- 172.21.15.17:0/2236527240 learned_addr learned my addr 172.21.15.17:0/2236527240 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:02.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.887+0000 7f3a5ab9c700 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562213676ad0 0x56221367bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.888+0000 7f3a59b9a700 1 -- 172.21.15.17:0/2236527240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562213676ad0 msgr2=0x56221367bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.888+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562213676ad0 0x56221367bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.888+0000 7f3a59b9a700 1 -- 172.21.15.17:0/2236527240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56221366b2d0 msgr2=0x56221367d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:02.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.888+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56221366b2d0 0x56221367d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.888+0000 7f3a59b9a700 1 -- 172.21.15.17:0/2236527240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5419d380 con 0x56221366bbe0 2023-07-14T13:11:02.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.888+0000 7f3a59b9a700 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 0x56221367b810 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3a44099b90 tx=0x7f3a440a2360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9de43c856f2b1d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:02.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.888+0000 7f3a3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:11:02.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.888+0000 7f3a3dffb700 1 -- 172.21.15.17:0/2236527240 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44099580 con 0x56221366bbe0 2023-07-14T13:11:02.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.888+0000 7f3a3dffb700 1 -- 172.21.15.17:0/2236527240 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3a44099e90 con 0x56221366bbe0 2023-07-14T13:11:02.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.888+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/2236527240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a4c00f040 con 0x56221366bbe0 2023-07-14T13:11:02.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.889+0000 7f3a3dffb700 1 -- 172.21.15.17:0/2236527240 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a440ca2e0 con 0x56221366bbe0 2023-07-14T13:11:02.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.889+0000 7f3a6ffdcb80 10 client.27248 fetch_fsmap learned FSMap version 34 2023-07-14T13:11:02.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.889+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/2236527240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5622133d4c60 con 0x56221366bbe0 2023-07-14T13:11:02.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.889+0000 7f3a3dffb700 1 -- 172.21.15.17:0/2236527240 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a4407c020 con 0x56221366bbe0 2023-07-14T13:11:02.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.889+0000 7f3a3dffb700 1 -- 172.21.15.17:0/2236527240 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f3a440a1f50 con 0x56221366bbe0 2023-07-14T13:11:02.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.889+0000 7f3a6ffdcb80 10 client.27248 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:11:02.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.889+0000 7f3a6ffdcb80 10 client.27248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:02.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.889+0000 7f3a6ffdcb80 20 client.27248 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:02.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.889+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5622136db600 0x5622136dd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:02.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.889+0000 7f3a6ffdcb80 4 client.27248 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:11:02.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.889+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/2236527240 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562213579050 con 0x5622136db600 2023-07-14T13:11:02.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.890+0000 7f3a5a39b700 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5622136db600 0x5622136dd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:02.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.890+0000 7f3a3dffb700 10 client.27248 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:02.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.890+0000 7f3a5a39b700 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5622136db600 0x5622136dd9e0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c68c3dbd2824ebc8 server_cookie=1fd8be6e9e1a3b68 in_seq=0 out_seq=0 2023-07-14T13:11:02.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a3dffb700 1 -- 172.21.15.17:0/2236527240 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x562213579050 con 0x5622136db600 2023-07-14T13:11:02.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a3dffb700 10 client.27248 handle_command_reply: tid=0 2023-07-14T13:11:02.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 1 client.27248 shutdown 2023-07-14T13:11:02.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/2236527240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 msgr2=0x56221367b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 0x56221367b810 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3a44099b90 tx=0x7f3a440a2360 comp rx=0 tx=0).stop 2023-07-14T13:11:02.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/2236527240 shutdown_connections 2023-07-14T13:11:02.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5622136db600 0x5622136dd9e0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562213676ad0 0x56221367bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56221366b2d0 0x56221367d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 1 --2- 172.21.15.17:0/2236527240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56221366bbe0 0x56221367b810 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a3dffb700 0 client.27248 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:02.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/2236527240 >> 172.21.15.17:0/2236527240 conn(0x562213661da0 msgr2=0x56221366d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/2236527240 shutdown_connections 2023-07-14T13:11:02.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 1 -- 172.21.15.17:0/2236527240 wait complete. 2023-07-14T13:11:02.937 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.891+0000 7f3a6ffdcb80 20 client.27248 trim_cache size 0 max 16384 2023-07-14T13:11:02.937 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:11:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:11:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:11:02.937 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:11:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:11:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:11:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:11:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:11:02.938 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:11:02.938 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:11:02.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/2559064462 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3a400a1340 msgr2=0x7f3a400a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3a400a1340 0x7f3a400a37f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c011000 tx=0x7f3a4c01e000 comp rx=0 tx=0).stop 2023-07-14T13:11:02.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/2559064462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a541015b0 msgr2=0x7f3a541982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:02.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a541015b0 0x7f3a541982d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400e9f0 tx=0x7f3a4400ed00 comp rx=0 tx=0).stop 2023-07-14T13:11:02.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/2559064462 shutdown_connections 2023-07-14T13:11:02.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3a400a1340 0x7f3a400a37f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a5410a070 0x7f3a5419c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3a54100ca0 0x7f3a54197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 --2- 172.21.15.17:0/2559064462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a541015b0 0x7f3a541982d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:02.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/2559064462 >> 172.21.15.17:0/2559064462 conn(0x7f3a540fa4b0 msgr2=0x7f3a5410c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:02.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/2559064462 shutdown_connections 2023-07-14T13:11:02.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:02.892+0000 7f3a5c5ff700 1 -- 172.21.15.17:0/2559064462 wait complete. 2023-07-14T13:11:02.948 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:11:03.152 INFO:teuthology.orchestra.run.smithi017.stderr:44300000 of 50000000 tuples (88%) done (elapsed 652.75 s, remaining 83.99 s) 2023-07-14T13:11:03.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:03 smithi135 ceph-mon[97338]: pgmap v352: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:11:03.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:03 smithi131 ceph-mon[96953]: pgmap v352: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:11:03.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:03 smithi017 ceph-mon[95536]: pgmap v352: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:11:04.550 INFO:teuthology.orchestra.run.smithi017.stderr:44400000 of 50000000 tuples (88%) done (elapsed 654.15 s, remaining 82.51 s) 2023-07-14T13:11:05.454 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:05 smithi135 ceph-mon[97338]: pgmap v353: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:11:05.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:05 smithi135 ceph-mon[97338]: osdmap e100: 12 total, 12 up, 12 in 2023-07-14T13:11:05.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:05 smithi131 ceph-mon[96953]: pgmap v353: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:11:05.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:05 smithi131 ceph-mon[96953]: osdmap e100: 12 total, 12 up, 12 in 2023-07-14T13:11:05.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:05 smithi017 ceph-mon[95536]: pgmap v353: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:11:05.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:05 smithi017 ceph-mon[95536]: osdmap e100: 12 total, 12 up, 12 in 2023-07-14T13:11:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:44500000 of 50000000 tuples (89%) done (elapsed 655.45 s, remaining 81.01 s) 2023-07-14T13:11:07.248 INFO:teuthology.orchestra.run.smithi017.stderr:44600000 of 50000000 tuples (89%) done (elapsed 656.85 s, remaining 79.53 s) 2023-07-14T13:11:07.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:07 smithi135 ceph-mon[97338]: pgmap v355: 97 pgs: 97 active+clean; 8.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 26 MiB/s wr, 99 op/s 2023-07-14T13:11:07.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:07 smithi131 ceph-mon[96953]: pgmap v355: 97 pgs: 97 active+clean; 8.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 26 MiB/s wr, 99 op/s 2023-07-14T13:11:07.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:07 smithi017 ceph-mon[95536]: pgmap v355: 97 pgs: 97 active+clean; 8.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 26 MiB/s wr, 99 op/s 2023-07-14T13:11:08.556 INFO:teuthology.orchestra.run.smithi017.stderr:44700000 of 50000000 tuples (89%) done (elapsed 658.16 s, remaining 78.04 s) 2023-07-14T13:11:09.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:09 smithi135 ceph-mon[97338]: pgmap v356: 97 pgs: 97 active+clean; 8.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 26 MiB/s wr, 99 op/s 2023-07-14T13:11:09.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:09 smithi131 ceph-mon[96953]: pgmap v356: 97 pgs: 97 active+clean; 8.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 26 MiB/s wr, 99 op/s 2023-07-14T13:11:09.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:09 smithi017 ceph-mon[95536]: pgmap v356: 97 pgs: 97 active+clean; 8.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 26 MiB/s wr, 99 op/s 2023-07-14T13:11:09.856 INFO:teuthology.orchestra.run.smithi017.stderr:44800000 of 50000000 tuples (89%) done (elapsed 659.46 s, remaining 76.54 s) 2023-07-14T13:11:11.318 INFO:teuthology.orchestra.run.smithi017.stderr:44900000 of 50000000 tuples (89%) done (elapsed 660.92 s, remaining 75.07 s) 2023-07-14T13:11:11.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:11 smithi135 ceph-mon[97338]: pgmap v357: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 26 MiB/s wr, 85 op/s 2023-07-14T13:11:11.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:11 smithi135 ceph-mon[97338]: osdmap e101: 12 total, 12 up, 12 in 2023-07-14T13:11:11.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:11 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:11:11.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:11 smithi131 ceph-mon[96953]: pgmap v357: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 26 MiB/s wr, 85 op/s 2023-07-14T13:11:11.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:11 smithi131 ceph-mon[96953]: osdmap e101: 12 total, 12 up, 12 in 2023-07-14T13:11:11.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:11 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:11:11.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:11 smithi017 ceph-mon[95536]: pgmap v357: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 26 MiB/s wr, 85 op/s 2023-07-14T13:11:11.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:11 smithi017 ceph-mon[95536]: osdmap e101: 12 total, 12 up, 12 in 2023-07-14T13:11:11.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:11 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:11:12.695 INFO:teuthology.orchestra.run.smithi017.stderr:45000000 of 50000000 tuples (90%) done (elapsed 662.29 s, remaining 73.59 s) 2023-07-14T13:11:13.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:12 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:12 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:12 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:12 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:12 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:12 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:12 smithi017 ceph-mon[95536]: pgmap v359: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 MiB/s wr, 107 op/s 2023-07-14T13:11:13.205 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:12 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.205 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:12 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.205 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:12 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.205 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:12 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.205 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:12 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.205 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:12 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.206 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:12 smithi135 ceph-mon[97338]: pgmap v359: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 MiB/s wr, 107 op/s 2023-07-14T13:11:13.253 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:12 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.254 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:12 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.254 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:12 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.254 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:12 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.254 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:12 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.254 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:12 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:13.254 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:12 smithi131 ceph-mon[96953]: pgmap v359: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 MiB/s wr, 107 op/s 2023-07-14T13:11:13.999 INFO:teuthology.orchestra.run.smithi017.stderr:45100000 of 50000000 tuples (90%) done (elapsed 663.60 s, remaining 72.10 s) 2023-07-14T13:11:14.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:13 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:11:14.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:13 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:11:14.114 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:13 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:14.204 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:13 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:11:14.205 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:13 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:11:14.205 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:13 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:14.253 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:13 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:11:14.253 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:13 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:11:14.254 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:13 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:11:15.113 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:14 smithi017 ceph-mon[95536]: pgmap v360: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 87 op/s 2023-07-14T13:11:15.204 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:14 smithi135 ceph-mon[97338]: pgmap v360: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 87 op/s 2023-07-14T13:11:15.253 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:14 smithi131 ceph-mon[96953]: pgmap v360: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 87 op/s 2023-07-14T13:11:15.418 INFO:teuthology.orchestra.run.smithi017.stderr:45200000 of 50000000 tuples (90%) done (elapsed 665.02 s, remaining 70.62 s) 2023-07-14T13:11:15.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.761+0000 7fefc33ff700 1 -- 172.21.15.17:0/3696186622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefbc0685b0 msgr2=0x7fefbc104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.761+0000 7fefc33ff700 1 --2- 172.21.15.17:0/3696186622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefbc0685b0 0x7fefbc104770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fefac0099c0 tx=0x7fefac009cd0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.761+0000 7fefc33ff700 1 -- 172.21.15.17:0/3696186622 shutdown_connections 2023-07-14T13:11:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.761+0000 7fefc33ff700 1 --2- 172.21.15.17:0/3696186622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefbc104e50 0x7fefbc10ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.761+0000 7fefc33ff700 1 --2- 172.21.15.17:0/3696186622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefbc067c10 0x7fefbc067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.761+0000 7fefc33ff700 1 --2- 172.21.15.17:0/3696186622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefbc0685b0 0x7fefbc104770 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.761+0000 7fefc33ff700 1 -- 172.21.15.17:0/3696186622 >> 172.21.15.17:0/3696186622 conn(0x7fefbc074760 msgr2=0x7fefbc074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.761+0000 7fefc33ff700 1 -- 172.21.15.17:0/3696186622 shutdown_connections 2023-07-14T13:11:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.762+0000 7fefc33ff700 1 -- 172.21.15.17:0/3696186622 wait complete. 2023-07-14T13:11:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.763+0000 7fefc33ff700 1 Processor -- start 2023-07-14T13:11:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.763+0000 7fefc33ff700 1 -- start start 2023-07-14T13:11:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.764+0000 7fefc33ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefbc067c10 0x7fefbc0fec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.764+0000 7fefc33ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefbc0685b0 0x7fefbc0ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.764+0000 7fefc33ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefbc104e50 0x7fefbc1a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.764+0000 7fefc33ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1a4260 con 0x7fefbc067c10 2023-07-14T13:11:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.764+0000 7fefc33ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1a43a0 con 0x7fefbc104e50 2023-07-14T13:11:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.764+0000 7fefc33ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc1a4510 con 0x7fefbc0685b0 2023-07-14T13:11:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.764+0000 7fefc099a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefbc0685b0 0x7fefbc0ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.764+0000 7fefc119b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefbc067c10 0x7fefbc0fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.764+0000 7fefc099a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefbc0685b0 0x7fefbc0ff180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37666/0 (socket says 172.21.15.17:37666) 2023-07-14T13:11:15.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.764+0000 7fefc099a700 1 -- 172.21.15.17:0/2833811559 learned_addr learned my addr 172.21.15.17:0/2833811559 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:15.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.765+0000 7fefc199c700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefbc104e50 0x7fefbc1a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.765+0000 7fefc099a700 1 -- 172.21.15.17:0/2833811559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefbc104e50 msgr2=0x7fefbc1a3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.765+0000 7fefc099a700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefbc104e50 0x7fefbc1a3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.765+0000 7fefc099a700 1 -- 172.21.15.17:0/2833811559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefbc067c10 msgr2=0x7fefbc0fec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.765+0000 7fefc099a700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefbc067c10 0x7fefbc0fec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.765+0000 7fefc099a700 1 -- 172.21.15.17:0/2833811559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac0095f0 con 0x7fefbc0685b0 2023-07-14T13:11:15.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.765+0000 7fefc099a700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefbc0685b0 0x7fefbc0ff180 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fefac000c00 tx=0x7fefac00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.766+0000 7fefb27fc700 1 -- 172.21.15.17:0/2833811559 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac01d070 con 0x7fefbc0685b0 2023-07-14T13:11:15.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.766+0000 7fefb27fc700 1 -- 172.21.15.17:0/2833811559 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefac005050 con 0x7fefbc0685b0 2023-07-14T13:11:15.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.766+0000 7fefc33ff700 1 -- 172.21.15.17:0/2833811559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc1a4790 con 0x7fefbc0685b0 2023-07-14T13:11:15.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.766+0000 7fefb27fc700 1 -- 172.21.15.17:0/2833811559 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac0049e0 con 0x7fefbc0685b0 2023-07-14T13:11:15.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.766+0000 7fefc33ff700 1 -- 172.21.15.17:0/2833811559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc1a4bb0 con 0x7fefbc0685b0 2023-07-14T13:11:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.770+0000 7fefb27fc700 1 -- 172.21.15.17:0/2833811559 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fefac0051c0 con 0x7fefbc0685b0 2023-07-14T13:11:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.772+0000 7fefd6d7ab80 1 Processor -- start 2023-07-14T13:11:15.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.772+0000 7fefd6d7ab80 1 -- start start 2023-07-14T13:11:15.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.773+0000 7fefb27fc700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fefa80a12c0 0x7fefa80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.773+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9c406b0 0x5563e9deca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.773+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 0x5563e9df11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.773+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9ded3f0 0x5563e9df16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.773+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9ce9c50 con 0x5563e9ded3f0 2023-07-14T13:11:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.773+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9d3c9e0 con 0x5563e9c406b0 2023-07-14T13:11:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.773+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9d35e70 con 0x5563e9decf80 2023-07-14T13:11:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.773+0000 7fefb27fc700 1 -- 172.21.15.17:0/2833811559 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fefac0cd990 con 0x7fefbc0685b0 2023-07-14T13:11:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.774+0000 7fefc199c700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fefa80a12c0 0x7fefa80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.774+0000 7fefc199c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9ded3f0 0x5563e9df16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.774+0000 7fefc119b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9c406b0 0x5563e9deca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.774+0000 7fefc199c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9ded3f0 0x5563e9df16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38360/0 (socket says 172.21.15.17:38360) 2023-07-14T13:11:15.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.774+0000 7fefc199c700 1 -- 172.21.15.17:0/852099282 learned_addr learned my addr 172.21.15.17:0/852099282 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.774+0000 7fefc099a700 1 --2- 172.21.15.17:0/852099282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 0x5563e9df11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.775+0000 7fefc199c700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fefa80a12c0 0x7fefa80a3770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009550 tx=0x7fefb4009380 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.775+0000 7fefc199c700 1 -- 172.21.15.17:0/852099282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 msgr2=0x5563e9df11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.775+0000 7fefc199c700 1 --2- 172.21.15.17:0/852099282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 0x5563e9df11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.775+0000 7fefc199c700 1 -- 172.21.15.17:0/852099282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9c406b0 msgr2=0x5563e9deca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.775+0000 7fefc199c700 1 --2- 172.21.15.17:0/852099282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9c406b0 0x5563e9deca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.775+0000 7fefc199c700 1 -- 172.21.15.17:0/852099282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563e9b63d80 con 0x5563e9ded3f0 2023-07-14T13:11:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.775+0000 7fefc199c700 1 --2- 172.21.15.17:0/852099282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9ded3f0 0x5563e9df16e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fefb401aa50 tx=0x7fefb401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b33165ce137619e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.776+0000 7fefa77fe700 1 -- 172.21.15.17:0/852099282 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb400e070 con 0x5563e9ded3f0 2023-07-14T13:11:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.776+0000 7fefa77fe700 1 -- 172.21.15.17:0/852099282 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefb401f070 con 0x5563e9ded3f0 2023-07-14T13:11:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.776+0000 7fefa77fe700 1 -- 172.21.15.17:0/852099282 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb401bb40 con 0x5563e9ded3f0 2023-07-14T13:11:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.777+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/852099282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9ded3f0 msgr2=0x5563e9df16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.777+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/852099282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9ded3f0 0x5563e9df16e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fefb401aa50 tx=0x7fefb401f000 comp rx=0 tx=0).stop 2023-07-14T13:11:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.777+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/852099282 shutdown_connections 2023-07-14T13:11:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.777+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/852099282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9ded3f0 0x5563e9df16e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.777+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/852099282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9c406b0 0x5563e9deca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.777+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/852099282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 0x5563e9df11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.777+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/852099282 >> 172.21.15.17:0/852099282 conn(0x5563e9dd9be0 msgr2=0x5563e9ddef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.777+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/852099282 shutdown_connections 2023-07-14T13:11:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.777+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/852099282 wait complete. 2023-07-14T13:11:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.778+0000 7fefd6d7ab80 1 -- start start 2023-07-14T13:11:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.778+0000 7fefd6d7ab80 1 Processor -- start 2023-07-14T13:11:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.778+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9c406b0 0x5563e9dfbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.778+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 0x5563e9dfc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.778+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.778+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9cd5a60 con 0x5563e9c406b0 2023-07-14T13:11:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.778+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9cd5760 con 0x5563e9ded3f0 2023-07-14T13:11:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.778+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9bb98c0 con 0x5563e9decf80 2023-07-14T13:11:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.778+0000 7fefd6d7ab80 10 client.0 _ll_register_callbacks cb 0x5563e9cd3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc119b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9c406b0 0x5563e9dfbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc099a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 0x5563e9dfc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc099a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 0x5563e9dfc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37672/0 (socket says 172.21.15.17:37672) 2023-07-14T13:11:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc099a700 1 -- 172.21.15.17:0/2017114151 learned_addr learned my addr 172.21.15.17:0/2017114151 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc119b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9c406b0 0x5563e9dfbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38376/0 (socket says 172.21.15.17:38376) 2023-07-14T13:11:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc199c700 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc099a700 1 -- 172.21.15.17:0/2017114151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 msgr2=0x5563e9df60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc099a700 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc099a700 1 -- 172.21.15.17:0/2017114151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9c406b0 msgr2=0x5563e9dfbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc099a700 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9c406b0 0x5563e9dfbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc099a700 1 -- 172.21.15.17:0/2017114151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb4008dd0 con 0x5563e9decf80 2023-07-14T13:11:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.779+0000 7fefc119b700 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9c406b0 0x5563e9dfbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.780+0000 7fefc099a700 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 0x5563e9dfc390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fefac09a810 tx=0x7fefac09ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31fd835aad7ffe3c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.780+0000 7fefa4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:11:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.780+0000 7fefa4ff9700 1 -- 172.21.15.17:0/2017114151 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac09a000 con 0x5563e9decf80 2023-07-14T13:11:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.780+0000 7fefa4ff9700 1 -- 172.21.15.17:0/2017114151 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fefac09a160 con 0x5563e9decf80 2023-07-14T13:11:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.780+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2017114151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563e9c8f490 con 0x5563e9decf80 2023-07-14T13:11:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.780+0000 7fefa4ff9700 1 -- 172.21.15.17:0/2017114151 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefac0b3290 con 0x5563e9decf80 2023-07-14T13:11:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.780+0000 7fefd6d7ab80 10 client.27226 fetch_fsmap learned FSMap version 34 2023-07-14T13:11:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.780+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2017114151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5563e9b4cc00 con 0x5563e9decf80 2023-07-14T13:11:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.780+0000 7fefa4ff9700 1 -- 172.21.15.17:0/2017114151 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5563e9c8f490 con 0x5563e9decf80 2023-07-14T13:11:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.781+0000 7fefa4ff9700 1 -- 172.21.15.17:0/2017114151 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7fefac004c60 con 0x5563e9decf80 2023-07-14T13:11:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.781+0000 7fefd6d7ab80 10 client.27226 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:11:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.781+0000 7fefd6d7ab80 10 client.27226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.781+0000 7fefd6d7ab80 20 client.27226 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.781+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563e9e05f40 0x5563e9e08350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.781+0000 7fefd6d7ab80 4 client.27226 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:11:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.781+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2017114151 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563e9d2ee50 con 0x5563e9e05f40 2023-07-14T13:11:15.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.781+0000 7fefc119b700 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563e9e05f40 0x5563e9e08350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.782+0000 7fefc119b700 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563e9e05f40 0x5563e9e08350 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4370acb7a6f51f51 server_cookie=2871183790161353 in_seq=0 out_seq=0 2023-07-14T13:11:15.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.782+0000 7fefa4ff9700 10 client.27226 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.782+0000 7fefa4ff9700 1 -- 172.21.15.17:0/2017114151 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5563e9d2ee50 con 0x5563e9e05f40 2023-07-14T13:11:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefa4ff9700 10 client.27226 handle_command_reply: tid=0 2023-07-14T13:11:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefd6d7ab80 1 client.27226 shutdown 2023-07-14T13:11:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2017114151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 msgr2=0x5563e9dfc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 0x5563e9dfc390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fefac09a810 tx=0x7fefac09ac00 comp rx=0 tx=0).stop 2023-07-14T13:11:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2017114151 shutdown_connections 2023-07-14T13:11:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563e9e05f40 0x5563e9e08350 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9c406b0 0x5563e9dfbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefa4ff9700 0 client.27226 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/2017114151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9decf80 0x5563e9dfc390 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2017114151 >> 172.21.15.17:0/2017114151 conn(0x5563e9dd9be0 msgr2=0x5563e9dde4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2017114151 shutdown_connections 2023-07-14T13:11:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.783+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2017114151 wait complete. 2023-07-14T13:11:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.784+0000 7fefd6d7ab80 20 client.27226 trim_cache size 0 max 16384 2023-07-14T13:11:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.804+0000 7fefd6d7ab80 1 Processor -- start 2023-07-14T13:11:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.804+0000 7fefd6d7ab80 1 -- start start 2023-07-14T13:11:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.805+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9df5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.805+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9decf80 0x5563e9df3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.805+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.805+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9df7680 con 0x5563e9decf80 2023-07-14T13:11:15.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.805+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9df6500 con 0x5563e9ded3f0 2023-07-14T13:11:15.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.805+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9df0870 con 0x5563e9c406b0 2023-07-14T13:11:15.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.805+0000 7fefc119b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9df5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.805+0000 7fefc199c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.805+0000 7fefc099a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9decf80 0x5563e9df3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.805+0000 7fefc119b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9df5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37674/0 (socket says 172.21.15.17:37674) 2023-07-14T13:11:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.805+0000 7fefc119b700 1 -- 172.21.15.17:0/2822914142 learned_addr learned my addr 172.21.15.17:0/2822914142 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.806+0000 7fefc119b700 1 -- 172.21.15.17:0/2822914142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 msgr2=0x5563e9df1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.806+0000 7fefc119b700 1 --2- 172.21.15.17:0/2822914142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.806+0000 7fefc119b700 1 -- 172.21.15.17:0/2822914142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9decf80 msgr2=0x5563e9df3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.806+0000 7fefc119b700 1 --2- 172.21.15.17:0/2822914142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9decf80 0x5563e9df3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.806+0000 7fefc119b700 1 -- 172.21.15.17:0/2822914142 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563e9b8a1f0 con 0x5563e9c406b0 2023-07-14T13:11:15.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.806+0000 7fefc119b700 1 --2- 172.21.15.17:0/2822914142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9df5fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5563e9e08c60 tx=0x7fefb8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83a2a41a4700586 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.806+0000 7fefa7fff700 1 -- 172.21.15.17:0/2822914142 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8016050 con 0x5563e9c406b0 2023-07-14T13:11:15.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.806+0000 7fefa7fff700 1 -- 172.21.15.17:0/2822914142 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefb8017040 con 0x5563e9c406b0 2023-07-14T13:11:15.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.806+0000 7fefa7fff700 1 -- 172.21.15.17:0/2822914142 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb801d3f0 con 0x5563e9c406b0 2023-07-14T13:11:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.807+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2822914142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 msgr2=0x5563e9df5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.807+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/2822914142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9df5fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5563e9e08c60 tx=0x7fefb8004750 comp rx=0 tx=0).stop 2023-07-14T13:11:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.807+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2822914142 shutdown_connections 2023-07-14T13:11:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.807+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/2822914142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.807+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/2822914142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9df5fc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.807+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/2822914142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9decf80 0x5563e9df3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.807+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2822914142 >> 172.21.15.17:0/2822914142 conn(0x5563e9dd9be0 msgr2=0x5563e9df0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.807+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2822914142 shutdown_connections 2023-07-14T13:11:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.807+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/2822914142 wait complete. 2023-07-14T13:11:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.807+0000 7fefd6d7ab80 1 -- start start 2023-07-14T13:11:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.808+0000 7fefd6d7ab80 1 Processor -- start 2023-07-14T13:11:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.808+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9dfbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.808+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9decf80 0x5563e9dfbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.808+0000 7fefd6d7ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.808+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9dfa600 con 0x5563e9decf80 2023-07-14T13:11:15.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.808+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9dfa770 con 0x5563e9ded3f0 2023-07-14T13:11:15.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.808+0000 7fefd6d7ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e9dfa930 con 0x5563e9c406b0 2023-07-14T13:11:15.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.808+0000 7fefd6d7ab80 10 client.0 _ll_register_callbacks cb 0x5563e9cd3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:15.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc119b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9dfbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc199c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc119b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9dfbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37680/0 (socket says 172.21.15.17:37680) 2023-07-14T13:11:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc119b700 1 -- 172.21.15.17:0/1085743102 learned_addr learned my addr 172.21.15.17:0/1085743102 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc099a700 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9decf80 0x5563e9dfbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc119b700 1 -- 172.21.15.17:0/1085743102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 msgr2=0x5563e9df9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc119b700 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc119b700 1 -- 172.21.15.17:0/1085743102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9decf80 msgr2=0x5563e9dfbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc119b700 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9decf80 0x5563e9dfbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc119b700 1 -- 172.21.15.17:0/1085743102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb801d9d0 con 0x5563e9c406b0 2023-07-14T13:11:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc099a700 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9decf80 0x5563e9dfbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc199c700 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefc119b700 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9dfbaa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fefb80092a0 tx=0x7fefb801d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acc66192f5492be8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.809+0000 7fefa4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:11:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.810+0000 7fefa4ff9700 1 -- 172.21.15.17:0/1085743102 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8010cb0 con 0x5563e9c406b0 2023-07-14T13:11:15.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.810+0000 7fefa4ff9700 1 -- 172.21.15.17:0/1085743102 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fefb8010e10 con 0x5563e9c406b0 2023-07-14T13:11:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.810+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/1085743102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefb401f070 con 0x5563e9c406b0 2023-07-14T13:11:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.810+0000 7fefa4ff9700 1 -- 172.21.15.17:0/1085743102 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefb8016020 con 0x5563e9c406b0 2023-07-14T13:11:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.810+0000 7fefd6d7ab80 10 client.27232 fetch_fsmap learned FSMap version 34 2023-07-14T13:11:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.810+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/1085743102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5563e9b62250 con 0x5563e9c406b0 2023-07-14T13:11:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.810+0000 7fefa4ff9700 1 -- 172.21.15.17:0/1085743102 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefb401f070 con 0x5563e9c406b0 2023-07-14T13:11:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.811+0000 7fefa4ff9700 1 -- 172.21.15.17:0/1085743102 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7fefb80054e0 con 0x5563e9c406b0 2023-07-14T13:11:15.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.811+0000 7fefd6d7ab80 10 client.27232 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:11:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.811+0000 7fefd6d7ab80 10 client.27232 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.811+0000 7fefd6d7ab80 20 client.27232 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.811+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563e9e5ae20 0x5563e9e5d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.811+0000 7fefd6d7ab80 4 client.27232 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:11:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.811+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/1085743102 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5563e9cf0ff0 con 0x5563e9e5ae20 2023-07-14T13:11:15.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.811+0000 7fefc099a700 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563e9e5ae20 0x5563e9e5d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:15.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.812+0000 7fefc099a700 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563e9e5ae20 0x5563e9e5d230 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af46fb6b7d2f708e server_cookie=dc1afa4e6de5f874 in_seq=0 out_seq=0 2023-07-14T13:11:15.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.812+0000 7fefa4ff9700 10 client.27232 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.826+0000 7fefa4ff9700 1 -- 172.21.15.17:0/1085743102 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5563e9cf0ff0 con 0x5563e9e5ae20 2023-07-14T13:11:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.826+0000 7fefa4ff9700 10 client.27232 handle_command_reply: tid=0 2023-07-14T13:11:15.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.826+0000 7fefd6d7ab80 1 client.27232 shutdown 2023-07-14T13:11:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.826+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/1085743102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 msgr2=0x5563e9dfbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.826+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9dfbaa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fefb80092a0 tx=0x7fefb801d490 comp rx=0 tx=0).stop 2023-07-14T13:11:15.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.827+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/1085743102 shutdown_connections 2023-07-14T13:11:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.827+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563e9e5ae20 0x5563e9e5d230 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.827+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563e9ded3f0 0x5563e9df9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.827+0000 7fefa4ff9700 0 client.27232 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.827+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e9c406b0 0x5563e9dfbaa0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.827+0000 7fefd6d7ab80 1 --2- 172.21.15.17:0/1085743102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563e9decf80 0x5563e9dfbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.827+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/1085743102 >> 172.21.15.17:0/1085743102 conn(0x5563e9dd9be0 msgr2=0x5563e9df0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.827+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/1085743102 shutdown_connections 2023-07-14T13:11:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.827+0000 7fefd6d7ab80 1 -- 172.21.15.17:0/1085743102 wait complete. 2023-07-14T13:11:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.827+0000 7fefd6d7ab80 20 client.27232 trim_cache size 0 max 16384 2023-07-14T13:11:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:11:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:11:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:11:15.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:11:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 -- 172.21.15.17:0/2833811559 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fefa80a12c0 msgr2=0x7fefa80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fefa80a12c0 0x7fefa80a3770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009550 tx=0x7fefb4009380 comp rx=0 tx=0).stop 2023-07-14T13:11:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 -- 172.21.15.17:0/2833811559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefbc0685b0 msgr2=0x7fefbc0ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefbc0685b0 0x7fefbc0ff180 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fefac000c00 tx=0x7fefac00f690 comp rx=0 tx=0).stop 2023-07-14T13:11:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 -- 172.21.15.17:0/2833811559 shutdown_connections 2023-07-14T13:11:15.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fefa80a12c0 0x7fefa80a3770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefbc104e50 0x7fefbc1a3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefbc067c10 0x7fefbc0fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 --2- 172.21.15.17:0/2833811559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fefbc0685b0 0x7fefbc0ff180 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:15.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 -- 172.21.15.17:0/2833811559 >> 172.21.15.17:0/2833811559 conn(0x7fefbc074760 msgr2=0x7fefbc103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:15.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 -- 172.21.15.17:0/2833811559 shutdown_connections 2023-07-14T13:11:15.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:15.828+0000 7fefc33ff700 1 -- 172.21.15.17:0/2833811559 wait complete. 2023-07-14T13:11:16.774 INFO:teuthology.orchestra.run.smithi017.stderr:45300000 of 50000000 tuples (90%) done (elapsed 666.37 s, remaining 69.14 s) 2023-07-14T13:11:17.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:17 smithi135 ceph-mon[97338]: pgmap v361: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 68 op/s 2023-07-14T13:11:17.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:17 smithi131 ceph-mon[96953]: pgmap v361: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 68 op/s 2023-07-14T13:11:17.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:17 smithi017 ceph-mon[95536]: pgmap v361: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 68 op/s 2023-07-14T13:11:18.099 INFO:teuthology.orchestra.run.smithi017.stderr:45400000 of 50000000 tuples (90%) done (elapsed 667.70 s, remaining 67.65 s) 2023-07-14T13:11:19.411 INFO:teuthology.orchestra.run.smithi017.stderr:45500000 of 50000000 tuples (91%) done (elapsed 669.01 s, remaining 66.17 s) 2023-07-14T13:11:19.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:19 smithi135 ceph-mon[97338]: pgmap v362: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 68 op/s 2023-07-14T13:11:19.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:19 smithi131 ceph-mon[96953]: pgmap v362: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 68 op/s 2023-07-14T13:11:19.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:19 smithi017 ceph-mon[95536]: pgmap v362: 97 pgs: 97 active+clean; 8.9 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 MiB/s wr, 68 op/s 2023-07-14T13:11:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:45600000 of 50000000 tuples (91%) done (elapsed 670.45 s, remaining 64.69 s) 2023-07-14T13:11:21.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:21 smithi135 ceph-mon[97338]: pgmap v363: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 26 MiB/s wr, 83 op/s 2023-07-14T13:11:21.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:21 smithi131 ceph-mon[96953]: pgmap v363: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 26 MiB/s wr, 83 op/s 2023-07-14T13:11:21.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:21 smithi017 ceph-mon[95536]: pgmap v363: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 26 MiB/s wr, 83 op/s 2023-07-14T13:11:22.236 INFO:teuthology.orchestra.run.smithi017.stderr:45700000 of 50000000 tuples (91%) done (elapsed 671.83 s, remaining 63.21 s) 2023-07-14T13:11:23.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:23 smithi135 ceph-mon[97338]: pgmap v364: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 24 MiB/s wr, 76 op/s 2023-07-14T13:11:23.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:23 smithi131 ceph-mon[96953]: pgmap v364: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 24 MiB/s wr, 76 op/s 2023-07-14T13:11:23.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:23 smithi017 ceph-mon[95536]: pgmap v364: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 24 MiB/s wr, 76 op/s 2023-07-14T13:11:23.615 INFO:teuthology.orchestra.run.smithi017.stderr:45800000 of 50000000 tuples (91%) done (elapsed 673.21 s, remaining 61.74 s) 2023-07-14T13:11:24.943 INFO:teuthology.orchestra.run.smithi017.stderr:45900000 of 50000000 tuples (91%) done (elapsed 674.54 s, remaining 60.25 s) 2023-07-14T13:11:25.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:25 smithi135 ceph-mon[97338]: pgmap v365: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:11:25.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:25 smithi131 ceph-mon[96953]: pgmap v365: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:11:25.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:25 smithi017 ceph-mon[95536]: pgmap v365: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 22 MiB/s wr, 69 op/s 2023-07-14T13:11:26.407 INFO:teuthology.orchestra.run.smithi017.stderr:46000000 of 50000000 tuples (92%) done (elapsed 676.01 s, remaining 58.78 s) 2023-07-14T13:11:27.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:27 smithi135 ceph-mon[97338]: pgmap v366: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 32 MiB/s wr, 109 op/s 2023-07-14T13:11:27.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:27 smithi131 ceph-mon[96953]: pgmap v366: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 32 MiB/s wr, 109 op/s 2023-07-14T13:11:27.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:27 smithi017 ceph-mon[95536]: pgmap v366: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 32 MiB/s wr, 109 op/s 2023-07-14T13:11:27.746 INFO:teuthology.orchestra.run.smithi017.stderr:46100000 of 50000000 tuples (92%) done (elapsed 677.35 s, remaining 57.30 s) 2023-07-14T13:11:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.006+0000 7f38e63ff700 1 -- 172.21.15.17:0/1885003848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38e00ffb00 msgr2=0x7f38e00fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.006+0000 7f38e63ff700 1 --2- 172.21.15.17:0/1885003848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38e00ffb00 0x7f38e00fff70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009990 tx=0x7f38d4009ca0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.006+0000 7f38e63ff700 1 -- 172.21.15.17:0/1885003848 shutdown_connections 2023-07-14T13:11:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.006+0000 7f38e63ff700 1 --2- 172.21.15.17:0/1885003848 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38e01004b0 0x7f38e010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.006+0000 7f38e63ff700 1 --2- 172.21.15.17:0/1885003848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38e0105b10 0x7f38e0105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.006+0000 7f38e63ff700 1 --2- 172.21.15.17:0/1885003848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38e00ffb00 0x7f38e00fff70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.006+0000 7f38e63ff700 1 -- 172.21.15.17:0/1885003848 >> 172.21.15.17:0/1885003848 conn(0x7f38e00fb600 msgr2=0x7f38e00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.007+0000 7f38e63ff700 1 -- 172.21.15.17:0/1885003848 shutdown_connections 2023-07-14T13:11:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.007+0000 7f38e63ff700 1 -- 172.21.15.17:0/1885003848 wait complete. 2023-07-14T13:11:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.008+0000 7f38e63ff700 1 Processor -- start 2023-07-14T13:11:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.008+0000 7f38e63ff700 1 -- start start 2023-07-14T13:11:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.009+0000 7f38e63ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38e00ffb00 0x7f38e0197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.009+0000 7f38e63ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38e01004b0 0x7f38e0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.009+0000 7f38e63ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38e0105b10 0x7f38e019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.009+0000 7f38e63ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e019cf30 con 0x7f38e0105b10 2023-07-14T13:11:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.009+0000 7f38e63ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e019d0a0 con 0x7f38e01004b0 2023-07-14T13:11:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.009+0000 7f38e63ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e019d260 con 0x7f38e00ffb00 2023-07-14T13:11:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.009+0000 7f38df7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38e01004b0 0x7f38e0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.009+0000 7f38e499c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38e0105b10 0x7f38e019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.009+0000 7f38df7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38e01004b0 0x7f38e0198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58436/0 (socket says 172.21.15.17:58436) 2023-07-14T13:11:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.009+0000 7f38df7fe700 1 -- 172.21.15.17:0/2327975907 learned_addr learned my addr 172.21.15.17:0/2327975907 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.009+0000 7f38dffff700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38e00ffb00 0x7f38e0197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.010+0000 7f38e499c700 1 -- 172.21.15.17:0/2327975907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38e00ffb00 msgr2=0x7f38e0197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.010+0000 7f38e499c700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38e00ffb00 0x7f38e0197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.010+0000 7f38e499c700 1 -- 172.21.15.17:0/2327975907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38e01004b0 msgr2=0x7f38e0198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.010+0000 7f38e499c700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38e01004b0 0x7f38e0198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.010+0000 7f38e499c700 1 -- 172.21.15.17:0/2327975907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d8009c40 con 0x7f38e0105b10 2023-07-14T13:11:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.010+0000 7f38df7fe700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38e01004b0 0x7f38e0198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.010+0000 7f38e499c700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38e0105b10 0x7f38e019c8f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f38d800efb0 tx=0x7f38d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.010+0000 7f38dd7fa700 1 -- 172.21.15.17:0/2327975907 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8003a00 con 0x7f38e0105b10 2023-07-14T13:11:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.011+0000 7f38e63ff700 1 -- 172.21.15.17:0/2327975907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d40095f0 con 0x7f38e0105b10 2023-07-14T13:11:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.011+0000 7f38dd7fa700 1 -- 172.21.15.17:0/2327975907 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38d800f040 con 0x7f38e0105b10 2023-07-14T13:11:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.011+0000 7f38dd7fa700 1 -- 172.21.15.17:0/2327975907 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80044d0 con 0x7f38e0105b10 2023-07-14T13:11:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.011+0000 7f38e63ff700 1 -- 172.21.15.17:0/2327975907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e01a4ba0 con 0x7f38e0105b10 2023-07-14T13:11:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.016+0000 7f38dd7fa700 1 -- 172.21.15.17:0/2327975907 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f38d800cbc0 con 0x7f38e0105b10 2023-07-14T13:11:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.016+0000 7f38f9c9bb80 1 Processor -- start 2023-07-14T13:11:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.017+0000 7f38f9c9bb80 1 -- start start 2023-07-14T13:11:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.017+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fcfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.017+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fd02d0 0x55b794fca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.017+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fca580 0x55b794fca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.017+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b794ecfc50 con 0x55b794fca580 2023-07-14T13:11:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.017+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b794f229e0 con 0x55b794fd02d0 2023-07-14T13:11:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.017+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b794f1be70 con 0x55b794e266b0 2023-07-14T13:11:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.017+0000 7f38df7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fcfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.017+0000 7f38dffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fd02d0 0x55b794fca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.017+0000 7f38df7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fca580 0x55b794fca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.017+0000 7f38dffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fd02d0 0x55b794fca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58450/0 (socket says 172.21.15.17:58450) 2023-07-14T13:11:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.018+0000 7f38dffff700 1 -- 172.21.15.17:0/3572828413 learned_addr learned my addr 172.21.15.17:0/3572828413 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.018+0000 7f38dd7fa700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f38c80a12c0 0x7f38c80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.018+0000 7f38df7fe700 1 -- 172.21.15.17:0/3572828413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 msgr2=0x55b794fcfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.018+0000 7f38df7fe700 1 --2- 172.21.15.17:0/3572828413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fcfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.018+0000 7f38df7fe700 1 -- 172.21.15.17:0/3572828413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fd02d0 msgr2=0x55b794fca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.018+0000 7f38df7fe700 1 --2- 172.21.15.17:0/3572828413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fd02d0 0x55b794fca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.018+0000 7f38df7fe700 1 -- 172.21.15.17:0/3572828413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b794d49d80 con 0x55b794fca580 2023-07-14T13:11:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.018+0000 7f38dd7fa700 1 -- 172.21.15.17:0/2327975907 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f38d80cc8e0 con 0x7f38e0105b10 2023-07-14T13:11:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.018+0000 7f38e499c700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f38c80a12c0 0x7f38c80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.018+0000 7f38df7fe700 1 --2- 172.21.15.17:0/3572828413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fca580 0x55b794fca9d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f38d4006010 tx=0x7f38d4005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d01813c07cff09 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.019+0000 7f38c67fc700 1 -- 172.21.15.17:0/3572828413 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4004830 con 0x55b794fca580 2023-07-14T13:11:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.019+0000 7f38c67fc700 1 -- 172.21.15.17:0/3572828413 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38d401e070 con 0x55b794fca580 2023-07-14T13:11:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.019+0000 7f38c67fc700 1 -- 172.21.15.17:0/3572828413 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4005660 con 0x55b794fca580 2023-07-14T13:11:29.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.020+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/3572828413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fca580 msgr2=0x55b794fca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.020+0000 7f38e499c700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f38c80a12c0 0x7f38c80a3770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f38d80964d0 tx=0x7f38d8009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.020+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/3572828413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fca580 0x55b794fca9d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f38d4006010 tx=0x7f38d4005960 comp rx=0 tx=0).stop 2023-07-14T13:11:29.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.020+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/3572828413 shutdown_connections 2023-07-14T13:11:29.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.020+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/3572828413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fca580 0x55b794fca9d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.020+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/3572828413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fcfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.020+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/3572828413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fd02d0 0x55b794fca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.020+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/3572828413 >> 172.21.15.17:0/3572828413 conn(0x55b794fbfbe0 msgr2=0x55b794fc4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:29.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.020+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/3572828413 shutdown_connections 2023-07-14T13:11:29.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.020+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/3572828413 wait complete. 2023-07-14T13:11:29.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.021+0000 7f38f9c9bb80 1 -- start start 2023-07-14T13:11:29.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.021+0000 7f38f9c9bb80 1 Processor -- start 2023-07-14T13:11:29.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fd6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 0x55b794fd3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fd02d0 0x55b794fd3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b794ebba60 con 0x55b794fd02d0 2023-07-14T13:11:29.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b794ebb760 con 0x55b794fca580 2023-07-14T13:11:29.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b794d9f8c0 con 0x55b794e266b0 2023-07-14T13:11:29.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38f9c9bb80 10 client.0 _ll_register_callbacks cb 0x55b794eb9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:29.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38df7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fd6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38df7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fd02d0 0x55b794fd3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38df7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fd02d0 0x55b794fd3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52686/0 (socket says 172.21.15.17:52686) 2023-07-14T13:11:29.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38df7fe700 1 -- 172.21.15.17:0/1280718502 learned_addr learned my addr 172.21.15.17:0/1280718502 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:29.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.022+0000 7f38dffff700 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 0x55b794fd3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.023+0000 7f38df7fe700 1 -- 172.21.15.17:0/1280718502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 msgr2=0x55b794fd6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:29.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.023+0000 7f38df7fe700 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fd6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.023+0000 7f38df7fe700 1 -- 172.21.15.17:0/1280718502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 msgr2=0x55b794fd3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:29.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.023+0000 7f38df7fe700 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 0x55b794fd3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.023+0000 7f38df7fe700 1 -- 172.21.15.17:0/1280718502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d4020040 con 0x55b794fd02d0 2023-07-14T13:11:29.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.023+0000 7f38dffff700 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 0x55b794fd3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.023+0000 7f38df7fe700 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fd02d0 0x55b794fd3fc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f38d4001eb0 tx=0x7f38d4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7153f8acbc77d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.023+0000 7f38bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:11:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.023+0000 7f38bf7fe700 1 -- 172.21.15.17:0/1280718502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d40055d0 con 0x55b794fd02d0 2023-07-14T13:11:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.023+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/1280718502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b794e75490 con 0x55b794fd02d0 2023-07-14T13:11:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.024+0000 7f38bf7fe700 1 -- 172.21.15.17:0/1280718502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f38d4004830 con 0x55b794fd02d0 2023-07-14T13:11:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.024+0000 7f38bf7fe700 1 -- 172.21.15.17:0/1280718502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38d40049f0 con 0x55b794fd02d0 2023-07-14T13:11:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.024+0000 7f38f9c9bb80 10 client.17553 fetch_fsmap learned FSMap version 34 2023-07-14T13:11:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.024+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/1280718502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55b794d32c00 con 0x55b794fd02d0 2023-07-14T13:11:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.024+0000 7f38bf7fe700 1 -- 172.21.15.17:0/1280718502 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b794e75490 con 0x55b794fd02d0 2023-07-14T13:11:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.024+0000 7f38bf7fe700 1 -- 172.21.15.17:0/1280718502 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f38d400f9f0 con 0x55b794fd02d0 2023-07-14T13:11:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.024+0000 7f38f9c9bb80 10 client.17553 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:11:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.024+0000 7f38f9c9bb80 10 client.17553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.024+0000 7f38f9c9bb80 20 client.17553 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.025+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b794fe36c0 0x55b794fe5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.025+0000 7f38f9c9bb80 4 client.17553 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:11:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.025+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/1280718502 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b794f14e50 con 0x55b794fe36c0 2023-07-14T13:11:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.025+0000 7f38dffff700 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b794fe36c0 0x55b794fe5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.025+0000 7f38dffff700 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b794fe36c0 0x55b794fe5ad0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d627e28ad0780957 server_cookie=db0ede4bee109728 in_seq=0 out_seq=0 2023-07-14T13:11:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.025+0000 7f38bf7fe700 10 client.17553 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.026+0000 7f38bf7fe700 1 -- 172.21.15.17:0/1280718502 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b794f14e50 con 0x55b794fe36c0 2023-07-14T13:11:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.026+0000 7f38bf7fe700 10 client.17553 handle_command_reply: tid=0 2023-07-14T13:11:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.026+0000 7f38f9c9bb80 1 client.17553 shutdown 2023-07-14T13:11:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/1280718502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fd02d0 msgr2=0x55b794fd3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fd02d0 0x55b794fd3fc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f38d4001eb0 tx=0x7f38d4009310 comp rx=0 tx=0).stop 2023-07-14T13:11:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/1280718502 shutdown_connections 2023-07-14T13:11:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b794fe36c0 0x55b794fe5ad0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fd02d0 0x55b794fd3fc0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fd6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38bf7fe700 0 client.17553 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/1280718502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 0x55b794fd3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/1280718502 >> 172.21.15.17:0/1280718502 conn(0x55b794fbfbe0 msgr2=0x55b794fc44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:29.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/1280718502 shutdown_connections 2023-07-14T13:11:29.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/1280718502 wait complete. 2023-07-14T13:11:29.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.027+0000 7f38f9c9bb80 20 client.17553 trim_cache size 0 max 16384 2023-07-14T13:11:29.077 INFO:teuthology.orchestra.run.smithi017.stderr:46200000 of 50000000 tuples (92%) done (elapsed 678.68 s, remaining 55.82 s) 2023-07-14T13:11:29.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.047+0000 7f38f9c9bb80 1 Processor -- start 2023-07-14T13:11:29.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.047+0000 7f38f9c9bb80 1 -- start start 2023-07-14T13:11:29.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fca580 0x55b794fcf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fd02d0 0x55b794fc4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b794fd4800 con 0x55b794fca580 2023-07-14T13:11:29.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b794fc6b70 con 0x55b794fd02d0 2023-07-14T13:11:29.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b794fc5ef0 con 0x55b794e266b0 2023-07-14T13:11:29.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38df7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38df7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39256/0 (socket says 172.21.15.17:39256) 2023-07-14T13:11:29.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38df7fe700 1 -- 172.21.15.17:0/2623544614 learned_addr learned my addr 172.21.15.17:0/2623544614 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:29.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38dffff700 1 --2- 172.21.15.17:0/2623544614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fca580 0x55b794fcf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38df7fe700 1 --2- 172.21.15.17:0/2623544614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fd02d0 0x55b794fc4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38df7fe700 1 -- 172.21.15.17:0/2623544614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fd02d0 msgr2=0x55b794fc4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:29.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38df7fe700 1 --2- 172.21.15.17:0/2623544614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fd02d0 0x55b794fc4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38df7fe700 1 -- 172.21.15.17:0/2623544614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fca580 msgr2=0x55b794fcf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:29.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38df7fe700 1 --2- 172.21.15.17:0/2623544614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fca580 0x55b794fcf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.048+0000 7f38df7fe700 1 -- 172.21.15.17:0/2623544614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b794d701f0 con 0x55b794e266b0 2023-07-14T13:11:29.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.049+0000 7f38df7fe700 1 --2- 172.21.15.17:0/2623544614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fca040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f38d4006010 tx=0x7f38d400bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5a9527288262a4f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.049+0000 7f38c6ffd700 1 -- 172.21.15.17:0/2623544614 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d40056f0 con 0x55b794e266b0 2023-07-14T13:11:29.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.049+0000 7f38c6ffd700 1 -- 172.21.15.17:0/2623544614 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38d400b280 con 0x55b794e266b0 2023-07-14T13:11:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.049+0000 7f38c6ffd700 1 -- 172.21.15.17:0/2623544614 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4026870 con 0x55b794e266b0 2023-07-14T13:11:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.050+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/2623544614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 msgr2=0x55b794fca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.050+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/2623544614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fca040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f38d4006010 tx=0x7f38d400bb40 comp rx=0 tx=0).stop 2023-07-14T13:11:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.050+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/2623544614 shutdown_connections 2023-07-14T13:11:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.050+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/2623544614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fd02d0 0x55b794fc4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.050+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/2623544614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794e266b0 0x55b794fca040 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.050+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/2623544614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794fca580 0x55b794fcf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.050+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/2623544614 >> 172.21.15.17:0/2623544614 conn(0x55b794fbfbe0 msgr2=0x55b794fd0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.050+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/2623544614 shutdown_connections 2023-07-14T13:11:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.050+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/2623544614 wait complete. 2023-07-14T13:11:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.050+0000 7f38f9c9bb80 1 -- start start 2023-07-14T13:11:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.051+0000 7f38f9c9bb80 1 Processor -- start 2023-07-14T13:11:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.051+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794e266b0 0x55b794fd7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.051+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 0x55b794fd78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.051+0000 7f38f9c9bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794fd02d0 0x55b795036530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.051+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b794fd7fb0 con 0x55b794e266b0 2023-07-14T13:11:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.051+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b795036a70 con 0x55b794fca580 2023-07-14T13:11:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.051+0000 7f38f9c9bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b795036bb0 con 0x55b794fd02d0 2023-07-14T13:11:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.051+0000 7f38f9c9bb80 10 client.0 _ll_register_callbacks cb 0x7f38d400bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.052+0000 7f38dffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 0x55b794fd78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.052+0000 7f38dffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 0x55b794fd78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58474/0 (socket says 172.21.15.17:58474) 2023-07-14T13:11:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.052+0000 7f38dffff700 1 -- 172.21.15.17:0/140180925 learned_addr learned my addr 172.21.15.17:0/140180925 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.052+0000 7f38df7fe700 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794e266b0 0x55b794fd7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.052+0000 7f38df7fe700 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794fd02d0 0x55b795036530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.052+0000 7f38dffff700 1 -- 172.21.15.17:0/140180925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794fd02d0 msgr2=0x55b795036530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.052+0000 7f38dffff700 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794fd02d0 0x55b795036530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.052+0000 7f38dffff700 1 -- 172.21.15.17:0/140180925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794e266b0 msgr2=0x55b794fd7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.052+0000 7f38dffff700 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794e266b0 0x55b794fd7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.052+0000 7f38dffff700 1 -- 172.21.15.17:0/140180925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b794d32c00 con 0x55b794fca580 2023-07-14T13:11:29.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.053+0000 7f38dffff700 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 0x55b794fd78d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55b794fd4e30 tx=0x7f38d001db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0b5185ebfd46ae9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:29.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.053+0000 7f38bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:11:29.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.053+0000 7f38bf7fe700 1 -- 172.21.15.17:0/140180925 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0016070 con 0x55b794fca580 2023-07-14T13:11:29.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.053+0000 7f38bf7fe700 1 -- 172.21.15.17:0/140180925 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f38d00042c0 con 0x55b794fca580 2023-07-14T13:11:29.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.053+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/140180925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f38d401e070 con 0x55b794fca580 2023-07-14T13:11:29.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.054+0000 7f38bf7fe700 1 -- 172.21.15.17:0/140180925 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38d0004480 con 0x55b794fca580 2023-07-14T13:11:29.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.054+0000 7f38f9c9bb80 10 client.27284 fetch_fsmap learned FSMap version 34 2023-07-14T13:11:29.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.054+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/140180925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55b794d48250 con 0x55b794fca580 2023-07-14T13:11:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.054+0000 7f38bf7fe700 1 -- 172.21.15.17:0/140180925 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38d401e070 con 0x55b794fca580 2023-07-14T13:11:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.054+0000 7f38bf7fe700 1 -- 172.21.15.17:0/140180925 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f38d00108b0 con 0x55b794fca580 2023-07-14T13:11:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.054+0000 7f38f9c9bb80 10 client.27284 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:11:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.054+0000 7f38f9c9bb80 10 client.27284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.054+0000 7f38f9c9bb80 20 client.27284 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.054+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b7950383a0 0x55b79503a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.054+0000 7f38f9c9bb80 4 client.27284 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:11:29.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.054+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/140180925 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b794ed6ff0 con 0x55b7950383a0 2023-07-14T13:11:29.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.055+0000 7f38df7fe700 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b7950383a0 0x55b79503a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:29.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.056+0000 7f38df7fe700 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b7950383a0 0x55b79503a7b0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d9bf442dd144afc server_cookie=9e655c73279e41e8 in_seq=0 out_seq=0 2023-07-14T13:11:29.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.056+0000 7f38bf7fe700 10 client.27284 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:29.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.071+0000 7f38bf7fe700 1 -- 172.21.15.17:0/140180925 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b794ed6ff0 con 0x55b7950383a0 2023-07-14T13:11:29.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.071+0000 7f38bf7fe700 10 client.27284 handle_command_reply: tid=0 2023-07-14T13:11:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.071+0000 7f38f9c9bb80 1 client.27284 shutdown 2023-07-14T13:11:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.071+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/140180925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 msgr2=0x55b794fd78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.071+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 0x55b794fd78d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55b794fd4e30 tx=0x7f38d001db70 comp rx=0 tx=0).stop 2023-07-14T13:11:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.072+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/140180925 shutdown_connections 2023-07-14T13:11:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.072+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b7950383a0 0x55b79503a7b0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.072+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b794fd02d0 0x55b795036530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.072+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b794e266b0 0x55b794fd7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.072+0000 7f38f9c9bb80 1 --2- 172.21.15.17:0/140180925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b794fca580 0x55b794fd78d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.072+0000 7f38bf7fe700 0 client.27284 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.072+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/140180925 >> 172.21.15.17:0/140180925 conn(0x55b794fbfbe0 msgr2=0x55b794fc98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.072+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/140180925 shutdown_connections 2023-07-14T13:11:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.072+0000 7f38f9c9bb80 1 -- 172.21.15.17:0/140180925 wait complete. 2023-07-14T13:11:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.072+0000 7f38f9c9bb80 20 client.27284 trim_cache size 0 max 16384 2023-07-14T13:11:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:11:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:11:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:11:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:11:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 -- 172.21.15.17:0/2327975907 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f38c80a12c0 msgr2=0x7f38c80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f38c80a12c0 0x7f38c80a3770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f38d80964d0 tx=0x7f38d8009040 comp rx=0 tx=0).stop 2023-07-14T13:11:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 -- 172.21.15.17:0/2327975907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38e0105b10 msgr2=0x7f38e019c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38e0105b10 0x7f38e019c8f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f38d800efb0 tx=0x7f38d800c3a0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 -- 172.21.15.17:0/2327975907 shutdown_connections 2023-07-14T13:11:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f38c80a12c0 0x7f38c80a3770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38e0105b10 0x7f38e019c8f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38e00ffb00 0x7f38e0197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 --2- 172.21.15.17:0/2327975907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38e01004b0 0x7f38e0198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 -- 172.21.15.17:0/2327975907 >> 172.21.15.17:0/2327975907 conn(0x7f38e00fb600 msgr2=0x7f38e010aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 -- 172.21.15.17:0/2327975907 shutdown_connections 2023-07-14T13:11:29.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:29.073+0000 7f38e63ff700 1 -- 172.21.15.17:0/2327975907 wait complete. 2023-07-14T13:11:29.457 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:29 smithi135 ceph-mon[97338]: pgmap v367: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 21 MiB/s wr, 75 op/s 2023-07-14T13:11:29.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:29 smithi131 ceph-mon[96953]: pgmap v367: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 21 MiB/s wr, 75 op/s 2023-07-14T13:11:29.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:29 smithi017 ceph-mon[95536]: pgmap v367: 97 pgs: 97 active+clean; 9.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 21 MiB/s wr, 75 op/s 2023-07-14T13:11:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:46300000 of 50000000 tuples (92%) done (elapsed 680.18 s, remaining 54.36 s) 2023-07-14T13:11:31.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:31 smithi135 ceph-mon[97338]: pgmap v368: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 31 MiB/s wr, 118 op/s 2023-07-14T13:11:31.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:31 smithi131 ceph-mon[96953]: pgmap v368: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 31 MiB/s wr, 118 op/s 2023-07-14T13:11:31.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:31 smithi017 ceph-mon[95536]: pgmap v368: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 31 MiB/s wr, 118 op/s 2023-07-14T13:11:31.906 INFO:teuthology.orchestra.run.smithi017.stderr:46400000 of 50000000 tuples (92%) done (elapsed 681.50 s, remaining 52.88 s) 2023-07-14T13:11:32.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:11:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.164+0000 7f51ef3ff700 1 -- 172.21.15.17:0/693348722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e81028c0 msgr2=0x7f51e8106880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.164+0000 7f51ef3ff700 1 --2- 172.21.15.17:0/693348722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e81028c0 0x7f51e8106880 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f51d80099c0 tx=0x7f51d8009cd0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.164+0000 7f51ef3ff700 1 -- 172.21.15.17:0/693348722 shutdown_connections 2023-07-14T13:11:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.164+0000 7f51ef3ff700 1 --2- 172.21.15.17:0/693348722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e8106f60 0x7f51e810eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.164+0000 7f51ef3ff700 1 --2- 172.21.15.17:0/693348722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51e8101f20 0x7f51e81022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.164+0000 7f51ef3ff700 1 --2- 172.21.15.17:0/693348722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e81028c0 0x7f51e8106880 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.164+0000 7f51ef3ff700 1 -- 172.21.15.17:0/693348722 >> 172.21.15.17:0/693348722 conn(0x7f51e80fd750 msgr2=0x7f51e80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.164+0000 7f51ef3ff700 1 -- 172.21.15.17:0/693348722 shutdown_connections 2023-07-14T13:11:33.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.164+0000 7f51ef3ff700 1 -- 172.21.15.17:0/693348722 wait complete. 2023-07-14T13:11:33.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.165+0000 7f51ef3ff700 1 Processor -- start 2023-07-14T13:11:33.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.166+0000 7f51ef3ff700 1 -- start start 2023-07-14T13:11:33.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.166+0000 7f51ef3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51e8101f20 0x7f51e8197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.166+0000 7f51ef3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e81028c0 0x7f51e81982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.166+0000 7f51ef3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e8106f60 0x7f51e819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.166+0000 7f51ef3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e819cd50 con 0x7f51e8106f60 2023-07-14T13:11:33.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.166+0000 7f51ef3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e819cec0 con 0x7f51e8101f20 2023-07-14T13:11:33.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.166+0000 7f51ef3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e819d080 con 0x7f51e81028c0 2023-07-14T13:11:33.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.167+0000 7f51ed19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51e8101f20 0x7f51e8197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.167+0000 7f51ed99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e8106f60 0x7f51e819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.167+0000 7f51ed19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51e8101f20 0x7f51e8197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58496/0 (socket says 172.21.15.17:58496) 2023-07-14T13:11:33.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.167+0000 7f51ed19b700 1 -- 172.21.15.17:0/4228639860 learned_addr learned my addr 172.21.15.17:0/4228639860 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:33.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.167+0000 7f51ec99a700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e81028c0 0x7f51e81982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.167+0000 7f51ec99a700 1 -- 172.21.15.17:0/4228639860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51e8101f20 msgr2=0x7f51e8197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.167+0000 7f51ec99a700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51e8101f20 0x7f51e8197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.167+0000 7f51ec99a700 1 -- 172.21.15.17:0/4228639860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e8106f60 msgr2=0x7f51e819c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.167+0000 7f51ec99a700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e8106f60 0x7f51e819c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.167+0000 7f51ec99a700 1 -- 172.21.15.17:0/4228639860 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d80095f0 con 0x7f51e81028c0 2023-07-14T13:11:33.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.168+0000 7f51ec99a700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e81028c0 0x7f51e81982b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f51d80098e0 tx=0x7f51d800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.168+0000 7f51de7fc700 1 -- 172.21.15.17:0/4228639860 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d801d070 con 0x7f51e81028c0 2023-07-14T13:11:33.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.168+0000 7f51de7fc700 1 -- 172.21.15.17:0/4228639860 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f51d8005050 con 0x7f51e81028c0 2023-07-14T13:11:33.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.168+0000 7f51ef3ff700 1 -- 172.21.15.17:0/4228639860 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e819d300 con 0x7f51e81028c0 2023-07-14T13:11:33.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.168+0000 7f51de7fc700 1 -- 172.21.15.17:0/4228639860 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8004970 con 0x7f51e81028c0 2023-07-14T13:11:33.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.168+0000 7f51ef3ff700 1 -- 172.21.15.17:0/4228639860 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e81a4ba0 con 0x7f51e81028c0 2023-07-14T13:11:33.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.172+0000 7f51de7fc700 1 -- 172.21.15.17:0/4228639860 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f51d8005430 con 0x7f51e81028c0 2023-07-14T13:11:33.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.174+0000 7f51de7fc700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51d40a1340 0x7f51d40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.174+0000 7f51de7fc700 1 -- 172.21.15.17:0/4228639860 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f51d80cd760 con 0x7f51e81028c0 2023-07-14T13:11:33.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.174+0000 7f5202cacb80 1 Processor -- start 2023-07-14T13:11:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.175+0000 7f51ed19b700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51d40a1340 0x7f51d40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.175+0000 7f5202cacb80 1 -- start start 2023-07-14T13:11:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.175+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42eb2d0 0x55dbd42eb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.176+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42feda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.176+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd43016c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.176+0000 7f5202cacb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd41f1cb0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.176+0000 7f5202cacb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd4244a40 con 0x55dbd42eb2d0 2023-07-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.176+0000 7f5202cacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd423ded0 con 0x55dbd42ff2e0 2023-07-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.176+0000 7f51ed19b700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51d40a1340 0x7f51d40a37f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009d00 tx=0x7f51e4009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.176+0000 7f51ec99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42feda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.176+0000 7f51ec99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42feda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52742/0 (socket says 172.21.15.17:52742) 2023-07-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.176+0000 7f51ed19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42eb2d0 0x55dbd42eb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.176+0000 7f51ec99a700 1 -- 172.21.15.17:0/2253375807 learned_addr learned my addr 172.21.15.17:0/2253375807 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.176+0000 7f51ed99c700 1 --2- 172.21.15.17:0/2253375807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd43016c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.177+0000 7f51ec99a700 1 -- 172.21.15.17:0/2253375807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 msgr2=0x55dbd43016c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:33.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.177+0000 7f51ec99a700 1 --2- 172.21.15.17:0/2253375807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd43016c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.177+0000 7f51ec99a700 1 -- 172.21.15.17:0/2253375807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42eb2d0 msgr2=0x55dbd42eb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:33.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.177+0000 7f51ec99a700 1 --2- 172.21.15.17:0/2253375807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42eb2d0 0x55dbd42eb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.177+0000 7f51ec99a700 1 -- 172.21.15.17:0/2253375807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbd406bde0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.224 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.177+0000 7f51ec99a700 1 --2- 172.21.15.17:0/2253375807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42feda0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f51d80a2770 tx=0x7f51d809a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8aa4f8a6823dae server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.177+0000 7f51d37fe700 1 -- 172.21.15.17:0/2253375807 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80a2ca0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.177+0000 7f51d37fe700 1 -- 172.21.15.17:0/2253375807 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f51d8098c80 con 0x55dbd42ebbe0 2023-07-14T13:11:33.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.177+0000 7f51d37fe700 1 -- 172.21.15.17:0/2253375807 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8099dd0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.178+0000 7f5202cacb80 1 -- 172.21.15.17:0/2253375807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 msgr2=0x55dbd42feda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.178+0000 7f5202cacb80 1 --2- 172.21.15.17:0/2253375807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42feda0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f51d80a2770 tx=0x7f51d809a290 comp rx=0 tx=0).stop 2023-07-14T13:11:33.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.178+0000 7f5202cacb80 1 -- 172.21.15.17:0/2253375807 shutdown_connections 2023-07-14T13:11:33.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.178+0000 7f5202cacb80 1 --2- 172.21.15.17:0/2253375807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd43016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.178+0000 7f5202cacb80 1 --2- 172.21.15.17:0/2253375807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42eb2d0 0x55dbd42eb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.178+0000 7f5202cacb80 1 --2- 172.21.15.17:0/2253375807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42feda0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.178+0000 7f5202cacb80 1 -- 172.21.15.17:0/2253375807 >> 172.21.15.17:0/2253375807 conn(0x55dbd42e1da0 msgr2=0x55dbd42e76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.178+0000 7f5202cacb80 1 -- 172.21.15.17:0/2253375807 shutdown_connections 2023-07-14T13:11:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.179+0000 7f5202cacb80 1 -- 172.21.15.17:0/2253375807 wait complete. 2023-07-14T13:11:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.179+0000 7f5202cacb80 1 -- start start 2023-07-14T13:11:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.180+0000 7f5202cacb80 1 Processor -- start 2023-07-14T13:11:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.180+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42eb2d0 0x55dbd42ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.180+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.180+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ff2e0 0x55dbd4300130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.180+0000 7f5202cacb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd41ddac0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.180+0000 7f5202cacb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd41dd7c0 con 0x55dbd42ff2e0 2023-07-14T13:11:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.180+0000 7f5202cacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd40c1920 con 0x55dbd42eb2d0 2023-07-14T13:11:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.181+0000 7f5202cacb80 10 client.0 _ll_register_callbacks cb 0x55dbd41db760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.181+0000 7f51ec99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.181+0000 7f51ec99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52744/0 (socket says 172.21.15.17:52744) 2023-07-14T13:11:33.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.181+0000 7f51ec99a700 1 -- 172.21.15.17:0/351150877 learned_addr learned my addr 172.21.15.17:0/351150877 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:33.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.181+0000 7f51ed99c700 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ff2e0 0x55dbd4300130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.181+0000 7f51ed19b700 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42eb2d0 0x55dbd42ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.181+0000 7f51ec99a700 1 -- 172.21.15.17:0/351150877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42eb2d0 msgr2=0x55dbd42ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:33.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.181+0000 7f51ec99a700 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42eb2d0 0x55dbd42ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.181+0000 7f51ec99a700 1 -- 172.21.15.17:0/351150877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ff2e0 msgr2=0x55dbd4300130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:33.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.182+0000 7f51ec99a700 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ff2e0 0x55dbd4300130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.182+0000 7f51ec99a700 1 -- 172.21.15.17:0/351150877 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e81a4ba0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.182+0000 7f51ec99a700 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42ffbf0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f51d80cb4d0 tx=0x7f51d8098df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9956d80643a82e36 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.182+0000 7f51d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:11:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.182+0000 7f51d0ff9700 1 -- 172.21.15.17:0/351150877 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d809ab40 con 0x55dbd42ebbe0 2023-07-14T13:11:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.182+0000 7f5202cacb80 1 -- 172.21.15.17:0/351150877 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dbd41974f0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.182+0000 7f51d0ff9700 1 -- 172.21.15.17:0/351150877 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f51d809aca0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.182+0000 7f51d0ff9700 1 -- 172.21.15.17:0/351150877 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51d80a2810 con 0x55dbd42ebbe0 2023-07-14T13:11:33.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.182+0000 7f5202cacb80 10 client.17571 fetch_fsmap learned FSMap version 34 2023-07-14T13:11:33.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.182+0000 7f5202cacb80 1 -- 172.21.15.17:0/351150877 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55dbd4054c60 con 0x55dbd42ebbe0 2023-07-14T13:11:33.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.183+0000 7f51d0ff9700 1 -- 172.21.15.17:0/351150877 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dbd41974f0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.183+0000 7f51d0ff9700 1 -- 172.21.15.17:0/351150877 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f51d80966d0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.183+0000 7f5202cacb80 10 client.17571 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:11:33.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.183+0000 7f5202cacb80 10 client.17571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:33.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.183+0000 7f5202cacb80 20 client.17571 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:33.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.183+0000 7f5202cacb80 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbd430e480 0x55dbd4310890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.183+0000 7f5202cacb80 4 client.17571 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:11:33.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.183+0000 7f5202cacb80 1 -- 172.21.15.17:0/351150877 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dbd4236eb0 con 0x55dbd430e480 2023-07-14T13:11:33.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.184+0000 7f51ed19b700 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbd430e480 0x55dbd4310890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.185+0000 7f51ed19b700 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbd430e480 0x55dbd4310890 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ed47a7da41b4a4b server_cookie=8ecba5037c50db87 in_seq=0 out_seq=0 2023-07-14T13:11:33.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.185+0000 7f51d0ff9700 10 client.17571 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:33.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.186+0000 7f51d0ff9700 1 -- 172.21.15.17:0/351150877 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55dbd4236eb0 con 0x55dbd430e480 2023-07-14T13:11:33.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.186+0000 7f51d0ff9700 10 client.17571 handle_command_reply: tid=0 2023-07-14T13:11:33.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.186+0000 7f5202cacb80 1 client.17571 shutdown 2023-07-14T13:11:33.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.186+0000 7f5202cacb80 1 -- 172.21.15.17:0/351150877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 msgr2=0x55dbd42ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.186+0000 7f5202cacb80 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42ffbf0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f51d80cb4d0 tx=0x7f51d8098df0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.186+0000 7f5202cacb80 1 -- 172.21.15.17:0/351150877 shutdown_connections 2023-07-14T13:11:33.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.186+0000 7f5202cacb80 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbd430e480 0x55dbd4310890 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.186+0000 7f5202cacb80 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ff2e0 0x55dbd4300130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.187+0000 7f5202cacb80 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42eb2d0 0x55dbd42ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.187+0000 7f5202cacb80 1 --2- 172.21.15.17:0/351150877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd42ffbf0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.187+0000 7f5202cacb80 1 -- 172.21.15.17:0/351150877 >> 172.21.15.17:0/351150877 conn(0x55dbd42e1da0 msgr2=0x55dbd42e7230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:33.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.187+0000 7f51d0ff9700 0 client.17571 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:33.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.187+0000 7f5202cacb80 1 -- 172.21.15.17:0/351150877 shutdown_connections 2023-07-14T13:11:33.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.187+0000 7f5202cacb80 1 -- 172.21.15.17:0/351150877 wait complete. 2023-07-14T13:11:33.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.187+0000 7f5202cacb80 20 client.17571 trim_cache size 0 max 16384 2023-07-14T13:11:33.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.207+0000 7f5202cacb80 1 Processor -- start 2023-07-14T13:11:33.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.207+0000 7f5202cacb80 1 -- start start 2023-07-14T13:11:33.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42eb2d0 0x55dbd42f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd43036e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd430acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f5202cacb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd42e3ec0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f5202cacb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd42ece30 con 0x55dbd42eb2d0 2023-07-14T13:11:33.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f5202cacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd42ec540 con 0x55dbd42ff2e0 2023-07-14T13:11:33.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f51ec99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd43036e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f51ec99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd43036e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52750/0 (socket says 172.21.15.17:52750) 2023-07-14T13:11:33.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f51ec99a700 1 -- 172.21.15.17:0/1845215230 learned_addr learned my addr 172.21.15.17:0/1845215230 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:33.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f51ed99c700 1 --2- 172.21.15.17:0/1845215230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd430acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f51ed19b700 1 --2- 172.21.15.17:0/1845215230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42eb2d0 0x55dbd42f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f51ec99a700 1 -- 172.21.15.17:0/1845215230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 msgr2=0x55dbd430acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:33.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f51ec99a700 1 --2- 172.21.15.17:0/1845215230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd430acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f51ec99a700 1 -- 172.21.15.17:0/1845215230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42eb2d0 msgr2=0x55dbd42f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:33.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f51ec99a700 1 --2- 172.21.15.17:0/1845215230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42eb2d0 0x55dbd42f8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.208+0000 7f51ec99a700 1 -- 172.21.15.17:0/1845215230 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbd4092250 con 0x55dbd42ebbe0 2023-07-14T13:11:33.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.209+0000 7f51ec99a700 1 --2- 172.21.15.17:0/1845215230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd43036e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f51d809a5e0 tx=0x7f51d8096b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0813b6a87193a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.209+0000 7f51d3fff700 1 -- 172.21.15.17:0/1845215230 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d809eea0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.209+0000 7f51d3fff700 1 -- 172.21.15.17:0/1845215230 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f51d809a8e0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.209+0000 7f51d3fff700 1 -- 172.21.15.17:0/1845215230 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d809ada0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.210+0000 7f5202cacb80 1 -- 172.21.15.17:0/1845215230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 msgr2=0x55dbd43036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.210+0000 7f5202cacb80 1 --2- 172.21.15.17:0/1845215230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd43036e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f51d809a5e0 tx=0x7f51d8096b40 comp rx=0 tx=0).stop 2023-07-14T13:11:33.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.210+0000 7f5202cacb80 1 -- 172.21.15.17:0/1845215230 shutdown_connections 2023-07-14T13:11:33.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.210+0000 7f5202cacb80 1 --2- 172.21.15.17:0/1845215230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd430acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.210+0000 7f5202cacb80 1 --2- 172.21.15.17:0/1845215230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42eb2d0 0x55dbd42f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.210+0000 7f5202cacb80 1 --2- 172.21.15.17:0/1845215230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42ebbe0 0x55dbd43036e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.210+0000 7f5202cacb80 1 -- 172.21.15.17:0/1845215230 >> 172.21.15.17:0/1845215230 conn(0x55dbd42e1da0 msgr2=0x55dbd42e5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:33.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.210+0000 7f5202cacb80 1 -- 172.21.15.17:0/1845215230 shutdown_connections 2023-07-14T13:11:33.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.210+0000 7f5202cacb80 1 -- 172.21.15.17:0/1845215230 wait complete. 2023-07-14T13:11:33.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.210+0000 7f5202cacb80 1 -- start start 2023-07-14T13:11:33.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.211+0000 7f5202cacb80 1 Processor -- start 2023-07-14T13:11:33.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.211+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42eb2d0 0x55dbd4303540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.211+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ebbe0 0x55dbd4301870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.211+0000 7f5202cacb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd4301db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.211+0000 7f5202cacb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd43022f0 con 0x55dbd42eb2d0 2023-07-14T13:11:33.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.211+0000 7f5202cacb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd4302460 con 0x55dbd42ebbe0 2023-07-14T13:11:33.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.211+0000 7f5202cacb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbd4302620 con 0x55dbd42ff2e0 2023-07-14T13:11:33.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.211+0000 7f5202cacb80 10 client.0 _ll_register_callbacks cb 0x7f51d809a4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:33.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51ed19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42eb2d0 0x55dbd4303540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51ec99a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ebbe0 0x55dbd4301870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51ed99c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd4301db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51ec99a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ebbe0 0x55dbd4301870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58530/0 (socket says 172.21.15.17:58530) 2023-07-14T13:11:33.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51ec99a700 1 -- 172.21.15.17:0/1251734812 learned_addr learned my addr 172.21.15.17:0/1251734812 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:33.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51ec99a700 1 -- 172.21.15.17:0/1251734812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 msgr2=0x55dbd4301db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:33.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51ec99a700 1 --2- 172.21.15.17:0/1251734812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd4301db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51ec99a700 1 -- 172.21.15.17:0/1251734812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42eb2d0 msgr2=0x55dbd4303540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:33.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51ec99a700 1 --2- 172.21.15.17:0/1251734812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42eb2d0 0x55dbd4303540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51ec99a700 1 -- 172.21.15.17:0/1251734812 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbd4054c60 con 0x55dbd42ebbe0 2023-07-14T13:11:33.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51ec99a700 1 --2- 172.21.15.17:0/1251734812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ebbe0 0x55dbd4301870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f51d8096d90 tx=0x7f51d809aef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b0066404272568f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:33.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.212+0000 7f51d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:11:33.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.213+0000 7f51d0ff9700 1 -- 172.21.15.17:0/1251734812 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d809eea0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.213+0000 7f51d0ff9700 1 -- 172.21.15.17:0/1251734812 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f51d80ba0b0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.213+0000 7f5202cacb80 1 -- 172.21.15.17:0/1251734812 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f51d8098c80 con 0x55dbd42ebbe0 2023-07-14T13:11:33.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.213+0000 7f51d0ff9700 1 -- 172.21.15.17:0/1251734812 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51d80ba2b0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.213+0000 7f5202cacb80 10 client.27302 fetch_fsmap learned FSMap version 34 2023-07-14T13:11:33.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.213+0000 7f5202cacb80 1 -- 172.21.15.17:0/1251734812 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55dbd406a2b0 con 0x55dbd42ebbe0 2023-07-14T13:11:33.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.213+0000 7f51d0ff9700 1 -- 172.21.15.17:0/1251734812 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f51d8098c80 con 0x55dbd42ebbe0 2023-07-14T13:11:33.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.213+0000 7f51d0ff9700 1 -- 172.21.15.17:0/1251734812 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f51d8004d30 con 0x55dbd42ebbe0 2023-07-14T13:11:33.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.213+0000 7f5202cacb80 10 client.27302 fetch_fsmap finished waiting for FSMap version 34 2023-07-14T13:11:33.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.213+0000 7f5202cacb80 10 client.27302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:33.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.213+0000 7f5202cacb80 20 client.27302 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:33.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.214+0000 7f5202cacb80 1 --2- 172.21.15.17:0/1251734812 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbd4363290 0x55dbd4365670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:33.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.214+0000 7f5202cacb80 4 client.27302 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:11:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.214+0000 7f5202cacb80 1 -- 172.21.15.17:0/1251734812 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dbd41f9050 con 0x55dbd4363290 2023-07-14T13:11:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.214+0000 7f51ed19b700 1 --2- 172.21.15.17:0/1251734812 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbd4363290 0x55dbd4365670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.214+0000 7f51ed19b700 1 --2- 172.21.15.17:0/1251734812 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbd4363290 0x55dbd4365670 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c047c2de4d9dae0 server_cookie=21663aadf7946435 in_seq=0 out_seq=0 2023-07-14T13:11:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.214+0000 7f51d0ff9700 10 client.27302 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f51d0ff9700 1 -- 172.21.15.17:0/1251734812 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55dbd41f9050 con 0x55dbd4363290 2023-07-14T13:11:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f51d0ff9700 10 client.27302 handle_command_reply: tid=0 2023-07-14T13:11:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 1 client.27302 shutdown 2023-07-14T13:11:33.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 1 -- 172.21.15.17:0/1251734812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ebbe0 msgr2=0x55dbd4301870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 1 --2- 172.21.15.17:0/1251734812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ebbe0 0x55dbd4301870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f51d8096d90 tx=0x7f51d809aef0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 1 -- 172.21.15.17:0/1251734812 shutdown_connections 2023-07-14T13:11:33.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 1 --2- 172.21.15.17:0/1251734812 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbd4363290 0x55dbd4365670 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 1 --2- 172.21.15.17:0/1251734812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbd42ff2e0 0x55dbd4301db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 1 --2- 172.21.15.17:0/1251734812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbd42eb2d0 0x55dbd4303540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 1 --2- 172.21.15.17:0/1251734812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbd42ebbe0 0x55dbd4301870 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f51d0ff9700 0 client.27302 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:33.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 1 -- 172.21.15.17:0/1251734812 >> 172.21.15.17:0/1251734812 conn(0x55dbd42e1da0 msgr2=0x55dbd430acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:33.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 1 -- 172.21.15.17:0/1251734812 shutdown_connections 2023-07-14T13:11:33.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 1 -- 172.21.15.17:0/1251734812 wait complete. 2023-07-14T13:11:33.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.215+0000 7f5202cacb80 20 client.27302 trim_cache size 0 max 16384 2023-07-14T13:11:33.260 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:11:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:11:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:11:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:11:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:11:33.260 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:11:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:11:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:11:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:11:33.261 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:11:33.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 -- 172.21.15.17:0/4228639860 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51d40a1340 msgr2=0x7f51d40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51d40a1340 0x7f51d40a37f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009d00 tx=0x7f51e4009260 comp rx=0 tx=0).stop 2023-07-14T13:11:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 -- 172.21.15.17:0/4228639860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e81028c0 msgr2=0x7f51e81982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e81028c0 0x7f51e81982b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f51d80098e0 tx=0x7f51d800f690 comp rx=0 tx=0).stop 2023-07-14T13:11:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 -- 172.21.15.17:0/4228639860 shutdown_connections 2023-07-14T13:11:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51d40a1340 0x7f51d40a37f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e8106f60 0x7f51e819c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51e8101f20 0x7f51e8197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 --2- 172.21.15.17:0/4228639860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51e81028c0 0x7f51e81982b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:33.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 -- 172.21.15.17:0/4228639860 >> 172.21.15.17:0/4228639860 conn(0x7f51e80fd750 msgr2=0x7f51e8105960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:33.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 -- 172.21.15.17:0/4228639860 shutdown_connections 2023-07-14T13:11:33.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:11:33.216+0000 7f51ef3ff700 1 -- 172.21.15.17:0/4228639860 wait complete. 2023-07-14T13:11:33.263 INFO:teuthology.orchestra.run.smithi017.stderr:46500000 of 50000000 tuples (93%) done (elapsed 682.86 s, remaining 51.40 s) 2023-07-14T13:11:33.275 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:11:33.363 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:33 smithi017 ceph-mon[95536]: pgmap v369: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 22 MiB/s wr, 84 op/s 2023-07-14T13:11:33.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:33 smithi135 ceph-mon[97338]: pgmap v369: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 22 MiB/s wr, 84 op/s 2023-07-14T13:11:33.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:33 smithi131 ceph-mon[96953]: pgmap v369: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 22 MiB/s wr, 84 op/s 2023-07-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi017.stderr:46600000 of 50000000 tuples (93%) done (elapsed 684.25 s, remaining 49.92 s) 2023-07-14T13:11:35.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:35 smithi135 ceph-mon[97338]: pgmap v370: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 22 MiB/s wr, 84 op/s 2023-07-14T13:11:35.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:35 smithi131 ceph-mon[96953]: pgmap v370: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 22 MiB/s wr, 84 op/s 2023-07-14T13:11:35.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:35 smithi017 ceph-mon[95536]: pgmap v370: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 22 MiB/s wr, 84 op/s 2023-07-14T13:11:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:46700000 of 50000000 tuples (93%) done (elapsed 685.68 s, remaining 48.45 s) 2023-07-14T13:11:37.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:37 smithi135 ceph-mon[97338]: pgmap v371: 97 pgs: 97 active+clean; 9.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 33 MiB/s wr, 119 op/s 2023-07-14T13:11:37.455 INFO:teuthology.orchestra.run.smithi017.stderr:46800000 of 50000000 tuples (93%) done (elapsed 687.05 s, remaining 46.98 s) 2023-07-14T13:11:37.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:37 smithi131 ceph-mon[96953]: pgmap v371: 97 pgs: 97 active+clean; 9.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 33 MiB/s wr, 119 op/s 2023-07-14T13:11:37.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:37 smithi017 ceph-mon[95536]: pgmap v371: 97 pgs: 97 active+clean; 9.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 33 MiB/s wr, 119 op/s 2023-07-14T13:11:38.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:38 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:11:38.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:38 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:11:38.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:38 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:11:38.750 INFO:teuthology.orchestra.run.smithi017.stderr:46900000 of 50000000 tuples (93%) done (elapsed 688.35 s, remaining 45.50 s) 2023-07-14T13:11:39.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:39 smithi135 ceph-mon[97338]: pgmap v372: 97 pgs: 97 active+clean; 9.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 22 MiB/s wr, 78 op/s 2023-07-14T13:11:39.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:39 smithi131 ceph-mon[96953]: pgmap v372: 97 pgs: 97 active+clean; 9.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 22 MiB/s wr, 78 op/s 2023-07-14T13:11:39.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:39 smithi017 ceph-mon[95536]: pgmap v372: 97 pgs: 97 active+clean; 9.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 22 MiB/s wr, 78 op/s 2023-07-14T13:11:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:47000000 of 50000000 tuples (94%) done (elapsed 689.78 s, remaining 44.03 s) 2023-07-14T13:11:41.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:41 smithi135 ceph-mon[97338]: pgmap v373: 97 pgs: 97 active+clean; 9.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 31 MiB/s wr, 106 op/s 2023-07-14T13:11:41.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:41 smithi131 ceph-mon[96953]: pgmap v373: 97 pgs: 97 active+clean; 9.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 31 MiB/s wr, 106 op/s 2023-07-14T13:11:41.547 INFO:teuthology.orchestra.run.smithi017.stderr:47100000 of 50000000 tuples (94%) done (elapsed 691.15 s, remaining 42.55 s) 2023-07-14T13:11:41.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:41 smithi017 ceph-mon[95536]: pgmap v373: 97 pgs: 97 active+clean; 9.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 31 MiB/s wr, 106 op/s 2023-07-14T13:11:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.235+0000 7f428c7ff700 1 -- 172.21.15.17:0/3053074823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4284105b10 msgr2=0x7f4284105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.235+0000 7f428c7ff700 1 --2- 172.21.15.17:0/3053074823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4284105b10 0x7f4284105ee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4280009990 tx=0x7f4280009ca0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.235+0000 7f428c7ff700 1 -- 172.21.15.17:0/3053074823 shutdown_connections 2023-07-14T13:11:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.235+0000 7f428c7ff700 1 --2- 172.21.15.17:0/3053074823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42841004b0 0x7f428410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.235+0000 7f428c7ff700 1 --2- 172.21.15.17:0/3053074823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4284105b10 0x7f4284105ee0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.235+0000 7f428c7ff700 1 --2- 172.21.15.17:0/3053074823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42840ffb00 0x7f42840fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.235+0000 7f428c7ff700 1 -- 172.21.15.17:0/3053074823 >> 172.21.15.17:0/3053074823 conn(0x7f42840fb600 msgr2=0x7f42840fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.235+0000 7f428c7ff700 1 -- 172.21.15.17:0/3053074823 shutdown_connections 2023-07-14T13:11:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.235+0000 7f428c7ff700 1 -- 172.21.15.17:0/3053074823 wait complete. 2023-07-14T13:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.236+0000 7f428c7ff700 1 Processor -- start 2023-07-14T13:11:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f428c7ff700 1 -- start start 2023-07-14T13:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f428c7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42840ffb00 0x7f428419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f428c7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42841004b0 0x7f428419c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f428c7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4284105b10 0x7f4284195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f428c7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42841960e0 con 0x7f42841004b0 2023-07-14T13:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f428c7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4284196250 con 0x7f4284105b10 2023-07-14T13:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f428c7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4284196410 con 0x7f42840ffb00 2023-07-14T13:11:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f428a59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42840ffb00 0x7f428419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f428a59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42840ffb00 0x7f428419bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38700/0 (socket says 172.21.15.17:38700) 2023-07-14T13:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f428a59b700 1 -- 172.21.15.17:0/110902660 learned_addr learned my addr 172.21.15.17:0/110902660 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f4289d9a700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42841004b0 0x7f428419c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.237+0000 7f428ad9c700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4284105b10 0x7f4284195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.238+0000 7f428a59b700 1 -- 172.21.15.17:0/110902660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4284105b10 msgr2=0x7f4284195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.238+0000 7f428a59b700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4284105b10 0x7f4284195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.238+0000 7f428a59b700 1 -- 172.21.15.17:0/110902660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42841004b0 msgr2=0x7f428419c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.238+0000 7f428a59b700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42841004b0 0x7f428419c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.238+0000 7f428a59b700 1 -- 172.21.15.17:0/110902660 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4274009520 con 0x7f42840ffb00 2023-07-14T13:11:42.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.238+0000 7f4289d9a700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42841004b0 0x7f428419c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:42.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.238+0000 7f428a59b700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42840ffb00 0x7f428419bc20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4280005740 tx=0x7f4280005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.239+0000 7f427b7fe700 1 -- 172.21.15.17:0/110902660 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428001d070 con 0x7f42840ffb00 2023-07-14T13:11:42.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.239+0000 7f427b7fe700 1 -- 172.21.15.17:0/110902660 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4280022470 con 0x7f42840ffb00 2023-07-14T13:11:42.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.239+0000 7f428c7ff700 1 -- 172.21.15.17:0/110902660 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42800095f0 con 0x7f42840ffb00 2023-07-14T13:11:42.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.239+0000 7f427b7fe700 1 -- 172.21.15.17:0/110902660 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280017650 con 0x7f42840ffb00 2023-07-14T13:11:42.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.239+0000 7f428c7ff700 1 -- 172.21.15.17:0/110902660 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42841a2a30 con 0x7f42840ffb00 2023-07-14T13:11:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.243+0000 7f427b7fe700 1 -- 172.21.15.17:0/110902660 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f42800225e0 con 0x7f42840ffb00 2023-07-14T13:11:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.243+0000 7f42a0192b80 1 Processor -- start 2023-07-14T13:11:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f42a0192b80 1 -- start start 2023-07-14T13:11:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0b366b0 0x5633b0cdfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0ce02d0 0x5633b0cda040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0cda9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f42a0192b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0bdfc50 con 0x5633b0ce02d0 2023-07-14T13:11:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f42a0192b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0c329e0 con 0x5633b0cda580 2023-07-14T13:11:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f42a0192b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0c2be70 con 0x5633b0b366b0 2023-07-14T13:11:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f428ad9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0b366b0 0x5633b0cdfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f428a59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0ce02d0 0x5633b0cda040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f428ad9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0b366b0 0x5633b0cdfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38714/0 (socket says 172.21.15.17:38714) 2023-07-14T13:11:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f428ad9c700 1 -- 172.21.15.17:0/2943154383 learned_addr learned my addr 172.21.15.17:0/2943154383 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.244+0000 7f4289d9a700 1 --2- 172.21.15.17:0/2943154383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0cda9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.245+0000 7f428ad9c700 1 -- 172.21.15.17:0/2943154383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 msgr2=0x5633b0cda9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.245+0000 7f428ad9c700 1 --2- 172.21.15.17:0/2943154383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0cda9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.245+0000 7f427b7fe700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42700a1340 0x7f42700a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.245+0000 7f428ad9c700 1 -- 172.21.15.17:0/2943154383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0ce02d0 msgr2=0x5633b0cda040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.245+0000 7f428ad9c700 1 --2- 172.21.15.17:0/2943154383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0ce02d0 0x5633b0cda040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.245+0000 7f428ad9c700 1 -- 172.21.15.17:0/2943154383 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633b0a59d80 con 0x5633b0b366b0 2023-07-14T13:11:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.245+0000 7f427b7fe700 1 -- 172.21.15.17:0/110902660 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f42800cdf80 con 0x7f42840ffb00 2023-07-14T13:11:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.245+0000 7f428ad9c700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42700a1340 0x7f42700a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.245+0000 7f428ad9c700 1 --2- 172.21.15.17:0/2943154383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0b366b0 0x5633b0cdfd90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f427c011680 tx=0x7f427c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fae5da6c254df9b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.246+0000 7f4278ff9700 1 -- 172.21.15.17:0/2943154383 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c00e040 con 0x5633b0b366b0 2023-07-14T13:11:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.246+0000 7f4278ff9700 1 -- 172.21.15.17:0/2943154383 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f427c00f040 con 0x5633b0b366b0 2023-07-14T13:11:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.246+0000 7f4278ff9700 1 -- 172.21.15.17:0/2943154383 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c015700 con 0x5633b0b366b0 2023-07-14T13:11:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.247+0000 7f42a0192b80 1 -- 172.21.15.17:0/2943154383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0b366b0 msgr2=0x5633b0cdfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.247+0000 7f428ad9c700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42700a1340 0x7f42700a37f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f427c0094f0 tx=0x7f427c023000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.247+0000 7f42a0192b80 1 --2- 172.21.15.17:0/2943154383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0b366b0 0x5633b0cdfd90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f427c011680 tx=0x7f427c009920 comp rx=0 tx=0).stop 2023-07-14T13:11:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.247+0000 7f42a0192b80 1 -- 172.21.15.17:0/2943154383 shutdown_connections 2023-07-14T13:11:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.247+0000 7f42a0192b80 1 --2- 172.21.15.17:0/2943154383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0cda9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.247+0000 7f42a0192b80 1 --2- 172.21.15.17:0/2943154383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0b366b0 0x5633b0cdfd90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.247+0000 7f42a0192b80 1 --2- 172.21.15.17:0/2943154383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0ce02d0 0x5633b0cda040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.247+0000 7f42a0192b80 1 -- 172.21.15.17:0/2943154383 >> 172.21.15.17:0/2943154383 conn(0x5633b0ccfbe0 msgr2=0x5633b0cd4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.247+0000 7f42a0192b80 1 -- 172.21.15.17:0/2943154383 shutdown_connections 2023-07-14T13:11:42.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.247+0000 7f42a0192b80 1 -- 172.21.15.17:0/2943154383 wait complete. 2023-07-14T13:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.248+0000 7f42a0192b80 1 -- start start 2023-07-14T13:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.248+0000 7f42a0192b80 1 Processor -- start 2023-07-14T13:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.248+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0b366b0 0x5633b0ce6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.248+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0cda580 0x5633b0ce37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.248+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0ce02d0 0x5633b0ce3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.248+0000 7f42a0192b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0bcba60 con 0x5633b0ce02d0 2023-07-14T13:11:42.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.248+0000 7f42a0192b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0bcb760 con 0x5633b0b366b0 2023-07-14T13:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.248+0000 7f42a0192b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0aaf8c0 con 0x5633b0cda580 2023-07-14T13:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.248+0000 7f42a0192b80 10 client.0 _ll_register_callbacks cb 0x5633b0bc9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f428a59b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0b366b0 0x5633b0ce6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f4289d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0cda580 0x5633b0ce37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f428a59b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0b366b0 0x5633b0ce6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44538/0 (socket says 172.21.15.17:44538) 2023-07-14T13:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f428a59b700 1 -- 172.21.15.17:0/1078808586 learned_addr learned my addr 172.21.15.17:0/1078808586 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:42.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f428ad9c700 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0ce02d0 0x5633b0ce3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f428a59b700 1 -- 172.21.15.17:0/1078808586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0cda580 msgr2=0x5633b0ce37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f428a59b700 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0cda580 0x5633b0ce37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f428a59b700 1 -- 172.21.15.17:0/1078808586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0ce02d0 msgr2=0x5633b0ce3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f428a59b700 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0ce02d0 0x5633b0ce3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f428a59b700 1 -- 172.21.15.17:0/1078808586 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c011330 con 0x5633b0b366b0 2023-07-14T13:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f428a59b700 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0b366b0 0x5633b0ce6560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f42800cbcf0 tx=0x7f4280005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f992b2ceb5eb6ef9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.249+0000 7f426dffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.250+0000 7f426dffb700 1 -- 172.21.15.17:0/1078808586 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280097440 con 0x5633b0b366b0 2023-07-14T13:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.250+0000 7f426dffb700 1 -- 172.21.15.17:0/1078808586 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f42800cbe40 con 0x5633b0b366b0 2023-07-14T13:11:42.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.250+0000 7f42a0192b80 1 -- 172.21.15.17:0/1078808586 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633b0b85490 con 0x5633b0b366b0 2023-07-14T13:11:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.250+0000 7f426dffb700 1 -- 172.21.15.17:0/1078808586 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f428009aed0 con 0x5633b0b366b0 2023-07-14T13:11:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.250+0000 7f42a0192b80 10 client.27314 fetch_fsmap learned FSMap version 36 2023-07-14T13:11:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.250+0000 7f42a0192b80 1 -- 172.21.15.17:0/1078808586 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5633b0a42c00 con 0x5633b0b366b0 2023-07-14T13:11:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.250+0000 7f426dffb700 1 -- 172.21.15.17:0/1078808586 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42800b2030 con 0x5633b0b366b0 2023-07-14T13:11:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.250+0000 7f426dffb700 1 -- 172.21.15.17:0/1078808586 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 36) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f428009b360 con 0x5633b0b366b0 2023-07-14T13:11:42.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.251+0000 7f42a0192b80 10 client.27314 fetch_fsmap finished waiting for FSMap version 36 2023-07-14T13:11:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.251+0000 7f42a0192b80 10 client.27314 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.251+0000 7f42a0192b80 20 client.27314 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.251+0000 7f42a0192b80 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5633b0cf7b70 0x5633b0cf9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.251+0000 7f42a0192b80 4 client.27314 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:11:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.251+0000 7f42a0192b80 1 -- 172.21.15.17:0/1078808586 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633b0c24e50 con 0x5633b0cf7b70 2023-07-14T13:11:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.251+0000 7f4289d9a700 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5633b0cf7b70 0x5633b0cf9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.252+0000 7f4289d9a700 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5633b0cf7b70 0x5633b0cf9f80 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8e06ed8c99be08e server_cookie=7b0f152bca336931 in_seq=0 out_seq=0 2023-07-14T13:11:42.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.252+0000 7f426dffb700 10 client.27314 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.252+0000 7f426dffb700 1 -- 172.21.15.17:0/1078808586 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5633b0c24e50 con 0x5633b0cf7b70 2023-07-14T13:11:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.252+0000 7f426dffb700 10 client.27314 handle_command_reply: tid=0 2023-07-14T13:11:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.252+0000 7f42a0192b80 1 client.27314 shutdown 2023-07-14T13:11:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f42a0192b80 1 -- 172.21.15.17:0/1078808586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0b366b0 msgr2=0x5633b0ce6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f42a0192b80 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0b366b0 0x5633b0ce6560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f42800cbcf0 tx=0x7f4280005c00 comp rx=0 tx=0).stop 2023-07-14T13:11:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f42a0192b80 1 -- 172.21.15.17:0/1078808586 shutdown_connections 2023-07-14T13:11:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f42a0192b80 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5633b0cf7b70 0x5633b0cf9f80 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f42a0192b80 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0ce02d0 0x5633b0ce3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f42a0192b80 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0b366b0 0x5633b0ce6560 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f426dffb700 0 client.27314 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f42a0192b80 1 --2- 172.21.15.17:0/1078808586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0cda580 0x5633b0ce37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f42a0192b80 1 -- 172.21.15.17:0/1078808586 >> 172.21.15.17:0/1078808586 conn(0x5633b0ccfbe0 msgr2=0x5633b0cd44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f42a0192b80 1 -- 172.21.15.17:0/1078808586 shutdown_connections 2023-07-14T13:11:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f42a0192b80 1 -- 172.21.15.17:0/1078808586 wait complete. 2023-07-14T13:11:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.253+0000 7f42a0192b80 20 client.27314 trim_cache size 0 max 16384 2023-07-14T13:11:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.274+0000 7f42a0192b80 1 Processor -- start 2023-07-14T13:11:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f42a0192b80 1 -- start start 2023-07-14T13:11:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 0x5633b0ce3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0cdf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 0x5633b0ce1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f42a0192b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0ce1e50 con 0x5633b0b366b0 2023-07-14T13:11:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f42a0192b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0cdfa10 con 0x5633b0cda580 2023-07-14T13:11:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f42a0192b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0cf4870 con 0x5633b0ce02d0 2023-07-14T13:11:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f428ad9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 0x5633b0ce1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f428a59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 0x5633b0ce3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f4289d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0cdf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f428ad9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 0x5633b0ce1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38722/0 (socket says 172.21.15.17:38722) 2023-07-14T13:11:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.275+0000 7f428ad9c700 1 -- 172.21.15.17:0/1407127903 learned_addr learned my addr 172.21.15.17:0/1407127903 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.276+0000 7f428ad9c700 1 -- 172.21.15.17:0/1407127903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 msgr2=0x5633b0cdf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.276+0000 7f428ad9c700 1 --2- 172.21.15.17:0/1407127903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0cdf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.276+0000 7f428ad9c700 1 -- 172.21.15.17:0/1407127903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 msgr2=0x5633b0ce3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.276+0000 7f428ad9c700 1 --2- 172.21.15.17:0/1407127903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 0x5633b0ce3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.276+0000 7f428ad9c700 1 -- 172.21.15.17:0/1407127903 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633b0cfeb70 con 0x5633b0ce02d0 2023-07-14T13:11:42.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.276+0000 7f428ad9c700 1 --2- 172.21.15.17:0/1407127903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 0x5633b0ce1910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f427c011c70 tx=0x7f427c025000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b38c527eb4cd323 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.276+0000 7f42797fa700 1 -- 172.21.15.17:0/1407127903 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c00e040 con 0x5633b0ce02d0 2023-07-14T13:11:42.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.276+0000 7f42797fa700 1 -- 172.21.15.17:0/1407127903 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f427c0145c0 con 0x5633b0ce02d0 2023-07-14T13:11:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.276+0000 7f42797fa700 1 -- 172.21.15.17:0/1407127903 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c015b80 con 0x5633b0ce02d0 2023-07-14T13:11:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.277+0000 7f42a0192b80 1 -- 172.21.15.17:0/1407127903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 msgr2=0x5633b0ce1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.277+0000 7f42a0192b80 1 --2- 172.21.15.17:0/1407127903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 0x5633b0ce1910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f427c011c70 tx=0x7f427c025000 comp rx=0 tx=0).stop 2023-07-14T13:11:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.277+0000 7f42a0192b80 1 -- 172.21.15.17:0/1407127903 shutdown_connections 2023-07-14T13:11:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.277+0000 7f42a0192b80 1 --2- 172.21.15.17:0/1407127903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 0x5633b0ce1910 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.277+0000 7f42a0192b80 1 --2- 172.21.15.17:0/1407127903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 0x5633b0ce3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.277+0000 7f42a0192b80 1 --2- 172.21.15.17:0/1407127903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0cdf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.277+0000 7f42a0192b80 1 -- 172.21.15.17:0/1407127903 >> 172.21.15.17:0/1407127903 conn(0x5633b0ccfbe0 msgr2=0x5633b0ce1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.277+0000 7f42a0192b80 1 -- 172.21.15.17:0/1407127903 shutdown_connections 2023-07-14T13:11:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.277+0000 7f42a0192b80 1 -- 172.21.15.17:0/1407127903 wait complete. 2023-07-14T13:11:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.277+0000 7f42a0192b80 1 -- start start 2023-07-14T13:11:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f42a0192b80 1 Processor -- start 2023-07-14T13:11:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 0x5633b0ceedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0ced0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f42a0192b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 0x5633b0ced620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f42a0192b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0cef6c0 con 0x5633b0b366b0 2023-07-14T13:11:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f42a0192b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0cedb60 con 0x5633b0cda580 2023-07-14T13:11:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f42a0192b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633b0cedd20 con 0x5633b0ce02d0 2023-07-14T13:11:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f42a0192b80 10 client.0 _ll_register_callbacks cb 0x5633b0bc9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f428a59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 0x5633b0ceedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f428a59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 0x5633b0ceedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52776/0 (socket says 172.21.15.17:52776) 2023-07-14T13:11:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f428a59b700 1 -- 172.21.15.17:0/2157632277 learned_addr learned my addr 172.21.15.17:0/2157632277 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f4289d9a700 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0ced0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.278+0000 7f428ad9c700 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 0x5633b0ced620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.279+0000 7f428a59b700 1 -- 172.21.15.17:0/2157632277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 msgr2=0x5633b0ced620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.279+0000 7f428a59b700 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 0x5633b0ced620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.279+0000 7f428a59b700 1 -- 172.21.15.17:0/2157632277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 msgr2=0x5633b0ced0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:42.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.279+0000 7f428a59b700 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0ced0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.279+0000 7f428a59b700 1 -- 172.21.15.17:0/2157632277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633b0a59d80 con 0x5633b0b366b0 2023-07-14T13:11:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.279+0000 7f428a59b700 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 0x5633b0ceedf0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4280006010 tx=0x7f42800a3260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7809eb07c66d5f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.279+0000 7f426dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:11:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.279+0000 7f426dffb700 1 -- 172.21.15.17:0/2157632277 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428009aed0 con 0x5633b0b366b0 2023-07-14T13:11:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.279+0000 7f426dffb700 1 -- 172.21.15.17:0/2157632277 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f42800cbe40 con 0x5633b0b366b0 2023-07-14T13:11:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.279+0000 7f42a0192b80 1 -- 172.21.15.17:0/2157632277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f427c00f040 con 0x5633b0b366b0 2023-07-14T13:11:42.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f426dffb700 1 -- 172.21.15.17:0/2157632277 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4280097440 con 0x5633b0b366b0 2023-07-14T13:11:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f42a0192b80 10 client.17595 fetch_fsmap learned FSMap version 36 2023-07-14T13:11:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f42a0192b80 1 -- 172.21.15.17:0/2157632277 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5633b0a801f0 con 0x5633b0b366b0 2023-07-14T13:11:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f426dffb700 1 -- 172.21.15.17:0/2157632277 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f427c00f040 con 0x5633b0b366b0 2023-07-14T13:11:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f426dffb700 1 -- 172.21.15.17:0/2157632277 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 36) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f42800b92f0 con 0x5633b0b366b0 2023-07-14T13:11:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f42a0192b80 10 client.17595 fetch_fsmap finished waiting for FSMap version 36 2023-07-14T13:11:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f42a0192b80 10 client.17595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f42a0192b80 20 client.17595 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f42a0192b80 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5633b0d4c810 0x5633b0d4ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f42a0192b80 4 client.17595 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:11:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f42a0192b80 1 -- 172.21.15.17:0/2157632277 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5633b0be6ff0 con 0x5633b0d4c810 2023-07-14T13:11:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.280+0000 7f4289d9a700 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5633b0d4c810 0x5633b0d4ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.281+0000 7f4289d9a700 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5633b0d4c810 0x5633b0d4ec20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f998a10b4127b0 server_cookie=e33d9804349bb862 in_seq=0 out_seq=0 2023-07-14T13:11:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.281+0000 7f426dffb700 10 client.17595 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.295+0000 7f426dffb700 1 -- 172.21.15.17:0/2157632277 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5633b0be6ff0 con 0x5633b0d4c810 2023-07-14T13:11:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.295+0000 7f426dffb700 10 client.17595 handle_command_reply: tid=0 2023-07-14T13:11:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.295+0000 7f42a0192b80 1 client.17595 shutdown 2023-07-14T13:11:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f42a0192b80 1 -- 172.21.15.17:0/2157632277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 msgr2=0x5633b0ceedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f42a0192b80 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 0x5633b0ceedf0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4280006010 tx=0x7f42800a3260 comp rx=0 tx=0).stop 2023-07-14T13:11:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f42a0192b80 1 -- 172.21.15.17:0/2157632277 shutdown_connections 2023-07-14T13:11:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f42a0192b80 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5633b0d4c810 0x5633b0d4ec20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f42a0192b80 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633b0ce02d0 0x5633b0ced620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f42a0192b80 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5633b0b366b0 0x5633b0ceedf0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f426dffb700 0 client.17595 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f42a0192b80 1 --2- 172.21.15.17:0/2157632277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5633b0cda580 0x5633b0ced0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f42a0192b80 1 -- 172.21.15.17:0/2157632277 >> 172.21.15.17:0/2157632277 conn(0x5633b0ccfbe0 msgr2=0x5633b0cf40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f42a0192b80 1 -- 172.21.15.17:0/2157632277 shutdown_connections 2023-07-14T13:11:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f42a0192b80 1 -- 172.21.15.17:0/2157632277 wait complete. 2023-07-14T13:11:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.296+0000 7f42a0192b80 20 client.17595 trim_cache size 0 max 16384 2023-07-14T13:11:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:11:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:11:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:11:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:11:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 -- 172.21.15.17:0/110902660 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42700a1340 msgr2=0x7f42700a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42700a1340 0x7f42700a37f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f427c0094f0 tx=0x7f427c023000 comp rx=0 tx=0).stop 2023-07-14T13:11:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 -- 172.21.15.17:0/110902660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42840ffb00 msgr2=0x7f428419bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42840ffb00 0x7f428419bc20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4280005740 tx=0x7f4280005770 comp rx=0 tx=0).stop 2023-07-14T13:11:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 -- 172.21.15.17:0/110902660 shutdown_connections 2023-07-14T13:11:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42700a1340 0x7f42700a37f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4284105b10 0x7f4284195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42840ffb00 0x7f428419bc20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 --2- 172.21.15.17:0/110902660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42841004b0 0x7f428419c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 -- 172.21.15.17:0/110902660 >> 172.21.15.17:0/110902660 conn(0x7f42840fb600 msgr2=0x7f42840fbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 -- 172.21.15.17:0/110902660 shutdown_connections 2023-07-14T13:11:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:42.297+0000 7f428c7ff700 1 -- 172.21.15.17:0/110902660 wait complete. 2023-07-14T13:11:43.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:43 smithi135 ceph-mon[97338]: pgmap v374: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 66 op/s 2023-07-14T13:11:43.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:43 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:11:43.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:43 smithi131 ceph-mon[96953]: pgmap v374: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 66 op/s 2023-07-14T13:11:43.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:43 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:11:43.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:43 smithi017 ceph-mon[95536]: pgmap v374: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 66 op/s 2023-07-14T13:11:43.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:43 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:11:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:47200000 of 50000000 tuples (94%) done (elapsed 694.51 s, remaining 41.20 s) 2023-07-14T13:11:45.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:45 smithi135 ceph-mon[97338]: pgmap v375: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:11:45.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:45 smithi131 ceph-mon[96953]: pgmap v375: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:11:45.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:45 smithi017 ceph-mon[95536]: pgmap v375: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 22 MiB/s wr, 65 op/s 2023-07-14T13:11:46.300 INFO:teuthology.orchestra.run.smithi017.stderr:47300000 of 50000000 tuples (94%) done (elapsed 695.90 s, remaining 39.72 s) 2023-07-14T13:11:47.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:47 smithi135 ceph-mon[97338]: pgmap v376: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-07-14T13:11:47.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:47 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:11:47.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:47 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:11:47.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:47 smithi131 ceph-mon[96953]: pgmap v376: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-07-14T13:11:47.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:47 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:11:47.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:47 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:11:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:47400000 of 50000000 tuples (94%) done (elapsed 697.18 s, remaining 38.24 s) 2023-07-14T13:11:47.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:47 smithi017 ceph-mon[95536]: pgmap v376: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 28 MiB/s wr, 85 op/s 2023-07-14T13:11:47.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:47 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:11:47.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:47 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:11:48.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:48 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:11:48.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:48 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:11:48.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:48 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:11:49.032 INFO:teuthology.orchestra.run.smithi017.stderr:47500000 of 50000000 tuples (95%) done (elapsed 698.63 s, remaining 36.77 s) 2023-07-14T13:11:49.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:49 smithi135 ceph-mon[97338]: pgmap v377: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 18 MiB/s wr, 50 op/s 2023-07-14T13:11:49.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:49 smithi131 ceph-mon[96953]: pgmap v377: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 18 MiB/s wr, 50 op/s 2023-07-14T13:11:49.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:49 smithi017 ceph-mon[95536]: pgmap v377: 97 pgs: 97 active+clean; 9.4 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 18 MiB/s wr, 50 op/s 2023-07-14T13:11:50.361 INFO:teuthology.orchestra.run.smithi017.stderr:47600000 of 50000000 tuples (95%) done (elapsed 699.96 s, remaining 35.29 s) 2023-07-14T13:11:51.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:51 smithi131 ceph-mon[96953]: pgmap v378: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 26 MiB/s wr, 66 op/s 2023-07-14T13:11:51.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:51 smithi017 ceph-mon[95536]: pgmap v378: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 26 MiB/s wr, 66 op/s 2023-07-14T13:11:51.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:51 smithi135 ceph-mon[97338]: pgmap v378: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 26 MiB/s wr, 66 op/s 2023-07-14T13:11:51.761 INFO:teuthology.orchestra.run.smithi017.stderr:47700000 of 50000000 tuples (95%) done (elapsed 701.36 s, remaining 33.82 s) 2023-07-14T13:11:53.075 INFO:teuthology.orchestra.run.smithi017.stderr:47800000 of 50000000 tuples (95%) done (elapsed 702.67 s, remaining 32.34 s) 2023-07-14T13:11:53.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:53 smithi131 ceph-mon[96953]: pgmap v379: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 40 op/s 2023-07-14T13:11:53.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:53 smithi017 ceph-mon[95536]: pgmap v379: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 40 op/s 2023-07-14T13:11:53.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:53 smithi135 ceph-mon[97338]: pgmap v379: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 40 op/s 2023-07-14T13:11:54.401 INFO:teuthology.orchestra.run.smithi017.stderr:47900000 of 50000000 tuples (95%) done (elapsed 704.00 s, remaining 30.86 s) 2023-07-14T13:11:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.457+0000 7fd0551ff700 1 -- 172.21.15.17:0/2245306391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd050105b10 msgr2=0x7fd050105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.457+0000 7fd0551ff700 1 --2- 172.21.15.17:0/2245306391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd050105b10 0x7fd050105ee0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd040009990 tx=0x7fd040009ca0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.457+0000 7fd0551ff700 1 -- 172.21.15.17:0/2245306391 shutdown_connections 2023-07-14T13:11:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.457+0000 7fd0551ff700 1 --2- 172.21.15.17:0/2245306391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0501004b0 0x7fd05010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.457+0000 7fd0551ff700 1 --2- 172.21.15.17:0/2245306391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd050105b10 0x7fd050105ee0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.457+0000 7fd0551ff700 1 --2- 172.21.15.17:0/2245306391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0500ffb00 0x7fd0500fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.457+0000 7fd0551ff700 1 -- 172.21.15.17:0/2245306391 >> 172.21.15.17:0/2245306391 conn(0x7fd0500fb600 msgr2=0x7fd0500fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.457+0000 7fd0551ff700 1 -- 172.21.15.17:0/2245306391 shutdown_connections 2023-07-14T13:11:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.457+0000 7fd0551ff700 1 -- 172.21.15.17:0/2245306391 wait complete. 2023-07-14T13:11:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.458+0000 7fd0551ff700 1 Processor -- start 2023-07-14T13:11:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.458+0000 7fd0551ff700 1 -- start start 2023-07-14T13:11:55.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd0551ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0500ffb00 0x7fd0500729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd0551ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0501004b0 0x7fd050072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd0551ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd050105b10 0x7fd0501a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd0551ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0501a4280 con 0x7fd050105b10 2023-07-14T13:11:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd0551ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0501a43c0 con 0x7fd0500ffb00 2023-07-14T13:11:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd0551ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0501a4530 con 0x7fd0501004b0 2023-07-14T13:11:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd04ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0500ffb00 0x7fd0500729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd04e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0501004b0 0x7fd050072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd04ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0500ffb00 0x7fd0500729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39136/0 (socket says 172.21.15.17:39136) 2023-07-14T13:11:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd04ed9d700 1 -- 172.21.15.17:0/4247898247 learned_addr learned my addr 172.21.15.17:0/4247898247 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd04e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0501004b0 0x7fd050072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45486/0 (socket says 172.21.15.17:45486) 2023-07-14T13:11:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.459+0000 7fd04f59e700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd050105b10 0x7fd0501a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.460+0000 7fd04ed9d700 1 -- 172.21.15.17:0/4247898247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0501004b0 msgr2=0x7fd050072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:55.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.460+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0501004b0 0x7fd050072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.460+0000 7fd04ed9d700 1 -- 172.21.15.17:0/4247898247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd050105b10 msgr2=0x7fd0501a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:55.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.460+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd050105b10 0x7fd0501a3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.460+0000 7fd04ed9d700 1 -- 172.21.15.17:0/4247898247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0400095f0 con 0x7fd0500ffb00 2023-07-14T13:11:55.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.460+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0500ffb00 0x7fd0500729f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd040000c00 tx=0x7fd040004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:55.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.460+0000 7fd037fff700 1 -- 172.21.15.17:0/4247898247 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04001d070 con 0x7fd0500ffb00 2023-07-14T13:11:55.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.460+0000 7fd0551ff700 1 -- 172.21.15.17:0/4247898247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0501a47b0 con 0x7fd0500ffb00 2023-07-14T13:11:55.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.460+0000 7fd037fff700 1 -- 172.21.15.17:0/4247898247 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd040022470 con 0x7fd0500ffb00 2023-07-14T13:11:55.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.460+0000 7fd037fff700 1 -- 172.21.15.17:0/4247898247 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040017650 con 0x7fd0500ffb00 2023-07-14T13:11:55.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.460+0000 7fd0551ff700 1 -- 172.21.15.17:0/4247898247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0501a4c30 con 0x7fd0500ffb00 2023-07-14T13:11:55.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:55 smithi131 ceph-mon[96953]: pgmap v380: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 17 MiB/s wr, 36 op/s 2023-07-14T13:11:55.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.465+0000 7fd037fff700 1 -- 172.21.15.17:0/4247898247 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd0400225e0 con 0x7fd0500ffb00 2023-07-14T13:11:55.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.467+0000 7fd068c21b80 1 Processor -- start 2023-07-14T13:11:55.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.467+0000 7fd037fff700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0380a1340 0x7fd0380a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.468+0000 7fd037fff700 1 -- 172.21.15.17:0/4247898247 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd0400ce020 con 0x7fd0500ffb00 2023-07-14T13:11:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.468+0000 7fd04f59e700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0380a1340 0x7fd0380a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.468+0000 7fd068c21b80 1 -- start start 2023-07-14T13:11:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.468+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 0x55a709ae8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.468+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 0x55a709ae3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.468+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae3580 0x55a709ae39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.469+0000 7fd068c21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7099e8c50 con 0x55a709ae3580 2023-07-14T13:11:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.469+0000 7fd068c21b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a709a3b9e0 con 0x55a709ae92d0 2023-07-14T13:11:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.469+0000 7fd068c21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a709a34e70 con 0x55a70993f6b0 2023-07-14T13:11:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.469+0000 7fd04ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 0x55a709ae8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.469+0000 7fd04e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 0x55a709ae3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.469+0000 7fd04ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 0x55a709ae8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45488/0 (socket says 172.21.15.17:45488) 2023-07-14T13:11:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.469+0000 7fd04ed9d700 1 -- 172.21.15.17:0/749109699 learned_addr learned my addr 172.21.15.17:0/749109699 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.469+0000 7fd04f59e700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0380a1340 0x7fd0380a37f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd04800f540 tx=0x7fd04800b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.470+0000 7fd04f59e700 1 --2- 172.21.15.17:0/749109699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae3580 0x55a709ae39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.470+0000 7fd04ed9d700 1 -- 172.21.15.17:0/749109699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 msgr2=0x55a709ae3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.470+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/749109699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 0x55a709ae3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.470+0000 7fd04ed9d700 1 -- 172.21.15.17:0/749109699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae3580 msgr2=0x55a709ae39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.470+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/749109699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae3580 0x55a709ae39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.470+0000 7fd04ed9d700 1 -- 172.21.15.17:0/749109699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a709862d80 con 0x55a70993f6b0 2023-07-14T13:11:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.470+0000 7fd04f59e700 1 --2- 172.21.15.17:0/749109699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae3580 0x55a709ae39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:11:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.470+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/749109699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 0x55a709ae8d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd040009350 tx=0x7fd040097600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35f14b8411651ac9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.470+0000 7fd0357fa700 1 -- 172.21.15.17:0/749109699 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04009ab00 con 0x55a70993f6b0 2023-07-14T13:11:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.470+0000 7fd0357fa700 1 -- 172.21.15.17:0/749109699 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0400228c0 con 0x55a70993f6b0 2023-07-14T13:11:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.470+0000 7fd0357fa700 1 -- 172.21.15.17:0/749109699 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04009a690 con 0x55a70993f6b0 2023-07-14T13:11:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.471+0000 7fd068c21b80 1 -- 172.21.15.17:0/749109699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 msgr2=0x55a709ae8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.471+0000 7fd068c21b80 1 --2- 172.21.15.17:0/749109699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 0x55a709ae8d90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd040009350 tx=0x7fd040097600 comp rx=0 tx=0).stop 2023-07-14T13:11:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.471+0000 7fd068c21b80 1 -- 172.21.15.17:0/749109699 shutdown_connections 2023-07-14T13:11:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.471+0000 7fd068c21b80 1 --2- 172.21.15.17:0/749109699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae3580 0x55a709ae39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.472+0000 7fd068c21b80 1 --2- 172.21.15.17:0/749109699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 0x55a709ae8d90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.472+0000 7fd068c21b80 1 --2- 172.21.15.17:0/749109699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 0x55a709ae3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.472+0000 7fd068c21b80 1 -- 172.21.15.17:0/749109699 >> 172.21.15.17:0/749109699 conn(0x55a709ad8be0 msgr2=0x55a709addf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.472+0000 7fd068c21b80 1 -- 172.21.15.17:0/749109699 shutdown_connections 2023-07-14T13:11:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.472+0000 7fd068c21b80 1 -- 172.21.15.17:0/749109699 wait complete. 2023-07-14T13:11:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.472+0000 7fd068c21b80 1 -- start start 2023-07-14T13:11:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.473+0000 7fd068c21b80 1 Processor -- start 2023-07-14T13:11:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.473+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 0x55a709afabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.473+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 0x55a709afb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.473+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae92d0 0x55a709af4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.473+0000 7fd068c21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7099d4a60 con 0x55a709ae92d0 2023-07-14T13:11:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.473+0000 7fd068c21b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7099d4760 con 0x55a70993f6b0 2023-07-14T13:11:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.473+0000 7fd068c21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7098b88c0 con 0x55a709ae3580 2023-07-14T13:11:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.473+0000 7fd068c21b80 10 client.0 _ll_register_callbacks cb 0x55a7099d2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 0x55a709afabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 0x55a709afb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 0x55a709afabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39166/0 (socket says 172.21.15.17:39166) 2023-07-14T13:11:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04ed9d700 1 -- 172.21.15.17:0/4115150202 learned_addr learned my addr 172.21.15.17:0/4115150202 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04f59e700 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae92d0 0x55a709af4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04e59c700 1 -- 172.21.15.17:0/4115150202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 msgr2=0x55a709afabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04e59c700 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 0x55a709afabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04e59c700 1 -- 172.21.15.17:0/4115150202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae92d0 msgr2=0x55a709af4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04e59c700 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae92d0 0x55a709af4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04e59c700 1 -- 172.21.15.17:0/4115150202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0501a4c30 con 0x55a709ae3580 2023-07-14T13:11:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 0x55a709afabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd04e59c700 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 0x55a709afb0f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd050074210 tx=0x7fd044012a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=179925a4b088aa8e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.474+0000 7fd032ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:11:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.475+0000 7fd032ff5700 1 -- 172.21.15.17:0/4115150202 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044017070 con 0x55a709ae3580 2023-07-14T13:11:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.475+0000 7fd068c21b80 1 -- 172.21.15.17:0/4115150202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a70998e490 con 0x55a709ae3580 2023-07-14T13:11:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.475+0000 7fd032ff5700 1 -- 172.21.15.17:0/4115150202 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd04400f480 con 0x55a709ae3580 2023-07-14T13:11:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.475+0000 7fd032ff5700 1 -- 172.21.15.17:0/4115150202 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd04400f640 con 0x55a709ae3580 2023-07-14T13:11:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.475+0000 7fd068c21b80 10 client.27298 fetch_fsmap learned FSMap version 37 2023-07-14T13:11:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.475+0000 7fd068c21b80 1 -- 172.21.15.17:0/4115150202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a70984bc00 con 0x55a709ae3580 2023-07-14T13:11:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.475+0000 7fd032ff5700 1 -- 172.21.15.17:0/4115150202 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a70998e490 con 0x55a709ae3580 2023-07-14T13:11:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.475+0000 7fd032ff5700 1 -- 172.21.15.17:0/4115150202 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd044010730 con 0x55a709ae3580 2023-07-14T13:11:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.476+0000 7fd068c21b80 10 client.27298 fetch_fsmap finished waiting for FSMap version 37 2023-07-14T13:11:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.476+0000 7fd068c21b80 10 client.27298 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.476+0000 7fd068c21b80 20 client.27298 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.476+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a709b050c0 0x55a709b074d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.476+0000 7fd068c21b80 4 client.27298 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:11:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.476+0000 7fd068c21b80 1 -- 172.21.15.17:0/4115150202 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a709a2de50 con 0x55a709b050c0 2023-07-14T13:11:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.476+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a709b050c0 0x55a709b074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.477+0000 7fd032ff5700 10 client.27298 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.477+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a709b050c0 0x55a709b074d0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bbfedee7c3c9307 server_cookie=ebdb08fa42ec4a54 in_seq=0 out_seq=0 2023-07-14T13:11:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd032ff5700 1 -- 172.21.15.17:0/4115150202 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a709a2de50 con 0x55a709b050c0 2023-07-14T13:11:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd032ff5700 10 client.27298 handle_command_reply: tid=0 2023-07-14T13:11:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 1 client.27298 shutdown 2023-07-14T13:11:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 1 -- 172.21.15.17:0/4115150202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 msgr2=0x55a709afb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 0x55a709afb0f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd050074210 tx=0x7fd044012a20 comp rx=0 tx=0).stop 2023-07-14T13:11:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 1 -- 172.21.15.17:0/4115150202 shutdown_connections 2023-07-14T13:11:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a709b050c0 0x55a709b074d0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae92d0 0x55a709af4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 0x55a709afabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd032ff5700 0 client.27298 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:55.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4115150202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 0x55a709afb0f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 1 -- 172.21.15.17:0/4115150202 >> 172.21.15.17:0/4115150202 conn(0x55a709ad8be0 msgr2=0x55a709add4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:55.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 1 -- 172.21.15.17:0/4115150202 shutdown_connections 2023-07-14T13:11:55.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 1 -- 172.21.15.17:0/4115150202 wait complete. 2023-07-14T13:11:55.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.478+0000 7fd068c21b80 20 client.27298 trim_cache size 0 max 16384 2023-07-14T13:11:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.496+0000 7fd068c21b80 1 Processor -- start 2023-07-14T13:11:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.496+0000 7fd068c21b80 1 -- start start 2023-07-14T13:11:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.496+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 0x55a709ae3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.496+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 0x55a709af29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.496+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae92d0 0x55a709ae80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.496+0000 7fd068c21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a709aded50 con 0x55a709ae92d0 2023-07-14T13:11:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.496+0000 7fd068c21b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a709ad5be0 con 0x55a70993f6b0 2023-07-14T13:11:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.496+0000 7fd068c21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a709adf740 con 0x55a709ae3580 2023-07-14T13:11:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04f59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae92d0 0x55a709ae80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 0x55a709af29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 0x55a709ae3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 0x55a709af29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45518/0 (socket says 172.21.15.17:45518) 2023-07-14T13:11:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04e59c700 1 -- 172.21.15.17:0/4136696609 learned_addr learned my addr 172.21.15.17:0/4136696609 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04f59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae92d0 0x55a709ae80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46020/0 (socket says 172.21.15.17:46020) 2023-07-14T13:11:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04e59c700 1 -- 172.21.15.17:0/4136696609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 msgr2=0x55a709ae3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04e59c700 1 --2- 172.21.15.17:0/4136696609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 0x55a709ae3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04e59c700 1 -- 172.21.15.17:0/4136696609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae92d0 msgr2=0x55a709ae80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04e59c700 1 --2- 172.21.15.17:0/4136696609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae92d0 0x55a709ae80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04e59c700 1 -- 172.21.15.17:0/4136696609 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7098891f0 con 0x55a709ae3580 2023-07-14T13:11:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/4136696609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 0x55a709ae3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.497+0000 7fd04e59c700 1 --2- 172.21.15.17:0/4136696609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 0x55a709af29a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0440095f0 tx=0x7fd044009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e03b86c3c72eb727 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.498+0000 7fd035ffb700 1 -- 172.21.15.17:0/4136696609 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044017070 con 0x55a709ae3580 2023-07-14T13:11:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.498+0000 7fd035ffb700 1 -- 172.21.15.17:0/4136696609 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd044018040 con 0x55a709ae3580 2023-07-14T13:11:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.498+0000 7fd035ffb700 1 -- 172.21.15.17:0/4136696609 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044004930 con 0x55a709ae3580 2023-07-14T13:11:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.498+0000 7fd068c21b80 1 -- 172.21.15.17:0/4136696609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 msgr2=0x55a709af29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.498+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4136696609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 0x55a709af29a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0440095f0 tx=0x7fd044009750 comp rx=0 tx=0).stop 2023-07-14T13:11:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.499+0000 7fd068c21b80 1 -- 172.21.15.17:0/4136696609 shutdown_connections 2023-07-14T13:11:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.499+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4136696609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae92d0 0x55a709ae80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.499+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4136696609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70993f6b0 0x55a709ae3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.499+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4136696609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a709ae3580 0x55a709af29a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.499+0000 7fd068c21b80 1 -- 172.21.15.17:0/4136696609 >> 172.21.15.17:0/4136696609 conn(0x55a709ad8be0 msgr2=0x55a709ae79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.499+0000 7fd068c21b80 1 -- 172.21.15.17:0/4136696609 shutdown_connections 2023-07-14T13:11:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.499+0000 7fd068c21b80 1 -- 172.21.15.17:0/4136696609 wait complete. 2023-07-14T13:11:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.499+0000 7fd068c21b80 1 -- start start 2023-07-14T13:11:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.500+0000 7fd068c21b80 1 Processor -- start 2023-07-14T13:11:55.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.500+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 0x55a709af8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.500+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae3580 0x55a709af9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.500+0000 7fd068c21b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 0x55a709b57f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.500+0000 7fd068c21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a709af99b0 con 0x55a709ae3580 2023-07-14T13:11:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.500+0000 7fd068c21b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a709b584c0 con 0x55a709ae92d0 2023-07-14T13:11:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.500+0000 7fd068c21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a709b58650 con 0x55a70993f6b0 2023-07-14T13:11:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.500+0000 7fd068c21b80 10 client.0 _ll_register_callbacks cb 0x7fd044009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:11:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.500+0000 7fd04e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae3580 0x55a709af9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd04ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 0x55a709af8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd04f59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 0x55a709b57f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd04f59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 0x55a709b57f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39184/0 (socket says 172.21.15.17:39184) 2023-07-14T13:11:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd04f59e700 1 -- 172.21.15.17:0/4286402070 learned_addr learned my addr 172.21.15.17:0/4286402070 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:11:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd04ed9d700 1 -- 172.21.15.17:0/4286402070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 msgr2=0x55a709b57f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 0x55a709b57f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd04ed9d700 1 -- 172.21.15.17:0/4286402070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae3580 msgr2=0x55a709af9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:11:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae3580 0x55a709af9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd04ed9d700 1 -- 172.21.15.17:0/4286402070 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a709862d80 con 0x55a70993f6b0 2023-07-14T13:11:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd04f59e700 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 0x55a709b57f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:11:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd04ed9d700 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 0x55a709af8d40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd040022a50 tx=0x7fd040005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d03a7f7b202830a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:11:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.501+0000 7fd032ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:11:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd032ff5700 1 -- 172.21.15.17:0/4286402070 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04009b600 con 0x55a70993f6b0 2023-07-14T13:11:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd032ff5700 1 -- 172.21.15.17:0/4286402070 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd04009f1d0 con 0x55a70993f6b0 2023-07-14T13:11:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd068c21b80 1 -- 172.21.15.17:0/4286402070 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0400228c0 con 0x55a70993f6b0 2023-07-14T13:11:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd032ff5700 1 -- 172.21.15.17:0/4286402070 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0400a3560 con 0x55a70993f6b0 2023-07-14T13:11:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd068c21b80 10 client.27304 fetch_fsmap learned FSMap version 37 2023-07-14T13:11:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd068c21b80 1 -- 172.21.15.17:0/4286402070 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55a70984bc00 con 0x55a70993f6b0 2023-07-14T13:11:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd032ff5700 1 -- 172.21.15.17:0/4286402070 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0400228c0 con 0x55a70993f6b0 2023-07-14T13:11:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd032ff5700 1 -- 172.21.15.17:0/4286402070 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd0400a30d0 con 0x55a70993f6b0 2023-07-14T13:11:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd068c21b80 10 client.27304 fetch_fsmap finished waiting for FSMap version 37 2023-07-14T13:11:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd068c21b80 10 client.27304 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:11:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd068c21b80 20 client.27304 populate_metadata read hostname 'smithi017' 2023-07-14T13:11:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a709b59a20 0x55a709b5be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:11:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd068c21b80 4 client.27304 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:11:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.502+0000 7fd068c21b80 1 -- 172.21.15.17:0/4286402070 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a7099efff0 con 0x55a709b59a20 2023-07-14T13:11:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.503+0000 7fd04e59c700 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a709b59a20 0x55a709b5be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:11:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.503+0000 7fd04e59c700 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a709b59a20 0x55a709b5be30 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75177e8ede8f82b0 server_cookie=79182f926159064 in_seq=0 out_seq=0 2023-07-14T13:11:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.503+0000 7fd032ff5700 10 client.27304 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:55.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd032ff5700 1 -- 172.21.15.17:0/4286402070 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a7099efff0 con 0x55a709b59a20 2023-07-14T13:11:55.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd032ff5700 10 client.27304 handle_command_reply: tid=0 2023-07-14T13:11:55.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd068c21b80 1 client.27304 shutdown 2023-07-14T13:11:55.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd068c21b80 1 -- 172.21.15.17:0/4286402070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 msgr2=0x55a709af8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:55.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 0x55a709af8d40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd040022a50 tx=0x7fd040005fd0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd068c21b80 1 -- 172.21.15.17:0/4286402070 shutdown_connections 2023-07-14T13:11:55.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a709b59a20 0x55a709b5be30 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a709ae92d0 0x55a709b57f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70993f6b0 0x55a709af8d40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd068c21b80 1 --2- 172.21.15.17:0/4286402070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a709ae3580 0x55a709af9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd032ff5700 0 client.27304 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:11:55.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd068c21b80 1 -- 172.21.15.17:0/4286402070 >> 172.21.15.17:0/4286402070 conn(0x55a709ad8be0 msgr2=0x55a709af2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:55.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd068c21b80 1 -- 172.21.15.17:0/4286402070 shutdown_connections 2023-07-14T13:11:55.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.517+0000 7fd068c21b80 1 -- 172.21.15.17:0/4286402070 wait complete. 2023-07-14T13:11:55.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd068c21b80 20 client.27304 trim_cache size 0 max 16384 2023-07-14T13:11:55.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:11:55.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:11:55.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:11:55.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:11:55.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 -- 172.21.15.17:0/4247898247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0380a1340 msgr2=0x7fd0380a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0380a1340 0x7fd0380a37f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd04800f540 tx=0x7fd04800b040 comp rx=0 tx=0).stop 2023-07-14T13:11:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 -- 172.21.15.17:0/4247898247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0500ffb00 msgr2=0x7fd0500729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:11:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0500ffb00 0x7fd0500729f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd040000c00 tx=0x7fd040004730 comp rx=0 tx=0).stop 2023-07-14T13:11:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 -- 172.21.15.17:0/4247898247 shutdown_connections 2023-07-14T13:11:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd0380a1340 0x7fd0380a37f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd050105b10 0x7fd0501a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0500ffb00 0x7fd0500729f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 --2- 172.21.15.17:0/4247898247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0501004b0 0x7fd050072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:11:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 -- 172.21.15.17:0/4247898247 >> 172.21.15.17:0/4247898247 conn(0x7fd0500fb600 msgr2=0x7fd0500fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:11:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 -- 172.21.15.17:0/4247898247 shutdown_connections 2023-07-14T13:11:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:11:55.518+0000 7fd0551ff700 1 -- 172.21.15.17:0/4247898247 wait complete. 2023-07-14T13:11:55.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:55 smithi017 ceph-mon[95536]: pgmap v380: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 17 MiB/s wr, 36 op/s 2023-07-14T13:11:55.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:55 smithi135 ceph-mon[97338]: pgmap v380: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 17 MiB/s wr, 36 op/s 2023-07-14T13:11:55.832 INFO:teuthology.orchestra.run.smithi017.stderr:48000000 of 50000000 tuples (96%) done (elapsed 705.43 s, remaining 29.39 s) 2023-07-14T13:11:57.143 INFO:teuthology.orchestra.run.smithi017.stderr:48100000 of 50000000 tuples (96%) done (elapsed 706.74 s, remaining 27.92 s) 2023-07-14T13:11:57.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:57 smithi131 ceph-mon[96953]: pgmap v381: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 28 MiB/s wr, 59 op/s 2023-07-14T13:11:57.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:57 smithi017 ceph-mon[95536]: pgmap v381: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 28 MiB/s wr, 59 op/s 2023-07-14T13:11:57.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:57 smithi135 ceph-mon[97338]: pgmap v381: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 28 MiB/s wr, 59 op/s 2023-07-14T13:11:58.467 INFO:teuthology.orchestra.run.smithi017.stderr:48200000 of 50000000 tuples (96%) done (elapsed 708.07 s, remaining 26.44 s) 2023-07-14T13:11:59.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:11:59 smithi131 ceph-mon[96953]: pgmap v382: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 MiB/s wr, 39 op/s 2023-07-14T13:11:59.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:11:59 smithi017 ceph-mon[95536]: pgmap v382: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 MiB/s wr, 39 op/s 2023-07-14T13:11:59.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:11:59 smithi135 ceph-mon[97338]: pgmap v382: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 MiB/s wr, 39 op/s 2023-07-14T13:11:59.769 INFO:teuthology.orchestra.run.smithi017.stderr:48300000 of 50000000 tuples (96%) done (elapsed 709.37 s, remaining 24.97 s) 2023-07-14T13:12:01.172 INFO:teuthology.orchestra.run.smithi017.stderr:48400000 of 50000000 tuples (96%) done (elapsed 710.77 s, remaining 23.50 s) 2023-07-14T13:12:01.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:01 smithi131 ceph-mon[96953]: pgmap v383: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 31 MiB/s wr, 66 op/s 2023-07-14T13:12:01.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:01 smithi017 ceph-mon[95536]: pgmap v383: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 31 MiB/s wr, 66 op/s 2023-07-14T13:12:01.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:01 smithi135 ceph-mon[97338]: pgmap v383: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 31 MiB/s wr, 66 op/s 2023-07-14T13:12:02.494 INFO:teuthology.orchestra.run.smithi017.stderr:48500000 of 50000000 tuples (97%) done (elapsed 712.09 s, remaining 22.02 s) 2023-07-14T13:12:03.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:12:03.503 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:03 smithi131 ceph-mon[96953]: pgmap v384: 97 pgs: 97 active+clean; 9.7 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 54 op/s 2023-07-14T13:12:03.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.484+0000 7fedb4dff700 1 -- 172.21.15.17:0/2834147515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb0100ca0 msgr2=0x7fedb0101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.484+0000 7fedb4dff700 1 --2- 172.21.15.17:0/2834147515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb0100ca0 0x7fedb0101070 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feda0009990 tx=0x7feda0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.484+0000 7fedb4dff700 1 -- 172.21.15.17:0/2834147515 shutdown_connections 2023-07-14T13:12:03.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.484+0000 7fedb4dff700 1 --2- 172.21.15.17:0/2834147515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb010a070 0x7fedb010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.484+0000 7fedb4dff700 1 --2- 172.21.15.17:0/2834147515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb0100ca0 0x7fedb0101070 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.484+0000 7fedb4dff700 1 --2- 172.21.15.17:0/2834147515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb01015b0 0x7fedb0109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.484+0000 7fedb4dff700 1 -- 172.21.15.17:0/2834147515 >> 172.21.15.17:0/2834147515 conn(0x7fedb00fa4b0 msgr2=0x7fedb00fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:03.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.484+0000 7fedb4dff700 1 -- 172.21.15.17:0/2834147515 shutdown_connections 2023-07-14T13:12:03.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.484+0000 7fedb4dff700 1 -- 172.21.15.17:0/2834147515 wait complete. 2023-07-14T13:12:03.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.485+0000 7fedb4dff700 1 Processor -- start 2023-07-14T13:12:03.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.486+0000 7fedb4dff700 1 -- start start 2023-07-14T13:12:03.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.486+0000 7fedb4dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb0100ca0 0x7fedb00fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.486+0000 7fedb4dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb01015b0 0x7fedb00fee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.486+0000 7fedb4dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb010a070 0x7fedb01a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.486+0000 7fedb4dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb00ff660 con 0x7fedb010a070 2023-07-14T13:12:03.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.486+0000 7fedb4dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb01a4240 con 0x7fedb0100ca0 2023-07-14T13:12:03.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.486+0000 7fedb4dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb01a4380 con 0x7fedb01015b0 2023-07-14T13:12:03.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.487+0000 7fedadd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb01015b0 0x7fedb00fee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.487+0000 7fedadd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb01015b0 0x7fedb00fee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45544/0 (socket says 172.21.15.17:45544) 2023-07-14T13:12:03.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.487+0000 7fedadd9b700 1 -- 172.21.15.17:0/2978157642 learned_addr learned my addr 172.21.15.17:0/2978157642 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:03.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.487+0000 7fedae59c700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb0100ca0 0x7fedb00fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.487+0000 7fedaed9d700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb010a070 0x7fedb01a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.487+0000 7fedadd9b700 1 -- 172.21.15.17:0/2978157642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb0100ca0 msgr2=0x7fedb00fe8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.487+0000 7fedadd9b700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb0100ca0 0x7fedb00fe8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.487+0000 7fedadd9b700 1 -- 172.21.15.17:0/2978157642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb010a070 msgr2=0x7fedb01a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.487+0000 7fedadd9b700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb010a070 0x7fedb01a3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.487+0000 7fedadd9b700 1 -- 172.21.15.17:0/2978157642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda00095f0 con 0x7fedb01015b0 2023-07-14T13:12:03.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.487+0000 7fedadd9b700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb01015b0 0x7fedb00fee30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7feda400e9a0 tx=0x7feda400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:03.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.488+0000 7fed9f7fe700 1 -- 172.21.15.17:0/2978157642 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4009790 con 0x7fedb01015b0 2023-07-14T13:12:03.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.488+0000 7fedb4dff700 1 -- 172.21.15.17:0/2978157642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb01a45e0 con 0x7fedb01015b0 2023-07-14T13:12:03.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.488+0000 7fed9f7fe700 1 -- 172.21.15.17:0/2978157642 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feda400cbd0 con 0x7fedb01015b0 2023-07-14T13:12:03.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.488+0000 7fed9f7fe700 1 -- 172.21.15.17:0/2978157642 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4018680 con 0x7fedb01015b0 2023-07-14T13:12:03.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.488+0000 7fedb4dff700 1 -- 172.21.15.17:0/2978157642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb01a4b10 con 0x7fedb01015b0 2023-07-14T13:12:03.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.493+0000 7fed9f7fe700 1 -- 172.21.15.17:0/2978157642 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7feda400cd40 con 0x7fedb01015b0 2023-07-14T13:12:03.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.493+0000 7fedc869fb80 1 Processor -- start 2023-07-14T13:12:03.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.493+0000 7fedc869fb80 1 -- start start 2023-07-14T13:12:03.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.494+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d0086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.494+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d008be0 0x564d8d013590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.494+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d013ad0 0x564d8d015eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.494+0000 7fedc869fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8cf0ecb0 con 0x564d8d013ad0 2023-07-14T13:12:03.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.494+0000 7fedc869fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8cf61a40 con 0x564d8d0082d0 2023-07-14T13:12:03.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.494+0000 7fedc869fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8cf5aed0 con 0x564d8d008be0 2023-07-14T13:12:03.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.494+0000 7fedaed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d0086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.494+0000 7fedaed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d0086a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39210/0 (socket says 172.21.15.17:39210) 2023-07-14T13:12:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.494+0000 7fedaed9d700 1 -- 172.21.15.17:0/243836008 learned_addr learned my addr 172.21.15.17:0/243836008 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.495+0000 7fedae59c700 1 --2- 172.21.15.17:0/243836008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d008be0 0x564d8d013590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.495+0000 7fedadd9b700 1 --2- 172.21.15.17:0/243836008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d013ad0 0x564d8d015eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.495+0000 7fed9f7fe700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed980a12c0 0x7fed980a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.496+0000 7fedaed9d700 1 -- 172.21.15.17:0/243836008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d008be0 msgr2=0x564d8d013590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:03.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.496+0000 7fedaed9d700 1 --2- 172.21.15.17:0/243836008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d008be0 0x564d8d013590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.496+0000 7fedaed9d700 1 -- 172.21.15.17:0/243836008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d013ad0 msgr2=0x564d8d015eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:03.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.496+0000 7fed9f7fe700 1 -- 172.21.15.17:0/2978157642 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feda4014070 con 0x7fedb01015b0 2023-07-14T13:12:03.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.496+0000 7fedaed9d700 1 --2- 172.21.15.17:0/243836008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d013ad0 0x564d8d015eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.496+0000 7fedaed9d700 1 -- 172.21.15.17:0/243836008 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d8cd88de0 con 0x564d8d0082d0 2023-07-14T13:12:03.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.496+0000 7fedaed9d700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed980a12c0 0x7fed980a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.496+0000 7fedae59c700 1 --2- 172.21.15.17:0/243836008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d008be0 0x564d8d013590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:03.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.496+0000 7fedaed9d700 1 --2- 172.21.15.17:0/243836008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d0086a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feda80094b0 tx=0x7feda80077e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b942beaab4df69a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.497+0000 7fedaed9d700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed980a12c0 0x7fed980a3770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feda8018000 tx=0x7feda801a000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.497+0000 7fed9cff9700 1 -- 172.21.15.17:0/243836008 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda800e070 con 0x564d8d0082d0 2023-07-14T13:12:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.497+0000 7fed9cff9700 1 -- 172.21.15.17:0/243836008 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feda800f040 con 0x564d8d0082d0 2023-07-14T13:12:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.497+0000 7fed9cff9700 1 -- 172.21.15.17:0/243836008 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8016630 con 0x564d8d0082d0 2023-07-14T13:12:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.498+0000 7fedc869fb80 1 -- 172.21.15.17:0/243836008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 msgr2=0x564d8d0086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.498+0000 7fedc869fb80 1 --2- 172.21.15.17:0/243836008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d0086a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feda80094b0 tx=0x7feda80077e0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.498+0000 7fedc869fb80 1 -- 172.21.15.17:0/243836008 shutdown_connections 2023-07-14T13:12:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.498+0000 7fedc869fb80 1 --2- 172.21.15.17:0/243836008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d013ad0 0x564d8d015eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.498+0000 7fedc869fb80 1 --2- 172.21.15.17:0/243836008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d0086a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.498+0000 7fedc869fb80 1 --2- 172.21.15.17:0/243836008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d008be0 0x564d8d013590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.498+0000 7fedc869fb80 1 -- 172.21.15.17:0/243836008 >> 172.21.15.17:0/243836008 conn(0x564d8cffeda0 msgr2=0x564d8d0046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:03.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.498+0000 7fedc869fb80 1 -- 172.21.15.17:0/243836008 shutdown_connections 2023-07-14T13:12:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.498+0000 7fedc869fb80 1 -- 172.21.15.17:0/243836008 wait complete. 2023-07-14T13:12:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.499+0000 7fedc869fb80 1 -- start start 2023-07-14T13:12:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.499+0000 7fedc869fb80 1 Processor -- start 2023-07-14T13:12:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d010840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d010d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d013ad0 0x564d8d0112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedc869fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8cefaac0 con 0x564d8d008be0 2023-07-14T13:12:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedc869fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8cefa7c0 con 0x564d8d0082d0 2023-07-14T13:12:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedc869fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8cdde920 con 0x564d8d013ad0 2023-07-14T13:12:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedc869fb80 10 client.0 _ll_register_callbacks cb 0x564d8cef8760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedae59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d010840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedadd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d010d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedae59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d010840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39216/0 (socket says 172.21.15.17:39216) 2023-07-14T13:12:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedae59c700 1 -- 172.21.15.17:0/1309028925 learned_addr learned my addr 172.21.15.17:0/1309028925 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:03.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.500+0000 7fedaed9d700 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d013ad0 0x564d8d0112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.501+0000 7fedae59c700 1 -- 172.21.15.17:0/1309028925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d013ad0 msgr2=0x564d8d0112c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:03.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.501+0000 7fedae59c700 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d013ad0 0x564d8d0112c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.501+0000 7fedae59c700 1 -- 172.21.15.17:0/1309028925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 msgr2=0x564d8d010d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:03.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.501+0000 7fedae59c700 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d010d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.501+0000 7fedae59c700 1 -- 172.21.15.17:0/1309028925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb010d170 con 0x564d8d0082d0 2023-07-14T13:12:03.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.501+0000 7fedae59c700 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d010840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feda0009990 tx=0x7feda0005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=575e6c9092dab37c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.501+0000 7fed95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:12:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.502+0000 7fed95ffb700 1 -- 172.21.15.17:0/1309028925 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda001d030 con 0x564d8d0082d0 2023-07-14T13:12:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.502+0000 7fedc869fb80 1 -- 172.21.15.17:0/1309028925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d8ceb44f0 con 0x564d8d0082d0 2023-07-14T13:12:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.502+0000 7fed95ffb700 1 -- 172.21.15.17:0/1309028925 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feda0004500 con 0x564d8d0082d0 2023-07-14T13:12:03.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.502+0000 7fed95ffb700 1 -- 172.21.15.17:0/1309028925 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feda00046c0 con 0x564d8d0082d0 2023-07-14T13:12:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.502+0000 7fedc869fb80 10 client.27350 fetch_fsmap learned FSMap version 37 2023-07-14T13:12:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.502+0000 7fedc869fb80 1 -- 172.21.15.17:0/1309028925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7feda80090e0 con 0x564d8d0082d0 2023-07-14T13:12:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.502+0000 7fed95ffb700 1 -- 172.21.15.17:0/1309028925 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564d8ceb44f0 con 0x564d8d0082d0 2023-07-14T13:12:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.502+0000 7fed95ffb700 1 -- 172.21.15.17:0/1309028925 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7feda000f7d0 con 0x564d8d0082d0 2023-07-14T13:12:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.503+0000 7fedc869fb80 10 client.27350 fetch_fsmap finished waiting for FSMap version 37 2023-07-14T13:12:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.503+0000 7fedc869fb80 10 client.27350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.503+0000 7fedc869fb80 20 client.27350 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.503+0000 7fedc869fb80 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564d8d023510 0x564d8d025920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.503+0000 7fedc869fb80 4 client.27350 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:12:03.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.503+0000 7fedc869fb80 1 -- 172.21.15.17:0/1309028925 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d8cf53eb0 con 0x564d8d023510 2023-07-14T13:12:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.504+0000 7fedadd9b700 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564d8d023510 0x564d8d025920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.504+0000 7fedadd9b700 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564d8d023510 0x564d8d025920 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e6a1cd7b770564b server_cookie=e46a25f3581e0dac in_seq=0 out_seq=0 2023-07-14T13:12:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.504+0000 7fed95ffb700 10 client.27350 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.505+0000 7fed95ffb700 1 -- 172.21.15.17:0/1309028925 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564d8cf53eb0 con 0x564d8d023510 2023-07-14T13:12:03.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.505+0000 7fed95ffb700 10 client.27350 handle_command_reply: tid=0 2023-07-14T13:12:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.505+0000 7fedc869fb80 1 client.27350 shutdown 2023-07-14T13:12:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.505+0000 7fedc869fb80 1 -- 172.21.15.17:0/1309028925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 msgr2=0x564d8d010840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.505+0000 7fedc869fb80 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d010840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feda0009990 tx=0x7feda0005800 comp rx=0 tx=0).stop 2023-07-14T13:12:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.506+0000 7fedc869fb80 1 -- 172.21.15.17:0/1309028925 shutdown_connections 2023-07-14T13:12:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.506+0000 7fedc869fb80 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564d8d023510 0x564d8d025920 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.506+0000 7fedc869fb80 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d013ad0 0x564d8d0112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.506+0000 7fedc869fb80 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d010840 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.506+0000 7fedc869fb80 1 --2- 172.21.15.17:0/1309028925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d010d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.506+0000 7fed95ffb700 0 client.27350 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.506+0000 7fedc869fb80 1 -- 172.21.15.17:0/1309028925 >> 172.21.15.17:0/1309028925 conn(0x564d8cffeda0 msgr2=0x564d8d004290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.506+0000 7fedc869fb80 1 -- 172.21.15.17:0/1309028925 shutdown_connections 2023-07-14T13:12:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.506+0000 7fedc869fb80 1 -- 172.21.15.17:0/1309028925 wait complete. 2023-07-14T13:12:03.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.507+0000 7fedc869fb80 20 client.27350 trim_cache size 0 max 16384 2023-07-14T13:12:03.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.525+0000 7fedc869fb80 1 Processor -- start 2023-07-14T13:12:03.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.525+0000 7fedc869fb80 1 -- start start 2023-07-14T13:12:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.525+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d0082d0 0x564d8d01a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.525+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d011000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d013ad0 0x564d8d011540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedc869fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8ceb4520 con 0x564d8d008be0 2023-07-14T13:12:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedc869fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8d005570 con 0x564d8d013ad0 2023-07-14T13:12:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedc869fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8d011df0 con 0x564d8d0082d0 2023-07-14T13:12:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedae59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d0082d0 0x564d8d01a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedadd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d011000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedae59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d0082d0 0x564d8d01a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45576/0 (socket says 172.21.15.17:45576) 2023-07-14T13:12:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedae59c700 1 -- 172.21.15.17:0/1748854418 learned_addr learned my addr 172.21.15.17:0/1748854418 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedaed9d700 1 --2- 172.21.15.17:0/1748854418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d013ad0 0x564d8d011540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedae59c700 1 -- 172.21.15.17:0/1748854418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d013ad0 msgr2=0x564d8d011540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedae59c700 1 --2- 172.21.15.17:0/1748854418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d013ad0 0x564d8d011540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedae59c700 1 -- 172.21.15.17:0/1748854418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 msgr2=0x564d8d011000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:03.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedae59c700 1 --2- 172.21.15.17:0/1748854418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d011000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedae59c700 1 -- 172.21.15.17:0/1748854418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d8cd71c60 con 0x564d8d0082d0 2023-07-14T13:12:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.526+0000 7fedaed9d700 1 --2- 172.21.15.17:0/1748854418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d013ad0 0x564d8d011540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.527+0000 7fedae59c700 1 --2- 172.21.15.17:0/1748854418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d0082d0 0x564d8d01a4b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feda00098e0 tx=0x7feda0009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2dd26879ea7e273 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.527+0000 7fed9d7fa700 1 -- 172.21.15.17:0/1748854418 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda001d070 con 0x564d8d0082d0 2023-07-14T13:12:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.527+0000 7fed9d7fa700 1 -- 172.21.15.17:0/1748854418 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feda001e040 con 0x564d8d0082d0 2023-07-14T13:12:03.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.527+0000 7fed9d7fa700 1 -- 172.21.15.17:0/1748854418 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0024730 con 0x564d8d0082d0 2023-07-14T13:12:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.528+0000 7fedc869fb80 1 -- 172.21.15.17:0/1748854418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d0082d0 msgr2=0x564d8d01a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.528+0000 7fedc869fb80 1 --2- 172.21.15.17:0/1748854418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d0082d0 0x564d8d01a4b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feda00098e0 tx=0x7feda0009290 comp rx=0 tx=0).stop 2023-07-14T13:12:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.528+0000 7fedc869fb80 1 -- 172.21.15.17:0/1748854418 shutdown_connections 2023-07-14T13:12:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.528+0000 7fedc869fb80 1 --2- 172.21.15.17:0/1748854418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d013ad0 0x564d8d011540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.528+0000 7fedc869fb80 1 --2- 172.21.15.17:0/1748854418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d0082d0 0x564d8d01a4b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.528+0000 7fedc869fb80 1 --2- 172.21.15.17:0/1748854418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d011000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.528+0000 7fedc869fb80 1 -- 172.21.15.17:0/1748854418 >> 172.21.15.17:0/1748854418 conn(0x564d8cffeda0 msgr2=0x564d8d00bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.528+0000 7fedc869fb80 1 -- 172.21.15.17:0/1748854418 shutdown_connections 2023-07-14T13:12:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.528+0000 7fedc869fb80 1 -- 172.21.15.17:0/1748854418 wait complete. 2023-07-14T13:12:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.528+0000 7fedc869fb80 1 -- start start 2023-07-14T13:12:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.529+0000 7fedc869fb80 1 Processor -- start 2023-07-14T13:12:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.529+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d06b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.529+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.529+0000 7fedc869fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d013ad0 0x564d8d070500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.529+0000 7fedc869fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8d070a40 con 0x564d8d008be0 2023-07-14T13:12:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.529+0000 7fedc869fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8d070bb0 con 0x564d8d0082d0 2023-07-14T13:12:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.529+0000 7fedc869fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8d070d70 con 0x564d8d013ad0 2023-07-14T13:12:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.529+0000 7fedc869fb80 10 client.0 _ll_register_callbacks cb 0x7feda0005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fedae59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d06b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fedae59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d06b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39222/0 (socket says 172.21.15.17:39222) 2023-07-14T13:12:03.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fedae59c700 1 -- 172.21.15.17:0/3687924370 learned_addr learned my addr 172.21.15.17:0/3687924370 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fedaed9d700 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d013ad0 0x564d8d070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fedadd9b700 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fedae59c700 1 -- 172.21.15.17:0/3687924370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d013ad0 msgr2=0x564d8d070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fedae59c700 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d013ad0 0x564d8d070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fedae59c700 1 -- 172.21.15.17:0/3687924370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 msgr2=0x564d8d06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fedae59c700 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d06ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fedae59c700 1 -- 172.21.15.17:0/3687924370 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda80090e0 con 0x564d8d0082d0 2023-07-14T13:12:03.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fedae59c700 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d06b550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feda0009ce0 tx=0x7feda0005910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb9b95e3d8b0d421 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.530+0000 7fed95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:12:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.531+0000 7fed95ffb700 1 -- 172.21.15.17:0/3687924370 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda001d070 con 0x564d8d0082d0 2023-07-14T13:12:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.531+0000 7fedc869fb80 1 -- 172.21.15.17:0/3687924370 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feda800f040 con 0x564d8d0082d0 2023-07-14T13:12:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.531+0000 7fed95ffb700 1 -- 172.21.15.17:0/3687924370 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feda0000e40 con 0x564d8d0082d0 2023-07-14T13:12:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.531+0000 7fed95ffb700 1 -- 172.21.15.17:0/3687924370 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feda000bec0 con 0x564d8d0082d0 2023-07-14T13:12:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.531+0000 7fedc869fb80 10 client.27356 fetch_fsmap learned FSMap version 37 2023-07-14T13:12:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.531+0000 7fedc869fb80 1 -- 172.21.15.17:0/3687924370 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x564d8cdaf250 con 0x564d8d0082d0 2023-07-14T13:12:03.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.531+0000 7fed95ffb700 1 -- 172.21.15.17:0/3687924370 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feda004c020 con 0x564d8d0082d0 2023-07-14T13:12:03.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.531+0000 7fed95ffb700 1 -- 172.21.15.17:0/3687924370 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7feda0046070 con 0x564d8d0082d0 2023-07-14T13:12:03.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.532+0000 7fedc869fb80 10 client.27356 fetch_fsmap finished waiting for FSMap version 37 2023-07-14T13:12:03.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.532+0000 7fedc869fb80 10 client.27356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:03.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.532+0000 7fedc869fb80 20 client.27356 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:03.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.532+0000 7fedc869fb80 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564d8d078050 0x564d8d07a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:03.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.532+0000 7fedc869fb80 4 client.27356 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:12:03.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.532+0000 7fedc869fb80 1 -- 172.21.15.17:0/3687924370 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564d8cf16050 con 0x564d8d078050 2023-07-14T13:12:03.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.532+0000 7fedadd9b700 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564d8d078050 0x564d8d07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:03.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.532+0000 7fedadd9b700 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564d8d078050 0x564d8d07a430 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b00a4a40271dd88 server_cookie=1f4d87f738fd55ce in_seq=0 out_seq=0 2023-07-14T13:12:03.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.532+0000 7fed95ffb700 10 client.27356 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:03.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fed95ffb700 1 -- 172.21.15.17:0/3687924370 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564d8cf16050 con 0x564d8d078050 2023-07-14T13:12:03.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fed95ffb700 10 client.27356 handle_command_reply: tid=0 2023-07-14T13:12:03.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 1 client.27356 shutdown 2023-07-14T13:12:03.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 1 -- 172.21.15.17:0/3687924370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 msgr2=0x564d8d06b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d06b550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feda0009ce0 tx=0x7feda0005910 comp rx=0 tx=0).stop 2023-07-14T13:12:03.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 1 -- 172.21.15.17:0/3687924370 shutdown_connections 2023-07-14T13:12:03.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564d8d078050 0x564d8d07a430 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d8d013ad0 0x564d8d070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fed95ffb700 0 client.27356 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:03.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564d8d0082d0 0x564d8d06b550 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 1 --2- 172.21.15.17:0/3687924370 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564d8d008be0 0x564d8d06ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 1 -- 172.21.15.17:0/3687924370 >> 172.21.15.17:0/3687924370 conn(0x564d8cffeda0 msgr2=0x564d8d00bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:03.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 1 -- 172.21.15.17:0/3687924370 shutdown_connections 2023-07-14T13:12:03.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 1 -- 172.21.15.17:0/3687924370 wait complete. 2023-07-14T13:12:03.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.533+0000 7fedc869fb80 20 client.27356 trim_cache size 0 max 16384 2023-07-14T13:12:03.579 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:12:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:12:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:12:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:12:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:12:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:12:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:12:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:12:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:12:03.581 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:12:03.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 -- 172.21.15.17:0/2978157642 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed980a12c0 msgr2=0x7fed980a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed980a12c0 0x7fed980a3770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feda8018000 tx=0x7feda801a000 comp rx=0 tx=0).stop 2023-07-14T13:12:03.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 -- 172.21.15.17:0/2978157642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb01015b0 msgr2=0x7fedb00fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:03.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb01015b0 0x7fedb00fee30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7feda400e9a0 tx=0x7feda400ecb0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 -- 172.21.15.17:0/2978157642 shutdown_connections 2023-07-14T13:12:03.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed980a12c0 0x7fed980a3770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fedb010a070 0x7fedb01a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb0100ca0 0x7fedb00fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 --2- 172.21.15.17:0/2978157642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fedb01015b0 0x7fedb00fee30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:03.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 -- 172.21.15.17:0/2978157642 >> 172.21.15.17:0/2978157642 conn(0x7fedb00fa4b0 msgr2=0x7fedb010c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:03.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 -- 172.21.15.17:0/2978157642 shutdown_connections 2023-07-14T13:12:03.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:03.534+0000 7fedb4dff700 1 -- 172.21.15.17:0/2978157642 wait complete. 2023-07-14T13:12:03.588 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:03 smithi017 ceph-mon[95536]: pgmap v384: 97 pgs: 97 active+clean; 9.7 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 54 op/s 2023-07-14T13:12:03.590 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:12:03.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:03 smithi135 ceph-mon[97338]: pgmap v384: 97 pgs: 97 active+clean; 9.7 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 54 op/s 2023-07-14T13:12:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:48600000 of 50000000 tuples (97%) done (elapsed 713.42 s, remaining 20.55 s) 2023-07-14T13:12:05.133 INFO:teuthology.orchestra.run.smithi017.stderr:48700000 of 50000000 tuples (97%) done (elapsed 714.73 s, remaining 19.08 s) 2023-07-14T13:12:05.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:05 smithi131 ceph-mon[96953]: pgmap v385: 97 pgs: 97 active+clean; 9.7 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-07-14T13:12:05.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:05 smithi017 ceph-mon[95536]: pgmap v385: 97 pgs: 97 active+clean; 9.7 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-07-14T13:12:05.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:05 smithi135 ceph-mon[97338]: pgmap v385: 97 pgs: 97 active+clean; 9.7 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 53 op/s 2023-07-14T13:12:06.518 INFO:teuthology.orchestra.run.smithi017.stderr:48800000 of 50000000 tuples (97%) done (elapsed 716.12 s, remaining 17.61 s) 2023-07-14T13:12:07.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:07 smithi131 ceph-mon[96953]: pgmap v386: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 86 op/s 2023-07-14T13:12:07.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:07 smithi017 ceph-mon[95536]: pgmap v386: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 86 op/s 2023-07-14T13:12:07.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:07 smithi135 ceph-mon[97338]: pgmap v386: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 86 op/s 2023-07-14T13:12:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:48900000 of 50000000 tuples (97%) done (elapsed 717.42 s, remaining 16.14 s) 2023-07-14T13:12:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.685+0000 7f85467ff700 1 -- 172.21.15.17:0/1543472243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85400ffb30 msgr2=0x7f85400fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.685+0000 7f85467ff700 1 --2- 172.21.15.17:0/1543472243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85400ffb30 0x7f85400fffa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8534009990 tx=0x7f8534009ca0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.685+0000 7f85467ff700 1 -- 172.21.15.17:0/1543472243 shutdown_connections 2023-07-14T13:12:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.685+0000 7f85467ff700 1 --2- 172.21.15.17:0/1543472243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85401004e0 0x7f854010c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.685+0000 7f85467ff700 1 --2- 172.21.15.17:0/1543472243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540105b60 0x7f8540105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.685+0000 7f85467ff700 1 --2- 172.21.15.17:0/1543472243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85400ffb30 0x7f85400fffa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.685+0000 7f85467ff700 1 -- 172.21.15.17:0/1543472243 >> 172.21.15.17:0/1543472243 conn(0x7f85400fb5f0 msgr2=0x7f85400fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.686+0000 7f85467ff700 1 -- 172.21.15.17:0/1543472243 shutdown_connections 2023-07-14T13:12:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.686+0000 7f85467ff700 1 -- 172.21.15.17:0/1543472243 wait complete. 2023-07-14T13:12:08.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.687+0000 7f85467ff700 1 Processor -- start 2023-07-14T13:12:08.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.687+0000 7f85467ff700 1 -- start start 2023-07-14T13:12:08.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.687+0000 7f85467ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb30 0x7f85400729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.687+0000 7f85467ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85401004e0 0x7f8540072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.687+0000 7f85467ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540105b60 0x7f85401a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.687+0000 7f85467ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401a41f0 con 0x7f85400ffb30 2023-07-14T13:12:08.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.687+0000 7f85467ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401a4330 con 0x7f85401004e0 2023-07-14T13:12:08.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.687+0000 7f85467ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401a44a0 con 0x7f8540105b60 2023-07-14T13:12:08.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f853ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb30 0x7f85400729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f853ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb30 0x7f85400729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53652/0 (socket says 172.21.15.17:53652) 2023-07-14T13:12:08.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85401004e0 0x7f8540072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f853ffff700 1 -- 172.21.15.17:0/438708696 learned_addr learned my addr 172.21.15.17:0/438708696 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:08.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f8544d9c700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540105b60 0x7f85401a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f853ffff700 1 -- 172.21.15.17:0/438708696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540105b60 msgr2=0x7f85401a3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f853ffff700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540105b60 0x7f85401a3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f853ffff700 1 -- 172.21.15.17:0/438708696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85401004e0 msgr2=0x7f8540072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f853ffff700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85401004e0 0x7f8540072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f853ffff700 1 -- 172.21.15.17:0/438708696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538009c40 con 0x7f85400ffb30 2023-07-14T13:12:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f8544d9c700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540105b60 0x7f85401a3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.688+0000 7f853f7fe700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85401004e0 0x7f8540072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.689+0000 7f853ffff700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb30 0x7f85400729f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f853000e9a0 tx=0x7f853000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.689+0000 7f853d7fa700 1 -- 172.21.15.17:0/438708696 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530009790 con 0x7f85400ffb30 2023-07-14T13:12:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.689+0000 7f853d7fa700 1 -- 172.21.15.17:0/438708696 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853000ce50 con 0x7f85400ffb30 2023-07-14T13:12:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.689+0000 7f85467ff700 1 -- 172.21.15.17:0/438708696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85340095f0 con 0x7f85400ffb30 2023-07-14T13:12:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.689+0000 7f853d7fa700 1 -- 172.21.15.17:0/438708696 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530018420 con 0x7f85400ffb30 2023-07-14T13:12:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.689+0000 7f85467ff700 1 -- 172.21.15.17:0/438708696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85401a4b50 con 0x7f85400ffb30 2023-07-14T13:12:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.693+0000 7f853d7fa700 1 -- 172.21.15.17:0/438708696 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8530010430 con 0x7f85400ffb30 2023-07-14T13:12:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.694+0000 7f853d7fa700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85280a1340 0x7f85280a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.695+0000 7f855a1a1b80 1 Processor -- start 2023-07-14T13:12:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.695+0000 7f853d7fa700 1 -- 172.21.15.17:0/438708696 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8530014070 con 0x7f85400ffb30 2023-07-14T13:12:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.695+0000 7f853f7fe700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85280a1340 0x7f85280a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.695+0000 7f855a1a1b80 1 -- start start 2023-07-14T13:12:08.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.695+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450b9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.695+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450ba2d0 0x5618450b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.695+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.695+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561844fb9c50 con 0x5618450b4580 2023-07-14T13:12:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.695+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184500c9e0 con 0x5618450ba2d0 2023-07-14T13:12:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.695+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561845005e70 con 0x561844f106b0 2023-07-14T13:12:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450b9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450b9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40424/0 (socket says 172.21.15.17:40424) 2023-07-14T13:12:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853ffff700 1 -- 172.21.15.17:0/3780776831 learned_addr learned my addr 172.21.15.17:0/3780776831 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853f7fe700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85280a1340 0x7f85280a37f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8540074210 tx=0x7f853400b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853f7fe700 1 --2- 172.21.15.17:0/3780776831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450ba2d0 0x5618450b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f8544d9c700 1 --2- 172.21.15.17:0/3780776831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853ffff700 1 -- 172.21.15.17:0/3780776831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450ba2d0 msgr2=0x5618450b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:08.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853ffff700 1 --2- 172.21.15.17:0/3780776831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450ba2d0 0x5618450b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853ffff700 1 -- 172.21.15.17:0/3780776831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 msgr2=0x5618450b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:08.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853ffff700 1 --2- 172.21.15.17:0/3780776831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853ffff700 1 -- 172.21.15.17:0/3780776831 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561844e33d80 con 0x561844f106b0 2023-07-14T13:12:08.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853f7fe700 1 --2- 172.21.15.17:0/3780776831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450ba2d0 0x5618450b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:08.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f8544d9c700 1 --2- 172.21.15.17:0/3780776831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.696+0000 7f853ffff700 1 --2- 172.21.15.17:0/3780776831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450b9d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8530096960 tx=0x7f8530010790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bc85bac2ed5bde server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.697+0000 7f85267fc700 1 -- 172.21.15.17:0/3780776831 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300a2340 con 0x561844f106b0 2023-07-14T13:12:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.697+0000 7f85267fc700 1 -- 172.21.15.17:0/3780776831 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853009a150 con 0x561844f106b0 2023-07-14T13:12:08.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.697+0000 7f85267fc700 1 -- 172.21.15.17:0/3780776831 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300a2110 con 0x561844f106b0 2023-07-14T13:12:08.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.697+0000 7f855a1a1b80 1 -- 172.21.15.17:0/3780776831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 msgr2=0x5618450b9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.697+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/3780776831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450b9d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8530096960 tx=0x7f8530010790 comp rx=0 tx=0).stop 2023-07-14T13:12:08.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.698+0000 7f855a1a1b80 1 -- 172.21.15.17:0/3780776831 shutdown_connections 2023-07-14T13:12:08.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.698+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/3780776831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.698+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/3780776831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450b9d90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.698+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/3780776831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450ba2d0 0x5618450b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.698+0000 7f855a1a1b80 1 -- 172.21.15.17:0/3780776831 >> 172.21.15.17:0/3780776831 conn(0x5618450a9be0 msgr2=0x5618450aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.698+0000 7f855a1a1b80 1 -- 172.21.15.17:0/3780776831 shutdown_connections 2023-07-14T13:12:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.698+0000 7f855a1a1b80 1 -- 172.21.15.17:0/3780776831 wait complete. 2023-07-14T13:12:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.698+0000 7f855a1a1b80 1 -- start start 2023-07-14T13:12:08.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.699+0000 7f855a1a1b80 1 Processor -- start 2023-07-14T13:12:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.699+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450c05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.699+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450bd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.699+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450ba2d0 0x5618450bdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.699+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561844fa5a60 con 0x5618450b4580 2023-07-14T13:12:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.699+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561844fa5760 con 0x5618450ba2d0 2023-07-14T13:12:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.699+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561844e898c0 con 0x561844f106b0 2023-07-14T13:12:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.700+0000 7f855a1a1b80 10 client.0 _ll_register_callbacks cb 0x561844fa3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:08.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.700+0000 7f853ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450c05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.700+0000 7f853ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450c05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40428/0 (socket says 172.21.15.17:40428) 2023-07-14T13:12:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.700+0000 7f853ffff700 1 -- 172.21.15.17:0/480205580 learned_addr learned my addr 172.21.15.17:0/480205580 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.700+0000 7f8544d9c700 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450ba2d0 0x5618450bdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.700+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.700+0000 7f853ffff700 1 -- 172.21.15.17:0/480205580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450ba2d0 msgr2=0x5618450bdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.700+0000 7f853ffff700 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450ba2d0 0x5618450bdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.700+0000 7f853ffff700 1 -- 172.21.15.17:0/480205580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 msgr2=0x5618450bd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.700+0000 7f853ffff700 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450bd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.700+0000 7f853ffff700 1 -- 172.21.15.17:0/480205580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85401a4b50 con 0x561844f106b0 2023-07-14T13:12:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.701+0000 7f853ffff700 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450c05c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85300a1e10 tx=0x7f85300962a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4251ad62f789d8b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.701+0000 7f851f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:12:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.701+0000 7f851f7fe700 1 -- 172.21.15.17:0/480205580 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300a20c0 con 0x561844f106b0 2023-07-14T13:12:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.701+0000 7f851f7fe700 1 -- 172.21.15.17:0/480205580 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f853000c9c0 con 0x561844f106b0 2023-07-14T13:12:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.701+0000 7f855a1a1b80 1 -- 172.21.15.17:0/480205580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561844f5f490 con 0x561844f106b0 2023-07-14T13:12:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.701+0000 7f851f7fe700 1 -- 172.21.15.17:0/480205580 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85300b8250 con 0x561844f106b0 2023-07-14T13:12:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.701+0000 7f855a1a1b80 10 client.27334 fetch_fsmap learned FSMap version 37 2023-07-14T13:12:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.701+0000 7f855a1a1b80 1 -- 172.21.15.17:0/480205580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x561844e1cc00 con 0x561844f106b0 2023-07-14T13:12:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.701+0000 7f851f7fe700 1 -- 172.21.15.17:0/480205580 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85300ca020 con 0x561844f106b0 2023-07-14T13:12:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.702+0000 7f851f7fe700 1 -- 172.21.15.17:0/480205580 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8530095ce0 con 0x561844f106b0 2023-07-14T13:12:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.702+0000 7f855a1a1b80 10 client.27334 fetch_fsmap finished waiting for FSMap version 37 2023-07-14T13:12:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.702+0000 7f855a1a1b80 10 client.27334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.702+0000 7f855a1a1b80 20 client.27334 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.702+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5618450cd7b0 0x5618450cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.702+0000 7f855a1a1b80 4 client.27334 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:12:08.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.702+0000 7f855a1a1b80 1 -- 172.21.15.17:0/480205580 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561844ffee50 con 0x5618450cd7b0 2023-07-14T13:12:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.702+0000 7f853f7fe700 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5618450cd7b0 0x5618450cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.703+0000 7f853f7fe700 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5618450cd7b0 0x5618450cfb90 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72a9882165ac3c0b server_cookie=88b6acb5ff316663 in_seq=0 out_seq=0 2023-07-14T13:12:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.703+0000 7f851f7fe700 10 client.27334 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f851f7fe700 1 -- 172.21.15.17:0/480205580 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561844ffee50 con 0x5618450cd7b0 2023-07-14T13:12:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f851f7fe700 10 client.27334 handle_command_reply: tid=0 2023-07-14T13:12:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 1 client.27334 shutdown 2023-07-14T13:12:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 1 -- 172.21.15.17:0/480205580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 msgr2=0x5618450c05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450c05c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85300a1e10 tx=0x7f85300962a0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 1 -- 172.21.15.17:0/480205580 shutdown_connections 2023-07-14T13:12:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5618450cd7b0 0x5618450cfb90 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450ba2d0 0x5618450bdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561844f106b0 0x5618450c05c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f851f7fe700 0 client.27334 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/480205580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450bd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 1 -- 172.21.15.17:0/480205580 >> 172.21.15.17:0/480205580 conn(0x5618450a9be0 msgr2=0x5618450ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 1 -- 172.21.15.17:0/480205580 shutdown_connections 2023-07-14T13:12:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 1 -- 172.21.15.17:0/480205580 wait complete. 2023-07-14T13:12:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.704+0000 7f855a1a1b80 20 client.27334 trim_cache size 0 max 16384 2023-07-14T13:12:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.722+0000 7f855a1a1b80 1 Processor -- start 2023-07-14T13:12:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.722+0000 7f855a1a1b80 1 -- start start 2023-07-14T13:12:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.722+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450a9be0 0x5618450c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.722+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561844f106b0 0x5618450c0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.722+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450b4580 0x5618450aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.722+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618450b05b0 con 0x561844f106b0 2023-07-14T13:12:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.722+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56184507a060 con 0x5618450a9be0 2023-07-14T13:12:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.722+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618450b0a70 con 0x5618450b4580 2023-07-14T13:12:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561844f106b0 0x5618450c0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f853ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450a9be0 0x5618450c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f853ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450a9be0 0x5618450c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56958/0 (socket says 172.21.15.17:56958) 2023-07-14T13:12:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f853ffff700 1 -- 172.21.15.17:0/419414091 learned_addr learned my addr 172.21.15.17:0/419414091 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561844f106b0 0x5618450c0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53696/0 (socket says 172.21.15.17:53696) 2023-07-14T13:12:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f8544d9c700 1 --2- 172.21.15.17:0/419414091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450b4580 0x5618450aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f853f7fe700 1 -- 172.21.15.17:0/419414091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450b4580 msgr2=0x5618450aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f853f7fe700 1 --2- 172.21.15.17:0/419414091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450b4580 0x5618450aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f853f7fe700 1 -- 172.21.15.17:0/419414091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450a9be0 msgr2=0x5618450c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f853f7fe700 1 --2- 172.21.15.17:0/419414091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450a9be0 0x5618450c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f853f7fe700 1 -- 172.21.15.17:0/419414091 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618450d4760 con 0x561844f106b0 2023-07-14T13:12:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.723+0000 7f853ffff700 1 --2- 172.21.15.17:0/419414091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450a9be0 0x5618450c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.724+0000 7f853f7fe700 1 --2- 172.21.15.17:0/419414091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561844f106b0 0x5618450c0160 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8534000c00 tx=0x7f8534020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68096b6e64b44c67 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.724+0000 7f8526ffd700 1 -- 172.21.15.17:0/419414091 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534033b20 con 0x561844f106b0 2023-07-14T13:12:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.724+0000 7f8526ffd700 1 -- 172.21.15.17:0/419414091 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853402a030 con 0x561844f106b0 2023-07-14T13:12:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.724+0000 7f8526ffd700 1 -- 172.21.15.17:0/419414091 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853400f9e0 con 0x561844f106b0 2023-07-14T13:12:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.725+0000 7f855a1a1b80 1 -- 172.21.15.17:0/419414091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561844f106b0 msgr2=0x5618450c0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.725+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/419414091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561844f106b0 0x5618450c0160 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8534000c00 tx=0x7f8534020000 comp rx=0 tx=0).stop 2023-07-14T13:12:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.725+0000 7f855a1a1b80 1 -- 172.21.15.17:0/419414091 shutdown_connections 2023-07-14T13:12:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.725+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/419414091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450b4580 0x5618450aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.725+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/419414091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618450a9be0 0x5618450c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.725+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/419414091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561844f106b0 0x5618450c0160 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.725+0000 7f855a1a1b80 1 -- 172.21.15.17:0/419414091 >> 172.21.15.17:0/419414091 conn(0x5618450ca240 msgr2=0x5618450bb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.725+0000 7f855a1a1b80 1 -- 172.21.15.17:0/419414091 shutdown_connections 2023-07-14T13:12:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.725+0000 7f855a1a1b80 1 -- 172.21.15.17:0/419414091 wait complete. 2023-07-14T13:12:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.725+0000 7f855a1a1b80 1 -- start start 2023-07-14T13:12:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f855a1a1b80 1 Processor -- start 2023-07-14T13:12:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561844f106b0 0x5618450c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450a9be0 0x5618450b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f855a1a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618450b63d0 con 0x5618450b4580 2023-07-14T13:12:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618450b6510 con 0x561844f106b0 2023-07-14T13:12:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f855a1a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618450b66d0 con 0x5618450a9be0 2023-07-14T13:12:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f855a1a1b80 10 client.0 _ll_register_callbacks cb 0x7f85300998e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450a9be0 0x5618450b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f853ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561844f106b0 0x5618450c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f853f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450a9be0 0x5618450b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40450/0 (socket says 172.21.15.17:40450) 2023-07-14T13:12:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f8544d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.726+0000 7f853f7fe700 1 -- 172.21.15.17:0/206965939 learned_addr learned my addr 172.21.15.17:0/206965939 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.727+0000 7f853f7fe700 1 -- 172.21.15.17:0/206965939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561844f106b0 msgr2=0x5618450c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.727+0000 7f853f7fe700 1 --2- 172.21.15.17:0/206965939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561844f106b0 0x5618450c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.727+0000 7f853f7fe700 1 -- 172.21.15.17:0/206965939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 msgr2=0x5618450b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.727+0000 7f853f7fe700 1 --2- 172.21.15.17:0/206965939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.727+0000 7f853f7fe700 1 -- 172.21.15.17:0/206965939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561844e1cc00 con 0x5618450a9be0 2023-07-14T13:12:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.727+0000 7f853f7fe700 1 --2- 172.21.15.17:0/206965939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450a9be0 0x5618450b5950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8534009350 tx=0x7f8534033ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8447cc07fa2b658b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.727+0000 7f851f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:12:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.727+0000 7f851f7fe700 1 -- 172.21.15.17:0/206965939 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534033250 con 0x5618450a9be0 2023-07-14T13:12:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f855a1a1b80 1 -- 172.21.15.17:0/206965939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5618450ca610 con 0x5618450a9be0 2023-07-14T13:12:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f851f7fe700 1 -- 172.21.15.17:0/206965939 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f85340333b0 con 0x5618450a9be0 2023-07-14T13:12:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f851f7fe700 1 -- 172.21.15.17:0/206965939 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8534033570 con 0x5618450a9be0 2023-07-14T13:12:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f855a1a1b80 10 client.27340 fetch_fsmap learned FSMap version 37 2023-07-14T13:12:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f855a1a1b80 1 -- 172.21.15.17:0/206965939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f854010d220 con 0x5618450a9be0 2023-07-14T13:12:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f851f7fe700 1 -- 172.21.15.17:0/206965939 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8534049020 con 0x5618450a9be0 2023-07-14T13:12:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f851f7fe700 1 -- 172.21.15.17:0/206965939 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f85340246b0 con 0x5618450a9be0 2023-07-14T13:12:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f855a1a1b80 10 client.27340 fetch_fsmap finished waiting for FSMap version 37 2023-07-14T13:12:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f855a1a1b80 10 client.27340 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f855a1a1b80 20 client.27340 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/206965939 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5618450ba2d0 0x561845124760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f855a1a1b80 4 client.27340 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:12:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.728+0000 7f855a1a1b80 1 -- 172.21.15.17:0/206965939 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f853009a150 con 0x5618450ba2d0 2023-07-14T13:12:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.729+0000 7f853ffff700 1 --2- 172.21.15.17:0/206965939 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5618450ba2d0 0x561845124760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.729+0000 7f851f7fe700 10 client.27340 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.729+0000 7f853ffff700 1 --2- 172.21.15.17:0/206965939 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5618450ba2d0 0x561845124760 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ac2d138ad61650d server_cookie=8eccba8d0aa671c7 in_seq=0 out_seq=0 2023-07-14T13:12:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f851f7fe700 1 -- 172.21.15.17:0/206965939 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f853009a150 con 0x5618450ba2d0 2023-07-14T13:12:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f851f7fe700 10 client.27340 handle_command_reply: tid=0 2023-07-14T13:12:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f855a1a1b80 1 client.27340 shutdown 2023-07-14T13:12:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f855a1a1b80 1 -- 172.21.15.17:0/206965939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450a9be0 msgr2=0x5618450b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/206965939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450a9be0 0x5618450b5950 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8534009350 tx=0x7f8534033ec0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f855a1a1b80 1 -- 172.21.15.17:0/206965939 shutdown_connections 2023-07-14T13:12:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/206965939 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5618450ba2d0 0x561845124760 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/206965939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5618450b4580 0x5618450b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/206965939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561844f106b0 0x5618450c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f851f7fe700 0 client.27340 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f855a1a1b80 1 --2- 172.21.15.17:0/206965939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5618450a9be0 0x5618450b5950 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f855a1a1b80 1 -- 172.21.15.17:0/206965939 >> 172.21.15.17:0/206965939 conn(0x5618450ca240 msgr2=0x5618450ba900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f855a1a1b80 1 -- 172.21.15.17:0/206965939 shutdown_connections 2023-07-14T13:12:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.742+0000 7f855a1a1b80 1 -- 172.21.15.17:0/206965939 wait complete. 2023-07-14T13:12:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.743+0000 7f855a1a1b80 20 client.27340 trim_cache size 0 max 16384 2023-07-14T13:12:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:12:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:12:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:12:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:12:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.743+0000 7f85467ff700 1 -- 172.21.15.17:0/438708696 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85280a1340 msgr2=0x7f85280a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.743+0000 7f85467ff700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85280a1340 0x7f85280a37f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8540074210 tx=0x7f853400b260 comp rx=0 tx=0).stop 2023-07-14T13:12:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.743+0000 7f85467ff700 1 -- 172.21.15.17:0/438708696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb30 msgr2=0x7f85400729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.743+0000 7f85467ff700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb30 0x7f85400729f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f853000e9a0 tx=0x7f853000ecb0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.743+0000 7f85467ff700 1 -- 172.21.15.17:0/438708696 shutdown_connections 2023-07-14T13:12:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.744+0000 7f85467ff700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85280a1340 0x7f85280a37f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.744+0000 7f85467ff700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8540105b60 0x7f85401a3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.744+0000 7f85467ff700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85400ffb30 0x7f85400729f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.744+0000 7f85467ff700 1 --2- 172.21.15.17:0/438708696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85401004e0 0x7f8540072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.744+0000 7f85467ff700 1 -- 172.21.15.17:0/438708696 >> 172.21.15.17:0/438708696 conn(0x7f85400fb5f0 msgr2=0x7f8540103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.744+0000 7f85467ff700 1 -- 172.21.15.17:0/438708696 shutdown_connections 2023-07-14T13:12:08.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:08.744+0000 7f85467ff700 1 -- 172.21.15.17:0/438708696 wait complete. 2023-07-14T13:12:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:49000000 of 50000000 tuples (98%) done (elapsed 718.74 s, remaining 14.67 s) 2023-07-14T13:12:09.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:09 smithi131 ceph-mon[96953]: pgmap v387: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-07-14T13:12:09.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:09 smithi017 ceph-mon[95536]: pgmap v387: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-07-14T13:12:09.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:09 smithi135 ceph-mon[97338]: pgmap v387: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 63 op/s 2023-07-14T13:12:10.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:10 smithi131 ceph-mon[96953]: osdmap e102: 12 total, 12 up, 12 in 2023-07-14T13:12:10.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:10 smithi017 ceph-mon[95536]: osdmap e102: 12 total, 12 up, 12 in 2023-07-14T13:12:10.623 INFO:teuthology.orchestra.run.smithi017.stderr:49100000 of 50000000 tuples (98%) done (elapsed 720.22 s, remaining 13.20 s) 2023-07-14T13:12:10.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:10 smithi135 ceph-mon[97338]: osdmap e102: 12 total, 12 up, 12 in 2023-07-14T13:12:11.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:11 smithi131 ceph-mon[96953]: pgmap v389: 97 pgs: 97 active+clean; 9.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 56 op/s 2023-07-14T13:12:11.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:11 smithi017 ceph-mon[95536]: pgmap v389: 97 pgs: 97 active+clean; 9.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 56 op/s 2023-07-14T13:12:11.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:11 smithi135 ceph-mon[97338]: pgmap v389: 97 pgs: 97 active+clean; 9.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 56 op/s 2023-07-14T13:12:11.942 INFO:teuthology.orchestra.run.smithi017.stderr:49200000 of 50000000 tuples (98%) done (elapsed 721.54 s, remaining 11.73 s) 2023-07-14T13:12:13.283 INFO:teuthology.orchestra.run.smithi017.stderr:49300000 of 50000000 tuples (98%) done (elapsed 722.88 s, remaining 10.26 s) 2023-07-14T13:12:13.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:13 smithi131 ceph-mon[96953]: pgmap v390: 97 pgs: 97 active+clean; 9.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 52 op/s 2023-07-14T13:12:13.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:13 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:12:13.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:13 smithi017 ceph-mon[95536]: pgmap v390: 97 pgs: 97 active+clean; 9.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 52 op/s 2023-07-14T13:12:13.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:13 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:12:13.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:13 smithi135 ceph-mon[97338]: pgmap v390: 97 pgs: 97 active+clean; 9.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 52 op/s 2023-07-14T13:12:13.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:13 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:12:14.767 INFO:teuthology.orchestra.run.smithi017.stderr:49400000 of 50000000 tuples (98%) done (elapsed 724.37 s, remaining 8.80 s) 2023-07-14T13:12:15.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:15 smithi131 ceph-mon[96953]: pgmap v391: 97 pgs: 97 active+clean; 9.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 52 op/s 2023-07-14T13:12:15.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:15 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:12:15.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:15 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:12:15.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:15 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:12:15.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:15 smithi017 ceph-mon[95536]: pgmap v391: 97 pgs: 97 active+clean; 9.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 52 op/s 2023-07-14T13:12:15.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:15 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:12:15.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:15 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:12:15.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:15 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:12:15.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:15 smithi135 ceph-mon[97338]: pgmap v391: 97 pgs: 97 active+clean; 9.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 26 MiB/s wr, 52 op/s 2023-07-14T13:12:15.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:15 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:12:15.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:15 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:12:15.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:15 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:12:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:49500000 of 50000000 tuples (99%) done (elapsed 725.67 s, remaining 7.33 s) 2023-07-14T13:12:17.411 INFO:teuthology.orchestra.run.smithi017.stderr:49600000 of 50000000 tuples (99%) done (elapsed 727.01 s, remaining 5.86 s) 2023-07-14T13:12:17.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:17 smithi135 ceph-mon[97338]: pgmap v392: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 47 op/s 2023-07-14T13:12:17.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:17 smithi135 ceph-mon[97338]: osdmap e103: 12 total, 12 up, 12 in 2023-07-14T13:12:17.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:17 smithi131 ceph-mon[96953]: pgmap v392: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 47 op/s 2023-07-14T13:12:17.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:17 smithi131 ceph-mon[96953]: osdmap e103: 12 total, 12 up, 12 in 2023-07-14T13:12:17.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:17 smithi017 ceph-mon[95536]: pgmap v392: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 47 op/s 2023-07-14T13:12:17.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:17 smithi017 ceph-mon[95536]: osdmap e103: 12 total, 12 up, 12 in 2023-07-14T13:12:19.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:19 smithi135 ceph-mon[97338]: pgmap v394: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 30 MiB/s wr, 53 op/s 2023-07-14T13:12:19.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:19 smithi131 ceph-mon[96953]: pgmap v394: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 30 MiB/s wr, 53 op/s 2023-07-14T13:12:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:49700000 of 50000000 tuples (99%) done (elapsed 729.13 s, remaining 4.40 s) 2023-07-14T13:12:19.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:19 smithi017 ceph-mon[95536]: pgmap v394: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 30 MiB/s wr, 53 op/s 2023-07-14T13:12:20.866 INFO:teuthology.orchestra.run.smithi017.stderr:49800000 of 50000000 tuples (99%) done (elapsed 730.46 s, remaining 2.93 s) 2023-07-14T13:12:21.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:21 smithi135 ceph-mon[97338]: pgmap v395: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 24 MiB/s wr, 67 op/s 2023-07-14T13:12:21.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:21 smithi131 ceph-mon[96953]: pgmap v395: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 24 MiB/s wr, 67 op/s 2023-07-14T13:12:21.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:21 smithi017 ceph-mon[95536]: pgmap v395: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 24 MiB/s wr, 67 op/s 2023-07-14T13:12:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.907+0000 7f2a637ff700 1 -- 172.21.15.17:0/642715870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c0679a0 msgr2=0x7f2a5c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.907+0000 7f2a637ff700 1 --2- 172.21.15.17:0/642715870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c0679a0 0x7f2a5c067d70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009990 tx=0x7f2a58009ca0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.907+0000 7f2a637ff700 1 -- 172.21.15.17:0/642715870 shutdown_connections 2023-07-14T13:12:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.907+0000 7f2a637ff700 1 --2- 172.21.15.17:0/642715870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a5c10c540 0x7f2a5c10e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.907+0000 7f2a637ff700 1 --2- 172.21.15.17:0/642715870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c0679a0 0x7f2a5c067d70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.907+0000 7f2a637ff700 1 --2- 172.21.15.17:0/642715870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c0682b0 0x7f2a5c10c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.907+0000 7f2a637ff700 1 -- 172.21.15.17:0/642715870 >> 172.21.15.17:0/642715870 conn(0x7f2a5c074760 msgr2=0x7f2a5c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.907+0000 7f2a637ff700 1 -- 172.21.15.17:0/642715870 shutdown_connections 2023-07-14T13:12:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.907+0000 7f2a637ff700 1 -- 172.21.15.17:0/642715870 wait complete. 2023-07-14T13:12:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.908+0000 7f2a637ff700 1 Processor -- start 2023-07-14T13:12:21.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.908+0000 7f2a637ff700 1 -- start start 2023-07-14T13:12:21.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.909+0000 7f2a637ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a5c0679a0 0x7f2a5c19dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.909+0000 7f2a637ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c0682b0 0x7f2a5c19e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.909+0000 7f2a637ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c10c540 0x7f2a5c197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.909+0000 7f2a637ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c1981b0 con 0x7f2a5c10c540 2023-07-14T13:12:21.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.909+0000 7f2a637ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c198320 con 0x7f2a5c0679a0 2023-07-14T13:12:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.909+0000 7f2a637ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c1984e0 con 0x7f2a5c0682b0 2023-07-14T13:12:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.909+0000 7f2a6159b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a5c0679a0 0x7f2a5c19dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.909+0000 7f2a61d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c10c540 0x7f2a5c197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.909+0000 7f2a6159b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a5c0679a0 0x7f2a5c19dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39584/0 (socket says 172.21.15.17:39584) 2023-07-14T13:12:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.909+0000 7f2a6159b700 1 -- 172.21.15.17:0/972244410 learned_addr learned my addr 172.21.15.17:0/972244410 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:21.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.909+0000 7f2a60d9a700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c0682b0 0x7f2a5c19e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.910+0000 7f2a6159b700 1 -- 172.21.15.17:0/972244410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c0682b0 msgr2=0x7f2a5c19e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.910+0000 7f2a6159b700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c0682b0 0x7f2a5c19e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.910+0000 7f2a6159b700 1 -- 172.21.15.17:0/972244410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c10c540 msgr2=0x7f2a5c197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.910+0000 7f2a6159b700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c10c540 0x7f2a5c197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.910+0000 7f2a6159b700 1 -- 172.21.15.17:0/972244410 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a580095f0 con 0x7f2a5c0679a0 2023-07-14T13:12:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.910+0000 7f2a60d9a700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c0682b0 0x7f2a5c19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.910+0000 7f2a61d9c700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c10c540 0x7f2a5c197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.910+0000 7f2a6159b700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a5c0679a0 0x7f2a5c19dce0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2a58005740 tx=0x7f2a58005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.910+0000 7f2a527fc700 1 -- 172.21.15.17:0/972244410 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5801d070 con 0x7f2a5c0679a0 2023-07-14T13:12:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.910+0000 7f2a637ff700 1 -- 172.21.15.17:0/972244410 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c198760 con 0x7f2a5c0679a0 2023-07-14T13:12:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.911+0000 7f2a527fc700 1 -- 172.21.15.17:0/972244410 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a58022470 con 0x7f2a5c0679a0 2023-07-14T13:12:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.911+0000 7f2a527fc700 1 -- 172.21.15.17:0/972244410 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58017650 con 0x7f2a5c0679a0 2023-07-14T13:12:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.911+0000 7f2a637ff700 1 -- 172.21.15.17:0/972244410 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c1a4cd0 con 0x7f2a5c0679a0 2023-07-14T13:12:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.914+0000 7f2a527fc700 1 -- 172.21.15.17:0/972244410 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2a580225e0 con 0x7f2a5c0679a0 2023-07-14T13:12:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.915+0000 7f2a77096b80 1 Processor -- start 2023-07-14T13:12:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a77096b80 1 -- start start 2023-07-14T13:12:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4236fb6b0 0x55a4238a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a42389f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a42389f580 0x55a42389f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a77096b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4237a4c50 con 0x55a42389f580 2023-07-14T13:12:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a77096b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4237f79e0 con 0x55a4236fb6b0 2023-07-14T13:12:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a77096b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4237f0e70 con 0x55a4238a52d0 2023-07-14T13:12:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a527fc700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2a480a1340 0x7f2a480a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a527fc700 1 -- 172.21.15.17:0/972244410 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2a580cdff0 con 0x7f2a5c0679a0 2023-07-14T13:12:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a61d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4236fb6b0 0x55a4238a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a61d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4236fb6b0 0x55a4238a4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39592/0 (socket says 172.21.15.17:39592) 2023-07-14T13:12:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a61d9c700 1 -- 172.21.15.17:0/3677267218 learned_addr learned my addr 172.21.15.17:0/3677267218 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.916+0000 7f2a6159b700 1 --2- 172.21.15.17:0/3677267218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a42389f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.917+0000 7f2a61d9c700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2a480a1340 0x7f2a480a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.917+0000 7f2a60d9a700 1 --2- 172.21.15.17:0/3677267218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a42389f580 0x55a42389f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.917+0000 7f2a61d9c700 1 -- 172.21.15.17:0/3677267218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 msgr2=0x55a42389f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.917+0000 7f2a61d9c700 1 --2- 172.21.15.17:0/3677267218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a42389f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.917+0000 7f2a61d9c700 1 -- 172.21.15.17:0/3677267218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a42389f580 msgr2=0x55a42389f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.917+0000 7f2a61d9c700 1 --2- 172.21.15.17:0/3677267218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a42389f580 0x55a42389f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.917+0000 7f2a61d9c700 1 -- 172.21.15.17:0/3677267218 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a42361ed80 con 0x55a4236fb6b0 2023-07-14T13:12:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.917+0000 7f2a6159b700 1 --2- 172.21.15.17:0/3677267218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a42389f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.917+0000 7f2a60d9a700 1 --2- 172.21.15.17:0/3677267218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a42389f580 0x55a42389f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.917+0000 7f2a61d9c700 1 --2- 172.21.15.17:0/3677267218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4236fb6b0 0x55a4238a4d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2a5401a810 tx=0x7f2a5401a840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac56f6f9d188103c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.917+0000 7f2a61d9c700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2a480a1340 0x7f2a480a37f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2a5401ab90 tx=0x7f2a54011000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.918+0000 7f2a477fe700 1 -- 172.21.15.17:0/3677267218 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540092e0 con 0x55a4236fb6b0 2023-07-14T13:12:21.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.918+0000 7f2a477fe700 1 -- 172.21.15.17:0/3677267218 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a5400f040 con 0x55a4236fb6b0 2023-07-14T13:12:21.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.918+0000 7f2a477fe700 1 -- 172.21.15.17:0/3677267218 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54007ae0 con 0x55a4236fb6b0 2023-07-14T13:12:21.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.918+0000 7f2a77096b80 1 -- 172.21.15.17:0/3677267218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4236fb6b0 msgr2=0x55a4238a4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.919+0000 7f2a77096b80 1 --2- 172.21.15.17:0/3677267218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4236fb6b0 0x55a4238a4d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2a5401a810 tx=0x7f2a5401a840 comp rx=0 tx=0).stop 2023-07-14T13:12:21.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.919+0000 7f2a77096b80 1 -- 172.21.15.17:0/3677267218 shutdown_connections 2023-07-14T13:12:21.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.919+0000 7f2a77096b80 1 --2- 172.21.15.17:0/3677267218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a42389f580 0x55a42389f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.919+0000 7f2a77096b80 1 --2- 172.21.15.17:0/3677267218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4236fb6b0 0x55a4238a4d90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.919+0000 7f2a77096b80 1 --2- 172.21.15.17:0/3677267218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a42389f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.919+0000 7f2a77096b80 1 -- 172.21.15.17:0/3677267218 >> 172.21.15.17:0/3677267218 conn(0x55a423894be0 msgr2=0x55a423899f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:21.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.919+0000 7f2a77096b80 1 -- 172.21.15.17:0/3677267218 shutdown_connections 2023-07-14T13:12:21.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.919+0000 7f2a77096b80 1 -- 172.21.15.17:0/3677267218 wait complete. 2023-07-14T13:12:21.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.919+0000 7f2a77096b80 1 -- start start 2023-07-14T13:12:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.920+0000 7f2a77096b80 1 Processor -- start 2023-07-14T13:12:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.920+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 0x55a4238ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.920+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.920+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a4238a8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.920+0000 7f2a77096b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a423790a60 con 0x55a4236fb6b0 2023-07-14T13:12:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.920+0000 7f2a77096b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a423790760 con 0x55a42389f580 2023-07-14T13:12:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.920+0000 7f2a77096b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4236748c0 con 0x55a4238a52d0 2023-07-14T13:12:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.920+0000 7f2a77096b80 10 client.0 _ll_register_callbacks cb 0x55a42378e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.920+0000 7f2a6159b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 0x55a4238ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.920+0000 7f2a60d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.920+0000 7f2a60d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39602/0 (socket says 172.21.15.17:39602) 2023-07-14T13:12:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.921+0000 7f2a60d9a700 1 -- 172.21.15.17:0/2167414259 learned_addr learned my addr 172.21.15.17:0/2167414259 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.921+0000 7f2a61d9c700 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a4238a8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.921+0000 7f2a60d9a700 1 -- 172.21.15.17:0/2167414259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 msgr2=0x55a4238a8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:21.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.921+0000 7f2a60d9a700 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a4238a8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.921+0000 7f2a60d9a700 1 -- 172.21.15.17:0/2167414259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 msgr2=0x55a4238ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:21.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.921+0000 7f2a60d9a700 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 0x55a4238ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.921+0000 7f2a60d9a700 1 -- 172.21.15.17:0/2167414259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c009c90 con 0x55a42389f580 2023-07-14T13:12:21.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.921+0000 7f2a6159b700 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 0x55a4238ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:21.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.921+0000 7f2a61d9c700 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a4238a8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:21.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.921+0000 7f2a60d9a700 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a8810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c011d40 tx=0x7f2a4c00f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7431d6b8974a3a43 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.921+0000 7f2a44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:12:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.922+0000 7f2a44ff9700 1 -- 172.21.15.17:0/2167414259 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c016070 con 0x55a42389f580 2023-07-14T13:12:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.922+0000 7f2a44ff9700 1 -- 172.21.15.17:0/2167414259 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2a4c00fb80 con 0x55a42389f580 2023-07-14T13:12:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.922+0000 7f2a77096b80 1 -- 172.21.15.17:0/2167414259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a42374a490 con 0x55a42389f580 2023-07-14T13:12:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.922+0000 7f2a44ff9700 1 -- 172.21.15.17:0/2167414259 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a4c011300 con 0x55a42389f580 2023-07-14T13:12:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.922+0000 7f2a77096b80 10 client.27386 fetch_fsmap learned FSMap version 37 2023-07-14T13:12:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.922+0000 7f2a77096b80 1 -- 172.21.15.17:0/2167414259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f2a5c1a4cd0 con 0x55a42389f580 2023-07-14T13:12:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.922+0000 7f2a44ff9700 1 -- 172.21.15.17:0/2167414259 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a42374a490 con 0x55a42389f580 2023-07-14T13:12:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.922+0000 7f2a44ff9700 1 -- 172.21.15.17:0/2167414259 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2a4c01a3f0 con 0x55a42389f580 2023-07-14T13:12:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.923+0000 7f2a77096b80 10 client.27386 fetch_fsmap finished waiting for FSMap version 37 2023-07-14T13:12:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.923+0000 7f2a77096b80 10 client.27386 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.923+0000 7f2a77096b80 20 client.27386 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.923+0000 7f2a77096b80 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4238b8bd0 0x55a4238bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.923+0000 7f2a77096b80 4 client.27386 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:12:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.923+0000 7f2a77096b80 1 -- 172.21.15.17:0/2167414259 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4237e9e50 con 0x55a4238b8bd0 2023-07-14T13:12:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.923+0000 7f2a6159b700 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4238b8bd0 0x55a4238bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.923+0000 7f2a6159b700 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4238b8bd0 0x55a4238bafe0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec0e25c1796cb2b4 server_cookie=92152fed11a882e5 in_seq=0 out_seq=0 2023-07-14T13:12:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.923+0000 7f2a44ff9700 10 client.27386 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.924+0000 7f2a44ff9700 1 -- 172.21.15.17:0/2167414259 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a4237e9e50 con 0x55a4238b8bd0 2023-07-14T13:12:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.924+0000 7f2a44ff9700 10 client.27386 handle_command_reply: tid=0 2023-07-14T13:12:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.924+0000 7f2a77096b80 1 client.27386 shutdown 2023-07-14T13:12:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a77096b80 1 -- 172.21.15.17:0/2167414259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 msgr2=0x55a4238a8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a77096b80 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a8810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c011d40 tx=0x7f2a4c00f6a0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a77096b80 1 -- 172.21.15.17:0/2167414259 shutdown_connections 2023-07-14T13:12:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a77096b80 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a4238b8bd0 0x55a4238bafe0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a77096b80 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a4238a8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a77096b80 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 0x55a4238ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a77096b80 1 --2- 172.21.15.17:0/2167414259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a8810 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a44ff9700 0 client.27386 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a77096b80 1 -- 172.21.15.17:0/2167414259 >> 172.21.15.17:0/2167414259 conn(0x55a423894be0 msgr2=0x55a423898c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a77096b80 1 -- 172.21.15.17:0/2167414259 shutdown_connections 2023-07-14T13:12:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a77096b80 1 -- 172.21.15.17:0/2167414259 wait complete. 2023-07-14T13:12:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.925+0000 7f2a77096b80 20 client.27386 trim_cache size 0 max 16384 2023-07-14T13:12:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.941+0000 7f2a77096b80 1 Processor -- start 2023-07-14T13:12:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.941+0000 7f2a77096b80 1 -- start start 2023-07-14T13:12:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4236fb6b0 0x55a4238afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a42389f580 0x55a423899c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4238a52d0 0x55a4238ab020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a77096b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4238a58a0 con 0x55a42389f580 2023-07-14T13:12:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a77096b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a423896d00 con 0x55a4238a52d0 2023-07-14T13:12:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a77096b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4238a9e20 con 0x55a4236fb6b0 2023-07-14T13:12:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a6159b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4236fb6b0 0x55a4238afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a61d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4238a52d0 0x55a4238ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a6159b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4236fb6b0 0x55a4238afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35970/0 (socket says 172.21.15.17:35970) 2023-07-14T13:12:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a61d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4238a52d0 0x55a4238ab020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39614/0 (socket says 172.21.15.17:39614) 2023-07-14T13:12:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a6159b700 1 -- 172.21.15.17:0/2603967686 learned_addr learned my addr 172.21.15.17:0/2603967686 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a60d9a700 1 --2- 172.21.15.17:0/2603967686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a42389f580 0x55a423899c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a6159b700 1 -- 172.21.15.17:0/2603967686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4238a52d0 msgr2=0x55a4238ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a6159b700 1 --2- 172.21.15.17:0/2603967686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4238a52d0 0x55a4238ab020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a6159b700 1 -- 172.21.15.17:0/2603967686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a42389f580 msgr2=0x55a423899c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a6159b700 1 --2- 172.21.15.17:0/2603967686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a42389f580 0x55a423899c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.942+0000 7f2a6159b700 1 -- 172.21.15.17:0/2603967686 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a423896420 con 0x55a4236fb6b0 2023-07-14T13:12:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.943+0000 7f2a6159b700 1 --2- 172.21.15.17:0/2603967686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4236fb6b0 0x55a4238afc60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2a580cb760 tx=0x7f2a58005910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5192b5dc27797fdd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.943+0000 7f2a47fff700 1 -- 172.21.15.17:0/2603967686 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5809b110 con 0x55a4236fb6b0 2023-07-14T13:12:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.943+0000 7f2a47fff700 1 -- 172.21.15.17:0/2603967686 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a5809f140 con 0x55a4236fb6b0 2023-07-14T13:12:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.943+0000 7f2a47fff700 1 -- 172.21.15.17:0/2603967686 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58022a50 con 0x55a4236fb6b0 2023-07-14T13:12:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.944+0000 7f2a77096b80 1 -- 172.21.15.17:0/2603967686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4236fb6b0 msgr2=0x55a4238afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.944+0000 7f2a77096b80 1 --2- 172.21.15.17:0/2603967686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4236fb6b0 0x55a4238afc60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2a580cb760 tx=0x7f2a58005910 comp rx=0 tx=0).stop 2023-07-14T13:12:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.944+0000 7f2a77096b80 1 -- 172.21.15.17:0/2603967686 shutdown_connections 2023-07-14T13:12:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.944+0000 7f2a77096b80 1 --2- 172.21.15.17:0/2603967686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4238a52d0 0x55a4238ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.944+0000 7f2a77096b80 1 --2- 172.21.15.17:0/2603967686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4236fb6b0 0x55a4238afc60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.944+0000 7f2a77096b80 1 --2- 172.21.15.17:0/2603967686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a42389f580 0x55a423899c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.944+0000 7f2a77096b80 1 -- 172.21.15.17:0/2603967686 >> 172.21.15.17:0/2603967686 conn(0x55a423894be0 msgr2=0x55a4238a2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.944+0000 7f2a77096b80 1 -- 172.21.15.17:0/2603967686 shutdown_connections 2023-07-14T13:12:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.944+0000 7f2a77096b80 1 -- 172.21.15.17:0/2603967686 wait complete. 2023-07-14T13:12:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.944+0000 7f2a77096b80 1 -- start start 2023-07-14T13:12:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.944+0000 7f2a77096b80 1 Processor -- start 2023-07-14T13:12:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 0x55a4238afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a77096b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a4238a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a77096b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4238a13c0 con 0x55a4236fb6b0 2023-07-14T13:12:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a77096b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4238a1530 con 0x55a42389f580 2023-07-14T13:12:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a77096b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4238a16f0 con 0x55a4238a52d0 2023-07-14T13:12:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a77096b80 10 client.0 _ll_register_callbacks cb 0x7f2a4c011840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a60d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a6159b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 0x55a4238afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a60d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39626/0 (socket says 172.21.15.17:39626) 2023-07-14T13:12:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a60d9a700 1 -- 172.21.15.17:0/1117420155 learned_addr learned my addr 172.21.15.17:0/1117420155 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.945+0000 7f2a61d9c700 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a4238a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.946+0000 7f2a60d9a700 1 -- 172.21.15.17:0/1117420155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 msgr2=0x55a4238a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.946+0000 7f2a60d9a700 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a4238a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.946+0000 7f2a60d9a700 1 -- 172.21.15.17:0/1117420155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 msgr2=0x55a4238afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.946+0000 7f2a60d9a700 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 0x55a4238afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.946+0000 7f2a60d9a700 1 -- 172.21.15.17:0/1117420155 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c198760 con 0x55a42389f580 2023-07-14T13:12:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.946+0000 7f2a6159b700 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 0x55a4238afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.946+0000 7f2a60d9a700 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a0790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55a4238947a0 tx=0x7f2a4c01ac20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d9e1ffcda1612f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.946+0000 7f2a44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:12:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a44ff9700 1 -- 172.21.15.17:0/1117420155 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c016070 con 0x55a42389f580 2023-07-14T13:12:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a44ff9700 1 -- 172.21.15.17:0/1117420155 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2a4c000e40 con 0x55a42389f580 2023-07-14T13:12:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a77096b80 1 -- 172.21.15.17:0/1117420155 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a5400f040 con 0x55a42389f580 2023-07-14T13:12:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a44ff9700 1 -- 172.21.15.17:0/1117420155 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a4c0050e0 con 0x55a42389f580 2023-07-14T13:12:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a77096b80 10 client.27392 fetch_fsmap learned FSMap version 37 2023-07-14T13:12:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a77096b80 1 -- 172.21.15.17:0/1117420155 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f2a5401a440 con 0x55a42389f580 2023-07-14T13:12:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a44ff9700 1 -- 172.21.15.17:0/1117420155 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a5400f040 con 0x55a42389f580 2023-07-14T13:12:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a44ff9700 1 -- 172.21.15.17:0/1117420155 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2a4c003980 con 0x55a42389f580 2023-07-14T13:12:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a77096b80 10 client.27392 fetch_fsmap finished waiting for FSMap version 37 2023-07-14T13:12:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a77096b80 10 client.27392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a77096b80 20 client.27392 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a77096b80 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a42390d180 0x55a42390f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a77096b80 4 client.27392 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:12:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.947+0000 7f2a77096b80 1 -- 172.21.15.17:0/1117420155 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a4237abff0 con 0x55a42390d180 2023-07-14T13:12:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.948+0000 7f2a6159b700 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a42390d180 0x55a42390f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.948+0000 7f2a6159b700 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a42390d180 0x55a42390f590 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=363d3d0e83f2cca0 server_cookie=33783c5ee7a6c88e in_seq=0 out_seq=0 2023-07-14T13:12:21.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.948+0000 7f2a44ff9700 10 client.27392 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a44ff9700 1 -- 172.21.15.17:0/1117420155 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a4237abff0 con 0x55a42390d180 2023-07-14T13:12:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a44ff9700 10 client.27392 handle_command_reply: tid=0 2023-07-14T13:12:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 1 client.27392 shutdown 2023-07-14T13:12:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 1 -- 172.21.15.17:0/1117420155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 msgr2=0x55a4238a0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a0790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55a4238947a0 tx=0x7f2a4c01ac20 comp rx=0 tx=0).stop 2023-07-14T13:12:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 1 -- 172.21.15.17:0/1117420155 shutdown_connections 2023-07-14T13:12:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a42390d180 0x55a42390f590 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4238a52d0 0x55a4238a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4236fb6b0 0x55a4238afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 1 --2- 172.21.15.17:0/1117420155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a42389f580 0x55a4238a0790 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a44ff9700 0 client.27392 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 1 -- 172.21.15.17:0/1117420155 >> 172.21.15.17:0/1117420155 conn(0x55a423894be0 msgr2=0x55a4238a5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 1 -- 172.21.15.17:0/1117420155 shutdown_connections 2023-07-14T13:12:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 1 -- 172.21.15.17:0/1117420155 wait complete. 2023-07-14T13:12:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.965+0000 7f2a77096b80 20 client.27392 trim_cache size 0 max 16384 2023-07-14T13:12:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:12:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:12:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:12:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:12:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 -- 172.21.15.17:0/972244410 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2a480a1340 msgr2=0x7f2a480a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2a480a1340 0x7f2a480a37f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2a5401ab90 tx=0x7f2a54011000 comp rx=0 tx=0).stop 2023-07-14T13:12:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 -- 172.21.15.17:0/972244410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a5c0679a0 msgr2=0x7f2a5c19dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a5c0679a0 0x7f2a5c19dce0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2a58005740 tx=0x7f2a58005770 comp rx=0 tx=0).stop 2023-07-14T13:12:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 -- 172.21.15.17:0/972244410 shutdown_connections 2023-07-14T13:12:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2a480a1340 0x7f2a480a37f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c10c540 0x7f2a5c197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a5c0679a0 0x7f2a5c19dce0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 --2- 172.21.15.17:0/972244410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a5c0682b0 0x7f2a5c19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 -- 172.21.15.17:0/972244410 >> 172.21.15.17:0/972244410 conn(0x7f2a5c074760 msgr2=0x7f2a5c0fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 -- 172.21.15.17:0/972244410 shutdown_connections 2023-07-14T13:12:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:21.966+0000 7f2a637ff700 1 -- 172.21.15.17:0/972244410 wait complete. 2023-07-14T13:12:22.430 INFO:teuthology.orchestra.run.smithi017.stderr:49900000 of 50000000 tuples (99%) done (elapsed 732.03 s, remaining 1.47 s) 2023-07-14T13:12:23.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:23 smithi135 ceph-mon[97338]: pgmap v396: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 25 MiB/s wr, 69 op/s 2023-07-14T13:12:23.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:23 smithi131 ceph-mon[96953]: pgmap v396: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 25 MiB/s wr, 69 op/s 2023-07-14T13:12:23.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:23 smithi017 ceph-mon[95536]: pgmap v396: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 25 MiB/s wr, 69 op/s 2023-07-14T13:12:24.788 INFO:teuthology.orchestra.run.smithi017.stderr:50000000 of 50000000 tuples (100%) done (elapsed 734.39 s, remaining 0.00 s) 2023-07-14T13:12:24.952 INFO:teuthology.orchestra.run.smithi017.stderr:vacuum... 2023-07-14T13:12:25.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:25 smithi135 ceph-mon[97338]: pgmap v397: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 25 MiB/s wr, 69 op/s 2023-07-14T13:12:25.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:25 smithi131 ceph-mon[96953]: pgmap v397: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 25 MiB/s wr, 69 op/s 2023-07-14T13:12:25.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:25 smithi017 ceph-mon[95536]: pgmap v397: 97 pgs: 97 active+clean; 9.5 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 25 MiB/s wr, 69 op/s 2023-07-14T13:12:27.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:27 smithi135 ceph-mon[97338]: pgmap v398: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 21 MiB/s wr, 71 op/s 2023-07-14T13:12:27.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:27 smithi131 ceph-mon[96953]: pgmap v398: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 21 MiB/s wr, 71 op/s 2023-07-14T13:12:27.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:27 smithi017 ceph-mon[95536]: pgmap v398: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 21 MiB/s wr, 71 op/s 2023-07-14T13:12:29.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:29 smithi135 ceph-mon[97338]: pgmap v399: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 18 MiB/s wr, 59 op/s 2023-07-14T13:12:29.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:29 smithi131 ceph-mon[96953]: pgmap v399: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 18 MiB/s wr, 59 op/s 2023-07-14T13:12:29.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:29 smithi017 ceph-mon[95536]: pgmap v399: 97 pgs: 97 active+clean; 9.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 18 MiB/s wr, 59 op/s 2023-07-14T13:12:30.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:30 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:12:30.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:30 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:12:30.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:30 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:12:31.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:31 smithi135 ceph-mon[97338]: pgmap v400: 97 pgs: 97 active+clean; 9.7 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-07-14T13:12:31.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:31 smithi131 ceph-mon[96953]: pgmap v400: 97 pgs: 97 active+clean; 9.7 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-07-14T13:12:31.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:31 smithi017 ceph-mon[95536]: pgmap v400: 97 pgs: 97 active+clean; 9.7 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 26 MiB/s wr, 69 op/s 2023-07-14T13:12:33.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:33 smithi135 ceph-mon[97338]: pgmap v401: 97 pgs: 97 active+clean; 9.7 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 22 MiB/s wr, 49 op/s 2023-07-14T13:12:33.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:33 smithi131 ceph-mon[96953]: pgmap v401: 97 pgs: 97 active+clean; 9.7 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 22 MiB/s wr, 49 op/s 2023-07-14T13:12:33.592 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:12:33.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:33 smithi017 ceph-mon[95536]: pgmap v401: 97 pgs: 97 active+clean; 9.7 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 22 MiB/s wr, 49 op/s 2023-07-14T13:12:33.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.796+0000 7fe64bfff700 1 -- 172.21.15.17:0/1569042825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe644106fb0 msgr2=0x7fe64410eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.796+0000 7fe64bfff700 1 --2- 172.21.15.17:0/1569042825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe644106fb0 0x7fe64410eb80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00b0d0 tx=0x7fe63c00b3e0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.796+0000 7fe64bfff700 1 -- 172.21.15.17:0/1569042825 shutdown_connections 2023-07-14T13:12:33.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.796+0000 7fe64bfff700 1 --2- 172.21.15.17:0/1569042825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe644106fb0 0x7fe64410eb80 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.796+0000 7fe64bfff700 1 --2- 172.21.15.17:0/1569042825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644101f70 0x7fe644102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.796+0000 7fe64bfff700 1 --2- 172.21.15.17:0/1569042825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe644102910 0x7fe6441068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.796+0000 7fe64bfff700 1 -- 172.21.15.17:0/1569042825 >> 172.21.15.17:0/1569042825 conn(0x7fe6440fd7e0 msgr2=0x7fe6440ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:33.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.796+0000 7fe64bfff700 1 -- 172.21.15.17:0/1569042825 shutdown_connections 2023-07-14T13:12:33.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.796+0000 7fe64bfff700 1 -- 172.21.15.17:0/1569042825 wait complete. 2023-07-14T13:12:33.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.797+0000 7fe64bfff700 1 Processor -- start 2023-07-14T13:12:33.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.797+0000 7fe64bfff700 1 -- start start 2023-07-14T13:12:33.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe64bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe644101f70 0x7fe644197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe64bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644102910 0x7fe6441983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe64bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe644106fb0 0x7fe64419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe64bfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64419ce50 con 0x7fe644101f70 2023-07-14T13:12:33.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe64bfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64419cfc0 con 0x7fe644102910 2023-07-14T13:12:33.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe64bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64419d180 con 0x7fe644106fb0 2023-07-14T13:12:33.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe649d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe644101f70 0x7fe644197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe649d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe644101f70 0x7fe644197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56310/0 (socket says 172.21.15.17:56310) 2023-07-14T13:12:33.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe649d9b700 1 -- 172.21.15.17:0/118356783 learned_addr learned my addr 172.21.15.17:0/118356783 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:33.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe64959a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644102910 0x7fe6441983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe64a59c700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe644106fb0 0x7fe64419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe649d9b700 1 -- 172.21.15.17:0/118356783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe644106fb0 msgr2=0x7fe64419c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe649d9b700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe644106fb0 0x7fe64419c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe649d9b700 1 -- 172.21.15.17:0/118356783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644102910 msgr2=0x7fe6441983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe649d9b700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644102910 0x7fe6441983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe649d9b700 1 -- 172.21.15.17:0/118356783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c009d00 con 0x7fe644101f70 2023-07-14T13:12:33.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.798+0000 7fe64959a700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644102910 0x7fe6441983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:33.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.799+0000 7fe649d9b700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe644101f70 0x7fe644197e70 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe64000e9a0 tx=0x7fe64000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.799+0000 7fe63affd700 1 -- 172.21.15.17:0/118356783 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640009790 con 0x7fe644101f70 2023-07-14T13:12:33.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.799+0000 7fe64bfff700 1 -- 172.21.15.17:0/118356783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64419d460 con 0x7fe644101f70 2023-07-14T13:12:33.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.799+0000 7fe63affd700 1 -- 172.21.15.17:0/118356783 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe640010430 con 0x7fe644101f70 2023-07-14T13:12:33.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.799+0000 7fe63affd700 1 -- 172.21.15.17:0/118356783 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64000cea0 con 0x7fe644101f70 2023-07-14T13:12:33.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.799+0000 7fe64bfff700 1 -- 172.21.15.17:0/118356783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6441a4ca0 con 0x7fe644101f70 2023-07-14T13:12:33.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.803+0000 7fe63affd700 1 -- 172.21.15.17:0/118356783 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe6400105a0 con 0x7fe644101f70 2023-07-14T13:12:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.804+0000 7fe65f9f4b80 1 Processor -- start 2023-07-14T13:12:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.805+0000 7fe65f9f4b80 1 -- start start 2023-07-14T13:12:33.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.805+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.805+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b4be0 0x55c03f4bf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.805+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 0x55c03f4c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.805+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f3bacb0 con 0x55c03f4b4be0 2023-07-14T13:12:33.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.805+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f40da40 con 0x55c03f4bfad0 2023-07-14T13:12:33.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.805+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f406ed0 con 0x55c03f4b42d0 2023-07-14T13:12:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe64a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe64a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52276/0 (socket says 172.21.15.17:52276) 2023-07-14T13:12:33.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe64a59c700 1 -- 172.21.15.17:0/3324488337 learned_addr learned my addr 172.21.15.17:0/3324488337 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:33.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe649d9b700 1 --2- 172.21.15.17:0/3324488337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b4be0 0x55c03f4bf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe64959a700 1 --2- 172.21.15.17:0/3324488337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 0x55c03f4c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe63affd700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe6300a1340 0x7fe6300a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe64a59c700 1 -- 172.21.15.17:0/3324488337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 msgr2=0x55c03f4c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe64a59c700 1 --2- 172.21.15.17:0/3324488337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 0x55c03f4c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe63affd700 1 -- 172.21.15.17:0/118356783 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe640014070 con 0x7fe644101f70 2023-07-14T13:12:33.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe64a59c700 1 -- 172.21.15.17:0/3324488337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b4be0 msgr2=0x55c03f4bf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe64a59c700 1 --2- 172.21.15.17:0/3324488337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b4be0 0x55c03f4bf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe64a59c700 1 -- 172.21.15.17:0/3324488337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c03f234de0 con 0x55c03f4b42d0 2023-07-14T13:12:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.806+0000 7fe64a59c700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe6300a1340 0x7fe6300a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.855 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.807+0000 7fe64959a700 1 --2- 172.21.15.17:0/3324488337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 0x55c03f4c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:33.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.807+0000 7fe64a59c700 1 --2- 172.21.15.17:0/3324488337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4b46a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009410 tx=0x7fe63c009440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58ab1a192fd1f96c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.807+0000 7fe62ffff700 1 -- 172.21.15.17:0/3324488337 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c00e040 con 0x55c03f4b42d0 2023-07-14T13:12:33.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.807+0000 7fe62ffff700 1 -- 172.21.15.17:0/3324488337 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe63c003e90 con 0x55c03f4b42d0 2023-07-14T13:12:33.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.807+0000 7fe62ffff700 1 -- 172.21.15.17:0/3324488337 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0052d0 con 0x55c03f4b42d0 2023-07-14T13:12:33.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.807+0000 7fe64a59c700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe6300a1340 0x7fe6300a37f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe63c02a000 tx=0x7fe63c02b000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.808+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3324488337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 msgr2=0x55c03f4b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.808+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/3324488337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4b46a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009410 tx=0x7fe63c009440 comp rx=0 tx=0).stop 2023-07-14T13:12:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.808+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3324488337 shutdown_connections 2023-07-14T13:12:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.808+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/3324488337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 0x55c03f4c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.808+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/3324488337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4b46a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.808+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/3324488337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b4be0 0x55c03f4bf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.808+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3324488337 >> 172.21.15.17:0/3324488337 conn(0x55c03f4aada0 msgr2=0x55c03f4b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:33.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.808+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3324488337 shutdown_connections 2023-07-14T13:12:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.808+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3324488337 wait complete. 2023-07-14T13:12:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.809+0000 7fe65f9f4b80 1 -- start start 2023-07-14T13:12:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.809+0000 7fe65f9f4b80 1 Processor -- start 2023-07-14T13:12:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.809+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b42d0 0x55c03f4bf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.809+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b4be0 0x55c03f4bc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.809+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4bfad0 0x55c03f4bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.858 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.809+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f3a6ac0 con 0x55c03f4b4be0 2023-07-14T13:12:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.809+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f3a67c0 con 0x55c03f4b42d0 2023-07-14T13:12:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.809+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f28a920 con 0x55c03f4bfad0 2023-07-14T13:12:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.810+0000 7fe65f9f4b80 10 client.0 _ll_register_callbacks cb 0x55c03f3a4760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.810+0000 7fe64959a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b4be0 0x55c03f4bc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.810+0000 7fe649d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b42d0 0x55c03f4bf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.810+0000 7fe649d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b42d0 0x55c03f4bf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49468/0 (socket says 172.21.15.17:49468) 2023-07-14T13:12:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.810+0000 7fe649d9b700 1 -- 172.21.15.17:0/3692082291 learned_addr learned my addr 172.21.15.17:0/3692082291 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:33.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.810+0000 7fe64a59c700 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4bfad0 0x55c03f4bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.810+0000 7fe649d9b700 1 -- 172.21.15.17:0/3692082291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4bfad0 msgr2=0x55c03f4bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.810+0000 7fe649d9b700 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4bfad0 0x55c03f4bcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.810+0000 7fe649d9b700 1 -- 172.21.15.17:0/3692082291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b4be0 msgr2=0x55c03f4bc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.810+0000 7fe649d9b700 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b4be0 0x55c03f4bc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.810+0000 7fe649d9b700 1 -- 172.21.15.17:0/3692082291 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe634007b90 con 0x55c03f4b42d0 2023-07-14T13:12:33.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.811+0000 7fe649d9b700 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b42d0 0x55c03f4bf530 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe64000e970 tx=0x7fe640096020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca278dd52d065e6b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.811+0000 7fe62d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:12:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.811+0000 7fe62d7fa700 1 -- 172.21.15.17:0/3692082291 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640099f50 con 0x55c03f4b42d0 2023-07-14T13:12:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.811+0000 7fe62d7fa700 1 -- 172.21.15.17:0/3692082291 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe64009df80 con 0x55c03f4b42d0 2023-07-14T13:12:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.811+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3692082291 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c03f3604f0 con 0x55c03f4b42d0 2023-07-14T13:12:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.811+0000 7fe62d7fa700 1 -- 172.21.15.17:0/3692082291 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6400a23a0 con 0x55c03f4b42d0 2023-07-14T13:12:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.811+0000 7fe65f9f4b80 10 client.27404 fetch_fsmap learned FSMap version 38 2023-07-14T13:12:33.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.811+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3692082291 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7fe64410f3c0 con 0x55c03f4b42d0 2023-07-14T13:12:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.811+0000 7fe62d7fa700 1 -- 172.21.15.17:0/3692082291 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c03f3604f0 con 0x55c03f4b42d0 2023-07-14T13:12:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.812+0000 7fe62d7fa700 1 -- 172.21.15.17:0/3692082291 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 38) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fe6400cad20 con 0x55c03f4b42d0 2023-07-14T13:12:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.812+0000 7fe65f9f4b80 10 client.27404 fetch_fsmap finished waiting for FSMap version 38 2023-07-14T13:12:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.812+0000 7fe65f9f4b80 10 client.27404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.812+0000 7fe65f9f4b80 20 client.27404 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.812+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c03f4cf340 0x55c03f4d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.812+0000 7fe65f9f4b80 4 client.27404 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:12:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.812+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3692082291 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c03f3ffeb0 con 0x55c03f4cf340 2023-07-14T13:12:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.812+0000 7fe64959a700 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c03f4cf340 0x55c03f4d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.813+0000 7fe64959a700 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c03f4cf340 0x55c03f4d1750 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=928810fbfc083eb1 server_cookie=f8ffb607d41487dc in_seq=0 out_seq=0 2023-07-14T13:12:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.813+0000 7fe62d7fa700 10 client.27404 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.813+0000 7fe62d7fa700 1 -- 172.21.15.17:0/3692082291 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c03f3ffeb0 con 0x55c03f4cf340 2023-07-14T13:12:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.813+0000 7fe62d7fa700 10 client.27404 handle_command_reply: tid=0 2023-07-14T13:12:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 1 client.27404 shutdown 2023-07-14T13:12:33.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3692082291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b42d0 msgr2=0x55c03f4bf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b42d0 0x55c03f4bf530 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe64000e970 tx=0x7fe640096020 comp rx=0 tx=0).stop 2023-07-14T13:12:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3692082291 shutdown_connections 2023-07-14T13:12:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c03f4cf340 0x55c03f4d1750 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4bfad0 0x55c03f4bcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b42d0 0x55c03f4bf530 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/3692082291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b4be0 0x55c03f4bc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe62d7fa700 0 client.27404 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3692082291 >> 172.21.15.17:0/3692082291 conn(0x55c03f4aada0 msgr2=0x55c03f4b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3692082291 shutdown_connections 2023-07-14T13:12:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/3692082291 wait complete. 2023-07-14T13:12:33.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.814+0000 7fe65f9f4b80 20 client.27404 trim_cache size 0 max 16384 2023-07-14T13:12:33.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.834+0000 7fe65f9f4b80 1 Processor -- start 2023-07-14T13:12:33.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.834+0000 7fe65f9f4b80 1 -- start start 2023-07-14T13:12:33.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.835+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.835+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b4be0 0x55c03f4bf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.835+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4bfad0 0x55c03f4bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.835+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f4b5e00 con 0x55c03f4bfad0 2023-07-14T13:12:33.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.835+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f4bd4f0 con 0x55c03f4b4be0 2023-07-14T13:12:33.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.835+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f4c6a50 con 0x55c03f4b42d0 2023-07-14T13:12:33.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.835+0000 7fe649d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.835+0000 7fe649d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52286/0 (socket says 172.21.15.17:52286) 2023-07-14T13:12:33.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.835+0000 7fe649d9b700 1 -- 172.21.15.17:0/1037571582 learned_addr learned my addr 172.21.15.17:0/1037571582 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:33.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.835+0000 7fe64959a700 1 --2- 172.21.15.17:0/1037571582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b4be0 0x55c03f4bf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.835+0000 7fe64a59c700 1 --2- 172.21.15.17:0/1037571582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4bfad0 0x55c03f4bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.836+0000 7fe649d9b700 1 -- 172.21.15.17:0/1037571582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b4be0 msgr2=0x55c03f4bf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:33.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.836+0000 7fe649d9b700 1 --2- 172.21.15.17:0/1037571582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b4be0 0x55c03f4bf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.836+0000 7fe649d9b700 1 -- 172.21.15.17:0/1037571582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4bfad0 msgr2=0x55c03f4bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:33.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.836+0000 7fe649d9b700 1 --2- 172.21.15.17:0/1037571582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4bfad0 0x55c03f4bc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.836+0000 7fe649d9b700 1 -- 172.21.15.17:0/1037571582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c03f21dc60 con 0x55c03f4b42d0 2023-07-14T13:12:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.836+0000 7fe649d9b700 1 --2- 172.21.15.17:0/1037571582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6510 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe640096970 tx=0x7fe640005b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f511f0b2855eb89d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.836+0000 7fe638ff9700 1 -- 172.21.15.17:0/1037571582 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6400056d0 con 0x55c03f4b42d0 2023-07-14T13:12:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.836+0000 7fe638ff9700 1 -- 172.21.15.17:0/1037571582 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe640099a90 con 0x55c03f4b42d0 2023-07-14T13:12:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.836+0000 7fe638ff9700 1 -- 172.21.15.17:0/1037571582 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640099680 con 0x55c03f4b42d0 2023-07-14T13:12:33.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.837+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/1037571582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 msgr2=0x55c03f4c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.837+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/1037571582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6510 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe640096970 tx=0x7fe640005b40 comp rx=0 tx=0).stop 2023-07-14T13:12:33.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.837+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/1037571582 shutdown_connections 2023-07-14T13:12:33.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.837+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/1037571582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4bfad0 0x55c03f4bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.837+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/1037571582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6510 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.837+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/1037571582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4b4be0 0x55c03f4bf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.837+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/1037571582 >> 172.21.15.17:0/1037571582 conn(0x55c03f4aada0 msgr2=0x55c03f4b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:33.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.837+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/1037571582 shutdown_connections 2023-07-14T13:12:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.837+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/1037571582 wait complete. 2023-07-14T13:12:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.838+0000 7fe65f9f4b80 1 -- start start 2023-07-14T13:12:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.838+0000 7fe65f9f4b80 1 Processor -- start 2023-07-14T13:12:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b4be0 0x55c03f4c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe65f9f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 0x55c03f4c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f4c3370 con 0x55c03f4b42d0 2023-07-14T13:12:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f4c34e0 con 0x55c03f4bfad0 2023-07-14T13:12:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe65f9f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c03f523200 con 0x55c03f4b4be0 2023-07-14T13:12:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe65f9f4b80 10 client.0 _ll_register_callbacks cb 0x7fe640099d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe649d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe649d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56358/0 (socket says 172.21.15.17:56358) 2023-07-14T13:12:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe649d9b700 1 -- 172.21.15.17:0/490234198 learned_addr learned my addr 172.21.15.17:0/490234198 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe64959a700 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b4be0 0x55c03f4c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe64a59c700 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 0x55c03f4c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe649d9b700 1 -- 172.21.15.17:0/490234198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b4be0 msgr2=0x55c03f4c26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe649d9b700 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b4be0 0x55c03f4c26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe649d9b700 1 -- 172.21.15.17:0/490234198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 msgr2=0x55c03f4c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe649d9b700 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 0x55c03f4c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe649d9b700 1 -- 172.21.15.17:0/490234198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64410f3c0 con 0x55c03f4b42d0 2023-07-14T13:12:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.839+0000 7fe64a59c700 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 0x55c03f4c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:12:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.840+0000 7fe649d9b700 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6320 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe6400969c0 tx=0x7fe640099800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1439e18677235ac7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.840+0000 7fe62d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:12:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.840+0000 7fe62d7fa700 1 -- 172.21.15.17:0/490234198 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64009df80 con 0x55c03f4b42d0 2023-07-14T13:12:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.840+0000 7fe62d7fa700 1 -- 172.21.15.17:0/490234198 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe6400a2170 con 0x55c03f4b42d0 2023-07-14T13:12:33.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.840+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/490234198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe63c003e90 con 0x55c03f4b42d0 2023-07-14T13:12:33.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.840+0000 7fe62d7fa700 1 -- 172.21.15.17:0/490234198 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6400a23a0 con 0x55c03f4b42d0 2023-07-14T13:12:33.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.840+0000 7fe65f9f4b80 10 client.17682 fetch_fsmap learned FSMap version 38 2023-07-14T13:12:33.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.840+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/490234198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55c03f25b250 con 0x55c03f4b42d0 2023-07-14T13:12:33.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.841+0000 7fe62d7fa700 1 -- 172.21.15.17:0/490234198 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe63c003e90 con 0x55c03f4b42d0 2023-07-14T13:12:33.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.841+0000 7fe62d7fa700 1 -- 172.21.15.17:0/490234198 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 38) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fe640095d40 con 0x55c03f4b42d0 2023-07-14T13:12:33.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.841+0000 7fe65f9f4b80 10 client.17682 fetch_fsmap finished waiting for FSMap version 38 2023-07-14T13:12:33.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.841+0000 7fe65f9f4b80 10 client.17682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:33.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.841+0000 7fe65f9f4b80 20 client.17682 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:33.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.841+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c03f524410 0x55c03f5267f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:33.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.841+0000 7fe65f9f4b80 4 client.17682 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:12:33.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.841+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/490234198 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c03f3c2050 con 0x55c03f524410 2023-07-14T13:12:33.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.841+0000 7fe64959a700 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c03f524410 0x55c03f5267f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:33.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.842+0000 7fe64959a700 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c03f524410 0x55c03f5267f0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fcbab32897c0f04 server_cookie=eddf9d0630038ac in_seq=0 out_seq=0 2023-07-14T13:12:33.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.842+0000 7fe62d7fa700 10 client.17682 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:33.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.842+0000 7fe62d7fa700 1 -- 172.21.15.17:0/490234198 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c03f3c2050 con 0x55c03f524410 2023-07-14T13:12:33.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.842+0000 7fe62d7fa700 10 client.17682 handle_command_reply: tid=0 2023-07-14T13:12:33.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.842+0000 7fe65f9f4b80 1 client.17682 shutdown 2023-07-14T13:12:33.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/490234198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b42d0 msgr2=0x55c03f4c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6320 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe6400969c0 tx=0x7fe640099800 comp rx=0 tx=0).stop 2023-07-14T13:12:33.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/490234198 shutdown_connections 2023-07-14T13:12:33.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c03f524410 0x55c03f5267f0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c03f4bfad0 0x55c03f4c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c03f4b42d0 0x55c03f4c6320 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe65f9f4b80 1 --2- 172.21.15.17:0/490234198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c03f4b4be0 0x55c03f4c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/490234198 >> 172.21.15.17:0/490234198 conn(0x55c03f4aada0 msgr2=0x55c03f4bc050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:33.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe62d7fa700 0 client.17682 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:33.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/490234198 shutdown_connections 2023-07-14T13:12:33.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe65f9f4b80 1 -- 172.21.15.17:0/490234198 wait complete. 2023-07-14T13:12:33.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.843+0000 7fe65f9f4b80 20 client.17682 trim_cache size 0 max 16384 2023-07-14T13:12:33.889 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:12:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:12:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:12:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:12:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:12:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:12:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:12:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:12:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:12:33.891 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:12:33.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 -- 172.21.15.17:0/118356783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe6300a1340 msgr2=0x7fe6300a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe6300a1340 0x7fe6300a37f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe63c02a000 tx=0x7fe63c02b000 comp rx=0 tx=0).stop 2023-07-14T13:12:33.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 -- 172.21.15.17:0/118356783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe644101f70 msgr2=0x7fe644197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:33.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe644101f70 0x7fe644197e70 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe64000e9a0 tx=0x7fe64000ecb0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 -- 172.21.15.17:0/118356783 shutdown_connections 2023-07-14T13:12:33.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe6300a1340 0x7fe6300a37f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe644106fb0 0x7fe64419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe644101f70 0x7fe644197e70 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 --2- 172.21.15.17:0/118356783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe644102910 0x7fe6441983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:33.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 -- 172.21.15.17:0/118356783 >> 172.21.15.17:0/118356783 conn(0x7fe6440fd7e0 msgr2=0x7fe6440fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:33.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 -- 172.21.15.17:0/118356783 shutdown_connections 2023-07-14T13:12:33.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:12:33.844+0000 7fe64bfff700 1 -- 172.21.15.17:0/118356783 wait complete. 2023-07-14T13:12:33.902 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:12:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.141+0000 7f28487ff700 1 -- 172.21.15.17:0/2218385308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2840067c10 msgr2=0x7f2840067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.141+0000 7f28487ff700 1 --2- 172.21.15.17:0/2218385308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2840067c10 0x7f2840067fe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f283c009920 tx=0x7f283c009c30 comp rx=0 tx=0).stop 2023-07-14T13:12:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.141+0000 7f28487ff700 1 -- 172.21.15.17:0/2218385308 shutdown_connections 2023-07-14T13:12:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.141+0000 7f28487ff700 1 --2- 172.21.15.17:0/2218385308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2840104e50 0x7f284010ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.141+0000 7f28487ff700 1 --2- 172.21.15.17:0/2218385308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2840067c10 0x7f2840067fe0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.141+0000 7f28487ff700 1 --2- 172.21.15.17:0/2218385308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28400685b0 0x7f2840104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.141+0000 7f28487ff700 1 -- 172.21.15.17:0/2218385308 >> 172.21.15.17:0/2218385308 conn(0x7f2840074760 msgr2=0x7f2840074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.141+0000 7f28487ff700 1 -- 172.21.15.17:0/2218385308 shutdown_connections 2023-07-14T13:12:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.141+0000 7f28487ff700 1 -- 172.21.15.17:0/2218385308 wait complete. 2023-07-14T13:12:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.143+0000 7f28487ff700 1 Processor -- start 2023-07-14T13:12:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.143+0000 7f28487ff700 1 -- start start 2023-07-14T13:12:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.143+0000 7f28487ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2840067c10 0x7f284019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.143+0000 7f28487ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28400685b0 0x7f284019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.143+0000 7f28487ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2840104e50 0x7f2840195a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.143+0000 7f28487ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2840196070 con 0x7f2840104e50 2023-07-14T13:12:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.143+0000 7f28487ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28401961e0 con 0x7f2840067c10 2023-07-14T13:12:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.143+0000 7f28487ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28401963a0 con 0x7f28400685b0 2023-07-14T13:12:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.144+0000 7f284659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2840067c10 0x7f284019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.144+0000 7f284659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2840067c10 0x7f284019bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59022/0 (socket says 172.21.15.17:59022) 2023-07-14T13:12:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.144+0000 7f284659b700 1 -- 172.21.15.17:0/1917396628 learned_addr learned my addr 172.21.15.17:0/1917396628 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.144+0000 7f2846d9c700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2840104e50 0x7f2840195a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.144+0000 7f284659b700 1 -- 172.21.15.17:0/1917396628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28400685b0 msgr2=0x7f284019c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.144+0000 7f284659b700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28400685b0 0x7f284019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.144+0000 7f284659b700 1 -- 172.21.15.17:0/1917396628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2840104e50 msgr2=0x7f2840195a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.144+0000 7f284659b700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2840104e50 0x7f2840195a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.144+0000 7f284659b700 1 -- 172.21.15.17:0/1917396628 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2838009d00 con 0x7f2840067c10 2023-07-14T13:12:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.145+0000 7f284659b700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2840067c10 0x7f284019bba0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f283c009840 tx=0x7f283c00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.145+0000 7f28377fe700 1 -- 172.21.15.17:0/1917396628 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c01c070 con 0x7f2840067c10 2023-07-14T13:12:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.145+0000 7f28487ff700 1 -- 172.21.15.17:0/1917396628 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c009520 con 0x7f2840067c10 2023-07-14T13:12:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.145+0000 7f28377fe700 1 -- 172.21.15.17:0/1917396628 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f283c00baf0 con 0x7f2840067c10 2023-07-14T13:12:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.145+0000 7f28377fe700 1 -- 172.21.15.17:0/1917396628 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0038e0 con 0x7f2840067c10 2023-07-14T13:12:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.145+0000 7f28487ff700 1 -- 172.21.15.17:0/1917396628 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2840196860 con 0x7f2840067c10 2023-07-14T13:12:35.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.150+0000 7f28377fe700 1 -- 172.21.15.17:0/1917396628 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f283c020030 con 0x7f2840067c10 2023-07-14T13:12:35.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.151+0000 7f285c037b80 1 Processor -- start 2023-07-14T13:12:35.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.152+0000 7f285c037b80 1 -- start start 2023-07-14T13:12:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.152+0000 7f285c037b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 0x56332bfa1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.152+0000 7f285c037b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 0x56332bf9c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.152+0000 7f285c037b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bf9c580 0x56332bf9c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.152+0000 7f285c037b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332bea1c50 con 0x56332bdf86b0 2023-07-14T13:12:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.152+0000 7f285c037b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332bef49e0 con 0x56332bf9c580 2023-07-14T13:12:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.152+0000 7f285c037b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332beede70 con 0x56332bfa22d0 2023-07-14T13:12:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f284659b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 0x56332bf9c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f2846d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 0x56332bfa1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f284659b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 0x56332bf9c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44994/0 (socket says 172.21.15.17:44994) 2023-07-14T13:12:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f284659b700 1 -- 172.21.15.17:0/2751105000 learned_addr learned my addr 172.21.15.17:0/2751105000 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f2845d9a700 1 --2- 172.21.15.17:0/2751105000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bf9c580 0x56332bf9c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f28377fe700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f282c0a12c0 0x7f282c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f284659b700 1 -- 172.21.15.17:0/2751105000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bf9c580 msgr2=0x56332bf9c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f284659b700 1 --2- 172.21.15.17:0/2751105000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bf9c580 0x56332bf9c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f284659b700 1 -- 172.21.15.17:0/2751105000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 msgr2=0x56332bfa1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f284659b700 1 --2- 172.21.15.17:0/2751105000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 0x56332bfa1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f284659b700 1 -- 172.21.15.17:0/2751105000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56332bd1bd80 con 0x56332bfa22d0 2023-07-14T13:12:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f28377fe700 1 -- 172.21.15.17:0/1917396628 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f283c0cdbc0 con 0x7f2840067c10 2023-07-14T13:12:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f284659b700 1 --2- 172.21.15.17:0/2751105000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 0x56332bf9c040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f283c0cb2a0 tx=0x7f283c066190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9b71a37e15b07e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.153+0000 7f2846d9c700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f282c0a12c0 0x7f282c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.154+0000 7f2834ff9700 1 -- 172.21.15.17:0/2751105000 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c09ab10 con 0x56332bfa22d0 2023-07-14T13:12:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.154+0000 7f2834ff9700 1 -- 172.21.15.17:0/2751105000 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f283c09a880 con 0x56332bfa22d0 2023-07-14T13:12:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.154+0000 7f2834ff9700 1 -- 172.21.15.17:0/2751105000 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c072d70 con 0x56332bfa22d0 2023-07-14T13:12:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.155+0000 7f2846d9c700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f282c0a12c0 0x7f282c0a3770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f284019c8a0 tx=0x7f2838004ad0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.155+0000 7f285c037b80 1 -- 172.21.15.17:0/2751105000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 msgr2=0x56332bf9c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.155+0000 7f285c037b80 1 --2- 172.21.15.17:0/2751105000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 0x56332bf9c040 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f283c0cb2a0 tx=0x7f283c066190 comp rx=0 tx=0).stop 2023-07-14T13:12:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.155+0000 7f285c037b80 1 -- 172.21.15.17:0/2751105000 shutdown_connections 2023-07-14T13:12:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.155+0000 7f285c037b80 1 --2- 172.21.15.17:0/2751105000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bf9c580 0x56332bf9c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.155+0000 7f285c037b80 1 --2- 172.21.15.17:0/2751105000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 0x56332bfa1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.155+0000 7f285c037b80 1 --2- 172.21.15.17:0/2751105000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 0x56332bf9c040 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.155+0000 7f285c037b80 1 -- 172.21.15.17:0/2751105000 >> 172.21.15.17:0/2751105000 conn(0x56332bf91be0 msgr2=0x56332bf96f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.155+0000 7f285c037b80 1 -- 172.21.15.17:0/2751105000 shutdown_connections 2023-07-14T13:12:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.155+0000 7f285c037b80 1 -- 172.21.15.17:0/2751105000 wait complete. 2023-07-14T13:12:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.156+0000 7f285c037b80 1 -- start start 2023-07-14T13:12:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.156+0000 7f285c037b80 1 Processor -- start 2023-07-14T13:12:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f285c037b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bdf86b0 0x56332bfab240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f285c037b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bf9c580 0x56332bfab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f285c037b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bfa22d0 0x56332bfa55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f285c037b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332be8da60 con 0x56332bfa22d0 2023-07-14T13:12:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f285c037b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332be8d760 con 0x56332bf9c580 2023-07-14T13:12:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f285c037b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332bd718c0 con 0x56332bdf86b0 2023-07-14T13:12:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f285c037b80 10 client.0 _ll_register_callbacks cb 0x56332be8b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f284659b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bdf86b0 0x56332bfab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f2846d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bfa22d0 0x56332bfa55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f284659b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bdf86b0 0x56332bfab240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44998/0 (socket says 172.21.15.17:44998) 2023-07-14T13:12:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f284659b700 1 -- 172.21.15.17:0/2923398836 learned_addr learned my addr 172.21.15.17:0/2923398836 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.157+0000 7f2845d9a700 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bf9c580 0x56332bfab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.158+0000 7f284659b700 1 -- 172.21.15.17:0/2923398836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bf9c580 msgr2=0x56332bfab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.158+0000 7f284659b700 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bf9c580 0x56332bfab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.158+0000 7f284659b700 1 -- 172.21.15.17:0/2923398836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bfa22d0 msgr2=0x56332bfa55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.158+0000 7f284659b700 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bfa22d0 0x56332bfa55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.158+0000 7f284659b700 1 -- 172.21.15.17:0/2923398836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2840196860 con 0x56332bdf86b0 2023-07-14T13:12:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.158+0000 7f284659b700 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bdf86b0 0x56332bfab240 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f283c0bc040 tx=0x7f283c0cde80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=197596a00811c604 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.158+0000 7f2829ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:12:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.158+0000 7f2829ffb700 1 -- 172.21.15.17:0/2923398836 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c06e180 con 0x56332bdf86b0 2023-07-14T13:12:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.158+0000 7f285c037b80 1 -- 172.21.15.17:0/2923398836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56332be47490 con 0x56332bdf86b0 2023-07-14T13:12:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.158+0000 7f2829ffb700 1 -- 172.21.15.17:0/2923398836 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f283c09ad40 con 0x56332bdf86b0 2023-07-14T13:12:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.159+0000 7f2829ffb700 1 -- 172.21.15.17:0/2923398836 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f283c09ab10 con 0x56332bdf86b0 2023-07-14T13:12:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.159+0000 7f285c037b80 10 client.27385 fetch_fsmap learned FSMap version 39 2023-07-14T13:12:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.159+0000 7f285c037b80 1 -- 172.21.15.17:0/2923398836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56332bd04c00 con 0x56332bdf86b0 2023-07-14T13:12:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.159+0000 7f2829ffb700 1 -- 172.21.15.17:0/2923398836 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56332be47490 con 0x56332bdf86b0 2023-07-14T13:12:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.159+0000 7f2829ffb700 1 -- 172.21.15.17:0/2923398836 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f283c0cb5b0 con 0x56332bdf86b0 2023-07-14T13:12:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.159+0000 7f285c037b80 10 client.27385 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:12:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.159+0000 7f285c037b80 10 client.27385 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.159+0000 7f285c037b80 20 client.27385 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.159+0000 7f285c037b80 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56332bfb5350 0x56332bfb7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.159+0000 7f285c037b80 4 client.27385 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:12:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.159+0000 7f285c037b80 1 -- 172.21.15.17:0/2923398836 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56332bee6e50 con 0x56332bfb5350 2023-07-14T13:12:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.160+0000 7f2845d9a700 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56332bfb5350 0x56332bfb7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.160+0000 7f2845d9a700 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56332bfb5350 0x56332bfb7760 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66e0464580cb925c server_cookie=fda3feecbcdecdd1 in_seq=0 out_seq=0 2023-07-14T13:12:35.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.160+0000 7f2829ffb700 10 client.27385 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.161+0000 7f2829ffb700 1 -- 172.21.15.17:0/2923398836 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56332bee6e50 con 0x56332bfb5350 2023-07-14T13:12:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.161+0000 7f2829ffb700 10 client.27385 handle_command_reply: tid=0 2023-07-14T13:12:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.161+0000 7f285c037b80 1 client.27385 shutdown 2023-07-14T13:12:35.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.161+0000 7f285c037b80 1 -- 172.21.15.17:0/2923398836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bdf86b0 msgr2=0x56332bfab240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.161+0000 7f285c037b80 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bdf86b0 0x56332bfab240 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f283c0bc040 tx=0x7f283c0cde80 comp rx=0 tx=0).stop 2023-07-14T13:12:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.162+0000 7f285c037b80 1 -- 172.21.15.17:0/2923398836 shutdown_connections 2023-07-14T13:12:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.162+0000 7f285c037b80 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56332bfb5350 0x56332bfb7760 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.162+0000 7f285c037b80 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bfa22d0 0x56332bfa55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.162+0000 7f285c037b80 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bdf86b0 0x56332bfab240 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.162+0000 7f2829ffb700 0 client.27385 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:35.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.162+0000 7f285c037b80 1 --2- 172.21.15.17:0/2923398836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bf9c580 0x56332bfab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.162+0000 7f285c037b80 1 -- 172.21.15.17:0/2923398836 >> 172.21.15.17:0/2923398836 conn(0x56332bf91be0 msgr2=0x56332bf964e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.162+0000 7f285c037b80 1 -- 172.21.15.17:0/2923398836 shutdown_connections 2023-07-14T13:12:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.162+0000 7f285c037b80 1 -- 172.21.15.17:0/2923398836 wait complete. 2023-07-14T13:12:35.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.162+0000 7f285c037b80 20 client.27385 trim_cache size 0 max 16384 2023-07-14T13:12:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.183+0000 7f285c037b80 1 Processor -- start 2023-07-14T13:12:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.183+0000 7f285c037b80 1 -- start start 2023-07-14T13:12:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f285c037b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bdf86b0 0x56332bf96c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f285c037b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bf9c580 0x56332bf9e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f285c037b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 0x56332bf9edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f285c037b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332bfa0590 con 0x56332bf9c580 2023-07-14T13:12:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f285c037b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332bf8eb40 con 0x56332bdf86b0 2023-07-14T13:12:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f285c037b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332bfa1d90 con 0x56332bfa22d0 2023-07-14T13:12:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f284659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bdf86b0 0x56332bf96c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f2845d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bf9c580 0x56332bf9e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f284659b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bdf86b0 0x56332bf96c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59042/0 (socket says 172.21.15.17:59042) 2023-07-14T13:12:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f284659b700 1 -- 172.21.15.17:0/2391328564 learned_addr learned my addr 172.21.15.17:0/2391328564 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f2846d9c700 1 --2- 172.21.15.17:0/2391328564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 0x56332bf9edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f2845d9a700 1 -- 172.21.15.17:0/2391328564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 msgr2=0x56332bf9edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f2845d9a700 1 --2- 172.21.15.17:0/2391328564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 0x56332bf9edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f2845d9a700 1 -- 172.21.15.17:0/2391328564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bdf86b0 msgr2=0x56332bf96c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f2845d9a700 1 --2- 172.21.15.17:0/2391328564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bdf86b0 0x56332bf96c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.184+0000 7f2845d9a700 1 -- 172.21.15.17:0/2391328564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56332bd421f0 con 0x56332bf9c580 2023-07-14T13:12:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.185+0000 7f284659b700 1 --2- 172.21.15.17:0/2391328564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bdf86b0 0x56332bf96c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.185+0000 7f2845d9a700 1 --2- 172.21.15.17:0/2391328564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bf9c580 0x56332bf9e870 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x56332bfb8000 tx=0x7f2830010710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d07ede6b35fed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.185+0000 7f28357fa700 1 -- 172.21.15.17:0/2391328564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830017040 con 0x56332bf9c580 2023-07-14T13:12:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.185+0000 7f28357fa700 1 -- 172.21.15.17:0/2391328564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f283001b530 con 0x56332bf9c580 2023-07-14T13:12:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.185+0000 7f28357fa700 1 -- 172.21.15.17:0/2391328564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283001b780 con 0x56332bf9c580 2023-07-14T13:12:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.186+0000 7f285c037b80 1 -- 172.21.15.17:0/2391328564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bf9c580 msgr2=0x56332bf9e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.186+0000 7f285c037b80 1 --2- 172.21.15.17:0/2391328564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bf9c580 0x56332bf9e870 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x56332bfb8000 tx=0x7f2830010710 comp rx=0 tx=0).stop 2023-07-14T13:12:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.186+0000 7f285c037b80 1 -- 172.21.15.17:0/2391328564 shutdown_connections 2023-07-14T13:12:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.186+0000 7f285c037b80 1 --2- 172.21.15.17:0/2391328564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bfa22d0 0x56332bf9edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.186+0000 7f285c037b80 1 --2- 172.21.15.17:0/2391328564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bdf86b0 0x56332bf96c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.186+0000 7f285c037b80 1 --2- 172.21.15.17:0/2391328564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bf9c580 0x56332bf9e870 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.186+0000 7f285c037b80 1 -- 172.21.15.17:0/2391328564 >> 172.21.15.17:0/2391328564 conn(0x56332bf91be0 msgr2=0x56332bf9c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:35.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.186+0000 7f285c037b80 1 -- 172.21.15.17:0/2391328564 shutdown_connections 2023-07-14T13:12:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.186+0000 7f285c037b80 1 -- 172.21.15.17:0/2391328564 wait complete. 2023-07-14T13:12:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.187+0000 7f285c037b80 1 -- start start 2023-07-14T13:12:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.187+0000 7f285c037b80 1 Processor -- start 2023-07-14T13:12:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f285c037b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 0x56332c002410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f285c037b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bf9c580 0x56332c002950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f285c037b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bfa22d0 0x56332c0011a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f285c037b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332c001710 con 0x56332bdf86b0 2023-07-14T13:12:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f285c037b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332c001880 con 0x56332bfa22d0 2023-07-14T13:12:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f285c037b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56332c001a40 con 0x56332bf9c580 2023-07-14T13:12:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f285c037b80 10 client.0 _ll_register_callbacks cb 0x7f28380105d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f284659b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 0x56332c002410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f2845d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bf9c580 0x56332c002950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f2846d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bfa22d0 0x56332c0011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f284659b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 0x56332c002410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52148/0 (socket says 172.21.15.17:52148) 2023-07-14T13:12:35.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f284659b700 1 -- 172.21.15.17:0/123950696 learned_addr learned my addr 172.21.15.17:0/123950696 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f2845d9a700 1 -- 172.21.15.17:0/123950696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bfa22d0 msgr2=0x56332c0011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f2845d9a700 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bfa22d0 0x56332c0011a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f2845d9a700 1 -- 172.21.15.17:0/123950696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 msgr2=0x56332c002410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.188+0000 7f2845d9a700 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 0x56332c002410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.189+0000 7f2845d9a700 1 -- 172.21.15.17:0/123950696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56332bd04c00 con 0x56332bf9c580 2023-07-14T13:12:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.189+0000 7f284659b700 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 0x56332c002410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.189+0000 7f2845d9a700 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bf9c580 0x56332c002950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2830004790 tx=0x7f2830010d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d734a5b6262ad96 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.189+0000 7f2829ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:12:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.189+0000 7f2829ffb700 1 -- 172.21.15.17:0/123950696 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2830017040 con 0x56332bf9c580 2023-07-14T13:12:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.189+0000 7f2829ffb700 1 -- 172.21.15.17:0/123950696 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2830004c40 con 0x56332bf9c580 2023-07-14T13:12:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.189+0000 7f285c037b80 1 -- 172.21.15.17:0/123950696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f283c09a880 con 0x56332bf9c580 2023-07-14T13:12:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.190+0000 7f2829ffb700 1 -- 172.21.15.17:0/123950696 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f283001b350 con 0x56332bf9c580 2023-07-14T13:12:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.190+0000 7f285c037b80 10 client.27391 fetch_fsmap learned FSMap version 39 2023-07-14T13:12:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.190+0000 7f285c037b80 1 -- 172.21.15.17:0/123950696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f2830009ad0 con 0x56332bf9c580 2023-07-14T13:12:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.190+0000 7f2829ffb700 1 -- 172.21.15.17:0/123950696 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f283c09a880 con 0x56332bf9c580 2023-07-14T13:12:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.190+0000 7f2829ffb700 1 -- 172.21.15.17:0/123950696 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2830005280 con 0x56332bf9c580 2023-07-14T13:12:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.190+0000 7f285c037b80 10 client.27391 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:12:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.190+0000 7f285c037b80 10 client.27391 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.190+0000 7f285c037b80 20 client.27391 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.190+0000 7f285c037b80 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56332c00a330 0x56332c00c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.190+0000 7f285c037b80 4 client.27391 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:12:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.190+0000 7f285c037b80 1 -- 172.21.15.17:0/123950696 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56332bea8ff0 con 0x56332c00a330 2023-07-14T13:12:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.191+0000 7f284659b700 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56332c00a330 0x56332c00c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.191+0000 7f284659b700 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56332c00a330 0x56332c00c740 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b712c35285627653 server_cookie=5e4e7fbbee0f87ad in_seq=0 out_seq=0 2023-07-14T13:12:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.191+0000 7f2829ffb700 10 client.27391 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.205+0000 7f2829ffb700 1 -- 172.21.15.17:0/123950696 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56332bea8ff0 con 0x56332c00a330 2023-07-14T13:12:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.205+0000 7f2829ffb700 10 client.27391 handle_command_reply: tid=0 2023-07-14T13:12:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.205+0000 7f285c037b80 1 client.27391 shutdown 2023-07-14T13:12:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f285c037b80 1 -- 172.21.15.17:0/123950696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bf9c580 msgr2=0x56332c002950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f285c037b80 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bf9c580 0x56332c002950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2830004790 tx=0x7f2830010d50 comp rx=0 tx=0).stop 2023-07-14T13:12:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f285c037b80 1 -- 172.21.15.17:0/123950696 shutdown_connections 2023-07-14T13:12:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f285c037b80 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56332c00a330 0x56332c00c740 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f285c037b80 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56332bfa22d0 0x56332c0011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f285c037b80 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56332bdf86b0 0x56332c002410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f285c037b80 1 --2- 172.21.15.17:0/123950696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56332bf9c580 0x56332c002950 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f2829ffb700 0 client.27391 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f285c037b80 1 -- 172.21.15.17:0/123950696 >> 172.21.15.17:0/123950696 conn(0x56332bf91be0 msgr2=0x56332bfa0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f285c037b80 1 -- 172.21.15.17:0/123950696 shutdown_connections 2023-07-14T13:12:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f285c037b80 1 -- 172.21.15.17:0/123950696 wait complete. 2023-07-14T13:12:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.206+0000 7f285c037b80 20 client.27391 trim_cache size 0 max 16384 2023-07-14T13:12:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:12:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:12:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:12:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:12:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 -- 172.21.15.17:0/1917396628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f282c0a12c0 msgr2=0x7f282c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f282c0a12c0 0x7f282c0a3770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f284019c8a0 tx=0x7f2838004ad0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 -- 172.21.15.17:0/1917396628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2840067c10 msgr2=0x7f284019bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2840067c10 0x7f284019bba0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f283c009840 tx=0x7f283c00fa00 comp rx=0 tx=0).stop 2023-07-14T13:12:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 -- 172.21.15.17:0/1917396628 shutdown_connections 2023-07-14T13:12:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f282c0a12c0 0x7f282c0a3770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2840104e50 0x7f2840195a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2840067c10 0x7f284019bba0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 --2- 172.21.15.17:0/1917396628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28400685b0 0x7f284019c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 -- 172.21.15.17:0/1917396628 >> 172.21.15.17:0/1917396628 conn(0x7f2840074760 msgr2=0x7f28400fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 -- 172.21.15.17:0/1917396628 shutdown_connections 2023-07-14T13:12:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:35.207+0000 7f28487ff700 1 -- 172.21.15.17:0/1917396628 wait complete. 2023-07-14T13:12:35.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:35 smithi135 ceph-mon[97338]: pgmap v402: 97 pgs: 97 active+clean; 9.7 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 20 MiB/s wr, 47 op/s 2023-07-14T13:12:35.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:35 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:12:35.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:35 smithi131 ceph-mon[96953]: pgmap v402: 97 pgs: 97 active+clean; 9.7 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 20 MiB/s wr, 47 op/s 2023-07-14T13:12:35.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:35 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:12:35.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:35 smithi017 ceph-mon[95536]: pgmap v402: 97 pgs: 97 active+clean; 9.7 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 20 MiB/s wr, 47 op/s 2023-07-14T13:12:35.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:35 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:12:37.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:37 smithi135 ceph-mon[97338]: pgmap v403: 97 pgs: 97 active+clean; 9.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 31 MiB/s wr, 59 op/s 2023-07-14T13:12:37.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:37 smithi131 ceph-mon[96953]: pgmap v403: 97 pgs: 97 active+clean; 9.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 31 MiB/s wr, 59 op/s 2023-07-14T13:12:37.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:37 smithi017 ceph-mon[95536]: pgmap v403: 97 pgs: 97 active+clean; 9.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 31 MiB/s wr, 59 op/s 2023-07-14T13:12:39.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:39 smithi135 ceph-mon[97338]: pgmap v404: 97 pgs: 97 active+clean; 9.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 23 MiB/s wr, 30 op/s 2023-07-14T13:12:39.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:39 smithi131 ceph-mon[96953]: pgmap v404: 97 pgs: 97 active+clean; 9.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 23 MiB/s wr, 30 op/s 2023-07-14T13:12:39.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:39 smithi017 ceph-mon[95536]: pgmap v404: 97 pgs: 97 active+clean; 9.9 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 23 MiB/s wr, 30 op/s 2023-07-14T13:12:41.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:41 smithi135 ceph-mon[97338]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 33 MiB/s wr, 41 op/s 2023-07-14T13:12:41.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:41 smithi131 ceph-mon[96953]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 33 MiB/s wr, 41 op/s 2023-07-14T13:12:41.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:41 smithi017 ceph-mon[95536]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 33 MiB/s wr, 41 op/s 2023-07-14T13:12:43.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:43 smithi135 ceph-mon[97338]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 26 MiB/s wr, 35 op/s 2023-07-14T13:12:43.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:43 smithi131 ceph-mon[96953]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 26 MiB/s wr, 35 op/s 2023-07-14T13:12:43.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:43 smithi017 ceph-mon[95536]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 26 MiB/s wr, 35 op/s 2023-07-14T13:12:45.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:45 smithi135 ceph-mon[97338]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 24 MiB/s wr, 28 op/s 2023-07-14T13:12:45.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:45 smithi131 ceph-mon[96953]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 24 MiB/s wr, 28 op/s 2023-07-14T13:12:45.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:45 smithi017 ceph-mon[95536]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 24 MiB/s wr, 28 op/s 2023-07-14T13:12:47.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:47 smithi135 ceph-mon[97338]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 36 MiB/s wr, 41 op/s 2023-07-14T13:12:47.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:47 smithi131 ceph-mon[96953]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 36 MiB/s wr, 41 op/s 2023-07-14T13:12:47.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:47 smithi017 ceph-mon[95536]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 36 MiB/s wr, 41 op/s 2023-07-14T13:12:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.373+0000 7fd93b1ff700 1 -- 172.21.15.17:0/3036779157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd934105b10 msgr2=0x7fd934105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.373+0000 7fd93b1ff700 1 --2- 172.21.15.17:0/3036779157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd934105b10 0x7fd934105ee0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd928009990 tx=0x7fd928009ca0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.373+0000 7fd93b1ff700 1 -- 172.21.15.17:0/3036779157 shutdown_connections 2023-07-14T13:12:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.373+0000 7fd93b1ff700 1 --2- 172.21.15.17:0/3036779157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9341004b0 0x7fd93410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.373+0000 7fd93b1ff700 1 --2- 172.21.15.17:0/3036779157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd934105b10 0x7fd934105ee0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.373+0000 7fd93b1ff700 1 --2- 172.21.15.17:0/3036779157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9340ffb00 0x7fd9340fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.373+0000 7fd93b1ff700 1 -- 172.21.15.17:0/3036779157 >> 172.21.15.17:0/3036779157 conn(0x7fd9340fb600 msgr2=0x7fd9340fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.373+0000 7fd93b1ff700 1 -- 172.21.15.17:0/3036779157 shutdown_connections 2023-07-14T13:12:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.373+0000 7fd93b1ff700 1 -- 172.21.15.17:0/3036779157 wait complete. 2023-07-14T13:12:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.375+0000 7fd93b1ff700 1 Processor -- start 2023-07-14T13:12:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.375+0000 7fd93b1ff700 1 -- start start 2023-07-14T13:12:48.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.375+0000 7fd93b1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340ffb00 0x7fd934197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.375+0000 7fd93b1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341004b0 0x7fd9341982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.375+0000 7fd93b1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd934105b10 0x7fd93419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.375+0000 7fd93b1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93419cf60 con 0x7fd9341004b0 2023-07-14T13:12:48.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.375+0000 7fd93b1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93419d0d0 con 0x7fd9340ffb00 2023-07-14T13:12:48.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.375+0000 7fd93b1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93419d290 con 0x7fd934105b10 2023-07-14T13:12:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd933fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341004b0 0x7fd9341982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd938f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340ffb00 0x7fd934197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd938f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340ffb00 0x7fd934197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39836/0 (socket says 172.21.15.17:39836) 2023-07-14T13:12:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd933fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341004b0 0x7fd9341982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46708/0 (socket says 172.21.15.17:46708) 2023-07-14T13:12:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd938f9b700 1 -- 172.21.15.17:0/2299759876 learned_addr learned my addr 172.21.15.17:0/2299759876 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:48.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd93979c700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd934105b10 0x7fd93419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd93979c700 1 -- 172.21.15.17:0/2299759876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340ffb00 msgr2=0x7fd934197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd93979c700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340ffb00 0x7fd934197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd93979c700 1 -- 172.21.15.17:0/2299759876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341004b0 msgr2=0x7fd9341982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd93979c700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341004b0 0x7fd9341982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd93979c700 1 -- 172.21.15.17:0/2299759876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd920009520 con 0x7fd934105b10 2023-07-14T13:12:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd938f9b700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340ffb00 0x7fd934197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.376+0000 7fd93979c700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd934105b10 0x7fd93419c920 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00efc0 tx=0x7fd92c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.377+0000 7fd931ffb700 1 -- 172.21.15.17:0/2299759876 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c018070 con 0x7fd934105b10 2023-07-14T13:12:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.377+0000 7fd931ffb700 1 -- 172.21.15.17:0/2299759876 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd92c00f040 con 0x7fd934105b10 2023-07-14T13:12:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.377+0000 7fd93b1ff700 1 -- 172.21.15.17:0/2299759876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9280095f0 con 0x7fd934105b10 2023-07-14T13:12:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.377+0000 7fd931ffb700 1 -- 172.21.15.17:0/2299759876 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00cba0 con 0x7fd934105b10 2023-07-14T13:12:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.377+0000 7fd93b1ff700 1 -- 172.21.15.17:0/2299759876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9341a4bd0 con 0x7fd934105b10 2023-07-14T13:12:48.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.381+0000 7fd931ffb700 1 -- 172.21.15.17:0/2299759876 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd92c003a00 con 0x7fd934105b10 2023-07-14T13:12:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.382+0000 7fd931ffb700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd9240a12c0 0x7fd9240a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.382+0000 7fd94ea51b80 1 Processor -- start 2023-07-14T13:12:48.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.383+0000 7fd931ffb700 1 -- 172.21.15.17:0/2299759876 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd92c0cc790 con 0x7fd934105b10 2023-07-14T13:12:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.383+0000 7fd94ea51b80 1 -- start start 2023-07-14T13:12:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.383+0000 7fd938f9b700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd9240a12c0 0x7fd9240a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.383+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 0x560ea4cfaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.383+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 0x560ea4cff1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.383+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfb3f0 0x560ea4cff6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.383+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4bf7c50 con 0x560ea4b4e6b0 2023-07-14T13:12:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.383+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4c4a9e0 con 0x560ea4cfb3f0 2023-07-14T13:12:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.383+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4c43e70 con 0x560ea4cfaf80 2023-07-14T13:12:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.383+0000 7fd933fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 0x560ea4cff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd933fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 0x560ea4cff1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58900/0 (socket says 172.21.15.17:58900) 2023-07-14T13:12:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd933fff700 1 -- 172.21.15.17:0/751585308 learned_addr learned my addr 172.21.15.17:0/751585308 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd93979c700 1 --2- 172.21.15.17:0/751585308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfb3f0 0x560ea4cff6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd938f9b700 1 --2- 172.21.15.17:0/751585308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 0x560ea4cfaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd938f9b700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd9240a12c0 0x7fd9240a3770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd928006010 tx=0x7fd928004660 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd93979c700 1 -- 172.21.15.17:0/751585308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 msgr2=0x560ea4cff1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd93979c700 1 --2- 172.21.15.17:0/751585308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 0x560ea4cff1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd93979c700 1 -- 172.21.15.17:0/751585308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 msgr2=0x560ea4cfaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd93979c700 1 --2- 172.21.15.17:0/751585308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 0x560ea4cfaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd93979c700 1 -- 172.21.15.17:0/751585308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ea4a71d80 con 0x560ea4cfb3f0 2023-07-14T13:12:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd933fff700 1 --2- 172.21.15.17:0/751585308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 0x560ea4cff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd93979c700 1 --2- 172.21.15.17:0/751585308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfb3f0 0x560ea4cff6e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0c9ea0 tx=0x7fd92c0993f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77dae0772623cc3b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.384+0000 7fd91effd700 1 -- 172.21.15.17:0/751585308 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0998b0 con 0x560ea4cfb3f0 2023-07-14T13:12:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.385+0000 7fd91effd700 1 -- 172.21.15.17:0/751585308 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd92c09d8e0 con 0x560ea4cfb3f0 2023-07-14T13:12:48.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.385+0000 7fd91effd700 1 -- 172.21.15.17:0/751585308 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0740d0 con 0x560ea4cfb3f0 2023-07-14T13:12:48.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.385+0000 7fd94ea51b80 1 -- 172.21.15.17:0/751585308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfb3f0 msgr2=0x560ea4cff6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.385+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/751585308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfb3f0 0x560ea4cff6e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0c9ea0 tx=0x7fd92c0993f0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.386+0000 7fd94ea51b80 1 -- 172.21.15.17:0/751585308 shutdown_connections 2023-07-14T13:12:48.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.386+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/751585308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfb3f0 0x560ea4cff6e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.386+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/751585308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 0x560ea4cfaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.386+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/751585308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 0x560ea4cff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.386+0000 7fd94ea51b80 1 -- 172.21.15.17:0/751585308 >> 172.21.15.17:0/751585308 conn(0x560ea4ce7be0 msgr2=0x560ea4cecf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.386+0000 7fd94ea51b80 1 -- 172.21.15.17:0/751585308 shutdown_connections 2023-07-14T13:12:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.386+0000 7fd94ea51b80 1 -- 172.21.15.17:0/751585308 wait complete. 2023-07-14T13:12:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.386+0000 7fd94ea51b80 1 -- start start 2023-07-14T13:12:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.386+0000 7fd94ea51b80 1 Processor -- start 2023-07-14T13:12:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 0x560ea4d06e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 0x560ea4d040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfb3f0 0x560ea4d04790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4be3a60 con 0x560ea4b4e6b0 2023-07-14T13:12:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4be3760 con 0x560ea4cfb3f0 2023-07-14T13:12:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4ac78c0 con 0x560ea4cfaf80 2023-07-14T13:12:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd94ea51b80 10 client.0 _ll_register_callbacks cb 0x560ea4be1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd938f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 0x560ea4d06e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd933fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 0x560ea4d040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd93979c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfb3f0 0x560ea4d04790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd933fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 0x560ea4d040f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58908/0 (socket says 172.21.15.17:58908) 2023-07-14T13:12:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd933fff700 1 -- 172.21.15.17:0/2737529170 learned_addr learned my addr 172.21.15.17:0/2737529170 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.387+0000 7fd938f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 0x560ea4d06e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46722/0 (socket says 172.21.15.17:46722) 2023-07-14T13:12:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.388+0000 7fd938f9b700 1 -- 172.21.15.17:0/2737529170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 msgr2=0x560ea4d040f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.388+0000 7fd938f9b700 1 --2- 172.21.15.17:0/2737529170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 0x560ea4d040f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.388+0000 7fd938f9b700 1 -- 172.21.15.17:0/2737529170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfb3f0 msgr2=0x560ea4d04790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.388+0000 7fd938f9b700 1 --2- 172.21.15.17:0/2737529170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfb3f0 0x560ea4d04790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.388+0000 7fd938f9b700 1 -- 172.21.15.17:0/2737529170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd920009b10 con 0x560ea4b4e6b0 2023-07-14T13:12:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.388+0000 7fd938f9b700 1 --2- 172.21.15.17:0/2737529170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 0x560ea4d06e70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd928027000 tx=0x7fd928009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44401a74883a4f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.388+0000 7fd913fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:12:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.389+0000 7fd913fff700 1 -- 172.21.15.17:0/2737529170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd928034070 con 0x560ea4b4e6b0 2023-07-14T13:12:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.389+0000 7fd94ea51b80 1 -- 172.21.15.17:0/2737529170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ea4b9d490 con 0x560ea4b4e6b0 2023-07-14T13:12:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.389+0000 7fd913fff700 1 -- 172.21.15.17:0/2737529170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd92802c040 con 0x560ea4b4e6b0 2023-07-14T13:12:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.389+0000 7fd913fff700 1 -- 172.21.15.17:0/2737529170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd928005020 con 0x560ea4b4e6b0 2023-07-14T13:12:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.389+0000 7fd94ea51b80 10 client.17712 fetch_fsmap learned FSMap version 39 2023-07-14T13:12:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.389+0000 7fd94ea51b80 1 -- 172.21.15.17:0/2737529170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7fd9341a4bd0 con 0x560ea4b4e6b0 2023-07-14T13:12:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.389+0000 7fd913fff700 1 -- 172.21.15.17:0/2737529170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560ea4b9d490 con 0x560ea4b4e6b0 2023-07-14T13:12:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.389+0000 7fd913fff700 1 -- 172.21.15.17:0/2737529170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd928037020 con 0x560ea4b4e6b0 2023-07-14T13:12:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.389+0000 7fd94ea51b80 10 client.17712 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:12:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.389+0000 7fd94ea51b80 10 client.17712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.390+0000 7fd94ea51b80 20 client.17712 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.390+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/2737529170 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560ea4d14390 0x560ea4d167a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.390+0000 7fd94ea51b80 4 client.17712 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:12:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.390+0000 7fd94ea51b80 1 -- 172.21.15.17:0/2737529170 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ea4c3ce50 con 0x560ea4d14390 2023-07-14T13:12:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.390+0000 7fd933fff700 1 --2- 172.21.15.17:0/2737529170 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560ea4d14390 0x560ea4d167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.391+0000 7fd933fff700 1 --2- 172.21.15.17:0/2737529170 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560ea4d14390 0x560ea4d167a0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=965ac936eb37b4ab server_cookie=6722370c5211848 in_seq=0 out_seq=0 2023-07-14T13:12:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.391+0000 7fd913fff700 10 client.17712 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.391+0000 7fd913fff700 1 -- 172.21.15.17:0/2737529170 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560ea4c3ce50 con 0x560ea4d14390 2023-07-14T13:12:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.391+0000 7fd913fff700 10 client.17712 handle_command_reply: tid=0 2023-07-14T13:12:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.391+0000 7fd94ea51b80 1 client.17712 shutdown 2023-07-14T13:12:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd94ea51b80 1 -- 172.21.15.17:0/2737529170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 msgr2=0x560ea4d06e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/2737529170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 0x560ea4d06e70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd928027000 tx=0x7fd928009ca0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd94ea51b80 1 -- 172.21.15.17:0/2737529170 shutdown_connections 2023-07-14T13:12:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/2737529170 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560ea4d14390 0x560ea4d167a0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/2737529170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfb3f0 0x560ea4d04790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/2737529170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4b4e6b0 0x560ea4d06e70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd913fff700 0 client.17712 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/2737529170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4cfaf80 0x560ea4d040f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd94ea51b80 1 -- 172.21.15.17:0/2737529170 >> 172.21.15.17:0/2737529170 conn(0x560ea4ce7be0 msgr2=0x560ea4cec4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd94ea51b80 1 -- 172.21.15.17:0/2737529170 shutdown_connections 2023-07-14T13:12:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd94ea51b80 1 -- 172.21.15.17:0/2737529170 wait complete. 2023-07-14T13:12:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.392+0000 7fd94ea51b80 20 client.17712 trim_cache size 0 max 16384 2023-07-14T13:12:48.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.410+0000 7fd94ea51b80 1 Processor -- start 2023-07-14T13:12:48.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.410+0000 7fd94ea51b80 1 -- start start 2023-07-14T13:12:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.410+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4ce7be0 0x560ea4d0b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.410+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4b4e6b0 0x560ea4cf1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.410+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfaf80 0x560ea4d06a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4cb8060 con 0x560ea4ce7be0 2023-07-14T13:12:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4d10d90 con 0x560ea4cfaf80 2023-07-14T13:12:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4d050a0 con 0x560ea4b4e6b0 2023-07-14T13:12:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd938f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4ce7be0 0x560ea4d0b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd938f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4ce7be0 0x560ea4d0b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46732/0 (socket says 172.21.15.17:46732) 2023-07-14T13:12:48.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd938f9b700 1 -- 172.21.15.17:0/390996763 learned_addr learned my addr 172.21.15.17:0/390996763 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:48.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd933fff700 1 --2- 172.21.15.17:0/390996763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4b4e6b0 0x560ea4cf1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd93979c700 1 --2- 172.21.15.17:0/390996763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfaf80 0x560ea4d06a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd938f9b700 1 -- 172.21.15.17:0/390996763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4b4e6b0 msgr2=0x560ea4cf1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:48.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd938f9b700 1 --2- 172.21.15.17:0/390996763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4b4e6b0 0x560ea4cf1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd938f9b700 1 -- 172.21.15.17:0/390996763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfaf80 msgr2=0x560ea4d06a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:48.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd938f9b700 1 --2- 172.21.15.17:0/390996763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfaf80 0x560ea4d06a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.411+0000 7fd938f9b700 1 -- 172.21.15.17:0/390996763 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ea4d1b390 con 0x560ea4ce7be0 2023-07-14T13:12:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.412+0000 7fd938f9b700 1 --2- 172.21.15.17:0/390996763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4ce7be0 0x560ea4d0b470 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd928004530 tx=0x7fd92800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf034a41e5f60e33 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.412+0000 7fd91f7fe700 1 -- 172.21.15.17:0/390996763 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd928034070 con 0x560ea4ce7be0 2023-07-14T13:12:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.412+0000 7fd91f7fe700 1 -- 172.21.15.17:0/390996763 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd92801e040 con 0x560ea4ce7be0 2023-07-14T13:12:48.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.412+0000 7fd91f7fe700 1 -- 172.21.15.17:0/390996763 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd928004ed0 con 0x560ea4ce7be0 2023-07-14T13:12:48.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.413+0000 7fd94ea51b80 1 -- 172.21.15.17:0/390996763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4ce7be0 msgr2=0x560ea4d0b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.413+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/390996763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4ce7be0 0x560ea4d0b470 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd928004530 tx=0x7fd92800b410 comp rx=0 tx=0).stop 2023-07-14T13:12:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.413+0000 7fd94ea51b80 1 -- 172.21.15.17:0/390996763 shutdown_connections 2023-07-14T13:12:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.413+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/390996763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4cfaf80 0x560ea4d06a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.413+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/390996763 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4ce7be0 0x560ea4d0b470 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.413+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/390996763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4b4e6b0 0x560ea4cf1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.413+0000 7fd94ea51b80 1 -- 172.21.15.17:0/390996763 >> 172.21.15.17:0/390996763 conn(0x560ea4cfe0c0 msgr2=0x560ea4cf1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:48.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.413+0000 7fd94ea51b80 1 -- 172.21.15.17:0/390996763 shutdown_connections 2023-07-14T13:12:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.413+0000 7fd94ea51b80 1 -- 172.21.15.17:0/390996763 wait complete. 2023-07-14T13:12:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.413+0000 7fd94ea51b80 1 -- start start 2023-07-14T13:12:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.414+0000 7fd94ea51b80 1 Processor -- start 2023-07-14T13:12:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.414+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4b4e6b0 0x560ea4d03c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.414+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4ce7be0 0x560ea4d041a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.414+0000 7fd94ea51b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4cfaf80 0x560ea4d028a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.414+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4d02e60 con 0x560ea4cfaf80 2023-07-14T13:12:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.414+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4d02fd0 con 0x560ea4b4e6b0 2023-07-14T13:12:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.414+0000 7fd94ea51b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea4d03190 con 0x560ea4ce7be0 2023-07-14T13:12:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.414+0000 7fd94ea51b80 10 client.0 _ll_register_callbacks cb 0x7fd92800bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:12:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.414+0000 7fd938f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4b4e6b0 0x560ea4d03c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.414+0000 7fd93979c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4cfaf80 0x560ea4d028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd933fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4ce7be0 0x560ea4d041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd93979c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4cfaf80 0x560ea4d028a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46734/0 (socket says 172.21.15.17:46734) 2023-07-14T13:12:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd93979c700 1 -- 172.21.15.17:0/1563031867 learned_addr learned my addr 172.21.15.17:0/1563031867 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:12:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd938f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4b4e6b0 0x560ea4d03c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39870/0 (socket says 172.21.15.17:39870) 2023-07-14T13:12:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd93979c700 1 -- 172.21.15.17:0/1563031867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4ce7be0 msgr2=0x560ea4d041a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd93979c700 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4ce7be0 0x560ea4d041a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd93979c700 1 -- 172.21.15.17:0/1563031867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4b4e6b0 msgr2=0x560ea4d03c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:12:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd93979c700 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4b4e6b0 0x560ea4d03c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd93979c700 1 -- 172.21.15.17:0/1563031867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9341a4bd0 con 0x560ea4cfaf80 2023-07-14T13:12:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd938f9b700 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4b4e6b0 0x560ea4d03c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:12:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd93979c700 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4cfaf80 0x560ea4d028a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0c9f00 tx=0x7fd92c0093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdf4f443e1f742b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:12:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd913fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:12:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.415+0000 7fd913fff700 1 -- 172.21.15.17:0/1563031867 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0b92b0 con 0x560ea4cfaf80 2023-07-14T13:12:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd94ea51b80 1 -- 172.21.15.17:0/1563031867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd92c09d8e0 con 0x560ea4cfaf80 2023-07-14T13:12:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd913fff700 1 -- 172.21.15.17:0/1563031867 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd92c0a1c70 con 0x560ea4cfaf80 2023-07-14T13:12:48.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd913fff700 1 -- 172.21.15.17:0/1563031867 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd92c099930 con 0x560ea4cfaf80 2023-07-14T13:12:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd94ea51b80 10 client.17718 fetch_fsmap learned FSMap version 39 2023-07-14T13:12:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd94ea51b80 1 -- 172.21.15.17:0/1563031867 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x560ea4a5ac00 con 0x560ea4cfaf80 2023-07-14T13:12:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd913fff700 1 -- 172.21.15.17:0/1563031867 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd92c09d8e0 con 0x560ea4cfaf80 2023-07-14T13:12:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd913fff700 1 -- 172.21.15.17:0/1563031867 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd92c0a17e0 con 0x560ea4cfaf80 2023-07-14T13:12:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd94ea51b80 10 client.17718 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:12:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd94ea51b80 10 client.17718 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:12:48.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd94ea51b80 20 client.17718 populate_metadata read hostname 'smithi017' 2023-07-14T13:12:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560ea4cfb3f0 0x560ea4d6ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:12:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd94ea51b80 4 client.17718 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:12:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.416+0000 7fd94ea51b80 1 -- 172.21.15.17:0/1563031867 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560ea4bfeff0 con 0x560ea4cfb3f0 2023-07-14T13:12:48.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.417+0000 7fd938f9b700 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560ea4cfb3f0 0x560ea4d6ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:12:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.417+0000 7fd938f9b700 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560ea4cfb3f0 0x560ea4d6ae60 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=574895905f858d66 server_cookie=a135d13ba3a2a040 in_seq=0 out_seq=0 2023-07-14T13:12:48.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.417+0000 7fd913fff700 10 client.17718 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd913fff700 1 -- 172.21.15.17:0/1563031867 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560ea4bfeff0 con 0x560ea4cfb3f0 2023-07-14T13:12:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd913fff700 10 client.17718 handle_command_reply: tid=0 2023-07-14T13:12:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd94ea51b80 1 client.17718 shutdown 2023-07-14T13:12:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd94ea51b80 1 -- 172.21.15.17:0/1563031867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4cfaf80 msgr2=0x560ea4d028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4cfaf80 0x560ea4d028a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0c9f00 tx=0x7fd92c0093a0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd94ea51b80 1 -- 172.21.15.17:0/1563031867 shutdown_connections 2023-07-14T13:12:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560ea4cfb3f0 0x560ea4d6ae60 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560ea4cfaf80 0x560ea4d028a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560ea4b4e6b0 0x560ea4d03c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd94ea51b80 1 --2- 172.21.15.17:0/1563031867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ea4ce7be0 0x560ea4d041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd94ea51b80 1 -- 172.21.15.17:0/1563031867 >> 172.21.15.17:0/1563031867 conn(0x560ea4cfe0c0 msgr2=0x560ea4cfec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd913fff700 0 client.17718 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:12:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd94ea51b80 1 -- 172.21.15.17:0/1563031867 shutdown_connections 2023-07-14T13:12:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.433+0000 7fd94ea51b80 1 -- 172.21.15.17:0/1563031867 wait complete. 2023-07-14T13:12:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd94ea51b80 20 client.17718 trim_cache size 0 max 16384 2023-07-14T13:12:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:12:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:12:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:12:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:12:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 -- 172.21.15.17:0/2299759876 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd9240a12c0 msgr2=0x7fd9240a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd9240a12c0 0x7fd9240a3770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd928006010 tx=0x7fd928004660 comp rx=0 tx=0).stop 2023-07-14T13:12:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 -- 172.21.15.17:0/2299759876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd934105b10 msgr2=0x7fd93419c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:12:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd934105b10 0x7fd93419c920 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00efc0 tx=0x7fd92c00c3a0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 -- 172.21.15.17:0/2299759876 shutdown_connections 2023-07-14T13:12:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd9240a12c0 0x7fd9240a3770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd934105b10 0x7fd93419c920 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9340ffb00 0x7fd934197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 --2- 172.21.15.17:0/2299759876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9341004b0 0x7fd9341982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:12:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 -- 172.21.15.17:0/2299759876 >> 172.21.15.17:0/2299759876 conn(0x7fd9340fb600 msgr2=0x7fd9340fbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:12:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 -- 172.21.15.17:0/2299759876 shutdown_connections 2023-07-14T13:12:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:12:48.434+0000 7fd93b1ff700 1 -- 172.21.15.17:0/2299759876 wait complete. 2023-07-14T13:12:49.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:49 smithi131 ceph-mon[96953]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 24 MiB/s wr, 28 op/s 2023-07-14T13:12:49.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:49 smithi017 ceph-mon[95536]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 24 MiB/s wr, 28 op/s 2023-07-14T13:12:49.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:49 smithi135 ceph-mon[97338]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 24 MiB/s wr, 28 op/s 2023-07-14T13:12:51.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:51 smithi131 ceph-mon[96953]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 35 MiB/s wr, 36 op/s 2023-07-14T13:12:51.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:51 smithi017 ceph-mon[95536]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 35 MiB/s wr, 36 op/s 2023-07-14T13:12:51.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:51 smithi135 ceph-mon[97338]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 35 MiB/s wr, 36 op/s 2023-07-14T13:12:53.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:53 smithi131 ceph-mon[96953]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 26 MiB/s wr, 31 op/s 2023-07-14T13:12:53.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:53 smithi017 ceph-mon[95536]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 26 MiB/s wr, 31 op/s 2023-07-14T13:12:53.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:53 smithi135 ceph-mon[97338]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 26 MiB/s wr, 31 op/s 2023-07-14T13:12:55.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:55 smithi131 ceph-mon[96953]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-07-14T13:12:55.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:55 smithi017 ceph-mon[95536]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-07-14T13:12:55.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:55 smithi135 ceph-mon[97338]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-07-14T13:12:57.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:57 smithi131 ceph-mon[96953]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 36 MiB/s wr, 35 op/s 2023-07-14T13:12:57.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:57 smithi017 ceph-mon[95536]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 36 MiB/s wr, 35 op/s 2023-07-14T13:12:57.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:57 smithi135 ceph-mon[97338]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 36 MiB/s wr, 35 op/s 2023-07-14T13:12:59.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:12:59 smithi131 ceph-mon[96953]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-07-14T13:12:59.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:12:59 smithi017 ceph-mon[95536]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-07-14T13:12:59.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:12:59 smithi135 ceph-mon[97338]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-07-14T13:13:01.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:01 smithi131 ceph-mon[96953]: pgmap v415: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 35 MiB/s wr, 27 op/s 2023-07-14T13:13:01.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:01 smithi017 ceph-mon[95536]: pgmap v415: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 35 MiB/s wr, 27 op/s 2023-07-14T13:13:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.609+0000 7f580a59d700 1 -- 172.21.15.17:0/257405427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5804102750 msgr2=0x7f5804106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.609+0000 7f580a59d700 1 --2- 172.21.15.17:0/257405427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5804102750 0x7f5804106710 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f57f40099c0 tx=0x7f57f4009cd0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.609+0000 7f580a59d700 1 -- 172.21.15.17:0/257405427 shutdown_connections 2023-07-14T13:13:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.609+0000 7f580a59d700 1 --2- 172.21.15.17:0/257405427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804106df0 0x7f580410e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.609+0000 7f580a59d700 1 --2- 172.21.15.17:0/257405427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5804101db0 0x7f5804102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.609+0000 7f580a59d700 1 --2- 172.21.15.17:0/257405427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5804102750 0x7f5804106710 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.609+0000 7f580a59d700 1 -- 172.21.15.17:0/257405427 >> 172.21.15.17:0/257405427 conn(0x7f58040fd660 msgr2=0x7f58040ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.609+0000 7f580a59d700 1 -- 172.21.15.17:0/257405427 shutdown_connections 2023-07-14T13:13:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.609+0000 7f580a59d700 1 -- 172.21.15.17:0/257405427 wait complete. 2023-07-14T13:13:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.611+0000 7f580a59d700 1 Processor -- start 2023-07-14T13:13:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.611+0000 7f580a59d700 1 -- start start 2023-07-14T13:13:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.611+0000 7f580a59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804101db0 0x7f580419da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.611+0000 7f580a59d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5804102750 0x7f580419df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.611+0000 7f580a59d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5804106df0 0x7f5804197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.611+0000 7f580a59d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58041980d0 con 0x7f5804106df0 2023-07-14T13:13:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.611+0000 7f580a59d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5804198240 con 0x7f5804102750 2023-07-14T13:13:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.611+0000 7f580a59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5804198400 con 0x7f5804101db0 2023-07-14T13:13:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.612+0000 7f580959b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804101db0 0x7f580419da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.612+0000 7f5808d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5804102750 0x7f580419df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.612+0000 7f580959b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804101db0 0x7f580419da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41816/0 (socket says 172.21.15.17:41816) 2023-07-14T13:13:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.612+0000 7f580959b700 1 -- 172.21.15.17:0/369700733 learned_addr learned my addr 172.21.15.17:0/369700733 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.612+0000 7f5809d9c700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5804106df0 0x7f5804197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.612+0000 7f580959b700 1 -- 172.21.15.17:0/369700733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5804102750 msgr2=0x7f580419df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.612+0000 7f580959b700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5804102750 0x7f580419df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.612+0000 7f580959b700 1 -- 172.21.15.17:0/369700733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5804106df0 msgr2=0x7f5804197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.612+0000 7f580959b700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5804106df0 0x7f5804197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.612+0000 7f580959b700 1 -- 172.21.15.17:0/369700733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f40095f0 con 0x7f5804101db0 2023-07-14T13:13:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.612+0000 7f5809d9c700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5804106df0 0x7f5804197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:13:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.613+0000 7f580959b700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804101db0 0x7f580419da00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f580000e9a0 tx=0x7f580000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.613+0000 7f57fa7fc700 1 -- 172.21.15.17:0/369700733 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800009790 con 0x7f5804101db0 2023-07-14T13:13:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.613+0000 7f580a59d700 1 -- 172.21.15.17:0/369700733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58041986e0 con 0x7f5804101db0 2023-07-14T13:13:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.613+0000 7f57fa7fc700 1 -- 172.21.15.17:0/369700733 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f580000cbd0 con 0x7f5804101db0 2023-07-14T13:13:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.613+0000 7f57fa7fc700 1 -- 172.21.15.17:0/369700733 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800018680 con 0x7f5804101db0 2023-07-14T13:13:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.613+0000 7f580a59d700 1 -- 172.21.15.17:0/369700733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58041a49f0 con 0x7f5804101db0 2023-07-14T13:13:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.617+0000 7f57fa7fc700 1 -- 172.21.15.17:0/369700733 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f580000cd40 con 0x7f5804101db0 2023-07-14T13:13:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.619+0000 7f57fa7fc700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f57f00a12c0 0x7f57f00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.619+0000 7f57fa7fc700 1 -- 172.21.15.17:0/369700733 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5800014070 con 0x7f5804101db0 2023-07-14T13:13:01.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.619+0000 7f581f021b80 1 Processor -- start 2023-07-14T13:13:01.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.619+0000 7f5808d9a700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f57f00a12c0 0x7f57f00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.619+0000 7f581f021b80 1 -- start start 2023-07-14T13:13:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f581f021b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f25846b0 0x5645f272df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f581f021b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f272e470 0x5645f27281a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f581f021b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f2728700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f581f021b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f262dc50 con 0x5645f272e8c0 2023-07-14T13:13:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f581f021b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f26809e0 con 0x5645f272e470 2023-07-14T13:13:01.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f581f021b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f2679e70 con 0x5645f25846b0 2023-07-14T13:13:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f580959b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f25846b0 0x5645f272df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f580959b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f25846b0 0x5645f272df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41820/0 (socket says 172.21.15.17:41820) 2023-07-14T13:13:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f580959b700 1 -- 172.21.15.17:0/846560947 learned_addr learned my addr 172.21.15.17:0/846560947 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f5808d9a700 1 --2- 172.21.15.17:0/846560947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f272e470 0x5645f27281a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f5809d9c700 1 --2- 172.21.15.17:0/846560947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f2728700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f5808d9a700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f57f00a12c0 0x7f57f00a3770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57f4000c00 tx=0x7f57f40058e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f580959b700 1 -- 172.21.15.17:0/846560947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f272e470 msgr2=0x5645f27281a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f580959b700 1 --2- 172.21.15.17:0/846560947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f272e470 0x5645f27281a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f580959b700 1 -- 172.21.15.17:0/846560947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 msgr2=0x5645f2728700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f580959b700 1 --2- 172.21.15.17:0/846560947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f2728700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f580959b700 1 -- 172.21.15.17:0/846560947 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645f24a7d80 con 0x5645f25846b0 2023-07-14T13:13:01.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.620+0000 7f5808d9a700 1 --2- 172.21.15.17:0/846560947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f272e470 0x5645f27281a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.621+0000 7f580959b700 1 --2- 172.21.15.17:0/846560947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f25846b0 0x5645f272df30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5800096590 tx=0x7f5800099cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5061ed5bd8c609a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.621+0000 7f57ef7fe700 1 -- 172.21.15.17:0/846560947 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58000a24e0 con 0x5645f25846b0 2023-07-14T13:13:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.621+0000 7f57ef7fe700 1 -- 172.21.15.17:0/846560947 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f580009a2f0 con 0x5645f25846b0 2023-07-14T13:13:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.621+0000 7f57ef7fe700 1 -- 172.21.15.17:0/846560947 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58000a22b0 con 0x5645f25846b0 2023-07-14T13:13:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.622+0000 7f581f021b80 1 -- 172.21.15.17:0/846560947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f25846b0 msgr2=0x5645f272df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.622+0000 7f581f021b80 1 --2- 172.21.15.17:0/846560947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f25846b0 0x5645f272df30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5800096590 tx=0x7f5800099cc0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.622+0000 7f581f021b80 1 -- 172.21.15.17:0/846560947 shutdown_connections 2023-07-14T13:13:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.622+0000 7f581f021b80 1 --2- 172.21.15.17:0/846560947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f2728700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.622+0000 7f581f021b80 1 --2- 172.21.15.17:0/846560947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f25846b0 0x5645f272df30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.622+0000 7f581f021b80 1 --2- 172.21.15.17:0/846560947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f272e470 0x5645f27281a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.622+0000 7f581f021b80 1 -- 172.21.15.17:0/846560947 >> 172.21.15.17:0/846560947 conn(0x5645f271dd40 msgr2=0x5645f2723340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:01.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.622+0000 7f581f021b80 1 -- 172.21.15.17:0/846560947 shutdown_connections 2023-07-14T13:13:01.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.622+0000 7f581f021b80 1 -- 172.21.15.17:0/846560947 wait complete. 2023-07-14T13:13:01.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.622+0000 7f581f021b80 1 -- start start 2023-07-14T13:13:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.623+0000 7f581f021b80 1 Processor -- start 2023-07-14T13:13:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.623+0000 7f581f021b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f25846b0 0x5645f2734870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.623+0000 7f581f021b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f2731af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.623+0000 7f581f021b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f272e8c0 0x5645f2732230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.623+0000 7f581f021b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f2619a60 con 0x5645f25846b0 2023-07-14T13:13:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.623+0000 7f581f021b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f2619760 con 0x5645f272e8c0 2023-07-14T13:13:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.623+0000 7f581f021b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f24fd8c0 con 0x5645f272e470 2023-07-14T13:13:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.623+0000 7f581f021b80 10 client.0 _ll_register_callbacks cb 0x5645f2617700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f5808d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f2731af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f580959b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f25846b0 0x5645f2734870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f5808d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f2731af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41822/0 (socket says 172.21.15.17:41822) 2023-07-14T13:13:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f5808d9a700 1 -- 172.21.15.17:0/725078181 learned_addr learned my addr 172.21.15.17:0/725078181 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f5809d9c700 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f272e8c0 0x5645f2732230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f580959b700 1 -- 172.21.15.17:0/725078181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 msgr2=0x5645f2731af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f580959b700 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f2731af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f580959b700 1 -- 172.21.15.17:0/725078181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f272e8c0 msgr2=0x5645f2732230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f580959b700 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f272e8c0 0x5645f2732230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f580959b700 1 -- 172.21.15.17:0/725078181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58041a49f0 con 0x5645f25846b0 2023-07-14T13:13:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f580959b700 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f25846b0 0x5645f2734870 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x5645f2728ea0 tx=0x7f5800010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a713753940c2299 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f57ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:13:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.624+0000 7f57ecff9700 1 -- 172.21.15.17:0/725078181 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58000a24e0 con 0x5645f25846b0 2023-07-14T13:13:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f57ecff9700 1 -- 172.21.15.17:0/725078181 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f58000a2260 con 0x5645f25846b0 2023-07-14T13:13:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f581f021b80 1 -- 172.21.15.17:0/725078181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5645f25d3490 con 0x5645f25846b0 2023-07-14T13:13:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f57ecff9700 1 -- 172.21.15.17:0/725078181 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58000b8250 con 0x5645f25846b0 2023-07-14T13:13:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f581f021b80 10 client.17727 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f581f021b80 1 -- 172.21.15.17:0/725078181 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5645f2490c00 con 0x5645f25846b0 2023-07-14T13:13:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f57ecff9700 1 -- 172.21.15.17:0/725078181 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5645f25d3490 con 0x5645f25846b0 2023-07-14T13:13:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f57ecff9700 1 -- 172.21.15.17:0/725078181 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f5800095e80 con 0x5645f25846b0 2023-07-14T13:13:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f581f021b80 10 client.17727 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f581f021b80 10 client.17727 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f581f021b80 20 client.17727 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f581f021b80 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5645f2741950 0x5645f2743d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f581f021b80 4 client.17727 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:13:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.625+0000 7f581f021b80 1 -- 172.21.15.17:0/725078181 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645f2672e50 con 0x5645f2741950 2023-07-14T13:13:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.626+0000 7f5808d9a700 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5645f2741950 0x5645f2743d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.626+0000 7f5808d9a700 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5645f2741950 0x5645f2743d60 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e141f9285f9536c1 server_cookie=ed693a5f794d83c4 in_seq=0 out_seq=0 2023-07-14T13:13:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.626+0000 7f57ecff9700 10 client.17727 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.627+0000 7f57ecff9700 1 -- 172.21.15.17:0/725078181 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5645f2672e50 con 0x5645f2741950 2023-07-14T13:13:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.627+0000 7f57ecff9700 10 client.17727 handle_command_reply: tid=0 2023-07-14T13:13:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.627+0000 7f581f021b80 1 client.17727 shutdown 2023-07-14T13:13:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f581f021b80 1 -- 172.21.15.17:0/725078181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f25846b0 msgr2=0x5645f2734870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f581f021b80 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f25846b0 0x5645f2734870 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x5645f2728ea0 tx=0x7f5800010a70 comp rx=0 tx=0).stop 2023-07-14T13:13:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f581f021b80 1 -- 172.21.15.17:0/725078181 shutdown_connections 2023-07-14T13:13:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f581f021b80 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5645f2741950 0x5645f2743d60 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f581f021b80 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f272e8c0 0x5645f2732230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f581f021b80 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f25846b0 0x5645f2734870 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f57ecff9700 0 client.17727 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:01.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f581f021b80 1 --2- 172.21.15.17:0/725078181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f2731af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f581f021b80 1 -- 172.21.15.17:0/725078181 >> 172.21.15.17:0/725078181 conn(0x5645f271dd40 msgr2=0x5645f2722640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f581f021b80 1 -- 172.21.15.17:0/725078181 shutdown_connections 2023-07-14T13:13:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f581f021b80 1 -- 172.21.15.17:0/725078181 wait complete. 2023-07-14T13:13:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.628+0000 7f581f021b80 20 client.17727 trim_cache size 0 max 16384 2023-07-14T13:13:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.644+0000 7f581f021b80 1 Processor -- start 2023-07-14T13:13:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f581f021b80 1 -- start start 2023-07-14T13:13:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f581f021b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 0x5645f272d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f581f021b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f272a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f581f021b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f27281a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f581f021b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f2732f80 con 0x5645f272e8c0 2023-07-14T13:13:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f581f021b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f2724b70 con 0x5645f25846b0 2023-07-14T13:13:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f581f021b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f271ad80 con 0x5645f272e470 2023-07-14T13:13:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f580959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 0x5645f272d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f5808d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f272a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f580959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 0x5645f272d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56768/0 (socket says 172.21.15.17:56768) 2023-07-14T13:13:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f580959b700 1 -- 172.21.15.17:0/80448364 learned_addr learned my addr 172.21.15.17:0/80448364 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.645+0000 7f5809d9c700 1 --2- 172.21.15.17:0/80448364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f27281a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.646+0000 7f5808d9a700 1 -- 172.21.15.17:0/80448364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 msgr2=0x5645f272d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.646+0000 7f5808d9a700 1 --2- 172.21.15.17:0/80448364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 0x5645f272d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.646+0000 7f5808d9a700 1 -- 172.21.15.17:0/80448364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 msgr2=0x5645f27281a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.646+0000 7f5808d9a700 1 --2- 172.21.15.17:0/80448364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f27281a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.646+0000 7f5808d9a700 1 -- 172.21.15.17:0/80448364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645f2748950 con 0x5645f272e470 2023-07-14T13:13:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.646+0000 7f580959b700 1 --2- 172.21.15.17:0/80448364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 0x5645f272d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.646+0000 7f5808d9a700 1 --2- 172.21.15.17:0/80448364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f272a9a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f57f4006010 tx=0x7f57f401f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c1ee92912401168 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.646+0000 7f57effff700 1 -- 172.21.15.17:0/80448364 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f4030430 con 0x5645f272e470 2023-07-14T13:13:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.646+0000 7f57effff700 1 -- 172.21.15.17:0/80448364 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57f402a040 con 0x5645f272e470 2023-07-14T13:13:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.646+0000 7f57effff700 1 -- 172.21.15.17:0/80448364 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f4003db0 con 0x5645f272e470 2023-07-14T13:13:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.647+0000 7f581f021b80 1 -- 172.21.15.17:0/80448364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 msgr2=0x5645f272a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.647+0000 7f581f021b80 1 --2- 172.21.15.17:0/80448364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f272a9a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f57f4006010 tx=0x7f57f401f000 comp rx=0 tx=0).stop 2023-07-14T13:13:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.647+0000 7f581f021b80 1 -- 172.21.15.17:0/80448364 shutdown_connections 2023-07-14T13:13:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.647+0000 7f581f021b80 1 --2- 172.21.15.17:0/80448364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f27281a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.647+0000 7f581f021b80 1 --2- 172.21.15.17:0/80448364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 0x5645f272d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.647+0000 7f581f021b80 1 --2- 172.21.15.17:0/80448364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f272a9a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.647+0000 7f581f021b80 1 -- 172.21.15.17:0/80448364 >> 172.21.15.17:0/80448364 conn(0x5645f271dd40 msgr2=0x5645f272cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.647+0000 7f581f021b80 1 -- 172.21.15.17:0/80448364 shutdown_connections 2023-07-14T13:13:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.647+0000 7f581f021b80 1 -- 172.21.15.17:0/80448364 wait complete. 2023-07-14T13:13:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.648+0000 7f581f021b80 1 -- start start 2023-07-14T13:13:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.648+0000 7f581f021b80 1 Processor -- start 2023-07-14T13:13:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.648+0000 7f581f021b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 0x5645f27372f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.648+0000 7f581f021b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f2735810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f581f021b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f2735d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f581f021b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f27362d0 con 0x5645f272e8c0 2023-07-14T13:13:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f581f021b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f2736440 con 0x5645f25846b0 2023-07-14T13:13:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f581f021b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645f2736600 con 0x5645f272e470 2023-07-14T13:13:01.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f581f021b80 10 client.0 _ll_register_callbacks cb 0x7f5800099f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f5808d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f2735810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f580959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 0x5645f27372f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f5808d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f2735810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41840/0 (socket says 172.21.15.17:41840) 2023-07-14T13:13:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f5808d9a700 1 -- 172.21.15.17:0/477292637 learned_addr learned my addr 172.21.15.17:0/477292637 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:01.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f5809d9c700 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f2735d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f5808d9a700 1 -- 172.21.15.17:0/477292637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 msgr2=0x5645f27372f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:01.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f5808d9a700 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 0x5645f27372f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f5808d9a700 1 -- 172.21.15.17:0/477292637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 msgr2=0x5645f2735d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:01.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f5808d9a700 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f2735d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f5808d9a700 1 -- 172.21.15.17:0/477292637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645f2490c00 con 0x5645f272e470 2023-07-14T13:13:01.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f5809d9c700 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f2735d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:01.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.649+0000 7f580959b700 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 0x5645f27372f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:01.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.650+0000 7f5808d9a700 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f2735810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f57f40098e0 tx=0x7f57f40056b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3590ca8c93a96f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:01.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.650+0000 7f57ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:13:01.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.650+0000 7f57ecff9700 1 -- 172.21.15.17:0/477292637 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f4027040 con 0x5645f272e470 2023-07-14T13:13:01.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.650+0000 7f581f021b80 1 -- 172.21.15.17:0/477292637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f580009a2f0 con 0x5645f272e470 2023-07-14T13:13:01.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.650+0000 7f57ecff9700 1 -- 172.21.15.17:0/477292637 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f57f40305b0 con 0x5645f272e470 2023-07-14T13:13:01.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.650+0000 7f57ecff9700 1 -- 172.21.15.17:0/477292637 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57f4030de0 con 0x5645f272e470 2023-07-14T13:13:01.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.650+0000 7f581f021b80 10 client.27427 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:01.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.650+0000 7f581f021b80 1 -- 172.21.15.17:0/477292637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f580410f200 con 0x5645f272e470 2023-07-14T13:13:01.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.650+0000 7f57ecff9700 1 -- 172.21.15.17:0/477292637 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f580009a2f0 con 0x5645f272e470 2023-07-14T13:13:01.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.651+0000 7f57ecff9700 1 -- 172.21.15.17:0/477292637 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f57f400f830 con 0x5645f272e470 2023-07-14T13:13:01.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.651+0000 7f581f021b80 10 client.27427 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:01.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.651+0000 7f581f021b80 10 client.27427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:01.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.651+0000 7f581f021b80 20 client.27427 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:01.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.651+0000 7f581f021b80 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5645f27968d0 0x5645f2798ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:01.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.651+0000 7f581f021b80 4 client.27427 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:13:01.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.651+0000 7f581f021b80 1 -- 172.21.15.17:0/477292637 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5645f2634ff0 con 0x5645f27968d0 2023-07-14T13:13:01.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.651+0000 7f580959b700 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5645f27968d0 0x5645f2798ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:01.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.652+0000 7f57ecff9700 10 client.27427 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:01.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.652+0000 7f580959b700 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5645f27968d0 0x5645f2798ce0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f48f1e4dee08a20 server_cookie=4304f4716885c701 in_seq=0 out_seq=0 2023-07-14T13:13:01.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f57ecff9700 1 -- 172.21.15.17:0/477292637 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5645f2634ff0 con 0x5645f27968d0 2023-07-14T13:13:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f57ecff9700 10 client.27427 handle_command_reply: tid=0 2023-07-14T13:13:01.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f581f021b80 1 client.27427 shutdown 2023-07-14T13:13:01.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:01 smithi135 ceph-mon[97338]: pgmap v415: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 35 MiB/s wr, 27 op/s 2023-07-14T13:13:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f581f021b80 1 -- 172.21.15.17:0/477292637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 msgr2=0x5645f2735810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f581f021b80 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f2735810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f57f40098e0 tx=0x7f57f40056b0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f581f021b80 1 -- 172.21.15.17:0/477292637 shutdown_connections 2023-07-14T13:13:01.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f581f021b80 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5645f27968d0 0x5645f2798ce0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f581f021b80 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5645f272e8c0 0x5645f2735d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f581f021b80 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5645f25846b0 0x5645f27372f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f581f021b80 1 --2- 172.21.15.17:0/477292637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645f272e470 0x5645f2735810 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f57ecff9700 0 client.27427 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f581f021b80 1 -- 172.21.15.17:0/477292637 >> 172.21.15.17:0/477292637 conn(0x5645f271dd40 msgr2=0x5645f27302a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f581f021b80 1 -- 172.21.15.17:0/477292637 shutdown_connections 2023-07-14T13:13:01.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.667+0000 7f581f021b80 1 -- 172.21.15.17:0/477292637 wait complete. 2023-07-14T13:13:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.668+0000 7f581f021b80 20 client.27427 trim_cache size 0 max 16384 2023-07-14T13:13:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:13:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:13:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:13:01.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:13:01.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.668+0000 7f580a59d700 1 -- 172.21.15.17:0/369700733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f57f00a12c0 msgr2=0x7f57f00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.668+0000 7f580a59d700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f57f00a12c0 0x7f57f00a3770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57f4000c00 tx=0x7f57f40058e0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.668+0000 7f580a59d700 1 -- 172.21.15.17:0/369700733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804101db0 msgr2=0x7f580419da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:01.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.668+0000 7f580a59d700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804101db0 0x7f580419da00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f580000e9a0 tx=0x7f580000ecb0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.668+0000 7f580a59d700 1 -- 172.21.15.17:0/369700733 shutdown_connections 2023-07-14T13:13:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.668+0000 7f580a59d700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f57f00a12c0 0x7f57f00a3770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.668+0000 7f580a59d700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5804106df0 0x7f5804197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.668+0000 7f580a59d700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804101db0 0x7f580419da00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.668+0000 7f580a59d700 1 --2- 172.21.15.17:0/369700733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5804102750 0x7f580419df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.668+0000 7f580a59d700 1 -- 172.21.15.17:0/369700733 >> 172.21.15.17:0/369700733 conn(0x7f58040fd660 msgr2=0x7f58040fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:01.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.669+0000 7f580a59d700 1 -- 172.21.15.17:0/369700733 shutdown_connections 2023-07-14T13:13:01.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:01.669+0000 7f580a59d700 1 -- 172.21.15.17:0/369700733 wait complete. 2023-07-14T13:13:03.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:03 smithi131 ceph-mon[96953]: pgmap v416: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 25 MiB/s wr, 23 op/s 2023-07-14T13:13:03.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:03 smithi017 ceph-mon[95536]: pgmap v416: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 25 MiB/s wr, 23 op/s 2023-07-14T13:13:03.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:03 smithi135 ceph-mon[97338]: pgmap v416: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 25 MiB/s wr, 23 op/s 2023-07-14T13:13:03.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:13:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.106+0000 7fdbb319d700 1 -- 172.21.15.17:0/2083848540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbac0ff9f0 msgr2=0x7fdbac0ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.106+0000 7fdbb319d700 1 --2- 172.21.15.17:0/2083848540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbac0ff9f0 0x7fdbac0ffe60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009990 tx=0x7fdb9c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.106+0000 7fdbb319d700 1 -- 172.21.15.17:0/2083848540 shutdown_connections 2023-07-14T13:13:04.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.106+0000 7fdbb319d700 1 --2- 172.21.15.17:0/2083848540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbac1003a0 0x7fdbac10c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.106+0000 7fdbb319d700 1 --2- 172.21.15.17:0/2083848540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbac105a00 0x7fdbac105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.106+0000 7fdbb319d700 1 --2- 172.21.15.17:0/2083848540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbac0ff9f0 0x7fdbac0ffe60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.106+0000 7fdbb319d700 1 -- 172.21.15.17:0/2083848540 >> 172.21.15.17:0/2083848540 conn(0x7fdbac0fb510 msgr2=0x7fdbac0fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:04.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.106+0000 7fdbb319d700 1 -- 172.21.15.17:0/2083848540 shutdown_connections 2023-07-14T13:13:04.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.106+0000 7fdbb319d700 1 -- 172.21.15.17:0/2083848540 wait complete. 2023-07-14T13:13:04.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.107+0000 7fdbb319d700 1 Processor -- start 2023-07-14T13:13:04.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.107+0000 7fdbb319d700 1 -- start start 2023-07-14T13:13:04.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb319d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbac0ff9f0 0x7fdbac19d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb319d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbac1003a0 0x7fdbac19dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb319d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbac105a00 0x7fdbac1978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb319d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac197f30 con 0x7fdbac1003a0 2023-07-14T13:13:04.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb319d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac1980a0 con 0x7fdbac0ff9f0 2023-07-14T13:13:04.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb319d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac198260 con 0x7fdbac105a00 2023-07-14T13:13:04.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb219b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbac0ff9f0 0x7fdbac19d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb199a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbac1003a0 0x7fdbac19dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb219b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbac0ff9f0 0x7fdbac19d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56802/0 (socket says 172.21.15.17:56802) 2023-07-14T13:13:04.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb219b700 1 -- 172.21.15.17:0/4115215108 learned_addr learned my addr 172.21.15.17:0/4115215108 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:04.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb199a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbac1003a0 0x7fdbac19dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51092/0 (socket says 172.21.15.17:51092) 2023-07-14T13:13:04.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.108+0000 7fdbb299c700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbac105a00 0x7fdbac1978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdbb199a700 1 -- 172.21.15.17:0/4115215108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbac105a00 msgr2=0x7fdbac1978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdbb199a700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbac105a00 0x7fdbac1978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdbb199a700 1 -- 172.21.15.17:0/4115215108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbac0ff9f0 msgr2=0x7fdbac19d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdbb199a700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbac0ff9f0 0x7fdbac19d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdbb199a700 1 -- 172.21.15.17:0/4115215108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0095f0 con 0x7fdbac1003a0 2023-07-14T13:13:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdbb219b700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbac0ff9f0 0x7fdbac19d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:04.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdbb199a700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbac1003a0 0x7fdbac19dda0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0098e0 tx=0x7fdb9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdba37fe700 1 -- 172.21.15.17:0/4115215108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c01d070 con 0x7fdbac1003a0 2023-07-14T13:13:04.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdba37fe700 1 -- 172.21.15.17:0/4115215108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb9c022470 con 0x7fdbac1003a0 2023-07-14T13:13:04.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdba37fe700 1 -- 172.21.15.17:0/4115215108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c017650 con 0x7fdbac1003a0 2023-07-14T13:13:04.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdbb319d700 1 -- 172.21.15.17:0/4115215108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac1984e0 con 0x7fdbac1003a0 2023-07-14T13:13:04.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.109+0000 7fdbb319d700 1 -- 172.21.15.17:0/4115215108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac1a4850 con 0x7fdbac1003a0 2023-07-14T13:13:04.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.114+0000 7fdba37fe700 1 -- 172.21.15.17:0/4115215108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fdb9c0225e0 con 0x7fdbac1003a0 2023-07-14T13:13:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.114+0000 7fdbc7d80b80 1 Processor -- start 2023-07-14T13:13:04.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.114+0000 7fdbc7d80b80 1 -- start start 2023-07-14T13:13:04.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.115+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1acd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.115+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1acde00 0x5591e1ad77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.115+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1ad7d30 0x5591e1ada110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.115+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e19d2cb0 con 0x5591e1ad7d30 2023-07-14T13:13:04.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.115+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e1a25a40 con 0x5591e1acd4f0 2023-07-14T13:13:04.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.115+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e1a1eed0 con 0x5591e1acde00 2023-07-14T13:13:04.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.115+0000 7fdbb299c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1acd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.115+0000 7fdbb199a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1ad7d30 0x5591e1ada110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.115+0000 7fdbb219b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1acde00 0x5591e1ad77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.115+0000 7fdbb299c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1acd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56816/0 (socket says 172.21.15.17:56816) 2023-07-14T13:13:04.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.116+0000 7fdbb299c700 1 -- 172.21.15.17:0/1488701759 learned_addr learned my addr 172.21.15.17:0/1488701759 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:04.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.116+0000 7fdba37fe700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdb980a13e0 0x7fdb980a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.116+0000 7fdbb219b700 1 -- 172.21.15.17:0/1488701759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 msgr2=0x5591e1acd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:04.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.116+0000 7fdbb219b700 1 --2- 172.21.15.17:0/1488701759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1acd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.116+0000 7fdbb219b700 1 -- 172.21.15.17:0/1488701759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1ad7d30 msgr2=0x5591e1ada110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:04.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.116+0000 7fdbb219b700 1 --2- 172.21.15.17:0/1488701759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1ad7d30 0x5591e1ada110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.116+0000 7fdbb219b700 1 -- 172.21.15.17:0/1488701759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591e184cde0 con 0x5591e1acde00 2023-07-14T13:13:04.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.116+0000 7fdba37fe700 1 -- 172.21.15.17:0/4115215108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdb9c0cdfe0 con 0x7fdbac1003a0 2023-07-14T13:13:04.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.116+0000 7fdbb299c700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdb980a13e0 0x7fdb980a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.116+0000 7fdbb219b700 1 --2- 172.21.15.17:0/1488701759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1acde00 0x5591e1ad77f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdba8005950 tx=0x7fdba80117a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2872a7805cdb97c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.117+0000 7fdba0bfe700 1 -- 172.21.15.17:0/1488701759 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8004a30 con 0x5591e1acde00 2023-07-14T13:13:04.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.117+0000 7fdba0bfe700 1 -- 172.21.15.17:0/1488701759 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdba80054b0 con 0x5591e1acde00 2023-07-14T13:13:04.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.117+0000 7fdba0bfe700 1 -- 172.21.15.17:0/1488701759 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba800e930 con 0x5591e1acde00 2023-07-14T13:13:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.118+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1488701759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1acde00 msgr2=0x5591e1ad77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.118+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/1488701759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1acde00 0x5591e1ad77f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdba8005950 tx=0x7fdba80117a0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.118+0000 7fdbb299c700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdb980a13e0 0x7fdb980a3890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdba40075c0 tx=0x7fdba4009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.118+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1488701759 shutdown_connections 2023-07-14T13:13:04.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.118+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/1488701759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1ad7d30 0x5591e1ada110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.118+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/1488701759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1acd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.118+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/1488701759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1acde00 0x5591e1ad77f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.118+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1488701759 >> 172.21.15.17:0/1488701759 conn(0x5591e1ac2ff0 msgr2=0x5591e1ac8930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:04.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.118+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1488701759 shutdown_connections 2023-07-14T13:13:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.118+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1488701759 wait complete. 2023-07-14T13:13:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.119+0000 7fdbc7d80b80 1 -- start start 2023-07-14T13:13:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.119+0000 7fdbc7d80b80 1 Processor -- start 2023-07-14T13:13:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acde00 0x5591e1ad4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 0x5591e1ad4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e19beac0 con 0x5591e1acde00 2023-07-14T13:13:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e19be7c0 con 0x5591e1acd4f0 2023-07-14T13:13:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e18a2920 con 0x5591e1ad7d30 2023-07-14T13:13:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbc7d80b80 10 client.0 _ll_register_callbacks cb 0x5591e19bc760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbb219b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbb219b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56818/0 (socket says 172.21.15.17:56818) 2023-07-14T13:13:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbb219b700 1 -- 172.21.15.17:0/1563101321 learned_addr learned my addr 172.21.15.17:0/1563101321 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbb199a700 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acde00 0x5591e1ad4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.120+0000 7fdbb299c700 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 0x5591e1ad4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.121+0000 7fdbb219b700 1 -- 172.21.15.17:0/1563101321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 msgr2=0x5591e1ad4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.121+0000 7fdbb219b700 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 0x5591e1ad4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.121+0000 7fdbb219b700 1 -- 172.21.15.17:0/1563101321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acde00 msgr2=0x5591e1ad4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.121+0000 7fdbb219b700 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acde00 0x5591e1ad4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.121+0000 7fdbb219b700 1 -- 172.21.15.17:0/1563101321 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba8009ce0 con 0x5591e1acd4f0 2023-07-14T13:13:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.121+0000 7fdbb219b700 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7720 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdba801b040 tx=0x7fdba8004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce17f5e7d5c630f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.121+0000 7fdb95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:13:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.121+0000 7fdb95ffb700 1 -- 172.21.15.17:0/1563101321 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8004750 con 0x5591e1acd4f0 2023-07-14T13:13:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.121+0000 7fdb95ffb700 1 -- 172.21.15.17:0/1563101321 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdba80048b0 con 0x5591e1acd4f0 2023-07-14T13:13:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.121+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1563101321 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591e19784f0 con 0x5591e1acd4f0 2023-07-14T13:13:04.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.122+0000 7fdb95ffb700 1 -- 172.21.15.17:0/1563101321 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdba8004a70 con 0x5591e1acd4f0 2023-07-14T13:13:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.122+0000 7fdbc7d80b80 10 client.27476 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.122+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1563101321 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5591e1835c60 con 0x5591e1acd4f0 2023-07-14T13:13:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.122+0000 7fdb95ffb700 1 -- 172.21.15.17:0/1563101321 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591e19784f0 con 0x5591e1acd4f0 2023-07-14T13:13:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.122+0000 7fdb95ffb700 1 -- 172.21.15.17:0/1563101321 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdba8028020 con 0x5591e1acd4f0 2023-07-14T13:13:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.122+0000 7fdbc7d80b80 10 client.27476 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.122+0000 7fdbc7d80b80 10 client.27476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.122+0000 7fdbc7d80b80 20 client.27476 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:04.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.122+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5591e1ae7540 0x5591e1ae9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.122+0000 7fdbc7d80b80 4 client.27476 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:13:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.122+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1563101321 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591e1a17eb0 con 0x5591e1ae7540 2023-07-14T13:13:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.123+0000 7fdbb199a700 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5591e1ae7540 0x5591e1ae9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.123+0000 7fdbb199a700 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5591e1ae7540 0x5591e1ae9950 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eb9d472d970a030 server_cookie=34495c66277da06a in_seq=0 out_seq=0 2023-07-14T13:13:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.123+0000 7fdb95ffb700 10 client.27476 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.124+0000 7fdb95ffb700 1 -- 172.21.15.17:0/1563101321 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5591e1a17eb0 con 0x5591e1ae7540 2023-07-14T13:13:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.124+0000 7fdb95ffb700 10 client.27476 handle_command_reply: tid=0 2023-07-14T13:13:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.124+0000 7fdbc7d80b80 1 client.27476 shutdown 2023-07-14T13:13:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.124+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1563101321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 msgr2=0x5591e1ad7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.124+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7720 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdba801b040 tx=0x7fdba8004040 comp rx=0 tx=0).stop 2023-07-14T13:13:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.124+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1563101321 shutdown_connections 2023-07-14T13:13:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.125+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5591e1ae7540 0x5591e1ae9950 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.125+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 0x5591e1ad4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.125+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7720 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.125+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/1563101321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acde00 0x5591e1ad4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.125+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1563101321 >> 172.21.15.17:0/1563101321 conn(0x5591e1ac2ff0 msgr2=0x5591e1ac8520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.125+0000 7fdb95ffb700 0 client.27476 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.125+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1563101321 shutdown_connections 2023-07-14T13:13:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.125+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/1563101321 wait complete. 2023-07-14T13:13:04.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.125+0000 7fdbc7d80b80 20 client.27476 trim_cache size 0 max 16384 2023-07-14T13:13:04.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.143+0000 7fdbc7d80b80 1 Processor -- start 2023-07-14T13:13:04.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.143+0000 7fdbc7d80b80 1 -- start start 2023-07-14T13:13:04.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.143+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.143+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acde00 0x5591e1acfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.143+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 0x5591e1ad41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.143+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e1ad5540 con 0x5591e1acde00 2023-07-14T13:13:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.143+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e1acf1a0 con 0x5591e1acd4f0 2023-07-14T13:13:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.143+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e1acf7e0 con 0x5591e1ad7d30 2023-07-14T13:13:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb299c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 0x5591e1ad41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb199a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acde00 0x5591e1acfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb219b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb299c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 0x5591e1ad41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41884/0 (socket says 172.21.15.17:41884) 2023-07-14T13:13:04.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb299c700 1 -- 172.21.15.17:0/2258540977 learned_addr learned my addr 172.21.15.17:0/2258540977 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:04.183 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb219b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56822/0 (socket says 172.21.15.17:56822) 2023-07-14T13:13:04.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb219b700 1 -- 172.21.15.17:0/2258540977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 msgr2=0x5591e1ad41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:04.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb219b700 1 --2- 172.21.15.17:0/2258540977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 0x5591e1ad41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.184 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb219b700 1 -- 172.21.15.17:0/2258540977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acde00 msgr2=0x5591e1acfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb219b700 1 --2- 172.21.15.17:0/2258540977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acde00 0x5591e1acfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb219b700 1 -- 172.21.15.17:0/2258540977 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591e1873250 con 0x5591e1acd4f0 2023-07-14T13:13:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb299c700 1 --2- 172.21.15.17:0/2258540977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 0x5591e1ad41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb199a700 1 --2- 172.21.15.17:0/2258540977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acde00 0x5591e1acfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.144+0000 7fdbb219b700 1 --2- 172.21.15.17:0/2258540977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdba8000c00 tx=0x7fdba80117a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a5536537770345d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.145+0000 7fdba13ff700 1 -- 172.21.15.17:0/2258540977 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8005c80 con 0x5591e1acd4f0 2023-07-14T13:13:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.145+0000 7fdba13ff700 1 -- 172.21.15.17:0/2258540977 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdba8015070 con 0x5591e1acd4f0 2023-07-14T13:13:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.145+0000 7fdba13ff700 1 -- 172.21.15.17:0/2258540977 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba800ebf0 con 0x5591e1acd4f0 2023-07-14T13:13:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.145+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/2258540977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 msgr2=0x5591e1ad7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.145+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/2258540977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdba8000c00 tx=0x7fdba80117a0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.146+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/2258540977 shutdown_connections 2023-07-14T13:13:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.146+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/2258540977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1ad7d30 0x5591e1ad41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.146+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/2258540977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1acd4f0 0x5591e1ad7250 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.146+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/2258540977 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acde00 0x5591e1acfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.146+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/2258540977 >> 172.21.15.17:0/2258540977 conn(0x5591e1ac2ff0 msgr2=0x5591e1ae39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:04.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.146+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/2258540977 shutdown_connections 2023-07-14T13:13:04.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.146+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/2258540977 wait complete. 2023-07-14T13:13:04.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.146+0000 7fdbc7d80b80 1 -- start start 2023-07-14T13:13:04.187 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.146+0000 7fdbc7d80b80 1 Processor -- start 2023-07-14T13:13:04.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acd4f0 0x5591e1ade4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1acde00 0x5591e1adea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbc7d80b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1ad7d30 0x5591e1adc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.189 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e1add020 con 0x5591e1acd4f0 2023-07-14T13:13:04.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e1add190 con 0x5591e1ad7d30 2023-07-14T13:13:04.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbc7d80b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e1add350 con 0x5591e1acde00 2023-07-14T13:13:04.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbc7d80b80 10 client.0 _ll_register_callbacks cb 0x7fdb9c0974c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:04.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbb219b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acd4f0 0x5591e1ade4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbb299c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1ad7d30 0x5591e1adc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbb299c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1ad7d30 0x5591e1adc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56828/0 (socket says 172.21.15.17:56828) 2023-07-14T13:13:04.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbb299c700 1 -- 172.21.15.17:0/82239229 learned_addr learned my addr 172.21.15.17:0/82239229 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbb219b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acd4f0 0x5591e1ade4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51120/0 (socket says 172.21.15.17:51120) 2023-07-14T13:13:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.147+0000 7fdbb199a700 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1acde00 0x5591e1adea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.148+0000 7fdbb299c700 1 -- 172.21.15.17:0/82239229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1acde00 msgr2=0x5591e1adea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.148+0000 7fdbb299c700 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1acde00 0x5591e1adea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.148+0000 7fdbb299c700 1 -- 172.21.15.17:0/82239229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acd4f0 msgr2=0x5591e1ade4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.148+0000 7fdbb299c700 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acd4f0 0x5591e1ade4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.148+0000 7fdbb299c700 1 -- 172.21.15.17:0/82239229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac1a4850 con 0x5591e1ad7d30 2023-07-14T13:13:04.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.148+0000 7fdbb299c700 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1ad7d30 0x5591e1adc950 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdba4024950 tx=0x7fdba4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caddbf099cde75d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:04.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.148+0000 7fdb95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:13:04.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.148+0000 7fdb95ffb700 1 -- 172.21.15.17:0/82239229 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba400e040 con 0x5591e1ad7d30 2023-07-14T13:13:04.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.148+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/82239229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdba80054b0 con 0x5591e1ad7d30 2023-07-14T13:13:04.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.148+0000 7fdb95ffb700 1 -- 172.21.15.17:0/82239229 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdba401c070 con 0x5591e1ad7d30 2023-07-14T13:13:04.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdb95ffb700 1 -- 172.21.15.17:0/82239229 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdba4004bb0 con 0x5591e1ad7d30 2023-07-14T13:13:04.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdbc7d80b80 10 client.27482 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:04.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/82239229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7fdba4017780 con 0x5591e1ad7d30 2023-07-14T13:13:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdb95ffb700 1 -- 172.21.15.17:0/82239229 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdba80054b0 con 0x5591e1ad7d30 2023-07-14T13:13:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdb95ffb700 1 -- 172.21.15.17:0/82239229 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdba4025950 con 0x5591e1ad7d30 2023-07-14T13:13:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdbc7d80b80 10 client.27482 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdbc7d80b80 10 client.27482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdbc7d80b80 20 client.27482 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5591e1b3c740 0x5591e1b3eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdbc7d80b80 4 client.27482 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:13:04.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/82239229 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5591e19da050 con 0x5591e1b3c740 2023-07-14T13:13:04.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.149+0000 7fdbb219b700 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5591e1b3c740 0x5591e1b3eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:04.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.150+0000 7fdbb219b700 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5591e1b3c740 0x5591e1b3eb50 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ba4e0287c5e3546 server_cookie=7167941648ba0e93 in_seq=0 out_seq=0 2023-07-14T13:13:04.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.150+0000 7fdb95ffb700 10 client.27482 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:04.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.150+0000 7fdb95ffb700 1 -- 172.21.15.17:0/82239229 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5591e19da050 con 0x5591e1b3c740 2023-07-14T13:13:04.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.150+0000 7fdb95ffb700 10 client.27482 handle_command_reply: tid=0 2023-07-14T13:13:04.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.150+0000 7fdbc7d80b80 1 client.27482 shutdown 2023-07-14T13:13:04.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.150+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/82239229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1ad7d30 msgr2=0x5591e1adc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.150+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1ad7d30 0x5591e1adc950 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdba4024950 tx=0x7fdba4004ad0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.151+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/82239229 shutdown_connections 2023-07-14T13:13:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.151+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5591e1b3c740 0x5591e1b3eb50 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.151+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5591e1ad7d30 0x5591e1adc950 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.151+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5591e1acd4f0 0x5591e1ade4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.151+0000 7fdbc7d80b80 1 --2- 172.21.15.17:0/82239229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591e1acde00 0x5591e1adea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.151+0000 7fdb95ffb700 0 client.27482 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:04.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.151+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/82239229 >> 172.21.15.17:0/82239229 conn(0x5591e1ac2ff0 msgr2=0x5591e1acfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:04.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.151+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/82239229 shutdown_connections 2023-07-14T13:13:04.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.151+0000 7fdbc7d80b80 1 -- 172.21.15.17:0/82239229 wait complete. 2023-07-14T13:13:04.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.151+0000 7fdbc7d80b80 20 client.27482 trim_cache size 0 max 16384 2023-07-14T13:13:04.196 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:13:04.196 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:13:04.197 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:13:04.197 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:13:04.197 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:13:04.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:13:04.197 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:13:04.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:13:04.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:13:04.197 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:13:04.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.151+0000 7fdbb319d700 1 -- 172.21.15.17:0/4115215108 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdb980a13e0 msgr2=0x7fdb980a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.152+0000 7fdbb319d700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdb980a13e0 0x7fdb980a3890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdba40075c0 tx=0x7fdba4009040 comp rx=0 tx=0).stop 2023-07-14T13:13:04.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.152+0000 7fdbb319d700 1 -- 172.21.15.17:0/4115215108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbac1003a0 msgr2=0x7fdbac19dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:04.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.152+0000 7fdbb319d700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbac1003a0 0x7fdbac19dda0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0098e0 tx=0x7fdb9c004730 comp rx=0 tx=0).stop 2023-07-14T13:13:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.152+0000 7fdbb319d700 1 -- 172.21.15.17:0/4115215108 shutdown_connections 2023-07-14T13:13:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.152+0000 7fdbb319d700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdb980a13e0 0x7fdb980a3890 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.152+0000 7fdbb319d700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbac105a00 0x7fdbac1978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.152+0000 7fdbb319d700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbac0ff9f0 0x7fdbac19d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.152+0000 7fdbb319d700 1 --2- 172.21.15.17:0/4115215108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbac1003a0 0x7fdbac19dda0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.152+0000 7fdbb319d700 1 -- 172.21.15.17:0/4115215108 >> 172.21.15.17:0/4115215108 conn(0x7fdbac0fb510 msgr2=0x7fdbac072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:04.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.152+0000 7fdbb319d700 1 -- 172.21.15.17:0/4115215108 shutdown_connections 2023-07-14T13:13:04.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:04.152+0000 7fdbb319d700 1 -- 172.21.15.17:0/4115215108 wait complete. 2023-07-14T13:13:04.208 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:13:05.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:05 smithi131 ceph-mon[96953]: pgmap v417: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:13:05.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:05 smithi131 ceph-mon[96953]: osdmap e104: 12 total, 12 up, 12 in 2023-07-14T13:13:05.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:05 smithi017 ceph-mon[95536]: pgmap v417: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:13:05.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:05 smithi017 ceph-mon[95536]: osdmap e104: 12 total, 12 up, 12 in 2023-07-14T13:13:05.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:05 smithi135 ceph-mon[97338]: pgmap v417: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:13:05.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:05 smithi135 ceph-mon[97338]: osdmap e104: 12 total, 12 up, 12 in 2023-07-14T13:13:07.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:07 smithi131 ceph-mon[96953]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 42 op/s 2023-07-14T13:13:07.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:07 smithi017 ceph-mon[95536]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 42 op/s 2023-07-14T13:13:07.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:07 smithi135 ceph-mon[97338]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 42 op/s 2023-07-14T13:13:09.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:09 smithi131 ceph-mon[96953]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 42 op/s 2023-07-14T13:13:09.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:09 smithi017 ceph-mon[95536]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 42 op/s 2023-07-14T13:13:09.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:09 smithi135 ceph-mon[97338]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 42 op/s 2023-07-14T13:13:11.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:11 smithi131 ceph-mon[96953]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 44 op/s 2023-07-14T13:13:11.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:11 smithi131 ceph-mon[96953]: osdmap e105: 12 total, 12 up, 12 in 2023-07-14T13:13:11.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:11 smithi017 ceph-mon[95536]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 44 op/s 2023-07-14T13:13:11.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:11 smithi017 ceph-mon[95536]: osdmap e105: 12 total, 12 up, 12 in 2023-07-14T13:13:11.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:11 smithi135 ceph-mon[97338]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 44 op/s 2023-07-14T13:13:11.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:11 smithi135 ceph-mon[97338]: osdmap e105: 12 total, 12 up, 12 in 2023-07-14T13:13:13.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:13 smithi131 ceph-mon[96953]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 36 MiB/s wr, 52 op/s 2023-07-14T13:13:13.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:13 smithi017 ceph-mon[95536]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 36 MiB/s wr, 52 op/s 2023-07-14T13:13:13.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:13 smithi135 ceph-mon[97338]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 36 MiB/s wr, 52 op/s 2023-07-14T13:13:14.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.857+0000 7fbbaafff700 1 -- 172.21.15.17:0/3632157764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba40679a0 msgr2=0x7fbba4067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.857+0000 7fbbaafff700 1 --2- 172.21.15.17:0/3632157764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba40679a0 0x7fbba4067d70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009990 tx=0x7fbb98009ca0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.857+0000 7fbbaafff700 1 -- 172.21.15.17:0/3632157764 shutdown_connections 2023-07-14T13:13:14.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.857+0000 7fbbaafff700 1 --2- 172.21.15.17:0/3632157764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbba410c540 0x7fbba410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.857+0000 7fbbaafff700 1 --2- 172.21.15.17:0/3632157764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba40679a0 0x7fbba4067d70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.857+0000 7fbbaafff700 1 --2- 172.21.15.17:0/3632157764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbba40682b0 0x7fbba410c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.857+0000 7fbbaafff700 1 -- 172.21.15.17:0/3632157764 >> 172.21.15.17:0/3632157764 conn(0x7fbba4074760 msgr2=0x7fbba4074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.857+0000 7fbbaafff700 1 -- 172.21.15.17:0/3632157764 shutdown_connections 2023-07-14T13:13:14.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.857+0000 7fbbaafff700 1 -- 172.21.15.17:0/3632157764 wait complete. 2023-07-14T13:13:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.858+0000 7fbbaafff700 1 Processor -- start 2023-07-14T13:13:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.858+0000 7fbbaafff700 1 -- start start 2023-07-14T13:13:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.859+0000 7fbbaafff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbba40679a0 0x7fbba4197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.859+0000 7fbbaafff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbba40682b0 0x7fbba41982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.859+0000 7fbbaafff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba410c540 0x7fbba419c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.859+0000 7fbbaafff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba419cfa0 con 0x7fbba40679a0 2023-07-14T13:13:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.859+0000 7fbbaafff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba419d110 con 0x7fbba40682b0 2023-07-14T13:13:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.859+0000 7fbbaafff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba419d2d0 con 0x7fbba410c540 2023-07-14T13:13:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.859+0000 7fbba8d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbba40679a0 0x7fbba4197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.859+0000 7fbba3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbba40682b0 0x7fbba41982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.859+0000 7fbba3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbba40682b0 0x7fbba41982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35284/0 (socket says 172.21.15.17:35284) 2023-07-14T13:13:14.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.859+0000 7fbba959c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba410c540 0x7fbba419c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.859+0000 7fbba3fff700 1 -- 172.21.15.17:0/2617251968 learned_addr learned my addr 172.21.15.17:0/2617251968 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:14.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.860+0000 7fbba3fff700 1 -- 172.21.15.17:0/2617251968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba410c540 msgr2=0x7fbba419c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.860+0000 7fbba3fff700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba410c540 0x7fbba419c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.860+0000 7fbba3fff700 1 -- 172.21.15.17:0/2617251968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbba40679a0 msgr2=0x7fbba4197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.860+0000 7fbba3fff700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbba40679a0 0x7fbba4197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.860+0000 7fbba3fff700 1 -- 172.21.15.17:0/2617251968 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90009520 con 0x7fbba40682b0 2023-07-14T13:13:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.860+0000 7fbba959c700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba410c540 0x7fbba419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.860+0000 7fbba3fff700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbba40682b0 0x7fbba41982f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000eb30 tx=0x7fbb9000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.860+0000 7fbba1ffb700 1 -- 172.21.15.17:0/2617251968 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90009880 con 0x7fbba40682b0 2023-07-14T13:13:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.860+0000 7fbbaafff700 1 -- 172.21.15.17:0/2617251968 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb980095f0 con 0x7fbba40682b0 2023-07-14T13:13:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.860+0000 7fbba1ffb700 1 -- 172.21.15.17:0/2617251968 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb900044b0 con 0x7fbba40682b0 2023-07-14T13:13:14.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.860+0000 7fbba1ffb700 1 -- 172.21.15.17:0/2617251968 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90003ce0 con 0x7fbba40682b0 2023-07-14T13:13:14.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.861+0000 7fbbaafff700 1 -- 172.21.15.17:0/2617251968 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba419d7a0 con 0x7fbba40682b0 2023-07-14T13:13:14.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.864+0000 7fbba1ffb700 1 -- 172.21.15.17:0/2617251968 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fbb90003ea0 con 0x7fbba40682b0 2023-07-14T13:13:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.866+0000 7fbba1ffb700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbb940a1340 0x7fbb940a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.866+0000 7fbba1ffb700 1 -- 172.21.15.17:0/2617251968 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbb90014070 con 0x7fbba40682b0 2023-07-14T13:13:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.866+0000 7fbbbe876b80 1 Processor -- start 2023-07-14T13:13:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.866+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbb940a1340 0x7fbb940a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbbbe876b80 1 -- start start 2023-07-14T13:13:14.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b94540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 0x55a1c3b8e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b8edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c3a8bc50 con 0x55a1c39e26b0 2023-07-14T13:13:14.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c3ade9e0 con 0x55a1c3b94ed0 2023-07-14T13:13:14.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c3ad7e70 con 0x55a1c3b94a80 2023-07-14T13:13:14.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbba3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 0x55a1c3b8e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbba3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 0x55a1c3b8e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59960/0 (socket says 172.21.15.17:59960) 2023-07-14T13:13:14.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbba3fff700 1 -- 172.21.15.17:0/2379648249 learned_addr learned my addr 172.21.15.17:0/2379648249 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:14.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbba959c700 1 --2- 172.21.15.17:0/2379648249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b8edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.867+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/2379648249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b94540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.868+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbb940a1340 0x7fbb940a37f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb98006010 tx=0x7fbb9800b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.868+0000 7fbba3fff700 1 -- 172.21.15.17:0/2379648249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94ed0 msgr2=0x55a1c3b8edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.868+0000 7fbba3fff700 1 --2- 172.21.15.17:0/2379648249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b8edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.868+0000 7fbba3fff700 1 -- 172.21.15.17:0/2379648249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 msgr2=0x55a1c3b94540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.868+0000 7fbba3fff700 1 --2- 172.21.15.17:0/2379648249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b94540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.868+0000 7fbba3fff700 1 -- 172.21.15.17:0/2379648249 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1c3905d80 con 0x55a1c3b94a80 2023-07-14T13:13:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.868+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/2379648249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b94540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:14.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.868+0000 7fbba3fff700 1 --2- 172.21.15.17:0/2379648249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 0x55a1c3b8e850 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbb90096730 tx=0x7fbb90099c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee76f227cc503e4e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.868+0000 7fbb8effd700 1 -- 172.21.15.17:0/2379648249 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9000cbd0 con 0x55a1c3b94a80 2023-07-14T13:13:14.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.868+0000 7fbb8effd700 1 -- 172.21.15.17:0/2379648249 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb9009a230 con 0x55a1c3b94a80 2023-07-14T13:13:14.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.868+0000 7fbb8effd700 1 -- 172.21.15.17:0/2379648249 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9009a490 con 0x55a1c3b94a80 2023-07-14T13:13:14.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.869+0000 7fbbbe876b80 1 -- 172.21.15.17:0/2379648249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 msgr2=0x55a1c3b8e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.869+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/2379648249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 0x55a1c3b8e850 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbb90096730 tx=0x7fbb90099c90 comp rx=0 tx=0).stop 2023-07-14T13:13:14.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.869+0000 7fbbbe876b80 1 -- 172.21.15.17:0/2379648249 shutdown_connections 2023-07-14T13:13:14.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.869+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/2379648249 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b8edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.869+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/2379648249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b94540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.869+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/2379648249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 0x55a1c3b8e850 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.869+0000 7fbbbe876b80 1 -- 172.21.15.17:0/2379648249 >> 172.21.15.17:0/2379648249 conn(0x55a1c3b7bbe0 msgr2=0x55a1c3b80f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.870+0000 7fbbbe876b80 1 -- 172.21.15.17:0/2379648249 shutdown_connections 2023-07-14T13:13:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.870+0000 7fbbbe876b80 1 -- 172.21.15.17:0/2379648249 wait complete. 2023-07-14T13:13:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.870+0000 7fbbbe876b80 1 -- start start 2023-07-14T13:13:14.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.871+0000 7fbbbe876b80 1 Processor -- start 2023-07-14T13:13:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.871+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.871+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 0x55a1c3b98120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.871+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b987c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.871+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c3a77a60 con 0x55a1c39e26b0 2023-07-14T13:13:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.871+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c3a77760 con 0x55a1c3b94a80 2023-07-14T13:13:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.871+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c395b8c0 con 0x55a1c3b94ed0 2023-07-14T13:13:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.871+0000 7fbbbe876b80 10 client.0 _ll_register_callbacks cb 0x55a1c3a75700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.872+0000 7fbba8d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.872+0000 7fbba8d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60774/0 (socket says 172.21.15.17:60774) 2023-07-14T13:13:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.872+0000 7fbba8d9b700 1 -- 172.21.15.17:0/3451552552 learned_addr learned my addr 172.21.15.17:0/3451552552 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.872+0000 7fbba959c700 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.872+0000 7fbba3fff700 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 0x55a1c3b98120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.872+0000 7fbba8d9b700 1 -- 172.21.15.17:0/3451552552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94ed0 msgr2=0x55a1c3b987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.872+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.872+0000 7fbba8d9b700 1 -- 172.21.15.17:0/3451552552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 msgr2=0x55a1c3b98120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.872+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 0x55a1c3b98120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.872+0000 7fbba8d9b700 1 -- 172.21.15.17:0/3451552552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba419d7a0 con 0x55a1c39e26b0 2023-07-14T13:13:14.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.872+0000 7fbba3fff700 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 0x55a1c3b98120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:14.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.873+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9ae00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800be40 tx=0x7fbb98009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79db077dce2769a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.873+0000 7fbb83fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:13:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.873+0000 7fbb83fff700 1 -- 172.21.15.17:0/3451552552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800be70 con 0x55a1c39e26b0 2023-07-14T13:13:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.873+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3451552552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1c3a31490 con 0x55a1c39e26b0 2023-07-14T13:13:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.873+0000 7fbb83fff700 1 -- 172.21.15.17:0/3451552552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbb9800f460 con 0x55a1c39e26b0 2023-07-14T13:13:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.873+0000 7fbb83fff700 1 -- 172.21.15.17:0/3451552552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb9800f620 con 0x55a1c39e26b0 2023-07-14T13:13:14.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.873+0000 7fbbbe876b80 10 client.17763 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:14.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.873+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3451552552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55a1c38eec00 con 0x55a1c39e26b0 2023-07-14T13:13:14.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.874+0000 7fbb83fff700 1 -- 172.21.15.17:0/3451552552 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb9803c020 con 0x55a1c39e26b0 2023-07-14T13:13:14.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.874+0000 7fbb83fff700 1 -- 172.21.15.17:0/3451552552 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fbb9802f6d0 con 0x55a1c39e26b0 2023-07-14T13:13:14.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.874+0000 7fbbbe876b80 10 client.17763 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:14.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.874+0000 7fbbbe876b80 10 client.17763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:14.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.874+0000 7fbbbe876b80 20 client.17763 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.874+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a1c3ba83e0 0x55a1c3baa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.874+0000 7fbbbe876b80 4 client.17763 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:13:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.874+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3451552552 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1c3ad0e50 con 0x55a1c3ba83e0 2023-07-14T13:13:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.874+0000 7fbba3fff700 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a1c3ba83e0 0x55a1c3baa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.875+0000 7fbba3fff700 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a1c3ba83e0 0x55a1c3baa7f0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b03fc04211d21b0e server_cookie=8bdcbf78e3cc9efc in_seq=0 out_seq=0 2023-07-14T13:13:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.875+0000 7fbb83fff700 10 client.17763 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.876+0000 7fbb83fff700 1 -- 172.21.15.17:0/3451552552 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a1c3ad0e50 con 0x55a1c3ba83e0 2023-07-14T13:13:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.876+0000 7fbb83fff700 10 client.17763 handle_command_reply: tid=0 2023-07-14T13:13:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.876+0000 7fbbbe876b80 1 client.17763 shutdown 2023-07-14T13:13:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.876+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3451552552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 msgr2=0x55a1c3b9ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.876+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9ae00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800be40 tx=0x7fbb98009ca0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.877+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3451552552 shutdown_connections 2023-07-14T13:13:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.877+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a1c3ba83e0 0x55a1c3baa7f0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.877+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.877+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9ae00 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.877+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/3451552552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 0x55a1c3b98120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.877+0000 7fbb83fff700 0 client.17763 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:14.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.877+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3451552552 >> 172.21.15.17:0/3451552552 conn(0x55a1c3b7bbe0 msgr2=0x55a1c3b804e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.877+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3451552552 shutdown_connections 2023-07-14T13:13:14.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.877+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3451552552 wait complete. 2023-07-14T13:13:14.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.877+0000 7fbbbe876b80 20 client.17763 trim_cache size 0 max 16384 2023-07-14T13:13:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.905+0000 7fbbbe876b80 1 Processor -- start 2023-07-14T13:13:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.905+0000 7fbbbe876b80 1 -- start start 2023-07-14T13:13:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 0x55a1c3b80c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b9a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c3b990d0 con 0x55a1c3b94ed0 2023-07-14T13:13:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c3b99700 con 0x55a1c39e26b0 2023-07-14T13:13:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c3ba5ac0 con 0x55a1c3b94a80 2023-07-14T13:13:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbba959c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b9a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbba8d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbba8d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35314/0 (socket says 172.21.15.17:35314) 2023-07-14T13:13:14.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbba8d9b700 1 -- 172.21.15.17:0/3898521705 learned_addr learned my addr 172.21.15.17:0/3898521705 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:14.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbba3fff700 1 --2- 172.21.15.17:0/3898521705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 0x55a1c3b80c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbba8d9b700 1 -- 172.21.15.17:0/3898521705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 msgr2=0x55a1c3b80c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/3898521705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 0x55a1c3b80c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbba8d9b700 1 -- 172.21.15.17:0/3898521705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c3b94ed0 msgr2=0x55a1c3b9a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/3898521705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b9a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.906+0000 7fbba8d9b700 1 -- 172.21.15.17:0/3898521705 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1c392c1f0 con 0x55a1c39e26b0 2023-07-14T13:13:14.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.907+0000 7fbba959c700 1 --2- 172.21.15.17:0/3898521705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b9a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.907+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/3898521705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9f4a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbb98005910 tx=0x7fbb9800bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e04d125846bfbf7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.907+0000 7fbb8f7fe700 1 -- 172.21.15.17:0/3898521705 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98004b70 con 0x55a1c39e26b0 2023-07-14T13:13:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.907+0000 7fbb8f7fe700 1 -- 172.21.15.17:0/3898521705 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb9803c070 con 0x55a1c39e26b0 2023-07-14T13:13:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.907+0000 7fbb8f7fe700 1 -- 172.21.15.17:0/3898521705 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800fa10 con 0x55a1c39e26b0 2023-07-14T13:13:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.908+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3898521705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c39e26b0 msgr2=0x55a1c3b9f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.908+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/3898521705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9f4a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbb98005910 tx=0x7fbb9800bfd0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.908+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3898521705 shutdown_connections 2023-07-14T13:13:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.908+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/3898521705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c3b94ed0 0x55a1c3b9a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.908+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/3898521705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9f4a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.908+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/3898521705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94a80 0x55a1c3b80c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.908+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3898521705 >> 172.21.15.17:0/3898521705 conn(0x55a1c3b7bbe0 msgr2=0x55a1c3b92320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.908+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3898521705 shutdown_connections 2023-07-14T13:13:14.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.908+0000 7fbbbe876b80 1 -- 172.21.15.17:0/3898521705 wait complete. 2023-07-14T13:13:14.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.909+0000 7fbbbe876b80 1 -- start start 2023-07-14T13:13:14.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.909+0000 7fbbbe876b80 1 Processor -- start 2023-07-14T13:13:14.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 0x55a1c3b9dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbbbe876b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94ed0 0x55a1c3bfb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c3b9e340 con 0x55a1c39e26b0 2023-07-14T13:13:14.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c3bfb7e0 con 0x55a1c3b94a80 2023-07-14T13:13:14.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbbbe876b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c3bfb950 con 0x55a1c3b94ed0 2023-07-14T13:13:14.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbbbe876b80 10 client.0 _ll_register_callbacks cb 0x7fbb9800ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:14.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbba3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 0x55a1c3b9dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbba3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 0x55a1c3b9dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35320/0 (socket says 172.21.15.17:35320) 2023-07-14T13:13:14.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbba3fff700 1 -- 172.21.15.17:0/4179030462 learned_addr learned my addr 172.21.15.17:0/4179030462 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:14.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbba959c700 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94ed0 0x55a1c3bfb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.910+0000 7fbba8d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.911+0000 7fbba3fff700 1 -- 172.21.15.17:0/4179030462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94ed0 msgr2=0x55a1c3bfb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.911+0000 7fbba3fff700 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94ed0 0x55a1c3bfb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.911+0000 7fbba3fff700 1 -- 172.21.15.17:0/4179030462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 msgr2=0x55a1c3b9d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.911+0000 7fbba3fff700 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.911+0000 7fbba3fff700 1 -- 172.21.15.17:0/4179030462 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1c38eec00 con 0x55a1c3b94a80 2023-07-14T13:13:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.911+0000 7fbba959c700 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94ed0 0x55a1c3bfb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.911+0000 7fbba3fff700 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 0x55a1c3b9dbc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbb900ca960 tx=0x7fbb9000bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5327db99eee6a469 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.911+0000 7fbb83fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:13:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.911+0000 7fbb83fff700 1 -- 172.21.15.17:0/4179030462 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900b8040 con 0x55a1c3b94a80 2023-07-14T13:13:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.911+0000 7fbb83fff700 1 -- 172.21.15.17:0/4179030462 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbb900b7040 con 0x55a1c3b94a80 2023-07-14T13:13:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.911+0000 7fbbbe876b80 1 -- 172.21.15.17:0/4179030462 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbb9009a230 con 0x55a1c3b94a80 2023-07-14T13:13:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.912+0000 7fbb83fff700 1 -- 172.21.15.17:0/4179030462 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb90004350 con 0x55a1c3b94a80 2023-07-14T13:13:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.912+0000 7fbbbe876b80 10 client.27500 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.912+0000 7fbbbe876b80 1 -- 172.21.15.17:0/4179030462 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55a1c3904250 con 0x55a1c3b94a80 2023-07-14T13:13:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.912+0000 7fbb83fff700 1 -- 172.21.15.17:0/4179030462 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbb9009a230 con 0x55a1c3b94a80 2023-07-14T13:13:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.912+0000 7fbb83fff700 1 -- 172.21.15.17:0/4179030462 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fbb90099840 con 0x55a1c3b94a80 2023-07-14T13:13:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.912+0000 7fbbbe876b80 10 client.27500 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.912+0000 7fbbbe876b80 10 client.27500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.912+0000 7fbbbe876b80 20 client.27500 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.912+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a1c3bfcbe0 0x55a1c3bfeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.912+0000 7fbbbe876b80 4 client.27500 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:13:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.912+0000 7fbbbe876b80 1 -- 172.21.15.17:0/4179030462 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a1c3a92ff0 con 0x55a1c3bfcbe0 2023-07-14T13:13:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.913+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a1c3bfcbe0 0x55a1c3bfeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.913+0000 7fbba8d9b700 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a1c3bfcbe0 0x55a1c3bfeff0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17e1452fad85ea06 server_cookie=9a73b8995cec52d8 in_seq=0 out_seq=0 2023-07-14T13:13:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.913+0000 7fbb83fff700 10 client.27500 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.932+0000 7fbb83fff700 1 -- 172.21.15.17:0/4179030462 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a1c3a92ff0 con 0x55a1c3bfcbe0 2023-07-14T13:13:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.932+0000 7fbb83fff700 10 client.27500 handle_command_reply: tid=0 2023-07-14T13:13:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.932+0000 7fbbbe876b80 1 client.27500 shutdown 2023-07-14T13:13:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.932+0000 7fbbbe876b80 1 -- 172.21.15.17:0/4179030462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 msgr2=0x55a1c3b9dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.932+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 0x55a1c3b9dbc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbb900ca960 tx=0x7fbb9000bf60 comp rx=0 tx=0).stop 2023-07-14T13:13:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.933+0000 7fbbbe876b80 1 -- 172.21.15.17:0/4179030462 shutdown_connections 2023-07-14T13:13:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.933+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a1c3bfcbe0 0x55a1c3bfeff0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.933+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a1c3b94ed0 0x55a1c3bfb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.933+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a1c39e26b0 0x55a1c3b9d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.933+0000 7fbbbe876b80 1 --2- 172.21.15.17:0/4179030462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1c3b94a80 0x55a1c3b9dbc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.933+0000 7fbb83fff700 0 client.27500 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.933+0000 7fbbbe876b80 1 -- 172.21.15.17:0/4179030462 >> 172.21.15.17:0/4179030462 conn(0x55a1c3b7bbe0 msgr2=0x55a1c3b85030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.933+0000 7fbbbe876b80 1 -- 172.21.15.17:0/4179030462 shutdown_connections 2023-07-14T13:13:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.933+0000 7fbbbe876b80 1 -- 172.21.15.17:0/4179030462 wait complete. 2023-07-14T13:13:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.933+0000 7fbbbe876b80 20 client.27500 trim_cache size 0 max 16384 2023-07-14T13:13:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:13:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:13:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:13:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:13:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 -- 172.21.15.17:0/2617251968 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbb940a1340 msgr2=0x7fbb940a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbb940a1340 0x7fbb940a37f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb98006010 tx=0x7fbb9800b260 comp rx=0 tx=0).stop 2023-07-14T13:13:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 -- 172.21.15.17:0/2617251968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbba40682b0 msgr2=0x7fbba41982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbba40682b0 0x7fbba41982f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000eb30 tx=0x7fbb9000ee40 comp rx=0 tx=0).stop 2023-07-14T13:13:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 -- 172.21.15.17:0/2617251968 shutdown_connections 2023-07-14T13:13:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbb940a1340 0x7fbb940a37f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbba410c540 0x7fbba419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbba40679a0 0x7fbba4197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 --2- 172.21.15.17:0/2617251968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbba40682b0 0x7fbba41982f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 -- 172.21.15.17:0/2617251968 >> 172.21.15.17:0/2617251968 conn(0x7fbba4074760 msgr2=0x7fbba40fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 -- 172.21.15.17:0/2617251968 shutdown_connections 2023-07-14T13:13:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:14.934+0000 7fbbaafff700 1 -- 172.21.15.17:0/2617251968 wait complete. 2023-07-14T13:13:15.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:15 smithi131 ceph-mon[96953]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 MiB/s wr, 42 op/s 2023-07-14T13:13:15.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:15 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:13:15.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:15 smithi017 ceph-mon[95536]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 MiB/s wr, 42 op/s 2023-07-14T13:13:15.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:15 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:13:15.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:15 smithi135 ceph-mon[97338]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 29 MiB/s wr, 42 op/s 2023-07-14T13:13:15.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:15 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:13:16.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:16 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:13:16.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:16 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:13:16.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:16 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:13:16.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:16 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:13:16.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:16 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:13:16.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:16 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:13:16.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:16 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:13:16.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:16 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:13:16.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:16 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:13:17.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:17 smithi131 ceph-mon[96953]: pgmap v425: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:13:17.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:17 smithi017 ceph-mon[95536]: pgmap v425: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:13:17.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:17 smithi135 ceph-mon[97338]: pgmap v425: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:13:19.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:19 smithi131 ceph-mon[96953]: pgmap v426: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:13:19.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:19 smithi017 ceph-mon[95536]: pgmap v426: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:13:19.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:19 smithi135 ceph-mon[97338]: pgmap v426: 97 pgs: 97 active+clean; 11 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:13:21.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:21 smithi131 ceph-mon[96953]: pgmap v427: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 32 op/s 2023-07-14T13:13:21.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:21 smithi017 ceph-mon[95536]: pgmap v427: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 32 op/s 2023-07-14T13:13:21.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:21 smithi135 ceph-mon[97338]: pgmap v427: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 32 op/s 2023-07-14T13:13:23.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:23 smithi017 ceph-mon[95536]: pgmap v428: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 26 MiB/s wr, 29 op/s 2023-07-14T13:13:23.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:23 smithi135 ceph-mon[97338]: pgmap v428: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 26 MiB/s wr, 29 op/s 2023-07-14T13:13:23.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:23 smithi131 ceph-mon[96953]: pgmap v428: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 26 MiB/s wr, 29 op/s 2023-07-14T13:13:25.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:25 smithi017 ceph-mon[95536]: pgmap v429: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-07-14T13:13:25.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:25 smithi135 ceph-mon[97338]: pgmap v429: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-07-14T13:13:25.754 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:25 smithi131 ceph-mon[96953]: pgmap v429: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 26 op/s 2023-07-14T13:13:27.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:27 smithi135 ceph-mon[97338]: pgmap v430: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 36 MiB/s wr, 34 op/s 2023-07-14T13:13:27.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:27 smithi131 ceph-mon[96953]: pgmap v430: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 36 MiB/s wr, 34 op/s 2023-07-14T13:13:27.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:27 smithi017 ceph-mon[95536]: pgmap v430: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 36 MiB/s wr, 34 op/s 2023-07-14T13:13:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.106+0000 7f16fc5ff700 1 -- 172.21.15.17:0/424516662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16f40685b0 msgr2=0x7f16f4104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.106+0000 7f16fc5ff700 1 --2- 172.21.15.17:0/424516662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16f40685b0 0x7f16f4104770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f16e40098f0 tx=0x7f16e4009c00 comp rx=0 tx=0).stop 2023-07-14T13:13:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.106+0000 7f16fc5ff700 1 -- 172.21.15.17:0/424516662 shutdown_connections 2023-07-14T13:13:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.106+0000 7f16fc5ff700 1 --2- 172.21.15.17:0/424516662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16f4104e50 0x7f16f410ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.106+0000 7f16fc5ff700 1 --2- 172.21.15.17:0/424516662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f4067c10 0x7f16f4067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.106+0000 7f16fc5ff700 1 --2- 172.21.15.17:0/424516662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16f40685b0 0x7f16f4104770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.106+0000 7f16fc5ff700 1 -- 172.21.15.17:0/424516662 >> 172.21.15.17:0/424516662 conn(0x7f16f4074760 msgr2=0x7f16f4074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.106+0000 7f16fc5ff700 1 -- 172.21.15.17:0/424516662 shutdown_connections 2023-07-14T13:13:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.107+0000 7f16fc5ff700 1 -- 172.21.15.17:0/424516662 wait complete. 2023-07-14T13:13:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.108+0000 7f16fc5ff700 1 Processor -- start 2023-07-14T13:13:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.108+0000 7f16fc5ff700 1 -- start start 2023-07-14T13:13:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16fc5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16f4067c10 0x7f16f4197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16fc5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40685b0 0x7f16f41982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16fc5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16f4104e50 0x7f16f419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16fc5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f419cf70 con 0x7f16f4067c10 2023-07-14T13:13:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16fc5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f419d0e0 con 0x7f16f40685b0 2023-07-14T13:13:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16fc5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f419d2a0 con 0x7f16f4104e50 2023-07-14T13:13:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16fa39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16f4067c10 0x7f16f4197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16f9b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40685b0 0x7f16f41982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16fa39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16f4067c10 0x7f16f4197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39506/0 (socket says 172.21.15.17:39506) 2023-07-14T13:13:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16fa39b700 1 -- 172.21.15.17:0/1313437079 learned_addr learned my addr 172.21.15.17:0/1313437079 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16fab9c700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16f4104e50 0x7f16f419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16f9b9a700 1 -- 172.21.15.17:0/1313437079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16f4104e50 msgr2=0x7f16f419c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16f4104e50 0x7f16f419c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16f9b9a700 1 -- 172.21.15.17:0/1313437079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16f4067c10 msgr2=0x7f16f4197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16f4067c10 0x7f16f4197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.109+0000 7f16f9b9a700 1 -- 172.21.15.17:0/1313437079 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4009520 con 0x7f16f40685b0 2023-07-14T13:13:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.110+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40685b0 0x7f16f41982c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f16e4000c00 tx=0x7f16e400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.110+0000 7f16eb7fe700 1 -- 172.21.15.17:0/1313437079 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e400b8f0 con 0x7f16f40685b0 2023-07-14T13:13:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.110+0000 7f16fc5ff700 1 -- 172.21.15.17:0/1313437079 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f419d520 con 0x7f16f40685b0 2023-07-14T13:13:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.110+0000 7f16eb7fe700 1 -- 172.21.15.17:0/1313437079 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16e400ba50 con 0x7f16f40685b0 2023-07-14T13:13:28.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.110+0000 7f16eb7fe700 1 -- 172.21.15.17:0/1313437079 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4003bf0 con 0x7f16f40685b0 2023-07-14T13:13:28.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.110+0000 7f16fc5ff700 1 -- 172.21.15.17:0/1313437079 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f41a4dc0 con 0x7f16f40685b0 2023-07-14T13:13:28.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.113+0000 7f16eb7fe700 1 -- 172.21.15.17:0/1313437079 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f16e4003d50 con 0x7f16f40685b0 2023-07-14T13:13:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.115+0000 7f171000ab80 1 Processor -- start 2023-07-14T13:13:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.115+0000 7f16eb7fe700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f16e00a1340 0x7f16e00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.115+0000 7f171000ab80 1 -- start start 2023-07-14T13:13:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f16eb7fe700 1 -- 172.21.15.17:0/1313437079 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f16e40cdcf0 con 0x7f16f40685b0 2023-07-14T13:13:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f16fab9c700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f16e00a1340 0x7f16e00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f171000ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2be06b0 0x5576a2d89d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f171000ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2d8a2d0 0x5576a2d84040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f171000ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 0x5576a2d849d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f171000ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2c89c50 con 0x5576a2d8a2d0 2023-07-14T13:13:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f171000ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2cdc9e0 con 0x5576a2be06b0 2023-07-14T13:13:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f171000ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2cd5e70 con 0x5576a2d84580 2023-07-14T13:13:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f16fa39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2be06b0 0x5576a2d89d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f16fa39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2be06b0 0x5576a2d89d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:46636/0 (socket says 172.21.15.17:46636) 2023-07-14T13:13:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f16fa39b700 1 -- 172.21.15.17:0/1186838013 learned_addr learned my addr 172.21.15.17:0/1186838013 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f16fab9c700 1 --2- 172.21.15.17:0/1186838013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 0x5576a2d849d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.116+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/1186838013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2d8a2d0 0x5576a2d84040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.117+0000 7f16fa39b700 1 -- 172.21.15.17:0/1186838013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 msgr2=0x5576a2d849d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.117+0000 7f16fa39b700 1 --2- 172.21.15.17:0/1186838013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 0x5576a2d849d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.117+0000 7f16fa39b700 1 -- 172.21.15.17:0/1186838013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2d8a2d0 msgr2=0x5576a2d84040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.117+0000 7f16fa39b700 1 --2- 172.21.15.17:0/1186838013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2d8a2d0 0x5576a2d84040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.117+0000 7f16fa39b700 1 -- 172.21.15.17:0/1186838013 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576a2b03d80 con 0x5576a2be06b0 2023-07-14T13:13:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.117+0000 7f16fab9c700 1 --2- 172.21.15.17:0/1186838013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 0x5576a2d849d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:13:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.117+0000 7f16fab9c700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f16e00a1340 0x7f16e00a37f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00f870 tx=0x7f16ec00fc30 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.117+0000 7f16fa39b700 1 --2- 172.21.15.17:0/1186838013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2be06b0 0x5576a2d89d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009e30 tx=0x7f16f0011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58dbb7681e5edf74 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.117+0000 7f16e8bfe700 1 -- 172.21.15.17:0/1186838013 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0019630 con 0x5576a2be06b0 2023-07-14T13:13:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.117+0000 7f16e8bfe700 1 -- 172.21.15.17:0/1186838013 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16f0019c20 con 0x5576a2be06b0 2023-07-14T13:13:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.117+0000 7f16e8bfe700 1 -- 172.21.15.17:0/1186838013 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f000ea70 con 0x5576a2be06b0 2023-07-14T13:13:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.118+0000 7f171000ab80 1 -- 172.21.15.17:0/1186838013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2be06b0 msgr2=0x5576a2d89d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:28.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.118+0000 7f171000ab80 1 --2- 172.21.15.17:0/1186838013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2be06b0 0x5576a2d89d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009e30 tx=0x7f16f0011720 comp rx=0 tx=0).stop 2023-07-14T13:13:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.118+0000 7f171000ab80 1 -- 172.21.15.17:0/1186838013 shutdown_connections 2023-07-14T13:13:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.118+0000 7f171000ab80 1 --2- 172.21.15.17:0/1186838013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 0x5576a2d849d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.118+0000 7f171000ab80 1 --2- 172.21.15.17:0/1186838013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2be06b0 0x5576a2d89d90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.118+0000 7f171000ab80 1 --2- 172.21.15.17:0/1186838013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2d8a2d0 0x5576a2d84040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.118+0000 7f171000ab80 1 -- 172.21.15.17:0/1186838013 >> 172.21.15.17:0/1186838013 conn(0x5576a2d79be0 msgr2=0x5576a2d7ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.118+0000 7f171000ab80 1 -- 172.21.15.17:0/1186838013 shutdown_connections 2023-07-14T13:13:28.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.118+0000 7f171000ab80 1 -- 172.21.15.17:0/1186838013 wait complete. 2023-07-14T13:13:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.119+0000 7f171000ab80 1 -- start start 2023-07-14T13:13:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.119+0000 7f171000ab80 1 Processor -- start 2023-07-14T13:13:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f171000ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 0x5576a2d90560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f171000ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 0x5576a2d8d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f171000ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d8a2d0 0x5576a2d8de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f171000ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2c75a60 con 0x5576a2be06b0 2023-07-14T13:13:28.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f171000ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2c75760 con 0x5576a2d8a2d0 2023-07-14T13:13:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f171000ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2b598c0 con 0x5576a2d84580 2023-07-14T13:13:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f171000ab80 10 client.0 _ll_register_callbacks cb 0x5576a2c73700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f16fa39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 0x5576a2d90560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f16fab9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d8a2d0 0x5576a2d8de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f16fa39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 0x5576a2d90560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39530/0 (socket says 172.21.15.17:39530) 2023-07-14T13:13:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f16f9b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 0x5576a2d8d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.120+0000 7f16fa39b700 1 -- 172.21.15.17:0/3223450227 learned_addr learned my addr 172.21.15.17:0/3223450227 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:28.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.121+0000 7f16f9b9a700 1 -- 172.21.15.17:0/3223450227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d8a2d0 msgr2=0x5576a2d8de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.121+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/3223450227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d8a2d0 0x5576a2d8de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.121+0000 7f16f9b9a700 1 -- 172.21.15.17:0/3223450227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 msgr2=0x5576a2d90560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.121+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/3223450227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 0x5576a2d90560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.121+0000 7f16f9b9a700 1 -- 172.21.15.17:0/3223450227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f0009a60 con 0x5576a2d84580 2023-07-14T13:13:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.121+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/3223450227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 0x5576a2d8d7e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f16e40cb400 tx=0x7f16e409ae10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c57abd4fe45dc288 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.121+0000 7f16ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:13:28.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.121+0000 7f16ddffb700 1 -- 172.21.15.17:0/3223450227 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4028e10 con 0x5576a2d84580 2023-07-14T13:13:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.121+0000 7f16ddffb700 1 -- 172.21.15.17:0/3223450227 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f16e40a31d0 con 0x5576a2d84580 2023-07-14T13:13:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.121+0000 7f171000ab80 1 -- 172.21.15.17:0/3223450227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576a2c2f490 con 0x5576a2d84580 2023-07-14T13:13:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.121+0000 7f16ddffb700 1 -- 172.21.15.17:0/3223450227 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e409b070 con 0x5576a2d84580 2023-07-14T13:13:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.122+0000 7f171000ab80 10 client.27475 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.122+0000 7f171000ab80 1 -- 172.21.15.17:0/3223450227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5576a2aecc00 con 0x5576a2d84580 2023-07-14T13:13:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.122+0000 7f16ddffb700 1 -- 172.21.15.17:0/3223450227 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16e40c9080 con 0x5576a2d84580 2023-07-14T13:13:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.122+0000 7f16ddffb700 1 -- 172.21.15.17:0/3223450227 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f16e40caf90 con 0x5576a2d84580 2023-07-14T13:13:28.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.122+0000 7f171000ab80 10 client.27475 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:28.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.122+0000 7f171000ab80 10 client.27475 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:28.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.122+0000 7f171000ab80 20 client.27475 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:28.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.122+0000 7f171000ab80 1 --2- 172.21.15.17:0/3223450227 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5576a2d9d7c0 0x5576a2d9fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.122+0000 7f171000ab80 4 client.27475 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:13:28.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.122+0000 7f171000ab80 1 -- 172.21.15.17:0/3223450227 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5576a2ccee50 con 0x5576a2d9d7c0 2023-07-14T13:13:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.123+0000 7f16fa39b700 1 --2- 172.21.15.17:0/3223450227 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5576a2d9d7c0 0x5576a2d9fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.123+0000 7f16ddffb700 10 client.27475 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.123+0000 7f16fa39b700 1 --2- 172.21.15.17:0/3223450227 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5576a2d9d7c0 0x5576a2d9fbd0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f909d965871b996d server_cookie=7910658b62b58140 in_seq=0 out_seq=0 2023-07-14T13:13:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.124+0000 7f16ddffb700 1 -- 172.21.15.17:0/3223450227 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5576a2ccee50 con 0x5576a2d9d7c0 2023-07-14T13:13:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.124+0000 7f16ddffb700 10 client.27475 handle_command_reply: tid=0 2023-07-14T13:13:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.124+0000 7f171000ab80 1 client.27475 shutdown 2023-07-14T13:13:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.124+0000 7f171000ab80 1 -- 172.21.15.17:0/3223450227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 msgr2=0x5576a2d8d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.124+0000 7f171000ab80 1 --2- 172.21.15.17:0/3223450227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 0x5576a2d8d7e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f16e40cb400 tx=0x7f16e409ae10 comp rx=0 tx=0).stop 2023-07-14T13:13:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.125+0000 7f171000ab80 1 -- 172.21.15.17:0/3223450227 shutdown_connections 2023-07-14T13:13:28.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.125+0000 7f171000ab80 1 --2- 172.21.15.17:0/3223450227 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5576a2d9d7c0 0x5576a2d9fbd0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.125+0000 7f171000ab80 1 --2- 172.21.15.17:0/3223450227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d8a2d0 0x5576a2d8de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.125+0000 7f16ddffb700 0 client.27475 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.125+0000 7f171000ab80 1 --2- 172.21.15.17:0/3223450227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 0x5576a2d90560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.125+0000 7f171000ab80 1 --2- 172.21.15.17:0/3223450227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d84580 0x5576a2d8d7e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.125+0000 7f171000ab80 1 -- 172.21.15.17:0/3223450227 >> 172.21.15.17:0/3223450227 conn(0x5576a2d79be0 msgr2=0x5576a2d7e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.125+0000 7f171000ab80 1 -- 172.21.15.17:0/3223450227 shutdown_connections 2023-07-14T13:13:28.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.125+0000 7f171000ab80 1 -- 172.21.15.17:0/3223450227 wait complete. 2023-07-14T13:13:28.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.125+0000 7f171000ab80 20 client.27475 trim_cache size 0 max 16384 2023-07-14T13:13:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f171000ab80 1 Processor -- start 2023-07-14T13:13:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f171000ab80 1 -- start start 2023-07-14T13:13:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f171000ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 0x5576a2d94c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f171000ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d84580 0x5576a2d90100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f171000ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d8a2d0 0x5576a2d7ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f171000ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2d80720 con 0x5576a2be06b0 2023-07-14T13:13:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f171000ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2d8a6a0 con 0x5576a2d84580 2023-07-14T13:13:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f171000ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2d8edc0 con 0x5576a2d8a2d0 2023-07-14T13:13:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f16fa39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 0x5576a2d94c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f16fa39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 0x5576a2d94c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39544/0 (socket says 172.21.15.17:39544) 2023-07-14T13:13:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f16fa39b700 1 -- 172.21.15.17:0/1805555623 learned_addr learned my addr 172.21.15.17:0/1805555623 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/1805555623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d84580 0x5576a2d90100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.146+0000 7f16fab9c700 1 --2- 172.21.15.17:0/1805555623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d8a2d0 0x5576a2d7ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.147+0000 7f16fa39b700 1 -- 172.21.15.17:0/1805555623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d8a2d0 msgr2=0x5576a2d7ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.147+0000 7f16fa39b700 1 --2- 172.21.15.17:0/1805555623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d8a2d0 0x5576a2d7ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.147+0000 7f16fa39b700 1 -- 172.21.15.17:0/1805555623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d84580 msgr2=0x5576a2d90100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.147+0000 7f16fa39b700 1 --2- 172.21.15.17:0/1805555623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d84580 0x5576a2d90100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.147+0000 7f16fa39b700 1 -- 172.21.15.17:0/1805555623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576a2b2a1f0 con 0x5576a2be06b0 2023-07-14T13:13:28.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.147+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/1805555623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d84580 0x5576a2d90100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:28.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.147+0000 7f16fa39b700 1 --2- 172.21.15.17:0/1805555623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 0x5576a2d94c60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f16f0000bc0 tx=0x7f16f0009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26690f8edd551563 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.147+0000 7f16e93ff700 1 -- 172.21.15.17:0/1805555623 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0019a10 con 0x5576a2be06b0 2023-07-14T13:13:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.148+0000 7f16e93ff700 1 -- 172.21.15.17:0/1805555623 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16f0019430 con 0x5576a2be06b0 2023-07-14T13:13:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.148+0000 7f16e93ff700 1 -- 172.21.15.17:0/1805555623 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0003ac0 con 0x5576a2be06b0 2023-07-14T13:13:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.148+0000 7f171000ab80 1 -- 172.21.15.17:0/1805555623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 msgr2=0x5576a2d94c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.148+0000 7f171000ab80 1 --2- 172.21.15.17:0/1805555623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 0x5576a2d94c60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f16f0000bc0 tx=0x7f16f0009fa0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.148+0000 7f171000ab80 1 -- 172.21.15.17:0/1805555623 shutdown_connections 2023-07-14T13:13:28.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.148+0000 7f171000ab80 1 --2- 172.21.15.17:0/1805555623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2d8a2d0 0x5576a2d7ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.148+0000 7f171000ab80 1 --2- 172.21.15.17:0/1805555623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2be06b0 0x5576a2d94c60 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.148+0000 7f171000ab80 1 --2- 172.21.15.17:0/1805555623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d84580 0x5576a2d90100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.148+0000 7f171000ab80 1 -- 172.21.15.17:0/1805555623 >> 172.21.15.17:0/1805555623 conn(0x5576a2d79be0 msgr2=0x5576a2d8b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.149+0000 7f171000ab80 1 -- 172.21.15.17:0/1805555623 shutdown_connections 2023-07-14T13:13:28.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.149+0000 7f171000ab80 1 -- 172.21.15.17:0/1805555623 wait complete. 2023-07-14T13:13:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.149+0000 7f171000ab80 1 -- start start 2023-07-14T13:13:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.149+0000 7f171000ab80 1 Processor -- start 2023-07-14T13:13:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f171000ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2be06b0 0x5576a2d94e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f171000ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2d84580 0x5576a2d85c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f171000ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d8a2d0 0x5576a2d861b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f171000ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2d86880 con 0x5576a2d84580 2023-07-14T13:13:28.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f171000ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2d869f0 con 0x5576a2d8a2d0 2023-07-14T13:13:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f171000ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576a2df1680 con 0x5576a2be06b0 2023-07-14T13:13:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f171000ab80 10 client.0 _ll_register_callbacks cb 0x5576a2c73700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f16f9b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2d84580 0x5576a2d85c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f16fa39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2be06b0 0x5576a2d94e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f16fa39b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2be06b0 0x5576a2d94e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52292/0 (socket says 172.21.15.17:52292) 2023-07-14T13:13:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f16fa39b700 1 -- 172.21.15.17:0/2864193480 learned_addr learned my addr 172.21.15.17:0/2864193480 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.150+0000 7f16fab9c700 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d8a2d0 0x5576a2d861b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.151+0000 7f16fa39b700 1 -- 172.21.15.17:0/2864193480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d8a2d0 msgr2=0x5576a2d861b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.151+0000 7f16fa39b700 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d8a2d0 0x5576a2d861b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.151+0000 7f16fa39b700 1 -- 172.21.15.17:0/2864193480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2d84580 msgr2=0x5576a2d85c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.151+0000 7f16fa39b700 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2d84580 0x5576a2d85c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.151+0000 7f16fa39b700 1 -- 172.21.15.17:0/2864193480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576a2aecc00 con 0x5576a2be06b0 2023-07-14T13:13:28.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.151+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2d84580 0x5576a2d85c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:28.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.151+0000 7f16fa39b700 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2be06b0 0x5576a2d94e60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f16f00195c0 tx=0x7f16f0011bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883a4d46b667c128 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.151+0000 7f16ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:13:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.151+0000 7f16ddffb700 1 -- 172.21.15.17:0/2864193480 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0005250 con 0x5576a2be06b0 2023-07-14T13:13:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.151+0000 7f16ddffb700 1 -- 172.21.15.17:0/2864193480 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f16f00053b0 con 0x5576a2be06b0 2023-07-14T13:13:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.151+0000 7f171000ab80 1 -- 172.21.15.17:0/2864193480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16f0019c20 con 0x5576a2be06b0 2023-07-14T13:13:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.152+0000 7f16ddffb700 1 -- 172.21.15.17:0/2864193480 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16f0005570 con 0x5576a2be06b0 2023-07-14T13:13:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.152+0000 7f171000ab80 10 client.27481 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.152+0000 7f171000ab80 1 -- 172.21.15.17:0/2864193480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5576a2b03d80 con 0x5576a2be06b0 2023-07-14T13:13:28.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.152+0000 7f16ddffb700 1 -- 172.21.15.17:0/2864193480 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16f003e080 con 0x5576a2be06b0 2023-07-14T13:13:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.152+0000 7f16ddffb700 1 -- 172.21.15.17:0/2864193480 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f16f000e7a0 con 0x5576a2be06b0 2023-07-14T13:13:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.152+0000 7f171000ab80 10 client.27481 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.152+0000 7f171000ab80 10 client.27481 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.152+0000 7f171000ab80 20 client.27481 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.152+0000 7f171000ab80 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5576a2df2930 0x5576a2df4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.152+0000 7f171000ab80 4 client.27481 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:13:28.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.152+0000 7f171000ab80 1 -- 172.21.15.17:0/2864193480 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5576a2c90ff0 con 0x5576a2df2930 2023-07-14T13:13:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.153+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5576a2df2930 0x5576a2df4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.153+0000 7f16f9b9a700 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5576a2df2930 0x5576a2df4d40 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=183d37c05539f9a9 server_cookie=171d8274c849ee2f in_seq=0 out_seq=0 2023-07-14T13:13:28.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.153+0000 7f16ddffb700 10 client.27481 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:28.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f16ddffb700 1 -- 172.21.15.17:0/2864193480 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5576a2c90ff0 con 0x5576a2df2930 2023-07-14T13:13:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f16ddffb700 10 client.27481 handle_command_reply: tid=0 2023-07-14T13:13:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f171000ab80 1 client.27481 shutdown 2023-07-14T13:13:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f171000ab80 1 -- 172.21.15.17:0/2864193480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2be06b0 msgr2=0x5576a2d94e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f171000ab80 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2be06b0 0x5576a2d94e60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f16f00195c0 tx=0x7f16f0011bc0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f171000ab80 1 -- 172.21.15.17:0/2864193480 shutdown_connections 2023-07-14T13:13:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f171000ab80 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5576a2df2930 0x5576a2df4d40 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f171000ab80 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5576a2d8a2d0 0x5576a2d861b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f171000ab80 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576a2be06b0 0x5576a2d94e60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f16ddffb700 0 client.27481 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f171000ab80 1 --2- 172.21.15.17:0/2864193480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5576a2d84580 0x5576a2d85c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.165+0000 7f171000ab80 1 -- 172.21.15.17:0/2864193480 >> 172.21.15.17:0/2864193480 conn(0x5576a2d79be0 msgr2=0x5576a2d88950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.166+0000 7f171000ab80 1 -- 172.21.15.17:0/2864193480 shutdown_connections 2023-07-14T13:13:28.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.166+0000 7f171000ab80 1 -- 172.21.15.17:0/2864193480 wait complete. 2023-07-14T13:13:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.166+0000 7f171000ab80 20 client.27481 trim_cache size 0 max 16384 2023-07-14T13:13:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:13:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:13:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:13:28.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:13:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.166+0000 7f16fc5ff700 1 -- 172.21.15.17:0/1313437079 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f16e00a1340 msgr2=0x7f16e00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.166+0000 7f16fc5ff700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f16e00a1340 0x7f16e00a37f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00f870 tx=0x7f16ec00fc30 comp rx=0 tx=0).stop 2023-07-14T13:13:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.166+0000 7f16fc5ff700 1 -- 172.21.15.17:0/1313437079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40685b0 msgr2=0x7f16f41982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:28.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.166+0000 7f16fc5ff700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40685b0 0x7f16f41982c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f16e4000c00 tx=0x7f16e400fa00 comp rx=0 tx=0).stop 2023-07-14T13:13:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.167+0000 7f16fc5ff700 1 -- 172.21.15.17:0/1313437079 shutdown_connections 2023-07-14T13:13:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.167+0000 7f16fc5ff700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f16e00a1340 0x7f16e00a37f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.167+0000 7f16fc5ff700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16f4104e50 0x7f16f419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.167+0000 7f16fc5ff700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16f4067c10 0x7f16f4197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.167+0000 7f16fc5ff700 1 --2- 172.21.15.17:0/1313437079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16f40685b0 0x7f16f41982c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.167+0000 7f16fc5ff700 1 -- 172.21.15.17:0/1313437079 >> 172.21.15.17:0/1313437079 conn(0x7f16f4074760 msgr2=0x7f16f40fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.167+0000 7f16fc5ff700 1 -- 172.21.15.17:0/1313437079 shutdown_connections 2023-07-14T13:13:28.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:28.167+0000 7f16fc5ff700 1 -- 172.21.15.17:0/1313437079 wait complete. 2023-07-14T13:13:29.455 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:29 smithi135 ceph-mon[97338]: pgmap v431: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 17 op/s 2023-07-14T13:13:29.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:29 smithi131 ceph-mon[96953]: pgmap v431: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 17 op/s 2023-07-14T13:13:29.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:29 smithi017 ceph-mon[95536]: pgmap v431: 97 pgs: 97 active+clean; 11 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 17 op/s 2023-07-14T13:13:31.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:31 smithi135 ceph-mon[97338]: pgmap v432: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 26 op/s 2023-07-14T13:13:31.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:31 smithi131 ceph-mon[96953]: pgmap v432: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 26 op/s 2023-07-14T13:13:31.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:31 smithi017 ceph-mon[95536]: pgmap v432: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 26 op/s 2023-07-14T13:13:33.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:33 smithi135 ceph-mon[97338]: pgmap v433: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-07-14T13:13:33.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:33 smithi131 ceph-mon[96953]: pgmap v433: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-07-14T13:13:33.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:33 smithi017 ceph-mon[95536]: pgmap v433: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-07-14T13:13:34.210 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:13:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.415+0000 7f03eabff700 1 -- 172.21.15.17:0/2994007275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03e40ff1c0 msgr2=0x7f03e410be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.415+0000 7f03eabff700 1 --2- 172.21.15.17:0/2994007275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03e40ff1c0 0x7f03e410be90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009990 tx=0x7f03d0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.415+0000 7f03eabff700 1 -- 172.21.15.17:0/2994007275 shutdown_connections 2023-07-14T13:13:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.415+0000 7f03eabff700 1 --2- 172.21.15.17:0/2994007275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03e410c3d0 0x7f03e410e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.415+0000 7f03eabff700 1 --2- 172.21.15.17:0/2994007275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e40fe820 0x7f03e40febf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.415+0000 7f03eabff700 1 --2- 172.21.15.17:0/2994007275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03e40ff1c0 0x7f03e410be90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.415+0000 7f03eabff700 1 -- 172.21.15.17:0/2994007275 >> 172.21.15.17:0/2994007275 conn(0x7f03e40fa4b0 msgr2=0x7f03e40fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.416+0000 7f03eabff700 1 -- 172.21.15.17:0/2994007275 shutdown_connections 2023-07-14T13:13:34.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.416+0000 7f03eabff700 1 -- 172.21.15.17:0/2994007275 wait complete. 2023-07-14T13:13:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.417+0000 7f03eabff700 1 Processor -- start 2023-07-14T13:13:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.417+0000 7f03eabff700 1 -- start start 2023-07-14T13:13:34.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.417+0000 7f03eabff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03e40fe820 0x7f03e4197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.417+0000 7f03eabff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e40ff1c0 0x7f03e41982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.417+0000 7f03eabff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03e410c3d0 0x7f03e419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.417+0000 7f03eabff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e419cd50 con 0x7f03e40ff1c0 2023-07-14T13:13:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.417+0000 7f03eabff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e419cec0 con 0x7f03e40fe820 2023-07-14T13:13:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.417+0000 7f03eabff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e419d080 con 0x7f03e410c3d0 2023-07-14T13:13:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e40ff1c0 0x7f03e41982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03e40fe820 0x7f03e4197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e40ff1c0 0x7f03e41982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39572/0 (socket says 172.21.15.17:39572) 2023-07-14T13:13:34.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03e40fe820 0x7f03e4197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:46684/0 (socket says 172.21.15.17:46684) 2023-07-14T13:13:34.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e3fff700 1 -- 172.21.15.17:0/2463199222 learned_addr learned my addr 172.21.15.17:0/2463199222 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:34.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e919c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03e410c3d0 0x7f03e419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e899b700 1 -- 172.21.15.17:0/2463199222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03e410c3d0 msgr2=0x7f03e419c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:34.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e899b700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03e410c3d0 0x7f03e419c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e899b700 1 -- 172.21.15.17:0/2463199222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e40ff1c0 msgr2=0x7f03e41982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:34.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e899b700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e40ff1c0 0x7f03e41982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e899b700 1 -- 172.21.15.17:0/2463199222 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d00095f0 con 0x7f03e40fe820 2023-07-14T13:13:34.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e3fff700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e40ff1c0 0x7f03e41982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:34.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.418+0000 7f03e899b700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03e40fe820 0x7f03e4197d70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e9f0 tx=0x7f03d800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:34.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.419+0000 7f03e1ffb700 1 -- 172.21.15.17:0/2463199222 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d800c9c0 con 0x7f03e40fe820 2023-07-14T13:13:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.419+0000 7f03e1ffb700 1 -- 172.21.15.17:0/2463199222 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03d8010430 con 0x7f03e40fe820 2023-07-14T13:13:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.419+0000 7f03eabff700 1 -- 172.21.15.17:0/2463199222 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e419d360 con 0x7f03e40fe820 2023-07-14T13:13:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.419+0000 7f03e1ffb700 1 -- 172.21.15.17:0/2463199222 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8018680 con 0x7f03e40fe820 2023-07-14T13:13:34.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.419+0000 7f03eabff700 1 -- 172.21.15.17:0/2463199222 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e41a4ba0 con 0x7f03e40fe820 2023-07-14T13:13:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.422+0000 7f03e1ffb700 1 -- 172.21.15.17:0/2463199222 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f03d80105a0 con 0x7f03e40fe820 2023-07-14T13:13:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.423+0000 7f03fe5d0b80 1 Processor -- start 2023-07-14T13:13:34.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.424+0000 7f03fe5d0b80 1 -- start start 2023-07-14T13:13:34.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.424+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f22d0 0x5564309f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.424+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f2be0 0x5564309fd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.424+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x5564309ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.424+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564308f8cb0 con 0x5564309f22d0 2023-07-14T13:13:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.424+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55643094ba40 con 0x5564309f2be0 2023-07-14T13:13:34.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.424+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556430944ed0 con 0x5564309fdad0 2023-07-14T13:13:34.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.424+0000 7f03e919c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f22d0 0x5564309f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.424+0000 7f03e919c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f22d0 0x5564309f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39584/0 (socket says 172.21.15.17:39584) 2023-07-14T13:13:34.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.424+0000 7f03e919c700 1 -- 172.21.15.17:0/4032360138 learned_addr learned my addr 172.21.15.17:0/4032360138 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:34.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e899b700 1 --2- 172.21.15.17:0/4032360138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f2be0 0x5564309fd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e3fff700 1 --2- 172.21.15.17:0/4032360138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x5564309ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e1ffb700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f03d40a1340 0x7f03d40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e899b700 1 -- 172.21.15.17:0/4032360138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 msgr2=0x5564309ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:34.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e899b700 1 --2- 172.21.15.17:0/4032360138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x5564309ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e899b700 1 -- 172.21.15.17:0/4032360138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f22d0 msgr2=0x5564309f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:34.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e1ffb700 1 -- 172.21.15.17:0/2463199222 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f03d8014070 con 0x7f03e40fe820 2023-07-14T13:13:34.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e899b700 1 --2- 172.21.15.17:0/4032360138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f22d0 0x5564309f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e899b700 1 -- 172.21.15.17:0/4032360138 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556430772de0 con 0x5564309f2be0 2023-07-14T13:13:34.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e3fff700 1 --2- 172.21.15.17:0/4032360138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x5564309ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:34.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e919c700 1 --2- 172.21.15.17:0/4032360138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f22d0 0x5564309f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:34.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.425+0000 7f03e919c700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f03d40a1340 0x7f03d40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.426+0000 7f03e899b700 1 --2- 172.21.15.17:0/4032360138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f2be0 0x5564309fd590 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f03d80ca500 tx=0x7f03d801af90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69d07e67c6f53533 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:34.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.426+0000 7f03ceffd700 1 -- 172.21.15.17:0/4032360138 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d80999c0 con 0x5564309f2be0 2023-07-14T13:13:34.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.426+0000 7f03ceffd700 1 -- 172.21.15.17:0/4032360138 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03d80997e0 con 0x5564309f2be0 2023-07-14T13:13:34.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.426+0000 7f03ceffd700 1 -- 172.21.15.17:0/4032360138 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8098220 con 0x5564309f2be0 2023-07-14T13:13:34.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.427+0000 7f03e919c700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f03d40a1340 0x7f03d40a37f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03dc007620 tx=0x7f03dc009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:34.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.427+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4032360138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f2be0 msgr2=0x5564309fd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:34.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.427+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/4032360138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f2be0 0x5564309fd590 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f03d80ca500 tx=0x7f03d801af90 comp rx=0 tx=0).stop 2023-07-14T13:13:34.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.427+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4032360138 shutdown_connections 2023-07-14T13:13:34.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.427+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/4032360138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x5564309ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.427+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/4032360138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f22d0 0x5564309f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.427+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/4032360138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f2be0 0x5564309fd590 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.427+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4032360138 >> 172.21.15.17:0/4032360138 conn(0x5564309e8da0 msgr2=0x5564309ee6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:34.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.427+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4032360138 shutdown_connections 2023-07-14T13:13:34.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.427+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4032360138 wait complete. 2023-07-14T13:13:34.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.427+0000 7f03fe5d0b80 1 -- start start 2023-07-14T13:13:34.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.428+0000 7f03fe5d0b80 1 Processor -- start 2023-07-14T13:13:34.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.428+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309f22d0 0x5564309fd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.428+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x5564309fa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.428+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309fdad0 0x5564309faec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.428+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564308e4ac0 con 0x5564309f2be0 2023-07-14T13:13:34.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.428+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564308e47c0 con 0x5564309fdad0 2023-07-14T13:13:34.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.428+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564307c8920 con 0x5564309f22d0 2023-07-14T13:13:34.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.428+0000 7f03fe5d0b80 10 client.0 _ll_register_callbacks cb 0x5564308e2760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:34.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309f22d0 0x5564309fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x5564309fa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e919c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309fdad0 0x5564309faec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309f22d0 0x5564309fd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52334/0 (socket says 172.21.15.17:52334) 2023-07-14T13:13:34.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e899b700 1 -- 172.21.15.17:0/4178614094 learned_addr learned my addr 172.21.15.17:0/4178614094 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:34.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e899b700 1 -- 172.21.15.17:0/4178614094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309fdad0 msgr2=0x5564309faec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:34.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e899b700 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309fdad0 0x5564309faec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e899b700 1 -- 172.21.15.17:0/4178614094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 msgr2=0x5564309fa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:34.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e899b700 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x5564309fa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e899b700 1 -- 172.21.15.17:0/4178614094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc0112c0 con 0x5564309f22d0 2023-07-14T13:13:34.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e3fff700 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x5564309fa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:34.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03e899b700 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309f22d0 0x5564309fd570 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009fd0 tx=0x7f03d80ca4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba7f1a13f3189245 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:34.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.429+0000 7f03c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:13:34.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03c3fff700 1 -- 172.21.15.17:0/4178614094 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d809a2e0 con 0x5564309f22d0 2023-07-14T13:13:34.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03c3fff700 1 -- 172.21.15.17:0/4178614094 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f03d8010880 con 0x5564309f22d0 2023-07-14T13:13:34.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4178614094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55643089e4f0 con 0x5564309f22d0 2023-07-14T13:13:34.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03c3fff700 1 -- 172.21.15.17:0/4178614094 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03d80999c0 con 0x5564309f22d0 2023-07-14T13:13:34.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03fe5d0b80 10 client.27493 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:34.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4178614094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f03e410f3f0 con 0x5564309f22d0 2023-07-14T13:13:34.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03c3fff700 1 -- 172.21.15.17:0/4178614094 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03d80b8030 con 0x5564309f22d0 2023-07-14T13:13:34.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03c3fff700 1 -- 172.21.15.17:0/4178614094 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f03d8099370 con 0x5564309f22d0 2023-07-14T13:13:34.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03fe5d0b80 10 client.27493 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:34.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03fe5d0b80 10 client.27493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:34.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03fe5d0b80 20 client.27493 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:34.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556430a0d040 0x556430a0f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03fe5d0b80 4 client.27493 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:13:34.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.430+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4178614094 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55643093deb0 con 0x556430a0d040 2023-07-14T13:13:34.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.431+0000 7f03e3fff700 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556430a0d040 0x556430a0f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.431+0000 7f03e3fff700 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556430a0d040 0x556430a0f450 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de877ea028fa30a5 server_cookie=8f2054d46ac3a148 in_seq=0 out_seq=0 2023-07-14T13:13:34.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.431+0000 7f03c3fff700 10 client.27493 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03c3fff700 1 -- 172.21.15.17:0/4178614094 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55643093deb0 con 0x556430a0d040 2023-07-14T13:13:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03c3fff700 10 client.27493 handle_command_reply: tid=0 2023-07-14T13:13:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03fe5d0b80 1 client.27493 shutdown 2023-07-14T13:13:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4178614094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309f22d0 msgr2=0x5564309fd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:34.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309f22d0 0x5564309fd570 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009fd0 tx=0x7f03d80ca4e0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4178614094 shutdown_connections 2023-07-14T13:13:34.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556430a0d040 0x556430a0f450 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309fdad0 0x5564309faec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309f22d0 0x5564309fd570 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03c3fff700 0 client.27493 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:34.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/4178614094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x5564309fa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.432+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4178614094 >> 172.21.15.17:0/4178614094 conn(0x5564309e8da0 msgr2=0x5564309ee230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:34.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.433+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4178614094 shutdown_connections 2023-07-14T13:13:34.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.433+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/4178614094 wait complete. 2023-07-14T13:13:34.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.433+0000 7f03fe5d0b80 20 client.27493 trim_cache size 0 max 16384 2023-07-14T13:13:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.451+0000 7f03fe5d0b80 1 Processor -- start 2023-07-14T13:13:34.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.451+0000 7f03fe5d0b80 1 -- start start 2023-07-14T13:13:34.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.451+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x5564309fa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.451+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x5564309f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.451+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x5564309fd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.451+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556430a09db0 con 0x5564309f2be0 2023-07-14T13:13:34.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.451+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564309f3190 con 0x5564309f22d0 2023-07-14T13:13:34.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.451+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564309ef4f0 con 0x5564309fdad0 2023-07-14T13:13:34.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.451+0000 7f03e899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x5564309fa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.451+0000 7f03e919c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x5564309fd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.452+0000 7f03e899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x5564309fa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:46710/0 (socket says 172.21.15.17:46710) 2023-07-14T13:13:34.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.452+0000 7f03e899b700 1 -- 172.21.15.17:0/3251114833 learned_addr learned my addr 172.21.15.17:0/3251114833 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:34.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.452+0000 7f03e3fff700 1 --2- 172.21.15.17:0/3251114833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x5564309f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.452+0000 7f03e899b700 1 -- 172.21.15.17:0/3251114833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 msgr2=0x5564309fd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:34.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.452+0000 7f03e899b700 1 --2- 172.21.15.17:0/3251114833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x5564309fd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.452+0000 7f03e899b700 1 -- 172.21.15.17:0/3251114833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 msgr2=0x5564309f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:34.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.452+0000 7f03e899b700 1 --2- 172.21.15.17:0/3251114833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x5564309f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.452+0000 7f03e899b700 1 -- 172.21.15.17:0/3251114833 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e41a4ba0 con 0x5564309f22d0 2023-07-14T13:13:34.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.452+0000 7f03e919c700 1 --2- 172.21.15.17:0/3251114833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x5564309fd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:34.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.452+0000 7f03e899b700 1 --2- 172.21.15.17:0/3251114833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x5564309fa730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e9c0 tx=0x7f03d80caa60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54ea9d2c1a40506b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:34.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.452+0000 7f03cf7fe700 1 -- 172.21.15.17:0/3251114833 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d80999c0 con 0x5564309f22d0 2023-07-14T13:13:34.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.453+0000 7f03cf7fe700 1 -- 172.21.15.17:0/3251114833 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03d80b8040 con 0x5564309f22d0 2023-07-14T13:13:34.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.453+0000 7f03cf7fe700 1 -- 172.21.15.17:0/3251114833 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8099370 con 0x5564309f22d0 2023-07-14T13:13:34.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.453+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/3251114833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 msgr2=0x5564309fa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:34.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.453+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/3251114833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x5564309fa730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e9c0 tx=0x7f03d80caa60 comp rx=0 tx=0).stop 2023-07-14T13:13:34.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.453+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/3251114833 shutdown_connections 2023-07-14T13:13:34.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.453+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/3251114833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x5564309fd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.453+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/3251114833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x5564309fa730 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.453+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/3251114833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x5564309f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.453+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/3251114833 >> 172.21.15.17:0/3251114833 conn(0x5564309e8da0 msgr2=0x5564309fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:34.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.453+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/3251114833 shutdown_connections 2023-07-14T13:13:34.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.453+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/3251114833 wait complete. 2023-07-14T13:13:34.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.454+0000 7f03fe5d0b80 1 -- start start 2023-07-14T13:13:34.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.454+0000 7f03fe5d0b80 1 Processor -- start 2023-07-14T13:13:34.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x556430a02a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x556430a02f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03fe5d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x556430a034a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556430a04ae0 con 0x5564309f2be0 2023-07-14T13:13:34.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556430a60ef0 con 0x5564309f22d0 2023-07-14T13:13:34.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03fe5d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556430a61060 con 0x5564309fdad0 2023-07-14T13:13:34.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03fe5d0b80 10 client.0 _ll_register_callbacks cb 0x7f03dc009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:34.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x556430a02f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03e899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x556430a02a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03e899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x556430a02a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:46724/0 (socket says 172.21.15.17:46724) 2023-07-14T13:13:34.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03e899b700 1 -- 172.21.15.17:0/566769859 learned_addr learned my addr 172.21.15.17:0/566769859 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:34.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.455+0000 7f03e919c700 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x556430a034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03e3fff700 1 -- 172.21.15.17:0/566769859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 msgr2=0x556430a034a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:34.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03e3fff700 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x556430a034a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03e3fff700 1 -- 172.21.15.17:0/566769859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 msgr2=0x556430a02a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:34.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03e3fff700 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x556430a02a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03e3fff700 1 -- 172.21.15.17:0/566769859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc0115f0 con 0x5564309f2be0 2023-07-14T13:13:34.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03e899b700 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x556430a02a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:34.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03e919c700 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x556430a034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:34.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03e3fff700 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x556430a02f60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x5564309fbe30 tx=0x7f03d00053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8d84d469e3402 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:34.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:13:34.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03c3fff700 1 -- 172.21.15.17:0/566769859 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d001d040 con 0x5564309f2be0 2023-07-14T13:13:34.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/566769859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f03d80997e0 con 0x5564309f2be0 2023-07-14T13:13:34.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.456+0000 7f03c3fff700 1 -- 172.21.15.17:0/566769859 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f03d00056a0 con 0x5564309f2be0 2023-07-14T13:13:34.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.457+0000 7f03c3fff700 1 -- 172.21.15.17:0/566769859 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03d000f660 con 0x5564309f2be0 2023-07-14T13:13:34.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.457+0000 7f03fe5d0b80 10 client.17805 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:34.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.457+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/566769859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f03e410f3f0 con 0x5564309f2be0 2023-07-14T13:13:34.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.457+0000 7f03c3fff700 1 -- 172.21.15.17:0/566769859 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03d80997e0 con 0x5564309f2be0 2023-07-14T13:13:34.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.457+0000 7f03c3fff700 1 -- 172.21.15.17:0/566769859 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f03d003c760 con 0x5564309f2be0 2023-07-14T13:13:34.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.457+0000 7f03fe5d0b80 10 client.17805 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:34.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.457+0000 7f03fe5d0b80 10 client.17805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:34.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.457+0000 7f03fe5d0b80 20 client.17805 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:34.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.457+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556430a62880 0x556430a64c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:34.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.457+0000 7f03fe5d0b80 4 client.17805 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:13:34.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.457+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/566769859 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556430900050 con 0x556430a62880 2023-07-14T13:13:34.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.458+0000 7f03e899b700 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556430a62880 0x556430a64c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:34.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.458+0000 7f03e899b700 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556430a62880 0x556430a64c90 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6acfd672bad24a67 server_cookie=5df6ac37636f9586 in_seq=0 out_seq=0 2023-07-14T13:13:34.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.458+0000 7f03c3fff700 10 client.17805 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:34.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.458+0000 7f03c3fff700 1 -- 172.21.15.17:0/566769859 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x556430900050 con 0x556430a62880 2023-07-14T13:13:34.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.458+0000 7f03c3fff700 10 client.17805 handle_command_reply: tid=0 2023-07-14T13:13:34.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.458+0000 7f03fe5d0b80 1 client.17805 shutdown 2023-07-14T13:13:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/566769859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 msgr2=0x556430a02f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x556430a02f60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x5564309fbe30 tx=0x7f03d00053a0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/566769859 shutdown_connections 2023-07-14T13:13:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556430a62880 0x556430a64c90 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564309fdad0 0x556430a034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564309f22d0 0x556430a02a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03fe5d0b80 1 --2- 172.21.15.17:0/566769859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564309f2be0 0x556430a02f60 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.503 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03c3fff700 0 client.17805 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:34.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/566769859 >> 172.21.15.17:0/566769859 conn(0x5564309e8da0 msgr2=0x5564309f8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:34.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/566769859 shutdown_connections 2023-07-14T13:13:34.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03fe5d0b80 1 -- 172.21.15.17:0/566769859 wait complete. 2023-07-14T13:13:34.504 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.459+0000 7f03fe5d0b80 20 client.17805 trim_cache size 0 max 16384 2023-07-14T13:13:34.504 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:13:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:13:34.506 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:13:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 -- 172.21.15.17:0/2463199222 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f03d40a1340 msgr2=0x7f03d40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f03d40a1340 0x7f03d40a37f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03dc007620 tx=0x7f03dc009040 comp rx=0 tx=0).stop 2023-07-14T13:13:34.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 -- 172.21.15.17:0/2463199222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03e40fe820 msgr2=0x7f03e4197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03e40fe820 0x7f03e4197d70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f03d800e9f0 tx=0x7f03d800ed00 comp rx=0 tx=0).stop 2023-07-14T13:13:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 -- 172.21.15.17:0/2463199222 shutdown_connections 2023-07-14T13:13:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f03d40a1340 0x7f03d40a37f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03e410c3d0 0x7f03e419c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03e40fe820 0x7f03e4197d70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 --2- 172.21.15.17:0/2463199222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03e40ff1c0 0x7f03e41982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:34.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 -- 172.21.15.17:0/2463199222 >> 172.21.15.17:0/2463199222 conn(0x7f03e40fa4b0 msgr2=0x7f03e410e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:34.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 -- 172.21.15.17:0/2463199222 shutdown_connections 2023-07-14T13:13:34.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:13:34.460+0000 7f03eabff700 1 -- 172.21.15.17:0/2463199222 wait complete. 2023-07-14T13:13:34.517 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:13:35.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:35 smithi135 ceph-mon[97338]: pgmap v434: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-14T13:13:35.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:35 smithi131 ceph-mon[96953]: pgmap v434: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-14T13:13:35.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:35 smithi017 ceph-mon[95536]: pgmap v434: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-14T13:13:37.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:37 smithi135 ceph-mon[97338]: pgmap v435: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 27 op/s 2023-07-14T13:13:37.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:37 smithi131 ceph-mon[96953]: pgmap v435: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 27 op/s 2023-07-14T13:13:37.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:37 smithi017 ceph-mon[95536]: pgmap v435: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 27 op/s 2023-07-14T13:13:39.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:39 smithi135 ceph-mon[97338]: pgmap v436: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-14T13:13:39.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:39 smithi131 ceph-mon[96953]: pgmap v436: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-14T13:13:39.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:39 smithi017 ceph-mon[95536]: pgmap v436: 97 pgs: 97 active+clean; 11 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-14T13:13:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.332+0000 7f71f01ff700 1 -- 172.21.15.17:0/2694490978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71e8102970 msgr2=0x7f71e8106930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:41.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.332+0000 7f71f01ff700 1 --2- 172.21.15.17:0/2694490978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71e8102970 0x7f71e8106930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009990 tx=0x7f71d8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.332+0000 7f71f01ff700 1 -- 172.21.15.17:0/2694490978 shutdown_connections 2023-07-14T13:13:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.332+0000 7f71f01ff700 1 --2- 172.21.15.17:0/2694490978 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e8107010 0x7f71e810ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.332+0000 7f71f01ff700 1 --2- 172.21.15.17:0/2694490978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71e8101fd0 0x7f71e81023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.332+0000 7f71f01ff700 1 --2- 172.21.15.17:0/2694490978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71e8102970 0x7f71e8106930 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.332+0000 7f71f01ff700 1 -- 172.21.15.17:0/2694490978 >> 172.21.15.17:0/2694490978 conn(0x7f71e80fd840 msgr2=0x7f71e80ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:41.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.332+0000 7f71f01ff700 1 -- 172.21.15.17:0/2694490978 shutdown_connections 2023-07-14T13:13:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.332+0000 7f71f01ff700 1 -- 172.21.15.17:0/2694490978 wait complete. 2023-07-14T13:13:41.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.333+0000 7f71f01ff700 1 Processor -- start 2023-07-14T13:13:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.333+0000 7f71f01ff700 1 -- start start 2023-07-14T13:13:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.333+0000 7f71f01ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71e8101fd0 0x7f71e8197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.333+0000 7f71f01ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71e8102970 0x7f71e8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.333+0000 7f71f01ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e8107010 0x7f71e819cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.333+0000 7f71f01ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e819d100 con 0x7f71e8102970 2023-07-14T13:13:41.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.333+0000 7f71f01ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e819d270 con 0x7f71e8101fd0 2023-07-14T13:13:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.333+0000 7f71f01ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e819d430 con 0x7f71e8107010 2023-07-14T13:13:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.334+0000 7f71ed79a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71e8102970 0x7f71e8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.334+0000 7f71edf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71e8101fd0 0x7f71e8197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.334+0000 7f71edf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71e8101fd0 0x7f71e8197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51054/0 (socket says 172.21.15.17:51054) 2023-07-14T13:13:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.334+0000 7f71edf9b700 1 -- 172.21.15.17:0/58512418 learned_addr learned my addr 172.21.15.17:0/58512418 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.334+0000 7f71ee79c700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e8107010 0x7f71e819cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.334+0000 7f71ed79a700 1 -- 172.21.15.17:0/58512418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e8107010 msgr2=0x7f71e819cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:41.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.334+0000 7f71ed79a700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e8107010 0x7f71e819cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.334+0000 7f71ed79a700 1 -- 172.21.15.17:0/58512418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71e8101fd0 msgr2=0x7f71e8197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.334+0000 7f71ed79a700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71e8101fd0 0x7f71e8197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.334+0000 7f71ed79a700 1 -- 172.21.15.17:0/58512418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4009520 con 0x7f71e8102970 2023-07-14T13:13:41.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.334+0000 7f71ee79c700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e8107010 0x7f71e819cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.335+0000 7f71ed79a700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71e8102970 0x7f71e8198450 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f71d80098e0 tx=0x7f71d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.335+0000 7f71deffd700 1 -- 172.21.15.17:0/58512418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d801d070 con 0x7f71e8102970 2023-07-14T13:13:41.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.335+0000 7f71f01ff700 1 -- 172.21.15.17:0/58512418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d80095f0 con 0x7f71e8102970 2023-07-14T13:13:41.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.335+0000 7f71deffd700 1 -- 172.21.15.17:0/58512418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71d8021410 con 0x7f71e8102970 2023-07-14T13:13:41.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.335+0000 7f71deffd700 1 -- 172.21.15.17:0/58512418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d80173f0 con 0x7f71e8102970 2023-07-14T13:13:41.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.335+0000 7f71f01ff700 1 -- 172.21.15.17:0/58512418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e81a4d70 con 0x7f71e8102970 2023-07-14T13:13:41.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.340+0000 7f71deffd700 1 -- 172.21.15.17:0/58512418 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f71d800fa90 con 0x7f71e8102970 2023-07-14T13:13:41.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.341+0000 7f7203a75b80 1 Processor -- start 2023-07-14T13:13:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.341+0000 7f7203a75b80 1 -- start start 2023-07-14T13:13:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 0x55dcb4149d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb4144040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb4144580 0x55dcb41449d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f7203a75b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb4049c50 con 0x55dcb4144580 2023-07-14T13:13:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f7203a75b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb409c9e0 con 0x55dcb3fa06b0 2023-07-14T13:13:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f7203a75b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb4095e70 con 0x55dcb414a2d0 2023-07-14T13:13:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f71ee79c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 0x55dcb4149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f71edf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb4144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f71deffd700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f71d40a12c0 0x7f71d40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f71edf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb4144040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44658/0 (socket says 172.21.15.17:44658) 2023-07-14T13:13:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f71ee79c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 0x55dcb4149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51060/0 (socket says 172.21.15.17:51060) 2023-07-14T13:13:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f71edf9b700 1 -- 172.21.15.17:0/959224155 learned_addr learned my addr 172.21.15.17:0/959224155 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f71ed79a700 1 --2- 172.21.15.17:0/959224155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb4144580 0x55dcb41449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.342+0000 7f71deffd700 1 -- 172.21.15.17:0/58512418 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f71d80cde30 con 0x7f71e8102970 2023-07-14T13:13:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.343+0000 7f71edf9b700 1 -- 172.21.15.17:0/959224155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 msgr2=0x55dcb4149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.343+0000 7f71edf9b700 1 --2- 172.21.15.17:0/959224155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 0x55dcb4149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.343+0000 7f71edf9b700 1 -- 172.21.15.17:0/959224155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb4144580 msgr2=0x55dcb41449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.343+0000 7f71edf9b700 1 --2- 172.21.15.17:0/959224155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb4144580 0x55dcb41449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.343+0000 7f71edf9b700 1 -- 172.21.15.17:0/959224155 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcb3ec3d80 con 0x55dcb414a2d0 2023-07-14T13:13:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.343+0000 7f71ee79c700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f71d40a12c0 0x7f71d40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.343+0000 7f71edf9b700 1 --2- 172.21.15.17:0/959224155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb4144040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f71e40114c0 tx=0x7f71e40117d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d88f1bbbd4a8b4c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.343+0000 7f71d3fff700 1 -- 172.21.15.17:0/959224155 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4019630 con 0x55dcb414a2d0 2023-07-14T13:13:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.343+0000 7f71d3fff700 1 -- 172.21.15.17:0/959224155 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71e4019c20 con 0x55dcb414a2d0 2023-07-14T13:13:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.343+0000 7f71d3fff700 1 -- 172.21.15.17:0/959224155 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400fbe0 con 0x55dcb414a2d0 2023-07-14T13:13:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.344+0000 7f7203a75b80 1 -- 172.21.15.17:0/959224155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 msgr2=0x55dcb4144040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.344+0000 7f7203a75b80 1 --2- 172.21.15.17:0/959224155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb4144040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f71e40114c0 tx=0x7f71e40117d0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.344+0000 7f71ee79c700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f71d40a12c0 0x7f71d40a3770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f71e00060b0 tx=0x7f71e0004ad0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.344+0000 7f7203a75b80 1 -- 172.21.15.17:0/959224155 shutdown_connections 2023-07-14T13:13:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.344+0000 7f7203a75b80 1 --2- 172.21.15.17:0/959224155 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb4144580 0x55dcb41449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.344+0000 7f7203a75b80 1 --2- 172.21.15.17:0/959224155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 0x55dcb4149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.344+0000 7f7203a75b80 1 --2- 172.21.15.17:0/959224155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb4144040 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.344+0000 7f7203a75b80 1 -- 172.21.15.17:0/959224155 >> 172.21.15.17:0/959224155 conn(0x55dcb4139be0 msgr2=0x55dcb413ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.344+0000 7f7203a75b80 1 -- 172.21.15.17:0/959224155 shutdown_connections 2023-07-14T13:13:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.344+0000 7f7203a75b80 1 -- 172.21.15.17:0/959224155 wait complete. 2023-07-14T13:13:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.345+0000 7f7203a75b80 1 -- start start 2023-07-14T13:13:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.345+0000 7f7203a75b80 1 Processor -- start 2023-07-14T13:13:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 0x55dcb4150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb4144580 0x55dcb414d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb414dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f7203a75b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb4035a60 con 0x55dcb3fa06b0 2023-07-14T13:13:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f7203a75b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb4035760 con 0x55dcb4144580 2023-07-14T13:13:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f7203a75b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb3f198c0 con 0x55dcb414a2d0 2023-07-14T13:13:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f7203a75b80 10 client.0 _ll_register_callbacks cb 0x55dcb4033700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f71ed79a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb4144580 0x55dcb414d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f71edf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 0x55dcb4150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f71ed79a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb4144580 0x55dcb414d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51070/0 (socket says 172.21.15.17:51070) 2023-07-14T13:13:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f71ed79a700 1 -- 172.21.15.17:0/3021071925 learned_addr learned my addr 172.21.15.17:0/3021071925 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.346+0000 7f71ee79c700 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb414dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f71ed79a700 1 -- 172.21.15.17:0/3021071925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 msgr2=0x55dcb414dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f71ed79a700 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb414dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f71ed79a700 1 -- 172.21.15.17:0/3021071925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 msgr2=0x55dcb4150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f71ed79a700 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 0x55dcb4150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f71ed79a700 1 -- 172.21.15.17:0/3021071925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e4009c90 con 0x55dcb4144580 2023-07-14T13:13:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f71ed79a700 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb4144580 0x55dcb414d880 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f71d80cb5a0 tx=0x7f71d8066b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3f8bae3ad8c2c3d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f71d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:13:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f71d17fa700 1 -- 172.21.15.17:0/3021071925 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d809b070 con 0x55dcb4144580 2023-07-14T13:13:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f7203a75b80 1 -- 172.21.15.17:0/3021071925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcb3fef490 con 0x55dcb4144580 2023-07-14T13:13:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f71d17fa700 1 -- 172.21.15.17:0/3021071925 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f71d809f0a0 con 0x55dcb4144580 2023-07-14T13:13:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f71d17fa700 1 -- 172.21.15.17:0/3021071925 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71d80a3430 con 0x55dcb4144580 2023-07-14T13:13:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f7203a75b80 10 client.27548 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.347+0000 7f7203a75b80 1 -- 172.21.15.17:0/3021071925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55dcb3eacc00 con 0x55dcb4144580 2023-07-14T13:13:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.348+0000 7f71d17fa700 1 -- 172.21.15.17:0/3021071925 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71d80b2030 con 0x55dcb4144580 2023-07-14T13:13:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.348+0000 7f71d17fa700 1 -- 172.21.15.17:0/3021071925 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f71d809b2d0 con 0x55dcb4144580 2023-07-14T13:13:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.348+0000 7f7203a75b80 10 client.27548 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.348+0000 7f7203a75b80 10 client.27548 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.348+0000 7f7203a75b80 20 client.27548 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.348+0000 7f7203a75b80 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dcb415d820 0x55dcb415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.348+0000 7f7203a75b80 4 client.27548 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:13:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.348+0000 7f7203a75b80 1 -- 172.21.15.17:0/3021071925 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dcb408ee50 con 0x55dcb415d820 2023-07-14T13:13:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.348+0000 7f71edf9b700 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dcb415d820 0x55dcb415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.349+0000 7f71edf9b700 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dcb415d820 0x55dcb415fc30 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bb18a7adb305d35 server_cookie=fb719a4e50d09a3f in_seq=0 out_seq=0 2023-07-14T13:13:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.349+0000 7f71d17fa700 10 client.27548 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f71d17fa700 1 -- 172.21.15.17:0/3021071925 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55dcb408ee50 con 0x55dcb415d820 2023-07-14T13:13:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f71d17fa700 10 client.27548 handle_command_reply: tid=0 2023-07-14T13:13:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f7203a75b80 1 client.27548 shutdown 2023-07-14T13:13:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f7203a75b80 1 -- 172.21.15.17:0/3021071925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb4144580 msgr2=0x55dcb414d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f7203a75b80 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb4144580 0x55dcb414d880 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f71d80cb5a0 tx=0x7f71d8066b30 comp rx=0 tx=0).stop 2023-07-14T13:13:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f7203a75b80 1 -- 172.21.15.17:0/3021071925 shutdown_connections 2023-07-14T13:13:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f7203a75b80 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dcb415d820 0x55dcb415fc30 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f7203a75b80 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb414dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f7203a75b80 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 0x55dcb4150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f7203a75b80 1 --2- 172.21.15.17:0/3021071925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb4144580 0x55dcb414d880 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f7203a75b80 1 -- 172.21.15.17:0/3021071925 >> 172.21.15.17:0/3021071925 conn(0x55dcb4139be0 msgr2=0x55dcb413dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f71d17fa700 0 client.27548 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f7203a75b80 1 -- 172.21.15.17:0/3021071925 shutdown_connections 2023-07-14T13:13:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.350+0000 7f7203a75b80 1 -- 172.21.15.17:0/3021071925 wait complete. 2023-07-14T13:13:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.351+0000 7f7203a75b80 20 client.27548 trim_cache size 0 max 16384 2023-07-14T13:13:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.367+0000 7f7203a75b80 1 Processor -- start 2023-07-14T13:13:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.367+0000 7f7203a75b80 1 -- start start 2023-07-14T13:13:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.367+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 0x55dcb4144040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.367+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb4144580 0x55dcb4154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.367+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb413ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f7203a75b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb4149a10 con 0x55dcb4144580 2023-07-14T13:13:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f7203a75b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb414ee60 con 0x55dcb3fa06b0 2023-07-14T13:13:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f7203a75b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb4140990 con 0x55dcb414a2d0 2023-07-14T13:13:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f71edf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 0x55dcb4144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f71ed79a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb4144580 0x55dcb4154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f71edf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 0x55dcb4144040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51076/0 (socket says 172.21.15.17:51076) 2023-07-14T13:13:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f71edf9b700 1 -- 172.21.15.17:0/2045125373 learned_addr learned my addr 172.21.15.17:0/2045125373 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f71ee79c700 1 --2- 172.21.15.17:0/2045125373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb413ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f71edf9b700 1 -- 172.21.15.17:0/2045125373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 msgr2=0x55dcb413ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f71edf9b700 1 --2- 172.21.15.17:0/2045125373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb413ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f71edf9b700 1 -- 172.21.15.17:0/2045125373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb4144580 msgr2=0x55dcb4154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f71edf9b700 1 --2- 172.21.15.17:0/2045125373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb4144580 0x55dcb4154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.368+0000 7f71edf9b700 1 -- 172.21.15.17:0/2045125373 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcb3eea1f0 con 0x55dcb3fa06b0 2023-07-14T13:13:41.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.369+0000 7f71edf9b700 1 --2- 172.21.15.17:0/2045125373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 0x55dcb4144040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009c60 tx=0x7f71e4009880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91a462fb382d6e7d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:41.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.369+0000 7f71dcff9700 1 -- 172.21.15.17:0/2045125373 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4011250 con 0x55dcb3fa06b0 2023-07-14T13:13:41.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.369+0000 7f71dcff9700 1 -- 172.21.15.17:0/2045125373 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71e402a040 con 0x55dcb3fa06b0 2023-07-14T13:13:41.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.369+0000 7f71dcff9700 1 -- 172.21.15.17:0/2045125373 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e402bac0 con 0x55dcb3fa06b0 2023-07-14T13:13:41.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.370+0000 7f7203a75b80 1 -- 172.21.15.17:0/2045125373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 msgr2=0x55dcb4144040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.370+0000 7f7203a75b80 1 --2- 172.21.15.17:0/2045125373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 0x55dcb4144040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009c60 tx=0x7f71e4009880 comp rx=0 tx=0).stop 2023-07-14T13:13:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.370+0000 7f7203a75b80 1 -- 172.21.15.17:0/2045125373 shutdown_connections 2023-07-14T13:13:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.370+0000 7f7203a75b80 1 --2- 172.21.15.17:0/2045125373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb414a2d0 0x55dcb413ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.370+0000 7f7203a75b80 1 --2- 172.21.15.17:0/2045125373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb3fa06b0 0x55dcb4144040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.370+0000 7f7203a75b80 1 --2- 172.21.15.17:0/2045125373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb4144580 0x55dcb4154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.370+0000 7f7203a75b80 1 -- 172.21.15.17:0/2045125373 >> 172.21.15.17:0/2045125373 conn(0x55dcb4139be0 msgr2=0x55dcb4147a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:41.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.370+0000 7f7203a75b80 1 -- 172.21.15.17:0/2045125373 shutdown_connections 2023-07-14T13:13:41.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.370+0000 7f7203a75b80 1 -- 172.21.15.17:0/2045125373 wait complete. 2023-07-14T13:13:41.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.370+0000 7f7203a75b80 1 -- start start 2023-07-14T13:13:41.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.371+0000 7f7203a75b80 1 Processor -- start 2023-07-14T13:13:41.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.371+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 0x55dcb4146810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.371+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb4144580 0x55dcb4146d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.371+0000 7f7203a75b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb414a2d0 0x55dcb4145790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f7203a75b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb4147290 con 0x55dcb3fa06b0 2023-07-14T13:13:41.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f7203a75b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb4147400 con 0x55dcb414a2d0 2023-07-14T13:13:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f7203a75b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb41475c0 con 0x55dcb4144580 2023-07-14T13:13:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f7203a75b80 10 client.0 _ll_register_callbacks cb 0x7f71d809ae40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f71edf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 0x55dcb4146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f71edf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 0x55dcb4146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50312/0 (socket says 172.21.15.17:50312) 2023-07-14T13:13:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f71edf9b700 1 -- 172.21.15.17:0/2422547405 learned_addr learned my addr 172.21.15.17:0/2422547405 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f71ed79a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb4144580 0x55dcb4146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f71ee79c700 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb414a2d0 0x55dcb4145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f71edf9b700 1 -- 172.21.15.17:0/2422547405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb4144580 msgr2=0x55dcb4146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f71edf9b700 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb4144580 0x55dcb4146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f71edf9b700 1 -- 172.21.15.17:0/2422547405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb414a2d0 msgr2=0x55dcb4145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f71edf9b700 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb414a2d0 0x55dcb4145790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f71edf9b700 1 -- 172.21.15.17:0/2422547405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcb3ec3d80 con 0x55dcb3fa06b0 2023-07-14T13:13:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.372+0000 7f71ed79a700 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb4144580 0x55dcb4146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.373+0000 7f71edf9b700 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 0x55dcb4146810 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009230 tx=0x7f71e40110e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c94d21dca8b2a2d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:41.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.373+0000 7f71d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:13:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.373+0000 7f71d17fa700 1 -- 172.21.15.17:0/2422547405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4005130 con 0x55dcb3fa06b0 2023-07-14T13:13:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.373+0000 7f7203a75b80 1 -- 172.21.15.17:0/2422547405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71e4019c20 con 0x55dcb3fa06b0 2023-07-14T13:13:41.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.373+0000 7f71d17fa700 1 -- 172.21.15.17:0/2422547405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f71e4005290 con 0x55dcb3fa06b0 2023-07-14T13:13:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.373+0000 7f71d17fa700 1 -- 172.21.15.17:0/2422547405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71e4005490 con 0x55dcb3fa06b0 2023-07-14T13:13:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.373+0000 7f7203a75b80 10 client.17823 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.373+0000 7f7203a75b80 1 -- 172.21.15.17:0/2422547405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55dcb3ec2250 con 0x55dcb3fa06b0 2023-07-14T13:13:41.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.374+0000 7f71d17fa700 1 -- 172.21.15.17:0/2422547405 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71e4019c20 con 0x55dcb3fa06b0 2023-07-14T13:13:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.374+0000 7f71d17fa700 1 -- 172.21.15.17:0/2422547405 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f71e402b910 con 0x55dcb3fa06b0 2023-07-14T13:13:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.374+0000 7f7203a75b80 10 client.17823 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.374+0000 7f7203a75b80 10 client.17823 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.374+0000 7f7203a75b80 20 client.17823 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.374+0000 7f7203a75b80 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dcb41b1c40 0x55dcb41b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.374+0000 7f7203a75b80 4 client.17823 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:13:41.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.374+0000 7f7203a75b80 1 -- 172.21.15.17:0/2422547405 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dcb4050ff0 con 0x55dcb41b1c40 2023-07-14T13:13:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.374+0000 7f71ed79a700 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dcb41b1c40 0x55dcb41b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.375+0000 7f71ed79a700 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dcb41b1c40 0x55dcb41b4050 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=473f57f402529836 server_cookie=470644e7bd13b0de in_seq=0 out_seq=0 2023-07-14T13:13:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.375+0000 7f71d17fa700 10 client.17823 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f71d17fa700 1 -- 172.21.15.17:0/2422547405 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dcb4050ff0 con 0x55dcb41b1c40 2023-07-14T13:13:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f71d17fa700 10 client.17823 handle_command_reply: tid=0 2023-07-14T13:13:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f7203a75b80 1 client.17823 shutdown 2023-07-14T13:13:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f7203a75b80 1 -- 172.21.15.17:0/2422547405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 msgr2=0x55dcb4146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f7203a75b80 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 0x55dcb4146810 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009230 tx=0x7f71e40110e0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f7203a75b80 1 -- 172.21.15.17:0/2422547405 shutdown_connections 2023-07-14T13:13:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f7203a75b80 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dcb41b1c40 0x55dcb41b4050 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f7203a75b80 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dcb414a2d0 0x55dcb4145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f7203a75b80 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dcb3fa06b0 0x55dcb4146810 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f7203a75b80 1 --2- 172.21.15.17:0/2422547405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcb4144580 0x55dcb4146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f7203a75b80 1 -- 172.21.15.17:0/2422547405 >> 172.21.15.17:0/2422547405 conn(0x55dcb4139be0 msgr2=0x55dcb4148a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f71d17fa700 0 client.17823 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f7203a75b80 1 -- 172.21.15.17:0/2422547405 shutdown_connections 2023-07-14T13:13:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.385+0000 7f7203a75b80 1 -- 172.21.15.17:0/2422547405 wait complete. 2023-07-14T13:13:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.386+0000 7f7203a75b80 20 client.17823 trim_cache size 0 max 16384 2023-07-14T13:13:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:13:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:13:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:13:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:13:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.386+0000 7f71f01ff700 1 -- 172.21.15.17:0/58512418 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f71d40a12c0 msgr2=0x7f71d40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.386+0000 7f71f01ff700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f71d40a12c0 0x7f71d40a3770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f71e00060b0 tx=0x7f71e0004ad0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.386+0000 7f71f01ff700 1 -- 172.21.15.17:0/58512418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71e8102970 msgr2=0x7f71e8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.386+0000 7f71f01ff700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71e8102970 0x7f71e8198450 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f71d80098e0 tx=0x7f71d8004730 comp rx=0 tx=0).stop 2023-07-14T13:13:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.386+0000 7f71f01ff700 1 -- 172.21.15.17:0/58512418 shutdown_connections 2023-07-14T13:13:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.386+0000 7f71f01ff700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f71d40a12c0 0x7f71d40a3770 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.386+0000 7f71f01ff700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71e8107010 0x7f71e819cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.386+0000 7f71f01ff700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71e8101fd0 0x7f71e8197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.386+0000 7f71f01ff700 1 --2- 172.21.15.17:0/58512418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71e8102970 0x7f71e8198450 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.386+0000 7f71f01ff700 1 -- 172.21.15.17:0/58512418 >> 172.21.15.17:0/58512418 conn(0x7f71e80fd840 msgr2=0x7f71e8105910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.387+0000 7f71f01ff700 1 -- 172.21.15.17:0/58512418 shutdown_connections 2023-07-14T13:13:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:41.387+0000 7f71f01ff700 1 -- 172.21.15.17:0/58512418 wait complete. 2023-07-14T13:13:41.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:41 smithi135 ceph-mon[97338]: pgmap v437: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 35 MiB/s wr, 25 op/s 2023-07-14T13:13:41.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:41 smithi131 ceph-mon[96953]: pgmap v437: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 35 MiB/s wr, 25 op/s 2023-07-14T13:13:41.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:41 smithi017 ceph-mon[95536]: pgmap v437: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 35 MiB/s wr, 25 op/s 2023-07-14T13:13:43.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:43 smithi135 ceph-mon[97338]: pgmap v438: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-14T13:13:43.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:43 smithi131 ceph-mon[96953]: pgmap v438: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-14T13:13:43.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:43 smithi017 ceph-mon[95536]: pgmap v438: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-14T13:13:45.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:45 smithi135 ceph-mon[97338]: pgmap v439: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-14T13:13:45.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:45 smithi131 ceph-mon[96953]: pgmap v439: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-14T13:13:45.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:45 smithi017 ceph-mon[95536]: pgmap v439: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-14T13:13:47.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:47 smithi135 ceph-mon[97338]: pgmap v440: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 27 op/s 2023-07-14T13:13:47.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:47 smithi131 ceph-mon[96953]: pgmap v440: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 27 op/s 2023-07-14T13:13:47.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:47 smithi017 ceph-mon[95536]: pgmap v440: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 27 op/s 2023-07-14T13:13:49.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:49 smithi135 ceph-mon[97338]: pgmap v441: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:13:49.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:49 smithi131 ceph-mon[96953]: pgmap v441: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:13:49.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:49 smithi017 ceph-mon[95536]: pgmap v441: 97 pgs: 97 active+clean; 11 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:13:51.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:51 smithi135 ceph-mon[97338]: pgmap v442: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 35 MiB/s wr, 25 op/s 2023-07-14T13:13:51.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:51 smithi131 ceph-mon[96953]: pgmap v442: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 35 MiB/s wr, 25 op/s 2023-07-14T13:13:51.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:51 smithi017 ceph-mon[95536]: pgmap v442: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 35 MiB/s wr, 25 op/s 2023-07-14T13:13:53.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:53 smithi135 ceph-mon[97338]: pgmap v443: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-14T13:13:53.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:53 smithi131 ceph-mon[96953]: pgmap v443: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-14T13:13:53.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:53 smithi017 ceph-mon[95536]: pgmap v443: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-14T13:13:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.566+0000 7ff188dff700 1 -- 172.21.15.17:0/1748218113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff184107010 msgr2=0x7ff18410ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.566+0000 7ff188dff700 1 --2- 172.21.15.17:0/1748218113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff184107010 0x7ff18410ebe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009fc0 tx=0x7ff17c00b330 comp rx=0 tx=0).stop 2023-07-14T13:13:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.566+0000 7ff188dff700 1 -- 172.21.15.17:0/1748218113 shutdown_connections 2023-07-14T13:13:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.566+0000 7ff188dff700 1 --2- 172.21.15.17:0/1748218113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff184107010 0x7ff18410ebe0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.566+0000 7ff188dff700 1 --2- 172.21.15.17:0/1748218113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff184101fd0 0x7ff1841023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.566+0000 7ff188dff700 1 --2- 172.21.15.17:0/1748218113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184102970 0x7ff184106930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.566+0000 7ff188dff700 1 -- 172.21.15.17:0/1748218113 >> 172.21.15.17:0/1748218113 conn(0x7ff1840fd840 msgr2=0x7ff1840ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.566+0000 7ff188dff700 1 -- 172.21.15.17:0/1748218113 shutdown_connections 2023-07-14T13:13:54.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.566+0000 7ff188dff700 1 -- 172.21.15.17:0/1748218113 wait complete. 2023-07-14T13:13:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.567+0000 7ff188dff700 1 Processor -- start 2023-07-14T13:13:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.567+0000 7ff188dff700 1 -- start start 2023-07-14T13:13:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.567+0000 7ff188dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff184101fd0 0x7ff184197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.567+0000 7ff188dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff184102970 0x7ff184198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.567+0000 7ff188dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184107010 0x7ff18419caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.567+0000 7ff188dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18419d0e0 con 0x7ff184107010 2023-07-14T13:13:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.567+0000 7ff188dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18419d250 con 0x7ff184102970 2023-07-14T13:13:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.567+0000 7ff188dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18419d410 con 0x7ff184101fd0 2023-07-14T13:13:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.568+0000 7ff18259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff184101fd0 0x7ff184197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.568+0000 7ff182d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184107010 0x7ff18419caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.568+0000 7ff18259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff184101fd0 0x7ff184197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:46504/0 (socket says 172.21.15.17:46504) 2023-07-14T13:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.568+0000 7ff18259c700 1 -- 172.21.15.17:0/63022982 learned_addr learned my addr 172.21.15.17:0/63022982 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.568+0000 7ff181d9b700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff184102970 0x7ff184198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.568+0000 7ff182d9d700 1 -- 172.21.15.17:0/63022982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff184101fd0 msgr2=0x7ff184197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.568+0000 7ff182d9d700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff184101fd0 0x7ff184197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.568+0000 7ff182d9d700 1 -- 172.21.15.17:0/63022982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff184102970 msgr2=0x7ff184198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.568+0000 7ff182d9d700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff184102970 0x7ff184198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.568+0000 7ff182d9d700 1 -- 172.21.15.17:0/63022982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1740095f0 con 0x7ff184107010 2023-07-14T13:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.568+0000 7ff18259c700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff184101fd0 0x7ff184197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.569+0000 7ff182d9d700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184107010 0x7ff18419caa0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff17c015000 tx=0x7ff17c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.569+0000 7ff1737fe700 1 -- 172.21.15.17:0/63022982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c00e040 con 0x7ff184107010 2023-07-14T13:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.569+0000 7ff188dff700 1 -- 172.21.15.17:0/63022982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17c009c40 con 0x7ff184107010 2023-07-14T13:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.569+0000 7ff1737fe700 1 -- 172.21.15.17:0/63022982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff17c00be80 con 0x7ff184107010 2023-07-14T13:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.569+0000 7ff1737fe700 1 -- 172.21.15.17:0/63022982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c005040 con 0x7ff184107010 2023-07-14T13:13:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.569+0000 7ff188dff700 1 -- 172.21.15.17:0/63022982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1841a4d50 con 0x7ff184107010 2023-07-14T13:13:54.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.574+0000 7ff1737fe700 1 -- 172.21.15.17:0/63022982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff17c01d6e0 con 0x7ff184107010 2023-07-14T13:13:54.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.575+0000 7ff19c728b80 1 Processor -- start 2023-07-14T13:13:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff19c728b80 1 -- start start 2023-07-14T13:13:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa7ffad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7ff5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ff5580 0x561fa7ff59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff19c728b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa7efac50 con 0x561fa7ffb2d0 2023-07-14T13:13:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff19c728b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa7f4d9e0 con 0x561fa7e516b0 2023-07-14T13:13:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff19c728b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa7f46e70 con 0x561fa7ff5580 2023-07-14T13:13:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff181d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa7ffad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff181d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa7ffad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52244/0 (socket says 172.21.15.17:52244) 2023-07-14T13:13:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff181d9b700 1 -- 172.21.15.17:0/2734892965 learned_addr learned my addr 172.21.15.17:0/2734892965 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:54.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff18259c700 1 --2- 172.21.15.17:0/2734892965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7ff5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff181d9b700 1 --2- 172.21.15.17:0/2734892965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ff5580 0x561fa7ff59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.576+0000 7ff1737fe700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff16c0a12c0 0x7ff16c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.577+0000 7ff1737fe700 1 -- 172.21.15.17:0/63022982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff17c0cdf70 con 0x7ff184107010 2023-07-14T13:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.577+0000 7ff181d9b700 1 -- 172.21.15.17:0/2734892965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ff5580 msgr2=0x561fa7ff59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.577+0000 7ff181d9b700 1 --2- 172.21.15.17:0/2734892965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ff5580 0x561fa7ff59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.577+0000 7ff181d9b700 1 -- 172.21.15.17:0/2734892965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 msgr2=0x561fa7ff5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.577+0000 7ff181d9b700 1 --2- 172.21.15.17:0/2734892965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7ff5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.577+0000 7ff181d9b700 1 -- 172.21.15.17:0/2734892965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fa7d74d80 con 0x561fa7e516b0 2023-07-14T13:13:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.577+0000 7ff18259c700 1 --2- 172.21.15.17:0/2734892965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7ff5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.577+0000 7ff182d9d700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff16c0a12c0 0x7ff16c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.577+0000 7ff181d9b700 1 --2- 172.21.15.17:0/2734892965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa7ffad90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff178013800 tx=0x7ff1780047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5db6c7731ee7289d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.578+0000 7ff182d9d700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff16c0a12c0 0x7ff16c0a3770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0975f0 tx=0x7ff17c00b330 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.578+0000 7ff170ff9700 1 -- 172.21.15.17:0/2734892965 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178013e20 con 0x561fa7e516b0 2023-07-14T13:13:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.578+0000 7ff170ff9700 1 -- 172.21.15.17:0/2734892965 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1780044e0 con 0x561fa7e516b0 2023-07-14T13:13:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.578+0000 7ff170ff9700 1 -- 172.21.15.17:0/2734892965 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178003d40 con 0x561fa7e516b0 2023-07-14T13:13:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.578+0000 7ff19c728b80 1 -- 172.21.15.17:0/2734892965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 msgr2=0x561fa7ffad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.578+0000 7ff19c728b80 1 --2- 172.21.15.17:0/2734892965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa7ffad90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff178013800 tx=0x7ff1780047c0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.579+0000 7ff19c728b80 1 -- 172.21.15.17:0/2734892965 shutdown_connections 2023-07-14T13:13:54.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.579+0000 7ff19c728b80 1 --2- 172.21.15.17:0/2734892965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ff5580 0x561fa7ff59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.579+0000 7ff19c728b80 1 --2- 172.21.15.17:0/2734892965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa7ffad90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.579+0000 7ff19c728b80 1 --2- 172.21.15.17:0/2734892965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7ff5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.579+0000 7ff19c728b80 1 -- 172.21.15.17:0/2734892965 >> 172.21.15.17:0/2734892965 conn(0x561fa7feabe0 msgr2=0x561fa7feff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.579+0000 7ff19c728b80 1 -- 172.21.15.17:0/2734892965 shutdown_connections 2023-07-14T13:13:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.579+0000 7ff19c728b80 1 -- 172.21.15.17:0/2734892965 wait complete. 2023-07-14T13:13:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.579+0000 7ff19c728b80 1 -- start start 2023-07-14T13:13:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.580+0000 7ff19c728b80 1 Processor -- start 2023-07-14T13:13:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.580+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa8001620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.580+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ff5580 0x561fa7ffe8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.580+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7ffef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.580+0000 7ff19c728b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa7ee6a60 con 0x561fa7ffb2d0 2023-07-14T13:13:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.580+0000 7ff19c728b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa7ee6760 con 0x561fa7e516b0 2023-07-14T13:13:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.580+0000 7ff19c728b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa7dca8c0 con 0x561fa7ff5580 2023-07-14T13:13:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.580+0000 7ff19c728b80 10 client.0 _ll_register_callbacks cb 0x561fa7ee4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff181d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7ffef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff181d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7ffef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48754/0 (socket says 172.21.15.17:48754) 2023-07-14T13:13:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff181d9b700 1 -- 172.21.15.17:0/1928589743 learned_addr learned my addr 172.21.15.17:0/1928589743 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff18259c700 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ff5580 0x561fa7ffe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff181d9b700 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa8001620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff18259c700 1 -- 172.21.15.17:0/1928589743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 msgr2=0x561fa8001620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff18259c700 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa8001620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff18259c700 1 -- 172.21.15.17:0/1928589743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 msgr2=0x561fa7ffef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff18259c700 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7ffef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff18259c700 1 -- 172.21.15.17:0/1928589743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff174011460 con 0x561fa7ff5580 2023-07-14T13:13:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff18259c700 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ff5580 0x561fa7ffe8a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x561fa7ff1b40 tx=0x7ff17400f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfbb3953da77f3da server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.581+0000 7ff169ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:13:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.582+0000 7ff169ffb700 1 -- 172.21.15.17:0/1928589743 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174017070 con 0x561fa7ff5580 2023-07-14T13:13:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.582+0000 7ff169ffb700 1 -- 172.21.15.17:0/1928589743 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff174012070 con 0x561fa7ff5580 2023-07-14T13:13:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.582+0000 7ff19c728b80 1 -- 172.21.15.17:0/1928589743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fa7ea0490 con 0x561fa7ff5580 2023-07-14T13:13:54.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.582+0000 7ff169ffb700 1 -- 172.21.15.17:0/1928589743 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff174012230 con 0x561fa7ff5580 2023-07-14T13:13:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.582+0000 7ff19c728b80 10 client.27529 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:54.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.582+0000 7ff19c728b80 1 -- 172.21.15.17:0/1928589743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7ff17801b040 con 0x561fa7ff5580 2023-07-14T13:13:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.582+0000 7ff169ffb700 1 -- 172.21.15.17:0/1928589743 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561fa7ea0490 con 0x561fa7ff5580 2023-07-14T13:13:54.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.583+0000 7ff169ffb700 1 -- 172.21.15.17:0/1928589743 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff174003960 con 0x561fa7ff5580 2023-07-14T13:13:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.583+0000 7ff19c728b80 10 client.27529 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.583+0000 7ff19c728b80 10 client.27529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.583+0000 7ff19c728b80 20 client.27529 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.583+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fa80173e0 0x561fa80197f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.583+0000 7ff19c728b80 4 client.27529 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:13:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.583+0000 7ff19c728b80 1 -- 172.21.15.17:0/1928589743 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fa7f3fe50 con 0x561fa80173e0 2023-07-14T13:13:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.583+0000 7ff181d9b700 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fa80173e0 0x561fa80197f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.584+0000 7ff181d9b700 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fa80173e0 0x561fa80197f0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77ebe3295f6fa9c0 server_cookie=33326a7b1910705e in_seq=0 out_seq=0 2023-07-14T13:13:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.584+0000 7ff169ffb700 10 client.27529 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff169ffb700 1 -- 172.21.15.17:0/1928589743 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561fa7f3fe50 con 0x561fa80173e0 2023-07-14T13:13:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff169ffb700 10 client.27529 handle_command_reply: tid=0 2023-07-14T13:13:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff19c728b80 1 client.27529 shutdown 2023-07-14T13:13:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff19c728b80 1 -- 172.21.15.17:0/1928589743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ff5580 msgr2=0x561fa7ffe8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ff5580 0x561fa7ffe8a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x561fa7ff1b40 tx=0x7ff17400f6a0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff19c728b80 1 -- 172.21.15.17:0/1928589743 shutdown_connections 2023-07-14T13:13:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fa80173e0 0x561fa80197f0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7ffef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff169ffb700 0 client.27529 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa8001620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1928589743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ff5580 0x561fa7ffe8a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff19c728b80 1 -- 172.21.15.17:0/1928589743 >> 172.21.15.17:0/1928589743 conn(0x561fa7feabe0 msgr2=0x561fa7fef4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff19c728b80 1 -- 172.21.15.17:0/1928589743 shutdown_connections 2023-07-14T13:13:54.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.585+0000 7ff19c728b80 1 -- 172.21.15.17:0/1928589743 wait complete. 2023-07-14T13:13:54.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.586+0000 7ff19c728b80 20 client.27529 trim_cache size 0 max 16384 2023-07-14T13:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.602+0000 7ff19c728b80 1 Processor -- start 2023-07-14T13:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.602+0000 7ff19c728b80 1 -- start start 2023-07-14T13:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.603+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7e516b0 0x561fa7ff5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.603+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7ff5580 0x561fa7ffa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.603+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7fefc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.603+0000 7ff19c728b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa7ea04c0 con 0x561fa7ffb2d0 2023-07-14T13:13:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.603+0000 7ff19c728b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa7ff1ba0 con 0x561fa7ff5580 2023-07-14T13:13:54.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.603+0000 7ff19c728b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa800b550 con 0x561fa7e516b0 2023-07-14T13:13:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.603+0000 7ff18259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7ff5580 0x561fa7ffa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.603+0000 7ff181d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7e516b0 0x561fa7ff5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.603+0000 7ff18259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7ff5580 0x561fa7ffa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52276/0 (socket says 172.21.15.17:52276) 2023-07-14T13:13:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.603+0000 7ff18259c700 1 -- 172.21.15.17:0/3881515480 learned_addr learned my addr 172.21.15.17:0/3881515480 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.603+0000 7ff181d9b700 1 --2- 172.21.15.17:0/3881515480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7fefc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.604+0000 7ff18259c700 1 -- 172.21.15.17:0/3881515480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7e516b0 msgr2=0x561fa7ff5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.604+0000 7ff18259c700 1 --2- 172.21.15.17:0/3881515480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7e516b0 0x561fa7ff5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.604+0000 7ff18259c700 1 -- 172.21.15.17:0/3881515480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 msgr2=0x561fa7fefc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.604+0000 7ff18259c700 1 --2- 172.21.15.17:0/3881515480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7fefc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.604+0000 7ff18259c700 1 -- 172.21.15.17:0/3881515480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fa7d5dc00 con 0x561fa7ff5580 2023-07-14T13:13:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.604+0000 7ff18259c700 1 --2- 172.21.15.17:0/3881515480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7ff5580 0x561fa7ffa140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff17400ffd0 tx=0x7ff174003f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baacabe451e26a39 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.604+0000 7ff1717fa700 1 -- 172.21.15.17:0/3881515480 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174017040 con 0x561fa7ff5580 2023-07-14T13:13:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.604+0000 7ff1717fa700 1 -- 172.21.15.17:0/3881515480 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1740050e0 con 0x561fa7ff5580 2023-07-14T13:13:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.604+0000 7ff1717fa700 1 -- 172.21.15.17:0/3881515480 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174003b10 con 0x561fa7ff5580 2023-07-14T13:13:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.605+0000 7ff19c728b80 1 -- 172.21.15.17:0/3881515480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7ff5580 msgr2=0x561fa7ffa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.605+0000 7ff19c728b80 1 --2- 172.21.15.17:0/3881515480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7ff5580 0x561fa7ffa140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff17400ffd0 tx=0x7ff174003f60 comp rx=0 tx=0).stop 2023-07-14T13:13:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.605+0000 7ff19c728b80 1 -- 172.21.15.17:0/3881515480 shutdown_connections 2023-07-14T13:13:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.605+0000 7ff19c728b80 1 --2- 172.21.15.17:0/3881515480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ffb2d0 0x561fa7fefc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.605+0000 7ff19c728b80 1 --2- 172.21.15.17:0/3881515480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7e516b0 0x561fa7ff5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.605+0000 7ff19c728b80 1 --2- 172.21.15.17:0/3881515480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7ff5580 0x561fa7ffa140 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.605+0000 7ff19c728b80 1 -- 172.21.15.17:0/3881515480 >> 172.21.15.17:0/3881515480 conn(0x561fa7feabe0 msgr2=0x561fa7ff9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.605+0000 7ff19c728b80 1 -- 172.21.15.17:0/3881515480 shutdown_connections 2023-07-14T13:13:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.605+0000 7ff19c728b80 1 -- 172.21.15.17:0/3881515480 wait complete. 2023-07-14T13:13:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.606+0000 7ff19c728b80 1 -- start start 2023-07-14T13:13:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.606+0000 7ff19c728b80 1 Processor -- start 2023-07-14T13:13:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.606+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa8005560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.606+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ff5580 0x561fa8005aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.606+0000 7ff19c728b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ffb2d0 0x561fa8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.606+0000 7ff19c728b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa8003ff0 con 0x561fa7ff5580 2023-07-14T13:13:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.606+0000 7ff19c728b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa8004160 con 0x561fa7e516b0 2023-07-14T13:13:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.606+0000 7ff19c728b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fa8004320 con 0x561fa7ffb2d0 2023-07-14T13:13:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.606+0000 7ff19c728b80 10 client.0 _ll_register_callbacks cb 0x7ff174012ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:13:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff181d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa8005560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff18259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ff5580 0x561fa8005aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff181d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa8005560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52278/0 (socket says 172.21.15.17:52278) 2023-07-14T13:13:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff181d9b700 1 -- 172.21.15.17:0/1296206287 learned_addr learned my addr 172.21.15.17:0/1296206287 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:13:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff181d9b700 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ffb2d0 0x561fa8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff181d9b700 1 -- 172.21.15.17:0/1296206287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ffb2d0 msgr2=0x561fa8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff181d9b700 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ffb2d0 0x561fa8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff181d9b700 1 -- 172.21.15.17:0/1296206287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ff5580 msgr2=0x561fa8005aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:13:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff181d9b700 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ff5580 0x561fa8005aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff181d9b700 1 -- 172.21.15.17:0/1296206287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17801b040 con 0x561fa7e516b0 2023-07-14T13:13:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff18259c700 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ff5580 0x561fa8005aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:13:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff181d9b700 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa8005560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x561fa8004f60 tx=0x7ff1780047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98226ad3969f833b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:13:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.607+0000 7ff169ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:13:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.608+0000 7ff169ffb700 1 -- 172.21.15.17:0/1296206287 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178027040 con 0x561fa7e516b0 2023-07-14T13:13:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.608+0000 7ff169ffb700 1 -- 172.21.15.17:0/1296206287 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff17802fa40 con 0x561fa7e516b0 2023-07-14T13:13:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.608+0000 7ff19c728b80 1 -- 172.21.15.17:0/1296206287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1780044e0 con 0x561fa7e516b0 2023-07-14T13:13:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.608+0000 7ff169ffb700 1 -- 172.21.15.17:0/1296206287 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff17802fc00 con 0x561fa7e516b0 2023-07-14T13:13:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.608+0000 7ff19c728b80 10 client.27572 fetch_fsmap learned FSMap version 39 2023-07-14T13:13:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.608+0000 7ff19c728b80 1 -- 172.21.15.17:0/1296206287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x561fa7d9b1f0 con 0x561fa7e516b0 2023-07-14T13:13:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.608+0000 7ff169ffb700 1 -- 172.21.15.17:0/1296206287 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff17803f080 con 0x561fa7e516b0 2023-07-14T13:13:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.609+0000 7ff169ffb700 1 -- 172.21.15.17:0/1296206287 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff178039060 con 0x561fa7e516b0 2023-07-14T13:13:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.609+0000 7ff19c728b80 10 client.27572 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:13:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.609+0000 7ff19c728b80 10 client.27572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.609+0000 7ff19c728b80 20 client.27572 populate_metadata read hostname 'smithi017' 2023-07-14T13:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.609+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fa806c310 0x561fa806e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.609+0000 7ff19c728b80 4 client.27572 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.609+0000 7ff19c728b80 1 -- 172.21.15.17:0/1296206287 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561fa7f01ff0 con 0x561fa806c310 2023-07-14T13:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.609+0000 7ff18259c700 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fa806c310 0x561fa806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.610+0000 7ff18259c700 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fa806c310 0x561fa806e720 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f9d0f6742492ef8 server_cookie=ca9ada29ce69acce in_seq=0 out_seq=0 2023-07-14T13:13:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.610+0000 7ff169ffb700 10 client.27572 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff169ffb700 1 -- 172.21.15.17:0/1296206287 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561fa7f01ff0 con 0x561fa806c310 2023-07-14T13:13:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff169ffb700 10 client.27572 handle_command_reply: tid=0 2023-07-14T13:13:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff19c728b80 1 client.27572 shutdown 2023-07-14T13:13:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff19c728b80 1 -- 172.21.15.17:0/1296206287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 msgr2=0x561fa8005560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa8005560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x561fa8004f60 tx=0x7ff1780047c0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff19c728b80 1 -- 172.21.15.17:0/1296206287 shutdown_connections 2023-07-14T13:13:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561fa806c310 0x561fa806e720 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa7ffb2d0 0x561fa8003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fa7e516b0 0x561fa8005560 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff169ffb700 0 client.27572 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff19c728b80 1 --2- 172.21.15.17:0/1296206287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561fa7ff5580 0x561fa8005aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff19c728b80 1 -- 172.21.15.17:0/1296206287 >> 172.21.15.17:0/1296206287 conn(0x561fa7feabe0 msgr2=0x561fa8000a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff19c728b80 1 -- 172.21.15.17:0/1296206287 shutdown_connections 2023-07-14T13:13:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.619+0000 7ff19c728b80 1 -- 172.21.15.17:0/1296206287 wait complete. 2023-07-14T13:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.620+0000 7ff19c728b80 20 client.27572 trim_cache size 0 max 16384 2023-07-14T13:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:13:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:13:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.620+0000 7ff188dff700 1 -- 172.21.15.17:0/63022982 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff16c0a12c0 msgr2=0x7ff16c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.620+0000 7ff188dff700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff16c0a12c0 0x7ff16c0a3770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0975f0 tx=0x7ff17c00b330 comp rx=0 tx=0).stop 2023-07-14T13:13:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.620+0000 7ff188dff700 1 -- 172.21.15.17:0/63022982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184107010 msgr2=0x7ff18419caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:13:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.620+0000 7ff188dff700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184107010 0x7ff18419caa0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff17c015000 tx=0x7ff17c0093d0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.621+0000 7ff188dff700 1 -- 172.21.15.17:0/63022982 shutdown_connections 2023-07-14T13:13:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.621+0000 7ff188dff700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff16c0a12c0 0x7ff16c0a3770 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.621+0000 7ff188dff700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff184107010 0x7ff18419caa0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.621+0000 7ff188dff700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff184101fd0 0x7ff184197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.621+0000 7ff188dff700 1 --2- 172.21.15.17:0/63022982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff184102970 0x7ff184198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:13:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.621+0000 7ff188dff700 1 -- 172.21.15.17:0/63022982 >> 172.21.15.17:0/63022982 conn(0x7ff1840fd840 msgr2=0x7ff1840fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:13:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.621+0000 7ff188dff700 1 -- 172.21.15.17:0/63022982 shutdown_connections 2023-07-14T13:13:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:13:54.621+0000 7ff188dff700 1 -- 172.21.15.17:0/63022982 wait complete. 2023-07-14T13:13:55.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:55 smithi131 ceph-mon[96953]: pgmap v444: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:13:55.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:55 smithi017 ceph-mon[95536]: pgmap v444: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:13:55.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:55 smithi135 ceph-mon[97338]: pgmap v444: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:13:57.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:57 smithi131 ceph-mon[96953]: pgmap v445: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 MiB/s wr, 29 op/s 2023-07-14T13:13:57.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:57 smithi017 ceph-mon[95536]: pgmap v445: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 MiB/s wr, 29 op/s 2023-07-14T13:13:57.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:57 smithi135 ceph-mon[97338]: pgmap v445: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 MiB/s wr, 29 op/s 2023-07-14T13:13:59.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:13:59 smithi131 ceph-mon[96953]: pgmap v446: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:13:59.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:13:59 smithi017 ceph-mon[95536]: pgmap v446: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:13:59.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:13:59 smithi135 ceph-mon[97338]: pgmap v446: 97 pgs: 97 active+clean; 12 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:14:01.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:01 smithi131 ceph-mon[96953]: pgmap v447: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 34 MiB/s wr, 25 op/s 2023-07-14T13:14:01.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:01 smithi017 ceph-mon[95536]: pgmap v447: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 34 MiB/s wr, 25 op/s 2023-07-14T13:14:01.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:01 smithi135 ceph-mon[97338]: pgmap v447: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 34 MiB/s wr, 25 op/s 2023-07-14T13:14:03.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:03 smithi131 ceph-mon[96953]: pgmap v448: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-14T13:14:03.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:03 smithi017 ceph-mon[95536]: pgmap v448: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-14T13:14:03.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:03 smithi135 ceph-mon[97338]: pgmap v448: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-14T13:14:04.518 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:14:04.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.717+0000 7efd3b3ff700 1 -- 172.21.15.17:0/2505421522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd34101f70 msgr2=0x7efd34102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:04.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.717+0000 7efd3b3ff700 1 --2- 172.21.15.17:0/2505421522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd34101f70 0x7efd34102340 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7efd300099c0 tx=0x7efd30009cd0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.717+0000 7efd3b3ff700 1 -- 172.21.15.17:0/2505421522 shutdown_connections 2023-07-14T13:14:04.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.717+0000 7efd3b3ff700 1 --2- 172.21.15.17:0/2505421522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd34106fb0 0x7efd3410eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.717+0000 7efd3b3ff700 1 --2- 172.21.15.17:0/2505421522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd34101f70 0x7efd34102340 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.717+0000 7efd3b3ff700 1 --2- 172.21.15.17:0/2505421522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd34102910 0x7efd341068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.717+0000 7efd3b3ff700 1 -- 172.21.15.17:0/2505421522 >> 172.21.15.17:0/2505421522 conn(0x7efd340fd7e0 msgr2=0x7efd340ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:04.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.717+0000 7efd3b3ff700 1 -- 172.21.15.17:0/2505421522 shutdown_connections 2023-07-14T13:14:04.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.717+0000 7efd3b3ff700 1 -- 172.21.15.17:0/2505421522 wait complete. 2023-07-14T13:14:04.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.718+0000 7efd3b3ff700 1 Processor -- start 2023-07-14T13:14:04.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.719+0000 7efd3b3ff700 1 -- start start 2023-07-14T13:14:04.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.719+0000 7efd3b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd34101f70 0x7efd34197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.719+0000 7efd3b3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd34102910 0x7efd341982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.719+0000 7efd3b3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd34106fb0 0x7efd3419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.719+0000 7efd3b3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3419cd80 con 0x7efd34102910 2023-07-14T13:14:04.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.719+0000 7efd3b3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3419cef0 con 0x7efd34106fb0 2023-07-14T13:14:04.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.719+0000 7efd3b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3419d0b0 con 0x7efd34101f70 2023-07-14T13:14:04.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.719+0000 7efd3899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd34102910 0x7efd341982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.719+0000 7efd3919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd34101f70 0x7efd34197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.719+0000 7efd3899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd34102910 0x7efd341982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51314/0 (socket says 172.21.15.17:51314) 2023-07-14T13:14:04.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.719+0000 7efd3899a700 1 -- 172.21.15.17:0/639771171 learned_addr learned my addr 172.21.15.17:0/639771171 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:04.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.720+0000 7efd3999c700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd34106fb0 0x7efd3419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.720+0000 7efd3919b700 1 -- 172.21.15.17:0/639771171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd34106fb0 msgr2=0x7efd3419c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:04.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.720+0000 7efd3919b700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd34106fb0 0x7efd3419c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.720+0000 7efd3919b700 1 -- 172.21.15.17:0/639771171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd34102910 msgr2=0x7efd341982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:04.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.720+0000 7efd3919b700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd34102910 0x7efd341982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.720+0000 7efd3919b700 1 -- 172.21.15.17:0/639771171 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300095f0 con 0x7efd34101f70 2023-07-14T13:14:04.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.720+0000 7efd3899a700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd34102910 0x7efd341982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:04.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.720+0000 7efd3919b700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd34101f70 0x7efd34197da0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efd30000c00 tx=0x7efd3000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:04.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.721+0000 7efd2a7fc700 1 -- 172.21.15.17:0/639771171 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3001d070 con 0x7efd34101f70 2023-07-14T13:14:04.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.721+0000 7efd2a7fc700 1 -- 172.21.15.17:0/639771171 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd30005050 con 0x7efd34101f70 2023-07-14T13:14:04.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.721+0000 7efd2a7fc700 1 -- 172.21.15.17:0/639771171 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30004950 con 0x7efd34101f70 2023-07-14T13:14:04.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.721+0000 7efd3b3ff700 1 -- 172.21.15.17:0/639771171 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3419d330 con 0x7efd34101f70 2023-07-14T13:14:04.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.721+0000 7efd3b3ff700 1 -- 172.21.15.17:0/639771171 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3419d5b0 con 0x7efd34101f70 2023-07-14T13:14:04.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.724+0000 7efd2a7fc700 1 -- 172.21.15.17:0/639771171 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7efd300051c0 con 0x7efd34101f70 2023-07-14T13:14:04.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.726+0000 7efd4ed58b80 1 Processor -- start 2023-07-14T13:14:04.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.726+0000 7efd4ed58b80 1 -- start start 2023-07-14T13:14:04.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.726+0000 7efd2a7fc700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd200a1340 0x7efd200a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.726+0000 7efd2a7fc700 1 -- 172.21.15.17:0/639771171 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efd300cd790 con 0x7efd34101f70 2023-07-14T13:14:04.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.726+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7f2d0 0x5629f7b7f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.726+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7fbe0 0x5629f7b8a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.726+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b8aad0 0x5629f7b8ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.726+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7a85cb0 con 0x5629f7b8aad0 2023-07-14T13:14:04.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.726+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7ad8a40 con 0x5629f7b7fbe0 2023-07-14T13:14:04.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.726+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7ad1ed0 con 0x5629f7b7f2d0 2023-07-14T13:14:04.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.726+0000 7efd3999c700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd200a1340 0x7efd200a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3899a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7fbe0 0x5629f7b8a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7f2d0 0x5629f7b7f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3899a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7fbe0 0x5629f7b8a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55686/0 (socket says 172.21.15.17:55686) 2023-07-14T13:14:04.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3899a700 1 -- 172.21.15.17:0/2304321957 learned_addr learned my addr 172.21.15.17:0/2304321957 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:04.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3999c700 1 --2- 172.21.15.17:0/2304321957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b8aad0 0x5629f7b8ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3919b700 1 -- 172.21.15.17:0/2304321957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7fbe0 msgr2=0x5629f7b8a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3919b700 1 --2- 172.21.15.17:0/2304321957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7fbe0 0x5629f7b8a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3919b700 1 -- 172.21.15.17:0/2304321957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b8aad0 msgr2=0x5629f7b8ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3919b700 1 --2- 172.21.15.17:0/2304321957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b8aad0 0x5629f7b8ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3919b700 1 -- 172.21.15.17:0/2304321957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629f78ffde0 con 0x5629f7b7f2d0 2023-07-14T13:14:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3919b700 1 --2- 172.21.15.17:0/2304321957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7f2d0 0x5629f7b7f6a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efd300caea0 tx=0x7efd3009a8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddee0c3177104ef1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.727+0000 7efd3999c700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd200a1340 0x7efd200a37f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00f870 tx=0x7efd2c00fc30 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:04.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.728+0000 7efd1f7fe700 1 -- 172.21.15.17:0/2304321957 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd300a2c70 con 0x5629f7b7f2d0 2023-07-14T13:14:04.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.728+0000 7efd1f7fe700 1 -- 172.21.15.17:0/2304321957 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd300054a0 con 0x5629f7b7f2d0 2023-07-14T13:14:04.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.728+0000 7efd1f7fe700 1 -- 172.21.15.17:0/2304321957 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30099da0 con 0x5629f7b7f2d0 2023-07-14T13:14:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.728+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2304321957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7f2d0 msgr2=0x5629f7b7f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.728+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2304321957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7f2d0 0x5629f7b7f6a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7efd300caea0 tx=0x7efd3009a8b0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.728+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2304321957 shutdown_connections 2023-07-14T13:14:04.771 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.728+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2304321957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b8aad0 0x5629f7b8ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.728+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2304321957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7f2d0 0x5629f7b7f6a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.728+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2304321957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7fbe0 0x5629f7b8a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.728+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2304321957 >> 172.21.15.17:0/2304321957 conn(0x5629f7b75da0 msgr2=0x5629f7b7b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.729+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2304321957 shutdown_connections 2023-07-14T13:14:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.729+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2304321957 wait complete. 2023-07-14T13:14:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.729+0000 7efd4ed58b80 1 -- start start 2023-07-14T13:14:04.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.729+0000 7efd4ed58b80 1 Processor -- start 2023-07-14T13:14:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7fbe0 0x5629f7b8b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b8aad0 0x5629f7b8b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7a71ac0 con 0x5629f7b8aad0 2023-07-14T13:14:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7a717c0 con 0x5629f7b7f2d0 2023-07-14T13:14:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7955920 con 0x5629f7b7fbe0 2023-07-14T13:14:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd4ed58b80 10 client.0 _ll_register_callbacks cb 0x5629f7a6f760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:04.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd3919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd3899a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7fbe0 0x5629f7b8b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd3999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b8aad0 0x5629f7b8b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd3899a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7fbe0 0x5629f7b8b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:42596/0 (socket says 172.21.15.17:42596) 2023-07-14T13:14:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd3899a700 1 -- 172.21.15.17:0/2633765366 learned_addr learned my addr 172.21.15.17:0/2633765366 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.730+0000 7efd3919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55702/0 (socket says 172.21.15.17:55702) 2023-07-14T13:14:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.731+0000 7efd3899a700 1 -- 172.21.15.17:0/2633765366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 msgr2=0x5629f7b8aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.731+0000 7efd3899a700 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.731+0000 7efd3899a700 1 -- 172.21.15.17:0/2633765366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b8aad0 msgr2=0x5629f7b8b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.731+0000 7efd3899a700 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b8aad0 0x5629f7b8b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.731+0000 7efd3899a700 1 -- 172.21.15.17:0/2633765366 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3419d330 con 0x5629f7b7fbe0 2023-07-14T13:14:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.731+0000 7efd3919b700 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.731+0000 7efd3899a700 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7fbe0 0x5629f7b8b3e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efd24012cf0 tx=0x7efd24009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d904160e527b3ac9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.731+0000 7efd1cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:14:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.731+0000 7efd1cff9700 1 -- 172.21.15.17:0/2633765366 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24017070 con 0x5629f7b7fbe0 2023-07-14T13:14:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.731+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2633765366 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629f7a2b4f0 con 0x5629f7b7fbe0 2023-07-14T13:14:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.731+0000 7efd1cff9700 1 -- 172.21.15.17:0/2633765366 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efd2400f8f0 con 0x5629f7b7fbe0 2023-07-14T13:14:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.732+0000 7efd1cff9700 1 -- 172.21.15.17:0/2633765366 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd240122e0 con 0x5629f7b7fbe0 2023-07-14T13:14:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.732+0000 7efd4ed58b80 10 client.27547 fetch_fsmap learned FSMap version 39 2023-07-14T13:14:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.732+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2633765366 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5629f78e8c60 con 0x5629f7b7fbe0 2023-07-14T13:14:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.732+0000 7efd1cff9700 1 -- 172.21.15.17:0/2633765366 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5629f7a2b4f0 con 0x5629f7b7fbe0 2023-07-14T13:14:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.732+0000 7efd1cff9700 1 -- 172.21.15.17:0/2633765366 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7efd24010c20 con 0x5629f7b7fbe0 2023-07-14T13:14:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.732+0000 7efd4ed58b80 10 client.27547 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:14:04.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.732+0000 7efd4ed58b80 10 client.27547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:04.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.732+0000 7efd4ed58b80 20 client.27547 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:04.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.732+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5629f7b9a280 0x5629f7b9c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.732+0000 7efd4ed58b80 4 client.27547 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:14:04.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.732+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2633765366 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629f7acaeb0 con 0x5629f7b9a280 2023-07-14T13:14:04.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.733+0000 7efd3919b700 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5629f7b9a280 0x5629f7b9c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.733+0000 7efd1cff9700 10 client.27547 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:04.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.733+0000 7efd3919b700 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5629f7b9a280 0x5629f7b9c690 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=883ee8b893480621 server_cookie=dd717ebe16ad9234 in_seq=0 out_seq=0 2023-07-14T13:14:04.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.734+0000 7efd1cff9700 1 -- 172.21.15.17:0/2633765366 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5629f7acaeb0 con 0x5629f7b9a280 2023-07-14T13:14:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.734+0000 7efd1cff9700 10 client.27547 handle_command_reply: tid=0 2023-07-14T13:14:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.734+0000 7efd4ed58b80 1 client.27547 shutdown 2023-07-14T13:14:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.734+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2633765366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7fbe0 msgr2=0x5629f7b8b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.734+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7fbe0 0x5629f7b8b3e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efd24012cf0 tx=0x7efd24009ee0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.735+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2633765366 shutdown_connections 2023-07-14T13:14:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.735+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5629f7b9a280 0x5629f7b9c690 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.735+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b8aad0 0x5629f7b8b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.735+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.735+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2633765366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b7fbe0 0x5629f7b8b3e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.735+0000 7efd1cff9700 0 client.27547 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.735+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2633765366 >> 172.21.15.17:0/2633765366 conn(0x5629f7b75da0 msgr2=0x5629f7b7b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.735+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2633765366 shutdown_connections 2023-07-14T13:14:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.735+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2633765366 wait complete. 2023-07-14T13:14:04.780 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.735+0000 7efd4ed58b80 20 client.27547 trim_cache size 0 max 16384 2023-07-14T13:14:04.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.756+0000 7efd4ed58b80 1 Processor -- start 2023-07-14T13:14:04.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.756+0000 7efd4ed58b80 1 -- start start 2023-07-14T13:14:04.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.757+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.757+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 0x5629f7b892b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.757+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b8aad0 0x5629f7b8b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.757+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7b95fc0 con 0x5629f7b7fbe0 2023-07-14T13:14:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.757+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7b849c0 con 0x5629f7b7f2d0 2023-07-14T13:14:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.757+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7b75970 con 0x5629f7b8aad0 2023-07-14T13:14:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.757+0000 7efd3899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 0x5629f7b892b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.757+0000 7efd3919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.757+0000 7efd3919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55718/0 (socket says 172.21.15.17:55718) 2023-07-14T13:14:04.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.757+0000 7efd3919b700 1 -- 172.21.15.17:0/921093705 learned_addr learned my addr 172.21.15.17:0/921093705 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:04.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.757+0000 7efd3999c700 1 --2- 172.21.15.17:0/921093705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b8aad0 0x5629f7b8b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.758+0000 7efd3899a700 1 -- 172.21.15.17:0/921093705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b8aad0 msgr2=0x5629f7b8b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:04.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.758+0000 7efd3899a700 1 --2- 172.21.15.17:0/921093705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b8aad0 0x5629f7b8b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.758+0000 7efd3899a700 1 -- 172.21.15.17:0/921093705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 msgr2=0x5629f7b8fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:04.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.758+0000 7efd3899a700 1 --2- 172.21.15.17:0/921093705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.758+0000 7efd3899a700 1 -- 172.21.15.17:0/921093705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629f7926250 con 0x5629f7b7fbe0 2023-07-14T13:14:04.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.758+0000 7efd3919b700 1 --2- 172.21.15.17:0/921093705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.758+0000 7efd3899a700 1 --2- 172.21.15.17:0/921093705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 0x5629f7b892b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x5629f7b8a090 tx=0x7efd24011fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569927ece7b530ef server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.758+0000 7efd1ffff700 1 -- 172.21.15.17:0/921093705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24017070 con 0x5629f7b7fbe0 2023-07-14T13:14:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.758+0000 7efd1ffff700 1 -- 172.21.15.17:0/921093705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd24018040 con 0x5629f7b7fbe0 2023-07-14T13:14:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.758+0000 7efd1ffff700 1 -- 172.21.15.17:0/921093705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2401ce00 con 0x5629f7b7fbe0 2023-07-14T13:14:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.759+0000 7efd4ed58b80 1 -- 172.21.15.17:0/921093705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 msgr2=0x5629f7b892b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.759+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/921093705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 0x5629f7b892b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x5629f7b8a090 tx=0x7efd24011fb0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.759+0000 7efd4ed58b80 1 -- 172.21.15.17:0/921093705 shutdown_connections 2023-07-14T13:14:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.759+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/921093705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b8aad0 0x5629f7b8b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.759+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/921093705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7b8fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.759+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/921093705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 0x5629f7b892b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.759+0000 7efd4ed58b80 1 -- 172.21.15.17:0/921093705 >> 172.21.15.17:0/921093705 conn(0x5629f7b75da0 msgr2=0x5629f7b8aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.759+0000 7efd4ed58b80 1 -- 172.21.15.17:0/921093705 shutdown_connections 2023-07-14T13:14:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.759+0000 7efd4ed58b80 1 -- 172.21.15.17:0/921093705 wait complete. 2023-07-14T13:14:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.760+0000 7efd4ed58b80 1 -- start start 2023-07-14T13:14:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.760+0000 7efd4ed58b80 1 Processor -- start 2023-07-14T13:14:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7be7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 0x5629f7be7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd4ed58b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b8aad0 0x5629f7b8bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7b8c2c0 con 0x5629f7b7fbe0 2023-07-14T13:14:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7b8c430 con 0x5629f7b7f2d0 2023-07-14T13:14:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd4ed58b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629f7b8c5f0 con 0x5629f7b8aad0 2023-07-14T13:14:04.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd4ed58b80 10 client.0 _ll_register_callbacks cb 0x7efd240127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7be7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3999c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b8aad0 0x5629f7b8bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 0x5629f7be7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3919b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7be7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55726/0 (socket says 172.21.15.17:55726) 2023-07-14T13:14:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3919b700 1 -- 172.21.15.17:0/2587094934 learned_addr learned my addr 172.21.15.17:0/2587094934 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3999c700 1 -- 172.21.15.17:0/2587094934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 msgr2=0x5629f7be7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3999c700 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7be7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3999c700 1 -- 172.21.15.17:0/2587094934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 msgr2=0x5629f7be7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3999c700 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 0x5629f7be7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3999c700 1 -- 172.21.15.17:0/2587094934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629f78ffde0 con 0x5629f7b8aad0 2023-07-14T13:14:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3919b700 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7be7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.761+0000 7efd3899a700 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 0x5629f7be7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.762+0000 7efd3999c700 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b8aad0 0x5629f7b8bcf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0060b0 tx=0x7efd2c004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed326dd55ece563 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.762+0000 7efd1cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:14:04.805 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.762+0000 7efd1cff9700 1 -- 172.21.15.17:0/2587094934 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c00e040 con 0x5629f7b8aad0 2023-07-14T13:14:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.762+0000 7efd1cff9700 1 -- 172.21.15.17:0/2587094934 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efd2c004bb0 con 0x5629f7b8aad0 2023-07-14T13:14:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.762+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2587094934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd300054a0 con 0x5629f7b8aad0 2023-07-14T13:14:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.763+0000 7efd1cff9700 1 -- 172.21.15.17:0/2587094934 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd2c00fe60 con 0x5629f7b8aad0 2023-07-14T13:14:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.763+0000 7efd4ed58b80 10 client.27553 fetch_fsmap learned FSMap version 39 2023-07-14T13:14:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.763+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2587094934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5629f78e8c60 con 0x5629f7b8aad0 2023-07-14T13:14:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.763+0000 7efd1cff9700 1 -- 172.21.15.17:0/2587094934 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd300054a0 con 0x5629f7b8aad0 2023-07-14T13:14:04.806 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.763+0000 7efd1cff9700 1 -- 172.21.15.17:0/2587094934 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) v1 ==== 7478+0+0 (secure 0 0 0) 0x7efd2c02c070 con 0x5629f7b8aad0 2023-07-14T13:14:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.763+0000 7efd4ed58b80 10 client.27553 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T13:14:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.763+0000 7efd4ed58b80 10 client.27553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.763+0000 7efd4ed58b80 20 client.27553 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.763+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5629f7bef260 0x5629f7bf1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.763+0000 7efd4ed58b80 4 client.27553 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:14:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.763+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2587094934 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5629f7a8d050 con 0x5629f7bef260 2023-07-14T13:14:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.764+0000 7efd3919b700 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5629f7bef260 0x5629f7bf1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:04.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.764+0000 7efd1cff9700 10 client.27553 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:04.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.764+0000 7efd3919b700 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5629f7bef260 0x5629f7bf1670 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64328b4c53e5d6fd server_cookie=e54fd56ca34df437 in_seq=0 out_seq=0 2023-07-14T13:14:04.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.764+0000 7efd1cff9700 1 -- 172.21.15.17:0/2587094934 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5629f7a8d050 con 0x5629f7bef260 2023-07-14T13:14:04.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.764+0000 7efd1cff9700 10 client.27553 handle_command_reply: tid=0 2023-07-14T13:14:04.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.764+0000 7efd4ed58b80 1 client.27553 shutdown 2023-07-14T13:14:04.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.764+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2587094934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b8aad0 msgr2=0x5629f7b8bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:04.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.764+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b8aad0 0x5629f7b8bcf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0060b0 tx=0x7efd2c004b40 comp rx=0 tx=0).stop 2023-07-14T13:14:04.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.765+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2587094934 shutdown_connections 2023-07-14T13:14:04.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.765+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5629f7bef260 0x5629f7bf1670 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.765+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5629f7b8aad0 0x5629f7b8bcf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.765+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5629f7b7f2d0 0x5629f7be7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.765+0000 7efd4ed58b80 1 --2- 172.21.15.17:0/2587094934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5629f7b7fbe0 0x5629f7be7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.765+0000 7efd1cff9700 0 client.27553 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:04.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.765+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2587094934 >> 172.21.15.17:0/2587094934 conn(0x5629f7b75da0 msgr2=0x5629f7b7b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:04.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.765+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2587094934 shutdown_connections 2023-07-14T13:14:04.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.765+0000 7efd4ed58b80 1 -- 172.21.15.17:0/2587094934 wait complete. 2023-07-14T13:14:04.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.765+0000 7efd4ed58b80 20 client.27553 trim_cache size 0 max 16384 2023-07-14T13:14:04.810 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:14:04.811 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T13:14:04.811 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:14:04.811 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:14:04.811 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:14:04.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:14:04.811 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:14:04.811 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:14:04.812 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:14:04.812 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:14:04.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 -- 172.21.15.17:0/639771171 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd200a1340 msgr2=0x7efd200a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:04.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd200a1340 0x7efd200a37f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00f870 tx=0x7efd2c00fc30 comp rx=0 tx=0).stop 2023-07-14T13:14:04.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 -- 172.21.15.17:0/639771171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd34101f70 msgr2=0x7efd34197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:04.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd34101f70 0x7efd34197da0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efd30000c00 tx=0x7efd3000f690 comp rx=0 tx=0).stop 2023-07-14T13:14:04.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 -- 172.21.15.17:0/639771171 shutdown_connections 2023-07-14T13:14:04.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd200a1340 0x7efd200a37f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd34106fb0 0x7efd3419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd34101f70 0x7efd34197da0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 --2- 172.21.15.17:0/639771171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd34102910 0x7efd341982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:04.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 -- 172.21.15.17:0/639771171 >> 172.21.15.17:0/639771171 conn(0x7efd340fd7e0 msgr2=0x7efd340fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:04.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 -- 172.21.15.17:0/639771171 shutdown_connections 2023-07-14T13:14:04.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:04.766+0000 7efd3b3ff700 1 -- 172.21.15.17:0/639771171 wait complete. 2023-07-14T13:14:04.826 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:14:05.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:05 smithi131 ceph-mon[96953]: pgmap v449: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:14:05.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:05 smithi017 ceph-mon[95536]: pgmap v449: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:14:05.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:05 smithi135 ceph-mon[97338]: pgmap v449: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:14:07.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:07 smithi131 ceph-mon[96953]: pgmap v450: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-07-14T13:14:07.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:07 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:14:07.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:07 smithi017 ceph-mon[95536]: pgmap v450: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-07-14T13:14:07.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:07 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:14:07.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:07 smithi135 ceph-mon[97338]: pgmap v450: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-07-14T13:14:07.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:07 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:14:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.792+0000 7f660a3ff700 1 -- 172.21.15.17:0/1813077635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66040ffb00 msgr2=0x7f66040fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.792+0000 7f660a3ff700 1 --2- 172.21.15.17:0/1813077635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66040ffb00 0x7f66040fff70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009990 tx=0x7f65f8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.792+0000 7f660a3ff700 1 -- 172.21.15.17:0/1813077635 shutdown_connections 2023-07-14T13:14:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.792+0000 7f660a3ff700 1 --2- 172.21.15.17:0/1813077635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66041004b0 0x7f660410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.792+0000 7f660a3ff700 1 --2- 172.21.15.17:0/1813077635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604105b10 0x7f6604105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.792+0000 7f660a3ff700 1 --2- 172.21.15.17:0/1813077635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66040ffb00 0x7f66040fff70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.792+0000 7f660a3ff700 1 -- 172.21.15.17:0/1813077635 >> 172.21.15.17:0/1813077635 conn(0x7f66040fb600 msgr2=0x7f66040fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.792+0000 7f660a3ff700 1 -- 172.21.15.17:0/1813077635 shutdown_connections 2023-07-14T13:14:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.792+0000 7f660a3ff700 1 -- 172.21.15.17:0/1813077635 wait complete. 2023-07-14T13:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.794+0000 7f660a3ff700 1 Processor -- start 2023-07-14T13:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.794+0000 7f660a3ff700 1 -- start start 2023-07-14T13:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.794+0000 7f660a3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66040ffb00 0x7f6604197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.794+0000 7f660a3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041004b0 0x7f66041982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.794+0000 7f660a3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604105b10 0x7f660419c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.794+0000 7f660a3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660419cfa0 con 0x7f6604105b10 2023-07-14T13:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.794+0000 7f660a3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660419d110 con 0x7f66040ffb00 2023-07-14T13:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.794+0000 7f660a3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660419d2d0 con 0x7f66041004b0 2023-07-14T13:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f66037fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041004b0 0x7f66041982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f6603fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66040ffb00 0x7f6604197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f660899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604105b10 0x7f660419c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f66037fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041004b0 0x7f66041982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55406/0 (socket says 172.21.15.17:55406) 2023-07-14T13:14:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f6603fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66040ffb00 0x7f6604197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55638/0 (socket says 172.21.15.17:55638) 2023-07-14T13:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f66037fe700 1 -- 172.21.15.17:0/3865414558 learned_addr learned my addr 172.21.15.17:0/3865414558 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f66037fe700 1 -- 172.21.15.17:0/3865414558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66040ffb00 msgr2=0x7f6604197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f66037fe700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66040ffb00 0x7f6604197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f66037fe700 1 -- 172.21.15.17:0/3865414558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604105b10 msgr2=0x7f660419c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f66037fe700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604105b10 0x7f660419c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f66037fe700 1 -- 172.21.15.17:0/3865414558 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f80095f0 con 0x7f66041004b0 2023-07-14T13:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f660899c700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604105b10 0x7f660419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.795+0000 7f66037fe700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041004b0 0x7f66041982f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f65f8005740 tx=0x7f65f8005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:07.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.796+0000 7f66017fa700 1 -- 172.21.15.17:0/3865414558 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f801d070 con 0x7f66041004b0 2023-07-14T13:14:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.796+0000 7f66017fa700 1 -- 172.21.15.17:0/3865414558 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65f8022470 con 0x7f66041004b0 2023-07-14T13:14:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.796+0000 7f660a3ff700 1 -- 172.21.15.17:0/3865414558 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660419d550 con 0x7f66041004b0 2023-07-14T13:14:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.796+0000 7f66017fa700 1 -- 172.21.15.17:0/3865414558 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8017650 con 0x7f66041004b0 2023-07-14T13:14:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.796+0000 7f660a3ff700 1 -- 172.21.15.17:0/3865414558 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66041a4df0 con 0x7f66041004b0 2023-07-14T13:14:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.799+0000 7f66017fa700 1 -- 172.21.15.17:0/3865414558 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f65f80225e0 con 0x7f66041004b0 2023-07-14T13:14:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.801+0000 7f661dcf7b80 1 Processor -- start 2023-07-14T13:14:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.801+0000 7f661dcf7b80 1 -- start start 2023-07-14T13:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.801+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 0x562e88560d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.801+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 0x562e8855b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.801+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e8855b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.801+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e88460c50 con 0x562e885612d0 2023-07-14T13:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.801+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e884b39e0 con 0x562e8855b580 2023-07-14T13:14:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.801+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e884ace70 con 0x562e883b76b0 2023-07-14T13:14:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f66037fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e8855b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f6603fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 0x562e8855b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f6603fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 0x562e8855b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39908/0 (socket says 172.21.15.17:39908) 2023-07-14T13:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f6603fff700 1 -- 172.21.15.17:0/4237080623 learned_addr learned my addr 172.21.15.17:0/4237080623 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f66017fa700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f65ec0a12c0 0x7f65ec0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f660899c700 1 --2- 172.21.15.17:0/4237080623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 0x562e88560d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f6603fff700 1 -- 172.21.15.17:0/4237080623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 msgr2=0x562e88560d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f6603fff700 1 --2- 172.21.15.17:0/4237080623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 0x562e88560d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f6603fff700 1 -- 172.21.15.17:0/4237080623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 msgr2=0x562e8855b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f6603fff700 1 --2- 172.21.15.17:0/4237080623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e8855b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f6603fff700 1 -- 172.21.15.17:0/4237080623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e882dad80 con 0x562e885612d0 2023-07-14T13:14:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f66017fa700 1 -- 172.21.15.17:0/3865414558 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f65f80ce020 con 0x7f66041004b0 2023-07-14T13:14:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.802+0000 7f660899c700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f65ec0a12c0 0x7f65ec0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.803+0000 7f6603fff700 1 --2- 172.21.15.17:0/4237080623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 0x562e8855b040 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009d00 tx=0x7f65f4011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfa49aaca0c3b31 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.803+0000 7f65ea7fc700 1 -- 172.21.15.17:0/4237080623 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4004230 con 0x562e885612d0 2023-07-14T13:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.803+0000 7f65ea7fc700 1 -- 172.21.15.17:0/4237080623 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65f4004390 con 0x562e885612d0 2023-07-14T13:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.803+0000 7f65ea7fc700 1 -- 172.21.15.17:0/4237080623 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4019750 con 0x562e885612d0 2023-07-14T13:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.804+0000 7f661dcf7b80 1 -- 172.21.15.17:0/4237080623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 msgr2=0x562e8855b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.804+0000 7f660899c700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f65ec0a12c0 0x7f65ec0a3770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009fd0 tx=0x7f65fc009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.804+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/4237080623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 0x562e8855b040 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009d00 tx=0x7f65f4011720 comp rx=0 tx=0).stop 2023-07-14T13:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.804+0000 7f661dcf7b80 1 -- 172.21.15.17:0/4237080623 shutdown_connections 2023-07-14T13:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.804+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/4237080623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e8855b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.804+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/4237080623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 0x562e88560d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.804+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/4237080623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 0x562e8855b040 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.804+0000 7f661dcf7b80 1 -- 172.21.15.17:0/4237080623 >> 172.21.15.17:0/4237080623 conn(0x562e88550be0 msgr2=0x562e88555f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.804+0000 7f661dcf7b80 1 -- 172.21.15.17:0/4237080623 shutdown_connections 2023-07-14T13:14:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.804+0000 7f661dcf7b80 1 -- 172.21.15.17:0/4237080623 wait complete. 2023-07-14T13:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.805+0000 7f661dcf7b80 1 -- start start 2023-07-14T13:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.805+0000 7f661dcf7b80 1 Processor -- start 2023-07-14T13:14:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.805+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 0x562e88567570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.805+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e885647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.805+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e885612d0 0x562e88564e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.805+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e8844ca60 con 0x562e883b76b0 2023-07-14T13:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.805+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e8844c760 con 0x562e8855b580 2023-07-14T13:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.805+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e883308c0 con 0x562e885612d0 2023-07-14T13:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f661dcf7b80 10 client.0 _ll_register_callbacks cb 0x562e8844a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f660899c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e885612d0 0x562e88564e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f66037fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e885647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f660899c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e885612d0 0x562e88564e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55438/0 (socket says 172.21.15.17:55438) 2023-07-14T13:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f660899c700 1 -- 172.21.15.17:0/2092008315 learned_addr learned my addr 172.21.15.17:0/2092008315 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f6603fff700 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 0x562e88567570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f660899c700 1 -- 172.21.15.17:0/2092008315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 msgr2=0x562e885647f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f660899c700 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e885647f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f660899c700 1 -- 172.21.15.17:0/2092008315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 msgr2=0x562e88567570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f660899c700 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 0x562e88567570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f660899c700 1 -- 172.21.15.17:0/2092008315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f4009960 con 0x562e885612d0 2023-07-14T13:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f66037fe700 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e885647f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.806+0000 7f6603fff700 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 0x562e88567570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.807+0000 7f660899c700 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e885612d0 0x562e88564e70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f65fc007ab0 tx=0x7f65fc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9436e9e8f1be08a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.807+0000 7f65e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.807+0000 7f65e37fe700 1 -- 172.21.15.17:0/2092008315 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00eb80 con 0x562e885612d0 2023-07-14T13:14:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.807+0000 7f65e37fe700 1 -- 172.21.15.17:0/2092008315 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f65fc01c030 con 0x562e885612d0 2023-07-14T13:14:07.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.807+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2092008315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e88406490 con 0x562e885612d0 2023-07-14T13:14:07.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.807+0000 7f65e37fe700 1 -- 172.21.15.17:0/2092008315 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65fc00ece0 con 0x562e885612d0 2023-07-14T13:14:07.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.807+0000 7f661dcf7b80 10 client.27565 fetch_fsmap learned FSMap version 40 2023-07-14T13:14:07.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.807+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2092008315 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x562e882c3c00 con 0x562e885612d0 2023-07-14T13:14:07.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.808+0000 7f65e37fe700 1 -- 172.21.15.17:0/2092008315 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562e88406490 con 0x562e885612d0 2023-07-14T13:14:07.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.808+0000 7f65e37fe700 1 -- 172.21.15.17:0/2092008315 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 40) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f65fc023450 con 0x562e885612d0 2023-07-14T13:14:07.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.808+0000 7f661dcf7b80 10 client.27565 fetch_fsmap finished waiting for FSMap version 40 2023-07-14T13:14:07.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.808+0000 7f661dcf7b80 10 client.27565 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.808+0000 7f661dcf7b80 20 client.27565 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.808+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e88574c40 0x562e88577050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.808+0000 7f661dcf7b80 4 client.27565 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:14:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.808+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2092008315 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e884a5e50 con 0x562e88574c40 2023-07-14T13:14:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.808+0000 7f6603fff700 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e88574c40 0x562e88577050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.809+0000 7f6603fff700 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e88574c40 0x562e88577050 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0307a587ca20d1f server_cookie=85d7737f7063f630 in_seq=0 out_seq=0 2023-07-14T13:14:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.809+0000 7f65e37fe700 10 client.27565 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f65e37fe700 1 -- 172.21.15.17:0/2092008315 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562e884a5e50 con 0x562e88574c40 2023-07-14T13:14:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f65e37fe700 10 client.27565 handle_command_reply: tid=0 2023-07-14T13:14:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 1 client.27565 shutdown 2023-07-14T13:14:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2092008315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e885612d0 msgr2=0x562e88564e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e885612d0 0x562e88564e70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f65fc007ab0 tx=0x7f65fc004ad0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2092008315 shutdown_connections 2023-07-14T13:14:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e88574c40 0x562e88577050 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e885612d0 0x562e88564e70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 0x562e88567570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/2092008315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e885647f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2092008315 >> 172.21.15.17:0/2092008315 conn(0x562e88550be0 msgr2=0x562e885554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f65e37fe700 0 client.27565 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2092008315 shutdown_connections 2023-07-14T13:14:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2092008315 wait complete. 2023-07-14T13:14:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.810+0000 7f661dcf7b80 20 client.27565 trim_cache size 0 max 16384 2023-07-14T13:14:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.831+0000 7f661dcf7b80 1 Processor -- start 2023-07-14T13:14:07.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.831+0000 7f661dcf7b80 1 -- start start 2023-07-14T13:14:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 0x562e88562010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e8855b580 0x562e88567110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e885612d0 0x562e88555c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e88565dd0 con 0x562e883b76b0 2023-07-14T13:14:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e8855f360 con 0x562e885612d0 2023-07-14T13:14:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e88556ea0 con 0x562e8855b580 2023-07-14T13:14:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f660899c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e885612d0 0x562e88555c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f6603fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 0x562e88562010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f660899c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e885612d0 0x562e88555c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55672/0 (socket says 172.21.15.17:55672) 2023-07-14T13:14:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f660899c700 1 -- 172.21.15.17:0/2865194891 learned_addr learned my addr 172.21.15.17:0/2865194891 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f66037fe700 1 --2- 172.21.15.17:0/2865194891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e8855b580 0x562e88567110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f660899c700 1 -- 172.21.15.17:0/2865194891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e8855b580 msgr2=0x562e88567110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f660899c700 1 --2- 172.21.15.17:0/2865194891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e8855b580 0x562e88567110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f660899c700 1 -- 172.21.15.17:0/2865194891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 msgr2=0x562e88562010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f660899c700 1 --2- 172.21.15.17:0/2865194891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 0x562e88562010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f660899c700 1 -- 172.21.15.17:0/2865194891 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e8857bc80 con 0x562e885612d0 2023-07-14T13:14:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f66037fe700 1 --2- 172.21.15.17:0/2865194891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e8855b580 0x562e88567110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:14:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.832+0000 7f6603fff700 1 --2- 172.21.15.17:0/2865194891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 0x562e88562010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.833+0000 7f660899c700 1 --2- 172.21.15.17:0/2865194891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e885612d0 0x562e88555c60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f65fc000f80 tx=0x7f65fc004a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f447bf8353c7178 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.833+0000 7f65eaffd700 1 -- 172.21.15.17:0/2865194891 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0239d0 con 0x562e885612d0 2023-07-14T13:14:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.833+0000 7f65eaffd700 1 -- 172.21.15.17:0/2865194891 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65fc00f040 con 0x562e885612d0 2023-07-14T13:14:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.833+0000 7f65eaffd700 1 -- 172.21.15.17:0/2865194891 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0177d0 con 0x562e885612d0 2023-07-14T13:14:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.834+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2865194891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e885612d0 msgr2=0x562e88555c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.834+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/2865194891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e885612d0 0x562e88555c60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f65fc000f80 tx=0x7f65fc004a10 comp rx=0 tx=0).stop 2023-07-14T13:14:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.834+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2865194891 shutdown_connections 2023-07-14T13:14:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.834+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/2865194891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e885612d0 0x562e88555c60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.834+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/2865194891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e883b76b0 0x562e88562010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.834+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/2865194891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e8855b580 0x562e88567110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.834+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2865194891 >> 172.21.15.17:0/2865194891 conn(0x562e88550be0 msgr2=0x562e88561900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.834+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2865194891 shutdown_connections 2023-07-14T13:14:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.834+0000 7f661dcf7b80 1 -- 172.21.15.17:0/2865194891 wait complete. 2023-07-14T13:14:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.835+0000 7f661dcf7b80 1 -- start start 2023-07-14T13:14:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.835+0000 7f661dcf7b80 1 Processor -- start 2023-07-14T13:14:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.835+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 0x562e88569c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e8856a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f661dcf7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 0x562e8856a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e885c7be0 con 0x562e885612d0 2023-07-14T13:14:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e885c7d50 con 0x562e8855b580 2023-07-14T13:14:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f661dcf7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e885c7f10 con 0x562e883b76b0 2023-07-14T13:14:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f661dcf7b80 10 client.0 _ll_register_callbacks cb 0x562e8844a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f6603fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 0x562e88569c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f660899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 0x562e8856a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f66037fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e8856a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f6603fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 0x562e88569c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55456/0 (socket says 172.21.15.17:55456) 2023-07-14T13:14:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f660899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 0x562e8856a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39918/0 (socket says 172.21.15.17:39918) 2023-07-14T13:14:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f6603fff700 1 -- 172.21.15.17:0/1417332428 learned_addr learned my addr 172.21.15.17:0/1417332428 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f6603fff700 1 -- 172.21.15.17:0/1417332428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 msgr2=0x562e8856a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f6603fff700 1 --2- 172.21.15.17:0/1417332428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e8856a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f6603fff700 1 -- 172.21.15.17:0/1417332428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 msgr2=0x562e8856a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f6603fff700 1 --2- 172.21.15.17:0/1417332428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 0x562e8856a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.836+0000 7f6603fff700 1 -- 172.21.15.17:0/1417332428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e882dad80 con 0x562e883b76b0 2023-07-14T13:14:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.837+0000 7f6603fff700 1 --2- 172.21.15.17:0/1417332428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 0x562e88569c50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f65f4013010 tx=0x7f65f4003e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b1484db53eb1761 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.837+0000 7f65e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:14:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.837+0000 7f65e37fe700 1 -- 172.21.15.17:0/1417332428 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4003a90 con 0x562e883b76b0 2023-07-14T13:14:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.837+0000 7f661dcf7b80 1 -- 172.21.15.17:0/1417332428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65f4004390 con 0x562e883b76b0 2023-07-14T13:14:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.837+0000 7f65e37fe700 1 -- 172.21.15.17:0/1417332428 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f65f402e070 con 0x562e883b76b0 2023-07-14T13:14:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.837+0000 7f65e37fe700 1 -- 172.21.15.17:0/1417332428 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65f4005040 con 0x562e883b76b0 2023-07-14T13:14:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.837+0000 7f661dcf7b80 10 client.27571 fetch_fsmap learned FSMap version 40 2023-07-14T13:14:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.837+0000 7f661dcf7b80 1 -- 172.21.15.17:0/1417332428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x562e882c3c00 con 0x562e883b76b0 2023-07-14T13:14:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.838+0000 7f65e37fe700 1 -- 172.21.15.17:0/1417332428 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65f4004390 con 0x562e883b76b0 2023-07-14T13:14:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.838+0000 7f65e37fe700 1 -- 172.21.15.17:0/1417332428 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 40) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f65f4004970 con 0x562e883b76b0 2023-07-14T13:14:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.838+0000 7f661dcf7b80 10 client.27571 fetch_fsmap finished waiting for FSMap version 40 2023-07-14T13:14:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.838+0000 7f661dcf7b80 10 client.27571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.838+0000 7f661dcf7b80 20 client.27571 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:07.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.838+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/1417332428 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e885c9620 0x562e885cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.838+0000 7f661dcf7b80 4 client.27571 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:14:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.838+0000 7f661dcf7b80 1 -- 172.21.15.17:0/1417332428 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562e88467ff0 con 0x562e885c9620 2023-07-14T13:14:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.838+0000 7f66037fe700 1 --2- 172.21.15.17:0/1417332428 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e885c9620 0x562e885cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.839+0000 7f66037fe700 1 --2- 172.21.15.17:0/1417332428 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e885c9620 0x562e885cba30 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed8813b54b6f58c0 server_cookie=8d03936d177bc0b2 in_seq=0 out_seq=0 2023-07-14T13:14:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.839+0000 7f65e37fe700 10 client.27571 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f65e37fe700 1 -- 172.21.15.17:0/1417332428 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562e88467ff0 con 0x562e885c9620 2023-07-14T13:14:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f65e37fe700 10 client.27571 handle_command_reply: tid=0 2023-07-14T13:14:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f661dcf7b80 1 client.27571 shutdown 2023-07-14T13:14:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f661dcf7b80 1 -- 172.21.15.17:0/1417332428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 msgr2=0x562e88569c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/1417332428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 0x562e88569c50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f65f4013010 tx=0x7f65f4003e70 comp rx=0 tx=0).stop 2023-07-14T13:14:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f661dcf7b80 1 -- 172.21.15.17:0/1417332428 shutdown_connections 2023-07-14T13:14:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/1417332428 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e885c9620 0x562e885cba30 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/1417332428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e885612d0 0x562e8856a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/1417332428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e883b76b0 0x562e88569c50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f661dcf7b80 1 --2- 172.21.15.17:0/1417332428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e8855b580 0x562e8856a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f65e37fe700 0 client.27571 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f661dcf7b80 1 -- 172.21.15.17:0/1417332428 >> 172.21.15.17:0/1417332428 conn(0x562e88550be0 msgr2=0x562e88560220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f661dcf7b80 1 -- 172.21.15.17:0/1417332428 shutdown_connections 2023-07-14T13:14:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.849+0000 7f661dcf7b80 1 -- 172.21.15.17:0/1417332428 wait complete. 2023-07-14T13:14:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.850+0000 7f661dcf7b80 20 client.27571 trim_cache size 0 max 16384 2023-07-14T13:14:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:14:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:14:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:14:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:14:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.850+0000 7f660a3ff700 1 -- 172.21.15.17:0/3865414558 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f65ec0a12c0 msgr2=0x7f65ec0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.850+0000 7f660a3ff700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f65ec0a12c0 0x7f65ec0a3770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009fd0 tx=0x7f65fc009040 comp rx=0 tx=0).stop 2023-07-14T13:14:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.850+0000 7f660a3ff700 1 -- 172.21.15.17:0/3865414558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041004b0 msgr2=0x7f66041982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.850+0000 7f660a3ff700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041004b0 0x7f66041982f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f65f8005740 tx=0x7f65f8005770 comp rx=0 tx=0).stop 2023-07-14T13:14:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.850+0000 7f660a3ff700 1 -- 172.21.15.17:0/3865414558 shutdown_connections 2023-07-14T13:14:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.850+0000 7f660a3ff700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f65ec0a12c0 0x7f65ec0a3770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.850+0000 7f660a3ff700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6604105b10 0x7f660419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.850+0000 7f660a3ff700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66040ffb00 0x7f6604197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.850+0000 7f660a3ff700 1 --2- 172.21.15.17:0/3865414558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66041004b0 0x7f66041982f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.850+0000 7f660a3ff700 1 -- 172.21.15.17:0/3865414558 >> 172.21.15.17:0/3865414558 conn(0x7f66040fb600 msgr2=0x7f660410aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.851+0000 7f660a3ff700 1 -- 172.21.15.17:0/3865414558 shutdown_connections 2023-07-14T13:14:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:07.851+0000 7f660a3ff700 1 -- 172.21.15.17:0/3865414558 wait complete. 2023-07-14T13:14:09.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:09 smithi131 ceph-mon[96953]: pgmap v451: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-07-14T13:14:09.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:09 smithi017 ceph-mon[95536]: pgmap v451: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-07-14T13:14:09.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:09 smithi135 ceph-mon[97338]: pgmap v451: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 24 MiB/s wr, 31 op/s 2023-07-14T13:14:10.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:10 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:14:10.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:10 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:14:10.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:10 smithi131 ceph-mon[96953]: osdmap e106: 12 total, 12 up, 12 in 2023-07-14T13:14:10.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:10 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:14:10.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:10 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:14:10.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:10 smithi017 ceph-mon[95536]: osdmap e106: 12 total, 12 up, 12 in 2023-07-14T13:14:10.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:10 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:14:10.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:10 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:14:10.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:10 smithi135 ceph-mon[97338]: osdmap e106: 12 total, 12 up, 12 in 2023-07-14T13:14:11.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:11 smithi131 ceph-mon[96953]: pgmap v453: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 31 MiB/s wr, 41 op/s 2023-07-14T13:14:11.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:11 smithi017 ceph-mon[95536]: pgmap v453: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 31 MiB/s wr, 41 op/s 2023-07-14T13:14:11.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:11 smithi135 ceph-mon[97338]: pgmap v453: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 31 MiB/s wr, 41 op/s 2023-07-14T13:14:13.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:13 smithi135 ceph-mon[97338]: pgmap v454: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 29 MiB/s wr, 42 op/s 2023-07-14T13:14:13.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:13 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:14:13.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:13 smithi131 ceph-mon[96953]: pgmap v454: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 29 MiB/s wr, 42 op/s 2023-07-14T13:14:13.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:13 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:14:13.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:13 smithi017 ceph-mon[95536]: pgmap v454: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 29 MiB/s wr, 42 op/s 2023-07-14T13:14:13.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:13 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:14:15.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:15 smithi135 ceph-mon[97338]: pgmap v455: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 29 MiB/s wr, 42 op/s 2023-07-14T13:14:15.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:15 smithi131 ceph-mon[96953]: pgmap v455: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 29 MiB/s wr, 42 op/s 2023-07-14T13:14:15.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:15 smithi017 ceph-mon[95536]: pgmap v455: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 29 MiB/s wr, 42 op/s 2023-07-14T13:14:16.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:16 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:14:16.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:16 smithi135 ceph-mon[97338]: osdmap e107: 12 total, 12 up, 12 in 2023-07-14T13:14:16.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:16 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:14:16.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:16 smithi131 ceph-mon[96953]: osdmap e107: 12 total, 12 up, 12 in 2023-07-14T13:14:16.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:16 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:14:16.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:16 smithi017 ceph-mon[95536]: osdmap e107: 12 total, 12 up, 12 in 2023-07-14T13:14:17.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:17 smithi135 ceph-mon[97338]: pgmap v456: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 29 MiB/s wr, 31 op/s 2023-07-14T13:14:17.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:17 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:14:17.457 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:17 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:14:17.457 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:17 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:14:17.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:17 smithi131 ceph-mon[96953]: pgmap v456: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 29 MiB/s wr, 31 op/s 2023-07-14T13:14:17.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:17 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:14:17.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:17 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:14:17.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:17 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:14:17.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:17 smithi017 ceph-mon[95536]: pgmap v456: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 29 MiB/s wr, 31 op/s 2023-07-14T13:14:17.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:17 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:14:17.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:17 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:14:17.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:17 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:14:19.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:19 smithi135 ceph-mon[97338]: pgmap v458: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 32 MiB/s wr, 36 op/s 2023-07-14T13:14:19.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:19 smithi131 ceph-mon[96953]: pgmap v458: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 32 MiB/s wr, 36 op/s 2023-07-14T13:14:19.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:19 smithi017 ceph-mon[95536]: pgmap v458: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 32 MiB/s wr, 36 op/s 2023-07-14T13:14:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.016+0000 7f540bfff700 1 -- 172.21.15.17:0/1262429599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540c1014a0 msgr2=0x7f540c101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.016+0000 7f540bfff700 1 --2- 172.21.15.17:0/1262429599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540c1014a0 0x7f540c101910 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009990 tx=0x7f53f4009ca0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.016+0000 7f540bfff700 1 -- 172.21.15.17:0/1262429599 shutdown_connections 2023-07-14T13:14:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.016+0000 7f540bfff700 1 --2- 172.21.15.17:0/1262429599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c101e50 0x7f540c10c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.016+0000 7f540bfff700 1 --2- 172.21.15.17:0/1262429599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c0ffd20 0x7f540c1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.016+0000 7f540bfff700 1 --2- 172.21.15.17:0/1262429599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540c1014a0 0x7f540c101910 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.016+0000 7f540bfff700 1 -- 172.21.15.17:0/1262429599 >> 172.21.15.17:0/1262429599 conn(0x7f540c0fb440 msgr2=0x7f540c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.016+0000 7f540bfff700 1 -- 172.21.15.17:0/1262429599 shutdown_connections 2023-07-14T13:14:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.016+0000 7f540bfff700 1 -- 172.21.15.17:0/1262429599 wait complete. 2023-07-14T13:14:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.017+0000 7f540bfff700 1 Processor -- start 2023-07-14T13:14:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.017+0000 7f540bfff700 1 -- start start 2023-07-14T13:14:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.018+0000 7f540bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0ffd20 0x7f540c19d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.018+0000 7f540bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540c1014a0 0x7f540c19df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.018+0000 7f540bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c101e50 0x7f540c197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.018+0000 7f540bfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c1980a0 con 0x7f540c1014a0 2023-07-14T13:14:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.018+0000 7f540bfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c198210 con 0x7f540c0ffd20 2023-07-14T13:14:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.018+0000 7f540bfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c1983d0 con 0x7f540c101e50 2023-07-14T13:14:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.018+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0ffd20 0x7f540c19d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.018+0000 7f540affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540c1014a0 0x7f540c19df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.018+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0ffd20 0x7f540c19d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35022/0 (socket says 172.21.15.17:35022) 2023-07-14T13:14:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.018+0000 7f5402ffd700 1 -- 172.21.15.17:0/2888125799 learned_addr learned my addr 172.21.15.17:0/2888125799 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.018+0000 7f540b7fe700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c101e50 0x7f540c197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.019+0000 7f5402ffd700 1 -- 172.21.15.17:0/2888125799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c101e50 msgr2=0x7f540c197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.019+0000 7f5402ffd700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c101e50 0x7f540c197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.019+0000 7f5402ffd700 1 -- 172.21.15.17:0/2888125799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540c1014a0 msgr2=0x7f540c19df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.019+0000 7f5402ffd700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540c1014a0 0x7f540c19df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.019+0000 7f5402ffd700 1 -- 172.21.15.17:0/2888125799 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f40095f0 con 0x7f540c0ffd20 2023-07-14T13:14:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.019+0000 7f5402ffd700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0ffd20 0x7f540c19d9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00e9a0 tx=0x7f53fc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.019+0000 7f5408ff9700 1 -- 172.21.15.17:0/2888125799 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc009790 con 0x7f540c0ffd20 2023-07-14T13:14:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.019+0000 7f540bfff700 1 -- 172.21.15.17:0/2888125799 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c1986b0 con 0x7f540c0ffd20 2023-07-14T13:14:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.019+0000 7f5408ff9700 1 -- 172.21.15.17:0/2888125799 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53fc010430 con 0x7f540c0ffd20 2023-07-14T13:14:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.019+0000 7f5408ff9700 1 -- 172.21.15.17:0/2888125799 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00cea0 con 0x7f540c0ffd20 2023-07-14T13:14:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.019+0000 7f540bfff700 1 -- 172.21.15.17:0/2888125799 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c1a49b0 con 0x7f540c0ffd20 2023-07-14T13:14:21.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.025+0000 7f5408ff9700 1 -- 172.21.15.17:0/2888125799 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f53fc0105a0 con 0x7f540c0ffd20 2023-07-14T13:14:21.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.025+0000 7f5424c4bb80 1 Processor -- start 2023-07-14T13:14:21.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.026+0000 7f5424c4bb80 1 -- start start 2023-07-14T13:14:21.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.026+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 0x55b9eb86ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.026+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb86a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.026+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 0x55b9eb86a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.026+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb76fc50 con 0x55b9eb870470 2023-07-14T13:14:21.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.026+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb7c29e0 con 0x55b9eb8708c0 2023-07-14T13:14:21.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.026+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb7bbe70 con 0x55b9eb6c66b0 2023-07-14T13:14:21.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f5408ff9700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f53f80a12c0 0x7f53f80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f540b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 0x55b9eb86ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb86a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f540b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 0x55b9eb86ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38642/0 (socket says 172.21.15.17:38642) 2023-07-14T13:14:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f540b7fe700 1 -- 172.21.15.17:0/995929883 learned_addr learned my addr 172.21.15.17:0/995929883 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f540affd700 1 --2- 172.21.15.17:0/995929883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 0x55b9eb86a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f5408ff9700 1 -- 172.21.15.17:0/2888125799 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f53fc014070 con 0x7f540c0ffd20 2023-07-14T13:14:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f540b7fe700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f53f80a12c0 0x7f53f80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f540affd700 1 -- 172.21.15.17:0/995929883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 msgr2=0x55b9eb86ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f540affd700 1 --2- 172.21.15.17:0/995929883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 0x55b9eb86ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f540affd700 1 -- 172.21.15.17:0/995929883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 msgr2=0x55b9eb86a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f540affd700 1 --2- 172.21.15.17:0/995929883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb86a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f540affd700 1 -- 172.21.15.17:0/995929883 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9eb5e9d80 con 0x55b9eb8708c0 2023-07-14T13:14:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.027+0000 7f5402ffd700 1 --2- 172.21.15.17:0/995929883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb86a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.028+0000 7f540affd700 1 --2- 172.21.15.17:0/995929883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 0x55b9eb86a700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f53f40098e0 tx=0x7f53f4005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8755bd05feb062b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.028+0000 7f540b7fe700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f53f80a12c0 0x7f53f80a3770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f54040060b0 tx=0x7f5404004b40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.028+0000 7f54017fa700 1 -- 172.21.15.17:0/995929883 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f401d070 con 0x55b9eb8708c0 2023-07-14T13:14:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.028+0000 7f54017fa700 1 -- 172.21.15.17:0/995929883 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53f401e040 con 0x55b9eb8708c0 2023-07-14T13:14:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.028+0000 7f54017fa700 1 -- 172.21.15.17:0/995929883 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4004760 con 0x55b9eb8708c0 2023-07-14T13:14:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.029+0000 7f5424c4bb80 1 -- 172.21.15.17:0/995929883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 msgr2=0x55b9eb86a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.029+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/995929883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 0x55b9eb86a700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f53f40098e0 tx=0x7f53f4005f00 comp rx=0 tx=0).stop 2023-07-14T13:14:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.029+0000 7f5424c4bb80 1 -- 172.21.15.17:0/995929883 shutdown_connections 2023-07-14T13:14:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.029+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/995929883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 0x55b9eb86a700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.029+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/995929883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 0x55b9eb86ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.029+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/995929883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb86a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.029+0000 7f5424c4bb80 1 -- 172.21.15.17:0/995929883 >> 172.21.15.17:0/995929883 conn(0x55b9eb85fd40 msgr2=0x55b9eb865340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.029+0000 7f5424c4bb80 1 -- 172.21.15.17:0/995929883 shutdown_connections 2023-07-14T13:14:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.029+0000 7f5424c4bb80 1 -- 172.21.15.17:0/995929883 wait complete. 2023-07-14T13:14:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.029+0000 7f5424c4bb80 1 -- start start 2023-07-14T13:14:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.030+0000 7f5424c4bb80 1 Processor -- start 2023-07-14T13:14:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.030+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb6c66b0 0x55b9eb8797c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.030+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb870470 0x55b9eb879d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.030+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb8708c0 0x55b9eb873ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.030+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb75ba60 con 0x55b9eb6c66b0 2023-07-14T13:14:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.030+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb75b760 con 0x55b9eb870470 2023-07-14T13:14:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.030+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb63f8c0 con 0x55b9eb8708c0 2023-07-14T13:14:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.030+0000 7f5424c4bb80 10 client.0 _ll_register_callbacks cb 0x55b9eb759700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb6c66b0 0x55b9eb8797c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f540affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb870470 0x55b9eb879d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f540affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb870470 0x55b9eb879d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35052/0 (socket says 172.21.15.17:35052) 2023-07-14T13:14:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f540affd700 1 -- 172.21.15.17:0/1276131031 learned_addr learned my addr 172.21.15.17:0/1276131031 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f5402ffd700 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb6c66b0 0x55b9eb8797c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36136/0 (socket says 172.21.15.17:36136) 2023-07-14T13:14:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f540b7fe700 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb8708c0 0x55b9eb873ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f540affd700 1 -- 172.21.15.17:0/1276131031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb8708c0 msgr2=0x55b9eb873ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f540affd700 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb8708c0 0x55b9eb873ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f540affd700 1 -- 172.21.15.17:0/1276131031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb6c66b0 msgr2=0x55b9eb8797c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f540affd700 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb6c66b0 0x55b9eb8797c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f540affd700 1 -- 172.21.15.17:0/1276131031 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c1a49b0 con 0x55b9eb870470 2023-07-14T13:14:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f5402ffd700 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb6c66b0 0x55b9eb8797c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f540b7fe700 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb8708c0 0x55b9eb873ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:14:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f540affd700 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb870470 0x55b9eb879d00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f53f400b940 tx=0x7f53f400b970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29faff66133fb3d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.031+0000 7f53f27fc700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:14:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.032+0000 7f53f27fc700 1 -- 172.21.15.17:0/1276131031 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f401d070 con 0x55b9eb870470 2023-07-14T13:14:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.032+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1276131031 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9eb715490 con 0x55b9eb870470 2023-07-14T13:14:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.032+0000 7f53f27fc700 1 -- 172.21.15.17:0/1276131031 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f53f4004910 con 0x55b9eb870470 2023-07-14T13:14:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.032+0000 7f53f27fc700 1 -- 172.21.15.17:0/1276131031 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53f400bc40 con 0x55b9eb870470 2023-07-14T13:14:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.032+0000 7f5424c4bb80 10 client.27620 fetch_fsmap learned FSMap version 41 2023-07-14T13:14:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.032+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1276131031 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7f540c10d1a0 con 0x55b9eb870470 2023-07-14T13:14:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.032+0000 7f53f27fc700 1 -- 172.21.15.17:0/1276131031 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b9eb715490 con 0x55b9eb870470 2023-07-14T13:14:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.032+0000 7f53f27fc700 1 -- 172.21.15.17:0/1276131031 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f53f400fa70 con 0x55b9eb870470 2023-07-14T13:14:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.033+0000 7f5424c4bb80 10 client.27620 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:14:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.033+0000 7f5424c4bb80 10 client.27620 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.033+0000 7f5424c4bb80 20 client.27620 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.033+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b9eb883900 0x55b9eb885d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.033+0000 7f5424c4bb80 4 client.27620 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:14:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.033+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1276131031 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9eb7b4e50 con 0x55b9eb883900 2023-07-14T13:14:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.033+0000 7f5402ffd700 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b9eb883900 0x55b9eb885d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.033+0000 7f5402ffd700 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b9eb883900 0x55b9eb885d10 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5af697557ab9e31e server_cookie=ef101872d72db199 in_seq=0 out_seq=0 2023-07-14T13:14:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.033+0000 7f53f27fc700 10 client.27620 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.034+0000 7f53f27fc700 1 -- 172.21.15.17:0/1276131031 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b9eb7b4e50 con 0x55b9eb883900 2023-07-14T13:14:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.034+0000 7f53f27fc700 10 client.27620 handle_command_reply: tid=0 2023-07-14T13:14:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.034+0000 7f5424c4bb80 1 client.27620 shutdown 2023-07-14T13:14:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1276131031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb870470 msgr2=0x55b9eb879d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb870470 0x55b9eb879d00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f53f400b940 tx=0x7f53f400b970 comp rx=0 tx=0).stop 2023-07-14T13:14:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1276131031 shutdown_connections 2023-07-14T13:14:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b9eb883900 0x55b9eb885d10 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb8708c0 0x55b9eb873ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb6c66b0 0x55b9eb8797c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f53f27fc700 0 client.27620 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/1276131031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb870470 0x55b9eb879d00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1276131031 >> 172.21.15.17:0/1276131031 conn(0x55b9eb85fd40 msgr2=0x55b9eb864640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1276131031 shutdown_connections 2023-07-14T13:14:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1276131031 wait complete. 2023-07-14T13:14:21.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.035+0000 7f5424c4bb80 20 client.27620 trim_cache size 0 max 16384 2023-07-14T13:14:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.051+0000 7f5424c4bb80 1 Processor -- start 2023-07-14T13:14:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.051+0000 7f5424c4bb80 1 -- start start 2023-07-14T13:14:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.052+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 0x55b9eb86f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.052+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb86a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.052+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 0x55b9eb864dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.052+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb866c30 con 0x55b9eb870470 2023-07-14T13:14:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.052+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb86b3c0 con 0x55b9eb8708c0 2023-07-14T13:14:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.052+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb861e60 con 0x55b9eb6c66b0 2023-07-14T13:14:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.052+0000 7f540b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 0x55b9eb864dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.052+0000 7f540affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb86a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.052+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 0x55b9eb86f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.052+0000 7f540b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 0x55b9eb864dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35060/0 (socket says 172.21.15.17:35060) 2023-07-14T13:14:21.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.052+0000 7f540b7fe700 1 -- 172.21.15.17:0/1090395793 learned_addr learned my addr 172.21.15.17:0/1090395793 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:21.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.053+0000 7f5402ffd700 1 -- 172.21.15.17:0/1090395793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 msgr2=0x55b9eb864dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:21.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.053+0000 7f5402ffd700 1 --2- 172.21.15.17:0/1090395793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 0x55b9eb864dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.053+0000 7f5402ffd700 1 -- 172.21.15.17:0/1090395793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 msgr2=0x55b9eb86a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.053+0000 7f5402ffd700 1 --2- 172.21.15.17:0/1090395793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb86a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.053+0000 7f5402ffd700 1 -- 172.21.15.17:0/1090395793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9eb88a900 con 0x55b9eb6c66b0 2023-07-14T13:14:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.053+0000 7f5402ffd700 1 --2- 172.21.15.17:0/1090395793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 0x55b9eb86f400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0ca6c0 tx=0x7f53fc065490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf7e8f7a9e043c2c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.053+0000 7f5401ffb700 1 -- 172.21.15.17:0/1090395793 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc010880 con 0x55b9eb6c66b0 2023-07-14T13:14:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.053+0000 7f5401ffb700 1 -- 172.21.15.17:0/1090395793 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53fc09a040 con 0x55b9eb6c66b0 2023-07-14T13:14:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.053+0000 7f5401ffb700 1 -- 172.21.15.17:0/1090395793 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc070370 con 0x55b9eb6c66b0 2023-07-14T13:14:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.054+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1090395793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 msgr2=0x55b9eb86f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:21.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.054+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/1090395793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 0x55b9eb86f400 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f53fc0ca6c0 tx=0x7f53fc065490 comp rx=0 tx=0).stop 2023-07-14T13:14:21.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.054+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1090395793 shutdown_connections 2023-07-14T13:14:21.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.054+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/1090395793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb8708c0 0x55b9eb864dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.054+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/1090395793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb6c66b0 0x55b9eb86f400 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.054+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/1090395793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb86a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.054+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1090395793 >> 172.21.15.17:0/1090395793 conn(0x55b9eb85fd40 msgr2=0x55b9eb8739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.055+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1090395793 shutdown_connections 2023-07-14T13:14:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.055+0000 7f5424c4bb80 1 -- 172.21.15.17:0/1090395793 wait complete. 2023-07-14T13:14:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.055+0000 7f5424c4bb80 1 -- start start 2023-07-14T13:14:21.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.055+0000 7f5424c4bb80 1 Processor -- start 2023-07-14T13:14:21.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb6c66b0 0x55b9eb877490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb8779d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f5424c4bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb8708c0 0x55b9eb8d6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb8781b0 con 0x55b9eb870470 2023-07-14T13:14:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb878320 con 0x55b9eb6c66b0 2023-07-14T13:14:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f5424c4bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9eb8d6d10 con 0x55b9eb8708c0 2023-07-14T13:14:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f5424c4bb80 10 client.0 _ll_register_callbacks cb 0x7f5404009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb6c66b0 0x55b9eb877490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f540affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb8779d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f5402ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb6c66b0 0x55b9eb877490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35070/0 (socket says 172.21.15.17:35070) 2023-07-14T13:14:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f5402ffd700 1 -- 172.21.15.17:0/4104698638 learned_addr learned my addr 172.21.15.17:0/4104698638 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:21.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.056+0000 7f540b7fe700 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb8708c0 0x55b9eb8d6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.057+0000 7f5402ffd700 1 -- 172.21.15.17:0/4104698638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb8708c0 msgr2=0x55b9eb8d6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:21.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.057+0000 7f5402ffd700 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb8708c0 0x55b9eb8d6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.057+0000 7f5402ffd700 1 -- 172.21.15.17:0/4104698638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 msgr2=0x55b9eb8779d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.057+0000 7f5402ffd700 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb8779d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.057+0000 7f5402ffd700 1 -- 172.21.15.17:0/4104698638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c1986b0 con 0x55b9eb6c66b0 2023-07-14T13:14:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.057+0000 7f540affd700 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb8779d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.057+0000 7f5402ffd700 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb6c66b0 0x55b9eb877490 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00e970 tx=0x7f53fc099e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bfa31d6fdd4c1ae server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.057+0000 7f53f27fc700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:14:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.057+0000 7f53f27fc700 1 -- 172.21.15.17:0/4104698638 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc06d070 con 0x55b9eb6c66b0 2023-07-14T13:14:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.057+0000 7f5424c4bb80 1 -- 172.21.15.17:0/4104698638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f53f401e040 con 0x55b9eb6c66b0 2023-07-14T13:14:21.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.057+0000 7f53f27fc700 1 -- 172.21.15.17:0/4104698638 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f53fc0a2490 con 0x55b9eb6c66b0 2023-07-14T13:14:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.058+0000 7f53f27fc700 1 -- 172.21.15.17:0/4104698638 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53fc0650d0 con 0x55b9eb6c66b0 2023-07-14T13:14:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.058+0000 7f5424c4bb80 10 client.27626 fetch_fsmap learned FSMap version 41 2023-07-14T13:14:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.058+0000 7f5424c4bb80 1 -- 172.21.15.17:0/4104698638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55b9eb5d2c00 con 0x55b9eb6c66b0 2023-07-14T13:14:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.058+0000 7f53f27fc700 1 -- 172.21.15.17:0/4104698638 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53f401e040 con 0x55b9eb6c66b0 2023-07-14T13:14:21.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.058+0000 7f53f27fc700 1 -- 172.21.15.17:0/4104698638 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f53fc09a3c0 con 0x55b9eb6c66b0 2023-07-14T13:14:21.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.058+0000 7f5424c4bb80 10 client.27626 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:14:21.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.058+0000 7f5424c4bb80 10 client.27626 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:21.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.058+0000 7f5424c4bb80 20 client.27626 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:21.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.058+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b9eb8d81a0 0x55b9eb8da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:21.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.058+0000 7f5424c4bb80 4 client.27626 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:14:21.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.058+0000 7f5424c4bb80 1 -- 172.21.15.17:0/4104698638 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b9eb776ff0 con 0x55b9eb8d81a0 2023-07-14T13:14:21.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.059+0000 7f540affd700 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b9eb8d81a0 0x55b9eb8da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:21.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.059+0000 7f53f27fc700 10 client.27626 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.059+0000 7f540affd700 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b9eb8d81a0 0x55b9eb8da580 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6de268809f28aac server_cookie=57dc525323d1e75c in_seq=0 out_seq=0 2023-07-14T13:14:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.070+0000 7f53f27fc700 1 -- 172.21.15.17:0/4104698638 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b9eb776ff0 con 0x55b9eb8d81a0 2023-07-14T13:14:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.070+0000 7f53f27fc700 10 client.27626 handle_command_reply: tid=0 2023-07-14T13:14:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.070+0000 7f5424c4bb80 1 client.27626 shutdown 2023-07-14T13:14:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.070+0000 7f5424c4bb80 1 -- 172.21.15.17:0/4104698638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb6c66b0 msgr2=0x55b9eb877490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.070+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb6c66b0 0x55b9eb877490 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00e970 tx=0x7f53fc099e80 comp rx=0 tx=0).stop 2023-07-14T13:14:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.071+0000 7f5424c4bb80 1 -- 172.21.15.17:0/4104698638 shutdown_connections 2023-07-14T13:14:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.071+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b9eb8d81a0 0x55b9eb8da580 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.071+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb8708c0 0x55b9eb8d6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.071+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9eb6c66b0 0x55b9eb877490 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.071+0000 7f5424c4bb80 1 --2- 172.21.15.17:0/4104698638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b9eb870470 0x55b9eb8779d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.071+0000 7f53f27fc700 0 client.27626 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:21.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.071+0000 7f5424c4bb80 1 -- 172.21.15.17:0/4104698638 >> 172.21.15.17:0/4104698638 conn(0x55b9eb85fd40 msgr2=0x55b9eb870cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:21.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.071+0000 7f5424c4bb80 1 -- 172.21.15.17:0/4104698638 shutdown_connections 2023-07-14T13:14:21.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.071+0000 7f5424c4bb80 1 -- 172.21.15.17:0/4104698638 wait complete. 2023-07-14T13:14:21.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.071+0000 7f5424c4bb80 20 client.27626 trim_cache size 0 max 16384 2023-07-14T13:14:21.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:14:21.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:14:21.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:14:21.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:14:21.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 -- 172.21.15.17:0/2888125799 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f53f80a12c0 msgr2=0x7f53f80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:21.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f53f80a12c0 0x7f53f80a3770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f54040060b0 tx=0x7f5404004b40 comp rx=0 tx=0).stop 2023-07-14T13:14:21.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 -- 172.21.15.17:0/2888125799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0ffd20 msgr2=0x7f540c19d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:21.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0ffd20 0x7f540c19d9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00e9a0 tx=0x7f53fc00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 -- 172.21.15.17:0/2888125799 shutdown_connections 2023-07-14T13:14:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f53f80a12c0 0x7f53f80a3770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f540c101e50 0x7f540c197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f540c0ffd20 0x7f540c19d9c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 --2- 172.21.15.17:0/2888125799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f540c1014a0 0x7f540c19df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 -- 172.21.15.17:0/2888125799 >> 172.21.15.17:0/2888125799 conn(0x7f540c0fb440 msgr2=0x7f540c10acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 -- 172.21.15.17:0/2888125799 shutdown_connections 2023-07-14T13:14:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:21.072+0000 7f540bfff700 1 -- 172.21.15.17:0/2888125799 wait complete. 2023-07-14T13:14:21.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:21 smithi135 ceph-mon[97338]: pgmap v459: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 29 MiB/s wr, 29 op/s 2023-07-14T13:14:21.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:21 smithi131 ceph-mon[96953]: pgmap v459: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 29 MiB/s wr, 29 op/s 2023-07-14T13:14:21.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:21 smithi017 ceph-mon[95536]: pgmap v459: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 29 MiB/s wr, 29 op/s 2023-07-14T13:14:23.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:23 smithi135 ceph-mon[97338]: pgmap v460: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 28 MiB/s wr, 29 op/s 2023-07-14T13:14:23.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:23 smithi131 ceph-mon[96953]: pgmap v460: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 28 MiB/s wr, 29 op/s 2023-07-14T13:14:23.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:23 smithi017 ceph-mon[95536]: pgmap v460: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 28 MiB/s wr, 29 op/s 2023-07-14T13:14:25.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:25 smithi135 ceph-mon[97338]: pgmap v461: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 28 MiB/s wr, 29 op/s 2023-07-14T13:14:25.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:25 smithi131 ceph-mon[96953]: pgmap v461: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 28 MiB/s wr, 29 op/s 2023-07-14T13:14:25.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:25 smithi017 ceph-mon[95536]: pgmap v461: 97 pgs: 97 active+clean; 12 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 28 MiB/s wr, 29 op/s 2023-07-14T13:14:27.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:27 smithi135 ceph-mon[97338]: pgmap v462: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 22 op/s 2023-07-14T13:14:27.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:27 smithi131 ceph-mon[96953]: pgmap v462: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 22 op/s 2023-07-14T13:14:27.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:27 smithi017 ceph-mon[95536]: pgmap v462: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 22 op/s 2023-07-14T13:14:29.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:29 smithi131 ceph-mon[96953]: pgmap v463: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-14T13:14:29.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:29 smithi017 ceph-mon[95536]: pgmap v463: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-14T13:14:29.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:29 smithi135 ceph-mon[97338]: pgmap v463: 97 pgs: 97 active+clean; 12 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-14T13:14:31.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:31 smithi131 ceph-mon[96953]: pgmap v464: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 35 MiB/s wr, 26 op/s 2023-07-14T13:14:31.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:31 smithi017 ceph-mon[95536]: pgmap v464: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 35 MiB/s wr, 26 op/s 2023-07-14T13:14:31.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:31 smithi135 ceph-mon[97338]: pgmap v464: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 35 MiB/s wr, 26 op/s 2023-07-14T13:14:33.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:33 smithi131 ceph-mon[96953]: pgmap v465: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-14T13:14:33.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:33 smithi017 ceph-mon[95536]: pgmap v465: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-14T13:14:33.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:33 smithi135 ceph-mon[97338]: pgmap v465: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-14T13:14:34.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.248+0000 7f1a41dff700 1 -- 172.21.15.17:0/4265240255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3c067c10 msgr2=0x7f1a3c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:34.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.248+0000 7f1a41dff700 1 --2- 172.21.15.17:0/4265240255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3c067c10 0x7f1a3c067fe0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009990 tx=0x7f1a2c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.248+0000 7f1a41dff700 1 -- 172.21.15.17:0/4265240255 shutdown_connections 2023-07-14T13:14:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.248+0000 7f1a41dff700 1 --2- 172.21.15.17:0/4265240255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a3c104e50 0x7f1a3c10ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.248+0000 7f1a41dff700 1 --2- 172.21.15.17:0/4265240255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3c067c10 0x7f1a3c067fe0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.248+0000 7f1a41dff700 1 --2- 172.21.15.17:0/4265240255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3c0685b0 0x7f1a3c104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.248+0000 7f1a41dff700 1 -- 172.21.15.17:0/4265240255 >> 172.21.15.17:0/4265240255 conn(0x7f1a3c074760 msgr2=0x7f1a3c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.248+0000 7f1a41dff700 1 -- 172.21.15.17:0/4265240255 shutdown_connections 2023-07-14T13:14:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.248+0000 7f1a41dff700 1 -- 172.21.15.17:0/4265240255 wait complete. 2023-07-14T13:14:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.249+0000 7f1a41dff700 1 Processor -- start 2023-07-14T13:14:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.250+0000 7f1a41dff700 1 -- start start 2023-07-14T13:14:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.250+0000 7f1a41dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3c067c10 0x7f1a3c197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.250+0000 7f1a41dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a3c0685b0 0x7f1a3c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.250+0000 7f1a41dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3c104e50 0x7f1a3c19c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.250+0000 7f1a41dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c19cfb0 con 0x7f1a3c0685b0 2023-07-14T13:14:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.250+0000 7f1a41dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c19d120 con 0x7f1a3c104e50 2023-07-14T13:14:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.250+0000 7f1a41dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c19d2e0 con 0x7f1a3c067c10 2023-07-14T13:14:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.250+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3c067c10 0x7f1a3c197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.250+0000 7f1a3affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a3c0685b0 0x7f1a3c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.250+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3c067c10 0x7f1a3c197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41836/0 (socket says 172.21.15.17:41836) 2023-07-14T13:14:34.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.250+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2305663235 learned_addr learned my addr 172.21.15.17:0/2305663235 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.251+0000 7f1a3bfff700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3c104e50 0x7f1a3c19c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.251+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2305663235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3c104e50 msgr2=0x7f1a3c19c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.251+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3c104e50 0x7f1a3c19c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.251+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2305663235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a3c0685b0 msgr2=0x7f1a3c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.251+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a3c0685b0 0x7f1a3c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.251+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2305663235 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34009c40 con 0x7f1a3c067c10 2023-07-14T13:14:34.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.251+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3c067c10 0x7f1a3c197dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c000c00 tx=0x7f1a2c00bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.251+0000 7f1a38ff9700 1 -- 172.21.15.17:0/2305663235 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c01d070 con 0x7f1a3c067c10 2023-07-14T13:14:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.252+0000 7f1a38ff9700 1 -- 172.21.15.17:0/2305663235 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a2c021410 con 0x7f1a3c067c10 2023-07-14T13:14:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.252+0000 7f1a41dff700 1 -- 172.21.15.17:0/2305663235 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c0095f0 con 0x7f1a3c067c10 2023-07-14T13:14:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.252+0000 7f1a38ff9700 1 -- 172.21.15.17:0/2305663235 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c017650 con 0x7f1a3c067c10 2023-07-14T13:14:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.252+0000 7f1a41dff700 1 -- 172.21.15.17:0/2305663235 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c19d7f0 con 0x7f1a3c067c10 2023-07-14T13:14:34.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.255+0000 7f1a38ff9700 1 -- 172.21.15.17:0/2305663235 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1a2c021580 con 0x7f1a3c067c10 2023-07-14T13:14:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.256+0000 7f1a556ccb80 1 Processor -- start 2023-07-14T13:14:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.256+0000 7f1a38ff9700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a240a12c0 0x7f1a240a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.257+0000 7f1a556ccb80 1 -- start start 2023-07-14T13:14:34.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.257+0000 7f1a38ff9700 1 -- 172.21.15.17:0/2305663235 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1a2c0ce110 con 0x7f1a3c067c10 2023-07-14T13:14:34.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.257+0000 7f1a3bfff700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a240a12c0 0x7f1a240a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.257+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e6ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.257+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e69040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.257+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8e69580 0x55a7a8e699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.257+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8d6ec50 con 0x55a7a8cc56b0 2023-07-14T13:14:34.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.257+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8dc19e0 con 0x55a7a8e6f2d0 2023-07-14T13:14:34.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.257+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8dbae70 con 0x55a7a8e69580 2023-07-14T13:14:34.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.257+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e6ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e6ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39986/0 (socket says 172.21.15.17:39986) 2023-07-14T13:14:34.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/14426124 learned_addr learned my addr 172.21.15.17:0/14426124 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:34.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3affd700 1 --2- 172.21.15.17:0/14426124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e69040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3bfff700 1 --2- 172.21.15.17:0/14426124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8e69580 0x55a7a8e699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/14426124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8e69580 msgr2=0x55a7a8e699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:34.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/14426124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8e69580 0x55a7a8e699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/14426124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 msgr2=0x55a7a8e69040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:34.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/14426124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e69040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/14426124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7a8be8d80 con 0x55a7a8cc56b0 2023-07-14T13:14:34.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3bfff700 1 --2- 172.21.15.17:0/14426124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8e69580 0x55a7a8e699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:14:34.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3bfff700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a240a12c0 0x7f1a240a3770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009fd0 tx=0x7f1a3400b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:34.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/14426124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e6ed90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c097ca0 tx=0x7f1a2c0976a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5a785c33c08b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:34.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.258+0000 7f1a21ffb700 1 -- 172.21.15.17:0/14426124 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0aeea0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.259+0000 7f1a21ffb700 1 -- 172.21.15.17:0/14426124 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a2c09b230 con 0x55a7a8cc56b0 2023-07-14T13:14:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.259+0000 7f1a21ffb700 1 -- 172.21.15.17:0/14426124 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c09b490 con 0x55a7a8cc56b0 2023-07-14T13:14:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.259+0000 7f1a556ccb80 1 -- 172.21.15.17:0/14426124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 msgr2=0x55a7a8e6ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.259+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/14426124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e6ed90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c097ca0 tx=0x7f1a2c0976a0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.259+0000 7f1a556ccb80 1 -- 172.21.15.17:0/14426124 shutdown_connections 2023-07-14T13:14:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.259+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/14426124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8e69580 0x55a7a8e699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.259+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/14426124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e6ed90 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.259+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/14426124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e69040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.260+0000 7f1a556ccb80 1 -- 172.21.15.17:0/14426124 >> 172.21.15.17:0/14426124 conn(0x55a7a8e5ebe0 msgr2=0x55a7a8e63f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.260+0000 7f1a556ccb80 1 -- 172.21.15.17:0/14426124 shutdown_connections 2023-07-14T13:14:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.260+0000 7f1a556ccb80 1 -- 172.21.15.17:0/14426124 wait complete. 2023-07-14T13:14:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.260+0000 7f1a556ccb80 1 -- start start 2023-07-14T13:14:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.261+0000 7f1a556ccb80 1 Processor -- start 2023-07-14T13:14:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.261+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e783a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.261+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8e69580 0x55a7a8e788e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.261+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.261+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8d5aa60 con 0x55a7a8e69580 2023-07-14T13:14:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.261+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8d5a760 con 0x55a7a8e6f2d0 2023-07-14T13:14:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.261+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8c3e8c0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.261+0000 7f1a556ccb80 10 client.0 _ll_register_callbacks cb 0x55a7a8d58700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.261+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.261+0000 7f1a3affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8e69580 0x55a7a8e788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.261+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e783a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41866/0 (socket says 172.21.15.17:41866) 2023-07-14T13:14:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.262+0000 7f1a3affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8e69580 0x55a7a8e788e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39994/0 (socket says 172.21.15.17:39994) 2023-07-14T13:14:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.262+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2781031901 learned_addr learned my addr 172.21.15.17:0/2781031901 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.262+0000 7f1a3bfff700 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.262+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2781031901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 msgr2=0x55a7a8e725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.262+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.262+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2781031901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8e69580 msgr2=0x55a7a8e788e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:34.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.262+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8e69580 0x55a7a8e788e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.262+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2781031901 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c19d7f0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.262+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e783a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c097730 tx=0x7f1a2c0a1210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa95593cbbd87d27 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:34.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.262+0000 7f1a1affd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:14:34.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.262+0000 7f1a1affd700 1 -- 172.21.15.17:0/2781031901 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0aeea0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a1affd700 1 -- 172.21.15.17:0/2781031901 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1a2c09f260 con 0x55a7a8cc56b0 2023-07-14T13:14:34.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2781031901 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7a8d14490 con 0x55a7a8cc56b0 2023-07-14T13:14:34.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a1affd700 1 -- 172.21.15.17:0/2781031901 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a2c0a35f0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a556ccb80 10 client.27601 fetch_fsmap learned FSMap version 41 2023-07-14T13:14:34.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2781031901 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55a7a8bd1c00 con 0x55a7a8cc56b0 2023-07-14T13:14:34.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a1affd700 1 -- 172.21.15.17:0/2781031901 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a7a8d14490 con 0x55a7a8cc56b0 2023-07-14T13:14:34.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a1affd700 1 -- 172.21.15.17:0/2781031901 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1a2c0b92e0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a556ccb80 10 client.27601 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:14:34.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a556ccb80 10 client.27601 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:34.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a556ccb80 20 client.27601 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a7a8e82320 0x55a7a8e84700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a556ccb80 4 client.27601 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:14:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.263+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2781031901 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7a8db3e50 con 0x55a7a8e82320 2023-07-14T13:14:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.264+0000 7f1a3affd700 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a7a8e82320 0x55a7a8e84700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.264+0000 7f1a3affd700 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a7a8e82320 0x55a7a8e84700 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c77d1baaaf5c052 server_cookie=6e950dd9bd2e070b in_seq=0 out_seq=0 2023-07-14T13:14:34.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.264+0000 7f1a1affd700 10 client.27601 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.265+0000 7f1a1affd700 1 -- 172.21.15.17:0/2781031901 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a7a8db3e50 con 0x55a7a8e82320 2023-07-14T13:14:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.265+0000 7f1a1affd700 10 client.27601 handle_command_reply: tid=0 2023-07-14T13:14:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.265+0000 7f1a556ccb80 1 client.27601 shutdown 2023-07-14T13:14:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.265+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2781031901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 msgr2=0x55a7a8e783a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.265+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e783a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c097730 tx=0x7f1a2c0a1210 comp rx=0 tx=0).stop 2023-07-14T13:14:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.266+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2781031901 shutdown_connections 2023-07-14T13:14:34.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.266+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a7a8e82320 0x55a7a8e84700 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.266+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.266+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e783a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.266+0000 7f1a1affd700 0 client.27601 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:34.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.266+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/2781031901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8e69580 0x55a7a8e788e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.266+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2781031901 >> 172.21.15.17:0/2781031901 conn(0x55a7a8e5ebe0 msgr2=0x55a7a8e634e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:34.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.266+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2781031901 shutdown_connections 2023-07-14T13:14:34.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.266+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2781031901 wait complete. 2023-07-14T13:14:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.266+0000 7f1a556ccb80 20 client.27601 trim_cache size 0 max 16384 2023-07-14T13:14:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.286+0000 7f1a556ccb80 1 Processor -- start 2023-07-14T13:14:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.286+0000 7f1a556ccb80 1 -- start start 2023-07-14T13:14:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.286+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e69040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.286+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e69580 0x55a7a8e70130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.286+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e63c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.286+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8db3e50 con 0x55a7a8cc56b0 2023-07-14T13:14:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.286+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8d14490 con 0x55a7a8e69580 2023-07-14T13:14:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.286+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8e60d00 con 0x55a7a8e6f2d0 2023-07-14T13:14:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.286+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e69040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.287+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e69040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40010/0 (socket says 172.21.15.17:40010) 2023-07-14T13:14:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.287+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2744725064 learned_addr learned my addr 172.21.15.17:0/2744725064 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.287+0000 7f1a3bfff700 1 --2- 172.21.15.17:0/2744725064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e63c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.287+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2744725064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8e6f2d0 msgr2=0x55a7a8e63c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.287+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/2744725064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e63c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.287+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2744725064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e69580 msgr2=0x55a7a8e70130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.287+0000 7f1a3affd700 1 --2- 172.21.15.17:0/2744725064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e69580 0x55a7a8e70130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.287+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/2744725064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e69580 0x55a7a8e70130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.287+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/2744725064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7a8c0f1f0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.287+0000 7f1a3affd700 1 --2- 172.21.15.17:0/2744725064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e69580 0x55a7a8e70130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:14:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.287+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/2744725064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e69040 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c09b1c0 tx=0x7f1a2c086020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d1e6f677dea7da server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.288+0000 7f1a227fc700 1 -- 172.21.15.17:0/2744725064 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0aeea0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.288+0000 7f1a227fc700 1 -- 172.21.15.17:0/2744725064 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a2c0b7ef0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.288+0000 7f1a227fc700 1 -- 172.21.15.17:0/2744725064 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c0b97d0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.288+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2744725064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 msgr2=0x55a7a8e69040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.288+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/2744725064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e69040 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c09b1c0 tx=0x7f1a2c086020 comp rx=0 tx=0).stop 2023-07-14T13:14:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.288+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2744725064 shutdown_connections 2023-07-14T13:14:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.288+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/2744725064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e63c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.288+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/2744725064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e69040 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.288+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/2744725064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e69580 0x55a7a8e70130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.288+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2744725064 >> 172.21.15.17:0/2744725064 conn(0x55a7a8e5ebe0 msgr2=0x55a7a8e72510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.289+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2744725064 shutdown_connections 2023-07-14T13:14:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.289+0000 7f1a556ccb80 1 -- 172.21.15.17:0/2744725064 wait complete. 2023-07-14T13:14:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.289+0000 7f1a556ccb80 1 -- start start 2023-07-14T13:14:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.289+0000 7f1a556ccb80 1 Processor -- start 2023-07-14T13:14:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.290+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e75f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.290+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8e69580 0x55a7a8e76450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.290+0000 7f1a556ccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e76990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.290+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8ed5110 con 0x55a7a8e69580 2023-07-14T13:14:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.290+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8ed5250 con 0x55a7a8e6f2d0 2023-07-14T13:14:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.290+0000 7f1a556ccb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a8ed5390 con 0x55a7a8cc56b0 2023-07-14T13:14:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.290+0000 7f1a556ccb80 10 client.0 _ll_register_callbacks cb 0x55a7a8d58700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.290+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e75f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.290+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e75f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41894/0 (socket says 172.21.15.17:41894) 2023-07-14T13:14:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.290+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/1689793177 learned_addr learned my addr 172.21.15.17:0/1689793177 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.290+0000 7f1a3affd700 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8e69580 0x55a7a8e76450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.291+0000 7f1a3bfff700 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e76990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.291+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/1689793177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 msgr2=0x55a7a8e76990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.291+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e76990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.291+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/1689793177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8e69580 msgr2=0x55a7a8e76450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.291+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8e69580 0x55a7a8e76450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.291+0000 7f1a3b7fe700 1 -- 172.21.15.17:0/1689793177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c19d7f0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.291+0000 7f1a3b7fe700 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e75f10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0a30c0 tx=0x7f1a2c009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c627a83992a5b85 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.291+0000 7f1a1affd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:14:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.292+0000 7f1a1affd700 1 -- 172.21.15.17:0/1689793177 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c09f260 con 0x55a7a8cc56b0 2023-07-14T13:14:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.292+0000 7f1a1affd700 1 -- 172.21.15.17:0/1689793177 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1a2c0a35f0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.292+0000 7f1a556ccb80 1 -- 172.21.15.17:0/1689793177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7a8d75ff0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.292+0000 7f1a1affd700 1 -- 172.21.15.17:0/1689793177 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a2c0a3160 con 0x55a7a8cc56b0 2023-07-14T13:14:34.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.292+0000 7f1a556ccb80 10 client.27607 fetch_fsmap learned FSMap version 41 2023-07-14T13:14:34.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.292+0000 7f1a556ccb80 1 -- 172.21.15.17:0/1689793177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55a7a8be7250 con 0x55a7a8cc56b0 2023-07-14T13:14:34.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.293+0000 7f1a1affd700 1 -- 172.21.15.17:0/1689793177 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a2c0b7020 con 0x55a7a8cc56b0 2023-07-14T13:14:34.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.293+0000 7f1a1affd700 1 -- 172.21.15.17:0/1689793177 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1a2c0cb4f0 con 0x55a7a8cc56b0 2023-07-14T13:14:34.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.293+0000 7f1a556ccb80 10 client.27607 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:14:34.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.293+0000 7f1a556ccb80 10 client.27607 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.293+0000 7f1a556ccb80 20 client.27607 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.293+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a7a8ed6540 0x55a7a8ed8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.293+0000 7f1a556ccb80 4 client.27607 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:14:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.293+0000 7f1a556ccb80 1 -- 172.21.15.17:0/1689793177 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a7a8c09f10 con 0x55a7a8ed6540 2023-07-14T13:14:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.293+0000 7f1a3affd700 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a7a8ed6540 0x55a7a8ed8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.294+0000 7f1a3affd700 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a7a8ed6540 0x55a7a8ed8920 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c571cfb050392bf server_cookie=1d7b084e7ad0f215 in_seq=0 out_seq=0 2023-07-14T13:14:34.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.294+0000 7f1a1affd700 10 client.27607 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a1affd700 1 -- 172.21.15.17:0/1689793177 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a7a8c09f10 con 0x55a7a8ed6540 2023-07-14T13:14:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a1affd700 10 client.27607 handle_command_reply: tid=0 2023-07-14T13:14:34.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 1 client.27607 shutdown 2023-07-14T13:14:34.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 1 -- 172.21.15.17:0/1689793177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 msgr2=0x55a7a8e75f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:34.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e75f10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0a30c0 tx=0x7f1a2c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 1 -- 172.21.15.17:0/1689793177 shutdown_connections 2023-07-14T13:14:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a7a8ed6540 0x55a7a8ed8920 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7a8e6f2d0 0x55a7a8e76990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7a8cc56b0 0x55a7a8e75f10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 1 --2- 172.21.15.17:0/1689793177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a7a8e69580 0x55a7a8e76450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a1affd700 0 client.27607 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 1 -- 172.21.15.17:0/1689793177 >> 172.21.15.17:0/1689793177 conn(0x55a7a8e5ebe0 msgr2=0x55a7a8e70da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 1 -- 172.21.15.17:0/1689793177 shutdown_connections 2023-07-14T13:14:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 1 -- 172.21.15.17:0/1689793177 wait complete. 2023-07-14T13:14:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.303+0000 7f1a556ccb80 20 client.27607 trim_cache size 0 max 16384 2023-07-14T13:14:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:14:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:14:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:14:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:14:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 -- 172.21.15.17:0/2305663235 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a240a12c0 msgr2=0x7f1a240a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a240a12c0 0x7f1a240a3770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009fd0 tx=0x7f1a3400b040 comp rx=0 tx=0).stop 2023-07-14T13:14:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 -- 172.21.15.17:0/2305663235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3c067c10 msgr2=0x7f1a3c197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3c067c10 0x7f1a3c197dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c000c00 tx=0x7f1a2c00bfd0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 -- 172.21.15.17:0/2305663235 shutdown_connections 2023-07-14T13:14:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a240a12c0 0x7f1a240a3770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a3c104e50 0x7f1a3c19c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a3c067c10 0x7f1a3c197dc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 --2- 172.21.15.17:0/2305663235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a3c0685b0 0x7f1a3c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:34.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 -- 172.21.15.17:0/2305663235 >> 172.21.15.17:0/2305663235 conn(0x7f1a3c074760 msgr2=0x7f1a3c0fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:34.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 -- 172.21.15.17:0/2305663235 shutdown_connections 2023-07-14T13:14:34.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:34.304+0000 7f1a41dff700 1 -- 172.21.15.17:0/2305663235 wait complete. 2023-07-14T13:14:34.827 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:14:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.057+0000 7f51c6bff700 1 -- 172.21.15.17:0/3524919164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c0101f70 msgr2=0x7f51c0102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.057+0000 7f51c6bff700 1 --2- 172.21.15.17:0/3524919164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c0101f70 0x7f51c0102340 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009920 tx=0x7f51b4009c30 comp rx=0 tx=0).stop 2023-07-14T13:14:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.057+0000 7f51c6bff700 1 -- 172.21.15.17:0/3524919164 shutdown_connections 2023-07-14T13:14:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.057+0000 7f51c6bff700 1 --2- 172.21.15.17:0/3524919164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51c0106fb0 0x7f51c010eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.057+0000 7f51c6bff700 1 --2- 172.21.15.17:0/3524919164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c0101f70 0x7f51c0102340 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.057+0000 7f51c6bff700 1 --2- 172.21.15.17:0/3524919164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c0102910 0x7f51c01068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.057+0000 7f51c6bff700 1 -- 172.21.15.17:0/3524919164 >> 172.21.15.17:0/3524919164 conn(0x7f51c00fd7e0 msgr2=0x7f51c00ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.057+0000 7f51c6bff700 1 -- 172.21.15.17:0/3524919164 shutdown_connections 2023-07-14T13:14:35.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.057+0000 7f51c6bff700 1 -- 172.21.15.17:0/3524919164 wait complete. 2023-07-14T13:14:35.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.058+0000 7f51c6bff700 1 Processor -- start 2023-07-14T13:14:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51c6bff700 1 -- start start 2023-07-14T13:14:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51c6bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c0101f70 0x7f51c0197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51c6bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51c0102910 0x7f51c0198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51c6bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c0106fb0 0x7f51c019c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51c6bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c019cdf0 con 0x7f51c0106fb0 2023-07-14T13:14:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51c6bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c019cf60 con 0x7f51c0102910 2023-07-14T13:14:35.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51c6bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c019d120 con 0x7f51c0101f70 2023-07-14T13:14:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51c499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c0101f70 0x7f51c0197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51bffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51c0102910 0x7f51c0198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51c499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c0101f70 0x7f51c0197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44966/0 (socket says 172.21.15.17:44966) 2023-07-14T13:14:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51c499b700 1 -- 172.21.15.17:0/2821812047 learned_addr learned my addr 172.21.15.17:0/2821812047 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.059+0000 7f51c519c700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c0106fb0 0x7f51c019c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.060+0000 7f51c499b700 1 -- 172.21.15.17:0/2821812047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51c0102910 msgr2=0x7f51c0198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.060+0000 7f51c499b700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51c0102910 0x7f51c0198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.060+0000 7f51c499b700 1 -- 172.21.15.17:0/2821812047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c0106fb0 msgr2=0x7f51c019c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.060+0000 7f51c499b700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c0106fb0 0x7f51c019c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.060+0000 7f51c499b700 1 -- 172.21.15.17:0/2821812047 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0095f0 con 0x7f51c0101f70 2023-07-14T13:14:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.060+0000 7f51c499b700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c0101f70 0x7f51c0197e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009840 tx=0x7f51b400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.060+0000 7f51bdffb700 1 -- 172.21.15.17:0/2821812047 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b401c070 con 0x7f51c0101f70 2023-07-14T13:14:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.061+0000 7f51bdffb700 1 -- 172.21.15.17:0/2821812047 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f51b400ba70 con 0x7f51c0101f70 2023-07-14T13:14:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.061+0000 7f51bdffb700 1 -- 172.21.15.17:0/2821812047 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4003680 con 0x7f51c0101f70 2023-07-14T13:14:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.061+0000 7f51c6bff700 1 -- 172.21.15.17:0/2821812047 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b4009520 con 0x7f51c0101f70 2023-07-14T13:14:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.061+0000 7f51c6bff700 1 -- 172.21.15.17:0/2821812047 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c019d5e0 con 0x7f51c0101f70 2023-07-14T13:14:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.066+0000 7f51bdffb700 1 -- 172.21.15.17:0/2821812047 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f51b4020030 con 0x7f51c0101f70 2023-07-14T13:14:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.067+0000 7f51da54ab80 1 Processor -- start 2023-07-14T13:14:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.067+0000 7f51da54ab80 1 -- start start 2023-07-14T13:14:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.067+0000 7f51bdffb700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51b00a1340 0x7f51b00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.067+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590d2d0 0x55bed590d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.067+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 0x55bed5918590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.067+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed5918ad0 0x55bed591aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51da54ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed5813cb0 con 0x55bed590d2d0 2023-07-14T13:14:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51da54ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed5866a40 con 0x55bed590dbe0 2023-07-14T13:14:35.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51da54ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed585fed0 con 0x55bed5918ad0 2023-07-14T13:14:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51bdffb700 1 -- 172.21.15.17:0/2821812047 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f51b40cdaa0 con 0x7f51c0101f70 2023-07-14T13:14:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51c519c700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51b00a1340 0x7f51b00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51c499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590d2d0 0x55bed590d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51bffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 0x55bed5918590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51bffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 0x55bed5918590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59650/0 (socket says 172.21.15.17:59650) 2023-07-14T13:14:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51bffff700 1 -- 172.21.15.17:0/2251120030 learned_addr learned my addr 172.21.15.17:0/2251120030 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51c519c700 1 --2- 172.21.15.17:0/2251120030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed5918ad0 0x55bed591aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51bffff700 1 -- 172.21.15.17:0/2251120030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed5918ad0 msgr2=0x55bed591aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:35.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51bffff700 1 --2- 172.21.15.17:0/2251120030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed5918ad0 0x55bed591aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51bffff700 1 -- 172.21.15.17:0/2251120030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590d2d0 msgr2=0x55bed590d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51bffff700 1 --2- 172.21.15.17:0/2251120030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590d2d0 0x55bed590d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51bffff700 1 -- 172.21.15.17:0/2251120030 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bed568dde0 con 0x55bed590dbe0 2023-07-14T13:14:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.068+0000 7f51c499b700 1 --2- 172.21.15.17:0/2251120030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590d2d0 0x55bed590d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.069+0000 7f51c519c700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51b00a1340 0x7f51b00a37f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009ec0 tx=0x7f51b80092f0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.069+0000 7f51bffff700 1 --2- 172.21.15.17:0/2251120030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 0x55bed5918590 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009f50 tx=0x7f51ac011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90ef5b9761116081 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.069+0000 7f51aaffd700 1 -- 172.21.15.17:0/2251120030 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0042f0 con 0x55bed590dbe0 2023-07-14T13:14:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.069+0000 7f51aaffd700 1 -- 172.21.15.17:0/2251120030 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f51ac004450 con 0x55bed590dbe0 2023-07-14T13:14:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.069+0000 7f51aaffd700 1 -- 172.21.15.17:0/2251120030 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac019760 con 0x55bed590dbe0 2023-07-14T13:14:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.070+0000 7f51da54ab80 1 -- 172.21.15.17:0/2251120030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 msgr2=0x55bed5918590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.070+0000 7f51da54ab80 1 --2- 172.21.15.17:0/2251120030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 0x55bed5918590 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009f50 tx=0x7f51ac011720 comp rx=0 tx=0).stop 2023-07-14T13:14:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.070+0000 7f51da54ab80 1 -- 172.21.15.17:0/2251120030 shutdown_connections 2023-07-14T13:14:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.070+0000 7f51da54ab80 1 --2- 172.21.15.17:0/2251120030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed5918ad0 0x55bed591aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.070+0000 7f51da54ab80 1 --2- 172.21.15.17:0/2251120030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590d2d0 0x55bed590d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.070+0000 7f51da54ab80 1 --2- 172.21.15.17:0/2251120030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 0x55bed5918590 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.070+0000 7f51da54ab80 1 -- 172.21.15.17:0/2251120030 >> 172.21.15.17:0/2251120030 conn(0x55bed5903da0 msgr2=0x55bed59096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.070+0000 7f51da54ab80 1 -- 172.21.15.17:0/2251120030 shutdown_connections 2023-07-14T13:14:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.070+0000 7f51da54ab80 1 -- 172.21.15.17:0/2251120030 wait complete. 2023-07-14T13:14:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.071+0000 7f51da54ab80 1 -- start start 2023-07-14T13:14:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.071+0000 7f51da54ab80 1 Processor -- start 2023-07-14T13:14:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.071+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed5915820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.071+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 0x55bed5915d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed5918ad0 0x55bed59162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51da54ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed57ffac0 con 0x55bed5918ad0 2023-07-14T13:14:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51da54ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed57ff7c0 con 0x55bed590dbe0 2023-07-14T13:14:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51da54ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed56e3920 con 0x55bed590d2d0 2023-07-14T13:14:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51da54ab80 10 client.0 _ll_register_callbacks cb 0x55bed57fd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51c499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed5915820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51c499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed5915820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44994/0 (socket says 172.21.15.17:44994) 2023-07-14T13:14:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51c499b700 1 -- 172.21.15.17:0/3295915344 learned_addr learned my addr 172.21.15.17:0/3295915344 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:35.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51c519c700 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed5918ad0 0x55bed59162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51bffff700 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 0x55bed5915d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51c499b700 1 -- 172.21.15.17:0/3295915344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 msgr2=0x55bed5915d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:35.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51c499b700 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 0x55bed5915d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51c499b700 1 -- 172.21.15.17:0/3295915344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed5918ad0 msgr2=0x55bed59162a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:35.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51c499b700 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed5918ad0 0x55bed59162a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51c499b700 1 -- 172.21.15.17:0/3295915344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c019d5e0 con 0x55bed590d2d0 2023-07-14T13:14:35.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.072+0000 7f51bffff700 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 0x55bed5915d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:14:35.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f51c499b700 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed5915820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f51b40cb810 tx=0x7f51b409a600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=782547d0ce8878e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:35.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f519ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:14:35.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f519ffff700 1 -- 172.21.15.17:0/3295915344 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b409ec50 con 0x55bed590d2d0 2023-07-14T13:14:35.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f519ffff700 1 -- 172.21.15.17:0/3295915344 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f51b40a2fe0 con 0x55bed590d2d0 2023-07-14T13:14:35.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f51da54ab80 1 -- 172.21.15.17:0/3295915344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bed57b94f0 con 0x55bed590d2d0 2023-07-14T13:14:35.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f519ffff700 1 -- 172.21.15.17:0/3295915344 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51b40841f0 con 0x55bed590d2d0 2023-07-14T13:14:35.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f51da54ab80 10 client.27619 fetch_fsmap learned FSMap version 41 2023-07-14T13:14:35.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f51da54ab80 1 -- 172.21.15.17:0/3295915344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7f51ac009b80 con 0x55bed590d2d0 2023-07-14T13:14:35.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f519ffff700 1 -- 172.21.15.17:0/3295915344 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bed57b94f0 con 0x55bed590d2d0 2023-07-14T13:14:35.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f519ffff700 1 -- 172.21.15.17:0/3295915344 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f51b407eb90 con 0x55bed590d2d0 2023-07-14T13:14:35.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f51da54ab80 10 client.27619 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:14:35.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f51da54ab80 10 client.27619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:35.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f51da54ab80 20 client.27619 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:35.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f51da54ab80 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bed5928020 0x55bed592a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f51da54ab80 4 client.27619 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:14:35.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.073+0000 7f51da54ab80 1 -- 172.21.15.17:0/3295915344 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bed5858eb0 con 0x55bed5928020 2023-07-14T13:14:35.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.074+0000 7f51bffff700 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bed5928020 0x55bed592a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.075+0000 7f519ffff700 10 client.27619 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:35.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.075+0000 7f51bffff700 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bed5928020 0x55bed592a430 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35c14902f23c5e4e server_cookie=d9eb2e7256c3b65 in_seq=0 out_seq=0 2023-07-14T13:14:35.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.075+0000 7f519ffff700 1 -- 172.21.15.17:0/3295915344 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bed5858eb0 con 0x55bed5928020 2023-07-14T13:14:35.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.075+0000 7f519ffff700 10 client.27619 handle_command_reply: tid=0 2023-07-14T13:14:35.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.075+0000 7f51da54ab80 1 client.27619 shutdown 2023-07-14T13:14:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f51da54ab80 1 -- 172.21.15.17:0/3295915344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 msgr2=0x55bed5915820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f51da54ab80 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed5915820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f51b40cb810 tx=0x7f51b409a600 comp rx=0 tx=0).stop 2023-07-14T13:14:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f51da54ab80 1 -- 172.21.15.17:0/3295915344 shutdown_connections 2023-07-14T13:14:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f51da54ab80 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bed5928020 0x55bed592a430 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f51da54ab80 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed5918ad0 0x55bed59162a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f51da54ab80 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed5915820 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f519ffff700 0 client.27619 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:35.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f51da54ab80 1 --2- 172.21.15.17:0/3295915344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed590dbe0 0x55bed5915d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f51da54ab80 1 -- 172.21.15.17:0/3295915344 >> 172.21.15.17:0/3295915344 conn(0x55bed5903da0 msgr2=0x55bed5909230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f51da54ab80 1 -- 172.21.15.17:0/3295915344 shutdown_connections 2023-07-14T13:14:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f51da54ab80 1 -- 172.21.15.17:0/3295915344 wait complete. 2023-07-14T13:14:35.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.076+0000 7f51da54ab80 20 client.27619 trim_cache size 0 max 16384 2023-07-14T13:14:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.095+0000 7f51da54ab80 1 Processor -- start 2023-07-14T13:14:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.095+0000 7f51da54ab80 1 -- start start 2023-07-14T13:14:35.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590dbe0 0x55bed5915d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed5918ad0 0x55bed59162d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51da54ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed590e330 con 0x55bed590dbe0 2023-07-14T13:14:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51da54ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed590ad20 con 0x55bed5918ad0 2023-07-14T13:14:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51da54ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed590d8f0 con 0x55bed590d2d0 2023-07-14T13:14:35.136 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590dbe0 0x55bed5915d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51c519c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed5918ad0 0x55bed59162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51c499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51c519c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed5918ad0 0x55bed59162d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59670/0 (socket says 172.21.15.17:59670) 2023-07-14T13:14:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51c499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45000/0 (socket says 172.21.15.17:45000) 2023-07-14T13:14:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51c519c700 1 -- 172.21.15.17:0/3024199195 learned_addr learned my addr 172.21.15.17:0/3024199195 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51c499b700 1 -- 172.21.15.17:0/3024199195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed5918ad0 msgr2=0x55bed59162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:35.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51c499b700 1 --2- 172.21.15.17:0/3024199195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed5918ad0 0x55bed59162d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51c499b700 1 -- 172.21.15.17:0/3024199195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590dbe0 msgr2=0x55bed5915d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51c499b700 1 --2- 172.21.15.17:0/3024199195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590dbe0 0x55bed5915d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.096+0000 7f51c499b700 1 -- 172.21.15.17:0/3024199195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bed59055e0 con 0x55bed590d2d0 2023-07-14T13:14:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.097+0000 7f51c499b700 1 --2- 172.21.15.17:0/3024199195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591f4b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f51b4097690 tx=0x7f51b409ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=478dcf0abff18887 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.097+0000 7f51ab7fe700 1 -- 172.21.15.17:0/3024199195 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40a3060 con 0x55bed590d2d0 2023-07-14T13:14:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.097+0000 7f51ab7fe700 1 -- 172.21.15.17:0/3024199195 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f51b409ec50 con 0x55bed590d2d0 2023-07-14T13:14:35.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.097+0000 7f51ab7fe700 1 -- 172.21.15.17:0/3024199195 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b407f330 con 0x55bed590d2d0 2023-07-14T13:14:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.098+0000 7f51da54ab80 1 -- 172.21.15.17:0/3024199195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 msgr2=0x55bed591f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.098+0000 7f51da54ab80 1 --2- 172.21.15.17:0/3024199195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591f4b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f51b4097690 tx=0x7f51b409ada0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.098+0000 7f51da54ab80 1 -- 172.21.15.17:0/3024199195 shutdown_connections 2023-07-14T13:14:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.098+0000 7f51da54ab80 1 --2- 172.21.15.17:0/3024199195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed5918ad0 0x55bed59162d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.098+0000 7f51da54ab80 1 --2- 172.21.15.17:0/3024199195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591f4b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.098+0000 7f51da54ab80 1 --2- 172.21.15.17:0/3024199195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590dbe0 0x55bed5915d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.098+0000 7f51da54ab80 1 -- 172.21.15.17:0/3024199195 >> 172.21.15.17:0/3024199195 conn(0x55bed5903da0 msgr2=0x55bed5910b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:35.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.098+0000 7f51da54ab80 1 -- 172.21.15.17:0/3024199195 shutdown_connections 2023-07-14T13:14:35.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.098+0000 7f51da54ab80 1 -- 172.21.15.17:0/3024199195 wait complete. 2023-07-14T13:14:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.098+0000 7f51da54ab80 1 -- start start 2023-07-14T13:14:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.099+0000 7f51da54ab80 1 Processor -- start 2023-07-14T13:14:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.099+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.099+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590dbe0 0x55bed591d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.099+0000 7f51da54ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed5918ad0 0x55bed597aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.099+0000 7f51da54ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed597b420 con 0x55bed590dbe0 2023-07-14T13:14:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.099+0000 7f51da54ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed597b590 con 0x55bed5918ad0 2023-07-14T13:14:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.099+0000 7f51da54ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bed597b750 con 0x55bed590d2d0 2023-07-14T13:14:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.099+0000 7f51da54ab80 10 client.0 _ll_register_callbacks cb 0x7f51b409a9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51c499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590dbe0 0x55bed591d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51c499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45010/0 (socket says 172.21.15.17:45010) 2023-07-14T13:14:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51c499b700 1 -- 172.21.15.17:0/238476331 learned_addr learned my addr 172.21.15.17:0/238476331 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51c519c700 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed5918ad0 0x55bed597aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51c499b700 1 -- 172.21.15.17:0/238476331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed5918ad0 msgr2=0x55bed597aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51c499b700 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed5918ad0 0x55bed597aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51c499b700 1 -- 172.21.15.17:0/238476331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590dbe0 msgr2=0x55bed591d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51c499b700 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590dbe0 0x55bed591d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51c499b700 1 -- 172.21.15.17:0/238476331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac009b80 con 0x55bed590d2d0 2023-07-14T13:14:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51bffff700 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590dbe0 0x55bed591d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f51c499b700 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591d2d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f51b4098f70 tx=0x7f51b40b3470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=711040fe7ff6c149 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.100+0000 7f519ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:14:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.101+0000 7f519ffff700 1 -- 172.21.15.17:0/238476331 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40a3060 con 0x55bed590d2d0 2023-07-14T13:14:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.101+0000 7f519ffff700 1 -- 172.21.15.17:0/238476331 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f51b40cb490 con 0x55bed590d2d0 2023-07-14T13:14:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.101+0000 7f51da54ab80 1 -- 172.21.15.17:0/238476331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f51ac004450 con 0x55bed590d2d0 2023-07-14T13:14:35.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.101+0000 7f519ffff700 1 -- 172.21.15.17:0/238476331 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51b407f120 con 0x55bed590d2d0 2023-07-14T13:14:35.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.101+0000 7f51da54ab80 10 client.27625 fetch_fsmap learned FSMap version 41 2023-07-14T13:14:35.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.101+0000 7f51da54ab80 1 -- 172.21.15.17:0/238476331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55bed5676c60 con 0x55bed590d2d0 2023-07-14T13:14:35.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.101+0000 7f519ffff700 1 -- 172.21.15.17:0/238476331 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f51ac004450 con 0x55bed590d2d0 2023-07-14T13:14:35.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.102+0000 7f519ffff700 1 -- 172.21.15.17:0/238476331 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f51b40a2b50 con 0x55bed590d2d0 2023-07-14T13:14:35.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.102+0000 7f51da54ab80 10 client.27625 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:14:35.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.102+0000 7f51da54ab80 10 client.27625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:35.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.102+0000 7f51da54ab80 20 client.27625 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:35.146 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.102+0000 7f51da54ab80 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bed597c990 0x55bed597ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:35.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.102+0000 7f51da54ab80 4 client.27625 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:14:35.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.102+0000 7f51da54ab80 1 -- 172.21.15.17:0/238476331 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bed581b050 con 0x55bed597c990 2023-07-14T13:14:35.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.102+0000 7f51bffff700 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bed597c990 0x55bed597ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:35.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f51bffff700 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bed597c990 0x55bed597ed70 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1335a11bff329a server_cookie=698041ae20b0bac2 in_seq=0 out_seq=0 2023-07-14T13:14:35.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f519ffff700 10 client.27625 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:35.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f519ffff700 1 -- 172.21.15.17:0/238476331 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55bed581b050 con 0x55bed597c990 2023-07-14T13:14:35.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f519ffff700 10 client.27625 handle_command_reply: tid=0 2023-07-14T13:14:35.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f51da54ab80 1 client.27625 shutdown 2023-07-14T13:14:35.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f51da54ab80 1 -- 172.21.15.17:0/238476331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 msgr2=0x55bed591d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:35.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f51da54ab80 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591d2d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f51b4098f70 tx=0x7f51b40b3470 comp rx=0 tx=0).stop 2023-07-14T13:14:35.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f51da54ab80 1 -- 172.21.15.17:0/238476331 shutdown_connections 2023-07-14T13:14:35.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f51da54ab80 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bed597c990 0x55bed597ed70 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f51da54ab80 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bed5918ad0 0x55bed597aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f519ffff700 0 client.27625 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:35.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f51da54ab80 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bed590d2d0 0x55bed591d2d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f51da54ab80 1 --2- 172.21.15.17:0/238476331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bed590dbe0 0x55bed591d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f51da54ab80 1 -- 172.21.15.17:0/238476331 >> 172.21.15.17:0/238476331 conn(0x55bed5903da0 msgr2=0x55bed590f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:35.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.103+0000 7f51da54ab80 1 -- 172.21.15.17:0/238476331 shutdown_connections 2023-07-14T13:14:35.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51da54ab80 1 -- 172.21.15.17:0/238476331 wait complete. 2023-07-14T13:14:35.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51da54ab80 20 client.27625 trim_cache size 0 max 16384 2023-07-14T13:14:35.149 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:14:35.150 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:14:35.150 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:14:35.150 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:14:35.150 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:14:35.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:14:35.150 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:14:35.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:14:35.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:14:35.151 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:14:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51c6bff700 1 -- 172.21.15.17:0/2821812047 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51b00a1340 msgr2=0x7f51b00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:35.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51c6bff700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51b00a1340 0x7f51b00a37f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009ec0 tx=0x7f51b80092f0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51c6bff700 1 -- 172.21.15.17:0/2821812047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c0101f70 msgr2=0x7f51c0197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51c6bff700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c0101f70 0x7f51c0197e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009840 tx=0x7f51b400fa00 comp rx=0 tx=0).stop 2023-07-14T13:14:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51c6bff700 1 -- 172.21.15.17:0/2821812047 shutdown_connections 2023-07-14T13:14:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51c6bff700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f51b00a1340 0x7f51b00a37f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51c6bff700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c0106fb0 0x7f51c019c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51c6bff700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51c0101f70 0x7f51c0197e10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51c6bff700 1 --2- 172.21.15.17:0/2821812047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51c0102910 0x7f51c0198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:35.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.104+0000 7f51c6bff700 1 -- 172.21.15.17:0/2821812047 >> 172.21.15.17:0/2821812047 conn(0x7f51c00fd7e0 msgr2=0x7f51c00fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:35.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.105+0000 7f51c6bff700 1 -- 172.21.15.17:0/2821812047 shutdown_connections 2023-07-14T13:14:35.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:14:35.105+0000 7f51c6bff700 1 -- 172.21.15.17:0/2821812047 wait complete. 2023-07-14T13:14:35.162 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:14:35.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:35 smithi131 ceph-mon[96953]: pgmap v466: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:14:35.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:35 smithi017 ceph-mon[95536]: pgmap v466: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:14:35.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:35 smithi135 ceph-mon[97338]: pgmap v466: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:14:37.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:37 smithi131 ceph-mon[96953]: pgmap v467: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-14T13:14:37.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:37 smithi017 ceph-mon[95536]: pgmap v467: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-14T13:14:37.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:37 smithi135 ceph-mon[97338]: pgmap v467: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-14T13:14:39.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:39 smithi131 ceph-mon[96953]: pgmap v468: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:14:39.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:39 smithi017 ceph-mon[95536]: pgmap v468: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:14:39.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:39 smithi135 ceph-mon[97338]: pgmap v468: 97 pgs: 97 active+clean; 12 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:14:41.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:41 smithi131 ceph-mon[96953]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 36 MiB/s wr, 25 op/s 2023-07-14T13:14:41.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:41 smithi017 ceph-mon[95536]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 36 MiB/s wr, 25 op/s 2023-07-14T13:14:41.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:41 smithi135 ceph-mon[97338]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 36 MiB/s wr, 25 op/s 2023-07-14T13:14:43.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:43 smithi131 ceph-mon[96953]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-14T13:14:43.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:43 smithi017 ceph-mon[95536]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-14T13:14:43.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:43 smithi135 ceph-mon[97338]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-14T13:14:45.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:45 smithi131 ceph-mon[96953]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:14:45.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:45 smithi017 ceph-mon[95536]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:14:45.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:45 smithi135 ceph-mon[97338]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:14:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.464+0000 7fc2323ff700 1 -- 172.21.15.17:0/1198647377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c0682b0 msgr2=0x7fc22c10c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.464+0000 7fc2323ff700 1 --2- 172.21.15.17:0/1198647377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c0682b0 0x7fc22c10c000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc220009990 tx=0x7fc220009ca0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.464+0000 7fc2323ff700 1 -- 172.21.15.17:0/1198647377 shutdown_connections 2023-07-14T13:14:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.464+0000 7fc2323ff700 1 --2- 172.21.15.17:0/1198647377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc22c10c540 0x7fc22c10e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.464+0000 7fc2323ff700 1 --2- 172.21.15.17:0/1198647377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c0679a0 0x7fc22c067d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.464+0000 7fc2323ff700 1 --2- 172.21.15.17:0/1198647377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c0682b0 0x7fc22c10c000 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.464+0000 7fc2323ff700 1 -- 172.21.15.17:0/1198647377 >> 172.21.15.17:0/1198647377 conn(0x7fc22c074760 msgr2=0x7fc22c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.464+0000 7fc2323ff700 1 -- 172.21.15.17:0/1198647377 shutdown_connections 2023-07-14T13:14:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.464+0000 7fc2323ff700 1 -- 172.21.15.17:0/1198647377 wait complete. 2023-07-14T13:14:47.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:47 smithi131 ceph-mon[96953]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 26 op/s 2023-07-14T13:14:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.466+0000 7fc2323ff700 1 Processor -- start 2023-07-14T13:14:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.466+0000 7fc2323ff700 1 -- start start 2023-07-14T13:14:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.466+0000 7fc2323ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c0679a0 0x7fc22c197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.466+0000 7fc2323ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c0682b0 0x7fc22c198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.466+0000 7fc2323ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc22c10c540 0x7fc22c19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.466+0000 7fc2323ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c19cf40 con 0x7fc22c10c540 2023-07-14T13:14:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.466+0000 7fc2323ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c19d0b0 con 0x7fc22c0682b0 2023-07-14T13:14:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.466+0000 7fc2323ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c19d270 con 0x7fc22c0679a0 2023-07-14T13:14:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc22bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c0679a0 0x7fc22c197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc22b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c0682b0 0x7fc22c198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc23099c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc22c10c540 0x7fc22c19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc22bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c0679a0 0x7fc22c197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40822/0 (socket says 172.21.15.17:40822) 2023-07-14T13:14:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc22b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c0682b0 0x7fc22c198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58160/0 (socket says 172.21.15.17:58160) 2023-07-14T13:14:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc22bfff700 1 -- 172.21.15.17:0/1675941011 learned_addr learned my addr 172.21.15.17:0/1675941011 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc22b7fe700 1 -- 172.21.15.17:0/1675941011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c0679a0 msgr2=0x7fc22c197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c0679a0 0x7fc22c197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc22b7fe700 1 -- 172.21.15.17:0/1675941011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc22c10c540 msgr2=0x7fc22c19c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc22c10c540 0x7fc22c19c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc22b7fe700 1 -- 172.21.15.17:0/1675941011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2200095f0 con 0x7fc22c0682b0 2023-07-14T13:14:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.467+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c0682b0 0x7fc22c198290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc2200098e0 tx=0x7fc220004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.468+0000 7fc2297fa700 1 -- 172.21.15.17:0/1675941011 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22001d070 con 0x7fc22c0682b0 2023-07-14T13:14:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.468+0000 7fc2297fa700 1 -- 172.21.15.17:0/1675941011 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc220022470 con 0x7fc22c0682b0 2023-07-14T13:14:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.468+0000 7fc2323ff700 1 -- 172.21.15.17:0/1675941011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22c19d4f0 con 0x7fc22c0682b0 2023-07-14T13:14:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.468+0000 7fc2297fa700 1 -- 172.21.15.17:0/1675941011 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220017650 con 0x7fc22c0682b0 2023-07-14T13:14:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.468+0000 7fc2323ff700 1 -- 172.21.15.17:0/1675941011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c1a4d90 con 0x7fc22c0682b0 2023-07-14T13:14:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.472+0000 7fc2297fa700 1 -- 172.21.15.17:0/1675941011 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc2200225e0 con 0x7fc22c0682b0 2023-07-14T13:14:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.473+0000 7fc245d59b80 1 Processor -- start 2023-07-14T13:14:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.473+0000 7fc2297fa700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc2140a12c0 0x7fc2140a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.473+0000 7fc245d59b80 1 -- start start 2023-07-14T13:14:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.473+0000 7fc2297fa700 1 -- 172.21.15.17:0/1675941011 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc2200ce080 con 0x7fc22c0682b0 2023-07-14T13:14:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc23099c700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc2140a12c0 0x7fc2140a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d0ad6b0 0x560e5d256d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d251040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d251580 0x560e5d2519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc245d59b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d156c50 con 0x560e5d0ad6b0 2023-07-14T13:14:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc245d59b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d1a99e0 con 0x560e5d251580 2023-07-14T13:14:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc245d59b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d1a2e70 con 0x560e5d2572d0 2023-07-14T13:14:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc22bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d0ad6b0 0x560e5d256d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc22b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d251040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc22bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d0ad6b0 0x560e5d256d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43334/0 (socket says 172.21.15.17:43334) 2023-07-14T13:14:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc22bfff700 1 -- 172.21.15.17:0/3707029250 learned_addr learned my addr 172.21.15.17:0/3707029250 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.474+0000 7fc23099c700 1 --2- 172.21.15.17:0/3707029250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d251580 0x560e5d2519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc22bfff700 1 -- 172.21.15.17:0/3707029250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 msgr2=0x560e5d251040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc22bfff700 1 --2- 172.21.15.17:0/3707029250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d251040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc22bfff700 1 -- 172.21.15.17:0/3707029250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d251580 msgr2=0x560e5d2519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc22bfff700 1 --2- 172.21.15.17:0/3707029250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d251580 0x560e5d2519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc22bfff700 1 -- 172.21.15.17:0/3707029250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e5cfd0d80 con 0x560e5d0ad6b0 2023-07-14T13:14:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc23099c700 1 --2- 172.21.15.17:0/3707029250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d251580 0x560e5d2519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:14:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc23099c700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc2140a12c0 0x7fc2140a3770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0733d0 tx=0x7fc22400b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/3707029250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d251040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc22bfff700 1 --2- 172.21.15.17:0/3707029250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d0ad6b0 0x560e5d256d90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009e50 tx=0x7fc21c011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b41dfee76a420d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc2127fc700 1 -- 172.21.15.17:0/3707029250 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c004a30 con 0x560e5d0ad6b0 2023-07-14T13:14:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc2127fc700 1 -- 172.21.15.17:0/3707029250 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc21c0054b0 con 0x560e5d0ad6b0 2023-07-14T13:14:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.475+0000 7fc2127fc700 1 -- 172.21.15.17:0/3707029250 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0198d0 con 0x560e5d0ad6b0 2023-07-14T13:14:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.476+0000 7fc245d59b80 1 -- 172.21.15.17:0/3707029250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d0ad6b0 msgr2=0x560e5d256d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.476+0000 7fc245d59b80 1 --2- 172.21.15.17:0/3707029250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d0ad6b0 0x560e5d256d90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009e50 tx=0x7fc21c011720 comp rx=0 tx=0).stop 2023-07-14T13:14:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.476+0000 7fc245d59b80 1 -- 172.21.15.17:0/3707029250 shutdown_connections 2023-07-14T13:14:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.476+0000 7fc245d59b80 1 --2- 172.21.15.17:0/3707029250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d251580 0x560e5d2519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.476+0000 7fc245d59b80 1 --2- 172.21.15.17:0/3707029250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d0ad6b0 0x560e5d256d90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.476+0000 7fc245d59b80 1 --2- 172.21.15.17:0/3707029250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d251040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.476+0000 7fc245d59b80 1 -- 172.21.15.17:0/3707029250 >> 172.21.15.17:0/3707029250 conn(0x560e5d246be0 msgr2=0x560e5d24bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.476+0000 7fc245d59b80 1 -- 172.21.15.17:0/3707029250 shutdown_connections 2023-07-14T13:14:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.476+0000 7fc245d59b80 1 -- 172.21.15.17:0/3707029250 wait complete. 2023-07-14T13:14:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.477+0000 7fc245d59b80 1 -- start start 2023-07-14T13:14:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.477+0000 7fc245d59b80 1 Processor -- start 2023-07-14T13:14:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d0ad6b0 0x560e5d25d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d251580 0x560e5d25a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d2572d0 0x560e5d25add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc245d59b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d142a60 con 0x560e5d2572d0 2023-07-14T13:14:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc245d59b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d142760 con 0x560e5d251580 2023-07-14T13:14:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc245d59b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d0268c0 con 0x560e5d0ad6b0 2023-07-14T13:14:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc245d59b80 10 client.0 _ll_register_callbacks cb 0x560e5d140700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc22bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d0ad6b0 0x560e5d25d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc22b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d251580 0x560e5d25a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc22bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d0ad6b0 0x560e5d25d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40846/0 (socket says 172.21.15.17:40846) 2023-07-14T13:14:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc22bfff700 1 -- 172.21.15.17:0/1118847223 learned_addr learned my addr 172.21.15.17:0/1118847223 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc23099c700 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d2572d0 0x560e5d25add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc22bfff700 1 -- 172.21.15.17:0/1118847223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d251580 msgr2=0x560e5d25a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc22bfff700 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d251580 0x560e5d25a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc22bfff700 1 -- 172.21.15.17:0/1118847223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d2572d0 msgr2=0x560e5d25add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc22bfff700 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d2572d0 0x560e5d25add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.478+0000 7fc22bfff700 1 -- 172.21.15.17:0/1118847223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c1a4d90 con 0x560e5d0ad6b0 2023-07-14T13:14:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.479+0000 7fc22bfff700 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d0ad6b0 0x560e5d25d5b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0096b0 tx=0x7fc21c004980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba3f254726572967 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.479+0000 7fc20b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:14:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.479+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1118847223 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c004450 con 0x560e5d0ad6b0 2023-07-14T13:14:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.479+0000 7fc245d59b80 1 -- 172.21.15.17:0/1118847223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e5d0fc490 con 0x560e5d0ad6b0 2023-07-14T13:14:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.479+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1118847223 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc21c005620 con 0x560e5d0ad6b0 2023-07-14T13:14:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.479+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1118847223 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc21c0045b0 con 0x560e5d0ad6b0 2023-07-14T13:14:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.479+0000 7fc245d59b80 10 client.27637 fetch_fsmap learned FSMap version 41 2023-07-14T13:14:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.480+0000 7fc245d59b80 1 -- 172.21.15.17:0/1118847223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7fc21c009a80 con 0x560e5d0ad6b0 2023-07-14T13:14:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.480+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1118847223 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560e5d0fc490 con 0x560e5d0ad6b0 2023-07-14T13:14:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.480+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1118847223 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc21c021040 con 0x560e5d0ad6b0 2023-07-14T13:14:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.480+0000 7fc245d59b80 10 client.27637 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:14:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.480+0000 7fc245d59b80 10 client.27637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.480+0000 7fc245d59b80 20 client.27637 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.480+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560e5d26aa80 0x560e5d26ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.480+0000 7fc245d59b80 4 client.27637 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:14:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.480+0000 7fc245d59b80 1 -- 172.21.15.17:0/1118847223 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e5d19be50 con 0x560e5d26aa80 2023-07-14T13:14:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.481+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560e5d26aa80 0x560e5d26ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.481+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560e5d26aa80 0x560e5d26ce90 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ce7cbc778496410 server_cookie=8ebd59b227a46169 in_seq=0 out_seq=0 2023-07-14T13:14:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.481+0000 7fc20b7fe700 10 client.27637 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1118847223 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560e5d19be50 con 0x560e5d26aa80 2023-07-14T13:14:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc20b7fe700 10 client.27637 handle_command_reply: tid=0 2023-07-14T13:14:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc245d59b80 1 client.27637 shutdown 2023-07-14T13:14:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc245d59b80 1 -- 172.21.15.17:0/1118847223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d0ad6b0 msgr2=0x560e5d25d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d0ad6b0 0x560e5d25d5b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0096b0 tx=0x7fc21c004980 comp rx=0 tx=0).stop 2023-07-14T13:14:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc245d59b80 1 -- 172.21.15.17:0/1118847223 shutdown_connections 2023-07-14T13:14:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560e5d26aa80 0x560e5d26ce90 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d2572d0 0x560e5d25add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d0ad6b0 0x560e5d25d5b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1118847223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d251580 0x560e5d25a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc20b7fe700 0 client.27637 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc245d59b80 1 -- 172.21.15.17:0/1118847223 >> 172.21.15.17:0/1118847223 conn(0x560e5d246be0 msgr2=0x560e5d24b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc245d59b80 1 -- 172.21.15.17:0/1118847223 shutdown_connections 2023-07-14T13:14:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.482+0000 7fc245d59b80 1 -- 172.21.15.17:0/1118847223 wait complete. 2023-07-14T13:14:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.483+0000 7fc245d59b80 20 client.27637 trim_cache size 0 max 16384 2023-07-14T13:14:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc245d59b80 1 Processor -- start 2023-07-14T13:14:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc245d59b80 1 -- start start 2023-07-14T13:14:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 0x560e5d251040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 0x560e5d261c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d258010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc245d59b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d248d00 con 0x560e5d251580 2023-07-14T13:14:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc245d59b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d266b30 con 0x560e5d0ad6b0 2023-07-14T13:14:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc245d59b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d2485f0 con 0x560e5d2572d0 2023-07-14T13:14:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc22b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 0x560e5d261c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc22bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 0x560e5d251040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc22b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 0x560e5d261c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43362/0 (socket says 172.21.15.17:43362) 2023-07-14T13:14:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc22b7fe700 1 -- 172.21.15.17:0/4006946727 learned_addr learned my addr 172.21.15.17:0/4006946727 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.500+0000 7fc23099c700 1 --2- 172.21.15.17:0/4006946727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d258010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.501+0000 7fc22b7fe700 1 -- 172.21.15.17:0/4006946727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 msgr2=0x560e5d258010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.501+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/4006946727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d258010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.501+0000 7fc22b7fe700 1 -- 172.21.15.17:0/4006946727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 msgr2=0x560e5d251040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.501+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/4006946727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 0x560e5d251040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.501+0000 7fc22b7fe700 1 -- 172.21.15.17:0/4006946727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e5cfb9c00 con 0x560e5d251580 2023-07-14T13:14:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.501+0000 7fc22bfff700 1 --2- 172.21.15.17:0/4006946727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 0x560e5d251040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.501+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/4006946727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 0x560e5d261c60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc2200cb7f0 tx=0x7fc220009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf77c245c10b1de3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.501+0000 7fc212ffd700 1 -- 172.21.15.17:0/4006946727 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22009ab00 con 0x560e5d251580 2023-07-14T13:14:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.501+0000 7fc212ffd700 1 -- 172.21.15.17:0/4006946727 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc22009b1a0 con 0x560e5d251580 2023-07-14T13:14:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.501+0000 7fc212ffd700 1 -- 172.21.15.17:0/4006946727 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22009b400 con 0x560e5d251580 2023-07-14T13:14:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.502+0000 7fc245d59b80 1 -- 172.21.15.17:0/4006946727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 msgr2=0x560e5d261c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.502+0000 7fc245d59b80 1 --2- 172.21.15.17:0/4006946727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 0x560e5d261c60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc2200cb7f0 tx=0x7fc220009ca0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.502+0000 7fc245d59b80 1 -- 172.21.15.17:0/4006946727 shutdown_connections 2023-07-14T13:14:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.502+0000 7fc245d59b80 1 --2- 172.21.15.17:0/4006946727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d258010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.502+0000 7fc245d59b80 1 --2- 172.21.15.17:0/4006946727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 0x560e5d251040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.502+0000 7fc245d59b80 1 --2- 172.21.15.17:0/4006946727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 0x560e5d261c60 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.502+0000 7fc245d59b80 1 -- 172.21.15.17:0/4006946727 >> 172.21.15.17:0/4006946727 conn(0x560e5d246be0 msgr2=0x560e5d257900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:47.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.502+0000 7fc245d59b80 1 -- 172.21.15.17:0/4006946727 shutdown_connections 2023-07-14T13:14:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.502+0000 7fc245d59b80 1 -- 172.21.15.17:0/4006946727 wait complete. 2023-07-14T13:14:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.503+0000 7fc245d59b80 1 -- start start 2023-07-14T13:14:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.503+0000 7fc245d59b80 1 Processor -- start 2023-07-14T13:14:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.503+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 0x560e5d261a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.503+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 0x560e5d25dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.503+0000 7fc245d59b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d25e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.503+0000 7fc245d59b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d25e820 con 0x560e5d251580 2023-07-14T13:14:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.503+0000 7fc245d59b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d25e990 con 0x560e5d0ad6b0 2023-07-14T13:14:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.503+0000 7fc245d59b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e5d25eb00 con 0x560e5d2572d0 2023-07-14T13:14:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.503+0000 7fc245d59b80 10 client.0 _ll_register_callbacks cb 0x7fc22000bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:14:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc22bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 0x560e5d261a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc22b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 0x560e5d25dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc22bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 0x560e5d261a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58194/0 (socket says 172.21.15.17:58194) 2023-07-14T13:14:47.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc22bfff700 1 -- 172.21.15.17:0/1013940308 learned_addr learned my addr 172.21.15.17:0/1013940308 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:14:47.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc23099c700 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d25e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc22bfff700 1 -- 172.21.15.17:0/1013940308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 msgr2=0x560e5d25e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:47.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc22bfff700 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d25e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc22bfff700 1 -- 172.21.15.17:0/1013940308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 msgr2=0x560e5d25dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:14:47.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc22bfff700 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 0x560e5d25dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc22bfff700 1 -- 172.21.15.17:0/1013940308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c009a80 con 0x560e5d0ad6b0 2023-07-14T13:14:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 0x560e5d25dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc23099c700 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d25e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:14:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc22bfff700 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 0x560e5d261a90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00f570 tx=0x7fc21c001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c30d05f78bd4b89b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:14:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.504+0000 7fc20b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:14:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.505+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1013940308 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00f3c0 con 0x560e5d0ad6b0 2023-07-14T13:14:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.505+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1013940308 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc21c005620 con 0x560e5d0ad6b0 2023-07-14T13:14:47.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.505+0000 7fc245d59b80 1 -- 172.21.15.17:0/1013940308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc21c0054b0 con 0x560e5d0ad6b0 2023-07-14T13:14:47.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.505+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1013940308 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc21c011a70 con 0x560e5d0ad6b0 2023-07-14T13:14:47.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.505+0000 7fc245d59b80 10 client.27677 fetch_fsmap learned FSMap version 41 2023-07-14T13:14:47.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.505+0000 7fc245d59b80 1 -- 172.21.15.17:0/1013940308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7fc22c19d4f0 con 0x560e5d0ad6b0 2023-07-14T13:14:47.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.505+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1013940308 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc21c044020 con 0x560e5d0ad6b0 2023-07-14T13:14:47.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.506+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1013940308 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc21c021070 con 0x560e5d0ad6b0 2023-07-14T13:14:47.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.506+0000 7fc245d59b80 10 client.27677 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:14:47.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.506+0000 7fc245d59b80 10 client.27677 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:14:47.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.506+0000 7fc245d59b80 20 client.27677 populate_metadata read hostname 'smithi017' 2023-07-14T13:14:47.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.506+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560e5d2bf8e0 0x560e5d2c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:14:47.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.506+0000 7fc245d59b80 4 client.27677 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:14:47.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.506+0000 7fc245d59b80 1 -- 172.21.15.17:0/1013940308 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560e5d15dff0 con 0x560e5d2bf8e0 2023-07-14T13:14:47.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.506+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560e5d2bf8e0 0x560e5d2c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:14:47.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.507+0000 7fc20b7fe700 10 client.27677 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:47.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.507+0000 7fc22b7fe700 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560e5d2bf8e0 0x560e5d2c1cf0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b22f89e855529aac server_cookie=d3605392649f8928 in_seq=0 out_seq=0 2023-07-14T13:14:47.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.514+0000 7fc20b7fe700 1 -- 172.21.15.17:0/1013940308 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560e5d15dff0 con 0x560e5d2bf8e0 2023-07-14T13:14:47.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.514+0000 7fc20b7fe700 10 client.27677 handle_command_reply: tid=0 2023-07-14T13:14:47.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.514+0000 7fc245d59b80 1 client.27677 shutdown 2023-07-14T13:14:47.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.514+0000 7fc245d59b80 1 -- 172.21.15.17:0/1013940308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 msgr2=0x560e5d261a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:47.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.514+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 0x560e5d261a90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00f570 tx=0x7fc21c001e70 comp rx=0 tx=0).stop 2023-07-14T13:14:47.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.515+0000 7fc245d59b80 1 -- 172.21.15.17:0/1013940308 shutdown_connections 2023-07-14T13:14:47.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.515+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560e5d2bf8e0 0x560e5d2c1cf0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.515+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5d2572d0 0x560e5d25e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.515+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e5d0ad6b0 0x560e5d261a90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.515+0000 7fc20b7fe700 0 client.27677 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:14:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.515+0000 7fc245d59b80 1 --2- 172.21.15.17:0/1013940308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560e5d251580 0x560e5d25dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.515+0000 7fc245d59b80 1 -- 172.21.15.17:0/1013940308 >> 172.21.15.17:0/1013940308 conn(0x560e5d246be0 msgr2=0x560e5d255950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:47.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.515+0000 7fc245d59b80 1 -- 172.21.15.17:0/1013940308 shutdown_connections 2023-07-14T13:14:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.515+0000 7fc245d59b80 1 -- 172.21.15.17:0/1013940308 wait complete. 2023-07-14T13:14:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.515+0000 7fc245d59b80 20 client.27677 trim_cache size 0 max 16384 2023-07-14T13:14:47.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:14:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:14:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:14:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:14:47.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 -- 172.21.15.17:0/1675941011 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc2140a12c0 msgr2=0x7fc2140a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc2140a12c0 0x7fc2140a3770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0733d0 tx=0x7fc22400b040 comp rx=0 tx=0).stop 2023-07-14T13:14:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 -- 172.21.15.17:0/1675941011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c0682b0 msgr2=0x7fc22c198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:14:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c0682b0 0x7fc22c198290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc2200098e0 tx=0x7fc220004730 comp rx=0 tx=0).stop 2023-07-14T13:14:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 -- 172.21.15.17:0/1675941011 shutdown_connections 2023-07-14T13:14:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc2140a12c0 0x7fc2140a3770 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc22c10c540 0x7fc22c19c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc22c0679a0 0x7fc22c197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 --2- 172.21.15.17:0/1675941011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc22c0682b0 0x7fc22c198290 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:14:47.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 -- 172.21.15.17:0/1675941011 >> 172.21.15.17:0/1675941011 conn(0x7fc22c074760 msgr2=0x7fc22c0fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:14:47.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 -- 172.21.15.17:0/1675941011 shutdown_connections 2023-07-14T13:14:47.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:14:47.516+0000 7fc2323ff700 1 -- 172.21.15.17:0/1675941011 wait complete. 2023-07-14T13:14:47.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:47 smithi017 ceph-mon[95536]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 26 op/s 2023-07-14T13:14:47.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:47 smithi135 ceph-mon[97338]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 26 op/s 2023-07-14T13:14:49.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:49 smithi131 ceph-mon[96953]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-14T13:14:49.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:49 smithi017 ceph-mon[95536]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-14T13:14:49.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:49 smithi135 ceph-mon[97338]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-14T13:14:51.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:51 smithi131 ceph-mon[96953]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 35 MiB/s wr, 24 op/s 2023-07-14T13:14:51.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:51 smithi017 ceph-mon[95536]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 35 MiB/s wr, 24 op/s 2023-07-14T13:14:51.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:51 smithi135 ceph-mon[97338]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 35 MiB/s wr, 24 op/s 2023-07-14T13:14:53.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:53 smithi131 ceph-mon[96953]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-14T13:14:53.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:53 smithi017 ceph-mon[95536]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-14T13:14:53.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:53 smithi135 ceph-mon[97338]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-14T13:14:55.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:55 smithi131 ceph-mon[96953]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:14:55.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:55 smithi017 ceph-mon[95536]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:14:55.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:55 smithi135 ceph-mon[97338]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:14:57.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:57 smithi131 ceph-mon[96953]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 26 op/s 2023-07-14T13:14:57.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:57 smithi017 ceph-mon[95536]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 26 op/s 2023-07-14T13:14:57.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:57 smithi135 ceph-mon[97338]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 26 op/s 2023-07-14T13:14:59.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:14:59 smithi131 ceph-mon[96953]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:14:59.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:14:59 smithi017 ceph-mon[95536]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:14:59.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:14:59 smithi135 ceph-mon[97338]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:15:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.685+0000 7f3eeabff700 1 -- 172.21.15.17:0/2201363175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee4072850 msgr2=0x7f3ee4072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.685+0000 7f3eeabff700 1 --2- 172.21.15.17:0/2201363175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee4072850 0x7f3ee4072c20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009990 tx=0x7f3ed8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.685+0000 7f3eeabff700 1 -- 172.21.15.17:0/2201363175 shutdown_connections 2023-07-14T13:15:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.685+0000 7f3eeabff700 1 --2- 172.21.15.17:0/2201363175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee410c3b0 0x7f3ee410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.685+0000 7f3eeabff700 1 --2- 172.21.15.17:0/2201363175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee4072850 0x7f3ee4072c20 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.685+0000 7f3eeabff700 1 --2- 172.21.15.17:0/2201363175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ee4073160 0x7f3ee410be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.685+0000 7f3eeabff700 1 -- 172.21.15.17:0/2201363175 >> 172.21.15.17:0/2201363175 conn(0x7f3ee40fb5f0 msgr2=0x7f3ee40fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.685+0000 7f3eeabff700 1 -- 172.21.15.17:0/2201363175 shutdown_connections 2023-07-14T13:15:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.685+0000 7f3eeabff700 1 -- 172.21.15.17:0/2201363175 wait complete. 2023-07-14T13:15:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.686+0000 7f3eeabff700 1 Processor -- start 2023-07-14T13:15:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.686+0000 7f3eeabff700 1 -- start start 2023-07-14T13:15:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3eeabff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee4072850 0x7f3ee4197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3eeabff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee4073160 0x7f3ee41982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3eeabff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ee410c3b0 0x7f3ee419c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3eeabff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee419cf50 con 0x7f3ee4072850 2023-07-14T13:15:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3eeabff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee419d0c0 con 0x7f3ee410c3b0 2023-07-14T13:15:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3eeabff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee419d280 con 0x7f3ee4073160 2023-07-14T13:15:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3ee899b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee4072850 0x7f3ee4197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3ee899b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee4072850 0x7f3ee4197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44542/0 (socket says 172.21.15.17:44542) 2023-07-14T13:15:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3ee899b700 1 -- 172.21.15.17:0/3442299615 learned_addr learned my addr 172.21.15.17:0/3442299615 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee4073160 0x7f3ee41982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3ee919c700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ee410c3b0 0x7f3ee419c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3ee3fff700 1 -- 172.21.15.17:0/3442299615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ee410c3b0 msgr2=0x7f3ee419c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ee410c3b0 0x7f3ee419c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3ee3fff700 1 -- 172.21.15.17:0/3442299615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee4072850 msgr2=0x7f3ee4197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee4072850 0x7f3ee4197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3ee3fff700 1 -- 172.21.15.17:0/3442299615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed80095f0 con 0x7f3ee4073160 2023-07-14T13:15:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.687+0000 7f3ee899b700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee4072850 0x7f3ee4197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.688+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee4073160 0x7f3ee41982a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000e9f0 tx=0x7f3ed000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.688+0000 7f3ee1ffb700 1 -- 172.21.15.17:0/3442299615 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed000c9c0 con 0x7f3ee4073160 2023-07-14T13:15:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.688+0000 7f3eeabff700 1 -- 172.21.15.17:0/3442299615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee419d560 con 0x7f3ee4073160 2023-07-14T13:15:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.688+0000 7f3ee1ffb700 1 -- 172.21.15.17:0/3442299615 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ed0010430 con 0x7f3ee4073160 2023-07-14T13:15:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.688+0000 7f3ee1ffb700 1 -- 172.21.15.17:0/3442299615 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0018680 con 0x7f3ee4073160 2023-07-14T13:15:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.688+0000 7f3eeabff700 1 -- 172.21.15.17:0/3442299615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee41a4da0 con 0x7f3ee4073160 2023-07-14T13:15:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.692+0000 7f3ee1ffb700 1 -- 172.21.15.17:0/3442299615 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3ed00105a0 con 0x7f3ee4073160 2023-07-14T13:15:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.694+0000 7f3ee1ffb700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3ed40a1340 0x7f3ed40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.694+0000 7f3ee1ffb700 1 -- 172.21.15.17:0/3442299615 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3ed0014070 con 0x7f3ee4073160 2023-07-14T13:15:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.694+0000 7f3ee899b700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3ed40a1340 0x7f3ed40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.694+0000 7f3efe45eb80 1 Processor -- start 2023-07-14T13:15:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.695+0000 7f3efe45eb80 1 -- start start 2023-07-14T13:15:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.695+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746b466b0 0x55f746cefd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.695+0000 7f3ee899b700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3ed40a1340 0x7f3ed40a37f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8006010 tx=0x7f3ed800bac0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.695+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 0x55f746cea040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.695+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cea9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.695+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746befc50 con 0x55f746cea580 2023-07-14T13:15:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.695+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746c429e0 con 0x55f746cf02d0 2023-07-14T13:15:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.695+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746c3be70 con 0x55f746b466b0 2023-07-14T13:15:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.696+0000 7f3ee899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746b466b0 0x55f746cefd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.696+0000 7f3ee3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 0x55f746cea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.696+0000 7f3ee899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746b466b0 0x55f746cefd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44280/0 (socket says 172.21.15.17:44280) 2023-07-14T13:15:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.696+0000 7f3ee899b700 1 -- 172.21.15.17:0/2689480521 learned_addr learned my addr 172.21.15.17:0/2689480521 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.696+0000 7f3ee3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 0x55f746cea040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35600/0 (socket says 172.21.15.17:35600) 2023-07-14T13:15:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.696+0000 7f3ee919c700 1 --2- 172.21.15.17:0/2689480521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cea9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.696+0000 7f3ee3fff700 1 -- 172.21.15.17:0/2689480521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746b466b0 msgr2=0x55f746cefd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.696+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/2689480521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746b466b0 0x55f746cefd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.696+0000 7f3ee3fff700 1 -- 172.21.15.17:0/2689480521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 msgr2=0x55f746cea9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.696+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/2689480521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cea9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.696+0000 7f3ee3fff700 1 -- 172.21.15.17:0/2689480521 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f746a69d80 con 0x55f746cf02d0 2023-07-14T13:15:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.697+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/2689480521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 0x55f746cea040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00ca5a0 tx=0x7f3ed0099dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39c0edb96b6b62a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.697+0000 7f3eceffd700 1 -- 172.21.15.17:0/2689480521 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0010880 con 0x55f746cf02d0 2023-07-14T13:15:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.697+0000 7f3eceffd700 1 -- 172.21.15.17:0/2689480521 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ed0099f20 con 0x55f746cf02d0 2023-07-14T13:15:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.697+0000 7f3eceffd700 1 -- 172.21.15.17:0/2689480521 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0099670 con 0x55f746cf02d0 2023-07-14T13:15:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.698+0000 7f3efe45eb80 1 -- 172.21.15.17:0/2689480521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 msgr2=0x55f746cea040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.698+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/2689480521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 0x55f746cea040 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00ca5a0 tx=0x7f3ed0099dc0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.698+0000 7f3efe45eb80 1 -- 172.21.15.17:0/2689480521 shutdown_connections 2023-07-14T13:15:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.698+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/2689480521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cea9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.698+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/2689480521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746b466b0 0x55f746cefd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.698+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/2689480521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 0x55f746cea040 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.698+0000 7f3efe45eb80 1 -- 172.21.15.17:0/2689480521 >> 172.21.15.17:0/2689480521 conn(0x55f746cdfbe0 msgr2=0x55f746ce4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.698+0000 7f3efe45eb80 1 -- 172.21.15.17:0/2689480521 shutdown_connections 2023-07-14T13:15:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.698+0000 7f3efe45eb80 1 -- 172.21.15.17:0/2689480521 wait complete. 2023-07-14T13:15:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.699+0000 7f3efe45eb80 1 -- start start 2023-07-14T13:15:00.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.699+0000 7f3efe45eb80 1 Processor -- start 2023-07-14T13:15:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.699+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746b466b0 0x55f746cf65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.699+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cf3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.699+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 0x55f746cf3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.699+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746bdba60 con 0x55f746cea580 2023-07-14T13:15:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.699+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746bdb760 con 0x55f746cf02d0 2023-07-14T13:15:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.699+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746abf8c0 con 0x55f746b466b0 2023-07-14T13:15:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3efe45eb80 10 client.0 _ll_register_callbacks cb 0x55f746bd9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cf3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cf3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44558/0 (socket says 172.21.15.17:44558) 2023-07-14T13:15:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee3fff700 1 -- 172.21.15.17:0/110418469 learned_addr learned my addr 172.21.15.17:0/110418469 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee899b700 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746b466b0 0x55f746cf65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee919c700 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 0x55f746cf3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee3fff700 1 -- 172.21.15.17:0/110418469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746b466b0 msgr2=0x55f746cf65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746b466b0 0x55f746cf65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee3fff700 1 -- 172.21.15.17:0/110418469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 msgr2=0x55f746cf3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 0x55f746cf3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee3fff700 1 -- 172.21.15.17:0/110418469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee41a4da0 con 0x55f746cea580 2023-07-14T13:15:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee919c700 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 0x55f746cf3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:15:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.700+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cf3850 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0096420 tx=0x7f3ed00996f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1c2d9c5f7e0e57 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.701+0000 7f3ec3fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:15:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.701+0000 7f3ec3fff700 1 -- 172.21.15.17:0/110418469 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed009df50 con 0x55f746cea580 2023-07-14T13:15:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.701+0000 7f3ec3fff700 1 -- 172.21.15.17:0/110418469 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3ed00a2370 con 0x55f746cea580 2023-07-14T13:15:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.701+0000 7f3efe45eb80 1 -- 172.21.15.17:0/110418469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f746b95490 con 0x55f746cea580 2023-07-14T13:15:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.701+0000 7f3ec3fff700 1 -- 172.21.15.17:0/110418469 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ed00ca250 con 0x55f746cea580 2023-07-14T13:15:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.701+0000 7f3efe45eb80 10 client.17961 fetch_fsmap learned FSMap version 41 2023-07-14T13:15:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.701+0000 7f3efe45eb80 1 -- 172.21.15.17:0/110418469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55f746a52c00 con 0x55f746cea580 2023-07-14T13:15:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.701+0000 7f3ec3fff700 1 -- 172.21.15.17:0/110418469 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f746b95490 con 0x55f746cea580 2023-07-14T13:15:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.702+0000 7f3ec3fff700 1 -- 172.21.15.17:0/110418469 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3ed00a1ee0 con 0x55f746cea580 2023-07-14T13:15:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.702+0000 7f3efe45eb80 10 client.17961 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:15:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.702+0000 7f3efe45eb80 10 client.17961 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.702+0000 7f3efe45eb80 20 client.17961 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.702+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f746d038d0 0x55f746d05ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.702+0000 7f3efe45eb80 4 client.17961 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.702+0000 7f3efe45eb80 1 -- 172.21.15.17:0/110418469 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f746c34e50 con 0x55f746d038d0 2023-07-14T13:15:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.702+0000 7f3ee899b700 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f746d038d0 0x55f746d05ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.704+0000 7f3ee899b700 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f746d038d0 0x55f746d05ce0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cd9a7019763af4 server_cookie=15d4b545283f0cfd in_seq=0 out_seq=0 2023-07-14T13:15:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.704+0000 7f3ec3fff700 10 client.17961 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3ec3fff700 1 -- 172.21.15.17:0/110418469 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f746c34e50 con 0x55f746d038d0 2023-07-14T13:15:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3ec3fff700 10 client.17961 handle_command_reply: tid=0 2023-07-14T13:15:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3efe45eb80 1 client.17961 shutdown 2023-07-14T13:15:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3efe45eb80 1 -- 172.21.15.17:0/110418469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 msgr2=0x55f746cf3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cf3850 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0096420 tx=0x7f3ed00996f0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3efe45eb80 1 -- 172.21.15.17:0/110418469 shutdown_connections 2023-07-14T13:15:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f746d038d0 0x55f746d05ce0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cf02d0 0x55f746cf3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746b466b0 0x55f746cf65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/110418469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cf3850 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3efe45eb80 1 -- 172.21.15.17:0/110418469 >> 172.21.15.17:0/110418469 conn(0x55f746cdfbe0 msgr2=0x55f746ce3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3ec3fff700 0 client.17961 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3efe45eb80 1 -- 172.21.15.17:0/110418469 shutdown_connections 2023-07-14T13:15:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.705+0000 7f3efe45eb80 1 -- 172.21.15.17:0/110418469 wait complete. 2023-07-14T13:15:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.706+0000 7f3efe45eb80 20 client.17961 trim_cache size 0 max 16384 2023-07-14T13:15:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.721+0000 7f3efe45eb80 1 Processor -- start 2023-07-14T13:15:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.721+0000 7f3efe45eb80 1 -- start start 2023-07-14T13:15:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.721+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746b466b0 0x55f746cea040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.721+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cfac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.721+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746cf02d0 0x55f746ce4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.721+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746ce5b40 con 0x55f746cea580 2023-07-14T13:15:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.721+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746ce5fb0 con 0x55f746b466b0 2023-07-14T13:15:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.721+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746cef9c0 con 0x55f746cf02d0 2023-07-14T13:15:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cfac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746b466b0 0x55f746cea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746b466b0 0x55f746cea040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35614/0 (socket says 172.21.15.17:35614) 2023-07-14T13:15:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee899b700 1 -- 172.21.15.17:0/716865794 learned_addr learned my addr 172.21.15.17:0/716865794 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee919c700 1 --2- 172.21.15.17:0/716865794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746cf02d0 0x55f746ce4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee899b700 1 -- 172.21.15.17:0/716865794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746cf02d0 msgr2=0x55f746ce4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee899b700 1 --2- 172.21.15.17:0/716865794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746cf02d0 0x55f746ce4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee899b700 1 -- 172.21.15.17:0/716865794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 msgr2=0x55f746cfac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee899b700 1 --2- 172.21.15.17:0/716865794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cfac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee899b700 1 -- 172.21.15.17:0/716865794 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f746cf3410 con 0x55f746b466b0 2023-07-14T13:15:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/716865794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cfac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.722+0000 7f3ee899b700 1 --2- 172.21.15.17:0/716865794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746b466b0 0x55f746cea040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55f746d065b0 tx=0x7f3ed801a050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33526c178323fd3c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.723+0000 7f3ecf7fe700 1 -- 172.21.15.17:0/716865794 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8036b50 con 0x55f746b466b0 2023-07-14T13:15:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.723+0000 7f3ecf7fe700 1 -- 172.21.15.17:0/716865794 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ed801e040 con 0x55f746b466b0 2023-07-14T13:15:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.723+0000 7f3ecf7fe700 1 -- 172.21.15.17:0/716865794 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8004c00 con 0x55f746b466b0 2023-07-14T13:15:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.723+0000 7f3efe45eb80 1 -- 172.21.15.17:0/716865794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746b466b0 msgr2=0x55f746cea040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.723+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/716865794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746b466b0 0x55f746cea040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55f746d065b0 tx=0x7f3ed801a050 comp rx=0 tx=0).stop 2023-07-14T13:15:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.724+0000 7f3efe45eb80 1 -- 172.21.15.17:0/716865794 shutdown_connections 2023-07-14T13:15:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.724+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/716865794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746cf02d0 0x55f746ce4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.724+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/716865794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746b466b0 0x55f746cea040 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.724+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/716865794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746cea580 0x55f746cfac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.724+0000 7f3efe45eb80 1 -- 172.21.15.17:0/716865794 >> 172.21.15.17:0/716865794 conn(0x55f746cdfbe0 msgr2=0x55f746ceda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.724+0000 7f3efe45eb80 1 -- 172.21.15.17:0/716865794 shutdown_connections 2023-07-14T13:15:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.724+0000 7f3efe45eb80 1 -- 172.21.15.17:0/716865794 wait complete. 2023-07-14T13:15:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.724+0000 7f3efe45eb80 1 -- start start 2023-07-14T13:15:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.724+0000 7f3efe45eb80 1 Processor -- start 2023-07-14T13:15:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746b466b0 0x55f746cecd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cea580 0x55f746ceb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3efe45eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746cf02d0 0x55f746cebcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746ced490 con 0x55f746b466b0 2023-07-14T13:15:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746ced600 con 0x55f746cea580 2023-07-14T13:15:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3efe45eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f746cec210 con 0x55f746cf02d0 2023-07-14T13:15:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3efe45eb80 10 client.0 _ll_register_callbacks cb 0x7f3edc009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3ee899b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746b466b0 0x55f746cecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3ee3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cea580 0x55f746ceb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3ee3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cea580 0x55f746ceb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35626/0 (socket says 172.21.15.17:35626) 2023-07-14T13:15:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3ee3fff700 1 -- 172.21.15.17:0/1481581391 learned_addr learned my addr 172.21.15.17:0/1481581391 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.725+0000 7f3ee919c700 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746cf02d0 0x55f746cebcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3ee3fff700 1 -- 172.21.15.17:0/1481581391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746cf02d0 msgr2=0x55f746cebcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746cf02d0 0x55f746cebcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3ee3fff700 1 -- 172.21.15.17:0/1481581391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746b466b0 msgr2=0x55f746cecd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746b466b0 0x55f746cecd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3ee3fff700 1 -- 172.21.15.17:0/1481581391 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f746a52c00 con 0x55f746cea580 2023-07-14T13:15:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3ee899b700 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746b466b0 0x55f746cecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3ee3fff700 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cea580 0x55f746ceb790 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0096990 tx=0x7f3ed00b8380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=442c29794dfe3480 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3ec3fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:15:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3ec3fff700 1 -- 172.21.15.17:0/1481581391 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0018ea0 con 0x55f746cea580 2023-07-14T13:15:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3ec3fff700 1 -- 172.21.15.17:0/1481581391 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3ed0010880 con 0x55f746cea580 2023-07-14T13:15:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3efe45eb80 1 -- 172.21.15.17:0/1481581391 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ed0099f20 con 0x55f746cea580 2023-07-14T13:15:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.726+0000 7f3ec3fff700 1 -- 172.21.15.17:0/1481581391 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ed00b6070 con 0x55f746cea580 2023-07-14T13:15:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.727+0000 7f3efe45eb80 10 client.27692 fetch_fsmap learned FSMap version 41 2023-07-14T13:15:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.727+0000 7f3efe45eb80 1 -- 172.21.15.17:0/1481581391 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7f3ee410f3d0 con 0x55f746cea580 2023-07-14T13:15:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.727+0000 7f3ec3fff700 1 -- 172.21.15.17:0/1481581391 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ed007c080 con 0x55f746cea580 2023-07-14T13:15:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.727+0000 7f3ec3fff700 1 -- 172.21.15.17:0/1481581391 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3ed00ca3e0 con 0x55f746cea580 2023-07-14T13:15:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.727+0000 7f3efe45eb80 10 client.27692 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:15:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.727+0000 7f3efe45eb80 10 client.27692 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.727+0000 7f3efe45eb80 20 client.27692 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.727+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f746d58450 0x55f746d5a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.727+0000 7f3efe45eb80 4 client.27692 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:15:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.727+0000 7f3efe45eb80 1 -- 172.21.15.17:0/1481581391 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f746bf6ff0 con 0x55f746d58450 2023-07-14T13:15:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.727+0000 7f3ee899b700 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f746d58450 0x55f746d5a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.728+0000 7f3ee899b700 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f746d58450 0x55f746d5a860 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a41175ec5c668fc server_cookie=a045b56e8000af08 in_seq=0 out_seq=0 2023-07-14T13:15:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.728+0000 7f3ec3fff700 10 client.27692 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3ec3fff700 1 -- 172.21.15.17:0/1481581391 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f746bf6ff0 con 0x55f746d58450 2023-07-14T13:15:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3ec3fff700 10 client.27692 handle_command_reply: tid=0 2023-07-14T13:15:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 1 client.27692 shutdown 2023-07-14T13:15:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 1 -- 172.21.15.17:0/1481581391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cea580 msgr2=0x55f746ceb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cea580 0x55f746ceb790 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0096990 tx=0x7f3ed00b8380 comp rx=0 tx=0).stop 2023-07-14T13:15:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 1 -- 172.21.15.17:0/1481581391 shutdown_connections 2023-07-14T13:15:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f746d58450 0x55f746d5a860 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f746cf02d0 0x55f746cebcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f746b466b0 0x55f746cecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3ec3fff700 0 client.27692 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 1 --2- 172.21.15.17:0/1481581391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f746cea580 0x55f746ceb790 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 1 -- 172.21.15.17:0/1481581391 >> 172.21.15.17:0/1481581391 conn(0x55f746cdfbe0 msgr2=0x55f746cee9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 1 -- 172.21.15.17:0/1481581391 shutdown_connections 2023-07-14T13:15:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 1 -- 172.21.15.17:0/1481581391 wait complete. 2023-07-14T13:15:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.736+0000 7f3efe45eb80 20 client.27692 trim_cache size 0 max 16384 2023-07-14T13:15:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:15:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:15:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:15:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:15:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 -- 172.21.15.17:0/3442299615 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3ed40a1340 msgr2=0x7f3ed40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3ed40a1340 0x7f3ed40a37f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8006010 tx=0x7f3ed800bac0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 -- 172.21.15.17:0/3442299615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee4073160 msgr2=0x7f3ee41982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee4073160 0x7f3ee41982a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000e9f0 tx=0x7f3ed000ed00 comp rx=0 tx=0).stop 2023-07-14T13:15:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 -- 172.21.15.17:0/3442299615 shutdown_connections 2023-07-14T13:15:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3ed40a1340 0x7f3ed40a37f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ee410c3b0 0x7f3ee419c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ee4072850 0x7f3ee4197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 --2- 172.21.15.17:0/3442299615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ee4073160 0x7f3ee41982a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 -- 172.21.15.17:0/3442299615 >> 172.21.15.17:0/3442299615 conn(0x7f3ee40fb5f0 msgr2=0x7f3ee410e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 -- 172.21.15.17:0/3442299615 shutdown_connections 2023-07-14T13:15:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:00.737+0000 7f3eeabff700 1 -- 172.21.15.17:0/3442299615 wait complete. 2023-07-14T13:15:01.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:01 smithi017 ceph-mon[95536]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 34 MiB/s wr, 24 op/s 2023-07-14T13:15:01.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:01 smithi135 ceph-mon[97338]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 34 MiB/s wr, 24 op/s 2023-07-14T13:15:01.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:01 smithi131 ceph-mon[96953]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 34 MiB/s wr, 24 op/s 2023-07-14T13:15:03.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:03 smithi017 ceph-mon[95536]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-14T13:15:03.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:03 smithi135 ceph-mon[97338]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-14T13:15:03.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:03 smithi131 ceph-mon[96953]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-14T13:15:05.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:15:05.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.361+0000 7fadd83ff700 1 -- 172.21.15.17:0/2403954751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd00728b0 msgr2=0x7fadd0072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:05.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.361+0000 7fadd83ff700 1 --2- 172.21.15.17:0/2403954751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd00728b0 0x7fadd0072c80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009990 tx=0x7fadcc009ca0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.362+0000 7fadd83ff700 1 -- 172.21.15.17:0/2403954751 shutdown_connections 2023-07-14T13:15:05.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.362+0000 7fadd83ff700 1 --2- 172.21.15.17:0/2403954751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadd0110ae0 0x7fadd0112ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.362+0000 7fadd83ff700 1 --2- 172.21.15.17:0/2403954751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd00728b0 0x7fadd0072c80 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.362+0000 7fadd83ff700 1 --2- 172.21.15.17:0/2403954751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd00731c0 0x7fadd01105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.362+0000 7fadd83ff700 1 -- 172.21.15.17:0/2403954751 >> 172.21.15.17:0/2403954751 conn(0x7fadd00fb5f0 msgr2=0x7fadd00fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:05.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.362+0000 7fadd83ff700 1 -- 172.21.15.17:0/2403954751 shutdown_connections 2023-07-14T13:15:05.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.362+0000 7fadd83ff700 1 -- 172.21.15.17:0/2403954751 wait complete. 2023-07-14T13:15:05.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.363+0000 7fadd83ff700 1 Processor -- start 2023-07-14T13:15:05.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.363+0000 7fadd83ff700 1 -- start start 2023-07-14T13:15:05.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.363+0000 7fadd83ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadd00728b0 0x7fadd019c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.363+0000 7fadd83ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd00731c0 0x7fadd019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.363+0000 7fadd83ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd0110ae0 0x7fadd01a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.363+0000 7fadd83ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd01a1110 con 0x7fadd0110ae0 2023-07-14T13:15:05.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.363+0000 7fadd83ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd01a1280 con 0x7fadd00728b0 2023-07-14T13:15:05.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.363+0000 7fadd83ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd01a1440 con 0x7fadd00731c0 2023-07-14T13:15:05.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.364+0000 7fadd619b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadd00728b0 0x7fadd019c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.364+0000 7fadd599a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd00731c0 0x7fadd019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.364+0000 7fadd619b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadd00728b0 0x7fadd019c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39416/0 (socket says 172.21.15.17:39416) 2023-07-14T13:15:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.364+0000 7fadd619b700 1 -- 172.21.15.17:0/1273804336 learned_addr learned my addr 172.21.15.17:0/1273804336 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.364+0000 7fadd699c700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd0110ae0 0x7fadd01a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.364+0000 7fadd619b700 1 -- 172.21.15.17:0/1273804336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd00731c0 msgr2=0x7fadd019c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.364+0000 7fadd619b700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd00731c0 0x7fadd019c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.364+0000 7fadd619b700 1 -- 172.21.15.17:0/1273804336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd0110ae0 msgr2=0x7fadd01a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.364+0000 7fadd619b700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd0110ae0 0x7fadd01a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.364+0000 7fadd619b700 1 -- 172.21.15.17:0/1273804336 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc0095f0 con 0x7fadd00728b0 2023-07-14T13:15:05.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.364+0000 7fadd619b700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadd00728b0 0x7fadd019c130 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fadcc005740 tx=0x7fadcc005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:05.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.365+0000 7fadc77fe700 1 -- 172.21.15.17:0/1273804336 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc01d070 con 0x7fadd00728b0 2023-07-14T13:15:05.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.365+0000 7fadc77fe700 1 -- 172.21.15.17:0/1273804336 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadcc022470 con 0x7fadd00728b0 2023-07-14T13:15:05.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.365+0000 7fadc77fe700 1 -- 172.21.15.17:0/1273804336 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc017650 con 0x7fadd00728b0 2023-07-14T13:15:05.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.365+0000 7fadd83ff700 1 -- 172.21.15.17:0/1273804336 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd01a16c0 con 0x7fadd00728b0 2023-07-14T13:15:05.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.365+0000 7fadd83ff700 1 -- 172.21.15.17:0/1273804336 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd01a1940 con 0x7fadd00728b0 2023-07-14T13:15:05.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.369+0000 7fadc77fe700 1 -- 172.21.15.17:0/1273804336 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fadcc0225e0 con 0x7fadd00728b0 2023-07-14T13:15:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.370+0000 7fadebd58b80 1 Processor -- start 2023-07-14T13:15:05.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.371+0000 7fadebd58b80 1 -- start start 2023-07-14T13:15:05.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.371+0000 7fadc77fe700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fadbc0a12c0 0x7fadbc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.371+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 0x55d85c1196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.371+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c119be0 0x55d85c124590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.371+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c124ad0 0x55d85c126eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.371+0000 7fadebd58b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85c01fcb0 con 0x55d85c119be0 2023-07-14T13:15:05.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.371+0000 7fadebd58b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85c072a40 con 0x55d85c1192d0 2023-07-14T13:15:05.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.371+0000 7fadebd58b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85c06bed0 con 0x55d85c124ad0 2023-07-14T13:15:05.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.371+0000 7fadc77fe700 1 -- 172.21.15.17:0/1273804336 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fadcc0cdea0 con 0x7fadd00728b0 2023-07-14T13:15:05.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.371+0000 7fadd699c700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fadbc0a12c0 0x7fadbc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.372+0000 7fadd619b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 0x55d85c1196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.372+0000 7fadd599a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c119be0 0x55d85c124590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.372+0000 7fadd699c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c124ad0 0x55d85c126eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.372+0000 7fadd619b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 0x55d85c1196a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39430/0 (socket says 172.21.15.17:39430) 2023-07-14T13:15:05.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.372+0000 7fadd619b700 1 -- 172.21.15.17:0/470845511 learned_addr learned my addr 172.21.15.17:0/470845511 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:05.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.372+0000 7fadd599a700 1 -- 172.21.15.17:0/470845511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c124ad0 msgr2=0x55d85c126eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:05.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.372+0000 7fadd599a700 1 --2- 172.21.15.17:0/470845511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c124ad0 0x55d85c126eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.372+0000 7fadd599a700 1 -- 172.21.15.17:0/470845511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 msgr2=0x55d85c1196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:05.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.372+0000 7fadd599a700 1 --2- 172.21.15.17:0/470845511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 0x55d85c1196a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.372+0000 7fadd599a700 1 -- 172.21.15.17:0/470845511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d85be99de0 con 0x55d85c119be0 2023-07-14T13:15:05.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.372+0000 7fadd699c700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fadbc0a12c0 0x7fadbc0a3770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009ec0 tx=0x7fadc800fc40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:05.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.373+0000 7fadd599a700 1 --2- 172.21.15.17:0/470845511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c119be0 0x55d85c124590 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009c80 tx=0x7fadc0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d43051940fcec22 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:05.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.373+0000 7fadc4bfe700 1 -- 172.21.15.17:0/470845511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0011c50 con 0x55d85c119be0 2023-07-14T13:15:05.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.373+0000 7fadc4bfe700 1 -- 172.21.15.17:0/470845511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadc0011db0 con 0x55d85c119be0 2023-07-14T13:15:05.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.373+0000 7fadc4bfe700 1 -- 172.21.15.17:0/470845511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0003d90 con 0x55d85c119be0 2023-07-14T13:15:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.374+0000 7fadebd58b80 1 -- 172.21.15.17:0/470845511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c119be0 msgr2=0x55d85c124590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.374+0000 7fadebd58b80 1 --2- 172.21.15.17:0/470845511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c119be0 0x55d85c124590 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009c80 tx=0x7fadc0009f90 comp rx=0 tx=0).stop 2023-07-14T13:15:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.374+0000 7fadebd58b80 1 -- 172.21.15.17:0/470845511 shutdown_connections 2023-07-14T13:15:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.374+0000 7fadebd58b80 1 --2- 172.21.15.17:0/470845511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c124ad0 0x55d85c126eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.374+0000 7fadebd58b80 1 --2- 172.21.15.17:0/470845511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 0x55d85c1196a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.374+0000 7fadebd58b80 1 --2- 172.21.15.17:0/470845511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c119be0 0x55d85c124590 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.374+0000 7fadebd58b80 1 -- 172.21.15.17:0/470845511 >> 172.21.15.17:0/470845511 conn(0x55d85c10fda0 msgr2=0x55d85c1156a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:05.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.374+0000 7fadebd58b80 1 -- 172.21.15.17:0/470845511 shutdown_connections 2023-07-14T13:15:05.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.374+0000 7fadebd58b80 1 -- 172.21.15.17:0/470845511 wait complete. 2023-07-14T13:15:05.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.375+0000 7fadebd58b80 1 -- start start 2023-07-14T13:15:05.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.375+0000 7fadebd58b80 1 Processor -- start 2023-07-14T13:15:05.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c1192d0 0x55d85c124520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 0x55d85c121730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c124ad0 0x55d85c121e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadebd58b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85c00bac0 con 0x55d85c1192d0 2023-07-14T13:15:05.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadebd58b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85c00b7c0 con 0x55d85c124ad0 2023-07-14T13:15:05.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadebd58b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85beef920 con 0x55d85c119be0 2023-07-14T13:15:05.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadebd58b80 10 client.0 _ll_register_callbacks cb 0x55d85c009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:05.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadd599a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 0x55d85c121730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadd599a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 0x55d85c121730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51096/0 (socket says 172.21.15.17:51096) 2023-07-14T13:15:05.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadd599a700 1 -- 172.21.15.17:0/3757513547 learned_addr learned my addr 172.21.15.17:0/3757513547 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:05.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadd699c700 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c124ad0 0x55d85c121e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadd619b700 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c1192d0 0x55d85c124520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadd599a700 1 -- 172.21.15.17:0/3757513547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c124ad0 msgr2=0x55d85c121e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:05.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadd599a700 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c124ad0 0x55d85c121e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadd599a700 1 -- 172.21.15.17:0/3757513547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c1192d0 msgr2=0x55d85c124520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:05.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadd599a700 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c1192d0 0x55d85c124520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.376+0000 7fadd599a700 1 -- 172.21.15.17:0/3757513547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc00098e0 con 0x55d85c119be0 2023-07-14T13:15:05.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.377+0000 7fadd599a700 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 0x55d85c121730 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fadc0011d80 tx=0x7fadc0003790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b196716151846e09 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:05.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.377+0000 7fadb9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:15:05.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.377+0000 7fadb9ffb700 1 -- 172.21.15.17:0/3757513547 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc001a7d0 con 0x55d85c119be0 2023-07-14T13:15:05.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.377+0000 7fadebd58b80 1 -- 172.21.15.17:0/3757513547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d85bfc54f0 con 0x55d85c119be0 2023-07-14T13:15:05.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.377+0000 7fadb9ffb700 1 -- 172.21.15.17:0/3757513547 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fadc001a930 con 0x55d85c119be0 2023-07-14T13:15:05.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.378+0000 7fadb9ffb700 1 -- 172.21.15.17:0/3757513547 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadc001ab10 con 0x55d85c119be0 2023-07-14T13:15:05.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.378+0000 7fadebd58b80 10 client.27673 fetch_fsmap learned FSMap version 41 2023-07-14T13:15:05.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.378+0000 7fadebd58b80 1 -- 172.21.15.17:0/3757513547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55d85be82c60 con 0x55d85c119be0 2023-07-14T13:15:05.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.378+0000 7fadb9ffb700 1 -- 172.21.15.17:0/3757513547 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d85bfc54f0 con 0x55d85c119be0 2023-07-14T13:15:05.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.378+0000 7fadb9ffb700 1 -- 172.21.15.17:0/3757513547 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fadc002c3f0 con 0x55d85c119be0 2023-07-14T13:15:05.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.379+0000 7fadebd58b80 10 client.27673 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:15:05.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.379+0000 7fadebd58b80 10 client.27673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:05.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.379+0000 7fadebd58b80 20 client.27673 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:05.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.379+0000 7fadebd58b80 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85c134340 0x55d85c136750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.379+0000 7fadebd58b80 4 client.27673 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:05.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.379+0000 7fadebd58b80 1 -- 172.21.15.17:0/3757513547 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d85c064eb0 con 0x55d85c134340 2023-07-14T13:15:05.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.380+0000 7fadd619b700 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85c134340 0x55d85c136750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.381+0000 7fadd619b700 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85c134340 0x55d85c136750 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ebe8548a148ac5b server_cookie=4ef380396d01d4b4 in_seq=0 out_seq=0 2023-07-14T13:15:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.381+0000 7fadb9ffb700 10 client.27673 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadb9ffb700 1 -- 172.21.15.17:0/3757513547 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d85c064eb0 con 0x55d85c134340 2023-07-14T13:15:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadb9ffb700 10 client.27673 handle_command_reply: tid=0 2023-07-14T13:15:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadebd58b80 1 client.27673 shutdown 2023-07-14T13:15:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadebd58b80 1 -- 172.21.15.17:0/3757513547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 msgr2=0x55d85c121730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadebd58b80 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 0x55d85c121730 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fadc0011d80 tx=0x7fadc0003790 comp rx=0 tx=0).stop 2023-07-14T13:15:05.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadebd58b80 1 -- 172.21.15.17:0/3757513547 shutdown_connections 2023-07-14T13:15:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadebd58b80 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85c134340 0x55d85c136750 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadebd58b80 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c124ad0 0x55d85c121e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadebd58b80 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c1192d0 0x55d85c124520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadebd58b80 1 --2- 172.21.15.17:0/3757513547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 0x55d85c121730 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadb9ffb700 0 client.27673 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.382+0000 7fadebd58b80 1 -- 172.21.15.17:0/3757513547 >> 172.21.15.17:0/3757513547 conn(0x55d85c10fda0 msgr2=0x55d85c115230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:05.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.383+0000 7fadebd58b80 1 -- 172.21.15.17:0/3757513547 shutdown_connections 2023-07-14T13:15:05.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.383+0000 7fadebd58b80 1 -- 172.21.15.17:0/3757513547 wait complete. 2023-07-14T13:15:05.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.383+0000 7fadebd58b80 20 client.27673 trim_cache size 0 max 16384 2023-07-14T13:15:05.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.400+0000 7fadebd58b80 1 Processor -- start 2023-07-14T13:15:05.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.400+0000 7fadebd58b80 1 -- start start 2023-07-14T13:15:05.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.400+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 0x55d85c124050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.400+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c1192d0 0x55d85c120fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.400+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c119be0 0x55d85c121510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.400+0000 7fadebd58b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85c119fe0 con 0x55d85c10fda0 2023-07-14T13:15:05.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.400+0000 7fadebd58b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85c11add0 con 0x55d85c119be0 2023-07-14T13:15:05.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.400+0000 7fadebd58b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85c121a50 con 0x55d85c1192d0 2023-07-14T13:15:05.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 0x55d85c124050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd599a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c1192d0 0x55d85c120fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd699c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c119be0 0x55d85c121510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 0x55d85c124050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34798/0 (socket says 172.21.15.17:34798) 2023-07-14T13:15:05.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd619b700 1 -- 172.21.15.17:0/142423610 learned_addr learned my addr 172.21.15.17:0/142423610 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd619b700 1 -- 172.21.15.17:0/142423610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c1192d0 msgr2=0x55d85c120fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd619b700 1 --2- 172.21.15.17:0/142423610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c1192d0 0x55d85c120fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd619b700 1 -- 172.21.15.17:0/142423610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c119be0 msgr2=0x55d85c121510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:05.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd619b700 1 --2- 172.21.15.17:0/142423610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c119be0 0x55d85c121510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd619b700 1 -- 172.21.15.17:0/142423610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d85bec0250 con 0x55d85c10fda0 2023-07-14T13:15:05.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd699c700 1 --2- 172.21.15.17:0/142423610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c119be0 0x55d85c121510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:05.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.401+0000 7fadd619b700 1 --2- 172.21.15.17:0/142423610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 0x55d85c124050 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0974f0 tx=0x7fadcc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdfe4af88c0fce2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:05.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.402+0000 7fadc53ff700 1 -- 172.21.15.17:0/142423610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc09a950 con 0x55d85c10fda0 2023-07-14T13:15:05.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.402+0000 7fadc53ff700 1 -- 172.21.15.17:0/142423610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadcc00e3e0 con 0x55d85c10fda0 2023-07-14T13:15:05.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.402+0000 7fadc53ff700 1 -- 172.21.15.17:0/142423610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc09aff0 con 0x55d85c10fda0 2023-07-14T13:15:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.402+0000 7fadebd58b80 1 -- 172.21.15.17:0/142423610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 msgr2=0x55d85c124050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.402+0000 7fadebd58b80 1 --2- 172.21.15.17:0/142423610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 0x55d85c124050 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0974f0 tx=0x7fadcc009ca0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.403+0000 7fadebd58b80 1 -- 172.21.15.17:0/142423610 shutdown_connections 2023-07-14T13:15:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.403+0000 7fadebd58b80 1 --2- 172.21.15.17:0/142423610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c119be0 0x55d85c121510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.403+0000 7fadebd58b80 1 --2- 172.21.15.17:0/142423610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 0x55d85c124050 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.403+0000 7fadebd58b80 1 --2- 172.21.15.17:0/142423610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c1192d0 0x55d85c120fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.403+0000 7fadebd58b80 1 -- 172.21.15.17:0/142423610 >> 172.21.15.17:0/142423610 conn(0x55d85c111600 msgr2=0x55d85c130760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:05.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.403+0000 7fadebd58b80 1 -- 172.21.15.17:0/142423610 shutdown_connections 2023-07-14T13:15:05.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.403+0000 7fadebd58b80 1 -- 172.21.15.17:0/142423610 wait complete. 2023-07-14T13:15:05.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.403+0000 7fadebd58b80 1 -- start start 2023-07-14T13:15:05.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.404+0000 7fadebd58b80 1 Processor -- start 2023-07-14T13:15:05.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.404+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 0x55d85c12b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.404+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 0x55d85c129900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.404+0000 7fadebd58b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 0x55d85c129e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.404+0000 7fadebd58b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85c12a4c0 con 0x55d85c10fda0 2023-07-14T13:15:05.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.404+0000 7fadebd58b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85c12a630 con 0x55d85c1192d0 2023-07-14T13:15:05.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.404+0000 7fadebd58b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85c1881d0 con 0x55d85c119be0 2023-07-14T13:15:05.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.404+0000 7fadebd58b80 10 client.0 _ll_register_callbacks cb 0x7fadcc00bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:05.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadd619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 0x55d85c12b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadd599a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 0x55d85c129900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadd699c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 0x55d85c129e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadd619b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 0x55d85c12b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34804/0 (socket says 172.21.15.17:34804) 2023-07-14T13:15:05.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadd619b700 1 -- 172.21.15.17:0/453160101 learned_addr learned my addr 172.21.15.17:0/453160101 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:05.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadd599a700 1 -- 172.21.15.17:0/453160101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 msgr2=0x55d85c129e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:05.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadd599a700 1 --2- 172.21.15.17:0/453160101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 0x55d85c129e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadd599a700 1 -- 172.21.15.17:0/453160101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 msgr2=0x55d85c12b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:05.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadd599a700 1 --2- 172.21.15.17:0/453160101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 0x55d85c12b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadd599a700 1 -- 172.21.15.17:0/453160101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc8009040 con 0x55d85c1192d0 2023-07-14T13:15:05.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadd599a700 1 --2- 172.21.15.17:0/453160101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 0x55d85c129900 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fadc002c7a0 tx=0x7fadc0009740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feb05d6d5ecde189 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:05.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.405+0000 7fadb9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:15:05.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.406+0000 7fadb9ffb700 1 -- 172.21.15.17:0/453160101 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc001a440 con 0x55d85c1192d0 2023-07-14T13:15:05.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.406+0000 7fadebd58b80 1 -- 172.21.15.17:0/453160101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fadc0011db0 con 0x55d85c1192d0 2023-07-14T13:15:05.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.406+0000 7fadb9ffb700 1 -- 172.21.15.17:0/453160101 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fadc00050f0 con 0x55d85c1192d0 2023-07-14T13:15:05.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.406+0000 7fadb9ffb700 1 -- 172.21.15.17:0/453160101 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadc00052d0 con 0x55d85c1192d0 2023-07-14T13:15:05.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.406+0000 7fadebd58b80 10 client.27710 fetch_fsmap learned FSMap version 41 2023-07-14T13:15:05.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.406+0000 7fadebd58b80 1 -- 172.21.15.17:0/453160101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7fadd01a16c0 con 0x55d85c1192d0 2023-07-14T13:15:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.406+0000 7fadb9ffb700 1 -- 172.21.15.17:0/453160101 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadc0043080 con 0x55d85c1192d0 2023-07-14T13:15:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.406+0000 7fadb9ffb700 1 -- 172.21.15.17:0/453160101 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fadc001a7d0 con 0x55d85c1192d0 2023-07-14T13:15:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.406+0000 7fadebd58b80 10 client.27710 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:15:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.406+0000 7fadebd58b80 10 client.27710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.406+0000 7fadebd58b80 20 client.27710 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.407+0000 7fadebd58b80 1 --2- 172.21.15.17:0/453160101 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85c124ad0 0x55d85c18b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.407+0000 7fadebd58b80 4 client.27710 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:15:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.407+0000 7fadebd58b80 1 -- 172.21.15.17:0/453160101 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d85c027050 con 0x55d85c124ad0 2023-07-14T13:15:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.407+0000 7fadd619b700 1 --2- 172.21.15.17:0/453160101 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85c124ad0 0x55d85c18b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.407+0000 7fadd619b700 1 --2- 172.21.15.17:0/453160101 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85c124ad0 0x55d85c18b530 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e7501c90dbdb62d server_cookie=fcc017535b7a4e08 in_seq=0 out_seq=0 2023-07-14T13:15:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.407+0000 7fadb9ffb700 10 client.27710 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadb9ffb700 1 -- 172.21.15.17:0/453160101 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d85c027050 con 0x55d85c124ad0 2023-07-14T13:15:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadb9ffb700 10 client.27710 handle_command_reply: tid=0 2023-07-14T13:15:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 1 client.27710 shutdown 2023-07-14T13:15:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 1 -- 172.21.15.17:0/453160101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 msgr2=0x55d85c129900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 1 --2- 172.21.15.17:0/453160101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 0x55d85c129900 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fadc002c7a0 tx=0x7fadc0009740 comp rx=0 tx=0).stop 2023-07-14T13:15:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 1 -- 172.21.15.17:0/453160101 shutdown_connections 2023-07-14T13:15:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 1 --2- 172.21.15.17:0/453160101 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85c124ad0 0x55d85c18b530 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 1 --2- 172.21.15.17:0/453160101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85c119be0 0x55d85c129e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 1 --2- 172.21.15.17:0/453160101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85c10fda0 0x55d85c12b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadb9ffb700 0 client.27710 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 1 --2- 172.21.15.17:0/453160101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85c1192d0 0x55d85c129900 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 1 -- 172.21.15.17:0/453160101 >> 172.21.15.17:0/453160101 conn(0x55d85c111600 msgr2=0x55d85c120fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 1 -- 172.21.15.17:0/453160101 shutdown_connections 2023-07-14T13:15:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 1 -- 172.21.15.17:0/453160101 wait complete. 2023-07-14T13:15:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.408+0000 7fadebd58b80 20 client.27710 trim_cache size 0 max 16384 2023-07-14T13:15:05.454 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:15:05.455 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:15:05.455 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:15:05.455 INFO:teuthology.orchestra.run.smithi017.stdout: "8925f5c5-945e-407d-ac89-f285db4d09f2": { 2023-07-14T13:15:05.455 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:15:05.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8925f5c5-945e-407d-ac89-f285db4d09f2", 2023-07-14T13:15:05.456 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:15:05.456 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:15:05.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:15:05.457 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:15:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 -- 172.21.15.17:0/1273804336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fadbc0a12c0 msgr2=0x7fadbc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fadbc0a12c0 0x7fadbc0a3770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fadc8009ec0 tx=0x7fadc800fc40 comp rx=0 tx=0).stop 2023-07-14T13:15:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 -- 172.21.15.17:0/1273804336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadd00728b0 msgr2=0x7fadd019c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadd00728b0 0x7fadd019c130 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fadcc005740 tx=0x7fadcc005770 comp rx=0 tx=0).stop 2023-07-14T13:15:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 -- 172.21.15.17:0/1273804336 shutdown_connections 2023-07-14T13:15:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fadbc0a12c0 0x7fadbc0a3770 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadd0110ae0 0x7fadd01a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadd00728b0 0x7fadd019c130 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 --2- 172.21.15.17:0/1273804336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd00731c0 0x7fadd019c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 -- 172.21.15.17:0/1273804336 >> 172.21.15.17:0/1273804336 conn(0x7fadd00fb5f0 msgr2=0x7fadd00fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 -- 172.21.15.17:0/1273804336 shutdown_connections 2023-07-14T13:15:05.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:05.409+0000 7fadd83ff700 1 -- 172.21.15.17:0/1273804336 wait complete. 2023-07-14T13:15:05.469 INFO:tasks.cephfs.filesystem:scrub status for tag:8925f5c5-945e-407d-ac89-f285db4d09f2 - {'path': '/', 'tag': '8925f5c5-945e-407d-ac89-f285db4d09f2', 'options': 'recursive,force'} 2023-07-14T13:15:05.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:05 smithi017 ceph-mon[95536]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-14T13:15:05.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:05 smithi017 ceph-mon[95536]: osdmap e108: 12 total, 12 up, 12 in 2023-07-14T13:15:05.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:05 smithi135 ceph-mon[97338]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-14T13:15:05.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:05 smithi135 ceph-mon[97338]: osdmap e108: 12 total, 12 up, 12 in 2023-07-14T13:15:05.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:05 smithi131 ceph-mon[96953]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-14T13:15:05.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:05 smithi131 ceph-mon[96953]: osdmap e108: 12 total, 12 up, 12 in 2023-07-14T13:15:07.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:07 smithi017 ceph-mon[95536]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 39 op/s 2023-07-14T13:15:07.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:07 smithi135 ceph-mon[97338]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 39 op/s 2023-07-14T13:15:07.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:07 smithi131 ceph-mon[96953]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 39 op/s 2023-07-14T13:15:09.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:09 smithi017 ceph-mon[95536]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 39 op/s 2023-07-14T13:15:09.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:09 smithi135 ceph-mon[97338]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 39 op/s 2023-07-14T13:15:09.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:09 smithi131 ceph-mon[96953]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 28 MiB/s wr, 39 op/s 2023-07-14T13:15:10.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:10 smithi017 ceph-mon[95536]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 39 op/s 2023-07-14T13:15:10.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:10 smithi135 ceph-mon[97338]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 39 op/s 2023-07-14T13:15:10.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:10 smithi131 ceph-mon[96953]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 39 op/s 2023-07-14T13:15:12.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:12 smithi135 ceph-mon[97338]: osdmap e109: 12 total, 12 up, 12 in 2023-07-14T13:15:12.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:12 smithi131 ceph-mon[96953]: osdmap e109: 12 total, 12 up, 12 in 2023-07-14T13:15:12.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:12 smithi017 ceph-mon[95536]: osdmap e109: 12 total, 12 up, 12 in 2023-07-14T13:15:13.457 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:13 smithi135 ceph-mon[97338]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 49 op/s 2023-07-14T13:15:13.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:13 smithi131 ceph-mon[96953]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 49 op/s 2023-07-14T13:15:13.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:13 smithi017 ceph-mon[95536]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 49 op/s 2023-07-14T13:15:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.928+0000 7efdf1dff700 1 -- 172.21.15.17:0/2011762577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec0ffb00 msgr2=0x7efdec0fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:13.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.928+0000 7efdf1dff700 1 --2- 172.21.15.17:0/2011762577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec0ffb00 0x7efdec0fff70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efde0009990 tx=0x7efde0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.928+0000 7efdf1dff700 1 -- 172.21.15.17:0/2011762577 shutdown_connections 2023-07-14T13:15:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.928+0000 7efdf1dff700 1 --2- 172.21.15.17:0/2011762577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec1004b0 0x7efdec10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.928+0000 7efdf1dff700 1 --2- 172.21.15.17:0/2011762577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec105b10 0x7efdec105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.928+0000 7efdf1dff700 1 --2- 172.21.15.17:0/2011762577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec0ffb00 0x7efdec0fff70 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.928+0000 7efdf1dff700 1 -- 172.21.15.17:0/2011762577 >> 172.21.15.17:0/2011762577 conn(0x7efdec0fb600 msgr2=0x7efdec0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.928+0000 7efdf1dff700 1 -- 172.21.15.17:0/2011762577 shutdown_connections 2023-07-14T13:15:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.928+0000 7efdf1dff700 1 -- 172.21.15.17:0/2011762577 wait complete. 2023-07-14T13:15:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.929+0000 7efdf1dff700 1 Processor -- start 2023-07-14T13:15:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdf1dff700 1 -- start start 2023-07-14T13:15:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdf1dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0ffb00 0x7efdec19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdf1dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec1004b0 0x7efdec19c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdf1dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec105b10 0x7efdec195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdf1dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec196140 con 0x7efdec1004b0 2023-07-14T13:15:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdf1dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec1962b0 con 0x7efdec0ffb00 2023-07-14T13:15:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdf1dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec196470 con 0x7efdec105b10 2023-07-14T13:15:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdeaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec1004b0 0x7efdec19c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0ffb00 0x7efdec19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdebfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec105b10 0x7efdec195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdeaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec1004b0 0x7efdec19c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34832/0 (socket says 172.21.15.17:34832) 2023-07-14T13:15:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.930+0000 7efdeaffd700 1 -- 172.21.15.17:0/4047487176 learned_addr learned my addr 172.21.15.17:0/4047487176 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.931+0000 7efdeaffd700 1 -- 172.21.15.17:0/4047487176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec105b10 msgr2=0x7efdec195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.931+0000 7efdeaffd700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec105b10 0x7efdec195970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.931+0000 7efdeaffd700 1 -- 172.21.15.17:0/4047487176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0ffb00 msgr2=0x7efdec19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.931+0000 7efdeaffd700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0ffb00 0x7efdec19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.931+0000 7efdeaffd700 1 -- 172.21.15.17:0/4047487176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde4009c40 con 0x7efdec1004b0 2023-07-14T13:15:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.931+0000 7efdeaffd700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec1004b0 0x7efdec19c0e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7efde0005770 tx=0x7efde00057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.931+0000 7efde8ff9700 1 -- 172.21.15.17:0/4047487176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde001d070 con 0x7efdec1004b0 2023-07-14T13:15:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.932+0000 7efde8ff9700 1 -- 172.21.15.17:0/4047487176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efde0005a00 con 0x7efdec1004b0 2023-07-14T13:15:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.932+0000 7efdf1dff700 1 -- 172.21.15.17:0/4047487176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efddc009520 con 0x7efdec1004b0 2023-07-14T13:15:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.932+0000 7efde8ff9700 1 -- 172.21.15.17:0/4047487176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0021d90 con 0x7efdec1004b0 2023-07-14T13:15:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.932+0000 7efdf1dff700 1 -- 172.21.15.17:0/4047487176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde00095f0 con 0x7efdec1004b0 2023-07-14T13:15:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.935+0000 7efde8ff9700 1 -- 172.21.15.17:0/4047487176 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7efde0021410 con 0x7efdec1004b0 2023-07-14T13:15:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.936+0000 7efe057a9b80 1 Processor -- start 2023-07-14T13:15:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efe057a9b80 1 -- start start 2023-07-14T13:15:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 0x562dcf519d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf51a2d0 0x562dcf514040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf514580 0x562dcf5149d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efe057a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf419c50 con 0x562dcf51a2d0 2023-07-14T13:15:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efe057a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf46c9e0 con 0x562dcf3706b0 2023-07-14T13:15:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efe057a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf465e70 con 0x562dcf514580 2023-07-14T13:15:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efde8ff9700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a1340 0x7efdd40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efdebfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 0x562dcf519d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efdeaffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf514580 0x562dcf5149d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf51a2d0 0x562dcf514040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efdebfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 0x562dcf519d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39490/0 (socket says 172.21.15.17:39490) 2023-07-14T13:15:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efdebfff700 1 -- 172.21.15.17:0/2560752313 learned_addr learned my addr 172.21.15.17:0/2560752313 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.937+0000 7efde8ff9700 1 -- 172.21.15.17:0/4047487176 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efde00cde20 con 0x7efdec1004b0 2023-07-14T13:15:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.938+0000 7efdebfff700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a1340 0x7efdd40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.938+0000 7efdeb7fe700 1 -- 172.21.15.17:0/2560752313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf514580 msgr2=0x562dcf5149d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.938+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/2560752313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf514580 0x562dcf5149d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.938+0000 7efdeb7fe700 1 -- 172.21.15.17:0/2560752313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 msgr2=0x562dcf519d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.938+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/2560752313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 0x562dcf519d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.938+0000 7efdeb7fe700 1 -- 172.21.15.17:0/2560752313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dcf293d80 con 0x562dcf51a2d0 2023-07-14T13:15:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.938+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/2560752313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf51a2d0 0x562dcf514040 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7efddc009dc0 tx=0x7efddc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f019b82e90b2d15c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.938+0000 7efdebfff700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a1340 0x7efdd40a37f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efde4009f80 tx=0x7efde4004b40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.939+0000 7efdd1ffb700 1 -- 172.21.15.17:0/2560752313 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc015050 con 0x562dcf51a2d0 2023-07-14T13:15:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.939+0000 7efdd1ffb700 1 -- 172.21.15.17:0/2560752313 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efddc016040 con 0x562dcf51a2d0 2023-07-14T13:15:13.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.939+0000 7efdd1ffb700 1 -- 172.21.15.17:0/2560752313 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0196e0 con 0x562dcf51a2d0 2023-07-14T13:15:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.939+0000 7efe057a9b80 1 -- 172.21.15.17:0/2560752313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf51a2d0 msgr2=0x562dcf514040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.939+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2560752313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf51a2d0 0x562dcf514040 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7efddc009dc0 tx=0x7efddc009260 comp rx=0 tx=0).stop 2023-07-14T13:15:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.940+0000 7efe057a9b80 1 -- 172.21.15.17:0/2560752313 shutdown_connections 2023-07-14T13:15:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.940+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2560752313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf514580 0x562dcf5149d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.940+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2560752313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 0x562dcf519d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.940+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2560752313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf51a2d0 0x562dcf514040 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.940+0000 7efe057a9b80 1 -- 172.21.15.17:0/2560752313 >> 172.21.15.17:0/2560752313 conn(0x562dcf509be0 msgr2=0x562dcf50ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.940+0000 7efe057a9b80 1 -- 172.21.15.17:0/2560752313 shutdown_connections 2023-07-14T13:15:13.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.940+0000 7efe057a9b80 1 -- 172.21.15.17:0/2560752313 wait complete. 2023-07-14T13:15:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.940+0000 7efe057a9b80 1 -- start start 2023-07-14T13:15:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.940+0000 7efe057a9b80 1 Processor -- start 2023-07-14T13:15:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.941+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf3706b0 0x562dcf5205e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.941+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf514580 0x562dcf51d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.941+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf51a2d0 0x562dcf51e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.941+0000 7efe057a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf405a60 con 0x562dcf514580 2023-07-14T13:15:13.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.941+0000 7efe057a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf405760 con 0x562dcf51a2d0 2023-07-14T13:15:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.941+0000 7efe057a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf2e98c0 con 0x562dcf3706b0 2023-07-14T13:15:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.941+0000 7efe057a9b80 10 client.0 _ll_register_callbacks cb 0x562dcf403700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.941+0000 7efdeaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf514580 0x562dcf51d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.941+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf3706b0 0x562dcf5205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.942+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf3706b0 0x562dcf5205e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51142/0 (socket says 172.21.15.17:51142) 2023-07-14T13:15:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.942+0000 7efdeb7fe700 1 -- 172.21.15.17:0/2179332827 learned_addr learned my addr 172.21.15.17:0/2179332827 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.942+0000 7efdebfff700 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf51a2d0 0x562dcf51e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:13.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.942+0000 7efdeb7fe700 1 -- 172.21.15.17:0/2179332827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf51a2d0 msgr2=0x562dcf51e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:13.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.942+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf51a2d0 0x562dcf51e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.942+0000 7efdeb7fe700 1 -- 172.21.15.17:0/2179332827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf514580 msgr2=0x562dcf51d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:13.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.942+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf514580 0x562dcf51d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.942+0000 7efdeb7fe700 1 -- 172.21.15.17:0/2179332827 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc009a70 con 0x562dcf3706b0 2023-07-14T13:15:13.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.942+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf3706b0 0x562dcf5205e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efddc009230 tx=0x7efddc005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c58c9ea40fdcc6d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:13.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.942+0000 7efdcaffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:15:13.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.943+0000 7efdcaffd700 1 -- 172.21.15.17:0/2179332827 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc01a600 con 0x562dcf3706b0 2023-07-14T13:15:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.943+0000 7efe057a9b80 1 -- 172.21.15.17:0/2179332827 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562dcf3bf490 con 0x562dcf3706b0 2023-07-14T13:15:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.943+0000 7efdcaffd700 1 -- 172.21.15.17:0/2179332827 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efddc01a760 con 0x562dcf3706b0 2023-07-14T13:15:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.943+0000 7efdcaffd700 1 -- 172.21.15.17:0/2179332827 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7efddc01a960 con 0x562dcf3706b0 2023-07-14T13:15:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.943+0000 7efe057a9b80 10 client.27691 fetch_fsmap learned FSMap version 41 2023-07-14T13:15:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.943+0000 7efe057a9b80 1 -- 172.21.15.17:0/2179332827 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x562dcf27cc00 con 0x562dcf3706b0 2023-07-14T13:15:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.943+0000 7efdcaffd700 1 -- 172.21.15.17:0/2179332827 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562dcf3bf490 con 0x562dcf3706b0 2023-07-14T13:15:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.944+0000 7efdcaffd700 1 -- 172.21.15.17:0/2179332827 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7efddc021070 con 0x562dcf3706b0 2023-07-14T13:15:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.944+0000 7efe057a9b80 10 client.27691 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:15:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.944+0000 7efe057a9b80 10 client.27691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.944+0000 7efe057a9b80 20 client.27691 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.944+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562dcf52db60 0x562dcf52ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.944+0000 7efe057a9b80 4 client.27691 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.944+0000 7efe057a9b80 1 -- 172.21.15.17:0/2179332827 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562dcf45ee50 con 0x562dcf52db60 2023-07-14T13:15:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.944+0000 7efdeaffd700 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562dcf52db60 0x562dcf52ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.945+0000 7efdeaffd700 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562dcf52db60 0x562dcf52ff70 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55c6d23e090fde81 server_cookie=de1d57de3875b624 in_seq=0 out_seq=0 2023-07-14T13:15:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.945+0000 7efdcaffd700 10 client.27691 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.945+0000 7efdcaffd700 1 -- 172.21.15.17:0/2179332827 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562dcf45ee50 con 0x562dcf52db60 2023-07-14T13:15:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.945+0000 7efdcaffd700 10 client.27691 handle_command_reply: tid=0 2023-07-14T13:15:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 1 client.27691 shutdown 2023-07-14T13:15:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 1 -- 172.21.15.17:0/2179332827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf3706b0 msgr2=0x562dcf5205e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf3706b0 0x562dcf5205e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efddc009230 tx=0x7efddc005760 comp rx=0 tx=0).stop 2023-07-14T13:15:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 1 -- 172.21.15.17:0/2179332827 shutdown_connections 2023-07-14T13:15:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562dcf52db60 0x562dcf52ff70 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf51a2d0 0x562dcf51e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf3706b0 0x562dcf5205e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2179332827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf514580 0x562dcf51d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 1 -- 172.21.15.17:0/2179332827 >> 172.21.15.17:0/2179332827 conn(0x562dcf509be0 msgr2=0x562dcf50dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efdcaffd700 0 client.27691 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 1 -- 172.21.15.17:0/2179332827 shutdown_connections 2023-07-14T13:15:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 1 -- 172.21.15.17:0/2179332827 wait complete. 2023-07-14T13:15:13.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.946+0000 7efe057a9b80 20 client.27691 trim_cache size 0 max 16384 2023-07-14T13:15:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efe057a9b80 1 Processor -- start 2023-07-14T13:15:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efe057a9b80 1 -- start start 2023-07-14T13:15:14.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 0x562dcf519160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:14.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf514580 0x562dcf50ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:14.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf51a2d0 0x562dcf520180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:14.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efe057a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf3bf490 con 0x562dcf514580 2023-07-14T13:15:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efe057a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf51e880 con 0x562dcf3706b0 2023-07-14T13:15:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efe057a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf50bd00 con 0x562dcf51a2d0 2023-07-14T13:15:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 0x562dcf519160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 0x562dcf519160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39506/0 (socket says 172.21.15.17:39506) 2023-07-14T13:15:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efdeb7fe700 1 -- 172.21.15.17:0/868307023 learned_addr learned my addr 172.21.15.17:0/868307023 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efdeaffd700 1 --2- 172.21.15.17:0/868307023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf514580 0x562dcf50ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.965+0000 7efdebfff700 1 --2- 172.21.15.17:0/868307023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf51a2d0 0x562dcf520180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.966+0000 7efdeb7fe700 1 -- 172.21.15.17:0/868307023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf51a2d0 msgr2=0x562dcf520180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.966+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/868307023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf51a2d0 0x562dcf520180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.966+0000 7efdeb7fe700 1 -- 172.21.15.17:0/868307023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf514580 msgr2=0x562dcf50ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.966+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/868307023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf514580 0x562dcf50ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.966+0000 7efdeb7fe700 1 -- 172.21.15.17:0/868307023 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dcf534bc0 con 0x562dcf3706b0 2023-07-14T13:15:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.966+0000 7efdeaffd700 1 --2- 172.21.15.17:0/868307023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf514580 0x562dcf50ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.966+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/868307023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 0x562dcf519160 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efddc003ec0 tx=0x7efddc010ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa87a9b1d710f692 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.966+0000 7efdd27fc700 1 -- 172.21.15.17:0/868307023 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc015030 con 0x562dcf3706b0 2023-07-14T13:15:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.967+0000 7efdd27fc700 1 -- 172.21.15.17:0/868307023 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efddc028070 con 0x562dcf3706b0 2023-07-14T13:15:14.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.967+0000 7efdd27fc700 1 -- 172.21.15.17:0/868307023 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc024a30 con 0x562dcf3706b0 2023-07-14T13:15:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.967+0000 7efe057a9b80 1 -- 172.21.15.17:0/868307023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 msgr2=0x562dcf519160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.967+0000 7efe057a9b80 1 --2- 172.21.15.17:0/868307023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 0x562dcf519160 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efddc003ec0 tx=0x7efddc010ce0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.967+0000 7efe057a9b80 1 -- 172.21.15.17:0/868307023 shutdown_connections 2023-07-14T13:15:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.967+0000 7efe057a9b80 1 --2- 172.21.15.17:0/868307023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf51a2d0 0x562dcf520180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.967+0000 7efe057a9b80 1 --2- 172.21.15.17:0/868307023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf3706b0 0x562dcf519160 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.967+0000 7efe057a9b80 1 --2- 172.21.15.17:0/868307023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf514580 0x562dcf50ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.967+0000 7efe057a9b80 1 -- 172.21.15.17:0/868307023 >> 172.21.15.17:0/868307023 conn(0x562dcf509be0 msgr2=0x562dcf518a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.967+0000 7efe057a9b80 1 -- 172.21.15.17:0/868307023 shutdown_connections 2023-07-14T13:15:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.967+0000 7efe057a9b80 1 -- 172.21.15.17:0/868307023 wait complete. 2023-07-14T13:15:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.968+0000 7efe057a9b80 1 -- start start 2023-07-14T13:15:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.968+0000 7efe057a9b80 1 Processor -- start 2023-07-14T13:15:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf3706b0 0x562dcf522c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf514580 0x562dcf523190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efe057a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf51a2d0 0x562dcf5236d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efe057a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf580a40 con 0x562dcf3706b0 2023-07-14T13:15:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efe057a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf580b80 con 0x562dcf514580 2023-07-14T13:15:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efe057a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dcf580cc0 con 0x562dcf51a2d0 2023-07-14T13:15:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efe057a9b80 10 client.0 _ll_register_callbacks cb 0x7efde400e280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf3706b0 0x562dcf522c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efdeaffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf514580 0x562dcf523190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efdebfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf51a2d0 0x562dcf5236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efdeaffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf514580 0x562dcf523190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:39516/0 (socket says 172.21.15.17:39516) 2023-07-14T13:15:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efdeaffd700 1 -- 172.21.15.17:0/2362443584 learned_addr learned my addr 172.21.15.17:0/2362443584 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efdeaffd700 1 -- 172.21.15.17:0/2362443584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf51a2d0 msgr2=0x562dcf5236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efdeaffd700 1 --2- 172.21.15.17:0/2362443584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf51a2d0 0x562dcf5236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efdeaffd700 1 -- 172.21.15.17:0/2362443584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf3706b0 msgr2=0x562dcf522c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efdeaffd700 1 --2- 172.21.15.17:0/2362443584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf3706b0 0x562dcf522c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.969+0000 7efdeaffd700 1 -- 172.21.15.17:0/2362443584 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde00095f0 con 0x562dcf514580 2023-07-14T13:15:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.970+0000 7efdeaffd700 1 --2- 172.21.15.17:0/2362443584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf514580 0x562dcf523190 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efde009ad50 tx=0x7efde006d0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80a7531e4fe8b02e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.970+0000 7efdcaffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:15:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.970+0000 7efdcaffd700 1 -- 172.21.15.17:0/2362443584 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0069030 con 0x562dcf514580 2023-07-14T13:15:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.970+0000 7efdcaffd700 1 -- 172.21.15.17:0/2362443584 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efde006a070 con 0x562dcf514580 2023-07-14T13:15:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.970+0000 7efe057a9b80 1 -- 172.21.15.17:0/2362443584 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efddc016040 con 0x562dcf514580 2023-07-14T13:15:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.970+0000 7efdcaffd700 1 -- 172.21.15.17:0/2362443584 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7efde009f080 con 0x562dcf514580 2023-07-14T13:15:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.970+0000 7efe057a9b80 10 client.27728 fetch_fsmap learned FSMap version 41 2023-07-14T13:15:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.970+0000 7efe057a9b80 1 -- 172.21.15.17:0/2362443584 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x562dcf27cc00 con 0x562dcf514580 2023-07-14T13:15:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.971+0000 7efdcaffd700 1 -- 172.21.15.17:0/2362443584 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efde00c9080 con 0x562dcf514580 2023-07-14T13:15:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.971+0000 7efdcaffd700 1 -- 172.21.15.17:0/2362443584 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7efde00b9170 con 0x562dcf514580 2023-07-14T13:15:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.971+0000 7efe057a9b80 10 client.27728 fetch_fsmap finished waiting for FSMap version 41 2023-07-14T13:15:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.971+0000 7efe057a9b80 10 client.27728 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.971+0000 7efe057a9b80 20 client.27728 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.971+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2362443584 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562dcf582090 0x562dcf5844a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.971+0000 7efe057a9b80 4 client.27728 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:15:14.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.971+0000 7efe057a9b80 1 -- 172.21.15.17:0/2362443584 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562dcf420ff0 con 0x562dcf582090 2023-07-14T13:15:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.971+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/2362443584 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562dcf582090 0x562dcf5844a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.972+0000 7efdcaffd700 10 client.27728 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.972+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/2362443584 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562dcf582090 0x562dcf5844a0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3aaf2088947a927 server_cookie=496195a4a5c9c0eb in_seq=0 out_seq=0 2023-07-14T13:15:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.979+0000 7efdcaffd700 1 -- 172.21.15.17:0/2362443584 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562dcf420ff0 con 0x562dcf582090 2023-07-14T13:15:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.979+0000 7efdcaffd700 10 client.27728 handle_command_reply: tid=0 2023-07-14T13:15:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.979+0000 7efe057a9b80 1 client.27728 shutdown 2023-07-14T13:15:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efe057a9b80 1 -- 172.21.15.17:0/2362443584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf514580 msgr2=0x562dcf523190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2362443584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf514580 0x562dcf523190 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efde009ad50 tx=0x7efde006d0c0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efe057a9b80 1 -- 172.21.15.17:0/2362443584 shutdown_connections 2023-07-14T13:15:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2362443584 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562dcf582090 0x562dcf5844a0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2362443584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562dcf51a2d0 0x562dcf5236d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2362443584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562dcf3706b0 0x562dcf522c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efe057a9b80 1 --2- 172.21.15.17:0/2362443584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562dcf514580 0x562dcf523190 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efdcaffd700 0 client.27728 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efe057a9b80 1 -- 172.21.15.17:0/2362443584 >> 172.21.15.17:0/2362443584 conn(0x562dcf509be0 msgr2=0x562dcf5192e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efe057a9b80 1 -- 172.21.15.17:0/2362443584 shutdown_connections 2023-07-14T13:15:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efe057a9b80 1 -- 172.21.15.17:0/2362443584 wait complete. 2023-07-14T13:15:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.980+0000 7efe057a9b80 20 client.27728 trim_cache size 0 max 16384 2023-07-14T13:15:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:15:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:15:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:15:14.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:15:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 -- 172.21.15.17:0/4047487176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a1340 msgr2=0x7efdd40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a1340 0x7efdd40a37f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efde4009f80 tx=0x7efde4004b40 comp rx=0 tx=0).stop 2023-07-14T13:15:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 -- 172.21.15.17:0/4047487176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec1004b0 msgr2=0x7efdec19c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:14.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec1004b0 0x7efdec19c0e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7efde0005770 tx=0x7efde00057a0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 -- 172.21.15.17:0/4047487176 shutdown_connections 2023-07-14T13:15:14.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a1340 0x7efdd40a37f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec105b10 0x7efdec195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0ffb00 0x7efdec19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 --2- 172.21.15.17:0/4047487176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec1004b0 0x7efdec19c0e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:14.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 -- 172.21.15.17:0/4047487176 >> 172.21.15.17:0/4047487176 conn(0x7efdec0fb600 msgr2=0x7efdec0fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:14.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 -- 172.21.15.17:0/4047487176 shutdown_connections 2023-07-14T13:15:14.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:13.981+0000 7efdf1dff700 1 -- 172.21.15.17:0/4047487176 wait complete. 2023-07-14T13:15:15.460 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:15 smithi135 ceph-mon[97338]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 28 MiB/s wr, 40 op/s 2023-07-14T13:15:15.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:15 smithi131 ceph-mon[96953]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 28 MiB/s wr, 40 op/s 2023-07-14T13:15:15.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:15 smithi017 ceph-mon[95536]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 28 MiB/s wr, 40 op/s 2023-07-14T13:15:16.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:16 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:15:16.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:16 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:16.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:16 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:15:16.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:16 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:16.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:16 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:15:16.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:16 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:17.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:17 smithi131 ceph-mon[96953]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:15:17.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:17 smithi017 ceph-mon[95536]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:15:17.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:17 smithi135 ceph-mon[97338]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:15:18.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:18 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:15:18.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:18 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:15:18.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:18 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:15:19.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:19 smithi131 ceph-mon[96953]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:15:19.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:19 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:15:19.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:19 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:15:19.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:19 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:15:19.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:19 smithi017 ceph-mon[95536]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:15:19.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:19 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:15:19.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:19 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:15:19.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:19 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:15:19.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:19 smithi135 ceph-mon[97338]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 29 MiB/s wr, 30 op/s 2023-07-14T13:15:19.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:19 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:15:19.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:19 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:15:19.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:19 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:15:21.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:21 smithi131 ceph-mon[96953]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 30 MiB/s wr, 36 op/s 2023-07-14T13:15:21.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:21 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:15:21.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:21 smithi017 ceph-mon[95536]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 30 MiB/s wr, 36 op/s 2023-07-14T13:15:21.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:21 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:15:21.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:21 smithi135 ceph-mon[97338]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 30 MiB/s wr, 36 op/s 2023-07-14T13:15:21.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:21 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:15:23.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:23 smithi131 ceph-mon[96953]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 27 MiB/s wr, 32 op/s 2023-07-14T13:15:23.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:23 smithi017 ceph-mon[95536]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 27 MiB/s wr, 32 op/s 2023-07-14T13:15:23.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:23 smithi135 ceph-mon[97338]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 27 MiB/s wr, 32 op/s 2023-07-14T13:15:25.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:25 smithi131 ceph-mon[96953]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 24 MiB/s wr, 29 op/s 2023-07-14T13:15:25.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:25 smithi017 ceph-mon[95536]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 24 MiB/s wr, 29 op/s 2023-07-14T13:15:25.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:25 smithi135 ceph-mon[97338]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 24 MiB/s wr, 29 op/s 2023-07-14T13:15:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.144+0000 7f58eafff700 1 -- 172.21.15.17:0/1976126696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e4102970 msgr2=0x7f58e4106930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.144+0000 7f58eafff700 1 --2- 172.21.15.17:0/1976126696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e4102970 0x7f58e4106930 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f58d00099c0 tx=0x7f58d0009cd0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.144+0000 7f58eafff700 1 -- 172.21.15.17:0/1976126696 shutdown_connections 2023-07-14T13:15:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.144+0000 7f58eafff700 1 --2- 172.21.15.17:0/1976126696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58e4107010 0x7f58e410ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.144+0000 7f58eafff700 1 --2- 172.21.15.17:0/1976126696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58e4101fd0 0x7f58e41023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.144+0000 7f58eafff700 1 --2- 172.21.15.17:0/1976126696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e4102970 0x7f58e4106930 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.144+0000 7f58eafff700 1 -- 172.21.15.17:0/1976126696 >> 172.21.15.17:0/1976126696 conn(0x7f58e40fd840 msgr2=0x7f58e40ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.144+0000 7f58eafff700 1 -- 172.21.15.17:0/1976126696 shutdown_connections 2023-07-14T13:15:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.144+0000 7f58eafff700 1 -- 172.21.15.17:0/1976126696 wait complete. 2023-07-14T13:15:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.145+0000 7f58eafff700 1 Processor -- start 2023-07-14T13:15:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.146+0000 7f58eafff700 1 -- start start 2023-07-14T13:15:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.146+0000 7f58eafff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58e4101fd0 0x7f58e4197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.146+0000 7f58eafff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58e4102970 0x7f58e41982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.146+0000 7f58eafff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e4107010 0x7f58e419c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.146+0000 7f58eafff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e419cf80 con 0x7f58e4107010 2023-07-14T13:15:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.146+0000 7f58eafff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e419d0f0 con 0x7f58e4102970 2023-07-14T13:15:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.146+0000 7f58eafff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e419d2b0 con 0x7f58e4101fd0 2023-07-14T13:15:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.147+0000 7f58e8d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58e4101fd0 0x7f58e4197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.147+0000 7f58e959c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e4107010 0x7f58e419c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.147+0000 7f58e8d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58e4101fd0 0x7f58e4197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35898/0 (socket says 172.21.15.17:35898) 2023-07-14T13:15:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.147+0000 7f58e8d9b700 1 -- 172.21.15.17:0/683062662 learned_addr learned my addr 172.21.15.17:0/683062662 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.147+0000 7f58e3fff700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58e4102970 0x7f58e41982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.147+0000 7f58e8d9b700 1 -- 172.21.15.17:0/683062662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58e4102970 msgr2=0x7f58e41982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.147+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58e4102970 0x7f58e41982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.147+0000 7f58e8d9b700 1 -- 172.21.15.17:0/683062662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e4107010 msgr2=0x7f58e419c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.147+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e4107010 0x7f58e419c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.147+0000 7f58e8d9b700 1 -- 172.21.15.17:0/683062662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d00095f0 con 0x7f58e4101fd0 2023-07-14T13:15:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.147+0000 7f58e959c700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e4107010 0x7f58e419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.148+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58e4101fd0 0x7f58e4197d90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f58d800d980 tx=0x7f58d800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.148+0000 7f58e1ffb700 1 -- 172.21.15.17:0/683062662 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8004220 con 0x7f58e4101fd0 2023-07-14T13:15:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.148+0000 7f58eafff700 1 -- 172.21.15.17:0/683062662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e419d590 con 0x7f58e4101fd0 2023-07-14T13:15:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.148+0000 7f58e1ffb700 1 -- 172.21.15.17:0/683062662 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58d8007640 con 0x7f58e4101fd0 2023-07-14T13:15:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.148+0000 7f58e1ffb700 1 -- 172.21.15.17:0/683062662 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8005660 con 0x7f58e4101fd0 2023-07-14T13:15:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.148+0000 7f58eafff700 1 -- 172.21.15.17:0/683062662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e41a4dd0 con 0x7f58e4101fd0 2023-07-14T13:15:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.152+0000 7f58e1ffb700 1 -- 172.21.15.17:0/683062662 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f58d8004750 con 0x7f58e4101fd0 2023-07-14T13:15:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.154+0000 7f58fe8eeb80 1 Processor -- start 2023-07-14T13:15:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.154+0000 7f58fe8eeb80 1 -- start start 2023-07-14T13:15:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.154+0000 7f58e1ffb700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d40a12c0 0x7f58d40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.154+0000 7f58e1ffb700 1 -- 172.21.15.17:0/683062662 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f58d80cca60 con 0x7f58e4101fd0 2023-07-14T13:15:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.154+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56061744a6b0 0x5606175f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.154+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606175f42d0 0x5606175ee040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.154+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175ee580 0x5606175ee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.154+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606174f3c50 con 0x56061744a6b0 2023-07-14T13:15:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.154+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606175469e0 con 0x5606175ee580 2023-07-14T13:15:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.154+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56061753fe70 con 0x5606175f42d0 2023-07-14T13:15:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e959c700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d40a12c0 0x7f58d40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e8d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56061744a6b0 0x5606175f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e8d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56061744a6b0 0x5606175f3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39158/0 (socket says 172.21.15.17:39158) 2023-07-14T13:15:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e8d9b700 1 -- 172.21.15.17:0/3659351209 learned_addr learned my addr 172.21.15.17:0/3659351209 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e3fff700 1 --2- 172.21.15.17:0/3659351209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606175f42d0 0x5606175ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e8d9b700 1 -- 172.21.15.17:0/3659351209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606175f42d0 msgr2=0x5606175ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/3659351209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606175f42d0 0x5606175ee040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e8d9b700 1 -- 172.21.15.17:0/3659351209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175ee580 msgr2=0x5606175ee9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/3659351209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175ee580 0x5606175ee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e8d9b700 1 -- 172.21.15.17:0/3659351209 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56061736dd80 con 0x56061744a6b0 2023-07-14T13:15:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e3fff700 1 --2- 172.21.15.17:0/3659351209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606175f42d0 0x5606175ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:15:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e959c700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d40a12c0 0x7f58d40a3770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009550 tx=0x7f58dc0079a0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.155+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/3659351209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56061744a6b0 0x5606175f3d90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f58d8096560 tx=0x7f58d8099760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ef7be06ba11005 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.156+0000 7f58ceffd700 1 -- 172.21.15.17:0/3659351209 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d809db20 con 0x56061744a6b0 2023-07-14T13:15:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.156+0000 7f58ceffd700 1 -- 172.21.15.17:0/3659351209 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58d80a1f40 con 0x56061744a6b0 2023-07-14T13:15:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.156+0000 7f58ceffd700 1 -- 172.21.15.17:0/3659351209 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8099240 con 0x56061744a6b0 2023-07-14T13:15:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.156+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3659351209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56061744a6b0 msgr2=0x5606175f3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.156+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/3659351209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56061744a6b0 0x5606175f3d90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f58d8096560 tx=0x7f58d8099760 comp rx=0 tx=0).stop 2023-07-14T13:15:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.157+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3659351209 shutdown_connections 2023-07-14T13:15:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.157+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/3659351209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175ee580 0x5606175ee9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.157+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/3659351209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56061744a6b0 0x5606175f3d90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.157+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/3659351209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606175f42d0 0x5606175ee040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.157+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3659351209 >> 172.21.15.17:0/3659351209 conn(0x5606175e3be0 msgr2=0x5606175e8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.157+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3659351209 shutdown_connections 2023-07-14T13:15:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.157+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3659351209 wait complete. 2023-07-14T13:15:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.157+0000 7f58fe8eeb80 1 -- start start 2023-07-14T13:15:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.158+0000 7f58fe8eeb80 1 Processor -- start 2023-07-14T13:15:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.158+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56061744a6b0 0x5606175fa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.158+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175ee580 0x5606175f7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.158+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175f42d0 0x5606175f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.158+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606174dfa60 con 0x5606175ee580 2023-07-14T13:15:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.158+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606174df760 con 0x5606175f42d0 2023-07-14T13:15:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.158+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606173c38c0 con 0x56061744a6b0 2023-07-14T13:15:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.158+0000 7f58fe8eeb80 10 client.0 _ll_register_callbacks cb 0x5606174dd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.158+0000 7f58e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175ee580 0x5606175f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58e3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175ee580 0x5606175f7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39174/0 (socket says 172.21.15.17:39174) 2023-07-14T13:15:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58e3fff700 1 -- 172.21.15.17:0/3962244523 learned_addr learned my addr 172.21.15.17:0/3962244523 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58e959c700 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175f42d0 0x5606175f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56061744a6b0 0x5606175fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58e3fff700 1 -- 172.21.15.17:0/3962244523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56061744a6b0 msgr2=0x5606175fa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58e3fff700 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56061744a6b0 0x5606175fa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58e3fff700 1 -- 172.21.15.17:0/3962244523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175f42d0 msgr2=0x5606175f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58e3fff700 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175f42d0 0x5606175f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58e3fff700 1 -- 172.21.15.17:0/3962244523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e41a4dd0 con 0x5606175ee580 2023-07-14T13:15:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58e959c700 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175f42d0 0x5606175f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58e3fff700 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175ee580 0x5606175f7800 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f58e4102d40 tx=0x7f58d000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b84df5472b336fe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.159+0000 7f58c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:15:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.160+0000 7f58c3fff700 1 -- 172.21.15.17:0/3962244523 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d001d070 con 0x5606175ee580 2023-07-14T13:15:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.160+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3962244523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560617499490 con 0x5606175ee580 2023-07-14T13:15:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.160+0000 7f58c3fff700 1 -- 172.21.15.17:0/3962244523 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f58d000bba0 con 0x5606175ee580 2023-07-14T13:15:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.160+0000 7f58c3fff700 1 -- 172.21.15.17:0/3962244523 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58d000bd60 con 0x5606175ee580 2023-07-14T13:15:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.160+0000 7f58fe8eeb80 10 client.18015 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.160+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3962244523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x560617356c00 con 0x5606175ee580 2023-07-14T13:15:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.160+0000 7f58c3fff700 1 -- 172.21.15.17:0/3962244523 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560617499490 con 0x5606175ee580 2023-07-14T13:15:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.160+0000 7f58c3fff700 1 -- 172.21.15.17:0/3962244523 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f58d0004d10 con 0x5606175ee580 2023-07-14T13:15:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.160+0000 7f58fe8eeb80 10 client.18015 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.160+0000 7f58fe8eeb80 10 client.18015 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.160+0000 7f58fe8eeb80 20 client.18015 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.161+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560617607c50 0x56061760a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.161+0000 7f58fe8eeb80 4 client.18015 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:27.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.161+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3962244523 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560617538e50 con 0x560617607c50 2023-07-14T13:15:27.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.161+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560617607c50 0x56061760a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.162+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560617607c50 0x56061760a060 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60326dc49cc0f338 server_cookie=b7edc1cbd4e832e in_seq=0 out_seq=0 2023-07-14T13:15:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.162+0000 7f58c3fff700 10 client.18015 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58c3fff700 1 -- 172.21.15.17:0/3962244523 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560617538e50 con 0x560617607c50 2023-07-14T13:15:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58c3fff700 10 client.18015 handle_command_reply: tid=0 2023-07-14T13:15:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 1 client.18015 shutdown 2023-07-14T13:15:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3962244523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175ee580 msgr2=0x5606175f7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175ee580 0x5606175f7800 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f58e4102d40 tx=0x7f58d000b630 comp rx=0 tx=0).stop 2023-07-14T13:15:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3962244523 shutdown_connections 2023-07-14T13:15:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560617607c50 0x56061760a060 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175f42d0 0x5606175f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56061744a6b0 0x5606175fa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/3962244523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175ee580 0x5606175f7800 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58c3fff700 0 client.18015 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3962244523 >> 172.21.15.17:0/3962244523 conn(0x5606175e3be0 msgr2=0x5606175e84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3962244523 shutdown_connections 2023-07-14T13:15:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/3962244523 wait complete. 2023-07-14T13:15:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.163+0000 7f58fe8eeb80 20 client.18015 trim_cache size 0 max 16384 2023-07-14T13:15:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.183+0000 7f58fe8eeb80 1 Processor -- start 2023-07-14T13:15:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.183+0000 7f58fe8eeb80 1 -- start start 2023-07-14T13:15:27.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.184+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56061744a6b0 0x5606175ee040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.184+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606175ee580 0x5606175fec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.184+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 0x5606175e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.184+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606175e5d00 con 0x5606175f42d0 2023-07-14T13:15:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.184+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606175f8540 con 0x56061744a6b0 2023-07-14T13:15:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.184+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606175f25a0 con 0x5606175ee580 2023-07-14T13:15:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e959c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 0x5606175e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e8d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56061744a6b0 0x5606175ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e8d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56061744a6b0 0x5606175ee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53312/0 (socket says 172.21.15.17:53312) 2023-07-14T13:15:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e959c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 0x5606175e8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39190/0 (socket says 172.21.15.17:39190) 2023-07-14T13:15:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e8d9b700 1 -- 172.21.15.17:0/2850216725 learned_addr learned my addr 172.21.15.17:0/2850216725 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:27.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e3fff700 1 --2- 172.21.15.17:0/2850216725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606175ee580 0x5606175fec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e8d9b700 1 -- 172.21.15.17:0/2850216725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606175ee580 msgr2=0x5606175fec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/2850216725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606175ee580 0x5606175fec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e8d9b700 1 -- 172.21.15.17:0/2850216725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 msgr2=0x5606175e8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:27.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/2850216725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 0x5606175e8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e8d9b700 1 -- 172.21.15.17:0/2850216725 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606175eec20 con 0x56061744a6b0 2023-07-14T13:15:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.185+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/2850216725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56061744a6b0 0x5606175ee040 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f58d800d950 tx=0x7f58d80cc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3e1d2ef0e3b1262 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.186+0000 7f58cf7fe700 1 -- 172.21.15.17:0/2850216725 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8097e90 con 0x56061744a6b0 2023-07-14T13:15:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.186+0000 7f58cf7fe700 1 -- 172.21.15.17:0/2850216725 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58d8098fe0 con 0x56061744a6b0 2023-07-14T13:15:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.186+0000 7f58cf7fe700 1 -- 172.21.15.17:0/2850216725 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8099f90 con 0x56061744a6b0 2023-07-14T13:15:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.187+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2850216725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56061744a6b0 msgr2=0x5606175ee040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.187+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/2850216725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56061744a6b0 0x5606175ee040 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f58d800d950 tx=0x7f58d80cc040 comp rx=0 tx=0).stop 2023-07-14T13:15:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.187+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2850216725 shutdown_connections 2023-07-14T13:15:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.187+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/2850216725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 0x5606175e8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.187+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/2850216725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56061744a6b0 0x5606175ee040 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.187+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/2850216725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606175ee580 0x5606175fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.187+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2850216725 >> 172.21.15.17:0/2850216725 conn(0x5606175e3be0 msgr2=0x560617603e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.187+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2850216725 shutdown_connections 2023-07-14T13:15:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.187+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2850216725 wait complete. 2023-07-14T13:15:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.188+0000 7f58fe8eeb80 1 -- start start 2023-07-14T13:15:27.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.188+0000 7f58fe8eeb80 1 Processor -- start 2023-07-14T13:15:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.189+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56061744a6b0 0x5606175f0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.189+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175ee580 0x5606175f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.189+0000 7f58fe8eeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 0x5606175ef790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.189+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606175f13c0 con 0x5606175f42d0 2023-07-14T13:15:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.189+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606175f1530 con 0x5606175ee580 2023-07-14T13:15:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.189+0000 7f58fe8eeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606175efcd0 con 0x56061744a6b0 2023-07-14T13:15:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.189+0000 7f58fe8eeb80 10 client.0 _ll_register_callbacks cb 0x7f58d0005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.189+0000 7f58e8d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56061744a6b0 0x5606175f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.189+0000 7f58e959c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 0x5606175ef790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.189+0000 7f58e8d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56061744a6b0 0x5606175f0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35944/0 (socket says 172.21.15.17:35944) 2023-07-14T13:15:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.189+0000 7f58e8d9b700 1 -- 172.21.15.17:0/2760945602 learned_addr learned my addr 172.21.15.17:0/2760945602 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.190+0000 7f58e3fff700 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175ee580 0x5606175f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.190+0000 7f58e959c700 1 -- 172.21.15.17:0/2760945602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56061744a6b0 msgr2=0x5606175f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.190+0000 7f58e959c700 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56061744a6b0 0x5606175f0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.190+0000 7f58e959c700 1 -- 172.21.15.17:0/2760945602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175ee580 msgr2=0x5606175f0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.190+0000 7f58e959c700 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175ee580 0x5606175f0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.190+0000 7f58e959c700 1 -- 172.21.15.17:0/2760945602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56061736dd80 con 0x5606175f42d0 2023-07-14T13:15:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.190+0000 7f58e959c700 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 0x5606175ef790 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009ec0 tx=0x7f58dc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83127b6e58aea06 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.190+0000 7f58c3fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:15:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.191+0000 7f58c3fff700 1 -- 172.21.15.17:0/2760945602 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc01f040 con 0x5606175f42d0 2023-07-14T13:15:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.191+0000 7f58c3fff700 1 -- 172.21.15.17:0/2760945602 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f58dc026440 con 0x5606175f42d0 2023-07-14T13:15:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.191+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2760945602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58d80a1f40 con 0x5606175f42d0 2023-07-14T13:15:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.191+0000 7f58c3fff700 1 -- 172.21.15.17:0/2760945602 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58dc026600 con 0x5606175f42d0 2023-07-14T13:15:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.191+0000 7f58fe8eeb80 10 client.18021 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.191+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2760945602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5606173941f0 con 0x5606175f42d0 2023-07-14T13:15:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.192+0000 7f58c3fff700 1 -- 172.21.15.17:0/2760945602 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58d80a1f40 con 0x5606175f42d0 2023-07-14T13:15:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.192+0000 7f58c3fff700 1 -- 172.21.15.17:0/2760945602 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f58dc02e070 con 0x5606175f42d0 2023-07-14T13:15:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.192+0000 7f58fe8eeb80 10 client.18021 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.192+0000 7f58fe8eeb80 10 client.18021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.192+0000 7f58fe8eeb80 20 client.18021 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.192+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56061765c750 0x56061765eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.192+0000 7f58fe8eeb80 4 client.18021 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:15:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.192+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2760945602 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5606174faff0 con 0x56061765c750 2023-07-14T13:15:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.193+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56061765c750 0x56061765eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.193+0000 7f58e8d9b700 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56061765c750 0x56061765eb60 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb327993f0d0adfd server_cookie=bbd6b489aa759bc2 in_seq=0 out_seq=0 2023-07-14T13:15:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.193+0000 7f58c3fff700 10 client.18021 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.201+0000 7f58c3fff700 1 -- 172.21.15.17:0/2760945602 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5606174faff0 con 0x56061765c750 2023-07-14T13:15:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.201+0000 7f58c3fff700 10 client.18021 handle_command_reply: tid=0 2023-07-14T13:15:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.201+0000 7f58fe8eeb80 1 client.18021 shutdown 2023-07-14T13:15:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2760945602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 msgr2=0x5606175ef790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 0x5606175ef790 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009ec0 tx=0x7f58dc004b40 comp rx=0 tx=0).stop 2023-07-14T13:15:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2760945602 shutdown_connections 2023-07-14T13:15:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56061765c750 0x56061765eb60 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5606175f42d0 0x5606175ef790 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56061744a6b0 0x5606175f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58fe8eeb80 1 --2- 172.21.15.17:0/2760945602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5606175ee580 0x5606175f0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58c3fff700 0 client.18021 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2760945602 >> 172.21.15.17:0/2760945602 conn(0x5606175e3be0 msgr2=0x5606175f48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2760945602 shutdown_connections 2023-07-14T13:15:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58fe8eeb80 1 -- 172.21.15.17:0/2760945602 wait complete. 2023-07-14T13:15:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.202+0000 7f58fe8eeb80 20 client.18021 trim_cache size 0 max 16384 2023-07-14T13:15:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:15:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:15:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:15:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:15:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.203+0000 7f58eafff700 1 -- 172.21.15.17:0/683062662 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d40a12c0 msgr2=0x7f58d40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.203+0000 7f58eafff700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d40a12c0 0x7f58d40a3770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009550 tx=0x7f58dc0079a0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.203+0000 7f58eafff700 1 -- 172.21.15.17:0/683062662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58e4101fd0 msgr2=0x7f58e4197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.203+0000 7f58eafff700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58e4101fd0 0x7f58e4197d90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f58d800d980 tx=0x7f58d800dc90 comp rx=0 tx=0).stop 2023-07-14T13:15:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.203+0000 7f58eafff700 1 -- 172.21.15.17:0/683062662 shutdown_connections 2023-07-14T13:15:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.203+0000 7f58eafff700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f58d40a12c0 0x7f58d40a3770 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.203+0000 7f58eafff700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58e4107010 0x7f58e419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.203+0000 7f58eafff700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58e4101fd0 0x7f58e4197d90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.203+0000 7f58eafff700 1 --2- 172.21.15.17:0/683062662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58e4102970 0x7f58e41982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.203+0000 7f58eafff700 1 -- 172.21.15.17:0/683062662 >> 172.21.15.17:0/683062662 conn(0x7f58e40fd840 msgr2=0x7f58e40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.203+0000 7f58eafff700 1 -- 172.21.15.17:0/683062662 shutdown_connections 2023-07-14T13:15:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:27.204+0000 7f58eafff700 1 -- 172.21.15.17:0/683062662 wait complete. 2023-07-14T13:15:27.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:27 smithi131 ceph-mon[96953]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 29 MiB/s wr, 35 op/s 2023-07-14T13:15:27.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:27 smithi017 ceph-mon[95536]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 29 MiB/s wr, 35 op/s 2023-07-14T13:15:27.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:27 smithi135 ceph-mon[97338]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 29 MiB/s wr, 35 op/s 2023-07-14T13:15:29.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:29 smithi131 ceph-mon[96953]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 17 MiB/s wr, 18 op/s 2023-07-14T13:15:29.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:29 smithi017 ceph-mon[95536]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 17 MiB/s wr, 18 op/s 2023-07-14T13:15:29.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:29 smithi135 ceph-mon[97338]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 17 MiB/s wr, 18 op/s 2023-07-14T13:15:30.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:30 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:15:30.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:30 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:15:30.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:30 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:15:30.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:30 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:15:30.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:30 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:15:30.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:30 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:15:30.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:30 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:15:30.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:30 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:15:30.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:30 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:15:31.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:31 smithi131 ceph-mon[96953]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-14T13:15:31.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:31 smithi017 ceph-mon[95536]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-14T13:15:31.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:31 smithi135 ceph-mon[97338]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-14T13:15:33.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:33 smithi017 ceph-mon[95536]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 16 op/s 2023-07-14T13:15:33.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:33 smithi135 ceph-mon[97338]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 16 op/s 2023-07-14T13:15:33.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:33 smithi131 ceph-mon[96953]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 16 op/s 2023-07-14T13:15:35.470 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:15:35.538 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:35 smithi017 ceph-mon[95536]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-07-14T13:15:35.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.657+0000 7f0bef9ff700 1 -- 172.21.15.17:0/2514713954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100ca0 msgr2=0x7f0be8101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.657+0000 7f0bef9ff700 1 --2- 172.21.15.17:0/2514713954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100ca0 0x7f0be8101070 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009990 tx=0x7f0be4009ca0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.657+0000 7f0bef9ff700 1 -- 172.21.15.17:0/2514713954 shutdown_connections 2023-07-14T13:15:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.657+0000 7f0bef9ff700 1 --2- 172.21.15.17:0/2514713954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be810a070 0x7f0be810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.657+0000 7f0bef9ff700 1 --2- 172.21.15.17:0/2514713954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100ca0 0x7f0be8101070 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.657+0000 7f0bef9ff700 1 --2- 172.21.15.17:0/2514713954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be81015b0 0x7f0be8109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.657+0000 7f0bef9ff700 1 -- 172.21.15.17:0/2514713954 >> 172.21.15.17:0/2514713954 conn(0x7f0be80fa4b0 msgr2=0x7f0be80fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.657+0000 7f0bef9ff700 1 -- 172.21.15.17:0/2514713954 shutdown_connections 2023-07-14T13:15:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.657+0000 7f0bef9ff700 1 -- 172.21.15.17:0/2514713954 wait complete. 2023-07-14T13:15:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.658+0000 7f0bef9ff700 1 Processor -- start 2023-07-14T13:15:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.659+0000 7f0bef9ff700 1 -- start start 2023-07-14T13:15:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.659+0000 7f0bef9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be8100ca0 0x7f0be819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.659+0000 7f0bef9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be81015b0 0x7f0be819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.659+0000 7f0bef9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be810a070 0x7f0be81959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.659+0000 7f0bef9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8196010 con 0x7f0be810a070 2023-07-14T13:15:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.659+0000 7f0bef9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8196180 con 0x7f0be81015b0 2023-07-14T13:15:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.659+0000 7f0bef9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8196340 con 0x7f0be8100ca0 2023-07-14T13:15:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.660+0000 7f0bed79b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be8100ca0 0x7f0be819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.660+0000 7f0bedf9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be810a070 0x7f0be81959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.660+0000 7f0bed79b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be8100ca0 0x7f0be819b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:36876/0 (socket says 172.21.15.17:36876) 2023-07-14T13:15:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.660+0000 7f0bedf9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be810a070 0x7f0be81959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51168/0 (socket says 172.21.15.17:51168) 2023-07-14T13:15:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.660+0000 7f0bed79b700 1 -- 172.21.15.17:0/324868571 learned_addr learned my addr 172.21.15.17:0/324868571 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.660+0000 7f0becf9a700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be81015b0 0x7f0be819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.660+0000 7f0bedf9c700 1 -- 172.21.15.17:0/324868571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be8100ca0 msgr2=0x7f0be819b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.660+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be8100ca0 0x7f0be819b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.660+0000 7f0bedf9c700 1 -- 172.21.15.17:0/324868571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be81015b0 msgr2=0x7f0be819be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.660+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be81015b0 0x7f0be819be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.660+0000 7f0bedf9c700 1 -- 172.21.15.17:0/324868571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40095f0 con 0x7f0be810a070 2023-07-14T13:15:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.661+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be810a070 0x7f0be81959a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0be0007f10 tx=0x7f0be000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.661+0000 7f0bde7fc700 1 -- 172.21.15.17:0/324868571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be0009ea0 con 0x7f0be810a070 2023-07-14T13:15:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.661+0000 7f0bde7fc700 1 -- 172.21.15.17:0/324868571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0be000f040 con 0x7f0be810a070 2023-07-14T13:15:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.661+0000 7f0bef9ff700 1 -- 172.21.15.17:0/324868571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be8196620 con 0x7f0be810a070 2023-07-14T13:15:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.661+0000 7f0bde7fc700 1 -- 172.21.15.17:0/324868571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be0004280 con 0x7f0be810a070 2023-07-14T13:15:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.661+0000 7f0bef9ff700 1 -- 172.21.15.17:0/324868571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be81a2920 con 0x7f0be810a070 2023-07-14T13:15:35.709 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:35 smithi135 ceph-mon[97338]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-07-14T13:15:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.667+0000 7f0bde7fc700 1 -- 172.21.15.17:0/324868571 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0be000db20 con 0x7f0be810a070 2023-07-14T13:15:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.667+0000 7f0c0335cb80 1 Processor -- start 2023-07-14T13:15:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.667+0000 7f0c0335cb80 1 -- start start 2023-07-14T13:15:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.668+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46ef6e0 0x55dbc46efab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.668+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 0x55dbc46fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.668+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46faee0 0x55dbc46fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.668+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc45f1cb0 con 0x55dbc46faee0 2023-07-14T13:15:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.668+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc4644a40 con 0x55dbc46ef6e0 2023-07-14T13:15:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.668+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc463ded0 con 0x55dbc46efff0 2023-07-14T13:15:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.668+0000 7f0bed79b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 0x55dbc46fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.668+0000 7f0becf9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46ef6e0 0x55dbc46efab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.668+0000 7f0bed79b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 0x55dbc46fa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:36878/0 (socket says 172.21.15.17:36878) 2023-07-14T13:15:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.668+0000 7f0becf9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46ef6e0 0x55dbc46efab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57116/0 (socket says 172.21.15.17:57116) 2023-07-14T13:15:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.668+0000 7f0bed79b700 1 -- 172.21.15.17:0/3436594380 learned_addr learned my addr 172.21.15.17:0/3436594380 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.669+0000 7f0becf9a700 1 --2- 172.21.15.17:0/3436594380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46faee0 0x55dbc46fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.669+0000 7f0bed79b700 1 -- 172.21.15.17:0/3436594380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46ef6e0 msgr2=0x55dbc46efab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.669+0000 7f0bed79b700 1 --2- 172.21.15.17:0/3436594380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46ef6e0 0x55dbc46efab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.669+0000 7f0bed79b700 1 -- 172.21.15.17:0/3436594380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46faee0 msgr2=0x55dbc46fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.669+0000 7f0bed79b700 1 --2- 172.21.15.17:0/3436594380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46faee0 0x55dbc46fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.669+0000 7f0bed79b700 1 -- 172.21.15.17:0/3436594380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbc446bde0 con 0x55dbc46efff0 2023-07-14T13:15:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.669+0000 7f0bde7fc700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0bd40a1340 0x7f0bd40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.669+0000 7f0bed79b700 1 --2- 172.21.15.17:0/3436594380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 0x55dbc46fa9a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0be4005ca0 tx=0x7f0be4005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7350843408ee918f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.670+0000 7f0bde7fc700 1 -- 172.21.15.17:0/324868571 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0be00cc4a0 con 0x7f0be810a070 2023-07-14T13:15:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.670+0000 7f0becf9a700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0bd40a1340 0x7f0bd40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.670+0000 7f0bd37fe700 1 -- 172.21.15.17:0/3436594380 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be401d070 con 0x55dbc46efff0 2023-07-14T13:15:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.670+0000 7f0bd37fe700 1 -- 172.21.15.17:0/3436594380 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0be401e040 con 0x55dbc46efff0 2023-07-14T13:15:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.670+0000 7f0bd37fe700 1 -- 172.21.15.17:0/3436594380 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40048c0 con 0x55dbc46efff0 2023-07-14T13:15:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.671+0000 7f0c0335cb80 1 -- 172.21.15.17:0/3436594380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 msgr2=0x55dbc46fa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.671+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/3436594380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 0x55dbc46fa9a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0be4005ca0 tx=0x7f0be4005040 comp rx=0 tx=0).stop 2023-07-14T13:15:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.671+0000 7f0becf9a700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0bd40a1340 0x7f0bd40a37f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80097c0 tx=0x7f0bd8009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.671+0000 7f0c0335cb80 1 -- 172.21.15.17:0/3436594380 shutdown_connections 2023-07-14T13:15:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.671+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/3436594380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46faee0 0x55dbc46fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.671+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/3436594380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46ef6e0 0x55dbc46efab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.671+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/3436594380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 0x55dbc46fa9a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.671+0000 7f0c0335cb80 1 -- 172.21.15.17:0/3436594380 >> 172.21.15.17:0/3436594380 conn(0x55dbc46e1da0 msgr2=0x55dbc46e76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:35.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.671+0000 7f0c0335cb80 1 -- 172.21.15.17:0/3436594380 shutdown_connections 2023-07-14T13:15:35.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.671+0000 7f0c0335cb80 1 -- 172.21.15.17:0/3436594380 wait complete. 2023-07-14T13:15:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.672+0000 7f0c0335cb80 1 -- start start 2023-07-14T13:15:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.672+0000 7f0c0335cb80 1 Processor -- start 2023-07-14T13:15:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46efff0 0x55dbc46f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 0x55dbc46f8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc45ddac0 con 0x55dbc46ef6e0 2023-07-14T13:15:35.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc45dd7c0 con 0x55dbc46efff0 2023-07-14T13:15:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc44c1920 con 0x55dbc46faee0 2023-07-14T13:15:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0c0335cb80 10 client.0 _ll_register_callbacks cb 0x55dbc45db760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0bed79b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0becf9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46efff0 0x55dbc46f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0bed79b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51188/0 (socket says 172.21.15.17:51188) 2023-07-14T13:15:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0bed79b700 1 -- 172.21.15.17:0/424100607 learned_addr learned my addr 172.21.15.17:0/424100607 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:35.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.673+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 0x55dbc46f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0bedf9c700 1 -- 172.21.15.17:0/424100607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46efff0 msgr2=0x55dbc46f7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46efff0 0x55dbc46f7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0bedf9c700 1 -- 172.21.15.17:0/424100607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 msgr2=0x55dbc46fa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0bedf9c700 1 -- 172.21.15.17:0/424100607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be810d170 con 0x55dbc46faee0 2023-07-14T13:15:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0bed79b700 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:35.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 0x55dbc46f8290 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0be00c9c10 tx=0x7f0be00959c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8c8eaad1a2e1dec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0bd0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:15:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/424100607 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be009d350 con 0x55dbc46faee0 2023-07-14T13:15:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/424100607 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0be000ddd0 con 0x55dbc46faee0 2023-07-14T13:15:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0c0335cb80 1 -- 172.21.15.17:0/424100607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dbc45974f0 con 0x55dbc46faee0 2023-07-14T13:15:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.674+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/424100607 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0be0084280 con 0x55dbc46faee0 2023-07-14T13:15:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.675+0000 7f0c0335cb80 10 client.27727 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.675+0000 7f0c0335cb80 1 -- 172.21.15.17:0/424100607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55dbc4454c60 con 0x55dbc46faee0 2023-07-14T13:15:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.675+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/424100607 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dbc45974f0 con 0x55dbc46faee0 2023-07-14T13:15:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.675+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/424100607 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0be00997f0 con 0x55dbc46faee0 2023-07-14T13:15:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.675+0000 7f0c0335cb80 10 client.27727 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.675+0000 7f0c0335cb80 10 client.27727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.675+0000 7f0c0335cb80 20 client.27727 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.675+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbc470a840 0x55dbc470cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.675+0000 7f0c0335cb80 4 client.27727 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.675+0000 7f0c0335cb80 1 -- 172.21.15.17:0/424100607 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dbc4636eb0 con 0x55dbc470a840 2023-07-14T13:15:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.676+0000 7f0bed79b700 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbc470a840 0x55dbc470cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.676+0000 7f0bed79b700 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbc470a840 0x55dbc470cc50 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90047d5aed742c93 server_cookie=99bf0661b17e6794 in_seq=0 out_seq=0 2023-07-14T13:15:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.676+0000 7f0bd0ff9700 10 client.27727 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/424100607 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55dbc4636eb0 con 0x55dbc470a840 2023-07-14T13:15:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0bd0ff9700 10 client.27727 handle_command_reply: tid=0 2023-07-14T13:15:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0c0335cb80 1 client.27727 shutdown 2023-07-14T13:15:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0c0335cb80 1 -- 172.21.15.17:0/424100607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 msgr2=0x55dbc46f8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 0x55dbc46f8290 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0be00c9c10 tx=0x7f0be00959c0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0c0335cb80 1 -- 172.21.15.17:0/424100607 shutdown_connections 2023-07-14T13:15:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbc470a840 0x55dbc470cc50 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 0x55dbc46f8290 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/424100607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46efff0 0x55dbc46f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0bd0ff9700 0 client.27727 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0c0335cb80 1 -- 172.21.15.17:0/424100607 >> 172.21.15.17:0/424100607 conn(0x55dbc46e1da0 msgr2=0x55dbc46e7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0c0335cb80 1 -- 172.21.15.17:0/424100607 shutdown_connections 2023-07-14T13:15:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.677+0000 7f0c0335cb80 1 -- 172.21.15.17:0/424100607 wait complete. 2023-07-14T13:15:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.678+0000 7f0c0335cb80 20 client.27727 trim_cache size 0 max 16384 2023-07-14T13:15:35.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.698+0000 7f0c0335cb80 1 Processor -- start 2023-07-14T13:15:35.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.698+0000 7f0c0335cb80 1 -- start start 2023-07-14T13:15:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.698+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.698+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46efff0 0x55dbc46f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.698+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 0x55dbc46f7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.698+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc46e1970 con 0x55dbc46ef6e0 2023-07-14T13:15:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.698+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc46f7e70 con 0x55dbc46efff0 2023-07-14T13:15:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.698+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc46e8c70 con 0x55dbc46faee0 2023-07-14T13:15:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.698+0000 7f0bed79b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0bed79b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51196/0 (socket says 172.21.15.17:51196) 2023-07-14T13:15:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0bedf9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 0x55dbc46f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0bed79b700 1 -- 172.21.15.17:0/4254828549 learned_addr learned my addr 172.21.15.17:0/4254828549 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0becf9a700 1 --2- 172.21.15.17:0/4254828549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46efff0 0x55dbc46f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0bedf9c700 1 -- 172.21.15.17:0/4254828549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46efff0 msgr2=0x55dbc46f73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/4254828549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46efff0 0x55dbc46f73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0bedf9c700 1 -- 172.21.15.17:0/4254828549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 msgr2=0x55dbc46fa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:35.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/4254828549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0bedf9c700 1 -- 172.21.15.17:0/4254828549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbc4492250 con 0x55dbc46faee0 2023-07-14T13:15:35.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0bed79b700 1 --2- 172.21.15.17:0/4254828549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/4254828549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 0x55dbc46f7930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0be00c9cc0 tx=0x7f0be0003a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edfac7111e5f0428 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.699+0000 7f0bd3fff700 1 -- 172.21.15.17:0/4254828549 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be00b90c0 con 0x55dbc46faee0 2023-07-14T13:15:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.700+0000 7f0bd3fff700 1 -- 172.21.15.17:0/4254828549 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0be0084280 con 0x55dbc46faee0 2023-07-14T13:15:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.700+0000 7f0bd3fff700 1 -- 172.21.15.17:0/4254828549 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be0099590 con 0x55dbc46faee0 2023-07-14T13:15:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.700+0000 7f0c0335cb80 1 -- 172.21.15.17:0/4254828549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 msgr2=0x55dbc46f7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.700+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/4254828549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 0x55dbc46f7930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0be00c9cc0 tx=0x7f0be0003a00 comp rx=0 tx=0).stop 2023-07-14T13:15:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.700+0000 7f0c0335cb80 1 -- 172.21.15.17:0/4254828549 shutdown_connections 2023-07-14T13:15:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.700+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/4254828549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46faee0 0x55dbc46f7930 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.700+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/4254828549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.700+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/4254828549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46efff0 0x55dbc46f73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.700+0000 7f0c0335cb80 1 -- 172.21.15.17:0/4254828549 >> 172.21.15.17:0/4254828549 conn(0x55dbc46e1da0 msgr2=0x55dbc46f2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.700+0000 7f0c0335cb80 1 -- 172.21.15.17:0/4254828549 shutdown_connections 2023-07-14T13:15:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.700+0000 7f0c0335cb80 1 -- 172.21.15.17:0/4254828549 wait complete. 2023-07-14T13:15:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.701+0000 7f0c0335cb80 1 -- start start 2023-07-14T13:15:35.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.701+0000 7f0c0335cb80 1 Processor -- start 2023-07-14T13:15:35.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.702+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46ffa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.702+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 0x55dbc46fffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.702+0000 7f0c0335cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46faee0 0x55dbc475d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.702+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc475dc40 con 0x55dbc46ef6e0 2023-07-14T13:15:35.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.702+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc475dd80 con 0x55dbc46faee0 2023-07-14T13:15:35.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.702+0000 7f0c0335cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc475dec0 con 0x55dbc46efff0 2023-07-14T13:15:35.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.702+0000 7f0c0335cb80 10 client.0 _ll_register_callbacks cb 0x7f0be0095210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:35.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.702+0000 7f0bed79b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.702+0000 7f0bed79b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46ffa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51208/0 (socket says 172.21.15.17:51208) 2023-07-14T13:15:35.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.702+0000 7f0bed79b700 1 -- 172.21.15.17:0/2974167699 learned_addr learned my addr 172.21.15.17:0/2974167699 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:35.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.702+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46faee0 0x55dbc475d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0becf9a700 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 0x55dbc46fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0bedf9c700 1 -- 172.21.15.17:0/2974167699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 msgr2=0x55dbc46fffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:35.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 0x55dbc46fffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0bedf9c700 1 -- 172.21.15.17:0/2974167699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 msgr2=0x55dbc46ffa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:35.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46ffa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0bedf9c700 1 -- 172.21.15.17:0/2974167699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbc446bde0 con 0x55dbc46faee0 2023-07-14T13:15:35.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0bed79b700 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:35.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0bedf9c700 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46faee0 0x55dbc475d700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55dbc46e8e00 tx=0x7f0be0099a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce174c9efef4e6d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:35.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0bd0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:15:35.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/2974167699 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be00b90b0 con 0x55dbc46faee0 2023-07-14T13:15:35.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0c0335cb80 1 -- 172.21.15.17:0/2974167699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0be401e040 con 0x55dbc46faee0 2023-07-14T13:15:35.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.703+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/2974167699 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0be000ddd0 con 0x55dbc46faee0 2023-07-14T13:15:35.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.704+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/2974167699 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0be0099360 con 0x55dbc46faee0 2023-07-14T13:15:35.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.704+0000 7f0c0335cb80 10 client.27761 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:35.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.704+0000 7f0c0335cb80 1 -- 172.21.15.17:0/2974167699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55dbc4454c60 con 0x55dbc46faee0 2023-07-14T13:15:35.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.704+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/2974167699 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0be401e040 con 0x55dbc46faee0 2023-07-14T13:15:35.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.704+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/2974167699 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0be00b7bc0 con 0x55dbc46faee0 2023-07-14T13:15:35.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.704+0000 7f0c0335cb80 10 client.27761 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:35.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.704+0000 7f0c0335cb80 10 client.27761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:35.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.704+0000 7f0c0335cb80 20 client.27761 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:35.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.704+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbc475f0f0 0x55dbc47614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.704+0000 7f0c0335cb80 4 client.27761 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:15:35.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.704+0000 7f0c0335cb80 1 -- 172.21.15.17:0/2974167699 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dbc45f9050 con 0x55dbc475f0f0 2023-07-14T13:15:35.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.705+0000 7f0bed79b700 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbc475f0f0 0x55dbc47614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.705+0000 7f0bed79b700 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbc475f0f0 0x55dbc47614d0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0f4b089fd14fc4e server_cookie=1f3018eea0aa257 in_seq=0 out_seq=0 2023-07-14T13:15:35.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.705+0000 7f0bd0ff9700 10 client.27761 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:35.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.705+0000 7f0bd0ff9700 1 -- 172.21.15.17:0/2974167699 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55dbc45f9050 con 0x55dbc475f0f0 2023-07-14T13:15:35.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.705+0000 7f0bd0ff9700 10 client.27761 handle_command_reply: tid=0 2023-07-14T13:15:35.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.705+0000 7f0c0335cb80 1 client.27761 shutdown 2023-07-14T13:15:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0c0335cb80 1 -- 172.21.15.17:0/2974167699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46faee0 msgr2=0x55dbc475d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46faee0 0x55dbc475d700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55dbc46e8e00 tx=0x7f0be0099a00 comp rx=0 tx=0).stop 2023-07-14T13:15:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0c0335cb80 1 -- 172.21.15.17:0/2974167699 shutdown_connections 2023-07-14T13:15:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dbc475f0f0 0x55dbc47614d0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dbc46faee0 0x55dbc475d700 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dbc46ef6e0 0x55dbc46ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0bd0ff9700 0 client.27761 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:35.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0c0335cb80 1 --2- 172.21.15.17:0/2974167699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dbc46efff0 0x55dbc46fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0c0335cb80 1 -- 172.21.15.17:0/2974167699 >> 172.21.15.17:0/2974167699 conn(0x55dbc46e1da0 msgr2=0x55dbc46f2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:35.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0c0335cb80 1 -- 172.21.15.17:0/2974167699 shutdown_connections 2023-07-14T13:15:35.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0c0335cb80 1 -- 172.21.15.17:0/2974167699 wait complete. 2023-07-14T13:15:35.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.706+0000 7f0c0335cb80 20 client.27761 trim_cache size 0 max 16384 2023-07-14T13:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:15:35.752 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:15:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:15:35.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 -- 172.21.15.17:0/324868571 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0bd40a1340 msgr2=0x7f0bd40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0bd40a1340 0x7f0bd40a37f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80097c0 tx=0x7f0bd8009260 comp rx=0 tx=0).stop 2023-07-14T13:15:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 -- 172.21.15.17:0/324868571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be810a070 msgr2=0x7f0be81959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be810a070 0x7f0be81959a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0be0007f10 tx=0x7f0be000d3b0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 -- 172.21.15.17:0/324868571 shutdown_connections 2023-07-14T13:15:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0bd40a1340 0x7f0bd40a37f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be810a070 0x7f0be81959a0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0be8100ca0 0x7f0be819b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 --2- 172.21.15.17:0/324868571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be81015b0 0x7f0be819be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 -- 172.21.15.17:0/324868571 >> 172.21.15.17:0/324868571 conn(0x7f0be80fa4b0 msgr2=0x7f0be80fb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:35.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 -- 172.21.15.17:0/324868571 shutdown_connections 2023-07-14T13:15:35.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.707+0000 7f0bef9ff700 1 -- 172.21.15.17:0/324868571 wait complete. 2023-07-14T13:15:35.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:35 smithi131 ceph-mon[96953]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 15 op/s 2023-07-14T13:15:35.765 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:15:35.765 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:15:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.952+0000 7f7024f9d700 1 -- 172.21.15.17:0/534403274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70201027e0 msgr2=0x7f70201067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.952+0000 7f7024f9d700 1 --2- 172.21.15.17:0/534403274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70201027e0 0x7f70201067a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f70140099c0 tx=0x7f7014009cd0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.952+0000 7f7024f9d700 1 -- 172.21.15.17:0/534403274 shutdown_connections 2023-07-14T13:15:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.952+0000 7f7024f9d700 1 --2- 172.21.15.17:0/534403274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7020106e80 0x7f702010ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.952+0000 7f7024f9d700 1 --2- 172.21.15.17:0/534403274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7020101e40 0x7f7020102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.952+0000 7f7024f9d700 1 --2- 172.21.15.17:0/534403274 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70201027e0 0x7f70201067a0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.952+0000 7f7024f9d700 1 -- 172.21.15.17:0/534403274 >> 172.21.15.17:0/534403274 conn(0x7f70200fd690 msgr2=0x7f70200ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.952+0000 7f7024f9d700 1 -- 172.21.15.17:0/534403274 shutdown_connections 2023-07-14T13:15:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.952+0000 7f7024f9d700 1 -- 172.21.15.17:0/534403274 wait complete. 2023-07-14T13:15:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.953+0000 7f7024f9d700 1 Processor -- start 2023-07-14T13:15:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.953+0000 7f7024f9d700 1 -- start start 2023-07-14T13:15:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f7024f9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7020101e40 0x7f702019d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f7024f9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70201027e0 0x7f702019ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f7024f9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7020106e80 0x7f7020197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f7024f9d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7020198060 con 0x7f7020101e40 2023-07-14T13:15:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f7024f9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70201981d0 con 0x7f7020106e80 2023-07-14T13:15:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f7024f9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7020198390 con 0x7f70201027e0 2023-07-14T13:15:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f701f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7020101e40 0x7f702019d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f701f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7020101e40 0x7f702019d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51230/0 (socket says 172.21.15.17:51230) 2023-07-14T13:15:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f701f7fe700 1 -- 172.21.15.17:0/1645046908 learned_addr learned my addr 172.21.15.17:0/1645046908 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f701ffff700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7020106e80 0x7f7020197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f701effd700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70201027e0 0x7f702019ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f701f7fe700 1 -- 172.21.15.17:0/1645046908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70201027e0 msgr2=0x7f702019ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f701f7fe700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70201027e0 0x7f702019ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f701f7fe700 1 -- 172.21.15.17:0/1645046908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7020106e80 msgr2=0x7f7020197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f701f7fe700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7020106e80 0x7f7020197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.954+0000 7f701f7fe700 1 -- 172.21.15.17:0/1645046908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140095f0 con 0x7f7020101e40 2023-07-14T13:15:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.955+0000 7f701f7fe700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7020101e40 0x7f702019d8b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f701000d950 tx=0x7f701000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.955+0000 7f701cff9700 1 -- 172.21.15.17:0/1645046908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701000f890 con 0x7f7020101e40 2023-07-14T13:15:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.955+0000 7f701cff9700 1 -- 172.21.15.17:0/1645046908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f701000fe80 con 0x7f7020101e40 2023-07-14T13:15:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.955+0000 7f7024f9d700 1 -- 172.21.15.17:0/1645046908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7020198670 con 0x7f7020101e40 2023-07-14T13:15:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.955+0000 7f701cff9700 1 -- 172.21.15.17:0/1645046908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701000e3b0 con 0x7f7020101e40 2023-07-14T13:15:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.955+0000 7f7024f9d700 1 -- 172.21.15.17:0/1645046908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70201a4830 con 0x7f7020101e40 2023-07-14T13:15:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.956+0000 7f7024f9d700 1 -- 172.21.15.17:0/1645046908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7020067220 con 0x7f7020101e40 2023-07-14T13:15:35.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.959+0000 7f701cff9700 1 -- 172.21.15.17:0/1645046908 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7010010460 con 0x7f7020101e40 2023-07-14T13:15:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.961+0000 7f701cff9700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f70080a13b0 0x7f70080a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.961+0000 7f701cff9700 1 -- 172.21.15.17:0/1645046908 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f70100ccae0 con 0x7f7020101e40 2023-07-14T13:15:36.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.961+0000 7f701effd700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f70080a13b0 0x7f70080a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.962+0000 7f701effd700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f70080a13b0 0x7f70080a3860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7014000c00 tx=0x7f70140058e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:35.964+0000 7f701cff9700 1 -- 172.21.15.17:0/1645046908 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f7010095eb0 con 0x7f7020101e40 2023-07-14T13:15:36.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.297+0000 7f7024f9d700 1 -- 172.21.15.17:0/1645046908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70201a4ac0 con 0x7f7020101e40 2023-07-14T13:15:36.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.298+0000 7f701cff9700 1 -- 172.21.15.17:0/1645046908 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+10851 (secure 0 0 0) 0x7f7010016090 con 0x7f7020101e40 2023-07-14T13:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:15:36.338 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:15:20.185849+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:15:36.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.301+0000 7f7024f9d700 1 -- 172.21.15.17:0/1645046908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f70080a13b0 msgr2=0x7f70080a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.301+0000 7f7024f9d700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f70080a13b0 0x7f70080a3860 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7014000c00 tx=0x7f70140058e0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.301+0000 7f7024f9d700 1 -- 172.21.15.17:0/1645046908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7020101e40 msgr2=0x7f702019d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.301+0000 7f7024f9d700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7020101e40 0x7f702019d8b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f701000d950 tx=0x7f701000dc60 comp rx=0 tx=0).stop 2023-07-14T13:15:36.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.301+0000 7f7024f9d700 1 -- 172.21.15.17:0/1645046908 shutdown_connections 2023-07-14T13:15:36.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.301+0000 7f7024f9d700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f70080a13b0 0x7f70080a3860 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.301+0000 7f7024f9d700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7020106e80 0x7f7020197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.301+0000 7f7024f9d700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7020101e40 0x7f702019d8b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.301+0000 7f7024f9d700 1 --2- 172.21.15.17:0/1645046908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70201027e0 0x7f702019ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.301+0000 7f7024f9d700 1 -- 172.21.15.17:0/1645046908 >> 172.21.15.17:0/1645046908 conn(0x7f70200fd690 msgr2=0x7f70200fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.302+0000 7f7024f9d700 1 -- 172.21.15.17:0/1645046908 shutdown_connections 2023-07-14T13:15:36.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.302+0000 7f7024f9d700 1 -- 172.21.15.17:0/1645046908 wait complete. 2023-07-14T13:15:36.342 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 43 2023-07-14T13:15:36.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:15:36.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.555+0000 7fc0d3fff700 1 -- 172.21.15.17:0/3808444528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc0728b0 msgr2=0x7fc0cc072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.555+0000 7fc0d3fff700 1 --2- 172.21.15.17:0/3808444528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc0728b0 0x7fc0cc072c80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009990 tx=0x7fc0c8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.555+0000 7fc0d3fff700 1 -- 172.21.15.17:0/3808444528 shutdown_connections 2023-07-14T13:15:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.555+0000 7fc0d3fff700 1 --2- 172.21.15.17:0/3808444528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0cc10c310 0x7fc0cc10e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.555+0000 7fc0d3fff700 1 --2- 172.21.15.17:0/3808444528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc0728b0 0x7fc0cc072c80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.555+0000 7fc0d3fff700 1 --2- 172.21.15.17:0/3808444528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc0731c0 0x7fc0cc10bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.555+0000 7fc0d3fff700 1 -- 172.21.15.17:0/3808444528 >> 172.21.15.17:0/3808444528 conn(0x7fc0cc0fb5f0 msgr2=0x7fc0cc0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.555+0000 7fc0d3fff700 1 -- 172.21.15.17:0/3808444528 shutdown_connections 2023-07-14T13:15:36.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.555+0000 7fc0d3fff700 1 -- 172.21.15.17:0/3808444528 wait complete. 2023-07-14T13:15:36.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.556+0000 7fc0d3fff700 1 Processor -- start 2023-07-14T13:15:36.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.557+0000 7fc0d3fff700 1 -- start start 2023-07-14T13:15:36.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.557+0000 7fc0d3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0cc0728b0 0x7fc0cc197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.557+0000 7fc0d3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc0731c0 0x7fc0cc198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.557+0000 7fc0d3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc10c310 0x7fc0cc19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.557+0000 7fc0d3fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc19cd00 con 0x7fc0cc0731c0 2023-07-14T13:15:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.557+0000 7fc0d3fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc19ce70 con 0x7fc0cc0728b0 2023-07-14T13:15:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.557+0000 7fc0d3fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc19d030 con 0x7fc0cc10c310 2023-07-14T13:15:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.557+0000 7fc0d159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc0731c0 0x7fc0cc198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.557+0000 7fc0d159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc0731c0 0x7fc0cc198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51254/0 (socket says 172.21.15.17:51254) 2023-07-14T13:15:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.557+0000 7fc0d159a700 1 -- 172.21.15.17:0/1232843266 learned_addr learned my addr 172.21.15.17:0/1232843266 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.557+0000 7fc0d1d9b700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0cc0728b0 0x7fc0cc197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.558+0000 7fc0d259c700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc10c310 0x7fc0cc19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.558+0000 7fc0d159a700 1 -- 172.21.15.17:0/1232843266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc10c310 msgr2=0x7fc0cc19c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.558+0000 7fc0d159a700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc10c310 0x7fc0cc19c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.558+0000 7fc0d159a700 1 -- 172.21.15.17:0/1232843266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0cc0728b0 msgr2=0x7fc0cc197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.558+0000 7fc0d159a700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0cc0728b0 0x7fc0cc197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.558+0000 7fc0d159a700 1 -- 172.21.15.17:0/1232843266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c80095f0 con 0x7fc0cc0731c0 2023-07-14T13:15:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.558+0000 7fc0d259c700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc10c310 0x7fc0cc19c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:15:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.558+0000 7fc0d159a700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc0731c0 0x7fc0cc198260 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00d950 tx=0x7fc0bc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.558+0000 7fc0c2ffd700 1 -- 172.21.15.17:0/1232843266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc009940 con 0x7fc0cc0731c0 2023-07-14T13:15:36.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.559+0000 7fc0c2ffd700 1 -- 172.21.15.17:0/1232843266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0bc010460 con 0x7fc0cc0731c0 2023-07-14T13:15:36.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.559+0000 7fc0d3fff700 1 -- 172.21.15.17:0/1232843266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc19d310 con 0x7fc0cc0731c0 2023-07-14T13:15:36.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.559+0000 7fc0c2ffd700 1 -- 172.21.15.17:0/1232843266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc00f620 con 0x7fc0cc0731c0 2023-07-14T13:15:36.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.559+0000 7fc0d3fff700 1 -- 172.21.15.17:0/1232843266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc1a4b50 con 0x7fc0cc0731c0 2023-07-14T13:15:36.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.562+0000 7fc0c2ffd700 1 -- 172.21.15.17:0/1232843266 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc0bc0105d0 con 0x7fc0cc0731c0 2023-07-14T13:15:36.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.564+0000 7fc0e78a4b80 1 Processor -- start 2023-07-14T13:15:36.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.564+0000 7fc0e78a4b80 1 -- start start 2023-07-14T13:15:36.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.564+0000 7fc0c2ffd700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0b80a1340 0x7fc0b80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.564+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c0012d0 0x55772c0016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.564+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c00c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.564+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c00eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.564+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772bf07cb0 con 0x55772c001be0 2023-07-14T13:15:36.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.564+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772bf5aa40 con 0x55772c0012d0 2023-07-14T13:15:36.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.564+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772bf53ed0 con 0x55772c00cad0 2023-07-14T13:15:36.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.564+0000 7fc0c2ffd700 1 -- 172.21.15.17:0/1232843266 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc0bc0ccab0 con 0x7fc0cc0731c0 2023-07-14T13:15:36.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c00c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d259c700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0b80a1340 0x7fc0b80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c00c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51264/0 (socket says 172.21.15.17:51264) 2023-07-14T13:15:36.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d159a700 1 -- 172.21.15.17:0/3930155942 learned_addr learned my addr 172.21.15.17:0/3930155942 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:36.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d1d9b700 1 --2- 172.21.15.17:0/3930155942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c0012d0 0x55772c0016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.606 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d259c700 1 --2- 172.21.15.17:0/3930155942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c00eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d159a700 1 -- 172.21.15.17:0/3930155942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 msgr2=0x55772c00eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d159a700 1 --2- 172.21.15.17:0/3930155942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c00eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d159a700 1 -- 172.21.15.17:0/3930155942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c0012d0 msgr2=0x55772c0016a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d159a700 1 --2- 172.21.15.17:0/3930155942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c0012d0 0x55772c0016a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d159a700 1 -- 172.21.15.17:0/3930155942 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55772bd81de0 con 0x55772c001be0 2023-07-14T13:15:36.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.565+0000 7fc0d159a700 1 --2- 172.21.15.17:0/3930155942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c00c590 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc099b30 tx=0x7fc0bc099760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1eb7cee4f03a0ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.566+0000 7fc0d259c700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0b80a1340 0x7fc0b80a37f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40060b0 tx=0x7fc0c4009c70 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.566+0000 7fc0b7fff700 1 -- 172.21.15.17:0/3930155942 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc048cb0 con 0x55772c001be0 2023-07-14T13:15:36.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.566+0000 7fc0b7fff700 1 -- 172.21.15.17:0/3930155942 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0bc0108d0 con 0x55772c001be0 2023-07-14T13:15:36.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.566+0000 7fc0b7fff700 1 -- 172.21.15.17:0/3930155942 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc04bef0 con 0x55772c001be0 2023-07-14T13:15:36.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.566+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/3930155942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 msgr2=0x55772c00c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.566+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/3930155942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c00c590 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc099b30 tx=0x7fc0bc099760 comp rx=0 tx=0).stop 2023-07-14T13:15:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.567+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/3930155942 shutdown_connections 2023-07-14T13:15:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.567+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/3930155942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c00eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.567+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/3930155942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c0012d0 0x55772c0016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.567+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/3930155942 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c00c590 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.567+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/3930155942 >> 172.21.15.17:0/3930155942 conn(0x55772bff7da0 msgr2=0x55772bffd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.567+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/3930155942 shutdown_connections 2023-07-14T13:15:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.567+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/3930155942 wait complete. 2023-07-14T13:15:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.568+0000 7fc0e78a4b80 1 -- start start 2023-07-14T13:15:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.568+0000 7fc0e78a4b80 1 Processor -- start 2023-07-14T13:15:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c0012d0 0x55772c00c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c001be0 0x55772c009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c009f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772bef3ac0 con 0x55772c0012d0 2023-07-14T13:15:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772bef37c0 con 0x55772c001be0 2023-07-14T13:15:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772bdd7920 con 0x55772c00cad0 2023-07-14T13:15:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0e78a4b80 10 client.0 _ll_register_callbacks cb 0x55772bef1760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0d1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c0012d0 0x55772c00c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0d1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c0012d0 0x55772c00c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51274/0 (socket says 172.21.15.17:51274) 2023-07-14T13:15:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0d1d9b700 1 -- 172.21.15.17:0/1164788838 learned_addr learned my addr 172.21.15.17:0/1164788838 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0d259c700 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c009f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0d1d9b700 1 -- 172.21.15.17:0/1164788838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 msgr2=0x55772c009f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0d1d9b700 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c009f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0d1d9b700 1 -- 172.21.15.17:0/1164788838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c001be0 msgr2=0x55772c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0d1d9b700 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c001be0 0x55772c009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.569+0000 7fc0d1d9b700 1 -- 172.21.15.17:0/1164788838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc1a4b50 con 0x55772c0012d0 2023-07-14T13:15:36.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.570+0000 7fc0d1d9b700 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c0012d0 0x55772c00c590 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80098e0 tx=0x7fc0c8005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f011559a45750c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.570+0000 7fc0b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:15:36.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.570+0000 7fc0b57fa700 1 -- 172.21.15.17:0/1164788838 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c801d070 con 0x55772c0012d0 2023-07-14T13:15:36.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.570+0000 7fc0b57fa700 1 -- 172.21.15.17:0/1164788838 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc0c800bd20 con 0x55772c0012d0 2023-07-14T13:15:36.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.570+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1164788838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55772bead4f0 con 0x55772c0012d0 2023-07-14T13:15:36.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.571+0000 7fc0b57fa700 1 -- 172.21.15.17:0/1164788838 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0c800bee0 con 0x55772c0012d0 2023-07-14T13:15:36.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.571+0000 7fc0e78a4b80 10 client.18057 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:36.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.571+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1164788838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55772bd6ac60 con 0x55772c0012d0 2023-07-14T13:15:36.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.571+0000 7fc0b57fa700 1 -- 172.21.15.17:0/1164788838 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55772bead4f0 con 0x55772c0012d0 2023-07-14T13:15:36.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.571+0000 7fc0b57fa700 1 -- 172.21.15.17:0/1164788838 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc0c8003940 con 0x55772c0012d0 2023-07-14T13:15:36.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.571+0000 7fc0e78a4b80 10 client.18057 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:36.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.571+0000 7fc0e78a4b80 10 client.18057 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:15:36.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.571+0000 7fc0e78a4b80 20 client.18057 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:36.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.571+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55772c01c4d0 0x55772c01e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.571+0000 7fc0e78a4b80 4 client.18057 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:36.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.571+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1164788838 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55772bf4ceb0 con 0x55772c01c4d0 2023-07-14T13:15:36.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.572+0000 7fc0d159a700 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55772c01c4d0 0x55772c01e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.572+0000 7fc0d159a700 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55772c01c4d0 0x55772c01e8e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4555d1dcf5340e9a server_cookie=7c1f81f7809eff9b in_seq=0 out_seq=0 2023-07-14T13:15:36.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.572+0000 7fc0b57fa700 10 client.18057 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:15:36.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.573+0000 7fc0b57fa700 1 -- 172.21.15.17:0/1164788838 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55772bf4ceb0 con 0x55772c01c4d0 2023-07-14T13:15:36.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.573+0000 7fc0b57fa700 10 client.18057 handle_command_reply: tid=0 2023-07-14T13:15:36.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.573+0000 7fc0e78a4b80 1 client.18057 shutdown 2023-07-14T13:15:36.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1164788838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c0012d0 msgr2=0x55772c00c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c0012d0 0x55772c00c590 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80098e0 tx=0x7fc0c8005750 comp rx=0 tx=0).stop 2023-07-14T13:15:36.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1164788838 shutdown_connections 2023-07-14T13:15:36.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55772c01c4d0 0x55772c01e8e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c009f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c0012d0 0x55772c00c590 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/1164788838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c001be0 0x55772c009810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1164788838 >> 172.21.15.17:0/1164788838 conn(0x55772bff7da0 msgr2=0x55772bffd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0b57fa700 0 client.18057 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:15:36.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1164788838 shutdown_connections 2023-07-14T13:15:36.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1164788838 wait complete. 2023-07-14T13:15:36.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.574+0000 7fc0e78a4b80 20 client.18057 trim_cache size 0 max 16384 2023-07-14T13:15:36.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.590+0000 7fc0e78a4b80 1 Processor -- start 2023-07-14T13:15:36.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.590+0000 7fc0e78a4b80 1 -- start start 2023-07-14T13:15:36.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.590+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c0012d0 0x55772c00c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c004af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772c004660 con 0x55772c001be0 2023-07-14T13:15:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772bffed20 con 0x55772c0012d0 2023-07-14T13:15:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772c002540 con 0x55772c00cad0 2023-07-14T13:15:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0d159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c004af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0d1d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c0012d0 0x55772c00c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0d159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c004af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51282/0 (socket says 172.21.15.17:51282) 2023-07-14T13:15:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0d159a700 1 -- 172.21.15.17:0/1439061307 learned_addr learned my addr 172.21.15.17:0/1439061307 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0d259c700 1 --2- 172.21.15.17:0/1439061307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0d159a700 1 -- 172.21.15.17:0/1439061307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 msgr2=0x55772c005030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0d159a700 1 --2- 172.21.15.17:0/1439061307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c005030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0d159a700 1 -- 172.21.15.17:0/1439061307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c0012d0 msgr2=0x55772c00c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0d159a700 1 --2- 172.21.15.17:0/1439061307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c0012d0 0x55772c00c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0d159a700 1 -- 172.21.15.17:0/1439061307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55772bda8250 con 0x55772c001be0 2023-07-14T13:15:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.591+0000 7fc0d1d9b700 1 --2- 172.21.15.17:0/1439061307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c0012d0 0x55772c00c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.592+0000 7fc0d159a700 1 --2- 172.21.15.17:0/1439061307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c004af0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0ca2d0 tx=0x7fc0bc00bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2c58a46a303ad7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.592+0000 7fc0c0ff9700 1 -- 172.21.15.17:0/1439061307 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0a1ff0 con 0x55772c001be0 2023-07-14T13:15:36.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.592+0000 7fc0c0ff9700 1 -- 172.21.15.17:0/1439061307 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0bc09dbd0 con 0x55772c001be0 2023-07-14T13:15:36.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.592+0000 7fc0c0ff9700 1 -- 172.21.15.17:0/1439061307 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc099e00 con 0x55772c001be0 2023-07-14T13:15:36.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.593+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1439061307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 msgr2=0x55772c004af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.593+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/1439061307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c004af0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0ca2d0 tx=0x7fc0bc00bf20 comp rx=0 tx=0).stop 2023-07-14T13:15:36.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.593+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1439061307 shutdown_connections 2023-07-14T13:15:36.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.593+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/1439061307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c00cad0 0x55772c005030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.593+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/1439061307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c0012d0 0x55772c00c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.593+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/1439061307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c004af0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.593+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1439061307 >> 172.21.15.17:0/1439061307 conn(0x55772bff7da0 msgr2=0x55772c01e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.593+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1439061307 shutdown_connections 2023-07-14T13:15:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.593+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/1439061307 wait complete. 2023-07-14T13:15:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.593+0000 7fc0e78a4b80 1 -- start start 2023-07-14T13:15:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.594+0000 7fc0e78a4b80 1 Processor -- start 2023-07-14T13:15:36.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.594+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c0012d0 0x55772c010c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.594+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c0111a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.594+0000 7fc0e78a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c00cad0 0x55772c0116e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.594+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772c06f410 con 0x55772c001be0 2023-07-14T13:15:36.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.594+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772c06f580 con 0x55772c00cad0 2023-07-14T13:15:36.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.594+0000 7fc0e78a4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55772c06f740 con 0x55772c0012d0 2023-07-14T13:15:36.638 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.594+0000 7fc0e78a4b80 10 client.0 _ll_register_callbacks cb 0x7fc0c8009f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.594+0000 7fc0d159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c0111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.594+0000 7fc0d159a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c0111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51298/0 (socket says 172.21.15.17:51298) 2023-07-14T13:15:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.594+0000 7fc0d159a700 1 -- 172.21.15.17:0/49241771 learned_addr learned my addr 172.21.15.17:0/49241771 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0d1d9b700 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c0012d0 0x55772c010c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0d259c700 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c00cad0 0x55772c0116e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0d159a700 1 -- 172.21.15.17:0/49241771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c0012d0 msgr2=0x55772c010c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0d159a700 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c0012d0 0x55772c010c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0d159a700 1 -- 172.21.15.17:0/49241771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c00cad0 msgr2=0x55772c0116e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0d159a700 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c00cad0 0x55772c0116e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0d159a700 1 -- 172.21.15.17:0/49241771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55772bd6ac60 con 0x55772c001be0 2023-07-14T13:15:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0d259c700 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c00cad0 0x55772c0116e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:15:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0d159a700 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c0111a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0998a0 tx=0x7fc0bc096010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb67f0c4fc7e40f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:15:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0b57fa700 1 -- 172.21.15.17:0/49241771 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0a1ff0 con 0x55772c001be0 2023-07-14T13:15:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0b57fa700 1 -- 172.21.15.17:0/49241771 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc0bc099ba0 con 0x55772c001be0 2023-07-14T13:15:36.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.595+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/49241771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc0bc0108d0 con 0x55772c001be0 2023-07-14T13:15:36.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.596+0000 7fc0b57fa700 1 -- 172.21.15.17:0/49241771 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0bc014030 con 0x55772c001be0 2023-07-14T13:15:36.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.596+0000 7fc0e78a4b80 10 client.18063 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:36.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.596+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/49241771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55772bd81de0 con 0x55772c001be0 2023-07-14T13:15:36.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.596+0000 7fc0b57fa700 1 -- 172.21.15.17:0/49241771 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0bc0108d0 con 0x55772c001be0 2023-07-14T13:15:36.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.596+0000 7fc0b57fa700 1 -- 172.21.15.17:0/49241771 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc0bc099e00 con 0x55772c001be0 2023-07-14T13:15:36.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.596+0000 7fc0e78a4b80 10 client.18063 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:36.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.596+0000 7fc0e78a4b80 10 client.18063 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:15:36.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.596+0000 7fc0e78a4b80 20 client.18063 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:36.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.596+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55772c070970 0x55772c072d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.596+0000 7fc0e78a4b80 4 client.18063 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:15:36.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.596+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/49241771 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55772bf0f050 con 0x55772c070970 2023-07-14T13:15:36.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.597+0000 7fc0d1d9b700 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55772c070970 0x55772c072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.597+0000 7fc0d1d9b700 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55772c070970 0x55772c072d50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0788f6bf4411f8c server_cookie=6988e30b8dc23852 in_seq=0 out_seq=0 2023-07-14T13:15:36.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.597+0000 7fc0b57fa700 10 client.18063 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:15:36.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.597+0000 7fc0b57fa700 1 -- 172.21.15.17:0/49241771 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55772bf0f050 con 0x55772c070970 2023-07-14T13:15:36.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.597+0000 7fc0b57fa700 10 client.18063 handle_command_reply: tid=0 2023-07-14T13:15:36.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.597+0000 7fc0e78a4b80 1 client.18063 shutdown 2023-07-14T13:15:36.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/49241771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 msgr2=0x55772c0111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c0111a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0998a0 tx=0x7fc0bc096010 comp rx=0 tx=0).stop 2023-07-14T13:15:36.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/49241771 shutdown_connections 2023-07-14T13:15:36.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55772c00cad0 0x55772c0116e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55772c070970 0x55772c072d50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55772c0012d0 0x55772c010c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0e78a4b80 1 --2- 172.21.15.17:0/49241771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55772c001be0 0x55772c0111a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/49241771 >> 172.21.15.17:0/49241771 conn(0x55772bff7da0 msgr2=0x55772c004af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0b57fa700 0 client.18063 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:15:36.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/49241771 shutdown_connections 2023-07-14T13:15:36.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0e78a4b80 1 -- 172.21.15.17:0/49241771 wait complete. 2023-07-14T13:15:36.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.598+0000 7fc0e78a4b80 20 client.18063 trim_cache size 0 max 16384 2023-07-14T13:15:36.645 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:15:36.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 -- 172.21.15.17:0/1232843266 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0b80a1340 msgr2=0x7fc0b80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0b80a1340 0x7fc0b80a37f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc0c40060b0 tx=0x7fc0c4009c70 comp rx=0 tx=0).stop 2023-07-14T13:15:36.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 -- 172.21.15.17:0/1232843266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc0731c0 msgr2=0x7fc0cc198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc0731c0 0x7fc0cc198260 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00d950 tx=0x7fc0bc00dc60 comp rx=0 tx=0).stop 2023-07-14T13:15:36.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 -- 172.21.15.17:0/1232843266 shutdown_connections 2023-07-14T13:15:36.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0b80a1340 0x7fc0b80a37f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc10c310 0x7fc0cc19c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0cc0728b0 0x7fc0cc197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 --2- 172.21.15.17:0/1232843266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0cc0731c0 0x7fc0cc198260 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 -- 172.21.15.17:0/1232843266 >> 172.21.15.17:0/1232843266 conn(0x7fc0cc0fb5f0 msgr2=0x7fc0cc10e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 -- 172.21.15.17:0/1232843266 shutdown_connections 2023-07-14T13:15:36.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.599+0000 7fc0d3fff700 1 -- 172.21.15.17:0/1232843266 wait complete. 2023-07-14T13:15:36.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:15:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.858+0000 7fc3681ff700 1 -- 172.21.15.17:0/1024720758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc360072850 msgr2=0x7fc360072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.858+0000 7fc3681ff700 1 --2- 172.21.15.17:0/1024720758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc360072850 0x7fc360072c20 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009990 tx=0x7fc35c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.858+0000 7fc3681ff700 1 -- 172.21.15.17:0/1024720758 shutdown_connections 2023-07-14T13:15:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.858+0000 7fc3681ff700 1 --2- 172.21.15.17:0/1024720758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc36010c3a0 0x7fc36010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.858+0000 7fc3681ff700 1 --2- 172.21.15.17:0/1024720758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc360072850 0x7fc360072c20 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.858+0000 7fc3681ff700 1 --2- 172.21.15.17:0/1024720758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc360073160 0x7fc36010be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.858+0000 7fc3681ff700 1 -- 172.21.15.17:0/1024720758 >> 172.21.15.17:0/1024720758 conn(0x7fc3600fb600 msgr2=0x7fc3600fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.858+0000 7fc3681ff700 1 -- 172.21.15.17:0/1024720758 shutdown_connections 2023-07-14T13:15:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.858+0000 7fc3681ff700 1 -- 172.21.15.17:0/1024720758 wait complete. 2023-07-14T13:15:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.859+0000 7fc3681ff700 1 Processor -- start 2023-07-14T13:15:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.859+0000 7fc3681ff700 1 -- start start 2023-07-14T13:15:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.860+0000 7fc3681ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc360072850 0x7fc360197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.860+0000 7fc3681ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc360073160 0x7fc3601982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.860+0000 7fc3681ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc36010c3a0 0x7fc36019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.860+0000 7fc3681ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36019cd00 con 0x7fc36010c3a0 2023-07-14T13:15:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.860+0000 7fc3681ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36019ce70 con 0x7fc360073160 2023-07-14T13:15:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.860+0000 7fc3681ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36019d030 con 0x7fc360072850 2023-07-14T13:15:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.860+0000 7fc36679c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc36010c3a0 0x7fc36019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.860+0000 7fc36679c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc36010c3a0 0x7fc36019c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51318/0 (socket says 172.21.15.17:51318) 2023-07-14T13:15:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.860+0000 7fc36679c700 1 -- 172.21.15.17:0/2045425469 learned_addr learned my addr 172.21.15.17:0/2045425469 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.860+0000 7fc365f9b700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc360072850 0x7fc360197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.860+0000 7fc36579a700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc360073160 0x7fc3601982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc36679c700 1 -- 172.21.15.17:0/2045425469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc360072850 msgr2=0x7fc360197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc36679c700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc360072850 0x7fc360197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc36679c700 1 -- 172.21.15.17:0/2045425469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc360073160 msgr2=0x7fc3601982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc36679c700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc360073160 0x7fc3601982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc36679c700 1 -- 172.21.15.17:0/2045425469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0095f0 con 0x7fc36010c3a0 2023-07-14T13:15:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc36579a700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc360073160 0x7fc3601982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc36679c700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc36010c3a0 0x7fc36019c6c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc358009fd0 tx=0x7fc35800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc356ffd700 1 -- 172.21.15.17:0/2045425469 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358018070 con 0x7fc36010c3a0 2023-07-14T13:15:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc3681ff700 1 -- 172.21.15.17:0/2045425469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36019d2b0 con 0x7fc36010c3a0 2023-07-14T13:15:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc356ffd700 1 -- 172.21.15.17:0/2045425469 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc35800f040 con 0x7fc36010c3a0 2023-07-14T13:15:36.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc356ffd700 1 -- 172.21.15.17:0/2045425469 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35800cc10 con 0x7fc36010c3a0 2023-07-14T13:15:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.861+0000 7fc3681ff700 1 -- 172.21.15.17:0/2045425469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3601a4b50 con 0x7fc36010c3a0 2023-07-14T13:15:36.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.865+0000 7fc356ffd700 1 -- 172.21.15.17:0/2045425469 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc358003a00 con 0x7fc36010c3a0 2023-07-14T13:15:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.866+0000 7fc356ffd700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc34c0a12c0 0x7fc34c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.866+0000 7fc356ffd700 1 -- 172.21.15.17:0/2045425469 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc3580cc7c0 con 0x7fc36010c3a0 2023-07-14T13:15:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.867+0000 7fc37bab2b80 1 Processor -- start 2023-07-14T13:15:36.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.867+0000 7fc365f9b700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc34c0a12c0 0x7fc34c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.867+0000 7fc37bab2b80 1 -- start start 2023-07-14T13:15:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.867+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f32d0 0x5620040f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.867+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f3be0 0x5620040fe590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.867+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x562004100eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.867+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562003ff9cb0 con 0x5620040f32d0 2023-07-14T13:15:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.867+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56200404ca40 con 0x5620040fead0 2023-07-14T13:15:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.867+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562004045ed0 con 0x5620040f3be0 2023-07-14T13:15:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc365f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f32d0 0x5620040f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc365f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f32d0 0x5620040f36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51334/0 (socket says 172.21.15.17:51334) 2023-07-14T13:15:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc36579a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f3be0 0x5620040fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc365f9b700 1 -- 172.21.15.17:0/2678592895 learned_addr learned my addr 172.21.15.17:0/2678592895 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc36679c700 1 --2- 172.21.15.17:0/2678592895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x562004100eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc365f9b700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc34c0a12c0 0x7fc34c0a3770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc35c006010 tx=0x7fc35c00b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc36579a700 1 -- 172.21.15.17:0/2678592895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 msgr2=0x562004100eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc36579a700 1 --2- 172.21.15.17:0/2678592895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x562004100eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc36579a700 1 -- 172.21.15.17:0/2678592895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f32d0 msgr2=0x5620040f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc36579a700 1 --2- 172.21.15.17:0/2678592895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f32d0 0x5620040f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc36579a700 1 -- 172.21.15.17:0/2678592895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562003e73de0 con 0x5620040f3be0 2023-07-14T13:15:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc365f9b700 1 --2- 172.21.15.17:0/2678592895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f32d0 0x5620040f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.868+0000 7fc36679c700 1 --2- 172.21.15.17:0/2678592895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x562004100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.869+0000 7fc36579a700 1 --2- 172.21.15.17:0/2678592895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f3be0 0x5620040fe590 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc3500114c0 tx=0x7fc3500117d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c621649edc278d09 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.869+0000 7fc34bfff700 1 -- 172.21.15.17:0/2678592895 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350004230 con 0x5620040f3be0 2023-07-14T13:15:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.869+0000 7fc34bfff700 1 -- 172.21.15.17:0/2678592895 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc350004cc0 con 0x5620040f3be0 2023-07-14T13:15:36.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.869+0000 7fc34bfff700 1 -- 172.21.15.17:0/2678592895 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350005590 con 0x5620040f3be0 2023-07-14T13:15:36.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.870+0000 7fc37bab2b80 1 -- 172.21.15.17:0/2678592895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f3be0 msgr2=0x5620040fe590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.870+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/2678592895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f3be0 0x5620040fe590 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc3500114c0 tx=0x7fc3500117d0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.870+0000 7fc37bab2b80 1 -- 172.21.15.17:0/2678592895 shutdown_connections 2023-07-14T13:15:36.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.870+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/2678592895 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x562004100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.870+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/2678592895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f32d0 0x5620040f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.870+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/2678592895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f3be0 0x5620040fe590 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.870+0000 7fc37bab2b80 1 -- 172.21.15.17:0/2678592895 >> 172.21.15.17:0/2678592895 conn(0x5620040e9da0 msgr2=0x5620040ef6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.870+0000 7fc37bab2b80 1 -- 172.21.15.17:0/2678592895 shutdown_connections 2023-07-14T13:15:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.870+0000 7fc37bab2b80 1 -- 172.21.15.17:0/2678592895 wait complete. 2023-07-14T13:15:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.871+0000 7fc37bab2b80 1 -- start start 2023-07-14T13:15:36.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.871+0000 7fc37bab2b80 1 Processor -- start 2023-07-14T13:15:36.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040f32d0 0x5620040fe540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040fead0 0x5620040fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562003fe5ac0 con 0x5620040f3be0 2023-07-14T13:15:36.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562003fe57c0 con 0x5620040f32d0 2023-07-14T13:15:36.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562003ec9920 con 0x5620040fead0 2023-07-14T13:15:36.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc37bab2b80 10 client.0 _ll_register_callbacks cb 0x562003fe3760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:36.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc36579a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc36579a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51342/0 (socket says 172.21.15.17:51342) 2023-07-14T13:15:36.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc365f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040f32d0 0x5620040fe540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc36579a700 1 -- 172.21.15.17:0/1340912928 learned_addr learned my addr 172.21.15.17:0/1340912928 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:36.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.872+0000 7fc36679c700 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040fead0 0x5620040fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.873+0000 7fc36579a700 1 -- 172.21.15.17:0/1340912928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040fead0 msgr2=0x5620040fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.873+0000 7fc36579a700 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040fead0 0x5620040fbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.873+0000 7fc36579a700 1 -- 172.21.15.17:0/1340912928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040f32d0 msgr2=0x5620040fe540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.873+0000 7fc36579a700 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040f32d0 0x5620040fe540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.873+0000 7fc36579a700 1 -- 172.21.15.17:0/1340912928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36010f3c0 con 0x5620040f3be0 2023-07-14T13:15:36.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.873+0000 7fc365f9b700 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040f32d0 0x5620040fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:36.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.873+0000 7fc36579a700 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb830 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc350005920 tx=0x7fc350004c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6300c4f403037854 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.873+0000 7fc3497fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:15:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.873+0000 7fc3497fa700 1 -- 172.21.15.17:0/1340912928 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350005150 con 0x5620040f3be0 2023-07-14T13:15:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.873+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1340912928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562003f9f4f0 con 0x5620040f3be0 2023-07-14T13:15:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.873+0000 7fc3497fa700 1 -- 172.21.15.17:0/1340912928 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc3500052b0 con 0x5620040f3be0 2023-07-14T13:15:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.874+0000 7fc3497fa700 1 -- 172.21.15.17:0/1340912928 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc350005470 con 0x5620040f3be0 2023-07-14T13:15:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.874+0000 7fc37bab2b80 10 client.18075 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.874+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1340912928 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fc3601a4b50 con 0x5620040f3be0 2023-07-14T13:15:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.874+0000 7fc3497fa700 1 -- 172.21.15.17:0/1340912928 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562003f9f4f0 con 0x5620040f3be0 2023-07-14T13:15:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.874+0000 7fc3497fa700 1 -- 172.21.15.17:0/1340912928 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc350019430 con 0x5620040f3be0 2023-07-14T13:15:36.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.874+0000 7fc37bab2b80 10 client.18075 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:36.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.874+0000 7fc37bab2b80 10 client.18075 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:15:36.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.874+0000 7fc37bab2b80 20 client.18075 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:36.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.874+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x56200410e350 0x562004110760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.874+0000 7fc37bab2b80 4 client.18075 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:36.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.874+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1340912928 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56200403eeb0 con 0x56200410e350 2023-07-14T13:15:36.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.875+0000 7fc365f9b700 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x56200410e350 0x562004110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.875+0000 7fc365f9b700 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x56200410e350 0x562004110760 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc33e0fd33243424 server_cookie=63f3e95fb4ef02e0 in_seq=0 out_seq=0 2023-07-14T13:15:36.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.875+0000 7fc3497fa700 10 client.18075 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:15:36.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.876+0000 7fc3497fa700 1 -- 172.21.15.17:0/1340912928 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56200403eeb0 con 0x56200410e350 2023-07-14T13:15:36.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.876+0000 7fc3497fa700 10 client.18075 handle_command_reply: tid=0 2023-07-14T13:15:36.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.876+0000 7fc37bab2b80 1 client.18075 shutdown 2023-07-14T13:15:36.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.876+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1340912928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 msgr2=0x5620040fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.876+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb830 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc350005920 tx=0x7fc350004c40 comp rx=0 tx=0).stop 2023-07-14T13:15:36.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.877+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1340912928 shutdown_connections 2023-07-14T13:15:36.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.877+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040fead0 0x5620040fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.877+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x56200410e350 0x562004110760 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.877+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040f32d0 0x5620040fe540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.877+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1340912928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb830 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.877+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1340912928 >> 172.21.15.17:0/1340912928 conn(0x5620040e9da0 msgr2=0x5620040ef290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.877+0000 7fc3497fa700 0 client.18075 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:15:36.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.877+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1340912928 shutdown_connections 2023-07-14T13:15:36.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.877+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1340912928 wait complete. 2023-07-14T13:15:36.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.877+0000 7fc37bab2b80 20 client.18075 trim_cache size 0 max 16384 2023-07-14T13:15:36.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc37bab2b80 1 Processor -- start 2023-07-14T13:15:36.931 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc37bab2b80 1 -- start start 2023-07-14T13:15:36.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f32d0 0x5620040fe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.932 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x5620040fb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620040f9e60 con 0x5620040f3be0 2023-07-14T13:15:36.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620040fbab0 con 0x5620040fead0 2023-07-14T13:15:36.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562004115440 con 0x5620040f32d0 2023-07-14T13:15:36.933 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc36579a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc36579a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51354/0 (socket says 172.21.15.17:51354) 2023-07-14T13:15:36.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc36679c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x5620040fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.891+0000 7fc36579a700 1 -- 172.21.15.17:0/421932203 learned_addr learned my addr 172.21.15.17:0/421932203 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:36.934 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.892+0000 7fc365f9b700 1 --2- 172.21.15.17:0/421932203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f32d0 0x5620040fe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.892+0000 7fc36679c700 1 -- 172.21.15.17:0/421932203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f32d0 msgr2=0x5620040fe0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.892+0000 7fc36679c700 1 --2- 172.21.15.17:0/421932203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f32d0 0x5620040fe0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.935 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.892+0000 7fc36679c700 1 -- 172.21.15.17:0/421932203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 msgr2=0x5620040fb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.892+0000 7fc36679c700 1 --2- 172.21.15.17:0/421932203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.892+0000 7fc36679c700 1 -- 172.21.15.17:0/421932203 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350009c90 con 0x5620040fead0 2023-07-14T13:15:36.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.892+0000 7fc36579a700 1 --2- 172.21.15.17:0/421932203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:36.936 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.892+0000 7fc36679c700 1 --2- 172.21.15.17:0/421932203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x5620040fb570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc3580c9ea0 tx=0x7fc35809f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f03d4a74cef8d29 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.893+0000 7fc354ff9700 1 -- 172.21.15.17:0/421932203 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580998e0 con 0x5620040fead0 2023-07-14T13:15:36.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.893+0000 7fc354ff9700 1 -- 172.21.15.17:0/421932203 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc35809d910 con 0x5620040fead0 2023-07-14T13:15:36.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.893+0000 7fc354ff9700 1 -- 172.21.15.17:0/421932203 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358099b40 con 0x5620040fead0 2023-07-14T13:15:36.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.893+0000 7fc37bab2b80 1 -- 172.21.15.17:0/421932203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 msgr2=0x5620040fb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.893+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/421932203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x5620040fb570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc3580c9ea0 tx=0x7fc35809f040 comp rx=0 tx=0).stop 2023-07-14T13:15:36.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.893+0000 7fc37bab2b80 1 -- 172.21.15.17:0/421932203 shutdown_connections 2023-07-14T13:15:36.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.893+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/421932203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x5620040fb570 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.893+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/421932203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f32d0 0x5620040fe0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.893+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/421932203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620040fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.893+0000 7fc37bab2b80 1 -- 172.21.15.17:0/421932203 >> 172.21.15.17:0/421932203 conn(0x5620040e9da0 msgr2=0x5620040f6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.893+0000 7fc37bab2b80 1 -- 172.21.15.17:0/421932203 shutdown_connections 2023-07-14T13:15:36.940 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.894+0000 7fc37bab2b80 1 -- 172.21.15.17:0/421932203 wait complete. 2023-07-14T13:15:36.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.894+0000 7fc37bab2b80 1 -- start start 2023-07-14T13:15:36.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.894+0000 7fc37bab2b80 1 Processor -- start 2023-07-14T13:15:36.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f32d0 0x562004105380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620041036b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc37bab2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x562004103bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562004104130 con 0x5620040f3be0 2023-07-14T13:15:36.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620041042a0 con 0x5620040fead0 2023-07-14T13:15:36.941 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc37bab2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562004104460 con 0x5620040f32d0 2023-07-14T13:15:36.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc37bab2b80 10 client.0 _ll_register_callbacks cb 0x7fc350009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:36.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc36579a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620041036b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc36579a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620041036b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51360/0 (socket says 172.21.15.17:51360) 2023-07-14T13:15:36.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc36579a700 1 -- 172.21.15.17:0/1462574927 learned_addr learned my addr 172.21.15.17:0/1462574927 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:36.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc36679c700 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x562004103bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.895+0000 7fc365f9b700 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f32d0 0x562004105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc36579a700 1 -- 172.21.15.17:0/1462574927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f32d0 msgr2=0x562004105380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc36579a700 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f32d0 0x562004105380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc36579a700 1 -- 172.21.15.17:0/1462574927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 msgr2=0x562004103bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:36.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc36579a700 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x562004103bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc36579a700 1 -- 172.21.15.17:0/1462574927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3601a4b50 con 0x5620040f3be0 2023-07-14T13:15:36.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc36579a700 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620041036b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc350019840 tx=0x7fc350019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0e13e36e430205 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:36.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc3497fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:15:36.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc3497fa700 1 -- 172.21.15.17:0/1462574927 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350005ce0 con 0x5620040f3be0 2023-07-14T13:15:36.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc3497fa700 1 -- 172.21.15.17:0/1462574927 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc350000e40 con 0x5620040f3be0 2023-07-14T13:15:36.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1462574927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc350004cc0 con 0x5620040f3be0 2023-07-14T13:15:36.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc3497fa700 1 -- 172.21.15.17:0/1462574927 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc350019a30 con 0x5620040f3be0 2023-07-14T13:15:36.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.896+0000 7fc37bab2b80 10 client.18081 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:36.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.897+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1462574927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fc36019d2b0 con 0x5620040f3be0 2023-07-14T13:15:36.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.897+0000 7fc3497fa700 1 -- 172.21.15.17:0/1462574927 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc350004cc0 con 0x5620040f3be0 2023-07-14T13:15:36.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.897+0000 7fc3497fa700 1 -- 172.21.15.17:0/1462574927 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc3500228a0 con 0x5620040f3be0 2023-07-14T13:15:36.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.897+0000 7fc37bab2b80 10 client.18081 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:36.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.897+0000 7fc37bab2b80 10 client.18081 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:15:36.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.897+0000 7fc37bab2b80 20 client.18081 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:36.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.897+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562004163220 0x562004165600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:36.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.897+0000 7fc37bab2b80 4 client.18081 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:15:36.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.897+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1462574927 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562004001050 con 0x562004163220 2023-07-14T13:15:36.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.897+0000 7fc365f9b700 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562004163220 0x562004165600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:36.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.898+0000 7fc365f9b700 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562004163220 0x562004165600 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f253cd60ee55cbbe server_cookie=bb2308c785a16d50 in_seq=0 out_seq=0 2023-07-14T13:15:36.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.898+0000 7fc3497fa700 10 client.18081 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:15:36.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.898+0000 7fc3497fa700 1 -- 172.21.15.17:0/1462574927 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562004001050 con 0x562004163220 2023-07-14T13:15:36.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.898+0000 7fc3497fa700 10 client.18081 handle_command_reply: tid=0 2023-07-14T13:15:36.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.898+0000 7fc37bab2b80 1 client.18081 shutdown 2023-07-14T13:15:36.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1462574927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 msgr2=0x5620041036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620041036b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc350019840 tx=0x7fc350019660 comp rx=0 tx=0).stop 2023-07-14T13:15:36.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1462574927 shutdown_connections 2023-07-14T13:15:36.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x562004163220 0x562004165600 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620040fead0 0x562004103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620040f32d0 0x562004105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc37bab2b80 1 --2- 172.21.15.17:0/1462574927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620040f3be0 0x5620041036b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc3497fa700 0 client.18081 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:15:36.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1462574927 >> 172.21.15.17:0/1462574927 conn(0x5620040e9da0 msgr2=0x5620040ee8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1462574927 shutdown_connections 2023-07-14T13:15:36.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc37bab2b80 1 -- 172.21.15.17:0/1462574927 wait complete. 2023-07-14T13:15:36.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.899+0000 7fc37bab2b80 20 client.18081 trim_cache size 0 max 16384 2023-07-14T13:15:36.948 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:15:36.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 -- 172.21.15.17:0/2045425469 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc34c0a12c0 msgr2=0x7fc34c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc34c0a12c0 0x7fc34c0a3770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc35c006010 tx=0x7fc35c00b260 comp rx=0 tx=0).stop 2023-07-14T13:15:36.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 -- 172.21.15.17:0/2045425469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc36010c3a0 msgr2=0x7fc36019c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:36.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc36010c3a0 0x7fc36019c6c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc358009fd0 tx=0x7fc35800ef90 comp rx=0 tx=0).stop 2023-07-14T13:15:36.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 -- 172.21.15.17:0/2045425469 shutdown_connections 2023-07-14T13:15:36.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc34c0a12c0 0x7fc34c0a3770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc36010c3a0 0x7fc36019c6c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc360072850 0x7fc360197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 --2- 172.21.15.17:0/2045425469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc360073160 0x7fc3601982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:36.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 -- 172.21.15.17:0/2045425469 >> 172.21.15.17:0/2045425469 conn(0x7fc3600fb600 msgr2=0x7fc36010e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:36.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 -- 172.21.15.17:0/2045425469 shutdown_connections 2023-07-14T13:15:36.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:36.900+0000 7fc3681ff700 1 -- 172.21.15.17:0/2045425469 wait complete. 2023-07-14T13:15:36.958 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:15:37.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.150+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1806249278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11b4102910 msgr2=0x7f11b41068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:37.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.150+0000 7f11bc1ff700 1 --2- 172.21.15.17:0/1806249278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11b4102910 0x7f11b41068d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f11a40099c0 tx=0x7f11a4009cd0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.150+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1806249278 shutdown_connections 2023-07-14T13:15:37.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.150+0000 7f11bc1ff700 1 --2- 172.21.15.17:0/1806249278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11b4106fb0 0x7f11b410eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.150+0000 7f11bc1ff700 1 --2- 172.21.15.17:0/1806249278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11b4101f70 0x7f11b4102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.150+0000 7f11bc1ff700 1 --2- 172.21.15.17:0/1806249278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11b4102910 0x7f11b41068d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.150+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1806249278 >> 172.21.15.17:0/1806249278 conn(0x7f11b40fd7e0 msgr2=0x7f11b40ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:37.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.151+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1806249278 shutdown_connections 2023-07-14T13:15:37.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.151+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1806249278 wait complete. 2023-07-14T13:15:37.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.152+0000 7f11bc1ff700 1 Processor -- start 2023-07-14T13:15:37.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.152+0000 7f11bc1ff700 1 -- start start 2023-07-14T13:15:37.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.152+0000 7f11bc1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11b4101f70 0x7f11b4197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.152+0000 7f11bc1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11b4102910 0x7f11b41982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11bc1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11b4106fb0 0x7f11b419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11bc1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b419cd60 con 0x7f11b4102910 2023-07-14T13:15:37.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11bc1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b419ced0 con 0x7f11b4106fb0 2023-07-14T13:15:37.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11bc1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b419d090 con 0x7f11b4101f70 2023-07-14T13:15:37.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11b979a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11b4102910 0x7f11b41982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11b979a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11b4102910 0x7f11b41982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51388/0 (socket says 172.21.15.17:51388) 2023-07-14T13:15:37.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11b979a700 1 -- 172.21.15.17:0/1267257737 learned_addr learned my addr 172.21.15.17:0/1267257737 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:37.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11b4101f70 0x7f11b4197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11ba79c700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11b4106fb0 0x7f11b419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11b979a700 1 -- 172.21.15.17:0/1267257737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11b4101f70 msgr2=0x7f11b4197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:37.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11b979a700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11b4101f70 0x7f11b4197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11b979a700 1 -- 172.21.15.17:0/1267257737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11b4106fb0 msgr2=0x7f11b419c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:37.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11b979a700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11b4106fb0 0x7f11b419c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.153+0000 7f11b979a700 1 -- 172.21.15.17:0/1267257737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009520 con 0x7f11b4102910 2023-07-14T13:15:37.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.154+0000 7f11b979a700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11b4102910 0x7f11b41982c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f11a4000c00 tx=0x7f11a400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:37.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.154+0000 7f11aaffd700 1 -- 172.21.15.17:0/1267257737 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a401d070 con 0x7f11b4102910 2023-07-14T13:15:37.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.154+0000 7f11aaffd700 1 -- 172.21.15.17:0/1267257737 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11a4005050 con 0x7f11b4102910 2023-07-14T13:15:37.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.154+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1267257737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a40095f0 con 0x7f11b4102910 2023-07-14T13:15:37.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.154+0000 7f11aaffd700 1 -- 172.21.15.17:0/1267257737 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4004a90 con 0x7f11b4102910 2023-07-14T13:15:37.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.154+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1267257737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b419d5a0 con 0x7f11b4102910 2023-07-14T13:15:37.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.159+0000 7f11aaffd700 1 -- 172.21.15.17:0/1267257737 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f11a40051c0 con 0x7f11b4102910 2023-07-14T13:15:37.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.160+0000 7f11cfa57b80 1 Processor -- start 2023-07-14T13:15:37.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.160+0000 7f11cfa57b80 1 -- start start 2023-07-14T13:15:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.161+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b558862d0 0x557b558866a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.161+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.161+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 0x557b55893eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.161+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5578ccb0 con 0x557b55886be0 2023-07-14T13:15:37.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.161+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b557dfa40 con 0x557b55891ad0 2023-07-14T13:15:37.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.161+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b557d8ed0 con 0x557b558862d0 2023-07-14T13:15:37.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.161+0000 7f11b979a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 0x557b55893eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.161+0000 7f11b9f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.161+0000 7f11ba79c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b558862d0 0x557b558866a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.161+0000 7f11b9f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51398/0 (socket says 172.21.15.17:51398) 2023-07-14T13:15:37.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.161+0000 7f11b9f9b700 1 -- 172.21.15.17:0/866883641 learned_addr learned my addr 172.21.15.17:0/866883641 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:37.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.162+0000 7f11b9f9b700 1 -- 172.21.15.17:0/866883641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b558862d0 msgr2=0x557b558866a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:37.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.162+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/866883641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b558862d0 0x557b558866a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.162+0000 7f11b9f9b700 1 -- 172.21.15.17:0/866883641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 msgr2=0x557b55893eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:37.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.162+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/866883641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 0x557b55893eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.162+0000 7f11b9f9b700 1 -- 172.21.15.17:0/866883641 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b55606de0 con 0x557b55886be0 2023-07-14T13:15:37.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.162+0000 7f11b979a700 1 --2- 172.21.15.17:0/866883641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 0x557b55893eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:37.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.162+0000 7f11aaffd700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11a00a12c0 0x7f11a00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.162+0000 7f11aaffd700 1 -- 172.21.15.17:0/1267257737 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f11a40cd9f0 con 0x7f11b4102910 2023-07-14T13:15:37.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.162+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/866883641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891590 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009f10 tx=0x7f11b0011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7645bea5e0f612f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:37.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.162+0000 7f11ba79c700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11a00a12c0 0x7f11a00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.163+0000 7f119ffff700 1 -- 172.21.15.17:0/866883641 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0019630 con 0x557b55886be0 2023-07-14T13:15:37.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.163+0000 7f119ffff700 1 -- 172.21.15.17:0/866883641 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11b0019c20 con 0x557b55886be0 2023-07-14T13:15:37.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.163+0000 7f119ffff700 1 -- 172.21.15.17:0/866883641 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b000eba0 con 0x557b55886be0 2023-07-14T13:15:37.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.163+0000 7f11cfa57b80 1 -- 172.21.15.17:0/866883641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 msgr2=0x557b55891590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:37.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.163+0000 7f11ba79c700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11a00a12c0 0x7f11a00a3770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009710 tx=0x7f11ac009100 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:37.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.163+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/866883641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891590 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009f10 tx=0x7f11b0011720 comp rx=0 tx=0).stop 2023-07-14T13:15:37.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.164+0000 7f11cfa57b80 1 -- 172.21.15.17:0/866883641 shutdown_connections 2023-07-14T13:15:37.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.164+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/866883641 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 0x557b55893eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.164+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/866883641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b558862d0 0x557b558866a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.164+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/866883641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891590 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.164+0000 7f11cfa57b80 1 -- 172.21.15.17:0/866883641 >> 172.21.15.17:0/866883641 conn(0x557b5587cda0 msgr2=0x557b558826a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:37.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.164+0000 7f11cfa57b80 1 -- 172.21.15.17:0/866883641 shutdown_connections 2023-07-14T13:15:37.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.164+0000 7f11cfa57b80 1 -- 172.21.15.17:0/866883641 wait complete. 2023-07-14T13:15:37.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.164+0000 7f11cfa57b80 1 -- start start 2023-07-14T13:15:37.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11cfa57b80 1 Processor -- start 2023-07-14T13:15:37.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 0x557b55891490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b55886be0 0x557b5588e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55891ad0 0x557b5588ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b55778ac0 con 0x557b55891ad0 2023-07-14T13:15:37.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b557787c0 con 0x557b558862d0 2023-07-14T13:15:37.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5565c920 con 0x557b55886be0 2023-07-14T13:15:37.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11cfa57b80 10 client.0 _ll_register_callbacks cb 0x557b55776760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:37.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11b9f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 0x557b55891490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11b9f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 0x557b55891490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57308/0 (socket says 172.21.15.17:57308) 2023-07-14T13:15:37.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11b9f9b700 1 -- 172.21.15.17:0/231505598 learned_addr learned my addr 172.21.15.17:0/231505598 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:37.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.165+0000 7f11ba79c700 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55891ad0 0x557b5588ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.166+0000 7f11b979a700 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b55886be0 0x557b5588e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.166+0000 7f11b9f9b700 1 -- 172.21.15.17:0/231505598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b55886be0 msgr2=0x557b5588e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:37.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.166+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b55886be0 0x557b5588e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.166+0000 7f11b9f9b700 1 -- 172.21.15.17:0/231505598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55891ad0 msgr2=0x557b5588ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:37.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.166+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55891ad0 0x557b5588ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.166+0000 7f11b9f9b700 1 -- 172.21.15.17:0/231505598 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b419d5a0 con 0x557b558862d0 2023-07-14T13:15:37.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.166+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 0x557b55891490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f11b000e7c0 tx=0x7f11b000ea50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8270c2bee84217e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:37.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.166+0000 7f119d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:15:37.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.167+0000 7f119d7fa700 1 -- 172.21.15.17:0/231505598 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b001ae10 con 0x557b558862d0 2023-07-14T13:15:37.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.167+0000 7f11cfa57b80 1 -- 172.21.15.17:0/231505598 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b557324f0 con 0x557b558862d0 2023-07-14T13:15:37.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.167+0000 7f119d7fa700 1 -- 172.21.15.17:0/231505598 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f11b0004030 con 0x557b558862d0 2023-07-14T13:15:37.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.167+0000 7f119d7fa700 1 -- 172.21.15.17:0/231505598 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11b00041f0 con 0x557b558862d0 2023-07-14T13:15:37.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.167+0000 7f11cfa57b80 10 client.27812 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:37.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.167+0000 7f11cfa57b80 1 -- 172.21.15.17:0/231505598 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7f11b0009b70 con 0x557b558862d0 2023-07-14T13:15:37.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.168+0000 7f119d7fa700 1 -- 172.21.15.17:0/231505598 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557b557324f0 con 0x557b558862d0 2023-07-14T13:15:37.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.168+0000 7f119d7fa700 1 -- 172.21.15.17:0/231505598 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f11b0005160 con 0x557b558862d0 2023-07-14T13:15:37.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.168+0000 7f11cfa57b80 10 client.27812 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:37.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.168+0000 7f11cfa57b80 10 client.27812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:37.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.168+0000 7f11cfa57b80 20 client.27812 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:37.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.168+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557b558a12f0 0x557b558a3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.168+0000 7f11cfa57b80 4 client.27812 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:37.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.168+0000 7f11cfa57b80 1 -- 172.21.15.17:0/231505598 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b557d1eb0 con 0x557b558a12f0 2023-07-14T13:15:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.168+0000 7f11b979a700 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557b558a12f0 0x557b558a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.169+0000 7f11b979a700 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557b558a12f0 0x557b558a3700 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=453e785d7ba7f127 server_cookie=aaba736b42f7da3e in_seq=0 out_seq=0 2023-07-14T13:15:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.169+0000 7f119d7fa700 10 client.27812 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.169+0000 7f119d7fa700 1 -- 172.21.15.17:0/231505598 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557b557d1eb0 con 0x557b558a12f0 2023-07-14T13:15:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f119d7fa700 10 client.27812 handle_command_reply: tid=0 2023-07-14T13:15:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f11cfa57b80 1 client.27812 shutdown 2023-07-14T13:15:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f11cfa57b80 1 -- 172.21.15.17:0/231505598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 msgr2=0x557b55891490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:37.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 0x557b55891490 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f11b000e7c0 tx=0x7f11b000ea50 comp rx=0 tx=0).stop 2023-07-14T13:15:37.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f11cfa57b80 1 -- 172.21.15.17:0/231505598 shutdown_connections 2023-07-14T13:15:37.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557b558a12f0 0x557b558a3700 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55891ad0 0x557b5588ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 0x557b55891490 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/231505598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b55886be0 0x557b5588e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f119d7fa700 0 client.27812 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:37.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f11cfa57b80 1 -- 172.21.15.17:0/231505598 >> 172.21.15.17:0/231505598 conn(0x557b5587cda0 msgr2=0x557b55882230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f11cfa57b80 1 -- 172.21.15.17:0/231505598 shutdown_connections 2023-07-14T13:15:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.170+0000 7f11cfa57b80 1 -- 172.21.15.17:0/231505598 wait complete. 2023-07-14T13:15:37.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.171+0000 7f11cfa57b80 20 client.27812 trim_cache size 0 max 16384 2023-07-14T13:15:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.186+0000 7f11cfa57b80 1 Processor -- start 2023-07-14T13:15:37.225 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.186+0000 7f11cfa57b80 1 -- start start 2023-07-14T13:15:37.226 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.187+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b558862d0 0x557b558984f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.187+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.187+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 0x557b55889a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.187+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b55887db0 con 0x557b55886be0 2023-07-14T13:15:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.187+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b55887570 con 0x557b55891ad0 2023-07-14T13:15:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.187+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b55886a20 con 0x557b558862d0 2023-07-14T13:15:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.187+0000 7f11b979a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.187+0000 7f11b979a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51408/0 (socket says 172.21.15.17:51408) 2023-07-14T13:15:37.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.187+0000 7f11b979a700 1 -- 172.21.15.17:0/978250097 learned_addr learned my addr 172.21.15.17:0/978250097 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:37.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.187+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/978250097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b558862d0 0x557b558984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.188+0000 7f11ba79c700 1 --2- 172.21.15.17:0/978250097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 0x557b55889a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.188+0000 7f11b979a700 1 -- 172.21.15.17:0/978250097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b558862d0 msgr2=0x557b558984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:37.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.188+0000 7f11b979a700 1 --2- 172.21.15.17:0/978250097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b558862d0 0x557b558984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.188+0000 7f11b979a700 1 -- 172.21.15.17:0/978250097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 msgr2=0x557b55889a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:37.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.188+0000 7f11b979a700 1 --2- 172.21.15.17:0/978250097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 0x557b55889a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.188+0000 7f11b979a700 1 -- 172.21.15.17:0/978250097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b555efc60 con 0x557b55886be0 2023-07-14T13:15:37.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.188+0000 7f11ba79c700 1 --2- 172.21.15.17:0/978250097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 0x557b55889a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:15:37.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.188+0000 7f11b979a700 1 --2- 172.21.15.17:0/978250097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891030 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f11a40975e0 tx=0x7f11a40d1500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a62a45ddad77ed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:37.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.188+0000 7f11a8ff9700 1 -- 172.21.15.17:0/978250097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a409a940 con 0x557b55886be0 2023-07-14T13:15:37.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.188+0000 7f11a8ff9700 1 -- 172.21.15.17:0/978250097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11a409a6b0 con 0x557b55886be0 2023-07-14T13:15:37.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.188+0000 7f11a8ff9700 1 -- 172.21.15.17:0/978250097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a40054a0 con 0x557b55886be0 2023-07-14T13:15:37.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.189+0000 7f11cfa57b80 1 -- 172.21.15.17:0/978250097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 msgr2=0x557b55891030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:37.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.189+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/978250097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891030 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f11a40975e0 tx=0x7f11a40d1500 comp rx=0 tx=0).stop 2023-07-14T13:15:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.189+0000 7f11cfa57b80 1 -- 172.21.15.17:0/978250097 shutdown_connections 2023-07-14T13:15:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.189+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/978250097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b55891ad0 0x557b55889a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.189+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/978250097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b558862d0 0x557b558984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.189+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/978250097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b55891030 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.189+0000 7f11cfa57b80 1 -- 172.21.15.17:0/978250097 >> 172.21.15.17:0/978250097 conn(0x557b5587cda0 msgr2=0x557b5589d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.189+0000 7f11cfa57b80 1 -- 172.21.15.17:0/978250097 shutdown_connections 2023-07-14T13:15:37.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.189+0000 7f11cfa57b80 1 -- 172.21.15.17:0/978250097 wait complete. 2023-07-14T13:15:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.190+0000 7f11cfa57b80 1 -- start start 2023-07-14T13:15:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.190+0000 7f11cfa57b80 1 Processor -- start 2023-07-14T13:15:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 0x557b558e9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b558e9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11cfa57b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b55891ad0 0x557b558f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b558e9f30 con 0x557b55886be0 2023-07-14T13:15:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b558f46e0 con 0x557b558862d0 2023-07-14T13:15:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11cfa57b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b558f4820 con 0x557b55891ad0 2023-07-14T13:15:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11cfa57b80 10 client.0 _ll_register_callbacks cb 0x7f11a40d13d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11b979a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b558e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11b979a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b558e9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51412/0 (socket says 172.21.15.17:51412) 2023-07-14T13:15:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11b979a700 1 -- 172.21.15.17:0/1894019231 learned_addr learned my addr 172.21.15.17:0/1894019231 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 0x557b558e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11ba79c700 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b55891ad0 0x557b558f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11b9f9b700 1 -- 172.21.15.17:0/1894019231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b55891ad0 msgr2=0x557b558f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b55891ad0 0x557b558f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11b9f9b700 1 -- 172.21.15.17:0/1894019231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 msgr2=0x557b558e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b558e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11b9f9b700 1 -- 172.21.15.17:0/1894019231 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a40095f0 con 0x557b558862d0 2023-07-14T13:15:37.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.191+0000 7f11b979a700 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b558e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:37.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.192+0000 7f11b9f9b700 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 0x557b558e9120 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f11b0000be0 tx=0x7f11b0009e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba062bd6ee3a7d27 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:37.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.192+0000 7f119d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:15:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.192+0000 7f119d7fa700 1 -- 172.21.15.17:0/1894019231 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0009370 con 0x557b558862d0 2023-07-14T13:15:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.192+0000 7f119d7fa700 1 -- 172.21.15.17:0/1894019231 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f11b0000e40 con 0x557b558862d0 2023-07-14T13:15:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.192+0000 7f11cfa57b80 1 -- 172.21.15.17:0/1894019231 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11b0019c20 con 0x557b558862d0 2023-07-14T13:15:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.192+0000 7f119d7fa700 1 -- 172.21.15.17:0/1894019231 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11b0019430 con 0x557b558862d0 2023-07-14T13:15:37.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.192+0000 7f11cfa57b80 10 client.27815 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:37.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.192+0000 7f11cfa57b80 1 -- 172.21.15.17:0/1894019231 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x557b5562d250 con 0x557b558862d0 2023-07-14T13:15:37.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.193+0000 7f119d7fa700 1 -- 172.21.15.17:0/1894019231 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11b0019c20 con 0x557b558862d0 2023-07-14T13:15:37.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.193+0000 7f119d7fa700 1 -- 172.21.15.17:0/1894019231 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f11b00345d0 con 0x557b558862d0 2023-07-14T13:15:37.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.193+0000 7f11cfa57b80 10 client.27815 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:37.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.193+0000 7f11cfa57b80 10 client.27815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:37.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.193+0000 7f11cfa57b80 20 client.27815 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:37.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.193+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557b558f5a00 0x557b558f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:37.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.193+0000 7f11cfa57b80 4 client.27815 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:15:37.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.193+0000 7f11cfa57b80 1 -- 172.21.15.17:0/1894019231 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557b55794050 con 0x557b558f5a00 2023-07-14T13:15:37.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.194+0000 7f11b979a700 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557b558f5a00 0x557b558f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:37.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.194+0000 7f11b979a700 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557b558f5a00 0x557b558f7e10 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1acece3a134fa7ea server_cookie=6a6754d2a247f1bc in_seq=0 out_seq=0 2023-07-14T13:15:37.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.194+0000 7f119d7fa700 10 client.27815 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:37.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.194+0000 7f119d7fa700 1 -- 172.21.15.17:0/1894019231 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557b55794050 con 0x557b558f5a00 2023-07-14T13:15:37.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f119d7fa700 10 client.27815 handle_command_reply: tid=0 2023-07-14T13:15:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 1 client.27815 shutdown 2023-07-14T13:15:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 1 -- 172.21.15.17:0/1894019231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 msgr2=0x557b558e9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 0x557b558e9120 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f11b0000be0 tx=0x7f11b0009e40 comp rx=0 tx=0).stop 2023-07-14T13:15:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 1 -- 172.21.15.17:0/1894019231 shutdown_connections 2023-07-14T13:15:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557b558f5a00 0x557b558f7e10 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b55891ad0 0x557b558f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b558862d0 0x557b558e9120 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f119d7fa700 0 client.27815 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 1 --2- 172.21.15.17:0/1894019231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557b55886be0 0x557b558e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 1 -- 172.21.15.17:0/1894019231 >> 172.21.15.17:0/1894019231 conn(0x557b5587cda0 msgr2=0x557b55889a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 1 -- 172.21.15.17:0/1894019231 shutdown_connections 2023-07-14T13:15:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 1 -- 172.21.15.17:0/1894019231 wait complete. 2023-07-14T13:15:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.195+0000 7f11cfa57b80 20 client.27815 trim_cache size 0 max 16384 2023-07-14T13:15:37.245 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:15:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1267257737 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11a00a12c0 msgr2=0x7f11a00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:37.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11a00a12c0 0x7f11a00a3770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009710 tx=0x7f11ac009100 comp rx=0 tx=0).stop 2023-07-14T13:15:37.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1267257737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11b4102910 msgr2=0x7f11b41982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:37.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11b4102910 0x7f11b41982c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f11a4000c00 tx=0x7f11a400f690 comp rx=0 tx=0).stop 2023-07-14T13:15:37.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1267257737 shutdown_connections 2023-07-14T13:15:37.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11a00a12c0 0x7f11a00a3770 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f11b4106fb0 0x7f11b419c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11b4101f70 0x7f11b4197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 --2- 172.21.15.17:0/1267257737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11b4102910 0x7f11b41982c0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:37.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1267257737 >> 172.21.15.17:0/1267257737 conn(0x7f11b40fd7e0 msgr2=0x7f11b40fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:37.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1267257737 shutdown_connections 2023-07-14T13:15:37.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:37.196+0000 7f11bc1ff700 1 -- 172.21.15.17:0/1267257737 wait complete. 2023-07-14T13:15:37.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:37 smithi017 ceph-mon[95536]: pgmap v499: 97 pgs: 97 active+clean; 14 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 24 op/s 2023-07-14T13:15:37.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:37 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1645046908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:15:37.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:37 smithi135 ceph-mon[97338]: pgmap v499: 97 pgs: 97 active+clean; 14 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 24 op/s 2023-07-14T13:15:37.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:37 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1645046908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:15:37.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:37 smithi131 ceph-mon[96953]: pgmap v499: 97 pgs: 97 active+clean; 14 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 24 op/s 2023-07-14T13:15:37.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:37 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1645046908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:15:38.255 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:15:38.256 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:15:38.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.450+0000 7fd6aefff700 1 -- 172.21.15.17:0/3207304852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6a80ffad0 msgr2=0x7fd6a80fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.450+0000 7fd6aefff700 1 --2- 172.21.15.17:0/3207304852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6a80ffad0 0x7fd6a80fff40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd694009990 tx=0x7fd694009ca0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.451+0000 7fd6aefff700 1 -- 172.21.15.17:0/3207304852 shutdown_connections 2023-07-14T13:15:38.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.451+0000 7fd6aefff700 1 --2- 172.21.15.17:0/3207304852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a8100480 0x7fd6a810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.451+0000 7fd6aefff700 1 --2- 172.21.15.17:0/3207304852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a8105ae0 0x7fd6a8105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.451+0000 7fd6aefff700 1 --2- 172.21.15.17:0/3207304852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6a80ffad0 0x7fd6a80fff40 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.451+0000 7fd6aefff700 1 -- 172.21.15.17:0/3207304852 >> 172.21.15.17:0/3207304852 conn(0x7fd6a80fb5f0 msgr2=0x7fd6a80fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.451+0000 7fd6aefff700 1 -- 172.21.15.17:0/3207304852 shutdown_connections 2023-07-14T13:15:38.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.451+0000 7fd6aefff700 1 -- 172.21.15.17:0/3207304852 wait complete. 2023-07-14T13:15:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.452+0000 7fd6aefff700 1 Processor -- start 2023-07-14T13:15:38.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.452+0000 7fd6aefff700 1 -- start start 2023-07-14T13:15:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.453+0000 7fd6aefff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6a80ffad0 0x7fd6a8197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.453+0000 7fd6aefff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a8100480 0x7fd6a81982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.453+0000 7fd6aefff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a8105ae0 0x7fd6a819c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.453+0000 7fd6aefff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a819cd60 con 0x7fd6a80ffad0 2023-07-14T13:15:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.453+0000 7fd6aefff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a819ced0 con 0x7fd6a8105ae0 2023-07-14T13:15:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.453+0000 7fd6aefff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a819d090 con 0x7fd6a8100480 2023-07-14T13:15:38.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.453+0000 7fd6acd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6a80ffad0 0x7fd6a8197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.453+0000 7fd6acd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6a80ffad0 0x7fd6a8197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51434/0 (socket says 172.21.15.17:51434) 2023-07-14T13:15:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.453+0000 7fd6acd9b700 1 -- 172.21.15.17:0/3830930673 learned_addr learned my addr 172.21.15.17:0/3830930673 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.453+0000 7fd6a7fff700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a8100480 0x7fd6a81982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.453+0000 7fd6ad59c700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a8105ae0 0x7fd6a819c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.454+0000 7fd6acd9b700 1 -- 172.21.15.17:0/3830930673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a8100480 msgr2=0x7fd6a81982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.454+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a8100480 0x7fd6a81982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.454+0000 7fd6acd9b700 1 -- 172.21.15.17:0/3830930673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a8105ae0 msgr2=0x7fd6a819c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.454+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a8105ae0 0x7fd6a819c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.454+0000 7fd6acd9b700 1 -- 172.21.15.17:0/3830930673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6940095f0 con 0x7fd6a80ffad0 2023-07-14T13:15:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.454+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6a80ffad0 0x7fd6a8197d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00e9a0 tx=0x7fd69c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.454+0000 7fd6a5ffb700 1 -- 172.21.15.17:0/3830930673 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c009790 con 0x7fd6a80ffad0 2023-07-14T13:15:38.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.454+0000 7fd6aefff700 1 -- 172.21.15.17:0/3830930673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a819d370 con 0x7fd6a80ffad0 2023-07-14T13:15:38.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.454+0000 7fd6a5ffb700 1 -- 172.21.15.17:0/3830930673 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd69c010430 con 0x7fd6a80ffad0 2023-07-14T13:15:38.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.454+0000 7fd6a5ffb700 1 -- 172.21.15.17:0/3830930673 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c00cea0 con 0x7fd6a80ffad0 2023-07-14T13:15:38.502 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.454+0000 7fd6aefff700 1 -- 172.21.15.17:0/3830930673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a81a4bb0 con 0x7fd6a80ffad0 2023-07-14T13:15:38.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.458+0000 7fd6a5ffb700 1 -- 172.21.15.17:0/3830930673 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd69c0105a0 con 0x7fd6a80ffad0 2023-07-14T13:15:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.460+0000 7fd6c28e5b80 1 Processor -- start 2023-07-14T13:15:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.460+0000 7fd6c28e5b80 1 -- start start 2023-07-14T13:15:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.460+0000 7fd6a5ffb700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd6980a12c0 0x7fd6980a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.460+0000 7fd6a5ffb700 1 -- 172.21.15.17:0/3830930673 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd69c014070 con 0x7fd6a80ffad0 2023-07-14T13:15:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.460+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5350 0x55effd3c5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.460+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5c60 0x55effd3d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.460+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3d0b50 0x55effd3d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.460+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd2cbd30 con 0x55effd3c5350 2023-07-14T13:15:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.460+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd31eac0 con 0x55effd3c5c60 2023-07-14T13:15:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.460+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd317f50 con 0x55effd3d0b50 2023-07-14T13:15:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6ad59c700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd6980a12c0 0x7fd6980a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6acd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5350 0x55effd3c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6acd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5350 0x55effd3c5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51450/0 (socket says 172.21.15.17:51450) 2023-07-14T13:15:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6acd9b700 1 -- 172.21.15.17:0/2788421604 learned_addr learned my addr 172.21.15.17:0/2788421604 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6a7fff700 1 --2- 172.21.15.17:0/2788421604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5c60 0x55effd3d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6ad59c700 1 --2- 172.21.15.17:0/2788421604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3d0b50 0x55effd3d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6acd9b700 1 -- 172.21.15.17:0/2788421604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3d0b50 msgr2=0x55effd3d2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/2788421604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3d0b50 0x55effd3d2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6acd9b700 1 -- 172.21.15.17:0/2788421604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5c60 msgr2=0x55effd3d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/2788421604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5c60 0x55effd3d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6acd9b700 1 -- 172.21.15.17:0/2788421604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55effd145e60 con 0x55effd3c5350 2023-07-14T13:15:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.461+0000 7fd6ad59c700 1 --2- 172.21.15.17:0/2788421604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3d0b50 0x55effd3d2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:15:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.462+0000 7fd6ad59c700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd6980a12c0 0x7fd6980a3770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0003f20 tx=0x7fd6a0009ba0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.462+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/2788421604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5350 0x55effd3c5720 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0969d0 tx=0x7fd69c099940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a981c608692764 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.462+0000 7fd692ffd700 1 -- 172.21.15.17:0/2788421604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c09df90 con 0x55effd3c5350 2023-07-14T13:15:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.462+0000 7fd692ffd700 1 -- 172.21.15.17:0/2788421604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd69c0a23b0 con 0x55effd3c5350 2023-07-14T13:15:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.462+0000 7fd692ffd700 1 -- 172.21.15.17:0/2788421604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0a1f20 con 0x55effd3c5350 2023-07-14T13:15:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.463+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2788421604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5350 msgr2=0x55effd3c5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.463+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/2788421604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5350 0x55effd3c5720 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0969d0 tx=0x7fd69c099940 comp rx=0 tx=0).stop 2023-07-14T13:15:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.463+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2788421604 shutdown_connections 2023-07-14T13:15:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.463+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/2788421604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3d0b50 0x55effd3d2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.463+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/2788421604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5350 0x55effd3c5720 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.463+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/2788421604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5c60 0x55effd3d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.463+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2788421604 >> 172.21.15.17:0/2788421604 conn(0x55effd3bbe20 msgr2=0x55effd3c1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.463+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2788421604 shutdown_connections 2023-07-14T13:15:38.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.463+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2788421604 wait complete. 2023-07-14T13:15:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.463+0000 7fd6c28e5b80 1 -- start start 2023-07-14T13:15:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.464+0000 7fd6c28e5b80 1 Processor -- start 2023-07-14T13:15:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.464+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5350 0x55effd3d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.464+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.464+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3d0b50 0x55effd3cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.464+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd2b7b40 con 0x55effd3c5c60 2023-07-14T13:15:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.464+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd2b7840 con 0x55effd3d0b50 2023-07-14T13:15:38.511 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.464+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd19b9a0 con 0x55effd3c5350 2023-07-14T13:15:38.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.465+0000 7fd6c28e5b80 10 client.0 _ll_register_callbacks cb 0x55effd2b57e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:38.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.465+0000 7fd6a7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.465+0000 7fd6a7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51456/0 (socket says 172.21.15.17:51456) 2023-07-14T13:15:38.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.465+0000 7fd6a7fff700 1 -- 172.21.15.17:0/465518837 learned_addr learned my addr 172.21.15.17:0/465518837 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:38.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.465+0000 7fd6ad59c700 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3d0b50 0x55effd3cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.465+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5350 0x55effd3d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.465+0000 7fd6a7fff700 1 -- 172.21.15.17:0/465518837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5350 msgr2=0x55effd3d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.465+0000 7fd6a7fff700 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5350 0x55effd3d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.465+0000 7fd6a7fff700 1 -- 172.21.15.17:0/465518837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3d0b50 msgr2=0x55effd3cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.465+0000 7fd6a7fff700 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3d0b50 0x55effd3cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.465+0000 7fd6a7fff700 1 -- 172.21.15.17:0/465518837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a81a4bb0 con 0x55effd3c5c60 2023-07-14T13:15:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.466+0000 7fd6a7fff700 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cd810 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd694005910 tx=0x7fd694005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62200938c1fc40ba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.466+0000 7fd687fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:15:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.466+0000 7fd687fff700 1 -- 172.21.15.17:0/465518837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69401d070 con 0x55effd3c5c60 2023-07-14T13:15:38.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.466+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/465518837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55effd271570 con 0x55effd3c5c60 2023-07-14T13:15:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.466+0000 7fd687fff700 1 -- 172.21.15.17:0/465518837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd694004500 con 0x55effd3c5c60 2023-07-14T13:15:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.466+0000 7fd687fff700 1 -- 172.21.15.17:0/465518837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6940046c0 con 0x55effd3c5c60 2023-07-14T13:15:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.466+0000 7fd6c28e5b80 10 client.18111 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:38.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.466+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/465518837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55effd12ece0 con 0x55effd3c5c60 2023-07-14T13:15:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.467+0000 7fd687fff700 1 -- 172.21.15.17:0/465518837 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55effd271570 con 0x55effd3c5c60 2023-07-14T13:15:38.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.467+0000 7fd687fff700 1 -- 172.21.15.17:0/465518837 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd69400f7f0 con 0x55effd3c5c60 2023-07-14T13:15:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.467+0000 7fd6c28e5b80 10 client.18111 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.467+0000 7fd6c28e5b80 10 client.18111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.467+0000 7fd6c28e5b80 20 client.18111 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.467+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55effd3e04b0 0x55effd3e28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.467+0000 7fd6c28e5b80 4 client.18111 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.467+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/465518837 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55effd310f30 con 0x55effd3e04b0 2023-07-14T13:15:38.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.467+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55effd3e04b0 0x55effd3e28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.468+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55effd3e04b0 0x55effd3e28c0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfc2ba76d3b84169 server_cookie=b33f3392a7aba4e6 in_seq=0 out_seq=0 2023-07-14T13:15:38.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.468+0000 7fd687fff700 10 client.18111 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:38.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd687fff700 1 -- 172.21.15.17:0/465518837 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55effd310f30 con 0x55effd3e04b0 2023-07-14T13:15:38.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd687fff700 10 client.18111 handle_command_reply: tid=0 2023-07-14T13:15:38.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd6c28e5b80 1 client.18111 shutdown 2023-07-14T13:15:38.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/465518837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 msgr2=0x55effd3cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cd810 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd694005910 tx=0x7fd694005a90 comp rx=0 tx=0).stop 2023-07-14T13:15:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/465518837 shutdown_connections 2023-07-14T13:15:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55effd3e04b0 0x55effd3e28c0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3d0b50 0x55effd3cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5350 0x55effd3d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd687fff700 0 client.18111 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/465518837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cd810 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/465518837 >> 172.21.15.17:0/465518837 conn(0x55effd3bbe20 msgr2=0x55effd3c1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/465518837 shutdown_connections 2023-07-14T13:15:38.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.469+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/465518837 wait complete. 2023-07-14T13:15:38.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.470+0000 7fd6c28e5b80 20 client.18111 trim_cache size 0 max 16384 2023-07-14T13:15:38.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.488+0000 7fd6c28e5b80 1 Processor -- start 2023-07-14T13:15:38.527 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.488+0000 7fd6c28e5b80 1 -- start start 2023-07-14T13:15:38.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.488+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5350 0x55effd3d7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.488+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.488+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3d0b50 0x55effd3ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.488+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd3c6ef0 con 0x55effd3c5c60 2023-07-14T13:15:38.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.488+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd3c2360 con 0x55effd3d0b50 2023-07-14T13:15:38.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.488+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd3c2d80 con 0x55effd3c5350 2023-07-14T13:15:38.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.489+0000 7fd6a7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.489+0000 7fd6a7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51468/0 (socket says 172.21.15.17:51468) 2023-07-14T13:15:38.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.489+0000 7fd6a7fff700 1 -- 172.21.15.17:0/4202433886 learned_addr learned my addr 172.21.15.17:0/4202433886 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:38.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.489+0000 7fd6ad59c700 1 --2- 172.21.15.17:0/4202433886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3d0b50 0x55effd3ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.489+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/4202433886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5350 0x55effd3d7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.489+0000 7fd6a7fff700 1 -- 172.21.15.17:0/4202433886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5350 msgr2=0x55effd3d7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.489+0000 7fd6a7fff700 1 --2- 172.21.15.17:0/4202433886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5350 0x55effd3d7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.489+0000 7fd6a7fff700 1 -- 172.21.15.17:0/4202433886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3d0b50 msgr2=0x55effd3ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.489+0000 7fd6a7fff700 1 --2- 172.21.15.17:0/4202433886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3d0b50 0x55effd3ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.489+0000 7fd6a7fff700 1 -- 172.21.15.17:0/4202433886 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55effd3bd660 con 0x55effd3c5c60 2023-07-14T13:15:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.490+0000 7fd6a7fff700 1 --2- 172.21.15.17:0/4202433886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cf830 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd694006010 tx=0x7fd69400b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c1b75002cfb0a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.490+0000 7fd6937fe700 1 -- 172.21.15.17:0/4202433886 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69401d030 con 0x55effd3c5c60 2023-07-14T13:15:38.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.490+0000 7fd6937fe700 1 -- 172.21.15.17:0/4202433886 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd69401e040 con 0x55effd3c5c60 2023-07-14T13:15:38.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.490+0000 7fd6937fe700 1 -- 172.21.15.17:0/4202433886 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6940238a0 con 0x55effd3c5c60 2023-07-14T13:15:38.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.491+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/4202433886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 msgr2=0x55effd3cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.491+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/4202433886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cf830 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd694006010 tx=0x7fd69400b310 comp rx=0 tx=0).stop 2023-07-14T13:15:38.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.491+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/4202433886 shutdown_connections 2023-07-14T13:15:38.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.491+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/4202433886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3d0b50 0x55effd3ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.491+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/4202433886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5350 0x55effd3d7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.491+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/4202433886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3c5c60 0x55effd3cf830 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.491+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/4202433886 >> 172.21.15.17:0/4202433886 conn(0x55effd3bbe20 msgr2=0x55effd3cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.491+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/4202433886 shutdown_connections 2023-07-14T13:15:38.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.491+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/4202433886 wait complete. 2023-07-14T13:15:38.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.491+0000 7fd6c28e5b80 1 -- start start 2023-07-14T13:15:38.533 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.492+0000 7fd6c28e5b80 1 Processor -- start 2023-07-14T13:15:38.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.492+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5350 0x55effd3d5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.492+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5c60 0x55effd3d60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.492+0000 7fd6c28e5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3d0b50 0x55effd3d6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.492+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd434340 con 0x55effd3d0b50 2023-07-14T13:15:38.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.492+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd434480 con 0x55effd3c5350 2023-07-14T13:15:38.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.492+0000 7fd6c28e5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effd4345c0 con 0x55effd3c5c60 2023-07-14T13:15:38.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.492+0000 7fd6c28e5b80 10 client.0 _ll_register_callbacks cb 0x7fd694005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:38.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6ad59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3d0b50 0x55effd3d6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6acd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5350 0x55effd3d5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6acd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5350 0x55effd3d5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57354/0 (socket says 172.21.15.17:57354) 2023-07-14T13:15:38.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6acd9b700 1 -- 172.21.15.17:0/2935807013 learned_addr learned my addr 172.21.15.17:0/2935807013 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:38.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6a7fff700 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5c60 0x55effd3d60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6acd9b700 1 -- 172.21.15.17:0/2935807013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5c60 msgr2=0x55effd3d60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5c60 0x55effd3d60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6acd9b700 1 -- 172.21.15.17:0/2935807013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3d0b50 msgr2=0x55effd3d6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3d0b50 0x55effd3d6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6acd9b700 1 -- 172.21.15.17:0/2935807013 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55effd12ece0 con 0x55effd3c5350 2023-07-14T13:15:38.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6ad59c700 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3d0b50 0x55effd3d6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:38.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd6acd9b700 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5350 0x55effd3d5bb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00c2d0 tx=0x7fd69c010880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3e786063a857b3b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.493+0000 7fd687fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:15:38.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd687fff700 1 -- 172.21.15.17:0/2935807013 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0b8220 con 0x55effd3c5350 2023-07-14T13:15:38.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd687fff700 1 -- 172.21.15.17:0/2935807013 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd69c09a1c0 con 0x55effd3c5350 2023-07-14T13:15:38.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2935807013 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd69c0a23b0 con 0x55effd3c5350 2023-07-14T13:15:38.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd687fff700 1 -- 172.21.15.17:0/2935807013 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd69c0b8380 con 0x55effd3c5350 2023-07-14T13:15:38.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd6c28e5b80 10 client.27833 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:38.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2935807013 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55effd16c2d0 con 0x55effd3c5350 2023-07-14T13:15:38.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd687fff700 1 -- 172.21.15.17:0/2935807013 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd69c0a23b0 con 0x55effd3c5350 2023-07-14T13:15:38.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd687fff700 1 -- 172.21.15.17:0/2935807013 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd69c0ca240 con 0x55effd3c5350 2023-07-14T13:15:38.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd6c28e5b80 10 client.27833 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:38.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd6c28e5b80 10 client.27833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:38.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd6c28e5b80 20 client.27833 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:38.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55effd435990 0x55effd437da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd6c28e5b80 4 client.27833 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:15:38.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.494+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2935807013 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55effd2d30d0 con 0x55effd435990 2023-07-14T13:15:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.495+0000 7fd6a7fff700 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55effd435990 0x55effd437da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.496+0000 7fd687fff700 10 client.27833 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.496+0000 7fd6a7fff700 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55effd435990 0x55effd437da0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3858a6a126e58c48 server_cookie=ff41f5a509c88a4f in_seq=0 out_seq=0 2023-07-14T13:15:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.496+0000 7fd687fff700 1 -- 172.21.15.17:0/2935807013 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55effd2d30d0 con 0x55effd435990 2023-07-14T13:15:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.496+0000 7fd687fff700 10 client.27833 handle_command_reply: tid=0 2023-07-14T13:15:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.496+0000 7fd6c28e5b80 1 client.27833 shutdown 2023-07-14T13:15:38.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2935807013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5350 msgr2=0x55effd3d5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5350 0x55effd3d5bb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00c2d0 tx=0x7fd69c010880 comp rx=0 tx=0).stop 2023-07-14T13:15:38.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2935807013 shutdown_connections 2023-07-14T13:15:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55effd435990 0x55effd437da0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd687fff700 0 client.27833 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55effd3d0b50 0x55effd3d6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55effd3c5350 0x55effd3d5bb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd6c28e5b80 1 --2- 172.21.15.17:0/2935807013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd3c5c60 0x55effd3d60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2935807013 >> 172.21.15.17:0/2935807013 conn(0x55effd3bbe20 msgr2=0x55effd3cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2935807013 shutdown_connections 2023-07-14T13:15:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd6c28e5b80 1 -- 172.21.15.17:0/2935807013 wait complete. 2023-07-14T13:15:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.497+0000 7fd6c28e5b80 20 client.27833 trim_cache size 0 max 16384 2023-07-14T13:15:38.544 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:15:38.544 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:15:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "1aa7f1a4-41ec-441c-9e37-f4775383a2a3", 2023-07-14T13:15:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:15:38.545 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:15:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 -- 172.21.15.17:0/3830930673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd6980a12c0 msgr2=0x7fd6980a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd6980a12c0 0x7fd6980a3770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0003f20 tx=0x7fd6a0009ba0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 -- 172.21.15.17:0/3830930673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6a80ffad0 msgr2=0x7fd6a8197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6a80ffad0 0x7fd6a8197d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00e9a0 tx=0x7fd69c00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 -- 172.21.15.17:0/3830930673 shutdown_connections 2023-07-14T13:15:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd6980a12c0 0x7fd6980a3770 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6a8105ae0 0x7fd6a819c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6a80ffad0 0x7fd6a8197d80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 --2- 172.21.15.17:0/3830930673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6a8100480 0x7fd6a81982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 -- 172.21.15.17:0/3830930673 >> 172.21.15.17:0/3830930673 conn(0x7fd6a80fb5f0 msgr2=0x7fd6a80fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 -- 172.21.15.17:0/3830930673 shutdown_connections 2023-07-14T13:15:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.498+0000 7fd6aefff700 1 -- 172.21.15.17:0/3830930673 wait complete. 2023-07-14T13:15:38.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:15:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.783+0000 7f9d877ff700 1 -- 172.21.15.17:0/3889568778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d80106fb0 msgr2=0x7f9d8010eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.783+0000 7f9d877ff700 1 --2- 172.21.15.17:0/3889568778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d80106fb0 0x7f9d8010eb80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009fc0 tx=0x7f9d7800b330 comp rx=0 tx=0).stop 2023-07-14T13:15:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.783+0000 7f9d877ff700 1 -- 172.21.15.17:0/3889568778 shutdown_connections 2023-07-14T13:15:38.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.783+0000 7f9d877ff700 1 --2- 172.21.15.17:0/3889568778 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d80106fb0 0x7f9d8010eb80 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.783+0000 7f9d877ff700 1 --2- 172.21.15.17:0/3889568778 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d80101f70 0x7f9d80102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.783+0000 7f9d877ff700 1 --2- 172.21.15.17:0/3889568778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d80102910 0x7f9d801068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.783+0000 7f9d877ff700 1 -- 172.21.15.17:0/3889568778 >> 172.21.15.17:0/3889568778 conn(0x7f9d800fd7e0 msgr2=0x7f9d800ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.784+0000 7f9d877ff700 1 -- 172.21.15.17:0/3889568778 shutdown_connections 2023-07-14T13:15:38.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.784+0000 7f9d877ff700 1 -- 172.21.15.17:0/3889568778 wait complete. 2023-07-14T13:15:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.785+0000 7f9d877ff700 1 Processor -- start 2023-07-14T13:15:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.785+0000 7f9d877ff700 1 -- start start 2023-07-14T13:15:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d877ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d80101f70 0x7f9d80197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d877ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d80102910 0x7f9d801983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d877ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d80106fb0 0x7f9d8019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.826 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d877ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019ce60 con 0x7f9d80106fb0 2023-07-14T13:15:38.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d877ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019cfd0 con 0x7f9d80102910 2023-07-14T13:15:38.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d877ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019d190 con 0x7f9d80101f70 2023-07-14T13:15:38.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d85d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d80106fb0 0x7f9d8019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d84d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d80102910 0x7f9d801983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d85d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d80106fb0 0x7f9d8019c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51488/0 (socket says 172.21.15.17:51488) 2023-07-14T13:15:38.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d84d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d80102910 0x7f9d801983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57368/0 (socket says 172.21.15.17:57368) 2023-07-14T13:15:38.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d85d9c700 1 -- 172.21.15.17:0/834883934 learned_addr learned my addr 172.21.15.17:0/834883934 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:38.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.786+0000 7f9d8559b700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d80101f70 0x7f9d80197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d84d9a700 1 -- 172.21.15.17:0/834883934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d80101f70 msgr2=0x7f9d80197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d80101f70 0x7f9d80197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d84d9a700 1 -- 172.21.15.17:0/834883934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d80106fb0 msgr2=0x7f9d8019c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d80106fb0 0x7f9d8019c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d84d9a700 1 -- 172.21.15.17:0/834883934 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700095f0 con 0x7f9d80102910 2023-07-14T13:15:38.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d85d9c700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d80106fb0 0x7f9d8019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:38.828 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d80102910 0x7f9d801983c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9d80102ce0 tx=0x7f9d7000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d767fc700 1 -- 172.21.15.17:0/834883934 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7000cba0 con 0x7f9d80102910 2023-07-14T13:15:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d877ff700 1 -- 172.21.15.17:0/834883934 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d78009c40 con 0x7f9d80102910 2023-07-14T13:15:38.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d767fc700 1 -- 172.21.15.17:0/834883934 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d700044b0 con 0x7f9d80102910 2023-07-14T13:15:38.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d767fc700 1 -- 172.21.15.17:0/834883934 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70003d50 con 0x7f9d80102910 2023-07-14T13:15:38.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.787+0000 7f9d877ff700 1 -- 172.21.15.17:0/834883934 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8019d660 con 0x7f9d80102910 2023-07-14T13:15:38.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.791+0000 7f9d767fc700 1 -- 172.21.15.17:0/834883934 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9d70003eb0 con 0x7f9d80102910 2023-07-14T13:15:38.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.792+0000 7f9d9b0f6b80 1 Processor -- start 2023-07-14T13:15:38.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.792+0000 7f9d767fc700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d6c0a12c0 0x7f9d6c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.792+0000 7f9d9b0f6b80 1 -- start start 2023-07-14T13:15:38.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d767fc700 1 -- 172.21.15.17:0/834883934 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9d70014070 con 0x7f9d80102910 2023-07-14T13:15:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d85d9c700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d6c0a12c0 0x7f9d6c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 0x556dddc6c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 0x556dddc77590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc77ad0 0x556dddc79eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dddb72cb0 con 0x556dddc77ad0 2023-07-14T13:15:38.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dddbc5a40 con 0x556dddc6cbe0 2023-07-14T13:15:38.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dddbbeed0 con 0x556dddc6c2d0 2023-07-14T13:15:38.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d8559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 0x556dddc6c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d84d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 0x556dddc77590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d84d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 0x556dddc77590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57384/0 (socket says 172.21.15.17:57384) 2023-07-14T13:15:38.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d8559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 0x556dddc6c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37136/0 (socket says 172.21.15.17:37136) 2023-07-14T13:15:38.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.793+0000 7f9d84d9a700 1 -- 172.21.15.17:0/1076868935 learned_addr learned my addr 172.21.15.17:0/1076868935 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.794+0000 7f9d85d9c700 1 --2- 172.21.15.17:0/1076868935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc77ad0 0x556dddc79eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.794+0000 7f9d84d9a700 1 -- 172.21.15.17:0/1076868935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 msgr2=0x556dddc6c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.794+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/1076868935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 0x556dddc6c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.794+0000 7f9d84d9a700 1 -- 172.21.15.17:0/1076868935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc77ad0 msgr2=0x556dddc79eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.794+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/1076868935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc77ad0 0x556dddc79eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.794+0000 7f9d84d9a700 1 -- 172.21.15.17:0/1076868935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ddd9ecde0 con 0x556dddc6cbe0 2023-07-14T13:15:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.794+0000 7f9d85d9c700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d6c0a12c0 0x7f9d6c0a3770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009f90 tx=0x7f9d78008a70 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.794+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/1076868935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 0x556dddc77590 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9d700a1ff0 tx=0x7f9d70099d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8befac58187b3485 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.795+0000 7f9d6b7fe700 1 -- 172.21.15.17:0/1076868935 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700caea0 con 0x556dddc6cbe0 2023-07-14T13:15:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.795+0000 7f9d6b7fe700 1 -- 172.21.15.17:0/1076868935 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d7000ce00 con 0x556dddc6cbe0 2023-07-14T13:15:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.795+0000 7f9d6b7fe700 1 -- 172.21.15.17:0/1076868935 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7009a330 con 0x556dddc6cbe0 2023-07-14T13:15:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.795+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/1076868935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 msgr2=0x556dddc77590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.795+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/1076868935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 0x556dddc77590 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9d700a1ff0 tx=0x7f9d70099d10 comp rx=0 tx=0).stop 2023-07-14T13:15:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.795+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/1076868935 shutdown_connections 2023-07-14T13:15:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.795+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/1076868935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc77ad0 0x556dddc79eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.795+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/1076868935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 0x556dddc6c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.795+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/1076868935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 0x556dddc77590 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.795+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/1076868935 >> 172.21.15.17:0/1076868935 conn(0x556dddc62da0 msgr2=0x556dddc686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.796+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/1076868935 shutdown_connections 2023-07-14T13:15:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.796+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/1076868935 wait complete. 2023-07-14T13:15:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.796+0000 7f9d9b0f6b80 1 -- start start 2023-07-14T13:15:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.796+0000 7f9d9b0f6b80 1 Processor -- start 2023-07-14T13:15:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6c2d0 0x556dddc77590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 0x556dddc74810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc77ad0 0x556dddc74f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dddb5eac0 con 0x556dddc6c2d0 2023-07-14T13:15:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dddb5e7c0 con 0x556dddc6cbe0 2023-07-14T13:15:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ddda42920 con 0x556dddc77ad0 2023-07-14T13:15:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d9b0f6b80 10 client.0 _ll_register_callbacks cb 0x556dddb5c760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d8559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6c2d0 0x556dddc77590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d8559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6c2d0 0x556dddc77590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51514/0 (socket says 172.21.15.17:51514) 2023-07-14T13:15:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d8559b700 1 -- 172.21.15.17:0/2225746705 learned_addr learned my addr 172.21.15.17:0/2225746705 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 0x556dddc74810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.797+0000 7f9d85d9c700 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc77ad0 0x556dddc74f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.798+0000 7f9d84d9a700 1 -- 172.21.15.17:0/2225746705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc77ad0 msgr2=0x556dddc74f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.798+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc77ad0 0x556dddc74f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.798+0000 7f9d84d9a700 1 -- 172.21.15.17:0/2225746705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6c2d0 msgr2=0x556dddc77590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.798+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6c2d0 0x556dddc77590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.798+0000 7f9d84d9a700 1 -- 172.21.15.17:0/2225746705 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8019d660 con 0x556dddc6cbe0 2023-07-14T13:15:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.798+0000 7f9d8559b700 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6c2d0 0x556dddc77590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.798+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 0x556dddc74810 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x556dddc6d050 tx=0x7f9d700997f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eb527cb73bbfaa8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.798+0000 7f9d68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:15:38.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.798+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2225746705 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7009e100 con 0x556dddc6cbe0 2023-07-14T13:15:38.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.798+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2225746705 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556dddb184f0 con 0x556dddc6cbe0 2023-07-14T13:15:38.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.798+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2225746705 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9d7009a0d0 con 0x556dddc6cbe0 2023-07-14T13:15:38.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.799+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2225746705 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d70016330 con 0x556dddc6cbe0 2023-07-14T13:15:38.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.799+0000 7f9d9b0f6b80 10 client.27845 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:38.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.799+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2225746705 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x556ddd9d5c60 con 0x556dddc6cbe0 2023-07-14T13:15:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.799+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2225746705 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556dddb184f0 con 0x556dddc6cbe0 2023-07-14T13:15:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.799+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2225746705 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9d700ca260 con 0x556dddc6cbe0 2023-07-14T13:15:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.799+0000 7f9d9b0f6b80 10 client.27845 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.799+0000 7f9d9b0f6b80 10 client.27845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.799+0000 7f9d9b0f6b80 20 client.27845 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:38.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.799+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556dddc86fe0 0x556dddc893f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.799+0000 7f9d9b0f6b80 4 client.27845 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:38.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.799+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2225746705 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556dddbb7eb0 con 0x556dddc86fe0 2023-07-14T13:15:38.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.800+0000 7f9d8559b700 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556dddc86fe0 0x556dddc893f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.801+0000 7f9d8559b700 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556dddc86fe0 0x556dddc893f0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2f77528bc7e4b8f server_cookie=ee14e32c024cf511 in_seq=0 out_seq=0 2023-07-14T13:15:38.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.801+0000 7f9d68ff9700 10 client.27845 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:38.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.801+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2225746705 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556dddbb7eb0 con 0x556dddc86fe0 2023-07-14T13:15:38.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.801+0000 7f9d68ff9700 10 client.27845 handle_command_reply: tid=0 2023-07-14T13:15:38.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.801+0000 7f9d9b0f6b80 1 client.27845 shutdown 2023-07-14T13:15:38.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.801+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2225746705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 msgr2=0x556dddc74810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.801+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 0x556dddc74810 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x556dddc6d050 tx=0x7f9d700997f0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.802+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2225746705 shutdown_connections 2023-07-14T13:15:38.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.802+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556dddc86fe0 0x556dddc893f0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.802+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc77ad0 0x556dddc74f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.802+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6c2d0 0x556dddc77590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.802+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2225746705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6cbe0 0x556dddc74810 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.802+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2225746705 >> 172.21.15.17:0/2225746705 conn(0x556dddc62da0 msgr2=0x556dddc68230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.802+0000 7f9d68ff9700 0 client.27845 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.802+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2225746705 shutdown_connections 2023-07-14T13:15:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.802+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2225746705 wait complete. 2023-07-14T13:15:38.848 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.802+0000 7f9d9b0f6b80 20 client.27845 trim_cache size 0 max 16384 2023-07-14T13:15:38.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.828+0000 7f9d9b0f6b80 1 Processor -- start 2023-07-14T13:15:38.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.828+0000 7f9d9b0f6b80 1 -- start start 2023-07-14T13:15:38.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc62da0 0x556dddc77130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6c2d0 0x556dddc71aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 0x556dddc71fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dddc5ffa0 con 0x556dddc6cbe0 2023-07-14T13:15:38.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dddc89a50 con 0x556dddc6c2d0 2023-07-14T13:15:38.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dddc67490 con 0x556dddc62da0 2023-07-14T13:15:38.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d8559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc62da0 0x556dddc77130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d8559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc62da0 0x556dddc77130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37146/0 (socket says 172.21.15.17:37146) 2023-07-14T13:15:38.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d85d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 0x556dddc71fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d8559b700 1 -- 172.21.15.17:0/1288501681 learned_addr learned my addr 172.21.15.17:0/1288501681 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:38.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/1288501681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6c2d0 0x556dddc71aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d8559b700 1 -- 172.21.15.17:0/1288501681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6c2d0 msgr2=0x556dddc71aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d8559b700 1 --2- 172.21.15.17:0/1288501681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6c2d0 0x556dddc71aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d8559b700 1 -- 172.21.15.17:0/1288501681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 msgr2=0x556dddc71fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d8559b700 1 --2- 172.21.15.17:0/1288501681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 0x556dddc71fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d8559b700 1 -- 172.21.15.17:0/1288501681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ddda13250 con 0x556dddc62da0 2023-07-14T13:15:38.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/1288501681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6c2d0 0x556dddc71aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:15:38.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.829+0000 7f9d85d9c700 1 --2- 172.21.15.17:0/1288501681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 0x556dddc71fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:38.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.830+0000 7f9d8559b700 1 --2- 172.21.15.17:0/1288501681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc62da0 0x556dddc77130 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c000c00 tx=0x7f9d7c009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=971530cd841baa6b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.830+0000 7f9d6bfff700 1 -- 172.21.15.17:0/1288501681 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c024070 con 0x556dddc62da0 2023-07-14T13:15:38.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.830+0000 7f9d6bfff700 1 -- 172.21.15.17:0/1288501681 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d7c018040 con 0x556dddc62da0 2023-07-14T13:15:38.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.830+0000 7f9d6bfff700 1 -- 172.21.15.17:0/1288501681 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c01f2d0 con 0x556dddc62da0 2023-07-14T13:15:38.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.831+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/1288501681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc62da0 msgr2=0x556dddc77130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.831+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/1288501681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc62da0 0x556dddc77130 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c000c00 tx=0x7f9d7c009fd0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.831+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/1288501681 shutdown_connections 2023-07-14T13:15:38.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.831+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/1288501681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 0x556dddc71fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.831+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/1288501681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc62da0 0x556dddc77130 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.831+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/1288501681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc6c2d0 0x556dddc71aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.831+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/1288501681 >> 172.21.15.17:0/1288501681 conn(0x556dddc64600 msgr2=0x556dddc836e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.831+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/1288501681 shutdown_connections 2023-07-14T13:15:38.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.831+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/1288501681 wait complete. 2023-07-14T13:15:38.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.831+0000 7f9d9b0f6b80 1 -- start start 2023-07-14T13:15:38.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.832+0000 7f9d9b0f6b80 1 Processor -- start 2023-07-14T13:15:38.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.832+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc62da0 0x556dddc7e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.832+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 0x556dddc7caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.832+0000 7f9d9b0f6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 0x556dddc7d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.832+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dddc7d860 con 0x556dddc6cbe0 2023-07-14T13:15:38.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.832+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dddcdae70 con 0x556dddc62da0 2023-07-14T13:15:38.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.832+0000 7f9d9b0f6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dddcdafb0 con 0x556dddc6c2d0 2023-07-14T13:15:38.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.832+0000 7f9d9b0f6b80 10 client.0 _ll_register_callbacks cb 0x7f9d7c009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:38.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d85d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 0x556dddc7d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d85d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 0x556dddc7d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51526/0 (socket says 172.21.15.17:51526) 2023-07-14T13:15:38.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d84d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 0x556dddc7caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d85d9c700 1 -- 172.21.15.17:0/2812422507 learned_addr learned my addr 172.21.15.17:0/2812422507 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:38.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d8559b700 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc62da0 0x556dddc7e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d84d9a700 1 -- 172.21.15.17:0/2812422507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc62da0 msgr2=0x556dddc7e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc62da0 0x556dddc7e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d84d9a700 1 -- 172.21.15.17:0/2812422507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 msgr2=0x556dddc7d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:38.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 0x556dddc7d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d84d9a700 1 -- 172.21.15.17:0/2812422507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8010f3c0 con 0x556dddc6c2d0 2023-07-14T13:15:38.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d8559b700 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc62da0 0x556dddc7e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:15:38.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d85d9c700 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 0x556dddc7d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:38.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d84d9a700 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 0x556dddc7caf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9d7009a060 tx=0x7f9d700a2640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b78ef4293663944 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:38.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.833+0000 7f9d68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:15:38.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2812422507 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700960c0 con 0x556dddc6c2d0 2023-07-14T13:15:38.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2812422507 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9d70096220 con 0x556dddc6c2d0 2023-07-14T13:15:38.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2812422507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d7000ce00 con 0x556dddc6c2d0 2023-07-14T13:15:38.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2812422507 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d7009e100 con 0x556dddc6c2d0 2023-07-14T13:15:38.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d9b0f6b80 10 client.27826 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2812422507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7f9d7c009e40 con 0x556dddc6c2d0 2023-07-14T13:15:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2812422507 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d7000ce00 con 0x556dddc6c2d0 2023-07-14T13:15:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2812422507 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9d70099030 con 0x556dddc6c2d0 2023-07-14T13:15:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d9b0f6b80 10 client.27826 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d9b0f6b80 10 client.27826 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d9b0f6b80 20 client.27826 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556dddc77ad0 0x556dddcde0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d9b0f6b80 4 client.27826 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:15:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.834+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2812422507 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556dddb7a050 con 0x556dddc77ad0 2023-07-14T13:15:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.835+0000 7f9d8559b700 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556dddc77ad0 0x556dddcde0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.835+0000 7f9d8559b700 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556dddc77ad0 0x556dddcde0f0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb2721c1bf99274e server_cookie=7654d3a59cd49ff6 in_seq=0 out_seq=0 2023-07-14T13:15:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.835+0000 7f9d68ff9700 10 client.27826 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d68ff9700 1 -- 172.21.15.17:0/2812422507 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556dddb7a050 con 0x556dddc77ad0 2023-07-14T13:15:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d68ff9700 10 client.27826 handle_command_reply: tid=0 2023-07-14T13:15:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 1 client.27826 shutdown 2023-07-14T13:15:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2812422507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 msgr2=0x556dddc7caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 0x556dddc7caf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9d7009a060 tx=0x7f9d700a2640 comp rx=0 tx=0).stop 2023-07-14T13:15:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2812422507 shutdown_connections 2023-07-14T13:15:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556dddc77ad0 0x556dddcde0f0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556dddc6cbe0 0x556dddc7d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556dddc62da0 0x556dddc7e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 1 --2- 172.21.15.17:0/2812422507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dddc6c2d0 0x556dddc7caf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d68ff9700 0 client.27826 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:38.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2812422507 >> 172.21.15.17:0/2812422507 conn(0x556dddc64600 msgr2=0x556dddc678b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2812422507 shutdown_connections 2023-07-14T13:15:38.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 1 -- 172.21.15.17:0/2812422507 wait complete. 2023-07-14T13:15:38.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.836+0000 7f9d9b0f6b80 20 client.27826 trim_cache size 0 max 16384 2023-07-14T13:15:38.886 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:15:38.887 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:15:38.887 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:15:38.887 INFO:teuthology.orchestra.run.smithi017.stdout: "1aa7f1a4-41ec-441c-9e37-f4775383a2a3": { 2023-07-14T13:15:38.887 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:15:38.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "1aa7f1a4-41ec-441c-9e37-f4775383a2a3", 2023-07-14T13:15:38.887 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:15:38.888 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:15:38.888 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:15:38.888 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:15:38.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 -- 172.21.15.17:0/834883934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d6c0a12c0 msgr2=0x7f9d6c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d6c0a12c0 0x7f9d6c0a3770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009f90 tx=0x7f9d78008a70 comp rx=0 tx=0).stop 2023-07-14T13:15:38.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 -- 172.21.15.17:0/834883934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d80102910 msgr2=0x7f9d801983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:38.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d80102910 0x7f9d801983c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9d80102ce0 tx=0x7f9d7000ee70 comp rx=0 tx=0).stop 2023-07-14T13:15:38.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 -- 172.21.15.17:0/834883934 shutdown_connections 2023-07-14T13:15:38.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d6c0a12c0 0x7f9d6c0a3770 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d80106fb0 0x7f9d8019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d80101f70 0x7f9d80197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 --2- 172.21.15.17:0/834883934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d80102910 0x7f9d801983c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:38.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 -- 172.21.15.17:0/834883934 >> 172.21.15.17:0/834883934 conn(0x7f9d800fd7e0 msgr2=0x7f9d800fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:38.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 -- 172.21.15.17:0/834883934 shutdown_connections 2023-07-14T13:15:38.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:15:38.837+0000 7f9d877ff700 1 -- 172.21.15.17:0/834883934 wait complete. 2023-07-14T13:15:38.897 INFO:tasks.cephfs.filesystem:scrub status for tag:1aa7f1a4-41ec-441c-9e37-f4775383a2a3 - {'path': '/', 'tag': '1aa7f1a4-41ec-441c-9e37-f4775383a2a3', 'options': 'recursive,force'} 2023-07-14T13:15:39.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:39 smithi017 ceph-mon[95536]: pgmap v500: 97 pgs: 97 active+clean; 14 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-07-14T13:15:39.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:39 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:15:39.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:39 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:39.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:39 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:15:39.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:39 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:15:39.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:39 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:39.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:39 smithi135 ceph-mon[97338]: pgmap v500: 97 pgs: 97 active+clean; 14 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-07-14T13:15:39.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:39 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:15:39.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:39 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:39.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:39 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:15:39.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:39 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:15:39.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:39 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:39.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:39 smithi131 ceph-mon[96953]: pgmap v500: 97 pgs: 97 active+clean; 14 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 18 op/s 2023-07-14T13:15:39.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:39 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:15:39.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:39 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:39.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:39 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:15:39.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:39 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:15:39.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:39 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.373+0000 7f45d55ff700 1 -- 172.21.15.17:0/2352292964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d00ffb00 msgr2=0x7f45d00fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.373+0000 7f45d55ff700 1 --2- 172.21.15.17:0/2352292964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d00ffb00 0x7f45d00fff70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009990 tx=0x7f45c4009ca0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.373+0000 7f45d55ff700 1 -- 172.21.15.17:0/2352292964 shutdown_connections 2023-07-14T13:15:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.373+0000 7f45d55ff700 1 --2- 172.21.15.17:0/2352292964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d01004b0 0x7f45d010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.373+0000 7f45d55ff700 1 --2- 172.21.15.17:0/2352292964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45d0105b10 0x7f45d0105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.373+0000 7f45d55ff700 1 --2- 172.21.15.17:0/2352292964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d00ffb00 0x7f45d00fff70 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.373+0000 7f45d55ff700 1 -- 172.21.15.17:0/2352292964 >> 172.21.15.17:0/2352292964 conn(0x7f45d00fb600 msgr2=0x7f45d00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.373+0000 7f45d55ff700 1 -- 172.21.15.17:0/2352292964 shutdown_connections 2023-07-14T13:15:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.373+0000 7f45d55ff700 1 -- 172.21.15.17:0/2352292964 wait complete. 2023-07-14T13:15:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.375+0000 7f45d55ff700 1 Processor -- start 2023-07-14T13:15:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.375+0000 7f45d55ff700 1 -- start start 2023-07-14T13:15:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.375+0000 7f45d55ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45d00ffb00 0x7f45d0197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.375+0000 7f45d55ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d01004b0 0x7f45d0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.375+0000 7f45d55ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d0105b10 0x7f45d019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.375+0000 7f45d55ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d019cfd0 con 0x7f45d01004b0 2023-07-14T13:15:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.375+0000 7f45d55ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d019d140 con 0x7f45d00ffb00 2023-07-14T13:15:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.375+0000 7f45d55ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d019d300 con 0x7f45d0105b10 2023-07-14T13:15:40.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45ceffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45d00ffb00 0x7f45d0197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45ce7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d01004b0 0x7f45d0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45ceffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45d00ffb00 0x7f45d0197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57432/0 (socket says 172.21.15.17:57432) 2023-07-14T13:15:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45ce7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d01004b0 0x7f45d0198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51538/0 (socket says 172.21.15.17:51538) 2023-07-14T13:15:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45ceffd700 1 -- 172.21.15.17:0/2875607524 learned_addr learned my addr 172.21.15.17:0/2875607524 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45cf7fe700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d0105b10 0x7f45d019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45ceffd700 1 -- 172.21.15.17:0/2875607524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d0105b10 msgr2=0x7f45d019c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45ceffd700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d0105b10 0x7f45d019c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45ceffd700 1 -- 172.21.15.17:0/2875607524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d01004b0 msgr2=0x7f45d0198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45ceffd700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d01004b0 0x7f45d0198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45ceffd700 1 -- 172.21.15.17:0/2875607524 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c40095f0 con 0x7f45d00ffb00 2023-07-14T13:15:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.376+0000 7f45ceffd700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45d00ffb00 0x7f45d0197de0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f45c000e9a0 tx=0x7f45c000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.377+0000 7f45b7fff700 1 -- 172.21.15.17:0/2875607524 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0009790 con 0x7f45d00ffb00 2023-07-14T13:15:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.377+0000 7f45b7fff700 1 -- 172.21.15.17:0/2875607524 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45c0010430 con 0x7f45d00ffb00 2023-07-14T13:15:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.377+0000 7f45d55ff700 1 -- 172.21.15.17:0/2875607524 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d019d5e0 con 0x7f45d00ffb00 2023-07-14T13:15:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.377+0000 7f45b7fff700 1 -- 172.21.15.17:0/2875607524 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c000cea0 con 0x7f45d00ffb00 2023-07-14T13:15:40.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.377+0000 7f45d55ff700 1 -- 172.21.15.17:0/2875607524 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d01a4e20 con 0x7f45d00ffb00 2023-07-14T13:15:40.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.381+0000 7f45b7fff700 1 -- 172.21.15.17:0/2875607524 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f45c00105a0 con 0x7f45d00ffb00 2023-07-14T13:15:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.382+0000 7f45e8f3db80 1 Processor -- start 2023-07-14T13:15:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.382+0000 7f45e8f3db80 1 -- start start 2023-07-14T13:15:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671f22d0 0x5634671ec040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671ec9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634670f1c50 con 0x5634670486b0 2023-07-14T13:15:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634671449e0 con 0x5634671f22d0 2023-07-14T13:15:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346713de70 con 0x5634671ec580 2023-07-14T13:15:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45b7fff700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f45b80a12c0 0x7f45b80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45cf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45b7fff700 1 -- 172.21.15.17:0/2875607524 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f45c0014070 con 0x7f45d00ffb00 2023-07-14T13:15:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45cf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51540/0 (socket says 172.21.15.17:51540) 2023-07-14T13:15:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45cf7fe700 1 -- 172.21.15.17:0/3328223247 learned_addr learned my addr 172.21.15.17:0/3328223247 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.383+0000 7f45ce7fc700 1 --2- 172.21.15.17:0/3328223247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.384+0000 7f45ceffd700 1 --2- 172.21.15.17:0/3328223247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671f22d0 0x5634671ec040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.384+0000 7f45cf7fe700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f45b80a12c0 0x7f45b80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.384+0000 7f45cf7fe700 1 -- 172.21.15.17:0/3328223247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 msgr2=0x5634671ec9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.384+0000 7f45cf7fe700 1 --2- 172.21.15.17:0/3328223247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671ec9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.384+0000 7f45cf7fe700 1 -- 172.21.15.17:0/3328223247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671f22d0 msgr2=0x5634671ec040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.384+0000 7f45cf7fe700 1 --2- 172.21.15.17:0/3328223247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671f22d0 0x5634671ec040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.384+0000 7f45cf7fe700 1 -- 172.21.15.17:0/3328223247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563466f6bd80 con 0x5634670486b0 2023-07-14T13:15:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.384+0000 7f45ceffd700 1 --2- 172.21.15.17:0/3328223247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671f22d0 0x5634671ec040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:15:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.384+0000 7f45cf7fe700 1 --2- 172.21.15.17:0/3328223247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f1d90 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f45c8008ad0 tx=0x7f45c8008de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2ecb56cd95b047 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.385+0000 7f45cf7fe700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f45b80a12c0 0x7f45b80a3770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f45c8011000 tx=0x7f45c801e000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.385+0000 7f45b57fa700 1 -- 172.21.15.17:0/3328223247 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c800e070 con 0x5634670486b0 2023-07-14T13:15:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.385+0000 7f45b57fa700 1 -- 172.21.15.17:0/3328223247 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45c800f040 con 0x5634670486b0 2023-07-14T13:15:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.385+0000 7f45b57fa700 1 -- 172.21.15.17:0/3328223247 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c8022860 con 0x5634670486b0 2023-07-14T13:15:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.386+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3328223247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 msgr2=0x5634671f1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.386+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3328223247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f1d90 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f45c8008ad0 tx=0x7f45c8008de0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.386+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3328223247 shutdown_connections 2023-07-14T13:15:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.386+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3328223247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671ec9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.386+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3328223247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f1d90 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.386+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3328223247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671f22d0 0x5634671ec040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.386+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3328223247 >> 172.21.15.17:0/3328223247 conn(0x5634671e1be0 msgr2=0x5634671e6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.386+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3328223247 shutdown_connections 2023-07-14T13:15:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.386+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3328223247 wait complete. 2023-07-14T13:15:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.387+0000 7f45e8f3db80 1 -- start start 2023-07-14T13:15:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.387+0000 7f45e8f3db80 1 Processor -- start 2023-07-14T13:15:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.387+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.387+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671ec580 0x5634671f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671f22d0 0x5634671f6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634670dda60 con 0x5634670486b0 2023-07-14T13:15:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634670dd760 con 0x5634671ec580 2023-07-14T13:15:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563466fc18c0 con 0x5634671f22d0 2023-07-14T13:15:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45e8f3db80 10 client.0 _ll_register_callbacks cb 0x5634670db700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45ceffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45ceffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51556/0 (socket says 172.21.15.17:51556) 2023-07-14T13:15:40.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45ceffd700 1 -- 172.21.15.17:0/3381805955 learned_addr learned my addr 172.21.15.17:0/3381805955 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:40.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45cf7fe700 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671f22d0 0x5634671f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45ce7fc700 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671ec580 0x5634671f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45ceffd700 1 -- 172.21.15.17:0/3381805955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671f22d0 msgr2=0x5634671f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:40.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45ceffd700 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671f22d0 0x5634671f6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.388+0000 7f45ceffd700 1 -- 172.21.15.17:0/3381805955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671ec580 msgr2=0x5634671f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:40.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.389+0000 7f45ceffd700 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671ec580 0x5634671f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.389+0000 7f45ceffd700 1 -- 172.21.15.17:0/3381805955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c80086b0 con 0x5634670486b0 2023-07-14T13:15:40.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.389+0000 7f45ce7fc700 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671ec580 0x5634671f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:40.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.389+0000 7f45ceffd700 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f58e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f45c0099f20 tx=0x7f45c00cab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3de6f33d13686b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:40.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.389+0000 7f45b2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:15:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.390+0000 7f45b2ff5700 1 -- 172.21.15.17:0/3381805955 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0004750 con 0x5634670486b0 2023-07-14T13:15:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.390+0000 7f45b2ff5700 1 -- 172.21.15.17:0/3381805955 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f45c0099f90 con 0x5634670486b0 2023-07-14T13:15:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.390+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3381805955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563467097490 con 0x5634670486b0 2023-07-14T13:15:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.390+0000 7f45b2ff5700 1 -- 172.21.15.17:0/3381805955 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45c009dfc0 con 0x5634670486b0 2023-07-14T13:15:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.391+0000 7f45e8f3db80 10 client.18147 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.391+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3381805955 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x563466f54c00 con 0x5634670486b0 2023-07-14T13:15:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.391+0000 7f45b2ff5700 1 -- 172.21.15.17:0/3381805955 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45c00b6080 con 0x5634670486b0 2023-07-14T13:15:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.391+0000 7f45b2ff5700 1 -- 172.21.15.17:0/3381805955 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f45c00a1f50 con 0x5634670486b0 2023-07-14T13:15:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.391+0000 7f45e8f3db80 10 client.18147 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.391+0000 7f45e8f3db80 10 client.18147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.391+0000 7f45e8f3db80 20 client.18147 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.391+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563467205bd0 0x563467207fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.391+0000 7f45e8f3db80 4 client.18147 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:40.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.391+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3381805955 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563467136e50 con 0x563467205bd0 2023-07-14T13:15:40.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.393+0000 7f45ce7fc700 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563467205bd0 0x563467207fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.394+0000 7f45ce7fc700 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563467205bd0 0x563467207fe0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59bad24b899ecef6 server_cookie=b29db5325551fc81 in_seq=0 out_seq=0 2023-07-14T13:15:40.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.394+0000 7f45b2ff5700 10 client.18147 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45b2ff5700 1 -- 172.21.15.17:0/3381805955 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563467136e50 con 0x563467205bd0 2023-07-14T13:15:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45b2ff5700 10 client.18147 handle_command_reply: tid=0 2023-07-14T13:15:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45e8f3db80 1 client.18147 shutdown 2023-07-14T13:15:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3381805955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 msgr2=0x5634671f58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f58e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f45c0099f20 tx=0x7f45c00cab70 comp rx=0 tx=0).stop 2023-07-14T13:15:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3381805955 shutdown_connections 2023-07-14T13:15:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563467205bd0 0x563467207fe0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671f22d0 0x5634671f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671f58e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3381805955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671ec580 0x5634671f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3381805955 >> 172.21.15.17:0/3381805955 conn(0x5634671e1be0 msgr2=0x5634671e64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45b2ff5700 0 client.18147 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3381805955 shutdown_connections 2023-07-14T13:15:40.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.395+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3381805955 wait complete. 2023-07-14T13:15:40.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.396+0000 7f45e8f3db80 20 client.18147 trim_cache size 0 max 16384 2023-07-14T13:15:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.417+0000 7f45e8f3db80 1 Processor -- start 2023-07-14T13:15:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.417+0000 7f45e8f3db80 1 -- start start 2023-07-14T13:15:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.417+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671ec040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.417+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671f1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.417+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671f22d0 0x5634671f6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.417+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634671b2060 con 0x5634670486b0 2023-07-14T13:15:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.417+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634671f1a10 con 0x5634671f22d0 2023-07-14T13:15:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.417+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634671f2130 con 0x5634671ec580 2023-07-14T13:15:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.418+0000 7f45ceffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671ec040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.418+0000 7f45ceffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671ec040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51562/0 (socket says 172.21.15.17:51562) 2023-07-14T13:15:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.418+0000 7f45ceffd700 1 -- 172.21.15.17:0/3597867817 learned_addr learned my addr 172.21.15.17:0/3597867817 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:40.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.418+0000 7f45ce7fc700 1 --2- 172.21.15.17:0/3597867817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.418+0000 7f45cf7fe700 1 --2- 172.21.15.17:0/3597867817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671f22d0 0x5634671f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.418+0000 7f45ceffd700 1 -- 172.21.15.17:0/3597867817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 msgr2=0x5634671f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.418+0000 7f45ceffd700 1 --2- 172.21.15.17:0/3597867817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.418+0000 7f45ceffd700 1 -- 172.21.15.17:0/3597867817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671f22d0 msgr2=0x5634671f6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.418+0000 7f45ceffd700 1 --2- 172.21.15.17:0/3597867817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671f22d0 0x5634671f6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.418+0000 7f45ceffd700 1 -- 172.21.15.17:0/3597867817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563466f921f0 con 0x5634670486b0 2023-07-14T13:15:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.419+0000 7f45ceffd700 1 --2- 172.21.15.17:0/3597867817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671ec040 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f45c0096a00 tx=0x7f45c0099e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932edded071ed006 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.419+0000 7f45b5ffb700 1 -- 172.21.15.17:0/3597867817 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0099f90 con 0x5634670486b0 2023-07-14T13:15:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.419+0000 7f45b5ffb700 1 -- 172.21.15.17:0/3597867817 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563467097490 con 0x5634670486b0 2023-07-14T13:15:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.419+0000 7f45b5ffb700 1 -- 172.21.15.17:0/3597867817 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b8170 con 0x5634670486b0 2023-07-14T13:15:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.420+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3597867817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 msgr2=0x5634671ec040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.420+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3597867817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671ec040 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f45c0096a00 tx=0x7f45c0099e90 comp rx=0 tx=0).stop 2023-07-14T13:15:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.420+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3597867817 shutdown_connections 2023-07-14T13:15:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.420+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3597867817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634671f22d0 0x5634671f6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.420+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3597867817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634670486b0 0x5634671ec040 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.420+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/3597867817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.420+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3597867817 >> 172.21.15.17:0/3597867817 conn(0x5634671e1be0 msgr2=0x5634671f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.420+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3597867817 shutdown_connections 2023-07-14T13:15:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.420+0000 7f45e8f3db80 1 -- 172.21.15.17:0/3597867817 wait complete. 2023-07-14T13:15:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.421+0000 7f45e8f3db80 1 -- start start 2023-07-14T13:15:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.421+0000 7f45e8f3db80 1 Processor -- start 2023-07-14T13:15:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.421+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634670486b0 0x5634671fc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.421+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.421+0000 7f45e8f3db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634671f22d0 0x5634671faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.421+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634671fb1c0 con 0x5634671f22d0 2023-07-14T13:15:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.421+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634671fb330 con 0x5634670486b0 2023-07-14T13:15:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.421+0000 7f45e8f3db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634671fb4f0 con 0x5634671ec580 2023-07-14T13:15:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.421+0000 7f45e8f3db80 10 client.0 _ll_register_callbacks cb 0x7f45c00998f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.422+0000 7f45ce7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.422+0000 7f45ce7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37194/0 (socket says 172.21.15.17:37194) 2023-07-14T13:15:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.422+0000 7f45ce7fc700 1 -- 172.21.15.17:0/1908043836 learned_addr learned my addr 172.21.15.17:0/1908043836 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.422+0000 7f45cf7fe700 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634671f22d0 0x5634671faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.422+0000 7f45ceffd700 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634670486b0 0x5634671fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.422+0000 7f45ce7fc700 1 -- 172.21.15.17:0/1908043836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634670486b0 msgr2=0x5634671fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.422+0000 7f45ce7fc700 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634670486b0 0x5634671fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.422+0000 7f45ce7fc700 1 -- 172.21.15.17:0/1908043836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634671f22d0 msgr2=0x5634671faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.422+0000 7f45ce7fc700 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634671f22d0 0x5634671faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.422+0000 7f45ce7fc700 1 -- 172.21.15.17:0/1908043836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563466f54c00 con 0x5634671ec580 2023-07-14T13:15:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.423+0000 7f45ce7fc700 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671fcbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009990 tx=0x7f45c400b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcabea4282948d71 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.423+0000 7f45b2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:15:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.423+0000 7f45b2ff5700 1 -- 172.21.15.17:0/1908043836 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c401d070 con 0x5634671ec580 2023-07-14T13:15:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.423+0000 7f45e8f3db80 1 -- 172.21.15.17:0/1908043836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45c800f040 con 0x5634671ec580 2023-07-14T13:15:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.423+0000 7f45b2ff5700 1 -- 172.21.15.17:0/1908043836 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f45c400bd40 con 0x5634671ec580 2023-07-14T13:15:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.423+0000 7f45b2ff5700 1 -- 172.21.15.17:0/1908043836 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45c402b070 con 0x5634671ec580 2023-07-14T13:15:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.423+0000 7f45e8f3db80 10 client.27844 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.423+0000 7f45e8f3db80 1 -- 172.21.15.17:0/1908043836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x563466f6a250 con 0x5634671ec580 2023-07-14T13:15:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.424+0000 7f45b2ff5700 1 -- 172.21.15.17:0/1908043836 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45c403c020 con 0x5634671ec580 2023-07-14T13:15:40.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.424+0000 7f45b2ff5700 1 -- 172.21.15.17:0/1908043836 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f45c400f460 con 0x5634671ec580 2023-07-14T13:15:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.424+0000 7f45e8f3db80 10 client.27844 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.424+0000 7f45e8f3db80 10 client.27844 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.424+0000 7f45e8f3db80 20 client.27844 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.424+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56346725ae00 0x56346725d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.424+0000 7f45e8f3db80 4 client.27844 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:15:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.424+0000 7f45e8f3db80 1 -- 172.21.15.17:0/1908043836 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5634670f8ff0 con 0x56346725ae00 2023-07-14T13:15:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.424+0000 7f45ceffd700 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56346725ae00 0x56346725d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.425+0000 7f45ceffd700 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56346725ae00 0x56346725d210 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c779532ebea6340a server_cookie=9e5b4fc3803886fd in_seq=0 out_seq=0 2023-07-14T13:15:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.425+0000 7f45b2ff5700 10 client.27844 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.433+0000 7f45b2ff5700 1 -- 172.21.15.17:0/1908043836 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5634670f8ff0 con 0x56346725ae00 2023-07-14T13:15:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45b2ff5700 10 client.27844 handle_command_reply: tid=0 2023-07-14T13:15:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 1 client.27844 shutdown 2023-07-14T13:15:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 1 -- 172.21.15.17:0/1908043836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 msgr2=0x5634671fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671fcbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009990 tx=0x7f45c400b260 comp rx=0 tx=0).stop 2023-07-14T13:15:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 1 -- 172.21.15.17:0/1908043836 shutdown_connections 2023-07-14T13:15:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56346725ae00 0x56346725d210 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5634671f22d0 0x5634671faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634670486b0 0x5634671fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45b2ff5700 0 client.27844 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 1 --2- 172.21.15.17:0/1908043836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634671ec580 0x5634671fcbd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 1 -- 172.21.15.17:0/1908043836 >> 172.21.15.17:0/1908043836 conn(0x5634671e1be0 msgr2=0x5634671f60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 1 -- 172.21.15.17:0/1908043836 shutdown_connections 2023-07-14T13:15:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 1 -- 172.21.15.17:0/1908043836 wait complete. 2023-07-14T13:15:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.434+0000 7f45e8f3db80 20 client.27844 trim_cache size 0 max 16384 2023-07-14T13:15:40.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:15:40.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:15:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:15:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:15:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 -- 172.21.15.17:0/2875607524 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f45b80a12c0 msgr2=0x7f45b80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:40.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f45b80a12c0 0x7f45b80a3770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f45c8011000 tx=0x7f45c801e000 comp rx=0 tx=0).stop 2023-07-14T13:15:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 -- 172.21.15.17:0/2875607524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45d00ffb00 msgr2=0x7f45d0197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45d00ffb00 0x7f45d0197de0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f45c000e9a0 tx=0x7f45c000ecb0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 -- 172.21.15.17:0/2875607524 shutdown_connections 2023-07-14T13:15:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f45b80a12c0 0x7f45b80a3770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d0105b10 0x7f45d019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45d00ffb00 0x7f45d0197de0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 --2- 172.21.15.17:0/2875607524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45d01004b0 0x7f45d0198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 -- 172.21.15.17:0/2875607524 >> 172.21.15.17:0/2875607524 conn(0x7f45d00fb600 msgr2=0x7f45d010af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 -- 172.21.15.17:0/2875607524 shutdown_connections 2023-07-14T13:15:40.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:40.435+0000 7f45d55ff700 1 -- 172.21.15.17:0/2875607524 wait complete. 2023-07-14T13:15:40.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:40 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:15:40.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:40 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:40.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:40 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:40.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:40 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:15:40.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:40 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:40.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:40 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:40.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:40 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:15:40.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:40 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:40.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:40 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:15:41.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:41 smithi017 ceph-mon[95536]: pgmap v501: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 32 MiB/s wr, 105 op/s 2023-07-14T13:15:41.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:41 smithi135 ceph-mon[97338]: pgmap v501: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 32 MiB/s wr, 105 op/s 2023-07-14T13:15:41.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:41 smithi131 ceph-mon[96953]: pgmap v501: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 32 MiB/s wr, 105 op/s 2023-07-14T13:15:43.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:43 smithi017 ceph-mon[95536]: pgmap v502: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 26 MiB/s wr, 108 op/s 2023-07-14T13:15:43.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:43 smithi135 ceph-mon[97338]: pgmap v502: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 26 MiB/s wr, 108 op/s 2023-07-14T13:15:43.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:43 smithi131 ceph-mon[96953]: pgmap v502: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 26 MiB/s wr, 108 op/s 2023-07-14T13:15:44.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:44 smithi017 ceph-mon[95536]: pgmap v503: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 24 MiB/s wr, 107 op/s 2023-07-14T13:15:44.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:44 smithi135 ceph-mon[97338]: pgmap v503: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 24 MiB/s wr, 107 op/s 2023-07-14T13:15:44.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:44 smithi131 ceph-mon[96953]: pgmap v503: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 24 MiB/s wr, 107 op/s 2023-07-14T13:15:47.457 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:47 smithi135 ceph-mon[97338]: pgmap v504: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 36 MiB/s wr, 117 op/s 2023-07-14T13:15:47.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:47 smithi131 ceph-mon[96953]: pgmap v504: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 36 MiB/s wr, 117 op/s 2023-07-14T13:15:47.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:47 smithi017 ceph-mon[95536]: pgmap v504: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 36 MiB/s wr, 117 op/s 2023-07-14T13:15:49.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:49 smithi131 ceph-mon[96953]: pgmap v505: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 24 MiB/s wr, 109 op/s 2023-07-14T13:15:49.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:49 smithi017 ceph-mon[95536]: pgmap v505: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 24 MiB/s wr, 109 op/s 2023-07-14T13:15:49.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:49 smithi135 ceph-mon[97338]: pgmap v505: 97 pgs: 97 active+clean; 14 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 24 MiB/s wr, 109 op/s 2023-07-14T13:15:50.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:50 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:15:50.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:50 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:15:50.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:50 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:15:50.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:50 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:15:50.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:50 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:15:50.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:50 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:15:50.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:50 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:15:50.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:50 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:15:50.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:50 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:15:51.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:51 smithi131 ceph-mon[96953]: pgmap v506: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 36 MiB/s wr, 117 op/s 2023-07-14T13:15:51.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:51 smithi017 ceph-mon[95536]: pgmap v506: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 36 MiB/s wr, 117 op/s 2023-07-14T13:15:51.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:51 smithi135 ceph-mon[97338]: pgmap v506: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 36 MiB/s wr, 117 op/s 2023-07-14T13:15:53.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:53 smithi131 ceph-mon[96953]: pgmap v507: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 30 op/s 2023-07-14T13:15:53.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:53 smithi017 ceph-mon[95536]: pgmap v507: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 30 op/s 2023-07-14T13:15:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.614+0000 7f352a5ff700 1 -- 172.21.15.17:0/4820285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3524105b10 msgr2=0x7f3524105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.614+0000 7f352a5ff700 1 --2- 172.21.15.17:0/4820285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3524105b10 0x7f3524105ee0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3514009990 tx=0x7f3514009ca0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.614+0000 7f352a5ff700 1 -- 172.21.15.17:0/4820285 shutdown_connections 2023-07-14T13:15:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.614+0000 7f352a5ff700 1 --2- 172.21.15.17:0/4820285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35241004b0 0x7f352410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.614+0000 7f352a5ff700 1 --2- 172.21.15.17:0/4820285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3524105b10 0x7f3524105ee0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.614+0000 7f352a5ff700 1 --2- 172.21.15.17:0/4820285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35240ffb00 0x7f35240fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.614+0000 7f352a5ff700 1 -- 172.21.15.17:0/4820285 >> 172.21.15.17:0/4820285 conn(0x7f35240fb600 msgr2=0x7f35240fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.614+0000 7f352a5ff700 1 -- 172.21.15.17:0/4820285 shutdown_connections 2023-07-14T13:15:53.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.614+0000 7f352a5ff700 1 -- 172.21.15.17:0/4820285 wait complete. 2023-07-14T13:15:53.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.616+0000 7f352a5ff700 1 Processor -- start 2023-07-14T13:15:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.616+0000 7f352a5ff700 1 -- start start 2023-07-14T13:15:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.616+0000 7f352a5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35240ffb00 0x7f352419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.616+0000 7f352a5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35241004b0 0x7f352419c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.616+0000 7f352a5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3524105b10 0x7f3524195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.616+0000 7f352a5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524196090 con 0x7f35240ffb00 2023-07-14T13:15:53.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.616+0000 7f352a5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524196200 con 0x7f35241004b0 2023-07-14T13:15:53.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.616+0000 7f352a5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35241963c0 con 0x7f3524105b10 2023-07-14T13:15:53.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.617+0000 7f3523fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35240ffb00 0x7f352419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.617+0000 7f3523fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35240ffb00 0x7f352419bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58294/0 (socket says 172.21.15.17:58294) 2023-07-14T13:15:53.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.617+0000 7f3523fff700 1 -- 172.21.15.17:0/954435514 learned_addr learned my addr 172.21.15.17:0/954435514 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:53.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.617+0000 7f35237fe700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35241004b0 0x7f352419c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.617+0000 7f3528b9c700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3524105b10 0x7f3524195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.617+0000 7f3523fff700 1 -- 172.21.15.17:0/954435514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3524105b10 msgr2=0x7f3524195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.617+0000 7f3523fff700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3524105b10 0x7f3524195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.617+0000 7f3523fff700 1 -- 172.21.15.17:0/954435514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35241004b0 msgr2=0x7f352419c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.617+0000 7f3523fff700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35241004b0 0x7f352419c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.617+0000 7f3523fff700 1 -- 172.21.15.17:0/954435514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35140095f0 con 0x7f35240ffb00 2023-07-14T13:15:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.617+0000 7f3523fff700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35240ffb00 0x7f352419bbc0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f35140036c0 tx=0x7f35140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.618+0000 7f35217fa700 1 -- 172.21.15.17:0/954435514 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351401d070 con 0x7f35240ffb00 2023-07-14T13:15:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.618+0000 7f352a5ff700 1 -- 172.21.15.17:0/954435514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3524196640 con 0x7f35240ffb00 2023-07-14T13:15:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.618+0000 7f35217fa700 1 -- 172.21.15.17:0/954435514 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3514003fc0 con 0x7f35240ffb00 2023-07-14T13:15:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.618+0000 7f35217fa700 1 -- 172.21.15.17:0/954435514 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514022ca0 con 0x7f35240ffb00 2023-07-14T13:15:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.618+0000 7f352a5ff700 1 -- 172.21.15.17:0/954435514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35241a2bb0 con 0x7f35240ffb00 2023-07-14T13:15:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.623+0000 7f35217fa700 1 -- 172.21.15.17:0/954435514 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3514022470 con 0x7f35240ffb00 2023-07-14T13:15:53.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.624+0000 7f353de21b80 1 Processor -- start 2023-07-14T13:15:53.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.625+0000 7f353de21b80 1 -- start start 2023-07-14T13:15:53.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.625+0000 7f353de21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 0x555937d05140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.625+0000 7f353de21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937cff450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.664 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.625+0000 7f353de21b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937d05ad0 0x555937cff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.625+0000 7f353de21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937c00c50 con 0x555937d05680 2023-07-14T13:15:53.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.625+0000 7f353de21b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937c539e0 con 0x555937d05ad0 2023-07-14T13:15:53.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.625+0000 7f353de21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937c4ce70 con 0x555937b576b0 2023-07-14T13:15:53.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.625+0000 7f3528b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 0x555937d05140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.625+0000 7f3528b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 0x555937d05140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60016/0 (socket says 172.21.15.17:60016) 2023-07-14T13:15:53.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.626+0000 7f3528b9c700 1 -- 172.21.15.17:0/471274361 learned_addr learned my addr 172.21.15.17:0/471274361 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:53.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.626+0000 7f35237fe700 1 --2- 172.21.15.17:0/471274361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937d05ad0 0x555937cff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.626+0000 7f3523fff700 1 --2- 172.21.15.17:0/471274361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937cff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.626+0000 7f35217fa700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f350c0a1340 0x7f350c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.626+0000 7f35217fa700 1 -- 172.21.15.17:0/954435514 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f35140ce220 con 0x7f35240ffb00 2023-07-14T13:15:53.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.626+0000 7f3528b9c700 1 -- 172.21.15.17:0/471274361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937d05ad0 msgr2=0x555937cff9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:53.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.626+0000 7f3528b9c700 1 --2- 172.21.15.17:0/471274361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937d05ad0 0x555937cff9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.626+0000 7f3528b9c700 1 -- 172.21.15.17:0/471274361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 msgr2=0x555937cff450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:53.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.626+0000 7f3528b9c700 1 --2- 172.21.15.17:0/471274361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937cff450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.626+0000 7f3528b9c700 1 -- 172.21.15.17:0/471274361 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555937a7ad80 con 0x555937b576b0 2023-07-14T13:15:53.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.626+0000 7f3528b9c700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f350c0a1340 0x7f350c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.627+0000 7f3528b9c700 1 --2- 172.21.15.17:0/471274361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 0x555937d05140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f351c009e30 tx=0x7f351c0077e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f1332af4e7ddd5a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:53.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.627+0000 7f350a7fc700 1 -- 172.21.15.17:0/471274361 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c018ae0 con 0x555937b576b0 2023-07-14T13:15:53.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.627+0000 7f3528b9c700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f350c0a1340 0x7f350c0a37f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f351c020000 tx=0x7f351c01d000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:53.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.627+0000 7f350a7fc700 1 -- 172.21.15.17:0/471274361 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f351c00f050 con 0x555937b576b0 2023-07-14T13:15:53.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.627+0000 7f350a7fc700 1 -- 172.21.15.17:0/471274361 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c023e50 con 0x555937b576b0 2023-07-14T13:15:53.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.628+0000 7f353de21b80 1 -- 172.21.15.17:0/471274361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 msgr2=0x555937d05140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.628+0000 7f353de21b80 1 --2- 172.21.15.17:0/471274361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 0x555937d05140 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f351c009e30 tx=0x7f351c0077e0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.629+0000 7f353de21b80 1 -- 172.21.15.17:0/471274361 shutdown_connections 2023-07-14T13:15:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.629+0000 7f353de21b80 1 --2- 172.21.15.17:0/471274361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937d05ad0 0x555937cff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.629+0000 7f353de21b80 1 --2- 172.21.15.17:0/471274361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 0x555937d05140 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.629+0000 7f353de21b80 1 --2- 172.21.15.17:0/471274361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937cff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.629+0000 7f353de21b80 1 -- 172.21.15.17:0/471274361 >> 172.21.15.17:0/471274361 conn(0x555937cf0be0 msgr2=0x555937cf5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.629+0000 7f353de21b80 1 -- 172.21.15.17:0/471274361 shutdown_connections 2023-07-14T13:15:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.629+0000 7f353de21b80 1 -- 172.21.15.17:0/471274361 wait complete. 2023-07-14T13:15:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.630+0000 7f353de21b80 1 -- start start 2023-07-14T13:15:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.630+0000 7f353de21b80 1 Processor -- start 2023-07-14T13:15:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.631+0000 7f353de21b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 0x555937d0ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.631+0000 7f353de21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d08ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.631+0000 7f353de21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937d05ad0 0x555937d093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.631+0000 7f353de21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937beca60 con 0x555937d05680 2023-07-14T13:15:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.631+0000 7f353de21b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937bec760 con 0x555937b576b0 2023-07-14T13:15:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.631+0000 7f353de21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937ad08c0 con 0x555937d05ad0 2023-07-14T13:15:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.631+0000 7f353de21b80 10 client.0 _ll_register_callbacks cb 0x555937bea700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.631+0000 7f35237fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d08ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.631+0000 7f35237fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d08ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58308/0 (socket says 172.21.15.17:58308) 2023-07-14T13:15:53.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.631+0000 7f35237fe700 1 -- 172.21.15.17:0/1781574308 learned_addr learned my addr 172.21.15.17:0/1781574308 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:53.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.632+0000 7f3528b9c700 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937d05ad0 0x555937d093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.632+0000 7f3523fff700 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 0x555937d0ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.632+0000 7f3523fff700 1 -- 172.21.15.17:0/1781574308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937d05ad0 msgr2=0x555937d093e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.632+0000 7f3523fff700 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937d05ad0 0x555937d093e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.632+0000 7f3523fff700 1 -- 172.21.15.17:0/1781574308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 msgr2=0x555937d08ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.632+0000 7f3523fff700 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d08ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.632+0000 7f3523fff700 1 -- 172.21.15.17:0/1781574308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c009990 con 0x555937b576b0 2023-07-14T13:15:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.632+0000 7f35237fe700 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d08ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.633+0000 7f3523fff700 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 0x555937d0ba20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f35140cb990 tx=0x7f3514009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd117bd799712a29 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.633+0000 7f35037fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:15:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.633+0000 7f35037fe700 1 -- 172.21.15.17:0/1781574308 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351409ad00 con 0x555937b576b0 2023-07-14T13:15:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.633+0000 7f353de21b80 1 -- 172.21.15.17:0/1781574308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555937ba6490 con 0x555937b576b0 2023-07-14T13:15:53.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.633+0000 7f35037fe700 1 -- 172.21.15.17:0/1781574308 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3514004130 con 0x555937b576b0 2023-07-14T13:15:53.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.633+0000 7f35037fe700 1 -- 172.21.15.17:0/1781574308 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f351409b3a0 con 0x555937b576b0 2023-07-14T13:15:53.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.633+0000 7f353de21b80 10 client.27881 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:53.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.633+0000 7f353de21b80 1 -- 172.21.15.17:0/1781574308 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x555937a63c00 con 0x555937b576b0 2023-07-14T13:15:53.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.634+0000 7f35037fe700 1 -- 172.21.15.17:0/1781574308 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555937ba6490 con 0x555937b576b0 2023-07-14T13:15:53.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.634+0000 7f35037fe700 1 -- 172.21.15.17:0/1781574308 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f35140a32d0 con 0x555937b576b0 2023-07-14T13:15:53.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.634+0000 7f353de21b80 10 client.27881 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:53.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.634+0000 7f353de21b80 10 client.27881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.634+0000 7f353de21b80 20 client.27881 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.634+0000 7f353de21b80 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555937d18c10 0x555937d1b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.634+0000 7f353de21b80 4 client.27881 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:15:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.634+0000 7f353de21b80 1 -- 172.21.15.17:0/1781574308 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555937c45e50 con 0x555937d18c10 2023-07-14T13:15:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.635+0000 7f35237fe700 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555937d18c10 0x555937d1b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.636+0000 7f35237fe700 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555937d18c10 0x555937d1b020 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60c3918d8c0526e7 server_cookie=25dac86b65cd5a0e in_seq=0 out_seq=0 2023-07-14T13:15:53.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.636+0000 7f35037fe700 10 client.27881 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.636+0000 7f35037fe700 1 -- 172.21.15.17:0/1781574308 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555937c45e50 con 0x555937d18c10 2023-07-14T13:15:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.636+0000 7f35037fe700 10 client.27881 handle_command_reply: tid=0 2023-07-14T13:15:53.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.636+0000 7f353de21b80 1 client.27881 shutdown 2023-07-14T13:15:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.637+0000 7f353de21b80 1 -- 172.21.15.17:0/1781574308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 msgr2=0x555937d0ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.637+0000 7f353de21b80 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 0x555937d0ba20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f35140cb990 tx=0x7f3514009310 comp rx=0 tx=0).stop 2023-07-14T13:15:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.637+0000 7f353de21b80 1 -- 172.21.15.17:0/1781574308 shutdown_connections 2023-07-14T13:15:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.637+0000 7f353de21b80 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555937d18c10 0x555937d1b020 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.637+0000 7f353de21b80 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937d05ad0 0x555937d093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.637+0000 7f353de21b80 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 0x555937d0ba20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.637+0000 7f353de21b80 1 --2- 172.21.15.17:0/1781574308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d08ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.637+0000 7f353de21b80 1 -- 172.21.15.17:0/1781574308 >> 172.21.15.17:0/1781574308 conn(0x555937cf0be0 msgr2=0x555937cf54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.637+0000 7f35037fe700 0 client.27881 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.637+0000 7f353de21b80 1 -- 172.21.15.17:0/1781574308 shutdown_connections 2023-07-14T13:15:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.637+0000 7f353de21b80 1 -- 172.21.15.17:0/1781574308 wait complete. 2023-07-14T13:15:53.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.638+0000 7f353de21b80 20 client.27881 trim_cache size 0 max 16384 2023-07-14T13:15:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.657+0000 7f353de21b80 1 Processor -- start 2023-07-14T13:15:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.657+0000 7f353de21b80 1 -- start start 2023-07-14T13:15:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.657+0000 7f353de21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 0x555937cf5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.657+0000 7f353de21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.657+0000 7f353de21b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937d05ad0 0x555937d08590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f353de21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937d1b680 con 0x555937d05680 2023-07-14T13:15:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f353de21b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937d04d40 con 0x555937d05ad0 2023-07-14T13:15:53.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f353de21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937d03a20 con 0x555937b576b0 2023-07-14T13:15:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f35237fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f35237fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58316/0 (socket says 172.21.15.17:58316) 2023-07-14T13:15:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f35237fe700 1 -- 172.21.15.17:0/3075752475 learned_addr learned my addr 172.21.15.17:0/3075752475 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:53.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f3528b9c700 1 --2- 172.21.15.17:0/3075752475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937d05ad0 0x555937d08590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f3523fff700 1 --2- 172.21.15.17:0/3075752475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 0x555937cf5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f35237fe700 1 -- 172.21.15.17:0/3075752475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 msgr2=0x555937cf5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f35237fe700 1 --2- 172.21.15.17:0/3075752475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 0x555937cf5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f35237fe700 1 -- 172.21.15.17:0/3075752475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937d05ad0 msgr2=0x555937d08590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f35237fe700 1 --2- 172.21.15.17:0/3075752475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937d05ad0 0x555937d08590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.658+0000 7f35237fe700 1 -- 172.21.15.17:0/3075752475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555937aa11f0 con 0x555937d05680 2023-07-14T13:15:53.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.659+0000 7f35237fe700 1 --2- 172.21.15.17:0/3075752475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0b550 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x555937d1b8f0 tx=0x7f35180119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214e4ee5b302e44d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.659+0000 7f350affd700 1 -- 172.21.15.17:0/3075752475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518017040 con 0x555937d05680 2023-07-14T13:15:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.659+0000 7f350affd700 1 -- 172.21.15.17:0/3075752475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f351801c5a0 con 0x555937d05680 2023-07-14T13:15:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.659+0000 7f350affd700 1 -- 172.21.15.17:0/3075752475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35180038e0 con 0x555937d05680 2023-07-14T13:15:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.660+0000 7f353de21b80 1 -- 172.21.15.17:0/3075752475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 msgr2=0x555937d0b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.660+0000 7f353de21b80 1 --2- 172.21.15.17:0/3075752475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0b550 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x555937d1b8f0 tx=0x7f35180119f0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.660+0000 7f353de21b80 1 -- 172.21.15.17:0/3075752475 shutdown_connections 2023-07-14T13:15:53.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.660+0000 7f353de21b80 1 --2- 172.21.15.17:0/3075752475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937d05ad0 0x555937d08590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.660+0000 7f353de21b80 1 --2- 172.21.15.17:0/3075752475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937b576b0 0x555937cf5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.660+0000 7f353de21b80 1 --2- 172.21.15.17:0/3075752475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0b550 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.660+0000 7f353de21b80 1 -- 172.21.15.17:0/3075752475 >> 172.21.15.17:0/3075752475 conn(0x555937cf0be0 msgr2=0x555937d02ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.660+0000 7f353de21b80 1 -- 172.21.15.17:0/3075752475 shutdown_connections 2023-07-14T13:15:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.660+0000 7f353de21b80 1 -- 172.21.15.17:0/3075752475 wait complete. 2023-07-14T13:15:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.660+0000 7f353de21b80 1 -- start start 2023-07-14T13:15:53.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.661+0000 7f353de21b80 1 Processor -- start 2023-07-14T13:15:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.661+0000 7f353de21b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 0x555937d0e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.661+0000 7f353de21b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.661+0000 7f353de21b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937d05ad0 0x555937d6ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.661+0000 7f353de21b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937d6bfd0 con 0x555937d05680 2023-07-14T13:15:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.661+0000 7f353de21b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937d6c110 con 0x555937b576b0 2023-07-14T13:15:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.661+0000 7f353de21b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555937d6c250 con 0x555937d05ad0 2023-07-14T13:15:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.661+0000 7f353de21b80 10 client.0 _ll_register_callbacks cb 0x7f351409b170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:15:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.662+0000 7f35237fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.662+0000 7f35237fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58318/0 (socket says 172.21.15.17:58318) 2023-07-14T13:15:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.662+0000 7f35237fe700 1 -- 172.21.15.17:0/1452096730 learned_addr learned my addr 172.21.15.17:0/1452096730 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:15:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.662+0000 7f3523fff700 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 0x555937d0e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.662+0000 7f3528b9c700 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937d05ad0 0x555937d6ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.662+0000 7f35237fe700 1 -- 172.21.15.17:0/1452096730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937d05ad0 msgr2=0x555937d6ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.662+0000 7f35237fe700 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937d05ad0 0x555937d6ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.662+0000 7f35237fe700 1 -- 172.21.15.17:0/1452096730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 msgr2=0x555937d0e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:15:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.662+0000 7f35237fe700 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 0x555937d0e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.662+0000 7f35237fe700 1 -- 172.21.15.17:0/1452096730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3518011440 con 0x555937d05680 2023-07-14T13:15:53.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.662+0000 7f3523fff700 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 0x555937d0e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:15:53.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.663+0000 7f35237fe700 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0e7c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3518021000 tx=0x7f351800bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14d0223885dfec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:15:53.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.663+0000 7f35037fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:15:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.663+0000 7f35037fe700 1 -- 172.21.15.17:0/1452096730 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518017070 con 0x555937d05680 2023-07-14T13:15:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.663+0000 7f35037fe700 1 -- 172.21.15.17:0/1452096730 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f351801ce20 con 0x555937d05680 2023-07-14T13:15:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.663+0000 7f353de21b80 1 -- 172.21.15.17:0/1452096730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f351c00f050 con 0x555937d05680 2023-07-14T13:15:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.663+0000 7f35037fe700 1 -- 172.21.15.17:0/1452096730 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f351802e470 con 0x555937d05680 2023-07-14T13:15:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.663+0000 7f353de21b80 10 client.18171 fetch_fsmap learned FSMap version 43 2023-07-14T13:15:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.663+0000 7f353de21b80 1 -- 172.21.15.17:0/1452096730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x555937a79250 con 0x555937d05680 2023-07-14T13:15:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.664+0000 7f35037fe700 1 -- 172.21.15.17:0/1452096730 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f351c00f050 con 0x555937d05680 2023-07-14T13:15:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.664+0000 7f35037fe700 1 -- 172.21.15.17:0/1452096730 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 43) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3518025670 con 0x555937d05680 2023-07-14T13:15:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.664+0000 7f353de21b80 10 client.18171 fetch_fsmap finished waiting for FSMap version 43 2023-07-14T13:15:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.664+0000 7f353de21b80 10 client.18171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:15:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.664+0000 7f353de21b80 20 client.18171 populate_metadata read hostname 'smithi017' 2023-07-14T13:15:53.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.664+0000 7f353de21b80 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555937d6d8e0 0x555937d6fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:15:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.664+0000 7f353de21b80 4 client.18171 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:15:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.664+0000 7f353de21b80 1 -- 172.21.15.17:0/1452096730 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555937c07ff0 con 0x555937d6d8e0 2023-07-14T13:15:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.664+0000 7f3523fff700 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555937d6d8e0 0x555937d6fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:15:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.665+0000 7f3523fff700 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555937d6d8e0 0x555937d6fcf0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a3c38358653493 server_cookie=36eadbc48e59cfee in_seq=0 out_seq=0 2023-07-14T13:15:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.665+0000 7f35037fe700 10 client.18171 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:53.716 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:53 smithi135 ceph-mon[97338]: pgmap v507: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 27 MiB/s wr, 30 op/s 2023-07-14T13:15:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f35037fe700 1 -- 172.21.15.17:0/1452096730 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555937c07ff0 con 0x555937d6d8e0 2023-07-14T13:15:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f35037fe700 10 client.18171 handle_command_reply: tid=0 2023-07-14T13:15:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f353de21b80 1 client.18171 shutdown 2023-07-14T13:15:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f353de21b80 1 -- 172.21.15.17:0/1452096730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 msgr2=0x555937d0e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f353de21b80 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0e7c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3518021000 tx=0x7f351800bb00 comp rx=0 tx=0).stop 2023-07-14T13:15:53.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f353de21b80 1 -- 172.21.15.17:0/1452096730 shutdown_connections 2023-07-14T13:15:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f353de21b80 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555937d6d8e0 0x555937d6fcf0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f353de21b80 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555937d05ad0 0x555937d6ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f353de21b80 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555937b576b0 0x555937d0e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f35037fe700 0 client.18171 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:15:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f353de21b80 1 --2- 172.21.15.17:0/1452096730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555937d05680 0x555937d0e7c0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.674+0000 7f353de21b80 1 -- 172.21.15.17:0/1452096730 >> 172.21.15.17:0/1452096730 conn(0x555937cf0be0 msgr2=0x555937d08590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.675+0000 7f353de21b80 1 -- 172.21.15.17:0/1452096730 shutdown_connections 2023-07-14T13:15:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.675+0000 7f353de21b80 1 -- 172.21.15.17:0/1452096730 wait complete. 2023-07-14T13:15:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.675+0000 7f353de21b80 20 client.18171 trim_cache size 0 max 16384 2023-07-14T13:15:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:15:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:15:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:15:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:15:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.675+0000 7f352a5ff700 1 -- 172.21.15.17:0/954435514 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f350c0a1340 msgr2=0x7f350c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.675+0000 7f352a5ff700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f350c0a1340 0x7f350c0a37f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f351c020000 tx=0x7f351c01d000 comp rx=0 tx=0).stop 2023-07-14T13:15:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.675+0000 7f352a5ff700 1 -- 172.21.15.17:0/954435514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35240ffb00 msgr2=0x7f352419bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:15:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.675+0000 7f352a5ff700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35240ffb00 0x7f352419bbc0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f35140036c0 tx=0x7f35140057f0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.676+0000 7f352a5ff700 1 -- 172.21.15.17:0/954435514 shutdown_connections 2023-07-14T13:15:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.676+0000 7f352a5ff700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f350c0a1340 0x7f350c0a37f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.676+0000 7f352a5ff700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3524105b10 0x7f3524195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.676+0000 7f352a5ff700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35240ffb00 0x7f352419bbc0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.676+0000 7f352a5ff700 1 --2- 172.21.15.17:0/954435514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35241004b0 0x7f352419c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:15:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.676+0000 7f352a5ff700 1 -- 172.21.15.17:0/954435514 >> 172.21.15.17:0/954435514 conn(0x7f35240fb600 msgr2=0x7f35240fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:15:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.676+0000 7f352a5ff700 1 -- 172.21.15.17:0/954435514 shutdown_connections 2023-07-14T13:15:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:15:53.676+0000 7f352a5ff700 1 -- 172.21.15.17:0/954435514 wait complete. 2023-07-14T13:15:55.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:55 smithi131 ceph-mon[96953]: pgmap v508: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:15:55.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:55 smithi017 ceph-mon[95536]: pgmap v508: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:15:55.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:55 smithi135 ceph-mon[97338]: pgmap v508: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:15:57.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:57 smithi131 ceph-mon[96953]: pgmap v509: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-14T13:15:57.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:57 smithi017 ceph-mon[95536]: pgmap v509: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-14T13:15:57.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:57 smithi135 ceph-mon[97338]: pgmap v509: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-14T13:15:59.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:15:59 smithi131 ceph-mon[96953]: pgmap v510: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:15:59.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:15:59 smithi017 ceph-mon[95536]: pgmap v510: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:15:59.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:15:59 smithi135 ceph-mon[97338]: pgmap v510: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-14T13:16:00.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:00 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:16:00.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:00 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:16:00.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:00 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:16:01.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:01 smithi131 ceph-mon[96953]: pgmap v511: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 35 MiB/s wr, 25 op/s 2023-07-14T13:16:01.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:01 smithi017 ceph-mon[95536]: pgmap v511: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 35 MiB/s wr, 25 op/s 2023-07-14T13:16:01.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:01 smithi135 ceph-mon[97338]: pgmap v511: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 35 MiB/s wr, 25 op/s 2023-07-14T13:16:03.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:03 smithi131 ceph-mon[96953]: pgmap v512: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:16:03.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:03 smithi017 ceph-mon[95536]: pgmap v512: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:16:03.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:03 smithi135 ceph-mon[97338]: pgmap v512: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:16:05.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:05 smithi131 ceph-mon[96953]: pgmap v513: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:16:05.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:05 smithi131 ceph-mon[96953]: osdmap e110: 12 total, 12 up, 12 in 2023-07-14T13:16:05.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:05 smithi017 ceph-mon[95536]: pgmap v513: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:16:05.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:05 smithi017 ceph-mon[95536]: osdmap e110: 12 total, 12 up, 12 in 2023-07-14T13:16:05.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:05 smithi135 ceph-mon[97338]: pgmap v513: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:16:05.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:05 smithi135 ceph-mon[97338]: osdmap e110: 12 total, 12 up, 12 in 2023-07-14T13:16:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.854+0000 7f129b3ff700 1 -- 172.21.15.17:0/803485755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12940ffb30 msgr2=0x7f12940fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.854+0000 7f129b3ff700 1 --2- 172.21.15.17:0/803485755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12940ffb30 0x7f12940fffa0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1284009990 tx=0x7f1284009ca0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.855+0000 7f129b3ff700 1 -- 172.21.15.17:0/803485755 shutdown_connections 2023-07-14T13:16:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.855+0000 7f129b3ff700 1 --2- 172.21.15.17:0/803485755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12941004e0 0x7f129410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.855+0000 7f129b3ff700 1 --2- 172.21.15.17:0/803485755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1294105b60 0x7f1294105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.855+0000 7f129b3ff700 1 --2- 172.21.15.17:0/803485755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12940ffb30 0x7f12940fffa0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.855+0000 7f129b3ff700 1 -- 172.21.15.17:0/803485755 >> 172.21.15.17:0/803485755 conn(0x7f12940fb5f0 msgr2=0x7f12940fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.855+0000 7f129b3ff700 1 -- 172.21.15.17:0/803485755 shutdown_connections 2023-07-14T13:16:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.855+0000 7f129b3ff700 1 -- 172.21.15.17:0/803485755 wait complete. 2023-07-14T13:16:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.856+0000 7f129b3ff700 1 Processor -- start 2023-07-14T13:16:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.856+0000 7f129b3ff700 1 -- start start 2023-07-14T13:16:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129b3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12940ffb30 0x7f129419dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12941004e0 0x7f129419e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129b3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1294105b60 0x7f1294197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129b3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12941981b0 con 0x7f12940ffb30 2023-07-14T13:16:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129b3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294198320 con 0x7f1294105b60 2023-07-14T13:16:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12941984e0 con 0x7f12941004e0 2023-07-14T13:16:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12940ffb30 0x7f129419dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12940ffb30 0x7f129419dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50444/0 (socket says 172.21.15.17:50444) 2023-07-14T13:16:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129919b700 1 -- 172.21.15.17:0/281194562 learned_addr learned my addr 172.21.15.17:0/281194562 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129899a700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12941004e0 0x7f129419e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129999c700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1294105b60 0x7f1294197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129919b700 1 -- 172.21.15.17:0/281194562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12941004e0 msgr2=0x7f129419e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129919b700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12941004e0 0x7f129419e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129919b700 1 -- 172.21.15.17:0/281194562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1294105b60 msgr2=0x7f1294197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129919b700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1294105b60 0x7f1294197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.857+0000 7f129919b700 1 -- 172.21.15.17:0/281194562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12840095f0 con 0x7f12940ffb30 2023-07-14T13:16:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.858+0000 7f129919b700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12940ffb30 0x7f129419dce0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f129000b530 tx=0x7f129000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.858+0000 7f128a7fc700 1 -- 172.21.15.17:0/281194562 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290011830 con 0x7f12940ffb30 2023-07-14T13:16:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.858+0000 7f129b3ff700 1 -- 172.21.15.17:0/281194562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12941987c0 con 0x7f12940ffb30 2023-07-14T13:16:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.858+0000 7f128a7fc700 1 -- 172.21.15.17:0/281194562 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1290011e20 con 0x7f12940ffb30 2023-07-14T13:16:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.858+0000 7f128a7fc700 1 -- 172.21.15.17:0/281194562 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290010db0 con 0x7f12940ffb30 2023-07-14T13:16:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.858+0000 7f129b3ff700 1 -- 172.21.15.17:0/281194562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12941a4d50 con 0x7f12940ffb30 2023-07-14T13:16:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.862+0000 7f128a7fc700 1 -- 172.21.15.17:0/281194562 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1290011990 con 0x7f12940ffb30 2023-07-14T13:16:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.864+0000 7f128a7fc700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12800a12c0 0x7f12800a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.864+0000 7f12aee1ab80 1 Processor -- start 2023-07-14T13:16:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.864+0000 7f128a7fc700 1 -- 172.21.15.17:0/281194562 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f12900cc650 con 0x7f12940ffb30 2023-07-14T13:16:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.864+0000 7f129899a700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12800a12c0 0x7f12800a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.864+0000 7f12aee1ab80 1 -- start start 2023-07-14T13:16:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.864+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 0x55d00b837d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.864+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b8382d0 0x55d00b832040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b8329d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b737c50 con 0x55d00b832580 2023-07-14T13:16:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b78a9e0 con 0x55d00b8382d0 2023-07-14T13:16:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b783e70 con 0x55d00b68e6b0 2023-07-14T13:16:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f129899a700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12800a12c0 0x7f12800a3770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12940fef00 tx=0x7f128400b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f129919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 0x55d00b837d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f129999c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b8329d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f129919b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 0x55d00b837d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45528/0 (socket says 172.21.15.17:45528) 2023-07-14T13:16:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f129919b700 1 -- 172.21.15.17:0/4038089258 learned_addr learned my addr 172.21.15.17:0/4038089258 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f129899a700 1 --2- 172.21.15.17:0/4038089258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b8382d0 0x55d00b832040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f129919b700 1 -- 172.21.15.17:0/4038089258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b8382d0 msgr2=0x55d00b832040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f129919b700 1 --2- 172.21.15.17:0/4038089258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b8382d0 0x55d00b832040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f129919b700 1 -- 172.21.15.17:0/4038089258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 msgr2=0x55d00b8329d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f129919b700 1 --2- 172.21.15.17:0/4038089258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b8329d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.865+0000 7f129919b700 1 -- 172.21.15.17:0/4038089258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d00b5b1d80 con 0x55d00b68e6b0 2023-07-14T13:16:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.866+0000 7f129919b700 1 --2- 172.21.15.17:0/4038089258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 0x55d00b837d90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1290096230 tx=0x7f1290004860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea787eaf6fadb9d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:06.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.866+0000 7f127f7fe700 1 -- 172.21.15.17:0/4038089258 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290099120 con 0x55d00b68e6b0 2023-07-14T13:16:06.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.866+0000 7f127f7fe700 1 -- 172.21.15.17:0/4038089258 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12900104f0 con 0x55d00b68e6b0 2023-07-14T13:16:06.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.866+0000 7f127f7fe700 1 -- 172.21.15.17:0/4038089258 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12900b90b0 con 0x55d00b68e6b0 2023-07-14T13:16:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.867+0000 7f12aee1ab80 1 -- 172.21.15.17:0/4038089258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 msgr2=0x55d00b837d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.867+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/4038089258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 0x55d00b837d90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1290096230 tx=0x7f1290004860 comp rx=0 tx=0).stop 2023-07-14T13:16:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.867+0000 7f12aee1ab80 1 -- 172.21.15.17:0/4038089258 shutdown_connections 2023-07-14T13:16:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.867+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/4038089258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b8329d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.867+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/4038089258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 0x55d00b837d90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.867+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/4038089258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b8382d0 0x55d00b832040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.867+0000 7f12aee1ab80 1 -- 172.21.15.17:0/4038089258 >> 172.21.15.17:0/4038089258 conn(0x55d00b827be0 msgr2=0x55d00b82cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.867+0000 7f12aee1ab80 1 -- 172.21.15.17:0/4038089258 shutdown_connections 2023-07-14T13:16:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.867+0000 7f12aee1ab80 1 -- 172.21.15.17:0/4038089258 wait complete. 2023-07-14T13:16:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.868+0000 7f12aee1ab80 1 -- start start 2023-07-14T13:16:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.868+0000 7f12aee1ab80 1 Processor -- start 2023-07-14T13:16:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.868+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b68e6b0 0x55d00b83b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.868+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b832580 0x55d00b83be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.868+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b8382d0 0x55d00b83c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.868+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b723a60 con 0x55d00b68e6b0 2023-07-14T13:16:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.868+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b723760 con 0x55d00b832580 2023-07-14T13:16:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.868+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b6078c0 con 0x55d00b8382d0 2023-07-14T13:16:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.868+0000 7f12aee1ab80 10 client.0 _ll_register_callbacks cb 0x55d00b721700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b68e6b0 0x55d00b83b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b68e6b0 0x55d00b83b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50456/0 (socket says 172.21.15.17:50456) 2023-07-14T13:16:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129919b700 1 -- 172.21.15.17:0/3241224616 learned_addr learned my addr 172.21.15.17:0/3241224616 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129899a700 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b832580 0x55d00b83be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129999c700 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b8382d0 0x55d00b83c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129919b700 1 -- 172.21.15.17:0/3241224616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b8382d0 msgr2=0x55d00b83c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129919b700 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b8382d0 0x55d00b83c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129919b700 1 -- 172.21.15.17:0/3241224616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b832580 msgr2=0x55d00b83be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129919b700 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b832580 0x55d00b83be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129919b700 1 -- 172.21.15.17:0/3241224616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12941a4d50 con 0x55d00b68e6b0 2023-07-14T13:16:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129999c700 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b8382d0 0x55d00b83c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:16:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f129919b700 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b68e6b0 0x55d00b83b930 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f12900a16e0 tx=0x7f12900106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515b299baaa5f37f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.869+0000 7f127cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.870+0000 7f127cff9700 1 -- 172.21.15.17:0/3241224616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12900b92e0 con 0x55d00b68e6b0 2023-07-14T13:16:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.870+0000 7f127cff9700 1 -- 172.21.15.17:0/3241224616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f1290011c40 con 0x55d00b68e6b0 2023-07-14T13:16:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.870+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3241224616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d00b6dd490 con 0x55d00b68e6b0 2023-07-14T13:16:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.870+0000 7f127cff9700 1 -- 172.21.15.17:0/3241224616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f129009d7f0 con 0x55d00b68e6b0 2023-07-14T13:16:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.870+0000 7f12aee1ab80 10 client.18183 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.870+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3241224616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55d00b59ac00 con 0x55d00b68e6b0 2023-07-14T13:16:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.870+0000 7f127cff9700 1 -- 172.21.15.17:0/3241224616 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d00b6dd490 con 0x55d00b68e6b0 2023-07-14T13:16:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.870+0000 7f127cff9700 1 -- 172.21.15.17:0/3241224616 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f1290098d20 con 0x55d00b68e6b0 2023-07-14T13:16:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.870+0000 7f12aee1ab80 10 client.18183 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.870+0000 7f12aee1ab80 10 client.18183 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.871+0000 7f12aee1ab80 20 client.18183 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.871+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d00b84b8e0 0x55d00b84dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.871+0000 7f12aee1ab80 4 client.18183 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.871+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3241224616 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d00b77ce50 con 0x55d00b84b8e0 2023-07-14T13:16:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.871+0000 7f129899a700 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d00b84b8e0 0x55d00b84dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.872+0000 7f129899a700 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d00b84b8e0 0x55d00b84dcf0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45d4182bb7ae8d4c server_cookie=589768fb167e2b06 in_seq=0 out_seq=0 2023-07-14T13:16:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.872+0000 7f127cff9700 10 client.18183 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.872+0000 7f127cff9700 1 -- 172.21.15.17:0/3241224616 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d00b77ce50 con 0x55d00b84b8e0 2023-07-14T13:16:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f127cff9700 10 client.18183 handle_command_reply: tid=0 2023-07-14T13:16:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 1 client.18183 shutdown 2023-07-14T13:16:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3241224616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b68e6b0 msgr2=0x55d00b83b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b68e6b0 0x55d00b83b930 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f12900a16e0 tx=0x7f12900106e0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3241224616 shutdown_connections 2023-07-14T13:16:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d00b84b8e0 0x55d00b84dcf0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b8382d0 0x55d00b83c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b68e6b0 0x55d00b83b930 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/3241224616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b832580 0x55d00b83be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3241224616 >> 172.21.15.17:0/3241224616 conn(0x55d00b827be0 msgr2=0x55d00b82c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f127cff9700 0 client.18183 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3241224616 shutdown_connections 2023-07-14T13:16:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3241224616 wait complete. 2023-07-14T13:16:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.873+0000 7f12aee1ab80 20 client.18183 trim_cache size 0 max 16384 2023-07-14T13:16:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.897+0000 7f12aee1ab80 1 Processor -- start 2023-07-14T13:16:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.897+0000 7f12aee1ab80 1 -- start start 2023-07-14T13:16:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.897+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b68e6b0 0x55d00b832040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.897+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b842c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.897+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b8382d0 0x55d00b8371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.897+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b829d40 con 0x55d00b832580 2023-07-14T13:16:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.897+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b8379e0 con 0x55d00b68e6b0 2023-07-14T13:16:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.897+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b8295f0 con 0x55d00b8382d0 2023-07-14T13:16:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.898+0000 7f129899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b842c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.898+0000 7f129899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b842c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50472/0 (socket says 172.21.15.17:50472) 2023-07-14T13:16:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.898+0000 7f129899a700 1 -- 172.21.15.17:0/3518006438 learned_addr learned my addr 172.21.15.17:0/3518006438 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.898+0000 7f129999c700 1 --2- 172.21.15.17:0/3518006438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b8382d0 0x55d00b8371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.898+0000 7f129919b700 1 --2- 172.21.15.17:0/3518006438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b68e6b0 0x55d00b832040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.898+0000 7f129899a700 1 -- 172.21.15.17:0/3518006438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b8382d0 msgr2=0x55d00b8371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.898+0000 7f129899a700 1 --2- 172.21.15.17:0/3518006438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b8382d0 0x55d00b8371e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.898+0000 7f129899a700 1 -- 172.21.15.17:0/3518006438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b68e6b0 msgr2=0x55d00b832040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.898+0000 7f129899a700 1 --2- 172.21.15.17:0/3518006438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b68e6b0 0x55d00b832040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.898+0000 7f129899a700 1 -- 172.21.15.17:0/3518006438 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d00b5d81f0 con 0x55d00b832580 2023-07-14T13:16:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.898+0000 7f129899a700 1 --2- 172.21.15.17:0/3518006438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b842c70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1284009990 tx=0x7f1284020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a4c51b28812500 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.899+0000 7f127ffff700 1 -- 172.21.15.17:0/3518006438 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284033a60 con 0x55d00b832580 2023-07-14T13:16:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.899+0000 7f127ffff700 1 -- 172.21.15.17:0/3518006438 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f128401e040 con 0x55d00b832580 2023-07-14T13:16:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.899+0000 7f127ffff700 1 -- 172.21.15.17:0/3518006438 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284004760 con 0x55d00b832580 2023-07-14T13:16:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.899+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3518006438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 msgr2=0x55d00b842c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.899+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/3518006438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b842c70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1284009990 tx=0x7f1284020000 comp rx=0 tx=0).stop 2023-07-14T13:16:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.900+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3518006438 shutdown_connections 2023-07-14T13:16:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.900+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/3518006438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b8382d0 0x55d00b8371e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.900+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/3518006438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b68e6b0 0x55d00b832040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.900+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/3518006438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b842c70 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.900+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3518006438 >> 172.21.15.17:0/3518006438 conn(0x55d00b827be0 msgr2=0x55d00b836ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.900+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3518006438 shutdown_connections 2023-07-14T13:16:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.900+0000 7f12aee1ab80 1 -- 172.21.15.17:0/3518006438 wait complete. 2023-07-14T13:16:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.900+0000 7f12aee1ab80 1 -- start start 2023-07-14T13:16:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.900+0000 7f12aee1ab80 1 Processor -- start 2023-07-14T13:16:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.901+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 0x55d00b897b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.901+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b898080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.901+0000 7f12aee1ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b8382d0 0x55d00b8936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.901+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b893dd0 con 0x55d00b832580 2023-07-14T13:16:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.901+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b893f40 con 0x55d00b8382d0 2023-07-14T13:16:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.901+0000 7f12aee1ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d00b894100 con 0x55d00b68e6b0 2023-07-14T13:16:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.901+0000 7f12aee1ab80 10 client.0 _ll_register_callbacks cb 0x55d00b721700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.901+0000 7f129899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b898080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.901+0000 7f129899a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b898080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50488/0 (socket says 172.21.15.17:50488) 2023-07-14T13:16:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.901+0000 7f129899a700 1 -- 172.21.15.17:0/829978960 learned_addr learned my addr 172.21.15.17:0/829978960 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.901+0000 7f129999c700 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b8382d0 0x55d00b8936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.902+0000 7f129919b700 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 0x55d00b897b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.902+0000 7f129899a700 1 -- 172.21.15.17:0/829978960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 msgr2=0x55d00b897b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.902+0000 7f129899a700 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 0x55d00b897b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.902+0000 7f129899a700 1 -- 172.21.15.17:0/829978960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b8382d0 msgr2=0x55d00b8936f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.902+0000 7f129899a700 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b8382d0 0x55d00b8936f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.902+0000 7f129899a700 1 -- 172.21.15.17:0/829978960 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129410d220 con 0x55d00b832580 2023-07-14T13:16:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.902+0000 7f129899a700 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b898080 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f128400ba10 tx=0x7f1284009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a65d3f2fce55c71 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.902+0000 7f127cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.902+0000 7f127cff9700 1 -- 172.21.15.17:0/829978960 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284040070 con 0x55d00b832580 2023-07-14T13:16:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.902+0000 7f12aee1ab80 1 -- 172.21.15.17:0/829978960 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12900104f0 con 0x55d00b832580 2023-07-14T13:16:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.902+0000 7f127cff9700 1 -- 172.21.15.17:0/829978960 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f1284033260 con 0x55d00b832580 2023-07-14T13:16:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.903+0000 7f127cff9700 1 -- 172.21.15.17:0/829978960 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1284033420 con 0x55d00b832580 2023-07-14T13:16:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.903+0000 7f12aee1ab80 10 client.18189 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.903+0000 7f12aee1ab80 1 -- 172.21.15.17:0/829978960 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55d00b5b0250 con 0x55d00b832580 2023-07-14T13:16:06.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.903+0000 7f127cff9700 1 -- 172.21.15.17:0/829978960 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12900104f0 con 0x55d00b832580 2023-07-14T13:16:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.903+0000 7f127cff9700 1 -- 172.21.15.17:0/829978960 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f1284043020 con 0x55d00b832580 2023-07-14T13:16:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.903+0000 7f12aee1ab80 10 client.18189 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.903+0000 7f12aee1ab80 10 client.18189 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.903+0000 7f12aee1ab80 20 client.18189 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.903+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d00b8a0470 0x55d00b8a2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.903+0000 7f12aee1ab80 4 client.18189 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:16:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.903+0000 7f12aee1ab80 1 -- 172.21.15.17:0/829978960 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d00b73eff0 con 0x55d00b8a0470 2023-07-14T13:16:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.904+0000 7f129919b700 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d00b8a0470 0x55d00b8a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.904+0000 7f129919b700 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d00b8a0470 0x55d00b8a2850 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f99fb9b2e451895 server_cookie=42ada94aa3d55a07 in_seq=0 out_seq=0 2023-07-14T13:16:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.904+0000 7f127cff9700 10 client.18189 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f127cff9700 1 -- 172.21.15.17:0/829978960 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d00b73eff0 con 0x55d00b8a0470 2023-07-14T13:16:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f127cff9700 10 client.18189 handle_command_reply: tid=0 2023-07-14T13:16:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f12aee1ab80 1 client.18189 shutdown 2023-07-14T13:16:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f12aee1ab80 1 -- 172.21.15.17:0/829978960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 msgr2=0x55d00b898080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b898080 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f128400ba10 tx=0x7f1284009290 comp rx=0 tx=0).stop 2023-07-14T13:16:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f12aee1ab80 1 -- 172.21.15.17:0/829978960 shutdown_connections 2023-07-14T13:16:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d00b8a0470 0x55d00b8a2850 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d00b8382d0 0x55d00b8936f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d00b68e6b0 0x55d00b897b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f12aee1ab80 1 --2- 172.21.15.17:0/829978960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d00b832580 0x55d00b898080 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f127cff9700 0 client.18189 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f12aee1ab80 1 -- 172.21.15.17:0/829978960 >> 172.21.15.17:0/829978960 conn(0x55d00b827be0 msgr2=0x55d00b8388a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f12aee1ab80 1 -- 172.21.15.17:0/829978960 shutdown_connections 2023-07-14T13:16:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.914+0000 7f12aee1ab80 1 -- 172.21.15.17:0/829978960 wait complete. 2023-07-14T13:16:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.915+0000 7f12aee1ab80 20 client.18189 trim_cache size 0 max 16384 2023-07-14T13:16:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:16:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:16:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:16:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:16:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.915+0000 7f129b3ff700 1 -- 172.21.15.17:0/281194562 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12800a12c0 msgr2=0x7f12800a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.915+0000 7f129b3ff700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12800a12c0 0x7f12800a3770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12940fef00 tx=0x7f128400b260 comp rx=0 tx=0).stop 2023-07-14T13:16:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.915+0000 7f129b3ff700 1 -- 172.21.15.17:0/281194562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12940ffb30 msgr2=0x7f129419dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.915+0000 7f129b3ff700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12940ffb30 0x7f129419dce0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f129000b530 tx=0x7f129000b840 comp rx=0 tx=0).stop 2023-07-14T13:16:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.915+0000 7f129b3ff700 1 -- 172.21.15.17:0/281194562 shutdown_connections 2023-07-14T13:16:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.915+0000 7f129b3ff700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12800a12c0 0x7f12800a3770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.915+0000 7f129b3ff700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1294105b60 0x7f1294197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.915+0000 7f129b3ff700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12940ffb30 0x7f129419dce0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.915+0000 7f129b3ff700 1 --2- 172.21.15.17:0/281194562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12941004e0 0x7f129419e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.915+0000 7f129b3ff700 1 -- 172.21.15.17:0/281194562 >> 172.21.15.17:0/281194562 conn(0x7f12940fb5f0 msgr2=0x7f12940fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.916+0000 7f129b3ff700 1 -- 172.21.15.17:0/281194562 shutdown_connections 2023-07-14T13:16:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:06.916+0000 7f129b3ff700 1 -- 172.21.15.17:0/281194562 wait complete. 2023-07-14T13:16:07.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:07 smithi131 ceph-mon[96953]: pgmap v515: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 29 MiB/s wr, 37 op/s 2023-07-14T13:16:07.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:07 smithi017 ceph-mon[95536]: pgmap v515: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 29 MiB/s wr, 37 op/s 2023-07-14T13:16:07.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:07 smithi135 ceph-mon[97338]: pgmap v515: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 29 MiB/s wr, 37 op/s 2023-07-14T13:16:08.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:16:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.107+0000 7f57119ff700 1 -- 172.21.15.17:0/2589183967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f570c101470 msgr2=0x7f570c109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.107+0000 7f57119ff700 1 --2- 172.21.15.17:0/2589183967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f570c101470 0x7f570c109b40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5700009990 tx=0x7f5700009ca0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.107+0000 7f57119ff700 1 -- 172.21.15.17:0/2589183967 shutdown_connections 2023-07-14T13:16:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.107+0000 7f57119ff700 1 --2- 172.21.15.17:0/2589183967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c10a080 0x7f570c10c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.107+0000 7f57119ff700 1 --2- 172.21.15.17:0/2589183967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c100b60 0x7f570c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.107+0000 7f57119ff700 1 --2- 172.21.15.17:0/2589183967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f570c101470 0x7f570c109b40 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.107+0000 7f57119ff700 1 -- 172.21.15.17:0/2589183967 >> 172.21.15.17:0/2589183967 conn(0x7f570c0fa4b0 msgr2=0x7f570c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.108+0000 7f57119ff700 1 -- 172.21.15.17:0/2589183967 shutdown_connections 2023-07-14T13:16:09.148 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.108+0000 7f57119ff700 1 -- 172.21.15.17:0/2589183967 wait complete. 2023-07-14T13:16:09.149 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.109+0000 7f57119ff700 1 Processor -- start 2023-07-14T13:16:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.109+0000 7f57119ff700 1 -- start start 2023-07-14T13:16:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.110+0000 7f57119ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c100b60 0x7f570c197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.110+0000 7f57119ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c101470 0x7f570c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.110+0000 7f57119ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f570c10a080 0x7f570c19c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.110+0000 7f57119ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c19cd70 con 0x7f570c10a080 2023-07-14T13:16:09.150 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.110+0000 7f57119ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c19cee0 con 0x7f570c101470 2023-07-14T13:16:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.110+0000 7f57119ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c19d0a0 con 0x7f570c100b60 2023-07-14T13:16:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.110+0000 7f570b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f570c10a080 0x7f570c19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.110+0000 7f570b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f570c10a080 0x7f570c19c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50496/0 (socket says 172.21.15.17:50496) 2023-07-14T13:16:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.110+0000 7f570b7fe700 1 -- 172.21.15.17:0/682925634 learned_addr learned my addr 172.21.15.17:0/682925634 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.110+0000 7f570a7fc700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c101470 0x7f570c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.151 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.110+0000 7f570affd700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c100b60 0x7f570c197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.111+0000 7f570b7fe700 1 -- 172.21.15.17:0/682925634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c100b60 msgr2=0x7f570c197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.152 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.111+0000 7f570b7fe700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c100b60 0x7f570c197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.111+0000 7f570b7fe700 1 -- 172.21.15.17:0/682925634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c101470 msgr2=0x7f570c1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.111+0000 7f570b7fe700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c101470 0x7f570c1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.111+0000 7f570b7fe700 1 -- 172.21.15.17:0/682925634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57000095f0 con 0x7f570c10a080 2023-07-14T13:16:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.111+0000 7f570b7fe700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f570c10a080 0x7f570c19c730 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5704007ee0 tx=0x7f570400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.111+0000 7f57109fd700 1 -- 172.21.15.17:0/682925634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400dd20 con 0x7f570c10a080 2023-07-14T13:16:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.111+0000 7f57109fd700 1 -- 172.21.15.17:0/682925634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f570400f040 con 0x7f570c10a080 2023-07-14T13:16:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.111+0000 7f57119ff700 1 -- 172.21.15.17:0/682925634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570c19d380 con 0x7f570c10a080 2023-07-14T13:16:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.111+0000 7f57109fd700 1 -- 172.21.15.17:0/682925634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704004750 con 0x7f570c10a080 2023-07-14T13:16:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.111+0000 7f57119ff700 1 -- 172.21.15.17:0/682925634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570c1a4bc0 con 0x7f570c10a080 2023-07-14T13:16:09.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.116+0000 7f57109fd700 1 -- 172.21.15.17:0/682925634 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5704003a00 con 0x7f570c10a080 2023-07-14T13:16:09.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.117+0000 7f5725382b80 1 Processor -- start 2023-07-14T13:16:09.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.117+0000 7f5725382b80 1 -- start start 2023-07-14T13:16:09.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.118+0000 7f5725382b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac62d0 0x563c81ac66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.118+0000 7f5725382b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ad1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.118+0000 7f5725382b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ad1ad0 0x563c81ad3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.118+0000 7f5725382b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c819cccb0 con 0x563c81ac62d0 2023-07-14T13:16:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.118+0000 7f5725382b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81a1fa40 con 0x563c81ac6be0 2023-07-14T13:16:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.118+0000 7f5725382b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81a18ed0 con 0x563c81ad1ad0 2023-07-14T13:16:09.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.118+0000 7f570a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac62d0 0x563c81ac66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.118+0000 7f570a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac62d0 0x563c81ac66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50510/0 (socket says 172.21.15.17:50510) 2023-07-14T13:16:09.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.118+0000 7f570a7fc700 1 -- 172.21.15.17:0/3794066257 learned_addr learned my addr 172.21.15.17:0/3794066257 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:09.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.118+0000 7f570affd700 1 --2- 172.21.15.17:0/3794066257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ad1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.118+0000 7f57109fd700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f56f40a1340 0x7f56f40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.119+0000 7f570a7fc700 1 -- 172.21.15.17:0/3794066257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ad1ad0 msgr2=0x563c81ad3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:09.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.119+0000 7f570a7fc700 1 --2- 172.21.15.17:0/3794066257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ad1ad0 0x563c81ad3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.119+0000 7f570a7fc700 1 -- 172.21.15.17:0/3794066257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 msgr2=0x563c81ad1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:09.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.119+0000 7f570a7fc700 1 --2- 172.21.15.17:0/3794066257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ad1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.119+0000 7f570a7fc700 1 -- 172.21.15.17:0/3794066257 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c81846de0 con 0x563c81ac62d0 2023-07-14T13:16:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.119+0000 7f57109fd700 1 -- 172.21.15.17:0/682925634 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f57040cc500 con 0x7f570c10a080 2023-07-14T13:16:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.119+0000 7f570b7fe700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f56f40a1340 0x7f56f40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.119+0000 7f570a7fc700 1 --2- 172.21.15.17:0/3794066257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac62d0 0x563c81ac66a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5700009990 tx=0x7f5700005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2256dc82dff32bbe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.119+0000 7f56f1ffb700 1 -- 172.21.15.17:0/3794066257 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570001d040 con 0x563c81ac62d0 2023-07-14T13:16:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.119+0000 7f56f1ffb700 1 -- 172.21.15.17:0/3794066257 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5700005600 con 0x563c81ac62d0 2023-07-14T13:16:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.119+0000 7f56f1ffb700 1 -- 172.21.15.17:0/3794066257 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5700004500 con 0x563c81ac62d0 2023-07-14T13:16:09.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.120+0000 7f5725382b80 1 -- 172.21.15.17:0/3794066257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac62d0 msgr2=0x563c81ac66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.163 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.120+0000 7f570b7fe700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f56f40a1340 0x7f56f40a37f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5704096030 tx=0x7f5704004130 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:09.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.120+0000 7f5725382b80 1 --2- 172.21.15.17:0/3794066257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac62d0 0x563c81ac66a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5700009990 tx=0x7f5700005c70 comp rx=0 tx=0).stop 2023-07-14T13:16:09.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.120+0000 7f5725382b80 1 -- 172.21.15.17:0/3794066257 shutdown_connections 2023-07-14T13:16:09.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.120+0000 7f5725382b80 1 --2- 172.21.15.17:0/3794066257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ad1ad0 0x563c81ad3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.120+0000 7f5725382b80 1 --2- 172.21.15.17:0/3794066257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac62d0 0x563c81ac66a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.120+0000 7f5725382b80 1 --2- 172.21.15.17:0/3794066257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ad1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.120+0000 7f5725382b80 1 -- 172.21.15.17:0/3794066257 >> 172.21.15.17:0/3794066257 conn(0x563c81abcda0 msgr2=0x563c81ac26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:09.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.120+0000 7f5725382b80 1 -- 172.21.15.17:0/3794066257 shutdown_connections 2023-07-14T13:16:09.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.121+0000 7f5725382b80 1 -- 172.21.15.17:0/3794066257 wait complete. 2023-07-14T13:16:09.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.121+0000 7f5725382b80 1 -- start start 2023-07-14T13:16:09.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.121+0000 7f5725382b80 1 Processor -- start 2023-07-14T13:16:09.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f5725382b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ac62d0 0x563c81ad14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f5725382b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ace740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f5725382b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 0x563c81acedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f5725382b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c819b8ac0 con 0x563c81ad1ad0 2023-07-14T13:16:09.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f5725382b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c819b87c0 con 0x563c81ac6be0 2023-07-14T13:16:09.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f5725382b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c8189c920 con 0x563c81ac62d0 2023-07-14T13:16:09.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f5725382b80 10 client.0 _ll_register_callbacks cb 0x563c819b6760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:09.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f570a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 0x563c81acedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.166 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f570a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ac62d0 0x563c81ad14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f570affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ace740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f570a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ac62d0 0x563c81ad14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45588/0 (socket says 172.21.15.17:45588) 2023-07-14T13:16:09.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.122+0000 7f570a7fc700 1 -- 172.21.15.17:0/607679418 learned_addr learned my addr 172.21.15.17:0/607679418 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:09.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.123+0000 7f570affd700 1 -- 172.21.15.17:0/607679418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ac62d0 msgr2=0x563c81ad14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:09.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.123+0000 7f570affd700 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ac62d0 0x563c81ad14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.123+0000 7f570affd700 1 -- 172.21.15.17:0/607679418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 msgr2=0x563c81acedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:09.167 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.123+0000 7f570affd700 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 0x563c81acedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.123+0000 7f570affd700 1 -- 172.21.15.17:0/607679418 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5700020040 con 0x563c81ac6be0 2023-07-14T13:16:09.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.123+0000 7f570a7fc700 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 0x563c81acedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:09.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.123+0000 7f570affd700 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ace740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f56fc005950 tx=0x7f56fc00baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e26f567c6d7990e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:09.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.123+0000 7f56eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:16:09.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.123+0000 7f56eaffd700 1 -- 172.21.15.17:0/607679418 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc003c10 con 0x563c81ac6be0 2023-07-14T13:16:09.168 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.123+0000 7f5725382b80 1 -- 172.21.15.17:0/607679418 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c819724f0 con 0x563c81ac6be0 2023-07-14T13:16:09.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.123+0000 7f56eaffd700 1 -- 172.21.15.17:0/607679418 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f56fc003d70 con 0x563c81ac6be0 2023-07-14T13:16:09.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.124+0000 7f56eaffd700 1 -- 172.21.15.17:0/607679418 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56fc01b440 con 0x563c81ac6be0 2023-07-14T13:16:09.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.124+0000 7f5725382b80 10 client.27917 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:09.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.124+0000 7f5725382b80 1 -- 172.21.15.17:0/607679418 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x563c8182fc60 con 0x563c81ac6be0 2023-07-14T13:16:09.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.124+0000 7f56eaffd700 1 -- 172.21.15.17:0/607679418 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563c819724f0 con 0x563c81ac6be0 2023-07-14T13:16:09.169 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.124+0000 7f56eaffd700 1 -- 172.21.15.17:0/607679418 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f56fc0115e0 con 0x563c81ac6be0 2023-07-14T13:16:09.170 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.124+0000 7f5725382b80 10 client.27917 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:09.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.124+0000 7f5725382b80 10 client.27917 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:09.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.124+0000 7f5725382b80 20 client.27917 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:09.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.124+0000 7f5725382b80 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563c81ae1500 0x563c81ae3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.125+0000 7f5725382b80 4 client.27917 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:09.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.125+0000 7f5725382b80 1 -- 172.21.15.17:0/607679418 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c81a11eb0 con 0x563c81ae1500 2023-07-14T13:16:09.171 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.125+0000 7f570a7fc700 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563c81ae1500 0x563c81ae3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.126+0000 7f56eaffd700 10 client.27917 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:09.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.126+0000 7f570a7fc700 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563c81ae1500 0x563c81ae3910 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e503d9cb2b93512 server_cookie=b310d0a7dda50d6e in_seq=0 out_seq=0 2023-07-14T13:16:09.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.126+0000 7f56eaffd700 1 -- 172.21.15.17:0/607679418 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563c81a11eb0 con 0x563c81ae1500 2023-07-14T13:16:09.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.126+0000 7f56eaffd700 10 client.27917 handle_command_reply: tid=0 2023-07-14T13:16:09.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 1 client.27917 shutdown 2023-07-14T13:16:09.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 1 -- 172.21.15.17:0/607679418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 msgr2=0x563c81ace740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ace740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f56fc005950 tx=0x7f56fc00baf0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 1 -- 172.21.15.17:0/607679418 shutdown_connections 2023-07-14T13:16:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563c81ae1500 0x563c81ae3910 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 0x563c81acedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ac62d0 0x563c81ad14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f56eaffd700 0 client.27917 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:09.173 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 1 --2- 172.21.15.17:0/607679418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ace740 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 1 -- 172.21.15.17:0/607679418 >> 172.21.15.17:0/607679418 conn(0x563c81abcda0 msgr2=0x563c81ac2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:09.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 1 -- 172.21.15.17:0/607679418 shutdown_connections 2023-07-14T13:16:09.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 1 -- 172.21.15.17:0/607679418 wait complete. 2023-07-14T13:16:09.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.127+0000 7f5725382b80 20 client.27917 trim_cache size 0 max 16384 2023-07-14T13:16:09.190 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.151+0000 7f5725382b80 1 Processor -- start 2023-07-14T13:16:09.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.151+0000 7f5725382b80 1 -- start start 2023-07-14T13:16:09.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.152+0000 7f5725382b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac62d0 0x563c81ad84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.191 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.152+0000 7f5725382b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac6be0 0x563c81ac9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.152+0000 7f5725382b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ad1ad0 0x563c81ac9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.152+0000 7f5725382b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81ac3d20 con 0x563c81ac6be0 2023-07-14T13:16:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.152+0000 7f5725382b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81ac7540 con 0x563c81ac62d0 2023-07-14T13:16:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.152+0000 7f5725382b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81ac81a0 con 0x563c81ad1ad0 2023-07-14T13:16:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.152+0000 7f570a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac62d0 0x563c81ad84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.153+0000 7f570a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac62d0 0x563c81ad84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60440/0 (socket says 172.21.15.17:60440) 2023-07-14T13:16:09.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.153+0000 7f570a7fc700 1 -- 172.21.15.17:0/3974360369 learned_addr learned my addr 172.21.15.17:0/3974360369 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.153+0000 7f570a7fc700 1 --2- 172.21.15.17:0/3974360369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ad1ad0 0x563c81ac9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.153+0000 7f570affd700 1 --2- 172.21.15.17:0/3974360369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac6be0 0x563c81ac9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.153+0000 7f570affd700 1 -- 172.21.15.17:0/3974360369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ad1ad0 msgr2=0x563c81ac9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.153+0000 7f570affd700 1 --2- 172.21.15.17:0/3974360369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ad1ad0 0x563c81ac9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.153+0000 7f570affd700 1 -- 172.21.15.17:0/3974360369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac62d0 msgr2=0x563c81ad84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.153+0000 7f570affd700 1 --2- 172.21.15.17:0/3974360369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac62d0 0x563c81ad84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.153+0000 7f570affd700 1 -- 172.21.15.17:0/3974360369 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c8186d250 con 0x563c81ac6be0 2023-07-14T13:16:09.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.154+0000 7f570affd700 1 --2- 172.21.15.17:0/3974360369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac6be0 0x563c81ac9a30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f56fc011940 tx=0x7f56fc00be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a176c5ba739da04 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:09.195 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.154+0000 7f56f27fc700 1 -- 172.21.15.17:0/3974360369 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc011440 con 0x563c81ac6be0 2023-07-14T13:16:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.154+0000 7f56f27fc700 1 -- 172.21.15.17:0/3974360369 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56fc003ea0 con 0x563c81ac6be0 2023-07-14T13:16:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.154+0000 7f56f27fc700 1 -- 172.21.15.17:0/3974360369 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc005490 con 0x563c81ac6be0 2023-07-14T13:16:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.155+0000 7f5725382b80 1 -- 172.21.15.17:0/3974360369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac6be0 msgr2=0x563c81ac9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.155+0000 7f5725382b80 1 --2- 172.21.15.17:0/3974360369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac6be0 0x563c81ac9a30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f56fc011940 tx=0x7f56fc00be40 comp rx=0 tx=0).stop 2023-07-14T13:16:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.156+0000 7f5725382b80 1 -- 172.21.15.17:0/3974360369 shutdown_connections 2023-07-14T13:16:09.196 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.156+0000 7f5725382b80 1 --2- 172.21.15.17:0/3974360369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ad1ad0 0x563c81ac9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.156+0000 7f5725382b80 1 --2- 172.21.15.17:0/3974360369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac62d0 0x563c81ad84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.156+0000 7f5725382b80 1 --2- 172.21.15.17:0/3974360369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ac6be0 0x563c81ac9a30 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.156+0000 7f5725382b80 1 -- 172.21.15.17:0/3974360369 >> 172.21.15.17:0/3974360369 conn(0x563c81abcda0 msgr2=0x563c81add6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.156+0000 7f5725382b80 1 -- 172.21.15.17:0/3974360369 shutdown_connections 2023-07-14T13:16:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.156+0000 7f5725382b80 1 -- 172.21.15.17:0/3974360369 wait complete. 2023-07-14T13:16:09.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.156+0000 7f5725382b80 1 -- start start 2023-07-14T13:16:09.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.157+0000 7f5725382b80 1 Processor -- start 2023-07-14T13:16:09.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.157+0000 7f5725382b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ac62d0 0x563c81ad4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.158+0000 7f5725382b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ad5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.158+0000 7f5725382b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 0x563c81b35380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.199 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.158+0000 7f5725382b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81ad5cb0 con 0x563c81ad1ad0 2023-07-14T13:16:09.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.158+0000 7f5725382b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81b358c0 con 0x563c81ac6be0 2023-07-14T13:16:09.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.158+0000 7f5725382b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81b35a00 con 0x563c81ac62d0 2023-07-14T13:16:09.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.158+0000 7f5725382b80 10 client.0 _ll_register_callbacks cb 0x7f56fc0041d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:09.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.158+0000 7f570a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 0x563c81b35380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.158+0000 7f570a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 0x563c81b35380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50530/0 (socket says 172.21.15.17:50530) 2023-07-14T13:16:09.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.158+0000 7f570a7fc700 1 -- 172.21.15.17:0/3968933949 learned_addr learned my addr 172.21.15.17:0/3968933949 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.158+0000 7f570affd700 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ad5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.158+0000 7f570a7fc700 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ac62d0 0x563c81ad4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.159+0000 7f570a7fc700 1 -- 172.21.15.17:0/3968933949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ac62d0 msgr2=0x563c81ad4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.159+0000 7f570a7fc700 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ac62d0 0x563c81ad4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.159+0000 7f570a7fc700 1 -- 172.21.15.17:0/3968933949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 msgr2=0x563c81ad5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.159+0000 7f570a7fc700 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ad5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.159+0000 7f570a7fc700 1 -- 172.21.15.17:0/3968933949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c8182fc60 con 0x563c81ad1ad0 2023-07-14T13:16:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.159+0000 7f570a7fc700 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 0x563c81b35380 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5700009990 tx=0x7f570001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f0e993e72aef1a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.159+0000 7f56eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.159+0000 7f56eaffd700 1 -- 172.21.15.17:0/3968933949 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570001d070 con 0x563c81ad1ad0 2023-07-14T13:16:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.159+0000 7f56eaffd700 1 -- 172.21.15.17:0/3968933949 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f5700036d90 con 0x563c81ad1ad0 2023-07-14T13:16:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.159+0000 7f5725382b80 1 -- 172.21.15.17:0/3968933949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5700005600 con 0x563c81ad1ad0 2023-07-14T13:16:09.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.160+0000 7f56eaffd700 1 -- 172.21.15.17:0/3968933949 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57000360b0 con 0x563c81ad1ad0 2023-07-14T13:16:09.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.160+0000 7f5725382b80 10 client.18207 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:09.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.160+0000 7f5725382b80 1 -- 172.21.15.17:0/3968933949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x563c818452b0 con 0x563c81ad1ad0 2023-07-14T13:16:09.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.160+0000 7f56eaffd700 1 -- 172.21.15.17:0/3968933949 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5700005600 con 0x563c81ad1ad0 2023-07-14T13:16:09.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.160+0000 7f56eaffd700 1 -- 172.21.15.17:0/3968933949 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f5700004c20 con 0x563c81ad1ad0 2023-07-14T13:16:09.204 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.160+0000 7f5725382b80 10 client.18207 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.160+0000 7f5725382b80 10 client.18207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.160+0000 7f5725382b80 20 client.18207 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.160+0000 7f5725382b80 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563c81b36cc0 0x563c81b390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.160+0000 7f5725382b80 4 client.18207 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:16:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.160+0000 7f5725382b80 1 -- 172.21.15.17:0/3968933949 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563c819d4050 con 0x563c81b36cc0 2023-07-14T13:16:09.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.161+0000 7f570affd700 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563c81b36cc0 0x563c81b390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.161+0000 7f56eaffd700 10 client.18207 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.161+0000 7f570affd700 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563c81b36cc0 0x563c81b390d0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e03838fb9588121 server_cookie=c7b602205db65a97 in_seq=0 out_seq=0 2023-07-14T13:16:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.161+0000 7f56eaffd700 1 -- 172.21.15.17:0/3968933949 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563c819d4050 con 0x563c81b36cc0 2023-07-14T13:16:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f56eaffd700 10 client.18207 handle_command_reply: tid=0 2023-07-14T13:16:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 1 client.18207 shutdown 2023-07-14T13:16:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 1 -- 172.21.15.17:0/3968933949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 msgr2=0x563c81b35380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 0x563c81b35380 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5700009990 tx=0x7f570001a040 comp rx=0 tx=0).stop 2023-07-14T13:16:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 1 -- 172.21.15.17:0/3968933949 shutdown_connections 2023-07-14T13:16:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563c81b36cc0 0x563c81b390d0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563c81ad1ad0 0x563c81b35380 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c81ac62d0 0x563c81ad4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f56eaffd700 0 client.18207 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 1 --2- 172.21.15.17:0/3968933949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563c81ac6be0 0x563c81ad5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 1 -- 172.21.15.17:0/3968933949 >> 172.21.15.17:0/3968933949 conn(0x563c81abcda0 msgr2=0x563c81ac9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 1 -- 172.21.15.17:0/3968933949 shutdown_connections 2023-07-14T13:16:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 1 -- 172.21.15.17:0/3968933949 wait complete. 2023-07-14T13:16:09.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.162+0000 7f5725382b80 20 client.18207 trim_cache size 0 max 16384 2023-07-14T13:16:09.208 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:16:09.208 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:16:09.209 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:16:09.209 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:16:09.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 -- 172.21.15.17:0/682925634 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f56f40a1340 msgr2=0x7f56f40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f56f40a1340 0x7f56f40a37f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5704096030 tx=0x7f5704004130 comp rx=0 tx=0).stop 2023-07-14T13:16:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 -- 172.21.15.17:0/682925634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f570c10a080 msgr2=0x7f570c19c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f570c10a080 0x7f570c19c730 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5704007ee0 tx=0x7f570400d3b0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 -- 172.21.15.17:0/682925634 shutdown_connections 2023-07-14T13:16:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f56f40a1340 0x7f56f40a37f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f570c10a080 0x7f570c19c730 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f570c100b60 0x7f570c197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 --2- 172.21.15.17:0/682925634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f570c101470 0x7f570c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 -- 172.21.15.17:0/682925634 >> 172.21.15.17:0/682925634 conn(0x7f570c0fa4b0 msgr2=0x7f570c10c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:09.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 -- 172.21.15.17:0/682925634 shutdown_connections 2023-07-14T13:16:09.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.163+0000 7f57119ff700 1 -- 172.21.15.17:0/682925634 wait complete. 2023-07-14T13:16:09.224 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:16:09.224 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:16:09.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.416+0000 7f6068fff700 1 -- 172.21.15.17:0/4027355332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6064105ae0 msgr2=0x7f6064105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.416+0000 7f6068fff700 1 --2- 172.21.15.17:0/4027355332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6064105ae0 0x7f6064105eb0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6054009990 tx=0x7f6054009ca0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.416+0000 7f6068fff700 1 -- 172.21.15.17:0/4027355332 shutdown_connections 2023-07-14T13:16:09.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.416+0000 7f6068fff700 1 --2- 172.21.15.17:0/4027355332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6064100480 0x7f606410c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.416+0000 7f6068fff700 1 --2- 172.21.15.17:0/4027355332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6064105ae0 0x7f6064105eb0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.416+0000 7f6068fff700 1 --2- 172.21.15.17:0/4027355332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60640ffad0 0x7f60640fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.416+0000 7f6068fff700 1 -- 172.21.15.17:0/4027355332 >> 172.21.15.17:0/4027355332 conn(0x7f60640fb590 msgr2=0x7f60640fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.416+0000 7f6068fff700 1 -- 172.21.15.17:0/4027355332 shutdown_connections 2023-07-14T13:16:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.416+0000 7f6068fff700 1 -- 172.21.15.17:0/4027355332 wait complete. 2023-07-14T13:16:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.417+0000 7f6068fff700 1 Processor -- start 2023-07-14T13:16:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.418+0000 7f6068fff700 1 -- start start 2023-07-14T13:16:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.418+0000 7f6068fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60640ffad0 0x7f6064072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.418+0000 7f6068fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6064100480 0x7f6064072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.418+0000 7f6068fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6064105ae0 0x7f60641a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.418+0000 7f6068fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6064073580 con 0x7f6064105ae0 2023-07-14T13:16:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.418+0000 7f6068fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60641a4210 con 0x7f60640ffad0 2023-07-14T13:16:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.418+0000 7f6068fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60641a4350 con 0x7f6064100480 2023-07-14T13:16:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f6062d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6064105ae0 0x7f60641a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f606259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60640ffad0 0x7f6064072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f606259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60640ffad0 0x7f6064072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60472/0 (socket says 172.21.15.17:60472) 2023-07-14T13:16:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f6062d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6064105ae0 0x7f60641a3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50554/0 (socket says 172.21.15.17:50554) 2023-07-14T13:16:09.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f606259c700 1 -- 172.21.15.17:0/300776253 learned_addr learned my addr 172.21.15.17:0/300776253 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:09.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f6061d9b700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6064100480 0x7f6064072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f6062d9d700 1 -- 172.21.15.17:0/300776253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6064100480 msgr2=0x7f6064072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f6062d9d700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6064100480 0x7f6064072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f6062d9d700 1 -- 172.21.15.17:0/300776253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60640ffad0 msgr2=0x7f6064072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f6062d9d700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60640ffad0 0x7f6064072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f6062d9d700 1 -- 172.21.15.17:0/300776253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60540095f0 con 0x7f6064105ae0 2023-07-14T13:16:09.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.419+0000 7f6062d9d700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6064105ae0 0x7f60641a3cd0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f605c00efc0 tx=0x7f605c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:09.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.420+0000 7f60537fe700 1 -- 172.21.15.17:0/300776253 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c018070 con 0x7f6064105ae0 2023-07-14T13:16:09.461 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.420+0000 7f6068fff700 1 -- 172.21.15.17:0/300776253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60641a4550 con 0x7f6064105ae0 2023-07-14T13:16:09.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.420+0000 7f60537fe700 1 -- 172.21.15.17:0/300776253 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f605c00f040 con 0x7f6064105ae0 2023-07-14T13:16:09.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.420+0000 7f60537fe700 1 -- 172.21.15.17:0/300776253 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c00cba0 con 0x7f6064105ae0 2023-07-14T13:16:09.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.420+0000 7f6068fff700 1 -- 172.21.15.17:0/300776253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60641a4a80 con 0x7f6064105ae0 2023-07-14T13:16:09.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.421+0000 7f6068fff700 1 -- 172.21.15.17:0/300776253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6064067300 con 0x7f6064105ae0 2023-07-14T13:16:09.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.423+0000 7f60537fe700 1 -- 172.21.15.17:0/300776253 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f605c003a00 con 0x7f6064105ae0 2023-07-14T13:16:09.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.425+0000 7f60537fe700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f604c0a1300 0x7f604c0a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:09.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.425+0000 7f60537fe700 1 -- 172.21.15.17:0/300776253 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f605c0cc7c0 con 0x7f6064105ae0 2023-07-14T13:16:09.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.425+0000 7f606259c700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f604c0a1300 0x7f604c0a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:09.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.426+0000 7f606259c700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f604c0a1300 0x7f604c0a37b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6054006010 tx=0x7f605400b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:09.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.429+0000 7f60537fe700 1 -- 172.21.15.17:0/300776253 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f605c095bf0 con 0x7f6064105ae0 2023-07-14T13:16:09.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:09 smithi017 ceph-mon[95536]: pgmap v516: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 29 MiB/s wr, 37 op/s 2023-07-14T13:16:09.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:09 smithi135 ceph-mon[97338]: pgmap v516: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 29 MiB/s wr, 37 op/s 2023-07-14T13:16:09.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:09 smithi131 ceph-mon[96953]: pgmap v516: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 29 MiB/s wr, 37 op/s 2023-07-14T13:16:09.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.725+0000 7f6068fff700 1 -- 172.21.15.17:0/300776253 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60641a4ca0 con 0x7f6064105ae0 2023-07-14T13:16:09.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.726+0000 7f60537fe700 1 -- 172.21.15.17:0/300776253 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+10849 (secure 0 0 0) 0x7f605c099210 con 0x7f6064105ae0 2023-07-14T13:16:09.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:16:09.765 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:15:59.188257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:16:09.767 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 -- 172.21.15.17:0/300776253 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f604c0a1300 msgr2=0x7f604c0a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f604c0a1300 0x7f604c0a37b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6054006010 tx=0x7f605400b260 comp rx=0 tx=0).stop 2023-07-14T13:16:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 -- 172.21.15.17:0/300776253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6064105ae0 msgr2=0x7f60641a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6064105ae0 0x7f60641a3cd0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f605c00efc0 tx=0x7f605c00c3a0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 -- 172.21.15.17:0/300776253 shutdown_connections 2023-07-14T13:16:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f604c0a1300 0x7f604c0a37b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6064105ae0 0x7f60641a3cd0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60640ffad0 0x7f6064072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 --2- 172.21.15.17:0/300776253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6064100480 0x7f6064072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 -- 172.21.15.17:0/300776253 >> 172.21.15.17:0/300776253 conn(0x7f60640fb590 msgr2=0x7f60640fbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 -- 172.21.15.17:0/300776253 shutdown_connections 2023-07-14T13:16:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.728+0000 7f6068fff700 1 -- 172.21.15.17:0/300776253 wait complete. 2023-07-14T13:16:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 44 2023-07-14T13:16:09.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:16:10.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.980+0000 7f4f457ff700 1 -- 172.21.15.17:0/3762115908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f401049e0 msgr2=0x7f4f40104db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.980+0000 7f4f457ff700 1 --2- 172.21.15.17:0/3762115908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f401049e0 0x7f4f40104db0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009990 tx=0x7f4f30009ca0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.980+0000 7f4f457ff700 1 -- 172.21.15.17:0/3762115908 shutdown_connections 2023-07-14T13:16:10.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.980+0000 7f4f457ff700 1 --2- 172.21.15.17:0/3762115908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f400ff380 0x7f4f4010b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.980+0000 7f4f457ff700 1 --2- 172.21.15.17:0/3762115908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f401049e0 0x7f4f40104db0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.980+0000 7f4f457ff700 1 --2- 172.21.15.17:0/3762115908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f400fe9d0 0x7f4f400fee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.980+0000 7f4f457ff700 1 -- 172.21.15.17:0/3762115908 >> 172.21.15.17:0/3762115908 conn(0x7f4f400fa4b0 msgr2=0x7f4f400fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.981+0000 7f4f457ff700 1 -- 172.21.15.17:0/3762115908 shutdown_connections 2023-07-14T13:16:10.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.981+0000 7f4f457ff700 1 -- 172.21.15.17:0/3762115908 wait complete. 2023-07-14T13:16:10.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.982+0000 7f4f457ff700 1 Processor -- start 2023-07-14T13:16:10.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.982+0000 7f4f457ff700 1 -- start start 2023-07-14T13:16:10.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.982+0000 7f4f457ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f400fe9d0 0x7f4f40197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.982+0000 7f4f457ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f400ff380 0x7f4f40198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.982+0000 7f4f457ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f401049e0 0x7f4f4019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.982+0000 7f4f457ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4019cdb0 con 0x7f4f400ff380 2023-07-14T13:16:10.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.982+0000 7f4f457ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4019cf20 con 0x7f4f401049e0 2023-07-14T13:16:10.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.982+0000 7f4f457ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4019d0e0 con 0x7f4f400fe9d0 2023-07-14T13:16:10.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.983+0000 7f4f3e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f400ff380 0x7f4f40198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.983+0000 7f4f3e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f400ff380 0x7f4f40198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50574/0 (socket says 172.21.15.17:50574) 2023-07-14T13:16:10.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.983+0000 7f4f3e7fc700 1 -- 172.21.15.17:0/1047416774 learned_addr learned my addr 172.21.15.17:0/1047416774 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.983+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f401049e0 0x7f4f4019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.983+0000 7f4f3effd700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f400fe9d0 0x7f4f40197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.983+0000 7f4f3e7fc700 1 -- 172.21.15.17:0/1047416774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f400fe9d0 msgr2=0x7f4f40197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.983+0000 7f4f3e7fc700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f400fe9d0 0x7f4f40197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.983+0000 7f4f3e7fc700 1 -- 172.21.15.17:0/1047416774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f401049e0 msgr2=0x7f4f4019c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.983+0000 7f4f3e7fc700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f401049e0 0x7f4f4019c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.983+0000 7f4f3e7fc700 1 -- 172.21.15.17:0/1047416774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f34009520 con 0x7f4f400ff380 2023-07-14T13:16:10.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.984+0000 7f4f3e7fc700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f400ff380 0x7f4f40198310 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400eb30 tx=0x7f4f3400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.984+0000 7f4f27fff700 1 -- 172.21.15.17:0/1047416774 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34009880 con 0x7f4f400ff380 2023-07-14T13:16:10.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.984+0000 7f4f457ff700 1 -- 172.21.15.17:0/1047416774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f300095f0 con 0x7f4f400ff380 2023-07-14T13:16:10.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.984+0000 7f4f27fff700 1 -- 172.21.15.17:0/1047416774 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f340044b0 con 0x7f4f400ff380 2023-07-14T13:16:10.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.984+0000 7f4f27fff700 1 -- 172.21.15.17:0/1047416774 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34003ce0 con 0x7f4f400ff380 2023-07-14T13:16:10.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.984+0000 7f4f457ff700 1 -- 172.21.15.17:0/1047416774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f401a4a20 con 0x7f4f400ff380 2023-07-14T13:16:10.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.988+0000 7f4f27fff700 1 -- 172.21.15.17:0/1047416774 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4f34003e40 con 0x7f4f400ff380 2023-07-14T13:16:10.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.989+0000 7f4f59211b80 1 Processor -- start 2023-07-14T13:16:10.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.989+0000 7f4f59211b80 1 -- start start 2023-07-14T13:16:10.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.990+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a02d0 0x5595976a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.990+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a0be0 0x5595976ab590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.990+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.990+0000 7f4f59211b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595975a6cb0 con 0x5595976abad0 2023-07-14T13:16:10.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.990+0000 7f4f59211b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595975f9a40 con 0x5595976a0be0 2023-07-14T13:16:10.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.990+0000 7f4f59211b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595975f2ed0 con 0x5595976a02d0 2023-07-14T13:16:10.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.990+0000 7f4f27fff700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4f280a12c0 0x7f4f280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.990+0000 7f4f3e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.990+0000 7f4f3e7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50578/0 (socket says 172.21.15.17:50578) 2023-07-14T13:16:10.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.990+0000 7f4f3e7fc700 1 -- 172.21.15.17:0/3777789123 learned_addr learned my addr 172.21.15.17:0/3777789123 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.991+0000 7f4f3effd700 1 --2- 172.21.15.17:0/3777789123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a0be0 0x5595976ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.991+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/3777789123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a02d0 0x5595976a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.991+0000 7f4f27fff700 1 -- 172.21.15.17:0/1047416774 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f4f34014070 con 0x7f4f400ff380 2023-07-14T13:16:10.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.991+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4f280a12c0 0x7f4f280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.991+0000 7f4f3e7fc700 1 -- 172.21.15.17:0/3777789123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a02d0 msgr2=0x5595976a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.991+0000 7f4f3e7fc700 1 --2- 172.21.15.17:0/3777789123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a02d0 0x5595976a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.991+0000 7f4f3e7fc700 1 -- 172.21.15.17:0/3777789123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a0be0 msgr2=0x5595976ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.991+0000 7f4f3e7fc700 1 --2- 172.21.15.17:0/3777789123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a0be0 0x5595976ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.991+0000 7f4f3e7fc700 1 -- 172.21.15.17:0/3777789123 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559597420de0 con 0x5595976abad0 2023-07-14T13:16:10.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.991+0000 7f4f3e7fc700 1 --2- 172.21.15.17:0/3777789123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976adeb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4f340ca8d0 tx=0x7f4f34003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88713e11e3817eb4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.992+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4f280a12c0 0x7f4f280a3770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009ec0 tx=0x7f4f3800b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.992+0000 7f4f257fa700 1 -- 172.21.15.17:0/3777789123 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400cdd0 con 0x5595976abad0 2023-07-14T13:16:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.992+0000 7f4f257fa700 1 -- 172.21.15.17:0/3777789123 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f3401e2e0 con 0x5595976abad0 2023-07-14T13:16:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.992+0000 7f4f257fa700 1 -- 172.21.15.17:0/3777789123 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f340a2700 con 0x5595976abad0 2023-07-14T13:16:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.992+0000 7f4f59211b80 1 -- 172.21.15.17:0/3777789123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 msgr2=0x5595976adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.992+0000 7f4f59211b80 1 --2- 172.21.15.17:0/3777789123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976adeb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4f340ca8d0 tx=0x7f4f34003680 comp rx=0 tx=0).stop 2023-07-14T13:16:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.993+0000 7f4f59211b80 1 -- 172.21.15.17:0/3777789123 shutdown_connections 2023-07-14T13:16:10.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.993+0000 7f4f59211b80 1 --2- 172.21.15.17:0/3777789123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976adeb0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.993+0000 7f4f59211b80 1 --2- 172.21.15.17:0/3777789123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a02d0 0x5595976a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.993+0000 7f4f59211b80 1 --2- 172.21.15.17:0/3777789123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a0be0 0x5595976ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.993+0000 7f4f59211b80 1 -- 172.21.15.17:0/3777789123 >> 172.21.15.17:0/3777789123 conn(0x559597696da0 msgr2=0x55959769c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.993+0000 7f4f59211b80 1 -- 172.21.15.17:0/3777789123 shutdown_connections 2023-07-14T13:16:10.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.993+0000 7f4f59211b80 1 -- 172.21.15.17:0/3777789123 wait complete. 2023-07-14T13:16:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.993+0000 7f4f59211b80 1 -- start start 2023-07-14T13:16:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.994+0000 7f4f59211b80 1 Processor -- start 2023-07-14T13:16:10.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.994+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a02d0 0x5595976ab500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.994+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a0be0 0x5595976a8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.994+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.994+0000 7f4f59211b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559597592ac0 con 0x5595976abad0 2023-07-14T13:16:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.994+0000 7f4f59211b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595975927c0 con 0x5595976a02d0 2023-07-14T13:16:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.994+0000 7f4f59211b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559597476920 con 0x5595976a0be0 2023-07-14T13:16:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.994+0000 7f4f59211b80 10 client.0 _ll_register_callbacks cb 0x559597590760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:10.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50588/0 (socket says 172.21.15.17:50588) 2023-07-14T13:16:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/2534180512 learned_addr learned my addr 172.21.15.17:0/2534180512 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f3e7fc700 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a0be0 0x5595976a8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f3effd700 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a02d0 0x5595976ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/2534180512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a0be0 msgr2=0x5595976a8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a0be0 0x5595976a8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/2534180512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a02d0 msgr2=0x5595976ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a02d0 0x5595976ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/2534180512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f401a4a20 con 0x5595976abad0 2023-07-14T13:16:10.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a8ec0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4f38018af0 tx=0x7f4f38004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b41429605f1c808 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.995+0000 7f4f22ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:10.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.996+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2534180512 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3800e070 con 0x5595976abad0 2023-07-14T13:16:10.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.996+0000 7f4f59211b80 1 -- 172.21.15.17:0/2534180512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55959754c4f0 con 0x5595976abad0 2023-07-14T13:16:10.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.996+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2534180512 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f4f38016a10 con 0x5595976abad0 2023-07-14T13:16:10.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.996+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2534180512 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f38016bd0 con 0x5595976abad0 2023-07-14T13:16:10.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.996+0000 7f4f59211b80 10 client.18225 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:10.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.996+0000 7f4f59211b80 1 -- 172.21.15.17:0/2534180512 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x559597409c60 con 0x5595976abad0 2023-07-14T13:16:10.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.996+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2534180512 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f38030020 con 0x5595976abad0 2023-07-14T13:16:10.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.997+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2534180512 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f4f3802b3c0 con 0x5595976abad0 2023-07-14T13:16:10.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.997+0000 7f4f59211b80 10 client.18225 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:10.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.997+0000 7f4f59211b80 10 client.18225 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:16:10.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.997+0000 7f4f59211b80 20 client.18225 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.997+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5595976bb3f0 0x5595976bd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.997+0000 7f4f59211b80 4 client.18225 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.997+0000 7f4f59211b80 1 -- 172.21.15.17:0/2534180512 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595975ebeb0 con 0x5595976bb3f0 2023-07-14T13:16:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.997+0000 7f4f3effd700 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5595976bb3f0 0x5595976bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.998+0000 7f4f22ff5700 10 client.18225 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:16:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.998+0000 7f4f3effd700 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5595976bb3f0 0x5595976bd800 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fdb1318701943c62 server_cookie=4c55f95e0f768412 in_seq=0 out_seq=0 2023-07-14T13:16:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2534180512 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5595975ebeb0 con 0x5595976bb3f0 2023-07-14T13:16:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f22ff5700 10 client.18225 handle_command_reply: tid=0 2023-07-14T13:16:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f59211b80 1 client.18225 shutdown 2023-07-14T13:16:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f59211b80 1 -- 172.21.15.17:0/2534180512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 msgr2=0x5595976a8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a8ec0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4f38018af0 tx=0x7f4f38004ad0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f59211b80 1 -- 172.21.15.17:0/2534180512 shutdown_connections 2023-07-14T13:16:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a8ec0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a02d0 0x5595976ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5595976bb3f0 0x5595976bd800 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2534180512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a0be0 0x5595976a8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f22ff5700 0 client.18225 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:16:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f59211b80 1 -- 172.21.15.17:0/2534180512 >> 172.21.15.17:0/2534180512 conn(0x559597696da0 msgr2=0x55959769c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:09.999+0000 7f4f59211b80 1 -- 172.21.15.17:0/2534180512 shutdown_connections 2023-07-14T13:16:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.000+0000 7f4f59211b80 1 -- 172.21.15.17:0/2534180512 wait complete. 2023-07-14T13:16:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.000+0000 7f4f59211b80 20 client.18225 trim_cache size 0 max 16384 2023-07-14T13:16:10.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.017+0000 7f4f59211b80 1 Processor -- start 2023-07-14T13:16:10.057 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.018+0000 7f4f59211b80 1 -- start start 2023-07-14T13:16:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.018+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a02d0 0x5595976b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.018+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a0be0 0x5595976ab030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.018+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.018+0000 7f4f59211b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595976a1e70 con 0x5595976abad0 2023-07-14T13:16:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.018+0000 7f4f59211b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595976a1540 con 0x5595976a02d0 2023-07-14T13:16:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.018+0000 7f4f59211b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595976a94c0 con 0x5595976a0be0 2023-07-14T13:16:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.018+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.018+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50598/0 (socket says 172.21.15.17:50598) 2023-07-14T13:16:10.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.018+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/1334783372 learned_addr learned my addr 172.21.15.17:0/1334783372 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.018+0000 7f4f3effd700 1 --2- 172.21.15.17:0/1334783372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a02d0 0x5595976b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.019+0000 7f4f3e7fc700 1 --2- 172.21.15.17:0/1334783372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a0be0 0x5595976ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.019+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/1334783372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a0be0 msgr2=0x5595976ab030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.019+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/1334783372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a0be0 0x5595976ab030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.019+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/1334783372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a02d0 msgr2=0x5595976b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.019+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/1334783372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a02d0 0x5595976b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.019+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/1334783372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559597447250 con 0x5595976abad0 2023-07-14T13:16:10.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.019+0000 7f4f3effd700 1 --2- 172.21.15.17:0/1334783372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a02d0 0x5595976b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:16:10.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.019+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/1334783372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a59f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009050 tx=0x7f4f380060a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3641c46ed688500a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.019+0000 7f4f25ffb700 1 -- 172.21.15.17:0/1334783372 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3800e040 con 0x5595976abad0 2023-07-14T13:16:10.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.019+0000 7f4f25ffb700 1 -- 172.21.15.17:0/1334783372 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f38030070 con 0x5595976abad0 2023-07-14T13:16:10.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.019+0000 7f4f25ffb700 1 -- 172.21.15.17:0/1334783372 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3802c620 con 0x5595976abad0 2023-07-14T13:16:10.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.020+0000 7f4f59211b80 1 -- 172.21.15.17:0/1334783372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 msgr2=0x5595976a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.020+0000 7f4f59211b80 1 --2- 172.21.15.17:0/1334783372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a59f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009050 tx=0x7f4f380060a0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.020+0000 7f4f59211b80 1 -- 172.21.15.17:0/1334783372 shutdown_connections 2023-07-14T13:16:10.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.020+0000 7f4f59211b80 1 --2- 172.21.15.17:0/1334783372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976a59f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.020+0000 7f4f59211b80 1 --2- 172.21.15.17:0/1334783372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a02d0 0x5595976b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.020+0000 7f4f59211b80 1 --2- 172.21.15.17:0/1334783372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a0be0 0x5595976ab030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.020+0000 7f4f59211b80 1 -- 172.21.15.17:0/1334783372 >> 172.21.15.17:0/1334783372 conn(0x559597696da0 msgr2=0x5595976c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.020+0000 7f4f59211b80 1 -- 172.21.15.17:0/1334783372 shutdown_connections 2023-07-14T13:16:10.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.020+0000 7f4f59211b80 1 -- 172.21.15.17:0/1334783372 wait complete. 2023-07-14T13:16:10.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.021+0000 7f4f59211b80 1 -- start start 2023-07-14T13:16:10.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.021+0000 7f4f59211b80 1 Processor -- start 2023-07-14T13:16:10.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a02d0 0x5595976b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a0be0 0x5595976b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f59211b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f59211b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595976b15b0 con 0x5595976abad0 2023-07-14T13:16:10.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f59211b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595976b1720 con 0x5595976a0be0 2023-07-14T13:16:10.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f59211b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55959770f2c0 con 0x5595976a02d0 2023-07-14T13:16:10.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f59211b80 10 client.0 _ll_register_callbacks cb 0x7f4f38018490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:10.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50612/0 (socket says 172.21.15.17:50612) 2023-07-14T13:16:10.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/2827092242 learned_addr learned my addr 172.21.15.17:0/2827092242 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f3effd700 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a02d0 0x5595976b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f3e7fc700 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a0be0 0x5595976b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/2827092242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a02d0 msgr2=0x5595976b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a02d0 0x5595976b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/2827092242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a0be0 msgr2=0x5595976b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a0be0 0x5595976b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f3f7fe700 1 -- 172.21.15.17:0/2827092242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559597409c60 con 0x5595976abad0 2023-07-14T13:16:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.022+0000 7f4f3effd700 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a02d0 0x5595976b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:16:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.023+0000 7f4f3f7fe700 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976b0ea0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4f3802bb70 tx=0x7f4f3802b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3350806586f9c5c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.023+0000 7f4f22ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.023+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2827092242 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3800e040 con 0x5595976abad0 2023-07-14T13:16:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.023+0000 7f4f59211b80 1 -- 172.21.15.17:0/2827092242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f3401e2e0 con 0x5595976abad0 2023-07-14T13:16:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.023+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2827092242 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f4f38031080 con 0x5595976abad0 2023-07-14T13:16:10.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.023+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2827092242 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f38004ea0 con 0x5595976abad0 2023-07-14T13:16:10.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.023+0000 7f4f59211b80 10 client.18231 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:10.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.023+0000 7f4f59211b80 1 -- 172.21.15.17:0/2827092242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55959741f2b0 con 0x5595976abad0 2023-07-14T13:16:10.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.024+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2827092242 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f38044020 con 0x5595976abad0 2023-07-14T13:16:10.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.024+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2827092242 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f4f38005600 con 0x5595976abad0 2023-07-14T13:16:10.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.024+0000 7f4f59211b80 10 client.18231 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:10.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.024+0000 7f4f59211b80 10 client.18231 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:16:10.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.024+0000 7f4f59211b80 20 client.18231 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:10.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.024+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559597710600 0x5595977129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.024+0000 7f4f59211b80 4 client.18231 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:16:10.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.024+0000 7f4f59211b80 1 -- 172.21.15.17:0/2827092242 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5595975ae050 con 0x559597710600 2023-07-14T13:16:10.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.024+0000 7f4f3effd700 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559597710600 0x5595977129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.025+0000 7f4f22ff5700 10 client.18231 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:16:10.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.025+0000 7f4f3effd700 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559597710600 0x5595977129e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=739dd5292fb557b0 server_cookie=75bae7642c71118f in_seq=0 out_seq=0 2023-07-14T13:16:10.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.025+0000 7f4f22ff5700 1 -- 172.21.15.17:0/2827092242 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5595975ae050 con 0x559597710600 2023-07-14T13:16:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.025+0000 7f4f22ff5700 10 client.18231 handle_command_reply: tid=0 2023-07-14T13:16:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.025+0000 7f4f59211b80 1 client.18231 shutdown 2023-07-14T13:16:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f59211b80 1 -- 172.21.15.17:0/2827092242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 msgr2=0x5595976b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976b0ea0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4f3802bb70 tx=0x7f4f3802b810 comp rx=0 tx=0).stop 2023-07-14T13:16:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f59211b80 1 -- 172.21.15.17:0/2827092242 shutdown_connections 2023-07-14T13:16:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5595976abad0 0x5595976b0ea0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x559597710600 0x5595977129e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595976a02d0 0x5595976b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f59211b80 1 --2- 172.21.15.17:0/2827092242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5595976a0be0 0x5595976b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f59211b80 1 -- 172.21.15.17:0/2827092242 >> 172.21.15.17:0/2827092242 conn(0x559597696da0 msgr2=0x5595976b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f22ff5700 0 client.18231 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:16:10.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f59211b80 1 -- 172.21.15.17:0/2827092242 shutdown_connections 2023-07-14T13:16:10.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f59211b80 1 -- 172.21.15.17:0/2827092242 wait complete. 2023-07-14T13:16:10.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.026+0000 7f4f59211b80 20 client.18231 trim_cache size 0 max 16384 2023-07-14T13:16:10.073 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:16:10.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 -- 172.21.15.17:0/1047416774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4f280a12c0 msgr2=0x7f4f280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4f280a12c0 0x7f4f280a3770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009ec0 tx=0x7f4f3800b040 comp rx=0 tx=0).stop 2023-07-14T13:16:10.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 -- 172.21.15.17:0/1047416774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f400ff380 msgr2=0x7f4f40198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f400ff380 0x7f4f40198310 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400eb30 tx=0x7f4f3400ee40 comp rx=0 tx=0).stop 2023-07-14T13:16:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 -- 172.21.15.17:0/1047416774 shutdown_connections 2023-07-14T13:16:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4f280a12c0 0x7f4f280a3770 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f401049e0 0x7f4f4019c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f400fe9d0 0x7f4f40197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 --2- 172.21.15.17:0/1047416774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f400ff380 0x7f4f40198310 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 -- 172.21.15.17:0/1047416774 >> 172.21.15.17:0/1047416774 conn(0x7f4f400fa4b0 msgr2=0x7f4f400fbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 -- 172.21.15.17:0/1047416774 shutdown_connections 2023-07-14T13:16:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.027+0000 7f4f457ff700 1 -- 172.21.15.17:0/1047416774 wait complete. 2023-07-14T13:16:10.088 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:16:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.295+0000 7f11461ff700 1 -- 172.21.15.17:0/3469710416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f114010a070 msgr2=0x7f114010c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.295+0000 7f11461ff700 1 --2- 172.21.15.17:0/3469710416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f114010a070 0x7f114010c4b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f113800b0a0 tx=0x7f113800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.295+0000 7f11461ff700 1 -- 172.21.15.17:0/3469710416 shutdown_connections 2023-07-14T13:16:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.295+0000 7f11461ff700 1 --2- 172.21.15.17:0/3469710416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f114010a070 0x7f114010c4b0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.295+0000 7f11461ff700 1 --2- 172.21.15.17:0/3469710416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1140100ca0 0x7f1140101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.295+0000 7f11461ff700 1 --2- 172.21.15.17:0/3469710416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11401015b0 0x7f1140109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.295+0000 7f11461ff700 1 -- 172.21.15.17:0/3469710416 >> 172.21.15.17:0/3469710416 conn(0x7f11400fa4b0 msgr2=0x7f11400fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.295+0000 7f11461ff700 1 -- 172.21.15.17:0/3469710416 shutdown_connections 2023-07-14T13:16:10.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.295+0000 7f11461ff700 1 -- 172.21.15.17:0/3469710416 wait complete. 2023-07-14T13:16:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.297+0000 7f11461ff700 1 Processor -- start 2023-07-14T13:16:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.297+0000 7f11461ff700 1 -- start start 2023-07-14T13:16:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.297+0000 7f11461ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1140100ca0 0x7f11400fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.297+0000 7f11461ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11401015b0 0x7f11400fee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f11461ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f114010a070 0x7f11401a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f11461ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400ff660 con 0x7f114010a070 2023-07-14T13:16:10.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f11461ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11401a43a0 con 0x7f1140100ca0 2023-07-14T13:16:10.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f11461ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11401a44e0 con 0x7f11401015b0 2023-07-14T13:16:10.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f113ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f114010a070 0x7f11401a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f113ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f114010a070 0x7f11401a3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50628/0 (socket says 172.21.15.17:50628) 2023-07-14T13:16:10.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f113ffff700 1 -- 172.21.15.17:0/3207232966 learned_addr learned my addr 172.21.15.17:0/3207232966 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f113effd700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11401015b0 0x7f11400fee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f113f7fe700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1140100ca0 0x7f11400fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f113ffff700 1 -- 172.21.15.17:0/3207232966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11401015b0 msgr2=0x7f11400fee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f113ffff700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11401015b0 0x7f11400fee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f113ffff700 1 -- 172.21.15.17:0/3207232966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1140100ca0 msgr2=0x7f11400fe8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f113ffff700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1140100ca0 0x7f11400fe8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.298+0000 7f113ffff700 1 -- 172.21.15.17:0/3207232966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138009d00 con 0x7f114010a070 2023-07-14T13:16:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.299+0000 7f113ffff700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f114010a070 0x7f11401a3e60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f113800b070 tx=0x7f113800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.299+0000 7f113cff9700 1 -- 172.21.15.17:0/3207232966 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800e040 con 0x7f114010a070 2023-07-14T13:16:10.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.299+0000 7f113cff9700 1 -- 172.21.15.17:0/3207232966 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1138009480 con 0x7f114010a070 2023-07-14T13:16:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.299+0000 7f11461ff700 1 -- 172.21.15.17:0/3207232966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11401a46e0 con 0x7f114010a070 2023-07-14T13:16:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.299+0000 7f113cff9700 1 -- 172.21.15.17:0/3207232966 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138005040 con 0x7f114010a070 2023-07-14T13:16:10.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.299+0000 7f11461ff700 1 -- 172.21.15.17:0/3207232966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11401a4b60 con 0x7f114010a070 2023-07-14T13:16:10.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.303+0000 7f113cff9700 1 -- 172.21.15.17:0/3207232966 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f113801d480 con 0x7f114010a070 2023-07-14T13:16:10.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.304+0000 7f1159b40b80 1 Processor -- start 2023-07-14T13:16:10.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.305+0000 7f1159b40b80 1 -- start start 2023-07-14T13:16:10.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.305+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 0x557c446756a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.305+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 0x557c44680590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.305+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44680ad0 0x557c44682eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.305+0000 7f1159b40b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4457bcb0 con 0x557c44675be0 2023-07-14T13:16:10.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.305+0000 7f1159b40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c445cea40 con 0x557c44680ad0 2023-07-14T13:16:10.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.305+0000 7f1159b40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c445c7ed0 con 0x557c446752d0 2023-07-14T13:16:10.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113cff9700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11280a1410 0x7f11280a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 0x557c44680590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113cff9700 1 -- 172.21.15.17:0/3207232966 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f11380cdef0 con 0x7f114010a070 2023-07-14T13:16:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44680ad0 0x557c44682eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44680ad0 0x557c44682eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60572/0 (socket says 172.21.15.17:60572) 2023-07-14T13:16:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113effd700 1 -- 172.21.15.17:0/4035621623 learned_addr learned my addr 172.21.15.17:0/4035621623 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113effd700 1 --2- 172.21.15.17:0/4035621623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 0x557c446756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113ffff700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11280a1410 0x7f11280a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113effd700 1 -- 172.21.15.17:0/4035621623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 msgr2=0x557c446756a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113effd700 1 --2- 172.21.15.17:0/4035621623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 0x557c446756a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113effd700 1 -- 172.21.15.17:0/4035621623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 msgr2=0x557c44680590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113effd700 1 --2- 172.21.15.17:0/4035621623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 0x557c44680590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.306+0000 7f113effd700 1 -- 172.21.15.17:0/4035621623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c443f5de0 con 0x557c44680ad0 2023-07-14T13:16:10.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.307+0000 7f113effd700 1 --2- 172.21.15.17:0/4035621623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44680ad0 0x557c44682eb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1134005950 tx=0x7f11340058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed745207a99d525f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.307+0000 7f113ffff700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11280a1410 0x7f11280a38c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1138007fd0 tx=0x7f1138009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.307+0000 7f1125ffb700 1 -- 172.21.15.17:0/4035621623 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134013e70 con 0x557c44680ad0 2023-07-14T13:16:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.307+0000 7f1125ffb700 1 -- 172.21.15.17:0/4035621623 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11340044c0 con 0x557c44680ad0 2023-07-14T13:16:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.307+0000 7f1125ffb700 1 -- 172.21.15.17:0/4035621623 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134005020 con 0x557c44680ad0 2023-07-14T13:16:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.308+0000 7f1159b40b80 1 -- 172.21.15.17:0/4035621623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44680ad0 msgr2=0x557c44682eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.308+0000 7f1159b40b80 1 --2- 172.21.15.17:0/4035621623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44680ad0 0x557c44682eb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1134005950 tx=0x7f11340058e0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.308+0000 7f1159b40b80 1 -- 172.21.15.17:0/4035621623 shutdown_connections 2023-07-14T13:16:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.308+0000 7f1159b40b80 1 --2- 172.21.15.17:0/4035621623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44680ad0 0x557c44682eb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.308+0000 7f1159b40b80 1 --2- 172.21.15.17:0/4035621623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 0x557c446756a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.308+0000 7f1159b40b80 1 --2- 172.21.15.17:0/4035621623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 0x557c44680590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.308+0000 7f1159b40b80 1 -- 172.21.15.17:0/4035621623 >> 172.21.15.17:0/4035621623 conn(0x557c4466bda0 msgr2=0x557c446716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.308+0000 7f1159b40b80 1 -- 172.21.15.17:0/4035621623 shutdown_connections 2023-07-14T13:16:10.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.308+0000 7f1159b40b80 1 -- 172.21.15.17:0/4035621623 wait complete. 2023-07-14T13:16:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.309+0000 7f1159b40b80 1 -- start start 2023-07-14T13:16:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.309+0000 7f1159b40b80 1 Processor -- start 2023-07-14T13:16:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.309+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c446752d0 0x557c4467d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.309+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 0x557c4467dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.309+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c44680ad0 0x557c4467e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.309+0000 7f1159b40b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c44567ac0 con 0x557c44675be0 2023-07-14T13:16:10.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.309+0000 7f1159b40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c445677c0 con 0x557c446752d0 2023-07-14T13:16:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.309+0000 7f1159b40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4444b920 con 0x557c44680ad0 2023-07-14T13:16:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.309+0000 7f1159b40b80 10 client.0 _ll_register_callbacks cb 0x557c44565760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.310+0000 7f113f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 0x557c4467dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.310+0000 7f113f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 0x557c4467dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50646/0 (socket says 172.21.15.17:50646) 2023-07-14T13:16:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.310+0000 7f113f7fe700 1 -- 172.21.15.17:0/891035345 learned_addr learned my addr 172.21.15.17:0/891035345 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.310+0000 7f113effd700 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c44680ad0 0x557c4467e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.310+0000 7f113effd700 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c446752d0 0x557c4467d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.310+0000 7f113f7fe700 1 -- 172.21.15.17:0/891035345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c44680ad0 msgr2=0x557c4467e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.310+0000 7f113f7fe700 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c44680ad0 0x557c4467e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.310+0000 7f113f7fe700 1 -- 172.21.15.17:0/891035345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c446752d0 msgr2=0x557c4467d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.310+0000 7f113f7fe700 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c446752d0 0x557c4467d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.310+0000 7f113f7fe700 1 -- 172.21.15.17:0/891035345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113401b040 con 0x557c44675be0 2023-07-14T13:16:10.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.310+0000 7f113effd700 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c446752d0 0x557c4467d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:16:10.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.311+0000 7f113f7fe700 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 0x557c4467dd10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f1130012860 tx=0x7f1130012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb89ed0c4a49642 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.311+0000 7f111effd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:10.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.311+0000 7f111effd700 1 -- 172.21.15.17:0/891035345 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130017070 con 0x557c44675be0 2023-07-14T13:16:10.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.311+0000 7f1159b40b80 1 -- 172.21.15.17:0/891035345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c445214f0 con 0x557c44675be0 2023-07-14T13:16:10.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.311+0000 7f111effd700 1 -- 172.21.15.17:0/891035345 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f113000f5e0 con 0x557c44675be0 2023-07-14T13:16:10.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.311+0000 7f111effd700 1 -- 172.21.15.17:0/891035345 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11300122e0 con 0x557c44675be0 2023-07-14T13:16:10.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.311+0000 7f1159b40b80 10 client.18243 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:10.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.311+0000 7f1159b40b80 1 -- 172.21.15.17:0/891035345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x557c443dec60 con 0x557c44675be0 2023-07-14T13:16:10.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.312+0000 7f111effd700 1 -- 172.21.15.17:0/891035345 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1130028080 con 0x557c44675be0 2023-07-14T13:16:10.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.312+0000 7f111effd700 1 -- 172.21.15.17:0/891035345 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f11300108e0 con 0x557c44675be0 2023-07-14T13:16:10.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.312+0000 7f1159b40b80 10 client.18243 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:10.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.312+0000 7f1159b40b80 10 client.18243 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:16:10.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.312+0000 7f1159b40b80 20 client.18243 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:10.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.312+0000 7f1159b40b80 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557c446903d0 0x557c446927e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.312+0000 7f1159b40b80 4 client.18243 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:10.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.312+0000 7f1159b40b80 1 -- 172.21.15.17:0/891035345 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c445c0eb0 con 0x557c446903d0 2023-07-14T13:16:10.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.312+0000 7f113effd700 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557c446903d0 0x557c446927e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.313+0000 7f113effd700 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557c446903d0 0x557c446927e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d0b556731fd130d server_cookie=117a7de33bd421d8 in_seq=0 out_seq=0 2023-07-14T13:16:10.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.313+0000 7f111effd700 10 client.18243 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:16:10.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f111effd700 1 -- 172.21.15.17:0/891035345 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557c445c0eb0 con 0x557c446903d0 2023-07-14T13:16:10.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f111effd700 10 client.18243 handle_command_reply: tid=0 2023-07-14T13:16:10.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f1159b40b80 1 client.18243 shutdown 2023-07-14T13:16:10.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f1159b40b80 1 -- 172.21.15.17:0/891035345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 msgr2=0x557c4467dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f1159b40b80 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 0x557c4467dd10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f1130012860 tx=0x7f1130012b70 comp rx=0 tx=0).stop 2023-07-14T13:16:10.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f1159b40b80 1 -- 172.21.15.17:0/891035345 shutdown_connections 2023-07-14T13:16:10.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f1159b40b80 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c44680ad0 0x557c4467e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f1159b40b80 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557c446903d0 0x557c446927e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f1159b40b80 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c446752d0 0x557c4467d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f1159b40b80 1 --2- 172.21.15.17:0/891035345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44675be0 0x557c4467dd10 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f1159b40b80 1 -- 172.21.15.17:0/891035345 >> 172.21.15.17:0/891035345 conn(0x557c4466bda0 msgr2=0x557c44671230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f111effd700 0 client.18243 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:16:10.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f1159b40b80 1 -- 172.21.15.17:0/891035345 shutdown_connections 2023-07-14T13:16:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.314+0000 7f1159b40b80 1 -- 172.21.15.17:0/891035345 wait complete. 2023-07-14T13:16:10.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.315+0000 7f1159b40b80 20 client.18243 trim_cache size 0 max 16384 2023-07-14T13:16:10.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:10 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/300776253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:16:10.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.328+0000 7f1159b40b80 1 Processor -- start 2023-07-14T13:16:10.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.328+0000 7f1159b40b80 1 -- start start 2023-07-14T13:16:10.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.329+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c446752d0 0x557c446874a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.329+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c44675be0 0x557c4467e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.329+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 0x557c4467aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.329+0000 7f1159b40b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c44668ef0 con 0x557c44680ad0 2023-07-14T13:16:10.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.329+0000 7f1159b40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c4467bd30 con 0x557c446752d0 2023-07-14T13:16:10.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.329+0000 7f1159b40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c446879e0 con 0x557c44675be0 2023-07-14T13:16:10.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.329+0000 7f113effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 0x557c4467aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.329+0000 7f113effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 0x557c4467aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50652/0 (socket says 172.21.15.17:50652) 2023-07-14T13:16:10.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.329+0000 7f113effd700 1 -- 172.21.15.17:0/2534981216 learned_addr learned my addr 172.21.15.17:0/2534981216 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.329+0000 7f113effd700 1 --2- 172.21.15.17:0/2534981216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c446752d0 0x557c446874a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.329+0000 7f113f7fe700 1 --2- 172.21.15.17:0/2534981216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c44675be0 0x557c4467e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.330+0000 7f113effd700 1 -- 172.21.15.17:0/2534981216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c44675be0 msgr2=0x557c4467e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.330+0000 7f113effd700 1 --2- 172.21.15.17:0/2534981216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c44675be0 0x557c4467e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.330+0000 7f113effd700 1 -- 172.21.15.17:0/2534981216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c446752d0 msgr2=0x557c446874a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.330+0000 7f113effd700 1 --2- 172.21.15.17:0/2534981216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c446752d0 0x557c446874a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.330+0000 7f113effd700 1 -- 172.21.15.17:0/2534981216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c4441c250 con 0x557c44680ad0 2023-07-14T13:16:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.330+0000 7f113effd700 1 --2- 172.21.15.17:0/2534981216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 0x557c4467aa60 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x557c44672c40 tx=0x7f11340092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7de4f5f88e42d9c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.330+0000 7f11267fc700 1 -- 172.21.15.17:0/2534981216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134004930 con 0x557c44680ad0 2023-07-14T13:16:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.330+0000 7f11267fc700 1 -- 172.21.15.17:0/2534981216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1134004a90 con 0x557c44680ad0 2023-07-14T13:16:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.330+0000 7f11267fc700 1 -- 172.21.15.17:0/2534981216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134010460 con 0x557c44680ad0 2023-07-14T13:16:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.331+0000 7f1159b40b80 1 -- 172.21.15.17:0/2534981216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 msgr2=0x557c4467aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.331+0000 7f1159b40b80 1 --2- 172.21.15.17:0/2534981216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 0x557c4467aa60 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x557c44672c40 tx=0x7f11340092e0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.331+0000 7f1159b40b80 1 -- 172.21.15.17:0/2534981216 shutdown_connections 2023-07-14T13:16:10.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.331+0000 7f1159b40b80 1 --2- 172.21.15.17:0/2534981216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 0x557c4467aa60 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.331+0000 7f1159b40b80 1 --2- 172.21.15.17:0/2534981216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c446752d0 0x557c446874a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.331+0000 7f1159b40b80 1 --2- 172.21.15.17:0/2534981216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c44675be0 0x557c4467e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.331+0000 7f1159b40b80 1 -- 172.21.15.17:0/2534981216 >> 172.21.15.17:0/2534981216 conn(0x557c4466bda0 msgr2=0x557c4468c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.331+0000 7f1159b40b80 1 -- 172.21.15.17:0/2534981216 shutdown_connections 2023-07-14T13:16:10.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.331+0000 7f1159b40b80 1 -- 172.21.15.17:0/2534981216 wait complete. 2023-07-14T13:16:10.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.332+0000 7f1159b40b80 1 -- start start 2023-07-14T13:16:10.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.332+0000 7f1159b40b80 1 Processor -- start 2023-07-14T13:16:10.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.332+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 0x557c44687480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.332+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44675be0 0x557c446858b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f1159b40b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 0x557c44685ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f1159b40b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c44686700 con 0x557c44680ad0 2023-07-14T13:16:10.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f1159b40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c446e42a0 con 0x557c44675be0 2023-07-14T13:16:10.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f1159b40b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c446e43e0 con 0x557c446752d0 2023-07-14T13:16:10.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f1159b40b80 10 client.0 _ll_register_callbacks cb 0x7f1130009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:10.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f113effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 0x557c44685ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f113effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 0x557c44687480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f113effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 0x557c44687480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45688/0 (socket says 172.21.15.17:45688) 2023-07-14T13:16:10.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f113effd700 1 -- 172.21.15.17:0/26605291 learned_addr learned my addr 172.21.15.17:0/26605291 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f113f7fe700 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44675be0 0x557c446858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f113effd700 1 -- 172.21.15.17:0/26605291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44675be0 msgr2=0x557c446858b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f113effd700 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44675be0 0x557c446858b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f113effd700 1 -- 172.21.15.17:0/26605291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 msgr2=0x557c44685ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f113effd700 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 0x557c44685ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.333+0000 7f113effd700 1 -- 172.21.15.17:0/26605291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113402a040 con 0x557c446752d0 2023-07-14T13:16:10.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.334+0000 7f113effd700 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 0x557c44687480 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1134004c20 tx=0x7f1134000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86ec3287de24479b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.334+0000 7f111effd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:16:10.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.334+0000 7f111effd700 1 -- 172.21.15.17:0/26605291 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113402d570 con 0x557c446752d0 2023-07-14T13:16:10.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.334+0000 7f1159b40b80 1 -- 172.21.15.17:0/26605291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11340044c0 con 0x557c446752d0 2023-07-14T13:16:10.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.334+0000 7f111effd700 1 -- 172.21.15.17:0/26605291 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f1134000e40 con 0x557c446752d0 2023-07-14T13:16:10.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.334+0000 7f111effd700 1 -- 172.21.15.17:0/26605291 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1134013020 con 0x557c446752d0 2023-07-14T13:16:10.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.334+0000 7f1159b40b80 10 client.27931 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:10.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.334+0000 7f1159b40b80 1 -- 172.21.15.17:0/26605291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x557c443f42b0 con 0x557c446752d0 2023-07-14T13:16:10.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.335+0000 7f111effd700 1 -- 172.21.15.17:0/26605291 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1134041080 con 0x557c446752d0 2023-07-14T13:16:10.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.335+0000 7f111effd700 1 -- 172.21.15.17:0/26605291 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f1134010600 con 0x557c446752d0 2023-07-14T13:16:10.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.335+0000 7f1159b40b80 10 client.27931 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:10.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.335+0000 7f1159b40b80 10 client.27931 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:16:10.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.335+0000 7f1159b40b80 20 client.27931 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:10.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.335+0000 7f1159b40b80 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557c446e5780 0x557c446e7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.335+0000 7f1159b40b80 4 client.27931 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:16:10.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.335+0000 7f1159b40b80 1 -- 172.21.15.17:0/26605291 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557c44583050 con 0x557c446e5780 2023-07-14T13:16:10.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.336+0000 7f113f7fe700 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557c446e5780 0x557c446e7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.336+0000 7f113f7fe700 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557c446e5780 0x557c446e7b90 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e21324d7256f5ee server_cookie=6225c699338d6025 in_seq=0 out_seq=0 2023-07-14T13:16:10.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.336+0000 7f111effd700 10 client.27931 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:16:10.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.336+0000 7f111effd700 1 -- 172.21.15.17:0/26605291 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557c44583050 con 0x557c446e5780 2023-07-14T13:16:10.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.336+0000 7f111effd700 10 client.27931 handle_command_reply: tid=0 2023-07-14T13:16:10.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.336+0000 7f1159b40b80 1 client.27931 shutdown 2023-07-14T13:16:10.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f1159b40b80 1 -- 172.21.15.17:0/26605291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 msgr2=0x557c44687480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f1159b40b80 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 0x557c44687480 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1134004c20 tx=0x7f1134000bc0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f1159b40b80 1 -- 172.21.15.17:0/26605291 shutdown_connections 2023-07-14T13:16:10.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f1159b40b80 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557c44680ad0 0x557c44685ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f1159b40b80 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557c446752d0 0x557c44687480 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f1159b40b80 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557c446e5780 0x557c446e7b90 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f1159b40b80 1 --2- 172.21.15.17:0/26605291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c44675be0 0x557c446858b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f111effd700 0 client.27931 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:16:10.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f1159b40b80 1 -- 172.21.15.17:0/26605291 >> 172.21.15.17:0/26605291 conn(0x557c4466bda0 msgr2=0x557c4467bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f1159b40b80 1 -- 172.21.15.17:0/26605291 shutdown_connections 2023-07-14T13:16:10.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f1159b40b80 1 -- 172.21.15.17:0/26605291 wait complete. 2023-07-14T13:16:10.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.337+0000 7f1159b40b80 20 client.27931 trim_cache size 0 max 16384 2023-07-14T13:16:10.383 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:16:10.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 -- 172.21.15.17:0/3207232966 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11280a1410 msgr2=0x7f11280a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11280a1410 0x7f11280a38c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1138007fd0 tx=0x7f1138009040 comp rx=0 tx=0).stop 2023-07-14T13:16:10.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 -- 172.21.15.17:0/3207232966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f114010a070 msgr2=0x7f11401a3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f114010a070 0x7f11401a3e60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f113800b070 tx=0x7f113800bce0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 -- 172.21.15.17:0/3207232966 shutdown_connections 2023-07-14T13:16:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f11280a1410 0x7f11280a38c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f114010a070 0x7f11401a3e60 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1140100ca0 0x7f11400fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 --2- 172.21.15.17:0/3207232966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11401015b0 0x7f11400fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 -- 172.21.15.17:0/3207232966 >> 172.21.15.17:0/3207232966 conn(0x7f11400fa4b0 msgr2=0x7f114010c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 -- 172.21.15.17:0/3207232966 shutdown_connections 2023-07-14T13:16:10.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.338+0000 7f11461ff700 1 -- 172.21.15.17:0/3207232966 wait complete. 2023-07-14T13:16:10.403 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:16:10.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.596+0000 7f9b4ebff700 1 -- 172.21.15.17:0/3858143454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480ffb00 msgr2=0x7f9b480fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.596+0000 7f9b4ebff700 1 --2- 172.21.15.17:0/3858143454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480ffb00 0x7f9b480fff70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009990 tx=0x7f9b34009ca0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.596+0000 7f9b4ebff700 1 -- 172.21.15.17:0/3858143454 shutdown_connections 2023-07-14T13:16:10.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.596+0000 7f9b4ebff700 1 --2- 172.21.15.17:0/3858143454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b481004b0 0x7f9b4810c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.596+0000 7f9b4ebff700 1 --2- 172.21.15.17:0/3858143454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b48105b10 0x7f9b48105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.596+0000 7f9b4ebff700 1 --2- 172.21.15.17:0/3858143454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480ffb00 0x7f9b480fff70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.596+0000 7f9b4ebff700 1 -- 172.21.15.17:0/3858143454 >> 172.21.15.17:0/3858143454 conn(0x7f9b480fb600 msgr2=0x7f9b480fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.596+0000 7f9b4ebff700 1 -- 172.21.15.17:0/3858143454 shutdown_connections 2023-07-14T13:16:10.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.596+0000 7f9b4ebff700 1 -- 172.21.15.17:0/3858143454 wait complete. 2023-07-14T13:16:10.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.597+0000 7f9b4ebff700 1 Processor -- start 2023-07-14T13:16:10.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.597+0000 7f9b4ebff700 1 -- start start 2023-07-14T13:16:10.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.598+0000 7f9b4ebff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480ffb00 0x7f9b4819b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.598+0000 7f9b4ebff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b481004b0 0x7f9b4819be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.639 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.598+0000 7f9b4ebff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b48105b10 0x7f9b481959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.598+0000 7f9b4ebff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b48196020 con 0x7f9b480ffb00 2023-07-14T13:16:10.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.598+0000 7f9b4ebff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b48196190 con 0x7f9b48105b10 2023-07-14T13:16:10.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.598+0000 7f9b4ebff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b48196350 con 0x7f9b481004b0 2023-07-14T13:16:10.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.598+0000 7f9b4c99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480ffb00 0x7f9b4819b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.598+0000 7f9b4c99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480ffb00 0x7f9b4819b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50680/0 (socket says 172.21.15.17:50680) 2023-07-14T13:16:10.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.598+0000 7f9b4c99b700 1 -- 172.21.15.17:0/1150870897 learned_addr learned my addr 172.21.15.17:0/1150870897 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.640 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.598+0000 7f9b47fff700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b481004b0 0x7f9b4819be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.598+0000 7f9b4d19c700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b48105b10 0x7f9b481959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.599+0000 7f9b4c99b700 1 -- 172.21.15.17:0/1150870897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b481004b0 msgr2=0x7f9b4819be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.599+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b481004b0 0x7f9b4819be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.599+0000 7f9b4c99b700 1 -- 172.21.15.17:0/1150870897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b48105b10 msgr2=0x7f9b481959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.599+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b48105b10 0x7f9b481959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.599+0000 7f9b4c99b700 1 -- 172.21.15.17:0/1150870897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b340095f0 con 0x7f9b480ffb00 2023-07-14T13:16:10.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.599+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480ffb00 0x7f9b4819b940 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00d980 tx=0x7f9b3c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.599+0000 7f9b45ffb700 1 -- 172.21.15.17:0/1150870897 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c004220 con 0x7f9b480ffb00 2023-07-14T13:16:10.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.599+0000 7f9b4ebff700 1 -- 172.21.15.17:0/1150870897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b48196630 con 0x7f9b480ffb00 2023-07-14T13:16:10.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.599+0000 7f9b45ffb700 1 -- 172.21.15.17:0/1150870897 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b3c007640 con 0x7f9b480ffb00 2023-07-14T13:16:10.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.599+0000 7f9b45ffb700 1 -- 172.21.15.17:0/1150870897 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c005660 con 0x7f9b480ffb00 2023-07-14T13:16:10.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.599+0000 7f9b4ebff700 1 -- 172.21.15.17:0/1150870897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b481a2930 con 0x7f9b480ffb00 2023-07-14T13:16:10.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.603+0000 7f9b45ffb700 1 -- 172.21.15.17:0/1150870897 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9b3c004750 con 0x7f9b480ffb00 2023-07-14T13:16:10.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.605+0000 7f9b6258ab80 1 Processor -- start 2023-07-14T13:16:10.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.605+0000 7f9b6258ab80 1 -- start start 2023-07-14T13:16:10.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.605+0000 7f9b45ffb700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b380a12c0 0x7f9b380a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.605+0000 7f9b45ffb700 1 -- 172.21.15.17:0/1150870897 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f9b3c0cca50 con 0x7f9b480ffb00 2023-07-14T13:16:10.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.605+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a756a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.605+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a849a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.605+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 0x559ae6a872c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.605+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae697bcb0 con 0x559ae6a84ee0 2023-07-14T13:16:10.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.605+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae69cea40 con 0x559ae6a752d0 2023-07-14T13:16:10.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.605+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae69c7ed0 con 0x559ae6a75be0 2023-07-14T13:16:10.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b4d19c700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b380a12c0 0x7f9b380a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b4c99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b4c99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a756a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60612/0 (socket says 172.21.15.17:60612) 2023-07-14T13:16:10.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b4c99b700 1 -- 172.21.15.17:0/867337581 learned_addr learned my addr 172.21.15.17:0/867337581 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b4d19c700 1 --2- 172.21.15.17:0/867337581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 0x559ae6a872c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b47fff700 1 --2- 172.21.15.17:0/867337581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a849a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b4c99b700 1 -- 172.21.15.17:0/867337581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 msgr2=0x559ae6a849a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/867337581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a849a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b4c99b700 1 -- 172.21.15.17:0/867337581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 msgr2=0x559ae6a872c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/867337581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 0x559ae6a872c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b4c99b700 1 -- 172.21.15.17:0/867337581 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ae67f5de0 con 0x559ae6a752d0 2023-07-14T13:16:10.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.606+0000 7f9b4d19c700 1 --2- 172.21.15.17:0/867337581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 0x559ae6a872c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:16:10.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.607+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/867337581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a756a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c095fb0 tx=0x7f9b3c004380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62a4cb07d7893418 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.607+0000 7f9b4d19c700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b380a12c0 0x7f9b380a3770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b4819c640 tx=0x7f9b4000b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.607+0000 7f9b32ffd700 1 -- 172.21.15.17:0/867337581 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0a1f00 con 0x559ae6a752d0 2023-07-14T13:16:10.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.607+0000 7f9b32ffd700 1 -- 172.21.15.17:0/867337581 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b3c0961c0 con 0x559ae6a752d0 2023-07-14T13:16:10.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.607+0000 7f9b32ffd700 1 -- 172.21.15.17:0/867337581 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c099200 con 0x559ae6a752d0 2023-07-14T13:16:10.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.608+0000 7f9b6258ab80 1 -- 172.21.15.17:0/867337581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 msgr2=0x559ae6a756a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.608+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/867337581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a756a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c095fb0 tx=0x7f9b3c004380 comp rx=0 tx=0).stop 2023-07-14T13:16:10.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.608+0000 7f9b6258ab80 1 -- 172.21.15.17:0/867337581 shutdown_connections 2023-07-14T13:16:10.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.608+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/867337581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 0x559ae6a872c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.608+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/867337581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a756a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.608+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/867337581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a849a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.608+0000 7f9b6258ab80 1 -- 172.21.15.17:0/867337581 >> 172.21.15.17:0/867337581 conn(0x559ae6a6bda0 msgr2=0x559ae6a716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.608+0000 7f9b6258ab80 1 -- 172.21.15.17:0/867337581 shutdown_connections 2023-07-14T13:16:10.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.608+0000 7f9b6258ab80 1 -- 172.21.15.17:0/867337581 wait complete. 2023-07-14T13:16:10.651 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.608+0000 7f9b6258ab80 1 -- start start 2023-07-14T13:16:10.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.609+0000 7f9b6258ab80 1 Processor -- start 2023-07-14T13:16:10.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.609+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a84930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.609+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a81c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.609+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 0x559ae6a82360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.609+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae6967ac0 con 0x559ae6a84ee0 2023-07-14T13:16:10.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.609+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae69677c0 con 0x559ae6a752d0 2023-07-14T13:16:10.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.609+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae684b920 con 0x559ae6a75be0 2023-07-14T13:16:10.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.610+0000 7f9b6258ab80 10 client.0 _ll_register_callbacks cb 0x559ae6965760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:10.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.610+0000 7f9b4d19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 0x559ae6a82360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.610+0000 7f9b4d19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 0x559ae6a82360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50702/0 (socket says 172.21.15.17:50702) 2023-07-14T13:16:10.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.610+0000 7f9b4d19c700 1 -- 172.21.15.17:0/116240019 learned_addr learned my addr 172.21.15.17:0/116240019 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.610+0000 7f9b47fff700 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a81c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.610+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a84930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.610+0000 7f9b4d19c700 1 -- 172.21.15.17:0/116240019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 msgr2=0x559ae6a81c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.610+0000 7f9b4d19c700 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a81c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.610+0000 7f9b4d19c700 1 -- 172.21.15.17:0/116240019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 msgr2=0x559ae6a84930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.610+0000 7f9b4d19c700 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a84930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.610+0000 7f9b4d19c700 1 -- 172.21.15.17:0/116240019 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b481a2930 con 0x559ae6a84ee0 2023-07-14T13:16:10.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.611+0000 7f9b4d19c700 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 0x559ae6a82360 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9b40017db0 tx=0x7f9b40004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa1a1e61a95987b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.611+0000 7f9b27fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:10.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.611+0000 7f9b27fff700 1 -- 172.21.15.17:0/116240019 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4001f070 con 0x559ae6a84ee0 2023-07-14T13:16:10.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.611+0000 7f9b27fff700 1 -- 172.21.15.17:0/116240019 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f9b40017de0 con 0x559ae6a84ee0 2023-07-14T13:16:10.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.611+0000 7f9b6258ab80 1 -- 172.21.15.17:0/116240019 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ae69214f0 con 0x559ae6a84ee0 2023-07-14T13:16:10.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.611+0000 7f9b27fff700 1 -- 172.21.15.17:0/116240019 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b4001ab30 con 0x559ae6a84ee0 2023-07-14T13:16:10.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.611+0000 7f9b6258ab80 10 client.18261 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:10.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.612+0000 7f9b6258ab80 1 -- 172.21.15.17:0/116240019 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x559ae67dec60 con 0x559ae6a84ee0 2023-07-14T13:16:10.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.612+0000 7f9b27fff700 1 -- 172.21.15.17:0/116240019 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b40032020 con 0x559ae6a84ee0 2023-07-14T13:16:10.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.612+0000 7f9b27fff700 1 -- 172.21.15.17:0/116240019 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f9b40025c00 con 0x559ae6a84ee0 2023-07-14T13:16:10.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.612+0000 7f9b6258ab80 10 client.18261 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:10.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.612+0000 7f9b6258ab80 10 client.18261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:10.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.612+0000 7f9b6258ab80 20 client.18261 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:10.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.612+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559ae6a94870 0x559ae6a96c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.612+0000 7f9b6258ab80 4 client.18261 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:10.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.612+0000 7f9b6258ab80 1 -- 172.21.15.17:0/116240019 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ae69c0eb0 con 0x559ae6a94870 2023-07-14T13:16:10.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.613+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559ae6a94870 0x559ae6a96c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.613+0000 7f9b27fff700 10 client.18261 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:10.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.613+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559ae6a94870 0x559ae6a96c80 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84c9f88cbc9411dd server_cookie=6d70cce8db782edb in_seq=0 out_seq=0 2023-07-14T13:16:10.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b27fff700 1 -- 172.21.15.17:0/116240019 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559ae69c0eb0 con 0x559ae6a94870 2023-07-14T13:16:10.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b27fff700 10 client.18261 handle_command_reply: tid=0 2023-07-14T13:16:10.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b6258ab80 1 client.18261 shutdown 2023-07-14T13:16:10.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b6258ab80 1 -- 172.21.15.17:0/116240019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 msgr2=0x559ae6a82360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 0x559ae6a82360 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9b40017db0 tx=0x7f9b40004b40 comp rx=0 tx=0).stop 2023-07-14T13:16:10.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b6258ab80 1 -- 172.21.15.17:0/116240019 shutdown_connections 2023-07-14T13:16:10.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559ae6a94870 0x559ae6a96c80 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a84ee0 0x559ae6a82360 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a84930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/116240019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a81c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b6258ab80 1 -- 172.21.15.17:0/116240019 >> 172.21.15.17:0/116240019 conn(0x559ae6a6bda0 msgr2=0x559ae6a71230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.614+0000 7f9b27fff700 0 client.18261 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:10.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.615+0000 7f9b6258ab80 1 -- 172.21.15.17:0/116240019 shutdown_connections 2023-07-14T13:16:10.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.615+0000 7f9b6258ab80 1 -- 172.21.15.17:0/116240019 wait complete. 2023-07-14T13:16:10.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.615+0000 7f9b6258ab80 20 client.18261 trim_cache size 0 max 16384 2023-07-14T13:16:10.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.635+0000 7f9b6258ab80 1 Processor -- start 2023-07-14T13:16:10.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.635+0000 7f9b6258ab80 1 -- start start 2023-07-14T13:16:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.635+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a6bda0 0x559ae6a81400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.635+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a844d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.635+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a75be0 0x559ae6a7cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.635+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae6a68fa0 con 0x559ae6a75be0 2023-07-14T13:16:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.635+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae6a6b970 con 0x559ae6a752d0 2023-07-14T13:16:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.635+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae6a91ec0 con 0x559ae6a6bda0 2023-07-14T13:16:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.636+0000 7f9b4d19c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a75be0 0x559ae6a7cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.636+0000 7f9b4c99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a6bda0 0x559ae6a81400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.636+0000 7f9b4c99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a6bda0 0x559ae6a81400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45740/0 (socket says 172.21.15.17:45740) 2023-07-14T13:16:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.636+0000 7f9b4c99b700 1 -- 172.21.15.17:0/1294427210 learned_addr learned my addr 172.21.15.17:0/1294427210 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.636+0000 7f9b47fff700 1 --2- 172.21.15.17:0/1294427210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a844d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.636+0000 7f9b4c99b700 1 -- 172.21.15.17:0/1294427210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 msgr2=0x559ae6a844d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.636+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/1294427210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a844d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.636+0000 7f9b4c99b700 1 -- 172.21.15.17:0/1294427210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a75be0 msgr2=0x559ae6a7cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.636+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/1294427210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a75be0 0x559ae6a7cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.636+0000 7f9b4c99b700 1 -- 172.21.15.17:0/1294427210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ae681c250 con 0x559ae6a6bda0 2023-07-14T13:16:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.636+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/1294427210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a6bda0 0x559ae6a81400 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c004570 tx=0x7f9b3c0999b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebe81b4777113d49 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.637+0000 7f9b337fe700 1 -- 172.21.15.17:0/1294427210 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0b6070 con 0x559ae6a6bda0 2023-07-14T13:16:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.637+0000 7f9b337fe700 1 -- 172.21.15.17:0/1294427210 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b3c0a1f80 con 0x559ae6a6bda0 2023-07-14T13:16:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.637+0000 7f9b337fe700 1 -- 172.21.15.17:0/1294427210 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c099d10 con 0x559ae6a6bda0 2023-07-14T13:16:10.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.638+0000 7f9b6258ab80 1 -- 172.21.15.17:0/1294427210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a6bda0 msgr2=0x559ae6a81400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.638+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/1294427210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a6bda0 0x559ae6a81400 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c004570 tx=0x7f9b3c0999b0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.638+0000 7f9b6258ab80 1 -- 172.21.15.17:0/1294427210 shutdown_connections 2023-07-14T13:16:10.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.638+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/1294427210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a75be0 0x559ae6a7cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.638+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/1294427210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a6bda0 0x559ae6a81400 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.638+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/1294427210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a844d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.638+0000 7f9b6258ab80 1 -- 172.21.15.17:0/1294427210 >> 172.21.15.17:0/1294427210 conn(0x559ae6a824d0 msgr2=0x559ae6a90b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.638+0000 7f9b6258ab80 1 -- 172.21.15.17:0/1294427210 shutdown_connections 2023-07-14T13:16:10.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.638+0000 7f9b6258ab80 1 -- 172.21.15.17:0/1294427210 wait complete. 2023-07-14T13:16:10.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.639+0000 7f9b6258ab80 1 -- start start 2023-07-14T13:16:10.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.639+0000 7f9b6258ab80 1 Processor -- start 2023-07-14T13:16:10.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.639+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a6bda0 0x559ae6a8b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.639+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a8b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.639+0000 7f9b6258ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a898a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.639+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae6a89e70 con 0x559ae6a6bda0 2023-07-14T13:16:10.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.639+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae6a89fe0 con 0x559ae6a752d0 2023-07-14T13:16:10.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.639+0000 7f9b6258ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae6a8a1a0 con 0x559ae6a75be0 2023-07-14T13:16:10.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.639+0000 7f9b6258ab80 10 client.0 _ll_register_callbacks cb 0x7f9b40017990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:10.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.640+0000 7f9b4c99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a6bda0 0x559ae6a8b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.640+0000 7f9b4c99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a6bda0 0x559ae6a8b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50726/0 (socket says 172.21.15.17:50726) 2023-07-14T13:16:10.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.640+0000 7f9b4c99b700 1 -- 172.21.15.17:0/2953153908 learned_addr learned my addr 172.21.15.17:0/2953153908 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:10.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.640+0000 7f9b4d19c700 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a898a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.640+0000 7f9b4c99b700 1 -- 172.21.15.17:0/2953153908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 msgr2=0x559ae6a898a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:10.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.640+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a898a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.640+0000 7f9b4c99b700 1 -- 172.21.15.17:0/2953153908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 msgr2=0x559ae6a8b810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:16:10.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.640+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a8b810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.640+0000 7f9b4c99b700 1 -- 172.21.15.17:0/2953153908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ae67f5de0 con 0x559ae6a6bda0 2023-07-14T13:16:10.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.640+0000 7f9b4d19c700 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a898a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:16:10.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.641+0000 7f9b4c99b700 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a6bda0 0x559ae6a8b2d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00d950 tx=0x7f9b3c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80a4e34f902844a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:10.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.641+0000 7f9b27fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:10.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.641+0000 7f9b27fff700 1 -- 172.21.15.17:0/2953153908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0b6030 con 0x559ae6a6bda0 2023-07-14T13:16:10.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.641+0000 7f9b6258ab80 1 -- 172.21.15.17:0/2953153908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b3c0961c0 con 0x559ae6a6bda0 2023-07-14T13:16:10.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.641+0000 7f9b27fff700 1 -- 172.21.15.17:0/2953153908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f9b3c0b7070 con 0x559ae6a6bda0 2023-07-14T13:16:10.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.641+0000 7f9b27fff700 1 -- 172.21.15.17:0/2953153908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b3c099f10 con 0x559ae6a6bda0 2023-07-14T13:16:10.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.641+0000 7f9b6258ab80 10 client.18267 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:10.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.641+0000 7f9b6258ab80 1 -- 172.21.15.17:0/2953153908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x559ae67f42b0 con 0x559ae6a6bda0 2023-07-14T13:16:10.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.641+0000 7f9b27fff700 1 -- 172.21.15.17:0/2953153908 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b3c0961c0 con 0x559ae6a6bda0 2023-07-14T13:16:10.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.641+0000 7f9b27fff700 1 -- 172.21.15.17:0/2953153908 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f9b3c098a10 con 0x559ae6a6bda0 2023-07-14T13:16:10.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.642+0000 7f9b6258ab80 10 client.18267 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:10.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.642+0000 7f9b6258ab80 10 client.18267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:10.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.642+0000 7f9b6258ab80 20 client.18267 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:10.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.642+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559ae6a84ee0 0x559ae6aeb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:10.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.642+0000 7f9b6258ab80 4 client.18267 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:16:10.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.642+0000 7f9b6258ab80 1 -- 172.21.15.17:0/2953153908 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559ae6983050 con 0x559ae6a84ee0 2023-07-14T13:16:10.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.642+0000 7f9b47fff700 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559ae6a84ee0 0x559ae6aeb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:10.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b47fff700 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559ae6a84ee0 0x559ae6aeb3e0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1a6ce7c35e4edda server_cookie=ed561257a647d960 in_seq=0 out_seq=0 2023-07-14T13:16:10.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b27fff700 10 client.18267 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:10.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b27fff700 1 -- 172.21.15.17:0/2953153908 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559ae6983050 con 0x559ae6a84ee0 2023-07-14T13:16:10.687 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b27fff700 10 client.18267 handle_command_reply: tid=0 2023-07-14T13:16:10.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b6258ab80 1 client.18267 shutdown 2023-07-14T13:16:10.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b6258ab80 1 -- 172.21.15.17:0/2953153908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a6bda0 msgr2=0x559ae6a8b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a6bda0 0x559ae6a8b2d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00d950 tx=0x7f9b3c004430 comp rx=0 tx=0).stop 2023-07-14T13:16:10.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b6258ab80 1 -- 172.21.15.17:0/2953153908 shutdown_connections 2023-07-14T13:16:10.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559ae6a84ee0 0x559ae6aeb3e0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ae6a75be0 0x559ae6a898a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559ae6a6bda0 0x559ae6a8b2d0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b6258ab80 1 --2- 172.21.15.17:0/2953153908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ae6a752d0 0x559ae6a8b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b6258ab80 1 -- 172.21.15.17:0/2953153908 >> 172.21.15.17:0/2953153908 conn(0x559ae6a824d0 msgr2=0x559ae6a7cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b27fff700 0 client.18267 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:10.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b6258ab80 1 -- 172.21.15.17:0/2953153908 shutdown_connections 2023-07-14T13:16:10.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.643+0000 7f9b6258ab80 1 -- 172.21.15.17:0/2953153908 wait complete. 2023-07-14T13:16:10.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.644+0000 7f9b6258ab80 20 client.18267 trim_cache size 0 max 16384 2023-07-14T13:16:10.689 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:16:10.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.644+0000 7f9b4ebff700 1 -- 172.21.15.17:0/1150870897 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b380a12c0 msgr2=0x7f9b380a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.644+0000 7f9b4ebff700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b380a12c0 0x7f9b380a3770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b4819c640 tx=0x7f9b4000b040 comp rx=0 tx=0).stop 2023-07-14T13:16:10.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.644+0000 7f9b4ebff700 1 -- 172.21.15.17:0/1150870897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480ffb00 msgr2=0x7f9b4819b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.644+0000 7f9b4ebff700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480ffb00 0x7f9b4819b940 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00d980 tx=0x7f9b3c00dc90 comp rx=0 tx=0).stop 2023-07-14T13:16:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.644+0000 7f9b4ebff700 1 -- 172.21.15.17:0/1150870897 shutdown_connections 2023-07-14T13:16:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.644+0000 7f9b4ebff700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9b380a12c0 0x7f9b380a3770 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.644+0000 7f9b4ebff700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b48105b10 0x7f9b481959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.644+0000 7f9b4ebff700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b480ffb00 0x7f9b4819b940 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.644+0000 7f9b4ebff700 1 --2- 172.21.15.17:0/1150870897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b481004b0 0x7f9b4819be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.644+0000 7f9b4ebff700 1 -- 172.21.15.17:0/1150870897 >> 172.21.15.17:0/1150870897 conn(0x7f9b480fb600 msgr2=0x7f9b480fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:10.691 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.645+0000 7f9b4ebff700 1 -- 172.21.15.17:0/1150870897 shutdown_connections 2023-07-14T13:16:10.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:10.645+0000 7f9b4ebff700 1 -- 172.21.15.17:0/1150870897 wait complete. 2023-07-14T13:16:10.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:10 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/300776253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:16:10.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:10 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/300776253' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:16:11.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:11 smithi017 ceph-mon[95536]: pgmap v517: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 39 op/s 2023-07-14T13:16:11.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:11 smithi017 ceph-mon[95536]: osdmap e111: 12 total, 12 up, 12 in 2023-07-14T13:16:11.707 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:16:11.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:16:11.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:11 smithi135 ceph-mon[97338]: pgmap v517: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 39 op/s 2023-07-14T13:16:11.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:11 smithi135 ceph-mon[97338]: osdmap e111: 12 total, 12 up, 12 in 2023-07-14T13:16:11.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:11 smithi131 ceph-mon[96953]: pgmap v517: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 28 MiB/s wr, 39 op/s 2023-07-14T13:16:11.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:11 smithi131 ceph-mon[96953]: osdmap e111: 12 total, 12 up, 12 in 2023-07-14T13:16:11.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.910+0000 7fb9e09fe700 1 -- 172.21.15.17:0/241188106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc101e60 msgr2=0x7fb9dc102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:11.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.910+0000 7fb9e09fe700 1 --2- 172.21.15.17:0/241188106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc101e60 0x7fb9dc102230 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0099c0 tx=0x7fb9cc009cd0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.910+0000 7fb9e09fe700 1 -- 172.21.15.17:0/241188106 shutdown_connections 2023-07-14T13:16:11.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.910+0000 7fb9e09fe700 1 --2- 172.21.15.17:0/241188106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc106ea0 0x7fb9dc10ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.910+0000 7fb9e09fe700 1 --2- 172.21.15.17:0/241188106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc101e60 0x7fb9dc102230 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.910+0000 7fb9e09fe700 1 --2- 172.21.15.17:0/241188106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9dc102800 0x7fb9dc1067c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.910+0000 7fb9e09fe700 1 -- 172.21.15.17:0/241188106 >> 172.21.15.17:0/241188106 conn(0x7fb9dc0fd690 msgr2=0x7fb9dc0ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:11.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.910+0000 7fb9e09fe700 1 -- 172.21.15.17:0/241188106 shutdown_connections 2023-07-14T13:16:11.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.910+0000 7fb9e09fe700 1 -- 172.21.15.17:0/241188106 wait complete. 2023-07-14T13:16:11.951 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.911+0000 7fb9e09fe700 1 Processor -- start 2023-07-14T13:16:11.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.912+0000 7fb9e09fe700 1 -- start start 2023-07-14T13:16:11.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.912+0000 7fb9e09fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc101e60 0x7fb9dc19d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.912+0000 7fb9e09fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9dc102800 0x7fb9dc19de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.912+0000 7fb9e09fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc106ea0 0x7fb9dc197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.912+0000 7fb9e09fe700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc1980d0 con 0x7fb9dc106ea0 2023-07-14T13:16:11.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.912+0000 7fb9e09fe700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc198240 con 0x7fb9dc102800 2023-07-14T13:16:11.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.912+0000 7fb9e09fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc198400 con 0x7fb9dc101e60 2023-07-14T13:16:11.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.912+0000 7fb9db59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc106ea0 0x7fb9dc197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.912+0000 7fb9dad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc101e60 0x7fb9dc19d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.912+0000 7fb9da59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9dc102800 0x7fb9dc19de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.913+0000 7fb9da59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9dc102800 0x7fb9dc19de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60654/0 (socket says 172.21.15.17:60654) 2023-07-14T13:16:11.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.913+0000 7fb9dad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc101e60 0x7fb9dc19d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45774/0 (socket says 172.21.15.17:45774) 2023-07-14T13:16:11.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.913+0000 7fb9da59c700 1 -- 172.21.15.17:0/4163508825 learned_addr learned my addr 172.21.15.17:0/4163508825 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:11.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.913+0000 7fb9da59c700 1 -- 172.21.15.17:0/4163508825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc101e60 msgr2=0x7fb9dc19d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:11.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.913+0000 7fb9da59c700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc101e60 0x7fb9dc19d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.913+0000 7fb9da59c700 1 -- 172.21.15.17:0/4163508825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc106ea0 msgr2=0x7fb9dc197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:11.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.913+0000 7fb9da59c700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc106ea0 0x7fb9dc197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.913+0000 7fb9da59c700 1 -- 172.21.15.17:0/4163508825 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc0095f0 con 0x7fb9dc102800 2023-07-14T13:16:11.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.913+0000 7fb9da59c700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9dc102800 0x7fb9dc19de60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000e940 tx=0x7fb9d000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:11.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.913+0000 7fb9c3fff700 1 -- 172.21.15.17:0/4163508825 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0009730 con 0x7fb9dc102800 2023-07-14T13:16:11.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.914+0000 7fb9c3fff700 1 -- 172.21.15.17:0/4163508825 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9d000ce70 con 0x7fb9dc102800 2023-07-14T13:16:11.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.914+0000 7fb9c3fff700 1 -- 172.21.15.17:0/4163508825 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0018420 con 0x7fb9dc102800 2023-07-14T13:16:11.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.914+0000 7fb9e09fe700 1 -- 172.21.15.17:0/4163508825 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc1986e0 con 0x7fb9dc102800 2023-07-14T13:16:11.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.914+0000 7fb9e09fe700 1 -- 172.21.15.17:0/4163508825 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc1a48a0 con 0x7fb9dc102800 2023-07-14T13:16:11.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.917+0000 7fb9c3fff700 1 -- 172.21.15.17:0/4163508825 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb9d000c9e0 con 0x7fb9dc102800 2023-07-14T13:16:11.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.919+0000 7fb9f4bb0b80 1 Processor -- start 2023-07-14T13:16:11.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.919+0000 7fb9f4bb0b80 1 -- start start 2023-07-14T13:16:11.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.919+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803570 0x556216803940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.919+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803e80 0x55621680d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.919+0000 7fb9c3fff700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9c40a13e0 0x7fb9c40a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.919+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55621680ddb0 0x556216810190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.919+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556216708d30 con 0x556216803e80 2023-07-14T13:16:11.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.919+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55621675bac0 con 0x55621680ddb0 2023-07-14T13:16:11.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.919+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556216754f50 con 0x556216803570 2023-07-14T13:16:11.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.919+0000 7fb9c3fff700 1 -- 172.21.15.17:0/4163508825 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb9d0014070 con 0x7fb9dc102800 2023-07-14T13:16:11.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9da59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803e80 0x55621680d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9dad9d700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9c40a13e0 0x7fb9c40a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9da59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803e80 0x55621680d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50732/0 (socket says 172.21.15.17:50732) 2023-07-14T13:16:11.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9da59c700 1 -- 172.21.15.17:0/2520645090 learned_addr learned my addr 172.21.15.17:0/2520645090 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:11.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9db59e700 1 --2- 172.21.15.17:0/2520645090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55621680ddb0 0x556216810190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9db59e700 1 --2- 172.21.15.17:0/2520645090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803570 0x556216803940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9da59c700 1 -- 172.21.15.17:0/2520645090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803570 msgr2=0x556216803940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:11.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9da59c700 1 --2- 172.21.15.17:0/2520645090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803570 0x556216803940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9da59c700 1 -- 172.21.15.17:0/2520645090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55621680ddb0 msgr2=0x556216810190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:11.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9da59c700 1 --2- 172.21.15.17:0/2520645090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55621680ddb0 0x556216810190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9da59c700 1 -- 172.21.15.17:0/2520645090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556216582e60 con 0x556216803e80 2023-07-14T13:16:11.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9db59e700 1 --2- 172.21.15.17:0/2520645090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55621680ddb0 0x556216810190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:11.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9da59c700 1 --2- 172.21.15.17:0/2520645090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803e80 0x55621680d870 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0096920 tx=0x7fb9d0099810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b19829be353702 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:11.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.920+0000 7fb9dad9d700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9c40a13e0 0x7fb9c40a3890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00b580 tx=0x7fb9cc005be0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:11.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.921+0000 7fb9c17fa700 1 -- 172.21.15.17:0/2520645090 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0099eb0 con 0x556216803e80 2023-07-14T13:16:11.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.921+0000 7fb9c17fa700 1 -- 172.21.15.17:0/2520645090 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9d009dee0 con 0x556216803e80 2023-07-14T13:16:11.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.921+0000 7fb9c17fa700 1 -- 172.21.15.17:0/2520645090 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d00b80f0 con 0x556216803e80 2023-07-14T13:16:11.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.921+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/2520645090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803e80 msgr2=0x55621680d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:11.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.921+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/2520645090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803e80 0x55621680d870 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0096920 tx=0x7fb9d0099810 comp rx=0 tx=0).stop 2023-07-14T13:16:11.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.922+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/2520645090 shutdown_connections 2023-07-14T13:16:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.922+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/2520645090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55621680ddb0 0x556216810190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.922+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/2520645090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803570 0x556216803940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.922+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/2520645090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803e80 0x55621680d870 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.922+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/2520645090 >> 172.21.15.17:0/2520645090 conn(0x5562167f9070 msgr2=0x5562167fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.922+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/2520645090 shutdown_connections 2023-07-14T13:16:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.922+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/2520645090 wait complete. 2023-07-14T13:16:11.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.922+0000 7fb9f4bb0b80 1 -- start start 2023-07-14T13:16:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.923+0000 7fb9f4bb0b80 1 Processor -- start 2023-07-14T13:16:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.923+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 0x55621680d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.923+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803e80 0x55621680aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.923+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55621680ddb0 0x55621680b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.923+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562166f4b40 con 0x556216803570 2023-07-14T13:16:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.923+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562166f4840 con 0x556216803e80 2023-07-14T13:16:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.923+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562165d89a0 con 0x55621680ddb0 2023-07-14T13:16:11.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.923+0000 7fb9f4bb0b80 10 client.0 _ll_register_callbacks cb 0x5562166f27e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9dad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 0x55621680d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9da59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803e80 0x55621680aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9da59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803e80 0x55621680aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60682/0 (socket says 172.21.15.17:60682) 2023-07-14T13:16:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9da59c700 1 -- 172.21.15.17:0/1841613013 learned_addr learned my addr 172.21.15.17:0/1841613013 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9db59e700 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55621680ddb0 0x55621680b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9da59c700 1 -- 172.21.15.17:0/1841613013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55621680ddb0 msgr2=0x55621680b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9da59c700 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55621680ddb0 0x55621680b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9da59c700 1 -- 172.21.15.17:0/1841613013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 msgr2=0x55621680d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9da59c700 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 0x55621680d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9da59c700 1 -- 172.21.15.17:0/1841613013 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d4008850 con 0x556216803e80 2023-07-14T13:16:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9da59c700 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803e80 0x55621680aa40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0000c00 tx=0x7fb9d000cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9644b7b099ded033 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.924+0000 7fb9beff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:16:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.925+0000 7fb9beff5700 1 -- 172.21.15.17:0/1841613013 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d00b82f0 con 0x556216803e80 2023-07-14T13:16:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.925+0000 7fb9beff5700 1 -- 172.21.15.17:0/1841613013 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb9d0099eb0 con 0x556216803e80 2023-07-14T13:16:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.925+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1841613013 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562166ae570 con 0x556216803e80 2023-07-14T13:16:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.925+0000 7fb9beff5700 1 -- 172.21.15.17:0/1841613013 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9d00a2300 con 0x556216803e80 2023-07-14T13:16:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.925+0000 7fb9f4bb0b80 10 client.27992 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.925+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1841613013 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x7fb9dc1a48a0 con 0x556216803e80 2023-07-14T13:16:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.925+0000 7fb9beff5700 1 -- 172.21.15.17:0/1841613013 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5562166ae570 con 0x556216803e80 2023-07-14T13:16:11.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.925+0000 7fb9beff5700 1 -- 172.21.15.17:0/1841613013 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fb9d00c2110 con 0x556216803e80 2023-07-14T13:16:11.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.925+0000 7fb9f4bb0b80 10 client.27992 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:11.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.925+0000 7fb9f4bb0b80 10 client.27992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:11.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.925+0000 7fb9f4bb0b80 20 client.27992 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:11.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.926+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55621681d3b0 0x55621681f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.926+0000 7fb9f4bb0b80 4 client.27992 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:11.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.926+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1841613013 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55621674df30 con 0x55621681d3b0 2023-07-14T13:16:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.926+0000 7fb9dad9d700 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55621681d3b0 0x55621681f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.927+0000 7fb9dad9d700 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55621681d3b0 0x55621681f7c0 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a3de0de5ff6910a server_cookie=13ca6b8c4d8c5211 in_seq=0 out_seq=0 2023-07-14T13:16:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.927+0000 7fb9beff5700 10 client.27992 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.927+0000 7fb9beff5700 1 -- 172.21.15.17:0/1841613013 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55621674df30 con 0x55621681d3b0 2023-07-14T13:16:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9beff5700 10 client.27992 handle_command_reply: tid=0 2023-07-14T13:16:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 1 client.27992 shutdown 2023-07-14T13:16:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1841613013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803e80 msgr2=0x55621680aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803e80 0x55621680aa40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0000c00 tx=0x7fb9d000cdc0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1841613013 shutdown_connections 2023-07-14T13:16:11.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55621681d3b0 0x55621681f7c0 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55621680ddb0 0x55621680b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 0x55621680d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9beff5700 0 client.27992 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:11.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1841613013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803e80 0x55621680aa40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:11.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1841613013 >> 172.21.15.17:0/1841613013 conn(0x5562167f9070 msgr2=0x5562167fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:11.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1841613013 shutdown_connections 2023-07-14T13:16:11.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1841613013 wait complete. 2023-07-14T13:16:11.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.928+0000 7fb9f4bb0b80 20 client.27992 trim_cache size 0 max 16384 2023-07-14T13:16:11.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.957+0000 7fb9f4bb0b80 1 Processor -- start 2023-07-14T13:16:11.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.957+0000 7fb9f4bb0b80 1 -- start start 2023-07-14T13:16:11.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.957+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 0x55621680a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.957+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803e80 0x55621680a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.957+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55621680ddb0 0x556216807d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:11.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.957+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556216804250 con 0x556216803570 2023-07-14T13:16:11.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.957+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556216808ff0 con 0x55621680ddb0 2023-07-14T13:16:11.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.957+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556216804770 con 0x556216803e80 2023-07-14T13:16:11.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.957+0000 7fb9dad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 0x55621680a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.957+0000 7fb9dad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 0x55621680a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50742/0 (socket says 172.21.15.17:50742) 2023-07-14T13:16:11.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.958+0000 7fb9dad9d700 1 -- 172.21.15.17:0/1053078086 learned_addr learned my addr 172.21.15.17:0/1053078086 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:11.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.958+0000 7fb9da59c700 1 --2- 172.21.15.17:0/1053078086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803e80 0x55621680a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:11.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.958+0000 7fb9db59e700 1 --2- 172.21.15.17:0/1053078086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55621680ddb0 0x556216807d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.958+0000 7fb9dad9d700 1 -- 172.21.15.17:0/1053078086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803e80 msgr2=0x55621680a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.958+0000 7fb9dad9d700 1 --2- 172.21.15.17:0/1053078086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803e80 0x55621680a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.958+0000 7fb9dad9d700 1 -- 172.21.15.17:0/1053078086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55621680ddb0 msgr2=0x556216807d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.958+0000 7fb9dad9d700 1 --2- 172.21.15.17:0/1053078086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55621680ddb0 0x556216807d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.958+0000 7fb9dad9d700 1 -- 172.21.15.17:0/1053078086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55621656bce0 con 0x556216803570 2023-07-14T13:16:12.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.958+0000 7fb9dad9d700 1 --2- 172.21.15.17:0/1053078086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 0x55621680a250 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0099c0 tx=0x7fb9cc005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db1b65085ac5211 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:12.000 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.958+0000 7fb9c1ffb700 1 -- 172.21.15.17:0/1053078086 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc028070 con 0x556216803570 2023-07-14T13:16:12.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.959+0000 7fb9c1ffb700 1 -- 172.21.15.17:0/1053078086 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9cc029040 con 0x556216803570 2023-07-14T13:16:12.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.959+0000 7fb9c1ffb700 1 -- 172.21.15.17:0/1053078086 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc003780 con 0x556216803570 2023-07-14T13:16:12.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.959+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1053078086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 msgr2=0x55621680a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.959+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1053078086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 0x55621680a250 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0099c0 tx=0x7fb9cc005000 comp rx=0 tx=0).stop 2023-07-14T13:16:12.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.960+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1053078086 shutdown_connections 2023-07-14T13:16:12.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.960+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1053078086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55621680ddb0 0x556216807d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.960+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1053078086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556216803570 0x55621680a250 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.960+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1053078086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803e80 0x55621680a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.960+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1053078086 >> 172.21.15.17:0/1053078086 conn(0x5562167f9070 msgr2=0x556216805db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:12.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.960+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1053078086 shutdown_connections 2023-07-14T13:16:12.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.960+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1053078086 wait complete. 2023-07-14T13:16:12.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.960+0000 7fb9f4bb0b80 1 -- start start 2023-07-14T13:16:12.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.960+0000 7fb9f4bb0b80 1 Processor -- start 2023-07-14T13:16:12.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803570 0x556216813800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803e80 0x556216813d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9f4bb0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55621680ddb0 0x55621686b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55621686b7c0 con 0x55621680ddb0 2023-07-14T13:16:12.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55621686b930 con 0x556216803570 2023-07-14T13:16:12.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9f4bb0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55621686baf0 con 0x556216803e80 2023-07-14T13:16:12.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9f4bb0b80 10 client.0 _ll_register_callbacks cb 0x7fb9d40091c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:12.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9db59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55621680ddb0 0x55621686b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9db59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55621680ddb0 0x55621686b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50754/0 (socket says 172.21.15.17:50754) 2023-07-14T13:16:12.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9db59e700 1 -- 172.21.15.17:0/1434757474 learned_addr learned my addr 172.21.15.17:0/1434757474 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:12.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9dad9d700 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803570 0x556216813800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.961+0000 7fb9da59c700 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803e80 0x556216813d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.962+0000 7fb9db59e700 1 -- 172.21.15.17:0/1434757474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803e80 msgr2=0x556216813d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.962+0000 7fb9db59e700 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803e80 0x556216813d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.962+0000 7fb9db59e700 1 -- 172.21.15.17:0/1434757474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803570 msgr2=0x556216813800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.962+0000 7fb9db59e700 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803570 0x556216813800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.962+0000 7fb9db59e700 1 -- 172.21.15.17:0/1434757474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc10f2b0 con 0x55621680ddb0 2023-07-14T13:16:12.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.962+0000 7fb9db59e700 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55621680ddb0 0x55621686b280 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40094c0 tx=0x7fb9d4008cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f05364d22628f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:12.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.962+0000 7fb9beff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:12.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.962+0000 7fb9beff5700 1 -- 172.21.15.17:0/1434757474 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400e040 con 0x55621680ddb0 2023-07-14T13:16:12.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.962+0000 7fb9beff5700 1 -- 172.21.15.17:0/1434757474 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb9d4004660 con 0x55621680ddb0 2023-07-14T13:16:12.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.962+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1434757474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9d009dee0 con 0x55621680ddb0 2023-07-14T13:16:12.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.963+0000 7fb9beff5700 1 -- 172.21.15.17:0/1434757474 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9d4004820 con 0x55621680ddb0 2023-07-14T13:16:12.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.963+0000 7fb9f4bb0b80 10 client.18285 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:12.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.963+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1434757474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x5562165a92d0 con 0x55621680ddb0 2023-07-14T13:16:12.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.963+0000 7fb9beff5700 1 -- 172.21.15.17:0/1434757474 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9d009dee0 con 0x55621680ddb0 2023-07-14T13:16:12.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.963+0000 7fb9beff5700 1 -- 172.21.15.17:0/1434757474 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fb9d401b450 con 0x55621680ddb0 2023-07-14T13:16:12.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.963+0000 7fb9f4bb0b80 10 client.18285 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:12.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.963+0000 7fb9f4bb0b80 10 client.18285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:12.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.963+0000 7fb9f4bb0b80 20 client.18285 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:12.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.963+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5562168733b0 0x5562168757c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.963+0000 7fb9f4bb0b80 4 client.18285 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:16:12.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.963+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1434757474 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5562167100d0 con 0x5562168733b0 2023-07-14T13:16:12.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.964+0000 7fb9dad9d700 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5562168733b0 0x5562168757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.964+0000 7fb9dad9d700 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5562168733b0 0x5562168757c0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1ed6e116df88fda server_cookie=1434a198c5e8579b in_seq=0 out_seq=0 2023-07-14T13:16:12.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.964+0000 7fb9beff5700 10 client.18285 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:12.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.965+0000 7fb9beff5700 1 -- 172.21.15.17:0/1434757474 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5562167100d0 con 0x5562168733b0 2023-07-14T13:16:12.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.965+0000 7fb9beff5700 10 client.18285 handle_command_reply: tid=0 2023-07-14T13:16:12.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.965+0000 7fb9f4bb0b80 1 client.18285 shutdown 2023-07-14T13:16:12.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.965+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1434757474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55621680ddb0 msgr2=0x55621686b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.965+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55621680ddb0 0x55621686b280 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40094c0 tx=0x7fb9d4008cc0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.966+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1434757474 shutdown_connections 2023-07-14T13:16:12.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.966+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5562168733b0 0x5562168757c0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.966+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55621680ddb0 0x55621686b280 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.966+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556216803570 0x556216813800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.966+0000 7fb9f4bb0b80 1 --2- 172.21.15.17:0/1434757474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556216803e80 0x556216813d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.966+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1434757474 >> 172.21.15.17:0/1434757474 conn(0x5562167f9070 msgr2=0x5562168024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:12.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.966+0000 7fb9beff5700 0 client.18285 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:12.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.966+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1434757474 shutdown_connections 2023-07-14T13:16:12.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.966+0000 7fb9f4bb0b80 1 -- 172.21.15.17:0/1434757474 wait complete. 2023-07-14T13:16:12.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.966+0000 7fb9f4bb0b80 20 client.18285 trim_cache size 0 max 16384 2023-07-14T13:16:12.012 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:16:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:16:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "408d7386-6d54-4324-8f2c-64d08c054885", 2023-07-14T13:16:12.013 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:16:12.013 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:16:12.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 -- 172.21.15.17:0/4163508825 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9c40a13e0 msgr2=0x7fb9c40a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9c40a13e0 0x7fb9c40a3890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00b580 tx=0x7fb9cc005be0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 -- 172.21.15.17:0/4163508825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9dc102800 msgr2=0x7fb9dc19de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9dc102800 0x7fb9dc19de60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000e940 tx=0x7fb9d000ec50 comp rx=0 tx=0).stop 2023-07-14T13:16:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 -- 172.21.15.17:0/4163508825 shutdown_connections 2023-07-14T13:16:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9c40a13e0 0x7fb9c40a3890 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc106ea0 0x7fb9dc197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9dc101e60 0x7fb9dc19d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 --2- 172.21.15.17:0/4163508825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9dc102800 0x7fb9dc19de60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 -- 172.21.15.17:0/4163508825 >> 172.21.15.17:0/4163508825 conn(0x7fb9dc0fd690 msgr2=0x7fb9dc0fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 -- 172.21.15.17:0/4163508825 shutdown_connections 2023-07-14T13:16:12.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:11.967+0000 7fb9e09fe700 1 -- 172.21.15.17:0/4163508825 wait complete. 2023-07-14T13:16:12.030 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:16:12.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.256+0000 7f79d6dff700 1 -- 172.21.15.17:0/1423667514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d0101f70 msgr2=0x7f79d0102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.256+0000 7f79d6dff700 1 --2- 172.21.15.17:0/1423667514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d0101f70 0x7f79d0102340 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f79c400b0d0 tx=0x7f79c400b3e0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.257+0000 7f79d6dff700 1 -- 172.21.15.17:0/1423667514 shutdown_connections 2023-07-14T13:16:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.257+0000 7f79d6dff700 1 --2- 172.21.15.17:0/1423667514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d0106fb0 0x7f79d010eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.257+0000 7f79d6dff700 1 --2- 172.21.15.17:0/1423667514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d0101f70 0x7f79d0102340 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.257+0000 7f79d6dff700 1 --2- 172.21.15.17:0/1423667514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d0102910 0x7f79d01068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.257+0000 7f79d6dff700 1 -- 172.21.15.17:0/1423667514 >> 172.21.15.17:0/1423667514 conn(0x7f79d00fd7e0 msgr2=0x7f79d00ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.257+0000 7f79d6dff700 1 -- 172.21.15.17:0/1423667514 shutdown_connections 2023-07-14T13:16:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.257+0000 7f79d6dff700 1 -- 172.21.15.17:0/1423667514 wait complete. 2023-07-14T13:16:12.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.258+0000 7f79d6dff700 1 Processor -- start 2023-07-14T13:16:12.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.258+0000 7f79d6dff700 1 -- start start 2023-07-14T13:16:12.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79d6dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d0101f70 0x7f79d0197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79d6dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d0102910 0x7f79d0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79d6dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d0106fb0 0x7f79d019c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79d6dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d019cef0 con 0x7f79d0106fb0 2023-07-14T13:16:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79d6dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d019d060 con 0x7f79d0102910 2023-07-14T13:16:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79d6dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d019d220 con 0x7f79d0101f70 2023-07-14T13:16:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79d4b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d0101f70 0x7f79d0197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79d539c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d0106fb0 0x7f79d019c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79d4b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d0101f70 0x7f79d0197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45848/0 (socket says 172.21.15.17:45848) 2023-07-14T13:16:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79d4b9b700 1 -- 172.21.15.17:0/698651002 learned_addr learned my addr 172.21.15.17:0/698651002 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:12.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79d539c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d0106fb0 0x7f79d019c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50778/0 (socket says 172.21.15.17:50778) 2023-07-14T13:16:12.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.259+0000 7f79cffff700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d0102910 0x7f79d0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.260+0000 7f79d539c700 1 -- 172.21.15.17:0/698651002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d0101f70 msgr2=0x7f79d0197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.260+0000 7f79d539c700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d0101f70 0x7f79d0197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.260+0000 7f79d539c700 1 -- 172.21.15.17:0/698651002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d0102910 msgr2=0x7f79d0198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.260+0000 7f79d539c700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d0102910 0x7f79d0198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.260+0000 7f79d539c700 1 -- 172.21.15.17:0/698651002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4009d00 con 0x7f79d0106fb0 2023-07-14T13:16:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.260+0000 7f79d539c700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d0106fb0 0x7f79d019c8b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f79c800d750 tx=0x7f79c800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.260+0000 7f79cdffb700 1 -- 172.21.15.17:0/698651002 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8004020 con 0x7f79d0106fb0 2023-07-14T13:16:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.260+0000 7f79d6dff700 1 -- 172.21.15.17:0/698651002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d019d500 con 0x7f79d0106fb0 2023-07-14T13:16:12.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.260+0000 7f79cdffb700 1 -- 172.21.15.17:0/698651002 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79c8004830 con 0x7f79d0106fb0 2023-07-14T13:16:12.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.260+0000 7f79cdffb700 1 -- 172.21.15.17:0/698651002 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c80054e0 con 0x7f79d0106fb0 2023-07-14T13:16:12.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.260+0000 7f79d6dff700 1 -- 172.21.15.17:0/698651002 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d01a4d40 con 0x7f79d0106fb0 2023-07-14T13:16:12.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.264+0000 7f79cdffb700 1 -- 172.21.15.17:0/698651002 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f79c80049a0 con 0x7f79d0106fb0 2023-07-14T13:16:12.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.266+0000 7f79cdffb700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79c00a12c0 0x7f79c00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.266+0000 7f79ea621b80 1 Processor -- start 2023-07-14T13:16:12.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.266+0000 7f79cdffb700 1 -- 172.21.15.17:0/698651002 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f79c80cc4e0 con 0x7f79d0106fb0 2023-07-14T13:16:12.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.266+0000 7f79ea621b80 1 -- start start 2023-07-14T13:16:12.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.266+0000 7f79d4b9b700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79c00a12c0 0x7f79c00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.266+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 0x557f74d026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.266+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d02be0 0x557f74d0d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.266+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d0dad0 0x557f74d0feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.266+0000 7f79ea621b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74c08cb0 con 0x557f74d0dad0 2023-07-14T13:16:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.266+0000 7f79ea621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74c5ba40 con 0x557f74d022d0 2023-07-14T13:16:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.266+0000 7f79ea621b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74c54ed0 con 0x557f74d02be0 2023-07-14T13:16:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.267+0000 7f79d539c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d0dad0 0x557f74d0feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.267+0000 7f79d539c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d0dad0 0x557f74d0feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50780/0 (socket says 172.21.15.17:50780) 2023-07-14T13:16:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.267+0000 7f79d539c700 1 -- 172.21.15.17:0/844275549 learned_addr learned my addr 172.21.15.17:0/844275549 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.267+0000 7f79cffff700 1 --2- 172.21.15.17:0/844275549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d02be0 0x557f74d0d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.267+0000 7f79d4b9b700 1 --2- 172.21.15.17:0/844275549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 0x557f74d026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.267+0000 7f79d539c700 1 -- 172.21.15.17:0/844275549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d02be0 msgr2=0x557f74d0d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.267+0000 7f79d539c700 1 --2- 172.21.15.17:0/844275549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d02be0 0x557f74d0d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.267+0000 7f79d539c700 1 -- 172.21.15.17:0/844275549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 msgr2=0x557f74d026a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.267+0000 7f79d539c700 1 --2- 172.21.15.17:0/844275549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 0x557f74d026a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.267+0000 7f79d4b9b700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79c00a12c0 0x7f79c00a3770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009fd0 tx=0x7f79c400b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.267+0000 7f79d539c700 1 -- 172.21.15.17:0/844275549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f74a82de0 con 0x557f74d0dad0 2023-07-14T13:16:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.268+0000 7f79d539c700 1 --2- 172.21.15.17:0/844275549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d0dad0 0x557f74d0feb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f79c8096040 tx=0x7f79c8098f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb370c61494ed6b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.268+0000 7f79baffd700 1 -- 172.21.15.17:0/844275549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c809d600 con 0x557f74d0dad0 2023-07-14T13:16:12.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.268+0000 7f79baffd700 1 -- 172.21.15.17:0/844275549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79c80a1a20 con 0x557f74d0dad0 2023-07-14T13:16:12.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.268+0000 7f79baffd700 1 -- 172.21.15.17:0/844275549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c801c170 con 0x557f74d0dad0 2023-07-14T13:16:12.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.269+0000 7f79ea621b80 1 -- 172.21.15.17:0/844275549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d0dad0 msgr2=0x557f74d0feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.269+0000 7f79ea621b80 1 --2- 172.21.15.17:0/844275549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d0dad0 0x557f74d0feb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f79c8096040 tx=0x7f79c8098f30 comp rx=0 tx=0).stop 2023-07-14T13:16:12.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.269+0000 7f79ea621b80 1 -- 172.21.15.17:0/844275549 shutdown_connections 2023-07-14T13:16:12.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.269+0000 7f79ea621b80 1 --2- 172.21.15.17:0/844275549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d0dad0 0x557f74d0feb0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.269+0000 7f79ea621b80 1 --2- 172.21.15.17:0/844275549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 0x557f74d026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.269+0000 7f79ea621b80 1 --2- 172.21.15.17:0/844275549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d02be0 0x557f74d0d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.269+0000 7f79ea621b80 1 -- 172.21.15.17:0/844275549 >> 172.21.15.17:0/844275549 conn(0x557f74cf8da0 msgr2=0x557f74cfe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:12.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.269+0000 7f79ea621b80 1 -- 172.21.15.17:0/844275549 shutdown_connections 2023-07-14T13:16:12.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.269+0000 7f79ea621b80 1 -- 172.21.15.17:0/844275549 wait complete. 2023-07-14T13:16:12.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.269+0000 7f79ea621b80 1 -- start start 2023-07-14T13:16:12.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.270+0000 7f79ea621b80 1 Processor -- start 2023-07-14T13:16:12.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.270+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d022d0 0x557f74d0d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.270+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d02be0 0x557f74d0a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.270+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d0dad0 0x557f74d0aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.270+0000 7f79ea621b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74bf4ac0 con 0x557f74d02be0 2023-07-14T13:16:12.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.270+0000 7f79ea621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74bf47c0 con 0x557f74d0dad0 2023-07-14T13:16:12.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.270+0000 7f79ea621b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74ad8920 con 0x557f74d022d0 2023-07-14T13:16:12.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.270+0000 7f79ea621b80 10 client.0 _ll_register_callbacks cb 0x557f74bf2760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:12.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.271+0000 7f79d4b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d022d0 0x557f74d0d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.271+0000 7f79cffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d02be0 0x557f74d0a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.271+0000 7f79d4b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d022d0 0x557f74d0d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45856/0 (socket says 172.21.15.17:45856) 2023-07-14T13:16:12.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.271+0000 7f79d4b9b700 1 -- 172.21.15.17:0/1433403123 learned_addr learned my addr 172.21.15.17:0/1433403123 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:12.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.271+0000 7f79d539c700 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d0dad0 0x557f74d0aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.271+0000 7f79d4b9b700 1 -- 172.21.15.17:0/1433403123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d0dad0 msgr2=0x557f74d0aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.271+0000 7f79d4b9b700 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d0dad0 0x557f74d0aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.271+0000 7f79d4b9b700 1 -- 172.21.15.17:0/1433403123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d02be0 msgr2=0x557f74d0a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.271+0000 7f79d4b9b700 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d02be0 0x557f74d0a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.271+0000 7f79d4b9b700 1 -- 172.21.15.17:0/1433403123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d01a4d40 con 0x557f74d022d0 2023-07-14T13:16:12.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.272+0000 7f79d4b9b700 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d022d0 0x557f74d0d510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f79c400cd30 tx=0x7f79c40099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=154560ff26b0de2e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.272+0000 7f79affff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:16:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.272+0000 7f79affff700 1 -- 172.21.15.17:0/1433403123 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c400e040 con 0x557f74d022d0 2023-07-14T13:16:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.272+0000 7f79ea621b80 1 -- 172.21.15.17:0/1433403123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f74bae4f0 con 0x557f74d022d0 2023-07-14T13:16:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.272+0000 7f79affff700 1 -- 172.21.15.17:0/1433403123 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f79c4023040 con 0x557f74d022d0 2023-07-14T13:16:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.272+0000 7f79affff700 1 -- 172.21.15.17:0/1433403123 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79c4003e10 con 0x557f74d022d0 2023-07-14T13:16:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.272+0000 7f79ea621b80 10 client.27976 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:12.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.272+0000 7f79ea621b80 1 -- 172.21.15.17:0/1433403123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x557f74a6bc60 con 0x557f74d022d0 2023-07-14T13:16:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.273+0000 7f79affff700 1 -- 172.21.15.17:0/1433403123 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557f74bae4f0 con 0x557f74d022d0 2023-07-14T13:16:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.273+0000 7f79affff700 1 -- 172.21.15.17:0/1433403123 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f79c4029930 con 0x557f74d022d0 2023-07-14T13:16:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.273+0000 7f79ea621b80 10 client.27976 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.273+0000 7f79ea621b80 10 client.27976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.273+0000 7f79ea621b80 20 client.27976 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.273+0000 7f79ea621b80 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557f74d1d4d0 0x557f74d1f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.273+0000 7f79ea621b80 4 client.27976 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.273+0000 7f79ea621b80 1 -- 172.21.15.17:0/1433403123 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f74c4deb0 con 0x557f74d1d4d0 2023-07-14T13:16:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.273+0000 7f79cffff700 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557f74d1d4d0 0x557f74d1f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.274+0000 7f79cffff700 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557f74d1d4d0 0x557f74d1f8e0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=613d794b10d81cab server_cookie=a12f14d3af46f229 in_seq=0 out_seq=0 2023-07-14T13:16:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.274+0000 7f79affff700 10 client.27976 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79affff700 1 -- 172.21.15.17:0/1433403123 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557f74c4deb0 con 0x557f74d1d4d0 2023-07-14T13:16:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79affff700 10 client.27976 handle_command_reply: tid=0 2023-07-14T13:16:12.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79ea621b80 1 client.27976 shutdown 2023-07-14T13:16:12.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79ea621b80 1 -- 172.21.15.17:0/1433403123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d022d0 msgr2=0x557f74d0d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79ea621b80 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d022d0 0x557f74d0d510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f79c400cd30 tx=0x7f79c40099e0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79ea621b80 1 -- 172.21.15.17:0/1433403123 shutdown_connections 2023-07-14T13:16:12.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79ea621b80 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557f74d1d4d0 0x557f74d1f8e0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79ea621b80 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d0dad0 0x557f74d0aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79ea621b80 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d022d0 0x557f74d0d510 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79affff700 0 client.27976 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:12.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79ea621b80 1 --2- 172.21.15.17:0/1433403123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d02be0 0x557f74d0a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79ea621b80 1 -- 172.21.15.17:0/1433403123 >> 172.21.15.17:0/1433403123 conn(0x557f74cf8da0 msgr2=0x557f74cfe230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:12.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79ea621b80 1 -- 172.21.15.17:0/1433403123 shutdown_connections 2023-07-14T13:16:12.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.275+0000 7f79ea621b80 1 -- 172.21.15.17:0/1433403123 wait complete. 2023-07-14T13:16:12.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.276+0000 7f79ea621b80 20 client.27976 trim_cache size 0 max 16384 2023-07-14T13:16:12.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.295+0000 7f79ea621b80 1 Processor -- start 2023-07-14T13:16:12.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.295+0000 7f79ea621b80 1 -- start start 2023-07-14T13:16:12.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.295+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d022d0 0x557f74d0d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.295+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d02be0 0x557f74d09f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.295+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 0x557f74d0a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.295+0000 7f79ea621b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74d03160 con 0x557f74d022d0 2023-07-14T13:16:12.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.295+0000 7f79ea621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74d03dd0 con 0x557f74d02be0 2023-07-14T13:16:12.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.295+0000 7f79ea621b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74d0b860 con 0x557f74d0dad0 2023-07-14T13:16:12.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79d4b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d022d0 0x557f74d0d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79d4b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d022d0 0x557f74d0d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50798/0 (socket says 172.21.15.17:50798) 2023-07-14T13:16:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79d4b9b700 1 -- 172.21.15.17:0/120581018 learned_addr learned my addr 172.21.15.17:0/120581018 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79cffff700 1 --2- 172.21.15.17:0/120581018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d02be0 0x557f74d09f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79d539c700 1 --2- 172.21.15.17:0/120581018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 0x557f74d0a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79cffff700 1 -- 172.21.15.17:0/120581018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 msgr2=0x557f74d0a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79cffff700 1 --2- 172.21.15.17:0/120581018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 0x557f74d0a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79cffff700 1 -- 172.21.15.17:0/120581018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d022d0 msgr2=0x557f74d0d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79cffff700 1 --2- 172.21.15.17:0/120581018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d022d0 0x557f74d0d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79cffff700 1 -- 172.21.15.17:0/120581018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f74aa9250 con 0x557f74d02be0 2023-07-14T13:16:12.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79d4b9b700 1 --2- 172.21.15.17:0/120581018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d022d0 0x557f74d0d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:12.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79d539c700 1 --2- 172.21.15.17:0/120581018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 0x557f74d0a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:12.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.296+0000 7f79cffff700 1 --2- 172.21.15.17:0/120581018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d02be0 0x557f74d09f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x557f74d201f0 tx=0x7f79bc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=786e6b27d0c23557 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:12.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.297+0000 7f79bb7fe700 1 -- 172.21.15.17:0/120581018 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc017070 con 0x557f74d02be0 2023-07-14T13:16:12.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.297+0000 7f79bb7fe700 1 -- 172.21.15.17:0/120581018 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79bc018040 con 0x557f74d02be0 2023-07-14T13:16:12.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.297+0000 7f79bb7fe700 1 -- 172.21.15.17:0/120581018 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc004c90 con 0x557f74d02be0 2023-07-14T13:16:12.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.297+0000 7f79ea621b80 1 -- 172.21.15.17:0/120581018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d02be0 msgr2=0x557f74d09f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.297+0000 7f79ea621b80 1 --2- 172.21.15.17:0/120581018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d02be0 0x557f74d09f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x557f74d201f0 tx=0x7f79bc009260 comp rx=0 tx=0).stop 2023-07-14T13:16:12.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.297+0000 7f79ea621b80 1 -- 172.21.15.17:0/120581018 shutdown_connections 2023-07-14T13:16:12.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.297+0000 7f79ea621b80 1 --2- 172.21.15.17:0/120581018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 0x557f74d0a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.297+0000 7f79ea621b80 1 --2- 172.21.15.17:0/120581018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d022d0 0x557f74d0d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.297+0000 7f79ea621b80 1 --2- 172.21.15.17:0/120581018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d02be0 0x557f74d09f50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.297+0000 7f79ea621b80 1 -- 172.21.15.17:0/120581018 >> 172.21.15.17:0/120581018 conn(0x557f74cf8da0 msgr2=0x557f74d05a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:12.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.298+0000 7f79ea621b80 1 -- 172.21.15.17:0/120581018 shutdown_connections 2023-07-14T13:16:12.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.298+0000 7f79ea621b80 1 -- 172.21.15.17:0/120581018 wait complete. 2023-07-14T13:16:12.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.298+0000 7f79ea621b80 1 -- start start 2023-07-14T13:16:12.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.298+0000 7f79ea621b80 1 Processor -- start 2023-07-14T13:16:12.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 0x557f74d12c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d02be0 0x557f74d13190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79ea621b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 0x557f74d136d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79ea621b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74d713e0 con 0x557f74d02be0 2023-07-14T13:16:12.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79ea621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74d71520 con 0x557f74d022d0 2023-07-14T13:16:12.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79ea621b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f74d716e0 con 0x557f74d0dad0 2023-07-14T13:16:12.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79ea621b80 10 client.0 _ll_register_callbacks cb 0x7f79c40077f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:12.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79cffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d02be0 0x557f74d13190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79d4b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 0x557f74d12c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79d4b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 0x557f74d12c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60760/0 (socket says 172.21.15.17:60760) 2023-07-14T13:16:12.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79d4b9b700 1 -- 172.21.15.17:0/2530741825 learned_addr learned my addr 172.21.15.17:0/2530741825 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:12.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.299+0000 7f79d539c700 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 0x557f74d136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79d539c700 1 -- 172.21.15.17:0/2530741825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 msgr2=0x557f74d12c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79d539c700 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 0x557f74d12c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79d539c700 1 -- 172.21.15.17:0/2530741825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d02be0 msgr2=0x557f74d13190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:12.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79d539c700 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d02be0 0x557f74d13190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79d539c700 1 -- 172.21.15.17:0/2530741825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f74a6bc60 con 0x557f74d0dad0 2023-07-14T13:16:12.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79cffff700 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d02be0 0x557f74d13190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:12.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79d4b9b700 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 0x557f74d12c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:12.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79d539c700 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 0x557f74d136d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f79c8096040 tx=0x7f79c8095a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a1e9c19d6bada5f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:12.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79affff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:16:12.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79affff700 1 -- 172.21.15.17:0/2530741825 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8005640 con 0x557f74d0dad0 2023-07-14T13:16:12.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79affff700 1 -- 172.21.15.17:0/2530741825 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f79c8004ca0 con 0x557f74d0dad0 2023-07-14T13:16:12.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.300+0000 7f79ea621b80 1 -- 172.21.15.17:0/2530741825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79c80a1a20 con 0x557f74d0dad0 2023-07-14T13:16:12.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.301+0000 7f79affff700 1 -- 172.21.15.17:0/2530741825 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79c801c170 con 0x557f74d0dad0 2023-07-14T13:16:12.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.301+0000 7f79ea621b80 10 client.27982 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:12.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.301+0000 7f79ea621b80 1 -- 172.21.15.17:0/2530741825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x557f74a82de0 con 0x557f74d0dad0 2023-07-14T13:16:12.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.301+0000 7f79affff700 1 -- 172.21.15.17:0/2530741825 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79c80a1a20 con 0x557f74d0dad0 2023-07-14T13:16:12.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.301+0000 7f79affff700 1 -- 172.21.15.17:0/2530741825 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f79c801f300 con 0x557f74d0dad0 2023-07-14T13:16:12.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.301+0000 7f79ea621b80 10 client.27982 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:12.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.301+0000 7f79ea621b80 10 client.27982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:12.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.301+0000 7f79ea621b80 20 client.27982 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:12.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.301+0000 7f79ea621b80 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557f74d72b10 0x557f74d74f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:12.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.301+0000 7f79ea621b80 4 client.27982 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:16:12.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.301+0000 7f79ea621b80 1 -- 172.21.15.17:0/2530741825 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557f74c10050 con 0x557f74d72b10 2023-07-14T13:16:12.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.302+0000 7f79d4b9b700 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557f74d72b10 0x557f74d74f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:12.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.302+0000 7f79affff700 10 client.27982 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:12.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.302+0000 7f79d4b9b700 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557f74d72b10 0x557f74d74f20 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e0713a6ad5090 server_cookie=b2c08f4134fa7055 in_seq=0 out_seq=0 2023-07-14T13:16:12.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79affff700 1 -- 172.21.15.17:0/2530741825 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557f74c10050 con 0x557f74d72b10 2023-07-14T13:16:12.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79affff700 10 client.27982 handle_command_reply: tid=0 2023-07-14T13:16:12.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 1 client.27982 shutdown 2023-07-14T13:16:12.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 1 -- 172.21.15.17:0/2530741825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 msgr2=0x557f74d136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 0x557f74d136d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f79c8096040 tx=0x7f79c8095a40 comp rx=0 tx=0).stop 2023-07-14T13:16:12.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 1 -- 172.21.15.17:0/2530741825 shutdown_connections 2023-07-14T13:16:12.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557f74d72b10 0x557f74d74f20 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f74d0dad0 0x557f74d136d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557f74d022d0 0x557f74d12c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79affff700 0 client.27982 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:12.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 1 --2- 172.21.15.17:0/2530741825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557f74d02be0 0x557f74d13190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 1 -- 172.21.15.17:0/2530741825 >> 172.21.15.17:0/2530741825 conn(0x557f74cf8da0 msgr2=0x557f74d043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:12.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 1 -- 172.21.15.17:0/2530741825 shutdown_connections 2023-07-14T13:16:12.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 1 -- 172.21.15.17:0/2530741825 wait complete. 2023-07-14T13:16:12.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.303+0000 7f79ea621b80 20 client.27982 trim_cache size 0 max 16384 2023-07-14T13:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:16:12.354 INFO:teuthology.orchestra.run.smithi017.stdout: "408d7386-6d54-4324-8f2c-64d08c054885": { 2023-07-14T13:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "408d7386-6d54-4324-8f2c-64d08c054885", 2023-07-14T13:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:16:12.355 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:16:12.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 -- 172.21.15.17:0/698651002 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79c00a12c0 msgr2=0x7f79c00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79c00a12c0 0x7f79c00a3770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009fd0 tx=0x7f79c400b040 comp rx=0 tx=0).stop 2023-07-14T13:16:12.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 -- 172.21.15.17:0/698651002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d0106fb0 msgr2=0x7f79d019c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:12.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d0106fb0 0x7f79d019c8b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f79c800d750 tx=0x7f79c800da60 comp rx=0 tx=0).stop 2023-07-14T13:16:12.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 -- 172.21.15.17:0/698651002 shutdown_connections 2023-07-14T13:16:12.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79c00a12c0 0x7f79c00a3770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d0106fb0 0x7f79d019c8b0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79d0101f70 0x7f79d0197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 --2- 172.21.15.17:0/698651002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79d0102910 0x7f79d0198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:12.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 -- 172.21.15.17:0/698651002 >> 172.21.15.17:0/698651002 conn(0x7f79d00fd7e0 msgr2=0x7f79d00fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 -- 172.21.15.17:0/698651002 shutdown_connections 2023-07-14T13:16:12.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:12.304+0000 7f79d6dff700 1 -- 172.21.15.17:0/698651002 wait complete. 2023-07-14T13:16:12.362 INFO:tasks.cephfs.filesystem:scrub status for tag:408d7386-6d54-4324-8f2c-64d08c054885 - {'path': '/', 'tag': '408d7386-6d54-4324-8f2c-64d08c054885', 'options': 'recursive,force'} 2023-07-14T13:16:13.103 INFO:teuthology.orchestra.run.smithi017.stderr:set primary keys... 2023-07-14T13:16:13.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:13 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:16:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:13 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:13 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:16:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:13 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:16:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:13 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:16:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:13 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:13 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:13 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:13 smithi017 ceph-mon[95536]: pgmap v519: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 35 MiB/s wr, 49 op/s 2023-07-14T13:16:13.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:13 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:16:13.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:13 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:13 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:16:13.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:13 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:16:13.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:13 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:16:13.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:13 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:13 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:13 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:13 smithi135 ceph-mon[97338]: pgmap v519: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 35 MiB/s wr, 49 op/s 2023-07-14T13:16:13.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:13 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:16:13.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:13 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:13 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:16:13.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:13 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:16:13.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:13 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:16:13.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:13 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:13 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:13 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:13.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:13 smithi131 ceph-mon[96953]: pgmap v519: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 35 MiB/s wr, 49 op/s 2023-07-14T13:16:15.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:15 smithi017 ceph-mon[95536]: pgmap v520: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 28 MiB/s wr, 40 op/s 2023-07-14T13:16:15.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:15 smithi135 ceph-mon[97338]: pgmap v520: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 28 MiB/s wr, 40 op/s 2023-07-14T13:16:15.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:15 smithi131 ceph-mon[96953]: pgmap v520: 97 pgs: 97 active+clean; 14 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 28 MiB/s wr, 40 op/s 2023-07-14T13:16:17.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:17 smithi017 ceph-mon[95536]: pgmap v521: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 25 MiB/s wr, 136 op/s 2023-07-14T13:16:17.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:17 smithi135 ceph-mon[97338]: pgmap v521: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 25 MiB/s wr, 136 op/s 2023-07-14T13:16:17.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:17 smithi131 ceph-mon[96953]: pgmap v521: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 25 MiB/s wr, 136 op/s 2023-07-14T13:16:19.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:19 smithi017 ceph-mon[95536]: pgmap v522: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 25 MiB/s wr, 136 op/s 2023-07-14T13:16:19.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:19 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:16:19.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:19 smithi135 ceph-mon[97338]: pgmap v522: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 25 MiB/s wr, 136 op/s 2023-07-14T13:16:19.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:19 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:16:19.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:19 smithi131 ceph-mon[96953]: pgmap v522: 97 pgs: 97 active+clean; 14 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 25 MiB/s wr, 136 op/s 2023-07-14T13:16:19.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:19 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:16:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.086+0000 7f6fd0fff700 1 -- 172.21.15.17:0/1389544761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fcc104e50 msgr2=0x7f6fcc10ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.086+0000 7f6fd0fff700 1 --2- 172.21.15.17:0/1389544761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fcc104e50 0x7f6fcc10ca00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400b0d0 tx=0x7f6fc400b3e0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.086+0000 7f6fd0fff700 1 -- 172.21.15.17:0/1389544761 shutdown_connections 2023-07-14T13:16:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.086+0000 7f6fd0fff700 1 --2- 172.21.15.17:0/1389544761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fcc104e50 0x7f6fcc10ca00 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.086+0000 7f6fd0fff700 1 --2- 172.21.15.17:0/1389544761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fcc067c10 0x7f6fcc067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.086+0000 7f6fd0fff700 1 --2- 172.21.15.17:0/1389544761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fcc0685b0 0x7f6fcc104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.086+0000 7f6fd0fff700 1 -- 172.21.15.17:0/1389544761 >> 172.21.15.17:0/1389544761 conn(0x7f6fcc074760 msgr2=0x7f6fcc074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.086+0000 7f6fd0fff700 1 -- 172.21.15.17:0/1389544761 shutdown_connections 2023-07-14T13:16:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.086+0000 7f6fd0fff700 1 -- 172.21.15.17:0/1389544761 wait complete. 2023-07-14T13:16:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.087+0000 7f6fd0fff700 1 Processor -- start 2023-07-14T13:16:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.087+0000 7f6fd0fff700 1 -- start start 2023-07-14T13:16:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.088+0000 7f6fd0fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fcc067c10 0x7f6fcc197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.088+0000 7f6fd0fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fcc0685b0 0x7f6fcc198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.088+0000 7f6fd0fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fcc104e50 0x7f6fcc19ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.088+0000 7f6fd0fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc19d040 con 0x7f6fcc0685b0 2023-07-14T13:16:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.088+0000 7f6fd0fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc19d1b0 con 0x7f6fcc104e50 2023-07-14T13:16:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.088+0000 7f6fd0fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc19d370 con 0x7f6fcc067c10 2023-07-14T13:16:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.088+0000 7f6fc9d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fcc0685b0 0x7f6fcc198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.088+0000 7f6fc9d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fcc0685b0 0x7f6fcc198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40104/0 (socket says 172.21.15.17:40104) 2023-07-14T13:16:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.088+0000 7f6fc9d9b700 1 -- 172.21.15.17:0/2805029209 learned_addr learned my addr 172.21.15.17:0/2805029209 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.088+0000 7f6fcad9d700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fcc104e50 0x7f6fcc19ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.088+0000 7f6fca59c700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fcc067c10 0x7f6fcc197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fc9d9b700 1 -- 172.21.15.17:0/2805029209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fcc067c10 msgr2=0x7f6fcc197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fc9d9b700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fcc067c10 0x7f6fcc197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fc9d9b700 1 -- 172.21.15.17:0/2805029209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fcc104e50 msgr2=0x7f6fcc19ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fc9d9b700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fcc104e50 0x7f6fcc19ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fc9d9b700 1 -- 172.21.15.17:0/2805029209 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0009520 con 0x7f6fcc0685b0 2023-07-14T13:16:20.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fcad9d700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fcc104e50 0x7f6fcc19ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fc9d9b700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fcc0685b0 0x7f6fcc198390 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009fd0 tx=0x7f6fc000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fbb7fe700 1 -- 172.21.15.17:0/2805029209 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000cbd0 con 0x7f6fcc0685b0 2023-07-14T13:16:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fd0fff700 1 -- 172.21.15.17:0/2805029209 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc4009d00 con 0x7f6fcc0685b0 2023-07-14T13:16:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fbb7fe700 1 -- 172.21.15.17:0/2805029209 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fc000eea0 con 0x7f6fcc0685b0 2023-07-14T13:16:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fbb7fe700 1 -- 172.21.15.17:0/2805029209 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0003c10 con 0x7f6fcc0685b0 2023-07-14T13:16:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.089+0000 7f6fd0fff700 1 -- 172.21.15.17:0/2805029209 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc19d840 con 0x7f6fcc0685b0 2023-07-14T13:16:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.094+0000 7f6fbb7fe700 1 -- 172.21.15.17:0/2805029209 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6fc0003dd0 con 0x7f6fcc0685b0 2023-07-14T13:16:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.094+0000 7f6fe4962b80 1 Processor -- start 2023-07-14T13:16:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.094+0000 7f6fe4962b80 1 -- start start 2023-07-14T13:16:20.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c8600d46b0 0x55c86027dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c86027e2d0 0x55c860278040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c8602789d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c86017dc50 con 0x55c86027e2d0 2023-07-14T13:16:20.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8601d09e0 con 0x55c8600d46b0 2023-07-14T13:16:20.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8601c9e70 con 0x55c860278580 2023-07-14T13:16:20.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c86027e2d0 0x55c860278040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c86027e2d0 0x55c860278040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40112/0 (socket says 172.21.15.17:40112) 2023-07-14T13:16:20.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fca59c700 1 -- 172.21.15.17:0/454084142 learned_addr learned my addr 172.21.15.17:0/454084142 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:20.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fcad9d700 1 --2- 172.21.15.17:0/454084142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c8600d46b0 0x55c86027dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fc9d9b700 1 --2- 172.21.15.17:0/454084142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c8602789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fca59c700 1 -- 172.21.15.17:0/454084142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 msgr2=0x55c8602789d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:20.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fca59c700 1 --2- 172.21.15.17:0/454084142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c8602789d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fca59c700 1 -- 172.21.15.17:0/454084142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c8600d46b0 msgr2=0x55c86027dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:20.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.095+0000 7f6fca59c700 1 --2- 172.21.15.17:0/454084142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c8600d46b0 0x55c86027dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.096+0000 7f6fca59c700 1 -- 172.21.15.17:0/454084142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85fff7d80 con 0x55c86027e2d0 2023-07-14T13:16:20.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.096+0000 7f6fbb7fe700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6fb40a12c0 0x7f6fb40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.096+0000 7f6fca59c700 1 --2- 172.21.15.17:0/454084142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c86027e2d0 0x55c860278040 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009d80 tx=0x7f6fbc011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f38014e0efd33d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:20.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.096+0000 7f6fbb7fe700 1 -- 172.21.15.17:0/2805029209 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6fc0014070 con 0x7f6fcc0685b0 2023-07-14T13:16:20.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.096+0000 7f6fcad9d700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6fb40a12c0 0x7f6fb40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.096+0000 7f6fb8ff9700 1 -- 172.21.15.17:0/454084142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc004230 con 0x55c86027e2d0 2023-07-14T13:16:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.096+0000 7f6fb8ff9700 1 -- 172.21.15.17:0/454084142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fbc004390 con 0x55c86027e2d0 2023-07-14T13:16:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.096+0000 7f6fb8ff9700 1 -- 172.21.15.17:0/454084142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc019800 con 0x55c86027e2d0 2023-07-14T13:16:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.097+0000 7f6fcad9d700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6fb40a12c0 0x7f6fb40a3770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4007f80 tx=0x7f6fc400b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.097+0000 7f6fe4962b80 1 -- 172.21.15.17:0/454084142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c86027e2d0 msgr2=0x55c860278040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.097+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/454084142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c86027e2d0 0x55c860278040 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009d80 tx=0x7f6fbc011720 comp rx=0 tx=0).stop 2023-07-14T13:16:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.097+0000 7f6fe4962b80 1 -- 172.21.15.17:0/454084142 shutdown_connections 2023-07-14T13:16:20.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.097+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/454084142 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c8602789d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.097+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/454084142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c8600d46b0 0x55c86027dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.097+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/454084142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c86027e2d0 0x55c860278040 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.097+0000 7f6fe4962b80 1 -- 172.21.15.17:0/454084142 >> 172.21.15.17:0/454084142 conn(0x55c86026dbe0 msgr2=0x55c860272f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.098+0000 7f6fe4962b80 1 -- 172.21.15.17:0/454084142 shutdown_connections 2023-07-14T13:16:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.098+0000 7f6fe4962b80 1 -- 172.21.15.17:0/454084142 wait complete. 2023-07-14T13:16:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.098+0000 7f6fe4962b80 1 -- start start 2023-07-14T13:16:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.099+0000 7f6fe4962b80 1 Processor -- start 2023-07-14T13:16:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.099+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c8600d46b0 0x55c860284580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.099+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c860278580 0x55c860281870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.099+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860281ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.099+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c860169a60 con 0x55c860278580 2023-07-14T13:16:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.099+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c860169760 con 0x55c86027e2d0 2023-07-14T13:16:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.099+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c86004d8c0 con 0x55c8600d46b0 2023-07-14T13:16:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.099+0000 7f6fe4962b80 10 client.0 _ll_register_callbacks cb 0x55c860167700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fc9d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c860278580 0x55c860281870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fc9d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c860278580 0x55c860281870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40128/0 (socket says 172.21.15.17:40128) 2023-07-14T13:16:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fc9d9b700 1 -- 172.21.15.17:0/1329544330 learned_addr learned my addr 172.21.15.17:0/1329544330 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fcad9d700 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860281ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fca59c700 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c8600d46b0 0x55c860284580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fc9d9b700 1 -- 172.21.15.17:0/1329544330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c8600d46b0 msgr2=0x55c860284580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fc9d9b700 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c8600d46b0 0x55c860284580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fc9d9b700 1 -- 172.21.15.17:0/1329544330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 msgr2=0x55c860281ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fc9d9b700 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860281ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fc9d9b700 1 -- 172.21.15.17:0/1329544330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc0099e0 con 0x55c860278580 2023-07-14T13:16:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fc9d9b700 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c860278580 0x55c860281870 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0096a40 tx=0x7f6fc0096440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a2b41a2b31fb1c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.100+0000 7f6fb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.101+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/1329544330 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc00ce070 con 0x55c860278580 2023-07-14T13:16:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.101+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/1329544330 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6fc0099fd0 con 0x55c860278580 2023-07-14T13:16:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.101+0000 7f6fe4962b80 1 -- 172.21.15.17:0/1329544330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c860123490 con 0x55c860278580 2023-07-14T13:16:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.101+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/1329544330 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fc009e000 con 0x55c860278580 2023-07-14T13:16:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.101+0000 7f6fe4962b80 10 client.18315 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.101+0000 7f6fe4962b80 1 -- 172.21.15.17:0/1329544330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55c85ffe0c00 con 0x55c860278580 2023-07-14T13:16:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.101+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/1329544330 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c860123490 con 0x55c860278580 2023-07-14T13:16:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.101+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/1329544330 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f6fc009a230 con 0x55c860278580 2023-07-14T13:16:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.101+0000 7f6fe4962b80 10 client.18315 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.101+0000 7f6fe4962b80 10 client.18315 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.102+0000 7f6fe4962b80 20 client.18315 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.102+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c860291b40 0x55c860293f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.102+0000 7f6fe4962b80 4 client.18315 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.102+0000 7f6fe4962b80 1 -- 172.21.15.17:0/1329544330 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8601c2e50 con 0x55c860291b40 2023-07-14T13:16:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.102+0000 7f6fca59c700 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c860291b40 0x55c860293f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.103+0000 7f6fb1ffb700 10 client.18315 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.103+0000 7f6fca59c700 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c860291b40 0x55c860293f50 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c725849a43b67f47 server_cookie=76dfb99cd8a8c090 in_seq=0 out_seq=0 2023-07-14T13:16:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/1329544330 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c8601c2e50 con 0x55c860291b40 2023-07-14T13:16:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fb1ffb700 10 client.18315 handle_command_reply: tid=0 2023-07-14T13:16:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fe4962b80 1 client.18315 shutdown 2023-07-14T13:16:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fe4962b80 1 -- 172.21.15.17:0/1329544330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c860278580 msgr2=0x55c860281870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c860278580 0x55c860281870 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0096a40 tx=0x7f6fc0096440 comp rx=0 tx=0).stop 2023-07-14T13:16:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fe4962b80 1 -- 172.21.15.17:0/1329544330 shutdown_connections 2023-07-14T13:16:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c860291b40 0x55c860293f50 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860281ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c8600d46b0 0x55c860284580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fb1ffb700 0 client.18315 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/1329544330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c860278580 0x55c860281870 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fe4962b80 1 -- 172.21.15.17:0/1329544330 >> 172.21.15.17:0/1329544330 conn(0x55c86026dbe0 msgr2=0x55c860271c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.104+0000 7f6fe4962b80 1 -- 172.21.15.17:0/1329544330 shutdown_connections 2023-07-14T13:16:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.105+0000 7f6fe4962b80 1 -- 172.21.15.17:0/1329544330 wait complete. 2023-07-14T13:16:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.105+0000 7f6fe4962b80 20 client.18315 trim_cache size 0 max 16384 2023-07-14T13:16:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.120+0000 7f6fe4962b80 1 Processor -- start 2023-07-14T13:16:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.120+0000 7f6fe4962b80 1 -- start start 2023-07-14T13:16:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.121+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860278040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.121+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c86027d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.121+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860288c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.121+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c86027e6a0 con 0x55c8600d46b0 2023-07-14T13:16:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.121+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c860274720 con 0x55c86027e2d0 2023-07-14T13:16:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.121+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c86026fd00 con 0x55c860278580 2023-07-14T13:16:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.121+0000 7f6fca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860278040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.121+0000 7f6fca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860278040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40134/0 (socket says 172.21.15.17:40134) 2023-07-14T13:16:20.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.121+0000 7f6fca59c700 1 -- 172.21.15.17:0/614559053 learned_addr learned my addr 172.21.15.17:0/614559053 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:20.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.121+0000 7f6fcad9d700 1 --2- 172.21.15.17:0/614559053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860288c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.121+0000 7f6fc9d9b700 1 --2- 172.21.15.17:0/614559053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c86027d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.122+0000 7f6fca59c700 1 -- 172.21.15.17:0/614559053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 msgr2=0x55c86027d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.122+0000 7f6fca59c700 1 --2- 172.21.15.17:0/614559053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c86027d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.122+0000 7f6fca59c700 1 -- 172.21.15.17:0/614559053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 msgr2=0x55c860288c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.122+0000 7f6fca59c700 1 --2- 172.21.15.17:0/614559053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860288c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.122+0000 7f6fca59c700 1 -- 172.21.15.17:0/614559053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c86001e1f0 con 0x55c8600d46b0 2023-07-14T13:16:20.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.122+0000 7f6fcad9d700 1 --2- 172.21.15.17:0/614559053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860288c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:20.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.122+0000 7f6fca59c700 1 --2- 172.21.15.17:0/614559053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860278040 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00a010 tx=0x7f6fbc011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4fba813b8002e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:20.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.122+0000 7f6fb97fa700 1 -- 172.21.15.17:0/614559053 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc029040 con 0x55c8600d46b0 2023-07-14T13:16:20.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.122+0000 7f6fb97fa700 1 -- 172.21.15.17:0/614559053 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fbc02a440 con 0x55c8600d46b0 2023-07-14T13:16:20.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.122+0000 7f6fb97fa700 1 -- 172.21.15.17:0/614559053 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc005380 con 0x55c8600d46b0 2023-07-14T13:16:20.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.123+0000 7f6fe4962b80 1 -- 172.21.15.17:0/614559053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 msgr2=0x55c860278040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:20.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.123+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/614559053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860278040 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00a010 tx=0x7f6fbc011720 comp rx=0 tx=0).stop 2023-07-14T13:16:20.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.123+0000 7f6fe4962b80 1 -- 172.21.15.17:0/614559053 shutdown_connections 2023-07-14T13:16:20.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.123+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/614559053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860288c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.123+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/614559053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860278040 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.123+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/614559053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c86027d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.123+0000 7f6fe4962b80 1 -- 172.21.15.17:0/614559053 >> 172.21.15.17:0/614559053 conn(0x55c86026dbe0 msgr2=0x55c86027e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:20.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.123+0000 7f6fe4962b80 1 -- 172.21.15.17:0/614559053 shutdown_connections 2023-07-14T13:16:20.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.123+0000 7f6fe4962b80 1 -- 172.21.15.17:0/614559053 wait complete. 2023-07-14T13:16:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.124+0000 7f6fe4962b80 1 -- start start 2023-07-14T13:16:20.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.124+0000 7f6fe4962b80 1 Processor -- start 2023-07-14T13:16:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.124+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860288640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.124+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c860288b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.124+0000 7f6fe4962b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860286c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.124+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c860287220 con 0x55c8600d46b0 2023-07-14T13:16:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.124+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c860287390 con 0x55c86027e2d0 2023-07-14T13:16:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.124+0000 7f6fe4962b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c860287550 con 0x55c860278580 2023-07-14T13:16:20.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.124+0000 7f6fe4962b80 10 client.0 _ll_register_callbacks cb 0x7f6fc0099b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:20.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.125+0000 7f6fca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860288640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.125+0000 7f6fca59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860288640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40150/0 (socket says 172.21.15.17:40150) 2023-07-14T13:16:20.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.125+0000 7f6fca59c700 1 -- 172.21.15.17:0/3209058224 learned_addr learned my addr 172.21.15.17:0/3209058224 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:20.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.125+0000 7f6fc9d9b700 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c860288b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.125+0000 7f6fcad9d700 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860286c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.125+0000 7f6fca59c700 1 -- 172.21.15.17:0/3209058224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 msgr2=0x55c860288b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:20.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.125+0000 7f6fca59c700 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c860288b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.125+0000 7f6fca59c700 1 -- 172.21.15.17:0/3209058224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 msgr2=0x55c860286c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:20.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.125+0000 7f6fca59c700 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860286c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.125+0000 7f6fca59c700 1 -- 172.21.15.17:0/3209058224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc10d210 con 0x55c8600d46b0 2023-07-14T13:16:20.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.125+0000 7f6fcad9d700 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860286c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:16:20.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.126+0000 7f6fca59c700 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860288640 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc000c00 tx=0x7f6fbc02a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a29326204dacf2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:20.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.126+0000 7f6fb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:20.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.126+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/3209058224 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc029050 con 0x55c8600d46b0 2023-07-14T13:16:20.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.126+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/3209058224 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6fbc0046f0 con 0x55c8600d46b0 2023-07-14T13:16:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.126+0000 7f6fe4962b80 1 -- 172.21.15.17:0/3209058224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6fbc004390 con 0x55c8600d46b0 2023-07-14T13:16:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.126+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/3209058224 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fbc0048b0 con 0x55c8600d46b0 2023-07-14T13:16:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.126+0000 7f6fe4962b80 10 client.18321 fetch_fsmap learned FSMap version 44 2023-07-14T13:16:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.126+0000 7f6fe4962b80 1 -- 172.21.15.17:0/3209058224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55c85fff7d80 con 0x55c8600d46b0 2023-07-14T13:16:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.127+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/3209058224 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fbc004390 con 0x55c8600d46b0 2023-07-14T13:16:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.127+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/3209058224 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 44) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f6fbc011440 con 0x55c8600d46b0 2023-07-14T13:16:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.127+0000 7f6fe4962b80 10 client.18321 fetch_fsmap finished waiting for FSMap version 44 2023-07-14T13:16:20.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.127+0000 7f6fe4962b80 10 client.18321 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.127+0000 7f6fe4962b80 20 client.18321 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.127+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c8602e6620 0x55c8602e8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.127+0000 7f6fe4962b80 4 client.18321 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:16:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.127+0000 7f6fe4962b80 1 -- 172.21.15.17:0/3209058224 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c860184ff0 con 0x55c8602e6620 2023-07-14T13:16:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.127+0000 7f6fc9d9b700 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c8602e6620 0x55c8602e8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.128+0000 7f6fc9d9b700 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c8602e6620 0x55c8602e8a00 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6baa9eef6eab4a4 server_cookie=2f3261cbec9c5cae in_seq=0 out_seq=0 2023-07-14T13:16:20.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.128+0000 7f6fb1ffb700 10 client.18321 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:20.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fb1ffb700 1 -- 172.21.15.17:0/3209058224 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c860184ff0 con 0x55c8602e6620 2023-07-14T13:16:20.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fb1ffb700 10 client.18321 handle_command_reply: tid=0 2023-07-14T13:16:20.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fe4962b80 1 client.18321 shutdown 2023-07-14T13:16:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fe4962b80 1 -- 172.21.15.17:0/3209058224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 msgr2=0x55c860288640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860288640 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc000c00 tx=0x7f6fbc02a370 comp rx=0 tx=0).stop 2023-07-14T13:16:20.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fe4962b80 1 -- 172.21.15.17:0/3209058224 shutdown_connections 2023-07-14T13:16:20.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c8602e6620 0x55c8602e8a00 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c86027e2d0 0x55c860286c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c8600d46b0 0x55c860288640 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fe4962b80 1 --2- 172.21.15.17:0/3209058224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c860278580 0x55c860288b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fb1ffb700 0 client.18321 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:20.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.149+0000 7f6fe4962b80 1 -- 172.21.15.17:0/3209058224 >> 172.21.15.17:0/3209058224 conn(0x55c86026dbe0 msgr2=0x55c8602778c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:20.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.150+0000 7f6fe4962b80 1 -- 172.21.15.17:0/3209058224 shutdown_connections 2023-07-14T13:16:20.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.150+0000 7f6fe4962b80 1 -- 172.21.15.17:0/3209058224 wait complete. 2023-07-14T13:16:20.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.150+0000 7f6fe4962b80 20 client.18321 trim_cache size 0 max 16384 2023-07-14T13:16:20.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:16:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:16:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:16:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:16:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.151+0000 7f6fd0fff700 1 -- 172.21.15.17:0/2805029209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6fb40a12c0 msgr2=0x7f6fb40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.151+0000 7f6fd0fff700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6fb40a12c0 0x7f6fb40a3770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4007f80 tx=0x7f6fc400b040 comp rx=0 tx=0).stop 2023-07-14T13:16:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.151+0000 7f6fd0fff700 1 -- 172.21.15.17:0/2805029209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fcc0685b0 msgr2=0x7f6fcc198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.151+0000 7f6fd0fff700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fcc0685b0 0x7f6fcc198390 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009fd0 tx=0x7f6fc000ed10 comp rx=0 tx=0).stop 2023-07-14T13:16:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.151+0000 7f6fd0fff700 1 -- 172.21.15.17:0/2805029209 shutdown_connections 2023-07-14T13:16:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.151+0000 7f6fd0fff700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f6fb40a12c0 0x7f6fb40a3770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.151+0000 7f6fd0fff700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fcc104e50 0x7f6fcc19ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.151+0000 7f6fd0fff700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fcc067c10 0x7f6fcc197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.151+0000 7f6fd0fff700 1 --2- 172.21.15.17:0/2805029209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fcc0685b0 0x7f6fcc198390 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:20.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.151+0000 7f6fd0fff700 1 -- 172.21.15.17:0/2805029209 >> 172.21.15.17:0/2805029209 conn(0x7f6fcc074760 msgr2=0x7f6fcc0fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:20.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.152+0000 7f6fd0fff700 1 -- 172.21.15.17:0/2805029209 shutdown_connections 2023-07-14T13:16:20.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:20.152+0000 7f6fd0fff700 1 -- 172.21.15.17:0/2805029209 wait complete. 2023-07-14T13:16:20.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:20 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:16:20.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:20 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:16:20.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:20 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:16:20.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:20 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:16:20.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:20 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:16:20.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:20 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:16:20.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:20 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:16:20.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:20 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:16:20.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:20 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:16:21.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:21 smithi017 ceph-mon[95536]: pgmap v523: 97 pgs: 97 active+clean; 14 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 22 MiB/s wr, 133 op/s 2023-07-14T13:16:21.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:21 smithi135 ceph-mon[97338]: pgmap v523: 97 pgs: 97 active+clean; 14 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 22 MiB/s wr, 133 op/s 2023-07-14T13:16:21.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:21 smithi131 ceph-mon[96953]: pgmap v523: 97 pgs: 97 active+clean; 14 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 22 MiB/s wr, 133 op/s 2023-07-14T13:16:23.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:23 smithi017 ceph-mon[95536]: pgmap v524: 97 pgs: 97 active+clean; 14 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 19 MiB/s wr, 122 op/s 2023-07-14T13:16:23.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:23 smithi135 ceph-mon[97338]: pgmap v524: 97 pgs: 97 active+clean; 14 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 19 MiB/s wr, 122 op/s 2023-07-14T13:16:23.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:23 smithi131 ceph-mon[96953]: pgmap v524: 97 pgs: 97 active+clean; 14 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 19 MiB/s wr, 122 op/s 2023-07-14T13:16:24.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:24 smithi017 ceph-mon[95536]: pgmap v525: 97 pgs: 97 active+clean; 14 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 18 MiB/s wr, 111 op/s 2023-07-14T13:16:24.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:24 smithi135 ceph-mon[97338]: pgmap v525: 97 pgs: 97 active+clean; 14 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 18 MiB/s wr, 111 op/s 2023-07-14T13:16:24.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:24 smithi131 ceph-mon[96953]: pgmap v525: 97 pgs: 97 active+clean; 14 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 18 MiB/s wr, 111 op/s 2023-07-14T13:16:25.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:25 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:16:25.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:25 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:16:25.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:25 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:16:25.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:25 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:16:25.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:25 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:16:25.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:25 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:16:25.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:25 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:16:25.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:25 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:16:25.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:25 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:16:27.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:27 smithi131 ceph-mon[96953]: pgmap v526: 97 pgs: 97 active+clean; 14 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 27 MiB/s wr, 121 op/s 2023-07-14T13:16:27.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:27 smithi017 ceph-mon[95536]: pgmap v526: 97 pgs: 97 active+clean; 14 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 27 MiB/s wr, 121 op/s 2023-07-14T13:16:27.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:27 smithi135 ceph-mon[97338]: pgmap v526: 97 pgs: 97 active+clean; 14 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 27 MiB/s wr, 121 op/s 2023-07-14T13:16:29.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:29 smithi131 ceph-mon[96953]: pgmap v527: 97 pgs: 97 active+clean; 14 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 17 op/s 2023-07-14T13:16:29.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:29 smithi017 ceph-mon[95536]: pgmap v527: 97 pgs: 97 active+clean; 14 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 17 op/s 2023-07-14T13:16:29.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:29 smithi135 ceph-mon[97338]: pgmap v527: 97 pgs: 97 active+clean; 14 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 17 op/s 2023-07-14T13:16:30.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:30 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:16:30.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:30 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:16:30.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:30 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:16:31.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:31 smithi131 ceph-mon[96953]: pgmap v528: 97 pgs: 97 active+clean; 15 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-07-14T13:16:31.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:31 smithi017 ceph-mon[95536]: pgmap v528: 97 pgs: 97 active+clean; 15 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-07-14T13:16:31.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:31 smithi135 ceph-mon[97338]: pgmap v528: 97 pgs: 97 active+clean; 15 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 22 op/s 2023-07-14T13:16:33.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.319+0000 7fc147fff700 1 -- 172.21.15.17:0/2631891851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148101db0 msgr2=0x7fc148102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.319+0000 7fc147fff700 1 --2- 172.21.15.17:0/2631891851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148101db0 0x7fc148102180 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc1380099c0 tx=0x7fc138009cd0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.319+0000 7fc147fff700 1 -- 172.21.15.17:0/2631891851 shutdown_connections 2023-07-14T13:16:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.319+0000 7fc147fff700 1 --2- 172.21.15.17:0/2631891851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc148106df0 0x7fc14810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.319+0000 7fc147fff700 1 --2- 172.21.15.17:0/2631891851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148101db0 0x7fc148102180 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.319+0000 7fc147fff700 1 --2- 172.21.15.17:0/2631891851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148102750 0x7fc148106710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.319+0000 7fc147fff700 1 -- 172.21.15.17:0/2631891851 >> 172.21.15.17:0/2631891851 conn(0x7fc1480fd660 msgr2=0x7fc1480ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.319+0000 7fc147fff700 1 -- 172.21.15.17:0/2631891851 shutdown_connections 2023-07-14T13:16:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.319+0000 7fc147fff700 1 -- 172.21.15.17:0/2631891851 wait complete. 2023-07-14T13:16:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.320+0000 7fc147fff700 1 Processor -- start 2023-07-14T13:16:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.321+0000 7fc147fff700 1 -- start start 2023-07-14T13:16:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.321+0000 7fc147fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148101db0 0x7fc14819d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.321+0000 7fc147fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc148102750 0x7fc14819de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.321+0000 7fc147fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148106df0 0x7fc148197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.321+0000 7fc147fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc148197ff0 con 0x7fc148106df0 2023-07-14T13:16:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.321+0000 7fc147fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc148198160 con 0x7fc148102750 2023-07-14T13:16:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.321+0000 7fc147fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc148198320 con 0x7fc148101db0 2023-07-14T13:16:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.321+0000 7fc146ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148101db0 0x7fc14819d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.321+0000 7fc1477fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148106df0 0x7fc148197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.322+0000 7fc146ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148101db0 0x7fc14819d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:49744/0 (socket says 172.21.15.17:49744) 2023-07-14T13:16:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.322+0000 7fc146ffd700 1 -- 172.21.15.17:0/3845115473 learned_addr learned my addr 172.21.15.17:0/3845115473 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.322+0000 7fc1467fc700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc148102750 0x7fc14819de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.322+0000 7fc146ffd700 1 -- 172.21.15.17:0/3845115473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc148102750 msgr2=0x7fc14819de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.322+0000 7fc146ffd700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc148102750 0x7fc14819de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.322+0000 7fc146ffd700 1 -- 172.21.15.17:0/3845115473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148106df0 msgr2=0x7fc148197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.322+0000 7fc146ffd700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148106df0 0x7fc148197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.322+0000 7fc146ffd700 1 -- 172.21.15.17:0/3845115473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1380095f0 con 0x7fc148101db0 2023-07-14T13:16:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.322+0000 7fc1477fe700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148106df0 0x7fc148197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.322+0000 7fc146ffd700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148101db0 0x7fc14819d910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc138009f50 tx=0x7fc138005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:33.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.323+0000 7fc14c9fd700 1 -- 172.21.15.17:0/3845115473 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13801d070 con 0x7fc148101db0 2023-07-14T13:16:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.323+0000 7fc147fff700 1 -- 172.21.15.17:0/3845115473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1481985a0 con 0x7fc148101db0 2023-07-14T13:16:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.323+0000 7fc147fff700 1 -- 172.21.15.17:0/3845115473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1481a4900 con 0x7fc148101db0 2023-07-14T13:16:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.323+0000 7fc14c9fd700 1 -- 172.21.15.17:0/3845115473 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc138003ec0 con 0x7fc148101db0 2023-07-14T13:16:33.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.323+0000 7fc14c9fd700 1 -- 172.21.15.17:0/3845115473 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138022a50 con 0x7fc148101db0 2023-07-14T13:16:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.328+0000 7fc14c9fd700 1 -- 172.21.15.17:0/3845115473 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc138004030 con 0x7fc148101db0 2023-07-14T13:16:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.329+0000 7fc1612a7b80 1 Processor -- start 2023-07-14T13:16:33.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.330+0000 7fc1612a7b80 1 -- start start 2023-07-14T13:16:33.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.330+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18e94b6b0 0x55c18eaf4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.330+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 0x55c18eaef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.330+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaef700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.330+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18e9f4c50 con 0x55c18eaf5470 2023-07-14T13:16:33.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.330+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18ea479e0 con 0x55c18eaf58c0 2023-07-14T13:16:33.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.330+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18ea40e70 con 0x55c18e94b6b0 2023-07-14T13:16:33.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.330+0000 7fc14c9fd700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc1300a12c0 0x7fc1300a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.330+0000 7fc14c9fd700 1 -- 172.21.15.17:0/3845115473 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc1380cdca0 con 0x7fc148101db0 2023-07-14T13:16:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc146ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 0x55c18eaef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc146ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 0x55c18eaef1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48930/0 (socket says 172.21.15.17:48930) 2023-07-14T13:16:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc146ffd700 1 -- 172.21.15.17:0/3076471790 learned_addr learned my addr 172.21.15.17:0/3076471790 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc1477fe700 1 --2- 172.21.15.17:0/3076471790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18e94b6b0 0x55c18eaf4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc1477fe700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc1300a12c0 0x7fc1300a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc1467fc700 1 --2- 172.21.15.17:0/3076471790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc1477fe700 1 -- 172.21.15.17:0/3076471790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 msgr2=0x55c18eaef700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc1477fe700 1 --2- 172.21.15.17:0/3076471790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaef700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc1477fe700 1 -- 172.21.15.17:0/3076471790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 msgr2=0x55c18eaef1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc1477fe700 1 --2- 172.21.15.17:0/3076471790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 0x55c18eaef1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc1477fe700 1 -- 172.21.15.17:0/3076471790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c18e86ed80 con 0x55c18e94b6b0 2023-07-14T13:16:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.331+0000 7fc1477fe700 1 --2- 172.21.15.17:0/3076471790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18e94b6b0 0x55c18eaf4f30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc140009550 tx=0x7fc140007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1729218ebe3c96f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.332+0000 7fc1477fe700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc1300a12c0 0x7fc1300a3770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc140010000 tx=0x7fc14001c000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:33.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.332+0000 7fc12dffb700 1 -- 172.21.15.17:0/3076471790 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14001a470 con 0x55c18e94b6b0 2023-07-14T13:16:33.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.332+0000 7fc12dffb700 1 -- 172.21.15.17:0/3076471790 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc14000f040 con 0x55c18e94b6b0 2023-07-14T13:16:33.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.332+0000 7fc12dffb700 1 -- 172.21.15.17:0/3076471790 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140024680 con 0x55c18e94b6b0 2023-07-14T13:16:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.333+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3076471790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18e94b6b0 msgr2=0x55c18eaf4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.333+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/3076471790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18e94b6b0 0x55c18eaf4f30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc140009550 tx=0x7fc140007e20 comp rx=0 tx=0).stop 2023-07-14T13:16:33.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.333+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3076471790 shutdown_connections 2023-07-14T13:16:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.333+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/3076471790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaef700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.333+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/3076471790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18e94b6b0 0x55c18eaf4f30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.333+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/3076471790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 0x55c18eaef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.333+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3076471790 >> 172.21.15.17:0/3076471790 conn(0x55c18eae4d40 msgr2=0x55c18eaea340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.333+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3076471790 shutdown_connections 2023-07-14T13:16:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.333+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3076471790 wait complete. 2023-07-14T13:16:33.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.333+0000 7fc1612a7b80 1 -- start start 2023-07-14T13:16:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.334+0000 7fc1612a7b80 1 Processor -- start 2023-07-14T13:16:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.334+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.334+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf5470 0x55c18eaf8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.334+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaf9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.334+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18e9e0a60 con 0x55c18e94b6b0 2023-07-14T13:16:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.334+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18e9e0760 con 0x55c18eaf58c0 2023-07-14T13:16:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.334+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18e8c48c0 con 0x55c18eaf5470 2023-07-14T13:16:33.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.334+0000 7fc1612a7b80 10 client.0 _ll_register_callbacks cb 0x55c18e9de700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc146ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc146ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48946/0 (socket says 172.21.15.17:48946) 2023-07-14T13:16:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc146ffd700 1 -- 172.21.15.17:0/3378525790 learned_addr learned my addr 172.21.15.17:0/3378525790 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc1467fc700 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf5470 0x55c18eaf8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc1477fe700 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaf9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc146ffd700 1 -- 172.21.15.17:0/3378525790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf5470 msgr2=0x55c18eaf8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc146ffd700 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf5470 0x55c18eaf8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc146ffd700 1 -- 172.21.15.17:0/3378525790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 msgr2=0x55c18eaf9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc146ffd700 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaf9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc146ffd700 1 -- 172.21.15.17:0/3378525790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc140011040 con 0x55c18e94b6b0 2023-07-14T13:16:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc146ffd700 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafb780 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc138097890 tx=0x7fc138014cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff00bbb3164c986 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.335+0000 7fc126ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc126ffd700 1 -- 172.21.15.17:0/3378525790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13809ae20 con 0x55c18e94b6b0 2023-07-14T13:16:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc126ffd700 1 -- 172.21.15.17:0/3378525790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc13809ee50 con 0x55c18e94b6b0 2023-07-14T13:16:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3378525790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c18e99a490 con 0x55c18e94b6b0 2023-07-14T13:16:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc126ffd700 1 -- 172.21.15.17:0/3378525790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1380a31e0 con 0x55c18e94b6b0 2023-07-14T13:16:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc1612a7b80 10 client.18333 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3378525790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55c18e857c00 con 0x55c18e94b6b0 2023-07-14T13:16:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc126ffd700 1 -- 172.21.15.17:0/3378525790 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1380b7080 con 0x55c18e94b6b0 2023-07-14T13:16:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc126ffd700 1 -- 172.21.15.17:0/3378525790 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc1380b8f80 con 0x55c18e94b6b0 2023-07-14T13:16:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc1612a7b80 10 client.18333 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc1612a7b80 10 client.18333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc1612a7b80 20 client.18333 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c18eb08a50 0x55c18eb0ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc1612a7b80 4 client.18333 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.336+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3378525790 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c18ea39e50 con 0x55c18eb08a50 2023-07-14T13:16:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.337+0000 7fc1467fc700 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c18eb08a50 0x55c18eb0ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.338+0000 7fc126ffd700 10 client.18333 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.338+0000 7fc1467fc700 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c18eb08a50 0x55c18eb0ae60 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce39a2579abf17d1 server_cookie=c89f25dbee63e3df in_seq=0 out_seq=0 2023-07-14T13:16:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.338+0000 7fc126ffd700 1 -- 172.21.15.17:0/3378525790 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c18ea39e50 con 0x55c18eb08a50 2023-07-14T13:16:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.338+0000 7fc126ffd700 10 client.18333 handle_command_reply: tid=0 2023-07-14T13:16:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.338+0000 7fc1612a7b80 1 client.18333 shutdown 2023-07-14T13:16:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3378525790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 msgr2=0x55c18eafb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafb780 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc138097890 tx=0x7fc138014cf0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3378525790 shutdown_connections 2023-07-14T13:16:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c18eb08a50 0x55c18eb0ae60 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaf9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafb780 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/3378525790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf5470 0x55c18eaf8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3378525790 >> 172.21.15.17:0/3378525790 conn(0x55c18eae4d40 msgr2=0x55c18eae9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:33.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc126ffd700 0 client.18333 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:33.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3378525790 shutdown_connections 2023-07-14T13:16:33.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc1612a7b80 1 -- 172.21.15.17:0/3378525790 wait complete. 2023-07-14T13:16:33.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.339+0000 7fc1612a7b80 20 client.18333 trim_cache size 0 max 16384 2023-07-14T13:16:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.360+0000 7fc1612a7b80 1 Processor -- start 2023-07-14T13:16:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.360+0000 7fc1612a7b80 1 -- start start 2023-07-14T13:16:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.361+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18e94b6b0 0x55c18eaffd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.361+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 0x55c18eaf6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.361+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf58c0 0x55c18eae9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.361+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18eaf6f60 con 0x55c18eaf5470 2023-07-14T13:16:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.361+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18eaf36d0 con 0x55c18e94b6b0 2023-07-14T13:16:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.361+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18eaebc30 con 0x55c18eaf58c0 2023-07-14T13:16:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.361+0000 7fc1467fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 0x55c18eaf6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.361+0000 7fc1467fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 0x55c18eaf6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48956/0 (socket says 172.21.15.17:48956) 2023-07-14T13:16:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.361+0000 7fc1467fc700 1 -- 172.21.15.17:0/1258357829 learned_addr learned my addr 172.21.15.17:0/1258357829 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.361+0000 7fc146ffd700 1 --2- 172.21.15.17:0/1258357829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18e94b6b0 0x55c18eaffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.361+0000 7fc1477fe700 1 --2- 172.21.15.17:0/1258357829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf58c0 0x55c18eae9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.362+0000 7fc146ffd700 1 -- 172.21.15.17:0/1258357829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf58c0 msgr2=0x55c18eae9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.362+0000 7fc146ffd700 1 --2- 172.21.15.17:0/1258357829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf58c0 0x55c18eae9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.362+0000 7fc146ffd700 1 -- 172.21.15.17:0/1258357829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 msgr2=0x55c18eaf6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.362+0000 7fc146ffd700 1 --2- 172.21.15.17:0/1258357829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 0x55c18eaf6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.362+0000 7fc146ffd700 1 -- 172.21.15.17:0/1258357829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c18eb0fa50 con 0x55c18e94b6b0 2023-07-14T13:16:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.362+0000 7fc146ffd700 1 --2- 172.21.15.17:0/1258357829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18e94b6b0 0x55c18eaffd80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc138087a70 tx=0x7fc1380993d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a10fa0198da68c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.362+0000 7fc12e7fc700 1 -- 172.21.15.17:0/1258357829 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13809ee50 con 0x55c18e94b6b0 2023-07-14T13:16:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.363+0000 7fc12e7fc700 1 -- 172.21.15.17:0/1258357829 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c18e99a490 con 0x55c18e94b6b0 2023-07-14T13:16:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.363+0000 7fc12e7fc700 1 -- 172.21.15.17:0/1258357829 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1380a2fb0 con 0x55c18e94b6b0 2023-07-14T13:16:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.363+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1258357829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18e94b6b0 msgr2=0x55c18eaffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.363+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/1258357829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18e94b6b0 0x55c18eaffd80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc138087a70 tx=0x7fc1380993d0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.363+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1258357829 shutdown_connections 2023-07-14T13:16:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.363+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/1258357829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf58c0 0x55c18eae9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.363+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/1258357829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18e94b6b0 0x55c18eaffd80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.363+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/1258357829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18eaf5470 0x55c18eaf6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.363+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1258357829 >> 172.21.15.17:0/1258357829 conn(0x55c18eae4d40 msgr2=0x55c18eaf5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.363+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1258357829 shutdown_connections 2023-07-14T13:16:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.364+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1258357829 wait complete. 2023-07-14T13:16:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.364+0000 7fc1612a7b80 1 -- start start 2023-07-14T13:16:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.364+0000 7fc1612a7b80 1 Processor -- start 2023-07-14T13:16:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf5470 0x55c18eaf0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc1612a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaf0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18eaf16a0 con 0x55c18e94b6b0 2023-07-14T13:16:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18eaf17e0 con 0x55c18eaf58c0 2023-07-14T13:16:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc1612a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18eaf19a0 con 0x55c18eaf5470 2023-07-14T13:16:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc1612a7b80 10 client.0 _ll_register_callbacks cb 0x7fc138097160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc146ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc146ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48964/0 (socket says 172.21.15.17:48964) 2023-07-14T13:16:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc146ffd700 1 -- 172.21.15.17:0/1135912068 learned_addr learned my addr 172.21.15.17:0/1135912068 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc1467fc700 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf5470 0x55c18eaf0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc1477fe700 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaf0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc146ffd700 1 -- 172.21.15.17:0/1135912068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf5470 msgr2=0x55c18eaf0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc146ffd700 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf5470 0x55c18eaf0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc146ffd700 1 -- 172.21.15.17:0/1135912068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 msgr2=0x55c18eaf0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc146ffd700 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaf0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.365+0000 7fc146ffd700 1 -- 172.21.15.17:0/1135912068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c18e857c00 con 0x55c18e94b6b0 2023-07-14T13:16:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.366+0000 7fc146ffd700 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafff80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc13809b3d0 tx=0x7fc138005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5109266c9b4ffa95 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.366+0000 7fc126ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.366+0000 7fc126ffd700 1 -- 172.21.15.17:0/1135912068 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13809ee50 con 0x55c18e94b6b0 2023-07-14T13:16:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.366+0000 7fc126ffd700 1 -- 172.21.15.17:0/1135912068 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc1380a31e0 con 0x55c18e94b6b0 2023-07-14T13:16:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.366+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1135912068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc14000f040 con 0x55c18e94b6b0 2023-07-14T13:16:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.366+0000 7fc126ffd700 1 -- 172.21.15.17:0/1135912068 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc138022bb0 con 0x55c18e94b6b0 2023-07-14T13:16:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.366+0000 7fc1612a7b80 10 client.18339 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.366+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1135912068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55c18e8951f0 con 0x55c18e94b6b0 2023-07-14T13:16:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.367+0000 7fc126ffd700 1 -- 172.21.15.17:0/1135912068 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc14000f040 con 0x55c18e94b6b0 2023-07-14T13:16:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.367+0000 7fc126ffd700 1 -- 172.21.15.17:0/1135912068 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc1380b3240 con 0x55c18e94b6b0 2023-07-14T13:16:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.367+0000 7fc1612a7b80 10 client.18339 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.367+0000 7fc1612a7b80 10 client.18339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.367+0000 7fc1612a7b80 20 client.18339 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.367+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c18eb5cc40 0x55c18eb5f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.367+0000 7fc1612a7b80 4 client.18339 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:16:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.367+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1135912068 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c18e9fbff0 con 0x55c18eb5cc40 2023-07-14T13:16:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.367+0000 7fc1467fc700 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c18eb5cc40 0x55c18eb5f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.368+0000 7fc1467fc700 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c18eb5cc40 0x55c18eb5f020 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e228cace3f95c3aa server_cookie=7c88694dcd52e0f in_seq=0 out_seq=0 2023-07-14T13:16:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.368+0000 7fc126ffd700 10 client.18339 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.378+0000 7fc126ffd700 1 -- 172.21.15.17:0/1135912068 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c18e9fbff0 con 0x55c18eb5cc40 2023-07-14T13:16:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.378+0000 7fc126ffd700 10 client.18339 handle_command_reply: tid=0 2023-07-14T13:16:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.378+0000 7fc1612a7b80 1 client.18339 shutdown 2023-07-14T13:16:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.379+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1135912068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 msgr2=0x55c18eafff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.379+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafff80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc13809b3d0 tx=0x7fc138005a00 comp rx=0 tx=0).stop 2023-07-14T13:16:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.379+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1135912068 shutdown_connections 2023-07-14T13:16:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.379+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c18eb5cc40 0x55c18eb5f020 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.379+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c18eaf58c0 0x55c18eaf0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.379+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c18e94b6b0 0x55c18eafff80 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.379+0000 7fc1612a7b80 1 --2- 172.21.15.17:0/1135912068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c18eaf5470 0x55c18eaf0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.379+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1135912068 >> 172.21.15.17:0/1135912068 conn(0x55c18eae4d40 msgr2=0x55c18eaf6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.379+0000 7fc126ffd700 0 client.18339 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.379+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1135912068 shutdown_connections 2023-07-14T13:16:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.379+0000 7fc1612a7b80 1 -- 172.21.15.17:0/1135912068 wait complete. 2023-07-14T13:16:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.380+0000 7fc1612a7b80 20 client.18339 trim_cache size 0 max 16384 2023-07-14T13:16:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:16:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:16:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:16:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:16:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.380+0000 7fc147fff700 1 -- 172.21.15.17:0/3845115473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc1300a12c0 msgr2=0x7fc1300a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.380+0000 7fc147fff700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc1300a12c0 0x7fc1300a3770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc140010000 tx=0x7fc14001c000 comp rx=0 tx=0).stop 2023-07-14T13:16:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.380+0000 7fc147fff700 1 -- 172.21.15.17:0/3845115473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148101db0 msgr2=0x7fc14819d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.380+0000 7fc147fff700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148101db0 0x7fc14819d910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc138009f50 tx=0x7fc138005740 comp rx=0 tx=0).stop 2023-07-14T13:16:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.380+0000 7fc147fff700 1 -- 172.21.15.17:0/3845115473 shutdown_connections 2023-07-14T13:16:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.381+0000 7fc147fff700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc1300a12c0 0x7fc1300a3770 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.381+0000 7fc147fff700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc148106df0 0x7fc148197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.381+0000 7fc147fff700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148101db0 0x7fc14819d910 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.381+0000 7fc147fff700 1 --2- 172.21.15.17:0/3845115473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc148102750 0x7fc14819de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.381+0000 7fc147fff700 1 -- 172.21.15.17:0/3845115473 >> 172.21.15.17:0/3845115473 conn(0x7fc1480fd660 msgr2=0x7fc1480fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.381+0000 7fc147fff700 1 -- 172.21.15.17:0/3845115473 shutdown_connections 2023-07-14T13:16:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:33.381+0000 7fc147fff700 1 -- 172.21.15.17:0/3845115473 wait complete. 2023-07-14T13:16:33.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:33 smithi131 ceph-mon[96953]: pgmap v529: 97 pgs: 97 active+clean; 15 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 16 op/s 2023-07-14T13:16:33.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:33 smithi017 ceph-mon[95536]: pgmap v529: 97 pgs: 97 active+clean; 15 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 16 op/s 2023-07-14T13:16:33.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:33 smithi135 ceph-mon[97338]: pgmap v529: 97 pgs: 97 active+clean; 15 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 16 op/s 2023-07-14T13:16:35.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:35 smithi131 ceph-mon[96953]: pgmap v530: 97 pgs: 97 active+clean; 15 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 MiB/s wr, 15 op/s 2023-07-14T13:16:35.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:35 smithi017 ceph-mon[95536]: pgmap v530: 97 pgs: 97 active+clean; 15 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 MiB/s wr, 15 op/s 2023-07-14T13:16:35.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:35 smithi135 ceph-mon[97338]: pgmap v530: 97 pgs: 97 active+clean; 15 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 MiB/s wr, 15 op/s 2023-07-14T13:16:37.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:37 smithi131 ceph-mon[96953]: pgmap v531: 97 pgs: 97 active+clean; 15 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 23 op/s 2023-07-14T13:16:37.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:37 smithi017 ceph-mon[95536]: pgmap v531: 97 pgs: 97 active+clean; 15 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 23 op/s 2023-07-14T13:16:37.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:37 smithi135 ceph-mon[97338]: pgmap v531: 97 pgs: 97 active+clean; 15 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 MiB/s wr, 23 op/s 2023-07-14T13:16:39.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:39 smithi131 ceph-mon[96953]: pgmap v532: 97 pgs: 97 active+clean; 15 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 13 op/s 2023-07-14T13:16:39.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:39 smithi017 ceph-mon[95536]: pgmap v532: 97 pgs: 97 active+clean; 15 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 13 op/s 2023-07-14T13:16:39.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:39 smithi135 ceph-mon[97338]: pgmap v532: 97 pgs: 97 active+clean; 15 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 13 op/s 2023-07-14T13:16:41.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:41 smithi017 ceph-mon[95536]: pgmap v533: 97 pgs: 97 active+clean; 15 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 17 op/s 2023-07-14T13:16:41.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:41 smithi135 ceph-mon[97338]: pgmap v533: 97 pgs: 97 active+clean; 15 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 17 op/s 2023-07-14T13:16:41.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:41 smithi131 ceph-mon[96953]: pgmap v533: 97 pgs: 97 active+clean; 15 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 17 op/s 2023-07-14T13:16:42.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:16:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.572+0000 7fc73359e700 1 -- 172.21.15.17:0/2645962979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7341003a0 msgr2=0x7fc73410c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.572+0000 7fc73359e700 1 --2- 172.21.15.17:0/2645962979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7341003a0 0x7fc73410c830 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00b0a0 tx=0x7fc72c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.572+0000 7fc73359e700 1 -- 172.21.15.17:0/2645962979 shutdown_connections 2023-07-14T13:16:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.572+0000 7fc73359e700 1 --2- 172.21.15.17:0/2645962979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7341003a0 0x7fc73410c830 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.572+0000 7fc73359e700 1 --2- 172.21.15.17:0/2645962979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc734105a00 0x7fc734105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.572+0000 7fc73359e700 1 --2- 172.21.15.17:0/2645962979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7340ff9f0 0x7fc7340ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.572+0000 7fc73359e700 1 -- 172.21.15.17:0/2645962979 >> 172.21.15.17:0/2645962979 conn(0x7fc7340fb510 msgr2=0x7fc7340fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.572+0000 7fc73359e700 1 -- 172.21.15.17:0/2645962979 shutdown_connections 2023-07-14T13:16:42.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.572+0000 7fc73359e700 1 -- 172.21.15.17:0/2645962979 wait complete. 2023-07-14T13:16:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.573+0000 7fc73359e700 1 Processor -- start 2023-07-14T13:16:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.574+0000 7fc73359e700 1 -- start start 2023-07-14T13:16:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.574+0000 7fc73359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7340ff9f0 0x7fc73419d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.574+0000 7fc73359e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7341003a0 0x7fc73419ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.574+0000 7fc73359e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc734105a00 0x7fc734197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.574+0000 7fc73359e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc734197f90 con 0x7fc734105a00 2023-07-14T13:16:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.574+0000 7fc73359e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc734198100 con 0x7fc7340ff9f0 2023-07-14T13:16:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.574+0000 7fc73359e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7341982c0 con 0x7fc7341003a0 2023-07-14T13:16:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc732d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc734105a00 0x7fc734197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc73259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7340ff9f0 0x7fc73419d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc732d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc734105a00 0x7fc734197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44264/0 (socket says 172.21.15.17:44264) 2023-07-14T13:16:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc73259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7340ff9f0 0x7fc73419d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59088/0 (socket says 172.21.15.17:59088) 2023-07-14T13:16:42.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc732d9d700 1 -- 172.21.15.17:0/3331110170 learned_addr learned my addr 172.21.15.17:0/3331110170 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc731d9b700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7341003a0 0x7fc73419ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc732d9d700 1 -- 172.21.15.17:0/3331110170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7341003a0 msgr2=0x7fc73419ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc732d9d700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7341003a0 0x7fc73419ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc732d9d700 1 -- 172.21.15.17:0/3331110170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7340ff9f0 msgr2=0x7fc73419d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc732d9d700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7340ff9f0 0x7fc73419d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc732d9d700 1 -- 172.21.15.17:0/3331110170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc724009520 con 0x7fc734105a00 2023-07-14T13:16:42.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.575+0000 7fc732d9d700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc734105a00 0x7fc734197920 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00b070 tx=0x7fc72c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:42.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.576+0000 7fc7237fe700 1 -- 172.21.15.17:0/3331110170 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00e040 con 0x7fc734105a00 2023-07-14T13:16:42.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.576+0000 7fc73359e700 1 -- 172.21.15.17:0/3331110170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72c009d00 con 0x7fc734105a00 2023-07-14T13:16:42.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.576+0000 7fc7237fe700 1 -- 172.21.15.17:0/3331110170 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc72c009480 con 0x7fc734105a00 2023-07-14T13:16:42.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.576+0000 7fc7237fe700 1 -- 172.21.15.17:0/3331110170 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c005040 con 0x7fc734105a00 2023-07-14T13:16:42.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.576+0000 7fc73359e700 1 -- 172.21.15.17:0/3331110170 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc734198780 con 0x7fc734105a00 2023-07-14T13:16:42.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.580+0000 7fc7237fe700 1 -- 172.21.15.17:0/3331110170 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc72c01d480 con 0x7fc734105a00 2023-07-14T13:16:42.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.581+0000 7fc74c70cb80 1 Processor -- start 2023-07-14T13:16:42.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.581+0000 7fc74c70cb80 1 -- start start 2023-07-14T13:16:42.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.581+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b4910c4f0 0x558b4910c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.581+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b491167f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.581+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b49116d30 0x558b49119110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b49011cb0 con 0x558b4910c4f0 2023-07-14T13:16:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b49064a40 con 0x558b49116d30 2023-07-14T13:16:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b4905ded0 con 0x558b4910ce00 2023-07-14T13:16:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc731d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b4910c4f0 0x558b4910c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc731d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b4910c4f0 0x558b4910c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44270/0 (socket says 172.21.15.17:44270) 2023-07-14T13:16:42.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc731d9b700 1 -- 172.21.15.17:0/3426304200 learned_addr learned my addr 172.21.15.17:0/3426304200 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:42.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc7237fe700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc71c0a1360 0x7fc71c0a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc731d9b700 1 --2- 172.21.15.17:0/3426304200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b49116d30 0x558b49119110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc73259c700 1 --2- 172.21.15.17:0/3426304200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b491167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc7237fe700 1 -- 172.21.15.17:0/3331110170 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc72c0cdfc0 con 0x7fc734105a00 2023-07-14T13:16:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc732d9d700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc71c0a1360 0x7fc71c0a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc731d9b700 1 -- 172.21.15.17:0/3426304200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 msgr2=0x558b491167f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.582+0000 7fc731d9b700 1 --2- 172.21.15.17:0/3426304200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b491167f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.583+0000 7fc731d9b700 1 -- 172.21.15.17:0/3426304200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b49116d30 msgr2=0x558b49119110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.583+0000 7fc731d9b700 1 --2- 172.21.15.17:0/3426304200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b49116d30 0x558b49119110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.583+0000 7fc731d9b700 1 -- 172.21.15.17:0/3426304200 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b48e8bde0 con 0x558b4910c4f0 2023-07-14T13:16:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.583+0000 7fc731d9b700 1 --2- 172.21.15.17:0/3426304200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b4910c4f0 0x558b4910c8c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc7280138c0 tx=0x7fc728009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2352c64b94a017 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.583+0000 7fc720ff9700 1 -- 172.21.15.17:0/3426304200 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728013170 con 0x558b4910c4f0 2023-07-14T13:16:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.583+0000 7fc732d9d700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc71c0a1360 0x7fc71c0a3810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc72c007fd0 tx=0x7fc72c009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.583+0000 7fc720ff9700 1 -- 172.21.15.17:0/3426304200 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7280132d0 con 0x558b4910c4f0 2023-07-14T13:16:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.583+0000 7fc720ff9700 1 -- 172.21.15.17:0/3426304200 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7280054c0 con 0x558b4910c4f0 2023-07-14T13:16:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.584+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3426304200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b4910c4f0 msgr2=0x558b4910c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.584+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/3426304200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b4910c4f0 0x558b4910c8c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc7280138c0 tx=0x7fc728009260 comp rx=0 tx=0).stop 2023-07-14T13:16:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.584+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3426304200 shutdown_connections 2023-07-14T13:16:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.584+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/3426304200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b49116d30 0x558b49119110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.584+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/3426304200 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b4910c4f0 0x558b4910c8c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.584+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/3426304200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b491167f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.584+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3426304200 >> 172.21.15.17:0/3426304200 conn(0x558b49101ff0 msgr2=0x558b49107930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.584+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3426304200 shutdown_connections 2023-07-14T13:16:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.584+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3426304200 wait complete. 2023-07-14T13:16:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.585+0000 7fc74c70cb80 1 -- start start 2023-07-14T13:16:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.585+0000 7fc74c70cb80 1 Processor -- start 2023-07-14T13:16:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910c4f0 0x558b49116710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b49113920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b49113f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b48ffdac0 con 0x558b49116d30 2023-07-14T13:16:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b48ffd7c0 con 0x558b4910c4f0 2023-07-14T13:16:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b48ee1920 con 0x558b4910ce00 2023-07-14T13:16:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc74c70cb80 10 client.0 _ll_register_callbacks cb 0x558b48ffb760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc731d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910c4f0 0x558b49116710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc731d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b49113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc73259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b49113920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc73259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b49113920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58998/0 (socket says 172.21.15.17:58998) 2023-07-14T13:16:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.586+0000 7fc73259c700 1 -- 172.21.15.17:0/2054657123 learned_addr learned my addr 172.21.15.17:0/2054657123 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.587+0000 7fc73259c700 1 -- 172.21.15.17:0/2054657123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910c4f0 msgr2=0x558b49116710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.587+0000 7fc73259c700 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910c4f0 0x558b49116710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.587+0000 7fc73259c700 1 -- 172.21.15.17:0/2054657123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 msgr2=0x558b49113f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.587+0000 7fc73259c700 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b49113f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.587+0000 7fc73259c700 1 -- 172.21.15.17:0/2054657123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72801b040 con 0x558b4910ce00 2023-07-14T13:16:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.587+0000 7fc731d9b700 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b49113f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.587+0000 7fc73259c700 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b49113920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc724012a10 tx=0x7fc724012d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c915b4e33bd9d15e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.587+0000 7fc719ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:16:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.588+0000 7fc719ffb700 1 -- 172.21.15.17:0/2054657123 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724017070 con 0x558b4910ce00 2023-07-14T13:16:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.588+0000 7fc74c70cb80 1 -- 172.21.15.17:0/2054657123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b48fb74f0 con 0x558b4910ce00 2023-07-14T13:16:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.588+0000 7fc719ffb700 1 -- 172.21.15.17:0/2054657123 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc72400f7b0 con 0x558b4910ce00 2023-07-14T13:16:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.588+0000 7fc719ffb700 1 -- 172.21.15.17:0/2054657123 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7240122e0 con 0x558b4910ce00 2023-07-14T13:16:42.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.588+0000 7fc74c70cb80 10 client.28027 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.588+0000 7fc74c70cb80 1 -- 172.21.15.17:0/2054657123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x558b48e74c60 con 0x558b4910ce00 2023-07-14T13:16:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.588+0000 7fc719ffb700 1 -- 172.21.15.17:0/2054657123 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558b48fb74f0 con 0x558b4910ce00 2023-07-14T13:16:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.588+0000 7fc719ffb700 1 -- 172.21.15.17:0/2054657123 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc724010a90 con 0x558b4910ce00 2023-07-14T13:16:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.589+0000 7fc74c70cb80 10 client.28027 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.589+0000 7fc74c70cb80 10 client.28027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.589+0000 7fc74c70cb80 20 client.28027 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:42.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.589+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558b491266d0 0x558b49128ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.589+0000 7fc74c70cb80 4 client.28027 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.589+0000 7fc74c70cb80 1 -- 172.21.15.17:0/2054657123 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b49056eb0 con 0x558b491266d0 2023-07-14T13:16:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.589+0000 7fc731d9b700 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558b491266d0 0x558b49128ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.590+0000 7fc731d9b700 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558b491266d0 0x558b49128ae0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c7b1276b6069a44 server_cookie=6dcac06c7d14ddba in_seq=0 out_seq=0 2023-07-14T13:16:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.590+0000 7fc719ffb700 10 client.28027 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:42.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.590+0000 7fc719ffb700 1 -- 172.21.15.17:0/2054657123 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558b49056eb0 con 0x558b491266d0 2023-07-14T13:16:42.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.590+0000 7fc719ffb700 10 client.28027 handle_command_reply: tid=0 2023-07-14T13:16:42.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.590+0000 7fc74c70cb80 1 client.28027 shutdown 2023-07-14T13:16:42.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc74c70cb80 1 -- 172.21.15.17:0/2054657123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 msgr2=0x558b49113920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b49113920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc724012a10 tx=0x7fc724012d20 comp rx=0 tx=0).stop 2023-07-14T13:16:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc74c70cb80 1 -- 172.21.15.17:0/2054657123 shutdown_connections 2023-07-14T13:16:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558b491266d0 0x558b49128ae0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b49113f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910c4f0 0x558b49116710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/2054657123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b49113920 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc719ffb700 0 client.28027 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:42.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc74c70cb80 1 -- 172.21.15.17:0/2054657123 >> 172.21.15.17:0/2054657123 conn(0x558b49101ff0 msgr2=0x558b491074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc74c70cb80 1 -- 172.21.15.17:0/2054657123 shutdown_connections 2023-07-14T13:16:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc74c70cb80 1 -- 172.21.15.17:0/2054657123 wait complete. 2023-07-14T13:16:42.637 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.591+0000 7fc74c70cb80 20 client.28027 trim_cache size 0 max 16384 2023-07-14T13:16:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.613+0000 7fc74c70cb80 1 Processor -- start 2023-07-14T13:16:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.613+0000 7fc74c70cb80 1 -- start start 2023-07-14T13:16:42.653 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.613+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910c4f0 0x558b491130e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b49116240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b491138e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b4910d230 con 0x558b49116d30 2023-07-14T13:16:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b4910d980 con 0x558b4910c4f0 2023-07-14T13:16:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b4910df50 con 0x558b4910ce00 2023-07-14T13:16:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc731d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b491138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc731d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b491138e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44286/0 (socket says 172.21.15.17:44286) 2023-07-14T13:16:42.654 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc731d9b700 1 -- 172.21.15.17:0/1865479956 learned_addr learned my addr 172.21.15.17:0/1865479956 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:42.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc731d9b700 1 --2- 172.21.15.17:0/1865479956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910c4f0 0x558b491130e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc73259c700 1 --2- 172.21.15.17:0/1865479956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b49116240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc731d9b700 1 -- 172.21.15.17:0/1865479956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 msgr2=0x558b49116240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:42.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc731d9b700 1 --2- 172.21.15.17:0/1865479956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b49116240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc731d9b700 1 -- 172.21.15.17:0/1865479956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910c4f0 msgr2=0x558b491130e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:42.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.614+0000 7fc731d9b700 1 --2- 172.21.15.17:0/1865479956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910c4f0 0x558b491130e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.615+0000 7fc731d9b700 1 -- 172.21.15.17:0/1865479956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b48eb2250 con 0x558b49116d30 2023-07-14T13:16:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.615+0000 7fc731d9b700 1 --2- 172.21.15.17:0/1865479956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b491138e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x558b491293b0 tx=0x7fc728012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c611255c0726228 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.615+0000 7fc7217fa700 1 -- 172.21.15.17:0/1865479956 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728004a60 con 0x558b49116d30 2023-07-14T13:16:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.615+0000 7fc7217fa700 1 -- 172.21.15.17:0/1865479956 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc728004bc0 con 0x558b49116d30 2023-07-14T13:16:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.615+0000 7fc7217fa700 1 -- 172.21.15.17:0/1865479956 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728004320 con 0x558b49116d30 2023-07-14T13:16:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.616+0000 7fc74c70cb80 1 -- 172.21.15.17:0/1865479956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 msgr2=0x558b491138e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.616+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/1865479956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b491138e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x558b491293b0 tx=0x7fc728012040 comp rx=0 tx=0).stop 2023-07-14T13:16:42.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.616+0000 7fc74c70cb80 1 -- 172.21.15.17:0/1865479956 shutdown_connections 2023-07-14T13:16:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.616+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/1865479956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b491138e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.616+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/1865479956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910c4f0 0x558b491130e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.616+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/1865479956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910ce00 0x558b49116240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.616+0000 7fc74c70cb80 1 -- 172.21.15.17:0/1865479956 >> 172.21.15.17:0/1865479956 conn(0x558b49101ff0 msgr2=0x558b49122980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.616+0000 7fc74c70cb80 1 -- 172.21.15.17:0/1865479956 shutdown_connections 2023-07-14T13:16:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.616+0000 7fc74c70cb80 1 -- 172.21.15.17:0/1865479956 wait complete. 2023-07-14T13:16:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.616+0000 7fc74c70cb80 1 -- start start 2023-07-14T13:16:42.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.617+0000 7fc74c70cb80 1 Processor -- start 2023-07-14T13:16:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.617+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910c4f0 0x558b4911d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.617+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910ce00 0x558b4911b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.617+0000 7fc74c70cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b4911bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.617+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b4911c4c0 con 0x558b49116d30 2023-07-14T13:16:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.617+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b4911c600 con 0x558b4910ce00 2023-07-14T13:16:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.617+0000 7fc74c70cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b4911c7c0 con 0x558b4910c4f0 2023-07-14T13:16:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.617+0000 7fc74c70cb80 10 client.0 _ll_register_callbacks cb 0x7fc7240124e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc731d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b4911bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc731d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910c4f0 0x558b4911d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc73259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910ce00 0x558b4911b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc731d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910c4f0 0x558b4911d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59014/0 (socket says 172.21.15.17:59014) 2023-07-14T13:16:42.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc731d9b700 1 -- 172.21.15.17:0/3534120692 learned_addr learned my addr 172.21.15.17:0/3534120692 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:42.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc731d9b700 1 -- 172.21.15.17:0/3534120692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910ce00 msgr2=0x558b4911b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:42.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc731d9b700 1 --2- 172.21.15.17:0/3534120692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910ce00 0x558b4911b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc731d9b700 1 -- 172.21.15.17:0/3534120692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 msgr2=0x558b4911bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:42.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc731d9b700 1 --2- 172.21.15.17:0/3534120692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b4911bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc731d9b700 1 -- 172.21.15.17:0/3534120692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc728029040 con 0x558b4910c4f0 2023-07-14T13:16:42.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc731d9b700 1 --2- 172.21.15.17:0/3534120692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910c4f0 0x558b4911d6f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc728005e90 tx=0x7fc728013690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43a22000833ecd9e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:42.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.618+0000 7fc719ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:16:42.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.619+0000 7fc719ffb700 1 -- 172.21.15.17:0/3534120692 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728031530 con 0x558b4910c4f0 2023-07-14T13:16:42.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.619+0000 7fc719ffb700 1 -- 172.21.15.17:0/3534120692 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc728031a10 con 0x558b4910c4f0 2023-07-14T13:16:42.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.619+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3534120692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7280132d0 con 0x558b4910c4f0 2023-07-14T13:16:42.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.619+0000 7fc719ffb700 1 -- 172.21.15.17:0/3534120692 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc728031bd0 con 0x558b4910c4f0 2023-07-14T13:16:42.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.619+0000 7fc74c70cb80 10 client.28033 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:42.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.619+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3534120692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x558b48e8a2b0 con 0x558b4910c4f0 2023-07-14T13:16:42.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.619+0000 7fc719ffb700 1 -- 172.21.15.17:0/3534120692 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc728043080 con 0x558b4910c4f0 2023-07-14T13:16:42.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.620+0000 7fc719ffb700 1 -- 172.21.15.17:0/3534120692 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc7280204f0 con 0x558b4910c4f0 2023-07-14T13:16:42.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.620+0000 7fc74c70cb80 10 client.28033 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:42.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.620+0000 7fc74c70cb80 10 client.28033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:42.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.620+0000 7fc74c70cb80 20 client.28033 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:42.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.620+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/3534120692 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558b4917b620 0x558b4917da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.620+0000 7fc74c70cb80 4 client.28033 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:16:42.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.620+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3534120692 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558b49019050 con 0x558b4917b620 2023-07-14T13:16:42.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.620+0000 7fc73259c700 1 --2- 172.21.15.17:0/3534120692 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558b4917b620 0x558b4917da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc73259c700 1 --2- 172.21.15.17:0/3534120692 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558b4917b620 0x558b4917da00 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4db58fb6df078635 server_cookie=cc764e862464a6f3 in_seq=0 out_seq=0 2023-07-14T13:16:42.665 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc719ffb700 10 client.28033 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:42.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc719ffb700 1 -- 172.21.15.17:0/3534120692 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558b49019050 con 0x558b4917b620 2023-07-14T13:16:42.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc719ffb700 10 client.28033 handle_command_reply: tid=0 2023-07-14T13:16:42.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc74c70cb80 1 client.28033 shutdown 2023-07-14T13:16:42.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3534120692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910c4f0 msgr2=0x558b4911d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/3534120692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910c4f0 0x558b4911d6f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc728005e90 tx=0x7fc728013690 comp rx=0 tx=0).stop 2023-07-14T13:16:42.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3534120692 shutdown_connections 2023-07-14T13:16:42.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/3534120692 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558b4917b620 0x558b4917da00 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/3534120692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558b49116d30 0x558b4911bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/3534120692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b4910c4f0 0x558b4911d6f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc719ffb700 0 client.28033 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:42.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc74c70cb80 1 --2- 172.21.15.17:0/3534120692 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558b4910ce00 0x558b4911b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.621+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3534120692 >> 172.21.15.17:0/3534120692 conn(0x558b49101ff0 msgr2=0x558b4910b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:42.667 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.622+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3534120692 shutdown_connections 2023-07-14T13:16:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.622+0000 7fc74c70cb80 1 -- 172.21.15.17:0/3534120692 wait complete. 2023-07-14T13:16:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.622+0000 7fc74c70cb80 20 client.28033 trim_cache size 0 max 16384 2023-07-14T13:16:42.668 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:16:42.668 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:16:42.668 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:16:42.668 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:16:42.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.622+0000 7fc73359e700 1 -- 172.21.15.17:0/3331110170 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc71c0a1360 msgr2=0x7fc71c0a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.622+0000 7fc73359e700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc71c0a1360 0x7fc71c0a3810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc72c007fd0 tx=0x7fc72c009040 comp rx=0 tx=0).stop 2023-07-14T13:16:42.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.622+0000 7fc73359e700 1 -- 172.21.15.17:0/3331110170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc734105a00 msgr2=0x7fc734197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.669 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.622+0000 7fc73359e700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc734105a00 0x7fc734197920 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00b070 tx=0x7fc72c00bce0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.623+0000 7fc73359e700 1 -- 172.21.15.17:0/3331110170 shutdown_connections 2023-07-14T13:16:42.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.623+0000 7fc73359e700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc71c0a1360 0x7fc71c0a3810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.623+0000 7fc73359e700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc734105a00 0x7fc734197920 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.623+0000 7fc73359e700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7340ff9f0 0x7fc73419d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.623+0000 7fc73359e700 1 --2- 172.21.15.17:0/3331110170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7341003a0 0x7fc73419ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.623+0000 7fc73359e700 1 -- 172.21.15.17:0/3331110170 >> 172.21.15.17:0/3331110170 conn(0x7fc7340fb510 msgr2=0x7fc734072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:42.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.623+0000 7fc73359e700 1 -- 172.21.15.17:0/3331110170 shutdown_connections 2023-07-14T13:16:42.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.623+0000 7fc73359e700 1 -- 172.21.15.17:0/3331110170 wait complete. 2023-07-14T13:16:42.681 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:16:42.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:16:42.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.853+0000 7f25203ff700 1 -- 172.21.15.17:0/1832517285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25180ffad0 msgr2=0x7f25180fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.853+0000 7f25203ff700 1 --2- 172.21.15.17:0/1832517285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25180ffad0 0x7f25180fff40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f2508009990 tx=0x7f2508009ca0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.853+0000 7f25203ff700 1 -- 172.21.15.17:0/1832517285 shutdown_connections 2023-07-14T13:16:42.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.853+0000 7f25203ff700 1 --2- 172.21.15.17:0/1832517285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518100480 0x7f251810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.853+0000 7f25203ff700 1 --2- 172.21.15.17:0/1832517285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2518105ae0 0x7f2518105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.853+0000 7f25203ff700 1 --2- 172.21.15.17:0/1832517285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25180ffad0 0x7f25180fff40 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.853+0000 7f25203ff700 1 -- 172.21.15.17:0/1832517285 >> 172.21.15.17:0/1832517285 conn(0x7f25180fb590 msgr2=0x7f25180fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:42.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.853+0000 7f25203ff700 1 -- 172.21.15.17:0/1832517285 shutdown_connections 2023-07-14T13:16:42.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.853+0000 7f25203ff700 1 -- 172.21.15.17:0/1832517285 wait complete. 2023-07-14T13:16:42.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.854+0000 7f25203ff700 1 Processor -- start 2023-07-14T13:16:42.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.855+0000 7f25203ff700 1 -- start start 2023-07-14T13:16:42.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.855+0000 7f25203ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25180ffad0 0x7f251819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.855+0000 7f25203ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2518100480 0x7f251819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.855+0000 7f25203ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518105ae0 0x7f2518195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.855+0000 7f25203ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2518195fb0 con 0x7f25180ffad0 2023-07-14T13:16:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.855+0000 7f25203ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2518196120 con 0x7f2518100480 2023-07-14T13:16:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.855+0000 7f25203ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25181962e0 con 0x7f2518105ae0 2023-07-14T13:16:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.855+0000 7f251e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25180ffad0 0x7f251819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.855+0000 7f251e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25180ffad0 0x7f251819b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44312/0 (socket says 172.21.15.17:44312) 2023-07-14T13:16:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.855+0000 7f251e19b700 1 -- 172.21.15.17:0/9318602 learned_addr learned my addr 172.21.15.17:0/9318602 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:42.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.856+0000 7f251d99a700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2518100480 0x7f251819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.856+0000 7f251e99c700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518105ae0 0x7f2518195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.856+0000 7f251e19b700 1 -- 172.21.15.17:0/9318602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518105ae0 msgr2=0x7f2518195940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.856+0000 7f251e19b700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518105ae0 0x7f2518195940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.856+0000 7f251e19b700 1 -- 172.21.15.17:0/9318602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2518100480 msgr2=0x7f251819be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.856+0000 7f251e19b700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2518100480 0x7f251819be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.856+0000 7f251e19b700 1 -- 172.21.15.17:0/9318602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25080095f0 con 0x7f25180ffad0 2023-07-14T13:16:42.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.856+0000 7f251e19b700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25180ffad0 0x7f251819b8d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f251400d980 tx=0x7f251400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:42.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.856+0000 7f250f7fe700 1 -- 172.21.15.17:0/9318602 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514004220 con 0x7f25180ffad0 2023-07-14T13:16:42.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.856+0000 7f25203ff700 1 -- 172.21.15.17:0/9318602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25181965c0 con 0x7f25180ffad0 2023-07-14T13:16:42.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.856+0000 7f250f7fe700 1 -- 172.21.15.17:0/9318602 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2514007640 con 0x7f25180ffad0 2023-07-14T13:16:42.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.857+0000 7f250f7fe700 1 -- 172.21.15.17:0/9318602 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514005660 con 0x7f25180ffad0 2023-07-14T13:16:42.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.857+0000 7f25203ff700 1 -- 172.21.15.17:0/9318602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25181a28c0 con 0x7f25180ffad0 2023-07-14T13:16:42.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.858+0000 7f25203ff700 1 -- 172.21.15.17:0/9318602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2518067300 con 0x7f25180ffad0 2023-07-14T13:16:42.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.860+0000 7f250f7fe700 1 -- 172.21.15.17:0/9318602 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2514004750 con 0x7f25180ffad0 2023-07-14T13:16:42.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.861+0000 7f250f7fe700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f25040a1300 0x7f25040a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:42.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.861+0000 7f250f7fe700 1 -- 172.21.15.17:0/9318602 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f25140cc9c0 con 0x7f25180ffad0 2023-07-14T13:16:42.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.861+0000 7f251d99a700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f25040a1300 0x7f25040a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:42.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.862+0000 7f251d99a700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f25040a1300 0x7f25040a37b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f25181051b0 tx=0x7f250800b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:42.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:42.869+0000 7f250f7fe700 1 -- 172.21.15.17:0/9318602 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2514095df0 con 0x7f25180ffad0 2023-07-14T13:16:43.193 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.153+0000 7f25203ff700 1 -- 172.21.15.17:0/9318602 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2518196e50 con 0x7f25180ffad0 2023-07-14T13:16:43.194 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.154+0000 7f250f7fe700 1 -- 172.21.15.17:0/9318602 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+10848 (secure 0 0 0) 0x7f2518196e50 con 0x7f25180ffad0 2023-07-14T13:16:43.194 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:16:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":45,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:16:29.180977+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:16:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 -- 172.21.15.17:0/9318602 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f25040a1300 msgr2=0x7f25040a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f25040a1300 0x7f25040a37b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f25181051b0 tx=0x7f250800b260 comp rx=0 tx=0).stop 2023-07-14T13:16:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 -- 172.21.15.17:0/9318602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25180ffad0 msgr2=0x7f251819b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25180ffad0 0x7f251819b8d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f251400d980 tx=0x7f251400dc90 comp rx=0 tx=0).stop 2023-07-14T13:16:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 -- 172.21.15.17:0/9318602 shutdown_connections 2023-07-14T13:16:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f25040a1300 0x7f25040a37b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2518105ae0 0x7f2518195940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25180ffad0 0x7f251819b8d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 --2- 172.21.15.17:0/9318602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2518100480 0x7f251819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 -- 172.21.15.17:0/9318602 >> 172.21.15.17:0/9318602 conn(0x7f25180fb590 msgr2=0x7f25180fbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 -- 172.21.15.17:0/9318602 shutdown_connections 2023-07-14T13:16:43.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.157+0000 7f25203ff700 1 -- 172.21.15.17:0/9318602 wait complete. 2023-07-14T13:16:43.198 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 45 2023-07-14T13:16:43.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:16:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.425+0000 7fdaad59d700 1 -- 172.21.15.17:0/4243731271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa8109fc0 msgr2=0x7fdaa810c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.425+0000 7fdaad59d700 1 --2- 172.21.15.17:0/4243731271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa8109fc0 0x7fdaa810c3e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000b0a0 tx=0x7fdaa000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.425+0000 7fdaad59d700 1 -- 172.21.15.17:0/4243731271 shutdown_connections 2023-07-14T13:16:43.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.425+0000 7fdaad59d700 1 --2- 172.21.15.17:0/4243731271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa8109fc0 0x7fdaa810c3e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.425+0000 7fdaad59d700 1 --2- 172.21.15.17:0/4243731271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa8100aa0 0x7fdaa8100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.425+0000 7fdaad59d700 1 --2- 172.21.15.17:0/4243731271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaa81013b0 0x7fdaa8109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.425+0000 7fdaad59d700 1 -- 172.21.15.17:0/4243731271 >> 172.21.15.17:0/4243731271 conn(0x7fdaa80745d0 msgr2=0x7fdaa80749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.425+0000 7fdaad59d700 1 -- 172.21.15.17:0/4243731271 shutdown_connections 2023-07-14T13:16:43.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.425+0000 7fdaad59d700 1 -- 172.21.15.17:0/4243731271 wait complete. 2023-07-14T13:16:43.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.426+0000 7fdaad59d700 1 Processor -- start 2023-07-14T13:16:43.468 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.426+0000 7fdaad59d700 1 -- start start 2023-07-14T13:16:43.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.427+0000 7fdaad59d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaa8100aa0 0x7fdaa80fe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.427+0000 7fdaad59d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa81013b0 0x7fdaa80fee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.427+0000 7fdaad59d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa8109fc0 0x7fdaa81a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.427+0000 7fdaad59d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80ff640 con 0x7fdaa81013b0 2023-07-14T13:16:43.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.427+0000 7fdaad59d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa81a40a0 con 0x7fdaa8109fc0 2023-07-14T13:16:43.469 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.427+0000 7fdaad59d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa81a41e0 con 0x7fdaa8100aa0 2023-07-14T13:16:43.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.427+0000 7fdaa77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa81013b0 0x7fdaa80fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.427+0000 7fdaa77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa81013b0 0x7fdaa80fee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44324/0 (socket says 172.21.15.17:44324) 2023-07-14T13:16:43.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.427+0000 7fdaa77fe700 1 -- 172.21.15.17:0/2718347094 learned_addr learned my addr 172.21.15.17:0/2718347094 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:43.470 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.427+0000 7fdaa7fff700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaa8100aa0 0x7fdaa80fe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.427+0000 7fdaacd9c700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa8109fc0 0x7fdaa81a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.428+0000 7fdaa77fe700 1 -- 172.21.15.17:0/2718347094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaa8100aa0 msgr2=0x7fdaa80fe8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.428+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaa8100aa0 0x7fdaa80fe8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.428+0000 7fdaa77fe700 1 -- 172.21.15.17:0/2718347094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa8109fc0 msgr2=0x7fdaa81a3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.471 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.428+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa8109fc0 0x7fdaa81a3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.428+0000 7fdaa77fe700 1 -- 172.21.15.17:0/2718347094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa0009d00 con 0x7fdaa81013b0 2023-07-14T13:16:43.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.428+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa81013b0 0x7fdaa80fee10 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00e9a0 tx=0x7fda9c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.428+0000 7fdaa57fa700 1 -- 172.21.15.17:0/2718347094 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c009790 con 0x7fdaa81013b0 2023-07-14T13:16:43.472 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.428+0000 7fdaa57fa700 1 -- 172.21.15.17:0/2718347094 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda9c010430 con 0x7fdaa81013b0 2023-07-14T13:16:43.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.428+0000 7fdaad59d700 1 -- 172.21.15.17:0/2718347094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa81a4440 con 0x7fdaa81013b0 2023-07-14T13:16:43.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.428+0000 7fdaa57fa700 1 -- 172.21.15.17:0/2718347094 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c00cea0 con 0x7fdaa81013b0 2023-07-14T13:16:43.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.429+0000 7fdaad59d700 1 -- 172.21.15.17:0/2718347094 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa81a4970 con 0x7fdaa81013b0 2023-07-14T13:16:43.473 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.433+0000 7fdaa57fa700 1 -- 172.21.15.17:0/2718347094 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fda9c0105a0 con 0x7fdaa81013b0 2023-07-14T13:16:43.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.435+0000 7fdac2071b80 1 Processor -- start 2023-07-14T13:16:43.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.435+0000 7fdac2071b80 1 -- start start 2023-07-14T13:16:43.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.435+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.435+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4b1e00 0x55569d4bb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.435+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4bbd30 0x55569d4be110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.435+0000 7fdac2071b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d3b6cb0 con 0x55569d4bbd30 2023-07-14T13:16:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.435+0000 7fdac2071b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d409a40 con 0x55569d4b14f0 2023-07-14T13:16:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.435+0000 7fdac2071b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d402ed0 con 0x55569d4b1e00 2023-07-14T13:16:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.435+0000 7fdaa57fa700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fda900a13e0 0x7fda900a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaa57fa700 1 -- 172.21.15.17:0/2718347094 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fda9c014070 con 0x7fdaa81013b0 2023-07-14T13:16:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaa77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4bbd30 0x55569d4be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaa77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4bbd30 0x55569d4be110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44336/0 (socket says 172.21.15.17:44336) 2023-07-14T13:16:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaa77fe700 1 -- 172.21.15.17:0/4190689639 learned_addr learned my addr 172.21.15.17:0/4190689639 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaacd9c700 1 --2- 172.21.15.17:0/4190689639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaacd9c700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fda900a13e0 0x7fda900a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaa7fff700 1 --2- 172.21.15.17:0/4190689639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4b1e00 0x55569d4bb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaa77fe700 1 -- 172.21.15.17:0/4190689639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4b1e00 msgr2=0x55569d4bb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/4190689639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4b1e00 0x55569d4bb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaa77fe700 1 -- 172.21.15.17:0/4190689639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 msgr2=0x55569d4b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/4190689639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.436+0000 7fdaa77fe700 1 -- 172.21.15.17:0/4190689639 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55569d230de0 con 0x55569d4bbd30 2023-07-14T13:16:43.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.437+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/4190689639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4bbd30 0x55569d4be110 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00e970 tx=0x7fda9c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdf7cb1336b5fc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.437+0000 7fdaacd9c700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fda900a13e0 0x7fda900a3890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000b780 tx=0x7fdaa0006210 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.437+0000 7fda8e7fc700 1 -- 172.21.15.17:0/4190689639 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c025170 con 0x55569d4bbd30 2023-07-14T13:16:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.437+0000 7fda8e7fc700 1 -- 172.21.15.17:0/4190689639 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda9c010880 con 0x55569d4bbd30 2023-07-14T13:16:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.437+0000 7fda8e7fc700 1 -- 172.21.15.17:0/4190689639 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0caa20 con 0x55569d4bbd30 2023-07-14T13:16:43.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.438+0000 7fdac2071b80 1 -- 172.21.15.17:0/4190689639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4bbd30 msgr2=0x55569d4be110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.438+0000 7fdac2071b80 1 --2- 172.21.15.17:0/4190689639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4bbd30 0x55569d4be110 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00e970 tx=0x7fda9c007ef0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.438+0000 7fdac2071b80 1 -- 172.21.15.17:0/4190689639 shutdown_connections 2023-07-14T13:16:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.438+0000 7fdac2071b80 1 --2- 172.21.15.17:0/4190689639 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4bbd30 0x55569d4be110 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.438+0000 7fdac2071b80 1 --2- 172.21.15.17:0/4190689639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.438+0000 7fdac2071b80 1 --2- 172.21.15.17:0/4190689639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4b1e00 0x55569d4bb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.438+0000 7fdac2071b80 1 -- 172.21.15.17:0/4190689639 >> 172.21.15.17:0/4190689639 conn(0x55569d4a6ff0 msgr2=0x55569d4ac930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.438+0000 7fdac2071b80 1 -- 172.21.15.17:0/4190689639 shutdown_connections 2023-07-14T13:16:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.438+0000 7fdac2071b80 1 -- 172.21.15.17:0/4190689639 wait complete. 2023-07-14T13:16:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.438+0000 7fdac2071b80 1 -- start start 2023-07-14T13:16:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.439+0000 7fdac2071b80 1 Processor -- start 2023-07-14T13:16:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.439+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4bb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.439+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4b8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.439+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4bbd30 0x55569d4b90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.439+0000 7fdac2071b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d3a2ac0 con 0x55569d4b1e00 2023-07-14T13:16:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.439+0000 7fdac2071b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d3a27c0 con 0x55569d4b14f0 2023-07-14T13:16:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.439+0000 7fdac2071b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d286920 con 0x55569d4bbd30 2023-07-14T13:16:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.439+0000 7fdac2071b80 10 client.0 _ll_register_callbacks cb 0x55569d3a0760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaa77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaa77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4b8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44344/0 (socket says 172.21.15.17:44344) 2023-07-14T13:16:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaa77fe700 1 -- 172.21.15.17:0/1731510336 learned_addr learned my addr 172.21.15.17:0/1731510336 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaacd9c700 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4bbd30 0x55569d4b90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaa7fff700 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4bb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaa77fe700 1 -- 172.21.15.17:0/1731510336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4bbd30 msgr2=0x55569d4b90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4bbd30 0x55569d4b90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaa77fe700 1 -- 172.21.15.17:0/1731510336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 msgr2=0x55569d4bb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4bb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaa77fe700 1 -- 172.21.15.17:0/1731510336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa81a4970 con 0x55569d4b1e00 2023-07-14T13:16:43.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaa7fff700 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4bb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:16:43.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.440+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4b8990 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0a1e00 tx=0x7fda9c010bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958bddc04cea0016 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.490 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.441+0000 7fda877fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.441+0000 7fda877fe700 1 -- 172.21.15.17:0/1731510336 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c099ee0 con 0x55569d4b1e00 2023-07-14T13:16:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.441+0000 7fdac2071b80 1 -- 172.21.15.17:0/1731510336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55569d35c4f0 con 0x55569d4b1e00 2023-07-14T13:16:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.441+0000 7fda877fe700 1 -- 172.21.15.17:0/1731510336 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fda9c09df10 con 0x55569d4b1e00 2023-07-14T13:16:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.441+0000 7fda877fe700 1 -- 172.21.15.17:0/1731510336 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda9c09a350 con 0x55569d4b1e00 2023-07-14T13:16:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.441+0000 7fdac2071b80 10 client.18375 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.441+0000 7fdac2071b80 1 -- 172.21.15.17:0/1731510336 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55569d219c60 con 0x55569d4b1e00 2023-07-14T13:16:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.441+0000 7fda877fe700 1 -- 172.21.15.17:0/1731510336 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55569d35c4f0 con 0x55569d4b1e00 2023-07-14T13:16:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.441+0000 7fda877fe700 1 -- 172.21.15.17:0/1731510336 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fda9c076410 con 0x55569d4b1e00 2023-07-14T13:16:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.442+0000 7fdac2071b80 10 client.18375 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.442+0000 7fdac2071b80 10 client.18375 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:16:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.442+0000 7fdac2071b80 20 client.18375 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.442+0000 7fdac2071b80 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55569d4cb330 0x55569d4cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.442+0000 7fdac2071b80 4 client.18375 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.442+0000 7fdac2071b80 1 -- 172.21.15.17:0/1731510336 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55569d3fbeb0 con 0x55569d4cb330 2023-07-14T13:16:43.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.442+0000 7fdaa7fff700 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55569d4cb330 0x55569d4cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.443+0000 7fdaa7fff700 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55569d4cb330 0x55569d4cd740 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b22a7d753e7e2869 server_cookie=827d780a6cb42248 in_seq=0 out_seq=0 2023-07-14T13:16:43.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.443+0000 7fda877fe700 10 client.18375 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:16:43.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fda877fe700 1 -- 172.21.15.17:0/1731510336 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55569d3fbeb0 con 0x55569d4cb330 2023-07-14T13:16:43.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fda877fe700 10 client.18375 handle_command_reply: tid=0 2023-07-14T13:16:43.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fdac2071b80 1 client.18375 shutdown 2023-07-14T13:16:43.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fdac2071b80 1 -- 172.21.15.17:0/1731510336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 msgr2=0x55569d4b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fdac2071b80 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4b8990 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0a1e00 tx=0x7fda9c010bf0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fdac2071b80 1 -- 172.21.15.17:0/1731510336 shutdown_connections 2023-07-14T13:16:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fdac2071b80 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55569d4cb330 0x55569d4cd740 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fdac2071b80 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4bbd30 0x55569d4b90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fdac2071b80 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4bb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fda877fe700 0 client.18375 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:16:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fdac2071b80 1 --2- 172.21.15.17:0/1731510336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4b8990 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fdac2071b80 1 -- 172.21.15.17:0/1731510336 >> 172.21.15.17:0/1731510336 conn(0x55569d4a6ff0 msgr2=0x55569d4ac520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fdac2071b80 1 -- 172.21.15.17:0/1731510336 shutdown_connections 2023-07-14T13:16:43.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.444+0000 7fdac2071b80 1 -- 172.21.15.17:0/1731510336 wait complete. 2023-07-14T13:16:43.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.445+0000 7fdac2071b80 20 client.18375 trim_cache size 0 max 16384 2023-07-14T13:16:43.505 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.466+0000 7fdac2071b80 1 Processor -- start 2023-07-14T13:16:43.506 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.466+0000 7fdac2071b80 1 -- start start 2023-07-14T13:16:43.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:43 smithi131 ceph-mon[96953]: pgmap v534: 97 pgs: 97 active+clean; 15 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 MiB/s wr, 13 op/s 2023-07-14T13:16:43.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:43 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/9318602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:16:43.507 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.466+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4b14f0 0x55569d4cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4bbd30 0x55569d4c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdac2071b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d4b31a0 con 0x55569d4b1e00 2023-07-14T13:16:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdac2071b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d4adef0 con 0x55569d4bbd30 2023-07-14T13:16:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdac2071b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d4c2d50 con 0x55569d4b14f0 2023-07-14T13:16:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdaa77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdaa77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44360/0 (socket says 172.21.15.17:44360) 2023-07-14T13:16:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdaa77fe700 1 -- 172.21.15.17:0/12136940 learned_addr learned my addr 172.21.15.17:0/12136940 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdaa7fff700 1 --2- 172.21.15.17:0/12136940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4b14f0 0x55569d4cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdaacd9c700 1 --2- 172.21.15.17:0/12136940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4bbd30 0x55569d4c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdaa77fe700 1 -- 172.21.15.17:0/12136940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4b14f0 msgr2=0x55569d4cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/12136940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4b14f0 0x55569d4cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdaa77fe700 1 -- 172.21.15.17:0/12136940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4bbd30 msgr2=0x55569d4c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.509 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/12136940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4bbd30 0x55569d4c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.467+0000 7fdaa77fe700 1 -- 172.21.15.17:0/12136940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55569d257250 con 0x55569d4b1e00 2023-07-14T13:16:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.468+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/12136940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c2810 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fda9c096950 tx=0x7fda9c00c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e06c58b65249c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.468+0000 7fda8effd700 1 -- 172.21.15.17:0/12136940 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c09df10 con 0x55569d4b1e00 2023-07-14T13:16:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.468+0000 7fda8effd700 1 -- 172.21.15.17:0/12136940 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda9c099ee0 con 0x55569d4b1e00 2023-07-14T13:16:43.510 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.468+0000 7fda8effd700 1 -- 172.21.15.17:0/12136940 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c076580 con 0x55569d4b1e00 2023-07-14T13:16:43.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.469+0000 7fdac2071b80 1 -- 172.21.15.17:0/12136940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 msgr2=0x55569d4c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.469+0000 7fdac2071b80 1 --2- 172.21.15.17:0/12136940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c2810 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fda9c096950 tx=0x7fda9c00c480 comp rx=0 tx=0).stop 2023-07-14T13:16:43.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.469+0000 7fdac2071b80 1 -- 172.21.15.17:0/12136940 shutdown_connections 2023-07-14T13:16:43.512 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.469+0000 7fdac2071b80 1 --2- 172.21.15.17:0/12136940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4bbd30 0x55569d4c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.469+0000 7fdac2071b80 1 --2- 172.21.15.17:0/12136940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4b14f0 0x55569d4cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.469+0000 7fdac2071b80 1 --2- 172.21.15.17:0/12136940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c2810 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.469+0000 7fdac2071b80 1 -- 172.21.15.17:0/12136940 >> 172.21.15.17:0/12136940 conn(0x55569d4a6ff0 msgr2=0x55569d4d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.469+0000 7fdac2071b80 1 -- 172.21.15.17:0/12136940 shutdown_connections 2023-07-14T13:16:43.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.469+0000 7fdac2071b80 1 -- 172.21.15.17:0/12136940 wait complete. 2023-07-14T13:16:43.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.469+0000 7fdac2071b80 1 -- start start 2023-07-14T13:16:43.513 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.470+0000 7fdac2071b80 1 Processor -- start 2023-07-14T13:16:43.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.470+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.470+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.470+0000 7fdac2071b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4bbd30 0x55569d51e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.470+0000 7fdac2071b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d4c1510 con 0x55569d4b1e00 2023-07-14T13:16:43.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.470+0000 7fdac2071b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d4c1680 con 0x55569d4b14f0 2023-07-14T13:16:43.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.470+0000 7fdac2071b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55569d51e780 con 0x55569d4bbd30 2023-07-14T13:16:43.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.470+0000 7fdac2071b80 10 client.0 _ll_register_callbacks cb 0x7fdaa0009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:43.514 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fdaa77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fdaa77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44362/0 (socket says 172.21.15.17:44362) 2023-07-14T13:16:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fdaa77fe700 1 -- 172.21.15.17:0/4038745174 learned_addr learned my addr 172.21.15.17:0/4038745174 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fdaacd9c700 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4bbd30 0x55569d51e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fdaa7fff700 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fdaa77fe700 1 -- 172.21.15.17:0/4038745174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4bbd30 msgr2=0x55569d51e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4bbd30 0x55569d51e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fdaa77fe700 1 -- 172.21.15.17:0/4038745174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 msgr2=0x55569d4c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.515 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fdaa77fe700 1 -- 172.21.15.17:0/4038745174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55569d219c60 con 0x55569d4b1e00 2023-07-14T13:16:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fdaa77fe700 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c0d30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0963e0 tx=0x7fda9c0adf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379a9605ad752c12 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.471+0000 7fda877fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fda877fe700 1 -- 172.21.15.17:0/4038745174 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c09df90 con 0x55569d4b1e00 2023-07-14T13:16:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fda877fe700 1 -- 172.21.15.17:0/4038745174 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fda9c0a2330 con 0x55569d4b1e00 2023-07-14T13:16:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fdac2071b80 1 -- 172.21.15.17:0/4038745174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda9c010880 con 0x55569d4b1e00 2023-07-14T13:16:43.516 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fda877fe700 1 -- 172.21.15.17:0/4038745174 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda9c0ca240 con 0x55569d4b1e00 2023-07-14T13:16:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fdac2071b80 10 client.18381 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fdac2071b80 1 -- 172.21.15.17:0/4038745174 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55569d22f2b0 con 0x55569d4b1e00 2023-07-14T13:16:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fda877fe700 1 -- 172.21.15.17:0/4038745174 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda9c010880 con 0x55569d4b1e00 2023-07-14T13:16:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fda877fe700 1 -- 172.21.15.17:0/4038745174 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fda9c095df0 con 0x55569d4b1e00 2023-07-14T13:16:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fdac2071b80 10 client.18381 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fdac2071b80 10 client.18381 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:16:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fdac2071b80 20 client.18381 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:43.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.472+0000 7fdac2071b80 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55569d51f9d0 0x55569d521db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.473+0000 7fdac2071b80 4 client.18381 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:16:43.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.473+0000 7fdac2071b80 1 -- 172.21.15.17:0/4038745174 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55569d3be050 con 0x55569d51f9d0 2023-07-14T13:16:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.473+0000 7fdaa7fff700 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55569d51f9d0 0x55569d521db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdaa7fff700 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55569d51f9d0 0x55569d521db0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1283b00d3d28210c server_cookie=2d43af12b827c493 in_seq=0 out_seq=0 2023-07-14T13:16:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fda877fe700 10 client.18381 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:16:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fda877fe700 1 -- 172.21.15.17:0/4038745174 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55569d3be050 con 0x55569d51f9d0 2023-07-14T13:16:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fda877fe700 10 client.18381 handle_command_reply: tid=0 2023-07-14T13:16:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdac2071b80 1 client.18381 shutdown 2023-07-14T13:16:43.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdac2071b80 1 -- 172.21.15.17:0/4038745174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 msgr2=0x55569d4c0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdac2071b80 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c0d30 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0963e0 tx=0x7fda9c0adf70 comp rx=0 tx=0).stop 2023-07-14T13:16:43.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdac2071b80 1 -- 172.21.15.17:0/4038745174 shutdown_connections 2023-07-14T13:16:43.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdac2071b80 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55569d51f9d0 0x55569d521db0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdac2071b80 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55569d4bbd30 0x55569d51e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdac2071b80 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55569d4b14f0 0x55569d4c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdac2071b80 1 --2- 172.21.15.17:0/4038745174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55569d4b1e00 0x55569d4c0d30 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fda877fe700 0 client.18381 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:16:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdac2071b80 1 -- 172.21.15.17:0/4038745174 >> 172.21.15.17:0/4038745174 conn(0x55569d4a6ff0 msgr2=0x55569d4b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdac2071b80 1 -- 172.21.15.17:0/4038745174 shutdown_connections 2023-07-14T13:16:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.474+0000 7fdac2071b80 1 -- 172.21.15.17:0/4038745174 wait complete. 2023-07-14T13:16:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdac2071b80 20 client.18381 trim_cache size 0 max 16384 2023-07-14T13:16:43.521 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:16:43.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdaad59d700 1 -- 172.21.15.17:0/2718347094 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fda900a13e0 msgr2=0x7fda900a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdaad59d700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fda900a13e0 0x7fda900a3890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000b780 tx=0x7fdaa0006210 comp rx=0 tx=0).stop 2023-07-14T13:16:43.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdaad59d700 1 -- 172.21.15.17:0/2718347094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa81013b0 msgr2=0x7fdaa80fee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdaad59d700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa81013b0 0x7fdaa80fee10 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00e9a0 tx=0x7fda9c00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdaad59d700 1 -- 172.21.15.17:0/2718347094 shutdown_connections 2023-07-14T13:16:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdaad59d700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fda900a13e0 0x7fda900a3890 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdaad59d700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaa8109fc0 0x7fdaa81a3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdaad59d700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdaa8100aa0 0x7fdaa80fe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdaad59d700 1 --2- 172.21.15.17:0/2718347094 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdaa81013b0 0x7fdaa80fee10 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdaad59d700 1 -- 172.21.15.17:0/2718347094 >> 172.21.15.17:0/2718347094 conn(0x7fdaa80745d0 msgr2=0x7fdaa8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.475+0000 7fdaad59d700 1 -- 172.21.15.17:0/2718347094 shutdown_connections 2023-07-14T13:16:43.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.476+0000 7fdaad59d700 1 -- 172.21.15.17:0/2718347094 wait complete. 2023-07-14T13:16:43.531 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:43 smithi017 ceph-mon[95536]: pgmap v534: 97 pgs: 97 active+clean; 15 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 MiB/s wr, 13 op/s 2023-07-14T13:16:43.531 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:43 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/9318602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:16:43.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:16:43.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:43 smithi135 ceph-mon[97338]: pgmap v534: 97 pgs: 97 active+clean; 15 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 MiB/s wr, 13 op/s 2023-07-14T13:16:43.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:43 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/9318602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:16:43.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.732+0000 7f05fadff700 1 -- 172.21.15.17:0/852373634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f4105ae0 msgr2=0x7f05f4105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.732+0000 7f05fadff700 1 --2- 172.21.15.17:0/852373634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f4105ae0 0x7f05f4105eb0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f05f000b0a0 tx=0x7f05f000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.732+0000 7f05fadff700 1 -- 172.21.15.17:0/852373634 shutdown_connections 2023-07-14T13:16:43.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.732+0000 7f05fadff700 1 --2- 172.21.15.17:0/852373634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f4100480 0x7f05f410c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.772 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.732+0000 7f05fadff700 1 --2- 172.21.15.17:0/852373634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f4105ae0 0x7f05f4105eb0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.732+0000 7f05fadff700 1 --2- 172.21.15.17:0/852373634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f40ffad0 0x7f05f40fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.732+0000 7f05fadff700 1 -- 172.21.15.17:0/852373634 >> 172.21.15.17:0/852373634 conn(0x7f05f40fb5f0 msgr2=0x7f05f40fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.732+0000 7f05fadff700 1 -- 172.21.15.17:0/852373634 shutdown_connections 2023-07-14T13:16:43.773 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.732+0000 7f05fadff700 1 -- 172.21.15.17:0/852373634 wait complete. 2023-07-14T13:16:43.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.733+0000 7f05fadff700 1 Processor -- start 2023-07-14T13:16:43.774 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.734+0000 7f05fadff700 1 -- start start 2023-07-14T13:16:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.734+0000 7f05fadff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f40ffad0 0x7f05f4197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.734+0000 7f05fadff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f4100480 0x7f05f41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.734+0000 7f05fadff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f4105ae0 0x7f05f419c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.734+0000 7f05fadff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f419ce40 con 0x7f05f4105ae0 2023-07-14T13:16:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.734+0000 7f05fadff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f419cfb0 con 0x7f05f4100480 2023-07-14T13:16:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.734+0000 7f05fadff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f419d170 con 0x7f05f40ffad0 2023-07-14T13:16:43.775 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.734+0000 7f05f939c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f4105ae0 0x7f05f419c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.734+0000 7f05f939c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f4105ae0 0x7f05f419c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44370/0 (socket says 172.21.15.17:44370) 2023-07-14T13:16:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.734+0000 7f05f939c700 1 -- 172.21.15.17:0/1654951444 learned_addr learned my addr 172.21.15.17:0/1654951444 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.735+0000 7f05f8b9b700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f40ffad0 0x7f05f4197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.735+0000 7f05ebfff700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f4100480 0x7f05f41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.735+0000 7f05f939c700 1 -- 172.21.15.17:0/1654951444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f40ffad0 msgr2=0x7f05f4197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.735+0000 7f05f939c700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f40ffad0 0x7f05f4197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.735+0000 7f05f939c700 1 -- 172.21.15.17:0/1654951444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f4100480 msgr2=0x7f05f41983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.735+0000 7f05f939c700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f4100480 0x7f05f41983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.735+0000 7f05f939c700 1 -- 172.21.15.17:0/1654951444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009d00 con 0x7f05f4105ae0 2023-07-14T13:16:43.777 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.735+0000 7f05f939c700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f4105ae0 0x7f05f419c800 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00d980 tx=0x7f05ec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.736+0000 7f05e9ffb700 1 -- 172.21.15.17:0/1654951444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec004220 con 0x7f05f4105ae0 2023-07-14T13:16:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.736+0000 7f05e9ffb700 1 -- 172.21.15.17:0/1654951444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05ec0075e0 con 0x7f05f4105ae0 2023-07-14T13:16:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.736+0000 7f05fadff700 1 -- 172.21.15.17:0/1654951444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f419d450 con 0x7f05f4105ae0 2023-07-14T13:16:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.736+0000 7f05e9ffb700 1 -- 172.21.15.17:0/1654951444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec005570 con 0x7f05f4105ae0 2023-07-14T13:16:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.736+0000 7f05fadff700 1 -- 172.21.15.17:0/1654951444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f41a4c90 con 0x7f05f4105ae0 2023-07-14T13:16:43.779 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.740+0000 7f05e9ffb700 1 -- 172.21.15.17:0/1654951444 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f05ec004750 con 0x7f05f4105ae0 2023-07-14T13:16:43.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.742+0000 7f060e789b80 1 Processor -- start 2023-07-14T13:16:43.781 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.742+0000 7f060e789b80 1 -- start start 2023-07-14T13:16:43.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.742+0000 7f05e9ffb700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f05dc0a1340 0x7f05dc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.742+0000 7f060e789b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc8166a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.742+0000 7f060e789b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc816be0 0x55ccfc821590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05e9ffb700 1 -- 172.21.15.17:0/1654951444 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f05ec0cc980 con 0x7f05f4105ae0 2023-07-14T13:16:43.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f060e789b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc821ad0 0x55ccfc823eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f060e789b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc71ccb0 con 0x55ccfc8162d0 2023-07-14T13:16:43.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f060e789b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc76fa40 con 0x55ccfc821ad0 2023-07-14T13:16:43.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f060e789b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc768ed0 con 0x55ccfc816be0 2023-07-14T13:16:43.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05f8b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc8166a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05f8b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc8166a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44380/0 (socket says 172.21.15.17:44380) 2023-07-14T13:16:43.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05f8b9b700 1 -- 172.21.15.17:0/345940072 learned_addr learned my addr 172.21.15.17:0/345940072 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:43.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05ebfff700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f05dc0a1340 0x7f05dc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05f939c700 1 --2- 172.21.15.17:0/345940072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc821ad0 0x55ccfc823eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05ebfff700 1 --2- 172.21.15.17:0/345940072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc816be0 0x55ccfc821590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05f8b9b700 1 -- 172.21.15.17:0/345940072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc816be0 msgr2=0x55ccfc821590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05f8b9b700 1 --2- 172.21.15.17:0/345940072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc816be0 0x55ccfc821590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05f8b9b700 1 -- 172.21.15.17:0/345940072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc821ad0 msgr2=0x55ccfc823eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05f8b9b700 1 --2- 172.21.15.17:0/345940072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc821ad0 0x55ccfc823eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.743+0000 7f05f8b9b700 1 -- 172.21.15.17:0/345940072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccfc596de0 con 0x55ccfc8162d0 2023-07-14T13:16:43.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.744+0000 7f05f8b9b700 1 --2- 172.21.15.17:0/345940072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc8166a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f05f0015000 tx=0x7f05f0009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e34129960abf26 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.744+0000 7f05ebfff700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f05dc0a1340 0x7f05dc0a37f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f05f4199470 tx=0x7f05e40099b0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.744+0000 7f05daffd700 1 -- 172.21.15.17:0/345940072 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f000e040 con 0x55ccfc8162d0 2023-07-14T13:16:43.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.744+0000 7f05daffd700 1 -- 172.21.15.17:0/345940072 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05f0007d90 con 0x55ccfc8162d0 2023-07-14T13:16:43.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.744+0000 7f05daffd700 1 -- 172.21.15.17:0/345940072 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0003c60 con 0x55ccfc8162d0 2023-07-14T13:16:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.745+0000 7f060e789b80 1 -- 172.21.15.17:0/345940072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 msgr2=0x55ccfc8166a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.745+0000 7f060e789b80 1 --2- 172.21.15.17:0/345940072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc8166a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f05f0015000 tx=0x7f05f0009360 comp rx=0 tx=0).stop 2023-07-14T13:16:43.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.745+0000 7f060e789b80 1 -- 172.21.15.17:0/345940072 shutdown_connections 2023-07-14T13:16:43.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.745+0000 7f060e789b80 1 --2- 172.21.15.17:0/345940072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc821ad0 0x55ccfc823eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.745+0000 7f060e789b80 1 --2- 172.21.15.17:0/345940072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc8166a0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.745+0000 7f060e789b80 1 --2- 172.21.15.17:0/345940072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc816be0 0x55ccfc821590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.745+0000 7f060e789b80 1 -- 172.21.15.17:0/345940072 >> 172.21.15.17:0/345940072 conn(0x55ccfc80cda0 msgr2=0x55ccfc8126a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.745+0000 7f060e789b80 1 -- 172.21.15.17:0/345940072 shutdown_connections 2023-07-14T13:16:43.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.745+0000 7f060e789b80 1 -- 172.21.15.17:0/345940072 wait complete. 2023-07-14T13:16:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.746+0000 7f060e789b80 1 -- start start 2023-07-14T13:16:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.746+0000 7f060e789b80 1 Processor -- start 2023-07-14T13:16:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.746+0000 7f060e789b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc821400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.746+0000 7f060e789b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc816be0 0x55ccfc81e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f060e789b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc821ad0 0x55ccfc81ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f060e789b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc708ac0 con 0x55ccfc8162d0 2023-07-14T13:16:43.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f060e789b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc7087c0 con 0x55ccfc816be0 2023-07-14T13:16:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f060e789b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc5ec920 con 0x55ccfc821ad0 2023-07-14T13:16:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f060e789b80 10 client.0 _ll_register_callbacks cb 0x55ccfc706760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f05f8b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc821400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f05f8b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc821400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44392/0 (socket says 172.21.15.17:44392) 2023-07-14T13:16:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f05f8b9b700 1 -- 172.21.15.17:0/304802117 learned_addr learned my addr 172.21.15.17:0/304802117 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f05f939c700 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc821ad0 0x55ccfc81ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f05ebfff700 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc816be0 0x55ccfc81e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f05f8b9b700 1 -- 172.21.15.17:0/304802117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc821ad0 msgr2=0x55ccfc81ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f05f8b9b700 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc821ad0 0x55ccfc81ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f05f8b9b700 1 -- 172.21.15.17:0/304802117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc816be0 msgr2=0x55ccfc81e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f05f8b9b700 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc816be0 0x55ccfc81e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f05f8b9b700 1 -- 172.21.15.17:0/304802117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f410d210 con 0x55ccfc8162d0 2023-07-14T13:16:43.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.747+0000 7f05ebfff700 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc816be0 0x55ccfc81e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:16:43.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.748+0000 7f05f8b9b700 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc821400 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f05f000d010 tx=0x7f05f0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b815697c2b33e37 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.748+0000 7f05d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:43.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.748+0000 7f05d3fff700 1 -- 172.21.15.17:0/304802117 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f000e040 con 0x55ccfc8162d0 2023-07-14T13:16:43.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.748+0000 7f05d3fff700 1 -- 172.21.15.17:0/304802117 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f05f00052d0 con 0x55ccfc8162d0 2023-07-14T13:16:43.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.748+0000 7f060e789b80 1 -- 172.21.15.17:0/304802117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ccfc6c24f0 con 0x55ccfc8162d0 2023-07-14T13:16:43.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.748+0000 7f05d3fff700 1 -- 172.21.15.17:0/304802117 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05f00078f0 con 0x55ccfc8162d0 2023-07-14T13:16:43.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.748+0000 7f060e789b80 10 client.18393 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:43.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.748+0000 7f060e789b80 1 -- 172.21.15.17:0/304802117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55ccfc57fc60 con 0x55ccfc8162d0 2023-07-14T13:16:43.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.749+0000 7f05d3fff700 1 -- 172.21.15.17:0/304802117 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ccfc6c24f0 con 0x55ccfc8162d0 2023-07-14T13:16:43.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.749+0000 7f05d3fff700 1 -- 172.21.15.17:0/304802117 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f05f0019050 con 0x55ccfc8162d0 2023-07-14T13:16:43.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.749+0000 7f060e789b80 10 client.18393 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:43.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.749+0000 7f060e789b80 10 client.18393 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:16:43.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.749+0000 7f060e789b80 20 client.18393 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:43.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.749+0000 7f060e789b80 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ccfc830ee0 0x55ccfc8332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.749+0000 7f060e789b80 4 client.18393 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:43.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.749+0000 7f060e789b80 1 -- 172.21.15.17:0/304802117 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ccfc761eb0 con 0x55ccfc830ee0 2023-07-14T13:16:43.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.749+0000 7f05ebfff700 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ccfc830ee0 0x55ccfc8332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.750+0000 7f05d3fff700 10 client.18393 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:16:43.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.750+0000 7f05ebfff700 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ccfc830ee0 0x55ccfc8332c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f51740643eafd817 server_cookie=4eb15c82019c9ae5 in_seq=0 out_seq=0 2023-07-14T13:16:43.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f05d3fff700 1 -- 172.21.15.17:0/304802117 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ccfc761eb0 con 0x55ccfc830ee0 2023-07-14T13:16:43.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f05d3fff700 10 client.18393 handle_command_reply: tid=0 2023-07-14T13:16:43.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f060e789b80 1 client.18393 shutdown 2023-07-14T13:16:43.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f060e789b80 1 -- 172.21.15.17:0/304802117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 msgr2=0x55ccfc821400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f060e789b80 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc821400 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f05f000d010 tx=0x7f05f0003d40 comp rx=0 tx=0).stop 2023-07-14T13:16:43.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f060e789b80 1 -- 172.21.15.17:0/304802117 shutdown_connections 2023-07-14T13:16:43.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f060e789b80 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc821ad0 0x55ccfc81ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f060e789b80 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc8162d0 0x55ccfc821400 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f060e789b80 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ccfc830ee0 0x55ccfc8332c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f060e789b80 1 --2- 172.21.15.17:0/304802117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc816be0 0x55ccfc81e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f060e789b80 1 -- 172.21.15.17:0/304802117 >> 172.21.15.17:0/304802117 conn(0x55ccfc80cda0 msgr2=0x55ccfc812230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.751+0000 7f05d3fff700 0 client.18393 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:16:43.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.752+0000 7f060e789b80 1 -- 172.21.15.17:0/304802117 shutdown_connections 2023-07-14T13:16:43.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.752+0000 7f060e789b80 1 -- 172.21.15.17:0/304802117 wait complete. 2023-07-14T13:16:43.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.752+0000 7f060e789b80 20 client.18393 trim_cache size 0 max 16384 2023-07-14T13:16:43.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.768+0000 7f060e789b80 1 Processor -- start 2023-07-14T13:16:43.807 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.768+0000 7f060e789b80 1 -- start start 2023-07-14T13:16:43.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.768+0000 7f060e789b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc8162d0 0x55ccfc820fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.808 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.768+0000 7f060e789b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc816be0 0x55ccfc819a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.768+0000 7f060e789b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc821ad0 0x55ccfc819f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.768+0000 7f060e789b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc817e70 con 0x55ccfc821ad0 2023-07-14T13:16:43.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.768+0000 7f060e789b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc81fcd0 con 0x55ccfc816be0 2023-07-14T13:16:43.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.768+0000 7f060e789b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc813d60 con 0x55ccfc8162d0 2023-07-14T13:16:43.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.769+0000 7f05f939c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc821ad0 0x55ccfc819f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.769+0000 7f05f939c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc821ad0 0x55ccfc819f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44406/0 (socket says 172.21.15.17:44406) 2023-07-14T13:16:43.809 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.769+0000 7f05f939c700 1 -- 172.21.15.17:0/2055148888 learned_addr learned my addr 172.21.15.17:0/2055148888 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:43.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.769+0000 7f05ebfff700 1 --2- 172.21.15.17:0/2055148888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc816be0 0x55ccfc819a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.769+0000 7f05f939c700 1 -- 172.21.15.17:0/2055148888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc8162d0 msgr2=0x55ccfc820fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.769+0000 7f05f939c700 1 --2- 172.21.15.17:0/2055148888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc8162d0 0x55ccfc820fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.769+0000 7f05f939c700 1 -- 172.21.15.17:0/2055148888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc816be0 msgr2=0x55ccfc819a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.769+0000 7f05f939c700 1 --2- 172.21.15.17:0/2055148888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc816be0 0x55ccfc819a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.810 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.769+0000 7f05f939c700 1 -- 172.21.15.17:0/2055148888 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccfc5bd250 con 0x55ccfc821ad0 2023-07-14T13:16:43.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.769+0000 7f05f939c700 1 --2- 172.21.15.17:0/2055148888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc821ad0 0x55ccfc819f90 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00d950 tx=0x7f05ec0b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ade4e558685e49 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.769+0000 7f05db7fe700 1 -- 172.21.15.17:0/2055148888 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec097db0 con 0x55ccfc821ad0 2023-07-14T13:16:43.812 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.770+0000 7f05db7fe700 1 -- 172.21.15.17:0/2055148888 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05ec014070 con 0x55ccfc821ad0 2023-07-14T13:16:43.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.770+0000 7f05db7fe700 1 -- 172.21.15.17:0/2055148888 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec099160 con 0x55ccfc821ad0 2023-07-14T13:16:43.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.770+0000 7f060e789b80 1 -- 172.21.15.17:0/2055148888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc821ad0 msgr2=0x55ccfc819f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.770+0000 7f060e789b80 1 --2- 172.21.15.17:0/2055148888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc821ad0 0x55ccfc819f90 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00d950 tx=0x7f05ec0b9040 comp rx=0 tx=0).stop 2023-07-14T13:16:43.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.770+0000 7f060e789b80 1 -- 172.21.15.17:0/2055148888 shutdown_connections 2023-07-14T13:16:43.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.770+0000 7f060e789b80 1 --2- 172.21.15.17:0/2055148888 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc821ad0 0x55ccfc819f90 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.770+0000 7f060e789b80 1 --2- 172.21.15.17:0/2055148888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc8162d0 0x55ccfc820fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.770+0000 7f060e789b80 1 --2- 172.21.15.17:0/2055148888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc816be0 0x55ccfc819a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.813 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.770+0000 7f060e789b80 1 -- 172.21.15.17:0/2055148888 >> 172.21.15.17:0/2055148888 conn(0x55ccfc80cda0 msgr2=0x55ccfc832ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.770+0000 7f060e789b80 1 -- 172.21.15.17:0/2055148888 shutdown_connections 2023-07-14T13:16:43.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.771+0000 7f060e789b80 1 -- 172.21.15.17:0/2055148888 wait complete. 2023-07-14T13:16:43.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.771+0000 7f060e789b80 1 -- start start 2023-07-14T13:16:43.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.771+0000 7f060e789b80 1 Processor -- start 2023-07-14T13:16:43.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f060e789b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc8162d0 0x55ccfc827ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f060e789b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc816be0 0x55ccfc8283e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.814 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f060e789b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc821ad0 0x55ccfc8264d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f060e789b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc826b70 con 0x55ccfc816be0 2023-07-14T13:16:43.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f060e789b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc826ce0 con 0x55ccfc821ad0 2023-07-14T13:16:43.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f060e789b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccfc826ea0 con 0x55ccfc8162d0 2023-07-14T13:16:43.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f060e789b80 10 client.0 _ll_register_callbacks cb 0x7f05ec095df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:43.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f05ebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc816be0 0x55ccfc8283e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f05ebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc816be0 0x55ccfc8283e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44410/0 (socket says 172.21.15.17:44410) 2023-07-14T13:16:43.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f05ebfff700 1 -- 172.21.15.17:0/2881760756 learned_addr learned my addr 172.21.15.17:0/2881760756 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:43.815 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f05f939c700 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc821ad0 0x55ccfc8264d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f05f8b9b700 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc8162d0 0x55ccfc827ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.772+0000 7f05ebfff700 1 -- 172.21.15.17:0/2881760756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc8162d0 msgr2=0x55ccfc827ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f05ebfff700 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc8162d0 0x55ccfc827ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f05ebfff700 1 -- 172.21.15.17:0/2881760756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc821ad0 msgr2=0x55ccfc8264d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:43.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f05ebfff700 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc821ad0 0x55ccfc8264d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f05ebfff700 1 -- 172.21.15.17:0/2881760756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f41a4c90 con 0x55ccfc816be0 2023-07-14T13:16:43.816 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f05f8b9b700 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc8162d0 0x55ccfc827ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:16:43.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f05ebfff700 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc816be0 0x55ccfc8283e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009fd0 tx=0x7f05e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572acce6993a8e23 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:43.817 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f05d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:43.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f05d3fff700 1 -- 172.21.15.17:0/2881760756 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4022040 con 0x55ccfc816be0 2023-07-14T13:16:43.818 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f060e789b80 1 -- 172.21.15.17:0/2881760756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05f0007d90 con 0x55ccfc816be0 2023-07-14T13:16:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f05d3fff700 1 -- 172.21.15.17:0/2881760756 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f05e40043a0 con 0x55ccfc816be0 2023-07-14T13:16:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f05d3fff700 1 -- 172.21.15.17:0/2881760756 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05e4004560 con 0x55ccfc816be0 2023-07-14T13:16:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f060e789b80 10 client.18399 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.773+0000 7f060e789b80 1 -- 172.21.15.17:0/2881760756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55ccfc5952b0 con 0x55ccfc816be0 2023-07-14T13:16:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.774+0000 7f05d3fff700 1 -- 172.21.15.17:0/2881760756 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05f0007d90 con 0x55ccfc816be0 2023-07-14T13:16:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.774+0000 7f05d3fff700 1 -- 172.21.15.17:0/2881760756 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f05e401dc70 con 0x55ccfc816be0 2023-07-14T13:16:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.774+0000 7f060e789b80 10 client.18399 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.774+0000 7f060e789b80 10 client.18399 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:16:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.774+0000 7f060e789b80 20 client.18399 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.774+0000 7f060e789b80 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ccfc885e60 0x55ccfc888270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.774+0000 7f060e789b80 4 client.18399 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:16:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.774+0000 7f060e789b80 1 -- 172.21.15.17:0/2881760756 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ccfc724050 con 0x55ccfc885e60 2023-07-14T13:16:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.774+0000 7f05f8b9b700 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ccfc885e60 0x55ccfc888270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:43.820 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.775+0000 7f05d3fff700 10 client.18399 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:16:43.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.775+0000 7f05f8b9b700 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ccfc885e60 0x55ccfc888270 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78f318d0dbf9e3b9 server_cookie=bc520d17ec6ddf4c in_seq=0 out_seq=0 2023-07-14T13:16:43.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.775+0000 7f05d3fff700 1 -- 172.21.15.17:0/2881760756 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ccfc724050 con 0x55ccfc885e60 2023-07-14T13:16:43.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.775+0000 7f05d3fff700 10 client.18399 handle_command_reply: tid=0 2023-07-14T13:16:43.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.775+0000 7f060e789b80 1 client.18399 shutdown 2023-07-14T13:16:43.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.775+0000 7f060e789b80 1 -- 172.21.15.17:0/2881760756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc816be0 msgr2=0x55ccfc8283e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.775+0000 7f060e789b80 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc816be0 0x55ccfc8283e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009fd0 tx=0x7f05e40047c0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.776+0000 7f060e789b80 1 -- 172.21.15.17:0/2881760756 shutdown_connections 2023-07-14T13:16:43.821 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.776+0000 7f060e789b80 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ccfc885e60 0x55ccfc888270 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.776+0000 7f060e789b80 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ccfc821ad0 0x55ccfc8264d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.776+0000 7f060e789b80 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ccfc8162d0 0x55ccfc827ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.776+0000 7f05d3fff700 0 client.18399 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:16:43.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.776+0000 7f060e789b80 1 --2- 172.21.15.17:0/2881760756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ccfc816be0 0x55ccfc8283e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.776+0000 7f060e789b80 1 -- 172.21.15.17:0/2881760756 >> 172.21.15.17:0/2881760756 conn(0x55ccfc80cda0 msgr2=0x55ccfc819a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.776+0000 7f060e789b80 1 -- 172.21.15.17:0/2881760756 shutdown_connections 2023-07-14T13:16:43.822 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.776+0000 7f060e789b80 1 -- 172.21.15.17:0/2881760756 wait complete. 2023-07-14T13:16:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.776+0000 7f060e789b80 20 client.18399 trim_cache size 0 max 16384 2023-07-14T13:16:43.823 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:16:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 -- 172.21.15.17:0/1654951444 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f05dc0a1340 msgr2=0x7f05dc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f05dc0a1340 0x7f05dc0a37f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f05f4199470 tx=0x7f05e40099b0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 -- 172.21.15.17:0/1654951444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f4105ae0 msgr2=0x7f05f419c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f4105ae0 0x7f05f419c800 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00d980 tx=0x7f05ec00dc90 comp rx=0 tx=0).stop 2023-07-14T13:16:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 -- 172.21.15.17:0/1654951444 shutdown_connections 2023-07-14T13:16:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f05dc0a1340 0x7f05dc0a37f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f4105ae0 0x7f05f419c800 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f40ffad0 0x7f05f4197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 --2- 172.21.15.17:0/1654951444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05f4100480 0x7f05f41983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 -- 172.21.15.17:0/1654951444 >> 172.21.15.17:0/1654951444 conn(0x7f05f40fb5f0 msgr2=0x7f05f410adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 -- 172.21.15.17:0/1654951444 shutdown_connections 2023-07-14T13:16:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:43.777+0000 7f05fadff700 1 -- 172.21.15.17:0/1654951444 wait complete. 2023-07-14T13:16:43.842 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:16:44.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.022+0000 7f36fa3ff700 1 -- 172.21.15.17:0/3823574610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f40fe9d0 msgr2=0x7f36f40fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:44.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.022+0000 7f36fa3ff700 1 --2- 172.21.15.17:0/3823574610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f40fe9d0 0x7f36f40fee40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009990 tx=0x7f36e8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.022+0000 7f36fa3ff700 1 -- 172.21.15.17:0/3823574610 shutdown_connections 2023-07-14T13:16:44.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.022+0000 7f36fa3ff700 1 --2- 172.21.15.17:0/3823574610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36f40ff380 0x7f36f410b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.022+0000 7f36fa3ff700 1 --2- 172.21.15.17:0/3823574610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f41049e0 0x7f36f4104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.022+0000 7f36fa3ff700 1 --2- 172.21.15.17:0/3823574610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f40fe9d0 0x7f36f40fee40 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.022+0000 7f36fa3ff700 1 -- 172.21.15.17:0/3823574610 >> 172.21.15.17:0/3823574610 conn(0x7f36f40fa4b0 msgr2=0x7f36f40fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:44.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.022+0000 7f36fa3ff700 1 -- 172.21.15.17:0/3823574610 shutdown_connections 2023-07-14T13:16:44.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.022+0000 7f36fa3ff700 1 -- 172.21.15.17:0/3823574610 wait complete. 2023-07-14T13:16:44.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.023+0000 7f36fa3ff700 1 Processor -- start 2023-07-14T13:16:44.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.023+0000 7f36fa3ff700 1 -- start start 2023-07-14T13:16:44.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36fa3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f40fe9d0 0x7f36f41005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36fa3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f40ff380 0x7f36f4100b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36fa3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36f41049e0 0x7f36f41a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36fa3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f41013c0 con 0x7f36f40fe9d0 2023-07-14T13:16:44.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36fa3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f41a41b0 con 0x7f36f41049e0 2023-07-14T13:16:44.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36fa3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f41a42f0 con 0x7f36f40ff380 2023-07-14T13:16:44.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36f3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f40fe9d0 0x7f36f41005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36f3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f40fe9d0 0x7f36f41005e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44426/0 (socket says 172.21.15.17:44426) 2023-07-14T13:16:44.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36f3fff700 1 -- 172.21.15.17:0/222000906 learned_addr learned my addr 172.21.15.17:0/222000906 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:44.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36f37fe700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f40ff380 0x7f36f4100b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36f899c700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36f41049e0 0x7f36f41a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36f3fff700 1 -- 172.21.15.17:0/222000906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f40ff380 msgr2=0x7f36f4100b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:44.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36f3fff700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f40ff380 0x7f36f4100b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36f3fff700 1 -- 172.21.15.17:0/222000906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36f41049e0 msgr2=0x7f36f41a3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:44.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36f3fff700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36f41049e0 0x7f36f41a3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36f3fff700 1 -- 172.21.15.17:0/222000906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80095f0 con 0x7f36f40fe9d0 2023-07-14T13:16:44.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.024+0000 7f36f899c700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36f41049e0 0x7f36f41a3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:16:44.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.025+0000 7f36f3fff700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f40fe9d0 0x7f36f41005e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f36e400d9b0 tx=0x7f36e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:44.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.025+0000 7f36f17fa700 1 -- 172.21.15.17:0/222000906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4004020 con 0x7f36f40fe9d0 2023-07-14T13:16:44.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.025+0000 7f36f17fa700 1 -- 172.21.15.17:0/222000906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36e4009730 con 0x7f36f40fe9d0 2023-07-14T13:16:44.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.025+0000 7f36fa3ff700 1 -- 172.21.15.17:0/222000906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f41a45a0 con 0x7f36f40fe9d0 2023-07-14T13:16:44.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.025+0000 7f36f17fa700 1 -- 172.21.15.17:0/222000906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e40039c0 con 0x7f36f40fe9d0 2023-07-14T13:16:44.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.025+0000 7f36fa3ff700 1 -- 172.21.15.17:0/222000906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f41a4ad0 con 0x7f36f40fe9d0 2023-07-14T13:16:44.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.029+0000 7f36f17fa700 1 -- 172.21.15.17:0/222000906 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f36e40098a0 con 0x7f36f40fe9d0 2023-07-14T13:16:44.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.030+0000 7f370dca5b80 1 Processor -- start 2023-07-14T13:16:44.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.030+0000 7f370dca5b80 1 -- start start 2023-07-14T13:16:44.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.031+0000 7f36f17fa700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f36dc0a1340 0x7f36dc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.031+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7dd2d0 0x55875c7dd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.031+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7ddbe0 0x55875c7e8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.031+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7e8ad0 0x55875c7eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.031+0000 7f370dca5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c6e3cb0 con 0x55875c7ddbe0 2023-07-14T13:16:44.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.031+0000 7f370dca5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c736a40 con 0x55875c7e8ad0 2023-07-14T13:16:44.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.031+0000 7f370dca5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c72fed0 con 0x55875c7dd2d0 2023-07-14T13:16:44.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.031+0000 7f36f17fa700 1 -- 172.21.15.17:0/222000906 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f36e40cc970 con 0x7f36f40fe9d0 2023-07-14T13:16:44.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.031+0000 7f36f899c700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f36dc0a1340 0x7f36dc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7ddbe0 0x55875c7e8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7ddbe0 0x55875c7e8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44432/0 (socket says 172.21.15.17:44432) 2023-07-14T13:16:44.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7dd2d0 0x55875c7dd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f37fe700 1 -- 172.21.15.17:0/3708718413 learned_addr learned my addr 172.21.15.17:0/3708718413 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f899c700 1 --2- 172.21.15.17:0/3708718413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7e8ad0 0x55875c7eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f37fe700 1 -- 172.21.15.17:0/3708718413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7dd2d0 msgr2=0x55875c7dd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f37fe700 1 --2- 172.21.15.17:0/3708718413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7dd2d0 0x55875c7dd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f37fe700 1 -- 172.21.15.17:0/3708718413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7e8ad0 msgr2=0x55875c7eaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:44.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f37fe700 1 --2- 172.21.15.17:0/3708718413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7e8ad0 0x55875c7eaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f37fe700 1 -- 172.21.15.17:0/3708718413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55875c55dde0 con 0x55875c7ddbe0 2023-07-14T13:16:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f899c700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f36dc0a1340 0x7f36dc0a37f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009fd0 tx=0x7f36ec00fb60 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.032+0000 7f36f37fe700 1 --2- 172.21.15.17:0/3708718413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7ddbe0 0x55875c7e8590 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009990 tx=0x7f36e8005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6548173f2e4ed4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.033+0000 7f36da7fc700 1 -- 172.21.15.17:0/3708718413 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e801d070 con 0x55875c7ddbe0 2023-07-14T13:16:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.033+0000 7f36da7fc700 1 -- 172.21.15.17:0/3708718413 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36e801e040 con 0x55875c7ddbe0 2023-07-14T13:16:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.033+0000 7f36da7fc700 1 -- 172.21.15.17:0/3708718413 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8004760 con 0x55875c7ddbe0 2023-07-14T13:16:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.034+0000 7f370dca5b80 1 -- 172.21.15.17:0/3708718413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7ddbe0 msgr2=0x55875c7e8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:44.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.034+0000 7f370dca5b80 1 --2- 172.21.15.17:0/3708718413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7ddbe0 0x55875c7e8590 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009990 tx=0x7f36e8005f00 comp rx=0 tx=0).stop 2023-07-14T13:16:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.034+0000 7f370dca5b80 1 -- 172.21.15.17:0/3708718413 shutdown_connections 2023-07-14T13:16:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.034+0000 7f370dca5b80 1 --2- 172.21.15.17:0/3708718413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7e8ad0 0x55875c7eaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.034+0000 7f370dca5b80 1 --2- 172.21.15.17:0/3708718413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7dd2d0 0x55875c7dd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.034+0000 7f370dca5b80 1 --2- 172.21.15.17:0/3708718413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7ddbe0 0x55875c7e8590 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.034+0000 7f370dca5b80 1 -- 172.21.15.17:0/3708718413 >> 172.21.15.17:0/3708718413 conn(0x55875c7d3da0 msgr2=0x55875c7d96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.034+0000 7f370dca5b80 1 -- 172.21.15.17:0/3708718413 shutdown_connections 2023-07-14T13:16:44.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.034+0000 7f370dca5b80 1 -- 172.21.15.17:0/3708718413 wait complete. 2023-07-14T13:16:44.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.034+0000 7f370dca5b80 1 -- start start 2023-07-14T13:16:44.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f370dca5b80 1 Processor -- start 2023-07-14T13:16:44.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7dd2d0 0x55875c7e8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7ddbe0 0x55875c7e5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f370dca5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c6cfac0 con 0x55875c7e8ad0 2023-07-14T13:16:44.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f370dca5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c6cf7c0 con 0x55875c7dd2d0 2023-07-14T13:16:44.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f370dca5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c5b3920 con 0x55875c7ddbe0 2023-07-14T13:16:44.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f370dca5b80 10 client.0 _ll_register_callbacks cb 0x55875c6cd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:44.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f36f899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f36f899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44448/0 (socket says 172.21.15.17:44448) 2023-07-14T13:16:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f36f899c700 1 -- 172.21.15.17:0/2354243489 learned_addr learned my addr 172.21.15.17:0/2354243489 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.035+0000 7f36f3fff700 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7dd2d0 0x55875c7e8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.036+0000 7f36f37fe700 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7ddbe0 0x55875c7e5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.036+0000 7f36f899c700 1 -- 172.21.15.17:0/2354243489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7ddbe0 msgr2=0x55875c7e5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.036+0000 7f36f899c700 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7ddbe0 0x55875c7e5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.036+0000 7f36f899c700 1 -- 172.21.15.17:0/2354243489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7dd2d0 msgr2=0x55875c7e8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.036+0000 7f36f899c700 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7dd2d0 0x55875c7e8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.036+0000 7f36f899c700 1 -- 172.21.15.17:0/2354243489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f410c110 con 0x55875c7e8ad0 2023-07-14T13:16:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.036+0000 7f36f37fe700 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7ddbe0 0x55875c7e5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:16:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.036+0000 7f36f899c700 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e5e70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f36ec007780 tx=0x7f36ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48006a4b06c27a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.036+0000 7f36d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.037+0000 7f36d37fe700 1 -- 172.21.15.17:0/2354243489 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec009400 con 0x55875c7e8ad0 2023-07-14T13:16:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.037+0000 7f370dca5b80 1 -- 172.21.15.17:0/2354243489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55875c6894f0 con 0x55875c7e8ad0 2023-07-14T13:16:44.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.037+0000 7f36d37fe700 1 -- 172.21.15.17:0/2354243489 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f36ec004bb0 con 0x55875c7e8ad0 2023-07-14T13:16:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.037+0000 7f36d37fe700 1 -- 172.21.15.17:0/2354243489 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36ec004d70 con 0x55875c7e8ad0 2023-07-14T13:16:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.037+0000 7f370dca5b80 10 client.18411 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.037+0000 7f370dca5b80 1 -- 172.21.15.17:0/2354243489 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55875c546c60 con 0x55875c7e8ad0 2023-07-14T13:16:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.037+0000 7f36d37fe700 1 -- 172.21.15.17:0/2354243489 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55875c6894f0 con 0x55875c7e8ad0 2023-07-14T13:16:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.037+0000 7f36d37fe700 1 -- 172.21.15.17:0/2354243489 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f36ec0196f0 con 0x55875c7e8ad0 2023-07-14T13:16:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.038+0000 7f370dca5b80 10 client.18411 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:44.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.038+0000 7f370dca5b80 10 client.18411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.038+0000 7f370dca5b80 20 client.18411 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.038+0000 7f370dca5b80 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55875c7f8400 0x55875c7fa810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.038+0000 7f370dca5b80 4 client.18411 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.038+0000 7f370dca5b80 1 -- 172.21.15.17:0/2354243489 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55875c728eb0 con 0x55875c7f8400 2023-07-14T13:16:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.038+0000 7f36f3fff700 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55875c7f8400 0x55875c7fa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.039+0000 7f36f3fff700 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55875c7f8400 0x55875c7fa810 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44a8cc2939454be0 server_cookie=637043e73137d98 in_seq=0 out_seq=0 2023-07-14T13:16:44.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.039+0000 7f36d37fe700 10 client.18411 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f36d37fe700 1 -- 172.21.15.17:0/2354243489 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55875c728eb0 con 0x55875c7f8400 2023-07-14T13:16:44.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f36d37fe700 10 client.18411 handle_command_reply: tid=0 2023-07-14T13:16:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f370dca5b80 1 client.18411 shutdown 2023-07-14T13:16:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f370dca5b80 1 -- 172.21.15.17:0/2354243489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 msgr2=0x55875c7e5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f370dca5b80 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e5e70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f36ec007780 tx=0x7f36ec00b040 comp rx=0 tx=0).stop 2023-07-14T13:16:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f370dca5b80 1 -- 172.21.15.17:0/2354243489 shutdown_connections 2023-07-14T13:16:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f370dca5b80 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55875c7f8400 0x55875c7fa810 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f370dca5b80 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e5e70 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f370dca5b80 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7dd2d0 0x55875c7e8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f370dca5b80 1 --2- 172.21.15.17:0/2354243489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7ddbe0 0x55875c7e5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f36d37fe700 0 client.18411 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f370dca5b80 1 -- 172.21.15.17:0/2354243489 >> 172.21.15.17:0/2354243489 conn(0x55875c7d3da0 msgr2=0x55875c7d9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f370dca5b80 1 -- 172.21.15.17:0/2354243489 shutdown_connections 2023-07-14T13:16:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.040+0000 7f370dca5b80 1 -- 172.21.15.17:0/2354243489 wait complete. 2023-07-14T13:16:44.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.041+0000 7f370dca5b80 20 client.18411 trim_cache size 0 max 16384 2023-07-14T13:16:44.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.059+0000 7f370dca5b80 1 Processor -- start 2023-07-14T13:16:44.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.059+0000 7f370dca5b80 1 -- start start 2023-07-14T13:16:44.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.060+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7dd2d0 0x55875c7d7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.060+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7ddbe0 0x55875c7f4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.060+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.060+0000 7f370dca5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c7ded60 con 0x55875c7e8ad0 2023-07-14T13:16:44.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.060+0000 7f370dca5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c7e6470 con 0x55875c7dd2d0 2023-07-14T13:16:44.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.060+0000 7f370dca5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c7d8350 con 0x55875c7ddbe0 2023-07-14T13:16:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.060+0000 7f36f899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.060+0000 7f36f37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7ddbe0 0x55875c7f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.060+0000 7f36f899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44450/0 (socket says 172.21.15.17:44450) 2023-07-14T13:16:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.060+0000 7f36f899c700 1 -- 172.21.15.17:0/3507942833 learned_addr learned my addr 172.21.15.17:0/3507942833 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:44.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.060+0000 7f36f3fff700 1 --2- 172.21.15.17:0/3507942833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7dd2d0 0x55875c7d7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.061+0000 7f36f899c700 1 -- 172.21.15.17:0/3507942833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7ddbe0 msgr2=0x55875c7f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:44.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.061+0000 7f36f899c700 1 --2- 172.21.15.17:0/3507942833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7ddbe0 0x55875c7f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.061+0000 7f36f899c700 1 -- 172.21.15.17:0/3507942833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7dd2d0 msgr2=0x55875c7d7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:44.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.061+0000 7f36f899c700 1 --2- 172.21.15.17:0/3507942833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7dd2d0 0x55875c7d7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.061+0000 7f36f899c700 1 -- 172.21.15.17:0/3507942833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55875c584250 con 0x55875c7e8ad0 2023-07-14T13:16:44.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.061+0000 7f36f899c700 1 --2- 172.21.15.17:0/3507942833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e8050 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00b010 tx=0x7f36ec010120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a7f91c230a3c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:44.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.061+0000 7f36daffd700 1 -- 172.21.15.17:0/3507942833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec009e40 con 0x55875c7e8ad0 2023-07-14T13:16:44.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.061+0000 7f36daffd700 1 -- 172.21.15.17:0/3507942833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36ec0098a0 con 0x55875c7e8ad0 2023-07-14T13:16:44.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.061+0000 7f36daffd700 1 -- 172.21.15.17:0/3507942833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec016930 con 0x55875c7e8ad0 2023-07-14T13:16:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.062+0000 7f370dca5b80 1 -- 172.21.15.17:0/3507942833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 msgr2=0x55875c7e8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.062+0000 7f370dca5b80 1 --2- 172.21.15.17:0/3507942833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e8050 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00b010 tx=0x7f36ec010120 comp rx=0 tx=0).stop 2023-07-14T13:16:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.062+0000 7f370dca5b80 1 -- 172.21.15.17:0/3507942833 shutdown_connections 2023-07-14T13:16:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.062+0000 7f370dca5b80 1 --2- 172.21.15.17:0/3507942833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7e8050 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.062+0000 7f370dca5b80 1 --2- 172.21.15.17:0/3507942833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7dd2d0 0x55875c7d7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.062+0000 7f370dca5b80 1 --2- 172.21.15.17:0/3507942833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7ddbe0 0x55875c7f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.062+0000 7f370dca5b80 1 -- 172.21.15.17:0/3507942833 >> 172.21.15.17:0/3507942833 conn(0x55875c7d3da0 msgr2=0x55875c7ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.062+0000 7f370dca5b80 1 -- 172.21.15.17:0/3507942833 shutdown_connections 2023-07-14T13:16:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.062+0000 7f370dca5b80 1 -- 172.21.15.17:0/3507942833 wait complete. 2023-07-14T13:16:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.063+0000 7f370dca5b80 1 -- start start 2023-07-14T13:16:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.063+0000 7f370dca5b80 1 Processor -- start 2023-07-14T13:16:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7dd2d0 0x55875c7eee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7ddbe0 0x55875c7ef350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f370dca5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7ed490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f370dca5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c7eda40 con 0x55875c7e8ad0 2023-07-14T13:16:44.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f370dca5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c7edbb0 con 0x55875c7ddbe0 2023-07-14T13:16:44.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f370dca5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55875c7edd70 con 0x55875c7dd2d0 2023-07-14T13:16:44.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f370dca5b80 10 client.0 _ll_register_callbacks cb 0x7f36ec009050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:44.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f36f899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f36f899c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7ed490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44458/0 (socket says 172.21.15.17:44458) 2023-07-14T13:16:44.106 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f36f899c700 1 -- 172.21.15.17:0/1129318839 learned_addr learned my addr 172.21.15.17:0/1129318839 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:44.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f36f3fff700 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7dd2d0 0x55875c7eee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.064+0000 7f36f37fe700 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7ddbe0 0x55875c7ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.065+0000 7f36f899c700 1 -- 172.21.15.17:0/1129318839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7dd2d0 msgr2=0x55875c7eee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.065+0000 7f36f899c700 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7dd2d0 0x55875c7eee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.065+0000 7f36f899c700 1 -- 172.21.15.17:0/1129318839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7ddbe0 msgr2=0x55875c7ef350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.065+0000 7f36f899c700 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7ddbe0 0x55875c7ef350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.065+0000 7f36f899c700 1 -- 172.21.15.17:0/1129318839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55875c546c60 con 0x55875c7e8ad0 2023-07-14T13:16:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.065+0000 7f36f37fe700 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7ddbe0 0x55875c7ef350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:16:44.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.065+0000 7f36f899c700 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7ed490 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f36ec007780 tx=0x7f36ec004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887bfce466425f18 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.065+0000 7f36d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:16:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.065+0000 7f36d37fe700 1 -- 172.21.15.17:0/1129318839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec019730 con 0x55875c7e8ad0 2023-07-14T13:16:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.065+0000 7f370dca5b80 1 -- 172.21.15.17:0/1129318839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f36e801e040 con 0x55875c7e8ad0 2023-07-14T13:16:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.065+0000 7f36d37fe700 1 -- 172.21.15.17:0/1129318839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f36ec0166d0 con 0x55875c7e8ad0 2023-07-14T13:16:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.066+0000 7f36d37fe700 1 -- 172.21.15.17:0/1129318839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36ec019890 con 0x55875c7e8ad0 2023-07-14T13:16:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.066+0000 7f370dca5b80 10 client.18417 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.066+0000 7f370dca5b80 1 -- 172.21.15.17:0/1129318839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55875c55c2b0 con 0x55875c7e8ad0 2023-07-14T13:16:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.066+0000 7f36d37fe700 1 -- 172.21.15.17:0/1129318839 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36e801e040 con 0x55875c7e8ad0 2023-07-14T13:16:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.066+0000 7f36d37fe700 1 -- 172.21.15.17:0/1129318839 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f36ec005500 con 0x55875c7e8ad0 2023-07-14T13:16:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.066+0000 7f370dca5b80 10 client.18417 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.066+0000 7f370dca5b80 10 client.18417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.066+0000 7f370dca5b80 20 client.18417 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.066+0000 7f370dca5b80 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55875c84d040 0x55875c84f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.066+0000 7f370dca5b80 4 client.18417 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:16:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.066+0000 7f370dca5b80 1 -- 172.21.15.17:0/1129318839 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55875c6eb050 con 0x55875c84d040 2023-07-14T13:16:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.067+0000 7f36f3fff700 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55875c84d040 0x55875c84f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f36f3fff700 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55875c84d040 0x55875c84f450 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=631e2f3898e53dbf server_cookie=69381b9fa05c4ec7 in_seq=0 out_seq=0 2023-07-14T13:16:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f36d37fe700 10 client.18417 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f36d37fe700 1 -- 172.21.15.17:0/1129318839 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55875c6eb050 con 0x55875c84d040 2023-07-14T13:16:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f36d37fe700 10 client.18417 handle_command_reply: tid=0 2023-07-14T13:16:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f370dca5b80 1 client.18417 shutdown 2023-07-14T13:16:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f370dca5b80 1 -- 172.21.15.17:0/1129318839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 msgr2=0x55875c7ed490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f370dca5b80 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7ed490 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f36ec007780 tx=0x7f36ec004ca0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f370dca5b80 1 -- 172.21.15.17:0/1129318839 shutdown_connections 2023-07-14T13:16:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f370dca5b80 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55875c84d040 0x55875c84f450 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f370dca5b80 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55875c7e8ad0 0x55875c7ed490 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f370dca5b80 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55875c7dd2d0 0x55875c7eee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f370dca5b80 1 --2- 172.21.15.17:0/1129318839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55875c7ddbe0 0x55875c7ef350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f370dca5b80 1 -- 172.21.15.17:0/1129318839 >> 172.21.15.17:0/1129318839 conn(0x55875c7d3da0 msgr2=0x55875c7df3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f36d37fe700 0 client.18417 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f370dca5b80 1 -- 172.21.15.17:0/1129318839 shutdown_connections 2023-07-14T13:16:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.068+0000 7f370dca5b80 1 -- 172.21.15.17:0/1129318839 wait complete. 2023-07-14T13:16:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.069+0000 7f370dca5b80 20 client.18417 trim_cache size 0 max 16384 2023-07-14T13:16:44.114 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:16:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.069+0000 7f36fa3ff700 1 -- 172.21.15.17:0/222000906 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f36dc0a1340 msgr2=0x7f36dc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.069+0000 7f36fa3ff700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f36dc0a1340 0x7f36dc0a37f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009fd0 tx=0x7f36ec00fb60 comp rx=0 tx=0).stop 2023-07-14T13:16:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.069+0000 7f36fa3ff700 1 -- 172.21.15.17:0/222000906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f40fe9d0 msgr2=0x7f36f41005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.069+0000 7f36fa3ff700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f40fe9d0 0x7f36f41005e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f36e400d9b0 tx=0x7f36e400dcc0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.069+0000 7f36fa3ff700 1 -- 172.21.15.17:0/222000906 shutdown_connections 2023-07-14T13:16:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.069+0000 7f36fa3ff700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f36dc0a1340 0x7f36dc0a37f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.069+0000 7f36fa3ff700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36f41049e0 0x7f36f41a3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.069+0000 7f36fa3ff700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36f40fe9d0 0x7f36f41005e0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.069+0000 7f36fa3ff700 1 --2- 172.21.15.17:0/222000906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36f40ff380 0x7f36f4100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.069+0000 7f36fa3ff700 1 -- 172.21.15.17:0/222000906 >> 172.21.15.17:0/222000906 conn(0x7f36f40fa4b0 msgr2=0x7f36f4067730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.070+0000 7f36fa3ff700 1 -- 172.21.15.17:0/222000906 shutdown_connections 2023-07-14T13:16:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:44.070+0000 7f36fa3ff700 1 -- 172.21.15.17:0/222000906 wait complete. 2023-07-14T13:16:45.131 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:16:45.131 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:16:45.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.329+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4023363461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c0fe8d0 msgr2=0x7f1a9c0fed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.329+0000 7f1a9b59e700 1 --2- 172.21.15.17:0/4023363461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c0fe8d0 0x7f1a9c0fed40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009990 tx=0x7f1a90009ca0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.329+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4023363461 shutdown_connections 2023-07-14T13:16:45.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.329+0000 7f1a9b59e700 1 --2- 172.21.15.17:0/4023363461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a9c0ff280 0x7f1a9c10b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.329+0000 7f1a9b59e700 1 --2- 172.21.15.17:0/4023363461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a9c1048e0 0x7f1a9c104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.329+0000 7f1a9b59e700 1 --2- 172.21.15.17:0/4023363461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c0fe8d0 0x7f1a9c0fed40 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.329+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4023363461 >> 172.21.15.17:0/4023363461 conn(0x7f1a9c0745d0 msgr2=0x7f1a9c0749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.329+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4023363461 shutdown_connections 2023-07-14T13:16:45.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.329+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4023363461 wait complete. 2023-07-14T13:16:45.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.330+0000 7f1a9b59e700 1 Processor -- start 2023-07-14T13:16:45.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.331+0000 7f1a9b59e700 1 -- start start 2023-07-14T13:16:45.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.331+0000 7f1a9b59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a9c0fe8d0 0x7f1a9c19b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.331+0000 7f1a9b59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a9c0ff280 0x7f1a9c19bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.331+0000 7f1a9b59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c1048e0 0x7f1a9c195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.331+0000 7f1a9b59e700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c195cc0 con 0x7f1a9c1048e0 2023-07-14T13:16:45.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.331+0000 7f1a9b59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c195e30 con 0x7f1a9c0fe8d0 2023-07-14T13:16:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.331+0000 7f1a9b59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c195ff0 con 0x7f1a9c0ff280 2023-07-14T13:16:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.331+0000 7f1a9ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c1048e0 0x7f1a9c195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.332+0000 7f1a9ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c1048e0 0x7f1a9c195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57290/0 (socket says 172.21.15.17:57290) 2023-07-14T13:16:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.332+0000 7f1a9ad9d700 1 -- 172.21.15.17:0/4128642912 learned_addr learned my addr 172.21.15.17:0/4128642912 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.332+0000 7f1a9a59c700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a9c0fe8d0 0x7f1a9c19b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.332+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a9c0ff280 0x7f1a9c19bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.332+0000 7f1a9ad9d700 1 -- 172.21.15.17:0/4128642912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a9c0ff280 msgr2=0x7f1a9c19bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.332+0000 7f1a9ad9d700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a9c0ff280 0x7f1a9c19bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.332+0000 7f1a9ad9d700 1 -- 172.21.15.17:0/4128642912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a9c0fe8d0 msgr2=0x7f1a9c19b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.332+0000 7f1a9ad9d700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a9c0fe8d0 0x7f1a9c19b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.332+0000 7f1a9ad9d700 1 -- 172.21.15.17:0/4128642912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900095f0 con 0x7f1a9c1048e0 2023-07-14T13:16:45.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.332+0000 7f1a9ad9d700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c1048e0 0x7f1a9c195650 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400efc0 tx=0x7f1a9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.332+0000 7f1a8b7fe700 1 -- 172.21.15.17:0/4128642912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94018070 con 0x7f1a9c1048e0 2023-07-14T13:16:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.333+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4128642912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c196270 con 0x7f1a9c1048e0 2023-07-14T13:16:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.333+0000 7f1a8b7fe700 1 -- 172.21.15.17:0/4128642912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a9400f040 con 0x7f1a9c1048e0 2023-07-14T13:16:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.333+0000 7f1a8b7fe700 1 -- 172.21.15.17:0/4128642912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400cb00 con 0x7f1a9c1048e0 2023-07-14T13:16:45.375 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.333+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4128642912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c1a25d0 con 0x7f1a9c1048e0 2023-07-14T13:16:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.337+0000 7f1a8b7fe700 1 -- 172.21.15.17:0/4128642912 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1a9400cce0 con 0x7f1a9c1048e0 2023-07-14T13:16:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.337+0000 7f1ab44bdb80 1 Processor -- start 2023-07-14T13:16:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.337+0000 7f1ab44bdb80 1 -- start start 2023-07-14T13:16:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.338+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5e570 0x5617b8b5e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.338+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 0x5617b8b68870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.338+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8b6b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.338+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b8a63d30 con 0x5617b8b68db0 2023-07-14T13:16:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.338+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b8ab6ac0 con 0x5617b8b5ee80 2023-07-14T13:16:45.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.338+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b8aaff50 con 0x5617b8b5e570 2023-07-14T13:16:45.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.338+0000 7f1a99d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5e570 0x5617b8b5e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.338+0000 7f1a99d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5e570 0x5617b8b5e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47754/0 (socket says 172.21.15.17:47754) 2023-07-14T13:16:45.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.338+0000 7f1a99d9b700 1 -- 172.21.15.17:0/4124182355 learned_addr learned my addr 172.21.15.17:0/4124182355 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:45.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.338+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/4124182355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8b6b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.339+0000 7f1a9a59c700 1 --2- 172.21.15.17:0/4124182355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 0x5617b8b68870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.339+0000 7f1a9a59c700 1 -- 172.21.15.17:0/4124182355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5e570 msgr2=0x5617b8b5e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.339+0000 7f1a9a59c700 1 --2- 172.21.15.17:0/4124182355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5e570 0x5617b8b5e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.339+0000 7f1a8b7fe700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a840a1360 0x7f1a840a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.339+0000 7f1a9a59c700 1 -- 172.21.15.17:0/4124182355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 msgr2=0x5617b8b6b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.339+0000 7f1a9a59c700 1 --2- 172.21.15.17:0/4124182355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8b6b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.339+0000 7f1a9a59c700 1 -- 172.21.15.17:0/4124182355 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617b88dde60 con 0x5617b8b5ee80 2023-07-14T13:16:45.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.339+0000 7f1a8b7fe700 1 -- 172.21.15.17:0/4128642912 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1a940cc7a0 con 0x7f1a9c1048e0 2023-07-14T13:16:45.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.339+0000 7f1a9ad9d700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a840a1360 0x7f1a840a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.339+0000 7f1a9a59c700 1 --2- 172.21.15.17:0/4124182355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 0x5617b8b68870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c007bb0 tx=0x7f1a8c007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c21c34b08b38bd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.340+0000 7f1a88ff9700 1 -- 172.21.15.17:0/4124182355 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c004310 con 0x5617b8b5ee80 2023-07-14T13:16:45.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.340+0000 7f1a88ff9700 1 -- 172.21.15.17:0/4124182355 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a8c010e10 con 0x5617b8b5ee80 2023-07-14T13:16:45.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.340+0000 7f1a88ff9700 1 -- 172.21.15.17:0/4124182355 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c004e10 con 0x5617b8b5ee80 2023-07-14T13:16:45.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.341+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/4124182355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 msgr2=0x5617b8b68870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.341+0000 7f1a9ad9d700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a840a1360 0x7f1a840a3810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a940a16b0 tx=0x7f1a94009370 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.341+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/4124182355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 0x5617b8b68870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c007bb0 tx=0x7f1a8c007ec0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.341+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/4124182355 shutdown_connections 2023-07-14T13:16:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.341+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/4124182355 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8b6b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.341+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/4124182355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5e570 0x5617b8b5e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.341+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/4124182355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 0x5617b8b68870 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.341+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/4124182355 >> 172.21.15.17:0/4124182355 conn(0x5617b8b54070 msgr2=0x5617b8b599b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.341+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/4124182355 shutdown_connections 2023-07-14T13:16:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.341+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/4124182355 wait complete. 2023-07-14T13:16:45.384 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.341+0000 7f1ab44bdb80 1 -- start start 2023-07-14T13:16:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.342+0000 7f1ab44bdb80 1 Processor -- start 2023-07-14T13:16:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.342+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5e570 0x5617b8b687b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.342+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 0x5617b8b659c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.342+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8b65fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.342+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b8a4fb40 con 0x5617b8b68db0 2023-07-14T13:16:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.342+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b8a4f840 con 0x5617b8b5ee80 2023-07-14T13:16:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.342+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b89339a0 con 0x5617b8b5e570 2023-07-14T13:16:45.385 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.342+0000 7f1ab44bdb80 10 client.0 _ll_register_callbacks cb 0x5617b8a4d7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.343+0000 7f1a99d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8b65fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.343+0000 7f1a9a59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 0x5617b8b659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.343+0000 7f1a99d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8b65fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57316/0 (socket says 172.21.15.17:57316) 2023-07-14T13:16:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.343+0000 7f1a99d9b700 1 -- 172.21.15.17:0/2257350522 learned_addr learned my addr 172.21.15.17:0/2257350522 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.343+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5e570 0x5617b8b687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.343+0000 7f1a9a59c700 1 -- 172.21.15.17:0/2257350522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5e570 msgr2=0x5617b8b687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.343+0000 7f1a9a59c700 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5e570 0x5617b8b687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.343+0000 7f1a9a59c700 1 -- 172.21.15.17:0/2257350522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 msgr2=0x5617b8b65fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.343+0000 7f1a9a59c700 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8b65fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.343+0000 7f1a9a59c700 1 -- 172.21.15.17:0/2257350522 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c007890 con 0x5617b8b5ee80 2023-07-14T13:16:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.343+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8b65fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.344+0000 7f1a9a59c700 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 0x5617b8b659c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c000c00 tx=0x7f1a8c010bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80192c71e9073c3f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.344+0000 7f1a81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:16:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.344+0000 7f1a81ffb700 1 -- 172.21.15.17:0/2257350522 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c01f070 con 0x5617b8b5ee80 2023-07-14T13:16:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.344+0000 7f1a81ffb700 1 -- 172.21.15.17:0/2257350522 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1a8c004320 con 0x5617b8b5ee80 2023-07-14T13:16:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.344+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2257350522 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617b8a09570 con 0x5617b8b5ee80 2023-07-14T13:16:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.344+0000 7f1a81ffb700 1 -- 172.21.15.17:0/2257350522 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a8c004800 con 0x5617b8b5ee80 2023-07-14T13:16:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.344+0000 7f1ab44bdb80 10 client.28136 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:45.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.344+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2257350522 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5617b88c6ce0 con 0x5617b8b5ee80 2023-07-14T13:16:45.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.345+0000 7f1a81ffb700 1 -- 172.21.15.17:0/2257350522 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a8c030020 con 0x5617b8b5ee80 2023-07-14T13:16:45.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.345+0000 7f1a81ffb700 1 -- 172.21.15.17:0/2257350522 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1a8c0114d0 con 0x5617b8b5ee80 2023-07-14T13:16:45.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.345+0000 7f1ab44bdb80 10 client.28136 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:45.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.345+0000 7f1ab44bdb80 10 client.28136 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:45.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.345+0000 7f1ab44bdb80 20 client.28136 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:45.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.345+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5617b8b7c9f0 0x5617b8b7ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.345+0000 7f1ab44bdb80 4 client.28136 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:45.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.345+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2257350522 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617b8aa8f30 con 0x5617b8b7c9f0 2023-07-14T13:16:45.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.345+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5617b8b7c9f0 0x5617b8b7ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.346+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5617b8b7c9f0 0x5617b8b7ee00 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bfcd1df367ac9f0 server_cookie=336f5557d6db6b7f in_seq=0 out_seq=0 2023-07-14T13:16:45.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.346+0000 7f1a81ffb700 10 client.28136 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:45.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1a81ffb700 1 -- 172.21.15.17:0/2257350522 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5617b8aa8f30 con 0x5617b8b7c9f0 2023-07-14T13:16:45.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1a81ffb700 10 client.28136 handle_command_reply: tid=0 2023-07-14T13:16:45.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1ab44bdb80 1 client.28136 shutdown 2023-07-14T13:16:45.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2257350522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 msgr2=0x5617b8b659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 0x5617b8b659c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c000c00 tx=0x7f1a8c010bb0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2257350522 shutdown_connections 2023-07-14T13:16:45.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5617b8b7c9f0 0x5617b8b7ee00 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8b65fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1a81ffb700 0 client.28136 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:45.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5e570 0x5617b8b687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/2257350522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5ee80 0x5617b8b659c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2257350522 >> 172.21.15.17:0/2257350522 conn(0x5617b8b54070 msgr2=0x5617b8b595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2257350522 shutdown_connections 2023-07-14T13:16:45.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.347+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2257350522 wait complete. 2023-07-14T13:16:45.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.348+0000 7f1ab44bdb80 20 client.28136 trim_cache size 0 max 16384 2023-07-14T13:16:45.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.375+0000 7f1ab44bdb80 1 Processor -- start 2023-07-14T13:16:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.375+0000 7f1ab44bdb80 1 -- start start 2023-07-14T13:16:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b5e570 0x5617b8b73ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5ee80 0x5617b8b682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b68db0 0x5617b8b60d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b8b78b50 con 0x5617b8b5e570 2023-07-14T13:16:45.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b8b63f40 con 0x5617b8b68db0 2023-07-14T13:16:45.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b8b60860 con 0x5617b8b5ee80 2023-07-14T13:16:45.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1a99d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b5e570 0x5617b8b73ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1a99d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b5e570 0x5617b8b73ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57326/0 (socket says 172.21.15.17:57326) 2023-07-14T13:16:45.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1a99d9b700 1 -- 172.21.15.17:0/2611598838 learned_addr learned my addr 172.21.15.17:0/2611598838 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:45.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1a99d9b700 1 -- 172.21.15.17:0/2611598838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5ee80 msgr2=0x5617b8b682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/2611598838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5ee80 0x5617b8b682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1a99d9b700 1 -- 172.21.15.17:0/2611598838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b68db0 msgr2=0x5617b8b60d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.376+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/2611598838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b68db0 0x5617b8b60d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.377+0000 7f1a99d9b700 1 -- 172.21.15.17:0/2611598838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617b8b558b0 con 0x5617b8b5e570 2023-07-14T13:16:45.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.377+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/2611598838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b5e570 0x5617b8b73ca0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005850 tx=0x7f1a90009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea2a8aa37567f76 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.377+0000 7f1a897fa700 1 -- 172.21.15.17:0/2611598838 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9001d040 con 0x5617b8b5e570 2023-07-14T13:16:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.377+0000 7f1a897fa700 1 -- 172.21.15.17:0/2611598838 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a9002be00 con 0x5617b8b5e570 2023-07-14T13:16:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.377+0000 7f1a897fa700 1 -- 172.21.15.17:0/2611598838 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9000fc60 con 0x5617b8b5e570 2023-07-14T13:16:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.378+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2611598838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b5e570 msgr2=0x5617b8b73ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.378+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/2611598838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b5e570 0x5617b8b73ca0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1a90005850 tx=0x7f1a90009310 comp rx=0 tx=0).stop 2023-07-14T13:16:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.378+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2611598838 shutdown_connections 2023-07-14T13:16:45.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.378+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/2611598838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b68db0 0x5617b8b60d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.378+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/2611598838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b5e570 0x5617b8b73ca0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.378+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/2611598838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5ee80 0x5617b8b682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.378+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2611598838 >> 172.21.15.17:0/2611598838 conn(0x5617b8b54070 msgr2=0x5617b8b78440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.379+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2611598838 shutdown_connections 2023-07-14T13:16:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.379+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/2611598838 wait complete. 2023-07-14T13:16:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.379+0000 7f1ab44bdb80 1 -- start start 2023-07-14T13:16:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.379+0000 7f1ab44bdb80 1 Processor -- start 2023-07-14T13:16:45.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.380+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5e570 0x5617b8b72bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.380+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5ee80 0x5617b8b73130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.380+0000 7f1ab44bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8bca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.380+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b8bcae40 con 0x5617b8b68db0 2023-07-14T13:16:45.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.380+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b8bcafb0 con 0x5617b8b5e570 2023-07-14T13:16:45.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.380+0000 7f1ab44bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617b8bcb120 con 0x5617b8b5ee80 2023-07-14T13:16:45.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.380+0000 7f1ab44bdb80 10 client.0 _ll_register_callbacks cb 0x7f1a90005700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a99d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5e570 0x5617b8b72bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a9a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5ee80 0x5617b8b73130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a9a59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5ee80 0x5617b8b73130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47784/0 (socket says 172.21.15.17:47784) 2023-07-14T13:16:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a9a59c700 1 -- 172.21.15.17:0/1927436266 learned_addr learned my addr 172.21.15.17:0/1927436266 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5e570 0x5617b8b72bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51838/0 (socket says 172.21.15.17:51838) 2023-07-14T13:16:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8bca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a9a59c700 1 -- 172.21.15.17:0/1927436266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5e570 msgr2=0x5617b8b72bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a9a59c700 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5e570 0x5617b8b72bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a9a59c700 1 -- 172.21.15.17:0/1927436266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 msgr2=0x5617b8bca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a9a59c700 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8bca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a9a59c700 1 -- 172.21.15.17:0/1927436266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a90020040 con 0x5617b8b5ee80 2023-07-14T13:16:45.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.381+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5e570 0x5617b8b72bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:45.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.382+0000 7f1a9a59c700 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5ee80 0x5617b8b73130 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c000c00 tx=0x7f1a8c0075e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b650bb3d8329607a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.382+0000 7f1a81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:16:45.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.382+0000 7f1a81ffb700 1 -- 172.21.15.17:0/1927436266 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c01f070 con 0x5617b8b5ee80 2023-07-14T13:16:45.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.382+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/1927436266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a8c010e10 con 0x5617b8b5ee80 2023-07-14T13:16:45.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.382+0000 7f1a81ffb700 1 -- 172.21.15.17:0/1927436266 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1a8c000e40 con 0x5617b8b5ee80 2023-07-14T13:16:45.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.383+0000 7f1a81ffb700 1 -- 172.21.15.17:0/1927436266 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a8c0053a0 con 0x5617b8b5ee80 2023-07-14T13:16:45.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.383+0000 7f1ab44bdb80 10 client.28105 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:45.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.383+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/1927436266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5617b89042d0 con 0x5617b8b5ee80 2023-07-14T13:16:45.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.383+0000 7f1a81ffb700 1 -- 172.21.15.17:0/1927436266 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a8c010e10 con 0x5617b8b5ee80 2023-07-14T13:16:45.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.383+0000 7f1a81ffb700 1 -- 172.21.15.17:0/1927436266 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1a8c017560 con 0x5617b8b5ee80 2023-07-14T13:16:45.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.383+0000 7f1ab44bdb80 10 client.28105 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:45.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.383+0000 7f1ab44bdb80 10 client.28105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:45.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.383+0000 7f1ab44bdb80 20 client.28105 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:45.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.383+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5617b8bd2640 0x5617b8bd4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.384+0000 7f1ab44bdb80 4 client.28105 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:16:45.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.384+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/1927436266 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5617b8a6b0d0 con 0x5617b8bd2640 2023-07-14T13:16:45.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.384+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5617b8bd2640 0x5617b8bd4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.385+0000 7f1a81ffb700 10 client.28105 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:45.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.385+0000 7f1a99d9b700 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5617b8bd2640 0x5617b8bd4a50 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6642736c1047525b server_cookie=7033731142c2f2e5 in_seq=0 out_seq=0 2023-07-14T13:16:45.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.386+0000 7f1a81ffb700 1 -- 172.21.15.17:0/1927436266 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5617b8a6b0d0 con 0x5617b8bd2640 2023-07-14T13:16:45.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.386+0000 7f1a81ffb700 10 client.28105 handle_command_reply: tid=0 2023-07-14T13:16:45.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.386+0000 7f1ab44bdb80 1 client.28105 shutdown 2023-07-14T13:16:45.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.386+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/1927436266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5ee80 msgr2=0x5617b8b73130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.386+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5ee80 0x5617b8b73130 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c000c00 tx=0x7f1a8c0075e0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.387+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/1927436266 shutdown_connections 2023-07-14T13:16:45.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.387+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5617b8bd2640 0x5617b8bd4a50 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.387+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5617b8b68db0 0x5617b8bca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.387+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617b8b5e570 0x5617b8b72bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.429 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.387+0000 7f1ab44bdb80 1 --2- 172.21.15.17:0/1927436266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617b8b5ee80 0x5617b8b73130 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.387+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/1927436266 >> 172.21.15.17:0/1927436266 conn(0x5617b8b54070 msgr2=0x5617b8b60d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.387+0000 7f1a81ffb700 0 client.28105 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:45.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.387+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/1927436266 shutdown_connections 2023-07-14T13:16:45.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.387+0000 7f1ab44bdb80 1 -- 172.21.15.17:0/1927436266 wait complete. 2023-07-14T13:16:45.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.387+0000 7f1ab44bdb80 20 client.28105 trim_cache size 0 max 16384 2023-07-14T13:16:45.430 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:16:45.431 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:16:45.431 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "8c13ab33-9f06-43b5-98c1-3af85d6173f4", 2023-07-14T13:16:45.431 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:16:45.431 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:16:45.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.388+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4128642912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a840a1360 msgr2=0x7f1a840a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.388+0000 7f1a9b59e700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a840a1360 0x7f1a840a3810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a940a16b0 tx=0x7f1a94009370 comp rx=0 tx=0).stop 2023-07-14T13:16:45.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.388+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4128642912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c1048e0 msgr2=0x7f1a9c195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.388+0000 7f1a9b59e700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c1048e0 0x7f1a9c195650 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400efc0 tx=0x7f1a9400c3a0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.388+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4128642912 shutdown_connections 2023-07-14T13:16:45.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.388+0000 7f1a9b59e700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1a840a1360 0x7f1a840a3810 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.388+0000 7f1a9b59e700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a9c1048e0 0x7f1a9c195650 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.388+0000 7f1a9b59e700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a9c0fe8d0 0x7f1a9c19b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.388+0000 7f1a9b59e700 1 --2- 172.21.15.17:0/4128642912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a9c0ff280 0x7f1a9c19bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.388+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4128642912 >> 172.21.15.17:0/4128642912 conn(0x7f1a9c0745d0 msgr2=0x7f1a9c0fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.388+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4128642912 shutdown_connections 2023-07-14T13:16:45.433 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.389+0000 7f1a9b59e700 1 -- 172.21.15.17:0/4128642912 wait complete. 2023-07-14T13:16:45.453 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:16:45.538 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:45 smithi017 ceph-mon[95536]: pgmap v535: 97 pgs: 97 active+clean; 15 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 MiB/s wr, 12 op/s 2023-07-14T13:16:45.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.664+0000 7f1bdffff700 1 -- 172.21.15.17:0/1090817976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00731c0 msgr2=0x7f1be010bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.664+0000 7f1bdffff700 1 --2- 172.21.15.17:0/1090817976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00731c0 0x7f1be010bcd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009990 tx=0x7f1bd4009ca0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.664+0000 7f1bdffff700 1 -- 172.21.15.17:0/1090817976 shutdown_connections 2023-07-14T13:16:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.664+0000 7f1bdffff700 1 --2- 172.21.15.17:0/1090817976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be010c210 0x7f1be010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.664+0000 7f1bdffff700 1 --2- 172.21.15.17:0/1090817976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1be00728b0 0x7f1be0072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.664+0000 7f1bdffff700 1 --2- 172.21.15.17:0/1090817976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00731c0 0x7f1be010bcd0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.664+0000 7f1bdffff700 1 -- 172.21.15.17:0/1090817976 >> 172.21.15.17:0/1090817976 conn(0x7f1be00fb4b0 msgr2=0x7f1be00fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.664+0000 7f1bdffff700 1 -- 172.21.15.17:0/1090817976 shutdown_connections 2023-07-14T13:16:45.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.664+0000 7f1bdffff700 1 -- 172.21.15.17:0/1090817976 wait complete. 2023-07-14T13:16:45.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.665+0000 7f1bdffff700 1 Processor -- start 2023-07-14T13:16:45.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.665+0000 7f1bdffff700 1 -- start start 2023-07-14T13:16:45.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.665+0000 7f1bdffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00728b0 0x7f1be019d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bdffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1be00731c0 0x7f1be019dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bdffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be010c210 0x7f1be0197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bdffff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0197f00 con 0x7f1be00728b0 2023-07-14T13:16:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bdffff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0198070 con 0x7f1be00731c0 2023-07-14T13:16:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bdffff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0198230 con 0x7f1be010c210 2023-07-14T13:16:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bdeffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00728b0 0x7f1be019d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bde7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1be00731c0 0x7f1be019dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bdeffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00728b0 0x7f1be019d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57360/0 (socket says 172.21.15.17:57360) 2023-07-14T13:16:45.707 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bdeffd700 1 -- 172.21.15.17:0/2998854577 learned_addr learned my addr 172.21.15.17:0/2998854577 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:45.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bdf7fe700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be010c210 0x7f1be0197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bde7fc700 1 -- 172.21.15.17:0/2998854577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be010c210 msgr2=0x7f1be0197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bde7fc700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be010c210 0x7f1be0197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bde7fc700 1 -- 172.21.15.17:0/2998854577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00728b0 msgr2=0x7f1be019d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bde7fc700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00728b0 0x7f1be019d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.666+0000 7f1bde7fc700 1 -- 172.21.15.17:0/2998854577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd0009520 con 0x7f1be00731c0 2023-07-14T13:16:45.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.667+0000 7f1bde7fc700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1be00731c0 0x7f1be019dd60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4000c00 tx=0x7f1bd40057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.709 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:45 smithi135 ceph-mon[97338]: pgmap v535: 97 pgs: 97 active+clean; 15 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 MiB/s wr, 12 op/s 2023-07-14T13:16:45.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.667+0000 7f1be49fd700 1 -- 172.21.15.17:0/2998854577 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd401d070 con 0x7f1be00731c0 2023-07-14T13:16:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.667+0000 7f1bdffff700 1 -- 172.21.15.17:0/2998854577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd40095f0 con 0x7f1be00731c0 2023-07-14T13:16:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.667+0000 7f1be49fd700 1 -- 172.21.15.17:0/2998854577 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bd4021410 con 0x7f1be00731c0 2023-07-14T13:16:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.667+0000 7f1be49fd700 1 -- 172.21.15.17:0/2998854577 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4017650 con 0x7f1be00731c0 2023-07-14T13:16:45.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.667+0000 7f1bdffff700 1 -- 172.21.15.17:0/2998854577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be01a4630 con 0x7f1be00731c0 2023-07-14T13:16:45.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.671+0000 7f1be49fd700 1 -- 172.21.15.17:0/2998854577 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1bd4021580 con 0x7f1be00731c0 2023-07-14T13:16:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.673+0000 7f1bf926eb80 1 Processor -- start 2023-07-14T13:16:45.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.673+0000 7f1bf926eb80 1 -- start start 2023-07-14T13:16:45.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.673+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098c4f0 0x55e2a098c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.673+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098ce00 0x55e2a09967f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.673+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a0996d30 0x55e2a0999110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0891cb0 con 0x55e2a098c4f0 2023-07-14T13:16:45.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a08e4a40 con 0x55e2a0996d30 2023-07-14T13:16:45.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a08dded0 con 0x55e2a098ce00 2023-07-14T13:16:45.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1be49fd700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1bc80a1360 0x7f1bc80a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1be49fd700 1 -- 172.21.15.17:0/2998854577 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1bd40ce010 con 0x7f1be00731c0 2023-07-14T13:16:45.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bdf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098c4f0 0x55e2a098c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bdeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098ce00 0x55e2a09967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bdf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098c4f0 0x55e2a098c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57370/0 (socket says 172.21.15.17:57370) 2023-07-14T13:16:45.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bdf7fe700 1 -- 172.21.15.17:0/428835595 learned_addr learned my addr 172.21.15.17:0/428835595 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:45.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bde7fc700 1 --2- 172.21.15.17:0/428835595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a0996d30 0x55e2a0999110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bdf7fe700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1bc80a1360 0x7f1bc80a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bdeffd700 1 -- 172.21.15.17:0/428835595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a0996d30 msgr2=0x55e2a0999110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/428835595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a0996d30 0x55e2a0999110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bdeffd700 1 -- 172.21.15.17:0/428835595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098c4f0 msgr2=0x55e2a098c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/428835595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098c4f0 0x55e2a098c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bdeffd700 1 -- 172.21.15.17:0/428835595 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2a070bde0 con 0x55e2a098ce00 2023-07-14T13:16:45.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.674+0000 7f1bdf7fe700 1 --2- 172.21.15.17:0/428835595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098c4f0 0x55e2a098c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:16:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.675+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/428835595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098ce00 0x55e2a09967f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009f00 tx=0x7f1bd0011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50668203b22c00e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.675+0000 7f1bdf7fe700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1bc80a1360 0x7f1bc80a3810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009fd0 tx=0x7f1bd800b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.675+0000 7f1bc5ffb700 1 -- 172.21.15.17:0/428835595 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0004a30 con 0x55e2a098ce00 2023-07-14T13:16:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.675+0000 7f1bc5ffb700 1 -- 172.21.15.17:0/428835595 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bd00054b0 con 0x55e2a098ce00 2023-07-14T13:16:45.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.675+0000 7f1bc5ffb700 1 -- 172.21.15.17:0/428835595 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000f7b0 con 0x55e2a098ce00 2023-07-14T13:16:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.676+0000 7f1bf926eb80 1 -- 172.21.15.17:0/428835595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098ce00 msgr2=0x55e2a09967f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.676+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/428835595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098ce00 0x55e2a09967f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009f00 tx=0x7f1bd0011720 comp rx=0 tx=0).stop 2023-07-14T13:16:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.676+0000 7f1bf926eb80 1 -- 172.21.15.17:0/428835595 shutdown_connections 2023-07-14T13:16:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.676+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/428835595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a0996d30 0x55e2a0999110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.676+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/428835595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098c4f0 0x55e2a098c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.676+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/428835595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098ce00 0x55e2a09967f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.676+0000 7f1bf926eb80 1 -- 172.21.15.17:0/428835595 >> 172.21.15.17:0/428835595 conn(0x55e2a0981ff0 msgr2=0x55e2a0987930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.676+0000 7f1bf926eb80 1 -- 172.21.15.17:0/428835595 shutdown_connections 2023-07-14T13:16:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.676+0000 7f1bf926eb80 1 -- 172.21.15.17:0/428835595 wait complete. 2023-07-14T13:16:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.677+0000 7f1bf926eb80 1 -- start start 2023-07-14T13:16:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.677+0000 7f1bf926eb80 1 Processor -- start 2023-07-14T13:16:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.677+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098c4f0 0x55e2a09966b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.677+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098ce00 0x55e2a09938c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.677+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a0996d30 0x55e2a0993e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a087dac0 con 0x55e2a098ce00 2023-07-14T13:16:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a087d7c0 con 0x55e2a098c4f0 2023-07-14T13:16:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0761920 con 0x55e2a0996d30 2023-07-14T13:16:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bf926eb80 10 client.0 _ll_register_callbacks cb 0x55e2a087b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bdeffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098c4f0 0x55e2a09966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bdeffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098c4f0 0x55e2a09966b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51868/0 (socket says 172.21.15.17:51868) 2023-07-14T13:16:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bdeffd700 1 -- 172.21.15.17:0/2422846636 learned_addr learned my addr 172.21.15.17:0/2422846636 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bde7fc700 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098ce00 0x55e2a09938c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bdf7fe700 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a0996d30 0x55e2a0993e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bdeffd700 1 -- 172.21.15.17:0/2422846636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a0996d30 msgr2=0x55e2a0993e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a0996d30 0x55e2a0993e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bdeffd700 1 -- 172.21.15.17:0/2422846636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098ce00 msgr2=0x55e2a09938c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098ce00 0x55e2a09938c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.678+0000 7f1bdeffd700 1 -- 172.21.15.17:0/2422846636 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd0009b30 con 0x55e2a098c4f0 2023-07-14T13:16:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.679+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098c4f0 0x55e2a09966b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009ad0 tx=0x7f1bd0004bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4980408ce01c21c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.679+0000 7f1bbeffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:16:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.679+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2422846636 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0004e90 con 0x55e2a098c4f0 2023-07-14T13:16:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.679+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2422846636 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1bd0004ff0 con 0x55e2a098c4f0 2023-07-14T13:16:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.679+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2422846636 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2a08374f0 con 0x55e2a098c4f0 2023-07-14T13:16:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.679+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2422846636 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bd00051b0 con 0x55e2a098c4f0 2023-07-14T13:16:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.679+0000 7f1bf926eb80 10 client.28151 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.679+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2422846636 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55e2a06f4c60 con 0x55e2a098c4f0 2023-07-14T13:16:45.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.680+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2422846636 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e2a08374f0 con 0x55e2a098c4f0 2023-07-14T13:16:45.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.680+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2422846636 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1bd0024430 con 0x55e2a098c4f0 2023-07-14T13:16:45.725 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.680+0000 7f1bf926eb80 10 client.28151 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.680+0000 7f1bf926eb80 10 client.28151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.680+0000 7f1bf926eb80 20 client.28151 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.680+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e2a09a6550 0x55e2a09a8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.680+0000 7f1bf926eb80 4 client.28151 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.680+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2422846636 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2a08d6eb0 con 0x55e2a09a6550 2023-07-14T13:16:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.680+0000 7f1bde7fc700 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e2a09a6550 0x55e2a09a8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.681+0000 7f1bde7fc700 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e2a09a6550 0x55e2a09a8930 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13ade57d2cb3a2f8 server_cookie=501935540d95c5b in_seq=0 out_seq=0 2023-07-14T13:16:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.681+0000 7f1bbeffd700 10 client.28151 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2422846636 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e2a08d6eb0 con 0x55e2a09a6550 2023-07-14T13:16:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bbeffd700 10 client.28151 handle_command_reply: tid=0 2023-07-14T13:16:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 1 client.28151 shutdown 2023-07-14T13:16:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2422846636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098c4f0 msgr2=0x55e2a09966b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098c4f0 0x55e2a09966b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009ad0 tx=0x7f1bd0004bc0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2422846636 shutdown_connections 2023-07-14T13:16:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e2a09a6550 0x55e2a09a8930 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a0996d30 0x55e2a0993e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098c4f0 0x55e2a09966b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bbeffd700 0 client.28151 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2422846636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098ce00 0x55e2a09938c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2422846636 >> 172.21.15.17:0/2422846636 conn(0x55e2a0981ff0 msgr2=0x55e2a0987520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2422846636 shutdown_connections 2023-07-14T13:16:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2422846636 wait complete. 2023-07-14T13:16:45.729 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.682+0000 7f1bf926eb80 20 client.28151 trim_cache size 0 max 16384 2023-07-14T13:16:45.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.704+0000 7f1bf926eb80 1 Processor -- start 2023-07-14T13:16:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.704+0000 7f1bf926eb80 1 -- start start 2023-07-14T13:16:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.704+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.704+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098ce00 0x55e2a09a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.704+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a0996d30 0x55e2a0987460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0987e70 con 0x55e2a098ce00 2023-07-14T13:16:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a098d5b0 con 0x55e2a0996d30 2023-07-14T13:16:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a098d1d0 con 0x55e2a098c4f0 2023-07-14T13:16:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bde7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098ce00 0x55e2a09a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bdeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bdeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47808/0 (socket says 172.21.15.17:47808) 2023-07-14T13:16:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bdeffd700 1 -- 172.21.15.17:0/4250063013 learned_addr learned my addr 172.21.15.17:0/4250063013 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bdf7fe700 1 --2- 172.21.15.17:0/4250063013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a0996d30 0x55e2a0987460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bdeffd700 1 -- 172.21.15.17:0/4250063013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a0996d30 msgr2=0x55e2a0987460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/4250063013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a0996d30 0x55e2a0987460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bdeffd700 1 -- 172.21.15.17:0/4250063013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098ce00 msgr2=0x55e2a09a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/4250063013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098ce00 0x55e2a09a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bdeffd700 1 -- 172.21.15.17:0/4250063013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2a0732250 con 0x55e2a098c4f0 2023-07-14T13:16:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.705+0000 7f1bde7fc700 1 --2- 172.21.15.17:0/4250063013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098ce00 0x55e2a09a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.706+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/4250063013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0011760 tx=0x7f1bd0011b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b55c5716ad4d70f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.706+0000 7f1bc67fc700 1 -- 172.21.15.17:0/4250063013 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0024a80 con 0x55e2a098c4f0 2023-07-14T13:16:45.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.706+0000 7f1bc67fc700 1 -- 172.21.15.17:0/4250063013 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bd0024430 con 0x55e2a098c4f0 2023-07-14T13:16:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.706+0000 7f1bc67fc700 1 -- 172.21.15.17:0/4250063013 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0005130 con 0x55e2a098c4f0 2023-07-14T13:16:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.707+0000 7f1bf926eb80 1 -- 172.21.15.17:0/4250063013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 msgr2=0x55e2a099d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.707+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/4250063013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0011760 tx=0x7f1bd0011b20 comp rx=0 tx=0).stop 2023-07-14T13:16:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.707+0000 7f1bf926eb80 1 -- 172.21.15.17:0/4250063013 shutdown_connections 2023-07-14T13:16:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.707+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/4250063013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a0996d30 0x55e2a0987460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.707+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/4250063013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d840 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.707+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/4250063013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a098ce00 0x55e2a09a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.707+0000 7f1bf926eb80 1 -- 172.21.15.17:0/4250063013 >> 172.21.15.17:0/4250063013 conn(0x55e2a0981ff0 msgr2=0x55e2a09a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.707+0000 7f1bf926eb80 1 -- 172.21.15.17:0/4250063013 shutdown_connections 2023-07-14T13:16:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.707+0000 7f1bf926eb80 1 -- 172.21.15.17:0/4250063013 wait complete. 2023-07-14T13:16:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.707+0000 7f1bf926eb80 1 -- start start 2023-07-14T13:16:45.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.708+0000 7f1bf926eb80 1 Processor -- start 2023-07-14T13:16:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.708+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.708+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098ce00 0x55e2a099b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.708+0000 7f1bf926eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a0996d30 0x55e2a099bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.708+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a099c3e0 con 0x55e2a0996d30 2023-07-14T13:16:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.708+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a099c550 con 0x55e2a098ce00 2023-07-14T13:16:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.708+0000 7f1bf926eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a099c710 con 0x55e2a098c4f0 2023-07-14T13:16:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.708+0000 7f1bf926eb80 10 client.0 _ll_register_callbacks cb 0x7f1bd0009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bdf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a0996d30 0x55e2a099bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bdeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bde7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098ce00 0x55e2a099b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bde7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098ce00 0x55e2a099b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51894/0 (socket says 172.21.15.17:51894) 2023-07-14T13:16:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bdeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47814/0 (socket says 172.21.15.17:47814) 2023-07-14T13:16:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bde7fc700 1 -- 172.21.15.17:0/2715788152 learned_addr learned my addr 172.21.15.17:0/2715788152 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bdf7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a0996d30 0x55e2a099bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57396/0 (socket says 172.21.15.17:57396) 2023-07-14T13:16:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bdeffd700 1 -- 172.21.15.17:0/2715788152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098ce00 msgr2=0x55e2a099b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098ce00 0x55e2a099b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bdeffd700 1 -- 172.21.15.17:0/2715788152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a0996d30 msgr2=0x55e2a099bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a0996d30 0x55e2a099bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bdeffd700 1 -- 172.21.15.17:0/2715788152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be01a4630 con 0x55e2a098c4f0 2023-07-14T13:16:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bdf7fe700 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a0996d30 0x55e2a099bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bdeffd700 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d670 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0004d80 tx=0x7f1bd0004ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6e29991d219e995 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.709+0000 7f1bbeffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:16:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.710+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2715788152 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000eb40 con 0x55e2a098c4f0 2023-07-14T13:16:45.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.710+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2715788152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1bd00054b0 con 0x55e2a098c4f0 2023-07-14T13:16:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.710+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2715788152 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1bd0000e40 con 0x55e2a098c4f0 2023-07-14T13:16:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.710+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2715788152 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bd000eca0 con 0x55e2a098c4f0 2023-07-14T13:16:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.710+0000 7f1bf926eb80 10 client.28123 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.710+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2715788152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55e2a06f4c60 con 0x55e2a098c4f0 2023-07-14T13:16:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.710+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2715788152 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bd00054b0 con 0x55e2a098c4f0 2023-07-14T13:16:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.710+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2715788152 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1bd000e6b0 con 0x55e2a098c4f0 2023-07-14T13:16:45.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.711+0000 7f1bf926eb80 10 client.28123 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.711+0000 7f1bf926eb80 10 client.28123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.711+0000 7f1bf926eb80 20 client.28123 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.711+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e2a09fb2f0 0x55e2a09fd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.711+0000 7f1bf926eb80 4 client.28123 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:16:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.711+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2715788152 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e2a0899050 con 0x55e2a09fb2f0 2023-07-14T13:16:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.711+0000 7f1bde7fc700 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e2a09fb2f0 0x55e2a09fd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.711+0000 7f1bde7fc700 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e2a09fb2f0 0x55e2a09fd6d0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a023d3e99fce6f73 server_cookie=733a32f996ea270f in_seq=0 out_seq=0 2023-07-14T13:16:45.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.711+0000 7f1bbeffd700 10 client.28123 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bbeffd700 1 -- 172.21.15.17:0/2715788152 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e2a0899050 con 0x55e2a09fb2f0 2023-07-14T13:16:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bbeffd700 10 client.28123 handle_command_reply: tid=0 2023-07-14T13:16:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 1 client.28123 shutdown 2023-07-14T13:16:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2715788152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 msgr2=0x55e2a099d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d670 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0004d80 tx=0x7f1bd0004ba0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2715788152 shutdown_connections 2023-07-14T13:16:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e2a09fb2f0 0x55e2a09fd6d0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e2a0996d30 0x55e2a099bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2a098c4f0 0x55e2a099d670 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 1 --2- 172.21.15.17:0/2715788152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a098ce00 0x55e2a099b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bbeffd700 0 client.28123 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:45.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2715788152 >> 172.21.15.17:0/2715788152 conn(0x55e2a0981ff0 msgr2=0x55e2a09a1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2715788152 shutdown_connections 2023-07-14T13:16:45.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 1 -- 172.21.15.17:0/2715788152 wait complete. 2023-07-14T13:16:45.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.712+0000 7f1bf926eb80 20 client.28123 trim_cache size 0 max 16384 2023-07-14T13:16:45.760 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:16:45.760 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:16:45.760 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:16:45.760 INFO:teuthology.orchestra.run.smithi017.stdout: "8c13ab33-9f06-43b5-98c1-3af85d6173f4": { 2023-07-14T13:16:45.761 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:16:45.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8c13ab33-9f06-43b5-98c1-3af85d6173f4", 2023-07-14T13:16:45.761 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:16:45.761 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:16:45.761 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:16:45.761 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:16:45.762 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:45 smithi131 ceph-mon[96953]: pgmap v535: 97 pgs: 97 active+clean; 15 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 17 MiB/s wr, 12 op/s 2023-07-14T13:16:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 -- 172.21.15.17:0/2998854577 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1bc80a1360 msgr2=0x7f1bc80a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1bc80a1360 0x7f1bc80a3810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009fd0 tx=0x7f1bd800b040 comp rx=0 tx=0).stop 2023-07-14T13:16:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 -- 172.21.15.17:0/2998854577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1be00731c0 msgr2=0x7f1be019dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1be00731c0 0x7f1be019dd60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4000c00 tx=0x7f1bd40057c0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 -- 172.21.15.17:0/2998854577 shutdown_connections 2023-07-14T13:16:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1bc80a1360 0x7f1bc80a3810 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1be010c210 0x7f1be0197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1be00728b0 0x7f1be019d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 --2- 172.21.15.17:0/2998854577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1be00731c0 0x7f1be019dd60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:45.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 -- 172.21.15.17:0/2998854577 >> 172.21.15.17:0/2998854577 conn(0x7f1be00fb4b0 msgr2=0x7f1be0103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:45.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 -- 172.21.15.17:0/2998854577 shutdown_connections 2023-07-14T13:16:45.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:16:45.713+0000 7f1bdffff700 1 -- 172.21.15.17:0/2998854577 wait complete. 2023-07-14T13:16:45.771 INFO:tasks.cephfs.filesystem:scrub status for tag:8c13ab33-9f06-43b5-98c1-3af85d6173f4 - {'path': '/', 'tag': '8c13ab33-9f06-43b5-98c1-3af85d6173f4', 'options': 'recursive,force'} 2023-07-14T13:16:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.543+0000 7f665099d700 1 -- 172.21.15.17:0/1381497703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f664c104ca0 msgr2=0x7f664c10c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.543+0000 7f665099d700 1 --2- 172.21.15.17:0/1381497703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f664c104ca0 0x7f664c10c7c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f664400b0d0 tx=0x7f664400b3e0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.543+0000 7f665099d700 1 -- 172.21.15.17:0/1381497703 shutdown_connections 2023-07-14T13:16:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.543+0000 7f665099d700 1 --2- 172.21.15.17:0/1381497703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f664c104ca0 0x7f664c10c7c0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.543+0000 7f665099d700 1 --2- 172.21.15.17:0/1381497703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f664c067b70 0x7f664c067f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.543+0000 7f665099d700 1 --2- 172.21.15.17:0/1381497703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f664c068510 0x7f664c104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.543+0000 7f665099d700 1 -- 172.21.15.17:0/1381497703 >> 172.21.15.17:0/1381497703 conn(0x7f664c0748e0 msgr2=0x7f664c074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.543+0000 7f665099d700 1 -- 172.21.15.17:0/1381497703 shutdown_connections 2023-07-14T13:16:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.543+0000 7f665099d700 1 -- 172.21.15.17:0/1381497703 wait complete. 2023-07-14T13:16:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.544+0000 7f665099d700 1 Processor -- start 2023-07-14T13:16:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.544+0000 7f665099d700 1 -- start start 2023-07-14T13:16:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.545+0000 7f665099d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f664c067b70 0x7f664c19d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.545+0000 7f665099d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f664c068510 0x7f664c19dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.545+0000 7f665099d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f664c104ca0 0x7f664c197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.545+0000 7f665099d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c197f80 con 0x7f664c068510 2023-07-14T13:16:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.545+0000 7f665099d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c1980f0 con 0x7f664c104ca0 2023-07-14T13:16:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.545+0000 7f665099d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664c1982b0 con 0x7f664c067b70 2023-07-14T13:16:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.545+0000 7f664affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f664c068510 0x7f664c19dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.545+0000 7f664affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f664c068510 0x7f664c19dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57410/0 (socket says 172.21.15.17:57410) 2023-07-14T13:16:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.545+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f664c067b70 0x7f664c19d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.545+0000 7f664affd700 1 -- 172.21.15.17:0/3121112772 learned_addr learned my addr 172.21.15.17:0/3121112772 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.545+0000 7f664bfff700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f664c104ca0 0x7f664c197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f664affd700 1 -- 172.21.15.17:0/3121112772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f664c067b70 msgr2=0x7f664c19d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f664affd700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f664c067b70 0x7f664c19d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f664affd700 1 -- 172.21.15.17:0/3121112772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f664c104ca0 msgr2=0x7f664c197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f664affd700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f664c104ca0 0x7f664c197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f664affd700 1 -- 172.21.15.17:0/3121112772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644009d00 con 0x7f664c068510 2023-07-14T13:16:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f664bfff700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f664c104ca0 0x7f664c197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f664affd700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f664c068510 0x7f664c19dde0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f664000e910 tx=0x7f664000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f6648ff9700 1 -- 172.21.15.17:0/3121112772 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640004a30 con 0x7f664c068510 2023-07-14T13:16:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f6648ff9700 1 -- 172.21.15.17:0/3121112772 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66400054b0 con 0x7f664c068510 2023-07-14T13:16:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f665099d700 1 -- 172.21.15.17:0/3121112772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664c198590 con 0x7f664c068510 2023-07-14T13:16:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f6648ff9700 1 -- 172.21.15.17:0/3121112772 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664000cb30 con 0x7f664c068510 2023-07-14T13:16:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.546+0000 7f665099d700 1 -- 172.21.15.17:0/3121112772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664c1a4890 con 0x7f664c068510 2023-07-14T13:16:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.551+0000 7f6648ff9700 1 -- 172.21.15.17:0/3121112772 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f664000ccd0 con 0x7f664c068510 2023-07-14T13:16:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.552+0000 7f66654dcb80 1 Processor -- start 2023-07-14T13:16:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.552+0000 7f66654dcb80 1 -- start start 2023-07-14T13:16:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 0x55e60c166f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c167470 0x55e60c1611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c1678c0 0x55e60c161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f66654dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60c066c50 con 0x55e60c1678c0 2023-07-14T13:16:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f66654dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60c0b99e0 con 0x55e60c167470 2023-07-14T13:16:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f66654dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60c0b2e70 con 0x55e60bfbd6b0 2023-07-14T13:16:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c167470 0x55e60c1611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f664bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 0x55e60c166f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f664bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 0x55e60c166f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47834/0 (socket says 172.21.15.17:47834) 2023-07-14T13:16:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c167470 0x55e60c1611a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51912/0 (socket says 172.21.15.17:51912) 2023-07-14T13:16:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f664bfff700 1 -- 172.21.15.17:0/2566189296 learned_addr learned my addr 172.21.15.17:0/2566189296 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f6648ff9700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66340a13e0 0x7f66340a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.553+0000 7f664affd700 1 --2- 172.21.15.17:0/2566189296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c1678c0 0x55e60c161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f6648ff9700 1 -- 172.21.15.17:0/3121112772 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6640014070 con 0x7f664c068510 2023-07-14T13:16:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f664b7fe700 1 -- 172.21.15.17:0/2566189296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 msgr2=0x55e60c166f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f664b7fe700 1 --2- 172.21.15.17:0/2566189296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 0x55e60c166f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f664b7fe700 1 -- 172.21.15.17:0/2566189296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c1678c0 msgr2=0x55e60c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f664b7fe700 1 --2- 172.21.15.17:0/2566189296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c1678c0 0x55e60c161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f664b7fe700 1 -- 172.21.15.17:0/2566189296 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e60bee0d80 con 0x55e60c167470 2023-07-14T13:16:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f664affd700 1 --2- 172.21.15.17:0/2566189296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c1678c0 0x55e60c161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:16:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f664bfff700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66340a13e0 0x7f66340a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f664b7fe700 1 --2- 172.21.15.17:0/2566189296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c167470 0x55e60c1611a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f663c009cb0 tx=0x7f663c011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef68669620b03111 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f6631ffb700 1 -- 172.21.15.17:0/2566189296 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c011d20 con 0x55e60c167470 2023-07-14T13:16:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f6631ffb700 1 -- 172.21.15.17:0/2566189296 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f663c011e80 con 0x55e60c167470 2023-07-14T13:16:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.554+0000 7f6631ffb700 1 -- 172.21.15.17:0/2566189296 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c005280 con 0x55e60c167470 2023-07-14T13:16:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.555+0000 7f66654dcb80 1 -- 172.21.15.17:0/2566189296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c167470 msgr2=0x55e60c1611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.555+0000 7f664bfff700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66340a13e0 0x7f66340a3890 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6644007f80 tx=0x7f664400b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.555+0000 7f66654dcb80 1 --2- 172.21.15.17:0/2566189296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c167470 0x55e60c1611a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f663c009cb0 tx=0x7f663c011440 comp rx=0 tx=0).stop 2023-07-14T13:16:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.555+0000 7f66654dcb80 1 -- 172.21.15.17:0/2566189296 shutdown_connections 2023-07-14T13:16:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.555+0000 7f66654dcb80 1 --2- 172.21.15.17:0/2566189296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c1678c0 0x55e60c161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.555+0000 7f66654dcb80 1 --2- 172.21.15.17:0/2566189296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 0x55e60c166f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.555+0000 7f66654dcb80 1 --2- 172.21.15.17:0/2566189296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c167470 0x55e60c1611a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.555+0000 7f66654dcb80 1 -- 172.21.15.17:0/2566189296 >> 172.21.15.17:0/2566189296 conn(0x55e60c156d40 msgr2=0x55e60c15c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.556+0000 7f66654dcb80 1 -- 172.21.15.17:0/2566189296 shutdown_connections 2023-07-14T13:16:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.556+0000 7f66654dcb80 1 -- 172.21.15.17:0/2566189296 wait complete. 2023-07-14T13:16:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.556+0000 7f66654dcb80 1 -- start start 2023-07-14T13:16:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f66654dcb80 1 Processor -- start 2023-07-14T13:16:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 0x55e60c16d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c16aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c1678c0 0x55e60c16b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f66654dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60c052a60 con 0x55e60c167470 2023-07-14T13:16:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f66654dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60c052760 con 0x55e60c1678c0 2023-07-14T13:16:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f66654dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60bf368c0 con 0x55e60bfbd6b0 2023-07-14T13:16:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f66654dcb80 10 client.0 _ll_register_callbacks cb 0x55e60c050700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f664affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c16aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 0x55e60c16d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f664bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c1678c0 0x55e60c16b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 0x55e60c16d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47844/0 (socket says 172.21.15.17:47844) 2023-07-14T13:16:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f664affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c16aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57436/0 (socket says 172.21.15.17:57436) 2023-07-14T13:16:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.557+0000 7f664b7fe700 1 -- 172.21.15.17:0/3330123354 learned_addr learned my addr 172.21.15.17:0/3330123354 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.558+0000 7f664b7fe700 1 -- 172.21.15.17:0/3330123354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c1678c0 msgr2=0x55e60c16b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.558+0000 7f664b7fe700 1 --2- 172.21.15.17:0/3330123354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c1678c0 0x55e60c16b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.558+0000 7f664b7fe700 1 -- 172.21.15.17:0/3330123354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 msgr2=0x55e60c16aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.558+0000 7f664b7fe700 1 --2- 172.21.15.17:0/3330123354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c16aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.558+0000 7f664b7fe700 1 -- 172.21.15.17:0/3330123354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c0098e0 con 0x55e60bfbd6b0 2023-07-14T13:16:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.558+0000 7f664b7fe700 1 --2- 172.21.15.17:0/3330123354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 0x55e60c16d790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f663c00a010 tx=0x7f663c005df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f013d0278964874 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.558+0000 7f662affd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:16:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.558+0000 7f662affd700 1 -- 172.21.15.17:0/3330123354 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c004ec0 con 0x55e60bfbd6b0 2023-07-14T13:16:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.559+0000 7f662affd700 1 -- 172.21.15.17:0/3330123354 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f663c005020 con 0x55e60bfbd6b0 2023-07-14T13:16:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.559+0000 7f66654dcb80 1 -- 172.21.15.17:0/3330123354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e60c0abe50 con 0x55e60bfbd6b0 2023-07-14T13:16:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.559+0000 7f662affd700 1 -- 172.21.15.17:0/3330123354 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f663c0051e0 con 0x55e60bfbd6b0 2023-07-14T13:16:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.559+0000 7f66654dcb80 10 client.28135 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.559+0000 7f66654dcb80 1 -- 172.21.15.17:0/3330123354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55e60bec9c00 con 0x55e60bfbd6b0 2023-07-14T13:16:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.559+0000 7f662affd700 1 -- 172.21.15.17:0/3330123354 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e60c0abe50 con 0x55e60bfbd6b0 2023-07-14T13:16:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.559+0000 7f662affd700 1 -- 172.21.15.17:0/3330123354 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f663c022ad0 con 0x55e60bfbd6b0 2023-07-14T13:16:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.559+0000 7f66654dcb80 10 client.28135 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.559+0000 7f66654dcb80 10 client.28135 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.559+0000 7f66654dcb80 20 client.28135 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.559+0000 7f66654dcb80 1 --2- 172.21.15.17:0/3330123354 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e60c17ab70 0x55e60c17cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.560+0000 7f66654dcb80 4 client.28135 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.560+0000 7f66654dcb80 1 -- 172.21.15.17:0/3330123354 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e60c06dff0 con 0x55e60c17ab70 2023-07-14T13:16:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.560+0000 7f664affd700 1 --2- 172.21.15.17:0/3330123354 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e60c17ab70 0x55e60c17cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.560+0000 7f664affd700 1 --2- 172.21.15.17:0/3330123354 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e60c17ab70 0x55e60c17cf50 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88f5de5f67df7e23 server_cookie=4fcb86a5b6bcf4c9 in_seq=0 out_seq=0 2023-07-14T13:16:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.560+0000 7f662affd700 10 client.28135 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.561+0000 7f662affd700 1 -- 172.21.15.17:0/3330123354 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e60c06dff0 con 0x55e60c17ab70 2023-07-14T13:16:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.561+0000 7f662affd700 10 client.28135 handle_command_reply: tid=0 2023-07-14T13:16:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.561+0000 7f66654dcb80 1 client.28135 shutdown 2023-07-14T13:16:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.561+0000 7f66654dcb80 1 -- 172.21.15.17:0/3330123354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 msgr2=0x55e60c16d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.561+0000 7f66654dcb80 1 --2- 172.21.15.17:0/3330123354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 0x55e60c16d790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f663c00a010 tx=0x7f663c005df0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.561+0000 7f66654dcb80 1 -- 172.21.15.17:0/3330123354 shutdown_connections 2023-07-14T13:16:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.561+0000 7f66654dcb80 1 --2- 172.21.15.17:0/3330123354 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e60c17ab70 0x55e60c17cf50 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.562+0000 7f66654dcb80 1 --2- 172.21.15.17:0/3330123354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60c1678c0 0x55e60c16b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.562+0000 7f662affd700 0 client.28135 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.562+0000 7f66654dcb80 1 --2- 172.21.15.17:0/3330123354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60bfbd6b0 0x55e60c16d790 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.562+0000 7f66654dcb80 1 --2- 172.21.15.17:0/3330123354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c16aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.562+0000 7f66654dcb80 1 -- 172.21.15.17:0/3330123354 >> 172.21.15.17:0/3330123354 conn(0x55e60c156d40 msgr2=0x55e60c15b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.562+0000 7f66654dcb80 1 -- 172.21.15.17:0/3330123354 shutdown_connections 2023-07-14T13:16:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.562+0000 7f66654dcb80 1 -- 172.21.15.17:0/3330123354 wait complete. 2023-07-14T13:16:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.562+0000 7f66654dcb80 20 client.28135 trim_cache size 0 max 16384 2023-07-14T13:16:46.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:46 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:16:46.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:46 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:46.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:46 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:16:46.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:46 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:16:46.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:46 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.579+0000 7f66654dcb80 1 Processor -- start 2023-07-14T13:16:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.579+0000 7f66654dcb80 1 -- start start 2023-07-14T13:16:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.580+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 0x55e60c171d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.580+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c1683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.580+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60c1678c0 0x55e60c16d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.580+0000 7f66654dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60c16bfc0 con 0x55e60c167470 2023-07-14T13:16:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.580+0000 7f66654dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60c1656c0 con 0x55e60bfbd6b0 2023-07-14T13:16:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.580+0000 7f66654dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60c15cf10 con 0x55e60c1678c0 2023-07-14T13:16:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.580+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 0x55e60c171d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.580+0000 7f664bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60c1678c0 0x55e60c16d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.580+0000 7f664affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c1683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.580+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 0x55e60c171d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51932/0 (socket says 172.21.15.17:51932) 2023-07-14T13:16:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.580+0000 7f664b7fe700 1 -- 172.21.15.17:0/3879461445 learned_addr learned my addr 172.21.15.17:0/3879461445 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.581+0000 7f664b7fe700 1 -- 172.21.15.17:0/3879461445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60c1678c0 msgr2=0x55e60c16d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.581+0000 7f664b7fe700 1 --2- 172.21.15.17:0/3879461445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60c1678c0 0x55e60c16d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.581+0000 7f664b7fe700 1 -- 172.21.15.17:0/3879461445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 msgr2=0x55e60c1683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.581+0000 7f664b7fe700 1 --2- 172.21.15.17:0/3879461445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c1683e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.581+0000 7f664b7fe700 1 -- 172.21.15.17:0/3879461445 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e60bf071f0 con 0x55e60bfbd6b0 2023-07-14T13:16:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.581+0000 7f664b7fe700 1 --2- 172.21.15.17:0/3879461445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 0x55e60c171d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f663c005dc0 tx=0x7f663c004b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c62b68277ef510e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.581+0000 7f66327fc700 1 -- 172.21.15.17:0/3879461445 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c0046f0 con 0x55e60bfbd6b0 2023-07-14T13:16:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.581+0000 7f66327fc700 1 -- 172.21.15.17:0/3879461445 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f663c004850 con 0x55e60bfbd6b0 2023-07-14T13:16:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.581+0000 7f66327fc700 1 -- 172.21.15.17:0/3879461445 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c022660 con 0x55e60bfbd6b0 2023-07-14T13:16:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.582+0000 7f66654dcb80 1 -- 172.21.15.17:0/3879461445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 msgr2=0x55e60c171d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.582+0000 7f66654dcb80 1 --2- 172.21.15.17:0/3879461445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 0x55e60c171d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f663c005dc0 tx=0x7f663c004b10 comp rx=0 tx=0).stop 2023-07-14T13:16:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.582+0000 7f66654dcb80 1 -- 172.21.15.17:0/3879461445 shutdown_connections 2023-07-14T13:16:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.582+0000 7f66654dcb80 1 --2- 172.21.15.17:0/3879461445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60c1678c0 0x55e60c16d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.582+0000 7f66654dcb80 1 --2- 172.21.15.17:0/3879461445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 0x55e60c171d90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.582+0000 7f66654dcb80 1 --2- 172.21.15.17:0/3879461445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c1683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.582+0000 7f66654dcb80 1 -- 172.21.15.17:0/3879461445 >> 172.21.15.17:0/3879461445 conn(0x55e60c156d40 msgr2=0x55e60c167cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.582+0000 7f66654dcb80 1 -- 172.21.15.17:0/3879461445 shutdown_connections 2023-07-14T13:16:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.582+0000 7f66654dcb80 1 -- 172.21.15.17:0/3879461445 wait complete. 2023-07-14T13:16:46.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.583+0000 7f66654dcb80 1 -- start start 2023-07-14T13:16:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.583+0000 7f66654dcb80 1 Processor -- start 2023-07-14T13:16:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.583+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 0x55e60c163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.583+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c164110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.583+0000 7f66654dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60c1678c0 0x55e60c162990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.583+0000 7f66654dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60c162ed0 con 0x55e60c167470 2023-07-14T13:16:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.583+0000 7f66654dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60c163040 con 0x55e60bfbd6b0 2023-07-14T13:16:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.583+0000 7f66654dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e60c163200 con 0x55e60c1678c0 2023-07-14T13:16:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.583+0000 7f66654dcb80 10 client.0 _ll_register_callbacks cb 0x7f663c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 0x55e60c163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60c1678c0 0x55e60c162990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c164110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 0x55e60c163bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51934/0 (socket says 172.21.15.17:51934) 2023-07-14T13:16:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664b7fe700 1 -- 172.21.15.17:0/2249685835 learned_addr learned my addr 172.21.15.17:0/2249685835 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664bfff700 1 -- 172.21.15.17:0/2249685835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 msgr2=0x55e60c163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664bfff700 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 0x55e60c163bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664bfff700 1 -- 172.21.15.17:0/2249685835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 msgr2=0x55e60c164110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664bfff700 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c164110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664bfff700 1 -- 172.21.15.17:0/2249685835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e60bec9c00 con 0x55e60c1678c0 2023-07-14T13:16:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664affd700 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c164110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f664bfff700 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60c1678c0 0x55e60c162990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6644009610 tx=0x7f6644006210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71723ce7c0320fad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.584+0000 7f662affd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:16:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.585+0000 7f662affd700 1 -- 172.21.15.17:0/2249685835 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644024040 con 0x55e60c1678c0 2023-07-14T13:16:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.585+0000 7f66654dcb80 1 -- 172.21.15.17:0/2249685835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e60c00c490 con 0x55e60c1678c0 2023-07-14T13:16:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.585+0000 7f662affd700 1 -- 172.21.15.17:0/2249685835 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f664401ecd0 con 0x55e60c1678c0 2023-07-14T13:16:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.585+0000 7f662affd700 1 -- 172.21.15.17:0/2249685835 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f664400e040 con 0x55e60c1678c0 2023-07-14T13:16:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.585+0000 7f66654dcb80 10 client.28141 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.585+0000 7f66654dcb80 1 -- 172.21.15.17:0/2249685835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55e60bedf250 con 0x55e60c1678c0 2023-07-14T13:16:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.585+0000 7f662affd700 1 -- 172.21.15.17:0/2249685835 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e60c00c490 con 0x55e60c1678c0 2023-07-14T13:16:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.585+0000 7f662affd700 1 -- 172.21.15.17:0/2249685835 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f664402c400 con 0x55e60c1678c0 2023-07-14T13:16:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.586+0000 7f66654dcb80 10 client.28141 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.586+0000 7f66654dcb80 10 client.28141 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.586+0000 7f66654dcb80 20 client.28141 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.586+0000 7f66654dcb80 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e60c1cf730 0x55e60c1d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.586+0000 7f66654dcb80 4 client.28141 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:16:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.586+0000 7f66654dcb80 1 -- 172.21.15.17:0/2249685835 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e60bf01f10 con 0x55e60c1cf730 2023-07-14T13:16:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.586+0000 7f664b7fe700 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e60c1cf730 0x55e60c1d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.586+0000 7f664b7fe700 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e60c1cf730 0x55e60c1d1b40 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ae61b0f265d2ea3 server_cookie=700553b19b5fc0f5 in_seq=0 out_seq=0 2023-07-14T13:16:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.586+0000 7f662affd700 10 client.28141 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.595+0000 7f662affd700 1 -- 172.21.15.17:0/2249685835 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e60bf01f10 con 0x55e60c1cf730 2023-07-14T13:16:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.595+0000 7f662affd700 10 client.28141 handle_command_reply: tid=0 2023-07-14T13:16:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.595+0000 7f66654dcb80 1 client.28141 shutdown 2023-07-14T13:16:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.595+0000 7f66654dcb80 1 -- 172.21.15.17:0/2249685835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60c1678c0 msgr2=0x55e60c162990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.595+0000 7f66654dcb80 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60c1678c0 0x55e60c162990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6644009610 tx=0x7f6644006210 comp rx=0 tx=0).stop 2023-07-14T13:16:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.596+0000 7f66654dcb80 1 -- 172.21.15.17:0/2249685835 shutdown_connections 2023-07-14T13:16:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.596+0000 7f66654dcb80 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e60c1cf730 0x55e60c1d1b40 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.596+0000 7f66654dcb80 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e60c1678c0 0x55e60c162990 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.596+0000 7f66654dcb80 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e60bfbd6b0 0x55e60c163bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.596+0000 7f66654dcb80 1 --2- 172.21.15.17:0/2249685835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e60c167470 0x55e60c164110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.596+0000 7f662affd700 0 client.28141 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.596+0000 7f66654dcb80 1 -- 172.21.15.17:0/2249685835 >> 172.21.15.17:0/2249685835 conn(0x55e60c156d40 msgr2=0x55e60c168520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.596+0000 7f66654dcb80 1 -- 172.21.15.17:0/2249685835 shutdown_connections 2023-07-14T13:16:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.596+0000 7f66654dcb80 1 -- 172.21.15.17:0/2249685835 wait complete. 2023-07-14T13:16:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.596+0000 7f66654dcb80 20 client.28141 trim_cache size 0 max 16384 2023-07-14T13:16:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:16:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:16:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:16:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:16:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 -- 172.21.15.17:0/3121112772 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66340a13e0 msgr2=0x7f66340a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66340a13e0 0x7f66340a3890 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6644007f80 tx=0x7f664400b040 comp rx=0 tx=0).stop 2023-07-14T13:16:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 -- 172.21.15.17:0/3121112772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f664c068510 msgr2=0x7f664c19dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f664c068510 0x7f664c19dde0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f664000e910 tx=0x7f664000ec20 comp rx=0 tx=0).stop 2023-07-14T13:16:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 -- 172.21.15.17:0/3121112772 shutdown_connections 2023-07-14T13:16:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66340a13e0 0x7f66340a3890 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f664c104ca0 0x7f664c197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f664c067b70 0x7f664c19d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 --2- 172.21.15.17:0/3121112772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f664c068510 0x7f664c19dde0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 -- 172.21.15.17:0/3121112772 >> 172.21.15.17:0/3121112772 conn(0x7f664c0748e0 msgr2=0x7f664c10ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 -- 172.21.15.17:0/3121112772 shutdown_connections 2023-07-14T13:16:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:46.597+0000 7f665099d700 1 -- 172.21.15.17:0/3121112772 wait complete. 2023-07-14T13:16:46.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:46 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:16:46.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:46 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:46.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:46 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:16:46.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:46 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:16:46.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:46 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:46.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:46 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:16:46.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:46 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:46.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:46 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:16:46.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:46 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:16:46.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:46 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:47.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:47 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:16:47.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:47 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:47.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:47 smithi017 ceph-mon[95536]: pgmap v536: 97 pgs: 97 active+clean; 15 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:16:47.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:47 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:16:47.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:47 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:47.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:47 smithi135 ceph-mon[97338]: pgmap v536: 97 pgs: 97 active+clean; 15 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:16:47.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:47 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:16:47.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:47 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:16:47.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:47 smithi131 ceph-mon[96953]: pgmap v536: 97 pgs: 97 active+clean; 15 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 18 op/s 2023-07-14T13:16:49.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:49 smithi017 ceph-mon[95536]: pgmap v537: 97 pgs: 97 active+clean; 15 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 17 MiB/s wr, 10 op/s 2023-07-14T13:16:49.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:49 smithi135 ceph-mon[97338]: pgmap v537: 97 pgs: 97 active+clean; 15 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 17 MiB/s wr, 10 op/s 2023-07-14T13:16:49.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:49 smithi131 ceph-mon[96953]: pgmap v537: 97 pgs: 97 active+clean; 15 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 17 MiB/s wr, 10 op/s 2023-07-14T13:16:51.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:51 smithi017 ceph-mon[95536]: pgmap v538: 97 pgs: 97 active+clean; 15 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 26 MiB/s wr, 97 op/s 2023-07-14T13:16:51.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:51 smithi135 ceph-mon[97338]: pgmap v538: 97 pgs: 97 active+clean; 15 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 26 MiB/s wr, 97 op/s 2023-07-14T13:16:51.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:51 smithi131 ceph-mon[96953]: pgmap v538: 97 pgs: 97 active+clean; 15 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 26 MiB/s wr, 97 op/s 2023-07-14T13:16:53.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:53 smithi017 ceph-mon[95536]: pgmap v539: 97 pgs: 97 active+clean; 15 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 17 MiB/s wr, 92 op/s 2023-07-14T13:16:53.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:53 smithi135 ceph-mon[97338]: pgmap v539: 97 pgs: 97 active+clean; 15 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 17 MiB/s wr, 92 op/s 2023-07-14T13:16:53.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:53 smithi131 ceph-mon[96953]: pgmap v539: 97 pgs: 97 active+clean; 15 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 17 MiB/s wr, 92 op/s 2023-07-14T13:16:55.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:55 smithi017 ceph-mon[95536]: pgmap v540: 97 pgs: 97 active+clean; 15 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 17 MiB/s wr, 92 op/s 2023-07-14T13:16:55.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:55 smithi135 ceph-mon[97338]: pgmap v540: 97 pgs: 97 active+clean; 15 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 17 MiB/s wr, 92 op/s 2023-07-14T13:16:55.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:55 smithi131 ceph-mon[96953]: pgmap v540: 97 pgs: 97 active+clean; 15 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 17 MiB/s wr, 92 op/s 2023-07-14T13:16:57.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:57 smithi017 ceph-mon[95536]: pgmap v541: 97 pgs: 97 active+clean; 15 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 26 MiB/s wr, 101 op/s 2023-07-14T13:16:57.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:57 smithi135 ceph-mon[97338]: pgmap v541: 97 pgs: 97 active+clean; 15 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 26 MiB/s wr, 101 op/s 2023-07-14T13:16:57.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:57 smithi131 ceph-mon[96953]: pgmap v541: 97 pgs: 97 active+clean; 15 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 26 MiB/s wr, 101 op/s 2023-07-14T13:16:59.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:16:59 smithi017 ceph-mon[95536]: pgmap v542: 97 pgs: 97 active+clean; 15 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 17 MiB/s wr, 96 op/s 2023-07-14T13:16:59.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:16:59 smithi135 ceph-mon[97338]: pgmap v542: 97 pgs: 97 active+clean; 15 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 17 MiB/s wr, 96 op/s 2023-07-14T13:16:59.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:16:59 smithi131 ceph-mon[96953]: pgmap v542: 97 pgs: 97 active+clean; 15 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 17 MiB/s wr, 96 op/s 2023-07-14T13:16:59.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.786+0000 7fb536bff700 1 -- 172.21.15.17:0/152281285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53010c540 msgr2=0x7fb53010e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.786+0000 7fb536bff700 1 --2- 172.21.15.17:0/152281285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53010c540 0x7fb53010e920 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb528009990 tx=0x7fb528009ca0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.786+0000 7fb536bff700 1 -- 172.21.15.17:0/152281285 shutdown_connections 2023-07-14T13:16:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.786+0000 7fb536bff700 1 --2- 172.21.15.17:0/152281285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53010c540 0x7fb53010e920 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.786+0000 7fb536bff700 1 --2- 172.21.15.17:0/152281285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5300679a0 0x7fb530067d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.786+0000 7fb536bff700 1 --2- 172.21.15.17:0/152281285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300682b0 0x7fb53010c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.786+0000 7fb536bff700 1 -- 172.21.15.17:0/152281285 >> 172.21.15.17:0/152281285 conn(0x7fb530074760 msgr2=0x7fb530074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:59.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.787+0000 7fb536bff700 1 -- 172.21.15.17:0/152281285 shutdown_connections 2023-07-14T13:16:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.787+0000 7fb536bff700 1 -- 172.21.15.17:0/152281285 wait complete. 2023-07-14T13:16:59.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.788+0000 7fb536bff700 1 Processor -- start 2023-07-14T13:16:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.788+0000 7fb536bff700 1 -- start start 2023-07-14T13:16:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.788+0000 7fb536bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5300679a0 0x7fb530197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.788+0000 7fb536bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300682b0 0x7fb5301981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.788+0000 7fb536bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53010c540 0x7fb53019b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.788+0000 7fb536bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53019bdb0 con 0x7fb5300679a0 2023-07-14T13:16:59.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.788+0000 7fb536bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53019bf20 con 0x7fb5300682b0 2023-07-14T13:16:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.788+0000 7fb536bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53019c0e0 con 0x7fb53010c540 2023-07-14T13:16:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.789+0000 7fb53499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5300679a0 0x7fb530197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.789+0000 7fb52ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300682b0 0x7fb5301981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.789+0000 7fb53519c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53010c540 0x7fb53019b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.789+0000 7fb52ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300682b0 0x7fb5301981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:48226/0 (socket says 172.21.15.17:48226) 2023-07-14T13:16:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.789+0000 7fb52ffff700 1 -- 172.21.15.17:0/1275239126 learned_addr learned my addr 172.21.15.17:0/1275239126 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.789+0000 7fb52ffff700 1 -- 172.21.15.17:0/1275239126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53010c540 msgr2=0x7fb53019b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:59.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.789+0000 7fb52ffff700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53010c540 0x7fb53019b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.789+0000 7fb52ffff700 1 -- 172.21.15.17:0/1275239126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5300679a0 msgr2=0x7fb530197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.789+0000 7fb52ffff700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5300679a0 0x7fb530197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.789+0000 7fb52ffff700 1 -- 172.21.15.17:0/1275239126 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280095f0 con 0x7fb5300682b0 2023-07-14T13:16:59.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.789+0000 7fb52ffff700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300682b0 0x7fb5301981f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00e9a0 tx=0x7fb51c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.790+0000 7fb52dffb700 1 -- 172.21.15.17:0/1275239126 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c009790 con 0x7fb5300682b0 2023-07-14T13:16:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.790+0000 7fb52dffb700 1 -- 172.21.15.17:0/1275239126 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb51c010430 con 0x7fb5300682b0 2023-07-14T13:16:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.790+0000 7fb536bff700 1 -- 172.21.15.17:0/1275239126 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53019c3c0 con 0x7fb5300682b0 2023-07-14T13:16:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.790+0000 7fb52dffb700 1 -- 172.21.15.17:0/1275239126 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00cea0 con 0x7fb5300682b0 2023-07-14T13:16:59.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.790+0000 7fb536bff700 1 -- 172.21.15.17:0/1275239126 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5301a4d20 con 0x7fb5300682b0 2023-07-14T13:16:59.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.793+0000 7fb52dffb700 1 -- 172.21.15.17:0/1275239126 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb51c0105a0 con 0x7fb5300682b0 2023-07-14T13:16:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.795+0000 7fb54a4b5b80 1 Processor -- start 2023-07-14T13:16:59.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.795+0000 7fb54a4b5b80 1 -- start start 2023-07-14T13:16:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.795+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48ca966b0 0x55d48cc3fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.795+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48cc402d0 0x55d48cc3a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.795+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc3a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.795+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48cb3fc50 con 0x55d48ca966b0 2023-07-14T13:16:59.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.795+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48cb929e0 con 0x55d48cc3a580 2023-07-14T13:16:59.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.795+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48cb8be70 con 0x55d48cc402d0 2023-07-14T13:16:59.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.795+0000 7fb52dffb700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5200a1340 0x7fb5200a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb53499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48cc402d0 0x55d48cc3a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb53499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48cc402d0 0x55d48cc3a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40276/0 (socket says 172.21.15.17:40276) 2023-07-14T13:16:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb52ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc3a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb53499b700 1 -- 172.21.15.17:0/4058676971 learned_addr learned my addr 172.21.15.17:0/4058676971 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb52dffb700 1 -- 172.21.15.17:0/1275239126 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb51c014070 con 0x7fb5300682b0 2023-07-14T13:16:59.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb53519c700 1 --2- 172.21.15.17:0/4058676971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48ca966b0 0x55d48cc3fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb53519c700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5200a1340 0x7fb5200a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb52ffff700 1 -- 172.21.15.17:0/4058676971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48cc402d0 msgr2=0x55d48cc3a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb52ffff700 1 --2- 172.21.15.17:0/4058676971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48cc402d0 0x55d48cc3a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb52ffff700 1 -- 172.21.15.17:0/4058676971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48ca966b0 msgr2=0x55d48cc3fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb52ffff700 1 --2- 172.21.15.17:0/4058676971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48ca966b0 0x55d48cc3fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb52ffff700 1 -- 172.21.15.17:0/4058676971 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d48c9b9d80 con 0x55d48cc3a580 2023-07-14T13:16:59.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.796+0000 7fb53499b700 1 --2- 172.21.15.17:0/4058676971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48cc402d0 0x55d48cc3a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.797+0000 7fb52ffff700 1 --2- 172.21.15.17:0/4058676971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc3a9d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0ca600 tx=0x7fb51c099e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a6fb3e08d569fa2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.797+0000 7fb51affd700 1 -- 172.21.15.17:0/4058676971 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c010880 con 0x55d48cc3a580 2023-07-14T13:16:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.797+0000 7fb51affd700 1 -- 172.21.15.17:0/4058676971 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb51c099f80 con 0x55d48cc3a580 2023-07-14T13:16:59.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.797+0000 7fb51affd700 1 -- 172.21.15.17:0/4058676971 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c09a440 con 0x55d48cc3a580 2023-07-14T13:16:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.798+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/4058676971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 msgr2=0x55d48cc3a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.798+0000 7fb53519c700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5200a1340 0x7fb5200a37f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb528005f50 tx=0x7fb52800b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.798+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/4058676971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc3a9d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0ca600 tx=0x7fb51c099e50 comp rx=0 tx=0).stop 2023-07-14T13:16:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.798+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/4058676971 shutdown_connections 2023-07-14T13:16:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.798+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/4058676971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc3a9d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.798+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/4058676971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48ca966b0 0x55d48cc3fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.798+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/4058676971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48cc402d0 0x55d48cc3a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.798+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/4058676971 >> 172.21.15.17:0/4058676971 conn(0x55d48cc2fbe0 msgr2=0x55d48cc34f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.798+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/4058676971 shutdown_connections 2023-07-14T13:16:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.798+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/4058676971 wait complete. 2023-07-14T13:16:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.799+0000 7fb54a4b5b80 1 -- start start 2023-07-14T13:16:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.799+0000 7fb54a4b5b80 1 Processor -- start 2023-07-14T13:16:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.799+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.799+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc438b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.799+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc402d0 0x55d48cc43f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.799+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48cb2ba60 con 0x55d48cc402d0 2023-07-14T13:16:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.799+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48cb2b760 con 0x55d48cc3a580 2023-07-14T13:16:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.799+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48ca0f8c0 con 0x55d48ca966b0 2023-07-14T13:16:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.799+0000 7fb54a4b5b80 10 client.0 _ll_register_callbacks cb 0x55d48cb29700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb53499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb52ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb53499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40286/0 (socket says 172.21.15.17:40286) 2023-07-14T13:16:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb53499b700 1 -- 172.21.15.17:0/1979501598 learned_addr learned my addr 172.21.15.17:0/1979501598 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb52ffff700 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:48244/0 (socket says 172.21.15.17:48244) 2023-07-14T13:16:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb53519c700 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc402d0 0x55d48cc43f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb53499b700 1 -- 172.21.15.17:0/1979501598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 msgr2=0x55d48cc438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb53499b700 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb53499b700 1 -- 172.21.15.17:0/1979501598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc402d0 msgr2=0x55d48cc43f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb53499b700 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc402d0 0x55d48cc43f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb53499b700 1 -- 172.21.15.17:0/1979501598 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb524011330 con 0x55d48ca966b0 2023-07-14T13:16:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb52ffff700 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:16:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb53499b700 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc465c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb524011fc0 tx=0x7fb524014600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7931439b3e104cb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.800+0000 7fb50ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:16:59.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.801+0000 7fb50ffff700 1 -- 172.21.15.17:0/1979501598 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52400e040 con 0x55d48ca966b0 2023-07-14T13:16:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.801+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1979501598 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d48cae5490 con 0x55d48ca966b0 2023-07-14T13:16:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.801+0000 7fb50ffff700 1 -- 172.21.15.17:0/1979501598 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb52401a070 con 0x55d48ca966b0 2023-07-14T13:16:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.801+0000 7fb50ffff700 1 -- 172.21.15.17:0/1979501598 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb524014ed0 con 0x55d48ca966b0 2023-07-14T13:16:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.801+0000 7fb54a4b5b80 10 client.28153 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.801+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1979501598 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x7fb5301a4d20 con 0x55d48ca966b0 2023-07-14T13:16:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.801+0000 7fb50ffff700 1 -- 172.21.15.17:0/1979501598 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d48cae5490 con 0x55d48ca966b0 2023-07-14T13:16:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.802+0000 7fb50ffff700 1 -- 172.21.15.17:0/1979501598 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb52401f480 con 0x55d48ca966b0 2023-07-14T13:16:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.802+0000 7fb54a4b5b80 10 client.28153 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.802+0000 7fb54a4b5b80 10 client.28153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.802+0000 7fb54a4b5b80 20 client.28153 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.802+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d48cc53ba0 0x55d48cc55fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.802+0000 7fb54a4b5b80 4 client.28153 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:16:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.802+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1979501598 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d48cb84e50 con 0x55d48cc53ba0 2023-07-14T13:16:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.802+0000 7fb52ffff700 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d48cc53ba0 0x55d48cc55fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.803+0000 7fb52ffff700 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d48cc53ba0 0x55d48cc55fb0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=798a847d03d8080c server_cookie=f311a136c89b8a5d in_seq=0 out_seq=0 2023-07-14T13:16:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.803+0000 7fb50ffff700 10 client.28153 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.803+0000 7fb50ffff700 1 -- 172.21.15.17:0/1979501598 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d48cb84e50 con 0x55d48cc53ba0 2023-07-14T13:16:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.803+0000 7fb50ffff700 10 client.28153 handle_command_reply: tid=0 2023-07-14T13:16:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.803+0000 7fb54a4b5b80 1 client.28153 shutdown 2023-07-14T13:16:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1979501598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 msgr2=0x55d48cc465c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc465c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb524011fc0 tx=0x7fb524014600 comp rx=0 tx=0).stop 2023-07-14T13:16:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1979501598 shutdown_connections 2023-07-14T13:16:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d48cc53ba0 0x55d48cc55fb0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc402d0 0x55d48cc43f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc465c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1979501598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1979501598 >> 172.21.15.17:0/1979501598 conn(0x55d48cc2fbe0 msgr2=0x55d48cc344e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb50ffff700 0 client.28153 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1979501598 shutdown_connections 2023-07-14T13:16:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1979501598 wait complete. 2023-07-14T13:16:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.804+0000 7fb54a4b5b80 20 client.28153 trim_cache size 0 max 16384 2023-07-14T13:16:59.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.821+0000 7fb54a4b5b80 1 Processor -- start 2023-07-14T13:16:59.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.821+0000 7fb54a4b5b80 1 -- start start 2023-07-14T13:16:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.822+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc2fbe0 0x55d48cc3f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.822+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc46160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.822+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc34c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.822+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48cc41910 con 0x55d48cc2fbe0 2023-07-14T13:16:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.822+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48cc3f9b0 con 0x55d48cc3a580 2023-07-14T13:16:59.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.822+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48cc41e10 con 0x55d48ca966b0 2023-07-14T13:16:59.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.822+0000 7fb52ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc46160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.822+0000 7fb52ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc46160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40300/0 (socket says 172.21.15.17:40300) 2023-07-14T13:16:59.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.822+0000 7fb52ffff700 1 -- 172.21.15.17:0/3072436216 learned_addr learned my addr 172.21.15.17:0/3072436216 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.822+0000 7fb53519c700 1 --2- 172.21.15.17:0/3072436216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc34c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.822+0000 7fb53499b700 1 --2- 172.21.15.17:0/3072436216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc2fbe0 0x55d48cc3f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.823+0000 7fb52ffff700 1 -- 172.21.15.17:0/3072436216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 msgr2=0x55d48cc34c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.823+0000 7fb52ffff700 1 --2- 172.21.15.17:0/3072436216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc34c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.823+0000 7fb52ffff700 1 -- 172.21.15.17:0/3072436216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc2fbe0 msgr2=0x55d48cc3f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.823+0000 7fb52ffff700 1 --2- 172.21.15.17:0/3072436216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc2fbe0 0x55d48cc3f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.823+0000 7fb52ffff700 1 -- 172.21.15.17:0/3072436216 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d48cc3ac40 con 0x55d48ca966b0 2023-07-14T13:16:59.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.823+0000 7fb52ffff700 1 --2- 172.21.15.17:0/3072436216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc46160 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb51c096480 tx=0x7fb51c00e8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0845d1181e641ef server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:59.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.823+0000 7fb51b7fe700 1 -- 172.21.15.17:0/3072436216 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c09dfb0 con 0x55d48ca966b0 2023-07-14T13:16:59.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.824+0000 7fb51b7fe700 1 -- 172.21.15.17:0/3072436216 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb51c0a23d0 con 0x55d48ca966b0 2023-07-14T13:16:59.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.824+0000 7fb51b7fe700 1 -- 172.21.15.17:0/3072436216 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0a1f40 con 0x55d48ca966b0 2023-07-14T13:16:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.824+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/3072436216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 msgr2=0x55d48cc46160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.824+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/3072436216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc46160 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb51c096480 tx=0x7fb51c00e8f0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.824+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/3072436216 shutdown_connections 2023-07-14T13:16:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.824+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/3072436216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc3a580 0x55d48cc34c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.824+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/3072436216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc2fbe0 0x55d48cc3f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.824+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/3072436216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc46160 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.825+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/3072436216 >> 172.21.15.17:0/3072436216 conn(0x55d48cc501c0 msgr2=0x55d48cc3ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.825+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/3072436216 shutdown_connections 2023-07-14T13:16:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.825+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/3072436216 wait complete. 2023-07-14T13:16:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.825+0000 7fb54a4b5b80 1 -- start start 2023-07-14T13:16:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.826+0000 7fb54a4b5b80 1 Processor -- start 2023-07-14T13:16:59.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.826+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc48c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.826+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc2fbe0 0x55d48cc49190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.826+0000 7fb54a4b5b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc3a580 0x55d48ccaf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.826+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48cc499c0 con 0x55d48cc3a580 2023-07-14T13:16:59.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.826+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48ccaf790 con 0x55d48cc2fbe0 2023-07-14T13:16:59.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.826+0000 7fb54a4b5b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48ccaf8d0 con 0x55d48ca966b0 2023-07-14T13:16:59.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.826+0000 7fb54a4b5b80 10 client.0 _ll_register_callbacks cb 0x7fb524011910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:16:59.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.826+0000 7fb53499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc48c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.827+0000 7fb53499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc48c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40304/0 (socket says 172.21.15.17:40304) 2023-07-14T13:16:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.827+0000 7fb53499b700 1 -- 172.21.15.17:0/1770994438 learned_addr learned my addr 172.21.15.17:0/1770994438 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:16:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.827+0000 7fb52ffff700 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc2fbe0 0x55d48cc49190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.827+0000 7fb53519c700 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc3a580 0x55d48ccaf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.827+0000 7fb53499b700 1 -- 172.21.15.17:0/1770994438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc2fbe0 msgr2=0x55d48cc49190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.827+0000 7fb53499b700 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc2fbe0 0x55d48cc49190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.827+0000 7fb53499b700 1 -- 172.21.15.17:0/1770994438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc3a580 msgr2=0x55d48ccaf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:16:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.827+0000 7fb53499b700 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc3a580 0x55d48ccaf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.827+0000 7fb53499b700 1 -- 172.21.15.17:0/1770994438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d48c9b9d80 con 0x55d48ca966b0 2023-07-14T13:16:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.827+0000 7fb53499b700 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc48c50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb5240061e0 tx=0x7fb52401fc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b51a5cf2d7480c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:16:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.827+0000 7fb50ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:16:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.828+0000 7fb50ffff700 1 -- 172.21.15.17:0/1770994438 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52400e040 con 0x55d48ca966b0 2023-07-14T13:16:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.828+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1770994438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d48cc50590 con 0x55d48ca966b0 2023-07-14T13:16:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.828+0000 7fb50ffff700 1 -- 172.21.15.17:0/1770994438 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb52401a040 con 0x55d48ca966b0 2023-07-14T13:16:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.828+0000 7fb50ffff700 1 -- 172.21.15.17:0/1770994438 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5240093a0 con 0x55d48ca966b0 2023-07-14T13:16:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.828+0000 7fb54a4b5b80 10 client.28159 fetch_fsmap learned FSMap version 45 2023-07-14T13:16:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.828+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1770994438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55d48c9a2c00 con 0x55d48ca966b0 2023-07-14T13:16:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.828+0000 7fb50ffff700 1 -- 172.21.15.17:0/1770994438 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d48cc50590 con 0x55d48ca966b0 2023-07-14T13:16:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.829+0000 7fb50ffff700 1 -- 172.21.15.17:0/1770994438 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 45) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb52402e030 con 0x55d48ca966b0 2023-07-14T13:16:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.829+0000 7fb54a4b5b80 10 client.28159 fetch_fsmap finished waiting for FSMap version 45 2023-07-14T13:16:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.829+0000 7fb54a4b5b80 10 client.28159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:16:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.829+0000 7fb54a4b5b80 20 client.28159 populate_metadata read hostname 'smithi017' 2023-07-14T13:16:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.829+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d48cc402d0 0x55d48ccb2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:16:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.829+0000 7fb54a4b5b80 4 client.28159 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:16:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.829+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1770994438 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7fb51c099f80 con 0x55d48cc402d0 2023-07-14T13:16:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.829+0000 7fb52ffff700 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d48cc402d0 0x55d48ccb2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:16:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.830+0000 7fb50ffff700 10 client.28159 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.830+0000 7fb52ffff700 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d48cc402d0 0x55d48ccb2eb0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=641498e67833d508 server_cookie=c2fd6a700abcf6d in_seq=0 out_seq=0 2023-07-14T13:16:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.841+0000 7fb50ffff700 1 -- 172.21.15.17:0/1770994438 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7fb51c099f80 con 0x55d48cc402d0 2023-07-14T13:16:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.841+0000 7fb50ffff700 10 client.28159 handle_command_reply: tid=0 2023-07-14T13:16:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.841+0000 7fb54a4b5b80 1 client.28159 shutdown 2023-07-14T13:16:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1770994438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 msgr2=0x55d48cc48c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc48c50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb5240061e0 tx=0x7fb52401fc30 comp rx=0 tx=0).stop 2023-07-14T13:16:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1770994438 shutdown_connections 2023-07-14T13:16:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d48cc402d0 0x55d48ccb2eb0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d48cc3a580 0x55d48ccaf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb50ffff700 0 client.28159 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:16:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d48ca966b0 0x55d48cc48c50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb54a4b5b80 1 --2- 172.21.15.17:0/1770994438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d48cc2fbe0 0x55d48cc49190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1770994438 >> 172.21.15.17:0/1770994438 conn(0x55d48cc501c0 msgr2=0x55d48cc408a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1770994438 shutdown_connections 2023-07-14T13:16:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb54a4b5b80 1 -- 172.21.15.17:0/1770994438 wait complete. 2023-07-14T13:16:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.842+0000 7fb54a4b5b80 20 client.28159 trim_cache size 0 max 16384 2023-07-14T13:16:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:16:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:16:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:16:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:16:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 -- 172.21.15.17:0/1275239126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5200a1340 msgr2=0x7fb5200a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5200a1340 0x7fb5200a37f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb528005f50 tx=0x7fb52800b260 comp rx=0 tx=0).stop 2023-07-14T13:16:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 -- 172.21.15.17:0/1275239126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300682b0 msgr2=0x7fb5301981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:16:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300682b0 0x7fb5301981f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00e9a0 tx=0x7fb51c00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 -- 172.21.15.17:0/1275239126 shutdown_connections 2023-07-14T13:16:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5200a1340 0x7fb5200a37f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53010c540 0x7fb53019b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5300679a0 0x7fb530197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 --2- 172.21.15.17:0/1275239126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5300682b0 0x7fb5301981f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:16:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 -- 172.21.15.17:0/1275239126 >> 172.21.15.17:0/1275239126 conn(0x7fb530074760 msgr2=0x7fb5300fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:16:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 -- 172.21.15.17:0/1275239126 shutdown_connections 2023-07-14T13:16:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:16:59.843+0000 7fb536bff700 1 -- 172.21.15.17:0/1275239126 wait complete. 2023-07-14T13:17:01.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:01 smithi017 ceph-mon[95536]: pgmap v543: 97 pgs: 97 active+clean; 15 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 26 MiB/s wr, 111 op/s 2023-07-14T13:17:01.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:01 smithi135 ceph-mon[97338]: pgmap v543: 97 pgs: 97 active+clean; 15 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 26 MiB/s wr, 111 op/s 2023-07-14T13:17:01.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:01 smithi131 ceph-mon[96953]: pgmap v543: 97 pgs: 97 active+clean; 15 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 26 MiB/s wr, 111 op/s 2023-07-14T13:17:03.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:03 smithi017 ceph-mon[95536]: pgmap v544: 97 pgs: 97 active+clean; 15 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 24 op/s 2023-07-14T13:17:03.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:03 smithi135 ceph-mon[97338]: pgmap v544: 97 pgs: 97 active+clean; 15 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 24 op/s 2023-07-14T13:17:03.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:03 smithi131 ceph-mon[96953]: pgmap v544: 97 pgs: 97 active+clean; 15 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 24 op/s 2023-07-14T13:17:05.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:05 smithi017 ceph-mon[95536]: pgmap v545: 97 pgs: 97 active+clean; 15 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 24 op/s 2023-07-14T13:17:05.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:05 smithi017 ceph-mon[95536]: osdmap e112: 12 total, 12 up, 12 in 2023-07-14T13:17:05.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:05 smithi135 ceph-mon[97338]: pgmap v545: 97 pgs: 97 active+clean; 15 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 24 op/s 2023-07-14T13:17:05.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:05 smithi135 ceph-mon[97338]: osdmap e112: 12 total, 12 up, 12 in 2023-07-14T13:17:05.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:05 smithi131 ceph-mon[96953]: pgmap v545: 97 pgs: 97 active+clean; 15 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 24 op/s 2023-07-14T13:17:05.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:05 smithi131 ceph-mon[96953]: osdmap e112: 12 total, 12 up, 12 in 2023-07-14T13:17:07.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:07 smithi131 ceph-mon[96953]: pgmap v547: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 18 MiB/s wr, 175 op/s 2023-07-14T13:17:07.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:07 smithi017 ceph-mon[95536]: pgmap v547: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 18 MiB/s wr, 175 op/s 2023-07-14T13:17:07.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:07 smithi135 ceph-mon[97338]: pgmap v547: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 18 MiB/s wr, 175 op/s 2023-07-14T13:17:09.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:09 smithi131 ceph-mon[96953]: pgmap v548: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 18 MiB/s wr, 175 op/s 2023-07-14T13:17:09.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:09 smithi017 ceph-mon[95536]: pgmap v548: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 18 MiB/s wr, 175 op/s 2023-07-14T13:17:09.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:09 smithi135 ceph-mon[97338]: pgmap v548: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 18 MiB/s wr, 175 op/s 2023-07-14T13:17:11.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:11 smithi131 ceph-mon[96953]: pgmap v549: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 MiB/s wr, 224 op/s 2023-07-14T13:17:11.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:11 smithi131 ceph-mon[96953]: osdmap e113: 12 total, 12 up, 12 in 2023-07-14T13:17:11.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:11 smithi017 ceph-mon[95536]: pgmap v549: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 MiB/s wr, 224 op/s 2023-07-14T13:17:11.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:11 smithi017 ceph-mon[95536]: osdmap e113: 12 total, 12 up, 12 in 2023-07-14T13:17:11.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:11 smithi135 ceph-mon[97338]: pgmap v549: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 MiB/s wr, 224 op/s 2023-07-14T13:17:11.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:11 smithi135 ceph-mon[97338]: osdmap e113: 12 total, 12 up, 12 in 2023-07-14T13:17:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.023+0000 7f2076bff700 1 -- 172.21.15.17:0/2025358825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20700679a0 msgr2=0x7f2070067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.023+0000 7f2076bff700 1 --2- 172.21.15.17:0/2025358825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20700679a0 0x7f2070067d70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f20640098f0 tx=0x7f2064009c00 comp rx=0 tx=0).stop 2023-07-14T13:17:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.023+0000 7f2076bff700 1 -- 172.21.15.17:0/2025358825 shutdown_connections 2023-07-14T13:17:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.023+0000 7f2076bff700 1 --2- 172.21.15.17:0/2025358825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f207010c540 0x7f207010e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.023+0000 7f2076bff700 1 --2- 172.21.15.17:0/2025358825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20700679a0 0x7f2070067d70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.023+0000 7f2076bff700 1 --2- 172.21.15.17:0/2025358825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20700682b0 0x7f207010c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.023+0000 7f2076bff700 1 -- 172.21.15.17:0/2025358825 >> 172.21.15.17:0/2025358825 conn(0x7f2070074760 msgr2=0x7f2070074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.023+0000 7f2076bff700 1 -- 172.21.15.17:0/2025358825 shutdown_connections 2023-07-14T13:17:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.023+0000 7f2076bff700 1 -- 172.21.15.17:0/2025358825 wait complete. 2023-07-14T13:17:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.024+0000 7f2076bff700 1 Processor -- start 2023-07-14T13:17:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.024+0000 7f2076bff700 1 -- start start 2023-07-14T13:17:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.025+0000 7f2076bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20700679a0 0x7f2070197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.025+0000 7f2076bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20700682b0 0x7f2070198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.025+0000 7f2076bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207010c540 0x7f207019c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.025+0000 7f2076bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207019d000 con 0x7f20700679a0 2023-07-14T13:17:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.025+0000 7f2076bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207019d170 con 0x7f20700682b0 2023-07-14T13:17:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.025+0000 7f2076bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207019d330 con 0x7f207010c540 2023-07-14T13:17:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.025+0000 7f207499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20700679a0 0x7f2070197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.025+0000 7f206ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20700682b0 0x7f2070198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.025+0000 7f206ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20700682b0 0x7f2070198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:48264/0 (socket says 172.21.15.17:48264) 2023-07-14T13:17:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.025+0000 7f206ffff700 1 -- 172.21.15.17:0/2653090774 learned_addr learned my addr 172.21.15.17:0/2653090774 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.025+0000 7f207499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20700679a0 0x7f2070197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49956/0 (socket says 172.21.15.17:49956) 2023-07-14T13:17:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.026+0000 7f207519c700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207010c540 0x7f207019c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.026+0000 7f206ffff700 1 -- 172.21.15.17:0/2653090774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207010c540 msgr2=0x7f207019c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.026+0000 7f206ffff700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207010c540 0x7f207019c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.026+0000 7f206ffff700 1 -- 172.21.15.17:0/2653090774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20700679a0 msgr2=0x7f2070197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.026+0000 7f206ffff700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20700679a0 0x7f2070197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.026+0000 7f206ffff700 1 -- 172.21.15.17:0/2653090774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c009520 con 0x7f20700682b0 2023-07-14T13:17:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.026+0000 7f207519c700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207010c540 0x7f207019c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:17:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.026+0000 7f206ffff700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20700682b0 0x7f2070198350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f205c00eb30 tx=0x7f205c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:13.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.027+0000 7f206dffb700 1 -- 172.21.15.17:0/2653090774 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c009880 con 0x7f20700682b0 2023-07-14T13:17:13.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.027+0000 7f206dffb700 1 -- 172.21.15.17:0/2653090774 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f205c0044b0 con 0x7f20700682b0 2023-07-14T13:17:13.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.027+0000 7f206dffb700 1 -- 172.21.15.17:0/2653090774 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c003df0 con 0x7f20700682b0 2023-07-14T13:17:13.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.027+0000 7f2076bff700 1 -- 172.21.15.17:0/2653090774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2068009d00 con 0x7f20700682b0 2023-07-14T13:17:13.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.027+0000 7f2076bff700 1 -- 172.21.15.17:0/2653090774 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2064009520 con 0x7f20700682b0 2023-07-14T13:17:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.031+0000 7f206dffb700 1 -- 172.21.15.17:0/2653090774 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f205c003f50 con 0x7f20700682b0 2023-07-14T13:17:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.032+0000 7f208a523b80 1 Processor -- start 2023-07-14T13:17:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.033+0000 7f208a523b80 1 -- start start 2023-07-14T13:17:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.033+0000 7f208a523b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3d9176b0 0x561a3dac0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.033+0000 7f208a523b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dac12d0 0x561a3dabb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.033+0000 7f206dffb700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20600a1340 0x7f20600a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.033+0000 7f208a523b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dabb580 0x561a3dabb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.033+0000 7f208a523b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3d9c0c50 con 0x561a3d9176b0 2023-07-14T13:17:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.033+0000 7f208a523b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3da139e0 con 0x561a3dac12d0 2023-07-14T13:17:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.033+0000 7f208a523b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3da0ce70 con 0x561a3dabb580 2023-07-14T13:17:13.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f206dffb700 1 -- 172.21.15.17:0/2653090774 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f205c014070 con 0x7f20700682b0 2023-07-14T13:17:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f207499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dac12d0 0x561a3dabb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f207519c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3d9176b0 0x561a3dac0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f207499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dac12d0 0x561a3dabb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:48280/0 (socket says 172.21.15.17:48280) 2023-07-14T13:17:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f207499b700 1 -- 172.21.15.17:0/1875389783 learned_addr learned my addr 172.21.15.17:0/1875389783 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f206ffff700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20600a1340 0x7f20600a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f207519c700 1 --2- 172.21.15.17:0/1875389783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dabb580 0x561a3dabb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f207499b700 1 -- 172.21.15.17:0/1875389783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dabb580 msgr2=0x561a3dabb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f207499b700 1 --2- 172.21.15.17:0/1875389783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dabb580 0x561a3dabb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f207499b700 1 -- 172.21.15.17:0/1875389783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3d9176b0 msgr2=0x561a3dac0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f207499b700 1 --2- 172.21.15.17:0/1875389783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3d9176b0 0x561a3dac0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f207499b700 1 -- 172.21.15.17:0/1875389783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a3d83ad80 con 0x561a3dac12d0 2023-07-14T13:17:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.034+0000 7f207519c700 1 --2- 172.21.15.17:0/1875389783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3d9176b0 0x561a3dac0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:17:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.035+0000 7f207499b700 1 --2- 172.21.15.17:0/1875389783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dac12d0 0x561a3dabb040 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2064000c00 tx=0x7f2064005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=942d0b4a61cec692 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.035+0000 7f206ffff700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20600a1340 0x7f20600a37f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f205c09a0d0 tx=0x7f205c003680 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.035+0000 7f205affd700 1 -- 172.21.15.17:0/1875389783 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400f460 con 0x561a3dac12d0 2023-07-14T13:17:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.035+0000 7f205affd700 1 -- 172.21.15.17:0/1875389783 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f206401d040 con 0x561a3dac12d0 2023-07-14T13:17:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.035+0000 7f205affd700 1 -- 172.21.15.17:0/1875389783 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20640052a0 con 0x561a3dac12d0 2023-07-14T13:17:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.036+0000 7f208a523b80 1 -- 172.21.15.17:0/1875389783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dac12d0 msgr2=0x561a3dabb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.036+0000 7f208a523b80 1 --2- 172.21.15.17:0/1875389783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dac12d0 0x561a3dabb040 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2064000c00 tx=0x7f2064005dc0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.036+0000 7f208a523b80 1 -- 172.21.15.17:0/1875389783 shutdown_connections 2023-07-14T13:17:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.036+0000 7f208a523b80 1 --2- 172.21.15.17:0/1875389783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dabb580 0x561a3dabb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.036+0000 7f208a523b80 1 --2- 172.21.15.17:0/1875389783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3d9176b0 0x561a3dac0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.036+0000 7f208a523b80 1 --2- 172.21.15.17:0/1875389783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dac12d0 0x561a3dabb040 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.036+0000 7f208a523b80 1 -- 172.21.15.17:0/1875389783 >> 172.21.15.17:0/1875389783 conn(0x561a3dab0be0 msgr2=0x561a3dab5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.037+0000 7f208a523b80 1 -- 172.21.15.17:0/1875389783 shutdown_connections 2023-07-14T13:17:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.037+0000 7f208a523b80 1 -- 172.21.15.17:0/1875389783 wait complete. 2023-07-14T13:17:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.037+0000 7f208a523b80 1 -- start start 2023-07-14T13:17:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.038+0000 7f208a523b80 1 Processor -- start 2023-07-14T13:17:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.038+0000 7f208a523b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3d9176b0 0x561a3dac75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.038+0000 7f208a523b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dabb580 0x561a3dac48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.038+0000 7f208a523b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dac12d0 0x561a3dac4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.038+0000 7f208a523b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3d9aca60 con 0x561a3dac12d0 2023-07-14T13:17:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.038+0000 7f208a523b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3d9ac760 con 0x561a3dabb580 2023-07-14T13:17:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.038+0000 7f208a523b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3d8908c0 con 0x561a3d9176b0 2023-07-14T13:17:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.038+0000 7f208a523b80 10 client.0 _ll_register_callbacks cb 0x561a3d9aa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.039+0000 7f207499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dabb580 0x561a3dac48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.039+0000 7f207499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dabb580 0x561a3dac48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:48286/0 (socket says 172.21.15.17:48286) 2023-07-14T13:17:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.039+0000 7f207499b700 1 -- 172.21.15.17:0/3584011120 learned_addr learned my addr 172.21.15.17:0/3584011120 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.039+0000 7f207519c700 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3d9176b0 0x561a3dac75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.039+0000 7f207519c700 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dac12d0 0x561a3dac4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.039+0000 7f207499b700 1 -- 172.21.15.17:0/3584011120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3d9176b0 msgr2=0x561a3dac75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.039+0000 7f207499b700 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3d9176b0 0x561a3dac75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.039+0000 7f207499b700 1 -- 172.21.15.17:0/3584011120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dac12d0 msgr2=0x561a3dac4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.039+0000 7f207499b700 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dac12d0 0x561a3dac4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.039+0000 7f207499b700 1 -- 172.21.15.17:0/3584011120 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207010f420 con 0x561a3dabb580 2023-07-14T13:17:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.039+0000 7f207519c700 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dac12d0 0x561a3dac4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:17:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.040+0000 7f207499b700 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dabb580 0x561a3dac48d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2064009c40 tx=0x7f206400bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b170ac57f2e87ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.040+0000 7f204ffff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:17:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.040+0000 7f204ffff700 1 -- 172.21.15.17:0/3584011120 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20640050e0 con 0x561a3dabb580 2023-07-14T13:17:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.040+0000 7f204ffff700 1 -- 172.21.15.17:0/3584011120 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2064005240 con 0x561a3dabb580 2023-07-14T13:17:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.040+0000 7f208a523b80 1 -- 172.21.15.17:0/3584011120 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a3d966490 con 0x561a3dabb580 2023-07-14T13:17:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.041+0000 7f204ffff700 1 -- 172.21.15.17:0/3584011120 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2064005400 con 0x561a3dabb580 2023-07-14T13:17:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.041+0000 7f208a523b80 10 client.28205 fetch_fsmap learned FSMap version 46 2023-07-14T13:17:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.041+0000 7f208a523b80 1 -- 172.21.15.17:0/3584011120 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x561a3d823c00 con 0x561a3dabb580 2023-07-14T13:17:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.041+0000 7f204ffff700 1 -- 172.21.15.17:0/3584011120 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561a3d966490 con 0x561a3dabb580 2023-07-14T13:17:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.041+0000 7f204ffff700 1 -- 172.21.15.17:0/3584011120 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 46) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f2064015020 con 0x561a3dabb580 2023-07-14T13:17:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.041+0000 7f208a523b80 10 client.28205 fetch_fsmap finished waiting for FSMap version 46 2023-07-14T13:17:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.041+0000 7f208a523b80 10 client.28205 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.041+0000 7f208a523b80 20 client.28205 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.041+0000 7f208a523b80 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a3dad4700 0x561a3dad6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.041+0000 7f208a523b80 4 client.28205 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:17:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.041+0000 7f208a523b80 1 -- 172.21.15.17:0/3584011120 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a3da05e50 con 0x561a3dad4700 2023-07-14T13:17:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.042+0000 7f207519c700 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a3dad4700 0x561a3dad6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.042+0000 7f207519c700 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a3dad4700 0x561a3dad6b10 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a1f59e8b812a536 server_cookie=b0464bd66d237182 in_seq=0 out_seq=0 2023-07-14T13:17:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.042+0000 7f204ffff700 10 client.28205 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.043+0000 7f204ffff700 1 -- 172.21.15.17:0/3584011120 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561a3da05e50 con 0x561a3dad4700 2023-07-14T13:17:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.043+0000 7f204ffff700 10 client.28205 handle_command_reply: tid=0 2023-07-14T13:17:13.088 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.043+0000 7f208a523b80 1 client.28205 shutdown 2023-07-14T13:17:13.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.043+0000 7f208a523b80 1 -- 172.21.15.17:0/3584011120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dabb580 msgr2=0x561a3dac48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:13.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.043+0000 7f208a523b80 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dabb580 0x561a3dac48d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2064009c40 tx=0x7f206400bc50 comp rx=0 tx=0).stop 2023-07-14T13:17:13.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.044+0000 7f208a523b80 1 -- 172.21.15.17:0/3584011120 shutdown_connections 2023-07-14T13:17:13.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.044+0000 7f208a523b80 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a3dad4700 0x561a3dad6b10 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.044+0000 7f208a523b80 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dac12d0 0x561a3dac4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.044+0000 7f208a523b80 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3d9176b0 0x561a3dac75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.044+0000 7f204ffff700 0 client.28205 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.044+0000 7f208a523b80 1 --2- 172.21.15.17:0/3584011120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3dabb580 0x561a3dac48d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.044+0000 7f208a523b80 1 -- 172.21.15.17:0/3584011120 >> 172.21.15.17:0/3584011120 conn(0x561a3dab0be0 msgr2=0x561a3dab4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.044+0000 7f208a523b80 1 -- 172.21.15.17:0/3584011120 shutdown_connections 2023-07-14T13:17:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.044+0000 7f208a523b80 1 -- 172.21.15.17:0/3584011120 wait complete. 2023-07-14T13:17:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.044+0000 7f208a523b80 20 client.28205 trim_cache size 0 max 16384 2023-07-14T13:17:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.067+0000 7f208a523b80 1 Processor -- start 2023-07-14T13:17:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.067+0000 7f208a523b80 1 -- start start 2023-07-14T13:17:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.067+0000 7f208a523b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dabb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.067+0000 7f208a523b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dabb580 0x561a3dab5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.067+0000 7f208a523b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dac12d0 0x561a3dac7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.067+0000 7f208a523b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3dac18e0 con 0x561a3dabb580 2023-07-14T13:17:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.067+0000 7f208a523b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3dac16d0 con 0x561a3d9176b0 2023-07-14T13:17:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.067+0000 7f208a523b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3dab7ac0 con 0x561a3dac12d0 2023-07-14T13:17:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dabb580 0x561a3dab5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207519c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dabb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dabb580 0x561a3dab5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49976/0 (socket says 172.21.15.17:49976) 2023-07-14T13:17:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207519c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dabb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:48302/0 (socket says 172.21.15.17:48302) 2023-07-14T13:17:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207499b700 1 -- 172.21.15.17:0/1597947012 learned_addr learned my addr 172.21.15.17:0/1597947012 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207519c700 1 --2- 172.21.15.17:0/1597947012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dac12d0 0x561a3dac7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207499b700 1 -- 172.21.15.17:0/1597947012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dac12d0 msgr2=0x561a3dac7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207499b700 1 --2- 172.21.15.17:0/1597947012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dac12d0 0x561a3dac7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207499b700 1 -- 172.21.15.17:0/1597947012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 msgr2=0x561a3dabb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207499b700 1 --2- 172.21.15.17:0/1597947012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dabb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207499b700 1 -- 172.21.15.17:0/1597947012 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a3dac4440 con 0x561a3dabb580 2023-07-14T13:17:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.068+0000 7f207519c700 1 --2- 172.21.15.17:0/1597947012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dabb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.069+0000 7f207499b700 1 --2- 172.21.15.17:0/1597947012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dabb580 0x561a3dab5c60 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f206402a4b0 tx=0x7f2064005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645a14321a611ba2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.069+0000 7f205b7fe700 1 -- 172.21.15.17:0/1597947012 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064005b40 con 0x561a3dabb580 2023-07-14T13:17:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.069+0000 7f205b7fe700 1 -- 172.21.15.17:0/1597947012 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f206402a720 con 0x561a3dabb580 2023-07-14T13:17:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.069+0000 7f205b7fe700 1 -- 172.21.15.17:0/1597947012 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206402abc0 con 0x561a3dabb580 2023-07-14T13:17:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.070+0000 7f208a523b80 1 -- 172.21.15.17:0/1597947012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dabb580 msgr2=0x561a3dab5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.070+0000 7f208a523b80 1 --2- 172.21.15.17:0/1597947012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dabb580 0x561a3dab5c60 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f206402a4b0 tx=0x7f2064005dc0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.070+0000 7f208a523b80 1 -- 172.21.15.17:0/1597947012 shutdown_connections 2023-07-14T13:17:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.070+0000 7f208a523b80 1 --2- 172.21.15.17:0/1597947012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dac12d0 0x561a3dac7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.070+0000 7f208a523b80 1 --2- 172.21.15.17:0/1597947012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dabb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.070+0000 7f208a523b80 1 --2- 172.21.15.17:0/1597947012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dabb580 0x561a3dab5c60 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.070+0000 7f208a523b80 1 -- 172.21.15.17:0/1597947012 >> 172.21.15.17:0/1597947012 conn(0x561a3dab0be0 msgr2=0x561a3dabead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.070+0000 7f208a523b80 1 -- 172.21.15.17:0/1597947012 shutdown_connections 2023-07-14T13:17:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.070+0000 7f208a523b80 1 -- 172.21.15.17:0/1597947012 wait complete. 2023-07-14T13:17:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.070+0000 7f208a523b80 1 -- start start 2023-07-14T13:17:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.071+0000 7f208a523b80 1 Processor -- start 2023-07-14T13:17:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.071+0000 7f208a523b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dac9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.071+0000 7f208a523b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dabb580 0x561a3daca380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.071+0000 7f208a523b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dac12d0 0x561a3db21630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.071+0000 7f208a523b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3db21b70 con 0x561a3dac12d0 2023-07-14T13:17:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.071+0000 7f208a523b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3db21ce0 con 0x561a3d9176b0 2023-07-14T13:17:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.071+0000 7f208a523b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a3db21ea0 con 0x561a3dabb580 2023-07-14T13:17:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.071+0000 7f208a523b80 10 client.0 _ll_register_callbacks cb 0x7f2064009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.071+0000 7f207519c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dac9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.071+0000 7f207519c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dac9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:48306/0 (socket says 172.21.15.17:48306) 2023-07-14T13:17:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.071+0000 7f207519c700 1 -- 172.21.15.17:0/2881149925 learned_addr learned my addr 172.21.15.17:0/2881149925 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.072+0000 7f207519c700 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dac12d0 0x561a3db21630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.072+0000 7f207499b700 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dabb580 0x561a3daca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.072+0000 7f207519c700 1 -- 172.21.15.17:0/2881149925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dabb580 msgr2=0x561a3daca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.072+0000 7f207519c700 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dabb580 0x561a3daca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.072+0000 7f207519c700 1 -- 172.21.15.17:0/2881149925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dac12d0 msgr2=0x561a3db21630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.072+0000 7f207519c700 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dac12d0 0x561a3db21630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.072+0000 7f207519c700 1 -- 172.21.15.17:0/2881149925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2068011040 con 0x561a3d9176b0 2023-07-14T13:17:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.072+0000 7f207519c700 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dac9e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x561a3dad73b0 tx=0x7f2068021780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68bc3b2018ac2aed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.072+0000 7f204ffff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:17:13.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.073+0000 7f204ffff700 1 -- 172.21.15.17:0/2881149925 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068026040 con 0x561a3d9176b0 2023-07-14T13:17:13.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.073+0000 7f208a523b80 1 -- 172.21.15.17:0/2881149925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f206401d040 con 0x561a3d9176b0 2023-07-14T13:17:13.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.073+0000 7f204ffff700 1 -- 172.21.15.17:0/2881149925 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2068004bb0 con 0x561a3d9176b0 2023-07-14T13:17:13.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.073+0000 7f204ffff700 1 -- 172.21.15.17:0/2881149925 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f206800e040 con 0x561a3d9176b0 2023-07-14T13:17:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.073+0000 7f208a523b80 10 client.28211 fetch_fsmap learned FSMap version 46 2023-07-14T13:17:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.073+0000 7f208a523b80 1 -- 172.21.15.17:0/2881149925 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x561a3d823c00 con 0x561a3d9176b0 2023-07-14T13:17:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.073+0000 7f204ffff700 1 -- 172.21.15.17:0/2881149925 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f206401d040 con 0x561a3d9176b0 2023-07-14T13:17:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.074+0000 7f204ffff700 1 -- 172.21.15.17:0/2881149925 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 46) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f206802c020 con 0x561a3d9176b0 2023-07-14T13:17:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.074+0000 7f208a523b80 10 client.28211 fetch_fsmap finished waiting for FSMap version 46 2023-07-14T13:17:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.074+0000 7f208a523b80 10 client.28211 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.074+0000 7f208a523b80 20 client.28211 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.074+0000 7f208a523b80 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a3db29680 0x561a3db2ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.074+0000 7f208a523b80 4 client.28211 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:17:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.074+0000 7f208a523b80 1 -- 172.21.15.17:0/2881149925 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561a3d9c7ff0 con 0x561a3db29680 2023-07-14T13:17:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.074+0000 7f207499b700 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a3db29680 0x561a3db2ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.075+0000 7f204ffff700 10 client.28211 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.075+0000 7f207499b700 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a3db29680 0x561a3db2ba90 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8c892296cc836d1 server_cookie=14f045a48117a62e in_seq=0 out_seq=0 2023-07-14T13:17:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.084+0000 7f204ffff700 1 -- 172.21.15.17:0/2881149925 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561a3d9c7ff0 con 0x561a3db29680 2023-07-14T13:17:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.084+0000 7f204ffff700 10 client.28211 handle_command_reply: tid=0 2023-07-14T13:17:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 1 client.28211 shutdown 2023-07-14T13:17:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 1 -- 172.21.15.17:0/2881149925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 msgr2=0x561a3dac9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:13.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dac9e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x561a3dad73b0 tx=0x7f2068021780 comp rx=0 tx=0).stop 2023-07-14T13:17:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 1 -- 172.21.15.17:0/2881149925 shutdown_connections 2023-07-14T13:17:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561a3db29680 0x561a3db2ba90 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561a3dac12d0 0x561a3db21630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a3d9176b0 0x561a3dac9e40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f204ffff700 0 client.28211 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 1 --2- 172.21.15.17:0/2881149925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3dabb580 0x561a3daca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 1 -- 172.21.15.17:0/2881149925 >> 172.21.15.17:0/2881149925 conn(0x561a3dab0be0 msgr2=0x561a3dac3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:13.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 1 -- 172.21.15.17:0/2881149925 shutdown_connections 2023-07-14T13:17:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 1 -- 172.21.15.17:0/2881149925 wait complete. 2023-07-14T13:17:13.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.085+0000 7f208a523b80 20 client.28211 trim_cache size 0 max 16384 2023-07-14T13:17:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:17:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:17:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:17:13.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:17:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 -- 172.21.15.17:0/2653090774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20600a1340 msgr2=0x7f20600a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20600a1340 0x7f20600a37f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f205c09a0d0 tx=0x7f205c003680 comp rx=0 tx=0).stop 2023-07-14T13:17:13.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 -- 172.21.15.17:0/2653090774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20700682b0 msgr2=0x7f2070198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20700682b0 0x7f2070198350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f205c00eb30 tx=0x7f205c00ee40 comp rx=0 tx=0).stop 2023-07-14T13:17:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 -- 172.21.15.17:0/2653090774 shutdown_connections 2023-07-14T13:17:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f20600a1340 0x7f20600a37f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f207010c540 0x7f207019c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20700679a0 0x7f2070197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 --2- 172.21.15.17:0/2653090774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20700682b0 0x7f2070198350 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 -- 172.21.15.17:0/2653090774 >> 172.21.15.17:0/2653090774 conn(0x7f2070074760 msgr2=0x7f20700fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 -- 172.21.15.17:0/2653090774 shutdown_connections 2023-07-14T13:17:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:13.086+0000 7f2076bff700 1 -- 172.21.15.17:0/2653090774 wait complete. 2023-07-14T13:17:13.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:13 smithi131 ceph-mon[96953]: pgmap v551: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 28 MiB/s wr, 280 op/s 2023-07-14T13:17:13.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:13 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:17:13.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:13 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:17:13.507 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:13 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:13.507 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:13 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:13 smithi017 ceph-mon[95536]: pgmap v551: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 28 MiB/s wr, 280 op/s 2023-07-14T13:17:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:13 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:17:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:13 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:17:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:13 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:13.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:13 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:13.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:13 smithi135 ceph-mon[97338]: pgmap v551: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 28 MiB/s wr, 280 op/s 2023-07-14T13:17:13.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:13 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:17:13.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:13 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:17:13.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:13 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:13.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:13 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:15.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:15 smithi131 ceph-mon[96953]: pgmap v552: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 23 MiB/s wr, 227 op/s 2023-07-14T13:17:15.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:15 smithi017 ceph-mon[95536]: pgmap v552: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 23 MiB/s wr, 227 op/s 2023-07-14T13:17:15.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:15 smithi135 ceph-mon[97338]: pgmap v552: 97 pgs: 97 active+clean; 15 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 23 MiB/s wr, 227 op/s 2023-07-14T13:17:15.772 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:17:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.976+0000 7fe8695ff700 1 -- 172.21.15.17:0/411011068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe86410c430 msgr2=0x7fe86410e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:16.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.976+0000 7fe8695ff700 1 --2- 172.21.15.17:0/411011068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe86410c430 0x7fe86410e810 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009f90 tx=0x7fe85c00b330 comp rx=0 tx=0).stop 2023-07-14T13:17:16.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.977+0000 7fe8695ff700 1 -- 172.21.15.17:0/411011068 shutdown_connections 2023-07-14T13:17:16.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.977+0000 7fe8695ff700 1 --2- 172.21.15.17:0/411011068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe86410c430 0x7fe86410e810 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.977+0000 7fe8695ff700 1 --2- 172.21.15.17:0/411011068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8640fe880 0x7fe8640fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.977+0000 7fe8695ff700 1 --2- 172.21.15.17:0/411011068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8640ff190 0x7fe86410bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.977+0000 7fe8695ff700 1 -- 172.21.15.17:0/411011068 >> 172.21.15.17:0/411011068 conn(0x7fe8640fa4b0 msgr2=0x7fe8640fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:16.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.977+0000 7fe8695ff700 1 -- 172.21.15.17:0/411011068 shutdown_connections 2023-07-14T13:17:16.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.977+0000 7fe8695ff700 1 -- 172.21.15.17:0/411011068 wait complete. 2023-07-14T13:17:16.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.978+0000 7fe8695ff700 1 Processor -- start 2023-07-14T13:17:16.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.978+0000 7fe8695ff700 1 -- start start 2023-07-14T13:17:16.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.978+0000 7fe8695ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8640fe880 0x7fe864197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.978+0000 7fe8695ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8640ff190 0x7fe8641983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.978+0000 7fe8695ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe86410c430 0x7fe86419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe8695ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86419ce70 con 0x7fe8640fe880 2023-07-14T13:17:16.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe8695ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86419cfe0 con 0x7fe8640ff190 2023-07-14T13:17:16.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe8695ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86419d1a0 con 0x7fe86410c430 2023-07-14T13:17:16.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8640fe880 0x7fe864197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8640fe880 0x7fe864197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34270/0 (socket says 172.21.15.17:34270) 2023-07-14T13:17:16.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe862ffd700 1 -- 172.21.15.17:0/1897066023 learned_addr learned my addr 172.21.15.17:0/1897066023 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:16.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe8637fe700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe86410c430 0x7fe86419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe8627fc700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8640ff190 0x7fe8641983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe862ffd700 1 -- 172.21.15.17:0/1897066023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe86410c430 msgr2=0x7fe86419c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:16.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe862ffd700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe86410c430 0x7fe86419c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe862ffd700 1 -- 172.21.15.17:0/1897066023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8640ff190 msgr2=0x7fe8641983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe862ffd700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8640ff190 0x7fe8641983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe862ffd700 1 -- 172.21.15.17:0/1897066023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c009c40 con 0x7fe8640fe880 2023-07-14T13:17:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.979+0000 7fe8627fc700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8640ff190 0x7fe8641983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:17:16.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.980+0000 7fe862ffd700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8640fe880 0x7fe864197e90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fe85400e9c0 tx=0x7fe85400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.980+0000 7fe84bfff700 1 -- 172.21.15.17:0/1897066023 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400cbd0 con 0x7fe8640fe880 2023-07-14T13:17:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.980+0000 7fe84bfff700 1 -- 172.21.15.17:0/1897066023 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe85400eeb0 con 0x7fe8640fe880 2023-07-14T13:17:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.980+0000 7fe8695ff700 1 -- 172.21.15.17:0/1897066023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86419d480 con 0x7fe8640fe880 2023-07-14T13:17:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.980+0000 7fe84bfff700 1 -- 172.21.15.17:0/1897066023 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854005410 con 0x7fe8640fe880 2023-07-14T13:17:16.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.980+0000 7fe8695ff700 1 -- 172.21.15.17:0/1897066023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8641a4cc0 con 0x7fe8640fe880 2023-07-14T13:17:16.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.984+0000 7fe84bfff700 1 -- 172.21.15.17:0/1897066023 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe8540055b0 con 0x7fe8640fe880 2023-07-14T13:17:16.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.986+0000 7fe87cf7fb80 1 Processor -- start 2023-07-14T13:17:16.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.986+0000 7fe84bfff700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe84c0a12c0 0x7fe84c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.986+0000 7fe84bfff700 1 -- 172.21.15.17:0/1897066023 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe854014070 con 0x7fe8640fe880 2023-07-14T13:17:16.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.986+0000 7fe87cf7fb80 1 -- start start 2023-07-14T13:17:16.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe8627fc700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe84c0a12c0 0x7fe84c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d852d0 0x55d9d0d856a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d85be0 0x55d9d0d98da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d9b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0c8bcb0 con 0x55d9d0d852d0 2023-07-14T13:17:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0cdea40 con 0x55d9d0d85be0 2023-07-14T13:17:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0cd7ed0 con 0x55d9d0d992e0 2023-07-14T13:17:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d852d0 0x55d9d0d856a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe8627fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d85be0 0x55d9d0d98da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d852d0 0x55d9d0d856a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34272/0 (socket says 172.21.15.17:34272) 2023-07-14T13:17:16.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe862ffd700 1 -- 172.21.15.17:0/4191872819 learned_addr learned my addr 172.21.15.17:0/4191872819 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:16.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.987+0000 7fe8637fe700 1 --2- 172.21.15.17:0/4191872819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d9b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.988+0000 7fe8627fc700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe84c0a12c0 0x7fe84c0a3770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe8641994a0 tx=0x7fe858009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:16.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.988+0000 7fe8627fc700 1 -- 172.21.15.17:0/4191872819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 msgr2=0x55d9d0d9b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:16.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.988+0000 7fe8627fc700 1 --2- 172.21.15.17:0/4191872819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d9b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.988+0000 7fe8627fc700 1 -- 172.21.15.17:0/4191872819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d852d0 msgr2=0x55d9d0d856a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.988+0000 7fe8627fc700 1 --2- 172.21.15.17:0/4191872819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d852d0 0x55d9d0d856a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.988+0000 7fe8627fc700 1 -- 172.21.15.17:0/4191872819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9d0b05de0 con 0x55d9d0d85be0 2023-07-14T13:17:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.988+0000 7fe862ffd700 1 --2- 172.21.15.17:0/4191872819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d852d0 0x55d9d0d856a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.988+0000 7fe8627fc700 1 --2- 172.21.15.17:0/4191872819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d85be0 0x55d9d0d98da0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe8580099a0 tx=0x7fe85801a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e2fff5f09c3ca2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.988+0000 7fe8497fa700 1 -- 172.21.15.17:0/4191872819 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858017040 con 0x55d9d0d85be0 2023-07-14T13:17:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.988+0000 7fe8497fa700 1 -- 172.21.15.17:0/4191872819 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8580036a0 con 0x55d9d0d85be0 2023-07-14T13:17:16.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.988+0000 7fe8497fa700 1 -- 172.21.15.17:0/4191872819 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858011860 con 0x55d9d0d85be0 2023-07-14T13:17:16.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.989+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4191872819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d85be0 msgr2=0x55d9d0d98da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:16.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.989+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/4191872819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d85be0 0x55d9d0d98da0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe8580099a0 tx=0x7fe85801a000 comp rx=0 tx=0).stop 2023-07-14T13:17:16.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.990+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4191872819 shutdown_connections 2023-07-14T13:17:16.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.990+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/4191872819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d9b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.990+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/4191872819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d852d0 0x55d9d0d856a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.990+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/4191872819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d85be0 0x55d9d0d98da0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.990+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4191872819 >> 172.21.15.17:0/4191872819 conn(0x55d9d0d7bda0 msgr2=0x55d9d0d816a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:16.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.990+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4191872819 shutdown_connections 2023-07-14T13:17:16.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.990+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4191872819 wait complete. 2023-07-14T13:17:16.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.990+0000 7fe87cf7fb80 1 -- start start 2023-07-14T13:17:16.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.991+0000 7fe87cf7fb80 1 Processor -- start 2023-07-14T13:17:16.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.991+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 0x55d9d0d98c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.991+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d95f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.991+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d96500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.991+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0c77ac0 con 0x55d9d0d85be0 2023-07-14T13:17:16.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.991+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0c777c0 con 0x55d9d0d852d0 2023-07-14T13:17:16.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.991+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0b5b920 con 0x55d9d0d992e0 2023-07-14T13:17:16.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.991+0000 7fe87cf7fb80 10 client.0 _ll_register_callbacks cb 0x55d9d0c75760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:16.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe8627fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d95f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 0x55d9d0d98c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 0x55d9d0d98c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56958/0 (socket says 172.21.15.17:56958) 2023-07-14T13:17:16.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe862ffd700 1 -- 172.21.15.17:0/3676191253 learned_addr learned my addr 172.21.15.17:0/3676191253 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:16.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe8637fe700 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d96500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe862ffd700 1 -- 172.21.15.17:0/3676191253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 msgr2=0x55d9d0d96500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:16.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe862ffd700 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d96500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe862ffd700 1 -- 172.21.15.17:0/3676191253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 msgr2=0x55d9d0d95f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe862ffd700 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d95f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe862ffd700 1 -- 172.21.15.17:0/3676191253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8641a4cc0 con 0x55d9d0d852d0 2023-07-14T13:17:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe862ffd700 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 0x55d9d0d98c30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c5b0 tx=0x7fe85409a1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4832d820634c6b8d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.992+0000 7fe846ff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:17:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.993+0000 7fe846ff5700 1 -- 172.21.15.17:0/3676191253 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854099560 con 0x55d9d0d852d0 2023-07-14T13:17:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.993+0000 7fe846ff5700 1 -- 172.21.15.17:0/3676191253 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe8540cae40 con 0x55d9d0d852d0 2023-07-14T13:17:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.993+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/3676191253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9d0c314f0 con 0x55d9d0d852d0 2023-07-14T13:17:16.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.993+0000 7fe846ff5700 1 -- 172.21.15.17:0/3676191253 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8540996c0 con 0x55d9d0d852d0 2023-07-14T13:17:16.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.993+0000 7fe87cf7fb80 10 client.28220 fetch_fsmap learned FSMap version 46 2023-07-14T13:17:16.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.993+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/3676191253 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x7fe85800f900 con 0x55d9d0d852d0 2023-07-14T13:17:16.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.993+0000 7fe846ff5700 1 -- 172.21.15.17:0/3676191253 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d9d0c314f0 con 0x55d9d0d852d0 2023-07-14T13:17:16.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.993+0000 7fe846ff5700 1 -- 172.21.15.17:0/3676191253 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 46) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fe854095e60 con 0x55d9d0d852d0 2023-07-14T13:17:16.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.993+0000 7fe87cf7fb80 10 client.28220 fetch_fsmap finished waiting for FSMap version 46 2023-07-14T13:17:16.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.993+0000 7fe87cf7fb80 10 client.28220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.993+0000 7fe87cf7fb80 20 client.28220 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.994+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d9d0da8ab0 0x55d9d0daaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.994+0000 7fe87cf7fb80 4 client.28220 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:17:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.994+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/3676191253 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9d0cd0eb0 con 0x55d9d0da8ab0 2023-07-14T13:17:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.994+0000 7fe8627fc700 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d9d0da8ab0 0x55d9d0daaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.995+0000 7fe8627fc700 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d9d0da8ab0 0x55d9d0daaec0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96fa165d9dbeb5ef server_cookie=e73b24db9af8b945 in_seq=0 out_seq=0 2023-07-14T13:17:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.995+0000 7fe846ff5700 10 client.28220 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.995+0000 7fe846ff5700 1 -- 172.21.15.17:0/3676191253 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d9d0cd0eb0 con 0x55d9d0da8ab0 2023-07-14T13:17:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.995+0000 7fe846ff5700 10 client.28220 handle_command_reply: tid=0 2023-07-14T13:17:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.995+0000 7fe87cf7fb80 1 client.28220 shutdown 2023-07-14T13:17:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.995+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/3676191253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 msgr2=0x55d9d0d98c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.995+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 0x55d9d0d98c30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c5b0 tx=0x7fe85409a1b0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.996+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/3676191253 shutdown_connections 2023-07-14T13:17:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.996+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d9d0da8ab0 0x55d9d0daaec0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.996+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d96500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.996+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 0x55d9d0d98c30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.996+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/3676191253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d95f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.996+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/3676191253 >> 172.21.15.17:0/3676191253 conn(0x55d9d0d7bda0 msgr2=0x55d9d0d81230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:16.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.996+0000 7fe846ff5700 0 client.28220 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:16.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.996+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/3676191253 shutdown_connections 2023-07-14T13:17:16.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.996+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/3676191253 wait complete. 2023-07-14T13:17:16.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:15.996+0000 7fe87cf7fb80 20 client.28220 trim_cache size 0 max 16384 2023-07-14T13:17:16.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.018+0000 7fe87cf7fb80 1 Processor -- start 2023-07-14T13:17:16.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.018+0000 7fe87cf7fb80 1 -- start start 2023-07-14T13:17:16.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.018+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 0x55d9d0d987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.018+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d95700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d95c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0d944a0 con 0x55d9d0d85be0 2023-07-14T13:17:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0d881b0 con 0x55d9d0d852d0 2023-07-14T13:17:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0d96f30 con 0x55d9d0d992e0 2023-07-14T13:17:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe8627fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d95700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe8627fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d95700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34294/0 (socket says 172.21.15.17:34294) 2023-07-14T13:17:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe8627fc700 1 -- 172.21.15.17:0/228415054 learned_addr learned my addr 172.21.15.17:0/228415054 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe862ffd700 1 --2- 172.21.15.17:0/228415054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 0x55d9d0d987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe8637fe700 1 --2- 172.21.15.17:0/228415054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d95c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe8627fc700 1 -- 172.21.15.17:0/228415054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 msgr2=0x55d9d0d95c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe8627fc700 1 --2- 172.21.15.17:0/228415054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d95c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe8627fc700 1 -- 172.21.15.17:0/228415054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 msgr2=0x55d9d0d987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe8627fc700 1 --2- 172.21.15.17:0/228415054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 0x55d9d0d987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe8627fc700 1 -- 172.21.15.17:0/228415054 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9d0aeec60 con 0x55d9d0d85be0 2023-07-14T13:17:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.019+0000 7fe862ffd700 1 --2- 172.21.15.17:0/228415054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 0x55d9d0d987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:17:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.020+0000 7fe8627fc700 1 --2- 172.21.15.17:0/228415054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d95700 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fe858009340 tx=0x7fe8580092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc4e070f9c46c81 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.020+0000 7fe849ffb700 1 -- 172.21.15.17:0/228415054 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85802a030 con 0x55d9d0d85be0 2023-07-14T13:17:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.020+0000 7fe849ffb700 1 -- 172.21.15.17:0/228415054 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe85802b040 con 0x55d9d0d85be0 2023-07-14T13:17:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.020+0000 7fe849ffb700 1 -- 172.21.15.17:0/228415054 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8580055d0 con 0x55d9d0d85be0 2023-07-14T13:17:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.021+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/228415054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 msgr2=0x55d9d0d95700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.021+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/228415054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d95700 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fe858009340 tx=0x7fe8580092d0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.021+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/228415054 shutdown_connections 2023-07-14T13:17:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.021+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/228415054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d992e0 0x55d9d0d95c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.021+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/228415054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d852d0 0x55d9d0d987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.021+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/228415054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d95700 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.021+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/228415054 >> 172.21.15.17:0/228415054 conn(0x55d9d0d7bda0 msgr2=0x55d9d0d91240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.021+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/228415054 shutdown_connections 2023-07-14T13:17:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.021+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/228415054 wait complete. 2023-07-14T13:17:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.022+0000 7fe87cf7fb80 1 -- start start 2023-07-14T13:17:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.022+0000 7fe87cf7fb80 1 Processor -- start 2023-07-14T13:17:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.022+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d852d0 0x55d9d0d9fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.022+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d9e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.022+0000 7fe87cf7fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d992e0 0x55d9d0d9e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.022+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0d9ed00 con 0x55d9d0d85be0 2023-07-14T13:17:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.022+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0d9ee70 con 0x55d9d0d992e0 2023-07-14T13:17:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.022+0000 7fe87cf7fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d0dfc9a0 con 0x55d9d0d852d0 2023-07-14T13:17:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.023+0000 7fe87cf7fb80 10 client.0 _ll_register_callbacks cb 0x7fe85400cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.023+0000 7fe8627fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d9e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.023+0000 7fe8627fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d9e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34296/0 (socket says 172.21.15.17:34296) 2023-07-14T13:17:16.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.023+0000 7fe8627fc700 1 -- 172.21.15.17:0/4114176440 learned_addr learned my addr 172.21.15.17:0/4114176440 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.023+0000 7fe8637fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d992e0 0x55d9d0d9e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.023+0000 7fe862ffd700 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d852d0 0x55d9d0d9fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.023+0000 7fe8637fe700 1 -- 172.21.15.17:0/4114176440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d852d0 msgr2=0x55d9d0d9fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.023+0000 7fe8637fe700 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d852d0 0x55d9d0d9fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.023+0000 7fe8637fe700 1 -- 172.21.15.17:0/4114176440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 msgr2=0x55d9d0d9e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.023+0000 7fe8637fe700 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d9e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.023+0000 7fe8637fe700 1 -- 172.21.15.17:0/4114176440 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9d0b05de0 con 0x55d9d0d992e0 2023-07-14T13:17:16.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.024+0000 7fe8637fe700 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d992e0 0x55d9d0d9e630 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00b6c0 tx=0x7fe85c007ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84d049a2f9e605e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.024+0000 7fe846ff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:17:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.024+0000 7fe846ff5700 1 -- 172.21.15.17:0/4114176440 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c021070 con 0x55d9d0d992e0 2023-07-14T13:17:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.024+0000 7fe846ff5700 1 -- 172.21.15.17:0/4114176440 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe85c003a00 con 0x55d9d0d992e0 2023-07-14T13:17:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.024+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4114176440 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe8580036a0 con 0x55d9d0d992e0 2023-07-14T13:17:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.024+0000 7fe846ff5700 1 -- 172.21.15.17:0/4114176440 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe85c00e040 con 0x55d9d0d992e0 2023-07-14T13:17:16.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.024+0000 7fe87cf7fb80 10 client.28226 fetch_fsmap learned FSMap version 46 2023-07-14T13:17:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.024+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4114176440 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55d9d0b2c250 con 0x55d9d0d992e0 2023-07-14T13:17:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.025+0000 7fe846ff5700 1 -- 172.21.15.17:0/4114176440 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8580036a0 con 0x55d9d0d992e0 2023-07-14T13:17:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.025+0000 7fe846ff5700 1 -- 172.21.15.17:0/4114176440 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 46) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fe85c00b050 con 0x55d9d0d992e0 2023-07-14T13:17:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.025+0000 7fe87cf7fb80 10 client.28226 fetch_fsmap finished waiting for FSMap version 46 2023-07-14T13:17:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.025+0000 7fe87cf7fb80 10 client.28226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.025+0000 7fe87cf7fb80 20 client.28226 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:16.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.025+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d9d0dfe010 0x55d9d0e00420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:16.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.025+0000 7fe87cf7fb80 4 client.28226 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:17:16.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.025+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4114176440 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d9d0c93050 con 0x55d9d0dfe010 2023-07-14T13:17:16.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.025+0000 7fe862ffd700 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d9d0dfe010 0x55d9d0e00420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:16.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe862ffd700 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d9d0dfe010 0x55d9d0e00420 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da6438fe6a262592 server_cookie=6978992e334085ba in_seq=0 out_seq=0 2023-07-14T13:17:16.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe846ff5700 10 client.28226 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:16.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe846ff5700 1 -- 172.21.15.17:0/4114176440 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d9d0c93050 con 0x55d9d0dfe010 2023-07-14T13:17:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe846ff5700 10 client.28226 handle_command_reply: tid=0 2023-07-14T13:17:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe87cf7fb80 1 client.28226 shutdown 2023-07-14T13:17:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4114176440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d992e0 msgr2=0x55d9d0d9e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d992e0 0x55d9d0d9e630 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00b6c0 tx=0x7fe85c007ce0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4114176440 shutdown_connections 2023-07-14T13:17:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d9d0dfe010 0x55d9d0e00420 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d9d0d992e0 0x55d9d0d9e630 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9d0d852d0 0x55d9d0d9fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe846ff5700 0 client.28226 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.026+0000 7fe87cf7fb80 1 --2- 172.21.15.17:0/4114176440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d9d0d85be0 0x55d9d0d9e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.027+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4114176440 >> 172.21.15.17:0/4114176440 conn(0x55d9d0d7bda0 msgr2=0x55d9d0d871a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.027+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4114176440 shutdown_connections 2023-07-14T13:17:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.027+0000 7fe87cf7fb80 1 -- 172.21.15.17:0/4114176440 wait complete. 2023-07-14T13:17:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.027+0000 7fe87cf7fb80 20 client.28226 trim_cache size 0 max 16384 2023-07-14T13:17:16.075 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:17:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:17:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:17:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "8c13ab33-9f06-43b5-98c1-3af85d6173f4": { 2023-07-14T13:17:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:17:16.075 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "8c13ab33-9f06-43b5-98c1-3af85d6173f4", 2023-07-14T13:17:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:17:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:17:16.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:17:16.076 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:17:16.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.027+0000 7fe8695ff700 1 -- 172.21.15.17:0/1897066023 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe84c0a12c0 msgr2=0x7fe84c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:16.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.027+0000 7fe8695ff700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe84c0a12c0 0x7fe84c0a3770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe8641994a0 tx=0x7fe858009260 comp rx=0 tx=0).stop 2023-07-14T13:17:16.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.027+0000 7fe8695ff700 1 -- 172.21.15.17:0/1897066023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8640fe880 msgr2=0x7fe864197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:16.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.028+0000 7fe8695ff700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8640fe880 0x7fe864197e90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fe85400e9c0 tx=0x7fe85400ecd0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.028+0000 7fe8695ff700 1 -- 172.21.15.17:0/1897066023 shutdown_connections 2023-07-14T13:17:16.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.028+0000 7fe8695ff700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe84c0a12c0 0x7fe84c0a3770 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.028+0000 7fe8695ff700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe86410c430 0x7fe86419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.028+0000 7fe8695ff700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8640fe880 0x7fe864197e90 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.028+0000 7fe8695ff700 1 --2- 172.21.15.17:0/1897066023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8640ff190 0x7fe8641983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:16.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.028+0000 7fe8695ff700 1 -- 172.21.15.17:0/1897066023 >> 172.21.15.17:0/1897066023 conn(0x7fe8640fa4b0 msgr2=0x7fe86410d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:16.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.028+0000 7fe8695ff700 1 -- 172.21.15.17:0/1897066023 shutdown_connections 2023-07-14T13:17:16.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:16.028+0000 7fe8695ff700 1 -- 172.21.15.17:0/1897066023 wait complete. 2023-07-14T13:17:16.086 INFO:tasks.cephfs.filesystem:scrub status for tag:8c13ab33-9f06-43b5-98c1-3af85d6173f4 - {'path': '/', 'tag': '8c13ab33-9f06-43b5-98c1-3af85d6173f4', 'options': 'recursive,force'} 2023-07-14T13:17:17.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:17 smithi131 ceph-mon[96953]: pgmap v553: 97 pgs: 97 active+clean; 15 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 33 MiB/s wr, 140 op/s 2023-07-14T13:17:17.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:17 smithi017 ceph-mon[95536]: pgmap v553: 97 pgs: 97 active+clean; 15 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 33 MiB/s wr, 140 op/s 2023-07-14T13:17:17.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:17 smithi135 ceph-mon[97338]: pgmap v553: 97 pgs: 97 active+clean; 15 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 33 MiB/s wr, 140 op/s 2023-07-14T13:17:18.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:18 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:17:18.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:18 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:17:18.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:18 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:17:19.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:19 smithi017 ceph-mon[95536]: pgmap v554: 97 pgs: 97 active+clean; 15 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 33 MiB/s wr, 140 op/s 2023-07-14T13:17:19.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:19 smithi135 ceph-mon[97338]: pgmap v554: 97 pgs: 97 active+clean; 15 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 33 MiB/s wr, 140 op/s 2023-07-14T13:17:19.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:19 smithi131 ceph-mon[96953]: pgmap v554: 97 pgs: 97 active+clean; 15 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 33 MiB/s wr, 140 op/s 2023-07-14T13:17:20.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:20 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:17:20.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:20 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:17:21.125 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:20 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:17:21.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:21 smithi135 ceph-mon[97338]: pgmap v555: 97 pgs: 97 active+clean; 15 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 33 MiB/s wr, 128 op/s 2023-07-14T13:17:21.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:21 smithi131 ceph-mon[96953]: pgmap v555: 97 pgs: 97 active+clean; 15 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 33 MiB/s wr, 128 op/s 2023-07-14T13:17:22.235 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:21 smithi017 ceph-mon[95536]: pgmap v555: 97 pgs: 97 active+clean; 15 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 33 MiB/s wr, 128 op/s 2023-07-14T13:17:23.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:23 smithi017 ceph-mon[95536]: pgmap v556: 97 pgs: 97 active+clean; 15 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 31 MiB/s wr, 117 op/s 2023-07-14T13:17:23.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:23 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:17:23.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:23 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:17:23.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:23 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:17:23.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:23 smithi135 ceph-mon[97338]: pgmap v556: 97 pgs: 97 active+clean; 15 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 31 MiB/s wr, 117 op/s 2023-07-14T13:17:23.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:23 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:17:23.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:23 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:17:23.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:23 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:17:23.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:23 smithi131 ceph-mon[96953]: pgmap v556: 97 pgs: 97 active+clean; 15 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 31 MiB/s wr, 117 op/s 2023-07-14T13:17:23.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:23 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:17:23.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:23 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:17:23.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:23 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:17:25.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:25 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:17:25.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:25 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:17:25.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:25 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:17:25.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:25 smithi017 ceph-mon[95536]: pgmap v557: 97 pgs: 97 active+clean; 15 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 28 MiB/s wr, 107 op/s 2023-07-14T13:17:25.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:25 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:17:25.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:25 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:17:25.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:25 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:17:25.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:25 smithi135 ceph-mon[97338]: pgmap v557: 97 pgs: 97 active+clean; 15 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 28 MiB/s wr, 107 op/s 2023-07-14T13:17:25.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:25 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:17:25.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:25 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:17:25.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:25 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:17:25.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:25 smithi131 ceph-mon[96953]: pgmap v557: 97 pgs: 97 active+clean; 15 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 28 MiB/s wr, 107 op/s 2023-07-14T13:17:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.460+0000 7f98793ff700 1 -- 172.21.15.17:0/3428508824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98740ffb30 msgr2=0x7f98740fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.460+0000 7f98793ff700 1 --2- 172.21.15.17:0/3428508824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98740ffb30 0x7f98740fffa0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f9868009990 tx=0x7f9868009ca0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.460+0000 7f98793ff700 1 -- 172.21.15.17:0/3428508824 shutdown_connections 2023-07-14T13:17:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.460+0000 7f98793ff700 1 --2- 172.21.15.17:0/3428508824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98741004e0 0x7f987410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.460+0000 7f98793ff700 1 --2- 172.21.15.17:0/3428508824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9874105b60 0x7f9874105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.460+0000 7f98793ff700 1 --2- 172.21.15.17:0/3428508824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98740ffb30 0x7f98740fffa0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.460+0000 7f98793ff700 1 -- 172.21.15.17:0/3428508824 >> 172.21.15.17:0/3428508824 conn(0x7f98740fb5f0 msgr2=0x7f98740fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.461+0000 7f98793ff700 1 -- 172.21.15.17:0/3428508824 shutdown_connections 2023-07-14T13:17:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.461+0000 7f98793ff700 1 -- 172.21.15.17:0/3428508824 wait complete. 2023-07-14T13:17:26.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.462+0000 7f98793ff700 1 Processor -- start 2023-07-14T13:17:26.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.462+0000 7f98793ff700 1 -- start start 2023-07-14T13:17:26.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.462+0000 7f98793ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98740ffb30 0x7f98740729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.462+0000 7f98793ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98741004e0 0x7f9874072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.462+0000 7f98793ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9874105b60 0x7f98741a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.462+0000 7f98793ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98741a41c0 con 0x7f98740ffb30 2023-07-14T13:17:26.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.462+0000 7f98793ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98741a4300 con 0x7f98741004e0 2023-07-14T13:17:26.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.462+0000 7f98793ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98741a4470 con 0x7f9874105b60 2023-07-14T13:17:26.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.462+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98740ffb30 0x7f98740729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.462+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98740ffb30 0x7f98740729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45230/0 (socket says 172.21.15.17:45230) 2023-07-14T13:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f9872ffd700 1 -- 172.21.15.17:0/634314981 learned_addr learned my addr 172.21.15.17:0/634314981 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f98737fe700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9874105b60 0x7f98741a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f98727fc700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98741004e0 0x7f9874072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f9872ffd700 1 -- 172.21.15.17:0/634314981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9874105b60 msgr2=0x7f98741a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f9872ffd700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9874105b60 0x7f98741a3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f9872ffd700 1 -- 172.21.15.17:0/634314981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98741004e0 msgr2=0x7f9874072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f9872ffd700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98741004e0 0x7f9874072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f9872ffd700 1 -- 172.21.15.17:0/634314981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98680095f0 con 0x7f98740ffb30 2023-07-14T13:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f98727fc700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98741004e0 0x7f9874072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f9872ffd700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98740ffb30 0x7f98740729f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f986400e9a0 tx=0x7f986400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f985bfff700 1 -- 172.21.15.17:0/634314981 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9864009790 con 0x7f98740ffb30 2023-07-14T13:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.463+0000 7f985bfff700 1 -- 172.21.15.17:0/634314981 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f986400cbd0 con 0x7f98740ffb30 2023-07-14T13:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.464+0000 7f98793ff700 1 -- 172.21.15.17:0/634314981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98741a4750 con 0x7f98740ffb30 2023-07-14T13:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.464+0000 7f985bfff700 1 -- 172.21.15.17:0/634314981 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9864018680 con 0x7f98740ffb30 2023-07-14T13:17:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.464+0000 7f98793ff700 1 -- 172.21.15.17:0/634314981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98741a4c60 con 0x7f98740ffb30 2023-07-14T13:17:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.467+0000 7f985bfff700 1 -- 172.21.15.17:0/634314981 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f986400cd40 con 0x7f98740ffb30 2023-07-14T13:17:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.468+0000 7f985bfff700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f985c0a12c0 0x7f985c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.469+0000 7f985bfff700 1 -- 172.21.15.17:0/634314981 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9864014070 con 0x7f98740ffb30 2023-07-14T13:17:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.469+0000 7f98727fc700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f985c0a12c0 0x7f985c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.469+0000 7f98727fc700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f985c0a12c0 0x7f985c0a3770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9868006010 tx=0x7f986800b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.513+0000 7f988cdc6b80 1 Processor -- start 2023-07-14T13:17:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f988cdc6b80 1 -- start start 2023-07-14T13:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 0x559c6dfc9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 0x559c6dfc4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfc4580 0x559c6dfc49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6dec9c50 con 0x559c6dfca2d0 2023-07-14T13:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6df1c9e0 con 0x559c6dfc4580 2023-07-14T13:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6df15e70 con 0x559c6de206b0 2023-07-14T13:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f98727fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 0x559c6dfc4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 0x559c6dfc9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 0x559c6dfc9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:56582/0 (socket says 172.21.15.17:56582) 2023-07-14T13:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f98727fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 0x559c6dfc4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45242/0 (socket says 172.21.15.17:45242) 2023-07-14T13:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.514+0000 7f9872ffd700 1 -- 172.21.15.17:0/1873043839 learned_addr learned my addr 172.21.15.17:0/1873043839 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.515+0000 7f98737fe700 1 --2- 172.21.15.17:0/1873043839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfc4580 0x559c6dfc49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.515+0000 7f9872ffd700 1 -- 172.21.15.17:0/1873043839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfc4580 msgr2=0x559c6dfc49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.515+0000 7f9872ffd700 1 --2- 172.21.15.17:0/1873043839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfc4580 0x559c6dfc49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.515+0000 7f9872ffd700 1 -- 172.21.15.17:0/1873043839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 msgr2=0x559c6dfc4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.515+0000 7f9872ffd700 1 --2- 172.21.15.17:0/1873043839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 0x559c6dfc4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.515+0000 7f9872ffd700 1 -- 172.21.15.17:0/1873043839 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c6dd43d80 con 0x559c6de206b0 2023-07-14T13:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.515+0000 7f9872ffd700 1 --2- 172.21.15.17:0/1873043839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 0x559c6dfc9d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9864096590 tx=0x7f9864099cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d799cd0506624016 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.515+0000 7f98597fa700 1 -- 172.21.15.17:0/1873043839 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986409e0c0 con 0x559c6de206b0 2023-07-14T13:17:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.515+0000 7f98597fa700 1 -- 172.21.15.17:0/1873043839 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98640a24e0 con 0x559c6de206b0 2023-07-14T13:17:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.515+0000 7f98597fa700 1 -- 172.21.15.17:0/1873043839 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640a2050 con 0x559c6de206b0 2023-07-14T13:17:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.516+0000 7f988cdc6b80 1 -- 172.21.15.17:0/1873043839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 msgr2=0x559c6dfc9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.516+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/1873043839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 0x559c6dfc9d90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9864096590 tx=0x7f9864099cc0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.516+0000 7f988cdc6b80 1 -- 172.21.15.17:0/1873043839 shutdown_connections 2023-07-14T13:17:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.516+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/1873043839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfc4580 0x559c6dfc49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.516+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/1873043839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 0x559c6dfc9d90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.516+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/1873043839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 0x559c6dfc4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.516+0000 7f988cdc6b80 1 -- 172.21.15.17:0/1873043839 >> 172.21.15.17:0/1873043839 conn(0x559c6dfb9be0 msgr2=0x559c6dfbef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.517+0000 7f988cdc6b80 1 -- 172.21.15.17:0/1873043839 shutdown_connections 2023-07-14T13:17:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.517+0000 7f988cdc6b80 1 -- 172.21.15.17:0/1873043839 wait complete. 2023-07-14T13:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.517+0000 7f988cdc6b80 1 -- start start 2023-07-14T13:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.517+0000 7f988cdc6b80 1 Processor -- start 2023-07-14T13:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 0x559c6dfd0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6dfc4580 0x559c6dfcd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfca2d0 0x559c6dfcdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6deb5a60 con 0x559c6de206b0 2023-07-14T13:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6deb5760 con 0x559c6dfca2d0 2023-07-14T13:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6dd998c0 con 0x559c6dfc4580 2023-07-14T13:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f988cdc6b80 10 client.0 _ll_register_callbacks cb 0x559c6deb3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 0x559c6dfd0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f98727fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6dfc4580 0x559c6dfcd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f98727fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6dfc4580 0x559c6dfcd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:56588/0 (socket says 172.21.15.17:56588) 2023-07-14T13:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f98727fc700 1 -- 172.21.15.17:0/2451048511 learned_addr learned my addr 172.21.15.17:0/2451048511 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.518+0000 7f98737fe700 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfca2d0 0x559c6dfcdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f9872ffd700 1 -- 172.21.15.17:0/2451048511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6dfc4580 msgr2=0x559c6dfcd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f9872ffd700 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6dfc4580 0x559c6dfcd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f9872ffd700 1 -- 172.21.15.17:0/2451048511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfca2d0 msgr2=0x559c6dfcdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f9872ffd700 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfca2d0 0x559c6dfcdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f9872ffd700 1 -- 172.21.15.17:0/2451048511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98741a4c60 con 0x559c6de206b0 2023-07-14T13:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f9872ffd700 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 0x559c6dfd0630 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x559c6dfca810 tx=0x7f98640997b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e33e46108deabca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f9856ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f9856ff5700 1 -- 172.21.15.17:0/2451048511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986409e0c0 con 0x559c6de206b0 2023-07-14T13:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f9856ff5700 1 -- 172.21.15.17:0/2451048511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f98640a2260 con 0x559c6de206b0 2023-07-14T13:17:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2451048511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c6de6f490 con 0x559c6de206b0 2023-07-14T13:17:26.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f9856ff5700 1 -- 172.21.15.17:0/2451048511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98640b82f0 con 0x559c6de206b0 2023-07-14T13:17:26.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.519+0000 7f988cdc6b80 10 client.18534 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.520+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2451048511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x559c6dd2cc00 con 0x559c6de206b0 2023-07-14T13:17:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.520+0000 7f9856ff5700 1 -- 172.21.15.17:0/2451048511 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559c6de6f490 con 0x559c6de206b0 2023-07-14T13:17:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.520+0000 7f9856ff5700 1 -- 172.21.15.17:0/2451048511 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9864098ff0 con 0x559c6de206b0 2023-07-14T13:17:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.520+0000 7f988cdc6b80 10 client.18534 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.520+0000 7f988cdc6b80 10 client.18534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.520+0000 7f988cdc6b80 20 client.18534 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.520+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559c6dfdd7f0 0x559c6dfdfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.520+0000 7f988cdc6b80 4 client.18534 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:17:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.520+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2451048511 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c6df0ee50 con 0x559c6dfdd7f0 2023-07-14T13:17:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.520+0000 7f98727fc700 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559c6dfdd7f0 0x559c6dfdfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.521+0000 7f98727fc700 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559c6dfdd7f0 0x559c6dfdfbd0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cadc54e7e326a3a3 server_cookie=2f83bbd825348879 in_seq=0 out_seq=0 2023-07-14T13:17:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.521+0000 7f9856ff5700 10 client.18534 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f9856ff5700 1 -- 172.21.15.17:0/2451048511 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559c6df0ee50 con 0x559c6dfdd7f0 2023-07-14T13:17:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f9856ff5700 10 client.18534 handle_command_reply: tid=0 2023-07-14T13:17:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 1 client.18534 shutdown 2023-07-14T13:17:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2451048511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 msgr2=0x559c6dfd0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 0x559c6dfd0630 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x559c6dfca810 tx=0x7f98640997b0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2451048511 shutdown_connections 2023-07-14T13:17:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559c6dfdd7f0 0x559c6dfdfbd0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfca2d0 0x559c6dfcdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 0x559c6dfd0630 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f9856ff5700 0 client.18534 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2451048511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6dfc4580 0x559c6dfcd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2451048511 >> 172.21.15.17:0/2451048511 conn(0x559c6dfb9be0 msgr2=0x559c6dfbe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2451048511 shutdown_connections 2023-07-14T13:17:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2451048511 wait complete. 2023-07-14T13:17:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.522+0000 7f988cdc6b80 20 client.18534 trim_cache size 0 max 16384 2023-07-14T13:17:26.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f988cdc6b80 1 Processor -- start 2023-07-14T13:17:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f988cdc6b80 1 -- start start 2023-07-14T13:17:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 0x559c6dfc4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfc4580 0x559c6dfcd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 0x559c6dfbec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6dfca8a0 con 0x559c6dfca2d0 2023-07-14T13:17:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6dfc9a10 con 0x559c6dfc4580 2023-07-14T13:17:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6dfce5b0 con 0x559c6de206b0 2023-07-14T13:17:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f98737fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 0x559c6dfbec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 0x559c6dfc4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f98737fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 0x559c6dfbec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45258/0 (socket says 172.21.15.17:45258) 2023-07-14T13:17:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 0x559c6dfc4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:56602/0 (socket says 172.21.15.17:56602) 2023-07-14T13:17:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.539+0000 7f98737fe700 1 -- 172.21.15.17:0/1150474882 learned_addr learned my addr 172.21.15.17:0/1150474882 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.540+0000 7f98727fc700 1 --2- 172.21.15.17:0/1150474882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfc4580 0x559c6dfcd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.540+0000 7f98737fe700 1 -- 172.21.15.17:0/1150474882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 msgr2=0x559c6dfc4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:26.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.540+0000 7f98737fe700 1 --2- 172.21.15.17:0/1150474882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 0x559c6dfc4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.540+0000 7f98737fe700 1 -- 172.21.15.17:0/1150474882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfc4580 msgr2=0x559c6dfcd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:26.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.540+0000 7f98737fe700 1 --2- 172.21.15.17:0/1150474882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfc4580 0x559c6dfcd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.540+0000 7f98737fe700 1 -- 172.21.15.17:0/1150474882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c6dd6a1f0 con 0x559c6dfca2d0 2023-07-14T13:17:26.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.540+0000 7f98727fc700 1 --2- 172.21.15.17:0/1150474882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfc4580 0x559c6dfcd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:17:26.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.540+0000 7f98737fe700 1 --2- 172.21.15.17:0/1150474882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 0x559c6dfbec60 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f986c007730 tx=0x7f986c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dba353a41126daf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:26.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.540+0000 7f9859ffb700 1 -- 172.21.15.17:0/1150474882 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00e040 con 0x559c6dfca2d0 2023-07-14T13:17:26.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.540+0000 7f9859ffb700 1 -- 172.21.15.17:0/1150474882 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f986c00f040 con 0x559c6dfca2d0 2023-07-14T13:17:26.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.540+0000 7f9859ffb700 1 -- 172.21.15.17:0/1150474882 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c0179d0 con 0x559c6dfca2d0 2023-07-14T13:17:26.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.541+0000 7f988cdc6b80 1 -- 172.21.15.17:0/1150474882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 msgr2=0x559c6dfbec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:26.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.541+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/1150474882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 0x559c6dfbec60 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f986c007730 tx=0x7f986c00b040 comp rx=0 tx=0).stop 2023-07-14T13:17:26.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.541+0000 7f988cdc6b80 1 -- 172.21.15.17:0/1150474882 shutdown_connections 2023-07-14T13:17:26.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.541+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/1150474882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6dfca2d0 0x559c6dfbec60 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.541+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/1150474882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6de206b0 0x559c6dfc4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.541+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/1150474882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfc4580 0x559c6dfcd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.541+0000 7f988cdc6b80 1 -- 172.21.15.17:0/1150474882 >> 172.21.15.17:0/1150474882 conn(0x559c6dfb9be0 msgr2=0x559c6dfcd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.541+0000 7f988cdc6b80 1 -- 172.21.15.17:0/1150474882 shutdown_connections 2023-07-14T13:17:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.541+0000 7f988cdc6b80 1 -- 172.21.15.17:0/1150474882 wait complete. 2023-07-14T13:17:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.542+0000 7f988cdc6b80 1 -- start start 2023-07-14T13:17:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.542+0000 7f988cdc6b80 1 Processor -- start 2023-07-14T13:17:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.542+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 0x559c6dfd4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.542+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6dfc4580 0x559c6dfd2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.542+0000 7f988cdc6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfca2d0 0x559c6dfd31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.542+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6dfd3730 con 0x559c6de206b0 2023-07-14T13:17:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.542+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6dfd38a0 con 0x559c6dfca2d0 2023-07-14T13:17:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.542+0000 7f988cdc6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6dfd3a60 con 0x559c6dfc4580 2023-07-14T13:17:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.542+0000 7f988cdc6b80 10 client.0 _ll_register_callbacks cb 0x7f9868009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 0x559c6dfd4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 0x559c6dfd4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45260/0 (socket says 172.21.15.17:45260) 2023-07-14T13:17:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9872ffd700 1 -- 172.21.15.17:0/2866567713 learned_addr learned my addr 172.21.15.17:0/2866567713 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f98727fc700 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6dfc4580 0x559c6dfd2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f98737fe700 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfca2d0 0x559c6dfd31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9872ffd700 1 -- 172.21.15.17:0/2866567713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6dfc4580 msgr2=0x559c6dfd2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9872ffd700 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6dfc4580 0x559c6dfd2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9872ffd700 1 -- 172.21.15.17:0/2866567713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfca2d0 msgr2=0x559c6dfd31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9872ffd700 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfca2d0 0x559c6dfd31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9872ffd700 1 -- 172.21.15.17:0/2866567713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c0073e0 con 0x559c6de206b0 2023-07-14T13:17:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f98737fe700 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfca2d0 0x559c6dfd31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:17:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9872ffd700 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 0x559c6dfd4a00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f9864096590 tx=0x7f98640998a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594366324ac8c442 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9856ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:17:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9856ff5700 1 -- 172.21.15.17:0/2866567713 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986409aef0 con 0x559c6de206b0 2023-07-14T13:17:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.543+0000 7f9856ff5700 1 -- 172.21.15.17:0/2866567713 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f986409e0c0 con 0x559c6de206b0 2023-07-14T13:17:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2866567713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98640a24e0 con 0x559c6de206b0 2023-07-14T13:17:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f9856ff5700 1 -- 172.21.15.17:0/2866567713 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f986409b060 con 0x559c6de206b0 2023-07-14T13:17:26.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f988cdc6b80 10 client.18540 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:26.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2866567713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x559c6dd42250 con 0x559c6de206b0 2023-07-14T13:17:26.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f9856ff5700 1 -- 172.21.15.17:0/2866567713 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98640a24e0 con 0x559c6de206b0 2023-07-14T13:17:26.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f9856ff5700 1 -- 172.21.15.17:0/2866567713 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9864095e80 con 0x559c6de206b0 2023-07-14T13:17:26.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f988cdc6b80 10 client.18540 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:26.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f988cdc6b80 10 client.18540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:26.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f988cdc6b80 20 client.18540 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:26.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559c6e0324f0 0x559c6e0348d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:26.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f988cdc6b80 4 client.18540 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:17:26.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.544+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2866567713 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559c6ded0ff0 con 0x559c6e0324f0 2023-07-14T13:17:26.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.545+0000 7f98727fc700 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559c6e0324f0 0x559c6e0348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:26.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.545+0000 7f98727fc700 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559c6e0324f0 0x559c6e0348d0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b26d3ac6f8a996bc server_cookie=d4e6024d3dadbdc6 in_seq=0 out_seq=0 2023-07-14T13:17:26.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.545+0000 7f9856ff5700 10 client.18540 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f9856ff5700 1 -- 172.21.15.17:0/2866567713 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559c6ded0ff0 con 0x559c6e0324f0 2023-07-14T13:17:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f9856ff5700 10 client.18540 handle_command_reply: tid=0 2023-07-14T13:17:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f988cdc6b80 1 client.18540 shutdown 2023-07-14T13:17:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2866567713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 msgr2=0x559c6dfd4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 0x559c6dfd4a00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f9864096590 tx=0x7f98640998a0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2866567713 shutdown_connections 2023-07-14T13:17:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559c6e0324f0 0x559c6e0348d0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559c6dfca2d0 0x559c6dfd31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559c6de206b0 0x559c6dfd4a00 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f988cdc6b80 1 --2- 172.21.15.17:0/2866567713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c6dfc4580 0x559c6dfd2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2866567713 >> 172.21.15.17:0/2866567713 conn(0x559c6dfb9be0 msgr2=0x559c6dfcaad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f9856ff5700 0 client.18540 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2866567713 shutdown_connections 2023-07-14T13:17:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.570+0000 7f988cdc6b80 1 -- 172.21.15.17:0/2866567713 wait complete. 2023-07-14T13:17:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.571+0000 7f988cdc6b80 20 client.18540 trim_cache size 0 max 16384 2023-07-14T13:17:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:17:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:17:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:17:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:17:26.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.571+0000 7f98793ff700 1 -- 172.21.15.17:0/634314981 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f985c0a12c0 msgr2=0x7f985c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.571+0000 7f98793ff700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f985c0a12c0 0x7f985c0a3770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9868006010 tx=0x7f986800b260 comp rx=0 tx=0).stop 2023-07-14T13:17:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.571+0000 7f98793ff700 1 -- 172.21.15.17:0/634314981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98740ffb30 msgr2=0x7f98740729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.571+0000 7f98793ff700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98740ffb30 0x7f98740729f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f986400e9a0 tx=0x7f986400ecb0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.571+0000 7f98793ff700 1 -- 172.21.15.17:0/634314981 shutdown_connections 2023-07-14T13:17:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.571+0000 7f98793ff700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f985c0a12c0 0x7f985c0a3770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.571+0000 7f98793ff700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9874105b60 0x7f98741a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.571+0000 7f98793ff700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98740ffb30 0x7f98740729f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.571+0000 7f98793ff700 1 --2- 172.21.15.17:0/634314981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98741004e0 0x7f9874072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.571+0000 7f98793ff700 1 -- 172.21.15.17:0/634314981 >> 172.21.15.17:0/634314981 conn(0x7f98740fb5f0 msgr2=0x7f9874103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.572+0000 7f98793ff700 1 -- 172.21.15.17:0/634314981 shutdown_connections 2023-07-14T13:17:26.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:26.572+0000 7f98793ff700 1 -- 172.21.15.17:0/634314981 wait complete. 2023-07-14T13:17:27.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:27 smithi017 ceph-mon[95536]: pgmap v558: 97 pgs: 97 active+clean; 15 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 42 MiB/s wr, 136 op/s 2023-07-14T13:17:27.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:27 smithi135 ceph-mon[97338]: pgmap v558: 97 pgs: 97 active+clean; 15 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 42 MiB/s wr, 136 op/s 2023-07-14T13:17:27.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:27 smithi131 ceph-mon[96953]: pgmap v558: 97 pgs: 97 active+clean; 15 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 42 MiB/s wr, 136 op/s 2023-07-14T13:17:29.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:29 smithi017 ceph-mon[95536]: pgmap v559: 97 pgs: 97 active+clean; 15 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 28 MiB/s wr, 75 op/s 2023-07-14T13:17:29.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:29 smithi135 ceph-mon[97338]: pgmap v559: 97 pgs: 97 active+clean; 15 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 28 MiB/s wr, 75 op/s 2023-07-14T13:17:29.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:29 smithi131 ceph-mon[96953]: pgmap v559: 97 pgs: 97 active+clean; 15 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 28 MiB/s wr, 75 op/s 2023-07-14T13:17:31.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:31 smithi017 ceph-mon[95536]: pgmap v560: 97 pgs: 97 active+clean; 16 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 38 MiB/s wr, 146 op/s 2023-07-14T13:17:31.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:31 smithi135 ceph-mon[97338]: pgmap v560: 97 pgs: 97 active+clean; 16 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 38 MiB/s wr, 146 op/s 2023-07-14T13:17:31.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:31 smithi131 ceph-mon[96953]: pgmap v560: 97 pgs: 97 active+clean; 16 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 38 MiB/s wr, 146 op/s 2023-07-14T13:17:33.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:33 smithi017 ceph-mon[95536]: pgmap v561: 97 pgs: 97 active+clean; 16 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 24 MiB/s wr, 100 op/s 2023-07-14T13:17:33.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:33 smithi135 ceph-mon[97338]: pgmap v561: 97 pgs: 97 active+clean; 16 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 24 MiB/s wr, 100 op/s 2023-07-14T13:17:33.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:33 smithi131 ceph-mon[96953]: pgmap v561: 97 pgs: 97 active+clean; 16 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 24 MiB/s wr, 100 op/s 2023-07-14T13:17:35.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:35 smithi017 ceph-mon[95536]: pgmap v562: 97 pgs: 97 active+clean; 16 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 24 MiB/s wr, 100 op/s 2023-07-14T13:17:35.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:35 smithi135 ceph-mon[97338]: pgmap v562: 97 pgs: 97 active+clean; 16 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 24 MiB/s wr, 100 op/s 2023-07-14T13:17:35.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:35 smithi131 ceph-mon[96953]: pgmap v562: 97 pgs: 97 active+clean; 16 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 24 MiB/s wr, 100 op/s 2023-07-14T13:17:37.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:37 smithi131 ceph-mon[96953]: pgmap v563: 97 pgs: 97 active+clean; 16 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 37 MiB/s wr, 145 op/s 2023-07-14T13:17:37.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:37 smithi017 ceph-mon[95536]: pgmap v563: 97 pgs: 97 active+clean; 16 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 37 MiB/s wr, 145 op/s 2023-07-14T13:17:37.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:37 smithi135 ceph-mon[97338]: pgmap v563: 97 pgs: 97 active+clean; 16 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 37 MiB/s wr, 145 op/s 2023-07-14T13:17:39.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:39 smithi131 ceph-mon[96953]: pgmap v564: 97 pgs: 97 active+clean; 16 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 23 MiB/s wr, 116 op/s 2023-07-14T13:17:39.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:39 smithi017 ceph-mon[95536]: pgmap v564: 97 pgs: 97 active+clean; 16 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 23 MiB/s wr, 116 op/s 2023-07-14T13:17:39.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:39 smithi135 ceph-mon[97338]: pgmap v564: 97 pgs: 97 active+clean; 16 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 23 MiB/s wr, 116 op/s 2023-07-14T13:17:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.790+0000 7fe839bff700 1 -- 172.21.15.17:0/2622571620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe834104e00 msgr2=0x7fe83410c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.790+0000 7fe839bff700 1 --2- 172.21.15.17:0/2622571620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe834104e00 0x7fe83410c9d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe82c009f90 tx=0x7fe82c00b330 comp rx=0 tx=0).stop 2023-07-14T13:17:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.790+0000 7fe839bff700 1 -- 172.21.15.17:0/2622571620 shutdown_connections 2023-07-14T13:17:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.790+0000 7fe839bff700 1 --2- 172.21.15.17:0/2622571620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe834104e00 0x7fe83410c9d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.790+0000 7fe839bff700 1 --2- 172.21.15.17:0/2622571620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8340ffdc0 0x7fe834100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.790+0000 7fe839bff700 1 --2- 172.21.15.17:0/2622571620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe834100760 0x7fe834104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.790+0000 7fe839bff700 1 -- 172.21.15.17:0/2622571620 >> 172.21.15.17:0/2622571620 conn(0x7fe8340fb650 msgr2=0x7fe8340fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.791+0000 7fe839bff700 1 -- 172.21.15.17:0/2622571620 shutdown_connections 2023-07-14T13:17:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.791+0000 7fe839bff700 1 -- 172.21.15.17:0/2622571620 wait complete. 2023-07-14T13:17:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.792+0000 7fe839bff700 1 Processor -- start 2023-07-14T13:17:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.792+0000 7fe839bff700 1 -- start start 2023-07-14T13:17:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.792+0000 7fe839bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8340ffdc0 0x7fe834197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.792+0000 7fe839bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe834100760 0x7fe834198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.792+0000 7fe839bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe834104e00 0x7fe83419ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.792+0000 7fe839bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83419d0d0 con 0x7fe834104e00 2023-07-14T13:17:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.792+0000 7fe839bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83419d240 con 0x7fe834100760 2023-07-14T13:17:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.792+0000 7fe839bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83419d400 con 0x7fe8340ffdc0 2023-07-14T13:17:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.793+0000 7fe8337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8340ffdc0 0x7fe834197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.793+0000 7fe832ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe834100760 0x7fe834198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.793+0000 7fe8337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8340ffdc0 0x7fe834197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47786/0 (socket says 172.21.15.17:47786) 2023-07-14T13:17:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.793+0000 7fe8337fe700 1 -- 172.21.15.17:0/3527959762 learned_addr learned my addr 172.21.15.17:0/3527959762 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.793+0000 7fe833fff700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe834104e00 0x7fe83419ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.793+0000 7fe8337fe700 1 -- 172.21.15.17:0/3527959762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe834100760 msgr2=0x7fe834198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.793+0000 7fe8337fe700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe834100760 0x7fe834198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.793+0000 7fe8337fe700 1 -- 172.21.15.17:0/3527959762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe834104e00 msgr2=0x7fe83419ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.793+0000 7fe8337fe700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe834104e00 0x7fe83419ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.793+0000 7fe8337fe700 1 -- 172.21.15.17:0/3527959762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8240095f0 con 0x7fe8340ffdc0 2023-07-14T13:17:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.794+0000 7fe8337fe700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8340ffdc0 0x7fe834197ee0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe82400ec10 tx=0x7fe82400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.794+0000 7fe830ff9700 1 -- 172.21.15.17:0/3527959762 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82400cc90 con 0x7fe8340ffdc0 2023-07-14T13:17:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.794+0000 7fe830ff9700 1 -- 172.21.15.17:0/3527959762 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe82400cdf0 con 0x7fe8340ffdc0 2023-07-14T13:17:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.794+0000 7fe839bff700 1 -- 172.21.15.17:0/3527959762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c009c40 con 0x7fe8340ffdc0 2023-07-14T13:17:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.794+0000 7fe830ff9700 1 -- 172.21.15.17:0/3527959762 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824003e80 con 0x7fe8340ffdc0 2023-07-14T13:17:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.794+0000 7fe839bff700 1 -- 172.21.15.17:0/3527959762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83419d8d0 con 0x7fe8340ffdc0 2023-07-14T13:17:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.798+0000 7fe830ff9700 1 -- 172.21.15.17:0/3527959762 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe824004000 con 0x7fe8340ffdc0 2023-07-14T13:17:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.799+0000 7fe830ff9700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe81c0a1340 0x7fe81c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.800+0000 7fe830ff9700 1 -- 172.21.15.17:0/3527959762 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe824014070 con 0x7fe8340ffdc0 2023-07-14T13:17:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.800+0000 7fe832ffd700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe81c0a1340 0x7fe81c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.801+0000 7fe832ffd700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe81c0a1340 0x7fe81c0a37f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe834199700 tx=0x7fe828009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.964+0000 7fe84d446b80 1 Processor -- start 2023-07-14T13:17:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.964+0000 7fe84d446b80 1 -- start start 2023-07-14T13:17:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.964+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a5ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.964+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a5f2d0 0x562026a59040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.965+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a599d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.965+0000 7fe84d446b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56202695ec50 con 0x562026a59580 2023-07-14T13:17:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.965+0000 7fe84d446b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620269b19e0 con 0x562026a5f2d0 2023-07-14T13:17:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.965+0000 7fe84d446b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620269aae70 con 0x5620268b56b0 2023-07-14T13:17:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.965+0000 7fe8337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a5ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.965+0000 7fe833fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.965+0000 7fe8337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a5ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47788/0 (socket says 172.21.15.17:47788) 2023-07-14T13:17:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.965+0000 7fe8337fe700 1 -- 172.21.15.17:0/4255482541 learned_addr learned my addr 172.21.15.17:0/4255482541 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.965+0000 7fe832ffd700 1 --2- 172.21.15.17:0/4255482541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a5f2d0 0x562026a59040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.965+0000 7fe8337fe700 1 -- 172.21.15.17:0/4255482541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a5f2d0 msgr2=0x562026a59040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.965+0000 7fe8337fe700 1 --2- 172.21.15.17:0/4255482541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a5f2d0 0x562026a59040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.966+0000 7fe8337fe700 1 -- 172.21.15.17:0/4255482541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 msgr2=0x562026a599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.966+0000 7fe8337fe700 1 --2- 172.21.15.17:0/4255482541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.966+0000 7fe8337fe700 1 -- 172.21.15.17:0/4255482541 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620267d8d80 con 0x5620268b56b0 2023-07-14T13:17:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.966+0000 7fe8337fe700 1 --2- 172.21.15.17:0/4255482541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a5ed90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe824005d70 tx=0x7fe824099e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=331ecda28a225035 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.966+0000 7fe819ffb700 1 -- 172.21.15.17:0/4255482541 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82409a190 con 0x5620268b56b0 2023-07-14T13:17:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.966+0000 7fe819ffb700 1 -- 172.21.15.17:0/4255482541 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8240ade90 con 0x5620268b56b0 2023-07-14T13:17:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.966+0000 7fe819ffb700 1 -- 172.21.15.17:0/4255482541 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240042b0 con 0x5620268b56b0 2023-07-14T13:17:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.967+0000 7fe84d446b80 1 -- 172.21.15.17:0/4255482541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 msgr2=0x562026a5ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.967+0000 7fe84d446b80 1 --2- 172.21.15.17:0/4255482541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a5ed90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe824005d70 tx=0x7fe824099e00 comp rx=0 tx=0).stop 2023-07-14T13:17:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.967+0000 7fe84d446b80 1 -- 172.21.15.17:0/4255482541 shutdown_connections 2023-07-14T13:17:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.967+0000 7fe84d446b80 1 --2- 172.21.15.17:0/4255482541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.967+0000 7fe84d446b80 1 --2- 172.21.15.17:0/4255482541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a5ed90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.967+0000 7fe84d446b80 1 --2- 172.21.15.17:0/4255482541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a5f2d0 0x562026a59040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.967+0000 7fe84d446b80 1 -- 172.21.15.17:0/4255482541 >> 172.21.15.17:0/4255482541 conn(0x562026a4ebe0 msgr2=0x562026a53f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.967+0000 7fe84d446b80 1 -- 172.21.15.17:0/4255482541 shutdown_connections 2023-07-14T13:17:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.967+0000 7fe84d446b80 1 -- 172.21.15.17:0/4255482541 wait complete. 2023-07-14T13:17:40.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.968+0000 7fe84d446b80 1 -- start start 2023-07-14T13:17:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.968+0000 7fe84d446b80 1 Processor -- start 2023-07-14T13:17:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620268b56b0 0x562026a65570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562026a5f2d0 0x562026a62e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe84d446b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56202694aa60 con 0x562026a59580 2023-07-14T13:17:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe84d446b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56202694a760 con 0x5620268b56b0 2023-07-14T13:17:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe84d446b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56202682e8c0 con 0x562026a5f2d0 2023-07-14T13:17:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe84d446b80 10 client.0 _ll_register_callbacks cb 0x562026948700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe832ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe8337fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620268b56b0 0x562026a65570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe8337fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620268b56b0 0x562026a65570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:38924/0 (socket says 172.21.15.17:38924) 2023-07-14T13:17:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe8337fe700 1 -- 172.21.15.17:0/3098391813 learned_addr learned my addr 172.21.15.17:0/3098391813 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.969+0000 7fe833fff700 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562026a5f2d0 0x562026a62e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.970+0000 7fe8337fe700 1 -- 172.21.15.17:0/3098391813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562026a5f2d0 msgr2=0x562026a62e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.970+0000 7fe8337fe700 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562026a5f2d0 0x562026a62e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.970+0000 7fe8337fe700 1 -- 172.21.15.17:0/3098391813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 msgr2=0x562026a627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.970+0000 7fe8337fe700 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a627f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.970+0000 7fe8337fe700 1 -- 172.21.15.17:0/3098391813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83419d8d0 con 0x5620268b56b0 2023-07-14T13:17:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.970+0000 7fe8337fe700 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620268b56b0 0x562026a65570 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe824099e90 tx=0x7fe824098740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50c072f9d27883b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.970+0000 7fe812ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:17:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.970+0000 7fe812ffd700 1 -- 172.21.15.17:0/3098391813 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240044c0 con 0x5620268b56b0 2023-07-14T13:17:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.970+0000 7fe812ffd700 1 -- 172.21.15.17:0/3098391813 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe8240a25e0 con 0x5620268b56b0 2023-07-14T13:17:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.970+0000 7fe84d446b80 1 -- 172.21.15.17:0/3098391813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562026904490 con 0x5620268b56b0 2023-07-14T13:17:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.971+0000 7fe812ffd700 1 -- 172.21.15.17:0/3098391813 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe82409a190 con 0x5620268b56b0 2023-07-14T13:17:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.971+0000 7fe84d446b80 10 client.28256 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.971+0000 7fe84d446b80 1 -- 172.21.15.17:0/3098391813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5620267c1c00 con 0x5620268b56b0 2023-07-14T13:17:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.971+0000 7fe812ffd700 1 -- 172.21.15.17:0/3098391813 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562026904490 con 0x5620268b56b0 2023-07-14T13:17:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.971+0000 7fe812ffd700 1 -- 172.21.15.17:0/3098391813 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe8240a2150 con 0x5620268b56b0 2023-07-14T13:17:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.971+0000 7fe84d446b80 10 client.28256 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.971+0000 7fe84d446b80 10 client.28256 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.971+0000 7fe84d446b80 20 client.28256 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.971+0000 7fe84d446b80 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562026a72810 0x562026a74c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.971+0000 7fe84d446b80 4 client.28256 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:17:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.971+0000 7fe84d446b80 1 -- 172.21.15.17:0/3098391813 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620269a3e50 con 0x562026a72810 2023-07-14T13:17:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.972+0000 7fe832ffd700 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562026a72810 0x562026a74c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.973+0000 7fe832ffd700 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562026a72810 0x562026a74c20 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e51bd07f75c0ca7 server_cookie=d5ad89e111bb69b5 in_seq=0 out_seq=0 2023-07-14T13:17:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.973+0000 7fe812ffd700 10 client.28256 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.973+0000 7fe812ffd700 1 -- 172.21.15.17:0/3098391813 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5620269a3e50 con 0x562026a72810 2023-07-14T13:17:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.973+0000 7fe812ffd700 10 client.28256 handle_command_reply: tid=0 2023-07-14T13:17:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.973+0000 7fe84d446b80 1 client.28256 shutdown 2023-07-14T13:17:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe84d446b80 1 -- 172.21.15.17:0/3098391813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620268b56b0 msgr2=0x562026a65570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe84d446b80 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620268b56b0 0x562026a65570 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe824099e90 tx=0x7fe824098740 comp rx=0 tx=0).stop 2023-07-14T13:17:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe84d446b80 1 -- 172.21.15.17:0/3098391813 shutdown_connections 2023-07-14T13:17:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe84d446b80 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562026a72810 0x562026a74c20 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe84d446b80 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562026a5f2d0 0x562026a62e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe84d446b80 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620268b56b0 0x562026a65570 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe84d446b80 1 --2- 172.21.15.17:0/3098391813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a627f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe812ffd700 0 client.28256 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe84d446b80 1 -- 172.21.15.17:0/3098391813 >> 172.21.15.17:0/3098391813 conn(0x562026a4ebe0 msgr2=0x562026a534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe84d446b80 1 -- 172.21.15.17:0/3098391813 shutdown_connections 2023-07-14T13:17:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe84d446b80 1 -- 172.21.15.17:0/3098391813 wait complete. 2023-07-14T13:17:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.974+0000 7fe84d446b80 20 client.28256 trim_cache size 0 max 16384 2023-07-14T13:17:40.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.997+0000 7fe84d446b80 1 Processor -- start 2023-07-14T13:17:40.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.998+0000 7fe84d446b80 1 -- start start 2023-07-14T13:17:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.998+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a60010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.998+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a59580 0x562026a65110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.998+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a5f2d0 0x562026a53c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.998+0000 7fe84d446b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562026904490 con 0x562026a5f2d0 2023-07-14T13:17:40.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.998+0000 7fe84d446b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562026a1f060 con 0x562026a59580 2023-07-14T13:17:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.998+0000 7fe84d446b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562026a63450 con 0x5620268b56b0 2023-07-14T13:17:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe833fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a5f2d0 0x562026a53c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe832ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a59580 0x562026a65110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe833fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a5f2d0 0x562026a53c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35108/0 (socket says 172.21.15.17:35108) 2023-07-14T13:17:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe832ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a59580 0x562026a65110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:38930/0 (socket says 172.21.15.17:38930) 2023-07-14T13:17:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe833fff700 1 -- 172.21.15.17:0/3992345809 learned_addr learned my addr 172.21.15.17:0/3992345809 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:40.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe8337fe700 1 --2- 172.21.15.17:0/3992345809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a60010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe833fff700 1 -- 172.21.15.17:0/3992345809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 msgr2=0x562026a60010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe833fff700 1 --2- 172.21.15.17:0/3992345809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a60010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe833fff700 1 -- 172.21.15.17:0/3992345809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a59580 msgr2=0x562026a65110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe833fff700 1 --2- 172.21.15.17:0/3992345809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a59580 0x562026a65110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe833fff700 1 -- 172.21.15.17:0/3992345809 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620267ff1f0 con 0x562026a5f2d0 2023-07-14T13:17:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:39.999+0000 7fe833fff700 1 --2- 172.21.15.17:0/3992345809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a5f2d0 0x562026a53c60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe82c007530 tx=0x7fe82c007560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d0a4221e4d7fdd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.000+0000 7fe81a7fc700 1 -- 172.21.15.17:0/3992345809 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00e040 con 0x562026a5f2d0 2023-07-14T13:17:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.000+0000 7fe81a7fc700 1 -- 172.21.15.17:0/3992345809 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe82c0093c0 con 0x562026a5f2d0 2023-07-14T13:17:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.000+0000 7fe81a7fc700 1 -- 172.21.15.17:0/3992345809 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00bdb0 con 0x562026a5f2d0 2023-07-14T13:17:40.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.001+0000 7fe84d446b80 1 -- 172.21.15.17:0/3992345809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a5f2d0 msgr2=0x562026a53c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.001+0000 7fe84d446b80 1 --2- 172.21.15.17:0/3992345809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a5f2d0 0x562026a53c60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe82c007530 tx=0x7fe82c007560 comp rx=0 tx=0).stop 2023-07-14T13:17:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.001+0000 7fe84d446b80 1 -- 172.21.15.17:0/3992345809 shutdown_connections 2023-07-14T13:17:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.001+0000 7fe84d446b80 1 --2- 172.21.15.17:0/3992345809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a5f2d0 0x562026a53c60 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.001+0000 7fe84d446b80 1 --2- 172.21.15.17:0/3992345809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a60010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.001+0000 7fe84d446b80 1 --2- 172.21.15.17:0/3992345809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a59580 0x562026a65110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.001+0000 7fe84d446b80 1 -- 172.21.15.17:0/3992345809 >> 172.21.15.17:0/3992345809 conn(0x562026a4ebe0 msgr2=0x562026a5f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.001+0000 7fe84d446b80 1 -- 172.21.15.17:0/3992345809 shutdown_connections 2023-07-14T13:17:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.001+0000 7fe84d446b80 1 -- 172.21.15.17:0/3992345809 wait complete. 2023-07-14T13:17:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.001+0000 7fe84d446b80 1 -- start start 2023-07-14T13:17:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.002+0000 7fe84d446b80 1 Processor -- start 2023-07-14T13:17:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.002+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a69620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.002+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a69b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.002+0000 7fe84d446b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a5f2d0 0x562026a67c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.002+0000 7fe84d446b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562026a682f0 con 0x562026a59580 2023-07-14T13:17:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.002+0000 7fe84d446b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562026a68460 con 0x562026a5f2d0 2023-07-14T13:17:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.002+0000 7fe84d446b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562026a68620 con 0x5620268b56b0 2023-07-14T13:17:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.002+0000 7fe84d446b80 10 client.0 _ll_register_callbacks cb 0x7fe8240091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.002+0000 7fe832ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a69b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe832ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a69b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35118/0 (socket says 172.21.15.17:35118) 2023-07-14T13:17:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe832ffd700 1 -- 172.21.15.17:0/1647941087 learned_addr learned my addr 172.21.15.17:0/1647941087 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe833fff700 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a5f2d0 0x562026a67c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe832ffd700 1 -- 172.21.15.17:0/1647941087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 msgr2=0x562026a69620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe832ffd700 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a69620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe832ffd700 1 -- 172.21.15.17:0/1647941087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a5f2d0 msgr2=0x562026a67c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe832ffd700 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a5f2d0 0x562026a67c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe832ffd700 1 -- 172.21.15.17:0/1647941087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83410d210 con 0x562026a59580 2023-07-14T13:17:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe833fff700 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a5f2d0 0x562026a67c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:17:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe832ffd700 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a69b60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe828009fd0 tx=0x7fe8280047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e4a82f0c2a0843 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe812ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:17:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.003+0000 7fe812ffd700 1 -- 172.21.15.17:0/1647941087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828024040 con 0x562026a59580 2023-07-14T13:17:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe84d446b80 1 -- 172.21.15.17:0/1647941087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe8240ade90 con 0x562026a59580 2023-07-14T13:17:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe812ffd700 1 -- 172.21.15.17:0/1647941087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe8280044a0 con 0x562026a59580 2023-07-14T13:17:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe812ffd700 1 -- 172.21.15.17:0/1647941087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe82802b380 con 0x562026a59580 2023-07-14T13:17:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe84d446b80 10 client.18558 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:40.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe84d446b80 1 -- 172.21.15.17:0/1647941087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5620267d7250 con 0x562026a59580 2023-07-14T13:17:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe812ffd700 1 -- 172.21.15.17:0/1647941087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8240ade90 con 0x562026a59580 2023-07-14T13:17:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe812ffd700 1 -- 172.21.15.17:0/1647941087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe82801f4b0 con 0x562026a59580 2023-07-14T13:17:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe84d446b80 10 client.18558 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe84d446b80 10 client.18558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe84d446b80 20 client.18558 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe84d446b80 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562026ac77b0 0x562026ac9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe84d446b80 4 client.18558 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:17:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.004+0000 7fe84d446b80 1 -- 172.21.15.17:0/1647941087 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562026965ff0 con 0x562026ac77b0 2023-07-14T13:17:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.005+0000 7fe8337fe700 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562026ac77b0 0x562026ac9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.005+0000 7fe812ffd700 10 client.18558 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.005+0000 7fe8337fe700 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562026ac77b0 0x562026ac9bc0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbdad90bea574310 server_cookie=fe90a0cd181b7b29 in_seq=0 out_seq=0 2023-07-14T13:17:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.026+0000 7fe812ffd700 1 -- 172.21.15.17:0/1647941087 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562026965ff0 con 0x562026ac77b0 2023-07-14T13:17:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.026+0000 7fe812ffd700 10 client.18558 handle_command_reply: tid=0 2023-07-14T13:17:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.026+0000 7fe84d446b80 1 client.18558 shutdown 2023-07-14T13:17:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe84d446b80 1 -- 172.21.15.17:0/1647941087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 msgr2=0x562026a69b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe84d446b80 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a69b60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe828009fd0 tx=0x7fe8280047c0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe84d446b80 1 -- 172.21.15.17:0/1647941087 shutdown_connections 2023-07-14T13:17:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe84d446b80 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562026ac77b0 0x562026ac9bc0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe84d446b80 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562026a5f2d0 0x562026a67c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe84d446b80 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620268b56b0 0x562026a69620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe84d446b80 1 --2- 172.21.15.17:0/1647941087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562026a59580 0x562026a69b60 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe84d446b80 1 -- 172.21.15.17:0/1647941087 >> 172.21.15.17:0/1647941087 conn(0x562026a4ebe0 msgr2=0x562026a60190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:40.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe812ffd700 0 client.18558 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:40.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe84d446b80 1 -- 172.21.15.17:0/1647941087 shutdown_connections 2023-07-14T13:17:40.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe84d446b80 1 -- 172.21.15.17:0/1647941087 wait complete. 2023-07-14T13:17:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.027+0000 7fe84d446b80 20 client.18558 trim_cache size 0 max 16384 2023-07-14T13:17:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:17:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:17:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:17:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:17:40.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 -- 172.21.15.17:0/3527959762 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe81c0a1340 msgr2=0x7fe81c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe81c0a1340 0x7fe81c0a37f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe834199700 tx=0x7fe828009260 comp rx=0 tx=0).stop 2023-07-14T13:17:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 -- 172.21.15.17:0/3527959762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8340ffdc0 msgr2=0x7fe834197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8340ffdc0 0x7fe834197ee0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe82400ec10 tx=0x7fe82400ef20 comp rx=0 tx=0).stop 2023-07-14T13:17:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 -- 172.21.15.17:0/3527959762 shutdown_connections 2023-07-14T13:17:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe81c0a1340 0x7fe81c0a37f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe834104e00 0x7fe83419ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8340ffdc0 0x7fe834197ee0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 --2- 172.21.15.17:0/3527959762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe834100760 0x7fe834198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 -- 172.21.15.17:0/3527959762 >> 172.21.15.17:0/3527959762 conn(0x7fe8340fb650 msgr2=0x7fe8340fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 -- 172.21.15.17:0/3527959762 shutdown_connections 2023-07-14T13:17:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:40.028+0000 7fe839bff700 1 -- 172.21.15.17:0/3527959762 wait complete. 2023-07-14T13:17:41.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:41 smithi131 ceph-mon[96953]: pgmap v565: 97 pgs: 97 active+clean; 16 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 32 MiB/s wr, 158 op/s 2023-07-14T13:17:41.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:41 smithi017 ceph-mon[95536]: pgmap v565: 97 pgs: 97 active+clean; 16 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 32 MiB/s wr, 158 op/s 2023-07-14T13:17:41.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:41 smithi135 ceph-mon[97338]: pgmap v565: 97 pgs: 97 active+clean; 16 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 32 MiB/s wr, 158 op/s 2023-07-14T13:17:43.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:43 smithi131 ceph-mon[96953]: pgmap v566: 97 pgs: 97 active+clean; 16 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 22 MiB/s wr, 87 op/s 2023-07-14T13:17:43.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:43 smithi017 ceph-mon[95536]: pgmap v566: 97 pgs: 97 active+clean; 16 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 22 MiB/s wr, 87 op/s 2023-07-14T13:17:43.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:43 smithi135 ceph-mon[97338]: pgmap v566: 97 pgs: 97 active+clean; 16 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 22 MiB/s wr, 87 op/s 2023-07-14T13:17:45.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:45 smithi131 ceph-mon[96953]: pgmap v567: 97 pgs: 97 active+clean; 16 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 22 MiB/s wr, 87 op/s 2023-07-14T13:17:45.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:45 smithi017 ceph-mon[95536]: pgmap v567: 97 pgs: 97 active+clean; 16 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 22 MiB/s wr, 87 op/s 2023-07-14T13:17:45.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:45 smithi135 ceph-mon[97338]: pgmap v567: 97 pgs: 97 active+clean; 16 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 22 MiB/s wr, 87 op/s 2023-07-14T13:17:46.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:17:46.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.358+0000 7f9dc77ff700 1 -- 172.21.15.17:0/1384229618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dc0073160 msgr2=0x7f9dc010be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.358+0000 7f9dc77ff700 1 --2- 172.21.15.17:0/1384229618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dc0073160 0x7f9dc010be40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009990 tx=0x7f9db0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.359+0000 7f9dc77ff700 1 -- 172.21.15.17:0/1384229618 shutdown_connections 2023-07-14T13:17:46.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.359+0000 7f9dc77ff700 1 --2- 172.21.15.17:0/1384229618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dc010c380 0x7f9dc010e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.359+0000 7f9dc77ff700 1 --2- 172.21.15.17:0/1384229618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc0072850 0x7f9dc0072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.359+0000 7f9dc77ff700 1 --2- 172.21.15.17:0/1384229618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dc0073160 0x7f9dc010be40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.359+0000 7f9dc77ff700 1 -- 172.21.15.17:0/1384229618 >> 172.21.15.17:0/1384229618 conn(0x7f9dc00fb5e0 msgr2=0x7f9dc00fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:46.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.359+0000 7f9dc77ff700 1 -- 172.21.15.17:0/1384229618 shutdown_connections 2023-07-14T13:17:46.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.359+0000 7f9dc77ff700 1 -- 172.21.15.17:0/1384229618 wait complete. 2023-07-14T13:17:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.360+0000 7f9dc77ff700 1 Processor -- start 2023-07-14T13:17:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.360+0000 7f9dc77ff700 1 -- start start 2023-07-14T13:17:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc77ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dc0072850 0x7f9dc0197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc77ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc0073160 0x7f9dc0198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc77ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dc010c380 0x7f9dc019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc77ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc019cd30 con 0x7f9dc0073160 2023-07-14T13:17:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc77ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc019cea0 con 0x7f9dc0072850 2023-07-14T13:17:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc77ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc019d060 con 0x7f9dc010c380 2023-07-14T13:17:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc4d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc0073160 0x7f9dc0198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dc0072850 0x7f9dc0197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dc0072850 0x7f9dc0197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34406/0 (socket says 172.21.15.17:34406) 2023-07-14T13:17:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc4d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc0073160 0x7f9dc0198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49134/0 (socket says 172.21.15.17:49134) 2023-07-14T13:17:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc559b700 1 -- 172.21.15.17:0/454322742 learned_addr learned my addr 172.21.15.17:0/454322742 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc5d9c700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dc010c380 0x7f9dc019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc559b700 1 -- 172.21.15.17:0/454322742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dc010c380 msgr2=0x7f9dc019c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc559b700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dc010c380 0x7f9dc019c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc559b700 1 -- 172.21.15.17:0/454322742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc0073160 msgr2=0x7f9dc0198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc559b700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc0073160 0x7f9dc0198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.361+0000 7f9dc559b700 1 -- 172.21.15.17:0/454322742 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db00095f0 con 0x7f9dc0072850 2023-07-14T13:17:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.362+0000 7f9dc559b700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dc0072850 0x7f9dc0197d50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00e9a0 tx=0x7f9dbc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.362+0000 7f9db67fc700 1 -- 172.21.15.17:0/454322742 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc009790 con 0x7f9dc0072850 2023-07-14T13:17:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.362+0000 7f9db67fc700 1 -- 172.21.15.17:0/454322742 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9dbc010430 con 0x7f9dc0072850 2023-07-14T13:17:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.362+0000 7f9db67fc700 1 -- 172.21.15.17:0/454322742 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00cea0 con 0x7f9dc0072850 2023-07-14T13:17:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.362+0000 7f9dc77ff700 1 -- 172.21.15.17:0/454322742 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc019d340 con 0x7f9dc0072850 2023-07-14T13:17:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.362+0000 7f9dc77ff700 1 -- 172.21.15.17:0/454322742 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc01a4b80 con 0x7f9dc0072850 2023-07-14T13:17:46.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.366+0000 7f9db67fc700 1 -- 172.21.15.17:0/454322742 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9dbc0105a0 con 0x7f9dc0072850 2023-07-14T13:17:46.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.367+0000 7f9db67fc700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9dac0a1340 0x7f9dac0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.367+0000 7f9db67fc700 1 -- 172.21.15.17:0/454322742 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9dbc014070 con 0x7f9dc0072850 2023-07-14T13:17:46.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.367+0000 7f9ddb186b80 1 Processor -- start 2023-07-14T13:17:46.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.368+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9dac0a1340 0x7f9dac0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.368+0000 7f9ddb186b80 1 -- start start 2023-07-14T13:17:46.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.368+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc0782d0 0x555cbc0786a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.368+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc083590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.368+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc083ad0 0x555cbc085eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.368+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbbf7ecb0 con 0x555cbc083ad0 2023-07-14T13:17:46.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.368+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbbfd1a40 con 0x555cbc0782d0 2023-07-14T13:17:46.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.368+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbbfcaed0 con 0x555cbc078be0 2023-07-14T13:17:46.410 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.368+0000 7f9dc559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc0782d0 0x555cbc0786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.368+0000 7f9dc559b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc0782d0 0x555cbc0786a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34418/0 (socket says 172.21.15.17:34418) 2023-07-14T13:17:46.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.368+0000 7f9dc559b700 1 -- 172.21.15.17:0/3524470554 learned_addr learned my addr 172.21.15.17:0/3524470554 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:46.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.369+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9dac0a1340 0x7f9dac0a37f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9db0006010 tx=0x7f9db00058e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:46.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.369+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/3524470554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc083590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.369+0000 7f9dc5d9c700 1 --2- 172.21.15.17:0/3524470554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc083ad0 0x555cbc085eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.369+0000 7f9dc559b700 1 -- 172.21.15.17:0/3524470554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 msgr2=0x555cbc083590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:46.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.369+0000 7f9dc559b700 1 --2- 172.21.15.17:0/3524470554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc083590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.369+0000 7f9dc559b700 1 -- 172.21.15.17:0/3524470554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc083ad0 msgr2=0x555cbc085eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:46.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.369+0000 7f9dc559b700 1 --2- 172.21.15.17:0/3524470554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc083ad0 0x555cbc085eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.369+0000 7f9dc559b700 1 -- 172.21.15.17:0/3524470554 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cbbdf8de0 con 0x555cbc0782d0 2023-07-14T13:17:46.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.369+0000 7f9dc5d9c700 1 --2- 172.21.15.17:0/3524470554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc083ad0 0x555cbc085eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:17:46.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.369+0000 7f9dc559b700 1 --2- 172.21.15.17:0/3524470554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc0782d0 0x555cbc0786a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0969f0 tx=0x7f9dbc099bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc531c6e77969866 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:46.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.369+0000 7f9dab7fe700 1 -- 172.21.15.17:0/3524470554 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0a23d0 con 0x555cbc0782d0 2023-07-14T13:17:46.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.370+0000 7f9dab7fe700 1 -- 172.21.15.17:0/3524470554 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9dbc09a1e0 con 0x555cbc0782d0 2023-07-14T13:17:46.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.370+0000 7f9dab7fe700 1 -- 172.21.15.17:0/3524470554 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0a1f40 con 0x555cbc0782d0 2023-07-14T13:17:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.370+0000 7f9ddb186b80 1 -- 172.21.15.17:0/3524470554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc0782d0 msgr2=0x555cbc0786a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.370+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/3524470554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc0782d0 0x555cbc0786a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0969f0 tx=0x7f9dbc099bd0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.370+0000 7f9ddb186b80 1 -- 172.21.15.17:0/3524470554 shutdown_connections 2023-07-14T13:17:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.370+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/3524470554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc083ad0 0x555cbc085eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.370+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/3524470554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc0782d0 0x555cbc0786a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.370+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/3524470554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc083590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.370+0000 7f9ddb186b80 1 -- 172.21.15.17:0/3524470554 >> 172.21.15.17:0/3524470554 conn(0x555cbc06eda0 msgr2=0x555cbc0746a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:46.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.371+0000 7f9ddb186b80 1 -- 172.21.15.17:0/3524470554 shutdown_connections 2023-07-14T13:17:46.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.371+0000 7f9ddb186b80 1 -- 172.21.15.17:0/3524470554 wait complete. 2023-07-14T13:17:46.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.371+0000 7f9ddb186b80 1 -- start start 2023-07-14T13:17:46.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.371+0000 7f9ddb186b80 1 Processor -- start 2023-07-14T13:17:46.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.372+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.372+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc080800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.372+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 0x555cbc080f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.372+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbbf6aac0 con 0x555cbc0782d0 2023-07-14T13:17:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.372+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbbf6a7c0 con 0x555cbc083ad0 2023-07-14T13:17:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.372+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbbe4e920 con 0x555cbc078be0 2023-07-14T13:17:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.372+0000 7f9ddb186b80 10 client.0 _ll_register_callbacks cb 0x555cbbf68760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.372+0000 7f9dc559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.372+0000 7f9dc559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49150/0 (socket says 172.21.15.17:49150) 2023-07-14T13:17:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.372+0000 7f9dc559b700 1 -- 172.21.15.17:0/451870741 learned_addr learned my addr 172.21.15.17:0/451870741 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.372+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc080800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9dc5d9c700 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 0x555cbc080f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9dc559b700 1 -- 172.21.15.17:0/451870741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 msgr2=0x555cbc080800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9dc559b700 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc080800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9dc559b700 1 -- 172.21.15.17:0/451870741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 msgr2=0x555cbc080f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:46.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9dc559b700 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 0x555cbc080f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9dc559b700 1 -- 172.21.15.17:0/451870741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc01a4b80 con 0x555cbc0782d0 2023-07-14T13:17:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9dc5d9c700 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 0x555cbc080f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:17:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9dc559b700 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083580 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00e970 tx=0x7f9dbc010ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7920b4033f939801 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9da8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:17:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9da8ff9700 1 -- 172.21.15.17:0/451870741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0a23d0 con 0x555cbc0782d0 2023-07-14T13:17:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9ddb186b80 1 -- 172.21.15.17:0/451870741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555cbbf244f0 con 0x555cbc0782d0 2023-07-14T13:17:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.373+0000 7f9da8ff9700 1 -- 172.21.15.17:0/451870741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9dbc098320 con 0x555cbc0782d0 2023-07-14T13:17:46.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.374+0000 7f9da8ff9700 1 -- 172.21.15.17:0/451870741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dbc0a2150 con 0x555cbc0782d0 2023-07-14T13:17:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.374+0000 7f9ddb186b80 10 client.18570 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.374+0000 7f9ddb186b80 1 -- 172.21.15.17:0/451870741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x555cbbde1c60 con 0x555cbc0782d0 2023-07-14T13:17:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.374+0000 7f9da8ff9700 1 -- 172.21.15.17:0/451870741 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555cbbf244f0 con 0x555cbc0782d0 2023-07-14T13:17:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.374+0000 7f9da8ff9700 1 -- 172.21.15.17:0/451870741 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9dbc095d70 con 0x555cbc0782d0 2023-07-14T13:17:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.374+0000 7f9ddb186b80 10 client.18570 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.374+0000 7f9ddb186b80 10 client.18570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:46.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.374+0000 7f9ddb186b80 20 client.18570 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.374+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555cbc0930c0 0x555cbc0954a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.374+0000 7f9ddb186b80 4 client.18570 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:17:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.374+0000 7f9ddb186b80 1 -- 172.21.15.17:0/451870741 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555cbbfc3eb0 con 0x555cbc0930c0 2023-07-14T13:17:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.375+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555cbc0930c0 0x555cbc0954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.375+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555cbc0930c0 0x555cbc0954a0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfc7028be5d7c616 server_cookie=cbd4d9fbd716586a in_seq=0 out_seq=0 2023-07-14T13:17:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.375+0000 7f9da8ff9700 10 client.18570 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.376+0000 7f9da8ff9700 1 -- 172.21.15.17:0/451870741 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555cbbfc3eb0 con 0x555cbc0930c0 2023-07-14T13:17:46.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.376+0000 7f9da8ff9700 10 client.18570 handle_command_reply: tid=0 2023-07-14T13:17:46.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.376+0000 7f9ddb186b80 1 client.18570 shutdown 2023-07-14T13:17:46.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.376+0000 7f9ddb186b80 1 -- 172.21.15.17:0/451870741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 msgr2=0x555cbc083580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.376+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083580 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00e970 tx=0x7f9dbc010ae0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.377+0000 7f9ddb186b80 1 -- 172.21.15.17:0/451870741 shutdown_connections 2023-07-14T13:17:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.377+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555cbc0930c0 0x555cbc0954a0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.377+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 0x555cbc080f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.377+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083580 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.377+0000 7f9da8ff9700 0 client.18570 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.377+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/451870741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc080800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.377+0000 7f9ddb186b80 1 -- 172.21.15.17:0/451870741 >> 172.21.15.17:0/451870741 conn(0x555cbc06eda0 msgr2=0x555cbc074230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:46.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.377+0000 7f9ddb186b80 1 -- 172.21.15.17:0/451870741 shutdown_connections 2023-07-14T13:17:46.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.377+0000 7f9ddb186b80 1 -- 172.21.15.17:0/451870741 wait complete. 2023-07-14T13:17:46.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.377+0000 7f9ddb186b80 20 client.18570 trim_cache size 0 max 16384 2023-07-14T13:17:46.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.398+0000 7f9ddb186b80 1 Processor -- start 2023-07-14T13:17:46.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.398+0000 7f9ddb186b80 1 -- start start 2023-07-14T13:17:46.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.398+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.398+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc07ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 0x555cbc080500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbc079540 con 0x555cbc0782d0 2023-07-14T13:17:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbc081de0 con 0x555cbc083ad0 2023-07-14T13:17:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbc081780 con 0x555cbc078be0 2023-07-14T13:17:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49154/0 (socket says 172.21.15.17:49154) 2023-07-14T13:17:46.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc559b700 1 -- 172.21.15.17:0/714259017 learned_addr learned my addr 172.21.15.17:0/714259017 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/714259017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc07ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc5d9c700 1 --2- 172.21.15.17:0/714259017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 0x555cbc080500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc4d9a700 1 -- 172.21.15.17:0/714259017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 msgr2=0x555cbc080500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/714259017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 0x555cbc080500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc4d9a700 1 -- 172.21.15.17:0/714259017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 msgr2=0x555cbc083120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/714259017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc4d9a700 1 -- 172.21.15.17:0/714259017 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cbbe1f250 con 0x555cbc078be0 2023-07-14T13:17:46.441 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc559b700 1 --2- 172.21.15.17:0/714259017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:46.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.399+0000 7f9dc5d9c700 1 --2- 172.21.15.17:0/714259017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 0x555cbc080500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:46.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.400+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/714259017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc07ffc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9db00098e0 tx=0x7f9db0020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f54e24d3e572ef0a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:46.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.400+0000 7f9dabfff700 1 -- 172.21.15.17:0/714259017 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0034cd0 con 0x555cbc078be0 2023-07-14T13:17:46.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.400+0000 7f9dabfff700 1 -- 172.21.15.17:0/714259017 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9db001e040 con 0x555cbc078be0 2023-07-14T13:17:46.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.400+0000 7f9dabfff700 1 -- 172.21.15.17:0/714259017 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0004900 con 0x555cbc078be0 2023-07-14T13:17:46.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.401+0000 7f9ddb186b80 1 -- 172.21.15.17:0/714259017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 msgr2=0x555cbc07ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.401+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/714259017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc07ffc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9db00098e0 tx=0x7f9db0020000 comp rx=0 tx=0).stop 2023-07-14T13:17:46.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.401+0000 7f9ddb186b80 1 -- 172.21.15.17:0/714259017 shutdown_connections 2023-07-14T13:17:46.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.401+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/714259017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc083ad0 0x555cbc080500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.401+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/714259017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc083120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.401+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/714259017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc078be0 0x555cbc07ffc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.401+0000 7f9ddb186b80 1 -- 172.21.15.17:0/714259017 >> 172.21.15.17:0/714259017 conn(0x555cbc06eda0 msgr2=0x555cbc07bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:46.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.401+0000 7f9ddb186b80 1 -- 172.21.15.17:0/714259017 shutdown_connections 2023-07-14T13:17:46.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.401+0000 7f9ddb186b80 1 -- 172.21.15.17:0/714259017 wait complete. 2023-07-14T13:17:46.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.402+0000 7f9ddb186b80 1 -- start start 2023-07-14T13:17:46.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.402+0000 7f9ddb186b80 1 Processor -- start 2023-07-14T13:17:46.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.402+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc08a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc078be0 0x555cbc088550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9ddb186b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc083ad0 0x555cbc088a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbc088fd0 con 0x555cbc0782d0 2023-07-14T13:17:46.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbc089140 con 0x555cbc078be0 2023-07-14T13:17:46.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9ddb186b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cbc089300 con 0x555cbc083ad0 2023-07-14T13:17:46.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9ddb186b80 10 client.0 _ll_register_callbacks cb 0x7f9db0005040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:46.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9dc559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc08a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9dc559b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc08a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49164/0 (socket says 172.21.15.17:49164) 2023-07-14T13:17:46.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9dc559b700 1 -- 172.21.15.17:0/2870998562 learned_addr learned my addr 172.21.15.17:0/2870998562 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:46.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc078be0 0x555cbc088550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9dc5d9c700 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc083ad0 0x555cbc088a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9dc559b700 1 -- 172.21.15.17:0/2870998562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc083ad0 msgr2=0x555cbc088a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:46.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9dc559b700 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc083ad0 0x555cbc088a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9dc559b700 1 -- 172.21.15.17:0/2870998562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc078be0 msgr2=0x555cbc088550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:46.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9dc559b700 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc078be0 0x555cbc088550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.403+0000 7f9dc559b700 1 -- 172.21.15.17:0/2870998562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555cbbde1c60 con 0x555cbc0782d0 2023-07-14T13:17:46.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.404+0000 7f9dc559b700 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc08a220 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc099f10 tx=0x7f9dbc0963f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23465a7f32a5cd31 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:46.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.404+0000 7f9da8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:17:46.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.404+0000 7f9da8ff9700 1 -- 172.21.15.17:0/2870998562 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0a2150 con 0x555cbc0782d0 2023-07-14T13:17:46.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.404+0000 7f9da8ff9700 1 -- 172.21.15.17:0/2870998562 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9dbc0a23d0 con 0x555cbc0782d0 2023-07-14T13:17:46.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.404+0000 7f9ddb186b80 1 -- 172.21.15.17:0/2870998562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9dbc09a1e0 con 0x555cbc0782d0 2023-07-14T13:17:46.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.404+0000 7f9da8ff9700 1 -- 172.21.15.17:0/2870998562 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dbc098320 con 0x555cbc0782d0 2023-07-14T13:17:46.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.404+0000 7f9ddb186b80 10 client.18576 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:46.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.404+0000 7f9ddb186b80 1 -- 172.21.15.17:0/2870998562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f9db80090b0 con 0x555cbc0782d0 2023-07-14T13:17:46.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.404+0000 7f9da8ff9700 1 -- 172.21.15.17:0/2870998562 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9dbc0bf070 con 0x555cbc0782d0 2023-07-14T13:17:46.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.405+0000 7f9da8ff9700 1 -- 172.21.15.17:0/2870998562 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9dbc098ee0 con 0x555cbc0782d0 2023-07-14T13:17:46.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.405+0000 7f9ddb186b80 10 client.18576 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:46.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.405+0000 7f9ddb186b80 10 client.18576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:46.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.405+0000 7f9ddb186b80 20 client.18576 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:46.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.405+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555cbc0e7eb0 0x555cbc0ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.405+0000 7f9ddb186b80 4 client.18576 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:17:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.405+0000 7f9ddb186b80 1 -- 172.21.15.17:0/2870998562 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555cbbf86050 con 0x555cbc0e7eb0 2023-07-14T13:17:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.405+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555cbc0e7eb0 0x555cbc0ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9dc4d9a700 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555cbc0e7eb0 0x555cbc0ea2c0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3d3beda95e2a62 server_cookie=1aa097e96028c2f6 in_seq=0 out_seq=0 2023-07-14T13:17:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9da8ff9700 10 client.18576 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9da8ff9700 1 -- 172.21.15.17:0/2870998562 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555cbbf86050 con 0x555cbc0e7eb0 2023-07-14T13:17:46.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9da8ff9700 10 client.18576 handle_command_reply: tid=0 2023-07-14T13:17:46.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9ddb186b80 1 client.18576 shutdown 2023-07-14T13:17:46.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9ddb186b80 1 -- 172.21.15.17:0/2870998562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 msgr2=0x555cbc08a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc08a220 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc099f10 tx=0x7f9dbc0963f0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9ddb186b80 1 -- 172.21.15.17:0/2870998562 shutdown_connections 2023-07-14T13:17:46.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555cbc0e7eb0 0x555cbc0ea2c0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555cbc083ad0 0x555cbc088a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555cbc0782d0 0x555cbc08a220 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9da8ff9700 0 client.18576 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:46.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9ddb186b80 1 --2- 172.21.15.17:0/2870998562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555cbc078be0 0x555cbc088550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9ddb186b80 1 -- 172.21.15.17:0/2870998562 >> 172.21.15.17:0/2870998562 conn(0x555cbc06eda0 msgr2=0x555cbc07a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:46.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9ddb186b80 1 -- 172.21.15.17:0/2870998562 shutdown_connections 2023-07-14T13:17:46.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.406+0000 7f9ddb186b80 1 -- 172.21.15.17:0/2870998562 wait complete. 2023-07-14T13:17:46.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9ddb186b80 20 client.18576 trim_cache size 0 max 16384 2023-07-14T13:17:46.455 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:17:46.455 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:17:46.455 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:17:46.455 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:17:46.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9dc77ff700 1 -- 172.21.15.17:0/454322742 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9dac0a1340 msgr2=0x7f9dac0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9dc77ff700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9dac0a1340 0x7f9dac0a37f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9db0006010 tx=0x7f9db00058e0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9dc77ff700 1 -- 172.21.15.17:0/454322742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dc0072850 msgr2=0x7f9dc0197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9dc77ff700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dc0072850 0x7f9dc0197d50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00e9a0 tx=0x7f9dbc00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9dc77ff700 1 -- 172.21.15.17:0/454322742 shutdown_connections 2023-07-14T13:17:46.456 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9dc77ff700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9dac0a1340 0x7f9dac0a37f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9dc77ff700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dc010c380 0x7f9dc019c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9dc77ff700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9dc0072850 0x7f9dc0197d50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9dc77ff700 1 --2- 172.21.15.17:0/454322742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dc0073160 0x7f9dc0198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9dc77ff700 1 -- 172.21.15.17:0/454322742 >> 172.21.15.17:0/454322742 conn(0x7f9dc00fb5e0 msgr2=0x7f9dc010e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:46.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.407+0000 7f9dc77ff700 1 -- 172.21.15.17:0/454322742 shutdown_connections 2023-07-14T13:17:46.457 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.408+0000 7f9dc77ff700 1 -- 172.21.15.17:0/454322742 wait complete. 2023-07-14T13:17:46.470 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:17:46.471 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:17:46.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.655+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/1687826342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2edc1003a0 msgr2=0x7f2edc10c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.655+0000 7f2ee0b9d700 1 --2- 172.21.15.17:0/1687826342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2edc1003a0 0x7f2edc10c830 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400b0a0 tx=0x7f2ed400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.655+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/1687826342 shutdown_connections 2023-07-14T13:17:46.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.655+0000 7f2ee0b9d700 1 --2- 172.21.15.17:0/1687826342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2edc1003a0 0x7f2edc10c830 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.655+0000 7f2ee0b9d700 1 --2- 172.21.15.17:0/1687826342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2edc105a00 0x7f2edc105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.655+0000 7f2ee0b9d700 1 --2- 172.21.15.17:0/1687826342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2edc0ff9f0 0x7f2edc0ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.655+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/1687826342 >> 172.21.15.17:0/1687826342 conn(0x7f2edc0fb510 msgr2=0x7f2edc0fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:46.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.655+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/1687826342 shutdown_connections 2023-07-14T13:17:46.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.655+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/1687826342 wait complete. 2023-07-14T13:17:46.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.656+0000 7f2ee0b9d700 1 Processor -- start 2023-07-14T13:17:46.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.656+0000 7f2ee0b9d700 1 -- start start 2023-07-14T13:17:46.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2ee0b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2edc0ff9f0 0x7f2edc072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2ee0b9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2edc1003a0 0x7f2edc072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2ee0b9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2edc105a00 0x7f2edc1a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2ee0b9d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc073580 con 0x7f2edc105a00 2023-07-14T13:17:46.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2ee0b9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc1a3fa0 con 0x7f2edc1003a0 2023-07-14T13:17:46.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2ee0b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc1a40e0 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2edb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2edc0ff9f0 0x7f2edc072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2edaffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2edc1003a0 0x7f2edc072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2edb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2edc0ff9f0 0x7f2edc072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60600/0 (socket says 172.21.15.17:60600) 2023-07-14T13:17:46.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2edaffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2edc1003a0 0x7f2edc072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34464/0 (socket says 172.21.15.17:34464) 2023-07-14T13:17:46.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2edb7fe700 1 -- 172.21.15.17:0/3432511056 learned_addr learned my addr 172.21.15.17:0/3432511056 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:46.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.657+0000 7f2edbfff700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2edc105a00 0x7f2edc1a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.658+0000 7f2edb7fe700 1 -- 172.21.15.17:0/3432511056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2edc1003a0 msgr2=0x7f2edc072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.658+0000 7f2edb7fe700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2edc1003a0 0x7f2edc072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.658+0000 7f2edb7fe700 1 -- 172.21.15.17:0/3432511056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2edc105a00 msgr2=0x7f2edc1a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:46.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.658+0000 7f2edb7fe700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2edc105a00 0x7f2edc1a3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:46.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.658+0000 7f2edb7fe700 1 -- 172.21.15.17:0/3432511056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed4009d00 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.658+0000 7f2edb7fe700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2edc0ff9f0 0x7f2edc072810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00d980 tx=0x7f2ecc00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:46.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.658+0000 7f2ed8ff9700 1 -- 172.21.15.17:0/3432511056 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc004020 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.658+0000 7f2ed8ff9700 1 -- 172.21.15.17:0/3432511056 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ecc00f690 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.658+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/3432511056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2edc1a4340 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.658+0000 7f2ed8ff9700 1 -- 172.21.15.17:0/3432511056 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0039e0 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.659+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/3432511056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2edc1a4870 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.660+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/3432511056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2edc067220 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.662+0000 7f2ed8ff9700 1 -- 172.21.15.17:0/3432511056 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2ecc00f800 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.664+0000 7f2ed8ff9700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2ec40a1430 0x7f2ec40a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:46.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.664+0000 7f2ed8ff9700 1 -- 172.21.15.17:0/3432511056 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2ecc0cc880 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.664+0000 7f2edaffd700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2ec40a1430 0x7f2ec40a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:46.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.665+0000 7f2edaffd700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2ec40a1430 0x7f2ec40a38e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2edc074000 tx=0x7f2ed0009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:46.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.668+0000 7f2ed8ff9700 1 -- 172.21.15.17:0/3432511056 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2ecc095cb0 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.957+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/3432511056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2edc073d40 con 0x7f2edc0ff9f0 2023-07-14T13:17:46.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.958+0000 7f2ed8ff9700 1 -- 172.21.15.17:0/3432511056 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+10851 (secure 0 0 0) 0x7f2ecc084090 con 0x7f2edc0ff9f0 2023-07-14T13:17:47.000 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:17:47.000 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":47,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:17:17.211515+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:17:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/3432511056 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2ec40a1430 msgr2=0x7f2ec40a38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2ec40a1430 0x7f2ec40a38e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2edc074000 tx=0x7f2ed0009260 comp rx=0 tx=0).stop 2023-07-14T13:17:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/3432511056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2edc0ff9f0 msgr2=0x7f2edc072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2edc0ff9f0 0x7f2edc072810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00d980 tx=0x7f2ecc00dc90 comp rx=0 tx=0).stop 2023-07-14T13:17:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/3432511056 shutdown_connections 2023-07-14T13:17:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2ec40a1430 0x7f2ec40a38e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2edc105a00 0x7f2edc1a3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2edc0ff9f0 0x7f2edc072810 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 --2- 172.21.15.17:0/3432511056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2edc1003a0 0x7f2edc072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/3432511056 >> 172.21.15.17:0/3432511056 conn(0x7f2edc0fb510 msgr2=0x7f2edc103540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/3432511056 shutdown_connections 2023-07-14T13:17:47.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:46.962+0000 7f2ee0b9d700 1 -- 172.21.15.17:0/3432511056 wait complete. 2023-07-14T13:17:47.003 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 47 2023-07-14T13:17:47.021 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:17:47.283 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.243+0000 7fba1619d700 1 -- 172.21.15.17:0/911487741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba10100380 msgr2=0x7fba1010c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.243+0000 7fba1619d700 1 --2- 172.21.15.17:0/911487741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba10100380 0x7fba1010c810 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fba08009f90 tx=0x7fba0800b330 comp rx=0 tx=0).stop 2023-07-14T13:17:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.243+0000 7fba1619d700 1 -- 172.21.15.17:0/911487741 shutdown_connections 2023-07-14T13:17:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.243+0000 7fba1619d700 1 --2- 172.21.15.17:0/911487741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba10100380 0x7fba1010c810 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.243+0000 7fba1619d700 1 --2- 172.21.15.17:0/911487741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba101059e0 0x7fba10105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.243+0000 7fba1619d700 1 --2- 172.21.15.17:0/911487741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba100ff9d0 0x7fba100ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.284 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.243+0000 7fba1619d700 1 -- 172.21.15.17:0/911487741 >> 172.21.15.17:0/911487741 conn(0x7fba100fb4b0 msgr2=0x7fba100fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.243+0000 7fba1619d700 1 -- 172.21.15.17:0/911487741 shutdown_connections 2023-07-14T13:17:47.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.243+0000 7fba1619d700 1 -- 172.21.15.17:0/911487741 wait complete. 2023-07-14T13:17:47.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.244+0000 7fba1619d700 1 Processor -- start 2023-07-14T13:17:47.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.244+0000 7fba1619d700 1 -- start start 2023-07-14T13:17:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.245+0000 7fba1619d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba100ff9d0 0x7fba10072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.245+0000 7fba1619d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba10100380 0x7fba10072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.245+0000 7fba1619d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba101059e0 0x7fba10073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.245+0000 7fba1619d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101a3da0 con 0x7fba101059e0 2023-07-14T13:17:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.245+0000 7fba1619d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101a3f10 con 0x7fba10100380 2023-07-14T13:17:47.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.245+0000 7fba1619d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101a40d0 con 0x7fba100ff9d0 2023-07-14T13:17:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.245+0000 7fba1599c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba101059e0 0x7fba10073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.245+0000 7fba1519b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba100ff9d0 0x7fba10072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.245+0000 7fba1519b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba100ff9d0 0x7fba10072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60606/0 (socket says 172.21.15.17:60606) 2023-07-14T13:17:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.245+0000 7fba1519b700 1 -- 172.21.15.17:0/1940185880 learned_addr learned my addr 172.21.15.17:0/1940185880 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.245+0000 7fba1499a700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba10100380 0x7fba10072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba1519b700 1 -- 172.21.15.17:0/1940185880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba10100380 msgr2=0x7fba10072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba1519b700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba10100380 0x7fba10072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba1519b700 1 -- 172.21.15.17:0/1940185880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba101059e0 msgr2=0x7fba10073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba1519b700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba101059e0 0x7fba10073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba1519b700 1 -- 172.21.15.17:0/1940185880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba08009c40 con 0x7fba100ff9d0 2023-07-14T13:17:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba1599c700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba101059e0 0x7fba10073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba1519b700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba100ff9d0 0x7fba10072810 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00e9f0 tx=0x7fba0c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba067fc700 1 -- 172.21.15.17:0/1940185880 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c004220 con 0x7fba100ff9d0 2023-07-14T13:17:47.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba067fc700 1 -- 172.21.15.17:0/1940185880 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba0c004380 con 0x7fba100ff9d0 2023-07-14T13:17:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba067fc700 1 -- 172.21.15.17:0/1940185880 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c003a80 con 0x7fba100ff9d0 2023-07-14T13:17:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba1619d700 1 -- 172.21.15.17:0/1940185880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba101a43b0 con 0x7fba100ff9d0 2023-07-14T13:17:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.246+0000 7fba1619d700 1 -- 172.21.15.17:0/1940185880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba101a48c0 con 0x7fba100ff9d0 2023-07-14T13:17:47.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.249+0000 7fba067fc700 1 -- 172.21.15.17:0/1940185880 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fba0c003c20 con 0x7fba100ff9d0 2023-07-14T13:17:47.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.251+0000 7fba2ad6ab80 1 Processor -- start 2023-07-14T13:17:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.251+0000 7fba2ad6ab80 1 -- start start 2023-07-14T13:17:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.251+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 0x5571a5ac78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.251+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ad17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.251+0000 7fba067fc700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9fc0a13e0 0x7fb9fc0a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.251+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 0x5571a5ad4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.251+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a59cccb0 con 0x5571a5ad1d30 2023-07-14T13:17:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.251+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a5a1fa40 con 0x5571a5ac74f0 2023-07-14T13:17:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.251+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a5a18ed0 con 0x5571a5ac7e00 2023-07-14T13:17:47.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba067fc700 1 -- 172.21.15.17:0/1940185880 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fba0c014070 con 0x7fba100ff9d0 2023-07-14T13:17:47.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba1599c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 0x5571a5ad4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba1599c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 0x5571a5ad4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49212/0 (socket says 172.21.15.17:49212) 2023-07-14T13:17:47.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba1599c700 1 -- 172.21.15.17:0/3239580176 learned_addr learned my addr 172.21.15.17:0/3239580176 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba1519b700 1 --2- 172.21.15.17:0/3239580176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ad17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba1599c700 1 --2- 172.21.15.17:0/3239580176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 0x5571a5ac78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba1499a700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9fc0a13e0 0x7fb9fc0a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba1519b700 1 -- 172.21.15.17:0/3239580176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 msgr2=0x5571a5ac78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba1519b700 1 --2- 172.21.15.17:0/3239580176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 0x5571a5ac78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba1519b700 1 -- 172.21.15.17:0/3239580176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 msgr2=0x5571a5ad4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba1519b700 1 --2- 172.21.15.17:0/3239580176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 0x5571a5ad4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.252+0000 7fba1519b700 1 -- 172.21.15.17:0/3239580176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571a5846de0 con 0x5571a5ac7e00 2023-07-14T13:17:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.253+0000 7fba1519b700 1 --2- 172.21.15.17:0/3239580176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ad17f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0ca470 tx=0x7fba0c099c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee764d7577d94b34 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.253+0000 7fba1499a700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9fc0a13e0 0x7fb9fc0a3890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fba10073f90 tx=0x7fba00009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.253+0000 7fb9fb7fe700 1 -- 172.21.15.17:0/3239580176 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c099570 con 0x5571a5ac7e00 2023-07-14T13:17:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.253+0000 7fb9fb7fe700 1 -- 172.21.15.17:0/3239580176 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba0c0992e0 con 0x5571a5ac7e00 2023-07-14T13:17:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.253+0000 7fb9fb7fe700 1 -- 172.21.15.17:0/3239580176 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0a2240 con 0x5571a5ac7e00 2023-07-14T13:17:47.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.254+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/3239580176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 msgr2=0x5571a5ad17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.254+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/3239580176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ad17f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0ca470 tx=0x7fba0c099c40 comp rx=0 tx=0).stop 2023-07-14T13:17:47.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.254+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/3239580176 shutdown_connections 2023-07-14T13:17:47.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.254+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/3239580176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 0x5571a5ad4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.254+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/3239580176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 0x5571a5ac78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.254+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/3239580176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ad17f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.254+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/3239580176 >> 172.21.15.17:0/3239580176 conn(0x5571a5abcff0 msgr2=0x5571a5ac2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.254+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/3239580176 shutdown_connections 2023-07-14T13:17:47.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.254+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/3239580176 wait complete. 2023-07-14T13:17:47.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.255+0000 7fba2ad6ab80 1 -- start start 2023-07-14T13:17:47.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.255+0000 7fba2ad6ab80 1 Processor -- start 2023-07-14T13:17:47.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac74f0 0x5571a5ad16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ace9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 0x5571a5acf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a59b8ac0 con 0x5571a5ac74f0 2023-07-14T13:17:47.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a59b87c0 con 0x5571a5ad1d30 2023-07-14T13:17:47.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a589c920 con 0x5571a5ac7e00 2023-07-14T13:17:47.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba2ad6ab80 10 client.0 _ll_register_callbacks cb 0x5571a59b6760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:47.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba1519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac74f0 0x5571a5ad16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba1599c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 0x5571a5acf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba1519b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac74f0 0x5571a5ad16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49216/0 (socket says 172.21.15.17:49216) 2023-07-14T13:17:47.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba1519b700 1 -- 172.21.15.17:0/181780076 learned_addr learned my addr 172.21.15.17:0/181780076 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.256+0000 7fba1499a700 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ace9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.257+0000 7fba1599c700 1 -- 172.21.15.17:0/181780076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 msgr2=0x5571a5ace9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.257+0000 7fba1599c700 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ace9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.257+0000 7fba1599c700 1 -- 172.21.15.17:0/181780076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac74f0 msgr2=0x5571a5ad16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.257+0000 7fba1599c700 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac74f0 0x5571a5ad16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.257+0000 7fba1599c700 1 -- 172.21.15.17:0/181780076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba101a48c0 con 0x5571a5ad1d30 2023-07-14T13:17:47.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.257+0000 7fba1519b700 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac74f0 0x5571a5ad16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:47.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.257+0000 7fba1599c700 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 0x5571a5acf060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fba08009790 tx=0x7fba08003c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c31608352a94d6eb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.257+0000 7fb9f8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:17:47.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.257+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/181780076 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800e040 con 0x5571a5ad1d30 2023-07-14T13:17:47.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.257+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/181780076 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fba0800b6a0 con 0x5571a5ad1d30 2023-07-14T13:17:47.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.257+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/181780076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571a59724f0 con 0x5571a5ad1d30 2023-07-14T13:17:47.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.258+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/181780076 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba0800bbf0 con 0x5571a5ad1d30 2023-07-14T13:17:47.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.258+0000 7fba2ad6ab80 10 client.28295 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:47.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.258+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/181780076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5571a582fc60 con 0x5571a5ad1d30 2023-07-14T13:17:47.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.258+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/181780076 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5571a59724f0 con 0x5571a5ad1d30 2023-07-14T13:17:47.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.258+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/181780076 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fba08019030 con 0x5571a5ad1d30 2023-07-14T13:17:47.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.258+0000 7fba2ad6ab80 10 client.28295 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:47.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.258+0000 7fba2ad6ab80 10 client.28295 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:17:47.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.258+0000 7fba2ad6ab80 20 client.28295 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:47.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.258+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5571a5ae17c0 0x5571a5ae3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.258+0000 7fba2ad6ab80 4 client.28295 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:17:47.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.258+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/181780076 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571a5a11eb0 con 0x5571a5ae17c0 2023-07-14T13:17:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.259+0000 7fba1519b700 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5571a5ae17c0 0x5571a5ae3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.259+0000 7fba1519b700 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5571a5ae17c0 0x5571a5ae3bd0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c37fec2678d54fa7 server_cookie=3124b8b8ff24c62f in_seq=0 out_seq=0 2023-07-14T13:17:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.259+0000 7fb9f8ff9700 10 client.28295 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:17:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.260+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/181780076 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5571a5a11eb0 con 0x5571a5ae17c0 2023-07-14T13:17:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.260+0000 7fb9f8ff9700 10 client.28295 handle_command_reply: tid=0 2023-07-14T13:17:47.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.260+0000 7fba2ad6ab80 1 client.28295 shutdown 2023-07-14T13:17:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.260+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/181780076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 msgr2=0x5571a5acf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.260+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 0x5571a5acf060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fba08009790 tx=0x7fba08003c30 comp rx=0 tx=0).stop 2023-07-14T13:17:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.261+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/181780076 shutdown_connections 2023-07-14T13:17:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.261+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 0x5571a5acf060 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.261+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac74f0 0x5571a5ad16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.261+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5571a5ae17c0 0x5571a5ae3bd0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.261+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/181780076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ace9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.261+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/181780076 >> 172.21.15.17:0/181780076 conn(0x5571a5abcff0 msgr2=0x5571a5ac2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.261+0000 7fb9f8ff9700 0 client.28295 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:17:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.261+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/181780076 shutdown_connections 2023-07-14T13:17:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.261+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/181780076 wait complete. 2023-07-14T13:17:47.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.261+0000 7fba2ad6ab80 20 client.28295 trim_cache size 0 max 16384 2023-07-14T13:17:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.277+0000 7fba2ad6ab80 1 Processor -- start 2023-07-14T13:17:47.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.278+0000 7fba2ad6ab80 1 -- start start 2023-07-14T13:17:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.278+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 0x5571a5ad8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.278+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ae37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.278+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 0x5571a5ac2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.278+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a5ac8980 con 0x5571a5ad1d30 2023-07-14T13:17:47.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.278+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a5acff50 con 0x5571a5ac74f0 2023-07-14T13:17:47.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.278+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a5add6c0 con 0x5571a5ac7e00 2023-07-14T13:17:47.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.278+0000 7fba1599c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 0x5571a5ac2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.278+0000 7fba1519b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 0x5571a5ad8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.278+0000 7fba1519b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 0x5571a5ad8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34514/0 (socket says 172.21.15.17:34514) 2023-07-14T13:17:47.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.278+0000 7fba1519b700 1 -- 172.21.15.17:0/2826395835 learned_addr learned my addr 172.21.15.17:0/2826395835 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.279+0000 7fba1499a700 1 --2- 172.21.15.17:0/2826395835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ae37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.279+0000 7fba1519b700 1 -- 172.21.15.17:0/2826395835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 msgr2=0x5571a5ae37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.279+0000 7fba1519b700 1 --2- 172.21.15.17:0/2826395835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ae37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.279+0000 7fba1519b700 1 -- 172.21.15.17:0/2826395835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 msgr2=0x5571a5ac2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.279+0000 7fba1519b700 1 --2- 172.21.15.17:0/2826395835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 0x5571a5ac2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.279+0000 7fba1519b700 1 -- 172.21.15.17:0/2826395835 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571a586d250 con 0x5571a5ac74f0 2023-07-14T13:17:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.279+0000 7fba1599c700 1 --2- 172.21.15.17:0/2826395835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 0x5571a5ac2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.279+0000 7fba1519b700 1 --2- 172.21.15.17:0/2826395835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 0x5571a5ad8810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fba0c099d80 tx=0x7fba0c009530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0e100c72472c0bc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.279+0000 7fb9fbfff700 1 -- 172.21.15.17:0/2826395835 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c016330 con 0x5571a5ac74f0 2023-07-14T13:17:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.280+0000 7fb9fbfff700 1 -- 172.21.15.17:0/2826395835 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba0c0044f0 con 0x5571a5ac74f0 2023-07-14T13:17:47.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.280+0000 7fb9fbfff700 1 -- 172.21.15.17:0/2826395835 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c099df0 con 0x5571a5ac74f0 2023-07-14T13:17:47.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.280+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/2826395835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 msgr2=0x5571a5ad8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.280+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/2826395835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 0x5571a5ad8810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fba0c099d80 tx=0x7fba0c009530 comp rx=0 tx=0).stop 2023-07-14T13:17:47.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.280+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/2826395835 shutdown_connections 2023-07-14T13:17:47.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.280+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/2826395835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ad1d30 0x5571a5ac2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.280+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/2826395835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ac74f0 0x5571a5ad8810 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.280+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/2826395835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac7e00 0x5571a5ae37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.280+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/2826395835 >> 172.21.15.17:0/2826395835 conn(0x5571a5abcff0 msgr2=0x5571a5adcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.280+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/2826395835 shutdown_connections 2023-07-14T13:17:47.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.280+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/2826395835 wait complete. 2023-07-14T13:17:47.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.281+0000 7fba2ad6ab80 1 -- start start 2023-07-14T13:17:47.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.281+0000 7fba2ad6ab80 1 Processor -- start 2023-07-14T13:17:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac74f0 0x5571a5b2e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac7e00 0x5571a5b2e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba2ad6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 0x5571a5ad7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a5ad83b0 con 0x5571a5ac7e00 2023-07-14T13:17:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a5ad8520 con 0x5571a5ad1d30 2023-07-14T13:17:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba2ad6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571a5ad86e0 con 0x5571a5ac74f0 2023-07-14T13:17:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba2ad6ab80 10 client.0 _ll_register_callbacks cb 0x7fba08008d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba1499a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac7e00 0x5571a5b2e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba1499a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac7e00 0x5571a5b2e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49240/0 (socket says 172.21.15.17:49240) 2023-07-14T13:17:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba1499a700 1 -- 172.21.15.17:0/1001135016 learned_addr learned my addr 172.21.15.17:0/1001135016 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba1599c700 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 0x5571a5ad7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.282+0000 7fba1519b700 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac74f0 0x5571a5b2e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.283+0000 7fba1599c700 1 -- 172.21.15.17:0/1001135016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac74f0 msgr2=0x5571a5b2e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.283+0000 7fba1599c700 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac74f0 0x5571a5b2e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.283+0000 7fba1599c700 1 -- 172.21.15.17:0/1001135016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac7e00 msgr2=0x5571a5b2e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.283+0000 7fba1599c700 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac7e00 0x5571a5b2e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.283+0000 7fba1599c700 1 -- 172.21.15.17:0/1001135016 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571a582fc60 con 0x5571a5ad1d30 2023-07-14T13:17:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.283+0000 7fba1519b700 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac74f0 0x5571a5b2e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:17:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.283+0000 7fba1599c700 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 0x5571a5ad7dd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fba08009c10 tx=0x7fba08020b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fceaccef42c431d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.283+0000 7fb9f8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:17:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.283+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/1001135016 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800e040 con 0x5571a5ad1d30 2023-07-14T13:17:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.283+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/1001135016 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba0c0992e0 con 0x5571a5ad1d30 2023-07-14T13:17:47.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.283+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/1001135016 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fba0800b6a0 con 0x5571a5ad1d30 2023-07-14T13:17:47.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.284+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/1001135016 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba080093e0 con 0x5571a5ad1d30 2023-07-14T13:17:47.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.284+0000 7fba2ad6ab80 10 client.28301 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:47.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.284+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/1001135016 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5571a5846de0 con 0x5571a5ad1d30 2023-07-14T13:17:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.284+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/1001135016 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba0c0992e0 con 0x5571a5ad1d30 2023-07-14T13:17:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.284+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/1001135016 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fba0800b3a0 con 0x5571a5ad1d30 2023-07-14T13:17:47.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.284+0000 7fba2ad6ab80 10 client.28301 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.284+0000 7fba2ad6ab80 10 client.28301 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:17:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.284+0000 7fba2ad6ab80 20 client.28301 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.284+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5571a5b35c30 0x5571a5b38040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.284+0000 7fba2ad6ab80 4 client.28301 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:17:47.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.284+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/1001135016 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5571a59d4050 con 0x5571a5b35c30 2023-07-14T13:17:47.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.285+0000 7fba1519b700 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5571a5b35c30 0x5571a5b38040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.285+0000 7fba1519b700 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5571a5b35c30 0x5571a5b38040 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5eeab94b8cd9fe1 server_cookie=c6559d0c241fe566 in_seq=0 out_seq=0 2023-07-14T13:17:47.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.285+0000 7fb9f8ff9700 10 client.28301 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:17:47.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fb9f8ff9700 1 -- 172.21.15.17:0/1001135016 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5571a59d4050 con 0x5571a5b35c30 2023-07-14T13:17:47.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fb9f8ff9700 10 client.28301 handle_command_reply: tid=0 2023-07-14T13:17:47.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 1 client.28301 shutdown 2023-07-14T13:17:47.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/1001135016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 msgr2=0x5571a5ad7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 0x5571a5ad7dd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fba08009c10 tx=0x7fba08020b30 comp rx=0 tx=0).stop 2023-07-14T13:17:47.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/1001135016 shutdown_connections 2023-07-14T13:17:47.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571a5ad1d30 0x5571a5ad7dd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5571a5b35c30 0x5571a5b38040 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a5ac74f0 0x5571a5b2e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 1 --2- 172.21.15.17:0/1001135016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5571a5ac7e00 0x5571a5b2e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fb9f8ff9700 0 client.28301 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:17:47.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/1001135016 >> 172.21.15.17:0/1001135016 conn(0x5571a5abcff0 msgr2=0x5571a5add9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/1001135016 shutdown_connections 2023-07-14T13:17:47.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 1 -- 172.21.15.17:0/1001135016 wait complete. 2023-07-14T13:17:47.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.286+0000 7fba2ad6ab80 20 client.28301 trim_cache size 0 max 16384 2023-07-14T13:17:47.337 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:17:47.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 -- 172.21.15.17:0/1940185880 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9fc0a13e0 msgr2=0x7fb9fc0a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9fc0a13e0 0x7fb9fc0a3890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fba10073f90 tx=0x7fba00009260 comp rx=0 tx=0).stop 2023-07-14T13:17:47.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 -- 172.21.15.17:0/1940185880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba100ff9d0 msgr2=0x7fba10072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba100ff9d0 0x7fba10072810 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00e9f0 tx=0x7fba0c00ed00 comp rx=0 tx=0).stop 2023-07-14T13:17:47.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 -- 172.21.15.17:0/1940185880 shutdown_connections 2023-07-14T13:17:47.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb9fc0a13e0 0x7fb9fc0a3890 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba101059e0 0x7fba10073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba100ff9d0 0x7fba10072810 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 --2- 172.21.15.17:0/1940185880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba10100380 0x7fba10072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 -- 172.21.15.17:0/1940185880 >> 172.21.15.17:0/1940185880 conn(0x7fba100fb4b0 msgr2=0x7fba100fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 -- 172.21.15.17:0/1940185880 shutdown_connections 2023-07-14T13:17:47.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.287+0000 7fba1619d700 1 -- 172.21.15.17:0/1940185880 wait complete. 2023-07-14T13:17:47.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:47 smithi017 ceph-mon[95536]: pgmap v568: 97 pgs: 97 active+clean; 16 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 35 MiB/s wr, 156 op/s 2023-07-14T13:17:47.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:47 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3432511056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:17:47.346 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:17:47.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:47 smithi131 ceph-mon[96953]: pgmap v568: 97 pgs: 97 active+clean; 16 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 35 MiB/s wr, 156 op/s 2023-07-14T13:17:47.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:47 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3432511056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:17:47.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.534+0000 7f67a199d700 1 -- 172.21.15.17:0/3297809000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c10c3b0 msgr2=0x7f679c10e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.534+0000 7f67a199d700 1 --2- 172.21.15.17:0/3297809000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c10c3b0 0x7f679c10e790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f679400b0a0 tx=0x7f679400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.535+0000 7f67a199d700 1 -- 172.21.15.17:0/3297809000 shutdown_connections 2023-07-14T13:17:47.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.535+0000 7f67a199d700 1 --2- 172.21.15.17:0/3297809000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c10c3b0 0x7f679c10e790 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.535+0000 7f67a199d700 1 --2- 172.21.15.17:0/3297809000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f679c0fe800 0x7f679c0febd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.535+0000 7f67a199d700 1 --2- 172.21.15.17:0/3297809000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f679c0ff110 0x7f679c10be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.535+0000 7f67a199d700 1 -- 172.21.15.17:0/3297809000 >> 172.21.15.17:0/3297809000 conn(0x7f679c0745d0 msgr2=0x7f679c0749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.535+0000 7f67a199d700 1 -- 172.21.15.17:0/3297809000 shutdown_connections 2023-07-14T13:17:47.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.535+0000 7f67a199d700 1 -- 172.21.15.17:0/3297809000 wait complete. 2023-07-14T13:17:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.536+0000 7f67a199d700 1 Processor -- start 2023-07-14T13:17:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.536+0000 7f67a199d700 1 -- start start 2023-07-14T13:17:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.537+0000 7f67a199d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f679c0fe800 0x7f679c19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.537+0000 7f67a199d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c0ff110 0x7f679c19df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.537+0000 7f67a199d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f679c10c3b0 0x7f679c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.537+0000 7f67a199d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c1981c0 con 0x7f679c10c3b0 2023-07-14T13:17:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.537+0000 7f67a199d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c198330 con 0x7f679c0ff110 2023-07-14T13:17:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.537+0000 7f67a199d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c1984f0 con 0x7f679c0fe800 2023-07-14T13:17:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.537+0000 7f67a099b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f679c0fe800 0x7f679c19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.537+0000 7f67a099b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f679c0fe800 0x7f679c19da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60666/0 (socket says 172.21.15.17:60666) 2023-07-14T13:17:47.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.537+0000 7f67a099b700 1 -- 172.21.15.17:0/868025397 learned_addr learned my addr 172.21.15.17:0/868025397 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.537+0000 7f67a119c700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f679c10c3b0 0x7f679c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.537+0000 7f679bfff700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c0ff110 0x7f679c19df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f67a099b700 1 -- 172.21.15.17:0/868025397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c0ff110 msgr2=0x7f679c19df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f67a099b700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c0ff110 0x7f679c19df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f67a099b700 1 -- 172.21.15.17:0/868025397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f679c10c3b0 msgr2=0x7f679c1979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f67a099b700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f679c10c3b0 0x7f679c1979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f67a099b700 1 -- 172.21.15.17:0/868025397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6794009d00 con 0x7f679c0fe800 2023-07-14T13:17:47.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f67a119c700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f679c10c3b0 0x7f679c1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f679bfff700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c0ff110 0x7f679c19df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f67a099b700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f679c0fe800 0x7f679c19da10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f679000e9a0 tx=0x7f679000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f6799ffb700 1 -- 172.21.15.17:0/868025397 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790009790 con 0x7f679c0fe800 2023-07-14T13:17:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f67a199d700 1 -- 172.21.15.17:0/868025397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679c1987d0 con 0x7f679c0fe800 2023-07-14T13:17:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f6799ffb700 1 -- 172.21.15.17:0/868025397 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6790010430 con 0x7f679c0fe800 2023-07-14T13:17:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f6799ffb700 1 -- 172.21.15.17:0/868025397 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679000cea0 con 0x7f679c0fe800 2023-07-14T13:17:47.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.538+0000 7f67a199d700 1 -- 172.21.15.17:0/868025397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679c1a49e0 con 0x7f679c0fe800 2023-07-14T13:17:47.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.542+0000 7f6799ffb700 1 -- 172.21.15.17:0/868025397 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f67900105a0 con 0x7f679c0fe800 2023-07-14T13:17:47.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.543+0000 7f6799ffb700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f678c0a1360 0x7f678c0a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.544+0000 7f6799ffb700 1 -- 172.21.15.17:0/868025397 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6790014070 con 0x7f679c0fe800 2023-07-14T13:17:47.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.544+0000 7f679bfff700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f678c0a1360 0x7f678c0a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.544+0000 7f67b650db80 1 Processor -- start 2023-07-14T13:17:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.544+0000 7f67b650db80 1 -- start start 2023-07-14T13:17:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f679bfff700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f678c0a1360 0x7f678c0a3810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f679c199220 tx=0x7f6788007400 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f67b650db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abddcf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f67b650db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f67b650db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abdddc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f67b650db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abdcd4cb0 con 0x556abddd9d30 2023-07-14T13:17:47.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f67b650db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abdd27a40 con 0x556abddcf4f0 2023-07-14T13:17:47.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f67b650db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abdd20ed0 con 0x556abddcfe00 2023-07-14T13:17:47.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f67a119c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abdddc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f67a099b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abddcf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f67a119c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abdddc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49282/0 (socket says 172.21.15.17:49282) 2023-07-14T13:17:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f67a119c700 1 -- 172.21.15.17:0/4184661398 learned_addr learned my addr 172.21.15.17:0/4184661398 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f67a099b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abddcf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34548/0 (socket says 172.21.15.17:34548) 2023-07-14T13:17:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.545+0000 7f679bfff700 1 --2- 172.21.15.17:0/4184661398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.546+0000 7f67a099b700 1 -- 172.21.15.17:0/4184661398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 msgr2=0x556abddd97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.546+0000 7f67a099b700 1 --2- 172.21.15.17:0/4184661398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.546+0000 7f67a099b700 1 -- 172.21.15.17:0/4184661398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 msgr2=0x556abdddc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.546+0000 7f67a099b700 1 --2- 172.21.15.17:0/4184661398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abdddc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.546+0000 7f67a099b700 1 -- 172.21.15.17:0/4184661398 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556abdb4ede0 con 0x556abddcf4f0 2023-07-14T13:17:47.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.546+0000 7f67a099b700 1 --2- 172.21.15.17:0/4184661398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abddcf8c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f67900ca660 tx=0x7f6790099a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44740ffb2dbb5c5e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.546+0000 7f6786ffd700 1 -- 172.21.15.17:0/4184661398 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679009e010 con 0x556abddcf4f0 2023-07-14T13:17:47.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.546+0000 7f6786ffd700 1 -- 172.21.15.17:0/4184661398 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67900a2430 con 0x556abddcf4f0 2023-07-14T13:17:47.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.546+0000 7f6786ffd700 1 -- 172.21.15.17:0/4184661398 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67900a2200 con 0x556abddcf4f0 2023-07-14T13:17:47.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.547+0000 7f67b650db80 1 -- 172.21.15.17:0/4184661398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 msgr2=0x556abddcf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.547+0000 7f67b650db80 1 --2- 172.21.15.17:0/4184661398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abddcf8c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f67900ca660 tx=0x7f6790099a10 comp rx=0 tx=0).stop 2023-07-14T13:17:47.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.547+0000 7f67b650db80 1 -- 172.21.15.17:0/4184661398 shutdown_connections 2023-07-14T13:17:47.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.547+0000 7f67b650db80 1 --2- 172.21.15.17:0/4184661398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abdddc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.547+0000 7f67b650db80 1 --2- 172.21.15.17:0/4184661398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abddcf8c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.547+0000 7f67b650db80 1 --2- 172.21.15.17:0/4184661398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.547+0000 7f67b650db80 1 -- 172.21.15.17:0/4184661398 >> 172.21.15.17:0/4184661398 conn(0x556abddc4ff0 msgr2=0x556abddca930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.547+0000 7f67b650db80 1 -- 172.21.15.17:0/4184661398 shutdown_connections 2023-07-14T13:17:47.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.547+0000 7f67b650db80 1 -- 172.21.15.17:0/4184661398 wait complete. 2023-07-14T13:17:47.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.548+0000 7f67b650db80 1 -- start start 2023-07-14T13:17:47.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.548+0000 7f67b650db80 1 Processor -- start 2023-07-14T13:17:47.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f67b650db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddcf4f0 0x556abddd9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f67b650db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f67b650db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddd9d30 0x556abddd7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f67b650db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abdcc0ac0 con 0x556abddcf4f0 2023-07-14T13:17:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f67b650db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abdcc07c0 con 0x556abddd9d30 2023-07-14T13:17:47.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f67b650db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abdba4920 con 0x556abddcfe00 2023-07-14T13:17:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f67b650db80 10 client.0 _ll_register_callbacks cb 0x556abdcbe760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f67a099b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddcf4f0 0x556abddd9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f67a099b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddcf4f0 0x556abddd9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49286/0 (socket says 172.21.15.17:49286) 2023-07-14T13:17:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f67a099b700 1 -- 172.21.15.17:0/4011640334 learned_addr learned my addr 172.21.15.17:0/4011640334 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f679bfff700 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.549+0000 7f67a119c700 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddd9d30 0x556abddd7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f67a099b700 1 -- 172.21.15.17:0/4011640334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 msgr2=0x556abddd6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f67a099b700 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f67a099b700 1 -- 172.21.15.17:0/4011640334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddd9d30 msgr2=0x556abddd7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f67a099b700 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddd9d30 0x556abddd7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f67a099b700 1 -- 172.21.15.17:0/4011640334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679c1a49e0 con 0x556abddcf4f0 2023-07-14T13:17:47.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f679bfff700 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:47.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f67a099b700 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddcf4f0 0x556abddd9760 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f67900ca630 tx=0x7f6790010bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98139bb3fe86e2c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f677bfff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:17:47.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f677bfff700 1 -- 172.21.15.17:0/4011640334 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679009e010 con 0x556abddcf4f0 2023-07-14T13:17:47.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f677bfff700 1 -- 172.21.15.17:0/4011640334 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f67900a21b0 con 0x556abddcf4f0 2023-07-14T13:17:47.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f67b650db80 1 -- 172.21.15.17:0/4011640334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556abdc7a4f0 con 0x556abddcf4f0 2023-07-14T13:17:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f677bfff700 1 -- 172.21.15.17:0/4011640334 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67900b82a0 con 0x556abddcf4f0 2023-07-14T13:17:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f67b650db80 10 client.18612 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.550+0000 7f67b650db80 1 -- 172.21.15.17:0/4011640334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x556abdb37c60 con 0x556abddcf4f0 2023-07-14T13:17:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.551+0000 7f677bfff700 1 -- 172.21.15.17:0/4011640334 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556abdc7a4f0 con 0x556abddcf4f0 2023-07-14T13:17:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.551+0000 7f677bfff700 1 -- 172.21.15.17:0/4011640334 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6790098f40 con 0x556abddcf4f0 2023-07-14T13:17:47.598 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.551+0000 7f67b650db80 10 client.18612 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.551+0000 7f67b650db80 10 client.18612 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:17:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.551+0000 7f67b650db80 20 client.18612 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.551+0000 7f67b650db80 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556abdde9320 0x556abddeb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.551+0000 7f67b650db80 4 client.18612 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:17:47.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.551+0000 7f67b650db80 1 -- 172.21.15.17:0/4011640334 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556abdd19eb0 con 0x556abdde9320 2023-07-14T13:17:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.551+0000 7f679bfff700 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556abdde9320 0x556abddeb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.552+0000 7f677bfff700 10 client.18612 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:17:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.552+0000 7f679bfff700 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556abdde9320 0x556abddeb730 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c13172df2616a81e server_cookie=efabb22723cf3c40 in_seq=0 out_seq=0 2023-07-14T13:17:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f677bfff700 1 -- 172.21.15.17:0/4011640334 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556abdd19eb0 con 0x556abdde9320 2023-07-14T13:17:47.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f677bfff700 10 client.18612 handle_command_reply: tid=0 2023-07-14T13:17:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f67b650db80 1 client.18612 shutdown 2023-07-14T13:17:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f67b650db80 1 -- 172.21.15.17:0/4011640334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddcf4f0 msgr2=0x556abddd9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f67b650db80 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddcf4f0 0x556abddd9760 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f67900ca630 tx=0x7f6790010bf0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f67b650db80 1 -- 172.21.15.17:0/4011640334 shutdown_connections 2023-07-14T13:17:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f67b650db80 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556abdde9320 0x556abddeb730 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f67b650db80 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddd9d30 0x556abddd7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f67b650db80 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddcf4f0 0x556abddd9760 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f67b650db80 1 --2- 172.21.15.17:0/4011640334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f677bfff700 0 client.18612 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:17:47.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.553+0000 7f67b650db80 1 -- 172.21.15.17:0/4011640334 >> 172.21.15.17:0/4011640334 conn(0x556abddc4ff0 msgr2=0x556abddca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.554+0000 7f67b650db80 1 -- 172.21.15.17:0/4011640334 shutdown_connections 2023-07-14T13:17:47.602 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.554+0000 7f67b650db80 1 -- 172.21.15.17:0/4011640334 wait complete. 2023-07-14T13:17:47.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.554+0000 7f67b650db80 20 client.18612 trim_cache size 0 max 16384 2023-07-14T13:17:47.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.570+0000 7f67b650db80 1 Processor -- start 2023-07-14T13:17:47.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.570+0000 7f67b650db80 1 -- start start 2023-07-14T13:17:47.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.570+0000 7f67b650db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abdde07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.570+0000 7f67b650db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.570+0000 7f67b650db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abddd22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.570+0000 7f67b650db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abddd09f0 con 0x556abddd9d30 2023-07-14T13:17:47.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.570+0000 7f67b650db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abddd7ff0 con 0x556abddcf4f0 2023-07-14T13:17:47.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.570+0000 7f67b650db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abddc4bf0 con 0x556abddcfe00 2023-07-14T13:17:47.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.570+0000 7f67a119c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abddd22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.571+0000 7f67a119c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abddd22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49292/0 (socket says 172.21.15.17:49292) 2023-07-14T13:17:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.571+0000 7f67a119c700 1 -- 172.21.15.17:0/27864802 learned_addr learned my addr 172.21.15.17:0/27864802 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.571+0000 7f679bfff700 1 --2- 172.21.15.17:0/27864802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.571+0000 7f67a099b700 1 --2- 172.21.15.17:0/27864802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abdde07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.571+0000 7f679bfff700 1 -- 172.21.15.17:0/27864802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 msgr2=0x556abdde07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.571+0000 7f679bfff700 1 --2- 172.21.15.17:0/27864802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abdde07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.571+0000 7f679bfff700 1 -- 172.21.15.17:0/27864802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 msgr2=0x556abddd22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.571+0000 7f679bfff700 1 --2- 172.21.15.17:0/27864802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abddd22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.571+0000 7f679bfff700 1 -- 172.21.15.17:0/27864802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556abdb75250 con 0x556abddcfe00 2023-07-14T13:17:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.571+0000 7f67a119c700 1 --2- 172.21.15.17:0/27864802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abddd22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.571+0000 7f679bfff700 1 --2- 172.21.15.17:0/27864802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd1d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x556abddd1610 tx=0x7f6788013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c4ea53b0d4aab65 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.572+0000 7f67877fe700 1 -- 172.21.15.17:0/27864802 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788024040 con 0x556abddcfe00 2023-07-14T13:17:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.572+0000 7f67877fe700 1 -- 172.21.15.17:0/27864802 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6788015070 con 0x556abddcfe00 2023-07-14T13:17:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.572+0000 7f67877fe700 1 -- 172.21.15.17:0/27864802 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788011af0 con 0x556abddcfe00 2023-07-14T13:17:47.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.572+0000 7f67b650db80 1 -- 172.21.15.17:0/27864802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 msgr2=0x556abddd1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.572+0000 7f67b650db80 1 --2- 172.21.15.17:0/27864802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd1d90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x556abddd1610 tx=0x7f6788013000 comp rx=0 tx=0).stop 2023-07-14T13:17:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.572+0000 7f67b650db80 1 -- 172.21.15.17:0/27864802 shutdown_connections 2023-07-14T13:17:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.572+0000 7f67b650db80 1 --2- 172.21.15.17:0/27864802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abddd22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.572+0000 7f67b650db80 1 --2- 172.21.15.17:0/27864802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abdde07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.572+0000 7f67b650db80 1 --2- 172.21.15.17:0/27864802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abddd1d90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.572+0000 7f67b650db80 1 -- 172.21.15.17:0/27864802 >> 172.21.15.17:0/27864802 conn(0x556abddc4ff0 msgr2=0x556abdde5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.573+0000 7f67b650db80 1 -- 172.21.15.17:0/27864802 shutdown_connections 2023-07-14T13:17:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.573+0000 7f67b650db80 1 -- 172.21.15.17:0/27864802 wait complete. 2023-07-14T13:17:47.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.573+0000 7f67b650db80 1 -- start start 2023-07-14T13:17:47.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.573+0000 7f67b650db80 1 Processor -- start 2023-07-14T13:17:47.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f67b650db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abdde04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f67b650db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abdde09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f67b650db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abddde9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f67b650db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abdddf0f0 con 0x556abddd9d30 2023-07-14T13:17:47.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f67b650db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abdddf260 con 0x556abddcf4f0 2023-07-14T13:17:47.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f67b650db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556abdddf420 con 0x556abddcfe00 2023-07-14T13:17:47.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f67b650db80 10 client.0 _ll_register_callbacks cb 0x7f6794009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:47.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f67a099b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abdde04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f67a099b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abdde04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34574/0 (socket says 172.21.15.17:34574) 2023-07-14T13:17:47.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f67a119c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abddde9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f67a099b700 1 -- 172.21.15.17:0/3557527858 learned_addr learned my addr 172.21.15.17:0/3557527858 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.574+0000 7f679bfff700 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abdde09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.575+0000 7f67a099b700 1 -- 172.21.15.17:0/3557527858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 msgr2=0x556abdde09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.575+0000 7f67a099b700 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abdde09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.575+0000 7f67a099b700 1 -- 172.21.15.17:0/3557527858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 msgr2=0x556abddde9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.575+0000 7f67a099b700 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abddde9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.575+0000 7f67a099b700 1 -- 172.21.15.17:0/3557527858 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679c10f2c0 con 0x556abddcf4f0 2023-07-14T13:17:47.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.575+0000 7f67a099b700 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abdde04b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6790099f70 tx=0x7f6790010a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a36083ad9d6473f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.575+0000 7f677bfff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:17:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.575+0000 7f677bfff700 1 -- 172.21.15.17:0/3557527858 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790010880 con 0x556abddcf4f0 2023-07-14T13:17:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.575+0000 7f677bfff700 1 -- 172.21.15.17:0/3557527858 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f679009e010 con 0x556abddcf4f0 2023-07-14T13:17:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.575+0000 7f67b650db80 1 -- 172.21.15.17:0/3557527858 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67900a2430 con 0x556abddcf4f0 2023-07-14T13:17:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.576+0000 7f677bfff700 1 -- 172.21.15.17:0/3557527858 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6790098380 con 0x556abddcf4f0 2023-07-14T13:17:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.576+0000 7f67b650db80 10 client.28319 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.576+0000 7f67b650db80 1 -- 172.21.15.17:0/3557527858 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f6788011570 con 0x556abddcf4f0 2023-07-14T13:17:47.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.576+0000 7f677bfff700 1 -- 172.21.15.17:0/3557527858 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67900a2430 con 0x556abddcf4f0 2023-07-14T13:17:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.576+0000 7f677bfff700 1 -- 172.21.15.17:0/3557527858 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f67900837e0 con 0x556abddcf4f0 2023-07-14T13:17:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.576+0000 7f67b650db80 10 client.28319 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.576+0000 7f67b650db80 10 client.28319 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:17:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.576+0000 7f67b650db80 20 client.28319 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.576+0000 7f67b650db80 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556abde3e190 0x556abde405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.576+0000 7f67b650db80 4 client.28319 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:17:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.576+0000 7f67b650db80 1 -- 172.21.15.17:0/3557527858 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556abdcdc050 con 0x556abde3e190 2023-07-14T13:17:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.577+0000 7f679bfff700 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556abde3e190 0x556abde405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.577+0000 7f679bfff700 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556abde3e190 0x556abde405a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c74f77fa4760f932 server_cookie=87281e749930c15b in_seq=0 out_seq=0 2023-07-14T13:17:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.577+0000 7f677bfff700 10 client.28319 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:17:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.577+0000 7f677bfff700 1 -- 172.21.15.17:0/3557527858 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556abdcdc050 con 0x556abde3e190 2023-07-14T13:17:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.577+0000 7f677bfff700 10 client.28319 handle_command_reply: tid=0 2023-07-14T13:17:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.577+0000 7f67b650db80 1 client.28319 shutdown 2023-07-14T13:17:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f67b650db80 1 -- 172.21.15.17:0/3557527858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 msgr2=0x556abdde04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f67b650db80 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abdde04b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6790099f70 tx=0x7f6790010a70 comp rx=0 tx=0).stop 2023-07-14T13:17:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f67b650db80 1 -- 172.21.15.17:0/3557527858 shutdown_connections 2023-07-14T13:17:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f67b650db80 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556abddd9d30 0x556abddde9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f67b650db80 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x556abde3e190 0x556abde405a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f67b650db80 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556abddcf4f0 0x556abdde04b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f67b650db80 1 --2- 172.21.15.17:0/3557527858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556abddcfe00 0x556abdde09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f677bfff700 0 client.28319 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:17:47.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f67b650db80 1 -- 172.21.15.17:0/3557527858 >> 172.21.15.17:0/3557527858 conn(0x556abddc4ff0 msgr2=0x556abddce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f67b650db80 1 -- 172.21.15.17:0/3557527858 shutdown_connections 2023-07-14T13:17:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f67b650db80 1 -- 172.21.15.17:0/3557527858 wait complete. 2023-07-14T13:17:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.578+0000 7f67b650db80 20 client.28319 trim_cache size 0 max 16384 2023-07-14T13:17:47.626 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:17:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 -- 172.21.15.17:0/868025397 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f678c0a1360 msgr2=0x7f678c0a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f678c0a1360 0x7f678c0a3810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f679c199220 tx=0x7f6788007400 comp rx=0 tx=0).stop 2023-07-14T13:17:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 -- 172.21.15.17:0/868025397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f679c0fe800 msgr2=0x7f679c19da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f679c0fe800 0x7f679c19da10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f679000e9a0 tx=0x7f679000ecb0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 -- 172.21.15.17:0/868025397 shutdown_connections 2023-07-14T13:17:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f678c0a1360 0x7f678c0a3810 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f679c10c3b0 0x7f679c1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f679c0fe800 0x7f679c19da10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 --2- 172.21.15.17:0/868025397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f679c0ff110 0x7f679c19df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 -- 172.21.15.17:0/868025397 >> 172.21.15.17:0/868025397 conn(0x7f679c0745d0 msgr2=0x7f679c0fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 -- 172.21.15.17:0/868025397 shutdown_connections 2023-07-14T13:17:47.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.579+0000 7f67a199d700 1 -- 172.21.15.17:0/868025397 wait complete. 2023-07-14T13:17:47.637 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:17:47.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:47 smithi135 ceph-mon[97338]: pgmap v568: 97 pgs: 97 active+clean; 16 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 35 MiB/s wr, 156 op/s 2023-07-14T13:17:47.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:47 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3432511056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:17:47.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.839+0000 7fd44c3ff700 1 -- 172.21.15.17:0/1372689063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd444100d00 msgr2=0x7fd4441010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.839+0000 7fd44c3ff700 1 --2- 172.21.15.17:0/1372689063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd444100d00 0x7fd4441010d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd440009990 tx=0x7fd440009ca0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.840+0000 7fd44c3ff700 1 -- 172.21.15.17:0/1372689063 shutdown_connections 2023-07-14T13:17:47.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.840+0000 7fd44c3ff700 1 --2- 172.21.15.17:0/1372689063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd44410a040 0x7fd44410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.840+0000 7fd44c3ff700 1 --2- 172.21.15.17:0/1372689063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd444100d00 0x7fd4441010d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.840+0000 7fd44c3ff700 1 --2- 172.21.15.17:0/1372689063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444101610 0x7fd444109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.840+0000 7fd44c3ff700 1 -- 172.21.15.17:0/1372689063 >> 172.21.15.17:0/1372689063 conn(0x7fd4440fa4b0 msgr2=0x7fd4440fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.840+0000 7fd44c3ff700 1 -- 172.21.15.17:0/1372689063 shutdown_connections 2023-07-14T13:17:47.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.840+0000 7fd44c3ff700 1 -- 172.21.15.17:0/1372689063 wait complete. 2023-07-14T13:17:47.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.841+0000 7fd44c3ff700 1 Processor -- start 2023-07-14T13:17:47.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.841+0000 7fd44c3ff700 1 -- start start 2023-07-14T13:17:47.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44c3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd444100d00 0x7fd4440fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44c3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444101610 0x7fd4440fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44c3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd44410a040 0x7fd4441a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44c3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440ff6c0 con 0x7fd44410a040 2023-07-14T13:17:47.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44c3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441a42e0 con 0x7fd444101610 2023-07-14T13:17:47.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44c3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441a4420 con 0x7fd444100d00 2023-07-14T13:17:47.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44a19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd444100d00 0x7fd4440fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44a19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd444100d00 0x7fd4440fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60714/0 (socket says 172.21.15.17:60714) 2023-07-14T13:17:47.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44a19b700 1 -- 172.21.15.17:0/2503235892 learned_addr learned my addr 172.21.15.17:0/2503235892 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44a99c700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd44410a040 0x7fd4441a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44999a700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444101610 0x7fd4440fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44a19b700 1 -- 172.21.15.17:0/2503235892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444101610 msgr2=0x7fd4440fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44a19b700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444101610 0x7fd4440fee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44a19b700 1 -- 172.21.15.17:0/2503235892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd44410a040 msgr2=0x7fd4441a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44a19b700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd44410a040 0x7fd4441a3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.842+0000 7fd44a19b700 1 -- 172.21.15.17:0/2503235892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4400095f0 con 0x7fd444100d00 2023-07-14T13:17:47.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.843+0000 7fd44a19b700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd444100d00 0x7fd4440fe950 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd440005740 tx=0x7fd440005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.843+0000 7fd43b7fe700 1 -- 172.21.15.17:0/2503235892 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44001d070 con 0x7fd444100d00 2023-07-14T13:17:47.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.843+0000 7fd43b7fe700 1 -- 172.21.15.17:0/2503235892 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd440022470 con 0x7fd444100d00 2023-07-14T13:17:47.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.843+0000 7fd44c3ff700 1 -- 172.21.15.17:0/2503235892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4441a4620 con 0x7fd444100d00 2023-07-14T13:17:47.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.843+0000 7fd43b7fe700 1 -- 172.21.15.17:0/2503235892 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440017650 con 0x7fd444100d00 2023-07-14T13:17:47.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.843+0000 7fd44c3ff700 1 -- 172.21.15.17:0/2503235892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4441a4aa0 con 0x7fd444100d00 2023-07-14T13:17:47.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.847+0000 7fd43b7fe700 1 -- 172.21.15.17:0/2503235892 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd4400225e0 con 0x7fd444100d00 2023-07-14T13:17:47.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.848+0000 7fd45fdb6b80 1 Processor -- start 2023-07-14T13:17:47.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd45fdb6b80 1 -- start start 2023-07-14T13:17:47.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd43b7fe700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4300a12c0 0x7fd4300a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d7d2d0 0x5621d3d7d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d88590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d88ad0 0x5621d3d8aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3c83cb0 con 0x5621d3d7d2d0 2023-07-14T13:17:47.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3cd6a40 con 0x5621d3d88ad0 2023-07-14T13:17:47.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3ccfed0 con 0x5621d3d7dbe0 2023-07-14T13:17:47.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd43b7fe700 1 -- 172.21.15.17:0/2503235892 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd4400ce080 con 0x7fd444100d00 2023-07-14T13:17:47.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd44999a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d88590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd44999a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d88590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60730/0 (socket says 172.21.15.17:60730) 2023-07-14T13:17:47.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.849+0000 7fd44999a700 1 -- 172.21.15.17:0/1893636159 learned_addr learned my addr 172.21.15.17:0/1893636159 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.850+0000 7fd44a19b700 1 --2- 172.21.15.17:0/1893636159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d7d2d0 0x5621d3d7d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.850+0000 7fd44a99c700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4300a12c0 0x7fd4300a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.850+0000 7fd44a99c700 1 --2- 172.21.15.17:0/1893636159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d88ad0 0x5621d3d8aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.850+0000 7fd44999a700 1 -- 172.21.15.17:0/1893636159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d88ad0 msgr2=0x5621d3d8aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.850+0000 7fd44999a700 1 --2- 172.21.15.17:0/1893636159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d88ad0 0x5621d3d8aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.850+0000 7fd44999a700 1 -- 172.21.15.17:0/1893636159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d7d2d0 msgr2=0x5621d3d7d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.850+0000 7fd44999a700 1 --2- 172.21.15.17:0/1893636159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d7d2d0 0x5621d3d7d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.850+0000 7fd44999a700 1 -- 172.21.15.17:0/1893636159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621d3afdde0 con 0x5621d3d7dbe0 2023-07-14T13:17:47.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.850+0000 7fd44999a700 1 --2- 172.21.15.17:0/1893636159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d88590 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd434009d20 tx=0x7fd434011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddaaf42d8e61932a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.850+0000 7fd44a99c700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4300a12c0 0x7fd4300a3770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009ec0 tx=0x7fd43c009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.851+0000 7fd438bfe700 1 -- 172.21.15.17:0/1893636159 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434019630 con 0x5621d3d7dbe0 2023-07-14T13:17:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.851+0000 7fd438bfe700 1 -- 172.21.15.17:0/1893636159 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd434019c20 con 0x5621d3d7dbe0 2023-07-14T13:17:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.851+0000 7fd438bfe700 1 -- 172.21.15.17:0/1893636159 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400eb60 con 0x5621d3d7dbe0 2023-07-14T13:17:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.851+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1893636159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 msgr2=0x5621d3d88590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.851+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/1893636159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d88590 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd434009d20 tx=0x7fd434011720 comp rx=0 tx=0).stop 2023-07-14T13:17:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.852+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1893636159 shutdown_connections 2023-07-14T13:17:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.852+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/1893636159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d88ad0 0x5621d3d8aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.852+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/1893636159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d7d2d0 0x5621d3d7d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.852+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/1893636159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d88590 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.852+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1893636159 >> 172.21.15.17:0/1893636159 conn(0x5621d3d73da0 msgr2=0x5621d3d796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.852+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1893636159 shutdown_connections 2023-07-14T13:17:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.852+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1893636159 wait complete. 2023-07-14T13:17:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.852+0000 7fd45fdb6b80 1 -- start start 2023-07-14T13:17:47.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.853+0000 7fd45fdb6b80 1 Processor -- start 2023-07-14T13:17:47.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.853+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d7d2d0 0x5621d3d884c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.853+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d857b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.853+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d88ad0 0x5621d3d85e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.853+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3c6fac0 con 0x5621d3d88ad0 2023-07-14T13:17:47.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.853+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3c6f7c0 con 0x5621d3d7d2d0 2023-07-14T13:17:47.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.853+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3b53920 con 0x5621d3d7dbe0 2023-07-14T13:17:47.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.853+0000 7fd45fdb6b80 10 client.0 _ll_register_callbacks cb 0x5621d3c6d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:47.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44999a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44999a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d857b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60744/0 (socket says 172.21.15.17:60744) 2023-07-14T13:17:47.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44a19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d7d2d0 0x5621d3d884c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44999a700 1 -- 172.21.15.17:0/1042188746 learned_addr learned my addr 172.21.15.17:0/1042188746 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44a99c700 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d88ad0 0x5621d3d85e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44999a700 1 -- 172.21.15.17:0/1042188746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d7d2d0 msgr2=0x5621d3d884c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44999a700 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d7d2d0 0x5621d3d884c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44999a700 1 -- 172.21.15.17:0/1042188746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d88ad0 msgr2=0x5621d3d85e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44999a700 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d88ad0 0x5621d3d85e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44999a700 1 -- 172.21.15.17:0/1042188746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd434009980 con 0x5621d3d7dbe0 2023-07-14T13:17:47.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44a19b700 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d7d2d0 0x5621d3d884c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:47.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd44999a700 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d857b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd434019a50 tx=0x7fd434019a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f3d7a26bd480871 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.854+0000 7fd42dffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:17:47.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.855+0000 7fd42dffb700 1 -- 172.21.15.17:0/1042188746 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434005450 con 0x5621d3d7dbe0 2023-07-14T13:17:47.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.855+0000 7fd42dffb700 1 -- 172.21.15.17:0/1042188746 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd43400e4d0 con 0x5621d3d7dbe0 2023-07-14T13:17:47.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.855+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1042188746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621d3c294f0 con 0x5621d3d7dbe0 2023-07-14T13:17:47.900 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.855+0000 7fd42dffb700 1 -- 172.21.15.17:0/1042188746 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd434005ce0 con 0x5621d3d7dbe0 2023-07-14T13:17:47.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.855+0000 7fd45fdb6b80 10 client.28300 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:47.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.855+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1042188746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5621d3ae6c60 con 0x5621d3d7dbe0 2023-07-14T13:17:47.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.855+0000 7fd42dffb700 1 -- 172.21.15.17:0/1042188746 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5621d3c294f0 con 0x5621d3d7dbe0 2023-07-14T13:17:47.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.856+0000 7fd42dffb700 1 -- 172.21.15.17:0/1042188746 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd434004ab0 con 0x5621d3d7dbe0 2023-07-14T13:17:47.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.856+0000 7fd45fdb6b80 10 client.28300 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:47.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.856+0000 7fd45fdb6b80 10 client.28300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:47.901 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.856+0000 7fd45fdb6b80 20 client.28300 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.856+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621d3da0a90 0x5621d3da2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.856+0000 7fd45fdb6b80 4 client.28300 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:17:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.856+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1042188746 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621d3cc8eb0 con 0x5621d3da0a90 2023-07-14T13:17:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.856+0000 7fd44a19b700 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621d3da0a90 0x5621d3da2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.857+0000 7fd44a19b700 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621d3da0a90 0x5621d3da2ea0 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91867b0861d74ac6 server_cookie=6496a4d4a9e61259 in_seq=0 out_seq=0 2023-07-14T13:17:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.857+0000 7fd42dffb700 10 client.28300 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.857+0000 7fd42dffb700 1 -- 172.21.15.17:0/1042188746 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5621d3cc8eb0 con 0x5621d3da0a90 2023-07-14T13:17:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.857+0000 7fd42dffb700 10 client.28300 handle_command_reply: tid=0 2023-07-14T13:17:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 1 client.28300 shutdown 2023-07-14T13:17:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1042188746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 msgr2=0x5621d3d857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d857b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd434019a50 tx=0x7fd434019a80 comp rx=0 tx=0).stop 2023-07-14T13:17:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1042188746 shutdown_connections 2023-07-14T13:17:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621d3da0a90 0x5621d3da2ea0 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d88ad0 0x5621d3d85e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d7d2d0 0x5621d3d884c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd42dffb700 0 client.28300 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/1042188746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7dbe0 0x5621d3d857b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1042188746 >> 172.21.15.17:0/1042188746 conn(0x5621d3d73da0 msgr2=0x5621d3d79230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1042188746 shutdown_connections 2023-07-14T13:17:47.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/1042188746 wait complete. 2023-07-14T13:17:47.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.858+0000 7fd45fdb6b80 20 client.28300 trim_cache size 0 max 16384 2023-07-14T13:17:47.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.872+0000 7fd45fdb6b80 1 Processor -- start 2023-07-14T13:17:47.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.872+0000 7fd45fdb6b80 1 -- start start 2023-07-14T13:17:47.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d7d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d7dbe0 0x5621d3d84f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d88ad0 0x5621d3d9cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3d70fa0 con 0x5621d3d7dbe0 2023-07-14T13:17:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3d73970 con 0x5621d3d88ad0 2023-07-14T13:17:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3d7a4d0 con 0x5621d3d7d2d0 2023-07-14T13:17:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd44999a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d7dbe0 0x5621d3d84f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd44a19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d7d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd44a19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d7d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60756/0 (socket says 172.21.15.17:60756) 2023-07-14T13:17:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd44a19b700 1 -- 172.21.15.17:0/2977482771 learned_addr learned my addr 172.21.15.17:0/2977482771 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd44999a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d7dbe0 0x5621d3d84f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49350/0 (socket says 172.21.15.17:49350) 2023-07-14T13:17:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.873+0000 7fd44a99c700 1 --2- 172.21.15.17:0/2977482771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d88ad0 0x5621d3d9cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.874+0000 7fd44a19b700 1 -- 172.21.15.17:0/2977482771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d88ad0 msgr2=0x5621d3d9cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.874+0000 7fd44a19b700 1 --2- 172.21.15.17:0/2977482771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d88ad0 0x5621d3d9cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.874+0000 7fd44a19b700 1 -- 172.21.15.17:0/2977482771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d7dbe0 msgr2=0x5621d3d84f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.874+0000 7fd44a19b700 1 --2- 172.21.15.17:0/2977482771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d7dbe0 0x5621d3d84f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.874+0000 7fd44a19b700 1 -- 172.21.15.17:0/2977482771 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621d3b24250 con 0x5621d3d7d2d0 2023-07-14T13:17:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.874+0000 7fd44a19b700 1 --2- 172.21.15.17:0/2977482771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d7d6a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd440097c10 tx=0x7fd440009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47fd8f528fa3f5ca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.874+0000 7fd4393ff700 1 -- 172.21.15.17:0/2977482771 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44009ab00 con 0x5621d3d7d2d0 2023-07-14T13:17:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.874+0000 7fd4393ff700 1 -- 172.21.15.17:0/2977482771 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd44009b1a0 con 0x5621d3d7d2d0 2023-07-14T13:17:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.874+0000 7fd4393ff700 1 -- 172.21.15.17:0/2977482771 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4400cba10 con 0x5621d3d7d2d0 2023-07-14T13:17:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.875+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/2977482771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 msgr2=0x5621d3d7d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.875+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/2977482771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d7d6a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd440097c10 tx=0x7fd440009ca0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.875+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/2977482771 shutdown_connections 2023-07-14T13:17:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.875+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/2977482771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d88ad0 0x5621d3d9cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.875+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/2977482771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d7d6a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.875+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/2977482771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d7dbe0 0x5621d3d84f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.875+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/2977482771 >> 172.21.15.17:0/2977482771 conn(0x5621d3d73da0 msgr2=0x5621d3da77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.875+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/2977482771 shutdown_connections 2023-07-14T13:17:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.875+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/2977482771 wait complete. 2023-07-14T13:17:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.876+0000 7fd45fdb6b80 1 -- start start 2023-07-14T13:17:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.876+0000 7fd45fdb6b80 1 Processor -- start 2023-07-14T13:17:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.876+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d953a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.876+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d7dbe0 0x5621d3d958e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.876+0000 7fd45fdb6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d88ad0 0x5621d3d95e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.876+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3df3930 con 0x5621d3d88ad0 2023-07-14T13:17:47.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.876+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3df3a70 con 0x5621d3d7dbe0 2023-07-14T13:17:47.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.876+0000 7fd45fdb6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d3df3c00 con 0x5621d3d7d2d0 2023-07-14T13:17:47.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.876+0000 7fd45fdb6b80 10 client.0 _ll_register_callbacks cb 0x7fd440005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:47.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44a19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44a99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d88ad0 0x5621d3d95e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44999a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d7dbe0 0x5621d3d958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44a19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d953a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60770/0 (socket says 172.21.15.17:60770) 2023-07-14T13:17:47.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44a19b700 1 -- 172.21.15.17:0/4247687026 learned_addr learned my addr 172.21.15.17:0/4247687026 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:47.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44a19b700 1 -- 172.21.15.17:0/4247687026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d7dbe0 msgr2=0x5621d3d958e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44a19b700 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d7dbe0 0x5621d3d958e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44a19b700 1 -- 172.21.15.17:0/4247687026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d88ad0 msgr2=0x5621d3d95e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:47.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44a19b700 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d88ad0 0x5621d3d95e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44a19b700 1 -- 172.21.15.17:0/4247687026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4441a4aa0 con 0x5621d3d7d2d0 2023-07-14T13:17:47.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44a99c700 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d88ad0 0x5621d3d95e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:47.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd44a19b700 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d953a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd440006010 tx=0x7fd44000bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53e4414b0d659d54 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:47.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.877+0000 7fd42dffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:17:47.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.878+0000 7fd42dffb700 1 -- 172.21.15.17:0/4247687026 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4400cbc20 con 0x5621d3d7d2d0 2023-07-14T13:17:47.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.878+0000 7fd42dffb700 1 -- 172.21.15.17:0/4247687026 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd4400a3560 con 0x5621d3d7d2d0 2023-07-14T13:17:47.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.878+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/4247687026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd434019c20 con 0x5621d3d7d2d0 2023-07-14T13:17:47.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.878+0000 7fd42dffb700 1 -- 172.21.15.17:0/4247687026 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd44009f1d0 con 0x5621d3d7d2d0 2023-07-14T13:17:47.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.878+0000 7fd45fdb6b80 10 client.28306 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:47.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.878+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/4247687026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5621d3afc2b0 con 0x5621d3d7d2d0 2023-07-14T13:17:47.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.878+0000 7fd42dffb700 1 -- 172.21.15.17:0/4247687026 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd434019c20 con 0x5621d3d7d2d0 2023-07-14T13:17:47.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.879+0000 7fd42dffb700 1 -- 172.21.15.17:0/4247687026 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd44009a690 con 0x5621d3d7d2d0 2023-07-14T13:17:47.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.879+0000 7fd45fdb6b80 10 client.28306 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:47.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.879+0000 7fd45fdb6b80 10 client.28306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:47.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.879+0000 7fd45fdb6b80 20 client.28306 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:47.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.879+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621d3df4f20 0x5621d3df7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:47.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.879+0000 7fd45fdb6b80 4 client.28306 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:17:47.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.879+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/4247687026 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5621d3c8b050 con 0x5621d3df4f20 2023-07-14T13:17:47.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.879+0000 7fd44999a700 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621d3df4f20 0x5621d3df7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:47.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd44999a700 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621d3df4f20 0x5621d3df7330 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2571c4998a7e0a94 server_cookie=bc24810f909b4cce in_seq=0 out_seq=0 2023-07-14T13:17:47.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd42dffb700 10 client.28306 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:47.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd42dffb700 1 -- 172.21.15.17:0/4247687026 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5621d3c8b050 con 0x5621d3df4f20 2023-07-14T13:17:47.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd42dffb700 10 client.28306 handle_command_reply: tid=0 2023-07-14T13:17:47.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd45fdb6b80 1 client.28306 shutdown 2023-07-14T13:17:47.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/4247687026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 msgr2=0x5621d3d953a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d953a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd440006010 tx=0x7fd44000bf50 comp rx=0 tx=0).stop 2023-07-14T13:17:47.926 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/4247687026 shutdown_connections 2023-07-14T13:17:47.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621d3df4f20 0x5621d3df7330 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621d3d88ad0 0x5621d3d95e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621d3d7d2d0 0x5621d3d953a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd42dffb700 0 client.28306 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:47.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd45fdb6b80 1 --2- 172.21.15.17:0/4247687026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621d3d7dbe0 0x5621d3d958e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/4247687026 >> 172.21.15.17:0/4247687026 conn(0x5621d3d73da0 msgr2=0x5621d3d80a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/4247687026 shutdown_connections 2023-07-14T13:17:47.927 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.880+0000 7fd45fdb6b80 1 -- 172.21.15.17:0/4247687026 wait complete. 2023-07-14T13:17:47.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd45fdb6b80 20 client.28306 trim_cache size 0 max 16384 2023-07-14T13:17:47.928 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:17:47.928 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 -- 172.21.15.17:0/2503235892 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4300a12c0 msgr2=0x7fd4300a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4300a12c0 0x7fd4300a3770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd43c009ec0 tx=0x7fd43c009920 comp rx=0 tx=0).stop 2023-07-14T13:17:47.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 -- 172.21.15.17:0/2503235892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd444100d00 msgr2=0x7fd4440fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:47.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd444100d00 0x7fd4440fe950 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd440005740 tx=0x7fd440005770 comp rx=0 tx=0).stop 2023-07-14T13:17:47.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 -- 172.21.15.17:0/2503235892 shutdown_connections 2023-07-14T13:17:47.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd4300a12c0 0x7fd4300a3770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd44410a040 0x7fd4441a3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.929 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd444100d00 0x7fd4440fe950 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 --2- 172.21.15.17:0/2503235892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444101610 0x7fd4440fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 -- 172.21.15.17:0/2503235892 >> 172.21.15.17:0/2503235892 conn(0x7fd4440fa4b0 msgr2=0x7fd44410c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 -- 172.21.15.17:0/2503235892 shutdown_connections 2023-07-14T13:17:47.930 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:47.881+0000 7fd44c3ff700 1 -- 172.21.15.17:0/2503235892 wait complete. 2023-07-14T13:17:48.941 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:17:48.942 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:17:49.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.157+0000 7f79ee1ff700 1 -- 172.21.15.17:0/97653390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e80728b0 msgr2=0x7f79e8072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.157+0000 7f79ee1ff700 1 --2- 172.21.15.17:0/97653390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e80728b0 0x7f79e8072c80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009990 tx=0x7f79d8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.157+0000 7f79ee1ff700 1 -- 172.21.15.17:0/97653390 shutdown_connections 2023-07-14T13:17:49.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.157+0000 7f79ee1ff700 1 --2- 172.21.15.17:0/97653390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e8110ae0 0x7f79e8112ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.197 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.157+0000 7f79ee1ff700 1 --2- 172.21.15.17:0/97653390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e80728b0 0x7f79e8072c80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.157+0000 7f79ee1ff700 1 --2- 172.21.15.17:0/97653390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79e80731c0 0x7f79e81105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.157+0000 7f79ee1ff700 1 -- 172.21.15.17:0/97653390 >> 172.21.15.17:0/97653390 conn(0x7f79e80fb5f0 msgr2=0x7f79e80fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.157+0000 7f79ee1ff700 1 -- 172.21.15.17:0/97653390 shutdown_connections 2023-07-14T13:17:49.198 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.157+0000 7f79ee1ff700 1 -- 172.21.15.17:0/97653390 wait complete. 2023-07-14T13:17:49.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.158+0000 7f79ee1ff700 1 Processor -- start 2023-07-14T13:17:49.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.158+0000 7f79ee1ff700 1 -- start start 2023-07-14T13:17:49.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.158+0000 7f79ee1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e80728b0 0x7f79e819c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79ee1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e80731c0 0x7f79e819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79ee1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79e8110ae0 0x7f79e81a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79ee1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e81a11b0 con 0x7f79e80731c0 2023-07-14T13:17:49.200 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79ee1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e81a1320 con 0x7f79e8110ae0 2023-07-14T13:17:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79ee1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e81a14e0 con 0x7f79e80728b0 2023-07-14T13:17:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79e6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e80731c0 0x7f79e819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79e6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e80731c0 0x7f79e819c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49376/0 (socket says 172.21.15.17:49376) 2023-07-14T13:17:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79e6ffd700 1 -- 172.21.15.17:0/3036411616 learned_addr learned my addr 172.21.15.17:0/3036411616 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79e77fe700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e80728b0 0x7f79e819c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79e7fff700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79e8110ae0 0x7f79e81a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.201 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79e6ffd700 1 -- 172.21.15.17:0/3036411616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e80728b0 msgr2=0x7f79e819c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79e6ffd700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e80728b0 0x7f79e819c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79e6ffd700 1 -- 172.21.15.17:0/3036411616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79e8110ae0 msgr2=0x7f79e81a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79e6ffd700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79e8110ae0 0x7f79e81a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.159+0000 7f79e6ffd700 1 -- 172.21.15.17:0/3036411616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0009c40 con 0x7f79e80731c0 2023-07-14T13:17:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.160+0000 7f79e6ffd700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e80731c0 0x7f79e819c710 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00e9a0 tx=0x7f79dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.160+0000 7f79e4ff9700 1 -- 172.21.15.17:0/3036411616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc009790 con 0x7f79e80731c0 2023-07-14T13:17:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.160+0000 7f79ee1ff700 1 -- 172.21.15.17:0/3036411616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d80095f0 con 0x7f79e80731c0 2023-07-14T13:17:49.202 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.160+0000 7f79e4ff9700 1 -- 172.21.15.17:0/3036411616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79dc00cbd0 con 0x7f79e80731c0 2023-07-14T13:17:49.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.160+0000 7f79e4ff9700 1 -- 172.21.15.17:0/3036411616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc018680 con 0x7f79e80731c0 2023-07-14T13:17:49.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.160+0000 7f79ee1ff700 1 -- 172.21.15.17:0/3036411616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e81a19b0 con 0x7f79e80731c0 2023-07-14T13:17:49.203 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.164+0000 7f79e4ff9700 1 -- 172.21.15.17:0/3036411616 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f79dc00cd40 con 0x7f79e80731c0 2023-07-14T13:17:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.166+0000 7f7a01ab4b80 1 Processor -- start 2023-07-14T13:17:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.166+0000 7f79e4ff9700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79d00a12c0 0x7f79d00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.166+0000 7f7a01ab4b80 1 -- start start 2023-07-14T13:17:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.166+0000 7f79e4ff9700 1 -- 172.21.15.17:0/3036411616 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f79dc014070 con 0x7f79e80731c0 2023-07-14T13:17:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.167+0000 7f79e7fff700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79d00a12c0 0x7f79d00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.167+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54a7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.167+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7c60 0x55f4f54b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.167+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54b2b50 0x55f4f54b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.167+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f53add30 con 0x55f4f54a7c60 2023-07-14T13:17:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.167+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5400ac0 con 0x55f4f54b2b50 2023-07-14T13:17:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.167+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f53f9f50 con 0x55f4f54a7350 2023-07-14T13:17:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.167+0000 7f79e6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7c60 0x55f4f54b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.167+0000 7f79e6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7c60 0x55f4f54b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49384/0 (socket says 172.21.15.17:49384) 2023-07-14T13:17:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.167+0000 7f79e6ffd700 1 -- 172.21.15.17:0/2657010120 learned_addr learned my addr 172.21.15.17:0/2657010120 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.167+0000 7f79e77fe700 1 --2- 172.21.15.17:0/2657010120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54a7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.168+0000 7f79e7fff700 1 --2- 172.21.15.17:0/2657010120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54b2b50 0x55f4f54b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.168+0000 7f79e77fe700 1 -- 172.21.15.17:0/2657010120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54b2b50 msgr2=0x55f4f54b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.168+0000 7f79e77fe700 1 --2- 172.21.15.17:0/2657010120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54b2b50 0x55f4f54b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.168+0000 7f79e77fe700 1 -- 172.21.15.17:0/2657010120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7c60 msgr2=0x55f4f54b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.168+0000 7f79e77fe700 1 --2- 172.21.15.17:0/2657010120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7c60 0x55f4f54b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.168+0000 7f79e77fe700 1 -- 172.21.15.17:0/2657010120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f5227e60 con 0x55f4f54a7350 2023-07-14T13:17:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.168+0000 7f79e7fff700 1 --2- 172.21.15.17:0/2657010120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54b2b50 0x55f4f54b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:17:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.168+0000 7f79e7fff700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79d00a12c0 0x7f79d00a3770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f79e8069aa0 tx=0x7f79e0009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.168+0000 7f79e77fe700 1 --2- 172.21.15.17:0/2657010120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54a7720 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f79d80098e0 tx=0x7f79d8005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ccf2f4c791882e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.169+0000 7f79cdffb700 1 -- 172.21.15.17:0/2657010120 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d801d070 con 0x55f4f54a7350 2023-07-14T13:17:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.169+0000 7f79cdffb700 1 -- 172.21.15.17:0/2657010120 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79d801e040 con 0x55f4f54a7350 2023-07-14T13:17:49.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.169+0000 7f79cdffb700 1 -- 172.21.15.17:0/2657010120 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8004760 con 0x55f4f54a7350 2023-07-14T13:17:49.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.170+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/2657010120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 msgr2=0x55f4f54a7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.170+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/2657010120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54a7720 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f79d80098e0 tx=0x7f79d8005f00 comp rx=0 tx=0).stop 2023-07-14T13:17:49.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.170+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/2657010120 shutdown_connections 2023-07-14T13:17:49.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.170+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/2657010120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54b2b50 0x55f4f54b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.170+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/2657010120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54a7720 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.170+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/2657010120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7c60 0x55f4f54b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.170+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/2657010120 >> 172.21.15.17:0/2657010120 conn(0x55f4f549de20 msgr2=0x55f4f54a3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.170+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/2657010120 shutdown_connections 2023-07-14T13:17:49.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.170+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/2657010120 wait complete. 2023-07-14T13:17:49.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.171+0000 7f7a01ab4b80 1 -- start start 2023-07-14T13:17:49.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.171+0000 7f7a01ab4b80 1 Processor -- start 2023-07-14T13:17:49.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.172+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7350 0x55f4f54b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.172+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.172+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54b2b50 0x55f4f54afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.172+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5399b40 con 0x55f4f54a7350 2023-07-14T13:17:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.172+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5399840 con 0x55f4f54a7c60 2023-07-14T13:17:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.172+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f527d9a0 con 0x55f4f54b2b50 2023-07-14T13:17:49.214 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.172+0000 7f7a01ab4b80 10 client.0 _ll_register_callbacks cb 0x55f4f53977e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.172+0000 7f79e77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7350 0x55f4f54b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.173+0000 7f79e77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7350 0x55f4f54b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49386/0 (socket says 172.21.15.17:49386) 2023-07-14T13:17:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.173+0000 7f79e77fe700 1 -- 172.21.15.17:0/1044547557 learned_addr learned my addr 172.21.15.17:0/1044547557 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.173+0000 7f79e6ffd700 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.173+0000 7f79e7fff700 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54b2b50 0x55f4f54afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.173+0000 7f79e6ffd700 1 -- 172.21.15.17:0/1044547557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54b2b50 msgr2=0x55f4f54afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.173+0000 7f79e6ffd700 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54b2b50 0x55f4f54afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.173+0000 7f79e6ffd700 1 -- 172.21.15.17:0/1044547557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7350 msgr2=0x55f4f54b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.173+0000 7f79e6ffd700 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7350 0x55f4f54b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.173+0000 7f79e6ffd700 1 -- 172.21.15.17:0/1044547557 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e8113780 con 0x55f4f54a7c60 2023-07-14T13:17:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.173+0000 7f79e6ffd700 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54af7d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f79dc096590 tx=0x7f79dc099a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b219622078b367f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.217 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.173+0000 7f79c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:17:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.174+0000 7f79c6ffd700 1 -- 172.21.15.17:0/1044547557 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc09e0c0 con 0x55f4f54a7c60 2023-07-14T13:17:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.174+0000 7f79c6ffd700 1 -- 172.21.15.17:0/1044547557 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f79dc0a24e0 con 0x55f4f54a7c60 2023-07-14T13:17:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.174+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/1044547557 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4f5353570 con 0x55f4f54a7c60 2023-07-14T13:17:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.174+0000 7f79c6ffd700 1 -- 172.21.15.17:0/1044547557 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79dc0b82a0 con 0x55f4f54a7c60 2023-07-14T13:17:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.174+0000 7f7a01ab4b80 10 client.28346 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.174+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/1044547557 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55f4f5210ce0 con 0x55f4f54a7c60 2023-07-14T13:17:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.174+0000 7f79c6ffd700 1 -- 172.21.15.17:0/1044547557 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f4f5353570 con 0x55f4f54a7c60 2023-07-14T13:17:49.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.175+0000 7f79c6ffd700 1 -- 172.21.15.17:0/1044547557 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f79dc0a20e0 con 0x55f4f54a7c60 2023-07-14T13:17:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.175+0000 7f7a01ab4b80 10 client.28346 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.175+0000 7f7a01ab4b80 10 client.28346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.175+0000 7f7a01ab4b80 20 client.28346 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.175+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f54c2390 0x55f4f54c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.175+0000 7f7a01ab4b80 4 client.28346 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:17:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.175+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/1044547557 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4f53f2f30 con 0x55f4f54c2390 2023-07-14T13:17:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.175+0000 7f79e77fe700 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f54c2390 0x55f4f54c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.176+0000 7f79e77fe700 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f54c2390 0x55f4f54c47a0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fc5ac2fb6416ca7 server_cookie=952035001670b682 in_seq=0 out_seq=0 2023-07-14T13:17:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.176+0000 7f79c6ffd700 10 client.28346 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f79c6ffd700 1 -- 172.21.15.17:0/1044547557 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f4f53f2f30 con 0x55f4f54c2390 2023-07-14T13:17:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f79c6ffd700 10 client.28346 handle_command_reply: tid=0 2023-07-14T13:17:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 1 client.28346 shutdown 2023-07-14T13:17:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/1044547557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 msgr2=0x55f4f54af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54af7d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f79dc096590 tx=0x7f79dc099a70 comp rx=0 tx=0).stop 2023-07-14T13:17:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/1044547557 shutdown_connections 2023-07-14T13:17:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f54c2390 0x55f4f54c47a0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54b2b50 0x55f4f54afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54a7350 0x55f4f54b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f79c6ffd700 0 client.28346 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/1044547557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54af7d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/1044547557 >> 172.21.15.17:0/1044547557 conn(0x55f4f549de20 msgr2=0x55f4f54a3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/1044547557 shutdown_connections 2023-07-14T13:17:49.222 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/1044547557 wait complete. 2023-07-14T13:17:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.177+0000 7f7a01ab4b80 20 client.28346 trim_cache size 0 max 16384 2023-07-14T13:17:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.198+0000 7f7a01ab4b80 1 Processor -- start 2023-07-14T13:17:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.198+0000 7f7a01ab4b80 1 -- start start 2023-07-14T13:17:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.199+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54a3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.199+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54a3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.199+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.199+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f54a85c0 con 0x55f4f54b2b50 2023-07-14T13:17:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.199+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f54b0d40 con 0x55f4f54a7c60 2023-07-14T13:17:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.199+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f549d9f0 con 0x55f4f54a7350 2023-07-14T13:17:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.199+0000 7f79e7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.199+0000 7f79e7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49398/0 (socket says 172.21.15.17:49398) 2023-07-14T13:17:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.199+0000 7f79e7fff700 1 -- 172.21.15.17:0/2926045851 learned_addr learned my addr 172.21.15.17:0/2926045851 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.199+0000 7f79e77fe700 1 --2- 172.21.15.17:0/2926045851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.241 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.199+0000 7f79e6ffd700 1 --2- 172.21.15.17:0/2926045851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.200+0000 7f79e77fe700 1 -- 172.21.15.17:0/2926045851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 msgr2=0x55f4f54a3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.200+0000 7f79e77fe700 1 --2- 172.21.15.17:0/2926045851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54a3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.200+0000 7f79e77fe700 1 -- 172.21.15.17:0/2926045851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 msgr2=0x55f4f54aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.200+0000 7f79e77fe700 1 --2- 172.21.15.17:0/2926045851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.200+0000 7f79e77fe700 1 -- 172.21.15.17:0/2926045851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f524e2d0 con 0x55f4f54a7350 2023-07-14T13:17:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.200+0000 7f79e7fff700 1 --2- 172.21.15.17:0/2926045851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:49.242 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.200+0000 7f79e77fe700 1 --2- 172.21.15.17:0/2926045851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54a3250 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55f4f54c5050 tx=0x7f79d801a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a567204c95593277 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.200+0000 7f79ce7fc700 1 -- 172.21.15.17:0/2926045851 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d801d040 con 0x55f4f54a7350 2023-07-14T13:17:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.201+0000 7f79ce7fc700 1 -- 172.21.15.17:0/2926045851 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79d80355d0 con 0x55f4f54a7350 2023-07-14T13:17:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.201+0000 7f79ce7fc700 1 -- 172.21.15.17:0/2926045851 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800bce0 con 0x55f4f54a7350 2023-07-14T13:17:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.201+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/2926045851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 msgr2=0x55f4f54a3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.201+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/2926045851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54a3250 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55f4f54c5050 tx=0x7f79d801a040 comp rx=0 tx=0).stop 2023-07-14T13:17:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.201+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/2926045851 shutdown_connections 2023-07-14T13:17:49.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.201+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/2926045851 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.201+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/2926045851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54a3250 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.201+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/2926045851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.201+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/2926045851 >> 172.21.15.17:0/2926045851 conn(0x55f4f549de20 msgr2=0x55f4f54aaab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.202+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/2926045851 shutdown_connections 2023-07-14T13:17:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.202+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/2926045851 wait complete. 2023-07-14T13:17:49.244 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.202+0000 7f7a01ab4b80 1 -- start start 2023-07-14T13:17:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.202+0000 7f7a01ab4b80 1 Processor -- start 2023-07-14T13:17:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f7a01ab4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5516310 con 0x55f4f54b2b50 2023-07-14T13:17:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5516480 con 0x55f4f54a7c60 2023-07-14T13:17:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f7a01ab4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5516640 con 0x55f4f54a7350 2023-07-14T13:17:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f7a01ab4b80 10 client.0 _ll_register_callbacks cb 0x7f79dc0ca6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f79e7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f79e7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49408/0 (socket says 172.21.15.17:49408) 2023-07-14T13:17:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f79e7fff700 1 -- 172.21.15.17:0/3678763906 learned_addr learned my addr 172.21.15.17:0/3678763906 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f79e6ffd700 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.203+0000 7f79e77fe700 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.204+0000 7f79e77fe700 1 -- 172.21.15.17:0/3678763906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 msgr2=0x55f4f54b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.204+0000 7f79e77fe700 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.204+0000 7f79e77fe700 1 -- 172.21.15.17:0/3678763906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 msgr2=0x55f4f54b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.204+0000 7f79e77fe700 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.204+0000 7f79e77fe700 1 -- 172.21.15.17:0/3678763906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e0017470 con 0x55f4f54a7350 2023-07-14T13:17:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.204+0000 7f79e7fff700 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.204+0000 7f79e77fe700 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54b5d20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c010 tx=0x7f79d8005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fc0a57c425ff44e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.204+0000 7f79c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:17:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.205+0000 7f79c6ffd700 1 -- 172.21.15.17:0/3678763906 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d801d070 con 0x55f4f54a7350 2023-07-14T13:17:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.205+0000 7f79c6ffd700 1 -- 172.21.15.17:0/3678763906 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f79d8032070 con 0x55f4f54a7350 2023-07-14T13:17:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.205+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/3678763906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79d801e040 con 0x55f4f54a7350 2023-07-14T13:17:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.205+0000 7f79c6ffd700 1 -- 172.21.15.17:0/3678763906 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79d800b710 con 0x55f4f54a7350 2023-07-14T13:17:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.205+0000 7f7a01ab4b80 10 client.28324 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.205+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/3678763906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55f4f5227e60 con 0x55f4f54a7350 2023-07-14T13:17:49.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.205+0000 7f79c6ffd700 1 -- 172.21.15.17:0/3678763906 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79d801e040 con 0x55f4f54a7350 2023-07-14T13:17:49.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.206+0000 7f79c6ffd700 1 -- 172.21.15.17:0/3678763906 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f79d8004700 con 0x55f4f54a7350 2023-07-14T13:17:49.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.206+0000 7f7a01ab4b80 10 client.28324 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:49.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.206+0000 7f7a01ab4b80 10 client.28324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:49.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.206+0000 7f7a01ab4b80 20 client.28324 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:49.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.206+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5517890 0x55f4f5519c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.206+0000 7f7a01ab4b80 4 client.28324 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:17:49.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.206+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/3678763906 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f4f53b50d0 con 0x55f4f5517890 2023-07-14T13:17:49.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.206+0000 7f79e6ffd700 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5517890 0x55f4f5519c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.207+0000 7f79e6ffd700 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5517890 0x55f4f5519c70 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc54fa368c9d9956 server_cookie=3219ef2540e00808 in_seq=0 out_seq=0 2023-07-14T13:17:49.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.207+0000 7f79c6ffd700 10 client.28324 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:49.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.208+0000 7f79c6ffd700 1 -- 172.21.15.17:0/3678763906 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f4f53b50d0 con 0x55f4f5517890 2023-07-14T13:17:49.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.208+0000 7f79c6ffd700 10 client.28324 handle_command_reply: tid=0 2023-07-14T13:17:49.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.208+0000 7f7a01ab4b80 1 client.28324 shutdown 2023-07-14T13:17:49.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/3678763906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 msgr2=0x55f4f54b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54b5d20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c010 tx=0x7f79d8005f10 comp rx=0 tx=0).stop 2023-07-14T13:17:49.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/3678763906 shutdown_connections 2023-07-14T13:17:49.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5517890 0x55f4f5519c70 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f54b2b50 0x55f4f54b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f54a7350 0x55f4f54b5d20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f7a01ab4b80 1 --2- 172.21.15.17:0/3678763906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f54a7c60 0x55f4f54b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/3678763906 >> 172.21.15.17:0/3678763906 conn(0x55f4f549de20 msgr2=0x55f4f54a2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f79c6ffd700 0 client.28324 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:49.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/3678763906 shutdown_connections 2023-07-14T13:17:49.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f7a01ab4b80 1 -- 172.21.15.17:0/3678763906 wait complete. 2023-07-14T13:17:49.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.209+0000 7f7a01ab4b80 20 client.28324 trim_cache size 0 max 16384 2023-07-14T13:17:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:17:49.254 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:17:49.254 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "d60f8a15-b7ac-44be-8521-29bdfa0b0b38", 2023-07-14T13:17:49.255 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:17:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:17:49.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.210+0000 7f79ee1ff700 1 -- 172.21.15.17:0/3036411616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79d00a12c0 msgr2=0x7f79d00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.210+0000 7f79ee1ff700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79d00a12c0 0x7f79d00a3770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f79e8069aa0 tx=0x7f79e0009920 comp rx=0 tx=0).stop 2023-07-14T13:17:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.210+0000 7f79ee1ff700 1 -- 172.21.15.17:0/3036411616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e80731c0 msgr2=0x7f79e819c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.210+0000 7f79ee1ff700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e80731c0 0x7f79e819c710 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00e9a0 tx=0x7f79dc00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.210+0000 7f79ee1ff700 1 -- 172.21.15.17:0/3036411616 shutdown_connections 2023-07-14T13:17:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.210+0000 7f79ee1ff700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79d00a12c0 0x7f79d00a3770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.210+0000 7f79ee1ff700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79e8110ae0 0x7f79e81a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.210+0000 7f79ee1ff700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79e80728b0 0x7f79e819c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.210+0000 7f79ee1ff700 1 --2- 172.21.15.17:0/3036411616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79e80731c0 0x7f79e819c710 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.210+0000 7f79ee1ff700 1 -- 172.21.15.17:0/3036411616 >> 172.21.15.17:0/3036411616 conn(0x7f79e80fb5f0 msgr2=0x7f79e80fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.211+0000 7f79ee1ff700 1 -- 172.21.15.17:0/3036411616 shutdown_connections 2023-07-14T13:17:49.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.211+0000 7f79ee1ff700 1 -- 172.21.15.17:0/3036411616 wait complete. 2023-07-14T13:17:49.277 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:49 smithi017 ceph-mon[95536]: pgmap v569: 97 pgs: 97 active+clean; 16 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 21 MiB/s wr, 110 op/s 2023-07-14T13:17:49.280 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:17:49.506 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:49 smithi131 ceph-mon[96953]: pgmap v569: 97 pgs: 97 active+clean; 16 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 21 MiB/s wr, 110 op/s 2023-07-14T13:17:49.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.496+0000 7f687adff700 1 -- 172.21.15.17:0/2940749009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68740728b0 msgr2=0x7f6874072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.496+0000 7f687adff700 1 --2- 172.21.15.17:0/2940749009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68740728b0 0x7f6874072c80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f68680098f0 tx=0x7f6868009c00 comp rx=0 tx=0).stop 2023-07-14T13:17:49.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.496+0000 7f687adff700 1 -- 172.21.15.17:0/2940749009 shutdown_connections 2023-07-14T13:17:49.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.496+0000 7f687adff700 1 --2- 172.21.15.17:0/2940749009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6874110ae0 0x7f6874112ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.496+0000 7f687adff700 1 --2- 172.21.15.17:0/2940749009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68740728b0 0x7f6874072c80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.496+0000 7f687adff700 1 --2- 172.21.15.17:0/2940749009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68740731c0 0x7f68741105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.496+0000 7f687adff700 1 -- 172.21.15.17:0/2940749009 >> 172.21.15.17:0/2940749009 conn(0x7f68740fb5f0 msgr2=0x7f68740fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.496+0000 7f687adff700 1 -- 172.21.15.17:0/2940749009 shutdown_connections 2023-07-14T13:17:49.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.497+0000 7f687adff700 1 -- 172.21.15.17:0/2940749009 wait complete. 2023-07-14T13:17:49.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.498+0000 7f687adff700 1 Processor -- start 2023-07-14T13:17:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.498+0000 7f687adff700 1 -- start start 2023-07-14T13:17:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.498+0000 7f687adff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68740728b0 0x7f687419c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.498+0000 7f687adff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68740731c0 0x7f687419c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.498+0000 7f687adff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6874110ae0 0x7f68741a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.498+0000 7f687adff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68741a1210 con 0x7f68740731c0 2023-07-14T13:17:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.498+0000 7f687adff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68741a1380 con 0x7f68740728b0 2023-07-14T13:17:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.498+0000 7f687adff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68741a1540 con 0x7f6874110ae0 2023-07-14T13:17:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.499+0000 7f6873fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68740731c0 0x7f687419c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.499+0000 7f6873fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68740731c0 0x7f687419c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49426/0 (socket says 172.21.15.17:49426) 2023-07-14T13:17:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.499+0000 7f6873fff700 1 -- 172.21.15.17:0/1946774962 learned_addr learned my addr 172.21.15.17:0/1946774962 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.499+0000 7f687939c700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6874110ae0 0x7f68741a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.499+0000 7f6878b9b700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68740728b0 0x7f687419c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.499+0000 7f6873fff700 1 -- 172.21.15.17:0/1946774962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6874110ae0 msgr2=0x7f68741a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.499+0000 7f6873fff700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6874110ae0 0x7f68741a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.499+0000 7f6873fff700 1 -- 172.21.15.17:0/1946774962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68740728b0 msgr2=0x7f687419c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.499+0000 7f6873fff700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68740728b0 0x7f687419c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.499+0000 7f6873fff700 1 -- 172.21.15.17:0/1946774962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68600095f0 con 0x7f68740731c0 2023-07-14T13:17:49.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.500+0000 7f6873fff700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68740731c0 0x7f687419c770 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f686000ec10 tx=0x7f686000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.500+0000 7f6871ffb700 1 -- 172.21.15.17:0/1946774962 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000cc90 con 0x7f68740731c0 2023-07-14T13:17:49.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.500+0000 7f6871ffb700 1 -- 172.21.15.17:0/1946774962 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f686000cdf0 con 0x7f68740731c0 2023-07-14T13:17:49.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.500+0000 7f687adff700 1 -- 172.21.15.17:0/1946774962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6868009520 con 0x7f68740731c0 2023-07-14T13:17:49.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.500+0000 7f6871ffb700 1 -- 172.21.15.17:0/1946774962 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860003e80 con 0x7f68740731c0 2023-07-14T13:17:49.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.500+0000 7f687adff700 1 -- 172.21.15.17:0/1946774962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68741a1a10 con 0x7f68740731c0 2023-07-14T13:17:49.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.503+0000 7f6871ffb700 1 -- 172.21.15.17:0/1946774962 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6860004000 con 0x7f68740731c0 2023-07-14T13:17:49.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.505+0000 7f6871ffb700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68640a1340 0x7f68640a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.505+0000 7f6871ffb700 1 -- 172.21.15.17:0/1946774962 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6860014070 con 0x7f68740731c0 2023-07-14T13:17:49.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.505+0000 7f6878b9b700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68640a1340 0x7f68640a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.506+0000 7f688e7bfb80 1 Processor -- start 2023-07-14T13:17:49.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.506+0000 7f688e7bfb80 1 -- start start 2023-07-14T13:17:49.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.506+0000 7f6878b9b700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68640a1340 0x7f68640a37f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6868005e90 tx=0x7f6868019040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.506+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad726232d0 0x55ad726236a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.506+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad7262e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.506+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7262ead0 0x55ad72630eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.506+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72529cb0 con 0x55ad72623be0 2023-07-14T13:17:49.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.506+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7257ca40 con 0x55ad7262ead0 2023-07-14T13:17:49.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.506+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72575ed0 con 0x55ad726232d0 2023-07-14T13:17:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.507+0000 7f6873fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad7262e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.507+0000 7f6873fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad7262e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49438/0 (socket says 172.21.15.17:49438) 2023-07-14T13:17:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.507+0000 7f6873fff700 1 -- 172.21.15.17:0/3582188592 learned_addr learned my addr 172.21.15.17:0/3582188592 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.507+0000 7f687939c700 1 --2- 172.21.15.17:0/3582188592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7262ead0 0x55ad72630eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.507+0000 7f6878b9b700 1 --2- 172.21.15.17:0/3582188592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad726232d0 0x55ad726236a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.507+0000 7f6873fff700 1 -- 172.21.15.17:0/3582188592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad726232d0 msgr2=0x55ad726236a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.507+0000 7f6873fff700 1 --2- 172.21.15.17:0/3582188592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad726232d0 0x55ad726236a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.507+0000 7f6873fff700 1 -- 172.21.15.17:0/3582188592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7262ead0 msgr2=0x55ad72630eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.507+0000 7f6873fff700 1 --2- 172.21.15.17:0/3582188592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7262ead0 0x55ad72630eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.507+0000 7f6873fff700 1 -- 172.21.15.17:0/3582188592 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad723a3de0 con 0x55ad72623be0 2023-07-14T13:17:49.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.507+0000 7f6873fff700 1 --2- 172.21.15.17:0/3582188592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad7262e590 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6860005d70 tx=0x7f6860099e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6e61edd205dd29 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.508+0000 7f685effd700 1 -- 172.21.15.17:0/3582188592 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686009a190 con 0x55ad72623be0 2023-07-14T13:17:49.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.508+0000 7f685effd700 1 -- 172.21.15.17:0/3582188592 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68600ade90 con 0x55ad72623be0 2023-07-14T13:17:49.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.508+0000 7f685effd700 1 -- 172.21.15.17:0/3582188592 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68600042b0 con 0x55ad72623be0 2023-07-14T13:17:49.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.508+0000 7f688e7bfb80 1 -- 172.21.15.17:0/3582188592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 msgr2=0x55ad7262e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.508+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/3582188592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad7262e590 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6860005d70 tx=0x7f6860099e00 comp rx=0 tx=0).stop 2023-07-14T13:17:49.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.509+0000 7f688e7bfb80 1 -- 172.21.15.17:0/3582188592 shutdown_connections 2023-07-14T13:17:49.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.509+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/3582188592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7262ead0 0x55ad72630eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.509+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/3582188592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad726232d0 0x55ad726236a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.509+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/3582188592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad7262e590 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.509+0000 7f688e7bfb80 1 -- 172.21.15.17:0/3582188592 >> 172.21.15.17:0/3582188592 conn(0x55ad72619da0 msgr2=0x55ad7261f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.509+0000 7f688e7bfb80 1 -- 172.21.15.17:0/3582188592 shutdown_connections 2023-07-14T13:17:49.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.509+0000 7f688e7bfb80 1 -- 172.21.15.17:0/3582188592 wait complete. 2023-07-14T13:17:49.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.509+0000 7f688e7bfb80 1 -- start start 2023-07-14T13:17:49.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.510+0000 7f688e7bfb80 1 Processor -- start 2023-07-14T13:17:49.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.510+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad726232d0 0x55ad7262b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.510+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72623be0 0x55ad7262bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.510+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7262ead0 0x55ad7262c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.510+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72515ac0 con 0x55ad7262ead0 2023-07-14T13:17:49.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.510+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad725157c0 con 0x55ad72623be0 2023-07-14T13:17:49.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.510+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad723f9920 con 0x55ad726232d0 2023-07-14T13:17:49.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.510+0000 7f688e7bfb80 10 client.0 _ll_register_callbacks cb 0x55ad72513760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:49.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f687939c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7262ead0 0x55ad7262c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f687939c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7262ead0 0x55ad7262c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49450/0 (socket says 172.21.15.17:49450) 2023-07-14T13:17:49.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f687939c700 1 -- 172.21.15.17:0/4197721637 learned_addr learned my addr 172.21.15.17:0/4197721637 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:49.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f6873fff700 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72623be0 0x55ad7262bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f6878b9b700 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad726232d0 0x55ad7262b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f687939c700 1 -- 172.21.15.17:0/4197721637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad726232d0 msgr2=0x55ad7262b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f687939c700 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad726232d0 0x55ad7262b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f687939c700 1 -- 172.21.15.17:0/4197721637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72623be0 msgr2=0x55ad7262bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f687939c700 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72623be0 0x55ad7262bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f687939c700 1 -- 172.21.15.17:0/4197721637 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68741a1a10 con 0x55ad7262ead0 2023-07-14T13:17:49.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f6873fff700 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72623be0 0x55ad7262bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:49.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f687939c700 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7262ead0 0x55ad7262c310 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f686c011ef0 tx=0x7f686c014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ec69e184887e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.511+0000 7f6853fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:17:49.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.512+0000 7f6853fff700 1 -- 172.21.15.17:0/4197721637 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c00e040 con 0x55ad7262ead0 2023-07-14T13:17:49.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.512+0000 7f688e7bfb80 1 -- 172.21.15.17:0/4197721637 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad724cf4f0 con 0x55ad7262ead0 2023-07-14T13:17:49.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.512+0000 7f6853fff700 1 -- 172.21.15.17:0/4197721637 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f686c0093a0 con 0x55ad7262ead0 2023-07-14T13:17:49.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.512+0000 7f6853fff700 1 -- 172.21.15.17:0/4197721637 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f686c014ce0 con 0x55ad7262ead0 2023-07-14T13:17:49.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.512+0000 7f688e7bfb80 10 client.18666 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:49.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.512+0000 7f688e7bfb80 1 -- 172.21.15.17:0/4197721637 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55ad7238cc60 con 0x55ad7262ead0 2023-07-14T13:17:49.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.512+0000 7f6853fff700 1 -- 172.21.15.17:0/4197721637 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ad724cf4f0 con 0x55ad7262ead0 2023-07-14T13:17:49.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.513+0000 7f6853fff700 1 -- 172.21.15.17:0/4197721637 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f686c01c020 con 0x55ad7262ead0 2023-07-14T13:17:49.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.513+0000 7f688e7bfb80 10 client.18666 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:49.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.513+0000 7f688e7bfb80 10 client.18666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:49.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.513+0000 7f688e7bfb80 20 client.18666 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:49.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.513+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ad7263e510 0x55ad72640920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.513+0000 7f688e7bfb80 4 client.18666 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:17:49.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.513+0000 7f688e7bfb80 1 -- 172.21.15.17:0/4197721637 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad7256eeb0 con 0x55ad7263e510 2023-07-14T13:17:49.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.513+0000 7f6878b9b700 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ad7263e510 0x55ad72640920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.514+0000 7f6853fff700 10 client.18666 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:49.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.514+0000 7f6878b9b700 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ad7263e510 0x55ad72640920 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d22d1be5d66d4c2 server_cookie=af0a6db5ef2a9959 in_seq=0 out_seq=0 2023-07-14T13:17:49.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f6853fff700 1 -- 172.21.15.17:0/4197721637 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ad7256eeb0 con 0x55ad7263e510 2023-07-14T13:17:49.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f6853fff700 10 client.18666 handle_command_reply: tid=0 2023-07-14T13:17:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f688e7bfb80 1 client.18666 shutdown 2023-07-14T13:17:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f688e7bfb80 1 -- 172.21.15.17:0/4197721637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7262ead0 msgr2=0x55ad7262c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7262ead0 0x55ad7262c310 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f686c011ef0 tx=0x7f686c014600 comp rx=0 tx=0).stop 2023-07-14T13:17:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f688e7bfb80 1 -- 172.21.15.17:0/4197721637 shutdown_connections 2023-07-14T13:17:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ad7263e510 0x55ad72640920 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7262ead0 0x55ad7262c310 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f6853fff700 0 client.18666 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad726232d0 0x55ad7262b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/4197721637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72623be0 0x55ad7262bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f688e7bfb80 1 -- 172.21.15.17:0/4197721637 >> 172.21.15.17:0/4197721637 conn(0x55ad72619da0 msgr2=0x55ad7261f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f688e7bfb80 1 -- 172.21.15.17:0/4197721637 shutdown_connections 2023-07-14T13:17:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.515+0000 7f688e7bfb80 1 -- 172.21.15.17:0/4197721637 wait complete. 2023-07-14T13:17:49.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.516+0000 7f688e7bfb80 20 client.18666 trim_cache size 0 max 16384 2023-07-14T13:17:49.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.541+0000 7f688e7bfb80 1 Processor -- start 2023-07-14T13:17:49.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.541+0000 7f688e7bfb80 1 -- start start 2023-07-14T13:17:49.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad726232d0 0x55ad726354e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad72623be0 0x55ad7262b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7262ead0 0x55ad72628b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72629df0 con 0x55ad726232d0 2023-07-14T13:17:49.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72627460 con 0x55ad7262ead0 2023-07-14T13:17:49.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72635a20 con 0x55ad72623be0 2023-07-14T13:17:49.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f6878b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad726232d0 0x55ad726354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f6873fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad72623be0 0x55ad7262b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f687939c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7262ead0 0x55ad72628b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f6878b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad726232d0 0x55ad726354e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49452/0 (socket says 172.21.15.17:49452) 2023-07-14T13:17:49.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f6873fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad72623be0 0x55ad7262b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60872/0 (socket says 172.21.15.17:60872) 2023-07-14T13:17:49.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.542+0000 7f6878b9b700 1 -- 172.21.15.17:0/1548786817 learned_addr learned my addr 172.21.15.17:0/1548786817 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:49.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.543+0000 7f687939c700 1 -- 172.21.15.17:0/1548786817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad72623be0 msgr2=0x55ad7262b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.543+0000 7f687939c700 1 --2- 172.21.15.17:0/1548786817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad72623be0 0x55ad7262b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.543+0000 7f687939c700 1 -- 172.21.15.17:0/1548786817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad726232d0 msgr2=0x55ad726354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.543+0000 7f687939c700 1 --2- 172.21.15.17:0/1548786817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad726232d0 0x55ad726354e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.543+0000 7f687939c700 1 -- 172.21.15.17:0/1548786817 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad723ca250 con 0x55ad7262ead0 2023-07-14T13:17:49.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.543+0000 7f6873fff700 1 --2- 172.21.15.17:0/1548786817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad72623be0 0x55ad7262b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:49.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.543+0000 7f687939c700 1 --2- 172.21.15.17:0/1548786817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7262ead0 0x55ad72628b00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f686c0045a0 tx=0x7f686c0093a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2671027a70f011a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.543+0000 7f685f7fe700 1 -- 172.21.15.17:0/1548786817 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c00e070 con 0x55ad7262ead0 2023-07-14T13:17:49.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.543+0000 7f685f7fe700 1 -- 172.21.15.17:0/1548786817 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f686c00f040 con 0x55ad7262ead0 2023-07-14T13:17:49.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.543+0000 7f685f7fe700 1 -- 172.21.15.17:0/1548786817 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c007570 con 0x55ad7262ead0 2023-07-14T13:17:49.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.544+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1548786817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7262ead0 msgr2=0x55ad72628b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.544+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/1548786817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7262ead0 0x55ad72628b00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f686c0045a0 tx=0x7f686c0093a0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.544+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1548786817 shutdown_connections 2023-07-14T13:17:49.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.544+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/1548786817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7262ead0 0x55ad72628b00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.544+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/1548786817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad726232d0 0x55ad726354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.544+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/1548786817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad72623be0 0x55ad7262b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.544+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1548786817 >> 172.21.15.17:0/1548786817 conn(0x55ad72619da0 msgr2=0x55ad7263a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.544+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1548786817 shutdown_connections 2023-07-14T13:17:49.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.544+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1548786817 wait complete. 2023-07-14T13:17:49.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.545+0000 7f688e7bfb80 1 -- start start 2023-07-14T13:17:49.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.545+0000 7f688e7bfb80 1 Processor -- start 2023-07-14T13:17:49.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.545+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad726232d0 0x55ad72634fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.545+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad726354e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.545+0000 7f688e7bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7262ead0 0x55ad72633460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.545+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72633b70 con 0x55ad72623be0 2023-07-14T13:17:49.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.545+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72633ce0 con 0x55ad726232d0 2023-07-14T13:17:49.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.545+0000 7f688e7bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72633ea0 con 0x55ad7262ead0 2023-07-14T13:17:49.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.545+0000 7f688e7bfb80 10 client.0 _ll_register_callbacks cb 0x7f686c011820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:49.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.546+0000 7f6873fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad726354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.546+0000 7f6873fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad726354e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49464/0 (socket says 172.21.15.17:49464) 2023-07-14T13:17:49.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.546+0000 7f6873fff700 1 -- 172.21.15.17:0/1808113212 learned_addr learned my addr 172.21.15.17:0/1808113212 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:49.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.546+0000 7f6878b9b700 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad726232d0 0x55ad72634fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.546+0000 7f687939c700 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7262ead0 0x55ad72633460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.546+0000 7f6873fff700 1 -- 172.21.15.17:0/1808113212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7262ead0 msgr2=0x55ad72633460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.546+0000 7f6873fff700 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7262ead0 0x55ad72633460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.546+0000 7f6873fff700 1 -- 172.21.15.17:0/1808113212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad726232d0 msgr2=0x55ad72634fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:49.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.546+0000 7f6873fff700 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad726232d0 0x55ad72634fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.546+0000 7f6873fff700 1 -- 172.21.15.17:0/1808113212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad723a3de0 con 0x55ad72623be0 2023-07-14T13:17:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.546+0000 7f6878b9b700 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad726232d0 0x55ad72634fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.547+0000 7f6873fff700 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad726354e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f686009e130 tx=0x7f6860009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3f4f1f4fcdd27c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.547+0000 7f6853fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:17:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.547+0000 7f6853fff700 1 -- 172.21.15.17:0/1808113212 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686009a5f0 con 0x55ad72623be0 2023-07-14T13:17:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.547+0000 7f6853fff700 1 -- 172.21.15.17:0/1808113212 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f68600a25e0 con 0x55ad72623be0 2023-07-14T13:17:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.547+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1808113212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68600ade90 con 0x55ad72623be0 2023-07-14T13:17:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.547+0000 7f6853fff700 1 -- 172.21.15.17:0/1808113212 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6860099680 con 0x55ad72623be0 2023-07-14T13:17:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.547+0000 7f688e7bfb80 10 client.18672 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.547+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1808113212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55ad7238cc60 con 0x55ad72623be0 2023-07-14T13:17:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.547+0000 7f6853fff700 1 -- 172.21.15.17:0/1808113212 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68600ade90 con 0x55ad72623be0 2023-07-14T13:17:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.548+0000 7f6853fff700 1 -- 172.21.15.17:0/1808113212 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f68600b8300 con 0x55ad72623be0 2023-07-14T13:17:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.548+0000 7f688e7bfb80 10 client.18672 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.548+0000 7f688e7bfb80 10 client.18672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.548+0000 7f688e7bfb80 20 client.18672 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:49.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.548+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ad726933b0 0x55ad726957c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:49.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.548+0000 7f688e7bfb80 4 client.18672 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:17:49.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.548+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1808113212 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ad72531050 con 0x55ad726933b0 2023-07-14T13:17:49.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.548+0000 7f6878b9b700 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ad726933b0 0x55ad726957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f6853fff700 10 client.18672 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f6878b9b700 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ad726933b0 0x55ad726957c0 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aa7baf6892a98ef server_cookie=55c8fa3ba426264a in_seq=0 out_seq=0 2023-07-14T13:17:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f6853fff700 1 -- 172.21.15.17:0/1808113212 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ad72531050 con 0x55ad726933b0 2023-07-14T13:17:49.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f6853fff700 10 client.18672 handle_command_reply: tid=0 2023-07-14T13:17:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f688e7bfb80 1 client.18672 shutdown 2023-07-14T13:17:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1808113212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 msgr2=0x55ad726354e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad726354e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f686009e130 tx=0x7f6860009ab0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1808113212 shutdown_connections 2023-07-14T13:17:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ad726933b0 0x55ad726957c0 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7262ead0 0x55ad72633460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad726232d0 0x55ad72634fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f688e7bfb80 1 --2- 172.21.15.17:0/1808113212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad72623be0 0x55ad726354e0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1808113212 >> 172.21.15.17:0/1808113212 conn(0x55ad72619da0 msgr2=0x55ad7262d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f6853fff700 0 client.18672 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:49.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.549+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1808113212 shutdown_connections 2023-07-14T13:17:49.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.550+0000 7f688e7bfb80 1 -- 172.21.15.17:0/1808113212 wait complete. 2023-07-14T13:17:49.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.550+0000 7f688e7bfb80 20 client.18672 trim_cache size 0 max 16384 2023-07-14T13:17:49.597 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:17:49.598 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:17:49.598 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:17:49.598 INFO:teuthology.orchestra.run.smithi017.stdout: "d60f8a15-b7ac-44be-8521-29bdfa0b0b38": { 2023-07-14T13:17:49.598 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:17:49.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "d60f8a15-b7ac-44be-8521-29bdfa0b0b38", 2023-07-14T13:17:49.598 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:17:49.598 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:17:49.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:17:49.599 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:17:49.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.550+0000 7f687adff700 1 -- 172.21.15.17:0/1946774962 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68640a1340 msgr2=0x7f68640a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.599 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.550+0000 7f687adff700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68640a1340 0x7f68640a37f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6868005e90 tx=0x7f6868019040 comp rx=0 tx=0).stop 2023-07-14T13:17:49.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.550+0000 7f687adff700 1 -- 172.21.15.17:0/1946774962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68740731c0 msgr2=0x7f687419c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:49.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.550+0000 7f687adff700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68740731c0 0x7f687419c770 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f686000ec10 tx=0x7f686000ef20 comp rx=0 tx=0).stop 2023-07-14T13:17:49.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.550+0000 7f687adff700 1 -- 172.21.15.17:0/1946774962 shutdown_connections 2023-07-14T13:17:49.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.550+0000 7f687adff700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f68640a1340 0x7f68640a37f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.550+0000 7f687adff700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6874110ae0 0x7f68741a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.550+0000 7f687adff700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68740728b0 0x7f687419c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.600 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.550+0000 7f687adff700 1 --2- 172.21.15.17:0/1946774962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68740731c0 0x7f687419c770 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:49.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.551+0000 7f687adff700 1 -- 172.21.15.17:0/1946774962 >> 172.21.15.17:0/1946774962 conn(0x7f68740fb5f0 msgr2=0x7f68740fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:49.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.551+0000 7f687adff700 1 -- 172.21.15.17:0/1946774962 shutdown_connections 2023-07-14T13:17:49.601 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:17:49.551+0000 7f687adff700 1 -- 172.21.15.17:0/1946774962 wait complete. 2023-07-14T13:17:49.610 INFO:tasks.cephfs.filesystem:scrub status for tag:d60f8a15-b7ac-44be-8521-29bdfa0b0b38 - {'path': '/', 'tag': 'd60f8a15-b7ac-44be-8521-29bdfa0b0b38', 'options': 'recursive,force'} 2023-07-14T13:17:49.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:49 smithi135 ceph-mon[97338]: pgmap v569: 97 pgs: 97 active+clean; 16 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 21 MiB/s wr, 110 op/s 2023-07-14T13:17:50.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:50 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:17:50.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:50 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:50 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:17:50.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:50 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:17:50.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:50 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:17:50.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:50 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:50 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:17:50.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:50 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:50 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:50 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:50 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:17:50.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:50 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:50 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:17:50.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:50 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:17:50.708 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:50 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:17:50.709 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:50 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.709 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:50 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:17:50.709 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:50 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.709 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:50 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.709 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:50 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:50 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:17:50.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:50 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:50 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:17:50.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:50 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:17:50.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:50 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:17:50.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:50 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.757 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:50 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:17:50.758 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:50 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.758 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:50 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:50.758 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:50 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:17:51.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:51 smithi017 ceph-mon[95536]: pgmap v570: 97 pgs: 97 active+clean; 16 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 35 MiB/s wr, 246 op/s 2023-07-14T13:17:51.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:51 smithi135 ceph-mon[97338]: pgmap v570: 97 pgs: 97 active+clean; 16 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 35 MiB/s wr, 246 op/s 2023-07-14T13:17:51.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:51 smithi131 ceph-mon[96953]: pgmap v570: 97 pgs: 97 active+clean; 16 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 35 MiB/s wr, 246 op/s 2023-07-14T13:17:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.204+0000 7ff4e9fff700 1 -- 172.21.15.17:0/241561124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e4104e50 msgr2=0x7ff4e410ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.204+0000 7ff4e9fff700 1 --2- 172.21.15.17:0/241561124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e4104e50 0x7ff4e410ca00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00b0d0 tx=0x7ff4dc00b3e0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.204+0000 7ff4e9fff700 1 -- 172.21.15.17:0/241561124 shutdown_connections 2023-07-14T13:17:53.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.204+0000 7ff4e9fff700 1 --2- 172.21.15.17:0/241561124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e4104e50 0x7ff4e410ca00 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.204+0000 7ff4e9fff700 1 --2- 172.21.15.17:0/241561124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e4067c10 0x7ff4e4067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.204+0000 7ff4e9fff700 1 --2- 172.21.15.17:0/241561124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4e40685b0 0x7ff4e4104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.204+0000 7ff4e9fff700 1 -- 172.21.15.17:0/241561124 >> 172.21.15.17:0/241561124 conn(0x7ff4e4074760 msgr2=0x7ff4e4074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.204+0000 7ff4e9fff700 1 -- 172.21.15.17:0/241561124 shutdown_connections 2023-07-14T13:17:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.204+0000 7ff4e9fff700 1 -- 172.21.15.17:0/241561124 wait complete. 2023-07-14T13:17:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.205+0000 7ff4e9fff700 1 Processor -- start 2023-07-14T13:17:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.206+0000 7ff4e9fff700 1 -- start start 2023-07-14T13:17:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.206+0000 7ff4e9fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e4067c10 0x7ff4e4197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.206+0000 7ff4e9fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e40685b0 0x7ff4e41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.206+0000 7ff4e9fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4e4104e50 0x7ff4e419ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.206+0000 7ff4e9fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e419d0a0 con 0x7ff4e4067c10 2023-07-14T13:17:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.206+0000 7ff4e9fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e419d210 con 0x7ff4e4104e50 2023-07-14T13:17:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.206+0000 7ff4e9fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e419d3d0 con 0x7ff4e40685b0 2023-07-14T13:17:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.206+0000 7ff4e37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e4067c10 0x7ff4e4197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.206+0000 7ff4e37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e4067c10 0x7ff4e4197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49474/0 (socket says 172.21.15.17:49474) 2023-07-14T13:17:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.206+0000 7ff4e37fe700 1 -- 172.21.15.17:0/850795326 learned_addr learned my addr 172.21.15.17:0/850795326 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.206+0000 7ff4e3fff700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4e4104e50 0x7ff4e419ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.207+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e40685b0 0x7ff4e41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.207+0000 7ff4e37fe700 1 -- 172.21.15.17:0/850795326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e40685b0 msgr2=0x7ff4e41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.207+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e40685b0 0x7ff4e41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.207+0000 7ff4e37fe700 1 -- 172.21.15.17:0/850795326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4e4104e50 msgr2=0x7ff4e419ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.207+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4e4104e50 0x7ff4e419ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.207+0000 7ff4e37fe700 1 -- 172.21.15.17:0/850795326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc009d00 con 0x7ff4e4067c10 2023-07-14T13:17:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.207+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e4067c10 0x7ff4e4197eb0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400e9a0 tx=0x7ff4d400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.207+0000 7ff4e0ff9700 1 -- 172.21.15.17:0/850795326 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4009790 con 0x7ff4e4067c10 2023-07-14T13:17:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.207+0000 7ff4e0ff9700 1 -- 172.21.15.17:0/850795326 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4d400cbd0 con 0x7ff4e4067c10 2023-07-14T13:17:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.207+0000 7ff4e0ff9700 1 -- 172.21.15.17:0/850795326 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4018680 con 0x7ff4e4067c10 2023-07-14T13:17:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.208+0000 7ff4e9fff700 1 -- 172.21.15.17:0/850795326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e419d6b0 con 0x7ff4e4067c10 2023-07-14T13:17:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.208+0000 7ff4e9fff700 1 -- 172.21.15.17:0/850795326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e41a4ef0 con 0x7ff4e4067c10 2023-07-14T13:17:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.211+0000 7ff4e0ff9700 1 -- 172.21.15.17:0/850795326 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff4d400cd40 con 0x7ff4e4067c10 2023-07-14T13:17:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.213+0000 7ff4e0ff9700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff4cc0a1340 0x7ff4cc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.213+0000 7ff4e0ff9700 1 -- 172.21.15.17:0/850795326 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff4d4014070 con 0x7ff4e4067c10 2023-07-14T13:17:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.214+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff4cc0a1340 0x7ff4cc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.214+0000 7ff4fd8d8b80 1 Processor -- start 2023-07-14T13:17:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.214+0000 7ff4fd8d8b80 1 -- start start 2023-07-14T13:17:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.214+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff4cc0a1340 0x7ff4cc0a37f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff4e41996d0 tx=0x7ff4d8009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.214+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.214+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0aa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.214+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0aad90 0x55fbfd0ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.214+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfcfa7c50 con 0x55fbfcefe6b0 2023-07-14T13:17:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.214+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfcffa9e0 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.214+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfcff3e70 con 0x55fbfd0aad90 2023-07-14T13:17:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0aad90 0x55fbfd0ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0aad90 0x55fbfd0ab1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60926/0 (socket says 172.21.15.17:60926) 2023-07-14T13:17:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49490/0 (socket says 172.21.15.17:49490) 2023-07-14T13:17:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e3fff700 1 -- 172.21.15.17:0/2196853304 learned_addr learned my addr 172.21.15.17:0/2196853304 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:53.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/2196853304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e2ffd700 1 -- 172.21.15.17:0/2196853304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0aad90 msgr2=0x55fbfd0ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:53.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/2196853304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0aad90 0x55fbfd0ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e2ffd700 1 -- 172.21.15.17:0/2196853304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfcefe6b0 msgr2=0x55fbfd0b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:53.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/2196853304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e2ffd700 1 -- 172.21.15.17:0/2196853304 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbfce21d80 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.215+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/2196853304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.216+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/2196853304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0aa850 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40733d0 tx=0x7ff4d8013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=126b93595f7fb8eb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.216+0000 7ff4c9ffb700 1 -- 172.21.15.17:0/2196853304 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8011aa0 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.216+0000 7ff4c9ffb700 1 -- 172.21.15.17:0/2196853304 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4d8015070 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.216+0000 7ff4c9ffb700 1 -- 172.21.15.17:0/2196853304 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d801c3b0 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.217+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/2196853304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 msgr2=0x55fbfd0aa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.217+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/2196853304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0aa850 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40733d0 tx=0x7ff4d8013000 comp rx=0 tx=0).stop 2023-07-14T13:17:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.217+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/2196853304 shutdown_connections 2023-07-14T13:17:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.217+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/2196853304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0aad90 0x55fbfd0ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.217+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/2196853304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.217+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/2196853304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0aa850 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.217+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/2196853304 >> 172.21.15.17:0/2196853304 conn(0x55fbfd097be0 msgr2=0x55fbfd09cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.217+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/2196853304 shutdown_connections 2023-07-14T13:17:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.217+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/2196853304 wait complete. 2023-07-14T13:17:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.218+0000 7ff4fd8d8b80 1 -- start start 2023-07-14T13:17:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.218+0000 7ff4fd8d8b80 1 Processor -- start 2023-07-14T13:17:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfcf93a60 con 0x55fbfd0aad90 2023-07-14T13:17:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfcf93760 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfce778c0 con 0x55fbfcefe6b0 2023-07-14T13:17:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4fd8d8b80 10 client.0 _ll_register_callbacks cb 0x55fbfcf91700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34758/0 (socket says 172.21.15.17:34758) 2023-07-14T13:17:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e3fff700 1 -- 172.21.15.17:0/672452388 learned_addr learned my addr 172.21.15.17:0/672452388 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e3fff700 1 -- 172.21.15.17:0/672452388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfcefe6b0 msgr2=0x55fbfd0b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e3fff700 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0b6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e3fff700 1 -- 172.21.15.17:0/672452388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 msgr2=0x55fbfd0b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e3fff700 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e3fff700 1 -- 172.21.15.17:0/672452388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e41a4ef0 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:17:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4e3fff700 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0b47a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00bd00 tx=0x7ff4dc00bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd0edf8e42b66067 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.220+0000 7ff4c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:17:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.221+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/672452388 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc00e040 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.221+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/672452388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fbfcf4d490 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.221+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/672452388 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff4dc003a00 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.221+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/672452388 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4dc0078f0 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.221+0000 7ff4fd8d8b80 10 client.28382 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.221+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/672452388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7ff4d8010a00 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.221+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/672452388 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fbfcf4d490 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.222+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/672452388 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff4dc023020 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.222+0000 7ff4fd8d8b80 10 client.28382 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.222+0000 7ff4fd8d8b80 10 client.28382 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.222+0000 7ff4fd8d8b80 20 client.28382 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.222+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55fbfd0c43b0 0x55fbfd0c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.222+0000 7ff4fd8d8b80 4 client.28382 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:17:53.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.222+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/672452388 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fbfcfece50 con 0x55fbfd0c43b0 2023-07-14T13:17:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.222+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55fbfd0c43b0 0x55fbfd0c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.223+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55fbfd0c43b0 0x55fbfd0c67c0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8954dafa1ebfd58 server_cookie=b245c4f7bbf89bbe in_seq=0 out_seq=0 2023-07-14T13:17:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.223+0000 7ff4c2ffd700 10 client.28382 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/672452388 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fbfcfece50 con 0x55fbfd0c43b0 2023-07-14T13:17:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4c2ffd700 10 client.28382 handle_command_reply: tid=0 2023-07-14T13:17:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4fd8d8b80 1 client.28382 shutdown 2023-07-14T13:17:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/672452388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 msgr2=0x55fbfd0b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0b47a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00bd00 tx=0x7ff4dc00bde0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/672452388 shutdown_connections 2023-07-14T13:17:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55fbfd0c43b0 0x55fbfd0c67c0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0b47a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4c2ffd700 0 client.28382 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/672452388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.224+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/672452388 >> 172.21.15.17:0/672452388 conn(0x55fbfd097be0 msgr2=0x55fbfd09bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.225+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/672452388 shutdown_connections 2023-07-14T13:17:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.225+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/672452388 wait complete. 2023-07-14T13:17:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.225+0000 7ff4fd8d8b80 20 client.28382 trim_cache size 0 max 16384 2023-07-14T13:17:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.244+0000 7ff4fd8d8b80 1 Processor -- start 2023-07-14T13:17:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4fd8d8b80 1 -- start start 2023-07-14T13:17:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0aa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0af980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd09cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfd0b5690 con 0x55fbfd0aad90 2023-07-14T13:17:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfd0995f0 con 0x55fbfcefe6b0 2023-07-14T13:17:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfd0b2630 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4e2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4e37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4e37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0aa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34770/0 (socket says 172.21.15.17:34770) 2023-07-14T13:17:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4e37fe700 1 -- 172.21.15.17:0/3687411933 learned_addr learned my addr 172.21.15.17:0/3687411933 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4e2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0af980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49512/0 (socket says 172.21.15.17:49512) 2023-07-14T13:17:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.245+0000 7ff4e3fff700 1 --2- 172.21.15.17:0/3687411933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd09cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.246+0000 7ff4e37fe700 1 -- 172.21.15.17:0/3687411933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0b0ae0 msgr2=0x55fbfd09cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.246+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/3687411933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd09cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.246+0000 7ff4e37fe700 1 -- 172.21.15.17:0/3687411933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 msgr2=0x55fbfd0af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.246+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/3687411933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.246+0000 7ff4e37fe700 1 -- 172.21.15.17:0/3687411933 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbfce0ac00 con 0x55fbfcefe6b0 2023-07-14T13:17:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.246+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/3687411933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0aa850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4099f70 tx=0x7ff4d4095c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44e1e011fef54875 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.246+0000 7ff4ca7fc700 1 -- 172.21.15.17:0/3687411933 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40a2430 con 0x55fbfcefe6b0 2023-07-14T13:17:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.246+0000 7ff4ca7fc700 1 -- 172.21.15.17:0/3687411933 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4d4098380 con 0x55fbfcefe6b0 2023-07-14T13:17:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.246+0000 7ff4ca7fc700 1 -- 172.21.15.17:0/3687411933 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4099730 con 0x55fbfcefe6b0 2023-07-14T13:17:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.247+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/3687411933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 msgr2=0x55fbfd0aa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.247+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/3687411933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0aa850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4099f70 tx=0x7ff4d4095c80 comp rx=0 tx=0).stop 2023-07-14T13:17:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.247+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/3687411933 shutdown_connections 2023-07-14T13:17:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.247+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/3687411933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd09cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.247+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/3687411933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0aa850 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.247+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/3687411933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.247+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/3687411933 >> 172.21.15.17:0/3687411933 conn(0x55fbfd097be0 msgr2=0x55fbfd0af270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.247+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/3687411933 shutdown_connections 2023-07-14T13:17:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.247+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/3687411933 wait complete. 2023-07-14T13:17:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.248+0000 7ff4fd8d8b80 1 -- start start 2023-07-14T13:17:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.248+0000 7ff4fd8d8b80 1 Processor -- start 2023-07-14T13:17:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.248+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0bb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.248+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.248+0000 7ff4fd8d8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.248+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfd0ba1d0 con 0x55fbfd0aad90 2023-07-14T13:17:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.248+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfd0ba340 con 0x55fbfcefe6b0 2023-07-14T13:17:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.248+0000 7ff4fd8d8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbfd0ba500 con 0x55fbfd0b0ae0 2023-07-14T13:17:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4fd8d8b80 10 client.0 _ll_register_callbacks cb 0x7ff4dc009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:17:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e2ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0b96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49514/0 (socket says 172.21.15.17:49514) 2023-07-14T13:17:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e2ffd700 1 -- 172.21.15.17:0/1407531006 learned_addr learned my addr 172.21.15.17:0/1407531006 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:17:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e3fff700 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0bb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e2ffd700 1 -- 172.21.15.17:0/1407531006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0b0ae0 msgr2=0x55fbfd0b9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0b9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e2ffd700 1 -- 172.21.15.17:0/1407531006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 msgr2=0x55fbfd0bb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:17:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0bb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e2ffd700 1 -- 172.21.15.17:0/1407531006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e419d6b0 con 0x55fbfd0aad90 2023-07-14T13:17:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e3fff700 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0b9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.249+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0bb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:17:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.250+0000 7ff4e2ffd700 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0b96c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x55fbfd09eb40 tx=0x7ff4d8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9265c8da6773cc0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:17:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.250+0000 7ff4c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:17:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.250+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/1407531006 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d801e8f0 con 0x55fbfd0aad90 2023-07-14T13:17:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.250+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/1407531006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff4d8015070 con 0x55fbfd0aad90 2023-07-14T13:17:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.250+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/1407531006 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff4d8017070 con 0x55fbfd0aad90 2023-07-14T13:17:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.250+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/1407531006 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4d801ea50 con 0x55fbfd0aad90 2023-07-14T13:17:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.250+0000 7ff4fd8d8b80 10 client.18687 fetch_fsmap learned FSMap version 47 2023-07-14T13:17:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.250+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/1407531006 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55fbfce481f0 con 0x55fbfd0aad90 2023-07-14T13:17:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.251+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/1407531006 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4d803e020 con 0x55fbfd0aad90 2023-07-14T13:17:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.251+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/1407531006 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 47) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff4d8031b50 con 0x55fbfd0aad90 2023-07-14T13:17:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.251+0000 7ff4fd8d8b80 10 client.18687 fetch_fsmap finished waiting for FSMap version 47 2023-07-14T13:17:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.251+0000 7ff4fd8d8b80 10 client.18687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:17:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.251+0000 7ff4fd8d8b80 20 client.18687 populate_metadata read hostname 'smithi017' 2023-07-14T13:17:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.251+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55fbfd1198b0 0x55fbfd11bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:17:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.251+0000 7ff4fd8d8b80 4 client.18687 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:17:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.251+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/1407531006 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fbfcfaeff0 con 0x55fbfd1198b0 2023-07-14T13:17:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.252+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55fbfd1198b0 0x55fbfd11bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:17:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.252+0000 7ff4c2ffd700 10 client.18687 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.252+0000 7ff4e37fe700 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55fbfd1198b0 0x55fbfd11bcc0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28d530f5e5aeb64b server_cookie=94556dd117e6151c in_seq=0 out_seq=0 2023-07-14T13:17:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4c2ffd700 1 -- 172.21.15.17:0/1407531006 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fbfcfaeff0 con 0x55fbfd1198b0 2023-07-14T13:17:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4c2ffd700 10 client.18687 handle_command_reply: tid=0 2023-07-14T13:17:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 1 client.18687 shutdown 2023-07-14T13:17:53.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/1407531006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 msgr2=0x55fbfd0b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0b96c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x55fbfd09eb40 tx=0x7ff4d8010800 comp rx=0 tx=0).stop 2023-07-14T13:17:53.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/1407531006 shutdown_connections 2023-07-14T13:17:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55fbfd1198b0 0x55fbfd11bcc0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fbfd0b0ae0 0x55fbfd0b9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbfcefe6b0 0x55fbfd0bb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4c2ffd700 0 client.18687 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:17:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 1 --2- 172.21.15.17:0/1407531006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55fbfd0aad90 0x55fbfd0b96c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/1407531006 >> 172.21.15.17:0/1407531006 conn(0x55fbfd097be0 msgr2=0x55fbfd0afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:53.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/1407531006 shutdown_connections 2023-07-14T13:17:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 1 -- 172.21.15.17:0/1407531006 wait complete. 2023-07-14T13:17:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.269+0000 7ff4fd8d8b80 20 client.18687 trim_cache size 0 max 16384 2023-07-14T13:17:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:17:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:17:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:17:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:17:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 -- 172.21.15.17:0/850795326 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff4cc0a1340 msgr2=0x7ff4cc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff4cc0a1340 0x7ff4cc0a37f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff4e41996d0 tx=0x7ff4d8009260 comp rx=0 tx=0).stop 2023-07-14T13:17:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 -- 172.21.15.17:0/850795326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e4067c10 msgr2=0x7ff4e4197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:17:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e4067c10 0x7ff4e4197eb0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400e9a0 tx=0x7ff4d400ecb0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 -- 172.21.15.17:0/850795326 shutdown_connections 2023-07-14T13:17:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff4cc0a1340 0x7ff4cc0a37f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4e4104e50 0x7ff4e419ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4e4067c10 0x7ff4e4197eb0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 --2- 172.21.15.17:0/850795326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e40685b0 0x7ff4e41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:17:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 -- 172.21.15.17:0/850795326 >> 172.21.15.17:0/850795326 conn(0x7ff4e4074760 msgr2=0x7ff4e40fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:17:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 -- 172.21.15.17:0/850795326 shutdown_connections 2023-07-14T13:17:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:17:53.270+0000 7ff4e9fff700 1 -- 172.21.15.17:0/850795326 wait complete. 2023-07-14T13:17:53.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:53 smithi017 ceph-mon[95536]: pgmap v571: 97 pgs: 97 active+clean; 16 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 26 MiB/s wr, 204 op/s 2023-07-14T13:17:53.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:53 smithi135 ceph-mon[97338]: pgmap v571: 97 pgs: 97 active+clean; 16 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 26 MiB/s wr, 204 op/s 2023-07-14T13:17:53.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:53 smithi131 ceph-mon[96953]: pgmap v571: 97 pgs: 97 active+clean; 16 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 26 MiB/s wr, 204 op/s 2023-07-14T13:17:55.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:55 smithi017 ceph-mon[95536]: pgmap v572: 97 pgs: 97 active+clean; 16 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 26 MiB/s wr, 204 op/s 2023-07-14T13:17:55.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:55 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:17:55.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:55 smithi135 ceph-mon[97338]: pgmap v572: 97 pgs: 97 active+clean; 16 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 26 MiB/s wr, 204 op/s 2023-07-14T13:17:55.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:55 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:17:55.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:55 smithi131 ceph-mon[96953]: pgmap v572: 97 pgs: 97 active+clean; 16 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 26 MiB/s wr, 204 op/s 2023-07-14T13:17:55.756 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:55 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:17:57.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:57 smithi017 ceph-mon[95536]: pgmap v573: 97 pgs: 97 active+clean; 16 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 39 MiB/s wr, 250 op/s 2023-07-14T13:17:57.707 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:57 smithi135 ceph-mon[97338]: pgmap v573: 97 pgs: 97 active+clean; 16 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 39 MiB/s wr, 250 op/s 2023-07-14T13:17:57.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:57 smithi131 ceph-mon[96953]: pgmap v573: 97 pgs: 97 active+clean; 16 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 39 MiB/s wr, 250 op/s 2023-07-14T13:17:59.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:17:59 smithi017 ceph-mon[95536]: pgmap v574: 97 pgs: 97 active+clean; 16 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 27 MiB/s wr, 181 op/s 2023-07-14T13:17:59.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:17:59 smithi135 ceph-mon[97338]: pgmap v574: 97 pgs: 97 active+clean; 16 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 27 MiB/s wr, 181 op/s 2023-07-14T13:17:59.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:17:59 smithi131 ceph-mon[96953]: pgmap v574: 97 pgs: 97 active+clean; 16 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 27 MiB/s wr, 181 op/s 2023-07-14T13:18:00.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:00 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:18:00.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:00 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:18:00.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:00 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:18:01.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:01 smithi017 ceph-mon[95536]: pgmap v575: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 39 MiB/s wr, 256 op/s 2023-07-14T13:18:01.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:01 smithi135 ceph-mon[97338]: pgmap v575: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 39 MiB/s wr, 256 op/s 2023-07-14T13:18:01.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:01 smithi131 ceph-mon[96953]: pgmap v575: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 39 MiB/s wr, 256 op/s 2023-07-14T13:18:02.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:02 smithi017 ceph-mon[95536]: pgmap v576: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 26 MiB/s wr, 120 op/s 2023-07-14T13:18:02.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:02 smithi135 ceph-mon[97338]: pgmap v576: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 26 MiB/s wr, 120 op/s 2023-07-14T13:18:02.755 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:02 smithi131 ceph-mon[96953]: pgmap v576: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 26 MiB/s wr, 120 op/s 2023-07-14T13:18:05.364 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:04 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:18:05.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:04 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:18:05.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:04 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:18:05.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:04 smithi017 ceph-mon[95536]: osdmap e114: 12 total, 12 up, 12 in 2023-07-14T13:18:05.365 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:04 smithi017 ceph-mon[95536]: pgmap v578: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 31 MiB/s wr, 144 op/s 2023-07-14T13:18:05.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:04 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:18:05.456 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:04 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:18:05.457 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:04 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:18:05.457 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:04 smithi135 ceph-mon[97338]: osdmap e114: 12 total, 12 up, 12 in 2023-07-14T13:18:05.457 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:04 smithi135 ceph-mon[97338]: pgmap v578: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 31 MiB/s wr, 144 op/s 2023-07-14T13:18:05.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:04 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:18:05.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:04 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:18:05.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:04 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:18:05.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:04 smithi131 ceph-mon[96953]: osdmap e114: 12 total, 12 up, 12 in 2023-07-14T13:18:05.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:04 smithi131 ceph-mon[96953]: pgmap v578: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 31 MiB/s wr, 144 op/s 2023-07-14T13:18:06.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.458+0000 7efd45dff700 1 -- 172.21.15.17:0/3259601591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd401004b0 msgr2=0x7efd4010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.458+0000 7efd45dff700 1 --2- 172.21.15.17:0/3259601591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd401004b0 0x7efd4010c940 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7efd38009990 tx=0x7efd38009ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.458+0000 7efd45dff700 1 -- 172.21.15.17:0/3259601591 shutdown_connections 2023-07-14T13:18:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.458+0000 7efd45dff700 1 --2- 172.21.15.17:0/3259601591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd401004b0 0x7efd4010c940 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.458+0000 7efd45dff700 1 --2- 172.21.15.17:0/3259601591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd40105b10 0x7efd40105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.458+0000 7efd45dff700 1 --2- 172.21.15.17:0/3259601591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd400ffb00 0x7efd400fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.458+0000 7efd45dff700 1 -- 172.21.15.17:0/3259601591 >> 172.21.15.17:0/3259601591 conn(0x7efd400fb600 msgr2=0x7efd400fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.458+0000 7efd45dff700 1 -- 172.21.15.17:0/3259601591 shutdown_connections 2023-07-14T13:18:06.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.458+0000 7efd45dff700 1 -- 172.21.15.17:0/3259601591 wait complete. 2023-07-14T13:18:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.459+0000 7efd45dff700 1 Processor -- start 2023-07-14T13:18:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.460+0000 7efd45dff700 1 -- start start 2023-07-14T13:18:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.460+0000 7efd45dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd400ffb00 0x7efd400729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.460+0000 7efd45dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd401004b0 0x7efd40072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.460+0000 7efd45dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd40105b10 0x7efd401a3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.460+0000 7efd45dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd401a4410 con 0x7efd40105b10 2023-07-14T13:18:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.460+0000 7efd45dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd401a4550 con 0x7efd400ffb00 2023-07-14T13:18:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.460+0000 7efd45dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd401a46c0 con 0x7efd401004b0 2023-07-14T13:18:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.461+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd400ffb00 0x7efd400729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.461+0000 7efd3ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd40105b10 0x7efd401a3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.461+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd400ffb00 0x7efd400729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:37902/0 (socket says 172.21.15.17:37902) 2023-07-14T13:18:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.461+0000 7efd3f7fe700 1 -- 172.21.15.17:0/1224736908 learned_addr learned my addr 172.21.15.17:0/1224736908 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.461+0000 7efd3effd700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd401004b0 0x7efd40072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.461+0000 7efd3ffff700 1 -- 172.21.15.17:0/1224736908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd401004b0 msgr2=0x7efd40072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.461+0000 7efd3ffff700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd401004b0 0x7efd40072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.461+0000 7efd3ffff700 1 -- 172.21.15.17:0/1224736908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd400ffb00 msgr2=0x7efd400729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.461+0000 7efd3ffff700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd400ffb00 0x7efd400729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.461+0000 7efd3ffff700 1 -- 172.21.15.17:0/1224736908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd380095f0 con 0x7efd40105b10 2023-07-14T13:18:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.461+0000 7efd3ffff700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd40105b10 0x7efd401a3ed0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7efd380098e0 tx=0x7efd38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.462+0000 7efd3cff9700 1 -- 172.21.15.17:0/1224736908 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3801d070 con 0x7efd40105b10 2023-07-14T13:18:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.462+0000 7efd45dff700 1 -- 172.21.15.17:0/1224736908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd401a4940 con 0x7efd40105b10 2023-07-14T13:18:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.462+0000 7efd3cff9700 1 -- 172.21.15.17:0/1224736908 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd38004c70 con 0x7efd40105b10 2023-07-14T13:18:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.462+0000 7efd3cff9700 1 -- 172.21.15.17:0/1224736908 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38005030 con 0x7efd40105b10 2023-07-14T13:18:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.462+0000 7efd45dff700 1 -- 172.21.15.17:0/1224736908 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd401a4d60 con 0x7efd40105b10 2023-07-14T13:18:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.466+0000 7efd3cff9700 1 -- 172.21.15.17:0/1224736908 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7efd38003b70 con 0x7efd40105b10 2023-07-14T13:18:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.467+0000 7efd59686b80 1 Processor -- start 2023-07-14T13:18:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.467+0000 7efd59686b80 1 -- start start 2023-07-14T13:18:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd59686b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c21d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd59686b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c222d0 0x557dd0c1c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd59686b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 0x557dd0c1c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd59686b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd0b21c50 con 0x557dd0c1c580 2023-07-14T13:18:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd59686b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd0b749e0 con 0x557dd0a786b0 2023-07-14T13:18:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd59686b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd0b6de70 con 0x557dd0c222d0 2023-07-14T13:18:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd3cff9700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd280a12c0 0x7efd280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd3cff9700 1 -- 172.21.15.17:0/1224736908 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efd380cdc90 con 0x7efd40105b10 2023-07-14T13:18:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd3effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c21d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd3effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c21d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:37910/0 (socket says 172.21.15.17:37910) 2023-07-14T13:18:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd3effd700 1 -- 172.21.15.17:0/3635651033 learned_addr learned my addr 172.21.15.17:0/3635651033 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd3effd700 1 --2- 172.21.15.17:0/3635651033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 0x557dd0c1c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.468+0000 7efd3f7fe700 1 --2- 172.21.15.17:0/3635651033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c222d0 0x557dd0c1c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.469+0000 7efd3ffff700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd280a12c0 0x7efd280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.469+0000 7efd3effd700 1 -- 172.21.15.17:0/3635651033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c222d0 msgr2=0x557dd0c1c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.469+0000 7efd3effd700 1 --2- 172.21.15.17:0/3635651033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c222d0 0x557dd0c1c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.469+0000 7efd3effd700 1 -- 172.21.15.17:0/3635651033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 msgr2=0x557dd0c1c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.469+0000 7efd3effd700 1 --2- 172.21.15.17:0/3635651033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 0x557dd0c1c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.469+0000 7efd3effd700 1 -- 172.21.15.17:0/3635651033 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dd099bd80 con 0x557dd0a786b0 2023-07-14T13:18:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.469+0000 7efd3effd700 1 --2- 172.21.15.17:0/3635651033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c21d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efd34006b30 tx=0x7efd34009590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c363389240a4691c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.469+0000 7efd3ffff700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd280a12c0 0x7efd280a3770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efd380972b0 tx=0x7efd38005940 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:06.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.469+0000 7efd25ffb700 1 -- 172.21.15.17:0/3635651033 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34018450 con 0x557dd0a786b0 2023-07-14T13:18:06.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.469+0000 7efd25ffb700 1 -- 172.21.15.17:0/3635651033 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd34018a40 con 0x557dd0a786b0 2023-07-14T13:18:06.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.469+0000 7efd25ffb700 1 -- 172.21.15.17:0/3635651033 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34013800 con 0x557dd0a786b0 2023-07-14T13:18:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.470+0000 7efd59686b80 1 -- 172.21.15.17:0/3635651033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 msgr2=0x557dd0c21d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.470+0000 7efd59686b80 1 --2- 172.21.15.17:0/3635651033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c21d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efd34006b30 tx=0x7efd34009590 comp rx=0 tx=0).stop 2023-07-14T13:18:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.470+0000 7efd59686b80 1 -- 172.21.15.17:0/3635651033 shutdown_connections 2023-07-14T13:18:06.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.470+0000 7efd59686b80 1 --2- 172.21.15.17:0/3635651033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 0x557dd0c1c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.470+0000 7efd59686b80 1 --2- 172.21.15.17:0/3635651033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c21d90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.470+0000 7efd59686b80 1 --2- 172.21.15.17:0/3635651033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c222d0 0x557dd0c1c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.470+0000 7efd59686b80 1 -- 172.21.15.17:0/3635651033 >> 172.21.15.17:0/3635651033 conn(0x557dd0c11be0 msgr2=0x557dd0c16f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.470+0000 7efd59686b80 1 -- 172.21.15.17:0/3635651033 shutdown_connections 2023-07-14T13:18:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.470+0000 7efd59686b80 1 -- 172.21.15.17:0/3635651033 wait complete. 2023-07-14T13:18:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.471+0000 7efd59686b80 1 -- start start 2023-07-14T13:18:06.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.471+0000 7efd59686b80 1 Processor -- start 2023-07-14T13:18:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.472+0000 7efd59686b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.472+0000 7efd59686b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c258c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.472+0000 7efd59686b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c222d0 0x557dd0c25f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.472+0000 7efd59686b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd0b0da60 con 0x557dd0c222d0 2023-07-14T13:18:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.472+0000 7efd59686b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd0b0d760 con 0x557dd0a786b0 2023-07-14T13:18:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.472+0000 7efd59686b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd09f18c0 con 0x557dd0c1c580 2023-07-14T13:18:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.472+0000 7efd59686b80 10 client.0 _ll_register_callbacks cb 0x557dd0b0b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:06.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.472+0000 7efd3effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.472+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c258c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.472+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c258c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:33892/0 (socket says 172.21.15.17:33892) 2023-07-14T13:18:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.472+0000 7efd3f7fe700 1 -- 172.21.15.17:0/191094324 learned_addr learned my addr 172.21.15.17:0/191094324 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.473+0000 7efd3effd700 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c222d0 0x557dd0c25f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.473+0000 7efd3f7fe700 1 -- 172.21.15.17:0/191094324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 msgr2=0x557dd0c285a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.473+0000 7efd3f7fe700 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c285a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.473+0000 7efd3f7fe700 1 -- 172.21.15.17:0/191094324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c222d0 msgr2=0x557dd0c25f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:06.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.473+0000 7efd3f7fe700 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c222d0 0x557dd0c25f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.473+0000 7efd3f7fe700 1 -- 172.21.15.17:0/191094324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd34017460 con 0x557dd0c1c580 2023-07-14T13:18:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.473+0000 7efd3f7fe700 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c258c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7efd30011ca0 tx=0x7efd30009eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=283081a9705fe405 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.473+0000 7efd1effd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:18:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.474+0000 7efd1effd700 1 -- 172.21.15.17:0/191094324 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000e040 con 0x557dd0c1c580 2023-07-14T13:18:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.474+0000 7efd59686b80 1 -- 172.21.15.17:0/191094324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557dd0ac7490 con 0x557dd0c1c580 2023-07-14T13:18:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.474+0000 7efd1effd700 1 -- 172.21.15.17:0/191094324 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efd30006e40 con 0x557dd0c1c580 2023-07-14T13:18:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.474+0000 7efd1effd700 1 -- 172.21.15.17:0/191094324 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd3000fb20 con 0x557dd0c1c580 2023-07-14T13:18:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.474+0000 7efd59686b80 10 client.28369 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.474+0000 7efd59686b80 1 -- 172.21.15.17:0/191094324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x557dd0984c00 con 0x557dd0c1c580 2023-07-14T13:18:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.476+0000 7efd1effd700 1 -- 172.21.15.17:0/191094324 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557dd0ac7490 con 0x557dd0c1c580 2023-07-14T13:18:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.476+0000 7efd1effd700 1 -- 172.21.15.17:0/191094324 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7efd3001b020 con 0x557dd0c1c580 2023-07-14T13:18:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.477+0000 7efd59686b80 10 client.28369 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.477+0000 7efd59686b80 10 client.28369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.477+0000 7efd59686b80 20 client.28369 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.477+0000 7efd59686b80 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557dd0c35c50 0x557dd0c38060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.477+0000 7efd59686b80 4 client.28369 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.477+0000 7efd59686b80 1 -- 172.21.15.17:0/191094324 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557dd0b66e50 con 0x557dd0c35c50 2023-07-14T13:18:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.477+0000 7efd3effd700 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557dd0c35c50 0x557dd0c38060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.478+0000 7efd3effd700 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557dd0c35c50 0x557dd0c38060 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7726bd98c439dbb1 server_cookie=c5314bebba1ccf55 in_seq=0 out_seq=0 2023-07-14T13:18:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.478+0000 7efd1effd700 10 client.28369 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd1effd700 1 -- 172.21.15.17:0/191094324 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557dd0b66e50 con 0x557dd0c35c50 2023-07-14T13:18:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd1effd700 10 client.28369 handle_command_reply: tid=0 2023-07-14T13:18:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd59686b80 1 client.28369 shutdown 2023-07-14T13:18:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd59686b80 1 -- 172.21.15.17:0/191094324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 msgr2=0x557dd0c258c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd59686b80 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c258c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7efd30011ca0 tx=0x7efd30009eb0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd59686b80 1 -- 172.21.15.17:0/191094324 shutdown_connections 2023-07-14T13:18:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd59686b80 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557dd0c35c50 0x557dd0c38060 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd59686b80 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c222d0 0x557dd0c25f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd59686b80 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c285a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd1effd700 0 client.28369 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd59686b80 1 --2- 172.21.15.17:0/191094324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c258c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd59686b80 1 -- 172.21.15.17:0/191094324 >> 172.21.15.17:0/191094324 conn(0x557dd0c11be0 msgr2=0x557dd0c164e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd59686b80 1 -- 172.21.15.17:0/191094324 shutdown_connections 2023-07-14T13:18:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.479+0000 7efd59686b80 1 -- 172.21.15.17:0/191094324 wait complete. 2023-07-14T13:18:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.480+0000 7efd59686b80 20 client.28369 trim_cache size 0 max 16384 2023-07-14T13:18:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.503+0000 7efd59686b80 1 Processor -- start 2023-07-14T13:18:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.503+0000 7efd59686b80 1 -- start start 2023-07-14T13:18:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.503+0000 7efd59686b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0a786b0 0x557dd0c1c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.503+0000 7efd59686b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 0x557dd0c2cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd59686b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0c222d0 0x557dd0c16c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd59686b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd0c226a0 con 0x557dd0c1c580 2023-07-14T13:18:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd59686b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd0c13d00 con 0x557dd0c222d0 2023-07-14T13:18:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd59686b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd0c17ea0 con 0x557dd0a786b0 2023-07-14T13:18:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 0x557dd0c2cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 0x557dd0c2cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51162/0 (socket says 172.21.15.17:51162) 2023-07-14T13:18:06.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd3f7fe700 1 -- 172.21.15.17:0/977564990 learned_addr learned my addr 172.21.15.17:0/977564990 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd3effd700 1 --2- 172.21.15.17:0/977564990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0c222d0 0x557dd0c16c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd3effd700 1 --2- 172.21.15.17:0/977564990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0a786b0 0x557dd0c1c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd3f7fe700 1 -- 172.21.15.17:0/977564990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0a786b0 msgr2=0x557dd0c1c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd3f7fe700 1 --2- 172.21.15.17:0/977564990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0a786b0 0x557dd0c1c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd3f7fe700 1 -- 172.21.15.17:0/977564990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0c222d0 msgr2=0x557dd0c16c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd3f7fe700 1 --2- 172.21.15.17:0/977564990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0c222d0 0x557dd0c16c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.504+0000 7efd3f7fe700 1 -- 172.21.15.17:0/977564990 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dd09c21f0 con 0x557dd0c1c580 2023-07-14T13:18:06.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.505+0000 7efd3f7fe700 1 --2- 172.21.15.17:0/977564990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 0x557dd0c2cc60 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7efd30026fd0 tx=0x7efd30009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1c41877fb3f93d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.505+0000 7efd267fc700 1 -- 172.21.15.17:0/977564990 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000e070 con 0x557dd0c1c580 2023-07-14T13:18:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.505+0000 7efd267fc700 1 -- 172.21.15.17:0/977564990 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd3000f040 con 0x557dd0c1c580 2023-07-14T13:18:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.505+0000 7efd267fc700 1 -- 172.21.15.17:0/977564990 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30015a20 con 0x557dd0c1c580 2023-07-14T13:18:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.506+0000 7efd59686b80 1 -- 172.21.15.17:0/977564990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 msgr2=0x557dd0c2cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.506+0000 7efd59686b80 1 --2- 172.21.15.17:0/977564990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 0x557dd0c2cc60 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7efd30026fd0 tx=0x7efd30009530 comp rx=0 tx=0).stop 2023-07-14T13:18:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.506+0000 7efd59686b80 1 -- 172.21.15.17:0/977564990 shutdown_connections 2023-07-14T13:18:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.506+0000 7efd59686b80 1 --2- 172.21.15.17:0/977564990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0c222d0 0x557dd0c16c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.506+0000 7efd59686b80 1 --2- 172.21.15.17:0/977564990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0a786b0 0x557dd0c1c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.506+0000 7efd59686b80 1 --2- 172.21.15.17:0/977564990 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c1c580 0x557dd0c2cc60 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.506+0000 7efd59686b80 1 -- 172.21.15.17:0/977564990 >> 172.21.15.17:0/977564990 conn(0x557dd0c11be0 msgr2=0x557dd0c1fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.506+0000 7efd59686b80 1 -- 172.21.15.17:0/977564990 shutdown_connections 2023-07-14T13:18:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.506+0000 7efd59686b80 1 -- 172.21.15.17:0/977564990 wait complete. 2023-07-14T13:18:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.507+0000 7efd59686b80 1 -- start start 2023-07-14T13:18:06.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.507+0000 7efd59686b80 1 Processor -- start 2023-07-14T13:18:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.507+0000 7efd59686b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c1ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd59686b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c1f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd59686b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c222d0 0x557dd0c1d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd59686b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd0c1dda0 con 0x557dd0c222d0 2023-07-14T13:18:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd59686b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd0c1df10 con 0x557dd0a786b0 2023-07-14T13:18:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd59686b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dd0c1e0d0 con 0x557dd0c1c580 2023-07-14T13:18:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd59686b80 10 client.0 _ll_register_callbacks cb 0x7efd300115d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c1f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd3effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c1ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd3f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c1f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:33908/0 (socket says 172.21.15.17:33908) 2023-07-14T13:18:06.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd3f7fe700 1 -- 172.21.15.17:0/1555473510 learned_addr learned my addr 172.21.15.17:0/1555473510 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd3effd700 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c222d0 0x557dd0c1d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd3f7fe700 1 -- 172.21.15.17:0/1555473510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 msgr2=0x557dd0c1ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd3f7fe700 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c1ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd3f7fe700 1 -- 172.21.15.17:0/1555473510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c222d0 msgr2=0x557dd0c1d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd3f7fe700 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c222d0 0x557dd0c1d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd3f7fe700 1 -- 172.21.15.17:0/1555473510 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557dd0984c00 con 0x557dd0c1c580 2023-07-14T13:18:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.508+0000 7efd3effd700 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c1ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:18:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.509+0000 7efd3f7fe700 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c1f160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efd30012010 tx=0x7efd3000fc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba1eaacd7e7cec9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.509+0000 7efd1effd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:18:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.509+0000 7efd1effd700 1 -- 172.21.15.17:0/1555473510 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000e040 con 0x557dd0c1c580 2023-07-14T13:18:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.509+0000 7efd59686b80 1 -- 172.21.15.17:0/1555473510 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd34018a40 con 0x557dd0c1c580 2023-07-14T13:18:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.509+0000 7efd1effd700 1 -- 172.21.15.17:0/1555473510 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efd300155a0 con 0x557dd0c1c580 2023-07-14T13:18:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.509+0000 7efd1effd700 1 -- 172.21.15.17:0/1555473510 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd30009870 con 0x557dd0c1c580 2023-07-14T13:18:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.509+0000 7efd59686b80 10 client.28375 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:06.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.509+0000 7efd59686b80 1 -- 172.21.15.17:0/1555473510 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x557dd099a250 con 0x557dd0c1c580 2023-07-14T13:18:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.510+0000 7efd1effd700 1 -- 172.21.15.17:0/1555473510 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd34018a40 con 0x557dd0c1c580 2023-07-14T13:18:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.510+0000 7efd1effd700 1 -- 172.21.15.17:0/1555473510 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7efd3002f070 con 0x557dd0c1c580 2023-07-14T13:18:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.510+0000 7efd59686b80 10 client.28375 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.510+0000 7efd59686b80 10 client.28375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.510+0000 7efd59686b80 20 client.28375 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.510+0000 7efd59686b80 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557dd0c8a570 0x557dd0c8c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:06.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.510+0000 7efd59686b80 4 client.28375 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:18:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.510+0000 7efd59686b80 1 -- 172.21.15.17:0/1555473510 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557dd0b28ff0 con 0x557dd0c8a570 2023-07-14T13:18:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.510+0000 7efd3effd700 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557dd0c8a570 0x557dd0c8c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.511+0000 7efd3effd700 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557dd0c8a570 0x557dd0c8c980 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc23c5983076f5c2 server_cookie=d3ba648e9559665c in_seq=0 out_seq=0 2023-07-14T13:18:06.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.511+0000 7efd1effd700 10 client.28375 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.527+0000 7efd1effd700 1 -- 172.21.15.17:0/1555473510 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557dd0b28ff0 con 0x557dd0c8a570 2023-07-14T13:18:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.527+0000 7efd1effd700 10 client.28375 handle_command_reply: tid=0 2023-07-14T13:18:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.527+0000 7efd59686b80 1 client.28375 shutdown 2023-07-14T13:18:06.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.527+0000 7efd59686b80 1 -- 172.21.15.17:0/1555473510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 msgr2=0x557dd0c1f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:06.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.527+0000 7efd59686b80 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c1f160 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efd30012010 tx=0x7efd3000fc50 comp rx=0 tx=0).stop 2023-07-14T13:18:06.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.528+0000 7efd59686b80 1 -- 172.21.15.17:0/1555473510 shutdown_connections 2023-07-14T13:18:06.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.528+0000 7efd59686b80 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557dd0c8a570 0x557dd0c8c980 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.528+0000 7efd59686b80 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557dd0c222d0 0x557dd0c1d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.528+0000 7efd59686b80 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557dd0a786b0 0x557dd0c1ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.528+0000 7efd59686b80 1 --2- 172.21.15.17:0/1555473510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dd0c1c580 0x557dd0c1f160 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.528+0000 7efd1effd700 0 client.28375 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:06.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.528+0000 7efd59686b80 1 -- 172.21.15.17:0/1555473510 >> 172.21.15.17:0/1555473510 conn(0x557dd0c11be0 msgr2=0x557dd0c20a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:06.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.528+0000 7efd59686b80 1 -- 172.21.15.17:0/1555473510 shutdown_connections 2023-07-14T13:18:06.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.528+0000 7efd59686b80 1 -- 172.21.15.17:0/1555473510 wait complete. 2023-07-14T13:18:06.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.528+0000 7efd59686b80 20 client.28375 trim_cache size 0 max 16384 2023-07-14T13:18:06.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:18:06.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:18:06.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:18:06.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:18:06.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 -- 172.21.15.17:0/1224736908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd280a12c0 msgr2=0x7efd280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:06.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd280a12c0 0x7efd280a3770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efd380972b0 tx=0x7efd38005940 comp rx=0 tx=0).stop 2023-07-14T13:18:06.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 -- 172.21.15.17:0/1224736908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd40105b10 msgr2=0x7efd401a3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:06.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd40105b10 0x7efd401a3ed0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7efd380098e0 tx=0x7efd38004730 comp rx=0 tx=0).stop 2023-07-14T13:18:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 -- 172.21.15.17:0/1224736908 shutdown_connections 2023-07-14T13:18:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efd280a12c0 0x7efd280a3770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd40105b10 0x7efd401a3ed0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd400ffb00 0x7efd400729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 --2- 172.21.15.17:0/1224736908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd401004b0 0x7efd40072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 -- 172.21.15.17:0/1224736908 >> 172.21.15.17:0/1224736908 conn(0x7efd400fb600 msgr2=0x7efd400fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 -- 172.21.15.17:0/1224736908 shutdown_connections 2023-07-14T13:18:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:06.529+0000 7efd45dff700 1 -- 172.21.15.17:0/1224736908 wait complete. 2023-07-14T13:18:07.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:07 smithi131 ceph-mon[96953]: pgmap v579: 97 pgs: 97 active+clean; 15 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 28 MiB/s wr, 196 op/s 2023-07-14T13:18:07.505 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:07 smithi131 ceph-mon[96953]: osdmap e115: 12 total, 12 up, 12 in 2023-07-14T13:18:07.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:07 smithi017 ceph-mon[95536]: pgmap v579: 97 pgs: 97 active+clean; 15 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 28 MiB/s wr, 196 op/s 2023-07-14T13:18:07.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:07 smithi017 ceph-mon[95536]: osdmap e115: 12 total, 12 up, 12 in 2023-07-14T13:18:07.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:07 smithi135 ceph-mon[97338]: pgmap v579: 97 pgs: 97 active+clean; 15 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 28 MiB/s wr, 196 op/s 2023-07-14T13:18:07.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:07 smithi135 ceph-mon[97338]: osdmap e115: 12 total, 12 up, 12 in 2023-07-14T13:18:09.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:09 smithi131 ceph-mon[96953]: pgmap v581: 97 pgs: 97 active+clean; 15 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 16 MiB/s wr, 132 op/s 2023-07-14T13:18:09.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:09 smithi017 ceph-mon[95536]: pgmap v581: 97 pgs: 97 active+clean; 15 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 16 MiB/s wr, 132 op/s 2023-07-14T13:18:09.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:09 smithi135 ceph-mon[97338]: pgmap v581: 97 pgs: 97 active+clean; 15 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 16 MiB/s wr, 132 op/s 2023-07-14T13:18:11.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:11 smithi131 ceph-mon[96953]: pgmap v582: 97 pgs: 97 active+clean; 16 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 35 MiB/s wr, 217 op/s 2023-07-14T13:18:11.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:11 smithi017 ceph-mon[95536]: pgmap v582: 97 pgs: 97 active+clean; 16 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 35 MiB/s wr, 217 op/s 2023-07-14T13:18:11.618 INFO:teuthology.orchestra.run.smithi017.stderr:done. 2023-07-14T13:18:11.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2023-07-14T13:18:11.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:11 smithi135 ceph-mon[97338]: pgmap v582: 97 pgs: 97 active+clean; 16 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 35 MiB/s wr, 217 op/s 2023-07-14T13:18:12.457 INFO:teuthology.orchestra.run.smithi017.stderr:starting vacuum...end. 2023-07-14T13:18:13.504 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:13 smithi131 ceph-mon[96953]: pgmap v583: 97 pgs: 97 active+clean; 16 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 34 MiB/s wr, 213 op/s 2023-07-14T13:18:13.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:13 smithi017 ceph-mon[95536]: pgmap v583: 97 pgs: 97 active+clean; 16 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 34 MiB/s wr, 213 op/s 2023-07-14T13:18:13.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:13 smithi135 ceph-mon[97338]: pgmap v583: 97 pgs: 97 active+clean; 16 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 34 MiB/s wr, 213 op/s 2023-07-14T13:18:15.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:15 smithi017 ceph-mon[95536]: pgmap v584: 97 pgs: 97 active+clean; 16 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 28 MiB/s wr, 174 op/s 2023-07-14T13:18:15.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:15 smithi135 ceph-mon[97338]: pgmap v584: 97 pgs: 97 active+clean; 16 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 28 MiB/s wr, 174 op/s 2023-07-14T13:18:15.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:15 smithi131 ceph-mon[96953]: pgmap v584: 97 pgs: 97 active+clean; 16 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 28 MiB/s wr, 174 op/s 2023-07-14T13:18:17.456 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 5.0 s, 780.8 tps, lat 114.378 ms stddev 193.796 2023-07-14T13:18:17.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:17 smithi017 ceph-mon[95536]: pgmap v585: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 22 MiB/s wr, 154 op/s 2023-07-14T13:18:17.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:17 smithi135 ceph-mon[97338]: pgmap v585: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 22 MiB/s wr, 154 op/s 2023-07-14T13:18:17.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:17 smithi131 ceph-mon[96953]: pgmap v585: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 22 MiB/s wr, 154 op/s 2023-07-14T13:18:19.611 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:18:19.618 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:19 smithi017 ceph-mon[95536]: pgmap v586: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 19 MiB/s wr, 129 op/s 2023-07-14T13:18:19.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:19 smithi135 ceph-mon[97338]: pgmap v586: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 19 MiB/s wr, 129 op/s 2023-07-14T13:18:19.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:19 smithi131 ceph-mon[96953]: pgmap v586: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 19 MiB/s wr, 129 op/s 2023-07-14T13:18:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.771+0000 7fadc71ff700 1 -- 172.21.15.17:0/891210429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadc00ffb00 msgr2=0x7fadc00fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.771+0000 7fadc71ff700 1 --2- 172.21.15.17:0/891210429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadc00ffb00 0x7fadc00fff70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009990 tx=0x7fadb0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.771+0000 7fadc71ff700 1 -- 172.21.15.17:0/891210429 shutdown_connections 2023-07-14T13:18:19.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.771+0000 7fadc71ff700 1 --2- 172.21.15.17:0/891210429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadc01004b0 0x7fadc010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.771+0000 7fadc71ff700 1 --2- 172.21.15.17:0/891210429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc0105b10 0x7fadc0105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.771+0000 7fadc71ff700 1 --2- 172.21.15.17:0/891210429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadc00ffb00 0x7fadc00fff70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.771+0000 7fadc71ff700 1 -- 172.21.15.17:0/891210429 >> 172.21.15.17:0/891210429 conn(0x7fadc00fb600 msgr2=0x7fadc00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:19.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.771+0000 7fadc71ff700 1 -- 172.21.15.17:0/891210429 shutdown_connections 2023-07-14T13:18:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.771+0000 7fadc71ff700 1 -- 172.21.15.17:0/891210429 wait complete. 2023-07-14T13:18:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.773+0000 7fadc71ff700 1 Processor -- start 2023-07-14T13:18:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.773+0000 7fadc71ff700 1 -- start start 2023-07-14T13:18:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.773+0000 7fadc71ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadc00ffb00 0x7fadc019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.774+0000 7fadc71ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc01004b0 0x7fadc019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.774+0000 7fadc71ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadc0105b10 0x7fadc01a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.774+0000 7fadc71ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc01a13d0 con 0x7fadc0105b10 2023-07-14T13:18:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.774+0000 7fadc71ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc01a1540 con 0x7fadc00ffb00 2023-07-14T13:18:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.774+0000 7fadc71ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc01a1700 con 0x7fadc01004b0 2023-07-14T13:18:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.774+0000 7fadc579c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadc0105b10 0x7fadc01a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.774+0000 7fadc579c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadc0105b10 0x7fadc01a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34010/0 (socket says 172.21.15.17:34010) 2023-07-14T13:18:19.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.774+0000 7fadc579c700 1 -- 172.21.15.17:0/1749097204 learned_addr learned my addr 172.21.15.17:0/1749097204 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:19.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.774+0000 7fadb7fff700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc01004b0 0x7fadc019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.774+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadc00ffb00 0x7fadc019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.775+0000 7fadb7fff700 1 -- 172.21.15.17:0/1749097204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadc00ffb00 msgr2=0x7fadc019c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.775+0000 7fadb7fff700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadc00ffb00 0x7fadc019c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.775+0000 7fadb7fff700 1 -- 172.21.15.17:0/1749097204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadc0105b10 msgr2=0x7fadc01a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.775+0000 7fadb7fff700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadc0105b10 0x7fadc01a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.775+0000 7fadb7fff700 1 -- 172.21.15.17:0/1749097204 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb00095f0 con 0x7fadc01004b0 2023-07-14T13:18:19.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.775+0000 7fadb7fff700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc01004b0 0x7fadc019c720 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fadb0005b40 tx=0x7fadb00038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:19.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.776+0000 7fadb5ffb700 1 -- 172.21.15.17:0/1749097204 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb001d070 con 0x7fadc01004b0 2023-07-14T13:18:19.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.776+0000 7fadb5ffb700 1 -- 172.21.15.17:0/1749097204 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadb000bdb0 con 0x7fadc01004b0 2023-07-14T13:18:19.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.776+0000 7fadb5ffb700 1 -- 172.21.15.17:0/1749097204 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0005080 con 0x7fadc01004b0 2023-07-14T13:18:19.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.776+0000 7fadc71ff700 1 -- 172.21.15.17:0/1749097204 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc01a1980 con 0x7fadc01004b0 2023-07-14T13:18:19.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.776+0000 7fadc71ff700 1 -- 172.21.15.17:0/1749097204 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc01a9040 con 0x7fadc01004b0 2023-07-14T13:18:19.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.783+0000 7faddab68b80 1 Processor -- start 2023-07-14T13:18:19.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.784+0000 7fadb5ffb700 1 -- 172.21.15.17:0/1749097204 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fadb0004800 con 0x7fadc01004b0 2023-07-14T13:18:19.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.785+0000 7faddab68b80 1 -- start start 2023-07-14T13:18:19.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.785+0000 7faddab68b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 0x5568e74bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.785+0000 7faddab68b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74ba040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.785+0000 7faddab68b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74ba580 0x5568e74ba9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.785+0000 7faddab68b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e73bfc50 con 0x5568e74ba580 2023-07-14T13:18:19.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.785+0000 7faddab68b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e74129e0 con 0x5568e73166b0 2023-07-14T13:18:19.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.785+0000 7faddab68b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e740be70 con 0x5568e74c02d0 2023-07-14T13:18:19.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.785+0000 7fadc4f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74ba040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.786+0000 7fadc4f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74ba040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57268/0 (socket says 172.21.15.17:57268) 2023-07-14T13:18:19.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.786+0000 7fadc4f9b700 1 -- 172.21.15.17:0/2052599868 learned_addr learned my addr 172.21.15.17:0/2052599868 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:19.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.786+0000 7fadc579c700 1 --2- 172.21.15.17:0/2052599868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 0x5568e74bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.786+0000 7fadb7fff700 1 --2- 172.21.15.17:0/2052599868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74ba580 0x5568e74ba9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.786+0000 7fadc579c700 1 -- 172.21.15.17:0/2052599868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 msgr2=0x5568e74ba040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.786+0000 7fadc579c700 1 --2- 172.21.15.17:0/2052599868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74ba040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.786+0000 7fadc579c700 1 -- 172.21.15.17:0/2052599868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74ba580 msgr2=0x5568e74ba9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.786+0000 7fadc579c700 1 --2- 172.21.15.17:0/2052599868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74ba580 0x5568e74ba9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.786+0000 7fadc579c700 1 -- 172.21.15.17:0/2052599868 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568e7239d80 con 0x5568e73166b0 2023-07-14T13:18:19.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.787+0000 7fadb7fff700 1 --2- 172.21.15.17:0/2052599868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74ba580 0x5568e74ba9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:18:19.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.788+0000 7fadb5ffb700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fada80a13f0 0x7fada80a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.788+0000 7fadb5ffb700 1 -- 172.21.15.17:0/1749097204 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fadb00cdd40 con 0x7fadc01004b0 2023-07-14T13:18:19.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.788+0000 7fadc579c700 1 --2- 172.21.15.17:0/2052599868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 0x5568e74bfd90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009c10 tx=0x7fadb8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8f5b46cb25cb96c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:19.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.789+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fada80a13f0 0x7fada80a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.789+0000 7fada6ffd700 1 -- 172.21.15.17:0/2052599868 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb800e040 con 0x5568e73166b0 2023-07-14T13:18:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.789+0000 7fada6ffd700 1 -- 172.21.15.17:0/2052599868 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadb800f040 con 0x5568e73166b0 2023-07-14T13:18:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.789+0000 7fada6ffd700 1 -- 172.21.15.17:0/2052599868 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8004610 con 0x5568e73166b0 2023-07-14T13:18:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.789+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fada80a13f0 0x7fada80a38a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5568e74b6b40 tx=0x7fadbc009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.790+0000 7faddab68b80 1 -- 172.21.15.17:0/2052599868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 msgr2=0x5568e74bfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.790+0000 7faddab68b80 1 --2- 172.21.15.17:0/2052599868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 0x5568e74bfd90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009c10 tx=0x7fadb8009920 comp rx=0 tx=0).stop 2023-07-14T13:18:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.791+0000 7faddab68b80 1 -- 172.21.15.17:0/2052599868 shutdown_connections 2023-07-14T13:18:19.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.791+0000 7faddab68b80 1 --2- 172.21.15.17:0/2052599868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74ba580 0x5568e74ba9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.791+0000 7faddab68b80 1 --2- 172.21.15.17:0/2052599868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 0x5568e74bfd90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.791+0000 7faddab68b80 1 --2- 172.21.15.17:0/2052599868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74ba040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.791+0000 7faddab68b80 1 -- 172.21.15.17:0/2052599868 >> 172.21.15.17:0/2052599868 conn(0x5568e74afbe0 msgr2=0x5568e74b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:19.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.791+0000 7faddab68b80 1 -- 172.21.15.17:0/2052599868 shutdown_connections 2023-07-14T13:18:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.791+0000 7faddab68b80 1 -- 172.21.15.17:0/2052599868 wait complete. 2023-07-14T13:18:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.792+0000 7faddab68b80 1 -- start start 2023-07-14T13:18:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.792+0000 7faddab68b80 1 Processor -- start 2023-07-14T13:18:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.793+0000 7faddab68b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e73166b0 0x5568e74c6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.793+0000 7faddab68b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e74ba580 0x5568e74c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.793+0000 7faddab68b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.793+0000 7faddab68b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e73aba60 con 0x5568e73166b0 2023-07-14T13:18:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.793+0000 7faddab68b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e73ab760 con 0x5568e74ba580 2023-07-14T13:18:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.793+0000 7faddab68b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e728f8c0 con 0x5568e74c02d0 2023-07-14T13:18:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.793+0000 7faddab68b80 10 client.0 _ll_register_callbacks cb 0x5568e73a9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.794+0000 7fadc4f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e73166b0 0x5568e74c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.794+0000 7fadc4f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e73166b0 0x5568e74c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34032/0 (socket says 172.21.15.17:34032) 2023-07-14T13:18:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.794+0000 7fadc4f9b700 1 -- 172.21.15.17:0/614103295 learned_addr learned my addr 172.21.15.17:0/614103295 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.794+0000 7fadc579c700 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.794+0000 7fadb7fff700 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e74ba580 0x5568e74c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.794+0000 7fadc4f9b700 1 -- 172.21.15.17:0/614103295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 msgr2=0x5568e74c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.794+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.794+0000 7fadc4f9b700 1 -- 172.21.15.17:0/614103295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e74ba580 msgr2=0x5568e74c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.794+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e74ba580 0x5568e74c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.795+0000 7fadc4f9b700 1 -- 172.21.15.17:0/614103295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb800e330 con 0x5568e73166b0 2023-07-14T13:18:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.795+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e73166b0 0x5568e74c6630 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fadbc010c20 tx=0x7fadbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6394bf47e70da48 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.795+0000 7fad9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:19.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.795+0000 7fad9ffff700 1 -- 172.21.15.17:0/614103295 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc004460 con 0x5568e73166b0 2023-07-14T13:18:19.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.795+0000 7fad9ffff700 1 -- 172.21.15.17:0/614103295 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fadbc01d8c0 con 0x5568e73166b0 2023-07-14T13:18:19.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.795+0000 7faddab68b80 1 -- 172.21.15.17:0/614103295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568e7365490 con 0x5568e73166b0 2023-07-14T13:18:19.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.796+0000 7fad9ffff700 1 -- 172.21.15.17:0/614103295 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadbc01da80 con 0x5568e73166b0 2023-07-14T13:18:19.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.796+0000 7faddab68b80 10 client.18714 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:19.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.796+0000 7faddab68b80 1 -- 172.21.15.17:0/614103295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x5568e7222c00 con 0x5568e73166b0 2023-07-14T13:18:19.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.796+0000 7fad9ffff700 1 -- 172.21.15.17:0/614103295 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5568e7365490 con 0x5568e73166b0 2023-07-14T13:18:19.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.796+0000 7fad9ffff700 1 -- 172.21.15.17:0/614103295 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fadbc01b460 con 0x5568e73166b0 2023-07-14T13:18:19.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.797+0000 7faddab68b80 10 client.18714 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:19.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.797+0000 7faddab68b80 10 client.18714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:19.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.797+0000 7faddab68b80 20 client.18714 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:19.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.797+0000 7faddab68b80 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5568e74e4cd0 0x5568e74e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.797+0000 7faddab68b80 4 client.18714 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:19.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.797+0000 7faddab68b80 1 -- 172.21.15.17:0/614103295 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568e7404e50 con 0x5568e74e4cd0 2023-07-14T13:18:19.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.797+0000 7fadb7fff700 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5568e74e4cd0 0x5568e74e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.798+0000 7fadb7fff700 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5568e74e4cd0 0x5568e74e70e0 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68453f60137424f3 server_cookie=a19545b717d57ed5 in_seq=0 out_seq=0 2023-07-14T13:18:19.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.798+0000 7fad9ffff700 10 client.18714 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:19.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7fad9ffff700 1 -- 172.21.15.17:0/614103295 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5568e7404e50 con 0x5568e74e4cd0 2023-07-14T13:18:19.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7fad9ffff700 10 client.18714 handle_command_reply: tid=0 2023-07-14T13:18:19.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7faddab68b80 1 client.18714 shutdown 2023-07-14T13:18:19.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7faddab68b80 1 -- 172.21.15.17:0/614103295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e73166b0 msgr2=0x5568e74c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7faddab68b80 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e73166b0 0x5568e74c6630 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fadbc010c20 tx=0x7fadbc004750 comp rx=0 tx=0).stop 2023-07-14T13:18:19.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7faddab68b80 1 -- 172.21.15.17:0/614103295 shutdown_connections 2023-07-14T13:18:19.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7faddab68b80 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5568e74e4cd0 0x5568e74e70e0 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7faddab68b80 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7faddab68b80 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e73166b0 0x5568e74c6630 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7faddab68b80 1 --2- 172.21.15.17:0/614103295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e74ba580 0x5568e74c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7faddab68b80 1 -- 172.21.15.17:0/614103295 >> 172.21.15.17:0/614103295 conn(0x5568e74afbe0 msgr2=0x5568e74b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:19.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.799+0000 7fad9ffff700 0 client.18714 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.800+0000 7faddab68b80 1 -- 172.21.15.17:0/614103295 shutdown_connections 2023-07-14T13:18:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.800+0000 7faddab68b80 1 -- 172.21.15.17:0/614103295 wait complete. 2023-07-14T13:18:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.800+0000 7faddab68b80 20 client.18714 trim_cache size 0 max 16384 2023-07-14T13:18:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.826+0000 7faddab68b80 1 Processor -- start 2023-07-14T13:18:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.826+0000 7faddab68b80 1 -- start start 2023-07-14T13:18:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.827+0000 7faddab68b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 0x5568e74c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.827+0000 7faddab68b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74ba580 0x5568e74bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.827+0000 7faddab68b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.827+0000 7faddab68b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e74e2250 con 0x5568e74ba580 2023-07-14T13:18:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.827+0000 7faddab68b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e74b69a0 con 0x5568e73166b0 2023-07-14T13:18:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.827+0000 7faddab68b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e74b5ff0 con 0x5568e74c02d0 2023-07-14T13:18:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.827+0000 7fadc579c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.827+0000 7fadc4f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 0x5568e74c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.828+0000 7fadc4f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 0x5568e74c30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58342/0 (socket says 172.21.15.17:58342) 2023-07-14T13:18:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.828+0000 7fadc4f9b700 1 -- 172.21.15.17:0/1172256796 learned_addr learned my addr 172.21.15.17:0/1172256796 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.828+0000 7fadc4f9b700 1 -- 172.21.15.17:0/1172256796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 msgr2=0x5568e74b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.828+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/1172256796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.828+0000 7fadc4f9b700 1 -- 172.21.15.17:0/1172256796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74ba580 msgr2=0x5568e74bf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.828+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/1172256796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74ba580 0x5568e74bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.828+0000 7fadc4f9b700 1 -- 172.21.15.17:0/1172256796 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568e72601f0 con 0x5568e73166b0 2023-07-14T13:18:19.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.829+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/1172256796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 0x5568e74c30e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fadbc014010 tx=0x7fadbc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52e41e22b190c13 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.829+0000 7fada77fe700 1 -- 172.21.15.17:0/1172256796 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc004260 con 0x5568e73166b0 2023-07-14T13:18:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.829+0000 7fada77fe700 1 -- 172.21.15.17:0/1172256796 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadbc0043c0 con 0x5568e73166b0 2023-07-14T13:18:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.829+0000 7fada77fe700 1 -- 172.21.15.17:0/1172256796 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc01dcf0 con 0x5568e73166b0 2023-07-14T13:18:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.830+0000 7faddab68b80 1 -- 172.21.15.17:0/1172256796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 msgr2=0x5568e74c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.830+0000 7faddab68b80 1 --2- 172.21.15.17:0/1172256796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 0x5568e74c30e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fadbc014010 tx=0x7fadbc0047c0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.831+0000 7faddab68b80 1 -- 172.21.15.17:0/1172256796 shutdown_connections 2023-07-14T13:18:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.831+0000 7faddab68b80 1 --2- 172.21.15.17:0/1172256796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e74c02d0 0x5568e74b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.831+0000 7faddab68b80 1 --2- 172.21.15.17:0/1172256796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e73166b0 0x5568e74c30e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.831+0000 7faddab68b80 1 --2- 172.21.15.17:0/1172256796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74ba580 0x5568e74bf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.831+0000 7faddab68b80 1 -- 172.21.15.17:0/1172256796 >> 172.21.15.17:0/1172256796 conn(0x5568e74afbe0 msgr2=0x5568e74beaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.831+0000 7faddab68b80 1 -- 172.21.15.17:0/1172256796 shutdown_connections 2023-07-14T13:18:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.831+0000 7faddab68b80 1 -- 172.21.15.17:0/1172256796 wait complete. 2023-07-14T13:18:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.831+0000 7faddab68b80 1 -- start start 2023-07-14T13:18:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.832+0000 7faddab68b80 1 Processor -- start 2023-07-14T13:18:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.833+0000 7faddab68b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e73166b0 0x5568e74db670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.833+0000 7faddab68b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e74ba580 0x5568e74dbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.833+0000 7faddab68b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74c02d0 0x5568e74d9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.833+0000 7faddab68b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e74da270 con 0x5568e74c02d0 2023-07-14T13:18:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.833+0000 7faddab68b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e74da3e0 con 0x5568e74ba580 2023-07-14T13:18:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.833+0000 7faddab68b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e74da5a0 con 0x5568e73166b0 2023-07-14T13:18:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.833+0000 7faddab68b80 10 client.0 _ll_register_callbacks cb 0x7fadbc0108d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.833+0000 7fadc4f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e73166b0 0x5568e74db670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.833+0000 7fadc4f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e73166b0 0x5568e74db670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57294/0 (socket says 172.21.15.17:57294) 2023-07-14T13:18:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.833+0000 7fadc4f9b700 1 -- 172.21.15.17:0/3038449810 learned_addr learned my addr 172.21.15.17:0/3038449810 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.834+0000 7fadb7fff700 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e74ba580 0x5568e74dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.834+0000 7fadc579c700 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74c02d0 0x5568e74d9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.834+0000 7fadc4f9b700 1 -- 172.21.15.17:0/3038449810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e74ba580 msgr2=0x5568e74dbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.834+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e74ba580 0x5568e74dbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.834+0000 7fadc4f9b700 1 -- 172.21.15.17:0/3038449810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74c02d0 msgr2=0x5568e74d9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.834+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74c02d0 0x5568e74d9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.834+0000 7fadc4f9b700 1 -- 172.21.15.17:0/3038449810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568e7222c00 con 0x5568e73166b0 2023-07-14T13:18:19.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.834+0000 7fadc579c700 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74c02d0 0x5568e74d9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:18:19.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.835+0000 7fadc4f9b700 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e73166b0 0x5568e74db670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fadbc004760 tx=0x7fadbc009710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b56a9fb0010c39 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:19.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.836+0000 7fad9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:18:19.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.836+0000 7fad9ffff700 1 -- 172.21.15.17:0/3038449810 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc01db30 con 0x5568e73166b0 2023-07-14T13:18:19.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.836+0000 7fad9ffff700 1 -- 172.21.15.17:0/3038449810 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fadbc01dc90 con 0x5568e73166b0 2023-07-14T13:18:19.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.836+0000 7faddab68b80 1 -- 172.21.15.17:0/3038449810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fadb800f040 con 0x5568e73166b0 2023-07-14T13:18:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.836+0000 7fad9ffff700 1 -- 172.21.15.17:0/3038449810 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadbc01de70 con 0x5568e73166b0 2023-07-14T13:18:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.836+0000 7faddab68b80 10 client.28393 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.836+0000 7faddab68b80 1 -- 172.21.15.17:0/3038449810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x5568e7238250 con 0x5568e73166b0 2023-07-14T13:18:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.837+0000 7fad9ffff700 1 -- 172.21.15.17:0/3038449810 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadb800f040 con 0x5568e73166b0 2023-07-14T13:18:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.837+0000 7fad9ffff700 1 -- 172.21.15.17:0/3038449810 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fadbc0384f0 con 0x5568e73166b0 2023-07-14T13:18:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.837+0000 7faddab68b80 10 client.28393 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.837+0000 7faddab68b80 10 client.28393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.837+0000 7faddab68b80 20 client.28393 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.837+0000 7faddab68b80 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5568e754ab60 0x5568e754cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.837+0000 7faddab68b80 4 client.28393 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:18:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.837+0000 7faddab68b80 1 -- 172.21.15.17:0/3038449810 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5568e73c6ff0 con 0x5568e754ab60 2023-07-14T13:18:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.838+0000 7fadb7fff700 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5568e754ab60 0x5568e754cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.838+0000 7fadb7fff700 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5568e754ab60 0x5568e754cf70 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37e197c797e1b2c9 server_cookie=68e19330bf881158 in_seq=0 out_seq=0 2023-07-14T13:18:19.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.839+0000 7fad9ffff700 10 client.28393 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:19.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.852+0000 7fad9ffff700 1 -- 172.21.15.17:0/3038449810 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5568e73c6ff0 con 0x5568e754ab60 2023-07-14T13:18:19.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.852+0000 7fad9ffff700 10 client.28393 handle_command_reply: tid=0 2023-07-14T13:18:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.852+0000 7faddab68b80 1 client.28393 shutdown 2023-07-14T13:18:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.852+0000 7faddab68b80 1 -- 172.21.15.17:0/3038449810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e73166b0 msgr2=0x5568e74db670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.852+0000 7faddab68b80 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e73166b0 0x5568e74db670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fadbc004760 tx=0x7fadbc009710 comp rx=0 tx=0).stop 2023-07-14T13:18:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.853+0000 7faddab68b80 1 -- 172.21.15.17:0/3038449810 shutdown_connections 2023-07-14T13:18:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.853+0000 7faddab68b80 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5568e754ab60 0x5568e754cf70 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.853+0000 7faddab68b80 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5568e74c02d0 0x5568e74d9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.853+0000 7faddab68b80 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5568e73166b0 0x5568e74db670 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.853+0000 7faddab68b80 1 --2- 172.21.15.17:0/3038449810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568e74ba580 0x5568e74dbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.853+0000 7faddab68b80 1 -- 172.21.15.17:0/3038449810 >> 172.21.15.17:0/3038449810 conn(0x5568e74afbe0 msgr2=0x5568e74bf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.853+0000 7fad9ffff700 0 client.28393 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.853+0000 7faddab68b80 1 -- 172.21.15.17:0/3038449810 shutdown_connections 2023-07-14T13:18:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.853+0000 7faddab68b80 1 -- 172.21.15.17:0/3038449810 wait complete. 2023-07-14T13:18:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.854+0000 7faddab68b80 20 client.28393 trim_cache size 0 max 16384 2023-07-14T13:18:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:18:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:18:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:18:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:18:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.854+0000 7fadc71ff700 1 -- 172.21.15.17:0/1749097204 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fada80a13f0 msgr2=0x7fada80a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.854+0000 7fadc71ff700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fada80a13f0 0x7fada80a38a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5568e74b6b40 tx=0x7fadbc009260 comp rx=0 tx=0).stop 2023-07-14T13:18:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.854+0000 7fadc71ff700 1 -- 172.21.15.17:0/1749097204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc01004b0 msgr2=0x7fadc019c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.854+0000 7fadc71ff700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc01004b0 0x7fadc019c720 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fadb0005b40 tx=0x7fadb00038b0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.855+0000 7fadc71ff700 1 -- 172.21.15.17:0/1749097204 shutdown_connections 2023-07-14T13:18:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.855+0000 7fadc71ff700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fada80a13f0 0x7fada80a38a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.855+0000 7fadc71ff700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fadc0105b10 0x7fadc01a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.855+0000 7fadc71ff700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadc00ffb00 0x7fadc019c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.855+0000 7fadc71ff700 1 --2- 172.21.15.17:0/1749097204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc01004b0 0x7fadc019c720 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.855+0000 7fadc71ff700 1 -- 172.21.15.17:0/1749097204 >> 172.21.15.17:0/1749097204 conn(0x7fadc00fb600 msgr2=0x7fadc00fbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.855+0000 7fadc71ff700 1 -- 172.21.15.17:0/1749097204 shutdown_connections 2023-07-14T13:18:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:19.855+0000 7fadc71ff700 1 -- 172.21.15.17:0/1749097204 wait complete. 2023-07-14T13:18:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.925+0000 7fcaab9ff700 1 -- 172.21.15.17:0/1792373864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaa410cb50 msgr2=0x7fcaa4106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.925+0000 7fcaab9ff700 1 --2- 172.21.15.17:0/1792373864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaa410cb50 0x7fcaa4106340 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fca9800b0a0 tx=0x7fca9800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.926+0000 7fcaab9ff700 1 -- 172.21.15.17:0/1792373864 shutdown_connections 2023-07-14T13:18:19.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.926+0000 7fcaab9ff700 1 --2- 172.21.15.17:0/1792373864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa4106a70 0x7fcaa4112f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.926+0000 7fcaab9ff700 1 --2- 172.21.15.17:0/1792373864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa410c240 0x7fcaa410c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.926+0000 7fcaab9ff700 1 --2- 172.21.15.17:0/1792373864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaa410cb50 0x7fcaa4106340 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.926+0000 7fcaab9ff700 1 -- 172.21.15.17:0/1792373864 >> 172.21.15.17:0/1792373864 conn(0x7fcaa40759e0 msgr2=0x7fcaa4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:19.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.926+0000 7fcaab9ff700 1 -- 172.21.15.17:0/1792373864 shutdown_connections 2023-07-14T13:18:19.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.926+0000 7fcaab9ff700 1 -- 172.21.15.17:0/1792373864 wait complete. 2023-07-14T13:18:19.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.928+0000 7fcaab9ff700 1 Processor -- start 2023-07-14T13:18:19.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.928+0000 7fcaab9ff700 1 -- start start 2023-07-14T13:18:19.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.929+0000 7fcaab9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaa4106a70 0x7fcaa419c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.929+0000 7fcaab9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa410c240 0x7fcaa419c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.929+0000 7fcaab9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa410cb50 0x7fcaa41a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.929+0000 7fcaab9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa41a1390 con 0x7fcaa410cb50 2023-07-14T13:18:19.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.929+0000 7fcaab9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa41a1500 con 0x7fcaa4106a70 2023-07-14T13:18:19.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.929+0000 7fcaab9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa41a16c0 con 0x7fcaa410c240 2023-07-14T13:18:19.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.929+0000 7fcaa8f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa410c240 0x7fcaa419c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.929+0000 7fcaa8f9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa410c240 0x7fcaa419c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57312/0 (socket says 172.21.15.17:57312) 2023-07-14T13:18:19.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.930+0000 7fcaa8f9a700 1 -- 172.21.15.17:0/3629286289 learned_addr learned my addr 172.21.15.17:0/3629286289 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.930+0000 7fcaa9f9c700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa410cb50 0x7fcaa41a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.930+0000 7fcaa979b700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaa4106a70 0x7fcaa419c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.930+0000 7fcaa8f9a700 1 -- 172.21.15.17:0/3629286289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaa4106a70 msgr2=0x7fcaa419c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.930+0000 7fcaa8f9a700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaa4106a70 0x7fcaa419c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.930+0000 7fcaa8f9a700 1 -- 172.21.15.17:0/3629286289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa410cb50 msgr2=0x7fcaa41a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.930+0000 7fcaa8f9a700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa410cb50 0x7fcaa41a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.930+0000 7fcaa8f9a700 1 -- 172.21.15.17:0/3629286289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca98009d00 con 0x7fcaa410c240 2023-07-14T13:18:19.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.931+0000 7fcaa8f9a700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa410c240 0x7fcaa419c8f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fca9800b070 tx=0x7fca98007930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:19.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.931+0000 7fca967fc700 1 -- 172.21.15.17:0/3629286289 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9800e040 con 0x7fcaa410c240 2023-07-14T13:18:19.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.931+0000 7fca967fc700 1 -- 172.21.15.17:0/3629286289 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca9800be40 con 0x7fcaa410c240 2023-07-14T13:18:19.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.931+0000 7fca967fc700 1 -- 172.21.15.17:0/3629286289 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca980052a0 con 0x7fcaa410c240 2023-07-14T13:18:19.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.931+0000 7fcaab9ff700 1 -- 172.21.15.17:0/3629286289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa41a1940 con 0x7fcaa410c240 2023-07-14T13:18:19.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.931+0000 7fcaab9ff700 1 -- 172.21.15.17:0/3629286289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa41a91e0 con 0x7fcaa410c240 2023-07-14T13:18:19.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.937+0000 7fca967fc700 1 -- 172.21.15.17:0/3629286289 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fca98003c00 con 0x7fcaa410c240 2023-07-14T13:18:19.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.938+0000 7fcabf31fb80 1 Processor -- start 2023-07-14T13:18:19.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.938+0000 7fcabf31fb80 1 -- start start 2023-07-14T13:18:19.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.939+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e572d0 0x55df15e576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.939+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e57be0 0x55df15e62590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.939+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e62ad0 0x55df15e64eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.939+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15d5dcb0 con 0x55df15e572d0 2023-07-14T13:18:19.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.939+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15db0a40 con 0x55df15e57be0 2023-07-14T13:18:19.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.939+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15da9ed0 con 0x55df15e62ad0 2023-07-14T13:18:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.939+0000 7fcaa9f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e572d0 0x55df15e576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.939+0000 7fcaa9f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e572d0 0x55df15e576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34070/0 (socket says 172.21.15.17:34070) 2023-07-14T13:18:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.939+0000 7fcaa9f9c700 1 -- 172.21.15.17:0/1508955315 learned_addr learned my addr 172.21.15.17:0/1508955315 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.939+0000 7fcaa8f9a700 1 --2- 172.21.15.17:0/1508955315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e62ad0 0x55df15e64eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.939+0000 7fcaa979b700 1 --2- 172.21.15.17:0/1508955315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e57be0 0x55df15e62590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.940+0000 7fcaa9f9c700 1 -- 172.21.15.17:0/1508955315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e62ad0 msgr2=0x55df15e64eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.940+0000 7fcaa9f9c700 1 --2- 172.21.15.17:0/1508955315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e62ad0 0x55df15e64eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.940+0000 7fcaa9f9c700 1 -- 172.21.15.17:0/1508955315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e57be0 msgr2=0x55df15e62590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.940+0000 7fcaa9f9c700 1 --2- 172.21.15.17:0/1508955315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e57be0 0x55df15e62590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.940+0000 7fcaa9f9c700 1 -- 172.21.15.17:0/1508955315 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df15bd7de0 con 0x55df15e572d0 2023-07-14T13:18:19.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.940+0000 7fcaa979b700 1 --2- 172.21.15.17:0/1508955315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e57be0 0x55df15e62590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:18:19.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.940+0000 7fcaa9f9c700 1 --2- 172.21.15.17:0/1508955315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e572d0 0x55df15e576a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009d20 tx=0x7fcaa0011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d756d223aef0de server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:19.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.941+0000 7fca8f7fe700 1 -- 172.21.15.17:0/1508955315 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0019630 con 0x55df15e572d0 2023-07-14T13:18:19.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.941+0000 7fca8f7fe700 1 -- 172.21.15.17:0/1508955315 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcaa0009e70 con 0x55df15e572d0 2023-07-14T13:18:19.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.941+0000 7fca8f7fe700 1 -- 172.21.15.17:0/1508955315 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa000eb20 con 0x55df15e572d0 2023-07-14T13:18:19.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.941+0000 7fca967fc700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca900a1400 0x7fca900a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.942+0000 7fca967fc700 1 -- 172.21.15.17:0/3629286289 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fca980cdb80 con 0x7fcaa410c240 2023-07-14T13:18:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.942+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1508955315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e572d0 msgr2=0x55df15e576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.942+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/1508955315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e572d0 0x55df15e576a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009d20 tx=0x7fcaa0011720 comp rx=0 tx=0).stop 2023-07-14T13:18:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.942+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1508955315 shutdown_connections 2023-07-14T13:18:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.942+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/1508955315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e62ad0 0x55df15e64eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.942+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/1508955315 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e572d0 0x55df15e576a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.942+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/1508955315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e57be0 0x55df15e62590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.942+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1508955315 >> 172.21.15.17:0/1508955315 conn(0x55df15e4dda0 msgr2=0x55df15e536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.942+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1508955315 shutdown_connections 2023-07-14T13:18:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.943+0000 7fcaa979b700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca900a1400 0x7fca900a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.943+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1508955315 wait complete. 2023-07-14T13:18:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.943+0000 7fcabf31fb80 1 -- start start 2023-07-14T13:18:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.943+0000 7fcaa979b700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca900a1400 0x7fca900a38b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcaa41075f0 tx=0x7fca9c009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.944+0000 7fcabf31fb80 1 Processor -- start 2023-07-14T13:18:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.945+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 0x55df15e62550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.945+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 0x55df15e5f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.945+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e62ad0 0x55df15e5fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.945+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15d49ac0 con 0x55df15e57be0 2023-07-14T13:18:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.945+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15d497c0 con 0x55df15e62ad0 2023-07-14T13:18:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.945+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15c2d920 con 0x55df15e572d0 2023-07-14T13:18:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.945+0000 7fcabf31fb80 10 client.0 _ll_register_callbacks cb 0x55df15d47760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.945+0000 7fcaa8f9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 0x55df15e5f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.945+0000 7fcaa979b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 0x55df15e62550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.945+0000 7fcaa8f9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 0x55df15e5f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34082/0 (socket says 172.21.15.17:34082) 2023-07-14T13:18:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.945+0000 7fcaa8f9a700 1 -- 172.21.15.17:0/1506818177 learned_addr learned my addr 172.21.15.17:0/1506818177 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.946+0000 7fcaa9f9c700 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e62ad0 0x55df15e5fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.946+0000 7fcaa979b700 1 -- 172.21.15.17:0/1506818177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e62ad0 msgr2=0x55df15e5fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.946+0000 7fcaa979b700 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e62ad0 0x55df15e5fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.946+0000 7fcaa979b700 1 -- 172.21.15.17:0/1506818177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 msgr2=0x55df15e5f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.946+0000 7fcaa979b700 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 0x55df15e5f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.946+0000 7fcaa979b700 1 -- 172.21.15.17:0/1506818177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa00099d0 con 0x55df15e572d0 2023-07-14T13:18:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.946+0000 7fcaa9f9c700 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e62ad0 0x55df15e5fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:18:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.946+0000 7fcaa979b700 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 0x55df15e62550 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0107b0 tx=0x7fca9c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bda9f9dbce009d55 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.946+0000 7fca8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:18:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.947+0000 7fca8cff9700 1 -- 172.21.15.17:0/1506818177 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c01b870 con 0x55df15e572d0 2023-07-14T13:18:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.947+0000 7fca8cff9700 1 -- 172.21.15.17:0/1506818177 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fca9c01b9d0 con 0x55df15e572d0 2023-07-14T13:18:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.947+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1506818177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df15d034f0 con 0x55df15e572d0 2023-07-14T13:18:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.947+0000 7fca8cff9700 1 -- 172.21.15.17:0/1506818177 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca9c01bb90 con 0x55df15e572d0 2023-07-14T13:18:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.947+0000 7fcabf31fb80 10 client.28405 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.947+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1506818177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55df15bc0c60 con 0x55df15e572d0 2023-07-14T13:18:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.948+0000 7fca8cff9700 1 -- 172.21.15.17:0/1506818177 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55df15d034f0 con 0x55df15e572d0 2023-07-14T13:18:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.948+0000 7fca8cff9700 1 -- 172.21.15.17:0/1506818177 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fca9c02f410 con 0x55df15e572d0 2023-07-14T13:18:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.948+0000 7fcabf31fb80 10 client.28405 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.948+0000 7fcabf31fb80 10 client.28405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.948+0000 7fcabf31fb80 20 client.28405 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.948+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55df15e723e0 0x55df15e747f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.948+0000 7fcabf31fb80 4 client.28405 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.948+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1506818177 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df15da2eb0 con 0x55df15e723e0 2023-07-14T13:18:19.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.949+0000 7fcaa8f9a700 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55df15e723e0 0x55df15e747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.949+0000 7fcaa8f9a700 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55df15e723e0 0x55df15e747f0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c2ec7dd15cd83af server_cookie=9ed0b8be36e15104 in_seq=0 out_seq=0 2023-07-14T13:18:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.949+0000 7fca8cff9700 10 client.28405 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.950+0000 7fca8cff9700 1 -- 172.21.15.17:0/1506818177 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55df15da2eb0 con 0x55df15e723e0 2023-07-14T13:18:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.950+0000 7fca8cff9700 10 client.28405 handle_command_reply: tid=0 2023-07-14T13:18:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.950+0000 7fcabf31fb80 1 client.28405 shutdown 2023-07-14T13:18:19.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.950+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1506818177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 msgr2=0x55df15e62550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.950+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 0x55df15e62550 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0107b0 tx=0x7fca9c004750 comp rx=0 tx=0).stop 2023-07-14T13:18:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.951+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1506818177 shutdown_connections 2023-07-14T13:18:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.951+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55df15e723e0 0x55df15e747f0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.951+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e62ad0 0x55df15e5fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.951+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 0x55df15e62550 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.951+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/1506818177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 0x55df15e5f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.951+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1506818177 >> 172.21.15.17:0/1506818177 conn(0x55df15e4dda0 msgr2=0x55df15e53230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.951+0000 7fca8cff9700 0 client.28405 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.951+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1506818177 shutdown_connections 2023-07-14T13:18:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.951+0000 7fcabf31fb80 1 -- 172.21.15.17:0/1506818177 wait complete. 2023-07-14T13:18:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.951+0000 7fcabf31fb80 20 client.28405 trim_cache size 0 max 16384 2023-07-14T13:18:20.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.977+0000 7fcabf31fb80 1 Processor -- start 2023-07-14T13:18:20.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.977+0000 7fcabf31fb80 1 -- start start 2023-07-14T13:18:20.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.978+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e572d0 0x55df15e69520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:20.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.978+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e57be0 0x55df15e62080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:20.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.978+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e62ad0 0x55df15e5aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.978+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15e54d00 con 0x55df15e62ad0 2023-07-14T13:18:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.978+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15e4d970 con 0x55df15e572d0 2023-07-14T13:18:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.978+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15e54290 con 0x55df15e57be0 2023-07-14T13:18:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.978+0000 7fcaa979b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e572d0 0x55df15e69520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.979+0000 7fcaa9f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e62ad0 0x55df15e5aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.979+0000 7fcaa9f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e62ad0 0x55df15e5aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34084/0 (socket says 172.21.15.17:34084) 2023-07-14T13:18:20.018 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.979+0000 7fcaa9f9c700 1 -- 172.21.15.17:0/2836760849 learned_addr learned my addr 172.21.15.17:0/2836760849 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.979+0000 7fcaa979b700 1 -- 172.21.15.17:0/2836760849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e57be0 msgr2=0x55df15e62080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:18:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.979+0000 7fcaa979b700 1 --2- 172.21.15.17:0/2836760849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e57be0 0x55df15e62080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.979+0000 7fcaa979b700 1 -- 172.21.15.17:0/2836760849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e62ad0 msgr2=0x55df15e5aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.979+0000 7fcaa979b700 1 --2- 172.21.15.17:0/2836760849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e62ad0 0x55df15e5aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.979+0000 7fcaa979b700 1 -- 172.21.15.17:0/2836760849 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df15bfe250 con 0x55df15e572d0 2023-07-14T13:18:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.980+0000 7fcaa979b700 1 --2- 172.21.15.17:0/2836760849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e572d0 0x55df15e69520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fca9c02f7a0 tx=0x7fca9c02f9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=305b4dcdb3355acd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.980+0000 7fca8ffff700 1 -- 172.21.15.17:0/2836760849 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c02fb10 con 0x55df15e572d0 2023-07-14T13:18:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.980+0000 7fca8ffff700 1 -- 172.21.15.17:0/2836760849 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca9c02f410 con 0x55df15e572d0 2023-07-14T13:18:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.980+0000 7fca8ffff700 1 -- 172.21.15.17:0/2836760849 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c0266a0 con 0x55df15e572d0 2023-07-14T13:18:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.981+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2836760849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e572d0 msgr2=0x55df15e69520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:20.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.981+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/2836760849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e572d0 0x55df15e69520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fca9c02f7a0 tx=0x7fca9c02f9c0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.981+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2836760849 shutdown_connections 2023-07-14T13:18:20.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.981+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/2836760849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e62ad0 0x55df15e5aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.981+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/2836760849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e572d0 0x55df15e69520 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.981+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/2836760849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e57be0 0x55df15e62080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.981+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2836760849 >> 172.21.15.17:0/2836760849 conn(0x55df15e4dda0 msgr2=0x55df15e51e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:20.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.982+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2836760849 shutdown_connections 2023-07-14T13:18:20.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.982+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2836760849 wait complete. 2023-07-14T13:18:20.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.982+0000 7fcabf31fb80 1 -- start start 2023-07-14T13:18:20.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.982+0000 7fcabf31fb80 1 Processor -- start 2023-07-14T13:18:20.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.983+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 0x55df15e67b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:20.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.983+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 0x55df15e680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:20.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.983+0000 7fcabf31fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e62ad0 0x55df15e685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:20.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.983+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15ec62b0 con 0x55df15e57be0 2023-07-14T13:18:20.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.983+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15ec63f0 con 0x55df15e62ad0 2023-07-14T13:18:20.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.983+0000 7fcabf31fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df15ed7540 con 0x55df15e572d0 2023-07-14T13:18:20.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.983+0000 7fcabf31fb80 10 client.0 _ll_register_callbacks cb 0x7fca9c012e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:20.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.984+0000 7fcaa979b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 0x55df15e67b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:20.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.984+0000 7fcaa979b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 0x55df15e67b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57346/0 (socket says 172.21.15.17:57346) 2023-07-14T13:18:20.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.984+0000 7fcaa979b700 1 -- 172.21.15.17:0/2168236394 learned_addr learned my addr 172.21.15.17:0/2168236394 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:20.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.984+0000 7fcaa9f9c700 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e62ad0 0x55df15e685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:20.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.984+0000 7fcaa8f9a700 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 0x55df15e680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:20.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.985+0000 7fcaa8f9a700 1 -- 172.21.15.17:0/2168236394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 msgr2=0x55df15e67b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:20.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.985+0000 7fcaa8f9a700 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 0x55df15e67b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.985+0000 7fcaa8f9a700 1 -- 172.21.15.17:0/2168236394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e62ad0 msgr2=0x55df15e685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:20.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.985+0000 7fcaa8f9a700 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e62ad0 0x55df15e685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.985+0000 7fcaa8f9a700 1 -- 172.21.15.17:0/2168236394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df15bc0c60 con 0x55df15e57be0 2023-07-14T13:18:20.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.986+0000 7fcaa8f9a700 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 0x55df15e680b0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fca9809ac30 tx=0x7fca98009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f30c699f9ea092 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:20.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.986+0000 7fca8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:20.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.986+0000 7fca8cff9700 1 -- 172.21.15.17:0/2168236394 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca980d5040 con 0x55df15e57be0 2023-07-14T13:18:20.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.986+0000 7fca8cff9700 1 -- 172.21.15.17:0/2168236394 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fca98024310 con 0x55df15e57be0 2023-07-14T13:18:20.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.986+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2168236394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcaa0009e70 con 0x55df15e57be0 2023-07-14T13:18:20.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.986+0000 7fca8cff9700 1 -- 172.21.15.17:0/2168236394 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca9809a600 con 0x55df15e57be0 2023-07-14T13:18:20.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.986+0000 7fcabf31fb80 10 client.18732 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:20.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.986+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2168236394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55df15bd62b0 con 0x55df15e57be0 2023-07-14T13:18:20.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.987+0000 7fca8cff9700 1 -- 172.21.15.17:0/2168236394 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca980b7080 con 0x55df15e57be0 2023-07-14T13:18:20.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.987+0000 7fca8cff9700 1 -- 172.21.15.17:0/2168236394 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fca980b3240 con 0x55df15e57be0 2023-07-14T13:18:20.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.987+0000 7fcabf31fb80 10 client.18732 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:20.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.987+0000 7fcabf31fb80 10 client.18732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:20.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.987+0000 7fcabf31fb80 20 client.18732 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:20.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.987+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55df15ec6760 0x55df15ec8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:20.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.987+0000 7fcabf31fb80 4 client.18732 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:18:20.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.987+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2168236394 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55df15d65050 con 0x55df15ec6760 2023-07-14T13:18:20.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.987+0000 7fcaa979b700 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55df15ec6760 0x55df15ec8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.988+0000 7fca8cff9700 10 client.18732 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fcaa979b700 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55df15ec6760 0x55df15ec8b70 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb04324034f15bc3 server_cookie=1a93efcae2788e98 in_seq=0 out_seq=0 2023-07-14T13:18:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fca8cff9700 1 -- 172.21.15.17:0/2168236394 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55df15d65050 con 0x55df15ec6760 2023-07-14T13:18:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fca8cff9700 10 client.18732 handle_command_reply: tid=0 2023-07-14T13:18:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fcabf31fb80 1 client.18732 shutdown 2023-07-14T13:18:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2168236394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 msgr2=0x55df15e680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:20.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 0x55df15e680b0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fca9809ac30 tx=0x7fca98009040 comp rx=0 tx=0).stop 2023-07-14T13:18:20.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2168236394 shutdown_connections 2023-07-14T13:18:20.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55df15ec6760 0x55df15ec8b70 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df15e62ad0 0x55df15e685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df15e572d0 0x55df15e67b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fca8cff9700 0 client.18732 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:20.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fcabf31fb80 1 --2- 172.21.15.17:0/2168236394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55df15e57be0 0x55df15e680b0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.989+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2168236394 >> 172.21.15.17:0/2168236394 conn(0x55df15e4dda0 msgr2=0x55df15e5aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:20.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.990+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2168236394 shutdown_connections 2023-07-14T13:18:20.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.990+0000 7fcabf31fb80 1 -- 172.21.15.17:0/2168236394 wait complete. 2023-07-14T13:18:20.033 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:18:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:18:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:18:20.034 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:18:20.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.991+0000 7fcabf31fb80 20 client.18732 trim_cache size 0 max 16384 2023-07-14T13:18:20.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 -- 172.21.15.17:0/3629286289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca900a1400 msgr2=0x7fca900a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:20.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca900a1400 0x7fca900a38b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcaa41075f0 tx=0x7fca9c009260 comp rx=0 tx=0).stop 2023-07-14T13:18:20.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 -- 172.21.15.17:0/3629286289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa410c240 msgr2=0x7fcaa419c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:20.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa410c240 0x7fcaa419c8f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fca9800b070 tx=0x7fca98007930 comp rx=0 tx=0).stop 2023-07-14T13:18:20.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 -- 172.21.15.17:0/3629286289 shutdown_connections 2023-07-14T13:18:20.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca900a1400 0x7fca900a38b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaa410cb50 0x7fcaa41a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcaa4106a70 0x7fcaa419c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 --2- 172.21.15.17:0/3629286289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcaa410c240 0x7fcaa419c8f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 -- 172.21.15.17:0/3629286289 >> 172.21.15.17:0/3629286289 conn(0x7fcaa40759e0 msgr2=0x7fcaa4077140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:20.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 -- 172.21.15.17:0/3629286289 shutdown_connections 2023-07-14T13:18:20.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:19.992+0000 7fcaab9ff700 1 -- 172.21.15.17:0/3629286289 wait complete. 2023-07-14T13:18:20.060 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:18:20.060 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:18:20.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.348+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4017703036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84c8074a40 msgr2=0x7f84c8074e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:20.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.348+0000 7f84cf5ff700 1 --2- 172.21.15.17:0/4017703036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84c8074a40 0x7f84c8074e10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f84c400b0a0 tx=0x7f84c400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.349+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4017703036 shutdown_connections 2023-07-14T13:18:20.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.349+0000 7f84cf5ff700 1 --2- 172.21.15.17:0/4017703036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c8110a00 0x7f84c8112de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.349+0000 7f84cf5ff700 1 --2- 172.21.15.17:0/4017703036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84c8074a40 0x7f84c8074e10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.349+0000 7f84cf5ff700 1 --2- 172.21.15.17:0/4017703036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8075350 0x7f84c81104c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.349+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4017703036 >> 172.21.15.17:0/4017703036 conn(0x7f84c80fd860 msgr2=0x7f84c80ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:20.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.349+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4017703036 shutdown_connections 2023-07-14T13:18:20.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.349+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4017703036 wait complete. 2023-07-14T13:18:20.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.350+0000 7f84cf5ff700 1 Processor -- start 2023-07-14T13:18:20.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.351+0000 7f84cf5ff700 1 -- start start 2023-07-14T13:18:20.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.351+0000 7f84cf5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8074a40 0x7f84c819c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:20.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.351+0000 7f84cf5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c8075350 0x7f84c819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:20.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.351+0000 7f84cf5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84c8110a00 0x7f84c81a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:20.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.351+0000 7f84cf5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c81a12a0 con 0x7f84c8074a40 2023-07-14T13:18:20.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84cf5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c81a1410 con 0x7f84c8110a00 2023-07-14T13:18:20.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84cf5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c81a15d0 con 0x7f84c8075350 2023-07-14T13:18:20.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84ccb9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c8075350 0x7f84c819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:20.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84ccb9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c8075350 0x7f84c819c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57360/0 (socket says 172.21.15.17:57360) 2023-07-14T13:18:20.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84ccb9a700 1 -- 172.21.15.17:0/4248413920 learned_addr learned my addr 172.21.15.17:0/4248413920 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:20.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84cd39b700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8074a40 0x7f84c819c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:20.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84cdb9c700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84c8110a00 0x7f84c81a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:20.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84ccb9a700 1 -- 172.21.15.17:0/4248413920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84c8110a00 msgr2=0x7f84c81a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:20.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84ccb9a700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84c8110a00 0x7f84c81a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84ccb9a700 1 -- 172.21.15.17:0/4248413920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8074a40 msgr2=0x7f84c819c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:20.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84ccb9a700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8074a40 0x7f84c819c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.352+0000 7f84ccb9a700 1 -- 172.21.15.17:0/4248413920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4009d00 con 0x7f84c8075350 2023-07-14T13:18:20.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.353+0000 7f84ccb9a700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c8075350 0x7f84c819c800 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f84b800e9a0 tx=0x7f84b800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.353+0000 7f84be7fc700 1 -- 172.21.15.17:0/4248413920 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8009790 con 0x7f84c8075350 2023-07-14T13:18:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.353+0000 7f84be7fc700 1 -- 172.21.15.17:0/4248413920 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f84b800cbd0 con 0x7f84c8075350 2023-07-14T13:18:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.353+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4248413920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c81a18b0 con 0x7f84c8075350 2023-07-14T13:18:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.353+0000 7f84be7fc700 1 -- 172.21.15.17:0/4248413920 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8018680 con 0x7f84c8075350 2023-07-14T13:18:20.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.354+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4248413920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c806a110 con 0x7f84c8075350 2023-07-14T13:18:20.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.355+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4248413920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c810bc20 con 0x7f84c8075350 2023-07-14T13:18:20.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.358+0000 7f84be7fc700 1 -- 172.21.15.17:0/4248413920 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f84b800cd40 con 0x7f84c8075350 2023-07-14T13:18:20.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.360+0000 7f84be7fc700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f84b40a1450 0x7f84b40a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:20.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.360+0000 7f84be7fc700 1 -- 172.21.15.17:0/4248413920 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f84b8014070 con 0x7f84c8075350 2023-07-14T13:18:20.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.361+0000 7f84cd39b700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f84b40a1450 0x7f84b40a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:20.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.362+0000 7f84cd39b700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f84b40a1450 0x7f84b40a3900 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009fd0 tx=0x7f84c400b700 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:20.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.364+0000 7f84be7fc700 1 -- 172.21.15.17:0/4248413920 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f84b8051790 con 0x7f84c8075350 2023-07-14T13:18:20.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.809+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4248413920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84c8067750 con 0x7f84c8075350 2023-07-14T13:18:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.810+0000 7f84be7fc700 1 -- 172.21.15.17:0/4248413920 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+10854 (secure 0 0 0) 0x7f84b8096280 con 0x7f84c8075350 2023-07-14T13:18:20.847 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:18:20.848 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":49,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:17:59.246297+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:18:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.814+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4248413920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f84b40a1450 msgr2=0x7f84b40a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.814+0000 7f84cf5ff700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f84b40a1450 0x7f84b40a3900 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009fd0 tx=0x7f84c400b700 comp rx=0 tx=0).stop 2023-07-14T13:18:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.814+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4248413920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c8075350 msgr2=0x7f84c819c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.814+0000 7f84cf5ff700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c8075350 0x7f84c819c800 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f84b800e9a0 tx=0x7f84b800ecb0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.814+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4248413920 shutdown_connections 2023-07-14T13:18:20.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.814+0000 7f84cf5ff700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f84b40a1450 0x7f84b40a3900 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.814+0000 7f84cf5ff700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84c8110a00 0x7f84c81a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.814+0000 7f84cf5ff700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84c8074a40 0x7f84c819c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.853 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.814+0000 7f84cf5ff700 1 --2- 172.21.15.17:0/4248413920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84c8075350 0x7f84c819c800 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:20.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.814+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4248413920 >> 172.21.15.17:0/4248413920 conn(0x7f84c80fd860 msgr2=0x7f84c8111660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:20.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.815+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4248413920 shutdown_connections 2023-07-14T13:18:20.854 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:20.815+0000 7f84cf5ff700 1 -- 172.21.15.17:0/4248413920 wait complete. 2023-07-14T13:18:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 49 2023-07-14T13:18:20.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:18:21.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.191+0000 7f492b1ff700 1 -- 172.21.15.17:0/2443116711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f492406d3a0 msgr2=0x7f492411b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.228 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.191+0000 7f492b1ff700 1 --2- 172.21.15.17:0/2443116711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f492406d3a0 0x7f492411b470 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b0a0 tx=0x7f491c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.192+0000 7f492b1ff700 1 -- 172.21.15.17:0/2443116711 shutdown_connections 2023-07-14T13:18:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.192+0000 7f492b1ff700 1 --2- 172.21.15.17:0/2443116711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f492406d3a0 0x7f492411b470 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.192+0000 7f492b1ff700 1 --2- 172.21.15.17:0/2443116711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f492410e280 0x7f492410e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.192+0000 7f492b1ff700 1 --2- 172.21.15.17:0/2443116711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f492406c9a0 0x7f492406ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.229 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.192+0000 7f492b1ff700 1 -- 172.21.15.17:0/2443116711 >> 172.21.15.17:0/2443116711 conn(0x7f492406bf70 msgr2=0x7f4924070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.192+0000 7f492b1ff700 1 -- 172.21.15.17:0/2443116711 shutdown_connections 2023-07-14T13:18:21.230 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.193+0000 7f492b1ff700 1 -- 172.21.15.17:0/2443116711 wait complete. 2023-07-14T13:18:21.231 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.194+0000 7f492b1ff700 1 Processor -- start 2023-07-14T13:18:21.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.195+0000 7f492b1ff700 1 -- start start 2023-07-14T13:18:21.232 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.196+0000 7f492b1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f492406c9a0 0x7f49241aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.196+0000 7f492b1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f492406d3a0 0x7f49241aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.196+0000 7f492b1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f492410e280 0x7f49241a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.196+0000 7f492b1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49241a5210 con 0x7f492410e280 2023-07-14T13:18:21.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.196+0000 7f492b1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49241a5380 con 0x7f492406c9a0 2023-07-14T13:18:21.233 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.196+0000 7f492b1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49241a5540 con 0x7f492406d3a0 2023-07-14T13:18:21.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.196+0000 7f4928f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f492406c9a0 0x7f49241aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.196+0000 7f4928f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f492406c9a0 0x7f49241aaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58432/0 (socket says 172.21.15.17:58432) 2023-07-14T13:18:21.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.196+0000 7f4928f9b700 1 -- 172.21.15.17:0/41170832 learned_addr learned my addr 172.21.15.17:0/41170832 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:21.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.196+0000 7f4923fff700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f492406d3a0 0x7f49241aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.197+0000 7f4928f9b700 1 -- 172.21.15.17:0/41170832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f492406d3a0 msgr2=0x7f49241aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.197+0000 7f4928f9b700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f492406d3a0 0x7f49241aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.234 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.197+0000 7f4928f9b700 1 -- 172.21.15.17:0/41170832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f492410e280 msgr2=0x7f49241a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.197+0000 7f4928f9b700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f492410e280 0x7f49241a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.197+0000 7f4928f9b700 1 -- 172.21.15.17:0/41170832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c009d00 con 0x7f492406c9a0 2023-07-14T13:18:21.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.197+0000 7f4928f9b700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f492406c9a0 0x7f49241aaa60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f491400e9a0 tx=0x7f491400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.235 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.198+0000 7f4921ffb700 1 -- 172.21.15.17:0/41170832 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400cbd0 con 0x7f492406c9a0 2023-07-14T13:18:21.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.198+0000 7f4921ffb700 1 -- 172.21.15.17:0/41170832 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f491400cd30 con 0x7f492406c9a0 2023-07-14T13:18:21.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.198+0000 7f4921ffb700 1 -- 172.21.15.17:0/41170832 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914018680 con 0x7f492406c9a0 2023-07-14T13:18:21.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.198+0000 7f492b1ff700 1 -- 172.21.15.17:0/41170832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49241a5820 con 0x7f492406c9a0 2023-07-14T13:18:21.236 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.198+0000 7f492b1ff700 1 -- 172.21.15.17:0/41170832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49241b19e0 con 0x7f492406c9a0 2023-07-14T13:18:21.243 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.206+0000 7f493ebb4b80 1 Processor -- start 2023-07-14T13:18:21.247 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.210+0000 7f493ebb4b80 1 -- start start 2023-07-14T13:18:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.212+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 0x55913c1466a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.212+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c146be0 0x55913c151590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.212+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c151ad0 0x55913c153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.212+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913c04ccb0 con 0x55913c151ad0 2023-07-14T13:18:21.249 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.212+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913c09fa40 con 0x55913c146be0 2023-07-14T13:18:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.212+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913c098ed0 con 0x55913c1462d0 2023-07-14T13:18:21.250 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.213+0000 7f492979c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 0x55913c1466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.214+0000 7f4923fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c151ad0 0x55913c153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.214+0000 7f4923fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c151ad0 0x55913c153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34138/0 (socket says 172.21.15.17:34138) 2023-07-14T13:18:21.251 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.214+0000 7f4923fff700 1 -- 172.21.15.17:0/3151887449 learned_addr learned my addr 172.21.15.17:0/3151887449 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.214+0000 7f4921ffb700 1 -- 172.21.15.17:0/41170832 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4914010430 con 0x7f492406c9a0 2023-07-14T13:18:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.215+0000 7f4923fff700 1 -- 172.21.15.17:0/3151887449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 msgr2=0x55913c1466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.252 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.215+0000 7f4923fff700 1 --2- 172.21.15.17:0/3151887449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 0x55913c1466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.215+0000 7f4923fff700 1 -- 172.21.15.17:0/3151887449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c146be0 msgr2=0x55913c151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.215+0000 7f4923fff700 1 --2- 172.21.15.17:0/3151887449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c146be0 0x55913c151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.215+0000 7f4923fff700 1 -- 172.21.15.17:0/3151887449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55913bec6de0 con 0x55913c151ad0 2023-07-14T13:18:21.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.215+0000 7f4923fff700 1 --2- 172.21.15.17:0/3151887449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c151ad0 0x55913c153eb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4918007c60 tx=0x7f4918007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a324b6daf2ff4b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.216+0000 7f490affd700 1 -- 172.21.15.17:0/3151887449 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918004310 con 0x55913c151ad0 2023-07-14T13:18:21.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.216+0000 7f490affd700 1 -- 172.21.15.17:0/3151887449 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4918010e10 con 0x55913c151ad0 2023-07-14T13:18:21.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.216+0000 7f490affd700 1 -- 172.21.15.17:0/3151887449 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918003e70 con 0x55913c151ad0 2023-07-14T13:18:21.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.217+0000 7f4921ffb700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f490c0a1410 0x7f490c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.217+0000 7f4921ffb700 1 -- 172.21.15.17:0/41170832 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4914014070 con 0x7f492406c9a0 2023-07-14T13:18:21.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.218+0000 7f493ebb4b80 1 -- 172.21.15.17:0/3151887449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c151ad0 msgr2=0x55913c153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.218+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/3151887449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c151ad0 0x55913c153eb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4918007c60 tx=0x7f4918007f70 comp rx=0 tx=0).stop 2023-07-14T13:18:21.255 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.218+0000 7f492979c700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f490c0a1410 0x7f490c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.219+0000 7f493ebb4b80 1 -- 172.21.15.17:0/3151887449 shutdown_connections 2023-07-14T13:18:21.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.219+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/3151887449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c151ad0 0x55913c153eb0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.219+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/3151887449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 0x55913c1466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.219+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/3151887449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c146be0 0x55913c151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.219+0000 7f493ebb4b80 1 -- 172.21.15.17:0/3151887449 >> 172.21.15.17:0/3151887449 conn(0x55913c13cda0 msgr2=0x55913c1426a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.219+0000 7f492979c700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f490c0a1410 0x7f490c0a38c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f491c009fd0 tx=0x7f491c009780 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.220+0000 7f493ebb4b80 1 -- 172.21.15.17:0/3151887449 shutdown_connections 2023-07-14T13:18:21.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.223+0000 7f493ebb4b80 1 -- 172.21.15.17:0/3151887449 wait complete. 2023-07-14T13:18:21.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.223+0000 7f493ebb4b80 1 -- start start 2023-07-14T13:18:21.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.224+0000 7f493ebb4b80 1 Processor -- start 2023-07-14T13:18:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.225+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c1462d0 0x55913c14e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.225+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c146be0 0x55913c14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.225+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c151ad0 0x55913c14f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.225+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913c038ac0 con 0x55913c146be0 2023-07-14T13:18:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.225+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913c0387c0 con 0x55913c1462d0 2023-07-14T13:18:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.226+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913bf1c920 con 0x55913c151ad0 2023-07-14T13:18:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.226+0000 7f493ebb4b80 10 client.0 _ll_register_callbacks cb 0x55913c036760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.226+0000 7f4923fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c146be0 0x55913c14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.226+0000 7f4923fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c146be0 0x55913c14eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34140/0 (socket says 172.21.15.17:34140) 2023-07-14T13:18:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.226+0000 7f4923fff700 1 -- 172.21.15.17:0/862655078 learned_addr learned my addr 172.21.15.17:0/862655078 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:21.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.226+0000 7f4928f9b700 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c1462d0 0x55913c14e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.227+0000 7f4928f9b700 1 -- 172.21.15.17:0/862655078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c151ad0 msgr2=0x55913c14f2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:18:21.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.227+0000 7f4928f9b700 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c151ad0 0x55913c14f2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.227+0000 7f4928f9b700 1 -- 172.21.15.17:0/862655078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c146be0 msgr2=0x55913c14eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.227+0000 7f4928f9b700 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c146be0 0x55913c14eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.227+0000 7f4928f9b700 1 -- 172.21.15.17:0/862655078 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49180078c0 con 0x55913c1462d0 2023-07-14T13:18:21.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.228+0000 7f4928f9b700 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c1462d0 0x55913c14e860 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f49140ca610 tx=0x7f4914099970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dde24eb8f1b6e090 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.228+0000 7f4903fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:18:21.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.228+0000 7f4903fff700 1 -- 172.21.15.17:0/862655078 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140a23e0 con 0x55913c1462d0 2023-07-14T13:18:21.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.229+0000 7f4903fff700 1 -- 172.21.15.17:0/862655078 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f49140a1f50 con 0x55913c1462d0 2023-07-14T13:18:21.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.229+0000 7f493ebb4b80 1 -- 172.21.15.17:0/862655078 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55913bff24f0 con 0x55913c1462d0 2023-07-14T13:18:21.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.234+0000 7f4903fff700 1 -- 172.21.15.17:0/862655078 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49140a2110 con 0x55913c1462d0 2023-07-14T13:18:21.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.234+0000 7f493ebb4b80 10 client.28454 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:21.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.234+0000 7f493ebb4b80 1 -- 172.21.15.17:0/862655078 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55913beafc60 con 0x55913c1462d0 2023-07-14T13:18:21.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.234+0000 7f4903fff700 1 -- 172.21.15.17:0/862655078 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55913bff24f0 con 0x55913c1462d0 2023-07-14T13:18:21.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.234+0000 7f4903fff700 1 -- 172.21.15.17:0/862655078 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4914098ef0 con 0x55913c1462d0 2023-07-14T13:18:21.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.234+0000 7f493ebb4b80 10 client.28454 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:21.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.234+0000 7f493ebb4b80 10 client.28454 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:18:21.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.234+0000 7f493ebb4b80 20 client.28454 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:21.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.234+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55913c172470 0x55913c174880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.234+0000 7f493ebb4b80 4 client.28454 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:21.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.234+0000 7f493ebb4b80 1 -- 172.21.15.17:0/862655078 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55913c091eb0 con 0x55913c172470 2023-07-14T13:18:21.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.235+0000 7f4923fff700 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55913c172470 0x55913c174880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.235+0000 7f4903fff700 10 client.28454 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:18:21.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.235+0000 7f4923fff700 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55913c172470 0x55913c174880 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f5701834cecdec37 server_cookie=611d5f6d9a544a03 in_seq=0 out_seq=0 2023-07-14T13:18:21.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.240+0000 7f4903fff700 1 -- 172.21.15.17:0/862655078 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55913c091eb0 con 0x55913c172470 2023-07-14T13:18:21.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.240+0000 7f4903fff700 10 client.28454 handle_command_reply: tid=0 2023-07-14T13:18:21.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.240+0000 7f493ebb4b80 1 client.28454 shutdown 2023-07-14T13:18:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.243+0000 7f493ebb4b80 1 -- 172.21.15.17:0/862655078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c1462d0 msgr2=0x55913c14e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.243+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c1462d0 0x55913c14e860 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f49140ca610 tx=0x7f4914099970 comp rx=0 tx=0).stop 2023-07-14T13:18:21.280 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.243+0000 7f493ebb4b80 1 -- 172.21.15.17:0/862655078 shutdown_connections 2023-07-14T13:18:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.243+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55913c172470 0x55913c174880 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.243+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c151ad0 0x55913c14f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.243+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c1462d0 0x55913c14e860 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.243+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/862655078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c146be0 0x55913c14eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.243+0000 7f493ebb4b80 1 -- 172.21.15.17:0/862655078 >> 172.21.15.17:0/862655078 conn(0x55913c13cda0 msgr2=0x55913c142230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.281 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.243+0000 7f4903fff700 0 client.28454 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:18:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.243+0000 7f493ebb4b80 1 -- 172.21.15.17:0/862655078 shutdown_connections 2023-07-14T13:18:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.243+0000 7f493ebb4b80 1 -- 172.21.15.17:0/862655078 wait complete. 2023-07-14T13:18:21.282 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.244+0000 7f493ebb4b80 20 client.28454 trim_cache size 0 max 16384 2023-07-14T13:18:21.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.270+0000 7f493ebb4b80 1 Processor -- start 2023-07-14T13:18:21.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.270+0000 7f493ebb4b80 1 -- start start 2023-07-14T13:18:21.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.270+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 0x55913c1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.270+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c1462d0 0x55913c14f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.271+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c146be0 0x55913c14baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.271+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913c147540 con 0x55913c1462d0 2023-07-14T13:18:21.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.271+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913c141490 con 0x55913c13cda0 2023-07-14T13:18:21.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.271+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913c143c70 con 0x55913c146be0 2023-07-14T13:18:21.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.271+0000 7f4928f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 0x55913c1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.271+0000 7f4928f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 0x55913c1584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58466/0 (socket says 172.21.15.17:58466) 2023-07-14T13:18:21.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.271+0000 7f4928f9b700 1 -- 172.21.15.17:0/2909676331 learned_addr learned my addr 172.21.15.17:0/2909676331 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:21.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.271+0000 7f492979c700 1 --2- 172.21.15.17:0/2909676331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c146be0 0x55913c14baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.272+0000 7f4923fff700 1 --2- 172.21.15.17:0/2909676331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c1462d0 0x55913c14f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.272+0000 7f4928f9b700 1 -- 172.21.15.17:0/2909676331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c146be0 msgr2=0x55913c14baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.272+0000 7f4928f9b700 1 --2- 172.21.15.17:0/2909676331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c146be0 0x55913c14baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.272+0000 7f4928f9b700 1 -- 172.21.15.17:0/2909676331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c1462d0 msgr2=0x55913c14f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.272+0000 7f4928f9b700 1 --2- 172.21.15.17:0/2909676331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c1462d0 0x55913c14f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.272+0000 7f4928f9b700 1 -- 172.21.15.17:0/2909676331 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55913c13e5e0 con 0x55913c13cda0 2023-07-14T13:18:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.272+0000 7f4928f9b700 1 --2- 172.21.15.17:0/2909676331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 0x55913c1584e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f491400e970 tx=0x7f49140092d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35e5e39e37eea1e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.272+0000 7f490b7fe700 1 -- 172.21.15.17:0/2909676331 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140a23e0 con 0x55913c13cda0 2023-07-14T13:18:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.272+0000 7f490b7fe700 1 -- 172.21.15.17:0/2909676331 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f491409b0e0 con 0x55913c13cda0 2023-07-14T13:18:21.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.272+0000 7f490b7fe700 1 -- 172.21.15.17:0/2909676331 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140ca290 con 0x55913c13cda0 2023-07-14T13:18:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.273+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2909676331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 msgr2=0x55913c1584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.273+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/2909676331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 0x55913c1584e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f491400e970 tx=0x7f49140092d0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.274+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2909676331 shutdown_connections 2023-07-14T13:18:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.274+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/2909676331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c146be0 0x55913c14baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.274+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/2909676331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 0x55913c1584e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.274+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/2909676331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c1462d0 0x55913c14f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.274+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2909676331 >> 172.21.15.17:0/2909676331 conn(0x55913c16ebf0 msgr2=0x55913c149bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.274+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2909676331 shutdown_connections 2023-07-14T13:18:21.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.274+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2909676331 wait complete. 2023-07-14T13:18:21.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.275+0000 7f493ebb4b80 1 -- start start 2023-07-14T13:18:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.275+0000 7f493ebb4b80 1 Processor -- start 2023-07-14T13:18:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.276+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 0x55913c1bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.276+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 0x55913c1bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.276+0000 7f493ebb4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c146be0 0x55913c1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.276+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913c156a90 con 0x55913c146be0 2023-07-14T13:18:21.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.276+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913c156c00 con 0x55913c13cda0 2023-07-14T13:18:21.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.276+0000 7f493ebb4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913c156dc0 con 0x55913c1462d0 2023-07-14T13:18:21.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.276+0000 7f493ebb4b80 10 client.0 _ll_register_callbacks cb 0x7f4914099d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:21.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.277+0000 7f4928f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 0x55913c1bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.277+0000 7f4923fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 0x55913c1bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.277+0000 7f4923fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 0x55913c1bfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57408/0 (socket says 172.21.15.17:57408) 2023-07-14T13:18:21.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.277+0000 7f4923fff700 1 -- 172.21.15.17:0/2126100374 learned_addr learned my addr 172.21.15.17:0/2126100374 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:21.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.277+0000 7f492979c700 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c146be0 0x55913c1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.277+0000 7f4923fff700 1 -- 172.21.15.17:0/2126100374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 msgr2=0x55913c1bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.277+0000 7f4923fff700 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 0x55913c1bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.277+0000 7f4923fff700 1 -- 172.21.15.17:0/2126100374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c146be0 msgr2=0x55913c1564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.277+0000 7f4923fff700 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c146be0 0x55913c1564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.277+0000 7f4923fff700 1 -- 172.21.15.17:0/2126100374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55913beafc60 con 0x55913c1462d0 2023-07-14T13:18:21.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.278+0000 7f4923fff700 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 0x55913c1bfb30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4918005fd0 tx=0x7f49180058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f00516807c000afb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.278+0000 7f4903fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:18:21.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.278+0000 7f4903fff700 1 -- 172.21.15.17:0/2126100374 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491801e040 con 0x55913c1462d0 2023-07-14T13:18:21.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.278+0000 7f4903fff700 1 -- 172.21.15.17:0/2126100374 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4918027cb0 con 0x55913c1462d0 2023-07-14T13:18:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.278+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2126100374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4918010e10 con 0x55913c1462d0 2023-07-14T13:18:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.279+0000 7f4903fff700 1 -- 172.21.15.17:0/2126100374 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4918027e70 con 0x55913c1462d0 2023-07-14T13:18:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.279+0000 7f493ebb4b80 10 client.28429 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.279+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2126100374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55913beed250 con 0x55913c1462d0 2023-07-14T13:18:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.280+0000 7f4903fff700 1 -- 172.21.15.17:0/2126100374 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4918010e10 con 0x55913c1462d0 2023-07-14T13:18:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.280+0000 7f4903fff700 1 -- 172.21.15.17:0/2126100374 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f49180050a0 con 0x55913c1462d0 2023-07-14T13:18:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.280+0000 7f493ebb4b80 10 client.28429 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.280+0000 7f493ebb4b80 10 client.28429 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:18:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.280+0000 7f493ebb4b80 20 client.28429 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.280+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55913c151ad0 0x55913c1c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.280+0000 7f493ebb4b80 4 client.28429 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:18:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.280+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2126100374 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55913c054050 con 0x55913c151ad0 2023-07-14T13:18:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.281+0000 7f4928f9b700 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55913c151ad0 0x55913c1c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.281+0000 7f4928f9b700 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55913c151ad0 0x55913c1c9350 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=548b5e5c4193f98f server_cookie=d07688a06a310637 in_seq=0 out_seq=0 2023-07-14T13:18:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.281+0000 7f4903fff700 10 client.28429 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:18:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.282+0000 7f4903fff700 1 -- 172.21.15.17:0/2126100374 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55913c054050 con 0x55913c151ad0 2023-07-14T13:18:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.282+0000 7f4903fff700 10 client.28429 handle_command_reply: tid=0 2023-07-14T13:18:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.282+0000 7f493ebb4b80 1 client.28429 shutdown 2023-07-14T13:18:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.283+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2126100374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 msgr2=0x55913c1bfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.283+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 0x55913c1bfb30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4918005fd0 tx=0x7f49180058e0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.283+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2126100374 shutdown_connections 2023-07-14T13:18:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.283+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55913c146be0 0x55913c1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.283+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55913c13cda0 0x55913c1bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.283+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x55913c151ad0 0x55913c1c9350 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.283+0000 7f493ebb4b80 1 --2- 172.21.15.17:0/2126100374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55913c1462d0 0x55913c1bfb30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.283+0000 7f4903fff700 0 client.28429 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:18:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.283+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2126100374 >> 172.21.15.17:0/2126100374 conn(0x55913c16ebf0 msgr2=0x55913c1483e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.283+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2126100374 shutdown_connections 2023-07-14T13:18:21.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.284+0000 7f493ebb4b80 1 -- 172.21.15.17:0/2126100374 wait complete. 2023-07-14T13:18:21.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.284+0000 7f493ebb4b80 20 client.28429 trim_cache size 0 max 16384 2023-07-14T13:18:21.323 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:18:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 -- 172.21.15.17:0/41170832 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f490c0a1410 msgr2=0x7f490c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f490c0a1410 0x7f490c0a38c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f491c009fd0 tx=0x7f491c009780 comp rx=0 tx=0).stop 2023-07-14T13:18:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 -- 172.21.15.17:0/41170832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f492406c9a0 msgr2=0x7f49241aaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f492406c9a0 0x7f49241aaa60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f491400e9a0 tx=0x7f491400ecb0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 -- 172.21.15.17:0/41170832 shutdown_connections 2023-07-14T13:18:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f490c0a1410 0x7f490c0a38c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f492410e280 0x7f49241a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f492406c9a0 0x7f49241aaa60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 --2- 172.21.15.17:0/41170832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f492406d3a0 0x7f49241aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 -- 172.21.15.17:0/41170832 >> 172.21.15.17:0/41170832 conn(0x7f492406bf70 msgr2=0x7f492406f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 -- 172.21.15.17:0/41170832 shutdown_connections 2023-07-14T13:18:21.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.285+0000 7f492b1ff700 1 -- 172.21.15.17:0/41170832 wait complete. 2023-07-14T13:18:21.352 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:18:21.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:21 smithi017 ceph-mon[95536]: pgmap v587: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 26 MiB/s wr, 228 op/s 2023-07-14T13:18:21.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:21 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/4248413920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:18:21.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:21 smithi135 ceph-mon[97338]: pgmap v587: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 26 MiB/s wr, 228 op/s 2023-07-14T13:18:21.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:21 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/4248413920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:18:21.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.712+0000 7f2ca07ff700 1 -- 172.21.15.17:0/662264914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c981049e0 msgr2=0x7f2c98104db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.712+0000 7f2ca07ff700 1 --2- 172.21.15.17:0/662264914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c981049e0 0x7f2c98104db0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009990 tx=0x7f2c88009ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:21 smithi131 ceph-mon[96953]: pgmap v587: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 26 MiB/s wr, 228 op/s 2023-07-14T13:18:21.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:21 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/4248413920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:18:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.721+0000 7f2ca07ff700 1 -- 172.21.15.17:0/662264914 shutdown_connections 2023-07-14T13:18:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.721+0000 7f2ca07ff700 1 --2- 172.21.15.17:0/662264914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c980ff380 0x7f2c9810b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.721+0000 7f2ca07ff700 1 --2- 172.21.15.17:0/662264914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c981049e0 0x7f2c98104db0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.721+0000 7f2ca07ff700 1 --2- 172.21.15.17:0/662264914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c980fe9d0 0x7f2c980fee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.721+0000 7f2ca07ff700 1 -- 172.21.15.17:0/662264914 >> 172.21.15.17:0/662264914 conn(0x7f2c980fa4b0 msgr2=0x7f2c980fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.723+0000 7f2ca07ff700 1 -- 172.21.15.17:0/662264914 shutdown_connections 2023-07-14T13:18:21.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.723+0000 7f2ca07ff700 1 -- 172.21.15.17:0/662264914 wait complete. 2023-07-14T13:18:21.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.725+0000 7f2ca07ff700 1 Processor -- start 2023-07-14T13:18:21.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.725+0000 7f2ca07ff700 1 -- start start 2023-07-14T13:18:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.725+0000 7f2ca07ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c980fe9d0 0x7f2c98199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.726+0000 7f2ca07ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980ff380 0x7f2c98199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.726+0000 7f2ca07ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c981049e0 0x7f2c98193860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.726+0000 7f2ca07ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98194030 con 0x7f2c981049e0 2023-07-14T13:18:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.726+0000 7f2ca07ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98194170 con 0x7f2c980fe9d0 2023-07-14T13:18:21.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.726+0000 7f2ca07ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98194330 con 0x7f2c980ff380 2023-07-14T13:18:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.727+0000 7f2c9dd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980ff380 0x7f2c98199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.727+0000 7f2c9dd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980ff380 0x7f2c98199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57436/0 (socket says 172.21.15.17:57436) 2023-07-14T13:18:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.727+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/355156752 learned_addr learned my addr 172.21.15.17:0/355156752 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:21.764 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.727+0000 7f2c9e59b700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c980fe9d0 0x7f2c98199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.727+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/355156752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c980fe9d0 msgr2=0x7f2c98199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.727+0000 7f2c9dd9a700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c980fe9d0 0x7f2c98199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.727+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/355156752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c981049e0 msgr2=0x7f2c98193860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.727+0000 7f2c9dd9a700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c981049e0 0x7f2c98193860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.765 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.727+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/355156752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c880095f0 con 0x7f2c980ff380 2023-07-14T13:18:21.766 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.729+0000 7f2c9dd9a700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980ff380 0x7f2c98199dc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400ada0 tx=0x7f2c9400c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.768 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.732+0000 7f2c8f7fe700 1 -- 172.21.15.17:0/355156752 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400f070 con 0x7f2c980ff380 2023-07-14T13:18:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.732+0000 7f2c8f7fe700 1 -- 172.21.15.17:0/355156752 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c94007bf0 con 0x7f2c980ff380 2023-07-14T13:18:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.732+0000 7f2c8f7fe700 1 -- 172.21.15.17:0/355156752 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94005480 con 0x7f2c980ff380 2023-07-14T13:18:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.732+0000 7f2ca07ff700 1 -- 172.21.15.17:0/355156752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c98194610 con 0x7f2c980ff380 2023-07-14T13:18:21.769 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.732+0000 7f2ca07ff700 1 -- 172.21.15.17:0/355156752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9806a110 con 0x7f2c980ff380 2023-07-14T13:18:21.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.743+0000 7f2cb417ab80 1 Processor -- start 2023-07-14T13:18:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.744+0000 7f2cb417ab80 1 -- start start 2023-07-14T13:18:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.744+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8baed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.744+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baedbe0 0x561e8baf8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.744+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baf8ad0 0x561e8bafaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.744+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8b9f3cb0 con 0x561e8baf8ad0 2023-07-14T13:18:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.744+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8ba46a40 con 0x561e8baed2d0 2023-07-14T13:18:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.744+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8ba3fed0 con 0x561e8baedbe0 2023-07-14T13:18:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.745+0000 7f2c9ed9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8baed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.745+0000 7f2c9ed9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8baed6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58490/0 (socket says 172.21.15.17:58490) 2023-07-14T13:18:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.745+0000 7f2c9ed9c700 1 -- 172.21.15.17:0/553730519 learned_addr learned my addr 172.21.15.17:0/553730519 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.745+0000 7f2c9e59b700 1 --2- 172.21.15.17:0/553730519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baedbe0 0x561e8baf8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.746+0000 7f2c9ed9c700 1 -- 172.21.15.17:0/553730519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baedbe0 msgr2=0x561e8baf8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.746+0000 7f2c9ed9c700 1 --2- 172.21.15.17:0/553730519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baedbe0 0x561e8baf8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.746+0000 7f2c9ed9c700 1 -- 172.21.15.17:0/553730519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baf8ad0 msgr2=0x561e8bafaeb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:18:21.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.746+0000 7f2c9ed9c700 1 --2- 172.21.15.17:0/553730519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baf8ad0 0x561e8bafaeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.746+0000 7f2c9ed9c700 1 -- 172.21.15.17:0/553730519 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e8b86dde0 con 0x561e8baed2d0 2023-07-14T13:18:21.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.747+0000 7f2c9ed9c700 1 --2- 172.21.15.17:0/553730519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8baed6a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2c9002b890 tx=0x7f2c9002bba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae115ffbb52630f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.747+0000 7f2c8f7fe700 1 -- 172.21.15.17:0/355156752 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2c94004ad0 con 0x7f2c980ff380 2023-07-14T13:18:21.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.748+0000 7f2c8cff9700 1 -- 172.21.15.17:0/553730519 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9002d680 con 0x561e8baed2d0 2023-07-14T13:18:21.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.748+0000 7f2c8cff9700 1 -- 172.21.15.17:0/553730519 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c9002dc70 con 0x561e8baed2d0 2023-07-14T13:18:21.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.748+0000 7f2c8cff9700 1 -- 172.21.15.17:0/553730519 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90033c90 con 0x561e8baed2d0 2023-07-14T13:18:21.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.749+0000 7f2c8f7fe700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c840a1460 0x7f2c840a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.749+0000 7f2c8f7fe700 1 -- 172.21.15.17:0/355156752 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2c940cc3b0 con 0x7f2c980ff380 2023-07-14T13:18:21.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.750+0000 7f2cb417ab80 1 -- 172.21.15.17:0/553730519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 msgr2=0x561e8baed6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.750+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/553730519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8baed6a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2c9002b890 tx=0x7f2c9002bba0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.750+0000 7f2cb417ab80 1 -- 172.21.15.17:0/553730519 shutdown_connections 2023-07-14T13:18:21.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.750+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/553730519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baf8ad0 0x561e8bafaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.750+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/553730519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8baed6a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.751+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/553730519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baedbe0 0x561e8baf8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.751+0000 7f2cb417ab80 1 -- 172.21.15.17:0/553730519 >> 172.21.15.17:0/553730519 conn(0x561e8bae3da0 msgr2=0x561e8bae96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.751+0000 7f2c9e59b700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c840a1460 0x7f2c840a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.752+0000 7f2cb417ab80 1 -- 172.21.15.17:0/553730519 shutdown_connections 2023-07-14T13:18:21.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.752+0000 7f2c9e59b700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c840a1460 0x7f2c840a3910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c880036f0 tx=0x7f2c88003680 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.752+0000 7f2cb417ab80 1 -- 172.21.15.17:0/553730519 wait complete. 2023-07-14T13:18:21.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.753+0000 7f2cb417ab80 1 -- start start 2023-07-14T13:18:21.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.754+0000 7f2cb417ab80 1 Processor -- start 2023-07-14T13:18:21.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.754+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8baf8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.754+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baedbe0 0x561e8baf57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.754+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baf8ad0 0x561e8baf5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.754+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8b9dfac0 con 0x561e8baedbe0 2023-07-14T13:18:21.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.754+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8b9df7c0 con 0x561e8baed2d0 2023-07-14T13:18:21.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.754+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8b8c3920 con 0x561e8baf8ad0 2023-07-14T13:18:21.792 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.755+0000 7f2cb417ab80 10 client.0 _ll_register_callbacks cb 0x561e8b9dd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:21.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.755+0000 7f2c9dd9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baedbe0 0x561e8baf57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.755+0000 7f2c9dd9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baedbe0 0x561e8baf57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34182/0 (socket says 172.21.15.17:34182) 2023-07-14T13:18:21.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.755+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/179382636 learned_addr learned my addr 172.21.15.17:0/179382636 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:21.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.755+0000 7f2c9ed9c700 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baf8ad0 0x561e8baf5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.755+0000 7f2c9e59b700 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8baf8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.756+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/179382636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baf8ad0 msgr2=0x561e8baf5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.756+0000 7f2c9dd9a700 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baf8ad0 0x561e8baf5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.756+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/179382636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 msgr2=0x561e8baf8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.756+0000 7f2c9dd9a700 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8baf8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.756+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/179382636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9002b4c0 con 0x561e8baedbe0 2023-07-14T13:18:21.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.757+0000 7f2c9dd9a700 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baedbe0 0x561e8baf57e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400ad70 tx=0x7f2c94019330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b683f0fe469210b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.757+0000 7f2c81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:21.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.757+0000 7f2c81ffb700 1 -- 172.21.15.17:0/179382636 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c940a1890 con 0x561e8baedbe0 2023-07-14T13:18:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.757+0000 7f2c81ffb700 1 -- 172.21.15.17:0/179382636 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2c9409d120 con 0x561e8baedbe0 2023-07-14T13:18:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.757+0000 7f2cb417ab80 1 -- 172.21.15.17:0/179382636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e8b9994f0 con 0x561e8baedbe0 2023-07-14T13:18:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.758+0000 7f2c81ffb700 1 -- 172.21.15.17:0/179382636 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c9409d2e0 con 0x561e8baedbe0 2023-07-14T13:18:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.758+0000 7f2cb417ab80 10 client.18756 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:21.796 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.758+0000 7f2cb417ab80 1 -- 172.21.15.17:0/179382636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x561e8b856c60 con 0x561e8baedbe0 2023-07-14T13:18:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.759+0000 7f2c81ffb700 1 -- 172.21.15.17:0/179382636 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c940b7020 con 0x561e8baedbe0 2023-07-14T13:18:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.759+0000 7f2c81ffb700 1 -- 172.21.15.17:0/179382636 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2c940cc070 con 0x561e8baedbe0 2023-07-14T13:18:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.759+0000 7f2cb417ab80 10 client.18756 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.759+0000 7f2cb417ab80 10 client.18756 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:18:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.759+0000 7f2cb417ab80 20 client.18756 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:21.797 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.759+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561e8bb10b60 0x561e8bb12f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.759+0000 7f2cb417ab80 4 client.18756 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.759+0000 7f2cb417ab80 1 -- 172.21.15.17:0/179382636 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e8ba38eb0 con 0x561e8bb10b60 2023-07-14T13:18:21.798 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.760+0000 7f2c9e59b700 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561e8bb10b60 0x561e8bb12f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.762+0000 7f2c9e59b700 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561e8bb10b60 0x561e8bb12f70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e5860188eb894a2c server_cookie=b3627c6bc026006a in_seq=0 out_seq=0 2023-07-14T13:18:21.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.762+0000 7f2c81ffb700 10 client.18756 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:18:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.763+0000 7f2c81ffb700 1 -- 172.21.15.17:0/179382636 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561e8ba38eb0 con 0x561e8bb10b60 2023-07-14T13:18:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.763+0000 7f2c81ffb700 10 client.18756 handle_command_reply: tid=0 2023-07-14T13:18:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.763+0000 7f2cb417ab80 1 client.18756 shutdown 2023-07-14T13:18:21.800 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.763+0000 7f2cb417ab80 1 -- 172.21.15.17:0/179382636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baedbe0 msgr2=0x561e8baf57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.763+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baedbe0 0x561e8baf57e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400ad70 tx=0x7f2c94019330 comp rx=0 tx=0).stop 2023-07-14T13:18:21.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.763+0000 7f2cb417ab80 1 -- 172.21.15.17:0/179382636 shutdown_connections 2023-07-14T13:18:21.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.763+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baf8ad0 0x561e8baf5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.763+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561e8bb10b60 0x561e8bb12f70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.763+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8baf8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.763+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/179382636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baedbe0 0x561e8baf57e0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.801 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.763+0000 7f2cb417ab80 1 -- 172.21.15.17:0/179382636 >> 172.21.15.17:0/179382636 conn(0x561e8bae3da0 msgr2=0x561e8bae9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.764+0000 7f2c81ffb700 0 client.18756 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:18:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.765+0000 7f2cb417ab80 1 -- 172.21.15.17:0/179382636 shutdown_connections 2023-07-14T13:18:21.802 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.765+0000 7f2cb417ab80 1 -- 172.21.15.17:0/179382636 wait complete. 2023-07-14T13:18:21.803 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.766+0000 7f2cb417ab80 20 client.18756 trim_cache size 0 max 16384 2023-07-14T13:18:21.827 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.789+0000 7f2cb417ab80 1 Processor -- start 2023-07-14T13:18:21.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.792+0000 7f2cb417ab80 1 -- start start 2023-07-14T13:18:21.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.792+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baed2d0 0x561e8baf4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.792+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baedbe0 0x561e8baf8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.792+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baf8ad0 0x561e8baf2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.829 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.792+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8baee310 con 0x561e8baed2d0 2023-07-14T13:18:21.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.792+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8baf6dc0 con 0x561e8baedbe0 2023-07-14T13:18:21.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.792+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8bb0e290 con 0x561e8baf8ad0 2023-07-14T13:18:21.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.793+0000 7f2c9dd9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baedbe0 0x561e8baf8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.793+0000 7f2c9dd9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baedbe0 0x561e8baf8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58514/0 (socket says 172.21.15.17:58514) 2023-07-14T13:18:21.830 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.793+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/2067364062 learned_addr learned my addr 172.21.15.17:0/2067364062 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.794+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/2067364062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baf8ad0 msgr2=0x561e8baf2a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:18:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.794+0000 7f2c9dd9a700 1 --2- 172.21.15.17:0/2067364062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baf8ad0 0x561e8baf2a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.794+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/2067364062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baed2d0 msgr2=0x561e8baf4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.794+0000 7f2c9dd9a700 1 --2- 172.21.15.17:0/2067364062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baed2d0 0x561e8baf4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.831 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.794+0000 7f2c9dd9a700 1 -- 172.21.15.17:0/2067364062 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e8b894250 con 0x561e8baedbe0 2023-07-14T13:18:21.832 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.794+0000 7f2c9dd9a700 1 --2- 172.21.15.17:0/2067364062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baedbe0 0x561e8baf8100 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2c940991d0 tx=0x7f2c9409d680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71a95b8284cb820 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.834 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.797+0000 7f2c8d7fa700 1 -- 172.21.15.17:0/2067364062 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9409f240 con 0x561e8baedbe0 2023-07-14T13:18:21.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.797+0000 7f2c8d7fa700 1 -- 172.21.15.17:0/2067364062 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c940b7070 con 0x561e8baedbe0 2023-07-14T13:18:21.835 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.797+0000 7f2c8d7fa700 1 -- 172.21.15.17:0/2067364062 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94098c20 con 0x561e8baedbe0 2023-07-14T13:18:21.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.799+0000 7f2cb417ab80 1 -- 172.21.15.17:0/2067364062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baedbe0 msgr2=0x561e8baf8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.799+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/2067364062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baedbe0 0x561e8baf8100 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2c940991d0 tx=0x7f2c9409d680 comp rx=0 tx=0).stop 2023-07-14T13:18:21.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.799+0000 7f2cb417ab80 1 -- 172.21.15.17:0/2067364062 shutdown_connections 2023-07-14T13:18:21.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.799+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/2067364062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baf8ad0 0x561e8baf2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.836 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.799+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/2067364062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baed2d0 0x561e8baf4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.799+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/2067364062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baedbe0 0x561e8baf8100 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.799+0000 7f2cb417ab80 1 -- 172.21.15.17:0/2067364062 >> 172.21.15.17:0/2067364062 conn(0x561e8bae3da0 msgr2=0x561e8baf0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.837 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.799+0000 7f2cb417ab80 1 -- 172.21.15.17:0/2067364062 shutdown_connections 2023-07-14T13:18:21.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.800+0000 7f2cb417ab80 1 -- 172.21.15.17:0/2067364062 wait complete. 2023-07-14T13:18:21.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.800+0000 7f2cb417ab80 1 -- start start 2023-07-14T13:18:21.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.801+0000 7f2cb417ab80 1 Processor -- start 2023-07-14T13:18:21.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.802+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8bb07c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.802+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baedbe0 0x561e8bb060f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.802+0000 7f2cb417ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baf8ad0 0x561e8bb06630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.802+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8bb06bc0 con 0x561e8baf8ad0 2023-07-14T13:18:21.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.802+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8bb06d30 con 0x561e8baed2d0 2023-07-14T13:18:21.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.802+0000 7f2cb417ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8bb06ef0 con 0x561e8baedbe0 2023-07-14T13:18:21.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.802+0000 7f2cb417ab80 10 client.0 _ll_register_callbacks cb 0x7f2c94099010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:21.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.802+0000 7f2c9ed9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baf8ad0 0x561e8bb06630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.802+0000 7f2c9ed9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baf8ad0 0x561e8bb06630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34208/0 (socket says 172.21.15.17:34208) 2023-07-14T13:18:21.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.802+0000 7f2c9ed9c700 1 -- 172.21.15.17:0/4069753563 learned_addr learned my addr 172.21.15.17:0/4069753563 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:21.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.802+0000 7f2c9e59b700 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8bb07c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.803+0000 7f2c9dd9a700 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baedbe0 0x561e8bb060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.803+0000 7f2c9ed9c700 1 -- 172.21.15.17:0/4069753563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baedbe0 msgr2=0x561e8bb060f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.803+0000 7f2c9ed9c700 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baedbe0 0x561e8bb060f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.803+0000 7f2c9ed9c700 1 -- 172.21.15.17:0/4069753563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 msgr2=0x561e8bb07c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.803+0000 7f2c9ed9c700 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8bb07c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.803+0000 7f2c9ed9c700 1 -- 172.21.15.17:0/4069753563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e8b856c60 con 0x561e8baf8ad0 2023-07-14T13:18:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.803+0000 7f2c9dd9a700 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baedbe0 0x561e8bb060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:18:21.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.803+0000 7f2c9ed9c700 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baf8ad0 0x561e8bb06630 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2c90006ba0 tx=0x7f2c90006e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158714f358c5009f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:21.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.803+0000 7f2c81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:21.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.804+0000 7f2c81ffb700 1 -- 172.21.15.17:0/4069753563 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90034800 con 0x561e8baf8ad0 2023-07-14T13:18:21.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.804+0000 7f2c81ffb700 1 -- 172.21.15.17:0/4069753563 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2c90034960 con 0x561e8baf8ad0 2023-07-14T13:18:21.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.804+0000 7f2cb417ab80 1 -- 172.21.15.17:0/4069753563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c9002dc70 con 0x561e8baf8ad0 2023-07-14T13:18:21.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.804+0000 7f2c81ffb700 1 -- 172.21.15.17:0/4069753563 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c90034b20 con 0x561e8baf8ad0 2023-07-14T13:18:21.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.804+0000 7f2cb417ab80 10 client.18759 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:21.843 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.804+0000 7f2cb417ab80 1 -- 172.21.15.17:0/4069753563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x561e8b86c2b0 con 0x561e8baf8ad0 2023-07-14T13:18:21.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.806+0000 7f2c81ffb700 1 -- 172.21.15.17:0/4069753563 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c9002dc70 con 0x561e8baf8ad0 2023-07-14T13:18:21.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.806+0000 7f2c81ffb700 1 -- 172.21.15.17:0/4069753563 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2c9003d430 con 0x561e8baf8ad0 2023-07-14T13:18:21.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.806+0000 7f2cb417ab80 10 client.18759 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:21.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.806+0000 7f2cb417ab80 10 client.18759 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:18:21.844 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.806+0000 7f2cb417ab80 20 client.18759 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:21.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.806+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561e8bb65f40 0x561e8bb68350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:21.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.806+0000 7f2cb417ab80 4 client.18759 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:18:21.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.806+0000 7f2cb417ab80 1 -- 172.21.15.17:0/4069753563 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561e8b9fb050 con 0x561e8bb65f40 2023-07-14T13:18:21.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.807+0000 7f2c9e59b700 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561e8bb65f40 0x561e8bb68350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.808+0000 7f2c9e59b700 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561e8bb65f40 0x561e8bb68350 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d04cca9301df2da5 server_cookie=75b2014c1c2004f0 in_seq=0 out_seq=0 2023-07-14T13:18:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.808+0000 7f2c81ffb700 10 client.18759 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:18:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.808+0000 7f2c81ffb700 1 -- 172.21.15.17:0/4069753563 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561e8b9fb050 con 0x561e8bb65f40 2023-07-14T13:18:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.808+0000 7f2c81ffb700 10 client.18759 handle_command_reply: tid=0 2023-07-14T13:18:21.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.808+0000 7f2cb417ab80 1 client.18759 shutdown 2023-07-14T13:18:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.811+0000 7f2cb417ab80 1 -- 172.21.15.17:0/4069753563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baf8ad0 msgr2=0x561e8bb06630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.849 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.811+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baf8ad0 0x561e8bb06630 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2c90006ba0 tx=0x7f2c90006e10 comp rx=0 tx=0).stop 2023-07-14T13:18:21.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.812+0000 7f2cb417ab80 1 -- 172.21.15.17:0/4069753563 shutdown_connections 2023-07-14T13:18:21.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.812+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e8baf8ad0 0x561e8bb06630 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.812+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x561e8bb65f40 0x561e8bb68350 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.850 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.812+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e8baed2d0 0x561e8bb07c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.812+0000 7f2cb417ab80 1 --2- 172.21.15.17:0/4069753563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e8baedbe0 0x561e8bb060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.812+0000 7f2cb417ab80 1 -- 172.21.15.17:0/4069753563 >> 172.21.15.17:0/4069753563 conn(0x561e8bae3da0 msgr2=0x561e8baef2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.812+0000 7f2c81ffb700 0 client.18759 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:18:21.852 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.815+0000 7f2cb417ab80 1 -- 172.21.15.17:0/4069753563 shutdown_connections 2023-07-14T13:18:21.858 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:18:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.820+0000 7f2cb417ab80 1 -- 172.21.15.17:0/4069753563 wait complete. 2023-07-14T13:18:21.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.820+0000 7f2cb417ab80 20 client.18759 trim_cache size 0 max 16384 2023-07-14T13:18:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.825+0000 7f2ca07ff700 1 -- 172.21.15.17:0/355156752 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c840a1460 msgr2=0x7f2c840a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.825+0000 7f2ca07ff700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c840a1460 0x7f2c840a3910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c880036f0 tx=0x7f2c88003680 comp rx=0 tx=0).stop 2023-07-14T13:18:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.825+0000 7f2ca07ff700 1 -- 172.21.15.17:0/355156752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980ff380 msgr2=0x7f2c98199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:21.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.825+0000 7f2ca07ff700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980ff380 0x7f2c98199dc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400ada0 tx=0x7f2c9400c330 comp rx=0 tx=0).stop 2023-07-14T13:18:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.826+0000 7f2ca07ff700 1 -- 172.21.15.17:0/355156752 shutdown_connections 2023-07-14T13:18:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.826+0000 7f2ca07ff700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c840a1460 0x7f2c840a3910 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.826+0000 7f2ca07ff700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c981049e0 0x7f2c98193860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.826+0000 7f2ca07ff700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c980fe9d0 0x7f2c98199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.826+0000 7f2ca07ff700 1 --2- 172.21.15.17:0/355156752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c980ff380 0x7f2c98199dc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.826+0000 7f2ca07ff700 1 -- 172.21.15.17:0/355156752 >> 172.21.15.17:0/355156752 conn(0x7f2c980fa4b0 msgr2=0x7f2c980fbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.826+0000 7f2ca07ff700 1 -- 172.21.15.17:0/355156752 shutdown_connections 2023-07-14T13:18:21.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:21.826+0000 7f2ca07ff700 1 -- 172.21.15.17:0/355156752 wait complete. 2023-07-14T13:18:21.899 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:18:22.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.263+0000 7feafcdff700 1 -- 172.21.15.17:0/2990044368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf8100480 msgr2=0x7feaf810c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:22.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.263+0000 7feafcdff700 1 --2- 172.21.15.17:0/2990044368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf8100480 0x7feaf810c910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feaf000b0a0 tx=0x7feaf000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.264+0000 7feafcdff700 1 -- 172.21.15.17:0/2990044368 shutdown_connections 2023-07-14T13:18:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.264+0000 7feafcdff700 1 --2- 172.21.15.17:0/2990044368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf8100480 0x7feaf810c910 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.264+0000 7feafcdff700 1 --2- 172.21.15.17:0/2990044368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf8105ae0 0x7feaf8105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.264+0000 7feafcdff700 1 --2- 172.21.15.17:0/2990044368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf80ffad0 0x7feaf80fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.264+0000 7feafcdff700 1 -- 172.21.15.17:0/2990044368 >> 172.21.15.17:0/2990044368 conn(0x7feaf80fb5f0 msgr2=0x7feaf80fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:22.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.265+0000 7feafcdff700 1 -- 172.21.15.17:0/2990044368 shutdown_connections 2023-07-14T13:18:22.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.266+0000 7feafcdff700 1 -- 172.21.15.17:0/2990044368 wait complete. 2023-07-14T13:18:22.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.268+0000 7feafcdff700 1 Processor -- start 2023-07-14T13:18:22.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.268+0000 7feafcdff700 1 -- start start 2023-07-14T13:18:22.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.269+0000 7feafcdff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffad0 0x7feaf806f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.269+0000 7feafcdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf8100480 0x7feaf806fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.269+0000 7feafcdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf8105ae0 0x7feaf806aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.269+0000 7feafcdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf806b210 con 0x7feaf8100480 2023-07-14T13:18:22.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.269+0000 7feafcdff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf806b380 con 0x7feaf80ffad0 2023-07-14T13:18:22.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.269+0000 7feafcdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf806b540 con 0x7feaf8105ae0 2023-07-14T13:18:22.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.269+0000 7feaf659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffad0 0x7feaf806f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.269+0000 7feaf659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffad0 0x7feaf806f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58536/0 (socket says 172.21.15.17:58536) 2023-07-14T13:18:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.269+0000 7feaf659c700 1 -- 172.21.15.17:0/3326181288 learned_addr learned my addr 172.21.15.17:0/3326181288 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.270+0000 7feaf6d9d700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf8105ae0 0x7feaf806aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.270+0000 7feaf659c700 1 -- 172.21.15.17:0/3326181288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf8105ae0 msgr2=0x7feaf806aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:22.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.270+0000 7feaf659c700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf8105ae0 0x7feaf806aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.270+0000 7feaf659c700 1 -- 172.21.15.17:0/3326181288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf8100480 msgr2=0x7feaf806fee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:18:22.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.270+0000 7feaf659c700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf8100480 0x7feaf806fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.270+0000 7feaf659c700 1 -- 172.21.15.17:0/3326181288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf0009d00 con 0x7feaf80ffad0 2023-07-14T13:18:22.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.272+0000 7feaf659c700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffad0 0x7feaf806f980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7feae800b530 tx=0x7feae800b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:22.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.272+0000 7feae77fe700 1 -- 172.21.15.17:0/3326181288 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8011830 con 0x7feaf80ffad0 2023-07-14T13:18:22.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.272+0000 7feae77fe700 1 -- 172.21.15.17:0/3326181288 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feae8011e20 con 0x7feaf80ffad0 2023-07-14T13:18:22.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.272+0000 7feae77fe700 1 -- 172.21.15.17:0/3326181288 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8010dd0 con 0x7feaf80ffad0 2023-07-14T13:18:22.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.272+0000 7feafcdff700 1 -- 172.21.15.17:0/3326181288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf806b820 con 0x7feaf80ffad0 2023-07-14T13:18:22.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.273+0000 7feafcdff700 1 -- 172.21.15.17:0/3326181288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf80739c0 con 0x7feaf80ffad0 2023-07-14T13:18:22.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.281+0000 7feb107dcb80 1 Processor -- start 2023-07-14T13:18:22.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.282+0000 7feb107dcb80 1 -- start start 2023-07-14T13:18:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.284+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c24406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.284+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 0x55f3c244b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.284+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c244deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.284+0000 7feb107dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c2346cb0 con 0x55f3c2440be0 2023-07-14T13:18:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.284+0000 7feb107dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c2399a40 con 0x55f3c244bad0 2023-07-14T13:18:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.284+0000 7feb107dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c2392ed0 con 0x55f3c24402d0 2023-07-14T13:18:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.285+0000 7feaf6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c24406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.285+0000 7feaf6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c24406a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57502/0 (socket says 172.21.15.17:57502) 2023-07-14T13:18:22.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.285+0000 7feaf6d9d700 1 -- 172.21.15.17:0/2760010604 learned_addr learned my addr 172.21.15.17:0/2760010604 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.286+0000 7feaf5d9b700 1 --2- 172.21.15.17:0/2760010604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c244deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.286+0000 7feaf6d9d700 1 -- 172.21.15.17:0/2760010604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 msgr2=0x55f3c244deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.286+0000 7feaf6d9d700 1 --2- 172.21.15.17:0/2760010604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c244deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.286+0000 7feaf6d9d700 1 -- 172.21.15.17:0/2760010604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 msgr2=0x55f3c244b590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:18:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.286+0000 7feaf6d9d700 1 --2- 172.21.15.17:0/2760010604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 0x55f3c244b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.286+0000 7feaf6d9d700 1 -- 172.21.15.17:0/2760010604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3c21c0de0 con 0x55f3c24402d0 2023-07-14T13:18:22.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.287+0000 7feaf6d9d700 1 --2- 172.21.15.17:0/2760010604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c24406a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feaf000b0a0 tx=0x7feaf00094b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=738e4e0a3913ad50 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.287+0000 7feae4ff9700 1 -- 172.21.15.17:0/2760010604 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf000e040 con 0x55f3c24402d0 2023-07-14T13:18:22.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.288+0000 7feae4ff9700 1 -- 172.21.15.17:0/2760010604 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feaf0007e10 con 0x55f3c24402d0 2023-07-14T13:18:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.288+0000 7feae4ff9700 1 -- 172.21.15.17:0/2760010604 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0004de0 con 0x55f3c24402d0 2023-07-14T13:18:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.288+0000 7feae77fe700 1 -- 172.21.15.17:0/3326181288 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7feae8011990 con 0x7feaf80ffad0 2023-07-14T13:18:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.289+0000 7feb107dcb80 1 -- 172.21.15.17:0/2760010604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 msgr2=0x55f3c24406a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:22.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.289+0000 7feb107dcb80 1 --2- 172.21.15.17:0/2760010604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c24406a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feaf000b0a0 tx=0x7feaf00094b0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.290+0000 7feae77fe700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feae00a14d0 0x7feae00a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.291+0000 7feae77fe700 1 -- 172.21.15.17:0/3326181288 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feae80cc6c0 con 0x7feaf80ffad0 2023-07-14T13:18:22.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.291+0000 7feaf6d9d700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feae00a14d0 0x7feae00a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.292+0000 7feb107dcb80 1 -- 172.21.15.17:0/2760010604 shutdown_connections 2023-07-14T13:18:22.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.292+0000 7feb107dcb80 1 --2- 172.21.15.17:0/2760010604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c244deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.292+0000 7feb107dcb80 1 --2- 172.21.15.17:0/2760010604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c24406a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.292+0000 7feb107dcb80 1 --2- 172.21.15.17:0/2760010604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 0x55f3c244b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.292+0000 7feb107dcb80 1 -- 172.21.15.17:0/2760010604 >> 172.21.15.17:0/2760010604 conn(0x55f3c2436da0 msgr2=0x55f3c243c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:22.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.293+0000 7feaf6d9d700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feae00a14d0 0x7feae00a3980 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feaf000b040 tx=0x7feaf0028040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:22.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.298+0000 7feb107dcb80 1 -- 172.21.15.17:0/2760010604 shutdown_connections 2023-07-14T13:18:22.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.303+0000 7feb107dcb80 1 -- 172.21.15.17:0/2760010604 wait complete. 2023-07-14T13:18:22.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.303+0000 7feb107dcb80 1 -- start start 2023-07-14T13:18:22.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.304+0000 7feb107dcb80 1 Processor -- start 2023-07-14T13:18:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.305+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c244b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.305+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 0x55f3c2448770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.305+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.305+0000 7feb107dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c2332ac0 con 0x55f3c2440be0 2023-07-14T13:18:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.305+0000 7feb107dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c23327c0 con 0x55f3c244bad0 2023-07-14T13:18:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.305+0000 7feb107dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c2216920 con 0x55f3c24402d0 2023-07-14T13:18:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.305+0000 7feb107dcb80 10 client.0 _ll_register_callbacks cb 0x55f3c2330760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:22.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.306+0000 7feaf5d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 0x55f3c2448770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.306+0000 7feaf6d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.306+0000 7feaf659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c244b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.306+0000 7feaf6d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58548/0 (socket says 172.21.15.17:58548) 2023-07-14T13:18:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.306+0000 7feaf6d9d700 1 -- 172.21.15.17:0/3071572278 learned_addr learned my addr 172.21.15.17:0/3071572278 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.306+0000 7feaf5d9b700 1 -- 172.21.15.17:0/3071572278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 msgr2=0x55f3c244b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.306+0000 7feaf5d9b700 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c244b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.306+0000 7feaf5d9b700 1 -- 172.21.15.17:0/3071572278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 msgr2=0x55f3c2448eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.306+0000 7feaf5d9b700 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.306+0000 7feaf5d9b700 1 -- 172.21.15.17:0/3071572278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf810d210 con 0x55f3c2440be0 2023-07-14T13:18:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.306+0000 7feaf6d9d700 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:18:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.307+0000 7feaf5d9b700 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 0x55f3c2448770 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7feaf8105200 tx=0x7feaec0108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28348ab9022d7104 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.307+0000 7feaddffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.307+0000 7feaddffb700 1 -- 172.21.15.17:0/3071572278 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec004220 con 0x55f3c2440be0 2023-07-14T13:18:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.307+0000 7feaddffb700 1 -- 172.21.15.17:0/3071572278 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feaec016070 con 0x55f3c2440be0 2023-07-14T13:18:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.309+0000 7feb107dcb80 1 -- 172.21.15.17:0/3071572278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3c22ec4f0 con 0x55f3c2440be0 2023-07-14T13:18:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.310+0000 7feaddffb700 1 -- 172.21.15.17:0/3071572278 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaec010e60 con 0x55f3c2440be0 2023-07-14T13:18:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.311+0000 7feb107dcb80 10 client.18765 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.311+0000 7feb107dcb80 1 -- 172.21.15.17:0/3071572278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55f3c21a9c60 con 0x55f3c2440be0 2023-07-14T13:18:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.315+0000 7feaddffb700 1 -- 172.21.15.17:0/3071572278 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3c22ec4f0 con 0x55f3c2440be0 2023-07-14T13:18:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.315+0000 7feaddffb700 1 -- 172.21.15.17:0/3071572278 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7feaec005280 con 0x55f3c2440be0 2023-07-14T13:18:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.315+0000 7feb107dcb80 10 client.18765 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.315+0000 7feb107dcb80 10 client.18765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:22.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.315+0000 7feb107dcb80 20 client.18765 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.315+0000 7feb107dcb80 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3c245b4e0 0x55f3c245d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.315+0000 7feb107dcb80 4 client.18765 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:22.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.315+0000 7feb107dcb80 1 -- 172.21.15.17:0/3071572278 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3c238beb0 con 0x55f3c245b4e0 2023-07-14T13:18:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.316+0000 7feaf659c700 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3c245b4e0 0x55f3c245d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.317+0000 7feaf659c700 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3c245b4e0 0x55f3c245d8f0 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e0bd540dd8da0ea server_cookie=b10ecb5c4059e10c in_seq=0 out_seq=0 2023-07-14T13:18:22.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.317+0000 7feaddffb700 10 client.18765 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.318+0000 7feaddffb700 1 -- 172.21.15.17:0/3071572278 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f3c238beb0 con 0x55f3c245b4e0 2023-07-14T13:18:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.318+0000 7feaddffb700 10 client.18765 handle_command_reply: tid=0 2023-07-14T13:18:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.318+0000 7feb107dcb80 1 client.18765 shutdown 2023-07-14T13:18:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.318+0000 7feb107dcb80 1 -- 172.21.15.17:0/3071572278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 msgr2=0x55f3c2448770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:22.357 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.318+0000 7feb107dcb80 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 0x55f3c2448770 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7feaf8105200 tx=0x7feaec0108d0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.319+0000 7feb107dcb80 1 -- 172.21.15.17:0/3071572278 shutdown_connections 2023-07-14T13:18:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.319+0000 7feb107dcb80 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3c245b4e0 0x55f3c245d8f0 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.319+0000 7feb107dcb80 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.319+0000 7feb107dcb80 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c244b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.319+0000 7feb107dcb80 1 --2- 172.21.15.17:0/3071572278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 0x55f3c2448770 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.319+0000 7feb107dcb80 1 -- 172.21.15.17:0/3071572278 >> 172.21.15.17:0/3071572278 conn(0x55f3c2436da0 msgr2=0x55f3c243c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:22.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.319+0000 7feaddffb700 0 client.18765 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.319+0000 7feb107dcb80 1 -- 172.21.15.17:0/3071572278 shutdown_connections 2023-07-14T13:18:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.319+0000 7feb107dcb80 1 -- 172.21.15.17:0/3071572278 wait complete. 2023-07-14T13:18:22.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.320+0000 7feb107dcb80 20 client.18765 trim_cache size 0 max 16384 2023-07-14T13:18:22.386 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.349+0000 7feb107dcb80 1 Processor -- start 2023-07-14T13:18:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.350+0000 7feb107dcb80 1 -- start start 2023-07-14T13:18:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.350+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c244b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.350+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 0x55f3c2448030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.350+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.350+0000 7feb107dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c2458ae0 con 0x55f3c2440be0 2023-07-14T13:18:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.350+0000 7feb107dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c2448ab0 con 0x55f3c244bad0 2023-07-14T13:18:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.350+0000 7feb107dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c243b490 con 0x55f3c24402d0 2023-07-14T13:18:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.351+0000 7feaf659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c244b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.351+0000 7feaf6d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.351+0000 7feaf6d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58562/0 (socket says 172.21.15.17:58562) 2023-07-14T13:18:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.351+0000 7feaf6d9d700 1 -- 172.21.15.17:0/3117853401 learned_addr learned my addr 172.21.15.17:0/3117853401 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.352+0000 7feaf6d9d700 1 -- 172.21.15.17:0/3117853401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 msgr2=0x55f3c244b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.352+0000 7feaf6d9d700 1 --2- 172.21.15.17:0/3117853401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c244b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.352+0000 7feaf6d9d700 1 -- 172.21.15.17:0/3117853401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 msgr2=0x55f3c2448030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.352+0000 7feaf6d9d700 1 --2- 172.21.15.17:0/3117853401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 0x55f3c2448030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.352+0000 7feaf6d9d700 1 -- 172.21.15.17:0/3117853401 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3c21e7250 con 0x55f3c244bad0 2023-07-14T13:18:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.354+0000 7feaf6d9d700 1 --2- 172.21.15.17:0/3117853401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448570 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009a20 tx=0x7feaf001c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a168f7a65f143abd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:22.394 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.356+0000 7feae57fa700 1 -- 172.21.15.17:0/3117853401 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf000e070 con 0x55f3c244bad0 2023-07-14T13:18:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.356+0000 7feae57fa700 1 -- 172.21.15.17:0/3117853401 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feaf0007c50 con 0x55f3c244bad0 2023-07-14T13:18:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.356+0000 7feae57fa700 1 -- 172.21.15.17:0/3117853401 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf002c070 con 0x55f3c244bad0 2023-07-14T13:18:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.357+0000 7feb107dcb80 1 -- 172.21.15.17:0/3117853401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 msgr2=0x55f3c2448570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.357+0000 7feb107dcb80 1 --2- 172.21.15.17:0/3117853401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448570 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009a20 tx=0x7feaf001c000 comp rx=0 tx=0).stop 2023-07-14T13:18:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.357+0000 7feb107dcb80 1 -- 172.21.15.17:0/3117853401 shutdown_connections 2023-07-14T13:18:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.357+0000 7feb107dcb80 1 --2- 172.21.15.17:0/3117853401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c244bad0 0x55f3c2448570 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.357+0000 7feb107dcb80 1 --2- 172.21.15.17:0/3117853401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c24402d0 0x55f3c244b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.357+0000 7feb107dcb80 1 --2- 172.21.15.17:0/3117853401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c2440be0 0x55f3c2448030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.357+0000 7feb107dcb80 1 -- 172.21.15.17:0/3117853401 >> 172.21.15.17:0/3117853401 conn(0x55f3c2436da0 msgr2=0x55f3c2443b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:22.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.359+0000 7feb107dcb80 1 -- 172.21.15.17:0/3117853401 shutdown_connections 2023-07-14T13:18:22.396 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.359+0000 7feb107dcb80 1 -- 172.21.15.17:0/3117853401 wait complete. 2023-07-14T13:18:22.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.359+0000 7feb107dcb80 1 -- start start 2023-07-14T13:18:22.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.360+0000 7feb107dcb80 1 Processor -- start 2023-07-14T13:18:22.397 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.360+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c24402d0 0x55f3c2451710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.360+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c2440be0 0x55f3c2451c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.360+0000 7feb107dcb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c244bad0 0x55f3c24ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.361+0000 7feb107dcb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c24524a0 con 0x55f3c244bad0 2023-07-14T13:18:22.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.361+0000 7feb107dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c24ae8e0 con 0x55f3c24402d0 2023-07-14T13:18:22.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.361+0000 7feb107dcb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3c24aea20 con 0x55f3c2440be0 2023-07-14T13:18:22.398 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.361+0000 7feb107dcb80 10 client.0 _ll_register_callbacks cb 0x7feaec009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:22.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.362+0000 7feaf659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c24402d0 0x55f3c2451710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.362+0000 7feaf659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c24402d0 0x55f3c2451710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58578/0 (socket says 172.21.15.17:58578) 2023-07-14T13:18:22.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.362+0000 7feaf659c700 1 -- 172.21.15.17:0/709201930 learned_addr learned my addr 172.21.15.17:0/709201930 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:22.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.363+0000 7feaf6d9d700 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c244bad0 0x55f3c24ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.363+0000 7feaf5d9b700 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c2440be0 0x55f3c2451c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.363+0000 7feaf659c700 1 -- 172.21.15.17:0/709201930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c2440be0 msgr2=0x55f3c2451c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:22.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.363+0000 7feaf659c700 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c2440be0 0x55f3c2451c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.363+0000 7feaf659c700 1 -- 172.21.15.17:0/709201930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c244bad0 msgr2=0x55f3c24ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:22.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.363+0000 7feaf659c700 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c244bad0 0x55f3c24ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.363+0000 7feaf659c700 1 -- 172.21.15.17:0/709201930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3c21c0de0 con 0x55f3c24402d0 2023-07-14T13:18:22.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.364+0000 7feaf659c700 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c24402d0 0x55f3c2451710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7feae8000c00 tx=0x7feae8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6013bb8a5ead7eaf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:22.401 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.364+0000 7feaddffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:18:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.365+0000 7feaddffb700 1 -- 172.21.15.17:0/709201930 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80b1070 con 0x55f3c24402d0 2023-07-14T13:18:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.365+0000 7feaddffb700 1 -- 172.21.15.17:0/709201930 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feae8099860 con 0x55f3c24402d0 2023-07-14T13:18:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.365+0000 7feb107dcb80 1 -- 172.21.15.17:0/709201930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feaf0007e10 con 0x55f3c24402d0 2023-07-14T13:18:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.365+0000 7feaddffb700 1 -- 172.21.15.17:0/709201930 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7feae80c6020 con 0x55f3c24402d0 2023-07-14T13:18:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.365+0000 7feb107dcb80 10 client.28490 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.365+0000 7feb107dcb80 1 -- 172.21.15.17:0/709201930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55f3c21bf2b0 con 0x55f3c24402d0 2023-07-14T13:18:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.365+0000 7feaddffb700 1 -- 172.21.15.17:0/709201930 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feaf0007e10 con 0x55f3c24402d0 2023-07-14T13:18:22.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.365+0000 7feaddffb700 1 -- 172.21.15.17:0/709201930 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7feae80b79f0 con 0x55f3c24402d0 2023-07-14T13:18:22.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.366+0000 7feb107dcb80 10 client.28490 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:22.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.366+0000 7feb107dcb80 10 client.28490 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:22.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.366+0000 7feb107dcb80 20 client.28490 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:22.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.366+0000 7feb107dcb80 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3c24b0110 0x55f3c24b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:22.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.366+0000 7feb107dcb80 4 client.28490 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:18:22.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.366+0000 7feb107dcb80 1 -- 172.21.15.17:0/709201930 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f3c234e050 con 0x55f3c24b0110 2023-07-14T13:18:22.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.366+0000 7feaf5d9b700 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3c24b0110 0x55f3c24b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:22.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.367+0000 7feaf5d9b700 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3c24b0110 0x55f3c24b2520 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab15a91989cdaa8d server_cookie=ddf3e58df6fb7934 in_seq=0 out_seq=0 2023-07-14T13:18:22.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.367+0000 7feaddffb700 10 client.28490 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:22.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.367+0000 7feaddffb700 1 -- 172.21.15.17:0/709201930 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f3c234e050 con 0x55f3c24b0110 2023-07-14T13:18:22.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.367+0000 7feaddffb700 10 client.28490 handle_command_reply: tid=0 2023-07-14T13:18:22.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.367+0000 7feb107dcb80 1 client.28490 shutdown 2023-07-14T13:18:22.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.367+0000 7feb107dcb80 1 -- 172.21.15.17:0/709201930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c24402d0 msgr2=0x55f3c2451710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:22.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.367+0000 7feb107dcb80 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c24402d0 0x55f3c2451710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7feae8000c00 tx=0x7feae8004750 comp rx=0 tx=0).stop 2023-07-14T13:18:22.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.368+0000 7feb107dcb80 1 -- 172.21.15.17:0/709201930 shutdown_connections 2023-07-14T13:18:22.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.368+0000 7feb107dcb80 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f3c24b0110 0x55f3c24b2520 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.368+0000 7feb107dcb80 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f3c244bad0 0x55f3c24ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.368+0000 7feaddffb700 0 client.28490 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:22.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.368+0000 7feb107dcb80 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3c24402d0 0x55f3c2451710 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.368+0000 7feb107dcb80 1 --2- 172.21.15.17:0/709201930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3c2440be0 0x55f3c2451c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.368+0000 7feb107dcb80 1 -- 172.21.15.17:0/709201930 >> 172.21.15.17:0/709201930 conn(0x55f3c2436da0 msgr2=0x55f3c2448030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:22.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.368+0000 7feb107dcb80 1 -- 172.21.15.17:0/709201930 shutdown_connections 2023-07-14T13:18:22.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.369+0000 7feb107dcb80 1 -- 172.21.15.17:0/709201930 wait complete. 2023-07-14T13:18:22.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.371+0000 7feb107dcb80 20 client.28490 trim_cache size 0 max 16384 2023-07-14T13:18:22.409 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:18:22.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 -- 172.21.15.17:0/3326181288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feae00a14d0 msgr2=0x7feae00a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:22.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feae00a14d0 0x7feae00a3980 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feaf000b040 tx=0x7feaf0028040 comp rx=0 tx=0).stop 2023-07-14T13:18:22.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 -- 172.21.15.17:0/3326181288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffad0 msgr2=0x7feaf806f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:22.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffad0 0x7feaf806f980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7feae800b530 tx=0x7feae800b8f0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 -- 172.21.15.17:0/3326181288 shutdown_connections 2023-07-14T13:18:22.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7feae00a14d0 0x7feae00a3980 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaf8105ae0 0x7feaf806aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffad0 0x7feaf806f980 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 --2- 172.21.15.17:0/3326181288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feaf8100480 0x7feaf806fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:22.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 -- 172.21.15.17:0/3326181288 >> 172.21.15.17:0/3326181288 conn(0x7feaf80fb5f0 msgr2=0x7feaf80fbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:22.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 -- 172.21.15.17:0/3326181288 shutdown_connections 2023-07-14T13:18:22.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:22.376+0000 7feafcdff700 1 -- 172.21.15.17:0/3326181288 wait complete. 2023-07-14T13:18:22.455 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 10.0 s, 913.2 tps, lat 108.226 ms stddev 57.749 2023-07-14T13:18:23.455 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:18:23.456 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:18:23.587 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:23 smithi017 ceph-mon[95536]: pgmap v588: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 14 MiB/s wr, 172 op/s 2023-07-14T13:18:23.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:23 smithi135 ceph-mon[97338]: pgmap v588: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 14 MiB/s wr, 172 op/s 2023-07-14T13:18:23.758 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:23 smithi131 ceph-mon[96953]: pgmap v588: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 14 MiB/s wr, 172 op/s 2023-07-14T13:18:23.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.836+0000 7fa4397ff700 1 -- 172.21.15.17:0/95336364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43406d8e0 msgr2=0x7fa434107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:23.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.836+0000 7fa4397ff700 1 --2- 172.21.15.17:0/95336364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43406d8e0 0x7fa434107510 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009990 tx=0x7fa41c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.837+0000 7fa4397ff700 1 -- 172.21.15.17:0/95336364 shutdown_connections 2023-07-14T13:18:23.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.837+0000 7fa4397ff700 1 --2- 172.21.15.17:0/95336364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa434112920 0x7fa434114d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.837+0000 7fa4397ff700 1 --2- 172.21.15.17:0/95336364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa43406d8e0 0x7fa434107510 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.837+0000 7fa4397ff700 1 --2- 172.21.15.17:0/95336364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa434107a50 0x7fa434107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.837+0000 7fa4397ff700 1 -- 172.21.15.17:0/95336364 >> 172.21.15.17:0/95336364 conn(0x7fa43406bf70 msgr2=0x7fa434070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:23.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.837+0000 7fa4397ff700 1 -- 172.21.15.17:0/95336364 shutdown_connections 2023-07-14T13:18:23.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.839+0000 7fa4397ff700 1 -- 172.21.15.17:0/95336364 wait complete. 2023-07-14T13:18:23.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.840+0000 7fa4397ff700 1 Processor -- start 2023-07-14T13:18:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.841+0000 7fa4397ff700 1 -- start start 2023-07-14T13:18:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.841+0000 7fa4397ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa43406d8e0 0x7fa4341086f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.841+0000 7fa4397ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa434107a50 0x7fa434108c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.842+0000 7fa4397ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa434112920 0x7fa434109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.842+0000 7fa4397ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4341b0e10 con 0x7fa43406d8e0 2023-07-14T13:18:23.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.842+0000 7fa4397ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4341b0f50 con 0x7fa434107a50 2023-07-14T13:18:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.842+0000 7fa4397ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4341b1090 con 0x7fa434112920 2023-07-14T13:18:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.842+0000 7fa432ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa43406d8e0 0x7fa4341086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.842+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa434107a50 0x7fa434108c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.842+0000 7fa432ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa43406d8e0 0x7fa4341086f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34286/0 (socket says 172.21.15.17:34286) 2023-07-14T13:18:23.880 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.842+0000 7fa432ffd700 1 -- 172.21.15.17:0/3456084593 learned_addr learned my addr 172.21.15.17:0/3456084593 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:23.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.843+0000 7fa42bfff700 1 -- 172.21.15.17:0/3456084593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa434112920 msgr2=0x7fa434109170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:23.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.843+0000 7fa42bfff700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa434112920 0x7fa434109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.843+0000 7fa42bfff700 1 -- 172.21.15.17:0/3456084593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa43406d8e0 msgr2=0x7fa4341086f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:23.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.843+0000 7fa42bfff700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa43406d8e0 0x7fa4341086f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.843+0000 7fa42bfff700 1 -- 172.21.15.17:0/3456084593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0095f0 con 0x7fa434107a50 2023-07-14T13:18:23.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.843+0000 7fa432ffd700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa43406d8e0 0x7fa4341086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:18:23.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.843+0000 7fa42bfff700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa434107a50 0x7fa434108c30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa42400b450 tx=0x7fa42400b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:23.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.844+0000 7fa430ff9700 1 -- 172.21.15.17:0/3456084593 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424011830 con 0x7fa434107a50 2023-07-14T13:18:23.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.844+0000 7fa430ff9700 1 -- 172.21.15.17:0/3456084593 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa424011e20 con 0x7fa434107a50 2023-07-14T13:18:23.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.844+0000 7fa430ff9700 1 -- 172.21.15.17:0/3456084593 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424010db0 con 0x7fa434107a50 2023-07-14T13:18:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.844+0000 7fa4397ff700 1 -- 172.21.15.17:0/3456084593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4341b1370 con 0x7fa434107a50 2023-07-14T13:18:23.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.844+0000 7fa4397ff700 1 -- 172.21.15.17:0/3456084593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4341b1830 con 0x7fa434107a50 2023-07-14T13:18:23.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.851+0000 7fa44d04db80 1 Processor -- start 2023-07-14T13:18:23.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.852+0000 7fa44d04db80 1 -- start start 2023-07-14T13:18:23.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.852+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19350 0x55bfe1c19720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.852+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 0x55bfe1c24610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.852+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 0x55bfe1c26f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.852+0000 7fa44d04db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe1b1fd30 con 0x55bfe1c24b50 2023-07-14T13:18:23.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.852+0000 7fa44d04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe1b72ac0 con 0x55bfe1c19350 2023-07-14T13:18:23.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.852+0000 7fa44d04db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe1b6bf50 con 0x55bfe1c19c60 2023-07-14T13:18:23.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.854+0000 7fa430ff9700 1 -- 172.21.15.17:0/3456084593 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa424011990 con 0x7fa434107a50 2023-07-14T13:18:23.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.856+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 0x55bfe1c26f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.856+0000 7fa4337fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19350 0x55bfe1c19720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.856+0000 7fa4337fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19350 0x55bfe1c19720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58596/0 (socket says 172.21.15.17:58596) 2023-07-14T13:18:23.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.856+0000 7fa4337fe700 1 -- 172.21.15.17:0/1859701332 learned_addr learned my addr 172.21.15.17:0/1859701332 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:23.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.857+0000 7fa432ffd700 1 --2- 172.21.15.17:0/1859701332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 0x55bfe1c24610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.857+0000 7fa4337fe700 1 -- 172.21.15.17:0/1859701332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 msgr2=0x55bfe1c24610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:23.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.857+0000 7fa4337fe700 1 --2- 172.21.15.17:0/1859701332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 0x55bfe1c24610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.857+0000 7fa4337fe700 1 -- 172.21.15.17:0/1859701332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 msgr2=0x55bfe1c26f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:23.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.859+0000 7fa4337fe700 1 --2- 172.21.15.17:0/1859701332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 0x55bfe1c26f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.859+0000 7fa4337fe700 1 -- 172.21.15.17:0/1859701332 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfe1999e60 con 0x55bfe1c19350 2023-07-14T13:18:23.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.859+0000 7fa42bfff700 1 --2- 172.21.15.17:0/1859701332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 0x55bfe1c26f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:18:23.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.859+0000 7fa4337fe700 1 --2- 172.21.15.17:0/1859701332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19350 0x55bfe1c19720 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa42c007fd0 tx=0x7fa42c00a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c089cbbaab18a965 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:23.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.859+0000 7fa4297fa700 1 -- 172.21.15.17:0/1859701332 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c00f070 con 0x55bfe1c19350 2023-07-14T13:18:23.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.860+0000 7fa4297fa700 1 -- 172.21.15.17:0/1859701332 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa42c00ae60 con 0x55bfe1c19350 2023-07-14T13:18:23.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.860+0000 7fa4297fa700 1 -- 172.21.15.17:0/1859701332 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c008760 con 0x55bfe1c19350 2023-07-14T13:18:23.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.861+0000 7fa430ff9700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4200a13c0 0x7fa4200a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.861+0000 7fa44d04db80 1 -- 172.21.15.17:0/1859701332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19350 msgr2=0x55bfe1c19720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:23.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.861+0000 7fa44d04db80 1 --2- 172.21.15.17:0/1859701332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19350 0x55bfe1c19720 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa42c007fd0 tx=0x7fa42c00a6f0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.861+0000 7fa430ff9700 1 -- 172.21.15.17:0/3456084593 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa4240cc3c0 con 0x7fa434107a50 2023-07-14T13:18:23.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.861+0000 7fa44d04db80 1 -- 172.21.15.17:0/1859701332 shutdown_connections 2023-07-14T13:18:23.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.861+0000 7fa44d04db80 1 --2- 172.21.15.17:0/1859701332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 0x55bfe1c26f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.861+0000 7fa44d04db80 1 --2- 172.21.15.17:0/1859701332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19350 0x55bfe1c19720 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.861+0000 7fa44d04db80 1 --2- 172.21.15.17:0/1859701332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 0x55bfe1c24610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.861+0000 7fa44d04db80 1 -- 172.21.15.17:0/1859701332 >> 172.21.15.17:0/1859701332 conn(0x55bfe1c0fe20 msgr2=0x55bfe1c15720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:23.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.862+0000 7fa44d04db80 1 -- 172.21.15.17:0/1859701332 shutdown_connections 2023-07-14T13:18:23.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.862+0000 7fa44d04db80 1 -- 172.21.15.17:0/1859701332 wait complete. 2023-07-14T13:18:23.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.862+0000 7fa432ffd700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4200a13c0 0x7fa4200a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.863+0000 7fa44d04db80 1 -- start start 2023-07-14T13:18:23.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.863+0000 7fa44d04db80 1 Processor -- start 2023-07-14T13:18:23.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.864+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19350 0x55bfe1c21930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.864+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 0x55bfe1c21e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.864+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c24b50 0x55bfe1c223b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.864+0000 7fa44d04db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe1b0bb40 con 0x55bfe1c19350 2023-07-14T13:18:23.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.864+0000 7fa44d04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe1b0b840 con 0x55bfe1c24b50 2023-07-14T13:18:23.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.864+0000 7fa44d04db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe19ef9a0 con 0x55bfe1c19c60 2023-07-14T13:18:23.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.864+0000 7fa44d04db80 10 client.0 _ll_register_callbacks cb 0x55bfe1b097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:23.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.866+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 0x55bfe1c21e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.866+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 0x55bfe1c21e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57566/0 (socket says 172.21.15.17:57566) 2023-07-14T13:18:23.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.866+0000 7fa42bfff700 1 -- 172.21.15.17:0/3476261755 learned_addr learned my addr 172.21.15.17:0/3476261755 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:23.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.866+0000 7fa4337fe700 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c24b50 0x55bfe1c223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.866+0000 7fa432ffd700 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19350 0x55bfe1c21930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.866+0000 7fa42bfff700 1 -- 172.21.15.17:0/3476261755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c24b50 msgr2=0x55bfe1c223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.866+0000 7fa42bfff700 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c24b50 0x55bfe1c223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.866+0000 7fa42bfff700 1 -- 172.21.15.17:0/3476261755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19350 msgr2=0x55bfe1c21930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:23.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.866+0000 7fa42bfff700 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19350 0x55bfe1c21930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.866+0000 7fa42bfff700 1 -- 172.21.15.17:0/3476261755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c007c80 con 0x55bfe1c19c60 2023-07-14T13:18:23.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.866+0000 7fa432ffd700 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19350 0x55bfe1c21930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:18:23.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.867+0000 7fa42bfff700 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 0x55bfe1c21e70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa4240cc660 tx=0x7fa424099460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11542d4695807d4e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:23.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.868+0000 7fa41a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:18:23.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.868+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3476261755 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424011c40 con 0x55bfe1c19c60 2023-07-14T13:18:23.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.868+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3476261755 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa424009200 con 0x55bfe1c19c60 2023-07-14T13:18:23.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.869+0000 7fa432ffd700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4200a13c0 0x7fa4200a3870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00b5c0 tx=0x7fa41c009fb0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:23.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.870+0000 7fa44d04db80 1 -- 172.21.15.17:0/3476261755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfe1ac5570 con 0x55bfe1c19c60 2023-07-14T13:18:23.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.871+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3476261755 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa424099560 con 0x55bfe1c19c60 2023-07-14T13:18:23.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.871+0000 7fa44d04db80 10 client.28456 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:23.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.871+0000 7fa44d04db80 1 -- 172.21.15.17:0/3476261755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55bfe1982ce0 con 0x55bfe1c19c60 2023-07-14T13:18:23.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.873+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3476261755 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bfe1ac5570 con 0x55bfe1c19c60 2023-07-14T13:18:23.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.873+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3476261755 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa42409d110 con 0x55bfe1c19c60 2023-07-14T13:18:23.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.873+0000 7fa44d04db80 10 client.28456 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:23.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.873+0000 7fa44d04db80 10 client.28456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:23.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.873+0000 7fa44d04db80 20 client.28456 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:23.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.873+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfe1c45460 0x55bfe1c47870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.874+0000 7fa44d04db80 4 client.28456 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:23.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.874+0000 7fa44d04db80 1 -- 172.21.15.17:0/3476261755 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bfe1b64f30 con 0x55bfe1c45460 2023-07-14T13:18:23.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.874+0000 7fa432ffd700 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfe1c45460 0x55bfe1c47870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.875+0000 7fa432ffd700 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfe1c45460 0x55bfe1c47870 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92c6037dc10c340 server_cookie=e5c6c82da3e8e37b in_seq=0 out_seq=0 2023-07-14T13:18:23.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.875+0000 7fa41a7fc700 10 client.28456 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:23.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.876+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3476261755 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bfe1b64f30 con 0x55bfe1c45460 2023-07-14T13:18:23.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.876+0000 7fa41a7fc700 10 client.28456 handle_command_reply: tid=0 2023-07-14T13:18:23.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.876+0000 7fa44d04db80 1 client.28456 shutdown 2023-07-14T13:18:23.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.876+0000 7fa44d04db80 1 -- 172.21.15.17:0/3476261755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 msgr2=0x55bfe1c21e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:23.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.876+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 0x55bfe1c21e70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa4240cc660 tx=0x7fa424099460 comp rx=0 tx=0).stop 2023-07-14T13:18:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.879+0000 7fa44d04db80 1 -- 172.21.15.17:0/3476261755 shutdown_connections 2023-07-14T13:18:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.879+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfe1c45460 0x55bfe1c47870 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.879+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c24b50 0x55bfe1c223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.879+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19350 0x55bfe1c21930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.879+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3476261755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19c60 0x55bfe1c21e70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.879+0000 7fa44d04db80 1 -- 172.21.15.17:0/3476261755 >> 172.21.15.17:0/3476261755 conn(0x55bfe1c0fe20 msgr2=0x55bfe1c152b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.880+0000 7fa41a7fc700 0 client.28456 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.880+0000 7fa44d04db80 1 -- 172.21.15.17:0/3476261755 shutdown_connections 2023-07-14T13:18:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.880+0000 7fa44d04db80 1 -- 172.21.15.17:0/3476261755 wait complete. 2023-07-14T13:18:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.883+0000 7fa44d04db80 20 client.28456 trim_cache size 0 max 16384 2023-07-14T13:18:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.921+0000 7fa44d04db80 1 Processor -- start 2023-07-14T13:18:23.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.921+0000 7fa44d04db80 1 -- start start 2023-07-14T13:18:23.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.922+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19350 0x55bfe1c157d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.922+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19c60 0x55bfe1c221e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.922+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 0x55bfe1c1ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.922+0000 7fa44d04db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe1c1c7b0 con 0x55bfe1c24b50 2023-07-14T13:18:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.922+0000 7fa44d04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe1c1a5c0 con 0x55bfe1c19c60 2023-07-14T13:18:23.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.922+0000 7fa44d04db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe1c16d80 con 0x55bfe1c19350 2023-07-14T13:18:23.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.923+0000 7fa432ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19350 0x55bfe1c157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.923+0000 7fa4337fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 0x55bfe1c1ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.923+0000 7fa432ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19350 0x55bfe1c157d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57576/0 (socket says 172.21.15.17:57576) 2023-07-14T13:18:23.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.923+0000 7fa432ffd700 1 -- 172.21.15.17:0/1697668745 learned_addr learned my addr 172.21.15.17:0/1697668745 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:23.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.923+0000 7fa42bfff700 1 --2- 172.21.15.17:0/1697668745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19c60 0x55bfe1c221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.924+0000 7fa42bfff700 1 -- 172.21.15.17:0/1697668745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19350 msgr2=0x55bfe1c157d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:23.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.924+0000 7fa42bfff700 1 --2- 172.21.15.17:0/1697668745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19350 0x55bfe1c157d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.924+0000 7fa42bfff700 1 -- 172.21.15.17:0/1697668745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 msgr2=0x55bfe1c1ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:23.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.924+0000 7fa42bfff700 1 --2- 172.21.15.17:0/1697668745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 0x55bfe1c1ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.924+0000 7fa42bfff700 1 -- 172.21.15.17:0/1697668745 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfe1c11660 con 0x55bfe1c19c60 2023-07-14T13:18:23.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.924+0000 7fa4337fe700 1 --2- 172.21.15.17:0/1697668745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 0x55bfe1c1ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:18:23.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.924+0000 7fa42bfff700 1 --2- 172.21.15.17:0/1697668745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19c60 0x55bfe1c221e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa424010790 tx=0x7fa424097b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc72cef7b91dd91 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:23.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.926+0000 7fa429ffb700 1 -- 172.21.15.17:0/1697668745 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424009200 con 0x55bfe1c19c60 2023-07-14T13:18:23.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.926+0000 7fa429ffb700 1 -- 172.21.15.17:0/1697668745 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa424011c40 con 0x55bfe1c19c60 2023-07-14T13:18:23.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.926+0000 7fa429ffb700 1 -- 172.21.15.17:0/1697668745 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424099560 con 0x55bfe1c19c60 2023-07-14T13:18:23.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.927+0000 7fa44d04db80 1 -- 172.21.15.17:0/1697668745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19c60 msgr2=0x55bfe1c221e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:23.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.927+0000 7fa44d04db80 1 --2- 172.21.15.17:0/1697668745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19c60 0x55bfe1c221e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa424010790 tx=0x7fa424097b10 comp rx=0 tx=0).stop 2023-07-14T13:18:23.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.927+0000 7fa44d04db80 1 -- 172.21.15.17:0/1697668745 shutdown_connections 2023-07-14T13:18:23.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.927+0000 7fa44d04db80 1 --2- 172.21.15.17:0/1697668745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c24b50 0x55bfe1c1ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.927+0000 7fa44d04db80 1 --2- 172.21.15.17:0/1697668745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19350 0x55bfe1c157d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.927+0000 7fa44d04db80 1 --2- 172.21.15.17:0/1697668745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c19c60 0x55bfe1c221e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.927+0000 7fa44d04db80 1 -- 172.21.15.17:0/1697668745 >> 172.21.15.17:0/1697668745 conn(0x55bfe1c0fe20 msgr2=0x55bfe1c150c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:23.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.928+0000 7fa44d04db80 1 -- 172.21.15.17:0/1697668745 shutdown_connections 2023-07-14T13:18:23.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.928+0000 7fa44d04db80 1 -- 172.21.15.17:0/1697668745 wait complete. 2023-07-14T13:18:23.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.928+0000 7fa44d04db80 1 -- start start 2023-07-14T13:18:23.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.929+0000 7fa44d04db80 1 Processor -- start 2023-07-14T13:18:23.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.930+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19350 0x55bfe1c3af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.930+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19c60 0x55bfe1c3b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.930+0000 7fa44d04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c24b50 0x55bfe1c99330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.930+0000 7fa44d04db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe1c3bdc0 con 0x55bfe1c19c60 2023-07-14T13:18:23.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.930+0000 7fa44d04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe1c99870 con 0x55bfe1c24b50 2023-07-14T13:18:23.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.930+0000 7fa44d04db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfe1c999b0 con 0x55bfe1c19350 2023-07-14T13:18:23.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.930+0000 7fa44d04db80 10 client.0 _ll_register_callbacks cb 0x7fa424095180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:23.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.931+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19c60 0x55bfe1c3b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.931+0000 7fa42bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19c60 0x55bfe1c3b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34318/0 (socket says 172.21.15.17:34318) 2023-07-14T13:18:23.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.931+0000 7fa42bfff700 1 -- 172.21.15.17:0/3248135098 learned_addr learned my addr 172.21.15.17:0/3248135098 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:23.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.932+0000 7fa432ffd700 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19350 0x55bfe1c3af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.932+0000 7fa42bfff700 1 -- 172.21.15.17:0/3248135098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19350 msgr2=0x55bfe1c3af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:23.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.932+0000 7fa42bfff700 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19350 0x55bfe1c3af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.969 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.932+0000 7fa42bfff700 1 -- 172.21.15.17:0/3248135098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c24b50 msgr2=0x55bfe1c99330 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:18:23.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.932+0000 7fa42bfff700 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c24b50 0x55bfe1c99330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.932+0000 7fa42bfff700 1 -- 172.21.15.17:0/3248135098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bfe1999e60 con 0x55bfe1c19c60 2023-07-14T13:18:23.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.933+0000 7fa42bfff700 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19c60 0x55bfe1c3b4b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa424099260 tx=0x7fa424099b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e5a215028975 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:23.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.933+0000 7fa41a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:23.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.933+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3248135098 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424098ec0 con 0x55bfe1c19c60 2023-07-14T13:18:23.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.933+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3248135098 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa424009200 con 0x55bfe1c19c60 2023-07-14T13:18:23.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.933+0000 7fa44d04db80 1 -- 172.21.15.17:0/3248135098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa42c00ae60 con 0x55bfe1c19c60 2023-07-14T13:18:23.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.934+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3248135098 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa42409d590 con 0x55bfe1c19c60 2023-07-14T13:18:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.934+0000 7fa44d04db80 10 client.18777 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.934+0000 7fa44d04db80 1 -- 172.21.15.17:0/3248135098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55bfe1982ce0 con 0x55bfe1c19c60 2023-07-14T13:18:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.935+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3248135098 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4240c7020 con 0x55bfe1c19c60 2023-07-14T13:18:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.935+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3248135098 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa42409d0b0 con 0x55bfe1c19c60 2023-07-14T13:18:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.935+0000 7fa44d04db80 10 client.18777 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.935+0000 7fa44d04db80 10 client.18777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:23.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.935+0000 7fa44d04db80 20 client.18777 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:23.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.935+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfe1c9abc0 0x55bfe1c9cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:23.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.935+0000 7fa44d04db80 4 client.18777 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:18:23.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.935+0000 7fa44d04db80 1 -- 172.21.15.17:0/3248135098 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55bfe1b270d0 con 0x55bfe1c9abc0 2023-07-14T13:18:23.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.936+0000 7fa432ffd700 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfe1c9abc0 0x55bfe1c9cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.941+0000 7fa432ffd700 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfe1c9abc0 0x55bfe1c9cfd0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d69577dd038e297b server_cookie=3e15c5db968b8894 in_seq=0 out_seq=0 2023-07-14T13:18:23.978 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.941+0000 7fa41a7fc700 10 client.18777 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:23.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.942+0000 7fa41a7fc700 1 -- 172.21.15.17:0/3248135098 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55bfe1b270d0 con 0x55bfe1c9abc0 2023-07-14T13:18:23.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.942+0000 7fa41a7fc700 10 client.18777 handle_command_reply: tid=0 2023-07-14T13:18:23.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.942+0000 7fa44d04db80 1 client.18777 shutdown 2023-07-14T13:18:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.943+0000 7fa44d04db80 1 -- 172.21.15.17:0/3248135098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19c60 msgr2=0x55bfe1c3b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.943+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19c60 0x55bfe1c3b4b0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa424099260 tx=0x7fa424099b50 comp rx=0 tx=0).stop 2023-07-14T13:18:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.943+0000 7fa44d04db80 1 -- 172.21.15.17:0/3248135098 shutdown_connections 2023-07-14T13:18:23.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.943+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bfe1c9abc0 0x55bfe1c9cfd0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.943+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bfe1c24b50 0x55bfe1c99330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.943+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bfe1c19350 0x55bfe1c3af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.943+0000 7fa44d04db80 1 --2- 172.21.15.17:0/3248135098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bfe1c19c60 0x55bfe1c3b4b0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.943+0000 7fa44d04db80 1 -- 172.21.15.17:0/3248135098 >> 172.21.15.17:0/3248135098 conn(0x55bfe1c0fe20 msgr2=0x55bfe1c21ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:23.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.943+0000 7fa41a7fc700 0 client.18777 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:23.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.944+0000 7fa44d04db80 1 -- 172.21.15.17:0/3248135098 shutdown_connections 2023-07-14T13:18:23.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.944+0000 7fa44d04db80 1 -- 172.21.15.17:0/3248135098 wait complete. 2023-07-14T13:18:23.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.944+0000 7fa44d04db80 20 client.18777 trim_cache size 0 max 16384 2023-07-14T13:18:23.982 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:18:23.982 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:18:23.982 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "08eb255e-b80d-47a4-a337-a06a8d3ea112", 2023-07-14T13:18:23.983 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:18:23.983 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:18:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.945+0000 7fa4397ff700 1 -- 172.21.15.17:0/3456084593 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4200a13c0 msgr2=0x7fa4200a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.945+0000 7fa4397ff700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4200a13c0 0x7fa4200a3870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00b5c0 tx=0x7fa41c009fb0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.945+0000 7fa4397ff700 1 -- 172.21.15.17:0/3456084593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa434107a50 msgr2=0x7fa434108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.945+0000 7fa4397ff700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa434107a50 0x7fa434108c30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa42400b450 tx=0x7fa42400b810 comp rx=0 tx=0).stop 2023-07-14T13:18:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.945+0000 7fa4397ff700 1 -- 172.21.15.17:0/3456084593 shutdown_connections 2023-07-14T13:18:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.945+0000 7fa4397ff700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4200a13c0 0x7fa4200a3870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.945+0000 7fa4397ff700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa434112920 0x7fa434109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.945+0000 7fa4397ff700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa43406d8e0 0x7fa4341086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.945+0000 7fa4397ff700 1 --2- 172.21.15.17:0/3456084593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa434107a50 0x7fa434108c30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:23.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.945+0000 7fa4397ff700 1 -- 172.21.15.17:0/3456084593 >> 172.21.15.17:0/3456084593 conn(0x7fa43406bf70 msgr2=0x7fa43410a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.946+0000 7fa4397ff700 1 -- 172.21.15.17:0/3456084593 shutdown_connections 2023-07-14T13:18:23.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:23.946+0000 7fa4397ff700 1 -- 172.21.15.17:0/3456084593 wait complete. 2023-07-14T13:18:24.016 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:18:24.285 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:24 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:18:24.462 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.425+0000 7f2c98fff700 1 -- 172.21.15.17:0/4149430820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c94075350 msgr2=0x7f2c94110460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.425+0000 7f2c98fff700 1 --2- 172.21.15.17:0/4149430820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c94075350 0x7f2c94110460 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009990 tx=0x7f2c84009ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.425+0000 7f2c98fff700 1 -- 172.21.15.17:0/4149430820 shutdown_connections 2023-07-14T13:18:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.425+0000 7f2c98fff700 1 --2- 172.21.15.17:0/4149430820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c941109a0 0x7f2c94112d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.425+0000 7f2c98fff700 1 --2- 172.21.15.17:0/4149430820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c94074a40 0x7f2c94074e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.425+0000 7f2c98fff700 1 --2- 172.21.15.17:0/4149430820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c94075350 0x7f2c94110460 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.463 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.425+0000 7f2c98fff700 1 -- 172.21.15.17:0/4149430820 >> 172.21.15.17:0/4149430820 conn(0x7f2c940fd7e0 msgr2=0x7f2c940ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.426+0000 7f2c98fff700 1 -- 172.21.15.17:0/4149430820 shutdown_connections 2023-07-14T13:18:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.426+0000 7f2c98fff700 1 -- 172.21.15.17:0/4149430820 wait complete. 2023-07-14T13:18:24.464 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.428+0000 7f2c98fff700 1 Processor -- start 2023-07-14T13:18:24.465 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.428+0000 7f2c98fff700 1 -- start start 2023-07-14T13:18:24.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.429+0000 7f2c98fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c94074a40 0x7f2c9419c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.429+0000 7f2c98fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c94075350 0x7f2c9419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.429+0000 7f2c98fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c941109a0 0x7f2c941a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.429+0000 7f2c98fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c941a10c0 con 0x7f2c941109a0 2023-07-14T13:18:24.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.429+0000 7f2c98fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c941a1230 con 0x7f2c94074a40 2023-07-14T13:18:24.466 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.429+0000 7f2c98fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c941a13f0 con 0x7f2c94075350 2023-07-14T13:18:24.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.429+0000 7f2c9259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c94074a40 0x7f2c9419c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.430+0000 7f2c91d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c94075350 0x7f2c9419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.430+0000 7f2c91d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c94075350 0x7f2c9419c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:57608/0 (socket says 172.21.15.17:57608) 2023-07-14T13:18:24.467 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.430+0000 7f2c91d9b700 1 -- 172.21.15.17:0/1250728345 learned_addr learned my addr 172.21.15.17:0/1250728345 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.430+0000 7f2c92d9d700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c941109a0 0x7f2c941a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.431+0000 7f2c92d9d700 1 -- 172.21.15.17:0/1250728345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c94075350 msgr2=0x7f2c9419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.431+0000 7f2c92d9d700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c94075350 0x7f2c9419c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.431+0000 7f2c92d9d700 1 -- 172.21.15.17:0/1250728345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c94074a40 msgr2=0x7f2c9419c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:24.474 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.431+0000 7f2c92d9d700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c94074a40 0x7f2c9419c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.431+0000 7f2c92d9d700 1 -- 172.21.15.17:0/1250728345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840095f0 con 0x7f2c941109a0 2023-07-14T13:18:24.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.431+0000 7f2c92d9d700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c941109a0 0x7f2c941a0a80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800c940 tx=0x7f2c8800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:24.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.432+0000 7f2c837fe700 1 -- 172.21.15.17:0/1250728345 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88007b00 con 0x7f2c941109a0 2023-07-14T13:18:24.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.432+0000 7f2c837fe700 1 -- 172.21.15.17:0/1250728345 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c8800ce20 con 0x7f2c941109a0 2023-07-14T13:18:24.475 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.432+0000 7f2c837fe700 1 -- 172.21.15.17:0/1250728345 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88018400 con 0x7f2c941109a0 2023-07-14T13:18:24.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.433+0000 7f2c98fff700 1 -- 172.21.15.17:0/1250728345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c941a16d0 con 0x7f2c941109a0 2023-07-14T13:18:24.476 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.433+0000 7f2c98fff700 1 -- 172.21.15.17:0/1250728345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9406a110 con 0x7f2c941109a0 2023-07-14T13:18:24.477 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.441+0000 7f2cac943b80 1 Processor -- start 2023-07-14T13:18:24.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.441+0000 7f2c837fe700 1 -- 172.21.15.17:0/1250728345 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2c8800f450 con 0x7f2c941109a0 2023-07-14T13:18:24.478 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.441+0000 7f2cac943b80 1 -- start start 2023-07-14T13:18:24.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.442+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea6b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.479 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.442+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea76590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.442+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea78eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.442+0000 7f2cac943b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7e971cb0 con 0x561e7ea76ad0 2023-07-14T13:18:24.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.442+0000 7f2cac943b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7e9c4a40 con 0x561e7ea6b2d0 2023-07-14T13:18:24.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.442+0000 7f2cac943b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7e9bded0 con 0x561e7ea6bbe0 2023-07-14T13:18:24.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.443+0000 7f2c91d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea6b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.443+0000 7f2c91d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea6b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58628/0 (socket says 172.21.15.17:58628) 2023-07-14T13:18:24.480 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.443+0000 7f2c91d9b700 1 -- 172.21.15.17:0/13133210 learned_addr learned my addr 172.21.15.17:0/13133210 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:24.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.444+0000 7f2c9259c700 1 --2- 172.21.15.17:0/13133210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea76590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.445+0000 7f2c9259c700 1 -- 172.21.15.17:0/13133210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 msgr2=0x561e7ea6b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:24.481 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.445+0000 7f2c9259c700 1 --2- 172.21.15.17:0/13133210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea6b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.445+0000 7f2c9259c700 1 -- 172.21.15.17:0/13133210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 msgr2=0x561e7ea78eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:24.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.445+0000 7f2c9259c700 1 --2- 172.21.15.17:0/13133210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea78eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.445+0000 7f2c9259c700 1 -- 172.21.15.17:0/13133210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e7e7ebde0 con 0x561e7ea6bbe0 2023-07-14T13:18:24.482 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.445+0000 7f2c837fe700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c7c0a1490 0x7f2c7c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.445+0000 7f2c9259c700 1 --2- 172.21.15.17:0/13133210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea76590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009c50 tx=0x7f2c8c009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61c47a47cd5f9bb2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.445+0000 7f2c837fe700 1 -- 172.21.15.17:0/1250728345 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2c880ccae0 con 0x7f2c941109a0 2023-07-14T13:18:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.446+0000 7f2c91d9b700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c7c0a1490 0x7f2c7c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.446+0000 7f2c80ff9700 1 -- 172.21.15.17:0/13133210 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c004bb0 con 0x561e7ea6bbe0 2023-07-14T13:18:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.446+0000 7f2c80ff9700 1 -- 172.21.15.17:0/13133210 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c8c004d10 con 0x561e7ea6bbe0 2023-07-14T13:18:24.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.446+0000 7f2c80ff9700 1 -- 172.21.15.17:0/13133210 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c014400 con 0x561e7ea6bbe0 2023-07-14T13:18:24.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.447+0000 7f2cac943b80 1 -- 172.21.15.17:0/13133210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 msgr2=0x561e7ea76590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:24.484 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.447+0000 7f2cac943b80 1 --2- 172.21.15.17:0/13133210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea76590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009c50 tx=0x7f2c8c009f60 comp rx=0 tx=0).stop 2023-07-14T13:18:24.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.448+0000 7f2c91d9b700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c7c0a1490 0x7f2c7c0a3940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400b5c0 tx=0x7f2c84005550 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:24.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.448+0000 7f2cac943b80 1 -- 172.21.15.17:0/13133210 shutdown_connections 2023-07-14T13:18:24.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.448+0000 7f2cac943b80 1 --2- 172.21.15.17:0/13133210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea78eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.448+0000 7f2cac943b80 1 --2- 172.21.15.17:0/13133210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea6b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.448+0000 7f2cac943b80 1 --2- 172.21.15.17:0/13133210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea76590 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.485 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.448+0000 7f2cac943b80 1 -- 172.21.15.17:0/13133210 >> 172.21.15.17:0/13133210 conn(0x561e7ea61da0 msgr2=0x561e7ea676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.450+0000 7f2cac943b80 1 -- 172.21.15.17:0/13133210 shutdown_connections 2023-07-14T13:18:24.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.452+0000 7f2cac943b80 1 -- 172.21.15.17:0/13133210 wait complete. 2023-07-14T13:18:24.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.452+0000 7f2cac943b80 1 -- start start 2023-07-14T13:18:24.489 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.453+0000 7f2cac943b80 1 Processor -- start 2023-07-14T13:18:24.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.454+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea76520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.454+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea6bbe0 0x561e7ea73810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.454+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea76ad0 0x561e7ea73f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.491 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.454+0000 7f2cac943b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7e95dac0 con 0x561e7ea6bbe0 2023-07-14T13:18:24.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.454+0000 7f2cac943b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7e95d7c0 con 0x561e7ea6b2d0 2023-07-14T13:18:24.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.454+0000 7f2cac943b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7e841920 con 0x561e7ea76ad0 2023-07-14T13:18:24.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.454+0000 7f2cac943b80 10 client.0 _ll_register_callbacks cb 0x561e7e95b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:24.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.455+0000 7f2c9259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea76520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.455+0000 7f2c9259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea76520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58640/0 (socket says 172.21.15.17:58640) 2023-07-14T13:18:24.492 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.455+0000 7f2c9259c700 1 -- 172.21.15.17:0/1851763104 learned_addr learned my addr 172.21.15.17:0/1851763104 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:24.493 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.455+0000 7f2c9259c700 1 -- 172.21.15.17:0/1851763104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea76ad0 msgr2=0x561e7ea73f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:24.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.455+0000 7f2c9259c700 1 --2- 172.21.15.17:0/1851763104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea76ad0 0x561e7ea73f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.455+0000 7f2c9259c700 1 -- 172.21.15.17:0/1851763104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea6bbe0 msgr2=0x561e7ea73810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:24.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.455+0000 7f2c9259c700 1 --2- 172.21.15.17:0/1851763104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea6bbe0 0x561e7ea73810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.455+0000 7f2c9259c700 1 -- 172.21.15.17:0/1851763104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8c009880 con 0x561e7ea6b2d0 2023-07-14T13:18:24.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.455+0000 7f2c9259c700 1 --2- 172.21.15.17:0/1851763104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea76520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00c040 tx=0x7f2c8c004ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abcee2b587d32663 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:24.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.455+0000 7f2c79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:18:24.494 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.456+0000 7f2c79ffb700 1 -- 172.21.15.17:0/1851763104 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c01e460 con 0x561e7ea6b2d0 2023-07-14T13:18:24.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.456+0000 7f2c79ffb700 1 -- 172.21.15.17:0/1851763104 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2c8c01e5c0 con 0x561e7ea6b2d0 2023-07-14T13:18:24.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.456+0000 7f2cac943b80 1 -- 172.21.15.17:0/1851763104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e7e9174f0 con 0x561e7ea6b2d0 2023-07-14T13:18:24.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.457+0000 7f2c79ffb700 1 -- 172.21.15.17:0/1851763104 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c8c01e780 con 0x561e7ea6b2d0 2023-07-14T13:18:24.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.457+0000 7f2cac943b80 10 client.28508 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:24.495 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.457+0000 7f2cac943b80 1 -- 172.21.15.17:0/1851763104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x561e7e7d4c60 con 0x561e7ea6b2d0 2023-07-14T13:18:24.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.458+0000 7f2c79ffb700 1 -- 172.21.15.17:0/1851763104 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561e7e9174f0 con 0x561e7ea6b2d0 2023-07-14T13:18:24.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.458+0000 7f2c79ffb700 1 -- 172.21.15.17:0/1851763104 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2c8c01c040 con 0x561e7ea6b2d0 2023-07-14T13:18:24.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.459+0000 7f2cac943b80 10 client.28508 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:24.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.459+0000 7f2cac943b80 10 client.28508 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:24.496 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.459+0000 7f2cac943b80 20 client.28508 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.459+0000 7f2cac943b80 1 --2- 172.21.15.17:0/1851763104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561e7ea86400 0x561e7ea88830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.459+0000 7f2cac943b80 4 client.28508 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.459+0000 7f2cac943b80 1 -- 172.21.15.17:0/1851763104 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e7e9b6eb0 con 0x561e7ea86400 2023-07-14T13:18:24.497 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.460+0000 7f2c91d9b700 1 --2- 172.21.15.17:0/1851763104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561e7ea86400 0x561e7ea88830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.461+0000 7f2c91d9b700 1 --2- 172.21.15.17:0/1851763104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561e7ea86400 0x561e7ea88830 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc223608e38d07c5 server_cookie=81499fae0c008275 in_seq=0 out_seq=0 2023-07-14T13:18:24.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.461+0000 7f2c79ffb700 10 client.28508 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:24.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.462+0000 7f2c79ffb700 1 -- 172.21.15.17:0/1851763104 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561e7e9b6eb0 con 0x561e7ea86400 2023-07-14T13:18:24.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.462+0000 7f2c79ffb700 10 client.28508 handle_command_reply: tid=0 2023-07-14T13:18:24.498 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.462+0000 7f2cac943b80 1 client.28508 shutdown 2023-07-14T13:18:24.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.462+0000 7f2cac943b80 1 -- 172.21.15.17:0/1851763104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 msgr2=0x561e7ea76520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:24.499 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.462+0000 7f2cac943b80 1 --2- 172.21.15.17:0/1851763104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea76520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00c040 tx=0x7f2c8c004ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.463+0000 7f2cac943b80 1 -- 172.21.15.17:0/1851763104 shutdown_connections 2023-07-14T13:18:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.463+0000 7f2cac943b80 1 --2- 172.21.15.17:0/1851763104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561e7ea86400 0x561e7ea88830 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.463+0000 7f2cac943b80 1 --2- 172.21.15.17:0/1851763104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea76ad0 0x561e7ea73f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.463+0000 7f2cac943b80 1 --2- 172.21.15.17:0/1851763104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea76520 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.463+0000 7f2cac943b80 1 --2- 172.21.15.17:0/1851763104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea6bbe0 0x561e7ea73810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.500 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.463+0000 7f2cac943b80 1 -- 172.21.15.17:0/1851763104 >> 172.21.15.17:0/1851763104 conn(0x561e7ea61da0 msgr2=0x561e7ea67290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:24.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.463+0000 7f2c79ffb700 0 client.28508 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:24.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.463+0000 7f2cac943b80 1 -- 172.21.15.17:0/1851763104 shutdown_connections 2023-07-14T13:18:24.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.463+0000 7f2cac943b80 1 -- 172.21.15.17:0/1851763104 wait complete. 2023-07-14T13:18:24.501 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.464+0000 7f2cac943b80 20 client.28508 trim_cache size 0 max 16384 2023-07-14T13:18:24.532 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.495+0000 7f2cac943b80 1 Processor -- start 2023-07-14T13:18:24.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.497+0000 7f2cac943b80 1 -- start start 2023-07-14T13:18:24.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.497+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.497+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea6eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.497+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea6f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.497+0000 7f2cac943b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7ea6bfb0 con 0x561e7ea76ad0 2023-07-14T13:18:24.534 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.497+0000 7f2cac943b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7ea74d80 con 0x561e7ea6b2d0 2023-07-14T13:18:24.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.497+0000 7f2cac943b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7ea5efa0 con 0x561e7ea6bbe0 2023-07-14T13:18:24.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.498+0000 7f2c9259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.498+0000 7f2c9259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58650/0 (socket says 172.21.15.17:58650) 2023-07-14T13:18:24.535 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.498+0000 7f2c9259c700 1 -- 172.21.15.17:0/3301879738 learned_addr learned my addr 172.21.15.17:0/3301879738 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.498+0000 7f2c92d9d700 1 --2- 172.21.15.17:0/3301879738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea6f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.499+0000 7f2c91d9b700 1 --2- 172.21.15.17:0/3301879738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea6eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.499+0000 7f2c92d9d700 1 -- 172.21.15.17:0/3301879738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 msgr2=0x561e7ea6eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.499+0000 7f2c92d9d700 1 --2- 172.21.15.17:0/3301879738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea6eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.536 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.499+0000 7f2c92d9d700 1 -- 172.21.15.17:0/3301879738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 msgr2=0x561e7ea760c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.499+0000 7f2c92d9d700 1 --2- 172.21.15.17:0/3301879738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea760c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.499+0000 7f2c92d9d700 1 -- 172.21.15.17:0/3301879738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e7e812250 con 0x561e7ea76ad0 2023-07-14T13:18:24.537 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.500+0000 7f2c92d9d700 1 --2- 172.21.15.17:0/3301879738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea6f030 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2c880ca1c0 tx=0x7f2c88099af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdbc31c8c5ebd76 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.501+0000 7f2c817fa700 1 -- 172.21.15.17:0/3301879738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880a2040 con 0x561e7ea76ad0 2023-07-14T13:18:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.501+0000 7f2c817fa700 1 -- 172.21.15.17:0/3301879738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c88097f90 con 0x561e7ea76ad0 2023-07-14T13:18:24.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.501+0000 7f2c817fa700 1 -- 172.21.15.17:0/3301879738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880b23f0 con 0x561e7ea76ad0 2023-07-14T13:18:24.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.503+0000 7f2cac943b80 1 -- 172.21.15.17:0/3301879738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 msgr2=0x561e7ea6f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:24.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.503+0000 7f2cac943b80 1 --2- 172.21.15.17:0/3301879738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea6f030 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2c880ca1c0 tx=0x7f2c88099af0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.504+0000 7f2cac943b80 1 -- 172.21.15.17:0/3301879738 shutdown_connections 2023-07-14T13:18:24.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.504+0000 7f2cac943b80 1 --2- 172.21.15.17:0/3301879738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea6f030 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.504+0000 7f2cac943b80 1 --2- 172.21.15.17:0/3301879738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea760c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.504+0000 7f2cac943b80 1 --2- 172.21.15.17:0/3301879738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea6eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.504+0000 7f2cac943b80 1 -- 172.21.15.17:0/3301879738 >> 172.21.15.17:0/3301879738 conn(0x561e7ea61da0 msgr2=0x561e7ea827c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:24.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.509+0000 7f2cac943b80 1 -- 172.21.15.17:0/3301879738 shutdown_connections 2023-07-14T13:18:24.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.509+0000 7f2cac943b80 1 -- 172.21.15.17:0/3301879738 wait complete. 2023-07-14T13:18:24.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.510+0000 7f2cac943b80 1 -- start start 2023-07-14T13:18:24.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.510+0000 7f2cac943b80 1 Processor -- start 2023-07-14T13:18:24.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.511+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea7d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.511+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea7b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.511+0000 7f2cac943b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea7ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.511+0000 7f2cac943b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7ea7db20 con 0x561e7ea76ad0 2023-07-14T13:18:24.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.511+0000 7f2cac943b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7ea7bfc0 con 0x561e7ea6b2d0 2023-07-14T13:18:24.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.511+0000 7f2cac943b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e7ea7c130 con 0x561e7ea6bbe0 2023-07-14T13:18:24.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.511+0000 7f2cac943b80 10 client.0 _ll_register_callbacks cb 0x7f2c84009d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:24.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.512+0000 7f2c9259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea7d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.512+0000 7f2c9259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea7d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58656/0 (socket says 172.21.15.17:58656) 2023-07-14T13:18:24.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.512+0000 7f2c9259c700 1 -- 172.21.15.17:0/4276723666 learned_addr learned my addr 172.21.15.17:0/4276723666 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:24.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.512+0000 7f2c91d9b700 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea7b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.512+0000 7f2c92d9d700 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea7ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.513+0000 7f2c91d9b700 1 -- 172.21.15.17:0/4276723666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 msgr2=0x561e7ea7d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:24.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.513+0000 7f2c91d9b700 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea7d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.513+0000 7f2c91d9b700 1 -- 172.21.15.17:0/4276723666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 msgr2=0x561e7ea7ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:24.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.513+0000 7f2c91d9b700 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea7ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.513+0000 7f2c91d9b700 1 -- 172.21.15.17:0/4276723666 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9406a110 con 0x561e7ea6bbe0 2023-07-14T13:18:24.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.514+0000 7f2c91d9b700 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea7b540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2c84000c00 tx=0x7f2c84009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e60b3bfabef44403 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:24.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.514+0000 7f2c79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:18:24.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.515+0000 7f2c79ffb700 1 -- 172.21.15.17:0/4276723666 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8402c040 con 0x561e7ea6bbe0 2023-07-14T13:18:24.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.515+0000 7f2c79ffb700 1 -- 172.21.15.17:0/4276723666 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2c8400be80 con 0x561e7ea6bbe0 2023-07-14T13:18:24.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.515+0000 7f2cac943b80 1 -- 172.21.15.17:0/4276723666 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c8c004d10 con 0x561e7ea6bbe0 2023-07-14T13:18:24.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.516+0000 7f2c79ffb700 1 -- 172.21.15.17:0/4276723666 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c84031310 con 0x561e7ea6bbe0 2023-07-14T13:18:24.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.516+0000 7f2cac943b80 10 client.28474 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:24.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.516+0000 7f2cac943b80 1 -- 172.21.15.17:0/4276723666 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x561e7e7ea2b0 con 0x561e7ea6bbe0 2023-07-14T13:18:24.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.517+0000 7f2c79ffb700 1 -- 172.21.15.17:0/4276723666 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c8c004d10 con 0x561e7ea6bbe0 2023-07-14T13:18:24.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.517+0000 7f2c79ffb700 1 -- 172.21.15.17:0/4276723666 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2c84025420 con 0x561e7ea6bbe0 2023-07-14T13:18:24.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.517+0000 7f2cac943b80 10 client.28474 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:24.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.517+0000 7f2cac943b80 10 client.28474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:24.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.517+0000 7f2cac943b80 20 client.28474 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:24.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.517+0000 7f2cac943b80 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561e7eadb610 0x561e7eadda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:24.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.517+0000 7f2cac943b80 4 client.28474 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:18:24.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.517+0000 7f2cac943b80 1 -- 172.21.15.17:0/4276723666 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561e7e979050 con 0x561e7eadb610 2023-07-14T13:18:24.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.517+0000 7f2c9259c700 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561e7eadb610 0x561e7eadda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:24.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.519+0000 7f2c9259c700 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561e7eadb610 0x561e7eadda20 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6aa8cd8f3638078 server_cookie=2846dd12679d0b76 in_seq=0 out_seq=0 2023-07-14T13:18:24.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.519+0000 7f2c79ffb700 10 client.28474 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:24.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.519+0000 7f2c79ffb700 1 -- 172.21.15.17:0/4276723666 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561e7e979050 con 0x561e7eadb610 2023-07-14T13:18:24.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.519+0000 7f2c79ffb700 10 client.28474 handle_command_reply: tid=0 2023-07-14T13:18:24.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.519+0000 7f2cac943b80 1 client.28474 shutdown 2023-07-14T13:18:24.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.521+0000 7f2cac943b80 1 -- 172.21.15.17:0/4276723666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 msgr2=0x561e7ea7b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:24.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.521+0000 7f2cac943b80 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea7b540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2c84000c00 tx=0x7f2c84009ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.521+0000 7f2cac943b80 1 -- 172.21.15.17:0/4276723666 shutdown_connections 2023-07-14T13:18:24.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.521+0000 7f2cac943b80 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561e7eadb610 0x561e7eadda20 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.521+0000 7f2cac943b80 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561e7ea76ad0 0x561e7ea7ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.521+0000 7f2c79ffb700 0 client.28474 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:24.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.521+0000 7f2cac943b80 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e7ea6b2d0 0x561e7ea7d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.521+0000 7f2cac943b80 1 --2- 172.21.15.17:0/4276723666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e7ea6bbe0 0x561e7ea7b540 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.521+0000 7f2cac943b80 1 -- 172.21.15.17:0/4276723666 >> 172.21.15.17:0/4276723666 conn(0x561e7ea61da0 msgr2=0x561e7ea6eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:24.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.521+0000 7f2cac943b80 1 -- 172.21.15.17:0/4276723666 shutdown_connections 2023-07-14T13:18:24.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.522+0000 7f2cac943b80 1 -- 172.21.15.17:0/4276723666 wait complete. 2023-07-14T13:18:24.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.523+0000 7f2cac943b80 20 client.28474 trim_cache size 0 max 16384 2023-07-14T13:18:24.560 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:18:24.560 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:18:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:18:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "08eb255e-b80d-47a4-a337-a06a8d3ea112": { 2023-07-14T13:18:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:18:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "08eb255e-b80d-47a4-a337-a06a8d3ea112", 2023-07-14T13:18:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:18:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:18:24.561 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:18:24.561 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:18:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.525+0000 7f2c98fff700 1 -- 172.21.15.17:0/1250728345 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c7c0a1490 msgr2=0x7f2c7c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:24.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.525+0000 7f2c98fff700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c7c0a1490 0x7f2c7c0a3940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400b5c0 tx=0x7f2c84005550 comp rx=0 tx=0).stop 2023-07-14T13:18:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.525+0000 7f2c98fff700 1 -- 172.21.15.17:0/1250728345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c941109a0 msgr2=0x7f2c941a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.525+0000 7f2c98fff700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c941109a0 0x7f2c941a0a80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800c940 tx=0x7f2c8800cd00 comp rx=0 tx=0).stop 2023-07-14T13:18:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.526+0000 7f2c98fff700 1 -- 172.21.15.17:0/1250728345 shutdown_connections 2023-07-14T13:18:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.526+0000 7f2c98fff700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2c7c0a1490 0x7f2c7c0a3940 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.526+0000 7f2c98fff700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c941109a0 0x7f2c941a0a80 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.526+0000 7f2c98fff700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c94074a40 0x7f2c9419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.526+0000 7f2c98fff700 1 --2- 172.21.15.17:0/1250728345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c94075350 0x7f2c9419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:24.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.526+0000 7f2c98fff700 1 -- 172.21.15.17:0/1250728345 >> 172.21.15.17:0/1250728345 conn(0x7f2c940fd7e0 msgr2=0x7f2c940ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:24.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.529+0000 7f2c98fff700 1 -- 172.21.15.17:0/1250728345 shutdown_connections 2023-07-14T13:18:24.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:24.529+0000 7f2c98fff700 1 -- 172.21.15.17:0/1250728345 wait complete. 2023-07-14T13:18:24.605 INFO:tasks.cephfs.filesystem:scrub status for tag:08eb255e-b80d-47a4-a337-a06a8d3ea112 - {'path': '/', 'tag': '08eb255e-b80d-47a4-a337-a06a8d3ea112', 'options': 'recursive,force'} 2023-07-14T13:18:24.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:24 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:18:24.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:24 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:18:25.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:25 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:18:25.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:25 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:25.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:25 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:18:25.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:25 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:18:25.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:25 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:18:25.616 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:25 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:25.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:25 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:25.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:25 smithi017 ceph-mon[95536]: pgmap v589: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 14 MiB/s wr, 172 op/s 2023-07-14T13:18:25.617 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:25 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:25.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:25 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:18:25.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:25 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:25.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:25 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:18:25.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:25 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:18:25.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:25 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:18:25.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:25 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:25.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:25 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:25.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:25 smithi135 ceph-mon[97338]: pgmap v589: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 14 MiB/s wr, 172 op/s 2023-07-14T13:18:25.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:25 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:26.362 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:25 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:18:26.363 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:25 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:26.363 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:25 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:18:26.363 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:25 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:18:26.363 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:25 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:18:26.363 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:25 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:26.363 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:25 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:26.364 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:25 smithi131 ceph-mon[96953]: pgmap v589: 97 pgs: 97 active+clean; 16 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 14 MiB/s wr, 172 op/s 2023-07-14T13:18:26.364 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:25 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:27.456 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 15.0 s, 522.5 tps, lat 191.105 ms stddev 50.255 2023-07-14T13:18:27.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:27 smithi017 ceph-mon[95536]: pgmap v590: 97 pgs: 97 active+clean; 16 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 20 MiB/s wr, 643 op/s 2023-07-14T13:18:27.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:27 smithi135 ceph-mon[97338]: pgmap v590: 97 pgs: 97 active+clean; 16 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 20 MiB/s wr, 643 op/s 2023-07-14T13:18:27.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:27 smithi131 ceph-mon[96953]: pgmap v590: 97 pgs: 97 active+clean; 16 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 20 MiB/s wr, 643 op/s 2023-07-14T13:18:28.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:28 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:18:28.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:28 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:18:28.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:28 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:18:28.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:28 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:18:28.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:28 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:18:28.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:28 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:18:28.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:28 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:18:28.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:28 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:18:28.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:28 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:18:29.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:29 smithi017 ceph-mon[95536]: pgmap v591: 97 pgs: 97 active+clean; 16 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 14 MiB/s wr, 571 op/s 2023-07-14T13:18:29.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:29 smithi135 ceph-mon[97338]: pgmap v591: 97 pgs: 97 active+clean; 16 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 14 MiB/s wr, 571 op/s 2023-07-14T13:18:29.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:29 smithi131 ceph-mon[96953]: pgmap v591: 97 pgs: 97 active+clean; 16 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 14 MiB/s wr, 571 op/s 2023-07-14T13:18:30.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:30 smithi017 ceph-mon[95536]: pgmap v592: 97 pgs: 97 active+clean; 16 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 22 MiB/s wr, 1.14k op/s 2023-07-14T13:18:30.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:30 smithi135 ceph-mon[97338]: pgmap v592: 97 pgs: 97 active+clean; 16 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 22 MiB/s wr, 1.14k op/s 2023-07-14T13:18:30.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:30 smithi131 ceph-mon[96953]: pgmap v592: 97 pgs: 97 active+clean; 16 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 22 MiB/s wr, 1.14k op/s 2023-07-14T13:18:32.455 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 20.0 s, 742.7 tps, lat 134.753 ms stddev 40.442 2023-07-14T13:18:33.615 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:33 smithi017 ceph-mon[95536]: pgmap v593: 97 pgs: 97 active+clean; 16 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:18:33.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:33 smithi135 ceph-mon[97338]: pgmap v593: 97 pgs: 97 active+clean; 16 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:18:33.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:33 smithi131 ceph-mon[96953]: pgmap v593: 97 pgs: 97 active+clean; 16 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:18:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.335+0000 7f5fb71ff700 1 -- 172.21.15.17:0/279075046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fb0074a40 msgr2=0x7f5fb0074e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.335+0000 7f5fb71ff700 1 --2- 172.21.15.17:0/279075046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fb0074a40 0x7f5fb0074e10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009f90 tx=0x7f5fa400b330 comp rx=0 tx=0).stop 2023-07-14T13:18:34.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.336+0000 7f5fb71ff700 1 -- 172.21.15.17:0/279075046 shutdown_connections 2023-07-14T13:18:34.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.336+0000 7f5fb71ff700 1 --2- 172.21.15.17:0/279075046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb0110a00 0x7f5fb0112de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.336+0000 7f5fb71ff700 1 --2- 172.21.15.17:0/279075046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fb0074a40 0x7f5fb0074e10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.336+0000 7f5fb71ff700 1 --2- 172.21.15.17:0/279075046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0075350 0x7f5fb01104c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.336+0000 7f5fb71ff700 1 -- 172.21.15.17:0/279075046 >> 172.21.15.17:0/279075046 conn(0x7f5fb00fd840 msgr2=0x7f5fb00ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.337+0000 7f5fb71ff700 1 -- 172.21.15.17:0/279075046 shutdown_connections 2023-07-14T13:18:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.337+0000 7f5fb71ff700 1 -- 172.21.15.17:0/279075046 wait complete. 2023-07-14T13:18:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.338+0000 7f5fb71ff700 1 Processor -- start 2023-07-14T13:18:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.339+0000 7f5fb71ff700 1 -- start start 2023-07-14T13:18:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.339+0000 7f5fb71ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fb0075350 0x7f5fb0110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.339+0000 7f5fb71ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb0110a00 0x7f5fb0108f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.339+0000 7f5fb71ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0109490 0x7f5fb0109930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.339+0000 7f5fb71ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb010dce0 con 0x7f5fb0110a00 2023-07-14T13:18:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.339+0000 7f5fb71ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb010de20 con 0x7f5fb0075350 2023-07-14T13:18:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.339+0000 7f5fb71ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb010dfe0 con 0x7f5fb0109490 2023-07-14T13:18:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.340+0000 7f5fb579c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0109490 0x7f5fb0109930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.340+0000 7f5fb579c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0109490 0x7f5fb0109930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48536/0 (socket says 172.21.15.17:48536) 2023-07-14T13:18:34.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.340+0000 7f5fb579c700 1 -- 172.21.15.17:0/2778453856 learned_addr learned my addr 172.21.15.17:0/2778453856 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:34.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.340+0000 7f5fb4f9b700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fb0075350 0x7f5fb0110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.340+0000 7f5faffff700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb0110a00 0x7f5fb0108f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.341+0000 7f5fb579c700 1 -- 172.21.15.17:0/2778453856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fb0075350 msgr2=0x7f5fb0110150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:34.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.341+0000 7f5fb579c700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fb0075350 0x7f5fb0110150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.341+0000 7f5fb579c700 1 -- 172.21.15.17:0/2778453856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb0110a00 msgr2=0x7f5fb0108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:34.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.341+0000 7f5fb579c700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb0110a00 0x7f5fb0108f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.341+0000 7f5fb579c700 1 -- 172.21.15.17:0/2778453856 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4009c40 con 0x7f5fb0109490 2023-07-14T13:18:34.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.342+0000 7f5fb579c700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0109490 0x7f5fb0109930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800e970 tx=0x7f5fa800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:34.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.342+0000 7f5fadffb700 1 -- 172.21.15.17:0/2778453856 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8009750 con 0x7f5fb0109490 2023-07-14T13:18:34.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.342+0000 7f5fb71ff700 1 -- 172.21.15.17:0/2778453856 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb010e2c0 con 0x7f5fb0109490 2023-07-14T13:18:34.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.342+0000 7f5fb71ff700 1 -- 172.21.15.17:0/2778453856 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb010e7d0 con 0x7f5fb0109490 2023-07-14T13:18:34.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.343+0000 7f5fadffb700 1 -- 172.21.15.17:0/2778453856 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fa800ee60 con 0x7f5fb0109490 2023-07-14T13:18:34.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.343+0000 7f5fadffb700 1 -- 172.21.15.17:0/2778453856 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8005490 con 0x7f5fb0109490 2023-07-14T13:18:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.349+0000 7f5fadffb700 1 -- 172.21.15.17:0/2778453856 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5fa8005610 con 0x7f5fb0109490 2023-07-14T13:18:34.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.351+0000 7f5fcaa61b80 1 Processor -- start 2023-07-14T13:18:34.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.351+0000 7f5fcaa61b80 1 -- start start 2023-07-14T13:18:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.352+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59d7a6b0 0x558a59f23d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.352+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59f242d0 0x558a59f1e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.352+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f1e580 0x558a59f1e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.352+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59e23c50 con 0x558a59f1e580 2023-07-14T13:18:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.352+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59e769e0 con 0x558a59d7a6b0 2023-07-14T13:18:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.352+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59e6fe70 con 0x558a59f242d0 2023-07-14T13:18:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.352+0000 7f5faffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59d7a6b0 0x558a59f23d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.352+0000 7f5fb4f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59f242d0 0x558a59f1e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.352+0000 7f5fb4f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59f242d0 0x558a59f1e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48540/0 (socket says 172.21.15.17:48540) 2023-07-14T13:18:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.352+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/3301856910 learned_addr learned my addr 172.21.15.17:0/3301856910 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.352+0000 7f5fadffb700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5fa00a1340 0x7f5fa00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.353+0000 7f5fadffb700 1 -- 172.21.15.17:0/2778453856 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5fa8014070 con 0x7f5fb0109490 2023-07-14T13:18:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.353+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/3301856910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59d7a6b0 msgr2=0x558a59f23d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.353+0000 7f5fb4f9b700 1 --2- 172.21.15.17:0/3301856910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59d7a6b0 0x558a59f23d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.353+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/3301856910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f1e580 msgr2=0x558a59f1e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.353+0000 7f5fb4f9b700 1 --2- 172.21.15.17:0/3301856910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f1e580 0x558a59f1e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.353+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/3301856910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a59c9dd80 con 0x558a59f242d0 2023-07-14T13:18:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.353+0000 7f5fb4f9b700 1 --2- 172.21.15.17:0/3301856910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59f242d0 0x558a59f1e040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0074970 tx=0x7f5fa4009420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f31d6e3855f2b8f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.354+0000 7f5f9affd700 1 -- 172.21.15.17:0/3301856910 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400e040 con 0x558a59f242d0 2023-07-14T13:18:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.354+0000 7f5f9affd700 1 -- 172.21.15.17:0/3301856910 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fa40077a0 con 0x558a59f242d0 2023-07-14T13:18:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.354+0000 7f5f9affd700 1 -- 172.21.15.17:0/3301856910 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400bc50 con 0x558a59f242d0 2023-07-14T13:18:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.355+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3301856910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59f242d0 msgr2=0x558a59f1e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.355+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/3301856910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59f242d0 0x558a59f1e040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0074970 tx=0x7f5fa4009420 comp rx=0 tx=0).stop 2023-07-14T13:18:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.355+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3301856910 shutdown_connections 2023-07-14T13:18:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.355+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/3301856910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f1e580 0x558a59f1e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.355+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/3301856910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59d7a6b0 0x558a59f23d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.355+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/3301856910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59f242d0 0x558a59f1e040 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.355+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3301856910 >> 172.21.15.17:0/3301856910 conn(0x558a59f13be0 msgr2=0x558a59f18f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.357+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3301856910 shutdown_connections 2023-07-14T13:18:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.357+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3301856910 wait complete. 2023-07-14T13:18:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.358+0000 7f5fcaa61b80 1 -- start start 2023-07-14T13:18:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.358+0000 7f5fb579c700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5fa00a1340 0x7f5fa00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.358+0000 7f5fcaa61b80 1 Processor -- start 2023-07-14T13:18:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.359+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59d7a6b0 0x558a59f2a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.359+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 0x558a59f278e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.359+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59f242d0 0x558a59f28020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.359+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59e0fa60 con 0x558a59d7a6b0 2023-07-14T13:18:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.359+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59e0f760 con 0x558a59f1e580 2023-07-14T13:18:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.359+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59cf38c0 con 0x558a59f242d0 2023-07-14T13:18:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.359+0000 7f5fcaa61b80 10 client.0 _ll_register_callbacks cb 0x558a59e0d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.359+0000 7f5fb4f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 0x558a59f278e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.360+0000 7f5fb4f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 0x558a59f278e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52634/0 (socket says 172.21.15.17:52634) 2023-07-14T13:18:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.360+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/499851903 learned_addr learned my addr 172.21.15.17:0/499851903 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.361+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/499851903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59f242d0 msgr2=0x558a59f28020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:18:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.361+0000 7f5fb4f9b700 1 --2- 172.21.15.17:0/499851903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59f242d0 0x558a59f28020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.361+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/499851903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59d7a6b0 msgr2=0x558a59f2a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.361+0000 7f5fb4f9b700 1 --2- 172.21.15.17:0/499851903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59d7a6b0 0x558a59f2a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.361+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/499851903 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb0113810 con 0x558a59f1e580 2023-07-14T13:18:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.361+0000 7f5fb4f9b700 1 --2- 172.21.15.17:0/499851903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 0x558a59f278e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4007eb0 tx=0x7f5fa40076a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1e0a2893e45896 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.362+0000 7f5f8ffff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:18:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.362+0000 7f5f8ffff700 1 -- 172.21.15.17:0/499851903 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400e040 con 0x558a59f1e580 2023-07-14T13:18:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.362+0000 7f5f8ffff700 1 -- 172.21.15.17:0/499851903 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5fa400b9f0 con 0x558a59f1e580 2023-07-14T13:18:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.363+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/499851903 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a59dc9490 con 0x558a59f1e580 2023-07-14T13:18:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.364+0000 7f5f8ffff700 1 -- 172.21.15.17:0/499851903 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fa400bbb0 con 0x558a59f1e580 2023-07-14T13:18:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.364+0000 7f5fcaa61b80 10 client.28523 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.364+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/499851903 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x558a59c86c00 con 0x558a59f1e580 2023-07-14T13:18:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.365+0000 7f5fb579c700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5fa00a1340 0x7f5fa00a37f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8099dc0 tx=0x7f5fa8099cf0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.365+0000 7f5f8ffff700 1 -- 172.21.15.17:0/499851903 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fa4033030 con 0x558a59f1e580 2023-07-14T13:18:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.365+0000 7f5f8ffff700 1 -- 172.21.15.17:0/499851903 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5fa4022020 con 0x558a59f1e580 2023-07-14T13:18:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.365+0000 7f5fcaa61b80 10 client.28523 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.365+0000 7f5fcaa61b80 10 client.28523 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.365+0000 7f5fcaa61b80 20 client.28523 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.365+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/499851903 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a59f37830 0x558a59f39c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.365+0000 7f5fcaa61b80 4 client.28523 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.365+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/499851903 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a59e68e50 con 0x558a59f37830 2023-07-14T13:18:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.366+0000 7f5faffff700 1 --2- 172.21.15.17:0/499851903 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a59f37830 0x558a59f39c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.369+0000 7f5faffff700 1 --2- 172.21.15.17:0/499851903 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a59f37830 0x558a59f39c40 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62fbe3a3024de3e5 server_cookie=37f9f1089497c2ac in_seq=0 out_seq=0 2023-07-14T13:18:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.369+0000 7f5f8ffff700 10 client.28523 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.370+0000 7f5f8ffff700 1 -- 172.21.15.17:0/499851903 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558a59e68e50 con 0x558a59f37830 2023-07-14T13:18:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.370+0000 7f5f8ffff700 10 client.28523 handle_command_reply: tid=0 2023-07-14T13:18:34.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.371+0000 7f5fcaa61b80 1 client.28523 shutdown 2023-07-14T13:18:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.371+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/499851903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 msgr2=0x558a59f278e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.371+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/499851903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 0x558a59f278e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4007eb0 tx=0x7f5fa40076a0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.372+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/499851903 shutdown_connections 2023-07-14T13:18:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.372+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/499851903 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a59f37830 0x558a59f39c40 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.372+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/499851903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59f242d0 0x558a59f28020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.372+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/499851903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59d7a6b0 0x558a59f2a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.372+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/499851903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 0x558a59f278e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.372+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/499851903 >> 172.21.15.17:0/499851903 conn(0x558a59f13be0 msgr2=0x558a59f184e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.372+0000 7f5f8ffff700 0 client.28523 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:34.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.375+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/499851903 shutdown_connections 2023-07-14T13:18:34.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.375+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/499851903 wait complete. 2023-07-14T13:18:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.376+0000 7f5fcaa61b80 20 client.28523 trim_cache size 0 max 16384 2023-07-14T13:18:34.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.406+0000 7f5fcaa61b80 1 Processor -- start 2023-07-14T13:18:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.406+0000 7f5fcaa61b80 1 -- start start 2023-07-14T13:18:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.406+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 0x558a59f231a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.406+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 0x558a59f18c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.406+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f242d0 0x558a59f2a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.406+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59f19d50 con 0x558a59f242d0 2023-07-14T13:18:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.406+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59f23a10 con 0x558a59f1e580 2023-07-14T13:18:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.406+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59f1aa50 con 0x558a59d7a6b0 2023-07-14T13:18:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.407+0000 7f5faffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 0x558a59f231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.407+0000 7f5faffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 0x558a59f231a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48544/0 (socket says 172.21.15.17:48544) 2023-07-14T13:18:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.407+0000 7f5faffff700 1 -- 172.21.15.17:0/1894157165 learned_addr learned my addr 172.21.15.17:0/1894157165 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.407+0000 7f5fb4f9b700 1 --2- 172.21.15.17:0/1894157165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 0x558a59f18c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.407+0000 7f5faffff700 1 --2- 172.21.15.17:0/1894157165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f242d0 0x558a59f2a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.407+0000 7f5faffff700 1 -- 172.21.15.17:0/1894157165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 msgr2=0x558a59f18c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.407+0000 7f5faffff700 1 --2- 172.21.15.17:0/1894157165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 0x558a59f18c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.408+0000 7f5faffff700 1 -- 172.21.15.17:0/1894157165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f242d0 msgr2=0x558a59f2a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.408+0000 7f5faffff700 1 --2- 172.21.15.17:0/1894157165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f242d0 0x558a59f2a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.408+0000 7f5faffff700 1 -- 172.21.15.17:0/1894157165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a59f1ec20 con 0x558a59d7a6b0 2023-07-14T13:18:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.408+0000 7f5faffff700 1 --2- 172.21.15.17:0/1894157165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 0x558a59f231a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00cfc0 tx=0x7f5f9c005cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a322f13c09a3ae6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.411+0000 7f5f9b7fe700 1 -- 172.21.15.17:0/1894157165 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c016040 con 0x558a59d7a6b0 2023-07-14T13:18:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.411+0000 7f5f9b7fe700 1 -- 172.21.15.17:0/1894157165 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f9c01f020 con 0x558a59d7a6b0 2023-07-14T13:18:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.411+0000 7f5f9b7fe700 1 -- 172.21.15.17:0/1894157165 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c010900 con 0x558a59d7a6b0 2023-07-14T13:18:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.412+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/1894157165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 msgr2=0x558a59f231a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.412+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/1894157165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 0x558a59f231a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00cfc0 tx=0x7f5f9c005cd0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.412+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/1894157165 shutdown_connections 2023-07-14T13:18:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.412+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/1894157165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f242d0 0x558a59f2a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.412+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/1894157165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 0x558a59f231a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.412+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/1894157165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f1e580 0x558a59f18c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.412+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/1894157165 >> 172.21.15.17:0/1894157165 conn(0x558a59f13be0 msgr2=0x558a59f22a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.413+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/1894157165 shutdown_connections 2023-07-14T13:18:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.413+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/1894157165 wait complete. 2023-07-14T13:18:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.413+0000 7f5fcaa61b80 1 -- start start 2023-07-14T13:18:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.414+0000 7f5fcaa61b80 1 Processor -- start 2023-07-14T13:18:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.415+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 0x558a59f2e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.415+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f1e580 0x558a59f2ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.415+0000 7f5fcaa61b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f242d0 0x558a59f2ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.415+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59f2d520 con 0x558a59f1e580 2023-07-14T13:18:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.415+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59f2d690 con 0x558a59f242d0 2023-07-14T13:18:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.415+0000 7f5fcaa61b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a59f2d850 con 0x558a59d7a6b0 2023-07-14T13:18:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.415+0000 7f5fcaa61b80 10 client.0 _ll_register_callbacks cb 0x7f5fa4009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.415+0000 7f5fb4f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f1e580 0x558a59f2ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.415+0000 7f5fb4f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f1e580 0x558a59f2ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47482/0 (socket says 172.21.15.17:47482) 2023-07-14T13:18:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.415+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/3610005372 learned_addr learned my addr 172.21.15.17:0/3610005372 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.416+0000 7f5faffff700 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f242d0 0x558a59f2ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.416+0000 7f5faffff700 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 0x558a59f2e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.416+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/3610005372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 msgr2=0x558a59f2e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.416+0000 7f5fb4f9b700 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 0x558a59f2e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.416+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/3610005372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f242d0 msgr2=0x558a59f2ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.416+0000 7f5fb4f9b700 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f242d0 0x558a59f2ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.454 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.416+0000 7f5fb4f9b700 1 -- 172.21.15.17:0/3610005372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9c00cd50 con 0x558a59f1e580 2023-07-14T13:18:34.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.416+0000 7f5faffff700 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f242d0 0x558a59f2ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:18:34.455 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.417+0000 7f5fb4f9b700 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f1e580 0x558a59f2ee40 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009790 tx=0x7f5fa400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cbe1a3c9688eb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:34.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.417+0000 7f5f8ffff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:34.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.418+0000 7f5f8ffff700 1 -- 172.21.15.17:0/3610005372 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400e070 con 0x558a59f1e580 2023-07-14T13:18:34.456 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.418+0000 7f5f8ffff700 1 -- 172.21.15.17:0/3610005372 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5fa401c5b0 con 0x558a59f1e580 2023-07-14T13:18:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.418+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3610005372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5fa40077a0 con 0x558a59f1e580 2023-07-14T13:18:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.419+0000 7f5f8ffff700 1 -- 172.21.15.17:0/3610005372 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fa401ca00 con 0x558a59f1e580 2023-07-14T13:18:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.419+0000 7f5fcaa61b80 10 client.18801 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.419+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3610005372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x558a59cc41f0 con 0x558a59f1e580 2023-07-14T13:18:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.419+0000 7f5f8ffff700 1 -- 172.21.15.17:0/3610005372 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fa40077a0 con 0x558a59f1e580 2023-07-14T13:18:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.420+0000 7f5f8ffff700 1 -- 172.21.15.17:0/3610005372 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5fa4022040 con 0x558a59f1e580 2023-07-14T13:18:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.420+0000 7f5fcaa61b80 10 client.18801 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.420+0000 7f5fcaa61b80 10 client.18801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.420+0000 7f5fcaa61b80 20 client.18801 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.420+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a59f864d0 0x558a59f868d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.420+0000 7f5fcaa61b80 4 client.18801 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:18:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.420+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3610005372 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558a59e2aff0 con 0x558a59f864d0 2023-07-14T13:18:34.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.421+0000 7f5faffff700 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a59f864d0 0x558a59f868d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:34.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.421+0000 7f5faffff700 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a59f864d0 0x558a59f868d0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=590dc27fc8831af2 server_cookie=e8e5fabb01cbec16 in_seq=0 out_seq=0 2023-07-14T13:18:34.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.421+0000 7f5f8ffff700 10 client.18801 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5f8ffff700 1 -- 172.21.15.17:0/3610005372 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558a59e2aff0 con 0x558a59f864d0 2023-07-14T13:18:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5f8ffff700 10 client.18801 handle_command_reply: tid=0 2023-07-14T13:18:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5fcaa61b80 1 client.18801 shutdown 2023-07-14T13:18:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3610005372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f1e580 msgr2=0x558a59f2ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f1e580 0x558a59f2ee40 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009790 tx=0x7f5fa400bd50 comp rx=0 tx=0).stop 2023-07-14T13:18:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3610005372 shutdown_connections 2023-07-14T13:18:34.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558a59f864d0 0x558a59f868d0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558a59f242d0 0x558a59f2ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a59d7a6b0 0x558a59f2e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5fcaa61b80 1 --2- 172.21.15.17:0/3610005372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558a59f1e580 0x558a59f2ee40 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5f8ffff700 0 client.18801 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.437+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3610005372 >> 172.21.15.17:0/3610005372 conn(0x558a59f13be0 msgr2=0x558a59f248a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.438+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3610005372 shutdown_connections 2023-07-14T13:18:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.438+0000 7f5fcaa61b80 1 -- 172.21.15.17:0/3610005372 wait complete. 2023-07-14T13:18:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.438+0000 7f5fcaa61b80 20 client.18801 trim_cache size 0 max 16384 2023-07-14T13:18:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:18:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:18:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:18:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:18:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.439+0000 7f5fb71ff700 1 -- 172.21.15.17:0/2778453856 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5fa00a1340 msgr2=0x7f5fa00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.439+0000 7f5fb71ff700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5fa00a1340 0x7f5fa00a37f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8099dc0 tx=0x7f5fa8099cf0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.439+0000 7f5fb71ff700 1 -- 172.21.15.17:0/2778453856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0109490 msgr2=0x7f5fb0109930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.439+0000 7f5fb71ff700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0109490 0x7f5fb0109930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800e970 tx=0x7f5fa800ec80 comp rx=0 tx=0).stop 2023-07-14T13:18:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.440+0000 7f5fb71ff700 1 -- 172.21.15.17:0/2778453856 shutdown_connections 2023-07-14T13:18:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.440+0000 7f5fb71ff700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5fa00a1340 0x7f5fa00a37f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.440+0000 7f5fb71ff700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb0109490 0x7f5fb0109930 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.440+0000 7f5fb71ff700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fb0075350 0x7f5fb0110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.440+0000 7f5fb71ff700 1 --2- 172.21.15.17:0/2778453856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fb0110a00 0x7f5fb0108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.440+0000 7f5fb71ff700 1 -- 172.21.15.17:0/2778453856 >> 172.21.15.17:0/2778453856 conn(0x7f5fb00fd840 msgr2=0x7f5fb0111660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.440+0000 7f5fb71ff700 1 -- 172.21.15.17:0/2778453856 shutdown_connections 2023-07-14T13:18:34.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:34.440+0000 7f5fb71ff700 1 -- 172.21.15.17:0/2778453856 wait complete. 2023-07-14T13:18:35.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:35 smithi017 ceph-mon[95536]: pgmap v594: 97 pgs: 97 active+clean; 16 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:18:35.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:35 smithi135 ceph-mon[97338]: pgmap v594: 97 pgs: 97 active+clean; 16 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:18:35.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:35 smithi131 ceph-mon[96953]: pgmap v594: 97 pgs: 97 active+clean; 16 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:18:37.454 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 25.0 s, 613.6 tps, lat 163.713 ms stddev 45.719 2023-07-14T13:18:37.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:37 smithi017 ceph-mon[95536]: pgmap v595: 97 pgs: 97 active+clean; 16 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 23 MiB/s wr, 1.68k op/s 2023-07-14T13:18:37.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:37 smithi135 ceph-mon[97338]: pgmap v595: 97 pgs: 97 active+clean; 16 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 23 MiB/s wr, 1.68k op/s 2023-07-14T13:18:37.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:37 smithi131 ceph-mon[96953]: pgmap v595: 97 pgs: 97 active+clean; 16 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 23 MiB/s wr, 1.68k op/s 2023-07-14T13:18:39.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:39 smithi017 ceph-mon[95536]: pgmap v596: 97 pgs: 97 active+clean; 16 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 17 MiB/s wr, 1.20k op/s 2023-07-14T13:18:39.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:39 smithi135 ceph-mon[97338]: pgmap v596: 97 pgs: 97 active+clean; 16 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 17 MiB/s wr, 1.20k op/s 2023-07-14T13:18:39.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:39 smithi131 ceph-mon[96953]: pgmap v596: 97 pgs: 97 active+clean; 16 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 17 MiB/s wr, 1.20k op/s 2023-07-14T13:18:40.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:40 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:18:40.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:40 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:18:40.613 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:40 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:18:40.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:40 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:18:40.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:40 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:18:40.704 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:40 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:18:40.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:40 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:18:40.752 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:40 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:18:40.753 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:40 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:18:41.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:41 smithi017 ceph-mon[95536]: pgmap v597: 97 pgs: 97 active+clean; 16 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 27 MiB/s wr, 1.90k op/s 2023-07-14T13:18:41.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:41 smithi135 ceph-mon[97338]: pgmap v597: 97 pgs: 97 active+clean; 16 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 27 MiB/s wr, 1.90k op/s 2023-07-14T13:18:41.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:41 smithi131 ceph-mon[96953]: pgmap v597: 97 pgs: 97 active+clean; 16 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 27 MiB/s wr, 1.90k op/s 2023-07-14T13:18:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 30.0 s, 722.0 tps, lat 138.475 ms stddev 32.826 2023-07-14T13:18:43.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:43 smithi017 ceph-mon[95536]: pgmap v598: 97 pgs: 97 active+clean; 16 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 18 MiB/s wr, 1.33k op/s 2023-07-14T13:18:43.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:43 smithi135 ceph-mon[97338]: pgmap v598: 97 pgs: 97 active+clean; 16 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 18 MiB/s wr, 1.33k op/s 2023-07-14T13:18:43.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:43 smithi131 ceph-mon[96953]: pgmap v598: 97 pgs: 97 active+clean; 16 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 18 MiB/s wr, 1.33k op/s 2023-07-14T13:18:45.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:45 smithi017 ceph-mon[95536]: pgmap v599: 97 pgs: 97 active+clean; 16 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 18 MiB/s wr, 1.33k op/s 2023-07-14T13:18:45.703 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:45 smithi135 ceph-mon[97338]: pgmap v599: 97 pgs: 97 active+clean; 16 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 18 MiB/s wr, 1.33k op/s 2023-07-14T13:18:45.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:45 smithi131 ceph-mon[96953]: pgmap v599: 97 pgs: 97 active+clean; 16 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 18 MiB/s wr, 1.33k op/s 2023-07-14T13:18:47.455 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 35.0 s, 751.6 tps, lat 133.011 ms stddev 46.974 2023-07-14T13:18:47.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:47 smithi017 ceph-mon[95536]: pgmap v600: 97 pgs: 97 active+clean; 16 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 27 MiB/s wr, 1.87k op/s 2023-07-14T13:18:47.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:47 smithi135 ceph-mon[97338]: pgmap v600: 97 pgs: 97 active+clean; 16 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 27 MiB/s wr, 1.87k op/s 2023-07-14T13:18:47.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:47 smithi131 ceph-mon[96953]: pgmap v600: 97 pgs: 97 active+clean; 16 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 27 MiB/s wr, 1.87k op/s 2023-07-14T13:18:47.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.718+0000 7f8ccdfff700 1 -- 172.21.15.17:0/1008781443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc8067ee0 msgr2=0x7f8cc8068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:47.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.718+0000 7f8ccdfff700 1 --2- 172.21.15.17:0/1008781443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc8067ee0 0x7f8cc8068350 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009990 tx=0x7f8cbc009ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.718+0000 7f8ccdfff700 1 -- 172.21.15.17:0/1008781443 shutdown_connections 2023-07-14T13:18:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.718+0000 7f8ccdfff700 1 --2- 172.21.15.17:0/1008781443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc81024f0 0x7f8cc8102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.718+0000 7f8ccdfff700 1 --2- 172.21.15.17:0/1008781443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8104a60 0x7f8cc80679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.718+0000 7f8ccdfff700 1 --2- 172.21.15.17:0/1008781443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc8067ee0 0x7f8cc8068350 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.718+0000 7f8ccdfff700 1 -- 172.21.15.17:0/1008781443 >> 172.21.15.17:0/1008781443 conn(0x7f8cc8074760 msgr2=0x7f8cc8074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.718+0000 7f8ccdfff700 1 -- 172.21.15.17:0/1008781443 shutdown_connections 2023-07-14T13:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.718+0000 7f8ccdfff700 1 -- 172.21.15.17:0/1008781443 wait complete. 2023-07-14T13:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.720+0000 7f8ccdfff700 1 Processor -- start 2023-07-14T13:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.721+0000 7f8ccdfff700 1 -- start start 2023-07-14T13:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.721+0000 7f8ccdfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc8067ee0 0x7f8cc8071a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.721+0000 7f8ccdfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81024f0 0x7f8cc8071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.721+0000 7f8ccdfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8104a60 0x7f8cc806a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.721+0000 7f8ccdfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc806afc0 con 0x7f8cc8067ee0 2023-07-14T13:18:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.721+0000 7f8ccdfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc806b130 con 0x7f8cc8104a60 2023-07-14T13:18:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.721+0000 7f8ccdfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc806b2f0 con 0x7f8cc81024f0 2023-07-14T13:18:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.722+0000 7f8cc77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc8067ee0 0x7f8cc8071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.722+0000 7f8cc77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc8067ee0 0x7f8cc8071a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42792/0 (socket says 172.21.15.17:42792) 2023-07-14T13:18:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.722+0000 7f8cc6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81024f0 0x7f8cc8071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.722+0000 7f8cc77fe700 1 -- 172.21.15.17:0/3616171419 learned_addr learned my addr 172.21.15.17:0/3616171419 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.722+0000 7f8cc7fff700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8104a60 0x7f8cc806a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.722+0000 7f8cc6ffd700 1 -- 172.21.15.17:0/3616171419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8104a60 msgr2=0x7f8cc806a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.722+0000 7f8cc6ffd700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8104a60 0x7f8cc806a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.722+0000 7f8cc6ffd700 1 -- 172.21.15.17:0/3616171419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc8067ee0 msgr2=0x7f8cc8071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.722+0000 7f8cc6ffd700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc8067ee0 0x7f8cc8071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.722+0000 7f8cc6ffd700 1 -- 172.21.15.17:0/3616171419 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc0095f0 con 0x7f8cc81024f0 2023-07-14T13:18:47.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.722+0000 7f8cc77fe700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc8067ee0 0x7f8cc8071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:18:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.723+0000 7f8cc6ffd700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81024f0 0x7f8cc8071fa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0098e0 tx=0x7f8cbc005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.723+0000 7f8cc4ff9700 1 -- 172.21.15.17:0/3616171419 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc01d070 con 0x7f8cc81024f0 2023-07-14T13:18:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.723+0000 7f8ccdfff700 1 -- 172.21.15.17:0/3616171419 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc806b570 con 0x7f8cc81024f0 2023-07-14T13:18:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.723+0000 7f8ccdfff700 1 -- 172.21.15.17:0/3616171419 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc806f790 con 0x7f8cc81024f0 2023-07-14T13:18:47.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.723+0000 7f8cc4ff9700 1 -- 172.21.15.17:0/3616171419 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cbc0173f0 con 0x7f8cc81024f0 2023-07-14T13:18:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.723+0000 7f8cc4ff9700 1 -- 172.21.15.17:0/3616171419 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00e640 con 0x7f8cc81024f0 2023-07-14T13:18:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.729+0000 7f8cc4ff9700 1 -- 172.21.15.17:0/3616171419 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8cbc017560 con 0x7f8cc81024f0 2023-07-14T13:18:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.731+0000 7f8ce1931b80 1 Processor -- start 2023-07-14T13:18:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.731+0000 7f8ce1931b80 1 -- start start 2023-07-14T13:18:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.732+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9d3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.732+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.732+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 0x55b3fc9ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.732+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc8c2c50 con 0x55b3fc8196b0 2023-07-14T13:18:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.732+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc9159e0 con 0x55b3fc9d42a0 2023-07-14T13:18:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.732+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc90ee70 con 0x55b3fc9d4710 2023-07-14T13:18:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.732+0000 7f8cc77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.733+0000 7f8cc7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9d3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.733+0000 7f8cc7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9d3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42800/0 (socket says 172.21.15.17:42800) 2023-07-14T13:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.733+0000 7f8cc7fff700 1 -- 172.21.15.17:0/1802357564 learned_addr learned my addr 172.21.15.17:0/1802357564 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.733+0000 7f8cc4ff9700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb00a1400 0x7f8cb00a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.734+0000 7f8cc4ff9700 1 -- 172.21.15.17:0/3616171419 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8cbc0cdd40 con 0x7f8cc81024f0 2023-07-14T13:18:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.734+0000 7f8cc7fff700 1 -- 172.21.15.17:0/1802357564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 msgr2=0x55b3fc9ce5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:18:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.734+0000 7f8cc7fff700 1 --2- 172.21.15.17:0/1802357564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 0x55b3fc9ce5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.734+0000 7f8cc7fff700 1 -- 172.21.15.17:0/1802357564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc9d42a0 msgr2=0x55b3fc9ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.734+0000 7f8cc7fff700 1 --2- 172.21.15.17:0/1802357564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.734+0000 7f8cc7fff700 1 -- 172.21.15.17:0/1802357564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3fc73cd80 con 0x55b3fc8196b0 2023-07-14T13:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.735+0000 7f8cc7fff700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb00a1400 0x7f8cb00a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.735+0000 7f8cc7fff700 1 --2- 172.21.15.17:0/1802357564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9d3d60 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000be30 tx=0x7f8cc000f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b13350d47b4b2d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.736+0000 7f8cadffb700 1 -- 172.21.15.17:0/1802357564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc001a5c0 con 0x55b3fc8196b0 2023-07-14T13:18:47.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.736+0000 7f8cadffb700 1 -- 172.21.15.17:0/1802357564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cc0016070 con 0x55b3fc8196b0 2023-07-14T13:18:47.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.736+0000 7f8cadffb700 1 -- 172.21.15.17:0/1802357564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0019850 con 0x55b3fc8196b0 2023-07-14T13:18:47.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.737+0000 7f8ce1931b80 1 -- 172.21.15.17:0/1802357564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 msgr2=0x55b3fc9d3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:47.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.737+0000 7f8cc7fff700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb00a1400 0x7f8cb00a38b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000ffd0 tx=0x7f8cc001b000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.737+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/1802357564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9d3d60 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000be30 tx=0x7f8cc000f640 comp rx=0 tx=0).stop 2023-07-14T13:18:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.738+0000 7f8ce1931b80 1 -- 172.21.15.17:0/1802357564 shutdown_connections 2023-07-14T13:18:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.738+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/1802357564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 0x55b3fc9ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.738+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/1802357564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9d3d60 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.738+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/1802357564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.738+0000 7f8ce1931b80 1 -- 172.21.15.17:0/1802357564 >> 172.21.15.17:0/1802357564 conn(0x55b3fc9b2be0 msgr2=0x55b3fc9b7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:47.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.738+0000 7f8ce1931b80 1 -- 172.21.15.17:0/1802357564 shutdown_connections 2023-07-14T13:18:47.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.738+0000 7f8ce1931b80 1 -- 172.21.15.17:0/1802357564 wait complete. 2023-07-14T13:18:47.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.739+0000 7f8ce1931b80 1 -- start start 2023-07-14T13:18:47.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.739+0000 7f8ce1931b80 1 Processor -- start 2023-07-14T13:18:47.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.740+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc8196b0 0x55b3fc9da5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.740+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.740+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 0x55b3fc9d7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.740+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc8aea60 con 0x55b3fc9d42a0 2023-07-14T13:18:47.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.740+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc8ae760 con 0x55b3fc8196b0 2023-07-14T13:18:47.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.740+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc7928c0 con 0x55b3fc9d4710 2023-07-14T13:18:47.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.740+0000 7f8ce1931b80 10 client.0 _ll_register_callbacks cb 0x55b3fc8ac700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:47.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.741+0000 7f8cc7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 0x55b3fc9d7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.741+0000 7f8cc7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 0x55b3fc9d7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35746/0 (socket says 172.21.15.17:35746) 2023-07-14T13:18:47.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.741+0000 7f8cc7fff700 1 -- 172.21.15.17:0/3270178203 learned_addr learned my addr 172.21.15.17:0/3270178203 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:47.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.741+0000 7f8cc6ffd700 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.741+0000 7f8cc77fe700 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc8196b0 0x55b3fc9da5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.742+0000 7f8cc6ffd700 1 -- 172.21.15.17:0/3270178203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 msgr2=0x55b3fc9d7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:47.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.742+0000 7f8cc6ffd700 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 0x55b3fc9d7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.742+0000 7f8cc6ffd700 1 -- 172.21.15.17:0/3270178203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc8196b0 msgr2=0x55b3fc9da5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:47.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.742+0000 7f8cc6ffd700 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc8196b0 0x55b3fc9da5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.742+0000 7f8cc6ffd700 1 -- 172.21.15.17:0/3270178203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc000b930 con 0x55b3fc9d42a0 2023-07-14T13:18:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.742+0000 7f8cc6ffd700 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d77e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0cb450 tx=0x7f8cbc017b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffce0e9a630d20b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:47.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.743+0000 7f8ca6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.744+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/3270178203 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc09ee90 con 0x55b3fc9d42a0 2023-07-14T13:18:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.744+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/3270178203 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8cbc0a3220 con 0x55b3fc9d42a0 2023-07-14T13:18:47.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.744+0000 7f8ce1931b80 1 -- 172.21.15.17:0/3270178203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b3fc868490 con 0x55b3fc9d42a0 2023-07-14T13:18:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.744+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/3270178203 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cbc09a350 con 0x55b3fc9d42a0 2023-07-14T13:18:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.744+0000 7f8ce1931b80 10 client.18813 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.744+0000 7f8ce1931b80 1 -- 172.21.15.17:0/3270178203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55b3fc725c00 con 0x55b3fc9d42a0 2023-07-14T13:18:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.745+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/3270178203 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b3fc868490 con 0x55b3fc9d42a0 2023-07-14T13:18:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.745+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/3270178203 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8cbc0cbba0 con 0x55b3fc9d42a0 2023-07-14T13:18:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.746+0000 7f8ce1931b80 10 client.18813 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:47.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.746+0000 7f8ce1931b80 10 client.18813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:47.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.746+0000 7f8ce1931b80 20 client.18813 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:47.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.746+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3fc9e7880 0x55b3fc9e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.746+0000 7f8ce1931b80 4 client.18813 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:47.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.746+0000 7f8ce1931b80 1 -- 172.21.15.17:0/3270178203 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b3fc907e50 con 0x55b3fc9e7880 2023-07-14T13:18:47.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.746+0000 7f8cc77fe700 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3fc9e7880 0x55b3fc9e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.747+0000 7f8cc77fe700 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3fc9e7880 0x55b3fc9e9c90 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=495b4f2d6dea7d7f server_cookie=8f011285e2cc4af7 in_seq=0 out_seq=0 2023-07-14T13:18:47.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.747+0000 7f8ca6ffd700 10 client.18813 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:47.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.748+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/3270178203 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b3fc907e50 con 0x55b3fc9e7880 2023-07-14T13:18:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.748+0000 7f8ca6ffd700 10 client.18813 handle_command_reply: tid=0 2023-07-14T13:18:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.748+0000 7f8ce1931b80 1 client.18813 shutdown 2023-07-14T13:18:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.748+0000 7f8ce1931b80 1 -- 172.21.15.17:0/3270178203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 msgr2=0x55b3fc9d77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.748+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d77e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0cb450 tx=0x7f8cbc017b20 comp rx=0 tx=0).stop 2023-07-14T13:18:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.749+0000 7f8ce1931b80 1 -- 172.21.15.17:0/3270178203 shutdown_connections 2023-07-14T13:18:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.749+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3fc9e7880 0x55b3fc9e9c90 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.749+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 0x55b3fc9d7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.749+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc8196b0 0x55b3fc9da5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.749+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/3270178203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d77e0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.749+0000 7f8ce1931b80 1 -- 172.21.15.17:0/3270178203 >> 172.21.15.17:0/3270178203 conn(0x55b3fc9b2be0 msgr2=0x55b3fc9b74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.749+0000 7f8ca6ffd700 0 client.18813 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.749+0000 7f8ce1931b80 1 -- 172.21.15.17:0/3270178203 shutdown_connections 2023-07-14T13:18:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.749+0000 7f8ce1931b80 1 -- 172.21.15.17:0/3270178203 wait complete. 2023-07-14T13:18:47.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.750+0000 7f8ce1931b80 20 client.18813 trim_cache size 0 max 16384 2023-07-14T13:18:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.779+0000 7f8ce1931b80 1 Processor -- start 2023-07-14T13:18:47.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.779+0000 7f8ce1931b80 1 -- start start 2023-07-14T13:18:47.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.779+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9ded50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.779+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.779+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc9d4710 0x55b3fc9b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.779+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc983060 con 0x55b3fc8196b0 2023-07-14T13:18:47.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.779+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc9cf1f0 con 0x55b3fc9d4710 2023-07-14T13:18:47.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.779+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc9ce3e0 con 0x55b3fc9d42a0 2023-07-14T13:18:47.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.780+0000 7f8cc77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9ded50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.780+0000 7f8cc77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9ded50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42820/0 (socket says 172.21.15.17:42820) 2023-07-14T13:18:47.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.780+0000 7f8cc77fe700 1 -- 172.21.15.17:0/861852260 learned_addr learned my addr 172.21.15.17:0/861852260 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:47.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.780+0000 7f8cc6ffd700 1 --2- 172.21.15.17:0/861852260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.780+0000 7f8cc77fe700 1 -- 172.21.15.17:0/861852260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d42a0 msgr2=0x55b3fc9d6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:47.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.780+0000 7f8cc77fe700 1 --2- 172.21.15.17:0/861852260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.817 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.780+0000 7f8cc77fe700 1 -- 172.21.15.17:0/861852260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc9d4710 msgr2=0x55b3fc9b7c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:18:47.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.780+0000 7f8cc77fe700 1 --2- 172.21.15.17:0/861852260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc9d4710 0x55b3fc9b7c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.780+0000 7f8cc77fe700 1 -- 172.21.15.17:0/861852260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3fc7631f0 con 0x55b3fc8196b0 2023-07-14T13:18:47.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.781+0000 7f8cc77fe700 1 --2- 172.21.15.17:0/861852260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9ded50 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8009690 tx=0x7f8cb800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf1371136eb641e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:47.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.782+0000 7f8cae7fc700 1 -- 172.21.15.17:0/861852260 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8007ea0 con 0x55b3fc8196b0 2023-07-14T13:18:47.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.782+0000 7f8cae7fc700 1 -- 172.21.15.17:0/861852260 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cb800f040 con 0x55b3fc8196b0 2023-07-14T13:18:47.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.782+0000 7f8cae7fc700 1 -- 172.21.15.17:0/861852260 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8004770 con 0x55b3fc8196b0 2023-07-14T13:18:47.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.783+0000 7f8ce1931b80 1 -- 172.21.15.17:0/861852260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 msgr2=0x55b3fc9ded50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:47.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.783+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/861852260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9ded50 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8009690 tx=0x7f8cb800b040 comp rx=0 tx=0).stop 2023-07-14T13:18:47.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.783+0000 7f8ce1931b80 1 -- 172.21.15.17:0/861852260 shutdown_connections 2023-07-14T13:18:47.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.783+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/861852260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc9d4710 0x55b3fc9b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.783+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/861852260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc8196b0 0x55b3fc9ded50 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.783+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/861852260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.783+0000 7f8ce1931b80 1 -- 172.21.15.17:0/861852260 >> 172.21.15.17:0/861852260 conn(0x55b3fc9b2be0 msgr2=0x55b3fc9e9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:47.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.783+0000 7f8ce1931b80 1 -- 172.21.15.17:0/861852260 shutdown_connections 2023-07-14T13:18:47.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.784+0000 7f8ce1931b80 1 -- 172.21.15.17:0/861852260 wait complete. 2023-07-14T13:18:47.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.784+0000 7f8ce1931b80 1 -- start start 2023-07-14T13:18:47.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.785+0000 7f8ce1931b80 1 Processor -- start 2023-07-14T13:18:47.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.785+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc8196b0 0x55b3fc9d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.785+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.785+0000 7f8ce1931b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 0x55b3fc9cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.785+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc9cfd00 con 0x55b3fc9d42a0 2023-07-14T13:18:47.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.785+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc9cfe70 con 0x55b3fc8196b0 2023-07-14T13:18:47.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.785+0000 7f8ce1931b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3fc9d0030 con 0x55b3fc9d4710 2023-07-14T13:18:47.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.786+0000 7f8ce1931b80 10 client.0 _ll_register_callbacks cb 0x55b3fc8ac700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:47.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.786+0000 7f8cc6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.786+0000 7f8cc6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42832/0 (socket says 172.21.15.17:42832) 2023-07-14T13:18:47.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.786+0000 7f8cc6ffd700 1 -- 172.21.15.17:0/146427493 learned_addr learned my addr 172.21.15.17:0/146427493 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.787+0000 7f8cc77fe700 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc8196b0 0x55b3fc9d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.787+0000 7f8cc6ffd700 1 -- 172.21.15.17:0/146427493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 msgr2=0x55b3fc9cf7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:18:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.787+0000 7f8cc6ffd700 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 0x55b3fc9cf7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.787+0000 7f8cc6ffd700 1 -- 172.21.15.17:0/146427493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc8196b0 msgr2=0x55b3fc9d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.787+0000 7f8cc6ffd700 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc8196b0 0x55b3fc9d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.787+0000 7f8cc6ffd700 1 -- 172.21.15.17:0/146427493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb80093f0 con 0x55b3fc9d42a0 2023-07-14T13:18:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.787+0000 7f8cc6ffd700 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d1050 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc005910 tx=0x7f8cbc005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21327315e979ea10 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.787+0000 7f8ca6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.787+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/146427493 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc09a550 con 0x55b3fc9d42a0 2023-07-14T13:18:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.788+0000 7f8ce1931b80 1 -- 172.21.15.17:0/146427493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8cc0016070 con 0x55b3fc9d42a0 2023-07-14T13:18:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.788+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/146427493 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8cbc0a3220 con 0x55b3fc9d42a0 2023-07-14T13:18:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.788+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/146427493 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cbc0cb2f0 con 0x55b3fc9d42a0 2023-07-14T13:18:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.788+0000 7f8ce1931b80 10 client.18819 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.788+0000 7f8ce1931b80 1 -- 172.21.15.17:0/146427493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55b3fc73b250 con 0x55b3fc9d42a0 2023-07-14T13:18:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.788+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/146427493 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cc0016070 con 0x55b3fc9d42a0 2023-07-14T13:18:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.789+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/146427493 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8cbc0aead0 con 0x55b3fc9d42a0 2023-07-14T13:18:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.789+0000 7f8ce1931b80 10 client.18819 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.789+0000 7f8ce1931b80 10 client.18819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.789+0000 7f8ce1931b80 20 client.18819 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.789+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3fca3c180 0x55b3fca3e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.789+0000 7f8ce1931b80 4 client.18819 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:18:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.789+0000 7f8ce1931b80 1 -- 172.21.15.17:0/146427493 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b3fc8c9ff0 con 0x55b3fca3c180 2023-07-14T13:18:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.789+0000 7f8cc77fe700 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3fca3c180 0x55b3fca3e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.790+0000 7f8cc77fe700 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3fca3c180 0x55b3fca3e560 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46f21fa6e830eaa5 server_cookie=2cb59b185add0fbe in_seq=0 out_seq=0 2023-07-14T13:18:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:47.790+0000 7f8ca6ffd700 10 client.18819 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:48.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.953+0000 7f8ca6ffd700 1 -- 172.21.15.17:0/146427493 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b3fc8c9ff0 con 0x55b3fca3c180 2023-07-14T13:18:48.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.953+0000 7f8ca6ffd700 10 client.18819 handle_command_reply: tid=0 2023-07-14T13:18:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.953+0000 7f8ce1931b80 1 client.18819 shutdown 2023-07-14T13:18:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.954+0000 7f8ce1931b80 1 -- 172.21.15.17:0/146427493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 msgr2=0x55b3fc9d1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.954+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d1050 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc005910 tx=0x7f8cbc005c70 comp rx=0 tx=0).stop 2023-07-14T13:18:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.955+0000 7f8ce1931b80 1 -- 172.21.15.17:0/146427493 shutdown_connections 2023-07-14T13:18:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.955+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b3fca3c180 0x55b3fca3e560 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.955+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3fc9d4710 0x55b3fc9cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.955+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b3fc8196b0 0x55b3fc9d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.955+0000 7f8ce1931b80 1 --2- 172.21.15.17:0/146427493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b3fc9d42a0 0x55b3fc9d1050 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.955+0000 7f8ce1931b80 1 -- 172.21.15.17:0/146427493 >> 172.21.15.17:0/146427493 conn(0x55b3fc9b2be0 msgr2=0x55b3fc9d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.955+0000 7f8ca6ffd700 0 client.18819 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.955+0000 7f8ce1931b80 1 -- 172.21.15.17:0/146427493 shutdown_connections 2023-07-14T13:18:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.955+0000 7f8ce1931b80 1 -- 172.21.15.17:0/146427493 wait complete. 2023-07-14T13:18:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.956+0000 7f8ce1931b80 20 client.18819 trim_cache size 0 max 16384 2023-07-14T13:18:48.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:18:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:18:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:18:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:18:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.957+0000 7f8ccdfff700 1 -- 172.21.15.17:0/3616171419 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb00a1400 msgr2=0x7f8cb00a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:48.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.957+0000 7f8ccdfff700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb00a1400 0x7f8cb00a38b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000ffd0 tx=0x7f8cc001b000 comp rx=0 tx=0).stop 2023-07-14T13:18:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.957+0000 7f8ccdfff700 1 -- 172.21.15.17:0/3616171419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81024f0 msgr2=0x7f8cc8071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.957+0000 7f8ccdfff700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81024f0 0x7f8cc8071fa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0098e0 tx=0x7f8cbc005740 comp rx=0 tx=0).stop 2023-07-14T13:18:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.958+0000 7f8ccdfff700 1 -- 172.21.15.17:0/3616171419 shutdown_connections 2023-07-14T13:18:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.958+0000 7f8ccdfff700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8cb00a1400 0x7f8cb00a38b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.958+0000 7f8ccdfff700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cc8104a60 0x7f8cc806a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.958+0000 7f8ccdfff700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cc8067ee0 0x7f8cc8071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:48.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.958+0000 7f8ccdfff700 1 --2- 172.21.15.17:0/3616171419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cc81024f0 0x7f8cc8071fa0 secure :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc0098e0 tx=0x7f8cbc005740 comp rx=0 tx=0).stop 2023-07-14T13:18:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.958+0000 7f8ccdfff700 1 -- 172.21.15.17:0/3616171419 >> 172.21.15.17:0/3616171419 conn(0x7f8cc8074760 msgr2=0x7f8cc81014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.958+0000 7f8ccdfff700 1 -- 172.21.15.17:0/3616171419 shutdown_connections 2023-07-14T13:18:48.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:18:48.958+0000 7f8ccdfff700 1 -- 172.21.15.17:0/3616171419 wait complete. 2023-07-14T13:18:49.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:49 smithi017 ceph-mon[95536]: pgmap v601: 97 pgs: 97 active+clean; 16 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 19 MiB/s wr, 1.24k op/s 2023-07-14T13:18:49.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:49 smithi135 ceph-mon[97338]: pgmap v601: 97 pgs: 97 active+clean; 16 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 19 MiB/s wr, 1.24k op/s 2023-07-14T13:18:49.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:49 smithi131 ceph-mon[96953]: pgmap v601: 97 pgs: 97 active+clean; 16 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 19 MiB/s wr, 1.24k op/s 2023-07-14T13:18:50.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:50 smithi017 ceph-mon[95536]: pgmap v602: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 28 MiB/s wr, 1.89k op/s 2023-07-14T13:18:50.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:50 smithi135 ceph-mon[97338]: pgmap v602: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 28 MiB/s wr, 1.89k op/s 2023-07-14T13:18:50.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:50 smithi131 ceph-mon[96953]: pgmap v602: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 28 MiB/s wr, 1.89k op/s 2023-07-14T13:18:52.453 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 40.0 s, 659.2 tps, lat 151.290 ms stddev 52.407 2023-07-14T13:18:53.614 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:53 smithi017 ceph-mon[95536]: pgmap v603: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2023-07-14T13:18:53.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:53 smithi135 ceph-mon[97338]: pgmap v603: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2023-07-14T13:18:53.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:53 smithi131 ceph-mon[96953]: pgmap v603: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2023-07-14T13:18:54.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:18:54.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.830+0000 7f2ce03ff700 1 -- 172.21.15.17:0/3094551948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd8110ae0 msgr2=0x7f2cd8112ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:54.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.830+0000 7f2ce03ff700 1 --2- 172.21.15.17:0/3094551948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd8110ae0 0x7f2cd8112ec0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000b0a0 tx=0x7f2cd000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.830+0000 7f2ce03ff700 1 -- 172.21.15.17:0/3094551948 shutdown_connections 2023-07-14T13:18:54.865 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.830+0000 7f2ce03ff700 1 --2- 172.21.15.17:0/3094551948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd8110ae0 0x7f2cd8112ec0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.830+0000 7f2ce03ff700 1 --2- 172.21.15.17:0/3094551948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cd80728b0 0x7f2cd8072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.830+0000 7f2ce03ff700 1 --2- 172.21.15.17:0/3094551948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd80731c0 0x7f2cd81105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.830+0000 7f2ce03ff700 1 -- 172.21.15.17:0/3094551948 >> 172.21.15.17:0/3094551948 conn(0x7f2cd80fb5f0 msgr2=0x7f2cd80fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:54.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.831+0000 7f2ce03ff700 1 -- 172.21.15.17:0/3094551948 shutdown_connections 2023-07-14T13:18:54.866 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.831+0000 7f2ce03ff700 1 -- 172.21.15.17:0/3094551948 wait complete. 2023-07-14T13:18:54.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.832+0000 7f2ce03ff700 1 Processor -- start 2023-07-14T13:18:54.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.832+0000 7f2ce03ff700 1 -- start start 2023-07-14T13:18:54.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.833+0000 7f2ce03ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd80728b0 0x7f2cd819c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.833+0000 7f2ce03ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cd80731c0 0x7f2cd819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.833+0000 7f2ce03ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd8110ae0 0x7f2cd81a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.833+0000 7f2ce03ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81a1240 con 0x7f2cd8110ae0 2023-07-14T13:18:54.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.833+0000 7f2ce03ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81a13b0 con 0x7f2cd80731c0 2023-07-14T13:18:54.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.833+0000 7f2ce03ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81a1570 con 0x7f2cd80728b0 2023-07-14T13:18:54.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.833+0000 7f2cde99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd8110ae0 0x7f2cd81a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.833+0000 7f2cde99c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd8110ae0 0x7f2cd81a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42848/0 (socket says 172.21.15.17:42848) 2023-07-14T13:18:54.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.833+0000 7f2cde99c700 1 -- 172.21.15.17:0/968497399 learned_addr learned my addr 172.21.15.17:0/968497399 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:54.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.833+0000 7f2cdd99a700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cd80731c0 0x7f2cd819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.833+0000 7f2cde19b700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd80728b0 0x7f2cd819c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.834+0000 7f2cde99c700 1 -- 172.21.15.17:0/968497399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd80728b0 msgr2=0x7f2cd819c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:54.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.834+0000 7f2cde99c700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd80728b0 0x7f2cd819c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.834+0000 7f2cde99c700 1 -- 172.21.15.17:0/968497399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cd80731c0 msgr2=0x7f2cd819c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:54.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.834+0000 7f2cde99c700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cd80731c0 0x7f2cd819c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.834+0000 7f2cde99c700 1 -- 172.21.15.17:0/968497399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0009d00 con 0x7f2cd8110ae0 2023-07-14T13:18:54.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.834+0000 7f2cdd99a700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cd80731c0 0x7f2cd819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:18:54.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.834+0000 7f2cde99c700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd8110ae0 0x7f2cd81a0c00 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000d010 tx=0x7f2cd000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:54.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.835+0000 7f2ccf7fe700 1 -- 172.21.15.17:0/968497399 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd000e040 con 0x7f2cd8110ae0 2023-07-14T13:18:54.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.835+0000 7f2ce03ff700 1 -- 172.21.15.17:0/968497399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd81a17f0 con 0x7f2cd8110ae0 2023-07-14T13:18:54.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.835+0000 7f2ccf7fe700 1 -- 172.21.15.17:0/968497399 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2cd0009480 con 0x7f2cd8110ae0 2023-07-14T13:18:54.871 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.835+0000 7f2ccf7fe700 1 -- 172.21.15.17:0/968497399 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0005040 con 0x7f2cd8110ae0 2023-07-14T13:18:54.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.835+0000 7f2ce03ff700 1 -- 172.21.15.17:0/968497399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd81a9090 con 0x7f2cd8110ae0 2023-07-14T13:18:54.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.840+0000 7f2ccf7fe700 1 -- 172.21.15.17:0/968497399 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2cd001d480 con 0x7f2cd8110ae0 2023-07-14T13:18:54.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.841+0000 7f2cf3de6b80 1 Processor -- start 2023-07-14T13:18:54.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.841+0000 7f2cf3de6b80 1 -- start start 2023-07-14T13:18:54.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.841+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc22d0 0x561926dc26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.841+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc2be0 0x561926dcd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.841+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dcfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.841+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926cc8cb0 con 0x561926dcdad0 2023-07-14T13:18:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.841+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926d1ba40 con 0x561926dc22d0 2023-07-14T13:18:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.841+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926d14ed0 con 0x561926dc2be0 2023-07-14T13:18:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.841+0000 7f2ccf7fe700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2cc40a12c0 0x7f2cc40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cdd99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dcfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cde19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc2be0 0x561926dcd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cde19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc2be0 0x561926dcd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35790/0 (socket says 172.21.15.17:35790) 2023-07-14T13:18:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cde19b700 1 -- 172.21.15.17:0/2830091712 learned_addr learned my addr 172.21.15.17:0/2830091712 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2ccf7fe700 1 -- 172.21.15.17:0/968497399 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2cd00cdf40 con 0x7f2cd8110ae0 2023-07-14T13:18:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cdd99a700 1 --2- 172.21.15.17:0/2830091712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc22d0 0x561926dc26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cde99c700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2cc40a12c0 0x7f2cc40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cde19b700 1 -- 172.21.15.17:0/2830091712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc22d0 msgr2=0x561926dc26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:54.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cde19b700 1 --2- 172.21.15.17:0/2830091712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc22d0 0x561926dc26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cde19b700 1 -- 172.21.15.17:0/2830091712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 msgr2=0x561926dcfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cde19b700 1 --2- 172.21.15.17:0/2830091712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dcfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cde19b700 1 -- 172.21.15.17:0/2830091712 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561926b42de0 con 0x561926dc2be0 2023-07-14T13:18:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.842+0000 7f2cdd99a700 1 --2- 172.21.15.17:0/2830091712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dcfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:18:54.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.843+0000 7f2cde19b700 1 --2- 172.21.15.17:0/2830091712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc2be0 0x561926dcd590 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009d80 tx=0x7f2cd4011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98ec92b243762781 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:54.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.843+0000 7f2cde99c700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2cc40a12c0 0x7f2cc40a3770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009670 tx=0x7f2cd00099e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:54.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.843+0000 7f2cccbfe700 1 -- 172.21.15.17:0/2830091712 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4004230 con 0x561926dc2be0 2023-07-14T13:18:54.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.843+0000 7f2cccbfe700 1 -- 172.21.15.17:0/2830091712 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2cd4004390 con 0x561926dc2be0 2023-07-14T13:18:54.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.843+0000 7f2cccbfe700 1 -- 172.21.15.17:0/2830091712 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4019750 con 0x561926dc2be0 2023-07-14T13:18:54.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.844+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/2830091712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc2be0 msgr2=0x561926dcd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:54.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.844+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/2830091712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc2be0 0x561926dcd590 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009d80 tx=0x7f2cd4011720 comp rx=0 tx=0).stop 2023-07-14T13:18:54.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.844+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/2830091712 shutdown_connections 2023-07-14T13:18:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.844+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/2830091712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dcfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.844+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/2830091712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc22d0 0x561926dc26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.844+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/2830091712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc2be0 0x561926dcd590 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.844+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/2830091712 >> 172.21.15.17:0/2830091712 conn(0x561926db8da0 msgr2=0x561926dbe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.844+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/2830091712 shutdown_connections 2023-07-14T13:18:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.844+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/2830091712 wait complete. 2023-07-14T13:18:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.844+0000 7f2cf3de6b80 1 -- start start 2023-07-14T13:18:54.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.845+0000 7f2cf3de6b80 1 Processor -- start 2023-07-14T13:18:54.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.845+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc22d0 0x561926dcd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.845+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.845+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dcae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.845+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926cb4ac0 con 0x561926dcdad0 2023-07-14T13:18:54.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.845+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926cb47c0 con 0x561926dc2be0 2023-07-14T13:18:54.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.845+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926b98920 con 0x561926dc22d0 2023-07-14T13:18:54.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.845+0000 7f2cf3de6b80 10 client.0 _ll_register_callbacks cb 0x561926cb2760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:54.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.845+0000 7f2cdd99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dcae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.845+0000 7f2cdd99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dcae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42872/0 (socket says 172.21.15.17:42872) 2023-07-14T13:18:54.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.845+0000 7f2cdd99a700 1 -- 172.21.15.17:0/1236080082 learned_addr learned my addr 172.21.15.17:0/1236080082 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:54.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cdd99a700 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc22d0 0x561926dcd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cde19b700 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cdd99a700 1 -- 172.21.15.17:0/1236080082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc22d0 msgr2=0x561926dcd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:54.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cdd99a700 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc22d0 0x561926dcd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cdd99a700 1 -- 172.21.15.17:0/1236080082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 msgr2=0x561926dca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:54.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cdd99a700 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cdd99a700 1 -- 172.21.15.17:0/1236080082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc801b040 con 0x561926dcdad0 2023-07-14T13:18:54.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cde19b700 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:18:54.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cdd99a700 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dcae40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8013fd0 tx=0x7f2cc8013730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2a55654df3122a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:54.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cc1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:54.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/1236080082 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8011eb0 con 0x561926dcdad0 2023-07-14T13:18:54.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/1236080082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561926c6e4f0 con 0x561926dcdad0 2023-07-14T13:18:54.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.846+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/1236080082 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2cc8004040 con 0x561926dcdad0 2023-07-14T13:18:54.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.847+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/1236080082 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cc8004200 con 0x561926dcdad0 2023-07-14T13:18:54.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.847+0000 7f2cf3de6b80 10 client.18831 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:54.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.847+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/1236080082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x7f2cd40099e0 con 0x561926dcdad0 2023-07-14T13:18:54.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.847+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/1236080082 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561926c6e4f0 con 0x561926dcdad0 2023-07-14T13:18:54.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.847+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/1236080082 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2cc80050b0 con 0x561926dcdad0 2023-07-14T13:18:54.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.847+0000 7f2cf3de6b80 10 client.18831 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:54.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.847+0000 7f2cf3de6b80 10 client.18831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:54.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.847+0000 7f2cf3de6b80 20 client.18831 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:54.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.847+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561926ddd460 0x561926ddf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.847+0000 7f2cf3de6b80 4 client.18831 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:54.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.847+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/1236080082 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561926d0deb0 con 0x561926ddd460 2023-07-14T13:18:54.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.848+0000 7f2cde19b700 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561926ddd460 0x561926ddf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.848+0000 7f2cde19b700 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561926ddd460 0x561926ddf870 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27818abfb572c5ad server_cookie=3b2876f2ce917b39 in_seq=0 out_seq=0 2023-07-14T13:18:54.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.848+0000 7f2cc1ffb700 10 client.18831 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:54.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.849+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/1236080082 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561926d0deb0 con 0x561926ddd460 2023-07-14T13:18:54.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.849+0000 7f2cc1ffb700 10 client.18831 handle_command_reply: tid=0 2023-07-14T13:18:54.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.849+0000 7f2cf3de6b80 1 client.18831 shutdown 2023-07-14T13:18:54.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.849+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/1236080082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 msgr2=0x561926dcae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:54.890 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.849+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dcae40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8013fd0 tx=0x7f2cc8013730 comp rx=0 tx=0).stop 2023-07-14T13:18:54.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.850+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/1236080082 shutdown_connections 2023-07-14T13:18:54.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.850+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561926ddd460 0x561926ddf870 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.850+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dcae40 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.850+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc22d0 0x561926dcd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.850+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/1236080082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.850+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/1236080082 >> 172.21.15.17:0/1236080082 conn(0x561926db8da0 msgr2=0x561926dbe230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:54.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.850+0000 7f2cc1ffb700 0 client.18831 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:54.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.850+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/1236080082 shutdown_connections 2023-07-14T13:18:54.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.850+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/1236080082 wait complete. 2023-07-14T13:18:54.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.850+0000 7f2cf3de6b80 20 client.18831 trim_cache size 0 max 16384 2023-07-14T13:18:54.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cf3de6b80 1 Processor -- start 2023-07-14T13:18:54.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cf3de6b80 1 -- start start 2023-07-14T13:18:54.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dc22d0 0x561926dcd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dc79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dcdad0 0x561926dc7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926dc3570 con 0x561926dc22d0 2023-07-14T13:18:54.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926dcb440 con 0x561926dc2be0 2023-07-14T13:18:54.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926db5ef0 con 0x561926dcdad0 2023-07-14T13:18:54.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cdd99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dc22d0 0x561926dcd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cde19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dc79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cdd99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dc22d0 0x561926dcd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35458/0 (socket says 172.21.15.17:35458) 2023-07-14T13:18:54.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.868+0000 7f2cdd99a700 1 -- 172.21.15.17:0/2329678654 learned_addr learned my addr 172.21.15.17:0/2329678654 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:54.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.869+0000 7f2cde19b700 1 -- 172.21.15.17:0/2329678654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dcdad0 msgr2=0x561926dc7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:54.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.869+0000 7f2cde19b700 1 --2- 172.21.15.17:0/2329678654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dcdad0 0x561926dc7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.869+0000 7f2cde19b700 1 -- 172.21.15.17:0/2329678654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dc22d0 msgr2=0x561926dcd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:54.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.869+0000 7f2cde19b700 1 --2- 172.21.15.17:0/2329678654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dc22d0 0x561926dcd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.869+0000 7f2cde19b700 1 -- 172.21.15.17:0/2329678654 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561926b2bc60 con 0x561926dc2be0 2023-07-14T13:18:54.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.869+0000 7f2cde19b700 1 --2- 172.21.15.17:0/2329678654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dc79c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x561926dcbe00 tx=0x7f2cd4011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c485c750c3ad28d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.869+0000 7f2ccd3ff700 1 -- 172.21.15.17:0/2329678654 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4029040 con 0x561926dc2be0 2023-07-14T13:18:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.869+0000 7f2ccd3ff700 1 -- 172.21.15.17:0/2329678654 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2cd4005c40 con 0x561926dc2be0 2023-07-14T13:18:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.869+0000 7f2ccd3ff700 1 -- 172.21.15.17:0/2329678654 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40038e0 con 0x561926dc2be0 2023-07-14T13:18:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.870+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/2329678654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 msgr2=0x561926dc79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.870+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/2329678654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dc79c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x561926dcbe00 tx=0x7f2cd4011720 comp rx=0 tx=0).stop 2023-07-14T13:18:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.870+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/2329678654 shutdown_connections 2023-07-14T13:18:54.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.870+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/2329678654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dcdad0 0x561926dc7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.870+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/2329678654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dc22d0 0x561926dcd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.870+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/2329678654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dc79c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.870+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/2329678654 >> 172.21.15.17:0/2329678654 conn(0x561926db8da0 msgr2=0x561926dc5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:54.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.870+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/2329678654 shutdown_connections 2023-07-14T13:18:54.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.870+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/2329678654 wait complete. 2023-07-14T13:18:54.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.870+0000 7f2cf3de6b80 1 -- start start 2023-07-14T13:18:54.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.871+0000 7f2cf3de6b80 1 Processor -- start 2023-07-14T13:18:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.871+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc22d0 0x561926dd3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.871+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dd4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.871+0000 7f2cf3de6b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dd23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.871+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926dd2990 con 0x561926dcdad0 2023-07-14T13:18:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.871+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926dd2b00 con 0x561926dc2be0 2023-07-14T13:18:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.871+0000 7f2cf3de6b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561926dd2cc0 con 0x561926dc22d0 2023-07-14T13:18:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.871+0000 7f2cf3de6b80 10 client.0 _ll_register_callbacks cb 0x7f2cc8013e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:54.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.871+0000 7f2cdd99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dd23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.871+0000 7f2cde19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dd4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.872+0000 7f2cde19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dd4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60904/0 (socket says 172.21.15.17:60904) 2023-07-14T13:18:54.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.872+0000 7f2cdd99a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dd23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35460/0 (socket says 172.21.15.17:35460) 2023-07-14T13:18:54.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.872+0000 7f2cde19b700 1 -- 172.21.15.17:0/3602026033 learned_addr learned my addr 172.21.15.17:0/3602026033 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:54.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.872+0000 7f2cdd99a700 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc22d0 0x561926dd3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.872+0000 7f2cde19b700 1 -- 172.21.15.17:0/3602026033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc22d0 msgr2=0x561926dd3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:54.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.872+0000 7f2cde19b700 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc22d0 0x561926dd3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.872+0000 7f2cde19b700 1 -- 172.21.15.17:0/3602026033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 msgr2=0x561926dd23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:54.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.872+0000 7f2cde19b700 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dd23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.872+0000 7f2cde19b700 1 -- 172.21.15.17:0/3602026033 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561926b42de0 con 0x561926dc2be0 2023-07-14T13:18:54.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.872+0000 7f2cde19b700 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dd4440 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2cd402a750 tx=0x7f2cd402a350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9a0f25fc4909f79 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:54.911 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.872+0000 7f2cc1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:18:54.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.873+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/3602026033 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4029040 con 0x561926dc2be0 2023-07-14T13:18:54.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.873+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/3602026033 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cd4004390 con 0x561926dc2be0 2023-07-14T13:18:54.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.873+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/3602026033 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2cd4003a90 con 0x561926dc2be0 2023-07-14T13:18:54.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.873+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/3602026033 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cd4003c50 con 0x561926dc2be0 2023-07-14T13:18:54.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.873+0000 7f2cf3de6b80 10 client.28559 fetch_fsmap learned FSMap version 49 2023-07-14T13:18:54.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.873+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/3602026033 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x561926b69250 con 0x561926dc2be0 2023-07-14T13:18:54.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.874+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/3602026033 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2cd4004390 con 0x561926dc2be0 2023-07-14T13:18:54.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.874+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/3602026033 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 49) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2cd4011440 con 0x561926dc2be0 2023-07-14T13:18:54.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.874+0000 7f2cf3de6b80 10 client.28559 fetch_fsmap finished waiting for FSMap version 49 2023-07-14T13:18:54.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.874+0000 7f2cf3de6b80 10 client.28559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:54.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.874+0000 7f2cf3de6b80 20 client.28559 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:54.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.874+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561926e321b0 0x561926e345c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:54.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.874+0000 7f2cf3de6b80 4 client.28559 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:18:54.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.874+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/3602026033 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561926cd0050 con 0x561926e321b0 2023-07-14T13:18:54.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.874+0000 7f2cdd99a700 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561926e321b0 0x561926e345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:54.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cdd99a700 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561926e321b0 0x561926e345c0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=227f35a0113706ef server_cookie=4a5801c58659e672 in_seq=0 out_seq=0 2023-07-14T13:18:54.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cc1ffb700 10 client.28559 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:54.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cc1ffb700 1 -- 172.21.15.17:0/3602026033 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561926cd0050 con 0x561926e321b0 2023-07-14T13:18:54.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cc1ffb700 10 client.28559 handle_command_reply: tid=0 2023-07-14T13:18:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 1 client.28559 shutdown 2023-07-14T13:18:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/3602026033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 msgr2=0x561926dd4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dd4440 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2cd402a750 tx=0x7f2cd402a350 comp rx=0 tx=0).stop 2023-07-14T13:18:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/3602026033 shutdown_connections 2023-07-14T13:18:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561926e321b0 0x561926e345c0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561926dcdad0 0x561926dd23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561926dc22d0 0x561926dd3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 1 --2- 172.21.15.17:0/3602026033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561926dc2be0 0x561926dd4440 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cc1ffb700 0 client.28559 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:54.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/3602026033 >> 172.21.15.17:0/3602026033 conn(0x561926db8da0 msgr2=0x561926dc43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:54.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/3602026033 shutdown_connections 2023-07-14T13:18:54.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 1 -- 172.21.15.17:0/3602026033 wait complete. 2023-07-14T13:18:54.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.875+0000 7f2cf3de6b80 20 client.28559 trim_cache size 0 max 16384 2023-07-14T13:18:54.918 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:18:54.918 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:18:54.918 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:18:54.918 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:18:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 -- 172.21.15.17:0/968497399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2cc40a12c0 msgr2=0x7f2cc40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2cc40a12c0 0x7f2cc40a3770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009670 tx=0x7f2cd00099e0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 -- 172.21.15.17:0/968497399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd8110ae0 msgr2=0x7f2cd81a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd8110ae0 0x7f2cd81a0c00 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000d010 tx=0x7f2cd000bce0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 -- 172.21.15.17:0/968497399 shutdown_connections 2023-07-14T13:18:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2cc40a12c0 0x7f2cc40a3770 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2cd8110ae0 0x7f2cd81a0c00 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cd80728b0 0x7f2cd819c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 --2- 172.21.15.17:0/968497399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cd80731c0 0x7f2cd819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:54.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 -- 172.21.15.17:0/968497399 >> 172.21.15.17:0/968497399 conn(0x7f2cd80fb5f0 msgr2=0x7f2cd80fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:54.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 -- 172.21.15.17:0/968497399 shutdown_connections 2023-07-14T13:18:54.920 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:54.876+0000 7f2ce03ff700 1 -- 172.21.15.17:0/968497399 wait complete. 2023-07-14T13:18:54.927 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:18:54.928 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:18:55.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.120+0000 7fb5f79ff700 1 -- 172.21.15.17:0/1125299322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5f00731c0 msgr2=0x7fb5f010bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.120+0000 7fb5f79ff700 1 --2- 172.21.15.17:0/1125299322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5f00731c0 0x7fb5f010bdd0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009990 tx=0x7fb5e0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.120+0000 7fb5f79ff700 1 -- 172.21.15.17:0/1125299322 shutdown_connections 2023-07-14T13:18:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.120+0000 7fb5f79ff700 1 --2- 172.21.15.17:0/1125299322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f010c310 0x7fb5f010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.120+0000 7fb5f79ff700 1 --2- 172.21.15.17:0/1125299322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f00728b0 0x7fb5f0072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.120+0000 7fb5f79ff700 1 --2- 172.21.15.17:0/1125299322 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5f00731c0 0x7fb5f010bdd0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.120+0000 7fb5f79ff700 1 -- 172.21.15.17:0/1125299322 >> 172.21.15.17:0/1125299322 conn(0x7fb5f00fb590 msgr2=0x7fb5f00fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.120+0000 7fb5f79ff700 1 -- 172.21.15.17:0/1125299322 shutdown_connections 2023-07-14T13:18:55.155 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.120+0000 7fb5f79ff700 1 -- 172.21.15.17:0/1125299322 wait complete. 2023-07-14T13:18:55.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.121+0000 7fb5f79ff700 1 Processor -- start 2023-07-14T13:18:55.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.121+0000 7fb5f79ff700 1 -- start start 2023-07-14T13:18:55.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.121+0000 7fb5f79ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5f00728b0 0x7fb5f0197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.121+0000 7fb5f79ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f00731c0 0x7fb5f0198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.121+0000 7fb5f79ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f010c310 0x7fb5f019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.121+0000 7fb5f79ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f019bbc0 con 0x7fb5f00728b0 2023-07-14T13:18:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.121+0000 7fb5f79ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f019bd30 con 0x7fb5f00731c0 2023-07-14T13:18:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.121+0000 7fb5f79ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f019bef0 con 0x7fb5f010c310 2023-07-14T13:18:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f579b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5f00728b0 0x7fb5f0197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f579b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5f00728b0 0x7fb5f0197cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35484/0 (socket says 172.21.15.17:35484) 2023-07-14T13:18:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f579b700 1 -- 172.21.15.17:0/3218748307 learned_addr learned my addr 172.21.15.17:0/3218748307 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f5f9c700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f010c310 0x7fb5f019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f4f9a700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f00731c0 0x7fb5f0198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f579b700 1 -- 172.21.15.17:0/3218748307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f010c310 msgr2=0x7fb5f019b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f579b700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f010c310 0x7fb5f019b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f579b700 1 -- 172.21.15.17:0/3218748307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f00731c0 msgr2=0x7fb5f0198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f579b700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f00731c0 0x7fb5f0198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f579b700 1 -- 172.21.15.17:0/3218748307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e00095f0 con 0x7fb5f00728b0 2023-07-14T13:18:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f4f9a700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f00731c0 0x7fb5f0198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:18:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.122+0000 7fb5f579b700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5f00728b0 0x7fb5f0197cd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00e9a0 tx=0x7fb5ec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.123+0000 7fb5e67fc700 1 -- 172.21.15.17:0/3218748307 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec009790 con 0x7fb5f00728b0 2023-07-14T13:18:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.123+0000 7fb5f79ff700 1 -- 172.21.15.17:0/3218748307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f019c1d0 con 0x7fb5f00728b0 2023-07-14T13:18:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.123+0000 7fb5e67fc700 1 -- 172.21.15.17:0/3218748307 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5ec00cbd0 con 0x7fb5f00728b0 2023-07-14T13:18:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.123+0000 7fb5e67fc700 1 -- 172.21.15.17:0/3218748307 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec018680 con 0x7fb5f00728b0 2023-07-14T13:18:55.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.123+0000 7fb5f79ff700 1 -- 172.21.15.17:0/3218748307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f01a4b30 con 0x7fb5f00728b0 2023-07-14T13:18:55.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.124+0000 7fb5f79ff700 1 -- 172.21.15.17:0/3218748307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f0067300 con 0x7fb5f00728b0 2023-07-14T13:18:55.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.126+0000 7fb5e67fc700 1 -- 172.21.15.17:0/3218748307 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb5ec00cd40 con 0x7fb5f00728b0 2023-07-14T13:18:55.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.127+0000 7fb5e67fc700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5dc0a1300 0x7fb5dc0a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.128+0000 7fb5e67fc700 1 -- 172.21.15.17:0/3218748307 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb5ec014070 con 0x7fb5f00728b0 2023-07-14T13:18:55.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.128+0000 7fb5f4f9a700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5dc0a1300 0x7fb5dc0a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.162 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.128+0000 7fb5f4f9a700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5dc0a1300 0x7fb5dc0a37b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0000c00 tx=0x7fb5e0005fb0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:55.165 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.131+0000 7fb5e67fc700 1 -- 172.21.15.17:0/3218748307 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb5ec051790 con 0x7fb5f00728b0 2023-07-14T13:18:55.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.411+0000 7fb5f79ff700 1 -- 172.21.15.17:0/3218748307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5f0198fe0 con 0x7fb5f00728b0 2023-07-14T13:18:55.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.412+0000 7fb5e67fc700 1 -- 172.21.15.17:0/3218748307 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+10852 (secure 0 0 0) 0x7fb5f0198fe0 con 0x7fb5f00728b0 2023-07-14T13:18:55.446 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:18:55.446 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":50,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:18:55.233282+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:18:55.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 -- 172.21.15.17:0/3218748307 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5dc0a1300 msgr2=0x7fb5dc0a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5dc0a1300 0x7fb5dc0a37b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0000c00 tx=0x7fb5e0005fb0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 -- 172.21.15.17:0/3218748307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5f00728b0 msgr2=0x7fb5f0197cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5f00728b0 0x7fb5f0197cd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00e9a0 tx=0x7fb5ec00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 -- 172.21.15.17:0/3218748307 shutdown_connections 2023-07-14T13:18:55.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5dc0a1300 0x7fb5dc0a37b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5f010c310 0x7fb5f019b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5f00728b0 0x7fb5f0197cd0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 --2- 172.21.15.17:0/3218748307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5f00731c0 0x7fb5f0198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 -- 172.21.15.17:0/3218748307 >> 172.21.15.17:0/3218748307 conn(0x7fb5f00fb590 msgr2=0x7fb5f010e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 -- 172.21.15.17:0/3218748307 shutdown_connections 2023-07-14T13:18:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.414+0000 7fb5f79ff700 1 -- 172.21.15.17:0/3218748307 wait complete. 2023-07-14T13:18:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 50 2023-07-14T13:18:55.468 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:18:55.545 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:55 smithi017 ceph-mon[95536]: pgmap v604: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2023-07-14T13:18:55.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.657+0000 7f1285fff700 1 -- 172.21.15.17:0/2200166454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12800ffad0 msgr2=0x7f12800fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.657+0000 7f1285fff700 1 --2- 172.21.15.17:0/2200166454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12800ffad0 0x7f12800fff40 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1274009990 tx=0x7f1274009ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.657+0000 7f1285fff700 1 -- 172.21.15.17:0/2200166454 shutdown_connections 2023-07-14T13:18:55.692 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.657+0000 7f1285fff700 1 --2- 172.21.15.17:0/2200166454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1280100480 0x7f128010c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.657+0000 7f1285fff700 1 --2- 172.21.15.17:0/2200166454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1280105ae0 0x7f1280105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.657+0000 7f1285fff700 1 --2- 172.21.15.17:0/2200166454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f12800ffad0 0x7f12800fff40 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.657+0000 7f1285fff700 1 -- 172.21.15.17:0/2200166454 >> 172.21.15.17:0/2200166454 conn(0x7f12800fb5f0 msgr2=0x7f12800fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:55.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.658+0000 7f1285fff700 1 -- 172.21.15.17:0/2200166454 shutdown_connections 2023-07-14T13:18:55.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.658+0000 7f1285fff700 1 -- 172.21.15.17:0/2200166454 wait complete. 2023-07-14T13:18:55.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.658+0000 7f1285fff700 1 Processor -- start 2023-07-14T13:18:55.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.659+0000 7f1285fff700 1 -- start start 2023-07-14T13:18:55.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.659+0000 7f1285fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12800ffad0 0x7f128019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.659+0000 7f1285fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1280100480 0x7f128019be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.659+0000 7f1285fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280105ae0 0x7f1280195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.659+0000 7f1285fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280196000 con 0x7f1280105ae0 2023-07-14T13:18:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.659+0000 7f1285fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280196170 con 0x7f12800ffad0 2023-07-14T13:18:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.659+0000 7f1285fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1280196330 con 0x7f1280100480 2023-07-14T13:18:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.659+0000 7f127ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280105ae0 0x7f1280195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.659+0000 7f127ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280105ae0 0x7f1280195990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35502/0 (socket says 172.21.15.17:35502) 2023-07-14T13:18:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.659+0000 7f127ffff700 1 -- 172.21.15.17:0/98172663 learned_addr learned my addr 172.21.15.17:0/98172663 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127f7fe700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12800ffad0 0x7f128019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127effd700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1280100480 0x7f128019be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127ffff700 1 -- 172.21.15.17:0/98172663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1280100480 msgr2=0x7f128019be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127ffff700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1280100480 0x7f128019be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127ffff700 1 -- 172.21.15.17:0/98172663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12800ffad0 msgr2=0x7f128019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127ffff700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12800ffad0 0x7f128019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127ffff700 1 -- 172.21.15.17:0/98172663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12740095f0 con 0x7f1280105ae0 2023-07-14T13:18:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127f7fe700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12800ffad0 0x7f128019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:18:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127ffff700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280105ae0 0x7f1280195990 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f127800ef30 tx=0x7f127800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:55.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127cff9700 1 -- 172.21.15.17:0/98172663 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278018070 con 0x7f1280105ae0 2023-07-14T13:18:55.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f1285fff700 1 -- 172.21.15.17:0/98172663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12801965b0 con 0x7f1280105ae0 2023-07-14T13:18:55.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127cff9700 1 -- 172.21.15.17:0/98172663 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f127800f040 con 0x7f1280105ae0 2023-07-14T13:18:55.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f127cff9700 1 -- 172.21.15.17:0/98172663 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278003ce0 con 0x7f1280105ae0 2023-07-14T13:18:55.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.660+0000 7f1285fff700 1 -- 172.21.15.17:0/98172663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12801a2910 con 0x7f1280105ae0 2023-07-14T13:18:55.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.664+0000 7f127cff9700 1 -- 172.21.15.17:0/98172663 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f127800caa0 con 0x7f1280105ae0 2023-07-14T13:18:55.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.665+0000 7f1299907b80 1 Processor -- start 2023-07-14T13:18:55.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.665+0000 7f1299907b80 1 -- start start 2023-07-14T13:18:55.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.665+0000 7f1299907b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580900f12d0 0x5580900f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.665+0000 7f1299907b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 0x5580901009a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.665+0000 7f1299907b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558090100ee0 0x5580901032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.665+0000 7f1299907b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808fff7cb0 con 0x558090100ee0 2023-07-14T13:18:55.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.665+0000 7f127cff9700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12680a12c0 0x7f12680a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.665+0000 7f1299907b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55809004aa40 con 0x5580900f12d0 2023-07-14T13:18:55.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.665+0000 7f1299907b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558090043ed0 con 0x5580900f1be0 2023-07-14T13:18:55.701 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127cff9700 1 -- 172.21.15.17:0/98172663 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f12780cca60 con 0x7f1280105ae0 2023-07-14T13:18:55.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558090100ee0 0x5580901032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 0x5580901009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127ffff700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12680a12c0 0x7f12680a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.702 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 0x5580901009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51792/0 (socket says 172.21.15.17:51792) 2023-07-14T13:18:55.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127f7fe700 1 -- 172.21.15.17:0/41430560 learned_addr learned my addr 172.21.15.17:0/41430560 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:55.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558090100ee0 0x5580901032c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35512/0 (socket says 172.21.15.17:35512) 2023-07-14T13:18:55.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127effd700 1 --2- 172.21.15.17:0/41430560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580900f12d0 0x5580900f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127f7fe700 1 -- 172.21.15.17:0/41430560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580900f12d0 msgr2=0x5580900f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:55.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127f7fe700 1 --2- 172.21.15.17:0/41430560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580900f12d0 0x5580900f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127f7fe700 1 -- 172.21.15.17:0/41430560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558090100ee0 msgr2=0x5580901032c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:55.703 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127f7fe700 1 --2- 172.21.15.17:0/41430560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558090100ee0 0x5580901032c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127f7fe700 1 -- 172.21.15.17:0/41430560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55808fe71de0 con 0x5580900f1be0 2023-07-14T13:18:55.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127effd700 1 --2- 172.21.15.17:0/41430560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558090100ee0 0x5580901032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:18:55.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.666+0000 7f127ffff700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12680a12c0 0x7f12680a3770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f12780ca1d0 tx=0x7f1278009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:55.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.667+0000 7f127f7fe700 1 --2- 172.21.15.17:0/41430560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 0x5580901009a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1270009dc0 tx=0x7f12700106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6da0de2a8231b07b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:55.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.667+0000 7f1265ffb700 1 -- 172.21.15.17:0/41430560 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270010db0 con 0x5580900f1be0 2023-07-14T13:18:55.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.667+0000 7f1265ffb700 1 -- 172.21.15.17:0/41430560 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1270015070 con 0x5580900f1be0 2023-07-14T13:18:55.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.667+0000 7f1265ffb700 1 -- 172.21.15.17:0/41430560 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12700116a0 con 0x5580900f1be0 2023-07-14T13:18:55.704 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.668+0000 7f1299907b80 1 -- 172.21.15.17:0/41430560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 msgr2=0x5580901009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.668+0000 7f1299907b80 1 --2- 172.21.15.17:0/41430560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 0x5580901009a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1270009dc0 tx=0x7f12700106b0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.668+0000 7f1299907b80 1 -- 172.21.15.17:0/41430560 shutdown_connections 2023-07-14T13:18:55.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.668+0000 7f1299907b80 1 --2- 172.21.15.17:0/41430560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558090100ee0 0x5580901032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.668+0000 7f1299907b80 1 --2- 172.21.15.17:0/41430560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580900f12d0 0x5580900f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.668+0000 7f1299907b80 1 --2- 172.21.15.17:0/41430560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 0x5580901009a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.668+0000 7f1299907b80 1 -- 172.21.15.17:0/41430560 >> 172.21.15.17:0/41430560 conn(0x5580900e7da0 msgr2=0x5580900ed6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:55.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.668+0000 7f1299907b80 1 -- 172.21.15.17:0/41430560 shutdown_connections 2023-07-14T13:18:55.705 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.668+0000 7f1299907b80 1 -- 172.21.15.17:0/41430560 wait complete. 2023-07-14T13:18:55.706 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:55 smithi135 ceph-mon[97338]: pgmap v604: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2023-07-14T13:18:55.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.668+0000 7f1299907b80 1 -- start start 2023-07-14T13:18:55.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.669+0000 7f1299907b80 1 Processor -- start 2023-07-14T13:18:55.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.669+0000 7f1299907b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f12d0 0x558090100920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.669+0000 7f1299907b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 0x5580900fdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.669+0000 7f1299907b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900fe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.669+0000 7f1299907b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808ffe3ac0 con 0x5580900f1be0 2023-07-14T13:18:55.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.669+0000 7f1299907b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808ffe37c0 con 0x558090100ee0 2023-07-14T13:18:55.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.669+0000 7f1299907b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55808fec7920 con 0x5580900f12d0 2023-07-14T13:18:55.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.669+0000 7f1299907b80 10 client.0 _ll_register_callbacks cb 0x55808ffe1760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:55.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 0x5580900fdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 0x5580900fdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35526/0 (socket says 172.21.15.17:35526) 2023-07-14T13:18:55.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127f7fe700 1 -- 172.21.15.17:0/3896934363 learned_addr learned my addr 172.21.15.17:0/3896934363 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:55.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127effd700 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f12d0 0x558090100920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127effd700 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900fe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127f7fe700 1 -- 172.21.15.17:0/3896934363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f12d0 msgr2=0x558090100920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:55.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127f7fe700 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f12d0 0x558090100920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127f7fe700 1 -- 172.21.15.17:0/3896934363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 msgr2=0x5580900fe2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:55.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127f7fe700 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900fe2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127f7fe700 1 -- 172.21.15.17:0/3896934363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128010d210 con 0x5580900f1be0 2023-07-14T13:18:55.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127effd700 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f12d0 0x558090100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:18:55.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f127f7fe700 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 0x5580900fdba0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1270009f50 tx=0x7f1270010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941945443dc276c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:55.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.670+0000 7f125effd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:55.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.671+0000 7f125effd700 1 -- 172.21.15.17:0/3896934363 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1270020040 con 0x5580900f1be0 2023-07-14T13:18:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.671+0000 7f1299907b80 1 -- 172.21.15.17:0/3896934363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55808ff9d4f0 con 0x5580900f1be0 2023-07-14T13:18:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.671+0000 7f125effd700 1 -- 172.21.15.17:0/3896934363 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1270017070 con 0x5580900f1be0 2023-07-14T13:18:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.671+0000 7f125effd700 1 -- 172.21.15.17:0/3896934363 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f127001cb70 con 0x5580900f1be0 2023-07-14T13:18:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.671+0000 7f1299907b80 10 client.18855 fetch_fsmap learned FSMap version 50 2023-07-14T13:18:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.671+0000 7f1299907b80 1 -- 172.21.15.17:0/3896934363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7f12700099f0 con 0x5580900f1be0 2023-07-14T13:18:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.671+0000 7f125effd700 1 -- 172.21.15.17:0/3896934363 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55808ff9d4f0 con 0x5580900f1be0 2023-07-14T13:18:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.671+0000 7f125effd700 1 -- 172.21.15.17:0/3896934363 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 50) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f1270005330 con 0x5580900f1be0 2023-07-14T13:18:55.712 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.671+0000 7f1299907b80 10 client.18855 fetch_fsmap finished waiting for FSMap version 50 2023-07-14T13:18:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.671+0000 7f1299907b80 10 client.18855 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:18:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.672+0000 7f1299907b80 20 client.18855 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.672+0000 7f1299907b80 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x558090110770 0x558090112b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.672+0000 7f1299907b80 4 client.18855 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.672+0000 7f1299907b80 1 -- 172.21.15.17:0/3896934363 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55809003ceb0 con 0x558090110770 2023-07-14T13:18:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.672+0000 7f127effd700 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x558090110770 0x558090112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.673+0000 7f127effd700 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x558090110770 0x558090112b80 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4950a6b4769fdf7a server_cookie=341b8fbdaa863e06 in_seq=0 out_seq=0 2023-07-14T13:18:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.673+0000 7f125effd700 10 client.18855 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:18:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.673+0000 7f125effd700 1 -- 172.21.15.17:0/3896934363 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55809003ceb0 con 0x558090110770 2023-07-14T13:18:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.673+0000 7f125effd700 10 client.18855 handle_command_reply: tid=0 2023-07-14T13:18:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.673+0000 7f1299907b80 1 client.18855 shutdown 2023-07-14T13:18:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f1299907b80 1 -- 172.21.15.17:0/3896934363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 msgr2=0x5580900fdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f1299907b80 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 0x5580900fdba0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1270009f50 tx=0x7f1270010de0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f1299907b80 1 -- 172.21.15.17:0/3896934363 shutdown_connections 2023-07-14T13:18:55.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f1299907b80 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900fe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f1299907b80 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x558090110770 0x558090112b80 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f1299907b80 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f12d0 0x558090100920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f1299907b80 1 --2- 172.21.15.17:0/3896934363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 0x5580900fdba0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f125effd700 0 client.18855 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:18:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f1299907b80 1 -- 172.21.15.17:0/3896934363 >> 172.21.15.17:0/3896934363 conn(0x5580900e7da0 msgr2=0x5580900ed290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f1299907b80 1 -- 172.21.15.17:0/3896934363 shutdown_connections 2023-07-14T13:18:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f1299907b80 1 -- 172.21.15.17:0/3896934363 wait complete. 2023-07-14T13:18:55.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.674+0000 7f1299907b80 20 client.18855 trim_cache size 0 max 16384 2023-07-14T13:18:55.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.698+0000 7f1299907b80 1 Processor -- start 2023-07-14T13:18:55.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.698+0000 7f1299907b80 1 -- start start 2023-07-14T13:18:55.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.698+0000 7f1299907b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f12d0 0x558090107900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.732 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.698+0000 7f1299907b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 0x55809010cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.698+0000 7f1299907b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.698+0000 7f1299907b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580900ff180 con 0x5580900f12d0 2023-07-14T13:18:55.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.698+0000 7f1299907b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580900f2dd0 con 0x558090100ee0 2023-07-14T13:18:55.733 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.698+0000 7f1299907b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580900e4ef0 con 0x5580900f1be0 2023-07-14T13:18:55.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.699+0000 7f127effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f12d0 0x558090107900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.699+0000 7f127effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f12d0 0x558090107900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35532/0 (socket says 172.21.15.17:35532) 2023-07-14T13:18:55.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.699+0000 7f127effd700 1 -- 172.21.15.17:0/1847367880 learned_addr learned my addr 172.21.15.17:0/1847367880 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:55.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.699+0000 7f127effd700 1 --2- 172.21.15.17:0/1847367880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.699+0000 7f127f7fe700 1 --2- 172.21.15.17:0/1847367880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 0x55809010cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.734 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.699+0000 7f127effd700 1 -- 172.21.15.17:0/1847367880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 msgr2=0x55809010cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:55.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.699+0000 7f127effd700 1 --2- 172.21.15.17:0/1847367880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 0x55809010cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.699+0000 7f127effd700 1 -- 172.21.15.17:0/1847367880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 msgr2=0x5580900f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:55.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.699+0000 7f127effd700 1 --2- 172.21.15.17:0/1847367880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.735 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.699+0000 7f127effd700 1 -- 172.21.15.17:0/1847367880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55808fe5ac60 con 0x5580900f12d0 2023-07-14T13:18:55.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.699+0000 7f127f7fe700 1 --2- 172.21.15.17:0/1847367880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 0x55809010cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:18:55.736 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.700+0000 7f127effd700 1 --2- 172.21.15.17:0/1847367880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f12d0 0x558090107900 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f127400b300 tx=0x7f1274005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20c9a0f4a7def57 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:55.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.700+0000 7f12667fc700 1 -- 172.21.15.17:0/1847367880 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400bed0 con 0x5580900f12d0 2023-07-14T13:18:55.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.700+0000 7f12667fc700 1 -- 172.21.15.17:0/1847367880 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f127401e040 con 0x5580900f12d0 2023-07-14T13:18:55.737 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.700+0000 7f12667fc700 1 -- 172.21.15.17:0/1847367880 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400f460 con 0x5580900f12d0 2023-07-14T13:18:55.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.701+0000 7f1299907b80 1 -- 172.21.15.17:0/1847367880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f12d0 msgr2=0x558090107900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.701+0000 7f1299907b80 1 --2- 172.21.15.17:0/1847367880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f12d0 0x558090107900 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f127400b300 tx=0x7f1274005fb0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.701+0000 7f1299907b80 1 -- 172.21.15.17:0/1847367880 shutdown_connections 2023-07-14T13:18:55.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.701+0000 7f1299907b80 1 --2- 172.21.15.17:0/1847367880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900f8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.701+0000 7f1299907b80 1 --2- 172.21.15.17:0/1847367880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f12d0 0x558090107900 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.701+0000 7f1299907b80 1 --2- 172.21.15.17:0/1847367880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f1be0 0x55809010cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.738 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.701+0000 7f1299907b80 1 -- 172.21.15.17:0/1847367880 >> 172.21.15.17:0/1847367880 conn(0x5580900e7da0 msgr2=0x5580900ebe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.702+0000 7f1299907b80 1 -- 172.21.15.17:0/1847367880 shutdown_connections 2023-07-14T13:18:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.702+0000 7f1299907b80 1 -- 172.21.15.17:0/1847367880 wait complete. 2023-07-14T13:18:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.702+0000 7f1299907b80 1 -- start start 2023-07-14T13:18:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.702+0000 7f1299907b80 1 Processor -- start 2023-07-14T13:18:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.703+0000 7f1299907b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f12d0 0x558090106ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.703+0000 7f1299907b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 0x558090106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.703+0000 7f1299907b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900f6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.703+0000 7f1299907b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580901078b0 con 0x5580900f1be0 2023-07-14T13:18:55.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.703+0000 7f1299907b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580900f6940 con 0x558090100ee0 2023-07-14T13:18:55.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.703+0000 7f1299907b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580900f6b00 con 0x5580900f12d0 2023-07-14T13:18:55.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.703+0000 7f1299907b80 10 client.0 _ll_register_callbacks cb 0x7f1270005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:55.741 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.704+0000 7f127effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.704+0000 7f127effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900f6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60962/0 (socket says 172.21.15.17:60962) 2023-07-14T13:18:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.704+0000 7f127effd700 1 -- 172.21.15.17:0/3584031748 learned_addr learned my addr 172.21.15.17:0/3584031748 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.704+0000 7f127effd700 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f12d0 0x558090106ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.704+0000 7f127f7fe700 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 0x558090106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.704+0000 7f127effd700 1 -- 172.21.15.17:0/3584031748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f12d0 msgr2=0x558090106ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.704+0000 7f127effd700 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f12d0 0x558090106ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.704+0000 7f127effd700 1 -- 172.21.15.17:0/3584031748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 msgr2=0x558090106ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.704+0000 7f127effd700 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 0x558090106ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.704+0000 7f127effd700 1 -- 172.21.15.17:0/3584031748 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1274033040 con 0x558090100ee0 2023-07-14T13:18:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.705+0000 7f127effd700 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900f6400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1274005cd0 tx=0x7f1274009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33eb62ccf59a2ed0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.705+0000 7f125effd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:18:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.705+0000 7f125effd700 1 -- 172.21.15.17:0/3584031748 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12740050f0 con 0x558090100ee0 2023-07-14T13:18:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.705+0000 7f125effd700 1 -- 172.21.15.17:0/3584031748 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1274005250 con 0x558090100ee0 2023-07-14T13:18:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.705+0000 7f1299907b80 1 -- 172.21.15.17:0/3584031748 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1270015070 con 0x558090100ee0 2023-07-14T13:18:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.706+0000 7f125effd700 1 -- 172.21.15.17:0/3584031748 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1274005410 con 0x558090100ee0 2023-07-14T13:18:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.706+0000 7f1299907b80 10 client.28580 fetch_fsmap learned FSMap version 50 2023-07-14T13:18:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.706+0000 7f1299907b80 1 -- 172.21.15.17:0/3584031748 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55808fe98250 con 0x558090100ee0 2023-07-14T13:18:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.706+0000 7f125effd700 1 -- 172.21.15.17:0/3584031748 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1270015070 con 0x558090100ee0 2023-07-14T13:18:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.706+0000 7f125effd700 1 -- 172.21.15.17:0/3584031748 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 50) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f1274004950 con 0x558090100ee0 2023-07-14T13:18:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.706+0000 7f1299907b80 10 client.28580 fetch_fsmap finished waiting for FSMap version 50 2023-07-14T13:18:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.706+0000 7f1299907b80 10 client.28580 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:18:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.706+0000 7f1299907b80 20 client.28580 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.707+0000 7f1299907b80 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5580901695c0 0x55809016b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.707+0000 7f1299907b80 4 client.28580 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:18:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.707+0000 7f1299907b80 1 -- 172.21.15.17:0/3584031748 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55808ffff050 con 0x5580901695c0 2023-07-14T13:18:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.707+0000 7f127f7fe700 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5580901695c0 0x55809016b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.708+0000 7f125effd700 10 client.28580 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:18:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.708+0000 7f127f7fe700 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5580901695c0 0x55809016b9d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=227440c1f2be6312 server_cookie=887dc80a51bb4870 in_seq=0 out_seq=0 2023-07-14T13:18:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f125effd700 1 -- 172.21.15.17:0/3584031748 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55808ffff050 con 0x5580901695c0 2023-07-14T13:18:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f125effd700 10 client.28580 handle_command_reply: tid=0 2023-07-14T13:18:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f1299907b80 1 client.28580 shutdown 2023-07-14T13:18:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f1299907b80 1 -- 172.21.15.17:0/3584031748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 msgr2=0x5580900f6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f1299907b80 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900f6400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1274005cd0 tx=0x7f1274009310 comp rx=0 tx=0).stop 2023-07-14T13:18:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f1299907b80 1 -- 172.21.15.17:0/3584031748 shutdown_connections 2023-07-14T13:18:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f1299907b80 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558090100ee0 0x5580900f6400 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f1299907b80 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x5580901695c0 0x55809016b9d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f1299907b80 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580900f12d0 0x558090106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f1299907b80 1 --2- 172.21.15.17:0/3584031748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5580900f1be0 0x558090106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f125effd700 0 client.28580 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:18:55.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.709+0000 7f1299907b80 1 -- 172.21.15.17:0/3584031748 >> 172.21.15.17:0/3584031748 conn(0x5580900e7da0 msgr2=0x5580900f8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:55.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.710+0000 7f1299907b80 1 -- 172.21.15.17:0/3584031748 shutdown_connections 2023-07-14T13:18:55.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.710+0000 7f1299907b80 1 -- 172.21.15.17:0/3584031748 wait complete. 2023-07-14T13:18:55.748 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.710+0000 7f1299907b80 20 client.28580 trim_cache size 0 max 16384 2023-07-14T13:18:55.748 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:18:55.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.711+0000 7f1285fff700 1 -- 172.21.15.17:0/98172663 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12680a12c0 msgr2=0x7f12680a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.711+0000 7f1285fff700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12680a12c0 0x7f12680a3770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f12780ca1d0 tx=0x7f1278009040 comp rx=0 tx=0).stop 2023-07-14T13:18:55.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.711+0000 7f1285fff700 1 -- 172.21.15.17:0/98172663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280105ae0 msgr2=0x7f1280195990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.711+0000 7f1285fff700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280105ae0 0x7f1280195990 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f127800ef30 tx=0x7f127800c450 comp rx=0 tx=0).stop 2023-07-14T13:18:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.711+0000 7f1285fff700 1 -- 172.21.15.17:0/98172663 shutdown_connections 2023-07-14T13:18:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.711+0000 7f1285fff700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f12680a12c0 0x7f12680a3770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.711+0000 7f1285fff700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1280105ae0 0x7f1280195990 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.711+0000 7f1285fff700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12800ffad0 0x7f128019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.711+0000 7f1285fff700 1 --2- 172.21.15.17:0/98172663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1280100480 0x7f128019be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.711+0000 7f1285fff700 1 -- 172.21.15.17:0/98172663 >> 172.21.15.17:0/98172663 conn(0x7f12800fb5f0 msgr2=0x7f12800fbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.712+0000 7f1285fff700 1 -- 172.21.15.17:0/98172663 shutdown_connections 2023-07-14T13:18:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.712+0000 7f1285fff700 1 -- 172.21.15.17:0/98172663 wait complete. 2023-07-14T13:18:55.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:55 smithi131 ceph-mon[96953]: pgmap v604: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2023-07-14T13:18:55.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:18:55.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.948+0000 7fd0115ff700 1 -- 172.21.15.17:0/603313558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd00c100480 msgr2=0x7fd00c10c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.948+0000 7fd0115ff700 1 --2- 172.21.15.17:0/603313558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd00c100480 0x7fd00c10c910 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fd00400b0a0 tx=0x7fd00400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.948+0000 7fd0115ff700 1 -- 172.21.15.17:0/603313558 shutdown_connections 2023-07-14T13:18:55.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.948+0000 7fd0115ff700 1 --2- 172.21.15.17:0/603313558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd00c100480 0x7fd00c10c910 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.948+0000 7fd0115ff700 1 --2- 172.21.15.17:0/603313558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd00c105ae0 0x7fd00c105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.948+0000 7fd0115ff700 1 --2- 172.21.15.17:0/603313558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd00c0ffad0 0x7fd00c0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.948+0000 7fd0115ff700 1 -- 172.21.15.17:0/603313558 >> 172.21.15.17:0/603313558 conn(0x7fd00c0fb5f0 msgr2=0x7fd00c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:55.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.949+0000 7fd0115ff700 1 -- 172.21.15.17:0/603313558 shutdown_connections 2023-07-14T13:18:55.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.949+0000 7fd0115ff700 1 -- 172.21.15.17:0/603313558 wait complete. 2023-07-14T13:18:55.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.950+0000 7fd0115ff700 1 Processor -- start 2023-07-14T13:18:55.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.950+0000 7fd0115ff700 1 -- start start 2023-07-14T13:18:55.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.950+0000 7fd0115ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd00c0ffad0 0x7fd00c19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.950+0000 7fd0115ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd00c100480 0x7fd00c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.950+0000 7fd0115ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd00c105ae0 0x7fd00c195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.950+0000 7fd0115ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c196140 con 0x7fd00c100480 2023-07-14T13:18:55.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.950+0000 7fd0115ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c1962b0 con 0x7fd00c0ffad0 2023-07-14T13:18:55.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.950+0000 7fd0115ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c196470 con 0x7fd00c105ae0 2023-07-14T13:18:55.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.950+0000 7fd003fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd00c100480 0x7fd00c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.950+0000 7fd003fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd00c100480 0x7fd00c19bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35552/0 (socket says 172.21.15.17:35552) 2023-07-14T13:18:55.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.950+0000 7fd003fff700 1 -- 172.21.15.17:0/2288279823 learned_addr learned my addr 172.21.15.17:0/2288279823 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:55.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd00affd700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd00c0ffad0 0x7fd00c19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd00b7fe700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd00c105ae0 0x7fd00c195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd003fff700 1 -- 172.21.15.17:0/2288279823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd00c105ae0 msgr2=0x7fd00c195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd003fff700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd00c105ae0 0x7fd00c195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd003fff700 1 -- 172.21.15.17:0/2288279823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd00c0ffad0 msgr2=0x7fd00c19ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:55.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd003fff700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd00c0ffad0 0x7fd00c19ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:55.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd003fff700 1 -- 172.21.15.17:0/2288279823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd004009d00 con 0x7fd00c100480 2023-07-14T13:18:55.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd003fff700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd00c100480 0x7fd00c19bfa0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fcff400d950 tx=0x7fcff400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:55.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd008ff9700 1 -- 172.21.15.17:0/2288279823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4009940 con 0x7fd00c100480 2023-07-14T13:18:55.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd0115ff700 1 -- 172.21.15.17:0/2288279823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c196750 con 0x7fd00c100480 2023-07-14T13:18:55.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd008ff9700 1 -- 172.21.15.17:0/2288279823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcff4010460 con 0x7fd00c100480 2023-07-14T13:18:55.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.951+0000 7fd008ff9700 1 -- 172.21.15.17:0/2288279823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff400f620 con 0x7fd00c100480 2023-07-14T13:18:55.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.952+0000 7fd0115ff700 1 -- 172.21.15.17:0/2288279823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c1a2a50 con 0x7fd00c100480 2023-07-14T13:18:55.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.955+0000 7fd008ff9700 1 -- 172.21.15.17:0/2288279823 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcff40105d0 con 0x7fd00c100480 2023-07-14T13:18:55.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.956+0000 7fd024fefb80 1 Processor -- start 2023-07-14T13:18:55.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.956+0000 7fd008ff9700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcff80a12c0 0x7fcff80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.956+0000 7fd024fefb80 1 -- start start 2023-07-14T13:18:55.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd008ff9700 1 -- 172.21.15.17:0/2288279823 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcff40ccbb0 con 0x7fd00c100480 2023-07-14T13:18:55.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd00b7fe700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcff80a12c0 0x7fcff80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e20d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20dbe0 0x557a7e218590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e218ad0 0x557a7e21aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:55.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd024fefb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7e113cb0 con 0x557a7e20d2d0 2023-07-14T13:18:55.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd024fefb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7e166a40 con 0x557a7e20dbe0 2023-07-14T13:18:55.995 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd024fefb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7e15fed0 con 0x557a7e218ad0 2023-07-14T13:18:55.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd00affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e20d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:55.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd00affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e20d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35562/0 (socket says 172.21.15.17:35562) 2023-07-14T13:18:55.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd00affd700 1 -- 172.21.15.17:0/213913043 learned_addr learned my addr 172.21.15.17:0/213913043 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:55.996 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd00b7fe700 1 --2- 172.21.15.17:0/213913043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e218ad0 0x557a7e21aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.957+0000 7fd003fff700 1 --2- 172.21.15.17:0/213913043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20dbe0 0x557a7e218590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.958+0000 7fd00affd700 1 -- 172.21.15.17:0/213913043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e218ad0 msgr2=0x557a7e21aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.958+0000 7fd00affd700 1 --2- 172.21.15.17:0/213913043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e218ad0 0x557a7e21aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.958+0000 7fd00affd700 1 -- 172.21.15.17:0/213913043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20dbe0 msgr2=0x557a7e218590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.001 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.958+0000 7fd00affd700 1 --2- 172.21.15.17:0/213913043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20dbe0 0x557a7e218590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.958+0000 7fd00b7fe700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcff80a12c0 0x7fcff80a3770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd0040062a0 tx=0x7fd004009370 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.958+0000 7fd00affd700 1 -- 172.21.15.17:0/213913043 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a7df8dde0 con 0x557a7e20d2d0 2023-07-14T13:18:56.002 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.958+0000 7fd00affd700 1 --2- 172.21.15.17:0/213913043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e20d6a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fcffc007c70 tx=0x7fcffc007f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb27bfee70b7539b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.958+0000 7fd0017fa700 1 -- 172.21.15.17:0/213913043 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc010b80 con 0x557a7e20d2d0 2023-07-14T13:18:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.958+0000 7fd0017fa700 1 -- 172.21.15.17:0/213913043 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcffc015070 con 0x557a7e20d2d0 2023-07-14T13:18:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.958+0000 7fd0017fa700 1 -- 172.21.15.17:0/213913043 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0193d0 con 0x557a7e20d2d0 2023-07-14T13:18:56.003 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.959+0000 7fd024fefb80 1 -- 172.21.15.17:0/213913043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 msgr2=0x557a7e20d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.959+0000 7fd024fefb80 1 --2- 172.21.15.17:0/213913043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e20d6a0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fcffc007c70 tx=0x7fcffc007f80 comp rx=0 tx=0).stop 2023-07-14T13:18:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.959+0000 7fd024fefb80 1 -- 172.21.15.17:0/213913043 shutdown_connections 2023-07-14T13:18:56.004 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.959+0000 7fd024fefb80 1 --2- 172.21.15.17:0/213913043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e218ad0 0x557a7e21aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.959+0000 7fd024fefb80 1 --2- 172.21.15.17:0/213913043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e20d6a0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.959+0000 7fd024fefb80 1 --2- 172.21.15.17:0/213913043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20dbe0 0x557a7e218590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.005 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.959+0000 7fd024fefb80 1 -- 172.21.15.17:0/213913043 >> 172.21.15.17:0/213913043 conn(0x557a7e203da0 msgr2=0x557a7e2096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.959+0000 7fd024fefb80 1 -- 172.21.15.17:0/213913043 shutdown_connections 2023-07-14T13:18:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.959+0000 7fd024fefb80 1 -- 172.21.15.17:0/213913043 wait complete. 2023-07-14T13:18:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.960+0000 7fd024fefb80 1 -- start start 2023-07-14T13:18:56.006 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.960+0000 7fd024fefb80 1 Processor -- start 2023-07-14T13:18:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.960+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e218470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e2156f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 0x557a7e215d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.007 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd024fefb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7e0ffac0 con 0x557a7e20d2d0 2023-07-14T13:18:56.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd024fefb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7e0ff7c0 con 0x557a7e218ad0 2023-07-14T13:18:56.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd024fefb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7dfe3920 con 0x557a7e20dbe0 2023-07-14T13:18:56.008 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd024fefb80 10 client.0 _ll_register_callbacks cb 0x557a7e0fd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd00affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e218470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd00affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e218470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35568/0 (socket says 172.21.15.17:35568) 2023-07-14T13:18:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd00affd700 1 -- 172.21.15.17:0/1932748362 learned_addr learned my addr 172.21.15.17:0/1932748362 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:56.009 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd003fff700 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e2156f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd00b7fe700 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 0x557a7e215d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd00affd700 1 -- 172.21.15.17:0/1932748362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 msgr2=0x557a7e2156f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.010 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd00affd700 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e2156f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd00affd700 1 -- 172.21.15.17:0/1932748362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 msgr2=0x557a7e215d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd00affd700 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 0x557a7e215d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.961+0000 7fd00affd700 1 -- 172.21.15.17:0/1932748362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc0078a0 con 0x557a7e20d2d0 2023-07-14T13:18:56.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.962+0000 7fd00affd700 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e218470 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fcffc011cb0 tx=0x7fcffc011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12a11c65d44cbdc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:56.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.962+0000 7fcff27fc700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:56.011 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.962+0000 7fcff27fc700 1 -- 172.21.15.17:0/1932748362 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc010b80 con 0x557a7e20d2d0 2023-07-14T13:18:56.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.962+0000 7fd024fefb80 1 -- 172.21.15.17:0/1932748362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a7e0b94f0 con 0x557a7e20d2d0 2023-07-14T13:18:56.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.962+0000 7fcff27fc700 1 -- 172.21.15.17:0/1932748362 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcffc010ce0 con 0x557a7e20d2d0 2023-07-14T13:18:56.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.962+0000 7fcff27fc700 1 -- 172.21.15.17:0/1932748362 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcffc004030 con 0x557a7e20d2d0 2023-07-14T13:18:56.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.962+0000 7fd024fefb80 10 client.18873 fetch_fsmap learned FSMap version 50 2023-07-14T13:18:56.012 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.962+0000 7fd024fefb80 1 -- 172.21.15.17:0/1932748362 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x557a7df76c60 con 0x557a7e20d2d0 2023-07-14T13:18:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.962+0000 7fcff27fc700 1 -- 172.21.15.17:0/1932748362 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcffc030020 con 0x557a7e20d2d0 2023-07-14T13:18:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.963+0000 7fcff27fc700 1 -- 172.21.15.17:0/1932748362 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 50) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fcffc005040 con 0x557a7e20d2d0 2023-07-14T13:18:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.963+0000 7fd024fefb80 10 client.18873 fetch_fsmap finished waiting for FSMap version 50 2023-07-14T13:18:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.963+0000 7fd024fefb80 10 client.18873 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:18:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.963+0000 7fd024fefb80 20 client.18873 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.963+0000 7fd024fefb80 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557a7e2283a0 0x557a7e22a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.013 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.963+0000 7fd024fefb80 4 client.18873 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.963+0000 7fd024fefb80 1 -- 172.21.15.17:0/1932748362 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a7e158eb0 con 0x557a7e2283a0 2023-07-14T13:18:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.963+0000 7fd003fff700 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557a7e2283a0 0x557a7e22a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.964+0000 7fd003fff700 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557a7e2283a0 0x557a7e22a7b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e5b5cd6e6ec321f server_cookie=d4cfbdebd2401500 in_seq=0 out_seq=0 2023-07-14T13:18:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.964+0000 7fcff27fc700 10 client.18873 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:18:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.964+0000 7fcff27fc700 1 -- 172.21.15.17:0/1932748362 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557a7e158eb0 con 0x557a7e2283a0 2023-07-14T13:18:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.964+0000 7fcff27fc700 10 client.18873 handle_command_reply: tid=0 2023-07-14T13:18:56.014 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 1 client.18873 shutdown 2023-07-14T13:18:56.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 1 -- 172.21.15.17:0/1932748362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 msgr2=0x557a7e218470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e218470 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fcffc011cb0 tx=0x7fcffc011ce0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 1 -- 172.21.15.17:0/1932748362 shutdown_connections 2023-07-14T13:18:56.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557a7e2283a0 0x557a7e22a7b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 0x557a7e215d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fcff27fc700 0 client.18873 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:18:56.015 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e218470 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 1 --2- 172.21.15.17:0/1932748362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e2156f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 1 -- 172.21.15.17:0/1932748362 >> 172.21.15.17:0/1932748362 conn(0x557a7e203da0 msgr2=0x557a7e209290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 1 -- 172.21.15.17:0/1932748362 shutdown_connections 2023-07-14T13:18:56.016 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 1 -- 172.21.15.17:0/1932748362 wait complete. 2023-07-14T13:18:56.017 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.965+0000 7fd024fefb80 20 client.18873 trim_cache size 0 max 16384 2023-07-14T13:18:56.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd024fefb80 1 Processor -- start 2023-07-14T13:18:56.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd024fefb80 1 -- start start 2023-07-14T13:18:56.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e21f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e218010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 0x557a7e212980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd024fefb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7e20e160 con 0x557a7e20d2d0 2023-07-14T13:18:56.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd024fefb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7e20f1a0 con 0x557a7e218ad0 2023-07-14T13:18:56.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd024fefb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7e2112e0 con 0x557a7e20dbe0 2023-07-14T13:18:56.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd00affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e21f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd00b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 0x557a7e212980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd00b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 0x557a7e212980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:32776/0 (socket says 172.21.15.17:32776) 2023-07-14T13:18:56.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd00affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e21f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35570/0 (socket says 172.21.15.17:35570) 2023-07-14T13:18:56.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.979+0000 7fd00b7fe700 1 -- 172.21.15.17:0/2175199300 learned_addr learned my addr 172.21.15.17:0/2175199300 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:56.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.980+0000 7fd003fff700 1 --2- 172.21.15.17:0/2175199300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e218010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.980+0000 7fd00b7fe700 1 -- 172.21.15.17:0/2175199300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 msgr2=0x557a7e218010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.980+0000 7fd00b7fe700 1 --2- 172.21.15.17:0/2175199300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e218010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.980+0000 7fd00b7fe700 1 -- 172.21.15.17:0/2175199300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 msgr2=0x557a7e21f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.980+0000 7fd00b7fe700 1 --2- 172.21.15.17:0/2175199300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e21f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.980+0000 7fd00b7fe700 1 -- 172.21.15.17:0/2175199300 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a7dfb4250 con 0x557a7e218ad0 2023-07-14T13:18:56.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.980+0000 7fd00affd700 1 --2- 172.21.15.17:0/2175199300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e21f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:18:56.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.980+0000 7fd00b7fe700 1 --2- 172.21.15.17:0/2175199300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 0x557a7e212980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd00400b0a0 tx=0x7fd00401f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=574409f10ac292c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:56.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.980+0000 7fd001ffb700 1 -- 172.21.15.17:0/2175199300 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd004007800 con 0x557a7e218ad0 2023-07-14T13:18:56.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.980+0000 7fd001ffb700 1 -- 172.21.15.17:0/2175199300 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd004007960 con 0x557a7e218ad0 2023-07-14T13:18:56.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.980+0000 7fd001ffb700 1 -- 172.21.15.17:0/2175199300 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0040052a0 con 0x557a7e218ad0 2023-07-14T13:18:56.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.981+0000 7fd024fefb80 1 -- 172.21.15.17:0/2175199300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 msgr2=0x557a7e212980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.981+0000 7fd024fefb80 1 --2- 172.21.15.17:0/2175199300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 0x557a7e212980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd00400b0a0 tx=0x7fd00401f040 comp rx=0 tx=0).stop 2023-07-14T13:18:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.981+0000 7fd024fefb80 1 -- 172.21.15.17:0/2175199300 shutdown_connections 2023-07-14T13:18:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.981+0000 7fd024fefb80 1 --2- 172.21.15.17:0/2175199300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e218ad0 0x557a7e212980 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.981+0000 7fd024fefb80 1 --2- 172.21.15.17:0/2175199300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e20d2d0 0x557a7e21f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.981+0000 7fd024fefb80 1 --2- 172.21.15.17:0/2175199300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e218010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.981+0000 7fd024fefb80 1 -- 172.21.15.17:0/2175199300 >> 172.21.15.17:0/2175199300 conn(0x557a7e203da0 msgr2=0x557a7e224720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.981+0000 7fd024fefb80 1 -- 172.21.15.17:0/2175199300 shutdown_connections 2023-07-14T13:18:56.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.981+0000 7fd024fefb80 1 -- 172.21.15.17:0/2175199300 wait complete. 2023-07-14T13:18:56.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.982+0000 7fd024fefb80 1 -- start start 2023-07-14T13:18:56.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.982+0000 7fd024fefb80 1 Processor -- start 2023-07-14T13:18:56.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.982+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20d2d0 0x557a7e275b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.982+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e2760d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.982+0000 7fd024fefb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e218ad0 0x557a7e2701b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.982+0000 7fd024fefb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7e2708c0 con 0x557a7e218ad0 2023-07-14T13:18:56.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.982+0000 7fd024fefb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7e270a30 con 0x557a7e20d2d0 2023-07-14T13:18:56.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.982+0000 7fd024fefb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a7e270bf0 con 0x557a7e20dbe0 2023-07-14T13:18:56.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.982+0000 7fd024fefb80 10 client.0 _ll_register_callbacks cb 0x7fcff400bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:56.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fd00affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20d2d0 0x557a7e275b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fd00affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20d2d0 0x557a7e275b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:32786/0 (socket says 172.21.15.17:32786) 2023-07-14T13:18:56.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fd00affd700 1 -- 172.21.15.17:0/3491107229 learned_addr learned my addr 172.21.15.17:0/3491107229 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:56.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fd003fff700 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e2760d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fd00b7fe700 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e218ad0 0x557a7e2701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fd00affd700 1 -- 172.21.15.17:0/3491107229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 msgr2=0x557a7e2760d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fd00affd700 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e2760d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fd00affd700 1 -- 172.21.15.17:0/3491107229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e218ad0 msgr2=0x557a7e2701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fd00affd700 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e218ad0 0x557a7e2701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fd00affd700 1 -- 172.21.15.17:0/3491107229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a7df76c60 con 0x557a7e20d2d0 2023-07-14T13:18:56.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fd00affd700 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20d2d0 0x557a7e275b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0054a0 tx=0x7fcffc0106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=202f2e45f25194e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:56.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.983+0000 7fcff27fc700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:18:56.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.984+0000 7fcff27fc700 1 -- 172.21.15.17:0/3491107229 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc010d90 con 0x557a7e20d2d0 2023-07-14T13:18:56.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.984+0000 7fd024fefb80 1 -- 172.21.15.17:0/3491107229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcffc015070 con 0x557a7e20d2d0 2023-07-14T13:18:56.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.984+0000 7fcff27fc700 1 -- 172.21.15.17:0/3491107229 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcffc031080 con 0x557a7e20d2d0 2023-07-14T13:18:56.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.984+0000 7fcff27fc700 1 -- 172.21.15.17:0/3491107229 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcffc005940 con 0x557a7e20d2d0 2023-07-14T13:18:56.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.984+0000 7fd024fefb80 10 client.28598 fetch_fsmap learned FSMap version 50 2023-07-14T13:18:56.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.984+0000 7fd024fefb80 1 -- 172.21.15.17:0/3491107229 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7fd00c10d210 con 0x557a7e20d2d0 2023-07-14T13:18:56.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.984+0000 7fcff27fc700 1 -- 172.21.15.17:0/3491107229 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcffc043020 con 0x557a7e20d2d0 2023-07-14T13:18:56.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.984+0000 7fcff27fc700 1 -- 172.21.15.17:0/3491107229 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 50) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fcffc033070 con 0x557a7e20d2d0 2023-07-14T13:18:56.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.984+0000 7fd024fefb80 10 client.28598 fetch_fsmap finished waiting for FSMap version 50 2023-07-14T13:18:56.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.984+0000 7fd024fefb80 10 client.28598 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:18:56.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.984+0000 7fd024fefb80 20 client.28598 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:56.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.985+0000 7fd024fefb80 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557a7e27d660 0x557a7e27fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.985+0000 7fd024fefb80 4 client.28598 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:18:56.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.985+0000 7fd024fefb80 1 -- 172.21.15.17:0/3491107229 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557a7e11b050 con 0x557a7e27d660 2023-07-14T13:18:56.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.985+0000 7fd003fff700 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557a7e27d660 0x557a7e27fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.985+0000 7fd003fff700 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557a7e27d660 0x557a7e27fa70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=852a6489afb5c062 server_cookie=bfca1c1adcd0c2b9 in_seq=0 out_seq=0 2023-07-14T13:18:56.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.985+0000 7fcff27fc700 10 client.28598 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:18:56.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fcff27fc700 1 -- 172.21.15.17:0/3491107229 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557a7e11b050 con 0x557a7e27d660 2023-07-14T13:18:56.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fcff27fc700 10 client.28598 handle_command_reply: tid=0 2023-07-14T13:18:56.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 1 client.28598 shutdown 2023-07-14T13:18:56.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 1 -- 172.21.15.17:0/3491107229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20d2d0 msgr2=0x557a7e275b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20d2d0 0x557a7e275b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0054a0 tx=0x7fcffc0106b0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 1 -- 172.21.15.17:0/3491107229 shutdown_connections 2023-07-14T13:18:56.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557a7e218ad0 0x557a7e2701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x557a7e27d660 0x557a7e27fa70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557a7e20d2d0 0x557a7e275b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.032 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fcff27fc700 0 client.28598 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:18:56.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 1 --2- 172.21.15.17:0/3491107229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557a7e20dbe0 0x557a7e2760d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 1 -- 172.21.15.17:0/3491107229 >> 172.21.15.17:0/3491107229 conn(0x557a7e203da0 msgr2=0x557a7e20f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:56.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 1 -- 172.21.15.17:0/3491107229 shutdown_connections 2023-07-14T13:18:56.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 1 -- 172.21.15.17:0/3491107229 wait complete. 2023-07-14T13:18:56.033 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.986+0000 7fd024fefb80 20 client.28598 trim_cache size 0 max 16384 2023-07-14T13:18:56.034 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:18:56.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 -- 172.21.15.17:0/2288279823 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcff80a12c0 msgr2=0x7fcff80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.034 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcff80a12c0 0x7fcff80a3770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd0040062a0 tx=0x7fd004009370 comp rx=0 tx=0).stop 2023-07-14T13:18:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 -- 172.21.15.17:0/2288279823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd00c100480 msgr2=0x7fd00c19bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd00c100480 0x7fd00c19bfa0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fcff400d950 tx=0x7fcff400dc60 comp rx=0 tx=0).stop 2023-07-14T13:18:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 -- 172.21.15.17:0/2288279823 shutdown_connections 2023-07-14T13:18:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcff80a12c0 0x7fcff80a3770 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd00c105ae0 0x7fd00c195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd00c0ffad0 0x7fd00c19ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 --2- 172.21.15.17:0/2288279823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd00c100480 0x7fd00c19bfa0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 -- 172.21.15.17:0/2288279823 >> 172.21.15.17:0/2288279823 conn(0x7fd00c0fb5f0 msgr2=0x7fd00c1035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 -- 172.21.15.17:0/2288279823 shutdown_connections 2023-07-14T13:18:56.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:55.987+0000 7fd0115ff700 1 -- 172.21.15.17:0/2288279823 wait complete. 2023-07-14T13:18:56.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:18:56.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.219+0000 7fca6c9ff700 1 -- 172.21.15.17:0/3601724966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca68100490 msgr2=0x7fca6810c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.253 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.219+0000 7fca6c9ff700 1 --2- 172.21.15.17:0/3601724966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca68100490 0x7fca6810c920 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fca6000b0a0 tx=0x7fca6000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.219+0000 7fca6c9ff700 1 -- 172.21.15.17:0/3601724966 shutdown_connections 2023-07-14T13:18:56.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.219+0000 7fca6c9ff700 1 --2- 172.21.15.17:0/3601724966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca68100490 0x7fca6810c920 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.219+0000 7fca6c9ff700 1 --2- 172.21.15.17:0/3601724966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca68105af0 0x7fca68105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.219+0000 7fca6c9ff700 1 --2- 172.21.15.17:0/3601724966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca680ffae0 0x7fca680fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.219+0000 7fca6c9ff700 1 -- 172.21.15.17:0/3601724966 >> 172.21.15.17:0/3601724966 conn(0x7fca680fb5e0 msgr2=0x7fca680fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:56.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.219+0000 7fca6c9ff700 1 -- 172.21.15.17:0/3601724966 shutdown_connections 2023-07-14T13:18:56.254 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.219+0000 7fca6c9ff700 1 -- 172.21.15.17:0/3601724966 wait complete. 2023-07-14T13:18:56.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.220+0000 7fca6c9ff700 1 Processor -- start 2023-07-14T13:18:56.256 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.220+0000 7fca6c9ff700 1 -- start start 2023-07-14T13:18:56.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca6c9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca680ffae0 0x7fca68197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca6c9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca68100490 0x7fca681982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca6c9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca68105af0 0x7fca6819c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca6c9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6819cd70 con 0x7fca68100490 2023-07-14T13:18:56.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca6c9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6819cee0 con 0x7fca680ffae0 2023-07-14T13:18:56.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca6c9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6819d0a0 con 0x7fca68105af0 2023-07-14T13:18:56.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca65d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca68100490 0x7fca681982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.257 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca65d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca68100490 0x7fca681982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35588/0 (socket says 172.21.15.17:35588) 2023-07-14T13:18:56.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca65d9b700 1 -- 172.21.15.17:0/698063677 learned_addr learned my addr 172.21.15.17:0/698063677 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:56.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca66d9d700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca68105af0 0x7fca6819c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca6659c700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca680ffae0 0x7fca68197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca65d9b700 1 -- 172.21.15.17:0/698063677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca68105af0 msgr2=0x7fca6819c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca65d9b700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca68105af0 0x7fca6819c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca65d9b700 1 -- 172.21.15.17:0/698063677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca680ffae0 msgr2=0x7fca68197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.258 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca65d9b700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca680ffae0 0x7fca68197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.221+0000 7fca65d9b700 1 -- 172.21.15.17:0/698063677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60009d00 con 0x7fca68100490 2023-07-14T13:18:56.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.222+0000 7fca65d9b700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca68100490 0x7fca681982d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00e9a0 tx=0x7fca5c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:56.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.222+0000 7fca577fe700 1 -- 172.21.15.17:0/698063677 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c009790 con 0x7fca68100490 2023-07-14T13:18:56.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.222+0000 7fca577fe700 1 -- 172.21.15.17:0/698063677 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5c00cbd0 con 0x7fca68100490 2023-07-14T13:18:56.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.222+0000 7fca6c9ff700 1 -- 172.21.15.17:0/698063677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6819d380 con 0x7fca68100490 2023-07-14T13:18:56.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.222+0000 7fca577fe700 1 -- 172.21.15.17:0/698063677 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c018680 con 0x7fca68100490 2023-07-14T13:18:56.259 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.222+0000 7fca6c9ff700 1 -- 172.21.15.17:0/698063677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca681a4bc0 con 0x7fca68100490 2023-07-14T13:18:56.260 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.225+0000 7fca577fe700 1 -- 172.21.15.17:0/698063677 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fca5c00cd40 con 0x7fca68100490 2023-07-14T13:18:56.261 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.228+0000 7fca803c8b80 1 Processor -- start 2023-07-14T13:18:56.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.228+0000 7fca577fe700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca500a12c0 0x7fca500a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.228+0000 7fca803c8b80 1 -- start start 2023-07-14T13:18:56.262 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.228+0000 7fca577fe700 1 -- 172.21.15.17:0/698063677 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fca5c014070 con 0x7fca68100490 2023-07-14T13:18:56.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.228+0000 7fca66d9d700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca500a12c0 0x7fca500a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.228+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 0x559660a3b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.228+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a46590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.228+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a48eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.263 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.228+0000 7fca803c8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660941cb0 con 0x559660a3bbe0 2023-07-14T13:18:56.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.228+0000 7fca803c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660994a40 con 0x559660a46ad0 2023-07-14T13:18:56.264 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.228+0000 7fca803c8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55966098ded0 con 0x559660a3b2d0 2023-07-14T13:18:56.265 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.229+0000 7fca6659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 0x559660a3b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.229+0000 7fca6659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 0x559660a3b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51884/0 (socket says 172.21.15.17:51884) 2023-07-14T13:18:56.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.229+0000 7fca6659c700 1 -- 172.21.15.17:0/3050848574 learned_addr learned my addr 172.21.15.17:0/3050848574 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:56.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.229+0000 7fca65d9b700 1 --2- 172.21.15.17:0/3050848574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a46590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.229+0000 7fca66d9d700 1 --2- 172.21.15.17:0/3050848574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a48eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.229+0000 7fca6659c700 1 -- 172.21.15.17:0/3050848574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 msgr2=0x559660a48eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.229+0000 7fca6659c700 1 --2- 172.21.15.17:0/3050848574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a48eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.266 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.229+0000 7fca6659c700 1 -- 172.21.15.17:0/3050848574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 msgr2=0x559660a46590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.229+0000 7fca6659c700 1 --2- 172.21.15.17:0/3050848574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a46590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.229+0000 7fca66d9d700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca500a12c0 0x7fca500a3770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fca60009fd0 tx=0x7fca6000b720 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:56.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.229+0000 7fca6659c700 1 -- 172.21.15.17:0/3050848574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596607bbde0 con 0x559660a3b2d0 2023-07-14T13:18:56.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.230+0000 7fca6659c700 1 --2- 172.21.15.17:0/3050848574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 0x559660a3b6a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fca58009cf0 tx=0x7fca580103d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=114fccbed6d73f9f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:56.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.230+0000 7fca54ff9700 1 -- 172.21.15.17:0/3050848574 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580097c0 con 0x559660a3b2d0 2023-07-14T13:18:56.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.230+0000 7fca54ff9700 1 -- 172.21.15.17:0/3050848574 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca58015070 con 0x559660a3b2d0 2023-07-14T13:18:56.267 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.230+0000 7fca54ff9700 1 -- 172.21.15.17:0/3050848574 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580116a0 con 0x559660a3b2d0 2023-07-14T13:18:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.231+0000 7fca803c8b80 1 -- 172.21.15.17:0/3050848574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 msgr2=0x559660a3b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.231+0000 7fca803c8b80 1 --2- 172.21.15.17:0/3050848574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 0x559660a3b6a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fca58009cf0 tx=0x7fca580103d0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.231+0000 7fca803c8b80 1 -- 172.21.15.17:0/3050848574 shutdown_connections 2023-07-14T13:18:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.231+0000 7fca803c8b80 1 --2- 172.21.15.17:0/3050848574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a48eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.231+0000 7fca803c8b80 1 --2- 172.21.15.17:0/3050848574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 0x559660a3b6a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.231+0000 7fca803c8b80 1 --2- 172.21.15.17:0/3050848574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a46590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.231+0000 7fca803c8b80 1 -- 172.21.15.17:0/3050848574 >> 172.21.15.17:0/3050848574 conn(0x559660a31da0 msgr2=0x559660a376a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:56.268 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.231+0000 7fca803c8b80 1 -- 172.21.15.17:0/3050848574 shutdown_connections 2023-07-14T13:18:56.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.231+0000 7fca803c8b80 1 -- 172.21.15.17:0/3050848574 wait complete. 2023-07-14T13:18:56.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.231+0000 7fca803c8b80 1 -- start start 2023-07-14T13:18:56.269 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.232+0000 7fca803c8b80 1 Processor -- start 2023-07-14T13:18:56.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.232+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a3b2d0 0x559660a46510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.232+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a43800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.271 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.232+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a46ad0 0x559660a43f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.232+0000 7fca803c8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55966092dac0 con 0x559660a3bbe0 2023-07-14T13:18:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.232+0000 7fca803c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55966092d7c0 con 0x559660a3b2d0 2023-07-14T13:18:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.232+0000 7fca803c8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660811920 con 0x559660a46ad0 2023-07-14T13:18:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.232+0000 7fca803c8b80 10 client.0 _ll_register_callbacks cb 0x55966092b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.232+0000 7fca65d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a43800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.232+0000 7fca65d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a43800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35610/0 (socket says 172.21.15.17:35610) 2023-07-14T13:18:56.272 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.232+0000 7fca65d9b700 1 -- 172.21.15.17:0/2588069011 learned_addr learned my addr 172.21.15.17:0/2588069011 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:56.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca6659c700 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a3b2d0 0x559660a46510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca66d9d700 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a46ad0 0x559660a43f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca65d9b700 1 -- 172.21.15.17:0/2588069011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a46ad0 msgr2=0x559660a43f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca65d9b700 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a46ad0 0x559660a43f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca65d9b700 1 -- 172.21.15.17:0/2588069011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a3b2d0 msgr2=0x559660a46510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca65d9b700 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a3b2d0 0x559660a46510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.273 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca65d9b700 1 -- 172.21.15.17:0/2588069011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca58009920 con 0x559660a3bbe0 2023-07-14T13:18:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca66d9d700 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a46ad0 0x559660a43f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:18:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca65d9b700 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a43800 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c5b0 tx=0x7fca5c09a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b888cf2fd9943e5a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca4dffb700 1 -- 172.21.15.17:0/2588069011 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0b1070 con 0x559660a3bbe0 2023-07-14T13:18:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca4dffb700 1 -- 172.21.15.17:0/2588069011 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fca5c099790 con 0x559660a3bbe0 2023-07-14T13:18:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.233+0000 7fca803c8b80 1 -- 172.21.15.17:0/2588069011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596608e74f0 con 0x559660a3bbe0 2023-07-14T13:18:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca4dffb700 1 -- 172.21.15.17:0/2588069011 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca5c0a2050 con 0x559660a3bbe0 2023-07-14T13:18:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca803c8b80 10 client.18891 fetch_fsmap learned FSMap version 50 2023-07-14T13:18:56.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca803c8b80 1 -- 172.21.15.17:0/2588069011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5596607a4c60 con 0x559660a3bbe0 2023-07-14T13:18:56.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca4dffb700 1 -- 172.21.15.17:0/2588069011 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5c0c8080 con 0x559660a3bbe0 2023-07-14T13:18:56.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca4dffb700 1 -- 172.21.15.17:0/2588069011 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 50) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fca5c095e80 con 0x559660a3bbe0 2023-07-14T13:18:56.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca803c8b80 10 client.18891 fetch_fsmap finished waiting for FSMap version 50 2023-07-14T13:18:56.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca803c8b80 10 client.18891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:56.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca803c8b80 20 client.18891 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:56.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca803c8b80 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660a563a0 0x559660a587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.275 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca803c8b80 4 client.18891 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca803c8b80 1 -- 172.21.15.17:0/2588069011 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559660986eb0 con 0x559660a563a0 2023-07-14T13:18:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.234+0000 7fca6659c700 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660a563a0 0x559660a587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.235+0000 7fca6659c700 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660a563a0 0x559660a587b0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcfa6ab2c500465f server_cookie=f394bba105056b87 in_seq=0 out_seq=0 2023-07-14T13:18:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.235+0000 7fca4dffb700 10 client.18891 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca4dffb700 1 -- 172.21.15.17:0/2588069011 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559660986eb0 con 0x559660a563a0 2023-07-14T13:18:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca4dffb700 10 client.18891 handle_command_reply: tid=0 2023-07-14T13:18:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca803c8b80 1 client.18891 shutdown 2023-07-14T13:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca803c8b80 1 -- 172.21.15.17:0/2588069011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 msgr2=0x559660a43800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca803c8b80 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a43800 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c5b0 tx=0x7fca5c09a110 comp rx=0 tx=0).stop 2023-07-14T13:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca803c8b80 1 -- 172.21.15.17:0/2588069011 shutdown_connections 2023-07-14T13:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca803c8b80 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660a563a0 0x559660a587b0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca803c8b80 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a46ad0 0x559660a43f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca803c8b80 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a3b2d0 0x559660a46510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca4dffb700 0 client.18891 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca803c8b80 1 --2- 172.21.15.17:0/2588069011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a43800 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca803c8b80 1 -- 172.21.15.17:0/2588069011 >> 172.21.15.17:0/2588069011 conn(0x559660a31da0 msgr2=0x559660a37230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca803c8b80 1 -- 172.21.15.17:0/2588069011 shutdown_connections 2023-07-14T13:18:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.236+0000 7fca803c8b80 1 -- 172.21.15.17:0/2588069011 wait complete. 2023-07-14T13:18:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.237+0000 7fca803c8b80 20 client.18891 trim_cache size 0 max 16384 2023-07-14T13:18:56.285 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca803c8b80 1 Processor -- start 2023-07-14T13:18:56.286 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca803c8b80 1 -- start start 2023-07-14T13:18:56.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3b2d0 0x559660a460b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3bbe0 0x559660a42fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a43500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca803c8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660a53b00 con 0x559660a3b2d0 2023-07-14T13:18:56.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca803c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660a3c540 con 0x559660a46ad0 2023-07-14T13:18:56.287 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca803c8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660a2ef80 con 0x559660a3bbe0 2023-07-14T13:18:56.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca6659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3b2d0 0x559660a460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca6659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3b2d0 0x559660a460b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35612/0 (socket says 172.21.15.17:35612) 2023-07-14T13:18:56.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca6659c700 1 -- 172.21.15.17:0/1305621636 learned_addr learned my addr 172.21.15.17:0/1305621636 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:56.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca66d9d700 1 --2- 172.21.15.17:0/1305621636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a43500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.252+0000 7fca65d9b700 1 --2- 172.21.15.17:0/1305621636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3bbe0 0x559660a42fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.253+0000 7fca6659c700 1 -- 172.21.15.17:0/1305621636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3bbe0 msgr2=0x559660a42fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.253+0000 7fca6659c700 1 --2- 172.21.15.17:0/1305621636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3bbe0 0x559660a42fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.288 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.253+0000 7fca6659c700 1 -- 172.21.15.17:0/1305621636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 msgr2=0x559660a43500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.253+0000 7fca6659c700 1 --2- 172.21.15.17:0/1305621636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a43500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.253+0000 7fca6659c700 1 -- 172.21.15.17:0/1305621636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559660a360e0 con 0x559660a3b2d0 2023-07-14T13:18:56.289 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.253+0000 7fca6659c700 1 --2- 172.21.15.17:0/1305621636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3b2d0 0x559660a460b0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fca5801c9f0 tx=0x7fca58005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83bd098fd0bf51b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:56.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.253+0000 7fca557fa700 1 -- 172.21.15.17:0/1305621636 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca58020040 con 0x559660a3b2d0 2023-07-14T13:18:56.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.253+0000 7fca557fa700 1 -- 172.21.15.17:0/1305621636 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5801c580 con 0x559660a3b2d0 2023-07-14T13:18:56.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.253+0000 7fca557fa700 1 -- 172.21.15.17:0/1305621636 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580290d0 con 0x559660a3b2d0 2023-07-14T13:18:56.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.254+0000 7fca803c8b80 1 -- 172.21.15.17:0/1305621636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3b2d0 msgr2=0x559660a460b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.254+0000 7fca803c8b80 1 --2- 172.21.15.17:0/1305621636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3b2d0 0x559660a460b0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fca5801c9f0 tx=0x7fca58005760 comp rx=0 tx=0).stop 2023-07-14T13:18:56.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.254+0000 7fca803c8b80 1 -- 172.21.15.17:0/1305621636 shutdown_connections 2023-07-14T13:18:56.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.254+0000 7fca803c8b80 1 --2- 172.21.15.17:0/1305621636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a43500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.254+0000 7fca803c8b80 1 --2- 172.21.15.17:0/1305621636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3b2d0 0x559660a460b0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.254+0000 7fca803c8b80 1 --2- 172.21.15.17:0/1305621636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3bbe0 0x559660a42fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.254+0000 7fca803c8b80 1 -- 172.21.15.17:0/1305621636 >> 172.21.15.17:0/1305621636 conn(0x559660a31da0 msgr2=0x559660a527c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:56.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.254+0000 7fca803c8b80 1 -- 172.21.15.17:0/1305621636 shutdown_connections 2023-07-14T13:18:56.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.254+0000 7fca803c8b80 1 -- 172.21.15.17:0/1305621636 wait complete. 2023-07-14T13:18:56.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.255+0000 7fca803c8b80 1 -- start start 2023-07-14T13:18:56.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.255+0000 7fca803c8b80 1 Processor -- start 2023-07-14T13:18:56.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.255+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 0x559660a4cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.255+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a4d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.255+0000 7fca803c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a4b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.255+0000 7fca803c8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660a4bad0 con 0x559660a3bbe0 2023-07-14T13:18:56.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.255+0000 7fca803c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660a4bc40 con 0x559660a46ad0 2023-07-14T13:18:56.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.255+0000 7fca803c8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660a4be00 con 0x559660a3b2d0 2023-07-14T13:18:56.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.255+0000 7fca803c8b80 10 client.0 _ll_register_callbacks cb 0x7fca5c099bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:56.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca65d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a4d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca65d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a4d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35624/0 (socket says 172.21.15.17:35624) 2023-07-14T13:18:56.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca65d9b700 1 -- 172.21.15.17:0/861043156 learned_addr learned my addr 172.21.15.17:0/861043156 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:56.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca66d9d700 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a4b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca6659c700 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 0x559660a4cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca65d9b700 1 -- 172.21.15.17:0/861043156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 msgr2=0x559660a4cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca65d9b700 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 0x559660a4cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca65d9b700 1 -- 172.21.15.17:0/861043156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 msgr2=0x559660a4b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:56.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca65d9b700 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a4b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca65d9b700 1 -- 172.21.15.17:0/861043156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596607bbde0 con 0x559660a3bbe0 2023-07-14T13:18:56.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca65d9b700 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a4d470 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x559660a36550 tx=0x7fca5c099aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c9837c928c275f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:56.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:56.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.256+0000 7fca4dffb700 1 -- 172.21.15.17:0/861043156 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0b1070 con 0x559660a3bbe0 2023-07-14T13:18:56.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca803c8b80 1 -- 172.21.15.17:0/861043156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca58015070 con 0x559660a3bbe0 2023-07-14T13:18:56.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca4dffb700 1 -- 172.21.15.17:0/861043156 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fca5c0a2260 con 0x559660a3bbe0 2023-07-14T13:18:56.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca4dffb700 1 -- 172.21.15.17:0/861043156 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca5c0b8170 con 0x559660a3bbe0 2023-07-14T13:18:56.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca803c8b80 10 client.18897 fetch_fsmap learned FSMap version 50 2023-07-14T13:18:56.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca803c8b80 1 -- 172.21.15.17:0/861043156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5596607e2250 con 0x559660a3bbe0 2023-07-14T13:18:56.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca4dffb700 1 -- 172.21.15.17:0/861043156 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca5c063020 con 0x559660a3bbe0 2023-07-14T13:18:56.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca4dffb700 1 -- 172.21.15.17:0/861043156 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 50) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fca5c099040 con 0x559660a3bbe0 2023-07-14T13:18:56.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca803c8b80 10 client.18897 fetch_fsmap finished waiting for FSMap version 50 2023-07-14T13:18:56.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca803c8b80 10 client.18897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:56.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca803c8b80 20 client.18897 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:56.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca803c8b80 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660aab1f0 0x559660aad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:56.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca803c8b80 4 client.18897 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:18:56.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.257+0000 7fca803c8b80 1 -- 172.21.15.17:0/861043156 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559660949050 con 0x559660aab1f0 2023-07-14T13:18:56.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.258+0000 7fca6659c700 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660aab1f0 0x559660aad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:56.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.258+0000 7fca6659c700 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660aab1f0 0x559660aad600 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e31c2e4691d72ef9 server_cookie=f339826a3c5ffde9 in_seq=0 out_seq=0 2023-07-14T13:18:56.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.258+0000 7fca4dffb700 10 client.18897 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:56.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca4dffb700 1 -- 172.21.15.17:0/861043156 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559660949050 con 0x559660aab1f0 2023-07-14T13:18:56.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca4dffb700 10 client.18897 handle_command_reply: tid=0 2023-07-14T13:18:56.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 1 client.18897 shutdown 2023-07-14T13:18:56.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 1 -- 172.21.15.17:0/861043156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 msgr2=0x559660a4d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a4d470 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x559660a36550 tx=0x7fca5c099aa0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 1 -- 172.21.15.17:0/861043156 shutdown_connections 2023-07-14T13:18:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660aab1f0 0x559660aad600 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660a46ad0 0x559660a4b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660a3b2d0 0x559660a4cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca4dffb700 0 client.18897 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 1 --2- 172.21.15.17:0/861043156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660a3bbe0 0x559660a4d470 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 1 -- 172.21.15.17:0/861043156 >> 172.21.15.17:0/861043156 conn(0x559660a31da0 msgr2=0x559660a3d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:56.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 1 -- 172.21.15.17:0/861043156 shutdown_connections 2023-07-14T13:18:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 1 -- 172.21.15.17:0/861043156 wait complete. 2023-07-14T13:18:56.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.259+0000 7fca803c8b80 20 client.18897 trim_cache size 0 max 16384 2023-07-14T13:18:56.301 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:18:56.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 -- 172.21.15.17:0/698063677 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca500a12c0 msgr2=0x7fca500a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca500a12c0 0x7fca500a3770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fca60009fd0 tx=0x7fca6000b720 comp rx=0 tx=0).stop 2023-07-14T13:18:56.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 -- 172.21.15.17:0/698063677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca68100490 msgr2=0x7fca681982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:56.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca68100490 0x7fca681982d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00e9a0 tx=0x7fca5c00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 -- 172.21.15.17:0/698063677 shutdown_connections 2023-07-14T13:18:56.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fca500a12c0 0x7fca500a3770 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca68105af0 0x7fca6819c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca680ffae0 0x7fca68197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 --2- 172.21.15.17:0/698063677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca68100490 0x7fca681982d0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:56.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 -- 172.21.15.17:0/698063677 >> 172.21.15.17:0/698063677 conn(0x7fca680fb5e0 msgr2=0x7fca6810ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:56.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 -- 172.21.15.17:0/698063677 shutdown_connections 2023-07-14T13:18:56.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:56.260+0000 7fca6c9ff700 1 -- 172.21.15.17:0/698063677 wait complete. 2023-07-14T13:18:56.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:56 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:18:56.360 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:56 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3218748307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:18:56.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:56 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:18:56.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:56 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3218748307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:18:56.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:56 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:18:56.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:56 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3218748307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:18:57.312 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:18:57.313 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:18:57.456 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 45.0 s, 244.8 tps, lat 142.439 ms stddev 50.222 2023-07-14T13:18:57.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.504+0000 7f0b609ff700 1 -- 172.21.15.17:0/1766467983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b5c0ffaa0 msgr2=0x7f0b5c0fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.504+0000 7f0b609ff700 1 --2- 172.21.15.17:0/1766467983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b5c0ffaa0 0x7f0b5c0fff10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009990 tx=0x7f0b50009ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.504+0000 7f0b609ff700 1 -- 172.21.15.17:0/1766467983 shutdown_connections 2023-07-14T13:18:57.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.504+0000 7f0b609ff700 1 --2- 172.21.15.17:0/1766467983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c100450 0x7f0b5c10c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.504+0000 7f0b609ff700 1 --2- 172.21.15.17:0/1766467983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b5c105ab0 0x7f0b5c105e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.504+0000 7f0b609ff700 1 --2- 172.21.15.17:0/1766467983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b5c0ffaa0 0x7f0b5c0fff10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.504+0000 7f0b609ff700 1 -- 172.21.15.17:0/1766467983 >> 172.21.15.17:0/1766467983 conn(0x7f0b5c0fb5a0 msgr2=0x7f0b5c0fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.504+0000 7f0b609ff700 1 -- 172.21.15.17:0/1766467983 shutdown_connections 2023-07-14T13:18:57.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.505+0000 7f0b609ff700 1 -- 172.21.15.17:0/1766467983 wait complete. 2023-07-14T13:18:57.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.505+0000 7f0b609ff700 1 Processor -- start 2023-07-14T13:18:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.506+0000 7f0b609ff700 1 -- start start 2023-07-14T13:18:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.506+0000 7f0b609ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c0ffaa0 0x7f0b5c19d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.506+0000 7f0b609ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b5c100450 0x7f0b5c19df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.506+0000 7f0b609ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b5c105ab0 0x7f0b5c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.506+0000 7f0b609ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c1980d0 con 0x7f0b5c100450 2023-07-14T13:18:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.506+0000 7f0b609ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c198240 con 0x7f0b5c105ab0 2023-07-14T13:18:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.506+0000 7f0b609ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c198400 con 0x7f0b5c0ffaa0 2023-07-14T13:18:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.506+0000 7f0b59d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b5c100450 0x7f0b5c19df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.506+0000 7f0b59d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b5c100450 0x7f0b5c19df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35642/0 (socket says 172.21.15.17:35642) 2023-07-14T13:18:57.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.506+0000 7f0b59d9b700 1 -- 172.21.15.17:0/374260357 learned_addr learned my addr 172.21.15.17:0/374260357 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:57.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b5ad9d700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b5c105ab0 0x7f0b5c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b5a59c700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c0ffaa0 0x7f0b5c19d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b59d9b700 1 -- 172.21.15.17:0/374260357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c0ffaa0 msgr2=0x7f0b5c19d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c0ffaa0 0x7f0b5c19d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b59d9b700 1 -- 172.21.15.17:0/374260357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b5c105ab0 msgr2=0x7f0b5c197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b5c105ab0 0x7f0b5c197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b59d9b700 1 -- 172.21.15.17:0/374260357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500095f0 con 0x7f0b5c100450 2023-07-14T13:18:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b5c100450 0x7f0b5c19df30 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f0b500036c0 tx=0x7f0b50005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b4b7fe700 1 -- 172.21.15.17:0/374260357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5001d070 con 0x7f0b5c100450 2023-07-14T13:18:57.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b4b7fe700 1 -- 172.21.15.17:0/374260357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b50003ec0 con 0x7f0b5c100450 2023-07-14T13:18:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b4b7fe700 1 -- 172.21.15.17:0/374260357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50022b00 con 0x7f0b5c100450 2023-07-14T13:18:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.507+0000 7f0b609ff700 1 -- 172.21.15.17:0/374260357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c198680 con 0x7f0b5c100450 2023-07-14T13:18:57.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.508+0000 7f0b609ff700 1 -- 172.21.15.17:0/374260357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c1a49e0 con 0x7f0b5c100450 2023-07-14T13:18:57.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.511+0000 7f0b4b7fe700 1 -- 172.21.15.17:0/374260357 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0b50004030 con 0x7f0b5c100450 2023-07-14T13:18:57.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.512+0000 7f0b4b7fe700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b440a1340 0x7f0b440a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.512+0000 7f0b742bdb80 1 Processor -- start 2023-07-14T13:18:57.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.512+0000 7f0b4b7fe700 1 -- 172.21.15.17:0/374260357 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0b500ce250 con 0x7f0b5c100450 2023-07-14T13:18:57.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.512+0000 7f0b742bdb80 1 -- start start 2023-07-14T13:18:57.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.512+0000 7f0b5a59c700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b440a1340 0x7f0b440a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ee7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3ef4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3dedd30 con 0x55b0b3ee7c60 2023-07-14T13:18:57.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3e40ac0 con 0x55b0b3ef2b50 2023-07-14T13:18:57.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3e39f50 con 0x55b0b3ee7350 2023-07-14T13:18:57.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b59d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b5a59c700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b440a1340 0x7f0b440a37f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c100be0 tx=0x7f0b4c00b410 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b59d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35648/0 (socket says 172.21.15.17:35648) 2023-07-14T13:18:57.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b59d9b700 1 -- 172.21.15.17:0/706502008 learned_addr learned my addr 172.21.15.17:0/706502008 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:57.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b5a59c700 1 --2- 172.21.15.17:0/706502008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ee7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b5ad9d700 1 --2- 172.21.15.17:0/706502008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3ef4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b59d9b700 1 -- 172.21.15.17:0/706502008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 msgr2=0x55b0b3ee7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.554 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/706502008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ee7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b59d9b700 1 -- 172.21.15.17:0/706502008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 msgr2=0x55b0b3ef4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/706502008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3ef4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.513+0000 7f0b59d9b700 1 -- 172.21.15.17:0/706502008 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0b3c67e60 con 0x55b0b3ee7c60 2023-07-14T13:18:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.514+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/706502008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef2610 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0b50097f00 tx=0x7f0b50009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5d85a0586a21ab server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.514+0000 7f0b48ff9700 1 -- 172.21.15.17:0/706502008 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5009f4c0 con 0x55b0b3ee7c60 2023-07-14T13:18:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.514+0000 7f0b48ff9700 1 -- 172.21.15.17:0/706502008 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b500a3850 con 0x55b0b3ee7c60 2023-07-14T13:18:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.514+0000 7f0b48ff9700 1 -- 172.21.15.17:0/706502008 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5009b6f0 con 0x55b0b3ee7c60 2023-07-14T13:18:57.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.515+0000 7f0b742bdb80 1 -- 172.21.15.17:0/706502008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 msgr2=0x55b0b3ef2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.515+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/706502008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef2610 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0b50097f00 tx=0x7f0b50009ca0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.515+0000 7f0b742bdb80 1 -- 172.21.15.17:0/706502008 shutdown_connections 2023-07-14T13:18:57.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.515+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/706502008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3ef4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.515+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/706502008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ee7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.515+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/706502008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef2610 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.515+0000 7f0b742bdb80 1 -- 172.21.15.17:0/706502008 >> 172.21.15.17:0/706502008 conn(0x55b0b3edde20 msgr2=0x55b0b3ee3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.515+0000 7f0b742bdb80 1 -- 172.21.15.17:0/706502008 shutdown_connections 2023-07-14T13:18:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.515+0000 7f0b742bdb80 1 -- 172.21.15.17:0/706502008 wait complete. 2023-07-14T13:18:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.515+0000 7f0b742bdb80 1 -- start start 2023-07-14T13:18:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.516+0000 7f0b742bdb80 1 Processor -- start 2023-07-14T13:18:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.516+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ef2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.516+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.516+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3ef39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.516+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3dd9b40 con 0x55b0b3ee7c60 2023-07-14T13:18:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.516+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3dd9840 con 0x55b0b3ef2b50 2023-07-14T13:18:57.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.516+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3cbd9a0 con 0x55b0b3ee7350 2023-07-14T13:18:57.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.516+0000 7f0b742bdb80 10 client.0 _ll_register_callbacks cb 0x55b0b3dd77e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:57.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.516+0000 7f0b59d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b59d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35660/0 (socket says 172.21.15.17:35660) 2023-07-14T13:18:57.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b5ad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3ef39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b59d9b700 1 -- 172.21.15.17:0/1354359141 learned_addr learned my addr 172.21.15.17:0/1354359141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:57.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b5a59c700 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ef2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b59d9b700 1 -- 172.21.15.17:0/1354359141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 msgr2=0x55b0b3ef2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ef2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b59d9b700 1 -- 172.21.15.17:0/1354359141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 msgr2=0x55b0b3ef39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3ef39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b59d9b700 1 -- 172.21.15.17:0/1354359141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c1a49e0 con 0x55b0b3ee7c60 2023-07-14T13:18:57.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b5ad9d700 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3ef39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:18:57.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef3460 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0b5009b420 tx=0x7f0b500cb900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90f878fb0df4ec4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:57.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.517+0000 7f0b41ffb700 1 -- 172.21.15.17:0/1354359141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5009f4c0 con 0x55b0b3ee7c60 2023-07-14T13:18:57.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1354359141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0b3d93570 con 0x55b0b3ee7c60 2023-07-14T13:18:57.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b41ffb700 1 -- 172.21.15.17:0/1354359141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0b5009a980 con 0x55b0b3ee7c60 2023-07-14T13:18:57.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b41ffb700 1 -- 172.21.15.17:0/1354359141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b5009ab40 con 0x55b0b3ee7c60 2023-07-14T13:18:57.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b742bdb80 10 client.18909 fetch_fsmap learned FSMap version 50 2023-07-14T13:18:57.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1354359141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55b0b3c50ce0 con 0x55b0b3ee7c60 2023-07-14T13:18:57.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b41ffb700 1 -- 172.21.15.17:0/1354359141 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b50065020 con 0x55b0b3ee7c60 2023-07-14T13:18:57.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b41ffb700 1 -- 172.21.15.17:0/1354359141 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 50) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f0b500a10b0 con 0x55b0b3ee7c60 2023-07-14T13:18:57.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b742bdb80 10 client.18909 fetch_fsmap finished waiting for FSMap version 50 2023-07-14T13:18:57.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b742bdb80 10 client.18909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:57.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b742bdb80 20 client.18909 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:57.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0b3f01d10 0x55b0b3f04120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b742bdb80 4 client.18909 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:57.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.518+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1354359141 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0b3e32f30 con 0x55b0b3f01d10 2023-07-14T13:18:57.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.519+0000 7f0b5a59c700 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0b3f01d10 0x55b0b3f04120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.519+0000 7f0b5a59c700 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0b3f01d10 0x55b0b3f04120 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24896fd2e3f3b31f server_cookie=c53af7692fa99a26 in_seq=0 out_seq=0 2023-07-14T13:18:57.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.519+0000 7f0b41ffb700 10 client.18909 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:57.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b41ffb700 1 -- 172.21.15.17:0/1354359141 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b0b3e32f30 con 0x55b0b3f01d10 2023-07-14T13:18:57.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b41ffb700 10 client.18909 handle_command_reply: tid=0 2023-07-14T13:18:57.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b742bdb80 1 client.18909 shutdown 2023-07-14T13:18:57.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1354359141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 msgr2=0x55b0b3ef3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef3460 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0b5009b420 tx=0x7f0b500cb900 comp rx=0 tx=0).stop 2023-07-14T13:18:57.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1354359141 shutdown_connections 2023-07-14T13:18:57.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0b3f01d10 0x55b0b3f04120 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3ef39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ef2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/1354359141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ef3460 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1354359141 >> 172.21.15.17:0/1354359141 conn(0x55b0b3edde20 msgr2=0x55b0b3ee3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.520+0000 7f0b41ffb700 0 client.18909 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:57.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.521+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1354359141 shutdown_connections 2023-07-14T13:18:57.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.521+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1354359141 wait complete. 2023-07-14T13:18:57.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.521+0000 7f0b742bdb80 20 client.18909 trim_cache size 0 max 16384 2023-07-14T13:18:57.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.539+0000 7f0b742bdb80 1 Processor -- start 2023-07-14T13:18:57.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.539+0000 7f0b742bdb80 1 -- start start 2023-07-14T13:18:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.539+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ef6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.539+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ee9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.539+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ef2b50 0x55b0b3eeede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.539+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3ee4550 con 0x55b0b3ef2b50 2023-07-14T13:18:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.539+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3ef2180 con 0x55b0b3ee7c60 2023-07-14T13:18:57.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.539+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3ee8350 con 0x55b0b3ee7350 2023-07-14T13:18:57.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.540+0000 7f0b5ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ef2b50 0x55b0b3eeede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.540+0000 7f0b5ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ef2b50 0x55b0b3eeede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35676/0 (socket says 172.21.15.17:35676) 2023-07-14T13:18:57.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.540+0000 7f0b5ad9d700 1 -- 172.21.15.17:0/1271058631 learned_addr learned my addr 172.21.15.17:0/1271058631 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:57.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.540+0000 7f0b5a59c700 1 --2- 172.21.15.17:0/1271058631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ef6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.540+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/1271058631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ee9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.540+0000 7f0b5ad9d700 1 -- 172.21.15.17:0/1271058631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 msgr2=0x55b0b3ef6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.540+0000 7f0b5ad9d700 1 --2- 172.21.15.17:0/1271058631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ef6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.540+0000 7f0b5ad9d700 1 -- 172.21.15.17:0/1271058631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ee7c60 msgr2=0x55b0b3ee9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.540+0000 7f0b5ad9d700 1 --2- 172.21.15.17:0/1271058631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ee9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.540+0000 7f0b5ad9d700 1 -- 172.21.15.17:0/1271058631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0b3c8e2d0 con 0x55b0b3ef2b50 2023-07-14T13:18:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.540+0000 7f0b5ad9d700 1 --2- 172.21.15.17:0/1271058631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ef2b50 0x55b0b3eeede0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009d80 tx=0x7f0b54009db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cd4203741faa43 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b497fa700 1 -- 172.21.15.17:0/1271058631 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540098d0 con 0x55b0b3ef2b50 2023-07-14T13:18:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b497fa700 1 -- 172.21.15.17:0/1271058631 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b5400f040 con 0x55b0b3ef2b50 2023-07-14T13:18:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b497fa700 1 -- 172.21.15.17:0/1271058631 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54007e70 con 0x55b0b3ef2b50 2023-07-14T13:18:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1271058631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ef2b50 msgr2=0x55b0b3eeede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/1271058631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ef2b50 0x55b0b3eeede0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009d80 tx=0x7f0b54009db0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1271058631 shutdown_connections 2023-07-14T13:18:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/1271058631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ef2b50 0x55b0b3eeede0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/1271058631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7350 0x55b0b3ef6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/1271058631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ee7c60 0x55b0b3ee9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1271058631 >> 172.21.15.17:0/1271058631 conn(0x55b0b3edde20 msgr2=0x55b0b3ee9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1271058631 shutdown_connections 2023-07-14T13:18:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.541+0000 7f0b742bdb80 1 -- 172.21.15.17:0/1271058631 wait complete. 2023-07-14T13:18:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.542+0000 7f0b742bdb80 1 -- start start 2023-07-14T13:18:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.542+0000 7f0b742bdb80 1 Processor -- start 2023-07-14T13:18:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.542+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7350 0x55b0b3f50370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.542+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7c60 0x55b0b3f508b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b742bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3f4a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3f4acb0 con 0x55b0b3ee7350 2023-07-14T13:18:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3f4ae20 con 0x55b0b3ef2b50 2023-07-14T13:18:57.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b742bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3f4afe0 con 0x55b0b3ee7c60 2023-07-14T13:18:57.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b742bdb80 10 client.0 _ll_register_callbacks cb 0x7f0b54003a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:57.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b5a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7350 0x55b0b3f50370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b5a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7350 0x55b0b3f50370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35686/0 (socket says 172.21.15.17:35686) 2023-07-14T13:18:57.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b5a59c700 1 -- 172.21.15.17:0/153444197 learned_addr learned my addr 172.21.15.17:0/153444197 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:57.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7c60 0x55b0b3f508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b5ad9d700 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3f4a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b5a59c700 1 -- 172.21.15.17:0/153444197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7c60 msgr2=0x55b0b3f508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b5a59c700 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7c60 0x55b0b3f508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b5a59c700 1 -- 172.21.15.17:0/153444197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 msgr2=0x55b0b3f4a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b5a59c700 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3f4a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b5a59c700 1 -- 172.21.15.17:0/153444197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b54009a30 con 0x55b0b3ee7350 2023-07-14T13:18:57.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.543+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7c60 0x55b0b3f508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:18:57.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.544+0000 7f0b5a59c700 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7350 0x55b0b3f50370 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x55b0b3f049c0 tx=0x7f0b4c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b637e8664818693b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.544+0000 7f0b41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:57.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.544+0000 7f0b41ffb700 1 -- 172.21.15.17:0/153444197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c024040 con 0x55b0b3ee7350 2023-07-14T13:18:57.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.544+0000 7f0b41ffb700 1 -- 172.21.15.17:0/153444197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0b4c017070 con 0x55b0b3ee7350 2023-07-14T13:18:57.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.544+0000 7f0b742bdb80 1 -- 172.21.15.17:0/153444197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b500a3850 con 0x55b0b3ee7350 2023-07-14T13:18:57.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.544+0000 7f0b41ffb700 1 -- 172.21.15.17:0/153444197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b4c0202d0 con 0x55b0b3ee7350 2023-07-14T13:18:57.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.544+0000 7f0b742bdb80 10 client.18915 fetch_fsmap learned FSMap version 50 2023-07-14T13:18:57.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.544+0000 7f0b742bdb80 1 -- 172.21.15.17:0/153444197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55b0b3c66330 con 0x55b0b3ee7350 2023-07-14T13:18:57.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.544+0000 7f0b41ffb700 1 -- 172.21.15.17:0/153444197 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b500a3850 con 0x55b0b3ee7350 2023-07-14T13:18:57.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.545+0000 7f0b41ffb700 1 -- 172.21.15.17:0/153444197 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 50) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f0b4c020b50 con 0x55b0b3ee7350 2023-07-14T13:18:57.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.545+0000 7f0b742bdb80 10 client.18915 fetch_fsmap finished waiting for FSMap version 50 2023-07-14T13:18:57.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.545+0000 7f0b742bdb80 10 client.18915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:57.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.545+0000 7f0b742bdb80 20 client.18915 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:57.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.545+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0b3f58260 0x55b0b3f5a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.545+0000 7f0b742bdb80 4 client.18915 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:18:57.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.545+0000 7f0b742bdb80 1 -- 172.21.15.17:0/153444197 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b0b3df50d0 con 0x55b0b3f58260 2023-07-14T13:18:57.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.545+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0b3f58260 0x55b0b3f5a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.546+0000 7f0b59d9b700 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0b3f58260 0x55b0b3f5a670 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=769bd3c9866d16a7 server_cookie=41e2e272a57756c7 in_seq=0 out_seq=0 2023-07-14T13:18:57.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.546+0000 7f0b41ffb700 10 client.18915 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.546+0000 7f0b41ffb700 1 -- 172.21.15.17:0/153444197 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b0b3df50d0 con 0x55b0b3f58260 2023-07-14T13:18:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.546+0000 7f0b41ffb700 10 client.18915 handle_command_reply: tid=0 2023-07-14T13:18:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.546+0000 7f0b742bdb80 1 client.18915 shutdown 2023-07-14T13:18:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.546+0000 7f0b742bdb80 1 -- 172.21.15.17:0/153444197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7350 msgr2=0x55b0b3f50370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.546+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7350 0x55b0b3f50370 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x55b0b3f049c0 tx=0x7f0b4c0047c0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b742bdb80 1 -- 172.21.15.17:0/153444197 shutdown_connections 2023-07-14T13:18:57.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b0b3f58260 0x55b0b3f5a670 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0b3ef2b50 0x55b0b3f4a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b0b3ee7350 0x55b0b3f50370 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b742bdb80 1 --2- 172.21.15.17:0/153444197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0b3ee7c60 0x55b0b3f508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b41ffb700 0 client.18915 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b742bdb80 1 -- 172.21.15.17:0/153444197 >> 172.21.15.17:0/153444197 conn(0x55b0b3edde20 msgr2=0x55b0b3ee9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b742bdb80 1 -- 172.21.15.17:0/153444197 shutdown_connections 2023-07-14T13:18:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b742bdb80 1 -- 172.21.15.17:0/153444197 wait complete. 2023-07-14T13:18:57.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b742bdb80 20 client.18915 trim_cache size 0 max 16384 2023-07-14T13:18:57.593 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:18:57.593 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:18:57.593 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "c212803c-a211-4b38-8ee6-a4fcb9732351", 2023-07-14T13:18:57.594 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:18:57.594 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:18:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b609ff700 1 -- 172.21.15.17:0/374260357 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b440a1340 msgr2=0x7f0b440a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.547+0000 7f0b609ff700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b440a1340 0x7f0b440a37f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c100be0 tx=0x7f0b4c00b410 comp rx=0 tx=0).stop 2023-07-14T13:18:57.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.548+0000 7f0b609ff700 1 -- 172.21.15.17:0/374260357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b5c100450 msgr2=0x7f0b5c19df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.548+0000 7f0b609ff700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b5c100450 0x7f0b5c19df30 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f0b500036c0 tx=0x7f0b50005740 comp rx=0 tx=0).stop 2023-07-14T13:18:57.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.548+0000 7f0b609ff700 1 -- 172.21.15.17:0/374260357 shutdown_connections 2023-07-14T13:18:57.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.548+0000 7f0b609ff700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0b440a1340 0x7f0b440a37f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.548+0000 7f0b609ff700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b5c105ab0 0x7f0b5c197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.548+0000 7f0b609ff700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b5c0ffaa0 0x7f0b5c19d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.548+0000 7f0b609ff700 1 --2- 172.21.15.17:0/374260357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b5c100450 0x7f0b5c19df30 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.548+0000 7f0b609ff700 1 -- 172.21.15.17:0/374260357 >> 172.21.15.17:0/374260357 conn(0x7f0b5c0fb5a0 msgr2=0x7f0b5c072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.548+0000 7f0b609ff700 1 -- 172.21.15.17:0/374260357 shutdown_connections 2023-07-14T13:18:57.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.548+0000 7f0b609ff700 1 -- 172.21.15.17:0/374260357 wait complete. 2023-07-14T13:18:57.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:57 smithi017 ceph-mon[95536]: pgmap v605: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 25 MiB/s wr, 1.70k op/s 2023-07-14T13:18:57.600 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:18:57.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:57 smithi135 ceph-mon[97338]: pgmap v605: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 25 MiB/s wr, 1.70k op/s 2023-07-14T13:18:57.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:57 smithi131 ceph-mon[96953]: pgmap v605: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 25 MiB/s wr, 1.70k op/s 2023-07-14T13:18:57.868 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.834+0000 7fdbf7dff700 1 -- 172.21.15.17:0/3862335879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf0100490 msgr2=0x7fdbf010c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.834+0000 7fdbf7dff700 1 --2- 172.21.15.17:0/3862335879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf0100490 0x7fdbf010c920 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800b0a0 tx=0x7fdbe800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.834+0000 7fdbf7dff700 1 -- 172.21.15.17:0/3862335879 shutdown_connections 2023-07-14T13:18:57.869 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.834+0000 7fdbf7dff700 1 --2- 172.21.15.17:0/3862335879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf0100490 0x7fdbf010c920 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.834+0000 7fdbf7dff700 1 --2- 172.21.15.17:0/3862335879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf0105af0 0x7fdbf0105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.834+0000 7fdbf7dff700 1 --2- 172.21.15.17:0/3862335879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf00ffae0 0x7fdbf00fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.834+0000 7fdbf7dff700 1 -- 172.21.15.17:0/3862335879 >> 172.21.15.17:0/3862335879 conn(0x7fdbf00fb5e0 msgr2=0x7fdbf00fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.834+0000 7fdbf7dff700 1 -- 172.21.15.17:0/3862335879 shutdown_connections 2023-07-14T13:18:57.870 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.835+0000 7fdbf7dff700 1 -- 172.21.15.17:0/3862335879 wait complete. 2023-07-14T13:18:57.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.836+0000 7fdbf7dff700 1 Processor -- start 2023-07-14T13:18:57.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.836+0000 7fdbf7dff700 1 -- start start 2023-07-14T13:18:57.872 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.837+0000 7fdbf7dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf00ffae0 0x7fdbf019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.837+0000 7fdbf7dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf0100490 0x7fdbf019bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.837+0000 7fdbf7dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf0105af0 0x7fdbf0195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.837+0000 7fdbf7dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf0196080 con 0x7fdbf00ffae0 2023-07-14T13:18:57.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.837+0000 7fdbf7dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf01961f0 con 0x7fdbf0105af0 2023-07-14T13:18:57.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.837+0000 7fdbf7dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf01963b0 con 0x7fdbf0100490 2023-07-14T13:18:57.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.837+0000 7fdbf5b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf00ffae0 0x7fdbf019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.873 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.837+0000 7fdbf5b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf00ffae0 0x7fdbf019b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35704/0 (socket says 172.21.15.17:35704) 2023-07-14T13:18:57.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.837+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/2646535861 learned_addr learned my addr 172.21.15.17:0/2646535861 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:57.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.837+0000 7fdbf639c700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf0105af0 0x7fdbf0195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.837+0000 7fdbf539a700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf0100490 0x7fdbf019bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.838+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/2646535861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf0100490 msgr2=0x7fdbf019bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.838+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf0100490 0x7fdbf019bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.838+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/2646535861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf0105af0 msgr2=0x7fdbf0195a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.838+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf0105af0 0x7fdbf0195a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.838+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/2646535861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe8009d00 con 0x7fdbf00ffae0 2023-07-14T13:18:57.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.838+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf00ffae0 0x7fdbf019b9a0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00e9a0 tx=0x7fdbec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.838+0000 7fdbe6ffd700 1 -- 172.21.15.17:0/2646535861 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec009790 con 0x7fdbf00ffae0 2023-07-14T13:18:57.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.838+0000 7fdbe6ffd700 1 -- 172.21.15.17:0/2646535861 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbec00cbd0 con 0x7fdbf00ffae0 2023-07-14T13:18:57.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.838+0000 7fdbf7dff700 1 -- 172.21.15.17:0/2646535861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf0196690 con 0x7fdbf00ffae0 2023-07-14T13:18:57.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.838+0000 7fdbe6ffd700 1 -- 172.21.15.17:0/2646535861 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec018680 con 0x7fdbf00ffae0 2023-07-14T13:18:57.875 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.838+0000 7fdbf7dff700 1 -- 172.21.15.17:0/2646535861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf01a2990 con 0x7fdbf00ffae0 2023-07-14T13:18:57.876 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.842+0000 7fdbe6ffd700 1 -- 172.21.15.17:0/2646535861 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fdbec00cd40 con 0x7fdbf00ffae0 2023-07-14T13:18:57.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.843+0000 7fdc0b69db80 1 Processor -- start 2023-07-14T13:18:57.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.843+0000 7fdbe6ffd700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdbdc0a1340 0x7fdbdc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.843+0000 7fdc0b69db80 1 -- start start 2023-07-14T13:18:57.881 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.843+0000 7fdbe6ffd700 1 -- 172.21.15.17:0/2646535861 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdbec014070 con 0x7fdbf00ffae0 2023-07-14T13:18:57.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdbf639c700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdbdc0a1340 0x7fdbdc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da79e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.882 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da79ebe0 0x5620da7ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da7adee0 0x5620da7b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da6a4cb0 con 0x5620da7adee0 2023-07-14T13:18:57.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da6f7a40 con 0x5620da79ebe0 2023-07-14T13:18:57.883 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da6f0ed0 con 0x5620da79e2d0 2023-07-14T13:18:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdbf5b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da79e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdbf639c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da7adee0 0x5620da7b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdbf5b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da79e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51994/0 (socket says 172.21.15.17:51994) 2023-07-14T13:18:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/3665885179 learned_addr learned my addr 172.21.15.17:0/3665885179 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:57.884 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdbf539a700 1 --2- 172.21.15.17:0/3665885179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da79ebe0 0x5620da7ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdbf639c700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdbdc0a1340 0x7fdbdc0a37f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009fd0 tx=0x7fdbe80094e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/3665885179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da79ebe0 msgr2=0x5620da7ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.885 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.844+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/3665885179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da79ebe0 0x5620da7ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.845+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/3665885179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da7adee0 msgr2=0x5620da7b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.845+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/3665885179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da7adee0 0x5620da7b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.886 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.845+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/3665885179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620da51ede0 con 0x5620da79e2d0 2023-07-14T13:18:57.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.845+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/3665885179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da79e6a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0969e0 tx=0x7fdbec0999c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d67ccdea5d75f1c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.845+0000 7fdbdbfff700 1 -- 172.21.15.17:0/3665885179 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec09dfa0 con 0x5620da79e2d0 2023-07-14T13:18:57.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.845+0000 7fdbdbfff700 1 -- 172.21.15.17:0/3665885179 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbec0a23c0 con 0x5620da79e2d0 2023-07-14T13:18:57.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.845+0000 7fdbdbfff700 1 -- 172.21.15.17:0/3665885179 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec0a1f30 con 0x5620da79e2d0 2023-07-14T13:18:57.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.846+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3665885179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 msgr2=0x5620da79e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.887 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.846+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/3665885179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da79e6a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0969e0 tx=0x7fdbec0999c0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.846+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3665885179 shutdown_connections 2023-07-14T13:18:57.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.846+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/3665885179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da7adee0 0x5620da7b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.846+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/3665885179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da79e6a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.846+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/3665885179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da79ebe0 0x5620da7ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.846+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3665885179 >> 172.21.15.17:0/3665885179 conn(0x5620da794da0 msgr2=0x5620da79a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.846+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3665885179 shutdown_connections 2023-07-14T13:18:57.888 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.846+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3665885179 wait complete. 2023-07-14T13:18:57.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.847+0000 7fdc0b69db80 1 -- start start 2023-07-14T13:18:57.889 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.847+0000 7fdc0b69db80 1 Processor -- start 2023-07-14T13:18:57.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da79ebe0 0x5620da7ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da7adee0 0x5620da7ab720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da690ac0 con 0x5620da79e2d0 2023-07-14T13:18:57.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da6907c0 con 0x5620da79ebe0 2023-07-14T13:18:57.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da574920 con 0x5620da7adee0 2023-07-14T13:18:57.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdc0b69db80 10 client.0 _ll_register_callbacks cb 0x5620da68e760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:57.892 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdbf5b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdbf5b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7aaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35714/0 (socket says 172.21.15.17:35714) 2023-07-14T13:18:57.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/3786978930 learned_addr learned my addr 172.21.15.17:0/3786978930 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:57.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdbf639c700 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da7adee0 0x5620da7ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdbf539a700 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da79ebe0 0x5620da7ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/3786978930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da7adee0 msgr2=0x5620da7ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da7adee0 0x5620da7ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/3786978930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da79ebe0 msgr2=0x5620da7ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.893 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da79ebe0 0x5620da7ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.848+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/3786978930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf01a2990 con 0x5620da79e2d0 2023-07-14T13:18:57.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.849+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7aaca0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0a1e90 tx=0x7fdbec0109d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d729f998ad00b81 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.849+0000 7fdbd97fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:57.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.849+0000 7fdbd97fa700 1 -- 172.21.15.17:0/3786978930 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec09e020 con 0x5620da79e2d0 2023-07-14T13:18:57.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.849+0000 7fdbd97fa700 1 -- 172.21.15.17:0/3786978930 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdbec0a2140 con 0x5620da79e2d0 2023-07-14T13:18:57.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.849+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3786978930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620da64a4f0 con 0x5620da79e2d0 2023-07-14T13:18:57.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.849+0000 7fdbd97fa700 1 -- 172.21.15.17:0/3786978930 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbec0b82a0 con 0x5620da79e2d0 2023-07-14T13:18:57.894 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.849+0000 7fdc0b69db80 10 client.18927 fetch_fsmap learned FSMap version 50 2023-07-14T13:18:57.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.849+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3786978930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5620da507c60 con 0x5620da79e2d0 2023-07-14T13:18:57.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.849+0000 7fdbd97fa700 1 -- 172.21.15.17:0/3786978930 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbec07c080 con 0x5620da79e2d0 2023-07-14T13:18:57.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.849+0000 7fdbd97fa700 1 -- 172.21.15.17:0/3786978930 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 50) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fdbec095d60 con 0x5620da79e2d0 2023-07-14T13:18:57.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.849+0000 7fdc0b69db80 10 client.18927 fetch_fsmap finished waiting for FSMap version 50 2023-07-14T13:18:57.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.850+0000 7fdc0b69db80 10 client.18927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:57.895 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.850+0000 7fdc0b69db80 20 client.18927 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:57.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.850+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5620da7bd570 0x5620da7bf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.850+0000 7fdc0b69db80 4 client.18927 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:18:57.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.850+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3786978930 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620da6e9eb0 con 0x5620da7bd570 2023-07-14T13:18:57.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.850+0000 7fdbf539a700 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5620da7bd570 0x5620da7bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.850+0000 7fdbf539a700 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5620da7bd570 0x5620da7bf980 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664b1287fc30a47c server_cookie=c886feff0b879e2 in_seq=0 out_seq=0 2023-07-14T13:18:57.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.850+0000 7fdbd97fa700 10 client.18927 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:57.896 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.851+0000 7fdbd97fa700 1 -- 172.21.15.17:0/3786978930 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5620da6e9eb0 con 0x5620da7bd570 2023-07-14T13:18:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.851+0000 7fdbd97fa700 10 client.18927 handle_command_reply: tid=0 2023-07-14T13:18:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.851+0000 7fdc0b69db80 1 client.18927 shutdown 2023-07-14T13:18:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.851+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3786978930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 msgr2=0x5620da7aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.851+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7aaca0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0a1e90 tx=0x7fdbec0109d0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.851+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3786978930 shutdown_connections 2023-07-14T13:18:57.897 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.851+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5620da7bd570 0x5620da7bf980 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.852+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da7adee0 0x5620da7ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.852+0000 7fdbd97fa700 0 client.18927 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.852+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7aaca0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.852+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/3786978930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da79ebe0 0x5620da7ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.852+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3786978930 >> 172.21.15.17:0/3786978930 conn(0x5620da794da0 msgr2=0x5620da79a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.852+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3786978930 shutdown_connections 2023-07-14T13:18:57.898 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.852+0000 7fdc0b69db80 1 -- 172.21.15.17:0/3786978930 wait complete. 2023-07-14T13:18:57.899 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.852+0000 7fdc0b69db80 20 client.18927 trim_cache size 0 max 16384 2023-07-14T13:18:57.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.869+0000 7fdc0b69db80 1 Processor -- start 2023-07-14T13:18:57.903 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.869+0000 7fdc0b69db80 1 -- start start 2023-07-14T13:18:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da7b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79ebe0 0x5620da7ab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 0x5620da7a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da79bd20 con 0x5620da79ebe0 2023-07-14T13:18:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da79efb0 con 0x5620da7adee0 2023-07-14T13:18:57.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da794970 con 0x5620da79e2d0 2023-07-14T13:18:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf539a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79ebe0 0x5620da7ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf5b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da7b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf5b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da7b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52018/0 (socket says 172.21.15.17:52018) 2023-07-14T13:18:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf539a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79ebe0 0x5620da7ab550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35726/0 (socket says 172.21.15.17:35726) 2023-07-14T13:18:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/2607844764 learned_addr learned my addr 172.21.15.17:0/2607844764 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf639c700 1 --2- 172.21.15.17:0/2607844764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 0x5620da7a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/2607844764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 msgr2=0x5620da7a7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/2607844764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 0x5620da7a7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.907 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/2607844764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79ebe0 msgr2=0x5620da7ab550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/2607844764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79ebe0 0x5620da7ab550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/2607844764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620da7965e0 con 0x5620da79e2d0 2023-07-14T13:18:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.870+0000 7fdbf639c700 1 --2- 172.21.15.17:0/2607844764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 0x5620da7a7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:18:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/2607844764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da7b48f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0969e0 tx=0x7fdbec099820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=661f0ab3677461bc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdbe4bff700 1 -- 172.21.15.17:0/2607844764 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec09dfa0 con 0x5620da79e2d0 2023-07-14T13:18:57.908 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdbe4bff700 1 -- 172.21.15.17:0/2607844764 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5620da64a4f0 con 0x5620da79e2d0 2023-07-14T13:18:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdbe4bff700 1 -- 172.21.15.17:0/2607844764 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec094b80 con 0x5620da79e2d0 2023-07-14T13:18:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdc0b69db80 1 -- 172.21.15.17:0/2607844764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 msgr2=0x5620da7b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/2607844764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da7b48f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0969e0 tx=0x7fdbec099820 comp rx=0 tx=0).stop 2023-07-14T13:18:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdc0b69db80 1 -- 172.21.15.17:0/2607844764 shutdown_connections 2023-07-14T13:18:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/2607844764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 0x5620da7a7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/2607844764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79e2d0 0x5620da7b48f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/2607844764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79ebe0 0x5620da7ab550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.909 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdc0b69db80 1 -- 172.21.15.17:0/2607844764 >> 172.21.15.17:0/2607844764 conn(0x5620da794da0 msgr2=0x5620da7b9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.871+0000 7fdc0b69db80 1 -- 172.21.15.17:0/2607844764 shutdown_connections 2023-07-14T13:18:57.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.872+0000 7fdc0b69db80 1 -- 172.21.15.17:0/2607844764 wait complete. 2023-07-14T13:18:57.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.872+0000 7fdc0b69db80 1 -- start start 2023-07-14T13:18:57.910 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.872+0000 7fdc0b69db80 1 Processor -- start 2023-07-14T13:18:57.912 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7b4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79ebe0 0x5620da7b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdc0b69db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 0x5620da7b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da7b2eb0 con 0x5620da79e2d0 2023-07-14T13:18:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da7b3020 con 0x5620da7adee0 2023-07-14T13:18:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdc0b69db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620da7b31e0 con 0x5620da79ebe0 2023-07-14T13:18:57.913 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdc0b69db80 10 client.0 _ll_register_callbacks cb 0x5620da68e760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:18:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf5b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf5b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35730/0 (socket says 172.21.15.17:35730) 2023-07-14T13:18:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/4015868344 learned_addr learned my addr 172.21.15.17:0/4015868344 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:18:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf539a700 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79ebe0 0x5620da7b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf639c700 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 0x5620da7b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/4015868344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79ebe0 msgr2=0x5620da7b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79ebe0 0x5620da7b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/4015868344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 msgr2=0x5620da7b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:18:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 0x5620da7b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf5b9b700 1 -- 172.21.15.17:0/4015868344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620da507c60 con 0x5620da79e2d0 2023-07-14T13:18:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf639c700 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 0x5620da7b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:18:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbf5b9b700 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7b4390 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00e970 tx=0x7fdbec0092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fc2f239b057713 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:18:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.873+0000 7fdbd97fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:18:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdbd97fa700 1 -- 172.21.15.17:0/4015868344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec094b80 con 0x5620da79e2d0 2023-07-14T13:18:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdbd97fa700 1 -- 172.21.15.17:0/4015868344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdbec07d060 con 0x5620da79e2d0 2023-07-14T13:18:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdc0b69db80 1 -- 172.21.15.17:0/4015868344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdbec0a23c0 con 0x5620da79e2d0 2023-07-14T13:18:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdbd97fa700 1 -- 172.21.15.17:0/4015868344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbec094ce0 con 0x5620da79e2d0 2023-07-14T13:18:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdc0b69db80 10 client.18933 fetch_fsmap learned FSMap version 50 2023-07-14T13:18:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdc0b69db80 1 -- 172.21.15.17:0/4015868344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5620da545250 con 0x5620da79e2d0 2023-07-14T13:18:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdbd97fa700 1 -- 172.21.15.17:0/4015868344 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbec0a23c0 con 0x5620da79e2d0 2023-07-14T13:18:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdbd97fa700 1 -- 172.21.15.17:0/4015868344 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 50) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fdbec0b9d20 con 0x5620da79e2d0 2023-07-14T13:18:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdc0b69db80 10 client.18933 fetch_fsmap finished waiting for FSMap version 50 2023-07-14T13:18:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdc0b69db80 10 client.18933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:18:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdc0b69db80 20 client.18933 populate_metadata read hostname 'smithi017' 2023-07-14T13:18:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5620da812090 0x5620da814470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:18:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdc0b69db80 4 client.18933 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:18:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.874+0000 7fdc0b69db80 1 -- 172.21.15.17:0/4015868344 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5620da6ac050 con 0x5620da812090 2023-07-14T13:18:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.875+0000 7fdbf539a700 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5620da812090 0x5620da814470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:18:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdbd97fa700 10 client.18933 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdbf539a700 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5620da812090 0x5620da814470 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3401907dd564f711 server_cookie=494048cb11d63d6a in_seq=0 out_seq=0 2023-07-14T13:18:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdbd97fa700 1 -- 172.21.15.17:0/4015868344 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5620da6ac050 con 0x5620da812090 2023-07-14T13:18:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdbd97fa700 10 client.18933 handle_command_reply: tid=0 2023-07-14T13:18:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 1 client.18933 shutdown 2023-07-14T13:18:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 1 -- 172.21.15.17:0/4015868344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 msgr2=0x5620da7b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7b4390 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00e970 tx=0x7fdbec0092d0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 1 -- 172.21.15.17:0/4015868344 shutdown_connections 2023-07-14T13:18:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5620da812090 0x5620da814470 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5620da7adee0 0x5620da7b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5620da79e2d0 0x5620da7b4390 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdbd97fa700 0 client.18933 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:18:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 1 --2- 172.21.15.17:0/4015868344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620da79ebe0 0x5620da7b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 1 -- 172.21.15.17:0/4015868344 >> 172.21.15.17:0/4015868344 conn(0x5620da794da0 msgr2=0x5620da7a02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 1 -- 172.21.15.17:0/4015868344 shutdown_connections 2023-07-14T13:18:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 1 -- 172.21.15.17:0/4015868344 wait complete. 2023-07-14T13:18:57.919 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.876+0000 7fdc0b69db80 20 client.18933 trim_cache size 0 max 16384 2023-07-14T13:18:57.920 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:18:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:18:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:18:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "c212803c-a211-4b38-8ee6-a4fcb9732351": { 2023-07-14T13:18:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:18:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "c212803c-a211-4b38-8ee6-a4fcb9732351", 2023-07-14T13:18:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:18:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:18:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:18:57.921 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:18:57.921 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 -- 172.21.15.17:0/2646535861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdbdc0a1340 msgr2=0x7fdbdc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdbdc0a1340 0x7fdbdc0a37f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009fd0 tx=0x7fdbe80094e0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 -- 172.21.15.17:0/2646535861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf00ffae0 msgr2=0x7fdbf019b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:18:57.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf00ffae0 0x7fdbf019b9a0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00e9a0 tx=0x7fdbec00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 -- 172.21.15.17:0/2646535861 shutdown_connections 2023-07-14T13:18:57.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdbdc0a1340 0x7fdbdc0a37f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.922 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbf0105af0 0x7fdbf0195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdbf00ffae0 0x7fdbf019b9a0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 --2- 172.21.15.17:0/2646535861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbf0100490 0x7fdbf019bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:18:57.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 -- 172.21.15.17:0/2646535861 >> 172.21.15.17:0/2646535861 conn(0x7fdbf00fb5e0 msgr2=0x7fdbf00fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:18:57.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 -- 172.21.15.17:0/2646535861 shutdown_connections 2023-07-14T13:18:57.923 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:18:57.877+0000 7fdbf7dff700 1 -- 172.21.15.17:0/2646535861 wait complete. 2023-07-14T13:18:57.929 INFO:tasks.cephfs.filesystem:scrub status for tag:c212803c-a211-4b38-8ee6-a4fcb9732351 - {'path': '/', 'tag': 'c212803c-a211-4b38-8ee6-a4fcb9732351', 'options': 'recursive,force'} 2023-07-14T13:18:58.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:58 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:18:58.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:58 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:58.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:58 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:18:58.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:58 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:18:58.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:58 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:58.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:58 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:18:58.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:58 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:58.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:58 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:18:58.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:58 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:18:58.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:58 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:58.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:58 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:18:58.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:58 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:58.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:58 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:18:58.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:58 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:18:58.751 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:58 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:59.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:59 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:18:59.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:59 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:59.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:59 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:59.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:18:59 smithi017 ceph-mon[95536]: pgmap v606: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-07-14T13:18:59.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:59 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:18:59.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:59 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:59.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:59 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:59.702 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:18:59 smithi135 ceph-mon[97338]: pgmap v606: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-07-14T13:18:59.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:59 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:18:59.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:59 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:59.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:59 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:18:59.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:18:59 smithi131 ceph-mon[96953]: pgmap v606: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-07-14T13:19:01.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:01 smithi017 ceph-mon[95536]: pgmap v607: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 19 MiB/s wr, 1.37k op/s 2023-07-14T13:19:01.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:01 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:19:01.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:01 smithi135 ceph-mon[97338]: pgmap v607: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 19 MiB/s wr, 1.37k op/s 2023-07-14T13:19:01.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:01 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:19:01.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:01 smithi131 ceph-mon[96953]: pgmap v607: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 19 MiB/s wr, 1.37k op/s 2023-07-14T13:19:01.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:01 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:19:02.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.270+0000 7f225f9ff700 1 -- 172.21.15.17:0/4049089921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2258110b20 msgr2=0x7f2258112f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.270+0000 7f225f9ff700 1 --2- 172.21.15.17:0/4049089921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2258110b20 0x7f2258112f00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f225000b0a0 tx=0x7f225000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.270+0000 7f225f9ff700 1 -- 172.21.15.17:0/4049089921 shutdown_connections 2023-07-14T13:19:02.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.270+0000 7f225f9ff700 1 --2- 172.21.15.17:0/4049089921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2258110b20 0x7f2258112f00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.270+0000 7f225f9ff700 1 --2- 172.21.15.17:0/4049089921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22580728b0 0x7f2258072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.270+0000 7f225f9ff700 1 --2- 172.21.15.17:0/4049089921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22580731c0 0x7f22581105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.270+0000 7f225f9ff700 1 -- 172.21.15.17:0/4049089921 >> 172.21.15.17:0/4049089921 conn(0x7f22580fb5f0 msgr2=0x7f22580fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:02.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.278+0000 7f225f9ff700 1 -- 172.21.15.17:0/4049089921 shutdown_connections 2023-07-14T13:19:02.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.278+0000 7f225f9ff700 1 -- 172.21.15.17:0/4049089921 wait complete. 2023-07-14T13:19:02.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.280+0000 7f225f9ff700 1 Processor -- start 2023-07-14T13:19:02.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.280+0000 7f225f9ff700 1 -- start start 2023-07-14T13:19:02.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.280+0000 7f225f9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22580728b0 0x7f2258110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.280+0000 7f225f9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22580731c0 0x7f2258108e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.281+0000 7f225f9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2258110b20 0x7f22581093b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.281+0000 7f225f9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22581098f0 con 0x7f2258110b20 2023-07-14T13:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.281+0000 7f225f9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2258109a60 con 0x7f22580728b0 2023-07-14T13:19:02.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.281+0000 7f225f9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2258109c20 con 0x7f22580731c0 2023-07-14T13:19:02.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.281+0000 7f225cf9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22580731c0 0x7f2258108e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.281+0000 7f225cf9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22580731c0 0x7f2258108e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52046/0 (socket says 172.21.15.17:52046) 2023-07-14T13:19:02.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.281+0000 7f225cf9a700 1 -- 172.21.15.17:0/3860774920 learned_addr learned my addr 172.21.15.17:0/3860774920 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:02.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.282+0000 7f225cf9a700 1 -- 172.21.15.17:0/3860774920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22580728b0 msgr2=0x7f2258110070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T13:19:02.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.282+0000 7f225cf9a700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22580728b0 0x7f2258110070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.282+0000 7f225cf9a700 1 -- 172.21.15.17:0/3860774920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2258110b20 msgr2=0x7f22581093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:02.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.282+0000 7f225cf9a700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2258110b20 0x7f22581093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.282+0000 7f225cf9a700 1 -- 172.21.15.17:0/3860774920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2250009d00 con 0x7f22580731c0 2023-07-14T13:19:02.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.283+0000 7f225cf9a700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22580731c0 0x7f2258108e70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f224800b530 tx=0x7f224800b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:02.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.284+0000 7f224e7fc700 1 -- 172.21.15.17:0/3860774920 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248011830 con 0x7f22580731c0 2023-07-14T13:19:02.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.284+0000 7f224e7fc700 1 -- 172.21.15.17:0/3860774920 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2248011e20 con 0x7f22580731c0 2023-07-14T13:19:02.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.284+0000 7f224e7fc700 1 -- 172.21.15.17:0/3860774920 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248010d20 con 0x7f22580731c0 2023-07-14T13:19:02.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.284+0000 7f225f9ff700 1 -- 172.21.15.17:0/3860774920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225810dc60 con 0x7f22580731c0 2023-07-14T13:19:02.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.284+0000 7f225f9ff700 1 -- 172.21.15.17:0/3860774920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225810e120 con 0x7f22580731c0 2023-07-14T13:19:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.292+0000 7f2273416b80 1 Processor -- start 2023-07-14T13:19:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.292+0000 7f2273416b80 1 -- start start 2023-07-14T13:19:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.293+0000 7f2273416b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9e1d6b0 0x555ae9fc6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.293+0000 7f2273416b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 0x555ae9fc1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.293+0000 7f2273416b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9fc1580 0x555ae9fc19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.293+0000 7f2273416b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ae9ec6c50 con 0x555ae9fc72d0 2023-07-14T13:19:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.293+0000 7f2273416b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ae9f199e0 con 0x555ae9fc1580 2023-07-14T13:19:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.293+0000 7f2273416b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ae9f12e70 con 0x555ae9e1d6b0 2023-07-14T13:19:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.294+0000 7f225d79b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 0x555ae9fc1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.294+0000 7f225d79b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 0x555ae9fc1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35756/0 (socket says 172.21.15.17:35756) 2023-07-14T13:19:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.294+0000 7f225d79b700 1 -- 172.21.15.17:0/3092755780 learned_addr learned my addr 172.21.15.17:0/3092755780 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.295+0000 7f225d79b700 1 -- 172.21.15.17:0/3092755780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9e1d6b0 msgr2=0x555ae9fc6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.295+0000 7f225d79b700 1 --2- 172.21.15.17:0/3092755780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9e1d6b0 0x555ae9fc6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.295+0000 7f225d79b700 1 -- 172.21.15.17:0/3092755780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9fc1580 msgr2=0x555ae9fc19d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:19:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.295+0000 7f225d79b700 1 --2- 172.21.15.17:0/3092755780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9fc1580 0x555ae9fc19d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.295+0000 7f225d79b700 1 -- 172.21.15.17:0/3092755780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ae9d40d80 con 0x555ae9fc72d0 2023-07-14T13:19:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.295+0000 7f224e7fc700 1 -- 172.21.15.17:0/3860774920 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2248011990 con 0x7f22580731c0 2023-07-14T13:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.295+0000 7f225d79b700 1 --2- 172.21.15.17:0/3092755780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 0x555ae9fc1040 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f2254009830 tx=0x7f2254009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71e9611f5a54fd1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.296+0000 7f22437fe700 1 -- 172.21.15.17:0/3092755780 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254011830 con 0x555ae9fc72d0 2023-07-14T13:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.296+0000 7f22437fe700 1 -- 172.21.15.17:0/3092755780 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2254011e20 con 0x555ae9fc72d0 2023-07-14T13:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.296+0000 7f22437fe700 1 -- 172.21.15.17:0/3092755780 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254010d70 con 0x555ae9fc72d0 2023-07-14T13:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.297+0000 7f2273416b80 1 -- 172.21.15.17:0/3092755780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 msgr2=0x555ae9fc1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.297+0000 7f2273416b80 1 --2- 172.21.15.17:0/3092755780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 0x555ae9fc1040 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f2254009830 tx=0x7f2254009b40 comp rx=0 tx=0).stop 2023-07-14T13:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.298+0000 7f2273416b80 1 -- 172.21.15.17:0/3092755780 shutdown_connections 2023-07-14T13:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.298+0000 7f2273416b80 1 --2- 172.21.15.17:0/3092755780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9fc1580 0x555ae9fc19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.298+0000 7f2273416b80 1 --2- 172.21.15.17:0/3092755780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9e1d6b0 0x555ae9fc6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.298+0000 7f2273416b80 1 --2- 172.21.15.17:0/3092755780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 0x555ae9fc1040 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.298+0000 7f2273416b80 1 -- 172.21.15.17:0/3092755780 >> 172.21.15.17:0/3092755780 conn(0x555ae9fb6be0 msgr2=0x555ae9fbbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.298+0000 7f2273416b80 1 -- 172.21.15.17:0/3092755780 shutdown_connections 2023-07-14T13:19:02.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.298+0000 7f2273416b80 1 -- 172.21.15.17:0/3092755780 wait complete. 2023-07-14T13:19:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.299+0000 7f2273416b80 1 -- start start 2023-07-14T13:19:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.299+0000 7f2273416b80 1 Processor -- start 2023-07-14T13:19:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.300+0000 7f2273416b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9e1d6b0 0x555ae9fca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.300+0000 7f2273416b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9fc1580 0x555ae9fcae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.300+0000 7f2273416b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 0x555ae9fcb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.300+0000 7f2273416b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ae9eb2a60 con 0x555ae9fc72d0 2023-07-14T13:19:02.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.300+0000 7f2273416b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ae9eb2760 con 0x555ae9fc1580 2023-07-14T13:19:02.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.300+0000 7f2273416b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ae9d968c0 con 0x555ae9e1d6b0 2023-07-14T13:19:02.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.300+0000 7f2273416b80 10 client.0 _ll_register_callbacks cb 0x555ae9eb0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:02.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.301+0000 7f225df9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9e1d6b0 0x555ae9fca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.301+0000 7f225df9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9e1d6b0 0x555ae9fca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52060/0 (socket says 172.21.15.17:52060) 2023-07-14T13:19:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.301+0000 7f225df9c700 1 -- 172.21.15.17:0/1181518532 learned_addr learned my addr 172.21.15.17:0/1181518532 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.301+0000 7f225cf9a700 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 0x555ae9fcb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.301+0000 7f225d79b700 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9fc1580 0x555ae9fcae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.301+0000 7f224e7fc700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22440a1320 0x7f22440a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.301+0000 7f225df9c700 1 -- 172.21.15.17:0/1181518532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9fc1580 msgr2=0x555ae9fcae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.301+0000 7f225df9c700 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9fc1580 0x555ae9fcae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.301+0000 7f225df9c700 1 -- 172.21.15.17:0/1181518532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 msgr2=0x555ae9fcb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.301+0000 7f225df9c700 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 0x555ae9fcb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.301+0000 7f225df9c700 1 -- 172.21.15.17:0/1181518532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2254009460 con 0x555ae9e1d6b0 2023-07-14T13:19:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.302+0000 7f224e7fc700 1 -- 172.21.15.17:0/3860774920 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f22480cc740 con 0x7f22580731c0 2023-07-14T13:19:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.302+0000 7f225df9c700 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9e1d6b0 0x555ae9fca900 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f22500062a0 tx=0x7f22500095d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69053a9b0881f5c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.302+0000 7f2240ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:19:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.302+0000 7f2240ff9700 1 -- 172.21.15.17:0/1181518532 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225000e040 con 0x555ae9e1d6b0 2023-07-14T13:19:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.302+0000 7f2240ff9700 1 -- 172.21.15.17:0/1181518532 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f22500074e0 con 0x555ae9e1d6b0 2023-07-14T13:19:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.303+0000 7f2273416b80 1 -- 172.21.15.17:0/1181518532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ae9e6c490 con 0x555ae9e1d6b0 2023-07-14T13:19:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.303+0000 7f2240ff9700 1 -- 172.21.15.17:0/1181518532 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2250004e50 con 0x555ae9e1d6b0 2023-07-14T13:19:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.303+0000 7f2273416b80 10 client.28615 fetch_fsmap learned FSMap version 51 2023-07-14T13:19:02.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.303+0000 7f2273416b80 1 -- 172.21.15.17:0/1181518532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x555ae9d29c00 con 0x555ae9e1d6b0 2023-07-14T13:19:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.303+0000 7f2240ff9700 1 -- 172.21.15.17:0/1181518532 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555ae9e6c490 con 0x555ae9e1d6b0 2023-07-14T13:19:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.304+0000 7f2240ff9700 1 -- 172.21.15.17:0/1181518532 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 51) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2250019070 con 0x555ae9e1d6b0 2023-07-14T13:19:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.304+0000 7f225df9c700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22440a1320 0x7f22440a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.304+0000 7f2273416b80 10 client.28615 fetch_fsmap finished waiting for FSMap version 51 2023-07-14T13:19:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.304+0000 7f2273416b80 10 client.28615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.304+0000 7f2273416b80 20 client.28615 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.304+0000 7f2273416b80 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ae9fdad40 0x555ae9fdd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.304+0000 7f2273416b80 4 client.28615 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:19:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.304+0000 7f2273416b80 1 -- 172.21.15.17:0/1181518532 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ae9f0be50 con 0x555ae9fdad40 2023-07-14T13:19:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.304+0000 7f225d79b700 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ae9fdad40 0x555ae9fdd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.305+0000 7f225d79b700 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ae9fdad40 0x555ae9fdd150 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=accfa11433748a3b server_cookie=70f31d640e526702 in_seq=0 out_seq=0 2023-07-14T13:19:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.305+0000 7f2240ff9700 10 client.28615 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.305+0000 7f225df9c700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22440a1320 0x7f22440a37d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f225001c020 tx=0x7f2250011800 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2240ff9700 1 -- 172.21.15.17:0/1181518532 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555ae9f0be50 con 0x555ae9fdad40 2023-07-14T13:19:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2240ff9700 10 client.28615 handle_command_reply: tid=0 2023-07-14T13:19:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2273416b80 1 client.28615 shutdown 2023-07-14T13:19:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2273416b80 1 -- 172.21.15.17:0/1181518532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9e1d6b0 msgr2=0x555ae9fca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2273416b80 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9e1d6b0 0x555ae9fca900 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f22500062a0 tx=0x7f22500095d0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2273416b80 1 -- 172.21.15.17:0/1181518532 shutdown_connections 2023-07-14T13:19:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2273416b80 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ae9fdad40 0x555ae9fdd150 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2273416b80 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc72d0 0x555ae9fcb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2273416b80 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9e1d6b0 0x555ae9fca900 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2273416b80 1 --2- 172.21.15.17:0/1181518532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9fc1580 0x555ae9fcae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2273416b80 1 -- 172.21.15.17:0/1181518532 >> 172.21.15.17:0/1181518532 conn(0x555ae9fb6be0 msgr2=0x555ae9fbac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.306+0000 7f2240ff9700 0 client.28615 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.307+0000 7f2273416b80 1 -- 172.21.15.17:0/1181518532 shutdown_connections 2023-07-14T13:19:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.307+0000 7f2273416b80 1 -- 172.21.15.17:0/1181518532 wait complete. 2023-07-14T13:19:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.307+0000 7f2273416b80 20 client.28615 trim_cache size 0 max 16384 2023-07-14T13:19:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.337+0000 7f2273416b80 1 Processor -- start 2023-07-14T13:19:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.338+0000 7f2273416b80 1 -- start start 2023-07-14T13:19:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.338+0000 7f2273416b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fb6be0 0x555ae9fc1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.338+0000 7f2273416b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9e1d6b0 0x555ae9fc61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.338+0000 7f2273416b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fc1580 0x555ae9fbbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.338+0000 7f2273416b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ae9fbdb70 con 0x555ae9fb6be0 2023-07-14T13:19:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.338+0000 7f2273416b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ae9fc6a10 con 0x555ae9e1d6b0 2023-07-14T13:19:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.339+0000 7f2273416b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ae9fd8350 con 0x555ae9fc1580 2023-07-14T13:19:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.339+0000 7f225d79b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fb6be0 0x555ae9fc1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.339+0000 7f225d79b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fb6be0 0x555ae9fc1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35776/0 (socket says 172.21.15.17:35776) 2023-07-14T13:19:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.339+0000 7f225d79b700 1 -- 172.21.15.17:0/3162788509 learned_addr learned my addr 172.21.15.17:0/3162788509 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.340+0000 7f225df9c700 1 --2- 172.21.15.17:0/3162788509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fc1580 0x555ae9fbbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.340+0000 7f225df9c700 1 -- 172.21.15.17:0/3162788509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9e1d6b0 msgr2=0x555ae9fc61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.340+0000 7f225df9c700 1 --2- 172.21.15.17:0/3162788509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9e1d6b0 0x555ae9fc61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.340+0000 7f225df9c700 1 -- 172.21.15.17:0/3162788509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fb6be0 msgr2=0x555ae9fc1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.340+0000 7f225df9c700 1 --2- 172.21.15.17:0/3162788509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fb6be0 0x555ae9fc1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.340+0000 7f225df9c700 1 -- 172.21.15.17:0/3162788509 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ae9fe1d40 con 0x555ae9fc1580 2023-07-14T13:19:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.340+0000 7f225d79b700 1 --2- 172.21.15.17:0/3162788509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fb6be0 0x555ae9fc1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:19:02.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.341+0000 7f225df9c700 1 --2- 172.21.15.17:0/3162788509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fc1580 0x555ae9fbbc60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f225001acf0 tx=0x7f2250036000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70afae9af92385a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:02.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.342+0000 7f2243fff700 1 -- 172.21.15.17:0/3162788509 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225000e030 con 0x555ae9fc1580 2023-07-14T13:19:02.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.342+0000 7f2243fff700 1 -- 172.21.15.17:0/3162788509 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f225000f040 con 0x555ae9fc1580 2023-07-14T13:19:02.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.342+0000 7f2243fff700 1 -- 172.21.15.17:0/3162788509 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250011390 con 0x555ae9fc1580 2023-07-14T13:19:02.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.343+0000 7f2273416b80 1 -- 172.21.15.17:0/3162788509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fc1580 msgr2=0x555ae9fbbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:02.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.343+0000 7f2273416b80 1 --2- 172.21.15.17:0/3162788509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fc1580 0x555ae9fbbc60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f225001acf0 tx=0x7f2250036000 comp rx=0 tx=0).stop 2023-07-14T13:19:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.351+0000 7f2273416b80 1 -- 172.21.15.17:0/3162788509 shutdown_connections 2023-07-14T13:19:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.351+0000 7f2273416b80 1 --2- 172.21.15.17:0/3162788509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fc1580 0x555ae9fbbc60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.351+0000 7f2273416b80 1 --2- 172.21.15.17:0/3162788509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fb6be0 0x555ae9fc1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.351+0000 7f2273416b80 1 --2- 172.21.15.17:0/3162788509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9e1d6b0 0x555ae9fc61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.351+0000 7f2273416b80 1 -- 172.21.15.17:0/3162788509 >> 172.21.15.17:0/3162788509 conn(0x555ae9fd7310 msgr2=0x555ae9fc5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.352+0000 7f2273416b80 1 -- 172.21.15.17:0/3162788509 shutdown_connections 2023-07-14T13:19:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.352+0000 7f2273416b80 1 -- 172.21.15.17:0/3162788509 wait complete. 2023-07-14T13:19:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.353+0000 7f2273416b80 1 -- start start 2023-07-14T13:19:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.353+0000 7f2273416b80 1 Processor -- start 2023-07-14T13:19:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.353+0000 7f2273416b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9e1d6b0 0x555ae9fcfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.353+0000 7f2273416b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fb6be0 0x555ae9fd0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.353+0000 7f2273416b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc1580 0x555aea027b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.353+0000 7f2273416b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aea0280d0 con 0x555ae9fc1580 2023-07-14T13:19:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.353+0000 7f2273416b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aea028240 con 0x555ae9e1d6b0 2023-07-14T13:19:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.354+0000 7f2273416b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aea028400 con 0x555ae9fb6be0 2023-07-14T13:19:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.354+0000 7f2273416b80 10 client.0 _ll_register_callbacks cb 0x7f2250009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.354+0000 7f225cf9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fb6be0 0x555ae9fd0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.354+0000 7f225cf9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fb6be0 0x555ae9fd0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52084/0 (socket says 172.21.15.17:52084) 2023-07-14T13:19:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.354+0000 7f225cf9a700 1 -- 172.21.15.17:0/2862276106 learned_addr learned my addr 172.21.15.17:0/2862276106 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.354+0000 7f225df9c700 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc1580 0x555aea027b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.355+0000 7f225cf9a700 1 -- 172.21.15.17:0/2862276106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9e1d6b0 msgr2=0x555ae9fcfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.355+0000 7f225cf9a700 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9e1d6b0 0x555ae9fcfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.355+0000 7f225cf9a700 1 -- 172.21.15.17:0/2862276106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc1580 msgr2=0x555aea027b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.355+0000 7f225cf9a700 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc1580 0x555aea027b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.355+0000 7f225cf9a700 1 -- 172.21.15.17:0/2862276106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ae9d29c00 con 0x555ae9fb6be0 2023-07-14T13:19:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.355+0000 7f225cf9a700 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fb6be0 0x555ae9fd0380 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f224800bcf0 tx=0x7f2248095d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5797c5c9fc16ead6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.355+0000 7f2240ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:19:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.356+0000 7f2240ff9700 1 -- 172.21.15.17:0/2862276106 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248099d40 con 0x555ae9fb6be0 2023-07-14T13:19:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.356+0000 7f2240ff9700 1 -- 172.21.15.17:0/2862276106 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f22480998e0 con 0x555ae9fb6be0 2023-07-14T13:19:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.356+0000 7f2273416b80 1 -- 172.21.15.17:0/2862276106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2254011e20 con 0x555ae9fb6be0 2023-07-14T13:19:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.356+0000 7f2240ff9700 1 -- 172.21.15.17:0/2862276106 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f224809d910 con 0x555ae9fb6be0 2023-07-14T13:19:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.356+0000 7f2273416b80 10 client.28621 fetch_fsmap learned FSMap version 51 2023-07-14T13:19:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.356+0000 7f2273416b80 1 -- 172.21.15.17:0/2862276106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x555ae9d671f0 con 0x555ae9fb6be0 2023-07-14T13:19:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.357+0000 7f2240ff9700 1 -- 172.21.15.17:0/2862276106 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2254011e20 con 0x555ae9fb6be0 2023-07-14T13:19:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.358+0000 7f2240ff9700 1 -- 172.21.15.17:0/2862276106 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 51) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f22480a18a0 con 0x555ae9fb6be0 2023-07-14T13:19:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.358+0000 7f2273416b80 10 client.28621 fetch_fsmap finished waiting for FSMap version 51 2023-07-14T13:19:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.358+0000 7f2273416b80 10 client.28621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:02.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.358+0000 7f2273416b80 20 client.28621 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.358+0000 7f2273416b80 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ae9fc72d0 0x555aea029ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.358+0000 7f2273416b80 4 client.28621 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:19:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.358+0000 7f2273416b80 1 -- 172.21.15.17:0/2862276106 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555ae9ecdff0 con 0x555ae9fc72d0 2023-07-14T13:19:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.358+0000 7f225d79b700 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ae9fc72d0 0x555aea029ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.359+0000 7f225d79b700 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ae9fc72d0 0x555aea029ba0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b82478bde456eaff server_cookie=bc44ba2597220f4b in_seq=0 out_seq=0 2023-07-14T13:19:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.359+0000 7f2240ff9700 10 client.28621 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.396+0000 7f2240ff9700 1 -- 172.21.15.17:0/2862276106 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555ae9ecdff0 con 0x555ae9fc72d0 2023-07-14T13:19:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.396+0000 7f2240ff9700 10 client.28621 handle_command_reply: tid=0 2023-07-14T13:19:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.396+0000 7f2273416b80 1 client.28621 shutdown 2023-07-14T13:19:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.397+0000 7f2273416b80 1 -- 172.21.15.17:0/2862276106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fb6be0 msgr2=0x555ae9fd0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.397+0000 7f2273416b80 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fb6be0 0x555ae9fd0380 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f224800bcf0 tx=0x7f2248095d40 comp rx=0 tx=0).stop 2023-07-14T13:19:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.402+0000 7f2273416b80 1 -- 172.21.15.17:0/2862276106 shutdown_connections 2023-07-14T13:19:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.402+0000 7f2273416b80 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555ae9fc72d0 0x555aea029ba0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.402+0000 7f2273416b80 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ae9fc1580 0x555aea027b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.402+0000 7f2273416b80 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555ae9e1d6b0 0x555ae9fcfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.402+0000 7f2273416b80 1 --2- 172.21.15.17:0/2862276106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ae9fb6be0 0x555ae9fd0380 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.402+0000 7f2273416b80 1 -- 172.21.15.17:0/2862276106 >> 172.21.15.17:0/2862276106 conn(0x555ae9fd7310 msgr2=0x555ae9fc7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.403+0000 7f2240ff9700 0 client.28621 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.404+0000 7f2273416b80 1 -- 172.21.15.17:0/2862276106 shutdown_connections 2023-07-14T13:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.404+0000 7f2273416b80 1 -- 172.21.15.17:0/2862276106 wait complete. 2023-07-14T13:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.405+0000 7f2273416b80 20 client.28621 trim_cache size 0 max 16384 2023-07-14T13:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:19:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:19:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:19:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.406+0000 7f225f9ff700 1 -- 172.21.15.17:0/3860774920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22440a1320 msgr2=0x7f22440a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.406+0000 7f225f9ff700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22440a1320 0x7f22440a37d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f225001c020 tx=0x7f2250011800 comp rx=0 tx=0).stop 2023-07-14T13:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.406+0000 7f225f9ff700 1 -- 172.21.15.17:0/3860774920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22580731c0 msgr2=0x7f2258108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.406+0000 7f225f9ff700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22580731c0 0x7f2258108e70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f224800b530 tx=0x7f224800b8f0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.406+0000 7f225f9ff700 1 -- 172.21.15.17:0/3860774920 shutdown_connections 2023-07-14T13:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.406+0000 7f225f9ff700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22440a1320 0x7f22440a37d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.406+0000 7f225f9ff700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2258110b20 0x7f22581093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.406+0000 7f225f9ff700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22580728b0 0x7f2258110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.406+0000 7f225f9ff700 1 --2- 172.21.15.17:0/3860774920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22580731c0 0x7f2258108e70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.406+0000 7f225f9ff700 1 -- 172.21.15.17:0/3860774920 >> 172.21.15.17:0/3860774920 conn(0x7f22580fb5f0 msgr2=0x7f22580fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.407+0000 7f225f9ff700 1 -- 172.21.15.17:0/3860774920 shutdown_connections 2023-07-14T13:19:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:02.407+0000 7f225f9ff700 1 -- 172.21.15.17:0/3860774920 wait complete. 2023-07-14T13:19:02.454 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 50.0 s, 408.5 tps, lat 402.726 ms stddev 807.418 2023-07-14T13:19:02.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:02 smithi135 ceph-mon[97338]: pgmap v608: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 9.6 MiB/s wr, 729 op/s 2023-07-14T13:19:02.750 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:02 smithi131 ceph-mon[96953]: pgmap v608: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 9.6 MiB/s wr, 729 op/s 2023-07-14T13:19:02.862 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:02 smithi017 ceph-mon[95536]: pgmap v608: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 9.6 MiB/s wr, 729 op/s 2023-07-14T13:19:05.363 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:05 smithi017 ceph-mon[95536]: osdmap e116: 12 total, 12 up, 12 in 2023-07-14T13:19:05.364 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:05 smithi017 ceph-mon[95536]: pgmap v610: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 11 MiB/s wr, 875 op/s 2023-07-14T13:19:05.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:05 smithi135 ceph-mon[97338]: osdmap e116: 12 total, 12 up, 12 in 2023-07-14T13:19:05.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:05 smithi135 ceph-mon[97338]: pgmap v610: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 11 MiB/s wr, 875 op/s 2023-07-14T13:19:05.499 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:05 smithi131 ceph-mon[96953]: osdmap e116: 12 total, 12 up, 12 in 2023-07-14T13:19:05.500 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:05 smithi131 ceph-mon[96953]: pgmap v610: 97 pgs: 97 active+clean; 16 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 11 MiB/s wr, 875 op/s 2023-07-14T13:19:07.453 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 55.0 s, 471.2 tps, lat 185.840 ms stddev 87.242 2023-07-14T13:19:07.611 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:07 smithi017 ceph-mon[95536]: pgmap v611: 97 pgs: 9 active+clean+snaptrim, 67 active+clean, 21 active+clean+snaptrim_wait; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 9.2 MiB/s wr, 771 op/s 2023-07-14T13:19:07.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:07 smithi135 ceph-mon[97338]: pgmap v611: 97 pgs: 9 active+clean+snaptrim, 67 active+clean, 21 active+clean+snaptrim_wait; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 9.2 MiB/s wr, 771 op/s 2023-07-14T13:19:07.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:07 smithi131 ceph-mon[96953]: pgmap v611: 97 pgs: 9 active+clean+snaptrim, 67 active+clean, 21 active+clean+snaptrim_wait; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 9.2 MiB/s wr, 771 op/s 2023-07-14T13:19:09.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:09 smithi017 ceph-mon[95536]: pgmap v612: 97 pgs: 9 active+clean+snaptrim, 67 active+clean, 21 active+clean+snaptrim_wait; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 9.2 MiB/s wr, 771 op/s 2023-07-14T13:19:09.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:09 smithi135 ceph-mon[97338]: pgmap v612: 97 pgs: 9 active+clean+snaptrim, 67 active+clean, 21 active+clean+snaptrim_wait; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 9.2 MiB/s wr, 771 op/s 2023-07-14T13:19:09.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:09 smithi131 ceph-mon[96953]: pgmap v612: 97 pgs: 9 active+clean+snaptrim, 67 active+clean, 21 active+clean+snaptrim_wait; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 9.2 MiB/s wr, 771 op/s 2023-07-14T13:19:10.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:10 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:19:10.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:10 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:19:10.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:10 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:19:10.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:10 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:19:10.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:10 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:19:10.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:10 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:19:10.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:10 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:19:10.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:10 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:19:10.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:10 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:19:11.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:11 smithi017 ceph-mon[95536]: pgmap v613: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-07-14T13:19:11.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:11 smithi017 ceph-mon[95536]: osdmap e117: 12 total, 12 up, 12 in 2023-07-14T13:19:11.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:11 smithi135 ceph-mon[97338]: pgmap v613: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-07-14T13:19:11.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:11 smithi135 ceph-mon[97338]: osdmap e117: 12 total, 12 up, 12 in 2023-07-14T13:19:11.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:11 smithi131 ceph-mon[96953]: pgmap v613: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-07-14T13:19:11.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:11 smithi131 ceph-mon[96953]: osdmap e117: 12 total, 12 up, 12 in 2023-07-14T13:19:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 60.0 s, 627.4 tps, lat 179.396 ms stddev 453.881 2023-07-14T13:19:13.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:13 smithi017 ceph-mon[95536]: pgmap v615: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 19 MiB/s wr, 1.41k op/s 2023-07-14T13:19:13.701 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:13 smithi135 ceph-mon[97338]: pgmap v615: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 19 MiB/s wr, 1.41k op/s 2023-07-14T13:19:13.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:13 smithi131 ceph-mon[96953]: pgmap v615: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 19 MiB/s wr, 1.41k op/s 2023-07-14T13:19:15.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:15 smithi017 ceph-mon[95536]: pgmap v616: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-07-14T13:19:15.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:15 smithi135 ceph-mon[97338]: pgmap v616: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-07-14T13:19:15.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:15 smithi131 ceph-mon[96953]: pgmap v616: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-07-14T13:19:17.451 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 65.0 s, 457.4 tps, lat 217.559 ms stddev 203.236 2023-07-14T13:19:17.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:17 smithi017 ceph-mon[95536]: pgmap v617: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-07-14T13:19:17.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:17 smithi135 ceph-mon[97338]: pgmap v617: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-07-14T13:19:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.691+0000 7f74a45ff700 1 -- 172.21.15.17:0/1207121968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c0fea30 msgr2=0x7f749c0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.691+0000 7f74a45ff700 1 --2- 172.21.15.17:0/1207121968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c0fea30 0x7f749c0feea0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f749001a9a0 tx=0x7f749001acb0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.691+0000 7f74a45ff700 1 -- 172.21.15.17:0/1207121968 shutdown_connections 2023-07-14T13:19:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.691+0000 7f74a45ff700 1 --2- 172.21.15.17:0/1207121968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c0ff3e0 0x7f749c10b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.691+0000 7f74a45ff700 1 --2- 172.21.15.17:0/1207121968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f749c104a30 0x7f749c104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.691+0000 7f74a45ff700 1 --2- 172.21.15.17:0/1207121968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c0fea30 0x7f749c0feea0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.691+0000 7f74a45ff700 1 -- 172.21.15.17:0/1207121968 >> 172.21.15.17:0/1207121968 conn(0x7f749c074760 msgr2=0x7f749c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.692+0000 7f74a45ff700 1 -- 172.21.15.17:0/1207121968 shutdown_connections 2023-07-14T13:19:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.692+0000 7f74a45ff700 1 -- 172.21.15.17:0/1207121968 wait complete. 2023-07-14T13:19:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.693+0000 7f74a45ff700 1 Processor -- start 2023-07-14T13:19:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.693+0000 7f74a45ff700 1 -- start start 2023-07-14T13:19:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.694+0000 7f74a45ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f749c0fea30 0x7f749c10b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.694+0000 7f74a45ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c0ff3e0 0x7f749c10b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.694+0000 7f74a45ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c104a30 0x7f749c108e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.694+0000 7f74a45ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c109510 con 0x7f749c104a30 2023-07-14T13:19:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.694+0000 7f74a45ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c109680 con 0x7f749c0fea30 2023-07-14T13:19:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.694+0000 7f74a45ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c109840 con 0x7f749c0ff3e0 2023-07-14T13:19:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.694+0000 7f74a1b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c0ff3e0 0x7f749c10b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.694+0000 7f74a1b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c0ff3e0 0x7f749c10b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59332/0 (socket says 172.21.15.17:59332) 2023-07-14T13:19:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.694+0000 7f74a239b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f749c0fea30 0x7f749c10b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.694+0000 7f74a1b9a700 1 -- 172.21.15.17:0/1629713938 learned_addr learned my addr 172.21.15.17:0/1629713938 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.695+0000 7f74a239b700 1 -- 172.21.15.17:0/1629713938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c0ff3e0 msgr2=0x7f749c10b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.695+0000 7f74a239b700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c0ff3e0 0x7f749c10b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.695+0000 7f74a239b700 1 -- 172.21.15.17:0/1629713938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c104a30 msgr2=0x7f749c108e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.695+0000 7f74a239b700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c104a30 0x7f749c108e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.695+0000 7f74a239b700 1 -- 172.21.15.17:0/1629713938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749001a600 con 0x7f749c0fea30 2023-07-14T13:19:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.695+0000 7f74a239b700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f749c0fea30 0x7f749c10b030 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f749400be50 tx=0x7f7494012330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.695+0000 7f749b7fe700 1 -- 172.21.15.17:0/1629713938 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749400e070 con 0x7f749c0fea30 2023-07-14T13:19:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.696+0000 7f749b7fe700 1 -- 172.21.15.17:0/1629713938 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7494003e90 con 0x7f749c0fea30 2023-07-14T13:19:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.696+0000 7f749b7fe700 1 -- 172.21.15.17:0/1629713938 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7494004280 con 0x7f749c0fea30 2023-07-14T13:19:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.696+0000 7f74a45ff700 1 -- 172.21.15.17:0/1629713938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c109b20 con 0x7f749c0fea30 2023-07-14T13:19:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.696+0000 7f74a45ff700 1 -- 172.21.15.17:0/1629713938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c106e00 con 0x7f749c0fea30 2023-07-14T13:19:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.701+0000 7f74b7f0eb80 1 Processor -- start 2023-07-14T13:19:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.701+0000 7f74b7f0eb80 1 -- start start 2023-07-14T13:19:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.702+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.702+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 0x561327bcc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.702+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327bcc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.702+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561327ad1c50 con 0x561327bd22d0 2023-07-14T13:19:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.702+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561327b249e0 con 0x561327bcc580 2023-07-14T13:19:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.702+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561327b1de70 con 0x561327a286b0 2023-07-14T13:19:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.702+0000 7f74a2b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.702+0000 7f74a2b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59342/0 (socket says 172.21.15.17:59342) 2023-07-14T13:19:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.702+0000 7f74a2b9c700 1 -- 172.21.15.17:0/537095940 learned_addr learned my addr 172.21.15.17:0/537095940 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.702+0000 7f74a1b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327bcc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.703+0000 7f74a2b9c700 1 -- 172.21.15.17:0/537095940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 msgr2=0x561327bcc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.703+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/537095940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327bcc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.703+0000 7f74a2b9c700 1 -- 172.21.15.17:0/537095940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 msgr2=0x561327bcc040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:19:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.703+0000 7f749b7fe700 1 -- 172.21.15.17:0/1629713938 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7494003a00 con 0x7f749c0fea30 2023-07-14T13:19:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.705+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/537095940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 0x561327bcc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.705+0000 7f74a2b9c700 1 -- 172.21.15.17:0/537095940 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56132794bd80 con 0x561327a286b0 2023-07-14T13:19:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.706+0000 7f749b7fe700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74840a13c0 0x7f74840a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.706+0000 7f749b7fe700 1 -- 172.21.15.17:0/1629713938 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f74940cccf0 con 0x7f749c0fea30 2023-07-14T13:19:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.708+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/537095940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd1d90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f748c009820 tx=0x7f748c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=685ec4a82a0883dd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.708+0000 7f7498bfe700 1 -- 172.21.15.17:0/537095940 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c011830 con 0x561327a286b0 2023-07-14T13:19:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.709+0000 7f7498bfe700 1 -- 172.21.15.17:0/537095940 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f748c011e20 con 0x561327a286b0 2023-07-14T13:19:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.709+0000 7f7498bfe700 1 -- 172.21.15.17:0/537095940 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c010db0 con 0x561327a286b0 2023-07-14T13:19:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.709+0000 7f74a239b700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74840a13c0 0x7f74840a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.710+0000 7f74a239b700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74840a13c0 0x7f74840a3870 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x561327bc8b40 tx=0x7f7494012b40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.711+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/537095940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 msgr2=0x561327bd1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.711+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/537095940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd1d90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f748c009820 tx=0x7f748c009b30 comp rx=0 tx=0).stop 2023-07-14T13:19:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.712+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/537095940 shutdown_connections 2023-07-14T13:19:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.712+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/537095940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327bcc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.712+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/537095940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd1d90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.712+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/537095940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 0x561327bcc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.712+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/537095940 >> 172.21.15.17:0/537095940 conn(0x561327bc1be0 msgr2=0x561327bc6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.712+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/537095940 shutdown_connections 2023-07-14T13:19:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.712+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/537095940 wait complete. 2023-07-14T13:19:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.713+0000 7f74b7f0eb80 1 -- start start 2023-07-14T13:19:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.713+0000 7f74b7f0eb80 1 Processor -- start 2023-07-14T13:19:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.714+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.714+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327bd5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.714+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 0x561327bd6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.714+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561327abda60 con 0x561327bd22d0 2023-07-14T13:19:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.714+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561327abd760 con 0x561327bcc580 2023-07-14T13:19:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.714+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613279a18c0 con 0x561327a286b0 2023-07-14T13:19:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.714+0000 7f74b7f0eb80 10 client.0 _ll_register_callbacks cb 0x561327abb700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.714+0000 7f74a2b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.714+0000 7f74a2b9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59358/0 (socket says 172.21.15.17:59358) 2023-07-14T13:19:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.714+0000 7f74a2b9c700 1 -- 172.21.15.17:0/461429227 learned_addr learned my addr 172.21.15.17:0/461429227 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.715+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 0x561327bd6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.749 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:17 smithi131 ceph-mon[96953]: pgmap v617: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-07-14T13:19:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.716+0000 7f74a2b9c700 1 -- 172.21.15.17:0/461429227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 msgr2=0x561327bd5e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:19:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.716+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327bd5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.716+0000 7f74a2b9c700 1 -- 172.21.15.17:0/461429227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 msgr2=0x561327bd6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.716+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 0x561327bd6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.716+0000 7f74a2b9c700 1 -- 172.21.15.17:0/461429227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c009450 con 0x561327a286b0 2023-07-14T13:19:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.717+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd58f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f748c010650 tx=0x7f748c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2a63cb0351e5f50 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:17.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.717+0000 7f7481ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:19:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.718+0000 7f7481ffb700 1 -- 172.21.15.17:0/461429227 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c011630 con 0x561327a286b0 2023-07-14T13:19:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.718+0000 7f7481ffb700 1 -- 172.21.15.17:0/461429227 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f748c011790 con 0x561327a286b0 2023-07-14T13:19:17.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.719+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/461429227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561327a77490 con 0x561327a286b0 2023-07-14T13:19:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.719+0000 7f7481ffb700 1 -- 172.21.15.17:0/461429227 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f748c011950 con 0x561327a286b0 2023-07-14T13:19:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.719+0000 7f74b7f0eb80 10 client.28633 fetch_fsmap learned FSMap version 51 2023-07-14T13:19:17.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.719+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/461429227 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x561327934c00 con 0x561327a286b0 2023-07-14T13:19:17.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.720+0000 7f7481ffb700 1 -- 172.21.15.17:0/461429227 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561327a77490 con 0x561327a286b0 2023-07-14T13:19:17.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.721+0000 7f7481ffb700 1 -- 172.21.15.17:0/461429227 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 51) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f748c01ca90 con 0x561327a286b0 2023-07-14T13:19:17.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.722+0000 7f74b7f0eb80 10 client.28633 fetch_fsmap finished waiting for FSMap version 51 2023-07-14T13:19:17.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.722+0000 7f74b7f0eb80 10 client.28633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:17.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.722+0000 7f74b7f0eb80 20 client.28633 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:17.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.722+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561327be5bc0 0x561327be7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.722+0000 7f74b7f0eb80 4 client.28633 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:19:17.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.722+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/461429227 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561327b16e50 con 0x561327be5bc0 2023-07-14T13:19:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.722+0000 7f74a1b9a700 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561327be5bc0 0x561327be7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.723+0000 7f74a1b9a700 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561327be5bc0 0x561327be7fd0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c77a9d5be7faedb3 server_cookie=e59db9b115a0fdd4 in_seq=0 out_seq=0 2023-07-14T13:19:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.723+0000 7f7481ffb700 10 client.28633 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:17.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.724+0000 7f7481ffb700 1 -- 172.21.15.17:0/461429227 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561327b16e50 con 0x561327be5bc0 2023-07-14T13:19:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.724+0000 7f7481ffb700 10 client.28633 handle_command_reply: tid=0 2023-07-14T13:19:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.724+0000 7f74b7f0eb80 1 client.28633 shutdown 2023-07-14T13:19:17.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.725+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/461429227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 msgr2=0x561327bd58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.725+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd58f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f748c010650 tx=0x7f748c008040 comp rx=0 tx=0).stop 2023-07-14T13:19:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.726+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/461429227 shutdown_connections 2023-07-14T13:19:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.726+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561327be5bc0 0x561327be7fd0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.726+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 0x561327bd6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.726+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327a286b0 0x561327bd58f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.726+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/461429227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327bd5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.726+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/461429227 >> 172.21.15.17:0/461429227 conn(0x561327bc1be0 msgr2=0x561327bc64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.726+0000 7f7481ffb700 0 client.28633 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:17.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.727+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/461429227 shutdown_connections 2023-07-14T13:19:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.727+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/461429227 wait complete. 2023-07-14T13:19:17.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.728+0000 7f74b7f0eb80 20 client.28633 trim_cache size 0 max 16384 2023-07-14T13:19:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.756+0000 7f74b7f0eb80 1 Processor -- start 2023-07-14T13:19:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.757+0000 7f74b7f0eb80 1 -- start start 2023-07-14T13:19:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.758+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327a286b0 0x561327bcc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.758+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bcc580 0x561327bd1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.758+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 0x561327bdcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.758+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561327bc8b70 con 0x561327bd22d0 2023-07-14T13:19:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.758+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561327be32c0 con 0x561327a286b0 2023-07-14T13:19:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.758+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561327bd6f00 con 0x561327bcc580 2023-07-14T13:19:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.758+0000 7f74a1b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bcc580 0x561327bd1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.758+0000 7f74a1b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bcc580 0x561327bd1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59362/0 (socket says 172.21.15.17:59362) 2023-07-14T13:19:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.758+0000 7f74a1b9a700 1 -- 172.21.15.17:0/1578653000 learned_addr learned my addr 172.21.15.17:0/1578653000 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.758+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/1578653000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327a286b0 0x561327bcc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.759+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/1578653000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 0x561327bdcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.759+0000 7f74a1b9a700 1 -- 172.21.15.17:0/1578653000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327a286b0 msgr2=0x561327bcc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.759+0000 7f74a1b9a700 1 --2- 172.21.15.17:0/1578653000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327a286b0 0x561327bcc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.759+0000 7f74a1b9a700 1 -- 172.21.15.17:0/1578653000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 msgr2=0x561327bdcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.759+0000 7f74a1b9a700 1 --2- 172.21.15.17:0/1578653000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 0x561327bdcc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.759+0000 7f74a1b9a700 1 -- 172.21.15.17:0/1578653000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613279721f0 con 0x561327bcc580 2023-07-14T13:19:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.759+0000 7f74a1b9a700 1 --2- 172.21.15.17:0/1578653000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bcc580 0x561327bd1340 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7490006010 tx=0x7f749001c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39c30ee80303c59c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.760+0000 7f74993ff700 1 -- 172.21.15.17:0/1578653000 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490037040 con 0x561327bcc580 2023-07-14T13:19:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.760+0000 7f74993ff700 1 -- 172.21.15.17:0/1578653000 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f749002c070 con 0x561327bcc580 2023-07-14T13:19:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.760+0000 7f74993ff700 1 -- 172.21.15.17:0/1578653000 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490005040 con 0x561327bcc580 2023-07-14T13:19:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.761+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/1578653000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bcc580 msgr2=0x561327bd1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.761+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/1578653000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bcc580 0x561327bd1340 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7490006010 tx=0x7f749001c290 comp rx=0 tx=0).stop 2023-07-14T13:19:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.762+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/1578653000 shutdown_connections 2023-07-14T13:19:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.762+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/1578653000 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327bd22d0 0x561327bdcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.762+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/1578653000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327a286b0 0x561327bcc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.762+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/1578653000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bcc580 0x561327bd1340 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.762+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/1578653000 >> 172.21.15.17:0/1578653000 conn(0x561327bc1be0 msgr2=0x561327bd2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:17.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.763+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/1578653000 shutdown_connections 2023-07-14T13:19:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.764+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/1578653000 wait complete. 2023-07-14T13:19:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.765+0000 7f74b7f0eb80 1 -- start start 2023-07-14T13:19:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.765+0000 7f74b7f0eb80 1 Processor -- start 2023-07-14T13:19:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.766+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327a286b0 0x561327bdcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.766+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327c319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.766+0000 7f74b7f0eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bd22d0 0x561327c31f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.766+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561327c35760 con 0x561327a286b0 2023-07-14T13:19:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.766+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561327c358d0 con 0x561327bcc580 2023-07-14T13:19:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.766+0000 7f74b7f0eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561327c324a0 con 0x561327bd22d0 2023-07-14T13:19:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.767+0000 7f74b7f0eb80 10 client.0 _ll_register_callbacks cb 0x7f748c010440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.767+0000 7f74a2b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327a286b0 0x561327bdcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.767+0000 7f74a1b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327c319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.767+0000 7f74a2b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327a286b0 0x561327bdcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57566/0 (socket says 172.21.15.17:57566) 2023-07-14T13:19:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.767+0000 7f74a2b9c700 1 -- 172.21.15.17:0/928442704 learned_addr learned my addr 172.21.15.17:0/928442704 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.767+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bd22d0 0x561327c31f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.768+0000 7f74a1b9a700 1 -- 172.21.15.17:0/928442704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bd22d0 msgr2=0x561327c31f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.768+0000 7f74a1b9a700 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bd22d0 0x561327c31f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.768+0000 7f74a1b9a700 1 -- 172.21.15.17:0/928442704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327a286b0 msgr2=0x561327bdcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.768+0000 7f74a1b9a700 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327a286b0 0x561327bdcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.768+0000 7f74a1b9a700 1 -- 172.21.15.17:0/928442704 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c10c160 con 0x561327bcc580 2023-07-14T13:19:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.769+0000 7f74a1b9a700 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327c319f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x561327bbeef0 tx=0x7f749001cbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d31d3256f75a620 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.769+0000 7f7481ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:19:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.769+0000 7f7481ffb700 1 -- 172.21.15.17:0/928442704 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490045030 con 0x561327bcc580 2023-07-14T13:19:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.769+0000 7f7481ffb700 1 -- 172.21.15.17:0/928442704 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7490046070 con 0x561327bcc580 2023-07-14T13:19:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.769+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/928442704 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f748c011e20 con 0x561327bcc580 2023-07-14T13:19:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.770+0000 7f7481ffb700 1 -- 172.21.15.17:0/928442704 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7490037040 con 0x561327bcc580 2023-07-14T13:19:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.770+0000 7f74b7f0eb80 10 client.28670 fetch_fsmap learned FSMap version 51 2023-07-14T13:19:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.770+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/928442704 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x56132794a250 con 0x561327bcc580 2023-07-14T13:19:17.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.771+0000 7f7481ffb700 1 -- 172.21.15.17:0/928442704 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f748c011e20 con 0x561327bcc580 2023-07-14T13:19:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.771+0000 7f7481ffb700 1 -- 172.21.15.17:0/928442704 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 51) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f74900051e0 con 0x561327bcc580 2023-07-14T13:19:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.771+0000 7f74b7f0eb80 10 client.28670 fetch_fsmap finished waiting for FSMap version 51 2023-07-14T13:19:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.771+0000 7f74b7f0eb80 10 client.28670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.771+0000 7f74b7f0eb80 20 client.28670 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.771+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561327c4b810 0x561327c4dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.771+0000 7f74b7f0eb80 4 client.28670 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:19:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.771+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/928442704 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561327ad8ff0 con 0x561327c4b810 2023-07-14T13:19:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.772+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561327c4b810 0x561327c4dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.773+0000 7f7481ffb700 10 client.28670 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.773+0000 7f74a2b9c700 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561327c4b810 0x561327c4dbf0 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eccb3f1a74241cb server_cookie=fa6e5285d8223fc0 in_seq=0 out_seq=0 2023-07-14T13:19:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.820+0000 7f7481ffb700 1 -- 172.21.15.17:0/928442704 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561327ad8ff0 con 0x561327c4b810 2023-07-14T13:19:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.820+0000 7f7481ffb700 10 client.28670 handle_command_reply: tid=0 2023-07-14T13:19:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.820+0000 7f74b7f0eb80 1 client.28670 shutdown 2023-07-14T13:19:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.821+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/928442704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 msgr2=0x561327c319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.821+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327c319f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x561327bbeef0 tx=0x7f749001cbb0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.821+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/928442704 shutdown_connections 2023-07-14T13:19:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.821+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561327c4b810 0x561327c4dbf0 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.821+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561327bd22d0 0x561327c31f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.821+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561327a286b0 0x561327bdcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.821+0000 7f74b7f0eb80 1 --2- 172.21.15.17:0/928442704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561327bcc580 0x561327c319f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.821+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/928442704 >> 172.21.15.17:0/928442704 conn(0x561327bc1be0 msgr2=0x561327bd11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.821+0000 7f7481ffb700 0 client.28670 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:17.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.822+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/928442704 shutdown_connections 2023-07-14T13:19:17.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.822+0000 7f74b7f0eb80 1 -- 172.21.15.17:0/928442704 wait complete. 2023-07-14T13:19:17.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.823+0000 7f74b7f0eb80 20 client.28670 trim_cache size 0 max 16384 2023-07-14T13:19:17.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:19:17.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:19:17.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:19:17.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:19:17.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.824+0000 7f74a45ff700 1 -- 172.21.15.17:0/1629713938 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74840a13c0 msgr2=0x7f74840a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:17.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.824+0000 7f74a45ff700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74840a13c0 0x7f74840a3870 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x561327bc8b40 tx=0x7f7494012b40 comp rx=0 tx=0).stop 2023-07-14T13:19:17.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.824+0000 7f74a45ff700 1 -- 172.21.15.17:0/1629713938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f749c0fea30 msgr2=0x7f749c10b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:17.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.824+0000 7f74a45ff700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f749c0fea30 0x7f749c10b030 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f749400be50 tx=0x7f7494012330 comp rx=0 tx=0).stop 2023-07-14T13:19:17.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.825+0000 7f74a45ff700 1 -- 172.21.15.17:0/1629713938 shutdown_connections 2023-07-14T13:19:17.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.825+0000 7f74a45ff700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74840a13c0 0x7f74840a3870 secure :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0x561327bc8b40 tx=0x7f7494012b40 comp rx=0 tx=0).stop 2023-07-14T13:19:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.825+0000 7f74a45ff700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c104a30 0x7f749c108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.825+0000 7f74a45ff700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f749c0fea30 0x7f749c10b030 secure :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f749400be50 tx=0x7f7494012330 comp rx=0 tx=0).stop 2023-07-14T13:19:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.825+0000 7f74a45ff700 1 --2- 172.21.15.17:0/1629713938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f749c0ff3e0 0x7f749c10b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:17.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.825+0000 7f74a45ff700 1 -- 172.21.15.17:0/1629713938 >> 172.21.15.17:0/1629713938 conn(0x7f749c074760 msgr2=0x7f749c0fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.827+0000 7f74a45ff700 1 -- 172.21.15.17:0/1629713938 shutdown_connections 2023-07-14T13:19:17.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:17.827+0000 7f74a45ff700 1 -- 172.21.15.17:0/1629713938 wait complete. 2023-07-14T13:19:19.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:19 smithi017 ceph-mon[95536]: pgmap v618: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-07-14T13:19:19.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:19 smithi135 ceph-mon[97338]: pgmap v618: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-07-14T13:19:19.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:19 smithi131 ceph-mon[96953]: pgmap v618: 97 pgs: 97 active+clean; 15 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-07-14T13:19:21.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:21 smithi017 ceph-mon[95536]: pgmap v619: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 17 MiB/s wr, 1.19k op/s 2023-07-14T13:19:21.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:21 smithi135 ceph-mon[97338]: pgmap v619: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 17 MiB/s wr, 1.19k op/s 2023-07-14T13:19:21.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:21 smithi131 ceph-mon[96953]: pgmap v619: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 17 MiB/s wr, 1.19k op/s 2023-07-14T13:19:22.451 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 70.0 s, 638.6 tps, lat 158.175 ms stddev 57.368 2023-07-14T13:19:23.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:23 smithi017 ceph-mon[95536]: pgmap v620: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-07-14T13:19:23.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:23 smithi135 ceph-mon[97338]: pgmap v620: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-07-14T13:19:23.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:23 smithi131 ceph-mon[96953]: pgmap v620: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-07-14T13:19:24.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:24 smithi135 ceph-mon[97338]: pgmap v621: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 14 MiB/s wr, 991 op/s 2023-07-14T13:19:24.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:24 smithi131 ceph-mon[96953]: pgmap v621: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 14 MiB/s wr, 991 op/s 2023-07-14T13:19:24.858 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:24 smithi017 ceph-mon[95536]: pgmap v621: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 14 MiB/s wr, 991 op/s 2023-07-14T13:19:27.450 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 75.0 s, 588.6 tps, lat 170.296 ms stddev 59.643 2023-07-14T13:19:27.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:27 smithi017 ceph-mon[95536]: pgmap v622: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 23 MiB/s wr, 1.60k op/s 2023-07-14T13:19:27.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:27 smithi135 ceph-mon[97338]: pgmap v622: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 23 MiB/s wr, 1.60k op/s 2023-07-14T13:19:27.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:27 smithi131 ceph-mon[96953]: pgmap v622: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 23 MiB/s wr, 1.60k op/s 2023-07-14T13:19:27.930 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:19:28.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.274+0000 7f267a3ff700 1 -- 172.21.15.17:0/2426810537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2674067da0 msgr2=0x7f267410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.274+0000 7f267a3ff700 1 --2- 172.21.15.17:0/2426810537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2674067da0 0x7f267410e570 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2664009990 tx=0x7f2664009ca0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.275+0000 7f267a3ff700 1 -- 172.21.15.17:0/2426810537 shutdown_connections 2023-07-14T13:19:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.275+0000 7f267a3ff700 1 --2- 172.21.15.17:0/2426810537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2674111000 0x7f26741133e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.275+0000 7f267a3ff700 1 --2- 172.21.15.17:0/2426810537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2674067da0 0x7f267410e570 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.275+0000 7f267a3ff700 1 --2- 172.21.15.17:0/2426810537 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2674108010 0x7f2674110ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.275+0000 7f267a3ff700 1 -- 172.21.15.17:0/2426810537 >> 172.21.15.17:0/2426810537 conn(0x7f267406c200 msgr2=0x7f267406c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.275+0000 7f267a3ff700 1 -- 172.21.15.17:0/2426810537 shutdown_connections 2023-07-14T13:19:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.275+0000 7f267a3ff700 1 -- 172.21.15.17:0/2426810537 wait complete. 2023-07-14T13:19:28.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.277+0000 7f267a3ff700 1 Processor -- start 2023-07-14T13:19:28.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.277+0000 7f267a3ff700 1 -- start start 2023-07-14T13:19:28.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.278+0000 7f267a3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2674067da0 0x7f26741a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.278+0000 7f267a3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2674108010 0x7f26741a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.278+0000 7f267a3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2674111000 0x7f26741a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.278+0000 7f267a3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26741a55d0 con 0x7f2674067da0 2023-07-14T13:19:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.278+0000 7f267a3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26741a5740 con 0x7f2674111000 2023-07-14T13:19:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.278+0000 7f267a3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26741a5900 con 0x7f2674108010 2023-07-14T13:19:28.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.279+0000 7f26737fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2674108010 0x7f26741a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.279+0000 7f26737fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2674108010 0x7f26741a0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50838/0 (socket says 172.21.15.17:50838) 2023-07-14T13:19:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.279+0000 7f26737fe700 1 -- 172.21.15.17:0/1489849672 learned_addr learned my addr 172.21.15.17:0/1489849672 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.279+0000 7f2673fff700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2674067da0 0x7f26741a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.279+0000 7f267899c700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2674111000 0x7f26741a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.279+0000 7f26737fe700 1 -- 172.21.15.17:0/1489849672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2674111000 msgr2=0x7f26741a4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.279+0000 7f26737fe700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2674111000 0x7f26741a4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.279+0000 7f26737fe700 1 -- 172.21.15.17:0/1489849672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2674067da0 msgr2=0x7f26741a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.279+0000 7f26737fe700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2674067da0 0x7f26741a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.279+0000 7f26737fe700 1 -- 172.21.15.17:0/1489849672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26640095f0 con 0x7f2674108010 2023-07-14T13:19:28.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.279+0000 7f267899c700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2674111000 0x7f26741a4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:19:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.280+0000 7f26737fe700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2674108010 0x7f26741a0b30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f266800b500 tx=0x7f266800b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.280+0000 7f26717fa700 1 -- 172.21.15.17:0/1489849672 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668011830 con 0x7f2674108010 2023-07-14T13:19:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.280+0000 7f26717fa700 1 -- 172.21.15.17:0/1489849672 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2668011e20 con 0x7f2674108010 2023-07-14T13:19:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.280+0000 7f26717fa700 1 -- 172.21.15.17:0/1489849672 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668010dd0 con 0x7f2674108010 2023-07-14T13:19:28.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.280+0000 7f267a3ff700 1 -- 172.21.15.17:0/1489849672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26741a5be0 con 0x7f2674108010 2023-07-14T13:19:28.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.280+0000 7f267a3ff700 1 -- 172.21.15.17:0/1489849672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2674108700 con 0x7f2674108010 2023-07-14T13:19:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.288+0000 7f268ddd2b80 1 Processor -- start 2023-07-14T13:19:28.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.289+0000 7f26717fa700 1 -- 172.21.15.17:0/1489849672 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2668011990 con 0x7f2674108010 2023-07-14T13:19:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.290+0000 7f268ddd2b80 1 -- start start 2023-07-14T13:19:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.290+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc80302d0 0x563cc80306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.290+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc8030be0 0x563cc803b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.290+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc803bad0 0x563cc803deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.290+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc7f36cb0 con 0x563cc80302d0 2023-07-14T13:19:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.290+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc7f89a40 con 0x563cc8030be0 2023-07-14T13:19:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.290+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc7f82ed0 con 0x563cc803bad0 2023-07-14T13:19:28.323 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.292+0000 7f2673fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc8030be0 0x563cc803b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.292+0000 7f2673fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc8030be0 0x563cc803b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35832/0 (socket says 172.21.15.17:35832) 2023-07-14T13:19:28.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.292+0000 7f2673fff700 1 -- 172.21.15.17:0/1530093796 learned_addr learned my addr 172.21.15.17:0/1530093796 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:28.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.292+0000 7f267899c700 1 --2- 172.21.15.17:0/1530093796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc80302d0 0x563cc80306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.324 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.292+0000 7f267899c700 1 -- 172.21.15.17:0/1530093796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc803bad0 msgr2=0x563cc803deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:28.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.293+0000 7f26717fa700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f265c0a1490 0x7f265c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.293+0000 7f26737fe700 1 --2- 172.21.15.17:0/1530093796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc803bad0 0x563cc803deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.325 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.293+0000 7f267899c700 1 --2- 172.21.15.17:0/1530093796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc803bad0 0x563cc803deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.293+0000 7f267899c700 1 -- 172.21.15.17:0/1530093796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc8030be0 msgr2=0x563cc803b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:28.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.293+0000 7f267899c700 1 --2- 172.21.15.17:0/1530093796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc8030be0 0x563cc803b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.293+0000 7f267899c700 1 -- 172.21.15.17:0/1530093796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cc7db0de0 con 0x563cc80302d0 2023-07-14T13:19:28.326 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.294+0000 7f26717fa700 1 -- 172.21.15.17:0/1489849672 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f26680cc590 con 0x7f2674108010 2023-07-14T13:19:28.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.295+0000 7f267899c700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f265c0a1490 0x7f265c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.295+0000 7f2673fff700 1 --2- 172.21.15.17:0/1530093796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc8030be0 0x563cc803b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:19:28.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.295+0000 7f267899c700 1 --2- 172.21.15.17:0/1530093796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc80302d0 0x563cc80306a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f267406dd20 tx=0x7f266c008800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552d699c5c2cfab5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:28.327 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.295+0000 7f265a7fc700 1 -- 172.21.15.17:0/1530093796 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c01a030 con 0x563cc80302d0 2023-07-14T13:19:28.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.296+0000 7f265a7fc700 1 -- 172.21.15.17:0/1530093796 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f266c010040 con 0x563cc80302d0 2023-07-14T13:19:28.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.296+0000 7f265a7fc700 1 -- 172.21.15.17:0/1530093796 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c020680 con 0x563cc80302d0 2023-07-14T13:19:28.328 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.297+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1530093796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc80302d0 msgr2=0x563cc80306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.297+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1530093796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc80302d0 0x563cc80306a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f267406dd20 tx=0x7f266c008800 comp rx=0 tx=0).stop 2023-07-14T13:19:28.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.297+0000 7f267899c700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f265c0a1490 0x7f265c0a3940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f266c01a000 tx=0x7f266c017000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:28.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.297+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1530093796 shutdown_connections 2023-07-14T13:19:28.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.297+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1530093796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc803bad0 0x563cc803deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.297+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1530093796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc80302d0 0x563cc80306a0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.329 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.297+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1530093796 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc8030be0 0x563cc803b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.297+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1530093796 >> 172.21.15.17:0/1530093796 conn(0x563cc8026da0 msgr2=0x563cc802c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:28.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.298+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1530093796 shutdown_connections 2023-07-14T13:19:28.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.298+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1530093796 wait complete. 2023-07-14T13:19:28.330 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.298+0000 7f268ddd2b80 1 -- start start 2023-07-14T13:19:28.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.299+0000 7f268ddd2b80 1 Processor -- start 2023-07-14T13:19:28.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.299+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc803b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.299+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc8038750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.331 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.299+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc8038e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.300+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc7f22ac0 con 0x563cc8030be0 2023-07-14T13:19:28.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.300+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc7f227c0 con 0x563cc803bad0 2023-07-14T13:19:28.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.300+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc7e06920 con 0x563cc80302d0 2023-07-14T13:19:28.332 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.300+0000 7f268ddd2b80 10 client.0 _ll_register_callbacks cb 0x563cc7f20760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:28.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.301+0000 7f267899c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc8038e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.301+0000 7f267899c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc8038e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35844/0 (socket says 172.21.15.17:35844) 2023-07-14T13:19:28.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.301+0000 7f267899c700 1 -- 172.21.15.17:0/1916268938 learned_addr learned my addr 172.21.15.17:0/1916268938 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:28.333 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.301+0000 7f26737fe700 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc8038750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.301+0000 7f267899c700 1 -- 172.21.15.17:0/1916268938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 msgr2=0x563cc803b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:28.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.301+0000 7f267899c700 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc803b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.301+0000 7f267899c700 1 -- 172.21.15.17:0/1916268938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 msgr2=0x563cc8038750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:28.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.301+0000 7f267899c700 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc8038750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.301+0000 7f267899c700 1 -- 172.21.15.17:0/1916268938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2674107b00 con 0x563cc803bad0 2023-07-14T13:19:28.334 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.302+0000 7f267899c700 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc8038e40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f266c01b040 tx=0x7f266c004d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f60ca9a79a9fec6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:28.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.302+0000 7f26537fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:19:28.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.303+0000 7f26537fe700 1 -- 172.21.15.17:0/1916268938 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c015730 con 0x563cc803bad0 2023-07-14T13:19:28.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.303+0000 7f26537fe700 1 -- 172.21.15.17:0/1916268938 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f266c01b070 con 0x563cc803bad0 2023-07-14T13:19:28.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.303+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1916268938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563cc7edc4f0 con 0x563cc803bad0 2023-07-14T13:19:28.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.303+0000 7f26537fe700 1 -- 172.21.15.17:0/1916268938 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f266c010eb0 con 0x563cc803bad0 2023-07-14T13:19:28.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.303+0000 7f268ddd2b80 10 client.28679 fetch_fsmap learned FSMap version 51 2023-07-14T13:19:28.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.303+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1916268938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f266c007d90 con 0x563cc803bad0 2023-07-14T13:19:28.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.304+0000 7f26537fe700 1 -- 172.21.15.17:0/1916268938 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563cc7edc4f0 con 0x563cc803bad0 2023-07-14T13:19:28.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.304+0000 7f26537fe700 1 -- 172.21.15.17:0/1916268938 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 51) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f266c005040 con 0x563cc803bad0 2023-07-14T13:19:28.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.305+0000 7f268ddd2b80 10 client.28679 fetch_fsmap finished waiting for FSMap version 51 2023-07-14T13:19:28.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.305+0000 7f268ddd2b80 10 client.28679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:28.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.305+0000 7f268ddd2b80 20 client.28679 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:28.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.305+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563cc805c2e0 0x563cc805e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.337 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.305+0000 7f268ddd2b80 4 client.28679 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:19:28.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.305+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1916268938 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563cc7f7beb0 con 0x563cc805c2e0 2023-07-14T13:19:28.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.306+0000 7f2673fff700 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563cc805c2e0 0x563cc805e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.338 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.306+0000 7f2673fff700 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563cc805c2e0 0x563cc805e6f0 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d67671cb9a7b73cc server_cookie=b5ec4c0b013a63fa in_seq=0 out_seq=0 2023-07-14T13:19:28.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.307+0000 7f26537fe700 10 client.28679 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:28.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.307+0000 7f26537fe700 1 -- 172.21.15.17:0/1916268938 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563cc7f7beb0 con 0x563cc805c2e0 2023-07-14T13:19:28.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.307+0000 7f26537fe700 10 client.28679 handle_command_reply: tid=0 2023-07-14T13:19:28.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.307+0000 7f268ddd2b80 1 client.28679 shutdown 2023-07-14T13:19:28.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.308+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1916268938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 msgr2=0x563cc8038e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.308+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc8038e40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f266c01b040 tx=0x7f266c004d70 comp rx=0 tx=0).stop 2023-07-14T13:19:28.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.308+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1916268938 shutdown_connections 2023-07-14T13:19:28.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.308+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563cc805c2e0 0x563cc805e6f0 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.308+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc8038e40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.308+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc803b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.308+0000 7f26537fe700 0 client.28679 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:28.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.308+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1916268938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc8038750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.341 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.308+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1916268938 >> 172.21.15.17:0/1916268938 conn(0x563cc8026da0 msgr2=0x563cc802c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:28.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.309+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1916268938 shutdown_connections 2023-07-14T13:19:28.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.309+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1916268938 wait complete. 2023-07-14T13:19:28.342 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.310+0000 7f268ddd2b80 20 client.28679 trim_cache size 0 max 16384 2023-07-14T13:19:28.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.336+0000 7f268ddd2b80 1 Processor -- start 2023-07-14T13:19:28.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.336+0000 7f268ddd2b80 1 -- start start 2023-07-14T13:19:28.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.336+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc80306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.336+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc80586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.336+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc803b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.336+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc805ed50 con 0x563cc8030be0 2023-07-14T13:19:28.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.336+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc80342e0 con 0x563cc803bad0 2023-07-14T13:19:28.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.336+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc8058c30 con 0x563cc80302d0 2023-07-14T13:19:28.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.337+0000 7f267899c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc803b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.337+0000 7f267899c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc803b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35850/0 (socket says 172.21.15.17:35850) 2023-07-14T13:19:28.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.337+0000 7f267899c700 1 -- 172.21.15.17:0/1671322231 learned_addr learned my addr 172.21.15.17:0/1671322231 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:28.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.337+0000 7f2673fff700 1 --2- 172.21.15.17:0/1671322231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc80306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.337+0000 7f267899c700 1 -- 172.21.15.17:0/1671322231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 msgr2=0x563cc80306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:28.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.337+0000 7f267899c700 1 --2- 172.21.15.17:0/1671322231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc80306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.370 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.337+0000 7f267899c700 1 -- 172.21.15.17:0/1671322231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 msgr2=0x563cc80586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:28.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.337+0000 7f267899c700 1 --2- 172.21.15.17:0/1671322231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc80586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.337+0000 7f267899c700 1 -- 172.21.15.17:0/1671322231 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cc7d99c60 con 0x563cc803bad0 2023-07-14T13:19:28.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.337+0000 7f2673fff700 1 --2- 172.21.15.17:0/1671322231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc80306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:19:28.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.338+0000 7f267899c700 1 --2- 172.21.15.17:0/1671322231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc803b070 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f266c008840 tx=0x7f266c007770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dd42d3db27e3b5c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:28.371 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.338+0000 7f265affd700 1 -- 172.21.15.17:0/1671322231 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c008e20 con 0x563cc803bad0 2023-07-14T13:19:28.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.338+0000 7f265affd700 1 -- 172.21.15.17:0/1671322231 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f266c015730 con 0x563cc803bad0 2023-07-14T13:19:28.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.338+0000 7f265affd700 1 -- 172.21.15.17:0/1671322231 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c020d10 con 0x563cc803bad0 2023-07-14T13:19:28.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.339+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1671322231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 msgr2=0x563cc803b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.372 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.339+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1671322231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc803b070 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f266c008840 tx=0x7f266c007770 comp rx=0 tx=0).stop 2023-07-14T13:19:28.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.341+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1671322231 shutdown_connections 2023-07-14T13:19:28.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.341+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1671322231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc803b070 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.341+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1671322231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc80306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.341+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1671322231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc80586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.373 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.341+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1671322231 >> 172.21.15.17:0/1671322231 conn(0x563cc8026da0 msgr2=0x563cc802ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:28.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.341+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1671322231 shutdown_connections 2023-07-14T13:19:28.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.341+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1671322231 wait complete. 2023-07-14T13:19:28.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.342+0000 7f268ddd2b80 1 -- start start 2023-07-14T13:19:28.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.342+0000 7f268ddd2b80 1 Processor -- start 2023-07-14T13:19:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.343+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc8041d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.343+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc8042280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.343+0000 7f268ddd2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc80a9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.343+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc80a96e0 con 0x563cc8030be0 2023-07-14T13:19:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.343+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc80a9850 con 0x563cc803bad0 2023-07-14T13:19:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.343+0000 7f268ddd2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc80a9a10 con 0x563cc80302d0 2023-07-14T13:19:28.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.343+0000 7f268ddd2b80 10 client.0 _ll_register_callbacks cb 0x7f2664009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.343+0000 7f2673fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc8041d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.343+0000 7f2673fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc8041d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50876/0 (socket says 172.21.15.17:50876) 2023-07-14T13:19:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.343+0000 7f2673fff700 1 -- 172.21.15.17:0/1148513358 learned_addr learned my addr 172.21.15.17:0/1148513358 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.344+0000 7f26737fe700 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc8042280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.377 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.344+0000 7f2673fff700 1 -- 172.21.15.17:0/1148513358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 msgr2=0x563cc80a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:28.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.344+0000 7f2673fff700 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc80a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.344+0000 7f2673fff700 1 -- 172.21.15.17:0/1148513358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 msgr2=0x563cc8042280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:28.378 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.344+0000 7f2673fff700 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc8042280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.344+0000 7f2673fff700 1 -- 172.21.15.17:0/1148513358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c007d90 con 0x563cc80302d0 2023-07-14T13:19:28.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.345+0000 7f26737fe700 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc8042280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:19:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.346+0000 7f2673fff700 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc8041d40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2664009990 tx=0x7f266400bbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d14cdce15542a4dd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.346+0000 7f26537fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:19:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.346+0000 7f26537fe700 1 -- 172.21.15.17:0/1148513358 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266401d050 con 0x563cc80302d0 2023-07-14T13:19:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.346+0000 7f26537fe700 1 -- 172.21.15.17:0/1148513358 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f266400be50 con 0x563cc80302d0 2023-07-14T13:19:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.347+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1148513358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f266c010040 con 0x563cc80302d0 2023-07-14T13:19:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.348+0000 7f26537fe700 1 -- 172.21.15.17:0/1148513358 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2664028130 con 0x563cc80302d0 2023-07-14T13:19:28.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.348+0000 7f268ddd2b80 10 client.28651 fetch_fsmap learned FSMap version 51 2023-07-14T13:19:28.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.348+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1148513358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x563cc7dd7250 con 0x563cc80302d0 2023-07-14T13:19:28.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.349+0000 7f26537fe700 1 -- 172.21.15.17:0/1148513358 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f266c010040 con 0x563cc80302d0 2023-07-14T13:19:28.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.349+0000 7f26537fe700 1 -- 172.21.15.17:0/1148513358 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 51) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2664004500 con 0x563cc80302d0 2023-07-14T13:19:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.351+0000 7f268ddd2b80 10 client.28651 fetch_fsmap finished waiting for FSMap version 51 2023-07-14T13:19:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.351+0000 7f268ddd2b80 10 client.28651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.351+0000 7f268ddd2b80 20 client.28651 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.351+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563cc80b12a0 0x563cc80b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.351+0000 7f268ddd2b80 4 client.28651 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:19:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.351+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1148513358 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563cc7f3e050 con 0x563cc80b12a0 2023-07-14T13:19:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.352+0000 7f26737fe700 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563cc80b12a0 0x563cc80b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.357+0000 7f26737fe700 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563cc80b12a0 0x563cc80b36b0 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bf630e3902f2c3e server_cookie=c095d33bd669d7bb in_seq=0 out_seq=0 2023-07-14T13:19:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.357+0000 7f26537fe700 10 client.28651 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.358+0000 7f26537fe700 1 -- 172.21.15.17:0/1148513358 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563cc7f3e050 con 0x563cc80b12a0 2023-07-14T13:19:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.358+0000 7f26537fe700 10 client.28651 handle_command_reply: tid=0 2023-07-14T13:19:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.358+0000 7f268ddd2b80 1 client.28651 shutdown 2023-07-14T13:19:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.359+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1148513358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 msgr2=0x563cc8041d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.359+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc8041d40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2664009990 tx=0x7f266400bbf0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.359+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1148513358 shutdown_connections 2023-07-14T13:19:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.359+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563cc80b12a0 0x563cc80b36b0 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.359+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563cc803bad0 0x563cc80a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.359+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563cc80302d0 0x563cc8041d40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.359+0000 7f268ddd2b80 1 --2- 172.21.15.17:0/1148513358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563cc8030be0 0x563cc8042280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.359+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1148513358 >> 172.21.15.17:0/1148513358 conn(0x563cc8026da0 msgr2=0x563cc8037fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.359+0000 7f26537fe700 0 client.28651 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.360+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1148513358 shutdown_connections 2023-07-14T13:19:28.393 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.360+0000 7f268ddd2b80 1 -- 172.21.15.17:0/1148513358 wait complete. 2023-07-14T13:19:28.398 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:19:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:19:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:19:28.399 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:19:28.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.364+0000 7f268ddd2b80 20 client.28651 trim_cache size 0 max 16384 2023-07-14T13:19:28.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.365+0000 7f267a3ff700 1 -- 172.21.15.17:0/1489849672 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f265c0a1490 msgr2=0x7f265c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.365+0000 7f267a3ff700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f265c0a1490 0x7f265c0a3940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f266c01a000 tx=0x7f266c017000 comp rx=0 tx=0).stop 2023-07-14T13:19:28.399 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.365+0000 7f267a3ff700 1 -- 172.21.15.17:0/1489849672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2674108010 msgr2=0x7f26741a0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.365+0000 7f267a3ff700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2674108010 0x7f26741a0b30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f266800b500 tx=0x7f266800b810 comp rx=0 tx=0).stop 2023-07-14T13:19:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.367+0000 7f267a3ff700 1 -- 172.21.15.17:0/1489849672 shutdown_connections 2023-07-14T13:19:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.367+0000 7f267a3ff700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f265c0a1490 0x7f265c0a3940 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.367+0000 7f267a3ff700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2674111000 0x7f26741a4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.367+0000 7f267a3ff700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2674067da0 0x7f26741a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.367+0000 7f267a3ff700 1 --2- 172.21.15.17:0/1489849672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2674108010 0x7f26741a0b30 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.400 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.367+0000 7f267a3ff700 1 -- 172.21.15.17:0/1489849672 >> 172.21.15.17:0/1489849672 conn(0x7f267406c200 msgr2=0x7f2674115090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:28.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.371+0000 7f267a3ff700 1 -- 172.21.15.17:0/1489849672 shutdown_connections 2023-07-14T13:19:28.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.372+0000 7f267a3ff700 1 -- 172.21.15.17:0/1489849672 wait complete. 2023-07-14T13:19:28.430 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:19:28.430 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:19:28.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.750+0000 7f63c59ff700 1 -- 172.21.15.17:0/1759207628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c00ff3a0 msgr2=0x7f63c0103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.750+0000 7f63c59ff700 1 --2- 172.21.15.17:0/1759207628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c00ff3a0 0x7f63c0103870 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009990 tx=0x7f63b4009ca0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.782 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.751+0000 7f63c59ff700 1 -- 172.21.15.17:0/1759207628 shutdown_connections 2023-07-14T13:19:28.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.751+0000 7f63c59ff700 1 --2- 172.21.15.17:0/1759207628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63c0103e40 0x7f63c01042e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.751+0000 7f63c59ff700 1 --2- 172.21.15.17:0/1759207628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63c00fea90 0x7f63c00fee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.751+0000 7f63c59ff700 1 --2- 172.21.15.17:0/1759207628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c00ff3a0 0x7f63c0103870 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.751+0000 7f63c59ff700 1 -- 172.21.15.17:0/1759207628 >> 172.21.15.17:0/1759207628 conn(0x7f63c00fa490 msgr2=0x7f63c00fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:28.783 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.751+0000 7f63c59ff700 1 -- 172.21.15.17:0/1759207628 shutdown_connections 2023-07-14T13:19:28.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.751+0000 7f63c59ff700 1 -- 172.21.15.17:0/1759207628 wait complete. 2023-07-14T13:19:28.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.752+0000 7f63c59ff700 1 Processor -- start 2023-07-14T13:19:28.784 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.753+0000 7f63c59ff700 1 -- start start 2023-07-14T13:19:28.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.753+0000 7f63c59ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63c00fea90 0x7f63c019c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.753+0000 7f63c59ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63c00ff3a0 0x7f63c019c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.753+0000 7f63c59ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c0103e40 0x7f63c01a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.785 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.753+0000 7f63c59ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c01a1100 con 0x7f63c00ff3a0 2023-07-14T13:19:28.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.753+0000 7f63c59ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c01a1270 con 0x7f63c0103e40 2023-07-14T13:19:28.786 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.753+0000 7f63c59ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c01a1430 con 0x7f63c00fea90 2023-07-14T13:19:28.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.754+0000 7f63be7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63c00ff3a0 0x7f63c019c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.787 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.754+0000 7f63be7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63c00ff3a0 0x7f63c019c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60986/0 (socket says 172.21.15.17:60986) 2023-07-14T13:19:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.754+0000 7f63be7fc700 1 -- 172.21.15.17:0/587686608 learned_addr learned my addr 172.21.15.17:0/587686608 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.754+0000 7f63beffd700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63c00fea90 0x7f63c019c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.755+0000 7f63be7fc700 1 -- 172.21.15.17:0/587686608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63c00fea90 msgr2=0x7f63c019c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.755+0000 7f63be7fc700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63c00fea90 0x7f63c019c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.755+0000 7f63be7fc700 1 -- 172.21.15.17:0/587686608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c0103e40 msgr2=0x7f63c01a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.755+0000 7f63be7fc700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c0103e40 0x7f63c01a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:28.788 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.755+0000 7f63be7fc700 1 -- 172.21.15.17:0/587686608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40095f0 con 0x7f63c00ff3a0 2023-07-14T13:19:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.755+0000 7f63be7fc700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63c00ff3a0 0x7f63c019c660 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f63b4000c00 tx=0x7f63b4009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.755+0000 7f63c49fd700 1 -- 172.21.15.17:0/587686608 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b401d070 con 0x7f63c00ff3a0 2023-07-14T13:19:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.755+0000 7f63c49fd700 1 -- 172.21.15.17:0/587686608 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63b4022470 con 0x7f63c00ff3a0 2023-07-14T13:19:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.755+0000 7f63c59ff700 1 -- 172.21.15.17:0/587686608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c01a16b0 con 0x7f63c00ff3a0 2023-07-14T13:19:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.755+0000 7f63c49fd700 1 -- 172.21.15.17:0/587686608 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4017650 con 0x7f63c00ff3a0 2023-07-14T13:19:28.789 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.756+0000 7f63c59ff700 1 -- 172.21.15.17:0/587686608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c01a8f50 con 0x7f63c00ff3a0 2023-07-14T13:19:28.790 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.757+0000 7f63c59ff700 1 -- 172.21.15.17:0/587686608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c0067300 con 0x7f63c00ff3a0 2023-07-14T13:19:28.791 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.760+0000 7f63c49fd700 1 -- 172.21.15.17:0/587686608 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f63b40225e0 con 0x7f63c00ff3a0 2023-07-14T13:19:28.793 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.762+0000 7f63c49fd700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63a80a1380 0x7f63a80a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:28.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.762+0000 7f63c49fd700 1 -- 172.21.15.17:0/587686608 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f63b40d53b0 con 0x7f63c00ff3a0 2023-07-14T13:19:28.794 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.763+0000 7f63beffd700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63a80a1380 0x7f63a80a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:28.795 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.764+0000 7f63beffd700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63a80a1380 0x7f63a80a3830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009380 tx=0x7f63b000b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:28.799 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:28.767+0000 7f63c49fd700 1 -- 172.21.15.17:0/587686608 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f63b4097360 con 0x7f63c00ff3a0 2023-07-14T13:19:29.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.271+0000 7f63c59ff700 1 -- 172.21.15.17:0/587686608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63c019d470 con 0x7f63c00ff3a0 2023-07-14T13:19:29.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.273+0000 7f63c49fd700 1 -- 172.21.15.17:0/587686608 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+10851 (secure 0 0 0) 0x7f63b409a980 con 0x7f63c00ff3a0 2023-07-14T13:19:29.305 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:19:29.305 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":51,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:19:00.254921+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:19:29.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.277+0000 7f63c59ff700 1 -- 172.21.15.17:0/587686608 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63a80a1380 msgr2=0x7f63a80a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:29.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.277+0000 7f63c59ff700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63a80a1380 0x7f63a80a3830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009380 tx=0x7f63b000b040 comp rx=0 tx=0).stop 2023-07-14T13:19:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.277+0000 7f63c59ff700 1 -- 172.21.15.17:0/587686608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63c00ff3a0 msgr2=0x7f63c019c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.277+0000 7f63c59ff700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63c00ff3a0 0x7f63c019c660 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f63b4000c00 tx=0x7f63b4009570 comp rx=0 tx=0).stop 2023-07-14T13:19:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.278+0000 7f63c59ff700 1 -- 172.21.15.17:0/587686608 shutdown_connections 2023-07-14T13:19:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.278+0000 7f63c59ff700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f63a80a1380 0x7f63a80a3830 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.278+0000 7f63c59ff700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63c0103e40 0x7f63c01a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:29.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.278+0000 7f63c59ff700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63c00fea90 0x7f63c019c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:29.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.278+0000 7f63c59ff700 1 --2- 172.21.15.17:0/587686608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63c00ff3a0 0x7f63c019c660 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:29.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.278+0000 7f63c59ff700 1 -- 172.21.15.17:0/587686608 >> 172.21.15.17:0/587686608 conn(0x7f63c00fa490 msgr2=0x7f63c0101920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:29.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.278+0000 7f63c59ff700 1 -- 172.21.15.17:0/587686608 shutdown_connections 2023-07-14T13:19:29.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:29.278+0000 7f63c59ff700 1 -- 172.21.15.17:0/587686608 wait complete. 2023-07-14T13:19:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 51 2023-07-14T13:19:29.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:19:29.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:29 smithi017 ceph-mon[95536]: pgmap v623: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-07-14T13:19:29.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:29 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:19:29.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:29 smithi135 ceph-mon[97338]: pgmap v623: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-07-14T13:19:29.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:29 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:19:29.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:29 smithi131 ceph-mon[96953]: pgmap v623: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 17 MiB/s wr, 1.17k op/s 2023-07-14T13:19:29.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:29 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:19:30.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.032+0000 7f8294dff700 1 -- 172.21.15.17:0/1529143670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829006c9a0 msgr2=0x7f829006ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.032+0000 7f8294dff700 1 --2- 172.21.15.17:0/1529143670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829006c9a0 0x7f829006ce10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8278009990 tx=0x7f8278009ca0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.032+0000 7f8294dff700 1 -- 172.21.15.17:0/1529143670 shutdown_connections 2023-07-14T13:19:30.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.032+0000 7f8294dff700 1 --2- 172.21.15.17:0/1529143670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f829006d3a0 0x7f829011b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.032+0000 7f8294dff700 1 --2- 172.21.15.17:0/1529143670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f829010e280 0x7f829010e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.032+0000 7f8294dff700 1 --2- 172.21.15.17:0/1529143670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829006c9a0 0x7f829006ce10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.032+0000 7f8294dff700 1 -- 172.21.15.17:0/1529143670 >> 172.21.15.17:0/1529143670 conn(0x7f829006bf70 msgr2=0x7f8290070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.033+0000 7f8294dff700 1 -- 172.21.15.17:0/1529143670 shutdown_connections 2023-07-14T13:19:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.033+0000 7f8294dff700 1 -- 172.21.15.17:0/1529143670 wait complete. 2023-07-14T13:19:30.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.034+0000 7f8294dff700 1 Processor -- start 2023-07-14T13:19:30.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.034+0000 7f8294dff700 1 -- start start 2023-07-14T13:19:30.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.035+0000 7f8294dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f829006c9a0 0x7f8290114d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.035+0000 7f8294dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f829006d3a0 0x7f8290115270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.035+0000 7f828e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f829006c9a0 0x7f8290114d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.035+0000 7f828e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f829006c9a0 0x7f8290114d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35878/0 (socket says 172.21.15.17:35878) 2023-07-14T13:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.036+0000 7f8285d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f829006d3a0 0x7f8290115270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.036+0000 7f8285d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f829006d3a0 0x7f8290115270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32782/0 (socket says 172.21.15.17:32782) 2023-07-14T13:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f8294dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829010e280 0x7f82901196d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f8294dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290119cd0 con 0x7f829006d3a0 2023-07-14T13:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f8294dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290119e40 con 0x7f829006c9a0 2023-07-14T13:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f8294dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829011a000 con 0x7f829010e280 2023-07-14T13:19:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f828e59c700 1 -- 172.21.15.17:0/4172206573 learned_addr learned my addr 172.21.15.17:0/4172206573 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f828ed9d700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829010e280 0x7f82901196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f828e59c700 1 -- 172.21.15.17:0/4172206573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829010e280 msgr2=0x7f82901196d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f828e59c700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829010e280 0x7f82901196d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f828e59c700 1 -- 172.21.15.17:0/4172206573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f829006d3a0 msgr2=0x7f8290115270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f828e59c700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f829006d3a0 0x7f8290115270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f828e59c700 1 -- 172.21.15.17:0/4172206573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780095f0 con 0x7f829006c9a0 2023-07-14T13:19:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.037+0000 7f828ed9d700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829010e280 0x7f82901196d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:19:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.038+0000 7f828e59c700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f829006c9a0 0x7f8290114d30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f82800060b0 tx=0x7f828000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.039+0000 7f8287fff700 1 -- 172.21.15.17:0/4172206573 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828000ddd0 con 0x7f829006c9a0 2023-07-14T13:19:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.039+0000 7f8287fff700 1 -- 172.21.15.17:0/4172206573 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f828000f040 con 0x7f829006c9a0 2023-07-14T13:19:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.039+0000 7f8287fff700 1 -- 172.21.15.17:0/4172206573 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280014600 con 0x7f829006c9a0 2023-07-14T13:19:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.039+0000 7f8294dff700 1 -- 172.21.15.17:0/4172206573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829011a2e0 con 0x7f829006c9a0 2023-07-14T13:19:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.039+0000 7f8294dff700 1 -- 172.21.15.17:0/4172206573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82901ba010 con 0x7f829006c9a0 2023-07-14T13:19:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.047+0000 7f82a8680b80 1 Processor -- start 2023-07-14T13:19:30.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.047+0000 7f82a8680b80 1 -- start start 2023-07-14T13:19:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.048+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d7716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.048+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d771be0 0x56186d77c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.048+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 0x56186d77eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.048+0000 7f82a8680b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d677cb0 con 0x56186d7712d0 2023-07-14T13:19:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.048+0000 7f82a8680b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d6caa40 con 0x56186d771be0 2023-07-14T13:19:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.048+0000 7f82a8680b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d6c3ed0 con 0x56186d77cad0 2023-07-14T13:19:30.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.049+0000 7f8285d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 0x56186d77eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.049+0000 7f8285d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 0x56186d77eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50902/0 (socket says 172.21.15.17:50902) 2023-07-14T13:19:30.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.049+0000 7f8285d9b700 1 -- 172.21.15.17:0/4078327776 learned_addr learned my addr 172.21.15.17:0/4078327776 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:30.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.049+0000 7f8285d9b700 1 -- 172.21.15.17:0/4078327776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d771be0 msgr2=0x56186d77c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.049+0000 7f8285d9b700 1 --2- 172.21.15.17:0/4078327776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d771be0 0x56186d77c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.049+0000 7f8285d9b700 1 -- 172.21.15.17:0/4078327776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 msgr2=0x56186d7716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.049+0000 7f8285d9b700 1 --2- 172.21.15.17:0/4078327776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d7716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.049+0000 7f8285d9b700 1 -- 172.21.15.17:0/4078327776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56186d4f1de0 con 0x56186d77cad0 2023-07-14T13:19:30.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.050+0000 7f8287fff700 1 -- 172.21.15.17:0/4172206573 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8280015400 con 0x7f829006c9a0 2023-07-14T13:19:30.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.050+0000 7f8285d9b700 1 --2- 172.21.15.17:0/4078327776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 0x56186d77eeb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8278009990 tx=0x7f8278009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa49f62eb25f0975 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.051+0000 7f8284d99700 1 -- 172.21.15.17:0/4078327776 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827801d070 con 0x56186d77cad0 2023-07-14T13:19:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.051+0000 7f8284d99700 1 -- 172.21.15.17:0/4078327776 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f827801e040 con 0x56186d77cad0 2023-07-14T13:19:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.051+0000 7f8284d99700 1 -- 172.21.15.17:0/4078327776 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278004760 con 0x56186d77cad0 2023-07-14T13:19:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.052+0000 7f82a8680b80 1 -- 172.21.15.17:0/4078327776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 msgr2=0x56186d77eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.052+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4078327776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 0x56186d77eeb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8278009990 tx=0x7f8278009ee0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.053+0000 7f82a8680b80 1 -- 172.21.15.17:0/4078327776 shutdown_connections 2023-07-14T13:19:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.053+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4078327776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 0x56186d77eeb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.053+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4078327776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d7716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.053+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4078327776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d771be0 0x56186d77c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.084 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.053+0000 7f82a8680b80 1 -- 172.21.15.17:0/4078327776 >> 172.21.15.17:0/4078327776 conn(0x56186d767da0 msgr2=0x56186d76d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.053+0000 7f82a8680b80 1 -- 172.21.15.17:0/4078327776 shutdown_connections 2023-07-14T13:19:30.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.053+0000 7f82a8680b80 1 -- 172.21.15.17:0/4078327776 wait complete. 2023-07-14T13:19:30.085 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.053+0000 7f8287fff700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f827c0a13a0 0x7f827c0a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.054+0000 7f8287fff700 1 -- 172.21.15.17:0/4172206573 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f82800cc550 con 0x7f829006c9a0 2023-07-14T13:19:30.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.054+0000 7f82a8680b80 1 -- start start 2023-07-14T13:19:30.086 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.054+0000 7f82a8680b80 1 Processor -- start 2023-07-14T13:19:30.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.055+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d7798b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.055+0000 7f8285d9b700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f827c0a13a0 0x7f827c0a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.055+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d771be0 0x56186d779df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.087 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.055+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 0x56186d77a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.055+0000 7f82a8680b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d663ac0 con 0x56186d7712d0 2023-07-14T13:19:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.055+0000 7f82a8680b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d6637c0 con 0x56186d771be0 2023-07-14T13:19:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.055+0000 7f82a8680b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d547920 con 0x56186d77cad0 2023-07-14T13:19:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.055+0000 7f82a8680b80 10 client.0 _ll_register_callbacks cb 0x56186d661760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.056+0000 7f8285d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d771be0 0x56186d779df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.088 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.056+0000 7f828e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d7798b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.056+0000 7f828e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d7798b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32806/0 (socket says 172.21.15.17:32806) 2023-07-14T13:19:30.089 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.056+0000 7f828e59c700 1 -- 172.21.15.17:0/4010111041 learned_addr learned my addr 172.21.15.17:0/4010111041 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.056+0000 7f828ed9d700 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 0x56186d77a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.056+0000 7f8285d9b700 1 -- 172.21.15.17:0/4010111041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 msgr2=0x56186d77a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.056+0000 7f8285d9b700 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 0x56186d77a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.090 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.056+0000 7f8285d9b700 1 -- 172.21.15.17:0/4010111041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 msgr2=0x56186d7798b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.056+0000 7f8285d9b700 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d7798b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.056+0000 7f8285d9b700 1 -- 172.21.15.17:0/4010111041 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829011bfa0 con 0x56186d771be0 2023-07-14T13:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.056+0000 7f828e59c700 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d7798b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.057+0000 7f8285d9b700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f827c0a13a0 0x7f827c0a3850 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f827800c010 tx=0x7f827800bcb0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.057+0000 7f8285d9b700 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d771be0 0x56186d779df0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8278005f50 tx=0x7f8278005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f79a32097a4d58b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.057+0000 7f8275ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:19:30.091 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.057+0000 7f8275ffb700 1 -- 172.21.15.17:0/4010111041 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827801d070 con 0x56186d771be0 2023-07-14T13:19:30.092 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.057+0000 7f8275ffb700 1 -- 172.21.15.17:0/4010111041 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8278004e50 con 0x56186d771be0 2023-07-14T13:19:30.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.057+0000 7f82a8680b80 1 -- 172.21.15.17:0/4010111041 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56186d61d4f0 con 0x56186d771be0 2023-07-14T13:19:30.094 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.058+0000 7f8275ffb700 1 -- 172.21.15.17:0/4010111041 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f827800bd50 con 0x56186d771be0 2023-07-14T13:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.058+0000 7f82a8680b80 10 client.28694 fetch_fsmap learned FSMap version 51 2023-07-14T13:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.058+0000 7f82a8680b80 1 -- 172.21.15.17:0/4010111041 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x56186d4dac60 con 0x56186d771be0 2023-07-14T13:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.058+0000 7f8275ffb700 1 -- 172.21.15.17:0/4010111041 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56186d61d4f0 con 0x56186d771be0 2023-07-14T13:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.058+0000 7f8275ffb700 1 -- 172.21.15.17:0/4010111041 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 51) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f827800f880 con 0x56186d771be0 2023-07-14T13:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.059+0000 7f82a8680b80 10 client.28694 fetch_fsmap finished waiting for FSMap version 51 2023-07-14T13:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.059+0000 7f82a8680b80 10 client.28694 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.059+0000 7f82a8680b80 20 client.28694 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.059+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56186d78bf90 0x56186d78e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.059+0000 7f82a8680b80 4 client.28694 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:19:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.059+0000 7f82a8680b80 1 -- 172.21.15.17:0/4010111041 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56186d6bceb0 con 0x56186d78bf90 2023-07-14T13:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.059+0000 7f828e59c700 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56186d78bf90 0x56186d78e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.060+0000 7f828e59c700 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56186d78bf90 0x56186d78e370 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5d07e05bec17549e server_cookie=add0579b5b10a4ee in_seq=0 out_seq=0 2023-07-14T13:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.060+0000 7f8275ffb700 10 client.28694 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.061+0000 7f8275ffb700 1 -- 172.21.15.17:0/4010111041 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56186d6bceb0 con 0x56186d78bf90 2023-07-14T13:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.061+0000 7f8275ffb700 10 client.28694 handle_command_reply: tid=0 2023-07-14T13:19:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.061+0000 7f82a8680b80 1 client.28694 shutdown 2023-07-14T13:19:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.061+0000 7f82a8680b80 1 -- 172.21.15.17:0/4010111041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d771be0 msgr2=0x56186d779df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.061+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d771be0 0x56186d779df0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8278005f50 tx=0x7f8278005fb0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.062+0000 7f82a8680b80 1 -- 172.21.15.17:0/4010111041 shutdown_connections 2023-07-14T13:19:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.062+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56186d78bf90 0x56186d78e370 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.062+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d77cad0 0x56186d77a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.062+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d7798b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.062+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4010111041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d771be0 0x56186d779df0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.062+0000 7f82a8680b80 1 -- 172.21.15.17:0/4010111041 >> 172.21.15.17:0/4010111041 conn(0x56186d767da0 msgr2=0x56186d76d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.062+0000 7f8275ffb700 0 client.28694 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:19:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.063+0000 7f82a8680b80 1 -- 172.21.15.17:0/4010111041 shutdown_connections 2023-07-14T13:19:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.063+0000 7f82a8680b80 1 -- 172.21.15.17:0/4010111041 wait complete. 2023-07-14T13:19:30.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.064+0000 7f82a8680b80 20 client.28694 trim_cache size 0 max 16384 2023-07-14T13:19:30.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.091+0000 7f82a8680b80 1 Processor -- start 2023-07-14T13:19:30.123 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.092+0000 7f82a8680b80 1 -- start start 2023-07-14T13:19:30.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.092+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d7712d0 0x56186d7834e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.092+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d771be0 0x56186d776b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.092+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d77cad0 0x56186d7770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.092+0000 7f82a8680b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d769ec0 con 0x56186d77cad0 2023-07-14T13:19:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.092+0000 7f82a8680b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d772160 con 0x56186d7712d0 2023-07-14T13:19:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.092+0000 7f82a8680b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d77c8f0 con 0x56186d771be0 2023-07-14T13:19:30.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.093+0000 7f8285d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d771be0 0x56186d776b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.093+0000 7f828e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d7712d0 0x56186d7834e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.093+0000 7f8285d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d771be0 0x56186d776b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50920/0 (socket says 172.21.15.17:50920) 2023-07-14T13:19:30.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.093+0000 7f8285d9b700 1 -- 172.21.15.17:0/274496781 learned_addr learned my addr 172.21.15.17:0/274496781 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:30.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.093+0000 7f828e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d7712d0 0x56186d7834e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35922/0 (socket says 172.21.15.17:35922) 2023-07-14T13:19:30.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.093+0000 7f828e59c700 1 -- 172.21.15.17:0/274496781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d771be0 msgr2=0x56186d776b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.093+0000 7f828e59c700 1 --2- 172.21.15.17:0/274496781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d771be0 0x56186d776b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.093+0000 7f828e59c700 1 -- 172.21.15.17:0/274496781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d77cad0 msgr2=0x56186d7770a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.093+0000 7f828e59c700 1 --2- 172.21.15.17:0/274496781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d77cad0 0x56186d7770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.094+0000 7f828e59c700 1 -- 172.21.15.17:0/274496781 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56186d518250 con 0x56186d7712d0 2023-07-14T13:19:30.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.094+0000 7f828e59c700 1 --2- 172.21.15.17:0/274496781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d7712d0 0x56186d7834e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8280099570 tx=0x7f828000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600c7c12a71aff9d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.094+0000 7f828559a700 1 -- 172.21.15.17:0/274496781 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82800995e0 con 0x56186d7712d0 2023-07-14T13:19:30.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.094+0000 7f828559a700 1 -- 172.21.15.17:0/274496781 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f828009d610 con 0x56186d7712d0 2023-07-14T13:19:30.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.094+0000 7f828559a700 1 -- 172.21.15.17:0/274496781 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280099840 con 0x56186d7712d0 2023-07-14T13:19:30.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.095+0000 7f82a8680b80 1 -- 172.21.15.17:0/274496781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d7712d0 msgr2=0x56186d7834e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.095+0000 7f82a8680b80 1 --2- 172.21.15.17:0/274496781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d7712d0 0x56186d7834e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8280099570 tx=0x7f828000b040 comp rx=0 tx=0).stop 2023-07-14T13:19:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.097+0000 7f82a8680b80 1 -- 172.21.15.17:0/274496781 shutdown_connections 2023-07-14T13:19:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.097+0000 7f82a8680b80 1 --2- 172.21.15.17:0/274496781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d77cad0 0x56186d7770a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.097+0000 7f82a8680b80 1 --2- 172.21.15.17:0/274496781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d7712d0 0x56186d7834e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.097+0000 7f82a8680b80 1 --2- 172.21.15.17:0/274496781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d771be0 0x56186d776b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.097+0000 7f82a8680b80 1 -- 172.21.15.17:0/274496781 >> 172.21.15.17:0/274496781 conn(0x56186d767da0 msgr2=0x56186d774bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.097+0000 7f82a8680b80 1 -- 172.21.15.17:0/274496781 shutdown_connections 2023-07-14T13:19:30.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.097+0000 7f82a8680b80 1 -- 172.21.15.17:0/274496781 wait complete. 2023-07-14T13:19:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.098+0000 7f82a8680b80 1 -- start start 2023-07-14T13:19:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.098+0000 7f82a8680b80 1 Processor -- start 2023-07-14T13:19:30.130 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.099+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d782f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.099+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d771be0 0x56186d783440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.099+0000 7f82a8680b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d77cad0 0x56186d7814d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.099+0000 7f82a8680b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d781ab0 con 0x56186d7712d0 2023-07-14T13:19:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.099+0000 7f82a8680b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d781c20 con 0x56186d77cad0 2023-07-14T13:19:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.099+0000 7f82a8680b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d781de0 con 0x56186d771be0 2023-07-14T13:19:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.099+0000 7f82a8680b80 10 client.0 _ll_register_callbacks cb 0x7f82780054f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:30.131 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.099+0000 7f828ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d77cad0 0x56186d7814d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.099+0000 7f828ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d77cad0 0x56186d7814d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35926/0 (socket says 172.21.15.17:35926) 2023-07-14T13:19:30.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.099+0000 7f828ed9d700 1 -- 172.21.15.17:0/4017894371 learned_addr learned my addr 172.21.15.17:0/4017894371 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:30.132 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.100+0000 7f8285d9b700 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d771be0 0x56186d783440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.100+0000 7f828ed9d700 1 -- 172.21.15.17:0/4017894371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d771be0 msgr2=0x56186d783440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.100+0000 7f828ed9d700 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d771be0 0x56186d783440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.100+0000 7f828ed9d700 1 -- 172.21.15.17:0/4017894371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 msgr2=0x56186d782f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.100+0000 7f828ed9d700 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d782f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.100+0000 7f828ed9d700 1 -- 172.21.15.17:0/4017894371 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82901ba010 con 0x56186d77cad0 2023-07-14T13:19:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.101+0000 7f828ed9d700 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d77cad0 0x56186d7814d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f828800dc30 tx=0x7f828800df40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=721e571e835f1ec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.101+0000 7f8275ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:19:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.101+0000 7f8275ffb700 1 -- 172.21.15.17:0/4017894371 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828800fdb0 con 0x56186d77cad0 2023-07-14T13:19:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.101+0000 7f8275ffb700 1 -- 172.21.15.17:0/4017894371 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8288015070 con 0x56186d77cad0 2023-07-14T13:19:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.101+0000 7f82a8680b80 1 -- 172.21.15.17:0/4017894371 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f827801e040 con 0x56186d77cad0 2023-07-14T13:19:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.102+0000 7f8275ffb700 1 -- 172.21.15.17:0/4017894371 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f828800d500 con 0x56186d77cad0 2023-07-14T13:19:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.102+0000 7f82a8680b80 10 client.28700 fetch_fsmap learned FSMap version 51 2023-07-14T13:19:30.135 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.102+0000 7f82a8680b80 1 -- 172.21.15.17:0/4017894371 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x56186d4f02b0 con 0x56186d77cad0 2023-07-14T13:19:30.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.105+0000 7f8275ffb700 1 -- 172.21.15.17:0/4017894371 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8288026020 con 0x56186d77cad0 2023-07-14T13:19:30.137 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.105+0000 7f8275ffb700 1 -- 172.21.15.17:0/4017894371 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 51) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f82880115a0 con 0x56186d77cad0 2023-07-14T13:19:30.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.106+0000 7f82a8680b80 10 client.28700 fetch_fsmap finished waiting for FSMap version 51 2023-07-14T13:19:30.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.106+0000 7f82a8680b80 10 client.28700 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:19:30.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.106+0000 7f82a8680b80 20 client.28700 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:30.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.107+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56186d7e0fa0 0x56186d7e33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.107+0000 7f82a8680b80 4 client.28700 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:19:30.138 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.107+0000 7f82a8680b80 1 -- 172.21.15.17:0/4017894371 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56186d67f050 con 0x56186d7e0fa0 2023-07-14T13:19:30.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.107+0000 7f828e59c700 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56186d7e0fa0 0x56186d7e33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.139 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.108+0000 7f828e59c700 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56186d7e0fa0 0x56186d7e33b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69897a66db61cb46 server_cookie=86d39c7bc240c40a in_seq=0 out_seq=0 2023-07-14T13:19:30.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.108+0000 7f8275ffb700 10 client.28700 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:19:30.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.108+0000 7f8275ffb700 1 -- 172.21.15.17:0/4017894371 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56186d67f050 con 0x56186d7e0fa0 2023-07-14T13:19:30.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.108+0000 7f8275ffb700 10 client.28700 handle_command_reply: tid=0 2023-07-14T13:19:30.140 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.108+0000 7f82a8680b80 1 client.28700 shutdown 2023-07-14T13:19:30.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.109+0000 7f82a8680b80 1 -- 172.21.15.17:0/4017894371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d77cad0 msgr2=0x56186d7814d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.109+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d77cad0 0x56186d7814d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f828800dc30 tx=0x7f828800df40 comp rx=0 tx=0).stop 2023-07-14T13:19:30.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.109+0000 7f82a8680b80 1 -- 172.21.15.17:0/4017894371 shutdown_connections 2023-07-14T13:19:30.141 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.109+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186d77cad0 0x56186d7814d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.109+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56186d7712d0 0x56186d782f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.109+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56186d7e0fa0 0x56186d7e33b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.109+0000 7f82a8680b80 1 --2- 172.21.15.17:0/4017894371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56186d771be0 0x56186d783440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.109+0000 7f82a8680b80 1 -- 172.21.15.17:0/4017894371 >> 172.21.15.17:0/4017894371 conn(0x56186d767da0 msgr2=0x56186d7732e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.109+0000 7f8275ffb700 0 client.28700 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:19:30.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.109+0000 7f82a8680b80 1 -- 172.21.15.17:0/4017894371 shutdown_connections 2023-07-14T13:19:30.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.109+0000 7f82a8680b80 1 -- 172.21.15.17:0/4017894371 wait complete. 2023-07-14T13:19:30.142 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.110+0000 7f82a8680b80 20 client.28700 trim_cache size 0 max 16384 2023-07-14T13:19:30.143 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:19:30.143 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.111+0000 7f8294dff700 1 -- 172.21.15.17:0/4172206573 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f827c0a13a0 msgr2=0x7f827c0a3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.111+0000 7f8294dff700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f827c0a13a0 0x7f827c0a3850 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f827800c010 tx=0x7f827800bcb0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.111+0000 7f8294dff700 1 -- 172.21.15.17:0/4172206573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f829006c9a0 msgr2=0x7f8290114d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.111+0000 7f8294dff700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f829006c9a0 0x7f8290114d30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f82800060b0 tx=0x7f828000d3b0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.111+0000 7f8294dff700 1 -- 172.21.15.17:0/4172206573 shutdown_connections 2023-07-14T13:19:30.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.111+0000 7f8294dff700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f827c0a13a0 0x7f827c0a3850 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.144 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.111+0000 7f8294dff700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f829010e280 0x7f82901196d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.111+0000 7f8294dff700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f829006c9a0 0x7f8290114d30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.111+0000 7f8294dff700 1 --2- 172.21.15.17:0/4172206573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f829006d3a0 0x7f8290115270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.111+0000 7f8294dff700 1 -- 172.21.15.17:0/4172206573 >> 172.21.15.17:0/4172206573 conn(0x7f829006bf70 msgr2=0x7f8290070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.112+0000 7f8294dff700 1 -- 172.21.15.17:0/4172206573 shutdown_connections 2023-07-14T13:19:30.145 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.112+0000 7f8294dff700 1 -- 172.21.15.17:0/4172206573 wait complete. 2023-07-14T13:19:30.175 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:19:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.518+0000 7f5956fff700 1 -- 172.21.15.17:0/180121100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5950100ca0 msgr2=0x7f5950101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.549 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.518+0000 7f5956fff700 1 --2- 172.21.15.17:0/180121100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5950100ca0 0x7f5950101070 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f5940009990 tx=0x7f5940009ca0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.518+0000 7f5956fff700 1 -- 172.21.15.17:0/180121100 shutdown_connections 2023-07-14T13:19:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.518+0000 7f5956fff700 1 --2- 172.21.15.17:0/180121100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f595010a070 0x7f595010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.518+0000 7f5956fff700 1 --2- 172.21.15.17:0/180121100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5950100ca0 0x7f5950101070 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.518+0000 7f5956fff700 1 --2- 172.21.15.17:0/180121100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59501015b0 0x7f5950109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.518+0000 7f5956fff700 1 -- 172.21.15.17:0/180121100 >> 172.21.15.17:0/180121100 conn(0x7f59500fa4b0 msgr2=0x7f59500fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.519+0000 7f5956fff700 1 -- 172.21.15.17:0/180121100 shutdown_connections 2023-07-14T13:19:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.520+0000 7f5956fff700 1 -- 172.21.15.17:0/180121100 wait complete. 2023-07-14T13:19:30.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.522+0000 7f5956fff700 1 Processor -- start 2023-07-14T13:19:30.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.524+0000 7f5956fff700 1 -- start start 2023-07-14T13:19:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.525+0000 7f5956fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5950100ca0 0x7f59501093a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.525+0000 7f5956fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59501015b0 0x7f59501098e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.525+0000 7f5956fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f595010a070 0x7f59500fe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.525+0000 7f5956fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59500fee20 con 0x7f59501015b0 2023-07-14T13:19:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.525+0000 7f5956fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59500fef90 con 0x7f5950100ca0 2023-07-14T13:19:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.525+0000 7f5956fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59500ff100 con 0x7f595010a070 2023-07-14T13:19:30.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.526+0000 7f5947fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59501015b0 0x7f59501098e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.526+0000 7f5947fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59501015b0 0x7f59501098e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32846/0 (socket says 172.21.15.17:32846) 2023-07-14T13:19:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.526+0000 7f5947fff700 1 -- 172.21.15.17:0/2622398138 learned_addr learned my addr 172.21.15.17:0/2622398138 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.526+0000 7f5954d9b700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5950100ca0 0x7f59501093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.526+0000 7f595559c700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f595010a070 0x7f59500fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.527+0000 7f5947fff700 1 -- 172.21.15.17:0/2622398138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f595010a070 msgr2=0x7f59500fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.527+0000 7f5947fff700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f595010a070 0x7f59500fe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.527+0000 7f5947fff700 1 -- 172.21.15.17:0/2622398138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5950100ca0 msgr2=0x7f59501093a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.527+0000 7f5947fff700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5950100ca0 0x7f59501093a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.527+0000 7f5947fff700 1 -- 172.21.15.17:0/2622398138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59400095f0 con 0x7f59501015b0 2023-07-14T13:19:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.528+0000 7f5947fff700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59501015b0 0x7f59501098e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f594c00e9a0 tx=0x7f594c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.528+0000 7f5945ffb700 1 -- 172.21.15.17:0/2622398138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c00ca10 con 0x7f59501015b0 2023-07-14T13:19:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.529+0000 7f5945ffb700 1 -- 172.21.15.17:0/2622398138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f594c010430 con 0x7f59501015b0 2023-07-14T13:19:30.560 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.529+0000 7f5945ffb700 1 -- 172.21.15.17:0/2622398138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c018680 con 0x7f59501015b0 2023-07-14T13:19:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.530+0000 7f5956fff700 1 -- 172.21.15.17:0/2622398138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59500ff3e0 con 0x7f59501015b0 2023-07-14T13:19:30.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.530+0000 7f5956fff700 1 -- 172.21.15.17:0/2622398138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59501b1a00 con 0x7f59501015b0 2023-07-14T13:19:30.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.537+0000 7f596a977b80 1 Processor -- start 2023-07-14T13:19:30.570 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.539+0000 7f596a977b80 1 -- start start 2023-07-14T13:19:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.540+0000 7f596a977b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a0b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.540+0000 7f596a977b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a16590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.540+0000 7f596a977b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a18eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.540+0000 7f596a977b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da8911cb0 con 0x555da8a0b2d0 2023-07-14T13:19:30.571 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.540+0000 7f596a977b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da8964a40 con 0x555da8a16ad0 2023-07-14T13:19:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.540+0000 7f596a977b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da895ded0 con 0x555da8a0bbe0 2023-07-14T13:19:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.541+0000 7f5954d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a16590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.541+0000 7f5954d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a16590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50940/0 (socket says 172.21.15.17:50940) 2023-07-14T13:19:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.541+0000 7f5954d9b700 1 -- 172.21.15.17:0/1317839814 learned_addr learned my addr 172.21.15.17:0/1317839814 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.542+0000 7f595559c700 1 --2- 172.21.15.17:0/1317839814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a0b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.542+0000 7f5954d9b700 1 -- 172.21.15.17:0/1317839814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 msgr2=0x555da8a18eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:19:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.542+0000 7f5954d9b700 1 --2- 172.21.15.17:0/1317839814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a18eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.542+0000 7f5954d9b700 1 -- 172.21.15.17:0/1317839814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 msgr2=0x555da8a0b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.542+0000 7f5954d9b700 1 --2- 172.21.15.17:0/1317839814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a0b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.542+0000 7f5954d9b700 1 -- 172.21.15.17:0/1317839814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555da878bde0 con 0x555da8a0bbe0 2023-07-14T13:19:30.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.542+0000 7f5945ffb700 1 -- 172.21.15.17:0/2622398138 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f594c0105a0 con 0x7f59501015b0 2023-07-14T13:19:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.543+0000 7f5954d9b700 1 --2- 172.21.15.17:0/1317839814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a16590 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5940005c70 tx=0x7f5940003fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56185e865b6b854a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.543+0000 7f5936ffd700 1 -- 172.21.15.17:0/1317839814 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594001d030 con 0x555da8a0bbe0 2023-07-14T13:19:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.543+0000 7f5936ffd700 1 -- 172.21.15.17:0/1317839814 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f594001e040 con 0x555da8a0bbe0 2023-07-14T13:19:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.543+0000 7f5936ffd700 1 -- 172.21.15.17:0/1317839814 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594000b970 con 0x555da8a0bbe0 2023-07-14T13:19:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.544+0000 7f596a977b80 1 -- 172.21.15.17:0/1317839814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 msgr2=0x555da8a16590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.544+0000 7f596a977b80 1 --2- 172.21.15.17:0/1317839814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a16590 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5940005c70 tx=0x7f5940003fc0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.545+0000 7f596a977b80 1 -- 172.21.15.17:0/1317839814 shutdown_connections 2023-07-14T13:19:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.545+0000 7f596a977b80 1 --2- 172.21.15.17:0/1317839814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a18eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.545+0000 7f596a977b80 1 --2- 172.21.15.17:0/1317839814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a0b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.545+0000 7f596a977b80 1 --2- 172.21.15.17:0/1317839814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a16590 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.545+0000 7f596a977b80 1 -- 172.21.15.17:0/1317839814 >> 172.21.15.17:0/1317839814 conn(0x555da8a01da0 msgr2=0x555da8a076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.545+0000 7f5945ffb700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f59380a14d0 0x7f59380a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.546+0000 7f5945ffb700 1 -- 172.21.15.17:0/2622398138 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f594c014070 con 0x7f59501015b0 2023-07-14T13:19:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.546+0000 7f5954d9b700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f59380a14d0 0x7f59380a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.546+0000 7f596a977b80 1 -- 172.21.15.17:0/1317839814 shutdown_connections 2023-07-14T13:19:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.547+0000 7f596a977b80 1 -- 172.21.15.17:0/1317839814 wait complete. 2023-07-14T13:19:30.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.547+0000 7f5954d9b700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f59380a14d0 0x7f59380a3980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5940003f60 tx=0x7f594001a040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.548+0000 7f596a977b80 1 -- start start 2023-07-14T13:19:30.580 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.548+0000 7f596a977b80 1 Processor -- start 2023-07-14T13:19:30.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.549+0000 7f596a977b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a16490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.549+0000 7f596a977b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a13780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.549+0000 7f596a977b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a13e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.581 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.549+0000 7f596a977b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da88fdac0 con 0x555da8a0b2d0 2023-07-14T13:19:30.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.549+0000 7f596a977b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da88fd7c0 con 0x555da8a16ad0 2023-07-14T13:19:30.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.549+0000 7f596a977b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da87e1920 con 0x555da8a0bbe0 2023-07-14T13:19:30.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.549+0000 7f596a977b80 10 client.0 _ll_register_callbacks cb 0x555da88fb760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:30.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.550+0000 7f595559c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a13e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.550+0000 7f595559c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a13e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35948/0 (socket says 172.21.15.17:35948) 2023-07-14T13:19:30.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.550+0000 7f595559c700 1 -- 172.21.15.17:0/3705012150 learned_addr learned my addr 172.21.15.17:0/3705012150 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:30.582 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.550+0000 7f5954d9b700 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a16490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.551+0000 7f5947fff700 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a13780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.551+0000 7f5954d9b700 1 -- 172.21.15.17:0/3705012150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 msgr2=0x555da8a13780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.551+0000 7f5954d9b700 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a13780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.551+0000 7f5954d9b700 1 -- 172.21.15.17:0/3705012150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 msgr2=0x555da8a13e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.583 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.551+0000 7f5954d9b700 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a13e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.584 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.551+0000 7f5954d9b700 1 -- 172.21.15.17:0/3705012150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595010d170 con 0x555da8a0b2d0 2023-07-14T13:19:30.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.554+0000 7f5954d9b700 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a16490 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f59400057d0 tx=0x7f5940003fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb970897031194da server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.585 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.554+0000 7f592ffff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:19:30.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.554+0000 7f592ffff700 1 -- 172.21.15.17:0/3705012150 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940038070 con 0x555da8a0b2d0 2023-07-14T13:19:30.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.555+0000 7f592ffff700 1 -- 172.21.15.17:0/3705012150 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5940003af0 con 0x555da8a0b2d0 2023-07-14T13:19:30.586 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.555+0000 7f596a977b80 1 -- 172.21.15.17:0/3705012150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555da88b74f0 con 0x555da8a0b2d0 2023-07-14T13:19:30.587 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.556+0000 7f592ffff700 1 -- 172.21.15.17:0/3705012150 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5940004500 con 0x555da8a0b2d0 2023-07-14T13:19:30.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.556+0000 7f596a977b80 10 client.18993 fetch_fsmap learned FSMap version 52 2023-07-14T13:19:30.588 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.556+0000 7f596a977b80 1 -- 172.21.15.17:0/3705012150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x555da8774c60 con 0x555da8a0b2d0 2023-07-14T13:19:30.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.558+0000 7f592ffff700 1 -- 172.21.15.17:0/3705012150 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555da88b74f0 con 0x555da8a0b2d0 2023-07-14T13:19:30.589 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.558+0000 7f592ffff700 1 -- 172.21.15.17:0/3705012150 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f594000f5f0 con 0x555da8a0b2d0 2023-07-14T13:19:30.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.559+0000 7f596a977b80 10 client.18993 fetch_fsmap finished waiting for FSMap version 52 2023-07-14T13:19:30.590 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.559+0000 7f596a977b80 10 client.18993 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:19:30.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.559+0000 7f596a977b80 20 client.18993 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:30.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.559+0000 7f596a977b80 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x555da8a25f60 0x555da8a28340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.559+0000 7f596a977b80 4 client.18993 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:19:30.591 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.559+0000 7f596a977b80 1 -- 172.21.15.17:0/3705012150 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555da8956eb0 con 0x555da8a25f60 2023-07-14T13:19:30.592 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.560+0000 7f5947fff700 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x555da8a25f60 0x555da8a28340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.562+0000 7f5947fff700 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x555da8a25f60 0x555da8a28340 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=543ced5f8715d91c server_cookie=a84a754b3f8e027e in_seq=0 out_seq=0 2023-07-14T13:19:30.593 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.562+0000 7f592ffff700 10 client.18993 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:19:30.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.563+0000 7f592ffff700 1 -- 172.21.15.17:0/3705012150 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555da8956eb0 con 0x555da8a25f60 2023-07-14T13:19:30.594 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.563+0000 7f592ffff700 10 client.18993 handle_command_reply: tid=0 2023-07-14T13:19:30.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.563+0000 7f596a977b80 1 client.18993 shutdown 2023-07-14T13:19:30.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.564+0000 7f596a977b80 1 -- 172.21.15.17:0/3705012150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 msgr2=0x555da8a16490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.595 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.564+0000 7f596a977b80 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a16490 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f59400057d0 tx=0x7f5940003fc0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.564+0000 7f596a977b80 1 -- 172.21.15.17:0/3705012150 shutdown_connections 2023-07-14T13:19:30.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.564+0000 7f596a977b80 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x555da8a25f60 0x555da8a28340 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.596 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.564+0000 7f596a977b80 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a13e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.564+0000 7f596a977b80 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a16490 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.564+0000 7f596a977b80 1 --2- 172.21.15.17:0/3705012150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a13780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.564+0000 7f596a977b80 1 -- 172.21.15.17:0/3705012150 >> 172.21.15.17:0/3705012150 conn(0x555da8a01da0 msgr2=0x555da8a07230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.564+0000 7f592ffff700 0 client.18993 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:19:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.565+0000 7f596a977b80 1 -- 172.21.15.17:0/3705012150 shutdown_connections 2023-07-14T13:19:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.565+0000 7f596a977b80 1 -- 172.21.15.17:0/3705012150 wait complete. 2023-07-14T13:19:30.597 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.565+0000 7f596a977b80 20 client.18993 trim_cache size 0 max 16384 2023-07-14T13:19:30.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:30 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/587686608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:19:30.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.587+0000 7f596a977b80 1 Processor -- start 2023-07-14T13:19:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.587+0000 7f596a977b80 1 -- start start 2023-07-14T13:19:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.588+0000 7f596a977b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a0b2d0 0x555da8a16030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.588+0000 7f596a977b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0bbe0 0x555da8a0eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.588+0000 7f596a977b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a16ad0 0x555da8a0efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.588+0000 7f596a977b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da8a01970 con 0x555da8a0bbe0 2023-07-14T13:19:30.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.588+0000 7f596a977b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da8a0cdd0 con 0x555da8a0b2d0 2023-07-14T13:19:30.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.588+0000 7f596a977b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da8a0f610 con 0x555da8a16ad0 2023-07-14T13:19:30.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.588+0000 7f5947fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0bbe0 0x555da8a0eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.588+0000 7f595559c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a16ad0 0x555da8a0efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.588+0000 7f595559c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a16ad0 0x555da8a0efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50948/0 (socket says 172.21.15.17:50948) 2023-07-14T13:19:30.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.588+0000 7f595559c700 1 -- 172.21.15.17:0/151283385 learned_addr learned my addr 172.21.15.17:0/151283385 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:30.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.588+0000 7f5954d9b700 1 --2- 172.21.15.17:0/151283385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a0b2d0 0x555da8a16030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.589+0000 7f5954d9b700 1 -- 172.21.15.17:0/151283385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a16ad0 msgr2=0x555da8a0efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.589+0000 7f5954d9b700 1 --2- 172.21.15.17:0/151283385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a16ad0 0x555da8a0efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.589+0000 7f5954d9b700 1 -- 172.21.15.17:0/151283385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0bbe0 msgr2=0x555da8a0eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.589+0000 7f5954d9b700 1 --2- 172.21.15.17:0/151283385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0bbe0 0x555da8a0eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.589+0000 7f5954d9b700 1 -- 172.21.15.17:0/151283385 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555da87b2250 con 0x555da8a0b2d0 2023-07-14T13:19:30.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.589+0000 7f5954d9b700 1 --2- 172.21.15.17:0/151283385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a0b2d0 0x555da8a16030 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f594000b2e0 tx=0x7f5940005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f23563f7591222 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.590+0000 7f59377fe700 1 -- 172.21.15.17:0/151283385 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5940038070 con 0x555da8a0b2d0 2023-07-14T13:19:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.590+0000 7f59377fe700 1 -- 172.21.15.17:0/151283385 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5940003af0 con 0x555da8a0b2d0 2023-07-14T13:19:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.590+0000 7f59377fe700 1 -- 172.21.15.17:0/151283385 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594000f770 con 0x555da8a0b2d0 2023-07-14T13:19:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.591+0000 7f596a977b80 1 -- 172.21.15.17:0/151283385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a0b2d0 msgr2=0x555da8a16030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.591+0000 7f596a977b80 1 --2- 172.21.15.17:0/151283385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a0b2d0 0x555da8a16030 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f594000b2e0 tx=0x7f5940005760 comp rx=0 tx=0).stop 2023-07-14T13:19:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.591+0000 7f596a977b80 1 -- 172.21.15.17:0/151283385 shutdown_connections 2023-07-14T13:19:30.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.591+0000 7f596a977b80 1 --2- 172.21.15.17:0/151283385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a16ad0 0x555da8a0efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.591+0000 7f596a977b80 1 --2- 172.21.15.17:0/151283385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a0b2d0 0x555da8a16030 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.591+0000 7f596a977b80 1 --2- 172.21.15.17:0/151283385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0bbe0 0x555da8a0eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.591+0000 7f596a977b80 1 -- 172.21.15.17:0/151283385 >> 172.21.15.17:0/151283385 conn(0x555da8a01da0 msgr2=0x555da8a22720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.592+0000 7f596a977b80 1 -- 172.21.15.17:0/151283385 shutdown_connections 2023-07-14T13:19:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.592+0000 7f596a977b80 1 -- 172.21.15.17:0/151283385 wait complete. 2023-07-14T13:19:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.592+0000 7f596a977b80 1 -- start start 2023-07-14T13:19:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.592+0000 7f596a977b80 1 Processor -- start 2023-07-14T13:19:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f596a977b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a1b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f596a977b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a1ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f596a977b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a1bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f596a977b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da8a1db10 con 0x555da8a0b2d0 2023-07-14T13:19:30.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f596a977b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da8a78e20 con 0x555da8a16ad0 2023-07-14T13:19:30.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f596a977b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555da8a78fe0 con 0x555da8a0bbe0 2023-07-14T13:19:30.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f596a977b80 10 client.0 _ll_register_callbacks cb 0x7f5940026070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:30.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f595559c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a1bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f5947fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a1ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f5954d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a1b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f5947fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a1ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50950/0 (socket says 172.21.15.17:50950) 2023-07-14T13:19:30.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.593+0000 7f5947fff700 1 -- 172.21.15.17:0/91936075 learned_addr learned my addr 172.21.15.17:0/91936075 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:30.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.594+0000 7f5947fff700 1 -- 172.21.15.17:0/91936075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 msgr2=0x555da8a1bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.594+0000 7f5947fff700 1 --2- 172.21.15.17:0/91936075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a1bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.594+0000 7f5947fff700 1 -- 172.21.15.17:0/91936075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 msgr2=0x555da8a1b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.594+0000 7f5947fff700 1 --2- 172.21.15.17:0/91936075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a1b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.594+0000 7f5947fff700 1 -- 172.21.15.17:0/91936075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555da8774c60 con 0x555da8a0bbe0 2023-07-14T13:19:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.594+0000 7f5947fff700 1 --2- 172.21.15.17:0/91936075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a1ba10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f594c00e970 tx=0x7f594c009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94c81475644feb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.594+0000 7f592ffff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:19:30.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.595+0000 7f592ffff700 1 -- 172.21.15.17:0/91936075 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0cabc0 con 0x555da8a0bbe0 2023-07-14T13:19:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.595+0000 7f592ffff700 1 -- 172.21.15.17:0/91936075 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f594c09e0f0 con 0x555da8a0bbe0 2023-07-14T13:19:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.595+0000 7f596a977b80 1 -- 172.21.15.17:0/91936075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f594001e040 con 0x555da8a0bbe0 2023-07-14T13:19:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.595+0000 7f592ffff700 1 -- 172.21.15.17:0/91936075 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f594c0a2510 con 0x555da8a0bbe0 2023-07-14T13:19:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.595+0000 7f596a977b80 10 client.28684 fetch_fsmap learned FSMap version 52 2023-07-14T13:19:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.595+0000 7f596a977b80 1 -- 172.21.15.17:0/91936075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x555da878a2b0 con 0x555da8a0bbe0 2023-07-14T13:19:30.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.596+0000 7f592ffff700 1 -- 172.21.15.17:0/91936075 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f594001e040 con 0x555da8a0bbe0 2023-07-14T13:19:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.596+0000 7f592ffff700 1 -- 172.21.15.17:0/91936075 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f594c0995b0 con 0x555da8a0bbe0 2023-07-14T13:19:30.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.596+0000 7f596a977b80 10 client.28684 fetch_fsmap finished waiting for FSMap version 52 2023-07-14T13:19:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.596+0000 7f596a977b80 10 client.28684 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:19:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.596+0000 7f596a977b80 20 client.28684 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.596+0000 7f596a977b80 1 --2- 172.21.15.17:0/91936075 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x555da8a7a730 0x555da8a7cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.596+0000 7f596a977b80 4 client.28684 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:19:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.596+0000 7f596a977b80 1 -- 172.21.15.17:0/91936075 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555da8919050 con 0x555da8a7a730 2023-07-14T13:19:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.597+0000 7f5954d9b700 1 --2- 172.21.15.17:0/91936075 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x555da8a7a730 0x555da8a7cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.598+0000 7f5954d9b700 1 --2- 172.21.15.17:0/91936075 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x555da8a7a730 0x555da8a7cb40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f19f6d8fed2a259b server_cookie=a890d9a359400c36 in_seq=0 out_seq=0 2023-07-14T13:19:30.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.598+0000 7f592ffff700 10 client.28684 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:19:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.598+0000 7f592ffff700 1 -- 172.21.15.17:0/91936075 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555da8919050 con 0x555da8a7a730 2023-07-14T13:19:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.598+0000 7f592ffff700 10 client.28684 handle_command_reply: tid=0 2023-07-14T13:19:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 1 client.28684 shutdown 2023-07-14T13:19:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 1 -- 172.21.15.17:0/91936075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 msgr2=0x555da8a1ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 1 --2- 172.21.15.17:0/91936075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a1ba10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f594c00e970 tx=0x7f594c009640 comp rx=0 tx=0).stop 2023-07-14T13:19:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 1 -- 172.21.15.17:0/91936075 shutdown_connections 2023-07-14T13:19:30.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 1 --2- 172.21.15.17:0/91936075 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x555da8a7a730 0x555da8a7cb40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 1 --2- 172.21.15.17:0/91936075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555da8a16ad0 0x555da8a1bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 1 --2- 172.21.15.17:0/91936075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555da8a0b2d0 0x555da8a1b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 1 --2- 172.21.15.17:0/91936075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555da8a0bbe0 0x555da8a1ba10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 1 -- 172.21.15.17:0/91936075 >> 172.21.15.17:0/91936075 conn(0x555da8a01da0 msgr2=0x555da8a0eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f592ffff700 0 client.28684 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:19:30.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 1 -- 172.21.15.17:0/91936075 shutdown_connections 2023-07-14T13:19:30.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 1 -- 172.21.15.17:0/91936075 wait complete. 2023-07-14T13:19:30.634 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.599+0000 7f596a977b80 20 client.28684 trim_cache size 0 max 16384 2023-07-14T13:19:30.634 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:19:30.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.600+0000 7f5956fff700 1 -- 172.21.15.17:0/2622398138 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f59380a14d0 msgr2=0x7f59380a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.600+0000 7f5956fff700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f59380a14d0 0x7f59380a3980 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5940003f60 tx=0x7f594001a040 comp rx=0 tx=0).stop 2023-07-14T13:19:30.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.600+0000 7f5956fff700 1 -- 172.21.15.17:0/2622398138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59501015b0 msgr2=0x7f59501098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:30.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.600+0000 7f5956fff700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59501015b0 0x7f59501098e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f594c00e9a0 tx=0x7f594c00ecb0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.601+0000 7f5956fff700 1 -- 172.21.15.17:0/2622398138 shutdown_connections 2023-07-14T13:19:30.635 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.601+0000 7f5956fff700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f59380a14d0 0x7f59380a3980 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.601+0000 7f5956fff700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f595010a070 0x7f59500fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.601+0000 7f5956fff700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5950100ca0 0x7f59501093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.601+0000 7f5956fff700 1 --2- 172.21.15.17:0/2622398138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59501015b0 0x7f59501098e0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:30.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.601+0000 7f5956fff700 1 -- 172.21.15.17:0/2622398138 >> 172.21.15.17:0/2622398138 conn(0x7f59500fa4b0 msgr2=0x7f595010c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:30.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.601+0000 7f5956fff700 1 -- 172.21.15.17:0/2622398138 shutdown_connections 2023-07-14T13:19:30.636 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:30.601+0000 7f5956fff700 1 -- 172.21.15.17:0/2622398138 wait complete. 2023-07-14T13:19:30.660 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:19:30.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:30 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/587686608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:19:30.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:30 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/587686608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:19:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.012+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/1399905477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80fe610 msgr2=0x7fe4c8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.012+0000 7fe4cf7ff700 1 --2- 172.21.15.17:0/1399905477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80fe610 0x7fe4c8102900 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400da10 tx=0x7fe4c400dd20 comp rx=0 tx=0).stop 2023-07-14T13:19:31.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.012+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/1399905477 shutdown_connections 2023-07-14T13:19:31.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.012+0000 7fe4cf7ff700 1 --2- 172.21.15.17:0/1399905477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4c8108ba0 0x7fe4c810af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.012+0000 7fe4cf7ff700 1 --2- 172.21.15.17:0/1399905477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80fe610 0x7fe4c8102900 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.012+0000 7fe4cf7ff700 1 --2- 172.21.15.17:0/1399905477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4c8102e40 0x7fe4c81032b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.012+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/1399905477 >> 172.21.15.17:0/1399905477 conn(0x7fe4c8075b70 msgr2=0x7fe4c8075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.013+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/1399905477 shutdown_connections 2023-07-14T13:19:31.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.014+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/1399905477 wait complete. 2023-07-14T13:19:31.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.015+0000 7fe4cf7ff700 1 Processor -- start 2023-07-14T13:19:31.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.016+0000 7fe4cf7ff700 1 -- start start 2023-07-14T13:19:31.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.016+0000 7fe4cf7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80fe610 0x7fe4c806bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.016+0000 7fe4cf7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4c8102e40 0x7fe4c806c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.016+0000 7fe4cf7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4c8108ba0 0x7fe4c80704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.016+0000 7fe4cf7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c8070a80 con 0x7fe4c8108ba0 2023-07-14T13:19:31.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.016+0000 7fe4cf7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c8070bc0 con 0x7fe4c80fe610 2023-07-14T13:19:31.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.016+0000 7fe4cf7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c8070d80 con 0x7fe4c8102e40 2023-07-14T13:19:31.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.017+0000 7fe4cd59b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80fe610 0x7fe4c806bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.017+0000 7fe4cd59b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80fe610 0x7fe4c806bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:35982/0 (socket says 172.21.15.17:35982) 2023-07-14T13:19:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.017+0000 7fe4cd59b700 1 -- 172.21.15.17:0/2508921241 learned_addr learned my addr 172.21.15.17:0/2508921241 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.017+0000 7fe4ccd9a700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4c8102e40 0x7fe4c806c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.018+0000 7fe4cd59b700 1 -- 172.21.15.17:0/2508921241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4c8102e40 msgr2=0x7fe4c806c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.018+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4c8102e40 0x7fe4c806c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.018+0000 7fe4cd59b700 1 -- 172.21.15.17:0/2508921241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4c8108ba0 msgr2=0x7fe4c80704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.018+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4c8108ba0 0x7fe4c80704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.050 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.018+0000 7fe4cd59b700 1 -- 172.21.15.17:0/2508921241 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c400d650 con 0x7fe4c80fe610 2023-07-14T13:19:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.018+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80fe610 0x7fe4c806bb10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4015b80 tx=0x7fe4c4015c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.019+0000 7fe4be7fc700 1 -- 172.21.15.17:0/2508921241 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400ac70 con 0x7fe4c80fe610 2023-07-14T13:19:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.019+0000 7fe4be7fc700 1 -- 172.21.15.17:0/2508921241 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4c40050d0 con 0x7fe4c80fe610 2023-07-14T13:19:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.019+0000 7fe4be7fc700 1 -- 172.21.15.17:0/2508921241 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400c670 con 0x7fe4c80fe610 2023-07-14T13:19:31.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.019+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/2508921241 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c8071000 con 0x7fe4c80fe610 2023-07-14T13:19:31.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.020+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/2508921241 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c81b16a0 con 0x7fe4c80fe610 2023-07-14T13:19:31.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.027+0000 7fe4e31afb80 1 Processor -- start 2023-07-14T13:19:31.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.028+0000 7fe4be7fc700 1 -- 172.21.15.17:0/2508921241 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe4c4005240 con 0x7fe4c80fe610 2023-07-14T13:19:31.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.028+0000 7fe4e31afb80 1 -- start start 2023-07-14T13:19:31.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.029+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c3d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.029+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c3dbe0 0x5565e2c48590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.029+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c48ad0 0x5565e2c4aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.029+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2b43cb0 con 0x5565e2c3d2d0 2023-07-14T13:19:31.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.029+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2b96a40 con 0x5565e2c48ad0 2023-07-14T13:19:31.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.029+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2b8fed0 con 0x5565e2c3dbe0 2023-07-14T13:19:31.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.030+0000 7fe4cd59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c3dbe0 0x5565e2c48590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.030+0000 7fe4ccd9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c48ad0 0x5565e2c4aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.030+0000 7fe4cd59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c3dbe0 0x5565e2c48590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50966/0 (socket says 172.21.15.17:50966) 2023-07-14T13:19:31.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.030+0000 7fe4cd59b700 1 -- 172.21.15.17:0/622788896 learned_addr learned my addr 172.21.15.17:0/622788896 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:31.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.030+0000 7fe4cd59b700 1 -- 172.21.15.17:0/622788896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c48ad0 msgr2=0x5565e2c4aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.030+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/622788896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c48ad0 0x5565e2c4aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.030+0000 7fe4cd59b700 1 -- 172.21.15.17:0/622788896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 msgr2=0x5565e2c3d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.030+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/622788896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c3d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.030+0000 7fe4cd59b700 1 -- 172.21.15.17:0/622788896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565e29bdde0 con 0x5565e2c3dbe0 2023-07-14T13:19:31.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.031+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/622788896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c3dbe0 0x5565e2c48590 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40cb060 tx=0x7fe4c40d3a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=255deb9edcb8e0f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.031+0000 7fe4b37fe700 1 -- 172.21.15.17:0/622788896 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40d3e20 con 0x5565e2c3dbe0 2023-07-14T13:19:31.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.031+0000 7fe4b37fe700 1 -- 172.21.15.17:0/622788896 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4c40d36d0 con 0x5565e2c3dbe0 2023-07-14T13:19:31.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.031+0000 7fe4b37fe700 1 -- 172.21.15.17:0/622788896 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40d7960 con 0x5565e2c3dbe0 2023-07-14T13:19:31.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.032+0000 7fe4e31afb80 1 -- 172.21.15.17:0/622788896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c3dbe0 msgr2=0x5565e2c48590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.032+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/622788896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c3dbe0 0x5565e2c48590 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40cb060 tx=0x7fe4c40d3a60 comp rx=0 tx=0).stop 2023-07-14T13:19:31.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.033+0000 7fe4be7fc700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe4b40a1490 0x7fe4b40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.065 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.033+0000 7fe4be7fc700 1 -- 172.21.15.17:0/2508921241 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe4c40cda10 con 0x7fe4c80fe610 2023-07-14T13:19:31.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.034+0000 7fe4e31afb80 1 -- 172.21.15.17:0/622788896 shutdown_connections 2023-07-14T13:19:31.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.034+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/622788896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c48ad0 0x5565e2c4aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.034+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/622788896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c3d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.034+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/622788896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c3dbe0 0x5565e2c48590 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.034+0000 7fe4e31afb80 1 -- 172.21.15.17:0/622788896 >> 172.21.15.17:0/622788896 conn(0x5565e2c33da0 msgr2=0x5565e2c396a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.066 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.034+0000 7fe4cdd9c700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe4b40a1490 0x7fe4b40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.067 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.035+0000 7fe4e31afb80 1 -- 172.21.15.17:0/622788896 shutdown_connections 2023-07-14T13:19:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.036+0000 7fe4e31afb80 1 -- 172.21.15.17:0/622788896 wait complete. 2023-07-14T13:19:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.036+0000 7fe4e31afb80 1 -- start start 2023-07-14T13:19:31.068 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.037+0000 7fe4e31afb80 1 Processor -- start 2023-07-14T13:19:31.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.038+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3d2d0 0x5565e2c48ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.038+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3dbe0 0x5565e2c493e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.038+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c53f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.038+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2b2fac0 con 0x5565e2c3dbe0 2023-07-14T13:19:31.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.038+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2b2f7c0 con 0x5565e2c3d2d0 2023-07-14T13:19:31.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.038+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2a13920 con 0x5565e2c48ad0 2023-07-14T13:19:31.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.038+0000 7fe4e31afb80 10 client.0 _ll_register_callbacks cb 0x5565e2b2d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:31.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.039+0000 7fe4cdd9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c53f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.039+0000 7fe4cdd9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c53f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:50968/0 (socket says 172.21.15.17:50968) 2023-07-14T13:19:31.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.039+0000 7fe4cdd9c700 1 -- 172.21.15.17:0/1954979774 learned_addr learned my addr 172.21.15.17:0/1954979774 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:31.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.039+0000 7fe4ccd9a700 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3dbe0 0x5565e2c493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.040+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3d2d0 0x5565e2c48ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.040+0000 7fe4cdd9c700 1 -- 172.21.15.17:0/1954979774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3d2d0 msgr2=0x5565e2c48ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.072 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.040+0000 7fe4cdd9c700 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3d2d0 0x5565e2c48ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.040+0000 7fe4cdd9c700 1 -- 172.21.15.17:0/1954979774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3dbe0 msgr2=0x5565e2c493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.040+0000 7fe4cdd9c700 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3dbe0 0x5565e2c493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.040+0000 7fe4cdd9c700 1 -- 172.21.15.17:0/1954979774 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c81b16a0 con 0x5565e2c48ad0 2023-07-14T13:19:31.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.040+0000 7fe4cdd9c700 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c53f20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8014b80 tx=0x7fe4b8014e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34ebbb79ed1458d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.041+0000 7fe4b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:19:31.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.041+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/1954979774 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8019070 con 0x5565e2c48ad0 2023-07-14T13:19:31.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.041+0000 7fe4e31afb80 1 -- 172.21.15.17:0/1954979774 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565e2b88eb0 con 0x5565e2c48ad0 2023-07-14T13:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.041+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/1954979774 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe4b8011a10 con 0x5565e2c48ad0 2023-07-14T13:19:31.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.041+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/1954979774 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4b8011080 con 0x5565e2c48ad0 2023-07-14T13:19:31.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.042+0000 7fe4e31afb80 10 client.28696 fetch_fsmap learned FSMap version 52 2023-07-14T13:19:31.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.042+0000 7fe4e31afb80 1 -- 172.21.15.17:0/1954979774 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5565e29a6c60 con 0x5565e2c48ad0 2023-07-14T13:19:31.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.042+0000 7fe4cdd9c700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe4b40a1490 0x7fe4b40a3940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8011000 tx=0x7fe4b801a000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.042+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/1954979774 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5565e2b88eb0 con 0x5565e2c48ad0 2023-07-14T13:19:31.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.043+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/1954979774 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe4b801f430 con 0x5565e2c48ad0 2023-07-14T13:19:31.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.043+0000 7fe4e31afb80 10 client.28696 fetch_fsmap finished waiting for FSMap version 52 2023-07-14T13:19:31.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.043+0000 7fe4e31afb80 10 client.28696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:31.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.043+0000 7fe4e31afb80 20 client.28696 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:31.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.043+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565e2c69330 0x5565e2c6b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.043+0000 7fe4e31afb80 4 client.28696 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:19:31.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.043+0000 7fe4e31afb80 1 -- 172.21.15.17:0/1954979774 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565e2b4b050 con 0x5565e2c69330 2023-07-14T13:19:31.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.043+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565e2c69330 0x5565e2c6b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.044+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565e2c69330 0x5565e2c6b740 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e22c73a0a0084807 server_cookie=de0b47e9f512fbe4 in_seq=0 out_seq=0 2023-07-14T13:19:31.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.044+0000 7fe4b0ff9700 10 client.28696 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:31.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.045+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/1954979774 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5565e2b4b050 con 0x5565e2c69330 2023-07-14T13:19:31.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.045+0000 7fe4b0ff9700 10 client.28696 handle_command_reply: tid=0 2023-07-14T13:19:31.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.045+0000 7fe4e31afb80 1 client.28696 shutdown 2023-07-14T13:19:31.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.046+0000 7fe4e31afb80 1 -- 172.21.15.17:0/1954979774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 msgr2=0x5565e2c53f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.046+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c53f20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8014b80 tx=0x7fe4b8014e90 comp rx=0 tx=0).stop 2023-07-14T13:19:31.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.047+0000 7fe4e31afb80 1 -- 172.21.15.17:0/1954979774 shutdown_connections 2023-07-14T13:19:31.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.047+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565e2c69330 0x5565e2c6b740 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.047+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c53f20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.047+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3d2d0 0x5565e2c48ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.047+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/1954979774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3dbe0 0x5565e2c493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.047+0000 7fe4e31afb80 1 -- 172.21.15.17:0/1954979774 >> 172.21.15.17:0/1954979774 conn(0x5565e2c33da0 msgr2=0x5565e2c39230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.047+0000 7fe4b0ff9700 0 client.28696 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:31.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.049+0000 7fe4e31afb80 1 -- 172.21.15.17:0/1954979774 shutdown_connections 2023-07-14T13:19:31.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.049+0000 7fe4e31afb80 1 -- 172.21.15.17:0/1954979774 wait complete. 2023-07-14T13:19:31.080 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.049+0000 7fe4e31afb80 20 client.28696 trim_cache size 0 max 16384 2023-07-14T13:19:31.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.077+0000 7fe4e31afb80 1 Processor -- start 2023-07-14T13:19:31.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.077+0000 7fe4e31afb80 1 -- start start 2023-07-14T13:19:31.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.077+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.077+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3dbe0 0x5565e2c4dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.077+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c42eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.078+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2c3ad20 con 0x5565e2c3d2d0 2023-07-14T13:19:31.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.078+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2c66910 con 0x5565e2c3dbe0 2023-07-14T13:19:31.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.078+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2c33970 con 0x5565e2c48ad0 2023-07-14T13:19:31.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.078+0000 7fe4ccd9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3dbe0 0x5565e2c4dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.078+0000 7fe4ccd9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3dbe0 0x5565e2c4dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36000/0 (socket says 172.21.15.17:36000) 2023-07-14T13:19:31.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.078+0000 7fe4ccd9a700 1 -- 172.21.15.17:0/3187749020 learned_addr learned my addr 172.21.15.17:0/3187749020 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:31.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.078+0000 7fe4ccd9a700 1 -- 172.21.15.17:0/3187749020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 msgr2=0x5565e2c42eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:19:31.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.079+0000 7fe4ccd9a700 1 --2- 172.21.15.17:0/3187749020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c42eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.079+0000 7fe4ccd9a700 1 -- 172.21.15.17:0/3187749020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 msgr2=0x5565e2c424f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:19:31.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.079+0000 7fe4ccd9a700 1 --2- 172.21.15.17:0/3187749020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.079+0000 7fe4ccd9a700 1 -- 172.21.15.17:0/3187749020 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565e2c47740 con 0x5565e2c3dbe0 2023-07-14T13:19:31.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.079+0000 7fe4ccd9a700 1 --2- 172.21.15.17:0/3187749020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3dbe0 0x5565e2c4dee0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009ee0 tx=0x7fe4c0009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=435f6831cbe6be83 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.080+0000 7fe4b3fff700 1 -- 172.21.15.17:0/3187749020 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0003a00 con 0x5565e2c3dbe0 2023-07-14T13:19:31.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.080+0000 7fe4b3fff700 1 -- 172.21.15.17:0/3187749020 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4c000f040 con 0x5565e2c3dbe0 2023-07-14T13:19:31.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.080+0000 7fe4b3fff700 1 -- 172.21.15.17:0/3187749020 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0017410 con 0x5565e2c3dbe0 2023-07-14T13:19:31.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.081+0000 7fe4e31afb80 1 -- 172.21.15.17:0/3187749020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3dbe0 msgr2=0x5565e2c4dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.081+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/3187749020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3dbe0 0x5565e2c4dee0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009ee0 tx=0x7fe4c0009f10 comp rx=0 tx=0).stop 2023-07-14T13:19:31.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.081+0000 7fe4e31afb80 1 -- 172.21.15.17:0/3187749020 shutdown_connections 2023-07-14T13:19:31.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.081+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/3187749020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c42eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.081+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/3187749020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.081+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/3187749020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3dbe0 0x5565e2c4dee0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.081+0000 7fe4e31afb80 1 -- 172.21.15.17:0/3187749020 >> 172.21.15.17:0/3187749020 conn(0x5565e2c33da0 msgr2=0x5565e2c6b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.081+0000 7fe4e31afb80 1 -- 172.21.15.17:0/3187749020 shutdown_connections 2023-07-14T13:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.081+0000 7fe4e31afb80 1 -- 172.21.15.17:0/3187749020 wait complete. 2023-07-14T13:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.082+0000 7fe4e31afb80 1 -- start start 2023-07-14T13:19:31.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.082+0000 7fe4e31afb80 1 Processor -- start 2023-07-14T13:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.083+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c4dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.083+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3dbe0 0x5565e2c4e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.083+0000 7fe4e31afb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c4a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.083+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2c4a800 con 0x5565e2c3d2d0 2023-07-14T13:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.083+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2c4a970 con 0x5565e2c3dbe0 2023-07-14T13:19:31.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.083+0000 7fe4e31afb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565e2c4ab30 con 0x5565e2c48ad0 2023-07-14T13:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.083+0000 7fe4e31afb80 10 client.0 _ll_register_callbacks cb 0x7fe4b8014650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.083+0000 7fe4cd59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c4dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.084+0000 7fe4cd59b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c4dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32938/0 (socket says 172.21.15.17:32938) 2023-07-14T13:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.084+0000 7fe4cd59b700 1 -- 172.21.15.17:0/2768447538 learned_addr learned my addr 172.21.15.17:0/2768447538 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.084+0000 7fe4cdd9c700 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c4a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.084+0000 7fe4cdd9c700 1 -- 172.21.15.17:0/2768447538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3dbe0 msgr2=0x5565e2c4e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.084+0000 7fe4cdd9c700 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3dbe0 0x5565e2c4e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.084+0000 7fe4cdd9c700 1 -- 172.21.15.17:0/2768447538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 msgr2=0x5565e2c4dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.084+0000 7fe4cdd9c700 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c4dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.084+0000 7fe4cdd9c700 1 -- 172.21.15.17:0/2768447538 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c0009b60 con 0x5565e2c48ad0 2023-07-14T13:19:31.118 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.084+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c4dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:19:31.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.085+0000 7fe4cdd9c700 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c4a0f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe4b801f7c0 tx=0x7fe4b8009820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a499c98846b1343 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.085+0000 7fe4b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:19:31.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.085+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/2768447538 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8019040 con 0x5565e2c48ad0 2023-07-14T13:19:31.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.085+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/2768447538 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe4b8011a10 con 0x5565e2c48ad0 2023-07-14T13:19:31.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.086+0000 7fe4e31afb80 1 -- 172.21.15.17:0/2768447538 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565e2ae94f0 con 0x5565e2c48ad0 2023-07-14T13:19:31.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.086+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/2768447538 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4b8009300 con 0x5565e2c48ad0 2023-07-14T13:19:31.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.086+0000 7fe4e31afb80 10 client.28699 fetch_fsmap learned FSMap version 52 2023-07-14T13:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.086+0000 7fe4e31afb80 1 -- 172.21.15.17:0/2768447538 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5565e29e4250 con 0x5565e2c48ad0 2023-07-14T13:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.087+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/2768447538 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5565e2ae94f0 con 0x5565e2c48ad0 2023-07-14T13:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.087+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/2768447538 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe4b800faf0 con 0x5565e2c48ad0 2023-07-14T13:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.087+0000 7fe4e31afb80 10 client.28699 fetch_fsmap finished waiting for FSMap version 52 2023-07-14T13:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.088+0000 7fe4e31afb80 10 client.28699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.088+0000 7fe4e31afb80 20 client.28699 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:31.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.088+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565e2cbe540 0x5565e2cc0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.088+0000 7fe4e31afb80 4 client.28699 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:19:31.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.088+0000 7fe4e31afb80 1 -- 172.21.15.17:0/2768447538 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5565e29def70 con 0x5565e2cbe540 2023-07-14T13:19:31.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.088+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565e2cbe540 0x5565e2cc0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.091+0000 7fe4cd59b700 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565e2cbe540 0x5565e2cc0950 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf1736541dbce59 server_cookie=3f84a3823c03cfad in_seq=0 out_seq=0 2023-07-14T13:19:31.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.091+0000 7fe4b0ff9700 10 client.28699 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:31.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.091+0000 7fe4b0ff9700 1 -- 172.21.15.17:0/2768447538 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5565e29def70 con 0x5565e2cbe540 2023-07-14T13:19:31.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.091+0000 7fe4b0ff9700 10 client.28699 handle_command_reply: tid=0 2023-07-14T13:19:31.124 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.091+0000 7fe4e31afb80 1 client.28699 shutdown 2023-07-14T13:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.092+0000 7fe4e31afb80 1 -- 172.21.15.17:0/2768447538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 msgr2=0x5565e2c4a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.092+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c4a0f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe4b801f7c0 tx=0x7fe4b8009820 comp rx=0 tx=0).stop 2023-07-14T13:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.092+0000 7fe4e31afb80 1 -- 172.21.15.17:0/2768447538 shutdown_connections 2023-07-14T13:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.092+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5565e2cbe540 0x5565e2cc0950 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.092+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565e2c48ad0 0x5565e2c4a0f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.092+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5565e2c3d2d0 0x5565e2c4dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.092+0000 7fe4e31afb80 1 --2- 172.21.15.17:0/2768447538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565e2c3dbe0 0x5565e2c4e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.092+0000 7fe4e31afb80 1 -- 172.21.15.17:0/2768447538 >> 172.21.15.17:0/2768447538 conn(0x5565e2c33da0 msgr2=0x5565e2c42eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.092+0000 7fe4b0ff9700 0 client.28699 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:31.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.092+0000 7fe4e31afb80 1 -- 172.21.15.17:0/2768447538 shutdown_connections 2023-07-14T13:19:31.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.092+0000 7fe4e31afb80 1 -- 172.21.15.17:0/2768447538 wait complete. 2023-07-14T13:19:31.126 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.093+0000 7fe4e31afb80 20 client.28699 trim_cache size 0 max 16384 2023-07-14T13:19:31.126 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:19:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.094+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/2508921241 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe4b40a1490 msgr2=0x7fe4b40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.094+0000 7fe4cf7ff700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe4b40a1490 0x7fe4b40a3940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8011000 tx=0x7fe4b801a000 comp rx=0 tx=0).stop 2023-07-14T13:19:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.094+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/2508921241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80fe610 msgr2=0x7fe4c806bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.094+0000 7fe4cf7ff700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80fe610 0x7fe4c806bb10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4015b80 tx=0x7fe4c4015c60 comp rx=0 tx=0).stop 2023-07-14T13:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.095+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/2508921241 shutdown_connections 2023-07-14T13:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.095+0000 7fe4cf7ff700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe4b40a1490 0x7fe4b40a3940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.095+0000 7fe4cf7ff700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4c8108ba0 0x7fe4c80704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.095+0000 7fe4cf7ff700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4c80fe610 0x7fe4c806bb10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.095+0000 7fe4cf7ff700 1 --2- 172.21.15.17:0/2508921241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4c8102e40 0x7fe4c806c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.095+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/2508921241 >> 172.21.15.17:0/2508921241 conn(0x7fe4c8075b70 msgr2=0x7fe4c80fb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.095+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/2508921241 shutdown_connections 2023-07-14T13:19:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:31.096+0000 7fe4cf7ff700 1 -- 172.21.15.17:0/2508921241 wait complete. 2023-07-14T13:19:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.112+0000 7fb5969ff700 1 -- 172.21.15.17:0/1172097766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5900731c0 msgr2=0x7fb5901105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.112+0000 7fb5969ff700 1 --2- 172.21.15.17:0/1172097766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5900731c0 0x7fb5901105d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb5780098f0 tx=0x7fb578009c00 comp rx=0 tx=0).stop 2023-07-14T13:19:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.112+0000 7fb5969ff700 1 -- 172.21.15.17:0/1172097766 shutdown_connections 2023-07-14T13:19:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.112+0000 7fb5969ff700 1 --2- 172.21.15.17:0/1172097766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb590110b10 0x7fb590112ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.112+0000 7fb5969ff700 1 --2- 172.21.15.17:0/1172097766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5900728b0 0x7fb590072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.112+0000 7fb5969ff700 1 --2- 172.21.15.17:0/1172097766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5900731c0 0x7fb5901105d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.112+0000 7fb5969ff700 1 -- 172.21.15.17:0/1172097766 >> 172.21.15.17:0/1172097766 conn(0x7fb5900fb600 msgr2=0x7fb5900fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.113+0000 7fb5969ff700 1 -- 172.21.15.17:0/1172097766 shutdown_connections 2023-07-14T13:19:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.114+0000 7fb5969ff700 1 -- 172.21.15.17:0/1172097766 wait complete. 2023-07-14T13:19:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.115+0000 7fb5969ff700 1 Processor -- start 2023-07-14T13:19:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.116+0000 7fb5969ff700 1 -- start start 2023-07-14T13:19:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.116+0000 7fb5969ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5900728b0 0x7fb590071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.116+0000 7fb5969ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5900731c0 0x7fb590072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.116+0000 7fb5969ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb590110b10 0x7fb59006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.116+0000 7fb5969ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59006b180 con 0x7fb5900728b0 2023-07-14T13:19:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.116+0000 7fb5969ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59006b2f0 con 0x7fb590110b10 2023-07-14T13:19:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.116+0000 7fb5969ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59006b4b0 con 0x7fb5900731c0 2023-07-14T13:19:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.117+0000 7fb5877fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5900731c0 0x7fb590072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.117+0000 7fb594f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb590110b10 0x7fb59006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.117+0000 7fb594f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb590110b10 0x7fb59006a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36044/0 (socket says 172.21.15.17:36044) 2023-07-14T13:19:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.117+0000 7fb594f9c700 1 -- 172.21.15.17:0/1264603146 learned_addr learned my addr 172.21.15.17:0/1264603146 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.118+0000 7fb594f9c700 1 -- 172.21.15.17:0/1264603146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5900731c0 msgr2=0x7fb590072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.118+0000 7fb594f9c700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5900731c0 0x7fb590072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.118+0000 7fb594f9c700 1 -- 172.21.15.17:0/1264603146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5900728b0 msgr2=0x7fb590071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.118+0000 7fb594f9c700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5900728b0 0x7fb590071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.118+0000 7fb594f9c700 1 -- 172.21.15.17:0/1264603146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb578009520 con 0x7fb590110b10 2023-07-14T13:19:31.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.120+0000 7fb594f9c700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb590110b10 0x7fb59006a9b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb58800e940 tx=0x7fb58800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.120+0000 7fb58dffb700 1 -- 172.21.15.17:0/1264603146 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588004a30 con 0x7fb590110b10 2023-07-14T13:19:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.120+0000 7fb58dffb700 1 -- 172.21.15.17:0/1264603146 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb58800cc50 con 0x7fb590110b10 2023-07-14T13:19:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.120+0000 7fb58dffb700 1 -- 172.21.15.17:0/1264603146 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5880054c0 con 0x7fb590110b10 2023-07-14T13:19:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.120+0000 7fb5969ff700 1 -- 172.21.15.17:0/1264603146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59006f690 con 0x7fb590110b10 2023-07-14T13:19:31.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.121+0000 7fb5969ff700 1 -- 172.21.15.17:0/1264603146 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59006fb50 con 0x7fb590110b10 2023-07-14T13:19:31.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.126+0000 7fb5aa3bbb80 1 Processor -- start 2023-07-14T13:19:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.129+0000 7fb58dffb700 1 -- 172.21.15.17:0/1264603146 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb588005620 con 0x7fb590110b10 2023-07-14T13:19:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.130+0000 7fb5aa3bbb80 1 -- start start 2023-07-14T13:19:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.130+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e999746b0 0x555e99b1dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.131+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e99b1e2d0 0x555e99b18040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.131+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b18580 0x555e99b189d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.131+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e99a1dc50 con 0x555e99b18580 2023-07-14T13:19:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.131+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e99a709e0 con 0x555e999746b0 2023-07-14T13:19:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.131+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e99a69e70 con 0x555e99b1e2d0 2023-07-14T13:19:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.131+0000 7fb5877fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e999746b0 0x555e99b1dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.132+0000 7fb5877fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e999746b0 0x555e99b1dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36060/0 (socket says 172.21.15.17:36060) 2023-07-14T13:19:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.132+0000 7fb5877fe700 1 -- 172.21.15.17:0/3336969481 learned_addr learned my addr 172.21.15.17:0/3336969481 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.132+0000 7fb5877fe700 1 --2- 172.21.15.17:0/3336969481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b18580 0x555e99b189d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.132+0000 7fb58ffff700 1 --2- 172.21.15.17:0/3336969481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e99b1e2d0 0x555e99b18040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.132+0000 7fb5877fe700 1 -- 172.21.15.17:0/3336969481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e99b1e2d0 msgr2=0x555e99b18040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.132+0000 7fb5877fe700 1 --2- 172.21.15.17:0/3336969481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e99b1e2d0 0x555e99b18040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.132+0000 7fb5877fe700 1 -- 172.21.15.17:0/3336969481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b18580 msgr2=0x555e99b189d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.132+0000 7fb5877fe700 1 --2- 172.21.15.17:0/3336969481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b18580 0x555e99b189d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.132+0000 7fb5877fe700 1 -- 172.21.15.17:0/3336969481 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e99897d80 con 0x555e999746b0 2023-07-14T13:19:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.133+0000 7fb5877fe700 1 --2- 172.21.15.17:0/3336969481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e999746b0 0x555e99b1dd90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb5780098f0 tx=0x7fb578019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e899b2e3e3528f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.133+0000 7fb58dffb700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb57c0a1400 0x7fb57c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.133+0000 7fb58dffb700 1 -- 172.21.15.17:0/1264603146 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb588014070 con 0x7fb590110b10 2023-07-14T13:19:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.134+0000 7fb5867fc700 1 -- 172.21.15.17:0/3336969481 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57800fb80 con 0x555e999746b0 2023-07-14T13:19:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.134+0000 7fb5867fc700 1 -- 172.21.15.17:0/3336969481 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb57800fce0 con 0x555e999746b0 2023-07-14T13:19:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.134+0000 7fb5867fc700 1 -- 172.21.15.17:0/3336969481 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57800b560 con 0x555e999746b0 2023-07-14T13:19:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.135+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/3336969481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e999746b0 msgr2=0x555e99b1dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.135+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/3336969481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e999746b0 0x555e99b1dd90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb5780098f0 tx=0x7fb578019040 comp rx=0 tx=0).stop 2023-07-14T13:19:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.135+0000 7fb58ffff700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb57c0a1400 0x7fb57c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.135+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/3336969481 shutdown_connections 2023-07-14T13:19:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.135+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/3336969481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b18580 0x555e99b189d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.135+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/3336969481 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e999746b0 0x555e99b1dd90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.135+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/3336969481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e99b1e2d0 0x555e99b18040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.135+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/3336969481 >> 172.21.15.17:0/3336969481 conn(0x555e99b0dbe0 msgr2=0x555e99b12f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.135+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/3336969481 shutdown_connections 2023-07-14T13:19:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.136+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/3336969481 wait complete. 2023-07-14T13:19:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.136+0000 7fb5aa3bbb80 1 -- start start 2023-07-14T13:19:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.136+0000 7fb5aa3bbb80 1 Processor -- start 2023-07-14T13:19:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.137+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e999746b0 0x555e99b24560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.137+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e99b18580 0x555e99b217e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.137+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b1e2d0 0x555e99b21e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.137+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e99a09a60 con 0x555e999746b0 2023-07-14T13:19:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.137+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e99a09760 con 0x555e99b1e2d0 2023-07-14T13:19:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.137+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e998ed8c0 con 0x555e99b18580 2023-07-14T13:19:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.137+0000 7fb5aa3bbb80 10 client.0 _ll_register_callbacks cb 0x555e99a07700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.137+0000 7fb594f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b1e2d0 0x555e99b21e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.137+0000 7fb594f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b1e2d0 0x555e99b21e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36064/0 (socket says 172.21.15.17:36064) 2023-07-14T13:19:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.137+0000 7fb594f9c700 1 -- 172.21.15.17:0/563389731 learned_addr learned my addr 172.21.15.17:0/563389731 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb5877fe700 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e99b18580 0x555e99b217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb594f9c700 1 -- 172.21.15.17:0/563389731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e99b18580 msgr2=0x555e99b217e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb594f9c700 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e99b18580 0x555e99b217e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb594f9c700 1 -- 172.21.15.17:0/563389731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e999746b0 msgr2=0x555e99b24560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:19:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb594f9c700 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e999746b0 0x555e99b24560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb594f9c700 1 -- 172.21.15.17:0/563389731 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57801f040 con 0x555e99b1e2d0 2023-07-14T13:19:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb594f9c700 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b1e2d0 0x555e99b21e10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb588096350 tx=0x7fb588099f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a2aacb746c3a9d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb56f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:19:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb58ffff700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb57c0a1400 0x7fb57c0a38b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x555e99b14b40 tx=0x7fb58000d040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb56f7fe700 1 -- 172.21.15.17:0/563389731 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58809a0b0 con 0x555e99b1e2d0 2023-07-14T13:19:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb56f7fe700 1 -- 172.21.15.17:0/563389731 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb58809a210 con 0x555e99b1e2d0 2023-07-14T13:19:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.138+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/563389731 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e999c3490 con 0x555e99b1e2d0 2023-07-14T13:19:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.139+0000 7fb56f7fe700 1 -- 172.21.15.17:0/563389731 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb588099340 con 0x555e99b1e2d0 2023-07-14T13:19:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.139+0000 7fb5aa3bbb80 10 client.28742 fetch_fsmap learned FSMap version 52 2023-07-14T13:19:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.139+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/563389731 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x555e99880c00 con 0x555e99b1e2d0 2023-07-14T13:19:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.139+0000 7fb56f7fe700 1 -- 172.21.15.17:0/563389731 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5880c8080 con 0x555e99b1e2d0 2023-07-14T13:19:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.140+0000 7fb56f7fe700 1 -- 172.21.15.17:0/563389731 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb58809c030 con 0x555e99b1e2d0 2023-07-14T13:19:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.140+0000 7fb5aa3bbb80 10 client.28742 fetch_fsmap finished waiting for FSMap version 52 2023-07-14T13:19:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.140+0000 7fb5aa3bbb80 10 client.28742 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.140+0000 7fb5aa3bbb80 20 client.28742 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.140+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e99b53ca0 0x555e99b560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.140+0000 7fb5aa3bbb80 4 client.28742 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:19:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.140+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/563389731 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e99a62e50 con 0x555e99b53ca0 2023-07-14T13:19:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.140+0000 7fb58ffff700 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e99b53ca0 0x555e99b560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.141+0000 7fb58ffff700 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e99b53ca0 0x555e99b560b0 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=211963390f1d7eba server_cookie=184a14816de88c80 in_seq=0 out_seq=0 2023-07-14T13:19:31.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.141+0000 7fb56f7fe700 10 client.28742 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:31.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.143+0000 7fb56f7fe700 1 -- 172.21.15.17:0/563389731 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555e99a62e50 con 0x555e99b53ca0 2023-07-14T13:19:31.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.143+0000 7fb56f7fe700 10 client.28742 handle_command_reply: tid=0 2023-07-14T13:19:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.143+0000 7fb5aa3bbb80 1 client.28742 shutdown 2023-07-14T13:19:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.144+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/563389731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b1e2d0 msgr2=0x555e99b21e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.144+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b1e2d0 0x555e99b21e10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb588096350 tx=0x7fb588099f00 comp rx=0 tx=0).stop 2023-07-14T13:19:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.144+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/563389731 shutdown_connections 2023-07-14T13:19:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.144+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e99b53ca0 0x555e99b560b0 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.144+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b1e2d0 0x555e99b21e10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.144+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e999746b0 0x555e99b24560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.144+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/563389731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e99b18580 0x555e99b217e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.144+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/563389731 >> 172.21.15.17:0/563389731 conn(0x555e99b0dbe0 msgr2=0x555e99b11c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.144+0000 7fb56f7fe700 0 client.28742 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:31.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.145+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/563389731 shutdown_connections 2023-07-14T13:19:31.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.145+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/563389731 wait complete. 2023-07-14T13:19:31.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.147+0000 7fb5aa3bbb80 20 client.28742 trim_cache size 0 max 16384 2023-07-14T13:19:31.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.170+0000 7fb5aa3bbb80 1 Processor -- start 2023-07-14T13:19:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.170+0000 7fb5aa3bbb80 1 -- start start 2023-07-14T13:19:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.171+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e999746b0 0x555e99b18040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.171+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 0x555e99b28c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.171+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b1e2d0 0x555e99b1ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.171+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e99b14970 con 0x555e99b1e2d0 2023-07-14T13:19:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.171+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e99b18fd0 con 0x555e99b18580 2023-07-14T13:19:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.171+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e99b248a0 con 0x555e999746b0 2023-07-14T13:19:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.171+0000 7fb5877fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 0x555e99b28c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.171+0000 7fb58ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e999746b0 0x555e99b18040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.173+0000 7fb5877fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 0x555e99b28c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36076/0 (socket says 172.21.15.17:36076) 2023-07-14T13:19:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.173+0000 7fb5877fe700 1 -- 172.21.15.17:0/3034781371 learned_addr learned my addr 172.21.15.17:0/3034781371 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.173+0000 7fb594f9c700 1 --2- 172.21.15.17:0/3034781371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b1e2d0 0x555e99b1ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.174+0000 7fb58ffff700 1 -- 172.21.15.17:0/3034781371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 msgr2=0x555e99b28c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.174+0000 7fb58ffff700 1 --2- 172.21.15.17:0/3034781371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 0x555e99b28c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.174+0000 7fb58ffff700 1 -- 172.21.15.17:0/3034781371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b1e2d0 msgr2=0x555e99b1ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.174+0000 7fb58ffff700 1 --2- 172.21.15.17:0/3034781371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b1e2d0 0x555e99b1ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.174+0000 7fb58ffff700 1 -- 172.21.15.17:0/3034781371 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e99b0f420 con 0x555e999746b0 2023-07-14T13:19:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.174+0000 7fb58ffff700 1 --2- 172.21.15.17:0/3034781371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e999746b0 0x555e99b18040 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x555e99b56960 tx=0x7fb580015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecf03cc0ec8c17f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.175+0000 7fb586ffd700 1 -- 172.21.15.17:0/3034781371 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580010040 con 0x555e999746b0 2023-07-14T13:19:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.175+0000 7fb586ffd700 1 -- 172.21.15.17:0/3034781371 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb58001c040 con 0x555e999746b0 2023-07-14T13:19:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.175+0000 7fb586ffd700 1 -- 172.21.15.17:0/3034781371 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580022420 con 0x555e999746b0 2023-07-14T13:19:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.176+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/3034781371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e999746b0 msgr2=0x555e99b18040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.176+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/3034781371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e999746b0 0x555e99b18040 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x555e99b56960 tx=0x7fb580015000 comp rx=0 tx=0).stop 2023-07-14T13:19:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.177+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/3034781371 shutdown_connections 2023-07-14T13:19:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.177+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/3034781371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b1e2d0 0x555e99b1ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.177+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/3034781371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e999746b0 0x555e99b18040 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.177+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/3034781371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 0x555e99b28c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.177+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/3034781371 >> 172.21.15.17:0/3034781371 conn(0x555e99b0dbe0 msgr2=0x555e99b24190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.177+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/3034781371 shutdown_connections 2023-07-14T13:19:31.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.177+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/3034781371 wait complete. 2023-07-14T13:19:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.178+0000 7fb5aa3bbb80 1 -- start start 2023-07-14T13:19:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.178+0000 7fb5aa3bbb80 1 Processor -- start 2023-07-14T13:19:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.179+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e999746b0 0x555e99b1af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.179+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 0x555e99b19800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.179+0000 7fb5aa3bbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b1e2d0 0x555e99b19d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.179+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e99b29220 con 0x555e99b1e2d0 2023-07-14T13:19:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.179+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e99b1a280 con 0x555e99b18580 2023-07-14T13:19:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.179+0000 7fb5aa3bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e99b1a440 con 0x555e999746b0 2023-07-14T13:19:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.179+0000 7fb5aa3bbb80 10 client.0 _ll_register_callbacks cb 0x7fb5880997b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.180+0000 7fb5877fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 0x555e99b19800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.180+0000 7fb5877fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 0x555e99b19800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36084/0 (socket says 172.21.15.17:36084) 2023-07-14T13:19:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.180+0000 7fb5877fe700 1 -- 172.21.15.17:0/2393862352 learned_addr learned my addr 172.21.15.17:0/2393862352 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.180+0000 7fb58ffff700 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e999746b0 0x555e99b1af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.181+0000 7fb5877fe700 1 -- 172.21.15.17:0/2393862352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e999746b0 msgr2=0x555e99b1af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.181+0000 7fb5877fe700 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e999746b0 0x555e99b1af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.181+0000 7fb5877fe700 1 -- 172.21.15.17:0/2393862352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b1e2d0 msgr2=0x555e99b19d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.181+0000 7fb5877fe700 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b1e2d0 0x555e99b19d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.181+0000 7fb5877fe700 1 -- 172.21.15.17:0/2393862352 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58000ad50 con 0x555e99b18580 2023-07-14T13:19:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.182+0000 7fb5877fe700 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 0x555e99b19800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb578010ee0 tx=0x7fb57800f7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5217a1325252cae7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.182+0000 7fb56f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:19:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.182+0000 7fb56f7fe700 1 -- 172.21.15.17:0/2393862352 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578005b00 con 0x555e99b18580 2023-07-14T13:19:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.182+0000 7fb56f7fe700 1 -- 172.21.15.17:0/2393862352 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb5780052d0 con 0x555e99b18580 2023-07-14T13:19:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.182+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/2393862352 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb57800fce0 con 0x555e99b18580 2023-07-14T13:19:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.182+0000 7fb56f7fe700 1 -- 172.21.15.17:0/2393862352 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb578005490 con 0x555e99b18580 2023-07-14T13:19:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.182+0000 7fb5aa3bbb80 10 client.28748 fetch_fsmap learned FSMap version 52 2023-07-14T13:19:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.182+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/2393862352 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x555e998be1f0 con 0x555e99b18580 2023-07-14T13:19:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.183+0000 7fb56f7fe700 1 -- 172.21.15.17:0/2393862352 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb57800fce0 con 0x555e99b18580 2023-07-14T13:19:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.183+0000 7fb56f7fe700 1 -- 172.21.15.17:0/2393862352 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb57803b070 con 0x555e99b18580 2023-07-14T13:19:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.183+0000 7fb5aa3bbb80 10 client.28748 fetch_fsmap finished waiting for FSMap version 52 2023-07-14T13:19:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.183+0000 7fb5aa3bbb80 10 client.28748 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.183+0000 7fb5aa3bbb80 20 client.28748 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.183+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e99ba8b30 0x555e99baaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.183+0000 7fb5aa3bbb80 4 client.28748 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:19:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.183+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/2393862352 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555e99a24ff0 con 0x555e99ba8b30 2023-07-14T13:19:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.184+0000 7fb58ffff700 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e99ba8b30 0x555e99baaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.185+0000 7fb58ffff700 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e99ba8b30 0x555e99baaf40 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5f8c19784fbd7da server_cookie=d7db244308ea3245 in_seq=0 out_seq=0 2023-07-14T13:19:31.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.185+0000 7fb56f7fe700 10 client.28748 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.210+0000 7fb56f7fe700 1 -- 172.21.15.17:0/2393862352 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555e99a24ff0 con 0x555e99ba8b30 2023-07-14T13:19:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.210+0000 7fb56f7fe700 10 client.28748 handle_command_reply: tid=0 2023-07-14T13:19:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.211+0000 7fb5aa3bbb80 1 client.28748 shutdown 2023-07-14T13:19:31.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.211+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/2393862352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 msgr2=0x555e99b19800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.211+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 0x555e99b19800 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb578010ee0 tx=0x7fb57800f7d0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.213+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/2393862352 shutdown_connections 2023-07-14T13:19:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.213+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e99ba8b30 0x555e99baaf40 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.213+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e99b1e2d0 0x555e99b19d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.213+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e999746b0 0x555e99b1af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.213+0000 7fb5aa3bbb80 1 --2- 172.21.15.17:0/2393862352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e99b18580 0x555e99b19800 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.213+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/2393862352 >> 172.21.15.17:0/2393862352 conn(0x555e99b0dbe0 msgr2=0x555e99b1ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.213+0000 7fb56f7fe700 0 client.28748 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:31.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.214+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/2393862352 shutdown_connections 2023-07-14T13:19:31.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.218+0000 7fb5aa3bbb80 1 -- 172.21.15.17:0/2393862352 wait complete. 2023-07-14T13:19:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.220+0000 7fb5aa3bbb80 20 client.28748 trim_cache size 0 max 16384 2023-07-14T13:19:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:19:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:19:31.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:19:31.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:19:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.221+0000 7fb5969ff700 1 -- 172.21.15.17:0/1264603146 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb57c0a1400 msgr2=0x7fb57c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.221+0000 7fb5969ff700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb57c0a1400 0x7fb57c0a38b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x555e99b14b40 tx=0x7fb58000d040 comp rx=0 tx=0).stop 2023-07-14T13:19:31.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.221+0000 7fb5969ff700 1 -- 172.21.15.17:0/1264603146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb590110b10 msgr2=0x7fb59006a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.221+0000 7fb5969ff700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb590110b10 0x7fb59006a9b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb58800e940 tx=0x7fb58800ec50 comp rx=0 tx=0).stop 2023-07-14T13:19:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.224+0000 7fb5969ff700 1 -- 172.21.15.17:0/1264603146 shutdown_connections 2023-07-14T13:19:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.224+0000 7fb5969ff700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb57c0a1400 0x7fb57c0a38b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.224+0000 7fb5969ff700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb590110b10 0x7fb59006a9b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.224+0000 7fb5969ff700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5900728b0 0x7fb590071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.224+0000 7fb5969ff700 1 --2- 172.21.15.17:0/1264603146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5900731c0 0x7fb590072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.224+0000 7fb5969ff700 1 -- 172.21.15.17:0/1264603146 >> 172.21.15.17:0/1264603146 conn(0x7fb5900fb600 msgr2=0x7fb5900fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.224+0000 7fb5969ff700 1 -- 172.21.15.17:0/1264603146 shutdown_connections 2023-07-14T13:19:31.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:31.225+0000 7fb5969ff700 1 -- 172.21.15.17:0/1264603146 wait complete. 2023-07-14T13:19:31.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:31 smithi017 ceph-mon[95536]: pgmap v624: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 25 MiB/s wr, 1.77k op/s 2023-07-14T13:19:31.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:31 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:19:31.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:31 smithi135 ceph-mon[97338]: pgmap v624: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 25 MiB/s wr, 1.77k op/s 2023-07-14T13:19:31.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:31 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:19:31.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:31 smithi131 ceph-mon[96953]: pgmap v624: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 25 MiB/s wr, 1.77k op/s 2023-07-14T13:19:31.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:31 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:19:32.162 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T13:19:32.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T13:19:32.450 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 80.0 s, 635.2 tps, lat 156.738 ms stddev 60.673 2023-07-14T13:19:32.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.506+0000 7f4edb7ff700 1 -- 172.21.15.17:0/1166671407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ed40fea90 msgr2=0x7f4ed40fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:32.538 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.506+0000 7f4edb7ff700 1 --2- 172.21.15.17:0/1166671407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ed40fea90 0x7f4ed40fee60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00b0a0 tx=0x7f4ecc00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.506+0000 7f4edb7ff700 1 -- 172.21.15.17:0/1166671407 shutdown_connections 2023-07-14T13:19:32.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.506+0000 7f4edb7ff700 1 --2- 172.21.15.17:0/1166671407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ed4103e40 0x7f4ed41042e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.506+0000 7f4edb7ff700 1 --2- 172.21.15.17:0/1166671407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ed40fea90 0x7f4ed40fee60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.539 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.506+0000 7f4edb7ff700 1 --2- 172.21.15.17:0/1166671407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed40ff3a0 0x7f4ed4103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.506+0000 7f4edb7ff700 1 -- 172.21.15.17:0/1166671407 >> 172.21.15.17:0/1166671407 conn(0x7f4ed40fa4b0 msgr2=0x7f4ed40fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:32.540 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.507+0000 7f4edb7ff700 1 -- 172.21.15.17:0/1166671407 shutdown_connections 2023-07-14T13:19:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.507+0000 7f4edb7ff700 1 -- 172.21.15.17:0/1166671407 wait complete. 2023-07-14T13:19:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.509+0000 7f4edb7ff700 1 Processor -- start 2023-07-14T13:19:32.541 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.509+0000 7f4edb7ff700 1 -- start start 2023-07-14T13:19:32.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.509+0000 7f4edb7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ed40fea90 0x7f4ed41128f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.510+0000 7f4edb7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed40ff3a0 0x7f4ed4112e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.542 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.510+0000 7f4edb7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ed4103e40 0x7f4ed410b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.510+0000 7f4edb7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed410bf70 con 0x7f4ed40ff3a0 2023-07-14T13:19:32.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.510+0000 7f4edb7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed410c0e0 con 0x7f4ed40fea90 2023-07-14T13:19:32.543 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.510+0000 7f4edb7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed410c2a0 con 0x7f4ed4103e40 2023-07-14T13:19:32.544 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.510+0000 7f4ed9d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ed4103e40 0x7f4ed410b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.510+0000 7f4ed9d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ed4103e40 0x7f4ed410b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51070/0 (socket says 172.21.15.17:51070) 2023-07-14T13:19:32.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.510+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/4017420288 learned_addr learned my addr 172.21.15.17:0/4017420288 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:32.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.510+0000 7f4ed959b700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ed40fea90 0x7f4ed41128f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.545 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.510+0000 7f4ed8d9a700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed40ff3a0 0x7f4ed4112e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.511+0000 7f4ed959b700 1 -- 172.21.15.17:0/4017420288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ed4103e40 msgr2=0x7f4ed410b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.511+0000 7f4ed959b700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ed4103e40 0x7f4ed410b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.511+0000 7f4ed959b700 1 -- 172.21.15.17:0/4017420288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed40ff3a0 msgr2=0x7f4ed4112e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:32.546 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.511+0000 7f4ed959b700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed40ff3a0 0x7f4ed4112e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.511+0000 7f4ed959b700 1 -- 172.21.15.17:0/4017420288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc009d00 con 0x7f4ed40fea90 2023-07-14T13:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.512+0000 7f4ed959b700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ed40fea90 0x7f4ed41128f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00b070 tx=0x7f4ecc012620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.512+0000 7f4eca7fc700 1 -- 172.21.15.17:0/4017420288 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc00e040 con 0x7f4ed40fea90 2023-07-14T13:19:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.513+0000 7f4eca7fc700 1 -- 172.21.15.17:0/4017420288 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ecc003e10 con 0x7f4ed40fea90 2023-07-14T13:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.513+0000 7f4eca7fc700 1 -- 172.21.15.17:0/4017420288 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0055b0 con 0x7f4ed40fea90 2023-07-14T13:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.513+0000 7f4edb7ff700 1 -- 172.21.15.17:0/4017420288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed410c520 con 0x7f4ed40fea90 2023-07-14T13:19:32.548 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.513+0000 7f4edb7ff700 1 -- 172.21.15.17:0/4017420288 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed41105f0 con 0x7f4ed40fea90 2023-07-14T13:19:32.550 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.519+0000 7f4eef0c2b80 1 Processor -- start 2023-07-14T13:19:32.551 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.520+0000 7f4eef0c2b80 1 -- start start 2023-07-14T13:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.520+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718350 0x555804718720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.520+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718c60 0x555804723610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.520+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804723b50 0x555804725f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.552 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.520+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55580461ed30 con 0x555804723b50 2023-07-14T13:19:32.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.520+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555804671ac0 con 0x555804718350 2023-07-14T13:19:32.553 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.520+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55580466af50 con 0x555804718c60 2023-07-14T13:19:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.520+0000 7f4ed9d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718350 0x555804718720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.521+0000 7f4ed9d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718350 0x555804718720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36112/0 (socket says 172.21.15.17:36112) 2023-07-14T13:19:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.521+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/711841688 learned_addr learned my addr 172.21.15.17:0/711841688 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.521+0000 7f4eca7fc700 1 -- 172.21.15.17:0/4017420288 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4ecc005710 con 0x7f4ed40fea90 2023-07-14T13:19:32.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.521+0000 7f4ed959b700 1 --2- 172.21.15.17:0/711841688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718c60 0x555804723610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.522+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/711841688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718c60 msgr2=0x555804723610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:32.556 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.522+0000 7f4ed9d9c700 1 --2- 172.21.15.17:0/711841688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718c60 0x555804723610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.522+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/711841688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804723b50 msgr2=0x555804725f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.522+0000 7f4ed9d9c700 1 --2- 172.21.15.17:0/711841688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804723b50 0x555804725f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.522+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/711841688 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555804498e60 con 0x555804718350 2023-07-14T13:19:32.557 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.522+0000 7f4ed9d9c700 1 --2- 172.21.15.17:0/711841688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718350 0x555804718720 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000bd50 tx=0x7f4ed00106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b47b7867da50cc62 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:32.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.523+0000 7f4ebf7fe700 1 -- 172.21.15.17:0/711841688 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed000bea0 con 0x555804718350 2023-07-14T13:19:32.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.523+0000 7f4ebf7fe700 1 -- 172.21.15.17:0/711841688 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ed0015070 con 0x555804718350 2023-07-14T13:19:32.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.523+0000 7f4ebf7fe700 1 -- 172.21.15.17:0/711841688 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0005560 con 0x555804718350 2023-07-14T13:19:32.558 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.523+0000 7f4eca7fc700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4ec00a14d0 0x7f4ec00a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.523+0000 7f4eca7fc700 1 -- 172.21.15.17:0/4017420288 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4ecc0cddb0 con 0x7f4ed40fea90 2023-07-14T13:19:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.524+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/711841688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718350 msgr2=0x555804718720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.524+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/711841688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718350 0x555804718720 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000bd50 tx=0x7f4ed00106b0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.524+0000 7f4ed959b700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4ec00a14d0 0x7f4ec00a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.525+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/711841688 shutdown_connections 2023-07-14T13:19:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.525+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/711841688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804723b50 0x555804725f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.525+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/711841688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718350 0x555804718720 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.525+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/711841688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718c60 0x555804723610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.525+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/711841688 >> 172.21.15.17:0/711841688 conn(0x55580470ee20 msgr2=0x555804714720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.525+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/711841688 shutdown_connections 2023-07-14T13:19:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.525+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/711841688 wait complete. 2023-07-14T13:19:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.526+0000 7f4eef0c2b80 1 -- start start 2023-07-14T13:19:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.526+0000 7f4eef0c2b80 1 Processor -- start 2023-07-14T13:19:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.526+0000 7f4ed959b700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4ec00a14d0 0x7f4ec00a3980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc097940 tx=0x7f4ecc0d17a0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.527+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718350 0x5558047235b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.527+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804718c60 0x555804720830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.527+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804723b50 0x555804720f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.527+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55580460ab40 con 0x555804718c60 2023-07-14T13:19:32.565 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.527+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55580460a840 con 0x555804723b50 2023-07-14T13:19:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.527+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558044ee9a0 con 0x555804718350 2023-07-14T13:19:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.527+0000 7f4eef0c2b80 10 client.0 _ll_register_callbacks cb 0x5558046087e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.528+0000 7f4ed9d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804723b50 0x555804720f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.566 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.528+0000 7f4ed9d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718350 0x5558047235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.528+0000 7f4ed9d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718350 0x5558047235b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51082/0 (socket says 172.21.15.17:51082) 2023-07-14T13:19:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.528+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/124141861 learned_addr learned my addr 172.21.15.17:0/124141861 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.528+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/124141861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804723b50 msgr2=0x555804720f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:32.567 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.528+0000 7f4ed9d9c700 1 --2- 172.21.15.17:0/124141861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804723b50 0x555804720f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.528+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/124141861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804718c60 msgr2=0x555804720830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:32.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.528+0000 7f4ed9d9c700 1 --2- 172.21.15.17:0/124141861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804718c60 0x555804720830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.528+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/124141861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed000b9b0 con 0x555804718350 2023-07-14T13:19:32.568 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.529+0000 7f4ed9d9c700 1 --2- 172.21.15.17:0/124141861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718350 0x5558047235b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00055a0 tx=0x7f4ed0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b88a32328fa52494 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.529+0000 7f4ebcff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:19:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.529+0000 7f4ebcff9700 1 -- 172.21.15.17:0/124141861 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00056b0 con 0x555804718350 2023-07-14T13:19:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.530+0000 7f4ebcff9700 1 -- 172.21.15.17:0/124141861 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4ed0017070 con 0x555804718350 2023-07-14T13:19:32.569 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.530+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/124141861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5558045c4570 con 0x555804718350 2023-07-14T13:19:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.530+0000 7f4ebcff9700 1 -- 172.21.15.17:0/124141861 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ed0004960 con 0x555804718350 2023-07-14T13:19:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.530+0000 7f4eef0c2b80 10 client.28726 fetch_fsmap learned FSMap version 52 2023-07-14T13:19:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.530+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/124141861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x555804481ce0 con 0x555804718350 2023-07-14T13:19:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.531+0000 7f4ebcff9700 1 -- 172.21.15.17:0/124141861 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5558045c4570 con 0x555804718350 2023-07-14T13:19:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.531+0000 7f4ebcff9700 1 -- 172.21.15.17:0/124141861 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4ed0011a30 con 0x555804718350 2023-07-14T13:19:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.531+0000 7f4eef0c2b80 10 client.28726 fetch_fsmap finished waiting for FSMap version 52 2023-07-14T13:19:32.573 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.531+0000 7f4eef0c2b80 10 client.28726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.531+0000 7f4eef0c2b80 20 client.28726 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.531+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/124141861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555804733390 0x5558047357a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.531+0000 7f4eef0c2b80 4 client.28726 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:19:32.574 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.531+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/124141861 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555804663f30 con 0x555804733390 2023-07-14T13:19:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.534+0000 7f4ed8d9a700 1 --2- 172.21.15.17:0/124141861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555804733390 0x5558047357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.534+0000 7f4ed8d9a700 1 --2- 172.21.15.17:0/124141861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555804733390 0x5558047357a0 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=573afb7be5be85eb server_cookie=7b43b08f44ef528 in_seq=0 out_seq=0 2023-07-14T13:19:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.535+0000 7f4ebcff9700 10 client.28726 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:32.575 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.535+0000 7f4ebcff9700 1 -- 172.21.15.17:0/124141861 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555804663f30 con 0x555804733390 2023-07-14T13:19:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.535+0000 7f4ebcff9700 10 client.28726 handle_command_reply: tid=0 2023-07-14T13:19:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.535+0000 7f4eef0c2b80 1 client.28726 shutdown 2023-07-14T13:19:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.536+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/124141861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718350 msgr2=0x5558047235b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:32.576 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.536+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/124141861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718350 0x5558047235b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00055a0 tx=0x7f4ed0000bc0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.536+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/124141861 shutdown_connections 2023-07-14T13:19:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.536+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/124141861 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555804733390 0x5558047357a0 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.536+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/124141861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804723b50 0x555804720f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.577 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.536+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/124141861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718350 0x5558047235b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.536+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/124141861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804718c60 0x555804720830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.536+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/124141861 >> 172.21.15.17:0/124141861 conn(0x55580470ee20 msgr2=0x5558047142b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.536+0000 7f4ebcff9700 0 client.28726 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:32.578 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.537+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/124141861 shutdown_connections 2023-07-14T13:19:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.537+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/124141861 wait complete. 2023-07-14T13:19:32.579 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.537+0000 7f4eef0c2b80 20 client.28726 trim_cache size 0 max 16384 2023-07-14T13:19:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.571+0000 7f4eef0c2b80 1 Processor -- start 2023-07-14T13:19:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.572+0000 7f4eef0c2b80 1 -- start start 2023-07-14T13:19:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.572+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804718350 0x55580472a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.572+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718c60 0x55580471fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.572+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804723b50 0x555804720530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.572+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558047195c0 con 0x555804718350 2023-07-14T13:19:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.572+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555804715d80 con 0x555804723b50 2023-07-14T13:19:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.572+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555804721e10 con 0x555804718c60 2023-07-14T13:19:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.573+0000 7f4ed9d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804723b50 0x555804720530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.573+0000 7f4ed9d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804718350 0x55580472a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.573+0000 7f4ed9d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804718350 0x55580472a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33034/0 (socket says 172.21.15.17:33034) 2023-07-14T13:19:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.573+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/2792419205 learned_addr learned my addr 172.21.15.17:0/2792419205 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:32.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.573+0000 7f4ed8d9a700 1 --2- 172.21.15.17:0/2792419205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718c60 0x55580471fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.574+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/2792419205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718c60 msgr2=0x55580471fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.574+0000 7f4ed9d9c700 1 --2- 172.21.15.17:0/2792419205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718c60 0x55580471fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.574+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/2792419205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804718350 msgr2=0x55580472a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.574+0000 7f4ed9d9c700 1 --2- 172.21.15.17:0/2792419205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804718350 0x55580472a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.574+0000 7f4ed9d9c700 1 -- 172.21.15.17:0/2792419205 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555804713160 con 0x555804723b50 2023-07-14T13:19:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.574+0000 7f4ed8d9a700 1 --2- 172.21.15.17:0/2792419205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718c60 0x55580471fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:19:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.574+0000 7f4ed9d9c700 1 --2- 172.21.15.17:0/2792419205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804723b50 0x555804720530 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0005cc0 tx=0x7f4ed0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65d2a7523a850464 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:32.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.574+0000 7f4ebffff700 1 -- 172.21.15.17:0/2792419205 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0005680 con 0x555804723b50 2023-07-14T13:19:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.575+0000 7f4ebffff700 1 -- 172.21.15.17:0/2792419205 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ed003a070 con 0x555804723b50 2023-07-14T13:19:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.575+0000 7f4ebffff700 1 -- 172.21.15.17:0/2792419205 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed002bce0 con 0x555804723b50 2023-07-14T13:19:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.576+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/2792419205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804723b50 msgr2=0x555804720530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:32.611 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.576+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/2792419205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804723b50 0x555804720530 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0005cc0 tx=0x7f4ed0000bc0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.576+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/2792419205 shutdown_connections 2023-07-14T13:19:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.576+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/2792419205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804723b50 0x555804720530 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.576+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/2792419205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804718350 0x55580472a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.576+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/2792419205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718c60 0x55580471fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.576+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/2792419205 >> 172.21.15.17:0/2792419205 conn(0x55580470ee20 msgr2=0x55580471a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:32.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.576+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/2792419205 shutdown_connections 2023-07-14T13:19:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.576+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/2792419205 wait complete. 2023-07-14T13:19:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.577+0000 7f4eef0c2b80 1 -- start start 2023-07-14T13:19:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.577+0000 7f4eef0c2b80 1 Processor -- start 2023-07-14T13:19:32.616 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.578+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718350 0x55580472a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.578+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718c60 0x555804728880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.578+0000 7f4eef0c2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804723b50 0x555804728dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.578+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558047294b0 con 0x555804723b50 2023-07-14T13:19:32.617 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.578+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555804729620 con 0x555804718c60 2023-07-14T13:19:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.578+0000 7f4eef0c2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555804787260 con 0x555804718350 2023-07-14T13:19:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.578+0000 7f4eef0c2b80 10 client.0 _ll_register_callbacks cb 0x7f4ed0010e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.579+0000 7f4ed8d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718c60 0x555804728880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.579+0000 7f4ed8d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718c60 0x555804728880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36142/0 (socket says 172.21.15.17:36142) 2023-07-14T13:19:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.579+0000 7f4ed8d9a700 1 -- 172.21.15.17:0/1735996339 learned_addr learned my addr 172.21.15.17:0/1735996339 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.579+0000 7f4ed8d9a700 1 -- 172.21.15.17:0/1735996339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718350 msgr2=0x55580472a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.579+0000 7f4ed8d9a700 1 --2- 172.21.15.17:0/1735996339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718350 0x55580472a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.579+0000 7f4ed8d9a700 1 -- 172.21.15.17:0/1735996339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804723b50 msgr2=0x555804728dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.579+0000 7f4ed8d9a700 1 --2- 172.21.15.17:0/1735996339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804723b50 0x555804728dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.579+0000 7f4ed8d9a700 1 -- 172.21.15.17:0/1735996339 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec400bc10 con 0x555804718c60 2023-07-14T13:19:32.620 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.579+0000 7f4ed8d9a700 1 --2- 172.21.15.17:0/1735996339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718c60 0x555804728880 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4ed410d130 tx=0x7f4ec4019570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eca01d2fd53bc4bb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.579+0000 7f4ebcff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:19:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.580+0000 7f4ebcff9700 1 -- 172.21.15.17:0/1735996339 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4016040 con 0x555804718c60 2023-07-14T13:19:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.580+0000 7f4ebcff9700 1 -- 172.21.15.17:0/1735996339 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4ec4019ce0 con 0x555804718c60 2023-07-14T13:19:32.621 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.581+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/1735996339 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ed0015070 con 0x555804718c60 2023-07-14T13:19:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.582+0000 7f4ebcff9700 1 -- 172.21.15.17:0/1735996339 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ec4019ea0 con 0x555804718c60 2023-07-14T13:19:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.582+0000 7f4eef0c2b80 10 client.28766 fetch_fsmap learned FSMap version 52 2023-07-14T13:19:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.582+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/1735996339 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x555804481ce0 con 0x555804718c60 2023-07-14T13:19:32.622 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.582+0000 7f4ebcff9700 1 -- 172.21.15.17:0/1735996339 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ed0015070 con 0x555804718c60 2023-07-14T13:19:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.583+0000 7f4ebcff9700 1 -- 172.21.15.17:0/1735996339 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4ec4022680 con 0x555804718c60 2023-07-14T13:19:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.583+0000 7f4eef0c2b80 10 client.28766 fetch_fsmap finished waiting for FSMap version 52 2023-07-14T13:19:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.583+0000 7f4eef0c2b80 10 client.28766 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:32.623 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.583+0000 7f4eef0c2b80 20 client.28766 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.583+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/1735996339 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5558047889a0 0x55580478adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.583+0000 7f4eef0c2b80 4 client.28766 mds_command: new command op to 24593 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T13:19:32.624 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.583+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/1735996339 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5558046260d0 con 0x5558047889a0 2023-07-14T13:19:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.583+0000 7f4ed9d9c700 1 --2- 172.21.15.17:0/1735996339 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5558047889a0 0x55580478adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.584+0000 7f4ed9d9c700 1 --2- 172.21.15.17:0/1735996339 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5558047889a0 0x55580478adb0 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=325436ca2461eb50 server_cookie=290d276718f7c62e in_seq=0 out_seq=0 2023-07-14T13:19:32.625 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.584+0000 7f4ebcff9700 10 client.28766 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:32.626 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.585+0000 7f4ebcff9700 1 -- 172.21.15.17:0/1735996339 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5558046260d0 con 0x5558047889a0 2023-07-14T13:19:32.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.585+0000 7f4ebcff9700 10 client.28766 handle_command_reply: tid=0 2023-07-14T13:19:32.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.585+0000 7f4eef0c2b80 1 client.28766 shutdown 2023-07-14T13:19:32.627 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.586+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/1735996339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718c60 msgr2=0x555804728880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:32.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.586+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/1735996339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718c60 0x555804728880 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4ed410d130 tx=0x7f4ec4019570 comp rx=0 tx=0).stop 2023-07-14T13:19:32.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.587+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/1735996339 shutdown_connections 2023-07-14T13:19:32.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.587+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/1735996339 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5558047889a0 0x55580478adb0 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.587+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/1735996339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555804723b50 0x555804728dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.587+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/1735996339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555804718350 0x55580472a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.587+0000 7f4eef0c2b80 1 --2- 172.21.15.17:0/1735996339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555804718c60 0x555804728880 secure :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4ed410d130 tx=0x7f4ec4019570 comp rx=0 tx=0).stop 2023-07-14T13:19:32.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.587+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/1735996339 >> 172.21.15.17:0/1735996339 conn(0x55580470ee20 msgr2=0x55580471abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:32.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.587+0000 7f4ebcff9700 0 client.28766 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:32.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.587+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/1735996339 shutdown_connections 2023-07-14T13:19:32.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.588+0000 7f4eef0c2b80 1 -- 172.21.15.17:0/1735996339 wait complete. 2023-07-14T13:19:32.630 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.588+0000 7f4eef0c2b80 20 client.28766 trim_cache size 0 max 16384 2023-07-14T13:19:32.630 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:19:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "return_code": 0, 2023-07-14T13:19:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "scrub_tag": "10a445bb-1e99-4893-a951-f616a7765afb", 2023-07-14T13:19:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": "asynchronous" 2023-07-14T13:19:32.630 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:19:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.589+0000 7f4edb7ff700 1 -- 172.21.15.17:0/4017420288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4ec00a14d0 msgr2=0x7f4ec00a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.589+0000 7f4edb7ff700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4ec00a14d0 0x7f4ec00a3980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc097940 tx=0x7f4ecc0d17a0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.589+0000 7f4edb7ff700 1 -- 172.21.15.17:0/4017420288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ed40fea90 msgr2=0x7f4ed41128f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.589+0000 7f4edb7ff700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ed40fea90 0x7f4ed41128f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00b070 tx=0x7f4ecc012620 comp rx=0 tx=0).stop 2023-07-14T13:19:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.590+0000 7f4edb7ff700 1 -- 172.21.15.17:0/4017420288 shutdown_connections 2023-07-14T13:19:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.590+0000 7f4edb7ff700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f4ec00a14d0 0x7f4ec00a3980 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.590+0000 7f4edb7ff700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ed4103e40 0x7f4ed410b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.590+0000 7f4edb7ff700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ed40fea90 0x7f4ed41128f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.590+0000 7f4edb7ff700 1 --2- 172.21.15.17:0/4017420288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed40ff3a0 0x7f4ed4112e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:32.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.590+0000 7f4edb7ff700 1 -- 172.21.15.17:0/4017420288 >> 172.21.15.17:0/4017420288 conn(0x7f4ed40fa4b0 msgr2=0x7f4ed41019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.591+0000 7f4edb7ff700 1 -- 172.21.15.17:0/4017420288 shutdown_connections 2023-07-14T13:19:32.633 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.591+0000 7f4edb7ff700 1 -- 172.21.15.17:0/4017420288 wait complete. 2023-07-14T13:19:32.649 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:19:32.998 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 13:19:32 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-h[121932]: 2023-07-14T13:19:32.609+0000 7f7c64721700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000231 [...22,head] /volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000007F auth v5610 ap=1 snaprealm=0x557fa14e0480 s=16777216 n(v0 rc2023-07-14T13:18:09.827252+0000 b16777216 1=1+0) old_inodes=2 (iversion lock) caps={15315=pAsLsXsFscr/-@16} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 remoteparent=0 freezing=0 frozen=0 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x557fa11bdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000231:[<0x10000000007/00000001000000010000007F v5450>,<0x10000000006/pg_wal v5515>,<0x10000000005/data v3635>,<0x10000000003/postgres v1007>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v929>,<0x10000000001/sv_0 v935>,<0x10000000000/_nogroup v907>,<0x1/volumes v917>]//[]","memoryvalue":"(3)0x20000000231:[<0x10000000007/00000001000000010000007F v5610>,<0x10000000006/pg_wal v8561>,<0x10000000005/data v4171>,<0x10000000003/postgres v1207>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v957>,<0x10000000001/sv_0 v880>,<0x10000000000/_nogroup v853>,<0x1/volumes v943>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-07-14T13:19:32.998 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 13:19:32 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-h[121932]: 2023-07-14T13:19:32.610+0000 7f7c64721700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000022e [...22,head] /volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/000000010000000100000078 auth v5512 ap=1 snaprealm=0x557fa12e3d40 s=16777216 n(v0 rc2023-07-14T13:18:01.484239+0000 b16777216 1=1+0) old_inodes=2 (iversion lock) caps={15315=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557fa1271b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000022e:[<0x10000000007/000000010000000100000078 v5382>,<0x10000000006/pg_wal v5515>,<0x10000000005/data v3635>,<0x10000000003/postgres v1007>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v929>,<0x10000000001/sv_0 v935>,<0x10000000000/_nogroup v907>,<0x1/volumes v917>]//[]","memoryvalue":"(3)0x2000000022e:[<0x10000000007/000000010000000100000078 v5512>,<0x10000000006/pg_wal v8561>,<0x10000000005/data v4171>,<0x10000000003/postgres v1207>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v957>,<0x10000000001/sv_0 v880>,<0x10000000000/_nogroup v853>,<0x1/volumes v943>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-07-14T13:19:32.998 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 13:19:32 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-h[121932]: 2023-07-14T13:19:32.616+0000 7f7c64721700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000001fc [...22,head] /volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000008D auth v5796 ap=1 snaprealm=0x557fa1d3a900 s=16777216 n(v0 rc2023-07-14T13:18:31.983448+0000 b16777216 1=1+0) old_inodes=2 (iversion lock) caps={15315=pAsLsXs/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557fa12ce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000001fc:[<0x10000000007/00000001000000010000008D v5595>,<0x10000000006/pg_wal v5764>,<0x10000000005/data v3738>,<0x10000000003/postgres v1054>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v935>,<0x10000000001/sv_0 v941>,<0x10000000000/_nogroup v913>,<0x1/volumes v923>]//[]","memoryvalue":"(3)0x200000001fc:[<0x10000000007/00000001000000010000008D v5796>,<0x10000000006/pg_wal v8561>,<0x10000000005/data v4171>,<0x10000000003/postgres v1207>,<0x10000000002/52fc56da-dc94-4d3f-a0a3-91ce35989bb3 v957>,<0x10000000001/sv_0 v880>,<0x10000000000/_nogroup v853>,<0x1/volumes v943>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-07-14T13:19:33.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.988+0000 7f020fdff700 1 -- 172.21.15.17:0/478022595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080fea90 msgr2=0x7f02080fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:33.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.988+0000 7f020fdff700 1 --2- 172.21.15.17:0/478022595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080fea90 0x7f02080fee60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f020401a9a0 tx=0x7f020401acb0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.990+0000 7f020fdff700 1 -- 172.21.15.17:0/478022595 shutdown_connections 2023-07-14T13:19:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.990+0000 7f020fdff700 1 --2- 172.21.15.17:0/478022595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208103e40 0x7f02081042e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.990+0000 7f020fdff700 1 --2- 172.21.15.17:0/478022595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080fea90 0x7f02080fee60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.990+0000 7f020fdff700 1 --2- 172.21.15.17:0/478022595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02080ff3a0 0x7f0208103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.990+0000 7f020fdff700 1 -- 172.21.15.17:0/478022595 >> 172.21.15.17:0/478022595 conn(0x7f02080fa4b0 msgr2=0x7f02080fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:33.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.990+0000 7f020fdff700 1 -- 172.21.15.17:0/478022595 shutdown_connections 2023-07-14T13:19:33.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.992+0000 7f020fdff700 1 -- 172.21.15.17:0/478022595 wait complete. 2023-07-14T13:19:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.993+0000 7f020fdff700 1 Processor -- start 2023-07-14T13:19:33.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.994+0000 7f020fdff700 1 -- start start 2023-07-14T13:19:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.994+0000 7f020fdff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080fea90 0x7f020810e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.994+0000 7f020fdff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02080ff3a0 0x7f020810ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.994+0000 7f020fdff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208103e40 0x7f02081c1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.994+0000 7f020fdff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02081c1cb0 con 0x7f02080ff3a0 2023-07-14T13:19:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.994+0000 7f020fdff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208069f30 con 0x7f0208103e40 2023-07-14T13:19:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.994+0000 7f020fdff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020806a0f0 con 0x7f02080fea90 2023-07-14T13:19:33.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.995+0000 7f020db9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080fea90 0x7f020810e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.995+0000 7f020db9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080fea90 0x7f020810e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51124/0 (socket says 172.21.15.17:51124) 2023-07-14T13:19:33.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.995+0000 7f020db9b700 1 -- 172.21.15.17:0/2385925158 learned_addr learned my addr 172.21.15.17:0/2385925158 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.995+0000 7f020e39c700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208103e40 0x7f02081c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.995+0000 7f020db9b700 1 -- 172.21.15.17:0/2385925158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208103e40 msgr2=0x7f02081c1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.995+0000 7f020db9b700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208103e40 0x7f02081c1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.995+0000 7f020db9b700 1 -- 172.21.15.17:0/2385925158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02080ff3a0 msgr2=0x7f020810ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.995+0000 7f020db9b700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02080ff3a0 0x7f020810ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.995+0000 7f020db9b700 1 -- 172.21.15.17:0/2385925158 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020401a600 con 0x7f02080fea90 2023-07-14T13:19:33.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.995+0000 7f020e39c700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208103e40 0x7f02081c1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:19:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.996+0000 7f020db9b700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080fea90 0x7f020810e8c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f020401c5d0 tx=0x7f020401ccd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.996+0000 7f01feffd700 1 -- 172.21.15.17:0/2385925158 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204003cd0 con 0x7f02080fea90 2023-07-14T13:19:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.997+0000 7f01feffd700 1 -- 172.21.15.17:0/2385925158 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0204003e30 con 0x7f02080fea90 2023-07-14T13:19:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.997+0000 7f01feffd700 1 -- 172.21.15.17:0/2385925158 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204004cd0 con 0x7f02080fea90 2023-07-14T13:19:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.997+0000 7f020fdff700 1 -- 172.21.15.17:0/2385925158 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020806a310 con 0x7f02080fea90 2023-07-14T13:19:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:32.997+0000 7f020fdff700 1 -- 172.21.15.17:0/2385925158 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020806a770 con 0x7f02080fea90 2023-07-14T13:19:33.035 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.004+0000 7f0223646b80 1 Processor -- start 2023-07-14T13:19:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.005+0000 7f01feffd700 1 -- 172.21.15.17:0/2385925158 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0204005050 con 0x7f02080fea90 2023-07-14T13:19:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.005+0000 7f0223646b80 1 -- start start 2023-07-14T13:19:33.036 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.005+0000 7f0223646b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f862d0 0x556042f866a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.006+0000 7f0223646b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f86be0 0x556042f91590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.006+0000 7f0223646b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 0x556042f93eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.006+0000 7f0223646b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042e8ccb0 con 0x556042f91ad0 2023-07-14T13:19:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.006+0000 7f0223646b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042edfa40 con 0x556042f862d0 2023-07-14T13:19:33.037 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.006+0000 7f0223646b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042ed8ed0 con 0x556042f86be0 2023-07-14T13:19:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.007+0000 7f020d39a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 0x556042f93eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.007+0000 7f020d39a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 0x556042f93eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33064/0 (socket says 172.21.15.17:33064) 2023-07-14T13:19:33.038 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.007+0000 7f020d39a700 1 -- 172.21.15.17:0/2029197164 learned_addr learned my addr 172.21.15.17:0/2029197164 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.007+0000 7f020e39c700 1 --2- 172.21.15.17:0/2029197164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f862d0 0x556042f866a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.008+0000 7f020db9b700 1 --2- 172.21.15.17:0/2029197164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f86be0 0x556042f91590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.008+0000 7f01feffd700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f01f40a1340 0x7f01f40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.008+0000 7f020d39a700 1 -- 172.21.15.17:0/2029197164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f86be0 msgr2=0x556042f91590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.008+0000 7f020d39a700 1 --2- 172.21.15.17:0/2029197164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f86be0 0x556042f91590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.008+0000 7f020d39a700 1 -- 172.21.15.17:0/2029197164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f862d0 msgr2=0x556042f866a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.008+0000 7f020d39a700 1 --2- 172.21.15.17:0/2029197164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f862d0 0x556042f866a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.008+0000 7f020d39a700 1 -- 172.21.15.17:0/2029197164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556042d06de0 con 0x556042f91ad0 2023-07-14T13:19:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.008+0000 7f01feffd700 1 -- 172.21.15.17:0/2385925158 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f02040ce1b0 con 0x7f02080fea90 2023-07-14T13:19:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.009+0000 7f020d39a700 1 --2- 172.21.15.17:0/2029197164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 0x556042f93eb0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f01f800bb30 tx=0x7f01f800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91ff88fbf7202a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.009+0000 7f020e39c700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f01f40a1340 0x7f01f40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.041 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.011+0000 7f020e39c700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f01f40a1340 0x7f01f40a37f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f020000a4c0 tx=0x7f020000c040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.011+0000 7f01f3fff700 1 -- 172.21.15.17:0/2029197164 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8004830 con 0x556042f91ad0 2023-07-14T13:19:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.011+0000 7f01f3fff700 1 -- 172.21.15.17:0/2029197164 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01f8004e20 con 0x556042f91ad0 2023-07-14T13:19:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.011+0000 7f01f3fff700 1 -- 172.21.15.17:0/2029197164 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80053a0 con 0x556042f91ad0 2023-07-14T13:19:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.012+0000 7f0223646b80 1 -- 172.21.15.17:0/2029197164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 msgr2=0x556042f93eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.012+0000 7f0223646b80 1 --2- 172.21.15.17:0/2029197164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 0x556042f93eb0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f01f800bb30 tx=0x7f01f800be40 comp rx=0 tx=0).stop 2023-07-14T13:19:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.012+0000 7f0223646b80 1 -- 172.21.15.17:0/2029197164 shutdown_connections 2023-07-14T13:19:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.012+0000 7f0223646b80 1 --2- 172.21.15.17:0/2029197164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 0x556042f93eb0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.012+0000 7f0223646b80 1 --2- 172.21.15.17:0/2029197164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f862d0 0x556042f866a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.012+0000 7f0223646b80 1 --2- 172.21.15.17:0/2029197164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f86be0 0x556042f91590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.012+0000 7f0223646b80 1 -- 172.21.15.17:0/2029197164 >> 172.21.15.17:0/2029197164 conn(0x556042f7cda0 msgr2=0x556042f826a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.013+0000 7f0223646b80 1 -- 172.21.15.17:0/2029197164 shutdown_connections 2023-07-14T13:19:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.013+0000 7f0223646b80 1 -- 172.21.15.17:0/2029197164 wait complete. 2023-07-14T13:19:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.014+0000 7f0223646b80 1 -- start start 2023-07-14T13:19:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.014+0000 7f0223646b80 1 Processor -- start 2023-07-14T13:19:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.015+0000 7f0223646b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f91550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.046 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.015+0000 7f0223646b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f86be0 0x556042f8e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.015+0000 7f0223646b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f91ad0 0x556042f8ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.015+0000 7f0223646b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042e78ac0 con 0x556042f86be0 2023-07-14T13:19:33.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.015+0000 7f0223646b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042e787c0 con 0x556042f91ad0 2023-07-14T13:19:33.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.015+0000 7f0223646b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042d5c920 con 0x556042f862d0 2023-07-14T13:19:33.047 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.015+0000 7f0223646b80 10 client.0 _ll_register_callbacks cb 0x556042e76760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.016+0000 7f020e39c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f91ad0 0x556042f8ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.016+0000 7f020e39c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f91ad0 0x556042f8ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36184/0 (socket says 172.21.15.17:36184) 2023-07-14T13:19:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.016+0000 7f020e39c700 1 -- 172.21.15.17:0/3510387828 learned_addr learned my addr 172.21.15.17:0/3510387828 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.016+0000 7f020e39c700 1 -- 172.21.15.17:0/3510387828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 msgr2=0x556042f91550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:19:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.016+0000 7f020e39c700 1 --2- 172.21.15.17:0/3510387828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f91550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.016+0000 7f020e39c700 1 -- 172.21.15.17:0/3510387828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f86be0 msgr2=0x556042f8e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.016+0000 7f020e39c700 1 --2- 172.21.15.17:0/3510387828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f86be0 0x556042f8e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.049 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.016+0000 7f020e39c700 1 -- 172.21.15.17:0/3510387828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f800b760 con 0x556042f91ad0 2023-07-14T13:19:33.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.019+0000 7f020e39c700 1 --2- 172.21.15.17:0/3510387828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f91ad0 0x556042f8ee50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0200017850 tx=0x7f0200009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ca49883e1b225e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:33.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.019+0000 7f01f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:19:33.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.019+0000 7f01f17fa700 1 -- 172.21.15.17:0/3510387828 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000ada0 con 0x556042f91ad0 2023-07-14T13:19:33.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.019+0000 7f01f17fa700 1 -- 172.21.15.17:0/3510387828 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0200016740 con 0x556042f91ad0 2023-07-14T13:19:33.051 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.019+0000 7f0223646b80 1 -- 172.21.15.17:0/3510387828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556042e324f0 con 0x556042f91ad0 2023-07-14T13:19:33.052 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.021+0000 7f01f17fa700 1 -- 172.21.15.17:0/3510387828 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0200016900 con 0x556042f91ad0 2023-07-14T13:19:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.022+0000 7f0223646b80 10 client.28775 fetch_fsmap learned FSMap version 52 2023-07-14T13:19:33.053 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.022+0000 7f0223646b80 1 -- 172.21.15.17:0/3510387828 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x556042cefc60 con 0x556042f91ad0 2023-07-14T13:19:33.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.027+0000 7f01f17fa700 1 -- 172.21.15.17:0/3510387828 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556042e324f0 con 0x556042f91ad0 2023-07-14T13:19:33.058 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.027+0000 7f01f17fa700 1 -- 172.21.15.17:0/3510387828 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f020002a070 con 0x556042f91ad0 2023-07-14T13:19:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.028+0000 7f0223646b80 10 client.28775 fetch_fsmap finished waiting for FSMap version 52 2023-07-14T13:19:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.028+0000 7f0223646b80 10 client.28775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.028+0000 7f0223646b80 20 client.28775 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.028+0000 7f0223646b80 1 --2- 172.21.15.17:0/3510387828 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556042fa1500 0x556042fa3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.028+0000 7f0223646b80 4 client.28775 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:19:33.059 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.028+0000 7f0223646b80 1 -- 172.21.15.17:0/3510387828 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556042ed1eb0 con 0x556042fa1500 2023-07-14T13:19:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.028+0000 7f020db9b700 1 --2- 172.21.15.17:0/3510387828 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556042fa1500 0x556042fa3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.029+0000 7f020db9b700 1 --2- 172.21.15.17:0/3510387828 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556042fa1500 0x556042fa3910 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5e3880a02663f3f server_cookie=6cfd0cf07ec6870f in_seq=0 out_seq=0 2023-07-14T13:19:33.060 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.029+0000 7f01f17fa700 10 client.28775 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.030+0000 7f01f17fa700 1 -- 172.21.15.17:0/3510387828 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556042ed1eb0 con 0x556042fa1500 2023-07-14T13:19:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.030+0000 7f01f17fa700 10 client.28775 handle_command_reply: tid=0 2023-07-14T13:19:33.061 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.030+0000 7f0223646b80 1 client.28775 shutdown 2023-07-14T13:19:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.031+0000 7f0223646b80 1 -- 172.21.15.17:0/3510387828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f91ad0 msgr2=0x556042f8ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.031+0000 7f0223646b80 1 --2- 172.21.15.17:0/3510387828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f91ad0 0x556042f8ee50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0200017850 tx=0x7f0200009700 comp rx=0 tx=0).stop 2023-07-14T13:19:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.031+0000 7f0223646b80 1 -- 172.21.15.17:0/3510387828 shutdown_connections 2023-07-14T13:19:33.062 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.031+0000 7f0223646b80 1 --2- 172.21.15.17:0/3510387828 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556042fa1500 0x556042fa3910 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.031+0000 7f0223646b80 1 --2- 172.21.15.17:0/3510387828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f91ad0 0x556042f8ee50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.031+0000 7f0223646b80 1 --2- 172.21.15.17:0/3510387828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f91550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.031+0000 7f0223646b80 1 --2- 172.21.15.17:0/3510387828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f86be0 0x556042f8e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.031+0000 7f0223646b80 1 -- 172.21.15.17:0/3510387828 >> 172.21.15.17:0/3510387828 conn(0x556042f7cda0 msgr2=0x556042f82230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:33.063 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.031+0000 7f01f17fa700 0 client.28775 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.032+0000 7f0223646b80 1 -- 172.21.15.17:0/3510387828 shutdown_connections 2023-07-14T13:19:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.032+0000 7f0223646b80 1 -- 172.21.15.17:0/3510387828 wait complete. 2023-07-14T13:19:33.064 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.032+0000 7f0223646b80 20 client.28775 trim_cache size 0 max 16384 2023-07-14T13:19:33.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.066+0000 7f0223646b80 1 Processor -- start 2023-07-14T13:19:33.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.066+0000 7f0223646b80 1 -- start start 2023-07-14T13:19:33.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.067+0000 7f0223646b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f91080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.098 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.067+0000 7f0223646b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f86be0 0x556042f89ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.067+0000 7f0223646b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f91ad0 0x556042f8a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.067+0000 7f0223646b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042f9eb70 con 0x556042f86be0 2023-07-14T13:19:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.067+0000 7f0223646b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042f8fb50 con 0x556042f91ad0 2023-07-14T13:19:33.099 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.067+0000 7f0223646b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042f83d20 con 0x556042f862d0 2023-07-14T13:19:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.068+0000 7f020d39a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f86be0 0x556042f89ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.068+0000 7f020d39a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f86be0 0x556042f89ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33086/0 (socket says 172.21.15.17:33086) 2023-07-14T13:19:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.068+0000 7f020d39a700 1 -- 172.21.15.17:0/2517412676 learned_addr learned my addr 172.21.15.17:0/2517412676 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.068+0000 7f020db9b700 1 --2- 172.21.15.17:0/2517412676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f91080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.068+0000 7f020d39a700 1 -- 172.21.15.17:0/2517412676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 msgr2=0x556042f91080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.068+0000 7f020d39a700 1 --2- 172.21.15.17:0/2517412676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f91080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.068+0000 7f020d39a700 1 -- 172.21.15.17:0/2517412676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f91ad0 msgr2=0x556042f8a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.068+0000 7f020d39a700 1 --2- 172.21.15.17:0/2517412676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f91ad0 0x556042f8a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.068+0000 7f020d39a700 1 -- 172.21.15.17:0/2517412676 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556042d2d250 con 0x556042f86be0 2023-07-14T13:19:33.101 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.069+0000 7f020d39a700 1 --2- 172.21.15.17:0/2517412676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f86be0 0x556042f89ad0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f01f80046f0 tx=0x7f01f8004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7524db2b38d05d7b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.070+0000 7f01fcbff700 1 -- 172.21.15.17:0/2517412676 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80048b0 con 0x556042f86be0 2023-07-14T13:19:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.070+0000 7f01fcbff700 1 -- 172.21.15.17:0/2517412676 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01f80044c0 con 0x556042f86be0 2023-07-14T13:19:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.070+0000 7f01fcbff700 1 -- 172.21.15.17:0/2517412676 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800de60 con 0x556042f86be0 2023-07-14T13:19:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.071+0000 7f0223646b80 1 -- 172.21.15.17:0/2517412676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f86be0 msgr2=0x556042f89ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:33.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.071+0000 7f0223646b80 1 --2- 172.21.15.17:0/2517412676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f86be0 0x556042f89ad0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f01f80046f0 tx=0x7f01f8004720 comp rx=0 tx=0).stop 2023-07-14T13:19:33.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.071+0000 7f0223646b80 1 -- 172.21.15.17:0/2517412676 shutdown_connections 2023-07-14T13:19:33.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.071+0000 7f0223646b80 1 --2- 172.21.15.17:0/2517412676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f91ad0 0x556042f8a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.071+0000 7f0223646b80 1 --2- 172.21.15.17:0/2517412676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f91080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.071+0000 7f0223646b80 1 --2- 172.21.15.17:0/2517412676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f86be0 0x556042f89ad0 secure :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f01f80046f0 tx=0x7f01f8004720 comp rx=0 tx=0).stop 2023-07-14T13:19:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.071+0000 7f0223646b80 1 -- 172.21.15.17:0/2517412676 >> 172.21.15.17:0/2517412676 conn(0x556042f7cda0 msgr2=0x556042f80e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.072+0000 7f0223646b80 1 -- 172.21.15.17:0/2517412676 shutdown_connections 2023-07-14T13:19:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.072+0000 7f0223646b80 1 -- 172.21.15.17:0/2517412676 wait complete. 2023-07-14T13:19:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.072+0000 7f0223646b80 1 -- start start 2023-07-14T13:19:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.073+0000 7f0223646b80 1 Processor -- start 2023-07-14T13:19:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.075+0000 7f0223646b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f985d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.075+0000 7f0223646b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 0x556042f96820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.075+0000 7f0223646b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f96d60 0x556042f971d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.075+0000 7f0223646b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042ff5410 con 0x556042f91ad0 2023-07-14T13:19:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.075+0000 7f0223646b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042ff5550 con 0x556042f96d60 2023-07-14T13:19:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.075+0000 7f0223646b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556042ff56e0 con 0x556042f862d0 2023-07-14T13:19:33.107 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.075+0000 7f0223646b80 10 client.0 _ll_register_callbacks cb 0x7f0200017450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.076+0000 7f020db9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.076+0000 7f020db9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51144/0 (socket says 172.21.15.17:51144) 2023-07-14T13:19:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.076+0000 7f020db9b700 1 -- 172.21.15.17:0/1889838924 learned_addr learned my addr 172.21.15.17:0/1889838924 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:33.108 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.076+0000 7f020d39a700 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 0x556042f96820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.076+0000 7f020e39c700 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f96d60 0x556042f971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.077+0000 7f020d39a700 1 -- 172.21.15.17:0/1889838924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 msgr2=0x556042f985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.077+0000 7f020d39a700 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.077+0000 7f020d39a700 1 -- 172.21.15.17:0/1889838924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f96d60 msgr2=0x556042f971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.077+0000 7f020d39a700 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f96d60 0x556042f971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.077+0000 7f020d39a700 1 -- 172.21.15.17:0/1889838924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556042d06de0 con 0x556042f91ad0 2023-07-14T13:19:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.077+0000 7f020d39a700 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 0x556042f96820 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x556042f86910 tx=0x7f01f8004ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f275f612766b28 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.077+0000 7f01f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:19:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.078+0000 7f01f17fa700 1 -- 172.21.15.17:0/1889838924 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8004c50 con 0x556042f91ad0 2023-07-14T13:19:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.078+0000 7f01f17fa700 1 -- 172.21.15.17:0/1889838924 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f01f800dc50 con 0x556042f91ad0 2023-07-14T13:19:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.078+0000 7f0223646b80 1 -- 172.21.15.17:0/1889838924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01f8004e20 con 0x556042f91ad0 2023-07-14T13:19:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.078+0000 7f01f17fa700 1 -- 172.21.15.17:0/1889838924 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01f800de30 con 0x556042f91ad0 2023-07-14T13:19:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.078+0000 7f0223646b80 10 client.19038 fetch_fsmap learned FSMap version 52 2023-07-14T13:19:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.078+0000 7f0223646b80 1 -- 172.21.15.17:0/1889838924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x556042d052b0 con 0x556042f91ad0 2023-07-14T13:19:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.079+0000 7f01f17fa700 1 -- 172.21.15.17:0/1889838924 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01f8004e20 con 0x556042f91ad0 2023-07-14T13:19:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.079+0000 7f01f17fa700 1 -- 172.21.15.17:0/1889838924 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f01f8021020 con 0x556042f91ad0 2023-07-14T13:19:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.079+0000 7f0223646b80 10 client.19038 fetch_fsmap finished waiting for FSMap version 52 2023-07-14T13:19:33.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.079+0000 7f0223646b80 10 client.19038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.079+0000 7f0223646b80 20 client.19038 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.079+0000 7f0223646b80 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556042ff6910 0x556042ff8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.080+0000 7f0223646b80 4 client.19038 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:19:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.080+0000 7f0223646b80 1 -- 172.21.15.17:0/1889838924 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556042e94050 con 0x556042ff6910 2023-07-14T13:19:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.080+0000 7f020db9b700 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556042ff6910 0x556042ff8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.081+0000 7f01f17fa700 10 client.19038 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.081+0000 7f020db9b700 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556042ff6910 0x556042ff8cf0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3d36fcaad56bc46 server_cookie=1b426ca65eccf93e in_seq=0 out_seq=0 2023-07-14T13:19:33.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f01f17fa700 1 -- 172.21.15.17:0/1889838924 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556042e94050 con 0x556042ff6910 2023-07-14T13:19:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f01f17fa700 10 client.19038 handle_command_reply: tid=0 2023-07-14T13:19:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f0223646b80 1 client.19038 shutdown 2023-07-14T13:19:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f0223646b80 1 -- 172.21.15.17:0/1889838924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 msgr2=0x556042f96820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f0223646b80 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 0x556042f96820 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x556042f86910 tx=0x7f01f8004ae0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f0223646b80 1 -- 172.21.15.17:0/1889838924 shutdown_connections 2023-07-14T13:19:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f0223646b80 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556042ff6910 0x556042ff8cf0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f0223646b80 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556042f96d60 0x556042f971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f01f17fa700 0 client.19038 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f0223646b80 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556042f862d0 0x556042f985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f0223646b80 1 --2- 172.21.15.17:0/1889838924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556042f91ad0 0x556042f96820 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.082+0000 7f0223646b80 1 -- 172.21.15.17:0/1889838924 >> 172.21.15.17:0/1889838924 conn(0x556042f7cda0 msgr2=0x556042f89ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.083+0000 7f0223646b80 1 -- 172.21.15.17:0/1889838924 shutdown_connections 2023-07-14T13:19:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.083+0000 7f0223646b80 1 -- 172.21.15.17:0/1889838924 wait complete. 2023-07-14T13:19:33.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.084+0000 7f0223646b80 20 client.19038 trim_cache size 0 max 16384 2023-07-14T13:19:33.117 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:19:33.117 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T13:19:33.117 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": { 2023-07-14T13:19:33.117 INFO:teuthology.orchestra.run.smithi017.stdout: "10a445bb-1e99-4893-a951-f616a7765afb": { 2023-07-14T13:19:33.117 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/", 2023-07-14T13:19:33.118 INFO:teuthology.orchestra.run.smithi017.stdout: "tag": "10a445bb-1e99-4893-a951-f616a7765afb", 2023-07-14T13:19:33.118 INFO:teuthology.orchestra.run.smithi017.stdout: "options": "recursive,force" 2023-07-14T13:19:33.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:19:33.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:19:33.118 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:19:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.087+0000 7f020fdff700 1 -- 172.21.15.17:0/2385925158 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f01f40a1340 msgr2=0x7f01f40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:33.119 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.087+0000 7f020fdff700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f01f40a1340 0x7f01f40a37f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f020000a4c0 tx=0x7f020000c040 comp rx=0 tx=0).stop 2023-07-14T13:19:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.087+0000 7f020fdff700 1 -- 172.21.15.17:0/2385925158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080fea90 msgr2=0x7f020810e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.087+0000 7f020fdff700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080fea90 0x7f020810e8c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f020401c5d0 tx=0x7f020401ccd0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.089+0000 7f020fdff700 1 -- 172.21.15.17:0/2385925158 shutdown_connections 2023-07-14T13:19:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.089+0000 7f020fdff700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f01f40a1340 0x7f01f40a37f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.089+0000 7f020fdff700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0208103e40 0x7f02081c1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.089+0000 7f020fdff700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02080fea90 0x7f020810e8c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.089+0000 7f020fdff700 1 --2- 172.21.15.17:0/2385925158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02080ff3a0 0x7f020810ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.089+0000 7f020fdff700 1 -- 172.21.15.17:0/2385925158 >> 172.21.15.17:0/2385925158 conn(0x7f02080fa4b0 msgr2=0x7f0208101990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:33.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.089+0000 7f020fdff700 1 -- 172.21.15.17:0/2385925158 shutdown_connections 2023-07-14T13:19:33.122 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:19:33.090+0000 7f020fdff700 1 -- 172.21.15.17:0/2385925158 wait complete. 2023-07-14T13:19:33.151 INFO:tasks.cephfs.filesystem:scrub status for tag:10a445bb-1e99-4893-a951-f616a7765afb - {'path': '/', 'tag': '10a445bb-1e99-4893-a951-f616a7765afb', 'options': 'recursive,force'} 2023-07-14T13:19:33.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:33 smithi017 ceph-mon[95536]: pgmap v625: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-07-14T13:19:33.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:33 smithi017 ceph-mon[95536]: scrub queued for path: / 2023-07-14T13:19:33.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:33 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:33.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:33 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:19:33.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:33 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:19:33.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:33 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:33.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:33 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:33.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:33 smithi135 ceph-mon[97338]: pgmap v625: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-07-14T13:19:33.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:33 smithi135 ceph-mon[97338]: scrub queued for path: / 2023-07-14T13:19:33.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:33 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:33.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:33 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:19:33.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:33 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:19:33.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:33 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:33.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:33 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:33.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:33 smithi131 ceph-mon[96953]: pgmap v625: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-07-14T13:19:33.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:33 smithi131 ceph-mon[96953]: scrub queued for path: / 2023-07-14T13:19:33.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:33 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:33.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:33 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:19:33.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:33 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:19:33.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:33 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:33.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:33 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:34.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:34 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:19:34.609 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:34 smithi017 ceph-mon[95536]: Scrub error on inode 0x20000000231 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000007F) see mds.h log and `damage ls` output for details 2023-07-14T13:19:34.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:34 smithi017 ceph-mon[95536]: Scrub error on inode 0x2000000022e (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/000000010000000100000078) see mds.h log and `damage ls` output for details 2023-07-14T13:19:34.610 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:34 smithi017 ceph-mon[95536]: Scrub error on inode 0x200000001fc (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000008D) see mds.h log and `damage ls` output for details 2023-07-14T13:19:34.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:34 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:19:34.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:34 smithi135 ceph-mon[97338]: Scrub error on inode 0x20000000231 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000007F) see mds.h log and `damage ls` output for details 2023-07-14T13:19:34.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:34 smithi135 ceph-mon[97338]: Scrub error on inode 0x2000000022e (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/000000010000000100000078) see mds.h log and `damage ls` output for details 2023-07-14T13:19:34.700 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:34 smithi135 ceph-mon[97338]: Scrub error on inode 0x200000001fc (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000008D) see mds.h log and `damage ls` output for details 2023-07-14T13:19:34.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:34 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:19:34.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:34 smithi131 ceph-mon[96953]: Scrub error on inode 0x20000000231 (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000007F) see mds.h log and `damage ls` output for details 2023-07-14T13:19:34.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:34 smithi131 ceph-mon[96953]: Scrub error on inode 0x2000000022e (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/000000010000000100000078) see mds.h log and `damage ls` output for details 2023-07-14T13:19:34.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:34 smithi131 ceph-mon[96953]: Scrub error on inode 0x200000001fc (/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000008D) see mds.h log and `damage ls` output for details 2023-07-14T13:19:35.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:35 smithi017 ceph-mon[95536]: pgmap v626: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-07-14T13:19:35.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:35 smithi135 ceph-mon[97338]: pgmap v626: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-07-14T13:19:35.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:35 smithi131 ceph-mon[96953]: pgmap v626: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-07-14T13:19:36.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:36 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:19:36.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:36 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:19:36.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:36 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:19:36.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:36 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:19:36.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:36 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:19:36.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:36 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:19:36.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:36 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:19:36.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:36 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:19:36.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:36 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:19:37.450 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 85.0 s, 673.4 tps, lat 135.437 ms stddev 42.812 2023-07-14T13:19:37.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:37 smithi017 ceph-mon[95536]: pgmap v627: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 25 MiB/s wr, 1.70k op/s 2023-07-14T13:19:37.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:37 smithi135 ceph-mon[97338]: pgmap v627: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 25 MiB/s wr, 1.70k op/s 2023-07-14T13:19:37.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:37 smithi131 ceph-mon[96953]: pgmap v627: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 25 MiB/s wr, 1.70k op/s 2023-07-14T13:19:39.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:39 smithi017 ceph-mon[95536]: pgmap v628: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 16 MiB/s wr, 1.08k op/s 2023-07-14T13:19:39.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:39 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-a[95512]: 2023-07-14T13:19:39.302+0000 7ff2c0aee700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-07-14T13:19:39.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:39 smithi135 ceph-mon[97338]: pgmap v628: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 16 MiB/s wr, 1.08k op/s 2023-07-14T13:19:39.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:39 smithi131 ceph-mon[96953]: pgmap v628: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 16 MiB/s wr, 1.08k op/s 2023-07-14T13:19:40.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:40 smithi017 ceph-mon[95536]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-07-14T13:19:40.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:40 smithi017 ceph-mon[95536]: mds.? [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] up:active 2023-07-14T13:19:40.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:40 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:19:40.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:40 smithi017 ceph-mon[95536]: pgmap v629: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 24 MiB/s wr, 1.65k op/s 2023-07-14T13:19:40.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:40 smithi135 ceph-mon[97338]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-07-14T13:19:40.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:40 smithi135 ceph-mon[97338]: mds.? [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] up:active 2023-07-14T13:19:40.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:40 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:19:40.699 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:40 smithi135 ceph-mon[97338]: pgmap v629: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 24 MiB/s wr, 1.65k op/s 2023-07-14T13:19:40.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:40 smithi131 ceph-mon[96953]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-07-14T13:19:40.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:40 smithi131 ceph-mon[96953]: mds.? [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] up:active 2023-07-14T13:19:40.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:40 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:19:40.748 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:40 smithi131 ceph-mon[96953]: pgmap v629: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 24 MiB/s wr, 1.65k op/s 2023-07-14T13:19:42.450 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 90.0 s, 293.0 tps, lat 151.361 ms stddev 509.136 2023-07-14T13:19:43.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:43 smithi017 ceph-mon[95536]: pgmap v630: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2023-07-14T13:19:43.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:43 smithi135 ceph-mon[97338]: pgmap v630: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2023-07-14T13:19:43.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:43 smithi131 ceph-mon[96953]: pgmap v630: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2023-07-14T13:19:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.493+0000 7f54939ff700 1 -- 172.21.15.17:0/1123424811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f548c067ee0 msgr2=0x7f548c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.493+0000 7f54939ff700 1 --2- 172.21.15.17:0/1123424811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f548c067ee0 0x7f548c068350 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f547c009990 tx=0x7f547c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.494+0000 7f54939ff700 1 -- 172.21.15.17:0/1123424811 shutdown_connections 2023-07-14T13:19:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.494+0000 7f54939ff700 1 --2- 172.21.15.17:0/1123424811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f548c1024f0 0x7f548c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.494+0000 7f54939ff700 1 --2- 172.21.15.17:0/1123424811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f548c104a60 0x7f548c0679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.494+0000 7f54939ff700 1 --2- 172.21.15.17:0/1123424811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f548c067ee0 0x7f548c068350 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.494+0000 7f54939ff700 1 -- 172.21.15.17:0/1123424811 >> 172.21.15.17:0/1123424811 conn(0x7f548c074760 msgr2=0x7f548c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.495+0000 7f54939ff700 1 -- 172.21.15.17:0/1123424811 shutdown_connections 2023-07-14T13:19:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.495+0000 7f54939ff700 1 -- 172.21.15.17:0/1123424811 wait complete. 2023-07-14T13:19:44.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.496+0000 7f54939ff700 1 Processor -- start 2023-07-14T13:19:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.497+0000 7f54939ff700 1 -- start start 2023-07-14T13:19:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.497+0000 7f54939ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f548c067ee0 0x7f548c19c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.497+0000 7f54939ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f548c1024f0 0x7f548c19c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.498+0000 7f549179b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f548c067ee0 0x7f548c19c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.498+0000 7f549179b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f548c067ee0 0x7f548c19c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34500/0 (socket says 172.21.15.17:34500) 2023-07-14T13:19:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.498+0000 7f54939ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f548c104a60 0x7f548c1a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.498+0000 7f5490f9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f548c1024f0 0x7f548c19c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.498+0000 7f54939ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1a12d0 con 0x7f548c104a60 2023-07-14T13:19:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.498+0000 7f54939ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1a1440 con 0x7f548c1024f0 2023-07-14T13:19:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.498+0000 7f5490f9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f548c1024f0 0x7f548c19c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:37942/0 (socket says 172.21.15.17:37942) 2023-07-14T13:19:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.498+0000 7f5490f9a700 1 -- 172.21.15.17:0/1549401052 learned_addr learned my addr 172.21.15.17:0/1549401052 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.498+0000 7f54939ff700 1 -- 172.21.15.17:0/1549401052 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1a1600 con 0x7f548c067ee0 2023-07-14T13:19:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.498+0000 7f5491f9c700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f548c104a60 0x7f548c1a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.499+0000 7f5490f9a700 1 -- 172.21.15.17:0/1549401052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f548c067ee0 msgr2=0x7f548c19c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.499+0000 7f5490f9a700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f548c067ee0 0x7f548c19c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.499+0000 7f5490f9a700 1 -- 172.21.15.17:0/1549401052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f548c104a60 msgr2=0x7f548c1a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.499+0000 7f5490f9a700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f548c104a60 0x7f548c1a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.499+0000 7f5490f9a700 1 -- 172.21.15.17:0/1549401052 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0095f0 con 0x7f548c1024f0 2023-07-14T13:19:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.501+0000 7f5490f9a700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f548c1024f0 0x7f548c19c620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f547c005740 tx=0x7f547c005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.501+0000 7f54827fc700 1 -- 172.21.15.17:0/1549401052 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c01d070 con 0x7f548c1024f0 2023-07-14T13:19:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.501+0000 7f54939ff700 1 -- 172.21.15.17:0/1549401052 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c1a1880 con 0x7f548c1024f0 2023-07-14T13:19:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.501+0000 7f54827fc700 1 -- 172.21.15.17:0/1549401052 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f547c022470 con 0x7f548c1024f0 2023-07-14T13:19:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.501+0000 7f54827fc700 1 -- 172.21.15.17:0/1549401052 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c017650 con 0x7f548c1024f0 2023-07-14T13:19:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.501+0000 7f54939ff700 1 -- 172.21.15.17:0/1549401052 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c1a9120 con 0x7f548c1024f0 2023-07-14T13:19:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.507+0000 7f54827fc700 1 -- 172.21.15.17:0/1549401052 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f547c00fb00 con 0x7f548c1024f0 2023-07-14T13:19:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.507+0000 7f54a7274b80 1 Processor -- start 2023-07-14T13:19:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.507+0000 7f54a7274b80 1 -- start start 2023-07-14T13:19:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.508+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 0x56402862ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.508+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 0x564028625040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.508+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564028625580 0x5640286259d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.508+0000 7f54a7274b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402852ac50 con 0x56402862b2d0 2023-07-14T13:19:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.508+0000 7f54a7274b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402857d9e0 con 0x5640284816b0 2023-07-14T13:19:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.508+0000 7f54a7274b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028576e70 con 0x564028625580 2023-07-14T13:19:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.509+0000 7f549179b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 0x564028625040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.509+0000 7f549179b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 0x564028625040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41084/0 (socket says 172.21.15.17:41084) 2023-07-14T13:19:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.509+0000 7f549179b700 1 -- 172.21.15.17:0/3585832808 learned_addr learned my addr 172.21.15.17:0/3585832808 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.509+0000 7f5491f9c700 1 --2- 172.21.15.17:0/3585832808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 0x56402862ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.509+0000 7f549179b700 1 -- 172.21.15.17:0/3585832808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564028625580 msgr2=0x5640286259d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:19:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.509+0000 7f549179b700 1 --2- 172.21.15.17:0/3585832808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564028625580 0x5640286259d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.509+0000 7f549179b700 1 -- 172.21.15.17:0/3585832808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 msgr2=0x56402862ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.509+0000 7f549179b700 1 --2- 172.21.15.17:0/3585832808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 0x56402862ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.509+0000 7f549179b700 1 -- 172.21.15.17:0/3585832808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640283a4d80 con 0x56402862b2d0 2023-07-14T13:19:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.510+0000 7f549179b700 1 --2- 172.21.15.17:0/3585832808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 0x564028625040 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f5484011650 tx=0x7f5484009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e76c9b4b78f653a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.510+0000 7f54777fe700 1 -- 172.21.15.17:0/3585832808 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400e040 con 0x56402862b2d0 2023-07-14T13:19:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.510+0000 7f54777fe700 1 -- 172.21.15.17:0/3585832808 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f548400f040 con 0x56402862b2d0 2023-07-14T13:19:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.510+0000 7f54777fe700 1 -- 172.21.15.17:0/3585832808 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484015780 con 0x56402862b2d0 2023-07-14T13:19:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.510+0000 7f54827fc700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54780a1340 0x7f54780a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.510+0000 7f54827fc700 1 -- 172.21.15.17:0/1549401052 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f547c0ce270 con 0x7f548c1024f0 2023-07-14T13:19:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.510+0000 7f5491f9c700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54780a1340 0x7f54780a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.511+0000 7f54a7274b80 1 -- 172.21.15.17:0/3585832808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 msgr2=0x564028625040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.511+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3585832808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 0x564028625040 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f5484011650 tx=0x7f5484009920 comp rx=0 tx=0).stop 2023-07-14T13:19:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.511+0000 7f54a7274b80 1 -- 172.21.15.17:0/3585832808 shutdown_connections 2023-07-14T13:19:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.511+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3585832808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564028625580 0x5640286259d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.511+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3585832808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 0x56402862ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.511+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3585832808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 0x564028625040 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.511+0000 7f54a7274b80 1 -- 172.21.15.17:0/3585832808 >> 172.21.15.17:0/3585832808 conn(0x56402861abe0 msgr2=0x56402861ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.512+0000 7f5491f9c700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54780a1340 0x7f54780a37f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5488005950 tx=0x7f548800b390 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.512+0000 7f54a7274b80 1 -- 172.21.15.17:0/3585832808 shutdown_connections 2023-07-14T13:19:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.512+0000 7f54a7274b80 1 -- 172.21.15.17:0/3585832808 wait complete. 2023-07-14T13:19:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.513+0000 7f54a7274b80 1 -- start start 2023-07-14T13:19:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.513+0000 7f54a7274b80 1 Processor -- start 2023-07-14T13:19:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.514+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640284816b0 0x5640286315a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.514+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564028625580 0x56402862e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.514+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402862ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.514+0000 7f54a7274b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028516a60 con 0x5640284816b0 2023-07-14T13:19:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.514+0000 7f54a7274b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028516760 con 0x564028625580 2023-07-14T13:19:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.514+0000 7f54a7274b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640283fa8c0 con 0x56402862b2d0 2023-07-14T13:19:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.514+0000 7f54a7274b80 10 client.0 _ll_register_callbacks cb 0x564028514700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.515+0000 7f5491f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402862ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.515+0000 7f5491f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402862ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34516/0 (socket says 172.21.15.17:34516) 2023-07-14T13:19:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.515+0000 7f5491f9c700 1 -- 172.21.15.17:0/789237632 learned_addr learned my addr 172.21.15.17:0/789237632 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.515+0000 7f5491f9c700 1 -- 172.21.15.17:0/789237632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564028625580 msgr2=0x56402862e890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:19:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.515+0000 7f5491f9c700 1 --2- 172.21.15.17:0/789237632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564028625580 0x56402862e890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.515+0000 7f5491f9c700 1 -- 172.21.15.17:0/789237632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640284816b0 msgr2=0x5640286315a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.515+0000 7f5491f9c700 1 --2- 172.21.15.17:0/789237632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640284816b0 0x5640286315a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.515+0000 7f5491f9c700 1 -- 172.21.15.17:0/789237632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5484011330 con 0x56402862b2d0 2023-07-14T13:19:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.516+0000 7f5491f9c700 1 --2- 172.21.15.17:0/789237632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402862ef10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f548800b620 tx=0x7f54880047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=673df2218ad0d454 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.516+0000 7f5474ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:19:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.516+0000 7f5474ff9700 1 -- 172.21.15.17:0/789237632 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488016070 con 0x56402862b2d0 2023-07-14T13:19:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.516+0000 7f5474ff9700 1 -- 172.21.15.17:0/789237632 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f548801fad0 con 0x56402862b2d0 2023-07-14T13:19:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.516+0000 7f54a7274b80 1 -- 172.21.15.17:0/789237632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640284d0490 con 0x56402862b2d0 2023-07-14T13:19:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.517+0000 7f5474ff9700 1 -- 172.21.15.17:0/789237632 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f548801fc90 con 0x56402862b2d0 2023-07-14T13:19:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.517+0000 7f54a7274b80 10 client.28750 fetch_fsmap learned FSMap version 53 2023-07-14T13:19:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.517+0000 7f54a7274b80 1 -- 172.21.15.17:0/789237632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x56402838dc00 con 0x56402862b2d0 2023-07-14T13:19:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.517+0000 7f5474ff9700 1 -- 172.21.15.17:0/789237632 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5640284d0490 con 0x56402862b2d0 2023-07-14T13:19:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.517+0000 7f5474ff9700 1 -- 172.21.15.17:0/789237632 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f548802f070 con 0x56402862b2d0 2023-07-14T13:19:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.517+0000 7f54a7274b80 10 client.28750 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:19:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.517+0000 7f54a7274b80 10 client.28750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.517+0000 7f54a7274b80 20 client.28750 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.517+0000 7f54a7274b80 1 --2- 172.21.15.17:0/789237632 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402864fd10 0x564028652140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.517+0000 7f54a7274b80 4 client.28750 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:19:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.517+0000 7f54a7274b80 1 -- 172.21.15.17:0/789237632 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56402856fe50 con 0x56402864fd10 2023-07-14T13:19:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.518+0000 7f549179b700 1 --2- 172.21.15.17:0/789237632 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402864fd10 0x564028652140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.519+0000 7f549179b700 1 --2- 172.21.15.17:0/789237632 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402864fd10 0x564028652140 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17808a6791fb522d server_cookie=9e36e08bd0c73c0 in_seq=0 out_seq=0 2023-07-14T13:19:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.519+0000 7f5474ff9700 10 client.28750 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.520+0000 7f5474ff9700 1 -- 172.21.15.17:0/789237632 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56402856fe50 con 0x56402864fd10 2023-07-14T13:19:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.520+0000 7f5474ff9700 10 client.28750 handle_command_reply: tid=0 2023-07-14T13:19:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.520+0000 7f54a7274b80 1 client.28750 shutdown 2023-07-14T13:19:44.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.521+0000 7f54a7274b80 1 -- 172.21.15.17:0/789237632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 msgr2=0x56402862ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:44.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.521+0000 7f54a7274b80 1 --2- 172.21.15.17:0/789237632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402862ef10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f548800b620 tx=0x7f54880047c0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.522+0000 7f54a7274b80 1 -- 172.21.15.17:0/789237632 shutdown_connections 2023-07-14T13:19:44.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.522+0000 7f54a7274b80 1 --2- 172.21.15.17:0/789237632 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56402864fd10 0x564028652140 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.522+0000 7f54a7274b80 1 --2- 172.21.15.17:0/789237632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402862ef10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.522+0000 7f54a7274b80 1 --2- 172.21.15.17:0/789237632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5640284816b0 0x5640286315a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.522+0000 7f54a7274b80 1 --2- 172.21.15.17:0/789237632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564028625580 0x56402862e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.522+0000 7f54a7274b80 1 -- 172.21.15.17:0/789237632 >> 172.21.15.17:0/789237632 conn(0x56402861abe0 msgr2=0x56402861ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.522+0000 7f5474ff9700 0 client.28750 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.522+0000 7f54a7274b80 1 -- 172.21.15.17:0/789237632 shutdown_connections 2023-07-14T13:19:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.522+0000 7f54a7274b80 1 -- 172.21.15.17:0/789237632 wait complete. 2023-07-14T13:19:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.523+0000 7f54a7274b80 20 client.28750 trim_cache size 0 max 16384 2023-07-14T13:19:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.549+0000 7f54a7274b80 1 Processor -- start 2023-07-14T13:19:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.549+0000 7f54a7274b80 1 -- start start 2023-07-14T13:19:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.549+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640284816b0 0x564028635c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.549+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564028625580 0x56402862a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.549+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 0x56402861fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.549+0000 7f54a7274b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402862a9e0 con 0x56402862b2d0 2023-07-14T13:19:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.550+0000 7f54a7274b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028617bb0 con 0x564028625580 2023-07-14T13:19:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.550+0000 7f54a7274b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402862fbe0 con 0x5640284816b0 2023-07-14T13:19:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.550+0000 7f5491f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 0x56402861fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.550+0000 7f5491f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 0x56402861fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41104/0 (socket says 172.21.15.17:41104) 2023-07-14T13:19:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.550+0000 7f549179b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640284816b0 0x564028635c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.550+0000 7f5491f9c700 1 -- 172.21.15.17:0/3039456385 learned_addr learned my addr 172.21.15.17:0/3039456385 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.551+0000 7f5490f9a700 1 --2- 172.21.15.17:0/3039456385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564028625580 0x56402862a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.551+0000 7f549179b700 1 -- 172.21.15.17:0/3039456385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564028625580 msgr2=0x56402862a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.551+0000 7f549179b700 1 --2- 172.21.15.17:0/3039456385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564028625580 0x56402862a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.551+0000 7f549179b700 1 -- 172.21.15.17:0/3039456385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 msgr2=0x56402861fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.551+0000 7f549179b700 1 --2- 172.21.15.17:0/3039456385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 0x56402861fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.551+0000 7f549179b700 1 -- 172.21.15.17:0/3039456385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640283cb1f0 con 0x5640284816b0 2023-07-14T13:19:44.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.555+0000 7f549179b700 1 --2- 172.21.15.17:0/3039456385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640284816b0 0x564028635c60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5484009040 tx=0x7f548400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=256365fa2beb11ea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:44.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.555+0000 7f5477fff700 1 -- 172.21.15.17:0/3039456385 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548400e040 con 0x5640284816b0 2023-07-14T13:19:44.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.555+0000 7f5477fff700 1 -- 172.21.15.17:0/3039456385 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5484009460 con 0x5640284816b0 2023-07-14T13:19:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.555+0000 7f5477fff700 1 -- 172.21.15.17:0/3039456385 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484007850 con 0x5640284816b0 2023-07-14T13:19:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.556+0000 7f54a7274b80 1 -- 172.21.15.17:0/3039456385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640284816b0 msgr2=0x564028635c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.556+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3039456385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640284816b0 0x564028635c60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5484009040 tx=0x7f548400b040 comp rx=0 tx=0).stop 2023-07-14T13:19:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.556+0000 7f54a7274b80 1 -- 172.21.15.17:0/3039456385 shutdown_connections 2023-07-14T13:19:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.556+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3039456385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56402862b2d0 0x56402861fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.556+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3039456385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5640284816b0 0x564028635c60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.556+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3039456385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564028625580 0x56402862a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.556+0000 7f54a7274b80 1 -- 172.21.15.17:0/3039456385 >> 172.21.15.17:0/3039456385 conn(0x56402861abe0 msgr2=0x564028629a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.557+0000 7f54a7274b80 1 -- 172.21.15.17:0/3039456385 shutdown_connections 2023-07-14T13:19:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.557+0000 7f54a7274b80 1 -- 172.21.15.17:0/3039456385 wait complete. 2023-07-14T13:19:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.557+0000 7f54a7274b80 1 -- start start 2023-07-14T13:19:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.558+0000 7f54a7274b80 1 Processor -- start 2023-07-14T13:19:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.558+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 0x564028627a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.558+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564028625580 0x564028627fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.558+0000 7f54a7274b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402869ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.558+0000 7f54a7274b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640286360b0 con 0x564028625580 2023-07-14T13:19:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.558+0000 7f54a7274b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028636220 con 0x5640284816b0 2023-07-14T13:19:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.558+0000 7f54a7274b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56402869f140 con 0x56402862b2d0 2023-07-14T13:19:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.558+0000 7f54a7274b80 10 client.0 _ll_register_callbacks cb 0x7f54880038a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.559+0000 7f549179b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 0x564028627a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.559+0000 7f5491f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402869ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.559+0000 7f549179b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 0x564028627a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:37966/0 (socket says 172.21.15.17:37966) 2023-07-14T13:19:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.559+0000 7f549179b700 1 -- 172.21.15.17:0/3177674623 learned_addr learned my addr 172.21.15.17:0/3177674623 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.559+0000 7f5491f9c700 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402869ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34530/0 (socket says 172.21.15.17:34530) 2023-07-14T13:19:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.559+0000 7f5491f9c700 1 -- 172.21.15.17:0/3177674623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 msgr2=0x564028627a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.559+0000 7f5491f9c700 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 0x564028627a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.559+0000 7f5491f9c700 1 -- 172.21.15.17:0/3177674623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564028625580 msgr2=0x564028627fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.559+0000 7f5491f9c700 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564028625580 0x564028627fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.559+0000 7f5491f9c700 1 -- 172.21.15.17:0/3177674623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640283a4d80 con 0x56402862b2d0 2023-07-14T13:19:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.559+0000 7f549179b700 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 0x564028627a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:19:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.560+0000 7f5491f9c700 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402869ec00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5488027f10 tx=0x7f5488011c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c0ae873301bb0e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.560+0000 7f5474ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:19:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.560+0000 7f5474ff9700 1 -- 172.21.15.17:0/3177674623 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488016070 con 0x56402862b2d0 2023-07-14T13:19:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.560+0000 7f54a7274b80 1 -- 172.21.15.17:0/3177674623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564028531ff0 con 0x56402862b2d0 2023-07-14T13:19:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.560+0000 7f5474ff9700 1 -- 172.21.15.17:0/3177674623 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f548801fce0 con 0x56402862b2d0 2023-07-14T13:19:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.561+0000 7f5474ff9700 1 -- 172.21.15.17:0/3177674623 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f548801fea0 con 0x56402862b2d0 2023-07-14T13:19:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.561+0000 7f54a7274b80 10 client.28756 fetch_fsmap learned FSMap version 53 2023-07-14T13:19:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.561+0000 7f54a7274b80 1 -- 172.21.15.17:0/3177674623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5640283a3250 con 0x56402862b2d0 2023-07-14T13:19:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.561+0000 7f5474ff9700 1 -- 172.21.15.17:0/3177674623 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564028531ff0 con 0x56402862b2d0 2023-07-14T13:19:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.562+0000 7f5474ff9700 1 -- 172.21.15.17:0/3177674623 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5488003be0 con 0x56402862b2d0 2023-07-14T13:19:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.562+0000 7f54a7274b80 10 client.28756 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:19:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.562+0000 7f54a7274b80 10 client.28756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.562+0000 7f54a7274b80 20 client.28756 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.562+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564028634c70 0x564028635070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.562+0000 7f54a7274b80 4 client.28756 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:19:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.562+0000 7f54a7274b80 1 -- 172.21.15.17:0/3177674623 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5640283c5f10 con 0x564028634c70 2023-07-14T13:19:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.562+0000 7f549179b700 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564028634c70 0x564028635070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.563+0000 7f5474ff9700 10 client.28756 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.563+0000 7f549179b700 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564028634c70 0x564028635070 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a9128f3b5ec7880 server_cookie=bf9e14a3c844b526 in_seq=0 out_seq=0 2023-07-14T13:19:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.574+0000 7f5474ff9700 1 -- 172.21.15.17:0/3177674623 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5640283c5f10 con 0x564028634c70 2023-07-14T13:19:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.574+0000 7f5474ff9700 10 client.28756 handle_command_reply: tid=0 2023-07-14T13:19:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.574+0000 7f54a7274b80 1 client.28756 shutdown 2023-07-14T13:19:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.574+0000 7f54a7274b80 1 -- 172.21.15.17:0/3177674623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 msgr2=0x56402869ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.574+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402869ec00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5488027f10 tx=0x7f5488011c10 comp rx=0 tx=0).stop 2023-07-14T13:19:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.575+0000 7f54a7274b80 1 -- 172.21.15.17:0/3177674623 shutdown_connections 2023-07-14T13:19:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.575+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564028634c70 0x564028635070 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.575+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56402862b2d0 0x56402869ec00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.575+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640284816b0 0x564028627a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.575+0000 7f54a7274b80 1 --2- 172.21.15.17:0/3177674623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564028625580 0x564028627fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.575+0000 7f54a7274b80 1 -- 172.21.15.17:0/3177674623 >> 172.21.15.17:0/3177674623 conn(0x56402861abe0 msgr2=0x56402862a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.575+0000 7f5474ff9700 0 client.28756 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.575+0000 7f54a7274b80 1 -- 172.21.15.17:0/3177674623 shutdown_connections 2023-07-14T13:19:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.575+0000 7f54a7274b80 1 -- 172.21.15.17:0/3177674623 wait complete. 2023-07-14T13:19:44.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.576+0000 7f54a7274b80 20 client.28756 trim_cache size 0 max 16384 2023-07-14T13:19:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:19:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:19:44.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:19:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:19:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.580+0000 7f54939ff700 1 -- 172.21.15.17:0/1549401052 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54780a1340 msgr2=0x7f54780a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.581+0000 7f54939ff700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54780a1340 0x7f54780a37f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5488005950 tx=0x7f548800b390 comp rx=0 tx=0).stop 2023-07-14T13:19:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.581+0000 7f54939ff700 1 -- 172.21.15.17:0/1549401052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f548c1024f0 msgr2=0x7f548c19c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:44.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.581+0000 7f54939ff700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f548c1024f0 0x7f548c19c620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f547c005740 tx=0x7f547c005770 comp rx=0 tx=0).stop 2023-07-14T13:19:44.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.581+0000 7f54939ff700 1 -- 172.21.15.17:0/1549401052 shutdown_connections 2023-07-14T13:19:44.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.581+0000 7f54939ff700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f54780a1340 0x7f54780a37f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.581+0000 7f54939ff700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f548c104a60 0x7f548c1a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.581+0000 7f54939ff700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f548c067ee0 0x7f548c19c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.581+0000 7f54939ff700 1 --2- 172.21.15.17:0/1549401052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f548c1024f0 0x7f548c19c620 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:44.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.581+0000 7f54939ff700 1 -- 172.21.15.17:0/1549401052 >> 172.21.15.17:0/1549401052 conn(0x7f548c074760 msgr2=0x7f548c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:44.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.582+0000 7f54939ff700 1 -- 172.21.15.17:0/1549401052 shutdown_connections 2023-07-14T13:19:44.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:44.582+0000 7f54939ff700 1 -- 172.21.15.17:0/1549401052 wait complete. 2023-07-14T13:19:45.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:45 smithi017 ceph-mon[95536]: pgmap v631: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2023-07-14T13:19:45.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:45 smithi017 ceph-mon[95536]: scrub summary: active paths [/] 2023-07-14T13:19:45.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:45 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:45.608 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:45 smithi017 ceph-mon[95536]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:45.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:45 smithi135 ceph-mon[97338]: pgmap v631: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2023-07-14T13:19:45.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:45 smithi135 ceph-mon[97338]: scrub summary: active paths [/] 2023-07-14T13:19:45.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:45 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:45.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:45 smithi135 ceph-mon[97338]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:45.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:45 smithi131 ceph-mon[96953]: pgmap v631: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2023-07-14T13:19:45.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:45 smithi131 ceph-mon[96953]: scrub summary: active paths [/] 2023-07-14T13:19:45.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:45 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:45.747 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:45 smithi131 ceph-mon[96953]: scrub summary: idle+waiting paths [/] 2023-07-14T13:19:47.451 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 95.0 s, 457.2 tps, lat 360.896 ms stddev 1063.747 2023-07-14T13:19:47.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:47 smithi017 ceph-mon[95536]: pgmap v632: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2023-07-14T13:19:47.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:47 smithi135 ceph-mon[97338]: pgmap v632: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2023-07-14T13:19:47.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:47 smithi131 ceph-mon[96953]: pgmap v632: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2023-07-14T13:19:49.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:49 smithi017 ceph-mon[95536]: pgmap v633: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 9.7 MiB/s wr, 743 op/s 2023-07-14T13:19:49.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:49 smithi135 ceph-mon[97338]: pgmap v633: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 9.7 MiB/s wr, 743 op/s 2023-07-14T13:19:49.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:49 smithi131 ceph-mon[96953]: pgmap v633: 97 pgs: 97 active+clean; 15 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 9.7 MiB/s wr, 743 op/s 2023-07-14T13:19:51.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:51 smithi017 ceph-mon[95536]: pgmap v634: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 18 MiB/s wr, 1.32k op/s 2023-07-14T13:19:51.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:51 smithi135 ceph-mon[97338]: pgmap v634: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 18 MiB/s wr, 1.32k op/s 2023-07-14T13:19:51.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:51 smithi131 ceph-mon[96953]: pgmap v634: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 18 MiB/s wr, 1.32k op/s 2023-07-14T13:19:52.450 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 100.0 s, 513.5 tps, lat 146.461 ms stddev 43.038 2023-07-14T13:19:53.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:53 smithi017 ceph-mon[95536]: pgmap v635: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 10 MiB/s wr, 752 op/s 2023-07-14T13:19:53.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:53 smithi135 ceph-mon[97338]: pgmap v635: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 10 MiB/s wr, 752 op/s 2023-07-14T13:19:53.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:53 smithi131 ceph-mon[96953]: pgmap v635: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 10 MiB/s wr, 752 op/s 2023-07-14T13:19:55.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:55 smithi017 ceph-mon[95536]: pgmap v636: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 10 MiB/s wr, 752 op/s 2023-07-14T13:19:55.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:55 smithi135 ceph-mon[97338]: pgmap v636: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 10 MiB/s wr, 752 op/s 2023-07-14T13:19:55.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:55 smithi131 ceph-mon[96953]: pgmap v636: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 10 MiB/s wr, 752 op/s 2023-07-14T13:19:57.449 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 105.0 s, 519.9 tps, lat 238.454 ms stddev 537.579 2023-07-14T13:19:57.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:57 smithi017 ceph-mon[95536]: pgmap v637: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-07-14T13:19:57.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:57 smithi135 ceph-mon[97338]: pgmap v637: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-07-14T13:19:57.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:57 smithi131 ceph-mon[96953]: pgmap v637: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2023-07-14T13:19:57.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.847+0000 7fa8f4bff700 1 -- 172.21.15.17:0/3071786374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f00ffb30 msgr2=0x7fa8f00fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:57.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.847+0000 7fa8f4bff700 1 --2- 172.21.15.17:0/3071786374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f00ffb30 0x7fa8f00fffa0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009990 tx=0x7fa8d8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.851+0000 7fa8f4bff700 1 -- 172.21.15.17:0/3071786374 shutdown_connections 2023-07-14T13:19:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.851+0000 7fa8f4bff700 1 --2- 172.21.15.17:0/3071786374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f01004e0 0x7fa8f010c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.851+0000 7fa8f4bff700 1 --2- 172.21.15.17:0/3071786374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f0105b60 0x7fa8f0105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.851+0000 7fa8f4bff700 1 --2- 172.21.15.17:0/3071786374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f00ffb30 0x7fa8f00fffa0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.851+0000 7fa8f4bff700 1 -- 172.21.15.17:0/3071786374 >> 172.21.15.17:0/3071786374 conn(0x7fa8f00fb650 msgr2=0x7fa8f00fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.852+0000 7fa8f4bff700 1 -- 172.21.15.17:0/3071786374 shutdown_connections 2023-07-14T13:19:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.853+0000 7fa8f4bff700 1 -- 172.21.15.17:0/3071786374 wait complete. 2023-07-14T13:19:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.854+0000 7fa8f4bff700 1 Processor -- start 2023-07-14T13:19:57.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.855+0000 7fa8f4bff700 1 -- start start 2023-07-14T13:19:57.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.855+0000 7fa8f4bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f00ffb30 0x7fa8f010ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.855+0000 7fa8f4bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f01004e0 0x7fa8f010ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.855+0000 7fa8f4bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0105b60 0x7fa8f01136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.855+0000 7fa8f4bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f010f840 con 0x7fa8f0105b60 2023-07-14T13:19:57.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.855+0000 7fa8f4bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0113c10 con 0x7fa8f00ffb30 2023-07-14T13:19:57.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.855+0000 7fa8f4bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0113dd0 con 0x7fa8f01004e0 2023-07-14T13:19:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.856+0000 7fa8edd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f01004e0 0x7fa8f010ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.856+0000 7fa8edd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f01004e0 0x7fa8f010ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52336/0 (socket says 172.21.15.17:52336) 2023-07-14T13:19:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.856+0000 7fa8edd9b700 1 -- 172.21.15.17:0/1612540501 learned_addr learned my addr 172.21.15.17:0/1612540501 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.856+0000 7fa8eed9d700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0105b60 0x7fa8f01136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.857+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f00ffb30 0x7fa8f010ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.857+0000 7fa8eed9d700 1 -- 172.21.15.17:0/1612540501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f01004e0 msgr2=0x7fa8f010ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:57.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.857+0000 7fa8eed9d700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f01004e0 0x7fa8f010ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.857+0000 7fa8eed9d700 1 -- 172.21.15.17:0/1612540501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f00ffb30 msgr2=0x7fa8f010ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:57.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.857+0000 7fa8eed9d700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f00ffb30 0x7fa8f010ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.857+0000 7fa8eed9d700 1 -- 172.21.15.17:0/1612540501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d80095f0 con 0x7fa8f0105b60 2023-07-14T13:19:57.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.858+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f00ffb30 0x7fa8f010ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:19:57.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.858+0000 7fa8eed9d700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0105b60 0x7fa8f01136d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000efc0 tx=0x7fa8e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:57.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.858+0000 7fa8e77fe700 1 -- 172.21.15.17:0/1612540501 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0018070 con 0x7fa8f0105b60 2023-07-14T13:19:57.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.859+0000 7fa8e77fe700 1 -- 172.21.15.17:0/1612540501 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8e000f040 con 0x7fa8f0105b60 2023-07-14T13:19:57.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.859+0000 7fa8e77fe700 1 -- 172.21.15.17:0/1612540501 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e000cba0 con 0x7fa8f0105b60 2023-07-14T13:19:57.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.859+0000 7fa8f4bff700 1 -- 172.21.15.17:0/1612540501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f0113ff0 con 0x7fa8f0105b60 2023-07-14T13:19:57.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.859+0000 7fa8f4bff700 1 -- 172.21.15.17:0/1612540501 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f01144b0 con 0x7fa8f0105b60 2023-07-14T13:19:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.869+0000 7fa8e77fe700 1 -- 172.21.15.17:0/1612540501 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa8e0003a00 con 0x7fa8f0105b60 2023-07-14T13:19:57.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.872+0000 7fa908468b80 1 Processor -- start 2023-07-14T13:19:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.872+0000 7fa908468b80 1 -- start start 2023-07-14T13:19:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.872+0000 7fa908468b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e67fe6b0 0x5592e69a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.872+0000 7fa908468b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e69a82d0 0x5592e69a2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.873+0000 7fa908468b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.873+0000 7fa908468b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e68a7c50 con 0x5592e67fe6b0 2023-07-14T13:19:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.873+0000 7fa908468b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e68fa9e0 con 0x5592e69a2580 2023-07-14T13:19:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.873+0000 7fa908468b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e68f3e70 con 0x5592e69a82d0 2023-07-14T13:19:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.874+0000 7fa8e77fe700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa8d00a13f0 0x7fa8d00a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.874+0000 7fa8edd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.874+0000 7fa8edd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e67fe6b0 0x5592e69a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.874+0000 7fa8ee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e69a82d0 0x5592e69a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.874+0000 7fa8edd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e67fe6b0 0x5592e69a7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44130/0 (socket says 172.21.15.17:44130) 2023-07-14T13:19:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.874+0000 7fa8edd9b700 1 -- 172.21.15.17:0/3041430603 learned_addr learned my addr 172.21.15.17:0/3041430603 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.875+0000 7fa8e77fe700 1 -- 172.21.15.17:0/1612540501 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa8e00cc7c0 con 0x7fa8f0105b60 2023-07-14T13:19:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.876+0000 7fa8ee59c700 1 -- 172.21.15.17:0/3041430603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 msgr2=0x5592e69a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.876+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/3041430603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69a29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.876+0000 7fa8ee59c700 1 -- 172.21.15.17:0/3041430603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e67fe6b0 msgr2=0x5592e69a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.876+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/3041430603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e67fe6b0 0x5592e69a7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.876+0000 7fa8ee59c700 1 -- 172.21.15.17:0/3041430603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592e6721d80 con 0x5592e69a82d0 2023-07-14T13:19:57.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.876+0000 7fa8eed9d700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa8d00a13f0 0x7fa8d00a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.877+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/3041430603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:19:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.878+0000 7fa8eed9d700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa8d00a13f0 0x7fa8d00a38a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00c9f30 tx=0x7fa8e0004c50 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:57.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.878+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/3041430603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e69a82d0 0x5592e69a2040 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8011440 tx=0x7fa8e8011750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a729efdcc7dfe3e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.879+0000 7fa8e4ff9700 1 -- 172.21.15.17:0/3041430603 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8004230 con 0x5592e69a82d0 2023-07-14T13:19:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.880+0000 7fa8e4ff9700 1 -- 172.21.15.17:0/3041430603 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8e8004390 con 0x5592e69a82d0 2023-07-14T13:19:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.880+0000 7fa8e4ff9700 1 -- 172.21.15.17:0/3041430603 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800e890 con 0x5592e69a82d0 2023-07-14T13:19:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.881+0000 7fa908468b80 1 -- 172.21.15.17:0/3041430603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e69a82d0 msgr2=0x5592e69a2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.881+0000 7fa908468b80 1 --2- 172.21.15.17:0/3041430603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e69a82d0 0x5592e69a2040 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8011440 tx=0x7fa8e8011750 comp rx=0 tx=0).stop 2023-07-14T13:19:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.882+0000 7fa908468b80 1 -- 172.21.15.17:0/3041430603 shutdown_connections 2023-07-14T13:19:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.882+0000 7fa908468b80 1 --2- 172.21.15.17:0/3041430603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.882+0000 7fa908468b80 1 --2- 172.21.15.17:0/3041430603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e67fe6b0 0x5592e69a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.882+0000 7fa908468b80 1 --2- 172.21.15.17:0/3041430603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e69a82d0 0x5592e69a2040 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.882+0000 7fa908468b80 1 -- 172.21.15.17:0/3041430603 >> 172.21.15.17:0/3041430603 conn(0x5592e6997be0 msgr2=0x5592e699cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.882+0000 7fa908468b80 1 -- 172.21.15.17:0/3041430603 shutdown_connections 2023-07-14T13:19:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.882+0000 7fa908468b80 1 -- 172.21.15.17:0/3041430603 wait complete. 2023-07-14T13:19:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.883+0000 7fa908468b80 1 -- start start 2023-07-14T13:19:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.883+0000 7fa908468b80 1 Processor -- start 2023-07-14T13:19:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.884+0000 7fa908468b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e67fe6b0 0x5592e69ab910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.884+0000 7fa908468b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.884+0000 7fa908468b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e69a82d0 0x5592e69ac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.884+0000 7fa908468b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e6893a60 con 0x5592e67fe6b0 2023-07-14T13:19:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.884+0000 7fa908468b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e6893760 con 0x5592e69a2580 2023-07-14T13:19:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.884+0000 7fa908468b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e67778c0 con 0x5592e69a82d0 2023-07-14T13:19:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.884+0000 7fa908468b80 10 client.0 _ll_register_callbacks cb 0x5592e6891700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.885+0000 7fa8ee59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.885+0000 7fa8ee59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56308/0 (socket says 172.21.15.17:56308) 2023-07-14T13:19:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.885+0000 7fa8ee59c700 1 -- 172.21.15.17:0/3107050693 learned_addr learned my addr 172.21.15.17:0/3107050693 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.885+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e69a82d0 0x5592e69ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.885+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e67fe6b0 0x5592e69ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.885+0000 7fa8ee59c700 1 -- 172.21.15.17:0/3107050693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e69a82d0 msgr2=0x5592e69ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.885+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e69a82d0 0x5592e69ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.885+0000 7fa8ee59c700 1 -- 172.21.15.17:0/3107050693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e67fe6b0 msgr2=0x5592e69ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.885+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e67fe6b0 0x5592e69ab910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.885+0000 7fa8ee59c700 1 -- 172.21.15.17:0/3107050693 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e8009c90 con 0x5592e69a2580 2023-07-14T13:19:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.886+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69abe50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009230 tx=0x7fa8e8003960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20e5b48c0dca7983 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.886+0000 7fa8ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:19:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.887+0000 7fa8ddffb700 1 -- 172.21.15.17:0/3107050693 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8005240 con 0x5592e69a2580 2023-07-14T13:19:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.887+0000 7fa8ddffb700 1 -- 172.21.15.17:0/3107050693 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa8e80053a0 con 0x5592e69a2580 2023-07-14T13:19:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.887+0000 7fa908468b80 1 -- 172.21.15.17:0/3107050693 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5592e684d490 con 0x5592e69a2580 2023-07-14T13:19:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.888+0000 7fa8ddffb700 1 -- 172.21.15.17:0/3107050693 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8e8005560 con 0x5592e69a2580 2023-07-14T13:19:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.888+0000 7fa908468b80 10 client.28805 fetch_fsmap learned FSMap version 53 2023-07-14T13:19:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.888+0000 7fa908468b80 1 -- 172.21.15.17:0/3107050693 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5592e670ac00 con 0x5592e69a2580 2023-07-14T13:19:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.888+0000 7fa8ddffb700 1 -- 172.21.15.17:0/3107050693 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8e8031030 con 0x5592e69a2580 2023-07-14T13:19:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.889+0000 7fa8ddffb700 1 -- 172.21.15.17:0/3107050693 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa8e8028020 con 0x5592e69a2580 2023-07-14T13:19:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.889+0000 7fa908468b80 10 client.28805 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:19:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.889+0000 7fa908468b80 10 client.28805 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.889+0000 7fa908468b80 20 client.28805 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.889+0000 7fa908468b80 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592e69bbb00 0x5592e69bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.889+0000 7fa908468b80 4 client.28805 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:19:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.889+0000 7fa908468b80 1 -- 172.21.15.17:0/3107050693 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592e68ece50 con 0x5592e69bbb00 2023-07-14T13:19:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.890+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592e69bbb00 0x5592e69bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.893+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592e69bbb00 0x5592e69bdf10 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6adea9df554c2ef9 server_cookie=77c1e8a6581c36b7 in_seq=0 out_seq=0 2023-07-14T13:19:57.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.893+0000 7fa8ddffb700 10 client.28805 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.894+0000 7fa8ddffb700 1 -- 172.21.15.17:0/3107050693 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5592e68ece50 con 0x5592e69bbb00 2023-07-14T13:19:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.894+0000 7fa8ddffb700 10 client.28805 handle_command_reply: tid=0 2023-07-14T13:19:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.894+0000 7fa908468b80 1 client.28805 shutdown 2023-07-14T13:19:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.895+0000 7fa908468b80 1 -- 172.21.15.17:0/3107050693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 msgr2=0x5592e69abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:57.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.895+0000 7fa908468b80 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69abe50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa8e8009230 tx=0x7fa8e8003960 comp rx=0 tx=0).stop 2023-07-14T13:19:57.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.895+0000 7fa908468b80 1 -- 172.21.15.17:0/3107050693 shutdown_connections 2023-07-14T13:19:57.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.895+0000 7fa908468b80 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592e69bbb00 0x5592e69bdf10 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.895+0000 7fa908468b80 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e69a82d0 0x5592e69ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.895+0000 7fa908468b80 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e67fe6b0 0x5592e69ab910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.895+0000 7fa908468b80 1 --2- 172.21.15.17:0/3107050693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69abe50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.895+0000 7fa908468b80 1 -- 172.21.15.17:0/3107050693 >> 172.21.15.17:0/3107050693 conn(0x5592e6997be0 msgr2=0x5592e699c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:57.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.896+0000 7fa8ddffb700 0 client.28805 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:57.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.896+0000 7fa908468b80 1 -- 172.21.15.17:0/3107050693 shutdown_connections 2023-07-14T13:19:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.896+0000 7fa908468b80 1 -- 172.21.15.17:0/3107050693 wait complete. 2023-07-14T13:19:57.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.897+0000 7fa908468b80 20 client.28805 trim_cache size 0 max 16384 2023-07-14T13:19:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.933+0000 7fa908468b80 1 Processor -- start 2023-07-14T13:19:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.934+0000 7fa908468b80 1 -- start start 2023-07-14T13:19:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.934+0000 7fa908468b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69a2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.934+0000 7fa908468b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.934+0000 7fa908468b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e69a82d0 0x5592e69a71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.934+0000 7fa908468b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e6994b40 con 0x5592e69a82d0 2023-07-14T13:19:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.934+0000 7fa908468b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e69b31a0 con 0x5592e69a2580 2023-07-14T13:19:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.934+0000 7fa908468b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e69a6400 con 0x5592e67fe6b0 2023-07-14T13:19:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.934+0000 7fa8edd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.935+0000 7fa8edd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69a2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52362/0 (socket says 172.21.15.17:52362) 2023-07-14T13:19:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.935+0000 7fa8edd9b700 1 -- 172.21.15.17:0/964983862 learned_addr learned my addr 172.21.15.17:0/964983862 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.935+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/964983862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.935+0000 7fa8edd9b700 1 -- 172.21.15.17:0/964983862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 msgr2=0x5592e69b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:57.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.935+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/964983862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.935+0000 7fa8edd9b700 1 -- 172.21.15.17:0/964983862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e69a82d0 msgr2=0x5592e69a71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.935+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/964983862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e69a82d0 0x5592e69a71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.935+0000 7fa8edd9b700 1 -- 172.21.15.17:0/964983862 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592e67481f0 con 0x5592e67fe6b0 2023-07-14T13:19:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.936+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/964983862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69a2040 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8005950 tx=0x7fa8d80058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=664c93c8c1c402a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.937+0000 7fa8e57fa700 1 -- 172.21.15.17:0/964983862 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80041f0 con 0x5592e67fe6b0 2023-07-14T13:19:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.937+0000 7fa8e57fa700 1 -- 172.21.15.17:0/964983862 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8d802f070 con 0x5592e67fe6b0 2023-07-14T13:19:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.937+0000 7fa8e57fa700 1 -- 172.21.15.17:0/964983862 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8003680 con 0x5592e67fe6b0 2023-07-14T13:19:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.938+0000 7fa908468b80 1 -- 172.21.15.17:0/964983862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 msgr2=0x5592e69a2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.938+0000 7fa908468b80 1 --2- 172.21.15.17:0/964983862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69a2040 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8005950 tx=0x7fa8d80058e0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.938+0000 7fa908468b80 1 -- 172.21.15.17:0/964983862 shutdown_connections 2023-07-14T13:19:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.938+0000 7fa908468b80 1 --2- 172.21.15.17:0/964983862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e69a82d0 0x5592e69a71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.938+0000 7fa908468b80 1 --2- 172.21.15.17:0/964983862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69a2040 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.938+0000 7fa908468b80 1 --2- 172.21.15.17:0/964983862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.938+0000 7fa908468b80 1 -- 172.21.15.17:0/964983862 >> 172.21.15.17:0/964983862 conn(0x5592e6997be0 msgr2=0x5592e69a6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.938+0000 7fa908468b80 1 -- 172.21.15.17:0/964983862 shutdown_connections 2023-07-14T13:19:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.938+0000 7fa908468b80 1 -- 172.21.15.17:0/964983862 wait complete. 2023-07-14T13:19:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.939+0000 7fa908468b80 1 -- start start 2023-07-14T13:19:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.939+0000 7fa908468b80 1 Processor -- start 2023-07-14T13:19:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.940+0000 7fa908468b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.940+0000 7fa908468b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.940+0000 7fa908468b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e69a82d0 0x5592e6a0e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.940+0000 7fa908468b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e6a0ef00 con 0x5592e69a82d0 2023-07-14T13:19:57.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.940+0000 7fa908468b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e6a0f040 con 0x5592e69a2580 2023-07-14T13:19:57.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.940+0000 7fa908468b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592e6a201e0 con 0x5592e67fe6b0 2023-07-14T13:19:57.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.940+0000 7fa908468b80 10 client.0 _ll_register_callbacks cb 0x7fa8e8009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:19:57.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.941+0000 7fa8edd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.941+0000 7fa8edd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52376/0 (socket says 172.21.15.17:52376) 2023-07-14T13:19:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.941+0000 7fa8edd9b700 1 -- 172.21.15.17:0/389748676 learned_addr learned my addr 172.21.15.17:0/389748676 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:19:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.941+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e69a82d0 0x5592e6a0e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.941+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.942+0000 7fa8edd9b700 1 -- 172.21.15.17:0/389748676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 msgr2=0x5592e69b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.942+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.942+0000 7fa8edd9b700 1 -- 172.21.15.17:0/389748676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e69a82d0 msgr2=0x5592e6a0e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:19:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.942+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e69a82d0 0x5592e6a0e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.942+0000 7fa8edd9b700 1 -- 172.21.15.17:0/389748676 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d8020040 con 0x5592e67fe6b0 2023-07-14T13:19:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.942+0000 7fa8edd9b700 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69b0870 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8005440 tx=0x7fa8d80058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=965bc18f6a94c7c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:19:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.942+0000 7fa8ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:19:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.943+0000 7fa8ddffb700 1 -- 172.21.15.17:0/389748676 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8004110 con 0x5592e67fe6b0 2023-07-14T13:19:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.943+0000 7fa8ddffb700 1 -- 172.21.15.17:0/389748676 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa8d8005580 con 0x5592e67fe6b0 2023-07-14T13:19:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.943+0000 7fa908468b80 1 -- 172.21.15.17:0/389748676 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8e8004390 con 0x5592e67fe6b0 2023-07-14T13:19:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.943+0000 7fa8ddffb700 1 -- 172.21.15.17:0/389748676 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8d802bb60 con 0x5592e67fe6b0 2023-07-14T13:19:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.943+0000 7fa908468b80 10 client.28771 fetch_fsmap learned FSMap version 53 2023-07-14T13:19:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.943+0000 7fa908468b80 1 -- 172.21.15.17:0/389748676 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5592e6720250 con 0x5592e67fe6b0 2023-07-14T13:19:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.944+0000 7fa8ddffb700 1 -- 172.21.15.17:0/389748676 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8e8004390 con 0x5592e67fe6b0 2023-07-14T13:19:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.944+0000 7fa8ddffb700 1 -- 172.21.15.17:0/389748676 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa8d800b710 con 0x5592e67fe6b0 2023-07-14T13:19:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.944+0000 7fa908468b80 10 client.28771 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:19:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.944+0000 7fa908468b80 10 client.28771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:19:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.944+0000 7fa908468b80 20 client.28771 populate_metadata read hostname 'smithi017' 2023-07-14T13:19:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.944+0000 7fa908468b80 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592e6a214c0 0x5592e6a238a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:19:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.944+0000 7fa908468b80 4 client.28771 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:19:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.944+0000 7fa908468b80 1 -- 172.21.15.17:0/389748676 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5592e68aeff0 con 0x5592e6a214c0 2023-07-14T13:19:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.945+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592e6a214c0 0x5592e6a238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:19:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.946+0000 7fa8ddffb700 10 client.28771 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.946+0000 7fa8ee59c700 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592e6a214c0 0x5592e6a238a0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2db84bba0606c3f6 server_cookie=16fc0ab21e5486ae in_seq=0 out_seq=0 2023-07-14T13:19:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.968+0000 7fa8ddffb700 1 -- 172.21.15.17:0/389748676 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5592e68aeff0 con 0x5592e6a214c0 2023-07-14T13:19:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.968+0000 7fa8ddffb700 10 client.28771 handle_command_reply: tid=0 2023-07-14T13:19:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.969+0000 7fa908468b80 1 client.28771 shutdown 2023-07-14T13:19:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.969+0000 7fa908468b80 1 -- 172.21.15.17:0/389748676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 msgr2=0x5592e69b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.969+0000 7fa908468b80 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69b0870 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8005440 tx=0x7fa8d80058e0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.969+0000 7fa908468b80 1 -- 172.21.15.17:0/389748676 shutdown_connections 2023-07-14T13:19:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.969+0000 7fa908468b80 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5592e6a214c0 0x5592e6a238a0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.969+0000 7fa908468b80 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5592e69a82d0 0x5592e6a0e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.969+0000 7fa908468b80 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592e67fe6b0 0x5592e69b0870 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.970+0000 7fa908468b80 1 --2- 172.21.15.17:0/389748676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592e69a2580 0x5592e69b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.970+0000 7fa8ddffb700 0 client.28771 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:19:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.970+0000 7fa908468b80 1 -- 172.21.15.17:0/389748676 >> 172.21.15.17:0/389748676 conn(0x5592e6997be0 msgr2=0x5592e69a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.970+0000 7fa908468b80 1 -- 172.21.15.17:0/389748676 shutdown_connections 2023-07-14T13:19:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.970+0000 7fa908468b80 1 -- 172.21.15.17:0/389748676 wait complete. 2023-07-14T13:19:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.970+0000 7fa908468b80 20 client.28771 trim_cache size 0 max 16384 2023-07-14T13:19:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:19:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:19:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:19:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:19:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.971+0000 7fa8f4bff700 1 -- 172.21.15.17:0/1612540501 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa8d00a13f0 msgr2=0x7fa8d00a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.971+0000 7fa8f4bff700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa8d00a13f0 0x7fa8d00a38a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00c9f30 tx=0x7fa8e0004c50 comp rx=0 tx=0).stop 2023-07-14T13:19:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.971+0000 7fa8f4bff700 1 -- 172.21.15.17:0/1612540501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0105b60 msgr2=0x7fa8f01136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:19:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.971+0000 7fa8f4bff700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0105b60 0x7fa8f01136d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000efc0 tx=0x7fa8e000c3a0 comp rx=0 tx=0).stop 2023-07-14T13:19:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.972+0000 7fa8f4bff700 1 -- 172.21.15.17:0/1612540501 shutdown_connections 2023-07-14T13:19:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.972+0000 7fa8f4bff700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa8d00a13f0 0x7fa8d00a38a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.972+0000 7fa8f4bff700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f0105b60 0x7fa8f01136d0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.972+0000 7fa8f4bff700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8f00ffb30 0x7fa8f010ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.972+0000 7fa8f4bff700 1 --2- 172.21.15.17:0/1612540501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8f01004e0 0x7fa8f010ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:19:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.972+0000 7fa8f4bff700 1 -- 172.21.15.17:0/1612540501 >> 172.21.15.17:0/1612540501 conn(0x7fa8f00fb650 msgr2=0x7fa8f0103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:19:58.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.973+0000 7fa8f4bff700 1 -- 172.21.15.17:0/1612540501 shutdown_connections 2023-07-14T13:19:58.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:19:57.975+0000 7fa8f4bff700 1 -- 172.21.15.17:0/1612540501 wait complete. 2023-07-14T13:19:59.606 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:19:59 smithi017 ceph-mon[95536]: pgmap v638: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 13 MiB/s wr, 892 op/s 2023-07-14T13:19:59.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:19:59 smithi135 ceph-mon[97338]: pgmap v638: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 13 MiB/s wr, 892 op/s 2023-07-14T13:19:59.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:19:59 smithi131 ceph-mon[96953]: pgmap v638: 97 pgs: 97 active+clean; 15 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 13 MiB/s wr, 892 op/s 2023-07-14T13:20:00.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-a[95512]: 2023-07-14T13:20:00.001+0000 7ff2c0aee700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-07-14T13:20:00.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-a[95512]: 2023-07-14T13:20:00.001+0000 7ff2c0aee700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-07-14T13:20:00.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-a[95512]: 2023-07-14T13:20:00.001+0000 7ff2c0aee700 -1 log_channel(cluster) log [ERR] : mds.h(mds.1): Metadata damage detected 2023-07-14T13:20:00.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:00 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:20:00.341 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:00 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:20:00.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:00 smithi017 ceph-mon[95536]: scrub summary: idle 2023-07-14T13:20:00.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:00 smithi017 ceph-mon[95536]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-07-14T13:20:00.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:00 smithi017 ceph-mon[95536]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-07-14T13:20:00.342 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:00 smithi017 ceph-mon[95536]: mds.h(mds.1): Metadata damage detected 2023-07-14T13:20:00.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:00 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:20:00.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:00 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:20:00.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:00 smithi135 ceph-mon[97338]: scrub summary: idle 2023-07-14T13:20:00.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:00 smithi135 ceph-mon[97338]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-07-14T13:20:00.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:00 smithi135 ceph-mon[97338]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-07-14T13:20:00.698 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:00 smithi135 ceph-mon[97338]: mds.h(mds.1): Metadata damage detected 2023-07-14T13:20:00.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:00 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:20:00.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:00 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:20:00.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:00 smithi131 ceph-mon[96953]: scrub summary: idle 2023-07-14T13:20:00.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:00 smithi131 ceph-mon[96953]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-07-14T13:20:00.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:00 smithi131 ceph-mon[96953]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-07-14T13:20:00.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:00 smithi131 ceph-mon[96953]: mds.h(mds.1): Metadata damage detected 2023-07-14T13:20:01.612 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:01 smithi017 ceph-mon[95536]: pgmap v639: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 22 MiB/s wr, 1.47k op/s 2023-07-14T13:20:01.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:01 smithi135 ceph-mon[97338]: pgmap v639: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 22 MiB/s wr, 1.47k op/s 2023-07-14T13:20:01.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:01 smithi131 ceph-mon[96953]: pgmap v639: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 22 MiB/s wr, 1.47k op/s 2023-07-14T13:20:02.449 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 110.0 s, 412.9 tps, lat 193.833 ms stddev 183.243 2023-07-14T13:20:02.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:02 smithi017 ceph-mon[95536]: pgmap v640: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 13 MiB/s wr, 893 op/s 2023-07-14T13:20:02.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:02 smithi135 ceph-mon[97338]: pgmap v640: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 13 MiB/s wr, 893 op/s 2023-07-14T13:20:02.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:02 smithi131 ceph-mon[96953]: pgmap v640: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 13 MiB/s wr, 893 op/s 2023-07-14T13:20:03.153 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T13:20:03.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.373+0000 7efdf29ff700 1 -- 172.21.15.17:0/3734928049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec100480 msgr2=0x7efdec10c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.373+0000 7efdf29ff700 1 --2- 172.21.15.17:0/3734928049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec100480 0x7efdec10c910 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7efde400b0a0 tx=0x7efde400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.374+0000 7efdf29ff700 1 -- 172.21.15.17:0/3734928049 shutdown_connections 2023-07-14T13:20:03.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.374+0000 7efdf29ff700 1 --2- 172.21.15.17:0/3734928049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec100480 0x7efdec10c910 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.403 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.374+0000 7efdf29ff700 1 --2- 172.21.15.17:0/3734928049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec105ae0 0x7efdec105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.374+0000 7efdf29ff700 1 --2- 172.21.15.17:0/3734928049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec0ffad0 0x7efdec0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.374+0000 7efdf29ff700 1 -- 172.21.15.17:0/3734928049 >> 172.21.15.17:0/3734928049 conn(0x7efdec0fb5f0 msgr2=0x7efdec0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:03.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.374+0000 7efdf29ff700 1 -- 172.21.15.17:0/3734928049 shutdown_connections 2023-07-14T13:20:03.404 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.374+0000 7efdf29ff700 1 -- 172.21.15.17:0/3734928049 wait complete. 2023-07-14T13:20:03.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.375+0000 7efdf29ff700 1 Processor -- start 2023-07-14T13:20:03.405 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.375+0000 7efdf29ff700 1 -- start start 2023-07-14T13:20:03.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.375+0000 7efdf29ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec0ffad0 0x7efdec197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.375+0000 7efdf29ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec100480 0x7efdec198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.375+0000 7efdf29ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec105ae0 0x7efdec19c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.375+0000 7efdf29ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec19cda0 con 0x7efdec0ffad0 2023-07-14T13:20:03.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.375+0000 7efdf29ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec19cf10 con 0x7efdec105ae0 2023-07-14T13:20:03.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.375+0000 7efdf29ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec19d0d0 con 0x7efdec100480 2023-07-14T13:20:03.406 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.375+0000 7efdebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec0ffad0 0x7efdec197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.375+0000 7efdebfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec0ffad0 0x7efdec197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44178/0 (socket says 172.21.15.17:44178) 2023-07-14T13:20:03.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.375+0000 7efdebfff700 1 -- 172.21.15.17:0/1659248910 learned_addr learned my addr 172.21.15.17:0/1659248910 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:03.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.376+0000 7efdebfff700 1 -- 172.21.15.17:0/1659248910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec100480 msgr2=0x7efdec198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.376+0000 7efdebfff700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec100480 0x7efdec198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.376+0000 7efdebfff700 1 -- 172.21.15.17:0/1659248910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec105ae0 msgr2=0x7efdec19c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.376+0000 7efdebfff700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec105ae0 0x7efdec19c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.407 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.376+0000 7efdebfff700 1 -- 172.21.15.17:0/1659248910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde4009d00 con 0x7efdec0ffad0 2023-07-14T13:20:03.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.376+0000 7efdebfff700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec0ffad0 0x7efdec197dc0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7efddc00e9a0 tx=0x7efddc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:03.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.376+0000 7efde97fa700 1 -- 172.21.15.17:0/1659248910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc009790 con 0x7efdec0ffad0 2023-07-14T13:20:03.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.376+0000 7efdf29ff700 1 -- 172.21.15.17:0/1659248910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec19d3b0 con 0x7efdec0ffad0 2023-07-14T13:20:03.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.376+0000 7efde97fa700 1 -- 172.21.15.17:0/1659248910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efddc00cbd0 con 0x7efdec0ffad0 2023-07-14T13:20:03.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.376+0000 7efde97fa700 1 -- 172.21.15.17:0/1659248910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc018680 con 0x7efdec0ffad0 2023-07-14T13:20:03.408 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.376+0000 7efdf29ff700 1 -- 172.21.15.17:0/1659248910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec1a4bf0 con 0x7efdec0ffad0 2023-07-14T13:20:03.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.380+0000 7efde97fa700 1 -- 172.21.15.17:0/1659248910 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7efddc00cd40 con 0x7efdec0ffad0 2023-07-14T13:20:03.409 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.381+0000 7efe062d0b80 1 Processor -- start 2023-07-14T13:20:03.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.381+0000 7efe062d0b80 1 -- start start 2023-07-14T13:20:03.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.381+0000 7efde97fa700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a12c0 0x7efdd40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.381+0000 7efde97fa700 1 -- 172.21.15.17:0/1659248910 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efddc014070 con 0x7efdec0ffad0 2023-07-14T13:20:03.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.381+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb942d0 0x562b1cb946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.381+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb9f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.381+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb9fad0 0x562b1cba1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efe062d0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1ca9acb0 con 0x562b1cb94be0 2023-07-14T13:20:03.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efe062d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1caeda40 con 0x562b1cb9fad0 2023-07-14T13:20:03.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efe062d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cae6ed0 con 0x562b1cb942d0 2023-07-14T13:20:03.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdf0f9c700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a12c0 0x7efdd40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb9f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb9f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44188/0 (socket says 172.21.15.17:44188) 2023-07-14T13:20:03.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdeb7fe700 1 -- 172.21.15.17:0/3305540836 learned_addr learned my addr 172.21.15.17:0/3305540836 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:03.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdebfff700 1 --2- 172.21.15.17:0/3305540836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb942d0 0x562b1cb946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdeb7fe700 1 -- 172.21.15.17:0/3305540836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb942d0 msgr2=0x562b1cb946a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:03.414 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/3305540836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb942d0 0x562b1cb946a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdf0f9c700 1 --2- 172.21.15.17:0/3305540836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb9fad0 0x562b1cba1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdeb7fe700 1 -- 172.21.15.17:0/3305540836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb9fad0 msgr2=0x562b1cba1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:03.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/3305540836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb9fad0 0x562b1cba1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdeb7fe700 1 -- 172.21.15.17:0/3305540836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b1c914de0 con 0x562b1cb94be0 2023-07-14T13:20:03.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.382+0000 7efdf0f9c700 1 --2- 172.21.15.17:0/3305540836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb9fad0 0x562b1cba1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:20:03.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.383+0000 7efdf0f9c700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a12c0 0x7efdd40a3770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efde400d010 tx=0x7efde40095c0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:03.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.383+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/3305540836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb9f590 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7efde0009c70 tx=0x7efde0009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741678e68e5ea573 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:03.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.383+0000 7efdd27fc700 1 -- 172.21.15.17:0/3305540836 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde00097c0 con 0x562b1cb94be0 2023-07-14T13:20:03.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.383+0000 7efdd27fc700 1 -- 172.21.15.17:0/3305540836 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efde0004830 con 0x562b1cb94be0 2023-07-14T13:20:03.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.383+0000 7efdd27fc700 1 -- 172.21.15.17:0/3305540836 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0005570 con 0x562b1cb94be0 2023-07-14T13:20:03.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.384+0000 7efe062d0b80 1 -- 172.21.15.17:0/3305540836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 msgr2=0x562b1cb9f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.384+0000 7efe062d0b80 1 --2- 172.21.15.17:0/3305540836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb9f590 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7efde0009c70 tx=0x7efde0009f80 comp rx=0 tx=0).stop 2023-07-14T13:20:03.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.384+0000 7efe062d0b80 1 -- 172.21.15.17:0/3305540836 shutdown_connections 2023-07-14T13:20:03.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.384+0000 7efe062d0b80 1 --2- 172.21.15.17:0/3305540836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb9fad0 0x562b1cba1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.384+0000 7efe062d0b80 1 --2- 172.21.15.17:0/3305540836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb942d0 0x562b1cb946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.384+0000 7efe062d0b80 1 --2- 172.21.15.17:0/3305540836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb9f590 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.384+0000 7efe062d0b80 1 -- 172.21.15.17:0/3305540836 >> 172.21.15.17:0/3305540836 conn(0x562b1cb8ada0 msgr2=0x562b1cb906a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:03.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.384+0000 7efe062d0b80 1 -- 172.21.15.17:0/3305540836 shutdown_connections 2023-07-14T13:20:03.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.384+0000 7efe062d0b80 1 -- 172.21.15.17:0/3305540836 wait complete. 2023-07-14T13:20:03.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.384+0000 7efe062d0b80 1 -- start start 2023-07-14T13:20:03.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efe062d0b80 1 Processor -- start 2023-07-14T13:20:03.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb942d0 0x562b1cb9f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb94be0 0x562b1cb9c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb9fad0 0x562b1cb9ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efe062d0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1ca86ac0 con 0x562b1cb9fad0 2023-07-14T13:20:03.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efe062d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1ca867c0 con 0x562b1cb942d0 2023-07-14T13:20:03.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efe062d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1c96a920 con 0x562b1cb94be0 2023-07-14T13:20:03.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efe062d0b80 10 client.0 _ll_register_callbacks cb 0x562b1ca84760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:03.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efdf0f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb9fad0 0x562b1cb9ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efdf0f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb9fad0 0x562b1cb9ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44190/0 (socket says 172.21.15.17:44190) 2023-07-14T13:20:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efdf0f9c700 1 -- 172.21.15.17:0/2368590594 learned_addr learned my addr 172.21.15.17:0/2368590594 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.385+0000 7efdebfff700 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb942d0 0x562b1cb9f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.386+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb94be0 0x562b1cb9c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.386+0000 7efdebfff700 1 -- 172.21.15.17:0/2368590594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb94be0 msgr2=0x562b1cb9c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:03.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.386+0000 7efdebfff700 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb94be0 0x562b1cb9c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.386+0000 7efdebfff700 1 -- 172.21.15.17:0/2368590594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb9fad0 msgr2=0x562b1cb9ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:03.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.386+0000 7efdebfff700 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb9fad0 0x562b1cb9ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.386+0000 7efdebfff700 1 -- 172.21.15.17:0/2368590594 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde0009920 con 0x562b1cb942d0 2023-07-14T13:20:03.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.386+0000 7efdebfff700 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb942d0 0x562b1cb9f540 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efddc0ca720 tx=0x7efddc09e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4e833191d485d93 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:03.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.386+0000 7efdcb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:20:03.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.386+0000 7efdcb7fe700 1 -- 172.21.15.17:0/2368590594 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0a2060 con 0x562b1cb942d0 2023-07-14T13:20:03.422 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.386+0000 7efdcb7fe700 1 -- 172.21.15.17:0/2368590594 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efddc0a21c0 con 0x562b1cb942d0 2023-07-14T13:20:03.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.386+0000 7efe062d0b80 1 -- 172.21.15.17:0/2368590594 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b1ca404f0 con 0x562b1cb942d0 2023-07-14T13:20:03.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.387+0000 7efdcb7fe700 1 -- 172.21.15.17:0/2368590594 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7efddc0b82a0 con 0x562b1cb942d0 2023-07-14T13:20:03.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.387+0000 7efe062d0b80 10 client.28817 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:03.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.387+0000 7efe062d0b80 1 -- 172.21.15.17:0/2368590594 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x562b1c8fdc60 con 0x562b1cb942d0 2023-07-14T13:20:03.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.387+0000 7efdcb7fe700 1 -- 172.21.15.17:0/2368590594 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efddc0c8080 con 0x562b1cb942d0 2023-07-14T13:20:03.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.387+0000 7efdcb7fe700 1 -- 172.21.15.17:0/2368590594 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7efddc0b2a80 con 0x562b1cb942d0 2023-07-14T13:20:03.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.387+0000 7efe062d0b80 10 client.28817 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:03.423 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.387+0000 7efe062d0b80 10 client.28817 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:03.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.387+0000 7efe062d0b80 20 client.28817 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:03.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.387+0000 7efe062d0b80 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b1cbaf400 0x562b1cbb1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.387+0000 7efe062d0b80 4 client.28817 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:20:03.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.387+0000 7efe062d0b80 1 -- 172.21.15.17:0/2368590594 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b1cadfeb0 con 0x562b1cbaf400 2023-07-14T13:20:03.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.388+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b1cbaf400 0x562b1cbb1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.424 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.388+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b1cbaf400 0x562b1cbb1810 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f6601f2867cad93 server_cookie=b9cc82afdc00a2a6 in_seq=0 out_seq=0 2023-07-14T13:20:03.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.388+0000 7efdcb7fe700 10 client.28817 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:03.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efdcb7fe700 1 -- 172.21.15.17:0/2368590594 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562b1cadfeb0 con 0x562b1cbaf400 2023-07-14T13:20:03.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efdcb7fe700 10 client.28817 handle_command_reply: tid=0 2023-07-14T13:20:03.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efe062d0b80 1 client.28817 shutdown 2023-07-14T13:20:03.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efe062d0b80 1 -- 172.21.15.17:0/2368590594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb942d0 msgr2=0x562b1cb9f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efe062d0b80 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb942d0 0x562b1cb9f540 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efddc0ca720 tx=0x7efddc09e150 comp rx=0 tx=0).stop 2023-07-14T13:20:03.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efe062d0b80 1 -- 172.21.15.17:0/2368590594 shutdown_connections 2023-07-14T13:20:03.425 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efe062d0b80 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b1cbaf400 0x562b1cbb1810 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efe062d0b80 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb9fad0 0x562b1cb9ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efdcb7fe700 0 client.28817 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:03.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efe062d0b80 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb942d0 0x562b1cb9f540 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efe062d0b80 1 --2- 172.21.15.17:0/2368590594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb94be0 0x562b1cb9c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.389+0000 7efe062d0b80 1 -- 172.21.15.17:0/2368590594 >> 172.21.15.17:0/2368590594 conn(0x562b1cb8ada0 msgr2=0x562b1cb90230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:03.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.390+0000 7efe062d0b80 1 -- 172.21.15.17:0/2368590594 shutdown_connections 2023-07-14T13:20:03.426 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.390+0000 7efe062d0b80 1 -- 172.21.15.17:0/2368590594 wait complete. 2023-07-14T13:20:03.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.390+0000 7efe062d0b80 20 client.28817 trim_cache size 0 max 16384 2023-07-14T13:20:03.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.407+0000 7efe062d0b80 1 Processor -- start 2023-07-14T13:20:03.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.408+0000 7efe062d0b80 1 -- start start 2023-07-14T13:20:03.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.408+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb942d0 0x562b1cb9f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.408+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb97a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.408+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb9fad0 0x562b1cb97f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.408+0000 7efe062d0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cbaca30 con 0x562b1cb94be0 2023-07-14T13:20:03.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.408+0000 7efe062d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cb90b80 con 0x562b1cb942d0 2023-07-14T13:20:03.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.408+0000 7efe062d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cb91c70 con 0x562b1cb9fad0 2023-07-14T13:20:03.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.408+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb97a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.408+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb97a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44196/0 (socket says 172.21.15.17:44196) 2023-07-14T13:20:03.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.408+0000 7efdeb7fe700 1 -- 172.21.15.17:0/893964150 learned_addr learned my addr 172.21.15.17:0/893964150 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:03.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.408+0000 7efdebfff700 1 --2- 172.21.15.17:0/893964150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb942d0 0x562b1cb9f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.409+0000 7efdf0f9c700 1 --2- 172.21.15.17:0/893964150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb9fad0 0x562b1cb97f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.409+0000 7efdeb7fe700 1 -- 172.21.15.17:0/893964150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb9fad0 msgr2=0x562b1cb97f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:03.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.409+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/893964150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb9fad0 0x562b1cb97f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.409+0000 7efdeb7fe700 1 -- 172.21.15.17:0/893964150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb942d0 msgr2=0x562b1cb9f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:03.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.409+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/893964150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb942d0 0x562b1cb9f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.409+0000 7efdeb7fe700 1 -- 172.21.15.17:0/893964150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b1c93b250 con 0x562b1cb94be0 2023-07-14T13:20:03.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.409+0000 7efdf0f9c700 1 --2- 172.21.15.17:0/893964150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb9fad0 0x562b1cb97f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:20:03.440 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.409+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/893964150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb97a30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7efde000e630 tx=0x7efde0004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5148790694e2a95a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:03.442 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.409+0000 7efdd2ffd700 1 -- 172.21.15.17:0/893964150 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde00097c0 con 0x562b1cb94be0 2023-07-14T13:20:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.409+0000 7efdd2ffd700 1 -- 172.21.15.17:0/893964150 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efde0004ca0 con 0x562b1cb94be0 2023-07-14T13:20:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.409+0000 7efdd2ffd700 1 -- 172.21.15.17:0/893964150 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde00051f0 con 0x562b1cb94be0 2023-07-14T13:20:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.410+0000 7efe062d0b80 1 -- 172.21.15.17:0/893964150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 msgr2=0x562b1cb97a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.410+0000 7efe062d0b80 1 --2- 172.21.15.17:0/893964150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb97a30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7efde000e630 tx=0x7efde0004f20 comp rx=0 tx=0).stop 2023-07-14T13:20:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.410+0000 7efe062d0b80 1 -- 172.21.15.17:0/893964150 shutdown_connections 2023-07-14T13:20:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.410+0000 7efe062d0b80 1 --2- 172.21.15.17:0/893964150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb9fad0 0x562b1cb97f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.410+0000 7efe062d0b80 1 --2- 172.21.15.17:0/893964150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb942d0 0x562b1cb9f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.410+0000 7efe062d0b80 1 --2- 172.21.15.17:0/893964150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cb97a30 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.410+0000 7efe062d0b80 1 -- 172.21.15.17:0/893964150 >> 172.21.15.17:0/893964150 conn(0x562b1cb8ada0 msgr2=0x562b1cb8ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.410+0000 7efe062d0b80 1 -- 172.21.15.17:0/893964150 shutdown_connections 2023-07-14T13:20:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.410+0000 7efe062d0b80 1 -- 172.21.15.17:0/893964150 wait complete. 2023-07-14T13:20:03.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.410+0000 7efe062d0b80 1 -- start start 2023-07-14T13:20:03.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.411+0000 7efe062d0b80 1 Processor -- start 2023-07-14T13:20:03.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.411+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb942d0 0x562b1cba6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.411+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cba4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.411+0000 7efe062d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb9fad0 0x562b1cba4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.411+0000 7efe062d0b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cba55f0 con 0x562b1cb94be0 2023-07-14T13:20:03.445 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.411+0000 7efe062d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cba5760 con 0x562b1cb9fad0 2023-07-14T13:20:03.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.411+0000 7efe062d0b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b1cc032d0 con 0x562b1cb942d0 2023-07-14T13:20:03.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.411+0000 7efe062d0b80 10 client.0 _ll_register_callbacks cb 0x562b1ca84760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:03.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.411+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cba4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.446 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.412+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cba4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44208/0 (socket says 172.21.15.17:44208) 2023-07-14T13:20:03.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.412+0000 7efdeb7fe700 1 -- 172.21.15.17:0/3798232490 learned_addr learned my addr 172.21.15.17:0/3798232490 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:03.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.412+0000 7efdebfff700 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb942d0 0x562b1cba6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.412+0000 7efdf0f9c700 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb9fad0 0x562b1cba4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.447 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.412+0000 7efdeb7fe700 1 -- 172.21.15.17:0/3798232490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb942d0 msgr2=0x562b1cba6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:03.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.412+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb942d0 0x562b1cba6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.412+0000 7efdeb7fe700 1 -- 172.21.15.17:0/3798232490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb9fad0 msgr2=0x562b1cba4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:03.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.412+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb9fad0 0x562b1cba4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.448 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.412+0000 7efdeb7fe700 1 -- 172.21.15.17:0/3798232490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde001c040 con 0x562b1cb94be0 2023-07-14T13:20:03.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.412+0000 7efdeb7fe700 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cba4940 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7efde0004ed0 tx=0x7efde0004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaf006b81d0850b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:03.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.412+0000 7efdcb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:20:03.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efdcb7fe700 1 -- 172.21.15.17:0/3798232490 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0032070 con 0x562b1cb94be0 2023-07-14T13:20:03.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efe062d0b80 1 -- 172.21.15.17:0/3798232490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efde0004830 con 0x562b1cb94be0 2023-07-14T13:20:03.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efdcb7fe700 1 -- 172.21.15.17:0/3798232490 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7efde0014070 con 0x562b1cb94be0 2023-07-14T13:20:03.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efdcb7fe700 1 -- 172.21.15.17:0/3798232490 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7efde000eab0 con 0x562b1cb94be0 2023-07-14T13:20:03.449 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efe062d0b80 10 client.19083 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:03.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efe062d0b80 1 -- 172.21.15.17:0/3798232490 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x562b1c9132b0 con 0x562b1cb94be0 2023-07-14T13:20:03.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efdcb7fe700 1 -- 172.21.15.17:0/3798232490 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efde0043020 con 0x562b1cb94be0 2023-07-14T13:20:03.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efdcb7fe700 1 -- 172.21.15.17:0/3798232490 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7efde00038e0 con 0x562b1cb94be0 2023-07-14T13:20:03.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efe062d0b80 10 client.19083 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:03.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efe062d0b80 10 client.19083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:03.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efe062d0b80 20 client.19083 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:03.450 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efe062d0b80 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b1cc04630 0x562b1cc06a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efe062d0b80 4 client.19083 mds_command: new command op to 24593 tid=0[{"prefix": "scrub status"}] 2023-07-14T13:20:03.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.413+0000 7efe062d0b80 1 -- 172.21.15.17:0/3798232490 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562b1caa2050 con 0x562b1cc04630 2023-07-14T13:20:03.451 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.414+0000 7efdebfff700 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b1cc04630 0x562b1cc06a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.414+0000 7efdebfff700 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b1cc04630 0x562b1cc06a40 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1439588b310c590 server_cookie=a13bb9dfab63cbae in_seq=0 out_seq=0 2023-07-14T13:20:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.414+0000 7efdcb7fe700 10 client.19083 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efdcb7fe700 1 -- 172.21.15.17:0/3798232490 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562b1caa2050 con 0x562b1cc04630 2023-07-14T13:20:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efdcb7fe700 10 client.19083 handle_command_reply: tid=0 2023-07-14T13:20:03.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 1 client.19083 shutdown 2023-07-14T13:20:03.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 1 -- 172.21.15.17:0/3798232490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 msgr2=0x562b1cba4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cba4940 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7efde0004ed0 tx=0x7efde0004bb0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.453 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 1 -- 172.21.15.17:0/3798232490 shutdown_connections 2023-07-14T13:20:03.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562b1cc04630 0x562b1cc06a40 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562b1cb9fad0 0x562b1cba4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b1cb942d0 0x562b1cba6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.454 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 1 --2- 172.21.15.17:0/3798232490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562b1cb94be0 0x562b1cba4940 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efdcb7fe700 0 client.19083 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:03.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 1 -- 172.21.15.17:0/3798232490 >> 172.21.15.17:0/3798232490 conn(0x562b1cb8ada0 msgr2=0x562b1cb97a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:03.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 1 -- 172.21.15.17:0/3798232490 shutdown_connections 2023-07-14T13:20:03.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 1 -- 172.21.15.17:0/3798232490 wait complete. 2023-07-14T13:20:03.455 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.415+0000 7efe062d0b80 20 client.19083 trim_cache size 0 max 16384 2023-07-14T13:20:03.456 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:20:03.456 INFO:teuthology.orchestra.run.smithi017.stdout: "status": "no active scrubs running", 2023-07-14T13:20:03.457 INFO:teuthology.orchestra.run.smithi017.stdout: "scrubs": {} 2023-07-14T13:20:03.457 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:20:03.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 -- 172.21.15.17:0/1659248910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a12c0 msgr2=0x7efdd40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a12c0 0x7efdd40a3770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efde400d010 tx=0x7efde40095c0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.458 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 -- 172.21.15.17:0/1659248910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec0ffad0 msgr2=0x7efdec197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec0ffad0 0x7efdec197dc0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7efddc00e9a0 tx=0x7efddc00ed60 comp rx=0 tx=0).stop 2023-07-14T13:20:03.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 -- 172.21.15.17:0/1659248910 shutdown_connections 2023-07-14T13:20:03.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7efdd40a12c0 0x7efdd40a3770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.459 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdec105ae0 0x7efdec19c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdec0ffad0 0x7efdec197dc0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 --2- 172.21.15.17:0/1659248910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec100480 0x7efdec198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 -- 172.21.15.17:0/1659248910 >> 172.21.15.17:0/1659248910 conn(0x7efdec0fb5f0 msgr2=0x7efdec10ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:03.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 -- 172.21.15.17:0/1659248910 shutdown_connections 2023-07-14T13:20:03.460 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.416+0000 7efdf29ff700 1 -- 172.21.15.17:0/1659248910 wait complete. 2023-07-14T13:20:03.462 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T13:20:03.462 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T13:20:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.641+0000 7f1b611ff700 1 -- 172.21.15.17:0/1094795776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b5c0ffad0 msgr2=0x7f1b5c0fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.670 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.641+0000 7f1b611ff700 1 --2- 172.21.15.17:0/1094795776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b5c0ffad0 0x7f1b5c0fff40 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009990 tx=0x7f1b44009ca0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.641+0000 7f1b611ff700 1 -- 172.21.15.17:0/1094795776 shutdown_connections 2023-07-14T13:20:03.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.641+0000 7f1b611ff700 1 --2- 172.21.15.17:0/1094795776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c100480 0x7f1b5c10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.641+0000 7f1b611ff700 1 --2- 172.21.15.17:0/1094795776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b5c105ae0 0x7f1b5c105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.641+0000 7f1b611ff700 1 --2- 172.21.15.17:0/1094795776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b5c0ffad0 0x7f1b5c0fff40 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.641+0000 7f1b611ff700 1 -- 172.21.15.17:0/1094795776 >> 172.21.15.17:0/1094795776 conn(0x7f1b5c0fb590 msgr2=0x7f1b5c0fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:03.671 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.641+0000 7f1b611ff700 1 -- 172.21.15.17:0/1094795776 shutdown_connections 2023-07-14T13:20:03.672 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.641+0000 7f1b611ff700 1 -- 172.21.15.17:0/1094795776 wait complete. 2023-07-14T13:20:03.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.642+0000 7f1b611ff700 1 Processor -- start 2023-07-14T13:20:03.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.642+0000 7f1b611ff700 1 -- start start 2023-07-14T13:20:03.673 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.643+0000 7f1b611ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c0ffad0 0x7f1b5c072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.643+0000 7f1b611ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b5c100480 0x7f1b5c072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.643+0000 7f1b611ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b5c105ae0 0x7f1b5c1a3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.643+0000 7f1b611ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c073580 con 0x7f1b5c105ae0 2023-07-14T13:20:03.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.643+0000 7f1b611ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c1a4220 con 0x7f1b5c100480 2023-07-14T13:20:03.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.643+0000 7f1b611ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c1a4360 con 0x7f1b5c0ffad0 2023-07-14T13:20:03.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.643+0000 7f1b5b59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b5c105ae0 0x7f1b5c1a3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.674 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.643+0000 7f1b5b59e700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b5c105ae0 0x7f1b5c1a3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44232/0 (socket says 172.21.15.17:44232) 2023-07-14T13:20:03.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.643+0000 7f1b5b59e700 1 -- 172.21.15.17:0/1563715114 learned_addr learned my addr 172.21.15.17:0/1563715114 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:03.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.643+0000 7f1b5ad9d700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c0ffad0 0x7f1b5c072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.643+0000 7f1b53fff700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b5c100480 0x7f1b5c072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.644+0000 7f1b5b59e700 1 -- 172.21.15.17:0/1563715114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c0ffad0 msgr2=0x7f1b5c072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.644+0000 7f1b5b59e700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c0ffad0 0x7f1b5c072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.644+0000 7f1b5b59e700 1 -- 172.21.15.17:0/1563715114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b5c100480 msgr2=0x7f1b5c072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.644+0000 7f1b5b59e700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b5c100480 0x7f1b5c072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.675 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.644+0000 7f1b5b59e700 1 -- 172.21.15.17:0/1563715114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b440095f0 con 0x7f1b5c105ae0 2023-07-14T13:20:03.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.644+0000 7f1b5b59e700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b5c105ae0 0x7f1b5c1a3ce0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f1b54007ee0 tx=0x7f1b5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:03.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.644+0000 7f1b58d99700 1 -- 172.21.15.17:0/1563715114 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54017070 con 0x7f1b5c105ae0 2023-07-14T13:20:03.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.644+0000 7f1b58d99700 1 -- 172.21.15.17:0/1563715114 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b5400f040 con 0x7f1b5c105ae0 2023-07-14T13:20:03.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.644+0000 7f1b58d99700 1 -- 172.21.15.17:0/1563715114 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54005570 con 0x7f1b5c105ae0 2023-07-14T13:20:03.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.644+0000 7f1b611ff700 1 -- 172.21.15.17:0/1563715114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5c1a45c0 con 0x7f1b5c105ae0 2023-07-14T13:20:03.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.644+0000 7f1b611ff700 1 -- 172.21.15.17:0/1563715114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5c1a4a50 con 0x7f1b5c105ae0 2023-07-14T13:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.645+0000 7f1b611ff700 1 -- 172.21.15.17:0/1563715114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5c067300 con 0x7f1b5c105ae0 2023-07-14T13:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.647+0000 7f1b58d99700 1 -- 172.21.15.17:0/1563715114 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1b5400db20 con 0x7f1b5c105ae0 2023-07-14T13:20:03.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.649+0000 7f1b58d99700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b480a1380 0x7f1b480a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:03.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.649+0000 7f1b58d99700 1 -- 172.21.15.17:0/1563715114 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1b540cc480 con 0x7f1b5c105ae0 2023-07-14T13:20:03.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.649+0000 7f1b5ad9d700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b480a1380 0x7f1b480a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:03.678 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.650+0000 7f1b5ad9d700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b480a1380 0x7f1b480a3830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009be0 tx=0x7f1b4c009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:03.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.653+0000 7f1b58d99700 1 -- 172.21.15.17:0/1563715114 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f1b54095850 con 0x7f1b5c105ae0 2023-07-14T13:20:03.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.910+0000 7f1b611ff700 1 -- 172.21.15.17:0/1563715114 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b5c1a4e00 con 0x7f1b5c105ae0 2023-07-14T13:20:03.939 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.910+0000 7f1b58d99700 1 -- 172.21.15.17:0/1563715114 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+10856 (secure 0 0 0) 0x7f1b54098e70 con 0x7f1b5c105ae0 2023-07-14T13:20:03.940 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:20:03.940 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/52692559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":52692559},{"type":"v1","addr":"172.21.15.17:6835","nonce":52692559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1941846207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":1941846207},{"type":"v1","addr":"172.21.15.17:6837","nonce":1941846207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3827721971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3827721971},{"type":"v1","addr":"172.21.15.17:6839","nonce":3827721971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6841/2303800338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6840","nonce":2303800338},{"type":"v1","addr":"172.21.15.17:6841","nonce":2303800338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24457,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/1506834360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":1506834360},{"type":"v1","addr":"172.21.15.135:6833","nonce":1506834360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/610469935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":610469935},{"type":"v1","addr":"172.21.15.131:6833","nonce":610469935}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":53,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T12:57:39.671161+0000","modified":"2023-07-14T13:19:39.303796+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24593,"mds_1":24548,"mds_2":24547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24508":{"gid":24508,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/1201140251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":1201140251},{"type":"v1","addr":"172.21.15.135:6835","nonce":1201140251}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24515":{"gid":24515,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/1432780018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1432780018},{"type":"v1","addr":"172.21.15.131:6835","nonce":1432780018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24526":{"gid":24526,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/4030549564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":4030549564},{"type":"v1","addr":"172.21.15.135:6837","nonce":4030549564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24547":{"gid":24547,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6839/2221555127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2221555127},{"type":"v1","addr":"172.21.15.135:6839","nonce":2221555127}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":336,"addr":"172.21.15.131:6837/3087773753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3087773753},{"type":"v1","addr":"172.21.15.131:6837","nonce":3087773753}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24593":{"gid":24593,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.131:6839/2296586377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":2296586377},{"type":"v1","addr":"172.21.15.131:6839","nonce":2296586377}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T13:20:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 -- 172.21.15.17:0/1563715114 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b480a1380 msgr2=0x7f1b480a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b480a1380 0x7f1b480a3830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009be0 tx=0x7f1b4c009260 comp rx=0 tx=0).stop 2023-07-14T13:20:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 -- 172.21.15.17:0/1563715114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b5c105ae0 msgr2=0x7f1b5c1a3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b5c105ae0 0x7f1b5c1a3ce0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f1b54007ee0 tx=0x7f1b5400d3b0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.942 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 -- 172.21.15.17:0/1563715114 shutdown_connections 2023-07-14T13:20:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1b480a1380 0x7f1b480a3830 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b5c105ae0 0x7f1b5c1a3ce0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b5c0ffad0 0x7f1b5c072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 --2- 172.21.15.17:0/1563715114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b5c100480 0x7f1b5c072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 -- 172.21.15.17:0/1563715114 >> 172.21.15.17:0/1563715114 conn(0x7f1b5c0fb590 msgr2=0x7f1b5c0fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 -- 172.21.15.17:0/1563715114 shutdown_connections 2023-07-14T13:20:03.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:03.913+0000 7f1b611ff700 1 -- 172.21.15.17:0/1563715114 wait complete. 2023-07-14T13:20:03.944 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 53 2023-07-14T13:20:03.960 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T13:20:04.245 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:03 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1563715114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:20:04.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.263+0000 7f86997ff700 1 -- 172.21.15.17:0/252316631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869410cb50 msgr2=0x7f8694106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.292 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.263+0000 7f86997ff700 1 --2- 172.21.15.17:0/252316631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869410cb50 0x7f8694106340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8688009920 tx=0x7f8688009c30 comp rx=0 tx=0).stop 2023-07-14T13:20:04.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.263+0000 7f86997ff700 1 -- 172.21.15.17:0/252316631 shutdown_connections 2023-07-14T13:20:04.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.263+0000 7f86997ff700 1 --2- 172.21.15.17:0/252316631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8694106a70 0x7f8694112f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.263+0000 7f86997ff700 1 --2- 172.21.15.17:0/252316631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f869410c240 0x7f869410c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.263+0000 7f86997ff700 1 --2- 172.21.15.17:0/252316631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869410cb50 0x7f8694106340 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.263+0000 7f86997ff700 1 -- 172.21.15.17:0/252316631 >> 172.21.15.17:0/252316631 conn(0x7f86940759e0 msgr2=0x7f8694077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.264+0000 7f86997ff700 1 -- 172.21.15.17:0/252316631 shutdown_connections 2023-07-14T13:20:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.264+0000 7f86997ff700 1 -- 172.21.15.17:0/252316631 wait complete. 2023-07-14T13:20:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.265+0000 7f86997ff700 1 Processor -- start 2023-07-14T13:20:04.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.266+0000 7f86997ff700 1 -- start start 2023-07-14T13:20:04.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.266+0000 7f86997ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8694106a70 0x7f869419c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.266+0000 7f86997ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f869410c240 0x7f869419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.266+0000 7f86997ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869410cb50 0x7f86941a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.266+0000 7f86997ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86941a1310 con 0x7f869410c240 2023-07-14T13:20:04.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.266+0000 7f86997ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86941a1480 con 0x7f8694106a70 2023-07-14T13:20:04.296 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.266+0000 7f86997ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86941a1640 con 0x7f869410cb50 2023-07-14T13:20:04.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.267+0000 7f8692ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8694106a70 0x7f869419c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.267+0000 7f8692ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8694106a70 0x7f869419c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56446/0 (socket says 172.21.15.17:56446) 2023-07-14T13:20:04.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.267+0000 7f8692ffd700 1 -- 172.21.15.17:0/1515838040 learned_addr learned my addr 172.21.15.17:0/1515838040 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.267+0000 7f86927fc700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f869410c240 0x7f869419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.297 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.267+0000 7f86937fe700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869410cb50 0x7f86941a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.267+0000 7f8692ffd700 1 -- 172.21.15.17:0/1515838040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869410cb50 msgr2=0x7f86941a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.267+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869410cb50 0x7f86941a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.267+0000 7f8692ffd700 1 -- 172.21.15.17:0/1515838040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f869410c240 msgr2=0x7f869419c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.267+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f869410c240 0x7f869419c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.298 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.267+0000 7f8692ffd700 1 -- 172.21.15.17:0/1515838040 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8688009520 con 0x7f8694106a70 2023-07-14T13:20:04.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.268+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8694106a70 0x7f869419c330 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f868400b500 tx=0x7f868400b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.268+0000 7f867bfff700 1 -- 172.21.15.17:0/1515838040 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684011830 con 0x7f8694106a70 2023-07-14T13:20:04.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.268+0000 7f867bfff700 1 -- 172.21.15.17:0/1515838040 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8684011e20 con 0x7f8694106a70 2023-07-14T13:20:04.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.268+0000 7f86997ff700 1 -- 172.21.15.17:0/1515838040 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86941a1920 con 0x7f8694106a70 2023-07-14T13:20:04.299 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.268+0000 7f86997ff700 1 -- 172.21.15.17:0/1515838040 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86941a9160 con 0x7f8694106a70 2023-07-14T13:20:04.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.268+0000 7f867bfff700 1 -- 172.21.15.17:0/1515838040 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684010cf0 con 0x7f8694106a70 2023-07-14T13:20:04.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.274+0000 7f86ad0d9b80 1 Processor -- start 2023-07-14T13:20:04.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.275+0000 7f86ad0d9b80 1 -- start start 2023-07-14T13:20:04.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.275+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d6072d0 0x56004d6076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.275+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d607be0 0x56004d612590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.275+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d612ad0 0x56004d614eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.275+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d50dcb0 con 0x56004d6072d0 2023-07-14T13:20:04.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.275+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d560a40 con 0x56004d612ad0 2023-07-14T13:20:04.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.275+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d559ed0 con 0x56004d607be0 2023-07-14T13:20:04.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.275+0000 7f867bfff700 1 -- 172.21.15.17:0/1515838040 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8684011990 con 0x7f8694106a70 2023-07-14T13:20:04.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.276+0000 7f8692ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d607be0 0x56004d612590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.276+0000 7f8692ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d607be0 0x56004d612590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52480/0 (socket says 172.21.15.17:52480) 2023-07-14T13:20:04.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.276+0000 7f8692ffd700 1 -- 172.21.15.17:0/1148391649 learned_addr learned my addr 172.21.15.17:0/1148391649 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.277+0000 7f8692ffd700 1 -- 172.21.15.17:0/1148391649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d612ad0 msgr2=0x56004d614eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:20:04.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.277+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1148391649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d612ad0 0x56004d614eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.277+0000 7f8692ffd700 1 -- 172.21.15.17:0/1148391649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d6072d0 msgr2=0x56004d6076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.277+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1148391649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d6072d0 0x56004d6076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.277+0000 7f8692ffd700 1 -- 172.21.15.17:0/1148391649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56004d387de0 con 0x56004d607be0 2023-07-14T13:20:04.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.277+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1148391649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d607be0 0x56004d612590 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f86840c9dc0 tx=0x7f86840d2820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fbe06c54a669fb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.278+0000 7f86797fa700 1 -- 172.21.15.17:0/1148391649 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86840cce30 con 0x56004d607be0 2023-07-14T13:20:04.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.278+0000 7f86797fa700 1 -- 172.21.15.17:0/1148391649 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86840ce560 con 0x56004d607be0 2023-07-14T13:20:04.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.278+0000 7f86797fa700 1 -- 172.21.15.17:0/1148391649 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86840d9950 con 0x56004d607be0 2023-07-14T13:20:04.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.278+0000 7f867bfff700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f867c0a1400 0x7f867c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.279+0000 7f867bfff700 1 -- 172.21.15.17:0/1515838040 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f86840cc630 con 0x7f8694106a70 2023-07-14T13:20:04.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.279+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1148391649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d607be0 msgr2=0x56004d612590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.279+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1148391649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d607be0 0x56004d612590 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f86840c9dc0 tx=0x7f86840d2820 comp rx=0 tx=0).stop 2023-07-14T13:20:04.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.280+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1148391649 shutdown_connections 2023-07-14T13:20:04.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.280+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1148391649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d612ad0 0x56004d614eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.280+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1148391649 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d6072d0 0x56004d6076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.280+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1148391649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d607be0 0x56004d612590 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.280+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1148391649 >> 172.21.15.17:0/1148391649 conn(0x56004d5fdda0 msgr2=0x56004d6036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.280+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1148391649 shutdown_connections 2023-07-14T13:20:04.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.280+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1148391649 wait complete. 2023-07-14T13:20:04.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.280+0000 7f86937fe700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f867c0a1400 0x7f867c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.281+0000 7f86ad0d9b80 1 -- start start 2023-07-14T13:20:04.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.281+0000 7f86ad0d9b80 1 Processor -- start 2023-07-14T13:20:04.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.281+0000 7f86937fe700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f867c0a1400 0x7f867c0a38b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f868c004b10 tx=0x7f868c0099e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.282+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d612470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.282+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d607be0 0x56004d60f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.282+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d612ad0 0x56004d60fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.282+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d4f9ac0 con 0x56004d607be0 2023-07-14T13:20:04.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.282+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d4f97c0 con 0x56004d612ad0 2023-07-14T13:20:04.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.282+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d3dd920 con 0x56004d6072d0 2023-07-14T13:20:04.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.282+0000 7f86ad0d9b80 10 client.0 _ll_register_callbacks cb 0x56004d4f7760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:04.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.283+0000 7f86937fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d612ad0 0x56004d60fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.283+0000 7f8692ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d612470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.283+0000 7f86937fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d612ad0 0x56004d60fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56462/0 (socket says 172.21.15.17:56462) 2023-07-14T13:20:04.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.283+0000 7f86937fe700 1 -- 172.21.15.17:0/232641371 learned_addr learned my addr 172.21.15.17:0/232641371 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.283+0000 7f86927fc700 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d607be0 0x56004d60f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.284+0000 7f86937fe700 1 -- 172.21.15.17:0/232641371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 msgr2=0x56004d612470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.284+0000 7f86937fe700 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d612470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.284+0000 7f86937fe700 1 -- 172.21.15.17:0/232641371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d607be0 msgr2=0x56004d60f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.284+0000 7f86937fe700 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d607be0 0x56004d60f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.284+0000 7f86937fe700 1 -- 172.21.15.17:0/232641371 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86941a9160 con 0x56004d612ad0 2023-07-14T13:20:04.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.284+0000 7f86937fe700 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d612ad0 0x56004d60fd20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f868c017e10 tx=0x7f868c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68ccdeaf2162315 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.284+0000 7f8676ff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:20:04.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.285+0000 7f8676ff5700 1 -- 172.21.15.17:0/232641371 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c00e040 con 0x56004d612ad0 2023-07-14T13:20:04.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.285+0000 7f8676ff5700 1 -- 172.21.15.17:0/232641371 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f868c01c040 con 0x56004d612ad0 2023-07-14T13:20:04.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.285+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/232641371 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56004d4b34f0 con 0x56004d612ad0 2023-07-14T13:20:04.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.285+0000 7f8676ff5700 1 -- 172.21.15.17:0/232641371 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f868c017e40 con 0x56004d612ad0 2023-07-14T13:20:04.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.285+0000 7f86ad0d9b80 10 client.28838 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:04.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.285+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/232641371 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x56004d370c60 con 0x56004d612ad0 2023-07-14T13:20:04.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.286+0000 7f8676ff5700 1 -- 172.21.15.17:0/232641371 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56004d4b34f0 con 0x56004d612ad0 2023-07-14T13:20:04.316 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.286+0000 7f8676ff5700 1 -- 172.21.15.17:0/232641371 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f868c0293b0 con 0x56004d612ad0 2023-07-14T13:20:04.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.286+0000 7f86ad0d9b80 10 client.28838 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:04.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.286+0000 7f86ad0d9b80 10 client.28838 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:20:04.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.286+0000 7f86ad0d9b80 20 client.28838 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:04.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.286+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56004d622410 0x56004d624820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.286+0000 7f86ad0d9b80 4 client.28838 mds_command: new command op to 24547 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:20:04.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.286+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/232641371 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56004d552eb0 con 0x56004d622410 2023-07-14T13:20:04.317 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.286+0000 7f8692ffd700 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56004d622410 0x56004d624820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.287+0000 7f8692ffd700 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56004d622410 0x56004d624820 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8386172aa29fc43d server_cookie=db2e299afaa5c91e in_seq=0 out_seq=0 2023-07-14T13:20:04.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.287+0000 7f8676ff5700 10 client.28838 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:20:04.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.289+0000 7f8676ff5700 1 -- 172.21.15.17:0/232641371 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56004d552eb0 con 0x56004d622410 2023-07-14T13:20:04.318 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.289+0000 7f8676ff5700 10 client.28838 handle_command_reply: tid=0 2023-07-14T13:20:04.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.289+0000 7f86ad0d9b80 1 client.28838 shutdown 2023-07-14T13:20:04.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.289+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/232641371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d612ad0 msgr2=0x56004d60fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.289+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d612ad0 0x56004d60fd20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f868c017e10 tx=0x7f868c004b40 comp rx=0 tx=0).stop 2023-07-14T13:20:04.319 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.289+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/232641371 shutdown_connections 2023-07-14T13:20:04.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.289+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d612ad0 0x56004d60fd20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.289+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56004d622410 0x56004d624820 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.290+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d612470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.320 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.290+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/232641371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d607be0 0x56004d60f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.290+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/232641371 >> 172.21.15.17:0/232641371 conn(0x56004d5fdda0 msgr2=0x56004d603230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.290+0000 7f8676ff5700 0 client.28838 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:20:04.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.290+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/232641371 shutdown_connections 2023-07-14T13:20:04.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.290+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/232641371 wait complete. 2023-07-14T13:20:04.321 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.290+0000 7f86ad0d9b80 20 client.28838 trim_cache size 0 max 16384 2023-07-14T13:20:04.344 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.315+0000 7f86ad0d9b80 1 Processor -- start 2023-07-14T13:20:04.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.315+0000 7f86ad0d9b80 1 -- start start 2023-07-14T13:20:04.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.315+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d5fdda0 0x56004d619530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.345 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.315+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d60aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.315+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d607be0 0x56004d60afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.316+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d604d60 con 0x56004d607be0 2023-07-14T13:20:04.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.316+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d608570 con 0x56004d5fdda0 2023-07-14T13:20:04.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.316+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d61ee60 con 0x56004d6072d0 2023-07-14T13:20:04.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.316+0000 7f8692ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d5fdda0 0x56004d619530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.316+0000 7f8692ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d5fdda0 0x56004d619530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56464/0 (socket says 172.21.15.17:56464) 2023-07-14T13:20:04.346 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.316+0000 7f8692ffd700 1 -- 172.21.15.17:0/1243690714 learned_addr learned my addr 172.21.15.17:0/1243690714 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.347 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.316+0000 7f86927fc700 1 --2- 172.21.15.17:0/1243690714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d60aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.317+0000 7f86937fe700 1 --2- 172.21.15.17:0/1243690714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d607be0 0x56004d60afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.317+0000 7f8692ffd700 1 -- 172.21.15.17:0/1243690714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 msgr2=0x56004d60aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.317+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1243690714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d60aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.317+0000 7f8692ffd700 1 -- 172.21.15.17:0/1243690714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d607be0 msgr2=0x56004d60afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.348 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.317+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1243690714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d607be0 0x56004d60afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.317+0000 7f8692ffd700 1 -- 172.21.15.17:0/1243690714 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56004d5ff5e0 con 0x56004d5fdda0 2023-07-14T13:20:04.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.317+0000 7f86937fe700 1 --2- 172.21.15.17:0/1243690714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d607be0 0x56004d60afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:20:04.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.317+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1243690714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d5fdda0 0x56004d619530 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f86840cc920 tx=0x7f86840d2820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=605fa8164eab8375 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.318+0000 7f8679ffb700 1 -- 172.21.15.17:0/1243690714 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684009330 con 0x56004d5fdda0 2023-07-14T13:20:04.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.318+0000 7f8679ffb700 1 -- 172.21.15.17:0/1243690714 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8684095b10 con 0x56004d5fdda0 2023-07-14T13:20:04.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.318+0000 7f8679ffb700 1 -- 172.21.15.17:0/1243690714 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86840997d0 con 0x56004d5fdda0 2023-07-14T13:20:04.349 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.319+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1243690714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d5fdda0 msgr2=0x56004d619530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.319+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1243690714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d5fdda0 0x56004d619530 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f86840cc920 tx=0x7f86840d2820 comp rx=0 tx=0).stop 2023-07-14T13:20:04.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.319+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1243690714 shutdown_connections 2023-07-14T13:20:04.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.319+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1243690714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d607be0 0x56004d60afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.319+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1243690714 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d5fdda0 0x56004d619530 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.319+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1243690714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d60aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.319+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1243690714 >> 172.21.15.17:0/1243690714 conn(0x56004d602170 msgr2=0x56004d624420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.350 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.319+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1243690714 shutdown_connections 2023-07-14T13:20:04.351 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.319+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1243690714 wait complete. 2023-07-14T13:20:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.320+0000 7f86ad0d9b80 1 -- start start 2023-07-14T13:20:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.320+0000 7f86ad0d9b80 1 Processor -- start 2023-07-14T13:20:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.321+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d5fdda0 0x56004d66f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.321+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d66a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.321+0000 7f86ad0d9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d607be0 0x56004d66a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.321+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d66ace0 con 0x56004d5fdda0 2023-07-14T13:20:04.352 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.321+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d66ae50 con 0x56004d607be0 2023-07-14T13:20:04.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.321+0000 7f86ad0d9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56004d66af90 con 0x56004d6072d0 2023-07-14T13:20:04.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.321+0000 7f86ad0d9b80 10 client.0 _ll_register_callbacks cb 0x7f868c0177e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:04.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.321+0000 7f86927fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d66a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.353 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.321+0000 7f86927fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d66a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52514/0 (socket says 172.21.15.17:52514) 2023-07-14T13:20:04.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.321+0000 7f86927fc700 1 -- 172.21.15.17:0/1852189666 learned_addr learned my addr 172.21.15.17:0/1852189666 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.322+0000 7f86937fe700 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d607be0 0x56004d66a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.322+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d5fdda0 0x56004d66f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.354 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.322+0000 7f86937fe700 1 -- 172.21.15.17:0/1852189666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 msgr2=0x56004d66a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.322+0000 7f86937fe700 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d66a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.322+0000 7f86937fe700 1 -- 172.21.15.17:0/1852189666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d5fdda0 msgr2=0x56004d66f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.322+0000 7f86937fe700 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d5fdda0 0x56004d66f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.355 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.322+0000 7f86937fe700 1 -- 172.21.15.17:0/1852189666 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56004d387de0 con 0x56004d607be0 2023-07-14T13:20:04.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.322+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d5fdda0 0x56004d66f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:20:04.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.322+0000 7f86937fe700 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d607be0 0x56004d66a7a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f868c029770 tx=0x7f868c029ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4478b2820e3d6c69 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.356 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.322+0000 7f8676ff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:20:04.358 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.323+0000 7f8676ff5700 1 -- 172.21.15.17:0/1852189666 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c00e040 con 0x56004d607be0 2023-07-14T13:20:04.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.323+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1852189666 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86840ce560 con 0x56004d607be0 2023-07-14T13:20:04.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.323+0000 7f8676ff5700 1 -- 172.21.15.17:0/1852189666 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f868c0299e0 con 0x56004d607be0 2023-07-14T13:20:04.359 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.323+0000 7f8676ff5700 1 -- 172.21.15.17:0/1852189666 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f868c0295c0 con 0x56004d607be0 2023-07-14T13:20:04.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.323+0000 7f86ad0d9b80 10 client.28844 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:04.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.323+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1852189666 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x56004d3ae250 con 0x56004d607be0 2023-07-14T13:20:04.360 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.324+0000 7f8676ff5700 1 -- 172.21.15.17:0/1852189666 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f868c043080 con 0x56004d607be0 2023-07-14T13:20:04.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.324+0000 7f8676ff5700 1 -- 172.21.15.17:0/1852189666 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f868c028360 con 0x56004d607be0 2023-07-14T13:20:04.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.324+0000 7f86ad0d9b80 10 client.28844 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:04.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.324+0000 7f86ad0d9b80 10 client.28844 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-07-14T13:20:04.361 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.324+0000 7f86ad0d9b80 20 client.28844 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:04.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.324+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56004d612ad0 0x56004d69b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.324+0000 7f86ad0d9b80 4 client.28844 mds_command: new command op to 24547 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:20:04.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.324+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1852189666 --> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56004d515050 con 0x56004d612ad0 2023-07-14T13:20:04.362 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.324+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56004d612ad0 0x56004d69b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.325+0000 7f8676ff5700 10 client.28844 ms_handle_connect on v2:172.21.15.135:6838/2221555127 2023-07-14T13:20:04.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.325+0000 7f8692ffd700 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56004d612ad0 0x56004d69b5f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3c5a00218040c2b server_cookie=f9982b3d042088ca in_seq=0 out_seq=0 2023-07-14T13:20:04.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.325+0000 7f8676ff5700 1 -- 172.21.15.17:0/1852189666 <== mds.2 v2:172.21.15.135:6838/2221555127 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56004d515050 con 0x56004d612ad0 2023-07-14T13:20:04.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.325+0000 7f8676ff5700 10 client.28844 handle_command_reply: tid=0 2023-07-14T13:20:04.363 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.325+0000 7f86ad0d9b80 1 client.28844 shutdown 2023-07-14T13:20:04.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.325+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1852189666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d607be0 msgr2=0x56004d66a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.325+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d607be0 0x56004d66a7a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f868c029770 tx=0x7f868c029ed0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.364 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.326+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1852189666 shutdown_connections 2023-07-14T13:20:04.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.326+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56004d607be0 0x56004d66a7a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.326+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56004d5fdda0 0x56004d66f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.326+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.135:6838/2221555127,v1:172.21.15.135:6839/2221555127] conn(0x56004d612ad0 0x56004d69b5f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.326+0000 7f86ad0d9b80 1 --2- 172.21.15.17:0/1852189666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56004d6072d0 0x56004d66a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.326+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1852189666 >> 172.21.15.17:0/1852189666 conn(0x56004d602170 msgr2=0x56004d60aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.365 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.326+0000 7f8676ff5700 0 client.28844 ms_handle_reset on v2:172.21.15.135:6838/2221555127 2023-07-14T13:20:04.366 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:03 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1563715114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:20:04.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.326+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1852189666 shutdown_connections 2023-07-14T13:20:04.366 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.326+0000 7f86ad0d9b80 1 -- 172.21.15.17:0/1852189666 wait complete. 2023-07-14T13:20:04.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.331+0000 7f86ad0d9b80 20 client.28844 trim_cache size 0 max 16384 2023-07-14T13:20:04.367 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:20:04.367 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.332+0000 7f86997ff700 1 -- 172.21.15.17:0/1515838040 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f867c0a1400 msgr2=0x7f867c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.332+0000 7f86997ff700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f867c0a1400 0x7f867c0a38b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f868c004b10 tx=0x7f868c0099e0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.332+0000 7f86997ff700 1 -- 172.21.15.17:0/1515838040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8694106a70 msgr2=0x7f869419c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.332+0000 7f86997ff700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8694106a70 0x7f869419c330 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f868400b500 tx=0x7f868400b810 comp rx=0 tx=0).stop 2023-07-14T13:20:04.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.332+0000 7f86997ff700 1 -- 172.21.15.17:0/1515838040 shutdown_connections 2023-07-14T13:20:04.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.332+0000 7f86997ff700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f867c0a1400 0x7f867c0a38b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.368 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.332+0000 7f86997ff700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869410cb50 0x7f86941a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.332+0000 7f86997ff700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8694106a70 0x7f869419c330 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.332+0000 7f86997ff700 1 --2- 172.21.15.17:0/1515838040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f869410c240 0x7f869419c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.332+0000 7f86997ff700 1 -- 172.21.15.17:0/1515838040 >> 172.21.15.17:0/1515838040 conn(0x7f86940759e0 msgr2=0x7f8694077230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.333+0000 7f86997ff700 1 -- 172.21.15.17:0/1515838040 shutdown_connections 2023-07-14T13:20:04.369 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.333+0000 7f86997ff700 1 -- 172.21.15.17:0/1515838040 wait complete. 2023-07-14T13:20:04.389 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T13:20:04.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:03 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1563715114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T13:20:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.647+0000 7fc054dff700 1 -- 172.21.15.17:0/2285076837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0500731c0 msgr2=0x7fc05010bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.647+0000 7fc054dff700 1 --2- 172.21.15.17:0/2285076837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0500731c0 0x7fc05010bdd0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc044009990 tx=0x7fc044009ca0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.676 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.647+0000 7fc054dff700 1 -- 172.21.15.17:0/2285076837 shutdown_connections 2023-07-14T13:20:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.647+0000 7fc054dff700 1 --2- 172.21.15.17:0/2285076837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc05010c310 0x7fc05010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.647+0000 7fc054dff700 1 --2- 172.21.15.17:0/2285076837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0500728b0 0x7fc050072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.647+0000 7fc054dff700 1 --2- 172.21.15.17:0/2285076837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0500731c0 0x7fc05010bdd0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.647+0000 7fc054dff700 1 -- 172.21.15.17:0/2285076837 >> 172.21.15.17:0/2285076837 conn(0x7fc0500fb5f0 msgr2=0x7fc0500fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.647+0000 7fc054dff700 1 -- 172.21.15.17:0/2285076837 shutdown_connections 2023-07-14T13:20:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.647+0000 7fc054dff700 1 -- 172.21.15.17:0/2285076837 wait complete. 2023-07-14T13:20:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.648+0000 7fc054dff700 1 Processor -- start 2023-07-14T13:20:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.648+0000 7fc054dff700 1 -- start start 2023-07-14T13:20:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.648+0000 7fc054dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0500728b0 0x7fc050197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.648+0000 7fc054dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0500731c0 0x7fc050198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.679 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.648+0000 7fc054dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05010c310 0x7fc05019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.648+0000 7fc054dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05019cd00 con 0x7fc0500728b0 2023-07-14T13:20:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.648+0000 7fc054dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05019ce70 con 0x7fc0500731c0 2023-07-14T13:20:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.648+0000 7fc054dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05019d030 con 0x7fc05010c310 2023-07-14T13:20:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.649+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0500728b0 0x7fc050197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.649+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0500728b0 0x7fc050197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44310/0 (socket says 172.21.15.17:44310) 2023-07-14T13:20:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.649+0000 7fc04e59c700 1 -- 172.21.15.17:0/751906791 learned_addr learned my addr 172.21.15.17:0/751906791 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.680 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.649+0000 7fc04ed9d700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05010c310 0x7fc05019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.649+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0500731c0 0x7fc050198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.649+0000 7fc04e59c700 1 -- 172.21.15.17:0/751906791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05010c310 msgr2=0x7fc05019c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.649+0000 7fc04e59c700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05010c310 0x7fc05019c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.649+0000 7fc04e59c700 1 -- 172.21.15.17:0/751906791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0500731c0 msgr2=0x7fc050198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.649+0000 7fc04e59c700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0500731c0 0x7fc050198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.649+0000 7fc04e59c700 1 -- 172.21.15.17:0/751906791 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0440095f0 con 0x7fc0500728b0 2023-07-14T13:20:04.681 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.649+0000 7fc04ed9d700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05010c310 0x7fc05019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:20:04.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.650+0000 7fc04e59c700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0500728b0 0x7fc050197d20 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fc04000e9a0 tx=0x7fc04000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.650+0000 7fc03f7fe700 1 -- 172.21.15.17:0/751906791 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc040009790 con 0x7fc0500728b0 2023-07-14T13:20:04.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.650+0000 7fc03f7fe700 1 -- 172.21.15.17:0/751906791 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc040010430 con 0x7fc0500728b0 2023-07-14T13:20:04.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.650+0000 7fc054dff700 1 -- 172.21.15.17:0/751906791 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05019d310 con 0x7fc0500728b0 2023-07-14T13:20:04.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.650+0000 7fc03f7fe700 1 -- 172.21.15.17:0/751906791 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04000cea0 con 0x7fc0500728b0 2023-07-14T13:20:04.682 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.650+0000 7fc054dff700 1 -- 172.21.15.17:0/751906791 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0501a4b50 con 0x7fc0500728b0 2023-07-14T13:20:04.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.653+0000 7fc03f7fe700 1 -- 172.21.15.17:0/751906791 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc0400105a0 con 0x7fc0500728b0 2023-07-14T13:20:04.683 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.655+0000 7fc06875db80 1 Processor -- start 2023-07-14T13:20:04.684 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.655+0000 7fc06875db80 1 -- start start 2023-07-14T13:20:04.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.655+0000 7fc06875db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea6e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.655+0000 7fc06875db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea79590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc06875db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea7beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc06875db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7e974cb0 con 0x55ad7ea6e2d0 2023-07-14T13:20:04.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc06875db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7e9c7a40 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.685 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc06875db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7e9c0ed0 con 0x55ad7ea79ad0 2023-07-14T13:20:04.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc03f7fe700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0380a1340 0x7fc0380a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc03f7fe700 1 -- 172.21.15.17:0/751906791 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc040014070 con 0x7fc0500728b0 2023-07-14T13:20:04.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc04ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea6e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc04ed9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea6e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44322/0 (socket says 172.21.15.17:44322) 2023-07-14T13:20:04.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc04ed9d700 1 -- 172.21.15.17:0/3219462780 learned_addr learned my addr 172.21.15.17:0/3219462780 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/3219462780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea7beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc04ed9d700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0380a1340 0x7fc0380a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.686 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc04e59c700 1 --2- 172.21.15.17:0/3219462780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea79590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc04dd9b700 1 -- 172.21.15.17:0/3219462780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea6ebe0 msgr2=0x55ad7ea79590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/3219462780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea79590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc04dd9b700 1 -- 172.21.15.17:0/3219462780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 msgr2=0x55ad7ea6e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/3219462780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea6e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.656+0000 7fc04dd9b700 1 -- 172.21.15.17:0/3219462780 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad7e7eede0 con 0x55ad7ea79ad0 2023-07-14T13:20:04.688 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.657+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/3219462780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea7beb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc044005910 tx=0x7fc044005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3faf7bb1353a692 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.657+0000 7fc04ed9d700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0380a1340 0x7fc0380a37f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc0480060b0 tx=0x7fc048009120 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.657+0000 7fc03cff9700 1 -- 172.21.15.17:0/3219462780 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04401d070 con 0x55ad7ea79ad0 2023-07-14T13:20:04.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.657+0000 7fc03cff9700 1 -- 172.21.15.17:0/3219462780 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc04401e040 con 0x55ad7ea79ad0 2023-07-14T13:20:04.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.657+0000 7fc03cff9700 1 -- 172.21.15.17:0/3219462780 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044004720 con 0x55ad7ea79ad0 2023-07-14T13:20:04.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.658+0000 7fc06875db80 1 -- 172.21.15.17:0/3219462780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea79ad0 msgr2=0x55ad7ea7beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.658+0000 7fc06875db80 1 --2- 172.21.15.17:0/3219462780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea7beb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc044005910 tx=0x7fc044005f00 comp rx=0 tx=0).stop 2023-07-14T13:20:04.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.658+0000 7fc06875db80 1 -- 172.21.15.17:0/3219462780 shutdown_connections 2023-07-14T13:20:04.689 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.658+0000 7fc06875db80 1 --2- 172.21.15.17:0/3219462780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea7beb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.658+0000 7fc06875db80 1 --2- 172.21.15.17:0/3219462780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea6e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.658+0000 7fc06875db80 1 --2- 172.21.15.17:0/3219462780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea79590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.658+0000 7fc06875db80 1 -- 172.21.15.17:0/3219462780 >> 172.21.15.17:0/3219462780 conn(0x55ad7ea64da0 msgr2=0x55ad7ea6a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.658+0000 7fc06875db80 1 -- 172.21.15.17:0/3219462780 shutdown_connections 2023-07-14T13:20:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.658+0000 7fc06875db80 1 -- 172.21.15.17:0/3219462780 wait complete. 2023-07-14T13:20:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.659+0000 7fc06875db80 1 -- start start 2023-07-14T13:20:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.659+0000 7fc06875db80 1 Processor -- start 2023-07-14T13:20:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.659+0000 7fc06875db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea794e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.659+0000 7fc06875db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea766f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.659+0000 7fc06875db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea76d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.693 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.659+0000 7fc06875db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7e960ac0 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.659+0000 7fc06875db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7e9607c0 con 0x55ad7ea79ad0 2023-07-14T13:20:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.659+0000 7fc06875db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7e844920 con 0x55ad7ea6e2d0 2023-07-14T13:20:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.659+0000 7fc06875db80 10 client.0 _ll_register_callbacks cb 0x55ad7e95e760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea766f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea766f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44330/0 (socket says 172.21.15.17:44330) 2023-07-14T13:20:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04dd9b700 1 -- 172.21.15.17:0/331563074 learned_addr learned my addr 172.21.15.17:0/331563074 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04ed9d700 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea76d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04e59c700 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea794e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04dd9b700 1 -- 172.21.15.17:0/331563074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6e2d0 msgr2=0x55ad7ea794e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea794e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04dd9b700 1 -- 172.21.15.17:0/331563074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 msgr2=0x55ad7ea76d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea76d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04dd9b700 1 -- 172.21.15.17:0/331563074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05010f390 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04ed9d700 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea76d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:20:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea766f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fc04400b940 tx=0x7fc04400ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7472ef3079d483 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.660+0000 7fc035ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:20:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.661+0000 7fc035ffb700 1 -- 172.21.15.17:0/331563074 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04401d030 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.661+0000 7fc06875db80 1 -- 172.21.15.17:0/331563074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad7e91a4f0 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.661+0000 7fc035ffb700 1 -- 172.21.15.17:0/331563074 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc044004910 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.661+0000 7fc035ffb700 1 -- 172.21.15.17:0/331563074 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc04400bd30 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.696 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.661+0000 7fc06875db80 10 client.19107 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.661+0000 7fc06875db80 1 -- 172.21.15.17:0/331563074 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55ad7e7d7c60 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.661+0000 7fc035ffb700 1 -- 172.21.15.17:0/331563074 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ad7e91a4f0 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.661+0000 7fc035ffb700 1 -- 172.21.15.17:0/331563074 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc04400fa00 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.661+0000 7fc06875db80 10 client.19107 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.661+0000 7fc06875db80 10 client.19107 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:20:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.661+0000 7fc06875db80 20 client.19107 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.662+0000 7fc06875db80 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ad7ea89060 0x55ad7ea8b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.697 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.662+0000 7fc06875db80 4 client.19107 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:20:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.662+0000 7fc06875db80 1 -- 172.21.15.17:0/331563074 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad7e9b9eb0 con 0x55ad7ea89060 2023-07-14T13:20:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.662+0000 7fc04e59c700 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ad7ea89060 0x55ad7ea8b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.662+0000 7fc04e59c700 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ad7ea89060 0x55ad7ea8b470 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4fc4524684db344c server_cookie=452362df17d3fefa in_seq=0 out_seq=0 2023-07-14T13:20:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.662+0000 7fc035ffb700 10 client.19107 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:20:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.663+0000 7fc035ffb700 1 -- 172.21.15.17:0/331563074 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ad7e9b9eb0 con 0x55ad7ea89060 2023-07-14T13:20:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.663+0000 7fc035ffb700 10 client.19107 handle_command_reply: tid=0 2023-07-14T13:20:04.698 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.663+0000 7fc06875db80 1 client.19107 shutdown 2023-07-14T13:20:04.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.663+0000 7fc06875db80 1 -- 172.21.15.17:0/331563074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 msgr2=0x55ad7ea766f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.663+0000 7fc06875db80 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea766f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fc04400b940 tx=0x7fc04400ba20 comp rx=0 tx=0).stop 2023-07-14T13:20:04.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.663+0000 7fc06875db80 1 -- 172.21.15.17:0/331563074 shutdown_connections 2023-07-14T13:20:04.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.663+0000 7fc06875db80 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ad7ea89060 0x55ad7ea8b470 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.664+0000 7fc06875db80 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea76d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.664+0000 7fc06875db80 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea794e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.664+0000 7fc035ffb700 0 client.19107 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:20:04.699 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.664+0000 7fc06875db80 1 --2- 172.21.15.17:0/331563074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea766f0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.664+0000 7fc06875db80 1 -- 172.21.15.17:0/331563074 >> 172.21.15.17:0/331563074 conn(0x55ad7ea64da0 msgr2=0x55ad7ea6a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.664+0000 7fc06875db80 1 -- 172.21.15.17:0/331563074 shutdown_connections 2023-07-14T13:20:04.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.664+0000 7fc06875db80 1 -- 172.21.15.17:0/331563074 wait complete. 2023-07-14T13:20:04.700 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.664+0000 7fc06875db80 20 client.19107 trim_cache size 0 max 16384 2023-07-14T13:20:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.677+0000 7fc06875db80 1 Processor -- start 2023-07-14T13:20:04.706 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc06875db80 1 -- start start 2023-07-14T13:20:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc06875db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea8b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc06875db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea79010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc06875db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea71a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc06875db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7ea77320 con 0x55ad7ea6e2d0 2023-07-14T13:20:04.708 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc06875db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7ea64970 con 0x55ad7ea79ad0 2023-07-14T13:20:04.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc06875db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7ea701a0 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea8b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea8b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44338/0 (socket says 172.21.15.17:44338) 2023-07-14T13:20:04.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc04e59c700 1 -- 172.21.15.17:0/3965403719 learned_addr learned my addr 172.21.15.17:0/3965403719 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc04ed9d700 1 --2- 172.21.15.17:0/3965403719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea71a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.678+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/3965403719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea79010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.709 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.679+0000 7fc04e59c700 1 -- 172.21.15.17:0/3965403719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6ebe0 msgr2=0x55ad7ea79010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.679+0000 7fc04e59c700 1 --2- 172.21.15.17:0/3965403719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea79010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.679+0000 7fc04e59c700 1 -- 172.21.15.17:0/3965403719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 msgr2=0x55ad7ea71a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.679+0000 7fc04e59c700 1 --2- 172.21.15.17:0/3965403719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea71a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.679+0000 7fc04e59c700 1 -- 172.21.15.17:0/3965403719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad7e815250 con 0x55ad7ea6e2d0 2023-07-14T13:20:04.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.679+0000 7fc04ed9d700 1 --2- 172.21.15.17:0/3965403719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea71a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:20:04.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.679+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/3965403719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea79010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:20:04.710 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.679+0000 7fc04e59c700 1 --2- 172.21.15.17:0/3965403719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea8b440 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fc04000c510 tx=0x7fc0400cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9c3d2d5878a8b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.679+0000 7fc03d7fa700 1 -- 172.21.15.17:0/3965403719 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04009df80 con 0x55ad7ea6e2d0 2023-07-14T13:20:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.679+0000 7fc03d7fa700 1 -- 172.21.15.17:0/3965403719 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc04009ede0 con 0x55ad7ea6e2d0 2023-07-14T13:20:04.711 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.679+0000 7fc03d7fa700 1 -- 172.21.15.17:0/3965403719 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04009f060 con 0x55ad7ea6e2d0 2023-07-14T13:20:04.713 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.680+0000 7fc06875db80 1 -- 172.21.15.17:0/3965403719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 msgr2=0x55ad7ea8b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.680+0000 7fc06875db80 1 --2- 172.21.15.17:0/3965403719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea8b440 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fc04000c510 tx=0x7fc0400cc040 comp rx=0 tx=0).stop 2023-07-14T13:20:04.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.680+0000 7fc06875db80 1 -- 172.21.15.17:0/3965403719 shutdown_connections 2023-07-14T13:20:04.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.680+0000 7fc06875db80 1 --2- 172.21.15.17:0/3965403719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea71a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.680+0000 7fc06875db80 1 --2- 172.21.15.17:0/3965403719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea8b440 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.714 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.680+0000 7fc06875db80 1 --2- 172.21.15.17:0/3965403719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea79010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.680+0000 7fc06875db80 1 -- 172.21.15.17:0/3965403719 >> 172.21.15.17:0/3965403719 conn(0x55ad7ea64da0 msgr2=0x55ad7ea8fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.680+0000 7fc06875db80 1 -- 172.21.15.17:0/3965403719 shutdown_connections 2023-07-14T13:20:04.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.680+0000 7fc06875db80 1 -- 172.21.15.17:0/3965403719 wait complete. 2023-07-14T13:20:04.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.680+0000 7fc06875db80 1 -- start start 2023-07-14T13:20:04.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.680+0000 7fc06875db80 1 Processor -- start 2023-07-14T13:20:04.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc06875db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea801c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.715 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc06875db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea7e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc06875db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea7e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc06875db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7ea80ad0 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc06875db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7ea7ef10 con 0x55ad7ea79ad0 2023-07-14T13:20:04.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc06875db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7ea7f080 con 0x55ad7ea6e2d0 2023-07-14T13:20:04.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc06875db80 10 client.0 _ll_register_callbacks cb 0x7fc0480094b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:04.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc04dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea7e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.716 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc04dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea7e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44340/0 (socket says 172.21.15.17:44340) 2023-07-14T13:20:04.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea801c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc04ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea7e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.681+0000 7fc04dd9b700 1 -- 172.21.15.17:0/3138680573 learned_addr learned my addr 172.21.15.17:0/3138680573 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc04dd9b700 1 -- 172.21.15.17:0/3138680573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6e2d0 msgr2=0x55ad7ea801c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea801c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc04dd9b700 1 -- 172.21.15.17:0/3138680573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 msgr2=0x55ad7ea7e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.717 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea7e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc04dd9b700 1 -- 172.21.15.17:0/3138680573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0501a4b50 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc04e59c700 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea801c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:20:04.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc04dd9b700 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea7e490 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fc044009990 tx=0x7fc04400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f146d766feba949 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc035ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:20:04.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc035ffb700 1 -- 172.21.15.17:0/3138680573 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04401d070 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc06875db80 1 -- 172.21.15.17:0/3138680573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc04401e040 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.718 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc035ffb700 1 -- 172.21.15.17:0/3138680573 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc044000e40 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc035ffb700 1 -- 172.21.15.17:0/3138680573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc044005320 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc06875db80 10 client.19113 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:04.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.682+0000 7fc06875db80 1 -- 172.21.15.17:0/3138680573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55ad7e7ed2b0 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.683+0000 7fc035ffb700 1 -- 172.21.15.17:0/3138680573 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc044047080 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.683+0000 7fc035ffb700 1 -- 172.21.15.17:0/3138680573 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc04402c850 con 0x55ad7ea6ebe0 2023-07-14T13:20:04.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.683+0000 7fc06875db80 10 client.19113 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:04.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.683+0000 7fc06875db80 10 client.19113 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2023-07-14T13:20:04.719 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.683+0000 7fc06875db80 20 client.19113 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:04.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.683+0000 7fc06875db80 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ad7eaddd10 0x55ad7eae00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.683+0000 7fc06875db80 4 client.19113 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:20:04.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.683+0000 7fc06875db80 1 -- 172.21.15.17:0/3138680573 --> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ad7e97c050 con 0x55ad7eaddd10 2023-07-14T13:20:04.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.683+0000 7fc04e59c700 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ad7eaddd10 0x55ad7eae00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc04e59c700 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ad7eaddd10 0x55ad7eae00f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=790ca2bbf4ef02c1 server_cookie=a482bcd0f46c3d5a in_seq=0 out_seq=0 2023-07-14T13:20:04.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc035ffb700 10 client.19113 ms_handle_connect on v2:172.21.15.131:6836/3087773753 2023-07-14T13:20:04.720 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc035ffb700 1 -- 172.21.15.17:0/3138680573 <== mds.1 v2:172.21.15.131:6836/3087773753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+689 (crc 0 0 0) 0x55ad7e97c050 con 0x55ad7eaddd10 2023-07-14T13:20:04.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc035ffb700 10 client.19113 handle_command_reply: tid=0 2023-07-14T13:20:04.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc06875db80 1 client.19113 shutdown 2023-07-14T13:20:04.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc06875db80 1 -- 172.21.15.17:0/3138680573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 msgr2=0x55ad7ea7e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc06875db80 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea7e490 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fc044009990 tx=0x7fc04400bd70 comp rx=0 tx=0).stop 2023-07-14T13:20:04.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc06875db80 1 -- 172.21.15.17:0/3138680573 shutdown_connections 2023-07-14T13:20:04.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc06875db80 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.131:6836/3087773753,v1:172.21.15.131:6837/3087773753] conn(0x55ad7eaddd10 0x55ad7eae00f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.721 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc06875db80 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad7ea79ad0 0x55ad7ea7e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc06875db80 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ad7ea6e2d0 0x55ad7ea801c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc06875db80 1 --2- 172.21.15.17:0/3138680573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ad7ea6ebe0 0x55ad7ea7e490 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc06875db80 1 -- 172.21.15.17:0/3138680573 >> 172.21.15.17:0/3138680573 conn(0x55ad7ea64da0 msgr2=0x55ad7ea71a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc035ffb700 0 client.19113 ms_handle_reset on v2:172.21.15.131:6836/3087773753 2023-07-14T13:20:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc06875db80 1 -- 172.21.15.17:0/3138680573 shutdown_connections 2023-07-14T13:20:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.684+0000 7fc06875db80 1 -- 172.21.15.17:0/3138680573 wait complete. 2023-07-14T13:20:04.722 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc06875db80 20 client.19113 trim_cache size 0 max 16384 2023-07-14T13:20:04.723 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2023-07-14T13:20:04.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:20:04.723 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2023-07-14T13:20:04.723 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 483825833, 2023-07-14T13:20:04.723 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 2199023256110, 2023-07-14T13:20:04.723 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/000000010000000100000078" 2023-07-14T13:20:04.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:20:04.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:20:04.724 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2023-07-14T13:20:04.724 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2256753451, 2023-07-14T13:20:04.724 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 2199023256060, 2023-07-14T13:20:04.724 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000008D" 2023-07-14T13:20:04.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:20:04.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:20:04.725 INFO:teuthology.orchestra.run.smithi017.stdout: "damage_type": "backtrace", 2023-07-14T13:20:04.725 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 2989993326, 2023-07-14T13:20:04.725 INFO:teuthology.orchestra.run.smithi017.stdout: "ino": 2199023256113, 2023-07-14T13:20:04.725 INFO:teuthology.orchestra.run.smithi017.stdout: "path": "/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000007F" 2023-07-14T13:20:04.725 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:20:04.725 INFO:teuthology.orchestra.run.smithi017.stdout:] 2023-07-14T13:20:04.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 -- 172.21.15.17:0/751906791 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0380a1340 msgr2=0x7fc0380a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0380a1340 0x7fc0380a37f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc0480060b0 tx=0x7fc048009120 comp rx=0 tx=0).stop 2023-07-14T13:20:04.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 -- 172.21.15.17:0/751906791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0500728b0 msgr2=0x7fc050197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.726 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0500728b0 0x7fc050197d20 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fc04000e9a0 tx=0x7fc04000ecb0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 -- 172.21.15.17:0/751906791 shutdown_connections 2023-07-14T13:20:04.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc0380a1340 0x7fc0380a37f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05010c310 0x7fc05019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0500728b0 0x7fc050197d20 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 --2- 172.21.15.17:0/751906791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0500731c0 0x7fc050198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 -- 172.21.15.17:0/751906791 >> 172.21.15.17:0/751906791 conn(0x7fc0500fb5f0 msgr2=0x7fc05010e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.727 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 -- 172.21.15.17:0/751906791 shutdown_connections 2023-07-14T13:20:04.728 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.685+0000 7fc054dff700 1 -- 172.21.15.17:0/751906791 wait complete. 2023-07-14T13:20:04.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T13:20:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.914+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1944981581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f080ffae0 msgr2=0x7f0f080fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.914+0000 7f0f0cfff700 1 --2- 172.21.15.17:0/1944981581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f080ffae0 0x7f0f080fff50 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009990 tx=0x7f0efc009ca0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.914+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1944981581 shutdown_connections 2023-07-14T13:20:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.914+0000 7f0f0cfff700 1 --2- 172.21.15.17:0/1944981581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f08100490 0x7f0f0810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.914+0000 7f0f0cfff700 1 --2- 172.21.15.17:0/1944981581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f08105af0 0x7f0f08105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.914+0000 7f0f0cfff700 1 --2- 172.21.15.17:0/1944981581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f080ffae0 0x7f0f080fff50 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.914+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1944981581 >> 172.21.15.17:0/1944981581 conn(0x7f0f080fb5e0 msgr2=0x7f0f080fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.914+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1944981581 shutdown_connections 2023-07-14T13:20:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.914+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1944981581 wait complete. 2023-07-14T13:20:04.946 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.915+0000 7f0f0cfff700 1 Processor -- start 2023-07-14T13:20:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.915+0000 7f0f0cfff700 1 -- start start 2023-07-14T13:20:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f0cfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f080ffae0 0x7f0f0819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f0cfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f08100490 0x7f0f0819beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f0cfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f08105af0 0x7f0f081959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f0cfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f08196050 con 0x7f0f08100490 2023-07-14T13:20:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f0cfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f081961c0 con 0x7f0f08105af0 2023-07-14T13:20:04.947 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f0cfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f08196380 con 0x7f0f080ffae0 2023-07-14T13:20:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f05d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f08100490 0x7f0f0819beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f05d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f08100490 0x7f0f0819beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54254/0 (socket says 172.21.15.17:54254) 2023-07-14T13:20:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f05d9b700 1 -- 172.21.15.17:0/1425283776 learned_addr learned my addr 172.21.15.17:0/1425283776 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f0659c700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f080ffae0 0x7f0f0819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f06d9d700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f08105af0 0x7f0f081959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f05d9b700 1 -- 172.21.15.17:0/1425283776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f080ffae0 msgr2=0x7f0f0819b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f080ffae0 0x7f0f0819b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f05d9b700 1 -- 172.21.15.17:0/1425283776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f08105af0 msgr2=0x7f0f081959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f08105af0 0x7f0f081959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f05d9b700 1 -- 172.21.15.17:0/1425283776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc0095f0 con 0x7f0f08100490 2023-07-14T13:20:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f0659c700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f080ffae0 0x7f0f0819b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:20:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.916+0000 7f0f06d9d700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f08105af0 0x7f0f081959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:20:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.917+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f08100490 0x7f0f0819beb0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0efc000c00 tx=0x7f0efc009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.917+0000 7f0ef77fe700 1 -- 172.21.15.17:0/1425283776 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc01d070 con 0x7f0f08100490 2023-07-14T13:20:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.917+0000 7f0ef77fe700 1 -- 172.21.15.17:0/1425283776 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0efc022470 con 0x7f0f08100490 2023-07-14T13:20:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.917+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1425283776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f08196600 con 0x7f0f08100490 2023-07-14T13:20:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.917+0000 7f0ef77fe700 1 -- 172.21.15.17:0/1425283776 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc017650 con 0x7f0f08100490 2023-07-14T13:20:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.917+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1425283776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f081a2960 con 0x7f0f08100490 2023-07-14T13:20:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.920+0000 7f0ef77fe700 1 -- 172.21.15.17:0/1425283776 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0efc00fb00 con 0x7f0f08100490 2023-07-14T13:20:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.921+0000 7f0f20a1fb80 1 Processor -- start 2023-07-14T13:20:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f20a1fb80 1 -- start start 2023-07-14T13:20:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0ef77fe700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0ef00a12c0 0x7f0ef00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0ef77fe700 1 -- 172.21.15.17:0/1425283776 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0efc0ce270 con 0x7f0f08100490 2023-07-14T13:20:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abe86e0 0x559f3abe8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 0x559f3abf39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abf3ee0 0x559f3abf62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3aaeacb0 con 0x559f3abf3ee0 2023-07-14T13:20:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3ab3da40 con 0x559f3abe8ff0 2023-07-14T13:20:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3ab36ed0 con 0x559f3abe86e0 2023-07-14T13:20:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f06d9d700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0ef00a12c0 0x7f0ef00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f05d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 0x559f3abf39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f06d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abf3ee0 0x559f3abf62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f05d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 0x559f3abf39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36864/0 (socket says 172.21.15.17:36864) 2023-07-14T13:20:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.922+0000 7f0f05d9b700 1 -- 172.21.15.17:0/3237965947 learned_addr learned my addr 172.21.15.17:0/3237965947 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0f0659c700 1 --2- 172.21.15.17:0/3237965947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abe86e0 0x559f3abe8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0f05d9b700 1 -- 172.21.15.17:0/3237965947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abe86e0 msgr2=0x559f3abe8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/3237965947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abe86e0 0x559f3abe8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0f05d9b700 1 -- 172.21.15.17:0/3237965947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abf3ee0 msgr2=0x559f3abf62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/3237965947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abf3ee0 0x559f3abf62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0f05d9b700 1 -- 172.21.15.17:0/3237965947 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f3a964de0 con 0x559f3abe8ff0 2023-07-14T13:20:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0f0659c700 1 --2- 172.21.15.17:0/3237965947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abe86e0 0x559f3abe8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:20:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0f06d9d700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0ef00a12c0 0x7f0ef00a3770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009fd0 tx=0x7f0f00009d20 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/3237965947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 0x559f3abf39a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0efc097f10 tx=0x7f0efc09b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85c0be6bcb2a6250 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0ef4ff9700 1 -- 172.21.15.17:0/3237965947 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0ce070 con 0x559f3abe8ff0 2023-07-14T13:20:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0ef4ff9700 1 -- 172.21.15.17:0/3237965947 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0efc022850 con 0x559f3abe8ff0 2023-07-14T13:20:04.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.923+0000 7f0ef4ff9700 1 -- 172.21.15.17:0/3237965947 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc099840 con 0x559f3abe8ff0 2023-07-14T13:20:04.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.924+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/3237965947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 msgr2=0x559f3abf39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.924+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/3237965947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 0x559f3abf39a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0efc097f10 tx=0x7f0efc09b390 comp rx=0 tx=0).stop 2023-07-14T13:20:04.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.924+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/3237965947 shutdown_connections 2023-07-14T13:20:04.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.924+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/3237965947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abf3ee0 0x559f3abf62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.924+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/3237965947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abe86e0 0x559f3abe8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.924+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/3237965947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 0x559f3abf39a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.924+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/3237965947 >> 172.21.15.17:0/3237965947 conn(0x559f3abdada0 msgr2=0x559f3abe06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.960 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.924+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/3237965947 shutdown_connections 2023-07-14T13:20:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.924+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/3237965947 wait complete. 2023-07-14T13:20:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.925+0000 7f0f20a1fb80 1 -- start start 2023-07-14T13:20:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.925+0000 7f0f20a1fb80 1 Processor -- start 2023-07-14T13:20:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.925+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe86e0 0x559f3abf9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.925+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 0x559f3abf9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abf3ee0 0x559f3abf2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3aad6ac0 con 0x559f3abe86e0 2023-07-14T13:20:04.961 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3aad67c0 con 0x559f3abe8ff0 2023-07-14T13:20:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3a9ba920 con 0x559f3abf3ee0 2023-07-14T13:20:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f20a1fb80 10 client.0 _ll_register_callbacks cb 0x559f3aad4760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f0659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe86e0 0x559f3abf9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f0659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe86e0 0x559f3abf9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54278/0 (socket says 172.21.15.17:54278) 2023-07-14T13:20:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f0659c700 1 -- 172.21.15.17:0/2851476767 learned_addr learned my addr 172.21.15.17:0/2851476767 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f06d9d700 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abf3ee0 0x559f3abf2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.962 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 0x559f3abf9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f0659c700 1 -- 172.21.15.17:0/2851476767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abf3ee0 msgr2=0x559f3abf2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f0659c700 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abf3ee0 0x559f3abf2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f0659c700 1 -- 172.21.15.17:0/2851476767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 msgr2=0x559f3abf9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f0659c700 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 0x559f3abf9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f0659c700 1 -- 172.21.15.17:0/2851476767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f081a2960 con 0x559f3abe86e0 2023-07-14T13:20:04.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.926+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 0x559f3abf9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:20:04.963 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.927+0000 7f0f0659c700 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe86e0 0x559f3abf9010 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8011770 tx=0x7f0ef8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55560e85344fe139 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.927+0000 7f0eedffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:20:04.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.927+0000 7f0eedffb700 1 -- 172.21.15.17:0/2851476767 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef800f7c0 con 0x559f3abe86e0 2023-07-14T13:20:04.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.927+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2851476767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f3aa904f0 con 0x559f3abe86e0 2023-07-14T13:20:04.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.927+0000 7f0eedffb700 1 -- 172.21.15.17:0/2851476767 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0ef800f920 con 0x559f3abe86e0 2023-07-14T13:20:04.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.927+0000 7f0eedffb700 1 -- 172.21.15.17:0/2851476767 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ef800fae0 con 0x559f3abe86e0 2023-07-14T13:20:04.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.927+0000 7f0f20a1fb80 10 client.19125 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:04.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.927+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2851476767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x559f3a94dc60 con 0x559f3abe86e0 2023-07-14T13:20:04.964 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.927+0000 7f0eedffb700 1 -- 172.21.15.17:0/2851476767 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559f3aa904f0 con 0x559f3abe86e0 2023-07-14T13:20:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.928+0000 7f0eedffb700 1 -- 172.21.15.17:0/2851476767 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0ef801bcf0 con 0x559f3abe86e0 2023-07-14T13:20:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.928+0000 7f0f20a1fb80 10 client.19125 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.928+0000 7f0f20a1fb80 10 client.19125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.928+0000 7f0f20a1fb80 20 client.19125 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.928+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559f3ac03510 0x559f3ac05920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.928+0000 7f0f20a1fb80 4 client.19125 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:20:04.965 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.928+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2851476767 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f3ab2feb0 con 0x559f3ac03510 2023-07-14T13:20:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.928+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559f3ac03510 0x559f3ac05920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.929+0000 7f0eedffb700 10 client.19125 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.929+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559f3ac03510 0x559f3ac05920 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bd7d1869c9fb26 server_cookie=37fa145ea6b73d2e in_seq=0 out_seq=0 2023-07-14T13:20:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.929+0000 7f0eedffb700 1 -- 172.21.15.17:0/2851476767 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559f3ab2feb0 con 0x559f3ac03510 2023-07-14T13:20:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.929+0000 7f0eedffb700 10 client.19125 handle_command_reply: tid=0 2023-07-14T13:20:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.929+0000 7f0f20a1fb80 1 client.19125 shutdown 2023-07-14T13:20:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.929+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2851476767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe86e0 msgr2=0x559f3abf9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.929+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe86e0 0x559f3abf9010 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8011770 tx=0x7f0ef8011a80 comp rx=0 tx=0).stop 2023-07-14T13:20:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.930+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2851476767 shutdown_connections 2023-07-14T13:20:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.930+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559f3ac03510 0x559f3ac05920 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.930+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abf3ee0 0x559f3abf2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.930+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe86e0 0x559f3abf9010 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.930+0000 7f0eedffb700 0 client.19125 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.930+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2851476767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe8ff0 0x559f3abf9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.930+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2851476767 >> 172.21.15.17:0/2851476767 conn(0x559f3abdada0 msgr2=0x559f3abe0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.930+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2851476767 shutdown_connections 2023-07-14T13:20:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.930+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2851476767 wait complete. 2023-07-14T13:20:04.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.930+0000 7f0f20a1fb80 20 client.19125 trim_cache size 0 max 16384 2023-07-14T13:20:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.943+0000 7f0f20a1fb80 1 Processor -- start 2023-07-14T13:20:04.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f20a1fb80 1 -- start start 2023-07-14T13:20:04.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe86e0 0x559f3abf2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3abf1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abf3ee0 0x559f3abf8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3ac00b00 con 0x559f3abe8ff0 2023-07-14T13:20:04.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3abe95d0 con 0x559f3abe86e0 2023-07-14T13:20:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3abdf1d0 con 0x559f3abf3ee0 2023-07-14T13:20:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f05d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3abf1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f05d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3abf1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54292/0 (socket says 172.21.15.17:54292) 2023-07-14T13:20:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f05d9b700 1 -- 172.21.15.17:0/798652097 learned_addr learned my addr 172.21.15.17:0/798652097 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f0659c700 1 --2- 172.21.15.17:0/798652097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe86e0 0x559f3abf2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f05d9b700 1 -- 172.21.15.17:0/798652097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abf3ee0 msgr2=0x559f3abf8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/798652097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abf3ee0 0x559f3abf8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f05d9b700 1 -- 172.21.15.17:0/798652097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe86e0 msgr2=0x559f3abf2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.944+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/798652097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe86e0 0x559f3abf2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.945+0000 7f0f05d9b700 1 -- 172.21.15.17:0/798652097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f3a98b250 con 0x559f3abe8ff0 2023-07-14T13:20:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.945+0000 7f0f0659c700 1 --2- 172.21.15.17:0/798652097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe86e0 0x559f3abf2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:20:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.945+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/798652097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3abf1d60 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0229e0 tx=0x7f0efc0ce1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b585f60405b681a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.945+0000 7f0ef57fa700 1 -- 172.21.15.17:0/798652097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0ce040 con 0x559f3abe8ff0 2023-07-14T13:20:04.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.945+0000 7f0ef57fa700 1 -- 172.21.15.17:0/798652097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0efc0092b0 con 0x559f3abe8ff0 2023-07-14T13:20:04.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.945+0000 7f0ef57fa700 1 -- 172.21.15.17:0/798652097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc09f120 con 0x559f3abe8ff0 2023-07-14T13:20:04.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.946+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/798652097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 msgr2=0x559f3abf1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.946+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/798652097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3abf1d60 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0229e0 tx=0x7f0efc0ce1a0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.946+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/798652097 shutdown_connections 2023-07-14T13:20:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.946+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/798652097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abf3ee0 0x559f3abf8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.946+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/798652097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abe86e0 0x559f3abf2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.946+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/798652097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3abf1d60 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.946+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/798652097 >> 172.21.15.17:0/798652097 conn(0x559f3abdada0 msgr2=0x559f3abf1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.946+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/798652097 shutdown_connections 2023-07-14T13:20:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.946+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/798652097 wait complete. 2023-07-14T13:20:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.946+0000 7f0f20a1fb80 1 -- start start 2023-07-14T13:20:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.946+0000 7f0f20a1fb80 1 Processor -- start 2023-07-14T13:20:04.981 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abe86e0 0x559f3ac509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3ac50f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f20a1fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abf3ee0 0x559f3ac4b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3ac4ba50 con 0x559f3abe8ff0 2023-07-14T13:20:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3ac4bbc0 con 0x559f3abf3ee0 2023-07-14T13:20:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f20a1fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3ac4bd80 con 0x559f3abe86e0 2023-07-14T13:20:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f20a1fb80 10 client.0 _ll_register_callbacks cb 0x7f0ef8009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f05d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3ac50f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.982 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f05d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3ac50f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54300/0 (socket says 172.21.15.17:54300) 2023-07-14T13:20:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f05d9b700 1 -- 172.21.15.17:0/2786139529 learned_addr learned my addr 172.21.15.17:0/2786139529 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f0659c700 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abe86e0 0x559f3ac509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f05d9b700 1 -- 172.21.15.17:0/2786139529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abe86e0 msgr2=0x559f3ac509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abe86e0 0x559f3ac509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f05d9b700 1 -- 172.21.15.17:0/2786139529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abf3ee0 msgr2=0x559f3ac4b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abf3ee0 0x559f3ac4b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.983 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.947+0000 7f0f05d9b700 1 -- 172.21.15.17:0/2786139529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f3a964de0 con 0x559f3abe8ff0 2023-07-14T13:20:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0f05d9b700 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3ac50f10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0cbaf0 tx=0x7f0efc0a3860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78147a6cb092eded server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0eedffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:20:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0eedffb700 1 -- 172.21.15.17:0/2786139529 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0ce040 con 0x559f3abe8ff0 2023-07-14T13:20:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0eedffb700 1 -- 172.21.15.17:0/2786139529 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0efc086070 con 0x559f3abe8ff0 2023-07-14T13:20:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2786139529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0efc022850 con 0x559f3abe8ff0 2023-07-14T13:20:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0eedffb700 1 -- 172.21.15.17:0/2786139529 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0efc0226a0 con 0x559f3abe8ff0 2023-07-14T13:20:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0f20a1fb80 10 client.19131 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:04.984 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2786139529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x559f3a9632b0 con 0x559f3abe8ff0 2023-07-14T13:20:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0eedffb700 1 -- 172.21.15.17:0/2786139529 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0efc022850 con 0x559f3abe8ff0 2023-07-14T13:20:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0eedffb700 1 -- 172.21.15.17:0/2786139529 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0efc09a990 con 0x559f3abe8ff0 2023-07-14T13:20:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0f20a1fb80 10 client.19131 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0f20a1fb80 10 client.19131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0f20a1fb80 20 client.19131 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559f3ac582d0 0x559f3ac5a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:04.985 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0f20a1fb80 4 client.19131 mds_command: new command op to 24593 tid=0[{"prefix": "damage ls"}] 2023-07-14T13:20:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.948+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2786139529 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559f3aaf2050 con 0x559f3ac582d0 2023-07-14T13:20:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.949+0000 7f0f0659c700 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559f3ac582d0 0x559f3ac5a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.949+0000 7f0f0659c700 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559f3ac582d0 0x559f3ac5a6e0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd7c9a4a28fbdaa8 server_cookie=f397a7c104b20cca in_seq=0 out_seq=0 2023-07-14T13:20:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.949+0000 7f0eedffb700 10 client.19131 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.949+0000 7f0eedffb700 1 -- 172.21.15.17:0/2786139529 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559f3aaf2050 con 0x559f3ac582d0 2023-07-14T13:20:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.949+0000 7f0eedffb700 10 client.19131 handle_command_reply: tid=0 2023-07-14T13:20:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.949+0000 7f0f20a1fb80 1 client.19131 shutdown 2023-07-14T13:20:04.986 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2786139529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 msgr2=0x559f3ac50f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3ac50f10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0cbaf0 tx=0x7f0efc0a3860 comp rx=0 tx=0).stop 2023-07-14T13:20:04.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2786139529 shutdown_connections 2023-07-14T13:20:04.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559f3ac582d0 0x559f3ac5a6e0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f3abf3ee0 0x559f3ac4b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f3abe86e0 0x559f3ac509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0eedffb700 0 client.19131 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:04.987 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0f20a1fb80 1 --2- 172.21.15.17:0/2786139529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559f3abe8ff0 0x559f3ac50f10 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2786139529 >> 172.21.15.17:0/2786139529 conn(0x559f3abdada0 msgr2=0x559f3abf1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2786139529 shutdown_connections 2023-07-14T13:20:04.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0f20a1fb80 1 -- 172.21.15.17:0/2786139529 wait complete. 2023-07-14T13:20:04.988 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.950+0000 7f0f20a1fb80 20 client.19131 trim_cache size 0 max 16384 2023-07-14T13:20:04.988 INFO:teuthology.orchestra.run.smithi017.stdout:[] 2023-07-14T13:20:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1425283776 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0ef00a12c0 msgr2=0x7f0ef00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0ef00a12c0 0x7f0ef00a3770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009fd0 tx=0x7f0f00009d20 comp rx=0 tx=0).stop 2023-07-14T13:20:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1425283776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f08100490 msgr2=0x7f0f0819beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:04.989 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f08100490 0x7f0f0819beb0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0efc000c00 tx=0x7f0efc009570 comp rx=0 tx=0).stop 2023-07-14T13:20:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1425283776 shutdown_connections 2023-07-14T13:20:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0ef00a12c0 0x7f0ef00a3770 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f08105af0 0x7f0f081959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f080ffae0 0x7f0f0819b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 --2- 172.21.15.17:0/1425283776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f08100490 0x7f0f0819beb0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1425283776 >> 172.21.15.17:0/1425283776 conn(0x7f0f080fb5e0 msgr2=0x7f0f080fbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:04.990 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1425283776 shutdown_connections 2023-07-14T13:20:04.991 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:20:04.951+0000 7f0f0cfff700 1 -- 172.21.15.17:0/1425283776 wait complete. 2023-07-14T13:20:04.997 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 483825833, 'ino': 2199023256110, 'path': '/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/000000010000000100000078'}, {'damage_type': 'backtrace', 'id': 2256753451, 'ino': 2199023256060, 'path': '/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000008D'}, {'damage_type': 'backtrace', 'id': 2989993326, 'ino': 2199023256113, 'path': '/volumes/_nogroup/sv_0/52fc56da-dc94-4d3f-a0a3-91ce35989bb3/postgres/data/pg_wal/00000001000000010000007F'}] 2023-07-14T13:20:04.998 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-07-14T13:20:05.355 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:04 smithi017 ceph-mon[95536]: pgmap v641: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 13 MiB/s wr, 893 op/s 2023-07-14T13:20:05.446 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:04 smithi135 ceph-mon[97338]: pgmap v641: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 13 MiB/s wr, 893 op/s 2023-07-14T13:20:05.495 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:04 smithi131 ceph-mon[96953]: pgmap v641: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 13 MiB/s wr, 893 op/s 2023-07-14T13:20:07.450 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 115.0 s, 111.6 tps, lat 570.906 ms stddev 1003.207 2023-07-14T13:20:07.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:07 smithi017 ceph-mon[95536]: pgmap v642: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-07-14T13:20:07.697 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:07 smithi135 ceph-mon[97338]: pgmap v642: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-07-14T13:20:07.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:07 smithi131 ceph-mon[96953]: pgmap v642: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-07-14T13:20:09.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:09 smithi017 ceph-mon[95536]: pgmap v643: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 11 MiB/s wr, 779 op/s 2023-07-14T13:20:09.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:09 smithi135 ceph-mon[97338]: pgmap v643: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 11 MiB/s wr, 779 op/s 2023-07-14T13:20:09.746 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:09 smithi131 ceph-mon[96953]: pgmap v643: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 11 MiB/s wr, 779 op/s 2023-07-14T13:20:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.235+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/3222683095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d54104e50 msgr2=0x7f8d5410ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.235+0000 7f8d5b5ff700 1 --2- 172.21.15.17:0/3222683095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d54104e50 0x7f8d5410ca00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00b0a0 tx=0x7f8d4c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.235+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/3222683095 shutdown_connections 2023-07-14T13:20:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.235+0000 7f8d5b5ff700 1 --2- 172.21.15.17:0/3222683095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d54104e50 0x7f8d5410ca00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.235+0000 7f8d5b5ff700 1 --2- 172.21.15.17:0/3222683095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d54067c10 0x7f8d54067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.235+0000 7f8d5b5ff700 1 --2- 172.21.15.17:0/3222683095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540685b0 0x7f8d54104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.235+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/3222683095 >> 172.21.15.17:0/3222683095 conn(0x7f8d54074760 msgr2=0x7f8d54074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.235+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/3222683095 shutdown_connections 2023-07-14T13:20:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.236+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/3222683095 wait complete. 2023-07-14T13:20:11.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.237+0000 7f8d5b5ff700 1 Processor -- start 2023-07-14T13:20:11.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.237+0000 7f8d5b5ff700 1 -- start start 2023-07-14T13:20:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.238+0000 7f8d5b5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d54067c10 0x7f8d540fe990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.238+0000 7f8d5b5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d540685b0 0x7f8d540feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.238+0000 7f8d5b5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d54104e50 0x7f8d54070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.238+0000 7f8d5b5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d54070e70 con 0x7f8d54104e50 2023-07-14T13:20:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.238+0000 7f8d5b5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d54070fb0 con 0x7f8d540685b0 2023-07-14T13:20:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.238+0000 7f8d5b5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d54071170 con 0x7f8d54067c10 2023-07-14T13:20:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.238+0000 7f8d58b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d540685b0 0x7f8d540feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.238+0000 7f8d58b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d540685b0 0x7f8d540feef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36896/0 (socket says 172.21.15.17:36896) 2023-07-14T13:20:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.239+0000 7f8d58b9a700 1 -- 172.21.15.17:0/2138640413 learned_addr learned my addr 172.21.15.17:0/2138640413 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.239+0000 7f8d58b9a700 1 -- 172.21.15.17:0/2138640413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d54067c10 msgr2=0x7f8d540fe990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.239+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d54067c10 0x7f8d540fe990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.239+0000 7f8d58b9a700 1 -- 172.21.15.17:0/2138640413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d54104e50 msgr2=0x7f8d54070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.239+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d54104e50 0x7f8d54070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.239+0000 7f8d58b9a700 1 -- 172.21.15.17:0/2138640413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c009d00 con 0x7f8d540685b0 2023-07-14T13:20:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.239+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d540685b0 0x7f8d540feef0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000c9b0 tx=0x7f8d5000cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.240+0000 7f8d4a7fc700 1 -- 172.21.15.17:0/2138640413 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50007a20 con 0x7f8d540685b0 2023-07-14T13:20:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.240+0000 7f8d4a7fc700 1 -- 172.21.15.17:0/2138640413 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d50007b80 con 0x7f8d540685b0 2023-07-14T13:20:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.240+0000 7f8d4a7fc700 1 -- 172.21.15.17:0/2138640413 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50018660 con 0x7f8d540685b0 2023-07-14T13:20:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.240+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/2138640413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d54071450 con 0x7f8d540685b0 2023-07-14T13:20:11.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.240+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/2138640413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d54071910 con 0x7f8d540685b0 2023-07-14T13:20:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.250+0000 7f8d4a7fc700 1 -- 172.21.15.17:0/2138640413 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8d5000f450 con 0x7f8d540685b0 2023-07-14T13:20:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.250+0000 7f8d6eff4b80 1 Processor -- start 2023-07-14T13:20:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.251+0000 7f8d6eff4b80 1 -- start start 2023-07-14T13:20:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.251+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.251+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 0x55f4fe5e2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.251+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5e29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.251+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe4e7c50 con 0x55f4fe5e82d0 2023-07-14T13:20:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.251+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe53a9e0 con 0x55f4fe43e6b0 2023-07-14T13:20:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.251+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe533e70 con 0x55f4fe5e2580 2023-07-14T13:20:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.252+0000 7f8d58b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5e29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.252+0000 7f8d58b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5e29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:42078/0 (socket says 172.21.15.17:42078) 2023-07-14T13:20:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.252+0000 7f8d58b9a700 1 -- 172.21.15.17:0/1019566905 learned_addr learned my addr 172.21.15.17:0/1019566905 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.252+0000 7f8d59b9c700 1 --2- 172.21.15.17:0/1019566905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.252+0000 7f8d5939b700 1 --2- 172.21.15.17:0/1019566905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 0x55f4fe5e2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.252+0000 7f8d58b9a700 1 -- 172.21.15.17:0/1019566905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 msgr2=0x55f4fe5e7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.252+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/1019566905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5e7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.252+0000 7f8d58b9a700 1 -- 172.21.15.17:0/1019566905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 msgr2=0x55f4fe5e2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.252+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/1019566905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 0x55f4fe5e2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.252+0000 7f8d58b9a700 1 -- 172.21.15.17:0/1019566905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4fe361d80 con 0x55f4fe5e2580 2023-07-14T13:20:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.253+0000 7f8d4a7fc700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a14d0 0x7f8d400a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.253+0000 7f8d4a7fc700 1 -- 172.21.15.17:0/2138640413 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8d500ccb40 con 0x7f8d540685b0 2023-07-14T13:20:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.253+0000 7f8d59b9c700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a14d0 0x7f8d400a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.253+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/1019566905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5e29d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8d500ca190 tx=0x7f8d500d0ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e8844e26ea62eb8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.254+0000 7f8d3f7fe700 1 -- 172.21.15.17:0/1019566905 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50095f10 con 0x55f4fe5e2580 2023-07-14T13:20:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.254+0000 7f8d3f7fe700 1 -- 172.21.15.17:0/1019566905 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d500999a0 con 0x55f4fe5e2580 2023-07-14T13:20:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.254+0000 7f8d3f7fe700 1 -- 172.21.15.17:0/1019566905 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50099530 con 0x55f4fe5e2580 2023-07-14T13:20:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.255+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/1019566905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 msgr2=0x55f4fe5e29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.255+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/1019566905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5e29d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8d500ca190 tx=0x7f8d500d0ab0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.255+0000 7f8d59b9c700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a14d0 0x7f8d400a3980 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0062a0 tx=0x7f8d4c009c00 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.255+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/1019566905 shutdown_connections 2023-07-14T13:20:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.255+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/1019566905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5e29d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.255+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/1019566905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.255+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/1019566905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 0x55f4fe5e2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.255+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/1019566905 >> 172.21.15.17:0/1019566905 conn(0x55f4fe5d7be0 msgr2=0x55f4fe5dcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.255+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/1019566905 shutdown_connections 2023-07-14T13:20:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.256+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/1019566905 wait complete. 2023-07-14T13:20:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.256+0000 7f8d6eff4b80 1 -- start start 2023-07-14T13:20:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.257+0000 7f8d6eff4b80 1 Processor -- start 2023-07-14T13:20:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.257+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5ee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.258+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5eb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.258+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 0x55f4fe5ec000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.258+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe4d3a60 con 0x55f4fe5e82d0 2023-07-14T13:20:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.258+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe4d3760 con 0x55f4fe43e6b0 2023-07-14T13:20:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.258+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe3b78c0 con 0x55f4fe5e2580 2023-07-14T13:20:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.258+0000 7f8d6eff4b80 10 client.0 _ll_register_callbacks cb 0x55f4fe4d1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.258+0000 7f8d58b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5eb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.258+0000 7f8d5939b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.258+0000 7f8d5939b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5ee640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36912/0 (socket says 172.21.15.17:36912) 2023-07-14T13:20:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.258+0000 7f8d5939b700 1 -- 172.21.15.17:0/468765408 learned_addr learned my addr 172.21.15.17:0/468765408 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.258+0000 7f8d59b9c700 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 0x55f4fe5ec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.259+0000 7f8d5939b700 1 -- 172.21.15.17:0/468765408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 msgr2=0x55f4fe5eb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.259+0000 7f8d5939b700 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5eb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.259+0000 7f8d5939b700 1 -- 172.21.15.17:0/468765408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 msgr2=0x55f4fe5ec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.259+0000 7f8d5939b700 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 0x55f4fe5ec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.259+0000 7f8d5939b700 1 -- 172.21.15.17:0/468765408 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d54071910 con 0x55f4fe43e6b0 2023-07-14T13:20:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.259+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5eb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:20:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.260+0000 7f8d5939b700 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5ee640 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8d44011660 tx=0x7f8d44011970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa3f9fe8e55296a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.260+0000 7f8d3cff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:20:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.260+0000 7f8d3cff9700 1 -- 172.21.15.17:0/468765408 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44012860 con 0x55f4fe43e6b0 2023-07-14T13:20:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.260+0000 7f8d3cff9700 1 -- 172.21.15.17:0/468765408 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8d440129c0 con 0x55f4fe43e6b0 2023-07-14T13:20:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.260+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/468765408 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4fe48d490 con 0x55f4fe43e6b0 2023-07-14T13:20:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.260+0000 7f8d3cff9700 1 -- 172.21.15.17:0/468765408 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d44012b80 con 0x55f4fe43e6b0 2023-07-14T13:20:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.260+0000 7f8d6eff4b80 10 client.28883 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.261+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/468765408 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55f4fe34ac00 con 0x55f4fe43e6b0 2023-07-14T13:20:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.261+0000 7f8d3cff9700 1 -- 172.21.15.17:0/468765408 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f4fe48d490 con 0x55f4fe43e6b0 2023-07-14T13:20:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.263+0000 7f8d3cff9700 1 -- 172.21.15.17:0/468765408 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8d4401a3f0 con 0x55f4fe43e6b0 2023-07-14T13:20:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.263+0000 7f8d6eff4b80 10 client.28883 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.263+0000 7f8d6eff4b80 10 client.28883 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.263+0000 7f8d6eff4b80 20 client.28883 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.263+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4fe63fc00 0x55f4fe642010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.263+0000 7f8d6eff4b80 4 client.28883 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:20:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.263+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/468765408 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4fe52ce50 con 0x55f4fe63fc00 2023-07-14T13:20:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.263+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4fe63fc00 0x55f4fe642010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.264+0000 7f8d3cff9700 10 client.28883 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.264+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4fe63fc00 0x55f4fe642010 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89bb20c011dc1052 server_cookie=b4b7c6b247cf8da9 in_seq=0 out_seq=0 2023-07-14T13:20:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.265+0000 7f8d3cff9700 1 -- 172.21.15.17:0/468765408 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f4fe52ce50 con 0x55f4fe63fc00 2023-07-14T13:20:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.265+0000 7f8d3cff9700 10 client.28883 handle_command_reply: tid=0 2023-07-14T13:20:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.265+0000 7f8d6eff4b80 1 client.28883 shutdown 2023-07-14T13:20:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.268+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/468765408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 msgr2=0x55f4fe5ee640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.268+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5ee640 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8d44011660 tx=0x7f8d44011970 comp rx=0 tx=0).stop 2023-07-14T13:20:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.270+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/468765408 shutdown_connections 2023-07-14T13:20:11.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.270+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4fe63fc00 0x55f4fe642010 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.270+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 0x55f4fe5ec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.270+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5ee640 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.270+0000 7f8d3cff9700 0 client.28883 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:11.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.270+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/468765408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5eb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.270+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/468765408 >> 172.21.15.17:0/468765408 conn(0x55f4fe5d7be0 msgr2=0x55f4fe5dc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:11.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.271+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/468765408 shutdown_connections 2023-07-14T13:20:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.272+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/468765408 wait complete. 2023-07-14T13:20:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.272+0000 7f8d6eff4b80 20 client.28883 trim_cache size 0 max 16384 2023-07-14T13:20:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.299+0000 7f8d6eff4b80 1 Processor -- start 2023-07-14T13:20:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.300+0000 7f8d6eff4b80 1 -- start start 2023-07-14T13:20:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.300+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5e7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.300+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5ee1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.300+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 0x55f4fe5dcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.300+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe5ec600 con 0x55f4fe5e82d0 2023-07-14T13:20:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.300+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe5e7a10 con 0x55f4fe43e6b0 2023-07-14T13:20:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.300+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe5de770 con 0x55f4fe5e2580 2023-07-14T13:20:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.301+0000 7f8d58b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5ee1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.301+0000 7f8d58b9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5ee1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:42086/0 (socket says 172.21.15.17:42086) 2023-07-14T13:20:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.301+0000 7f8d58b9a700 1 -- 172.21.15.17:0/2615516854 learned_addr learned my addr 172.21.15.17:0/2615516854 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.301+0000 7f8d5939b700 1 --2- 172.21.15.17:0/2615516854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5e7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.301+0000 7f8d58b9a700 1 -- 172.21.15.17:0/2615516854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 msgr2=0x55f4fe5e7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.301+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/2615516854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5e7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.301+0000 7f8d58b9a700 1 -- 172.21.15.17:0/2615516854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 msgr2=0x55f4fe5dcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.301+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/2615516854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 0x55f4fe5dcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.301+0000 7f8d58b9a700 1 -- 172.21.15.17:0/2615516854 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4fe3881f0 con 0x55f4fe5e2580 2023-07-14T13:20:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.302+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/2615516854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5ee1e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000cfd0 tx=0x7f8d500d0610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15330f0541727f7d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.302+0000 7f8d3ffff700 1 -- 172.21.15.17:0/2615516854 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d500ca1c0 con 0x55f4fe5e2580 2023-07-14T13:20:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.302+0000 7f8d3ffff700 1 -- 172.21.15.17:0/2615516854 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d50099530 con 0x55f4fe5e2580 2023-07-14T13:20:11.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.302+0000 7f8d3ffff700 1 -- 172.21.15.17:0/2615516854 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d500a2020 con 0x55f4fe5e2580 2023-07-14T13:20:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.303+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/2615516854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 msgr2=0x55f4fe5ee1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.303+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/2615516854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5ee1e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000cfd0 tx=0x7f8d500d0610 comp rx=0 tx=0).stop 2023-07-14T13:20:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.305+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/2615516854 shutdown_connections 2023-07-14T13:20:11.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.305+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/2615516854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e82d0 0x55f4fe5dcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.305+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/2615516854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe43e6b0 0x55f4fe5e7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.305+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/2615516854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe5e2580 0x55f4fe5ee1e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.305+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/2615516854 >> 172.21.15.17:0/2615516854 conn(0x55f4fe5d7be0 msgr2=0x55f4fe5e6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.305+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/2615516854 shutdown_connections 2023-07-14T13:20:11.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.306+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/2615516854 wait complete. 2023-07-14T13:20:11.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.306+0000 7f8d6eff4b80 1 -- start start 2023-07-14T13:20:11.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.307+0000 7f8d6eff4b80 1 Processor -- start 2023-07-14T13:20:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.307+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe43e6b0 0x55f4fe634c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.307+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e2580 0x55f4fe635150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.307+0000 7f8d6eff4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe5e82d0 0x55f4fe635690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.307+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe692b20 con 0x55f4fe5e2580 2023-07-14T13:20:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.307+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe692c60 con 0x55f4fe5e82d0 2023-07-14T13:20:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.307+0000 7f8d6eff4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fe692df0 con 0x55f4fe43e6b0 2023-07-14T13:20:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.307+0000 7f8d6eff4b80 10 client.0 _ll_register_callbacks cb 0x7f8d44009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.308+0000 7f8d59b9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe5e82d0 0x55f4fe635690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.308+0000 7f8d59b9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe5e82d0 0x55f4fe635690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36936/0 (socket says 172.21.15.17:36936) 2023-07-14T13:20:11.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.308+0000 7f8d59b9c700 1 -- 172.21.15.17:0/4093949334 learned_addr learned my addr 172.21.15.17:0/4093949334 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:11.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.308+0000 7f8d5939b700 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe43e6b0 0x55f4fe634c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.309+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e2580 0x55f4fe635150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.309+0000 7f8d59b9c700 1 -- 172.21.15.17:0/4093949334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe43e6b0 msgr2=0x55f4fe634c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.309+0000 7f8d59b9c700 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe43e6b0 0x55f4fe634c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.309+0000 7f8d59b9c700 1 -- 172.21.15.17:0/4093949334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e2580 msgr2=0x55f4fe635150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.309+0000 7f8d59b9c700 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e2580 0x55f4fe635150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.309+0000 7f8d59b9c700 1 -- 172.21.15.17:0/4093949334 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4fe361d80 con 0x55f4fe5e82d0 2023-07-14T13:20:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.309+0000 7f8d58b9a700 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e2580 0x55f4fe635150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:20:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.309+0000 7f8d59b9c700 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe5e82d0 0x55f4fe635690 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00b0a0 tx=0x7f8d4c0079f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd2c6eb10b7ff51c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.310+0000 7f8d3cff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:20:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.310+0000 7f8d3cff9700 1 -- 172.21.15.17:0/4093949334 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c00e040 con 0x55f4fe5e82d0 2023-07-14T13:20:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.310+0000 7f8d3cff9700 1 -- 172.21.15.17:0/4093949334 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8d4c024040 con 0x55f4fe5e82d0 2023-07-14T13:20:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.310+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/4093949334 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d500999a0 con 0x55f4fe5e82d0 2023-07-14T13:20:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.311+0000 7f8d3cff9700 1 -- 172.21.15.17:0/4093949334 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d4c01c640 con 0x55f4fe5e82d0 2023-07-14T13:20:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.311+0000 7f8d6eff4b80 10 client.28889 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.311+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/4093949334 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55f4fe360250 con 0x55f4fe5e82d0 2023-07-14T13:20:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.311+0000 7f8d3cff9700 1 -- 172.21.15.17:0/4093949334 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d500999a0 con 0x55f4fe5e82d0 2023-07-14T13:20:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.312+0000 7f8d3cff9700 1 -- 172.21.15.17:0/4093949334 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8d4c005770 con 0x55f4fe5e82d0 2023-07-14T13:20:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.312+0000 7f8d6eff4b80 10 client.28889 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.312+0000 7f8d6eff4b80 10 client.28889 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.312+0000 7f8d6eff4b80 20 client.28889 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.312+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4fe694450 0x55f4fe696860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.312+0000 7f8d6eff4b80 4 client.28889 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:20:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.312+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/4093949334 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f4fe4eeff0 con 0x55f4fe694450 2023-07-14T13:20:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.313+0000 7f8d5939b700 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4fe694450 0x55f4fe696860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.313+0000 7f8d5939b700 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4fe694450 0x55f4fe696860 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7f7289b873c08ee server_cookie=ae4cb67ea3923c0b in_seq=0 out_seq=0 2023-07-14T13:20:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.313+0000 7f8d3cff9700 10 client.28889 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:11.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.327+0000 7f8d3cff9700 1 -- 172.21.15.17:0/4093949334 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f4fe4eeff0 con 0x55f4fe694450 2023-07-14T13:20:11.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.327+0000 7f8d3cff9700 10 client.28889 handle_command_reply: tid=0 2023-07-14T13:20:11.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.327+0000 7f8d6eff4b80 1 client.28889 shutdown 2023-07-14T13:20:11.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.327+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/4093949334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe5e82d0 msgr2=0x55f4fe635690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.327+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe5e82d0 0x55f4fe635690 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00b0a0 tx=0x7f8d4c0079f0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.327+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/4093949334 shutdown_connections 2023-07-14T13:20:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.327+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4fe694450 0x55f4fe696860 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.327+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4fe5e82d0 0x55f4fe635690 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.327+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4fe43e6b0 0x55f4fe634c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.327+0000 7f8d6eff4b80 1 --2- 172.21.15.17:0/4093949334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4fe5e2580 0x55f4fe635150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.327+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/4093949334 >> 172.21.15.17:0/4093949334 conn(0x55f4fe5d7be0 msgr2=0x55f4fe5e72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.328+0000 7f8d3cff9700 0 client.28889 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.328+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/4093949334 shutdown_connections 2023-07-14T13:20:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.328+0000 7f8d6eff4b80 1 -- 172.21.15.17:0/4093949334 wait complete. 2023-07-14T13:20:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.328+0000 7f8d6eff4b80 20 client.28889 trim_cache size 0 max 16384 2023-07-14T13:20:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:20:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:20:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:20:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:20:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.330+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/2138640413 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a14d0 msgr2=0x7f8d400a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.330+0000 7f8d5b5ff700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a14d0 0x7f8d400a3980 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0062a0 tx=0x7f8d4c009c00 comp rx=0 tx=0).stop 2023-07-14T13:20:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.330+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/2138640413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d540685b0 msgr2=0x7f8d540feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.330+0000 7f8d5b5ff700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d540685b0 0x7f8d540feef0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000c9b0 tx=0x7f8d5000cd70 comp rx=0 tx=0).stop 2023-07-14T13:20:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.330+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/2138640413 shutdown_connections 2023-07-14T13:20:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.330+0000 7f8d5b5ff700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a14d0 0x7f8d400a3980 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.330+0000 7f8d5b5ff700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d54104e50 0x7f8d54070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.330+0000 7f8d5b5ff700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d54067c10 0x7f8d540fe990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.330+0000 7f8d5b5ff700 1 --2- 172.21.15.17:0/2138640413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d540685b0 0x7f8d540feef0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.330+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/2138640413 >> 172.21.15.17:0/2138640413 conn(0x7f8d54074760 msgr2=0x7f8d541036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.331+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/2138640413 shutdown_connections 2023-07-14T13:20:11.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:11.332+0000 7f8d5b5ff700 1 -- 172.21.15.17:0/2138640413 wait complete. 2023-07-14T13:20:11.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:11 smithi017 ceph-mon[95536]: pgmap v644: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 12 MiB/s wr, 853 op/s 2023-07-14T13:20:11.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:11 smithi135 ceph-mon[97338]: pgmap v644: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 12 MiB/s wr, 853 op/s 2023-07-14T13:20:11.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:11 smithi131 ceph-mon[96953]: pgmap v644: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 12 MiB/s wr, 853 op/s 2023-07-14T13:20:12.450 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 120.0 s, 219.7 tps, lat 706.509 ms stddev 1375.736 2023-07-14T13:20:13.607 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:13 smithi017 ceph-mon[95536]: pgmap v645: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 3.5 MiB/s wr, 275 op/s 2023-07-14T13:20:13.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:13 smithi135 ceph-mon[97338]: pgmap v645: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 3.5 MiB/s wr, 275 op/s 2023-07-14T13:20:13.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:13 smithi131 ceph-mon[96953]: pgmap v645: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 3.5 MiB/s wr, 275 op/s 2023-07-14T13:20:15.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:15 smithi017 ceph-mon[95536]: pgmap v646: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 3.5 MiB/s wr, 275 op/s 2023-07-14T13:20:15.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:15 smithi017 ceph-mon[95536]: osdmap e118: 12 total, 12 up, 12 in 2023-07-14T13:20:15.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:15 smithi135 ceph-mon[97338]: pgmap v646: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 3.5 MiB/s wr, 275 op/s 2023-07-14T13:20:15.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:15 smithi135 ceph-mon[97338]: osdmap e118: 12 total, 12 up, 12 in 2023-07-14T13:20:15.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:15 smithi131 ceph-mon[96953]: pgmap v646: 97 pgs: 97 active+clean; 16 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 3.5 MiB/s wr, 275 op/s 2023-07-14T13:20:15.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:15 smithi131 ceph-mon[96953]: osdmap e118: 12 total, 12 up, 12 in 2023-07-14T13:20:17.451 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 125.0 s, 219.9 tps, lat 462.351 ms stddev 915.596 2023-07-14T13:20:17.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:17 smithi017 ceph-mon[95536]: pgmap v648: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 4.7 MiB/s wr, 361 op/s 2023-07-14T13:20:17.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:17 smithi135 ceph-mon[97338]: pgmap v648: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 4.7 MiB/s wr, 361 op/s 2023-07-14T13:20:17.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:17 smithi131 ceph-mon[96953]: pgmap v648: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 4.7 MiB/s wr, 361 op/s 2023-07-14T13:20:19.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:19 smithi017 ceph-mon[95536]: pgmap v649: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 4.7 MiB/s wr, 361 op/s 2023-07-14T13:20:19.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:19 smithi135 ceph-mon[97338]: pgmap v649: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 4.7 MiB/s wr, 361 op/s 2023-07-14T13:20:19.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:19 smithi131 ceph-mon[96953]: pgmap v649: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 4.7 MiB/s wr, 361 op/s 2023-07-14T13:20:21.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:21 smithi017 ceph-mon[95536]: pgmap v650: 97 pgs: 97 active+clean; 14 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 10 MiB/s wr, 737 op/s 2023-07-14T13:20:21.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:21 smithi017 ceph-mon[95536]: osdmap e119: 12 total, 12 up, 12 in 2023-07-14T13:20:21.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:21 smithi135 ceph-mon[97338]: pgmap v650: 97 pgs: 97 active+clean; 14 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 10 MiB/s wr, 737 op/s 2023-07-14T13:20:21.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:21 smithi135 ceph-mon[97338]: osdmap e119: 12 total, 12 up, 12 in 2023-07-14T13:20:21.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:21 smithi131 ceph-mon[96953]: pgmap v650: 97 pgs: 97 active+clean; 14 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 10 MiB/s wr, 737 op/s 2023-07-14T13:20:21.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:21 smithi131 ceph-mon[96953]: osdmap e119: 12 total, 12 up, 12 in 2023-07-14T13:20:22.449 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 130.0 s, 624.1 tps, lat 159.987 ms stddev 39.523 2023-07-14T13:20:23.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:23 smithi017 ceph-mon[95536]: pgmap v652: 97 pgs: 97 active+clean; 14 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 13 MiB/s wr, 921 op/s 2023-07-14T13:20:23.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:23 smithi135 ceph-mon[97338]: pgmap v652: 97 pgs: 97 active+clean; 14 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 13 MiB/s wr, 921 op/s 2023-07-14T13:20:23.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:23 smithi131 ceph-mon[96953]: pgmap v652: 97 pgs: 97 active+clean; 14 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 13 MiB/s wr, 921 op/s 2023-07-14T13:20:24.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:24 smithi131 ceph-mon[96953]: pgmap v653: 97 pgs: 97 active+clean; 14 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 10 MiB/s wr, 745 op/s 2023-07-14T13:20:24.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:24 smithi017 ceph-mon[95536]: pgmap v653: 97 pgs: 97 active+clean; 14 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 10 MiB/s wr, 745 op/s 2023-07-14T13:20:24.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:24 smithi135 ceph-mon[97338]: pgmap v653: 97 pgs: 97 active+clean; 14 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 10 MiB/s wr, 745 op/s 2023-07-14T13:20:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.005+0000 7f85de7ff700 1 -- 172.21.15.17:0/2730451746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d81004b0 msgr2=0x7f85d810c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.005+0000 7f85de7ff700 1 --2- 172.21.15.17:0/2730451746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d81004b0 0x7f85d810c940 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f85d0009990 tx=0x7f85d0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.005+0000 7f85de7ff700 1 -- 172.21.15.17:0/2730451746 shutdown_connections 2023-07-14T13:20:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.005+0000 7f85de7ff700 1 --2- 172.21.15.17:0/2730451746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d81004b0 0x7f85d810c940 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.005+0000 7f85de7ff700 1 --2- 172.21.15.17:0/2730451746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85d8105b10 0x7f85d8105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.005+0000 7f85de7ff700 1 --2- 172.21.15.17:0/2730451746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d80ffb00 0x7f85d80fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.005+0000 7f85de7ff700 1 -- 172.21.15.17:0/2730451746 >> 172.21.15.17:0/2730451746 conn(0x7f85d80fb600 msgr2=0x7f85d80fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.005+0000 7f85de7ff700 1 -- 172.21.15.17:0/2730451746 shutdown_connections 2023-07-14T13:20:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.005+0000 7f85de7ff700 1 -- 172.21.15.17:0/2730451746 wait complete. 2023-07-14T13:20:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.007+0000 7f85de7ff700 1 Processor -- start 2023-07-14T13:20:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.007+0000 7f85de7ff700 1 -- start start 2023-07-14T13:20:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.008+0000 7f85de7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d80ffb00 0x7f85d8199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.008+0000 7f85de7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d81004b0 0x7f85d8199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.008+0000 7f85de7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85d8105b10 0x7f85d8193670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.008+0000 7f85de7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d8193ce0 con 0x7f85d81004b0 2023-07-14T13:20:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.008+0000 7f85de7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d8193e50 con 0x7f85d80ffb00 2023-07-14T13:20:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.008+0000 7f85de7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d8194010 con 0x7f85d8105b10 2023-07-14T13:20:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.008+0000 7f85d7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d80ffb00 0x7f85d8199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.008+0000 7f85d7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d80ffb00 0x7f85d8199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:50890/0 (socket says 172.21.15.17:50890) 2023-07-14T13:20:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.008+0000 7f85d7fff700 1 -- 172.21.15.17:0/3641802679 learned_addr learned my addr 172.21.15.17:0/3641802679 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.008+0000 7f85d77fe700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d81004b0 0x7f85d8199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.008+0000 7f85dcd9c700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85d8105b10 0x7f85d8193670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.009+0000 7f85d7fff700 1 -- 172.21.15.17:0/3641802679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85d8105b10 msgr2=0x7f85d8193670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.009+0000 7f85d7fff700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85d8105b10 0x7f85d8193670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.009+0000 7f85d7fff700 1 -- 172.21.15.17:0/3641802679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d81004b0 msgr2=0x7f85d8199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.009+0000 7f85d7fff700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d81004b0 0x7f85d8199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.009+0000 7f85d7fff700 1 -- 172.21.15.17:0/3641802679 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00095f0 con 0x7f85d80ffb00 2023-07-14T13:20:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.009+0000 7f85d7fff700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d80ffb00 0x7f85d8199810 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f85c800d980 tx=0x7f85c800dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.010+0000 7f85d57fa700 1 -- 172.21.15.17:0/3641802679 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c800bb60 con 0x7f85d80ffb00 2023-07-14T13:20:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.010+0000 7f85d57fa700 1 -- 172.21.15.17:0/3641802679 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85c800de60 con 0x7f85d80ffb00 2023-07-14T13:20:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.010+0000 7f85d57fa700 1 -- 172.21.15.17:0/3641802679 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8004dc0 con 0x7f85d80ffb00 2023-07-14T13:20:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.010+0000 7f85de7ff700 1 -- 172.21.15.17:0/3641802679 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d81942f0 con 0x7f85d80ffb00 2023-07-14T13:20:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.010+0000 7f85de7ff700 1 -- 172.21.15.17:0/3641802679 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d81a0800 con 0x7f85d80ffb00 2023-07-14T13:20:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.016+0000 7f85d57fa700 1 -- 172.21.15.17:0/3641802679 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f85c8004020 con 0x7f85d80ffb00 2023-07-14T13:20:26.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.018+0000 7f85f21a1b80 1 Processor -- start 2023-07-14T13:20:26.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.019+0000 7f85f21a1b80 1 -- start start 2023-07-14T13:20:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.021+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610ceff8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.021+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610ceffd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.021+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff93f0 0x5610ceffd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.021+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ceef5c50 con 0x5610ceff8f80 2023-07-14T13:20:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.021+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cef489e0 con 0x5610ceff93f0 2023-07-14T13:20:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.021+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cef41e70 con 0x5610cee4c6b0 2023-07-14T13:20:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.021+0000 7f85d57fa700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85c40a1400 0x7f85c40a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.022+0000 7f85d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610ceffd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.022+0000 7f85d7fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610ceffd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35106/0 (socket says 172.21.15.17:35106) 2023-07-14T13:20:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.022+0000 7f85d7fff700 1 -- 172.21.15.17:0/2475058258 learned_addr learned my addr 172.21.15.17:0/2475058258 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.022+0000 7f85dcd9c700 1 --2- 172.21.15.17:0/2475058258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610ceff8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.022+0000 7f85dcd9c700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85c40a1400 0x7f85c40a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.022+0000 7f85d7fff700 1 -- 172.21.15.17:0/2475058258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 msgr2=0x5610ceff8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.022+0000 7f85d7fff700 1 --2- 172.21.15.17:0/2475058258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610ceff8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.022+0000 7f85d7fff700 1 -- 172.21.15.17:0/2475058258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff93f0 msgr2=0x5610ceffd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.022+0000 7f85d77fe700 1 --2- 172.21.15.17:0/2475058258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff93f0 0x5610ceffd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.022+0000 7f85d7fff700 1 --2- 172.21.15.17:0/2475058258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff93f0 0x5610ceffd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.022+0000 7f85d7fff700 1 -- 172.21.15.17:0/2475058258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610ced6fd80 con 0x5610ceff8f80 2023-07-14T13:20:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.023+0000 7f85d57fa700 1 -- 172.21.15.17:0/3641802679 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f85c80ccb10 con 0x7f85d80ffb00 2023-07-14T13:20:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.024+0000 7f85d7fff700 1 --2- 172.21.15.17:0/2475058258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610ceffd1a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f85c80ca1c0 tx=0x7f85c8099c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f27ed49b01261a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.024+0000 7f85dcd9c700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85c40a1400 0x7f85c40a38b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b5c0 tx=0x7f85d0009ca0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.025+0000 7f85ce7fc700 1 -- 172.21.15.17:0/2475058258 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80a1ff0 con 0x5610ceff8f80 2023-07-14T13:20:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.025+0000 7f85ce7fc700 1 -- 172.21.15.17:0/2475058258 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85c8065070 con 0x5610ceff8f80 2023-07-14T13:20:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.025+0000 7f85ce7fc700 1 -- 172.21.15.17:0/2475058258 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c800bcc0 con 0x5610ceff8f80 2023-07-14T13:20:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.026+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2475058258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 msgr2=0x5610ceffd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.026+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2475058258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610ceffd1a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f85c80ca1c0 tx=0x7f85c8099c20 comp rx=0 tx=0).stop 2023-07-14T13:20:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.026+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2475058258 shutdown_connections 2023-07-14T13:20:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.026+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2475058258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff93f0 0x5610ceffd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.026+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2475058258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610ceff8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.026+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2475058258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610ceffd1a0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.026+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2475058258 >> 172.21.15.17:0/2475058258 conn(0x5610cefe5be0 msgr2=0x5610cefeaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.027+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2475058258 shutdown_connections 2023-07-14T13:20:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.027+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2475058258 wait complete. 2023-07-14T13:20:26.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.028+0000 7f85f21a1b80 1 -- start start 2023-07-14T13:20:26.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.028+0000 7f85f21a1b80 1 Processor -- start 2023-07-14T13:20:26.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.029+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610cf004e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.029+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610cf002130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.029+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff93f0 0x5610cf002740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.029+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ceee1a60 con 0x5610ceff8f80 2023-07-14T13:20:26.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.029+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ceee1760 con 0x5610ceff93f0 2023-07-14T13:20:26.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.029+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cedc58c0 con 0x5610cee4c6b0 2023-07-14T13:20:26.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.029+0000 7f85f21a1b80 10 client.0 _ll_register_callbacks cb 0x5610ceedf700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:26.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.030+0000 7f85d77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610cf002130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.030+0000 7f85d77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610cf002130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35120/0 (socket says 172.21.15.17:35120) 2023-07-14T13:20:26.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.030+0000 7f85d77fe700 1 -- 172.21.15.17:0/2481694666 learned_addr learned my addr 172.21.15.17:0/2481694666 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:26.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.031+0000 7f85d77fe700 1 -- 172.21.15.17:0/2481694666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 msgr2=0x5610cf004e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:20:26.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.031+0000 7f85d77fe700 1 --2- 172.21.15.17:0/2481694666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610cf004e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.031+0000 7f85d77fe700 1 -- 172.21.15.17:0/2481694666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff93f0 msgr2=0x5610cf002740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:20:26.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.031+0000 7f85d77fe700 1 --2- 172.21.15.17:0/2481694666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff93f0 0x5610cf002740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.031+0000 7f85d77fe700 1 -- 172.21.15.17:0/2481694666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d81a0800 con 0x5610ceff8f80 2023-07-14T13:20:26.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.031+0000 7f85d77fe700 1 --2- 172.21.15.17:0/2481694666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610cf002130 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f85c000f920 tx=0x7f85c000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108b1bc1f76a9eb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:26.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.032+0000 7f85b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:20:26.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.032+0000 7f85b77fe700 1 -- 172.21.15.17:0/2481694666 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c000d070 con 0x5610ceff8f80 2023-07-14T13:20:26.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.032+0000 7f85b77fe700 1 -- 172.21.15.17:0/2481694666 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f85c000fe60 con 0x5610ceff8f80 2023-07-14T13:20:26.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.032+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2481694666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610cee9b490 con 0x5610ceff8f80 2023-07-14T13:20:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.033+0000 7f85b77fe700 1 -- 172.21.15.17:0/2481694666 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85c0003a00 con 0x5610ceff8f80 2023-07-14T13:20:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.033+0000 7f85f21a1b80 10 client.19146 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.033+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2481694666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5610ced58c00 con 0x5610ceff8f80 2023-07-14T13:20:26.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.033+0000 7f85b77fe700 1 -- 172.21.15.17:0/2481694666 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5610cee9b490 con 0x5610ceff8f80 2023-07-14T13:20:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.033+0000 7f85b77fe700 1 -- 172.21.15.17:0/2481694666 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f85c0004020 con 0x5610ceff8f80 2023-07-14T13:20:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.033+0000 7f85f21a1b80 10 client.19146 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.033+0000 7f85f21a1b80 10 client.19146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.033+0000 7f85f21a1b80 20 client.19146 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.033+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2481694666 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5610cf012550 0x5610cf014960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.033+0000 7f85f21a1b80 4 client.19146 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:20:26.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.033+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2481694666 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610cef3ae50 con 0x5610cf012550 2023-07-14T13:20:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.034+0000 7f85d7fff700 1 --2- 172.21.15.17:0/2481694666 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5610cf012550 0x5610cf014960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.035+0000 7f85d7fff700 1 --2- 172.21.15.17:0/2481694666 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5610cf012550 0x5610cf014960 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=991338a0158aa6cf server_cookie=34a3888b6625941e in_seq=0 out_seq=0 2023-07-14T13:20:26.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.035+0000 7f85b77fe700 10 client.19146 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.037+0000 7f85b77fe700 1 -- 172.21.15.17:0/2481694666 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5610cef3ae50 con 0x5610cf012550 2023-07-14T13:20:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.037+0000 7f85b77fe700 10 client.19146 handle_command_reply: tid=0 2023-07-14T13:20:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.037+0000 7f85f21a1b80 1 client.19146 shutdown 2023-07-14T13:20:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.038+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2481694666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 msgr2=0x5610cf002130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.038+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2481694666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610cf002130 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f85c000f920 tx=0x7f85c000fce0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.038+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2481694666 shutdown_connections 2023-07-14T13:20:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.038+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2481694666 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5610cf012550 0x5610cf014960 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.038+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2481694666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff93f0 0x5610cf002740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.038+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2481694666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610cf004e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.038+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2481694666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff8f80 0x5610cf002130 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.038+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2481694666 >> 172.21.15.17:0/2481694666 conn(0x5610cefe5be0 msgr2=0x5610cefea4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.038+0000 7f85b77fe700 0 client.19146 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.039+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2481694666 shutdown_connections 2023-07-14T13:20:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.050+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2481694666 wait complete. 2023-07-14T13:20:26.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.050+0000 7f85f21a1b80 20 client.19146 trim_cache size 0 max 16384 2023-07-14T13:20:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.285+0000 7f85f21a1b80 1 Processor -- start 2023-07-14T13:20:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.285+0000 7f85f21a1b80 1 -- start start 2023-07-14T13:20:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.285+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610cefeac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.286+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff8f80 0x5610ceffb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.286+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff93f0 0x5610cf0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.286+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ceffdf50 con 0x5610ceff93f0 2023-07-14T13:20:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.286+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cefe2bb0 con 0x5610ceff8f80 2023-07-14T13:20:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.286+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cf0006d0 con 0x5610cee4c6b0 2023-07-14T13:20:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.286+0000 7f85d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610cefeac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.286+0000 7f85d77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff8f80 0x5610ceffb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.286+0000 7f85d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610cefeac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52022/0 (socket says 172.21.15.17:52022) 2023-07-14T13:20:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.286+0000 7f85d7fff700 1 -- 172.21.15.17:0/3384359802 learned_addr learned my addr 172.21.15.17:0/3384359802 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.286+0000 7f85dcd9c700 1 --2- 172.21.15.17:0/3384359802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff93f0 0x5610cf0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.287+0000 7f85dcd9c700 1 -- 172.21.15.17:0/3384359802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 msgr2=0x5610cefeac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.287+0000 7f85dcd9c700 1 --2- 172.21.15.17:0/3384359802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610cefeac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.287+0000 7f85dcd9c700 1 -- 172.21.15.17:0/3384359802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff8f80 msgr2=0x5610ceffb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.287+0000 7f85dcd9c700 1 --2- 172.21.15.17:0/3384359802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff8f80 0x5610ceffb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.287+0000 7f85dcd9c700 1 -- 172.21.15.17:0/3384359802 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610ced961f0 con 0x5610ceff93f0 2023-07-14T13:20:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.287+0000 7f85dcd9c700 1 --2- 172.21.15.17:0/3384359802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff93f0 0x5610cf0048d0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f85d819a510 tx=0x7f85d0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688a58fd83892541 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.287+0000 7f85ceffd700 1 -- 172.21.15.17:0/3384359802 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00053b0 con 0x5610ceff93f0 2023-07-14T13:20:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.288+0000 7f85ceffd700 1 -- 172.21.15.17:0/3384359802 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85d001e070 con 0x5610ceff93f0 2023-07-14T13:20:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.288+0000 7f85ceffd700 1 -- 172.21.15.17:0/3384359802 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0004500 con 0x5610ceff93f0 2023-07-14T13:20:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.289+0000 7f85f21a1b80 1 -- 172.21.15.17:0/3384359802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff93f0 msgr2=0x5610cf0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:26.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.289+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/3384359802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff93f0 0x5610cf0048d0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f85d819a510 tx=0x7f85d0018000 comp rx=0 tx=0).stop 2023-07-14T13:20:26.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.289+0000 7f85f21a1b80 1 -- 172.21.15.17:0/3384359802 shutdown_connections 2023-07-14T13:20:26.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.289+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/3384359802 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610ceff93f0 0x5610cf0048d0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.289+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/3384359802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610cee4c6b0 0x5610cefeac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.289+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/3384359802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff8f80 0x5610ceffb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.289+0000 7f85f21a1b80 1 -- 172.21.15.17:0/3384359802 >> 172.21.15.17:0/3384359802 conn(0x5610cefe5be0 msgr2=0x5610cf0192c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:26.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.289+0000 7f85f21a1b80 1 -- 172.21.15.17:0/3384359802 shutdown_connections 2023-07-14T13:20:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.289+0000 7f85f21a1b80 1 -- 172.21.15.17:0/3384359802 wait complete. 2023-07-14T13:20:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.290+0000 7f85f21a1b80 1 -- start start 2023-07-14T13:20:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.290+0000 7f85f21a1b80 1 Processor -- start 2023-07-14T13:20:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.292+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610cee4c6b0 0x5610cf009510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.292+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff8f80 0x5610cf061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.292+0000 7f85f21a1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610ceff93f0 0x5610cf05e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.292+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cf05e900 con 0x5610cee4c6b0 2023-07-14T13:20:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.292+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cf05ea70 con 0x5610ceff8f80 2023-07-14T13:20:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.292+0000 7f85f21a1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cf05ebb0 con 0x5610ceff93f0 2023-07-14T13:20:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.292+0000 7f85f21a1b80 10 client.0 _ll_register_callbacks cb 0x7f85c000f190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.293+0000 7f85d77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff8f80 0x5610cf061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.293+0000 7f85dcd9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610ceff93f0 0x5610cf05e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.294+0000 7f85d77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff8f80 0x5610cf061c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:50918/0 (socket says 172.21.15.17:50918) 2023-07-14T13:20:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.294+0000 7f85d77fe700 1 -- 172.21.15.17:0/2224050789 learned_addr learned my addr 172.21.15.17:0/2224050789 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.294+0000 7f85d7fff700 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610cee4c6b0 0x5610cf009510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.294+0000 7f85dcd9c700 1 -- 172.21.15.17:0/2224050789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff8f80 msgr2=0x5610cf061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.294+0000 7f85dcd9c700 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff8f80 0x5610cf061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.294+0000 7f85dcd9c700 1 -- 172.21.15.17:0/2224050789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610cee4c6b0 msgr2=0x5610cf009510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.294+0000 7f85dcd9c700 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610cee4c6b0 0x5610cf009510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.294+0000 7f85dcd9c700 1 -- 172.21.15.17:0/2224050789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d810d240 con 0x5610ceff93f0 2023-07-14T13:20:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.295+0000 7f85dcd9c700 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610ceff93f0 0x5610cf05e3c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x5610cefebe10 tx=0x7f85d00054c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75883874b22e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.295+0000 7f85b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:20:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.296+0000 7f85b77fe700 1 -- 172.21.15.17:0/2224050789 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00038c0 con 0x5610ceff93f0 2023-07-14T13:20:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.296+0000 7f85b77fe700 1 -- 172.21.15.17:0/2224050789 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f85d0003a20 con 0x5610ceff93f0 2023-07-14T13:20:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.296+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2224050789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f85c8065070 con 0x5610ceff93f0 2023-07-14T13:20:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.297+0000 7f85b77fe700 1 -- 172.21.15.17:0/2224050789 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85d0003c20 con 0x5610ceff93f0 2023-07-14T13:20:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.297+0000 7f85f21a1b80 10 client.28861 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.297+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2224050789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5610ced6e250 con 0x5610ceff93f0 2023-07-14T13:20:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.297+0000 7f85b77fe700 1 -- 172.21.15.17:0/2224050789 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85c8065070 con 0x5610ceff93f0 2023-07-14T13:20:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.297+0000 7f85b77fe700 1 -- 172.21.15.17:0/2224050789 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f85d0004ad0 con 0x5610ceff93f0 2023-07-14T13:20:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.297+0000 7f85f21a1b80 10 client.28861 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.297+0000 7f85f21a1b80 10 client.28861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.297+0000 7f85f21a1b80 20 client.28861 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.297+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5610ceff09c0 0x5610ceff2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.297+0000 7f85f21a1b80 4 client.28861 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:20:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.297+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2224050789 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5610ceefcff0 con 0x5610ceff09c0 2023-07-14T13:20:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.298+0000 7f85d7fff700 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5610ceff09c0 0x5610ceff2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.299+0000 7f85d7fff700 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5610ceff09c0 0x5610ceff2dd0 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f9c1458a188e5cf server_cookie=7292d460c120c4cf in_seq=0 out_seq=0 2023-07-14T13:20:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.299+0000 7f85b77fe700 10 client.28861 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.322+0000 7f85b77fe700 1 -- 172.21.15.17:0/2224050789 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5610ceefcff0 con 0x5610ceff09c0 2023-07-14T13:20:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.322+0000 7f85b77fe700 10 client.28861 handle_command_reply: tid=0 2023-07-14T13:20:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.323+0000 7f85f21a1b80 1 client.28861 shutdown 2023-07-14T13:20:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.324+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2224050789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610ceff93f0 msgr2=0x5610cf05e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.324+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610ceff93f0 0x5610cf05e3c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x5610cefebe10 tx=0x7f85d00054c0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.324+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2224050789 shutdown_connections 2023-07-14T13:20:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.324+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5610ceff09c0 0x5610ceff2dd0 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.324+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5610ceff93f0 0x5610cf05e3c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.324+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5610cee4c6b0 0x5610cf009510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.324+0000 7f85f21a1b80 1 --2- 172.21.15.17:0/2224050789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5610ceff8f80 0x5610cf061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.324+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2224050789 >> 172.21.15.17:0/2224050789 conn(0x5610cefe5be0 msgr2=0x5610ceffbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.324+0000 7f85b77fe700 0 client.28861 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.324+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2224050789 shutdown_connections 2023-07-14T13:20:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.325+0000 7f85f21a1b80 1 -- 172.21.15.17:0/2224050789 wait complete. 2023-07-14T13:20:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.325+0000 7f85f21a1b80 20 client.28861 trim_cache size 0 max 16384 2023-07-14T13:20:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:20:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:20:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:20:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:20:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.326+0000 7f85de7ff700 1 -- 172.21.15.17:0/3641802679 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85c40a1400 msgr2=0x7f85c40a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.326+0000 7f85de7ff700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85c40a1400 0x7f85c40a38b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b5c0 tx=0x7f85d0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.326+0000 7f85de7ff700 1 -- 172.21.15.17:0/3641802679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d80ffb00 msgr2=0x7f85d8199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.326+0000 7f85de7ff700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d80ffb00 0x7f85d8199810 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f85c800d980 tx=0x7f85c800dd40 comp rx=0 tx=0).stop 2023-07-14T13:20:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.326+0000 7f85de7ff700 1 -- 172.21.15.17:0/3641802679 shutdown_connections 2023-07-14T13:20:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.326+0000 7f85de7ff700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f85c40a1400 0x7f85c40a38b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.326+0000 7f85de7ff700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85d8105b10 0x7f85d8193670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.326+0000 7f85de7ff700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d80ffb00 0x7f85d8199810 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.326+0000 7f85de7ff700 1 --2- 172.21.15.17:0/3641802679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85d81004b0 0x7f85d8199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.326+0000 7f85de7ff700 1 -- 172.21.15.17:0/3641802679 >> 172.21.15.17:0/3641802679 conn(0x7f85d80fb600 msgr2=0x7f85d80fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.327+0000 7f85de7ff700 1 -- 172.21.15.17:0/3641802679 shutdown_connections 2023-07-14T13:20:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:26.327+0000 7f85de7ff700 1 -- 172.21.15.17:0/3641802679 wait complete. 2023-07-14T13:20:27.448 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 135.0 s, 592.7 tps, lat 127.406 ms stddev 59.903 2023-07-14T13:20:27.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:27 smithi017 ceph-mon[95536]: pgmap v654: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-07-14T13:20:27.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:27 smithi135 ceph-mon[97338]: pgmap v654: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-07-14T13:20:27.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:27 smithi131 ceph-mon[96953]: pgmap v654: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-07-14T13:20:29.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:29 smithi017 ceph-mon[95536]: pgmap v655: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-07-14T13:20:29.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:29 smithi135 ceph-mon[97338]: pgmap v655: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-07-14T13:20:29.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:29 smithi131 ceph-mon[96953]: pgmap v655: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-07-14T13:20:31.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:31 smithi017 ceph-mon[95536]: pgmap v656: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 20 MiB/s wr, 1.42k op/s 2023-07-14T13:20:31.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:31 smithi135 ceph-mon[97338]: pgmap v656: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 20 MiB/s wr, 1.42k op/s 2023-07-14T13:20:31.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:31 smithi131 ceph-mon[96953]: pgmap v656: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 20 MiB/s wr, 1.42k op/s 2023-07-14T13:20:32.446 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 140.0 s, 594.4 tps, lat 210.651 ms stddev 674.280 2023-07-14T13:20:33.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:33 smithi017 ceph-mon[95536]: pgmap v657: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 18 MiB/s wr, 1.30k op/s 2023-07-14T13:20:33.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:33 smithi135 ceph-mon[97338]: pgmap v657: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 18 MiB/s wr, 1.30k op/s 2023-07-14T13:20:33.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:33 smithi131 ceph-mon[96953]: pgmap v657: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 18 MiB/s wr, 1.30k op/s 2023-07-14T13:20:35.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:35 smithi017 ceph-mon[95536]: pgmap v658: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 16 MiB/s wr, 1.18k op/s 2023-07-14T13:20:35.696 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:35 smithi135 ceph-mon[97338]: pgmap v658: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 16 MiB/s wr, 1.18k op/s 2023-07-14T13:20:35.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:35 smithi131 ceph-mon[96953]: pgmap v658: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 16 MiB/s wr, 1.18k op/s 2023-07-14T13:20:37.446 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 145.0 s, 746.6 tps, lat 134.694 ms stddev 40.216 2023-07-14T13:20:37.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:37 smithi017 ceph-mon[95536]: pgmap v659: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 25 MiB/s wr, 1.74k op/s 2023-07-14T13:20:37.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:37 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:20:37.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:37 smithi135 ceph-mon[97338]: pgmap v659: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 25 MiB/s wr, 1.74k op/s 2023-07-14T13:20:37.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:37 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:20:37.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:37 smithi131 ceph-mon[96953]: pgmap v659: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 25 MiB/s wr, 1.74k op/s 2023-07-14T13:20:37.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:37 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:20:39.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:39 smithi017 ceph-mon[95536]: pgmap v660: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-07-14T13:20:39.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:39 smithi135 ceph-mon[97338]: pgmap v660: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-07-14T13:20:39.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:39 smithi131 ceph-mon[96953]: pgmap v660: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-07-14T13:20:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.818+0000 7fa46ebff700 1 -- 172.21.15.17:0/4222898828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa468102040 msgr2=0x7fa468102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.818+0000 7fa46ebff700 1 --2- 172.21.15.17:0/4222898828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa468102040 0x7fa468102410 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa45c01a9a0 tx=0x7fa45c01acb0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.819+0000 7fa46ebff700 1 -- 172.21.15.17:0/4222898828 shutdown_connections 2023-07-14T13:20:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.819+0000 7fa46ebff700 1 --2- 172.21.15.17:0/4222898828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa468107080 0x7fa46810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.819+0000 7fa46ebff700 1 --2- 172.21.15.17:0/4222898828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa468102040 0x7fa468102410 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.819+0000 7fa46ebff700 1 --2- 172.21.15.17:0/4222898828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4681029e0 0x7fa4681069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.819+0000 7fa46ebff700 1 -- 172.21.15.17:0/4222898828 >> 172.21.15.17:0/4222898828 conn(0x7fa4680fd8d0 msgr2=0x7fa4680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.821+0000 7fa46ebff700 1 -- 172.21.15.17:0/4222898828 shutdown_connections 2023-07-14T13:20:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.821+0000 7fa46ebff700 1 -- 172.21.15.17:0/4222898828 wait complete. 2023-07-14T13:20:39.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.822+0000 7fa46ebff700 1 Processor -- start 2023-07-14T13:20:39.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.823+0000 7fa46ebff700 1 -- start start 2023-07-14T13:20:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.823+0000 7fa46ebff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa468102040 0x7fa46810e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.823+0000 7fa46ebff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4681029e0 0x7fa46810e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.823+0000 7fa46ebff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa468107080 0x7fa46810a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.823+0000 7fa46ebff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46810aa60 con 0x7fa4681029e0 2023-07-14T13:20:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.823+0000 7fa46ebff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46810abd0 con 0x7fa468102040 2023-07-14T13:20:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.823+0000 7fa46ebff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46810ad90 con 0x7fa468107080 2023-07-14T13:20:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.824+0000 7fa46c99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa468102040 0x7fa46810e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.824+0000 7fa46d19c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa468107080 0x7fa46810a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.824+0000 7fa46c99b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa468102040 0x7fa46810e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33936/0 (socket says 172.21.15.17:33936) 2023-07-14T13:20:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.824+0000 7fa46c99b700 1 -- 172.21.15.17:0/512670819 learned_addr learned my addr 172.21.15.17:0/512670819 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.824+0000 7fa467fff700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4681029e0 0x7fa46810e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.825+0000 7fa46d19c700 1 -- 172.21.15.17:0/512670819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa468102040 msgr2=0x7fa46810e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.825+0000 7fa46d19c700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa468102040 0x7fa46810e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.825+0000 7fa46d19c700 1 -- 172.21.15.17:0/512670819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4681029e0 msgr2=0x7fa46810e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.825+0000 7fa46d19c700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4681029e0 0x7fa46810e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.825+0000 7fa46d19c700 1 -- 172.21.15.17:0/512670819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c01a600 con 0x7fa468107080 2023-07-14T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.825+0000 7fa46c99b700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa468102040 0x7fa46810e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:20:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.826+0000 7fa46d19c700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa468107080 0x7fa46810a2c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa46000be00 tx=0x7fa460009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.827+0000 7fa465ffb700 1 -- 172.21.15.17:0/512670819 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46000cc10 con 0x7fa468107080 2023-07-14T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.828+0000 7fa465ffb700 1 -- 172.21.15.17:0/512670819 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa46000cd70 con 0x7fa468107080 2023-07-14T13:20:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.828+0000 7fa465ffb700 1 -- 172.21.15.17:0/512670819 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600126b0 con 0x7fa468107080 2023-07-14T13:20:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.828+0000 7fa46ebff700 1 -- 172.21.15.17:0/512670819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46810b070 con 0x7fa468107080 2023-07-14T13:20:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.828+0000 7fa46ebff700 1 -- 172.21.15.17:0/512670819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46819c680 con 0x7fa468107080 2023-07-14T13:20:39.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.837+0000 7fa482565b80 1 Processor -- start 2023-07-14T13:20:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.838+0000 7fa482565b80 1 -- start start 2023-07-14T13:20:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.838+0000 7fa465ffb700 1 -- 172.21.15.17:0/512670819 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa460014440 con 0x7fa468107080 2023-07-14T13:20:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.838+0000 7fa482565b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4dc086b0 0x55ca4ddb0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.838+0000 7fa482565b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4ddb13f0 0x55ca4dda9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.838+0000 7fa482565b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4dda9560 0x55ca4dda99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.838+0000 7fa482565b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4dcb1c50 con 0x55ca4dda9560 2023-07-14T13:20:39.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.838+0000 7fa482565b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4dd049e0 con 0x55ca4dc086b0 2023-07-14T13:20:39.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.838+0000 7fa482565b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4dcfde70 con 0x55ca4ddb13f0 2023-07-14T13:20:39.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.839+0000 7fa46c99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4ddb13f0 0x55ca4dda9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.839+0000 7fa46c99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4ddb13f0 0x55ca4dda9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58028/0 (socket says 172.21.15.17:58028) 2023-07-14T13:20:39.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.839+0000 7fa46c99b700 1 -- 172.21.15.17:0/491928183 learned_addr learned my addr 172.21.15.17:0/491928183 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:39.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.839+0000 7fa46c99b700 1 -- 172.21.15.17:0/491928183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4dc086b0 msgr2=0x55ca4ddb0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:39.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.839+0000 7fa46c99b700 1 --2- 172.21.15.17:0/491928183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4dc086b0 0x55ca4ddb0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.839+0000 7fa46c99b700 1 -- 172.21.15.17:0/491928183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4dda9560 msgr2=0x55ca4dda99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:39.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.839+0000 7fa46c99b700 1 --2- 172.21.15.17:0/491928183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4dda9560 0x55ca4dda99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.839+0000 7fa46c99b700 1 -- 172.21.15.17:0/491928183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca4db2bd80 con 0x55ca4ddb13f0 2023-07-14T13:20:39.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.840+0000 7fa46c99b700 1 --2- 172.21.15.17:0/491928183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4ddb13f0 0x55ca4dda9020 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa45c005fe0 tx=0x7fa45c01c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd3b7a41c2c43e70 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:39.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.840+0000 7fa452ffd700 1 -- 172.21.15.17:0/491928183 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c01ccc0 con 0x55ca4ddb13f0 2023-07-14T13:20:39.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.840+0000 7fa452ffd700 1 -- 172.21.15.17:0/491928183 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa45c0056b0 con 0x55ca4ddb13f0 2023-07-14T13:20:39.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.840+0000 7fa452ffd700 1 -- 172.21.15.17:0/491928183 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0346b0 con 0x55ca4ddb13f0 2023-07-14T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.841+0000 7fa465ffb700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4580a1490 0x7fa4580a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.841+0000 7fa465ffb700 1 -- 172.21.15.17:0/512670819 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa4600cc510 con 0x7fa468107080 2023-07-14T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.841+0000 7fa482565b80 1 -- 172.21.15.17:0/491928183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4ddb13f0 msgr2=0x55ca4dda9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.841+0000 7fa482565b80 1 --2- 172.21.15.17:0/491928183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4ddb13f0 0x55ca4dda9020 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa45c005fe0 tx=0x7fa45c01c9f0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.842+0000 7fa482565b80 1 -- 172.21.15.17:0/491928183 shutdown_connections 2023-07-14T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.842+0000 7fa482565b80 1 --2- 172.21.15.17:0/491928183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4dda9560 0x55ca4dda99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.842+0000 7fa482565b80 1 --2- 172.21.15.17:0/491928183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4dc086b0 0x55ca4ddb0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.842+0000 7fa482565b80 1 --2- 172.21.15.17:0/491928183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4ddb13f0 0x55ca4dda9020 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.842+0000 7fa482565b80 1 -- 172.21.15.17:0/491928183 >> 172.21.15.17:0/491928183 conn(0x55ca4dda1be0 msgr2=0x55ca4dda6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.845+0000 7fa467fff700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4580a1490 0x7fa4580a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.845+0000 7fa482565b80 1 -- 172.21.15.17:0/491928183 shutdown_connections 2023-07-14T13:20:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.845+0000 7fa482565b80 1 -- 172.21.15.17:0/491928183 wait complete. 2023-07-14T13:20:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.846+0000 7fa482565b80 1 -- start start 2023-07-14T13:20:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.846+0000 7fa482565b80 1 Processor -- start 2023-07-14T13:20:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.847+0000 7fa467fff700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4580a1490 0x7fa4580a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55ca4dda89d0 tx=0x7fa454004800 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.847+0000 7fa482565b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddae560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.847+0000 7fa482565b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4dda9560 0x55ca4ddab770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.847+0000 7fa482565b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 0x55ca4ddabe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.847+0000 7fa482565b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4dc9da60 con 0x55ca4ddb13f0 2023-07-14T13:20:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.847+0000 7fa482565b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4dc9d760 con 0x55ca4dda9560 2023-07-14T13:20:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.847+0000 7fa482565b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4db818c0 con 0x55ca4dc086b0 2023-07-14T13:20:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.847+0000 7fa482565b80 10 client.0 _ll_register_callbacks cb 0x55ca4dc9b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.847+0000 7fa467fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4dda9560 0x55ca4ddab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.847+0000 7fa467fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4dda9560 0x55ca4ddab770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33960/0 (socket says 172.21.15.17:33960) 2023-07-14T13:20:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.848+0000 7fa467fff700 1 -- 172.21.15.17:0/1361628678 learned_addr learned my addr 172.21.15.17:0/1361628678 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.848+0000 7fa467fff700 1 -- 172.21.15.17:0/1361628678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 msgr2=0x55ca4ddae560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:20:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.848+0000 7fa467fff700 1 --2- 172.21.15.17:0/1361628678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddae560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.848+0000 7fa467fff700 1 -- 172.21.15.17:0/1361628678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 msgr2=0x55ca4ddabe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.848+0000 7fa467fff700 1 --2- 172.21.15.17:0/1361628678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 0x55ca4ddabe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.848+0000 7fa467fff700 1 -- 172.21.15.17:0/1361628678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46810f490 con 0x55ca4dda9560 2023-07-14T13:20:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.848+0000 7fa467fff700 1 --2- 172.21.15.17:0/1361628678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4dda9560 0x55ca4ddab770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa45400ef30 tx=0x7fa454009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b28f5b577930f224 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.848+0000 7fa447fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:20:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.849+0000 7fa447fff700 1 -- 172.21.15.17:0/1361628678 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454015990 con 0x55ca4dda9560 2023-07-14T13:20:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.849+0000 7fa447fff700 1 -- 172.21.15.17:0/1361628678 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa454015af0 con 0x55ca4dda9560 2023-07-14T13:20:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.849+0000 7fa482565b80 1 -- 172.21.15.17:0/1361628678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca4dc57490 con 0x55ca4dda9560 2023-07-14T13:20:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.850+0000 7fa447fff700 1 -- 172.21.15.17:0/1361628678 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa454015cb0 con 0x55ca4dda9560 2023-07-14T13:20:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.851+0000 7fa482565b80 10 client.28910 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.851+0000 7fa482565b80 1 -- 172.21.15.17:0/1361628678 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55ca4db14c00 con 0x55ca4dda9560 2023-07-14T13:20:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.854+0000 7fa447fff700 1 -- 172.21.15.17:0/1361628678 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ca4dc57490 con 0x55ca4dda9560 2023-07-14T13:20:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.854+0000 7fa447fff700 1 -- 172.21.15.17:0/1361628678 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa4540283f0 con 0x55ca4dda9560 2023-07-14T13:20:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.854+0000 7fa482565b80 10 client.28910 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.854+0000 7fa482565b80 10 client.28910 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.854+0000 7fa482565b80 20 client.28910 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.854+0000 7fa482565b80 1 --2- 172.21.15.17:0/1361628678 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ca4ddd6d10 0x55ca4ddd9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.854+0000 7fa482565b80 4 client.28910 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:20:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.854+0000 7fa482565b80 1 -- 172.21.15.17:0/1361628678 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca4dcf6e50 con 0x55ca4ddd6d10 2023-07-14T13:20:39.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.855+0000 7fa46c99b700 1 --2- 172.21.15.17:0/1361628678 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ca4ddd6d10 0x55ca4ddd9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.856+0000 7fa46c99b700 1 --2- 172.21.15.17:0/1361628678 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ca4ddd6d10 0x55ca4ddd9140 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10a9f9dfcc3b6a5 server_cookie=fedbea3e34738920 in_seq=0 out_seq=0 2023-07-14T13:20:39.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.857+0000 7fa447fff700 10 client.28910 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:39.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.857+0000 7fa447fff700 1 -- 172.21.15.17:0/1361628678 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ca4dcf6e50 con 0x55ca4ddd6d10 2023-07-14T13:20:39.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.857+0000 7fa447fff700 10 client.28910 handle_command_reply: tid=0 2023-07-14T13:20:39.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.857+0000 7fa482565b80 1 client.28910 shutdown 2023-07-14T13:20:39.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.858+0000 7fa482565b80 1 -- 172.21.15.17:0/1361628678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4dda9560 msgr2=0x55ca4ddab770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:39.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.858+0000 7fa482565b80 1 --2- 172.21.15.17:0/1361628678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4dda9560 0x55ca4ddab770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa45400ef30 tx=0x7fa454009190 comp rx=0 tx=0).stop 2023-07-14T13:20:39.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.859+0000 7fa482565b80 1 -- 172.21.15.17:0/1361628678 shutdown_connections 2023-07-14T13:20:39.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.859+0000 7fa482565b80 1 --2- 172.21.15.17:0/1361628678 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ca4ddd6d10 0x55ca4ddd9140 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.859+0000 7fa482565b80 1 --2- 172.21.15.17:0/1361628678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 0x55ca4ddabe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.859+0000 7fa482565b80 1 --2- 172.21.15.17:0/1361628678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.859+0000 7fa482565b80 1 --2- 172.21.15.17:0/1361628678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4dda9560 0x55ca4ddab770 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.859+0000 7fa482565b80 1 -- 172.21.15.17:0/1361628678 >> 172.21.15.17:0/1361628678 conn(0x55ca4dda1be0 msgr2=0x55ca4dda64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:39.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.859+0000 7fa447fff700 0 client.28910 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:39.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.860+0000 7fa482565b80 1 -- 172.21.15.17:0/1361628678 shutdown_connections 2023-07-14T13:20:39.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.860+0000 7fa482565b80 1 -- 172.21.15.17:0/1361628678 wait complete. 2023-07-14T13:20:39.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.861+0000 7fa482565b80 20 client.28910 trim_cache size 0 max 16384 2023-07-14T13:20:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.885+0000 7fa482565b80 1 Processor -- start 2023-07-14T13:20:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.886+0000 7fa482565b80 1 -- start start 2023-07-14T13:20:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.886+0000 7fa482565b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddcdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.887+0000 7fa482565b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 0x55ca4ddb00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.887+0000 7fa482565b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 0x55ca4ddc8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.887+0000 7fa482565b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4dda8b50 con 0x55ca4ddb13f0 2023-07-14T13:20:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.887+0000 7fa482565b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4ddaa1c0 con 0x55ca4ddb05e0 2023-07-14T13:20:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.887+0000 7fa482565b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4ddac460 con 0x55ca4dc086b0 2023-07-14T13:20:39.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.887+0000 7fa46d19c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 0x55ca4ddc8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.887+0000 7fa46d19c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 0x55ca4ddc8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33970/0 (socket says 172.21.15.17:33970) 2023-07-14T13:20:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.887+0000 7fa46d19c700 1 -- 172.21.15.17:0/3470564054 learned_addr learned my addr 172.21.15.17:0/3470564054 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.887+0000 7fa467fff700 1 --2- 172.21.15.17:0/3470564054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 0x55ca4ddb00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.888+0000 7fa46c99b700 1 --2- 172.21.15.17:0/3470564054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddcdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.888+0000 7fa46d19c700 1 -- 172.21.15.17:0/3470564054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 msgr2=0x55ca4ddcdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.888+0000 7fa46d19c700 1 --2- 172.21.15.17:0/3470564054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddcdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.888+0000 7fa46d19c700 1 -- 172.21.15.17:0/3470564054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 msgr2=0x55ca4ddb00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.888+0000 7fa46d19c700 1 --2- 172.21.15.17:0/3470564054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 0x55ca4ddb00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.888+0000 7fa46d19c700 1 -- 172.21.15.17:0/3470564054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca4db521f0 con 0x55ca4ddb05e0 2023-07-14T13:20:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.888+0000 7fa46d19c700 1 --2- 172.21.15.17:0/3470564054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 0x55ca4ddc8c30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa460096120 tx=0x7fa4600953c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55626ff88dc1e583 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:39.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.888+0000 7fa4537fe700 1 -- 172.21.15.17:0/3470564054 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600149d0 con 0x55ca4ddb05e0 2023-07-14T13:20:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.889+0000 7fa4537fe700 1 -- 172.21.15.17:0/3470564054 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4600996b0 con 0x55ca4ddb05e0 2023-07-14T13:20:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.889+0000 7fa4537fe700 1 -- 172.21.15.17:0/3470564054 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460099910 con 0x55ca4ddb05e0 2023-07-14T13:20:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.889+0000 7fa482565b80 1 -- 172.21.15.17:0/3470564054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 msgr2=0x55ca4ddc8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.889+0000 7fa482565b80 1 --2- 172.21.15.17:0/3470564054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 0x55ca4ddc8c30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa460096120 tx=0x7fa4600953c0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.890+0000 7fa482565b80 1 -- 172.21.15.17:0/3470564054 shutdown_connections 2023-07-14T13:20:39.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.890+0000 7fa482565b80 1 --2- 172.21.15.17:0/3470564054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 0x55ca4ddc8c30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.890+0000 7fa482565b80 1 --2- 172.21.15.17:0/3470564054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddcdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.890+0000 7fa482565b80 1 --2- 172.21.15.17:0/3470564054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 0x55ca4ddb00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.890+0000 7fa482565b80 1 -- 172.21.15.17:0/3470564054 >> 172.21.15.17:0/3470564054 conn(0x55ca4dda1be0 msgr2=0x55ca4ddd2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:39.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.891+0000 7fa482565b80 1 -- 172.21.15.17:0/3470564054 shutdown_connections 2023-07-14T13:20:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.891+0000 7fa482565b80 1 -- 172.21.15.17:0/3470564054 wait complete. 2023-07-14T13:20:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.891+0000 7fa482565b80 1 -- start start 2023-07-14T13:20:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.892+0000 7fa482565b80 1 Processor -- start 2023-07-14T13:20:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.892+0000 7fa482565b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddcdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.892+0000 7fa482565b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 0x55ca4ddcc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.892+0000 7fa482565b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 0x55ca4ddcc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.892+0000 7fa482565b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4ddcccd0 con 0x55ca4ddb13f0 2023-07-14T13:20:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.892+0000 7fa482565b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4ddcce40 con 0x55ca4ddb05e0 2023-07-14T13:20:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.892+0000 7fa482565b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca4de2ac40 con 0x55ca4dc086b0 2023-07-14T13:20:39.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.892+0000 7fa482565b80 10 client.0 _ll_register_callbacks cb 0x7fa45400e930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.893+0000 7fa46c99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddcdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.893+0000 7fa46c99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddcdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58062/0 (socket says 172.21.15.17:58062) 2023-07-14T13:20:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.893+0000 7fa46c99b700 1 -- 172.21.15.17:0/282363062 learned_addr learned my addr 172.21.15.17:0/282363062 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.893+0000 7fa467fff700 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 0x55ca4ddcc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.893+0000 7fa46c99b700 1 -- 172.21.15.17:0/282363062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 msgr2=0x55ca4ddcc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:39.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.893+0000 7fa46c99b700 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 0x55ca4ddcc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.893+0000 7fa46c99b700 1 -- 172.21.15.17:0/282363062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 msgr2=0x55ca4ddcc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.893+0000 7fa46c99b700 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 0x55ca4ddcc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.893+0000 7fa46c99b700 1 -- 172.21.15.17:0/282363062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46819c680 con 0x55ca4dc086b0 2023-07-14T13:20:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.894+0000 7fa46c99b700 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddcdc60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa45c003760 tx=0x7fa45c01a920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d5952c9d13104cd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.894+0000 7fa447fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:20:39.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.894+0000 7fa447fff700 1 -- 172.21.15.17:0/282363062 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c038040 con 0x55ca4dc086b0 2023-07-14T13:20:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.894+0000 7fa447fff700 1 -- 172.21.15.17:0/282363062 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa45c042030 con 0x55ca4dc086b0 2023-07-14T13:20:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.894+0000 7fa482565b80 1 -- 172.21.15.17:0/282363062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa45c0056b0 con 0x55ca4dc086b0 2023-07-14T13:20:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.895+0000 7fa447fff700 1 -- 172.21.15.17:0/282363062 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa45c01ccc0 con 0x55ca4dc086b0 2023-07-14T13:20:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.895+0000 7fa482565b80 10 client.28873 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.895+0000 7fa482565b80 1 -- 172.21.15.17:0/282363062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55ca4db2a250 con 0x55ca4dc086b0 2023-07-14T13:20:39.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.896+0000 7fa447fff700 1 -- 172.21.15.17:0/282363062 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa45c04b030 con 0x55ca4dc086b0 2023-07-14T13:20:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.896+0000 7fa447fff700 1 -- 172.21.15.17:0/282363062 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa45c03db10 con 0x55ca4dc086b0 2023-07-14T13:20:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.896+0000 7fa482565b80 10 client.28873 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.896+0000 7fa482565b80 10 client.28873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.896+0000 7fa482565b80 20 client.28873 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.896+0000 7fa482565b80 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ca4de2bef0 0x55ca4de2e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.896+0000 7fa482565b80 4 client.28873 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:20:39.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.896+0000 7fa482565b80 1 -- 172.21.15.17:0/282363062 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ca4dcb8ff0 con 0x55ca4de2bef0 2023-07-14T13:20:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.896+0000 7fa467fff700 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ca4de2bef0 0x55ca4de2e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.897+0000 7fa467fff700 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ca4de2bef0 0x55ca4de2e300 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=123a292887dff38e server_cookie=8eef648951a7ca68 in_seq=0 out_seq=0 2023-07-14T13:20:39.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.897+0000 7fa447fff700 10 client.28873 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.930+0000 7fa447fff700 1 -- 172.21.15.17:0/282363062 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ca4dcb8ff0 con 0x55ca4de2bef0 2023-07-14T13:20:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.930+0000 7fa447fff700 10 client.28873 handle_command_reply: tid=0 2023-07-14T13:20:39.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.930+0000 7fa482565b80 1 client.28873 shutdown 2023-07-14T13:20:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.931+0000 7fa482565b80 1 -- 172.21.15.17:0/282363062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 msgr2=0x55ca4ddcdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.931+0000 7fa482565b80 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddcdc60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa45c003760 tx=0x7fa45c01a920 comp rx=0 tx=0).stop 2023-07-14T13:20:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.931+0000 7fa482565b80 1 -- 172.21.15.17:0/282363062 shutdown_connections 2023-07-14T13:20:39.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.931+0000 7fa482565b80 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ca4de2bef0 0x55ca4de2e300 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.931+0000 7fa482565b80 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ca4ddb13f0 0x55ca4ddcc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.931+0000 7fa482565b80 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ca4dc086b0 0x55ca4ddcdc60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.931+0000 7fa482565b80 1 --2- 172.21.15.17:0/282363062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ca4ddb05e0 0x55ca4ddcc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.931+0000 7fa482565b80 1 -- 172.21.15.17:0/282363062 >> 172.21.15.17:0/282363062 conn(0x55ca4dda1be0 msgr2=0x55ca4ddc8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.932+0000 7fa447fff700 0 client.28873 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.932+0000 7fa482565b80 1 -- 172.21.15.17:0/282363062 shutdown_connections 2023-07-14T13:20:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.932+0000 7fa482565b80 1 -- 172.21.15.17:0/282363062 wait complete. 2023-07-14T13:20:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.933+0000 7fa482565b80 20 client.28873 trim_cache size 0 max 16384 2023-07-14T13:20:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:20:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:20:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:20:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:20:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.935+0000 7fa46ebff700 1 -- 172.21.15.17:0/512670819 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4580a1490 msgr2=0x7fa4580a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.935+0000 7fa46ebff700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4580a1490 0x7fa4580a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55ca4dda89d0 tx=0x7fa454004800 comp rx=0 tx=0).stop 2023-07-14T13:20:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.935+0000 7fa46ebff700 1 -- 172.21.15.17:0/512670819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa468107080 msgr2=0x7fa46810a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.935+0000 7fa46ebff700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa468107080 0x7fa46810a2c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa46000be00 tx=0x7fa460009ed0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.936+0000 7fa46ebff700 1 -- 172.21.15.17:0/512670819 shutdown_connections 2023-07-14T13:20:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.936+0000 7fa46ebff700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4580a1490 0x7fa4580a3940 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.936+0000 7fa46ebff700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa468107080 0x7fa46810a2c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.936+0000 7fa46ebff700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa468102040 0x7fa46810e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.936+0000 7fa46ebff700 1 --2- 172.21.15.17:0/512670819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4681029e0 0x7fa46810e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.936+0000 7fa46ebff700 1 -- 172.21.15.17:0/512670819 >> 172.21.15.17:0/512670819 conn(0x7fa4680fd8d0 msgr2=0x7fa468106210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.937+0000 7fa46ebff700 1 -- 172.21.15.17:0/512670819 shutdown_connections 2023-07-14T13:20:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:39.937+0000 7fa46ebff700 1 -- 172.21.15.17:0/512670819 wait complete. 2023-07-14T13:20:41.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:41 smithi135 ceph-mon[97338]: pgmap v661: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 25 MiB/s wr, 1.68k op/s 2023-07-14T13:20:41.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:41 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:41.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:41 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:41.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:41 smithi131 ceph-mon[96953]: pgmap v661: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 25 MiB/s wr, 1.68k op/s 2023-07-14T13:20:41.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:41 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:41.745 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:41 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:41.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:41 smithi017 ceph-mon[95536]: pgmap v661: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 25 MiB/s wr, 1.68k op/s 2023-07-14T13:20:41.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:41 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:41.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:41 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:42.447 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 150.0 s, 560.0 tps, lat 176.591 ms stddev 59.962 2023-07-14T13:20:42.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:42 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:42 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:42 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:42 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:42 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:42 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:42 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.695 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:42 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:42 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:42 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:42 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:42 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:42 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:42 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:42 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.744 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:42 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:42 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:42 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:42 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:42 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:42 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:42 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:42 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:42.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:42 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:43.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:43 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T13:20:43.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:43 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:20:43.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:43 smithi135 ceph-mon[97338]: pgmap v662: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 16 MiB/s wr, 1.07k op/s 2023-07-14T13:20:43.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:43 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:43.694 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:43 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:43.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:43 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T13:20:43.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:43 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:20:43.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:43 smithi131 ceph-mon[96953]: pgmap v662: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 16 MiB/s wr, 1.07k op/s 2023-07-14T13:20:43.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:43 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:43.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:43 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:43.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:43 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T13:20:43.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:43 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:20:43.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:43 smithi017 ceph-mon[95536]: pgmap v662: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 16 MiB/s wr, 1.07k op/s 2023-07-14T13:20:43.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:43 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:43.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:43 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:44.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:44.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:44.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T13:20:44.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:20:44.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:44 smithi017 ceph-mon[95536]: pgmap v663: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 16 MiB/s wr, 1.07k op/s 2023-07-14T13:20:44.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:44.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:44.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T13:20:44.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:20:44.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:44 smithi135 ceph-mon[97338]: pgmap v663: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 16 MiB/s wr, 1.07k op/s 2023-07-14T13:20:44.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:44.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:44.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:44.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T13:20:44.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:20:44.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:44 smithi131 ceph-mon[96953]: pgmap v663: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 16 MiB/s wr, 1.07k op/s 2023-07-14T13:20:45.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T13:20:45.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T13:20:45.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:20:45.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:20:45.854 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:45 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:45.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.944 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T13:20:45.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T13:20:45.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:20:45.945 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:20:45.946 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:45 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:45.992 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.993 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:20:45.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T13:20:45.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T13:20:45.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:20:45.994 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:20:45.995 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:45 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:20:47.445 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 155.0 s, 631.8 tps, lat 158.924 ms stddev 39.091 2023-07-14T13:20:47.605 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:47 smithi017 ceph-mon[95536]: pgmap v664: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 24 MiB/s wr, 1.61k op/s 2023-07-14T13:20:47.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:47 smithi135 ceph-mon[97338]: pgmap v664: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 24 MiB/s wr, 1.61k op/s 2023-07-14T13:20:47.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:47 smithi131 ceph-mon[96953]: pgmap v664: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 24 MiB/s wr, 1.61k op/s 2023-07-14T13:20:49.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:49 smithi017 ceph-mon[95536]: pgmap v665: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 15 MiB/s wr, 1.05k op/s 2023-07-14T13:20:49.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:49 smithi135 ceph-mon[97338]: pgmap v665: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 15 MiB/s wr, 1.05k op/s 2023-07-14T13:20:49.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:49 smithi131 ceph-mon[96953]: pgmap v665: 97 pgs: 97 active+clean; 14 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 15 MiB/s wr, 1.05k op/s 2023-07-14T13:20:51.604 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:51 smithi017 ceph-mon[95536]: pgmap v666: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 22 MiB/s wr, 1.55k op/s 2023-07-14T13:20:51.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:51 smithi135 ceph-mon[97338]: pgmap v666: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 22 MiB/s wr, 1.55k op/s 2023-07-14T13:20:51.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:51 smithi131 ceph-mon[96953]: pgmap v666: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 22 MiB/s wr, 1.55k op/s 2023-07-14T13:20:52.444 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 160.0 s, 556.8 tps, lat 179.467 ms stddev 178.138 2023-07-14T13:20:53.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.126+0000 7faae3dff700 1 -- 172.21.15.17:0/2525411960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faadc105b60 msgr2=0x7faadc105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.126+0000 7faae3dff700 1 --2- 172.21.15.17:0/2525411960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faadc105b60 0x7faadc105f30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7faad8009990 tx=0x7faad8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.126+0000 7faae3dff700 1 -- 172.21.15.17:0/2525411960 shutdown_connections 2023-07-14T13:20:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.126+0000 7faae3dff700 1 --2- 172.21.15.17:0/2525411960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc1004e0 0x7faadc10c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.126+0000 7faae3dff700 1 --2- 172.21.15.17:0/2525411960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faadc105b60 0x7faadc105f30 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.126+0000 7faae3dff700 1 --2- 172.21.15.17:0/2525411960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faadc0ffb30 0x7faadc0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.126+0000 7faae3dff700 1 -- 172.21.15.17:0/2525411960 >> 172.21.15.17:0/2525411960 conn(0x7faadc0fb5f0 msgr2=0x7faadc0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.126+0000 7faae3dff700 1 -- 172.21.15.17:0/2525411960 shutdown_connections 2023-07-14T13:20:53.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.126+0000 7faae3dff700 1 -- 172.21.15.17:0/2525411960 wait complete. 2023-07-14T13:20:53.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.127+0000 7faae3dff700 1 Processor -- start 2023-07-14T13:20:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.127+0000 7faae3dff700 1 -- start start 2023-07-14T13:20:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.127+0000 7faae3dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faadc0ffb30 0x7faadc19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.127+0000 7faae3dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc1004e0 0x7faadc19c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.127+0000 7faae3dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faadc105b60 0x7faadc195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.127+0000 7faae3dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc195fa0 con 0x7faadc105b60 2023-07-14T13:20:53.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.127+0000 7faae3dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc196110 con 0x7faadc1004e0 2023-07-14T13:20:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.127+0000 7faae3dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc1962d0 con 0x7faadc0ffb30 2023-07-14T13:20:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.128+0000 7faae1b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faadc0ffb30 0x7faadc19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.128+0000 7faae1b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faadc0ffb30 0x7faadc19bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:36914/0 (socket says 172.21.15.17:36914) 2023-07-14T13:20:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.128+0000 7faae1b9b700 1 -- 172.21.15.17:0/3005042208 learned_addr learned my addr 172.21.15.17:0/3005042208 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.128+0000 7faae239c700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faadc105b60 0x7faadc195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.128+0000 7faae139a700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc1004e0 0x7faadc19c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.128+0000 7faae1b9b700 1 -- 172.21.15.17:0/3005042208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc1004e0 msgr2=0x7faadc19c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.128+0000 7faae1b9b700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc1004e0 0x7faadc19c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.128+0000 7faae1b9b700 1 -- 172.21.15.17:0/3005042208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faadc105b60 msgr2=0x7faadc195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.128+0000 7faae1b9b700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faadc105b60 0x7faadc195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.128+0000 7faae1b9b700 1 -- 172.21.15.17:0/3005042208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80095f0 con 0x7faadc0ffb30 2023-07-14T13:20:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.128+0000 7faae1b9b700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faadc0ffb30 0x7faadc19bad0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faad8005740 tx=0x7faad8005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.129+0000 7faad2ffd700 1 -- 172.21.15.17:0/3005042208 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad801d070 con 0x7faadc0ffb30 2023-07-14T13:20:53.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.129+0000 7faae3dff700 1 -- 172.21.15.17:0/3005042208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc196550 con 0x7faadc0ffb30 2023-07-14T13:20:53.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.129+0000 7faad2ffd700 1 -- 172.21.15.17:0/3005042208 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faad8022470 con 0x7faadc0ffb30 2023-07-14T13:20:53.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.129+0000 7faad2ffd700 1 -- 172.21.15.17:0/3005042208 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8017650 con 0x7faadc0ffb30 2023-07-14T13:20:53.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.129+0000 7faae3dff700 1 -- 172.21.15.17:0/3005042208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc1a2ac0 con 0x7faadc0ffb30 2023-07-14T13:20:53.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.132+0000 7faad2ffd700 1 -- 172.21.15.17:0/3005042208 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7faad800fb00 con 0x7faadc0ffb30 2023-07-14T13:20:53.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.134+0000 7faaf7799b80 1 Processor -- start 2023-07-14T13:20:53.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.134+0000 7faaf7799b80 1 -- start start 2023-07-14T13:20:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.134+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204a3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x5653204a8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faaf7799b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653203a4c50 con 0x5653204a3b80 2023-07-14T13:20:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faaf7799b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653203f79e0 con 0x5653204a3ff0 2023-07-14T13:20:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faaf7799b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653203f0e70 con 0x5653202fb6b0 2023-07-14T13:20:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faad2ffd700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faac80a12c0 0x7faac80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faae1b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faae1b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204a7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47534/0 (socket says 172.21.15.17:47534) 2023-07-14T13:20:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faae1b9b700 1 -- 172.21.15.17:0/4250617424 learned_addr learned my addr 172.21.15.17:0/4250617424 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:53.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faae139a700 1 --2- 172.21.15.17:0/4250617424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x5653204a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faae239c700 1 --2- 172.21.15.17:0/4250617424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faad2ffd700 1 -- 172.21.15.17:0/3005042208 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8492+0+0 (secure 0 0 0) 0x7faad80ce310 con 0x7faadc0ffb30 2023-07-14T13:20:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faae239c700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faac80a12c0 0x7faac80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faae139a700 1 -- 172.21.15.17:0/4250617424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 msgr2=0x5653204a3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faae139a700 1 --2- 172.21.15.17:0/4250617424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204a3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faae139a700 1 -- 172.21.15.17:0/4250617424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 msgr2=0x5653204a7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faae139a700 1 --2- 172.21.15.17:0/4250617424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204a7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.135+0000 7faae139a700 1 -- 172.21.15.17:0/4250617424 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56532021ed80 con 0x5653204a3ff0 2023-07-14T13:20:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.136+0000 7faae1b9b700 1 --2- 172.21.15.17:0/4250617424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:20:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.136+0000 7faae139a700 1 --2- 172.21.15.17:0/4250617424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x5653204a8300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faacc00bc40 tx=0x7faacc00bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55d34ce5ef6f4b1e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:53.164 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.136+0000 7faae239c700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faac80a12c0 0x7faac80a3770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faad4009ec0 tx=0x7faad400b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.136+0000 7faac7fff700 1 -- 172.21.15.17:0/4250617424 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc00fab0 con 0x5653204a3ff0 2023-07-14T13:20:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.136+0000 7faac7fff700 1 -- 172.21.15.17:0/4250617424 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faacc00fc10 con 0x5653204a3ff0 2023-07-14T13:20:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.136+0000 7faac7fff700 1 -- 172.21.15.17:0/4250617424 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc011440 con 0x5653204a3ff0 2023-07-14T13:20:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.137+0000 7faaf7799b80 1 -- 172.21.15.17:0/4250617424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 msgr2=0x5653204a8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.137+0000 7faaf7799b80 1 --2- 172.21.15.17:0/4250617424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x5653204a8300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faacc00bc40 tx=0x7faacc00bf50 comp rx=0 tx=0).stop 2023-07-14T13:20:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.137+0000 7faaf7799b80 1 -- 172.21.15.17:0/4250617424 shutdown_connections 2023-07-14T13:20:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.137+0000 7faaf7799b80 1 --2- 172.21.15.17:0/4250617424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x5653204a8300 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.137+0000 7faaf7799b80 1 --2- 172.21.15.17:0/4250617424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204a3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.137+0000 7faaf7799b80 1 --2- 172.21.15.17:0/4250617424 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.137+0000 7faaf7799b80 1 -- 172.21.15.17:0/4250617424 >> 172.21.15.17:0/4250617424 conn(0x565320494be0 msgr2=0x565320499f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.137+0000 7faaf7799b80 1 -- 172.21.15.17:0/4250617424 shutdown_connections 2023-07-14T13:20:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.137+0000 7faaf7799b80 1 -- 172.21.15.17:0/4250617424 wait complete. 2023-07-14T13:20:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.137+0000 7faaf7799b80 1 -- start start 2023-07-14T13:20:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faaf7799b80 1 Processor -- start 2023-07-14T13:20:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653202fb6b0 0x5653204afa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653204a3b80 0x5653204acc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x5653204ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faaf7799b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x565320390a60 con 0x5653202fb6b0 2023-07-14T13:20:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faaf7799b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x565320390760 con 0x5653204a3ff0 2023-07-14T13:20:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faaf7799b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653202748c0 con 0x5653204a3b80 2023-07-14T13:20:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faaf7799b80 10 client.0 _ll_register_callbacks cb 0x56532038e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faae1b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653202fb6b0 0x5653204afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faae239c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x5653204ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faae139a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653204a3b80 0x5653204acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faae139a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653204a3b80 0x5653204acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:36936/0 (socket says 172.21.15.17:36936) 2023-07-14T13:20:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faae139a700 1 -- 172.21.15.17:0/214011798 learned_addr learned my addr 172.21.15.17:0/214011798 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.138+0000 7faae1b9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653202fb6b0 0x5653204afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47548/0 (socket says 172.21.15.17:47548) 2023-07-14T13:20:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.139+0000 7faae139a700 1 -- 172.21.15.17:0/214011798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 msgr2=0x5653204ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.139+0000 7faae139a700 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x5653204ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.139+0000 7faae139a700 1 -- 172.21.15.17:0/214011798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653202fb6b0 msgr2=0x5653204afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.139+0000 7faae139a700 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653202fb6b0 0x5653204afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.139+0000 7faae139a700 1 -- 172.21.15.17:0/214011798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc1a2ac0 con 0x5653204a3b80 2023-07-14T13:20:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.139+0000 7faae1b9b700 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653202fb6b0 0x5653204afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:20:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.139+0000 7faae139a700 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653204a3b80 0x5653204acc90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faacc00ffb0 tx=0x7faacc00f8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fccc76a4b3d49024 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.139+0000 7faac57fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:20:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faac57fa700 1 -- 172.21.15.17:0/214011798 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc01a660 con 0x5653204a3b80 2023-07-14T13:20:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faaf7799b80 1 -- 172.21.15.17:0/214011798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56532034a490 con 0x5653204a3b80 2023-07-14T13:20:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faac57fa700 1 -- 172.21.15.17:0/214011798 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8492+0+0 (secure 0 0 0) 0x7faacc01a7c0 con 0x5653204a3b80 2023-07-14T13:20:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faac57fa700 1 -- 172.21.15.17:0/214011798 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7faacc01ae20 con 0x5653204a3b80 2023-07-14T13:20:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faaf7799b80 10 client.28885 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faaf7799b80 1 -- 172.21.15.17:0/214011798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7faacc00b8a0 con 0x5653204a3b80 2023-07-14T13:20:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faac57fa700 1 -- 172.21.15.17:0/214011798 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faacc032020 con 0x5653204a3b80 2023-07-14T13:20:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faac57fa700 1 -- 172.21.15.17:0/214011798 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7faacc023030 con 0x5653204a3b80 2023-07-14T13:20:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faaf7799b80 10 client.28885 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faaf7799b80 10 client.28885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faaf7799b80 20 client.28885 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:53.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faaf7799b80 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5653204bceb0 0x5653204bf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faaf7799b80 4 client.28885 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:20:53.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.140+0000 7faaf7799b80 1 -- 172.21.15.17:0/214011798 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653203e9e50 con 0x5653204bceb0 2023-07-14T13:20:53.173 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.141+0000 7faae1b9b700 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5653204bceb0 0x5653204bf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.142+0000 7faae1b9b700 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5653204bceb0 0x5653204bf2c0 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be13536055434b8e server_cookie=ef3d7a841d7abdb1 in_seq=0 out_seq=0 2023-07-14T13:20:53.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.142+0000 7faac57fa700 10 client.28885 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:53.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faac57fa700 1 -- 172.21.15.17:0/214011798 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5653203e9e50 con 0x5653204bceb0 2023-07-14T13:20:53.174 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faac57fa700 10 client.28885 handle_command_reply: tid=0 2023-07-14T13:20:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 1 client.28885 shutdown 2023-07-14T13:20:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 1 -- 172.21.15.17:0/214011798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653204a3b80 msgr2=0x5653204acc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653204a3b80 0x5653204acc90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faacc00ffb0 tx=0x7faacc00f8b0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 1 -- 172.21.15.17:0/214011798 shutdown_connections 2023-07-14T13:20:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5653204bceb0 0x5653204bf2c0 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x5653204ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653202fb6b0 0x5653204afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 1 --2- 172.21.15.17:0/214011798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653204a3b80 0x5653204acc90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faac57fa700 0 client.28885 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 1 -- 172.21.15.17:0/214011798 >> 172.21.15.17:0/214011798 conn(0x565320494be0 msgr2=0x5653204994e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 1 -- 172.21.15.17:0/214011798 shutdown_connections 2023-07-14T13:20:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 1 -- 172.21.15.17:0/214011798 wait complete. 2023-07-14T13:20:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.143+0000 7faaf7799b80 20 client.28885 trim_cache size 0 max 16384 2023-07-14T13:20:53.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.158+0000 7faaf7799b80 1 Processor -- start 2023-07-14T13:20:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.158+0000 7faaf7799b80 1 -- start start 2023-07-14T13:20:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.158+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x565320499c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faaf7799b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x565320465060 con 0x5653204a3b80 2023-07-14T13:20:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faaf7799b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653204a7590 con 0x5653204a3ff0 2023-07-14T13:20:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faaf7799b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653204a43c0 con 0x5653202fb6b0 2023-07-14T13:20:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faae139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faae139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47564/0 (socket says 172.21.15.17:47564) 2023-07-14T13:20:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faae1b9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faae139a700 1 -- 172.21.15.17:0/102427326 learned_addr learned my addr 172.21.15.17:0/102427326 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faae239c700 1 --2- 172.21.15.17:0/102427326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x565320499c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faae139a700 1 -- 172.21.15.17:0/102427326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 msgr2=0x5653204ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faae139a700 1 --2- 172.21.15.17:0/102427326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204ac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faae139a700 1 -- 172.21.15.17:0/102427326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 msgr2=0x565320499c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faae139a700 1 --2- 172.21.15.17:0/102427326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x565320499c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faae139a700 1 -- 172.21.15.17:0/102427326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653204a88f0 con 0x5653204a3b80 2023-07-14T13:20:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.159+0000 7faae1b9b700 1 --2- 172.21.15.17:0/102427326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:20:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.160+0000 7faae139a700 1 --2- 172.21.15.17:0/102427326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b87c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7faacc00bb90 tx=0x7faacc00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422329d41c92ddb8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:53.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.160+0000 7faad0bff700 1 -- 172.21.15.17:0/102427326 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc004db0 con 0x5653204a3b80 2023-07-14T13:20:53.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.160+0000 7faad0bff700 1 -- 172.21.15.17:0/102427326 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faacc032030 con 0x5653204a3b80 2023-07-14T13:20:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.160+0000 7faad0bff700 1 -- 172.21.15.17:0/102427326 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc004290 con 0x5653204a3b80 2023-07-14T13:20:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.160+0000 7faaf7799b80 1 -- 172.21.15.17:0/102427326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 msgr2=0x5653204b87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.160+0000 7faaf7799b80 1 --2- 172.21.15.17:0/102427326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b87c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7faacc00bb90 tx=0x7faacc00bfd0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.160+0000 7faaf7799b80 1 -- 172.21.15.17:0/102427326 shutdown_connections 2023-07-14T13:20:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.160+0000 7faaf7799b80 1 --2- 172.21.15.17:0/102427326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x565320499c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.160+0000 7faaf7799b80 1 --2- 172.21.15.17:0/102427326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.160+0000 7faaf7799b80 1 --2- 172.21.15.17:0/102427326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b87c0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.160+0000 7faaf7799b80 1 -- 172.21.15.17:0/102427326 >> 172.21.15.17:0/102427326 conn(0x565320494be0 msgr2=0x5653204a6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.161+0000 7faaf7799b80 1 -- 172.21.15.17:0/102427326 shutdown_connections 2023-07-14T13:20:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.161+0000 7faaf7799b80 1 -- 172.21.15.17:0/102427326 wait complete. 2023-07-14T13:20:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.161+0000 7faaf7799b80 1 -- start start 2023-07-14T13:20:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.161+0000 7faaf7799b80 1 Processor -- start 2023-07-14T13:20:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faaf7799b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x565320509db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faaf7799b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532050a320 con 0x5653204a3b80 2023-07-14T13:20:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faaf7799b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532050a490 con 0x5653204a3ff0 2023-07-14T13:20:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faaf7799b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532050a650 con 0x5653202fb6b0 2023-07-14T13:20:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faaf7799b80 10 client.0 _ll_register_callbacks cb 0x7faad4009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:20:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faae139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faae139a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47576/0 (socket says 172.21.15.17:47576) 2023-07-14T13:20:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faae139a700 1 -- 172.21.15.17:0/3953381065 learned_addr learned my addr 172.21.15.17:0/3953381065 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:20:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faae239c700 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x565320509db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faae1b9b700 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faae139a700 1 -- 172.21.15.17:0/3953381065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 msgr2=0x5653204b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faae139a700 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faae139a700 1 -- 172.21.15.17:0/3953381065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 msgr2=0x565320509db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:20:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faae139a700 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x565320509db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faae139a700 1 -- 172.21.15.17:0/3953381065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc196550 con 0x5653204a3b80 2023-07-14T13:20:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.162+0000 7faae1b9b700 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:20:53.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.163+0000 7faae139a700 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b2730 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7faacc00ffb0 tx=0x7faacc005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b0007bb323069a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:20:53.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.163+0000 7faac57fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:20:53.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.163+0000 7faac57fa700 1 -- 172.21.15.17:0/3953381065 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc01a660 con 0x5653204a3b80 2023-07-14T13:20:53.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.163+0000 7faaf7799b80 1 -- 172.21.15.17:0/3953381065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faacc00fc10 con 0x5653204a3b80 2023-07-14T13:20:53.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.163+0000 7faac57fa700 1 -- 172.21.15.17:0/3953381065 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8492+0+0 (secure 0 0 0) 0x7faacc000e40 con 0x5653204a3b80 2023-07-14T13:20:53.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.163+0000 7faac57fa700 1 -- 172.21.15.17:0/3953381065 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7faacc01a7c0 con 0x5653204a3b80 2023-07-14T13:20:53.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.163+0000 7faaf7799b80 10 client.19176 fetch_fsmap learned FSMap version 53 2023-07-14T13:20:53.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.163+0000 7faaf7799b80 1 -- 172.21.15.17:0/3953381065 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7faacc00b8a0 con 0x5653204a3b80 2023-07-14T13:20:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.163+0000 7faac57fa700 1 -- 172.21.15.17:0/3953381065 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faacc04d020 con 0x5653204a3b80 2023-07-14T13:20:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.164+0000 7faac57fa700 1 -- 172.21.15.17:0/3953381065 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7faacc023070 con 0x5653204a3b80 2023-07-14T13:20:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.164+0000 7faaf7799b80 10 client.19176 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:20:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.164+0000 7faaf7799b80 10 client.19176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:20:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.164+0000 7faaf7799b80 20 client.19176 populate_metadata read hostname 'smithi017' 2023-07-14T13:20:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.164+0000 7faaf7799b80 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5653205119b0 0x565320513dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:20:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.164+0000 7faaf7799b80 4 client.19176 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:20:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.164+0000 7faaf7799b80 1 -- 172.21.15.17:0/3953381065 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5653203abff0 con 0x5653205119b0 2023-07-14T13:20:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.164+0000 7faae1b9b700 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5653205119b0 0x565320513dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:20:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.165+0000 7faae1b9b700 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5653205119b0 0x565320513dc0 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=901623877a96fb02 server_cookie=76812967d987f1dd in_seq=0 out_seq=0 2023-07-14T13:20:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.165+0000 7faac57fa700 10 client.19176 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.504+0000 7faac57fa700 1 -- 172.21.15.17:0/3953381065 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5653203abff0 con 0x5653205119b0 2023-07-14T13:20:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.504+0000 7faac57fa700 10 client.19176 handle_command_reply: tid=0 2023-07-14T13:20:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.504+0000 7faaf7799b80 1 client.19176 shutdown 2023-07-14T13:20:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.505+0000 7faaf7799b80 1 -- 172.21.15.17:0/3953381065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 msgr2=0x5653204b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.505+0000 7faaf7799b80 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b2730 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7faacc00ffb0 tx=0x7faacc005a00 comp rx=0 tx=0).stop 2023-07-14T13:20:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.505+0000 7faaf7799b80 1 -- 172.21.15.17:0/3953381065 shutdown_connections 2023-07-14T13:20:53.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.505+0000 7faaf7799b80 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5653205119b0 0x565320513dc0 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.505+0000 7faaf7799b80 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5653204a3ff0 0x565320509db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.505+0000 7faaf7799b80 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653202fb6b0 0x5653204b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.505+0000 7faaf7799b80 1 --2- 172.21.15.17:0/3953381065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5653204a3b80 0x5653204b2730 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.505+0000 7faaf7799b80 1 -- 172.21.15.17:0/3953381065 >> 172.21.15.17:0/3953381065 conn(0x565320494be0 msgr2=0x5653204b9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.505+0000 7faac57fa700 0 client.19176 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:20:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.505+0000 7faaf7799b80 1 -- 172.21.15.17:0/3953381065 shutdown_connections 2023-07-14T13:20:53.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.506+0000 7faaf7799b80 1 -- 172.21.15.17:0/3953381065 wait complete. 2023-07-14T13:20:53.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.506+0000 7faaf7799b80 20 client.19176 trim_cache size 0 max 16384 2023-07-14T13:20:53.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:20:53.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:20:53.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:20:53.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:20:53.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 -- 172.21.15.17:0/3005042208 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faac80a12c0 msgr2=0x7faac80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:53.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faac80a12c0 0x7faac80a3770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faad4009ec0 tx=0x7faad400b040 comp rx=0 tx=0).stop 2023-07-14T13:20:53.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 -- 172.21.15.17:0/3005042208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faadc0ffb30 msgr2=0x7faadc19bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:20:53.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faadc0ffb30 0x7faadc19bad0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faad8005740 tx=0x7faad8005770 comp rx=0 tx=0).stop 2023-07-14T13:20:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 -- 172.21.15.17:0/3005042208 shutdown_connections 2023-07-14T13:20:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7faac80a12c0 0x7faac80a3770 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faadc105b60 0x7faadc195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faadc0ffb30 0x7faadc19bad0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 --2- 172.21.15.17:0/3005042208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faadc1004e0 0x7faadc19c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:20:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 -- 172.21.15.17:0/3005042208 >> 172.21.15.17:0/3005042208 conn(0x7faadc0fb5f0 msgr2=0x7faadc103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:20:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 -- 172.21.15.17:0/3005042208 shutdown_connections 2023-07-14T13:20:53.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:20:53.507+0000 7faae3dff700 1 -- 172.21.15.17:0/3005042208 wait complete. 2023-07-14T13:20:53.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:53 smithi017 ceph-mon[95536]: pgmap v667: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:20:53.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:53 smithi135 ceph-mon[97338]: pgmap v667: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:20:53.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:53 smithi131 ceph-mon[96953]: pgmap v667: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:20:55.603 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:55 smithi017 ceph-mon[95536]: pgmap v668: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:20:55.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:55 smithi135 ceph-mon[97338]: pgmap v668: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:20:55.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:55 smithi131 ceph-mon[96953]: pgmap v668: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2023-07-14T13:20:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 165.0 s, 558.0 tps, lat 175.668 ms stddev 124.931 2023-07-14T13:20:57.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:57 smithi017 ceph-mon[95536]: pgmap v669: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 22 MiB/s wr, 1.60k op/s 2023-07-14T13:20:57.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:57 smithi135 ceph-mon[97338]: pgmap v669: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 22 MiB/s wr, 1.60k op/s 2023-07-14T13:20:57.742 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:57 smithi131 ceph-mon[96953]: pgmap v669: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 22 MiB/s wr, 1.60k op/s 2023-07-14T13:20:59.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:20:59 smithi135 ceph-mon[97338]: pgmap v670: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-07-14T13:20:59.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:20:59 smithi131 ceph-mon[96953]: pgmap v670: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-07-14T13:20:59.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:20:59 smithi017 ceph-mon[95536]: pgmap v670: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-07-14T13:21:01.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:01 smithi135 ceph-mon[97338]: pgmap v671: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 20 MiB/s wr, 1.46k op/s 2023-07-14T13:21:01.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:01 smithi131 ceph-mon[96953]: pgmap v671: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 20 MiB/s wr, 1.46k op/s 2023-07-14T13:21:01.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:01 smithi017 ceph-mon[95536]: pgmap v671: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 20 MiB/s wr, 1.46k op/s 2023-07-14T13:21:02.444 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 170.0 s, 342.4 tps, lat 295.326 ms stddev 477.264 2023-07-14T13:21:03.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:03 smithi135 ceph-mon[97338]: pgmap v672: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 12 MiB/s wr, 952 op/s 2023-07-14T13:21:03.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:03 smithi131 ceph-mon[96953]: pgmap v672: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 12 MiB/s wr, 952 op/s 2023-07-14T13:21:03.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:03 smithi017 ceph-mon[95536]: pgmap v672: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 12 MiB/s wr, 952 op/s 2023-07-14T13:21:05.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:05 smithi135 ceph-mon[97338]: pgmap v673: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 12 MiB/s wr, 952 op/s 2023-07-14T13:21:05.693 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:05 smithi135 ceph-mon[97338]: osdmap e120: 12 total, 12 up, 12 in 2023-07-14T13:21:05.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:05 smithi131 ceph-mon[96953]: pgmap v673: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 12 MiB/s wr, 952 op/s 2023-07-14T13:21:05.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:05 smithi131 ceph-mon[96953]: osdmap e120: 12 total, 12 up, 12 in 2023-07-14T13:21:05.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:05 smithi017 ceph-mon[95536]: pgmap v673: 97 pgs: 97 active+clean; 15 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 12 MiB/s wr, 952 op/s 2023-07-14T13:21:05.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:05 smithi017 ceph-mon[95536]: osdmap e120: 12 total, 12 up, 12 in 2023-07-14T13:21:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.769+0000 7f8d5edff700 1 -- 172.21.15.17:0/219497583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d5806c910 msgr2=0x7f8d5806cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.769+0000 7f8d5edff700 1 --2- 172.21.15.17:0/219497583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d5806c910 0x7f8d5806cd80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8d5001c0d0 tx=0x7f8d5001c3e0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.770+0000 7f8d5edff700 1 -- 172.21.15.17:0/219497583 shutdown_connections 2023-07-14T13:21:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.770+0000 7f8d5edff700 1 --2- 172.21.15.17:0/219497583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d5806d3a0 0x7f8d5811b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.770+0000 7f8d5edff700 1 --2- 172.21.15.17:0/219497583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5810e2a0 0x7f8d5810e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.770+0000 7f8d5edff700 1 --2- 172.21.15.17:0/219497583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d5806c910 0x7f8d5806cd80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.770+0000 7f8d5edff700 1 -- 172.21.15.17:0/219497583 >> 172.21.15.17:0/219497583 conn(0x7f8d5806bd70 msgr2=0x7f8d58070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.770+0000 7f8d5edff700 1 -- 172.21.15.17:0/219497583 shutdown_connections 2023-07-14T13:21:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.770+0000 7f8d5edff700 1 -- 172.21.15.17:0/219497583 wait complete. 2023-07-14T13:21:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.771+0000 7f8d5edff700 1 Processor -- start 2023-07-14T13:21:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.772+0000 7f8d5edff700 1 -- start start 2023-07-14T13:21:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.773+0000 7f8d5edff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d5806c910 0x7f8d58116e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.773+0000 7f8d5edff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d5806d3a0 0x7f8d58117360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.773+0000 7f8d5edff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5810e2a0 0x7f8d5811a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.773+0000 7f8d5edff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5811afe0 con 0x7f8d5810e2a0 2023-07-14T13:21:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.773+0000 7f8d5edff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5811b150 con 0x7f8d5806c910 2023-07-14T13:21:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.773+0000 7f8d5edff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5811b310 con 0x7f8d5806d3a0 2023-07-14T13:21:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.773+0000 7f8d57fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d5806d3a0 0x7f8d58117360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.773+0000 7f8d57fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d5806d3a0 0x7f8d58117360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:43276/0 (socket says 172.21.15.17:43276) 2023-07-14T13:21:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.773+0000 7f8d57fff700 1 -- 172.21.15.17:0/312930118 learned_addr learned my addr 172.21.15.17:0/312930118 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.773+0000 7f8d5cb9b700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d5806c910 0x7f8d58116e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.774+0000 7f8d57fff700 1 -- 172.21.15.17:0/312930118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d5806c910 msgr2=0x7f8d58116e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.774+0000 7f8d57fff700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d5806c910 0x7f8d58116e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.774+0000 7f8d57fff700 1 -- 172.21.15.17:0/312930118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5810e2a0 msgr2=0x7f8d5811a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.774+0000 7f8d57fff700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5810e2a0 0x7f8d5811a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.774+0000 7f8d57fff700 1 -- 172.21.15.17:0/312930118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5001ad10 con 0x7f8d5806d3a0 2023-07-14T13:21:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.774+0000 7f8d57fff700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d5806d3a0 0x7f8d58117360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8d5001a860 tx=0x7f8d5001ddd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.774+0000 7f8d55ffb700 1 -- 172.21.15.17:0/312930118 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5001f050 con 0x7f8d5806d3a0 2023-07-14T13:21:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.775+0000 7f8d5edff700 1 -- 172.21.15.17:0/312930118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5811b530 con 0x7f8d5806d3a0 2023-07-14T13:21:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.775+0000 7f8d55ffb700 1 -- 172.21.15.17:0/312930118 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d50003e10 con 0x7f8d5806d3a0 2023-07-14T13:21:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.775+0000 7f8d55ffb700 1 -- 172.21.15.17:0/312930118 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5002c740 con 0x7f8d5806d3a0 2023-07-14T13:21:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.775+0000 7f8d5edff700 1 -- 172.21.15.17:0/312930118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d581a9410 con 0x7f8d5806d3a0 2023-07-14T13:21:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.782+0000 7f8d55ffb700 1 -- 172.21.15.17:0/312930118 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8d50005640 con 0x7f8d5806d3a0 2023-07-14T13:21:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.783+0000 7f8d7263cb80 1 Processor -- start 2023-07-14T13:21:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.784+0000 7f8d7263cb80 1 -- start start 2023-07-14T13:21:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.785+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef120306b0 0x55ef121d9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.785+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef121da2d0 0x55ef121d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.785+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.785+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef120d9c50 con 0x55ef121da2d0 2023-07-14T13:21:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.785+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1212c9e0 con 0x55ef120306b0 2023-07-14T13:21:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.785+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef12125e70 con 0x55ef121d4580 2023-07-14T13:21:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.785+0000 7f8d5d39c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef120306b0 0x55ef121d9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.785+0000 7f8d5d39c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef120306b0 0x55ef121d9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59212/0 (socket says 172.21.15.17:59212) 2023-07-14T13:21:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.785+0000 7f8d5d39c700 1 -- 172.21.15.17:0/3667184104 learned_addr learned my addr 172.21.15.17:0/3667184104 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.785+0000 7f8d5cb9b700 1 --2- 172.21.15.17:0/3667184104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef121da2d0 0x55ef121d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.785+0000 7f8d57fff700 1 --2- 172.21.15.17:0/3667184104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.786+0000 7f8d5d39c700 1 -- 172.21.15.17:0/3667184104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 msgr2=0x55ef121d49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.786+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/3667184104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121d49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.786+0000 7f8d5d39c700 1 -- 172.21.15.17:0/3667184104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef121da2d0 msgr2=0x55ef121d4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.786+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/3667184104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef121da2d0 0x55ef121d4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.786+0000 7f8d5d39c700 1 -- 172.21.15.17:0/3667184104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef11f53d80 con 0x55ef120306b0 2023-07-14T13:21:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.786+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/3667184104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef120306b0 0x55ef121d9d90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8d48007af0 tx=0x7f8d48007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb3860c697de6ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.788+0000 7f8d3effd700 1 -- 172.21.15.17:0/3667184104 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48004830 con 0x55ef120306b0 2023-07-14T13:21:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.788+0000 7f8d3effd700 1 -- 172.21.15.17:0/3667184104 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d48004e20 con 0x55ef120306b0 2023-07-14T13:21:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.788+0000 7f8d3effd700 1 -- 172.21.15.17:0/3667184104 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48005280 con 0x55ef120306b0 2023-07-14T13:21:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.790+0000 7f8d7263cb80 1 -- 172.21.15.17:0/3667184104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef120306b0 msgr2=0x55ef121d9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.790+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/3667184104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef120306b0 0x55ef121d9d90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8d48007af0 tx=0x7f8d48007e00 comp rx=0 tx=0).stop 2023-07-14T13:21:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.792+0000 7f8d55ffb700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a1400 0x7f8d400a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.792+0000 7f8d55ffb700 1 -- 172.21.15.17:0/312930118 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f8d500df340 con 0x7f8d5806d3a0 2023-07-14T13:21:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.793+0000 7f8d7263cb80 1 -- 172.21.15.17:0/3667184104 shutdown_connections 2023-07-14T13:21:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.793+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/3667184104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121d49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.793+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/3667184104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef120306b0 0x55ef121d9d90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.793+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/3667184104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef121da2d0 0x55ef121d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.793+0000 7f8d7263cb80 1 -- 172.21.15.17:0/3667184104 >> 172.21.15.17:0/3667184104 conn(0x55ef121c9be0 msgr2=0x55ef121cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.794+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a1400 0x7f8d400a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.795+0000 7f8d7263cb80 1 -- 172.21.15.17:0/3667184104 shutdown_connections 2023-07-14T13:21:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.796+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a1400 0x7f8d400a38b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8d48005fd0 tx=0x7f8d4801c040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.796+0000 7f8d7263cb80 1 -- 172.21.15.17:0/3667184104 wait complete. 2023-07-14T13:21:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.797+0000 7f8d7263cb80 1 -- start start 2023-07-14T13:21:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.797+0000 7f8d7263cb80 1 Processor -- start 2023-07-14T13:21:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.798+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121dd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.798+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121dde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.798+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 0x55ef121de390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.798+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef120c5a60 con 0x55ef120306b0 2023-07-14T13:21:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.798+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef120c5760 con 0x55ef121da2d0 2023-07-14T13:21:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.798+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef11fa98c0 con 0x55ef121d4580 2023-07-14T13:21:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.798+0000 7f8d7263cb80 10 client.0 _ll_register_callbacks cb 0x55ef120c3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:21:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.799+0000 7f8d5d39c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 0x55ef121de390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.799+0000 7f8d5d39c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 0x55ef121de390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59222/0 (socket says 172.21.15.17:59222) 2023-07-14T13:21:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.799+0000 7f8d5d39c700 1 -- 172.21.15.17:0/946031836 learned_addr learned my addr 172.21.15.17:0/946031836 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.799+0000 7f8d57fff700 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121dde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.799+0000 7f8d5d39c700 1 -- 172.21.15.17:0/946031836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 msgr2=0x55ef121dde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.799+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121dde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.799+0000 7f8d5d39c700 1 -- 172.21.15.17:0/946031836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 msgr2=0x55ef121dd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.799+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121dd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.799+0000 7f8d5d39c700 1 -- 172.21.15.17:0/946031836 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d48007750 con 0x55ef121da2d0 2023-07-14T13:21:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.800+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 0x55ef121de390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800da00 tx=0x7f8d48004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3803bf089bd74eb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.800+0000 7f8d37fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:21:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.801+0000 7f8d37fff700 1 -- 172.21.15.17:0/946031836 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48005710 con 0x55ef121da2d0 2023-07-14T13:21:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.801+0000 7f8d37fff700 1 -- 172.21.15.17:0/946031836 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f8d48025480 con 0x55ef121da2d0 2023-07-14T13:21:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.801+0000 7f8d7263cb80 1 -- 172.21.15.17:0/946031836 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef1207f490 con 0x55ef121da2d0 2023-07-14T13:21:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.801+0000 7f8d37fff700 1 -- 172.21.15.17:0/946031836 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d48025640 con 0x55ef121da2d0 2023-07-14T13:21:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.802+0000 7f8d7263cb80 10 client.28946 fetch_fsmap learned FSMap version 53 2023-07-14T13:21:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.802+0000 7f8d7263cb80 1 -- 172.21.15.17:0/946031836 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55ef11f3cc00 con 0x55ef121da2d0 2023-07-14T13:21:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.802+0000 7f8d37fff700 1 -- 172.21.15.17:0/946031836 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ef1207f490 con 0x55ef121da2d0 2023-07-14T13:21:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.802+0000 7f8d37fff700 1 -- 172.21.15.17:0/946031836 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8d480197a0 con 0x55ef121da2d0 2023-07-14T13:21:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.803+0000 7f8d7263cb80 10 client.28946 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:21:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.803+0000 7f8d7263cb80 10 client.28946 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:21:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.803+0000 7f8d7263cb80 20 client.28946 populate_metadata read hostname 'smithi017' 2023-07-14T13:21:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.803+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef121edc90 0x55ef121f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.803+0000 7f8d7263cb80 4 client.28946 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:21:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.803+0000 7f8d7263cb80 1 -- 172.21.15.17:0/946031836 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef1211ee50 con 0x55ef121edc90 2023-07-14T13:21:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.803+0000 7f8d5cb9b700 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef121edc90 0x55ef121f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.804+0000 7f8d5cb9b700 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef121edc90 0x55ef121f00a0 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd937068ff27ad1f server_cookie=dffc14ffbda0883e in_seq=0 out_seq=0 2023-07-14T13:21:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.805+0000 7f8d37fff700 10 client.28946 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.806+0000 7f8d37fff700 1 -- 172.21.15.17:0/946031836 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ef1211ee50 con 0x55ef121edc90 2023-07-14T13:21:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.806+0000 7f8d37fff700 10 client.28946 handle_command_reply: tid=0 2023-07-14T13:21:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.806+0000 7f8d7263cb80 1 client.28946 shutdown 2023-07-14T13:21:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.806+0000 7f8d7263cb80 1 -- 172.21.15.17:0/946031836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 msgr2=0x55ef121de390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.806+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 0x55ef121de390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800da00 tx=0x7f8d48004750 comp rx=0 tx=0).stop 2023-07-14T13:21:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.807+0000 7f8d7263cb80 1 -- 172.21.15.17:0/946031836 shutdown_connections 2023-07-14T13:21:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.807+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef121edc90 0x55ef121f00a0 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.807+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 0x55ef121de390 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.807+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121dd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.807+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/946031836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121dde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.807+0000 7f8d7263cb80 1 -- 172.21.15.17:0/946031836 >> 172.21.15.17:0/946031836 conn(0x55ef121c9be0 msgr2=0x55ef121ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.807+0000 7f8d37fff700 0 client.28946 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.807+0000 7f8d7263cb80 1 -- 172.21.15.17:0/946031836 shutdown_connections 2023-07-14T13:21:06.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.807+0000 7f8d7263cb80 1 -- 172.21.15.17:0/946031836 wait complete. 2023-07-14T13:21:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.808+0000 7f8d7263cb80 20 client.28946 trim_cache size 0 max 16384 2023-07-14T13:21:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.839+0000 7f8d7263cb80 1 Processor -- start 2023-07-14T13:21:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.839+0000 7f8d7263cb80 1 -- start start 2023-07-14T13:21:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.840+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.840+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121d4580 0x55ef121e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.840+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121da2d0 0x55ef121cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.840+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef121cb5f0 con 0x55ef120306b0 2023-07-14T13:21:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.840+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef121ea600 con 0x55ef121d4580 2023-07-14T13:21:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.840+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef121dec60 con 0x55ef121da2d0 2023-07-14T13:21:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.840+0000 7f8d5cb9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.840+0000 7f8d5cb9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121d4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60766/0 (socket says 172.21.15.17:60766) 2023-07-14T13:21:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.840+0000 7f8d5cb9b700 1 -- 172.21.15.17:0/1533103400 learned_addr learned my addr 172.21.15.17:0/1533103400 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.840+0000 7f8d57fff700 1 --2- 172.21.15.17:0/1533103400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121d4580 0x55ef121e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.841+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/1533103400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121da2d0 0x55ef121cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.841+0000 7f8d57fff700 1 -- 172.21.15.17:0/1533103400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121da2d0 msgr2=0x55ef121cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.841+0000 7f8d57fff700 1 --2- 172.21.15.17:0/1533103400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121da2d0 0x55ef121cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.841+0000 7f8d57fff700 1 -- 172.21.15.17:0/1533103400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 msgr2=0x55ef121d4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.841+0000 7f8d57fff700 1 --2- 172.21.15.17:0/1533103400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121d4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.841+0000 7f8d57fff700 1 -- 172.21.15.17:0/1533103400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef11f7a1f0 con 0x55ef121d4580 2023-07-14T13:21:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.842+0000 7f8d57fff700 1 --2- 172.21.15.17:0/1533103400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121d4580 0x55ef121e4c60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8d500dca20 tx=0x7f8d5001a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bd60f6515c2c8a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.842+0000 7f8d3f7fe700 1 -- 172.21.15.17:0/1533103400 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d500a8770 con 0x55ef121d4580 2023-07-14T13:21:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.842+0000 7f8d3f7fe700 1 -- 172.21.15.17:0/1533103400 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d500ac200 con 0x55ef121d4580 2023-07-14T13:21:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.842+0000 7f8d3f7fe700 1 -- 172.21.15.17:0/1533103400 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d500b47f0 con 0x55ef121d4580 2023-07-14T13:21:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.843+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1533103400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121d4580 msgr2=0x55ef121e4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.843+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/1533103400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121d4580 0x55ef121e4c60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8d500dca20 tx=0x7f8d5001a040 comp rx=0 tx=0).stop 2023-07-14T13:21:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.844+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1533103400 shutdown_connections 2023-07-14T13:21:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.844+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/1533103400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121da2d0 0x55ef121cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.844+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/1533103400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.844+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/1533103400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121d4580 0x55ef121e4c60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.844+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1533103400 >> 172.21.15.17:0/1533103400 conn(0x55ef121c9be0 msgr2=0x55ef121d7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.844+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1533103400 shutdown_connections 2023-07-14T13:21:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.844+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1533103400 wait complete. 2023-07-14T13:21:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.845+0000 7f8d7263cb80 1 -- start start 2023-07-14T13:21:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.845+0000 7f8d7263cb80 1 Processor -- start 2023-07-14T13:21:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.846+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121e2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.846+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121e3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.846+0000 7f8d7263cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 0x55ef121e36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.846+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef121e5250 con 0x55ef120306b0 2023-07-14T13:21:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.846+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef12240b70 con 0x55ef121da2d0 2023-07-14T13:21:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.846+0000 7f8d7263cb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef12240cb0 con 0x55ef121d4580 2023-07-14T13:21:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.846+0000 7f8d7263cb80 10 client.0 _ll_register_callbacks cb 0x7f8d4800dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:21:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.847+0000 7f8d57fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.847+0000 7f8d57fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121e3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:43312/0 (socket says 172.21.15.17:43312) 2023-07-14T13:21:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.847+0000 7f8d57fff700 1 -- 172.21.15.17:0/1583284492 learned_addr learned my addr 172.21.15.17:0/1583284492 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.847+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 0x55ef121e36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.847+0000 7f8d5cb9b700 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121e2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.847+0000 7f8d5d39c700 1 -- 172.21.15.17:0/1583284492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 msgr2=0x55ef121e3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:06.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.847+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121e3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.847+0000 7f8d5d39c700 1 -- 172.21.15.17:0/1583284492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 msgr2=0x55ef121e2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.847+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121e2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.847+0000 7f8d5d39c700 1 -- 172.21.15.17:0/1583284492 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d581a9410 con 0x55ef121da2d0 2023-07-14T13:21:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.849+0000 7f8d5d39c700 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 0x55ef121e36d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8d48019bd0 tx=0x7f8d48010790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4418281e8b8480c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.849+0000 7f8d37fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:21:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.849+0000 7f8d37fff700 1 -- 172.21.15.17:0/1583284492 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48019870 con 0x55ef121da2d0 2023-07-14T13:21:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.849+0000 7f8d37fff700 1 -- 172.21.15.17:0/1583284492 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f8d48010800 con 0x55ef121da2d0 2023-07-14T13:21:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.850+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1583284492 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d48004e20 con 0x55ef121da2d0 2023-07-14T13:21:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.851+0000 7f8d37fff700 1 -- 172.21.15.17:0/1583284492 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d480109e0 con 0x55ef121da2d0 2023-07-14T13:21:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.852+0000 7f8d7263cb80 10 client.28952 fetch_fsmap learned FSMap version 53 2023-07-14T13:21:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.852+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1583284492 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55ef11f52250 con 0x55ef121da2d0 2023-07-14T13:21:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.852+0000 7f8d37fff700 1 -- 172.21.15.17:0/1583284492 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d48004e20 con 0x55ef121da2d0 2023-07-14T13:21:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.853+0000 7f8d37fff700 1 -- 172.21.15.17:0/1583284492 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8d48010b40 con 0x55ef121da2d0 2023-07-14T13:21:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.854+0000 7f8d7263cb80 10 client.28952 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:21:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.854+0000 7f8d7263cb80 10 client.28952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:21:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.854+0000 7f8d7263cb80 20 client.28952 populate_metadata read hostname 'smithi017' 2023-07-14T13:21:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.854+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef122421f0 0x55ef12244600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.854+0000 7f8d7263cb80 4 client.28952 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:21:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.854+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1583284492 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ef120e0ff0 con 0x55ef122421f0 2023-07-14T13:21:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.854+0000 7f8d5cb9b700 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef122421f0 0x55ef12244600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.855+0000 7f8d5cb9b700 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef122421f0 0x55ef12244600 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=640ef5bf14157517 server_cookie=a1fd0cfdd0ce2d20 in_seq=0 out_seq=0 2023-07-14T13:21:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.856+0000 7f8d37fff700 10 client.28952 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:06.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.885+0000 7f8d37fff700 1 -- 172.21.15.17:0/1583284492 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ef120e0ff0 con 0x55ef122421f0 2023-07-14T13:21:06.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.885+0000 7f8d37fff700 10 client.28952 handle_command_reply: tid=0 2023-07-14T13:21:06.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.885+0000 7f8d7263cb80 1 client.28952 shutdown 2023-07-14T13:21:06.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.886+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1583284492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 msgr2=0x55ef121e36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.886+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 0x55ef121e36d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8d48019bd0 tx=0x7f8d48010790 comp rx=0 tx=0).stop 2023-07-14T13:21:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.886+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1583284492 shutdown_connections 2023-07-14T13:21:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.886+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef122421f0 0x55ef12244600 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.886+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef121da2d0 0x55ef121e36d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.886+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef120306b0 0x55ef121e2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.886+0000 7f8d7263cb80 1 --2- 172.21.15.17:0/1583284492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef121d4580 0x55ef121e3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.886+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1583284492 >> 172.21.15.17:0/1583284492 conn(0x55ef121c9be0 msgr2=0x55ef121d8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.886+0000 7f8d37fff700 0 client.28952 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.886+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1583284492 shutdown_connections 2023-07-14T13:21:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.887+0000 7f8d7263cb80 1 -- 172.21.15.17:0/1583284492 wait complete. 2023-07-14T13:21:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.888+0000 7f8d7263cb80 20 client.28952 trim_cache size 0 max 16384 2023-07-14T13:21:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:21:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:21:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:21:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:21:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.889+0000 7f8d5edff700 1 -- 172.21.15.17:0/312930118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a1400 msgr2=0x7f8d400a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.889+0000 7f8d5edff700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a1400 0x7f8d400a38b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8d48005fd0 tx=0x7f8d4801c040 comp rx=0 tx=0).stop 2023-07-14T13:21:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.889+0000 7f8d5edff700 1 -- 172.21.15.17:0/312930118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d5806d3a0 msgr2=0x7f8d58117360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.889+0000 7f8d5edff700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d5806d3a0 0x7f8d58117360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8d5001a860 tx=0x7f8d5001ddd0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.891+0000 7f8d5edff700 1 -- 172.21.15.17:0/312930118 shutdown_connections 2023-07-14T13:21:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.891+0000 7f8d5edff700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8d400a1400 0x7f8d400a38b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.891+0000 7f8d5edff700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d5810e2a0 0x7f8d5811a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.891+0000 7f8d5edff700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d5806c910 0x7f8d58116e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.891+0000 7f8d5edff700 1 --2- 172.21.15.17:0/312930118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d5806d3a0 0x7f8d58117360 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:06.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.891+0000 7f8d5edff700 1 -- 172.21.15.17:0/312930118 >> 172.21.15.17:0/312930118 conn(0x7f8d5806bd70 msgr2=0x7f8d580707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:06.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.896+0000 7f8d5edff700 1 -- 172.21.15.17:0/312930118 shutdown_connections 2023-07-14T13:21:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:06.899+0000 7f8d5edff700 1 -- 172.21.15.17:0/312930118 wait complete. 2023-07-14T13:21:07.444 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 175.0 s, 379.8 tps, lat 264.120 ms stddev 128.292 2023-07-14T13:21:07.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:07 smithi017 ceph-mon[95536]: pgmap v675: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 12 MiB/s wr, 965 op/s 2023-07-14T13:21:07.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:07 smithi135 ceph-mon[97338]: pgmap v675: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 12 MiB/s wr, 965 op/s 2023-07-14T13:21:07.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:07 smithi131 ceph-mon[96953]: pgmap v675: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 12 MiB/s wr, 965 op/s 2023-07-14T13:21:09.602 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:09 smithi017 ceph-mon[95536]: pgmap v676: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 12 MiB/s wr, 965 op/s 2023-07-14T13:21:09.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:09 smithi135 ceph-mon[97338]: pgmap v676: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 12 MiB/s wr, 965 op/s 2023-07-14T13:21:09.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:09 smithi131 ceph-mon[96953]: pgmap v676: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 12 MiB/s wr, 965 op/s 2023-07-14T13:21:11.600 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:11 smithi017 ceph-mon[95536]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 14 MiB/s wr, 1.07k op/s 2023-07-14T13:21:11.601 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:11 smithi017 ceph-mon[95536]: osdmap e121: 12 total, 12 up, 12 in 2023-07-14T13:21:11.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:11 smithi135 ceph-mon[97338]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 14 MiB/s wr, 1.07k op/s 2023-07-14T13:21:11.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:11 smithi135 ceph-mon[97338]: osdmap e121: 12 total, 12 up, 12 in 2023-07-14T13:21:11.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:11 smithi131 ceph-mon[96953]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 14 MiB/s wr, 1.07k op/s 2023-07-14T13:21:11.741 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:11 smithi131 ceph-mon[96953]: osdmap e121: 12 total, 12 up, 12 in 2023-07-14T13:21:12.443 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 180.0 s, 566.2 tps, lat 175.697 ms stddev 50.639 2023-07-14T13:21:13.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:13 smithi135 ceph-mon[97338]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 17 MiB/s wr, 1.34k op/s 2023-07-14T13:21:13.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:13 smithi131 ceph-mon[96953]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 17 MiB/s wr, 1.34k op/s 2023-07-14T13:21:13.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:13 smithi017 ceph-mon[95536]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 17 MiB/s wr, 1.34k op/s 2023-07-14T13:21:15.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:15 smithi135 ceph-mon[97338]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 14 MiB/s wr, 1.09k op/s 2023-07-14T13:21:15.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:15 smithi131 ceph-mon[96953]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 14 MiB/s wr, 1.09k op/s 2023-07-14T13:21:15.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:15 smithi017 ceph-mon[95536]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 14 MiB/s wr, 1.09k op/s 2023-07-14T13:21:17.445 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 185.0 s, 564.5 tps, lat 178.768 ms stddev 69.968 2023-07-14T13:21:17.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:17 smithi135 ceph-mon[97338]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-07-14T13:21:17.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:17 smithi131 ceph-mon[96953]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-07-14T13:21:17.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:17 smithi017 ceph-mon[95536]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-07-14T13:21:19.692 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:19 smithi135 ceph-mon[97338]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-07-14T13:21:19.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:19 smithi131 ceph-mon[96953]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-07-14T13:21:19.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:19 smithi017 ceph-mon[95536]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.24k op/s 2023-07-14T13:21:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.156+0000 7f60e67ff700 1 -- 172.21.15.17:0/891412147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60e00ffb00 msgr2=0x7f60e00fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.156+0000 7f60e67ff700 1 --2- 172.21.15.17:0/891412147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60e00ffb00 0x7f60e00fff70 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009990 tx=0x7f60d4009ca0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.156+0000 7f60e67ff700 1 -- 172.21.15.17:0/891412147 shutdown_connections 2023-07-14T13:21:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.156+0000 7f60e67ff700 1 --2- 172.21.15.17:0/891412147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60e01004b0 0x7f60e010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.156+0000 7f60e67ff700 1 --2- 172.21.15.17:0/891412147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e0105b10 0x7f60e0105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.156+0000 7f60e67ff700 1 --2- 172.21.15.17:0/891412147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60e00ffb00 0x7f60e00fff70 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.156+0000 7f60e67ff700 1 -- 172.21.15.17:0/891412147 >> 172.21.15.17:0/891412147 conn(0x7f60e00fb600 msgr2=0x7f60e00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.156+0000 7f60e67ff700 1 -- 172.21.15.17:0/891412147 shutdown_connections 2023-07-14T13:21:20.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.156+0000 7f60e67ff700 1 -- 172.21.15.17:0/891412147 wait complete. 2023-07-14T13:21:20.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.157+0000 7f60e67ff700 1 Processor -- start 2023-07-14T13:21:20.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.158+0000 7f60e67ff700 1 -- start start 2023-07-14T13:21:20.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.158+0000 7f60e67ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e00ffb00 0x7f60e0197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.158+0000 7f60e67ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60e01004b0 0x7f60e01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.158+0000 7f60e67ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60e0105b10 0x7f60e019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.158+0000 7f60e67ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e019d020 con 0x7f60e01004b0 2023-07-14T13:21:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.158+0000 7f60e67ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e019d190 con 0x7f60e00ffb00 2023-07-14T13:21:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.158+0000 7f60e67ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e019d350 con 0x7f60e0105b10 2023-07-14T13:21:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.158+0000 7f60df7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60e01004b0 0x7f60e01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.158+0000 7f60df7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60e01004b0 0x7f60e01983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33432/0 (socket says 172.21.15.17:33432) 2023-07-14T13:21:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.159+0000 7f60df7fe700 1 -- 172.21.15.17:0/3692881896 learned_addr learned my addr 172.21.15.17:0/3692881896 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.159+0000 7f60e4d9c700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60e0105b10 0x7f60e019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.159+0000 7f60dffff700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e00ffb00 0x7f60e0197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.159+0000 7f60df7fe700 1 -- 172.21.15.17:0/3692881896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60e0105b10 msgr2=0x7f60e019c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.159+0000 7f60df7fe700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60e0105b10 0x7f60e019c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.159+0000 7f60df7fe700 1 -- 172.21.15.17:0/3692881896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e00ffb00 msgr2=0x7f60e0197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.159+0000 7f60df7fe700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e00ffb00 0x7f60e0197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.159+0000 7f60df7fe700 1 -- 172.21.15.17:0/3692881896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d40095f0 con 0x7f60e01004b0 2023-07-14T13:21:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.159+0000 7f60df7fe700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60e01004b0 0x7f60e01983c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f60d4000c00 tx=0x7f60d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.160+0000 7f60dd7fa700 1 -- 172.21.15.17:0/3692881896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d401d070 con 0x7f60e01004b0 2023-07-14T13:21:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.160+0000 7f60e67ff700 1 -- 172.21.15.17:0/3692881896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e019d5d0 con 0x7f60e01004b0 2023-07-14T13:21:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.160+0000 7f60dd7fa700 1 -- 172.21.15.17:0/3692881896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60d4022470 con 0x7f60e01004b0 2023-07-14T13:21:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.160+0000 7f60dd7fa700 1 -- 172.21.15.17:0/3692881896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4017650 con 0x7f60e01004b0 2023-07-14T13:21:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.160+0000 7f60e67ff700 1 -- 172.21.15.17:0/3692881896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e01a4e70 con 0x7f60e01004b0 2023-07-14T13:21:20.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.165+0000 7f60fa0a7b80 1 Processor -- start 2023-07-14T13:21:20.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.165+0000 7f60dd7fa700 1 -- 172.21.15.17:0/3692881896 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f60d40225e0 con 0x7f60e01004b0 2023-07-14T13:21:20.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.166+0000 7f60fa0a7b80 1 -- start start 2023-07-14T13:21:20.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.166+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e4ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.166+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.166+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e536e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.167+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8d4bc50 con 0x55bdf8e4ef80 2023-07-14T13:21:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.167+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8d9e9e0 con 0x55bdf8ca26b0 2023-07-14T13:21:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.167+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8d97e70 con 0x55bdf8e4f3f0 2023-07-14T13:21:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.167+0000 7f60df7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.167+0000 7f60df7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38716/0 (socket says 172.21.15.17:38716) 2023-07-14T13:21:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.167+0000 7f60df7fe700 1 -- 172.21.15.17:0/3836509123 learned_addr learned my addr 172.21.15.17:0/3836509123 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.167+0000 7f60dffff700 1 --2- 172.21.15.17:0/3836509123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.167+0000 7f60e4d9c700 1 --2- 172.21.15.17:0/3836509123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e4ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.168+0000 7f60df7fe700 1 -- 172.21.15.17:0/3836509123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 msgr2=0x55bdf8e4ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.168+0000 7f60df7fe700 1 --2- 172.21.15.17:0/3836509123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e4ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.168+0000 7f60df7fe700 1 -- 172.21.15.17:0/3836509123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 msgr2=0x55bdf8e531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.168+0000 7f60df7fe700 1 --2- 172.21.15.17:0/3836509123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.168+0000 7f60df7fe700 1 -- 172.21.15.17:0/3836509123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdf8bc5d80 con 0x55bdf8e4f3f0 2023-07-14T13:21:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.168+0000 7f60dd7fa700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c80a1340 0x7f60c80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.168+0000 7f60dffff700 1 --2- 172.21.15.17:0/3836509123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:21:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.168+0000 7f60df7fe700 1 --2- 172.21.15.17:0/3836509123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e536e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f60d40cb820 tx=0x7f60d40d6540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f284593553ebf4dd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.168+0000 7f60e4d9c700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c80a1340 0x7f60c80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.169+0000 7f60dd7fa700 1 -- 172.21.15.17:0/3692881896 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f60d40ce0a0 con 0x7f60e01004b0 2023-07-14T13:21:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.169+0000 7f60c67fc700 1 -- 172.21.15.17:0/3836509123 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d40d1770 con 0x55bdf8e4f3f0 2023-07-14T13:21:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.169+0000 7f60c67fc700 1 -- 172.21.15.17:0/3836509123 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60d409b090 con 0x55bdf8e4f3f0 2023-07-14T13:21:20.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.169+0000 7f60c67fc700 1 -- 172.21.15.17:0/3836509123 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d409ac20 con 0x55bdf8e4f3f0 2023-07-14T13:21:20.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.170+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3836509123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4f3f0 msgr2=0x55bdf8e536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:20.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.170+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/3836509123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e536e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f60d40cb820 tx=0x7f60d40d6540 comp rx=0 tx=0).stop 2023-07-14T13:21:20.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.170+0000 7f60e4d9c700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c80a1340 0x7f60c80a37f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f60d8007500 tx=0x7f60d800b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.170+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3836509123 shutdown_connections 2023-07-14T13:21:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.170+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/3836509123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e536e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.170+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/3836509123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e4ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.170+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/3836509123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.170+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3836509123 >> 172.21.15.17:0/3836509123 conn(0x55bdf8e3bbe0 msgr2=0x55bdf8e40f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.170+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3836509123 shutdown_connections 2023-07-14T13:21:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.170+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3836509123 wait complete. 2023-07-14T13:21:20.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.171+0000 7f60fa0a7b80 1 -- start start 2023-07-14T13:21:20.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.171+0000 7f60fa0a7b80 1 Processor -- start 2023-07-14T13:21:20.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.172+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e5db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.172+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e5e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.172+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e57d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.172+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8d37a60 con 0x55bdf8e4f3f0 2023-07-14T13:21:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.172+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8d37760 con 0x55bdf8ca26b0 2023-07-14T13:21:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.172+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8c1b8c0 con 0x55bdf8e4ef80 2023-07-14T13:21:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.172+0000 7f60fa0a7b80 10 client.0 _ll_register_callbacks cb 0x55bdf8d35700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:21:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.173+0000 7f60e4d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e57d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.173+0000 7f60e4d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e57d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33446/0 (socket says 172.21.15.17:33446) 2023-07-14T13:21:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.173+0000 7f60e4d9c700 1 -- 172.21.15.17:0/1084814742 learned_addr learned my addr 172.21.15.17:0/1084814742 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.173+0000 7f60df7fe700 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e5e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.173+0000 7f60df7fe700 1 -- 172.21.15.17:0/1084814742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 msgr2=0x55bdf8e5db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.173+0000 7f60df7fe700 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e5db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.173+0000 7f60df7fe700 1 -- 172.21.15.17:0/1084814742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4f3f0 msgr2=0x55bdf8e57d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.174+0000 7f60df7fe700 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e57d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.174+0000 7f60df7fe700 1 -- 172.21.15.17:0/1084814742 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d000e040 con 0x55bdf8e4ef80 2023-07-14T13:21:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.174+0000 7f60e4d9c700 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e57d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:21:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.174+0000 7f60df7fe700 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e5e070 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f60d4005f50 tx=0x7f60d4005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bdde454b9fbee38 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.174+0000 7f60bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:21:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.174+0000 7f60bf7fe700 1 -- 172.21.15.17:0/1084814742 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d40d1770 con 0x55bdf8e4ef80 2023-07-14T13:21:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.174+0000 7f60bf7fe700 1 -- 172.21.15.17:0/1084814742 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f60d40228c0 con 0x55bdf8e4ef80 2023-07-14T13:21:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.174+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/1084814742 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bdf8cf1490 con 0x55bdf8e4ef80 2023-07-14T13:21:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.175+0000 7f60bf7fe700 1 -- 172.21.15.17:0/1084814742 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60d409ac20 con 0x55bdf8e4ef80 2023-07-14T13:21:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.175+0000 7f60fa0a7b80 10 client.28918 fetch_fsmap learned FSMap version 53 2023-07-14T13:21:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.175+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/1084814742 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7f60e01a4e70 con 0x55bdf8e4ef80 2023-07-14T13:21:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.175+0000 7f60bf7fe700 1 -- 172.21.15.17:0/1084814742 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60d40b2080 con 0x55bdf8e4ef80 2023-07-14T13:21:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.175+0000 7f60bf7fe700 1 -- 172.21.15.17:0/1084814742 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f60d40979d0 con 0x55bdf8e4ef80 2023-07-14T13:21:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.175+0000 7f60fa0a7b80 10 client.28918 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:21:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.175+0000 7f60fa0a7b80 10 client.28918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:21:20.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.175+0000 7f60fa0a7b80 20 client.28918 populate_metadata read hostname 'smithi017' 2023-07-14T13:21:20.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.175+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bdf8e67b60 0x55bdf8e69f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.175+0000 7f60fa0a7b80 4 client.28918 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:21:20.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.175+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/1084814742 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bdf8d90e50 con 0x55bdf8e67b60 2023-07-14T13:21:20.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.180+0000 7f60dffff700 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bdf8e67b60 0x55bdf8e69f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.183+0000 7f60dffff700 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bdf8e67b60 0x55bdf8e69f70 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c470c3aefcbe7793 server_cookie=aab5c4895c1fe88b in_seq=0 out_seq=0 2023-07-14T13:21:20.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.183+0000 7f60bf7fe700 10 client.28918 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:20.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.184+0000 7f60bf7fe700 1 -- 172.21.15.17:0/1084814742 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bdf8d90e50 con 0x55bdf8e67b60 2023-07-14T13:21:20.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.184+0000 7f60bf7fe700 10 client.28918 handle_command_reply: tid=0 2023-07-14T13:21:20.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.184+0000 7f60fa0a7b80 1 client.28918 shutdown 2023-07-14T13:21:20.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/1084814742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4ef80 msgr2=0x55bdf8e5e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:20.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e5e070 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f60d4005f50 tx=0x7f60d4005c00 comp rx=0 tx=0).stop 2023-07-14T13:21:20.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/1084814742 shutdown_connections 2023-07-14T13:21:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bdf8e67b60 0x55bdf8e69f70 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e57d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e5db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60bf7fe700 0 client.28918 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/1084814742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e5e070 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/1084814742 >> 172.21.15.17:0/1084814742 conn(0x55bdf8e3bbe0 msgr2=0x55bdf8e404e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/1084814742 shutdown_connections 2023-07-14T13:21:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/1084814742 wait complete. 2023-07-14T13:21:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.185+0000 7f60fa0a7b80 20 client.28918 trim_cache size 0 max 16384 2023-07-14T13:21:20.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.212+0000 7f60fa0a7b80 1 Processor -- start 2023-07-14T13:21:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.213+0000 7f60fa0a7b80 1 -- start start 2023-07-14T13:21:20.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.213+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e559b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.213+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e57d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.213+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e50fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.213+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8e4f9f0 con 0x55bdf8e4f3f0 2023-07-14T13:21:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.213+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8e4f7c0 con 0x55bdf8ca26b0 2023-07-14T13:21:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.213+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8e53d30 con 0x55bdf8e4ef80 2023-07-14T13:21:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.214+0000 7f60dffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.238 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.214+0000 7f60dffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:50172/0 (socket says 172.21.15.17:50172) 2023-07-14T13:21:20.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.214+0000 7f60dffff700 1 -- 172.21.15.17:0/2399168546 learned_addr learned my addr 172.21.15.17:0/2399168546 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:20.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.214+0000 7f60dffff700 1 -- 172.21.15.17:0/2399168546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4ef80 msgr2=0x55bdf8e57d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:21:20.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.214+0000 7f60dffff700 1 --2- 172.21.15.17:0/2399168546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e57d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.214+0000 7f60dffff700 1 -- 172.21.15.17:0/2399168546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4f3f0 msgr2=0x55bdf8e50fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.214+0000 7f60dffff700 1 --2- 172.21.15.17:0/2399168546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e50fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.214+0000 7f60dffff700 1 -- 172.21.15.17:0/2399168546 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdf8baec00 con 0x55bdf8ca26b0 2023-07-14T13:21:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.215+0000 7f60dffff700 1 --2- 172.21.15.17:0/2399168546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e559b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f60d00070f0 tx=0x7f60d0007d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ffb5c7a7efc1f6d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.216+0000 7f60c6ffd700 1 -- 172.21.15.17:0/2399168546 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0015780 con 0x55bdf8ca26b0 2023-07-14T13:21:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.216+0000 7f60c6ffd700 1 -- 172.21.15.17:0/2399168546 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60d001d070 con 0x55bdf8ca26b0 2023-07-14T13:21:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.216+0000 7f60c6ffd700 1 -- 172.21.15.17:0/2399168546 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0021b60 con 0x55bdf8ca26b0 2023-07-14T13:21:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.217+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/2399168546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 msgr2=0x55bdf8e559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.217+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/2399168546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e559b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f60d00070f0 tx=0x7f60d0007d00 comp rx=0 tx=0).stop 2023-07-14T13:21:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.217+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/2399168546 shutdown_connections 2023-07-14T13:21:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.217+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/2399168546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e50fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.217+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/2399168546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e559b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.217+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/2399168546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e57d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.217+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/2399168546 >> 172.21.15.17:0/2399168546 conn(0x55bdf8e3bbe0 msgr2=0x55bdf8e57620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.217+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/2399168546 shutdown_connections 2023-07-14T13:21:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.218+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/2399168546 wait complete. 2023-07-14T13:21:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.218+0000 7f60fa0a7b80 1 -- start start 2023-07-14T13:21:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.219+0000 7f60fa0a7b80 1 Processor -- start 2023-07-14T13:21:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.221+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e60a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.221+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e60f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.221+0000 7f60fa0a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e63b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.221+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8e64060 con 0x55bdf8e4ef80 2023-07-14T13:21:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.221+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8e641d0 con 0x55bdf8e4f3f0 2023-07-14T13:21:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.221+0000 7f60fa0a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf8e64390 con 0x55bdf8ca26b0 2023-07-14T13:21:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.221+0000 7f60fa0a7b80 10 client.0 _ll_register_callbacks cb 0x7f60d00071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:21:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.222+0000 7f60dffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e60a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.222+0000 7f60dffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e60a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:38748/0 (socket says 172.21.15.17:38748) 2023-07-14T13:21:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.222+0000 7f60dffff700 1 -- 172.21.15.17:0/3455774006 learned_addr learned my addr 172.21.15.17:0/3455774006 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.222+0000 7f60df7fe700 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e60f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.222+0000 7f60dffff700 1 -- 172.21.15.17:0/3455774006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8e4f3f0 msgr2=0x55bdf8e63b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:21:20.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.222+0000 7f60dffff700 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e63b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.222+0000 7f60dffff700 1 -- 172.21.15.17:0/3455774006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 msgr2=0x55bdf8e60f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.222+0000 7f60dffff700 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e60f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.222+0000 7f60dffff700 1 -- 172.21.15.17:0/3455774006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d0007610 con 0x55bdf8ca26b0 2023-07-14T13:21:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.223+0000 7f60df7fe700 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e60f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:21:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.223+0000 7f60dffff700 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e60a50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f60d00077c0 tx=0x7f60d0015830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c087f97c3bfbe7d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.223+0000 7f60bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:21:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.223+0000 7f60bf7fe700 1 -- 172.21.15.17:0/3455774006 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0015c60 con 0x55bdf8ca26b0 2023-07-14T13:21:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.223+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3455774006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60d409b090 con 0x55bdf8ca26b0 2023-07-14T13:21:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.223+0000 7f60bf7fe700 1 -- 172.21.15.17:0/3455774006 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f60d0015dc0 con 0x55bdf8ca26b0 2023-07-14T13:21:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.224+0000 7f60bf7fe700 1 -- 172.21.15.17:0/3455774006 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60d0021740 con 0x55bdf8ca26b0 2023-07-14T13:21:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.224+0000 7f60fa0a7b80 10 client.28921 fetch_fsmap learned FSMap version 53 2023-07-14T13:21:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.224+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3455774006 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55bdf8bec1f0 con 0x55bdf8ca26b0 2023-07-14T13:21:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.224+0000 7f60bf7fe700 1 -- 172.21.15.17:0/3455774006 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60d0037020 con 0x55bdf8ca26b0 2023-07-14T13:21:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.224+0000 7f60bf7fe700 1 -- 172.21.15.17:0/3455774006 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f60d0022a40 con 0x55bdf8ca26b0 2023-07-14T13:21:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.225+0000 7f60fa0a7b80 10 client.28921 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:21:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.225+0000 7f60fa0a7b80 10 client.28921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:21:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.225+0000 7f60fa0a7b80 20 client.28921 populate_metadata read hostname 'smithi017' 2023-07-14T13:21:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.225+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bdf8ebc000 0x55bdf8ebe410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.225+0000 7f60fa0a7b80 4 client.28921 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:21:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.225+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3455774006 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bdf8d52ff0 con 0x55bdf8ebc000 2023-07-14T13:21:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.225+0000 7f60df7fe700 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bdf8ebc000 0x55bdf8ebe410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.226+0000 7f60df7fe700 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bdf8ebc000 0x55bdf8ebe410 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ec3dc2fbe4bae17 server_cookie=a64677bc1fa68817 in_seq=0 out_seq=0 2023-07-14T13:21:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.226+0000 7f60bf7fe700 10 client.28921 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.261+0000 7f60bf7fe700 1 -- 172.21.15.17:0/3455774006 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bdf8d52ff0 con 0x55bdf8ebc000 2023-07-14T13:21:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.261+0000 7f60bf7fe700 10 client.28921 handle_command_reply: tid=0 2023-07-14T13:21:20.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.261+0000 7f60fa0a7b80 1 client.28921 shutdown 2023-07-14T13:21:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.263+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3455774006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8ca26b0 msgr2=0x55bdf8e60a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.263+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e60a50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f60d00077c0 tx=0x7f60d0015830 comp rx=0 tx=0).stop 2023-07-14T13:21:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.263+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3455774006 shutdown_connections 2023-07-14T13:21:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.263+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55bdf8ebc000 0x55bdf8ebe410 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.263+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bdf8e4f3f0 0x55bdf8e63b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.263+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdf8ca26b0 0x55bdf8e60a50 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.263+0000 7f60fa0a7b80 1 --2- 172.21.15.17:0/3455774006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55bdf8e4ef80 0x55bdf8e60f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.263+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3455774006 >> 172.21.15.17:0/3455774006 conn(0x55bdf8e3bbe0 msgr2=0x55bdf8e54750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.263+0000 7f60bf7fe700 0 client.28921 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:20.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.263+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3455774006 shutdown_connections 2023-07-14T13:21:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.263+0000 7f60fa0a7b80 1 -- 172.21.15.17:0/3455774006 wait complete. 2023-07-14T13:21:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.264+0000 7f60fa0a7b80 20 client.28921 trim_cache size 0 max 16384 2023-07-14T13:21:20.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:21:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:21:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:21:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:21:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.265+0000 7f60e67ff700 1 -- 172.21.15.17:0/3692881896 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c80a1340 msgr2=0x7f60c80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:20.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.265+0000 7f60e67ff700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c80a1340 0x7f60c80a37f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f60d8007500 tx=0x7f60d800b040 comp rx=0 tx=0).stop 2023-07-14T13:21:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.265+0000 7f60e67ff700 1 -- 172.21.15.17:0/3692881896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60e01004b0 msgr2=0x7f60e01983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.265+0000 7f60e67ff700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60e01004b0 0x7f60e01983c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f60d4000c00 tx=0x7f60d4004730 comp rx=0 tx=0).stop 2023-07-14T13:21:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.265+0000 7f60e67ff700 1 -- 172.21.15.17:0/3692881896 shutdown_connections 2023-07-14T13:21:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.265+0000 7f60e67ff700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c80a1340 0x7f60c80a37f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.265+0000 7f60e67ff700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60e0105b10 0x7f60e019c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.265+0000 7f60e67ff700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60e00ffb00 0x7f60e0197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.265+0000 7f60e67ff700 1 --2- 172.21.15.17:0/3692881896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60e01004b0 0x7f60e01983c0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.265+0000 7f60e67ff700 1 -- 172.21.15.17:0/3692881896 >> 172.21.15.17:0/3692881896 conn(0x7f60e00fb600 msgr2=0x7f60e010aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:20.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.268+0000 7f60e67ff700 1 -- 172.21.15.17:0/3692881896 shutdown_connections 2023-07-14T13:21:20.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:20.269+0000 7f60e67ff700 1 -- 172.21.15.17:0/3692881896 wait complete. 2023-07-14T13:21:21.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:21 smithi135 ceph-mon[97338]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 18 MiB/s wr, 1.45k op/s 2023-07-14T13:21:21.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:21 smithi131 ceph-mon[96953]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 18 MiB/s wr, 1.45k op/s 2023-07-14T13:21:21.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:21 smithi017 ceph-mon[95536]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 18 MiB/s wr, 1.45k op/s 2023-07-14T13:21:22.442 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 190.0 s, 515.5 tps, lat 169.514 ms stddev 94.020 2023-07-14T13:21:23.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:23 smithi135 ceph-mon[97338]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 16 MiB/s wr, 1.33k op/s 2023-07-14T13:21:23.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:23 smithi131 ceph-mon[96953]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 16 MiB/s wr, 1.33k op/s 2023-07-14T13:21:23.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:23 smithi017 ceph-mon[95536]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 16 MiB/s wr, 1.33k op/s 2023-07-14T13:21:24.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:24 smithi017 ceph-mon[95536]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 15 MiB/s wr, 1.21k op/s 2023-07-14T13:21:24.941 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:24 smithi135 ceph-mon[97338]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 15 MiB/s wr, 1.21k op/s 2023-07-14T13:21:24.990 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:24 smithi131 ceph-mon[96953]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 15 MiB/s wr, 1.21k op/s 2023-07-14T13:21:27.442 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 195.0 s, 699.8 tps, lat 161.794 ms stddev 660.982 2023-07-14T13:21:27.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:27 smithi017 ceph-mon[95536]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 23 MiB/s wr, 1.89k op/s 2023-07-14T13:21:27.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:27 smithi135 ceph-mon[97338]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 23 MiB/s wr, 1.89k op/s 2023-07-14T13:21:27.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:27 smithi131 ceph-mon[96953]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 23 MiB/s wr, 1.89k op/s 2023-07-14T13:21:29.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:29 smithi017 ceph-mon[95536]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.33k op/s 2023-07-14T13:21:29.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:29 smithi135 ceph-mon[97338]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.33k op/s 2023-07-14T13:21:29.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:29 smithi131 ceph-mon[96953]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 16 MiB/s wr, 1.33k op/s 2023-07-14T13:21:31.599 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:31 smithi017 ceph-mon[95536]: pgmap v688: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 24 MiB/s wr, 1.92k op/s 2023-07-14T13:21:31.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:31 smithi135 ceph-mon[97338]: pgmap v688: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 24 MiB/s wr, 1.92k op/s 2023-07-14T13:21:31.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:31 smithi131 ceph-mon[96953]: pgmap v688: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 24 MiB/s wr, 1.92k op/s 2023-07-14T13:21:32.442 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 200.0 s, 639.7 tps, lat 155.121 ms stddev 38.353 2023-07-14T13:21:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.521+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3469233458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3406d3a0 msgr2=0x7fea3411b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.521+0000 7fea3b7ff700 1 --2- 172.21.15.17:0/3469233458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3406d3a0 0x7fea3411b470 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fea3000b0a0 tx=0x7fea3000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.522+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3469233458 shutdown_connections 2023-07-14T13:21:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.522+0000 7fea3b7ff700 1 --2- 172.21.15.17:0/3469233458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3406d3a0 0x7fea3411b470 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.522+0000 7fea3b7ff700 1 --2- 172.21.15.17:0/3469233458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea3410e2a0 0x7fea3410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.522+0000 7fea3b7ff700 1 --2- 172.21.15.17:0/3469233458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea3406c910 0x7fea3406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.522+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3469233458 >> 172.21.15.17:0/3469233458 conn(0x7fea3406bd70 msgr2=0x7fea34070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.522+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3469233458 shutdown_connections 2023-07-14T13:21:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.522+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3469233458 wait complete. 2023-07-14T13:21:33.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.523+0000 7fea3b7ff700 1 Processor -- start 2023-07-14T13:21:33.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.524+0000 7fea3b7ff700 1 -- start start 2023-07-14T13:21:33.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.524+0000 7fea3b7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3406c910 0x7fea341aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.524+0000 7fea3b7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea3406d3a0 0x7fea341ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.524+0000 7fea3b7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea3410e2a0 0x7fea341a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.524+0000 7fea3b7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea341a5010 con 0x7fea3410e2a0 2023-07-14T13:21:33.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.524+0000 7fea3b7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea341a5180 con 0x7fea3406d3a0 2023-07-14T13:21:33.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.524+0000 7fea3b7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea341a5340 con 0x7fea3406c910 2023-07-14T13:21:33.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.525+0000 7fea38d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea3406d3a0 0x7fea341ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.525+0000 7fea38d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea3406d3a0 0x7fea341ab080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:42494/0 (socket says 172.21.15.17:42494) 2023-07-14T13:21:33.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.525+0000 7fea38d9a700 1 -- 172.21.15.17:0/3773207582 learned_addr learned my addr 172.21.15.17:0/3773207582 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:33.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.525+0000 7fea39d9c700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea3410e2a0 0x7fea341a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.526+0000 7fea39d9c700 1 -- 172.21.15.17:0/3773207582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3406c910 msgr2=0x7fea341aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.526+0000 7fea39d9c700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3406c910 0x7fea341aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.526+0000 7fea39d9c700 1 -- 172.21.15.17:0/3773207582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea3406d3a0 msgr2=0x7fea341ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.526+0000 7fea39d9c700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea3406d3a0 0x7fea341ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.526+0000 7fea39d9c700 1 -- 172.21.15.17:0/3773207582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30009d00 con 0x7fea3410e2a0 2023-07-14T13:21:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.526+0000 7fea39d9c700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea3410e2a0 0x7fea341a49a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fea3000b0a0 tx=0x7fea30008ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.526+0000 7fea2a7fc700 1 -- 172.21.15.17:0/3773207582 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000e040 con 0x7fea3410e2a0 2023-07-14T13:21:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.526+0000 7fea2a7fc700 1 -- 172.21.15.17:0/3773207582 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea3000be40 con 0x7fea3410e2a0 2023-07-14T13:21:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.526+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3773207582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea341a55c0 con 0x7fea3410e2a0 2023-07-14T13:21:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.526+0000 7fea2a7fc700 1 -- 172.21.15.17:0/3773207582 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30005040 con 0x7fea3410e2a0 2023-07-14T13:21:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.527+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3773207582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea341b1b30 con 0x7fea3410e2a0 2023-07-14T13:21:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.533+0000 7fea4f03bb80 1 Processor -- start 2023-07-14T13:21:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.533+0000 7fea2a7fc700 1 -- 172.21.15.17:0/3773207582 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fea3001d470 con 0x7fea3410e2a0 2023-07-14T13:21:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.534+0000 7fea4f03bb80 1 -- start start 2023-07-14T13:21:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.534+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c9362d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.534+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c93632d0 0x55c2c935d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.534+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c935d580 0x55c2c935d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.534+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c9262c50 con 0x55c2c91b96b0 2023-07-14T13:21:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.534+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c92b59e0 con 0x55c2c93632d0 2023-07-14T13:21:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.534+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c92aee70 con 0x55c2c935d580 2023-07-14T13:21:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.535+0000 7fea3959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c93632d0 0x55c2c935d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.535+0000 7fea3959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c93632d0 0x55c2c935d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:42496/0 (socket says 172.21.15.17:42496) 2023-07-14T13:21:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.535+0000 7fea3959b700 1 -- 172.21.15.17:0/732899948 learned_addr learned my addr 172.21.15.17:0/732899948 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.535+0000 7fea38d9a700 1 --2- 172.21.15.17:0/732899948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c9362d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.535+0000 7fea38d9a700 1 --2- 172.21.15.17:0/732899948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c935d580 0x55c2c935d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.536+0000 7fea3959b700 1 -- 172.21.15.17:0/732899948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c935d580 msgr2=0x55c2c935d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.536+0000 7fea3959b700 1 --2- 172.21.15.17:0/732899948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c935d580 0x55c2c935d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.536+0000 7fea3959b700 1 -- 172.21.15.17:0/732899948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 msgr2=0x55c2c9362d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.536+0000 7fea3959b700 1 --2- 172.21.15.17:0/732899948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c9362d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.536+0000 7fea3959b700 1 -- 172.21.15.17:0/732899948 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2c90dcd80 con 0x55c2c93632d0 2023-07-14T13:21:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.536+0000 7fea38d9a700 1 --2- 172.21.15.17:0/732899948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c935d580 0x55c2c935d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:21:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.536+0000 7fea3959b700 1 --2- 172.21.15.17:0/732899948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c93632d0 0x55c2c935d040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fea2400bb10 tx=0x7fea2400be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da983d2b9752a36f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.537+0000 7fea2a7fc700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fea200a13c0 0x7fea200a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.537+0000 7fea2a7fc700 1 -- 172.21.15.17:0/3773207582 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fea300ce000 con 0x7fea3410e2a0 2023-07-14T13:21:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.537+0000 7fea1f7fe700 1 -- 172.21.15.17:0/732899948 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2400da90 con 0x55c2c93632d0 2023-07-14T13:21:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.537+0000 7fea1f7fe700 1 -- 172.21.15.17:0/732899948 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea24004cc0 con 0x55c2c93632d0 2023-07-14T13:21:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.537+0000 7fea1f7fe700 1 -- 172.21.15.17:0/732899948 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24005570 con 0x55c2c93632d0 2023-07-14T13:21:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.538+0000 7fea38d9a700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fea200a13c0 0x7fea200a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.538+0000 7fea4f03bb80 1 -- 172.21.15.17:0/732899948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c93632d0 msgr2=0x55c2c935d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.538+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/732899948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c93632d0 0x55c2c935d040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fea2400bb10 tx=0x7fea2400be20 comp rx=0 tx=0).stop 2023-07-14T13:21:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.539+0000 7fea4f03bb80 1 -- 172.21.15.17:0/732899948 shutdown_connections 2023-07-14T13:21:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.539+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/732899948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c935d580 0x55c2c935d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.539+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/732899948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c9362d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.539+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/732899948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c93632d0 0x55c2c935d040 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.539+0000 7fea4f03bb80 1 -- 172.21.15.17:0/732899948 >> 172.21.15.17:0/732899948 conn(0x55c2c9352be0 msgr2=0x55c2c9357f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.539+0000 7fea4f03bb80 1 -- 172.21.15.17:0/732899948 shutdown_connections 2023-07-14T13:21:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.539+0000 7fea4f03bb80 1 -- 172.21.15.17:0/732899948 wait complete. 2023-07-14T13:21:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.539+0000 7fea38d9a700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fea200a13c0 0x7fea200a3870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0096b0 tx=0x7fea2c0095c0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.540+0000 7fea4f03bb80 1 -- start start 2023-07-14T13:21:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.540+0000 7fea4f03bb80 1 Processor -- start 2023-07-14T13:21:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.541+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c91b96b0 0x55c2c9366920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.541+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c935d580 0x55c2c9366e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.541+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93673a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.541+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c924ea60 con 0x55c2c935d580 2023-07-14T13:21:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.541+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c924e760 con 0x55c2c91b96b0 2023-07-14T13:21:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.541+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c91328c0 con 0x55c2c93632d0 2023-07-14T13:21:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.541+0000 7fea4f03bb80 10 client.0 _ll_register_callbacks cb 0x55c2c924c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:21:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.542+0000 7fea3959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c91b96b0 0x55c2c9366920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.542+0000 7fea3959b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c91b96b0 0x55c2c9366920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:42498/0 (socket says 172.21.15.17:42498) 2023-07-14T13:21:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.542+0000 7fea3959b700 1 -- 172.21.15.17:0/1791114011 learned_addr learned my addr 172.21.15.17:0/1791114011 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.542+0000 7fea39d9c700 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.542+0000 7fea3959b700 1 -- 172.21.15.17:0/1791114011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 msgr2=0x55c2c93673a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.542+0000 7fea3959b700 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93673a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.542+0000 7fea3959b700 1 -- 172.21.15.17:0/1791114011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c935d580 msgr2=0x55c2c9366e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.542+0000 7fea3959b700 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c935d580 0x55c2c9366e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.542+0000 7fea3959b700 1 -- 172.21.15.17:0/1791114011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2400b740 con 0x55c2c91b96b0 2023-07-14T13:21:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.542+0000 7fea3959b700 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c91b96b0 0x55c2c9366920 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fea24004a40 tx=0x7fea24004b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=260e8a6d710ab67d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.542+0000 7fea1cff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:21:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.543+0000 7fea1cff9700 1 -- 172.21.15.17:0/1791114011 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2400dca0 con 0x55c2c91b96b0 2023-07-14T13:21:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.543+0000 7fea1cff9700 1 -- 172.21.15.17:0/1791114011 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fea24005150 con 0x55c2c91b96b0 2023-07-14T13:21:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.543+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1791114011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2c9208490 con 0x55c2c91b96b0 2023-07-14T13:21:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.544+0000 7fea1cff9700 1 -- 172.21.15.17:0/1791114011 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea24005310 con 0x55c2c91b96b0 2023-07-14T13:21:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.544+0000 7fea4f03bb80 10 client.28973 fetch_fsmap learned FSMap version 53 2023-07-14T13:21:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.544+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1791114011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55c2c90c5c00 con 0x55c2c91b96b0 2023-07-14T13:21:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.544+0000 7fea1cff9700 1 -- 172.21.15.17:0/1791114011 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c2c9208490 con 0x55c2c91b96b0 2023-07-14T13:21:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.544+0000 7fea1cff9700 1 -- 172.21.15.17:0/1791114011 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fea2402eb60 con 0x55c2c91b96b0 2023-07-14T13:21:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.545+0000 7fea4f03bb80 10 client.28973 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:21:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.545+0000 7fea4f03bb80 10 client.28973 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:21:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.545+0000 7fea4f03bb80 20 client.28973 populate_metadata read hostname 'smithi017' 2023-07-14T13:21:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.545+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2c9376aa0 0x55c2c9378eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.545+0000 7fea4f03bb80 4 client.28973 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:21:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.545+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1791114011 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2c92a7e50 con 0x55c2c9376aa0 2023-07-14T13:21:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.545+0000 7fea38d9a700 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2c9376aa0 0x55c2c9378eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.548+0000 7fea38d9a700 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2c9376aa0 0x55c2c9378eb0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f78ba14781e80539 server_cookie=e213f4d1900fb318 in_seq=0 out_seq=0 2023-07-14T13:21:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.548+0000 7fea1cff9700 10 client.28973 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.548+0000 7fea1cff9700 1 -- 172.21.15.17:0/1791114011 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c2c92a7e50 con 0x55c2c9376aa0 2023-07-14T13:21:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.548+0000 7fea1cff9700 10 client.28973 handle_command_reply: tid=0 2023-07-14T13:21:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.548+0000 7fea4f03bb80 1 client.28973 shutdown 2023-07-14T13:21:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.551+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1791114011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c91b96b0 msgr2=0x55c2c9366920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.551+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c91b96b0 0x55c2c9366920 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fea24004a40 tx=0x7fea24004b20 comp rx=0 tx=0).stop 2023-07-14T13:21:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.552+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1791114011 shutdown_connections 2023-07-14T13:21:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.552+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2c9376aa0 0x55c2c9378eb0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.552+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93673a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.552+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c91b96b0 0x55c2c9366920 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.552+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1791114011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c935d580 0x55c2c9366e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.552+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1791114011 >> 172.21.15.17:0/1791114011 conn(0x55c2c9352be0 msgr2=0x55c2c93574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.552+0000 7fea1cff9700 0 client.28973 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.552+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1791114011 shutdown_connections 2023-07-14T13:21:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.552+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1791114011 wait complete. 2023-07-14T13:21:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.553+0000 7fea4f03bb80 20 client.28973 trim_cache size 0 max 16384 2023-07-14T13:21:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.583+0000 7fea4f03bb80 1 Processor -- start 2023-07-14T13:21:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.583+0000 7fea4f03bb80 1 -- start start 2023-07-14T13:21:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.584+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c935d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.584+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c935d580 0x55c2c936dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.584+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93671d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.584+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c9354d20 con 0x55c2c91b96b0 2023-07-14T13:21:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.584+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c93636a0 con 0x55c2c935d580 2023-07-14T13:21:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.584+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c934fbd0 con 0x55c2c93632d0 2023-07-14T13:21:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.585+0000 7fea39d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.585+0000 7fea39d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93671d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35960/0 (socket says 172.21.15.17:35960) 2023-07-14T13:21:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.585+0000 7fea39d9c700 1 -- 172.21.15.17:0/2864949884 learned_addr learned my addr 172.21.15.17:0/2864949884 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.585+0000 7fea3959b700 1 --2- 172.21.15.17:0/2864949884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c935d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.585+0000 7fea38d9a700 1 --2- 172.21.15.17:0/2864949884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c935d580 0x55c2c936dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.586+0000 7fea39d9c700 1 -- 172.21.15.17:0/2864949884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c935d580 msgr2=0x55c2c936dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.586+0000 7fea39d9c700 1 --2- 172.21.15.17:0/2864949884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c935d580 0x55c2c936dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.586+0000 7fea39d9c700 1 -- 172.21.15.17:0/2864949884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 msgr2=0x55c2c935d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.586+0000 7fea39d9c700 1 --2- 172.21.15.17:0/2864949884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c935d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.586+0000 7fea39d9c700 1 -- 172.21.15.17:0/2864949884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2c937dae0 con 0x55c2c93632d0 2023-07-14T13:21:33.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.586+0000 7fea3959b700 1 --2- 172.21.15.17:0/2864949884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c935d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:21:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.586+0000 7fea39d9c700 1 --2- 172.21.15.17:0/2864949884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93671d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fea30097620 tx=0x7fea3009aef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8333d2f7724174 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.587+0000 7fea1ffff700 1 -- 172.21.15.17:0/2864949884 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3009b120 con 0x55c2c93632d0 2023-07-14T13:21:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.587+0000 7fea1ffff700 1 -- 172.21.15.17:0/2864949884 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea3009f150 con 0x55c2c93632d0 2023-07-14T13:21:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.587+0000 7fea1ffff700 1 -- 172.21.15.17:0/2864949884 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea300979c0 con 0x55c2c93632d0 2023-07-14T13:21:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.588+0000 7fea4f03bb80 1 -- 172.21.15.17:0/2864949884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 msgr2=0x55c2c93671d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.588+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/2864949884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93671d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fea30097620 tx=0x7fea3009aef0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.590+0000 7fea4f03bb80 1 -- 172.21.15.17:0/2864949884 shutdown_connections 2023-07-14T13:21:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.590+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/2864949884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93671d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.590+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/2864949884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c935d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.590+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/2864949884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c935d580 0x55c2c936dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.590+0000 7fea4f03bb80 1 -- 172.21.15.17:0/2864949884 >> 172.21.15.17:0/2864949884 conn(0x55c2c9352be0 msgr2=0x55c2c9361b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.591+0000 7fea4f03bb80 1 -- 172.21.15.17:0/2864949884 shutdown_connections 2023-07-14T13:21:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.591+0000 7fea4f03bb80 1 -- 172.21.15.17:0/2864949884 wait complete. 2023-07-14T13:21:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.591+0000 7fea4f03bb80 1 -- start start 2023-07-14T13:21:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.592+0000 7fea4f03bb80 1 Processor -- start 2023-07-14T13:21:33.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.592+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c93c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.592+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c935d580 0x55c2c93c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.593+0000 7fea4f03bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93c2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.593+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c93c4700 con 0x55c2c91b96b0 2023-07-14T13:21:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.593+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c93c2e50 con 0x55c2c935d580 2023-07-14T13:21:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.593+0000 7fea4f03bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2c93c3010 con 0x55c2c93632d0 2023-07-14T13:21:33.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.593+0000 7fea4f03bb80 10 client.0 _ll_register_callbacks cb 0x7fea2400b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:21:33.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.593+0000 7fea3959b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c93c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.593+0000 7fea3959b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c93c3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60446/0 (socket says 172.21.15.17:60446) 2023-07-14T13:21:33.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.593+0000 7fea3959b700 1 -- 172.21.15.17:0/1896670050 learned_addr learned my addr 172.21.15.17:0/1896670050 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:33.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.594+0000 7fea38d9a700 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c935d580 0x55c2c93c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.594+0000 7fea39d9c700 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.594+0000 7fea3959b700 1 -- 172.21.15.17:0/1896670050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 msgr2=0x55c2c93c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.594+0000 7fea3959b700 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.594+0000 7fea3959b700 1 -- 172.21.15.17:0/1896670050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c935d580 msgr2=0x55c2c93c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.594+0000 7fea3959b700 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c935d580 0x55c2c93c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.594+0000 7fea3959b700 1 -- 172.21.15.17:0/1896670050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2c90c5c00 con 0x55c2c91b96b0 2023-07-14T13:21:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.595+0000 7fea3959b700 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c93c3bb0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fea24004c60 tx=0x7fea240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f61713b4f2ef5e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.595+0000 7fea1cff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:21:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.596+0000 7fea1cff9700 1 -- 172.21.15.17:0/1896670050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24005ee0 con 0x55c2c91b96b0 2023-07-14T13:21:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.596+0000 7fea1cff9700 1 -- 172.21.15.17:0/1896670050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fea24000e40 con 0x55c2c91b96b0 2023-07-14T13:21:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.596+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1896670050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea24004cc0 con 0x55c2c91b96b0 2023-07-14T13:21:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.596+0000 7fea1cff9700 1 -- 172.21.15.17:0/1896670050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea24010600 con 0x55c2c91b96b0 2023-07-14T13:21:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.596+0000 7fea4f03bb80 10 client.19215 fetch_fsmap learned FSMap version 53 2023-07-14T13:21:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.596+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1896670050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7fea341b1b30 con 0x55c2c91b96b0 2023-07-14T13:21:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.597+0000 7fea1cff9700 1 -- 172.21.15.17:0/1896670050 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea24004cc0 con 0x55c2c91b96b0 2023-07-14T13:21:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.597+0000 7fea1cff9700 1 -- 172.21.15.17:0/1896670050 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fea240037e0 con 0x55c2c91b96b0 2023-07-14T13:21:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.597+0000 7fea4f03bb80 10 client.19215 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:21:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.597+0000 7fea4f03bb80 10 client.19215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:21:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.597+0000 7fea4f03bb80 20 client.19215 populate_metadata read hostname 'smithi017' 2023-07-14T13:21:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.597+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2c93dc3e0 0x55c2c93de7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.597+0000 7fea4f03bb80 4 client.19215 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:21:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.597+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1896670050 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c2c9269ff0 con 0x55c2c93dc3e0 2023-07-14T13:21:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.598+0000 7fea38d9a700 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2c93dc3e0 0x55c2c93de7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.599+0000 7fea38d9a700 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2c93dc3e0 0x55c2c93de7f0 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=552382e5c840e66a server_cookie=5bef5fb0912aa111 in_seq=0 out_seq=0 2023-07-14T13:21:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.600+0000 7fea1cff9700 10 client.19215 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.624+0000 7fea1cff9700 1 -- 172.21.15.17:0/1896670050 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c2c9269ff0 con 0x55c2c93dc3e0 2023-07-14T13:21:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.624+0000 7fea1cff9700 10 client.19215 handle_command_reply: tid=0 2023-07-14T13:21:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.624+0000 7fea4f03bb80 1 client.19215 shutdown 2023-07-14T13:21:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.624+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1896670050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 msgr2=0x55c2c93c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.624+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c93c3bb0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fea24004c60 tx=0x7fea240042f0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.624+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1896670050 shutdown_connections 2023-07-14T13:21:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.624+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c2c93dc3e0 0x55c2c93de7f0 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.624+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2c93632d0 0x55c2c93c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.624+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c2c91b96b0 0x55c2c93c3bb0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.624+0000 7fea4f03bb80 1 --2- 172.21.15.17:0/1896670050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c2c935d580 0x55c2c93c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.624+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1896670050 >> 172.21.15.17:0/1896670050 conn(0x55c2c9352be0 msgr2=0x55c2c9365960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.625+0000 7fea1cff9700 0 client.19215 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.625+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1896670050 shutdown_connections 2023-07-14T13:21:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.625+0000 7fea4f03bb80 1 -- 172.21.15.17:0/1896670050 wait complete. 2023-07-14T13:21:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.625+0000 7fea4f03bb80 20 client.19215 trim_cache size 0 max 16384 2023-07-14T13:21:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:21:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:21:33.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:21:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:21:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.626+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3773207582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fea200a13c0 msgr2=0x7fea200a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.626+0000 7fea3b7ff700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fea200a13c0 0x7fea200a3870 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0096b0 tx=0x7fea2c0095c0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.626+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3773207582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea3410e2a0 msgr2=0x7fea341a49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.626+0000 7fea3b7ff700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea3410e2a0 0x7fea341a49a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fea3000b0a0 tx=0x7fea30008ea0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.627+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3773207582 shutdown_connections 2023-07-14T13:21:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.627+0000 7fea3b7ff700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fea200a13c0 0x7fea200a3870 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.627+0000 7fea3b7ff700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea3410e2a0 0x7fea341a49a0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.627+0000 7fea3b7ff700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3406c910 0x7fea341aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.627+0000 7fea3b7ff700 1 --2- 172.21.15.17:0/3773207582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea3406d3a0 0x7fea341ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:33.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.627+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3773207582 >> 172.21.15.17:0/3773207582 conn(0x7fea3406bd70 msgr2=0x7fea34070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:33.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.627+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3773207582 shutdown_connections 2023-07-14T13:21:33.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:33.627+0000 7fea3b7ff700 1 -- 172.21.15.17:0/3773207582 wait complete. 2023-07-14T13:21:33.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:33 smithi135 ceph-mon[97338]: pgmap v689: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:33.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:33 smithi131 ceph-mon[96953]: pgmap v689: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:33.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:33 smithi017 ceph-mon[95536]: pgmap v689: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:35.691 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:35 smithi135 ceph-mon[97338]: pgmap v690: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:35.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:35 smithi131 ceph-mon[96953]: pgmap v690: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:35.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:35 smithi017 ceph-mon[95536]: pgmap v690: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:37.442 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 205.0 s, 624.9 tps, lat 160.517 ms stddev 35.258 2023-07-14T13:21:37.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:37 smithi135 ceph-mon[97338]: pgmap v691: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 24 MiB/s wr, 1.89k op/s 2023-07-14T13:21:37.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:37 smithi131 ceph-mon[96953]: pgmap v691: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 24 MiB/s wr, 1.89k op/s 2023-07-14T13:21:37.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:37 smithi017 ceph-mon[95536]: pgmap v691: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 24 MiB/s wr, 1.89k op/s 2023-07-14T13:21:39.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:39 smithi135 ceph-mon[97338]: pgmap v692: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.20k op/s 2023-07-14T13:21:39.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:39 smithi131 ceph-mon[96953]: pgmap v692: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.20k op/s 2023-07-14T13:21:39.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:39 smithi017 ceph-mon[95536]: pgmap v692: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 16 MiB/s wr, 1.20k op/s 2023-07-14T13:21:41.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:41 smithi135 ceph-mon[97338]: pgmap v693: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 23 MiB/s wr, 1.84k op/s 2023-07-14T13:21:41.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:41 smithi131 ceph-mon[96953]: pgmap v693: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 23 MiB/s wr, 1.84k op/s 2023-07-14T13:21:41.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:41 smithi017 ceph-mon[95536]: pgmap v693: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 23 MiB/s wr, 1.84k op/s 2023-07-14T13:21:42.441 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 210.0 s, 436.8 tps, lat 222.281 ms stddev 263.199 2023-07-14T13:21:43.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:43 smithi135 ceph-mon[97338]: pgmap v694: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:43.740 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:43 smithi131 ceph-mon[96953]: pgmap v694: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:43.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:43 smithi017 ceph-mon[95536]: pgmap v694: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:45.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:45 smithi135 ceph-mon[97338]: pgmap v695: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:45.738 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:45 smithi131 ceph-mon[96953]: pgmap v695: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:45.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:45 smithi017 ceph-mon[95536]: pgmap v695: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-14T13:21:46.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:46 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:21:46.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:46 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:46.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:46 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:46.738 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:46 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:21:46.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:46 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:46.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:46 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:46.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:46 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:21:46.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:46 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:46.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:46 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.904+0000 7f682a3ff700 1 -- 172.21.15.17:0/3115430996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f682406c910 msgr2=0x7f682406cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.904+0000 7f682a3ff700 1 --2- 172.21.15.17:0/3115430996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f682406c910 0x7f682406cd80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6818009990 tx=0x7f6818009ca0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.904+0000 7f682a3ff700 1 -- 172.21.15.17:0/3115430996 shutdown_connections 2023-07-14T13:21:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.904+0000 7f682a3ff700 1 --2- 172.21.15.17:0/3115430996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f682406d3a0 0x7f682411b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.904+0000 7f682a3ff700 1 --2- 172.21.15.17:0/3115430996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f682410e2a0 0x7f682410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.904+0000 7f682a3ff700 1 --2- 172.21.15.17:0/3115430996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f682406c910 0x7f682406cd80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.904+0000 7f682a3ff700 1 -- 172.21.15.17:0/3115430996 >> 172.21.15.17:0/3115430996 conn(0x7f682406bd70 msgr2=0x7f6824070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.904+0000 7f682a3ff700 1 -- 172.21.15.17:0/3115430996 shutdown_connections 2023-07-14T13:21:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.904+0000 7f682a3ff700 1 -- 172.21.15.17:0/3115430996 wait complete. 2023-07-14T13:21:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.906+0000 7f682a3ff700 1 Processor -- start 2023-07-14T13:21:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.906+0000 7f682a3ff700 1 -- start start 2023-07-14T13:21:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.907+0000 7f682a3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f682406c910 0x7f682411ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.907+0000 7f682a3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f682406d3a0 0x7f682411b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.907+0000 7f682a3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f682410e2a0 0x7f6824113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.907+0000 7f682a3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68241142e0 con 0x7f682406d3a0 2023-07-14T13:21:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.907+0000 7f682a3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824114450 con 0x7f682406c910 2023-07-14T13:21:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.907+0000 7f682a3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824114610 con 0x7f682410e2a0 2023-07-14T13:21:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.908+0000 7f682899c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f682410e2a0 0x7f6824113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.909+0000 7f682899c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f682410e2a0 0x7f6824113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59550/0 (socket says 172.21.15.17:59550) 2023-07-14T13:21:46.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.909+0000 7f682899c700 1 -- 172.21.15.17:0/2915836458 learned_addr learned my addr 172.21.15.17:0/2915836458 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:46.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.911+0000 7f6823fff700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f682406c910 0x7f682411ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.917+0000 7f68237fe700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f682406d3a0 0x7f682411b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.918+0000 7f682899c700 1 -- 172.21.15.17:0/2915836458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f682406c910 msgr2=0x7f682411ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:46.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.918+0000 7f682899c700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f682406c910 0x7f682411ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.918+0000 7f682899c700 1 -- 172.21.15.17:0/2915836458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f682406d3a0 msgr2=0x7f682411b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:46.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.918+0000 7f682899c700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f682406d3a0 0x7f682411b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.918+0000 7f682899c700 1 -- 172.21.15.17:0/2915836458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68180095f0 con 0x7f682410e2a0 2023-07-14T13:21:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.921+0000 7f682899c700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f682410e2a0 0x7f6824113b10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f681c00cca0 tx=0x7f681c00a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.921+0000 7f68217fa700 1 -- 172.21.15.17:0/2915836458 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c00aaf0 con 0x7f682410e2a0 2023-07-14T13:21:46.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.921+0000 7f68217fa700 1 -- 172.21.15.17:0/2915836458 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f681c00ac50 con 0x7f682410e2a0 2023-07-14T13:21:46.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.921+0000 7f68217fa700 1 -- 172.21.15.17:0/2915836458 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c0115e0 con 0x7f682410e2a0 2023-07-14T13:21:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.923+0000 7f682a3ff700 1 -- 172.21.15.17:0/2915836458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68241148f0 con 0x7f682410e2a0 2023-07-14T13:21:46.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.924+0000 7f682a3ff700 1 -- 172.21.15.17:0/2915836458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6824118b40 con 0x7f682410e2a0 2023-07-14T13:21:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.934+0000 7f68217fa700 1 -- 172.21.15.17:0/2915836458 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f681c012420 con 0x7f682410e2a0 2023-07-14T13:21:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.934+0000 7f683dd2db80 1 Processor -- start 2023-07-14T13:21:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.935+0000 7f683dd2db80 1 -- start start 2023-07-14T13:21:46.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.935+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba06ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.935+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba06b2d0 0x55b6ba065040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.935+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba065580 0x55b6ba0659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.935+0000 7f683dd2db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b9f6ac50 con 0x55b6ba065580 2023-07-14T13:21:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.936+0000 7f683dd2db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b9fbd9e0 con 0x55b6b9ec16b0 2023-07-14T13:21:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.936+0000 7f683dd2db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b9fb6e70 con 0x55b6ba06b2d0 2023-07-14T13:21:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.936+0000 7f6823fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba06b2d0 0x55b6ba065040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.936+0000 7f6823fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba06b2d0 0x55b6ba065040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59564/0 (socket says 172.21.15.17:59564) 2023-07-14T13:21:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.936+0000 7f6823fff700 1 -- 172.21.15.17:0/3243812205 learned_addr learned my addr 172.21.15.17:0/3243812205 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.936+0000 7f68237fe700 1 --2- 172.21.15.17:0/3243812205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba06ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:46.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.936+0000 7f68237fe700 1 --2- 172.21.15.17:0/3243812205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba065580 0x55b6ba0659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.937+0000 7f68237fe700 1 -- 172.21.15.17:0/3243812205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba06b2d0 msgr2=0x55b6ba065040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.937+0000 7f68237fe700 1 --2- 172.21.15.17:0/3243812205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba06b2d0 0x55b6ba065040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.937+0000 7f68237fe700 1 -- 172.21.15.17:0/3243812205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba065580 msgr2=0x55b6ba0659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.937+0000 7f68237fe700 1 --2- 172.21.15.17:0/3243812205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba065580 0x55b6ba0659d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.937+0000 7f68237fe700 1 -- 172.21.15.17:0/3243812205 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6b9de4d80 con 0x55b6b9ec16b0 2023-07-14T13:21:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.937+0000 7f6823fff700 1 --2- 172.21.15.17:0/3243812205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba06b2d0 0x55b6ba065040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:21:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.937+0000 7f68237fe700 1 --2- 172.21.15.17:0/3243812205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba06ad90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f68180098e0 tx=0x7f681801a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bfa22c9761c7f47 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.937+0000 7f680a7fc700 1 -- 172.21.15.17:0/3243812205 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800b960 con 0x55b6b9ec16b0 2023-07-14T13:21:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.938+0000 7f680a7fc700 1 -- 172.21.15.17:0/3243812205 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6818003850 con 0x55b6b9ec16b0 2023-07-14T13:21:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.938+0000 7f680a7fc700 1 -- 172.21.15.17:0/3243812205 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800f6c0 con 0x55b6b9ec16b0 2023-07-14T13:21:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.938+0000 7f68217fa700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f680c0a1490 0x7f680c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.938+0000 7f68217fa700 1 -- 172.21.15.17:0/2915836458 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f681c0ccac0 con 0x7f682410e2a0 2023-07-14T13:21:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.939+0000 7f683dd2db80 1 -- 172.21.15.17:0/3243812205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 msgr2=0x55b6ba06ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.939+0000 7f683dd2db80 1 --2- 172.21.15.17:0/3243812205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba06ad90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f68180098e0 tx=0x7f681801a040 comp rx=0 tx=0).stop 2023-07-14T13:21:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.939+0000 7f683dd2db80 1 -- 172.21.15.17:0/3243812205 shutdown_connections 2023-07-14T13:21:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.939+0000 7f683dd2db80 1 --2- 172.21.15.17:0/3243812205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba065580 0x55b6ba0659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.939+0000 7f683dd2db80 1 --2- 172.21.15.17:0/3243812205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba06ad90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.939+0000 7f683dd2db80 1 --2- 172.21.15.17:0/3243812205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba06b2d0 0x55b6ba065040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.939+0000 7f683dd2db80 1 -- 172.21.15.17:0/3243812205 >> 172.21.15.17:0/3243812205 conn(0x55b6ba05abe0 msgr2=0x55b6ba05ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.939+0000 7f6823fff700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f680c0a1490 0x7f680c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.940+0000 7f683dd2db80 1 -- 172.21.15.17:0/3243812205 shutdown_connections 2023-07-14T13:21:46.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.940+0000 7f683dd2db80 1 -- 172.21.15.17:0/3243812205 wait complete. 2023-07-14T13:21:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.940+0000 7f683dd2db80 1 -- start start 2023-07-14T13:21:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.941+0000 7f683dd2db80 1 Processor -- start 2023-07-14T13:21:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.942+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba071630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.942+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba065580 0x55b6ba06e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.942+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba06b2d0 0x55b6ba06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.942+0000 7f683dd2db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b9f56a60 con 0x55b6ba06b2d0 2023-07-14T13:21:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.942+0000 7f683dd2db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b9f56760 con 0x55b6b9ec16b0 2023-07-14T13:21:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.942+0000 7f683dd2db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6b9e3a8c0 con 0x55b6ba065580 2023-07-14T13:21:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.942+0000 7f683dd2db80 10 client.0 _ll_register_callbacks cb 0x55b6b9f54700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:21:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.941+0000 7f6823fff700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f680c0a1490 0x7f680c0a3940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55b6ba061b40 tx=0x7f6814009190 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:46.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.944+0000 7f68237fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba065580 0x55b6ba06e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.944+0000 7f68237fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba065580 0x55b6ba06e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59580/0 (socket says 172.21.15.17:59580) 2023-07-14T13:21:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.944+0000 7f68237fe700 1 -- 172.21.15.17:0/3695243117 learned_addr learned my addr 172.21.15.17:0/3695243117 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:46.976 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.944+0000 7f6823fff700 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.944+0000 7f68237fe700 1 -- 172.21.15.17:0/3695243117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 msgr2=0x55b6ba071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.944+0000 7f68237fe700 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba071630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.977 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.944+0000 7f68237fe700 1 -- 172.21.15.17:0/3695243117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba06b2d0 msgr2=0x55b6ba06f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.944+0000 7f68237fe700 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba06b2d0 0x55b6ba06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.944+0000 7f68237fe700 1 -- 172.21.15.17:0/3695243117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6814009730 con 0x55b6ba065580 2023-07-14T13:21:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.945+0000 7f68237fe700 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba065580 0x55b6ba06e9c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6818000c00 tx=0x7f681800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74432e9ffc790f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.946+0000 7f68037fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:21:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.946+0000 7f68037fe700 1 -- 172.21.15.17:0/3695243117 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68180041a0 con 0x55b6ba065580 2023-07-14T13:21:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.947+0000 7f68037fe700 1 -- 172.21.15.17:0/3695243117 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6818003bd0 con 0x55b6ba065580 2023-07-14T13:21:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.947+0000 7f683dd2db80 1 -- 172.21.15.17:0/3695243117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6b9f10490 con 0x55b6ba065580 2023-07-14T13:21:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.947+0000 7f68037fe700 1 -- 172.21.15.17:0/3695243117 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6818003db0 con 0x55b6ba065580 2023-07-14T13:21:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.947+0000 7f683dd2db80 10 client.28945 fetch_fsmap learned FSMap version 53 2023-07-14T13:21:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.947+0000 7f683dd2db80 1 -- 172.21.15.17:0/3695243117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7f6818020040 con 0x55b6ba065580 2023-07-14T13:21:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.949+0000 7f68037fe700 1 -- 172.21.15.17:0/3695243117 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b6b9f10490 con 0x55b6ba065580 2023-07-14T13:21:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.949+0000 7f68037fe700 1 -- 172.21.15.17:0/3695243117 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f681800fc00 con 0x55b6ba065580 2023-07-14T13:21:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.949+0000 7f683dd2db80 10 client.28945 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:21:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.949+0000 7f683dd2db80 10 client.28945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:21:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.949+0000 7f683dd2db80 20 client.28945 populate_metadata read hostname 'smithi017' 2023-07-14T13:21:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.949+0000 7f683dd2db80 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6ba0c2890 0x55b6ba0c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.950+0000 7f683dd2db80 4 client.28945 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:21:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.950+0000 7f683dd2db80 1 -- 172.21.15.17:0/3695243117 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6b9fafe50 con 0x55b6ba0c2890 2023-07-14T13:21:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.956+0000 7f6823fff700 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6ba0c2890 0x55b6ba0c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.957+0000 7f6823fff700 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6ba0c2890 0x55b6ba0c4ca0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db7ba65d37e36127 server_cookie=10a0d6e19c73d464 in_seq=0 out_seq=0 2023-07-14T13:21:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.957+0000 7f68037fe700 10 client.28945 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.960+0000 7f68037fe700 1 -- 172.21.15.17:0/3695243117 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b6b9fafe50 con 0x55b6ba0c2890 2023-07-14T13:21:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.960+0000 7f68037fe700 10 client.28945 handle_command_reply: tid=0 2023-07-14T13:21:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.960+0000 7f683dd2db80 1 client.28945 shutdown 2023-07-14T13:21:46.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.963+0000 7f683dd2db80 1 -- 172.21.15.17:0/3695243117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba065580 msgr2=0x55b6ba06e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.963+0000 7f683dd2db80 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba065580 0x55b6ba06e9c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6818000c00 tx=0x7f681800b840 comp rx=0 tx=0).stop 2023-07-14T13:21:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.964+0000 7f683dd2db80 1 -- 172.21.15.17:0/3695243117 shutdown_connections 2023-07-14T13:21:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.964+0000 7f683dd2db80 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6ba0c2890 0x55b6ba0c4ca0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.964+0000 7f683dd2db80 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba06b2d0 0x55b6ba06f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.964+0000 7f683dd2db80 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.964+0000 7f683dd2db80 1 --2- 172.21.15.17:0/3695243117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba065580 0x55b6ba06e9c0 secure :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6818000c00 tx=0x7f681800b840 comp rx=0 tx=0).stop 2023-07-14T13:21:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.964+0000 7f683dd2db80 1 -- 172.21.15.17:0/3695243117 >> 172.21.15.17:0/3695243117 conn(0x55b6ba05abe0 msgr2=0x55b6ba05ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.964+0000 7f68037fe700 0 client.28945 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.964+0000 7f683dd2db80 1 -- 172.21.15.17:0/3695243117 shutdown_connections 2023-07-14T13:21:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.964+0000 7f683dd2db80 1 -- 172.21.15.17:0/3695243117 wait complete. 2023-07-14T13:21:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.966+0000 7f683dd2db80 20 client.28945 trim_cache size 0 max 16384 2023-07-14T13:21:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.997+0000 7f683dd2db80 1 Processor -- start 2023-07-14T13:21:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.997+0000 7f683dd2db80 1 -- start start 2023-07-14T13:21:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.997+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba065040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.997+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba06b2d0 0x55b6ba05fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.997+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba0601a0 0x55b6ba071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.997+0000 7f683dd2db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6ba02b060 con 0x55b6ba0601a0 2023-07-14T13:21:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.997+0000 7f683dd2db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6ba0bf630 con 0x55b6b9ec16b0 2023-07-14T13:21:47.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.997+0000 7f683dd2db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6ba0687a0 con 0x55b6ba06b2d0 2023-07-14T13:21:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.998+0000 7f6823fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba065040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.998+0000 7f6823fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba065040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54512/0 (socket says 172.21.15.17:54512) 2023-07-14T13:21:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.998+0000 7f6823fff700 1 -- 172.21.15.17:0/1325462040 learned_addr learned my addr 172.21.15.17:0/1325462040 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.998+0000 7f6823fff700 1 -- 172.21.15.17:0/1325462040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba06b2d0 msgr2=0x55b6ba05fc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:21:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.998+0000 7f6823fff700 1 --2- 172.21.15.17:0/1325462040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba06b2d0 0x55b6ba05fc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.998+0000 7f6823fff700 1 -- 172.21.15.17:0/1325462040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba0601a0 msgr2=0x55b6ba071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.998+0000 7f6823fff700 1 --2- 172.21.15.17:0/1325462040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba0601a0 0x55b6ba071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.998+0000 7f6823fff700 1 -- 172.21.15.17:0/1325462040 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6ba0c9890 con 0x55b6b9ec16b0 2023-07-14T13:21:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:46.999+0000 7f6823fff700 1 --2- 172.21.15.17:0/1325462040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba065040 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6814006fd0 tx=0x7f6814014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fa4dc5b026cf440 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.000+0000 7f680affd700 1 -- 172.21.15.17:0/1325462040 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814009eb0 con 0x55b6b9ec16b0 2023-07-14T13:21:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.000+0000 7f680affd700 1 -- 172.21.15.17:0/1325462040 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6814024bd0 con 0x55b6b9ec16b0 2023-07-14T13:21:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.000+0000 7f680affd700 1 -- 172.21.15.17:0/1325462040 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814022640 con 0x55b6b9ec16b0 2023-07-14T13:21:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.001+0000 7f683dd2db80 1 -- 172.21.15.17:0/1325462040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 msgr2=0x55b6ba065040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.001+0000 7f683dd2db80 1 --2- 172.21.15.17:0/1325462040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba065040 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6814006fd0 tx=0x7f6814014000 comp rx=0 tx=0).stop 2023-07-14T13:21:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.001+0000 7f683dd2db80 1 -- 172.21.15.17:0/1325462040 shutdown_connections 2023-07-14T13:21:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.001+0000 7f683dd2db80 1 --2- 172.21.15.17:0/1325462040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba0601a0 0x55b6ba071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.001+0000 7f683dd2db80 1 --2- 172.21.15.17:0/1325462040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6b9ec16b0 0x55b6ba065040 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.001+0000 7f683dd2db80 1 --2- 172.21.15.17:0/1325462040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6ba06b2d0 0x55b6ba05fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.001+0000 7f683dd2db80 1 -- 172.21.15.17:0/1325462040 >> 172.21.15.17:0/1325462040 conn(0x55b6ba05abe0 msgr2=0x55b6ba06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.002+0000 7f683dd2db80 1 -- 172.21.15.17:0/1325462040 shutdown_connections 2023-07-14T13:21:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.002+0000 7f683dd2db80 1 -- 172.21.15.17:0/1325462040 wait complete. 2023-07-14T13:21:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.002+0000 7f683dd2db80 1 -- start start 2023-07-14T13:21:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.003+0000 7f683dd2db80 1 Processor -- start 2023-07-14T13:21:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.003+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6b9ec16b0 0x55b6ba0be200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.003+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6ba0601a0 0x55b6ba0be740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.003+0000 7f683dd2db80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba06b2d0 0x55b6ba0bade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.004+0000 7f683dd2db80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6ba0bb4c0 con 0x55b6ba06b2d0 2023-07-14T13:21:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.004+0000 7f683dd2db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6ba0bb630 con 0x55b6ba0601a0 2023-07-14T13:21:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.004+0000 7f683dd2db80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6ba0bb7f0 con 0x55b6b9ec16b0 2023-07-14T13:21:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.004+0000 7f683dd2db80 10 client.0 _ll_register_callbacks cb 0x7f681800b8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:21:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.004+0000 7f6823fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6b9ec16b0 0x55b6ba0be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.004+0000 7f6823fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6b9ec16b0 0x55b6ba0be200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59600/0 (socket says 172.21.15.17:59600) 2023-07-14T13:21:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.004+0000 7f6823fff700 1 -- 172.21.15.17:0/2653071735 learned_addr learned my addr 172.21.15.17:0/2653071735 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:21:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.004+0000 7f68237fe700 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6ba0601a0 0x55b6ba0be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.004+0000 7f682899c700 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba06b2d0 0x55b6ba0bade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.005+0000 7f6823fff700 1 -- 172.21.15.17:0/2653071735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6ba0601a0 msgr2=0x55b6ba0be740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.005+0000 7f6823fff700 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6ba0601a0 0x55b6ba0be740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.005+0000 7f6823fff700 1 -- 172.21.15.17:0/2653071735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba06b2d0 msgr2=0x55b6ba0bade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:21:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.005+0000 7f6823fff700 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba06b2d0 0x55b6ba0bade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.005+0000 7f6823fff700 1 -- 172.21.15.17:0/2653071735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6814011d10 con 0x55b6b9ec16b0 2023-07-14T13:21:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.005+0000 7f682899c700 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba06b2d0 0x55b6ba0bade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:21:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.005+0000 7f6823fff700 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6b9ec16b0 0x55b6ba0be200 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6814009420 tx=0x7f6814014ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cda3acff32d9e222 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:21:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.006+0000 7f68037fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:21:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.006+0000 7f68037fe700 1 -- 172.21.15.17:0/2653071735 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814014850 con 0x55b6b9ec16b0 2023-07-14T13:21:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.006+0000 7f68037fe700 1 -- 172.21.15.17:0/2653071735 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f681401c040 con 0x55b6b9ec16b0 2023-07-14T13:21:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.007+0000 7f683dd2db80 1 -- 172.21.15.17:0/2653071735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6818003850 con 0x55b6b9ec16b0 2023-07-14T13:21:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.007+0000 7f68037fe700 1 -- 172.21.15.17:0/2653071735 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68140149b0 con 0x55b6b9ec16b0 2023-07-14T13:21:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.008+0000 7f683dd2db80 10 client.28948 fetch_fsmap learned FSMap version 53 2023-07-14T13:21:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.008+0000 7f683dd2db80 1 -- 172.21.15.17:0/2653071735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55b6b9dcdc00 con 0x55b6b9ec16b0 2023-07-14T13:21:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.009+0000 7f68037fe700 1 -- 172.21.15.17:0/2653071735 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6818003850 con 0x55b6b9ec16b0 2023-07-14T13:21:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.009+0000 7f68037fe700 1 -- 172.21.15.17:0/2653071735 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6814043020 con 0x55b6b9ec16b0 2023-07-14T13:21:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.010+0000 7f683dd2db80 10 client.28948 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:21:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.010+0000 7f683dd2db80 10 client.28948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:21:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.010+0000 7f683dd2db80 20 client.28948 populate_metadata read hostname 'smithi017' 2023-07-14T13:21:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.010+0000 7f683dd2db80 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6ba117800 0x55b6ba119c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:21:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.010+0000 7f683dd2db80 4 client.28948 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:21:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.010+0000 7f683dd2db80 1 -- 172.21.15.17:0/2653071735 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b6b9f71ff0 con 0x55b6ba117800 2023-07-14T13:21:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.011+0000 7f68237fe700 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6ba117800 0x55b6ba119c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:21:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.013+0000 7f68237fe700 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6ba117800 0x55b6ba119c10 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a1600a3ecd9900 server_cookie=90d47b1e986e926b in_seq=0 out_seq=0 2023-07-14T13:21:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.013+0000 7f68037fe700 10 client.28948 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.095+0000 7f68037fe700 1 -- 172.21.15.17:0/2653071735 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b6b9f71ff0 con 0x55b6ba117800 2023-07-14T13:21:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.095+0000 7f68037fe700 10 client.28948 handle_command_reply: tid=0 2023-07-14T13:21:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.095+0000 7f683dd2db80 1 client.28948 shutdown 2023-07-14T13:21:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f683dd2db80 1 -- 172.21.15.17:0/2653071735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6b9ec16b0 msgr2=0x55b6ba0be200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f683dd2db80 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6b9ec16b0 0x55b6ba0be200 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6814009420 tx=0x7f6814014ca0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f683dd2db80 1 -- 172.21.15.17:0/2653071735 shutdown_connections 2023-07-14T13:21:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f683dd2db80 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b6ba117800 0x55b6ba119c10 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f683dd2db80 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b6ba06b2d0 0x55b6ba0bade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f683dd2db80 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6b9ec16b0 0x55b6ba0be200 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f683dd2db80 1 --2- 172.21.15.17:0/2653071735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6ba0601a0 0x55b6ba0be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f683dd2db80 1 -- 172.21.15.17:0/2653071735 >> 172.21.15.17:0/2653071735 conn(0x55b6ba05abe0 msgr2=0x55b6ba06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f68037fe700 0 client.28948 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:21:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f683dd2db80 1 -- 172.21.15.17:0/2653071735 shutdown_connections 2023-07-14T13:21:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f683dd2db80 1 -- 172.21.15.17:0/2653071735 wait complete. 2023-07-14T13:21:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.096+0000 7f683dd2db80 20 client.28948 trim_cache size 0 max 16384 2023-07-14T13:21:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:21:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:21:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:21:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:21:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.098+0000 7f682a3ff700 1 -- 172.21.15.17:0/2915836458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f680c0a1490 msgr2=0x7f680c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:47.121 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.098+0000 7f682a3ff700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f680c0a1490 0x7f680c0a3940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55b6ba061b40 tx=0x7f6814009190 comp rx=0 tx=0).stop 2023-07-14T13:21:47.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.098+0000 7f682a3ff700 1 -- 172.21.15.17:0/2915836458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f682410e2a0 msgr2=0x7f6824113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:21:47.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.098+0000 7f682a3ff700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f682410e2a0 0x7f6824113b10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f681c00cca0 tx=0x7f681c00a060 comp rx=0 tx=0).stop 2023-07-14T13:21:47.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.098+0000 7f682a3ff700 1 -- 172.21.15.17:0/2915836458 shutdown_connections 2023-07-14T13:21:47.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.098+0000 7f682a3ff700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f680c0a1490 0x7f680c0a3940 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55b6ba061b40 tx=0x7f6814009190 comp rx=0 tx=0).stop 2023-07-14T13:21:47.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.098+0000 7f682a3ff700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f682410e2a0 0x7f6824113b10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.098+0000 7f682a3ff700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f682406c910 0x7f682411ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.098+0000 7f682a3ff700 1 --2- 172.21.15.17:0/2915836458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f682406d3a0 0x7f682411b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:21:47.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.098+0000 7f682a3ff700 1 -- 172.21.15.17:0/2915836458 >> 172.21.15.17:0/2915836458 conn(0x7f682406bd70 msgr2=0x7f682406f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:21:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.106+0000 7f682a3ff700 1 -- 172.21.15.17:0/2915836458 shutdown_connections 2023-07-14T13:21:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:21:47.107+0000 7f682a3ff700 1 -- 172.21.15.17:0/2915836458 wait complete. 2023-07-14T13:21:47.441 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 215.0 s, 383.8 tps, lat 264.654 ms stddev 457.039 2023-07-14T13:21:47.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:47 smithi135 ceph-mon[97338]: pgmap v696: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 19 MiB/s wr, 1.50k op/s 2023-07-14T13:21:47.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:47 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:47.690 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:47 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:47.738 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:47 smithi131 ceph-mon[96953]: pgmap v696: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 19 MiB/s wr, 1.50k op/s 2023-07-14T13:21:47.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:47 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:47.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:47 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:47.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:47 smithi017 ceph-mon[95536]: pgmap v696: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 19 MiB/s wr, 1.50k op/s 2023-07-14T13:21:47.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:47 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:47.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:47 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:49.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:48 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:49.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:48 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:49.098 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:48 smithi017 ceph-mon[95536]: pgmap v697: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 881 op/s 2023-07-14T13:21:49.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:48 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:21:49.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:48 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:21:49.099 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:48 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:49.189 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:48 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:49.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:48 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:49.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:48 smithi135 ceph-mon[97338]: pgmap v697: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 881 op/s 2023-07-14T13:21:49.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:48 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:21:49.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:48 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:21:49.190 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:48 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:49.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:48 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:49.238 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:48 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:49.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:48 smithi131 ceph-mon[96953]: pgmap v697: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 11 MiB/s wr, 881 op/s 2023-07-14T13:21:49.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:48 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:21:49.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:48 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:21:49.239 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:48 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:21:51.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:51 smithi017 ceph-mon[95536]: pgmap v698: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-07-14T13:21:51.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:51 smithi135 ceph-mon[97338]: pgmap v698: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-07-14T13:21:51.738 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:51 smithi131 ceph-mon[96953]: pgmap v698: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-07-14T13:21:52.444 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 220.0 s, 3.2 tps, lat 1784.846 ms stddev 23.649 2023-07-14T13:21:53.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:53 smithi017 ceph-mon[95536]: pgmap v699: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.6 MiB/s wr, 589 op/s 2023-07-14T13:21:53.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:53 smithi135 ceph-mon[97338]: pgmap v699: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.6 MiB/s wr, 589 op/s 2023-07-14T13:21:53.738 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:53 smithi131 ceph-mon[96953]: pgmap v699: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.6 MiB/s wr, 589 op/s 2023-07-14T13:21:55.598 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:55 smithi017 ceph-mon[95536]: pgmap v700: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.6 MiB/s wr, 589 op/s 2023-07-14T13:21:55.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:55 smithi135 ceph-mon[97338]: pgmap v700: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.6 MiB/s wr, 589 op/s 2023-07-14T13:21:55.738 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:55 smithi131 ceph-mon[96953]: pgmap v700: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.6 MiB/s wr, 589 op/s 2023-07-14T13:21:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 225.0 s, 491.9 tps, lat 397.841 ms stddev 1249.099 2023-07-14T13:21:57.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:57 smithi135 ceph-mon[97338]: pgmap v701: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.6 MiB/s wr, 737 op/s 2023-07-14T13:21:57.738 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:57 smithi131 ceph-mon[96953]: pgmap v701: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.6 MiB/s wr, 737 op/s 2023-07-14T13:21:57.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:57 smithi017 ceph-mon[95536]: pgmap v701: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.6 MiB/s wr, 737 op/s 2023-07-14T13:21:59.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:21:59 smithi135 ceph-mon[97338]: pgmap v702: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 5.6 MiB/s wr, 494 op/s 2023-07-14T13:21:59.737 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:21:59 smithi131 ceph-mon[96953]: pgmap v702: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 5.6 MiB/s wr, 494 op/s 2023-07-14T13:21:59.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:21:59 smithi017 ceph-mon[95536]: pgmap v702: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 5.6 MiB/s wr, 494 op/s 2023-07-14T13:22:00.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.382+0000 7fb53d7ff700 1 -- 172.21.15.17:0/2969215124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53806c910 msgr2=0x7fb53806cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.382+0000 7fb53d7ff700 1 --2- 172.21.15.17:0/2969215124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53806c910 0x7fb53806cd80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb52800b0a0 tx=0x7fb52800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.383+0000 7fb53d7ff700 1 -- 172.21.15.17:0/2969215124 shutdown_connections 2023-07-14T13:22:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.383+0000 7fb53d7ff700 1 --2- 172.21.15.17:0/2969215124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53806d3a0 0x7fb53811b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.383+0000 7fb53d7ff700 1 --2- 172.21.15.17:0/2969215124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb53810e2a0 0x7fb53810e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.383+0000 7fb53d7ff700 1 --2- 172.21.15.17:0/2969215124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53806c910 0x7fb53806cd80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.383+0000 7fb53d7ff700 1 -- 172.21.15.17:0/2969215124 >> 172.21.15.17:0/2969215124 conn(0x7fb53806bd70 msgr2=0x7fb538070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.383+0000 7fb53d7ff700 1 -- 172.21.15.17:0/2969215124 shutdown_connections 2023-07-14T13:22:00.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.383+0000 7fb53d7ff700 1 -- 172.21.15.17:0/2969215124 wait complete. 2023-07-14T13:22:00.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.384+0000 7fb53d7ff700 1 Processor -- start 2023-07-14T13:22:00.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.385+0000 7fb53d7ff700 1 -- start start 2023-07-14T13:22:00.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.386+0000 7fb53d7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53806c910 0x7fb5381aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.386+0000 7fb53d7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53806d3a0 0x7fb5381aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.386+0000 7fb53d7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb53810e2a0 0x7fb5381a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.386+0000 7fb53d7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5381a4e20 con 0x7fb53806c910 2023-07-14T13:22:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.386+0000 7fb53d7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5381a4f90 con 0x7fb53810e2a0 2023-07-14T13:22:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.386+0000 7fb53d7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5381a5150 con 0x7fb53806d3a0 2023-07-14T13:22:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.387+0000 7fb5367fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53806d3a0 0x7fb5381aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.387+0000 7fb5367fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53806d3a0 0x7fb5381aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35142/0 (socket says 172.21.15.17:35142) 2023-07-14T13:22:00.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.387+0000 7fb5367fc700 1 -- 172.21.15.17:0/315998532 learned_addr learned my addr 172.21.15.17:0/315998532 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:00.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.387+0000 7fb5377fe700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb53810e2a0 0x7fb5381a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.388+0000 7fb536ffd700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53806c910 0x7fb5381aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.388+0000 7fb5367fc700 1 -- 172.21.15.17:0/315998532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb53810e2a0 msgr2=0x7fb5381a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.388+0000 7fb5367fc700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb53810e2a0 0x7fb5381a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.388+0000 7fb5367fc700 1 -- 172.21.15.17:0/315998532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53806c910 msgr2=0x7fb5381aa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.388+0000 7fb5367fc700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53806c910 0x7fb5381aa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.388+0000 7fb5367fc700 1 -- 172.21.15.17:0/315998532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb528009d00 con 0x7fb53806d3a0 2023-07-14T13:22:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.389+0000 7fb5367fc700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53806d3a0 0x7fb5381aae90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb52800b070 tx=0x7fb52800bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:00.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.389+0000 7fb52ffff700 1 -- 172.21.15.17:0/315998532 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52800e040 con 0x7fb53806d3a0 2023-07-14T13:22:00.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.389+0000 7fb52ffff700 1 -- 172.21.15.17:0/315998532 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb528004c50 con 0x7fb53806d3a0 2023-07-14T13:22:00.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.389+0000 7fb52ffff700 1 -- 172.21.15.17:0/315998532 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52801b6c0 con 0x7fb53806d3a0 2023-07-14T13:22:00.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.389+0000 7fb53d7ff700 1 -- 172.21.15.17:0/315998532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5381a53d0 con 0x7fb53806d3a0 2023-07-14T13:22:00.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.390+0000 7fb53d7ff700 1 -- 172.21.15.17:0/315998532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5381b1940 con 0x7fb53806d3a0 2023-07-14T13:22:00.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.396+0000 7fb55109fb80 1 Processor -- start 2023-07-14T13:22:00.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.401+0000 7fb55109fb80 1 -- start start 2023-07-14T13:22:00.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.401+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c31f26b0 0x5563c339bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.401+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c339c2d0 0x5563c3396040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.401+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 0x5563c33969d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.401+0000 7fb55109fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c329bc50 con 0x5563c31f26b0 2023-07-14T13:22:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.401+0000 7fb55109fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c32ee9e0 con 0x5563c339c2d0 2023-07-14T13:22:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.402+0000 7fb55109fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c32e7e70 con 0x5563c3396580 2023-07-14T13:22:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.404+0000 7fb52ffff700 1 -- 172.21.15.17:0/315998532 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb52801d470 con 0x7fb53806d3a0 2023-07-14T13:22:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.405+0000 7fb5367fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 0x5563c33969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.405+0000 7fb5367fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 0x5563c33969d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35146/0 (socket says 172.21.15.17:35146) 2023-07-14T13:22:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.405+0000 7fb5367fc700 1 -- 172.21.15.17:0/3341313360 learned_addr learned my addr 172.21.15.17:0/3341313360 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.406+0000 7fb5367fc700 1 -- 172.21.15.17:0/3341313360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c339c2d0 msgr2=0x5563c3396040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:22:00.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.406+0000 7fb5367fc700 1 --2- 172.21.15.17:0/3341313360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c339c2d0 0x5563c3396040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.406+0000 7fb5367fc700 1 -- 172.21.15.17:0/3341313360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c31f26b0 msgr2=0x5563c339bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:00.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.406+0000 7fb5367fc700 1 --2- 172.21.15.17:0/3341313360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c31f26b0 0x5563c339bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.406+0000 7fb5367fc700 1 -- 172.21.15.17:0/3341313360 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563c3115d80 con 0x5563c3396580 2023-07-14T13:22:00.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.407+0000 7fb52ffff700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5240a1400 0x7fb5240a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.407+0000 7fb5367fc700 1 --2- 172.21.15.17:0/3341313360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 0x5563c33969d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb5280cb4e0 tx=0x7fb5280d1d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd1333af9b032213 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.408+0000 7fb52ffff700 1 -- 172.21.15.17:0/315998532 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb5280cde90 con 0x7fb53806d3a0 2023-07-14T13:22:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.408+0000 7fb52d7fa700 1 -- 172.21.15.17:0/3341313360 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5280d9070 con 0x5563c3396580 2023-07-14T13:22:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.408+0000 7fb52d7fa700 1 -- 172.21.15.17:0/3341313360 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb5280d1a30 con 0x5563c3396580 2023-07-14T13:22:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.408+0000 7fb52d7fa700 1 -- 172.21.15.17:0/3341313360 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52809aaf0 con 0x5563c3396580 2023-07-14T13:22:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.408+0000 7fb5377fe700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5240a1400 0x7fb5240a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.409+0000 7fb55109fb80 1 -- 172.21.15.17:0/3341313360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 msgr2=0x5563c33969d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.409+0000 7fb55109fb80 1 --2- 172.21.15.17:0/3341313360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 0x5563c33969d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb5280cb4e0 tx=0x7fb5280d1d40 comp rx=0 tx=0).stop 2023-07-14T13:22:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.409+0000 7fb55109fb80 1 -- 172.21.15.17:0/3341313360 shutdown_connections 2023-07-14T13:22:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.409+0000 7fb55109fb80 1 --2- 172.21.15.17:0/3341313360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 0x5563c33969d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.409+0000 7fb55109fb80 1 --2- 172.21.15.17:0/3341313360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c31f26b0 0x5563c339bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.409+0000 7fb55109fb80 1 --2- 172.21.15.17:0/3341313360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c339c2d0 0x5563c3396040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.409+0000 7fb55109fb80 1 -- 172.21.15.17:0/3341313360 >> 172.21.15.17:0/3341313360 conn(0x5563c338bbe0 msgr2=0x5563c3390f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:00.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.410+0000 7fb55109fb80 1 -- 172.21.15.17:0/3341313360 shutdown_connections 2023-07-14T13:22:00.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.410+0000 7fb5377fe700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5240a1400 0x7fb5240a38b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb5381ab650 tx=0x7fb5300098e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:00.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.410+0000 7fb55109fb80 1 -- 172.21.15.17:0/3341313360 wait complete. 2023-07-14T13:22:00.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.411+0000 7fb55109fb80 1 -- start start 2023-07-14T13:22:00.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.411+0000 7fb55109fb80 1 Processor -- start 2023-07-14T13:22:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.412+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 0x5563c33a2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.412+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c3396580 0x5563c339f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.412+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 0x5563c339fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.412+0000 7fb55109fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c3287a60 con 0x5563c3396580 2023-07-14T13:22:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.412+0000 7fb55109fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c3287760 con 0x5563c31f26b0 2023-07-14T13:22:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.412+0000 7fb55109fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c316b8c0 con 0x5563c339c2d0 2023-07-14T13:22:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.412+0000 7fb55109fb80 10 client.0 _ll_register_callbacks cb 0x5563c3285700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:22:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.413+0000 7fb536ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 0x5563c33a2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.413+0000 7fb5377fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 0x5563c339fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.413+0000 7fb536ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 0x5563c33a2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58084/0 (socket says 172.21.15.17:58084) 2023-07-14T13:22:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.413+0000 7fb536ffd700 1 -- 172.21.15.17:0/2583613874 learned_addr learned my addr 172.21.15.17:0/2583613874 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.413+0000 7fb5377fe700 1 -- 172.21.15.17:0/2583613874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 msgr2=0x5563c33a2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.413+0000 7fb5377fe700 1 --2- 172.21.15.17:0/2583613874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 0x5563c33a2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.413+0000 7fb5377fe700 1 -- 172.21.15.17:0/2583613874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c3396580 msgr2=0x5563c339f7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:22:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.414+0000 7fb5377fe700 1 --2- 172.21.15.17:0/2583613874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c3396580 0x5563c339f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.414+0000 7fb5377fe700 1 -- 172.21.15.17:0/2583613874 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5381b1940 con 0x5563c339c2d0 2023-07-14T13:22:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.414+0000 7fb5377fe700 1 --2- 172.21.15.17:0/2583613874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 0x5563c339fd60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb53001c5d0 tx=0x7fb530009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9e5c65d10f05de1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.415+0000 7fb51e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:22:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.415+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2583613874 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530028680 con 0x5563c339c2d0 2023-07-14T13:22:00.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.415+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2583613874 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb530023070 con 0x5563c339c2d0 2023-07-14T13:22:00.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.417+0000 7fb55109fb80 1 -- 172.21.15.17:0/2583613874 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563c32e0e50 con 0x5563c339c2d0 2023-07-14T13:22:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.418+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2583613874 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5300287e0 con 0x5563c339c2d0 2023-07-14T13:22:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.418+0000 7fb55109fb80 10 client.28960 fetch_fsmap learned FSMap version 53 2023-07-14T13:22:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.418+0000 7fb55109fb80 1 -- 172.21.15.17:0/2583613874 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5563c30fec00 con 0x5563c339c2d0 2023-07-14T13:22:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.419+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2583613874 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5563c32e0e50 con 0x5563c339c2d0 2023-07-14T13:22:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.420+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2583613874 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb530032a00 con 0x5563c339c2d0 2023-07-14T13:22:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.421+0000 7fb55109fb80 10 client.28960 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:22:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.421+0000 7fb55109fb80 10 client.28960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:22:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.421+0000 7fb55109fb80 20 client.28960 populate_metadata read hostname 'smithi017' 2023-07-14T13:22:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.421+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2583613874 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563c33c0a60 0x5563c33c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.421+0000 7fb55109fb80 4 client.28960 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:22:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.421+0000 7fb55109fb80 1 -- 172.21.15.17:0/2583613874 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563c32a2ff0 con 0x5563c33c0a60 2023-07-14T13:22:00.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.421+0000 7fb536ffd700 1 --2- 172.21.15.17:0/2583613874 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563c33c0a60 0x5563c33c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.422+0000 7fb536ffd700 1 --2- 172.21.15.17:0/2583613874 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563c33c0a60 0x5563c33c2e70 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=927578a7f2b53a56 server_cookie=b994678215e03d20 in_seq=0 out_seq=0 2023-07-14T13:22:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.422+0000 7fb51e7fc700 10 client.28960 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.423+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2583613874 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5563c32a2ff0 con 0x5563c33c0a60 2023-07-14T13:22:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.423+0000 7fb51e7fc700 10 client.28960 handle_command_reply: tid=0 2023-07-14T13:22:00.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.424+0000 7fb55109fb80 1 client.28960 shutdown 2023-07-14T13:22:00.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.426+0000 7fb55109fb80 1 -- 172.21.15.17:0/2583613874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 msgr2=0x5563c339fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:00.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.426+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2583613874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 0x5563c339fd60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb53001c5d0 tx=0x7fb530009260 comp rx=0 tx=0).stop 2023-07-14T13:22:00.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.426+0000 7fb55109fb80 1 -- 172.21.15.17:0/2583613874 shutdown_connections 2023-07-14T13:22:00.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.426+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2583613874 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563c33c0a60 0x5563c33c2e70 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.426+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2583613874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 0x5563c339fd60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.426+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2583613874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 0x5563c33a2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.426+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2583613874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c3396580 0x5563c339f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.426+0000 7fb55109fb80 1 -- 172.21.15.17:0/2583613874 >> 172.21.15.17:0/2583613874 conn(0x5563c338bbe0 msgr2=0x5563c33904e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:00.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.426+0000 7fb51e7fc700 0 client.28960 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.426+0000 7fb55109fb80 1 -- 172.21.15.17:0/2583613874 shutdown_connections 2023-07-14T13:22:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.426+0000 7fb55109fb80 1 -- 172.21.15.17:0/2583613874 wait complete. 2023-07-14T13:22:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.427+0000 7fb55109fb80 20 client.28960 trim_cache size 0 max 16384 2023-07-14T13:22:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.457+0000 7fb55109fb80 1 Processor -- start 2023-07-14T13:22:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.457+0000 7fb55109fb80 1 -- start start 2023-07-14T13:22:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.457+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 0x5563c3396040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.457+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 0x5563c33b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.457+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c339c2d0 0x5563c339d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.457+0000 7fb55109fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c33bcab0 con 0x5563c339c2d0 2023-07-14T13:22:00.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.457+0000 7fb55109fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c338dd00 con 0x5563c31f26b0 2023-07-14T13:22:00.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.457+0000 7fb55109fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c3397000 con 0x5563c3396580 2023-07-14T13:22:00.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.458+0000 7fb536ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 0x5563c3396040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.458+0000 7fb536ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 0x5563c3396040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58098/0 (socket says 172.21.15.17:58098) 2023-07-14T13:22:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.458+0000 7fb536ffd700 1 -- 172.21.15.17:0/767184567 learned_addr learned my addr 172.21.15.17:0/767184567 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.458+0000 7fb5367fc700 1 --2- 172.21.15.17:0/767184567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 0x5563c33b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.459+0000 7fb536ffd700 1 -- 172.21.15.17:0/767184567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 msgr2=0x5563c33b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.459+0000 7fb536ffd700 1 --2- 172.21.15.17:0/767184567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 0x5563c33b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.459+0000 7fb536ffd700 1 -- 172.21.15.17:0/767184567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c339c2d0 msgr2=0x5563c339d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.459+0000 7fb536ffd700 1 --2- 172.21.15.17:0/767184567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c339c2d0 0x5563c339d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.459+0000 7fb536ffd700 1 -- 172.21.15.17:0/767184567 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563c3396c20 con 0x5563c31f26b0 2023-07-14T13:22:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.459+0000 7fb536ffd700 1 --2- 172.21.15.17:0/767184567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 0x5563c3396040 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb520009740 tx=0x7fb520009e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a9edb351c1931ee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.460+0000 7fb52dffb700 1 -- 172.21.15.17:0/767184567 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5200157b0 con 0x5563c31f26b0 2023-07-14T13:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.460+0000 7fb52dffb700 1 -- 172.21.15.17:0/767184567 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb52001d070 con 0x5563c31f26b0 2023-07-14T13:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.460+0000 7fb52dffb700 1 -- 172.21.15.17:0/767184567 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb520021b60 con 0x5563c31f26b0 2023-07-14T13:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.461+0000 7fb55109fb80 1 -- 172.21.15.17:0/767184567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 msgr2=0x5563c3396040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.461+0000 7fb55109fb80 1 --2- 172.21.15.17:0/767184567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 0x5563c3396040 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb520009740 tx=0x7fb520009e90 comp rx=0 tx=0).stop 2023-07-14T13:22:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.462+0000 7fb55109fb80 1 -- 172.21.15.17:0/767184567 shutdown_connections 2023-07-14T13:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.462+0000 7fb55109fb80 1 --2- 172.21.15.17:0/767184567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c339c2d0 0x5563c339d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.462+0000 7fb55109fb80 1 --2- 172.21.15.17:0/767184567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c31f26b0 0x5563c3396040 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.462+0000 7fb55109fb80 1 --2- 172.21.15.17:0/767184567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c3396580 0x5563c33b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.462+0000 7fb55109fb80 1 -- 172.21.15.17:0/767184567 >> 172.21.15.17:0/767184567 conn(0x5563c338bbe0 msgr2=0x5563c339ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.462+0000 7fb55109fb80 1 -- 172.21.15.17:0/767184567 shutdown_connections 2023-07-14T13:22:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.463+0000 7fb55109fb80 1 -- 172.21.15.17:0/767184567 wait complete. 2023-07-14T13:22:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.464+0000 7fb55109fb80 1 -- start start 2023-07-14T13:22:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.464+0000 7fb55109fb80 1 Processor -- start 2023-07-14T13:22:00.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.465+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c31f26b0 0x5563c3398a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.465+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 0x5563c3398f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.465+0000 7fb55109fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c3397790 0x5563c3397c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.465+0000 7fb55109fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c3399540 con 0x5563c31f26b0 2023-07-14T13:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.465+0000 7fb55109fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c3398140 con 0x5563c3397790 2023-07-14T13:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.465+0000 7fb55109fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563c3398300 con 0x5563c339c2d0 2023-07-14T13:22:00.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.465+0000 7fb55109fb80 10 client.0 _ll_register_callbacks cb 0x7fb530011ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.466+0000 7fb5367fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 0x5563c3398f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.466+0000 7fb5367fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 0x5563c3398f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35182/0 (socket says 172.21.15.17:35182) 2023-07-14T13:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.466+0000 7fb5367fc700 1 -- 172.21.15.17:0/2904724074 learned_addr learned my addr 172.21.15.17:0/2904724074 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:00.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.466+0000 7fb5377fe700 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c3397790 0x5563c3397c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.466+0000 7fb536ffd700 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c31f26b0 0x5563c3398a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.466+0000 7fb5367fc700 1 -- 172.21.15.17:0/2904724074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c3397790 msgr2=0x5563c3397c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.466+0000 7fb5367fc700 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c3397790 0x5563c3397c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.466+0000 7fb5367fc700 1 -- 172.21.15.17:0/2904724074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c31f26b0 msgr2=0x5563c3398a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.466+0000 7fb5367fc700 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c31f26b0 0x5563c3398a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.466+0000 7fb5367fc700 1 -- 172.21.15.17:0/2904724074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52000e040 con 0x5563c339c2d0 2023-07-14T13:22:00.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.467+0000 7fb5367fc700 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 0x5563c3398f40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb52800bbd0 tx=0x7fb5280d1f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b22a48ba2372f7b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:00.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.467+0000 7fb51e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.467+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2904724074 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5280cb510 con 0x5563c339c2d0 2023-07-14T13:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.467+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2904724074 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb52801ae90 con 0x5563c339c2d0 2023-07-14T13:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.468+0000 7fb55109fb80 1 -- 172.21.15.17:0/2904724074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563c3241490 con 0x5563c339c2d0 2023-07-14T13:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.468+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2904724074 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5280d1410 con 0x5563c339c2d0 2023-07-14T13:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.468+0000 7fb55109fb80 10 client.28966 fetch_fsmap learned FSMap version 53 2023-07-14T13:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.468+0000 7fb55109fb80 1 -- 172.21.15.17:0/2904724074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x5563c313c1f0 con 0x5563c339c2d0 2023-07-14T13:22:00.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.469+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2904724074 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5563c3241490 con 0x5563c339c2d0 2023-07-14T13:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.469+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2904724074 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 53) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb5280d40d0 con 0x5563c339c2d0 2023-07-14T13:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.469+0000 7fb55109fb80 10 client.28966 fetch_fsmap finished waiting for FSMap version 53 2023-07-14T13:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.469+0000 7fb55109fb80 10 client.28966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.469+0000 7fb55109fb80 20 client.28966 populate_metadata read hostname 'smithi017' 2023-07-14T13:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.469+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563c3415620 0x5563c3417a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.469+0000 7fb55109fb80 4 client.28966 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:22:00.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.469+0000 7fb55109fb80 1 -- 172.21.15.17:0/2904724074 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5563c3136f10 con 0x5563c3415620 2023-07-14T13:22:00.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.470+0000 7fb536ffd700 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563c3415620 0x5563c3417a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:00.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.471+0000 7fb536ffd700 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563c3415620 0x5563c3417a00 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b12dbf88203eb83e server_cookie=515d62fecea874c5 in_seq=0 out_seq=0 2023-07-14T13:22:00.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.472+0000 7fb51e7fc700 10 client.28966 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.495+0000 7fb51e7fc700 1 -- 172.21.15.17:0/2904724074 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5563c3136f10 con 0x5563c3415620 2023-07-14T13:22:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.495+0000 7fb51e7fc700 10 client.28966 handle_command_reply: tid=0 2023-07-14T13:22:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.496+0000 7fb55109fb80 1 client.28966 shutdown 2023-07-14T13:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.499+0000 7fb55109fb80 1 -- 172.21.15.17:0/2904724074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 msgr2=0x5563c3398f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.499+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 0x5563c3398f40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb52800bbd0 tx=0x7fb5280d1f80 comp rx=0 tx=0).stop 2023-07-14T13:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.500+0000 7fb55109fb80 1 -- 172.21.15.17:0/2904724074 shutdown_connections 2023-07-14T13:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.500+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5563c3415620 0x5563c3417a00 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.500+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5563c3397790 0x5563c3397c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.500+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5563c31f26b0 0x5563c3398a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.500+0000 7fb55109fb80 1 --2- 172.21.15.17:0/2904724074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563c339c2d0 0x5563c3398f40 secure :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb52800bbd0 tx=0x7fb5280d1f80 comp rx=0 tx=0).stop 2023-07-14T13:22:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.500+0000 7fb55109fb80 1 -- 172.21.15.17:0/2904724074 >> 172.21.15.17:0/2904724074 conn(0x5563c338bbe0 msgr2=0x5563c339e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.500+0000 7fb51e7fc700 0 client.28966 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.504+0000 7fb55109fb80 1 -- 172.21.15.17:0/2904724074 shutdown_connections 2023-07-14T13:22:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.506+0000 7fb55109fb80 1 -- 172.21.15.17:0/2904724074 wait complete. 2023-07-14T13:22:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:22:00.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:22:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:22:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:22:00.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.510+0000 7fb55109fb80 20 client.28966 trim_cache size 0 max 16384 2023-07-14T13:22:00.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.517+0000 7fb53d7ff700 1 -- 172.21.15.17:0/315998532 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5240a1400 msgr2=0x7fb5240a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.517+0000 7fb53d7ff700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5240a1400 0x7fb5240a38b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb5381ab650 tx=0x7fb5300098e0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.517+0000 7fb53d7ff700 1 -- 172.21.15.17:0/315998532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53806d3a0 msgr2=0x7fb5381aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.517+0000 7fb53d7ff700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53806d3a0 0x7fb5381aae90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb52800b070 tx=0x7fb52800bab0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.518+0000 7fb53d7ff700 1 -- 172.21.15.17:0/315998532 shutdown_connections 2023-07-14T13:22:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.518+0000 7fb53d7ff700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5240a1400 0x7fb5240a38b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.518+0000 7fb53d7ff700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb53810e2a0 0x7fb5381a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.518+0000 7fb53d7ff700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb53806c910 0x7fb5381aa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.518+0000 7fb53d7ff700 1 --2- 172.21.15.17:0/315998532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb53806d3a0 0x7fb5381aae90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:00.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.518+0000 7fb53d7ff700 1 -- 172.21.15.17:0/315998532 >> 172.21.15.17:0/315998532 conn(0x7fb53806bd70 msgr2=0x7fb53806f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.518+0000 7fb53d7ff700 1 -- 172.21.15.17:0/315998532 shutdown_connections 2023-07-14T13:22:00.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:00.519+0000 7fb53d7ff700 1 -- 172.21.15.17:0/315998532 wait complete. 2023-07-14T13:22:01.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:01 smithi135 ceph-mon[97338]: pgmap v703: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-07-14T13:22:01.737 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:01 smithi131 ceph-mon[96953]: pgmap v703: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-07-14T13:22:01.850 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:01 smithi017 ceph-mon[95536]: pgmap v703: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-07-14T13:22:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 230.0 s, 544.4 tps, lat 184.450 ms stddev 82.590 2023-07-14T13:22:03.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:03 smithi135 ceph-mon[97338]: pgmap v704: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.7 MiB/s wr, 805 op/s 2023-07-14T13:22:03.737 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:03 smithi131 ceph-mon[96953]: pgmap v704: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.7 MiB/s wr, 805 op/s 2023-07-14T13:22:03.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:03 smithi017 ceph-mon[95536]: pgmap v704: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.7 MiB/s wr, 805 op/s 2023-07-14T13:22:05.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:05 smithi135 ceph-mon[97338]: pgmap v705: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.7 MiB/s wr, 805 op/s 2023-07-14T13:22:05.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:05 smithi135 ceph-mon[97338]: osdmap e122: 12 total, 12 up, 12 in 2023-07-14T13:22:05.737 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:05 smithi131 ceph-mon[96953]: pgmap v705: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.7 MiB/s wr, 805 op/s 2023-07-14T13:22:05.737 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:05 smithi131 ceph-mon[96953]: osdmap e122: 12 total, 12 up, 12 in 2023-07-14T13:22:05.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:05 smithi017 ceph-mon[95536]: pgmap v705: 97 pgs: 97 active+clean; 14 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 9.7 MiB/s wr, 805 op/s 2023-07-14T13:22:05.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:05 smithi017 ceph-mon[95536]: osdmap e122: 12 total, 12 up, 12 in 2023-07-14T13:22:07.440 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 235.0 s, 367.4 tps, lat 272.779 ms stddev 134.189 2023-07-14T13:22:07.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:07 smithi135 ceph-mon[97338]: pgmap v707: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.34k op/s 2023-07-14T13:22:07.689 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:07 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:22:07.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:07 smithi131 ceph-mon[96953]: pgmap v707: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.34k op/s 2023-07-14T13:22:07.739 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:07 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:22:07.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:07 smithi017 ceph-mon[95536]: pgmap v707: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.34k op/s 2023-07-14T13:22:07.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:07 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:22:09.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:09 smithi135 ceph-mon[97338]: pgmap v708: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.34k op/s 2023-07-14T13:22:09.737 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:09 smithi131 ceph-mon[96953]: pgmap v708: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.34k op/s 2023-07-14T13:22:09.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:09 smithi017 ceph-mon[95536]: pgmap v708: 97 pgs: 21 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 37 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.34k op/s 2023-07-14T13:22:11.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:11 smithi135 ceph-mon[97338]: pgmap v709: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.10k op/s 2023-07-14T13:22:11.743 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:11 smithi131 ceph-mon[96953]: pgmap v709: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.10k op/s 2023-07-14T13:22:11.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:11 smithi017 ceph-mon[95536]: pgmap v709: 97 pgs: 2 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 90 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.10k op/s 2023-07-14T13:22:12.440 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 240.0 s, 524.0 tps, lat 188.688 ms stddev 61.119 2023-07-14T13:22:12.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:12 smithi135 ceph-mon[97338]: pgmap v710: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-07-14T13:22:12.737 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:12 smithi131 ceph-mon[96953]: pgmap v710: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-07-14T13:22:12.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:12 smithi017 ceph-mon[95536]: pgmap v710: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-07-14T13:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.787+0000 7fcf59bff700 1 -- 172.21.15.17:0/3886802041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf54101fd0 msgr2=0x7fcf541023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.787+0000 7fcf59bff700 1 --2- 172.21.15.17:0/3886802041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf54101fd0 0x7fcf541023a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcf4400b0d0 tx=0x7fcf4400b3e0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.788+0000 7fcf59bff700 1 -- 172.21.15.17:0/3886802041 shutdown_connections 2023-07-14T13:22:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.788+0000 7fcf59bff700 1 --2- 172.21.15.17:0/3886802041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf54107010 0x7fcf5410ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.788+0000 7fcf59bff700 1 --2- 172.21.15.17:0/3886802041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf54101fd0 0x7fcf541023a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.788+0000 7fcf59bff700 1 --2- 172.21.15.17:0/3886802041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf54102970 0x7fcf54106930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.788+0000 7fcf59bff700 1 -- 172.21.15.17:0/3886802041 >> 172.21.15.17:0/3886802041 conn(0x7fcf540fd840 msgr2=0x7fcf540ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.789+0000 7fcf59bff700 1 -- 172.21.15.17:0/3886802041 shutdown_connections 2023-07-14T13:22:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.789+0000 7fcf59bff700 1 -- 172.21.15.17:0/3886802041 wait complete. 2023-07-14T13:22:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.791+0000 7fcf59bff700 1 Processor -- start 2023-07-14T13:22:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.791+0000 7fcf59bff700 1 -- start start 2023-07-14T13:22:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.791+0000 7fcf59bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf54101fd0 0x7fcf54071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.792+0000 7fcf59bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf54102970 0x7fcf5406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.792+0000 7fcf59bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf54107010 0x7fcf5406afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.792+0000 7fcf59bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5406b520 con 0x7fcf54107010 2023-07-14T13:22:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.792+0000 7fcf59bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5406b690 con 0x7fcf54102970 2023-07-14T13:22:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.792+0000 7fcf59bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5406b850 con 0x7fcf54101fd0 2023-07-14T13:22:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.792+0000 7fcf537fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf54101fd0 0x7fcf54071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.792+0000 7fcf537fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf54101fd0 0x7fcf54071ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52628/0 (socket says 172.21.15.17:52628) 2023-07-14T13:22:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.792+0000 7fcf537fe700 1 -- 172.21.15.17:0/2596051099 learned_addr learned my addr 172.21.15.17:0/2596051099 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.792+0000 7fcf4affd700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf54102970 0x7fcf5406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.793+0000 7fcf53fff700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf54107010 0x7fcf5406afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.793+0000 7fcf537fe700 1 -- 172.21.15.17:0/2596051099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf54102970 msgr2=0x7fcf5406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.793+0000 7fcf537fe700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf54102970 0x7fcf5406aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.793+0000 7fcf537fe700 1 -- 172.21.15.17:0/2596051099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf54107010 msgr2=0x7fcf5406afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.793+0000 7fcf537fe700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf54107010 0x7fcf5406afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.793+0000 7fcf537fe700 1 -- 172.21.15.17:0/2596051099 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44009d00 con 0x7fcf54101fd0 2023-07-14T13:22:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.793+0000 7fcf537fe700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf54101fd0 0x7fcf54071ca0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcf44000f80 tx=0x7fcf44009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.794+0000 7fcf517fa700 1 -- 172.21.15.17:0/2596051099 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400e040 con 0x7fcf54101fd0 2023-07-14T13:22:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.794+0000 7fcf517fa700 1 -- 172.21.15.17:0/2596051099 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf4401d690 con 0x7fcf54101fd0 2023-07-14T13:22:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.794+0000 7fcf517fa700 1 -- 172.21.15.17:0/2596051099 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf44005280 con 0x7fcf54101fd0 2023-07-14T13:22:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.794+0000 7fcf59bff700 1 -- 172.21.15.17:0/2596051099 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5406f830 con 0x7fcf54101fd0 2023-07-14T13:22:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.795+0000 7fcf59bff700 1 -- 172.21.15.17:0/2596051099 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5406fcf0 con 0x7fcf54101fd0 2023-07-14T13:22:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.802+0000 7fcf6d449b80 1 Processor -- start 2023-07-14T13:22:13.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.804+0000 7fcf517fa700 1 -- 172.21.15.17:0/2596051099 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcf4401dae0 con 0x7fcf54101fd0 2023-07-14T13:22:13.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.804+0000 7fcf6d449b80 1 -- start start 2023-07-14T13:22:13.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.804+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x5617450725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.804+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 0x56174506c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.804+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x56174506d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.805+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561744f69c50 con 0x561745072ae0 2023-07-14T13:22:13.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.805+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561744fbc9e0 con 0x561744ec06b0 2023-07-14T13:22:13.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.805+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561744fb5e70 con 0x56174506cd90 2023-07-14T13:22:13.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.805+0000 7fcf53fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x5617450725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.805+0000 7fcf53fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x5617450725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44894/0 (socket says 172.21.15.17:44894) 2023-07-14T13:22:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.805+0000 7fcf53fff700 1 -- 172.21.15.17:0/1654967901 learned_addr learned my addr 172.21.15.17:0/1654967901 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.806+0000 7fcf53fff700 1 -- 172.21.15.17:0/1654967901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 msgr2=0x56174506d1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:22:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.806+0000 7fcf53fff700 1 --2- 172.21.15.17:0/1654967901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x56174506d1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.806+0000 7fcf53fff700 1 -- 172.21.15.17:0/1654967901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 msgr2=0x56174506c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.807+0000 7fcf53fff700 1 --2- 172.21.15.17:0/1654967901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 0x56174506c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.807+0000 7fcf53fff700 1 -- 172.21.15.17:0/1654967901 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561744de3d80 con 0x561744ec06b0 2023-07-14T13:22:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.807+0000 7fcf517fa700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcf400a13c0 0x7fcf400a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.807+0000 7fcf53fff700 1 --2- 172.21.15.17:0/1654967901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x5617450725a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00dbd0 tx=0x7fcf4c00dee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c37c6ce92dc366 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.807+0000 7fcf517fa700 1 -- 172.21.15.17:0/2596051099 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fcf440ce560 con 0x7fcf54101fd0 2023-07-14T13:22:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.809+0000 7fcf537fe700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcf400a13c0 0x7fcf400a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.809+0000 7fcf49ffb700 1 -- 172.21.15.17:0/1654967901 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00fb70 con 0x561744ec06b0 2023-07-14T13:22:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.810+0000 7fcf49ffb700 1 -- 172.21.15.17:0/1654967901 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf4c00fcd0 con 0x561744ec06b0 2023-07-14T13:22:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.810+0000 7fcf49ffb700 1 -- 172.21.15.17:0/1654967901 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c011730 con 0x561744ec06b0 2023-07-14T13:22:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.810+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1654967901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 msgr2=0x5617450725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.810+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/1654967901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x5617450725a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00dbd0 tx=0x7fcf4c00dee0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.812+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1654967901 shutdown_connections 2023-07-14T13:22:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.812+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/1654967901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x56174506d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.812+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/1654967901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x5617450725a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.812+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/1654967901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 0x56174506c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.812+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1654967901 >> 172.21.15.17:0/1654967901 conn(0x561745059be0 msgr2=0x56174505ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.813+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1654967901 shutdown_connections 2023-07-14T13:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.813+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1654967901 wait complete. 2023-07-14T13:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.813+0000 7fcf537fe700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcf400a13c0 0x7fcf400a3870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x561745060b40 tx=0x7fcf44009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.814+0000 7fcf6d449b80 1 -- start start 2023-07-14T13:22:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.814+0000 7fcf6d449b80 1 Processor -- start 2023-07-14T13:22:13.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.815+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561744ec06b0 0x561745076110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.815+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56174506cd90 0x561745076650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.815+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 0x561745076b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.815+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561744f55a60 con 0x561745072ae0 2023-07-14T13:22:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.815+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561744f55760 con 0x56174506cd90 2023-07-14T13:22:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.815+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561744e398c0 con 0x561744ec06b0 2023-07-14T13:22:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.815+0000 7fcf6d449b80 10 client.0 _ll_register_callbacks cb 0x561744f53700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.816+0000 7fcf53fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561744ec06b0 0x561745076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.816+0000 7fcf53fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561744ec06b0 0x561745076110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52650/0 (socket says 172.21.15.17:52650) 2023-07-14T13:22:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.816+0000 7fcf53fff700 1 -- 172.21.15.17:0/2795889563 learned_addr learned my addr 172.21.15.17:0/2795889563 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.816+0000 7fcf53fff700 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 0x561745076b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.816+0000 7fcf4affd700 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56174506cd90 0x561745076650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.816+0000 7fcf53fff700 1 -- 172.21.15.17:0/2795889563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56174506cd90 msgr2=0x561745076650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.817+0000 7fcf53fff700 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56174506cd90 0x561745076650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.817+0000 7fcf53fff700 1 -- 172.21.15.17:0/2795889563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 msgr2=0x561745076b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.817+0000 7fcf53fff700 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 0x561745076b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.817+0000 7fcf53fff700 1 -- 172.21.15.17:0/2795889563 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c00d800 con 0x561744ec06b0 2023-07-14T13:22:13.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.817+0000 7fcf4affd700 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56174506cd90 0x561745076650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:22:13.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.817+0000 7fcf53fff700 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561744ec06b0 0x561745076110 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c01ae30 tx=0x7fcf4c01ae90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8470ba7bf8372d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:13.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.817+0000 7fcf32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:22:13.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.817+0000 7fcf32ffd700 1 -- 172.21.15.17:0/2795889563 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c01a670 con 0x561744ec06b0 2023-07-14T13:22:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.817+0000 7fcf32ffd700 1 -- 172.21.15.17:0/2795889563 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fcf4c01a7d0 con 0x561744ec06b0 2023-07-14T13:22:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.818+0000 7fcf6d449b80 1 -- 172.21.15.17:0/2795889563 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561744f0f490 con 0x561744ec06b0 2023-07-14T13:22:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.818+0000 7fcf32ffd700 1 -- 172.21.15.17:0/2795889563 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf4c01a990 con 0x561744ec06b0 2023-07-14T13:22:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.818+0000 7fcf6d449b80 10 client.28975 fetch_fsmap learned FSMap version 54 2023-07-14T13:22:13.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.818+0000 7fcf6d449b80 1 -- 172.21.15.17:0/2795889563 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x561744dccc00 con 0x561744ec06b0 2023-07-14T13:22:13.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.819+0000 7fcf32ffd700 1 -- 172.21.15.17:0/2795889563 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561744f0f490 con 0x561744ec06b0 2023-07-14T13:22:13.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.819+0000 7fcf32ffd700 1 -- 172.21.15.17:0/2795889563 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fcf4c011440 con 0x561744ec06b0 2023-07-14T13:22:13.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.819+0000 7fcf6d449b80 10 client.28975 fetch_fsmap finished waiting for FSMap version 54 2023-07-14T13:22:13.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.819+0000 7fcf6d449b80 10 client.28975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:22:13.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.819+0000 7fcf6d449b80 20 client.28975 populate_metadata read hostname 'smithi017' 2023-07-14T13:22:13.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.819+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561745086200 0x561745088610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.819+0000 7fcf6d449b80 4 client.28975 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:22:13.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.819+0000 7fcf6d449b80 1 -- 172.21.15.17:0/2795889563 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561744faee50 con 0x561745086200 2023-07-14T13:22:13.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.820+0000 7fcf4affd700 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561745086200 0x561745088610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.821+0000 7fcf4affd700 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561745086200 0x561745088610 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec0ff56fe73906a7 server_cookie=99df63784a7bd3b6 in_seq=0 out_seq=0 2023-07-14T13:22:13.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.821+0000 7fcf32ffd700 10 client.28975 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:13.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.821+0000 7fcf32ffd700 1 -- 172.21.15.17:0/2795889563 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561744faee50 con 0x561745086200 2023-07-14T13:22:13.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.821+0000 7fcf32ffd700 10 client.28975 handle_command_reply: tid=0 2023-07-14T13:22:13.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.822+0000 7fcf6d449b80 1 client.28975 shutdown 2023-07-14T13:22:13.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.822+0000 7fcf6d449b80 1 -- 172.21.15.17:0/2795889563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561744ec06b0 msgr2=0x561745076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:13.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.822+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561744ec06b0 0x561745076110 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c01ae30 tx=0x7fcf4c01ae90 comp rx=0 tx=0).stop 2023-07-14T13:22:13.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.822+0000 7fcf6d449b80 1 -- 172.21.15.17:0/2795889563 shutdown_connections 2023-07-14T13:22:13.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.822+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561745086200 0x561745088610 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.822+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 0x561745076b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.822+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561744ec06b0 0x561745076110 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.822+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/2795889563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56174506cd90 0x561745076650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.822+0000 7fcf6d449b80 1 -- 172.21.15.17:0/2795889563 >> 172.21.15.17:0/2795889563 conn(0x561745059be0 msgr2=0x56174505e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:13.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.823+0000 7fcf32ffd700 0 client.28975 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:13.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.823+0000 7fcf6d449b80 1 -- 172.21.15.17:0/2795889563 shutdown_connections 2023-07-14T13:22:13.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.823+0000 7fcf6d449b80 1 -- 172.21.15.17:0/2795889563 wait complete. 2023-07-14T13:22:13.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.823+0000 7fcf6d449b80 20 client.28975 trim_cache size 0 max 16384 2023-07-14T13:22:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.850+0000 7fcf6d449b80 1 Processor -- start 2023-07-14T13:22:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.851+0000 7fcf6d449b80 1 -- start start 2023-07-14T13:22:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.851+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561744ec06b0 0x56174506c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.851+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x56174507d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.851+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561745072ae0 0x5617450719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.851+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561744f0f4c0 con 0x561744ec06b0 2023-07-14T13:22:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.851+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561745077110 con 0x561745072ae0 2023-07-14T13:22:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.852+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561745060b70 con 0x56174506cd90 2023-07-14T13:22:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.851+0000 7fcf4affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x56174507d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.852+0000 7fcf4affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x56174507d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52652/0 (socket says 172.21.15.17:52652) 2023-07-14T13:22:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.852+0000 7fcf4affd700 1 -- 172.21.15.17:0/3829196130 learned_addr learned my addr 172.21.15.17:0/3829196130 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.852+0000 7fcf4affd700 1 -- 172.21.15.17:0/3829196130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561745072ae0 msgr2=0x5617450719c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:22:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.852+0000 7fcf4affd700 1 --2- 172.21.15.17:0/3829196130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561745072ae0 0x5617450719c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.852+0000 7fcf4affd700 1 -- 172.21.15.17:0/3829196130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561744ec06b0 msgr2=0x56174506c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.852+0000 7fcf4affd700 1 --2- 172.21.15.17:0/3829196130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561744ec06b0 0x56174506c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.852+0000 7fcf4affd700 1 -- 172.21.15.17:0/3829196130 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56174506d430 con 0x56174506cd90 2023-07-14T13:22:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.853+0000 7fcf4affd700 1 --2- 172.21.15.17:0/3829196130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x56174507d470 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c000c00 tx=0x7fcf3c0073d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2d34bf650f5dd60 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.853+0000 7fcf4a7fc700 1 -- 172.21.15.17:0/3829196130 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c01a5e0 con 0x56174506cd90 2023-07-14T13:22:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.853+0000 7fcf4a7fc700 1 -- 172.21.15.17:0/3829196130 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf3c01ad60 con 0x56174506cd90 2023-07-14T13:22:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.853+0000 7fcf4a7fc700 1 -- 172.21.15.17:0/3829196130 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c012450 con 0x56174506cd90 2023-07-14T13:22:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.854+0000 7fcf6d449b80 1 -- 172.21.15.17:0/3829196130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 msgr2=0x56174507d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.854+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/3829196130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x56174507d470 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c000c00 tx=0x7fcf3c0073d0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.854+0000 7fcf6d449b80 1 -- 172.21.15.17:0/3829196130 shutdown_connections 2023-07-14T13:22:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.854+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/3829196130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561745072ae0 0x5617450719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.854+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/3829196130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561744ec06b0 0x56174506c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.854+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/3829196130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x56174507d470 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.854+0000 7fcf6d449b80 1 -- 172.21.15.17:0/3829196130 >> 172.21.15.17:0/3829196130 conn(0x561745059be0 msgr2=0x5617450712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.854+0000 7fcf6d449b80 1 -- 172.21.15.17:0/3829196130 shutdown_connections 2023-07-14T13:22:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.855+0000 7fcf6d449b80 1 -- 172.21.15.17:0/3829196130 wait complete. 2023-07-14T13:22:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.855+0000 7fcf6d449b80 1 -- start start 2023-07-14T13:22:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.855+0000 7fcf6d449b80 1 Processor -- start 2023-07-14T13:22:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.856+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x561745061020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.856+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x561745063570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.856+0000 7fcf6d449b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 0x561745065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.856+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561745066090 con 0x561745072ae0 2023-07-14T13:22:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.856+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561745066200 con 0x561744ec06b0 2023-07-14T13:22:13.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.856+0000 7fcf6d449b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617450663c0 con 0x56174506cd90 2023-07-14T13:22:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.856+0000 7fcf6d449b80 10 client.0 _ll_register_callbacks cb 0x7fcf4c00da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:22:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.857+0000 7fcf53fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x561745061020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.857+0000 7fcf53fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x561745061020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44920/0 (socket says 172.21.15.17:44920) 2023-07-14T13:22:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.857+0000 7fcf53fff700 1 -- 172.21.15.17:0/1780328338 learned_addr learned my addr 172.21.15.17:0/1780328338 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.857+0000 7fcf53fff700 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 0x561745065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.857+0000 7fcf4affd700 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x561745063570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.857+0000 7fcf53fff700 1 -- 172.21.15.17:0/1780328338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 msgr2=0x561745063570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.857+0000 7fcf53fff700 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x561745063570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.857+0000 7fcf53fff700 1 -- 172.21.15.17:0/1780328338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 msgr2=0x561745065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:13.880 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.857+0000 7fcf53fff700 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 0x561745065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.857+0000 7fcf53fff700 1 -- 172.21.15.17:0/1780328338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c007c00 con 0x561744ec06b0 2023-07-14T13:22:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.858+0000 7fcf53fff700 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x561745061020 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c005cb0 tx=0x7fcf4c005c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6c3799f1bc0f1be server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.858+0000 7fcf32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:22:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.859+0000 7fcf32ffd700 1 -- 172.21.15.17:0/1780328338 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c011a40 con 0x561744ec06b0 2023-07-14T13:22:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.859+0000 7fcf32ffd700 1 -- 172.21.15.17:0/1780328338 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fcf4c000e40 con 0x561744ec06b0 2023-07-14T13:22:13.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.860+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1780328338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf4c00fcd0 con 0x561744ec06b0 2023-07-14T13:22:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.860+0000 7fcf32ffd700 1 -- 172.21.15.17:0/1780328338 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf4c01a670 con 0x561744ec06b0 2023-07-14T13:22:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.860+0000 7fcf6d449b80 10 client.29018 fetch_fsmap learned FSMap version 54 2023-07-14T13:22:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.860+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1780328338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x561744e0a1f0 con 0x561744ec06b0 2023-07-14T13:22:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.861+0000 7fcf32ffd700 1 -- 172.21.15.17:0/1780328338 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf4c00fcd0 con 0x561744ec06b0 2023-07-14T13:22:13.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.861+0000 7fcf32ffd700 1 -- 172.21.15.17:0/1780328338 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 54) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fcf4c010740 con 0x561744ec06b0 2023-07-14T13:22:13.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.861+0000 7fcf6d449b80 10 client.29018 fetch_fsmap finished waiting for FSMap version 54 2023-07-14T13:22:13.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.861+0000 7fcf6d449b80 10 client.29018 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:22:13.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.861+0000 7fcf6d449b80 20 client.29018 populate_metadata read hostname 'smithi017' 2023-07-14T13:22:13.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.861+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561745067770 0x561745067b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:13.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.861+0000 7fcf6d449b80 4 client.29018 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:22:13.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.861+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1780328338 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561744f70ff0 con 0x561745067770 2023-07-14T13:22:13.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.862+0000 7fcf4affd700 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561745067770 0x561745067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:13.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.863+0000 7fcf4affd700 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561745067770 0x561745067b70 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bdd59b552e533cb server_cookie=e04499e96e9a7087 in_seq=0 out_seq=0 2023-07-14T13:22:13.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.863+0000 7fcf32ffd700 10 client.29018 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.895+0000 7fcf32ffd700 1 -- 172.21.15.17:0/1780328338 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561744f70ff0 con 0x561745067770 2023-07-14T13:22:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.895+0000 7fcf32ffd700 10 client.29018 handle_command_reply: tid=0 2023-07-14T13:22:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.895+0000 7fcf6d449b80 1 client.29018 shutdown 2023-07-14T13:22:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.896+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1780328338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 msgr2=0x561745061020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.896+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x561745061020 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c005cb0 tx=0x7fcf4c005c20 comp rx=0 tx=0).stop 2023-07-14T13:22:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.896+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1780328338 shutdown_connections 2023-07-14T13:22:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.896+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561745067770 0x561745067b70 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.896+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561745072ae0 0x561745065ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.896+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561744ec06b0 0x561745061020 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.896+0000 7fcf6d449b80 1 --2- 172.21.15.17:0/1780328338 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56174506cd90 0x561745063570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.896+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1780328338 >> 172.21.15.17:0/1780328338 conn(0x561745059be0 msgr2=0x5617450760d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.896+0000 7fcf32ffd700 0 client.29018 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.897+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1780328338 shutdown_connections 2023-07-14T13:22:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.897+0000 7fcf6d449b80 1 -- 172.21.15.17:0/1780328338 wait complete. 2023-07-14T13:22:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.897+0000 7fcf6d449b80 20 client.29018 trim_cache size 0 max 16384 2023-07-14T13:22:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:22:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:22:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:22:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:22:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.898+0000 7fcf59bff700 1 -- 172.21.15.17:0/2596051099 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcf400a13c0 msgr2=0x7fcf400a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.898+0000 7fcf59bff700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcf400a13c0 0x7fcf400a3870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x561745060b40 tx=0x7fcf44009040 comp rx=0 tx=0).stop 2023-07-14T13:22:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.898+0000 7fcf59bff700 1 -- 172.21.15.17:0/2596051099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf54101fd0 msgr2=0x7fcf54071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.898+0000 7fcf59bff700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf54101fd0 0x7fcf54071ca0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcf44000f80 tx=0x7fcf44009360 comp rx=0 tx=0).stop 2023-07-14T13:22:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.899+0000 7fcf59bff700 1 -- 172.21.15.17:0/2596051099 shutdown_connections 2023-07-14T13:22:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.899+0000 7fcf59bff700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcf400a13c0 0x7fcf400a3870 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.899+0000 7fcf59bff700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf54107010 0x7fcf5406afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.899+0000 7fcf59bff700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf54101fd0 0x7fcf54071ca0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.899+0000 7fcf59bff700 1 --2- 172.21.15.17:0/2596051099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf54102970 0x7fcf5406aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.899+0000 7fcf59bff700 1 -- 172.21.15.17:0/2596051099 >> 172.21.15.17:0/2596051099 conn(0x7fcf540fd840 msgr2=0x7fcf54105970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.899+0000 7fcf59bff700 1 -- 172.21.15.17:0/2596051099 shutdown_connections 2023-07-14T13:22:13.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:13.899+0000 7fcf59bff700 1 -- 172.21.15.17:0/2596051099 wait complete. 2023-07-14T13:22:15.596 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:15 smithi017 ceph-mon[95536]: pgmap v711: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-07-14T13:22:15.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:15 smithi135 ceph-mon[97338]: pgmap v711: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-07-14T13:22:15.737 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:15 smithi131 ceph-mon[96953]: pgmap v711: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-07-14T13:22:17.439 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 245.0 s, 350.0 tps, lat 281.062 ms stddev 474.974 2023-07-14T13:22:17.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:17 smithi135 ceph-mon[97338]: pgmap v712: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.53k op/s 2023-07-14T13:22:17.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:17 smithi135 ceph-mon[97338]: osdmap e123: 12 total, 12 up, 12 in 2023-07-14T13:22:17.736 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:17 smithi131 ceph-mon[96953]: pgmap v712: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.53k op/s 2023-07-14T13:22:17.737 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:17 smithi131 ceph-mon[96953]: osdmap e123: 12 total, 12 up, 12 in 2023-07-14T13:22:17.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:17 smithi017 ceph-mon[95536]: pgmap v712: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.53k op/s 2023-07-14T13:22:17.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:17 smithi017 ceph-mon[95536]: osdmap e123: 12 total, 12 up, 12 in 2023-07-14T13:22:18.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:18 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:22:18.736 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:18 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:22:18.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:18 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:22:19.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:19 smithi135 ceph-mon[97338]: pgmap v714: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:22:19.736 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:19 smithi131 ceph-mon[96953]: pgmap v714: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:22:19.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:19 smithi017 ceph-mon[95536]: pgmap v714: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:22:21.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:21 smithi135 ceph-mon[97338]: pgmap v715: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.20k op/s 2023-07-14T13:22:21.736 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:21 smithi131 ceph-mon[96953]: pgmap v715: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.20k op/s 2023-07-14T13:22:21.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:21 smithi017 ceph-mon[95536]: pgmap v715: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.20k op/s 2023-07-14T13:22:22.439 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 250.0 s, 514.6 tps, lat 196.680 ms stddev 96.787 2023-07-14T13:22:23.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:23 smithi135 ceph-mon[97338]: pgmap v716: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:22:23.736 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:23 smithi131 ceph-mon[96953]: pgmap v716: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:22:23.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:23 smithi017 ceph-mon[95536]: pgmap v716: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:22:25.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:25 smithi135 ceph-mon[97338]: pgmap v717: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:22:25.736 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:25 smithi131 ceph-mon[96953]: pgmap v717: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:22:25.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:25 smithi017 ceph-mon[95536]: pgmap v717: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:22:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.155+0000 7f5a677ff700 1 -- 172.21.15.17:0/4257565877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60104a60 msgr2=0x7f5a600679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.155+0000 7f5a677ff700 1 --2- 172.21.15.17:0/4257565877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60104a60 0x7f5a600679a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009990 tx=0x7f5a5c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.156+0000 7f5a677ff700 1 -- 172.21.15.17:0/4257565877 shutdown_connections 2023-07-14T13:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.156+0000 7f5a677ff700 1 --2- 172.21.15.17:0/4257565877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a601024f0 0x7f5a60102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.156+0000 7f5a677ff700 1 --2- 172.21.15.17:0/4257565877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60104a60 0x7f5a600679a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.156+0000 7f5a677ff700 1 --2- 172.21.15.17:0/4257565877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a60067ee0 0x7f5a60068350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.156+0000 7f5a677ff700 1 -- 172.21.15.17:0/4257565877 >> 172.21.15.17:0/4257565877 conn(0x7f5a60074760 msgr2=0x7f5a60074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.158+0000 7f5a677ff700 1 -- 172.21.15.17:0/4257565877 shutdown_connections 2023-07-14T13:22:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.158+0000 7f5a677ff700 1 -- 172.21.15.17:0/4257565877 wait complete. 2023-07-14T13:22:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.159+0000 7f5a677ff700 1 Processor -- start 2023-07-14T13:22:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.159+0000 7f5a677ff700 1 -- start start 2023-07-14T13:22:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.160+0000 7f5a677ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60067ee0 0x7f5a60112bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.160+0000 7f5a677ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a601024f0 0x7f5a60113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.160+0000 7f5a677ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a60104a60 0x7f5a6010baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.160+0000 7f5a677ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6010c270 con 0x7f5a60104a60 2023-07-14T13:22:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.160+0000 7f5a677ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6010c3e0 con 0x7f5a601024f0 2023-07-14T13:22:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.160+0000 7f5a677ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6010c5a0 con 0x7f5a60067ee0 2023-07-14T13:22:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.161+0000 7f5a65d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a60104a60 0x7f5a6010baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.161+0000 7f5a65d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a60104a60 0x7f5a6010baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58432/0 (socket says 172.21.15.17:58432) 2023-07-14T13:22:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.161+0000 7f5a65d9c700 1 -- 172.21.15.17:0/2507142182 learned_addr learned my addr 172.21.15.17:0/2507142182 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.161+0000 7f5a6559b700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60067ee0 0x7f5a60112bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.162+0000 7f5a65d9c700 1 -- 172.21.15.17:0/2507142182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60067ee0 msgr2=0x7f5a60112bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.162+0000 7f5a65d9c700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60067ee0 0x7f5a60112bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.162+0000 7f5a65d9c700 1 -- 172.21.15.17:0/2507142182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a601024f0 msgr2=0x7f5a60113150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.162+0000 7f5a65d9c700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a601024f0 0x7f5a60113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.162+0000 7f5a65d9c700 1 -- 172.21.15.17:0/2507142182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c0095f0 con 0x7f5a60104a60 2023-07-14T13:22:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.164+0000 7f5a65d9c700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a60104a60 0x7f5a6010baa0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007ee0 tx=0x7f5a5800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.164+0000 7f5a527fc700 1 -- 172.21.15.17:0/2507142182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58017070 con 0x7f5a60104a60 2023-07-14T13:22:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.165+0000 7f5a527fc700 1 -- 172.21.15.17:0/2507142182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a5800f040 con 0x7f5a60104a60 2023-07-14T13:22:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.165+0000 7f5a527fc700 1 -- 172.21.15.17:0/2507142182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58005710 con 0x7f5a60104a60 2023-07-14T13:22:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.165+0000 7f5a677ff700 1 -- 172.21.15.17:0/2507142182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a60110760 con 0x7f5a60104a60 2023-07-14T13:22:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.165+0000 7f5a677ff700 1 -- 172.21.15.17:0/2507142182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a60110c20 con 0x7f5a60104a60 2023-07-14T13:22:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.172+0000 7f5a7b076b80 1 Processor -- start 2023-07-14T13:22:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.172+0000 7f5a527fc700 1 -- 172.21.15.17:0/2507142182 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5a58005870 con 0x7f5a60104a60 2023-07-14T13:22:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.173+0000 7f5a7b076b80 1 -- start start 2023-07-14T13:22:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.173+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a7436b0 0x559e8a8ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.173+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a8ed2d0 0x559e8a8e7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.174+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 0x559e8a8e79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.174+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a7ecc50 con 0x559e8a7436b0 2023-07-14T13:22:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.174+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a83f9e0 con 0x559e8a8ed2d0 2023-07-14T13:22:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.174+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a838e70 con 0x559e8a8e7580 2023-07-14T13:22:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.176+0000 7f5a527fc700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a4c0a14d0 0x7f5a4c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.176+0000 7f5a527fc700 1 -- 172.21.15.17:0/2507142182 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5a580cbaf0 con 0x7f5a60104a60 2023-07-14T13:22:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.176+0000 7f5a64d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a7436b0 0x559e8a8ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.176+0000 7f5a64d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a7436b0 0x559e8a8ecd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58448/0 (socket says 172.21.15.17:58448) 2023-07-14T13:22:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.176+0000 7f5a64d9a700 1 -- 172.21.15.17:0/447420043 learned_addr learned my addr 172.21.15.17:0/447420043 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.176+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/447420043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 0x559e8a8e79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.177+0000 7f5a64d9a700 1 -- 172.21.15.17:0/447420043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a8ed2d0 msgr2=0x559e8a8e7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.177+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/447420043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a8ed2d0 0x559e8a8e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.177+0000 7f5a64d9a700 1 -- 172.21.15.17:0/447420043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a7436b0 msgr2=0x559e8a8ecd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:27.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.177+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/447420043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a7436b0 0x559e8a8ecd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.177+0000 7f5a64d9a700 1 -- 172.21.15.17:0/447420043 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e8a666d80 con 0x559e8a8e7580 2023-07-14T13:22:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.177+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/447420043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 0x559e8a8e79d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5a54013890 tx=0x7f5a540058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b264015cbdada65 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.178+0000 7f5a65d9c700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a4c0a14d0 0x7f5a4c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.178+0000 7f5a4b7fe700 1 -- 172.21.15.17:0/447420043 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a540132d0 con 0x559e8a8e7580 2023-07-14T13:22:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.178+0000 7f5a4b7fe700 1 -- 172.21.15.17:0/447420043 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a54019070 con 0x559e8a8e7580 2023-07-14T13:22:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.178+0000 7f5a4b7fe700 1 -- 172.21.15.17:0/447420043 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54003c40 con 0x559e8a8e7580 2023-07-14T13:22:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.179+0000 7f5a7b076b80 1 -- 172.21.15.17:0/447420043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 msgr2=0x559e8a8e79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:27.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.179+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/447420043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 0x559e8a8e79d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5a54013890 tx=0x7f5a540058e0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.180+0000 7f5a7b076b80 1 -- 172.21.15.17:0/447420043 shutdown_connections 2023-07-14T13:22:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.180+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/447420043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 0x559e8a8e79d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.180+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/447420043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a7436b0 0x559e8a8ecd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.180+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/447420043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a8ed2d0 0x559e8a8e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.180+0000 7f5a7b076b80 1 -- 172.21.15.17:0/447420043 >> 172.21.15.17:0/447420043 conn(0x559e8a8dcbe0 msgr2=0x559e8a8e1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:27.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.180+0000 7f5a7b076b80 1 -- 172.21.15.17:0/447420043 shutdown_connections 2023-07-14T13:22:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.181+0000 7f5a65d9c700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a4c0a14d0 0x7f5a4c0a3980 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5a580c9260 tx=0x7f5a5800b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.181+0000 7f5a7b076b80 1 -- 172.21.15.17:0/447420043 wait complete. 2023-07-14T13:22:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.182+0000 7f5a7b076b80 1 -- start start 2023-07-14T13:22:27.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.182+0000 7f5a7b076b80 1 Processor -- start 2023-07-14T13:22:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.183+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a7436b0 0x559e8a8f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.183+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a8e7580 0x559e8a8f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.183+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.183+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a7d8a60 con 0x559e8a7436b0 2023-07-14T13:22:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.183+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a7d8760 con 0x559e8a8e7580 2023-07-14T13:22:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.183+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a6bc8c0 con 0x559e8a8ed2d0 2023-07-14T13:22:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.183+0000 7f5a7b076b80 10 client.0 _ll_register_callbacks cb 0x559e8a7d6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:22:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.184+0000 7f5a64d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.184+0000 7f5a64d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:56420/0 (socket says 172.21.15.17:56420) 2023-07-14T13:22:27.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.184+0000 7f5a64d9a700 1 -- 172.21.15.17:0/2558678241 learned_addr learned my addr 172.21.15.17:0/2558678241 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.184+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a7436b0 0x559e8a8f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.185+0000 7f5a6559b700 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a8e7580 0x559e8a8f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.185+0000 7f5a64d9a700 1 -- 172.21.15.17:0/2558678241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a8e7580 msgr2=0x559e8a8f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.185+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a8e7580 0x559e8a8f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.185+0000 7f5a64d9a700 1 -- 172.21.15.17:0/2558678241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a7436b0 msgr2=0x559e8a8f09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.185+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a7436b0 0x559e8a8f09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.185+0000 7f5a64d9a700 1 -- 172.21.15.17:0/2558678241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a54013540 con 0x559e8a8ed2d0 2023-07-14T13:22:27.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.185+0000 7f5a6559b700 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a8e7580 0x559e8a8f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:22:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.185+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f1440 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5a540037b0 tx=0x7f5a54009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d53e1626e94bc77f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.186+0000 7f5a48ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:22:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.186+0000 7f5a48ff9700 1 -- 172.21.15.17:0/2558678241 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54011850 con 0x559e8a8ed2d0 2023-07-14T13:22:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.186+0000 7f5a48ff9700 1 -- 172.21.15.17:0/2558678241 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5a54000e40 con 0x559e8a8ed2d0 2023-07-14T13:22:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.186+0000 7f5a7b076b80 1 -- 172.21.15.17:0/2558678241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e8a792490 con 0x559e8a8ed2d0 2023-07-14T13:22:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.186+0000 7f5a48ff9700 1 -- 172.21.15.17:0/2558678241 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a54021440 con 0x559e8a8ed2d0 2023-07-14T13:22:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.186+0000 7f5a7b076b80 10 client.28993 fetch_fsmap learned FSMap version 55 2023-07-14T13:22:27.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.186+0000 7f5a7b076b80 1 -- 172.21.15.17:0/2558678241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x559e8a64fc00 con 0x559e8a8ed2d0 2023-07-14T13:22:27.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.187+0000 7f5a48ff9700 1 -- 172.21.15.17:0/2558678241 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559e8a792490 con 0x559e8a8ed2d0 2023-07-14T13:22:27.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.187+0000 7f5a48ff9700 1 -- 172.21.15.17:0/2558678241 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5a5402d420 con 0x559e8a8ed2d0 2023-07-14T13:22:27.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.187+0000 7f5a7b076b80 10 client.28993 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:22:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.187+0000 7f5a7b076b80 10 client.28993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:22:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.187+0000 7f5a7b076b80 20 client.28993 populate_metadata read hostname 'smithi017' 2023-07-14T13:22:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.187+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e8a900c00 0x559e8a903010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.187+0000 7f5a7b076b80 4 client.28993 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:22:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.187+0000 7f5a7b076b80 1 -- 172.21.15.17:0/2558678241 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e8a831e50 con 0x559e8a900c00 2023-07-14T13:22:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.188+0000 7f5a6559b700 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e8a900c00 0x559e8a903010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.189+0000 7f5a6559b700 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e8a900c00 0x559e8a903010 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73fa9b6043f50a9b server_cookie=94857d863dd48045 in_seq=0 out_seq=0 2023-07-14T13:22:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.189+0000 7f5a48ff9700 10 client.28993 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.189+0000 7f5a48ff9700 1 -- 172.21.15.17:0/2558678241 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559e8a831e50 con 0x559e8a900c00 2023-07-14T13:22:27.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.189+0000 7f5a48ff9700 10 client.28993 handle_command_reply: tid=0 2023-07-14T13:22:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.190+0000 7f5a7b076b80 1 client.28993 shutdown 2023-07-14T13:22:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.190+0000 7f5a7b076b80 1 -- 172.21.15.17:0/2558678241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 msgr2=0x559e8a8f1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:27.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.190+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f1440 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5a540037b0 tx=0x7f5a54009bd0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.191+0000 7f5a7b076b80 1 -- 172.21.15.17:0/2558678241 shutdown_connections 2023-07-14T13:22:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.191+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e8a900c00 0x559e8a903010 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.191+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f1440 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.191+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a7436b0 0x559e8a8f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.191+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/2558678241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a8e7580 0x559e8a8f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.191+0000 7f5a7b076b80 1 -- 172.21.15.17:0/2558678241 >> 172.21.15.17:0/2558678241 conn(0x559e8a8dcbe0 msgr2=0x559e8a8e14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.191+0000 7f5a48ff9700 0 client.28993 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.191+0000 7f5a7b076b80 1 -- 172.21.15.17:0/2558678241 shutdown_connections 2023-07-14T13:22:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.191+0000 7f5a7b076b80 1 -- 172.21.15.17:0/2558678241 wait complete. 2023-07-14T13:22:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.192+0000 7f5a7b076b80 20 client.28993 trim_cache size 0 max 16384 2023-07-14T13:22:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.223+0000 7f5a7b076b80 1 Processor -- start 2023-07-14T13:22:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.224+0000 7f5a7b076b80 1 -- start start 2023-07-14T13:22:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.224+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a7436b0 0x559e8a8e7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.224+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 0x559e8a8f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.224+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a8ed2d0 0x559e8a8ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.225+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a8f3a00 con 0x559e8a8ed2d0 2023-07-14T13:22:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.225+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a8ded00 con 0x559e8a7436b0 2023-07-14T13:22:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.225+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a8e2b20 con 0x559e8a8e7580 2023-07-14T13:22:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.232+0000 7f5a6559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 0x559e8a8f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.232+0000 7f5a6559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 0x559e8a8f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:56430/0 (socket says 172.21.15.17:56430) 2023-07-14T13:22:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.232+0000 7f5a6559b700 1 -- 172.21.15.17:0/51021906 learned_addr learned my addr 172.21.15.17:0/51021906 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.232+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/51021906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a7436b0 0x559e8a8e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.232+0000 7f5a6559b700 1 -- 172.21.15.17:0/51021906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a7436b0 msgr2=0x559e8a8e7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.232+0000 7f5a6559b700 1 --2- 172.21.15.17:0/51021906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a7436b0 0x559e8a8e7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.232+0000 7f5a6559b700 1 -- 172.21.15.17:0/51021906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a8ed2d0 msgr2=0x559e8a8ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.232+0000 7f5a6559b700 1 --2- 172.21.15.17:0/51021906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a8ed2d0 0x559e8a8ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.232+0000 7f5a6559b700 1 -- 172.21.15.17:0/51021906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e8a68d1f0 con 0x559e8a8e7580 2023-07-14T13:22:27.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.233+0000 7f5a6559b700 1 --2- 172.21.15.17:0/51021906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 0x559e8a8f7c60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c015000 tx=0x7f5a5c0093b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55d2bb4ea4c4aed2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.233+0000 7f5a4bfff700 1 -- 172.21.15.17:0/51021906 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c026610 con 0x559e8a8e7580 2023-07-14T13:22:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.234+0000 7f5a4bfff700 1 -- 172.21.15.17:0/51021906 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a5c01e040 con 0x559e8a8e7580 2023-07-14T13:22:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.234+0000 7f5a4bfff700 1 -- 172.21.15.17:0/51021906 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c00bcd0 con 0x559e8a8e7580 2023-07-14T13:22:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.238+0000 7f5a7b076b80 1 -- 172.21.15.17:0/51021906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 msgr2=0x559e8a8f7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:27.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.238+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/51021906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 0x559e8a8f7c60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c015000 tx=0x7f5a5c0093b0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.238+0000 7f5a7b076b80 1 -- 172.21.15.17:0/51021906 shutdown_connections 2023-07-14T13:22:27.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.238+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/51021906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a8ed2d0 0x559e8a8ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.238+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/51021906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a7436b0 0x559e8a8e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.238+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/51021906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8e7580 0x559e8a8f7c60 secure :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c015000 tx=0x7f5a5c0093b0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.238+0000 7f5a7b076b80 1 -- 172.21.15.17:0/51021906 >> 172.21.15.17:0/51021906 conn(0x559e8a8dcbe0 msgr2=0x559e8a8ef190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.238+0000 7f5a7b076b80 1 -- 172.21.15.17:0/51021906 shutdown_connections 2023-07-14T13:22:27.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.239+0000 7f5a7b076b80 1 -- 172.21.15.17:0/51021906 wait complete. 2023-07-14T13:22:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.239+0000 7f5a7b076b80 1 -- start start 2023-07-14T13:22:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.239+0000 7f5a7b076b80 1 Processor -- start 2023-07-14T13:22:27.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.240+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a7436b0 0x559e8a8f7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.240+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.240+0000 7f5a7b076b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a8f5c50 0x559e8a8f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.240+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a8f6600 con 0x559e8a8f5c50 2023-07-14T13:22:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.240+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a8f6740 con 0x559e8a7436b0 2023-07-14T13:22:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.240+0000 7f5a7b076b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8a8f6900 con 0x559e8a8ed2d0 2023-07-14T13:22:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.240+0000 7f5a7b076b80 10 client.0 _ll_register_callbacks cb 0x7f5a54009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:22:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.241+0000 7f5a6559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.241+0000 7f5a6559b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:56444/0 (socket says 172.21.15.17:56444) 2023-07-14T13:22:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.241+0000 7f5a6559b700 1 -- 172.21.15.17:0/356657266 learned_addr learned my addr 172.21.15.17:0/356657266 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:27.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.241+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a7436b0 0x559e8a8f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.241+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a8f5c50 0x559e8a8f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.241+0000 7f5a6559b700 1 -- 172.21.15.17:0/356657266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a7436b0 msgr2=0x559e8a8f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.241+0000 7f5a6559b700 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a7436b0 0x559e8a8f7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.241+0000 7f5a6559b700 1 -- 172.21.15.17:0/356657266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a8f5c50 msgr2=0x559e8a8f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.241+0000 7f5a6559b700 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a8f5c50 0x559e8a8f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.241+0000 7f5a6559b700 1 -- 172.21.15.17:0/356657266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a60113930 con 0x559e8a8ed2d0 2023-07-14T13:22:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.242+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a7436b0 0x559e8a8f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:22:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.242+0000 7f5a6559b700 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f7b50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00b2e0 tx=0x7f5a5c0264c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d2956b275745b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.242+0000 7f5a48ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:22:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.243+0000 7f5a48ff9700 1 -- 172.21.15.17:0/356657266 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c0055c0 con 0x559e8a8ed2d0 2023-07-14T13:22:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.243+0000 7f5a48ff9700 1 -- 172.21.15.17:0/356657266 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5a5c00b710 con 0x559e8a8ed2d0 2023-07-14T13:22:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.243+0000 7f5a7b076b80 1 -- 172.21.15.17:0/356657266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a54019070 con 0x559e8a8ed2d0 2023-07-14T13:22:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.243+0000 7f5a48ff9700 1 -- 172.21.15.17:0/356657266 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a5c00b8d0 con 0x559e8a8ed2d0 2023-07-14T13:22:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.243+0000 7f5a7b076b80 10 client.28999 fetch_fsmap learned FSMap version 55 2023-07-14T13:22:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.243+0000 7f5a7b076b80 1 -- 172.21.15.17:0/356657266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x559e8a665250 con 0x559e8a8ed2d0 2023-07-14T13:22:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.244+0000 7f5a48ff9700 1 -- 172.21.15.17:0/356657266 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a54019070 con 0x559e8a8ed2d0 2023-07-14T13:22:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.244+0000 7f5a48ff9700 1 -- 172.21.15.17:0/356657266 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5a5c03b070 con 0x559e8a8ed2d0 2023-07-14T13:22:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.244+0000 7f5a7b076b80 10 client.28999 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:22:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.244+0000 7f5a7b076b80 10 client.28999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:22:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.244+0000 7f5a7b076b80 20 client.28999 populate_metadata read hostname 'smithi017' 2023-07-14T13:22:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.244+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e8a955b90 0x559e8a957f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.244+0000 7f5a7b076b80 4 client.28999 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:22:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.244+0000 7f5a7b076b80 1 -- 172.21.15.17:0/356657266 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559e8a7f3ff0 con 0x559e8a955b90 2023-07-14T13:22:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.245+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e8a955b90 0x559e8a957f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.245+0000 7f5a48ff9700 10 client.28999 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.245+0000 7f5a64d9a700 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e8a955b90 0x559e8a957f70 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb688595c8957ed9 server_cookie=d71200c6e19d7b9f in_seq=0 out_seq=0 2023-07-14T13:22:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.273+0000 7f5a48ff9700 1 -- 172.21.15.17:0/356657266 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559e8a7f3ff0 con 0x559e8a955b90 2023-07-14T13:22:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.273+0000 7f5a48ff9700 10 client.28999 handle_command_reply: tid=0 2023-07-14T13:22:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.273+0000 7f5a7b076b80 1 client.28999 shutdown 2023-07-14T13:22:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.273+0000 7f5a7b076b80 1 -- 172.21.15.17:0/356657266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 msgr2=0x559e8a8f7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.273+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f7b50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00b2e0 tx=0x7f5a5c0264c0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.274+0000 7f5a7b076b80 1 -- 172.21.15.17:0/356657266 shutdown_connections 2023-07-14T13:22:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.274+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559e8a955b90 0x559e8a957f70 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.274+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559e8a8f5c50 0x559e8a8f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.274+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e8a7436b0 0x559e8a8f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.274+0000 7f5a7b076b80 1 --2- 172.21.15.17:0/356657266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e8a8ed2d0 0x559e8a8f7b50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.274+0000 7f5a7b076b80 1 -- 172.21.15.17:0/356657266 >> 172.21.15.17:0/356657266 conn(0x559e8a8dcbe0 msgr2=0x559e8a8f11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.274+0000 7f5a48ff9700 0 client.28999 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.274+0000 7f5a7b076b80 1 -- 172.21.15.17:0/356657266 shutdown_connections 2023-07-14T13:22:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.274+0000 7f5a7b076b80 1 -- 172.21.15.17:0/356657266 wait complete. 2023-07-14T13:22:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.274+0000 7f5a7b076b80 20 client.28999 trim_cache size 0 max 16384 2023-07-14T13:22:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:22:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:22:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:22:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:22:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.275+0000 7f5a677ff700 1 -- 172.21.15.17:0/2507142182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a4c0a14d0 msgr2=0x7f5a4c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.275+0000 7f5a677ff700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a4c0a14d0 0x7f5a4c0a3980 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5a580c9260 tx=0x7f5a5800b040 comp rx=0 tx=0).stop 2023-07-14T13:22:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.275+0000 7f5a677ff700 1 -- 172.21.15.17:0/2507142182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a60104a60 msgr2=0x7f5a6010baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.275+0000 7f5a677ff700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a60104a60 0x7f5a6010baa0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007ee0 tx=0x7f5a5800d3b0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.275+0000 7f5a677ff700 1 -- 172.21.15.17:0/2507142182 shutdown_connections 2023-07-14T13:22:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.275+0000 7f5a677ff700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5a4c0a14d0 0x7f5a4c0a3980 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.276+0000 7f5a677ff700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a60104a60 0x7f5a6010baa0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.276+0000 7f5a677ff700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a60067ee0 0x7f5a60112bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.276+0000 7f5a677ff700 1 --2- 172.21.15.17:0/2507142182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a601024f0 0x7f5a60113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.276+0000 7f5a677ff700 1 -- 172.21.15.17:0/2507142182 >> 172.21.15.17:0/2507142182 conn(0x7f5a60074760 msgr2=0x7f5a601014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.277+0000 7f5a677ff700 1 -- 172.21.15.17:0/2507142182 shutdown_connections 2023-07-14T13:22:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:27.277+0000 7f5a677ff700 1 -- 172.21.15.17:0/2507142182 wait complete. 2023-07-14T13:22:27.439 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 255.0 s, 579.4 tps, lat 175.083 ms stddev 86.517 2023-07-14T13:22:27.688 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:27 smithi135 ceph-mon[97338]: pgmap v718: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 15 MiB/s wr, 1.42k op/s 2023-07-14T13:22:27.736 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:27 smithi131 ceph-mon[96953]: pgmap v718: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 15 MiB/s wr, 1.42k op/s 2023-07-14T13:22:27.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:27 smithi017 ceph-mon[95536]: pgmap v718: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 15 MiB/s wr, 1.42k op/s 2023-07-14T13:22:29.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:29 smithi135 ceph-mon[97338]: pgmap v719: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.20k op/s 2023-07-14T13:22:29.736 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:29 smithi131 ceph-mon[96953]: pgmap v719: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.20k op/s 2023-07-14T13:22:29.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:29 smithi017 ceph-mon[95536]: pgmap v719: 97 pgs: 97 active+clean; 14 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.20k op/s 2023-07-14T13:22:31.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:31 smithi135 ceph-mon[97338]: pgmap v720: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 20 MiB/s wr, 1.79k op/s 2023-07-14T13:22:31.736 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:31 smithi131 ceph-mon[96953]: pgmap v720: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 20 MiB/s wr, 1.79k op/s 2023-07-14T13:22:31.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:31 smithi017 ceph-mon[95536]: pgmap v720: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 20 MiB/s wr, 1.79k op/s 2023-07-14T13:22:32.439 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 260.0 s, 698.2 tps, lat 142.209 ms stddev 37.071 2023-07-14T13:22:33.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:33 smithi135 ceph-mon[97338]: pgmap v721: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.44k op/s 2023-07-14T13:22:33.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:33 smithi131 ceph-mon[96953]: pgmap v721: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.44k op/s 2023-07-14T13:22:33.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:33 smithi017 ceph-mon[95536]: pgmap v721: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.44k op/s 2023-07-14T13:22:35.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:35 smithi135 ceph-mon[97338]: pgmap v722: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.40k op/s 2023-07-14T13:22:35.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:35 smithi131 ceph-mon[96953]: pgmap v722: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.40k op/s 2023-07-14T13:22:35.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:35 smithi017 ceph-mon[95536]: pgmap v722: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.40k op/s 2023-07-14T13:22:37.442 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 265.0 s, 594.2 tps, lat 118.858 ms stddev 54.304 2023-07-14T13:22:37.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:37 smithi135 ceph-mon[97338]: pgmap v723: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 23 MiB/s wr, 2.11k op/s 2023-07-14T13:22:37.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:37 smithi131 ceph-mon[96953]: pgmap v723: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 23 MiB/s wr, 2.11k op/s 2023-07-14T13:22:37.853 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:37 smithi017 ceph-mon[95536]: pgmap v723: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 23 MiB/s wr, 2.11k op/s 2023-07-14T13:22:39.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:39 smithi135 ceph-mon[97338]: pgmap v724: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 15 MiB/s wr, 1.37k op/s 2023-07-14T13:22:39.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:39 smithi131 ceph-mon[96953]: pgmap v724: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 15 MiB/s wr, 1.37k op/s 2023-07-14T13:22:39.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:39 smithi017 ceph-mon[95536]: pgmap v724: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 15 MiB/s wr, 1.37k op/s 2023-07-14T13:22:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.544+0000 7ff815dff700 1 -- 172.21.15.17:0/16441237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810101f90 msgr2=0x7ff810102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.544+0000 7ff815dff700 1 --2- 172.21.15.17:0/16441237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810101f90 0x7ff810102360 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff800009f90 tx=0x7ff80000b330 comp rx=0 tx=0).stop 2023-07-14T13:22:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.545+0000 7ff815dff700 1 -- 172.21.15.17:0/16441237 shutdown_connections 2023-07-14T13:22:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.545+0000 7ff815dff700 1 --2- 172.21.15.17:0/16441237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff810106fd0 0x7ff81010eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.545+0000 7ff815dff700 1 --2- 172.21.15.17:0/16441237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810101f90 0x7ff810102360 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.545+0000 7ff815dff700 1 --2- 172.21.15.17:0/16441237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810102930 0x7ff8101068f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.545+0000 7ff815dff700 1 -- 172.21.15.17:0/16441237 >> 172.21.15.17:0/16441237 conn(0x7ff8100fd7e0 msgr2=0x7ff8100ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.545+0000 7ff815dff700 1 -- 172.21.15.17:0/16441237 shutdown_connections 2023-07-14T13:22:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.545+0000 7ff815dff700 1 -- 172.21.15.17:0/16441237 wait complete. 2023-07-14T13:22:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.547+0000 7ff815dff700 1 Processor -- start 2023-07-14T13:22:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.547+0000 7ff815dff700 1 -- start start 2023-07-14T13:22:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.548+0000 7ff815dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810101f90 0x7ff81010e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.548+0000 7ff815dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff810102930 0x7ff81010b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.548+0000 7ff815dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810106fd0 0x7ff81010bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.548+0000 7ff815dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81010c480 con 0x7ff810102930 2023-07-14T13:22:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.548+0000 7ff815dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81010c5f0 con 0x7ff810106fd0 2023-07-14T13:22:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.548+0000 7ff815dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81019e2c0 con 0x7ff810101f90 2023-07-14T13:22:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.549+0000 7ff80f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810101f90 0x7ff81010e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.549+0000 7ff80f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810101f90 0x7ff81010e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37288/0 (socket says 172.21.15.17:37288) 2023-07-14T13:22:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.549+0000 7ff80f7fe700 1 -- 172.21.15.17:0/1389503465 learned_addr learned my addr 172.21.15.17:0/1389503465 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.549+0000 7ff80effd700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff810102930 0x7ff81010b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.549+0000 7ff80f7fe700 1 -- 172.21.15.17:0/1389503465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810106fd0 msgr2=0x7ff81010bcb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T13:22:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.549+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810106fd0 0x7ff81010bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.549+0000 7ff80f7fe700 1 -- 172.21.15.17:0/1389503465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff810102930 msgr2=0x7ff81010b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.549+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff810102930 0x7ff81010b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.549+0000 7ff80f7fe700 1 -- 172.21.15.17:0/1389503465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800009c40 con 0x7ff810101f90 2023-07-14T13:22:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.550+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810101f90 0x7ff81010e970 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff800006050 tx=0x7ff800007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.550+0000 7ff80cff9700 1 -- 172.21.15.17:0/1389503465 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80000e070 con 0x7ff810101f90 2023-07-14T13:22:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.550+0000 7ff80cff9700 1 -- 172.21.15.17:0/1389503465 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff800003e10 con 0x7ff810101f90 2023-07-14T13:22:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.550+0000 7ff80cff9700 1 -- 172.21.15.17:0/1389503465 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80001a630 con 0x7ff810101f90 2023-07-14T13:22:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.550+0000 7ff815dff700 1 -- 172.21.15.17:0/1389503465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff81019e540 con 0x7ff810101f90 2023-07-14T13:22:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.550+0000 7ff815dff700 1 -- 172.21.15.17:0/1389503465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff81019ea00 con 0x7ff810101f90 2023-07-14T13:22:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.555+0000 7ff80cff9700 1 -- 172.21.15.17:0/1389503465 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff800005640 con 0x7ff810101f90 2023-07-14T13:22:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.557+0000 7ff8296b2b80 1 Processor -- start 2023-07-14T13:22:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.557+0000 7ff8296b2b80 1 -- start start 2023-07-14T13:22:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.557+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f4d76b0 0x55d64f680d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.557+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f6812d0 0x55d64f67b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.558+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f67b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.558+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f580c50 con 0x55d64f4d76b0 2023-07-14T13:22:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.558+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f5d39e0 con 0x55d64f67b580 2023-07-14T13:22:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.558+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f5cce70 con 0x55d64f6812d0 2023-07-14T13:22:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.558+0000 7ff80effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f67b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.558+0000 7ff80effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f67b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44758/0 (socket says 172.21.15.17:44758) 2023-07-14T13:22:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.558+0000 7ff80effd700 1 -- 172.21.15.17:0/1680157657 learned_addr learned my addr 172.21.15.17:0/1680157657 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.558+0000 7ff80cff9700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff7f80a1400 0x7ff7f80a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.558+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/1680157657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f6812d0 0x55d64f67b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.559+0000 7ff80cff9700 1 -- 172.21.15.17:0/1389503465 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff8000cdbe0 con 0x7ff810101f90 2023-07-14T13:22:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.559+0000 7ff80effd700 1 -- 172.21.15.17:0/1680157657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f6812d0 msgr2=0x55d64f67b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.559+0000 7ff80effd700 1 --2- 172.21.15.17:0/1680157657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f6812d0 0x55d64f67b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.559+0000 7ff80effd700 1 -- 172.21.15.17:0/1680157657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f4d76b0 msgr2=0x55d64f680d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.559+0000 7ff80effd700 1 --2- 172.21.15.17:0/1680157657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f4d76b0 0x55d64f680d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.559+0000 7ff80effd700 1 -- 172.21.15.17:0/1680157657 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d64f3fad80 con 0x55d64f67b580 2023-07-14T13:22:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.559+0000 7ff80effd700 1 --2- 172.21.15.17:0/1680157657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f67b9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff804009cb0 tx=0x7ff804011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37d2b434f51ff2e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.559+0000 7ff7f5ffb700 1 -- 172.21.15.17:0/1680157657 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804011dd0 con 0x55d64f67b580 2023-07-14T13:22:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.560+0000 7ff80ffff700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff7f80a1400 0x7ff7f80a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.560+0000 7ff7f5ffb700 1 -- 172.21.15.17:0/1680157657 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8040044c0 con 0x55d64f67b580 2023-07-14T13:22:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.560+0000 7ff7f5ffb700 1 -- 172.21.15.17:0/1680157657 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff804005280 con 0x55d64f67b580 2023-07-14T13:22:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.560+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1680157657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 msgr2=0x55d64f67b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.560+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/1680157657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f67b9d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff804009cb0 tx=0x7ff804011440 comp rx=0 tx=0).stop 2023-07-14T13:22:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.561+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1680157657 shutdown_connections 2023-07-14T13:22:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.561+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/1680157657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f67b9d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.561+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/1680157657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f4d76b0 0x55d64f680d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.561+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/1680157657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f6812d0 0x55d64f67b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.561+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1680157657 >> 172.21.15.17:0/1680157657 conn(0x55d64f670be0 msgr2=0x55d64f675f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.564+0000 7ff80ffff700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff7f80a1400 0x7ff7f80a38b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff808005b40 tx=0x7ff808005a90 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.564+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1680157657 shutdown_connections 2023-07-14T13:22:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.565+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1680157657 wait complete. 2023-07-14T13:22:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.565+0000 7ff8296b2b80 1 -- start start 2023-07-14T13:22:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.566+0000 7ff8296b2b80 1 Processor -- start 2023-07-14T13:22:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.566+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f4d76b0 0x55d64f6875f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.567+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f67b580 0x55d64f684870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.567+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f6812d0 0x55d64f684fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.567+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f56ca60 con 0x55d64f67b580 2023-07-14T13:22:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.567+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f56c760 con 0x55d64f4d76b0 2023-07-14T13:22:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.567+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f4508c0 con 0x55d64f6812d0 2023-07-14T13:22:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.567+0000 7ff8296b2b80 10 client.0 _ll_register_callbacks cb 0x55d64f56a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:22:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.567+0000 7ff80effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f67b580 0x55d64f684870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.567+0000 7ff80effd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f67b580 0x55d64f684870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54274/0 (socket says 172.21.15.17:54274) 2023-07-14T13:22:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.567+0000 7ff80effd700 1 -- 172.21.15.17:0/954080987 learned_addr learned my addr 172.21.15.17:0/954080987 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.567+0000 7ff80f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f4d76b0 0x55d64f6875f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.567+0000 7ff80ffff700 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f6812d0 0x55d64f684fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.568+0000 7ff80f7fe700 1 -- 172.21.15.17:0/954080987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f6812d0 msgr2=0x55d64f684fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.568+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f6812d0 0x55d64f684fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.568+0000 7ff80f7fe700 1 -- 172.21.15.17:0/954080987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f67b580 msgr2=0x55d64f684870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.568+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f67b580 0x55d64f684870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.568+0000 7ff80f7fe700 1 -- 172.21.15.17:0/954080987 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8040098e0 con 0x55d64f4d76b0 2023-07-14T13:22:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.568+0000 7ff80effd700 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f67b580 0x55d64f684870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:22:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.569+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f4d76b0 0x55d64f6875f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff8000cb2f0 tx=0x7ff8000665f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65069bd815aa444f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.569+0000 7ff7eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:22:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.569+0000 7ff7eeffd700 1 -- 172.21.15.17:0/954080987 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80009aad0 con 0x55d64f4d76b0 2023-07-14T13:22:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.569+0000 7ff7eeffd700 1 -- 172.21.15.17:0/954080987 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff80009ad00 con 0x55d64f4d76b0 2023-07-14T13:22:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.569+0000 7ff8296b2b80 1 -- 172.21.15.17:0/954080987 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d64f526490 con 0x55d64f4d76b0 2023-07-14T13:22:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.570+0000 7ff7eeffd700 1 -- 172.21.15.17:0/954080987 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff80009a840 con 0x55d64f4d76b0 2023-07-14T13:22:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.570+0000 7ff8296b2b80 10 client.29036 fetch_fsmap learned FSMap version 55 2023-07-14T13:22:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.570+0000 7ff8296b2b80 1 -- 172.21.15.17:0/954080987 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55d64f3e3c00 con 0x55d64f4d76b0 2023-07-14T13:22:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.570+0000 7ff7eeffd700 1 -- 172.21.15.17:0/954080987 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d64f526490 con 0x55d64f4d76b0 2023-07-14T13:22:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.570+0000 7ff7eeffd700 1 -- 172.21.15.17:0/954080987 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff80009af60 con 0x55d64f4d76b0 2023-07-14T13:22:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.572+0000 7ff8296b2b80 10 client.29036 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:22:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.572+0000 7ff8296b2b80 10 client.29036 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:22:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.572+0000 7ff8296b2b80 20 client.29036 populate_metadata read hostname 'smithi017' 2023-07-14T13:22:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.572+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d64f6a5990 0x55d64f6a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.572+0000 7ff8296b2b80 4 client.29036 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:22:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.572+0000 7ff8296b2b80 1 -- 172.21.15.17:0/954080987 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d64f5c5e50 con 0x55d64f6a5990 2023-07-14T13:22:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.573+0000 7ff80effd700 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d64f6a5990 0x55d64f6a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.574+0000 7ff80effd700 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d64f6a5990 0x55d64f6a7da0 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f78fdadeac993189 server_cookie=5b21dbad2b34acbb in_seq=0 out_seq=0 2023-07-14T13:22:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.574+0000 7ff7eeffd700 10 client.29036 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.575+0000 7ff7eeffd700 1 -- 172.21.15.17:0/954080987 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d64f5c5e50 con 0x55d64f6a5990 2023-07-14T13:22:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.575+0000 7ff7eeffd700 10 client.29036 handle_command_reply: tid=0 2023-07-14T13:22:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.575+0000 7ff8296b2b80 1 client.29036 shutdown 2023-07-14T13:22:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.576+0000 7ff8296b2b80 1 -- 172.21.15.17:0/954080987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f4d76b0 msgr2=0x55d64f6875f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.576+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f4d76b0 0x55d64f6875f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff8000cb2f0 tx=0x7ff8000665f0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.576+0000 7ff8296b2b80 1 -- 172.21.15.17:0/954080987 shutdown_connections 2023-07-14T13:22:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.576+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d64f6a5990 0x55d64f6a7da0 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.576+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f6812d0 0x55d64f684fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.576+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f4d76b0 0x55d64f6875f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.576+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/954080987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f67b580 0x55d64f684870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.576+0000 7ff8296b2b80 1 -- 172.21.15.17:0/954080987 >> 172.21.15.17:0/954080987 conn(0x55d64f670be0 msgr2=0x55d64f6754e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.576+0000 7ff7eeffd700 0 client.29036 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.577+0000 7ff8296b2b80 1 -- 172.21.15.17:0/954080987 shutdown_connections 2023-07-14T13:22:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.577+0000 7ff8296b2b80 1 -- 172.21.15.17:0/954080987 wait complete. 2023-07-14T13:22:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.578+0000 7ff8296b2b80 20 client.29036 trim_cache size 0 max 16384 2023-07-14T13:22:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.608+0000 7ff8296b2b80 1 Processor -- start 2023-07-14T13:22:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.608+0000 7ff8296b2b80 1 -- start start 2023-07-14T13:22:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.608+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f69cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.608+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f684030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.608+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f6812d0 0x55d64f680120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.608+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f685820 con 0x55d64f6812d0 2023-07-14T13:22:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.608+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f6816a0 con 0x55d64f67b580 2023-07-14T13:22:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.608+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f685e50 con 0x55d64f4d76b0 2023-07-14T13:22:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.609+0000 7ff80f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f69cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.609+0000 7ff80f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f69cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37310/0 (socket says 172.21.15.17:37310) 2023-07-14T13:22:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.609+0000 7ff80f7fe700 1 -- 172.21.15.17:0/2300126065 learned_addr learned my addr 172.21.15.17:0/2300126065 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.609+0000 7ff80effd700 1 --2- 172.21.15.17:0/2300126065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f684030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.609+0000 7ff80ffff700 1 --2- 172.21.15.17:0/2300126065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f6812d0 0x55d64f680120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.609+0000 7ff80f7fe700 1 -- 172.21.15.17:0/2300126065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 msgr2=0x55d64f684030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.609+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/2300126065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f684030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.609+0000 7ff80f7fe700 1 -- 172.21.15.17:0/2300126065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f6812d0 msgr2=0x55d64f680120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.609+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/2300126065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f6812d0 0x55d64f680120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.609+0000 7ff80f7fe700 1 -- 172.21.15.17:0/2300126065 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d64f6ac990 con 0x55d64f4d76b0 2023-07-14T13:22:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.609+0000 7ff80effd700 1 --2- 172.21.15.17:0/2300126065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f684030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:22:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.610+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/2300126065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f69cc70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff8000cb320 tx=0x7ff80000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b11faec2e999103e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.610+0000 7ff7f67fc700 1 -- 172.21.15.17:0/2300126065 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80006a020 con 0x55d64f4d76b0 2023-07-14T13:22:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.610+0000 7ff7f67fc700 1 -- 172.21.15.17:0/2300126065 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff800008f50 con 0x55d64f4d76b0 2023-07-14T13:22:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.610+0000 7ff7f67fc700 1 -- 172.21.15.17:0/2300126065 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000a30c0 con 0x55d64f4d76b0 2023-07-14T13:22:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.611+0000 7ff8296b2b80 1 -- 172.21.15.17:0/2300126065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 msgr2=0x55d64f69cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.611+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/2300126065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f69cc70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff8000cb320 tx=0x7ff80000b330 comp rx=0 tx=0).stop 2023-07-14T13:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.611+0000 7ff8296b2b80 1 -- 172.21.15.17:0/2300126065 shutdown_connections 2023-07-14T13:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.611+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/2300126065 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f6812d0 0x55d64f680120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.611+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/2300126065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f69cc70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.611+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/2300126065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f684030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.611+0000 7ff8296b2b80 1 -- 172.21.15.17:0/2300126065 >> 172.21.15.17:0/2300126065 conn(0x55d64f670be0 msgr2=0x55d64f67fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.611+0000 7ff8296b2b80 1 -- 172.21.15.17:0/2300126065 shutdown_connections 2023-07-14T13:22:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.612+0000 7ff8296b2b80 1 -- 172.21.15.17:0/2300126065 wait complete. 2023-07-14T13:22:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.612+0000 7ff8296b2b80 1 -- start start 2023-07-14T13:22:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.612+0000 7ff8296b2b80 1 Processor -- start 2023-07-14T13:22:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.613+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f67d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.613+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f67dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.613+0000 7ff8296b2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f6812d0 0x55d64f67c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.613+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f67e310 con 0x55d64f6812d0 2023-07-14T13:22:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.613+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f67e480 con 0x55d64f67b580 2023-07-14T13:22:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.613+0000 7ff8296b2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64f67e640 con 0x55d64f4d76b0 2023-07-14T13:22:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.613+0000 7ff8296b2b80 10 client.0 _ll_register_callbacks cb 0x55d64f56a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:22:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.614+0000 7ff80f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f67d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.614+0000 7ff80f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f67d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:37316/0 (socket says 172.21.15.17:37316) 2023-07-14T13:22:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.614+0000 7ff80f7fe700 1 -- 172.21.15.17:0/1613773544 learned_addr learned my addr 172.21.15.17:0/1613773544 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.614+0000 7ff80ffff700 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f6812d0 0x55d64f67c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.614+0000 7ff80effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f67dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.615+0000 7ff80ffff700 1 -- 172.21.15.17:0/1613773544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 msgr2=0x55d64f67d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.615+0000 7ff80ffff700 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f67d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.615+0000 7ff80ffff700 1 -- 172.21.15.17:0/1613773544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 msgr2=0x55d64f67dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.615+0000 7ff80ffff700 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f67dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.615+0000 7ff80ffff700 1 -- 172.21.15.17:0/1613773544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d64f3e3c00 con 0x55d64f6812d0 2023-07-14T13:22:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.615+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f67d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:22:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.615+0000 7ff80effd700 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f67dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:22:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.615+0000 7ff80ffff700 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f6812d0 0x55d64f67c790 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff808004800 tx=0x7ff808010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84663172912f5a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.615+0000 7ff7eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:22:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.616+0000 7ff7eeffd700 1 -- 172.21.15.17:0/1613773544 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800ded0 con 0x55d64f6812d0 2023-07-14T13:22:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.616+0000 7ff7eeffd700 1 -- 172.21.15.17:0/1613773544 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff808010e20 con 0x55d64f6812d0 2023-07-14T13:22:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.616+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1613773544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d64f587ff0 con 0x55d64f6812d0 2023-07-14T13:22:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.616+0000 7ff7eeffd700 1 -- 172.21.15.17:0/1613773544 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8080273f0 con 0x55d64f6812d0 2023-07-14T13:22:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.616+0000 7ff8296b2b80 10 client.19275 fetch_fsmap learned FSMap version 55 2023-07-14T13:22:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.616+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1613773544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55d64f4211f0 con 0x55d64f6812d0 2023-07-14T13:22:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.617+0000 7ff7eeffd700 1 -- 172.21.15.17:0/1613773544 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d64f587ff0 con 0x55d64f6812d0 2023-07-14T13:22:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.618+0000 7ff7eeffd700 1 -- 172.21.15.17:0/1613773544 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff80801d5f0 con 0x55d64f6812d0 2023-07-14T13:22:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.618+0000 7ff8296b2b80 10 client.19275 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:22:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.618+0000 7ff8296b2b80 10 client.19275 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:22:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.618+0000 7ff8296b2b80 20 client.19275 populate_metadata read hostname 'smithi017' 2023-07-14T13:22:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.618+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d64f6fa2f0 0x55d64f6fc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.618+0000 7ff8296b2b80 4 client.19275 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:22:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.618+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1613773544 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d64f41bf10 con 0x55d64f6fa2f0 2023-07-14T13:22:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.619+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d64f6fa2f0 0x55d64f6fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.620+0000 7ff80f7fe700 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d64f6fa2f0 0x55d64f6fc700 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f086bedc7aa5e48 server_cookie=9e9dcbfa9900d5cd in_seq=0 out_seq=0 2023-07-14T13:22:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:40.620+0000 7ff7eeffd700 10 client.19275 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:41.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:41 smithi135 ceph-mon[97338]: pgmap v725: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 22 MiB/s wr, 1.98k op/s 2023-07-14T13:22:41.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:41 smithi131 ceph-mon[96953]: pgmap v725: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 22 MiB/s wr, 1.98k op/s 2023-07-14T13:22:41.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:41 smithi017 ceph-mon[95536]: pgmap v725: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 22 MiB/s wr, 1.98k op/s 2023-07-14T13:22:42.438 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 270.0 s, 589.6 tps, lat 81.137 ms stddev 22.802 2023-07-14T13:22:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.312+0000 7ff7eeffd700 1 -- 172.21.15.17:0/1613773544 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d64f41bf10 con 0x55d64f6fa2f0 2023-07-14T13:22:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.312+0000 7ff7eeffd700 10 client.19275 handle_command_reply: tid=0 2023-07-14T13:22:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.312+0000 7ff8296b2b80 1 client.19275 shutdown 2023-07-14T13:22:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.313+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1613773544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f6812d0 msgr2=0x55d64f67c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.313+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f6812d0 0x55d64f67c790 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff808004800 tx=0x7ff808010740 comp rx=0 tx=0).stop 2023-07-14T13:22:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.313+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1613773544 shutdown_connections 2023-07-14T13:22:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.313+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d64f6fa2f0 0x55d64f6fc700 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.313+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d64f6812d0 0x55d64f67c790 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.313+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d64f4d76b0 0x55d64f67d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.313+0000 7ff8296b2b80 1 --2- 172.21.15.17:0/1613773544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d64f67b580 0x55d64f67dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.313+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1613773544 >> 172.21.15.17:0/1613773544 conn(0x55d64f670be0 msgr2=0x55d64f6802a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.313+0000 7ff7eeffd700 0 client.19275 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.314+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1613773544 shutdown_connections 2023-07-14T13:22:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.314+0000 7ff8296b2b80 1 -- 172.21.15.17:0/1613773544 wait complete. 2023-07-14T13:22:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.314+0000 7ff8296b2b80 20 client.19275 trim_cache size 0 max 16384 2023-07-14T13:22:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:22:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:22:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:22:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:22:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.316+0000 7ff815dff700 1 -- 172.21.15.17:0/1389503465 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff7f80a1400 msgr2=0x7ff7f80a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.316+0000 7ff815dff700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff7f80a1400 0x7ff7f80a38b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff808005b40 tx=0x7ff808005a90 comp rx=0 tx=0).stop 2023-07-14T13:22:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.316+0000 7ff815dff700 1 -- 172.21.15.17:0/1389503465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810101f90 msgr2=0x7ff81010e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.316+0000 7ff815dff700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810101f90 0x7ff81010e970 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff800006050 tx=0x7ff800007d30 comp rx=0 tx=0).stop 2023-07-14T13:22:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.316+0000 7ff815dff700 1 -- 172.21.15.17:0/1389503465 shutdown_connections 2023-07-14T13:22:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.316+0000 7ff815dff700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff7f80a1400 0x7ff7f80a38b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.316+0000 7ff815dff700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff810106fd0 0x7ff81010bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.316+0000 7ff815dff700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff810101f90 0x7ff81010e970 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.316+0000 7ff815dff700 1 --2- 172.21.15.17:0/1389503465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff810102930 0x7ff81010b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.316+0000 7ff815dff700 1 -- 172.21.15.17:0/1389503465 >> 172.21.15.17:0/1389503465 conn(0x7ff8100fd7e0 msgr2=0x7ff8100fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.317+0000 7ff815dff700 1 -- 172.21.15.17:0/1389503465 shutdown_connections 2023-07-14T13:22:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:43.317+0000 7ff815dff700 1 -- 172.21.15.17:0/1389503465 wait complete. 2023-07-14T13:22:43.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:43 smithi135 ceph-mon[97338]: pgmap v726: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.45k op/s 2023-07-14T13:22:43.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:43 smithi131 ceph-mon[96953]: pgmap v726: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.45k op/s 2023-07-14T13:22:43.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:43 smithi017 ceph-mon[95536]: pgmap v726: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.45k op/s 2023-07-14T13:22:44.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:44 smithi131 ceph-mon[96953]: pgmap v727: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-14T13:22:44.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:44 smithi017 ceph-mon[95536]: pgmap v727: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-14T13:22:44.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:44 smithi135 ceph-mon[97338]: pgmap v727: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-14T13:22:47.439 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 275.0 s, 286.8 tps, lat 632.483 ms stddev 1925.871 2023-07-14T13:22:47.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:47 smithi135 ceph-mon[97338]: pgmap v728: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 20 MiB/s wr, 1.88k op/s 2023-07-14T13:22:47.734 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:47 smithi131 ceph-mon[96953]: pgmap v728: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 20 MiB/s wr, 1.88k op/s 2023-07-14T13:22:47.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:47 smithi017 ceph-mon[95536]: pgmap v728: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 20 MiB/s wr, 1.88k op/s 2023-07-14T13:22:49.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:49 smithi135 ceph-mon[97338]: pgmap v729: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:22:49.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:49 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:22:49.734 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:49 smithi131 ceph-mon[96953]: pgmap v729: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:22:49.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:49 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:22:49.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:49 smithi017 ceph-mon[95536]: pgmap v729: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:22:49.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:49 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:22:50.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:22:50.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:22:50.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:50 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:22:50.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:22:50.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:22:50.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:50 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:22:50.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:22:50.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:22:50.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:50 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:22:51.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:51 smithi135 ceph-mon[97338]: pgmap v730: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:22:51.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:51 smithi131 ceph-mon[96953]: pgmap v730: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:22:51.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:51 smithi017 ceph-mon[95536]: pgmap v730: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:22:52.440 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 280.0 s, 200.3 tps, lat 155.856 ms stddev 35.515 2023-07-14T13:22:53.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:53 smithi135 ceph-mon[97338]: pgmap v731: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 951 op/s 2023-07-14T13:22:53.734 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:53 smithi131 ceph-mon[96953]: pgmap v731: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 951 op/s 2023-07-14T13:22:53.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:53 smithi017 ceph-mon[95536]: pgmap v731: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 951 op/s 2023-07-14T13:22:55.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:55 smithi135 ceph-mon[97338]: pgmap v732: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.5 MiB/s wr, 876 op/s 2023-07-14T13:22:55.734 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:55 smithi131 ceph-mon[96953]: pgmap v732: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.5 MiB/s wr, 876 op/s 2023-07-14T13:22:55.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:55 smithi017 ceph-mon[95536]: pgmap v732: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.5 MiB/s wr, 876 op/s 2023-07-14T13:22:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.580+0000 7f3f49dff700 1 -- 172.21.15.17:0/1132798951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f440ffdc0 msgr2=0x7f3f44100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.580+0000 7f3f49dff700 1 --2- 172.21.15.17:0/1132798951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f440ffdc0 0x7f3f44100190 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009fc0 tx=0x7f3f3400b330 comp rx=0 tx=0).stop 2023-07-14T13:22:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.581+0000 7f3f49dff700 1 -- 172.21.15.17:0/1132798951 shutdown_connections 2023-07-14T13:22:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.581+0000 7f3f49dff700 1 --2- 172.21.15.17:0/1132798951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f44104e00 0x7f3f4410c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.581+0000 7f3f49dff700 1 --2- 172.21.15.17:0/1132798951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f440ffdc0 0x7f3f44100190 secure :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009fc0 tx=0x7f3f3400b330 comp rx=0 tx=0).stop 2023-07-14T13:22:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.581+0000 7f3f49dff700 1 --2- 172.21.15.17:0/1132798951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f44100760 0x7f3f44104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.581+0000 7f3f49dff700 1 -- 172.21.15.17:0/1132798951 >> 172.21.15.17:0/1132798951 conn(0x7f3f440fb650 msgr2=0x7f3f440fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.581+0000 7f3f49dff700 1 -- 172.21.15.17:0/1132798951 shutdown_connections 2023-07-14T13:22:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.581+0000 7f3f49dff700 1 -- 172.21.15.17:0/1132798951 wait complete. 2023-07-14T13:22:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.583+0000 7f3f49dff700 1 Processor -- start 2023-07-14T13:22:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.583+0000 7f3f49dff700 1 -- start start 2023-07-14T13:22:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.584+0000 7f3f49dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f44100760 0x7f3f44073da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.584+0000 7f3f49dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f44104e00 0x7f3f44074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.584+0000 7f3f49dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f4406ab20 0x7f3f4406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.584+0000 7f3f49dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4406b790 con 0x7f3f4406ab20 2023-07-14T13:22:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.584+0000 7f3f49dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4406b900 con 0x7f3f44104e00 2023-07-14T13:22:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.584+0000 7f3f49dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4406f850 con 0x7f3f44100760 2023-07-14T13:22:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.584+0000 7f3f3affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f44104e00 0x7f3f44074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.585+0000 7f3f3affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f44104e00 0x7f3f44074300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55128/0 (socket says 172.21.15.17:55128) 2023-07-14T13:22:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.585+0000 7f3f3affd700 1 -- 172.21.15.17:0/3440566831 learned_addr learned my addr 172.21.15.17:0/3440566831 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.585+0000 7f3f43fff700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f4406ab20 0x7f3f4406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.585+0000 7f3f437fe700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f44100760 0x7f3f44073da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.585+0000 7f3f3affd700 1 -- 172.21.15.17:0/3440566831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f44100760 msgr2=0x7f3f44073da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.585+0000 7f3f3affd700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f44100760 0x7f3f44073da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.585+0000 7f3f3affd700 1 -- 172.21.15.17:0/3440566831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f4406ab20 msgr2=0x7f3f4406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.585+0000 7f3f3affd700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f4406ab20 0x7f3f4406afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.585+0000 7f3f3affd700 1 -- 172.21.15.17:0/3440566831 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f34009c40 con 0x7f3f44104e00 2023-07-14T13:22:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.586+0000 7f3f3affd700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f44104e00 0x7f3f44074300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00b4d0 tx=0x7f3f2c00b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.586+0000 7f3f417fa700 1 -- 172.21.15.17:0/3440566831 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c011830 con 0x7f3f44104e00 2023-07-14T13:22:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.586+0000 7f3f417fa700 1 -- 172.21.15.17:0/3440566831 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f2c011e20 con 0x7f3f44104e00 2023-07-14T13:22:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.586+0000 7f3f417fa700 1 -- 172.21.15.17:0/3440566831 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c010d40 con 0x7f3f44104e00 2023-07-14T13:22:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.586+0000 7f3f49dff700 1 -- 172.21.15.17:0/3440566831 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4406fb30 con 0x7f3f44104e00 2023-07-14T13:22:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.587+0000 7f3f49dff700 1 -- 172.21.15.17:0/3440566831 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4406fff0 con 0x7f3f44104e00 2023-07-14T13:22:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.593+0000 7f3f5d632b80 1 Processor -- start 2023-07-14T13:22:56.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.594+0000 7f3f5d632b80 1 -- start start 2023-07-14T13:22:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.594+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.594+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0cc2d0 0x5638bf0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.594+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0c6580 0x5638bf0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.594+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638befcbc50 con 0x5638bf0cc2d0 2023-07-14T13:22:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.594+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bf01e9e0 con 0x5638bef226b0 2023-07-14T13:22:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.594+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bf017e70 con 0x5638bf0c6580 2023-07-14T13:22:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.595+0000 7f3f437fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0cc2d0 0x5638bf0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.595+0000 7f3f43fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.595+0000 7f3f43fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55142/0 (socket says 172.21.15.17:55142) 2023-07-14T13:22:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.595+0000 7f3f43fff700 1 -- 172.21.15.17:0/1563722054 learned_addr learned my addr 172.21.15.17:0/1563722054 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.596+0000 7f3f43fff700 1 -- 172.21.15.17:0/1563722054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0c6580 msgr2=0x5638bf0c69d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:22:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.596+0000 7f3f43fff700 1 --2- 172.21.15.17:0/1563722054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0c6580 0x5638bf0c69d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.596+0000 7f3f43fff700 1 -- 172.21.15.17:0/1563722054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0cc2d0 msgr2=0x5638bf0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.596+0000 7f3f43fff700 1 --2- 172.21.15.17:0/1563722054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0cc2d0 0x5638bf0c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.596+0000 7f3f43fff700 1 -- 172.21.15.17:0/1563722054 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638bee45d80 con 0x5638bef226b0 2023-07-14T13:22:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.596+0000 7f3f43fff700 1 --2- 172.21.15.17:0/1563722054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cbd90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00b6c0 tx=0x7f3f3c00b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e721f718b146b5cd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.596+0000 7f3f39ffb700 1 -- 172.21.15.17:0/1563722054 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c003940 con 0x5638bef226b0 2023-07-14T13:22:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.597+0000 7f3f39ffb700 1 -- 172.21.15.17:0/1563722054 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f3c01a470 con 0x5638bef226b0 2023-07-14T13:22:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.597+0000 7f3f39ffb700 1 -- 172.21.15.17:0/1563722054 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0116a0 con 0x5638bef226b0 2023-07-14T13:22:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.597+0000 7f3f417fa700 1 -- 172.21.15.17:0/3440566831 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3f2c011990 con 0x7f3f44104e00 2023-07-14T13:22:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.598+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1563722054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 msgr2=0x5638bf0cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.598+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/1563722054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cbd90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00b6c0 tx=0x7f3f3c00b9d0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.598+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1563722054 shutdown_connections 2023-07-14T13:22:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.598+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/1563722054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0c6580 0x5638bf0c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.598+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/1563722054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cbd90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.598+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/1563722054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0cc2d0 0x5638bf0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.598+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1563722054 >> 172.21.15.17:0/1563722054 conn(0x5638bf0bbbe0 msgr2=0x5638bf0c0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.599+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1563722054 shutdown_connections 2023-07-14T13:22:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.599+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1563722054 wait complete. 2023-07-14T13:22:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.600+0000 7f3f417fa700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f300a12d0 0x7f3f300a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.600+0000 7f3f5d632b80 1 -- start start 2023-07-14T13:22:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.600+0000 7f3f417fa700 1 -- 172.21.15.17:0/3440566831 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3f2c0cc5d0 con 0x7f3f44104e00 2023-07-14T13:22:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.601+0000 7f3f43fff700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f300a12d0 0x7f3f300a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.601+0000 7f3f5d632b80 1 Processor -- start 2023-07-14T13:22:56.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.604+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.604+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0c6580 0x5638bf0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.604+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0cc2d0 0x5638bf0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.604+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638befb7a60 con 0x5638bf0c6580 2023-07-14T13:22:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.604+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638befb7760 con 0x5638bef226b0 2023-07-14T13:22:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.604+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bee9b8c0 con 0x5638bf0cc2d0 2023-07-14T13:22:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.604+0000 7f3f5d632b80 10 client.0 _ll_register_callbacks cb 0x5638befb5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:22:56.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.606+0000 7f3f437fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.606+0000 7f3f437fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55146/0 (socket says 172.21.15.17:55146) 2023-07-14T13:22:56.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.606+0000 7f3f437fe700 1 -- 172.21.15.17:0/1841842257 learned_addr learned my addr 172.21.15.17:0/1841842257 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.606+0000 7f3f437fe700 1 -- 172.21.15.17:0/1841842257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0cc2d0 msgr2=0x5638bf0d0400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:22:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.606+0000 7f3f437fe700 1 --2- 172.21.15.17:0/1841842257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0cc2d0 0x5638bf0d0400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.606+0000 7f3f437fe700 1 -- 172.21.15.17:0/1841842257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0c6580 msgr2=0x5638bf0cfec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:22:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.606+0000 7f3f437fe700 1 --2- 172.21.15.17:0/1841842257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0c6580 0x5638bf0cfec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.606+0000 7f3f437fe700 1 -- 172.21.15.17:0/1841842257 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c004350 con 0x5638bef226b0 2023-07-14T13:22:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.610+0000 7f3f43fff700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f300a12d0 0x7f3f300a3780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00b690 tx=0x7f3f3c01acb0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.612+0000 7f3f437fe700 1 --2- 172.21.15.17:0/1841842257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cf980 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3f440ffa80 tx=0x7f3f3400bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=912a3f52149fa426 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.613+0000 7f3f22ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:22:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.613+0000 7f3f22ffd700 1 -- 172.21.15.17:0/1841842257 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3400e040 con 0x5638bef226b0 2023-07-14T13:22:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.614+0000 7f3f22ffd700 1 -- 172.21.15.17:0/1841842257 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3f34022070 con 0x5638bef226b0 2023-07-14T13:22:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.614+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1841842257 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638bef71490 con 0x5638bef226b0 2023-07-14T13:22:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.614+0000 7f3f22ffd700 1 -- 172.21.15.17:0/1841842257 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f340073e0 con 0x5638bef226b0 2023-07-14T13:22:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.614+0000 7f3f5d632b80 10 client.29054 fetch_fsmap learned FSMap version 55 2023-07-14T13:22:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.614+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1841842257 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5638bee2ec00 con 0x5638bef226b0 2023-07-14T13:22:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.615+0000 7f3f22ffd700 1 -- 172.21.15.17:0/1841842257 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5638bef71490 con 0x5638bef226b0 2023-07-14T13:22:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.615+0000 7f3f22ffd700 1 -- 172.21.15.17:0/1841842257 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3f3400b050 con 0x5638bef226b0 2023-07-14T13:22:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.615+0000 7f3f5d632b80 10 client.29054 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:22:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.615+0000 7f3f5d632b80 10 client.29054 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:22:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.615+0000 7f3f5d632b80 20 client.29054 populate_metadata read hostname 'smithi017' 2023-07-14T13:22:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.615+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/1841842257 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5638bf0dfcf0 0x5638bf0e2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.615+0000 7f3f5d632b80 4 client.29054 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:22:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.615+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1841842257 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638bf010e50 con 0x5638bf0dfcf0 2023-07-14T13:22:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.617+0000 7f3f3affd700 1 --2- 172.21.15.17:0/1841842257 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5638bf0dfcf0 0x5638bf0e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.618+0000 7f3f3affd700 1 --2- 172.21.15.17:0/1841842257 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5638bf0dfcf0 0x5638bf0e2100 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3051d319d6e2dc0 server_cookie=73985d8161e60ac0 in_seq=0 out_seq=0 2023-07-14T13:22:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.618+0000 7f3f22ffd700 10 client.29054 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.619+0000 7f3f22ffd700 1 -- 172.21.15.17:0/1841842257 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5638bf010e50 con 0x5638bf0dfcf0 2023-07-14T13:22:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.619+0000 7f3f22ffd700 10 client.29054 handle_command_reply: tid=0 2023-07-14T13:22:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.619+0000 7f3f5d632b80 1 client.29054 shutdown 2023-07-14T13:22:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.620+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1841842257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 msgr2=0x5638bf0cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.620+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/1841842257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cf980 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3f440ffa80 tx=0x7f3f3400bd80 comp rx=0 tx=0).stop 2023-07-14T13:22:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.621+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1841842257 shutdown_connections 2023-07-14T13:22:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.621+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/1841842257 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5638bf0dfcf0 0x5638bf0e2100 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.621+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/1841842257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0cc2d0 0x5638bf0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.621+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/1841842257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bef226b0 0x5638bf0cf980 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.621+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/1841842257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0c6580 0x5638bf0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.621+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1841842257 >> 172.21.15.17:0/1841842257 conn(0x5638bf0bbbe0 msgr2=0x5638bf0bfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:56.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.621+0000 7f3f22ffd700 0 client.29054 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:56.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.623+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1841842257 shutdown_connections 2023-07-14T13:22:56.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.623+0000 7f3f5d632b80 1 -- 172.21.15.17:0/1841842257 wait complete. 2023-07-14T13:22:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.624+0000 7f3f5d632b80 20 client.29054 trim_cache size 0 max 16384 2023-07-14T13:22:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.655+0000 7f3f5d632b80 1 Processor -- start 2023-07-14T13:22:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.656+0000 7f3f5d632b80 1 -- start start 2023-07-14T13:22:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.656+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0bbbe0 0x5638bf0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.656+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bef226b0 0x5638bf0d6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.656+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0c6580 0x5638bf0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.656+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bf0c2720 con 0x5638bf0bbbe0 2023-07-14T13:22:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.656+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bf0dc6b0 con 0x5638bf0c6580 2023-07-14T13:22:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.656+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bf0cba10 con 0x5638bef226b0 2023-07-14T13:22:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.657+0000 7f3f43fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0c6580 0x5638bf0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.657+0000 7f3f43fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0c6580 0x5638bf0cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55160/0 (socket says 172.21.15.17:55160) 2023-07-14T13:22:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.657+0000 7f3f43fff700 1 -- 172.21.15.17:0/2030123937 learned_addr learned my addr 172.21.15.17:0/2030123937 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.657+0000 7f3f3affd700 1 --2- 172.21.15.17:0/2030123937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bef226b0 0x5638bf0d6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.658+0000 7f3f43fff700 1 -- 172.21.15.17:0/2030123937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bef226b0 msgr2=0x5638bf0d6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.658+0000 7f3f43fff700 1 --2- 172.21.15.17:0/2030123937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bef226b0 0x5638bf0d6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.658+0000 7f3f43fff700 1 -- 172.21.15.17:0/2030123937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0bbbe0 msgr2=0x5638bf0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.658+0000 7f3f43fff700 1 --2- 172.21.15.17:0/2030123937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0bbbe0 0x5638bf0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.658+0000 7f3f43fff700 1 -- 172.21.15.17:0/2030123937 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638bf0e6cf0 con 0x5638bf0c6580 2023-07-14T13:22:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.658+0000 7f3f43fff700 1 --2- 172.21.15.17:0/2030123937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0c6580 0x5638bf0cb220 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c01ad20 tx=0x7f3f3c01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4486a1f4b3fe3c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.659+0000 7f3f3a7fc700 1 -- 172.21.15.17:0/2030123937 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c02b070 con 0x5638bf0c6580 2023-07-14T13:22:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.659+0000 7f3f3a7fc700 1 -- 172.21.15.17:0/2030123937 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f3c003fa0 con 0x5638bf0c6580 2023-07-14T13:22:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.659+0000 7f3f3a7fc700 1 -- 172.21.15.17:0/2030123937 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c01e040 con 0x5638bf0c6580 2023-07-14T13:22:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.660+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2030123937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0c6580 msgr2=0x5638bf0cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.660+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/2030123937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0c6580 0x5638bf0cb220 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c01ad20 tx=0x7f3f3c01f000 comp rx=0 tx=0).stop 2023-07-14T13:22:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.660+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2030123937 shutdown_connections 2023-07-14T13:22:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.660+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/2030123937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0c6580 0x5638bf0cb220 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.660+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/2030123937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bf0bbbe0 0x5638bf0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.660+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/2030123937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bef226b0 0x5638bf0d6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.660+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2030123937 >> 172.21.15.17:0/2030123937 conn(0x5638bf0c6cb0 msgr2=0x5638bf0cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.660+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2030123937 shutdown_connections 2023-07-14T13:22:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.661+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2030123937 wait complete. 2023-07-14T13:22:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.661+0000 7f3f5d632b80 1 -- start start 2023-07-14T13:22:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.661+0000 7f3f5d632b80 1 Processor -- start 2023-07-14T13:22:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.662+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bef226b0 0x5638bf127cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.662+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0bbbe0 0x5638bf128230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.662+0000 7f3f5d632b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0c6580 0x5638bf12bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.662+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bf12c270 con 0x5638bef226b0 2023-07-14T13:22:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.662+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bf12c3e0 con 0x5638bf0bbbe0 2023-07-14T13:22:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.662+0000 7f3f5d632b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638bf12c5a0 con 0x5638bf0c6580 2023-07-14T13:22:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.662+0000 7f3f5d632b80 10 client.0 _ll_register_callbacks cb 0x7f3f34007eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:22:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.663+0000 7f3f43fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0c6580 0x5638bf12bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.663+0000 7f3f43fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0c6580 0x5638bf12bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48022/0 (socket says 172.21.15.17:48022) 2023-07-14T13:22:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.663+0000 7f3f43fff700 1 -- 172.21.15.17:0/2054457052 learned_addr learned my addr 172.21.15.17:0/2054457052 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:22:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.663+0000 7f3f3affd700 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0bbbe0 0x5638bf128230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.663+0000 7f3f437fe700 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bef226b0 0x5638bf127cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.664+0000 7f3f3affd700 1 -- 172.21.15.17:0/2054457052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0c6580 msgr2=0x5638bf12bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.664+0000 7f3f3affd700 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0c6580 0x5638bf12bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.664+0000 7f3f3affd700 1 -- 172.21.15.17:0/2054457052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bef226b0 msgr2=0x5638bf127cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:22:56.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.664+0000 7f3f3affd700 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bef226b0 0x5638bf127cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.664+0000 7f3f3affd700 1 -- 172.21.15.17:0/2054457052 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638bee45d80 con 0x5638bf0bbbe0 2023-07-14T13:22:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.665+0000 7f3f3affd700 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0bbbe0 0x5638bf128230 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0c9df0 tx=0x7f3f2c00bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ea5ca323264ab30 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:22:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.665+0000 7f3f22ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:22:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.665+0000 7f3f22ffd700 1 -- 172.21.15.17:0/2054457052 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0ca160 con 0x5638bf0bbbe0 2023-07-14T13:22:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.665+0000 7f3f22ffd700 1 -- 172.21.15.17:0/2054457052 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3f2c099770 con 0x5638bf0bbbe0 2023-07-14T13:22:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.666+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2054457052 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f3c01a470 con 0x5638bf0bbbe0 2023-07-14T13:22:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.666+0000 7f3f22ffd700 1 -- 172.21.15.17:0/2054457052 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f2c09d7a0 con 0x5638bf0bbbe0 2023-07-14T13:22:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.666+0000 7f3f5d632b80 10 client.29060 fetch_fsmap learned FSMap version 55 2023-07-14T13:22:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.666+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2054457052 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5638bee6c1f0 con 0x5638bf0bbbe0 2023-07-14T13:22:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.667+0000 7f3f22ffd700 1 -- 172.21.15.17:0/2054457052 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f3c01a470 con 0x5638bf0bbbe0 2023-07-14T13:22:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.667+0000 7f3f22ffd700 1 -- 172.21.15.17:0/2054457052 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3f2c0b7900 con 0x5638bf0bbbe0 2023-07-14T13:22:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.668+0000 7f3f5d632b80 10 client.29060 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:22:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.668+0000 7f3f5d632b80 10 client.29060 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:22:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.668+0000 7f3f5d632b80 20 client.29060 populate_metadata read hostname 'smithi017' 2023-07-14T13:22:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.668+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5638bf0cc2d0 0x5638bf148020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:22:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.668+0000 7f3f5d632b80 4 client.29060 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:22:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.668+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2054457052 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5638befd2ff0 con 0x5638bf0cc2d0 2023-07-14T13:22:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.668+0000 7f3f437fe700 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5638bf0cc2d0 0x5638bf148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:22:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.669+0000 7f3f437fe700 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5638bf0cc2d0 0x5638bf148020 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58ba4dbdfba41488 server_cookie=4bb01af37eb3b91f in_seq=0 out_seq=0 2023-07-14T13:22:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.669+0000 7f3f22ffd700 10 client.29060 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.698+0000 7f3f22ffd700 1 -- 172.21.15.17:0/2054457052 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5638befd2ff0 con 0x5638bf0cc2d0 2023-07-14T13:22:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.698+0000 7f3f22ffd700 10 client.29060 handle_command_reply: tid=0 2023-07-14T13:22:56.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.702+0000 7f3f5d632b80 1 client.29060 shutdown 2023-07-14T13:22:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.702+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2054457052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0bbbe0 msgr2=0x5638bf128230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.702+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0bbbe0 0x5638bf128230 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0c9df0 tx=0x7f3f2c00bf90 comp rx=0 tx=0).stop 2023-07-14T13:22:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.703+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2054457052 shutdown_connections 2023-07-14T13:22:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.703+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5638bf0cc2d0 0x5638bf148020 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.703+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638bf0c6580 0x5638bf12bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.703+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5638bef226b0 0x5638bf127cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.703+0000 7f3f5d632b80 1 --2- 172.21.15.17:0/2054457052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5638bf0bbbe0 0x5638bf128230 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.703+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2054457052 >> 172.21.15.17:0/2054457052 conn(0x5638bf0c6cb0 msgr2=0x5638bf0cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.703+0000 7f3f22ffd700 0 client.29060 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:22:56.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.703+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2054457052 shutdown_connections 2023-07-14T13:22:56.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.706+0000 7f3f5d632b80 1 -- 172.21.15.17:0/2054457052 wait complete. 2023-07-14T13:22:56.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.707+0000 7f3f5d632b80 20 client.29060 trim_cache size 0 max 16384 2023-07-14T13:22:56.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:22:56.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:22:56.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:22:56.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:22:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.711+0000 7f3f49dff700 1 -- 172.21.15.17:0/3440566831 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f300a12d0 msgr2=0x7f3f300a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.711+0000 7f3f49dff700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f300a12d0 0x7f3f300a3780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00b690 tx=0x7f3f3c01acb0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.711+0000 7f3f49dff700 1 -- 172.21.15.17:0/3440566831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f44104e00 msgr2=0x7f3f44074300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:22:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.711+0000 7f3f49dff700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f44104e00 0x7f3f44074300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00b4d0 tx=0x7f3f2c00b7e0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.717+0000 7f3f49dff700 1 -- 172.21.15.17:0/3440566831 shutdown_connections 2023-07-14T13:22:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.717+0000 7f3f49dff700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f300a12d0 0x7f3f300a3780 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.717+0000 7f3f49dff700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f4406ab20 0x7f3f4406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.717+0000 7f3f49dff700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f44100760 0x7f3f44073da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.717+0000 7f3f49dff700 1 --2- 172.21.15.17:0/3440566831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f44104e00 0x7f3f44074300 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:22:56.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.717+0000 7f3f49dff700 1 -- 172.21.15.17:0/3440566831 >> 172.21.15.17:0/3440566831 conn(0x7f3f440fb650 msgr2=0x7f3f440fc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:22:56.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.717+0000 7f3f49dff700 1 -- 172.21.15.17:0/3440566831 shutdown_connections 2023-07-14T13:22:56.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:22:56.717+0000 7f3f49dff700 1 -- 172.21.15.17:0/3440566831 wait complete. 2023-07-14T13:22:57.437 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 285.0 s, 442.2 tps, lat 382.907 ms stddev 1031.360 2023-07-14T13:22:57.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:57 smithi135 ceph-mon[97338]: pgmap v733: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-07-14T13:22:57.734 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:57 smithi131 ceph-mon[96953]: pgmap v733: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-07-14T13:22:57.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:57 smithi017 ceph-mon[95536]: pgmap v733: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-07-14T13:22:59.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:22:59 smithi135 ceph-mon[97338]: pgmap v734: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.5 MiB/s wr, 570 op/s 2023-07-14T13:22:59.734 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:22:59 smithi131 ceph-mon[96953]: pgmap v734: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.5 MiB/s wr, 570 op/s 2023-07-14T13:22:59.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:22:59 smithi017 ceph-mon[95536]: pgmap v734: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.5 MiB/s wr, 570 op/s 2023-07-14T13:23:01.734 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:01 smithi131 ceph-mon[96953]: pgmap v735: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 937 op/s 2023-07-14T13:23:01.849 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:01 smithi017 ceph-mon[95536]: pgmap v735: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 937 op/s 2023-07-14T13:23:01.937 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:01 smithi135 ceph-mon[97338]: pgmap v735: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 937 op/s 2023-07-14T13:23:02.438 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 290.0 s, 454.1 tps, lat 216.278 ms stddev 216.441 2023-07-14T13:23:02.734 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:02 smithi131 ceph-mon[96953]: pgmap v736: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.6 MiB/s wr, 795 op/s 2023-07-14T13:23:02.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:02 smithi017 ceph-mon[95536]: pgmap v736: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.6 MiB/s wr, 795 op/s 2023-07-14T13:23:02.935 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:02 smithi135 ceph-mon[97338]: pgmap v736: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.6 MiB/s wr, 795 op/s 2023-07-14T13:23:05.344 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:05 smithi017 ceph-mon[95536]: osdmap e124: 12 total, 12 up, 12 in 2023-07-14T13:23:05.345 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:05 smithi017 ceph-mon[95536]: pgmap v738: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 911 op/s 2023-07-14T13:23:05.437 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:05 smithi135 ceph-mon[97338]: osdmap e124: 12 total, 12 up, 12 in 2023-07-14T13:23:05.437 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:05 smithi135 ceph-mon[97338]: pgmap v738: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 911 op/s 2023-07-14T13:23:05.484 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:05 smithi131 ceph-mon[96953]: osdmap e124: 12 total, 12 up, 12 in 2023-07-14T13:23:05.484 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:05 smithi131 ceph-mon[96953]: pgmap v738: 97 pgs: 97 active+clean; 14 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 911 op/s 2023-07-14T13:23:07.437 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 295.0 s, 267.8 tps, lat 320.934 ms stddev 136.447 2023-07-14T13:23:07.685 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:07 smithi135 ceph-mon[97338]: pgmap v739: 97 pgs: 18 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 42 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:23:07.734 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:07 smithi131 ceph-mon[96953]: pgmap v739: 97 pgs: 18 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 42 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:23:07.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:07 smithi017 ceph-mon[95536]: pgmap v739: 97 pgs: 18 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 42 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:23:09.685 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:09 smithi135 ceph-mon[97338]: pgmap v740: 97 pgs: 18 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 42 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:23:09.734 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:09 smithi131 ceph-mon[96953]: pgmap v740: 97 pgs: 18 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 42 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:23:09.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:09 smithi017 ceph-mon[95536]: pgmap v740: 97 pgs: 18 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 42 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:23:09.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.981+0000 7f669efff700 1 -- 172.21.15.17:0/3344648615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6698106cf0 msgr2=0x7f6698112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.981+0000 7f669efff700 1 --2- 172.21.15.17:0/3344648615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6698106cf0 0x7f6698112f30 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f6690009990 tx=0x7f6690009ca0 comp rx=0 tx=0).stop 2023-07-14T13:23:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.981+0000 7f669efff700 1 -- 172.21.15.17:0/3344648615 shutdown_connections 2023-07-14T13:23:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.981+0000 7f669efff700 1 --2- 172.21.15.17:0/3344648615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6698106cf0 0x7f6698112f30 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.981+0000 7f669efff700 1 --2- 172.21.15.17:0/3344648615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f669810c240 0x7f669810c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.981+0000 7f669efff700 1 --2- 172.21.15.17:0/3344648615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6698106340 0x7f66981067b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.981+0000 7f669efff700 1 -- 172.21.15.17:0/3344648615 >> 172.21.15.17:0/3344648615 conn(0x7f6698075a20 msgr2=0x7f6698077e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:10.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.981+0000 7f669efff700 1 -- 172.21.15.17:0/3344648615 shutdown_connections 2023-07-14T13:23:10.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.982+0000 7f669efff700 1 -- 172.21.15.17:0/3344648615 wait complete. 2023-07-14T13:23:10.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.983+0000 7f669efff700 1 Processor -- start 2023-07-14T13:23:10.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.983+0000 7f669efff700 1 -- start start 2023-07-14T13:23:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.984+0000 7f669efff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698106340 0x7f669819c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.984+0000 7f669efff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6698106cf0 0x7f669819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.984+0000 7f669efff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f669810c240 0x7f66981a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.984+0000 7f669efff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66981a1310 con 0x7f669810c240 2023-07-14T13:23:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.984+0000 7f669efff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66981a1480 con 0x7f6698106cf0 2023-07-14T13:23:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.984+0000 7f669efff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66981a1640 con 0x7f6698106340 2023-07-14T13:23:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.985+0000 7f669cd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698106340 0x7f669819c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.985+0000 7f669cd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698106340 0x7f669819c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40834/0 (socket says 172.21.15.17:40834) 2023-07-14T13:23:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.985+0000 7f669cd9b700 1 -- 172.21.15.17:0/117227064 learned_addr learned my addr 172.21.15.17:0/117227064 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.985+0000 7f669d59c700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f669810c240 0x7f66981a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.985+0000 7f669cd9b700 1 -- 172.21.15.17:0/117227064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6698106cf0 msgr2=0x7f669819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.985+0000 7f669cd9b700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6698106cf0 0x7f669819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.985+0000 7f669cd9b700 1 -- 172.21.15.17:0/117227064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f669810c240 msgr2=0x7f66981a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.985+0000 7f669cd9b700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f669810c240 0x7f66981a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.985+0000 7f669cd9b700 1 -- 172.21.15.17:0/117227064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900095f0 con 0x7f6698106340 2023-07-14T13:23:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.986+0000 7f669cd9b700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698106340 0x7f669819c120 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f66940060b0 tx=0x7f6694007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.986+0000 7f668dffb700 1 -- 172.21.15.17:0/117227064 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400de20 con 0x7f6698106340 2023-07-14T13:23:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.986+0000 7f668dffb700 1 -- 172.21.15.17:0/117227064 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f669400f040 con 0x7f6698106340 2023-07-14T13:23:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.986+0000 7f669efff700 1 -- 172.21.15.17:0/117227064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66981a1920 con 0x7f6698106340 2023-07-14T13:23:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.986+0000 7f669efff700 1 -- 172.21.15.17:0/117227064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66981a9160 con 0x7f6698106340 2023-07-14T13:23:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.987+0000 7f668dffb700 1 -- 172.21.15.17:0/117227064 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694014690 con 0x7f6698106340 2023-07-14T13:23:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.993+0000 7f66b28a7b80 1 Processor -- start 2023-07-14T13:23:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.994+0000 7f668dffb700 1 -- 172.21.15.17:0/117227064 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6694004ad0 con 0x7f6698106340 2023-07-14T13:23:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.994+0000 7f66b28a7b80 1 -- start start 2023-07-14T13:23:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.995+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846d086b0 0x55b846eb1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.995+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846eb22d0 0x55b846eac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.995+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eac580 0x55b846eac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.995+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846db1c50 con 0x55b846d086b0 2023-07-14T13:23:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.995+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846e049e0 con 0x55b846eb22d0 2023-07-14T13:23:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.995+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846dfde70 con 0x55b846eac580 2023-07-14T13:23:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.995+0000 7f669cd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846eb22d0 0x55b846eac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.996+0000 7f669cd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846eb22d0 0x55b846eac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53840/0 (socket says 172.21.15.17:53840) 2023-07-14T13:23:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.996+0000 7f669cd9b700 1 -- 172.21.15.17:0/1745655913 learned_addr learned my addr 172.21.15.17:0/1745655913 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.996+0000 7f668ffff700 1 --2- 172.21.15.17:0/1745655913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eac580 0x55b846eac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.996+0000 7f669d59c700 1 --2- 172.21.15.17:0/1745655913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846d086b0 0x55b846eb1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.997+0000 7f668ffff700 1 -- 172.21.15.17:0/1745655913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846eb22d0 msgr2=0x55b846eac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.997+0000 7f668ffff700 1 --2- 172.21.15.17:0/1745655913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846eb22d0 0x55b846eac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.997+0000 7f668ffff700 1 -- 172.21.15.17:0/1745655913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846d086b0 msgr2=0x55b846eb1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.997+0000 7f668ffff700 1 --2- 172.21.15.17:0/1745655913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846d086b0 0x55b846eb1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.997+0000 7f668ffff700 1 -- 172.21.15.17:0/1745655913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b846c2bd80 con 0x55b846eac580 2023-07-14T13:23:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.997+0000 7f669d59c700 1 --2- 172.21.15.17:0/1745655913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846d086b0 0x55b846eb1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:23:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.997+0000 7f668ffff700 1 --2- 172.21.15.17:0/1745655913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eac580 0x55b846eac9d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6688009ba0 tx=0x7f6688009eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9cc22594a98d835 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.997+0000 7f668dffb700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66800a13c0 0x7f66800a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.997+0000 7f667effd700 1 -- 172.21.15.17:0/1745655913 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688004230 con 0x55b846eac580 2023-07-14T13:23:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.998+0000 7f667effd700 1 -- 172.21.15.17:0/1745655913 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f668800edc0 con 0x55b846eac580 2023-07-14T13:23:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.998+0000 7f667effd700 1 -- 172.21.15.17:0/1745655913 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688005020 con 0x55b846eac580 2023-07-14T13:23:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.998+0000 7f668dffb700 1 -- 172.21.15.17:0/117227064 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f66940cc620 con 0x7f6698106340 2023-07-14T13:23:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.998+0000 7f669d59c700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66800a13c0 0x7f66800a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.999+0000 7f66b28a7b80 1 -- 172.21.15.17:0/1745655913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eac580 msgr2=0x55b846eac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.999+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/1745655913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eac580 0x55b846eac9d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6688009ba0 tx=0x7f6688009eb0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.999+0000 7f66b28a7b80 1 -- 172.21.15.17:0/1745655913 shutdown_connections 2023-07-14T13:23:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.999+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/1745655913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eac580 0x55b846eac9d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.999+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/1745655913 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846d086b0 0x55b846eb1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.999+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/1745655913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846eb22d0 0x55b846eac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:09.999+0000 7f66b28a7b80 1 -- 172.21.15.17:0/1745655913 >> 172.21.15.17:0/1745655913 conn(0x55b846ea1be0 msgr2=0x55b846ea6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.000+0000 7f669d59c700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66800a13c0 0x7f66800a3870 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f669000b2e0 tx=0x7f6690005a90 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.000+0000 7f66b28a7b80 1 -- 172.21.15.17:0/1745655913 shutdown_connections 2023-07-14T13:23:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.000+0000 7f66b28a7b80 1 -- 172.21.15.17:0/1745655913 wait complete. 2023-07-14T13:23:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.000+0000 7f66b28a7b80 1 -- start start 2023-07-14T13:23:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.001+0000 7f66b28a7b80 1 Processor -- start 2023-07-14T13:23:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.001+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846d086b0 0x55b846eb85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.001+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846eb57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.001+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 0x55b846eb5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.001+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846d9da60 con 0x55b846eac580 2023-07-14T13:23:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.001+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846d9d760 con 0x55b846d086b0 2023-07-14T13:23:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.001+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846c818c0 con 0x55b846eb22d0 2023-07-14T13:23:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.002+0000 7f66b28a7b80 10 client.0 _ll_register_callbacks cb 0x55b846d9b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:23:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.002+0000 7f669d59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 0x55b846eb5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.002+0000 7f669d59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 0x55b846eb5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40862/0 (socket says 172.21.15.17:40862) 2023-07-14T13:23:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.002+0000 7f669d59c700 1 -- 172.21.15.17:0/2303861799 learned_addr learned my addr 172.21.15.17:0/2303861799 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.002+0000 7f669cd9b700 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846d086b0 0x55b846eb85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.002+0000 7f668ffff700 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846eb57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.003+0000 7f669cd9b700 1 -- 172.21.15.17:0/2303861799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 msgr2=0x55b846eb5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.003+0000 7f669cd9b700 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 0x55b846eb5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.003+0000 7f669cd9b700 1 -- 172.21.15.17:0/2303861799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 msgr2=0x55b846eb57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.003+0000 7f669cd9b700 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846eb57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.003+0000 7f669cd9b700 1 -- 172.21.15.17:0/2303861799 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6688009880 con 0x55b846d086b0 2023-07-14T13:23:10.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.004+0000 7f669cd9b700 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846d086b0 0x55b846eb85a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6694099610 tx=0x7f66940cfee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8043d716caaeff1d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:10.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.004+0000 7f6677fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:23:10.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.004+0000 7f6677fff700 1 -- 172.21.15.17:0/2303861799 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940842f0 con 0x55b846d086b0 2023-07-14T13:23:10.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.004+0000 7f6677fff700 1 -- 172.21.15.17:0/2303861799 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f6694099680 con 0x55b846d086b0 2023-07-14T13:23:10.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.004+0000 7f66b28a7b80 1 -- 172.21.15.17:0/2303861799 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b846d57490 con 0x55b846d086b0 2023-07-14T13:23:10.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.005+0000 7f6677fff700 1 -- 172.21.15.17:0/2303861799 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66940991c0 con 0x55b846d086b0 2023-07-14T13:23:10.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.005+0000 7f66b28a7b80 10 client.29069 fetch_fsmap learned FSMap version 55 2023-07-14T13:23:10.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.005+0000 7f66b28a7b80 1 -- 172.21.15.17:0/2303861799 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55b846c14c00 con 0x55b846d086b0 2023-07-14T13:23:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.006+0000 7f6677fff700 1 -- 172.21.15.17:0/2303861799 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b846d57490 con 0x55b846d086b0 2023-07-14T13:23:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.006+0000 7f6677fff700 1 -- 172.21.15.17:0/2303861799 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6694098b70 con 0x55b846d086b0 2023-07-14T13:23:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.006+0000 7f66b28a7b80 10 client.29069 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:23:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.006+0000 7f66b28a7b80 10 client.29069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:23:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.006+0000 7f66b28a7b80 20 client.29069 populate_metadata read hostname 'smithi017' 2023-07-14T13:23:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.006+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b846ec5bb0 0x55b846ec7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.006+0000 7f66b28a7b80 4 client.29069 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:23:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.006+0000 7f66b28a7b80 1 -- 172.21.15.17:0/2303861799 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b846df6e50 con 0x55b846ec5bb0 2023-07-14T13:23:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.006+0000 7f668ffff700 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b846ec5bb0 0x55b846ec7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.007+0000 7f668ffff700 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b846ec5bb0 0x55b846ec7fc0 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf225b6bd4b98277 server_cookie=4912fc4b5698a03b in_seq=0 out_seq=0 2023-07-14T13:23:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.007+0000 7f6677fff700 10 client.29069 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.008+0000 7f6677fff700 1 -- 172.21.15.17:0/2303861799 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b846df6e50 con 0x55b846ec5bb0 2023-07-14T13:23:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.008+0000 7f6677fff700 10 client.29069 handle_command_reply: tid=0 2023-07-14T13:23:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.008+0000 7f66b28a7b80 1 client.29069 shutdown 2023-07-14T13:23:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.008+0000 7f66b28a7b80 1 -- 172.21.15.17:0/2303861799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846d086b0 msgr2=0x55b846eb85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.008+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846d086b0 0x55b846eb85a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6694099610 tx=0x7f66940cfee0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.009+0000 7f66b28a7b80 1 -- 172.21.15.17:0/2303861799 shutdown_connections 2023-07-14T13:23:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.009+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b846ec5bb0 0x55b846ec7fc0 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.009+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 0x55b846eb5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.009+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846d086b0 0x55b846eb85a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.009+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/2303861799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846eb57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.009+0000 7f66b28a7b80 1 -- 172.21.15.17:0/2303861799 >> 172.21.15.17:0/2303861799 conn(0x55b846ea1be0 msgr2=0x55b846ea5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.009+0000 7f6677fff700 0 client.29069 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.009+0000 7f66b28a7b80 1 -- 172.21.15.17:0/2303861799 shutdown_connections 2023-07-14T13:23:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.009+0000 7f66b28a7b80 1 -- 172.21.15.17:0/2303861799 wait complete. 2023-07-14T13:23:10.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.010+0000 7f66b28a7b80 20 client.29069 trim_cache size 0 max 16384 2023-07-14T13:23:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.035+0000 7f66b28a7b80 1 Processor -- start 2023-07-14T13:23:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.035+0000 7f66b28a7b80 1 -- start start 2023-07-14T13:23:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.036+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846d086b0 0x55b846ebcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.036+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846ea6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.036+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 0x55b846eb3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.036+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846e72060 con 0x55b846eac580 2023-07-14T13:23:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.036+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846ea3d00 con 0x55b846d086b0 2023-07-14T13:23:10.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.036+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846eb63c0 con 0x55b846eb22d0 2023-07-14T13:23:10.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.036+0000 7f669d59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 0x55b846eb3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.036+0000 7f669d59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 0x55b846eb3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40874/0 (socket says 172.21.15.17:40874) 2023-07-14T13:23:10.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.036+0000 7f669d59c700 1 -- 172.21.15.17:0/1654684225 learned_addr learned my addr 172.21.15.17:0/1654684225 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:10.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.036+0000 7f668ffff700 1 --2- 172.21.15.17:0/1654684225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846ea6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.037+0000 7f669cd9b700 1 --2- 172.21.15.17:0/1654684225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846d086b0 0x55b846ebcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.037+0000 7f668ffff700 1 -- 172.21.15.17:0/1654684225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 msgr2=0x55b846eb3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.037+0000 7f668ffff700 1 --2- 172.21.15.17:0/1654684225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 0x55b846eb3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.037+0000 7f668ffff700 1 -- 172.21.15.17:0/1654684225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846d086b0 msgr2=0x55b846ebcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.037+0000 7f668ffff700 1 --2- 172.21.15.17:0/1654684225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846d086b0 0x55b846ebcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.037+0000 7f668ffff700 1 -- 172.21.15.17:0/1654684225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b846eccbb0 con 0x55b846eac580 2023-07-14T13:23:10.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.037+0000 7f668ffff700 1 --2- 172.21.15.17:0/1654684225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846ea6c60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f6688004790 tx=0x7f66880097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232e8fccff0c1fa5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.038+0000 7f667f7fe700 1 -- 172.21.15.17:0/1654684225 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668800e9b0 con 0x55b846eac580 2023-07-14T13:23:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.038+0000 7f667f7fe700 1 -- 172.21.15.17:0/1654684225 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f668801d040 con 0x55b846eac580 2023-07-14T13:23:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.038+0000 7f667f7fe700 1 -- 172.21.15.17:0/1654684225 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688028620 con 0x55b846eac580 2023-07-14T13:23:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.039+0000 7f66b28a7b80 1 -- 172.21.15.17:0/1654684225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 msgr2=0x55b846ea6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.039+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/1654684225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846ea6c60 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f6688004790 tx=0x7f66880097e0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.039+0000 7f66b28a7b80 1 -- 172.21.15.17:0/1654684225 shutdown_connections 2023-07-14T13:23:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.039+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/1654684225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846eb22d0 0x55b846eb3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.039+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/1654684225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846d086b0 0x55b846ebcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.039+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/1654684225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846ea6c60 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.039+0000 7f66b28a7b80 1 -- 172.21.15.17:0/1654684225 >> 172.21.15.17:0/1654684225 conn(0x55b846ea1be0 msgr2=0x55b846eb2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.039+0000 7f66b28a7b80 1 -- 172.21.15.17:0/1654684225 shutdown_connections 2023-07-14T13:23:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.039+0000 7f66b28a7b80 1 -- 172.21.15.17:0/1654684225 wait complete. 2023-07-14T13:23:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.040+0000 7f66b28a7b80 1 -- start start 2023-07-14T13:23:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.040+0000 7f66b28a7b80 1 Processor -- start 2023-07-14T13:23:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.041+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846d086b0 0x55b846ebccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.041+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846ead900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.041+0000 7f66b28a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846eb22d0 0x55b846eade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.041+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846eae380 con 0x55b846eac580 2023-07-14T13:23:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.041+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846eae4f0 con 0x55b846eb22d0 2023-07-14T13:23:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.041+0000 7f66b28a7b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b846eae6b0 con 0x55b846d086b0 2023-07-14T13:23:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.041+0000 7f66b28a7b80 10 client.0 _ll_register_callbacks cb 0x55b846d9b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:23:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.042+0000 7f669cd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846d086b0 0x55b846ebccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.042+0000 7f669d59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846eb22d0 0x55b846eade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.042+0000 7f668ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846ead900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.042+0000 7f669cd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846d086b0 0x55b846ebccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40890/0 (socket says 172.21.15.17:40890) 2023-07-14T13:23:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.042+0000 7f669cd9b700 1 -- 172.21.15.17:0/968414657 learned_addr learned my addr 172.21.15.17:0/968414657 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.043+0000 7f668ffff700 1 -- 172.21.15.17:0/968414657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846d086b0 msgr2=0x55b846ebccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.043+0000 7f668ffff700 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846d086b0 0x55b846ebccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.043+0000 7f668ffff700 1 -- 172.21.15.17:0/968414657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846eb22d0 msgr2=0x55b846eade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.043+0000 7f668ffff700 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846eb22d0 0x55b846eade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.043+0000 7f668ffff700 1 -- 172.21.15.17:0/968414657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b846c2bd80 con 0x55b846eac580 2023-07-14T13:23:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.043+0000 7f669cd9b700 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846d086b0 0x55b846ebccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:23:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.043+0000 7f668ffff700 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846ead900 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f6688009fd0 tx=0x7f668800e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa692907326885aa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.043+0000 7f6677fff700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:23:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.043+0000 7f6677fff700 1 -- 172.21.15.17:0/968414657 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668800ebe0 con 0x55b846eac580 2023-07-14T13:23:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.044+0000 7f66b28a7b80 1 -- 172.21.15.17:0/968414657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f668800edc0 con 0x55b846eac580 2023-07-14T13:23:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.044+0000 7f6677fff700 1 -- 172.21.15.17:0/968414657 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f6688014070 con 0x55b846eac580 2023-07-14T13:23:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.044+0000 7f6677fff700 1 -- 172.21.15.17:0/968414657 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6688028d50 con 0x55b846eac580 2023-07-14T13:23:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.044+0000 7f66b28a7b80 10 client.19305 fetch_fsmap learned FSMap version 55 2023-07-14T13:23:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.044+0000 7f66b28a7b80 1 -- 172.21.15.17:0/968414657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55b846c521f0 con 0x55b846eac580 2023-07-14T13:23:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.045+0000 7f6677fff700 1 -- 172.21.15.17:0/968414657 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f668800edc0 con 0x55b846eac580 2023-07-14T13:23:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.045+0000 7f6677fff700 1 -- 172.21.15.17:0/968414657 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6688039070 con 0x55b846eac580 2023-07-14T13:23:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.046+0000 7f66b28a7b80 10 client.19305 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:23:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.046+0000 7f66b28a7b80 10 client.19305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:23:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.046+0000 7f66b28a7b80 20 client.19305 populate_metadata read hostname 'smithi017' 2023-07-14T13:23:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.046+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b846f1a960 0x55b846f1cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.046+0000 7f66b28a7b80 4 client.19305 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:23:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.046+0000 7f66b28a7b80 1 -- 172.21.15.17:0/968414657 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b846db8ff0 con 0x55b846f1a960 2023-07-14T13:23:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.046+0000 7f669cd9b700 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b846f1a960 0x55b846f1cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:10.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.047+0000 7f6677fff700 10 client.19305 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:10.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.047+0000 7f669cd9b700 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b846f1a960 0x55b846f1cd70 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd40e834eb990da3 server_cookie=a4ddb24c1a552445 in_seq=0 out_seq=0 2023-07-14T13:23:10.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.084+0000 7f6677fff700 1 -- 172.21.15.17:0/968414657 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b846db8ff0 con 0x55b846f1a960 2023-07-14T13:23:10.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.085+0000 7f6677fff700 10 client.19305 handle_command_reply: tid=0 2023-07-14T13:23:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.085+0000 7f66b28a7b80 1 client.19305 shutdown 2023-07-14T13:23:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.085+0000 7f66b28a7b80 1 -- 172.21.15.17:0/968414657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 msgr2=0x55b846ead900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.085+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846ead900 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f6688009fd0 tx=0x7f668800e9b0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.086+0000 7f66b28a7b80 1 -- 172.21.15.17:0/968414657 shutdown_connections 2023-07-14T13:23:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.086+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b846f1a960 0x55b846f1cd70 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.086+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b846eb22d0 0x55b846eade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.086+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b846d086b0 0x55b846ebccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.086+0000 7f66b28a7b80 1 --2- 172.21.15.17:0/968414657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b846eac580 0x55b846ead900 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.086+0000 7f66b28a7b80 1 -- 172.21.15.17:0/968414657 >> 172.21.15.17:0/968414657 conn(0x55b846ea1be0 msgr2=0x55b846eb3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.086+0000 7f6677fff700 0 client.19305 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.086+0000 7f66b28a7b80 1 -- 172.21.15.17:0/968414657 shutdown_connections 2023-07-14T13:23:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.086+0000 7f66b28a7b80 1 -- 172.21.15.17:0/968414657 wait complete. 2023-07-14T13:23:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.087+0000 7f66b28a7b80 20 client.19305 trim_cache size 0 max 16384 2023-07-14T13:23:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:23:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:23:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:23:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:23:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.088+0000 7f669efff700 1 -- 172.21.15.17:0/117227064 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66800a13c0 msgr2=0x7f66800a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.088+0000 7f669efff700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66800a13c0 0x7f66800a3870 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f669000b2e0 tx=0x7f6690005a90 comp rx=0 tx=0).stop 2023-07-14T13:23:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.088+0000 7f669efff700 1 -- 172.21.15.17:0/117227064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698106340 msgr2=0x7f669819c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.088+0000 7f669efff700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698106340 0x7f669819c120 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f66940060b0 tx=0x7f6694007f90 comp rx=0 tx=0).stop 2023-07-14T13:23:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.088+0000 7f669efff700 1 -- 172.21.15.17:0/117227064 shutdown_connections 2023-07-14T13:23:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.088+0000 7f669efff700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f66800a13c0 0x7f66800a3870 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.088+0000 7f669efff700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f669810c240 0x7f66981a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.088+0000 7f669efff700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6698106340 0x7f669819c120 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.088+0000 7f669efff700 1 --2- 172.21.15.17:0/117227064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6698106cf0 0x7f669819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.088+0000 7f669efff700 1 -- 172.21.15.17:0/117227064 >> 172.21.15.17:0/117227064 conn(0x7f6698075a20 msgr2=0x7f6698077060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.089+0000 7f669efff700 1 -- 172.21.15.17:0/117227064 shutdown_connections 2023-07-14T13:23:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:10.089+0000 7f669efff700 1 -- 172.21.15.17:0/117227064 wait complete. 2023-07-14T13:23:11.685 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:11 smithi135 ceph-mon[97338]: pgmap v741: 97 pgs: 8 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 71 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.7 MiB/s wr, 917 op/s 2023-07-14T13:23:11.734 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:11 smithi131 ceph-mon[96953]: pgmap v741: 97 pgs: 8 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 71 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.7 MiB/s wr, 917 op/s 2023-07-14T13:23:11.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:11 smithi017 ceph-mon[95536]: pgmap v741: 97 pgs: 8 active+clean+snaptrim, 18 active+clean+snaptrim_wait, 71 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.7 MiB/s wr, 917 op/s 2023-07-14T13:23:12.439 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 300.0 s, 315.9 tps, lat 365.778 ms stddev 638.431 2023-07-14T13:23:13.685 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:13 smithi135 ceph-mon[97338]: pgmap v742: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.9 MiB/s wr, 819 op/s 2023-07-14T13:23:13.733 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:13 smithi131 ceph-mon[96953]: pgmap v742: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.9 MiB/s wr, 819 op/s 2023-07-14T13:23:13.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:13 smithi017 ceph-mon[95536]: pgmap v742: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.9 MiB/s wr, 819 op/s 2023-07-14T13:23:15.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:15 smithi135 ceph-mon[97338]: pgmap v743: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 800 op/s 2023-07-14T13:23:15.733 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:15 smithi131 ceph-mon[96953]: pgmap v743: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 800 op/s 2023-07-14T13:23:15.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:15 smithi017 ceph-mon[95536]: pgmap v743: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.6 MiB/s wr, 800 op/s 2023-07-14T13:23:17.436 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 305.0 s, 561.0 tps, lat 178.773 ms stddev 63.132 2023-07-14T13:23:17.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:17 smithi135 ceph-mon[97338]: pgmap v744: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-07-14T13:23:17.685 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:17 smithi135 ceph-mon[97338]: osdmap e125: 12 total, 12 up, 12 in 2023-07-14T13:23:17.733 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:17 smithi131 ceph-mon[96953]: pgmap v744: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-07-14T13:23:17.733 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:17 smithi131 ceph-mon[96953]: osdmap e125: 12 total, 12 up, 12 in 2023-07-14T13:23:17.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:17 smithi017 ceph-mon[95536]: pgmap v744: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-07-14T13:23:17.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:17 smithi017 ceph-mon[95536]: osdmap e125: 12 total, 12 up, 12 in 2023-07-14T13:23:19.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:19 smithi135 ceph-mon[97338]: pgmap v746: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 995 op/s 2023-07-14T13:23:19.733 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:19 smithi131 ceph-mon[96953]: pgmap v746: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 995 op/s 2023-07-14T13:23:19.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:19 smithi017 ceph-mon[95536]: pgmap v746: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 995 op/s 2023-07-14T13:23:21.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:21 smithi017 ceph-mon[95536]: pgmap v747: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:23:21.934 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:21 smithi135 ceph-mon[97338]: pgmap v747: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:23:21.983 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:21 smithi131 ceph-mon[96953]: pgmap v747: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:23:22.437 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 310.0 s, 551.4 tps, lat 179.418 ms stddev 360.364 2023-07-14T13:23:22.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:22 smithi017 ceph-mon[95536]: pgmap v748: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-14T13:23:22.934 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:22 smithi135 ceph-mon[97338]: pgmap v748: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-14T13:23:22.986 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:22 smithi131 ceph-mon[96953]: pgmap v748: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-14T13:23:23.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.367+0000 7f89febff700 1 -- 172.21.15.17:0/843421447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f807a800 msgr2=0x7f89f810adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.367+0000 7f89febff700 1 --2- 172.21.15.17:0/843421447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f807a800 0x7f89f810adb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009990 tx=0x7f89e4009ca0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.367+0000 7f89febff700 1 -- 172.21.15.17:0/843421447 shutdown_connections 2023-07-14T13:23:23.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.367+0000 7f89febff700 1 --2- 172.21.15.17:0/843421447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89f810b490 0x7f89f8113040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.367+0000 7f89febff700 1 --2- 172.21.15.17:0/843421447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89f8079e60 0x7f89f807a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.367+0000 7f89febff700 1 --2- 172.21.15.17:0/843421447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f807a800 0x7f89f810adb0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.367+0000 7f89febff700 1 -- 172.21.15.17:0/843421447 >> 172.21.15.17:0/843421447 conn(0x7f89f80756f0 msgr2=0x7f89f8077b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.368+0000 7f89febff700 1 -- 172.21.15.17:0/843421447 shutdown_connections 2023-07-14T13:23:23.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.368+0000 7f89febff700 1 -- 172.21.15.17:0/843421447 wait complete. 2023-07-14T13:23:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.369+0000 7f89febff700 1 Processor -- start 2023-07-14T13:23:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.370+0000 7f89febff700 1 -- start start 2023-07-14T13:23:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.370+0000 7f89febff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f8079e60 0x7f89f8071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.370+0000 7f89febff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89f807a800 0x7f89f8072010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.370+0000 7f89febff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89f810b490 0x7f89f806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.370+0000 7f89febff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f806b0a0 con 0x7f89f807a800 2023-07-14T13:23:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.370+0000 7f89febff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f806b210 con 0x7f89f810b490 2023-07-14T13:23:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.370+0000 7f89febff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f806b3d0 con 0x7f89f8079e60 2023-07-14T13:23:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.371+0000 7f89fc99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f8079e60 0x7f89f8071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.371+0000 7f89fc99b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f8079e60 0x7f89f8071a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44100/0 (socket says 172.21.15.17:44100) 2023-07-14T13:23:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.371+0000 7f89fc99b700 1 -- 172.21.15.17:0/3778705932 learned_addr learned my addr 172.21.15.17:0/3778705932 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.372+0000 7f89fc99b700 1 -- 172.21.15.17:0/3778705932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89f810b490 msgr2=0x7f89f806a8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T13:23:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.372+0000 7f89fc99b700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89f810b490 0x7f89f806a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.372+0000 7f89fc99b700 1 -- 172.21.15.17:0/3778705932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89f807a800 msgr2=0x7f89f8072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.372+0000 7f89fc99b700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89f807a800 0x7f89f8072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.372+0000 7f89fc99b700 1 -- 172.21.15.17:0/3778705932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40095f0 con 0x7f89f8079e60 2023-07-14T13:23:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.373+0000 7f89fc99b700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f8079e60 0x7f89f8071a90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00d950 tx=0x7f89ec00dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.374+0000 7f89f5ffb700 1 -- 172.21.15.17:0/3778705932 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec009b40 con 0x7f89f8079e60 2023-07-14T13:23:23.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.374+0000 7f89f5ffb700 1 -- 172.21.15.17:0/3778705932 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89ec009ca0 con 0x7f89f8079e60 2023-07-14T13:23:23.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.374+0000 7f89f5ffb700 1 -- 172.21.15.17:0/3778705932 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00f620 con 0x7f89f8079e60 2023-07-14T13:23:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.376+0000 7f89febff700 1 -- 172.21.15.17:0/3778705932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f806b6b0 con 0x7f89f8079e60 2023-07-14T13:23:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.376+0000 7f89febff700 1 -- 172.21.15.17:0/3778705932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f806f8c0 con 0x7f89f8079e60 2023-07-14T13:23:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.384+0000 7f8a12621b80 1 Processor -- start 2023-07-14T13:23:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.384+0000 7f8a12621b80 1 -- start start 2023-07-14T13:23:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.385+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a2226b0 0x55609a3cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.385+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3cc2d0 0x55609a3c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.385+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a3c6580 0x55609a3c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.385+0000 7f8a12621b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a2cbc50 con 0x55609a3c6580 2023-07-14T13:23:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.385+0000 7f8a12621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a31e9e0 con 0x55609a2226b0 2023-07-14T13:23:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.385+0000 7f8a12621b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a317e70 con 0x55609a3cc2d0 2023-07-14T13:23:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.385+0000 7f89fd19c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a2226b0 0x55609a3cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.385+0000 7f89fd19c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a2226b0 0x55609a3cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:37506/0 (socket says 172.21.15.17:37506) 2023-07-14T13:23:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.385+0000 7f89fd19c700 1 -- 172.21.15.17:0/3974303314 learned_addr learned my addr 172.21.15.17:0/3974303314 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.389+0000 7f89f7fff700 1 --2- 172.21.15.17:0/3974303314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a3c6580 0x55609a3c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.389+0000 7f89fd19c700 1 -- 172.21.15.17:0/3974303314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3cc2d0 msgr2=0x55609a3c6040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:23:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.389+0000 7f89fd19c700 1 --2- 172.21.15.17:0/3974303314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3cc2d0 0x55609a3c6040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.389+0000 7f89fd19c700 1 -- 172.21.15.17:0/3974303314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a3c6580 msgr2=0x55609a3c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.389+0000 7f89fd19c700 1 --2- 172.21.15.17:0/3974303314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a3c6580 0x55609a3c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.389+0000 7f89fd19c700 1 -- 172.21.15.17:0/3974303314 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55609a145d80 con 0x55609a2226b0 2023-07-14T13:23:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.389+0000 7f89f7fff700 1 --2- 172.21.15.17:0/3974303314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a3c6580 0x55609a3c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:23:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.390+0000 7f89fd19c700 1 --2- 172.21.15.17:0/3974303314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a2226b0 0x55609a3cbd90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f89f0007f90 tx=0x7f89f000c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=559368e5ab4b62dd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.390+0000 7f89e2ffd700 1 -- 172.21.15.17:0/3974303314 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0012420 con 0x55609a2226b0 2023-07-14T13:23:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.390+0000 7f89e2ffd700 1 -- 172.21.15.17:0/3974303314 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89f0012a10 con 0x55609a2226b0 2023-07-14T13:23:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.390+0000 7f89e2ffd700 1 -- 172.21.15.17:0/3974303314 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0011980 con 0x55609a2226b0 2023-07-14T13:23:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.394+0000 7f89f5ffb700 1 -- 172.21.15.17:0/3778705932 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f89ec010460 con 0x7f89f8079e60 2023-07-14T13:23:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.395+0000 7f8a12621b80 1 -- 172.21.15.17:0/3974303314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a2226b0 msgr2=0x55609a3cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.395+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3974303314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a2226b0 0x55609a3cbd90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f89f0007f90 tx=0x7f89f000c3c0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.395+0000 7f8a12621b80 1 -- 172.21.15.17:0/3974303314 shutdown_connections 2023-07-14T13:23:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.395+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3974303314 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a3c6580 0x55609a3c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.395+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3974303314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a2226b0 0x55609a3cbd90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.395+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3974303314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3cc2d0 0x55609a3c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.395+0000 7f8a12621b80 1 -- 172.21.15.17:0/3974303314 >> 172.21.15.17:0/3974303314 conn(0x55609a3bbbe0 msgr2=0x55609a3c0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.396+0000 7f89f5ffb700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89e80a13a0 0x7f89e80a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.397+0000 7f89f5ffb700 1 -- 172.21.15.17:0/3778705932 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f89ec0cca80 con 0x7f89f8079e60 2023-07-14T13:23:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.397+0000 7f89f7fff700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89e80a13a0 0x7f89e80a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.398+0000 7f8a12621b80 1 -- 172.21.15.17:0/3974303314 shutdown_connections 2023-07-14T13:23:23.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.399+0000 7f8a12621b80 1 -- 172.21.15.17:0/3974303314 wait complete. 2023-07-14T13:23:23.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.399+0000 7f89f7fff700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89e80a13a0 0x7f89e80a3850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f89e400b5c0 tx=0x7f89e4003680 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:23.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.400+0000 7f8a12621b80 1 -- start start 2023-07-14T13:23:23.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.400+0000 7f8a12621b80 1 Processor -- start 2023-07-14T13:23:23.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.401+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a2226b0 0x55609a3d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.401+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a3c6580 0x55609a3cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.401+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3cc2d0 0x55609a3cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.401+0000 7f8a12621b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a2b7a60 con 0x55609a3c6580 2023-07-14T13:23:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.401+0000 7f8a12621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a2b7760 con 0x55609a2226b0 2023-07-14T13:23:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.401+0000 7f8a12621b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a19b8c0 con 0x55609a3cc2d0 2023-07-14T13:23:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.401+0000 7f8a12621b80 10 client.0 _ll_register_callbacks cb 0x55609a2b5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:23:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.402+0000 7f89fd19c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3cc2d0 0x55609a3cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.402+0000 7f89fd19c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3cc2d0 0x55609a3cff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44112/0 (socket says 172.21.15.17:44112) 2023-07-14T13:23:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.402+0000 7f89fd19c700 1 -- 172.21.15.17:0/3740226057 learned_addr learned my addr 172.21.15.17:0/3740226057 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.402+0000 7f89fd19c700 1 -- 172.21.15.17:0/3740226057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a2226b0 msgr2=0x55609a3d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.402+0000 7f89fd19c700 1 --2- 172.21.15.17:0/3740226057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a2226b0 0x55609a3d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.402+0000 7f89fd19c700 1 -- 172.21.15.17:0/3740226057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a3c6580 msgr2=0x55609a3cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.402+0000 7f89fd19c700 1 --2- 172.21.15.17:0/3740226057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a3c6580 0x55609a3cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.402+0000 7f89fd19c700 1 -- 172.21.15.17:0/3740226057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f0007bc0 con 0x55609a3cc2d0 2023-07-14T13:23:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.403+0000 7f89fd19c700 1 --2- 172.21.15.17:0/3740226057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3cc2d0 0x55609a3cff90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f89f000cfc0 tx=0x7f89f0012c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=835b463f2d56dd7e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.403+0000 7f89d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:23:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.404+0000 7f89d7fff700 1 -- 172.21.15.17:0/3740226057 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0003a00 con 0x55609a3cc2d0 2023-07-14T13:23:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.404+0000 7f89d7fff700 1 -- 172.21.15.17:0/3740226057 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f89f0003b60 con 0x55609a3cc2d0 2023-07-14T13:23:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.404+0000 7f8a12621b80 1 -- 172.21.15.17:0/3740226057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55609a271490 con 0x55609a3cc2d0 2023-07-14T13:23:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.404+0000 7f89d7fff700 1 -- 172.21.15.17:0/3740226057 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89f0003d20 con 0x55609a3cc2d0 2023-07-14T13:23:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.404+0000 7f8a12621b80 10 client.29050 fetch_fsmap learned FSMap version 55 2023-07-14T13:23:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.404+0000 7f8a12621b80 1 -- 172.21.15.17:0/3740226057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55609a12ec00 con 0x55609a3cc2d0 2023-07-14T13:23:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.406+0000 7f89d7fff700 1 -- 172.21.15.17:0/3740226057 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55609a271490 con 0x55609a3cc2d0 2023-07-14T13:23:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.406+0000 7f89d7fff700 1 -- 172.21.15.17:0/3740226057 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f89f0011500 con 0x55609a3cc2d0 2023-07-14T13:23:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.406+0000 7f8a12621b80 10 client.29050 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:23:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.406+0000 7f8a12621b80 10 client.29050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:23:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.406+0000 7f8a12621b80 20 client.29050 populate_metadata read hostname 'smithi017' 2023-07-14T13:23:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.406+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3740226057 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55609a3dfb60 0x55609a3e1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.406+0000 7f8a12621b80 4 client.29050 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:23:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.406+0000 7f8a12621b80 1 -- 172.21.15.17:0/3740226057 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55609a310e50 con 0x55609a3dfb60 2023-07-14T13:23:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.407+0000 7f89fc99b700 1 --2- 172.21.15.17:0/3740226057 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55609a3dfb60 0x55609a3e1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.409+0000 7f89fc99b700 1 --2- 172.21.15.17:0/3740226057 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55609a3dfb60 0x55609a3e1f70 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a12feb2c1d34313f server_cookie=677cbf203fde51a5 in_seq=0 out_seq=0 2023-07-14T13:23:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.410+0000 7f89d7fff700 10 client.29050 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.410+0000 7f89d7fff700 1 -- 172.21.15.17:0/3740226057 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55609a310e50 con 0x55609a3dfb60 2023-07-14T13:23:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.410+0000 7f89d7fff700 10 client.29050 handle_command_reply: tid=0 2023-07-14T13:23:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.410+0000 7f8a12621b80 1 client.29050 shutdown 2023-07-14T13:23:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.411+0000 7f8a12621b80 1 -- 172.21.15.17:0/3740226057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3cc2d0 msgr2=0x55609a3cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.411+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3740226057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3cc2d0 0x55609a3cff90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f89f000cfc0 tx=0x7f89f0012c30 comp rx=0 tx=0).stop 2023-07-14T13:23:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.411+0000 7f8a12621b80 1 -- 172.21.15.17:0/3740226057 shutdown_connections 2023-07-14T13:23:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.411+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3740226057 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55609a3dfb60 0x55609a3e1f70 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.411+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3740226057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3cc2d0 0x55609a3cff90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.411+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3740226057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a2226b0 0x55609a3d2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.411+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3740226057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a3c6580 0x55609a3cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.411+0000 7f8a12621b80 1 -- 172.21.15.17:0/3740226057 >> 172.21.15.17:0/3740226057 conn(0x55609a3bbbe0 msgr2=0x55609a3c04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.414+0000 7f89d7fff700 0 client.29050 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:23.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.414+0000 7f8a12621b80 1 -- 172.21.15.17:0/3740226057 shutdown_connections 2023-07-14T13:23:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.418+0000 7f8a12621b80 1 -- 172.21.15.17:0/3740226057 wait complete. 2023-07-14T13:23:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.419+0000 7f8a12621b80 20 client.29050 trim_cache size 0 max 16384 2023-07-14T13:23:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.449+0000 7f8a12621b80 1 Processor -- start 2023-07-14T13:23:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.453+0000 7f8a12621b80 1 -- start start 2023-07-14T13:23:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.453+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a2226b0 0x55609a3c6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.453+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 0x55609a3c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.453+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a3cc2d0 0x55609a3c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.454+0000 7f8a12621b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a3bdd00 con 0x55609a2226b0 2023-07-14T13:23:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.454+0000 7f8a12621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a3c1ac0 con 0x55609a3cc2d0 2023-07-14T13:23:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.454+0000 7f8a12621b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a3bd5f0 con 0x55609a3c6580 2023-07-14T13:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.454+0000 7f89fc99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a2226b0 0x55609a3c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.454+0000 7f89fc99b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a2226b0 0x55609a3c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51972/0 (socket says 172.21.15.17:51972) 2023-07-14T13:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.454+0000 7f89fc99b700 1 -- 172.21.15.17:0/3371732239 learned_addr learned my addr 172.21.15.17:0/3371732239 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.454+0000 7f89f7fff700 1 --2- 172.21.15.17:0/3371732239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 0x55609a3c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.455+0000 7f89fd19c700 1 --2- 172.21.15.17:0/3371732239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a3cc2d0 0x55609a3c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.455+0000 7f89f7fff700 1 -- 172.21.15.17:0/3371732239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a3cc2d0 msgr2=0x55609a3c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.455+0000 7f89f7fff700 1 --2- 172.21.15.17:0/3371732239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a3cc2d0 0x55609a3c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.455+0000 7f89f7fff700 1 -- 172.21.15.17:0/3371732239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a2226b0 msgr2=0x55609a3c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.455+0000 7f89f7fff700 1 --2- 172.21.15.17:0/3371732239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a2226b0 0x55609a3c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.455+0000 7f89f7fff700 1 -- 172.21.15.17:0/3371732239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55609a16c1f0 con 0x55609a3c6580 2023-07-14T13:23:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.455+0000 7f89fc99b700 1 --2- 172.21.15.17:0/3371732239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a2226b0 0x55609a3c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.457+0000 7f89f7fff700 1 --2- 172.21.15.17:0/3371732239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 0x55609a3c0c60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f89f806c290 tx=0x7f89e4009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65fa24affb165bb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.460+0000 7f89e37fe700 1 -- 172.21.15.17:0/3371732239 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e401e070 con 0x55609a3c6580 2023-07-14T13:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.460+0000 7f89e37fe700 1 -- 172.21.15.17:0/3371732239 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89e400bd20 con 0x55609a3c6580 2023-07-14T13:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.460+0000 7f89e37fe700 1 -- 172.21.15.17:0/3371732239 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4004d80 con 0x55609a3c6580 2023-07-14T13:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.461+0000 7f8a12621b80 1 -- 172.21.15.17:0/3371732239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 msgr2=0x55609a3c0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.461+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3371732239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 0x55609a3c0c60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f89f806c290 tx=0x7f89e4009310 comp rx=0 tx=0).stop 2023-07-14T13:23:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.461+0000 7f8a12621b80 1 -- 172.21.15.17:0/3371732239 shutdown_connections 2023-07-14T13:23:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.461+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3371732239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a3cc2d0 0x55609a3c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.461+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3371732239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a2226b0 0x55609a3c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.461+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3371732239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 0x55609a3c0c60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.461+0000 7f8a12621b80 1 -- 172.21.15.17:0/3371732239 >> 172.21.15.17:0/3371732239 conn(0x55609a3bbbe0 msgr2=0x55609a3db450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.462+0000 7f8a12621b80 1 -- 172.21.15.17:0/3371732239 shutdown_connections 2023-07-14T13:23:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.462+0000 7f8a12621b80 1 -- 172.21.15.17:0/3371732239 wait complete. 2023-07-14T13:23:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.462+0000 7f8a12621b80 1 -- start start 2023-07-14T13:23:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.463+0000 7f8a12621b80 1 Processor -- start 2023-07-14T13:23:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.463+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a2226b0 0x55609a3d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.463+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 0x55609a3d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.464+0000 7f8a12621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a3cc2d0 0x55609a3d5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.464+0000 7f8a12621b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a432b80 con 0x55609a2226b0 2023-07-14T13:23:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.464+0000 7f8a12621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a432cf0 con 0x55609a3cc2d0 2023-07-14T13:23:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.464+0000 7f8a12621b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609a432eb0 con 0x55609a3c6580 2023-07-14T13:23:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.464+0000 7f8a12621b80 10 client.0 _ll_register_callbacks cb 0x7f89f0007de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:23:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.464+0000 7f89f7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 0x55609a3d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.465+0000 7f89f7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 0x55609a3d51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44130/0 (socket says 172.21.15.17:44130) 2023-07-14T13:23:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.465+0000 7f89f7fff700 1 -- 172.21.15.17:0/3683558574 learned_addr learned my addr 172.21.15.17:0/3683558574 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:23.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.465+0000 7f89fd19c700 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a3cc2d0 0x55609a3d5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.465+0000 7f89f7fff700 1 -- 172.21.15.17:0/3683558574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a3cc2d0 msgr2=0x55609a3d5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.465+0000 7f89f7fff700 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a3cc2d0 0x55609a3d5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.465+0000 7f89f7fff700 1 -- 172.21.15.17:0/3683558574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a2226b0 msgr2=0x55609a3d4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.465+0000 7f89f7fff700 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a2226b0 0x55609a3d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.465+0000 7f89f7fff700 1 -- 172.21.15.17:0/3683558574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f806f8c0 con 0x55609a3c6580 2023-07-14T13:23:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.466+0000 7f89f7fff700 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 0x55609a3d51d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f89e4020040 tx=0x7f89e400bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=effb0db3d698da54 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.466+0000 7f89d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:23:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.466+0000 7f89d7fff700 1 -- 172.21.15.17:0/3683558574 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4003db0 con 0x55609a3c6580 2023-07-14T13:23:23.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.466+0000 7f89d7fff700 1 -- 172.21.15.17:0/3683558574 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f89e4003f10 con 0x55609a3c6580 2023-07-14T13:23:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.466+0000 7f8a12621b80 1 -- 172.21.15.17:0/3683558574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f89f0012a10 con 0x55609a3c6580 2023-07-14T13:23:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.467+0000 7f89d7fff700 1 -- 172.21.15.17:0/3683558574 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89e40040d0 con 0x55609a3c6580 2023-07-14T13:23:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.467+0000 7f8a12621b80 10 client.29056 fetch_fsmap learned FSMap version 55 2023-07-14T13:23:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.467+0000 7f8a12621b80 1 -- 172.21.15.17:0/3683558574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7f89f8113850 con 0x55609a3c6580 2023-07-14T13:23:23.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.467+0000 7f89d7fff700 1 -- 172.21.15.17:0/3683558574 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f89e4041030 con 0x55609a3c6580 2023-07-14T13:23:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.467+0000 7f89d7fff700 1 -- 172.21.15.17:0/3683558574 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f89e4004590 con 0x55609a3c6580 2023-07-14T13:23:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.468+0000 7f8a12621b80 10 client.29056 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:23:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.468+0000 7f8a12621b80 10 client.29056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:23:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.468+0000 7f8a12621b80 20 client.29056 populate_metadata read hostname 'smithi017' 2023-07-14T13:23:23.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.468+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55609a434210 0x55609a436620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.468+0000 7f8a12621b80 4 client.29056 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.468+0000 7f8a12621b80 1 -- 172.21.15.17:0/3683558574 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55609a2d2ff0 con 0x55609a434210 2023-07-14T13:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.468+0000 7f89fc99b700 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55609a434210 0x55609a436620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.469+0000 7f89d7fff700 10 client.29056 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:23.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.469+0000 7f89fc99b700 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55609a434210 0x55609a436620 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c2ca7f25edaf855 server_cookie=e904c1aa4a7dba4b in_seq=0 out_seq=0 2023-07-14T13:23:23.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.497+0000 7f89d7fff700 1 -- 172.21.15.17:0/3683558574 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55609a2d2ff0 con 0x55609a434210 2023-07-14T13:23:23.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.497+0000 7f89d7fff700 10 client.29056 handle_command_reply: tid=0 2023-07-14T13:23:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.497+0000 7f8a12621b80 1 client.29056 shutdown 2023-07-14T13:23:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.498+0000 7f8a12621b80 1 -- 172.21.15.17:0/3683558574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 msgr2=0x55609a3d51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:23.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.498+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 0x55609a3d51d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f89e4020040 tx=0x7f89e400bed0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.498+0000 7f8a12621b80 1 -- 172.21.15.17:0/3683558574 shutdown_connections 2023-07-14T13:23:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.498+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55609a434210 0x55609a436620 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.498+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55609a3cc2d0 0x55609a3d5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.498+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55609a2226b0 0x55609a3d4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.498+0000 7f8a12621b80 1 --2- 172.21.15.17:0/3683558574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55609a3c6580 0x55609a3d51d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.498+0000 7f8a12621b80 1 -- 172.21.15.17:0/3683558574 >> 172.21.15.17:0/3683558574 conn(0x55609a3bbbe0 msgr2=0x55609a3c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.498+0000 7f89d7fff700 0 client.29056 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.499+0000 7f8a12621b80 1 -- 172.21.15.17:0/3683558574 shutdown_connections 2023-07-14T13:23:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.499+0000 7f8a12621b80 1 -- 172.21.15.17:0/3683558574 wait complete. 2023-07-14T13:23:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.499+0000 7f8a12621b80 20 client.29056 trim_cache size 0 max 16384 2023-07-14T13:23:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:23:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:23:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:23:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:23:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.501+0000 7f89febff700 1 -- 172.21.15.17:0/3778705932 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89e80a13a0 msgr2=0x7f89e80a3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.501+0000 7f89febff700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89e80a13a0 0x7f89e80a3850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f89e400b5c0 tx=0x7f89e4003680 comp rx=0 tx=0).stop 2023-07-14T13:23:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.501+0000 7f89febff700 1 -- 172.21.15.17:0/3778705932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f8079e60 msgr2=0x7f89f8071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.501+0000 7f89febff700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f8079e60 0x7f89f8071a90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00d950 tx=0x7f89ec00dd10 comp rx=0 tx=0).stop 2023-07-14T13:23:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.501+0000 7f89febff700 1 -- 172.21.15.17:0/3778705932 shutdown_connections 2023-07-14T13:23:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.501+0000 7f89febff700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f89e80a13a0 0x7f89e80a3850 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.501+0000 7f89febff700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89f810b490 0x7f89f806a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.501+0000 7f89febff700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89f8079e60 0x7f89f8071a90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.501+0000 7f89febff700 1 --2- 172.21.15.17:0/3778705932 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89f807a800 0x7f89f8072010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.501+0000 7f89febff700 1 -- 172.21.15.17:0/3778705932 >> 172.21.15.17:0/3778705932 conn(0x7f89f80756f0 msgr2=0x7f89f8076190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:23.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.502+0000 7f89febff700 1 -- 172.21.15.17:0/3778705932 shutdown_connections 2023-07-14T13:23:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:23.502+0000 7f89febff700 1 -- 172.21.15.17:0/3778705932 wait complete. 2023-07-14T13:23:25.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:25 smithi135 ceph-mon[97338]: pgmap v749: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-14T13:23:25.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:25 smithi131 ceph-mon[96953]: pgmap v749: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-14T13:23:25.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:25 smithi017 ceph-mon[95536]: pgmap v749: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-14T13:23:27.444 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 315.0 s, 480.1 tps, lat 208.529 ms stddev 101.608 2023-07-14T13:23:27.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:27 smithi135 ceph-mon[97338]: pgmap v750: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:23:27.735 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:27 smithi131 ceph-mon[96953]: pgmap v750: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:23:27.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:27 smithi017 ceph-mon[95536]: pgmap v750: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:23:29.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:29 smithi135 ceph-mon[97338]: pgmap v751: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-07-14T13:23:29.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:29 smithi131 ceph-mon[96953]: pgmap v751: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-07-14T13:23:29.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:29 smithi017 ceph-mon[95536]: pgmap v751: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-07-14T13:23:31.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:31 smithi135 ceph-mon[97338]: pgmap v752: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-07-14T13:23:31.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:31 smithi131 ceph-mon[96953]: pgmap v752: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-07-14T13:23:31.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:31 smithi017 ceph-mon[95536]: pgmap v752: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-07-14T13:23:32.435 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 320.0 s, 664.1 tps, lat 151.995 ms stddev 38.907 2023-07-14T13:23:33.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:33 smithi135 ceph-mon[97338]: pgmap v753: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.56k op/s 2023-07-14T13:23:33.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:33 smithi131 ceph-mon[96953]: pgmap v753: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.56k op/s 2023-07-14T13:23:33.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:33 smithi017 ceph-mon[95536]: pgmap v753: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.56k op/s 2023-07-14T13:23:35.685 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:35 smithi135 ceph-mon[97338]: pgmap v754: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.33k op/s 2023-07-14T13:23:35.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:35 smithi131 ceph-mon[96953]: pgmap v754: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.33k op/s 2023-07-14T13:23:35.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:35 smithi017 ceph-mon[95536]: pgmap v754: 97 pgs: 97 active+clean; 14 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.33k op/s 2023-07-14T13:23:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.788+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/1192895219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a18106cf0 msgr2=0x7f0a18112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.788+0000 7f0a1f1ff700 1 --2- 172.21.15.17:0/1192895219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a18106cf0 0x7f0a18112f30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009f90 tx=0x7f0a1000b330 comp rx=0 tx=0).stop 2023-07-14T13:23:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.788+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/1192895219 shutdown_connections 2023-07-14T13:23:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.788+0000 7f0a1f1ff700 1 --2- 172.21.15.17:0/1192895219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a18106cf0 0x7f0a18112f30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.788+0000 7f0a1f1ff700 1 --2- 172.21.15.17:0/1192895219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a1810c240 0x7f0a1810c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.788+0000 7f0a1f1ff700 1 --2- 172.21.15.17:0/1192895219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a18106340 0x7f0a181067b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.788+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/1192895219 >> 172.21.15.17:0/1192895219 conn(0x7f0a18075a20 msgr2=0x7f0a18077e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.788+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/1192895219 shutdown_connections 2023-07-14T13:23:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.788+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/1192895219 wait complete. 2023-07-14T13:23:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.790+0000 7f0a1f1ff700 1 Processor -- start 2023-07-14T13:23:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.790+0000 7f0a1f1ff700 1 -- start start 2023-07-14T13:23:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.791+0000 7f0a1f1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a18106340 0x7f0a1819c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.791+0000 7f0a1f1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a18106cf0 0x7f0a1819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.791+0000 7f0a1f1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a1810c240 0x7f0a181a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.791+0000 7f0a1f1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a181a1480 con 0x7f0a1810c240 2023-07-14T13:23:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.791+0000 7f0a1f1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a181a15f0 con 0x7f0a18106cf0 2023-07-14T13:23:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.791+0000 7f0a1f1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a181a17b0 con 0x7f0a18106340 2023-07-14T13:23:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.791+0000 7f0a0ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a18106cf0 0x7f0a1819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.792+0000 7f0a1d79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a1810c240 0x7f0a181a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.792+0000 7f0a1d79c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a1810c240 0x7f0a181a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38098/0 (socket says 172.21.15.17:38098) 2023-07-14T13:23:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.792+0000 7f0a1d79c700 1 -- 172.21.15.17:0/3691385269 learned_addr learned my addr 172.21.15.17:0/3691385269 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.792+0000 7f0a1d79c700 1 -- 172.21.15.17:0/3691385269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a18106340 msgr2=0x7f0a1819c290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T13:23:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.792+0000 7f0a1d79c700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a18106340 0x7f0a1819c290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.792+0000 7f0a1d79c700 1 -- 172.21.15.17:0/3691385269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a18106cf0 msgr2=0x7f0a1819c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.792+0000 7f0a1d79c700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a18106cf0 0x7f0a1819c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.792+0000 7f0a1d79c700 1 -- 172.21.15.17:0/3691385269 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10009c40 con 0x7f0a1810c240 2023-07-14T13:23:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.793+0000 7f0a1d79c700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a1810c240 0x7f0a181a0e40 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f0a10007730 tx=0x7f0a10007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:36.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.794+0000 7f0a0dffb700 1 -- 172.21.15.17:0/3691385269 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000e040 con 0x7f0a1810c240 2023-07-14T13:23:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.794+0000 7f0a0dffb700 1 -- 172.21.15.17:0/3691385269 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a10007e90 con 0x7f0a1810c240 2023-07-14T13:23:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.794+0000 7f0a0dffb700 1 -- 172.21.15.17:0/3691385269 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100052a0 con 0x7f0a1810c240 2023-07-14T13:23:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.794+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/3691385269 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a181a1a30 con 0x7f0a1810c240 2023-07-14T13:23:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.795+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/3691385269 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a181a92d0 con 0x7f0a1810c240 2023-07-14T13:23:36.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.802+0000 7f0a32aa3b80 1 Processor -- start 2023-07-14T13:23:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.804+0000 7f0a0dffb700 1 -- 172.21.15.17:0/3691385269 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0a1001d480 con 0x7f0a1810c240 2023-07-14T13:23:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.804+0000 7f0a32aa3b80 1 -- start start 2023-07-14T13:23:36.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.804+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 0x55e7028c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.804+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7028c32d0 0x55e7028bd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.804+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028bd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.804+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7027c2c50 con 0x55e7027196b0 2023-07-14T13:23:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.804+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7028159e0 con 0x55e7028bd580 2023-07-14T13:23:36.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.804+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e70280ee70 con 0x55e7028c32d0 2023-07-14T13:23:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.805+0000 7f0a0ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028bd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.805+0000 7f0a0ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028bd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:46962/0 (socket says 172.21.15.17:46962) 2023-07-14T13:23:36.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.805+0000 7f0a0ffff700 1 -- 172.21.15.17:0/791709776 learned_addr learned my addr 172.21.15.17:0/791709776 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.805+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/791709776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7028c32d0 0x55e7028bd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.806+0000 7f0a0ffff700 1 --2- 172.21.15.17:0/791709776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 0x55e7028c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.806+0000 7f0a0ffff700 1 -- 172.21.15.17:0/791709776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7028c32d0 msgr2=0x55e7028bd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.806+0000 7f0a0ffff700 1 --2- 172.21.15.17:0/791709776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7028c32d0 0x55e7028bd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.806+0000 7f0a0ffff700 1 -- 172.21.15.17:0/791709776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 msgr2=0x55e7028c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.806+0000 7f0a0ffff700 1 --2- 172.21.15.17:0/791709776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 0x55e7028c2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.806+0000 7f0a0ffff700 1 -- 172.21.15.17:0/791709776 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e70263cd80 con 0x55e7028bd580 2023-07-14T13:23:36.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.806+0000 7f0a0ffff700 1 --2- 172.21.15.17:0/791709776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028bd9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0a080124f0 tx=0x7f0a0800b5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c0c588c8ce22e98 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:36.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.807+0000 7f09feffd700 1 -- 172.21.15.17:0/791709776 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08012cc0 con 0x55e7028bd580 2023-07-14T13:23:36.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.807+0000 7f0a0dffb700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a000a14d0 0x7f0a000a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.807+0000 7f09feffd700 1 -- 172.21.15.17:0/791709776 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a08012e20 con 0x55e7028bd580 2023-07-14T13:23:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.807+0000 7f09feffd700 1 -- 172.21.15.17:0/791709776 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08010640 con 0x55e7028bd580 2023-07-14T13:23:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.807+0000 7f0a0dffb700 1 -- 172.21.15.17:0/3691385269 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0a100ce550 con 0x7f0a1810c240 2023-07-14T13:23:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.808+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/791709776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 msgr2=0x55e7028bd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.808+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/791709776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028bd9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0a080124f0 tx=0x7f0a0800b5e0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.808+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/791709776 shutdown_connections 2023-07-14T13:23:36.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.808+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/791709776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028bd9d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.808+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/791709776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 0x55e7028c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.808+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/791709776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7028c32d0 0x55e7028bd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.808+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/791709776 >> 172.21.15.17:0/791709776 conn(0x55e7028b2be0 msgr2=0x55e7028b7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.809+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/791709776 shutdown_connections 2023-07-14T13:23:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.809+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/791709776 wait complete. 2023-07-14T13:23:36.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.810+0000 7f0a32aa3b80 1 -- start start 2023-07-14T13:23:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.810+0000 7f0a32aa3b80 1 Processor -- start 2023-07-14T13:23:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.810+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a000a14d0 0x7f0a000a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.811+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.811+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7028bd580 0x55e7028c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.811+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028c32d0 0x55e7028c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.811+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7027aea60 con 0x55e7028bd580 2023-07-14T13:23:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.811+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7027ae760 con 0x55e7028c32d0 2023-07-14T13:23:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.811+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7026928c0 con 0x55e7027196b0 2023-07-14T13:23:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.811+0000 7f0a32aa3b80 10 client.0 _ll_register_callbacks cb 0x55e7027ac700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:23:36.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.812+0000 7f0a1cf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.812+0000 7f0a1cf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028c68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:36846/0 (socket says 172.21.15.17:36846) 2023-07-14T13:23:36.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.812+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/270997063 learned_addr learned my addr 172.21.15.17:0/270997063 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:36.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.813+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/270997063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028c32d0 msgr2=0x55e7028c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:36.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.813+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/270997063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028c32d0 0x55e7028c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.813+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/270997063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7028bd580 msgr2=0x55e7028c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.813+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/270997063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7028bd580 0x55e7028c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.813+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/270997063 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0800bcd0 con 0x55e7027196b0 2023-07-14T13:23:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.813+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a000a14d0 0x7f0a000a3980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55e7028b9b40 tx=0x7f0a14009f40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.813+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/270997063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028c68e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0a14011e80 tx=0x7f0a140047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11885ebed9e773d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:36.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.813+0000 7f09f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.814+0000 7f09f7fff700 1 -- 172.21.15.17:0/270997063 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14004a30 con 0x55e7027196b0 2023-07-14T13:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.814+0000 7f09f7fff700 1 -- 172.21.15.17:0/270997063 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0a14022070 con 0x55e7027196b0 2023-07-14T13:23:36.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.815+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/270997063 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e702768490 con 0x55e7027196b0 2023-07-14T13:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.816+0000 7f09f7fff700 1 -- 172.21.15.17:0/270997063 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a14004b90 con 0x55e7027196b0 2023-07-14T13:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.816+0000 7f0a32aa3b80 10 client.29065 fetch_fsmap learned FSMap version 55 2023-07-14T13:23:36.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.816+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/270997063 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55e702625c00 con 0x55e7027196b0 2023-07-14T13:23:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.817+0000 7f09f7fff700 1 -- 172.21.15.17:0/270997063 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e702768490 con 0x55e7027196b0 2023-07-14T13:23:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.817+0000 7f09f7fff700 1 -- 172.21.15.17:0/270997063 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0a140305c0 con 0x55e7027196b0 2023-07-14T13:23:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.817+0000 7f0a32aa3b80 10 client.29065 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:23:36.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.817+0000 7f0a32aa3b80 10 client.29065 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:23:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.817+0000 7f0a32aa3b80 20 client.29065 populate_metadata read hostname 'smithi017' 2023-07-14T13:23:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.817+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/270997063 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e7028e7d70 0x55e7028ea180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.817+0000 7f0a32aa3b80 4 client.29065 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:23:36.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.817+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/270997063 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e702807e50 con 0x55e7028e7d70 2023-07-14T13:23:36.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.818+0000 7f0a0ffff700 1 --2- 172.21.15.17:0/270997063 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e7028e7d70 0x55e7028ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.823+0000 7f0a0ffff700 1 --2- 172.21.15.17:0/270997063 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e7028e7d70 0x55e7028ea180 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e06519769944b810 server_cookie=ebb0887776e05cf0 in_seq=0 out_seq=0 2023-07-14T13:23:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.823+0000 7f09f7fff700 10 client.29065 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.824+0000 7f09f7fff700 1 -- 172.21.15.17:0/270997063 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e702807e50 con 0x55e7028e7d70 2023-07-14T13:23:36.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.824+0000 7f09f7fff700 10 client.29065 handle_command_reply: tid=0 2023-07-14T13:23:36.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.824+0000 7f0a32aa3b80 1 client.29065 shutdown 2023-07-14T13:23:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.827+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/270997063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 msgr2=0x55e7028c68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:36.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.827+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/270997063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028c68e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0a14011e80 tx=0x7f0a140047c0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.827+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/270997063 shutdown_connections 2023-07-14T13:23:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.827+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/270997063 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e7028e7d70 0x55e7028ea180 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.827+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/270997063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028c32d0 0x55e7028c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.827+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/270997063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028c68e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.827+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/270997063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7028bd580 0x55e7028c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.827+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/270997063 >> 172.21.15.17:0/270997063 conn(0x55e7028b2be0 msgr2=0x55e7028bc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.829+0000 7f09f7fff700 0 client.29065 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.829+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/270997063 shutdown_connections 2023-07-14T13:23:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.829+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/270997063 wait complete. 2023-07-14T13:23:36.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.831+0000 7f0a32aa3b80 20 client.29065 trim_cache size 0 max 16384 2023-07-14T13:23:36.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.868+0000 7f0a32aa3b80 1 Processor -- start 2023-07-14T13:23:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.868+0000 7f0a32aa3b80 1 -- start start 2023-07-14T13:23:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.869+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 0x55e7028cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.869+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.869+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7028c32d0 0x55e7028b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.869+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7028c29f0 con 0x55e7027196b0 2023-07-14T13:23:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.869+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7028afbb0 con 0x55e7028bd580 2023-07-14T13:23:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.869+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7028b9970 con 0x55e7028c32d0 2023-07-14T13:23:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.871+0000 7f0a1cf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 0x55e7028cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.871+0000 7f0a1cf9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 0x55e7028cdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38132/0 (socket says 172.21.15.17:38132) 2023-07-14T13:23:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.871+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/3368093570 learned_addr learned my addr 172.21.15.17:0/3368093570 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.873+0000 7f0a1d79c700 1 --2- 172.21.15.17:0/3368093570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7028c32d0 0x55e7028b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.876+0000 7f0a0ffff700 1 --2- 172.21.15.17:0/3368093570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.876+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/3368093570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7028c32d0 msgr2=0x55e7028b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.876+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/3368093570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7028c32d0 0x55e7028b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.876+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/3368093570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 msgr2=0x55e7028c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.876+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/3368093570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.876+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/3368093570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7026631f0 con 0x55e7027196b0 2023-07-14T13:23:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.878+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/3368093570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 0x55e7028cdc70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f0a14030a70 tx=0x7f0a140099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18cddab882a2d19 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.878+0000 7f09ff7fe700 1 -- 172.21.15.17:0/3368093570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14030d90 con 0x55e7027196b0 2023-07-14T13:23:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.878+0000 7f09ff7fe700 1 -- 172.21.15.17:0/3368093570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a14015040 con 0x55e7027196b0 2023-07-14T13:23:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.878+0000 7f09ff7fe700 1 -- 172.21.15.17:0/3368093570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14003970 con 0x55e7027196b0 2023-07-14T13:23:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.879+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/3368093570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 msgr2=0x55e7028cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.879+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/3368093570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 0x55e7028cdc70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f0a14030a70 tx=0x7f0a140099f0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.880+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/3368093570 shutdown_connections 2023-07-14T13:23:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.880+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/3368093570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7028c32d0 0x55e7028b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.880+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/3368093570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7027196b0 0x55e7028cdc70 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.880+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/3368093570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.880+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/3368093570 >> 172.21.15.17:0/3368093570 conn(0x55e7028b2be0 msgr2=0x55e7028e9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.887+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/3368093570 shutdown_connections 2023-07-14T13:23:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.887+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/3368093570 wait complete. 2023-07-14T13:23:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.888+0000 7f0a32aa3b80 1 -- start start 2023-07-14T13:23:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.888+0000 7f0a32aa3b80 1 Processor -- start 2023-07-14T13:23:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.897+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.897+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.897+0000 7f0a32aa3b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7028c32d0 0x55e7028cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.897+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e70293ac70 con 0x55e7028c32d0 2023-07-14T13:23:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.897+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e70293adb0 con 0x55e7028bd580 2023-07-14T13:23:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.897+0000 7f0a32aa3b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e70293aef0 con 0x55e7027196b0 2023-07-14T13:23:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.897+0000 7f0a32aa3b80 10 client.0 _ll_register_callbacks cb 0x7f0a14011ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:23:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.898+0000 7f0a1cf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.898+0000 7f0a1cf9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:36854/0 (socket says 172.21.15.17:36854) 2023-07-14T13:23:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.898+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/210511653 learned_addr learned my addr 172.21.15.17:0/210511653 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.898+0000 7f0a0ffff700 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.899+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/210511653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 msgr2=0x55e7028cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.899+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.899+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/210511653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7028c32d0 msgr2=0x55e7028cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.899+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7028c32d0 0x55e7028cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.899+0000 7f0a1cf9b700 1 -- 172.21.15.17:0/210511653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e702625c00 con 0x55e7027196b0 2023-07-14T13:23:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.901+0000 7f0a1cf9b700 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028cbc50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0a14014040 tx=0x7f0a14030d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad6a3ac17d00654 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.902+0000 7f09f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:23:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.903+0000 7f09f7fff700 1 -- 172.21.15.17:0/210511653 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14005380 con 0x55e7027196b0 2023-07-14T13:23:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.903+0000 7f09f7fff700 1 -- 172.21.15.17:0/210511653 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0a14034070 con 0x55e7027196b0 2023-07-14T13:23:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.903+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/210511653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a08012e20 con 0x55e7027196b0 2023-07-14T13:23:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.905+0000 7f09f7fff700 1 -- 172.21.15.17:0/210511653 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a140054e0 con 0x55e7027196b0 2023-07-14T13:23:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.905+0000 7f0a32aa3b80 10 client.29071 fetch_fsmap learned FSMap version 55 2023-07-14T13:23:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.905+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/210511653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55e70263b250 con 0x55e7027196b0 2023-07-14T13:23:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.906+0000 7f09f7fff700 1 -- 172.21.15.17:0/210511653 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a08012e20 con 0x55e7027196b0 2023-07-14T13:23:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.906+0000 7f09f7fff700 1 -- 172.21.15.17:0/210511653 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0a14026610 con 0x55e7027196b0 2023-07-14T13:23:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.906+0000 7f0a32aa3b80 10 client.29071 fetch_fsmap finished waiting for FSMap version 55 2023-07-14T13:23:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.906+0000 7f0a32aa3b80 10 client.29071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:23:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.906+0000 7f0a32aa3b80 20 client.29071 populate_metadata read hostname 'smithi017' 2023-07-14T13:23:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.906+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e70293c130 0x55e70293e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.906+0000 7f0a32aa3b80 4 client.29071 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:23:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.906+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/210511653 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e7027c9ff0 con 0x55e70293c130 2023-07-14T13:23:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.906+0000 7f0a0ffff700 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e70293c130 0x55e70293e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.908+0000 7f0a0ffff700 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e70293c130 0x55e70293e510 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9a2bb33eefd73 server_cookie=c7c948f5c08814e2 in_seq=0 out_seq=0 2023-07-14T13:23:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.908+0000 7f09f7fff700 10 client.29071 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.940+0000 7f09f7fff700 1 -- 172.21.15.17:0/210511653 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e7027c9ff0 con 0x55e70293c130 2023-07-14T13:23:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.940+0000 7f09f7fff700 10 client.29071 handle_command_reply: tid=0 2023-07-14T13:23:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.940+0000 7f0a32aa3b80 1 client.29071 shutdown 2023-07-14T13:23:36.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.942+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/210511653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 msgr2=0x55e7028cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.942+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028cbc50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0a14014040 tx=0x7f0a14030d70 comp rx=0 tx=0).stop 2023-07-14T13:23:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.942+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/210511653 shutdown_connections 2023-07-14T13:23:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.942+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e70293c130 0x55e70293e510 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.942+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e7028c32d0 0x55e7028cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.942+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7027196b0 0x55e7028cbc50 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.942+0000 7f0a32aa3b80 1 --2- 172.21.15.17:0/210511653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e7028bd580 0x55e7028cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.942+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/210511653 >> 172.21.15.17:0/210511653 conn(0x55e7028b2be0 msgr2=0x55e7028b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.942+0000 7f09f7fff700 0 client.29071 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.942+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/210511653 shutdown_connections 2023-07-14T13:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.943+0000 7f0a32aa3b80 1 -- 172.21.15.17:0/210511653 wait complete. 2023-07-14T13:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.943+0000 7f0a32aa3b80 20 client.29071 trim_cache size 0 max 16384 2023-07-14T13:23:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:23:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:23:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:23:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:23:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.949+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/3691385269 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a000a14d0 msgr2=0x7f0a000a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.949+0000 7f0a1f1ff700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a000a14d0 0x7f0a000a3980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55e7028b9b40 tx=0x7f0a14009f40 comp rx=0 tx=0).stop 2023-07-14T13:23:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.949+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/3691385269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a1810c240 msgr2=0x7f0a181a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:36.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.949+0000 7f0a1f1ff700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a1810c240 0x7f0a181a0e40 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f0a10007730 tx=0x7f0a10007810 comp rx=0 tx=0).stop 2023-07-14T13:23:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.953+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/3691385269 shutdown_connections 2023-07-14T13:23:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.953+0000 7f0a1f1ff700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a000a14d0 0x7f0a000a3980 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.953+0000 7f0a1f1ff700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a1810c240 0x7f0a181a0e40 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.953+0000 7f0a1f1ff700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a18106340 0x7f0a1819c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.953+0000 7f0a1f1ff700 1 --2- 172.21.15.17:0/3691385269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a18106cf0 0x7f0a1819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.953+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/3691385269 >> 172.21.15.17:0/3691385269 conn(0x7f0a18075a20 msgr2=0x7f0a18077060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.954+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/3691385269 shutdown_connections 2023-07-14T13:23:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:36.954+0000 7f0a1f1ff700 1 -- 172.21.15.17:0/3691385269 wait complete. 2023-07-14T13:23:37.435 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 325.0 s, 618.0 tps, lat 162.121 ms stddev 43.768 2023-07-14T13:23:37.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:37 smithi131 ceph-mon[96953]: pgmap v755: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 22 MiB/s wr, 1.94k op/s 2023-07-14T13:23:37.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:37 smithi017 ceph-mon[95536]: pgmap v755: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 22 MiB/s wr, 1.94k op/s 2023-07-14T13:23:37.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:37 smithi135 ceph-mon[97338]: pgmap v755: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 22 MiB/s wr, 1.94k op/s 2023-07-14T13:23:39.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:39 smithi131 ceph-mon[96953]: pgmap v756: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-07-14T13:23:39.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:39 smithi017 ceph-mon[95536]: pgmap v756: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-07-14T13:23:39.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:39 smithi135 ceph-mon[97338]: pgmap v756: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-07-14T13:23:40.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:40 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:23:40.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:40 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:23:40.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:40 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:23:41.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:41 smithi131 ceph-mon[96953]: pgmap v757: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 19 MiB/s wr, 1.67k op/s 2023-07-14T13:23:41.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:41 smithi017 ceph-mon[95536]: pgmap v757: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 19 MiB/s wr, 1.67k op/s 2023-07-14T13:23:41.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:41 smithi135 ceph-mon[97338]: pgmap v757: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 19 MiB/s wr, 1.67k op/s 2023-07-14T13:23:42.435 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 330.0 s, 589.6 tps, lat 168.384 ms stddev 41.611 2023-07-14T13:23:43.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:43 smithi131 ceph-mon[96953]: pgmap v758: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:23:43.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:43 smithi017 ceph-mon[95536]: pgmap v758: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:23:43.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:43 smithi135 ceph-mon[97338]: pgmap v758: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:23:44.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:44 smithi131 ceph-mon[96953]: pgmap v759: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:23:44.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:44 smithi017 ceph-mon[95536]: pgmap v759: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:23:44.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:44 smithi135 ceph-mon[97338]: pgmap v759: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:23:47.434 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 335.0 s, 565.6 tps, lat 178.635 ms stddev 67.334 2023-07-14T13:23:47.683 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:47 smithi135 ceph-mon[97338]: pgmap v760: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 21 MiB/s wr, 1.89k op/s 2023-07-14T13:23:47.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:47 smithi131 ceph-mon[96953]: pgmap v760: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 21 MiB/s wr, 1.89k op/s 2023-07-14T13:23:47.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:47 smithi017 ceph-mon[95536]: pgmap v760: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 21 MiB/s wr, 1.89k op/s 2023-07-14T13:23:49.684 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:49 smithi135 ceph-mon[97338]: pgmap v761: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.27k op/s 2023-07-14T13:23:49.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:49 smithi131 ceph-mon[96953]: pgmap v761: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.27k op/s 2023-07-14T13:23:49.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:49 smithi017 ceph-mon[95536]: pgmap v761: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.27k op/s 2023-07-14T13:23:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.236+0000 7f9d58fff700 1 -- 172.21.15.17:0/4155744730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406c910 msgr2=0x7f9d5406cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:50.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.236+0000 7f9d58fff700 1 --2- 172.21.15.17:0/4155744730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406c910 0x7f9d5406cd80 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f9d480098f0 tx=0x7f9d48009c00 comp rx=0 tx=0).stop 2023-07-14T13:23:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.237+0000 7f9d58fff700 1 -- 172.21.15.17:0/4155744730 shutdown_connections 2023-07-14T13:23:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.237+0000 7f9d58fff700 1 --2- 172.21.15.17:0/4155744730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d5406d3a0 0x7f9d5411b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.237+0000 7f9d58fff700 1 --2- 172.21.15.17:0/4155744730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5410e2a0 0x7f9d5410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.237+0000 7f9d58fff700 1 --2- 172.21.15.17:0/4155744730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406c910 0x7f9d5406cd80 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.237+0000 7f9d58fff700 1 -- 172.21.15.17:0/4155744730 >> 172.21.15.17:0/4155744730 conn(0x7f9d5406bd70 msgr2=0x7f9d54070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.237+0000 7f9d58fff700 1 -- 172.21.15.17:0/4155744730 shutdown_connections 2023-07-14T13:23:50.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.237+0000 7f9d58fff700 1 -- 172.21.15.17:0/4155744730 wait complete. 2023-07-14T13:23:50.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.239+0000 7f9d58fff700 1 Processor -- start 2023-07-14T13:23:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.239+0000 7f9d58fff700 1 -- start start 2023-07-14T13:23:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.240+0000 7f9d58fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5406c910 0x7f9d541aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.240+0000 7f9d58fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406d3a0 0x7f9d541aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.240+0000 7f9d58fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d5410e2a0 0x7f9d541a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.240+0000 7f9d58fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d541a4f70 con 0x7f9d5406d3a0 2023-07-14T13:23:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.240+0000 7f9d58fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d541a50e0 con 0x7f9d5410e2a0 2023-07-14T13:23:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.240+0000 7f9d58fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d541a52a0 con 0x7f9d5406c910 2023-07-14T13:23:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.241+0000 7f9d5259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5406c910 0x7f9d541aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.241+0000 7f9d5259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5406c910 0x7f9d541aaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:53908/0 (socket says 172.21.15.17:53908) 2023-07-14T13:23:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.241+0000 7f9d5259c700 1 -- 172.21.15.17:0/1250428651 learned_addr learned my addr 172.21.15.17:0/1250428651 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.241+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406d3a0 0x7f9d541aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.241+0000 7f9d52d9d700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d5410e2a0 0x7f9d541a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.241+0000 7f9d5259c700 1 -- 172.21.15.17:0/1250428651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d5410e2a0 msgr2=0x7f9d541a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.241+0000 7f9d5259c700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d5410e2a0 0x7f9d541a4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.241+0000 7f9d5259c700 1 -- 172.21.15.17:0/1250428651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406d3a0 msgr2=0x7f9d541aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:50.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.241+0000 7f9d5259c700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406d3a0 0x7f9d541aafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.241+0000 7f9d5259c700 1 -- 172.21.15.17:0/1250428651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48009520 con 0x7f9d5406c910 2023-07-14T13:23:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.242+0000 7f9d5259c700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5406c910 0x7f9d541aaaa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400b840 tx=0x7f9d4400bb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.242+0000 7f9d437fe700 1 -- 172.21.15.17:0/1250428651 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400f840 con 0x7f9d5406c910 2023-07-14T13:23:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.242+0000 7f9d437fe700 1 -- 172.21.15.17:0/1250428651 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d4400fe30 con 0x7f9d5406c910 2023-07-14T13:23:50.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.242+0000 7f9d437fe700 1 -- 172.21.15.17:0/1250428651 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400d3d0 con 0x7f9d5406c910 2023-07-14T13:23:50.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.243+0000 7f9d58fff700 1 -- 172.21.15.17:0/1250428651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d541a5580 con 0x7f9d5406c910 2023-07-14T13:23:50.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.243+0000 7f9d58fff700 1 -- 172.21.15.17:0/1250428651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d541b1a90 con 0x7f9d5406c910 2023-07-14T13:23:50.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.251+0000 7f9d6c9a9b80 1 Processor -- start 2023-07-14T13:23:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.251+0000 7f9d6c9a9b80 1 -- start start 2023-07-14T13:23:50.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.252+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 0x55738e305d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.252+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e3062d0 0x55738e300040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.252+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e300580 0x55738e3009d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.252+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e205c50 con 0x55738e300580 2023-07-14T13:23:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.252+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e2589e0 con 0x55738e15c6b0 2023-07-14T13:23:50.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.252+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e251e70 con 0x55738e3062d0 2023-07-14T13:23:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.253+0000 7f9d52d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 0x55738e305d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.253+0000 7f9d52d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 0x55738e305d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53666/0 (socket says 172.21.15.17:53666) 2023-07-14T13:23:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.253+0000 7f9d52d9d700 1 -- 172.21.15.17:0/345431636 learned_addr learned my addr 172.21.15.17:0/345431636 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.253+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/345431636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e300580 0x55738e3009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.254+0000 7f9d51d9b700 1 -- 172.21.15.17:0/345431636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e3062d0 msgr2=0x55738e300040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:23:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.254+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/345431636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e3062d0 0x55738e300040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.254+0000 7f9d51d9b700 1 -- 172.21.15.17:0/345431636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 msgr2=0x55738e305d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.254+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/345431636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 0x55738e305d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.254+0000 7f9d51d9b700 1 -- 172.21.15.17:0/345431636 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55738e07fd80 con 0x55738e300580 2023-07-14T13:23:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.255+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/345431636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e300580 0x55738e3009d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009810 tx=0x7f9d4800bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30cea4b05a02a1e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.255+0000 7f9d437fe700 1 -- 172.21.15.17:0/1250428651 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f9d4400f9a0 con 0x7f9d5406c910 2023-07-14T13:23:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.255+0000 7f9d40ff9700 1 -- 172.21.15.17:0/345431636 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4801c040 con 0x55738e300580 2023-07-14T13:23:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.255+0000 7f9d40ff9700 1 -- 172.21.15.17:0/345431636 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d4800fe00 con 0x55738e300580 2023-07-14T13:23:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.256+0000 7f9d40ff9700 1 -- 172.21.15.17:0/345431636 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d480052a0 con 0x55738e300580 2023-07-14T13:23:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.257+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/345431636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e300580 msgr2=0x55738e3009d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.257+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/345431636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e300580 0x55738e3009d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009810 tx=0x7f9d4800bec0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.258+0000 7f9d437fe700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d3c0a1380 0x7f9d3c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.258+0000 7f9d437fe700 1 -- 172.21.15.17:0/1250428651 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9d440ccf50 con 0x7f9d5406c910 2023-07-14T13:23:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.259+0000 7f9d52d9d700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d3c0a1380 0x7f9d3c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.259+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/345431636 shutdown_connections 2023-07-14T13:23:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.259+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/345431636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e300580 0x55738e3009d0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.259+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/345431636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 0x55738e305d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.259+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/345431636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e3062d0 0x55738e300040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.259+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/345431636 >> 172.21.15.17:0/345431636 conn(0x55738e2f5be0 msgr2=0x55738e2faf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.260+0000 7f9d52d9d700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d3c0a1380 0x7f9d3c0a3830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009ed0 tx=0x7f9d4c009310 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:50.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.261+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/345431636 shutdown_connections 2023-07-14T13:23:50.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.262+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/345431636 wait complete. 2023-07-14T13:23:50.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.262+0000 7f9d6c9a9b80 1 -- start start 2023-07-14T13:23:50.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.263+0000 7f9d6c9a9b80 1 Processor -- start 2023-07-14T13:23:50.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.264+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e15c6b0 0x55738e3098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.264+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e300580 0x55738e309e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.264+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e3062d0 0x55738e30a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.264+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e1f1a60 con 0x55738e3062d0 2023-07-14T13:23:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.264+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e1f1760 con 0x55738e300580 2023-07-14T13:23:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.264+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e0d58c0 con 0x55738e15c6b0 2023-07-14T13:23:50.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.264+0000 7f9d6c9a9b80 10 client.0 _ll_register_callbacks cb 0x55738e1ef700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:23:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.265+0000 7f9d51d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e300580 0x55738e309e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.265+0000 7f9d51d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e300580 0x55738e309e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53676/0 (socket says 172.21.15.17:53676) 2023-07-14T13:23:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.265+0000 7f9d51d9b700 1 -- 172.21.15.17:0/2324662885 learned_addr learned my addr 172.21.15.17:0/2324662885 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:50.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.266+0000 7f9d51d9b700 1 -- 172.21.15.17:0/2324662885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e15c6b0 msgr2=0x55738e3098f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:23:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.266+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/2324662885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e15c6b0 0x55738e3098f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.266+0000 7f9d51d9b700 1 -- 172.21.15.17:0/2324662885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e3062d0 msgr2=0x55738e30a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.266+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/2324662885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e3062d0 0x55738e30a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.266+0000 7f9d51d9b700 1 -- 172.21.15.17:0/2324662885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5411bfb0 con 0x55738e300580 2023-07-14T13:23:50.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.267+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/2324662885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e300580 0x55738e309e30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009fd0 tx=0x7f9d4800b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a88a2cdb6cee6d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:50.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.269+0000 7f9d39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:23:50.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.269+0000 7f9d39ffb700 1 -- 172.21.15.17:0/2324662885 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4801c050 con 0x55738e300580 2023-07-14T13:23:50.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.269+0000 7f9d39ffb700 1 -- 172.21.15.17:0/2324662885 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9d4802d460 con 0x55738e300580 2023-07-14T13:23:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.269+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/2324662885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55738e1ab490 con 0x55738e300580 2023-07-14T13:23:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.269+0000 7f9d39ffb700 1 -- 172.21.15.17:0/2324662885 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d4800f870 con 0x55738e300580 2023-07-14T13:23:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.269+0000 7f9d6c9a9b80 10 client.29105 fetch_fsmap learned FSMap version 56 2023-07-14T13:23:50.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.269+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/2324662885 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55738e068c00 con 0x55738e300580 2023-07-14T13:23:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.270+0000 7f9d39ffb700 1 -- 172.21.15.17:0/2324662885 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d4803a020 con 0x55738e300580 2023-07-14T13:23:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.270+0000 7f9d39ffb700 1 -- 172.21.15.17:0/2324662885 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 56) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f9d48029070 con 0x55738e300580 2023-07-14T13:23:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.270+0000 7f9d6c9a9b80 10 client.29105 fetch_fsmap finished waiting for FSMap version 56 2023-07-14T13:23:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.270+0000 7f9d6c9a9b80 10 client.29105 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:23:50.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.270+0000 7f9d6c9a9b80 20 client.29105 populate_metadata read hostname 'smithi017' 2023-07-14T13:23:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.270+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/2324662885 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55738e3196c0 0x55738e31bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.270+0000 7f9d6c9a9b80 4 client.29105 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:23:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.270+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/2324662885 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55738e24ae50 con 0x55738e3196c0 2023-07-14T13:23:50.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.272+0000 7f9d5259c700 1 --2- 172.21.15.17:0/2324662885 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55738e3196c0 0x55738e31bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.274+0000 7f9d5259c700 1 --2- 172.21.15.17:0/2324662885 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55738e3196c0 0x55738e31bad0 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c31e6f9b79ec2e15 server_cookie=c8ae509cb5a6c113 in_seq=0 out_seq=0 2023-07-14T13:23:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.274+0000 7f9d39ffb700 10 client.29105 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.275+0000 7f9d39ffb700 1 -- 172.21.15.17:0/2324662885 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55738e24ae50 con 0x55738e3196c0 2023-07-14T13:23:50.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.275+0000 7f9d39ffb700 10 client.29105 handle_command_reply: tid=0 2023-07-14T13:23:50.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.277+0000 7f9d6c9a9b80 1 client.29105 shutdown 2023-07-14T13:23:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.279+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/2324662885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e300580 msgr2=0x55738e309e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.279+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/2324662885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e300580 0x55738e309e30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009fd0 tx=0x7f9d4800b840 comp rx=0 tx=0).stop 2023-07-14T13:23:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.279+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/2324662885 shutdown_connections 2023-07-14T13:23:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.279+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/2324662885 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55738e3196c0 0x55738e31bad0 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.279+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/2324662885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e3062d0 0x55738e30a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.279+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/2324662885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e15c6b0 0x55738e3098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.279+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/2324662885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e300580 0x55738e309e30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.279+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/2324662885 >> 172.21.15.17:0/2324662885 conn(0x55738e2f5be0 msgr2=0x55738e2f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.280+0000 7f9d39ffb700 0 client.29105 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.280+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/2324662885 shutdown_connections 2023-07-14T13:23:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.281+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/2324662885 wait complete. 2023-07-14T13:23:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.282+0000 7f9d6c9a9b80 20 client.29105 trim_cache size 0 max 16384 2023-07-14T13:23:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.331+0000 7f9d6c9a9b80 1 Processor -- start 2023-07-14T13:23:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.337+0000 7f9d6c9a9b80 1 -- start start 2023-07-14T13:23:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.337+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e2f5be0 0x55738e300040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.337+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e15c6b0 0x55738e3109c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.337+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e300580 0x55738e3051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.337+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e2fcb70 con 0x55738e2f5be0 2023-07-14T13:23:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.337+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e2f2bf0 con 0x55738e300580 2023-07-14T13:23:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.337+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e3059c0 con 0x55738e15c6b0 2023-07-14T13:23:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.338+0000 7f9d5259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e2f5be0 0x55738e300040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.338+0000 7f9d5259c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e2f5be0 0x55738e300040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43358/0 (socket says 172.21.15.17:43358) 2023-07-14T13:23:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.338+0000 7f9d5259c700 1 -- 172.21.15.17:0/3644949583 learned_addr learned my addr 172.21.15.17:0/3644949583 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.339+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/3644949583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e15c6b0 0x55738e3109c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.341+0000 7f9d51d9b700 1 -- 172.21.15.17:0/3644949583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e300580 msgr2=0x55738e3051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:23:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.341+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/3644949583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e300580 0x55738e3051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.341+0000 7f9d51d9b700 1 -- 172.21.15.17:0/3644949583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e2f5be0 msgr2=0x55738e300040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.341+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/3644949583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e2f5be0 0x55738e300040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.341+0000 7f9d51d9b700 1 -- 172.21.15.17:0/3644949583 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55738e320700 con 0x55738e15c6b0 2023-07-14T13:23:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.342+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/3644949583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e15c6b0 0x55738e3109c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55738e30aea0 tx=0x7f9d48005810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=858a3507d3187f30 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.342+0000 7f9d417fa700 1 -- 172.21.15.17:0/3644949583 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4801c070 con 0x55738e15c6b0 2023-07-14T13:23:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.342+0000 7f9d417fa700 1 -- 172.21.15.17:0/3644949583 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d4803a030 con 0x55738e15c6b0 2023-07-14T13:23:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.342+0000 7f9d417fa700 1 -- 172.21.15.17:0/3644949583 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4800f670 con 0x55738e15c6b0 2023-07-14T13:23:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.344+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/3644949583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e15c6b0 msgr2=0x55738e3109c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.344+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/3644949583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e15c6b0 0x55738e3109c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55738e30aea0 tx=0x7f9d48005810 comp rx=0 tx=0).stop 2023-07-14T13:23:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.345+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/3644949583 shutdown_connections 2023-07-14T13:23:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.345+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/3644949583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e300580 0x55738e3051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.345+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/3644949583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e2f5be0 0x55738e300040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.345+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/3644949583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e15c6b0 0x55738e3109c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.345+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/3644949583 >> 172.21.15.17:0/3644949583 conn(0x55738e3161d0 msgr2=0x55738e304ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.345+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/3644949583 shutdown_connections 2023-07-14T13:23:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.345+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/3644949583 wait complete. 2023-07-14T13:23:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.346+0000 7f9d6c9a9b80 1 -- start start 2023-07-14T13:23:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.346+0000 7f9d6c9a9b80 1 Processor -- start 2023-07-14T13:23:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.347+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 0x55738e30e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.347+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e2f5be0 0x55738e30eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.347+0000 7f9d6c9a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e300580 0x55738e30f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.347+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e36c660 con 0x55738e2f5be0 2023-07-14T13:23:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.347+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e36c7d0 con 0x55738e15c6b0 2023-07-14T13:23:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.347+0000 7f9d6c9a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55738e36c990 con 0x55738e300580 2023-07-14T13:23:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.347+0000 7f9d6c9a9b80 10 client.0 _ll_register_callbacks cb 0x7f9d4c009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:23:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.348+0000 7f9d5259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 0x55738e30e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.348+0000 7f9d5259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 0x55738e30e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53700/0 (socket says 172.21.15.17:53700) 2023-07-14T13:23:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.348+0000 7f9d5259c700 1 -- 172.21.15.17:0/1579921902 learned_addr learned my addr 172.21.15.17:0/1579921902 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:23:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.348+0000 7f9d52d9d700 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e300580 0x55738e30f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.348+0000 7f9d5259c700 1 -- 172.21.15.17:0/1579921902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e300580 msgr2=0x55738e30f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.348+0000 7f9d5259c700 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e300580 0x55738e30f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.349+0000 7f9d5259c700 1 -- 172.21.15.17:0/1579921902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e2f5be0 msgr2=0x55738e30eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:23:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.348+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e2f5be0 0x55738e30eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.349+0000 7f9d5259c700 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e2f5be0 0x55738e30eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.349+0000 7f9d5259c700 1 -- 172.21.15.17:0/1579921902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55738e068c00 con 0x55738e15c6b0 2023-07-14T13:23:50.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.349+0000 7f9d52d9d700 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e300580 0x55738e30f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:23:50.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.349+0000 7f9d5259c700 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 0x55738e30e9b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9d44099f70 tx=0x7f9d4400fc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cefe99961e3d4ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:23:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.349+0000 7f9d39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:23:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.350+0000 7f9d39ffb700 1 -- 172.21.15.17:0/1579921902 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d440a2430 con 0x55738e15c6b0 2023-07-14T13:23:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.350+0000 7f9d39ffb700 1 -- 172.21.15.17:0/1579921902 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9d44017400 con 0x55738e15c6b0 2023-07-14T13:23:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.350+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/1579921902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55738e3165a0 con 0x55738e15c6b0 2023-07-14T13:23:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.350+0000 7f9d39ffb700 1 -- 172.21.15.17:0/1579921902 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d4400c240 con 0x55738e15c6b0 2023-07-14T13:23:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.350+0000 7f9d6c9a9b80 10 client.29108 fetch_fsmap learned FSMap version 56 2023-07-14T13:23:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.350+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/1579921902 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55738e0a61f0 con 0x55738e15c6b0 2023-07-14T13:23:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.351+0000 7f9d39ffb700 1 -- 172.21.15.17:0/1579921902 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55738e3165a0 con 0x55738e15c6b0 2023-07-14T13:23:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.351+0000 7f9d39ffb700 1 -- 172.21.15.17:0/1579921902 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 56) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f9d4409a240 con 0x55738e15c6b0 2023-07-14T13:23:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.351+0000 7f9d6c9a9b80 10 client.29108 fetch_fsmap finished waiting for FSMap version 56 2023-07-14T13:23:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.351+0000 7f9d6c9a9b80 10 client.29108 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:23:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.351+0000 7f9d6c9a9b80 20 client.29108 populate_metadata read hostname 'smithi017' 2023-07-14T13:23:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.351+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55738e3062d0 0x55738e3700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:23:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.351+0000 7f9d6c9a9b80 4 client.29108 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:23:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.351+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/1579921902 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f9d4800fe00 con 0x55738e3062d0 2023-07-14T13:23:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.352+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55738e3062d0 0x55738e3700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:23:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.353+0000 7f9d51d9b700 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55738e3062d0 0x55738e3700d0 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd8ea2024824ebda server_cookie=5040f95072606de in_seq=0 out_seq=0 2023-07-14T13:23:50.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.353+0000 7f9d39ffb700 10 client.29108 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.390+0000 7f9d39ffb700 1 -- 172.21.15.17:0/1579921902 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f9d4800fe00 con 0x55738e3062d0 2023-07-14T13:23:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.390+0000 7f9d39ffb700 10 client.29108 handle_command_reply: tid=0 2023-07-14T13:23:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.396+0000 7f9d6c9a9b80 1 client.29108 shutdown 2023-07-14T13:23:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.397+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/1579921902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 msgr2=0x55738e30e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.397+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 0x55738e30e9b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9d44099f70 tx=0x7f9d4400fc50 comp rx=0 tx=0).stop 2023-07-14T13:23:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.397+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/1579921902 shutdown_connections 2023-07-14T13:23:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.397+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55738e3062d0 0x55738e3700d0 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.397+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55738e300580 0x55738e30f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.397+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55738e15c6b0 0x55738e30e9b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.397+0000 7f9d6c9a9b80 1 --2- 172.21.15.17:0/1579921902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55738e2f5be0 0x55738e30eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.397+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/1579921902 >> 172.21.15.17:0/1579921902 conn(0x55738e3161d0 msgr2=0x55738e307320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.398+0000 7f9d39ffb700 0 client.29108 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:23:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.398+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/1579921902 shutdown_connections 2023-07-14T13:23:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.398+0000 7f9d6c9a9b80 1 -- 172.21.15.17:0/1579921902 wait complete. 2023-07-14T13:23:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.398+0000 7f9d6c9a9b80 20 client.29108 trim_cache size 0 max 16384 2023-07-14T13:23:50.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:23:50.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:23:50.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:23:50.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:23:50.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.400+0000 7f9d58fff700 1 -- 172.21.15.17:0/1250428651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d3c0a1380 msgr2=0x7f9d3c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:50.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.400+0000 7f9d58fff700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d3c0a1380 0x7f9d3c0a3830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009ed0 tx=0x7f9d4c009310 comp rx=0 tx=0).stop 2023-07-14T13:23:50.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.400+0000 7f9d58fff700 1 -- 172.21.15.17:0/1250428651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5406c910 msgr2=0x7f9d541aaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:23:50.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.400+0000 7f9d58fff700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5406c910 0x7f9d541aaaa0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400b840 tx=0x7f9d4400bb50 comp rx=0 tx=0).stop 2023-07-14T13:23:50.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.401+0000 7f9d58fff700 1 -- 172.21.15.17:0/1250428651 shutdown_connections 2023-07-14T13:23:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.401+0000 7f9d58fff700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f9d3c0a1380 0x7f9d3c0a3830 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.401+0000 7f9d58fff700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d5410e2a0 0x7f9d541a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.401+0000 7f9d58fff700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5406c910 0x7f9d541aaaa0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.401+0000 7f9d58fff700 1 --2- 172.21.15.17:0/1250428651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d5406d3a0 0x7f9d541aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:23:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.401+0000 7f9d58fff700 1 -- 172.21.15.17:0/1250428651 >> 172.21.15.17:0/1250428651 conn(0x7f9d5406bd70 msgr2=0x7f9d5406f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:23:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.401+0000 7f9d58fff700 1 -- 172.21.15.17:0/1250428651 shutdown_connections 2023-07-14T13:23:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:23:50.401+0000 7f9d58fff700 1 -- 172.21.15.17:0/1250428651 wait complete. 2023-07-14T13:23:50.687 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:50 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:23:50.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:50 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:23:50.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:50 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:23:51.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:51 smithi131 ceph-mon[96953]: pgmap v762: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 18 MiB/s wr, 1.65k op/s 2023-07-14T13:23:51.851 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:51 smithi017 ceph-mon[95536]: pgmap v762: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 18 MiB/s wr, 1.65k op/s 2023-07-14T13:23:51.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:51 smithi135 ceph-mon[97338]: pgmap v762: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 18 MiB/s wr, 1.65k op/s 2023-07-14T13:23:52.434 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 340.0 s, 582.2 tps, lat 170.431 ms stddev 52.765 2023-07-14T13:23:53.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:53 smithi131 ceph-mon[96953]: pgmap v763: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 17 MiB/s wr, 1.50k op/s 2023-07-14T13:23:53.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:53 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:23:53.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:53 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:23:53.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:53 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:23:53.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:53 smithi017 ceph-mon[95536]: pgmap v763: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 17 MiB/s wr, 1.50k op/s 2023-07-14T13:23:53.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:53 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:23:53.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:53 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:23:53.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:53 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:23:53.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:53 smithi135 ceph-mon[97338]: pgmap v763: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 17 MiB/s wr, 1.50k op/s 2023-07-14T13:23:53.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:53 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:23:53.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:53 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:23:53.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:53 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:23:55.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:55 smithi131 ceph-mon[96953]: pgmap v764: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-14T13:23:55.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:55 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:23:55.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:55 smithi017 ceph-mon[95536]: pgmap v764: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-14T13:23:55.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:55 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:23:55.932 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:55 smithi135 ceph-mon[97338]: pgmap v764: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-14T13:23:55.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:55 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:23:57.439 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 345.0 s, 520.4 tps, lat 190.637 ms stddev 497.190 2023-07-14T13:23:57.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:57 smithi131 ceph-mon[96953]: pgmap v765: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 21 MiB/s wr, 1.88k op/s 2023-07-14T13:23:57.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:57 smithi017 ceph-mon[95536]: pgmap v765: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 21 MiB/s wr, 1.88k op/s 2023-07-14T13:23:57.932 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:57 smithi135 ceph-mon[97338]: pgmap v765: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 21 MiB/s wr, 1.88k op/s 2023-07-14T13:23:59.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:23:59 smithi131 ceph-mon[96953]: pgmap v766: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-14T13:23:59.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:23:59 smithi017 ceph-mon[95536]: pgmap v766: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-14T13:23:59.932 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:23:59 smithi135 ceph-mon[97338]: pgmap v766: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-14T13:24:00.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:00 smithi017 ceph-mon[95536]: pgmap v767: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 17 MiB/s wr, 1.60k op/s 2023-07-14T13:24:00.932 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:00 smithi135 ceph-mon[97338]: pgmap v767: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 17 MiB/s wr, 1.60k op/s 2023-07-14T13:24:00.981 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:00 smithi131 ceph-mon[96953]: pgmap v767: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 17 MiB/s wr, 1.60k op/s 2023-07-14T13:24:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 350.0 s, 544.4 tps, lat 183.240 ms stddev 99.083 2023-07-14T13:24:03.682 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:03 smithi135 ceph-mon[97338]: pgmap v768: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 17 MiB/s wr, 1.46k op/s 2023-07-14T13:24:03.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:03 smithi131 ceph-mon[96953]: pgmap v768: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 17 MiB/s wr, 1.46k op/s 2023-07-14T13:24:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.715+0000 7f83c5bff700 1 -- 172.21.15.17:0/2980917205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c006c910 msgr2=0x7f83c006cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.715+0000 7f83c5bff700 1 --2- 172.21.15.17:0/2980917205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c006c910 0x7f83c006cd80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f83b40098f0 tx=0x7f83b4009c00 comp rx=0 tx=0).stop 2023-07-14T13:24:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.715+0000 7f83c5bff700 1 -- 172.21.15.17:0/2980917205 shutdown_connections 2023-07-14T13:24:03.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.715+0000 7f83c5bff700 1 --2- 172.21.15.17:0/2980917205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c006d3a0 0x7f83c011b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.715+0000 7f83c5bff700 1 --2- 172.21.15.17:0/2980917205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c010e2a0 0x7f83c010e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.715+0000 7f83c5bff700 1 --2- 172.21.15.17:0/2980917205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c006c910 0x7f83c006cd80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.715+0000 7f83c5bff700 1 -- 172.21.15.17:0/2980917205 >> 172.21.15.17:0/2980917205 conn(0x7f83c006bd70 msgr2=0x7f83c0070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.717+0000 7f83c5bff700 1 -- 172.21.15.17:0/2980917205 shutdown_connections 2023-07-14T13:24:03.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.717+0000 7f83c5bff700 1 -- 172.21.15.17:0/2980917205 wait complete. 2023-07-14T13:24:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.718+0000 7f83c5bff700 1 Processor -- start 2023-07-14T13:24:03.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.719+0000 7f83c5bff700 1 -- start start 2023-07-14T13:24:03.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.719+0000 7f83c5bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c006c910 0x7f83c0116ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.719+0000 7f83c5bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c006d3a0 0x7f83c0117400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.719+0000 7f83c5bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c010e2a0 0x7f83c0072740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.719+0000 7f83c5bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0072e50 con 0x7f83c010e2a0 2023-07-14T13:24:03.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.719+0000 7f83c5bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0072fc0 con 0x7f83c006c910 2023-07-14T13:24:03.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.719+0000 7f83c5bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0073180 con 0x7f83c006d3a0 2023-07-14T13:24:03.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.720+0000 7f83bf7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c006c910 0x7f83c0116ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.720+0000 7f83bf7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c006c910 0x7f83c0116ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:46794/0 (socket says 172.21.15.17:46794) 2023-07-14T13:24:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.720+0000 7f83bf7fe700 1 -- 172.21.15.17:0/3933128458 learned_addr learned my addr 172.21.15.17:0/3933128458 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:03.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.720+0000 7f83bffff700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c010e2a0 0x7f83c0072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.721+0000 7f83bf7fe700 1 -- 172.21.15.17:0/3933128458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c006d3a0 msgr2=0x7f83c0117400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.721+0000 7f83bf7fe700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c006d3a0 0x7f83c0117400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.721+0000 7f83bf7fe700 1 -- 172.21.15.17:0/3933128458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c010e2a0 msgr2=0x7f83c0072740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.721+0000 7f83bf7fe700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c010e2a0 0x7f83c0072740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.721+0000 7f83bf7fe700 1 -- 172.21.15.17:0/3933128458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4009520 con 0x7f83c006c910 2023-07-14T13:24:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.721+0000 7f83bffff700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c010e2a0 0x7f83c0072740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:24:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.721+0000 7f83bf7fe700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c006c910 0x7f83c0116ec0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f83b001faf0 tx=0x7f83b001feb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.722+0000 7f83bcff9700 1 -- 172.21.15.17:0/3933128458 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b001dad0 con 0x7f83c006c910 2023-07-14T13:24:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.722+0000 7f83bcff9700 1 -- 172.21.15.17:0/3933128458 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83b0004cc0 con 0x7f83c006c910 2023-07-14T13:24:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.722+0000 7f83bcff9700 1 -- 172.21.15.17:0/3933128458 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0005550 con 0x7f83c006c910 2023-07-14T13:24:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.722+0000 7f83c5bff700 1 -- 172.21.15.17:0/3933128458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c0073460 con 0x7f83c006c910 2023-07-14T13:24:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.722+0000 7f83c5bff700 1 -- 172.21.15.17:0/3933128458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c007aa00 con 0x7f83c006c910 2023-07-14T13:24:03.747 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.733+0000 7f83d9498b80 1 Processor -- start 2023-07-14T13:24:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.734+0000 7f83bcff9700 1 -- 172.21.15.17:0/3933128458 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f83b001dc30 con 0x7f83c006c910 2023-07-14T13:24:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.740+0000 7f83bcff9700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f83a80a1450 0x7f83a80a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.740+0000 7f83bcff9700 1 -- 172.21.15.17:0/3933128458 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f83b0025070 con 0x7f83c006c910 2023-07-14T13:24:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.745+0000 7f83d9498b80 1 -- start start 2023-07-14T13:24:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.745+0000 7f83bffff700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f83a80a1450 0x7f83a80a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.745+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461ddf6b0 0x55c461f88d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.745+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461f892d0 0x55c461f83040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.745+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.745+0000 7f83d9498b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461e88c50 con 0x55c461f83580 2023-07-14T13:24:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.745+0000 7f83d9498b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461edb9e0 con 0x55c461ddf6b0 2023-07-14T13:24:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.745+0000 7f83d9498b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461ed4e70 con 0x55c461f892d0 2023-07-14T13:24:03.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.747+0000 7f83bffff700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f83a80a1450 0x7f83a80a3900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83c0117bc0 tx=0x7f83b800c420 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:03.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.747+0000 7f83bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.747+0000 7f83bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f839d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37014/0 (socket says 172.21.15.17:37014) 2023-07-14T13:24:03.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.747+0000 7f83bffff700 1 -- 172.21.15.17:0/2661543473 learned_addr learned my addr 172.21.15.17:0/2661543473 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.747+0000 7f83bffff700 1 -- 172.21.15.17:0/2661543473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461f892d0 msgr2=0x55c461f83040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.747+0000 7f83bffff700 1 --2- 172.21.15.17:0/2661543473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461f892d0 0x55c461f83040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.747+0000 7f83bffff700 1 -- 172.21.15.17:0/2661543473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461ddf6b0 msgr2=0x55c461f88d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.747+0000 7f83bffff700 1 --2- 172.21.15.17:0/2661543473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461ddf6b0 0x55c461f88d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.747+0000 7f83bffff700 1 -- 172.21.15.17:0/2661543473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c461d02d80 con 0x55c461f83580 2023-07-14T13:24:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.748+0000 7f83bffff700 1 --2- 172.21.15.17:0/2661543473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f839d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f83b800cf60 tx=0x7f83b8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790ce0d994ca0fc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.749+0000 7f83a5ffb700 1 -- 172.21.15.17:0/2661543473 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8021400 con 0x55c461f83580 2023-07-14T13:24:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.749+0000 7f83a5ffb700 1 -- 172.21.15.17:0/2661543473 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83b80219f0 con 0x55c461f83580 2023-07-14T13:24:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.749+0000 7f83a5ffb700 1 -- 172.21.15.17:0/2661543473 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8018880 con 0x55c461f83580 2023-07-14T13:24:03.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.750+0000 7f83d9498b80 1 -- 172.21.15.17:0/2661543473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 msgr2=0x55c461f839d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.750+0000 7f83d9498b80 1 --2- 172.21.15.17:0/2661543473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f839d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f83b800cf60 tx=0x7f83b8015000 comp rx=0 tx=0).stop 2023-07-14T13:24:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.750+0000 7f83d9498b80 1 -- 172.21.15.17:0/2661543473 shutdown_connections 2023-07-14T13:24:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.750+0000 7f83d9498b80 1 --2- 172.21.15.17:0/2661543473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f839d0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.750+0000 7f83d9498b80 1 --2- 172.21.15.17:0/2661543473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461ddf6b0 0x55c461f88d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.750+0000 7f83d9498b80 1 --2- 172.21.15.17:0/2661543473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461f892d0 0x55c461f83040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.750+0000 7f83d9498b80 1 -- 172.21.15.17:0/2661543473 >> 172.21.15.17:0/2661543473 conn(0x55c461f78be0 msgr2=0x55c461f7df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.750+0000 7f83d9498b80 1 -- 172.21.15.17:0/2661543473 shutdown_connections 2023-07-14T13:24:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.751+0000 7f83d9498b80 1 -- 172.21.15.17:0/2661543473 wait complete. 2023-07-14T13:24:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.751+0000 7f83d9498b80 1 -- start start 2023-07-14T13:24:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.752+0000 7f83d9498b80 1 Processor -- start 2023-07-14T13:24:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.752+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f8c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.753+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f83580 0x55c461f8cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.753+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f892d0 0x55c461f8d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.753+0000 7f83d9498b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461e74a60 con 0x55c461f892d0 2023-07-14T13:24:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.753+0000 7f83d9498b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461e74760 con 0x55c461f83580 2023-07-14T13:24:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.753+0000 7f83d9498b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461d588c0 con 0x55c461ddf6b0 2023-07-14T13:24:03.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.753+0000 7f83d9498b80 10 client.0 _ll_register_callbacks cb 0x55c461e72700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:24:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.754+0000 7f83bf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f8c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.754+0000 7f83bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f892d0 0x55c461f8d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.754+0000 7f83bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f892d0 0x55c461f8d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37020/0 (socket says 172.21.15.17:37020) 2023-07-14T13:24:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.754+0000 7f83bffff700 1 -- 172.21.15.17:0/301923700 learned_addr learned my addr 172.21.15.17:0/301923700 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.754+0000 7f83beffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f83580 0x55c461f8cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.755+0000 7f83bffff700 1 -- 172.21.15.17:0/301923700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 msgr2=0x55c461f8c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:03.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.755+0000 7f83bffff700 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f8c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.755+0000 7f83bffff700 1 -- 172.21.15.17:0/301923700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f83580 msgr2=0x55c461f8cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:03.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.755+0000 7f83bffff700 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f83580 0x55c461f8cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.755+0000 7f83bffff700 1 -- 172.21.15.17:0/301923700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b800cc10 con 0x55c461f892d0 2023-07-14T13:24:03.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.755+0000 7f83beffd700 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f83580 0x55c461f8cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:24:03.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.756+0000 7f83bffff700 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f892d0 0x55c461f8d460 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f83b8004b10 tx=0x7f83b800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f934508a4e59f94b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:03.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.760+0000 7f839effd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:24:03.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.760+0000 7f839effd700 1 -- 172.21.15.17:0/301923700 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8021870 con 0x55c461f892d0 2023-07-14T13:24:03.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.760+0000 7f839effd700 1 -- 172.21.15.17:0/301923700 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f83b8006e40 con 0x55c461f892d0 2023-07-14T13:24:03.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.760+0000 7f83d9498b80 1 -- 172.21.15.17:0/301923700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c461e2e490 con 0x55c461f892d0 2023-07-14T13:24:03.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.762+0000 7f839effd700 1 -- 172.21.15.17:0/301923700 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83b8018460 con 0x55c461f892d0 2023-07-14T13:24:03.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.762+0000 7f83d9498b80 10 client.19344 fetch_fsmap learned FSMap version 57 2023-07-14T13:24:03.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.762+0000 7f83d9498b80 1 -- 172.21.15.17:0/301923700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55c461cebc00 con 0x55c461f892d0 2023-07-14T13:24:03.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.764+0000 7f839effd700 1 -- 172.21.15.17:0/301923700 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c461e2e490 con 0x55c461f892d0 2023-07-14T13:24:03.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.764+0000 7f839effd700 1 -- 172.21.15.17:0/301923700 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 57) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f83b802b6f0 con 0x55c461f892d0 2023-07-14T13:24:03.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.765+0000 7f83d9498b80 10 client.19344 fetch_fsmap finished waiting for FSMap version 57 2023-07-14T13:24:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.765+0000 7f83d9498b80 10 client.19344 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:24:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.765+0000 7f83d9498b80 20 client.19344 populate_metadata read hostname 'smithi017' 2023-07-14T13:24:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.765+0000 7f83d9498b80 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c461f9cb10 0x55c461f9ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.765+0000 7f83d9498b80 4 client.19344 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:24:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.765+0000 7f83d9498b80 1 -- 172.21.15.17:0/301923700 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c461ecde50 con 0x55c461f9cb10 2023-07-14T13:24:03.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.766+0000 7f83bf7fe700 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c461f9cb10 0x55c461f9ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.767+0000 7f83bf7fe700 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c461f9cb10 0x55c461f9ef20 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4f11ab3ce5eece3 server_cookie=329265fc888267a9 in_seq=0 out_seq=0 2023-07-14T13:24:03.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.767+0000 7f839effd700 10 client.19344 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:03.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.768+0000 7f839effd700 1 -- 172.21.15.17:0/301923700 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c461ecde50 con 0x55c461f9cb10 2023-07-14T13:24:03.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.768+0000 7f839effd700 10 client.19344 handle_command_reply: tid=0 2023-07-14T13:24:03.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.768+0000 7f83d9498b80 1 client.19344 shutdown 2023-07-14T13:24:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.773+0000 7f83d9498b80 1 -- 172.21.15.17:0/301923700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f892d0 msgr2=0x55c461f8d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:03.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.773+0000 7f83d9498b80 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f892d0 0x55c461f8d460 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f83b8004b10 tx=0x7f83b800cb10 comp rx=0 tx=0).stop 2023-07-14T13:24:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.775+0000 7f83d9498b80 1 -- 172.21.15.17:0/301923700 shutdown_connections 2023-07-14T13:24:03.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.775+0000 7f83d9498b80 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c461f9cb10 0x55c461f9ef20 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.775+0000 7f83d9498b80 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f892d0 0x55c461f8d460 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.775+0000 7f83d9498b80 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f8c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.775+0000 7f83d9498b80 1 --2- 172.21.15.17:0/301923700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f83580 0x55c461f8cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.775+0000 7f83d9498b80 1 -- 172.21.15.17:0/301923700 >> 172.21.15.17:0/301923700 conn(0x55c461f78be0 msgr2=0x55c461f7d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:03.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.775+0000 7f839effd700 0 client.19344 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:03.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.779+0000 7f83d9498b80 1 -- 172.21.15.17:0/301923700 shutdown_connections 2023-07-14T13:24:03.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.779+0000 7f83d9498b80 1 -- 172.21.15.17:0/301923700 wait complete. 2023-07-14T13:24:03.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.779+0000 7f83d9498b80 20 client.19344 trim_cache size 0 max 16384 2023-07-14T13:24:03.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.811+0000 7f83d9498b80 1 Processor -- start 2023-07-14T13:24:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.812+0000 7f83d9498b80 1 -- start start 2023-07-14T13:24:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.812+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f83040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.812+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f88410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.812+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 0x55c461f8d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.812+0000 7f83d9498b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461f896c0 con 0x55c461f83580 2023-07-14T13:24:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.812+0000 7f83d9498b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461f7fb70 con 0x55c461f892d0 2023-07-14T13:24:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.812+0000 7f83d9498b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461f889f0 con 0x55c461ddf6b0 2023-07-14T13:24:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.813+0000 7f83bffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 0x55c461f8d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.813+0000 7f83bffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 0x55c461f8d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:46820/0 (socket says 172.21.15.17:46820) 2023-07-14T13:24:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.813+0000 7f83bffff700 1 -- 172.21.15.17:0/1753138344 learned_addr learned my addr 172.21.15.17:0/1753138344 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.814+0000 7f83bffff700 1 -- 172.21.15.17:0/1753138344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 msgr2=0x55c461f83040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:24:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.814+0000 7f83bffff700 1 --2- 172.21.15.17:0/1753138344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f83040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.814+0000 7f83bffff700 1 -- 172.21.15.17:0/1753138344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 msgr2=0x55c461f88410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.814+0000 7f83bffff700 1 --2- 172.21.15.17:0/1753138344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f88410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.814+0000 7f83bffff700 1 -- 172.21.15.17:0/1753138344 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c461f99260 con 0x55c461f892d0 2023-07-14T13:24:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.815+0000 7f83bffff700 1 --2- 172.21.15.17:0/1753138344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 0x55c461f8d290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c820 tx=0x7f83b802bbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=976a5a813110d4cb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.815+0000 7f83a67fc700 1 -- 172.21.15.17:0/1753138344 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8021870 con 0x55c461f892d0 2023-07-14T13:24:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.816+0000 7f83a67fc700 1 -- 172.21.15.17:0/1753138344 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83b8009d90 con 0x55c461f892d0 2023-07-14T13:24:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.816+0000 7f83a67fc700 1 -- 172.21.15.17:0/1753138344 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b803f6a0 con 0x55c461f892d0 2023-07-14T13:24:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.816+0000 7f83d9498b80 1 -- 172.21.15.17:0/1753138344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 msgr2=0x55c461f8d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.816+0000 7f83d9498b80 1 --2- 172.21.15.17:0/1753138344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 0x55c461f8d290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c820 tx=0x7f83b802bbd0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.817+0000 7f83d9498b80 1 -- 172.21.15.17:0/1753138344 shutdown_connections 2023-07-14T13:24:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.817+0000 7f83d9498b80 1 --2- 172.21.15.17:0/1753138344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 0x55c461f8d290 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.817+0000 7f83d9498b80 1 --2- 172.21.15.17:0/1753138344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f83040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.817+0000 7f83d9498b80 1 --2- 172.21.15.17:0/1753138344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f88410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.817+0000 7f83d9498b80 1 -- 172.21.15.17:0/1753138344 >> 172.21.15.17:0/1753138344 conn(0x55c461f78be0 msgr2=0x55c461f8b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.821+0000 7f83d9498b80 1 -- 172.21.15.17:0/1753138344 shutdown_connections 2023-07-14T13:24:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.823+0000 7f83d9498b80 1 -- 172.21.15.17:0/1753138344 wait complete. 2023-07-14T13:24:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.824+0000 7f83d9498b80 1 -- start start 2023-07-14T13:24:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.824+0000 7f83d9498b80 1 Processor -- start 2023-07-14T13:24:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.825+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f915c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.825+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f91b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.825+0000 7f83d9498b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 0x55c461f92080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.825+0000 7f83d9498b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461fefb90 con 0x55c461f83580 2023-07-14T13:24:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.825+0000 7f83d9498b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461fefd00 con 0x55c461f892d0 2023-07-14T13:24:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.825+0000 7f83d9498b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c461fefec0 con 0x55c461ddf6b0 2023-07-14T13:24:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.825+0000 7f83d9498b80 10 client.0 _ll_register_callbacks cb 0x7f83b800ce30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:24:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.827+0000 7f83beffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f91b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.827+0000 7f83beffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f91b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37038/0 (socket says 172.21.15.17:37038) 2023-07-14T13:24:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.827+0000 7f83beffd700 1 -- 172.21.15.17:0/1534449608 learned_addr learned my addr 172.21.15.17:0/1534449608 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.827+0000 7f83bf7fe700 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f915c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.828+0000 7f83bffff700 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 0x55c461f92080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.828+0000 7f83bf7fe700 1 -- 172.21.15.17:0/1534449608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 msgr2=0x55c461f92080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.828+0000 7f83bf7fe700 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 0x55c461f92080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.828+0000 7f83bf7fe700 1 -- 172.21.15.17:0/1534449608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 msgr2=0x55c461f91b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.828+0000 7f83bf7fe700 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f91b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.828+0000 7f83bf7fe700 1 -- 172.21.15.17:0/1534449608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c461cebc00 con 0x55c461ddf6b0 2023-07-14T13:24:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.829+0000 7f83bf7fe700 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f915c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f83b00db6e0 tx=0x7f83b0027330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e5e43d363f7b69 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.830+0000 7f839effd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:24:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.830+0000 7f839effd700 1 -- 172.21.15.17:0/1534449608 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b00b34b0 con 0x55c461ddf6b0 2023-07-14T13:24:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.830+0000 7f839effd700 1 -- 172.21.15.17:0/1534449608 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f83b00c9330 con 0x55c461ddf6b0 2023-07-14T13:24:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.830+0000 7f83d9498b80 1 -- 172.21.15.17:0/1534449608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f83b80219f0 con 0x55c461ddf6b0 2023-07-14T13:24:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.831+0000 7f839effd700 1 -- 172.21.15.17:0/1534449608 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83b00db960 con 0x55c461ddf6b0 2023-07-14T13:24:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.831+0000 7f83d9498b80 10 client.29083 fetch_fsmap learned FSMap version 57 2023-07-14T13:24:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.831+0000 7f83d9498b80 1 -- 172.21.15.17:0/1534449608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55c461d291f0 con 0x55c461ddf6b0 2023-07-14T13:24:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.833+0000 7f839effd700 1 -- 172.21.15.17:0/1534449608 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f83b80219f0 con 0x55c461ddf6b0 2023-07-14T13:24:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.833+0000 7f839effd700 1 -- 172.21.15.17:0/1534449608 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 57) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f83b00ab2c0 con 0x55c461ddf6b0 2023-07-14T13:24:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.834+0000 7f83d9498b80 10 client.29083 fetch_fsmap finished waiting for FSMap version 57 2023-07-14T13:24:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.834+0000 7f83d9498b80 10 client.29083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:24:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.834+0000 7f83d9498b80 20 client.29083 populate_metadata read hostname 'smithi017' 2023-07-14T13:24:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.834+0000 7f83d9498b80 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c461ff1620 0x55c461ff3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.834+0000 7f83d9498b80 4 client.29083 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:24:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.834+0000 7f83d9498b80 1 -- 172.21.15.17:0/1534449608 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c461e8fff0 con 0x55c461ff1620 2023-07-14T13:24:03.852 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:03 smithi017 ceph-mon[95536]: pgmap v768: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 17 MiB/s wr, 1.46k op/s 2023-07-14T13:24:03.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.837+0000 7f83beffd700 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c461ff1620 0x55c461ff3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.844+0000 7f83beffd700 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c461ff1620 0x55c461ff3a30 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fbba8a6b38ea4aa server_cookie=d90ba3f13245676f in_seq=0 out_seq=0 2023-07-14T13:24:03.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.845+0000 7f839effd700 10 client.29083 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:03.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.880+0000 7f839effd700 1 -- 172.21.15.17:0/1534449608 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c461e8fff0 con 0x55c461ff1620 2023-07-14T13:24:03.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.880+0000 7f839effd700 10 client.29083 handle_command_reply: tid=0 2023-07-14T13:24:03.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.880+0000 7f83d9498b80 1 client.29083 shutdown 2023-07-14T13:24:03.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.881+0000 7f83d9498b80 1 -- 172.21.15.17:0/1534449608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 msgr2=0x55c461f915c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:03.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.881+0000 7f83d9498b80 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f915c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f83b00db6e0 tx=0x7f83b0027330 comp rx=0 tx=0).stop 2023-07-14T13:24:03.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.882+0000 7f83d9498b80 1 -- 172.21.15.17:0/1534449608 shutdown_connections 2023-07-14T13:24:03.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.882+0000 7f83d9498b80 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c461ff1620 0x55c461ff3a30 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.882+0000 7f83d9498b80 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c461f892d0 0x55c461f92080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.882+0000 7f83d9498b80 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c461ddf6b0 0x55c461f915c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.882+0000 7f83d9498b80 1 --2- 172.21.15.17:0/1534449608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c461f83580 0x55c461f91b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.882+0000 7f83d9498b80 1 -- 172.21.15.17:0/1534449608 >> 172.21.15.17:0/1534449608 conn(0x55c461f78be0 msgr2=0x55c461f88280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:03.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.882+0000 7f839effd700 0 client.29083 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.886+0000 7f83d9498b80 1 -- 172.21.15.17:0/1534449608 shutdown_connections 2023-07-14T13:24:03.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.886+0000 7f83d9498b80 1 -- 172.21.15.17:0/1534449608 wait complete. 2023-07-14T13:24:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:24:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:24:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:24:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:24:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.887+0000 7f83d9498b80 20 client.29083 trim_cache size 0 max 16384 2023-07-14T13:24:03.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.893+0000 7f83c5bff700 1 -- 172.21.15.17:0/3933128458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f83a80a1450 msgr2=0x7f83a80a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.893+0000 7f83c5bff700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f83a80a1450 0x7f83a80a3900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83c0117bc0 tx=0x7f83b800c420 comp rx=0 tx=0).stop 2023-07-14T13:24:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.893+0000 7f83c5bff700 1 -- 172.21.15.17:0/3933128458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c006c910 msgr2=0x7f83c0116ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.893+0000 7f83c5bff700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c006c910 0x7f83c0116ec0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f83b001faf0 tx=0x7f83b001feb0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.896+0000 7f83c5bff700 1 -- 172.21.15.17:0/3933128458 shutdown_connections 2023-07-14T13:24:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.896+0000 7f83c5bff700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f83a80a1450 0x7f83a80a3900 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.896+0000 7f83c5bff700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c010e2a0 0x7f83c0072740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.896+0000 7f83c5bff700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83c006c910 0x7f83c0116ec0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.896+0000 7f83c5bff700 1 --2- 172.21.15.17:0/3933128458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c006d3a0 0x7f83c0117400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.896+0000 7f83c5bff700 1 -- 172.21.15.17:0/3933128458 >> 172.21.15.17:0/3933128458 conn(0x7f83c006bd70 msgr2=0x7f83c006f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.897+0000 7f83c5bff700 1 -- 172.21.15.17:0/3933128458 shutdown_connections 2023-07-14T13:24:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:03.897+0000 7f83c5bff700 1 -- 172.21.15.17:0/3933128458 wait complete. 2023-07-14T13:24:05.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:05 smithi131 ceph-mon[96953]: pgmap v769: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.21k op/s 2023-07-14T13:24:05.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:05 smithi131 ceph-mon[96953]: osdmap e126: 12 total, 12 up, 12 in 2023-07-14T13:24:05.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:05 smithi017 ceph-mon[95536]: pgmap v769: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.21k op/s 2023-07-14T13:24:05.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:05 smithi017 ceph-mon[95536]: osdmap e126: 12 total, 12 up, 12 in 2023-07-14T13:24:05.936 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:05 smithi135 ceph-mon[97338]: pgmap v769: 97 pgs: 97 active+clean; 15 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.21k op/s 2023-07-14T13:24:05.937 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:05 smithi135 ceph-mon[97338]: osdmap e126: 12 total, 12 up, 12 in 2023-07-14T13:24:07.434 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 355.0 s, 195.2 tps, lat 412.116 ms stddev 197.509 2023-07-14T13:24:07.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:07 smithi017 ceph-mon[95536]: pgmap v771: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:24:07.932 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:07 smithi135 ceph-mon[97338]: pgmap v771: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:24:07.980 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:07 smithi131 ceph-mon[96953]: pgmap v771: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:24:08.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:08 smithi017 ceph-mon[95536]: pgmap v772: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:24:08.932 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:08 smithi135 ceph-mon[97338]: pgmap v772: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:24:08.980 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:08 smithi131 ceph-mon[96953]: pgmap v772: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:24:11.682 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:11 smithi135 ceph-mon[97338]: pgmap v773: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 905 op/s 2023-07-14T13:24:11.730 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:11 smithi131 ceph-mon[96953]: pgmap v773: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 905 op/s 2023-07-14T13:24:11.845 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:11 smithi017 ceph-mon[95536]: pgmap v773: 97 pgs: 10 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 67 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 905 op/s 2023-07-14T13:24:12.433 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 360.0 s, 399.7 tps, lat 299.022 ms stddev 551.455 2023-07-14T13:24:13.682 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:13 smithi135 ceph-mon[97338]: pgmap v774: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.3 MiB/s wr, 747 op/s 2023-07-14T13:24:13.730 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:13 smithi131 ceph-mon[96953]: pgmap v774: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.3 MiB/s wr, 747 op/s 2023-07-14T13:24:13.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:13 smithi017 ceph-mon[95536]: pgmap v774: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.3 MiB/s wr, 747 op/s 2023-07-14T13:24:15.730 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:15 smithi131 ceph-mon[96953]: pgmap v775: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.3 MiB/s wr, 747 op/s 2023-07-14T13:24:15.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:15 smithi017 ceph-mon[95536]: pgmap v775: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.3 MiB/s wr, 747 op/s 2023-07-14T13:24:15.932 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:15 smithi135 ceph-mon[97338]: pgmap v775: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 8.3 MiB/s wr, 747 op/s 2023-07-14T13:24:17.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.180+0000 7f35015ff700 1 -- 172.21.15.17:0/3393305644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34fc107350 msgr2=0x7f34fc107720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:17.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.180+0000 7f35015ff700 1 --2- 172.21.15.17:0/3393305644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34fc107350 0x7f34fc107720 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00b0a0 tx=0x7f34ec00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.181+0000 7f35015ff700 1 -- 172.21.15.17:0/3393305644 shutdown_connections 2023-07-14T13:24:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.181+0000 7f35015ff700 1 --2- 172.21.15.17:0/3393305644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34fc110900 0x7f34fc112ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.181+0000 7f35015ff700 1 --2- 172.21.15.17:0/3393305644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34fc107350 0x7f34fc107720 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.181+0000 7f35015ff700 1 --2- 172.21.15.17:0/3393305644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34fc107c60 0x7f34fc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.181+0000 7f35015ff700 1 -- 172.21.15.17:0/3393305644 >> 172.21.15.17:0/3393305644 conn(0x7f34fc075a00 msgr2=0x7f34fc077e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.182+0000 7f35015ff700 1 -- 172.21.15.17:0/3393305644 shutdown_connections 2023-07-14T13:24:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.182+0000 7f35015ff700 1 -- 172.21.15.17:0/3393305644 wait complete. 2023-07-14T13:24:17.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.184+0000 7f35015ff700 1 Processor -- start 2023-07-14T13:24:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.184+0000 7f35015ff700 1 -- start start 2023-07-14T13:24:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.185+0000 7f35015ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34fc107350 0x7f34fc071c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.185+0000 7f35015ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34fc107c60 0x7f34fc0721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.185+0000 7f35015ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34fc110900 0x7f34fc06ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.185+0000 7f35015ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc06b420 con 0x7f34fc110900 2023-07-14T13:24:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.185+0000 7f35015ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc06b590 con 0x7f34fc107350 2023-07-14T13:24:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.185+0000 7f35015ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc06b750 con 0x7f34fc107c60 2023-07-14T13:24:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.185+0000 7f34fb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34fc110900 0x7f34fc06ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.185+0000 7f34fb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34fc110900 0x7f34fc06ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57388/0 (socket says 172.21.15.17:57388) 2023-07-14T13:24:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.185+0000 7f34fb7fe700 1 -- 172.21.15.17:0/2473058209 learned_addr learned my addr 172.21.15.17:0/2473058209 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.185+0000 7f34fa7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34fc107c60 0x7f34fc0721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.186+0000 7f34faffd700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34fc107350 0x7f34fc071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.186+0000 7f34fa7fc700 1 -- 172.21.15.17:0/2473058209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34fc107350 msgr2=0x7f34fc071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.186+0000 7f34fa7fc700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34fc107350 0x7f34fc071c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.186+0000 7f34fa7fc700 1 -- 172.21.15.17:0/2473058209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34fc110900 msgr2=0x7f34fc06ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.186+0000 7f34fa7fc700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34fc110900 0x7f34fc06ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.186+0000 7f34fa7fc700 1 -- 172.21.15.17:0/2473058209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec009d00 con 0x7f34fc107c60 2023-07-14T13:24:17.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.187+0000 7f34fa7fc700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34fc107c60 0x7f34fc0721a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f34f000b450 tx=0x7f34f000b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:17.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.187+0000 7f34e3fff700 1 -- 172.21.15.17:0/2473058209 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f0011830 con 0x7f34fc107c60 2023-07-14T13:24:17.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.187+0000 7f34e3fff700 1 -- 172.21.15.17:0/2473058209 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34f0011e20 con 0x7f34fc107c60 2023-07-14T13:24:17.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.187+0000 7f34e3fff700 1 -- 172.21.15.17:0/2473058209 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f0010d10 con 0x7f34fc107c60 2023-07-14T13:24:17.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.187+0000 7f35015ff700 1 -- 172.21.15.17:0/2473058209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34fc06f7b0 con 0x7f34fc107c60 2023-07-14T13:24:17.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.188+0000 7f35015ff700 1 -- 172.21.15.17:0/2473058209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc06fc10 con 0x7f34fc107c60 2023-07-14T13:24:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.195+0000 7f34e3fff700 1 -- 172.21.15.17:0/2473058209 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f34f0011990 con 0x7f34fc107c60 2023-07-14T13:24:17.210 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.196+0000 7f3514f70b80 1 Processor -- start 2023-07-14T13:24:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.196+0000 7f3514f70b80 1 -- start start 2023-07-14T13:24:17.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.197+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec81d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.197+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccec7c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.197+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec7c580 0x55eccec7c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.197+0000 7f3514f70b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecceb81c50 con 0x55eccec7c580 2023-07-14T13:24:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.197+0000 7f3514f70b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eccebd49e0 con 0x55eccead86b0 2023-07-14T13:24:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.197+0000 7f3514f70b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eccebcde70 con 0x55eccec822d0 2023-07-14T13:24:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.197+0000 7f34fb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec81d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.198+0000 7f34fb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec81d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57502/0 (socket says 172.21.15.17:57502) 2023-07-14T13:24:17.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.198+0000 7f34fb7fe700 1 -- 172.21.15.17:0/3217288788 learned_addr learned my addr 172.21.15.17:0/3217288788 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.198+0000 7f34faffd700 1 --2- 172.21.15.17:0/3217288788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccec7c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.198+0000 7f34fa7fc700 1 --2- 172.21.15.17:0/3217288788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec7c580 0x55eccec7c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.198+0000 7f34fb7fe700 1 -- 172.21.15.17:0/3217288788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 msgr2=0x55eccec7c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.198+0000 7f34fb7fe700 1 --2- 172.21.15.17:0/3217288788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccec7c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.198+0000 7f34fb7fe700 1 -- 172.21.15.17:0/3217288788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec7c580 msgr2=0x55eccec7c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.198+0000 7f34fb7fe700 1 --2- 172.21.15.17:0/3217288788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec7c580 0x55eccec7c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.198+0000 7f34fb7fe700 1 -- 172.21.15.17:0/3217288788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecce9fbd80 con 0x55eccead86b0 2023-07-14T13:24:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.199+0000 7f34fb7fe700 1 --2- 172.21.15.17:0/3217288788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec81d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f34f400aca0 tx=0x7f34f400f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87ac9cf08c36c5bb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.199+0000 7f34e17fa700 1 -- 172.21.15.17:0/3217288788 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f400a7a0 con 0x55eccead86b0 2023-07-14T13:24:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.199+0000 7f34e17fa700 1 -- 172.21.15.17:0/3217288788 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34f400fe50 con 0x55eccead86b0 2023-07-14T13:24:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.199+0000 7f34e17fa700 1 -- 172.21.15.17:0/3217288788 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4018440 con 0x55eccead86b0 2023-07-14T13:24:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.200+0000 7f34e3fff700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f34e40a1410 0x7f34e40a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.200+0000 7f34e3fff700 1 -- 172.21.15.17:0/2473058209 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f34f00cc2f0 con 0x7f34fc107c60 2023-07-14T13:24:17.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.200+0000 7f3514f70b80 1 -- 172.21.15.17:0/3217288788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 msgr2=0x55eccec81d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:17.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.200+0000 7f3514f70b80 1 --2- 172.21.15.17:0/3217288788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec81d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f34f400aca0 tx=0x7f34f400f3c0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.200+0000 7f3514f70b80 1 -- 172.21.15.17:0/3217288788 shutdown_connections 2023-07-14T13:24:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.200+0000 7f3514f70b80 1 --2- 172.21.15.17:0/3217288788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec7c580 0x55eccec7c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.200+0000 7f3514f70b80 1 --2- 172.21.15.17:0/3217288788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec81d90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.200+0000 7f3514f70b80 1 --2- 172.21.15.17:0/3217288788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccec7c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.200+0000 7f3514f70b80 1 -- 172.21.15.17:0/3217288788 >> 172.21.15.17:0/3217288788 conn(0x55eccec71be0 msgr2=0x55eccec76f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.201+0000 7f34faffd700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f34e40a1410 0x7f34e40a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.201+0000 7f3514f70b80 1 -- 172.21.15.17:0/3217288788 shutdown_connections 2023-07-14T13:24:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.201+0000 7f3514f70b80 1 -- 172.21.15.17:0/3217288788 wait complete. 2023-07-14T13:24:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.202+0000 7f34faffd700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f34e40a1410 0x7f34e40a38c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00b830 tx=0x7f34ec009be0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.202+0000 7f3514f70b80 1 -- start start 2023-07-14T13:24:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.202+0000 7f3514f70b80 1 Processor -- start 2023-07-14T13:24:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.203+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec85960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.203+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec7c580 0x55eccec85ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.203+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccec863e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.203+0000 7f3514f70b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecceb6da60 con 0x55eccec7c580 2023-07-14T13:24:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.203+0000 7f3514f70b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecceb6d760 con 0x55eccead86b0 2023-07-14T13:24:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.203+0000 7f3514f70b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eccea518c0 con 0x55eccec822d0 2023-07-14T13:24:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.203+0000 7f3514f70b80 10 client.0 _ll_register_callbacks cb 0x55ecceb6b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:24:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.203+0000 7f34fb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccec863e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.203+0000 7f34fb7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccec863e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:36912/0 (socket says 172.21.15.17:36912) 2023-07-14T13:24:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.203+0000 7f34fb7fe700 1 -- 172.21.15.17:0/4117001291 learned_addr learned my addr 172.21.15.17:0/4117001291 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.203+0000 7f34faffd700 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec85960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.204+0000 7f34fa7fc700 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec7c580 0x55eccec85ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.204+0000 7f34fb7fe700 1 -- 172.21.15.17:0/4117001291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 msgr2=0x55eccec85960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:17.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.204+0000 7f34fb7fe700 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec85960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.204+0000 7f34fb7fe700 1 -- 172.21.15.17:0/4117001291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec7c580 msgr2=0x55eccec85ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.204+0000 7f34fb7fe700 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec7c580 0x55eccec85ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.204+0000 7f34fb7fe700 1 -- 172.21.15.17:0/4117001291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f400a900 con 0x55eccec822d0 2023-07-14T13:24:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.205+0000 7f34fb7fe700 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccec863e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f34f4003aa0 tx=0x7f34f4003ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7ef6ceb2ff5cf08 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.205+0000 7f34deff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:24:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.205+0000 7f34deff5700 1 -- 172.21.15.17:0/4117001291 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4004410 con 0x55eccec822d0 2023-07-14T13:24:17.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.205+0000 7f34deff5700 1 -- 172.21.15.17:0/4117001291 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f34f4004750 con 0x55eccec822d0 2023-07-14T13:24:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.206+0000 7f3514f70b80 1 -- 172.21.15.17:0/4117001291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecceb27490 con 0x55eccec822d0 2023-07-14T13:24:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.206+0000 7f34deff5700 1 -- 172.21.15.17:0/4117001291 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34f4004570 con 0x55eccec822d0 2023-07-14T13:24:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.206+0000 7f3514f70b80 10 client.29095 fetch_fsmap learned FSMap version 57 2023-07-14T13:24:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.206+0000 7f3514f70b80 1 -- 172.21.15.17:0/4117001291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55ecce9e4c00 con 0x55eccec822d0 2023-07-14T13:24:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.206+0000 7f34deff5700 1 -- 172.21.15.17:0/4117001291 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ecceb27490 con 0x55eccec822d0 2023-07-14T13:24:17.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.207+0000 7f34deff5700 1 -- 172.21.15.17:0/4117001291 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 57) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f34f4020040 con 0x55eccec822d0 2023-07-14T13:24:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.207+0000 7f3514f70b80 10 client.29095 fetch_fsmap finished waiting for FSMap version 57 2023-07-14T13:24:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.207+0000 7f3514f70b80 10 client.29095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:24:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.207+0000 7f3514f70b80 20 client.29095 populate_metadata read hostname 'smithi017' 2023-07-14T13:24:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.207+0000 7f3514f70b80 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eccec95aa0 0x55eccec97eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.207+0000 7f3514f70b80 4 client.29095 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:24:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.207+0000 7f3514f70b80 1 -- 172.21.15.17:0/4117001291 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eccebc6e50 con 0x55eccec95aa0 2023-07-14T13:24:17.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.207+0000 7f34faffd700 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eccec95aa0 0x55eccec97eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.208+0000 7f34faffd700 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eccec95aa0 0x55eccec97eb0 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6f22af14e254ba server_cookie=163d48a7c9e55107 in_seq=0 out_seq=0 2023-07-14T13:24:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.208+0000 7f34deff5700 10 client.29095 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.209+0000 7f34deff5700 1 -- 172.21.15.17:0/4117001291 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55eccebc6e50 con 0x55eccec95aa0 2023-07-14T13:24:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.209+0000 7f34deff5700 10 client.29095 handle_command_reply: tid=0 2023-07-14T13:24:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.209+0000 7f3514f70b80 1 client.29095 shutdown 2023-07-14T13:24:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.210+0000 7f3514f70b80 1 -- 172.21.15.17:0/4117001291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 msgr2=0x55eccec863e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.210+0000 7f3514f70b80 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccec863e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f34f4003aa0 tx=0x7f34f4003ad0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.210+0000 7f3514f70b80 1 -- 172.21.15.17:0/4117001291 shutdown_connections 2023-07-14T13:24:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.210+0000 7f3514f70b80 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eccec95aa0 0x55eccec97eb0 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.210+0000 7f3514f70b80 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccec863e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.210+0000 7f3514f70b80 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec85960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.210+0000 7f3514f70b80 1 --2- 172.21.15.17:0/4117001291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec7c580 0x55eccec85ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.210+0000 7f3514f70b80 1 -- 172.21.15.17:0/4117001291 >> 172.21.15.17:0/4117001291 conn(0x55eccec71be0 msgr2=0x55eccec75c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.210+0000 7f34deff5700 0 client.29095 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.210+0000 7f3514f70b80 1 -- 172.21.15.17:0/4117001291 shutdown_connections 2023-07-14T13:24:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.210+0000 7f3514f70b80 1 -- 172.21.15.17:0/4117001291 wait complete. 2023-07-14T13:24:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.211+0000 7f3514f70b80 20 client.29095 trim_cache size 0 max 16384 2023-07-14T13:24:17.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.235+0000 7f3514f70b80 1 Processor -- start 2023-07-14T13:24:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.235+0000 7f3514f70b80 1 -- start start 2023-07-14T13:24:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.235+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec7c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.235+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec7c580 0x55eccec7fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.236+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec822d0 0x55eccec80150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.236+0000 7f3514f70b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eccec735f0 con 0x55eccec822d0 2023-07-14T13:24:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.236+0000 7f3514f70b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eccec80750 con 0x55eccead86b0 2023-07-14T13:24:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.236+0000 7f3514f70b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eccec78ab0 con 0x55eccec7c580 2023-07-14T13:24:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.236+0000 7f34faffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec7c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.236+0000 7f34faffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec7c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57520/0 (socket says 172.21.15.17:57520) 2023-07-14T13:24:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.236+0000 7f34faffd700 1 -- 172.21.15.17:0/1972635905 learned_addr learned my addr 172.21.15.17:0/1972635905 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.236+0000 7f34fa7fc700 1 --2- 172.21.15.17:0/1972635905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec7c580 0x55eccec7fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.237+0000 7f34fb7fe700 1 --2- 172.21.15.17:0/1972635905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec822d0 0x55eccec80150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.237+0000 7f34fa7fc700 1 -- 172.21.15.17:0/1972635905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 msgr2=0x55eccec7c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.237+0000 7f34fa7fc700 1 --2- 172.21.15.17:0/1972635905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec7c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.237+0000 7f34fa7fc700 1 -- 172.21.15.17:0/1972635905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec822d0 msgr2=0x55eccec80150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.237+0000 7f34fa7fc700 1 --2- 172.21.15.17:0/1972635905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec822d0 0x55eccec80150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.238+0000 7f34fa7fc700 1 -- 172.21.15.17:0/1972635905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eccea221f0 con 0x55eccec7c580 2023-07-14T13:24:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.238+0000 7f34fa7fc700 1 --2- 172.21.15.17:0/1972635905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec7c580 0x55eccec7fc10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f34f00c9b10 tx=0x7f34f00cf910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=372d6e80b2aeb030 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.238+0000 7f34e1ffb700 1 -- 172.21.15.17:0/1972635905 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f0098fd0 con 0x55eccec7c580 2023-07-14T13:24:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.238+0000 7f34e1ffb700 1 -- 172.21.15.17:0/1972635905 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34f0098df0 con 0x55eccec7c580 2023-07-14T13:24:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.238+0000 7f34e1ffb700 1 -- 172.21.15.17:0/1972635905 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f009d4c0 con 0x55eccec7c580 2023-07-14T13:24:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.239+0000 7f3514f70b80 1 -- 172.21.15.17:0/1972635905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec7c580 msgr2=0x55eccec7fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.239+0000 7f3514f70b80 1 --2- 172.21.15.17:0/1972635905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec7c580 0x55eccec7fc10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f34f00c9b10 tx=0x7f34f00cf910 comp rx=0 tx=0).stop 2023-07-14T13:24:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.239+0000 7f3514f70b80 1 -- 172.21.15.17:0/1972635905 shutdown_connections 2023-07-14T13:24:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.239+0000 7f3514f70b80 1 --2- 172.21.15.17:0/1972635905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec822d0 0x55eccec80150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.239+0000 7f3514f70b80 1 --2- 172.21.15.17:0/1972635905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccead86b0 0x55eccec7c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.239+0000 7f3514f70b80 1 --2- 172.21.15.17:0/1972635905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec7c580 0x55eccec7fc10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.239+0000 7f3514f70b80 1 -- 172.21.15.17:0/1972635905 >> 172.21.15.17:0/1972635905 conn(0x55eccec71be0 msgr2=0x55eccec76ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.240+0000 7f3514f70b80 1 -- 172.21.15.17:0/1972635905 shutdown_connections 2023-07-14T13:24:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.240+0000 7f3514f70b80 1 -- 172.21.15.17:0/1972635905 wait complete. 2023-07-14T13:24:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.241+0000 7f3514f70b80 1 -- start start 2023-07-14T13:24:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.241+0000 7f3514f70b80 1 Processor -- start 2023-07-14T13:24:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.242+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccec7c580 0x55eccece4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.242+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccece5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.242+0000 7f3514f70b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec8ac50 0x55eccec8b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.242+0000 7f3514f70b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eccec8b790 con 0x55eccec8ac50 2023-07-14T13:24:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.242+0000 7f3514f70b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eccec8b900 con 0x55eccec7c580 2023-07-14T13:24:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.242+0000 7f3514f70b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eccec8bac0 con 0x55eccec822d0 2023-07-14T13:24:17.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.242+0000 7f3514f70b80 10 client.0 _ll_register_callbacks cb 0x55ecceb6b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:24:17.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.243+0000 7f34faffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccec7c580 0x55eccece4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.243+0000 7f34fa7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccece5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.244+0000 7f34fb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec8ac50 0x55eccec8b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.244+0000 7f34fb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec8ac50 0x55eccec8b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57428/0 (socket says 172.21.15.17:57428) 2023-07-14T13:24:17.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.244+0000 7f34fb7fe700 1 -- 172.21.15.17:0/2856799358 learned_addr learned my addr 172.21.15.17:0/2856799358 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:17.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.244+0000 7f34fb7fe700 1 -- 172.21.15.17:0/2856799358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 msgr2=0x55eccece5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:17.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.244+0000 7f34fb7fe700 1 --2- 172.21.15.17:0/2856799358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccece5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.244+0000 7f34fb7fe700 1 -- 172.21.15.17:0/2856799358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccec7c580 msgr2=0x55eccece4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:17.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.244+0000 7f34fb7fe700 1 --2- 172.21.15.17:0/2856799358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccec7c580 0x55eccece4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.244+0000 7f34fb7fe700 1 -- 172.21.15.17:0/2856799358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc06fc10 con 0x55eccec8ac50 2023-07-14T13:24:17.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.245+0000 7f34fb7fe700 1 --2- 172.21.15.17:0/2856799358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec8ac50 0x55eccec8b0c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f34f4003a70 tx=0x7f34f4022460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c1fd15ce993895 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:17.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.245+0000 7f34deff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:24:17.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.246+0000 7f34deff5700 1 -- 172.21.15.17:0/2856799358 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f400fc50 con 0x55eccec8ac50 2023-07-14T13:24:17.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.246+0000 7f34deff5700 1 -- 172.21.15.17:0/2856799358 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f34f4000e40 con 0x55eccec8ac50 2023-07-14T13:24:17.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.247+0000 7f3514f70b80 1 -- 172.21.15.17:0/2856799358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f34f400fe50 con 0x55eccec8ac50 2023-07-14T13:24:17.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.247+0000 7f34deff5700 1 -- 172.21.15.17:0/2856799358 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34f4022620 con 0x55eccec8ac50 2023-07-14T13:24:17.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.247+0000 7f3514f70b80 10 client.19362 fetch_fsmap learned FSMap version 57 2023-07-14T13:24:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.247+0000 7f3514f70b80 1 -- 172.21.15.17:0/2856799358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55ecce9fa250 con 0x55eccec8ac50 2023-07-14T13:24:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.248+0000 7f34deff5700 1 -- 172.21.15.17:0/2856799358 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34f4041030 con 0x55eccec8ac50 2023-07-14T13:24:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.248+0000 7f34deff5700 1 -- 172.21.15.17:0/2856799358 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 57) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f34f400f430 con 0x55eccec8ac50 2023-07-14T13:24:17.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.248+0000 7f3514f70b80 10 client.19362 fetch_fsmap finished waiting for FSMap version 57 2023-07-14T13:24:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.248+0000 7f3514f70b80 10 client.19362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:24:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.248+0000 7f3514f70b80 20 client.19362 populate_metadata read hostname 'smithi017' 2023-07-14T13:24:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.248+0000 7f3514f70b80 1 --2- 172.21.15.17:0/2856799358 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eccecfba90 0x55eccecfdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.248+0000 7f3514f70b80 4 client.19362 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:24:17.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.248+0000 7f3514f70b80 1 -- 172.21.15.17:0/2856799358 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ecceb88ff0 con 0x55eccecfba90 2023-07-14T13:24:17.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.249+0000 7f34faffd700 1 --2- 172.21.15.17:0/2856799358 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eccecfba90 0x55eccecfdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:17.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.250+0000 7f34faffd700 1 --2- 172.21.15.17:0/2856799358 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eccecfba90 0x55eccecfdea0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cfb3e7cb19bcf94 server_cookie=b8052cf3578262d6 in_seq=0 out_seq=0 2023-07-14T13:24:17.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.250+0000 7f34deff5700 10 client.19362 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:17.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.273+0000 7f34deff5700 1 -- 172.21.15.17:0/2856799358 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ecceb88ff0 con 0x55eccecfba90 2023-07-14T13:24:17.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.273+0000 7f34deff5700 10 client.19362 handle_command_reply: tid=0 2023-07-14T13:24:17.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.273+0000 7f3514f70b80 1 client.19362 shutdown 2023-07-14T13:24:17.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.276+0000 7f3514f70b80 1 -- 172.21.15.17:0/2856799358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec8ac50 msgr2=0x55eccec8b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:17.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.276+0000 7f3514f70b80 1 --2- 172.21.15.17:0/2856799358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec8ac50 0x55eccec8b0c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f34f4003a70 tx=0x7f34f4022460 comp rx=0 tx=0).stop 2023-07-14T13:24:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.281+0000 7f3514f70b80 1 -- 172.21.15.17:0/2856799358 shutdown_connections 2023-07-14T13:24:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.281+0000 7f3514f70b80 1 --2- 172.21.15.17:0/2856799358 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eccecfba90 0x55eccecfdea0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.281+0000 7f3514f70b80 1 --2- 172.21.15.17:0/2856799358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eccec8ac50 0x55eccec8b0c0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.281+0000 7f3514f70b80 1 --2- 172.21.15.17:0/2856799358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eccec7c580 0x55eccece4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.281+0000 7f3514f70b80 1 --2- 172.21.15.17:0/2856799358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eccec822d0 0x55eccece5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.281+0000 7f3514f70b80 1 -- 172.21.15.17:0/2856799358 >> 172.21.15.17:0/2856799358 conn(0x55eccec71be0 msgr2=0x55eccec80b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:17.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.281+0000 7f34deff5700 0 client.19362 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:17.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.285+0000 7f3514f70b80 1 -- 172.21.15.17:0/2856799358 shutdown_connections 2023-07-14T13:24:17.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.286+0000 7f3514f70b80 1 -- 172.21.15.17:0/2856799358 wait complete. 2023-07-14T13:24:17.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.286+0000 7f3514f70b80 20 client.19362 trim_cache size 0 max 16384 2023-07-14T13:24:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:24:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:24:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:24:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:24:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.287+0000 7f35015ff700 1 -- 172.21.15.17:0/2473058209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f34e40a1410 msgr2=0x7f34e40a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.287+0000 7f35015ff700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f34e40a1410 0x7f34e40a38c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00b830 tx=0x7f34ec009be0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.287+0000 7f35015ff700 1 -- 172.21.15.17:0/2473058209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34fc107c60 msgr2=0x7f34fc0721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.287+0000 7f35015ff700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34fc107c60 0x7f34fc0721a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f34f000b450 tx=0x7f34f000b760 comp rx=0 tx=0).stop 2023-07-14T13:24:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.287+0000 7f35015ff700 1 -- 172.21.15.17:0/2473058209 shutdown_connections 2023-07-14T13:24:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.287+0000 7f35015ff700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f34e40a1410 0x7f34e40a38c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.287+0000 7f35015ff700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34fc110900 0x7f34fc06ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.287+0000 7f35015ff700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34fc107350 0x7f34fc071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.287+0000 7f35015ff700 1 --2- 172.21.15.17:0/2473058209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34fc107c60 0x7f34fc0721a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.287+0000 7f35015ff700 1 -- 172.21.15.17:0/2473058209 >> 172.21.15.17:0/2473058209 conn(0x7f34fc075a00 msgr2=0x7f34fc075f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.288+0000 7f35015ff700 1 -- 172.21.15.17:0/2473058209 shutdown_connections 2023-07-14T13:24:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:17.288+0000 7f35015ff700 1 -- 172.21.15.17:0/2473058209 wait complete. 2023-07-14T13:24:17.433 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 365.0 s, 509.0 tps, lat 196.904 ms stddev 58.464 2023-07-14T13:24:17.681 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:17 smithi135 ceph-mon[97338]: pgmap v776: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:24:17.682 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:17 smithi135 ceph-mon[97338]: osdmap e127: 12 total, 12 up, 12 in 2023-07-14T13:24:17.730 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:17 smithi131 ceph-mon[96953]: pgmap v776: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:24:17.731 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:17 smithi131 ceph-mon[96953]: osdmap e127: 12 total, 12 up, 12 in 2023-07-14T13:24:17.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:17 smithi017 ceph-mon[95536]: pgmap v776: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-07-14T13:24:17.843 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:17 smithi017 ceph-mon[95536]: osdmap e127: 12 total, 12 up, 12 in 2023-07-14T13:24:19.730 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:19 smithi131 ceph-mon[96953]: pgmap v778: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 924 op/s 2023-07-14T13:24:19.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:19 smithi017 ceph-mon[95536]: pgmap v778: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 924 op/s 2023-07-14T13:24:19.931 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:19 smithi135 ceph-mon[97338]: pgmap v778: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 10 MiB/s wr, 924 op/s 2023-07-14T13:24:21.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:21 smithi017 ceph-mon[95536]: pgmap v779: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-14T13:24:21.931 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:21 smithi135 ceph-mon[97338]: pgmap v779: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-14T13:24:21.980 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:21 smithi131 ceph-mon[96953]: pgmap v779: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-14T13:24:22.435 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 370.0 s, 524.2 tps, lat 191.821 ms stddev 111.500 2023-07-14T13:24:22.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:22 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:24:22.931 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:22 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:24:22.984 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:22 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:24:23.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:23 smithi017 ceph-mon[95536]: pgmap v780: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-14T13:24:23.931 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:23 smithi135 ceph-mon[97338]: pgmap v780: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-14T13:24:23.980 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:23 smithi131 ceph-mon[96953]: pgmap v780: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-14T13:24:24.844 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:24 smithi017 ceph-mon[95536]: pgmap v781: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-14T13:24:24.932 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:24 smithi135 ceph-mon[97338]: pgmap v781: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-14T13:24:24.980 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:24 smithi131 ceph-mon[96953]: pgmap v781: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-14T13:24:27.433 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 375.0 s, 472.7 tps, lat 210.578 ms stddev 107.310 2023-07-14T13:24:27.681 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:27 smithi135 ceph-mon[97338]: pgmap v782: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.47k op/s 2023-07-14T13:24:27.730 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:27 smithi131 ceph-mon[96953]: pgmap v782: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.47k op/s 2023-07-14T13:24:27.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:27 smithi017 ceph-mon[95536]: pgmap v782: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.47k op/s 2023-07-14T13:24:29.732 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:29 smithi131 ceph-mon[96953]: pgmap v783: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-07-14T13:24:29.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:29 smithi017 ceph-mon[95536]: pgmap v783: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-07-14T13:24:29.931 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:29 smithi135 ceph-mon[97338]: pgmap v783: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-07-14T13:24:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.543+0000 7f5f67dff700 1 -- 172.21.15.17:0/3378267185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f60101fb0 msgr2=0x7f5f60102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.543+0000 7f5f67dff700 1 --2- 172.21.15.17:0/3378267185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f60101fb0 0x7f5f60102380 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0138c0 tx=0x7f5f5c013bd0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.543+0000 7f5f67dff700 1 -- 172.21.15.17:0/3378267185 shutdown_connections 2023-07-14T13:24:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.543+0000 7f5f67dff700 1 --2- 172.21.15.17:0/3378267185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f60106ff0 0x7f5f6010ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.543+0000 7f5f67dff700 1 --2- 172.21.15.17:0/3378267185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f60101fb0 0x7f5f60102380 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.543+0000 7f5f67dff700 1 --2- 172.21.15.17:0/3378267185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f60102950 0x7f5f60106910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.543+0000 7f5f67dff700 1 -- 172.21.15.17:0/3378267185 >> 172.21.15.17:0/3378267185 conn(0x7f5f600fd800 msgr2=0x7f5f600ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.544+0000 7f5f67dff700 1 -- 172.21.15.17:0/3378267185 shutdown_connections 2023-07-14T13:24:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.544+0000 7f5f67dff700 1 -- 172.21.15.17:0/3378267185 wait complete. 2023-07-14T13:24:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.545+0000 7f5f67dff700 1 Processor -- start 2023-07-14T13:24:30.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.545+0000 7f5f67dff700 1 -- start start 2023-07-14T13:24:30.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.546+0000 7f5f67dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f60101fb0 0x7f5f60199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.546+0000 7f5f67dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f60102950 0x7f5f6019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.546+0000 7f5f67dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f60106ff0 0x7f5f60194360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.546+0000 7f5f67dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f60194b30 con 0x7f5f60106ff0 2023-07-14T13:24:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.546+0000 7f5f67dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f60194ca0 con 0x7f5f60101fb0 2023-07-14T13:24:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.546+0000 7f5f67dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f60194e60 con 0x7f5f60102950 2023-07-14T13:24:30.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.547+0000 7f5f65b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f60101fb0 0x7f5f60199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.547+0000 7f5f65b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f60101fb0 0x7f5f60199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53980/0 (socket says 172.21.15.17:53980) 2023-07-14T13:24:30.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.547+0000 7f5f65b9b700 1 -- 172.21.15.17:0/3255621629 learned_addr learned my addr 172.21.15.17:0/3255621629 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:30.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.547+0000 7f5f6639c700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f60106ff0 0x7f5f60194360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.547+0000 7f5f6539a700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f60102950 0x7f5f6019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.547+0000 7f5f65b9b700 1 -- 172.21.15.17:0/3255621629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f60102950 msgr2=0x7f5f6019a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:30.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.547+0000 7f5f65b9b700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f60102950 0x7f5f6019a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.547+0000 7f5f65b9b700 1 -- 172.21.15.17:0/3255621629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f60106ff0 msgr2=0x7f5f60194360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:30.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.547+0000 7f5f65b9b700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f60106ff0 0x7f5f60194360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.547+0000 7f5f65b9b700 1 -- 172.21.15.17:0/3255621629 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58009520 con 0x7f5f60101fb0 2023-07-14T13:24:30.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.547+0000 7f5f6639c700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f60106ff0 0x7f5f60194360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:24:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.548+0000 7f5f65b9b700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f60101fb0 0x7f5f60199b30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009c10 tx=0x7f5f5c008fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.549+0000 7f5f56ffd700 1 -- 172.21.15.17:0/3255621629 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c003c00 con 0x7f5f60101fb0 2023-07-14T13:24:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.549+0000 7f5f67dff700 1 -- 172.21.15.17:0/3255621629 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5c009c40 con 0x7f5f60101fb0 2023-07-14T13:24:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.549+0000 7f5f56ffd700 1 -- 172.21.15.17:0/3255621629 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f5c007940 con 0x7f5f60101fb0 2023-07-14T13:24:30.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.549+0000 7f5f67dff700 1 -- 172.21.15.17:0/3255621629 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f601a08f0 con 0x7f5f60101fb0 2023-07-14T13:24:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.549+0000 7f5f56ffd700 1 -- 172.21.15.17:0/3255621629 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0055a0 con 0x7f5f60101fb0 2023-07-14T13:24:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.556+0000 7f5f7b6deb80 1 Processor -- start 2023-07-14T13:24:30.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.557+0000 7f5f7b6deb80 1 -- start start 2023-07-14T13:24:30.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.557+0000 7f5f56ffd700 1 -- 172.21.15.17:0/3255621629 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5f5c005700 con 0x7f5f60101fb0 2023-07-14T13:24:30.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.557+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b3cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.557+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b3d2d0 0x559660b37040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.557+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 0x559660b379d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.557+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660a3cc50 con 0x559660b37580 2023-07-14T13:24:30.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.557+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660a8f9e0 con 0x559660b3d2d0 2023-07-14T13:24:30.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.557+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660a88e70 con 0x5596609936b0 2023-07-14T13:24:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.557+0000 7f5f6539a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 0x559660b379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.558+0000 7f5f6539a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 0x559660b379d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42882/0 (socket says 172.21.15.17:42882) 2023-07-14T13:24:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.558+0000 7f5f6539a700 1 -- 172.21.15.17:0/215410850 learned_addr learned my addr 172.21.15.17:0/215410850 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.558+0000 7f5f6639c700 1 --2- 172.21.15.17:0/215410850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b3cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.558+0000 7f5f65b9b700 1 --2- 172.21.15.17:0/215410850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b3d2d0 0x559660b37040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.558+0000 7f5f6539a700 1 -- 172.21.15.17:0/215410850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 msgr2=0x559660b3cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.558+0000 7f5f6539a700 1 --2- 172.21.15.17:0/215410850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b3cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.558+0000 7f5f6539a700 1 -- 172.21.15.17:0/215410850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b3d2d0 msgr2=0x559660b37040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.558+0000 7f5f6539a700 1 --2- 172.21.15.17:0/215410850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b3d2d0 0x559660b37040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.558+0000 7f5f6539a700 1 -- 172.21.15.17:0/215410850 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596608b6d80 con 0x559660b37580 2023-07-14T13:24:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.559+0000 7f5f6539a700 1 --2- 172.21.15.17:0/215410850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 0x559660b379d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009cc0 tx=0x7f5f50011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2dc36aae3c08a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.559+0000 7f5f4bfff700 1 -- 172.21.15.17:0/215410850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50011da0 con 0x559660b37580 2023-07-14T13:24:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.559+0000 7f5f4bfff700 1 -- 172.21.15.17:0/215410850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f500044e0 con 0x559660b37580 2023-07-14T13:24:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.559+0000 7f5f4bfff700 1 -- 172.21.15.17:0/215410850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50005280 con 0x559660b37580 2023-07-14T13:24:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.560+0000 7f5f56ffd700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5f4c0a13c0 0x7f5f4c0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.560+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/215410850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 msgr2=0x559660b379d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.560+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/215410850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 0x559660b379d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009cc0 tx=0x7f5f50011440 comp rx=0 tx=0).stop 2023-07-14T13:24:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.560+0000 7f5f56ffd700 1 -- 172.21.15.17:0/3255621629 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5f5c0d69d0 con 0x7f5f60101fb0 2023-07-14T13:24:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.560+0000 7f5f6639c700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5f4c0a13c0 0x7f5f4c0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.561+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/215410850 shutdown_connections 2023-07-14T13:24:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.561+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/215410850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 0x559660b379d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.561+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/215410850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b3cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.561+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/215410850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b3d2d0 0x559660b37040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.561+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/215410850 >> 172.21.15.17:0/215410850 conn(0x559660b2cbe0 msgr2=0x559660b31f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.561+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/215410850 shutdown_connections 2023-07-14T13:24:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.562+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/215410850 wait complete. 2023-07-14T13:24:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.562+0000 7f5f7b6deb80 1 -- start start 2023-07-14T13:24:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.563+0000 7f5f7b6deb80 1 Processor -- start 2023-07-14T13:24:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.563+0000 7f5f6639c700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5f4c0a13c0 0x7f5f4c0a3870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5f580116f0 tx=0x7f5f58009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.564+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.564+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b40770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.564+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b3d2d0 0x559660b40d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.564+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660a28a60 con 0x559660b3d2d0 2023-07-14T13:24:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.564+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660a28760 con 0x559660b37580 2023-07-14T13:24:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.564+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55966090c8c0 con 0x5596609936b0 2023-07-14T13:24:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.564+0000 7f5f7b6deb80 10 client.0 _ll_register_callbacks cb 0x559660a26700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:24:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.564+0000 7f5f6539a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b40770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.564+0000 7f5f6539a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b40770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53998/0 (socket says 172.21.15.17:53998) 2023-07-14T13:24:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.564+0000 7f5f6539a700 1 -- 172.21.15.17:0/2067920779 learned_addr learned my addr 172.21.15.17:0/2067920779 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.564+0000 7f5f6639c700 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b3d2d0 0x559660b40d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.565+0000 7f5f6539a700 1 -- 172.21.15.17:0/2067920779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 msgr2=0x559660b434f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:24:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.565+0000 7f5f6539a700 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b434f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.565+0000 7f5f6539a700 1 -- 172.21.15.17:0/2067920779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b3d2d0 msgr2=0x559660b40d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.565+0000 7f5f6539a700 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b3d2d0 0x559660b40d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.565+0000 7f5f6539a700 1 -- 172.21.15.17:0/2067920779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f50009920 con 0x559660b37580 2023-07-14T13:24:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.565+0000 7f5f6639c700 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b3d2d0 0x559660b40d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:24:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.566+0000 7f5f6539a700 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b40770 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5f50004bb0 tx=0x7f5f50004cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e95bece37ee9d48 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:30.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.566+0000 7f5f497fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:24:30.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.566+0000 7f5f497fa700 1 -- 172.21.15.17:0/2067920779 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50011e00 con 0x559660b37580 2023-07-14T13:24:30.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.566+0000 7f5f497fa700 1 -- 172.21.15.17:0/2067920779 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5f50004260 con 0x559660b37580 2023-07-14T13:24:30.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.567+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/2067920779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596609e2490 con 0x559660b37580 2023-07-14T13:24:30.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.567+0000 7f5f497fa700 1 -- 172.21.15.17:0/2067920779 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f50003680 con 0x559660b37580 2023-07-14T13:24:30.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.567+0000 7f5f7b6deb80 10 client.29147 fetch_fsmap learned FSMap version 58 2023-07-14T13:24:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.567+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/2067920779 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55966089fc00 con 0x559660b37580 2023-07-14T13:24:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.568+0000 7f5f497fa700 1 -- 172.21.15.17:0/2067920779 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5596609e2490 con 0x559660b37580 2023-07-14T13:24:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.568+0000 7f5f497fa700 1 -- 172.21.15.17:0/2067920779 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 58) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f5f500052c0 con 0x559660b37580 2023-07-14T13:24:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.568+0000 7f5f7b6deb80 10 client.29147 fetch_fsmap finished waiting for FSMap version 58 2023-07-14T13:24:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.568+0000 7f5f7b6deb80 10 client.29147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:24:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.568+0000 7f5f7b6deb80 20 client.29147 populate_metadata read hostname 'smithi017' 2023-07-14T13:24:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.568+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660b61aa0 0x559660b63eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.568+0000 7f5f7b6deb80 4 client.29147 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:24:30.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.568+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/2067920779 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559660a81e50 con 0x559660b61aa0 2023-07-14T13:24:30.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.569+0000 7f5f65b9b700 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660b61aa0 0x559660b63eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.570+0000 7f5f65b9b700 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660b61aa0 0x559660b63eb0 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9fd0c5ec07e0306 server_cookie=7691d967e86ad1ee in_seq=0 out_seq=0 2023-07-14T13:24:30.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.570+0000 7f5f497fa700 10 client.29147 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.571+0000 7f5f497fa700 1 -- 172.21.15.17:0/2067920779 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559660a81e50 con 0x559660b61aa0 2023-07-14T13:24:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.571+0000 7f5f497fa700 10 client.29147 handle_command_reply: tid=0 2023-07-14T13:24:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.571+0000 7f5f7b6deb80 1 client.29147 shutdown 2023-07-14T13:24:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.572+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/2067920779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 msgr2=0x559660b40770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.572+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b40770 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5f50004bb0 tx=0x7f5f50004cc0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.572+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/2067920779 shutdown_connections 2023-07-14T13:24:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.572+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660b61aa0 0x559660b63eb0 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.572+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b3d2d0 0x559660b40d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.572+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.572+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/2067920779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b40770 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.572+0000 7f5f497fa700 0 client.29147 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.572+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/2067920779 >> 172.21.15.17:0/2067920779 conn(0x559660b2cbe0 msgr2=0x559660b30c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.573+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/2067920779 shutdown_connections 2023-07-14T13:24:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.573+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/2067920779 wait complete. 2023-07-14T13:24:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.573+0000 7f5f7b6deb80 20 client.29147 trim_cache size 0 max 16384 2023-07-14T13:24:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.602+0000 7f5f7b6deb80 1 Processor -- start 2023-07-14T13:24:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.603+0000 7f5f7b6deb80 1 -- start start 2023-07-14T13:24:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.604+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b37040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.604+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b335b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.604+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b3d2d0 0x559660b58cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.604+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596609e2490 con 0x559660b3d2d0 2023-07-14T13:24:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.604+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660afd060 con 0x559660b37580 2023-07-14T13:24:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.604+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660b38050 con 0x5596609936b0 2023-07-14T13:24:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.605+0000 7f5f6539a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.605+0000 7f5f6539a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b335b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54002/0 (socket says 172.21.15.17:54002) 2023-07-14T13:24:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.605+0000 7f5f6539a700 1 -- 172.21.15.17:0/479496881 learned_addr learned my addr 172.21.15.17:0/479496881 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.605+0000 7f5f65b9b700 1 --2- 172.21.15.17:0/479496881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b37040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.606+0000 7f5f6539a700 1 -- 172.21.15.17:0/479496881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 msgr2=0x559660b37040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.606+0000 7f5f6539a700 1 --2- 172.21.15.17:0/479496881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b37040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.606+0000 7f5f6539a700 1 -- 172.21.15.17:0/479496881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b3d2d0 msgr2=0x559660b58cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.606+0000 7f5f6539a700 1 --2- 172.21.15.17:0/479496881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b3d2d0 0x559660b58cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.606+0000 7f5f6539a700 1 -- 172.21.15.17:0/479496881 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596608dd1f0 con 0x559660b37580 2023-07-14T13:24:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.606+0000 7f5f6539a700 1 --2- 172.21.15.17:0/479496881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b335b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5f50005620 tx=0x7f5f50011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=192cca5b327fac6d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.606+0000 7f5f65b9b700 1 --2- 172.21.15.17:0/479496881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b37040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:24:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.606+0000 7f5f54bff700 1 -- 172.21.15.17:0/479496881 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50004260 con 0x559660b37580 2023-07-14T13:24:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.606+0000 7f5f54bff700 1 -- 172.21.15.17:0/479496881 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f50018390 con 0x559660b37580 2023-07-14T13:24:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.606+0000 7f5f54bff700 1 -- 172.21.15.17:0/479496881 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50004fe0 con 0x559660b37580 2023-07-14T13:24:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.607+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/479496881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 msgr2=0x559660b335b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.607+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/479496881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b335b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5f50005620 tx=0x7f5f50011440 comp rx=0 tx=0).stop 2023-07-14T13:24:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.608+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/479496881 shutdown_connections 2023-07-14T13:24:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.608+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/479496881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b3d2d0 0x559660b58cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.608+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/479496881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596609936b0 0x559660b37040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.608+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/479496881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559660b37580 0x559660b335b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.608+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/479496881 >> 172.21.15.17:0/479496881 conn(0x559660b2cbe0 msgr2=0x559660b5d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:30.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.608+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/479496881 shutdown_connections 2023-07-14T13:24:30.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.608+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/479496881 wait complete. 2023-07-14T13:24:30.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.608+0000 7f5f7b6deb80 1 -- start start 2023-07-14T13:24:30.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.609+0000 7f5f7b6deb80 1 Processor -- start 2023-07-14T13:24:30.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.609+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596609936b0 0x559660b39a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.609+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 0x559660b39f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.609+0000 7f5f7b6deb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660b3d2d0 0x559660bb0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.610+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660b59170 con 0x559660b37580 2023-07-14T13:24:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.610+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660b592e0 con 0x5596609936b0 2023-07-14T13:24:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.610+0000 7f5f7b6deb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559660bb0e70 con 0x559660b3d2d0 2023-07-14T13:24:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.610+0000 7f5f7b6deb80 10 client.0 _ll_register_callbacks cb 0x7f5f50009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:24:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.610+0000 7f5f65b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596609936b0 0x559660b39a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.610+0000 7f5f65b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596609936b0 0x559660b39a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:54014/0 (socket says 172.21.15.17:54014) 2023-07-14T13:24:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.610+0000 7f5f65b9b700 1 -- 172.21.15.17:0/1082145323 learned_addr learned my addr 172.21.15.17:0/1082145323 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.610+0000 7f5f6539a700 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 0x559660b39f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.610+0000 7f5f6639c700 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660b3d2d0 0x559660bb0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.611+0000 7f5f65b9b700 1 -- 172.21.15.17:0/1082145323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660b3d2d0 msgr2=0x559660bb0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:30.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.611+0000 7f5f65b9b700 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660b3d2d0 0x559660bb0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.611+0000 7f5f65b9b700 1 -- 172.21.15.17:0/1082145323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 msgr2=0x559660b39f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.611+0000 7f5f65b9b700 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 0x559660b39f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.611+0000 7f5f65b9b700 1 -- 172.21.15.17:0/1082145323 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f601a08f0 con 0x5596609936b0 2023-07-14T13:24:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.611+0000 7f5f6539a700 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 0x559660b39f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:24:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.611+0000 7f5f65b9b700 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596609936b0 0x559660b39a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009790 tx=0x7f5f5c0a36e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2b728cf22d72177 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:30.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.611+0000 7f5f497fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:24:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.611+0000 7f5f497fa700 1 -- 172.21.15.17:0/1082145323 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0dc030 con 0x5596609936b0 2023-07-14T13:24:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.611+0000 7f5f497fa700 1 -- 172.21.15.17:0/1082145323 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5f5c0a3af0 con 0x5596609936b0 2023-07-14T13:24:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.612+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/1082145323 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f500044e0 con 0x5596609936b0 2023-07-14T13:24:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.612+0000 7f5f497fa700 1 -- 172.21.15.17:0/1082145323 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f5c0a7b20 con 0x5596609936b0 2023-07-14T13:24:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.613+0000 7f5f7b6deb80 10 client.29153 fetch_fsmap learned FSMap version 58 2023-07-14T13:24:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.613+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/1082145323 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55966089fc00 con 0x5596609936b0 2023-07-14T13:24:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.613+0000 7f5f497fa700 1 -- 172.21.15.17:0/1082145323 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f500044e0 con 0x5596609936b0 2023-07-14T13:24:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.613+0000 7f5f497fa700 1 -- 172.21.15.17:0/1082145323 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 58) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f5f5c0a3d50 con 0x5596609936b0 2023-07-14T13:24:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.613+0000 7f5f7b6deb80 10 client.29153 fetch_fsmap finished waiting for FSMap version 58 2023-07-14T13:24:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.613+0000 7f5f7b6deb80 10 client.29153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:24:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.613+0000 7f5f7b6deb80 20 client.29153 populate_metadata read hostname 'smithi017' 2023-07-14T13:24:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.613+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660b39130 0x559660b57cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.614+0000 7f5f7b6deb80 4 client.29153 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:24:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.614+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/1082145323 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559660a43ff0 con 0x559660b39130 2023-07-14T13:24:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.614+0000 7f5f6539a700 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660b39130 0x559660b57cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.617+0000 7f5f6539a700 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660b39130 0x559660b57cc0 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29b70fc83bfe95e6 server_cookie=b46de0f361e26727 in_seq=0 out_seq=0 2023-07-14T13:24:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.617+0000 7f5f497fa700 10 client.29153 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.636+0000 7f5f497fa700 1 -- 172.21.15.17:0/1082145323 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559660a43ff0 con 0x559660b39130 2023-07-14T13:24:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.636+0000 7f5f497fa700 10 client.29153 handle_command_reply: tid=0 2023-07-14T13:24:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.636+0000 7f5f7b6deb80 1 client.29153 shutdown 2023-07-14T13:24:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.637+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/1082145323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596609936b0 msgr2=0x559660b39a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.637+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596609936b0 0x559660b39a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009790 tx=0x7f5f5c0a36e0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.640+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/1082145323 shutdown_connections 2023-07-14T13:24:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.640+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559660b39130 0x559660b57cc0 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.640+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559660b3d2d0 0x559660bb0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.640+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596609936b0 0x559660b39a30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.640+0000 7f5f7b6deb80 1 --2- 172.21.15.17:0/1082145323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559660b37580 0x559660b39f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.640+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/1082145323 >> 172.21.15.17:0/1082145323 conn(0x559660b2cbe0 msgr2=0x559660b3a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.640+0000 7f5f497fa700 0 client.29153 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.640+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/1082145323 shutdown_connections 2023-07-14T13:24:30.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.640+0000 7f5f7b6deb80 1 -- 172.21.15.17:0/1082145323 wait complete. 2023-07-14T13:24:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:24:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:24:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:24:30.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:24:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.644+0000 7f5f7b6deb80 20 client.29153 trim_cache size 0 max 16384 2023-07-14T13:24:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.646+0000 7f5f67dff700 1 -- 172.21.15.17:0/3255621629 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5f4c0a13c0 msgr2=0x7f5f4c0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.646+0000 7f5f67dff700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5f4c0a13c0 0x7f5f4c0a3870 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5f580116f0 tx=0x7f5f58009260 comp rx=0 tx=0).stop 2023-07-14T13:24:30.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.646+0000 7f5f67dff700 1 -- 172.21.15.17:0/3255621629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f60101fb0 msgr2=0x7f5f60199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:30.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.646+0000 7f5f67dff700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f60101fb0 0x7f5f60199b30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c009c10 tx=0x7f5f5c008fd0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.646+0000 7f5f67dff700 1 -- 172.21.15.17:0/3255621629 shutdown_connections 2023-07-14T13:24:30.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.646+0000 7f5f67dff700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5f4c0a13c0 0x7f5f4c0a3870 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.646+0000 7f5f67dff700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5f60106ff0 0x7f5f60194360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.646+0000 7f5f67dff700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f60101fb0 0x7f5f60199b30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.646+0000 7f5f67dff700 1 --2- 172.21.15.17:0/3255621629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5f60102950 0x7f5f6019a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:30.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.646+0000 7f5f67dff700 1 -- 172.21.15.17:0/3255621629 >> 172.21.15.17:0/3255621629 conn(0x7f5f600fd800 msgr2=0x7f5f601058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.647+0000 7f5f67dff700 1 -- 172.21.15.17:0/3255621629 shutdown_connections 2023-07-14T13:24:30.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:30.647+0000 7f5f67dff700 1 -- 172.21.15.17:0/3255621629 wait complete. 2023-07-14T13:24:31.729 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:31 smithi131 ceph-mon[96953]: pgmap v784: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 18 MiB/s wr, 1.55k op/s 2023-07-14T13:24:31.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:31 smithi017 ceph-mon[95536]: pgmap v784: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 18 MiB/s wr, 1.55k op/s 2023-07-14T13:24:31.931 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:31 smithi135 ceph-mon[97338]: pgmap v784: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 18 MiB/s wr, 1.55k op/s 2023-07-14T13:24:32.432 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 380.0 s, 706.2 tps, lat 142.569 ms stddev 38.136 2023-07-14T13:24:33.729 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:33 smithi131 ceph-mon[96953]: pgmap v785: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.49k op/s 2023-07-14T13:24:33.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:33 smithi017 ceph-mon[95536]: pgmap v785: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.49k op/s 2023-07-14T13:24:33.931 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:33 smithi135 ceph-mon[97338]: pgmap v785: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 1.49k op/s 2023-07-14T13:24:35.729 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:35 smithi131 ceph-mon[96953]: pgmap v786: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 1.22k op/s 2023-07-14T13:24:35.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:35 smithi017 ceph-mon[95536]: pgmap v786: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 1.22k op/s 2023-07-14T13:24:35.931 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:35 smithi135 ceph-mon[97338]: pgmap v786: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 1.22k op/s 2023-07-14T13:24:37.432 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 385.0 s, 575.8 tps, lat 173.199 ms stddev 42.412 2023-07-14T13:24:37.729 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:37 smithi131 ceph-mon[96953]: pgmap v787: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 21 MiB/s wr, 1.82k op/s 2023-07-14T13:24:37.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:37 smithi017 ceph-mon[95536]: pgmap v787: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 21 MiB/s wr, 1.82k op/s 2023-07-14T13:24:37.931 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:37 smithi135 ceph-mon[97338]: pgmap v787: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 21 MiB/s wr, 1.82k op/s 2023-07-14T13:24:39.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:39 smithi017 ceph-mon[95536]: pgmap v788: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.19k op/s 2023-07-14T13:24:39.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:39 smithi135 ceph-mon[97338]: pgmap v788: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.19k op/s 2023-07-14T13:24:39.981 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:39 smithi131 ceph-mon[96953]: pgmap v788: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.19k op/s 2023-07-14T13:24:41.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:41 smithi017 ceph-mon[95536]: pgmap v789: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:24:41.934 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:41 smithi135 ceph-mon[97338]: pgmap v789: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:24:41.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:41 smithi131 ceph-mon[96953]: pgmap v789: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 17 MiB/s wr, 1.52k op/s 2023-07-14T13:24:42.432 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 390.0 s, 589.2 tps, lat 170.062 ms stddev 45.483 2023-07-14T13:24:42.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:42 smithi017 ceph-mon[95536]: pgmap v790: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.48k op/s 2023-07-14T13:24:42.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:42 smithi135 ceph-mon[97338]: pgmap v790: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.48k op/s 2023-07-14T13:24:42.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:42 smithi131 ceph-mon[96953]: pgmap v790: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 1.48k op/s 2023-07-14T13:24:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.885+0000 7f184f7ff700 1 -- 172.21.15.17:0/1932403563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f184806bb70 msgr2=0x7f184806bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.885+0000 7f184f7ff700 1 --2- 172.21.15.17:0/1932403563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f184806bb70 0x7f184806bf40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f184000b0a0 tx=0x7f184000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.885+0000 7f184f7ff700 1 -- 172.21.15.17:0/1932403563 shutdown_connections 2023-07-14T13:24:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.885+0000 7f184f7ff700 1 --2- 172.21.15.17:0/1932403563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f18481192c0 0x7f184811b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.885+0000 7f184f7ff700 1 --2- 172.21.15.17:0/1932403563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f184806bb70 0x7f184806bf40 secure :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f184000b0a0 tx=0x7f184000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.885+0000 7f184f7ff700 1 --2- 172.21.15.17:0/1932403563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f184806c480 0x7f1848118d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.885+0000 7f184f7ff700 1 -- 172.21.15.17:0/1932403563 >> 172.21.15.17:0/1932403563 conn(0x7f184806a940 msgr2=0x7f184806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:43.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.888+0000 7f184f7ff700 1 -- 172.21.15.17:0/1932403563 shutdown_connections 2023-07-14T13:24:43.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.888+0000 7f184f7ff700 1 -- 172.21.15.17:0/1932403563 wait complete. 2023-07-14T13:24:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.890+0000 7f184f7ff700 1 Processor -- start 2023-07-14T13:24:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.890+0000 7f184f7ff700 1 -- start start 2023-07-14T13:24:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.891+0000 7f184f7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184806c480 0x7f18481a4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.891+0000 7f184f7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18481192c0 0x7f18481a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.891+0000 7f184f7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18481a9970 0x7f18481a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.891+0000 7f184f7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18481aa3e0 con 0x7f18481a9970 2023-07-14T13:24:43.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.891+0000 7f184f7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18481aa550 con 0x7f18481192c0 2023-07-14T13:24:43.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.891+0000 7f184f7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18481aa710 con 0x7f184806c480 2023-07-14T13:24:43.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.891+0000 7f184cd9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18481192c0 0x7f18481a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.892+0000 7f184cd9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18481192c0 0x7f18481a5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:38134/0 (socket says 172.21.15.17:38134) 2023-07-14T13:24:43.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.892+0000 7f184cd9a700 1 -- 172.21.15.17:0/543250398 learned_addr learned my addr 172.21.15.17:0/543250398 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:43.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.892+0000 7f184dd9c700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18481a9970 0x7f18481a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.892+0000 7f184d59b700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184806c480 0x7f18481a4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.892+0000 7f184cd9a700 1 -- 172.21.15.17:0/543250398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184806c480 msgr2=0x7f18481a4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:43.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.892+0000 7f184cd9a700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184806c480 0x7f18481a4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.892+0000 7f184cd9a700 1 -- 172.21.15.17:0/543250398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18481a9970 msgr2=0x7f18481a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:43.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.892+0000 7f184cd9a700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18481a9970 0x7f18481a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.892+0000 7f184cd9a700 1 -- 172.21.15.17:0/543250398 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1840009d00 con 0x7f18481192c0 2023-07-14T13:24:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.892+0000 7f184d59b700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184806c480 0x7f18481a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:24:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.893+0000 7f184cd9a700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18481192c0 0x7f18481a5300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f184400b530 tx=0x7f184400b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.893+0000 7f184dd9c700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18481a9970 0x7f18481a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:24:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.894+0000 7f183e7fc700 1 -- 172.21.15.17:0/543250398 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844011830 con 0x7f18481192c0 2023-07-14T13:24:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.894+0000 7f183e7fc700 1 -- 172.21.15.17:0/543250398 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1844011e20 con 0x7f18481192c0 2023-07-14T13:24:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.894+0000 7f183e7fc700 1 -- 172.21.15.17:0/543250398 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844010df0 con 0x7f18481192c0 2023-07-14T13:24:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.894+0000 7f184f7ff700 1 -- 172.21.15.17:0/543250398 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18481b1c80 con 0x7f18481192c0 2023-07-14T13:24:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.894+0000 7f184f7ff700 1 -- 172.21.15.17:0/543250398 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18481b2110 con 0x7f18481192c0 2023-07-14T13:24:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.902+0000 7f1863165b80 1 Processor -- start 2023-07-14T13:24:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.902+0000 7f183e7fc700 1 -- 172.21.15.17:0/543250398 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1844011990 con 0x7f18481192c0 2023-07-14T13:24:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.904+0000 7f183e7fc700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f18340a1450 0x7f18340a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.904+0000 7f183e7fc700 1 -- 172.21.15.17:0/543250398 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f18440cc670 con 0x7f18481192c0 2023-07-14T13:24:43.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.905+0000 7f1863165b80 1 -- start start 2023-07-14T13:24:43.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.906+0000 7f1863165b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa8156b0 0x5564fa9bed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.906+0000 7f1863165b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa9bf2d0 0x5564fa9b9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.906+0000 7f1863165b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9b9580 0x5564fa9b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.906+0000 7f1863165b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fa8bec50 con 0x5564fa9b9580 2023-07-14T13:24:43.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.906+0000 7f1863165b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fa9119e0 con 0x5564fa9bf2d0 2023-07-14T13:24:43.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.906+0000 7f1863165b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fa90ae70 con 0x5564fa8156b0 2023-07-14T13:24:43.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.907+0000 7f184cd9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa9bf2d0 0x5564fa9b9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.907+0000 7f184cd9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa9bf2d0 0x5564fa9b9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:38136/0 (socket says 172.21.15.17:38136) 2023-07-14T13:24:43.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.907+0000 7f184cd9a700 1 -- 172.21.15.17:0/1350134916 learned_addr learned my addr 172.21.15.17:0/1350134916 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.908+0000 7f184d59b700 1 --2- 172.21.15.17:0/1350134916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa8156b0 0x5564fa9bed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.908+0000 7f184cd9a700 1 -- 172.21.15.17:0/1350134916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa8156b0 msgr2=0x5564fa9bed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.908+0000 7f184cd9a700 1 --2- 172.21.15.17:0/1350134916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa8156b0 0x5564fa9bed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.908+0000 7f184cd9a700 1 -- 172.21.15.17:0/1350134916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9b9580 msgr2=0x5564fa9b99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.908+0000 7f184cd9a700 1 --2- 172.21.15.17:0/1350134916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9b9580 0x5564fa9b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.909+0000 7f184cd9a700 1 -- 172.21.15.17:0/1350134916 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564fa738d80 con 0x5564fa9bf2d0 2023-07-14T13:24:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.909+0000 7f184dd9c700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f18340a1450 0x7f18340a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.910+0000 7f184cd9a700 1 --2- 172.21.15.17:0/1350134916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa9bf2d0 0x5564fa9b9040 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1844096280 tx=0x7f1844004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cefd5bdb7b57943 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.910+0000 7f18337fe700 1 -- 172.21.15.17:0/1350134916 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844010380 con 0x5564fa9bf2d0 2023-07-14T13:24:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.910+0000 7f18337fe700 1 -- 172.21.15.17:0/1350134916 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1844011c40 con 0x5564fa9bf2d0 2023-07-14T13:24:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.910+0000 7f18337fe700 1 -- 172.21.15.17:0/1350134916 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440b9310 con 0x5564fa9bf2d0 2023-07-14T13:24:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.911+0000 7f1863165b80 1 -- 172.21.15.17:0/1350134916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa9bf2d0 msgr2=0x5564fa9b9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.911+0000 7f1863165b80 1 --2- 172.21.15.17:0/1350134916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa9bf2d0 0x5564fa9b9040 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1844096280 tx=0x7f1844004750 comp rx=0 tx=0).stop 2023-07-14T13:24:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.912+0000 7f184dd9c700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f18340a1450 0x7f18340a3900 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1848071ab0 tx=0x7f183800c350 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.912+0000 7f1863165b80 1 -- 172.21.15.17:0/1350134916 shutdown_connections 2023-07-14T13:24:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.912+0000 7f1863165b80 1 --2- 172.21.15.17:0/1350134916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9b9580 0x5564fa9b99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.912+0000 7f1863165b80 1 --2- 172.21.15.17:0/1350134916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa8156b0 0x5564fa9bed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.912+0000 7f1863165b80 1 --2- 172.21.15.17:0/1350134916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa9bf2d0 0x5564fa9b9040 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.912+0000 7f1863165b80 1 -- 172.21.15.17:0/1350134916 >> 172.21.15.17:0/1350134916 conn(0x5564fa9aebe0 msgr2=0x5564fa9b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.912+0000 7f1863165b80 1 -- 172.21.15.17:0/1350134916 shutdown_connections 2023-07-14T13:24:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.913+0000 7f1863165b80 1 -- 172.21.15.17:0/1350134916 wait complete. 2023-07-14T13:24:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.913+0000 7f1863165b80 1 -- start start 2023-07-14T13:24:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.914+0000 7f1863165b80 1 Processor -- start 2023-07-14T13:24:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.915+0000 7f1863165b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564fa9c29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.915+0000 7f1863165b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564fa9c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.915+0000 7f1863165b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9bf2d0 0x5564fa9c3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.915+0000 7f1863165b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fa8aaa60 con 0x5564fa9bf2d0 2023-07-14T13:24:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.915+0000 7f1863165b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fa8aa760 con 0x5564fa8156b0 2023-07-14T13:24:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.915+0000 7f1863165b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fa78e8c0 con 0x5564fa9b9580 2023-07-14T13:24:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.915+0000 7f1863165b80 10 client.0 _ll_register_callbacks cb 0x5564fa8a8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:24:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.916+0000 7f184dd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9bf2d0 0x5564fa9c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.916+0000 7f184dd9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9bf2d0 0x5564fa9c3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54522/0 (socket says 172.21.15.17:54522) 2023-07-14T13:24:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.916+0000 7f184dd9c700 1 -- 172.21.15.17:0/1502666202 learned_addr learned my addr 172.21.15.17:0/1502666202 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.916+0000 7f184cd9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564fa9c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.917+0000 7f184cd9a700 1 -- 172.21.15.17:0/1502666202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 msgr2=0x5564fa9c29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.917+0000 7f184cd9a700 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564fa9c29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.917+0000 7f184cd9a700 1 -- 172.21.15.17:0/1502666202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9bf2d0 msgr2=0x5564fa9c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.917+0000 7f184cd9a700 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9bf2d0 0x5564fa9c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.917+0000 7f184cd9a700 1 -- 172.21.15.17:0/1502666202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18481b2110 con 0x5564fa9b9580 2023-07-14T13:24:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.918+0000 7f184cd9a700 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564fa9c2f30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x5564fa9b5b40 tx=0x7f1844004860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1beca2b829e7d2e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.918+0000 7f1830ff9700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:24:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.918+0000 7f1830ff9700 1 -- 172.21.15.17:0/1502666202 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440a1c60 con 0x5564fa9b9580 2023-07-14T13:24:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.919+0000 7f1830ff9700 1 -- 172.21.15.17:0/1502666202 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f18440b7e40 con 0x5564fa9b9580 2023-07-14T13:24:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.919+0000 7f184dd9c700 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9bf2d0 0x5564fa9c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:24:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.919+0000 7f1863165b80 1 -- 172.21.15.17:0/1502666202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564fa864490 con 0x5564fa9b9580 2023-07-14T13:24:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.920+0000 7f1830ff9700 1 -- 172.21.15.17:0/1502666202 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1844010380 con 0x5564fa9b9580 2023-07-14T13:24:43.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.924+0000 7f1863165b80 10 client.29125 fetch_fsmap learned FSMap version 58 2023-07-14T13:24:43.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.924+0000 7f1863165b80 1 -- 172.21.15.17:0/1502666202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x5564fa721c00 con 0x5564fa9b9580 2023-07-14T13:24:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.925+0000 7f1830ff9700 1 -- 172.21.15.17:0/1502666202 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5564fa864490 con 0x5564fa9b9580 2023-07-14T13:24:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.925+0000 7f1830ff9700 1 -- 172.21.15.17:0/1502666202 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 58) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f18440a18a0 con 0x5564fa9b9580 2023-07-14T13:24:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.925+0000 7f1863165b80 10 client.29125 fetch_fsmap finished waiting for FSMap version 58 2023-07-14T13:24:43.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.925+0000 7f1863165b80 10 client.29125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:24:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.925+0000 7f1863165b80 20 client.29125 populate_metadata read hostname 'smithi017' 2023-07-14T13:24:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.925+0000 7f1863165b80 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5564fa9d2980 0x5564fa9d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.925+0000 7f1863165b80 4 client.29125 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:24:43.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.925+0000 7f1863165b80 1 -- 172.21.15.17:0/1502666202 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564fa903e50 con 0x5564fa9d2980 2023-07-14T13:24:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.926+0000 7f184d59b700 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5564fa9d2980 0x5564fa9d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.927+0000 7f184d59b700 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5564fa9d2980 0x5564fa9d4d90 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e89f52d6c5788a1 server_cookie=ad8bcd3e3472cd20 in_seq=0 out_seq=0 2023-07-14T13:24:43.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.927+0000 7f1830ff9700 10 client.29125 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.927+0000 7f1830ff9700 1 -- 172.21.15.17:0/1502666202 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5564fa903e50 con 0x5564fa9d2980 2023-07-14T13:24:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.927+0000 7f1830ff9700 10 client.29125 handle_command_reply: tid=0 2023-07-14T13:24:43.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.928+0000 7f1863165b80 1 client.29125 shutdown 2023-07-14T13:24:43.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.933+0000 7f1863165b80 1 -- 172.21.15.17:0/1502666202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 msgr2=0x5564fa9c2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:43.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.933+0000 7f1863165b80 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564fa9c2f30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x5564fa9b5b40 tx=0x7f1844004860 comp rx=0 tx=0).stop 2023-07-14T13:24:43.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.933+0000 7f1863165b80 1 -- 172.21.15.17:0/1502666202 shutdown_connections 2023-07-14T13:24:43.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.933+0000 7f1863165b80 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5564fa9d2980 0x5564fa9d4d90 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.933+0000 7f1863165b80 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9bf2d0 0x5564fa9c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.933+0000 7f1863165b80 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564fa9c29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.933+0000 7f1863165b80 1 --2- 172.21.15.17:0/1502666202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564fa9c2f30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.933+0000 7f1863165b80 1 -- 172.21.15.17:0/1502666202 >> 172.21.15.17:0/1502666202 conn(0x5564fa9aebe0 msgr2=0x5564fa9b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:43.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.934+0000 7f1830ff9700 0 client.29125 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:43.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.934+0000 7f1863165b80 1 -- 172.21.15.17:0/1502666202 shutdown_connections 2023-07-14T13:24:43.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.935+0000 7f1863165b80 1 -- 172.21.15.17:0/1502666202 wait complete. 2023-07-14T13:24:43.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.935+0000 7f1863165b80 20 client.29125 trim_cache size 0 max 16384 2023-07-14T13:24:43.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.966+0000 7f1863165b80 1 Processor -- start 2023-07-14T13:24:43.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.966+0000 7f1863165b80 1 -- start start 2023-07-14T13:24:43.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.967+0000 7f1863165b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9aebe0 0x5564fa9b9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.967+0000 7f1863165b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564fa9c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.980 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.967+0000 7f1863165b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564fa9be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.967+0000 7f1863165b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fa9c3f60 con 0x5564fa9aebe0 2023-07-14T13:24:43.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.967+0000 7f1863165b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fa9ba000 con 0x5564fa8156b0 2023-07-14T13:24:43.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.967+0000 7f1863165b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564fa9b4a00 con 0x5564fa9b9580 2023-07-14T13:24:43.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.967+0000 7f184cd9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564fa9c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.968+0000 7f184cd9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564fa9c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:38158/0 (socket says 172.21.15.17:38158) 2023-07-14T13:24:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.968+0000 7f184cd9a700 1 -- 172.21.15.17:0/435050643 learned_addr learned my addr 172.21.15.17:0/435050643 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.968+0000 7f184dd9c700 1 --2- 172.21.15.17:0/435050643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564fa9be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.968+0000 7f184cd9a700 1 -- 172.21.15.17:0/435050643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 msgr2=0x5564fa9be2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.968+0000 7f184cd9a700 1 --2- 172.21.15.17:0/435050643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564fa9be2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.968+0000 7f184cd9a700 1 -- 172.21.15.17:0/435050643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9aebe0 msgr2=0x5564fa9b9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:43.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.968+0000 7f184cd9a700 1 --2- 172.21.15.17:0/435050643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9aebe0 0x5564fa9b9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.968+0000 7f184cd9a700 1 -- 172.21.15.17:0/435050643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564fa9b9c20 con 0x5564fa8156b0 2023-07-14T13:24:43.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.968+0000 7f184cd9a700 1 --2- 172.21.15.17:0/435050643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564fa9c9c70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f18440992e0 tx=0x7f1844011f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3505ea255aaf589 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:43.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.969+0000 7f1833fff700 1 -- 172.21.15.17:0/435050643 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440a1c60 con 0x5564fa8156b0 2023-07-14T13:24:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.969+0000 7f1833fff700 1 -- 172.21.15.17:0/435050643 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f184400d040 con 0x5564fa8156b0 2023-07-14T13:24:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.969+0000 7f1833fff700 1 -- 172.21.15.17:0/435050643 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184409d840 con 0x5564fa8156b0 2023-07-14T13:24:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.970+0000 7f1863165b80 1 -- 172.21.15.17:0/435050643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 msgr2=0x5564fa9c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.970+0000 7f1863165b80 1 --2- 172.21.15.17:0/435050643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564fa9c9c70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f18440992e0 tx=0x7f1844011f90 comp rx=0 tx=0).stop 2023-07-14T13:24:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.970+0000 7f1863165b80 1 -- 172.21.15.17:0/435050643 shutdown_connections 2023-07-14T13:24:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.970+0000 7f1863165b80 1 --2- 172.21.15.17:0/435050643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564fa9be2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.970+0000 7f1863165b80 1 --2- 172.21.15.17:0/435050643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9aebe0 0x5564fa9b9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.970+0000 7f1863165b80 1 --2- 172.21.15.17:0/435050643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564fa9c9c70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.970+0000 7f1863165b80 1 -- 172.21.15.17:0/435050643 >> 172.21.15.17:0/435050643 conn(0x5564fa9c3560 msgr2=0x5564fa9bdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.971+0000 7f1863165b80 1 -- 172.21.15.17:0/435050643 shutdown_connections 2023-07-14T13:24:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.972+0000 7f1863165b80 1 -- 172.21.15.17:0/435050643 wait complete. 2023-07-14T13:24:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.972+0000 7f1863165b80 1 -- start start 2023-07-14T13:24:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.972+0000 7f1863165b80 1 Processor -- start 2023-07-14T13:24:43.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.973+0000 7f1863165b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564faa1f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.973+0000 7f1863165b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9aebe0 0x5564faa1fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.973+0000 7f1863165b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564faa20260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.973+0000 7f1863165b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564faa1a940 con 0x5564fa9aebe0 2023-07-14T13:24:43.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.973+0000 7f1863165b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564faa1aab0 con 0x5564fa8156b0 2023-07-14T13:24:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.973+0000 7f1863165b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564faa1ac70 con 0x5564fa9b9580 2023-07-14T13:24:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.973+0000 7f1863165b80 10 client.0 _ll_register_callbacks cb 0x7f184000b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:24:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.974+0000 7f184d59b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564faa1f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.975+0000 7f184cd9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9aebe0 0x5564faa1fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.975+0000 7f184cd9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9aebe0 0x5564faa1fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54540/0 (socket says 172.21.15.17:54540) 2023-07-14T13:24:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.975+0000 7f184cd9a700 1 -- 172.21.15.17:0/3166944566 learned_addr learned my addr 172.21.15.17:0/3166944566 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:43.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.975+0000 7f184dd9c700 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564faa20260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.976+0000 7f184d59b700 1 -- 172.21.15.17:0/3166944566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 msgr2=0x5564faa20260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:43.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.976+0000 7f184d59b700 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564faa20260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.976+0000 7f184d59b700 1 -- 172.21.15.17:0/3166944566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9aebe0 msgr2=0x5564faa1fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:43.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.976+0000 7f184d59b700 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9aebe0 0x5564faa1fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:43.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.976+0000 7f184d59b700 1 -- 172.21.15.17:0/3166944566 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564fa721c00 con 0x5564fa8156b0 2023-07-14T13:24:43.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.976+0000 7f184cd9a700 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9aebe0 0x5564faa1fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:24:43.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.976+0000 7f184d59b700 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564faa1f7e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1840008000 tx=0x7f18400091b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6454883942263aa2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:43.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.976+0000 7f1830ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:24:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.977+0000 7f1830ff9700 1 -- 172.21.15.17:0/3166944566 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840027070 con 0x5564fa8156b0 2023-07-14T13:24:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.977+0000 7f1830ff9700 1 -- 172.21.15.17:0/3166944566 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f18400074e0 con 0x5564fa8156b0 2023-07-14T13:24:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.977+0000 7f1863165b80 1 -- 172.21.15.17:0/3166944566 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564fa8c5ff0 con 0x5564fa8156b0 2023-07-14T13:24:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.977+0000 7f1830ff9700 1 -- 172.21.15.17:0/3166944566 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f184000e040 con 0x5564fa8156b0 2023-07-14T13:24:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.977+0000 7f1863165b80 10 client.29168 fetch_fsmap learned FSMap version 58 2023-07-14T13:24:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.977+0000 7f1863165b80 1 -- 172.21.15.17:0/3166944566 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x5564fa75f1f0 con 0x5564fa8156b0 2023-07-14T13:24:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.978+0000 7f1830ff9700 1 -- 172.21.15.17:0/3166944566 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5564fa8c5ff0 con 0x5564fa8156b0 2023-07-14T13:24:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.978+0000 7f1830ff9700 1 -- 172.21.15.17:0/3166944566 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 58) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f184000b0d0 con 0x5564fa8156b0 2023-07-14T13:24:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.978+0000 7f1863165b80 10 client.29168 fetch_fsmap finished waiting for FSMap version 58 2023-07-14T13:24:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.978+0000 7f1863165b80 10 client.29168 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:24:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.978+0000 7f1863165b80 20 client.29168 populate_metadata read hostname 'smithi017' 2023-07-14T13:24:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.978+0000 7f1863165b80 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5564fa9bf2d0 0x5564faa3a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.978+0000 7f1863165b80 4 client.29168 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:24:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.978+0000 7f1863165b80 1 -- 172.21.15.17:0/3166944566 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5564fa759f10 con 0x5564fa9bf2d0 2023-07-14T13:24:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.978+0000 7f184cd9a700 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5564fa9bf2d0 0x5564faa3a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.979+0000 7f184cd9a700 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5564fa9bf2d0 0x5564faa3a310 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb09a1469e5312a2 server_cookie=46b9371bb8be4f97 in_seq=0 out_seq=0 2023-07-14T13:24:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.979+0000 7f1830ff9700 10 client.29168 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.994+0000 7f1830ff9700 1 -- 172.21.15.17:0/3166944566 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5564fa759f10 con 0x5564fa9bf2d0 2023-07-14T13:24:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.994+0000 7f1830ff9700 10 client.29168 handle_command_reply: tid=0 2023-07-14T13:24:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.994+0000 7f1863165b80 1 client.29168 shutdown 2023-07-14T13:24:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.995+0000 7f1863165b80 1 -- 172.21.15.17:0/3166944566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 msgr2=0x5564faa1f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.995+0000 7f1863165b80 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564faa1f7e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1840008000 tx=0x7f18400091b0 comp rx=0 tx=0).stop 2023-07-14T13:24:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.995+0000 7f1863165b80 1 -- 172.21.15.17:0/3166944566 shutdown_connections 2023-07-14T13:24:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.995+0000 7f1863165b80 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5564fa9bf2d0 0x5564faa3a310 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:44.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.995+0000 7f1863165b80 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564fa9b9580 0x5564faa20260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.995+0000 7f1863165b80 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564fa8156b0 0x5564faa1f7e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.995+0000 7f1863165b80 1 --2- 172.21.15.17:0/3166944566 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5564fa9aebe0 0x5564faa1fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.995+0000 7f1830ff9700 0 client.29168 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.995+0000 7f1863165b80 1 -- 172.21.15.17:0/3166944566 >> 172.21.15.17:0/3166944566 conn(0x5564fa9c3560 msgr2=0x5564fa9be470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.995+0000 7f1863165b80 1 -- 172.21.15.17:0/3166944566 shutdown_connections 2023-07-14T13:24:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.996+0000 7f1863165b80 1 -- 172.21.15.17:0/3166944566 wait complete. 2023-07-14T13:24:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.996+0000 7f1863165b80 20 client.29168 trim_cache size 0 max 16384 2023-07-14T13:24:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:24:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:24:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:24:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:24:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.997+0000 7f184f7ff700 1 -- 172.21.15.17:0/543250398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f18340a1450 msgr2=0x7f18340a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.997+0000 7f184f7ff700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f18340a1450 0x7f18340a3900 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1848071ab0 tx=0x7f183800c350 comp rx=0 tx=0).stop 2023-07-14T13:24:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.997+0000 7f184f7ff700 1 -- 172.21.15.17:0/543250398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18481192c0 msgr2=0x7f18481a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.997+0000 7f184f7ff700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18481192c0 0x7f18481a5300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f184400b530 tx=0x7f184400b8f0 comp rx=0 tx=0).stop 2023-07-14T13:24:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.998+0000 7f184f7ff700 1 -- 172.21.15.17:0/543250398 shutdown_connections 2023-07-14T13:24:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.998+0000 7f184f7ff700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f18340a1450 0x7f18340a3900 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.998+0000 7f184f7ff700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18481a9970 0x7f18481a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.998+0000 7f184f7ff700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f184806c480 0x7f18481a4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.998+0000 7f184f7ff700 1 --2- 172.21.15.17:0/543250398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18481192c0 0x7f18481a5300 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.998+0000 7f184f7ff700 1 -- 172.21.15.17:0/543250398 >> 172.21.15.17:0/543250398 conn(0x7f184806a940 msgr2=0x7f1848109520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.999+0000 7f184f7ff700 1 -- 172.21.15.17:0/543250398 shutdown_connections 2023-07-14T13:24:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:43.999+0000 7f184f7ff700 1 -- 172.21.15.17:0/543250398 wait complete. 2023-07-14T13:24:45.680 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:45 smithi135 ceph-mon[97338]: pgmap v791: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 1.22k op/s 2023-07-14T13:24:45.729 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:45 smithi131 ceph-mon[96953]: pgmap v791: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 1.22k op/s 2023-07-14T13:24:45.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:45 smithi017 ceph-mon[95536]: pgmap v791: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 1.22k op/s 2023-07-14T13:24:47.431 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 395.0 s, 583.0 tps, lat 169.491 ms stddev 93.349 2023-07-14T13:24:47.729 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:47 smithi131 ceph-mon[96953]: pgmap v792: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 21 MiB/s wr, 1.85k op/s 2023-07-14T13:24:47.729 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:47 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:24:47.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:47 smithi017 ceph-mon[95536]: pgmap v792: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 21 MiB/s wr, 1.85k op/s 2023-07-14T13:24:47.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:47 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:24:48.538 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:47 smithi135 ceph-mon[97338]: pgmap v792: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 21 MiB/s wr, 1.85k op/s 2023-07-14T13:24:48.538 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:47 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:24:49.729 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:49 smithi131 ceph-mon[96953]: pgmap v793: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:24:49.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:49 smithi017 ceph-mon[95536]: pgmap v793: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:24:49.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:49 smithi135 ceph-mon[97338]: pgmap v793: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-14T13:24:51.728 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:51 smithi131 ceph-mon[96953]: pgmap v794: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.58k op/s 2023-07-14T13:24:51.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:51 smithi017 ceph-mon[95536]: pgmap v794: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.58k op/s 2023-07-14T13:24:51.932 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:51 smithi135 ceph-mon[97338]: pgmap v794: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.58k op/s 2023-07-14T13:24:52.431 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 400.0 s, 581.0 tps, lat 174.409 ms stddev 55.566 2023-07-14T13:24:53.729 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:53 smithi131 ceph-mon[96953]: pgmap v795: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.53k op/s 2023-07-14T13:24:53.730 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:53 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:24:53.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:53 smithi017 ceph-mon[95536]: pgmap v795: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.53k op/s 2023-07-14T13:24:53.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:53 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:24:54.071 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:53 smithi135 ceph-mon[97338]: pgmap v795: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 1.53k op/s 2023-07-14T13:24:54.072 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:53 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:24:55.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:55 smithi017 ceph-mon[95536]: pgmap v796: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-07-14T13:24:55.846 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:55 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:24:55.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:55 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:24:55.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:55 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:24:55.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:55 smithi135 ceph-mon[97338]: pgmap v796: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-07-14T13:24:55.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:55 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:24:55.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:55 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:24:55.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:55 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:24:55.978 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:55 smithi131 ceph-mon[96953]: pgmap v796: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-07-14T13:24:55.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:55 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:24:55.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:55 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:24:55.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:55 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:24:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.262+0000 7f79521ff700 1 -- 172.21.15.17:0/3234608983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f794c104e50 msgr2=0x7f794c10ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.262+0000 7f79521ff700 1 --2- 172.21.15.17:0/3234608983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f794c104e50 0x7f794c10ca00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7944009920 tx=0x7f7944009c30 comp rx=0 tx=0).stop 2023-07-14T13:24:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.262+0000 7f79521ff700 1 -- 172.21.15.17:0/3234608983 shutdown_connections 2023-07-14T13:24:57.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.262+0000 7f79521ff700 1 --2- 172.21.15.17:0/3234608983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f794c104e50 0x7f794c10ca00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.262+0000 7f79521ff700 1 --2- 172.21.15.17:0/3234608983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c067c10 0x7f794c067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.262+0000 7f79521ff700 1 --2- 172.21.15.17:0/3234608983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f794c0685b0 0x7f794c104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.262+0000 7f79521ff700 1 -- 172.21.15.17:0/3234608983 >> 172.21.15.17:0/3234608983 conn(0x7f794c074760 msgr2=0x7f794c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.262+0000 7f79521ff700 1 -- 172.21.15.17:0/3234608983 shutdown_connections 2023-07-14T13:24:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.262+0000 7f79521ff700 1 -- 172.21.15.17:0/3234608983 wait complete. 2023-07-14T13:24:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.264+0000 7f79521ff700 1 Processor -- start 2023-07-14T13:24:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.264+0000 7f79521ff700 1 -- start start 2023-07-14T13:24:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.264+0000 7f79521ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f794c067c10 0x7f794c10c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.264+0000 7f79521ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0685b0 0x7f794c109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.264+0000 7f79521ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f794c104e50 0x7f794c109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.264+0000 7f79521ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c10a3c0 con 0x7f794c067c10 2023-07-14T13:24:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.264+0000 7f79521ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c10a530 con 0x7f794c104e50 2023-07-14T13:24:57.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.264+0000 7f79521ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c1a88c0 con 0x7f794c0685b0 2023-07-14T13:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.265+0000 7f794b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f794c067c10 0x7f794c10c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.265+0000 7f794b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f794c067c10 0x7f794c10c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53322/0 (socket says 172.21.15.17:53322) 2023-07-14T13:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.265+0000 7f794b7fe700 1 -- 172.21.15.17:0/946146774 learned_addr learned my addr 172.21.15.17:0/946146774 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.265+0000 7f794bfff700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f794c104e50 0x7f794c109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.265+0000 7f7942ffd700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0685b0 0x7f794c109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.266+0000 7f7942ffd700 1 -- 172.21.15.17:0/946146774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f794c104e50 msgr2=0x7f794c109bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.266+0000 7f7942ffd700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f794c104e50 0x7f794c109bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.266+0000 7f7942ffd700 1 -- 172.21.15.17:0/946146774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f794c067c10 msgr2=0x7f794c10c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.266+0000 7f7942ffd700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f794c067c10 0x7f794c10c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.266+0000 7f7942ffd700 1 -- 172.21.15.17:0/946146774 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7944009520 con 0x7f794c0685b0 2023-07-14T13:24:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.266+0000 7f794b7fe700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f794c067c10 0x7f794c10c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:24:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.266+0000 7f7942ffd700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0685b0 0x7f794c109670 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f794c068980 tx=0x7f793400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.267+0000 7f79497fa700 1 -- 172.21.15.17:0/946146774 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934010900 con 0x7f794c0685b0 2023-07-14T13:24:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.267+0000 7f79497fa700 1 -- 172.21.15.17:0/946146774 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7934018420 con 0x7f794c0685b0 2023-07-14T13:24:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.267+0000 7f79521ff700 1 -- 172.21.15.17:0/946146774 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c1a8ba0 con 0x7f794c0685b0 2023-07-14T13:24:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.267+0000 7f79497fa700 1 -- 172.21.15.17:0/946146774 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934018ea0 con 0x7f794c0685b0 2023-07-14T13:24:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.267+0000 7f79521ff700 1 -- 172.21.15.17:0/946146774 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c1a90b0 con 0x7f794c0685b0 2023-07-14T13:24:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.272+0000 7f79497fa700 1 -- 172.21.15.17:0/946146774 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f7934018590 con 0x7f794c0685b0 2023-07-14T13:24:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.274+0000 7f7965a37b80 1 Processor -- start 2023-07-14T13:24:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.274+0000 7f7965a37b80 1 -- start start 2023-07-14T13:24:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.275+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 0x55d8584d6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.275+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d72d0 0x55d8584d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.275+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.275+0000 7f7965a37b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8583d6c50 con 0x55d85832d6b0 2023-07-14T13:24:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.275+0000 7f7965a37b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8584299e0 con 0x55d8584d1580 2023-07-14T13:24:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.275+0000 7f7965a37b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d858422e70 con 0x55d8584d72d0 2023-07-14T13:24:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.275+0000 7f794bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 0x55d8584d6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.275+0000 7f794bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 0x55d8584d6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53332/0 (socket says 172.21.15.17:53332) 2023-07-14T13:24:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.275+0000 7f794bfff700 1 -- 172.21.15.17:0/1681816124 learned_addr learned my addr 172.21.15.17:0/1681816124 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.276+0000 7f7942ffd700 1 --2- 172.21.15.17:0/1681816124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.276+0000 7f794bfff700 1 -- 172.21.15.17:0/1681816124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d72d0 msgr2=0x55d8584d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.276+0000 7f794bfff700 1 --2- 172.21.15.17:0/1681816124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d72d0 0x55d8584d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.276+0000 7f79497fa700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79380a1410 0x7f79380a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.276+0000 7f794bfff700 1 -- 172.21.15.17:0/1681816124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 msgr2=0x55d8584d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.276+0000 7f794bfff700 1 --2- 172.21.15.17:0/1681816124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584d19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.276+0000 7f794bfff700 1 -- 172.21.15.17:0/1681816124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d858250d80 con 0x55d85832d6b0 2023-07-14T13:24:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.277+0000 7f79497fa700 1 -- 172.21.15.17:0/946146774 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7934014070 con 0x7f794c0685b0 2023-07-14T13:24:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.277+0000 7f794bfff700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79380a1410 0x7f79380a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.278+0000 7f794bfff700 1 --2- 172.21.15.17:0/1681816124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 0x55d8584d6d90 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f7944016000 tx=0x7f7944005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bff27b32912b2c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.279+0000 7f7941ffb700 1 -- 172.21.15.17:0/1681816124 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400f840 con 0x55d85832d6b0 2023-07-14T13:24:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.279+0000 7f7941ffb700 1 -- 172.21.15.17:0/1681816124 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f794401d040 con 0x55d85832d6b0 2023-07-14T13:24:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.279+0000 7f7941ffb700 1 -- 172.21.15.17:0/1681816124 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440054d0 con 0x55d85832d6b0 2023-07-14T13:24:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.280+0000 7f7965a37b80 1 -- 172.21.15.17:0/1681816124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 msgr2=0x55d8584d6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.280+0000 7f794bfff700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79380a1410 0x7f79380a38c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f794402b000 tx=0x7f794402e000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.280+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1681816124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 0x55d8584d6d90 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f7944016000 tx=0x7f7944005e00 comp rx=0 tx=0).stop 2023-07-14T13:24:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.280+0000 7f7965a37b80 1 -- 172.21.15.17:0/1681816124 shutdown_connections 2023-07-14T13:24:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.280+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1681816124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.280+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1681816124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 0x55d8584d6d90 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.280+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1681816124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d72d0 0x55d8584d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.280+0000 7f7965a37b80 1 -- 172.21.15.17:0/1681816124 >> 172.21.15.17:0/1681816124 conn(0x55d8584c6be0 msgr2=0x55d8584cbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.280+0000 7f7965a37b80 1 -- 172.21.15.17:0/1681816124 shutdown_connections 2023-07-14T13:24:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.280+0000 7f7965a37b80 1 -- 172.21.15.17:0/1681816124 wait complete. 2023-07-14T13:24:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.281+0000 7f7965a37b80 1 -- start start 2023-07-14T13:24:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.281+0000 7f7965a37b80 1 Processor -- start 2023-07-14T13:24:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.282+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 0x55d8584da900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.282+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584dae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.282+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d72d0 0x55d8584db380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.282+0000 7f7965a37b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8583c2a60 con 0x55d85832d6b0 2023-07-14T13:24:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.282+0000 7f7965a37b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8583c2760 con 0x55d8584d1580 2023-07-14T13:24:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.282+0000 7f7965a37b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8582a68c0 con 0x55d8584d72d0 2023-07-14T13:24:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.282+0000 7f7965a37b80 10 client.0 _ll_register_callbacks cb 0x55d8583c0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:24:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.283+0000 7f7942ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584dae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.283+0000 7f7942ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584dae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53336/0 (socket says 172.21.15.17:53336) 2023-07-14T13:24:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.283+0000 7f7942ffd700 1 -- 172.21.15.17:0/1485562046 learned_addr learned my addr 172.21.15.17:0/1485562046 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.283+0000 7f794b7fe700 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 0x55d8584da900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.283+0000 7f794bfff700 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d72d0 0x55d8584db380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.284+0000 7f7942ffd700 1 -- 172.21.15.17:0/1485562046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d72d0 msgr2=0x55d8584db380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.284+0000 7f7942ffd700 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d72d0 0x55d8584db380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.284+0000 7f7942ffd700 1 -- 172.21.15.17:0/1485562046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 msgr2=0x55d8584da900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.284+0000 7f7942ffd700 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 0x55d8584da900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.284+0000 7f7942ffd700 1 -- 172.21.15.17:0/1485562046 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c10d210 con 0x55d8584d1580 2023-07-14T13:24:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.284+0000 7f7942ffd700 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584dae40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7934099a10 tx=0x7f7934099b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9afe71a701b7b9cd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.284+0000 7f792affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:24:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.284+0000 7f792affd700 1 -- 172.21.15.17:0/1485562046 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934099400 con 0x55d8584d1580 2023-07-14T13:24:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.285+0000 7f792affd700 1 -- 172.21.15.17:0/1485562046 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f79340d3020 con 0x55d8584d1580 2023-07-14T13:24:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.285+0000 7f7965a37b80 1 -- 172.21.15.17:0/1485562046 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d85837c490 con 0x55d8584d1580 2023-07-14T13:24:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.285+0000 7f792affd700 1 -- 172.21.15.17:0/1485562046 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7934099670 con 0x55d8584d1580 2023-07-14T13:24:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.285+0000 7f7965a37b80 10 client.29180 fetch_fsmap learned FSMap version 59 2023-07-14T13:24:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.285+0000 7f7965a37b80 1 -- 172.21.15.17:0/1485562046 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55d858239c00 con 0x55d8584d1580 2023-07-14T13:24:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.286+0000 7f792affd700 1 -- 172.21.15.17:0/1485562046 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d85837c490 con 0x55d8584d1580 2023-07-14T13:24:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.286+0000 7f792affd700 1 -- 172.21.15.17:0/1485562046 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 59) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f79340a1df0 con 0x55d8584d1580 2023-07-14T13:24:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.286+0000 7f7965a37b80 10 client.29180 fetch_fsmap finished waiting for FSMap version 59 2023-07-14T13:24:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.286+0000 7f7965a37b80 10 client.29180 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:24:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.286+0000 7f7965a37b80 20 client.29180 populate_metadata read hostname 'smithi017' 2023-07-14T13:24:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.286+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d8584eabd0 0x55d8584ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.286+0000 7f7965a37b80 4 client.29180 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:24:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.286+0000 7f7965a37b80 1 -- 172.21.15.17:0/1485562046 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d85841be50 con 0x55d8584eabd0 2023-07-14T13:24:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.287+0000 7f794b7fe700 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d8584eabd0 0x55d8584ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.290+0000 7f794b7fe700 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d8584eabd0 0x55d8584ecfe0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d3f6e1189aa7ddd server_cookie=58c7710bb8813322 in_seq=0 out_seq=0 2023-07-14T13:24:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.291+0000 7f792affd700 10 client.29180 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:57.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.291+0000 7f792affd700 1 -- 172.21.15.17:0/1485562046 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d85841be50 con 0x55d8584eabd0 2023-07-14T13:24:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.291+0000 7f792affd700 10 client.29180 handle_command_reply: tid=0 2023-07-14T13:24:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.292+0000 7f7965a37b80 1 client.29180 shutdown 2023-07-14T13:24:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.292+0000 7f7965a37b80 1 -- 172.21.15.17:0/1485562046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 msgr2=0x55d8584dae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.292+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584dae40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7934099a10 tx=0x7f7934099b60 comp rx=0 tx=0).stop 2023-07-14T13:24:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.292+0000 7f7965a37b80 1 -- 172.21.15.17:0/1485562046 shutdown_connections 2023-07-14T13:24:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.292+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d8584eabd0 0x55d8584ecfe0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.292+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d72d0 0x55d8584db380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.292+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d85832d6b0 0x55d8584da900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.292+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1485562046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584dae40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.292+0000 7f7965a37b80 1 -- 172.21.15.17:0/1485562046 >> 172.21.15.17:0/1485562046 conn(0x55d8584c6be0 msgr2=0x55d8584cb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.292+0000 7f792affd700 0 client.29180 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.293+0000 7f7965a37b80 1 -- 172.21.15.17:0/1485562046 shutdown_connections 2023-07-14T13:24:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.293+0000 7f7965a37b80 1 -- 172.21.15.17:0/1485562046 wait complete. 2023-07-14T13:24:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.293+0000 7f7965a37b80 20 client.29180 trim_cache size 0 max 16384 2023-07-14T13:24:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.320+0000 7f7965a37b80 1 Processor -- start 2023-07-14T13:24:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.320+0000 7f7965a37b80 1 -- start start 2023-07-14T13:24:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.321+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85832d6b0 0x55d8584d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.321+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d1580 0x55d8584e1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.321+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8584d72d0 0x55d8584d61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.321+0000 7f7965a37b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8584cdba0 con 0x55d8584d72d0 2023-07-14T13:24:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.321+0000 7f7965a37b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8584e75f0 con 0x55d85832d6b0 2023-07-14T13:24:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.321+0000 7f7965a37b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8584d6a10 con 0x55d8584d1580 2023-07-14T13:24:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.322+0000 7f794b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85832d6b0 0x55d8584d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.322+0000 7f794b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85832d6b0 0x55d8584d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53352/0 (socket says 172.21.15.17:53352) 2023-07-14T13:24:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.322+0000 7f794b7fe700 1 -- 172.21.15.17:0/1878856733 learned_addr learned my addr 172.21.15.17:0/1878856733 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.322+0000 7f7942ffd700 1 --2- 172.21.15.17:0/1878856733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d1580 0x55d8584e1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.322+0000 7f794bfff700 1 --2- 172.21.15.17:0/1878856733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8584d72d0 0x55d8584d61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.323+0000 7f794b7fe700 1 -- 172.21.15.17:0/1878856733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d1580 msgr2=0x55d8584e1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.323+0000 7f794b7fe700 1 --2- 172.21.15.17:0/1878856733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d1580 0x55d8584e1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.323+0000 7f794b7fe700 1 -- 172.21.15.17:0/1878856733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8584d72d0 msgr2=0x55d8584d61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.323+0000 7f794b7fe700 1 --2- 172.21.15.17:0/1878856733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8584d72d0 0x55d8584d61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.323+0000 7f794b7fe700 1 -- 172.21.15.17:0/1878856733 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8582771f0 con 0x55d85832d6b0 2023-07-14T13:24:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.323+0000 7f794b7fe700 1 --2- 172.21.15.17:0/1878856733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85832d6b0 0x55d8584d1040 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55d8584cdb40 tx=0x7f793c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9aec160997c5b4a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.324+0000 7f79427fc700 1 -- 172.21.15.17:0/1878856733 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c01d550 con 0x55d85832d6b0 2023-07-14T13:24:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.324+0000 7f79427fc700 1 -- 172.21.15.17:0/1878856733 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f793c00f040 con 0x55d85832d6b0 2023-07-14T13:24:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.325+0000 7f79427fc700 1 -- 172.21.15.17:0/1878856733 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c009290 con 0x55d85832d6b0 2023-07-14T13:24:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.325+0000 7f7965a37b80 1 -- 172.21.15.17:0/1878856733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85832d6b0 msgr2=0x55d8584d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.325+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1878856733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85832d6b0 0x55d8584d1040 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55d8584cdb40 tx=0x7f793c00b040 comp rx=0 tx=0).stop 2023-07-14T13:24:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.326+0000 7f7965a37b80 1 -- 172.21.15.17:0/1878856733 shutdown_connections 2023-07-14T13:24:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.326+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1878856733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8584d72d0 0x55d8584d61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.326+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1878856733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d85832d6b0 0x55d8584d1040 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.326+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1878856733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8584d1580 0x55d8584e1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.326+0000 7f7965a37b80 1 -- 172.21.15.17:0/1878856733 >> 172.21.15.17:0/1878856733 conn(0x55d8584c6be0 msgr2=0x55d8584d5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.326+0000 7f7965a37b80 1 -- 172.21.15.17:0/1878856733 shutdown_connections 2023-07-14T13:24:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.326+0000 7f7965a37b80 1 -- 172.21.15.17:0/1878856733 wait complete. 2023-07-14T13:24:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.326+0000 7f7965a37b80 1 -- start start 2023-07-14T13:24:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.327+0000 7f7965a37b80 1 Processor -- start 2023-07-14T13:24:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.328+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85832d6b0 0x55d8584e0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.328+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584e13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.328+0000 7f7965a37b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8584d72d0 0x55d85853da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.328+0000 7f7965a37b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8584e1cf0 con 0x55d8584d72d0 2023-07-14T13:24:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.328+0000 7f7965a37b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85853dfd0 con 0x55d8584d1580 2023-07-14T13:24:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.328+0000 7f7965a37b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85853e110 con 0x55d85832d6b0 2023-07-14T13:24:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.328+0000 7f7965a37b80 10 client.0 _ll_register_callbacks cb 0x7f7934095930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:24:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.328+0000 7f794b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85832d6b0 0x55d8584e0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.328+0000 7f7942ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584e13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.328+0000 7f7942ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584e13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53360/0 (socket says 172.21.15.17:53360) 2023-07-14T13:24:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.328+0000 7f7942ffd700 1 -- 172.21.15.17:0/1113036504 learned_addr learned my addr 172.21.15.17:0/1113036504 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:24:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.329+0000 7f794bfff700 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8584d72d0 0x55d85853da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.329+0000 7f7942ffd700 1 -- 172.21.15.17:0/1113036504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85832d6b0 msgr2=0x55d8584e0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.329+0000 7f7942ffd700 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85832d6b0 0x55d8584e0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.329+0000 7f7942ffd700 1 -- 172.21.15.17:0/1113036504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8584d72d0 msgr2=0x55d85853da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:24:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.329+0000 7f7942ffd700 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8584d72d0 0x55d85853da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.329+0000 7f7942ffd700 1 -- 172.21.15.17:0/1113036504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c003cd0 con 0x55d8584d1580 2023-07-14T13:24:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.330+0000 7f7942ffd700 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584e13d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7934098060 tx=0x7f79340a1f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbe00fad96cdb244 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:24:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.330+0000 7f792affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:24:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.330+0000 7f792affd700 1 -- 172.21.15.17:0/1113036504 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934099670 con 0x55d8584d1580 2023-07-14T13:24:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.330+0000 7f792affd700 1 -- 172.21.15.17:0/1113036504 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f79340d3040 con 0x55d8584d1580 2023-07-14T13:24:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.330+0000 7f7965a37b80 1 -- 172.21.15.17:0/1113036504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f794401d040 con 0x55d8584d1580 2023-07-14T13:24:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.330+0000 7f792affd700 1 -- 172.21.15.17:0/1113036504 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79340cacd0 con 0x55d8584d1580 2023-07-14T13:24:57.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.330+0000 7f7965a37b80 10 client.29186 fetch_fsmap learned FSMap version 59 2023-07-14T13:24:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.330+0000 7f7965a37b80 1 -- 172.21.15.17:0/1113036504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55d85824f250 con 0x55d8584d1580 2023-07-14T13:24:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.331+0000 7f792affd700 1 -- 172.21.15.17:0/1113036504 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79340bd080 con 0x55d8584d1580 2023-07-14T13:24:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.331+0000 7f792affd700 1 -- 172.21.15.17:0/1113036504 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 59) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f7934095b00 con 0x55d8584d1580 2023-07-14T13:24:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.331+0000 7f7965a37b80 10 client.29186 fetch_fsmap finished waiting for FSMap version 59 2023-07-14T13:24:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.331+0000 7f7965a37b80 10 client.29186 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:24:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.331+0000 7f7965a37b80 20 client.29186 populate_metadata read hostname 'smithi017' 2023-07-14T13:24:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.331+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85853f350 0x55d858541730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:24:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.331+0000 7f7965a37b80 4 client.29186 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:24:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.331+0000 7f7965a37b80 1 -- 172.21.15.17:0/1113036504 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d8583ddff0 con 0x55d85853f350 2023-07-14T13:24:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.333+0000 7f794b7fe700 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85853f350 0x55d858541730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:24:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.335+0000 7f794b7fe700 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85853f350 0x55d858541730 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79612e4550c6b557 server_cookie=d51b36a886d9714a in_seq=0 out_seq=0 2023-07-14T13:24:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.335+0000 7f792affd700 10 client.29186 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.365+0000 7f792affd700 1 -- 172.21.15.17:0/1113036504 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d8583ddff0 con 0x55d85853f350 2023-07-14T13:24:57.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.365+0000 7f792affd700 10 client.29186 handle_command_reply: tid=0 2023-07-14T13:24:57.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.365+0000 7f7965a37b80 1 client.29186 shutdown 2023-07-14T13:24:57.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.365+0000 7f7965a37b80 1 -- 172.21.15.17:0/1113036504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 msgr2=0x55d8584e13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:57.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.365+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584e13d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7934098060 tx=0x7f79340a1f80 comp rx=0 tx=0).stop 2023-07-14T13:24:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.365+0000 7f7965a37b80 1 -- 172.21.15.17:0/1113036504 shutdown_connections 2023-07-14T13:24:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.365+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d85853f350 0x55d858541730 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.365+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d8584d72d0 0x55d85853da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.365+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d85832d6b0 0x55d8584e0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.365+0000 7f7965a37b80 1 --2- 172.21.15.17:0/1113036504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8584d1580 0x55d8584e13d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.366+0000 7f7965a37b80 1 -- 172.21.15.17:0/1113036504 >> 172.21.15.17:0/1113036504 conn(0x55d8584c6be0 msgr2=0x55d8584da8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.366+0000 7f792affd700 0 client.29186 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:24:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.366+0000 7f7965a37b80 1 -- 172.21.15.17:0/1113036504 shutdown_connections 2023-07-14T13:24:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.366+0000 7f7965a37b80 1 -- 172.21.15.17:0/1113036504 wait complete. 2023-07-14T13:24:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.367+0000 7f7965a37b80 20 client.29186 trim_cache size 0 max 16384 2023-07-14T13:24:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:24:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:24:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:24:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:24:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.368+0000 7f79521ff700 1 -- 172.21.15.17:0/946146774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79380a1410 msgr2=0x7f79380a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.368+0000 7f79521ff700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79380a1410 0x7f79380a38c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f794402b000 tx=0x7f794402e000 comp rx=0 tx=0).stop 2023-07-14T13:24:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.368+0000 7f79521ff700 1 -- 172.21.15.17:0/946146774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0685b0 msgr2=0x7f794c109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:24:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.368+0000 7f79521ff700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0685b0 0x7f794c109670 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f794c068980 tx=0x7f793400eca0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.368+0000 7f79521ff700 1 -- 172.21.15.17:0/946146774 shutdown_connections 2023-07-14T13:24:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.368+0000 7f79521ff700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f79380a1410 0x7f79380a38c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.368+0000 7f79521ff700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f794c104e50 0x7f794c109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.368+0000 7f79521ff700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f794c067c10 0x7f794c10c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.368+0000 7f79521ff700 1 --2- 172.21.15.17:0/946146774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f794c0685b0 0x7f794c109670 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:24:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.368+0000 7f79521ff700 1 -- 172.21.15.17:0/946146774 >> 172.21.15.17:0/946146774 conn(0x7f794c074760 msgr2=0x7f794c0fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:24:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.369+0000 7f79521ff700 1 -- 172.21.15.17:0/946146774 shutdown_connections 2023-07-14T13:24:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:24:57.369+0000 7f79521ff700 1 -- 172.21.15.17:0/946146774 wait complete. 2023-07-14T13:24:57.431 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 405.0 s, 542.6 tps, lat 182.759 ms stddev 49.761 2023-07-14T13:24:57.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:57 smithi017 ceph-mon[95536]: pgmap v797: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 20 MiB/s wr, 1.80k op/s 2023-07-14T13:24:57.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:57 smithi135 ceph-mon[97338]: pgmap v797: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 20 MiB/s wr, 1.80k op/s 2023-07-14T13:24:57.978 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:57 smithi131 ceph-mon[96953]: pgmap v797: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 20 MiB/s wr, 1.80k op/s 2023-07-14T13:24:59.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:24:59 smithi017 ceph-mon[95536]: pgmap v798: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-14T13:24:59.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:24:59 smithi135 ceph-mon[97338]: pgmap v798: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-14T13:24:59.978 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:24:59 smithi131 ceph-mon[96953]: pgmap v798: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-14T13:25:01.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:01 smithi017 ceph-mon[95536]: pgmap v799: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 15 MiB/s wr, 1.35k op/s 2023-07-14T13:25:01.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:01 smithi135 ceph-mon[97338]: pgmap v799: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 15 MiB/s wr, 1.35k op/s 2023-07-14T13:25:01.978 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:01 smithi131 ceph-mon[96953]: pgmap v799: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 15 MiB/s wr, 1.35k op/s 2023-07-14T13:25:02.434 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 410.0 s, 9.8 tps, lat 1635.452 ms stddev 792.173 2023-07-14T13:25:03.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:03 smithi017 ceph-mon[95536]: pgmap v800: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-14T13:25:03.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:03 smithi135 ceph-mon[97338]: pgmap v800: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-14T13:25:03.978 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:03 smithi131 ceph-mon[96953]: pgmap v800: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-14T13:25:04.842 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:04 smithi017 ceph-mon[95536]: pgmap v801: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.8 MiB/s wr, 891 op/s 2023-07-14T13:25:04.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:04 smithi135 ceph-mon[97338]: pgmap v801: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.8 MiB/s wr, 891 op/s 2023-07-14T13:25:04.978 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:04 smithi131 ceph-mon[96953]: pgmap v801: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.8 MiB/s wr, 891 op/s 2023-07-14T13:25:07.433 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 415.0 s, 24.4 tps, lat 5333.078 ms stddev 2615.987 2023-07-14T13:25:07.728 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:07 smithi131 ceph-mon[96953]: pgmap v802: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-07-14T13:25:07.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:07 smithi017 ceph-mon[95536]: pgmap v802: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-07-14T13:25:07.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:07 smithi135 ceph-mon[97338]: pgmap v802: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 1.03k op/s 2023-07-14T13:25:09.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:09 smithi017 ceph-mon[95536]: pgmap v803: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 4.4 MiB/s wr, 462 op/s 2023-07-14T13:25:09.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:09 smithi135 ceph-mon[97338]: pgmap v803: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 4.4 MiB/s wr, 462 op/s 2023-07-14T13:25:09.980 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:09 smithi131 ceph-mon[96953]: pgmap v803: 97 pgs: 97 active+clean; 14 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 4.4 MiB/s wr, 462 op/s 2023-07-14T13:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.679+0000 7f28e41ff700 1 -- 172.21.15.17:0/2971671629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28dc110b50 msgr2=0x7f28dc112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.679+0000 7f28e41ff700 1 --2- 172.21.15.17:0/2971671629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28dc110b50 0x7f28dc112f50 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f28cc007510 tx=0x7f28cc007820 comp rx=0 tx=0).stop 2023-07-14T13:25:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.683+0000 7f28e41ff700 1 -- 172.21.15.17:0/2971671629 shutdown_connections 2023-07-14T13:25:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.683+0000 7f28e41ff700 1 --2- 172.21.15.17:0/2971671629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28dc110b50 0x7f28dc112f50 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.683+0000 7f28e41ff700 1 --2- 172.21.15.17:0/2971671629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28dc107780 0x7f28dc107b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.683+0000 7f28e41ff700 1 --2- 172.21.15.17:0/2971671629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28dc108090 0x7f28dc110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.683+0000 7f28e41ff700 1 -- 172.21.15.17:0/2971671629 >> 172.21.15.17:0/2971671629 conn(0x7f28dc06c270 msgr2=0x7f28dc06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.686+0000 7f28e41ff700 1 -- 172.21.15.17:0/2971671629 shutdown_connections 2023-07-14T13:25:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.686+0000 7f28e41ff700 1 -- 172.21.15.17:0/2971671629 wait complete. 2023-07-14T13:25:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.688+0000 7f28e41ff700 1 Processor -- start 2023-07-14T13:25:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.688+0000 7f28e41ff700 1 -- start start 2023-07-14T13:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.691+0000 7f28e41ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28dc107780 0x7f28dc1aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.691+0000 7f28e41ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28dc108090 0x7f28dc1aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.691+0000 7f28e41ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28dc110b50 0x7f28dc1a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.691+0000 7f28e41ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc1a4db0 con 0x7f28dc110b50 2023-07-14T13:25:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.691+0000 7f28e41ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc1a4f20 con 0x7f28dc108090 2023-07-14T13:25:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.691+0000 7f28e41ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc1a50e0 con 0x7f28dc107780 2023-07-14T13:25:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.695+0000 7f28e179a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28dc108090 0x7f28dc1aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.695+0000 7f28e179a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28dc108090 0x7f28dc1aae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41606/0 (socket says 172.21.15.17:41606) 2023-07-14T13:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.695+0000 7f28e179a700 1 -- 172.21.15.17:0/2908346583 learned_addr learned my addr 172.21.15.17:0/2908346583 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:10.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.696+0000 7f28e279c700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28dc110b50 0x7f28dc1a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.696+0000 7f28e179a700 1 -- 172.21.15.17:0/2908346583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28dc107780 msgr2=0x7f28dc1aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:10.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.696+0000 7f28e179a700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28dc107780 0x7f28dc1aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.696+0000 7f28e179a700 1 -- 172.21.15.17:0/2908346583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28dc110b50 msgr2=0x7f28dc1a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:10.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.696+0000 7f28e179a700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28dc110b50 0x7f28dc1a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.696+0000 7f28e179a700 1 -- 172.21.15.17:0/2908346583 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc0071c0 con 0x7f28dc108090 2023-07-14T13:25:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.702+0000 7f28e179a700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28dc108090 0x7f28dc1aae20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f28d800b550 tx=0x7f28d800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.705+0000 7f28d2ffd700 1 -- 172.21.15.17:0/2908346583 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8011830 con 0x7f28dc108090 2023-07-14T13:25:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.705+0000 7f28d2ffd700 1 -- 172.21.15.17:0/2908346583 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28d8011e20 con 0x7f28dc108090 2023-07-14T13:25:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.705+0000 7f28d2ffd700 1 -- 172.21.15.17:0/2908346583 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8010e40 con 0x7f28dc108090 2023-07-14T13:25:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.705+0000 7f28e41ff700 1 -- 172.21.15.17:0/2908346583 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc1a53c0 con 0x7f28dc108090 2023-07-14T13:25:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.705+0000 7f28e41ff700 1 -- 172.21.15.17:0/2908346583 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc1b18d0 con 0x7f28dc108090 2023-07-14T13:25:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.712+0000 7f28f7bfab80 1 Processor -- start 2023-07-14T13:25:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.717+0000 7f28d2ffd700 1 -- 172.21.15.17:0/2908346583 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f28d8011990 con 0x7f28dc108090 2023-07-14T13:25:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.717+0000 7f28f7bfab80 1 -- start start 2023-07-14T13:25:10.735 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.718+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 0x55ef30367d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.718+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef303682d0 0x55ef30362040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.718+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef30362580 0x55ef303629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.718+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef30267c50 con 0x55ef301be6b0 2023-07-14T13:25:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.718+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef302ba9e0 con 0x55ef303682d0 2023-07-14T13:25:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.718+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef302b3e70 con 0x55ef30362580 2023-07-14T13:25:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.720+0000 7f28d2ffd700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f28c80a14c0 0x7f28c80a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.720+0000 7f28d2ffd700 1 -- 172.21.15.17:0/2908346583 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f28d80cc420 con 0x7f28dc108090 2023-07-14T13:25:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.725+0000 7f28e1f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef303682d0 0x55ef30362040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.725+0000 7f28e1f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef303682d0 0x55ef30362040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41612/0 (socket says 172.21.15.17:41612) 2023-07-14T13:25:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.725+0000 7f28e1f9b700 1 -- 172.21.15.17:0/937270305 learned_addr learned my addr 172.21.15.17:0/937270305 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:10.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.727+0000 7f28e279c700 1 --2- 172.21.15.17:0/937270305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 0x55ef30367d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.727+0000 7f28e179a700 1 --2- 172.21.15.17:0/937270305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef30362580 0x55ef303629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.728+0000 7f28e279c700 1 -- 172.21.15.17:0/937270305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef30362580 msgr2=0x55ef303629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.728+0000 7f28e279c700 1 --2- 172.21.15.17:0/937270305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef30362580 0x55ef303629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.728+0000 7f28e279c700 1 -- 172.21.15.17:0/937270305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef303682d0 msgr2=0x55ef30362040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.728+0000 7f28e279c700 1 --2- 172.21.15.17:0/937270305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef303682d0 0x55ef30362040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.728+0000 7f28e279c700 1 -- 172.21.15.17:0/937270305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef300e1d80 con 0x55ef301be6b0 2023-07-14T13:25:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.729+0000 7f28e279c700 1 --2- 172.21.15.17:0/937270305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 0x55ef30367d90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f28dc069880 tx=0x7f28cc009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6d4cf0a5fb0342 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.733+0000 7f28c7fff700 1 -- 172.21.15.17:0/937270305 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00f030 con 0x55ef301be6b0 2023-07-14T13:25:10.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.733+0000 7f28c7fff700 1 -- 172.21.15.17:0/937270305 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28cc0054e0 con 0x55ef301be6b0 2023-07-14T13:25:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.733+0000 7f28c7fff700 1 -- 172.21.15.17:0/937270305 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00cb00 con 0x55ef301be6b0 2023-07-14T13:25:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.735+0000 7f28e279c700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f28c80a14c0 0x7f28c80a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.739+0000 7f28f7bfab80 1 -- 172.21.15.17:0/937270305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 msgr2=0x55ef30367d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:10.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.739+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/937270305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 0x55ef30367d90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f28dc069880 tx=0x7f28cc009e40 comp rx=0 tx=0).stop 2023-07-14T13:25:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.741+0000 7f28e279c700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f28c80a14c0 0x7f28c80a3970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f28dc069880 tx=0x7f28cc009e40 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.747+0000 7f28f7bfab80 1 -- 172.21.15.17:0/937270305 shutdown_connections 2023-07-14T13:25:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.747+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/937270305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef30362580 0x55ef303629d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.747+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/937270305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 0x55ef30367d90 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.747+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/937270305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef303682d0 0x55ef30362040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.747+0000 7f28f7bfab80 1 -- 172.21.15.17:0/937270305 >> 172.21.15.17:0/937270305 conn(0x55ef30357be0 msgr2=0x55ef3035cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:10.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.761+0000 7f28f7bfab80 1 -- 172.21.15.17:0/937270305 shutdown_connections 2023-07-14T13:25:10.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.771+0000 7f28f7bfab80 1 -- 172.21.15.17:0/937270305 wait complete. 2023-07-14T13:25:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.771+0000 7f28f7bfab80 1 -- start start 2023-07-14T13:25:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.772+0000 7f28f7bfab80 1 Processor -- start 2023-07-14T13:25:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.773+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef301be6b0 0x55ef3036b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.773+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef30362580 0x55ef3036bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.773+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef303682d0 0x55ef3036c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.773+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef30253a60 con 0x55ef30362580 2023-07-14T13:25:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.773+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef30253760 con 0x55ef303682d0 2023-07-14T13:25:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.773+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef301378c0 con 0x55ef301be6b0 2023-07-14T13:25:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.773+0000 7f28f7bfab80 10 client.0 _ll_register_callbacks cb 0x55ef30251700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:25:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.774+0000 7f28e179a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef30362580 0x55ef3036bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.774+0000 7f28e179a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef30362580 0x55ef3036bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40522/0 (socket says 172.21.15.17:40522) 2023-07-14T13:25:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.774+0000 7f28e179a700 1 -- 172.21.15.17:0/2132266930 learned_addr learned my addr 172.21.15.17:0/2132266930 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.775+0000 7f28e179a700 1 -- 172.21.15.17:0/2132266930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef301be6b0 msgr2=0x55ef3036b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.775+0000 7f28e179a700 1 --2- 172.21.15.17:0/2132266930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef301be6b0 0x55ef3036b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.775+0000 7f28e179a700 1 -- 172.21.15.17:0/2132266930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef303682d0 msgr2=0x55ef3036c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.775+0000 7f28e179a700 1 --2- 172.21.15.17:0/2132266930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef303682d0 0x55ef3036c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.775+0000 7f28e179a700 1 -- 172.21.15.17:0/2132266930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc113be0 con 0x55ef30362580 2023-07-14T13:25:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.776+0000 7f28e179a700 1 --2- 172.21.15.17:0/2132266930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef30362580 0x55ef3036bef0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f28d8099520 tx=0x7f28d80991f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dd803340a274fa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.776+0000 7f28c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:25:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.776+0000 7f28c57fa700 1 -- 172.21.15.17:0/2132266930 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d809d370 con 0x55ef30362580 2023-07-14T13:25:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.776+0000 7f28c57fa700 1 -- 172.21.15.17:0/2132266930 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f28d8010380 con 0x55ef30362580 2023-07-14T13:25:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.777+0000 7f28f7bfab80 1 -- 172.21.15.17:0/2132266930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef3020d490 con 0x55ef30362580 2023-07-14T13:25:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.777+0000 7f28c57fa700 1 -- 172.21.15.17:0/2132266930 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28d8099590 con 0x55ef30362580 2023-07-14T13:25:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.777+0000 7f28f7bfab80 10 client.19416 fetch_fsmap learned FSMap version 59 2023-07-14T13:25:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.777+0000 7f28f7bfab80 1 -- 172.21.15.17:0/2132266930 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55ef300cac00 con 0x55ef30362580 2023-07-14T13:25:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.779+0000 7f28c57fa700 1 -- 172.21.15.17:0/2132266930 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ef3020d490 con 0x55ef30362580 2023-07-14T13:25:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.779+0000 7f28c57fa700 1 -- 172.21.15.17:0/2132266930 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 59) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f28d80998e0 con 0x55ef30362580 2023-07-14T13:25:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.779+0000 7f28f7bfab80 10 client.19416 fetch_fsmap finished waiting for FSMap version 59 2023-07-14T13:25:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.779+0000 7f28f7bfab80 10 client.19416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:25:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.779+0000 7f28f7bfab80 20 client.19416 populate_metadata read hostname 'smithi017' 2023-07-14T13:25:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.779+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/2132266930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef3038cb80 0x55ef3038ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.779+0000 7f28f7bfab80 4 client.19416 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:25:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.779+0000 7f28f7bfab80 1 -- 172.21.15.17:0/2132266930 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef302ace50 con 0x55ef3038cb80 2023-07-14T13:25:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.784+0000 7f28e1f9b700 1 --2- 172.21.15.17:0/2132266930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef3038cb80 0x55ef3038ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.786+0000 7f28e1f9b700 1 --2- 172.21.15.17:0/2132266930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef3038cb80 0x55ef3038ef90 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d9fec9c465095e8 server_cookie=f3daa0bb5d7634f8 in_seq=0 out_seq=0 2023-07-14T13:25:10.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.786+0000 7f28c57fa700 10 client.19416 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.791+0000 7f28c57fa700 1 -- 172.21.15.17:0/2132266930 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ef302ace50 con 0x55ef3038cb80 2023-07-14T13:25:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.791+0000 7f28c57fa700 10 client.19416 handle_command_reply: tid=0 2023-07-14T13:25:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.791+0000 7f28f7bfab80 1 client.19416 shutdown 2023-07-14T13:25:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.792+0000 7f28f7bfab80 1 -- 172.21.15.17:0/2132266930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef30362580 msgr2=0x55ef3036bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.792+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/2132266930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef30362580 0x55ef3036bef0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f28d8099520 tx=0x7f28d80991f0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.793+0000 7f28f7bfab80 1 -- 172.21.15.17:0/2132266930 shutdown_connections 2023-07-14T13:25:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.793+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/2132266930 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef3038cb80 0x55ef3038ef90 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.793+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/2132266930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef303682d0 0x55ef3036c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.793+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/2132266930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef301be6b0 0x55ef3036b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.793+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/2132266930 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef30362580 0x55ef3036bef0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.793+0000 7f28f7bfab80 1 -- 172.21.15.17:0/2132266930 >> 172.21.15.17:0/2132266930 conn(0x55ef30357be0 msgr2=0x55ef3035c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.793+0000 7f28c57fa700 0 client.19416 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.793+0000 7f28f7bfab80 1 -- 172.21.15.17:0/2132266930 shutdown_connections 2023-07-14T13:25:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.793+0000 7f28f7bfab80 1 -- 172.21.15.17:0/2132266930 wait complete. 2023-07-14T13:25:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.796+0000 7f28f7bfab80 20 client.19416 trim_cache size 0 max 16384 2023-07-14T13:25:10.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:10 smithi017 ceph-mon[95536]: osdmap e128: 12 total, 12 up, 12 in 2023-07-14T13:25:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.829+0000 7f28f7bfab80 1 Processor -- start 2023-07-14T13:25:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.830+0000 7f28f7bfab80 1 -- start start 2023-07-14T13:25:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.830+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef301be6b0 0x55ef3036e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.830+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef30362580 0x55ef30362040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.830+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef303682d0 0x55ef30383c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.830+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef30354bb0 con 0x55ef303682d0 2023-07-14T13:25:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.830+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef3035e970 con 0x55ef30362580 2023-07-14T13:25:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.830+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef3038a270 con 0x55ef301be6b0 2023-07-14T13:25:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.831+0000 7f28e1f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef301be6b0 0x55ef3036e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.831+0000 7f28e1f9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef301be6b0 0x55ef3036e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:46190/0 (socket says 172.21.15.17:46190) 2023-07-14T13:25:10.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.831+0000 7f28e1f9b700 1 -- 172.21.15.17:0/819583694 learned_addr learned my addr 172.21.15.17:0/819583694 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:10.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.831+0000 7f28e279c700 1 --2- 172.21.15.17:0/819583694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef303682d0 0x55ef30383c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.832+0000 7f28e1f9b700 1 -- 172.21.15.17:0/819583694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef30362580 msgr2=0x55ef30362040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:10.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.832+0000 7f28e1f9b700 1 --2- 172.21.15.17:0/819583694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef30362580 0x55ef30362040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.832+0000 7f28e1f9b700 1 -- 172.21.15.17:0/819583694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef303682d0 msgr2=0x55ef30383c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:10.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.832+0000 7f28e1f9b700 1 --2- 172.21.15.17:0/819583694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef303682d0 0x55ef30383c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.832+0000 7f28e1f9b700 1 -- 172.21.15.17:0/819583694 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef30362c20 con 0x55ef301be6b0 2023-07-14T13:25:10.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.833+0000 7f28e1f9b700 1 --2- 172.21.15.17:0/819583694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef301be6b0 0x55ef3036e150 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55ef3035eb40 tx=0x7f28d401be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f13040e8692d863e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:10.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.838+0000 7f28d0ff9700 1 -- 172.21.15.17:0/819583694 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d400e040 con 0x55ef301be6b0 2023-07-14T13:25:10.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.838+0000 7f28d0ff9700 1 -- 172.21.15.17:0/819583694 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28d401f070 con 0x55ef301be6b0 2023-07-14T13:25:10.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.838+0000 7f28d0ff9700 1 -- 172.21.15.17:0/819583694 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4003c60 con 0x55ef301be6b0 2023-07-14T13:25:10.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.839+0000 7f28f7bfab80 1 -- 172.21.15.17:0/819583694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef301be6b0 msgr2=0x55ef3036e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:10.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.839+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/819583694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef301be6b0 0x55ef3036e150 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x55ef3035eb40 tx=0x7f28d401be20 comp rx=0 tx=0).stop 2023-07-14T13:25:10.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.843+0000 7f28f7bfab80 1 -- 172.21.15.17:0/819583694 shutdown_connections 2023-07-14T13:25:10.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.843+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/819583694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef303682d0 0x55ef30383c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.843+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/819583694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef301be6b0 0x55ef3036e150 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.843+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/819583694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef30362580 0x55ef30362040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.843+0000 7f28f7bfab80 1 -- 172.21.15.17:0/819583694 >> 172.21.15.17:0/819583694 conn(0x55ef30357be0 msgr2=0x55ef30366b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.847+0000 7f28f7bfab80 1 -- 172.21.15.17:0/819583694 shutdown_connections 2023-07-14T13:25:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.847+0000 7f28f7bfab80 1 -- 172.21.15.17:0/819583694 wait complete. 2023-07-14T13:25:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.847+0000 7f28f7bfab80 1 -- start start 2023-07-14T13:25:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.848+0000 7f28f7bfab80 1 Processor -- start 2023-07-14T13:25:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.849+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 0x55ef303815f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.849+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef30362580 0x55ef30381b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.849+0000 7f28f7bfab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef303682d0 0x55ef303dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.849+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef303822a0 con 0x55ef301be6b0 2023-07-14T13:25:10.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.849+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef30382410 con 0x55ef30362580 2023-07-14T13:25:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.849+0000 7f28f7bfab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef303dff80 con 0x55ef303682d0 2023-07-14T13:25:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.849+0000 7f28f7bfab80 10 client.0 _ll_register_callbacks cb 0x55ef30251700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:25:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.850+0000 7f28e1f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 0x55ef303815f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.850+0000 7f28e1f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 0x55ef303815f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40536/0 (socket says 172.21.15.17:40536) 2023-07-14T13:25:10.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.850+0000 7f28e1f9b700 1 -- 172.21.15.17:0/795036293 learned_addr learned my addr 172.21.15.17:0/795036293 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.850+0000 7f28e179a700 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef30362580 0x55ef30381b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.851+0000 7f28e1f9b700 1 -- 172.21.15.17:0/795036293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef303682d0 msgr2=0x55ef303dfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.851+0000 7f28e1f9b700 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef303682d0 0x55ef303dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.851+0000 7f28e1f9b700 1 -- 172.21.15.17:0/795036293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef30362580 msgr2=0x55ef30381b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.851+0000 7f28e1f9b700 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef30362580 0x55ef30381b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.851+0000 7f28e1f9b700 1 -- 172.21.15.17:0/795036293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d400f370 con 0x55ef301be6b0 2023-07-14T13:25:10.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.852+0000 7f28e1f9b700 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 0x55ef303815f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f28d400fbf0 tx=0x7f28d400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8760dea233ef973c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:10.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.853+0000 7f28c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:25:10.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.853+0000 7f28c57fa700 1 -- 172.21.15.17:0/795036293 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d400e040 con 0x55ef301be6b0 2023-07-14T13:25:10.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.853+0000 7f28c57fa700 1 -- 172.21.15.17:0/795036293 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f28d40092d0 con 0x55ef301be6b0 2023-07-14T13:25:10.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.853+0000 7f28f7bfab80 1 -- 172.21.15.17:0/795036293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f28cc0054e0 con 0x55ef301be6b0 2023-07-14T13:25:10.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.854+0000 7f28c57fa700 1 -- 172.21.15.17:0/795036293 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28d401b150 con 0x55ef301be6b0 2023-07-14T13:25:10.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.858+0000 7f28f7bfab80 10 client.19422 fetch_fsmap learned FSMap version 59 2023-07-14T13:25:10.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.858+0000 7f28f7bfab80 1 -- 172.21.15.17:0/795036293 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55ef301081f0 con 0x55ef301be6b0 2023-07-14T13:25:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.860+0000 7f28c57fa700 1 -- 172.21.15.17:0/795036293 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28d4030030 con 0x55ef301be6b0 2023-07-14T13:25:10.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.860+0000 7f28c57fa700 1 -- 172.21.15.17:0/795036293 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 59) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f28d4017400 con 0x55ef301be6b0 2023-07-14T13:25:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.860+0000 7f28f7bfab80 10 client.19422 fetch_fsmap finished waiting for FSMap version 59 2023-07-14T13:25:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.860+0000 7f28f7bfab80 10 client.19422 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:25:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.860+0000 7f28f7bfab80 20 client.19422 populate_metadata read hostname 'smithi017' 2023-07-14T13:25:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.860+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef303e1630 0x55ef303e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:10.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.860+0000 7f28f7bfab80 4 client.19422 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:25:10.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.860+0000 7f28f7bfab80 1 -- 172.21.15.17:0/795036293 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ef3026eff0 con 0x55ef303e1630 2023-07-14T13:25:10.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.865+0000 7f28e179a700 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef303e1630 0x55ef303e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.904+0000 7f28e179a700 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef303e1630 0x55ef303e3a40 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=488b6f8852622652 server_cookie=da8cd4013d357d9a in_seq=0 out_seq=0 2023-07-14T13:25:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:10.909+0000 7f28c57fa700 10 client.19422 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:10.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:10 smithi135 ceph-mon[97338]: osdmap e128: 12 total, 12 up, 12 in 2023-07-14T13:25:10.978 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:10 smithi131 ceph-mon[96953]: osdmap e128: 12 total, 12 up, 12 in 2023-07-14T13:25:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.009+0000 7f28c57fa700 1 -- 172.21.15.17:0/795036293 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ef3026eff0 con 0x55ef303e1630 2023-07-14T13:25:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.009+0000 7f28c57fa700 10 client.19422 handle_command_reply: tid=0 2023-07-14T13:25:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.009+0000 7f28f7bfab80 1 client.19422 shutdown 2023-07-14T13:25:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.010+0000 7f28f7bfab80 1 -- 172.21.15.17:0/795036293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 msgr2=0x55ef303815f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.010+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 0x55ef303815f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f28d400fbf0 tx=0x7f28d400fe10 comp rx=0 tx=0).stop 2023-07-14T13:25:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.010+0000 7f28f7bfab80 1 -- 172.21.15.17:0/795036293 shutdown_connections 2023-07-14T13:25:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.010+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55ef303e1630 0x55ef303e3a40 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.010+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef303682d0 0x55ef303dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.010+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ef301be6b0 0x55ef303815f0 secure :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f28d400fbf0 tx=0x7f28d400fe10 comp rx=0 tx=0).stop 2023-07-14T13:25:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.010+0000 7f28f7bfab80 1 --2- 172.21.15.17:0/795036293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef30362580 0x55ef30381b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.010+0000 7f28f7bfab80 1 -- 172.21.15.17:0/795036293 >> 172.21.15.17:0/795036293 conn(0x55ef30357be0 msgr2=0x55ef30369360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.010+0000 7f28c57fa700 0 client.19422 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.013+0000 7f28f7bfab80 1 -- 172.21.15.17:0/795036293 shutdown_connections 2023-07-14T13:25:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.018+0000 7f28f7bfab80 1 -- 172.21.15.17:0/795036293 wait complete. 2023-07-14T13:25:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:25:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:25:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:25:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:25:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.022+0000 7f28f7bfab80 20 client.19422 trim_cache size 0 max 16384 2023-07-14T13:25:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.029+0000 7f28e41ff700 1 -- 172.21.15.17:0/2908346583 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f28c80a14c0 msgr2=0x7f28c80a3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.029+0000 7f28e41ff700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f28c80a14c0 0x7f28c80a3970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f28dc069880 tx=0x7f28cc009e40 comp rx=0 tx=0).stop 2023-07-14T13:25:11.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.029+0000 7f28e41ff700 1 -- 172.21.15.17:0/2908346583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28dc108090 msgr2=0x7f28dc1aae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.029+0000 7f28e41ff700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28dc108090 0x7f28dc1aae20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f28d800b550 tx=0x7f28d800b910 comp rx=0 tx=0).stop 2023-07-14T13:25:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.029+0000 7f28e41ff700 1 -- 172.21.15.17:0/2908346583 shutdown_connections 2023-07-14T13:25:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.029+0000 7f28e41ff700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f28c80a14c0 0x7f28c80a3970 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:11.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.029+0000 7f28e41ff700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28dc110b50 0x7f28dc1a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.029+0000 7f28e41ff700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28dc107780 0x7f28dc1aa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.029+0000 7f28e41ff700 1 --2- 172.21.15.17:0/2908346583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28dc108090 0x7f28dc1aae20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.029+0000 7f28e41ff700 1 -- 172.21.15.17:0/2908346583 >> 172.21.15.17:0/2908346583 conn(0x7f28dc06c270 msgr2=0x7f28dc06eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.030+0000 7f28e41ff700 1 -- 172.21.15.17:0/2908346583 shutdown_connections 2023-07-14T13:25:11.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:11.030+0000 7f28e41ff700 1 -- 172.21.15.17:0/2908346583 wait complete. 2023-07-14T13:25:11.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:11 smithi017 ceph-mon[95536]: pgmap v805: 97 pgs: 10 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 70 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 3.1 MiB/s wr, 360 op/s 2023-07-14T13:25:11.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:11 smithi135 ceph-mon[97338]: pgmap v805: 97 pgs: 10 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 70 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 3.1 MiB/s wr, 360 op/s 2023-07-14T13:25:11.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:11 smithi131 ceph-mon[96953]: pgmap v805: 97 pgs: 10 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 70 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 3.1 MiB/s wr, 360 op/s 2023-07-14T13:25:12.430 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 420.0 s, 205.3 tps, lat 732.611 ms stddev 1269.713 2023-07-14T13:25:12.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:12 smithi017 ceph-mon[95536]: pgmap v806: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 2.4 MiB/s wr, 228 op/s 2023-07-14T13:25:12.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:12 smithi135 ceph-mon[97338]: pgmap v806: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 2.4 MiB/s wr, 228 op/s 2023-07-14T13:25:12.978 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:12 smithi131 ceph-mon[96953]: pgmap v806: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 2.4 MiB/s wr, 228 op/s 2023-07-14T13:25:15.727 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:15 smithi131 ceph-mon[96953]: pgmap v807: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 2.4 MiB/s wr, 228 op/s 2023-07-14T13:25:15.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:15 smithi017 ceph-mon[95536]: pgmap v807: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 2.4 MiB/s wr, 228 op/s 2023-07-14T13:25:15.932 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:15 smithi135 ceph-mon[97338]: pgmap v807: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 2.4 MiB/s wr, 228 op/s 2023-07-14T13:25:17.433 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 425.0 s, 369.6 tps, lat 275.601 ms stddev 138.576 2023-07-14T13:25:17.727 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:17 smithi131 ceph-mon[96953]: pgmap v808: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 331 op/s 2023-07-14T13:25:17.728 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:17 smithi131 ceph-mon[96953]: osdmap e129: 12 total, 12 up, 12 in 2023-07-14T13:25:17.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:17 smithi017 ceph-mon[95536]: pgmap v808: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 331 op/s 2023-07-14T13:25:17.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:17 smithi017 ceph-mon[95536]: osdmap e129: 12 total, 12 up, 12 in 2023-07-14T13:25:17.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:17 smithi135 ceph-mon[97338]: pgmap v808: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 331 op/s 2023-07-14T13:25:17.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:17 smithi135 ceph-mon[97338]: osdmap e129: 12 total, 12 up, 12 in 2023-07-14T13:25:19.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:19 smithi017 ceph-mon[95536]: pgmap v810: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 374 op/s 2023-07-14T13:25:19.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:19 smithi135 ceph-mon[97338]: pgmap v810: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 374 op/s 2023-07-14T13:25:19.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:19 smithi131 ceph-mon[96953]: pgmap v810: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 374 op/s 2023-07-14T13:25:21.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:21 smithi017 ceph-mon[95536]: pgmap v811: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.1 MiB/s wr, 623 op/s 2023-07-14T13:25:21.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:21 smithi135 ceph-mon[97338]: pgmap v811: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.1 MiB/s wr, 623 op/s 2023-07-14T13:25:21.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:21 smithi131 ceph-mon[96953]: pgmap v811: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.1 MiB/s wr, 623 op/s 2023-07-14T13:25:22.431 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 430.0 s, 478.3 tps, lat 215.119 ms stddev 85.148 2023-07-14T13:25:22.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:22 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:25:22.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:22 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:25:22.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:22 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:25:23.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:23 smithi017 ceph-mon[95536]: pgmap v812: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 867 op/s 2023-07-14T13:25:23.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:23 smithi135 ceph-mon[97338]: pgmap v812: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 867 op/s 2023-07-14T13:25:23.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:23 smithi131 ceph-mon[96953]: pgmap v812: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 867 op/s 2023-07-14T13:25:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.302+0000 7f3344bff700 1 -- 172.21.15.17:0/1490301605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334006d3a0 msgr2=0x7f334011b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.302+0000 7f3344bff700 1 --2- 172.21.15.17:0/1490301605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334006d3a0 0x7f334011b470 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f333800b0a0 tx=0x7f333800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.302+0000 7f3344bff700 1 -- 172.21.15.17:0/1490301605 shutdown_connections 2023-07-14T13:25:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.302+0000 7f3344bff700 1 --2- 172.21.15.17:0/1490301605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334006d3a0 0x7f334011b470 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.302+0000 7f3344bff700 1 --2- 172.21.15.17:0/1490301605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f334010e2a0 0x7f334010e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.302+0000 7f3344bff700 1 --2- 172.21.15.17:0/1490301605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f334006c910 0x7f334006cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.302+0000 7f3344bff700 1 -- 172.21.15.17:0/1490301605 >> 172.21.15.17:0/1490301605 conn(0x7f334006bd70 msgr2=0x7f3340070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:24.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.307+0000 7f3344bff700 1 -- 172.21.15.17:0/1490301605 shutdown_connections 2023-07-14T13:25:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.308+0000 7f3344bff700 1 -- 172.21.15.17:0/1490301605 wait complete. 2023-07-14T13:25:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.309+0000 7f3344bff700 1 Processor -- start 2023-07-14T13:25:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.310+0000 7f3344bff700 1 -- start start 2023-07-14T13:25:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.310+0000 7f3344bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334006d3a0 0x7f33401aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.310+0000 7f3344bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f334010e2a0 0x7f33401aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.310+0000 7f3344bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33401a4900 0x7f33401a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.310+0000 7f3344bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33401a5370 con 0x7f334010e2a0 2023-07-14T13:25:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.310+0000 7f3344bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33401a54b0 con 0x7f334006d3a0 2023-07-14T13:25:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.310+0000 7f3344bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33401a5670 con 0x7f33401a4900 2023-07-14T13:25:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.312+0000 7f333dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f334010e2a0 0x7f33401aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.312+0000 7f333dd9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f334010e2a0 0x7f33401aafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38190/0 (socket says 172.21.15.17:38190) 2023-07-14T13:25:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.312+0000 7f333dd9b700 1 -- 172.21.15.17:0/267496771 learned_addr learned my addr 172.21.15.17:0/267496771 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.313+0000 7f333dd9b700 1 -- 172.21.15.17:0/267496771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33401a4900 msgr2=0x7f33401a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.313+0000 7f333dd9b700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33401a4900 0x7f33401a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.313+0000 7f333dd9b700 1 -- 172.21.15.17:0/267496771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334006d3a0 msgr2=0x7f33401aaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.313+0000 7f333dd9b700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334006d3a0 0x7f33401aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.313+0000 7f333dd9b700 1 -- 172.21.15.17:0/267496771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338009d00 con 0x7f334010e2a0 2023-07-14T13:25:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.314+0000 7f333dd9b700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f334010e2a0 0x7f33401aafe0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f333400b480 tx=0x7f333400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.315+0000 7f332f7fe700 1 -- 172.21.15.17:0/267496771 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340118f0 con 0x7f334010e2a0 2023-07-14T13:25:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.315+0000 7f332f7fe700 1 -- 172.21.15.17:0/267496771 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3334010380 con 0x7f334010e2a0 2023-07-14T13:25:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.315+0000 7f332f7fe700 1 -- 172.21.15.17:0/267496771 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400f540 con 0x7f334010e2a0 2023-07-14T13:25:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.315+0000 7f3344bff700 1 -- 172.21.15.17:0/267496771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33400727a0 con 0x7f334010e2a0 2023-07-14T13:25:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.315+0000 7f3344bff700 1 -- 172.21.15.17:0/267496771 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3340072c60 con 0x7f334010e2a0 2023-07-14T13:25:24.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.322+0000 7f33585f4b80 1 Processor -- start 2023-07-14T13:25:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.328+0000 7f332f7fe700 1 -- 172.21.15.17:0/267496771 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f33340104f0 con 0x7f334010e2a0 2023-07-14T13:25:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.330+0000 7f332f7fe700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f33280c34e0 0x7f33280c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.330+0000 7f332f7fe700 1 -- 172.21.15.17:0/267496771 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f33340cc6a0 con 0x7f334010e2a0 2023-07-14T13:25:24.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.332+0000 7f333ed9d700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f33280c34e0 0x7f33280c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.339+0000 7f33585f4b80 1 -- start start 2023-07-14T13:25:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.339+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 0x564c445c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.339+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c62d0 0x564c445c0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.339+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 0x564c445c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.340+0000 7f33585f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c444c5c50 con 0x564c445c62d0 2023-07-14T13:25:24.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.340+0000 7f33585f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c445189e0 con 0x564c445c0580 2023-07-14T13:25:24.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.340+0000 7f33585f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c44511e70 con 0x564c4441c6b0 2023-07-14T13:25:24.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.345+0000 7f333e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 0x564c445c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.346+0000 7f333ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 0x564c445c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.346+0000 7f333ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 0x564c445c09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55046/0 (socket says 172.21.15.17:55046) 2023-07-14T13:25:24.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.346+0000 7f333ed9d700 1 -- 172.21.15.17:0/3605691341 learned_addr learned my addr 172.21.15.17:0/3605691341 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:24.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.357+0000 7f333dd9b700 1 --2- 172.21.15.17:0/3605691341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c62d0 0x564c445c0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.361+0000 7f333ed9d700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f33280c34e0 0x7f33280c5990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f333800b070 tx=0x7f3338009340 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:24.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.369+0000 7f333e59c700 1 -- 172.21.15.17:0/3605691341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 msgr2=0x564c445c09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:24.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.369+0000 7f333e59c700 1 --2- 172.21.15.17:0/3605691341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 0x564c445c09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.369+0000 7f333e59c700 1 -- 172.21.15.17:0/3605691341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c62d0 msgr2=0x564c445c0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:24.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.369+0000 7f333e59c700 1 --2- 172.21.15.17:0/3605691341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c62d0 0x564c445c0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.369+0000 7f333e59c700 1 -- 172.21.15.17:0/3605691341 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c4433fd80 con 0x564c4441c6b0 2023-07-14T13:25:24.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.376+0000 7f333e59c700 1 --2- 172.21.15.17:0/3605691341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 0x564c445c5d90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f333000a9c0 tx=0x7f333000acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85e742390bbea45f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.384+0000 7f332cff9700 1 -- 172.21.15.17:0/3605691341 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000cc10 con 0x564c4441c6b0 2023-07-14T13:25:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.384+0000 7f332cff9700 1 -- 172.21.15.17:0/3605691341 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f333000ae60 con 0x564c4441c6b0 2023-07-14T13:25:24.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.384+0000 7f332cff9700 1 -- 172.21.15.17:0/3605691341 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3330018660 con 0x564c4441c6b0 2023-07-14T13:25:24.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.396+0000 7f33585f4b80 1 -- 172.21.15.17:0/3605691341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 msgr2=0x564c445c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:24.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.396+0000 7f33585f4b80 1 --2- 172.21.15.17:0/3605691341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 0x564c445c5d90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f333000a9c0 tx=0x7f333000acd0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.412+0000 7f33585f4b80 1 -- 172.21.15.17:0/3605691341 shutdown_connections 2023-07-14T13:25:24.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.412+0000 7f33585f4b80 1 --2- 172.21.15.17:0/3605691341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 0x564c445c09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.412+0000 7f33585f4b80 1 --2- 172.21.15.17:0/3605691341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 0x564c445c5d90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.412+0000 7f33585f4b80 1 --2- 172.21.15.17:0/3605691341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c62d0 0x564c445c0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.412+0000 7f33585f4b80 1 -- 172.21.15.17:0/3605691341 >> 172.21.15.17:0/3605691341 conn(0x564c445b5be0 msgr2=0x564c445baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.428+0000 7f33585f4b80 1 -- 172.21.15.17:0/3605691341 shutdown_connections 2023-07-14T13:25:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.437+0000 7f33585f4b80 1 -- 172.21.15.17:0/3605691341 wait complete. 2023-07-14T13:25:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.438+0000 7f33585f4b80 1 -- start start 2023-07-14T13:25:24.449 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.438+0000 7f33585f4b80 1 Processor -- start 2023-07-14T13:25:24.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.440+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 0x564c445cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.440+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c0580 0x564c445c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.440+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c62d0 0x564c445c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.458 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.440+0000 7f33585f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c444b1a60 con 0x564c445c0580 2023-07-14T13:25:24.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.440+0000 7f33585f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c444b1760 con 0x564c445c62d0 2023-07-14T13:25:24.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.440+0000 7f33585f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c443958c0 con 0x564c4441c6b0 2023-07-14T13:25:24.459 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.440+0000 7f33585f4b80 10 client.0 _ll_register_callbacks cb 0x564c444af700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:25:24.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.449+0000 7f333ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c62d0 0x564c445c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.449+0000 7f333ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c62d0 0x564c445c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55062/0 (socket says 172.21.15.17:55062) 2023-07-14T13:25:24.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.449+0000 7f333ed9d700 1 -- 172.21.15.17:0/397994129 learned_addr learned my addr 172.21.15.17:0/397994129 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:24.460 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.449+0000 7f333e59c700 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 0x564c445cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.461 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.451+0000 7f333dd9b700 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c0580 0x564c445c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.460+0000 7f333e59c700 1 -- 172.21.15.17:0/397994129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c62d0 msgr2=0x564c445c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.460+0000 7f333e59c700 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c62d0 0x564c445c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.460+0000 7f333e59c700 1 -- 172.21.15.17:0/397994129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c0580 msgr2=0x564c445c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.460+0000 7f333e59c700 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c0580 0x564c445c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.460+0000 7f333e59c700 1 -- 172.21.15.17:0/397994129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333000a5f0 con 0x564c4441c6b0 2023-07-14T13:25:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.464+0000 7f333e59c700 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 0x564c445cc580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3330000c00 tx=0x7f3330005c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53d006752d711963 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.471+0000 7f3325ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:25:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.472+0000 7f3325ffb700 1 -- 172.21.15.17:0/397994129 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000f660 con 0x564c4441c6b0 2023-07-14T13:25:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.472+0000 7f3325ffb700 1 -- 172.21.15.17:0/397994129 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f333000f7c0 con 0x564c4441c6b0 2023-07-14T13:25:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.472+0000 7f33585f4b80 1 -- 172.21.15.17:0/397994129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c4446b490 con 0x564c4441c6b0 2023-07-14T13:25:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.485+0000 7f3325ffb700 1 -- 172.21.15.17:0/397994129 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f333000f980 con 0x564c4441c6b0 2023-07-14T13:25:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.494+0000 7f33585f4b80 10 client.29161 fetch_fsmap learned FSMap version 60 2023-07-14T13:25:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.494+0000 7f33585f4b80 1 -- 172.21.15.17:0/397994129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x564c44328c00 con 0x564c4441c6b0 2023-07-14T13:25:24.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.495+0000 7f3325ffb700 1 -- 172.21.15.17:0/397994129 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564c4446b490 con 0x564c4441c6b0 2023-07-14T13:25:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.495+0000 7f3325ffb700 1 -- 172.21.15.17:0/397994129 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 60) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f3330029070 con 0x564c4441c6b0 2023-07-14T13:25:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.496+0000 7f33585f4b80 10 client.29161 fetch_fsmap finished waiting for FSMap version 60 2023-07-14T13:25:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.496+0000 7f33585f4b80 10 client.29161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:25:24.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.496+0000 7f33585f4b80 20 client.29161 populate_metadata read hostname 'smithi017' 2023-07-14T13:25:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.496+0000 7f33585f4b80 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564c445eaa80 0x564c445ece90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.496+0000 7f33585f4b80 4 client.29161 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:25:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.496+0000 7f33585f4b80 1 -- 172.21.15.17:0/397994129 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c4450ae50 con 0x564c445eaa80 2023-07-14T13:25:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.502+0000 7f333dd9b700 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564c445eaa80 0x564c445ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.508+0000 7f333dd9b700 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564c445eaa80 0x564c445ece90 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0be47b135b3b2c5 server_cookie=c59cd2f95f4dc22a in_seq=0 out_seq=0 2023-07-14T13:25:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.508+0000 7f3325ffb700 10 client.29161 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.517+0000 7f3325ffb700 1 -- 172.21.15.17:0/397994129 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564c4450ae50 con 0x564c445eaa80 2023-07-14T13:25:24.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.517+0000 7f3325ffb700 10 client.29161 handle_command_reply: tid=0 2023-07-14T13:25:24.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.517+0000 7f33585f4b80 1 client.29161 shutdown 2023-07-14T13:25:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.521+0000 7f33585f4b80 1 -- 172.21.15.17:0/397994129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 msgr2=0x564c445cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:24.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.521+0000 7f33585f4b80 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 0x564c445cc580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3330000c00 tx=0x7f3330005c60 comp rx=0 tx=0).stop 2023-07-14T13:25:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.521+0000 7f33585f4b80 1 -- 172.21.15.17:0/397994129 shutdown_connections 2023-07-14T13:25:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.521+0000 7f33585f4b80 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564c445eaa80 0x564c445ece90 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.521+0000 7f33585f4b80 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c62d0 0x564c445c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.521+0000 7f33585f4b80 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c4441c6b0 0x564c445cc580 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.521+0000 7f33585f4b80 1 --2- 172.21.15.17:0/397994129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c0580 0x564c445c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.521+0000 7f33585f4b80 1 -- 172.21.15.17:0/397994129 >> 172.21.15.17:0/397994129 conn(0x564c445b5be0 msgr2=0x564c445ba4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.522+0000 7f3325ffb700 0 client.29161 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:24.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.522+0000 7f33585f4b80 1 -- 172.21.15.17:0/397994129 shutdown_connections 2023-07-14T13:25:24.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.527+0000 7f33585f4b80 1 -- 172.21.15.17:0/397994129 wait complete. 2023-07-14T13:25:24.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.532+0000 7f33585f4b80 20 client.29161 trim_cache size 0 max 16384 2023-07-14T13:25:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.561+0000 7f33585f4b80 1 Processor -- start 2023-07-14T13:25:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.561+0000 7f33585f4b80 1 -- start start 2023-07-14T13:25:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.562+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c445b5be0 0x564c445d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.562+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c4441c6b0 0x564c445cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.562+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c0580 0x564c445bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.562+0000 7f33585f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c445cade0 con 0x564c445c0580 2023-07-14T13:25:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.562+0000 7f33585f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c445bbfb0 con 0x564c4441c6b0 2023-07-14T13:25:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.562+0000 7f33585f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c445ca760 con 0x564c445b5be0 2023-07-14T13:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.562+0000 7f333dd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c4441c6b0 0x564c445cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.562+0000 7f333dd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c4441c6b0 0x564c445cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55078/0 (socket says 172.21.15.17:55078) 2023-07-14T13:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.562+0000 7f333dd9b700 1 -- 172.21.15.17:0/3261433663 learned_addr learned my addr 172.21.15.17:0/3261433663 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.563+0000 7f333ed9d700 1 --2- 172.21.15.17:0/3261433663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c0580 0x564c445bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.563+0000 7f333dd9b700 1 -- 172.21.15.17:0/3261433663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c445b5be0 msgr2=0x564c445d0c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.563+0000 7f333dd9b700 1 --2- 172.21.15.17:0/3261433663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c445b5be0 0x564c445d0c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.563+0000 7f333dd9b700 1 -- 172.21.15.17:0/3261433663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c0580 msgr2=0x564c445bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.563+0000 7f333dd9b700 1 --2- 172.21.15.17:0/3261433663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c0580 0x564c445bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.563+0000 7f333dd9b700 1 -- 172.21.15.17:0/3261433663 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c445e71c0 con 0x564c4441c6b0 2023-07-14T13:25:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.563+0000 7f333dd9b700 1 --2- 172.21.15.17:0/3261433663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c4441c6b0 0x564c445cc120 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f33340962b0 tx=0x7f3334004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21b1cf94ba9fa449 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.563+0000 7f332d7fa700 1 -- 172.21.15.17:0/3261433663 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334097be0 con 0x564c4441c6b0 2023-07-14T13:25:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.563+0000 7f332d7fa700 1 -- 172.21.15.17:0/3261433663 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33340107f0 con 0x564c4441c6b0 2023-07-14T13:25:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.563+0000 7f332d7fa700 1 -- 172.21.15.17:0/3261433663 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340b9310 con 0x564c4441c6b0 2023-07-14T13:25:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.565+0000 7f33585f4b80 1 -- 172.21.15.17:0/3261433663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c4441c6b0 msgr2=0x564c445cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.565+0000 7f33585f4b80 1 --2- 172.21.15.17:0/3261433663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c4441c6b0 0x564c445cc120 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f33340962b0 tx=0x7f3334004750 comp rx=0 tx=0).stop 2023-07-14T13:25:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.565+0000 7f33585f4b80 1 -- 172.21.15.17:0/3261433663 shutdown_connections 2023-07-14T13:25:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.565+0000 7f33585f4b80 1 --2- 172.21.15.17:0/3261433663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c445c0580 0x564c445bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.565+0000 7f33585f4b80 1 --2- 172.21.15.17:0/3261433663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c445b5be0 0x564c445d0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.565+0000 7f33585f4b80 1 --2- 172.21.15.17:0/3261433663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c4441c6b0 0x564c445cc120 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.565+0000 7f33585f4b80 1 -- 172.21.15.17:0/3261433663 >> 172.21.15.17:0/3261433663 conn(0x564c445d5770 msgr2=0x564c445c7190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.565+0000 7f33585f4b80 1 -- 172.21.15.17:0/3261433663 shutdown_connections 2023-07-14T13:25:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.565+0000 7f33585f4b80 1 -- 172.21.15.17:0/3261433663 wait complete. 2023-07-14T13:25:24.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.566+0000 7f33585f4b80 1 -- start start 2023-07-14T13:25:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.566+0000 7f33585f4b80 1 Processor -- start 2023-07-14T13:25:24.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.567+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c4441c6b0 0x564c445c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.567+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c445b5be0 0x564c445c1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.567+0000 7f33585f4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 0x564c445c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.567+0000 7f33585f4b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c445c3530 con 0x564c4441c6b0 2023-07-14T13:25:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f33585f4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c445c2210 con 0x564c445c0580 2023-07-14T13:25:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f33585f4b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c445c23d0 con 0x564c445b5be0 2023-07-14T13:25:24.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f33585f4b80 10 client.0 _ll_register_callbacks cb 0x7f3334099610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:25:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f333e59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c4441c6b0 0x564c445c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f333ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 0x564c445c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f333ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 0x564c445c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:55088/0 (socket says 172.21.15.17:55088) 2023-07-14T13:25:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f333ed9d700 1 -- 172.21.15.17:0/986994579 learned_addr learned my addr 172.21.15.17:0/986994579 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f333dd9b700 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c445b5be0 0x564c445c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f333dd9b700 1 -- 172.21.15.17:0/986994579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 msgr2=0x564c445c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f333dd9b700 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 0x564c445c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f333dd9b700 1 -- 172.21.15.17:0/986994579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c4441c6b0 msgr2=0x564c445c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:24.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.568+0000 7f333dd9b700 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c4441c6b0 0x564c445c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.569+0000 7f333dd9b700 1 -- 172.21.15.17:0/986994579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33340b7e70 con 0x564c445b5be0 2023-07-14T13:25:24.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.569+0000 7f333dd9b700 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c445b5be0 0x564c445c1790 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x564c4450af90 tx=0x7f3334099920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af537a06e5959c0e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:24.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.569+0000 7f3325ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:25:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.570+0000 7f3325ffb700 1 -- 172.21.15.17:0/986994579 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340c8070 con 0x564c445b5be0 2023-07-14T13:25:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.570+0000 7f3325ffb700 1 -- 172.21.15.17:0/986994579 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f33340109e0 con 0x564c445b5be0 2023-07-14T13:25:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.570+0000 7f33585f4b80 1 -- 172.21.15.17:0/986994579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f333000ae60 con 0x564c445b5be0 2023-07-14T13:25:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.571+0000 7f3325ffb700 1 -- 172.21.15.17:0/986994579 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33340b79d0 con 0x564c445b5be0 2023-07-14T13:25:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.571+0000 7f33585f4b80 10 client.29164 fetch_fsmap learned FSMap version 60 2023-07-14T13:25:24.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.571+0000 7f33585f4b80 1 -- 172.21.15.17:0/986994579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x564c443661f0 con 0x564c445b5be0 2023-07-14T13:25:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.571+0000 7f3325ffb700 1 -- 172.21.15.17:0/986994579 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33340bf020 con 0x564c445b5be0 2023-07-14T13:25:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.571+0000 7f3325ffb700 1 -- 172.21.15.17:0/986994579 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 60) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f3334098d30 con 0x564c445b5be0 2023-07-14T13:25:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.571+0000 7f33585f4b80 10 client.29164 fetch_fsmap finished waiting for FSMap version 60 2023-07-14T13:25:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.571+0000 7f33585f4b80 10 client.29164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:25:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.572+0000 7f33585f4b80 20 client.29164 populate_metadata read hostname 'smithi017' 2023-07-14T13:25:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.572+0000 7f33585f4b80 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564c445c62d0 0x564c446418a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:24.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.572+0000 7f33585f4b80 4 client.29164 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:25:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.572+0000 7f33585f4b80 1 -- 172.21.15.17:0/986994579 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564c444ccff0 con 0x564c445c62d0 2023-07-14T13:25:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.572+0000 7f333e59c700 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564c445c62d0 0x564c446418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.573+0000 7f3325ffb700 10 client.29164 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:24.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.573+0000 7f333e59c700 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564c445c62d0 0x564c446418a0 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d2a61629e162f30 server_cookie=c894b096915b6d3d in_seq=0 out_seq=0 2023-07-14T13:25:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.587+0000 7f3325ffb700 1 -- 172.21.15.17:0/986994579 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564c444ccff0 con 0x564c445c62d0 2023-07-14T13:25:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.587+0000 7f3325ffb700 10 client.29164 handle_command_reply: tid=0 2023-07-14T13:25:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.587+0000 7f33585f4b80 1 client.29164 shutdown 2023-07-14T13:25:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.587+0000 7f33585f4b80 1 -- 172.21.15.17:0/986994579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c445b5be0 msgr2=0x564c445c1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.587+0000 7f33585f4b80 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c445b5be0 0x564c445c1790 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x564c4450af90 tx=0x7f3334099920 comp rx=0 tx=0).stop 2023-07-14T13:25:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.588+0000 7f33585f4b80 1 -- 172.21.15.17:0/986994579 shutdown_connections 2023-07-14T13:25:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.588+0000 7f33585f4b80 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564c445c62d0 0x564c446418a0 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.588+0000 7f33585f4b80 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c445c0580 0x564c445c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.588+0000 7f33585f4b80 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564c4441c6b0 0x564c445c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.588+0000 7f33585f4b80 1 --2- 172.21.15.17:0/986994579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564c445b5be0 0x564c445c1790 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.588+0000 7f33585f4b80 1 -- 172.21.15.17:0/986994579 >> 172.21.15.17:0/986994579 conn(0x564c445d5770 msgr2=0x564c445c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.588+0000 7f3325ffb700 0 client.29164 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.588+0000 7f33585f4b80 1 -- 172.21.15.17:0/986994579 shutdown_connections 2023-07-14T13:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.588+0000 7f33585f4b80 1 -- 172.21.15.17:0/986994579 wait complete. 2023-07-14T13:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.588+0000 7f33585f4b80 20 client.29164 trim_cache size 0 max 16384 2023-07-14T13:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:25:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:25:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:25:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.589+0000 7f3344bff700 1 -- 172.21.15.17:0/267496771 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f33280c34e0 msgr2=0x7f33280c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.589+0000 7f3344bff700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f33280c34e0 0x7f33280c5990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f333800b070 tx=0x7f3338009340 comp rx=0 tx=0).stop 2023-07-14T13:25:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.589+0000 7f3344bff700 1 -- 172.21.15.17:0/267496771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f334010e2a0 msgr2=0x7f33401aafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.589+0000 7f3344bff700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f334010e2a0 0x7f33401aafe0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f333400b480 tx=0x7f333400b840 comp rx=0 tx=0).stop 2023-07-14T13:25:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.589+0000 7f3344bff700 1 -- 172.21.15.17:0/267496771 shutdown_connections 2023-07-14T13:25:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.589+0000 7f3344bff700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f33280c34e0 0x7f33280c5990 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.589+0000 7f3344bff700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33401a4900 0x7f33401a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.589+0000 7f3344bff700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f334006d3a0 0x7f33401aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.589+0000 7f3344bff700 1 --2- 172.21.15.17:0/267496771 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f334010e2a0 0x7f33401aafe0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.589+0000 7f3344bff700 1 -- 172.21.15.17:0/267496771 >> 172.21.15.17:0/267496771 conn(0x7f334006bd70 msgr2=0x7f334006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.590+0000 7f3344bff700 1 -- 172.21.15.17:0/267496771 shutdown_connections 2023-07-14T13:25:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:24.590+0000 7f3344bff700 1 -- 172.21.15.17:0/267496771 wait complete. 2023-07-14T13:25:25.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:25 smithi017 ceph-mon[95536]: pgmap v813: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 867 op/s 2023-07-14T13:25:25.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:25 smithi135 ceph-mon[97338]: pgmap v813: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 867 op/s 2023-07-14T13:25:25.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:25 smithi131 ceph-mon[96953]: pgmap v813: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.9 MiB/s wr, 867 op/s 2023-07-14T13:25:27.430 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 435.0 s, 554.3 tps, lat 178.277 ms stddev 292.701 2023-07-14T13:25:27.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:27 smithi017 ceph-mon[95536]: pgmap v814: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-07-14T13:25:27.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:27 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:25:27.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:27 smithi135 ceph-mon[97338]: pgmap v814: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-07-14T13:25:27.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:27 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:25:27.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:27 smithi131 ceph-mon[96953]: pgmap v814: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-07-14T13:25:27.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:27 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:25:29.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:29 smithi017 ceph-mon[95536]: pgmap v815: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.04k op/s 2023-07-14T13:25:29.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:29 smithi135 ceph-mon[97338]: pgmap v815: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.04k op/s 2023-07-14T13:25:29.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:29 smithi131 ceph-mon[96953]: pgmap v815: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 1.04k op/s 2023-07-14T13:25:31.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:31 smithi017 ceph-mon[95536]: pgmap v816: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-14T13:25:31.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:31 smithi135 ceph-mon[97338]: pgmap v816: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-14T13:25:31.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:31 smithi131 ceph-mon[96953]: pgmap v816: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-14T13:25:32.430 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 440.0 s, 427.2 tps, lat 235.280 ms stddev 145.407 2023-07-14T13:25:33.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:33 smithi017 ceph-mon[95536]: pgmap v817: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-07-14T13:25:33.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:33 smithi135 ceph-mon[97338]: pgmap v817: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-07-14T13:25:33.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:33 smithi131 ceph-mon[96953]: pgmap v817: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-07-14T13:25:35.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:35 smithi017 ceph-mon[95536]: pgmap v818: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-07-14T13:25:35.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:35 smithi135 ceph-mon[97338]: pgmap v818: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-07-14T13:25:35.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:35 smithi131 ceph-mon[96953]: pgmap v818: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-07-14T13:25:37.429 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 445.0 s, 567.4 tps, lat 176.871 ms stddev 77.524 2023-07-14T13:25:37.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:37 smithi017 ceph-mon[95536]: pgmap v819: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-07-14T13:25:37.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.860+0000 7f5dd3fff700 1 -- 172.21.15.17:0/1499433044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dcc06d3a0 msgr2=0x7f5dcc11b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:37.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.860+0000 7f5dd3fff700 1 --2- 172.21.15.17:0/1499433044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dcc06d3a0 0x7f5dcc11b470 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40098f0 tx=0x7f5dc4009c00 comp rx=0 tx=0).stop 2023-07-14T13:25:37.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.860+0000 7f5dd3fff700 1 -- 172.21.15.17:0/1499433044 shutdown_connections 2023-07-14T13:25:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.860+0000 7f5dd3fff700 1 --2- 172.21.15.17:0/1499433044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dcc06d3a0 0x7f5dcc11b470 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.860+0000 7f5dd3fff700 1 --2- 172.21.15.17:0/1499433044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dcc10e2a0 0x7f5dcc10e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.860+0000 7f5dd3fff700 1 --2- 172.21.15.17:0/1499433044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dcc06c910 0x7f5dcc06cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.860+0000 7f5dd3fff700 1 -- 172.21.15.17:0/1499433044 >> 172.21.15.17:0/1499433044 conn(0x7f5dcc06bd70 msgr2=0x7f5dcc070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.860+0000 7f5dd3fff700 1 -- 172.21.15.17:0/1499433044 shutdown_connections 2023-07-14T13:25:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.860+0000 7f5dd3fff700 1 -- 172.21.15.17:0/1499433044 wait complete. 2023-07-14T13:25:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.862+0000 7f5dd3fff700 1 Processor -- start 2023-07-14T13:25:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.862+0000 7f5dd3fff700 1 -- start start 2023-07-14T13:25:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.863+0000 7f5dd3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dcc06c910 0x7f5dcc1aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.863+0000 7f5dd3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dcc06d3a0 0x7f5dcc1aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.863+0000 7f5dd3fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dcc10e2a0 0x7f5dcc1a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.863+0000 7f5dd3fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc1a5020 con 0x7f5dcc10e2a0 2023-07-14T13:25:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.863+0000 7f5dd3fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc1a5190 con 0x7f5dcc06c910 2023-07-14T13:25:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.863+0000 7f5dd3fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc1a5350 con 0x7f5dcc06d3a0 2023-07-14T13:25:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.863+0000 7f5dd159a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dcc06d3a0 0x7f5dcc1aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.863+0000 7f5dd159a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dcc06d3a0 0x7f5dcc1aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54696/0 (socket says 172.21.15.17:54696) 2023-07-14T13:25:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.863+0000 7f5dd159a700 1 -- 172.21.15.17:0/3743117526 learned_addr learned my addr 172.21.15.17:0/3743117526 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.864+0000 7f5dd1d9b700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dcc06c910 0x7f5dcc1aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.864+0000 7f5dd159a700 1 -- 172.21.15.17:0/3743117526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dcc06c910 msgr2=0x7f5dcc1aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.864+0000 7f5dd159a700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dcc06c910 0x7f5dcc1aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.864+0000 7f5dd159a700 1 -- 172.21.15.17:0/3743117526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dcc10e2a0 msgr2=0x7f5dcc1a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.864+0000 7f5dd159a700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dcc10e2a0 0x7f5dcc1a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.864+0000 7f5dd159a700 1 -- 172.21.15.17:0/3743117526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4009520 con 0x7f5dcc06d3a0 2023-07-14T13:25:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.866+0000 7f5dd159a700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dcc06d3a0 0x7f5dcc1aafc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800c0c0 tx=0x7f5dc800c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:37.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.866+0000 7f5dc2ffd700 1 -- 172.21.15.17:0/3743117526 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8018070 con 0x7f5dcc06d3a0 2023-07-14T13:25:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.866+0000 7f5dc2ffd700 1 -- 172.21.15.17:0/3743117526 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dc800f040 con 0x7f5dcc06d3a0 2023-07-14T13:25:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.866+0000 7f5dc2ffd700 1 -- 172.21.15.17:0/3743117526 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800e020 con 0x7f5dcc06d3a0 2023-07-14T13:25:37.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.867+0000 7f5dd3fff700 1 -- 172.21.15.17:0/3743117526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dcc1a55d0 con 0x7f5dcc06d3a0 2023-07-14T13:25:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.867+0000 7f5dd3fff700 1 -- 172.21.15.17:0/3743117526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dcc1b1a00 con 0x7f5dcc06d3a0 2023-07-14T13:25:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.874+0000 7f5dc2ffd700 1 -- 172.21.15.17:0/3743117526 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5dc8007d10 con 0x7f5dcc06d3a0 2023-07-14T13:25:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.876+0000 7f5de7997b80 1 Processor -- start 2023-07-14T13:25:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.876+0000 7f5dc2ffd700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5db80a1450 0x7f5db80a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.876+0000 7f5dc2ffd700 1 -- 172.21.15.17:0/3743117526 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5dc80cc450 con 0x7f5dcc06d3a0 2023-07-14T13:25:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.877+0000 7f5de7997b80 1 -- start start 2023-07-14T13:25:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.877+0000 7f5dd259c700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5db80a1450 0x7f5db80a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.877+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b425616d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.877+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 0x55b425611040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.877+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b4256119d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.877+0000 7f5de7997b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b425516c50 con 0x55b42546d6b0 2023-07-14T13:25:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.877+0000 7f5de7997b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4255699e0 con 0x55b425611580 2023-07-14T13:25:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.877+0000 7f5de7997b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b425562e70 con 0x55b4256172d0 2023-07-14T13:25:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.878+0000 7f5dd159a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 0x55b425611040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.878+0000 7f5dd159a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 0x55b425611040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54698/0 (socket says 172.21.15.17:54698) 2023-07-14T13:25:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.878+0000 7f5dd159a700 1 -- 172.21.15.17:0/327196727 learned_addr learned my addr 172.21.15.17:0/327196727 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.878+0000 7f5dd1d9b700 1 --2- 172.21.15.17:0/327196727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b425616d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.878+0000 7f5dd259c700 1 --2- 172.21.15.17:0/327196727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b4256119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.878+0000 7f5dd159a700 1 -- 172.21.15.17:0/327196727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 msgr2=0x55b4256119d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.878+0000 7f5dd159a700 1 --2- 172.21.15.17:0/327196727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b4256119d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.878+0000 7f5dd159a700 1 -- 172.21.15.17:0/327196727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 msgr2=0x55b425616d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.878+0000 7f5dd159a700 1 --2- 172.21.15.17:0/327196727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b425616d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.878+0000 7f5dd159a700 1 -- 172.21.15.17:0/327196727 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b425390d80 con 0x55b4256172d0 2023-07-14T13:25:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.879+0000 7f5dd1d9b700 1 --2- 172.21.15.17:0/327196727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b425616d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:25:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.879+0000 7f5dd159a700 1 --2- 172.21.15.17:0/327196727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 0x55b425611040 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8095f50 tx=0x7f5dc8099150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0e8d51c285ea6ee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.879+0000 7f5dd259c700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5db80a1450 0x7f5db80a3900 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009230 tx=0x7f5dc400f540 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.879+0000 7f5db7fff700 1 -- 172.21.15.17:0/327196727 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800cd10 con 0x55b4256172d0 2023-07-14T13:25:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.879+0000 7f5db7fff700 1 -- 172.21.15.17:0/327196727 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dc80994e0 con 0x55b4256172d0 2023-07-14T13:25:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.879+0000 7f5db7fff700 1 -- 172.21.15.17:0/327196727 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8095bf0 con 0x55b4256172d0 2023-07-14T13:25:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.880+0000 7f5de7997b80 1 -- 172.21.15.17:0/327196727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 msgr2=0x55b425611040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.880+0000 7f5de7997b80 1 --2- 172.21.15.17:0/327196727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 0x55b425611040 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8095f50 tx=0x7f5dc8099150 comp rx=0 tx=0).stop 2023-07-14T13:25:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.881+0000 7f5de7997b80 1 -- 172.21.15.17:0/327196727 shutdown_connections 2023-07-14T13:25:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.881+0000 7f5de7997b80 1 --2- 172.21.15.17:0/327196727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b4256119d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.881+0000 7f5de7997b80 1 --2- 172.21.15.17:0/327196727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b425616d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.881+0000 7f5de7997b80 1 --2- 172.21.15.17:0/327196727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 0x55b425611040 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.881+0000 7f5de7997b80 1 -- 172.21.15.17:0/327196727 >> 172.21.15.17:0/327196727 conn(0x55b425606be0 msgr2=0x55b42560bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.881+0000 7f5de7997b80 1 -- 172.21.15.17:0/327196727 shutdown_connections 2023-07-14T13:25:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.881+0000 7f5de7997b80 1 -- 172.21.15.17:0/327196727 wait complete. 2023-07-14T13:25:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.882+0000 7f5de7997b80 1 -- start start 2023-07-14T13:25:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.882+0000 7f5de7997b80 1 Processor -- start 2023-07-14T13:25:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.883+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b42561d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.883+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b42561a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.883+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 0x55b42561b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.883+0000 7f5de7997b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b425502a60 con 0x55b42546d6b0 2023-07-14T13:25:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.883+0000 7f5de7997b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b425502760 con 0x55b425611580 2023-07-14T13:25:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.883+0000 7f5de7997b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4253e68c0 con 0x55b4256172d0 2023-07-14T13:25:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.883+0000 7f5de7997b80 10 client.0 _ll_register_callbacks cb 0x55b425500700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:25:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.884+0000 7f5dd259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 0x55b42561b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.884+0000 7f5dd259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 0x55b42561b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54702/0 (socket says 172.21.15.17:54702) 2023-07-14T13:25:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.884+0000 7f5dd259c700 1 -- 172.21.15.17:0/1653438084 learned_addr learned my addr 172.21.15.17:0/1653438084 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.884+0000 7f5dd159a700 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b42561a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.884+0000 7f5dd1d9b700 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b42561d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.884+0000 7f5dd159a700 1 -- 172.21.15.17:0/1653438084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 msgr2=0x55b42561b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.884+0000 7f5dd159a700 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 0x55b42561b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.884+0000 7f5dd159a700 1 -- 172.21.15.17:0/1653438084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 msgr2=0x55b42561d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.884+0000 7f5dd159a700 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b42561d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.884+0000 7f5dd159a700 1 -- 172.21.15.17:0/1653438084 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc009650 con 0x55b425611580 2023-07-14T13:25:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.887+0000 7f5dd159a700 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b42561a940 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x55b42560db40 tx=0x7f5dc800cd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=556d031efa1d222f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.887+0000 7f5db57fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:25:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.889+0000 7f5db57fa700 1 -- 172.21.15.17:0/1653438084 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80a19b0 con 0x55b425611580 2023-07-14T13:25:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.889+0000 7f5db57fa700 1 -- 172.21.15.17:0/1653438084 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5dc809d1b0 con 0x55b425611580 2023-07-14T13:25:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.889+0000 7f5de7997b80 1 -- 172.21.15.17:0/1653438084 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4254bc490 con 0x55b425611580 2023-07-14T13:25:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.890+0000 7f5db57fa700 1 -- 172.21.15.17:0/1653438084 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dc8095bf0 con 0x55b425611580 2023-07-14T13:25:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.890+0000 7f5de7997b80 10 client.29222 fetch_fsmap learned FSMap version 61 2023-07-14T13:25:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.890+0000 7f5de7997b80 1 -- 172.21.15.17:0/1653438084 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x7f5dcc1b1a00 con 0x55b425611580 2023-07-14T13:25:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.890+0000 7f5db57fa700 1 -- 172.21.15.17:0/1653438084 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b4254bc490 con 0x55b425611580 2023-07-14T13:25:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.891+0000 7f5db57fa700 1 -- 172.21.15.17:0/1653438084 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 61) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5dc80989d0 con 0x55b425611580 2023-07-14T13:25:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.891+0000 7f5de7997b80 10 client.29222 fetch_fsmap finished waiting for FSMap version 61 2023-07-14T13:25:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.891+0000 7f5de7997b80 10 client.29222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:25:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.891+0000 7f5de7997b80 20 client.29222 populate_metadata read hostname 'smithi017' 2023-07-14T13:25:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.891+0000 7f5de7997b80 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b42562a600 0x55b42562ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.891+0000 7f5de7997b80 4 client.29222 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:25:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.891+0000 7f5de7997b80 1 -- 172.21.15.17:0/1653438084 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b42555be50 con 0x55b42562a600 2023-07-14T13:25:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.892+0000 7f5dd1d9b700 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b42562a600 0x55b42562ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.893+0000 7f5dd1d9b700 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b42562a600 0x55b42562ca10 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb33e7040c3b968d server_cookie=6c613dc316b85ac8 in_seq=0 out_seq=0 2023-07-14T13:25:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.894+0000 7f5db57fa700 10 client.29222 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.895+0000 7f5db57fa700 1 -- 172.21.15.17:0/1653438084 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b42555be50 con 0x55b42562a600 2023-07-14T13:25:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.895+0000 7f5db57fa700 10 client.29222 handle_command_reply: tid=0 2023-07-14T13:25:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.895+0000 7f5de7997b80 1 client.29222 shutdown 2023-07-14T13:25:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5de7997b80 1 -- 172.21.15.17:0/1653438084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 msgr2=0x55b42561a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5de7997b80 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b42561a940 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x55b42560db40 tx=0x7f5dc800cd90 comp rx=0 tx=0).stop 2023-07-14T13:25:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5de7997b80 1 -- 172.21.15.17:0/1653438084 shutdown_connections 2023-07-14T13:25:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5de7997b80 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b42562a600 0x55b42562ca10 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5de7997b80 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4256172d0 0x55b42561b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5de7997b80 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b42561d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5db57fa700 0 client.29222 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5de7997b80 1 --2- 172.21.15.17:0/1653438084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b42561a940 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5de7997b80 1 -- 172.21.15.17:0/1653438084 >> 172.21.15.17:0/1653438084 conn(0x55b425606be0 msgr2=0x55b42560b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5de7997b80 1 -- 172.21.15.17:0/1653438084 shutdown_connections 2023-07-14T13:25:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5de7997b80 1 -- 172.21.15.17:0/1653438084 wait complete. 2023-07-14T13:25:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.896+0000 7f5de7997b80 20 client.29222 trim_cache size 0 max 16384 2023-07-14T13:25:37.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:37 smithi135 ceph-mon[97338]: pgmap v819: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-07-14T13:25:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.928+0000 7f5de7997b80 1 Processor -- start 2023-07-14T13:25:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.929+0000 7f5de7997b80 1 -- start start 2023-07-14T13:25:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.929+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b425606be0 0x55b425611040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.929+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b4256161e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.929+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b42560bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.929+0000 7f5de7997b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4256176a0 con 0x55b42546d6b0 2023-07-14T13:25:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.929+0000 7f5de7997b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42561bdd0 con 0x55b425611580 2023-07-14T13:25:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.929+0000 7f5de7997b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42561b630 con 0x55b425606be0 2023-07-14T13:25:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.930+0000 7f5dd259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b42560bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.930+0000 7f5dd259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b42560bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:37580/0 (socket says 172.21.15.17:37580) 2023-07-14T13:25:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.930+0000 7f5dd259c700 1 -- 172.21.15.17:0/4130775965 learned_addr learned my addr 172.21.15.17:0/4130775965 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.930+0000 7f5dd1d9b700 1 --2- 172.21.15.17:0/4130775965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b425606be0 0x55b425611040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.930+0000 7f5dd259c700 1 -- 172.21.15.17:0/4130775965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b425606be0 msgr2=0x55b425611040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.930+0000 7f5dd259c700 1 --2- 172.21.15.17:0/4130775965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b425606be0 0x55b425611040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.930+0000 7f5dd159a700 1 --2- 172.21.15.17:0/4130775965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b4256161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.930+0000 7f5dd259c700 1 -- 172.21.15.17:0/4130775965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 msgr2=0x55b4256161e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.931+0000 7f5dd259c700 1 --2- 172.21.15.17:0/4130775965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b4256161e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.931+0000 7f5dd259c700 1 -- 172.21.15.17:0/4130775965 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b425631650 con 0x55b425611580 2023-07-14T13:25:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.931+0000 7f5dd159a700 1 --2- 172.21.15.17:0/4130775965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b4256161e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:25:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.932+0000 7f5dd259c700 1 --2- 172.21.15.17:0/4130775965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b42560bc60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400f890 tx=0x7f5dc4005b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=904bedf910bb9488 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.934+0000 7f5dc0ff9700 1 -- 172.21.15.17:0/4130775965 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc402c040 con 0x55b425611580 2023-07-14T13:25:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.934+0000 7f5dc0ff9700 1 -- 172.21.15.17:0/4130775965 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dc401d050 con 0x55b425611580 2023-07-14T13:25:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.934+0000 7f5dc0ff9700 1 -- 172.21.15.17:0/4130775965 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4003680 con 0x55b425611580 2023-07-14T13:25:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.935+0000 7f5de7997b80 1 -- 172.21.15.17:0/4130775965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 msgr2=0x55b42560bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.935+0000 7f5de7997b80 1 --2- 172.21.15.17:0/4130775965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b42560bc60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400f890 tx=0x7f5dc4005b40 comp rx=0 tx=0).stop 2023-07-14T13:25:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.936+0000 7f5de7997b80 1 -- 172.21.15.17:0/4130775965 shutdown_connections 2023-07-14T13:25:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.936+0000 7f5de7997b80 1 --2- 172.21.15.17:0/4130775965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b42560bc60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.936+0000 7f5de7997b80 1 --2- 172.21.15.17:0/4130775965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b425606be0 0x55b425611040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.936+0000 7f5de7997b80 1 --2- 172.21.15.17:0/4130775965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b4256161e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.936+0000 7f5de7997b80 1 -- 172.21.15.17:0/4130775965 >> 172.21.15.17:0/4130775965 conn(0x55b425626770 msgr2=0x55b425615ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.936+0000 7f5de7997b80 1 -- 172.21.15.17:0/4130775965 shutdown_connections 2023-07-14T13:25:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.936+0000 7f5de7997b80 1 -- 172.21.15.17:0/4130775965 wait complete. 2023-07-14T13:25:37.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.937+0000 7f5de7997b80 1 -- start start 2023-07-14T13:25:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.938+0000 7f5de7997b80 1 Processor -- start 2023-07-14T13:25:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.938+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b425621b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.938+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b425606be0 0x55b42561feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.938+0000 7f5de7997b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b4256203f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.938+0000 7f5de7997b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b425620970 con 0x55b42546d6b0 2023-07-14T13:25:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.938+0000 7f5de7997b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b425620ab0 con 0x55b425611580 2023-07-14T13:25:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.938+0000 7f5de7997b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b425620c70 con 0x55b425606be0 2023-07-14T13:25:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.938+0000 7f5de7997b80 10 client.0 _ll_register_callbacks cb 0x7f5dbc009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:25:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.939+0000 7f5dd259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b4256203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.939+0000 7f5dd259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b4256203f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:37592/0 (socket says 172.21.15.17:37592) 2023-07-14T13:25:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.939+0000 7f5dd259c700 1 -- 172.21.15.17:0/3688005989 learned_addr learned my addr 172.21.15.17:0/3688005989 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.940+0000 7f5dd259c700 1 -- 172.21.15.17:0/3688005989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b425606be0 msgr2=0x55b42561feb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:25:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.940+0000 7f5dd259c700 1 --2- 172.21.15.17:0/3688005989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b425606be0 0x55b42561feb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.940+0000 7f5dd259c700 1 -- 172.21.15.17:0/3688005989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 msgr2=0x55b425621b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.940+0000 7f5dd259c700 1 --2- 172.21.15.17:0/3688005989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b425621b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.940+0000 7f5dd259c700 1 -- 172.21.15.17:0/3688005989 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc401f070 con 0x55b425611580 2023-07-14T13:25:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.941+0000 7f5dd259c700 1 --2- 172.21.15.17:0/3688005989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b4256203f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400f860 tx=0x7f5dc4005370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b00452b91976e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.941+0000 7f5db57fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:25:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.941+0000 7f5db57fa700 1 -- 172.21.15.17:0/3688005989 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc402c070 con 0x55b425611580 2023-07-14T13:25:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.941+0000 7f5db57fa700 1 -- 172.21.15.17:0/3688005989 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5dc40056c0 con 0x55b425611580 2023-07-14T13:25:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.941+0000 7f5de7997b80 1 -- 172.21.15.17:0/3688005989 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5dc80994e0 con 0x55b425611580 2023-07-14T13:25:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.942+0000 7f5db57fa700 1 -- 172.21.15.17:0/3688005989 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dc400b970 con 0x55b425611580 2023-07-14T13:25:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.942+0000 7f5de7997b80 10 client.29228 fetch_fsmap learned FSMap version 61 2023-07-14T13:25:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.942+0000 7f5de7997b80 1 -- 172.21.15.17:0/3688005989 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x55b425379c00 con 0x55b425611580 2023-07-14T13:25:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.943+0000 7f5db57fa700 1 -- 172.21.15.17:0/3688005989 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dc80994e0 con 0x55b425611580 2023-07-14T13:25:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.943+0000 7f5db57fa700 1 -- 172.21.15.17:0/3688005989 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 61) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5dc403a590 con 0x55b425611580 2023-07-14T13:25:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.943+0000 7f5de7997b80 10 client.29228 fetch_fsmap finished waiting for FSMap version 61 2023-07-14T13:25:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.943+0000 7f5de7997b80 10 client.29228 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:25:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.943+0000 7f5de7997b80 20 client.29228 populate_metadata read hostname 'smithi017' 2023-07-14T13:25:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.943+0000 7f5de7997b80 1 --2- 172.21.15.17:0/3688005989 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4256172d0 0x55b425681480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.943+0000 7f5de7997b80 4 client.29228 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:25:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.943+0000 7f5de7997b80 1 -- 172.21.15.17:0/3688005989 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b42551dff0 con 0x55b4256172d0 2023-07-14T13:25:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.944+0000 7f5dd1d9b700 1 --2- 172.21.15.17:0/3688005989 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4256172d0 0x55b425681480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:37.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.946+0000 7f5dd1d9b700 1 --2- 172.21.15.17:0/3688005989 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4256172d0 0x55b425681480 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b0389681e568f12 server_cookie=7e01021b706077f1 in_seq=0 out_seq=0 2023-07-14T13:25:37.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.946+0000 7f5db57fa700 10 client.29228 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:37.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:37 smithi131 ceph-mon[96953]: pgmap v819: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-07-14T13:25:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.991+0000 7f5db57fa700 1 -- 172.21.15.17:0/3688005989 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b42551dff0 con 0x55b4256172d0 2023-07-14T13:25:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.991+0000 7f5db57fa700 10 client.29228 handle_command_reply: tid=0 2023-07-14T13:25:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.991+0000 7f5de7997b80 1 client.29228 shutdown 2023-07-14T13:25:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.992+0000 7f5de7997b80 1 -- 172.21.15.17:0/3688005989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 msgr2=0x55b4256203f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.992+0000 7f5de7997b80 1 --2- 172.21.15.17:0/3688005989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b4256203f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400f860 tx=0x7f5dc4005370 comp rx=0 tx=0).stop 2023-07-14T13:25:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.992+0000 7f5de7997b80 1 -- 172.21.15.17:0/3688005989 shutdown_connections 2023-07-14T13:25:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.992+0000 7f5de7997b80 1 --2- 172.21.15.17:0/3688005989 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4256172d0 0x55b425681480 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.992+0000 7f5de7997b80 1 --2- 172.21.15.17:0/3688005989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b425611580 0x55b4256203f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.992+0000 7f5de7997b80 1 --2- 172.21.15.17:0/3688005989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b42546d6b0 0x55b425621b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.992+0000 7f5de7997b80 1 --2- 172.21.15.17:0/3688005989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b425606be0 0x55b42561feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.992+0000 7f5de7997b80 1 -- 172.21.15.17:0/3688005989 >> 172.21.15.17:0/3688005989 conn(0x55b425626770 msgr2=0x55b425619980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.992+0000 7f5db57fa700 0 client.29228 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.992+0000 7f5de7997b80 1 -- 172.21.15.17:0/3688005989 shutdown_connections 2023-07-14T13:25:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.992+0000 7f5de7997b80 1 -- 172.21.15.17:0/3688005989 wait complete. 2023-07-14T13:25:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.993+0000 7f5de7997b80 20 client.29228 trim_cache size 0 max 16384 2023-07-14T13:25:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:25:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:25:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:25:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:25:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.995+0000 7f5dd3fff700 1 -- 172.21.15.17:0/3743117526 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5db80a1450 msgr2=0x7f5db80a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.995+0000 7f5dd3fff700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5db80a1450 0x7f5db80a3900 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009230 tx=0x7f5dc400f540 comp rx=0 tx=0).stop 2023-07-14T13:25:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.995+0000 7f5dd3fff700 1 -- 172.21.15.17:0/3743117526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dcc06d3a0 msgr2=0x7f5dcc1aafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.995+0000 7f5dd3fff700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dcc06d3a0 0x7f5dcc1aafc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800c0c0 tx=0x7f5dc800c3d0 comp rx=0 tx=0).stop 2023-07-14T13:25:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.995+0000 7f5dd3fff700 1 -- 172.21.15.17:0/3743117526 shutdown_connections 2023-07-14T13:25:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.995+0000 7f5dd3fff700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5db80a1450 0x7f5db80a3900 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.995+0000 7f5dd3fff700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dcc10e2a0 0x7f5dcc1a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.995+0000 7f5dd3fff700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dcc06c910 0x7f5dcc1aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.995+0000 7f5dd3fff700 1 --2- 172.21.15.17:0/3743117526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dcc06d3a0 0x7f5dcc1aafc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.995+0000 7f5dd3fff700 1 -- 172.21.15.17:0/3743117526 >> 172.21.15.17:0/3743117526 conn(0x7f5dcc06bd70 msgr2=0x7f5dcc070880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.998+0000 7f5dd3fff700 1 -- 172.21.15.17:0/3743117526 shutdown_connections 2023-07-14T13:25:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:37.998+0000 7f5dd3fff700 1 -- 172.21.15.17:0/3743117526 wait complete. 2023-07-14T13:25:38.836 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:38 smithi017 ceph-mon[95536]: pgmap v820: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-07-14T13:25:38.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:38 smithi135 ceph-mon[97338]: pgmap v820: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-07-14T13:25:38.976 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:38 smithi131 ceph-mon[96953]: pgmap v820: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-07-14T13:25:41.679 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:41 smithi135 ceph-mon[97338]: pgmap v821: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.46k op/s 2023-07-14T13:25:41.726 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:41 smithi131 ceph-mon[96953]: pgmap v821: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.46k op/s 2023-07-14T13:25:41.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:41 smithi017 ceph-mon[95536]: pgmap v821: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.46k op/s 2023-07-14T13:25:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 450.0 s, 699.8 tps, lat 142.958 ms stddev 43.803 2023-07-14T13:25:43.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:43 smithi017 ceph-mon[95536]: pgmap v822: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 18 MiB/s wr, 1.50k op/s 2023-07-14T13:25:43.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:43 smithi135 ceph-mon[97338]: pgmap v822: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 18 MiB/s wr, 1.50k op/s 2023-07-14T13:25:43.976 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:43 smithi131 ceph-mon[96953]: pgmap v822: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 18 MiB/s wr, 1.50k op/s 2023-07-14T13:25:45.836 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:45 smithi017 ceph-mon[95536]: pgmap v823: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.19k op/s 2023-07-14T13:25:45.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:45 smithi135 ceph-mon[97338]: pgmap v823: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.19k op/s 2023-07-14T13:25:45.976 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:45 smithi131 ceph-mon[96953]: pgmap v823: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.19k op/s 2023-07-14T13:25:47.429 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 455.0 s, 523.0 tps, lat 190.431 ms stddev 56.365 2023-07-14T13:25:47.836 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:47 smithi017 ceph-mon[95536]: pgmap v824: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 20 MiB/s wr, 1.79k op/s 2023-07-14T13:25:47.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:47 smithi135 ceph-mon[97338]: pgmap v824: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 20 MiB/s wr, 1.79k op/s 2023-07-14T13:25:47.976 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:47 smithi131 ceph-mon[96953]: pgmap v824: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 20 MiB/s wr, 1.79k op/s 2023-07-14T13:25:49.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:49 smithi017 ceph-mon[95536]: pgmap v825: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 1.19k op/s 2023-07-14T13:25:49.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:49 smithi135 ceph-mon[97338]: pgmap v825: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 1.19k op/s 2023-07-14T13:25:49.976 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:49 smithi131 ceph-mon[96953]: pgmap v825: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 1.19k op/s 2023-07-14T13:25:51.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.276+0000 7f60ddbff700 1 -- 172.21.15.17:0/3734838054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60d8110b20 msgr2=0x7f60d8112f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:51.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.276+0000 7f60ddbff700 1 --2- 172.21.15.17:0/3734838054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60d8110b20 0x7f60d8112f00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f60d0009f90 tx=0x7f60d000b330 comp rx=0 tx=0).stop 2023-07-14T13:25:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.279+0000 7f60ddbff700 1 -- 172.21.15.17:0/3734838054 shutdown_connections 2023-07-14T13:25:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.279+0000 7f60ddbff700 1 --2- 172.21.15.17:0/3734838054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60d8110b20 0x7f60d8112f00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.279+0000 7f60ddbff700 1 --2- 172.21.15.17:0/3734838054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60d80728b0 0x7f60d8072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.279+0000 7f60ddbff700 1 --2- 172.21.15.17:0/3734838054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d80731c0 0x7f60d81105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.279+0000 7f60ddbff700 1 -- 172.21.15.17:0/3734838054 >> 172.21.15.17:0/3734838054 conn(0x7f60d80fb650 msgr2=0x7f60d80fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:51.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.282+0000 7f60ddbff700 1 -- 172.21.15.17:0/3734838054 shutdown_connections 2023-07-14T13:25:51.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.282+0000 7f60ddbff700 1 -- 172.21.15.17:0/3734838054 wait complete. 2023-07-14T13:25:51.293 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.284+0000 7f60ddbff700 1 Processor -- start 2023-07-14T13:25:51.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.285+0000 7f60ddbff700 1 -- start start 2023-07-14T13:25:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.285+0000 7f60ddbff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60d80728b0 0x7f60d8110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.285+0000 7f60ddbff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d80731c0 0x7f60d8110590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.285+0000 7f60ddbff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60d8110b20 0x7f60d8108ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.285+0000 7f60ddbff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d81097c0 con 0x7f60d80731c0 2023-07-14T13:25:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.285+0000 7f60ddbff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d8109930 con 0x7f60d8110b20 2023-07-14T13:25:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.285+0000 7f60ddbff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d8109af0 con 0x7f60d80728b0 2023-07-14T13:25:51.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.289+0000 7f60d6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d80731c0 0x7f60d8110590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.289+0000 7f60d6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d80731c0 0x7f60d8110590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43892/0 (socket says 172.21.15.17:43892) 2023-07-14T13:25:51.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.289+0000 7f60d6ffd700 1 -- 172.21.15.17:0/2253259579 learned_addr learned my addr 172.21.15.17:0/2253259579 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:51.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.289+0000 7f60d77fe700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60d80728b0 0x7f60d8110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.290+0000 7f60d7fff700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60d8110b20 0x7f60d8108ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.295+0000 7f60d6ffd700 1 -- 172.21.15.17:0/2253259579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60d80728b0 msgr2=0x7f60d8110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:51.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.295+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60d80728b0 0x7f60d8110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.295+0000 7f60d6ffd700 1 -- 172.21.15.17:0/2253259579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60d8110b20 msgr2=0x7f60d8108ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:51.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.295+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60d8110b20 0x7f60d8108ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.295+0000 7f60d6ffd700 1 -- 172.21.15.17:0/2253259579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d0009c40 con 0x7f60d80731c0 2023-07-14T13:25:51.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.296+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d80731c0 0x7f60d8110590 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f60c800d950 tx=0x7f60c800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.298+0000 7f60d4ff9700 1 -- 172.21.15.17:0/2253259579 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8009930 con 0x7f60d80731c0 2023-07-14T13:25:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.298+0000 7f60d4ff9700 1 -- 172.21.15.17:0/2253259579 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60c8010460 con 0x7f60d80731c0 2023-07-14T13:25:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.298+0000 7f60d4ff9700 1 -- 172.21.15.17:0/2253259579 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c800f620 con 0x7f60d80731c0 2023-07-14T13:25:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.298+0000 7f60ddbff700 1 -- 172.21.15.17:0/2253259579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d810dba0 con 0x7f60d80731c0 2023-07-14T13:25:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.298+0000 7f60ddbff700 1 -- 172.21.15.17:0/2253259579 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d810e060 con 0x7f60d80731c0 2023-07-14T13:25:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.305+0000 7f60f1427b80 1 Processor -- start 2023-07-14T13:25:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.306+0000 7f60f1427b80 1 -- start start 2023-07-14T13:25:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.306+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 0x556f27f73d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.306+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 0x556f27f6e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.306+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27f6e580 0x556f27f6e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.306+0000 7f60f1427b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27e73c50 con 0x556f27f6e580 2023-07-14T13:25:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.306+0000 7f60f1427b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27ec69e0 con 0x556f27dca6b0 2023-07-14T13:25:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.306+0000 7f60f1427b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27ebfe70 con 0x556f27f742d0 2023-07-14T13:25:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.307+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 0x556f27f73d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.307+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 0x556f27f73d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58150/0 (socket says 172.21.15.17:58150) 2023-07-14T13:25:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.307+0000 7f60d7fff700 1 -- 172.21.15.17:0/1727056870 learned_addr learned my addr 172.21.15.17:0/1727056870 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.307+0000 7f60d77fe700 1 --2- 172.21.15.17:0/1727056870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 0x556f27f6e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.308+0000 7f60d7fff700 1 -- 172.21.15.17:0/1727056870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 msgr2=0x556f27f6e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.308+0000 7f60d7fff700 1 --2- 172.21.15.17:0/1727056870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 0x556f27f6e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.308+0000 7f60d7fff700 1 -- 172.21.15.17:0/1727056870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27f6e580 msgr2=0x556f27f6e9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:25:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.308+0000 7f60d7fff700 1 --2- 172.21.15.17:0/1727056870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27f6e580 0x556f27f6e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.308+0000 7f60d7fff700 1 -- 172.21.15.17:0/1727056870 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f27cedd80 con 0x556f27dca6b0 2023-07-14T13:25:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.308+0000 7f60d7fff700 1 --2- 172.21.15.17:0/1727056870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 0x556f27f73d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f60d0009b70 tx=0x7f60d0009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71b084bcb0f490d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:51.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.310+0000 7f60bdffb700 1 -- 172.21.15.17:0/1727056870 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d000e040 con 0x556f27dca6b0 2023-07-14T13:25:51.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.310+0000 7f60bdffb700 1 -- 172.21.15.17:0/1727056870 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60d0007720 con 0x556f27dca6b0 2023-07-14T13:25:51.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.310+0000 7f60bdffb700 1 -- 172.21.15.17:0/1727056870 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d000be60 con 0x556f27dca6b0 2023-07-14T13:25:51.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.310+0000 7f60d4ff9700 1 -- 172.21.15.17:0/2253259579 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f60c80105d0 con 0x7f60d80731c0 2023-07-14T13:25:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.311+0000 7f60f1427b80 1 -- 172.21.15.17:0/1727056870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 msgr2=0x556f27f73d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.311+0000 7f60f1427b80 1 --2- 172.21.15.17:0/1727056870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 0x556f27f73d90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f60d0009b70 tx=0x7f60d0009ba0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.311+0000 7f60f1427b80 1 -- 172.21.15.17:0/1727056870 shutdown_connections 2023-07-14T13:25:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.311+0000 7f60f1427b80 1 --2- 172.21.15.17:0/1727056870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27f6e580 0x556f27f6e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.311+0000 7f60f1427b80 1 --2- 172.21.15.17:0/1727056870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 0x556f27f73d90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.311+0000 7f60f1427b80 1 --2- 172.21.15.17:0/1727056870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 0x556f27f6e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.311+0000 7f60f1427b80 1 -- 172.21.15.17:0/1727056870 >> 172.21.15.17:0/1727056870 conn(0x556f27f63be0 msgr2=0x556f27f68f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.312+0000 7f60f1427b80 1 -- 172.21.15.17:0/1727056870 shutdown_connections 2023-07-14T13:25:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.312+0000 7f60f1427b80 1 -- 172.21.15.17:0/1727056870 wait complete. 2023-07-14T13:25:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.313+0000 7f60f1427b80 1 -- start start 2023-07-14T13:25:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.313+0000 7f60d4ff9700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c00a13e0 0x7f60c00a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.313+0000 7f60d4ff9700 1 -- 172.21.15.17:0/2253259579 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f60c80cc5c0 con 0x7f60d80731c0 2023-07-14T13:25:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.313+0000 7f60f1427b80 1 Processor -- start 2023-07-14T13:25:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.314+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 0x556f27f7a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.314+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 0x556f27f77950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.314+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27f742d0 0x556f27f77ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.314+0000 7f60f1427b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27e5fa60 con 0x556f27dca6b0 2023-07-14T13:25:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.314+0000 7f60f1427b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27e5f760 con 0x556f27f742d0 2023-07-14T13:25:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.314+0000 7f60f1427b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27d438c0 con 0x556f27f6e580 2023-07-14T13:25:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.314+0000 7f60f1427b80 10 client.0 _ll_register_callbacks cb 0x556f27e5d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:25:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.315+0000 7f60d77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 0x556f27f7a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.315+0000 7f60d77fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 0x556f27f7a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43902/0 (socket says 172.21.15.17:43902) 2023-07-14T13:25:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.315+0000 7f60d77fe700 1 -- 172.21.15.17:0/2993242324 learned_addr learned my addr 172.21.15.17:0/2993242324 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.315+0000 7f60d7fff700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c00a13e0 0x7f60c00a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.315+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 0x556f27f77950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.315+0000 7f60d6ffd700 1 -- 172.21.15.17:0/2993242324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27f742d0 msgr2=0x556f27f77ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.315+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27f742d0 0x556f27f77ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.315+0000 7f60d6ffd700 1 -- 172.21.15.17:0/2993242324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 msgr2=0x556f27f7a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.315+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 0x556f27f7a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.315+0000 7f60d6ffd700 1 -- 172.21.15.17:0/2993242324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d81137c0 con 0x556f27f6e580 2023-07-14T13:25:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.316+0000 7f60d77fe700 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 0x556f27f7a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:25:51.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.316+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 0x556f27f77950 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f60c80c9cd0 tx=0x7f60c8099510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5f4428f76ae69fe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.316+0000 7f60b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:25:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.316+0000 7f60b6ffd700 1 -- 172.21.15.17:0/2993242324 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8009c90 con 0x556f27f6e580 2023-07-14T13:25:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.316+0000 7f60f1427b80 1 -- 172.21.15.17:0/2993242324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f27e19490 con 0x556f27f6e580 2023-07-14T13:25:51.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.316+0000 7f60b6ffd700 1 -- 172.21.15.17:0/2993242324 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f60c8099650 con 0x556f27f6e580 2023-07-14T13:25:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.317+0000 7f60b6ffd700 1 -- 172.21.15.17:0/2993242324 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60c809d680 con 0x556f27f6e580 2023-07-14T13:25:51.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.317+0000 7f60d7fff700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c00a13e0 0x7f60c00a3890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f60d000b6c0 tx=0x7f60d0007890 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.317+0000 7f60f1427b80 10 client.29191 fetch_fsmap learned FSMap version 61 2023-07-14T13:25:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.317+0000 7f60f1427b80 1 -- 172.21.15.17:0/2993242324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x556f27cd6c00 con 0x556f27f6e580 2023-07-14T13:25:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.317+0000 7f60b6ffd700 1 -- 172.21.15.17:0/2993242324 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556f27e19490 con 0x556f27f6e580 2023-07-14T13:25:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.318+0000 7f60b6ffd700 1 -- 172.21.15.17:0/2993242324 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 61) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f60c8098b40 con 0x556f27f6e580 2023-07-14T13:25:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.318+0000 7f60f1427b80 10 client.29191 fetch_fsmap finished waiting for FSMap version 61 2023-07-14T13:25:51.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.318+0000 7f60f1427b80 10 client.29191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:25:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.318+0000 7f60f1427b80 20 client.29191 populate_metadata read hostname 'smithi017' 2023-07-14T13:25:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.318+0000 7f60f1427b80 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556f27f87aa0 0x556f27f89eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.318+0000 7f60f1427b80 4 client.29191 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:25:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.318+0000 7f60f1427b80 1 -- 172.21.15.17:0/2993242324 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f27eb8e50 con 0x556f27f87aa0 2023-07-14T13:25:51.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.319+0000 7f60d77fe700 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556f27f87aa0 0x556f27f89eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.320+0000 7f60d77fe700 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556f27f87aa0 0x556f27f89eb0 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=537f3d33bf1aa947 server_cookie=5eee849a7ececc22 in_seq=0 out_seq=0 2023-07-14T13:25:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.320+0000 7f60b6ffd700 10 client.29191 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.321+0000 7f60b6ffd700 1 -- 172.21.15.17:0/2993242324 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556f27eb8e50 con 0x556f27f87aa0 2023-07-14T13:25:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.321+0000 7f60b6ffd700 10 client.29191 handle_command_reply: tid=0 2023-07-14T13:25:51.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.321+0000 7f60f1427b80 1 client.29191 shutdown 2023-07-14T13:25:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.322+0000 7f60f1427b80 1 -- 172.21.15.17:0/2993242324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 msgr2=0x556f27f77950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.322+0000 7f60f1427b80 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 0x556f27f77950 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f60c80c9cd0 tx=0x7f60c8099510 comp rx=0 tx=0).stop 2023-07-14T13:25:51.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.322+0000 7f60f1427b80 1 -- 172.21.15.17:0/2993242324 shutdown_connections 2023-07-14T13:25:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.322+0000 7f60f1427b80 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556f27f87aa0 0x556f27f89eb0 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.322+0000 7f60f1427b80 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27f742d0 0x556f27f77ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.322+0000 7f60b6ffd700 0 client.29191 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:51.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.322+0000 7f60f1427b80 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 0x556f27f7a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.322+0000 7f60f1427b80 1 --2- 172.21.15.17:0/2993242324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 0x556f27f77950 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.322+0000 7f60f1427b80 1 -- 172.21.15.17:0/2993242324 >> 172.21.15.17:0/2993242324 conn(0x556f27f63be0 msgr2=0x556f27f67c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.322+0000 7f60f1427b80 1 -- 172.21.15.17:0/2993242324 shutdown_connections 2023-07-14T13:25:51.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.322+0000 7f60f1427b80 1 -- 172.21.15.17:0/2993242324 wait complete. 2023-07-14T13:25:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.323+0000 7f60f1427b80 20 client.29191 trim_cache size 0 max 16384 2023-07-14T13:25:51.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.350+0000 7f60f1427b80 1 Processor -- start 2023-07-14T13:25:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.350+0000 7f60f1427b80 1 -- start start 2023-07-14T13:25:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.351+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 0x556f27f6e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.351+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27f6e580 0x556f27f7ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.351+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 0x556f27f68c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.351+0000 7f60f1427b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27f748a0 con 0x556f27f6e580 2023-07-14T13:25:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.351+0000 7f60f1427b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27f65d00 con 0x556f27dca6b0 2023-07-14T13:25:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.351+0000 7f60f1427b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27f60bb0 con 0x556f27f742d0 2023-07-14T13:25:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.352+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 0x556f27f68c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.352+0000 7f60d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 0x556f27f68c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44686/0 (socket says 172.21.15.17:44686) 2023-07-14T13:25:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.352+0000 7f60d7fff700 1 -- 172.21.15.17:0/1289613861 learned_addr learned my addr 172.21.15.17:0/1289613861 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.353+0000 7f60d77fe700 1 --2- 172.21.15.17:0/1289613861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 0x556f27f6e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.353+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/1289613861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27f6e580 0x556f27f7ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.353+0000 7f60d7fff700 1 -- 172.21.15.17:0/1289613861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 msgr2=0x556f27f6e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.353+0000 7f60d7fff700 1 --2- 172.21.15.17:0/1289613861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 0x556f27f6e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.354+0000 7f60d7fff700 1 -- 172.21.15.17:0/1289613861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27f6e580 msgr2=0x556f27f7ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.354+0000 7f60d7fff700 1 --2- 172.21.15.17:0/1289613861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27f6e580 0x556f27f7ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.354+0000 7f60d7fff700 1 -- 172.21.15.17:0/1289613861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f27f65420 con 0x556f27f742d0 2023-07-14T13:25:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.354+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/1289613861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27f6e580 0x556f27f7ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:25:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.354+0000 7f60d7fff700 1 --2- 172.21.15.17:0/1289613861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 0x556f27f68c60 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f60d0007900 tx=0x7f60d0027070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7d77458e4d4fd16 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.355+0000 7f60be7fc700 1 -- 172.21.15.17:0/1289613861 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0003cc0 con 0x556f27f742d0 2023-07-14T13:25:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.355+0000 7f60be7fc700 1 -- 172.21.15.17:0/1289613861 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60d0029070 con 0x556f27f742d0 2023-07-14T13:25:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.355+0000 7f60be7fc700 1 -- 172.21.15.17:0/1289613861 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d00259f0 con 0x556f27f742d0 2023-07-14T13:25:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.356+0000 7f60f1427b80 1 -- 172.21.15.17:0/1289613861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 msgr2=0x556f27f68c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.356+0000 7f60f1427b80 1 --2- 172.21.15.17:0/1289613861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 0x556f27f68c60 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f60d0007900 tx=0x7f60d0027070 comp rx=0 tx=0).stop 2023-07-14T13:25:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.356+0000 7f60f1427b80 1 -- 172.21.15.17:0/1289613861 shutdown_connections 2023-07-14T13:25:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.356+0000 7f60f1427b80 1 --2- 172.21.15.17:0/1289613861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f742d0 0x556f27f68c60 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.356+0000 7f60f1427b80 1 --2- 172.21.15.17:0/1289613861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27dca6b0 0x556f27f6e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.356+0000 7f60f1427b80 1 --2- 172.21.15.17:0/1289613861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27f6e580 0x556f27f7ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.356+0000 7f60f1427b80 1 -- 172.21.15.17:0/1289613861 >> 172.21.15.17:0/1289613861 conn(0x556f27f63be0 msgr2=0x556f27f71b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.356+0000 7f60f1427b80 1 -- 172.21.15.17:0/1289613861 shutdown_connections 2023-07-14T13:25:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.357+0000 7f60f1427b80 1 -- 172.21.15.17:0/1289613861 wait complete. 2023-07-14T13:25:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.357+0000 7f60f1427b80 1 -- start start 2023-07-14T13:25:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.358+0000 7f60f1427b80 1 Processor -- start 2023-07-14T13:25:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.359+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 0x556f27f7ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.359+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 0x556f27f7cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.359+0000 7f60f1427b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27f742d0 0x556f27f7d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.359+0000 7f60f1427b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27f7d920 con 0x556f27dca6b0 2023-07-14T13:25:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.359+0000 7f60f1427b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27f7da90 con 0x556f27f742d0 2023-07-14T13:25:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.359+0000 7f60f1427b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27fda960 con 0x556f27f6e580 2023-07-14T13:25:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.359+0000 7f60f1427b80 10 client.0 _ll_register_callbacks cb 0x7f60c80952f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:25:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.359+0000 7f60d6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 0x556f27f7cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.359+0000 7f60d6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 0x556f27f7cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:44700/0 (socket says 172.21.15.17:44700) 2023-07-14T13:25:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.359+0000 7f60d6ffd700 1 -- 172.21.15.17:0/793734195 learned_addr learned my addr 172.21.15.17:0/793734195 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:25:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.359+0000 7f60d7fff700 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27f742d0 0x556f27f7d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.360+0000 7f60d77fe700 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 0x556f27f7ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.360+0000 7f60d6ffd700 1 -- 172.21.15.17:0/793734195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27f742d0 msgr2=0x556f27f7d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.360+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27f742d0 0x556f27f7d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.360+0000 7f60d6ffd700 1 -- 172.21.15.17:0/793734195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 msgr2=0x556f27f7ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:25:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.360+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 0x556f27f7ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.360+0000 7f60d6ffd700 1 -- 172.21.15.17:0/793734195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f27cedd80 con 0x556f27f6e580 2023-07-14T13:25:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.361+0000 7f60d6ffd700 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 0x556f27f7cc50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f60c8095b50 tx=0x7f60c8098d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f55ea56fdc07f033 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:25:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.361+0000 7f60b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:25:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.361+0000 7f60b6ffd700 1 -- 172.21.15.17:0/793734195 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8014070 con 0x556f27f6e580 2023-07-14T13:25:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.361+0000 7f60b6ffd700 1 -- 172.21.15.17:0/793734195 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f60c809d680 con 0x556f27f6e580 2023-07-14T13:25:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.361+0000 7f60f1427b80 1 -- 172.21.15.17:0/793734195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60d0007720 con 0x556f27f6e580 2023-07-14T13:25:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.362+0000 7f60b6ffd700 1 -- 172.21.15.17:0/793734195 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60c8009ca0 con 0x556f27f6e580 2023-07-14T13:25:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.362+0000 7f60f1427b80 10 client.29197 fetch_fsmap learned FSMap version 61 2023-07-14T13:25:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.362+0000 7f60f1427b80 1 -- 172.21.15.17:0/793734195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x556f27d141f0 con 0x556f27f6e580 2023-07-14T13:25:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.362+0000 7f60b6ffd700 1 -- 172.21.15.17:0/793734195 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f60d0007720 con 0x556f27f6e580 2023-07-14T13:25:51.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.363+0000 7f60b6ffd700 1 -- 172.21.15.17:0/793734195 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 61) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f60c80cc0f0 con 0x556f27f6e580 2023-07-14T13:25:51.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.363+0000 7f60f1427b80 10 client.29197 fetch_fsmap finished waiting for FSMap version 61 2023-07-14T13:25:51.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.363+0000 7f60f1427b80 10 client.29197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:25:51.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.363+0000 7f60f1427b80 20 client.29197 populate_metadata read hostname 'smithi017' 2023-07-14T13:25:51.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.363+0000 7f60f1427b80 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556f27fdbbc0 0x556f27fddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:25:51.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.363+0000 7f60f1427b80 4 client.29197 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:25:51.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.363+0000 7f60f1427b80 1 -- 172.21.15.17:0/793734195 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556f27e7aff0 con 0x556f27fdbbc0 2023-07-14T13:25:51.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.364+0000 7f60d77fe700 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556f27fdbbc0 0x556f27fddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:25:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.366+0000 7f60d77fe700 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556f27fdbbc0 0x556f27fddfd0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f141c3e0645f02a server_cookie=7ce22b4dd58b36e4 in_seq=0 out_seq=0 2023-07-14T13:25:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.367+0000 7f60b6ffd700 10 client.29197 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:51.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.408+0000 7f60b6ffd700 1 -- 172.21.15.17:0/793734195 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556f27e7aff0 con 0x556f27fdbbc0 2023-07-14T13:25:51.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.408+0000 7f60b6ffd700 10 client.29197 handle_command_reply: tid=0 2023-07-14T13:25:51.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.408+0000 7f60f1427b80 1 client.29197 shutdown 2023-07-14T13:25:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.408+0000 7f60f1427b80 1 -- 172.21.15.17:0/793734195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 msgr2=0x556f27f7cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.408+0000 7f60f1427b80 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 0x556f27f7cc50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f60c8095b50 tx=0x7f60c8098d70 comp rx=0 tx=0).stop 2023-07-14T13:25:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.409+0000 7f60f1427b80 1 -- 172.21.15.17:0/793734195 shutdown_connections 2023-07-14T13:25:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.409+0000 7f60f1427b80 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x556f27fdbbc0 0x556f27fddfd0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.409+0000 7f60f1427b80 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556f27f742d0 0x556f27f7d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.409+0000 7f60f1427b80 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x556f27dca6b0 0x556f27f7ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.409+0000 7f60f1427b80 1 --2- 172.21.15.17:0/793734195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f27f6e580 0x556f27f7cc50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.409+0000 7f60f1427b80 1 -- 172.21.15.17:0/793734195 >> 172.21.15.17:0/793734195 conn(0x556f27f63be0 msgr2=0x556f27f72af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:51.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.409+0000 7f60b6ffd700 0 client.29197 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:25:51.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.409+0000 7f60f1427b80 1 -- 172.21.15.17:0/793734195 shutdown_connections 2023-07-14T13:25:51.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.409+0000 7f60f1427b80 1 -- 172.21.15.17:0/793734195 wait complete. 2023-07-14T13:25:51.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.410+0000 7f60f1427b80 20 client.29197 trim_cache size 0 max 16384 2023-07-14T13:25:51.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:25:51.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:25:51.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:25:51.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:25:51.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.411+0000 7f60ddbff700 1 -- 172.21.15.17:0/2253259579 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c00a13e0 msgr2=0x7f60c00a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:51.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.411+0000 7f60ddbff700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c00a13e0 0x7f60c00a3890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f60d000b6c0 tx=0x7f60d0007890 comp rx=0 tx=0).stop 2023-07-14T13:25:51.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.411+0000 7f60ddbff700 1 -- 172.21.15.17:0/2253259579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d80731c0 msgr2=0x7f60d8110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:25:51.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.411+0000 7f60ddbff700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d80731c0 0x7f60d8110590 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f60c800d950 tx=0x7f60c800dc60 comp rx=0 tx=0).stop 2023-07-14T13:25:51.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.411+0000 7f60ddbff700 1 -- 172.21.15.17:0/2253259579 shutdown_connections 2023-07-14T13:25:51.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.411+0000 7f60ddbff700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f60c00a13e0 0x7f60c00a3890 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.411+0000 7f60ddbff700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60d8110b20 0x7f60d8108ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.411+0000 7f60ddbff700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60d80728b0 0x7f60d8110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.411+0000 7f60ddbff700 1 --2- 172.21.15.17:0/2253259579 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60d80731c0 0x7f60d8110590 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:25:51.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.411+0000 7f60ddbff700 1 -- 172.21.15.17:0/2253259579 >> 172.21.15.17:0/2253259579 conn(0x7f60d80fb650 msgr2=0x7f60d80fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:25:51.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.411+0000 7f60ddbff700 1 -- 172.21.15.17:0/2253259579 shutdown_connections 2023-07-14T13:25:51.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:25:51.412+0000 7f60ddbff700 1 -- 172.21.15.17:0/2253259579 wait complete. 2023-07-14T13:25:51.836 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:51 smithi017 ceph-mon[95536]: pgmap v826: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.50k op/s 2023-07-14T13:25:51.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:51 smithi135 ceph-mon[97338]: pgmap v826: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.50k op/s 2023-07-14T13:25:51.976 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:51 smithi131 ceph-mon[96953]: pgmap v826: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.50k op/s 2023-07-14T13:25:52.429 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 460.0 s, 557.5 tps, lat 179.741 ms stddev 90.153 2023-07-14T13:25:53.836 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:53 smithi017 ceph-mon[95536]: pgmap v827: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 17 MiB/s wr, 1.44k op/s 2023-07-14T13:25:53.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:53 smithi135 ceph-mon[97338]: pgmap v827: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 17 MiB/s wr, 1.44k op/s 2023-07-14T13:25:53.976 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:53 smithi131 ceph-mon[96953]: pgmap v827: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 17 MiB/s wr, 1.44k op/s 2023-07-14T13:25:55.836 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:55 smithi017 ceph-mon[95536]: pgmap v828: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:25:55.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:55 smithi135 ceph-mon[97338]: pgmap v828: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:25:55.976 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:55 smithi131 ceph-mon[96953]: pgmap v828: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:25:56.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:56 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:25:56.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:56 smithi017 ceph-mon[95536]: pgmap v829: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 1.67k op/s 2023-07-14T13:25:56.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:56 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:25:56.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:56 smithi135 ceph-mon[97338]: pgmap v829: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 1.67k op/s 2023-07-14T13:25:56.976 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:56 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:25:56.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:56 smithi131 ceph-mon[96953]: pgmap v829: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 1.67k op/s 2023-07-14T13:25:57.429 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 465.0 s, 432.2 tps, lat 186.875 ms stddev 187.844 2023-07-14T13:25:59.677 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:25:59 smithi135 ceph-mon[97338]: pgmap v830: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-07-14T13:25:59.726 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:25:59 smithi131 ceph-mon[96953]: pgmap v830: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-07-14T13:25:59.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:25:59 smithi017 ceph-mon[95536]: pgmap v830: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-07-14T13:26:01.586 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:01 smithi017 ceph-mon[95536]: pgmap v831: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:26:01.726 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:01 smithi131 ceph-mon[96953]: pgmap v831: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:26:01.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:01 smithi135 ceph-mon[97338]: pgmap v831: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-07-14T13:26:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 470.0 s, 419.3 tps, lat 285.158 ms stddev 674.610 2023-07-14T13:26:03.841 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:03 smithi017 ceph-mon[95536]: pgmap v832: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-07-14T13:26:03.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:03 smithi135 ceph-mon[97338]: pgmap v832: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-07-14T13:26:03.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:03 smithi131 ceph-mon[96953]: pgmap v832: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-07-14T13:26:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.717+0000 7fb0645ff700 1 -- 172.21.15.17:0/2325583461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb05c067ee0 msgr2=0x7fb05c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.717+0000 7fb0645ff700 1 --2- 172.21.15.17:0/2325583461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb05c067ee0 0x7fb05c068350 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb05800b0a0 tx=0x7fb05800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.718+0000 7fb0645ff700 1 -- 172.21.15.17:0/2325583461 shutdown_connections 2023-07-14T13:26:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.718+0000 7fb0645ff700 1 --2- 172.21.15.17:0/2325583461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb05c1024f0 0x7fb05c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.718+0000 7fb0645ff700 1 --2- 172.21.15.17:0/2325583461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb05c104a60 0x7fb05c0679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.718+0000 7fb0645ff700 1 --2- 172.21.15.17:0/2325583461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb05c067ee0 0x7fb05c068350 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.718+0000 7fb0645ff700 1 -- 172.21.15.17:0/2325583461 >> 172.21.15.17:0/2325583461 conn(0x7fb05c074760 msgr2=0x7fb05c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.723+0000 7fb0645ff700 1 -- 172.21.15.17:0/2325583461 shutdown_connections 2023-07-14T13:26:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.723+0000 7fb0645ff700 1 -- 172.21.15.17:0/2325583461 wait complete. 2023-07-14T13:26:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.724+0000 7fb0645ff700 1 Processor -- start 2023-07-14T13:26:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.724+0000 7fb0645ff700 1 -- start start 2023-07-14T13:26:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.725+0000 7fb0645ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb05c067ee0 0x7fb05c071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.725+0000 7fb0645ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb05c1024f0 0x7fb05c06bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.725+0000 7fb0645ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb05c104a60 0x7fb05c06c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.725+0000 7fb0645ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c06c5a0 con 0x7fb05c1024f0 2023-07-14T13:26:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.725+0000 7fb0645ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c06c710 con 0x7fb05c104a60 2023-07-14T13:26:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.725+0000 7fb0645ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c06c8d0 con 0x7fb05c067ee0 2023-07-14T13:26:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.726+0000 7fb061b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb05c1024f0 0x7fb05c06bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.726+0000 7fb061b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb05c1024f0 0x7fb05c06bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35830/0 (socket says 172.21.15.17:35830) 2023-07-14T13:26:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.726+0000 7fb061b9a700 1 -- 172.21.15.17:0/109754110 learned_addr learned my addr 172.21.15.17:0/109754110 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.726+0000 7fb062b9c700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb05c104a60 0x7fb05c06c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.727+0000 7fb06239b700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb05c067ee0 0x7fb05c071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.727+0000 7fb061b9a700 1 -- 172.21.15.17:0/109754110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb05c067ee0 msgr2=0x7fb05c071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.727+0000 7fb061b9a700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb05c067ee0 0x7fb05c071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.727+0000 7fb061b9a700 1 -- 172.21.15.17:0/109754110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb05c104a60 msgr2=0x7fb05c06c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.727+0000 7fb061b9a700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb05c104a60 0x7fb05c06c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.727+0000 7fb061b9a700 1 -- 172.21.15.17:0/109754110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb058009d00 con 0x7fb05c1024f0 2023-07-14T13:26:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.728+0000 7fb061b9a700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb05c1024f0 0x7fb05c06bb20 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fb05800b830 tx=0x7fb0580094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.731+0000 7fb0537fe700 1 -- 172.21.15.17:0/109754110 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800e040 con 0x7fb05c1024f0 2023-07-14T13:26:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.731+0000 7fb0537fe700 1 -- 172.21.15.17:0/109754110 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb058004e40 con 0x7fb05c1024f0 2023-07-14T13:26:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.731+0000 7fb0537fe700 1 -- 172.21.15.17:0/109754110 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05803dcb0 con 0x7fb05c1024f0 2023-07-14T13:26:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.731+0000 7fb0645ff700 1 -- 172.21.15.17:0/109754110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05c107020 con 0x7fb05c1024f0 2023-07-14T13:26:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.732+0000 7fb0645ff700 1 -- 172.21.15.17:0/109754110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05c1074e0 con 0x7fb05c1024f0 2023-07-14T13:26:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.738+0000 7fb077f26b80 1 Processor -- start 2023-07-14T13:26:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.740+0000 7fb077f26b80 1 -- start start 2023-07-14T13:26:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.740+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 0x555eea110d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.740+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea1112d0 0x555eea10b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.740+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 0x555eea10b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.740+0000 7fb077f26b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea010c50 con 0x555eea1112d0 2023-07-14T13:26:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.740+0000 7fb077f26b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea0639e0 con 0x555eea10b580 2023-07-14T13:26:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.740+0000 7fb077f26b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea05ce70 con 0x555ee9f676b0 2023-07-14T13:26:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.744+0000 7fb06239b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea1112d0 0x555eea10b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.744+0000 7fb061b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 0x555eea10b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.744+0000 7fb06239b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea1112d0 0x555eea10b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35834/0 (socket says 172.21.15.17:35834) 2023-07-14T13:26:04.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.744+0000 7fb06239b700 1 -- 172.21.15.17:0/3712717286 learned_addr learned my addr 172.21.15.17:0/3712717286 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:04.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.745+0000 7fb062b9c700 1 --2- 172.21.15.17:0/3712717286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 0x555eea110d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.751+0000 7fb06239b700 1 -- 172.21.15.17:0/3712717286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 msgr2=0x555eea110d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:04.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.751+0000 7fb06239b700 1 --2- 172.21.15.17:0/3712717286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 0x555eea110d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.751+0000 7fb06239b700 1 -- 172.21.15.17:0/3712717286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 msgr2=0x555eea10b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:04.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.751+0000 7fb06239b700 1 --2- 172.21.15.17:0/3712717286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 0x555eea10b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.751+0000 7fb06239b700 1 -- 172.21.15.17:0/3712717286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ee9e8ad80 con 0x555eea1112d0 2023-07-14T13:26:04.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.753+0000 7fb06239b700 1 --2- 172.21.15.17:0/3712717286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea1112d0 0x555eea10b040 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb054007810 tx=0x7fb054007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfa4e4c766e342d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.754+0000 7fb050bfe700 1 -- 172.21.15.17:0/3712717286 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0540125f0 con 0x555eea1112d0 2023-07-14T13:26:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.754+0000 7fb050bfe700 1 -- 172.21.15.17:0/3712717286 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb054012be0 con 0x555eea1112d0 2023-07-14T13:26:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.754+0000 7fb050bfe700 1 -- 172.21.15.17:0/3712717286 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb054013d50 con 0x555eea1112d0 2023-07-14T13:26:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.759+0000 7fb077f26b80 1 -- 172.21.15.17:0/3712717286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea1112d0 msgr2=0x555eea10b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.759+0000 7fb077f26b80 1 --2- 172.21.15.17:0/3712717286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea1112d0 0x555eea10b040 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb054007810 tx=0x7fb054007b20 comp rx=0 tx=0).stop 2023-07-14T13:26:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.760+0000 7fb0537fe700 1 -- 172.21.15.17:0/109754110 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb05803d460 con 0x7fb05c1024f0 2023-07-14T13:26:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.763+0000 7fb0537fe700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb0480a14d0 0x7fb0480a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.763+0000 7fb0537fe700 1 -- 172.21.15.17:0/109754110 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fb0580f37f0 con 0x7fb05c1024f0 2023-07-14T13:26:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.771+0000 7fb077f26b80 1 -- 172.21.15.17:0/3712717286 shutdown_connections 2023-07-14T13:26:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.771+0000 7fb077f26b80 1 --2- 172.21.15.17:0/3712717286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 0x555eea10b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.771+0000 7fb077f26b80 1 --2- 172.21.15.17:0/3712717286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 0x555eea110d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.771+0000 7fb077f26b80 1 --2- 172.21.15.17:0/3712717286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea1112d0 0x555eea10b040 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.771+0000 7fb077f26b80 1 -- 172.21.15.17:0/3712717286 >> 172.21.15.17:0/3712717286 conn(0x555eea100be0 msgr2=0x555eea105f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.773+0000 7fb077f26b80 1 -- 172.21.15.17:0/3712717286 shutdown_connections 2023-07-14T13:26:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.777+0000 7fb062b9c700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb0480a14d0 0x7fb0480a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.779+0000 7fb077f26b80 1 -- 172.21.15.17:0/3712717286 wait complete. 2023-07-14T13:26:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.780+0000 7fb077f26b80 1 -- start start 2023-07-14T13:26:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.781+0000 7fb077f26b80 1 Processor -- start 2023-07-14T13:26:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.794+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 0x555eea114980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.794+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 0x555eea114ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.794+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea1112d0 0x555eea115400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.794+0000 7fb077f26b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee9ffca60 con 0x555eea1112d0 2023-07-14T13:26:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.794+0000 7fb077f26b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee9ffc760 con 0x555eea10b580 2023-07-14T13:26:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.794+0000 7fb077f26b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee9ee08c0 con 0x555ee9f676b0 2023-07-14T13:26:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.794+0000 7fb077f26b80 10 client.0 _ll_register_callbacks cb 0x555ee9ffa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:26:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.797+0000 7fb061b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 0x555eea114ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.800+0000 7fb061b9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 0x555eea114ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52904/0 (socket says 172.21.15.17:52904) 2023-07-14T13:26:04.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.800+0000 7fb061b9a700 1 -- 172.21.15.17:0/1804494788 learned_addr learned my addr 172.21.15.17:0/1804494788 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.803+0000 7fb061b9a700 1 -- 172.21.15.17:0/1804494788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 msgr2=0x555eea114980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.803+0000 7fb061b9a700 1 --2- 172.21.15.17:0/1804494788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 0x555eea114980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.803+0000 7fb061b9a700 1 -- 172.21.15.17:0/1804494788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea1112d0 msgr2=0x555eea115400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.803+0000 7fb061b9a700 1 --2- 172.21.15.17:0/1804494788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea1112d0 0x555eea115400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.803+0000 7fb061b9a700 1 -- 172.21.15.17:0/1804494788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05400e040 con 0x555eea10b580 2023-07-14T13:26:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.805+0000 7fb061b9a700 1 --2- 172.21.15.17:0/1804494788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 0x555eea114ec0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb0580bcde0 tx=0x7fb0580f1430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5499859b03c04d2e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:04.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.807+0000 7fb045ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:26:04.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.807+0000 7fb045ffb700 1 -- 172.21.15.17:0/1804494788 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0580c4910 con 0x555eea10b580 2023-07-14T13:26:04.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.807+0000 7fb045ffb700 1 -- 172.21.15.17:0/1804494788 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fb0580c8ca0 con 0x555eea10b580 2023-07-14T13:26:04.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.807+0000 7fb077f26b80 1 -- 172.21.15.17:0/1804494788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ee9fb6490 con 0x555eea10b580 2023-07-14T13:26:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.810+0000 7fb062b9c700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb0480a14d0 0x7fb0480a3980 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb04c006fd0 tx=0x7fb04c008040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.814+0000 7fb045ffb700 1 -- 172.21.15.17:0/1804494788 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0580e00c0 con 0x555eea10b580 2023-07-14T13:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.814+0000 7fb077f26b80 10 client.29249 fetch_fsmap learned FSMap version 61 2023-07-14T13:26:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.814+0000 7fb077f26b80 1 -- 172.21.15.17:0/1804494788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x555ee9e73c00 con 0x555eea10b580 2023-07-14T13:26:04.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.817+0000 7fb045ffb700 1 -- 172.21.15.17:0/1804494788 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555ee9fb6490 con 0x555eea10b580 2023-07-14T13:26:04.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.817+0000 7fb045ffb700 1 -- 172.21.15.17:0/1804494788 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 61) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb0580c8810 con 0x555eea10b580 2023-07-14T13:26:04.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.818+0000 7fb077f26b80 10 client.29249 fetch_fsmap finished waiting for FSMap version 61 2023-07-14T13:26:04.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.818+0000 7fb077f26b80 10 client.29249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:26:04.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.818+0000 7fb077f26b80 20 client.29249 populate_metadata read hostname 'smithi017' 2023-07-14T13:26:04.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.818+0000 7fb077f26b80 1 --2- 172.21.15.17:0/1804494788 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555eea1247b0 0x555eea126b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.818+0000 7fb077f26b80 4 client.29249 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:26:04.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.818+0000 7fb077f26b80 1 -- 172.21.15.17:0/1804494788 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555eea055e50 con 0x555eea1247b0 2023-07-14T13:26:04.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.825+0000 7fb06239b700 1 --2- 172.21.15.17:0/1804494788 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555eea1247b0 0x555eea126b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.833+0000 7fb06239b700 1 --2- 172.21.15.17:0/1804494788 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555eea1247b0 0x555eea126b90 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e971e61cc3ba16b server_cookie=95b921b283c47a38 in_seq=0 out_seq=0 2023-07-14T13:26:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.834+0000 7fb045ffb700 10 client.29249 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:04.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.838+0000 7fb045ffb700 1 -- 172.21.15.17:0/1804494788 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555eea055e50 con 0x555eea1247b0 2023-07-14T13:26:04.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.838+0000 7fb045ffb700 10 client.29249 handle_command_reply: tid=0 2023-07-14T13:26:04.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.839+0000 7fb077f26b80 1 client.29249 shutdown 2023-07-14T13:26:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.840+0000 7fb077f26b80 1 -- 172.21.15.17:0/1804494788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 msgr2=0x555eea114ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.840+0000 7fb077f26b80 1 --2- 172.21.15.17:0/1804494788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 0x555eea114ec0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb0580bcde0 tx=0x7fb0580f1430 comp rx=0 tx=0).stop 2023-07-14T13:26:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.842+0000 7fb077f26b80 1 -- 172.21.15.17:0/1804494788 shutdown_connections 2023-07-14T13:26:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.842+0000 7fb077f26b80 1 --2- 172.21.15.17:0/1804494788 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555eea1247b0 0x555eea126b90 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.842+0000 7fb077f26b80 1 --2- 172.21.15.17:0/1804494788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea1112d0 0x555eea115400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.842+0000 7fb077f26b80 1 --2- 172.21.15.17:0/1804494788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 0x555eea114980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.842+0000 7fb077f26b80 1 --2- 172.21.15.17:0/1804494788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea10b580 0x555eea114ec0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.842+0000 7fb077f26b80 1 -- 172.21.15.17:0/1804494788 >> 172.21.15.17:0/1804494788 conn(0x555eea100be0 msgr2=0x555eea1054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.845+0000 7fb045ffb700 0 client.29249 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.845+0000 7fb077f26b80 1 -- 172.21.15.17:0/1804494788 shutdown_connections 2023-07-14T13:26:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.846+0000 7fb077f26b80 1 -- 172.21.15.17:0/1804494788 wait complete. 2023-07-14T13:26:04.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.850+0000 7fb077f26b80 20 client.29249 trim_cache size 0 max 16384 2023-07-14T13:26:04.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.881+0000 7fb077f26b80 1 Processor -- start 2023-07-14T13:26:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.881+0000 7fb077f26b80 1 -- start start 2023-07-14T13:26:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.881+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ee9f676b0 0x555eea10b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.881+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555eea10b580 0x555eea105c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.881+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea1112d0 0x555eea111900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.881+0000 7fb077f26b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea10f740 con 0x555ee9f676b0 2023-07-14T13:26:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.881+0000 7fb077f26b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea110fe0 con 0x555eea1112d0 2023-07-14T13:26:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.881+0000 7fb077f26b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea10f440 con 0x555eea10b580 2023-07-14T13:26:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.883+0000 7fb06239b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ee9f676b0 0x555eea10b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.883+0000 7fb06239b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ee9f676b0 0x555eea10b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33386/0 (socket says 172.21.15.17:33386) 2023-07-14T13:26:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.883+0000 7fb06239b700 1 -- 172.21.15.17:0/755738893 learned_addr learned my addr 172.21.15.17:0/755738893 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.883+0000 7fb062b9c700 1 --2- 172.21.15.17:0/755738893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea1112d0 0x555eea111900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.884+0000 7fb06239b700 1 -- 172.21.15.17:0/755738893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555eea10b580 msgr2=0x555eea105c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.884+0000 7fb06239b700 1 --2- 172.21.15.17:0/755738893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555eea10b580 0x555eea105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.884+0000 7fb06239b700 1 -- 172.21.15.17:0/755738893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea1112d0 msgr2=0x555eea111900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.884+0000 7fb06239b700 1 --2- 172.21.15.17:0/755738893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea1112d0 0x555eea111900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.884+0000 7fb06239b700 1 -- 172.21.15.17:0/755738893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ee9eb11f0 con 0x555ee9f676b0 2023-07-14T13:26:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.884+0000 7fb06239b700 1 --2- 172.21.15.17:0/755738893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ee9f676b0 0x555eea10b040 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fb054007810 tx=0x7fb054004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e5e1306ab2470e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.885+0000 7fb0513ff700 1 -- 172.21.15.17:0/755738893 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb054022070 con 0x555ee9f676b0 2023-07-14T13:26:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.885+0000 7fb0513ff700 1 -- 172.21.15.17:0/755738893 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb054013500 con 0x555ee9f676b0 2023-07-14T13:26:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.885+0000 7fb0513ff700 1 -- 172.21.15.17:0/755738893 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0540126e0 con 0x555ee9f676b0 2023-07-14T13:26:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.886+0000 7fb077f26b80 1 -- 172.21.15.17:0/755738893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ee9f676b0 msgr2=0x555eea10b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.886+0000 7fb077f26b80 1 --2- 172.21.15.17:0/755738893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ee9f676b0 0x555eea10b040 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fb054007810 tx=0x7fb054004860 comp rx=0 tx=0).stop 2023-07-14T13:26:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.887+0000 7fb077f26b80 1 -- 172.21.15.17:0/755738893 shutdown_connections 2023-07-14T13:26:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.887+0000 7fb077f26b80 1 --2- 172.21.15.17:0/755738893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea1112d0 0x555eea111900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.887+0000 7fb077f26b80 1 --2- 172.21.15.17:0/755738893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555ee9f676b0 0x555eea10b040 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.887+0000 7fb077f26b80 1 --2- 172.21.15.17:0/755738893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555eea10b580 0x555eea105c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.887+0000 7fb077f26b80 1 -- 172.21.15.17:0/755738893 >> 172.21.15.17:0/755738893 conn(0x555eea100be0 msgr2=0x555eea114f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:04.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.888+0000 7fb077f26b80 1 -- 172.21.15.17:0/755738893 shutdown_connections 2023-07-14T13:26:04.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.888+0000 7fb077f26b80 1 -- 172.21.15.17:0/755738893 wait complete. 2023-07-14T13:26:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.889+0000 7fb077f26b80 1 -- start start 2023-07-14T13:26:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.889+0000 7fb077f26b80 1 Processor -- start 2023-07-14T13:26:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.890+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 0x555eea16c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.890+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea10b580 0x555eea16cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.890+0000 7fb077f26b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea1112d0 0x555eea177650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.890+0000 7fb077f26b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea177b90 con 0x555eea10b580 2023-07-14T13:26:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.890+0000 7fb077f26b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea177cd0 con 0x555eea1112d0 2023-07-14T13:26:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.890+0000 7fb077f26b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea177e40 con 0x555ee9f676b0 2023-07-14T13:26:04.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.890+0000 7fb077f26b80 10 client.0 _ll_register_callbacks cb 0x555ee9ffa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:26:04.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.891+0000 7fb061b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea10b580 0x555eea16cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.891+0000 7fb061b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea10b580 0x555eea16cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33390/0 (socket says 172.21.15.17:33390) 2023-07-14T13:26:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.891+0000 7fb061b9a700 1 -- 172.21.15.17:0/2497537405 learned_addr learned my addr 172.21.15.17:0/2497537405 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.892+0000 7fb061b9a700 1 -- 172.21.15.17:0/2497537405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 msgr2=0x555eea16c7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:26:04.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.892+0000 7fb061b9a700 1 --2- 172.21.15.17:0/2497537405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 0x555eea16c7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.892+0000 7fb061b9a700 1 -- 172.21.15.17:0/2497537405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea1112d0 msgr2=0x555eea177650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:26:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.892+0000 7fb061b9a700 1 --2- 172.21.15.17:0/2497537405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea1112d0 0x555eea177650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.892+0000 7fb061b9a700 1 -- 172.21.15.17:0/2497537405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ee9e8ad80 con 0x555eea10b580 2023-07-14T13:26:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.892+0000 7fb061b9a700 1 --2- 172.21.15.17:0/2497537405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea10b580 0x555eea16cd00 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb0580c0870 tx=0x7fb058005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e49dccf2d6dfe2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:04.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.892+0000 7fb045ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:26:04.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.893+0000 7fb045ffb700 1 -- 172.21.15.17:0/2497537405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0580bffd0 con 0x555eea10b580 2023-07-14T13:26:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.893+0000 7fb045ffb700 1 -- 172.21.15.17:0/2497537405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fb0580f35c0 con 0x555eea10b580 2023-07-14T13:26:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.893+0000 7fb077f26b80 1 -- 172.21.15.17:0/2497537405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb054012be0 con 0x555eea10b580 2023-07-14T13:26:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.893+0000 7fb045ffb700 1 -- 172.21.15.17:0/2497537405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb05800b860 con 0x555eea10b580 2023-07-14T13:26:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.893+0000 7fb077f26b80 10 client.19473 fetch_fsmap learned FSMap version 61 2023-07-14T13:26:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.893+0000 7fb077f26b80 1 -- 172.21.15.17:0/2497537405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x555ee9e89250 con 0x555eea10b580 2023-07-14T13:26:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.894+0000 7fb045ffb700 1 -- 172.21.15.17:0/2497537405 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb054012be0 con 0x555eea10b580 2023-07-14T13:26:04.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.894+0000 7fb045ffb700 1 -- 172.21.15.17:0/2497537405 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 61) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb0580e00c0 con 0x555eea10b580 2023-07-14T13:26:04.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.894+0000 7fb077f26b80 10 client.19473 fetch_fsmap finished waiting for FSMap version 61 2023-07-14T13:26:04.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.894+0000 7fb077f26b80 10 client.19473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:26:04.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.894+0000 7fb077f26b80 20 client.19473 populate_metadata read hostname 'smithi017' 2023-07-14T13:26:04.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.894+0000 7fb077f26b80 1 --2- 172.21.15.17:0/2497537405 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555eea179080 0x555eea17b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:04.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.894+0000 7fb077f26b80 4 client.19473 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:26:04.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.894+0000 7fb077f26b80 1 -- 172.21.15.17:0/2497537405 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555eea017ff0 con 0x555eea179080 2023-07-14T13:26:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.913+0000 7fb06239b700 1 --2- 172.21.15.17:0/2497537405 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555eea179080 0x555eea17b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.920+0000 7fb06239b700 1 --2- 172.21.15.17:0/2497537405 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555eea179080 0x555eea17b460 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1276dfe5aaef7d6e server_cookie=16cf8d6b4d5d3ca0 in_seq=0 out_seq=0 2023-07-14T13:26:04.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:04.920+0000 7fb045ffb700 10 client.19473 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.139+0000 7fb045ffb700 1 -- 172.21.15.17:0/2497537405 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555eea017ff0 con 0x555eea179080 2023-07-14T13:26:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.139+0000 7fb045ffb700 10 client.19473 handle_command_reply: tid=0 2023-07-14T13:26:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.142+0000 7fb077f26b80 1 client.19473 shutdown 2023-07-14T13:26:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.149+0000 7fb077f26b80 1 -- 172.21.15.17:0/2497537405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea10b580 msgr2=0x555eea16cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.149+0000 7fb077f26b80 1 --2- 172.21.15.17:0/2497537405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea10b580 0x555eea16cd00 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb0580c0870 tx=0x7fb058005b70 comp rx=0 tx=0).stop 2023-07-14T13:26:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.155+0000 7fb077f26b80 1 -- 172.21.15.17:0/2497537405 shutdown_connections 2023-07-14T13:26:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.156+0000 7fb077f26b80 1 --2- 172.21.15.17:0/2497537405 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555eea179080 0x555eea17b460 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.156+0000 7fb077f26b80 1 --2- 172.21.15.17:0/2497537405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555eea1112d0 0x555eea177650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.156+0000 7fb077f26b80 1 --2- 172.21.15.17:0/2497537405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee9f676b0 0x555eea16c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.156+0000 7fb077f26b80 1 --2- 172.21.15.17:0/2497537405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555eea10b580 0x555eea16cd00 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.156+0000 7fb077f26b80 1 -- 172.21.15.17:0/2497537405 >> 172.21.15.17:0/2497537405 conn(0x555eea100be0 msgr2=0x555eea10fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.158+0000 7fb045ffb700 0 client.19473 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.159+0000 7fb077f26b80 1 -- 172.21.15.17:0/2497537405 shutdown_connections 2023-07-14T13:26:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.159+0000 7fb077f26b80 1 -- 172.21.15.17:0/2497537405 wait complete. 2023-07-14T13:26:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.159+0000 7fb077f26b80 20 client.19473 trim_cache size 0 max 16384 2023-07-14T13:26:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:26:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:26:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:26:05.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:26:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.160+0000 7fb0645ff700 1 -- 172.21.15.17:0/109754110 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb0480a14d0 msgr2=0x7fb0480a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.160+0000 7fb0645ff700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb0480a14d0 0x7fb0480a3980 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb04c006fd0 tx=0x7fb04c008040 comp rx=0 tx=0).stop 2023-07-14T13:26:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.160+0000 7fb0645ff700 1 -- 172.21.15.17:0/109754110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb05c1024f0 msgr2=0x7fb05c06bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:05.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.160+0000 7fb0645ff700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb05c1024f0 0x7fb05c06bb20 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fb05800b830 tx=0x7fb0580094f0 comp rx=0 tx=0).stop 2023-07-14T13:26:05.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.162+0000 7fb0645ff700 1 -- 172.21.15.17:0/109754110 shutdown_connections 2023-07-14T13:26:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.162+0000 7fb0645ff700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb0480a14d0 0x7fb0480a3980 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.162+0000 7fb0645ff700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb05c104a60 0x7fb05c06c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.162+0000 7fb0645ff700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb05c067ee0 0x7fb05c071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.162+0000 7fb0645ff700 1 --2- 172.21.15.17:0/109754110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb05c1024f0 0x7fb05c06bb20 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.162+0000 7fb0645ff700 1 -- 172.21.15.17:0/109754110 >> 172.21.15.17:0/109754110 conn(0x7fb05c074760 msgr2=0x7fb05c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:05.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.166+0000 7fb0645ff700 1 -- 172.21.15.17:0/109754110 shutdown_connections 2023-07-14T13:26:05.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:05.168+0000 7fb0645ff700 1 -- 172.21.15.17:0/109754110 wait complete. 2023-07-14T13:26:05.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:05 smithi017 ceph-mon[95536]: pgmap v833: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 983 op/s 2023-07-14T13:26:05.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:05 smithi017 ceph-mon[95536]: osdmap e130: 12 total, 12 up, 12 in 2023-07-14T13:26:05.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:05 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:26:05.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:05 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:26:05.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:05 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:26:05.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:05 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:26:05.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:05 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:26:05.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:05 smithi135 ceph-mon[97338]: pgmap v833: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 983 op/s 2023-07-14T13:26:05.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:05 smithi135 ceph-mon[97338]: osdmap e130: 12 total, 12 up, 12 in 2023-07-14T13:26:05.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:05 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:26:05.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:05 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:26:05.929 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:05 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:26:05.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:05 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:26:05.930 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:05 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:26:05.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:05 smithi131 ceph-mon[96953]: pgmap v833: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 11 MiB/s wr, 983 op/s 2023-07-14T13:26:05.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:05 smithi131 ceph-mon[96953]: osdmap e130: 12 total, 12 up, 12 in 2023-07-14T13:26:05.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:05 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:26:05.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:05 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:26:05.979 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:05 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:26:05.980 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:05 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:26:05.980 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:05 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:26:07.429 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 475.0 s, 206.2 tps, lat 409.634 ms stddev 400.895 2023-07-14T13:26:07.525 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:07 smithi017 ceph-mon[95536]: pgmap v835: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 989 op/s 2023-07-14T13:26:07.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:07 smithi135 ceph-mon[97338]: pgmap v835: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 989 op/s 2023-07-14T13:26:07.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:07 smithi131 ceph-mon[96953]: pgmap v835: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 989 op/s 2023-07-14T13:26:09.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:09 smithi017 ceph-mon[95536]: pgmap v836: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 989 op/s 2023-07-14T13:26:09.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:09 smithi135 ceph-mon[97338]: pgmap v836: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 989 op/s 2023-07-14T13:26:09.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:09 smithi131 ceph-mon[96953]: pgmap v836: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 989 op/s 2023-07-14T13:26:11.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:11 smithi017 ceph-mon[95536]: pgmap v837: 97 pgs: 18 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 42 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 878 op/s 2023-07-14T13:26:11.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:11 smithi135 ceph-mon[97338]: pgmap v837: 97 pgs: 18 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 42 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 878 op/s 2023-07-14T13:26:11.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:11 smithi131 ceph-mon[96953]: pgmap v837: 97 pgs: 18 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 42 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 11 MiB/s wr, 878 op/s 2023-07-14T13:26:12.428 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 480.0 s, 307.8 tps, lat 353.536 ms stddev 331.575 2023-07-14T13:26:12.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:12 smithi017 ceph-mon[95536]: pgmap v838: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 621 op/s 2023-07-14T13:26:12.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:12 smithi135 ceph-mon[97338]: pgmap v838: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 621 op/s 2023-07-14T13:26:12.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:12 smithi131 ceph-mon[96953]: pgmap v838: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 621 op/s 2023-07-14T13:26:15.335 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:15 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:26:15.335 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:15 smithi017 ceph-mon[95536]: pgmap v839: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 621 op/s 2023-07-14T13:26:15.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:15 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:26:15.427 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:15 smithi135 ceph-mon[97338]: pgmap v839: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 621 op/s 2023-07-14T13:26:15.475 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:15 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:26:15.475 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:15 smithi131 ceph-mon[96953]: pgmap v839: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.9 MiB/s wr, 621 op/s 2023-07-14T13:26:17.428 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 485.0 s, 457.0 tps, lat 232.815 ms stddev 106.523 2023-07-14T13:26:17.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:17 smithi017 ceph-mon[95536]: pgmap v840: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 985 op/s 2023-07-14T13:26:17.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:17 smithi017 ceph-mon[95536]: osdmap e131: 12 total, 12 up, 12 in 2023-07-14T13:26:17.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:17 smithi135 ceph-mon[97338]: pgmap v840: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 985 op/s 2023-07-14T13:26:17.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:17 smithi135 ceph-mon[97338]: osdmap e131: 12 total, 12 up, 12 in 2023-07-14T13:26:17.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:17 smithi131 ceph-mon[96953]: pgmap v840: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 985 op/s 2023-07-14T13:26:17.976 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:17 smithi131 ceph-mon[96953]: osdmap e131: 12 total, 12 up, 12 in 2023-07-14T13:26:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.453+0000 7febd7bff700 1 -- 172.21.15.17:0/3218922949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd00fea30 msgr2=0x7febd00feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.453+0000 7febd7bff700 1 --2- 172.21.15.17:0/3218922949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd00fea30 0x7febd00feea0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7febc0009990 tx=0x7febc0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.453+0000 7febd7bff700 1 -- 172.21.15.17:0/3218922949 shutdown_connections 2023-07-14T13:26:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.453+0000 7febd7bff700 1 --2- 172.21.15.17:0/3218922949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febd00ff3e0 0x7febd010b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.453+0000 7febd7bff700 1 --2- 172.21.15.17:0/3218922949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd0104a30 0x7febd0104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.453+0000 7febd7bff700 1 --2- 172.21.15.17:0/3218922949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd00fea30 0x7febd00feea0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.453+0000 7febd7bff700 1 -- 172.21.15.17:0/3218922949 >> 172.21.15.17:0/3218922949 conn(0x7febd0074760 msgr2=0x7febd0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.453+0000 7febd7bff700 1 -- 172.21.15.17:0/3218922949 shutdown_connections 2023-07-14T13:26:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.453+0000 7febd7bff700 1 -- 172.21.15.17:0/3218922949 wait complete. 2023-07-14T13:26:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.455+0000 7febd7bff700 1 Processor -- start 2023-07-14T13:26:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.455+0000 7febd7bff700 1 -- start start 2023-07-14T13:26:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.456+0000 7febd7bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd00fea30 0x7febd0194090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.456+0000 7febd7bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febd00ff3e0 0x7febd01945d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.456+0000 7febd7bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd0104a30 0x7febd0199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.456+0000 7febd7bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0199d00 con 0x7febd00fea30 2023-07-14T13:26:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.456+0000 7febd7bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0199e70 con 0x7febd00ff3e0 2023-07-14T13:26:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.456+0000 7febd7bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd019a030 con 0x7febd0104a30 2023-07-14T13:26:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.456+0000 7febd519a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febd00ff3e0 0x7febd01945d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.456+0000 7febd519a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febd00ff3e0 0x7febd01945d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49516/0 (socket says 172.21.15.17:49516) 2023-07-14T13:26:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.456+0000 7febd519a700 1 -- 172.21.15.17:0/3722266786 learned_addr learned my addr 172.21.15.17:0/3722266786 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.457+0000 7febd519a700 1 -- 172.21.15.17:0/3722266786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd0104a30 msgr2=0x7febd0199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.457+0000 7febd519a700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd0104a30 0x7febd0199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.457+0000 7febd519a700 1 -- 172.21.15.17:0/3722266786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd00fea30 msgr2=0x7febd0194090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.457+0000 7febd519a700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd00fea30 0x7febd0194090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.457+0000 7febd519a700 1 -- 172.21.15.17:0/3722266786 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00095f0 con 0x7febd00ff3e0 2023-07-14T13:26:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.457+0000 7febd519a700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febd00ff3e0 0x7febd01945d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7febc0005740 tx=0x7febc0005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.458+0000 7febc6ffd700 1 -- 172.21.15.17:0/3722266786 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc001d070 con 0x7febd00ff3e0 2023-07-14T13:26:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.458+0000 7febd7bff700 1 -- 172.21.15.17:0/3722266786 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd019a2b0 con 0x7febd00ff3e0 2023-07-14T13:26:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.458+0000 7febc6ffd700 1 -- 172.21.15.17:0/3722266786 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febc000fbb0 con 0x7febd00ff3e0 2023-07-14T13:26:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.458+0000 7febc6ffd700 1 -- 172.21.15.17:0/3722266786 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc00173f0 con 0x7febd00ff3e0 2023-07-14T13:26:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.458+0000 7febd7bff700 1 -- 172.21.15.17:0/3722266786 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd019a9d0 con 0x7febd00ff3e0 2023-07-14T13:26:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.465+0000 7febeb575b80 1 Processor -- start 2023-07-14T13:26:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.465+0000 7febc6ffd700 1 -- 172.21.15.17:0/3722266786 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7febc0022470 con 0x7febd00ff3e0 2023-07-14T13:26:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.465+0000 7febeb575b80 1 -- start start 2023-07-14T13:26:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.465+0000 7febeb575b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 0x560fa91acd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.466+0000 7febeb575b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 0x560fa91a7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.466+0000 7febeb575b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 0x560fa91a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.466+0000 7febeb575b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa90acc50 con 0x560fa91a7580 2023-07-14T13:26:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.466+0000 7febeb575b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa90ff9e0 con 0x560fa91ad2d0 2023-07-14T13:26:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.466+0000 7febeb575b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa90f8e70 con 0x560fa90036b0 2023-07-14T13:26:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.466+0000 7febd519a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 0x560fa91a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.467+0000 7febd599b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 0x560fa91a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.467+0000 7febd619c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 0x560fa91acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.467+0000 7febd619c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 0x560fa91acd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40156/0 (socket says 172.21.15.17:40156) 2023-07-14T13:26:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.467+0000 7febd619c700 1 -- 172.21.15.17:0/1549127573 learned_addr learned my addr 172.21.15.17:0/1549127573 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.468+0000 7febc6ffd700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febbc0a13c0 0x7febbc0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.469+0000 7febc6ffd700 1 -- 172.21.15.17:0/3722266786 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7febc00ce0a0 con 0x7febd00ff3e0 2023-07-14T13:26:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.469+0000 7febd619c700 1 -- 172.21.15.17:0/1549127573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 msgr2=0x560fa91a7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.469+0000 7febd619c700 1 --2- 172.21.15.17:0/1549127573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 0x560fa91a7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.469+0000 7febd619c700 1 -- 172.21.15.17:0/1549127573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 msgr2=0x560fa91a79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.469+0000 7febd619c700 1 --2- 172.21.15.17:0/1549127573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 0x560fa91a79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.469+0000 7febd619c700 1 -- 172.21.15.17:0/1549127573 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fa8f26d80 con 0x560fa90036b0 2023-07-14T13:26:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.471+0000 7febd619c700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febbc0a13c0 0x7febbc0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.471+0000 7febd619c700 1 --2- 172.21.15.17:0/1549127573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 0x560fa91acd90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7febc800e5c0 tx=0x7febc800e8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cd163533a5b3252 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.471+0000 7febbbfff700 1 -- 172.21.15.17:0/1549127573 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8007620 con 0x560fa90036b0 2023-07-14T13:26:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.471+0000 7febbbfff700 1 -- 172.21.15.17:0/1549127573 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febc800f040 con 0x560fa90036b0 2023-07-14T13:26:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.471+0000 7febbbfff700 1 -- 172.21.15.17:0/1549127573 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8015c20 con 0x560fa90036b0 2023-07-14T13:26:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.473+0000 7febeb575b80 1 -- 172.21.15.17:0/1549127573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 msgr2=0x560fa91acd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.473+0000 7febeb575b80 1 --2- 172.21.15.17:0/1549127573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 0x560fa91acd90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7febc800e5c0 tx=0x7febc800e8d0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.474+0000 7febd619c700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febbc0a13c0 0x7febbc0a3870 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7febc801d000 tx=0x7febc8015eb0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.474+0000 7febeb575b80 1 -- 172.21.15.17:0/1549127573 shutdown_connections 2023-07-14T13:26:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.474+0000 7febeb575b80 1 --2- 172.21.15.17:0/1549127573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 0x560fa91a79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.474+0000 7febeb575b80 1 --2- 172.21.15.17:0/1549127573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 0x560fa91acd90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.474+0000 7febeb575b80 1 --2- 172.21.15.17:0/1549127573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 0x560fa91a7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.474+0000 7febeb575b80 1 -- 172.21.15.17:0/1549127573 >> 172.21.15.17:0/1549127573 conn(0x560fa919cbe0 msgr2=0x560fa91a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:18.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.475+0000 7febeb575b80 1 -- 172.21.15.17:0/1549127573 shutdown_connections 2023-07-14T13:26:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.476+0000 7febeb575b80 1 -- 172.21.15.17:0/1549127573 wait complete. 2023-07-14T13:26:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.477+0000 7febeb575b80 1 -- start start 2023-07-14T13:26:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.477+0000 7febeb575b80 1 Processor -- start 2023-07-14T13:26:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.478+0000 7febeb575b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 0x560fa91b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.478+0000 7febeb575b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 0x560fa91b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.478+0000 7febeb575b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91ad2d0 0x560fa91b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.478+0000 7febeb575b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9098a60 con 0x560fa91a7580 2023-07-14T13:26:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.478+0000 7febeb575b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9098760 con 0x560fa90036b0 2023-07-14T13:26:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.478+0000 7febeb575b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa8f7c8c0 con 0x560fa91ad2d0 2023-07-14T13:26:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.478+0000 7febeb575b80 10 client.0 _ll_register_callbacks cb 0x560fa9096700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:26:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.479+0000 7febd619c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91ad2d0 0x560fa91b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.479+0000 7febd599b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 0x560fa91b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.479+0000 7febd619c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91ad2d0 0x560fa91b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40172/0 (socket says 172.21.15.17:40172) 2023-07-14T13:26:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.479+0000 7febd599b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 0x560fa91b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49534/0 (socket says 172.21.15.17:49534) 2023-07-14T13:26:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.479+0000 7febd619c700 1 -- 172.21.15.17:0/1300921748 learned_addr learned my addr 172.21.15.17:0/1300921748 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.480+0000 7febd619c700 1 -- 172.21.15.17:0/1300921748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 msgr2=0x560fa91b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.480+0000 7febd619c700 1 --2- 172.21.15.17:0/1300921748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 0x560fa91b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.480+0000 7febd619c700 1 -- 172.21.15.17:0/1300921748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 msgr2=0x560fa91b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.480+0000 7febd619c700 1 --2- 172.21.15.17:0/1300921748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 0x560fa91b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.480+0000 7febd619c700 1 -- 172.21.15.17:0/1300921748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc800e140 con 0x560fa91ad2d0 2023-07-14T13:26:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.481+0000 7febd619c700 1 --2- 172.21.15.17:0/1300921748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91ad2d0 0x560fa91b1370 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7febc80095e0 tx=0x7febc8016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1779e7d82b0cc01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.481+0000 7febb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:26:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.481+0000 7febb97fa700 1 -- 172.21.15.17:0/1300921748 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8015660 con 0x560fa91ad2d0 2023-07-14T13:26:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.481+0000 7febb97fa700 1 -- 172.21.15.17:0/1300921748 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7febc801e790 con 0x560fa91ad2d0 2023-07-14T13:26:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.482+0000 7febeb575b80 1 -- 172.21.15.17:0/1300921748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560fa9052490 con 0x560fa91ad2d0 2023-07-14T13:26:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.482+0000 7febb97fa700 1 -- 172.21.15.17:0/1300921748 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7febc8015c10 con 0x560fa91ad2d0 2023-07-14T13:26:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.483+0000 7febeb575b80 10 client.29209 fetch_fsmap learned FSMap version 62 2023-07-14T13:26:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.483+0000 7febeb575b80 1 -- 172.21.15.17:0/1300921748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x560fa8f0fc00 con 0x560fa91ad2d0 2023-07-14T13:26:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.484+0000 7febb97fa700 1 -- 172.21.15.17:0/1300921748 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560fa9052490 con 0x560fa91ad2d0 2023-07-14T13:26:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.484+0000 7febb97fa700 1 -- 172.21.15.17:0/1300921748 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 62) v1 ==== 7482+0+0 (secure 0 0 0) 0x7febc800e5f0 con 0x560fa91ad2d0 2023-07-14T13:26:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.484+0000 7febeb575b80 10 client.29209 fetch_fsmap finished waiting for FSMap version 62 2023-07-14T13:26:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.484+0000 7febeb575b80 10 client.29209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:26:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.484+0000 7febeb575b80 20 client.29209 populate_metadata read hostname 'smithi017' 2023-07-14T13:26:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.484+0000 7febeb575b80 1 --2- 172.21.15.17:0/1300921748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560fa91c0ba0 0x560fa91c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.484+0000 7febeb575b80 4 client.29209 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:26:18.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.484+0000 7febeb575b80 1 -- 172.21.15.17:0/1300921748 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560fa90f1e50 con 0x560fa91c0ba0 2023-07-14T13:26:18.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.485+0000 7febd599b700 1 --2- 172.21.15.17:0/1300921748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560fa91c0ba0 0x560fa91c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.489+0000 7febd599b700 1 --2- 172.21.15.17:0/1300921748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560fa91c0ba0 0x560fa91c2fb0 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=736b109c26745fba server_cookie=284ba0ba591c5065 in_seq=0 out_seq=0 2023-07-14T13:26:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.489+0000 7febb97fa700 10 client.29209 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.490+0000 7febb97fa700 1 -- 172.21.15.17:0/1300921748 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560fa90f1e50 con 0x560fa91c0ba0 2023-07-14T13:26:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.490+0000 7febb97fa700 10 client.29209 handle_command_reply: tid=0 2023-07-14T13:26:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.490+0000 7febeb575b80 1 client.29209 shutdown 2023-07-14T13:26:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.491+0000 7febeb575b80 1 -- 172.21.15.17:0/1300921748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91ad2d0 msgr2=0x560fa91b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.491+0000 7febeb575b80 1 --2- 172.21.15.17:0/1300921748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91ad2d0 0x560fa91b1370 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7febc80095e0 tx=0x7febc8016000 comp rx=0 tx=0).stop 2023-07-14T13:26:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.491+0000 7febeb575b80 1 -- 172.21.15.17:0/1300921748 shutdown_connections 2023-07-14T13:26:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.491+0000 7febeb575b80 1 --2- 172.21.15.17:0/1300921748 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560fa91c0ba0 0x560fa91c2fb0 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.491+0000 7febeb575b80 1 --2- 172.21.15.17:0/1300921748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91ad2d0 0x560fa91b1370 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.491+0000 7febeb575b80 1 --2- 172.21.15.17:0/1300921748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 0x560fa91b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.491+0000 7febeb575b80 1 --2- 172.21.15.17:0/1300921748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 0x560fa91b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.491+0000 7febeb575b80 1 -- 172.21.15.17:0/1300921748 >> 172.21.15.17:0/1300921748 conn(0x560fa919cbe0 msgr2=0x560fa91a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:18.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.491+0000 7febb97fa700 0 client.29209 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.492+0000 7febeb575b80 1 -- 172.21.15.17:0/1300921748 shutdown_connections 2023-07-14T13:26:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.492+0000 7febeb575b80 1 -- 172.21.15.17:0/1300921748 wait complete. 2023-07-14T13:26:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.492+0000 7febeb575b80 20 client.29209 trim_cache size 0 max 16384 2023-07-14T13:26:18.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.521+0000 7febeb575b80 1 Processor -- start 2023-07-14T13:26:18.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.521+0000 7febeb575b80 1 -- start start 2023-07-14T13:26:18.531 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.522+0000 7febeb575b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 0x560fa91a7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.522+0000 7febeb575b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 0x560fa91b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.522+0000 7febeb575b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 0x560fa91ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.522+0000 7febeb575b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa91ac9c0 con 0x560fa91a7580 2023-07-14T13:26:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.522+0000 7febeb575b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa919e5f0 con 0x560fa91ad2d0 2023-07-14T13:26:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.522+0000 7febeb575b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa91a7fd0 con 0x560fa90036b0 2023-07-14T13:26:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.522+0000 7febd619c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 0x560fa91ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.523+0000 7febd619c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 0x560fa91ac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49544/0 (socket says 172.21.15.17:49544) 2023-07-14T13:26:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.523+0000 7febd619c700 1 -- 172.21.15.17:0/1653646618 learned_addr learned my addr 172.21.15.17:0/1653646618 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.523+0000 7febd599b700 1 --2- 172.21.15.17:0/1653646618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 0x560fa91a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.523+0000 7febd519a700 1 --2- 172.21.15.17:0/1653646618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 0x560fa91b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.523+0000 7febd619c700 1 -- 172.21.15.17:0/1653646618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 msgr2=0x560fa91a7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.523+0000 7febd619c700 1 --2- 172.21.15.17:0/1653646618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 0x560fa91a7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.523+0000 7febd619c700 1 -- 172.21.15.17:0/1653646618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 msgr2=0x560fa91b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.523+0000 7febd619c700 1 --2- 172.21.15.17:0/1653646618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 0x560fa91b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.523+0000 7febd619c700 1 -- 172.21.15.17:0/1653646618 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fa8f4d1f0 con 0x560fa91ad2d0 2023-07-14T13:26:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.524+0000 7febd619c700 1 --2- 172.21.15.17:0/1653646618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 0x560fa91ac1a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7febc8005c30 tx=0x7febc800ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c933e587b779da2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.524+0000 7febc4bff700 1 -- 172.21.15.17:0/1653646618 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc80293b0 con 0x560fa91ad2d0 2023-07-14T13:26:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.524+0000 7febc4bff700 1 -- 172.21.15.17:0/1653646618 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febc8007a50 con 0x560fa91ad2d0 2023-07-14T13:26:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.524+0000 7febc4bff700 1 -- 172.21.15.17:0/1653646618 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc800e540 con 0x560fa91ad2d0 2023-07-14T13:26:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.525+0000 7febeb575b80 1 -- 172.21.15.17:0/1653646618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 msgr2=0x560fa91ac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.525+0000 7febeb575b80 1 --2- 172.21.15.17:0/1653646618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 0x560fa91ac1a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7febc8005c30 tx=0x7febc800ef40 comp rx=0 tx=0).stop 2023-07-14T13:26:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.527+0000 7febeb575b80 1 -- 172.21.15.17:0/1653646618 shutdown_connections 2023-07-14T13:26:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.527+0000 7febeb575b80 1 --2- 172.21.15.17:0/1653646618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa91ad2d0 0x560fa91ac1a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.527+0000 7febeb575b80 1 --2- 172.21.15.17:0/1653646618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa90036b0 0x560fa91a7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.527+0000 7febeb575b80 1 --2- 172.21.15.17:0/1653646618 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91a7580 0x560fa91b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.527+0000 7febeb575b80 1 -- 172.21.15.17:0/1653646618 >> 172.21.15.17:0/1653646618 conn(0x560fa919cbe0 msgr2=0x560fa91aba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.531+0000 7febeb575b80 1 -- 172.21.15.17:0/1653646618 shutdown_connections 2023-07-14T13:26:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.531+0000 7febeb575b80 1 -- 172.21.15.17:0/1653646618 wait complete. 2023-07-14T13:26:18.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.532+0000 7febeb575b80 1 -- start start 2023-07-14T13:26:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.533+0000 7febeb575b80 1 Processor -- start 2023-07-14T13:26:18.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.535+0000 7febeb575b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 0x560fa91b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.535+0000 7febeb575b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91a7580 0x560fa91b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.535+0000 7febeb575b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91ad2d0 0x560fa91b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.535+0000 7febeb575b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9213c10 con 0x560fa91ad2d0 2023-07-14T13:26:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.535+0000 7febeb575b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9213d80 con 0x560fa90036b0 2023-07-14T13:26:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.535+0000 7febeb575b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fa9213f40 con 0x560fa91a7580 2023-07-14T13:26:18.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.535+0000 7febeb575b80 10 client.0 _ll_register_callbacks cb 0x7febc800e470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:26:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.536+0000 7febd519a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91a7580 0x560fa91b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.536+0000 7febd519a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91a7580 0x560fa91b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40196/0 (socket says 172.21.15.17:40196) 2023-07-14T13:26:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.536+0000 7febd519a700 1 -- 172.21.15.17:0/695357508 learned_addr learned my addr 172.21.15.17:0/695357508 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:18.545 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.536+0000 7febd599b700 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 0x560fa91b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.536+0000 7febd599b700 1 -- 172.21.15.17:0/695357508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91a7580 msgr2=0x560fa91b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.536+0000 7febd599b700 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91a7580 0x560fa91b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.536+0000 7febd599b700 1 -- 172.21.15.17:0/695357508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91ad2d0 msgr2=0x560fa91b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.536+0000 7febd599b700 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91ad2d0 0x560fa91b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.536+0000 7febd599b700 1 -- 172.21.15.17:0/695357508 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fa8f0fc00 con 0x560fa90036b0 2023-07-14T13:26:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.537+0000 7febd599b700 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 0x560fa91b5560 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x560fa91c3860 tx=0x7febcc0194a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0ed29fe810f2855 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:18.547 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.538+0000 7febb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:26:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.538+0000 7febb97fa700 1 -- 172.21.15.17:0/695357508 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc017040 con 0x560fa90036b0 2023-07-14T13:26:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.538+0000 7febb97fa700 1 -- 172.21.15.17:0/695357508 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7febcc011640 con 0x560fa90036b0 2023-07-14T13:26:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.538+0000 7febeb575b80 1 -- 172.21.15.17:0/695357508 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febc800f040 con 0x560fa90036b0 2023-07-14T13:26:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.538+0000 7febb97fa700 1 -- 172.21.15.17:0/695357508 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7febcc011800 con 0x560fa90036b0 2023-07-14T13:26:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.539+0000 7febeb575b80 10 client.29270 fetch_fsmap learned FSMap version 62 2023-07-14T13:26:18.548 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.539+0000 7febeb575b80 1 -- 172.21.15.17:0/695357508 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x560fa8f25250 con 0x560fa90036b0 2023-07-14T13:26:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.539+0000 7febb97fa700 1 -- 172.21.15.17:0/695357508 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febc800f040 con 0x560fa90036b0 2023-07-14T13:26:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.539+0000 7febb97fa700 1 -- 172.21.15.17:0/695357508 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 62) v1 ==== 7482+0+0 (secure 0 0 0) 0x7febcc0217c0 con 0x560fa90036b0 2023-07-14T13:26:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.540+0000 7febeb575b80 10 client.29270 fetch_fsmap finished waiting for FSMap version 62 2023-07-14T13:26:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.540+0000 7febeb575b80 10 client.29270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:26:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.540+0000 7febeb575b80 20 client.29270 populate_metadata read hostname 'smithi017' 2023-07-14T13:26:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.540+0000 7febeb575b80 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560fa9215640 0x560fa9217a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.540+0000 7febeb575b80 4 client.29270 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:26:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.540+0000 7febeb575b80 1 -- 172.21.15.17:0/695357508 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560fa90b3ff0 con 0x560fa9215640 2023-07-14T13:26:18.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.541+0000 7febd519a700 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560fa9215640 0x560fa9217a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:18.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.542+0000 7febd519a700 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560fa9215640 0x560fa9217a50 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d074d41f8a54d5eb server_cookie=9c386d9488651636 in_seq=0 out_seq=0 2023-07-14T13:26:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.544+0000 7febb97fa700 10 client.29270 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.611+0000 7febb97fa700 1 -- 172.21.15.17:0/695357508 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560fa90b3ff0 con 0x560fa9215640 2023-07-14T13:26:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.611+0000 7febb97fa700 10 client.29270 handle_command_reply: tid=0 2023-07-14T13:26:18.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.611+0000 7febeb575b80 1 client.29270 shutdown 2023-07-14T13:26:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.612+0000 7febeb575b80 1 -- 172.21.15.17:0/695357508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 msgr2=0x560fa91b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.612+0000 7febeb575b80 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 0x560fa91b5560 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x560fa91c3860 tx=0x7febcc0194a0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.614+0000 7febeb575b80 1 -- 172.21.15.17:0/695357508 shutdown_connections 2023-07-14T13:26:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.614+0000 7febeb575b80 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560fa9215640 0x560fa9217a50 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.614+0000 7febeb575b80 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560fa91ad2d0 0x560fa91b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.614+0000 7febeb575b80 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560fa90036b0 0x560fa91b5560 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.614+0000 7febeb575b80 1 --2- 172.21.15.17:0/695357508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fa91a7580 0x560fa91b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.614+0000 7febeb575b80 1 -- 172.21.15.17:0/695357508 >> 172.21.15.17:0/695357508 conn(0x560fa919cbe0 msgr2=0x560fa91ac320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:18.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.614+0000 7febb97fa700 0 client.29270 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.614+0000 7febeb575b80 1 -- 172.21.15.17:0/695357508 shutdown_connections 2023-07-14T13:26:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.614+0000 7febeb575b80 1 -- 172.21.15.17:0/695357508 wait complete. 2023-07-14T13:26:18.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.615+0000 7febeb575b80 20 client.29270 trim_cache size 0 max 16384 2023-07-14T13:26:18.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:26:18.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:26:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:26:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:26:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.616+0000 7febd7bff700 1 -- 172.21.15.17:0/3722266786 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febbc0a13c0 msgr2=0x7febbc0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.616+0000 7febd7bff700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febbc0a13c0 0x7febbc0a3870 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7febc801d000 tx=0x7febc8015eb0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.616+0000 7febd7bff700 1 -- 172.21.15.17:0/3722266786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febd00ff3e0 msgr2=0x7febd01945d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.616+0000 7febd7bff700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febd00ff3e0 0x7febd01945d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7febc0005740 tx=0x7febc0005e80 comp rx=0 tx=0).stop 2023-07-14T13:26:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.616+0000 7febd7bff700 1 -- 172.21.15.17:0/3722266786 shutdown_connections 2023-07-14T13:26:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.616+0000 7febd7bff700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7febbc0a13c0 0x7febbc0a3870 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.616+0000 7febd7bff700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febd0104a30 0x7febd0199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.616+0000 7febd7bff700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd00fea30 0x7febd0194090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.616+0000 7febd7bff700 1 --2- 172.21.15.17:0/3722266786 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7febd00ff3e0 0x7febd01945d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.616+0000 7febd7bff700 1 -- 172.21.15.17:0/3722266786 >> 172.21.15.17:0/3722266786 conn(0x7febd0074760 msgr2=0x7febd0067980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.616+0000 7febd7bff700 1 -- 172.21.15.17:0/3722266786 shutdown_connections 2023-07-14T13:26:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:18.617+0000 7febd7bff700 1 -- 172.21.15.17:0/3722266786 wait complete. 2023-07-14T13:26:19.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:19 smithi017 ceph-mon[95536]: pgmap v842: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 766 op/s 2023-07-14T13:26:19.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:19 smithi135 ceph-mon[97338]: pgmap v842: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 766 op/s 2023-07-14T13:26:19.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:19 smithi131 ceph-mon[96953]: pgmap v842: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 8.7 MiB/s wr, 766 op/s 2023-07-14T13:26:21.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:21 smithi017 ceph-mon[95536]: pgmap v843: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.6 MiB/s wr, 829 op/s 2023-07-14T13:26:21.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:21 smithi135 ceph-mon[97338]: pgmap v843: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.6 MiB/s wr, 829 op/s 2023-07-14T13:26:21.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:21 smithi131 ceph-mon[96953]: pgmap v843: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 9.6 MiB/s wr, 829 op/s 2023-07-14T13:26:22.428 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 490.0 s, 485.8 tps, lat 195.227 ms stddev 62.181 2023-07-14T13:26:23.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:23 smithi017 ceph-mon[95536]: pgmap v844: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-14T13:26:23.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:23 smithi135 ceph-mon[97338]: pgmap v844: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-14T13:26:23.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:23 smithi131 ceph-mon[96953]: pgmap v844: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-14T13:26:25.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:25 smithi135 ceph-mon[97338]: pgmap v845: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-14T13:26:25.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:25 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:26:25.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:25 smithi131 ceph-mon[96953]: pgmap v845: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-14T13:26:25.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:25 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:26:26.085 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:25 smithi017 ceph-mon[95536]: pgmap v845: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-14T13:26:26.085 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:25 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:26:27.427 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 495.0 s, 408.8 tps, lat 254.859 ms stddev 419.779 2023-07-14T13:26:27.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:27 smithi017 ceph-mon[95536]: pgmap v846: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-07-14T13:26:27.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:27 smithi135 ceph-mon[97338]: pgmap v846: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-07-14T13:26:27.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:27 smithi131 ceph-mon[96953]: pgmap v846: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-07-14T13:26:29.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:29 smithi017 ceph-mon[95536]: pgmap v847: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 10 MiB/s wr, 909 op/s 2023-07-14T13:26:29.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:29 smithi135 ceph-mon[97338]: pgmap v847: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 10 MiB/s wr, 909 op/s 2023-07-14T13:26:29.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:29 smithi131 ceph-mon[96953]: pgmap v847: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 10 MiB/s wr, 909 op/s 2023-07-14T13:26:31.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:31 smithi017 ceph-mon[95536]: pgmap v848: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 977 op/s 2023-07-14T13:26:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.892+0000 7fc849fff700 1 -- 172.21.15.17:0/482270831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8440731c0 msgr2=0x7fc8441105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.892+0000 7fc849fff700 1 --2- 172.21.15.17:0/482270831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8440731c0 0x7fc8441105d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00b0a0 tx=0x7fc83c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.893+0000 7fc849fff700 1 -- 172.21.15.17:0/482270831 shutdown_connections 2023-07-14T13:26:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.893+0000 7fc849fff700 1 --2- 172.21.15.17:0/482270831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc844110b10 0x7fc844112ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.893+0000 7fc849fff700 1 --2- 172.21.15.17:0/482270831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8440728b0 0x7fc844072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.893+0000 7fc849fff700 1 --2- 172.21.15.17:0/482270831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8440731c0 0x7fc8441105d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.893+0000 7fc849fff700 1 -- 172.21.15.17:0/482270831 >> 172.21.15.17:0/482270831 conn(0x7fc8440fb600 msgr2=0x7fc8440fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.893+0000 7fc849fff700 1 -- 172.21.15.17:0/482270831 shutdown_connections 2023-07-14T13:26:31.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.894+0000 7fc849fff700 1 -- 172.21.15.17:0/482270831 wait complete. 2023-07-14T13:26:31.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.895+0000 7fc849fff700 1 Processor -- start 2023-07-14T13:26:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.900+0000 7fc849fff700 1 -- start start 2023-07-14T13:26:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.900+0000 7fc849fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8440728b0 0x7fc844110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.900+0000 7fc849fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8440731c0 0x7fc8441105d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.900+0000 7fc849fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc844110b10 0x7fc844109080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.900+0000 7fc849fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc844109850 con 0x7fc8440731c0 2023-07-14T13:26:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.900+0000 7fc849fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8441099c0 con 0x7fc8440728b0 2023-07-14T13:26:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.900+0000 7fc849fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc844109b80 con 0x7fc844110b10 2023-07-14T13:26:31.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.900+0000 7fc8437fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8440728b0 0x7fc844110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.901+0000 7fc8437fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8440728b0 0x7fc844110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58914/0 (socket says 172.21.15.17:58914) 2023-07-14T13:26:31.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.901+0000 7fc8437fe700 1 -- 172.21.15.17:0/1905711557 learned_addr learned my addr 172.21.15.17:0/1905711557 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:31.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.901+0000 7fc843fff700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc844110b10 0x7fc844109080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.901+0000 7fc8437fe700 1 -- 172.21.15.17:0/1905711557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc844110b10 msgr2=0x7fc844109080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.901+0000 7fc8437fe700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc844110b10 0x7fc844109080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.901+0000 7fc8437fe700 1 -- 172.21.15.17:0/1905711557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8440731c0 msgr2=0x7fc8441105d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.901+0000 7fc8437fe700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8440731c0 0x7fc8441105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.901+0000 7fc8437fe700 1 -- 172.21.15.17:0/1905711557 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc838009520 con 0x7fc8440728b0 2023-07-14T13:26:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.902+0000 7fc8437fe700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8440728b0 0x7fc844110050 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc83800eb30 tx=0x7fc83800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.903+0000 7fc840ff9700 1 -- 172.21.15.17:0/1905711557 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800cc90 con 0x7fc8440728b0 2023-07-14T13:26:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.903+0000 7fc840ff9700 1 -- 172.21.15.17:0/1905711557 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8380044b0 con 0x7fc8440728b0 2023-07-14T13:26:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.903+0000 7fc840ff9700 1 -- 172.21.15.17:0/1905711557 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838003db0 con 0x7fc8440728b0 2023-07-14T13:26:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.903+0000 7fc849fff700 1 -- 172.21.15.17:0/1905711557 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c009d00 con 0x7fc8440728b0 2023-07-14T13:26:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.903+0000 7fc849fff700 1 -- 172.21.15.17:0/1905711557 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84410df10 con 0x7fc8440728b0 2023-07-14T13:26:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.909+0000 7fc840ff9700 1 -- 172.21.15.17:0/1905711557 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc838003f10 con 0x7fc8440728b0 2023-07-14T13:26:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.911+0000 7fc85d886b80 1 Processor -- start 2023-07-14T13:26:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.913+0000 7fc840ff9700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc82c0a1410 0x7fc82c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.913+0000 7fc840ff9700 1 -- 172.21.15.17:0/1905711557 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc838014070 con 0x7fc8440728b0 2023-07-14T13:26:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.914+0000 7fc85d886b80 1 -- start start 2023-07-14T13:26:31.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.915+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb685816b0 0x55eb6872ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.915+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb6872b2d0 0x55eb68725040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.915+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb687259d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.915+0000 7fc85d886b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb6862ac50 con 0x55eb68725580 2023-07-14T13:26:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.915+0000 7fc85d886b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb6867d9e0 con 0x55eb685816b0 2023-07-14T13:26:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.915+0000 7fc85d886b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb68676e70 con 0x55eb6872b2d0 2023-07-14T13:26:31.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.915+0000 7fc843fff700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc82c0a1410 0x7fc82c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.915+0000 7fc842ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb6872b2d0 0x55eb68725040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:31 smithi135 ceph-mon[97338]: pgmap v848: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 977 op/s 2023-07-14T13:26:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.915+0000 7fc842ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb6872b2d0 0x55eb68725040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34494/0 (socket says 172.21.15.17:34494) 2023-07-14T13:26:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.915+0000 7fc842ffd700 1 -- 172.21.15.17:0/4024989097 learned_addr learned my addr 172.21.15.17:0/4024989097 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.915+0000 7fc843fff700 1 --2- 172.21.15.17:0/4024989097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb687259d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.916+0000 7fc842ffd700 1 -- 172.21.15.17:0/4024989097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb685816b0 msgr2=0x55eb6872ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.916+0000 7fc8437fe700 1 --2- 172.21.15.17:0/4024989097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb685816b0 0x55eb6872ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.916+0000 7fc842ffd700 1 --2- 172.21.15.17:0/4024989097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb685816b0 0x55eb6872ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.916+0000 7fc842ffd700 1 -- 172.21.15.17:0/4024989097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 msgr2=0x55eb687259d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.916+0000 7fc842ffd700 1 --2- 172.21.15.17:0/4024989097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb687259d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.916+0000 7fc842ffd700 1 -- 172.21.15.17:0/4024989097 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb684a4d80 con 0x55eb6872b2d0 2023-07-14T13:26:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.916+0000 7fc842ffd700 1 --2- 172.21.15.17:0/4024989097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb6872b2d0 0x55eb68725040 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00b070 tx=0x7fc83c009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be07fd1884d582b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.917+0000 7fc829ffb700 1 -- 172.21.15.17:0/4024989097 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c021070 con 0x55eb6872b2d0 2023-07-14T13:26:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.917+0000 7fc829ffb700 1 -- 172.21.15.17:0/4024989097 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc83c007b90 con 0x55eb6872b2d0 2023-07-14T13:26:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.917+0000 7fc829ffb700 1 -- 172.21.15.17:0/4024989097 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00e040 con 0x55eb6872b2d0 2023-07-14T13:26:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.918+0000 7fc85d886b80 1 -- 172.21.15.17:0/4024989097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb6872b2d0 msgr2=0x55eb68725040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.918+0000 7fc85d886b80 1 --2- 172.21.15.17:0/4024989097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb6872b2d0 0x55eb68725040 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00b070 tx=0x7fc83c009c70 comp rx=0 tx=0).stop 2023-07-14T13:26:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.921+0000 7fc85d886b80 1 -- 172.21.15.17:0/4024989097 shutdown_connections 2023-07-14T13:26:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.921+0000 7fc85d886b80 1 --2- 172.21.15.17:0/4024989097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb687259d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.921+0000 7fc85d886b80 1 --2- 172.21.15.17:0/4024989097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb685816b0 0x55eb6872ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.921+0000 7fc85d886b80 1 --2- 172.21.15.17:0/4024989097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb6872b2d0 0x55eb68725040 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.921+0000 7fc85d886b80 1 -- 172.21.15.17:0/4024989097 >> 172.21.15.17:0/4024989097 conn(0x55eb6871abe0 msgr2=0x55eb6871ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.922+0000 7fc843fff700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc82c0a1410 0x7fc82c0a38c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc844069ab0 tx=0x7fc834009510 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:31.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.924+0000 7fc85d886b80 1 -- 172.21.15.17:0/4024989097 shutdown_connections 2023-07-14T13:26:31.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.924+0000 7fc85d886b80 1 -- 172.21.15.17:0/4024989097 wait complete. 2023-07-14T13:26:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.925+0000 7fc85d886b80 1 -- start start 2023-07-14T13:26:31.934 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.925+0000 7fc85d886b80 1 Processor -- start 2023-07-14T13:26:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.926+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb685816b0 0x55eb68731520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.926+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb6872e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.926+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb6872b2d0 0x55eb6872ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.926+0000 7fc85d886b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb68616a60 con 0x55eb68725580 2023-07-14T13:26:31.935 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.926+0000 7fc85d886b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb68616760 con 0x55eb685816b0 2023-07-14T13:26:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.926+0000 7fc85d886b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb684fa8c0 con 0x55eb6872b2d0 2023-07-14T13:26:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.926+0000 7fc85d886b80 10 client.0 _ll_register_callbacks cb 0x55eb68614700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:26:31.936 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.927+0000 7fc842ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb6872e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.927+0000 7fc842ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb6872e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45454/0 (socket says 172.21.15.17:45454) 2023-07-14T13:26:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.927+0000 7fc842ffd700 1 -- 172.21.15.17:0/436722756 learned_addr learned my addr 172.21.15.17:0/436722756 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.928+0000 7fc842ffd700 1 -- 172.21.15.17:0/436722756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb6872b2d0 msgr2=0x55eb6872ee70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:26:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.928+0000 7fc842ffd700 1 --2- 172.21.15.17:0/436722756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb6872b2d0 0x55eb6872ee70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.928+0000 7fc842ffd700 1 -- 172.21.15.17:0/436722756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb685816b0 msgr2=0x55eb68731520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:26:31.937 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.928+0000 7fc842ffd700 1 --2- 172.21.15.17:0/436722756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb685816b0 0x55eb68731520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.928+0000 7fc842ffd700 1 -- 172.21.15.17:0/436722756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8441137b0 con 0x55eb68725580 2023-07-14T13:26:31.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.929+0000 7fc842ffd700 1 --2- 172.21.15.17:0/436722756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb6872e840 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00b0a0 tx=0x7fc83c00bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0eefcb6d093f5d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:31.938 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.930+0000 7fc822ffd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:26:31.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.930+0000 7fc822ffd700 1 -- 172.21.15.17:0/436722756 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c021070 con 0x55eb68725580 2023-07-14T13:26:31.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.930+0000 7fc822ffd700 1 -- 172.21.15.17:0/436722756 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc83c003a00 con 0x55eb68725580 2023-07-14T13:26:31.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.930+0000 7fc85d886b80 1 -- 172.21.15.17:0/436722756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb685d0490 con 0x55eb68725580 2023-07-14T13:26:31.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.931+0000 7fc822ffd700 1 -- 172.21.15.17:0/436722756 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc83c00e070 con 0x55eb68725580 2023-07-14T13:26:31.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.931+0000 7fc85d886b80 10 client.19488 fetch_fsmap learned FSMap version 63 2023-07-14T13:26:31.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.931+0000 7fc85d886b80 1 -- 172.21.15.17:0/436722756 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55eb6848dc00 con 0x55eb68725580 2023-07-14T13:26:31.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.932+0000 7fc822ffd700 1 -- 172.21.15.17:0/436722756 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55eb685d0490 con 0x55eb68725580 2023-07-14T13:26:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.932+0000 7fc822ffd700 1 -- 172.21.15.17:0/436722756 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 63) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc83c019070 con 0x55eb68725580 2023-07-14T13:26:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.932+0000 7fc85d886b80 10 client.19488 fetch_fsmap finished waiting for FSMap version 63 2023-07-14T13:26:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.932+0000 7fc85d886b80 10 client.19488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:26:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.932+0000 7fc85d886b80 20 client.19488 populate_metadata read hostname 'smithi017' 2023-07-14T13:26:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.932+0000 7fc85d886b80 1 --2- 172.21.15.17:0/436722756 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eb6873e8b0 0x55eb68740cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.932+0000 7fc85d886b80 4 client.19488 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:26:31.941 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.932+0000 7fc85d886b80 1 -- 172.21.15.17:0/436722756 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb6866fe50 con 0x55eb6873e8b0 2023-07-14T13:26:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.936+0000 7fc8437fe700 1 --2- 172.21.15.17:0/436722756 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eb6873e8b0 0x55eb68740cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.937+0000 7fc8437fe700 1 --2- 172.21.15.17:0/436722756 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eb6873e8b0 0x55eb68740cc0 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa2e0d2ee212af58 server_cookie=232983ab686137cb in_seq=0 out_seq=0 2023-07-14T13:26:31.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.937+0000 7fc822ffd700 10 client.19488 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.938+0000 7fc822ffd700 1 -- 172.21.15.17:0/436722756 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55eb6866fe50 con 0x55eb6873e8b0 2023-07-14T13:26:31.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.938+0000 7fc822ffd700 10 client.19488 handle_command_reply: tid=0 2023-07-14T13:26:31.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.939+0000 7fc85d886b80 1 client.19488 shutdown 2023-07-14T13:26:31.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.939+0000 7fc85d886b80 1 -- 172.21.15.17:0/436722756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 msgr2=0x55eb6872e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.939+0000 7fc85d886b80 1 --2- 172.21.15.17:0/436722756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb6872e840 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00b0a0 tx=0x7fc83c00bf20 comp rx=0 tx=0).stop 2023-07-14T13:26:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.939+0000 7fc85d886b80 1 -- 172.21.15.17:0/436722756 shutdown_connections 2023-07-14T13:26:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.939+0000 7fc85d886b80 1 --2- 172.21.15.17:0/436722756 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eb6873e8b0 0x55eb68740cc0 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.939+0000 7fc85d886b80 1 --2- 172.21.15.17:0/436722756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb6872b2d0 0x55eb6872ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.939+0000 7fc85d886b80 1 --2- 172.21.15.17:0/436722756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb685816b0 0x55eb68731520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.939+0000 7fc85d886b80 1 --2- 172.21.15.17:0/436722756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb6872e840 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.939+0000 7fc85d886b80 1 -- 172.21.15.17:0/436722756 >> 172.21.15.17:0/436722756 conn(0x55eb6871abe0 msgr2=0x55eb6871f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.940+0000 7fc822ffd700 0 client.19488 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.941+0000 7fc85d886b80 1 -- 172.21.15.17:0/436722756 shutdown_connections 2023-07-14T13:26:31.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.941+0000 7fc85d886b80 1 -- 172.21.15.17:0/436722756 wait complete. 2023-07-14T13:26:31.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.941+0000 7fc85d886b80 20 client.19488 trim_cache size 0 max 16384 2023-07-14T13:26:31.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:31 smithi131 ceph-mon[96953]: pgmap v848: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 977 op/s 2023-07-14T13:26:31.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.971+0000 7fc85d886b80 1 Processor -- start 2023-07-14T13:26:31.983 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.973+0000 7fc85d886b80 1 -- start start 2023-07-14T13:26:31.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.974+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb685816b0 0x55eb6871fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.974+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb68731050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.974+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb6872b2d0 0x55eb6872e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.974+0000 7fc85d886b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb6872b8a0 con 0x55eb68725580 2023-07-14T13:26:31.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.974+0000 7fc85d886b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb6872fe20 con 0x55eb6872b2d0 2023-07-14T13:26:31.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.974+0000 7fc85d886b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb68725fd0 con 0x55eb685816b0 2023-07-14T13:26:31.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.974+0000 7fc8437fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb685816b0 0x55eb6871fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.974+0000 7fc8437fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb685816b0 0x55eb6871fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34518/0 (socket says 172.21.15.17:34518) 2023-07-14T13:26:31.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.974+0000 7fc8437fe700 1 -- 172.21.15.17:0/3602538 learned_addr learned my addr 172.21.15.17:0/3602538 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:31.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.975+0000 7fc843fff700 1 --2- 172.21.15.17:0/3602538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb6872b2d0 0x55eb6872e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.975+0000 7fc842ffd700 1 --2- 172.21.15.17:0/3602538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb68731050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.975+0000 7fc8437fe700 1 -- 172.21.15.17:0/3602538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb6872b2d0 msgr2=0x55eb6872e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:31.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.975+0000 7fc8437fe700 1 --2- 172.21.15.17:0/3602538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb6872b2d0 0x55eb6872e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.975+0000 7fc8437fe700 1 -- 172.21.15.17:0/3602538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 msgr2=0x55eb68731050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:31.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.975+0000 7fc8437fe700 1 --2- 172.21.15.17:0/3602538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb68731050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.975+0000 7fc8437fe700 1 -- 172.21.15.17:0/3602538 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb684cb1f0 con 0x55eb685816b0 2023-07-14T13:26:31.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.975+0000 7fc842ffd700 1 --2- 172.21.15.17:0/3602538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb68731050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:26:31.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.975+0000 7fc843fff700 1 --2- 172.21.15.17:0/3602538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb6872b2d0 0x55eb6872e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:26:31.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.975+0000 7fc8437fe700 1 --2- 172.21.15.17:0/3602538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb685816b0 0x55eb6871fc60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc8380cad10 tx=0x7fc838003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4f50d5b34af7c5a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.976+0000 7fc82a7fc700 1 -- 172.21.15.17:0/3602538 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8380a24e0 con 0x55eb685816b0 2023-07-14T13:26:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.976+0000 7fc82a7fc700 1 -- 172.21.15.17:0/3602538 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8380981d0 con 0x55eb685816b0 2023-07-14T13:26:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.976+0000 7fc82a7fc700 1 -- 172.21.15.17:0/3602538 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83809a2f0 con 0x55eb685816b0 2023-07-14T13:26:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.977+0000 7fc85d886b80 1 -- 172.21.15.17:0/3602538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb685816b0 msgr2=0x55eb6871fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.977+0000 7fc85d886b80 1 --2- 172.21.15.17:0/3602538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb685816b0 0x55eb6871fc60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc8380cad10 tx=0x7fc838003680 comp rx=0 tx=0).stop 2023-07-14T13:26:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.977+0000 7fc85d886b80 1 -- 172.21.15.17:0/3602538 shutdown_connections 2023-07-14T13:26:31.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.977+0000 7fc85d886b80 1 --2- 172.21.15.17:0/3602538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb6872b2d0 0x55eb6872e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.977+0000 7fc85d886b80 1 --2- 172.21.15.17:0/3602538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb685816b0 0x55eb6871fc60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.977+0000 7fc85d886b80 1 --2- 172.21.15.17:0/3602538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb68725580 0x55eb68731050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.977+0000 7fc85d886b80 1 -- 172.21.15.17:0/3602538 >> 172.21.15.17:0/3602538 conn(0x55eb6871abe0 msgr2=0x55eb68728b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.977+0000 7fc85d886b80 1 -- 172.21.15.17:0/3602538 shutdown_connections 2023-07-14T13:26:31.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.977+0000 7fc85d886b80 1 -- 172.21.15.17:0/3602538 wait complete. 2023-07-14T13:26:31.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.978+0000 7fc85d886b80 1 -- start start 2023-07-14T13:26:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.978+0000 7fc85d886b80 1 Processor -- start 2023-07-14T13:26:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.979+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb685816b0 0x55eb68733c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.979+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb68725580 0x55eb68734190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.979+0000 7fc85d886b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb6872b2d0 0x55eb687346d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.979+0000 7fc85d886b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb68791730 con 0x55eb685816b0 2023-07-14T13:26:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.979+0000 7fc85d886b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb68791870 con 0x55eb6872b2d0 2023-07-14T13:26:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.979+0000 7fc85d886b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb687919e0 con 0x55eb68725580 2023-07-14T13:26:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.979+0000 7fc85d886b80 10 client.0 _ll_register_callbacks cb 0x7fc838005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:26:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.980+0000 7fc842ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb68725580 0x55eb68734190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.980+0000 7fc842ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb68725580 0x55eb68734190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34528/0 (socket says 172.21.15.17:34528) 2023-07-14T13:26:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.980+0000 7fc842ffd700 1 -- 172.21.15.17:0/184172397 learned_addr learned my addr 172.21.15.17:0/184172397 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.980+0000 7fc8437fe700 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb685816b0 0x55eb68733c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.981+0000 7fc842ffd700 1 -- 172.21.15.17:0/184172397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb6872b2d0 msgr2=0x55eb687346d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.981+0000 7fc842ffd700 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb6872b2d0 0x55eb687346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.981+0000 7fc842ffd700 1 -- 172.21.15.17:0/184172397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb685816b0 msgr2=0x55eb68733c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.981+0000 7fc842ffd700 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb685816b0 0x55eb68733c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:31.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.981+0000 7fc842ffd700 1 -- 172.21.15.17:0/184172397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84410df10 con 0x55eb68725580 2023-07-14T13:26:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.981+0000 7fc842ffd700 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb68725580 0x55eb68734190 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00b070 tx=0x7fc83c01df80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d7c48467eea4df5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.981+0000 7fc822ffd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:26:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.981+0000 7fc822ffd700 1 -- 172.21.15.17:0/184172397 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c021060 con 0x55eb68725580 2023-07-14T13:26:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.981+0000 7fc822ffd700 1 -- 172.21.15.17:0/184172397 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc83c003c10 con 0x55eb68725580 2023-07-14T13:26:31.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.981+0000 7fc85d886b80 1 -- 172.21.15.17:0/184172397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc83c007b90 con 0x55eb68725580 2023-07-14T13:26:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.982+0000 7fc822ffd700 1 -- 172.21.15.17:0/184172397 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc83c00e030 con 0x55eb68725580 2023-07-14T13:26:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.983+0000 7fc85d886b80 10 client.29230 fetch_fsmap learned FSMap version 63 2023-07-14T13:26:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.983+0000 7fc85d886b80 1 -- 172.21.15.17:0/184172397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55eb684a3250 con 0x55eb68725580 2023-07-14T13:26:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.987+0000 7fc822ffd700 1 -- 172.21.15.17:0/184172397 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc83c007b90 con 0x55eb68725580 2023-07-14T13:26:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.987+0000 7fc822ffd700 1 -- 172.21.15.17:0/184172397 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 63) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc83c019040 con 0x55eb68725580 2023-07-14T13:26:31.998 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.987+0000 7fc85d886b80 10 client.29230 fetch_fsmap finished waiting for FSMap version 63 2023-07-14T13:26:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.987+0000 7fc85d886b80 10 client.29230 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:26:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.987+0000 7fc85d886b80 20 client.29230 populate_metadata read hostname 'smithi017' 2023-07-14T13:26:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.988+0000 7fc85d886b80 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eb68792c80 0x55eb68795090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.988+0000 7fc85d886b80 4 client.29230 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:26:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.988+0000 7fc85d886b80 1 -- 172.21.15.17:0/184172397 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55eb68631ff0 con 0x55eb68792c80 2023-07-14T13:26:31.999 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.989+0000 7fc8437fe700 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eb68792c80 0x55eb68795090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:32.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.992+0000 7fc8437fe700 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eb68792c80 0x55eb68795090 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2713765bc131b454 server_cookie=6d2dc45f7ab95a57 in_seq=0 out_seq=0 2023-07-14T13:26:32.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:31.992+0000 7fc822ffd700 10 client.29230 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:32.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.033+0000 7fc822ffd700 1 -- 172.21.15.17:0/184172397 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55eb68631ff0 con 0x55eb68792c80 2023-07-14T13:26:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.033+0000 7fc822ffd700 10 client.29230 handle_command_reply: tid=0 2023-07-14T13:26:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.033+0000 7fc85d886b80 1 client.29230 shutdown 2023-07-14T13:26:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.034+0000 7fc85d886b80 1 -- 172.21.15.17:0/184172397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb68725580 msgr2=0x55eb68734190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.034+0000 7fc85d886b80 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb68725580 0x55eb68734190 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00b070 tx=0x7fc83c01df80 comp rx=0 tx=0).stop 2023-07-14T13:26:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.034+0000 7fc85d886b80 1 -- 172.21.15.17:0/184172397 shutdown_connections 2023-07-14T13:26:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.034+0000 7fc85d886b80 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55eb68792c80 0x55eb68795090 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.034+0000 7fc85d886b80 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb6872b2d0 0x55eb687346d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.034+0000 7fc85d886b80 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55eb685816b0 0x55eb68733c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.034+0000 7fc85d886b80 1 --2- 172.21.15.17:0/184172397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb68725580 0x55eb68734190 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:32.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.034+0000 7fc85d886b80 1 -- 172.21.15.17:0/184172397 >> 172.21.15.17:0/184172397 conn(0x55eb6871abe0 msgr2=0x55eb68729a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:32.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.035+0000 7fc822ffd700 0 client.29230 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:32.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.037+0000 7fc85d886b80 1 -- 172.21.15.17:0/184172397 shutdown_connections 2023-07-14T13:26:32.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.037+0000 7fc85d886b80 1 -- 172.21.15.17:0/184172397 wait complete. 2023-07-14T13:26:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.038+0000 7fc85d886b80 20 client.29230 trim_cache size 0 max 16384 2023-07-14T13:26:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:26:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:26:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:26:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:26:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.040+0000 7fc849fff700 1 -- 172.21.15.17:0/1905711557 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc82c0a1410 msgr2=0x7fc82c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.040+0000 7fc849fff700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc82c0a1410 0x7fc82c0a38c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc844069ab0 tx=0x7fc834009510 comp rx=0 tx=0).stop 2023-07-14T13:26:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.040+0000 7fc849fff700 1 -- 172.21.15.17:0/1905711557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8440728b0 msgr2=0x7fc844110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.040+0000 7fc849fff700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8440728b0 0x7fc844110050 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc83800eb30 tx=0x7fc83800ee40 comp rx=0 tx=0).stop 2023-07-14T13:26:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.041+0000 7fc849fff700 1 -- 172.21.15.17:0/1905711557 shutdown_connections 2023-07-14T13:26:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.041+0000 7fc849fff700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc82c0a1410 0x7fc82c0a38c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.041+0000 7fc849fff700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc844110b10 0x7fc844109080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.041+0000 7fc849fff700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8440728b0 0x7fc844110050 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.041+0000 7fc849fff700 1 --2- 172.21.15.17:0/1905711557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8440731c0 0x7fc8441105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.041+0000 7fc849fff700 1 -- 172.21.15.17:0/1905711557 >> 172.21.15.17:0/1905711557 conn(0x7fc8440fb600 msgr2=0x7fc8440fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.042+0000 7fc849fff700 1 -- 172.21.15.17:0/1905711557 shutdown_connections 2023-07-14T13:26:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:32.042+0000 7fc849fff700 1 -- 172.21.15.17:0/1905711557 wait complete. 2023-07-14T13:26:32.427 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 500.0 s, 551.6 tps, lat 181.203 ms stddev 51.984 2023-07-14T13:26:33.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:33 smithi017 ceph-mon[95536]: pgmap v849: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 16 MiB/s wr, 1.40k op/s 2023-07-14T13:26:33.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:33 smithi135 ceph-mon[97338]: pgmap v849: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 16 MiB/s wr, 1.40k op/s 2023-07-14T13:26:33.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:33 smithi131 ceph-mon[96953]: pgmap v849: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 16 MiB/s wr, 1.40k op/s 2023-07-14T13:26:35.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:35 smithi017 ceph-mon[95536]: pgmap v850: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 952 op/s 2023-07-14T13:26:35.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:35 smithi135 ceph-mon[97338]: pgmap v850: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 952 op/s 2023-07-14T13:26:35.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:35 smithi131 ceph-mon[96953]: pgmap v850: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 10 MiB/s wr, 952 op/s 2023-07-14T13:26:37.429 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 505.0 s, 535.4 tps, lat 184.593 ms stddev 65.385 2023-07-14T13:26:37.838 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:37 smithi017 ceph-mon[95536]: pgmap v851: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 1.50k op/s 2023-07-14T13:26:37.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:37 smithi135 ceph-mon[97338]: pgmap v851: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 1.50k op/s 2023-07-14T13:26:37.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:37 smithi131 ceph-mon[96953]: pgmap v851: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 1.50k op/s 2023-07-14T13:26:39.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:39 smithi017 ceph-mon[95536]: pgmap v852: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-14T13:26:39.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:39 smithi135 ceph-mon[97338]: pgmap v852: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-14T13:26:39.978 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:39 smithi131 ceph-mon[96953]: pgmap v852: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-14T13:26:41.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:41 smithi017 ceph-mon[95536]: pgmap v853: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-07-14T13:26:41.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:41 smithi135 ceph-mon[97338]: pgmap v853: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-07-14T13:26:41.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:41 smithi131 ceph-mon[96953]: pgmap v853: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-07-14T13:26:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 510.0 s, 471.8 tps, lat 205.725 ms stddev 95.311 2023-07-14T13:26:43.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:43 smithi017 ceph-mon[95536]: pgmap v854: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 1.63k op/s 2023-07-14T13:26:43.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:43 smithi135 ceph-mon[97338]: pgmap v854: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 1.63k op/s 2023-07-14T13:26:43.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:43 smithi131 ceph-mon[96953]: pgmap v854: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 1.63k op/s 2023-07-14T13:26:45.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.288+0000 7f82d6bff700 1 -- 172.21.15.17:0/3286024875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82d00fea30 msgr2=0x7f82d00feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.288+0000 7f82d6bff700 1 --2- 172.21.15.17:0/3286024875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82d00fea30 0x7f82d00feea0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0098f0 tx=0x7f82bc009c00 comp rx=0 tx=0).stop 2023-07-14T13:26:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.289+0000 7f82d6bff700 1 -- 172.21.15.17:0/3286024875 shutdown_connections 2023-07-14T13:26:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.289+0000 7f82d6bff700 1 --2- 172.21.15.17:0/3286024875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82d00ff3e0 0x7f82d010b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.289+0000 7f82d6bff700 1 --2- 172.21.15.17:0/3286024875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d0104a30 0x7f82d0104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.289+0000 7f82d6bff700 1 --2- 172.21.15.17:0/3286024875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82d00fea30 0x7f82d00feea0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.289+0000 7f82d6bff700 1 -- 172.21.15.17:0/3286024875 >> 172.21.15.17:0/3286024875 conn(0x7f82d0074760 msgr2=0x7f82d0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:45.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.290+0000 7f82d6bff700 1 -- 172.21.15.17:0/3286024875 shutdown_connections 2023-07-14T13:26:45.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.291+0000 7f82d6bff700 1 -- 172.21.15.17:0/3286024875 wait complete. 2023-07-14T13:26:45.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.293+0000 7f82d6bff700 1 Processor -- start 2023-07-14T13:26:45.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.293+0000 7f82d6bff700 1 -- start start 2023-07-14T13:26:45.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.294+0000 7f82d6bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fea30 0x7f82d0071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.294+0000 7f82d6bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82d00ff3e0 0x7f82d00720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.294+0000 7f82d6bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82d0104a30 0x7f82d006aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.294+0000 7f82d6bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d006b200 con 0x7f82d0104a30 2023-07-14T13:26:45.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.294+0000 7f82d6bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d006b370 con 0x7f82d00fea30 2023-07-14T13:26:45.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.294+0000 7f82d6bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d006b530 con 0x7f82d00ff3e0 2023-07-14T13:26:45.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.294+0000 7f82d499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fea30 0x7f82d0071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.294+0000 7f82d499b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fea30 0x7f82d0071b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51602/0 (socket says 172.21.15.17:51602) 2023-07-14T13:26:45.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.294+0000 7f82d499b700 1 -- 172.21.15.17:0/1797002032 learned_addr learned my addr 172.21.15.17:0/1797002032 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:45.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.294+0000 7f82cffff700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82d00ff3e0 0x7f82d00720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.295+0000 7f82d519c700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82d0104a30 0x7f82d006aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.295+0000 7f82cffff700 1 -- 172.21.15.17:0/1797002032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fea30 msgr2=0x7f82d0071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:45.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.295+0000 7f82cffff700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fea30 0x7f82d0071b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.295+0000 7f82cffff700 1 -- 172.21.15.17:0/1797002032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82d0104a30 msgr2=0x7f82d006aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:45.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.295+0000 7f82cffff700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82d0104a30 0x7f82d006aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.295+0000 7f82cffff700 1 -- 172.21.15.17:0/1797002032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c8009d00 con 0x7f82d00ff3e0 2023-07-14T13:26:45.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.296+0000 7f82cffff700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82d00ff3e0 0x7f82d00720c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009810 tx=0x7f82bc00bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:45.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.297+0000 7f82cdffb700 1 -- 172.21.15.17:0/1797002032 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc01c070 con 0x7f82d00ff3e0 2023-07-14T13:26:45.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.297+0000 7f82cdffb700 1 -- 172.21.15.17:0/1797002032 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82bc005040 con 0x7f82d00ff3e0 2023-07-14T13:26:45.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.297+0000 7f82cdffb700 1 -- 172.21.15.17:0/1797002032 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0038e0 con 0x7f82d00ff3e0 2023-07-14T13:26:45.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.297+0000 7f82d6bff700 1 -- 172.21.15.17:0/1797002032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc009520 con 0x7f82d00ff3e0 2023-07-14T13:26:45.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.297+0000 7f82d6bff700 1 -- 172.21.15.17:0/1797002032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d006f8b0 con 0x7f82d00ff3e0 2023-07-14T13:26:45.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.304+0000 7f82ea475b80 1 Processor -- start 2023-07-14T13:26:45.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.305+0000 7f82ea475b80 1 -- start start 2023-07-14T13:26:45.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.305+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1eb1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.305+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eb22d0 0x5604a1eac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.305+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eac580 0x5604a1eac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.305+0000 7f82ea475b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1db1c50 con 0x5604a1d086b0 2023-07-14T13:26:45.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.305+0000 7f82ea475b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1e049e0 con 0x5604a1eac580 2023-07-14T13:26:45.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.305+0000 7f82ea475b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1dfde70 con 0x5604a1eb22d0 2023-07-14T13:26:45.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.306+0000 7f82d499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eb22d0 0x5604a1eac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.306+0000 7f82d499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eb22d0 0x5604a1eac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35888/0 (socket says 172.21.15.17:35888) 2023-07-14T13:26:45.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.306+0000 7f82d499b700 1 -- 172.21.15.17:0/2366046820 learned_addr learned my addr 172.21.15.17:0/2366046820 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:45.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.306+0000 7f82d519c700 1 --2- 172.21.15.17:0/2366046820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1eb1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.306+0000 7f82d499b700 1 -- 172.21.15.17:0/2366046820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eac580 msgr2=0x5604a1eac9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:26:45.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.306+0000 7f82d499b700 1 --2- 172.21.15.17:0/2366046820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eac580 0x5604a1eac9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.306+0000 7f82d499b700 1 -- 172.21.15.17:0/2366046820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 msgr2=0x5604a1eb1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:45.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.306+0000 7f82d499b700 1 --2- 172.21.15.17:0/2366046820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1eb1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.306+0000 7f82d499b700 1 -- 172.21.15.17:0/2366046820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604a1c2bd80 con 0x5604a1eb22d0 2023-07-14T13:26:45.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.307+0000 7f82d499b700 1 --2- 172.21.15.17:0/2366046820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eb22d0 0x5604a1eac040 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f82c400dc30 tx=0x7f82c4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23e6682e47ea4f6b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:45.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.307+0000 7f82baffd700 1 -- 172.21.15.17:0/2366046820 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c401b070 con 0x5604a1eb22d0 2023-07-14T13:26:45.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.307+0000 7f82baffd700 1 -- 172.21.15.17:0/2366046820 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82c4013040 con 0x5604a1eb22d0 2023-07-14T13:26:45.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.307+0000 7f82baffd700 1 -- 172.21.15.17:0/2366046820 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4004b20 con 0x5604a1eb22d0 2023-07-14T13:26:45.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.307+0000 7f82cdffb700 1 -- 172.21.15.17:0/1797002032 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f82bc020030 con 0x7f82d00ff3e0 2023-07-14T13:26:45.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.308+0000 7f82ea475b80 1 -- 172.21.15.17:0/2366046820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eb22d0 msgr2=0x5604a1eac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:45.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.308+0000 7f82ea475b80 1 --2- 172.21.15.17:0/2366046820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eb22d0 0x5604a1eac040 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f82c400dc30 tx=0x7f82c4009260 comp rx=0 tx=0).stop 2023-07-14T13:26:45.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.308+0000 7f82ea475b80 1 -- 172.21.15.17:0/2366046820 shutdown_connections 2023-07-14T13:26:45.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.308+0000 7f82ea475b80 1 --2- 172.21.15.17:0/2366046820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eac580 0x5604a1eac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.308+0000 7f82ea475b80 1 --2- 172.21.15.17:0/2366046820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1eb1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.308+0000 7f82ea475b80 1 --2- 172.21.15.17:0/2366046820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eb22d0 0x5604a1eac040 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.308+0000 7f82ea475b80 1 -- 172.21.15.17:0/2366046820 >> 172.21.15.17:0/2366046820 conn(0x5604a1ea1be0 msgr2=0x5604a1ea6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:45.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.310+0000 7f82ea475b80 1 -- 172.21.15.17:0/2366046820 shutdown_connections 2023-07-14T13:26:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.310+0000 7f82ea475b80 1 -- 172.21.15.17:0/2366046820 wait complete. 2023-07-14T13:26:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.310+0000 7f82ea475b80 1 -- start start 2023-07-14T13:26:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.311+0000 7f82ea475b80 1 Processor -- start 2023-07-14T13:26:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.312+0000 7f82cdffb700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f82c00a13b0 0x7f82c00a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.312+0000 7f82cdffb700 1 -- 172.21.15.17:0/1797002032 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f82bc0ce100 con 0x7f82d00ff3e0 2023-07-14T13:26:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.313+0000 7f82d519c700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f82c00a13b0 0x7f82c00a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.313+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1eb5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.313+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eac580 0x5604a1eb5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.313+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eb22d0 0x5604a1eb63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.313+0000 7f82ea475b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1d9da60 con 0x5604a1d086b0 2023-07-14T13:26:45.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.313+0000 7f82ea475b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1d9d760 con 0x5604a1eb22d0 2023-07-14T13:26:45.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.313+0000 7f82ea475b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1c818c0 con 0x5604a1eac580 2023-07-14T13:26:45.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.313+0000 7f82ea475b80 10 client.0 _ll_register_callbacks cb 0x5604a1d9b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:26:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.313+0000 7f82d499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1eb5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.313+0000 7f82d499b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1eb5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44232/0 (socket says 172.21.15.17:44232) 2023-07-14T13:26:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.313+0000 7f82d499b700 1 -- 172.21.15.17:0/474597872 learned_addr learned my addr 172.21.15.17:0/474597872 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.314+0000 7f82cffff700 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eac580 0x5604a1eb5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.314+0000 7f82d519c700 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eb22d0 0x5604a1eb63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.314+0000 7f82cffff700 1 -- 172.21.15.17:0/474597872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eb22d0 msgr2=0x5604a1eb63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.314+0000 7f82cffff700 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eb22d0 0x5604a1eb63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.314+0000 7f82cffff700 1 -- 172.21.15.17:0/474597872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 msgr2=0x5604a1eb5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.314+0000 7f82cffff700 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1eb5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.314+0000 7f82cffff700 1 -- 172.21.15.17:0/474597872 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c400d910 con 0x5604a1eac580 2023-07-14T13:26:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.315+0000 7f82cffff700 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eac580 0x5604a1eb5e60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0cb810 tx=0x7f82bc09ab80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4bdab6d4d906355 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.315+0000 7f82affff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:26:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.315+0000 7f82affff700 1 -- 172.21.15.17:0/474597872 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc005690 con 0x5604a1eac580 2023-07-14T13:26:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.315+0000 7f82affff700 1 -- 172.21.15.17:0/474597872 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f82bc0a35e0 con 0x5604a1eac580 2023-07-14T13:26:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.315+0000 7f82ea475b80 1 -- 172.21.15.17:0/474597872 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604a1d57490 con 0x5604a1eac580 2023-07-14T13:26:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.315+0000 7f82affff700 1 -- 172.21.15.17:0/474597872 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82bc0cba90 con 0x5604a1eac580 2023-07-14T13:26:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82ea475b80 10 client.29242 fetch_fsmap learned FSMap version 63 2023-07-14T13:26:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82ea475b80 1 -- 172.21.15.17:0/474597872 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x5604a1c14c00 con 0x5604a1eac580 2023-07-14T13:26:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82d519c700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f82c00a13b0 0x7f82c00a3860 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009fd0 tx=0x7f82c800b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82affff700 1 -- 172.21.15.17:0/474597872 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5604a1d57490 con 0x5604a1eac580 2023-07-14T13:26:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82affff700 1 -- 172.21.15.17:0/474597872 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 63) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f82bc09a710 con 0x5604a1eac580 2023-07-14T13:26:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82ea475b80 10 client.29242 fetch_fsmap finished waiting for FSMap version 63 2023-07-14T13:26:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82ea475b80 10 client.29242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:26:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82ea475b80 20 client.29242 populate_metadata read hostname 'smithi017' 2023-07-14T13:26:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82ea475b80 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604a1ec5890 0x5604a1ec7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82ea475b80 4 client.29242 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:26:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82ea475b80 1 -- 172.21.15.17:0/474597872 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604a1df6e50 con 0x5604a1ec5890 2023-07-14T13:26:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.316+0000 7f82d499b700 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604a1ec5890 0x5604a1ec7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.317+0000 7f82affff700 10 client.29242 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.317+0000 7f82d499b700 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604a1ec5890 0x5604a1ec7ca0 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddafbda502dbb494 server_cookie=418c8021d82f7804 in_seq=0 out_seq=0 2023-07-14T13:26:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.318+0000 7f82affff700 1 -- 172.21.15.17:0/474597872 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5604a1df6e50 con 0x5604a1ec5890 2023-07-14T13:26:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.318+0000 7f82affff700 10 client.29242 handle_command_reply: tid=0 2023-07-14T13:26:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.318+0000 7f82ea475b80 1 client.29242 shutdown 2023-07-14T13:26:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.318+0000 7f82ea475b80 1 -- 172.21.15.17:0/474597872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eac580 msgr2=0x5604a1eb5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.318+0000 7f82ea475b80 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eac580 0x5604a1eb5e60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0cb810 tx=0x7f82bc09ab80 comp rx=0 tx=0).stop 2023-07-14T13:26:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.319+0000 7f82ea475b80 1 -- 172.21.15.17:0/474597872 shutdown_connections 2023-07-14T13:26:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.319+0000 7f82ea475b80 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604a1ec5890 0x5604a1ec7ca0 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.319+0000 7f82ea475b80 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eb22d0 0x5604a1eb63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.319+0000 7f82ea475b80 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1eb5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.319+0000 7f82ea475b80 1 --2- 172.21.15.17:0/474597872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1eac580 0x5604a1eb5e60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.319+0000 7f82ea475b80 1 -- 172.21.15.17:0/474597872 >> 172.21.15.17:0/474597872 conn(0x5604a1ea1be0 msgr2=0x5604a1ea5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.319+0000 7f82affff700 0 client.29242 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.319+0000 7f82ea475b80 1 -- 172.21.15.17:0/474597872 shutdown_connections 2023-07-14T13:26:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.319+0000 7f82ea475b80 1 -- 172.21.15.17:0/474597872 wait complete. 2023-07-14T13:26:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.319+0000 7f82ea475b80 20 client.29242 trim_cache size 0 max 16384 2023-07-14T13:26:45.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.346+0000 7f82ea475b80 1 Processor -- start 2023-07-14T13:26:45.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.347+0000 7f82ea475b80 1 -- start start 2023-07-14T13:26:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.347+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 0x5604a1eac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.347+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1d086b0 0x5604a1ebcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.347+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1eac580 0x5604a1eb4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.347+0000 7f82ea475b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1e9ec00 con 0x5604a1eac580 2023-07-14T13:26:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.347+0000 7f82ea475b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1eb6db0 con 0x5604a1d086b0 2023-07-14T13:26:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.347+0000 7f82ea475b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1eb3e80 con 0x5604a1ea1be0 2023-07-14T13:26:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.348+0000 7f82d499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 0x5604a1eac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.348+0000 7f82d499b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 0x5604a1eac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35912/0 (socket says 172.21.15.17:35912) 2023-07-14T13:26:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.348+0000 7f82d499b700 1 -- 172.21.15.17:0/445840215 learned_addr learned my addr 172.21.15.17:0/445840215 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.348+0000 7f82d519c700 1 --2- 172.21.15.17:0/445840215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1eac580 0x5604a1eb4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.349+0000 7f82d499b700 1 -- 172.21.15.17:0/445840215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1d086b0 msgr2=0x5604a1ebcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.349+0000 7f82cffff700 1 --2- 172.21.15.17:0/445840215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1d086b0 0x5604a1ebcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.349+0000 7f82d499b700 1 --2- 172.21.15.17:0/445840215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1d086b0 0x5604a1ebcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.349+0000 7f82d499b700 1 -- 172.21.15.17:0/445840215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1eac580 msgr2=0x5604a1eb4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.349+0000 7f82d499b700 1 --2- 172.21.15.17:0/445840215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1eac580 0x5604a1eb4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.349+0000 7f82d499b700 1 -- 172.21.15.17:0/445840215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604a1c521f0 con 0x5604a1ea1be0 2023-07-14T13:26:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.349+0000 7f82d499b700 1 --2- 172.21.15.17:0/445840215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 0x5604a1eac040 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f82c40096e0 tx=0x7f82c4009810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9355416f37235b67 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.350+0000 7f82bb7fe700 1 -- 172.21.15.17:0/445840215 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c401b040 con 0x5604a1ea1be0 2023-07-14T13:26:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.350+0000 7f82bb7fe700 1 -- 172.21.15.17:0/445840215 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82c401c040 con 0x5604a1ea1be0 2023-07-14T13:26:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.350+0000 7f82bb7fe700 1 -- 172.21.15.17:0/445840215 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4025410 con 0x5604a1ea1be0 2023-07-14T13:26:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.351+0000 7f82ea475b80 1 -- 172.21.15.17:0/445840215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 msgr2=0x5604a1eac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:45.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.351+0000 7f82ea475b80 1 --2- 172.21.15.17:0/445840215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 0x5604a1eac040 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f82c40096e0 tx=0x7f82c4009810 comp rx=0 tx=0).stop 2023-07-14T13:26:45.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.351+0000 7f82ea475b80 1 -- 172.21.15.17:0/445840215 shutdown_connections 2023-07-14T13:26:45.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.351+0000 7f82ea475b80 1 --2- 172.21.15.17:0/445840215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1eac580 0x5604a1eb4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.351+0000 7f82ea475b80 1 --2- 172.21.15.17:0/445840215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 0x5604a1eac040 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.351+0000 7f82ea475b80 1 --2- 172.21.15.17:0/445840215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1d086b0 0x5604a1ebcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.351+0000 7f82ea475b80 1 -- 172.21.15.17:0/445840215 >> 172.21.15.17:0/445840215 conn(0x5604a1eaccf0 msgr2=0x5604a1eb4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:45.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.352+0000 7f82ea475b80 1 -- 172.21.15.17:0/445840215 shutdown_connections 2023-07-14T13:26:45.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.352+0000 7f82ea475b80 1 -- 172.21.15.17:0/445840215 wait complete. 2023-07-14T13:26:45.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.352+0000 7f82ea475b80 1 -- start start 2023-07-14T13:26:45.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.353+0000 7f82ea475b80 1 Processor -- start 2023-07-14T13:26:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.353+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1ebccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.353+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 0x5604a1f11940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.353+0000 7f82ea475b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eac580 0x5604a1f11e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.353+0000 7f82ea475b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1f12410 con 0x5604a1d086b0 2023-07-14T13:26:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.353+0000 7f82ea475b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1f12550 con 0x5604a1eac580 2023-07-14T13:26:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.353+0000 7f82ea475b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604a1f12710 con 0x5604a1ea1be0 2023-07-14T13:26:45.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.353+0000 7f82ea475b80 10 client.0 _ll_register_callbacks cb 0x5604a1d9b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:26:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.354+0000 7f82d519c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eac580 0x5604a1f11e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.354+0000 7f82d519c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eac580 0x5604a1f11e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:51626/0 (socket says 172.21.15.17:51626) 2023-07-14T13:26:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.354+0000 7f82d519c700 1 -- 172.21.15.17:0/1699448221 learned_addr learned my addr 172.21.15.17:0/1699448221 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.354+0000 7f82cffff700 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 0x5604a1f11940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.354+0000 7f82d499b700 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1ebccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.355+0000 7f82d519c700 1 -- 172.21.15.17:0/1699448221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 msgr2=0x5604a1f11940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.355+0000 7f82d519c700 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 0x5604a1f11940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.355+0000 7f82d519c700 1 -- 172.21.15.17:0/1699448221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 msgr2=0x5604a1ebccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.355+0000 7f82d519c700 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1ebccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.355+0000 7f82d519c700 1 -- 172.21.15.17:0/1699448221 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604a1c2bd80 con 0x5604a1eac580 2023-07-14T13:26:45.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.355+0000 7f82d519c700 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eac580 0x5604a1f11e80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009750 tx=0x7f82c8004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=335d72c7aabffc27 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:45.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.356+0000 7f82affff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:26:45.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.358+0000 7f82affff700 1 -- 172.21.15.17:0/1699448221 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8022040 con 0x5604a1eac580 2023-07-14T13:26:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.358+0000 7f82affff700 1 -- 172.21.15.17:0/1699448221 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f82c801dd10 con 0x5604a1eac580 2023-07-14T13:26:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.358+0000 7f82ea475b80 1 -- 172.21.15.17:0/1699448221 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82c4013040 con 0x5604a1eac580 2023-07-14T13:26:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.358+0000 7f82affff700 1 -- 172.21.15.17:0/1699448221 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82c801d320 con 0x5604a1eac580 2023-07-14T13:26:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.358+0000 7f82ea475b80 10 client.29288 fetch_fsmap learned FSMap version 63 2023-07-14T13:26:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.358+0000 7f82ea475b80 1 -- 172.21.15.17:0/1699448221 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x5604a1c2a250 con 0x5604a1eac580 2023-07-14T13:26:45.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.359+0000 7f82affff700 1 -- 172.21.15.17:0/1699448221 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82c4013040 con 0x5604a1eac580 2023-07-14T13:26:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.359+0000 7f82affff700 1 -- 172.21.15.17:0/1699448221 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 63) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f82c80046b0 con 0x5604a1eac580 2023-07-14T13:26:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.359+0000 7f82ea475b80 10 client.29288 fetch_fsmap finished waiting for FSMap version 63 2023-07-14T13:26:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.359+0000 7f82ea475b80 10 client.29288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:26:45.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.359+0000 7f82ea475b80 20 client.29288 populate_metadata read hostname 'smithi017' 2023-07-14T13:26:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.359+0000 7f82ea475b80 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604a1eb22d0 0x5604a1f2dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.359+0000 7f82ea475b80 4 client.29288 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:26:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.359+0000 7f82ea475b80 1 -- 172.21.15.17:0/1699448221 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5604a1db8ff0 con 0x5604a1eb22d0 2023-07-14T13:26:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.360+0000 7f82d499b700 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604a1eb22d0 0x5604a1f2dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.361+0000 7f82d499b700 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604a1eb22d0 0x5604a1f2dcf0 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfc7e515ba054c45 server_cookie=d118678eee0f834e in_seq=0 out_seq=0 2023-07-14T13:26:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.361+0000 7f82affff700 10 client.29288 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.381+0000 7f82affff700 1 -- 172.21.15.17:0/1699448221 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5604a1db8ff0 con 0x5604a1eb22d0 2023-07-14T13:26:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.381+0000 7f82affff700 10 client.29288 handle_command_reply: tid=0 2023-07-14T13:26:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.384+0000 7f82ea475b80 1 client.29288 shutdown 2023-07-14T13:26:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.386+0000 7f82ea475b80 1 -- 172.21.15.17:0/1699448221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eac580 msgr2=0x5604a1f11e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.386+0000 7f82ea475b80 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eac580 0x5604a1f11e80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009750 tx=0x7f82c8004b40 comp rx=0 tx=0).stop 2023-07-14T13:26:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.386+0000 7f82ea475b80 1 -- 172.21.15.17:0/1699448221 shutdown_connections 2023-07-14T13:26:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.386+0000 7f82ea475b80 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5604a1eb22d0 0x5604a1f2dcf0 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.386+0000 7f82ea475b80 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604a1eac580 0x5604a1f11e80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.386+0000 7f82ea475b80 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5604a1d086b0 0x5604a1ebccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.386+0000 7f82ea475b80 1 --2- 172.21.15.17:0/1699448221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604a1ea1be0 0x5604a1f11940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.386+0000 7f82ea475b80 1 -- 172.21.15.17:0/1699448221 >> 172.21.15.17:0/1699448221 conn(0x5604a1eaccf0 msgr2=0x5604a1eb0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.386+0000 7f82affff700 0 client.29288 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.386+0000 7f82ea475b80 1 -- 172.21.15.17:0/1699448221 shutdown_connections 2023-07-14T13:26:45.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.386+0000 7f82ea475b80 1 -- 172.21.15.17:0/1699448221 wait complete. 2023-07-14T13:26:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.387+0000 7f82ea475b80 20 client.29288 trim_cache size 0 max 16384 2023-07-14T13:26:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:26:45.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:26:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:26:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:26:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.388+0000 7f82d6bff700 1 -- 172.21.15.17:0/1797002032 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f82c00a13b0 msgr2=0x7f82c00a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.388+0000 7f82d6bff700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f82c00a13b0 0x7f82c00a3860 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009fd0 tx=0x7f82c800b040 comp rx=0 tx=0).stop 2023-07-14T13:26:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.388+0000 7f82d6bff700 1 -- 172.21.15.17:0/1797002032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82d00ff3e0 msgr2=0x7f82d00720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:45.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.388+0000 7f82d6bff700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82d00ff3e0 0x7f82d00720c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009810 tx=0x7f82bc00bf30 comp rx=0 tx=0).stop 2023-07-14T13:26:45.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.396+0000 7f82d6bff700 1 -- 172.21.15.17:0/1797002032 shutdown_connections 2023-07-14T13:26:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.396+0000 7f82d6bff700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f82c00a13b0 0x7f82c00a3860 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.396+0000 7f82d6bff700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82d0104a30 0x7f82d006aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.396+0000 7f82d6bff700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fea30 0x7f82d0071b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.396+0000 7f82d6bff700 1 --2- 172.21.15.17:0/1797002032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82d00ff3e0 0x7f82d00720c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:45.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.396+0000 7f82d6bff700 1 -- 172.21.15.17:0/1797002032 >> 172.21.15.17:0/1797002032 conn(0x7f82d0074760 msgr2=0x7f82d00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.399+0000 7f82d6bff700 1 -- 172.21.15.17:0/1797002032 shutdown_connections 2023-07-14T13:26:45.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:45.399+0000 7f82d6bff700 1 -- 172.21.15.17:0/1797002032 wait complete. 2023-07-14T13:26:45.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:45 smithi017 ceph-mon[95536]: pgmap v855: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-07-14T13:26:45.926 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:45 smithi135 ceph-mon[97338]: pgmap v855: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-07-14T13:26:45.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:45 smithi131 ceph-mon[96953]: pgmap v855: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-07-14T13:26:47.428 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 515.0 s, 639.4 tps, lat 164.295 ms stddev 74.188 2023-07-14T13:26:47.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:47 smithi017 ceph-mon[95536]: pgmap v856: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 1.64k op/s 2023-07-14T13:26:47.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:47 smithi135 ceph-mon[97338]: pgmap v856: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 1.64k op/s 2023-07-14T13:26:47.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:47 smithi131 ceph-mon[96953]: pgmap v856: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 1.64k op/s 2023-07-14T13:26:49.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:49 smithi017 ceph-mon[95536]: pgmap v857: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-14T13:26:49.928 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:49 smithi135 ceph-mon[97338]: pgmap v857: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-14T13:26:49.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:49 smithi131 ceph-mon[96953]: pgmap v857: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-14T13:26:50.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:50 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:26:50.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:50 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:26:50.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:50 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:26:51.834 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:51 smithi017 ceph-mon[95536]: pgmap v858: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-14T13:26:51.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:51 smithi135 ceph-mon[97338]: pgmap v858: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-14T13:26:51.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:51 smithi131 ceph-mon[96953]: pgmap v858: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-14T13:26:52.427 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 520.0 s, 558.9 tps, lat 176.105 ms stddev 49.050 2023-07-14T13:26:53.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:53 smithi135 ceph-mon[97338]: pgmap v859: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 18 MiB/s wr, 1.58k op/s 2023-07-14T13:26:53.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:53 smithi131 ceph-mon[96953]: pgmap v859: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 18 MiB/s wr, 1.58k op/s 2023-07-14T13:26:54.085 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:53 smithi017 ceph-mon[95536]: pgmap v859: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 18 MiB/s wr, 1.58k op/s 2023-07-14T13:26:54.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:54 smithi135 ceph-mon[97338]: pgmap v860: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.07k op/s 2023-07-14T13:26:54.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:54 smithi131 ceph-mon[96953]: pgmap v860: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.07k op/s 2023-07-14T13:26:55.085 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:54 smithi017 ceph-mon[95536]: pgmap v860: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 1.07k op/s 2023-07-14T13:26:57.426 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 525.0 s, 558.6 tps, lat 180.985 ms stddev 53.149 2023-07-14T13:26:57.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:57 smithi017 ceph-mon[95536]: pgmap v861: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 19 MiB/s wr, 1.63k op/s 2023-07-14T13:26:57.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:57 smithi135 ceph-mon[97338]: pgmap v861: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 19 MiB/s wr, 1.63k op/s 2023-07-14T13:26:57.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:57 smithi131 ceph-mon[96953]: pgmap v861: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 19 MiB/s wr, 1.63k op/s 2023-07-14T13:26:58.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.660+0000 7f808c7ff700 1 -- 172.21.15.17:0/1014758870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808406d3a0 msgr2=0x7f808411b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.660+0000 7f808c7ff700 1 --2- 172.21.15.17:0/1014758870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808406d3a0 0x7f808411b470 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f807c01c0d0 tx=0x7f807c01c3e0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.660+0000 7f808c7ff700 1 -- 172.21.15.17:0/1014758870 shutdown_connections 2023-07-14T13:26:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.660+0000 7f808c7ff700 1 --2- 172.21.15.17:0/1014758870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808406d3a0 0x7f808411b470 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.660+0000 7f808c7ff700 1 --2- 172.21.15.17:0/1014758870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808410e2a0 0x7f808410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.660+0000 7f808c7ff700 1 --2- 172.21.15.17:0/1014758870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f808406c910 0x7f808406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.660+0000 7f808c7ff700 1 -- 172.21.15.17:0/1014758870 >> 172.21.15.17:0/1014758870 conn(0x7f808406bd70 msgr2=0x7f8084070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.660+0000 7f808c7ff700 1 -- 172.21.15.17:0/1014758870 shutdown_connections 2023-07-14T13:26:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.661+0000 7f808c7ff700 1 -- 172.21.15.17:0/1014758870 wait complete. 2023-07-14T13:26:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.663+0000 7f808c7ff700 1 Processor -- start 2023-07-14T13:26:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.663+0000 7f808c7ff700 1 -- start start 2023-07-14T13:26:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.664+0000 7f808c7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f808406c910 0x7f8084116e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.664+0000 7f808c7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808406d3a0 0x7f8084117370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.664+0000 7f808c7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808410e2a0 0x7f808411a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.664+0000 7f808c7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808411afe0 con 0x7f808406c910 2023-07-14T13:26:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.664+0000 7f808c7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808411b150 con 0x7f808410e2a0 2023-07-14T13:26:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.664+0000 7f808c7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808411b310 con 0x7f808406d3a0 2023-07-14T13:26:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.665+0000 7f808ad9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808410e2a0 0x7f808411a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.665+0000 7f808ad9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808410e2a0 0x7f808411a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33302/0 (socket says 172.21.15.17:33302) 2023-07-14T13:26:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.665+0000 7f808ad9c700 1 -- 172.21.15.17:0/3018088974 learned_addr learned my addr 172.21.15.17:0/3018088974 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.665+0000 7f808a59b700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f808406c910 0x7f8084116e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.666+0000 7f808ad9c700 1 -- 172.21.15.17:0/3018088974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808406d3a0 msgr2=0x7f8084117370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.666+0000 7f808ad9c700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808406d3a0 0x7f8084117370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.666+0000 7f808ad9c700 1 -- 172.21.15.17:0/3018088974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f808406c910 msgr2=0x7f8084116e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.666+0000 7f808ad9c700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f808406c910 0x7f8084116e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.666+0000 7f808ad9c700 1 -- 172.21.15.17:0/3018088974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c01ad10 con 0x7f808410e2a0 2023-07-14T13:26:58.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.666+0000 7f808ad9c700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808410e2a0 0x7f808411a9d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f807c01dd20 tx=0x7f807c01de00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.668+0000 7f807b7fe700 1 -- 172.21.15.17:0/3018088974 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c01f050 con 0x7f808410e2a0 2023-07-14T13:26:58.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.668+0000 7f807b7fe700 1 -- 172.21.15.17:0/3018088974 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f807c01a4d0 con 0x7f808410e2a0 2023-07-14T13:26:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.668+0000 7f807b7fe700 1 -- 172.21.15.17:0/3018088974 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c02c6b0 con 0x7f808410e2a0 2023-07-14T13:26:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.668+0000 7f808c7ff700 1 -- 172.21.15.17:0/3018088974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808411b530 con 0x7f808410e2a0 2023-07-14T13:26:58.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.668+0000 7f808c7ff700 1 -- 172.21.15.17:0/3018088974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808411b810 con 0x7f808410e2a0 2023-07-14T13:26:58.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.675+0000 7f80a01a9b80 1 Processor -- start 2023-07-14T13:26:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.677+0000 7f80a01a9b80 1 -- start start 2023-07-14T13:26:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.678+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.678+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4b072d0 0x561aa4b01040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.678+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 0x561aa4b019d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.678+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa4a06c50 con 0x561aa4b01580 2023-07-14T13:26:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.678+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa4a599e0 con 0x561aa4b072d0 2023-07-14T13:26:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.678+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa4a52e70 con 0x561aa495d6b0 2023-07-14T13:26:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.682+0000 7f8089d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.682+0000 7f8089d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54120/0 (socket says 172.21.15.17:54120) 2023-07-14T13:26:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.682+0000 7f8089d9a700 1 -- 172.21.15.17:0/3738710580 learned_addr learned my addr 172.21.15.17:0/3738710580 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.682+0000 7f808a59b700 1 --2- 172.21.15.17:0/3738710580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4b072d0 0x561aa4b01040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.682+0000 7f8089d9a700 1 -- 172.21.15.17:0/3738710580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4b072d0 msgr2=0x561aa4b01040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.682+0000 7f8089d9a700 1 --2- 172.21.15.17:0/3738710580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4b072d0 0x561aa4b01040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.682+0000 7f8089d9a700 1 -- 172.21.15.17:0/3738710580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 msgr2=0x561aa4b019d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.682+0000 7f8089d9a700 1 --2- 172.21.15.17:0/3738710580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 0x561aa4b019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.682+0000 7f8089d9a700 1 -- 172.21.15.17:0/3738710580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561aa4880d80 con 0x561aa495d6b0 2023-07-14T13:26:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.683+0000 7f8089d9a700 1 --2- 172.21.15.17:0/3738710580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8074001830 tx=0x7f8074001b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=492e55c35d4926ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.683+0000 7f8078ff9700 1 -- 172.21.15.17:0/3738710580 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074001d80 con 0x561aa495d6b0 2023-07-14T13:26:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.683+0000 7f8078ff9700 1 -- 172.21.15.17:0/3738710580 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8074004c70 con 0x561aa495d6b0 2023-07-14T13:26:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.683+0000 7f8078ff9700 1 -- 172.21.15.17:0/3738710580 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807400e650 con 0x561aa495d6b0 2023-07-14T13:26:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.685+0000 7f80a01a9b80 1 -- 172.21.15.17:0/3738710580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 msgr2=0x561aa4b06d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.685+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/3738710580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8074001830 tx=0x7f8074001b40 comp rx=0 tx=0).stop 2023-07-14T13:26:58.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.689+0000 7f807b7fe700 1 -- 172.21.15.17:0/3018088974 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f807c005040 con 0x7f808410e2a0 2023-07-14T13:26:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.690+0000 7f80a01a9b80 1 -- 172.21.15.17:0/3738710580 shutdown_connections 2023-07-14T13:26:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.690+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/3738710580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 0x561aa4b019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.690+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/3738710580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06d90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.690+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/3738710580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4b072d0 0x561aa4b01040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.690+0000 7f80a01a9b80 1 -- 172.21.15.17:0/3738710580 >> 172.21.15.17:0/3738710580 conn(0x561aa4af6be0 msgr2=0x561aa4afbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.692+0000 7f807b7fe700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f80700a14d0 0x7f80700a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.692+0000 7f807b7fe700 1 -- 172.21.15.17:0/3018088974 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f807c0dead0 con 0x7f808410e2a0 2023-07-14T13:26:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.693+0000 7f80a01a9b80 1 -- 172.21.15.17:0/3738710580 shutdown_connections 2023-07-14T13:26:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.693+0000 7f808a59b700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f80700a14d0 0x7f80700a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.693+0000 7f80a01a9b80 1 -- 172.21.15.17:0/3738710580 wait complete. 2023-07-14T13:26:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.694+0000 7f80a01a9b80 1 -- start start 2023-07-14T13:26:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.695+0000 7f80a01a9b80 1 Processor -- start 2023-07-14T13:26:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.696+0000 7f808a59b700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f80700a14d0 0x7f80700a3980 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x561aa4afdb40 tx=0x7f8080009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.698+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa495d6b0 0x561aa4b0d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.698+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 0x561aa4b0a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.698+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b072d0 0x561aa4b0af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.698+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa49f2a60 con 0x561aa4b01580 2023-07-14T13:26:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.698+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa49f2760 con 0x561aa495d6b0 2023-07-14T13:26:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.698+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa48d68c0 con 0x561aa4b072d0 2023-07-14T13:26:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.698+0000 7f80a01a9b80 10 client.0 _ll_register_callbacks cb 0x561aa49f0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:26:58.707 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.699+0000 7f8089d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 0x561aa4b0a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.700+0000 7f808a59b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa495d6b0 0x561aa4b0d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.700+0000 7f8089d9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 0x561aa4b0a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51448/0 (socket says 172.21.15.17:51448) 2023-07-14T13:26:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.700+0000 7f8089d9a700 1 -- 172.21.15.17:0/178715762 learned_addr learned my addr 172.21.15.17:0/178715762 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.700+0000 7f808ad9c700 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b072d0 0x561aa4b0af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.700+0000 7f808a59b700 1 -- 172.21.15.17:0/178715762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b072d0 msgr2=0x561aa4b0af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.700+0000 7f808a59b700 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b072d0 0x561aa4b0af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.700+0000 7f808a59b700 1 -- 172.21.15.17:0/178715762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 msgr2=0x561aa4b0a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.700+0000 7f808a59b700 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 0x561aa4b0a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.700+0000 7f808a59b700 1 -- 172.21.15.17:0/178715762 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80740014e0 con 0x561aa495d6b0 2023-07-14T13:26:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.701+0000 7f808a59b700 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa495d6b0 0x561aa4b0d630 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f80800106e0 tx=0x7f8080004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf7453c87e8336be server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:58.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.701+0000 7f806dffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:26:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.702+0000 7f806dffb700 1 -- 172.21.15.17:0/178715762 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8080004220 con 0x561aa495d6b0 2023-07-14T13:26:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.702+0000 7f806dffb700 1 -- 172.21.15.17:0/178715762 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8080004380 con 0x561aa495d6b0 2023-07-14T13:26:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.702+0000 7f80a01a9b80 1 -- 172.21.15.17:0/178715762 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561aa49ac490 con 0x561aa495d6b0 2023-07-14T13:26:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.703+0000 7f806dffb700 1 -- 172.21.15.17:0/178715762 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8080003680 con 0x561aa495d6b0 2023-07-14T13:26:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.703+0000 7f80a01a9b80 10 client.29297 fetch_fsmap learned FSMap version 64 2023-07-14T13:26:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.703+0000 7f80a01a9b80 1 -- 172.21.15.17:0/178715762 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x561aa4869c00 con 0x561aa495d6b0 2023-07-14T13:26:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.704+0000 7f806dffb700 1 -- 172.21.15.17:0/178715762 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561aa49ac490 con 0x561aa495d6b0 2023-07-14T13:26:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.704+0000 7f806dffb700 1 -- 172.21.15.17:0/178715762 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f808001ba20 con 0x561aa495d6b0 2023-07-14T13:26:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.705+0000 7f80a01a9b80 10 client.29297 fetch_fsmap finished waiting for FSMap version 64 2023-07-14T13:26:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.705+0000 7f80a01a9b80 10 client.29297 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:26:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.705+0000 7f80a01a9b80 20 client.29297 populate_metadata read hostname 'smithi017' 2023-07-14T13:26:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.705+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561aa4b1abf0 0x561aa4b1d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.705+0000 7f80a01a9b80 4 client.29297 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:26:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.705+0000 7f80a01a9b80 1 -- 172.21.15.17:0/178715762 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561aa4a4be50 con 0x561aa4b1abf0 2023-07-14T13:26:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.706+0000 7f8089d9a700 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561aa4b1abf0 0x561aa4b1d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.710+0000 7f8089d9a700 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561aa4b1abf0 0x561aa4b1d000 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1569fb1b6c240d5 server_cookie=4c119560fc8725aa in_seq=0 out_seq=0 2023-07-14T13:26:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.713+0000 7f806dffb700 10 client.29297 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.713+0000 7f806dffb700 1 -- 172.21.15.17:0/178715762 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561aa4a4be50 con 0x561aa4b1abf0 2023-07-14T13:26:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.713+0000 7f806dffb700 10 client.29297 handle_command_reply: tid=0 2023-07-14T13:26:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.713+0000 7f80a01a9b80 1 client.29297 shutdown 2023-07-14T13:26:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.714+0000 7f80a01a9b80 1 -- 172.21.15.17:0/178715762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa495d6b0 msgr2=0x561aa4b0d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.714+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa495d6b0 0x561aa4b0d630 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f80800106e0 tx=0x7f8080004750 comp rx=0 tx=0).stop 2023-07-14T13:26:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.714+0000 7f80a01a9b80 1 -- 172.21.15.17:0/178715762 shutdown_connections 2023-07-14T13:26:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.714+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561aa4b1abf0 0x561aa4b1d000 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.714+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b072d0 0x561aa4b0af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.714+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa495d6b0 0x561aa4b0d630 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.714+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/178715762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 0x561aa4b0a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.714+0000 7f80a01a9b80 1 -- 172.21.15.17:0/178715762 >> 172.21.15.17:0/178715762 conn(0x561aa4af6be0 msgr2=0x561aa4afac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.714+0000 7f806dffb700 0 client.29297 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.716+0000 7f80a01a9b80 1 -- 172.21.15.17:0/178715762 shutdown_connections 2023-07-14T13:26:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.717+0000 7f80a01a9b80 1 -- 172.21.15.17:0/178715762 wait complete. 2023-07-14T13:26:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.719+0000 7f80a01a9b80 20 client.29297 trim_cache size 0 max 16384 2023-07-14T13:26:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.752+0000 7f80a01a9b80 1 Processor -- start 2023-07-14T13:26:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.756+0000 7f80a01a9b80 1 -- start start 2023-07-14T13:26:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.757+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4af6be0 0x561aa4b01040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.757+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.757+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 0x561aa4afbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.757+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa4b0b530 con 0x561aa4b01580 2023-07-14T13:26:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.757+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa4b18260 con 0x561aa4af6be0 2023-07-14T13:26:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.757+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa4af85f0 con 0x561aa495d6b0 2023-07-14T13:26:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.757+0000 7f8089d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.758+0000 7f8089d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54132/0 (socket says 172.21.15.17:54132) 2023-07-14T13:26:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.758+0000 7f8089d9a700 1 -- 172.21.15.17:0/224351254 learned_addr learned my addr 172.21.15.17:0/224351254 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.758+0000 7f808a59b700 1 --2- 172.21.15.17:0/224351254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4af6be0 0x561aa4b01040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.758+0000 7f8089d9a700 1 -- 172.21.15.17:0/224351254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4af6be0 msgr2=0x561aa4b01040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.758+0000 7f8089d9a700 1 --2- 172.21.15.17:0/224351254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4af6be0 0x561aa4b01040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.758+0000 7f8089d9a700 1 -- 172.21.15.17:0/224351254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 msgr2=0x561aa4afbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.758+0000 7f8089d9a700 1 --2- 172.21.15.17:0/224351254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 0x561aa4afbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.758+0000 7f8089d9a700 1 -- 172.21.15.17:0/224351254 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561aa4b01c20 con 0x561aa495d6b0 2023-07-14T13:26:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.760+0000 7f8089d9a700 1 --2- 172.21.15.17:0/224351254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06160 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8074009e60 tx=0x7f8074001e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ed51004d0cb8e80 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.763+0000 7f80797fa700 1 -- 172.21.15.17:0/224351254 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074019040 con 0x561aa495d6b0 2023-07-14T13:26:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.763+0000 7f80797fa700 1 -- 172.21.15.17:0/224351254 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f807401a040 con 0x561aa495d6b0 2023-07-14T13:26:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.763+0000 7f80797fa700 1 -- 172.21.15.17:0/224351254 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074008d00 con 0x561aa495d6b0 2023-07-14T13:26:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.768+0000 7f80a01a9b80 1 -- 172.21.15.17:0/224351254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 msgr2=0x561aa4b06160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.768+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/224351254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06160 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8074009e60 tx=0x7f8074001e60 comp rx=0 tx=0).stop 2023-07-14T13:26:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.768+0000 7f80a01a9b80 1 -- 172.21.15.17:0/224351254 shutdown_connections 2023-07-14T13:26:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.768+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/224351254 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4b01580 0x561aa4afbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.768+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/224351254 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4af6be0 0x561aa4b01040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.768+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/224351254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa495d6b0 0x561aa4b06160 secure :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8074009e60 tx=0x7f8074001e60 comp rx=0 tx=0).stop 2023-07-14T13:26:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.768+0000 7f80a01a9b80 1 -- 172.21.15.17:0/224351254 >> 172.21.15.17:0/224351254 conn(0x561aa4b171a0 msgr2=0x561aa4b05a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:58.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.773+0000 7f80a01a9b80 1 -- 172.21.15.17:0/224351254 shutdown_connections 2023-07-14T13:26:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.773+0000 7f80a01a9b80 1 -- 172.21.15.17:0/224351254 wait complete. 2023-07-14T13:26:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.774+0000 7f80a01a9b80 1 -- start start 2023-07-14T13:26:58.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.774+0000 7f80a01a9b80 1 Processor -- start 2023-07-14T13:26:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.775+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4af6be0 0x561aa4b11ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.775+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b01580 0x561aa4b0fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.775+0000 7f80a01a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4b072d0 0x561aa4b10290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.775+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa4b107d0 con 0x561aa4af6be0 2023-07-14T13:26:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.775+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa4b10940 con 0x561aa4b072d0 2023-07-14T13:26:58.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.775+0000 7f80a01a9b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aa4b10b00 con 0x561aa4b01580 2023-07-14T13:26:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.775+0000 7f80a01a9b80 10 client.0 _ll_register_callbacks cb 0x561aa49f0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:26:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.776+0000 7f8089d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b01580 0x561aa4b0fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.776+0000 7f8089d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b01580 0x561aa4b0fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54144/0 (socket says 172.21.15.17:54144) 2023-07-14T13:26:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.776+0000 7f8089d9a700 1 -- 172.21.15.17:0/740440683 learned_addr learned my addr 172.21.15.17:0/740440683 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:26:58.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.777+0000 7f808ad9c700 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4b072d0 0x561aa4b10290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.777+0000 7f808a59b700 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4af6be0 0x561aa4b11ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.777+0000 7f8089d9a700 1 -- 172.21.15.17:0/740440683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4b072d0 msgr2=0x561aa4b10290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.777+0000 7f8089d9a700 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4b072d0 0x561aa4b10290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.777+0000 7f8089d9a700 1 -- 172.21.15.17:0/740440683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4af6be0 msgr2=0x561aa4b11ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:26:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.777+0000 7f8089d9a700 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4af6be0 0x561aa4b11ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.778+0000 7f8089d9a700 1 -- 172.21.15.17:0/740440683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561aa4880d80 con 0x561aa4b01580 2023-07-14T13:26:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.779+0000 7f8089d9a700 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b01580 0x561aa4b0fd50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8074009e60 tx=0x7f8074007250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bceced0dd9d1997 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:26:58.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.779+0000 7f806dffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:26:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.779+0000 7f806dffb700 1 -- 172.21.15.17:0/740440683 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074023c50 con 0x561aa4b01580 2023-07-14T13:26:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.780+0000 7f806dffb700 1 -- 172.21.15.17:0/740440683 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8074023db0 con 0x561aa4b01580 2023-07-14T13:26:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.780+0000 7f80a01a9b80 1 -- 172.21.15.17:0/740440683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8074004c70 con 0x561aa4b01580 2023-07-14T13:26:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.781+0000 7f806dffb700 1 -- 172.21.15.17:0/740440683 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8074008a10 con 0x561aa4b01580 2023-07-14T13:26:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.781+0000 7f80a01a9b80 10 client.29263 fetch_fsmap learned FSMap version 64 2023-07-14T13:26:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.781+0000 7f80a01a9b80 1 -- 172.21.15.17:0/740440683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x561aa48a71f0 con 0x561aa4b01580 2023-07-14T13:26:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.783+0000 7f806dffb700 1 -- 172.21.15.17:0/740440683 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8074004c70 con 0x561aa4b01580 2023-07-14T13:26:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.783+0000 7f806dffb700 1 -- 172.21.15.17:0/740440683 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f8074036070 con 0x561aa4b01580 2023-07-14T13:26:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.784+0000 7f80a01a9b80 10 client.29263 fetch_fsmap finished waiting for FSMap version 64 2023-07-14T13:26:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.784+0000 7f80a01a9b80 10 client.29263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:26:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.784+0000 7f80a01a9b80 20 client.29263 populate_metadata read hostname 'smithi017' 2023-07-14T13:26:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.784+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561aa4b6f9e0 0x561aa4b71df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:26:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.784+0000 7f80a01a9b80 4 client.29263 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:26:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.784+0000 7f80a01a9b80 1 -- 172.21.15.17:0/740440683 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561aa4a0dff0 con 0x561aa4b6f9e0 2023-07-14T13:26:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.785+0000 7f808a59b700 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561aa4b6f9e0 0x561aa4b71df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:26:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.787+0000 7f808a59b700 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561aa4b6f9e0 0x561aa4b71df0 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6908a79fca7e1d8 server_cookie=ee857ccac17578d5 in_seq=0 out_seq=0 2023-07-14T13:26:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.787+0000 7f806dffb700 10 client.29263 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:58.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.838+0000 7f806dffb700 1 -- 172.21.15.17:0/740440683 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561aa4a0dff0 con 0x561aa4b6f9e0 2023-07-14T13:26:58.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.838+0000 7f806dffb700 10 client.29263 handle_command_reply: tid=0 2023-07-14T13:26:58.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.839+0000 7f80a01a9b80 1 client.29263 shutdown 2023-07-14T13:26:58.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.839+0000 7f80a01a9b80 1 -- 172.21.15.17:0/740440683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b01580 msgr2=0x561aa4b0fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:58.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.839+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b01580 0x561aa4b0fd50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8074009e60 tx=0x7f8074007250 comp rx=0 tx=0).stop 2023-07-14T13:26:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.842+0000 7f80a01a9b80 1 -- 172.21.15.17:0/740440683 shutdown_connections 2023-07-14T13:26:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.842+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x561aa4b6f9e0 0x561aa4b71df0 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.842+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561aa4b072d0 0x561aa4b10290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.842+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561aa4af6be0 0x561aa4b11ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.842+0000 7f80a01a9b80 1 --2- 172.21.15.17:0/740440683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561aa4b01580 0x561aa4b0fd50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.842+0000 7f80a01a9b80 1 -- 172.21.15.17:0/740440683 >> 172.21.15.17:0/740440683 conn(0x561aa4b171a0 msgr2=0x561aa4b07900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:58.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.842+0000 7f806dffb700 0 client.29263 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:26:58.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.842+0000 7f80a01a9b80 1 -- 172.21.15.17:0/740440683 shutdown_connections 2023-07-14T13:26:58.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.842+0000 7f80a01a9b80 1 -- 172.21.15.17:0/740440683 wait complete. 2023-07-14T13:26:58.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.843+0000 7f80a01a9b80 20 client.29263 trim_cache size 0 max 16384 2023-07-14T13:26:58.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:26:58.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:26:58.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:26:58.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:26:58.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.845+0000 7f808c7ff700 1 -- 172.21.15.17:0/3018088974 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f80700a14d0 msgr2=0x7f80700a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:58.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.845+0000 7f808c7ff700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f80700a14d0 0x7f80700a3980 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x561aa4afdb40 tx=0x7f8080009260 comp rx=0 tx=0).stop 2023-07-14T13:26:58.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.845+0000 7f808c7ff700 1 -- 172.21.15.17:0/3018088974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808410e2a0 msgr2=0x7f808411a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:26:58.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.845+0000 7f808c7ff700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808410e2a0 0x7f808411a9d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f807c01dd20 tx=0x7f807c01de00 comp rx=0 tx=0).stop 2023-07-14T13:26:58.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.847+0000 7f808c7ff700 1 -- 172.21.15.17:0/3018088974 shutdown_connections 2023-07-14T13:26:58.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.847+0000 7f808c7ff700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f80700a14d0 0x7f80700a3980 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.847+0000 7f808c7ff700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f808410e2a0 0x7f808411a9d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.847+0000 7f808c7ff700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f808406c910 0x7f8084116e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.847+0000 7f808c7ff700 1 --2- 172.21.15.17:0/3018088974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f808406d3a0 0x7f8084117370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:26:58.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.847+0000 7f808c7ff700 1 -- 172.21.15.17:0/3018088974 >> 172.21.15.17:0/3018088974 conn(0x7f808406bd70 msgr2=0x7f80840707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:26:58.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.847+0000 7f808c7ff700 1 -- 172.21.15.17:0/3018088974 shutdown_connections 2023-07-14T13:26:58.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:26:58.848+0000 7f808c7ff700 1 -- 172.21.15.17:0/3018088974 wait complete. 2023-07-14T13:26:59.837 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:26:59 smithi017 ceph-mon[95536]: pgmap v862: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-14T13:26:59.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:26:59 smithi135 ceph-mon[97338]: pgmap v862: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-14T13:26:59.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:26:59 smithi131 ceph-mon[96953]: pgmap v862: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-14T13:27:01.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:01 smithi017 ceph-mon[95536]: pgmap v863: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 15 MiB/s wr, 1.21k op/s 2023-07-14T13:27:01.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:01 smithi135 ceph-mon[97338]: pgmap v863: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 15 MiB/s wr, 1.21k op/s 2023-07-14T13:27:01.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:01 smithi131 ceph-mon[96953]: pgmap v863: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 15 MiB/s wr, 1.21k op/s 2023-07-14T13:27:02.427 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 530.0 s, 514.8 tps, lat 191.122 ms stddev 125.336 2023-07-14T13:27:03.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:03 smithi135 ceph-mon[97338]: pgmap v864: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 1.63k op/s 2023-07-14T13:27:03.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:03 smithi131 ceph-mon[96953]: pgmap v864: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 1.63k op/s 2023-07-14T13:27:04.093 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:03 smithi017 ceph-mon[95536]: pgmap v864: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 1.63k op/s 2023-07-14T13:27:04.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:04 smithi135 ceph-mon[97338]: pgmap v865: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-07-14T13:27:04.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:04 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:27:04.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:04 smithi131 ceph-mon[96953]: pgmap v865: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-07-14T13:27:04.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:04 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:27:05.087 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:04 smithi017 ceph-mon[95536]: pgmap v865: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-07-14T13:27:05.088 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:04 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:27:06.174 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:05 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:27:06.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:05 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:27:06.333 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:05 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:27:07.426 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 535.0 s, 322.6 tps, lat 316.110 ms stddev 117.590 2023-07-14T13:27:07.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:07 smithi017 ceph-mon[95536]: pgmap v866: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 1.51k op/s 2023-07-14T13:27:07.924 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:07 smithi135 ceph-mon[97338]: pgmap v866: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 1.51k op/s 2023-07-14T13:27:07.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:07 smithi131 ceph-mon[96953]: pgmap v866: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 1.51k op/s 2023-07-14T13:27:09.840 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:09 smithi017 ceph-mon[95536]: pgmap v867: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 11 MiB/s wr, 950 op/s 2023-07-14T13:27:09.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:09 smithi135 ceph-mon[97338]: pgmap v867: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 11 MiB/s wr, 950 op/s 2023-07-14T13:27:09.975 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:09 smithi131 ceph-mon[96953]: pgmap v867: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 11 MiB/s wr, 950 op/s 2023-07-14T13:27:10.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:10 smithi135 ceph-mon[97338]: osdmap e132: 12 total, 12 up, 12 in 2023-07-14T13:27:10.977 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:10 smithi131 ceph-mon[96953]: osdmap e132: 12 total, 12 up, 12 in 2023-07-14T13:27:11.084 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:10 smithi017 ceph-mon[95536]: osdmap e132: 12 total, 12 up, 12 in 2023-07-14T13:27:11.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:11 smithi135 ceph-mon[97338]: pgmap v869: 97 pgs: 4 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 89 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-14T13:27:11.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:11 smithi131 ceph-mon[96953]: pgmap v869: 97 pgs: 4 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 89 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-14T13:27:12.084 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:11 smithi017 ceph-mon[95536]: pgmap v869: 97 pgs: 4 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 89 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-14T13:27:12.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.192+0000 7f624cfff700 1 -- 172.21.15.17:0/2669220365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f624806c910 msgr2=0x7f624806cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:12.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.192+0000 7f624cfff700 1 --2- 172.21.15.17:0/2669220365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f624806c910 0x7f624806cd80 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6238009990 tx=0x7f6238009ca0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.197+0000 7f624cfff700 1 -- 172.21.15.17:0/2669220365 shutdown_connections 2023-07-14T13:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.197+0000 7f624cfff700 1 --2- 172.21.15.17:0/2669220365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f624806d3a0 0x7f624811b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.197+0000 7f624cfff700 1 --2- 172.21.15.17:0/2669220365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624810e2a0 0x7f624810e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.197+0000 7f624cfff700 1 --2- 172.21.15.17:0/2669220365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f624806c910 0x7f624806cd80 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.197+0000 7f624cfff700 1 -- 172.21.15.17:0/2669220365 >> 172.21.15.17:0/2669220365 conn(0x7f624806bd70 msgr2=0x7f6248070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.200+0000 7f624cfff700 1 -- 172.21.15.17:0/2669220365 shutdown_connections 2023-07-14T13:27:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.203+0000 7f624cfff700 1 -- 172.21.15.17:0/2669220365 wait complete. 2023-07-14T13:27:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.205+0000 7f624cfff700 1 Processor -- start 2023-07-14T13:27:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.205+0000 7f624cfff700 1 -- start start 2023-07-14T13:27:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.206+0000 7f624cfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f624806c910 0x7f62481aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.206+0000 7f624cfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624806d3a0 0x7f62481aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.206+0000 7f624cfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f624810e2a0 0x7f62481a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.206+0000 7f624cfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62481a4e40 con 0x7f624806c910 2023-07-14T13:27:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.206+0000 7f624cfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62481a4f80 con 0x7f624806d3a0 2023-07-14T13:27:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.206+0000 7f624cfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62481a5140 con 0x7f624810e2a0 2023-07-14T13:27:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.207+0000 7f624659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f624806c910 0x7f62481aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.207+0000 7f624659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f624806c910 0x7f62481aa8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34128/0 (socket says 172.21.15.17:34128) 2023-07-14T13:27:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.207+0000 7f624659c700 1 -- 172.21.15.17:0/3947301139 learned_addr learned my addr 172.21.15.17:0/3947301139 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.207+0000 7f6245d9b700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624806d3a0 0x7f62481aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.208+0000 7f6246d9d700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f624810e2a0 0x7f62481a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.208+0000 7f624659c700 1 -- 172.21.15.17:0/3947301139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f624810e2a0 msgr2=0x7f62481a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.208+0000 7f624659c700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f624810e2a0 0x7f62481a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.208+0000 7f624659c700 1 -- 172.21.15.17:0/3947301139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624806d3a0 msgr2=0x7f62481aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.208+0000 7f624659c700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624806d3a0 0x7f62481aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.208+0000 7f624659c700 1 -- 172.21.15.17:0/3947301139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62380095f0 con 0x7f624806c910 2023-07-14T13:27:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.209+0000 7f624659c700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f624806c910 0x7f62481aa8a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6240007e20 tx=0x7f624000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.211+0000 7f62377fe700 1 -- 172.21.15.17:0/3947301139 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624000ae00 con 0x7f624806c910 2023-07-14T13:27:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.211+0000 7f62377fe700 1 -- 172.21.15.17:0/3947301139 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f62400128b0 con 0x7f624806c910 2023-07-14T13:27:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.211+0000 7f62377fe700 1 -- 172.21.15.17:0/3947301139 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6240011740 con 0x7f624806c910 2023-07-14T13:27:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.211+0000 7f624cfff700 1 -- 172.21.15.17:0/3947301139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62481a5420 con 0x7f624806c910 2023-07-14T13:27:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.211+0000 7f624cfff700 1 -- 172.21.15.17:0/3947301139 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624810ee20 con 0x7f624806c910 2023-07-14T13:27:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.217+0000 7f626097bb80 1 Processor -- start 2023-07-14T13:27:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.218+0000 7f626097bb80 1 -- start start 2023-07-14T13:27:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.218+0000 7f626097bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 0x562572ac8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.218+0000 7f626097bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ac92d0 0x562572ac3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.218+0000 7f626097bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 0x562572ac39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.218+0000 7f626097bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625729c8c50 con 0x56257291f6b0 2023-07-14T13:27:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.218+0000 7f626097bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562572a1b9e0 con 0x562572ac3580 2023-07-14T13:27:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.218+0000 7f626097bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562572a14e70 con 0x562572ac92d0 2023-07-14T13:27:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.219+0000 7f6246d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 0x562572ac8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.219+0000 7f6246d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 0x562572ac8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34138/0 (socket says 172.21.15.17:34138) 2023-07-14T13:27:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.219+0000 7f6246d9d700 1 -- 172.21.15.17:0/2011703828 learned_addr learned my addr 172.21.15.17:0/2011703828 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.220+0000 7f6246d9d700 1 -- 172.21.15.17:0/2011703828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ac92d0 msgr2=0x562572ac3040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:27:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.220+0000 7f6246d9d700 1 --2- 172.21.15.17:0/2011703828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ac92d0 0x562572ac3040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.220+0000 7f6246d9d700 1 -- 172.21.15.17:0/2011703828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 msgr2=0x562572ac39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.220+0000 7f6246d9d700 1 --2- 172.21.15.17:0/2011703828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 0x562572ac39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.220+0000 7f6246d9d700 1 -- 172.21.15.17:0/2011703828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562572842d80 con 0x56257291f6b0 2023-07-14T13:27:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.221+0000 7f6246d9d700 1 --2- 172.21.15.17:0/2011703828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 0x562572ac8d90 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f623c008ba0 tx=0x7f623c008eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40e6af08ce7549d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.222+0000 7f6234ff9700 1 -- 172.21.15.17:0/2011703828 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00ed40 con 0x56257291f6b0 2023-07-14T13:27:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.222+0000 7f6234ff9700 1 -- 172.21.15.17:0/2011703828 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f623c00eea0 con 0x56257291f6b0 2023-07-14T13:27:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.222+0000 7f6234ff9700 1 -- 172.21.15.17:0/2011703828 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c010430 con 0x56257291f6b0 2023-07-14T13:27:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.225+0000 7f626097bb80 1 -- 172.21.15.17:0/2011703828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 msgr2=0x562572ac8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.225+0000 7f626097bb80 1 --2- 172.21.15.17:0/2011703828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 0x562572ac8d90 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f623c008ba0 tx=0x7f623c008eb0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.226+0000 7f626097bb80 1 -- 172.21.15.17:0/2011703828 shutdown_connections 2023-07-14T13:27:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.226+0000 7f626097bb80 1 --2- 172.21.15.17:0/2011703828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 0x562572ac39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.226+0000 7f626097bb80 1 --2- 172.21.15.17:0/2011703828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 0x562572ac8d90 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.226+0000 7f626097bb80 1 --2- 172.21.15.17:0/2011703828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ac92d0 0x562572ac3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.226+0000 7f626097bb80 1 -- 172.21.15.17:0/2011703828 >> 172.21.15.17:0/2011703828 conn(0x562572ab8be0 msgr2=0x562572abdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.228+0000 7f626097bb80 1 -- 172.21.15.17:0/2011703828 shutdown_connections 2023-07-14T13:27:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.228+0000 7f626097bb80 1 -- 172.21.15.17:0/2011703828 wait complete. 2023-07-14T13:27:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.228+0000 7f62377fe700 1 -- 172.21.15.17:0/3947301139 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6240012420 con 0x7f624806c910 2023-07-14T13:27:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.229+0000 7f626097bb80 1 -- start start 2023-07-14T13:27:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.230+0000 7f626097bb80 1 Processor -- start 2023-07-14T13:27:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.232+0000 7f62377fe700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62300a13e0 0x7f62300a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.232+0000 7f62377fe700 1 -- 172.21.15.17:0/3947301139 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f62400cc930 con 0x7f624806c910 2023-07-14T13:27:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.233+0000 7f626097bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56257291f6b0 0x562572acc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.233+0000 7f626097bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 0x562572accef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.233+0000 7f626097bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac92d0 0x562572acd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.233+0000 7f626097bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625729b4a60 con 0x562572ac92d0 2023-07-14T13:27:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.233+0000 7f626097bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625729b4760 con 0x562572ac3580 2023-07-14T13:27:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.233+0000 7f626097bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625728988c0 con 0x56257291f6b0 2023-07-14T13:27:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.234+0000 7f626097bb80 10 client.0 _ll_register_callbacks cb 0x5625729b2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:27:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.235+0000 7f624659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56257291f6b0 0x562572acc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.235+0000 7f6246d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac92d0 0x562572acd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.235+0000 7f6246d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac92d0 0x562572acd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34152/0 (socket says 172.21.15.17:34152) 2023-07-14T13:27:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.235+0000 7f6246d9d700 1 -- 172.21.15.17:0/1585792578 learned_addr learned my addr 172.21.15.17:0/1585792578 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.236+0000 7f6246d9d700 1 -- 172.21.15.17:0/1585792578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56257291f6b0 msgr2=0x562572acc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.236+0000 7f6246d9d700 1 --2- 172.21.15.17:0/1585792578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56257291f6b0 0x562572acc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.236+0000 7f6246d9d700 1 -- 172.21.15.17:0/1585792578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 msgr2=0x562572accef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.236+0000 7f6246d9d700 1 --2- 172.21.15.17:0/1585792578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 0x562572accef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.236+0000 7f6246d9d700 1 -- 172.21.15.17:0/1585792578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c008800 con 0x562572ac92d0 2023-07-14T13:27:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.237+0000 7f6246d9d700 1 --2- 172.21.15.17:0/1585792578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac92d0 0x562572acd430 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f623c0196b0 tx=0x7f623c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c4c20b262c7094 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.238+0000 7f622dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.238+0000 7f622dffb700 1 -- 172.21.15.17:0/1585792578 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c019d40 con 0x562572ac92d0 2023-07-14T13:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.238+0000 7f622dffb700 1 -- 172.21.15.17:0/1585792578 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f623c010430 con 0x562572ac92d0 2023-07-14T13:27:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.239+0000 7f626097bb80 1 -- 172.21.15.17:0/1585792578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56257296e490 con 0x562572ac92d0 2023-07-14T13:27:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.239+0000 7f622dffb700 1 -- 172.21.15.17:0/1585792578 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f623c019ea0 con 0x562572ac92d0 2023-07-14T13:27:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.240+0000 7f6246d9d700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62300a13e0 0x7f62300a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.241+0000 7f626097bb80 10 client.19530 fetch_fsmap learned FSMap version 65 2023-07-14T13:27:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.241+0000 7f626097bb80 1 -- 172.21.15.17:0/1585792578 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x56257282bc00 con 0x562572ac92d0 2023-07-14T13:27:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.242+0000 7f6246d9d700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62300a13e0 0x7f62300a3890 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x562572acfa40 tx=0x7f623c01b000 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.242+0000 7f622dffb700 1 -- 172.21.15.17:0/1585792578 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56257296e490 con 0x562572ac92d0 2023-07-14T13:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.242+0000 7f622dffb700 1 -- 172.21.15.17:0/1585792578 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 65) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f623c02e770 con 0x562572ac92d0 2023-07-14T13:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.242+0000 7f626097bb80 10 client.19530 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.242+0000 7f626097bb80 10 client.19530 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.242+0000 7f626097bb80 20 client.19530 populate_metadata read hostname 'smithi017' 2023-07-14T13:27:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.242+0000 7f626097bb80 1 --2- 172.21.15.17:0/1585792578 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562572adcd60 0x562572adf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.242+0000 7f626097bb80 4 client.19530 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.242+0000 7f626097bb80 1 -- 172.21.15.17:0/1585792578 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562572a0de50 con 0x562572adcd60 2023-07-14T13:27:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.243+0000 7f624659c700 1 --2- 172.21.15.17:0/1585792578 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562572adcd60 0x562572adf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.251+0000 7f624659c700 1 --2- 172.21.15.17:0/1585792578 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562572adcd60 0x562572adf170 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=436585edeee28ae1 server_cookie=eee5a0f70fc2b395 in_seq=0 out_seq=0 2023-07-14T13:27:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.251+0000 7f622dffb700 10 client.19530 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.252+0000 7f622dffb700 1 -- 172.21.15.17:0/1585792578 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562572a0de50 con 0x562572adcd60 2023-07-14T13:27:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.252+0000 7f622dffb700 10 client.19530 handle_command_reply: tid=0 2023-07-14T13:27:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.253+0000 7f626097bb80 1 client.19530 shutdown 2023-07-14T13:27:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.259+0000 7f626097bb80 1 -- 172.21.15.17:0/1585792578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac92d0 msgr2=0x562572acd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.259+0000 7f626097bb80 1 --2- 172.21.15.17:0/1585792578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac92d0 0x562572acd430 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f623c0196b0 tx=0x7f623c0196e0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.259+0000 7f626097bb80 1 -- 172.21.15.17:0/1585792578 shutdown_connections 2023-07-14T13:27:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.259+0000 7f626097bb80 1 --2- 172.21.15.17:0/1585792578 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562572adcd60 0x562572adf170 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.259+0000 7f626097bb80 1 --2- 172.21.15.17:0/1585792578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac92d0 0x562572acd430 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.259+0000 7f626097bb80 1 --2- 172.21.15.17:0/1585792578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56257291f6b0 0x562572acc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.259+0000 7f626097bb80 1 --2- 172.21.15.17:0/1585792578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 0x562572accef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.259+0000 7f626097bb80 1 -- 172.21.15.17:0/1585792578 >> 172.21.15.17:0/1585792578 conn(0x562572ab8be0 msgr2=0x562572abd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.259+0000 7f622dffb700 0 client.19530 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.260+0000 7f626097bb80 1 -- 172.21.15.17:0/1585792578 shutdown_connections 2023-07-14T13:27:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.260+0000 7f626097bb80 1 -- 172.21.15.17:0/1585792578 wait complete. 2023-07-14T13:27:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.266+0000 7f626097bb80 20 client.19530 trim_cache size 0 max 16384 2023-07-14T13:27:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.305+0000 7f626097bb80 1 Processor -- start 2023-07-14T13:27:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.307+0000 7f626097bb80 1 -- start start 2023-07-14T13:27:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.307+0000 7f626097bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ab8be0 0x562572ac3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.307+0000 7f626097bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56257291f6b0 0x562572ad3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.307+0000 7f626097bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac3580 0x562572ac8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.307+0000 7f626097bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562572ac96c0 con 0x562572ac3580 2023-07-14T13:27:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.307+0000 7f626097bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562572abf740 con 0x56257291f6b0 2023-07-14T13:27:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.307+0000 7f626097bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562572ac7720 con 0x562572ab8be0 2023-07-14T13:27:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.309+0000 7f6246d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac3580 0x562572ac8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.309+0000 7f6246d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac3580 0x562572ac8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34156/0 (socket says 172.21.15.17:34156) 2023-07-14T13:27:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.309+0000 7f6246d9d700 1 -- 172.21.15.17:0/1170260703 learned_addr learned my addr 172.21.15.17:0/1170260703 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.310+0000 7f6246d9d700 1 -- 172.21.15.17:0/1170260703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ab8be0 msgr2=0x562572ac3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.310+0000 7f6246d9d700 1 --2- 172.21.15.17:0/1170260703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ab8be0 0x562572ac3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.310+0000 7f6246d9d700 1 -- 172.21.15.17:0/1170260703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56257291f6b0 msgr2=0x562572ad3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.310+0000 7f6246d9d700 1 --2- 172.21.15.17:0/1170260703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56257291f6b0 0x562572ad3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.310+0000 7f6246d9d700 1 -- 172.21.15.17:0/1170260703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625728691f0 con 0x562572ac3580 2023-07-14T13:27:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.310+0000 7f6246d9d700 1 --2- 172.21.15.17:0/1170260703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac3580 0x562572ac8240 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f623c02ead0 tx=0x7f623c0106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a693a182b2552f47 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.312+0000 7f62357fa700 1 -- 172.21.15.17:0/1170260703 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c010430 con 0x562572ac3580 2023-07-14T13:27:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.312+0000 7f62357fa700 1 -- 172.21.15.17:0/1170260703 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f623c033e20 con 0x562572ac3580 2023-07-14T13:27:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.312+0000 7f62357fa700 1 -- 172.21.15.17:0/1170260703 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c030700 con 0x562572ac3580 2023-07-14T13:27:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.313+0000 7f626097bb80 1 -- 172.21.15.17:0/1170260703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac3580 msgr2=0x562572ac8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.313+0000 7f626097bb80 1 --2- 172.21.15.17:0/1170260703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac3580 0x562572ac8240 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f623c02ead0 tx=0x7f623c0106b0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.313+0000 7f626097bb80 1 -- 172.21.15.17:0/1170260703 shutdown_connections 2023-07-14T13:27:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.313+0000 7f626097bb80 1 --2- 172.21.15.17:0/1170260703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562572ac3580 0x562572ac8240 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.313+0000 7f626097bb80 1 --2- 172.21.15.17:0/1170260703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ab8be0 0x562572ac3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.313+0000 7f626097bb80 1 --2- 172.21.15.17:0/1170260703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56257291f6b0 0x562572ad3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.313+0000 7f626097bb80 1 -- 172.21.15.17:0/1170260703 >> 172.21.15.17:0/1170260703 conn(0x562572ad92e0 msgr2=0x562572ac7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:12.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.314+0000 7f626097bb80 1 -- 172.21.15.17:0/1170260703 shutdown_connections 2023-07-14T13:27:12.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.314+0000 7f626097bb80 1 -- 172.21.15.17:0/1170260703 wait complete. 2023-07-14T13:27:12.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.314+0000 7f626097bb80 1 -- start start 2023-07-14T13:27:12.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.315+0000 7f626097bb80 1 Processor -- start 2023-07-14T13:27:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.315+0000 7f626097bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 0x562572b28fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.315+0000 7f626097bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ab8be0 0x562572b294e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.316+0000 7f626097bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 0x562572b24bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.316+0000 7f626097bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562572b252c0 con 0x56257291f6b0 2023-07-14T13:27:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.316+0000 7f626097bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562572b25430 con 0x562572ac3580 2023-07-14T13:27:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.316+0000 7f626097bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562572b255f0 con 0x562572ab8be0 2023-07-14T13:27:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.316+0000 7f626097bb80 10 client.0 _ll_register_callbacks cb 0x7f623c008a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:27:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.316+0000 7f6246d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 0x562572b24bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.316+0000 7f6246d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 0x562572b24bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59770/0 (socket says 172.21.15.17:59770) 2023-07-14T13:27:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.316+0000 7f6246d9d700 1 -- 172.21.15.17:0/3701829261 learned_addr learned my addr 172.21.15.17:0/3701829261 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.316+0000 7f624659c700 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 0x562572b28fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.317+0000 7f6245d9b700 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ab8be0 0x562572b294e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.317+0000 7f624659c700 1 -- 172.21.15.17:0/3701829261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ab8be0 msgr2=0x562572b294e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.317+0000 7f624659c700 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ab8be0 0x562572b294e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.317+0000 7f624659c700 1 -- 172.21.15.17:0/3701829261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 msgr2=0x562572b24bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.317+0000 7f624659c700 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 0x562572b24bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.317+0000 7f624659c700 1 -- 172.21.15.17:0/3701829261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56257282bc00 con 0x56257291f6b0 2023-07-14T13:27:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.318+0000 7f624659c700 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 0x562572b28fa0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f62400ca120 tx=0x7f6240095f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbd675558a477ad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.318+0000 7f622dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:27:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.319+0000 7f622dffb700 1 -- 172.21.15.17:0/3701829261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400126d0 con 0x56257291f6b0 2023-07-14T13:27:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.319+0000 7f622dffb700 1 -- 172.21.15.17:0/3701829261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f6240099aa0 con 0x56257291f6b0 2023-07-14T13:27:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.319+0000 7f626097bb80 1 -- 172.21.15.17:0/3701829261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f623c00eea0 con 0x56257291f6b0 2023-07-14T13:27:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.321+0000 7f622dffb700 1 -- 172.21.15.17:0/3701829261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f624009dad0 con 0x56257291f6b0 2023-07-14T13:27:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.321+0000 7f626097bb80 10 client.19536 fetch_fsmap learned FSMap version 65 2023-07-14T13:27:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.321+0000 7f626097bb80 1 -- 172.21.15.17:0/3701829261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x562572841250 con 0x56257291f6b0 2023-07-14T13:27:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.323+0000 7f622dffb700 1 -- 172.21.15.17:0/3701829261 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f623c00eea0 con 0x56257291f6b0 2023-07-14T13:27:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.323+0000 7f622dffb700 1 -- 172.21.15.17:0/3701829261 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 65) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6240098f90 con 0x56257291f6b0 2023-07-14T13:27:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.324+0000 7f626097bb80 10 client.19536 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:27:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.324+0000 7f626097bb80 10 client.19536 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:27:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.324+0000 7f626097bb80 20 client.19536 populate_metadata read hostname 'smithi017' 2023-07-14T13:27:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.324+0000 7f626097bb80 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562572ac92d0 0x562572b33df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.324+0000 7f626097bb80 4 client.19536 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:27:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.324+0000 7f626097bb80 1 -- 172.21.15.17:0/3701829261 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5625729cfff0 con 0x562572ac92d0 2023-07-14T13:27:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.325+0000 7f6245d9b700 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562572ac92d0 0x562572b33df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.335+0000 7f6245d9b700 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562572ac92d0 0x562572b33df0 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0c9f2b4f19962a server_cookie=c1d1a3a6cd5ad8ed in_seq=0 out_seq=0 2023-07-14T13:27:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.335+0000 7f622dffb700 10 client.19536 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 540.0 s, 208.0 tps, lat 425.618 ms stddev 359.701 2023-07-14T13:27:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.565+0000 7f622dffb700 1 -- 172.21.15.17:0/3701829261 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5625729cfff0 con 0x562572ac92d0 2023-07-14T13:27:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.565+0000 7f622dffb700 10 client.19536 handle_command_reply: tid=0 2023-07-14T13:27:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.565+0000 7f626097bb80 1 client.19536 shutdown 2023-07-14T13:27:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.566+0000 7f626097bb80 1 -- 172.21.15.17:0/3701829261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 msgr2=0x562572b28fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.566+0000 7f626097bb80 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 0x562572b28fa0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f62400ca120 tx=0x7f6240095f10 comp rx=0 tx=0).stop 2023-07-14T13:27:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.567+0000 7f626097bb80 1 -- 172.21.15.17:0/3701829261 shutdown_connections 2023-07-14T13:27:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.567+0000 7f626097bb80 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562572ac92d0 0x562572b33df0 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.567+0000 7f626097bb80 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562572ac3580 0x562572b24bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.567+0000 7f626097bb80 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56257291f6b0 0x562572b28fa0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.567+0000 7f626097bb80 1 --2- 172.21.15.17:0/3701829261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562572ab8be0 0x562572b294e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.567+0000 7f626097bb80 1 -- 172.21.15.17:0/3701829261 >> 172.21.15.17:0/3701829261 conn(0x562572ad92e0 msgr2=0x562572ac83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.567+0000 7f622dffb700 0 client.19536 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.567+0000 7f626097bb80 1 -- 172.21.15.17:0/3701829261 shutdown_connections 2023-07-14T13:27:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.567+0000 7f626097bb80 1 -- 172.21.15.17:0/3701829261 wait complete. 2023-07-14T13:27:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.568+0000 7f626097bb80 20 client.19536 trim_cache size 0 max 16384 2023-07-14T13:27:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:27:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:27:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:27:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:27:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.569+0000 7f624cfff700 1 -- 172.21.15.17:0/3947301139 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62300a13e0 msgr2=0x7f62300a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.569+0000 7f624cfff700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62300a13e0 0x7f62300a3890 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x562572acfa40 tx=0x7f623c01b000 comp rx=0 tx=0).stop 2023-07-14T13:27:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.569+0000 7f624cfff700 1 -- 172.21.15.17:0/3947301139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f624806c910 msgr2=0x7f62481aa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.569+0000 7f624cfff700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f624806c910 0x7f62481aa8a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6240007e20 tx=0x7f624000a340 comp rx=0 tx=0).stop 2023-07-14T13:27:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.570+0000 7f624cfff700 1 -- 172.21.15.17:0/3947301139 shutdown_connections 2023-07-14T13:27:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.570+0000 7f624cfff700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f62300a13e0 0x7f62300a3890 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.570+0000 7f624cfff700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f624810e2a0 0x7f62481a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.570+0000 7f624cfff700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f624806c910 0x7f62481aa8a0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.570+0000 7f624cfff700 1 --2- 172.21.15.17:0/3947301139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624806d3a0 0x7f62481aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.570+0000 7f624cfff700 1 -- 172.21.15.17:0/3947301139 >> 172.21.15.17:0/3947301139 conn(0x7f624806bd70 msgr2=0x7f6248109df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.572+0000 7f624cfff700 1 -- 172.21.15.17:0/3947301139 shutdown_connections 2023-07-14T13:27:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:12.572+0000 7f624cfff700 1 -- 172.21.15.17:0/3947301139 wait complete. 2023-07-14T13:27:12.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:12 smithi131 ceph-mon[96953]: pgmap v870: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.7 MiB/s wr, 837 op/s 2023-07-14T13:27:13.086 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:12 smithi017 ceph-mon[95536]: pgmap v870: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.7 MiB/s wr, 837 op/s 2023-07-14T13:27:13.174 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:12 smithi135 ceph-mon[97338]: pgmap v870: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.7 MiB/s wr, 837 op/s 2023-07-14T13:27:15.723 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:15 smithi131 ceph-mon[96953]: pgmap v871: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.7 MiB/s wr, 837 op/s 2023-07-14T13:27:15.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:15 smithi017 ceph-mon[95536]: pgmap v871: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.7 MiB/s wr, 837 op/s 2023-07-14T13:27:15.924 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:15 smithi135 ceph-mon[97338]: pgmap v871: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 9.7 MiB/s wr, 837 op/s 2023-07-14T13:27:17.426 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 545.0 s, 137.4 tps, lat 757.077 ms stddev 1064.780 2023-07-14T13:27:17.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:17 smithi017 ceph-mon[95536]: pgmap v872: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 565 op/s 2023-07-14T13:27:17.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:17 smithi017 ceph-mon[95536]: osdmap e133: 12 total, 12 up, 12 in 2023-07-14T13:27:17.924 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:17 smithi135 ceph-mon[97338]: pgmap v872: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 565 op/s 2023-07-14T13:27:17.924 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:17 smithi135 ceph-mon[97338]: osdmap e133: 12 total, 12 up, 12 in 2023-07-14T13:27:17.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:17 smithi131 ceph-mon[96953]: pgmap v872: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 565 op/s 2023-07-14T13:27:17.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:17 smithi131 ceph-mon[96953]: osdmap e133: 12 total, 12 up, 12 in 2023-07-14T13:27:19.586 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:19 smithi131 ceph-mon[96953]: pgmap v874: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.7 MiB/s wr, 638 op/s 2023-07-14T13:27:19.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:19 smithi017 ceph-mon[95536]: pgmap v874: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.7 MiB/s wr, 638 op/s 2023-07-14T13:27:19.924 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:19 smithi135 ceph-mon[97338]: pgmap v874: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.7 MiB/s wr, 638 op/s 2023-07-14T13:27:21.832 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:21 smithi017 ceph-mon[95536]: pgmap v875: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 539 op/s 2023-07-14T13:27:21.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:21 smithi135 ceph-mon[97338]: pgmap v875: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 539 op/s 2023-07-14T13:27:21.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:21 smithi131 ceph-mon[96953]: pgmap v875: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 539 op/s 2023-07-14T13:27:22.426 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 550.0 s, 377.4 tps, lat 285.737 ms stddev 426.120 2023-07-14T13:27:23.222 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:22 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:23.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:22 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:23.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:22 smithi131 ceph-mon[96953]: pgmap v876: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 442 op/s 2023-07-14T13:27:23.334 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:22 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:23.334 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:22 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:23.335 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:22 smithi017 ceph-mon[95536]: pgmap v876: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 442 op/s 2023-07-14T13:27:23.424 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:22 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:23.424 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:22 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:23.424 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:22 smithi135 ceph-mon[97338]: pgmap v876: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 442 op/s 2023-07-14T13:27:24.425 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:24 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:24.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:24 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:24.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:24 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:27:24.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:24 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:27:24.426 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:24 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:24.473 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:24 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:24.473 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:24 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:24.473 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:24 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:27:24.473 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:24 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:27:24.473 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:24 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:24.582 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:24 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:24.583 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:24 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:24.583 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:24 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:27:24.583 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:24 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:27:24.583 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:24 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:27:25.400 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:25 smithi135 ceph-mon[97338]: pgmap v877: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 442 op/s 2023-07-14T13:27:25.472 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:25 smithi131 ceph-mon[96953]: pgmap v877: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 442 op/s 2023-07-14T13:27:25.582 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:25 smithi017 ceph-mon[95536]: pgmap v877: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 442 op/s 2023-07-14T13:27:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.852+0000 7fd1821ff700 1 -- 172.21.15.17:0/2337688028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd17c06c910 msgr2=0x7fd17c06cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.852+0000 7fd1821ff700 1 --2- 172.21.15.17:0/2337688028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd17c06c910 0x7fd17c06cd80 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b0a0 tx=0x7fd17400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.853+0000 7fd1821ff700 1 -- 172.21.15.17:0/2337688028 shutdown_connections 2023-07-14T13:27:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.853+0000 7fd1821ff700 1 --2- 172.21.15.17:0/2337688028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd17c06d3a0 0x7fd17c11b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.853+0000 7fd1821ff700 1 --2- 172.21.15.17:0/2337688028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd17c10e2a0 0x7fd17c10e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.853+0000 7fd1821ff700 1 --2- 172.21.15.17:0/2337688028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd17c06c910 0x7fd17c06cd80 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.853+0000 7fd1821ff700 1 -- 172.21.15.17:0/2337688028 >> 172.21.15.17:0/2337688028 conn(0x7fd17c06bd70 msgr2=0x7fd17c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.856+0000 7fd1821ff700 1 -- 172.21.15.17:0/2337688028 shutdown_connections 2023-07-14T13:27:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.860+0000 7fd1821ff700 1 -- 172.21.15.17:0/2337688028 wait complete. 2023-07-14T13:27:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.862+0000 7fd1821ff700 1 Processor -- start 2023-07-14T13:27:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.862+0000 7fd1821ff700 1 -- start start 2023-07-14T13:27:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.863+0000 7fd1821ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd17c06c910 0x7fd17c1aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.863+0000 7fd1821ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd17c06d3a0 0x7fd17c1ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.863+0000 7fd1821ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd17c10e2a0 0x7fd17c1a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.863+0000 7fd1821ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c1a4f90 con 0x7fd17c10e2a0 2023-07-14T13:27:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.863+0000 7fd1821ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c1a5100 con 0x7fd17c06c910 2023-07-14T13:27:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.863+0000 7fd1821ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c1a52c0 con 0x7fd17c06d3a0 2023-07-14T13:27:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.863+0000 7fd17b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd17c06c910 0x7fd17c1aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.863+0000 7fd17b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd17c06c910 0x7fd17c1aaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59266/0 (socket says 172.21.15.17:59266) 2023-07-14T13:27:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.863+0000 7fd17b7fe700 1 -- 172.21.15.17:0/21340289 learned_addr learned my addr 172.21.15.17:0/21340289 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.863+0000 7fd17bfff700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd17c10e2a0 0x7fd17c1a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.864+0000 7fd17bfff700 1 -- 172.21.15.17:0/21340289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd17c06d3a0 msgr2=0x7fd17c1ab000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T13:27:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.864+0000 7fd17bfff700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd17c06d3a0 0x7fd17c1ab000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.864+0000 7fd17bfff700 1 -- 172.21.15.17:0/21340289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd17c06c910 msgr2=0x7fd17c1aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.864+0000 7fd17bfff700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd17c06c910 0x7fd17c1aaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.864+0000 7fd17bfff700 1 -- 172.21.15.17:0/21340289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174009d00 con 0x7fd17c10e2a0 2023-07-14T13:27:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.865+0000 7fd17bfff700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd17c10e2a0 0x7fd17c1a4920 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00b3e0 tx=0x7fd16c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.866+0000 7fd178ff9700 1 -- 172.21.15.17:0/21340289 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c011830 con 0x7fd17c10e2a0 2023-07-14T13:27:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.866+0000 7fd178ff9700 1 -- 172.21.15.17:0/21340289 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd16c00be40 con 0x7fd17c10e2a0 2023-07-14T13:27:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.866+0000 7fd178ff9700 1 -- 172.21.15.17:0/21340289 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c010cd0 con 0x7fd17c10e2a0 2023-07-14T13:27:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.866+0000 7fd1821ff700 1 -- 172.21.15.17:0/21340289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c1a55a0 con 0x7fd17c10e2a0 2023-07-14T13:27:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.866+0000 7fd1821ff700 1 -- 172.21.15.17:0/21340289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c10ee20 con 0x7fd17c10e2a0 2023-07-14T13:27:25.879 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.873+0000 7fd195b91b80 1 Processor -- start 2023-07-14T13:27:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.876+0000 7fd195b91b80 1 -- start start 2023-07-14T13:27:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.876+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6eead6b0 0x562e6f056d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.876+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 0x562e6f051040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.876+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f051580 0x562e6f0519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.876+0000 7fd195b91b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6ef56c50 con 0x562e6f051580 2023-07-14T13:27:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.876+0000 7fd195b91b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6efa99e0 con 0x562e6f0572d0 2023-07-14T13:27:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.876+0000 7fd195b91b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6efa2e70 con 0x562e6eead6b0 2023-07-14T13:27:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.877+0000 7fd178ff9700 1 -- 172.21.15.17:0/21340289 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd16c011990 con 0x7fd17c10e2a0 2023-07-14T13:27:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.879+0000 7fd17b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 0x562e6f051040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.879+0000 7fd17b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 0x562e6f051040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59268/0 (socket says 172.21.15.17:59268) 2023-07-14T13:27:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.879+0000 7fd17b7fe700 1 -- 172.21.15.17:0/3850936812 learned_addr learned my addr 172.21.15.17:0/3850936812 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.880+0000 7fd17b7fe700 1 -- 172.21.15.17:0/3850936812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6eead6b0 msgr2=0x562e6f056d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.880+0000 7fd17b7fe700 1 --2- 172.21.15.17:0/3850936812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6eead6b0 0x562e6f056d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.880+0000 7fd17b7fe700 1 -- 172.21.15.17:0/3850936812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f051580 msgr2=0x562e6f0519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.880+0000 7fd17b7fe700 1 --2- 172.21.15.17:0/3850936812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f051580 0x562e6f0519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.880+0000 7fd17b7fe700 1 -- 172.21.15.17:0/3850936812 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e6edd0d80 con 0x562e6f0572d0 2023-07-14T13:27:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.880+0000 7fd178ff9700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1640a14d0 0x7fd1640a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.880+0000 7fd178ff9700 1 -- 172.21.15.17:0/21340289 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd16c0cc420 con 0x7fd17c10e2a0 2023-07-14T13:27:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.881+0000 7fd17b7fe700 1 --2- 172.21.15.17:0/3850936812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 0x562e6f051040 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd170009bb0 tx=0x7fd170009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf1ac424901ec4fa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.884+0000 7fd161ffb700 1 -- 172.21.15.17:0/3850936812 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700096b0 con 0x562e6f0572d0 2023-07-14T13:27:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.884+0000 7fd161ffb700 1 -- 172.21.15.17:0/3850936812 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd17000ee80 con 0x562e6f0572d0 2023-07-14T13:27:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.884+0000 7fd161ffb700 1 -- 172.21.15.17:0/3850936812 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700123d0 con 0x562e6f0572d0 2023-07-14T13:27:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.885+0000 7fd195b91b80 1 -- 172.21.15.17:0/3850936812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 msgr2=0x562e6f051040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.885+0000 7fd195b91b80 1 --2- 172.21.15.17:0/3850936812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 0x562e6f051040 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd170009bb0 tx=0x7fd170009ec0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.885+0000 7fd195b91b80 1 -- 172.21.15.17:0/3850936812 shutdown_connections 2023-07-14T13:27:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.885+0000 7fd195b91b80 1 --2- 172.21.15.17:0/3850936812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f051580 0x562e6f0519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.885+0000 7fd195b91b80 1 --2- 172.21.15.17:0/3850936812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6eead6b0 0x562e6f056d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.885+0000 7fd195b91b80 1 --2- 172.21.15.17:0/3850936812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 0x562e6f051040 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.885+0000 7fd195b91b80 1 -- 172.21.15.17:0/3850936812 >> 172.21.15.17:0/3850936812 conn(0x562e6f046be0 msgr2=0x562e6f04bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.886+0000 7fd17affd700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1640a14d0 0x7fd1640a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.886+0000 7fd195b91b80 1 -- 172.21.15.17:0/3850936812 shutdown_connections 2023-07-14T13:27:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.886+0000 7fd195b91b80 1 -- 172.21.15.17:0/3850936812 wait complete. 2023-07-14T13:27:25.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.887+0000 7fd195b91b80 1 -- start start 2023-07-14T13:27:25.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.888+0000 7fd195b91b80 1 Processor -- start 2023-07-14T13:27:25.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.888+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 0x562e6f05d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.888+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6f051580 0x562e6f05a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.888+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f0572d0 0x562e6f05afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.888+0000 7fd195b91b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6ef42a60 con 0x562e6f0572d0 2023-07-14T13:27:25.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.888+0000 7fd195b91b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6ef42760 con 0x562e6eead6b0 2023-07-14T13:27:25.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.888+0000 7fd195b91b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6ee268c0 con 0x562e6f051580 2023-07-14T13:27:25.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.888+0000 7fd195b91b80 10 client.0 _ll_register_callbacks cb 0x562e6ef40700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:27:25.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.890+0000 7fd17b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 0x562e6f05d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.890+0000 7fd17bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f0572d0 0x562e6f05afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.890+0000 7fd17bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f0572d0 0x562e6f05afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47988/0 (socket says 172.21.15.17:47988) 2023-07-14T13:27:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.890+0000 7fd17bfff700 1 -- 172.21.15.17:0/681091915 learned_addr learned my addr 172.21.15.17:0/681091915 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.891+0000 7fd17b7fe700 1 -- 172.21.15.17:0/681091915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6f051580 msgr2=0x562e6f05a890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:27:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.891+0000 7fd17b7fe700 1 --2- 172.21.15.17:0/681091915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6f051580 0x562e6f05a890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.891+0000 7fd17b7fe700 1 -- 172.21.15.17:0/681091915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f0572d0 msgr2=0x562e6f05afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.891+0000 7fd17b7fe700 1 --2- 172.21.15.17:0/681091915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f0572d0 0x562e6f05afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.891+0000 7fd17b7fe700 1 -- 172.21.15.17:0/681091915 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd170009810 con 0x562e6eead6b0 2023-07-14T13:27:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.892+0000 7fd17b7fe700 1 --2- 172.21.15.17:0/681091915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 0x562e6f05d610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd170009bb0 tx=0x7fd170013750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e42c28808d8132d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.892+0000 7fd15affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:27:25.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.893+0000 7fd15affd700 1 -- 172.21.15.17:0/681091915 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17001c450 con 0x562e6eead6b0 2023-07-14T13:27:25.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.893+0000 7fd15affd700 1 -- 172.21.15.17:0/681091915 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd17001c5b0 con 0x562e6eead6b0 2023-07-14T13:27:25.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.894+0000 7fd195b91b80 1 -- 172.21.15.17:0/681091915 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e6eefc490 con 0x562e6eead6b0 2023-07-14T13:27:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.894+0000 7fd15affd700 1 -- 172.21.15.17:0/681091915 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd17001c770 con 0x562e6eead6b0 2023-07-14T13:27:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.894+0000 7fd195b91b80 10 client.29318 fetch_fsmap learned FSMap version 65 2023-07-14T13:27:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.894+0000 7fd195b91b80 1 -- 172.21.15.17:0/681091915 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x562e6edb9c00 con 0x562e6eead6b0 2023-07-14T13:27:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.897+0000 7fd15affd700 1 -- 172.21.15.17:0/681091915 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562e6eefc490 con 0x562e6eead6b0 2023-07-14T13:27:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.897+0000 7fd15affd700 1 -- 172.21.15.17:0/681091915 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 65) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd170024030 con 0x562e6eead6b0 2023-07-14T13:27:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.897+0000 7fd195b91b80 10 client.29318 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:27:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.897+0000 7fd195b91b80 10 client.29318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:27:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.897+0000 7fd195b91b80 20 client.29318 populate_metadata read hostname 'smithi017' 2023-07-14T13:27:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.898+0000 7fd195b91b80 1 --2- 172.21.15.17:0/681091915 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e6f06aa40 0x562e6f06ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.898+0000 7fd195b91b80 4 client.29318 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:27:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.898+0000 7fd195b91b80 1 -- 172.21.15.17:0/681091915 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e6ef9be50 con 0x562e6f06aa40 2023-07-14T13:27:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.899+0000 7fd17affd700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1640a14d0 0x7fd1640a3980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b7b0 tx=0x7fd17400b3b0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.899+0000 7fd17affd700 1 --2- 172.21.15.17:0/681091915 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e6f06aa40 0x562e6f06ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.900+0000 7fd17affd700 1 --2- 172.21.15.17:0/681091915 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e6f06aa40 0x562e6f06ce50 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e627498ca21b8b3 server_cookie=46b6d090fd93cc0c in_seq=0 out_seq=0 2023-07-14T13:27:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.900+0000 7fd15affd700 10 client.29318 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.901+0000 7fd15affd700 1 -- 172.21.15.17:0/681091915 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562e6ef9be50 con 0x562e6f06aa40 2023-07-14T13:27:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.901+0000 7fd15affd700 10 client.29318 handle_command_reply: tid=0 2023-07-14T13:27:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.901+0000 7fd195b91b80 1 client.29318 shutdown 2023-07-14T13:27:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.902+0000 7fd195b91b80 1 -- 172.21.15.17:0/681091915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 msgr2=0x562e6f05d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.902+0000 7fd195b91b80 1 --2- 172.21.15.17:0/681091915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 0x562e6f05d610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd170009bb0 tx=0x7fd170013750 comp rx=0 tx=0).stop 2023-07-14T13:27:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.903+0000 7fd195b91b80 1 -- 172.21.15.17:0/681091915 shutdown_connections 2023-07-14T13:27:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.903+0000 7fd195b91b80 1 --2- 172.21.15.17:0/681091915 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e6f06aa40 0x562e6f06ce50 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.903+0000 7fd195b91b80 1 --2- 172.21.15.17:0/681091915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f0572d0 0x562e6f05afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.903+0000 7fd195b91b80 1 --2- 172.21.15.17:0/681091915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 0x562e6f05d610 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.903+0000 7fd195b91b80 1 --2- 172.21.15.17:0/681091915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6f051580 0x562e6f05a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.903+0000 7fd195b91b80 1 -- 172.21.15.17:0/681091915 >> 172.21.15.17:0/681091915 conn(0x562e6f046be0 msgr2=0x562e6f04b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.903+0000 7fd15affd700 0 client.29318 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.903+0000 7fd195b91b80 1 -- 172.21.15.17:0/681091915 shutdown_connections 2023-07-14T13:27:25.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.904+0000 7fd195b91b80 1 -- 172.21.15.17:0/681091915 wait complete. 2023-07-14T13:27:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.907+0000 7fd195b91b80 20 client.29318 trim_cache size 0 max 16384 2023-07-14T13:27:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.937+0000 7fd195b91b80 1 Processor -- start 2023-07-14T13:27:25.944 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.938+0000 7fd195b91b80 1 -- start start 2023-07-14T13:27:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.938+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6eead6b0 0x562e6f04bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.938+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f051580 0x562e6f05d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.938+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 0x562e6f05a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.938+0000 7fd195b91b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6eefc490 con 0x562e6f051580 2023-07-14T13:27:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.938+0000 7fd195b91b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6f017060 con 0x562e6f0572d0 2023-07-14T13:27:25.945 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.938+0000 7fd195b91b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6f056a10 con 0x562e6eead6b0 2023-07-14T13:27:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.939+0000 7fd17b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6eead6b0 0x562e6f04bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.946 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.939+0000 7fd17b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6eead6b0 0x562e6f04bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:55318/0 (socket says 172.21.15.17:55318) 2023-07-14T13:27:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.939+0000 7fd17b7fe700 1 -- 172.21.15.17:0/2790725175 learned_addr learned my addr 172.21.15.17:0/2790725175 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.939+0000 7fd17bfff700 1 --2- 172.21.15.17:0/2790725175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 0x562e6f05a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.939+0000 7fd17b7fe700 1 -- 172.21.15.17:0/2790725175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 msgr2=0x562e6f05a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.939+0000 7fd17b7fe700 1 --2- 172.21.15.17:0/2790725175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 0x562e6f05a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.939+0000 7fd17b7fe700 1 -- 172.21.15.17:0/2790725175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f051580 msgr2=0x562e6f05d1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:27:25.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.939+0000 7fd17b7fe700 1 --2- 172.21.15.17:0/2790725175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f051580 0x562e6f05d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.939+0000 7fd17b7fe700 1 -- 172.21.15.17:0/2790725175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e6edf71f0 con 0x562e6eead6b0 2023-07-14T13:27:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.940+0000 7fd17b7fe700 1 --2- 172.21.15.17:0/2790725175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6eead6b0 0x562e6f04bc60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd170000c00 tx=0x7fd170009ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a1ba59e51be6829 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.940+0000 7fd1627fc700 1 -- 172.21.15.17:0/2790725175 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170030670 con 0x562e6eead6b0 2023-07-14T13:27:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.940+0000 7fd1627fc700 1 -- 172.21.15.17:0/2790725175 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd170020070 con 0x562e6eead6b0 2023-07-14T13:27:25.948 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.940+0000 7fd1627fc700 1 -- 172.21.15.17:0/2790725175 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17001c450 con 0x562e6eead6b0 2023-07-14T13:27:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.941+0000 7fd195b91b80 1 -- 172.21.15.17:0/2790725175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6eead6b0 msgr2=0x562e6f04bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.941+0000 7fd195b91b80 1 --2- 172.21.15.17:0/2790725175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6eead6b0 0x562e6f04bc60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd170000c00 tx=0x7fd170009ae0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.942+0000 7fd195b91b80 1 -- 172.21.15.17:0/2790725175 shutdown_connections 2023-07-14T13:27:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.942+0000 7fd195b91b80 1 --2- 172.21.15.17:0/2790725175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6f0572d0 0x562e6f05a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.942+0000 7fd195b91b80 1 --2- 172.21.15.17:0/2790725175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6eead6b0 0x562e6f04bc60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.949 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.942+0000 7fd195b91b80 1 --2- 172.21.15.17:0/2790725175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f051580 0x562e6f05d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.942+0000 7fd195b91b80 1 -- 172.21.15.17:0/2790725175 >> 172.21.15.17:0/2790725175 conn(0x562e6f046be0 msgr2=0x562e6f051950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.942+0000 7fd195b91b80 1 -- 172.21.15.17:0/2790725175 shutdown_connections 2023-07-14T13:27:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.943+0000 7fd195b91b80 1 -- 172.21.15.17:0/2790725175 wait complete. 2023-07-14T13:27:25.950 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.943+0000 7fd195b91b80 1 -- start start 2023-07-14T13:27:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.944+0000 7fd195b91b80 1 Processor -- start 2023-07-14T13:27:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.945+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 0x562e6f05fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.945+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6f051580 0x562e6f060190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.945+0000 7fd195b91b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f0572d0 0x562e6f0606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.945+0000 7fd195b91b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6f0bd9a0 con 0x562e6f0572d0 2023-07-14T13:27:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.945+0000 7fd195b91b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6f0bdae0 con 0x562e6eead6b0 2023-07-14T13:27:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.945+0000 7fd195b91b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e6f0bdca0 con 0x562e6f051580 2023-07-14T13:27:25.952 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.945+0000 7fd195b91b80 10 client.0 _ll_register_callbacks cb 0x7fd170009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:27:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.946+0000 7fd17affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6f051580 0x562e6f060190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.946+0000 7fd17b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 0x562e6f05fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.946+0000 7fd17b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 0x562e6f05fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59288/0 (socket says 172.21.15.17:59288) 2023-07-14T13:27:25.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.946+0000 7fd17b7fe700 1 -- 172.21.15.17:0/3130198510 learned_addr learned my addr 172.21.15.17:0/3130198510 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:25.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.946+0000 7fd17bfff700 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f0572d0 0x562e6f0606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.947+0000 7fd17affd700 1 -- 172.21.15.17:0/3130198510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 msgr2=0x562e6f05fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:25.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.947+0000 7fd17affd700 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 0x562e6f05fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.947+0000 7fd17affd700 1 -- 172.21.15.17:0/3130198510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f0572d0 msgr2=0x562e6f0606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:25.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.947+0000 7fd17affd700 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f0572d0 0x562e6f0606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:25.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.947+0000 7fd17affd700 1 -- 172.21.15.17:0/3130198510 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e6edb9c00 con 0x562e6f051580 2023-07-14T13:27:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.947+0000 7fd17affd700 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6f051580 0x562e6f060190 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x562e6f06d760 tx=0x7fd1740093d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2d254de123d8ae9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:25.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.947+0000 7fd15affd700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:27:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.950+0000 7fd15affd700 1 -- 172.21.15.17:0/3130198510 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17400e040 con 0x562e6f051580 2023-07-14T13:27:25.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.950+0000 7fd15affd700 1 -- 172.21.15.17:0/3130198510 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd1740079c0 con 0x562e6f051580 2023-07-14T13:27:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.954+0000 7fd195b91b80 1 -- 172.21.15.17:0/3130198510 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd17000ee80 con 0x562e6f051580 2023-07-14T13:27:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.954+0000 7fd15affd700 1 -- 172.21.15.17:0/3130198510 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd174029c70 con 0x562e6f051580 2023-07-14T13:27:25.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.954+0000 7fd195b91b80 10 client.29278 fetch_fsmap learned FSMap version 65 2023-07-14T13:27:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.954+0000 7fd195b91b80 1 -- 172.21.15.17:0/3130198510 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x562e6edcf250 con 0x562e6f051580 2023-07-14T13:27:25.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.955+0000 7fd15affd700 1 -- 172.21.15.17:0/3130198510 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd17000ee80 con 0x562e6f051580 2023-07-14T13:27:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.956+0000 7fd15affd700 1 -- 172.21.15.17:0/3130198510 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 65) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd174029470 con 0x562e6f051580 2023-07-14T13:27:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.956+0000 7fd195b91b80 10 client.29278 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:27:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.956+0000 7fd195b91b80 10 client.29278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:27:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.956+0000 7fd195b91b80 20 client.29278 populate_metadata read hostname 'smithi017' 2023-07-14T13:27:25.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.956+0000 7fd195b91b80 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e6f0bf410 0x562e6f0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.956+0000 7fd195b91b80 4 client.29278 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:27:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.956+0000 7fd195b91b80 1 -- 172.21.15.17:0/3130198510 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562e6ef5dff0 con 0x562e6f0bf410 2023-07-14T13:27:25.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.957+0000 7fd17b7fe700 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e6f0bf410 0x562e6f0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.958+0000 7fd17b7fe700 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e6f0bf410 0x562e6f0c1820 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff9517afac3bc12d server_cookie=739d25e1d5d1582a in_seq=0 out_seq=0 2023-07-14T13:27:25.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:25.958+0000 7fd15affd700 10 client.29278 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.007+0000 7fd15affd700 1 -- 172.21.15.17:0/3130198510 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562e6ef5dff0 con 0x562e6f0bf410 2023-07-14T13:27:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.007+0000 7fd15affd700 10 client.29278 handle_command_reply: tid=0 2023-07-14T13:27:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.008+0000 7fd195b91b80 1 client.29278 shutdown 2023-07-14T13:27:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.010+0000 7fd195b91b80 1 -- 172.21.15.17:0/3130198510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6f051580 msgr2=0x562e6f060190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:26.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.010+0000 7fd195b91b80 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6f051580 0x562e6f060190 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x562e6f06d760 tx=0x7fd1740093d0 comp rx=0 tx=0).stop 2023-07-14T13:27:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.016+0000 7fd195b91b80 1 -- 172.21.15.17:0/3130198510 shutdown_connections 2023-07-14T13:27:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.016+0000 7fd195b91b80 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x562e6f0bf410 0x562e6f0c1820 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.016+0000 7fd195b91b80 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562e6f0572d0 0x562e6f0606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.016+0000 7fd195b91b80 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e6eead6b0 0x562e6f05fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.016+0000 7fd195b91b80 1 --2- 172.21.15.17:0/3130198510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e6f051580 0x562e6f060190 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.016+0000 7fd195b91b80 1 -- 172.21.15.17:0/3130198510 >> 172.21.15.17:0/3130198510 conn(0x562e6f046be0 msgr2=0x562e6f055a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.016+0000 7fd15affd700 0 client.29278 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.017+0000 7fd195b91b80 1 -- 172.21.15.17:0/3130198510 shutdown_connections 2023-07-14T13:27:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.017+0000 7fd195b91b80 1 -- 172.21.15.17:0/3130198510 wait complete. 2023-07-14T13:27:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.020+0000 7fd195b91b80 20 client.29278 trim_cache size 0 max 16384 2023-07-14T13:27:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:27:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:27:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:27:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:27:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.023+0000 7fd1821ff700 1 -- 172.21.15.17:0/21340289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1640a14d0 msgr2=0x7fd1640a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:26.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.023+0000 7fd1821ff700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1640a14d0 0x7fd1640a3980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b7b0 tx=0x7fd17400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:27:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.023+0000 7fd1821ff700 1 -- 172.21.15.17:0/21340289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd17c10e2a0 msgr2=0x7fd17c1a4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.023+0000 7fd1821ff700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd17c10e2a0 0x7fd17c1a4920 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00b3e0 tx=0x7fd16c00b6f0 comp rx=0 tx=0).stop 2023-07-14T13:27:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.026+0000 7fd1821ff700 1 -- 172.21.15.17:0/21340289 shutdown_connections 2023-07-14T13:27:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.026+0000 7fd1821ff700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1640a14d0 0x7fd1640a3980 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd17400b7b0 tx=0x7fd17400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:27:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.026+0000 7fd1821ff700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd17c10e2a0 0x7fd17c1a4920 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.026+0000 7fd1821ff700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd17c06c910 0x7fd17c1aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.026+0000 7fd1821ff700 1 --2- 172.21.15.17:0/21340289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd17c06d3a0 0x7fd17c1ab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.027+0000 7fd1821ff700 1 -- 172.21.15.17:0/21340289 >> 172.21.15.17:0/21340289 conn(0x7fd17c06bd70 msgr2=0x7fd17c06f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.030+0000 7fd1821ff700 1 -- 172.21.15.17:0/21340289 shutdown_connections 2023-07-14T13:27:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:26.030+0000 7fd1821ff700 1 -- 172.21.15.17:0/21340289 wait complete. 2023-07-14T13:27:27.426 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 555.0 s, 357.7 tps, lat 202.513 ms stddev 61.953 2023-07-14T13:27:27.832 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:27 smithi017 ceph-mon[95536]: pgmap v878: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 932 op/s 2023-07-14T13:27:27.924 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:27 smithi135 ceph-mon[97338]: pgmap v878: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 932 op/s 2023-07-14T13:27:27.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:27 smithi131 ceph-mon[96953]: pgmap v878: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 11 MiB/s wr, 932 op/s 2023-07-14T13:27:29.832 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:29 smithi017 ceph-mon[95536]: pgmap v879: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.9 MiB/s wr, 784 op/s 2023-07-14T13:27:29.924 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:29 smithi135 ceph-mon[97338]: pgmap v879: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.9 MiB/s wr, 784 op/s 2023-07-14T13:27:29.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:29 smithi131 ceph-mon[96953]: pgmap v879: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 8.9 MiB/s wr, 784 op/s 2023-07-14T13:27:31.839 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:31 smithi017 ceph-mon[95536]: pgmap v880: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.0 MiB/s wr, 803 op/s 2023-07-14T13:27:31.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:31 smithi135 ceph-mon[97338]: pgmap v880: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.0 MiB/s wr, 803 op/s 2023-07-14T13:27:31.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:31 smithi131 ceph-mon[96953]: pgmap v880: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 9.0 MiB/s wr, 803 op/s 2023-07-14T13:27:32.425 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 560.0 s, 403.7 tps, lat 316.612 ms stddev 716.963 2023-07-14T13:27:33.832 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:33 smithi017 ceph-mon[95536]: pgmap v881: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 996 op/s 2023-07-14T13:27:33.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:33 smithi135 ceph-mon[97338]: pgmap v881: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 996 op/s 2023-07-14T13:27:33.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:33 smithi131 ceph-mon[96953]: pgmap v881: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 11 MiB/s wr, 996 op/s 2023-07-14T13:27:35.833 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:35 smithi017 ceph-mon[95536]: pgmap v882: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.6 MiB/s wr, 783 op/s 2023-07-14T13:27:35.861 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:35 smithi131 ceph-mon[96953]: pgmap v882: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.6 MiB/s wr, 783 op/s 2023-07-14T13:27:35.924 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:35 smithi135 ceph-mon[97338]: pgmap v882: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.6 MiB/s wr, 783 op/s 2023-07-14T13:27:37.425 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 565.0 s, 456.0 tps, lat 216.368 ms stddev 387.976 2023-07-14T13:27:37.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:37 smithi135 ceph-mon[97338]: pgmap v883: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.35k op/s 2023-07-14T13:27:37.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:37 smithi131 ceph-mon[96953]: pgmap v883: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.35k op/s 2023-07-14T13:27:38.082 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:37 smithi017 ceph-mon[95536]: pgmap v883: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 15 MiB/s wr, 1.35k op/s 2023-07-14T13:27:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.301+0000 7fcc467ff700 1 -- 172.21.15.17:0/1809330752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc40074a40 msgr2=0x7fcc40074e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.301+0000 7fcc467ff700 1 --2- 172.21.15.17:0/1809330752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc40074a40 0x7fcc40074e10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcc300098f0 tx=0x7fcc30009c00 comp rx=0 tx=0).stop 2023-07-14T13:27:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.302+0000 7fcc467ff700 1 -- 172.21.15.17:0/1809330752 shutdown_connections 2023-07-14T13:27:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.302+0000 7fcc467ff700 1 --2- 172.21.15.17:0/1809330752 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc401109a0 0x7fcc40112d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.302+0000 7fcc467ff700 1 --2- 172.21.15.17:0/1809330752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc40074a40 0x7fcc40074e10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.302+0000 7fcc467ff700 1 --2- 172.21.15.17:0/1809330752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40075350 0x7fcc40110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.302+0000 7fcc467ff700 1 -- 172.21.15.17:0/1809330752 >> 172.21.15.17:0/1809330752 conn(0x7fcc400fd7e0 msgr2=0x7fcc400ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.303+0000 7fcc467ff700 1 -- 172.21.15.17:0/1809330752 shutdown_connections 2023-07-14T13:27:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.303+0000 7fcc467ff700 1 -- 172.21.15.17:0/1809330752 wait complete. 2023-07-14T13:27:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.304+0000 7fcc467ff700 1 Processor -- start 2023-07-14T13:27:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.304+0000 7fcc467ff700 1 -- start start 2023-07-14T13:27:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.305+0000 7fcc467ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40074a40 0x7fcc4019c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.305+0000 7fcc467ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc40075350 0x7fcc4019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.305+0000 7fcc467ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc401109a0 0x7fcc401a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.305+0000 7fcc467ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc401a13b0 con 0x7fcc40075350 2023-07-14T13:27:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.305+0000 7fcc467ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc401a1520 con 0x7fcc40074a40 2023-07-14T13:27:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.305+0000 7fcc467ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc401a16e0 con 0x7fcc401109a0 2023-07-14T13:27:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.305+0000 7fcc3ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40074a40 0x7fcc4019c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.306+0000 7fcc3ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40074a40 0x7fcc4019c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60360/0 (socket says 172.21.15.17:60360) 2023-07-14T13:27:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.306+0000 7fcc3ffff700 1 -- 172.21.15.17:0/778379965 learned_addr learned my addr 172.21.15.17:0/778379965 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.306+0000 7fcc377fe700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc40075350 0x7fcc4019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.306+0000 7fcc44d9c700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc401109a0 0x7fcc401a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.306+0000 7fcc377fe700 1 -- 172.21.15.17:0/778379965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc401109a0 msgr2=0x7fcc401a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.306+0000 7fcc377fe700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc401109a0 0x7fcc401a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.306+0000 7fcc377fe700 1 -- 172.21.15.17:0/778379965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40074a40 msgr2=0x7fcc4019c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.307+0000 7fcc377fe700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40074a40 0x7fcc4019c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.307+0000 7fcc377fe700 1 -- 172.21.15.17:0/778379965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc30009520 con 0x7fcc40075350 2023-07-14T13:27:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.307+0000 7fcc3ffff700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40074a40 0x7fcc4019c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:27:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.307+0000 7fcc377fe700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc40075350 0x7fcc4019c700 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800ef10 tx=0x7fcc2800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.308+0000 7fcc3dffb700 1 -- 172.21.15.17:0/778379965 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800ca70 con 0x7fcc40075350 2023-07-14T13:27:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.308+0000 7fcc3dffb700 1 -- 172.21.15.17:0/778379965 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc2800f040 con 0x7fcc40075350 2023-07-14T13:27:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.308+0000 7fcc3dffb700 1 -- 172.21.15.17:0/778379965 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28014480 con 0x7fcc40075350 2023-07-14T13:27:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.309+0000 7fcc467ff700 1 -- 172.21.15.17:0/778379965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc401a1960 con 0x7fcc40075350 2023-07-14T13:27:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.309+0000 7fcc467ff700 1 -- 172.21.15.17:0/778379965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc40101df0 con 0x7fcc40075350 2023-07-14T13:27:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.316+0000 7fcc5a075b80 1 Processor -- start 2023-07-14T13:27:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.317+0000 7fcc5a075b80 1 -- start start 2023-07-14T13:27:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.317+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f36566b0 0x55e0f37ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.317+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f38002d0 0x55e0f37fa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.317+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f37fa580 0x55e0f37fa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.317+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f36ffc50 con 0x55e0f36566b0 2023-07-14T13:27:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.317+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f37529e0 con 0x55e0f38002d0 2023-07-14T13:27:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.317+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f374be70 con 0x55e0f37fa580 2023-07-14T13:27:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.318+0000 7fcc44d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f36566b0 0x55e0f37ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.318+0000 7fcc44d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f36566b0 0x55e0f37ffd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43750/0 (socket says 172.21.15.17:43750) 2023-07-14T13:27:39.325 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.318+0000 7fcc44d9c700 1 -- 172.21.15.17:0/2567266864 learned_addr learned my addr 172.21.15.17:0/2567266864 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.319+0000 7fcc44d9c700 1 -- 172.21.15.17:0/2567266864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f37fa580 msgr2=0x55e0f37fa9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:27:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.319+0000 7fcc44d9c700 1 --2- 172.21.15.17:0/2567266864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f37fa580 0x55e0f37fa9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.319+0000 7fcc44d9c700 1 -- 172.21.15.17:0/2567266864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f38002d0 msgr2=0x55e0f37fa040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:27:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.319+0000 7fcc44d9c700 1 --2- 172.21.15.17:0/2567266864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f38002d0 0x55e0f37fa040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.319+0000 7fcc44d9c700 1 -- 172.21.15.17:0/2567266864 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0f3579d80 con 0x55e0f36566b0 2023-07-14T13:27:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.319+0000 7fcc3dffb700 1 -- 172.21.15.17:0/778379965 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcc280075c0 con 0x7fcc40075350 2023-07-14T13:27:39.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.319+0000 7fcc44d9c700 1 --2- 172.21.15.17:0/2567266864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f36566b0 0x55e0f37ffd90 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800dc20 tx=0x7fcc3800df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba3a254f96032a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.320+0000 7fcc367fc700 1 -- 172.21.15.17:0/2567266864 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800fbc0 con 0x55e0f36566b0 2023-07-14T13:27:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.320+0000 7fcc367fc700 1 -- 172.21.15.17:0/2567266864 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc3800fd20 con 0x55e0f36566b0 2023-07-14T13:27:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.320+0000 7fcc367fc700 1 -- 172.21.15.17:0/2567266864 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc380055b0 con 0x55e0f36566b0 2023-07-14T13:27:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.321+0000 7fcc3dffb700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcc2c0a1490 0x7fcc2c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.321+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2567266864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f36566b0 msgr2=0x55e0f37ffd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.321+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/2567266864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f36566b0 0x55e0f37ffd90 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800dc20 tx=0x7fcc3800df30 comp rx=0 tx=0).stop 2023-07-14T13:27:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.322+0000 7fcc3dffb700 1 -- 172.21.15.17:0/778379965 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcc280ccf30 con 0x7fcc40075350 2023-07-14T13:27:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.322+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2567266864 shutdown_connections 2023-07-14T13:27:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.322+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/2567266864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f37fa580 0x55e0f37fa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.322+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/2567266864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f36566b0 0x55e0f37ffd90 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.322+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/2567266864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f38002d0 0x55e0f37fa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.322+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2567266864 >> 172.21.15.17:0/2567266864 conn(0x55e0f37efbe0 msgr2=0x55e0f37f4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.322+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2567266864 shutdown_connections 2023-07-14T13:27:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.322+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2567266864 wait complete. 2023-07-14T13:27:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.323+0000 7fcc5a075b80 1 -- start start 2023-07-14T13:27:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.323+0000 7fcc5a075b80 1 Processor -- start 2023-07-14T13:27:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.324+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f36566b0 0x55e0f38039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.324+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f37fa580 0x55e0f3803ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.324+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f38002d0 0x55e0f3804420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.324+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f36eba60 con 0x55e0f37fa580 2023-07-14T13:27:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.324+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f36eb760 con 0x55e0f36566b0 2023-07-14T13:27:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.324+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f35cf8c0 con 0x55e0f38002d0 2023-07-14T13:27:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.324+0000 7fcc5a075b80 10 client.0 _ll_register_callbacks cb 0x55e0f36e9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:27:39.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.325+0000 7fcc3ffff700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcc2c0a1490 0x7fcc2c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.325+0000 7fcc377fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f37fa580 0x55e0f3803ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.325+0000 7fcc377fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f37fa580 0x55e0f3803ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43760/0 (socket says 172.21.15.17:43760) 2023-07-14T13:27:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.325+0000 7fcc377fe700 1 -- 172.21.15.17:0/3482561365 learned_addr learned my addr 172.21.15.17:0/3482561365 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:39.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.326+0000 7fcc377fe700 1 -- 172.21.15.17:0/3482561365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f38002d0 msgr2=0x55e0f3804420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.326+0000 7fcc377fe700 1 --2- 172.21.15.17:0/3482561365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f38002d0 0x55e0f3804420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.326+0000 7fcc377fe700 1 -- 172.21.15.17:0/3482561365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f36566b0 msgr2=0x55e0f38039a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:27:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.326+0000 7fcc377fe700 1 --2- 172.21.15.17:0/3482561365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f36566b0 0x55e0f38039a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.326+0000 7fcc377fe700 1 -- 172.21.15.17:0/3482561365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3800d880 con 0x55e0f37fa580 2023-07-14T13:27:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.327+0000 7fcc3ffff700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcc2c0a1490 0x7fcc2c0a3940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55e0f37f6b40 tx=0x7fcc30005e00 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.327+0000 7fcc377fe700 1 --2- 172.21.15.17:0/3482561365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f37fa580 0x55e0f3803ee0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fcc28000f80 tx=0x7fcc28099c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc0a3ddcd8dbe2f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:39.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.327+0000 7fcc1f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:27:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.327+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/3482561365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280996b0 con 0x55e0f37fa580 2023-07-14T13:27:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.327+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/3482561365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcc280094e0 con 0x55e0f37fa580 2023-07-14T13:27:39.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.328+0000 7fcc5a075b80 1 -- 172.21.15.17:0/3482561365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0f36a5490 con 0x55e0f37fa580 2023-07-14T13:27:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.328+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/3482561365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc28007870 con 0x55e0f37fa580 2023-07-14T13:27:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.328+0000 7fcc5a075b80 10 client.19560 fetch_fsmap learned FSMap version 65 2023-07-14T13:27:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.328+0000 7fcc5a075b80 1 -- 172.21.15.17:0/3482561365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55e0f3562c00 con 0x55e0f37fa580 2023-07-14T13:27:39.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.329+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/3482561365 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc280c8020 con 0x55e0f37fa580 2023-07-14T13:27:39.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.329+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/3482561365 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 65) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fcc280a1f80 con 0x55e0f37fa580 2023-07-14T13:27:39.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.329+0000 7fcc5a075b80 10 client.19560 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:27:39.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.329+0000 7fcc5a075b80 10 client.19560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:27:39.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.329+0000 7fcc5a075b80 20 client.19560 populate_metadata read hostname 'smithi017' 2023-07-14T13:27:39.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.329+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/3482561365 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0f3813d70 0x55e0f3816180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.329+0000 7fcc5a075b80 4 client.19560 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:27:39.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.329+0000 7fcc5a075b80 1 -- 172.21.15.17:0/3482561365 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0f3744e50 con 0x55e0f3813d70 2023-07-14T13:27:39.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.330+0000 7fcc3ffff700 1 --2- 172.21.15.17:0/3482561365 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0f3813d70 0x55e0f3816180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.331+0000 7fcc3ffff700 1 --2- 172.21.15.17:0/3482561365 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0f3813d70 0x55e0f3816180 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=378fc7dea2d79fc1 server_cookie=bc38798dce899b4e in_seq=0 out_seq=0 2023-07-14T13:27:39.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.331+0000 7fcc1f7fe700 10 client.19560 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:39.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/3482561365 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e0f3744e50 con 0x55e0f3813d70 2023-07-14T13:27:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc1f7fe700 10 client.19560 handle_command_reply: tid=0 2023-07-14T13:27:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc5a075b80 1 client.19560 shutdown 2023-07-14T13:27:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc5a075b80 1 -- 172.21.15.17:0/3482561365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f37fa580 msgr2=0x55e0f3803ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/3482561365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f37fa580 0x55e0f3803ee0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fcc28000f80 tx=0x7fcc28099c30 comp rx=0 tx=0).stop 2023-07-14T13:27:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc5a075b80 1 -- 172.21.15.17:0/3482561365 shutdown_connections 2023-07-14T13:27:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/3482561365 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0f3813d70 0x55e0f3816180 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/3482561365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f38002d0 0x55e0f3804420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/3482561365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f36566b0 0x55e0f38039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/3482561365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f37fa580 0x55e0f3803ee0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc5a075b80 1 -- 172.21.15.17:0/3482561365 >> 172.21.15.17:0/3482561365 conn(0x55e0f37efbe0 msgr2=0x55e0f37f3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.332+0000 7fcc1f7fe700 0 client.19560 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.333+0000 7fcc5a075b80 1 -- 172.21.15.17:0/3482561365 shutdown_connections 2023-07-14T13:27:39.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.333+0000 7fcc5a075b80 1 -- 172.21.15.17:0/3482561365 wait complete. 2023-07-14T13:27:39.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.333+0000 7fcc5a075b80 20 client.19560 trim_cache size 0 max 16384 2023-07-14T13:27:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.361+0000 7fcc5a075b80 1 Processor -- start 2023-07-14T13:27:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.361+0000 7fcc5a075b80 1 -- start start 2023-07-14T13:27:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.362+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f36566b0 0x55e0f37fa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.362+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f37fa580 0x55e0f380ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.362+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f38002d0 0x55e0f37f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.362+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f37f6970 con 0x55e0f38002d0 2023-07-14T13:27:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.362+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f37f5ef0 con 0x55e0f37fa580 2023-07-14T13:27:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.362+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f3801f20 con 0x55e0f36566b0 2023-07-14T13:27:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.362+0000 7fcc3ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f36566b0 0x55e0f37fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.362+0000 7fcc3ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f36566b0 0x55e0f37fa040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54320/0 (socket says 172.21.15.17:54320) 2023-07-14T13:27:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.362+0000 7fcc3ffff700 1 -- 172.21.15.17:0/472354363 learned_addr learned my addr 172.21.15.17:0/472354363 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.362+0000 7fcc377fe700 1 --2- 172.21.15.17:0/472354363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f37fa580 0x55e0f380ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.363+0000 7fcc3ffff700 1 -- 172.21.15.17:0/472354363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f37fa580 msgr2=0x55e0f380ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.363+0000 7fcc3ffff700 1 --2- 172.21.15.17:0/472354363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f37fa580 0x55e0f380ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.363+0000 7fcc3ffff700 1 -- 172.21.15.17:0/472354363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f38002d0 msgr2=0x55e0f37f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.363+0000 7fcc3ffff700 1 --2- 172.21.15.17:0/472354363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f38002d0 0x55e0f37f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.363+0000 7fcc3ffff700 1 -- 172.21.15.17:0/472354363 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0f35a01f0 con 0x55e0f36566b0 2023-07-14T13:27:39.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.366+0000 7fcc3ffff700 1 --2- 172.21.15.17:0/472354363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f36566b0 0x55e0f37fa040 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcc30011040 tx=0x7fcc30022000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fc7361ba0465a58 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.368+0000 7fcc36ffd700 1 -- 172.21.15.17:0/472354363 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3002c040 con 0x55e0f36566b0 2023-07-14T13:27:39.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.368+0000 7fcc36ffd700 1 -- 172.21.15.17:0/472354363 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc3001d040 con 0x55e0f36566b0 2023-07-14T13:27:39.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.368+0000 7fcc36ffd700 1 -- 172.21.15.17:0/472354363 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3002edb0 con 0x55e0f36566b0 2023-07-14T13:27:39.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.369+0000 7fcc5a075b80 1 -- 172.21.15.17:0/472354363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f36566b0 msgr2=0x55e0f37fa040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:39.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.369+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/472354363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f36566b0 0x55e0f37fa040 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcc30011040 tx=0x7fcc30022000 comp rx=0 tx=0).stop 2023-07-14T13:27:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.369+0000 7fcc5a075b80 1 -- 172.21.15.17:0/472354363 shutdown_connections 2023-07-14T13:27:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.369+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/472354363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f38002d0 0x55e0f37f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.369+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/472354363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f36566b0 0x55e0f37fa040 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.369+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/472354363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f37fa580 0x55e0f380ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.369+0000 7fcc5a075b80 1 -- 172.21.15.17:0/472354363 >> 172.21.15.17:0/472354363 conn(0x55e0f37efbe0 msgr2=0x55e0f37fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.369+0000 7fcc5a075b80 1 -- 172.21.15.17:0/472354363 shutdown_connections 2023-07-14T13:27:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.369+0000 7fcc5a075b80 1 -- 172.21.15.17:0/472354363 wait complete. 2023-07-14T13:27:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.370+0000 7fcc5a075b80 1 -- start start 2023-07-14T13:27:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.370+0000 7fcc5a075b80 1 Processor -- start 2023-07-14T13:27:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.371+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f36566b0 0x55e0f3808c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.371+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f37fa580 0x55e0f3809190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.371+0000 7fcc5a075b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f38002d0 0x55e0f3866bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.371+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f3809ab0 con 0x55e0f38002d0 2023-07-14T13:27:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.371+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f3867130 con 0x55e0f36566b0 2023-07-14T13:27:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.371+0000 7fcc5a075b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0f3867270 con 0x55e0f37fa580 2023-07-14T13:27:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.371+0000 7fcc5a075b80 10 client.0 _ll_register_callbacks cb 0x7fcc28096300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:27:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.372+0000 7fcc377fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f37fa580 0x55e0f3809190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.372+0000 7fcc377fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f37fa580 0x55e0f3809190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:54332/0 (socket says 172.21.15.17:54332) 2023-07-14T13:27:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.372+0000 7fcc377fe700 1 -- 172.21.15.17:0/2290012507 learned_addr learned my addr 172.21.15.17:0/2290012507 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.372+0000 7fcc44d9c700 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f38002d0 0x55e0f3866bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.373+0000 7fcc377fe700 1 -- 172.21.15.17:0/2290012507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f36566b0 msgr2=0x55e0f3808c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.373+0000 7fcc377fe700 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f36566b0 0x55e0f3808c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.373+0000 7fcc377fe700 1 -- 172.21.15.17:0/2290012507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f38002d0 msgr2=0x55e0f3866bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.373+0000 7fcc377fe700 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f38002d0 0x55e0f3866bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.373+0000 7fcc377fe700 1 -- 172.21.15.17:0/2290012507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc401137b0 con 0x55e0f37fa580 2023-07-14T13:27:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.373+0000 7fcc377fe700 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f37fa580 0x55e0f3809190 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcc280a22b0 tx=0x7fcc28004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87eb1a5898733e0b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.374+0000 7fcc1f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:27:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.374+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/2290012507 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28094dd0 con 0x55e0f37fa580 2023-07-14T13:27:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.374+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/2290012507 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcc280c9080 con 0x55e0f37fa580 2023-07-14T13:27:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.374+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2290012507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc3800fd20 con 0x55e0f37fa580 2023-07-14T13:27:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.375+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/2290012507 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc280094e0 con 0x55e0f37fa580 2023-07-14T13:27:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.375+0000 7fcc5a075b80 10 client.29290 fetch_fsmap learned FSMap version 65 2023-07-14T13:27:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.375+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2290012507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55e0f3578250 con 0x55e0f37fa580 2023-07-14T13:27:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.375+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/2290012507 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc3800fd20 con 0x55e0f37fa580 2023-07-14T13:27:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.375+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/2290012507 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 65) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fcc28099540 con 0x55e0f37fa580 2023-07-14T13:27:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.376+0000 7fcc5a075b80 10 client.29290 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:27:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.376+0000 7fcc5a075b80 10 client.29290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:27:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.376+0000 7fcc5a075b80 20 client.29290 populate_metadata read hostname 'smithi017' 2023-07-14T13:27:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.376+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0f3868420 0x55e0f386a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.376+0000 7fcc5a075b80 4 client.29290 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:27:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.376+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2290012507 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e0f3706ff0 con 0x55e0f3868420 2023-07-14T13:27:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.376+0000 7fcc3ffff700 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0f3868420 0x55e0f386a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.378+0000 7fcc3ffff700 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0f3868420 0x55e0f386a800 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e9a86732b79c1ff server_cookie=732396d5fe7ada35 in_seq=0 out_seq=0 2023-07-14T13:27:39.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.378+0000 7fcc1f7fe700 10 client.29290 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:39.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.417+0000 7fcc1f7fe700 1 -- 172.21.15.17:0/2290012507 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e0f3706ff0 con 0x55e0f3868420 2023-07-14T13:27:39.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.417+0000 7fcc1f7fe700 10 client.29290 handle_command_reply: tid=0 2023-07-14T13:27:39.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.417+0000 7fcc5a075b80 1 client.29290 shutdown 2023-07-14T13:27:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.419+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2290012507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f37fa580 msgr2=0x55e0f3809190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.419+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f37fa580 0x55e0f3809190 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fcc280a22b0 tx=0x7fcc28004ad0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.419+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2290012507 shutdown_connections 2023-07-14T13:27:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.419+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e0f3868420 0x55e0f386a800 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.419+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e0f38002d0 0x55e0f3866bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.419+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0f36566b0 0x55e0f3808c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.419+0000 7fcc5a075b80 1 --2- 172.21.15.17:0/2290012507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e0f37fa580 0x55e0f3809190 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.419+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2290012507 >> 172.21.15.17:0/2290012507 conn(0x55e0f37efbe0 msgr2=0x55e0f37feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.419+0000 7fcc1f7fe700 0 client.29290 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.419+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2290012507 shutdown_connections 2023-07-14T13:27:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.419+0000 7fcc5a075b80 1 -- 172.21.15.17:0/2290012507 wait complete. 2023-07-14T13:27:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.420+0000 7fcc5a075b80 20 client.29290 trim_cache size 0 max 16384 2023-07-14T13:27:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:27:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:27:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:27:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:27:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.422+0000 7fcc467ff700 1 -- 172.21.15.17:0/778379965 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcc2c0a1490 msgr2=0x7fcc2c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.422+0000 7fcc467ff700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcc2c0a1490 0x7fcc2c0a3940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x55e0f37f6b40 tx=0x7fcc30005e00 comp rx=0 tx=0).stop 2023-07-14T13:27:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.422+0000 7fcc467ff700 1 -- 172.21.15.17:0/778379965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc40075350 msgr2=0x7fcc4019c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.422+0000 7fcc467ff700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc40075350 0x7fcc4019c700 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800ef10 tx=0x7fcc2800c3a0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.424+0000 7fcc467ff700 1 -- 172.21.15.17:0/778379965 shutdown_connections 2023-07-14T13:27:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.424+0000 7fcc467ff700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcc2c0a1490 0x7fcc2c0a3940 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.424+0000 7fcc467ff700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc401109a0 0x7fcc401a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.424+0000 7fcc467ff700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40074a40 0x7fcc4019c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.424+0000 7fcc467ff700 1 --2- 172.21.15.17:0/778379965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc40075350 0x7fcc4019c700 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.424+0000 7fcc467ff700 1 -- 172.21.15.17:0/778379965 >> 172.21.15.17:0/778379965 conn(0x7fcc400fd7e0 msgr2=0x7fcc40111600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.424+0000 7fcc467ff700 1 -- 172.21.15.17:0/778379965 shutdown_connections 2023-07-14T13:27:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:39.424+0000 7fcc467ff700 1 -- 172.21.15.17:0/778379965 wait complete. 2023-07-14T13:27:39.925 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:39 smithi135 ceph-mon[97338]: pgmap v884: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.6 MiB/s wr, 806 op/s 2023-07-14T13:27:39.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:39 smithi131 ceph-mon[96953]: pgmap v884: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.6 MiB/s wr, 806 op/s 2023-07-14T13:27:40.082 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:39 smithi017 ceph-mon[95536]: pgmap v884: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.6 MiB/s wr, 806 op/s 2023-07-14T13:27:41.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:41 smithi135 ceph-mon[97338]: pgmap v885: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.4 MiB/s wr, 872 op/s 2023-07-14T13:27:41.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:41 smithi131 ceph-mon[96953]: pgmap v885: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.4 MiB/s wr, 872 op/s 2023-07-14T13:27:42.086 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:41 smithi017 ceph-mon[95536]: pgmap v885: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 9.4 MiB/s wr, 872 op/s 2023-07-14T13:27:42.425 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 570.0 s, 575.3 tps, lat 172.963 ms stddev 58.734 2023-07-14T13:27:43.924 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:43 smithi135 ceph-mon[97338]: pgmap v886: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-07-14T13:27:43.985 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:43 smithi131 ceph-mon[96953]: pgmap v886: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-07-14T13:27:44.083 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:43 smithi017 ceph-mon[95536]: pgmap v886: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-07-14T13:27:45.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:45 smithi135 ceph-mon[97338]: pgmap v887: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-14T13:27:45.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:45 smithi131 ceph-mon[96953]: pgmap v887: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-14T13:27:46.087 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:45 smithi017 ceph-mon[95536]: pgmap v887: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-14T13:27:47.424 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 575.0 s, 503.7 tps, lat 197.536 ms stddev 115.710 2023-07-14T13:27:47.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:47 smithi135 ceph-mon[97338]: pgmap v888: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 19 MiB/s wr, 1.64k op/s 2023-07-14T13:27:47.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:47 smithi131 ceph-mon[96953]: pgmap v888: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 19 MiB/s wr, 1.64k op/s 2023-07-14T13:27:48.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:47 smithi017 ceph-mon[95536]: pgmap v888: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 19 MiB/s wr, 1.64k op/s 2023-07-14T13:27:48.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:48 smithi135 ceph-mon[97338]: pgmap v889: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-07-14T13:27:48.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:48 smithi131 ceph-mon[96953]: pgmap v889: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-07-14T13:27:49.085 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:48 smithi017 ceph-mon[95536]: pgmap v889: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-07-14T13:27:51.832 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:51 smithi017 ceph-mon[95536]: pgmap v890: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-07-14T13:27:51.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:51 smithi135 ceph-mon[97338]: pgmap v890: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-07-14T13:27:51.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:51 smithi131 ceph-mon[96953]: pgmap v890: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-07-14T13:27:52.424 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 580.0 s, 541.8 tps, lat 186.954 ms stddev 71.084 2023-07-14T13:27:52.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.692+0000 7fe9b47ff700 1 -- 172.21.15.17:0/340550293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9ac105b10 msgr2=0x7fe9ac105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:52.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.692+0000 7fe9b47ff700 1 --2- 172.21.15.17:0/340550293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9ac105b10 0x7fe9ac105ee0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009990 tx=0x7fe9a8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.692+0000 7fe9b47ff700 1 -- 172.21.15.17:0/340550293 shutdown_connections 2023-07-14T13:27:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.692+0000 7fe9b47ff700 1 --2- 172.21.15.17:0/340550293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac1004b0 0x7fe9ac10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.692+0000 7fe9b47ff700 1 --2- 172.21.15.17:0/340550293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9ac105b10 0x7fe9ac105ee0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.692+0000 7fe9b47ff700 1 --2- 172.21.15.17:0/340550293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9ac0ffb00 0x7fe9ac0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.692+0000 7fe9b47ff700 1 -- 172.21.15.17:0/340550293 >> 172.21.15.17:0/340550293 conn(0x7fe9ac0fb600 msgr2=0x7fe9ac0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.692+0000 7fe9b47ff700 1 -- 172.21.15.17:0/340550293 shutdown_connections 2023-07-14T13:27:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.692+0000 7fe9b47ff700 1 -- 172.21.15.17:0/340550293 wait complete. 2023-07-14T13:27:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.693+0000 7fe9b47ff700 1 Processor -- start 2023-07-14T13:27:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.694+0000 7fe9b47ff700 1 -- start start 2023-07-14T13:27:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.694+0000 7fe9b47ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac0ffb00 0x7fe9ac197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.694+0000 7fe9b47ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9ac1004b0 0x7fe9ac198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.694+0000 7fe9b47ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9ac105b10 0x7fe9ac19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.694+0000 7fe9b47ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac19cf40 con 0x7fe9ac0ffb00 2023-07-14T13:27:52.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.694+0000 7fe9b47ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac19d0b0 con 0x7fe9ac1004b0 2023-07-14T13:27:52.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.694+0000 7fe9b47ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac19d270 con 0x7fe9ac105b10 2023-07-14T13:27:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.695+0000 7fe9b1d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9ac1004b0 0x7fe9ac198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.695+0000 7fe9b1d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9ac1004b0 0x7fe9ac198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44200/0 (socket says 172.21.15.17:44200) 2023-07-14T13:27:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.695+0000 7fe9b1d9a700 1 -- 172.21.15.17:0/1190177162 learned_addr learned my addr 172.21.15.17:0/1190177162 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.695+0000 7fe9b2d9c700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9ac105b10 0x7fe9ac19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.695+0000 7fe9b259b700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac0ffb00 0x7fe9ac197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.696+0000 7fe9b1d9a700 1 -- 172.21.15.17:0/1190177162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9ac105b10 msgr2=0x7fe9ac19c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.696+0000 7fe9b1d9a700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9ac105b10 0x7fe9ac19c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.696+0000 7fe9b1d9a700 1 -- 172.21.15.17:0/1190177162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac0ffb00 msgr2=0x7fe9ac197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.696+0000 7fe9b1d9a700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac0ffb00 0x7fe9ac197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.696+0000 7fe9b1d9a700 1 -- 172.21.15.17:0/1190177162 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a80095f0 con 0x7fe9ac1004b0 2023-07-14T13:27:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.696+0000 7fe9b1d9a700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9ac1004b0 0x7fe9ac198290 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00e9a0 tx=0x7fe99c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.697+0000 7fe9a37fe700 1 -- 172.21.15.17:0/1190177162 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c00cbd0 con 0x7fe9ac1004b0 2023-07-14T13:27:52.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.697+0000 7fe9a37fe700 1 -- 172.21.15.17:0/1190177162 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe99c00cd30 con 0x7fe9ac1004b0 2023-07-14T13:27:52.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.697+0000 7fe9b47ff700 1 -- 172.21.15.17:0/1190177162 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ac19d550 con 0x7fe9ac1004b0 2023-07-14T13:27:52.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.697+0000 7fe9a37fe700 1 -- 172.21.15.17:0/1190177162 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c018680 con 0x7fe9ac1004b0 2023-07-14T13:27:52.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.697+0000 7fe9b47ff700 1 -- 172.21.15.17:0/1190177162 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac106ab0 con 0x7fe9ac1004b0 2023-07-14T13:27:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.703+0000 7fe9a37fe700 1 -- 172.21.15.17:0/1190177162 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe99c0187e0 con 0x7fe9ac1004b0 2023-07-14T13:27:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.704+0000 7fe9c8181b80 1 Processor -- start 2023-07-14T13:27:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.704+0000 7fe9c8181b80 1 -- start start 2023-07-14T13:27:52.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.705+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c320d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.710 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.705+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c3212d0 0x555e3c31b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.705+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 0x555e3c31b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.705+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c220c50 con 0x555e3c1776b0 2023-07-14T13:27:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.705+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c2739e0 con 0x555e3c31b580 2023-07-14T13:27:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.705+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c26ce70 con 0x555e3c3212d0 2023-07-14T13:27:52.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.705+0000 7fe9b1d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 0x555e3c31b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.706+0000 7fe9b1d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 0x555e3c31b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44202/0 (socket says 172.21.15.17:44202) 2023-07-14T13:27:52.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.706+0000 7fe9b1d9a700 1 -- 172.21.15.17:0/1867349391 learned_addr learned my addr 172.21.15.17:0/1867349391 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:52.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.706+0000 7fe9b1d9a700 1 -- 172.21.15.17:0/1867349391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c3212d0 msgr2=0x555e3c31b040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:27:52.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.706+0000 7fe9b1d9a700 1 --2- 172.21.15.17:0/1867349391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c3212d0 0x555e3c31b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.706+0000 7fe9b1d9a700 1 -- 172.21.15.17:0/1867349391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 msgr2=0x555e3c320d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:52.712 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.706+0000 7fe9b1d9a700 1 --2- 172.21.15.17:0/1867349391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c320d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.706+0000 7fe9b1d9a700 1 -- 172.21.15.17:0/1867349391 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e3c09ad80 con 0x555e3c31b580 2023-07-14T13:27:52.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.707+0000 7fe9b1d9a700 1 --2- 172.21.15.17:0/1867349391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 0x555e3c31b9d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0ca660 tx=0x7fe99c0d53c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22f879b1c219a8fa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:52.713 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.707+0000 7fe9a37fe700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe9980a1340 0x7fe9980a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.707+0000 7fe9a0ff9700 1 -- 172.21.15.17:0/1867349391 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c0d0e80 con 0x555e3c31b580 2023-07-14T13:27:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.708+0000 7fe9a37fe700 1 -- 172.21.15.17:0/1190177162 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe99c014070 con 0x7fe9ac1004b0 2023-07-14T13:27:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.708+0000 7fe9b2d9c700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe9980a1340 0x7fe9980a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.708+0000 7fe9a0ff9700 1 -- 172.21.15.17:0/1867349391 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe99c0963e0 con 0x555e3c31b580 2023-07-14T13:27:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.708+0000 7fe9a0ff9700 1 -- 172.21.15.17:0/1867349391 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c099a00 con 0x555e3c31b580 2023-07-14T13:27:52.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.709+0000 7fe9c8181b80 1 -- 172.21.15.17:0/1867349391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 msgr2=0x555e3c31b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:52.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.709+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/1867349391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 0x555e3c31b9d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0ca660 tx=0x7fe99c0d53c0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.709+0000 7fe9c8181b80 1 -- 172.21.15.17:0/1867349391 shutdown_connections 2023-07-14T13:27:52.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.709+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/1867349391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 0x555e3c31b9d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.709+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/1867349391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c320d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.709+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/1867349391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c3212d0 0x555e3c31b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.709+0000 7fe9c8181b80 1 -- 172.21.15.17:0/1867349391 >> 172.21.15.17:0/1867349391 conn(0x555e3c310be0 msgr2=0x555e3c315f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.709+0000 7fe9b2d9c700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe9980a1340 0x7fe9980a37f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009360 tx=0x7fe9a4009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.710+0000 7fe9c8181b80 1 -- 172.21.15.17:0/1867349391 shutdown_connections 2023-07-14T13:27:52.716 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.710+0000 7fe9c8181b80 1 -- 172.21.15.17:0/1867349391 wait complete. 2023-07-14T13:27:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.711+0000 7fe9c8181b80 1 -- start start 2023-07-14T13:27:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.711+0000 7fe9c8181b80 1 Processor -- start 2023-07-14T13:27:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.711+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c1776b0 0x555e3c327570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.712+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c31b580 0x555e3c324860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.712+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 0x555e3c324ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.712+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c20ca60 con 0x555e3c31b580 2023-07-14T13:27:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.712+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c20c760 con 0x555e3c3212d0 2023-07-14T13:27:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.712+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c0f08c0 con 0x555e3c1776b0 2023-07-14T13:27:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.712+0000 7fe9c8181b80 10 client.0 _ll_register_callbacks cb 0x555e3c20a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:27:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.712+0000 7fe9b2d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 0x555e3c324ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.712+0000 7fe9b2d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 0x555e3c324ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44208/0 (socket says 172.21.15.17:44208) 2023-07-14T13:27:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.712+0000 7fe9b2d9c700 1 -- 172.21.15.17:0/3658500705 learned_addr learned my addr 172.21.15.17:0/3658500705 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.712+0000 7fe9b259b700 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c1776b0 0x555e3c327570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.713+0000 7fe9b1d9a700 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c31b580 0x555e3c324860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.713+0000 7fe9b2d9c700 1 -- 172.21.15.17:0/3658500705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c1776b0 msgr2=0x555e3c327570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.713+0000 7fe9b2d9c700 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c1776b0 0x555e3c327570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.713+0000 7fe9b2d9c700 1 -- 172.21.15.17:0/3658500705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c31b580 msgr2=0x555e3c324860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.713+0000 7fe9b2d9c700 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c31b580 0x555e3c324860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.713+0000 7fe9b2d9c700 1 -- 172.21.15.17:0/3658500705 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac106ab0 con 0x555e3c3212d0 2023-07-14T13:27:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.714+0000 7fe9b2d9c700 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 0x555e3c324ee0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40159c0 tx=0x7fe9a4004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339620a63c1b5bd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.714+0000 7fe995ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:27:52.724 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.715+0000 7fe995ffb700 1 -- 172.21.15.17:0/3658500705 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a400e050 con 0x555e3c3212d0 2023-07-14T13:27:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.715+0000 7fe995ffb700 1 -- 172.21.15.17:0/3658500705 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe9a4016a80 con 0x555e3c3212d0 2023-07-14T13:27:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.715+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3658500705 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e3c1c6490 con 0x555e3c3212d0 2023-07-14T13:27:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.715+0000 7fe995ffb700 1 -- 172.21.15.17:0/3658500705 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9a4016c40 con 0x555e3c3212d0 2023-07-14T13:27:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.715+0000 7fe9c8181b80 10 client.29345 fetch_fsmap learned FSMap version 65 2023-07-14T13:27:52.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.715+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3658500705 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x555e3c083c00 con 0x555e3c3212d0 2023-07-14T13:27:52.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.716+0000 7fe995ffb700 1 -- 172.21.15.17:0/3658500705 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555e3c1c6490 con 0x555e3c3212d0 2023-07-14T13:27:52.726 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.716+0000 7fe995ffb700 1 -- 172.21.15.17:0/3658500705 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 65) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe9a40203a0 con 0x555e3c3212d0 2023-07-14T13:27:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.716+0000 7fe9c8181b80 10 client.29345 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:27:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.716+0000 7fe9c8181b80 10 client.29345 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:27:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.716+0000 7fe9c8181b80 20 client.29345 populate_metadata read hostname 'smithi017' 2023-07-14T13:27:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.716+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e3c334cb0 0x555e3c3370c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.716+0000 7fe9c8181b80 4 client.29345 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:27:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.716+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3658500705 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e3c265e50 con 0x555e3c334cb0 2023-07-14T13:27:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.717+0000 7fe9b259b700 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e3c334cb0 0x555e3c3370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.718+0000 7fe9b259b700 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e3c334cb0 0x555e3c3370c0 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbc41335dc85a186 server_cookie=9e47bcff7675ce41 in_seq=0 out_seq=0 2023-07-14T13:27:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.718+0000 7fe995ffb700 10 client.29345 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.719+0000 7fe995ffb700 1 -- 172.21.15.17:0/3658500705 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555e3c265e50 con 0x555e3c334cb0 2023-07-14T13:27:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.719+0000 7fe995ffb700 10 client.29345 handle_command_reply: tid=0 2023-07-14T13:27:52.729 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.719+0000 7fe9c8181b80 1 client.29345 shutdown 2023-07-14T13:27:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.720+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3658500705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 msgr2=0x555e3c324ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:52.730 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.720+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 0x555e3c324ee0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40159c0 tx=0x7fe9a4004b40 comp rx=0 tx=0).stop 2023-07-14T13:27:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.725+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3658500705 shutdown_connections 2023-07-14T13:27:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.725+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e3c334cb0 0x555e3c3370c0 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.725+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 0x555e3c324ee0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.725+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c1776b0 0x555e3c327570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.725+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3658500705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c31b580 0x555e3c324860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.725+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3658500705 >> 172.21.15.17:0/3658500705 conn(0x555e3c310be0 msgr2=0x555e3c314c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.725+0000 7fe995ffb700 0 client.29345 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:52.733 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.727+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3658500705 shutdown_connections 2023-07-14T13:27:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.728+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3658500705 wait complete. 2023-07-14T13:27:52.734 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.729+0000 7fe9c8181b80 20 client.29345 trim_cache size 0 max 16384 2023-07-14T13:27:52.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.759+0000 7fe9c8181b80 1 Processor -- start 2023-07-14T13:27:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.759+0000 7fe9c8181b80 1 -- start start 2023-07-14T13:27:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.760+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c31b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.760+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c31b580 0x555e3c320100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.760+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 0x555e3c315c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.760+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c317970 con 0x555e3c1776b0 2023-07-14T13:27:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.760+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c317720 con 0x555e3c3212d0 2023-07-14T13:27:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.760+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c322dc0 con 0x555e3c31b580 2023-07-14T13:27:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.762+0000 7fe9b259b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c31b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.762+0000 7fe9b1d9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c31b580 0x555e3c320100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.762+0000 7fe9b259b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c31b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40856/0 (socket says 172.21.15.17:40856) 2023-07-14T13:27:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.762+0000 7fe9b259b700 1 -- 172.21.15.17:0/4144342636 learned_addr learned my addr 172.21.15.17:0/4144342636 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.763+0000 7fe9b2d9c700 1 --2- 172.21.15.17:0/4144342636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 0x555e3c315c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.763+0000 7fe9b2d9c700 1 -- 172.21.15.17:0/4144342636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c31b580 msgr2=0x555e3c320100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.763+0000 7fe9b2d9c700 1 --2- 172.21.15.17:0/4144342636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c31b580 0x555e3c320100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.763+0000 7fe9b2d9c700 1 -- 172.21.15.17:0/4144342636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 msgr2=0x555e3c31b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.763+0000 7fe9b2d9c700 1 --2- 172.21.15.17:0/4144342636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c31b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.763+0000 7fe9b2d9c700 1 -- 172.21.15.17:0/4144342636 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e3c0c11f0 con 0x555e3c3212d0 2023-07-14T13:27:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.763+0000 7fe9b259b700 1 --2- 172.21.15.17:0/4144342636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c31b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:27:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.765+0000 7fe9b2d9c700 1 --2- 172.21.15.17:0/4144342636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 0x555e3c315c60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40166d0 tx=0x7fe9a4007b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8650c03225b379c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:52.772 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.765+0000 7fe9a17fa700 1 -- 172.21.15.17:0/4144342636 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a400e070 con 0x555e3c3212d0 2023-07-14T13:27:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.765+0000 7fe9a17fa700 1 -- 172.21.15.17:0/4144342636 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9a401a070 con 0x555e3c3212d0 2023-07-14T13:27:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.765+0000 7fe9a17fa700 1 -- 172.21.15.17:0/4144342636 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a402b450 con 0x555e3c3212d0 2023-07-14T13:27:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.766+0000 7fe9c8181b80 1 -- 172.21.15.17:0/4144342636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 msgr2=0x555e3c315c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.766+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/4144342636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 0x555e3c315c60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40166d0 tx=0x7fe9a4007b70 comp rx=0 tx=0).stop 2023-07-14T13:27:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.768+0000 7fe9c8181b80 1 -- 172.21.15.17:0/4144342636 shutdown_connections 2023-07-14T13:27:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.768+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/4144342636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c3212d0 0x555e3c315c60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.768+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/4144342636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c31b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.768+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/4144342636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c31b580 0x555e3c320100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.768+0000 7fe9c8181b80 1 -- 172.21.15.17:0/4144342636 >> 172.21.15.17:0/4144342636 conn(0x555e3c310be0 msgr2=0x555e3c31f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.771+0000 7fe9c8181b80 1 -- 172.21.15.17:0/4144342636 shutdown_connections 2023-07-14T13:27:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.771+0000 7fe9c8181b80 1 -- 172.21.15.17:0/4144342636 wait complete. 2023-07-14T13:27:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.772+0000 7fe9c8181b80 1 -- start start 2023-07-14T13:27:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.773+0000 7fe9c8181b80 1 Processor -- start 2023-07-14T13:27:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.774+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c32b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.774+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 0x555e3c329cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.774+0000 7fe9c8181b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c3212d0 0x555e3c32a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.774+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c32c2c0 con 0x555e3c1776b0 2023-07-14T13:27:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.774+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c32a770 con 0x555e3c31b580 2023-07-14T13:27:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.774+0000 7fe9c8181b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e3c32a930 con 0x555e3c3212d0 2023-07-14T13:27:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.774+0000 7fe9c8181b80 10 client.0 _ll_register_callbacks cb 0x7fe9a4007f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:27:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.775+0000 7fe9b2d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c3212d0 0x555e3c32a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.775+0000 7fe9b2d9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c3212d0 0x555e3c32a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52678/0 (socket says 172.21.15.17:52678) 2023-07-14T13:27:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.775+0000 7fe9b2d9c700 1 -- 172.21.15.17:0/3589965933 learned_addr learned my addr 172.21.15.17:0/3589965933 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:27:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.775+0000 7fe9b1d9a700 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 0x555e3c329cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.775+0000 7fe9b259b700 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c32b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.777+0000 7fe9b1d9a700 1 -- 172.21.15.17:0/3589965933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c3212d0 msgr2=0x555e3c32a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.777+0000 7fe9b1d9a700 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c3212d0 0x555e3c32a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.777+0000 7fe9b1d9a700 1 -- 172.21.15.17:0/3589965933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 msgr2=0x555e3c32b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:27:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.777+0000 7fe9b1d9a700 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c32b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.777+0000 7fe9b1d9a700 1 -- 172.21.15.17:0/3589965933 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac10d240 con 0x555e3c31b580 2023-07-14T13:27:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.778+0000 7fe9b1d9a700 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 0x555e3c329cf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0ca660 tx=0x7fe99c0d0930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=989081978c186454 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:27:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.779+0000 7fe995ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:27:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.779+0000 7fe995ffb700 1 -- 172.21.15.17:0/3589965933 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c0d03f0 con 0x555e3c31b580 2023-07-14T13:27:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.780+0000 7fe995ffb700 1 -- 172.21.15.17:0/3589965933 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe99c09a0a0 con 0x555e3c31b580 2023-07-14T13:27:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.780+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3589965933 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe99c0963e0 con 0x555e3c31b580 2023-07-14T13:27:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.782+0000 7fe995ffb700 1 -- 172.21.15.17:0/3589965933 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe99c099a00 con 0x555e3c31b580 2023-07-14T13:27:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.782+0000 7fe9c8181b80 10 client.29351 fetch_fsmap learned FSMap version 65 2023-07-14T13:27:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.782+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3589965933 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x555e3c083c00 con 0x555e3c31b580 2023-07-14T13:27:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.783+0000 7fe995ffb700 1 -- 172.21.15.17:0/3589965933 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe99c0963e0 con 0x555e3c31b580 2023-07-14T13:27:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.783+0000 7fe995ffb700 1 -- 172.21.15.17:0/3589965933 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 65) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe99c0d5c60 con 0x555e3c31b580 2023-07-14T13:27:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.783+0000 7fe9c8181b80 10 client.29351 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:27:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.783+0000 7fe9c8181b80 10 client.29351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:27:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.783+0000 7fe9c8181b80 20 client.29351 populate_metadata read hostname 'smithi017' 2023-07-14T13:27:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.784+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e3c383bb0 0x555e3c383fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:27:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.784+0000 7fe9c8181b80 4 client.29351 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:27:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.784+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3589965933 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555e3c227ff0 con 0x555e3c383bb0 2023-07-14T13:27:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.785+0000 7fe9b259b700 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e3c383bb0 0x555e3c383fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:27:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.787+0000 7fe9b259b700 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e3c383bb0 0x555e3c383fb0 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c2321be3c6cab7e server_cookie=128b299a92846ad5 in_seq=0 out_seq=0 2023-07-14T13:27:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.787+0000 7fe995ffb700 10 client.29351 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.842+0000 7fe995ffb700 1 -- 172.21.15.17:0/3589965933 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555e3c227ff0 con 0x555e3c383bb0 2023-07-14T13:27:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.842+0000 7fe995ffb700 10 client.29351 handle_command_reply: tid=0 2023-07-14T13:27:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.846+0000 7fe9c8181b80 1 client.29351 shutdown 2023-07-14T13:27:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.846+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3589965933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 msgr2=0x555e3c329cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.846+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 0x555e3c329cf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0ca660 tx=0x7fe99c0d0930 comp rx=0 tx=0).stop 2023-07-14T13:27:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.848+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3589965933 shutdown_connections 2023-07-14T13:27:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.848+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x555e3c383bb0 0x555e3c383fb0 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.848+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555e3c3212d0 0x555e3c32a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.848+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x555e3c1776b0 0x555e3c32b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.848+0000 7fe9c8181b80 1 --2- 172.21.15.17:0/3589965933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555e3c31b580 0x555e3c329cf0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.848+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3589965933 >> 172.21.15.17:0/3589965933 conn(0x555e3c310be0 msgr2=0x555e3c326990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.849+0000 7fe995ffb700 0 client.29351 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:27:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.850+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3589965933 shutdown_connections 2023-07-14T13:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.850+0000 7fe9c8181b80 1 -- 172.21.15.17:0/3589965933 wait complete. 2023-07-14T13:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.851+0000 7fe9c8181b80 20 client.29351 trim_cache size 0 max 16384 2023-07-14T13:27:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:27:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:27:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:27:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:27:52.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.852+0000 7fe9b47ff700 1 -- 172.21.15.17:0/1190177162 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe9980a1340 msgr2=0x7fe9980a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.852+0000 7fe9b47ff700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe9980a1340 0x7fe9980a37f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009360 tx=0x7fe9a4009920 comp rx=0 tx=0).stop 2023-07-14T13:27:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.852+0000 7fe9b47ff700 1 -- 172.21.15.17:0/1190177162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9ac1004b0 msgr2=0x7fe9ac198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:27:52.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.852+0000 7fe9b47ff700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9ac1004b0 0x7fe9ac198290 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00e9a0 tx=0x7fe99c00ed60 comp rx=0 tx=0).stop 2023-07-14T13:27:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.853+0000 7fe9b47ff700 1 -- 172.21.15.17:0/1190177162 shutdown_connections 2023-07-14T13:27:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.853+0000 7fe9b47ff700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe9980a1340 0x7fe9980a37f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.853+0000 7fe9b47ff700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9ac105b10 0x7fe9ac19c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.853+0000 7fe9b47ff700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9ac0ffb00 0x7fe9ac197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.853+0000 7fe9b47ff700 1 --2- 172.21.15.17:0/1190177162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9ac1004b0 0x7fe9ac198290 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:27:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.853+0000 7fe9b47ff700 1 -- 172.21.15.17:0/1190177162 >> 172.21.15.17:0/1190177162 conn(0x7fe9ac0fb600 msgr2=0x7fe9ac10aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.853+0000 7fe9b47ff700 1 -- 172.21.15.17:0/1190177162 shutdown_connections 2023-07-14T13:27:52.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:27:52.853+0000 7fe9b47ff700 1 -- 172.21.15.17:0/1190177162 wait complete. 2023-07-14T13:27:53.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:53 smithi017 ceph-mon[95536]: pgmap v891: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 1.59k op/s 2023-07-14T13:27:53.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:53 smithi135 ceph-mon[97338]: pgmap v891: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 1.59k op/s 2023-07-14T13:27:53.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:53 smithi131 ceph-mon[96953]: pgmap v891: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 18 MiB/s wr, 1.59k op/s 2023-07-14T13:27:55.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:55 smithi017 ceph-mon[95536]: pgmap v892: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.13k op/s 2023-07-14T13:27:55.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:55 smithi135 ceph-mon[97338]: pgmap v892: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.13k op/s 2023-07-14T13:27:55.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:55 smithi131 ceph-mon[96953]: pgmap v892: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.13k op/s 2023-07-14T13:27:57.425 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 585.0 s, 627.1 tps, lat 160.970 ms stddev 70.515 2023-07-14T13:27:57.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:57 smithi017 ceph-mon[95536]: pgmap v893: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 19 MiB/s wr, 1.65k op/s 2023-07-14T13:27:57.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:57 smithi135 ceph-mon[97338]: pgmap v893: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 19 MiB/s wr, 1.65k op/s 2023-07-14T13:27:57.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:57 smithi131 ceph-mon[96953]: pgmap v893: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 19 MiB/s wr, 1.65k op/s 2023-07-14T13:27:59.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:27:59 smithi017 ceph-mon[95536]: pgmap v894: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 12 MiB/s wr, 1.11k op/s 2023-07-14T13:27:59.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:27:59 smithi135 ceph-mon[97338]: pgmap v894: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 12 MiB/s wr, 1.11k op/s 2023-07-14T13:27:59.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:27:59 smithi131 ceph-mon[96953]: pgmap v894: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 12 MiB/s wr, 1.11k op/s 2023-07-14T13:28:01.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:01 smithi135 ceph-mon[97338]: pgmap v895: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-07-14T13:28:01.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:01 smithi131 ceph-mon[96953]: pgmap v895: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-07-14T13:28:02.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:01 smithi017 ceph-mon[95536]: pgmap v895: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-07-14T13:28:02.424 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 590.0 s, 264.8 tps, lat 329.321 ms stddev 451.358 2023-07-14T13:28:03.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:03 smithi135 ceph-mon[97338]: pgmap v896: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.53k op/s 2023-07-14T13:28:03.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:03 smithi131 ceph-mon[96953]: pgmap v896: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.53k op/s 2023-07-14T13:28:04.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:03 smithi017 ceph-mon[95536]: pgmap v896: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 17 MiB/s wr, 1.53k op/s 2023-07-14T13:28:05.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:05 smithi135 ceph-mon[97338]: pgmap v897: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.01k op/s 2023-07-14T13:28:05.924 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:05 smithi135 ceph-mon[97338]: osdmap e134: 12 total, 12 up, 12 in 2023-07-14T13:28:05.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:05 smithi131 ceph-mon[96953]: pgmap v897: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.01k op/s 2023-07-14T13:28:05.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:05 smithi131 ceph-mon[96953]: osdmap e134: 12 total, 12 up, 12 in 2023-07-14T13:28:06.082 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:05 smithi017 ceph-mon[95536]: pgmap v897: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 1.01k op/s 2023-07-14T13:28:06.082 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:05 smithi017 ceph-mon[95536]: osdmap e134: 12 total, 12 up, 12 in 2023-07-14T13:28:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.157+0000 7fb3321ff700 1 -- 172.21.15.17:0/3719007437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c104a60 msgr2=0x7fb32c0679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:06.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.157+0000 7fb3321ff700 1 --2- 172.21.15.17:0/3719007437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c104a60 0x7fb32c0679a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb324009990 tx=0x7fb324009ca0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.169 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.163+0000 7fb3321ff700 1 -- 172.21.15.17:0/3719007437 shutdown_connections 2023-07-14T13:28:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.163+0000 7fb3321ff700 1 --2- 172.21.15.17:0/3719007437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb32c1024f0 0x7fb32c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.163+0000 7fb3321ff700 1 --2- 172.21.15.17:0/3719007437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c104a60 0x7fb32c0679a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.163+0000 7fb3321ff700 1 --2- 172.21.15.17:0/3719007437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb32c067ee0 0x7fb32c068350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.170 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.163+0000 7fb3321ff700 1 -- 172.21.15.17:0/3719007437 >> 172.21.15.17:0/3719007437 conn(0x7fb32c074760 msgr2=0x7fb32c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.166+0000 7fb3321ff700 1 -- 172.21.15.17:0/3719007437 shutdown_connections 2023-07-14T13:28:06.175 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.171+0000 7fb3321ff700 1 -- 172.21.15.17:0/3719007437 wait complete. 2023-07-14T13:28:06.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.173+0000 7fb3321ff700 1 Processor -- start 2023-07-14T13:28:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.182+0000 7fb3321ff700 1 -- start start 2023-07-14T13:28:06.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.182+0000 7fb3321ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c067ee0 0x7fb32c112bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.182+0000 7fb3321ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb32c1024f0 0x7fb32c113100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.182+0000 7fb3321ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb32c104a60 0x7fb32c10b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.182+0000 7fb3321ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c10c180 con 0x7fb32c1024f0 2023-07-14T13:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.183+0000 7fb3321ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c10c2f0 con 0x7fb32c067ee0 2023-07-14T13:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.183+0000 7fb3321ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c10c4b0 con 0x7fb32c104a60 2023-07-14T13:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.183+0000 7fb32b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c067ee0 0x7fb32c112bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.183+0000 7fb32bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb32c104a60 0x7fb32c10b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.183+0000 7fb32bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb32c104a60 0x7fb32c10b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48516/0 (socket says 172.21.15.17:48516) 2023-07-14T13:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.183+0000 7fb32bfff700 1 -- 172.21.15.17:0/522208702 learned_addr learned my addr 172.21.15.17:0/522208702 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.183+0000 7fb32affd700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb32c1024f0 0x7fb32c113100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.184+0000 7fb32affd700 1 -- 172.21.15.17:0/522208702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb32c104a60 msgr2=0x7fb32c10b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.184+0000 7fb32affd700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb32c104a60 0x7fb32c10b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.184+0000 7fb32affd700 1 -- 172.21.15.17:0/522208702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c067ee0 msgr2=0x7fb32c112bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.184+0000 7fb32affd700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c067ee0 0x7fb32c112bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.184+0000 7fb32affd700 1 -- 172.21.15.17:0/522208702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3240095f0 con 0x7fb32c1024f0 2023-07-14T13:28:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.186+0000 7fb32affd700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb32c1024f0 0x7fb32c113100 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fb31400e9f0 tx=0x7fb31400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.195+0000 7fb328ff9700 1 -- 172.21.15.17:0/522208702 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31400eee0 con 0x7fb32c1024f0 2023-07-14T13:28:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.195+0000 7fb328ff9700 1 -- 172.21.15.17:0/522208702 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb31400cbd0 con 0x7fb32c1024f0 2023-07-14T13:28:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.195+0000 7fb328ff9700 1 -- 172.21.15.17:0/522208702 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314018680 con 0x7fb32c1024f0 2023-07-14T13:28:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.196+0000 7fb3321ff700 1 -- 172.21.15.17:0/522208702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32c10c790 con 0x7fb32c1024f0 2023-07-14T13:28:06.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.196+0000 7fb3321ff700 1 -- 172.21.15.17:0/522208702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32c110a10 con 0x7fb32c1024f0 2023-07-14T13:28:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.202+0000 7fb345b2eb80 1 Processor -- start 2023-07-14T13:28:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.203+0000 7fb345b2eb80 1 -- start start 2023-07-14T13:28:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.203+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 0x55b47dbeed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.203+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbe9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.203+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47dbe9580 0x55b47dbe99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.203+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47daeec50 con 0x55b47da456b0 2023-07-14T13:28:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.203+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47db419e0 con 0x55b47dbef2d0 2023-07-14T13:28:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.203+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47db3ae70 con 0x55b47dbe9580 2023-07-14T13:28:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.206+0000 7fb32bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 0x55b47dbeed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.206+0000 7fb32bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 0x55b47dbeed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55584/0 (socket says 172.21.15.17:55584) 2023-07-14T13:28:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.206+0000 7fb32bfff700 1 -- 172.21.15.17:0/2954803847 learned_addr learned my addr 172.21.15.17:0/2954803847 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.206+0000 7fb32affd700 1 --2- 172.21.15.17:0/2954803847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47dbe9580 0x55b47dbe99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.207+0000 7fb328ff9700 1 -- 172.21.15.17:0/522208702 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb31400cd40 con 0x7fb32c1024f0 2023-07-14T13:28:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.207+0000 7fb32bfff700 1 -- 172.21.15.17:0/2954803847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47dbe9580 msgr2=0x55b47dbe99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.207+0000 7fb32bfff700 1 --2- 172.21.15.17:0/2954803847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47dbe9580 0x55b47dbe99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.207+0000 7fb32bfff700 1 -- 172.21.15.17:0/2954803847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 msgr2=0x55b47dbe9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.207+0000 7fb32bfff700 1 --2- 172.21.15.17:0/2954803847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbe9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.207+0000 7fb32bfff700 1 -- 172.21.15.17:0/2954803847 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b47d968d80 con 0x55b47da456b0 2023-07-14T13:28:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.207+0000 7fb32affd700 1 --2- 172.21.15.17:0/2954803847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47dbe9580 0x55b47dbe99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:28:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.207+0000 7fb32bfff700 1 --2- 172.21.15.17:0/2954803847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 0x55b47dbeed90 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00e680 tx=0x7fb31c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddaa59ac3f60655 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.208+0000 7fb321ffb700 1 -- 172.21.15.17:0/2954803847 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c00e040 con 0x55b47da456b0 2023-07-14T13:28:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.208+0000 7fb321ffb700 1 -- 172.21.15.17:0/2954803847 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb31c00f040 con 0x55b47da456b0 2023-07-14T13:28:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.208+0000 7fb321ffb700 1 -- 172.21.15.17:0/2954803847 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0046b0 con 0x55b47da456b0 2023-07-14T13:28:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.209+0000 7fb328ff9700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3180a14d0 0x7fb3180a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.209+0000 7fb328ff9700 1 -- 172.21.15.17:0/522208702 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fb314014070 con 0x7fb32c1024f0 2023-07-14T13:28:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.209+0000 7fb345b2eb80 1 -- 172.21.15.17:0/2954803847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 msgr2=0x55b47dbeed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.209+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/2954803847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 0x55b47dbeed90 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00e680 tx=0x7fb31c009920 comp rx=0 tx=0).stop 2023-07-14T13:28:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.210+0000 7fb32b7fe700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3180a14d0 0x7fb3180a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.211+0000 7fb32b7fe700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3180a14d0 0x7fb3180a3980 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb32400b2e0 tx=0x7fb324005fb0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.213+0000 7fb345b2eb80 1 -- 172.21.15.17:0/2954803847 shutdown_connections 2023-07-14T13:28:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.213+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/2954803847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47dbe9580 0x55b47dbe99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.213+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/2954803847 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 0x55b47dbeed90 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.213+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/2954803847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbe9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.213+0000 7fb345b2eb80 1 -- 172.21.15.17:0/2954803847 >> 172.21.15.17:0/2954803847 conn(0x55b47dbdebe0 msgr2=0x55b47dbe3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.213+0000 7fb345b2eb80 1 -- 172.21.15.17:0/2954803847 shutdown_connections 2023-07-14T13:28:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.213+0000 7fb345b2eb80 1 -- 172.21.15.17:0/2954803847 wait complete. 2023-07-14T13:28:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.214+0000 7fb345b2eb80 1 -- start start 2023-07-14T13:28:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.214+0000 7fb345b2eb80 1 Processor -- start 2023-07-14T13:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.215+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47da456b0 0x55b47dbf2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.215+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47dbe9580 0x55b47dbf2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.215+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbf33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.215+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47dadaa60 con 0x55b47dbe9580 2023-07-14T13:28:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.215+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47dada760 con 0x55b47dbef2d0 2023-07-14T13:28:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.215+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47d9be8c0 con 0x55b47da456b0 2023-07-14T13:28:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.215+0000 7fb345b2eb80 10 client.0 _ll_register_callbacks cb 0x55b47dad8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:28:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.217+0000 7fb32affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47dbe9580 0x55b47dbf2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.217+0000 7fb32bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbf33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.217+0000 7fb32affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47dbe9580 0x55b47dbf2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55594/0 (socket says 172.21.15.17:55594) 2023-07-14T13:28:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.217+0000 7fb32affd700 1 -- 172.21.15.17:0/600233375 learned_addr learned my addr 172.21.15.17:0/600233375 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.218+0000 7fb32affd700 1 -- 172.21.15.17:0/600233375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47da456b0 msgr2=0x55b47dbf2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.218+0000 7fb32affd700 1 --2- 172.21.15.17:0/600233375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47da456b0 0x55b47dbf2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.218+0000 7fb32affd700 1 -- 172.21.15.17:0/600233375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 msgr2=0x55b47dbf33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.218+0000 7fb32affd700 1 --2- 172.21.15.17:0/600233375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbf33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.218+0000 7fb32affd700 1 -- 172.21.15.17:0/600233375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32c110a10 con 0x55b47dbe9580 2023-07-14T13:28:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.219+0000 7fb32affd700 1 --2- 172.21.15.17:0/600233375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47dbe9580 0x55b47dbf2e80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb314096610 tx=0x7fb314010bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fe8825e33f7b5c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.219+0000 7fb30affd700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:28:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.219+0000 7fb30affd700 1 -- 172.21.15.17:0/600233375 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31409a570 con 0x55b47dbe9580 2023-07-14T13:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.220+0000 7fb30affd700 1 -- 172.21.15.17:0/600233375 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fb31401f340 con 0x55b47dbe9580 2023-07-14T13:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.220+0000 7fb345b2eb80 1 -- 172.21.15.17:0/600233375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b47da94490 con 0x55b47dbe9580 2023-07-14T13:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.220+0000 7fb30affd700 1 -- 172.21.15.17:0/600233375 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb31409a110 con 0x55b47dbe9580 2023-07-14T13:28:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.220+0000 7fb345b2eb80 10 client.19590 fetch_fsmap learned FSMap version 65 2023-07-14T13:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.220+0000 7fb345b2eb80 1 -- 172.21.15.17:0/600233375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x7fb31c00e330 con 0x55b47dbe9580 2023-07-14T13:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.221+0000 7fb30affd700 1 -- 172.21.15.17:0/600233375 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b47da94490 con 0x55b47dbe9580 2023-07-14T13:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.221+0000 7fb30affd700 1 -- 172.21.15.17:0/600233375 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 65) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb3140a20d0 con 0x55b47dbe9580 2023-07-14T13:28:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.221+0000 7fb345b2eb80 10 client.19590 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.221+0000 7fb345b2eb80 10 client.19590 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.221+0000 7fb345b2eb80 20 client.19590 populate_metadata read hostname 'smithi017' 2023-07-14T13:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.221+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/600233375 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b47dc02c70 0x55b47dc05080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.221+0000 7fb345b2eb80 4 client.19590 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:28:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.221+0000 7fb345b2eb80 1 -- 172.21.15.17:0/600233375 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b47db33e50 con 0x55b47dc02c70 2023-07-14T13:28:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.234+0000 7fb32b7fe700 1 --2- 172.21.15.17:0/600233375 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b47dc02c70 0x55b47dc05080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.250+0000 7fb32b7fe700 1 --2- 172.21.15.17:0/600233375 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b47dc02c70 0x55b47dc05080 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64dbf731371536dd server_cookie=91f50fa797db9e2d in_seq=0 out_seq=0 2023-07-14T13:28:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.250+0000 7fb30affd700 10 client.19590 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.253+0000 7fb30affd700 1 -- 172.21.15.17:0/600233375 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b47db33e50 con 0x55b47dc02c70 2023-07-14T13:28:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.253+0000 7fb30affd700 10 client.19590 handle_command_reply: tid=0 2023-07-14T13:28:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.254+0000 7fb345b2eb80 1 client.19590 shutdown 2023-07-14T13:28:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.256+0000 7fb345b2eb80 1 -- 172.21.15.17:0/600233375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47dbe9580 msgr2=0x55b47dbf2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.256+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/600233375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47dbe9580 0x55b47dbf2e80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb314096610 tx=0x7fb314010bc0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.257+0000 7fb345b2eb80 1 -- 172.21.15.17:0/600233375 shutdown_connections 2023-07-14T13:28:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.257+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/600233375 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b47dc02c70 0x55b47dc05080 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.257+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/600233375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbf33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.257+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/600233375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47da456b0 0x55b47dbf2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.257+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/600233375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47dbe9580 0x55b47dbf2e80 secure :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fb314096610 tx=0x7fb314010bc0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.257+0000 7fb345b2eb80 1 -- 172.21.15.17:0/600233375 >> 172.21.15.17:0/600233375 conn(0x55b47dbdebe0 msgr2=0x55b47dbe2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.257+0000 7fb30affd700 0 client.19590 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.260+0000 7fb345b2eb80 1 -- 172.21.15.17:0/600233375 shutdown_connections 2023-07-14T13:28:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.261+0000 7fb345b2eb80 1 -- 172.21.15.17:0/600233375 wait complete. 2023-07-14T13:28:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.261+0000 7fb345b2eb80 20 client.19590 trim_cache size 0 max 16384 2023-07-14T13:28:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.292+0000 7fb345b2eb80 1 Processor -- start 2023-07-14T13:28:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.292+0000 7fb345b2eb80 1 -- start start 2023-07-14T13:28:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.293+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 0x55b47dbe9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.293+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47dbef2d0 0x55b47dbf9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.293+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbf51f0 0x55b47dbe3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.293+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47dc00320 con 0x55b47da456b0 2023-07-14T13:28:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.293+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47dbe0d00 con 0x55b47dbf51f0 2023-07-14T13:28:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.293+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47dbe5970 con 0x55b47dbef2d0 2023-07-14T13:28:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.294+0000 7fb32bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbf51f0 0x55b47dbe3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.295+0000 7fb32bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbf51f0 0x55b47dbe3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36256/0 (socket says 172.21.15.17:36256) 2023-07-14T13:28:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.295+0000 7fb32bfff700 1 -- 172.21.15.17:0/4098771693 learned_addr learned my addr 172.21.15.17:0/4098771693 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.295+0000 7fb32b7fe700 1 --2- 172.21.15.17:0/4098771693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 0x55b47dbe9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.295+0000 7fb32affd700 1 --2- 172.21.15.17:0/4098771693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47dbef2d0 0x55b47dbf9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.297+0000 7fb32bfff700 1 -- 172.21.15.17:0/4098771693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47dbef2d0 msgr2=0x55b47dbf9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.297+0000 7fb32bfff700 1 --2- 172.21.15.17:0/4098771693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47dbef2d0 0x55b47dbf9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.297+0000 7fb32bfff700 1 -- 172.21.15.17:0/4098771693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 msgr2=0x55b47dbe9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.297+0000 7fb32bfff700 1 --2- 172.21.15.17:0/4098771693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 0x55b47dbe9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.297+0000 7fb32bfff700 1 -- 172.21.15.17:0/4098771693 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b47d951c00 con 0x55b47dbf51f0 2023-07-14T13:28:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.306+0000 7fb32bfff700 1 --2- 172.21.15.17:0/4098771693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbf51f0 0x55b47dbe3c60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00e1c0 tx=0x7fb31c00e1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b347ec0da0b1d00 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.309+0000 7fb3227fc700 1 -- 172.21.15.17:0/4098771693 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c00e040 con 0x55b47dbf51f0 2023-07-14T13:28:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.309+0000 7fb3227fc700 1 -- 172.21.15.17:0/4098771693 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb31c003e90 con 0x55b47dbf51f0 2023-07-14T13:28:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.309+0000 7fb3227fc700 1 -- 172.21.15.17:0/4098771693 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0057f0 con 0x55b47dbf51f0 2023-07-14T13:28:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.310+0000 7fb345b2eb80 1 -- 172.21.15.17:0/4098771693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbf51f0 msgr2=0x55b47dbe3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.310+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/4098771693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbf51f0 0x55b47dbe3c60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00e1c0 tx=0x7fb31c00e1f0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.318 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.314+0000 7fb345b2eb80 1 -- 172.21.15.17:0/4098771693 shutdown_connections 2023-07-14T13:28:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.314+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/4098771693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbf51f0 0x55b47dbe3c60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.314+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/4098771693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47da456b0 0x55b47dbe9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.314+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/4098771693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47dbef2d0 0x55b47dbf9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.319 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.314+0000 7fb345b2eb80 1 -- 172.21.15.17:0/4098771693 >> 172.21.15.17:0/4098771693 conn(0x55b47dbdebe0 msgr2=0x55b47dbedad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:06.328 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.323+0000 7fb345b2eb80 1 -- 172.21.15.17:0/4098771693 shutdown_connections 2023-07-14T13:28:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.324+0000 7fb345b2eb80 1 -- 172.21.15.17:0/4098771693 wait complete. 2023-07-14T13:28:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.325+0000 7fb345b2eb80 1 -- start start 2023-07-14T13:28:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.325+0000 7fb345b2eb80 1 Processor -- start 2023-07-14T13:28:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.326+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47da456b0 0x55b47dbf8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.326+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbf8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.326+0000 7fb345b2eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47dbf51f0 0x55b47dbf8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.326+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47dbfa2a0 con 0x55b47dbf51f0 2023-07-14T13:28:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.326+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47dc56b40 con 0x55b47dbef2d0 2023-07-14T13:28:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.326+0000 7fb345b2eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b47dc56cb0 con 0x55b47da456b0 2023-07-14T13:28:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.326+0000 7fb345b2eb80 10 client.0 _ll_register_callbacks cb 0x55b47dad8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:28:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.327+0000 7fb32affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbf8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.327+0000 7fb32affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbf8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:36262/0 (socket says 172.21.15.17:36262) 2023-07-14T13:28:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.327+0000 7fb32affd700 1 -- 172.21.15.17:0/915538531 learned_addr learned my addr 172.21.15.17:0/915538531 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.328+0000 7fb32affd700 1 -- 172.21.15.17:0/915538531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47da456b0 msgr2=0x55b47dbf8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.328+0000 7fb32affd700 1 --2- 172.21.15.17:0/915538531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47da456b0 0x55b47dbf8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.328+0000 7fb32affd700 1 -- 172.21.15.17:0/915538531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47dbf51f0 msgr2=0x55b47dbf8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.328+0000 7fb32affd700 1 --2- 172.21.15.17:0/915538531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47dbf51f0 0x55b47dbf8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.328+0000 7fb32affd700 1 -- 172.21.15.17:0/915538531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b47d968d80 con 0x55b47dbef2d0 2023-07-14T13:28:06.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.328+0000 7fb32affd700 1 --2- 172.21.15.17:0/915538531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbf8790 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb31400c5b0 tx=0x7fb3140d2f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbd585124ed460d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:06.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.328+0000 7fb30affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:28:06.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.329+0000 7fb30affd700 1 -- 172.21.15.17:0/915538531 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3140b1030 con 0x55b47dbef2d0 2023-07-14T13:28:06.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.329+0000 7fb30affd700 1 -- 172.21.15.17:0/915538531 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fb3140b2070 con 0x55b47dbef2d0 2023-07-14T13:28:06.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.329+0000 7fb345b2eb80 1 -- 172.21.15.17:0/915538531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb31c00f040 con 0x55b47dbef2d0 2023-07-14T13:28:06.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.330+0000 7fb30affd700 1 -- 172.21.15.17:0/915538531 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb31401f340 con 0x55b47dbef2d0 2023-07-14T13:28:06.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.330+0000 7fb345b2eb80 10 client.29360 fetch_fsmap learned FSMap version 65 2023-07-14T13:28:06.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.330+0000 7fb345b2eb80 1 -- 172.21.15.17:0/915538531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55b47d98f1f0 con 0x55b47dbef2d0 2023-07-14T13:28:06.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.333+0000 7fb30affd700 1 -- 172.21.15.17:0/915538531 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb31c00f040 con 0x55b47dbef2d0 2023-07-14T13:28:06.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.333+0000 7fb30affd700 1 -- 172.21.15.17:0/915538531 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 65) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb3140b82f0 con 0x55b47dbef2d0 2023-07-14T13:28:06.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.333+0000 7fb345b2eb80 10 client.29360 fetch_fsmap finished waiting for FSMap version 65 2023-07-14T13:28:06.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.333+0000 7fb345b2eb80 10 client.29360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:28:06.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.333+0000 7fb345b2eb80 20 client.29360 populate_metadata read hostname 'smithi017' 2023-07-14T13:28:06.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.333+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/915538531 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b47dc582a0 0x55b47dc5a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:06.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.334+0000 7fb345b2eb80 4 client.29360 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:28:06.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.334+0000 7fb345b2eb80 1 -- 172.21.15.17:0/915538531 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b47daf5ff0 con 0x55b47dc582a0 2023-07-14T13:28:06.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.340+0000 7fb32b7fe700 1 --2- 172.21.15.17:0/915538531 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b47dc582a0 0x55b47dc5a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.349+0000 7fb32b7fe700 1 --2- 172.21.15.17:0/915538531 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b47dc582a0 0x55b47dc5a6b0 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa77552ad7165b7a server_cookie=20c769280474827c in_seq=0 out_seq=0 2023-07-14T13:28:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.349+0000 7fb30affd700 10 client.29360 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:06.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.845+0000 7fb30affd700 1 -- 172.21.15.17:0/915538531 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b47daf5ff0 con 0x55b47dc582a0 2023-07-14T13:28:06.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.846+0000 7fb30affd700 10 client.29360 handle_command_reply: tid=0 2023-07-14T13:28:06.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.846+0000 7fb345b2eb80 1 client.29360 shutdown 2023-07-14T13:28:06.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.846+0000 7fb345b2eb80 1 -- 172.21.15.17:0/915538531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 msgr2=0x55b47dbf8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:06.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.846+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/915538531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbf8790 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb31400c5b0 tx=0x7fb3140d2f30 comp rx=0 tx=0).stop 2023-07-14T13:28:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.847+0000 7fb345b2eb80 1 -- 172.21.15.17:0/915538531 shutdown_connections 2023-07-14T13:28:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.847+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/915538531 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b47dc582a0 0x55b47dc5a6b0 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.847+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/915538531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b47dbf51f0 0x55b47dbf8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.847+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/915538531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b47da456b0 0x55b47dbf8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.847+0000 7fb345b2eb80 1 --2- 172.21.15.17:0/915538531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b47dbef2d0 0x55b47dbf8790 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.847+0000 7fb345b2eb80 1 -- 172.21.15.17:0/915538531 >> 172.21.15.17:0/915538531 conn(0x55b47dbdebe0 msgr2=0x55b47dbf4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.849+0000 7fb30affd700 0 client.29360 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.849+0000 7fb345b2eb80 1 -- 172.21.15.17:0/915538531 shutdown_connections 2023-07-14T13:28:06.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.850+0000 7fb345b2eb80 1 -- 172.21.15.17:0/915538531 wait complete. 2023-07-14T13:28:06.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.850+0000 7fb345b2eb80 20 client.29360 trim_cache size 0 max 16384 2023-07-14T13:28:06.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:28:06.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:28:06.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:28:06.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:28:06.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.854+0000 7fb3321ff700 1 -- 172.21.15.17:0/522208702 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3180a14d0 msgr2=0x7fb3180a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.854+0000 7fb3321ff700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3180a14d0 0x7fb3180a3980 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb32400b2e0 tx=0x7fb324005fb0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.854+0000 7fb3321ff700 1 -- 172.21.15.17:0/522208702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb32c1024f0 msgr2=0x7fb32c113100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.854+0000 7fb3321ff700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb32c1024f0 0x7fb32c113100 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fb31400e9f0 tx=0x7fb31400ed00 comp rx=0 tx=0).stop 2023-07-14T13:28:06.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.854+0000 7fb3321ff700 1 -- 172.21.15.17:0/522208702 shutdown_connections 2023-07-14T13:28:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.854+0000 7fb3321ff700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb3180a14d0 0x7fb3180a3980 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.854+0000 7fb3321ff700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb32c104a60 0x7fb32c10b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.854+0000 7fb3321ff700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32c067ee0 0x7fb32c112bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.854+0000 7fb3321ff700 1 --2- 172.21.15.17:0/522208702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb32c1024f0 0x7fb32c113100 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.854+0000 7fb3321ff700 1 -- 172.21.15.17:0/522208702 >> 172.21.15.17:0/522208702 conn(0x7fb32c074760 msgr2=0x7fb32c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.855+0000 7fb3321ff700 1 -- 172.21.15.17:0/522208702 shutdown_connections 2023-07-14T13:28:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:06.855+0000 7fb3321ff700 1 -- 172.21.15.17:0/522208702 wait complete. 2023-07-14T13:28:07.428 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 595.0 s, 94.5 tps, lat 709.165 ms stddev 795.874 2023-07-14T13:28:07.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:07 smithi135 ceph-mon[97338]: pgmap v899: 97 pgs: 21 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 40 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.4 MiB/s wr, 832 op/s 2023-07-14T13:28:07.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:07 smithi131 ceph-mon[96953]: pgmap v899: 97 pgs: 21 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 40 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.4 MiB/s wr, 832 op/s 2023-07-14T13:28:08.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:07 smithi017 ceph-mon[95536]: pgmap v899: 97 pgs: 21 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 40 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.4 MiB/s wr, 832 op/s 2023-07-14T13:28:09.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:09 smithi135 ceph-mon[97338]: pgmap v900: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.4 MiB/s wr, 844 op/s 2023-07-14T13:28:09.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:09 smithi131 ceph-mon[96953]: pgmap v900: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.4 MiB/s wr, 844 op/s 2023-07-14T13:28:10.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:09 smithi017 ceph-mon[95536]: pgmap v900: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.4 MiB/s wr, 844 op/s 2023-07-14T13:28:10.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:10 smithi135 ceph-mon[97338]: pgmap v901: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.7 MiB/s wr, 781 op/s 2023-07-14T13:28:10.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:10 smithi131 ceph-mon[96953]: pgmap v901: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.7 MiB/s wr, 781 op/s 2023-07-14T13:28:11.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:10 smithi017 ceph-mon[95536]: pgmap v901: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.7 MiB/s wr, 781 op/s 2023-07-14T13:28:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 600.0 s, 157.3 tps, lat 885.378 ms stddev 1182.099 2023-07-14T13:28:13.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:13 smithi017 ceph-mon[95536]: pgmap v902: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 447 op/s 2023-07-14T13:28:13.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:13 smithi135 ceph-mon[97338]: pgmap v902: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 447 op/s 2023-07-14T13:28:13.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:13 smithi131 ceph-mon[96953]: pgmap v902: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 447 op/s 2023-07-14T13:28:15.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:15 smithi017 ceph-mon[95536]: pgmap v903: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 447 op/s 2023-07-14T13:28:15.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:15 smithi135 ceph-mon[97338]: pgmap v903: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 447 op/s 2023-07-14T13:28:15.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:15 smithi131 ceph-mon[96953]: pgmap v903: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 447 op/s 2023-07-14T13:28:17.423 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 605.0 s, 218.6 tps, lat 449.638 ms stddev 434.744 2023-07-14T13:28:17.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:17 smithi017 ceph-mon[95536]: pgmap v904: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.6 MiB/s wr, 643 op/s 2023-07-14T13:28:17.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:17 smithi017 ceph-mon[95536]: osdmap e135: 12 total, 12 up, 12 in 2023-07-14T13:28:17.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:17 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:28:17.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:17 smithi135 ceph-mon[97338]: pgmap v904: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.6 MiB/s wr, 643 op/s 2023-07-14T13:28:17.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:17 smithi135 ceph-mon[97338]: osdmap e135: 12 total, 12 up, 12 in 2023-07-14T13:28:17.923 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:17 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:28:17.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:17 smithi131 ceph-mon[96953]: pgmap v904: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.6 MiB/s wr, 643 op/s 2023-07-14T13:28:17.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:17 smithi131 ceph-mon[96953]: osdmap e135: 12 total, 12 up, 12 in 2023-07-14T13:28:17.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:17 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:28:19.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:19 smithi017 ceph-mon[95536]: pgmap v906: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 528 op/s 2023-07-14T13:28:19.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:19 smithi135 ceph-mon[97338]: pgmap v906: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 528 op/s 2023-07-14T13:28:19.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:19 smithi131 ceph-mon[96953]: pgmap v906: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 528 op/s 2023-07-14T13:28:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.096+0000 7f41a999d700 1 -- 172.21.15.17:0/952869009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a4105940 msgr2=0x7f41a4105d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.096+0000 7f41a999d700 1 --2- 172.21.15.17:0/952869009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a4105940 0x7f41a4105d10 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4198009990 tx=0x7f4198009ca0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.096+0000 7f41a999d700 1 -- 172.21.15.17:0/952869009 shutdown_connections 2023-07-14T13:28:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.096+0000 7f41a999d700 1 --2- 172.21.15.17:0/952869009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a41002e0 0x7f41a410c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.096+0000 7f41a999d700 1 --2- 172.21.15.17:0/952869009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a4105940 0x7f41a4105d10 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.096+0000 7f41a999d700 1 --2- 172.21.15.17:0/952869009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a40ff930 0x7f41a40ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.096+0000 7f41a999d700 1 -- 172.21.15.17:0/952869009 >> 172.21.15.17:0/952869009 conn(0x7f41a40fb450 msgr2=0x7f41a40fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.096+0000 7f41a999d700 1 -- 172.21.15.17:0/952869009 shutdown_connections 2023-07-14T13:28:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.096+0000 7f41a999d700 1 -- 172.21.15.17:0/952869009 wait complete. 2023-07-14T13:28:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.097+0000 7f41a999d700 1 Processor -- start 2023-07-14T13:28:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.097+0000 7f41a999d700 1 -- start start 2023-07-14T13:28:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.098+0000 7f41a999d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a40ff930 0x7f41a419d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.098+0000 7f41a999d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a41002e0 0x7f41a419deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.098+0000 7f41a999d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a4105940 0x7f41a41979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.098+0000 7f41a999d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4198050 con 0x7f41a4105940 2023-07-14T13:28:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.098+0000 7f41a999d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a41981c0 con 0x7f41a41002e0 2023-07-14T13:28:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.098+0000 7f41a999d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4198380 con 0x7f41a40ff930 2023-07-14T13:28:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.098+0000 7f41a899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a40ff930 0x7f41a419d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.098+0000 7f41a899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a40ff930 0x7f41a419d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:59998/0 (socket says 172.21.15.17:59998) 2023-07-14T13:28:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.098+0000 7f41a899b700 1 -- 172.21.15.17:0/1716916826 learned_addr learned my addr 172.21.15.17:0/1716916826 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.099+0000 7f41a919c700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a4105940 0x7f41a41979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.099+0000 7f41a3fff700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a41002e0 0x7f41a419deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.099+0000 7f41a899b700 1 -- 172.21.15.17:0/1716916826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a41002e0 msgr2=0x7f41a419deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.099+0000 7f41a899b700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a41002e0 0x7f41a419deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.099+0000 7f41a899b700 1 -- 172.21.15.17:0/1716916826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a4105940 msgr2=0x7f41a41979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.099+0000 7f41a899b700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a4105940 0x7f41a41979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.099+0000 7f41a899b700 1 -- 172.21.15.17:0/1716916826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41980095f0 con 0x7f41a40ff930 2023-07-14T13:28:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.099+0000 7f41a3fff700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a41002e0 0x7f41a419deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:28:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.100+0000 7f41a899b700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a40ff930 0x7f41a419d970 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f41980098e0 tx=0x7f4198009570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.100+0000 7f41a1ffb700 1 -- 172.21.15.17:0/1716916826 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419801d070 con 0x7f41a40ff930 2023-07-14T13:28:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.100+0000 7f41a999d700 1 -- 172.21.15.17:0/1716916826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a4198600 con 0x7f41a40ff930 2023-07-14T13:28:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.100+0000 7f41a1ffb700 1 -- 172.21.15.17:0/1716916826 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4198022470 con 0x7f41a40ff930 2023-07-14T13:28:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.100+0000 7f41a1ffb700 1 -- 172.21.15.17:0/1716916826 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4198017650 con 0x7f41a40ff930 2023-07-14T13:28:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.100+0000 7f41a999d700 1 -- 172.21.15.17:0/1716916826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a41a4960 con 0x7f41a40ff930 2023-07-14T13:28:20.110 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.106+0000 7f41a1ffb700 1 -- 172.21.15.17:0/1716916826 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f41980225e0 con 0x7f41a40ff930 2023-07-14T13:28:20.111 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.107+0000 7f41be4bdb80 1 Processor -- start 2023-07-14T13:28:20.112 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.107+0000 7f41be4bdb80 1 -- start start 2023-07-14T13:28:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.108+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b485f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.108+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b486470 0x55d76b4801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.108+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b4868c0 0x55d76b480700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.113 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.108+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b385c50 con 0x55d76b4868c0 2023-07-14T13:28:20.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.108+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b3d89e0 con 0x55d76b2dc6b0 2023-07-14T13:28:20.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.108+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b3d1e70 con 0x55d76b486470 2023-07-14T13:28:20.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.108+0000 7f41a919c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b485f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.108+0000 7f41a919c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b485f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34182/0 (socket says 172.21.15.17:34182) 2023-07-14T13:28:20.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.108+0000 7f41a919c700 1 -- 172.21.15.17:0/2955706168 learned_addr learned my addr 172.21.15.17:0/2955706168 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:20.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.108+0000 7f41a3fff700 1 --2- 172.21.15.17:0/2955706168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b4868c0 0x55d76b480700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.108+0000 7f41a1ffb700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41940a12c0 0x7f41940a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.114 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.109+0000 7f41a1ffb700 1 -- 172.21.15.17:0/1716916826 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f41980ce210 con 0x7f41a40ff930 2023-07-14T13:28:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.109+0000 7f41a899b700 1 --2- 172.21.15.17:0/2955706168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b486470 0x55d76b4801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.109+0000 7f41a919c700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41940a12c0 0x7f41940a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.109+0000 7f41a3fff700 1 -- 172.21.15.17:0/2955706168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b486470 msgr2=0x55d76b4801a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.109+0000 7f41a3fff700 1 --2- 172.21.15.17:0/2955706168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b486470 0x55d76b4801a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.109+0000 7f41a3fff700 1 -- 172.21.15.17:0/2955706168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 msgr2=0x55d76b485f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.109+0000 7f41a3fff700 1 --2- 172.21.15.17:0/2955706168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b485f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.109+0000 7f41a3fff700 1 -- 172.21.15.17:0/2955706168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d76b1ffd80 con 0x55d76b4868c0 2023-07-14T13:28:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.109+0000 7f41a919c700 1 --2- 172.21.15.17:0/2955706168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b485f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:28:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.109+0000 7f41a3fff700 1 --2- 172.21.15.17:0/2955706168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b4868c0 0x55d76b480700 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f4190009c90 tx=0x7f41900113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3548379adb551dc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.110+0000 7f41a919c700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41940a12c0 0x7f41940a3770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f419c0060b0 tx=0x7f419c009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.110+0000 7f418effd700 1 -- 172.21.15.17:0/2955706168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190011c00 con 0x55d76b4868c0 2023-07-14T13:28:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.110+0000 7f418effd700 1 -- 172.21.15.17:0/2955706168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4190011d60 con 0x55d76b4868c0 2023-07-14T13:28:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.110+0000 7f418effd700 1 -- 172.21.15.17:0/2955706168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419000f6a0 con 0x55d76b4868c0 2023-07-14T13:28:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.111+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2955706168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b4868c0 msgr2=0x55d76b480700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.111+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/2955706168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b4868c0 0x55d76b480700 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f4190009c90 tx=0x7f41900113e0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.111+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2955706168 shutdown_connections 2023-07-14T13:28:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.111+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/2955706168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b4868c0 0x55d76b480700 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.111+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/2955706168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b485f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.111+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/2955706168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b486470 0x55d76b4801a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.111+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2955706168 >> 172.21.15.17:0/2955706168 conn(0x55d76b475d40 msgr2=0x55d76b47b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.111+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2955706168 shutdown_connections 2023-07-14T13:28:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.111+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2955706168 wait complete. 2023-07-14T13:28:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.111+0000 7f41be4bdb80 1 -- start start 2023-07-14T13:28:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.112+0000 7f41be4bdb80 1 Processor -- start 2023-07-14T13:28:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b48c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b486470 0x55d76b489b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b4868c0 0x55d76b48a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b371a60 con 0x55d76b486470 2023-07-14T13:28:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b371760 con 0x55d76b2dc6b0 2023-07-14T13:28:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b2558c0 con 0x55d76b4868c0 2023-07-14T13:28:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41be4bdb80 10 client.0 _ll_register_callbacks cb 0x55d76b36f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:28:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41a899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b48c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41a899b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b48c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:34194/0 (socket says 172.21.15.17:34194) 2023-07-14T13:28:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41a899b700 1 -- 172.21.15.17:0/2402327784 learned_addr learned my addr 172.21.15.17:0/2402327784 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41a3fff700 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b486470 0x55d76b489b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41a899b700 1 -- 172.21.15.17:0/2402327784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b4868c0 msgr2=0x55d76b48a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41a899b700 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b4868c0 0x55d76b48a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41a899b700 1 -- 172.21.15.17:0/2402327784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b486470 msgr2=0x55d76b489b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41a899b700 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b486470 0x55d76b489b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.113+0000 7f41a899b700 1 -- 172.21.15.17:0/2402327784 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c0075e0 con 0x55d76b2dc6b0 2023-07-14T13:28:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.114+0000 7f41a899b700 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b48c820 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4198097e00 tx=0x7f419809b1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6c3d2cd297d32a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.114+0000 7f4183fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:28:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.114+0000 7f4183fff700 1 -- 172.21.15.17:0/2402327784 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980ce070 con 0x55d76b2dc6b0 2023-07-14T13:28:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.114+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2402327784 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d76b32b490 con 0x55d76b2dc6b0 2023-07-14T13:28:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.114+0000 7f4183fff700 1 -- 172.21.15.17:0/2402327784 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f41980228c0 con 0x55d76b2dc6b0 2023-07-14T13:28:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.114+0000 7f4183fff700 1 -- 172.21.15.17:0/2402327784 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f419809acf0 con 0x55d76b2dc6b0 2023-07-14T13:28:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.114+0000 7f41be4bdb80 10 client.29372 fetch_fsmap learned FSMap version 66 2023-07-14T13:28:20.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.114+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2402327784 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x7f41900098f0 con 0x55d76b2dc6b0 2023-07-14T13:28:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.115+0000 7f4183fff700 1 -- 172.21.15.17:0/2402327784 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41980b2070 con 0x55d76b2dc6b0 2023-07-14T13:28:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.115+0000 7f4183fff700 1 -- 172.21.15.17:0/2402327784 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f41980a32c0 con 0x55d76b2dc6b0 2023-07-14T13:28:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.115+0000 7f41be4bdb80 10 client.29372 fetch_fsmap finished waiting for FSMap version 66 2023-07-14T13:28:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.115+0000 7f41be4bdb80 10 client.29372 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:28:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.115+0000 7f41be4bdb80 20 client.29372 populate_metadata read hostname 'smithi017' 2023-07-14T13:28:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.115+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d76b4a22b0 0x55d76b4a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.115+0000 7f41be4bdb80 4 client.29372 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:28:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.115+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2402327784 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d76b3cae50 con 0x55d76b4a22b0 2023-07-14T13:28:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.115+0000 7f41a3fff700 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d76b4a22b0 0x55d76b4a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.116+0000 7f41a3fff700 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d76b4a22b0 0x55d76b4a46c0 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8918f07a64468b15 server_cookie=28c347fab648ab05 in_seq=0 out_seq=0 2023-07-14T13:28:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.116+0000 7f4183fff700 10 client.29372 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f4183fff700 1 -- 172.21.15.17:0/2402327784 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d76b3cae50 con 0x55d76b4a22b0 2023-07-14T13:28:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f4183fff700 10 client.29372 handle_command_reply: tid=0 2023-07-14T13:28:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f41be4bdb80 1 client.29372 shutdown 2023-07-14T13:28:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2402327784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 msgr2=0x55d76b48c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b48c820 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4198097e00 tx=0x7f419809b1e0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2402327784 shutdown_connections 2023-07-14T13:28:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d76b4a22b0 0x55d76b4a46c0 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b4868c0 0x55d76b48a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b2dc6b0 0x55d76b48c820 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/2402327784 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b486470 0x55d76b489b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f4183fff700 0 client.29372 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2402327784 >> 172.21.15.17:0/2402327784 conn(0x55d76b475d40 msgr2=0x55d76b47a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2402327784 shutdown_connections 2023-07-14T13:28:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.117+0000 7f41be4bdb80 1 -- 172.21.15.17:0/2402327784 wait complete. 2023-07-14T13:28:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.118+0000 7f41be4bdb80 20 client.29372 trim_cache size 0 max 16384 2023-07-14T13:28:20.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.141+0000 7f41be4bdb80 1 Processor -- start 2023-07-14T13:28:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.141+0000 7f41be4bdb80 1 -- start start 2023-07-14T13:28:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.142+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b2dc6b0 0x55d76b499690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.142+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b486470 0x55d76b4852b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.142+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b4868c0 0x55d76b48c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.142+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b4880c0 con 0x55d76b2dc6b0 2023-07-14T13:28:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.142+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b49e4c0 con 0x55d76b486470 2023-07-14T13:28:20.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.142+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b484790 con 0x55d76b4868c0 2023-07-14T13:28:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.142+0000 7f41a899b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b2dc6b0 0x55d76b499690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.142+0000 7f41a899b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b2dc6b0 0x55d76b499690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59542/0 (socket says 172.21.15.17:59542) 2023-07-14T13:28:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.142+0000 7f41a899b700 1 -- 172.21.15.17:0/1961340543 learned_addr learned my addr 172.21.15.17:0/1961340543 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.142+0000 7f41a3fff700 1 --2- 172.21.15.17:0/1961340543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b486470 0x55d76b4852b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.143+0000 7f41a919c700 1 --2- 172.21.15.17:0/1961340543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b4868c0 0x55d76b48c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.143+0000 7f41a899b700 1 -- 172.21.15.17:0/1961340543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b4868c0 msgr2=0x55d76b48c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.143+0000 7f41a899b700 1 --2- 172.21.15.17:0/1961340543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b4868c0 0x55d76b48c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.143+0000 7f41a899b700 1 -- 172.21.15.17:0/1961340543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b486470 msgr2=0x55d76b4852b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.143+0000 7f41a899b700 1 --2- 172.21.15.17:0/1961340543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b486470 0x55d76b4852b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.143+0000 7f41a899b700 1 -- 172.21.15.17:0/1961340543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d76b1e8c00 con 0x55d76b2dc6b0 2023-07-14T13:28:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.143+0000 7f41a919c700 1 --2- 172.21.15.17:0/1961340543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b4868c0 0x55d76b48c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:28:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.143+0000 7f41a899b700 1 --2- 172.21.15.17:0/1961340543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b2dc6b0 0x55d76b499690 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f419809b320 tx=0x7f4198005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17dc9d74ca8b41c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:20.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.144+0000 7f418f7fe700 1 -- 172.21.15.17:0/1961340543 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980ce040 con 0x55d76b2dc6b0 2023-07-14T13:28:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.144+0000 7f418f7fe700 1 -- 172.21.15.17:0/1961340543 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41980b2030 con 0x55d76b2dc6b0 2023-07-14T13:28:20.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.144+0000 7f418f7fe700 1 -- 172.21.15.17:0/1961340543 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419809f430 con 0x55d76b2dc6b0 2023-07-14T13:28:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.145+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1961340543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b2dc6b0 msgr2=0x55d76b499690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.145+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/1961340543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b2dc6b0 0x55d76b499690 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f419809b320 tx=0x7f4198005850 comp rx=0 tx=0).stop 2023-07-14T13:28:20.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.145+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1961340543 shutdown_connections 2023-07-14T13:28:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.145+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/1961340543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b4868c0 0x55d76b48c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.145+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/1961340543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b2dc6b0 0x55d76b499690 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.145+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/1961340543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b486470 0x55d76b4852b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.145+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1961340543 >> 172.21.15.17:0/1961340543 conn(0x55d76b475d40 msgr2=0x55d76b484ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.145+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1961340543 shutdown_connections 2023-07-14T13:28:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.145+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1961340543 wait complete. 2023-07-14T13:28:20.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.145+0000 7f41be4bdb80 1 -- start start 2023-07-14T13:28:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.146+0000 7f41be4bdb80 1 Processor -- start 2023-07-14T13:28:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.146+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b2dc6b0 0x55d76b482ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.146+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b486470 0x55d76b481990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.146+0000 7f41be4bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b4868c0 0x55d76b481ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.146+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b483590 con 0x55d76b486470 2023-07-14T13:28:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.146+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b483700 con 0x55d76b4868c0 2023-07-14T13:28:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.146+0000 7f41be4bdb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d76b482410 con 0x55d76b2dc6b0 2023-07-14T13:28:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.146+0000 7f41be4bdb80 10 client.0 _ll_register_callbacks cb 0x7f41980976d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:28:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.147+0000 7f41a899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b2dc6b0 0x55d76b482ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.147+0000 7f41a899b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b2dc6b0 0x55d76b482ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:60028/0 (socket says 172.21.15.17:60028) 2023-07-14T13:28:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.147+0000 7f41a899b700 1 -- 172.21.15.17:0/1274781928 learned_addr learned my addr 172.21.15.17:0/1274781928 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:20.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.147+0000 7f41a919c700 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b4868c0 0x55d76b481ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.147+0000 7f41a3fff700 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b486470 0x55d76b481990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.147+0000 7f41a919c700 1 -- 172.21.15.17:0/1274781928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b2dc6b0 msgr2=0x55d76b482ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.147+0000 7f41a919c700 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b2dc6b0 0x55d76b482ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.147+0000 7f41a919c700 1 -- 172.21.15.17:0/1274781928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b486470 msgr2=0x55d76b481990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.147+0000 7f41a919c700 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b486470 0x55d76b481990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.147+0000 7f41a919c700 1 -- 172.21.15.17:0/1274781928 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41900098f0 con 0x55d76b4868c0 2023-07-14T13:28:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.147+0000 7f41a899b700 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b2dc6b0 0x55d76b482ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:28:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.148+0000 7f41a919c700 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b4868c0 0x55d76b481ed0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f419c009510 tx=0x7f419c009280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d348b95549e3953 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.148+0000 7f4183fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:28:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.148+0000 7f4183fff700 1 -- 172.21.15.17:0/1274781928 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c00e070 con 0x55d76b4868c0 2023-07-14T13:28:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.148+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1274781928 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4190011d60 con 0x55d76b4868c0 2023-07-14T13:28:20.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.148+0000 7f4183fff700 1 -- 172.21.15.17:0/1274781928 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f419c004bb0 con 0x55d76b4868c0 2023-07-14T13:28:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.148+0000 7f4183fff700 1 -- 172.21.15.17:0/1274781928 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f419c004d70 con 0x55d76b4868c0 2023-07-14T13:28:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.148+0000 7f41be4bdb80 10 client.29378 fetch_fsmap learned FSMap version 66 2023-07-14T13:28:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.148+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1274781928 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55d76b2261f0 con 0x55d76b4868c0 2023-07-14T13:28:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.149+0000 7f4183fff700 1 -- 172.21.15.17:0/1274781928 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4190011d60 con 0x55d76b4868c0 2023-07-14T13:28:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.149+0000 7f4183fff700 1 -- 172.21.15.17:0/1274781928 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f419c024a40 con 0x55d76b4868c0 2023-07-14T13:28:20.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.149+0000 7f41be4bdb80 10 client.29378 fetch_fsmap finished waiting for FSMap version 66 2023-07-14T13:28:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.149+0000 7f41be4bdb80 10 client.29378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:28:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.149+0000 7f41be4bdb80 20 client.29378 populate_metadata read hostname 'smithi017' 2023-07-14T13:28:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.149+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d76b4f7240 0x55d76b4f9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.149+0000 7f41be4bdb80 4 client.29378 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:28:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.149+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1274781928 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d76b38cff0 con 0x55d76b4f7240 2023-07-14T13:28:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.149+0000 7f41a899b700 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d76b4f7240 0x55d76b4f9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.150+0000 7f41a899b700 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d76b4f7240 0x55d76b4f9650 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e40dc2077647a8bb server_cookie=257a72677df0b229 in_seq=0 out_seq=0 2023-07-14T13:28:20.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.150+0000 7f4183fff700 10 client.29378 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:20.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f4183fff700 1 -- 172.21.15.17:0/1274781928 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d76b38cff0 con 0x55d76b4f7240 2023-07-14T13:28:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f4183fff700 10 client.29378 handle_command_reply: tid=0 2023-07-14T13:28:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f41be4bdb80 1 client.29378 shutdown 2023-07-14T13:28:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1274781928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b4868c0 msgr2=0x55d76b481ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:20.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b4868c0 0x55d76b481ed0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f419c009510 tx=0x7f419c009280 comp rx=0 tx=0).stop 2023-07-14T13:28:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1274781928 shutdown_connections 2023-07-14T13:28:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d76b4f7240 0x55d76b4f9650 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d76b4868c0 0x55d76b481ed0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d76b2dc6b0 0x55d76b482ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f41be4bdb80 1 --2- 172.21.15.17:0/1274781928 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d76b486470 0x55d76b481990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1274781928 >> 172.21.15.17:0/1274781928 conn(0x55d76b475d40 msgr2=0x55d76b486d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f4183fff700 0 client.29378 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1274781928 shutdown_connections 2023-07-14T13:28:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.179+0000 7f41be4bdb80 1 -- 172.21.15.17:0/1274781928 wait complete. 2023-07-14T13:28:20.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.180+0000 7f41be4bdb80 20 client.29378 trim_cache size 0 max 16384 2023-07-14T13:28:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:28:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:28:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:28:20.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:28:20.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 -- 172.21.15.17:0/1716916826 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41940a12c0 msgr2=0x7f41940a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:20.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41940a12c0 0x7f41940a3770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f419c0060b0 tx=0x7f419c009040 comp rx=0 tx=0).stop 2023-07-14T13:28:20.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 -- 172.21.15.17:0/1716916826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a40ff930 msgr2=0x7f41a419d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:20.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a40ff930 0x7f41a419d970 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f41980098e0 tx=0x7f4198009570 comp rx=0 tx=0).stop 2023-07-14T13:28:20.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 -- 172.21.15.17:0/1716916826 shutdown_connections 2023-07-14T13:28:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41940a12c0 0x7f41940a3770 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41a4105940 0x7f41a41979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a40ff930 0x7f41a419d970 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 --2- 172.21.15.17:0/1716916826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a41002e0 0x7f41a419deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 -- 172.21.15.17:0/1716916826 >> 172.21.15.17:0/1716916826 conn(0x7f41a40fb450 msgr2=0x7f41a4072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 -- 172.21.15.17:0/1716916826 shutdown_connections 2023-07-14T13:28:20.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:20.181+0000 7f41a999d700 1 -- 172.21.15.17:0/1716916826 wait complete. 2023-07-14T13:28:21.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:21 smithi017 ceph-mon[95536]: pgmap v907: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 572 op/s 2023-07-14T13:28:21.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:21 smithi135 ceph-mon[97338]: pgmap v907: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 572 op/s 2023-07-14T13:28:21.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:21 smithi131 ceph-mon[96953]: pgmap v907: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.2 MiB/s wr, 572 op/s 2023-07-14T13:28:22.423 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 610.0 s, 202.2 tps, lat 485.102 ms stddev 495.893 2023-07-14T13:28:23.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:23 smithi017 ceph-mon[95536]: pgmap v908: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 733 op/s 2023-07-14T13:28:23.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:23 smithi135 ceph-mon[97338]: pgmap v908: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 733 op/s 2023-07-14T13:28:23.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:23 smithi131 ceph-mon[96953]: pgmap v908: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 733 op/s 2023-07-14T13:28:24.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:24 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:28:24.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:24 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:28:25.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:24 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:28:25.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:25 smithi131 ceph-mon[96953]: pgmap v909: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 732 op/s 2023-07-14T13:28:26.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:25 smithi017 ceph-mon[95536]: pgmap v909: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 732 op/s 2023-07-14T13:28:26.172 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:25 smithi135 ceph-mon[97338]: pgmap v909: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 732 op/s 2023-07-14T13:28:27.423 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 615.0 s, 149.4 tps, lat 589.078 ms stddev 676.760 2023-07-14T13:28:27.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:27 smithi017 ceph-mon[95536]: pgmap v910: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 768 op/s 2023-07-14T13:28:27.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:27 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:28:27.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:27 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:28:27.831 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:27 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:28:27.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:27 smithi135 ceph-mon[97338]: pgmap v910: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 768 op/s 2023-07-14T13:28:27.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:27 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:28:27.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:27 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:28:27.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:27 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:28:27.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:27 smithi131 ceph-mon[96953]: pgmap v910: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.4 MiB/s wr, 768 op/s 2023-07-14T13:28:27.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:27 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:28:27.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:27 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:28:27.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:27 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:28:29.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:29 smithi017 ceph-mon[95536]: pgmap v911: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.6 MiB/s wr, 674 op/s 2023-07-14T13:28:29.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:29 smithi135 ceph-mon[97338]: pgmap v911: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.6 MiB/s wr, 674 op/s 2023-07-14T13:28:29.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:29 smithi131 ceph-mon[96953]: pgmap v911: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.6 MiB/s wr, 674 op/s 2023-07-14T13:28:31.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:31 smithi017 ceph-mon[95536]: pgmap v912: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 688 op/s 2023-07-14T13:28:31.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:31 smithi135 ceph-mon[97338]: pgmap v912: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 688 op/s 2023-07-14T13:28:31.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:31 smithi131 ceph-mon[96953]: pgmap v912: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 688 op/s 2023-07-14T13:28:32.423 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 620.0 s, 284.2 tps, lat 402.398 ms stddev 481.137 2023-07-14T13:28:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.389+0000 7f8f8f19d700 1 -- 172.21.15.17:0/2430814567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88072850 msgr2=0x7f8f88072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.389+0000 7f8f8f19d700 1 --2- 172.21.15.17:0/2430814567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88072850 0x7f8f88072c20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009990 tx=0x7f8f84009ca0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.389+0000 7f8f8f19d700 1 -- 172.21.15.17:0/2430814567 shutdown_connections 2023-07-14T13:28:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.389+0000 7f8f8f19d700 1 --2- 172.21.15.17:0/2430814567 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f8810c3d0 0x7f8f8810e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.389+0000 7f8f8f19d700 1 --2- 172.21.15.17:0/2430814567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f88072850 0x7f8f88072c20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.389+0000 7f8f8f19d700 1 --2- 172.21.15.17:0/2430814567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f88073160 0x7f8f8810be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.389+0000 7f8f8f19d700 1 -- 172.21.15.17:0/2430814567 >> 172.21.15.17:0/2430814567 conn(0x7f8f880fb5f0 msgr2=0x7f8f880fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.390+0000 7f8f8f19d700 1 -- 172.21.15.17:0/2430814567 shutdown_connections 2023-07-14T13:28:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.390+0000 7f8f8f19d700 1 -- 172.21.15.17:0/2430814567 wait complete. 2023-07-14T13:28:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.391+0000 7f8f8f19d700 1 Processor -- start 2023-07-14T13:28:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.392+0000 7f8f8f19d700 1 -- start start 2023-07-14T13:28:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.392+0000 7f8f8f19d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f88072850 0x7f8f8810b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.392+0000 7f8f8f19d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f88073160 0x7f8f881089b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.392+0000 7f8f8f19d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f8810c3d0 0x7f8f88108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.392+0000 7f8f8f19d700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88109430 con 0x7f8f88073160 2023-07-14T13:28:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.392+0000 7f8f8f19d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88109570 con 0x7f8f8810c3d0 2023-07-14T13:28:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.392+0000 7f8f8f19d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88109730 con 0x7f8f88072850 2023-07-14T13:28:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.393+0000 7f8f8e19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f88072850 0x7f8f8810b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.393+0000 7f8f8e99c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f8810c3d0 0x7f8f88108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.393+0000 7f8f8e19b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f88072850 0x7f8f8810b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48136/0 (socket says 172.21.15.17:48136) 2023-07-14T13:28:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.393+0000 7f8f8e19b700 1 -- 172.21.15.17:0/1107974172 learned_addr learned my addr 172.21.15.17:0/1107974172 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.393+0000 7f8f8d99a700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f88073160 0x7f8f881089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.393+0000 7f8f8e19b700 1 -- 172.21.15.17:0/1107974172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f8810c3d0 msgr2=0x7f8f88108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.393+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f8810c3d0 0x7f8f88108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.393+0000 7f8f8e19b700 1 -- 172.21.15.17:0/1107974172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f88073160 msgr2=0x7f8f881089b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.393+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f88073160 0x7f8f881089b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.393+0000 7f8f8e19b700 1 -- 172.21.15.17:0/1107974172 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f78009520 con 0x7f8f88072850 2023-07-14T13:28:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.394+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f88072850 0x7f8f8810b9a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8f84005740 tx=0x7f8f84005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.394+0000 7f8f7f7fe700 1 -- 172.21.15.17:0/1107974172 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8401d070 con 0x7f8f88072850 2023-07-14T13:28:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.394+0000 7f8f8f19d700 1 -- 172.21.15.17:0/1107974172 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f80009c40 con 0x7f8f88072850 2023-07-14T13:28:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.394+0000 7f8f7f7fe700 1 -- 172.21.15.17:0/1107974172 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f84022470 con 0x7f8f88072850 2023-07-14T13:28:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.394+0000 7f8f7f7fe700 1 -- 172.21.15.17:0/1107974172 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f84017650 con 0x7f8f88072850 2023-07-14T13:28:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.394+0000 7f8f8f19d700 1 -- 172.21.15.17:0/1107974172 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f840095f0 con 0x7f8f88072850 2023-07-14T13:28:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.399+0000 7f8f7f7fe700 1 -- 172.21.15.17:0/1107974172 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f8f8400fb00 con 0x7f8f88072850 2023-07-14T13:28:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.400+0000 7f8f7f7fe700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8f740a1340 0x7f8f740a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.400+0000 7f8fa3decb80 1 Processor -- start 2023-07-14T13:28:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.400+0000 7f8f7f7fe700 1 -- 172.21.15.17:0/1107974172 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8f840ce0e0 con 0x7f8f88072850 2023-07-14T13:28:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.401+0000 7f8fa3decb80 1 -- start start 2023-07-14T13:28:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.401+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.401+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c6470 0x5621938c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.401+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c68c0 0x5621938c0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.401+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621937c5c50 con 0x56219371c6b0 2023-07-14T13:28:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.401+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621938189e0 con 0x5621938c6470 2023-07-14T13:28:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.401+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562193811e70 con 0x5621938c68c0 2023-07-14T13:28:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.401+0000 7f8f8d99a700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8f740a1340 0x7f8f740a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.402+0000 7f8f8e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.402+0000 7f8f8e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47650/0 (socket says 172.21.15.17:47650) 2023-07-14T13:28:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.402+0000 7f8f8e19b700 1 -- 172.21.15.17:0/2689385659 learned_addr learned my addr 172.21.15.17:0/2689385659 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:33.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.402+0000 7f8f8d99a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c6470 0x5621938c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.402+0000 7f8f8e99c700 1 --2- 172.21.15.17:0/2689385659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c68c0 0x5621938c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.402+0000 7f8f8e19b700 1 -- 172.21.15.17:0/2689385659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c68c0 msgr2=0x5621938c0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.402+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/2689385659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c68c0 0x5621938c0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.402+0000 7f8f8e19b700 1 -- 172.21.15.17:0/2689385659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c6470 msgr2=0x5621938c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.402+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/2689385659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c6470 0x5621938c01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.402+0000 7f8f8e19b700 1 -- 172.21.15.17:0/2689385659 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56219363fd80 con 0x56219371c6b0 2023-07-14T13:28:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.403+0000 7f8f8d99a700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8f740a1340 0x7f8f740a37f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8f8810a1a0 tx=0x7f8f78013a10 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.403+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/2689385659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c5f30 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f8f8409b000 tx=0x7f8f84097760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a424fd31e0443a5e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.403+0000 7f8f7cbfe700 1 -- 172.21.15.17:0/2689385659 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8409f120 con 0x56219371c6b0 2023-07-14T13:28:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.403+0000 7f8f7cbfe700 1 -- 172.21.15.17:0/2689385659 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f8409f330 con 0x56219371c6b0 2023-07-14T13:28:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.403+0000 7f8f7cbfe700 1 -- 172.21.15.17:0/2689385659 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840997c0 con 0x56219371c6b0 2023-07-14T13:28:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.404+0000 7f8fa3decb80 1 -- 172.21.15.17:0/2689385659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 msgr2=0x5621938c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.404+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/2689385659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c5f30 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f8f8409b000 tx=0x7f8f84097760 comp rx=0 tx=0).stop 2023-07-14T13:28:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.404+0000 7f8fa3decb80 1 -- 172.21.15.17:0/2689385659 shutdown_connections 2023-07-14T13:28:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.404+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/2689385659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c68c0 0x5621938c0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.404+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/2689385659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c5f30 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.404+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/2689385659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c6470 0x5621938c01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.404+0000 7f8fa3decb80 1 -- 172.21.15.17:0/2689385659 >> 172.21.15.17:0/2689385659 conn(0x5621938b5d40 msgr2=0x5621938bb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.404+0000 7f8fa3decb80 1 -- 172.21.15.17:0/2689385659 shutdown_connections 2023-07-14T13:28:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.404+0000 7f8fa3decb80 1 -- 172.21.15.17:0/2689385659 wait complete. 2023-07-14T13:28:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.405+0000 7f8fa3decb80 1 -- start start 2023-07-14T13:28:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.405+0000 7f8fa3decb80 1 Processor -- start 2023-07-14T13:28:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c6470 0x5621938cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 0x5621938c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621937b1a60 con 0x56219371c6b0 2023-07-14T13:28:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621937b1760 con 0x5621938c68c0 2023-07-14T13:28:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621936958c0 con 0x5621938c6470 2023-07-14T13:28:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8fa3decb80 10 client.0 _ll_register_callbacks cb 0x5621937af700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:28:33.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8f8e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8f8e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47664/0 (socket says 172.21.15.17:47664) 2023-07-14T13:28:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8f8e19b700 1 -- 172.21.15.17:0/1807676219 learned_addr learned my addr 172.21.15.17:0/1807676219 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8f8e99c700 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 0x5621938c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.413 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.406+0000 7f8f8d99a700 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c6470 0x5621938cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8f8e19b700 1 -- 172.21.15.17:0/1807676219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c6470 msgr2=0x5621938cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c6470 0x5621938cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8f8e19b700 1 -- 172.21.15.17:0/1807676219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 msgr2=0x5621938c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 0x5621938c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8f8e19b700 1 -- 172.21.15.17:0/1807676219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f840095f0 con 0x56219371c6b0 2023-07-14T13:28:33.415 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8f8e99c700 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 0x5621938c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:28:33.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938cf3d0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f8f840cbe70 tx=0x7f8f8409b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b7427855fe535e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:33.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8f71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:28:33.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8f71ffb700 1 -- 172.21.15.17:0/1807676219 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840a36c0 con 0x56219371c6b0 2023-07-14T13:28:33.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8f71ffb700 1 -- 172.21.15.17:0/1807676219 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8f84022850 con 0x56219371c6b0 2023-07-14T13:28:33.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8fa3decb80 1 -- 172.21.15.17:0/1807676219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56219376b490 con 0x56219371c6b0 2023-07-14T13:28:33.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8f71ffb700 1 -- 172.21.15.17:0/1807676219 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f8409b560 con 0x56219371c6b0 2023-07-14T13:28:33.416 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8fa3decb80 10 client.19623 fetch_fsmap learned FSMap version 66 2023-07-14T13:28:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.407+0000 7f8fa3decb80 1 -- 172.21.15.17:0/1807676219 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x562193628c00 con 0x56219371c6b0 2023-07-14T13:28:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.408+0000 7f8f71ffb700 1 -- 172.21.15.17:0/1807676219 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56219376b490 con 0x56219371c6b0 2023-07-14T13:28:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.408+0000 7f8f71ffb700 1 -- 172.21.15.17:0/1807676219 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 66) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f8f8409a7f0 con 0x56219371c6b0 2023-07-14T13:28:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.408+0000 7f8fa3decb80 10 client.19623 fetch_fsmap finished waiting for FSMap version 66 2023-07-14T13:28:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.408+0000 7f8fa3decb80 10 client.19623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:28:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.408+0000 7f8fa3decb80 20 client.19623 populate_metadata read hostname 'smithi017' 2023-07-14T13:28:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.408+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621938d9540 0x5621938db950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.417 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.408+0000 7f8fa3decb80 4 client.19623 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:28:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.408+0000 7f8fa3decb80 1 -- 172.21.15.17:0/1807676219 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56219380ae50 con 0x5621938d9540 2023-07-14T13:28:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.408+0000 7f8f8d99a700 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621938d9540 0x5621938db950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.409+0000 7f8f8d99a700 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621938d9540 0x5621938db950 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a9bce63cba8ecfb server_cookie=beee7f333c0b322 in_seq=0 out_seq=0 2023-07-14T13:28:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.409+0000 7f8f71ffb700 10 client.19623 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8f71ffb700 1 -- 172.21.15.17:0/1807676219 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56219380ae50 con 0x5621938d9540 2023-07-14T13:28:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8f71ffb700 10 client.19623 handle_command_reply: tid=0 2023-07-14T13:28:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8fa3decb80 1 client.19623 shutdown 2023-07-14T13:28:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8fa3decb80 1 -- 172.21.15.17:0/1807676219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 msgr2=0x5621938cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938cf3d0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f8f840cbe70 tx=0x7f8f8409b3c0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8fa3decb80 1 -- 172.21.15.17:0/1807676219 shutdown_connections 2023-07-14T13:28:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5621938d9540 0x5621938db950 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 0x5621938c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938cf3d0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8f71ffb700 0 client.19623 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/1807676219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c6470 0x5621938cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8fa3decb80 1 -- 172.21.15.17:0/1807676219 >> 172.21.15.17:0/1807676219 conn(0x5621938b5d40 msgr2=0x5621938ba640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8fa3decb80 1 -- 172.21.15.17:0/1807676219 shutdown_connections 2023-07-14T13:28:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.410+0000 7f8fa3decb80 1 -- 172.21.15.17:0/1807676219 wait complete. 2023-07-14T13:28:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.411+0000 7f8fa3decb80 20 client.19623 trim_cache size 0 max 16384 2023-07-14T13:28:33.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.431+0000 7f8fa3decb80 1 Processor -- start 2023-07-14T13:28:33.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.431+0000 7f8fa3decb80 1 -- start start 2023-07-14T13:28:33.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.431+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.431+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c6470 0x5621938c7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.431+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 0x5621938c8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.431+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621938c13f0 con 0x56219371c6b0 2023-07-14T13:28:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.431+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621938c4460 con 0x5621938c68c0 2023-07-14T13:28:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.431+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621938dbfb0 con 0x5621938c6470 2023-07-14T13:28:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.432+0000 7f8f8e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.432+0000 7f8f8e19b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47680/0 (socket says 172.21.15.17:47680) 2023-07-14T13:28:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.432+0000 7f8f8e19b700 1 -- 172.21.15.17:0/651374603 learned_addr learned my addr 172.21.15.17:0/651374603 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.432+0000 7f8f8e99c700 1 --2- 172.21.15.17:0/651374603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 0x5621938c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.432+0000 7f8f8d99a700 1 --2- 172.21.15.17:0/651374603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c6470 0x5621938c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.432+0000 7f8f8e19b700 1 -- 172.21.15.17:0/651374603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c6470 msgr2=0x5621938c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.432+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/651374603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c6470 0x5621938c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.432+0000 7f8f8e19b700 1 -- 172.21.15.17:0/651374603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 msgr2=0x5621938c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.432+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/651374603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 0x5621938c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.432+0000 7f8f8e19b700 1 -- 172.21.15.17:0/651374603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621936661f0 con 0x56219371c6b0 2023-07-14T13:28:33.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.432+0000 7f8f8e99c700 1 --2- 172.21.15.17:0/651374603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 0x5621938c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:28:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.433+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/651374603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c98a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f8f84006010 tx=0x7f8f8409b160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cd007fcc876f2a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.433+0000 7f8f7d3ff700 1 -- 172.21.15.17:0/651374603 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f84017e90 con 0x56219371c6b0 2023-07-14T13:28:33.439 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.433+0000 7f8f7d3ff700 1 -- 172.21.15.17:0/651374603 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f8409f120 con 0x56219371c6b0 2023-07-14T13:28:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.433+0000 7f8f7d3ff700 1 -- 172.21.15.17:0/651374603 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840a3380 con 0x56219371c6b0 2023-07-14T13:28:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.434+0000 7f8fa3decb80 1 -- 172.21.15.17:0/651374603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 msgr2=0x5621938c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.434+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/651374603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c98a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f8f84006010 tx=0x7f8f8409b160 comp rx=0 tx=0).stop 2023-07-14T13:28:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.434+0000 7f8fa3decb80 1 -- 172.21.15.17:0/651374603 shutdown_connections 2023-07-14T13:28:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.434+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/651374603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621938c68c0 0x5621938c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.434+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/651374603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56219371c6b0 0x5621938c98a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.434+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/651374603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c6470 0x5621938c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.434+0000 7f8fa3decb80 1 -- 172.21.15.17:0/651374603 >> 172.21.15.17:0/651374603 conn(0x5621938b5d40 msgr2=0x5621938c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.434+0000 7f8fa3decb80 1 -- 172.21.15.17:0/651374603 shutdown_connections 2023-07-14T13:28:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.434+0000 7f8fa3decb80 1 -- 172.21.15.17:0/651374603 wait complete. 2023-07-14T13:28:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.435+0000 7f8fa3decb80 1 -- start start 2023-07-14T13:28:33.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.435+0000 7f8fa3decb80 1 Processor -- start 2023-07-14T13:28:33.442 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56219371c6b0 0x562193925fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621938c6470 0x562193926500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8fa3decb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c68c0 0x5621938cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621938cf400 con 0x5621938c6470 2023-07-14T13:28:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621938cf570 con 0x56219371c6b0 2023-07-14T13:28:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8fa3decb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621938cf730 con 0x5621938c68c0 2023-07-14T13:28:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8fa3decb80 10 client.0 _ll_register_callbacks cb 0x7f8f78009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:28:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8f8e99c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c68c0 0x5621938cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8f8e19b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56219371c6b0 0x562193925fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8f8e99c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c68c0 0x5621938cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48164/0 (socket says 172.21.15.17:48164) 2023-07-14T13:28:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8f8e99c700 1 -- 172.21.15.17:0/4276606845 learned_addr learned my addr 172.21.15.17:0/4276606845 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.436+0000 7f8f8d99a700 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621938c6470 0x562193926500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.437+0000 7f8f8e19b700 1 -- 172.21.15.17:0/4276606845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c68c0 msgr2=0x5621938cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.437+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c68c0 0x5621938cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.437+0000 7f8f8e19b700 1 -- 172.21.15.17:0/4276606845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621938c6470 msgr2=0x562193926500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:33.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.437+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621938c6470 0x562193926500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.437+0000 7f8f8e19b700 1 -- 172.21.15.17:0/4276606845 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f80007680 con 0x56219371c6b0 2023-07-14T13:28:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.437+0000 7f8f8d99a700 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621938c6470 0x562193926500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:28:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.437+0000 7f8f8e19b700 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56219371c6b0 0x562193925fc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8f84006010 tx=0x7f8f84022b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2fd1dec837e14c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.437+0000 7f8f71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:28:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.438+0000 7f8f71ffb700 1 -- 172.21.15.17:0/4276606845 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8409b560 con 0x56219371c6b0 2023-07-14T13:28:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.438+0000 7f8f71ffb700 1 -- 172.21.15.17:0/4276606845 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8f8409b6c0 con 0x56219371c6b0 2023-07-14T13:28:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.438+0000 7f8fa3decb80 1 -- 172.21.15.17:0/4276606845 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f8409f330 con 0x56219371c6b0 2023-07-14T13:28:33.445 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.438+0000 7f8f71ffb700 1 -- 172.21.15.17:0/4276606845 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f84084b00 con 0x56219371c6b0 2023-07-14T13:28:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.438+0000 7f8fa3decb80 10 client.29396 fetch_fsmap learned FSMap version 66 2023-07-14T13:28:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.438+0000 7f8fa3decb80 1 -- 172.21.15.17:0/4276606845 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x562193628c00 con 0x56219371c6b0 2023-07-14T13:28:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.438+0000 7f8f71ffb700 1 -- 172.21.15.17:0/4276606845 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f8409f330 con 0x56219371c6b0 2023-07-14T13:28:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.439+0000 7f8f71ffb700 1 -- 172.21.15.17:0/4276606845 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f8f8409a2f0 con 0x56219371c6b0 2023-07-14T13:28:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.439+0000 7f8fa3decb80 10 client.29396 fetch_fsmap finished waiting for FSMap version 66 2023-07-14T13:28:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.439+0000 7f8fa3decb80 10 client.29396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:28:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.439+0000 7f8fa3decb80 20 client.29396 populate_metadata read hostname 'smithi017' 2023-07-14T13:28:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.439+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56219392d910 0x56219392fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.439+0000 7f8fa3decb80 4 client.29396 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:28:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.439+0000 7f8fa3decb80 1 -- 172.21.15.17:0/4276606845 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5621937ccff0 con 0x56219392d910 2023-07-14T13:28:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.439+0000 7f8f8d99a700 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56219392d910 0x56219392fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.440+0000 7f8f8d99a700 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56219392d910 0x56219392fcf0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f04077ceeff55769 server_cookie=7117e7ed6c994f67 in_seq=0 out_seq=0 2023-07-14T13:28:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.440+0000 7f8f71ffb700 10 client.29396 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.488+0000 7f8f71ffb700 1 -- 172.21.15.17:0/4276606845 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5621937ccff0 con 0x56219392d910 2023-07-14T13:28:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.488+0000 7f8f71ffb700 10 client.29396 handle_command_reply: tid=0 2023-07-14T13:28:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.488+0000 7f8fa3decb80 1 client.29396 shutdown 2023-07-14T13:28:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.488+0000 7f8fa3decb80 1 -- 172.21.15.17:0/4276606845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56219371c6b0 msgr2=0x562193925fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.488+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56219371c6b0 0x562193925fc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8f84006010 tx=0x7f8f84022b90 comp rx=0 tx=0).stop 2023-07-14T13:28:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.489+0000 7f8fa3decb80 1 -- 172.21.15.17:0/4276606845 shutdown_connections 2023-07-14T13:28:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.489+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56219392d910 0x56219392fcf0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.489+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621938c68c0 0x5621938cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.489+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56219371c6b0 0x562193925fc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.489+0000 7f8fa3decb80 1 --2- 172.21.15.17:0/4276606845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5621938c6470 0x562193926500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.489+0000 7f8fa3decb80 1 -- 172.21.15.17:0/4276606845 >> 172.21.15.17:0/4276606845 conn(0x5621938b5d40 msgr2=0x5621938c1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.489+0000 7f8f71ffb700 0 client.29396 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.489+0000 7f8fa3decb80 1 -- 172.21.15.17:0/4276606845 shutdown_connections 2023-07-14T13:28:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.490+0000 7f8fa3decb80 1 -- 172.21.15.17:0/4276606845 wait complete. 2023-07-14T13:28:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.490+0000 7f8fa3decb80 20 client.29396 trim_cache size 0 max 16384 2023-07-14T13:28:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:28:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:28:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:28:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:28:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.491+0000 7f8f8f19d700 1 -- 172.21.15.17:0/1107974172 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8f740a1340 msgr2=0x7f8f740a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.491+0000 7f8f8f19d700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8f740a1340 0x7f8f740a37f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8f8810a1a0 tx=0x7f8f78013a10 comp rx=0 tx=0).stop 2023-07-14T13:28:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.491+0000 7f8f8f19d700 1 -- 172.21.15.17:0/1107974172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f88072850 msgr2=0x7f8f8810b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.491+0000 7f8f8f19d700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f88072850 0x7f8f8810b9a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8f84005740 tx=0x7f8f84005770 comp rx=0 tx=0).stop 2023-07-14T13:28:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.491+0000 7f8f8f19d700 1 -- 172.21.15.17:0/1107974172 shutdown_connections 2023-07-14T13:28:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.491+0000 7f8f8f19d700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f8f740a1340 0x7f8f740a37f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.491+0000 7f8f8f19d700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f8810c3d0 0x7f8f88108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.491+0000 7f8f8f19d700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f88072850 0x7f8f8810b9a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.491+0000 7f8f8f19d700 1 --2- 172.21.15.17:0/1107974172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f88073160 0x7f8f881089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.491+0000 7f8f8f19d700 1 -- 172.21.15.17:0/1107974172 >> 172.21.15.17:0/1107974172 conn(0x7f8f880fb5f0 msgr2=0x7f8f8810e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.492+0000 7f8f8f19d700 1 -- 172.21.15.17:0/1107974172 shutdown_connections 2023-07-14T13:28:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:33.492+0000 7f8f8f19d700 1 -- 172.21.15.17:0/1107974172 wait complete. 2023-07-14T13:28:33.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:33 smithi017 ceph-mon[95536]: pgmap v913: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.6 MiB/s wr, 897 op/s 2023-07-14T13:28:33.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:33 smithi135 ceph-mon[97338]: pgmap v913: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.6 MiB/s wr, 897 op/s 2023-07-14T13:28:33.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:33 smithi131 ceph-mon[96953]: pgmap v913: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.6 MiB/s wr, 897 op/s 2023-07-14T13:28:35.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:35 smithi017 ceph-mon[95536]: pgmap v914: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 621 op/s 2023-07-14T13:28:35.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:35 smithi135 ceph-mon[97338]: pgmap v914: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 621 op/s 2023-07-14T13:28:35.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:35 smithi131 ceph-mon[96953]: pgmap v914: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 621 op/s 2023-07-14T13:28:37.423 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 625.0 s, 252.4 tps, lat 402.901 ms stddev 409.818 2023-07-14T13:28:37.830 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:37 smithi017 ceph-mon[95536]: pgmap v915: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.7 MiB/s wr, 986 op/s 2023-07-14T13:28:37.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:37 smithi135 ceph-mon[97338]: pgmap v915: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.7 MiB/s wr, 986 op/s 2023-07-14T13:28:37.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:37 smithi131 ceph-mon[96953]: pgmap v915: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.7 MiB/s wr, 986 op/s 2023-07-14T13:28:39.835 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:39 smithi017 ceph-mon[95536]: pgmap v916: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.9 MiB/s wr, 739 op/s 2023-07-14T13:28:39.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:39 smithi135 ceph-mon[97338]: pgmap v916: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.9 MiB/s wr, 739 op/s 2023-07-14T13:28:39.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:39 smithi131 ceph-mon[96953]: pgmap v916: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.9 MiB/s wr, 739 op/s 2023-07-14T13:28:41.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:41 smithi135 ceph-mon[97338]: pgmap v917: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.8 MiB/s wr, 745 op/s 2023-07-14T13:28:41.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:41 smithi131 ceph-mon[96953]: pgmap v917: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.8 MiB/s wr, 745 op/s 2023-07-14T13:28:42.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:41 smithi017 ceph-mon[95536]: pgmap v917: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.8 MiB/s wr, 745 op/s 2023-07-14T13:28:42.422 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 630.0 s, 203.6 tps, lat 427.004 ms stddev 397.364 2023-07-14T13:28:43.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:43 smithi135 ceph-mon[97338]: pgmap v918: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.9 MiB/s wr, 1.01k op/s 2023-07-14T13:28:43.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:43 smithi131 ceph-mon[96953]: pgmap v918: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.9 MiB/s wr, 1.01k op/s 2023-07-14T13:28:44.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:43 smithi017 ceph-mon[95536]: pgmap v918: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.9 MiB/s wr, 1.01k op/s 2023-07-14T13:28:45.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:45 smithi135 ceph-mon[97338]: pgmap v919: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 755 op/s 2023-07-14T13:28:45.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:45 smithi131 ceph-mon[96953]: pgmap v919: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 755 op/s 2023-07-14T13:28:46.082 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:45 smithi017 ceph-mon[95536]: pgmap v919: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 755 op/s 2023-07-14T13:28:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.770+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/3794113793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc58107010 msgr2=0x7fdc5810ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.770+0000 7fdc5c9ff700 1 --2- 172.21.15.17:0/3794113793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc58107010 0x7fdc5810ebe0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b0a0 tx=0x7fdc5000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.770+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/3794113793 shutdown_connections 2023-07-14T13:28:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.770+0000 7fdc5c9ff700 1 --2- 172.21.15.17:0/3794113793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc58107010 0x7fdc5810ebe0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.770+0000 7fdc5c9ff700 1 --2- 172.21.15.17:0/3794113793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc58101fd0 0x7fdc581023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.770+0000 7fdc5c9ff700 1 --2- 172.21.15.17:0/3794113793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc58102970 0x7fdc58106930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.775 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.770+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/3794113793 >> 172.21.15.17:0/3794113793 conn(0x7fdc580fd840 msgr2=0x7fdc580ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:46.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.770+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/3794113793 shutdown_connections 2023-07-14T13:28:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.771+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/3794113793 wait complete. 2023-07-14T13:28:46.777 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.772+0000 7fdc5c9ff700 1 Processor -- start 2023-07-14T13:28:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.772+0000 7fdc5c9ff700 1 -- start start 2023-07-14T13:28:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.772+0000 7fdc5c9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc58101fd0 0x7fdc5810d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.773+0000 7fdc5c9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc58102970 0x7fdc5810d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.773+0000 7fdc5c9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc58107010 0x7fdc581a8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.773+0000 7fdc5c9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc581a8740 con 0x7fdc58101fd0 2023-07-14T13:28:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.773+0000 7fdc5c9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc581a8880 con 0x7fdc58102970 2023-07-14T13:28:46.778 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.773+0000 7fdc5c9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc581a8a40 con 0x7fdc58107010 2023-07-14T13:28:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.773+0000 7fdc5659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc58101fd0 0x7fdc5810d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.773+0000 7fdc5659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc58101fd0 0x7fdc5810d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48902/0 (socket says 172.21.15.17:48902) 2023-07-14T13:28:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.773+0000 7fdc5659c700 1 -- 172.21.15.17:0/2060600824 learned_addr learned my addr 172.21.15.17:0/2060600824 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.773+0000 7fdc56d9d700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc58107010 0x7fdc581a8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.774+0000 7fdc5659c700 1 -- 172.21.15.17:0/2060600824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc58107010 msgr2=0x7fdc581a8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.774+0000 7fdc5659c700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc58107010 0x7fdc581a8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.774+0000 7fdc5659c700 1 -- 172.21.15.17:0/2060600824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc58102970 msgr2=0x7fdc5810d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:46.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.774+0000 7fdc5659c700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc58102970 0x7fdc5810d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.774+0000 7fdc5659c700 1 -- 172.21.15.17:0/2060600824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc50009d00 con 0x7fdc58101fd0 2023-07-14T13:28:46.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.774+0000 7fdc5659c700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc58101fd0 0x7fdc5810d220 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800d950 tx=0x7fdc4800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:46.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.775+0000 7fdc477fe700 1 -- 172.21.15.17:0/2060600824 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48009940 con 0x7fdc58101fd0 2023-07-14T13:28:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.775+0000 7fdc477fe700 1 -- 172.21.15.17:0/2060600824 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc48010460 con 0x7fdc58101fd0 2023-07-14T13:28:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.775+0000 7fdc477fe700 1 -- 172.21.15.17:0/2060600824 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800f620 con 0x7fdc58101fd0 2023-07-14T13:28:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.775+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/2060600824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc581a8d20 con 0x7fdc58101fd0 2023-07-14T13:28:46.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.775+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/2060600824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc581a9180 con 0x7fdc58101fd0 2023-07-14T13:28:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.781+0000 7fdc477fe700 1 -- 172.21.15.17:0/2060600824 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fdc480105d0 con 0x7fdc58101fd0 2023-07-14T13:28:46.785 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.782+0000 7fdc70360b80 1 Processor -- start 2023-07-14T13:28:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.782+0000 7fdc70360b80 1 -- start start 2023-07-14T13:28:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.783+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c04d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.783+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3c052d0 0x55a6b3bff040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.783+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3bff580 0x55a6b3bff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.783+0000 7fdc70360b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3b04c50 con 0x55a6b3bff580 2023-07-14T13:28:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.783+0000 7fdc70360b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3b579e0 con 0x55a6b3c052d0 2023-07-14T13:28:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.783+0000 7fdc70360b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3b50e70 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.784+0000 7fdc56d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c04d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.784+0000 7fdc56d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c04d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:43376/0 (socket says 172.21.15.17:43376) 2023-07-14T13:28:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.784+0000 7fdc56d9d700 1 -- 172.21.15.17:0/10827733 learned_addr learned my addr 172.21.15.17:0/10827733 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.784+0000 7fdc477fe700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdc400a1340 0x7fdc400a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.784+0000 7fdc56d9d700 1 -- 172.21.15.17:0/10827733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3c052d0 msgr2=0x55a6b3bff040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.784+0000 7fdc56d9d700 1 --2- 172.21.15.17:0/10827733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3c052d0 0x55a6b3bff040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.784+0000 7fdc56d9d700 1 -- 172.21.15.17:0/10827733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3bff580 msgr2=0x55a6b3bff9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.784+0000 7fdc56d9d700 1 --2- 172.21.15.17:0/10827733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3bff580 0x55a6b3bff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.784+0000 7fdc56d9d700 1 -- 172.21.15.17:0/10827733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6b397ed80 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.784+0000 7fdc477fe700 1 -- 172.21.15.17:0/2060600824 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdc480ccab0 con 0x7fdc58101fd0 2023-07-14T13:28:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.785+0000 7fdc56d9d700 1 --2- 172.21.15.17:0/10827733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c04d90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdc50015000 tx=0x7fdc5000ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84ca0d93c75cbae3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.785+0000 7fdc56d9d700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdc400a1340 0x7fdc400a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.785+0000 7fdc44ff9700 1 -- 172.21.15.17:0/10827733 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000e040 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.785+0000 7fdc44ff9700 1 -- 172.21.15.17:0/10827733 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc50003e90 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.785+0000 7fdc44ff9700 1 -- 172.21.15.17:0/10827733 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50027960 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.786+0000 7fdc70360b80 1 -- 172.21.15.17:0/10827733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3a5b6b0 msgr2=0x55a6b3c04d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.786+0000 7fdc70360b80 1 --2- 172.21.15.17:0/10827733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c04d90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdc50015000 tx=0x7fdc5000ceb0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.786+0000 7fdc56d9d700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdc400a1340 0x7fdc400a37f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdc500061c0 tx=0x7fdc50027ac0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.787+0000 7fdc70360b80 1 -- 172.21.15.17:0/10827733 shutdown_connections 2023-07-14T13:28:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.787+0000 7fdc70360b80 1 --2- 172.21.15.17:0/10827733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3bff580 0x55a6b3bff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.787+0000 7fdc70360b80 1 --2- 172.21.15.17:0/10827733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c04d90 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.787+0000 7fdc70360b80 1 --2- 172.21.15.17:0/10827733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3c052d0 0x55a6b3bff040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.787+0000 7fdc70360b80 1 -- 172.21.15.17:0/10827733 >> 172.21.15.17:0/10827733 conn(0x55a6b3bf4be0 msgr2=0x55a6b3bf9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.787+0000 7fdc70360b80 1 -- 172.21.15.17:0/10827733 shutdown_connections 2023-07-14T13:28:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.787+0000 7fdc70360b80 1 -- 172.21.15.17:0/10827733 wait complete. 2023-07-14T13:28:46.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.788+0000 7fdc70360b80 1 -- start start 2023-07-14T13:28:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.788+0000 7fdc70360b80 1 Processor -- start 2023-07-14T13:28:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c0b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3bff580 0x55a6b3c08890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3c052d0 0x55a6b3c08fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc70360b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3af0a60 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc70360b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3af0760 con 0x55a6b3bff580 2023-07-14T13:28:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc70360b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b39d48c0 con 0x55a6b3c052d0 2023-07-14T13:28:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc70360b80 10 client.0 _ll_register_callbacks cb 0x55a6b3aee700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:28:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc55d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3bff580 0x55a6b3c08890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc55d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3bff580 0x55a6b3c08890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44764/0 (socket says 172.21.15.17:44764) 2023-07-14T13:28:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc55d9b700 1 -- 172.21.15.17:0/3992682357 learned_addr learned my addr 172.21.15.17:0/3992682357 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc5659c700 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c0b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.789+0000 7fdc56d9d700 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3c052d0 0x55a6b3c08fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.790+0000 7fdc55d9b700 1 -- 172.21.15.17:0/3992682357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3c052d0 msgr2=0x55a6b3c08fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.790+0000 7fdc55d9b700 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3c052d0 0x55a6b3c08fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.790+0000 7fdc55d9b700 1 -- 172.21.15.17:0/3992682357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 msgr2=0x55a6b3c0b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.790+0000 7fdc55d9b700 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c0b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.790+0000 7fdc55d9b700 1 -- 172.21.15.17:0/3992682357 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5810f420 con 0x55a6b3bff580 2023-07-14T13:28:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.790+0000 7fdc55d9b700 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3bff580 0x55a6b3c08890 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00c350 tx=0x7fdc4c00c660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8ae80038df68c52 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.790+0000 7fdc3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:28:46.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.790+0000 7fdc3dffb700 1 -- 172.21.15.17:0/3992682357 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c004a30 con 0x55a6b3bff580 2023-07-14T13:28:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.791+0000 7fdc70360b80 1 -- 172.21.15.17:0/3992682357 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6b3aaa490 con 0x55a6b3bff580 2023-07-14T13:28:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.791+0000 7fdc3dffb700 1 -- 172.21.15.17:0/3992682357 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdc4c004b90 con 0x55a6b3bff580 2023-07-14T13:28:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.791+0000 7fdc3dffb700 1 -- 172.21.15.17:0/3992682357 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc4c004d50 con 0x55a6b3bff580 2023-07-14T13:28:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.791+0000 7fdc70360b80 10 client.29402 fetch_fsmap learned FSMap version 66 2023-07-14T13:28:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.791+0000 7fdc70360b80 1 -- 172.21.15.17:0/3992682357 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55a6b3967c00 con 0x55a6b3bff580 2023-07-14T13:28:46.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.791+0000 7fdc3dffb700 1 -- 172.21.15.17:0/3992682357 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a6b3aaa490 con 0x55a6b3bff580 2023-07-14T13:28:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.792+0000 7fdc3dffb700 1 -- 172.21.15.17:0/3992682357 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdc4c016030 con 0x55a6b3bff580 2023-07-14T13:28:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.792+0000 7fdc70360b80 10 client.29402 fetch_fsmap finished waiting for FSMap version 66 2023-07-14T13:28:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.792+0000 7fdc70360b80 10 client.29402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:28:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.792+0000 7fdc70360b80 20 client.29402 populate_metadata read hostname 'smithi017' 2023-07-14T13:28:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.792+0000 7fdc70360b80 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a6b3c18c00 0x55a6b3c1b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.792+0000 7fdc70360b80 4 client.29402 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:28:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.792+0000 7fdc70360b80 1 -- 172.21.15.17:0/3992682357 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a6b3b49e50 con 0x55a6b3c18c00 2023-07-14T13:28:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.792+0000 7fdc5659c700 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a6b3c18c00 0x55a6b3c1b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.793+0000 7fdc5659c700 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a6b3c18c00 0x55a6b3c1b010 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edffc459ad6c54a2 server_cookie=4f1d1147be3fecea in_seq=0 out_seq=0 2023-07-14T13:28:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.793+0000 7fdc3dffb700 10 client.29402 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc3dffb700 1 -- 172.21.15.17:0/3992682357 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a6b3b49e50 con 0x55a6b3c18c00 2023-07-14T13:28:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc3dffb700 10 client.29402 handle_command_reply: tid=0 2023-07-14T13:28:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc70360b80 1 client.29402 shutdown 2023-07-14T13:28:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc70360b80 1 -- 172.21.15.17:0/3992682357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3bff580 msgr2=0x55a6b3c08890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc70360b80 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3bff580 0x55a6b3c08890 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00c350 tx=0x7fdc4c00c660 comp rx=0 tx=0).stop 2023-07-14T13:28:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc70360b80 1 -- 172.21.15.17:0/3992682357 shutdown_connections 2023-07-14T13:28:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc70360b80 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a6b3c18c00 0x55a6b3c1b010 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc70360b80 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3c052d0 0x55a6b3c08fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc70360b80 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c0b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc3dffb700 0 client.29402 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc70360b80 1 --2- 172.21.15.17:0/3992682357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3bff580 0x55a6b3c08890 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.794+0000 7fdc70360b80 1 -- 172.21.15.17:0/3992682357 >> 172.21.15.17:0/3992682357 conn(0x55a6b3bf4be0 msgr2=0x55a6b3bf8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.795+0000 7fdc70360b80 1 -- 172.21.15.17:0/3992682357 shutdown_connections 2023-07-14T13:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.795+0000 7fdc70360b80 1 -- 172.21.15.17:0/3992682357 wait complete. 2023-07-14T13:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.795+0000 7fdc70360b80 20 client.29402 trim_cache size 0 max 16384 2023-07-14T13:28:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.818+0000 7fdc70360b80 1 Processor -- start 2023-07-14T13:28:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.818+0000 7fdc70360b80 1 -- start start 2023-07-14T13:28:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.818+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3bff040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.818+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3bff580 0x55a6b3c0fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.818+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3c052d0 0x55a6b3c04120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.818+0000 7fdc70360b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3bf65f0 con 0x55a6b3bff580 2023-07-14T13:28:46.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.818+0000 7fdc70360b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3c14b30 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.818+0000 7fdc70360b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3bfaaa0 con 0x55a6b3c052d0 2023-07-14T13:28:46.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc55d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3bff580 0x55a6b3c0fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc5659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3bff040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc55d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3bff580 0x55a6b3c0fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48930/0 (socket says 172.21.15.17:48930) 2023-07-14T13:28:46.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc5659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3bff040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:44780/0 (socket says 172.21.15.17:44780) 2023-07-14T13:28:46.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc55d9b700 1 -- 172.21.15.17:0/3781693785 learned_addr learned my addr 172.21.15.17:0/3781693785 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:46.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc56d9d700 1 --2- 172.21.15.17:0/3781693785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3c052d0 0x55a6b3c04120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc55d9b700 1 -- 172.21.15.17:0/3781693785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3c052d0 msgr2=0x55a6b3c04120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:46.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc55d9b700 1 --2- 172.21.15.17:0/3781693785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3c052d0 0x55a6b3c04120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc55d9b700 1 -- 172.21.15.17:0/3781693785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3a5b6b0 msgr2=0x55a6b3bff040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:46.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc55d9b700 1 --2- 172.21.15.17:0/3781693785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3bff040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc55d9b700 1 -- 172.21.15.17:0/3781693785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6b39a51f0 con 0x55a6b3bff580 2023-07-14T13:28:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.819+0000 7fdc5659c700 1 --2- 172.21.15.17:0/3781693785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3bff040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:28:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.820+0000 7fdc55d9b700 1 --2- 172.21.15.17:0/3781693785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3bff580 0x55a6b3c0fc70 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c000c00 tx=0x7fdc4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108452ec7caf5075 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.821+0000 7fdc457fa700 1 -- 172.21.15.17:0/3781693785 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c00c9b0 con 0x55a6b3bff580 2023-07-14T13:28:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.821+0000 7fdc457fa700 1 -- 172.21.15.17:0/3781693785 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc4c004cc0 con 0x55a6b3bff580 2023-07-14T13:28:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.821+0000 7fdc457fa700 1 -- 172.21.15.17:0/3781693785 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c00fa20 con 0x55a6b3bff580 2023-07-14T13:28:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.821+0000 7fdc70360b80 1 -- 172.21.15.17:0/3781693785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3bff580 msgr2=0x55a6b3c0fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.821+0000 7fdc70360b80 1 --2- 172.21.15.17:0/3781693785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3bff580 0x55a6b3c0fc70 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c000c00 tx=0x7fdc4c00a430 comp rx=0 tx=0).stop 2023-07-14T13:28:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.821+0000 7fdc70360b80 1 -- 172.21.15.17:0/3781693785 shutdown_connections 2023-07-14T13:28:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.821+0000 7fdc70360b80 1 --2- 172.21.15.17:0/3781693785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3c052d0 0x55a6b3c04120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.821+0000 7fdc70360b80 1 --2- 172.21.15.17:0/3781693785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3bff040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.821+0000 7fdc70360b80 1 --2- 172.21.15.17:0/3781693785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3bff580 0x55a6b3c0fc70 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.821+0000 7fdc70360b80 1 -- 172.21.15.17:0/3781693785 >> 172.21.15.17:0/3781693785 conn(0x55a6b3bf4be0 msgr2=0x55a6b3c03a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.822+0000 7fdc70360b80 1 -- 172.21.15.17:0/3781693785 shutdown_connections 2023-07-14T13:28:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.822+0000 7fdc70360b80 1 -- 172.21.15.17:0/3781693785 wait complete. 2023-07-14T13:28:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.822+0000 7fdc70360b80 1 -- start start 2023-07-14T13:28:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.822+0000 7fdc70360b80 1 Processor -- start 2023-07-14T13:28:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.823+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c0e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.823+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3bff580 0x55a6b3c0e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.823+0000 7fdc70360b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3c052d0 0x55a6b3c0ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.823+0000 7fdc70360b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3c6ca90 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.823+0000 7fdc70360b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3c6cbd0 con 0x55a6b3c052d0 2023-07-14T13:28:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.823+0000 7fdc70360b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6b3c6cd10 con 0x55a6b3bff580 2023-07-14T13:28:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.823+0000 7fdc70360b80 10 client.0 _ll_register_callbacks cb 0x7fdc4c00a8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:28:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.824+0000 7fdc5659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c0e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.824+0000 7fdc5659c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c0e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48946/0 (socket says 172.21.15.17:48946) 2023-07-14T13:28:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.824+0000 7fdc5659c700 1 -- 172.21.15.17:0/600018117 learned_addr learned my addr 172.21.15.17:0/600018117 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:28:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.824+0000 7fdc55d9b700 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3bff580 0x55a6b3c0e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.824+0000 7fdc56d9d700 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3c052d0 0x55a6b3c0ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.824+0000 7fdc5659c700 1 -- 172.21.15.17:0/600018117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3bff580 msgr2=0x55a6b3c0e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.824+0000 7fdc5659c700 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3bff580 0x55a6b3c0e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.824+0000 7fdc5659c700 1 -- 172.21.15.17:0/600018117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3c052d0 msgr2=0x55a6b3c0ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:28:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.824+0000 7fdc5659c700 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3c052d0 0x55a6b3c0ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.824+0000 7fdc5659c700 1 -- 172.21.15.17:0/600018117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc581a9180 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.825+0000 7fdc5659c700 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c0e2e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdc480ca280 tx=0x7fdc48095ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e4ed3e4396fc7c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:28:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.825+0000 7fdc3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:28:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.826+0000 7fdc3dffb700 1 -- 172.21.15.17:0/600018117 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480a1ff0 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.826+0000 7fdc3dffb700 1 -- 172.21.15.17:0/600018117 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdc480b22b0 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.826+0000 7fdc70360b80 1 -- 172.21.15.17:0/600018117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc50003e90 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.826+0000 7fdc3dffb700 1 -- 172.21.15.17:0/600018117 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc48099e00 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.826+0000 7fdc70360b80 10 client.19641 fetch_fsmap learned FSMap version 66 2023-07-14T13:28:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.826+0000 7fdc70360b80 1 -- 172.21.15.17:0/600018117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55a6b3967c00 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.827+0000 7fdc3dffb700 1 -- 172.21.15.17:0/600018117 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdc50003e90 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.827+0000 7fdc3dffb700 1 -- 172.21.15.17:0/600018117 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 66) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdc480a1b60 con 0x55a6b3a5b6b0 2023-07-14T13:28:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.827+0000 7fdc70360b80 10 client.19641 fetch_fsmap finished waiting for FSMap version 66 2023-07-14T13:28:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.827+0000 7fdc70360b80 10 client.19641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:28:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.827+0000 7fdc70360b80 20 client.19641 populate_metadata read hostname 'smithi017' 2023-07-14T13:28:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.827+0000 7fdc70360b80 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a6b3c6e310 0x55a6b3c70720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:28:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.827+0000 7fdc70360b80 4 client.19641 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:28:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.827+0000 7fdc70360b80 1 -- 172.21.15.17:0/600018117 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a6b3b0bff0 con 0x55a6b3c6e310 2023-07-14T13:28:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.828+0000 7fdc55d9b700 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a6b3c6e310 0x55a6b3c70720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:28:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.829+0000 7fdc55d9b700 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a6b3c6e310 0x55a6b3c70720 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=772a6fb72970f406 server_cookie=be92dca33d5e426f in_seq=0 out_seq=0 2023-07-14T13:28:46.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.829+0000 7fdc3dffb700 10 client.19641 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.858+0000 7fdc3dffb700 1 -- 172.21.15.17:0/600018117 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a6b3b0bff0 con 0x55a6b3c6e310 2023-07-14T13:28:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.858+0000 7fdc3dffb700 10 client.19641 handle_command_reply: tid=0 2023-07-14T13:28:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.858+0000 7fdc70360b80 1 client.19641 shutdown 2023-07-14T13:28:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.858+0000 7fdc70360b80 1 -- 172.21.15.17:0/600018117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 msgr2=0x55a6b3c0e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.858+0000 7fdc70360b80 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c0e2e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdc480ca280 tx=0x7fdc48095ee0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.859+0000 7fdc70360b80 1 -- 172.21.15.17:0/600018117 shutdown_connections 2023-07-14T13:28:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.859+0000 7fdc70360b80 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a6b3c6e310 0x55a6b3c70720 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.859+0000 7fdc70360b80 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a6b3c052d0 0x55a6b3c0ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.859+0000 7fdc70360b80 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a6b3a5b6b0 0x55a6b3c0e2e0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.859+0000 7fdc70360b80 1 --2- 172.21.15.17:0/600018117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a6b3bff580 0x55a6b3c0e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.859+0000 7fdc70360b80 1 -- 172.21.15.17:0/600018117 >> 172.21.15.17:0/600018117 conn(0x55a6b3bf4be0 msgr2=0x55a6b3bfe030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.859+0000 7fdc3dffb700 0 client.19641 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:28:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.859+0000 7fdc70360b80 1 -- 172.21.15.17:0/600018117 shutdown_connections 2023-07-14T13:28:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.859+0000 7fdc70360b80 1 -- 172.21.15.17:0/600018117 wait complete. 2023-07-14T13:28:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.860+0000 7fdc70360b80 20 client.19641 trim_cache size 0 max 16384 2023-07-14T13:28:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:28:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:28:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:28:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:28:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/2060600824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdc400a1340 msgr2=0x7fdc400a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdc400a1340 0x7fdc400a37f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdc500061c0 tx=0x7fdc50027ac0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/2060600824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc58101fd0 msgr2=0x7fdc5810d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:28:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc58101fd0 0x7fdc5810d220 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800d950 tx=0x7fdc4800dc60 comp rx=0 tx=0).stop 2023-07-14T13:28:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/2060600824 shutdown_connections 2023-07-14T13:28:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fdc400a1340 0x7fdc400a37f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc58107010 0x7fdc581a8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc58101fd0 0x7fdc5810d220 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 --2- 172.21.15.17:0/2060600824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc58102970 0x7fdc5810d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:28:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/2060600824 >> 172.21.15.17:0/2060600824 conn(0x7fdc580fd840 msgr2=0x7fdc58078240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:28:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/2060600824 shutdown_connections 2023-07-14T13:28:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:28:46.861+0000 7fdc5c9ff700 1 -- 172.21.15.17:0/2060600824 wait complete. 2023-07-14T13:28:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 635.0 s, 141.8 tps, lat 796.615 ms stddev 1459.449 2023-07-14T13:28:47.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:47 smithi135 ceph-mon[97338]: pgmap v920: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 10 MiB/s wr, 997 op/s 2023-07-14T13:28:47.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:47 smithi131 ceph-mon[96953]: pgmap v920: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 10 MiB/s wr, 997 op/s 2023-07-14T13:28:48.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:47 smithi017 ceph-mon[95536]: pgmap v920: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 10 MiB/s wr, 997 op/s 2023-07-14T13:28:49.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:49 smithi135 ceph-mon[97338]: pgmap v921: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.1 MiB/s wr, 657 op/s 2023-07-14T13:28:49.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:49 smithi131 ceph-mon[96953]: pgmap v921: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.1 MiB/s wr, 657 op/s 2023-07-14T13:28:50.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:49 smithi017 ceph-mon[95536]: pgmap v921: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.1 MiB/s wr, 657 op/s 2023-07-14T13:28:51.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:51 smithi135 ceph-mon[97338]: pgmap v922: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.2 MiB/s wr, 665 op/s 2023-07-14T13:28:51.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:51 smithi131 ceph-mon[96953]: pgmap v922: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.2 MiB/s wr, 665 op/s 2023-07-14T13:28:52.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:51 smithi017 ceph-mon[95536]: pgmap v922: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.2 MiB/s wr, 665 op/s 2023-07-14T13:28:52.423 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 640.0 s, 281.2 tps, lat 374.564 ms stddev 369.192 2023-07-14T13:28:52.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:52 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:28:52.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:52 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:28:53.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:52 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:28:53.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:53 smithi135 ceph-mon[97338]: pgmap v923: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 931 op/s 2023-07-14T13:28:53.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:53 smithi131 ceph-mon[96953]: pgmap v923: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 931 op/s 2023-07-14T13:28:54.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:53 smithi017 ceph-mon[95536]: pgmap v923: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 931 op/s 2023-07-14T13:28:55.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:55 smithi135 ceph-mon[97338]: pgmap v924: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 617 op/s 2023-07-14T13:28:55.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:55 smithi131 ceph-mon[96953]: pgmap v924: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 617 op/s 2023-07-14T13:28:56.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:55 smithi017 ceph-mon[95536]: pgmap v924: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.2 MiB/s wr, 617 op/s 2023-07-14T13:28:57.422 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 645.0 s, 463.6 tps, lat 196.119 ms stddev 71.175 2023-07-14T13:28:57.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:57 smithi135 ceph-mon[97338]: pgmap v925: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 1.17k op/s 2023-07-14T13:28:57.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:57 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:28:57.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:57 smithi131 ceph-mon[96953]: pgmap v925: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 1.17k op/s 2023-07-14T13:28:57.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:57 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:28:58.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:57 smithi017 ceph-mon[95536]: pgmap v925: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 1.17k op/s 2023-07-14T13:28:58.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:57 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:28:59.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:28:59 smithi135 ceph-mon[97338]: pgmap v926: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.8 MiB/s wr, 1.00k op/s 2023-07-14T13:28:59.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:28:59 smithi131 ceph-mon[96953]: pgmap v926: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.8 MiB/s wr, 1.00k op/s 2023-07-14T13:29:00.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:28:59 smithi017 ceph-mon[95536]: pgmap v926: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.8 MiB/s wr, 1.00k op/s 2023-07-14T13:29:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.149+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/2041530512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a41024f0 msgr2=0x7ff6a4102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.149+0000 7ff6aa9ff700 1 --2- 172.21.15.17:0/2041530512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a41024f0 0x7ff6a4102940 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009990 tx=0x7ff69c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.149+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/2041530512 shutdown_connections 2023-07-14T13:29:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.149+0000 7ff6aa9ff700 1 --2- 172.21.15.17:0/2041530512 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a41024f0 0x7ff6a4102940 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.149+0000 7ff6aa9ff700 1 --2- 172.21.15.17:0/2041530512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a4104a60 0x7ff6a40679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.149+0000 7ff6aa9ff700 1 --2- 172.21.15.17:0/2041530512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a4067ee0 0x7ff6a4068350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.149+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/2041530512 >> 172.21.15.17:0/2041530512 conn(0x7ff6a4074760 msgr2=0x7ff6a4074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.150+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/2041530512 shutdown_connections 2023-07-14T13:29:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.150+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/2041530512 wait complete. 2023-07-14T13:29:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.152+0000 7ff6aa9ff700 1 Processor -- start 2023-07-14T13:29:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.152+0000 7ff6aa9ff700 1 -- start start 2023-07-14T13:29:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.152+0000 7ff6aa9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a4067ee0 0x7ff6a4112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.153+0000 7ff6aa9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a41024f0 0x7ff6a41130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.153+0000 7ff6aa9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a4104a60 0x7ff6a410b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.153+0000 7ff6aa9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a410c150 con 0x7ff6a4067ee0 2023-07-14T13:29:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.153+0000 7ff6aa9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a410c2c0 con 0x7ff6a41024f0 2023-07-14T13:29:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.153+0000 7ff6aa9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a410c480 con 0x7ff6a4104a60 2023-07-14T13:29:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.153+0000 7ff69b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a41024f0 0x7ff6a41130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.153+0000 7ff69b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a41024f0 0x7ff6a41130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53390/0 (socket says 172.21.15.17:53390) 2023-07-14T13:29:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.153+0000 7ff69b7fe700 1 -- 172.21.15.17:0/3773384783 learned_addr learned my addr 172.21.15.17:0/3773384783 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.154+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a4104a60 0x7ff6a410b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.154+0000 7ff6a3fff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a4067ee0 0x7ff6a4112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.155+0000 7ff6a3fff700 1 -- 172.21.15.17:0/3773384783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a4104a60 msgr2=0x7ff6a410b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.155+0000 7ff6a3fff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a4104a60 0x7ff6a410b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.155+0000 7ff6a3fff700 1 -- 172.21.15.17:0/3773384783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a41024f0 msgr2=0x7ff6a41130f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.155+0000 7ff6a3fff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a41024f0 0x7ff6a41130f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.155+0000 7ff6a3fff700 1 -- 172.21.15.17:0/3773384783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c0095f0 con 0x7ff6a4067ee0 2023-07-14T13:29:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.156+0000 7ff6a3fff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a4067ee0 0x7ff6a4112bb0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00e9f0 tx=0x7ff68c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.156+0000 7ff6a1ffb700 1 -- 172.21.15.17:0/3773384783 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c00eee0 con 0x7ff6a4067ee0 2023-07-14T13:29:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.156+0000 7ff6a1ffb700 1 -- 172.21.15.17:0/3773384783 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff68c00cbd0 con 0x7ff6a4067ee0 2023-07-14T13:29:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.156+0000 7ff6a1ffb700 1 -- 172.21.15.17:0/3773384783 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c018680 con 0x7ff6a4067ee0 2023-07-14T13:29:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.157+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/3773384783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a410c760 con 0x7ff6a4067ee0 2023-07-14T13:29:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.157+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/3773384783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a41109a0 con 0x7ff6a4067ee0 2023-07-14T13:29:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.169+0000 7ff6be39fb80 1 Processor -- start 2023-07-14T13:29:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.170+0000 7ff6a1ffb700 1 -- 172.21.15.17:0/3773384783 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff68c010430 con 0x7ff6a4067ee0 2023-07-14T13:29:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.170+0000 7ff6be39fb80 1 -- start start 2023-07-14T13:29:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.171+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c90d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.171+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c912d0 0x560717c8b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.171+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c8b580 0x560717c8b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.171+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717b90c50 con 0x560717c8b580 2023-07-14T13:29:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.171+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717be39e0 con 0x560717ae76b0 2023-07-14T13:29:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.171+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717bdce70 con 0x560717c912d0 2023-07-14T13:29:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.171+0000 7ff6a8f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c90d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.172+0000 7ff6a8f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c90d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53406/0 (socket says 172.21.15.17:53406) 2023-07-14T13:29:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.172+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/3765526539 learned_addr learned my addr 172.21.15.17:0/3765526539 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.172+0000 7ff6a3fff700 1 --2- 172.21.15.17:0/3765526539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c912d0 0x560717c8b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.173+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/3765526539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c912d0 msgr2=0x560717c8b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.173+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/3765526539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c912d0 0x560717c8b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.173+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/3765526539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c8b580 msgr2=0x560717c8b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:29:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.173+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/3765526539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c8b580 0x560717c8b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.173+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/3765526539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560717a0ad80 con 0x560717ae76b0 2023-07-14T13:29:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.173+0000 7ff6a1ffb700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6900a14d0 0x7ff6900a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.173+0000 7ff6a3fff700 1 --2- 172.21.15.17:0/3765526539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c912d0 0x560717c8b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.173+0000 7ff6a1ffb700 1 -- 172.21.15.17:0/3773384783 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff68c014070 con 0x7ff6a4067ee0 2023-07-14T13:29:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.173+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/3765526539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c90d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff69c015000 tx=0x7ff69c004000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc92d8eaa775c38d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.173+0000 7ff6a3fff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6900a14d0 0x7ff6900a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.175+0000 7ff69a7fc700 1 -- 172.21.15.17:0/3765526539 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c005400 con 0x560717ae76b0 2023-07-14T13:29:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.175+0000 7ff69a7fc700 1 -- 172.21.15.17:0/3765526539 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff69c03f030 con 0x560717ae76b0 2023-07-14T13:29:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.175+0000 7ff69a7fc700 1 -- 172.21.15.17:0/3765526539 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00ba70 con 0x560717ae76b0 2023-07-14T13:29:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.176+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3765526539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 msgr2=0x560717c90d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.176+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3765526539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c90d90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff69c015000 tx=0x7ff69c004000 comp rx=0 tx=0).stop 2023-07-14T13:29:00.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.176+0000 7ff6a3fff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6900a14d0 0x7ff6900a3980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x560717c87b40 tx=0x7ff68c0d06b0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:00.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.177+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3765526539 shutdown_connections 2023-07-14T13:29:00.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.177+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3765526539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c8b580 0x560717c8b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.177+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3765526539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c90d90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.181 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.177+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3765526539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c912d0 0x560717c8b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.177+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3765526539 >> 172.21.15.17:0/3765526539 conn(0x560717c80be0 msgr2=0x560717c85f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:00.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.178+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3765526539 shutdown_connections 2023-07-14T13:29:00.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.178+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3765526539 wait complete. 2023-07-14T13:29:00.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.179+0000 7ff6be39fb80 1 -- start start 2023-07-14T13:29:00.182 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.179+0000 7ff6be39fb80 1 Processor -- start 2023-07-14T13:29:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.180+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c97640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.180+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c8b580 0x560717c94960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.180+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 0x560717c950a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.180+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717b7ca60 con 0x560717c912d0 2023-07-14T13:29:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.180+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717b7c760 con 0x560717ae76b0 2023-07-14T13:29:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.180+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717a608c0 con 0x560717c8b580 2023-07-14T13:29:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.180+0000 7ff6be39fb80 10 client.0 _ll_register_callbacks cb 0x560717b7a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.181+0000 7ff6a8f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c97640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.181+0000 7ff6a8f9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c97640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53414/0 (socket says 172.21.15.17:53414) 2023-07-14T13:29:00.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.181+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/2119427152 learned_addr learned my addr 172.21.15.17:0/2119427152 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:00.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.181+0000 7ff69b7fe700 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c8b580 0x560717c94960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.182+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/2119427152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c8b580 msgr2=0x560717c94960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:00.185 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.182+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c8b580 0x560717c94960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.182+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/2119427152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 msgr2=0x560717c950a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.182+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 0x560717c950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.182+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/2119427152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a41109a0 con 0x560717ae76b0 2023-07-14T13:29:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.182+0000 7ff69b7fe700 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c8b580 0x560717c94960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.183+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c97640 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0098e0 tx=0x7ff69c00bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8259395b5626768d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.185+0000 7ff6837fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:29:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.185+0000 7ff6837fe700 1 -- 172.21.15.17:0/2119427152 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c003880 con 0x560717ae76b0 2023-07-14T13:29:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.185+0000 7ff6837fe700 1 -- 172.21.15.17:0/2119427152 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff69c005200 con 0x560717ae76b0 2023-07-14T13:29:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.186+0000 7ff6be39fb80 1 -- 172.21.15.17:0/2119427152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560717b36490 con 0x560717ae76b0 2023-07-14T13:29:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.190+0000 7ff6837fe700 1 -- 172.21.15.17:0/2119427152 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff69c0039e0 con 0x560717ae76b0 2023-07-14T13:29:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.190+0000 7ff6be39fb80 10 client.29417 fetch_fsmap learned FSMap version 68 2023-07-14T13:29:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.190+0000 7ff6be39fb80 1 -- 172.21.15.17:0/2119427152 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x7ff6a4113930 con 0x560717ae76b0 2023-07-14T13:29:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.191+0000 7ff6837fe700 1 -- 172.21.15.17:0/2119427152 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560717b36490 con 0x560717ae76b0 2023-07-14T13:29:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.191+0000 7ff6837fe700 1 -- 172.21.15.17:0/2119427152 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff69c0099c0 con 0x560717ae76b0 2023-07-14T13:29:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.191+0000 7ff6be39fb80 10 client.29417 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:29:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.191+0000 7ff6be39fb80 10 client.29417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:29:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.191+0000 7ff6be39fb80 20 client.29417 populate_metadata read hostname 'smithi017' 2023-07-14T13:29:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.191+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560717ca46a0 0x560717ca6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.191+0000 7ff6be39fb80 4 client.29417 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:29:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.191+0000 7ff6be39fb80 1 -- 172.21.15.17:0/2119427152 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560717bd5e50 con 0x560717ca46a0 2023-07-14T13:29:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.192+0000 7ff69b7fe700 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560717ca46a0 0x560717ca6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.193+0000 7ff69b7fe700 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560717ca46a0 0x560717ca6a80 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2b4195fd10f40d7 server_cookie=878bbf10b12d02d9 in_seq=0 out_seq=0 2023-07-14T13:29:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.193+0000 7ff6837fe700 10 client.29417 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.195+0000 7ff6837fe700 1 -- 172.21.15.17:0/2119427152 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560717bd5e50 con 0x560717ca46a0 2023-07-14T13:29:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.195+0000 7ff6837fe700 10 client.29417 handle_command_reply: tid=0 2023-07-14T13:29:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.195+0000 7ff6be39fb80 1 client.29417 shutdown 2023-07-14T13:29:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.196+0000 7ff6be39fb80 1 -- 172.21.15.17:0/2119427152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 msgr2=0x560717c97640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.196+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c97640 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0098e0 tx=0x7ff69c00bf60 comp rx=0 tx=0).stop 2023-07-14T13:29:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.196+0000 7ff6be39fb80 1 -- 172.21.15.17:0/2119427152 shutdown_connections 2023-07-14T13:29:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.196+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560717ca46a0 0x560717ca6a80 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.196+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 0x560717c950a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.196+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717ae76b0 0x560717c97640 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.196+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/2119427152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717c8b580 0x560717c94960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.196+0000 7ff6be39fb80 1 -- 172.21.15.17:0/2119427152 >> 172.21.15.17:0/2119427152 conn(0x560717c80be0 msgr2=0x560717c84c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.196+0000 7ff6837fe700 0 client.29417 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.196+0000 7ff6be39fb80 1 -- 172.21.15.17:0/2119427152 shutdown_connections 2023-07-14T13:29:00.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.197+0000 7ff6be39fb80 1 -- 172.21.15.17:0/2119427152 wait complete. 2023-07-14T13:29:00.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.198+0000 7ff6be39fb80 20 client.29417 trim_cache size 0 max 16384 2023-07-14T13:29:00.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.225+0000 7ff6be39fb80 1 Processor -- start 2023-07-14T13:29:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.225+0000 7ff6be39fb80 1 -- start start 2023-07-14T13:29:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.226+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 0x560717c8b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.226+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 0x560717c94910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.226+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 0x560717c85c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.226+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717c90a10 con 0x560717c912d0 2023-07-14T13:29:00.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.226+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717c82d00 con 0x560717c8b580 2023-07-14T13:29:00.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.226+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717c87990 con 0x560717ae76b0 2023-07-14T13:29:00.230 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.226+0000 7ff6a8f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 0x560717c8b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.226+0000 7ff6a8f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 0x560717c8b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:58022/0 (socket says 172.21.15.17:58022) 2023-07-14T13:29:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.226+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/3697498327 learned_addr learned my addr 172.21.15.17:0/3697498327 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.226+0000 7ff69b7fe700 1 --2- 172.21.15.17:0/3697498327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 0x560717c94910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.227+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/3697498327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 msgr2=0x560717c94910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.227+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/3697498327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 0x560717c94910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.227+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/3697498327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 msgr2=0x560717c85c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.227+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/3697498327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 0x560717c85c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.227+0000 7ff6a8f9c700 1 -- 172.21.15.17:0/3697498327 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560717cab5e0 con 0x560717ae76b0 2023-07-14T13:29:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.227+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/3697498327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 0x560717c8b040 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff69c001eb0 tx=0x7ff69c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b50ca583ce72b59 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.228+0000 7ff69affd700 1 -- 172.21.15.17:0/3697498327 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c009b10 con 0x560717ae76b0 2023-07-14T13:29:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.228+0000 7ff69affd700 1 -- 172.21.15.17:0/3697498327 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff69c003d40 con 0x560717ae76b0 2023-07-14T13:29:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.228+0000 7ff69affd700 1 -- 172.21.15.17:0/3697498327 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c005720 con 0x560717ae76b0 2023-07-14T13:29:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.229+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3697498327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 msgr2=0x560717c8b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.229+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3697498327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 0x560717c8b040 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff69c001eb0 tx=0x7ff69c005fd0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.236+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3697498327 shutdown_connections 2023-07-14T13:29:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.236+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3697498327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 0x560717c85c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.236+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3697498327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 0x560717c8b040 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.236+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3697498327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 0x560717c94910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.236+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3697498327 >> 172.21.15.17:0/3697498327 conn(0x560717c80be0 msgr2=0x560717c94200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.237+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3697498327 shutdown_connections 2023-07-14T13:29:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.237+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3697498327 wait complete. 2023-07-14T13:29:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.237+0000 7ff6be39fb80 1 -- start start 2023-07-14T13:29:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.238+0000 7ff6be39fb80 1 Processor -- start 2023-07-14T13:29:00.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.239+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 0x560717c99c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.239+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 0x560717c9a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.239+0000 7ff6be39fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 0x560717cf7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.239+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717c9a920 con 0x560717c912d0 2023-07-14T13:29:00.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.239+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717c9aa90 con 0x560717c8b580 2023-07-14T13:29:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.239+0000 7ff6be39fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560717cf79a0 con 0x560717ae76b0 2023-07-14T13:29:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.239+0000 7ff6be39fb80 10 client.0 _ll_register_callbacks cb 0x7ff68c0d0580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.239+0000 7ff69b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 0x560717c9a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.239+0000 7ff69b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 0x560717c9a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:53432/0 (socket says 172.21.15.17:53432) 2023-07-14T13:29:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.239+0000 7ff69b7fe700 1 -- 172.21.15.17:0/3004746388 learned_addr learned my addr 172.21.15.17:0/3004746388 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.239+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 0x560717c99c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.240+0000 7ff69b7fe700 1 -- 172.21.15.17:0/3004746388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 msgr2=0x560717c99c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.240+0000 7ff69b7fe700 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 0x560717c99c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.240+0000 7ff69b7fe700 1 -- 172.21.15.17:0/3004746388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 msgr2=0x560717cf7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.240+0000 7ff69b7fe700 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 0x560717cf7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.240+0000 7ff69b7fe700 1 -- 172.21.15.17:0/3004746388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a4113930 con 0x560717c8b580 2023-07-14T13:29:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.241+0000 7ff69b7fe700 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 0x560717c9a190 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x560717c97b80 tx=0x7ff694007a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c350224176b4c444 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.241+0000 7ff6837fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:29:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.243+0000 7ff6837fe700 1 -- 172.21.15.17:0/3004746388 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694019040 con 0x560717c8b580 2023-07-14T13:29:00.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.243+0000 7ff6837fe700 1 -- 172.21.15.17:0/3004746388 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(135..135 src has 1..135) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff6940191a0 con 0x560717c8b580 2023-07-14T13:29:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.245+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3004746388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff69c03f030 con 0x560717c8b580 2023-07-14T13:29:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.245+0000 7ff6837fe700 1 -- 172.21.15.17:0/3004746388 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff694019360 con 0x560717c8b580 2023-07-14T13:29:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.247+0000 7ff6be39fb80 10 client.29423 fetch_fsmap learned FSMap version 68 2023-07-14T13:29:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.247+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3004746388 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5607179f3c00 con 0x560717c8b580 2023-07-14T13:29:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.248+0000 7ff6837fe700 1 -- 172.21.15.17:0/3004746388 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff69c03f030 con 0x560717c8b580 2023-07-14T13:29:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.248+0000 7ff6837fe700 1 -- 172.21.15.17:0/3004746388 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff694022430 con 0x560717c8b580 2023-07-14T13:29:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.248+0000 7ff6be39fb80 10 client.29423 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:29:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.248+0000 7ff6be39fb80 10 client.29423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:29:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.248+0000 7ff6be39fb80 20 client.29423 populate_metadata read hostname 'smithi017' 2023-07-14T13:29:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.248+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560717cf91d0 0x560717cfb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.248+0000 7ff6be39fb80 4 client.29423 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:29:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.248+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3004746388 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560717b97ff0 con 0x560717cf91d0 2023-07-14T13:29:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.249+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560717cf91d0 0x560717cfb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:00.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.258+0000 7ff6a8f9c700 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560717cf91d0 0x560717cfb5e0 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b217546d6b195c8 server_cookie=478db816342bc85a in_seq=0 out_seq=0 2023-07-14T13:29:00.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.259+0000 7ff6837fe700 10 client.29423 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.299+0000 7ff6837fe700 1 -- 172.21.15.17:0/3004746388 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560717b97ff0 con 0x560717cf91d0 2023-07-14T13:29:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.299+0000 7ff6837fe700 10 client.29423 handle_command_reply: tid=0 2023-07-14T13:29:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.299+0000 7ff6be39fb80 1 client.29423 shutdown 2023-07-14T13:29:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.300+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3004746388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 msgr2=0x560717c9a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.300+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 0x560717c9a190 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x560717c97b80 tx=0x7ff694007a30 comp rx=0 tx=0).stop 2023-07-14T13:29:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.300+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3004746388 shutdown_connections 2023-07-14T13:29:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.300+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560717cf91d0 0x560717cfb5e0 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.300+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560717c912d0 0x560717cf7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.300+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560717ae76b0 0x560717c99c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.300+0000 7ff6be39fb80 1 --2- 172.21.15.17:0/3004746388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560717c8b580 0x560717c9a190 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.300+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3004746388 >> 172.21.15.17:0/3004746388 conn(0x560717c80be0 msgr2=0x560717c90390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.300+0000 7ff6837fe700 0 client.29423 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.301+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3004746388 shutdown_connections 2023-07-14T13:29:00.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.301+0000 7ff6be39fb80 1 -- 172.21.15.17:0/3004746388 wait complete. 2023-07-14T13:29:00.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.302+0000 7ff6be39fb80 20 client.29423 trim_cache size 0 max 16384 2023-07-14T13:29:00.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:29:00.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:29:00.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:29:00.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:29:00.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.305+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/3773384783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6900a14d0 msgr2=0x7ff6900a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.305+0000 7ff6aa9ff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6900a14d0 0x7ff6900a3980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x560717c87b40 tx=0x7ff68c0d06b0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.306+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/3773384783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a4067ee0 msgr2=0x7ff6a4112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:00.309 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.306+0000 7ff6aa9ff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a4067ee0 0x7ff6a4112bb0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00e9f0 tx=0x7ff68c00ed00 comp rx=0 tx=0).stop 2023-07-14T13:29:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.310+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/3773384783 shutdown_connections 2023-07-14T13:29:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.310+0000 7ff6aa9ff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6900a14d0 0x7ff6900a3980 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.310+0000 7ff6aa9ff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6a4104a60 0x7ff6a410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.310+0000 7ff6aa9ff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6a4067ee0 0x7ff6a4112bb0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.310+0000 7ff6aa9ff700 1 --2- 172.21.15.17:0/3773384783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6a41024f0 0x7ff6a41130f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:00.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.310+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/3773384783 >> 172.21.15.17:0/3773384783 conn(0x7ff6a4074760 msgr2=0x7ff6a41014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:00.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.311+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/3773384783 shutdown_connections 2023-07-14T13:29:00.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:00.312+0000 7ff6aa9ff700 1 -- 172.21.15.17:0/3773384783 wait complete. 2023-07-14T13:29:01.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:01 smithi135 ceph-mon[97338]: pgmap v927: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.9 MiB/s wr, 1.03k op/s 2023-07-14T13:29:01.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:01 smithi131 ceph-mon[96953]: pgmap v927: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.9 MiB/s wr, 1.03k op/s 2023-07-14T13:29:02.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:01 smithi017 ceph-mon[95536]: pgmap v927: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.9 MiB/s wr, 1.03k op/s 2023-07-14T13:29:02.422 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 650.0 s, 340.6 tps, lat 315.676 ms stddev 488.010 2023-07-14T13:29:03.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:03 smithi135 ceph-mon[97338]: pgmap v928: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-14T13:29:03.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:03 smithi131 ceph-mon[96953]: pgmap v928: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-14T13:29:04.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:03 smithi017 ceph-mon[95536]: pgmap v928: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-14T13:29:05.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:05 smithi131 ceph-mon[96953]: pgmap v929: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 1.08k op/s 2023-07-14T13:29:06.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:05 smithi017 ceph-mon[95536]: pgmap v929: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 1.08k op/s 2023-07-14T13:29:06.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:05 smithi135 ceph-mon[97338]: pgmap v929: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 1.08k op/s 2023-07-14T13:29:07.422 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 655.0 s, 345.4 tps, lat 295.505 ms stddev 113.915 2023-07-14T13:29:07.922 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:07 smithi135 ceph-mon[97338]: pgmap v930: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 13 MiB/s wr, 1.47k op/s 2023-07-14T13:29:07.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:07 smithi131 ceph-mon[96953]: pgmap v930: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 13 MiB/s wr, 1.47k op/s 2023-07-14T13:29:08.082 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:07 smithi017 ceph-mon[95536]: pgmap v930: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 13 MiB/s wr, 1.47k op/s 2023-07-14T13:29:09.927 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:09 smithi135 ceph-mon[97338]: pgmap v931: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.3 MiB/s wr, 956 op/s 2023-07-14T13:29:09.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:09 smithi131 ceph-mon[96953]: pgmap v931: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.3 MiB/s wr, 956 op/s 2023-07-14T13:29:10.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:09 smithi017 ceph-mon[95536]: pgmap v931: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.3 MiB/s wr, 956 op/s 2023-07-14T13:29:10.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:10 smithi135 ceph-mon[97338]: osdmap e136: 12 total, 12 up, 12 in 2023-07-14T13:29:10.972 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:10 smithi131 ceph-mon[96953]: osdmap e136: 12 total, 12 up, 12 in 2023-07-14T13:29:11.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:10 smithi017 ceph-mon[95536]: osdmap e136: 12 total, 12 up, 12 in 2023-07-14T13:29:11.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:11 smithi131 ceph-mon[96953]: pgmap v933: 97 pgs: 4 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 89 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.5 MiB/s wr, 1.07k op/s 2023-07-14T13:29:12.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:11 smithi017 ceph-mon[95536]: pgmap v933: 97 pgs: 4 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 89 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.5 MiB/s wr, 1.07k op/s 2023-07-14T13:29:12.172 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:11 smithi135 ceph-mon[97338]: pgmap v933: 97 pgs: 4 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 89 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 9.5 MiB/s wr, 1.07k op/s 2023-07-14T13:29:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 660.0 s, 240.3 tps, lat 389.764 ms stddev 322.931 2023-07-14T13:29:13.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:13 smithi131 ceph-mon[96953]: pgmap v934: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 1.08k op/s 2023-07-14T13:29:14.085 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:13 smithi017 ceph-mon[95536]: pgmap v934: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 1.08k op/s 2023-07-14T13:29:14.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:13 smithi135 ceph-mon[97338]: pgmap v934: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 1.08k op/s 2023-07-14T13:29:15.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:14 smithi017 ceph-mon[95536]: pgmap v935: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 1.08k op/s 2023-07-14T13:29:15.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:14 smithi135 ceph-mon[97338]: pgmap v935: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 1.08k op/s 2023-07-14T13:29:15.219 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:14 smithi131 ceph-mon[96953]: pgmap v935: 97 pgs: 41 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 34 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 1.08k op/s 2023-07-14T13:29:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.197+0000 7f74da9ff700 1 -- 172.21.15.17:0/2353214343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d40ffb00 msgr2=0x7f74d40fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.197+0000 7f74da9ff700 1 --2- 172.21.15.17:0/2353214343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d40ffb00 0x7f74d40fff70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f74c80098f0 tx=0x7f74c8009c00 comp rx=0 tx=0).stop 2023-07-14T13:29:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.197+0000 7f74da9ff700 1 -- 172.21.15.17:0/2353214343 shutdown_connections 2023-07-14T13:29:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.197+0000 7f74da9ff700 1 --2- 172.21.15.17:0/2353214343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d41004b0 0x7f74d410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.197+0000 7f74da9ff700 1 --2- 172.21.15.17:0/2353214343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4105b10 0x7f74d4105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.197+0000 7f74da9ff700 1 --2- 172.21.15.17:0/2353214343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d40ffb00 0x7f74d40fff70 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.197+0000 7f74da9ff700 1 -- 172.21.15.17:0/2353214343 >> 172.21.15.17:0/2353214343 conn(0x7f74d40fb600 msgr2=0x7f74d40fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.202+0000 7f74da9ff700 1 -- 172.21.15.17:0/2353214343 shutdown_connections 2023-07-14T13:29:17.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.202+0000 7f74da9ff700 1 -- 172.21.15.17:0/2353214343 wait complete. 2023-07-14T13:29:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.204+0000 7f74da9ff700 1 Processor -- start 2023-07-14T13:29:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.205+0000 7f74da9ff700 1 -- start start 2023-07-14T13:29:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.210+0000 7f74da9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d40ffb00 0x7f74d410c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.210+0000 7f74da9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d41004b0 0x7f74d4109470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.210+0000 7f74da9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4105b10 0x7f74d41099b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.210+0000 7f74da9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d410a090 con 0x7f74d4105b10 2023-07-14T13:29:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.210+0000 7f74da9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d410a200 con 0x7f74d41004b0 2023-07-14T13:29:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.210+0000 7f74da9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d41a8a90 con 0x7f74d40ffb00 2023-07-14T13:29:17.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.211+0000 7f74d3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d40ffb00 0x7f74d410c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.211+0000 7f74d3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d40ffb00 0x7f74d410c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:48208/0 (socket says 172.21.15.17:48208) 2023-07-14T13:29:17.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.211+0000 7f74d3fff700 1 -- 172.21.15.17:0/554080691 learned_addr learned my addr 172.21.15.17:0/554080691 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:17.216 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.212+0000 7f74d8f9c700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4105b10 0x7f74d41099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.214+0000 7f74d3fff700 1 -- 172.21.15.17:0/554080691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d41004b0 msgr2=0x7f74d4109470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-14T13:29:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.214+0000 7f74d3fff700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d41004b0 0x7f74d4109470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.214+0000 7f74d3fff700 1 -- 172.21.15.17:0/554080691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4105b10 msgr2=0x7f74d41099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.214+0000 7f74d3fff700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4105b10 0x7f74d41099b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.214+0000 7f74d3fff700 1 -- 172.21.15.17:0/554080691 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8009520 con 0x7f74d40ffb00 2023-07-14T13:29:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.215+0000 7f74d3fff700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d40ffb00 0x7f74d410c6c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f74c400ba50 tx=0x7f74c400be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.215+0000 7f74d17fa700 1 -- 172.21.15.17:0/554080691 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c400c9f0 con 0x7f74d40ffb00 2023-07-14T13:29:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.216+0000 7f74da9ff700 1 -- 172.21.15.17:0/554080691 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d41a8cf0 con 0x7f74d40ffb00 2023-07-14T13:29:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.216+0000 7f74da9ff700 1 -- 172.21.15.17:0/554080691 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d41a91d0 con 0x7f74d40ffb00 2023-07-14T13:29:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.216+0000 7f74d17fa700 1 -- 172.21.15.17:0/554080691 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74c4014440 con 0x7f74d40ffb00 2023-07-14T13:29:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.216+0000 7f74d17fa700 1 -- 172.21.15.17:0/554080691 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40075d0 con 0x7f74d40ffb00 2023-07-14T13:29:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.225+0000 7f74ee392b80 1 Processor -- start 2023-07-14T13:29:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.231+0000 7f74ee392b80 1 -- start start 2023-07-14T13:29:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.231+0000 7f74d17fa700 1 -- 172.21.15.17:0/554080691 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f74c400cb50 con 0x7f74d40ffb00 2023-07-14T13:29:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.232+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596ab9526b0 0x5596abafbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.232+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abafc2d0 0x5596abaf6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.232+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596abaf6580 0x5596abaf69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.232+0000 7f74ee392b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ab9fbc50 con 0x5596ab9526b0 2023-07-14T13:29:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.232+0000 7f74ee392b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596aba4e9e0 con 0x5596abafc2d0 2023-07-14T13:29:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.232+0000 7f74ee392b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596aba47e70 con 0x5596abaf6580 2023-07-14T13:29:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.232+0000 7f74d3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abafc2d0 0x5596abaf6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.232+0000 7f74d3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abafc2d0 0x5596abaf6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41430/0 (socket says 172.21.15.17:41430) 2023-07-14T13:29:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.232+0000 7f74d3fff700 1 -- 172.21.15.17:0/2485882207 learned_addr learned my addr 172.21.15.17:0/2485882207 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.233+0000 7f74d37fe700 1 --2- 172.21.15.17:0/2485882207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596abaf6580 0x5596abaf69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.234+0000 7f74d37fe700 1 -- 172.21.15.17:0/2485882207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abafc2d0 msgr2=0x5596abaf6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.234+0000 7f74d37fe700 1 --2- 172.21.15.17:0/2485882207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abafc2d0 0x5596abaf6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.234+0000 7f74d37fe700 1 -- 172.21.15.17:0/2485882207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596ab9526b0 msgr2=0x5596abafbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.234+0000 7f74d37fe700 1 --2- 172.21.15.17:0/2485882207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596ab9526b0 0x5596abafbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.237 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.235+0000 7f74d37fe700 1 -- 172.21.15.17:0/2485882207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596ab875d80 con 0x5596abaf6580 2023-07-14T13:29:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.236+0000 7f74d17fa700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74bc0a13c0 0x7f74bc0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.236+0000 7f74d17fa700 1 -- 172.21.15.17:0/554080691 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f74c4006e40 con 0x7f74d40ffb00 2023-07-14T13:29:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.236+0000 7f74d8f9c700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74bc0a13c0 0x7f74bc0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.240 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.238+0000 7f74d8f9c700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74bc0a13c0 0x7f74bc0a3870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f74cc005fd0 tx=0x7f74cc009830 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.241 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.239+0000 7f74d37fe700 1 --2- 172.21.15.17:0/2485882207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596abaf6580 0x5596abaf69d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f74c8000c00 tx=0x7f74c8009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28d1d23c2b3c2683 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.239+0000 7f74ba7fc700 1 -- 172.21.15.17:0/2485882207 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c801c070 con 0x5596abaf6580 2023-07-14T13:29:17.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.239+0000 7f74ba7fc700 1 -- 172.21.15.17:0/2485882207 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74c800f8f0 con 0x5596abaf6580 2023-07-14T13:29:17.242 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.239+0000 7f74ba7fc700 1 -- 172.21.15.17:0/2485882207 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c800bac0 con 0x5596abaf6580 2023-07-14T13:29:17.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.240+0000 7f74ee392b80 1 -- 172.21.15.17:0/2485882207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596abaf6580 msgr2=0x5596abaf69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.243 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.240+0000 7f74ee392b80 1 --2- 172.21.15.17:0/2485882207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596abaf6580 0x5596abaf69d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f74c8000c00 tx=0x7f74c8009400 comp rx=0 tx=0).stop 2023-07-14T13:29:17.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.241+0000 7f74ee392b80 1 -- 172.21.15.17:0/2485882207 shutdown_connections 2023-07-14T13:29:17.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.241+0000 7f74ee392b80 1 --2- 172.21.15.17:0/2485882207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596abaf6580 0x5596abaf69d0 secure :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f74c8000c00 tx=0x7f74c8009400 comp rx=0 tx=0).stop 2023-07-14T13:29:17.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.241+0000 7f74ee392b80 1 --2- 172.21.15.17:0/2485882207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596ab9526b0 0x5596abafbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.241+0000 7f74ee392b80 1 --2- 172.21.15.17:0/2485882207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abafc2d0 0x5596abaf6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.241+0000 7f74ee392b80 1 -- 172.21.15.17:0/2485882207 >> 172.21.15.17:0/2485882207 conn(0x5596abaebbe0 msgr2=0x5596abaf0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:17.244 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.241+0000 7f74ee392b80 1 -- 172.21.15.17:0/2485882207 shutdown_connections 2023-07-14T13:29:17.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.242+0000 7f74ee392b80 1 -- 172.21.15.17:0/2485882207 wait complete. 2023-07-14T13:29:17.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.242+0000 7f74ee392b80 1 -- start start 2023-07-14T13:29:17.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.243+0000 7f74ee392b80 1 Processor -- start 2023-07-14T13:29:17.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.243+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596ab9526b0 0x5596abaffb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.244+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 0x5596abb00060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.244+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abb005a0 0x5596abb1ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.244+0000 7f74ee392b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ab9e7a60 con 0x5596abafc2d0 2023-07-14T13:29:17.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.244+0000 7f74ee392b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ab9e7760 con 0x5596abb005a0 2023-07-14T13:29:17.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.244+0000 7f74ee392b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ab8cb8c0 con 0x5596ab9526b0 2023-07-14T13:29:17.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.244+0000 7f74ee392b80 10 client.0 _ll_register_callbacks cb 0x5596ab9e5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:17.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.244+0000 7f74d37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 0x5596abb00060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.245+0000 7f74d37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 0x5596abb00060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48418/0 (socket says 172.21.15.17:48418) 2023-07-14T13:29:17.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.245+0000 7f74d37fe700 1 -- 172.21.15.17:0/3586078722 learned_addr learned my addr 172.21.15.17:0/3586078722 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:17.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.245+0000 7f74d3fff700 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596ab9526b0 0x5596abaffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.245+0000 7f74d8f9c700 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abb005a0 0x5596abb1ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.248 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.245+0000 7f74d37fe700 1 -- 172.21.15.17:0/3586078722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596ab9526b0 msgr2=0x5596abaffb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:17.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.245+0000 7f74d37fe700 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596ab9526b0 0x5596abaffb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.245+0000 7f74d37fe700 1 -- 172.21.15.17:0/3586078722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abb005a0 msgr2=0x5596abb1ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:17.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.245+0000 7f74d37fe700 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abb005a0 0x5596abb1ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.249 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.245+0000 7f74d37fe700 1 -- 172.21.15.17:0/3586078722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d4072900 con 0x5596abafc2d0 2023-07-14T13:29:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.246+0000 7f74d37fe700 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 0x5596abb00060 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009810 tx=0x7f74c800f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad9c15490e279e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.246+0000 7f74b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:29:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.247+0000 7f74b37fe700 1 -- 172.21.15.17:0/3586078722 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c801c070 con 0x5596abafc2d0 2023-07-14T13:29:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.247+0000 7f74b37fe700 1 -- 172.21.15.17:0/3586078722 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f74c800bab0 con 0x5596abafc2d0 2023-07-14T13:29:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.247+0000 7f74ee392b80 1 -- 172.21.15.17:0/3586078722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596aba40e50 con 0x5596abafc2d0 2023-07-14T13:29:17.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.247+0000 7f74b37fe700 1 -- 172.21.15.17:0/3586078722 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74c8005040 con 0x5596abafc2d0 2023-07-14T13:29:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.248+0000 7f74ee392b80 10 client.19653 fetch_fsmap learned FSMap version 68 2023-07-14T13:29:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.248+0000 7f74ee392b80 1 -- 172.21.15.17:0/3586078722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5596ab85ec00 con 0x5596abafc2d0 2023-07-14T13:29:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.248+0000 7f74b37fe700 1 -- 172.21.15.17:0/3586078722 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5596aba40e50 con 0x5596abafc2d0 2023-07-14T13:29:17.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.249+0000 7f74b37fe700 1 -- 172.21.15.17:0/3586078722 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f74c8015020 con 0x5596abafc2d0 2023-07-14T13:29:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.249+0000 7f74ee392b80 10 client.19653 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:29:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.249+0000 7f74ee392b80 10 client.19653 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:29:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.249+0000 7f74ee392b80 20 client.19653 populate_metadata read hostname 'smithi017' 2023-07-14T13:29:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.249+0000 7f74ee392b80 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5596abb20d10 0x5596abb23120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.249+0000 7f74ee392b80 4 client.19653 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:29:17.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.249+0000 7f74ee392b80 1 -- 172.21.15.17:0/3586078722 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596aba02ff0 con 0x5596abb20d10 2023-07-14T13:29:17.253 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.249+0000 7f74d3fff700 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5596abb20d10 0x5596abb23120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.251+0000 7f74d3fff700 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5596abb20d10 0x5596abb23120 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6533436e7c898d2 server_cookie=ae0a23a1ff2cf28a in_seq=0 out_seq=0 2023-07-14T13:29:17.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.252+0000 7f74b37fe700 10 client.19653 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.252+0000 7f74b37fe700 1 -- 172.21.15.17:0/3586078722 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5596aba02ff0 con 0x5596abb20d10 2023-07-14T13:29:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.252+0000 7f74b37fe700 10 client.19653 handle_command_reply: tid=0 2023-07-14T13:29:17.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.253+0000 7f74ee392b80 1 client.19653 shutdown 2023-07-14T13:29:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.253+0000 7f74ee392b80 1 -- 172.21.15.17:0/3586078722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 msgr2=0x5596abb00060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.253+0000 7f74ee392b80 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 0x5596abb00060 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009810 tx=0x7f74c800f880 comp rx=0 tx=0).stop 2023-07-14T13:29:17.256 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.253+0000 7f74ee392b80 1 -- 172.21.15.17:0/3586078722 shutdown_connections 2023-07-14T13:29:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.253+0000 7f74ee392b80 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5596abb20d10 0x5596abb23120 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.253+0000 7f74ee392b80 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abb005a0 0x5596abb1ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.253+0000 7f74ee392b80 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596ab9526b0 0x5596abaffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.253+0000 7f74ee392b80 1 --2- 172.21.15.17:0/3586078722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 0x5596abb00060 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.253+0000 7f74b37fe700 0 client.19653 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.253+0000 7f74ee392b80 1 -- 172.21.15.17:0/3586078722 >> 172.21.15.17:0/3586078722 conn(0x5596abaebbe0 msgr2=0x5596abaf04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.254+0000 7f74ee392b80 1 -- 172.21.15.17:0/3586078722 shutdown_connections 2023-07-14T13:29:17.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.254+0000 7f74ee392b80 1 -- 172.21.15.17:0/3586078722 wait complete. 2023-07-14T13:29:17.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.254+0000 7f74ee392b80 20 client.19653 trim_cache size 0 max 16384 2023-07-14T13:29:17.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.287+0000 7f74ee392b80 1 Processor -- start 2023-07-14T13:29:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.291+0000 7f74ee392b80 1 -- start start 2023-07-14T13:29:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.291+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596ab9526b0 0x5596abb17c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.291+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abafc2d0 0x5596abaff2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.291+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abb005a0 0x5596abaf0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.291+0000 7f74ee392b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596abb1dbc0 con 0x5596abb005a0 2023-07-14T13:29:17.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.291+0000 7f74ee392b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596abae8c00 con 0x5596abafc2d0 2023-07-14T13:29:17.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.291+0000 7f74ee392b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596abb00ad0 con 0x5596ab9526b0 2023-07-14T13:29:17.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.292+0000 7f74d8f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abb005a0 0x5596abaf0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.292+0000 7f74d8f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abb005a0 0x5596abaf0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48422/0 (socket says 172.21.15.17:48422) 2023-07-14T13:29:17.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.292+0000 7f74d8f9c700 1 -- 172.21.15.17:0/1759826688 learned_addr learned my addr 172.21.15.17:0/1759826688 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:17.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.293+0000 7f74d8f9c700 1 -- 172.21.15.17:0/1759826688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596ab9526b0 msgr2=0x5596abb17c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:29:17.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.293+0000 7f74d8f9c700 1 --2- 172.21.15.17:0/1759826688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596ab9526b0 0x5596abb17c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.293+0000 7f74d8f9c700 1 -- 172.21.15.17:0/1759826688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abafc2d0 msgr2=0x5596abaff2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:29:17.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.293+0000 7f74d8f9c700 1 --2- 172.21.15.17:0/1759826688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abafc2d0 0x5596abaff2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.293+0000 7f74d8f9c700 1 -- 172.21.15.17:0/1759826688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596ab89c1f0 con 0x5596abb005a0 2023-07-14T13:29:17.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.293+0000 7f74d8f9c700 1 --2- 172.21.15.17:0/1759826688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abb005a0 0x5596abaf0c60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f74cc011c70 tx=0x7f74cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a414c4b78ead790a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.294+0000 7f74baffd700 1 -- 172.21.15.17:0/1759826688 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc01db90 con 0x5596abb005a0 2023-07-14T13:29:17.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.294+0000 7f74baffd700 1 -- 172.21.15.17:0/1759826688 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74cc01dcf0 con 0x5596abb005a0 2023-07-14T13:29:17.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.294+0000 7f74baffd700 1 -- 172.21.15.17:0/1759826688 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc005540 con 0x5596abb005a0 2023-07-14T13:29:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.295+0000 7f74ee392b80 1 -- 172.21.15.17:0/1759826688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abb005a0 msgr2=0x5596abaf0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.295+0000 7f74ee392b80 1 --2- 172.21.15.17:0/1759826688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abb005a0 0x5596abaf0c60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f74cc011c70 tx=0x7f74cc014000 comp rx=0 tx=0).stop 2023-07-14T13:29:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.295+0000 7f74ee392b80 1 -- 172.21.15.17:0/1759826688 shutdown_connections 2023-07-14T13:29:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.295+0000 7f74ee392b80 1 --2- 172.21.15.17:0/1759826688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abb005a0 0x5596abaf0c60 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.295+0000 7f74ee392b80 1 --2- 172.21.15.17:0/1759826688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596ab9526b0 0x5596abb17c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.295+0000 7f74ee392b80 1 --2- 172.21.15.17:0/1759826688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596abafc2d0 0x5596abaff2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.295+0000 7f74ee392b80 1 -- 172.21.15.17:0/1759826688 >> 172.21.15.17:0/1759826688 conn(0x5596abaebbe0 msgr2=0x5596abb1d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.296+0000 7f74ee392b80 1 -- 172.21.15.17:0/1759826688 shutdown_connections 2023-07-14T13:29:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.296+0000 7f74ee392b80 1 -- 172.21.15.17:0/1759826688 wait complete. 2023-07-14T13:29:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.296+0000 7f74ee392b80 1 -- start start 2023-07-14T13:29:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.297+0000 7f74ee392b80 1 Processor -- start 2023-07-14T13:29:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596ab9526b0 0x5596abaf7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 0x5596abaf7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74ee392b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596abb005a0 0x5596abaf8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74ee392b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596abaf8750 con 0x5596abafc2d0 2023-07-14T13:29:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74ee392b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596abaf8890 con 0x5596ab9526b0 2023-07-14T13:29:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74ee392b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596abaf8a20 con 0x5596abb005a0 2023-07-14T13:29:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74ee392b80 10 client.0 _ll_register_callbacks cb 0x7f74cc0091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74d3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596ab9526b0 0x5596abaf7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74d3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596ab9526b0 0x5596abaf7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41450/0 (socket says 172.21.15.17:41450) 2023-07-14T13:29:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74d3fff700 1 -- 172.21.15.17:0/204144769 learned_addr learned my addr 172.21.15.17:0/204144769 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74d8f9c700 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596abb005a0 0x5596abaf8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.298+0000 7f74d37fe700 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 0x5596abaf7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.307 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.299+0000 7f74d3fff700 1 -- 172.21.15.17:0/204144769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596abb005a0 msgr2=0x5596abaf8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.299+0000 7f74d3fff700 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596abb005a0 0x5596abaf8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.299+0000 7f74d3fff700 1 -- 172.21.15.17:0/204144769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 msgr2=0x5596abaf7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.299+0000 7f74d3fff700 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 0x5596abaf7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.299+0000 7f74d3fff700 1 -- 172.21.15.17:0/204144769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc017070 con 0x5596ab9526b0 2023-07-14T13:29:17.310 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.300+0000 7f74d3fff700 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596ab9526b0 0x5596abaf7790 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f74c4095e10 tx=0x7f74c4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50b92f6618d68f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.300+0000 7f74b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:29:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.301+0000 7f74b37fe700 1 -- 172.21.15.17:0/204144769 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c409d3d0 con 0x5596ab9526b0 2023-07-14T13:29:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.301+0000 7f74b37fe700 1 -- 172.21.15.17:0/204144769 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f74c40b0060 con 0x5596ab9526b0 2023-07-14T13:29:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.301+0000 7f74ee392b80 1 -- 172.21.15.17:0/204144769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596ab9a1490 con 0x5596ab9526b0 2023-07-14T13:29:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.302+0000 7f74b37fe700 1 -- 172.21.15.17:0/204144769 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74c40a17f0 con 0x5596ab9526b0 2023-07-14T13:29:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.302+0000 7f74ee392b80 10 client.29432 fetch_fsmap learned FSMap version 68 2023-07-14T13:29:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.302+0000 7f74ee392b80 1 -- 172.21.15.17:0/204144769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5596ab874250 con 0x5596ab9526b0 2023-07-14T13:29:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.302+0000 7f74b37fe700 1 -- 172.21.15.17:0/204144769 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5596ab9a1490 con 0x5596ab9526b0 2023-07-14T13:29:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.303+0000 7f74b37fe700 1 -- 172.21.15.17:0/204144769 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f74c40989a0 con 0x5596ab9526b0 2023-07-14T13:29:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.303+0000 7f74ee392b80 10 client.29432 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:29:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.303+0000 7f74ee392b80 10 client.29432 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:29:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.303+0000 7f74ee392b80 20 client.29432 populate_metadata read hostname 'smithi017' 2023-07-14T13:29:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.303+0000 7f74ee392b80 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5596abb75b40 0x5596abb77f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.303+0000 7f74ee392b80 4 client.29432 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:29:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.303+0000 7f74ee392b80 1 -- 172.21.15.17:0/204144769 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5596ab896f10 con 0x5596abb75b40 2023-07-14T13:29:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.303+0000 7f74d37fe700 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5596abb75b40 0x5596abb77f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.305+0000 7f74d37fe700 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5596abb75b40 0x5596abb77f50 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=979bb3cf00074de4 server_cookie=d5b717f0783068ba in_seq=0 out_seq=0 2023-07-14T13:29:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.305+0000 7f74b37fe700 10 client.29432 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:17.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.351+0000 7f74b37fe700 1 -- 172.21.15.17:0/204144769 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5596ab896f10 con 0x5596abb75b40 2023-07-14T13:29:17.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.351+0000 7f74b37fe700 10 client.29432 handle_command_reply: tid=0 2023-07-14T13:29:17.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.351+0000 7f74ee392b80 1 client.29432 shutdown 2023-07-14T13:29:17.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.352+0000 7f74ee392b80 1 -- 172.21.15.17:0/204144769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596ab9526b0 msgr2=0x5596abaf7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.352+0000 7f74ee392b80 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596ab9526b0 0x5596abaf7790 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f74c4095e10 tx=0x7f74c4004ad0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.352+0000 7f74ee392b80 1 -- 172.21.15.17:0/204144769 shutdown_connections 2023-07-14T13:29:17.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.352+0000 7f74ee392b80 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5596abb75b40 0x5596abb77f50 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.353+0000 7f74ee392b80 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5596abb005a0 0x5596abaf8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.353+0000 7f74ee392b80 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5596ab9526b0 0x5596abaf7790 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.353+0000 7f74ee392b80 1 --2- 172.21.15.17:0/204144769 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5596abafc2d0 0x5596abaf7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.353+0000 7f74ee392b80 1 -- 172.21.15.17:0/204144769 >> 172.21.15.17:0/204144769 conn(0x5596abaebbe0 msgr2=0x5596abafacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:17.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.353+0000 7f74b37fe700 0 client.29432 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:17.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.353+0000 7f74ee392b80 1 -- 172.21.15.17:0/204144769 shutdown_connections 2023-07-14T13:29:17.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.353+0000 7f74ee392b80 1 -- 172.21.15.17:0/204144769 wait complete. 2023-07-14T13:29:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.353+0000 7f74ee392b80 20 client.29432 trim_cache size 0 max 16384 2023-07-14T13:29:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:29:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:29:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:29:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:29:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.354+0000 7f74da9ff700 1 -- 172.21.15.17:0/554080691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74bc0a13c0 msgr2=0x7f74bc0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.354+0000 7f74da9ff700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74bc0a13c0 0x7f74bc0a3870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f74cc005fd0 tx=0x7f74cc009830 comp rx=0 tx=0).stop 2023-07-14T13:29:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.354+0000 7f74da9ff700 1 -- 172.21.15.17:0/554080691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d40ffb00 msgr2=0x7f74d410c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.354+0000 7f74da9ff700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d40ffb00 0x7f74d410c6c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f74c400ba50 tx=0x7f74c400be10 comp rx=0 tx=0).stop 2023-07-14T13:29:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.355+0000 7f74da9ff700 1 -- 172.21.15.17:0/554080691 shutdown_connections 2023-07-14T13:29:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.355+0000 7f74da9ff700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74bc0a13c0 0x7f74bc0a3870 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.355+0000 7f74da9ff700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d4105b10 0x7f74d41099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.355+0000 7f74da9ff700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d40ffb00 0x7f74d410c6c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.355+0000 7f74da9ff700 1 --2- 172.21.15.17:0/554080691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d41004b0 0x7f74d4109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.355+0000 7f74da9ff700 1 -- 172.21.15.17:0/554080691 >> 172.21.15.17:0/554080691 conn(0x7f74d40fb600 msgr2=0x7f74d40fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.355+0000 7f74da9ff700 1 -- 172.21.15.17:0/554080691 shutdown_connections 2023-07-14T13:29:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:17.356+0000 7f74da9ff700 1 -- 172.21.15.17:0/554080691 wait complete. 2023-07-14T13:29:17.422 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 665.0 s, 374.3 tps, lat 283.502 ms stddev 218.083 2023-07-14T13:29:17.920 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:17 smithi135 ceph-mon[97338]: pgmap v936: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.9 MiB/s wr, 947 op/s 2023-07-14T13:29:17.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:17 smithi131 ceph-mon[96953]: pgmap v936: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.9 MiB/s wr, 947 op/s 2023-07-14T13:29:18.083 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:17 smithi017 ceph-mon[95536]: pgmap v936: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.9 MiB/s wr, 947 op/s 2023-07-14T13:29:19.920 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:19 smithi135 ceph-mon[97338]: pgmap v937: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.3 MiB/s wr, 944 op/s 2023-07-14T13:29:19.974 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:19 smithi131 ceph-mon[96953]: pgmap v937: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.3 MiB/s wr, 944 op/s 2023-07-14T13:29:20.086 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:19 smithi017 ceph-mon[95536]: pgmap v937: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.3 MiB/s wr, 944 op/s 2023-07-14T13:29:21.920 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:21 smithi135 ceph-mon[97338]: pgmap v938: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.3 MiB/s wr, 954 op/s 2023-07-14T13:29:21.920 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:21 smithi135 ceph-mon[97338]: osdmap e137: 12 total, 12 up, 12 in 2023-07-14T13:29:21.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:21 smithi131 ceph-mon[96953]: pgmap v938: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.3 MiB/s wr, 954 op/s 2023-07-14T13:29:21.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:21 smithi131 ceph-mon[96953]: osdmap e137: 12 total, 12 up, 12 in 2023-07-14T13:29:22.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:21 smithi017 ceph-mon[95536]: pgmap v938: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.3 MiB/s wr, 954 op/s 2023-07-14T13:29:22.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:21 smithi017 ceph-mon[95536]: osdmap e137: 12 total, 12 up, 12 in 2023-07-14T13:29:22.421 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 670.0 s, 491.4 tps, lat 203.043 ms stddev 61.273 2023-07-14T13:29:23.920 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:23 smithi135 ceph-mon[97338]: pgmap v940: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.9 MiB/s wr, 1.16k op/s 2023-07-14T13:29:23.968 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:23 smithi131 ceph-mon[96953]: pgmap v940: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.9 MiB/s wr, 1.16k op/s 2023-07-14T13:29:24.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:23 smithi017 ceph-mon[95536]: pgmap v940: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.9 MiB/s wr, 1.16k op/s 2023-07-14T13:29:25.920 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:25 smithi135 ceph-mon[97338]: pgmap v941: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.9 MiB/s wr, 1.16k op/s 2023-07-14T13:29:25.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:25 smithi131 ceph-mon[96953]: pgmap v941: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.9 MiB/s wr, 1.16k op/s 2023-07-14T13:29:26.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:25 smithi017 ceph-mon[95536]: pgmap v941: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.9 MiB/s wr, 1.16k op/s 2023-07-14T13:29:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 675.0 s, 490.8 tps, lat 201.613 ms stddev 72.472 2023-07-14T13:29:27.920 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:27 smithi135 ceph-mon[97338]: pgmap v942: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.57k op/s 2023-07-14T13:29:27.920 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:27 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:29:27.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:27 smithi131 ceph-mon[96953]: pgmap v942: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.57k op/s 2023-07-14T13:29:27.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:27 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:29:28.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:27 smithi017 ceph-mon[95536]: pgmap v942: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.57k op/s 2023-07-14T13:29:28.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:27 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:29:29.968 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:29 smithi131 ceph-mon[96953]: pgmap v943: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.60k op/s 2023-07-14T13:29:30.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:29 smithi017 ceph-mon[95536]: pgmap v943: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.60k op/s 2023-07-14T13:29:30.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:29 smithi135 ceph-mon[97338]: pgmap v943: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.60k op/s 2023-07-14T13:29:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.648+0000 7f3d457ff700 1 -- 172.21.15.17:0/154830435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d40106cf0 msgr2=0x7f3d40112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.648+0000 7f3d457ff700 1 --2- 172.21.15.17:0/154830435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d40106cf0 0x7f3d40112f30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3d3801c0d0 tx=0x7f3d3801c3e0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.648+0000 7f3d457ff700 1 -- 172.21.15.17:0/154830435 shutdown_connections 2023-07-14T13:29:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.648+0000 7f3d457ff700 1 --2- 172.21.15.17:0/154830435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d40106cf0 0x7f3d40112f30 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.648+0000 7f3d457ff700 1 --2- 172.21.15.17:0/154830435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d4010c240 0x7f3d4010c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.648+0000 7f3d457ff700 1 --2- 172.21.15.17:0/154830435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d40106340 0x7f3d401067b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.648+0000 7f3d457ff700 1 -- 172.21.15.17:0/154830435 >> 172.21.15.17:0/154830435 conn(0x7f3d40075a20 msgr2=0x7f3d40077e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.649+0000 7f3d457ff700 1 -- 172.21.15.17:0/154830435 shutdown_connections 2023-07-14T13:29:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.649+0000 7f3d457ff700 1 -- 172.21.15.17:0/154830435 wait complete. 2023-07-14T13:29:30.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.650+0000 7f3d457ff700 1 Processor -- start 2023-07-14T13:29:30.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.651+0000 7f3d457ff700 1 -- start start 2023-07-14T13:29:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.652+0000 7f3d457ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d40106340 0x7f3d40112710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.652+0000 7f3d457ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d40106cf0 0x7f3d40112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.652+0000 7f3d457ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4010c240 0x7f3d4010e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.652+0000 7f3d457ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4010ed60 con 0x7f3d40106cf0 2023-07-14T13:29:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.652+0000 7f3d457ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4010eed0 con 0x7f3d4010c240 2023-07-14T13:29:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.652+0000 7f3d457ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4010f090 con 0x7f3d40106340 2023-07-14T13:29:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.653+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4010c240 0x7f3d4010e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.653+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4010c240 0x7f3d4010e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:32900/0 (socket says 172.21.15.17:32900) 2023-07-14T13:29:30.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.653+0000 7f3d3f7fe700 1 -- 172.21.15.17:0/2555806659 learned_addr learned my addr 172.21.15.17:0/2555806659 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.653+0000 7f3d3f7fe700 1 -- 172.21.15.17:0/2555806659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d40106340 msgr2=0x7f3d40112710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.653+0000 7f3d3f7fe700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d40106340 0x7f3d40112710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.653+0000 7f3d3f7fe700 1 -- 172.21.15.17:0/2555806659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d40106cf0 msgr2=0x7f3d40112c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.653+0000 7f3d3f7fe700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d40106cf0 0x7f3d40112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.653+0000 7f3d3f7fe700 1 -- 172.21.15.17:0/2555806659 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3801ad10 con 0x7f3d4010c240 2023-07-14T13:29:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.655+0000 7f3d3f7fe700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4010c240 0x7f3d4010e5d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3d3801cf50 tx=0x7f3d3801a3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.656+0000 7f3d27fff700 1 -- 172.21.15.17:0/2555806659 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3801f040 con 0x7f3d4010c240 2023-07-14T13:29:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.656+0000 7f3d27fff700 1 -- 172.21.15.17:0/2555806659 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d38003e10 con 0x7f3d4010c240 2023-07-14T13:29:30.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.656+0000 7f3d27fff700 1 -- 172.21.15.17:0/2555806659 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d380052a0 con 0x7f3d4010c240 2023-07-14T13:29:30.660 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.658+0000 7f3d457ff700 1 -- 172.21.15.17:0/2555806659 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4010f310 con 0x7f3d4010c240 2023-07-14T13:29:30.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.658+0000 7f3d457ff700 1 -- 172.21.15.17:0/2555806659 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d401a09b0 con 0x7f3d4010c240 2023-07-14T13:29:30.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.664+0000 7f3d59047b80 1 Processor -- start 2023-07-14T13:29:30.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.666+0000 7f3d27fff700 1 -- 172.21.15.17:0/2555806659 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3d3802c980 con 0x7f3d4010c240 2023-07-14T13:29:30.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.667+0000 7f3d59047b80 1 -- start start 2023-07-14T13:29:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.667+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.667+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde72d0 0x55b4cfde1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.667+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde1580 0x55b4cfde19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.667+0000 7f3d59047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfce6c50 con 0x55b4cfde72d0 2023-07-14T13:29:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.667+0000 7f3d59047b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfd399e0 con 0x55b4cfde1580 2023-07-14T13:29:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.667+0000 7f3d59047b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfd32e70 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.669+0000 7f3d3e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.669+0000 7f3d3e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:53692/0 (socket says 172.21.15.17:53692) 2023-07-14T13:29:30.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.669+0000 7f3d3e7fc700 1 -- 172.21.15.17:0/3977519738 learned_addr learned my addr 172.21.15.17:0/3977519738 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:30.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.670+0000 7f3d3e7fc700 1 --2- 172.21.15.17:0/3977519738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde1580 0x55b4cfde19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.670+0000 7f3d3e7fc700 1 -- 172.21.15.17:0/3977519738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde1580 msgr2=0x55b4cfde19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.670+0000 7f3d3e7fc700 1 --2- 172.21.15.17:0/3977519738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde1580 0x55b4cfde19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.670+0000 7f3d3e7fc700 1 -- 172.21.15.17:0/3977519738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde72d0 msgr2=0x55b4cfde1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.670+0000 7f3d3e7fc700 1 --2- 172.21.15.17:0/3977519738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde72d0 0x55b4cfde1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.670+0000 7f3d3e7fc700 1 -- 172.21.15.17:0/3977519738 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4cfb60d80 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.671+0000 7f3d27fff700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3d280a1450 0x7f3d280a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.671+0000 7f3d3e7fc700 1 --2- 172.21.15.17:0/3977519738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde6d90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3d300127f0 tx=0x7f3d3000af90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21dcd4ca4ab9866c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.671+0000 7f3d27fff700 1 -- 172.21.15.17:0/2555806659 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3d380de340 con 0x7f3d4010c240 2023-07-14T13:29:30.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.671+0000 7f3d257fa700 1 -- 172.21.15.17:0/3977519738 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30012230 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.672+0000 7f3d257fa700 1 -- 172.21.15.17:0/3977519738 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d30018070 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.672+0000 7f3d257fa700 1 -- 172.21.15.17:0/3977519738 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000d3e0 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.675 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.673+0000 7f3d59047b80 1 -- 172.21.15.17:0/3977519738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 msgr2=0x55b4cfde6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.673+0000 7f3d59047b80 1 --2- 172.21.15.17:0/3977519738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde6d90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3d300127f0 tx=0x7f3d3000af90 comp rx=0 tx=0).stop 2023-07-14T13:29:30.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.673+0000 7f3d3effd700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3d280a1450 0x7f3d280a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.673+0000 7f3d59047b80 1 -- 172.21.15.17:0/3977519738 shutdown_connections 2023-07-14T13:29:30.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.673+0000 7f3d59047b80 1 --2- 172.21.15.17:0/3977519738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde1580 0x55b4cfde19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.673+0000 7f3d59047b80 1 --2- 172.21.15.17:0/3977519738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde6d90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.673+0000 7f3d59047b80 1 --2- 172.21.15.17:0/3977519738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde72d0 0x55b4cfde1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.676 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.673+0000 7f3d59047b80 1 -- 172.21.15.17:0/3977519738 >> 172.21.15.17:0/3977519738 conn(0x55b4cfdd6be0 msgr2=0x55b4cfddbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.673+0000 7f3d59047b80 1 -- 172.21.15.17:0/3977519738 shutdown_connections 2023-07-14T13:29:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.674+0000 7f3d59047b80 1 -- 172.21.15.17:0/3977519738 wait complete. 2023-07-14T13:29:30.677 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.674+0000 7f3d3effd700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3d280a1450 0x7f3d280a3900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55b4cfdddb40 tx=0x7f3d34006d90 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.675+0000 7f3d59047b80 1 -- start start 2023-07-14T13:29:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.675+0000 7f3d59047b80 1 Processor -- start 2023-07-14T13:29:30.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.676+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfdea980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.676+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde1580 0x55b4cfdeaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.676+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde72d0 0x55b4cfdeb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.676+0000 7f3d59047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfcd2a60 con 0x55b4cfde72d0 2023-07-14T13:29:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.676+0000 7f3d59047b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfcd2760 con 0x55b4cfde1580 2023-07-14T13:29:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.676+0000 7f3d59047b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfbb68c0 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.679 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.676+0000 7f3d59047b80 10 client.0 _ll_register_callbacks cb 0x55b4cfcd0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:30.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.677+0000 7f3d3effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfdea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.677+0000 7f3d3effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfdea980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:53694/0 (socket says 172.21.15.17:53694) 2023-07-14T13:29:30.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.677+0000 7f3d3effd700 1 -- 172.21.15.17:0/2365088781 learned_addr learned my addr 172.21.15.17:0/2365088781 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:30.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.678+0000 7f3d3e7fc700 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde1580 0x55b4cfdeaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.678+0000 7f3d3f7fe700 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde72d0 0x55b4cfdeb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.678+0000 7f3d3effd700 1 -- 172.21.15.17:0/2365088781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde1580 msgr2=0x55b4cfdeaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:30.681 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.678+0000 7f3d3effd700 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde1580 0x55b4cfdeaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.679+0000 7f3d3effd700 1 -- 172.21.15.17:0/2365088781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde72d0 msgr2=0x55b4cfdeb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.679+0000 7f3d3effd700 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde72d0 0x55b4cfdeb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.679+0000 7f3d3effd700 1 -- 172.21.15.17:0/2365088781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d300124d0 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.679+0000 7f3d3e7fc700 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde1580 0x55b4cfdeaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.679+0000 7f3d3f7fe700 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde72d0 0x55b4cfdeb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:30.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.679+0000 7f3d3effd700 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfdea980 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3d340123e0 tx=0x7f3d34004940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=202b9c321d8960c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.679+0000 7f3d22ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:29:30.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.679+0000 7f3d22ff5700 1 -- 172.21.15.17:0/2365088781 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3401a070 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.680+0000 7f3d59047b80 1 -- 172.21.15.17:0/2365088781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4cfc8c490 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.680+0000 7f3d22ff5700 1 -- 172.21.15.17:0/2365088781 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3d340150d0 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.685+0000 7f3d22ff5700 1 -- 172.21.15.17:0/2365088781 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d34015290 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.685+0000 7f3d59047b80 10 client.29407 fetch_fsmap learned FSMap version 68 2023-07-14T13:29:30.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.685+0000 7f3d59047b80 1 -- 172.21.15.17:0/2365088781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55b4cfb49c00 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.686+0000 7f3d22ff5700 1 -- 172.21.15.17:0/2365088781 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d3402b020 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.686+0000 7f3d22ff5700 1 -- 172.21.15.17:0/2365088781 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3d34026390 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.687+0000 7f3d59047b80 10 client.29407 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:29:30.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.687+0000 7f3d59047b80 10 client.29407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:29:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.687+0000 7f3d59047b80 20 client.29407 populate_metadata read hostname 'smithi017' 2023-07-14T13:29:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.687+0000 7f3d59047b80 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4cfdfadc0 0x55b4cfdfd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.687+0000 7f3d59047b80 4 client.29407 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:29:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.687+0000 7f3d59047b80 1 -- 172.21.15.17:0/2365088781 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4cfd2be50 con 0x55b4cfdfadc0 2023-07-14T13:29:30.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.688+0000 7f3d3e7fc700 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4cfdfadc0 0x55b4cfdfd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.696+0000 7f3d3e7fc700 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4cfdfadc0 0x55b4cfdfd1d0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c726a4315733e5ee server_cookie=fe46bf67b4696306 in_seq=0 out_seq=0 2023-07-14T13:29:30.698 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.696+0000 7f3d22ff5700 10 client.29407 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.697+0000 7f3d22ff5700 1 -- 172.21.15.17:0/2365088781 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b4cfd2be50 con 0x55b4cfdfadc0 2023-07-14T13:29:30.699 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.697+0000 7f3d22ff5700 10 client.29407 handle_command_reply: tid=0 2023-07-14T13:29:30.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.699+0000 7f3d59047b80 1 client.29407 shutdown 2023-07-14T13:29:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.700+0000 7f3d59047b80 1 -- 172.21.15.17:0/2365088781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 msgr2=0x55b4cfdea980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.700+0000 7f3d59047b80 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfdea980 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3d340123e0 tx=0x7f3d34004940 comp rx=0 tx=0).stop 2023-07-14T13:29:30.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.700+0000 7f3d59047b80 1 -- 172.21.15.17:0/2365088781 shutdown_connections 2023-07-14T13:29:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.700+0000 7f3d59047b80 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4cfdfadc0 0x55b4cfdfd1d0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.700+0000 7f3d59047b80 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde72d0 0x55b4cfdeb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.700+0000 7f3d59047b80 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfdea980 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.700+0000 7f3d59047b80 1 --2- 172.21.15.17:0/2365088781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde1580 0x55b4cfdeaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.700+0000 7f3d59047b80 1 -- 172.21.15.17:0/2365088781 >> 172.21.15.17:0/2365088781 conn(0x55b4cfdd6be0 msgr2=0x55b4cfddb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:30.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.700+0000 7f3d22ff5700 0 client.29407 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.703+0000 7f3d59047b80 1 -- 172.21.15.17:0/2365088781 shutdown_connections 2023-07-14T13:29:30.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.703+0000 7f3d59047b80 1 -- 172.21.15.17:0/2365088781 wait complete. 2023-07-14T13:29:30.706 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.704+0000 7f3d59047b80 20 client.29407 trim_cache size 0 max 16384 2023-07-14T13:29:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.735+0000 7f3d59047b80 1 Processor -- start 2023-07-14T13:29:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.745+0000 7f3d59047b80 1 -- start start 2023-07-14T13:29:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.745+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.745+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde1580 0x55b4cfdf1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.745+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfde72d0 0x55b4cfdeb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.745+0000 7f3d59047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfdd3bb0 con 0x55b4cfde1580 2023-07-14T13:29:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.745+0000 7f3d59047b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfdd85f0 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.745+0000 7f3d59047b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfddcb20 con 0x55b4cfde72d0 2023-07-14T13:29:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.749+0000 7f3d3effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.749+0000 7f3d3effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:32928/0 (socket says 172.21.15.17:32928) 2023-07-14T13:29:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.749+0000 7f3d3effd700 1 -- 172.21.15.17:0/3884559273 learned_addr learned my addr 172.21.15.17:0/3884559273 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.750+0000 7f3d3f7fe700 1 --2- 172.21.15.17:0/3884559273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfde72d0 0x55b4cfdeb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.750+0000 7f3d3effd700 1 -- 172.21.15.17:0/3884559273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfde72d0 msgr2=0x55b4cfdeb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.750+0000 7f3d3effd700 1 --2- 172.21.15.17:0/3884559273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfde72d0 0x55b4cfdeb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.750+0000 7f3d3effd700 1 -- 172.21.15.17:0/3884559273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde1580 msgr2=0x55b4cfdf1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.750+0000 7f3d3effd700 1 --2- 172.21.15.17:0/3884559273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde1580 0x55b4cfdf1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.750+0000 7f3d3effd700 1 -- 172.21.15.17:0/3884559273 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4cfb871f0 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.751+0000 7f3d3effd700 1 --2- 172.21.15.17:0/3884559273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde1040 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3d34027000 tx=0x7f3d34012f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=952b90a869a27c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.752+0000 7f3d25ffb700 1 -- 172.21.15.17:0/3884559273 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3401a040 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.752+0000 7f3d25ffb700 1 -- 172.21.15.17:0/3884559273 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d3402b030 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.752+0000 7f3d25ffb700 1 -- 172.21.15.17:0/3884559273 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34013b10 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.753+0000 7f3d59047b80 1 -- 172.21.15.17:0/3884559273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfc3d6b0 msgr2=0x55b4cfde1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.753+0000 7f3d59047b80 1 --2- 172.21.15.17:0/3884559273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde1040 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3d34027000 tx=0x7f3d34012f50 comp rx=0 tx=0).stop 2023-07-14T13:29:30.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.753+0000 7f3d59047b80 1 -- 172.21.15.17:0/3884559273 shutdown_connections 2023-07-14T13:29:30.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.753+0000 7f3d59047b80 1 --2- 172.21.15.17:0/3884559273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfde72d0 0x55b4cfdeb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.753+0000 7f3d59047b80 1 --2- 172.21.15.17:0/3884559273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfde1040 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.753+0000 7f3d59047b80 1 --2- 172.21.15.17:0/3884559273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfde1580 0x55b4cfdf1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.753+0000 7f3d59047b80 1 -- 172.21.15.17:0/3884559273 >> 172.21.15.17:0/3884559273 conn(0x55b4cfdd6be0 msgr2=0x55b4cfde63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:30.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.755+0000 7f3d59047b80 1 -- 172.21.15.17:0/3884559273 shutdown_connections 2023-07-14T13:29:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.755+0000 7f3d59047b80 1 -- 172.21.15.17:0/3884559273 wait complete. 2023-07-14T13:29:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.755+0000 7f3d59047b80 1 -- start start 2023-07-14T13:29:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.756+0000 7f3d59047b80 1 Processor -- start 2023-07-14T13:29:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.757+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfdf16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.757+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfde1580 0x55b4cfdf1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.757+0000 7f3d59047b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde72d0 0x55b4cfdefc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.757+0000 7f3d59047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfdf0250 con 0x55b4cfc3d6b0 2023-07-14T13:29:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.757+0000 7f3d59047b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfdf03c0 con 0x55b4cfde72d0 2023-07-14T13:29:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.757+0000 7f3d59047b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4cfdf0580 con 0x55b4cfde1580 2023-07-14T13:29:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.757+0000 7f3d59047b80 10 client.0 _ll_register_callbacks cb 0x7f3d34015990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.757+0000 7f3d3e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfde1580 0x55b4cfdf1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.757+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde72d0 0x55b4cfdefc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.758+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde72d0 0x55b4cfdefc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:32938/0 (socket says 172.21.15.17:32938) 2023-07-14T13:29:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.758+0000 7f3d3f7fe700 1 -- 172.21.15.17:0/34416565 learned_addr learned my addr 172.21.15.17:0/34416565 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.758+0000 7f3d3e7fc700 1 -- 172.21.15.17:0/34416565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde72d0 msgr2=0x55b4cfdefc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.758+0000 7f3d3e7fc700 1 --2- 172.21.15.17:0/34416565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde72d0 0x55b4cfdefc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.758+0000 7f3d3e7fc700 1 -- 172.21.15.17:0/34416565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfc3d6b0 msgr2=0x55b4cfdf16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.758+0000 7f3d3e7fc700 1 --2- 172.21.15.17:0/34416565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfdf16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.758+0000 7f3d3e7fc700 1 -- 172.21.15.17:0/34416565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4cfb49c00 con 0x55b4cfde1580 2023-07-14T13:29:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.762+0000 7f3d3e7fc700 1 --2- 172.21.15.17:0/34416565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfde1580 0x55b4cfdf1bf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x55b4cfdebfc0 tx=0x7f3d3000abd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ed591cbf35a185 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.763+0000 7f3d22ff5700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:29:30.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.768+0000 7f3d22ff5700 1 -- 172.21.15.17:0/34416565 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d300285d0 con 0x55b4cfde1580 2023-07-14T13:29:30.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.768+0000 7f3d22ff5700 1 -- 172.21.15.17:0/34416565 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3d30025070 con 0x55b4cfde1580 2023-07-14T13:29:30.770 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.768+0000 7f3d59047b80 1 -- 172.21.15.17:0/34416565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d30018070 con 0x55b4cfde1580 2023-07-14T13:29:30.771 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.769+0000 7f3d22ff5700 1 -- 172.21.15.17:0/34416565 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d300040c0 con 0x55b4cfde1580 2023-07-14T13:29:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.774+0000 7f3d59047b80 10 client.29413 fetch_fsmap learned FSMap version 68 2023-07-14T13:29:30.776 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.774+0000 7f3d59047b80 1 -- 172.21.15.17:0/34416565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55b4cfb5f250 con 0x55b4cfde1580 2023-07-14T13:29:30.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.776+0000 7f3d22ff5700 1 -- 172.21.15.17:0/34416565 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d30018070 con 0x55b4cfde1580 2023-07-14T13:29:30.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.776+0000 7f3d22ff5700 1 -- 172.21.15.17:0/34416565 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3d30004830 con 0x55b4cfde1580 2023-07-14T13:29:30.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.776+0000 7f3d59047b80 10 client.29413 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:29:30.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.776+0000 7f3d59047b80 10 client.29413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:29:30.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.777+0000 7f3d59047b80 20 client.29413 populate_metadata read hostname 'smithi017' 2023-07-14T13:29:30.779 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.777+0000 7f3d59047b80 1 --2- 172.21.15.17:0/34416565 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4cfe60c30 0x55b4cfe63040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:30.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.777+0000 7f3d59047b80 4 client.29413 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:29:30.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.777+0000 7f3d59047b80 1 -- 172.21.15.17:0/34416565 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b4cfcedff0 con 0x55b4cfe60c30 2023-07-14T13:29:30.780 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.777+0000 7f3d3effd700 1 --2- 172.21.15.17:0/34416565 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4cfe60c30 0x55b4cfe63040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:30.781 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.779+0000 7f3d22ff5700 10 client.29413 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:30.782 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.779+0000 7f3d3effd700 1 --2- 172.21.15.17:0/34416565 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4cfe60c30 0x55b4cfe63040 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a95aa9f1d92e6f36 server_cookie=f9fe45e161466a40 in_seq=0 out_seq=0 2023-07-14T13:29:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.827+0000 7f3d22ff5700 1 -- 172.21.15.17:0/34416565 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b4cfcedff0 con 0x55b4cfe60c30 2023-07-14T13:29:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.827+0000 7f3d22ff5700 10 client.29413 handle_command_reply: tid=0 2023-07-14T13:29:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.827+0000 7f3d59047b80 1 client.29413 shutdown 2023-07-14T13:29:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.828+0000 7f3d59047b80 1 -- 172.21.15.17:0/34416565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfde1580 msgr2=0x55b4cfdf1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.828+0000 7f3d59047b80 1 --2- 172.21.15.17:0/34416565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfde1580 0x55b4cfdf1bf0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x55b4cfdebfc0 tx=0x7f3d3000abd0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.828+0000 7f3d59047b80 1 -- 172.21.15.17:0/34416565 shutdown_connections 2023-07-14T13:29:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.828+0000 7f3d59047b80 1 --2- 172.21.15.17:0/34416565 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55b4cfe60c30 0x55b4cfe63040 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.828+0000 7f3d59047b80 1 --2- 172.21.15.17:0/34416565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b4cfde72d0 0x55b4cfdefc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.828+0000 7f3d22ff5700 0 client.29413 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.828+0000 7f3d59047b80 1 --2- 172.21.15.17:0/34416565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55b4cfc3d6b0 0x55b4cfdf16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.828+0000 7f3d59047b80 1 --2- 172.21.15.17:0/34416565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4cfde1580 0x55b4cfdf1bf0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.828+0000 7f3d59047b80 1 -- 172.21.15.17:0/34416565 >> 172.21.15.17:0/34416565 conn(0x55b4cfdd6be0 msgr2=0x55b4cfde7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.828+0000 7f3d59047b80 1 -- 172.21.15.17:0/34416565 shutdown_connections 2023-07-14T13:29:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.828+0000 7f3d59047b80 1 -- 172.21.15.17:0/34416565 wait complete. 2023-07-14T13:29:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.829+0000 7f3d59047b80 20 client.29413 trim_cache size 0 max 16384 2023-07-14T13:29:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:29:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:29:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:29:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:29:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.832+0000 7f3d457ff700 1 -- 172.21.15.17:0/2555806659 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3d280a1450 msgr2=0x7f3d280a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.832+0000 7f3d457ff700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3d280a1450 0x7f3d280a3900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55b4cfdddb40 tx=0x7f3d34006d90 comp rx=0 tx=0).stop 2023-07-14T13:29:30.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.832+0000 7f3d457ff700 1 -- 172.21.15.17:0/2555806659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4010c240 msgr2=0x7f3d4010e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.832+0000 7f3d457ff700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4010c240 0x7f3d4010e5d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3d3801cf50 tx=0x7f3d3801a3b0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.833+0000 7f3d457ff700 1 -- 172.21.15.17:0/2555806659 shutdown_connections 2023-07-14T13:29:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.833+0000 7f3d457ff700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3d280a1450 0x7f3d280a3900 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.833+0000 7f3d457ff700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d4010c240 0x7f3d4010e5d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.833+0000 7f3d457ff700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d40106340 0x7f3d40112710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.833+0000 7f3d457ff700 1 --2- 172.21.15.17:0/2555806659 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d40106cf0 0x7f3d40112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.833+0000 7f3d457ff700 1 -- 172.21.15.17:0/2555806659 >> 172.21.15.17:0/2555806659 conn(0x7f3d40075a20 msgr2=0x7f3d40076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.834+0000 7f3d457ff700 1 -- 172.21.15.17:0/2555806659 shutdown_connections 2023-07-14T13:29:30.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:30.834+0000 7f3d457ff700 1 -- 172.21.15.17:0/2555806659 wait complete. 2023-07-14T13:29:31.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:31 smithi131 ceph-mon[96953]: pgmap v944: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 14 MiB/s wr, 1.60k op/s 2023-07-14T13:29:31.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:31 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:29:31.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:31 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:29:31.970 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:31 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:29:32.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:31 smithi017 ceph-mon[95536]: pgmap v944: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 14 MiB/s wr, 1.60k op/s 2023-07-14T13:29:32.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:31 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:29:32.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:31 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:29:32.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:31 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:29:32.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:31 smithi135 ceph-mon[97338]: pgmap v944: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 14 MiB/s wr, 1.60k op/s 2023-07-14T13:29:32.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:31 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:29:32.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:31 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:29:32.171 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:31 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:29:32.421 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 680.0 s, 478.6 tps, lat 214.285 ms stddev 98.672 2023-07-14T13:29:33.968 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:33 smithi131 ceph-mon[96953]: pgmap v945: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.55k op/s 2023-07-14T13:29:34.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:33 smithi017 ceph-mon[95536]: pgmap v945: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.55k op/s 2023-07-14T13:29:34.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:33 smithi135 ceph-mon[97338]: pgmap v945: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.55k op/s 2023-07-14T13:29:35.968 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:35 smithi131 ceph-mon[96953]: pgmap v946: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 12 MiB/s wr, 1.34k op/s 2023-07-14T13:29:36.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:35 smithi017 ceph-mon[95536]: pgmap v946: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 12 MiB/s wr, 1.34k op/s 2023-07-14T13:29:36.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:35 smithi135 ceph-mon[97338]: pgmap v946: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 12 MiB/s wr, 1.34k op/s 2023-07-14T13:29:37.421 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 685.0 s, 658.8 tps, lat 150.192 ms stddev 37.407 2023-07-14T13:29:37.968 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:37 smithi131 ceph-mon[96953]: pgmap v947: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 18 MiB/s wr, 1.98k op/s 2023-07-14T13:29:38.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:37 smithi017 ceph-mon[95536]: pgmap v947: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 18 MiB/s wr, 1.98k op/s 2023-07-14T13:29:38.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:37 smithi135 ceph-mon[97338]: pgmap v947: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 18 MiB/s wr, 1.98k op/s 2023-07-14T13:29:40.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:39 smithi017 ceph-mon[95536]: pgmap v948: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 13 MiB/s wr, 1.43k op/s 2023-07-14T13:29:40.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:39 smithi135 ceph-mon[97338]: pgmap v948: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 13 MiB/s wr, 1.43k op/s 2023-07-14T13:29:40.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:39 smithi131 ceph-mon[96953]: pgmap v948: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 13 MiB/s wr, 1.43k op/s 2023-07-14T13:29:42.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:41 smithi017 ceph-mon[95536]: pgmap v949: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.44k op/s 2023-07-14T13:29:42.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:41 smithi135 ceph-mon[97338]: pgmap v949: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.44k op/s 2023-07-14T13:29:42.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:41 smithi131 ceph-mon[96953]: pgmap v949: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.44k op/s 2023-07-14T13:29:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 690.0 s, 503.0 tps, lat 159.751 ms stddev 94.413 2023-07-14T13:29:43.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:42 smithi017 ceph-mon[95536]: pgmap v950: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 18 MiB/s wr, 1.96k op/s 2023-07-14T13:29:43.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:42 smithi135 ceph-mon[97338]: pgmap v950: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 18 MiB/s wr, 1.96k op/s 2023-07-14T13:29:43.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:42 smithi131 ceph-mon[96953]: pgmap v950: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 18 MiB/s wr, 1.96k op/s 2023-07-14T13:29:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.124+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3230171173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dbc102950 msgr2=0x7f5dbc106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.124+0000 7f5dc1bff700 1 --2- 172.21.15.17:0/3230171173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dbc102950 0x7f5dbc106910 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5da400b0d0 tx=0x7f5da400b3e0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.126+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3230171173 shutdown_connections 2023-07-14T13:29:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.126+0000 7f5dc1bff700 1 --2- 172.21.15.17:0/3230171173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dbc106ff0 0x7f5dbc10ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.126+0000 7f5dc1bff700 1 --2- 172.21.15.17:0/3230171173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dbc101fb0 0x7f5dbc102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.126+0000 7f5dc1bff700 1 --2- 172.21.15.17:0/3230171173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dbc102950 0x7f5dbc106910 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.126+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3230171173 >> 172.21.15.17:0/3230171173 conn(0x7f5dbc0fd800 msgr2=0x7f5dbc0ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.127+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3230171173 shutdown_connections 2023-07-14T13:29:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.127+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3230171173 wait complete. 2023-07-14T13:29:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.129+0000 7f5dc1bff700 1 Processor -- start 2023-07-14T13:29:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.129+0000 7f5dc1bff700 1 -- start start 2023-07-14T13:29:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.130+0000 7f5dc1bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dbc101fb0 0x7f5dbc10e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.130+0000 7f5dc1bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dbc102950 0x7f5dbc10b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.130+0000 7f5dc1bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dbc106ff0 0x7f5dbc10bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.130+0000 7f5dc1bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc10c100 con 0x7f5dbc102950 2023-07-14T13:29:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.130+0000 7f5dc1bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc10c270 con 0x7f5dbc101fb0 2023-07-14T13:29:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.130+0000 7f5dc1bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc10c430 con 0x7f5dbc106ff0 2023-07-14T13:29:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.130+0000 7f5dbb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dbc101fb0 0x7f5dbc10e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.130+0000 7f5dbb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dbc101fb0 0x7f5dbc10e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59302/0 (socket says 172.21.15.17:59302) 2023-07-14T13:29:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.130+0000 7f5dbb7fe700 1 -- 172.21.15.17:0/3405251038 learned_addr learned my addr 172.21.15.17:0/3405251038 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.131+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dbc106ff0 0x7f5dbc10bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.131+0000 7f5dbaffd700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dbc102950 0x7f5dbc10b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.131+0000 7f5dbbfff700 1 -- 172.21.15.17:0/3405251038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dbc101fb0 msgr2=0x7f5dbc10e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.131+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dbc101fb0 0x7f5dbc10e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.131+0000 7f5dbbfff700 1 -- 172.21.15.17:0/3405251038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dbc102950 msgr2=0x7f5dbc10b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.131+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dbc102950 0x7f5dbc10b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.131+0000 7f5dbbfff700 1 -- 172.21.15.17:0/3405251038 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da4009d00 con 0x7f5dbc106ff0 2023-07-14T13:29:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.132+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dbc106ff0 0x7f5dbc10bb30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5db400b3c0 tx=0x7f5db400b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.132+0000 7f5db8ff9700 1 -- 172.21.15.17:0/3405251038 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4011620 con 0x7f5dbc106ff0 2023-07-14T13:29:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.132+0000 7f5db8ff9700 1 -- 172.21.15.17:0/3405251038 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5db4011c10 con 0x7f5dbc106ff0 2023-07-14T13:29:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.132+0000 7f5db8ff9700 1 -- 172.21.15.17:0/3405251038 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4010c80 con 0x7f5dbc106ff0 2023-07-14T13:29:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.132+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3405251038 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dbc1a8d20 con 0x7f5dbc106ff0 2023-07-14T13:29:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.133+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3405251038 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc1a91b0 con 0x7f5dbc106ff0 2023-07-14T13:29:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.140+0000 7f5db8ff9700 1 -- 172.21.15.17:0/3405251038 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f5db4011780 con 0x7f5dbc106ff0 2023-07-14T13:29:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.140+0000 7f5dd5613b80 1 Processor -- start 2023-07-14T13:29:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.141+0000 7f5dd5613b80 1 -- start start 2023-07-14T13:29:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.141+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 0x559327663d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.141+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x55932765e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.141+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55932765e580 0x55932765e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.141+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559327563c50 con 0x5593274ba6b0 2023-07-14T13:29:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.141+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593275b69e0 con 0x55932765e580 2023-07-14T13:29:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.141+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593275afe70 con 0x5593276642d0 2023-07-14T13:29:44.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.142+0000 7f5dbaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 0x559327663d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.142+0000 7f5dbaffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 0x559327663d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41212/0 (socket says 172.21.15.17:41212) 2023-07-14T13:29:44.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.142+0000 7f5dbaffd700 1 -- 172.21.15.17:0/2670911728 learned_addr learned my addr 172.21.15.17:0/2670911728 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:44.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.142+0000 7f5dbaffd700 1 --2- 172.21.15.17:0/2670911728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55932765e580 0x55932765e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.142+0000 7f5dbb7fe700 1 --2- 172.21.15.17:0/2670911728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x55932765e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.143+0000 7f5dbaffd700 1 -- 172.21.15.17:0/2670911728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 msgr2=0x55932765e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.143+0000 7f5dbaffd700 1 --2- 172.21.15.17:0/2670911728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x55932765e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.143+0000 7f5dbaffd700 1 -- 172.21.15.17:0/2670911728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55932765e580 msgr2=0x55932765e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.143+0000 7f5dbaffd700 1 --2- 172.21.15.17:0/2670911728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55932765e580 0x55932765e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.146 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.143+0000 7f5dbaffd700 1 -- 172.21.15.17:0/2670911728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593273ddd80 con 0x5593274ba6b0 2023-07-14T13:29:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.143+0000 7f5dbb7fe700 1 --2- 172.21.15.17:0/2670911728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x55932765e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.143+0000 7f5db8ff9700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5da80a1400 0x7f5da80a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.143+0000 7f5dbaffd700 1 --2- 172.21.15.17:0/2670911728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 0x559327663d90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f5da400b0d0 tx=0x7f5da4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe81d89a0369aaf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.143+0000 7f5db8ff9700 1 -- 172.21.15.17:0/3405251038 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5db40cc4d0 con 0x7f5dbc106ff0 2023-07-14T13:29:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.144+0000 7f5dbb7fe700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5da80a1400 0x7f5da80a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.144+0000 7f5db1ffb700 1 -- 172.21.15.17:0/2670911728 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da400e050 con 0x5593274ba6b0 2023-07-14T13:29:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.144+0000 7f5db1ffb700 1 -- 172.21.15.17:0/2670911728 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5da401f470 con 0x5593274ba6b0 2023-07-14T13:29:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.144+0000 7f5db1ffb700 1 -- 172.21.15.17:0/2670911728 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da40091b0 con 0x5593274ba6b0 2023-07-14T13:29:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.145+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2670911728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 msgr2=0x559327663d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.145+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/2670911728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 0x559327663d90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f5da400b0d0 tx=0x7f5da4009310 comp rx=0 tx=0).stop 2023-07-14T13:29:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.145+0000 7f5dbb7fe700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5da80a1400 0x7f5da80a38b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55932765ab40 tx=0x7f5dac00a400 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.146+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2670911728 shutdown_connections 2023-07-14T13:29:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.146+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/2670911728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55932765e580 0x55932765e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.146+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/2670911728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 0x559327663d90 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.146+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/2670911728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x55932765e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.146+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2670911728 >> 172.21.15.17:0/2670911728 conn(0x559327653be0 msgr2=0x559327658f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.146+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2670911728 shutdown_connections 2023-07-14T13:29:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.146+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2670911728 wait complete. 2023-07-14T13:29:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.146+0000 7f5dd5613b80 1 -- start start 2023-07-14T13:29:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.147+0000 7f5dd5613b80 1 Processor -- start 2023-07-14T13:29:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.148+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x55932766a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.148+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55932765e580 0x5593276678b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.148+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x559327667fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.148+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55932754fa60 con 0x55932765e580 2023-07-14T13:29:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.148+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55932754f760 con 0x5593274ba6b0 2023-07-14T13:29:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.148+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593274338c0 con 0x5593276642d0 2023-07-14T13:29:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.148+0000 7f5dd5613b80 10 client.0 _ll_register_callbacks cb 0x55932754d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.148+0000 7f5dbb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x55932766a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.148+0000 7f5dbb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x55932766a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59324/0 (socket says 172.21.15.17:59324) 2023-07-14T13:29:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.148+0000 7f5dbb7fe700 1 -- 172.21.15.17:0/550402244 learned_addr learned my addr 172.21.15.17:0/550402244 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.148+0000 7f5dbaffd700 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55932765e580 0x5593276678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.149+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x559327667fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.149+0000 7f5dbb7fe700 1 -- 172.21.15.17:0/550402244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 msgr2=0x559327667fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.149+0000 7f5dbb7fe700 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x559327667fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.149+0000 7f5dbb7fe700 1 -- 172.21.15.17:0/550402244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55932765e580 msgr2=0x5593276678b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.149+0000 7f5dbb7fe700 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55932765e580 0x5593276678b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.149+0000 7f5dbb7fe700 1 -- 172.21.15.17:0/550402244 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc10f400 con 0x5593274ba6b0 2023-07-14T13:29:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.149+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x559327667fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.149+0000 7f5dbaffd700 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55932765e580 0x5593276678b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.150+0000 7f5dbb7fe700 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x55932766a630 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5dac010f00 tx=0x7f5dac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22f63a899b21ef68 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.150+0000 7f5d9affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:29:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.150+0000 7f5d9affd700 1 -- 172.21.15.17:0/550402244 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac01de70 con 0x5593274ba6b0 2023-07-14T13:29:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.150+0000 7f5d9affd700 1 -- 172.21.15.17:0/550402244 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5dac01b460 con 0x5593274ba6b0 2023-07-14T13:29:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.150+0000 7f5dd5613b80 1 -- 172.21.15.17:0/550402244 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559327509490 con 0x5593274ba6b0 2023-07-14T13:29:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.151+0000 7f5d9affd700 1 -- 172.21.15.17:0/550402244 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dac01b660 con 0x5593274ba6b0 2023-07-14T13:29:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.151+0000 7f5dd5613b80 10 client.29459 fetch_fsmap learned FSMap version 68 2023-07-14T13:29:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.151+0000 7f5dd5613b80 1 -- 172.21.15.17:0/550402244 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5593273c6c00 con 0x5593274ba6b0 2023-07-14T13:29:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.151+0000 7f5d9affd700 1 -- 172.21.15.17:0/550402244 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559327509490 con 0x5593274ba6b0 2023-07-14T13:29:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.151+0000 7f5d9affd700 1 -- 172.21.15.17:0/550402244 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5dac025870 con 0x5593274ba6b0 2023-07-14T13:29:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.152+0000 7f5dd5613b80 10 client.29459 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:29:44.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.152+0000 7f5dd5613b80 10 client.29459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:29:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.152+0000 7f5dd5613b80 20 client.29459 populate_metadata read hostname 'smithi017' 2023-07-14T13:29:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.152+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559327677c00 0x55932767a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.152+0000 7f5dd5613b80 4 client.29459 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:29:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.152+0000 7f5dd5613b80 1 -- 172.21.15.17:0/550402244 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5593275a8e50 con 0x559327677c00 2023-07-14T13:29:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.152+0000 7f5dbaffd700 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559327677c00 0x55932767a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.153+0000 7f5d9affd700 10 client.29459 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.153+0000 7f5dbaffd700 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559327677c00 0x55932767a010 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41ce6d17a77fd964 server_cookie=b97ecf2a82ad6d3f in_seq=0 out_seq=0 2023-07-14T13:29:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.155+0000 7f5d9affd700 1 -- 172.21.15.17:0/550402244 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5593275a8e50 con 0x559327677c00 2023-07-14T13:29:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.155+0000 7f5d9affd700 10 client.29459 handle_command_reply: tid=0 2023-07-14T13:29:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.155+0000 7f5dd5613b80 1 client.29459 shutdown 2023-07-14T13:29:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.155+0000 7f5dd5613b80 1 -- 172.21.15.17:0/550402244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 msgr2=0x55932766a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.155+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x55932766a630 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5dac010f00 tx=0x7f5dac004750 comp rx=0 tx=0).stop 2023-07-14T13:29:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.156+0000 7f5dd5613b80 1 -- 172.21.15.17:0/550402244 shutdown_connections 2023-07-14T13:29:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.156+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559327677c00 0x55932767a010 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.156+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x559327667fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.156+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x55932766a630 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.156+0000 7f5d9affd700 0 client.29459 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.156+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/550402244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55932765e580 0x5593276678b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.156+0000 7f5dd5613b80 1 -- 172.21.15.17:0/550402244 >> 172.21.15.17:0/550402244 conn(0x559327653be0 msgr2=0x5593276584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.156+0000 7f5dd5613b80 1 -- 172.21.15.17:0/550402244 shutdown_connections 2023-07-14T13:29:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.156+0000 7f5dd5613b80 1 -- 172.21.15.17:0/550402244 wait complete. 2023-07-14T13:29:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.156+0000 7f5dd5613b80 20 client.29459 trim_cache size 0 max 16384 2023-07-14T13:29:44.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.185+0000 7f5dd5613b80 1 Processor -- start 2023-07-14T13:29:44.187 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.185+0000 7f5dd5613b80 1 -- start start 2023-07-14T13:29:44.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.185+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x5593276631a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.185+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55932765e580 0x559327658c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.185+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x55932766a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.185+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559327663a50 con 0x55932765e580 2023-07-14T13:29:44.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.185+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55932765a9a0 con 0x5593274ba6b0 2023-07-14T13:29:44.188 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.185+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559327650bd0 con 0x5593276642d0 2023-07-14T13:29:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.186+0000 7f5dbb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x5593276631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.186+0000 7f5dbb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x5593276631a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59336/0 (socket says 172.21.15.17:59336) 2023-07-14T13:29:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.186+0000 7f5dbb7fe700 1 -- 172.21.15.17:0/3013517968 learned_addr learned my addr 172.21.15.17:0/3013517968 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.186+0000 7f5dbaffd700 1 --2- 172.21.15.17:0/3013517968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55932765e580 0x559327658c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.186+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/3013517968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x55932766a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.187+0000 7f5dbbfff700 1 -- 172.21.15.17:0/3013517968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 msgr2=0x5593276631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.187+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/3013517968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x5593276631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.187+0000 7f5dbbfff700 1 -- 172.21.15.17:0/3013517968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55932765e580 msgr2=0x559327658c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.187+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/3013517968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55932765e580 0x559327658c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.187+0000 7f5dbbfff700 1 -- 172.21.15.17:0/3013517968 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55932767ec40 con 0x5593276642d0 2023-07-14T13:29:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.187+0000 7f5dbb7fe700 1 --2- 172.21.15.17:0/3013517968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x5593276631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:29:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.187+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/3013517968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x55932766a1d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5db40c9cf0 tx=0x7f5db4099230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c790d662cd95bd2a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.187+0000 7f5db27fc700 1 -- 172.21.15.17:0/3013517968 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4011a30 con 0x5593276642d0 2023-07-14T13:29:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.187+0000 7f5db27fc700 1 -- 172.21.15.17:0/3013517968 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5db4099670 con 0x5593276642d0 2023-07-14T13:29:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.187+0000 7f5db27fc700 1 -- 172.21.15.17:0/3013517968 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4010de0 con 0x5593276642d0 2023-07-14T13:29:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.188+0000 7f5dd5613b80 1 -- 172.21.15.17:0/3013517968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 msgr2=0x55932766a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.188+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/3013517968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x55932766a1d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5db40c9cf0 tx=0x7f5db4099230 comp rx=0 tx=0).stop 2023-07-14T13:29:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.189+0000 7f5dd5613b80 1 -- 172.21.15.17:0/3013517968 shutdown_connections 2023-07-14T13:29:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.189+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/3013517968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593276642d0 0x55932766a1d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.189+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/3013517968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593274ba6b0 0x5593276631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.189+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/3013517968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55932765e580 0x559327658c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.189+0000 7f5dd5613b80 1 -- 172.21.15.17:0/3013517968 >> 172.21.15.17:0/3013517968 conn(0x559327653be0 msgr2=0x559327662a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.189+0000 7f5dd5613b80 1 -- 172.21.15.17:0/3013517968 shutdown_connections 2023-07-14T13:29:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.189+0000 7f5dd5613b80 1 -- 172.21.15.17:0/3013517968 wait complete. 2023-07-14T13:29:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.189+0000 7f5dd5613b80 1 -- start start 2023-07-14T13:29:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.190+0000 7f5dd5613b80 1 Processor -- start 2023-07-14T13:29:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 0x55932766eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55932765e580 0x55932766cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dd5613b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593276642d0 0x55932766d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55932766d850 con 0x5593274ba6b0 2023-07-14T13:29:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55932766d9c0 con 0x5593276642d0 2023-07-14T13:29:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dd5613b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55932766db80 con 0x55932765e580 2023-07-14T13:29:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dd5613b80 10 client.0 _ll_register_callbacks cb 0x7f5dac010b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 0x55932766eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dbbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593276642d0 0x55932766d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dbaffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55932765e580 0x55932766cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dbaffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55932765e580 0x55932766cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:45550/0 (socket says 172.21.15.17:45550) 2023-07-14T13:29:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dbaffd700 1 -- 172.21.15.17:0/2279503804 learned_addr learned my addr 172.21.15.17:0/2279503804 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.191+0000 7f5dbb7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 0x55932766eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41250/0 (socket says 172.21.15.17:41250) 2023-07-14T13:29:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.192+0000 7f5dbbfff700 1 -- 172.21.15.17:0/2279503804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55932765e580 msgr2=0x55932766cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.192+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/2279503804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55932765e580 0x55932766cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.192+0000 7f5dbbfff700 1 -- 172.21.15.17:0/2279503804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 msgr2=0x55932766eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.192+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/2279503804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 0x55932766eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.192+0000 7f5dbbfff700 1 -- 172.21.15.17:0/2279503804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593273c6c00 con 0x5593276642d0 2023-07-14T13:29:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.192+0000 7f5dbbfff700 1 --2- 172.21.15.17:0/2279503804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593276642d0 0x55932766d310 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5db40979c0 tx=0x7f5db40997e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b04e46ee04ef0cd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.192+0000 7f5d9affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:29:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.193+0000 7f5d9affd700 1 -- 172.21.15.17:0/2279503804 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db40c3ea0 con 0x5593276642d0 2023-07-14T13:29:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.193+0000 7f5d9affd700 1 -- 172.21.15.17:0/2279503804 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5db409d6a0 con 0x5593276642d0 2023-07-14T13:29:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.193+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2279503804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5da401f470 con 0x5593276642d0 2023-07-14T13:29:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.193+0000 7f5d9affd700 1 -- 172.21.15.17:0/2279503804 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5db4011a30 con 0x5593276642d0 2023-07-14T13:29:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.193+0000 7f5dd5613b80 10 client.29465 fetch_fsmap learned FSMap version 68 2023-07-14T13:29:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.193+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2279503804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x7f5db4082e70 con 0x5593276642d0 2023-07-14T13:29:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.194+0000 7f5d9affd700 1 -- 172.21.15.17:0/2279503804 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5da401f470 con 0x5593276642d0 2023-07-14T13:29:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.194+0000 7f5d9affd700 1 -- 172.21.15.17:0/2279503804 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5db40998d0 con 0x5593276642d0 2023-07-14T13:29:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.194+0000 7f5dd5613b80 10 client.29465 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:29:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.194+0000 7f5dd5613b80 10 client.29465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:29:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.194+0000 7f5dd5613b80 20 client.29465 populate_metadata read hostname 'smithi017' 2023-07-14T13:29:44.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.194+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/2279503804 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593276ccda0 0x5593276cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:44.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.194+0000 7f5dd5613b80 4 client.29465 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:29:44.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.194+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2279503804 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55932756aff0 con 0x5593276ccda0 2023-07-14T13:29:44.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.195+0000 7f5dbb7fe700 1 --2- 172.21.15.17:0/2279503804 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593276ccda0 0x5593276cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:44.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.195+0000 7f5dbb7fe700 1 --2- 172.21.15.17:0/2279503804 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593276ccda0 0x5593276cf1b0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b681b6e12228bbe server_cookie=617a5975c926a8c in_seq=0 out_seq=0 2023-07-14T13:29:44.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.195+0000 7f5d9affd700 10 client.29465 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.218+0000 7f5d9affd700 1 -- 172.21.15.17:0/2279503804 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55932756aff0 con 0x5593276ccda0 2023-07-14T13:29:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.218+0000 7f5d9affd700 10 client.29465 handle_command_reply: tid=0 2023-07-14T13:29:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.218+0000 7f5dd5613b80 1 client.29465 shutdown 2023-07-14T13:29:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.219+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2279503804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593276642d0 msgr2=0x55932766d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.219+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/2279503804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593276642d0 0x55932766d310 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5db40979c0 tx=0x7f5db40997e0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.220+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2279503804 shutdown_connections 2023-07-14T13:29:44.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.220+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/2279503804 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5593276ccda0 0x5593276cf1b0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.220+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/2279503804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593276642d0 0x55932766d310 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.220+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/2279503804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5593274ba6b0 0x55932766eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.222 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.220+0000 7f5dd5613b80 1 --2- 172.21.15.17:0/2279503804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55932765e580 0x55932766cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.220+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2279503804 >> 172.21.15.17:0/2279503804 conn(0x559327653be0 msgr2=0x559327663320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.220+0000 7f5d9affd700 0 client.29465 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.220+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2279503804 shutdown_connections 2023-07-14T13:29:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.220+0000 7f5dd5613b80 1 -- 172.21.15.17:0/2279503804 wait complete. 2023-07-14T13:29:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.221+0000 7f5dd5613b80 20 client.29465 trim_cache size 0 max 16384 2023-07-14T13:29:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:29:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:29:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:29:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:29:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.221+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3405251038 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5da80a1400 msgr2=0x7f5da80a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.221+0000 7f5dc1bff700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5da80a1400 0x7f5da80a38b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55932765ab40 tx=0x7f5dac00a400 comp rx=0 tx=0).stop 2023-07-14T13:29:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.221+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3405251038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dbc106ff0 msgr2=0x7f5dbc10bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.221+0000 7f5dc1bff700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dbc106ff0 0x7f5dbc10bb30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5db400b3c0 tx=0x7f5db400b6d0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.222+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3405251038 shutdown_connections 2023-07-14T13:29:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.222+0000 7f5dc1bff700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f5da80a1400 0x7f5da80a38b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.222+0000 7f5dc1bff700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dbc106ff0 0x7f5dbc10bb30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.222+0000 7f5dc1bff700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5dbc101fb0 0x7f5dbc10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.222+0000 7f5dc1bff700 1 --2- 172.21.15.17:0/3405251038 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dbc102950 0x7f5dbc10b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.222+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3405251038 >> 172.21.15.17:0/3405251038 conn(0x7f5dbc0fd800 msgr2=0x7f5dbc0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.222+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3405251038 shutdown_connections 2023-07-14T13:29:44.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:44.222+0000 7f5dc1bff700 1 -- 172.21.15.17:0/3405251038 wait complete. 2023-07-14T13:29:45.920 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:45 smithi135 ceph-mon[97338]: pgmap v951: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-14T13:29:45.968 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:45 smithi131 ceph-mon[96953]: pgmap v951: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-14T13:29:46.083 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:45 smithi017 ceph-mon[95536]: pgmap v951: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-14T13:29:47.420 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 695.0 s, 507.4 tps, lat 234.686 ms stddev 385.316 2023-07-14T13:29:47.919 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:47 smithi135 ceph-mon[97338]: pgmap v952: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 18 MiB/s wr, 1.91k op/s 2023-07-14T13:29:47.968 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:47 smithi131 ceph-mon[96953]: pgmap v952: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 18 MiB/s wr, 1.91k op/s 2023-07-14T13:29:48.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:47 smithi017 ceph-mon[95536]: pgmap v952: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 18 MiB/s wr, 1.91k op/s 2023-07-14T13:29:49.919 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:49 smithi135 ceph-mon[97338]: pgmap v953: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 12 MiB/s wr, 1.27k op/s 2023-07-14T13:29:49.971 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:49 smithi131 ceph-mon[96953]: pgmap v953: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 12 MiB/s wr, 1.27k op/s 2023-07-14T13:29:50.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:49 smithi017 ceph-mon[95536]: pgmap v953: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 12 MiB/s wr, 1.27k op/s 2023-07-14T13:29:51.919 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:51 smithi135 ceph-mon[97338]: pgmap v954: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 18 MiB/s wr, 1.88k op/s 2023-07-14T13:29:51.968 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:51 smithi131 ceph-mon[96953]: pgmap v954: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 18 MiB/s wr, 1.88k op/s 2023-07-14T13:29:52.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:51 smithi017 ceph-mon[95536]: pgmap v954: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 18 MiB/s wr, 1.88k op/s 2023-07-14T13:29:52.422 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 700.0 s, 536.7 tps, lat 186.656 ms stddev 51.963 2023-07-14T13:29:53.919 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:53 smithi135 ceph-mon[97338]: pgmap v955: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 17 MiB/s wr, 1.80k op/s 2023-07-14T13:29:53.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:53 smithi131 ceph-mon[96953]: pgmap v955: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 17 MiB/s wr, 1.80k op/s 2023-07-14T13:29:54.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:53 smithi017 ceph-mon[95536]: pgmap v955: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 17 MiB/s wr, 1.80k op/s 2023-07-14T13:29:55.919 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:55 smithi135 ceph-mon[97338]: pgmap v956: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:29:55.968 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:55 smithi131 ceph-mon[96953]: pgmap v956: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:29:56.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:55 smithi017 ceph-mon[95536]: pgmap v956: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:29:57.420 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 705.0 s, 550.7 tps, lat 181.730 ms stddev 78.175 2023-07-14T13:29:57.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.494+0000 7f43109ff700 1 -- 172.21.15.17:0/1070131615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f430c106340 msgr2=0x7f430c1067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.494+0000 7f43109ff700 1 --2- 172.21.15.17:0/1070131615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f430c106340 0x7f430c1067b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f43000098f0 tx=0x7f4300009c00 comp rx=0 tx=0).stop 2023-07-14T13:29:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.495+0000 7f43109ff700 1 -- 172.21.15.17:0/1070131615 shutdown_connections 2023-07-14T13:29:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.495+0000 7f43109ff700 1 --2- 172.21.15.17:0/1070131615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f430c106cf0 0x7f430c112f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.495+0000 7f43109ff700 1 --2- 172.21.15.17:0/1070131615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f430c10c240 0x7f430c10c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.495+0000 7f43109ff700 1 --2- 172.21.15.17:0/1070131615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f430c106340 0x7f430c1067b0 secure :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f43000098f0 tx=0x7f4300009c00 comp rx=0 tx=0).stop 2023-07-14T13:29:57.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.495+0000 7f43109ff700 1 -- 172.21.15.17:0/1070131615 >> 172.21.15.17:0/1070131615 conn(0x7f430c075a20 msgr2=0x7f430c077e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:57.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.495+0000 7f43109ff700 1 -- 172.21.15.17:0/1070131615 shutdown_connections 2023-07-14T13:29:57.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.495+0000 7f43109ff700 1 -- 172.21.15.17:0/1070131615 wait complete. 2023-07-14T13:29:57.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.496+0000 7f43109ff700 1 Processor -- start 2023-07-14T13:29:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.497+0000 7f43109ff700 1 -- start start 2023-07-14T13:29:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.497+0000 7f43109ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f430c106cf0 0x7f430c19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.497+0000 7f43109ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f430c10c240 0x7f430c19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.497+0000 7f43109ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f430c1a0f70 0x7f430c1a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.497+0000 7f43109ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c1a19e0 con 0x7f430c10c240 2023-07-14T13:29:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.497+0000 7f43109ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c1a1b50 con 0x7f430c106cf0 2023-07-14T13:29:57.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.497+0000 7f43109ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c1a1d10 con 0x7f430c1a0f70 2023-07-14T13:29:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.498+0000 7f430a59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f430c106cf0 0x7f430c19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.498+0000 7f430a59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f430c106cf0 0x7f430c19c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58238/0 (socket says 172.21.15.17:58238) 2023-07-14T13:29:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.498+0000 7f430a59c700 1 -- 172.21.15.17:0/2597455186 learned_addr learned my addr 172.21.15.17:0/2597455186 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.498+0000 7f430ad9d700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f430c1a0f70 0x7f430c1a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.498+0000 7f430a59c700 1 -- 172.21.15.17:0/2597455186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f430c1a0f70 msgr2=0x7f430c1a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.498+0000 7f430a59c700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f430c1a0f70 0x7f430c1a13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.498+0000 7f430a59c700 1 -- 172.21.15.17:0/2597455186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f430c10c240 msgr2=0x7f430c19c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.498+0000 7f430a59c700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f430c10c240 0x7f430c19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.498+0000 7f430a59c700 1 -- 172.21.15.17:0/2597455186 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300009520 con 0x7f430c106cf0 2023-07-14T13:29:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.499+0000 7f430a59c700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f430c106cf0 0x7f430c19c3c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f43040060b0 tx=0x7f4304007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.499+0000 7f42fb7fe700 1 -- 172.21.15.17:0/2597455186 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400de20 con 0x7f430c106cf0 2023-07-14T13:29:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.499+0000 7f43109ff700 1 -- 172.21.15.17:0/2597455186 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c1a9280 con 0x7f430c106cf0 2023-07-14T13:29:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.499+0000 7f42fb7fe700 1 -- 172.21.15.17:0/2597455186 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f430400f040 con 0x7f430c106cf0 2023-07-14T13:29:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.499+0000 7f42fb7fe700 1 -- 172.21.15.17:0/2597455186 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304014690 con 0x7f430c106cf0 2023-07-14T13:29:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.499+0000 7f43109ff700 1 -- 172.21.15.17:0/2597455186 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c1a9790 con 0x7f430c106cf0 2023-07-14T13:29:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.505+0000 7f42fb7fe700 1 -- 172.21.15.17:0/2597455186 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f43040147f0 con 0x7f430c106cf0 2023-07-14T13:29:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.506+0000 7f432427fb80 1 Processor -- start 2023-07-14T13:29:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.507+0000 7f432427fb80 1 -- start start 2023-07-14T13:29:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.507+0000 7f432427fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df10db6b0 0x557df1284d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.507+0000 7f432427fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df12852d0 0x557df127f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.507+0000 7f432427fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df127f580 0x557df127f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.507+0000 7f432427fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df1184c50 con 0x557df127f580 2023-07-14T13:29:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.507+0000 7f432427fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df11d79e0 con 0x557df12852d0 2023-07-14T13:29:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.507+0000 7f432427fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df11d0e70 con 0x557df10db6b0 2023-07-14T13:29:57.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.508+0000 7f430a59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df12852d0 0x557df127f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.508+0000 7f430a59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df12852d0 0x557df127f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:58242/0 (socket says 172.21.15.17:58242) 2023-07-14T13:29:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.508+0000 7f430a59c700 1 -- 172.21.15.17:0/78436409 learned_addr learned my addr 172.21.15.17:0/78436409 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.508+0000 7f430ad9d700 1 --2- 172.21.15.17:0/78436409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df10db6b0 0x557df1284d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.509+0000 7f42fb7fe700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42f40a1400 0x7f42f40a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.509+0000 7f42fb7fe700 1 -- 172.21.15.17:0/2597455186 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f43040cc680 con 0x7f430c106cf0 2023-07-14T13:29:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.509+0000 7f430a59c700 1 -- 172.21.15.17:0/78436409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df10db6b0 msgr2=0x557df1284d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.509+0000 7f430a59c700 1 --2- 172.21.15.17:0/78436409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df10db6b0 0x557df1284d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.509+0000 7f430a59c700 1 -- 172.21.15.17:0/78436409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df127f580 msgr2=0x557df127f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:57.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.509+0000 7f430a59c700 1 --2- 172.21.15.17:0/78436409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df127f580 0x557df127f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.509+0000 7f430a59c700 1 -- 172.21.15.17:0/78436409 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557df0ffed80 con 0x557df12852d0 2023-07-14T13:29:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.510+0000 7f430ad9d700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42f40a1400 0x7f42f40a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.511+0000 7f430ad9d700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42f40a1400 0x7f42f40a38b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f430c10ce20 tx=0x7f42fc0047c0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.512+0000 7f430a59c700 1 --2- 172.21.15.17:0/78436409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df12852d0 0x557df127f040 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f43040c9cd0 tx=0x7f430400df80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5cf40d07c172ba2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.512+0000 7f42f8ff9700 1 -- 172.21.15.17:0/78436409 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43040994e0 con 0x557df12852d0 2023-07-14T13:29:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.512+0000 7f42f8ff9700 1 -- 172.21.15.17:0/78436409 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4304099250 con 0x557df12852d0 2023-07-14T13:29:57.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.512+0000 7f42f8ff9700 1 -- 172.21.15.17:0/78436409 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304095e20 con 0x557df12852d0 2023-07-14T13:29:57.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.513+0000 7f432427fb80 1 -- 172.21.15.17:0/78436409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df12852d0 msgr2=0x557df127f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:57.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.513+0000 7f432427fb80 1 --2- 172.21.15.17:0/78436409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df12852d0 0x557df127f040 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f43040c9cd0 tx=0x7f430400df80 comp rx=0 tx=0).stop 2023-07-14T13:29:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.514+0000 7f432427fb80 1 -- 172.21.15.17:0/78436409 shutdown_connections 2023-07-14T13:29:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.514+0000 7f432427fb80 1 --2- 172.21.15.17:0/78436409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df127f580 0x557df127f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.514+0000 7f432427fb80 1 --2- 172.21.15.17:0/78436409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df10db6b0 0x557df1284d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.514+0000 7f432427fb80 1 --2- 172.21.15.17:0/78436409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df12852d0 0x557df127f040 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.514+0000 7f432427fb80 1 -- 172.21.15.17:0/78436409 >> 172.21.15.17:0/78436409 conn(0x557df1274be0 msgr2=0x557df1279f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:57.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.514+0000 7f432427fb80 1 -- 172.21.15.17:0/78436409 shutdown_connections 2023-07-14T13:29:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.514+0000 7f432427fb80 1 -- 172.21.15.17:0/78436409 wait complete. 2023-07-14T13:29:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.515+0000 7f432427fb80 1 -- start start 2023-07-14T13:29:57.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.516+0000 7f432427fb80 1 Processor -- start 2023-07-14T13:29:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.516+0000 7f432427fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df10db6b0 0x557df1288910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.516+0000 7f432427fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df127f580 0x557df1288e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.516+0000 7f432427fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df12852d0 0x557df1289390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.516+0000 7f432427fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df1170a60 con 0x557df127f580 2023-07-14T13:29:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.516+0000 7f432427fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df1170760 con 0x557df10db6b0 2023-07-14T13:29:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.516+0000 7f432427fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df10548c0 con 0x557df12852d0 2023-07-14T13:29:57.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.516+0000 7f432427fb80 10 client.0 _ll_register_callbacks cb 0x557df116e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:57.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.517+0000 7f4309d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df127f580 0x557df1288e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.517+0000 7f4309d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df127f580 0x557df1288e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57966/0 (socket says 172.21.15.17:57966) 2023-07-14T13:29:57.520 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.517+0000 7f4309d9b700 1 -- 172.21.15.17:0/1252102711 learned_addr learned my addr 172.21.15.17:0/1252102711 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:57.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.517+0000 7f430a59c700 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df10db6b0 0x557df1288910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.518+0000 7f430ad9d700 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df12852d0 0x557df1289390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.518+0000 7f4309d9b700 1 -- 172.21.15.17:0/1252102711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df12852d0 msgr2=0x557df1289390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:57.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.519+0000 7f4309d9b700 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df12852d0 0x557df1289390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.519+0000 7f4309d9b700 1 -- 172.21.15.17:0/1252102711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df10db6b0 msgr2=0x557df1288910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:57.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.519+0000 7f4309d9b700 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df10db6b0 0x557df1288910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.521 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.519+0000 7f4309d9b700 1 -- 172.21.15.17:0/1252102711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c1a9790 con 0x557df127f580 2023-07-14T13:29:57.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.519+0000 7f430ad9d700 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df12852d0 0x557df1289390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:29:57.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.519+0000 7f430a59c700 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df10db6b0 0x557df1288910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:29:57.522 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.519+0000 7f4309d9b700 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df127f580 0x557df1288e50 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4300009810 tx=0x7f430000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6a2deb823188d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.520+0000 7f42f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:29:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.520+0000 7f42f1ffb700 1 -- 172.21.15.17:0/1252102711 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430001c070 con 0x557df127f580 2023-07-14T13:29:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.520+0000 7f42f1ffb700 1 -- 172.21.15.17:0/1252102711 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f430000b770 con 0x557df127f580 2023-07-14T13:29:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.520+0000 7f432427fb80 1 -- 172.21.15.17:0/1252102711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557df112a490 con 0x557df127f580 2023-07-14T13:29:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.521+0000 7f42f1ffb700 1 -- 172.21.15.17:0/1252102711 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f430000f8e0 con 0x557df127f580 2023-07-14T13:29:57.523 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.521+0000 7f432427fb80 10 client.19680 fetch_fsmap learned FSMap version 68 2023-07-14T13:29:57.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.521+0000 7f432427fb80 1 -- 172.21.15.17:0/1252102711 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x557df0fe7c00 con 0x557df127f580 2023-07-14T13:29:57.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.521+0000 7f42f1ffb700 1 -- 172.21.15.17:0/1252102711 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557df112a490 con 0x557df127f580 2023-07-14T13:29:57.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.522+0000 7f42f1ffb700 1 -- 172.21.15.17:0/1252102711 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4300015020 con 0x557df127f580 2023-07-14T13:29:57.524 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.522+0000 7f432427fb80 10 client.19680 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:29:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.522+0000 7f432427fb80 10 client.19680 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:29:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.522+0000 7f432427fb80 20 client.19680 populate_metadata read hostname 'smithi017' 2023-07-14T13:29:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.522+0000 7f432427fb80 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557df1298c30 0x557df129b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.522+0000 7f432427fb80 4 client.19680 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:29:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.522+0000 7f432427fb80 1 -- 172.21.15.17:0/1252102711 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557df11c9e50 con 0x557df1298c30 2023-07-14T13:29:57.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.522+0000 7f430a59c700 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557df1298c30 0x557df129b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.523+0000 7f430a59c700 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557df1298c30 0x557df129b040 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5fd43e674f8001e server_cookie=329fd12f6a3e7d75 in_seq=0 out_seq=0 2023-07-14T13:29:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.523+0000 7f42f1ffb700 10 client.19680 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:57.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.525+0000 7f42f1ffb700 1 -- 172.21.15.17:0/1252102711 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557df11c9e50 con 0x557df1298c30 2023-07-14T13:29:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.525+0000 7f42f1ffb700 10 client.19680 handle_command_reply: tid=0 2023-07-14T13:29:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.525+0000 7f432427fb80 1 client.19680 shutdown 2023-07-14T13:29:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.526+0000 7f432427fb80 1 -- 172.21.15.17:0/1252102711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df127f580 msgr2=0x557df1288e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:57.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.526+0000 7f432427fb80 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df127f580 0x557df1288e50 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4300009810 tx=0x7f430000f740 comp rx=0 tx=0).stop 2023-07-14T13:29:57.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.532+0000 7f432427fb80 1 -- 172.21.15.17:0/1252102711 shutdown_connections 2023-07-14T13:29:57.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.532+0000 7f432427fb80 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557df1298c30 0x557df129b040 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.532+0000 7f432427fb80 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df12852d0 0x557df1289390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.532+0000 7f432427fb80 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df10db6b0 0x557df1288910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.532+0000 7f432427fb80 1 --2- 172.21.15.17:0/1252102711 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df127f580 0x557df1288e50 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.532+0000 7f432427fb80 1 -- 172.21.15.17:0/1252102711 >> 172.21.15.17:0/1252102711 conn(0x557df1274be0 msgr2=0x557df12794e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:57.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.533+0000 7f42f1ffb700 0 client.19680 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.536+0000 7f432427fb80 1 -- 172.21.15.17:0/1252102711 shutdown_connections 2023-07-14T13:29:57.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.536+0000 7f432427fb80 1 -- 172.21.15.17:0/1252102711 wait complete. 2023-07-14T13:29:57.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.537+0000 7f432427fb80 20 client.19680 trim_cache size 0 max 16384 2023-07-14T13:29:57.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.570+0000 7f432427fb80 1 Processor -- start 2023-07-14T13:29:57.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.570+0000 7f432427fb80 1 -- start start 2023-07-14T13:29:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.570+0000 7f432427fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df10db6b0 0x557df127f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.570+0000 7f432427fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df127f580 0x557df128fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.570+0000 7f432427fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df12852d0 0x557df12841c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.570+0000 7f432427fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df1276630 con 0x557df12852d0 2023-07-14T13:29:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.570+0000 7f432427fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df12836a0 con 0x557df10db6b0 2023-07-14T13:29:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.570+0000 7f432427fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df129b360 con 0x557df127f580 2023-07-14T13:29:57.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.571+0000 7f430ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df12852d0 0x557df12841c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.571+0000 7f430ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df12852d0 0x557df12841c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57980/0 (socket says 172.21.15.17:57980) 2023-07-14T13:29:57.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.571+0000 7f430ad9d700 1 -- 172.21.15.17:0/871928625 learned_addr learned my addr 172.21.15.17:0/871928625 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:57.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.572+0000 7f430ad9d700 1 -- 172.21.15.17:0/871928625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df127f580 msgr2=0x557df128fc70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:29:57.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.572+0000 7f430ad9d700 1 --2- 172.21.15.17:0/871928625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df127f580 0x557df128fc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.572+0000 7f430ad9d700 1 -- 172.21.15.17:0/871928625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df10db6b0 msgr2=0x557df127f040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:29:57.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.572+0000 7f430ad9d700 1 --2- 172.21.15.17:0/871928625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df10db6b0 0x557df127f040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.572+0000 7f430ad9d700 1 -- 172.21.15.17:0/871928625 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557df10251f0 con 0x557df12852d0 2023-07-14T13:29:57.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.572+0000 7f430ad9d700 1 --2- 172.21.15.17:0/871928625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df12852d0 0x557df12841c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f42fc014f90 tx=0x7f42fc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bd66676226f3a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:57.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.573+0000 7f42f97fa700 1 -- 172.21.15.17:0/871928625 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc011d80 con 0x557df12852d0 2023-07-14T13:29:57.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.573+0000 7f42f97fa700 1 -- 172.21.15.17:0/871928625 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f42fc0438a0 con 0x557df12852d0 2023-07-14T13:29:57.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.573+0000 7f42f97fa700 1 -- 172.21.15.17:0/871928625 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc0406f0 con 0x557df12852d0 2023-07-14T13:29:57.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.575+0000 7f432427fb80 1 -- 172.21.15.17:0/871928625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df12852d0 msgr2=0x557df12841c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:57.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.575+0000 7f432427fb80 1 --2- 172.21.15.17:0/871928625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df12852d0 0x557df12841c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f42fc014f90 tx=0x7f42fc005b00 comp rx=0 tx=0).stop 2023-07-14T13:29:57.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.575+0000 7f432427fb80 1 -- 172.21.15.17:0/871928625 shutdown_connections 2023-07-14T13:29:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.575+0000 7f432427fb80 1 --2- 172.21.15.17:0/871928625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df12852d0 0x557df12841c0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.575+0000 7f432427fb80 1 --2- 172.21.15.17:0/871928625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df10db6b0 0x557df127f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.575+0000 7f432427fb80 1 --2- 172.21.15.17:0/871928625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df127f580 0x557df128fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.575+0000 7f432427fb80 1 -- 172.21.15.17:0/871928625 >> 172.21.15.17:0/871928625 conn(0x557df1274be0 msgr2=0x557df1283ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.576+0000 7f432427fb80 1 -- 172.21.15.17:0/871928625 shutdown_connections 2023-07-14T13:29:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.576+0000 7f432427fb80 1 -- 172.21.15.17:0/871928625 wait complete. 2023-07-14T13:29:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.576+0000 7f432427fb80 1 -- start start 2023-07-14T13:29:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.577+0000 7f432427fb80 1 Processor -- start 2023-07-14T13:29:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.577+0000 7f432427fb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df10db6b0 0x557df12e63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.578+0000 7f432427fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df127f580 0x557df12e6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.578+0000 7f432427fb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df12852d0 0x557df12e0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.578+0000 7f432427fb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df12e1050 con 0x557df10db6b0 2023-07-14T13:29:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.578+0000 7f432427fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df12e11c0 con 0x557df127f580 2023-07-14T13:29:57.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.578+0000 7f432427fb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x557df12e1380 con 0x557df12852d0 2023-07-14T13:29:57.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.578+0000 7f432427fb80 10 client.0 _ll_register_callbacks cb 0x7f42fc0091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:29:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.578+0000 7f430a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df10db6b0 0x557df12e63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.578+0000 7f430a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df10db6b0 0x557df12e63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57986/0 (socket says 172.21.15.17:57986) 2023-07-14T13:29:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.578+0000 7f430a59c700 1 -- 172.21.15.17:0/2341971303 learned_addr learned my addr 172.21.15.17:0/2341971303 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:29:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.578+0000 7f4309d9b700 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df127f580 0x557df12e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.578+0000 7f430ad9d700 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df12852d0 0x557df12e0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.579+0000 7f430a59c700 1 -- 172.21.15.17:0/2341971303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df12852d0 msgr2=0x557df12e0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.579+0000 7f430a59c700 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df12852d0 0x557df12e0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.579+0000 7f430a59c700 1 -- 172.21.15.17:0/2341971303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df127f580 msgr2=0x557df12e6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:29:57.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.579+0000 7f430a59c700 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df127f580 0x557df12e6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.579+0000 7f430a59c700 1 -- 172.21.15.17:0/2341971303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42fc014cd0 con 0x557df10db6b0 2023-07-14T13:29:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.579+0000 7f430a59c700 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df10db6b0 0x557df12e63e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4304009fd0 tx=0x7f4304095b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89b3c952ce382cd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:29:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.579+0000 7f42f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:29:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.580+0000 7f42f1ffb700 1 -- 172.21.15.17:0/2341971303 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43040994e0 con 0x557df10db6b0 2023-07-14T13:29:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.580+0000 7f42f1ffb700 1 -- 172.21.15.17:0/2341971303 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4304099710 con 0x557df10db6b0 2023-07-14T13:29:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.580+0000 7f432427fb80 1 -- 172.21.15.17:0/2341971303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4304099250 con 0x557df10db6b0 2023-07-14T13:29:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.580+0000 7f42f1ffb700 1 -- 172.21.15.17:0/2341971303 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43040a1b60 con 0x557df10db6b0 2023-07-14T13:29:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.580+0000 7f432427fb80 10 client.19686 fetch_fsmap learned FSMap version 68 2023-07-14T13:29:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.580+0000 7f432427fb80 1 -- 172.21.15.17:0/2341971303 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x557df0ffd250 con 0x557df10db6b0 2023-07-14T13:29:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.581+0000 7f42f1ffb700 1 -- 172.21.15.17:0/2341971303 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4304099250 con 0x557df10db6b0 2023-07-14T13:29:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.581+0000 7f42f1ffb700 1 -- 172.21.15.17:0/2341971303 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4304099970 con 0x557df10db6b0 2023-07-14T13:29:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.581+0000 7f432427fb80 10 client.19686 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:29:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.581+0000 7f432427fb80 10 client.19686 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:29:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.581+0000 7f432427fb80 20 client.19686 populate_metadata read hostname 'smithi017' 2023-07-14T13:29:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.581+0000 7f432427fb80 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557df12edf00 0x557df12f0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:29:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.581+0000 7f432427fb80 4 client.19686 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:29:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.581+0000 7f432427fb80 1 -- 172.21.15.17:0/2341971303 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557df118bff0 con 0x557df12edf00 2023-07-14T13:29:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.581+0000 7f4309d9b700 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557df12edf00 0x557df12f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:29:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.582+0000 7f4309d9b700 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557df12edf00 0x557df12f0310 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=549cae55228140f5 server_cookie=29f0e9d9674e93b1 in_seq=0 out_seq=0 2023-07-14T13:29:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.582+0000 7f42f1ffb700 10 client.19686 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:57.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.608+0000 7f42f1ffb700 1 -- 172.21.15.17:0/2341971303 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557df118bff0 con 0x557df12edf00 2023-07-14T13:29:57.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.608+0000 7f42f1ffb700 10 client.19686 handle_command_reply: tid=0 2023-07-14T13:29:57.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.610+0000 7f432427fb80 1 client.19686 shutdown 2023-07-14T13:29:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.620+0000 7f432427fb80 1 -- 172.21.15.17:0/2341971303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df10db6b0 msgr2=0x557df12e63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.620+0000 7f432427fb80 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df10db6b0 0x557df12e63e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4304009fd0 tx=0x7f4304095b50 comp rx=0 tx=0).stop 2023-07-14T13:29:57.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.621+0000 7f432427fb80 1 -- 172.21.15.17:0/2341971303 shutdown_connections 2023-07-14T13:29:57.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.621+0000 7f432427fb80 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x557df12edf00 0x557df12f0310 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.621+0000 7f432427fb80 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557df12852d0 0x557df12e0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.621+0000 7f432427fb80 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x557df10db6b0 0x557df12e63e0 secure :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4304009fd0 tx=0x7f4304095b50 comp rx=0 tx=0).stop 2023-07-14T13:29:57.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.621+0000 7f432427fb80 1 --2- 172.21.15.17:0/2341971303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557df127f580 0x557df12e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.621+0000 7f432427fb80 1 -- 172.21.15.17:0/2341971303 >> 172.21.15.17:0/2341971303 conn(0x557df1274be0 msgr2=0x557df1284340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:57.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.621+0000 7f42f1ffb700 0 client.19686 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:29:57.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.623+0000 7f432427fb80 1 -- 172.21.15.17:0/2341971303 shutdown_connections 2023-07-14T13:29:57.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.624+0000 7f432427fb80 1 -- 172.21.15.17:0/2341971303 wait complete. 2023-07-14T13:29:57.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:29:57.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:29:57.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:29:57.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:29:57.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.627+0000 7f432427fb80 20 client.19686 trim_cache size 0 max 16384 2023-07-14T13:29:57.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.628+0000 7f43109ff700 1 -- 172.21.15.17:0/2597455186 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42f40a1400 msgr2=0x7f42f40a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:57.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.628+0000 7f43109ff700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42f40a1400 0x7f42f40a38b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f430c10ce20 tx=0x7f42fc0047c0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.628+0000 7f43109ff700 1 -- 172.21.15.17:0/2597455186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f430c106cf0 msgr2=0x7f430c19c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:29:57.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.628+0000 7f43109ff700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f430c106cf0 0x7f430c19c3c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f43040060b0 tx=0x7f4304007f90 comp rx=0 tx=0).stop 2023-07-14T13:29:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.629+0000 7f43109ff700 1 -- 172.21.15.17:0/2597455186 shutdown_connections 2023-07-14T13:29:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.629+0000 7f43109ff700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f42f40a1400 0x7f42f40a38b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.629+0000 7f43109ff700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f430c1a0f70 0x7f430c1a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.629+0000 7f43109ff700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f430c106cf0 0x7f430c19c3c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.629+0000 7f43109ff700 1 --2- 172.21.15.17:0/2597455186 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f430c10c240 0x7f430c19c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:29:57.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.629+0000 7f43109ff700 1 -- 172.21.15.17:0/2597455186 >> 172.21.15.17:0/2597455186 conn(0x7f430c075a20 msgr2=0x7f430c0772a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:29:57.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.629+0000 7f43109ff700 1 -- 172.21.15.17:0/2597455186 shutdown_connections 2023-07-14T13:29:57.633 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:29:57.629+0000 7f43109ff700 1 -- 172.21.15.17:0/2597455186 wait complete. 2023-07-14T13:29:57.969 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:57 smithi131 ceph-mon[96953]: pgmap v957: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 18 MiB/s wr, 1.83k op/s 2023-07-14T13:29:58.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:57 smithi017 ceph-mon[95536]: pgmap v957: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 18 MiB/s wr, 1.83k op/s 2023-07-14T13:29:58.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:57 smithi135 ceph-mon[97338]: pgmap v957: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 18 MiB/s wr, 1.83k op/s 2023-07-14T13:29:59.968 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:29:59 smithi131 ceph-mon[96953]: pgmap v958: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.31k op/s 2023-07-14T13:30:00.005 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:29:59 smithi017 ceph-mon[95536]: pgmap v958: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.31k op/s 2023-07-14T13:30:00.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:29:59 smithi135 ceph-mon[97338]: pgmap v958: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.31k op/s 2023-07-14T13:30:00.339 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-a[95512]: 2023-07-14T13:29:59.999+0000 7ff2c0aee700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-14T13:30:01.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:00 smithi017 ceph-mon[95536]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-14T13:30:01.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:00 smithi135 ceph-mon[97338]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-14T13:30:01.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:00 smithi131 ceph-mon[96953]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-14T13:30:02.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:01 smithi017 ceph-mon[95536]: pgmap v959: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 18 MiB/s wr, 1.88k op/s 2023-07-14T13:30:02.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:01 smithi135 ceph-mon[97338]: pgmap v959: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 18 MiB/s wr, 1.88k op/s 2023-07-14T13:30:02.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:01 smithi131 ceph-mon[96953]: pgmap v959: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 18 MiB/s wr, 1.88k op/s 2023-07-14T13:30:02.422 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 710.0 s, 227.5 tps, lat 310.317 ms stddev 320.791 2023-07-14T13:30:04.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:03 smithi017 ceph-mon[95536]: pgmap v960: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:30:04.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:03 smithi135 ceph-mon[97338]: pgmap v960: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:30:04.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:03 smithi131 ceph-mon[96953]: pgmap v960: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:30:06.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:05 smithi017 ceph-mon[95536]: pgmap v961: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:30:06.174 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:05 smithi135 ceph-mon[97338]: pgmap v961: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:30:06.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:05 smithi131 ceph-mon[96953]: pgmap v961: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:30:07.420 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 715.0 s, 270.3 tps, lat 468.944 ms stddev 792.074 2023-07-14T13:30:07.919 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:07 smithi135 ceph-mon[97338]: pgmap v962: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.44k op/s 2023-07-14T13:30:07.967 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:07 smithi131 ceph-mon[96953]: pgmap v962: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.44k op/s 2023-07-14T13:30:08.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:07 smithi017 ceph-mon[95536]: pgmap v962: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.44k op/s 2023-07-14T13:30:09.973 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:09 smithi131 ceph-mon[96953]: pgmap v963: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.2 MiB/s wr, 806 op/s 2023-07-14T13:30:10.054 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:09 smithi135 ceph-mon[97338]: pgmap v963: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.2 MiB/s wr, 806 op/s 2023-07-14T13:30:10.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:09 smithi017 ceph-mon[95536]: pgmap v963: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.2 MiB/s wr, 806 op/s 2023-07-14T13:30:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.958+0000 7fc34adff700 1 -- 172.21.15.17:0/47996246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc34406d3a0 msgr2=0x7fc34411b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.958+0000 7fc34adff700 1 --2- 172.21.15.17:0/47996246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc34406d3a0 0x7fc34411b470 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fc33c01c0d0 tx=0x7fc33c01c3e0 comp rx=0 tx=0).stop 2023-07-14T13:30:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.958+0000 7fc34adff700 1 -- 172.21.15.17:0/47996246 shutdown_connections 2023-07-14T13:30:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.958+0000 7fc34adff700 1 --2- 172.21.15.17:0/47996246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc34406d3a0 0x7fc34411b470 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.958+0000 7fc34adff700 1 --2- 172.21.15.17:0/47996246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc34410e2a0 0x7fc34410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.958+0000 7fc34adff700 1 --2- 172.21.15.17:0/47996246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc34406c910 0x7fc34406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.958+0000 7fc34adff700 1 -- 172.21.15.17:0/47996246 >> 172.21.15.17:0/47996246 conn(0x7fc34406bd70 msgr2=0x7fc344070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.968+0000 7fc34adff700 1 -- 172.21.15.17:0/47996246 shutdown_connections 2023-07-14T13:30:10.979 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.977+0000 7fc34adff700 1 -- 172.21.15.17:0/47996246 wait complete. 2023-07-14T13:30:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.980+0000 7fc34adff700 1 Processor -- start 2023-07-14T13:30:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.981+0000 7fc34adff700 1 -- start start 2023-07-14T13:30:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.981+0000 7fc34adff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc34406c910 0x7fc344116bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.981+0000 7fc34adff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc34406d3a0 0x7fc344117130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.981+0000 7fc34adff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc34410e2a0 0x7fc3441a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.981+0000 7fc34adff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3441a24f0 con 0x7fc34406d3a0 2023-07-14T13:30:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.981+0000 7fc34adff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3441a2660 con 0x7fc34406c910 2023-07-14T13:30:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.981+0000 7fc34adff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3441a2820 con 0x7fc34410e2a0 2023-07-14T13:30:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.984+0000 7fc348b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc34406c910 0x7fc344116bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.984+0000 7fc348b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc34406c910 0x7fc344116bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56112/0 (socket says 172.21.15.17:56112) 2023-07-14T13:30:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.984+0000 7fc348b9b700 1 -- 172.21.15.17:0/311289503 learned_addr learned my addr 172.21.15.17:0/311289503 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.985+0000 7fc348b9b700 1 -- 172.21.15.17:0/311289503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc34410e2a0 msgr2=0x7fc3441a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.985+0000 7fc348b9b700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc34410e2a0 0x7fc3441a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.985+0000 7fc348b9b700 1 -- 172.21.15.17:0/311289503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc34406d3a0 msgr2=0x7fc344117130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T13:30:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.985+0000 7fc348b9b700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc34406d3a0 0x7fc344117130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.985+0000 7fc348b9b700 1 -- 172.21.15.17:0/311289503 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c01ad10 con 0x7fc34406c910 2023-07-14T13:30:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.986+0000 7fc348b9b700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc34406c910 0x7fc344116bf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc33800b550 tx=0x7fc33800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.989+0000 7fc341ffb700 1 -- 172.21.15.17:0/311289503 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338011830 con 0x7fc34406c910 2023-07-14T13:30:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.989+0000 7fc341ffb700 1 -- 172.21.15.17:0/311289503 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc338011e20 con 0x7fc34406c910 2023-07-14T13:30:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.989+0000 7fc341ffb700 1 -- 172.21.15.17:0/311289503 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338010e30 con 0x7fc34406c910 2023-07-14T13:30:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.989+0000 7fc34adff700 1 -- 172.21.15.17:0/311289503 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3441a2b00 con 0x7fc34406c910 2023-07-14T13:30:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.989+0000 7fc34adff700 1 -- 172.21.15.17:0/311289503 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3441a91b0 con 0x7fc34406c910 2023-07-14T13:30:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:10.999+0000 7fc35e799b80 1 Processor -- start 2023-07-14T13:30:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.005+0000 7fc35e799b80 1 -- start start 2023-07-14T13:30:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.005+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4579596b0 0x55a457b02d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.005+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457b032d0 0x55a457afd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.005+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 0x55a457afd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.005+0000 7fc35e799b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a457a02c50 con 0x55a457afd580 2023-07-14T13:30:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.005+0000 7fc35e799b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a457a559e0 con 0x55a4579596b0 2023-07-14T13:30:11.007 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.005+0000 7fc35e799b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a457a4ee70 con 0x55a457b032d0 2023-07-14T13:30:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.007+0000 7fc343fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 0x55a457afd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:11.008 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.007+0000 7fc343fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 0x55a457afd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59642/0 (socket says 172.21.15.17:59642) 2023-07-14T13:30:11.009 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.007+0000 7fc343fff700 1 -- 172.21.15.17:0/380795899 learned_addr learned my addr 172.21.15.17:0/380795899 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.008+0000 7fc343fff700 1 -- 172.21.15.17:0/380795899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457b032d0 msgr2=0x55a457afd040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:30:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.008+0000 7fc343fff700 1 --2- 172.21.15.17:0/380795899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457b032d0 0x55a457afd040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.008+0000 7fc343fff700 1 -- 172.21.15.17:0/380795899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4579596b0 msgr2=0x55a457b02d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.008+0000 7fc343fff700 1 --2- 172.21.15.17:0/380795899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4579596b0 0x55a457b02d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.008+0000 7fc343fff700 1 -- 172.21.15.17:0/380795899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a45787cd80 con 0x55a457afd580 2023-07-14T13:30:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.008+0000 7fc341ffb700 1 -- 172.21.15.17:0/311289503 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fc338011990 con 0x7fc34406c910 2023-07-14T13:30:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.011+0000 7fc341ffb700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc32c0a14d0 0x7fc32c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.011+0000 7fc341ffb700 1 -- 172.21.15.17:0/311289503 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fc3380cc660 con 0x7fc34406c910 2023-07-14T13:30:11.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.016+0000 7fc34939c700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc32c0a14d0 0x7fc32c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.021+0000 7fc343fff700 1 --2- 172.21.15.17:0/380795899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 0x55a457afd9d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc33400aac0 tx=0x7fc33400add0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb577d41cc67005 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.022+0000 7fc32affd700 1 -- 172.21.15.17:0/380795899 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33400ccd0 con 0x55a457afd580 2023-07-14T13:30:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.023+0000 7fc32affd700 1 -- 172.21.15.17:0/380795899 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc33400ce30 con 0x55a457afd580 2023-07-14T13:30:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.023+0000 7fc32affd700 1 -- 172.21.15.17:0/380795899 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33400f690 con 0x55a457afd580 2023-07-14T13:30:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.024+0000 7fc35e799b80 1 -- 172.21.15.17:0/380795899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 msgr2=0x55a457afd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.024+0000 7fc35e799b80 1 --2- 172.21.15.17:0/380795899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 0x55a457afd9d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc33400aac0 tx=0x7fc33400add0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.026+0000 7fc35e799b80 1 -- 172.21.15.17:0/380795899 shutdown_connections 2023-07-14T13:30:11.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.026+0000 7fc35e799b80 1 --2- 172.21.15.17:0/380795899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 0x55a457afd9d0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.026+0000 7fc35e799b80 1 --2- 172.21.15.17:0/380795899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4579596b0 0x55a457b02d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.026+0000 7fc35e799b80 1 --2- 172.21.15.17:0/380795899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457b032d0 0x55a457afd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.026+0000 7fc35e799b80 1 -- 172.21.15.17:0/380795899 >> 172.21.15.17:0/380795899 conn(0x55a457af2be0 msgr2=0x55a457af7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:11.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.026+0000 7fc34939c700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc32c0a14d0 0x7fc32c0a3980 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc33c01c0d0 tx=0x7fc33c01c800 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:11.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.028+0000 7fc35e799b80 1 -- 172.21.15.17:0/380795899 shutdown_connections 2023-07-14T13:30:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.028+0000 7fc35e799b80 1 -- 172.21.15.17:0/380795899 wait complete. 2023-07-14T13:30:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.029+0000 7fc35e799b80 1 -- start start 2023-07-14T13:30:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.029+0000 7fc35e799b80 1 Processor -- start 2023-07-14T13:30:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.030+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4579596b0 0x55a457b069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.030+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 0x55a457b06f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.030+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a457b032d0 0x55a457b07460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.030+0000 7fc35e799b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4579eea60 con 0x55a457afd580 2023-07-14T13:30:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.030+0000 7fc35e799b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4579ee760 con 0x55a457b032d0 2023-07-14T13:30:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.030+0000 7fc35e799b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4578d28c0 con 0x55a4579596b0 2023-07-14T13:30:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.030+0000 7fc35e799b80 10 client.0 _ll_register_callbacks cb 0x55a4579ec700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:30:11.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.034+0000 7fc34939c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a457b032d0 0x55a457b07460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:11.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.034+0000 7fc34939c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a457b032d0 0x55a457b07460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56130/0 (socket says 172.21.15.17:56130) 2023-07-14T13:30:11.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.034+0000 7fc34939c700 1 -- 172.21.15.17:0/903683450 learned_addr learned my addr 172.21.15.17:0/903683450 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:11.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.035+0000 7fc343fff700 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 0x55a457b06f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.036+0000 7fc34939c700 1 -- 172.21.15.17:0/903683450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4579596b0 msgr2=0x55a457b069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:11.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.036+0000 7fc34939c700 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4579596b0 0x55a457b069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.036+0000 7fc34939c700 1 -- 172.21.15.17:0/903683450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 msgr2=0x55a457b06f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:11.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.036+0000 7fc34939c700 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 0x55a457b06f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.036+0000 7fc34939c700 1 -- 172.21.15.17:0/903683450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33400a6f0 con 0x55a457b032d0 2023-07-14T13:30:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.043+0000 7fc34939c700 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a457b032d0 0x55a457b07460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc33c004ed0 tx=0x7fc33c0184f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d9d6ffb5ff8934 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.043+0000 7fc323fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:30:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.061+0000 7fc323fff700 1 -- 172.21.15.17:0/903683450 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c01f040 con 0x55a457b032d0 2023-07-14T13:30:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.061+0000 7fc323fff700 1 -- 172.21.15.17:0/903683450 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fc33c02e880 con 0x55a457b032d0 2023-07-14T13:30:11.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.061+0000 7fc35e799b80 1 -- 172.21.15.17:0/903683450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4579a8490 con 0x55a457b032d0 2023-07-14T13:30:11.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:10 smithi017 ceph-mon[95536]: osdmap e138: 12 total, 12 up, 12 in 2023-07-14T13:30:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.085+0000 7fc323fff700 1 -- 172.21.15.17:0/903683450 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc33c02ea40 con 0x55a457b032d0 2023-07-14T13:30:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.085+0000 7fc35e799b80 10 client.29486 fetch_fsmap learned FSMap version 68 2023-07-14T13:30:11.086 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.085+0000 7fc35e799b80 1 -- 172.21.15.17:0/903683450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55a457865c00 con 0x55a457b032d0 2023-07-14T13:30:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.096+0000 7fc323fff700 1 -- 172.21.15.17:0/903683450 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a4579a8490 con 0x55a457b032d0 2023-07-14T13:30:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.096+0000 7fc323fff700 1 -- 172.21.15.17:0/903683450 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc33c0056c0 con 0x55a457b032d0 2023-07-14T13:30:11.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.096+0000 7fc35e799b80 10 client.29486 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:30:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.096+0000 7fc35e799b80 10 client.29486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:30:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.096+0000 7fc35e799b80 20 client.29486 populate_metadata read hostname 'smithi017' 2023-07-14T13:30:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.096+0000 7fc35e799b80 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a457b16d00 0x55a457b19110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.096+0000 7fc35e799b80 4 client.29486 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:30:11.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.096+0000 7fc35e799b80 1 -- 172.21.15.17:0/903683450 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a457a47e50 con 0x55a457b16d00 2023-07-14T13:30:11.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.105+0000 7fc348b9b700 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a457b16d00 0x55a457b19110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.117+0000 7fc348b9b700 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a457b16d00 0x55a457b19110 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3759cef8f50b100 server_cookie=66acb908909e8785 in_seq=0 out_seq=0 2023-07-14T13:30:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.133+0000 7fc323fff700 10 client.29486 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.140+0000 7fc323fff700 1 -- 172.21.15.17:0/903683450 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a457a47e50 con 0x55a457b16d00 2023-07-14T13:30:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.140+0000 7fc323fff700 10 client.29486 handle_command_reply: tid=0 2023-07-14T13:30:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.141+0000 7fc35e799b80 1 client.29486 shutdown 2023-07-14T13:30:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.148+0000 7fc35e799b80 1 -- 172.21.15.17:0/903683450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a457b032d0 msgr2=0x55a457b07460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.148+0000 7fc35e799b80 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a457b032d0 0x55a457b07460 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc33c004ed0 tx=0x7fc33c0184f0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.152+0000 7fc35e799b80 1 -- 172.21.15.17:0/903683450 shutdown_connections 2023-07-14T13:30:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.152+0000 7fc35e799b80 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a457b16d00 0x55a457b19110 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.156 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.152+0000 7fc35e799b80 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a457b032d0 0x55a457b07460 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.152+0000 7fc35e799b80 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a4579596b0 0x55a457b069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.152+0000 7fc35e799b80 1 --2- 172.21.15.17:0/903683450 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457afd580 0x55a457b06f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.152+0000 7fc35e799b80 1 -- 172.21.15.17:0/903683450 >> 172.21.15.17:0/903683450 conn(0x55a457af2be0 msgr2=0x55a457af6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:11.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.152+0000 7fc323fff700 0 client.29486 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:11.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.162+0000 7fc35e799b80 1 -- 172.21.15.17:0/903683450 shutdown_connections 2023-07-14T13:30:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.166+0000 7fc35e799b80 1 -- 172.21.15.17:0/903683450 wait complete. 2023-07-14T13:30:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.167+0000 7fc35e799b80 20 client.29486 trim_cache size 0 max 16384 2023-07-14T13:30:11.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:10 smithi135 ceph-mon[97338]: osdmap e138: 12 total, 12 up, 12 in 2023-07-14T13:30:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.196+0000 7fc35e799b80 1 Processor -- start 2023-07-14T13:30:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.196+0000 7fc35e799b80 1 -- start start 2023-07-14T13:30:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.197+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4579596b0 0x55a457afd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.197+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457afd580 0x55a457b0dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.197+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457b032d0 0x55a457b07290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.197+0000 7fc35e799b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a457b007e0 con 0x55a457b032d0 2023-07-14T13:30:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.197+0000 7fc35e799b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a457aefc00 con 0x55a4579596b0 2023-07-14T13:30:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.197+0000 7fc35e799b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a457af45f0 con 0x55a457afd580 2023-07-14T13:30:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.201+0000 7fc34939c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457b032d0 0x55a457b07290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.205+0000 7fc348b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4579596b0 0x55a457afd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.205+0000 7fc348b9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4579596b0 0x55a457afd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:56132/0 (socket says 172.21.15.17:56132) 2023-07-14T13:30:11.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.205+0000 7fc348b9b700 1 -- 172.21.15.17:0/2332304003 learned_addr learned my addr 172.21.15.17:0/2332304003 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:11.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.206+0000 7fc343fff700 1 --2- 172.21.15.17:0/2332304003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457afd580 0x55a457b0dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.212+0000 7fc343fff700 1 -- 172.21.15.17:0/2332304003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4579596b0 msgr2=0x55a457afd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.212+0000 7fc343fff700 1 --2- 172.21.15.17:0/2332304003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4579596b0 0x55a457afd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.212+0000 7fc343fff700 1 -- 172.21.15.17:0/2332304003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457b032d0 msgr2=0x55a457b07290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:11.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.212+0000 7fc343fff700 1 --2- 172.21.15.17:0/2332304003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457b032d0 0x55a457b07290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.214 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.212+0000 7fc343fff700 1 -- 172.21.15.17:0/2332304003 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4578a31f0 con 0x55a457afd580 2023-07-14T13:30:11.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:10 smithi131 ceph-mon[96953]: osdmap e138: 12 total, 12 up, 12 in 2023-07-14T13:30:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.223+0000 7fc343fff700 1 --2- 172.21.15.17:0/2332304003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457afd580 0x55a457b0dc60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x55a457b08020 tx=0x7fc334005c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96040edb70c9035f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:11.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.235+0000 7fc32b7fe700 1 -- 172.21.15.17:0/2332304003 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33401c050 con 0x55a457afd580 2023-07-14T13:30:11.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.235+0000 7fc32b7fe700 1 -- 172.21.15.17:0/2332304003 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc33401d040 con 0x55a457afd580 2023-07-14T13:30:11.236 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.235+0000 7fc32b7fe700 1 -- 172.21.15.17:0/2332304003 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3340056d0 con 0x55a457afd580 2023-07-14T13:30:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.237+0000 7fc35e799b80 1 -- 172.21.15.17:0/2332304003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457afd580 msgr2=0x55a457b0dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.237+0000 7fc35e799b80 1 --2- 172.21.15.17:0/2332304003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457afd580 0x55a457b0dc60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x55a457b08020 tx=0x7fc334005c70 comp rx=0 tx=0).stop 2023-07-14T13:30:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.237+0000 7fc35e799b80 1 -- 172.21.15.17:0/2332304003 shutdown_connections 2023-07-14T13:30:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.237+0000 7fc35e799b80 1 --2- 172.21.15.17:0/2332304003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a457b032d0 0x55a457b07290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.237+0000 7fc35e799b80 1 --2- 172.21.15.17:0/2332304003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4579596b0 0x55a457afd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.237+0000 7fc35e799b80 1 --2- 172.21.15.17:0/2332304003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457afd580 0x55a457b0dc60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.237+0000 7fc35e799b80 1 -- 172.21.15.17:0/2332304003 >> 172.21.15.17:0/2332304003 conn(0x55a457af2be0 msgr2=0x55a457b051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:11.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.245+0000 7fc35e799b80 1 -- 172.21.15.17:0/2332304003 shutdown_connections 2023-07-14T13:30:11.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.245+0000 7fc35e799b80 1 -- 172.21.15.17:0/2332304003 wait complete. 2023-07-14T13:30:11.250 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.246+0000 7fc35e799b80 1 -- start start 2023-07-14T13:30:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.246+0000 7fc35e799b80 1 Processor -- start 2023-07-14T13:30:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.247+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4579596b0 0x55a457b0bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.247+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a457afd580 0x55a457b0c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.247+0000 7fc35e799b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457b032d0 0x55a457b0c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.247+0000 7fc35e799b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a457b69ba0 con 0x55a4579596b0 2023-07-14T13:30:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.247+0000 7fc35e799b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a457b69ce0 con 0x55a457afd580 2023-07-14T13:30:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.247+0000 7fc35e799b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a457b69e50 con 0x55a457b032d0 2023-07-14T13:30:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.247+0000 7fc35e799b80 10 client.0 _ll_register_callbacks cb 0x7fc33c004a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:30:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.257+0000 7fc34939c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457b032d0 0x55a457b0c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.257+0000 7fc34939c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457b032d0 0x55a457b0c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40784/0 (socket says 172.21.15.17:40784) 2023-07-14T13:30:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.257+0000 7fc34939c700 1 -- 172.21.15.17:0/139814569 learned_addr learned my addr 172.21.15.17:0/139814569 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.258+0000 7fc348b9b700 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4579596b0 0x55a457b0bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.258+0000 7fc34939c700 1 -- 172.21.15.17:0/139814569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a457afd580 msgr2=0x55a457b0c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.258+0000 7fc34939c700 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a457afd580 0x55a457b0c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.258+0000 7fc34939c700 1 -- 172.21.15.17:0/139814569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4579596b0 msgr2=0x55a457b0bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.258+0000 7fc34939c700 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4579596b0 0x55a457b0bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.258+0000 7fc34939c700 1 -- 172.21.15.17:0/139814569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a45787cd80 con 0x55a457b032d0 2023-07-14T13:30:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.258+0000 7fc34939c700 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457b032d0 0x55a457b0c6d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc33c005ad0 tx=0x7fc33c006000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a3ead0628a8b3f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.259+0000 7fc323fff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:30:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.259+0000 7fc323fff700 1 -- 172.21.15.17:0/139814569 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c019f40 con 0x55a457b032d0 2023-07-14T13:30:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.259+0000 7fc323fff700 1 -- 172.21.15.17:0/139814569 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fc33c0236f0 con 0x55a457b032d0 2023-07-14T13:30:11.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.260+0000 7fc35e799b80 1 -- 172.21.15.17:0/139814569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc33400ce30 con 0x55a457b032d0 2023-07-14T13:30:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.263+0000 7fc323fff700 1 -- 172.21.15.17:0/139814569 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc33c039580 con 0x55a457b032d0 2023-07-14T13:30:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.263+0000 7fc35e799b80 10 client.29446 fetch_fsmap learned FSMap version 68 2023-07-14T13:30:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.263+0000 7fc35e799b80 1 -- 172.21.15.17:0/139814569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55a45787b250 con 0x55a457b032d0 2023-07-14T13:30:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.267+0000 7fc323fff700 1 -- 172.21.15.17:0/139814569 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc33400ce30 con 0x55a457b032d0 2023-07-14T13:30:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.267+0000 7fc323fff700 1 -- 172.21.15.17:0/139814569 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc33c054070 con 0x55a457b032d0 2023-07-14T13:30:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.268+0000 7fc35e799b80 10 client.29446 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:30:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.268+0000 7fc35e799b80 10 client.29446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:30:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.268+0000 7fc35e799b80 20 client.29446 populate_metadata read hostname 'smithi017' 2023-07-14T13:30:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.268+0000 7fc35e799b80 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a457b8d140 0x55a457b8f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.268+0000 7fc35e799b80 4 client.29446 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:30:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.268+0000 7fc35e799b80 1 -- 172.21.15.17:0/139814569 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a457a09ff0 con 0x55a457b8d140 2023-07-14T13:30:11.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.279+0000 7fc348b9b700 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a457b8d140 0x55a457b8f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:11.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.295+0000 7fc348b9b700 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a457b8d140 0x55a457b8f540 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=528a4fcf22d35a19 server_cookie=e9cb782f33548c89 in_seq=0 out_seq=0 2023-07-14T13:30:11.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.297+0000 7fc323fff700 10 client.29446 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.798+0000 7fc323fff700 1 -- 172.21.15.17:0/139814569 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a457a09ff0 con 0x55a457b8d140 2023-07-14T13:30:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.798+0000 7fc323fff700 10 client.29446 handle_command_reply: tid=0 2023-07-14T13:30:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.798+0000 7fc35e799b80 1 client.29446 shutdown 2023-07-14T13:30:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.799+0000 7fc35e799b80 1 -- 172.21.15.17:0/139814569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457b032d0 msgr2=0x55a457b0c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.799+0000 7fc35e799b80 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457b032d0 0x55a457b0c6d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc33c005ad0 tx=0x7fc33c006000 comp rx=0 tx=0).stop 2023-07-14T13:30:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.799+0000 7fc35e799b80 1 -- 172.21.15.17:0/139814569 shutdown_connections 2023-07-14T13:30:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.799+0000 7fc35e799b80 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a457b8d140 0x55a457b8f540 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.799+0000 7fc35e799b80 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a457b032d0 0x55a457b0c6d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.799+0000 7fc35e799b80 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a4579596b0 0x55a457b0bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.799+0000 7fc35e799b80 1 --2- 172.21.15.17:0/139814569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a457afd580 0x55a457b0c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.799+0000 7fc35e799b80 1 -- 172.21.15.17:0/139814569 >> 172.21.15.17:0/139814569 conn(0x55a457af2be0 msgr2=0x55a457b023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.799+0000 7fc323fff700 0 client.29446 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.800+0000 7fc35e799b80 1 -- 172.21.15.17:0/139814569 shutdown_connections 2023-07-14T13:30:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.800+0000 7fc35e799b80 1 -- 172.21.15.17:0/139814569 wait complete. 2023-07-14T13:30:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.800+0000 7fc35e799b80 20 client.29446 trim_cache size 0 max 16384 2023-07-14T13:30:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:30:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:30:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:30:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:30:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.810+0000 7fc34adff700 1 -- 172.21.15.17:0/311289503 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc32c0a14d0 msgr2=0x7fc32c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.810+0000 7fc34adff700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc32c0a14d0 0x7fc32c0a3980 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc33c01c0d0 tx=0x7fc33c01c800 comp rx=0 tx=0).stop 2023-07-14T13:30:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.810+0000 7fc34adff700 1 -- 172.21.15.17:0/311289503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc34406c910 msgr2=0x7fc344116bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.810+0000 7fc34adff700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc34406c910 0x7fc344116bf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc33800b550 tx=0x7fc33800b910 comp rx=0 tx=0).stop 2023-07-14T13:30:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.811+0000 7fc34adff700 1 -- 172.21.15.17:0/311289503 shutdown_connections 2023-07-14T13:30:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.811+0000 7fc34adff700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fc32c0a14d0 0x7fc32c0a3980 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.811+0000 7fc34adff700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc34410e2a0 0x7fc3441a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.811+0000 7fc34adff700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc34406c910 0x7fc344116bf0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.811+0000 7fc34adff700 1 --2- 172.21.15.17:0/311289503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc34406d3a0 0x7fc344117130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.811+0000 7fc34adff700 1 -- 172.21.15.17:0/311289503 >> 172.21.15.17:0/311289503 conn(0x7fc34406bd70 msgr2=0x7fc34406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.811+0000 7fc34adff700 1 -- 172.21.15.17:0/311289503 shutdown_connections 2023-07-14T13:30:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:11.811+0000 7fc34adff700 1 -- 172.21.15.17:0/311289503 wait complete. 2023-07-14T13:30:12.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:11 smithi017 ceph-mon[95536]: pgmap v965: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 747 op/s 2023-07-14T13:30:12.171 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:11 smithi135 ceph-mon[97338]: pgmap v965: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 747 op/s 2023-07-14T13:30:12.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:11 smithi131 ceph-mon[96953]: pgmap v965: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 747 op/s 2023-07-14T13:30:12.420 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 720.0 s, 205.2 tps, lat 470.654 ms stddev 281.185 2023-07-14T13:30:13.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:12 smithi017 ceph-mon[95536]: pgmap v966: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 746 op/s 2023-07-14T13:30:13.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:12 smithi135 ceph-mon[97338]: pgmap v966: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 746 op/s 2023-07-14T13:30:13.222 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:12 smithi131 ceph-mon[96953]: pgmap v966: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 746 op/s 2023-07-14T13:30:15.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:15 smithi135 ceph-mon[97338]: pgmap v967: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 746 op/s 2023-07-14T13:30:15.967 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:15 smithi131 ceph-mon[96953]: pgmap v967: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 746 op/s 2023-07-14T13:30:16.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:15 smithi017 ceph-mon[95536]: pgmap v967: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 746 op/s 2023-07-14T13:30:17.423 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 725.0 s, 242.3 tps, lat 440.796 ms stddev 434.016 2023-07-14T13:30:17.967 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:17 smithi131 ceph-mon[96953]: pgmap v968: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 669 op/s 2023-07-14T13:30:18.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:17 smithi017 ceph-mon[95536]: pgmap v968: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 669 op/s 2023-07-14T13:30:18.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:17 smithi135 ceph-mon[97338]: pgmap v968: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 669 op/s 2023-07-14T13:30:19.967 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:19 smithi131 ceph-mon[96953]: pgmap v969: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 669 op/s 2023-07-14T13:30:20.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:19 smithi017 ceph-mon[95536]: pgmap v969: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 669 op/s 2023-07-14T13:30:20.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:19 smithi135 ceph-mon[97338]: pgmap v969: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.8 MiB/s wr, 669 op/s 2023-07-14T13:30:22.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:21 smithi017 ceph-mon[95536]: pgmap v970: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 11 MiB/s wr, 1.22k op/s 2023-07-14T13:30:22.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:21 smithi017 ceph-mon[95536]: osdmap e139: 12 total, 12 up, 12 in 2023-07-14T13:30:22.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:21 smithi135 ceph-mon[97338]: pgmap v970: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 11 MiB/s wr, 1.22k op/s 2023-07-14T13:30:22.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:21 smithi135 ceph-mon[97338]: osdmap e139: 12 total, 12 up, 12 in 2023-07-14T13:30:22.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:21 smithi131 ceph-mon[96953]: pgmap v970: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 11 MiB/s wr, 1.22k op/s 2023-07-14T13:30:22.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:21 smithi131 ceph-mon[96953]: osdmap e139: 12 total, 12 up, 12 in 2023-07-14T13:30:22.424 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 730.0 s, 492.2 tps, lat 202.481 ms stddev 95.019 2023-07-14T13:30:24.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:23 smithi017 ceph-mon[95536]: pgmap v972: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 865 op/s 2023-07-14T13:30:24.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:23 smithi135 ceph-mon[97338]: pgmap v972: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 865 op/s 2023-07-14T13:30:24.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:23 smithi131 ceph-mon[96953]: pgmap v972: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 865 op/s 2023-07-14T13:30:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.095+0000 7fed33bff700 1 -- 172.21.15.17:0/3639705863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c06d3a0 msgr2=0x7fed2c11b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.095+0000 7fed33bff700 1 --2- 172.21.15.17:0/3639705863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c06d3a0 0x7fed2c11b470 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0098f0 tx=0x7fed1c009c00 comp rx=0 tx=0).stop 2023-07-14T13:30:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.095+0000 7fed33bff700 1 -- 172.21.15.17:0/3639705863 shutdown_connections 2023-07-14T13:30:25.097 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.095+0000 7fed33bff700 1 --2- 172.21.15.17:0/3639705863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c06d3a0 0x7fed2c11b470 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.095+0000 7fed33bff700 1 --2- 172.21.15.17:0/3639705863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c10e2a0 0x7fed2c10e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.095+0000 7fed33bff700 1 --2- 172.21.15.17:0/3639705863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed2c06c910 0x7fed2c06cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.098 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.095+0000 7fed33bff700 1 -- 172.21.15.17:0/3639705863 >> 172.21.15.17:0/3639705863 conn(0x7fed2c06bd70 msgr2=0x7fed2c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:25.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.100+0000 7fed33bff700 1 -- 172.21.15.17:0/3639705863 shutdown_connections 2023-07-14T13:30:25.101 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.100+0000 7fed33bff700 1 -- 172.21.15.17:0/3639705863 wait complete. 2023-07-14T13:30:25.103 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.102+0000 7fed33bff700 1 Processor -- start 2023-07-14T13:30:25.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.102+0000 7fed33bff700 1 -- start start 2023-07-14T13:30:25.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.103+0000 7fed33bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c06c910 0x7fed2c1aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.103+0000 7fed33bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed2c06d3a0 0x7fed2c1aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.104 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.103+0000 7fed33bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c10e2a0 0x7fed2c1a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.103+0000 7fed33bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c1a5050 con 0x7fed2c06c910 2023-07-14T13:30:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.103+0000 7fed33bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c1a5190 con 0x7fed2c06d3a0 2023-07-14T13:30:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.103+0000 7fed33bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c1a5350 con 0x7fed2c10e2a0 2023-07-14T13:30:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.104+0000 7fed3119a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed2c06d3a0 0x7fed2c1aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.105 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.104+0000 7fed3219c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c10e2a0 0x7fed2c1a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.104+0000 7fed3219c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c10e2a0 0x7fed2c1a4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34064/0 (socket says 172.21.15.17:34064) 2023-07-14T13:30:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.104+0000 7fed3219c700 1 -- 172.21.15.17:0/2662885321 learned_addr learned my addr 172.21.15.17:0/2662885321 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.104+0000 7fed3199b700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c06c910 0x7fed2c1aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.105+0000 7fed3219c700 1 -- 172.21.15.17:0/2662885321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed2c06d3a0 msgr2=0x7fed2c1aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:25.106 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.105+0000 7fed3219c700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed2c06d3a0 0x7fed2c1aaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.105+0000 7fed3219c700 1 -- 172.21.15.17:0/2662885321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c06c910 msgr2=0x7fed2c1aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.105+0000 7fed3219c700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c06c910 0x7fed2c1aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.107 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.105+0000 7fed3219c700 1 -- 172.21.15.17:0/2662885321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c009520 con 0x7fed2c10e2a0 2023-07-14T13:30:25.115 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.108+0000 7fed3219c700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c10e2a0 0x7fed2c1a4880 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00bb00 tx=0x7fed1c00bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.111+0000 7fed22ffd700 1 -- 172.21.15.17:0/2662885321 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c00bee0 con 0x7fed2c10e2a0 2023-07-14T13:30:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.111+0000 7fed22ffd700 1 -- 172.21.15.17:0/2662885321 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed1c005520 con 0x7fed2c10e2a0 2023-07-14T13:30:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.111+0000 7fed22ffd700 1 -- 172.21.15.17:0/2662885321 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c017940 con 0x7fed2c10e2a0 2023-07-14T13:30:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.115+0000 7fed33bff700 1 -- 172.21.15.17:0/2662885321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c1a55d0 con 0x7fed2c10e2a0 2023-07-14T13:30:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.115+0000 7fed33bff700 1 -- 172.21.15.17:0/2662885321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c10ee20 con 0x7fed2c10e2a0 2023-07-14T13:30:25.125 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.124+0000 7fed47551b80 1 Processor -- start 2023-07-14T13:30:25.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.125+0000 7fed47551b80 1 -- start start 2023-07-14T13:30:25.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.125+0000 7fed47551b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 0x55dfc605ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.125+0000 7fed47551b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc605f2d0 0x55dfc6059040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.126 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.125+0000 7fed47551b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc6059580 0x55dfc60599d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.126+0000 7fed47551b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5f5ec50 con 0x55dfc6059580 2023-07-14T13:30:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.126+0000 7fed47551b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5fb19e0 con 0x55dfc605f2d0 2023-07-14T13:30:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.126+0000 7fed47551b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5faae70 con 0x55dfc5eb56b0 2023-07-14T13:30:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.128+0000 7fed3119a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 0x55dfc605ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.128+0000 7fed3119a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 0x55dfc605ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34076/0 (socket says 172.21.15.17:34076) 2023-07-14T13:30:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.128+0000 7fed3119a700 1 -- 172.21.15.17:0/806940646 learned_addr learned my addr 172.21.15.17:0/806940646 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.128+0000 7fed3119a700 1 --2- 172.21.15.17:0/806940646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc6059580 0x55dfc60599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.129+0000 7fed22ffd700 1 -- 172.21.15.17:0/2662885321 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fed1c003c10 con 0x7fed2c10e2a0 2023-07-14T13:30:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.129+0000 7fed3119a700 1 -- 172.21.15.17:0/806940646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc605f2d0 msgr2=0x55dfc6059040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:30:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.129+0000 7fed3119a700 1 --2- 172.21.15.17:0/806940646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc605f2d0 0x55dfc6059040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.129+0000 7fed3119a700 1 -- 172.21.15.17:0/806940646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc6059580 msgr2=0x55dfc60599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.129+0000 7fed3119a700 1 --2- 172.21.15.17:0/806940646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc6059580 0x55dfc60599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.129+0000 7fed3119a700 1 -- 172.21.15.17:0/806940646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfc5dd8d80 con 0x55dfc5eb56b0 2023-07-14T13:30:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.130+0000 7fed3119a700 1 --2- 172.21.15.17:0/806940646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 0x55dfc605ed90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fed24015ad0 tx=0x7fed240099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ead519ddedd9d730 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.131+0000 7fed22ffd700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed180a14d0 0x7fed180a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.132+0000 7fed22ffd700 1 -- 172.21.15.17:0/2662885321 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fed1c0cd590 con 0x7fed2c10e2a0 2023-07-14T13:30:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.133+0000 7fed3199b700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed180a14d0 0x7fed180a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.134+0000 7fed3199b700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed180a14d0 0x7fed180a3980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55dfc6055b40 tx=0x7fed28008040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.134+0000 7fed17fff700 1 -- 172.21.15.17:0/806940646 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2400e040 con 0x55dfc5eb56b0 2023-07-14T13:30:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.134+0000 7fed17fff700 1 -- 172.21.15.17:0/806940646 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed24003e90 con 0x55dfc5eb56b0 2023-07-14T13:30:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.134+0000 7fed17fff700 1 -- 172.21.15.17:0/806940646 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240075c0 con 0x55dfc5eb56b0 2023-07-14T13:30:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.138+0000 7fed47551b80 1 -- 172.21.15.17:0/806940646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 msgr2=0x55dfc605ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.138+0000 7fed47551b80 1 --2- 172.21.15.17:0/806940646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 0x55dfc605ed90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fed24015ad0 tx=0x7fed240099e0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.138+0000 7fed47551b80 1 -- 172.21.15.17:0/806940646 shutdown_connections 2023-07-14T13:30:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.138+0000 7fed47551b80 1 --2- 172.21.15.17:0/806940646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc6059580 0x55dfc60599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.138+0000 7fed47551b80 1 --2- 172.21.15.17:0/806940646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 0x55dfc605ed90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.138+0000 7fed47551b80 1 --2- 172.21.15.17:0/806940646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc605f2d0 0x55dfc6059040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.138+0000 7fed47551b80 1 -- 172.21.15.17:0/806940646 >> 172.21.15.17:0/806940646 conn(0x55dfc604ebe0 msgr2=0x55dfc6053f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.138+0000 7fed47551b80 1 -- 172.21.15.17:0/806940646 shutdown_connections 2023-07-14T13:30:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.139+0000 7fed47551b80 1 -- 172.21.15.17:0/806940646 wait complete. 2023-07-14T13:30:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.139+0000 7fed47551b80 1 -- start start 2023-07-14T13:30:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.140+0000 7fed47551b80 1 Processor -- start 2023-07-14T13:30:25.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.141+0000 7fed47551b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc5eb56b0 0x55dfc60629a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.141 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.141+0000 7fed47551b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc6059580 0x55dfc6062ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.141+0000 7fed47551b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc605f2d0 0x55dfc6063420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.141+0000 7fed47551b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5f4aa60 con 0x55dfc6059580 2023-07-14T13:30:25.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.141+0000 7fed47551b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5f4a760 con 0x55dfc5eb56b0 2023-07-14T13:30:25.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.141+0000 7fed47551b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5e2e8c0 con 0x55dfc605f2d0 2023-07-14T13:30:25.142 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.141+0000 7fed47551b80 10 client.0 _ll_register_callbacks cb 0x55dfc5f48700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:30:25.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.141+0000 7fed3219c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc605f2d0 0x55dfc6063420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.142+0000 7fed3219c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc605f2d0 0x55dfc6063420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34084/0 (socket says 172.21.15.17:34084) 2023-07-14T13:30:25.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.142+0000 7fed3219c700 1 -- 172.21.15.17:0/1173132286 learned_addr learned my addr 172.21.15.17:0/1173132286 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:25.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.142+0000 7fed3119a700 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc6059580 0x55dfc6062ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.142+0000 7fed3199b700 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc5eb56b0 0x55dfc60629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.143 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.142+0000 7fed3219c700 1 -- 172.21.15.17:0/1173132286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc5eb56b0 msgr2=0x55dfc60629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:25.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.142+0000 7fed3219c700 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc5eb56b0 0x55dfc60629a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.142+0000 7fed3219c700 1 -- 172.21.15.17:0/1173132286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc6059580 msgr2=0x55dfc6062ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:25.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.142+0000 7fed3219c700 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc6059580 0x55dfc6062ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.144 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.142+0000 7fed3219c700 1 -- 172.21.15.17:0/1173132286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed24015780 con 0x55dfc605f2d0 2023-07-14T13:30:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.143+0000 7fed3219c700 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc605f2d0 0x55dfc6063420 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009810 tx=0x7fed1c09a6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8ebe762cb9ba88e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.143+0000 7fed157fa700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:30:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.143+0000 7fed157fa700 1 -- 172.21.15.17:0/1173132286 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c09a910 con 0x55dfc605f2d0 2023-07-14T13:30:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.143+0000 7fed157fa700 1 -- 172.21.15.17:0/1173132286 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fed1c09aa70 con 0x55dfc605f2d0 2023-07-14T13:30:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.144+0000 7fed47551b80 1 -- 172.21.15.17:0/1173132286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dfc5f04490 con 0x55dfc605f2d0 2023-07-14T13:30:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.144+0000 7fed157fa700 1 -- 172.21.15.17:0/1173132286 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed1c099ba0 con 0x55dfc605f2d0 2023-07-14T13:30:25.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.146+0000 7fed47551b80 10 client.29455 fetch_fsmap learned FSMap version 68 2023-07-14T13:30:25.148 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.146+0000 7fed47551b80 1 -- 172.21.15.17:0/1173132286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55dfc5dc1c00 con 0x55dfc605f2d0 2023-07-14T13:30:25.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.151+0000 7fed157fa700 1 -- 172.21.15.17:0/1173132286 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dfc5f04490 con 0x55dfc605f2d0 2023-07-14T13:30:25.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.151+0000 7fed157fa700 1 -- 172.21.15.17:0/1173132286 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fed1c0cd0d0 con 0x55dfc605f2d0 2023-07-14T13:30:25.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.151+0000 7fed47551b80 10 client.29455 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:30:25.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.151+0000 7fed47551b80 10 client.29455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:30:25.152 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.151+0000 7fed47551b80 20 client.29455 populate_metadata read hostname 'smithi017' 2023-07-14T13:30:25.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.151+0000 7fed47551b80 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dfc6072840 0x55dfc6074c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.151+0000 7fed47551b80 4 client.29455 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:30:25.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.151+0000 7fed47551b80 1 -- 172.21.15.17:0/1173132286 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dfc5fa3e50 con 0x55dfc6072840 2023-07-14T13:30:25.153 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.152+0000 7fed3199b700 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dfc6072840 0x55dfc6074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.154+0000 7fed3199b700 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dfc6072840 0x55dfc6074c50 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=605fc4155d07182b server_cookie=706bc141a30c1cfe in_seq=0 out_seq=0 2023-07-14T13:30:25.154 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.154+0000 7fed157fa700 10 client.29455 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.155+0000 7fed157fa700 1 -- 172.21.15.17:0/1173132286 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55dfc5fa3e50 con 0x55dfc6072840 2023-07-14T13:30:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.155+0000 7fed157fa700 10 client.29455 handle_command_reply: tid=0 2023-07-14T13:30:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.157+0000 7fed47551b80 1 client.29455 shutdown 2023-07-14T13:30:25.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.157+0000 7fed47551b80 1 -- 172.21.15.17:0/1173132286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc605f2d0 msgr2=0x55dfc6063420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:25.158 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.157+0000 7fed47551b80 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc605f2d0 0x55dfc6063420 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009810 tx=0x7fed1c09a6b0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.161+0000 7fed47551b80 1 -- 172.21.15.17:0/1173132286 shutdown_connections 2023-07-14T13:30:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.161+0000 7fed47551b80 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dfc6072840 0x55dfc6074c50 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.161+0000 7fed47551b80 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc605f2d0 0x55dfc6063420 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.161+0000 7fed47551b80 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc5eb56b0 0x55dfc60629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.161+0000 7fed47551b80 1 --2- 172.21.15.17:0/1173132286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc6059580 0x55dfc6062ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.161+0000 7fed47551b80 1 -- 172.21.15.17:0/1173132286 >> 172.21.15.17:0/1173132286 conn(0x55dfc604ebe0 msgr2=0x55dfc6052c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.161+0000 7fed157fa700 0 client.29455 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.161+0000 7fed47551b80 1 -- 172.21.15.17:0/1173132286 shutdown_connections 2023-07-14T13:30:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.162+0000 7fed47551b80 1 -- 172.21.15.17:0/1173132286 wait complete. 2023-07-14T13:30:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.163+0000 7fed47551b80 20 client.29455 trim_cache size 0 max 16384 2023-07-14T13:30:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.193+0000 7fed47551b80 1 Processor -- start 2023-07-14T13:30:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.194+0000 7fed47551b80 1 -- start start 2023-07-14T13:30:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.194+0000 7fed47551b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc604ebe0 0x55dfc6059040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.194+0000 7fed47551b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 0x55dfc6053c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.194+0000 7fed47551b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc6059580 0x55dfc6060320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.194+0000 7fed47551b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc5f04490 con 0x55dfc604ebe0 2023-07-14T13:30:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.194+0000 7fed47551b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc6055b70 con 0x55dfc6059580 2023-07-14T13:30:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.194+0000 7fed47551b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc605ea10 con 0x55dfc5eb56b0 2023-07-14T13:30:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.195+0000 7fed3199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc604ebe0 0x55dfc6059040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.195+0000 7fed3199b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc604ebe0 0x55dfc6059040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40606/0 (socket says 172.21.15.17:40606) 2023-07-14T13:30:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.195+0000 7fed3199b700 1 -- 172.21.15.17:0/2447560658 learned_addr learned my addr 172.21.15.17:0/2447560658 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.195+0000 7fed3119a700 1 --2- 172.21.15.17:0/2447560658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 0x55dfc6053c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.195+0000 7fed3219c700 1 --2- 172.21.15.17:0/2447560658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc6059580 0x55dfc6060320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.196+0000 7fed3199b700 1 -- 172.21.15.17:0/2447560658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 msgr2=0x55dfc6053c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.196+0000 7fed3199b700 1 --2- 172.21.15.17:0/2447560658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 0x55dfc6053c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.196+0000 7fed3199b700 1 -- 172.21.15.17:0/2447560658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc6059580 msgr2=0x55dfc6060320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.196+0000 7fed3199b700 1 --2- 172.21.15.17:0/2447560658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc6059580 0x55dfc6060320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.196+0000 7fed3199b700 1 -- 172.21.15.17:0/2447560658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfc6059c20 con 0x55dfc604ebe0 2023-07-14T13:30:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.196+0000 7fed3199b700 1 --2- 172.21.15.17:0/2447560658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc604ebe0 0x55dfc6059040 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fed28009f90 tx=0x7fed28013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977451734d500cc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.197+0000 7fed20bff700 1 -- 172.21.15.17:0/2447560658 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28024040 con 0x55dfc604ebe0 2023-07-14T13:30:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.197+0000 7fed20bff700 1 -- 172.21.15.17:0/2447560658 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed28004020 con 0x55dfc604ebe0 2023-07-14T13:30:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.197+0000 7fed20bff700 1 -- 172.21.15.17:0/2447560658 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed280149f0 con 0x55dfc604ebe0 2023-07-14T13:30:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.198+0000 7fed47551b80 1 -- 172.21.15.17:0/2447560658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc604ebe0 msgr2=0x55dfc6059040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.198+0000 7fed47551b80 1 --2- 172.21.15.17:0/2447560658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc604ebe0 0x55dfc6059040 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fed28009f90 tx=0x7fed28013000 comp rx=0 tx=0).stop 2023-07-14T13:30:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.198+0000 7fed47551b80 1 -- 172.21.15.17:0/2447560658 shutdown_connections 2023-07-14T13:30:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.198+0000 7fed47551b80 1 --2- 172.21.15.17:0/2447560658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc6059580 0x55dfc6060320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.198+0000 7fed47551b80 1 --2- 172.21.15.17:0/2447560658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc604ebe0 0x55dfc6059040 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.198+0000 7fed47551b80 1 --2- 172.21.15.17:0/2447560658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc5eb56b0 0x55dfc6053c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.198+0000 7fed47551b80 1 -- 172.21.15.17:0/2447560658 >> 172.21.15.17:0/2447560658 conn(0x55dfc605cfb0 msgr2=0x55dfc605e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.199+0000 7fed47551b80 1 -- 172.21.15.17:0/2447560658 shutdown_connections 2023-07-14T13:30:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.199+0000 7fed47551b80 1 -- 172.21.15.17:0/2447560658 wait complete. 2023-07-14T13:30:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.199+0000 7fed47551b80 1 -- start start 2023-07-14T13:30:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.200+0000 7fed47551b80 1 Processor -- start 2023-07-14T13:30:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.201+0000 7fed47551b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc5eb56b0 0x55dfc6069da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.201+0000 7fed47551b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc604ebe0 0x55dfc6068160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.201+0000 7fed47551b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc6059580 0x55dfc6068850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.201+0000 7fed47551b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc6068f90 con 0x55dfc5eb56b0 2023-07-14T13:30:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.201+0000 7fed47551b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc60c66d0 con 0x55dfc604ebe0 2023-07-14T13:30:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.201+0000 7fed47551b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfc60c6810 con 0x55dfc6059580 2023-07-14T13:30:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.201+0000 7fed47551b80 10 client.0 _ll_register_callbacks cb 0x7fed1c09a570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:30:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.202+0000 7fed3119a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc604ebe0 0x55dfc6068160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.202+0000 7fed3119a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc604ebe0 0x55dfc6068160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:57174/0 (socket says 172.21.15.17:57174) 2023-07-14T13:30:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.202+0000 7fed3119a700 1 -- 172.21.15.17:0/3227719 learned_addr learned my addr 172.21.15.17:0/3227719 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.202+0000 7fed3199b700 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc5eb56b0 0x55dfc6069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.202+0000 7fed3219c700 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc6059580 0x55dfc6068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.203+0000 7fed3199b700 1 -- 172.21.15.17:0/3227719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc6059580 msgr2=0x55dfc6068850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.203+0000 7fed3199b700 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc6059580 0x55dfc6068850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.203+0000 7fed3199b700 1 -- 172.21.15.17:0/3227719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc604ebe0 msgr2=0x55dfc6068160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.203+0000 7fed3199b700 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc604ebe0 0x55dfc6068160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.203+0000 7fed3199b700 1 -- 172.21.15.17:0/3227719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2801c040 con 0x55dfc5eb56b0 2023-07-14T13:30:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.203+0000 7fed3199b700 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc5eb56b0 0x55dfc6069da0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fed28008010 tx=0x7fed280043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e328919b6c56726 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.204+0000 7fed157fa700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:30:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.204+0000 7fed157fa700 1 -- 172.21.15.17:0/3227719 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28030040 con 0x55dfc5eb56b0 2023-07-14T13:30:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.204+0000 7fed157fa700 1 -- 172.21.15.17:0/3227719 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fed28005c10 con 0x55dfc5eb56b0 2023-07-14T13:30:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.204+0000 7fed47551b80 1 -- 172.21.15.17:0/3227719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed24003e90 con 0x55dfc5eb56b0 2023-07-14T13:30:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.205+0000 7fed157fa700 1 -- 172.21.15.17:0/3227719 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed28005dd0 con 0x55dfc5eb56b0 2023-07-14T13:30:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.205+0000 7fed47551b80 10 client.19719 fetch_fsmap learned FSMap version 68 2023-07-14T13:30:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.205+0000 7fed47551b80 1 -- 172.21.15.17:0/3227719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55dfc5dff1f0 con 0x55dfc5eb56b0 2023-07-14T13:30:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.206+0000 7fed157fa700 1 -- 172.21.15.17:0/3227719 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed24003e90 con 0x55dfc5eb56b0 2023-07-14T13:30:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.206+0000 7fed157fa700 1 -- 172.21.15.17:0/3227719 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fed28003720 con 0x55dfc5eb56b0 2023-07-14T13:30:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.208+0000 7fed47551b80 10 client.19719 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:30:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.208+0000 7fed47551b80 10 client.19719 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:30:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.208+0000 7fed47551b80 20 client.19719 populate_metadata read hostname 'smithi017' 2023-07-14T13:30:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.208+0000 7fed47551b80 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dfc605f2d0 0x55dfc60c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.208+0000 7fed47551b80 4 client.19719 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:30:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.208+0000 7fed47551b80 1 -- 172.21.15.17:0/3227719 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dfc5f65ff0 con 0x55dfc605f2d0 2023-07-14T13:30:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.214+0000 7fed3119a700 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dfc605f2d0 0x55dfc60c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.217+0000 7fed3119a700 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dfc605f2d0 0x55dfc60c9df0 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c0ff56fa7375bf1 server_cookie=adbea57047c6e1c8 in_seq=0 out_seq=0 2023-07-14T13:30:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.217+0000 7fed157fa700 10 client.19719 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.280+0000 7fed157fa700 1 -- 172.21.15.17:0/3227719 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dfc5f65ff0 con 0x55dfc605f2d0 2023-07-14T13:30:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.280+0000 7fed157fa700 10 client.19719 handle_command_reply: tid=0 2023-07-14T13:30:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.280+0000 7fed47551b80 1 client.19719 shutdown 2023-07-14T13:30:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.280+0000 7fed47551b80 1 -- 172.21.15.17:0/3227719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc5eb56b0 msgr2=0x55dfc6069da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.280+0000 7fed47551b80 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc5eb56b0 0x55dfc6069da0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fed28008010 tx=0x7fed280043c0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.281+0000 7fed47551b80 1 -- 172.21.15.17:0/3227719 shutdown_connections 2023-07-14T13:30:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.281+0000 7fed47551b80 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55dfc605f2d0 0x55dfc60c9df0 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.281+0000 7fed47551b80 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dfc6059580 0x55dfc6068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.281+0000 7fed47551b80 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dfc5eb56b0 0x55dfc6069da0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.281+0000 7fed47551b80 1 --2- 172.21.15.17:0/3227719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dfc604ebe0 0x55dfc6068160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.281+0000 7fed47551b80 1 -- 172.21.15.17:0/3227719 >> 172.21.15.17:0/3227719 conn(0x55dfc605cfb0 msgr2=0x55dfc6060320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.281+0000 7fed157fa700 0 client.19719 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.281+0000 7fed47551b80 1 -- 172.21.15.17:0/3227719 shutdown_connections 2023-07-14T13:30:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:30:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:30:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:30:25.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:30:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.281+0000 7fed47551b80 1 -- 172.21.15.17:0/3227719 wait complete. 2023-07-14T13:30:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.282+0000 7fed47551b80 20 client.19719 trim_cache size 0 max 16384 2023-07-14T13:30:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.283+0000 7fed33bff700 1 -- 172.21.15.17:0/2662885321 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed180a14d0 msgr2=0x7fed180a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.283+0000 7fed33bff700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed180a14d0 0x7fed180a3980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55dfc6055b40 tx=0x7fed28008040 comp rx=0 tx=0).stop 2023-07-14T13:30:25.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.283+0000 7fed33bff700 1 -- 172.21.15.17:0/2662885321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c10e2a0 msgr2=0x7fed2c1a4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.283+0000 7fed33bff700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c10e2a0 0x7fed2c1a4880 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00bb00 tx=0x7fed1c00bbe0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.283+0000 7fed33bff700 1 -- 172.21.15.17:0/2662885321 shutdown_connections 2023-07-14T13:30:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.283+0000 7fed33bff700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fed180a14d0 0x7fed180a3980 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.283+0000 7fed33bff700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c10e2a0 0x7fed2c1a4880 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.283+0000 7fed33bff700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed2c06c910 0x7fed2c1aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.283+0000 7fed33bff700 1 --2- 172.21.15.17:0/2662885321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed2c06d3a0 0x7fed2c1aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.283+0000 7fed33bff700 1 -- 172.21.15.17:0/2662885321 >> 172.21.15.17:0/2662885321 conn(0x7fed2c06bd70 msgr2=0x7fed2c070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.283+0000 7fed33bff700 1 -- 172.21.15.17:0/2662885321 shutdown_connections 2023-07-14T13:30:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:25.284+0000 7fed33bff700 1 -- 172.21.15.17:0/2662885321 wait complete. 2023-07-14T13:30:26.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:25 smithi017 ceph-mon[95536]: pgmap v973: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 865 op/s 2023-07-14T13:30:26.459 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:25 smithi131 ceph-mon[96953]: pgmap v973: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 865 op/s 2023-07-14T13:30:26.459 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:25 smithi135 ceph-mon[97338]: pgmap v973: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.5 MiB/s wr, 865 op/s 2023-07-14T13:30:27.424 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 735.0 s, 509.2 tps, lat 195.442 ms stddev 85.147 2023-07-14T13:30:28.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:27 smithi017 ceph-mon[95536]: pgmap v974: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 12 MiB/s wr, 1.41k op/s 2023-07-14T13:30:28.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:27 smithi135 ceph-mon[97338]: pgmap v974: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 12 MiB/s wr, 1.41k op/s 2023-07-14T13:30:28.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:27 smithi131 ceph-mon[96953]: pgmap v974: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 12 MiB/s wr, 1.41k op/s 2023-07-14T13:30:30.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:29 smithi017 ceph-mon[95536]: pgmap v975: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 12 MiB/s wr, 1.41k op/s 2023-07-14T13:30:30.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:29 smithi135 ceph-mon[97338]: pgmap v975: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 12 MiB/s wr, 1.41k op/s 2023-07-14T13:30:30.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:29 smithi131 ceph-mon[96953]: pgmap v975: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 12 MiB/s wr, 1.41k op/s 2023-07-14T13:30:32.059 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:31 smithi017 ceph-mon[95536]: pgmap v976: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.53k op/s 2023-07-14T13:30:32.060 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:31 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:30:32.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:31 smithi135 ceph-mon[97338]: pgmap v976: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.53k op/s 2023-07-14T13:30:32.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:31 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:30:32.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:31 smithi131 ceph-mon[96953]: pgmap v976: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.53k op/s 2023-07-14T13:30:32.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:31 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:30:32.420 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 740.0 s, 490.7 tps, lat 203.751 ms stddev 162.605 2023-07-14T13:30:34.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:33 smithi017 ceph-mon[95536]: pgmap v977: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2023-07-14T13:30:34.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:33 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:34.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:33 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:34.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:33 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:34.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:33 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:34.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:33 smithi135 ceph-mon[97338]: pgmap v977: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2023-07-14T13:30:34.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:33 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:34.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:33 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:34.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:33 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:34.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:33 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:34.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:33 smithi131 ceph-mon[96953]: pgmap v977: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2023-07-14T13:30:34.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:33 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:34.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:33 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:34.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:33 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:34.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:33 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:35.418 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:35 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:35.418 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:35 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:35.419 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:35 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:30:35.419 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:35 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:30:35.419 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:35 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:35.419 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:35 smithi135 ceph-mon[97338]: pgmap v978: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.27k op/s 2023-07-14T13:30:35.467 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:35 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:35.467 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:35 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:35.467 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:35 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:30:35.467 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:35 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:30:35.467 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:35 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:35.468 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:35 smithi131 ceph-mon[96953]: pgmap v978: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.27k op/s 2023-07-14T13:30:35.579 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:35 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:35.580 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:35 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:35.580 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:35 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:30:35.580 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:35 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:30:35.580 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:35 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:30:35.580 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:35 smithi017 ceph-mon[95536]: pgmap v978: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.27k op/s 2023-07-14T13:30:37.422 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 745.0 s, 472.6 tps, lat 207.431 ms stddev 58.887 2023-07-14T13:30:37.966 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:37 smithi131 ceph-mon[96953]: pgmap v979: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 17 MiB/s wr, 1.89k op/s 2023-07-14T13:30:38.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:37 smithi017 ceph-mon[95536]: pgmap v979: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 17 MiB/s wr, 1.89k op/s 2023-07-14T13:30:38.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:37 smithi135 ceph-mon[97338]: pgmap v979: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 17 MiB/s wr, 1.89k op/s 2023-07-14T13:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.570+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/11709632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc74110a70 msgr2=0x7fbc74112e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.570+0000 7fbc7a3ff700 1 --2- 172.21.15.17:0/11709632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc74110a70 0x7fbc74112e50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009990 tx=0x7fbc6c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.570+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/11709632 shutdown_connections 2023-07-14T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.570+0000 7fbc7a3ff700 1 --2- 172.21.15.17:0/11709632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc74110a70 0x7fbc74112e50 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.570+0000 7fbc7a3ff700 1 --2- 172.21.15.17:0/11709632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc74074a40 0x7fbc74074e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.570+0000 7fbc7a3ff700 1 --2- 172.21.15.17:0/11709632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc74075350 0x7fbc74110530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.570+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/11709632 >> 172.21.15.17:0/11709632 conn(0x7fbc740fd8d0 msgr2=0x7fbc740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.570+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/11709632 shutdown_connections 2023-07-14T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.570+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/11709632 wait complete. 2023-07-14T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.572+0000 7fbc7a3ff700 1 Processor -- start 2023-07-14T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.572+0000 7fbc7a3ff700 1 -- start start 2023-07-14T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.572+0000 7fbc7a3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc74074a40 0x7fbc7419c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.573+0000 7fbc7a3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc74075350 0x7fbc7419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.573+0000 7fbc7a3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc74110a70 0x7fbc741a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.573+0000 7fbc7a3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc741a1260 con 0x7fbc74074a40 2023-07-14T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.573+0000 7fbc7a3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc741a13d0 con 0x7fbc74075350 2023-07-14T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.573+0000 7fbc7a3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc741a1590 con 0x7fbc74110a70 2023-07-14T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.573+0000 7fbc7899c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc74110a70 0x7fbc741a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.573+0000 7fbc7899c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc74110a70 0x7fbc741a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:35150/0 (socket says 172.21.15.17:35150) 2023-07-14T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.573+0000 7fbc7899c700 1 -- 172.21.15.17:0/1608324865 learned_addr learned my addr 172.21.15.17:0/1608324865 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.574+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc74075350 0x7fbc7419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.574+0000 7fbc73fff700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc74074a40 0x7fbc7419c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.574+0000 7fbc7899c700 1 -- 172.21.15.17:0/1608324865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc74075350 msgr2=0x7fbc7419c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.574+0000 7fbc7899c700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc74075350 0x7fbc7419c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.574+0000 7fbc7899c700 1 -- 172.21.15.17:0/1608324865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc74074a40 msgr2=0x7fbc7419c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.574+0000 7fbc7899c700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc74074a40 0x7fbc7419c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.574+0000 7fbc7899c700 1 -- 172.21.15.17:0/1608324865 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0095f0 con 0x7fbc74110a70 2023-07-14T13:30:38.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.575+0000 7fbc7899c700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc74110a70 0x7fbc741a0c20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0098e0 tx=0x7fbc6c005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:38.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.575+0000 7fbc71ffb700 1 -- 172.21.15.17:0/1608324865 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c01d070 con 0x7fbc74110a70 2023-07-14T13:30:38.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.575+0000 7fbc71ffb700 1 -- 172.21.15.17:0/1608324865 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc6c00fe90 con 0x7fbc74110a70 2023-07-14T13:30:38.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.575+0000 7fbc71ffb700 1 -- 172.21.15.17:0/1608324865 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c017e60 con 0x7fbc74110a70 2023-07-14T13:30:38.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.576+0000 7fbc73fff700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc74074a40 0x7fbc7419c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:30:38.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.577+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/1608324865 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc741a1810 con 0x7fbc74110a70 2023-07-14T13:30:38.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.577+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/1608324865 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc741a1a60 con 0x7fbc74110a70 2023-07-14T13:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.585+0000 7fbc8de07b80 1 Processor -- start 2023-07-14T13:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.587+0000 7fbc8de07b80 1 -- start start 2023-07-14T13:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.587+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 0x55937ba0dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.587+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937ba0e2a0 0x55937ba08050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.587+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 0x55937ba085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.587+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937b8fcc50 con 0x55937ba0e710 2023-07-14T13:30:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.587+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937b94f9e0 con 0x55937b8536b0 2023-07-14T13:30:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.587+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937b948e70 con 0x55937ba0e2a0 2023-07-14T13:30:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.588+0000 7fbc6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 0x55937ba0dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.588+0000 7fbc6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 0x55937ba0dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59250/0 (socket says 172.21.15.17:59250) 2023-07-14T13:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.588+0000 7fbc6b7fe700 1 -- 172.21.15.17:0/2085758530 learned_addr learned my addr 172.21.15.17:0/2085758530 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.589+0000 7fbc6b7fe700 1 -- 172.21.15.17:0/2085758530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937ba0e2a0 msgr2=0x55937ba08050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.589+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/2085758530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937ba0e2a0 0x55937ba08050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.589+0000 7fbc6b7fe700 1 -- 172.21.15.17:0/2085758530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 msgr2=0x55937ba085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.589+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/2085758530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 0x55937ba085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.589+0000 7fbc6b7fe700 1 -- 172.21.15.17:0/2085758530 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55937b776d80 con 0x55937b8536b0 2023-07-14T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.590+0000 7fbc71ffb700 1 -- 172.21.15.17:0/1608324865 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fbc6c00fa00 con 0x7fbc74110a70 2023-07-14T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.590+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/2085758530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 0x55937ba0dd60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009d50 tx=0x7fbc5c0336d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b9f1efe28e08f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.592+0000 7fbc71ffb700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc600a14d0 0x7fbc600a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.593+0000 7fbc71ffb700 1 -- 172.21.15.17:0/1608324865 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbc6c0ce230 con 0x7fbc74110a70 2023-07-14T13:30:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.594+0000 7fbc6a7fc700 1 -- 172.21.15.17:0/2085758530 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c038070 con 0x55937b8536b0 2023-07-14T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.594+0000 7fbc6a7fc700 1 -- 172.21.15.17:0/2085758530 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc5c033c60 con 0x55937b8536b0 2023-07-14T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.594+0000 7fbc6a7fc700 1 -- 172.21.15.17:0/2085758530 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c031db0 con 0x55937b8536b0 2023-07-14T13:30:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.594+0000 7fbc73fff700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc600a14d0 0x7fbc600a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.595+0000 7fbc8de07b80 1 -- 172.21.15.17:0/2085758530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 msgr2=0x55937ba0dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.595+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/2085758530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 0x55937ba0dd60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009d50 tx=0x7fbc5c0336d0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.595+0000 7fbc8de07b80 1 -- 172.21.15.17:0/2085758530 shutdown_connections 2023-07-14T13:30:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.595+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/2085758530 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 0x55937ba085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.595+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/2085758530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 0x55937ba0dd60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.595+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/2085758530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937ba0e2a0 0x55937ba08050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.595+0000 7fbc8de07b80 1 -- 172.21.15.17:0/2085758530 >> 172.21.15.17:0/2085758530 conn(0x55937b9ecbe0 msgr2=0x55937b9f1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.596+0000 7fbc8de07b80 1 -- 172.21.15.17:0/2085758530 shutdown_connections 2023-07-14T13:30:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.596+0000 7fbc8de07b80 1 -- 172.21.15.17:0/2085758530 wait complete. 2023-07-14T13:30:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.597+0000 7fbc8de07b80 1 -- start start 2023-07-14T13:30:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.598+0000 7fbc8de07b80 1 Processor -- start 2023-07-14T13:30:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.598+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937b8536b0 0x55937b9ff130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.598+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e2a0 0x55937b9ff670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.598+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e710 0x55937b9fa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.598+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937b8e8a60 con 0x55937ba0e2a0 2023-07-14T13:30:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.598+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937b8e8760 con 0x55937ba0e710 2023-07-14T13:30:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.598+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937b7cc8c0 con 0x55937b8536b0 2023-07-14T13:30:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.599+0000 7fbc8de07b80 10 client.0 _ll_register_callbacks cb 0x55937b8e6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:30:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.602+0000 7fbc7899c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e710 0x55937b9fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.602+0000 7fbc7899c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e710 0x55937b9fa400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59258/0 (socket says 172.21.15.17:59258) 2023-07-14T13:30:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.602+0000 7fbc7899c700 1 -- 172.21.15.17:0/1225092686 learned_addr learned my addr 172.21.15.17:0/1225092686 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.602+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e2a0 0x55937b9ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.603+0000 7fbc7899c700 1 -- 172.21.15.17:0/1225092686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937b8536b0 msgr2=0x55937b9ff130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:30:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.603+0000 7fbc7899c700 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937b8536b0 0x55937b9ff130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.603+0000 7fbc7899c700 1 -- 172.21.15.17:0/1225092686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e2a0 msgr2=0x55937b9ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.603+0000 7fbc7899c700 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e2a0 0x55937b9ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.603+0000 7fbc7899c700 1 -- 172.21.15.17:0/1225092686 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c009a30 con 0x55937ba0e710 2023-07-14T13:30:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.603+0000 7fbc7899c700 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e710 0x55937b9fa400 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c097dc0 tx=0x7fbc6c09af90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e15f83b30604640e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.603+0000 7fbc537fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:30:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.603+0000 7fbc537fe700 1 -- 172.21.15.17:0/1225092686 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c029340 con 0x55937ba0e710 2023-07-14T13:30:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.603+0000 7fbc537fe700 1 -- 172.21.15.17:0/1225092686 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbc6c00fcb0 con 0x55937ba0e710 2023-07-14T13:30:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.603+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1225092686 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55937b8a2490 con 0x55937ba0e710 2023-07-14T13:30:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.604+0000 7fbc537fe700 1 -- 172.21.15.17:0/1225092686 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc6c09b350 con 0x55937ba0e710 2023-07-14T13:30:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.604+0000 7fbc73fff700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc600a14d0 0x7fbc600a3980 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbc64007fd0 tx=0x7fbc64009040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.605+0000 7fbc8de07b80 10 client.29513 fetch_fsmap learned FSMap version 68 2023-07-14T13:30:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.605+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1225092686 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55937b75fc00 con 0x55937ba0e710 2023-07-14T13:30:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.605+0000 7fbc537fe700 1 -- 172.21.15.17:0/1225092686 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55937b8a2490 con 0x55937ba0e710 2023-07-14T13:30:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.605+0000 7fbc537fe700 1 -- 172.21.15.17:0/1225092686 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fbc6c09a840 con 0x55937ba0e710 2023-07-14T13:30:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.605+0000 7fbc8de07b80 10 client.29513 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:30:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.605+0000 7fbc8de07b80 10 client.29513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:30:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.605+0000 7fbc8de07b80 20 client.29513 populate_metadata read hostname 'smithi017' 2023-07-14T13:30:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.605+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55937ba08010 0x55937ba23e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.605+0000 7fbc8de07b80 4 client.29513 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:30:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.605+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1225092686 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55937b941e50 con 0x55937ba08010 2023-07-14T13:30:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.607+0000 7fbc73fff700 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55937ba08010 0x55937ba23e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.613 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.608+0000 7fbc73fff700 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55937ba08010 0x55937ba23e50 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f241ed4dc394059 server_cookie=e6f87c93eb977dd6 in_seq=0 out_seq=0 2023-07-14T13:30:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.608+0000 7fbc537fe700 10 client.29513 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.609+0000 7fbc537fe700 1 -- 172.21.15.17:0/1225092686 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55937b941e50 con 0x55937ba08010 2023-07-14T13:30:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.609+0000 7fbc537fe700 10 client.29513 handle_command_reply: tid=0 2023-07-14T13:30:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.609+0000 7fbc8de07b80 1 client.29513 shutdown 2023-07-14T13:30:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.610+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1225092686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e710 msgr2=0x55937b9fa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.610+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e710 0x55937b9fa400 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c097dc0 tx=0x7fbc6c09af90 comp rx=0 tx=0).stop 2023-07-14T13:30:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.610+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1225092686 shutdown_connections 2023-07-14T13:30:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.610+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55937ba08010 0x55937ba23e50 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.610+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e710 0x55937b9fa400 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.610+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937b8536b0 0x55937b9ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.610+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1225092686 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e2a0 0x55937b9ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.610+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1225092686 >> 172.21.15.17:0/1225092686 conn(0x55937b9ecbe0 msgr2=0x55937b9f14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.610+0000 7fbc537fe700 0 client.29513 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.610+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1225092686 shutdown_connections 2023-07-14T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.611+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1225092686 wait complete. 2023-07-14T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.612+0000 7fbc8de07b80 20 client.29513 trim_cache size 0 max 16384 2023-07-14T13:30:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.642+0000 7fbc8de07b80 1 Processor -- start 2023-07-14T13:30:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.642+0000 7fbc8de07b80 1 -- start start 2023-07-14T13:30:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.643+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 0x55937ba06c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.643+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937ba0e2a0 0x55937b9f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.643+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 0x55937b9f9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.643+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937ba08b80 con 0x55937ba0e710 2023-07-14T13:30:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.643+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937b9fb9e0 con 0x55937b8536b0 2023-07-14T13:30:38.646 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.643+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937ba0d9b0 con 0x55937ba0e2a0 2023-07-14T13:30:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.643+0000 7fbc73fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 0x55937ba06c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.643+0000 7fbc73fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 0x55937ba06c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59264/0 (socket says 172.21.15.17:59264) 2023-07-14T13:30:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.643+0000 7fbc73fff700 1 -- 172.21.15.17:0/3363822063 learned_addr learned my addr 172.21.15.17:0/3363822063 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.644+0000 7fbc7899c700 1 --2- 172.21.15.17:0/3363822063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 0x55937b9f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.644+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/3363822063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937ba0e2a0 0x55937b9f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.644+0000 7fbc6b7fe700 1 -- 172.21.15.17:0/3363822063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 msgr2=0x55937ba06c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.644+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/3363822063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 0x55937ba06c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.644+0000 7fbc6b7fe700 1 -- 172.21.15.17:0/3363822063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 msgr2=0x55937b9f9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.644+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/3363822063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 0x55937b9f9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.644+0000 7fbc6b7fe700 1 -- 172.21.15.17:0/3363822063 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55937b79d1f0 con 0x55937ba0e2a0 2023-07-14T13:30:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.645+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/3363822063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937ba0e2a0 0x55937b9f1c60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55937b9fb9b0 tx=0x7fbc5c035040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c9fe7b999ce8f60 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.645+0000 7fbc6affd700 1 -- 172.21.15.17:0/3363822063 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c038040 con 0x55937ba0e2a0 2023-07-14T13:30:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.645+0000 7fbc6affd700 1 -- 172.21.15.17:0/3363822063 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc5c033dd0 con 0x55937ba0e2a0 2023-07-14T13:30:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.645+0000 7fbc6affd700 1 -- 172.21.15.17:0/3363822063 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c03d420 con 0x55937ba0e2a0 2023-07-14T13:30:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.646+0000 7fbc8de07b80 1 -- 172.21.15.17:0/3363822063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937ba0e2a0 msgr2=0x55937b9f1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.646+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/3363822063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937ba0e2a0 0x55937b9f1c60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55937b9fb9b0 tx=0x7fbc5c035040 comp rx=0 tx=0).stop 2023-07-14T13:30:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.647+0000 7fbc8de07b80 1 -- 172.21.15.17:0/3363822063 shutdown_connections 2023-07-14T13:30:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.647+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/3363822063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 0x55937b9f9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.647+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/3363822063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937b8536b0 0x55937ba06c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.647+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/3363822063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937ba0e2a0 0x55937b9f1c60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.647+0000 7fbc8de07b80 1 -- 172.21.15.17:0/3363822063 >> 172.21.15.17:0/3363822063 conn(0x55937b9ecbe0 msgr2=0x55937ba064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.647+0000 7fbc8de07b80 1 -- 172.21.15.17:0/3363822063 shutdown_connections 2023-07-14T13:30:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.647+0000 7fbc8de07b80 1 -- 172.21.15.17:0/3363822063 wait complete. 2023-07-14T13:30:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.647+0000 7fbc8de07b80 1 -- start start 2023-07-14T13:30:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.648+0000 7fbc8de07b80 1 Processor -- start 2023-07-14T13:30:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.649+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937b8536b0 0x55937ba03be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.649+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e2a0 0x55937ba020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.649+0000 7fbc8de07b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 0x55937ba025f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.649+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937ba02b30 con 0x55937ba0e710 2023-07-14T13:30:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.649+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937ba02ca0 con 0x55937ba0e2a0 2023-07-14T13:30:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.649+0000 7fbc8de07b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55937ba02e60 con 0x55937b8536b0 2023-07-14T13:30:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.649+0000 7fbc8de07b80 10 client.0 _ll_register_callbacks cb 0x7fbc6c097740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:30:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.649+0000 7fbc73fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937b8536b0 0x55937ba03be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.649+0000 7fbc6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e2a0 0x55937ba020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.650+0000 7fbc6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e2a0 0x55937ba020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59274/0 (socket says 172.21.15.17:59274) 2023-07-14T13:30:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.650+0000 7fbc6b7fe700 1 -- 172.21.15.17:0/1353325318 learned_addr learned my addr 172.21.15.17:0/1353325318 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.650+0000 7fbc6b7fe700 1 -- 172.21.15.17:0/1353325318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937b8536b0 msgr2=0x55937ba03be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.650+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/1353325318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937b8536b0 0x55937ba03be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.650+0000 7fbc6b7fe700 1 -- 172.21.15.17:0/1353325318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 msgr2=0x55937ba025f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.650+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/1353325318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 0x55937ba025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.650+0000 7fbc6b7fe700 1 -- 172.21.15.17:0/1353325318 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c041040 con 0x55937ba0e2a0 2023-07-14T13:30:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.651+0000 7fbc6b7fe700 1 --2- 172.21.15.17:0/1353325318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e2a0 0x55937ba020b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c000c00 tx=0x7fbc5c0038b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5af3135e2d2e58b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.651+0000 7fbc537fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:30:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.651+0000 7fbc537fe700 1 -- 172.21.15.17:0/1353325318 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c038070 con 0x55937ba0e2a0 2023-07-14T13:30:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.651+0000 7fbc537fe700 1 -- 172.21.15.17:0/1353325318 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbc5c003d40 con 0x55937ba0e2a0 2023-07-14T13:30:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.651+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1353325318 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc5c033c60 con 0x55937ba0e2a0 2023-07-14T13:30:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.652+0000 7fbc537fe700 1 -- 172.21.15.17:0/1353325318 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc5c005110 con 0x55937ba0e2a0 2023-07-14T13:30:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.652+0000 7fbc8de07b80 10 client.29519 fetch_fsmap learned FSMap version 68 2023-07-14T13:30:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.652+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1353325318 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55937b775250 con 0x55937ba0e2a0 2023-07-14T13:30:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.653+0000 7fbc537fe700 1 -- 172.21.15.17:0/1353325318 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc5c033c60 con 0x55937ba0e2a0 2023-07-14T13:30:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.653+0000 7fbc537fe700 1 -- 172.21.15.17:0/1353325318 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fbc5c046c90 con 0x55937ba0e2a0 2023-07-14T13:30:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.653+0000 7fbc8de07b80 10 client.29519 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:30:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.653+0000 7fbc8de07b80 10 client.29519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:30:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.653+0000 7fbc8de07b80 20 client.29519 populate_metadata read hostname 'smithi017' 2023-07-14T13:30:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.653+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1353325318 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55937ba767b0 0x55937ba78bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.653+0000 7fbc8de07b80 4 client.29519 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:30:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.653+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1353325318 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55937b903ff0 con 0x55937ba767b0 2023-07-14T13:30:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.654+0000 7fbc73fff700 1 --2- 172.21.15.17:0/1353325318 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55937ba767b0 0x55937ba78bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.655+0000 7fbc73fff700 1 --2- 172.21.15.17:0/1353325318 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55937ba767b0 0x55937ba78bc0 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4d951a6db9d8a81 server_cookie=8c990cb4f5c0a715 in_seq=0 out_seq=0 2023-07-14T13:30:38.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.655+0000 7fbc537fe700 10 client.29519 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.671+0000 7fbc537fe700 1 -- 172.21.15.17:0/1353325318 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55937b903ff0 con 0x55937ba767b0 2023-07-14T13:30:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.671+0000 7fbc537fe700 10 client.29519 handle_command_reply: tid=0 2023-07-14T13:30:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.671+0000 7fbc8de07b80 1 client.29519 shutdown 2023-07-14T13:30:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.672+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1353325318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e2a0 msgr2=0x55937ba020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:38.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.672+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1353325318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e2a0 0x55937ba020b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c000c00 tx=0x7fbc5c0038b0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.672+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1353325318 shutdown_connections 2023-07-14T13:30:38.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.672+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1353325318 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55937ba767b0 0x55937ba78bc0 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.672+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1353325318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55937ba0e710 0x55937ba025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.672+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1353325318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937b8536b0 0x55937ba03be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.672+0000 7fbc8de07b80 1 --2- 172.21.15.17:0/1353325318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55937ba0e2a0 0x55937ba020b0 secure :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c000c00 tx=0x7fbc5c0038b0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.672+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1353325318 >> 172.21.15.17:0/1353325318 conn(0x55937b9ecbe0 msgr2=0x55937b9f6030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:38.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.672+0000 7fbc537fe700 0 client.29519 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:38.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.672+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1353325318 shutdown_connections 2023-07-14T13:30:38.680 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.679+0000 7fbc8de07b80 1 -- 172.21.15.17:0/1353325318 wait complete. 2023-07-14T13:30:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.682+0000 7fbc8de07b80 20 client.29519 trim_cache size 0 max 16384 2023-07-14T13:30:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:30:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:30:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:30:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:30:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.683+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/1608324865 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc600a14d0 msgr2=0x7fbc600a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.683+0000 7fbc7a3ff700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc600a14d0 0x7fbc600a3980 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbc64007fd0 tx=0x7fbc64009040 comp rx=0 tx=0).stop 2023-07-14T13:30:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.683+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/1608324865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc74110a70 msgr2=0x7fbc741a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.683+0000 7fbc7a3ff700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc74110a70 0x7fbc741a0c20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0098e0 tx=0x7fbc6c005720 comp rx=0 tx=0).stop 2023-07-14T13:30:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.684+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/1608324865 shutdown_connections 2023-07-14T13:30:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.684+0000 7fbc7a3ff700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc600a14d0 0x7fbc600a3980 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.684+0000 7fbc7a3ff700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc74110a70 0x7fbc741a0c20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.684+0000 7fbc7a3ff700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc74074a40 0x7fbc7419c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.684+0000 7fbc7a3ff700 1 --2- 172.21.15.17:0/1608324865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc74075350 0x7fbc7419c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.684+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/1608324865 >> 172.21.15.17:0/1608324865 conn(0x7fbc740fd8d0 msgr2=0x7fbc740ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.685+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/1608324865 shutdown_connections 2023-07-14T13:30:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:38.685+0000 7fbc7a3ff700 1 -- 172.21.15.17:0/1608324865 wait complete. 2023-07-14T13:30:39.966 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:39 smithi131 ceph-mon[96953]: pgmap v980: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.26k op/s 2023-07-14T13:30:40.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:39 smithi017 ceph-mon[95536]: pgmap v980: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.26k op/s 2023-07-14T13:30:40.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:39 smithi135 ceph-mon[97338]: pgmap v980: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.26k op/s 2023-07-14T13:30:42.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:41 smithi017 ceph-mon[95536]: pgmap v981: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 17 MiB/s wr, 1.91k op/s 2023-07-14T13:30:42.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:41 smithi135 ceph-mon[97338]: pgmap v981: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 17 MiB/s wr, 1.91k op/s 2023-07-14T13:30:42.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:41 smithi131 ceph-mon[96953]: pgmap v981: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 17 MiB/s wr, 1.91k op/s 2023-07-14T13:30:42.419 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 750.0 s, 485.4 tps, lat 211.359 ms stddev 63.834 2023-07-14T13:30:44.081 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:43 smithi017 ceph-mon[95536]: pgmap v982: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.27k op/s 2023-07-14T13:30:44.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:43 smithi135 ceph-mon[97338]: pgmap v982: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.27k op/s 2023-07-14T13:30:44.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:43 smithi131 ceph-mon[96953]: pgmap v982: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.27k op/s 2023-07-14T13:30:46.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:45 smithi017 ceph-mon[95536]: pgmap v983: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.27k op/s 2023-07-14T13:30:46.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:45 smithi135 ceph-mon[97338]: pgmap v983: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.27k op/s 2023-07-14T13:30:46.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:45 smithi131 ceph-mon[96953]: pgmap v983: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.27k op/s 2023-07-14T13:30:47.422 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 755.0 s, 587.2 tps, lat 170.469 ms stddev 53.943 2023-07-14T13:30:48.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:47 smithi017 ceph-mon[95536]: pgmap v984: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 17 MiB/s wr, 1.93k op/s 2023-07-14T13:30:48.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:47 smithi135 ceph-mon[97338]: pgmap v984: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 17 MiB/s wr, 1.93k op/s 2023-07-14T13:30:48.221 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:47 smithi131 ceph-mon[96953]: pgmap v984: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 17 MiB/s wr, 1.93k op/s 2023-07-14T13:30:50.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:49 smithi017 ceph-mon[95536]: pgmap v985: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 12 MiB/s wr, 1.31k op/s 2023-07-14T13:30:50.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:49 smithi135 ceph-mon[97338]: pgmap v985: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 12 MiB/s wr, 1.31k op/s 2023-07-14T13:30:50.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:49 smithi131 ceph-mon[96953]: pgmap v985: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 12 MiB/s wr, 1.31k op/s 2023-07-14T13:30:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.961+0000 7f1ff75ff700 1 -- 172.21.15.17:0/2177951185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff01109e0 msgr2=0x7f1ff0112dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.961+0000 7f1ff75ff700 1 --2- 172.21.15.17:0/2177951185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff01109e0 0x7f1ff0112dc0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009f90 tx=0x7f1fe800b330 comp rx=0 tx=0).stop 2023-07-14T13:30:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.961+0000 7f1ff75ff700 1 -- 172.21.15.17:0/2177951185 shutdown_connections 2023-07-14T13:30:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.961+0000 7f1ff75ff700 1 --2- 172.21.15.17:0/2177951185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff01109e0 0x7f1ff0112dc0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.961+0000 7f1ff75ff700 1 --2- 172.21.15.17:0/2177951185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ff0074a40 0x7f1ff0074e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.961+0000 7f1ff75ff700 1 --2- 172.21.15.17:0/2177951185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ff0075350 0x7f1ff01104a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.961+0000 7f1ff75ff700 1 -- 172.21.15.17:0/2177951185 >> 172.21.15.17:0/2177951185 conn(0x7f1ff00fd800 msgr2=0x7f1ff00ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.962+0000 7f1ff75ff700 1 -- 172.21.15.17:0/2177951185 shutdown_connections 2023-07-14T13:30:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.963+0000 7f1ff75ff700 1 -- 172.21.15.17:0/2177951185 wait complete. 2023-07-14T13:30:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.965+0000 7f1ff75ff700 1 Processor -- start 2023-07-14T13:30:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.965+0000 7f1ff75ff700 1 -- start start 2023-07-14T13:30:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.966+0000 7f1ff75ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ff0074a40 0x7f1ff0071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.966+0000 7f1ff75ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ff0075350 0x7f1ff006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.966+0000 7f1ff75ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff01109e0 0x7f1ff006afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.966+0000 7f1ff75ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff006b520 con 0x7f1ff01109e0 2023-07-14T13:30:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.966+0000 7f1ff75ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff006b690 con 0x7f1ff0075350 2023-07-14T13:30:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.966+0000 7f1ff75ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff006b850 con 0x7f1ff0074a40 2023-07-14T13:30:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.967+0000 7f1ff539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ff0074a40 0x7f1ff0071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.967+0000 7f1ff5b9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff01109e0 0x7f1ff006afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.967+0000 7f1ff539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ff0074a40 0x7f1ff0071ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41426/0 (socket says 172.21.15.17:41426) 2023-07-14T13:30:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.967+0000 7f1ff539b700 1 -- 172.21.15.17:0/1271887916 learned_addr learned my addr 172.21.15.17:0/1271887916 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:51.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.967+0000 7f1ff4b9a700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ff0075350 0x7f1ff006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:51.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.968+0000 7f1ff5b9c700 1 -- 172.21.15.17:0/1271887916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ff0074a40 msgr2=0x7f1ff0071ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:51.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.968+0000 7f1ff5b9c700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ff0074a40 0x7f1ff0071ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.968+0000 7f1ff5b9c700 1 -- 172.21.15.17:0/1271887916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ff0075350 msgr2=0x7f1ff006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:51.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.968+0000 7f1ff5b9c700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ff0075350 0x7f1ff006aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.969 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.968+0000 7f1ff5b9c700 1 -- 172.21.15.17:0/1271887916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe0009520 con 0x7f1ff01109e0 2023-07-14T13:30:51.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.968+0000 7f1ff5b9c700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff01109e0 0x7f1ff006afe0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800b6c0 tx=0x7f1fe8008d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.971+0000 7f1fe67fc700 1 -- 172.21.15.17:0/1271887916 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800e040 con 0x7f1ff01109e0 2023-07-14T13:30:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.971+0000 7f1fe67fc700 1 -- 172.21.15.17:0/1271887916 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fe8004e30 con 0x7f1ff01109e0 2023-07-14T13:30:51.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.971+0000 7f1fe67fc700 1 -- 172.21.15.17:0/1271887916 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80052a0 con 0x7f1ff01109e0 2023-07-14T13:30:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.971+0000 7f1ff75ff700 1 -- 172.21.15.17:0/1271887916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe8009c40 con 0x7f1ff01109e0 2023-07-14T13:30:51.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.971+0000 7f1ff75ff700 1 -- 172.21.15.17:0/1271887916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff006fad0 con 0x7f1ff01109e0 2023-07-14T13:30:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.981+0000 7f200af9eb80 1 Processor -- start 2023-07-14T13:30:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.982+0000 7f1fe67fc700 1 -- 172.21.15.17:0/1271887916 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f1fe801d470 con 0x7f1ff01109e0 2023-07-14T13:30:51.987 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.982+0000 7f200af9eb80 1 -- start start 2023-07-14T13:30:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.983+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1d2f6b0 0x5635e1ee4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.983+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1ee4780 0x5635e1ee89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.983+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1ee8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:51.988 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.983+0000 7f200af9eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1dd8c50 con 0x5635e1d2f6b0 2023-07-14T13:30:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.983+0000 7f200af9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1e2b9e0 con 0x5635e1ee4bf0 2023-07-14T13:30:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.983+0000 7f200af9eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1e24e70 con 0x5635e1ee4780 2023-07-14T13:30:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.984+0000 7f1ff539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1ee4780 0x5635e1ee89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:51.989 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.984+0000 7f1ff539b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1ee4780 0x5635e1ee89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41428/0 (socket says 172.21.15.17:41428) 2023-07-14T13:30:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.984+0000 7f1ff539b700 1 -- 172.21.15.17:0/1207057761 learned_addr learned my addr 172.21.15.17:0/1207057761 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.985+0000 7f1ff539b700 1 -- 172.21.15.17:0/1207057761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 msgr2=0x5635e1ee8ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:30:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.985+0000 7f1ff539b700 1 --2- 172.21.15.17:0/1207057761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1ee8ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.985+0000 7f1ff539b700 1 -- 172.21.15.17:0/1207057761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1d2f6b0 msgr2=0x5635e1ee4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.985+0000 7f1ff539b700 1 --2- 172.21.15.17:0/1207057761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1d2f6b0 0x5635e1ee4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.985+0000 7f1ff539b700 1 -- 172.21.15.17:0/1207057761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635e1c52d80 con 0x5635e1ee4780 2023-07-14T13:30:51.990 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.985+0000 7f1ff539b700 1 --2- 172.21.15.17:0/1207057761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1ee4780 0x5635e1ee89a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009d90 tx=0x7f1fec0336d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2613e60eb07a960c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.985+0000 7f1fe67fc700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1fdc0a1410 0x7f1fdc0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.986+0000 7f1fdb7fe700 1 -- 172.21.15.17:0/1207057761 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec03c640 con 0x5635e1ee4780 2023-07-14T13:30:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.986+0000 7f1fe67fc700 1 -- 172.21.15.17:0/1271887916 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1fe80ce110 con 0x7f1ff01109e0 2023-07-14T13:30:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.986+0000 7f1fdb7fe700 1 -- 172.21.15.17:0/1207057761 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fec0318e0 con 0x5635e1ee4780 2023-07-14T13:30:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.986+0000 7f1fdb7fe700 1 -- 172.21.15.17:0/1207057761 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec03b880 con 0x5635e1ee4780 2023-07-14T13:30:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.987+0000 7f1ff4b9a700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1fdc0a1410 0x7f1fdc0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:51.991 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.987+0000 7f200af9eb80 1 -- 172.21.15.17:0/1207057761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1ee4780 msgr2=0x5635e1ee89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.987+0000 7f200af9eb80 1 --2- 172.21.15.17:0/1207057761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1ee4780 0x5635e1ee89a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009d90 tx=0x7f1fec0336d0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.987+0000 7f200af9eb80 1 -- 172.21.15.17:0/1207057761 shutdown_connections 2023-07-14T13:30:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.987+0000 7f200af9eb80 1 --2- 172.21.15.17:0/1207057761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1ee8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.987+0000 7f200af9eb80 1 --2- 172.21.15.17:0/1207057761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1d2f6b0 0x5635e1ee4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.987+0000 7f200af9eb80 1 --2- 172.21.15.17:0/1207057761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1ee4780 0x5635e1ee89a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.987+0000 7f200af9eb80 1 -- 172.21.15.17:0/1207057761 >> 172.21.15.17:0/1207057761 conn(0x5635e1ec8be0 msgr2=0x5635e1ecdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.988+0000 7f200af9eb80 1 -- 172.21.15.17:0/1207057761 shutdown_connections 2023-07-14T13:30:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.988+0000 7f200af9eb80 1 -- 172.21.15.17:0/1207057761 wait complete. 2023-07-14T13:30:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.988+0000 7f1ff4b9a700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1fdc0a1410 0x7f1fdc0a38c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ff006c4a0 tx=0x7f1fe0009450 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.988+0000 7f200af9eb80 1 -- start start 2023-07-14T13:30:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.989+0000 7f200af9eb80 1 Processor -- start 2023-07-14T13:30:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.990+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1d2f6b0 0x5635e1edab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.990+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4780 0x5635e1edb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.990+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1ed5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.990+0000 7f200af9eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1dc4a60 con 0x5635e1ee4780 2023-07-14T13:30:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.990+0000 7f200af9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1dc4760 con 0x5635e1ee4bf0 2023-07-14T13:30:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.990+0000 7f200af9eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1ca88c0 con 0x5635e1d2f6b0 2023-07-14T13:30:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.990+0000 7f200af9eb80 10 client.0 _ll_register_callbacks cb 0x5635e1dc2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:30:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.990+0000 7f1ff4b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4780 0x5635e1edb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.990+0000 7f1ff4b9a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4780 0x5635e1edb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46224/0 (socket says 172.21.15.17:46224) 2023-07-14T13:30:51.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.990+0000 7f1ff4b9a700 1 -- 172.21.15.17:0/1574921242 learned_addr learned my addr 172.21.15.17:0/1574921242 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:51.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.991+0000 7f1ff5b9c700 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1ed5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:51.996 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.991+0000 7f1ff539b700 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1d2f6b0 0x5635e1edab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:51.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.991+0000 7f1ff4b9a700 1 -- 172.21.15.17:0/1574921242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1d2f6b0 msgr2=0x5635e1edab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:51.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.991+0000 7f1ff4b9a700 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1d2f6b0 0x5635e1edab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.991+0000 7f1ff4b9a700 1 -- 172.21.15.17:0/1574921242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 msgr2=0x5635e1ed5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:51.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.991+0000 7f1ff4b9a700 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1ed5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:51.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.991+0000 7f1ff4b9a700 1 -- 172.21.15.17:0/1574921242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec0099c0 con 0x5635e1ee4780 2023-07-14T13:30:51.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.991+0000 7f1ff5b9c700 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1ed5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:30:51.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.992+0000 7f1ff4b9a700 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4780 0x5635e1edb040 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0011740 tx=0x7f1fe0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ed749c915114f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:51.997 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.992+0000 7f1fd8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:30:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.995+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/1574921242 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe001e830 con 0x5635e1ee4780 2023-07-14T13:30:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.995+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/1574921242 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1fe0017070 con 0x5635e1ee4780 2023-07-14T13:30:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.995+0000 7f200af9eb80 1 -- 172.21.15.17:0/1574921242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5635e1d7e490 con 0x5635e1ee4780 2023-07-14T13:30:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.997+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/1574921242 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fe001e990 con 0x5635e1ee4780 2023-07-14T13:30:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.997+0000 7f200af9eb80 10 client.19740 fetch_fsmap learned FSMap version 68 2023-07-14T13:30:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.997+0000 7f200af9eb80 1 -- 172.21.15.17:0/1574921242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5635e1c3bc00 con 0x5635e1ee4780 2023-07-14T13:30:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.998+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/1574921242 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5635e1d7e490 con 0x5635e1ee4780 2023-07-14T13:30:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.998+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/1574921242 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1fe0005080 con 0x5635e1ee4780 2023-07-14T13:30:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.999+0000 7f200af9eb80 10 client.19740 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:30:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.999+0000 7f200af9eb80 10 client.19740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:30:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.999+0000 7f200af9eb80 20 client.19740 populate_metadata read hostname 'smithi017' 2023-07-14T13:30:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.999+0000 7f200af9eb80 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635e1eecea0 0x5635e1eef280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.999+0000 7f200af9eb80 4 client.19740 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:30:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:51.999+0000 7f200af9eb80 1 -- 172.21.15.17:0/1574921242 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635e1e1de50 con 0x5635e1eecea0 2023-07-14T13:30:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.001+0000 7f1ff539b700 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635e1eecea0 0x5635e1eef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:52.003 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.003+0000 7f1ff539b700 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635e1eecea0 0x5635e1eef280 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c74a7d8739c7baef server_cookie=3467c89a41a7c537 in_seq=0 out_seq=0 2023-07-14T13:30:52.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.004+0000 7f1fd8ff9700 10 client.19740 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:52.004 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.005+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/1574921242 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5635e1e1de50 con 0x5635e1eecea0 2023-07-14T13:30:52.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.005+0000 7f1fd8ff9700 10 client.19740 handle_command_reply: tid=0 2023-07-14T13:30:52.005 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.005+0000 7f200af9eb80 1 client.19740 shutdown 2023-07-14T13:30:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.008+0000 7f200af9eb80 1 -- 172.21.15.17:0/1574921242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4780 msgr2=0x5635e1edb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.008+0000 7f200af9eb80 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4780 0x5635e1edb040 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0011740 tx=0x7f1fe0009260 comp rx=0 tx=0).stop 2023-07-14T13:30:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.015+0000 7f200af9eb80 1 -- 172.21.15.17:0/1574921242 shutdown_connections 2023-07-14T13:30:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.015+0000 7f200af9eb80 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635e1eecea0 0x5635e1eef280 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.015+0000 7f200af9eb80 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1ed5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.015+0000 7f200af9eb80 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1d2f6b0 0x5635e1edab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.015+0000 7f200af9eb80 1 --2- 172.21.15.17:0/1574921242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4780 0x5635e1edb040 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.015+0000 7f200af9eb80 1 -- 172.21.15.17:0/1574921242 >> 172.21.15.17:0/1574921242 conn(0x5635e1ec8be0 msgr2=0x5635e1ecd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.015+0000 7f1fd8ff9700 0 client.19740 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.018+0000 7f200af9eb80 1 -- 172.21.15.17:0/1574921242 shutdown_connections 2023-07-14T13:30:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.018+0000 7f200af9eb80 1 -- 172.21.15.17:0/1574921242 wait complete. 2023-07-14T13:30:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.018+0000 7f200af9eb80 20 client.19740 trim_cache size 0 max 16384 2023-07-14T13:30:52.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.054+0000 7f200af9eb80 1 Processor -- start 2023-07-14T13:30:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.055+0000 7f200af9eb80 1 -- start start 2023-07-14T13:30:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.055+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1d2f6b0 0x5635e1edf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.055+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1ee4780 0x5635e1ee8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.055+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4bf0 0x5635e1ee67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.055+0000 7f200af9eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1ee3700 con 0x5635e1ee4bf0 2023-07-14T13:30:52.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.055+0000 7f200af9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1e99060 con 0x5635e1d2f6b0 2023-07-14T13:30:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.055+0000 7f200af9eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1ecee30 con 0x5635e1ee4780 2023-07-14T13:30:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.056+0000 7f1ff539b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1d2f6b0 0x5635e1edf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.056+0000 7f1ff539b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1d2f6b0 0x5635e1edf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52410/0 (socket says 172.21.15.17:52410) 2023-07-14T13:30:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.056+0000 7f1ff539b700 1 -- 172.21.15.17:0/2108831645 learned_addr learned my addr 172.21.15.17:0/2108831645 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:52.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.056+0000 7f1ff539b700 1 -- 172.21.15.17:0/2108831645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1ee4780 msgr2=0x5635e1ee8c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:30:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.056+0000 7f1ff539b700 1 --2- 172.21.15.17:0/2108831645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1ee4780 0x5635e1ee8c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.056+0000 7f1ff539b700 1 -- 172.21.15.17:0/2108831645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4bf0 msgr2=0x5635e1ee67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.056+0000 7f1ff539b700 1 --2- 172.21.15.17:0/2108831645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4bf0 0x5635e1ee67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.056+0000 7f1ff539b700 1 -- 172.21.15.17:0/2108831645 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635e1c791f0 con 0x5635e1d2f6b0 2023-07-14T13:30:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.058+0000 7f1ff539b700 1 --2- 172.21.15.17:0/2108831645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1d2f6b0 0x5635e1edf790 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1fec03c000 tx=0x7f1fec005950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e0644f4c31a62ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.059+0000 7f1fdbfff700 1 -- 172.21.15.17:0/2108831645 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec031b10 con 0x5635e1d2f6b0 2023-07-14T13:30:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.059+0000 7f1fdbfff700 1 -- 172.21.15.17:0/2108831645 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fec031c70 con 0x5635e1d2f6b0 2023-07-14T13:30:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.059+0000 7f1fdbfff700 1 -- 172.21.15.17:0/2108831645 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec04c5f0 con 0x5635e1d2f6b0 2023-07-14T13:30:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.061+0000 7f200af9eb80 1 -- 172.21.15.17:0/2108831645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1d2f6b0 msgr2=0x5635e1edf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.061+0000 7f200af9eb80 1 --2- 172.21.15.17:0/2108831645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1d2f6b0 0x5635e1edf790 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1fec03c000 tx=0x7f1fec005950 comp rx=0 tx=0).stop 2023-07-14T13:30:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.065+0000 7f200af9eb80 1 -- 172.21.15.17:0/2108831645 shutdown_connections 2023-07-14T13:30:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.065+0000 7f200af9eb80 1 --2- 172.21.15.17:0/2108831645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4bf0 0x5635e1ee67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.065+0000 7f200af9eb80 1 --2- 172.21.15.17:0/2108831645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1d2f6b0 0x5635e1edf790 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.065+0000 7f200af9eb80 1 --2- 172.21.15.17:0/2108831645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1ee4780 0x5635e1ee8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.065+0000 7f200af9eb80 1 -- 172.21.15.17:0/2108831645 >> 172.21.15.17:0/2108831645 conn(0x5635e1ec8be0 msgr2=0x5635e1ee8500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:52.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.066+0000 7f200af9eb80 1 -- 172.21.15.17:0/2108831645 shutdown_connections 2023-07-14T13:30:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.067+0000 7f200af9eb80 1 -- 172.21.15.17:0/2108831645 wait complete. 2023-07-14T13:30:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.067+0000 7f200af9eb80 1 -- start start 2023-07-14T13:30:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.068+0000 7f200af9eb80 1 Processor -- start 2023-07-14T13:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.068+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1d2f6b0 0x5635e1edf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.068+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4780 0x5635e1edd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.068+0000 7f200af9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1eddd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.068+0000 7f200af9eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1ede270 con 0x5635e1ee4780 2023-07-14T13:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.068+0000 7f200af9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1ede3e0 con 0x5635e1ee4bf0 2023-07-14T13:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.068+0000 7f200af9eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e1ede5a0 con 0x5635e1d2f6b0 2023-07-14T13:30:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.068+0000 7f200af9eb80 10 client.0 _ll_register_callbacks cb 0x7f1fe0010ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:30:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.069+0000 7f1ff5b9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1eddd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.069+0000 7f1ff5b9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1eddd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52416/0 (socket says 172.21.15.17:52416) 2023-07-14T13:30:52.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.069+0000 7f1ff5b9c700 1 -- 172.21.15.17:0/2665514904 learned_addr learned my addr 172.21.15.17:0/2665514904 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.072+0000 7f1ff539b700 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1d2f6b0 0x5635e1edf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.072+0000 7f1ff5b9c700 1 -- 172.21.15.17:0/2665514904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1d2f6b0 msgr2=0x5635e1edf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.072+0000 7f1ff5b9c700 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1d2f6b0 0x5635e1edf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.072+0000 7f1ff5b9c700 1 -- 172.21.15.17:0/2665514904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4780 msgr2=0x5635e1edd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.072+0000 7f1ff5b9c700 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4780 0x5635e1edd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.072+0000 7f1ff5b9c700 1 -- 172.21.15.17:0/2665514904 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec040040 con 0x5635e1ee4bf0 2023-07-14T13:30:52.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:51 smithi017 ceph-mon[95536]: pgmap v986: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 18 MiB/s wr, 1.98k op/s 2023-07-14T13:30:52.078 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.079+0000 7f1ff5b9c700 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1eddd30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80cbe80 tx=0x7f1fe809ae80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51d8993bff0759e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:30:52.079 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.079+0000 7f1fd8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:30:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.083+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/2665514904 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8095ea0 con 0x5635e1ee4bf0 2023-07-14T13:30:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.083+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/2665514904 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1fe809f2c0 con 0x5635e1ee4bf0 2023-07-14T13:30:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.083+0000 7f200af9eb80 1 -- 172.21.15.17:0/2665514904 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1fec0318e0 con 0x5635e1ee4bf0 2023-07-14T13:30:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.089+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/2665514904 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fe80a3650 con 0x5635e1ee4bf0 2023-07-14T13:30:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.089+0000 7f200af9eb80 10 client.29534 fetch_fsmap learned FSMap version 68 2023-07-14T13:30:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.089+0000 7f200af9eb80 1 -- 172.21.15.17:0/2665514904 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5635e1c51250 con 0x5635e1ee4bf0 2023-07-14T13:30:52.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.090+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/2665514904 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fec0318e0 con 0x5635e1ee4bf0 2023-07-14T13:30:52.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.090+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/2665514904 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1fe80b3d00 con 0x5635e1ee4bf0 2023-07-14T13:30:52.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.090+0000 7f200af9eb80 10 client.29534 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:30:52.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.090+0000 7f200af9eb80 10 client.29534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:30:52.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.090+0000 7f200af9eb80 20 client.29534 populate_metadata read hostname 'smithi017' 2023-07-14T13:30:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.090+0000 7f200af9eb80 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635e1f41c50 0x5635e1f44060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:30:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.090+0000 7f200af9eb80 4 client.29534 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:30:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.090+0000 7f200af9eb80 1 -- 172.21.15.17:0/2665514904 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5635e1ddfff0 con 0x5635e1f41c50 2023-07-14T13:30:52.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.091+0000 7f1ff539b700 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635e1f41c50 0x5635e1f44060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:30:52.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.092+0000 7f1ff539b700 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635e1f41c50 0x5635e1f44060 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=713b5d8f9c0b365f server_cookie=5830f6928c576a8 in_seq=0 out_seq=0 2023-07-14T13:30:52.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.092+0000 7f1fd8ff9700 10 client.29534 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:52.129 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.129+0000 7f1fd8ff9700 1 -- 172.21.15.17:0/2665514904 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5635e1ddfff0 con 0x5635e1f41c50 2023-07-14T13:30:52.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.129+0000 7f1fd8ff9700 10 client.29534 handle_command_reply: tid=0 2023-07-14T13:30:52.130 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.129+0000 7f200af9eb80 1 client.29534 shutdown 2023-07-14T13:30:52.131 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.129+0000 7f200af9eb80 1 -- 172.21.15.17:0/2665514904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 msgr2=0x5635e1eddd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.129+0000 7f200af9eb80 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1eddd30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80cbe80 tx=0x7f1fe809ae80 comp rx=0 tx=0).stop 2023-07-14T13:30:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.130+0000 7f200af9eb80 1 -- 172.21.15.17:0/2665514904 shutdown_connections 2023-07-14T13:30:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.130+0000 7f200af9eb80 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5635e1f41c50 0x5635e1f44060 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.130+0000 7f200af9eb80 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5635e1ee4bf0 0x5635e1eddd30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.130+0000 7f200af9eb80 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5635e1d2f6b0 0x5635e1edf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.130+0000 7f200af9eb80 1 --2- 172.21.15.17:0/2665514904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5635e1ee4780 0x5635e1edd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.130+0000 7f200af9eb80 1 -- 172.21.15.17:0/2665514904 >> 172.21.15.17:0/2665514904 conn(0x5635e1ec8be0 msgr2=0x5635e1ee8500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.130+0000 7f1fd8ff9700 0 client.29534 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:30:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.130+0000 7f200af9eb80 1 -- 172.21.15.17:0/2665514904 shutdown_connections 2023-07-14T13:30:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.130+0000 7f200af9eb80 1 -- 172.21.15.17:0/2665514904 wait complete. 2023-07-14T13:30:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.131+0000 7f200af9eb80 20 client.29534 trim_cache size 0 max 16384 2023-07-14T13:30:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:30:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:30:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:30:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:30:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.132+0000 7f1ff75ff700 1 -- 172.21.15.17:0/1271887916 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1fdc0a1410 msgr2=0x7f1fdc0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.132+0000 7f1ff75ff700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1fdc0a1410 0x7f1fdc0a38c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ff006c4a0 tx=0x7f1fe0009450 comp rx=0 tx=0).stop 2023-07-14T13:30:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.132+0000 7f1ff75ff700 1 -- 172.21.15.17:0/1271887916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff01109e0 msgr2=0x7f1ff006afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:30:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.132+0000 7f1ff75ff700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff01109e0 0x7f1ff006afe0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800b6c0 tx=0x7f1fe8008d50 comp rx=0 tx=0).stop 2023-07-14T13:30:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.133+0000 7f1ff75ff700 1 -- 172.21.15.17:0/1271887916 shutdown_connections 2023-07-14T13:30:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.133+0000 7f1ff75ff700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f1fdc0a1410 0x7f1fdc0a38c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.133+0000 7f1ff75ff700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ff01109e0 0x7f1ff006afe0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.133+0000 7f1ff75ff700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ff0074a40 0x7f1ff0071ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.133+0000 7f1ff75ff700 1 --2- 172.21.15.17:0/1271887916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ff0075350 0x7f1ff006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:30:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.133+0000 7f1ff75ff700 1 -- 172.21.15.17:0/1271887916 >> 172.21.15.17:0/1271887916 conn(0x7f1ff00fd800 msgr2=0x7f1ff00ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:30:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.133+0000 7f1ff75ff700 1 -- 172.21.15.17:0/1271887916 shutdown_connections 2023-07-14T13:30:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:30:52.134+0000 7f1ff75ff700 1 -- 172.21.15.17:0/1271887916 wait complete. 2023-07-14T13:30:52.171 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:51 smithi135 ceph-mon[97338]: pgmap v986: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 18 MiB/s wr, 1.98k op/s 2023-07-14T13:30:52.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:51 smithi131 ceph-mon[96953]: pgmap v986: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 18 MiB/s wr, 1.98k op/s 2023-07-14T13:30:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 760.0 s, 577.9 tps, lat 170.293 ms stddev 50.931 2023-07-14T13:30:54.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:53 smithi017 ceph-mon[95536]: pgmap v987: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:30:54.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:53 smithi135 ceph-mon[97338]: pgmap v987: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:30:54.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:53 smithi131 ceph-mon[96953]: pgmap v987: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:30:56.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:55 smithi017 ceph-mon[95536]: pgmap v988: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:30:56.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:55 smithi135 ceph-mon[97338]: pgmap v988: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:30:56.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:55 smithi131 ceph-mon[96953]: pgmap v988: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:30:57.419 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 765.0 s, 543.2 tps, lat 186.445 ms stddev 53.440 2023-07-14T13:30:57.966 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:57 smithi131 ceph-mon[96953]: pgmap v989: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 18 MiB/s wr, 1.99k op/s 2023-07-14T13:30:58.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:57 smithi017 ceph-mon[95536]: pgmap v989: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 18 MiB/s wr, 1.99k op/s 2023-07-14T13:30:58.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:57 smithi135 ceph-mon[97338]: pgmap v989: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 18 MiB/s wr, 1.99k op/s 2023-07-14T13:30:59.966 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:30:59 smithi131 ceph-mon[96953]: pgmap v990: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:31:00.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:30:59 smithi017 ceph-mon[95536]: pgmap v990: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:31:00.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:30:59 smithi135 ceph-mon[97338]: pgmap v990: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:31:02.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:01 smithi017 ceph-mon[95536]: pgmap v991: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 18 MiB/s wr, 1.96k op/s 2023-07-14T13:31:02.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:01 smithi135 ceph-mon[97338]: pgmap v991: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 18 MiB/s wr, 1.96k op/s 2023-07-14T13:31:02.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:01 smithi131 ceph-mon[96953]: pgmap v991: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 18 MiB/s wr, 1.96k op/s 2023-07-14T13:31:02.427 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 770.0 s, 459.0 tps, lat 209.635 ms stddev 120.486 2023-07-14T13:31:04.078 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:03 smithi017 ceph-mon[95536]: pgmap v992: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-14T13:31:04.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:03 smithi135 ceph-mon[97338]: pgmap v992: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-14T13:31:04.219 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:03 smithi131 ceph-mon[96953]: pgmap v992: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-14T13:31:05.469 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.470+0000 7fa4d97ff700 1 -- 172.21.15.17:0/20221565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d406c910 msgr2=0x7fa4d406cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:05.470 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.470+0000 7fa4d97ff700 1 --2- 172.21.15.17:0/20221565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d406c910 0x7fa4d406cd80 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009990 tx=0x7fa4c8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.477 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.476+0000 7fa4d97ff700 1 -- 172.21.15.17:0/20221565 shutdown_connections 2023-07-14T13:31:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.476+0000 7fa4d97ff700 1 --2- 172.21.15.17:0/20221565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d406d3a0 0x7fa4d411b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.476+0000 7fa4d97ff700 1 --2- 172.21.15.17:0/20221565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d410e2a0 0x7fa4d410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.478 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.476+0000 7fa4d97ff700 1 --2- 172.21.15.17:0/20221565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d406c910 0x7fa4d406cd80 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.479 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.476+0000 7fa4d97ff700 1 -- 172.21.15.17:0/20221565 >> 172.21.15.17:0/20221565 conn(0x7fa4d406bd70 msgr2=0x7fa4d4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:05.480 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.480+0000 7fa4d97ff700 1 -- 172.21.15.17:0/20221565 shutdown_connections 2023-07-14T13:31:05.484 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.484+0000 7fa4d97ff700 1 -- 172.21.15.17:0/20221565 wait complete. 2023-07-14T13:31:05.485 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.486+0000 7fa4d97ff700 1 Processor -- start 2023-07-14T13:31:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.487+0000 7fa4d97ff700 1 -- start start 2023-07-14T13:31:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.487+0000 7fa4d97ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d406c910 0x7fa4d411ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.487+0000 7fa4d97ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d406d3a0 0x7fa4d411b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.487+0000 7fa4d97ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d410e2a0 0x7fa4d4113cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.487+0000 7fa4d97ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4114440 con 0x7fa4d410e2a0 2023-07-14T13:31:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.487+0000 7fa4d97ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d41145b0 con 0x7fa4d406d3a0 2023-07-14T13:31:05.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.487+0000 7fa4d97ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d4114770 con 0x7fa4d406c910 2023-07-14T13:31:05.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.490+0000 7fa4d27fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d406d3a0 0x7fa4d411b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.490+0000 7fa4d2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d406c910 0x7fa4d411ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.490+0000 7fa4d2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d406c910 0x7fa4d411ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:34752/0 (socket says 172.21.15.17:34752) 2023-07-14T13:31:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.490+0000 7fa4d2ffd700 1 -- 172.21.15.17:0/1693147788 learned_addr learned my addr 172.21.15.17:0/1693147788 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:05.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.492+0000 7fa4d37fe700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d410e2a0 0x7fa4d4113cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.500+0000 7fa4d27fc700 1 -- 172.21.15.17:0/1693147788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d406c910 msgr2=0x7fa4d411ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.500+0000 7fa4d27fc700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d406c910 0x7fa4d411ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.500+0000 7fa4d27fc700 1 -- 172.21.15.17:0/1693147788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d410e2a0 msgr2=0x7fa4d4113cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.500+0000 7fa4d27fc700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d410e2a0 0x7fa4d4113cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.500+0000 7fa4d27fc700 1 -- 172.21.15.17:0/1693147788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c80095f0 con 0x7fa4d406d3a0 2023-07-14T13:31:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.505+0000 7fa4d27fc700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d406d3a0 0x7fa4d411b370 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800b5c0 tx=0x7fa4c8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.517+0000 7fa4bbfff700 1 -- 172.21.15.17:0/1693147788 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c801d070 con 0x7fa4d406d3a0 2023-07-14T13:31:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.517+0000 7fa4bbfff700 1 -- 172.21.15.17:0/1693147788 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4c8003ec0 con 0x7fa4d406d3a0 2023-07-14T13:31:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.517+0000 7fa4bbfff700 1 -- 172.21.15.17:0/1693147788 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800faa0 con 0x7fa4d406d3a0 2023-07-14T13:31:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.517+0000 7fa4d97ff700 1 -- 172.21.15.17:0/1693147788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d41149f0 con 0x7fa4d406d3a0 2023-07-14T13:31:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.517+0000 7fa4d97ff700 1 -- 172.21.15.17:0/1693147788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d4118b90 con 0x7fa4d406d3a0 2023-07-14T13:31:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.538+0000 7fa4ed21eb80 1 Processor -- start 2023-07-14T13:31:05.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.541+0000 7fa4bbfff700 1 -- 172.21.15.17:0/1693147788 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa4c8004030 con 0x7fa4d406d3a0 2023-07-14T13:31:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.542+0000 7fa4ed21eb80 1 -- start start 2023-07-14T13:31:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.542+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c67d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.542+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c682d0 0x55aa75c62040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.542 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.542+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 0x55aa75c629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.542+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75b67c50 con 0x55aa75c62580 2023-07-14T13:31:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.542+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75bba9e0 con 0x55aa75abe6b0 2023-07-14T13:31:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.542+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75bb3e70 con 0x55aa75c682d0 2023-07-14T13:31:05.543 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.543+0000 7fa4d37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c67d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.543+0000 7fa4d37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c67d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60784/0 (socket says 172.21.15.17:60784) 2023-07-14T13:31:05.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.543+0000 7fa4d37fe700 1 -- 172.21.15.17:0/220959999 learned_addr learned my addr 172.21.15.17:0/220959999 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:05.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.543+0000 7fa4d2ffd700 1 --2- 172.21.15.17:0/220959999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c682d0 0x55aa75c62040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.544 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.544+0000 7fa4d27fc700 1 --2- 172.21.15.17:0/220959999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 0x55aa75c629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.550+0000 7fa4bbfff700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4bc0a14d0 0x7fa4bc0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.551+0000 7fa4bbfff700 1 -- 172.21.15.17:0/1693147788 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fa4c80cd630 con 0x7fa4d406d3a0 2023-07-14T13:31:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.551+0000 7fa4d27fc700 1 -- 172.21.15.17:0/220959999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c682d0 msgr2=0x55aa75c62040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:05.551 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.551+0000 7fa4d27fc700 1 --2- 172.21.15.17:0/220959999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c682d0 0x55aa75c62040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.551+0000 7fa4d27fc700 1 -- 172.21.15.17:0/220959999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 msgr2=0x55aa75c67d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.551+0000 7fa4d27fc700 1 --2- 172.21.15.17:0/220959999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c67d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.551+0000 7fa4d27fc700 1 -- 172.21.15.17:0/220959999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa759e1d80 con 0x55aa75c62580 2023-07-14T13:31:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.551+0000 7fa4d37fe700 1 --2- 172.21.15.17:0/220959999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c67d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:31:05.553 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.552+0000 7fa4d27fc700 1 --2- 172.21.15.17:0/220959999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 0x55aa75c629d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80cad10 tx=0x7fa4c8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecc4b9911bedf1f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:05.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.553+0000 7fa4b97fa700 1 -- 172.21.15.17:0/220959999 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c809a260 con 0x55aa75c62580 2023-07-14T13:31:05.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.553+0000 7fa4b97fa700 1 -- 172.21.15.17:0/220959999 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4c809a080 con 0x55aa75c62580 2023-07-14T13:31:05.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.553+0000 7fa4b97fa700 1 -- 172.21.15.17:0/220959999 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c80a2ae0 con 0x55aa75c62580 2023-07-14T13:31:05.554 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.554+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/220959999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 msgr2=0x55aa75c629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:05.555 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.554+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/220959999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 0x55aa75c629d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80cad10 tx=0x7fa4c8009310 comp rx=0 tx=0).stop 2023-07-14T13:31:05.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.559+0000 7fa4d37fe700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4bc0a14d0 0x7fa4bc0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.573+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/220959999 shutdown_connections 2023-07-14T13:31:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.573+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/220959999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 0x55aa75c629d0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.573+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/220959999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c67d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.573+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/220959999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c682d0 0x55aa75c62040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.573+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/220959999 >> 172.21.15.17:0/220959999 conn(0x55aa75c57be0 msgr2=0x55aa75c5cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:05.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.574+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/220959999 shutdown_connections 2023-07-14T13:31:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.576+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/220959999 wait complete. 2023-07-14T13:31:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.577+0000 7fa4ed21eb80 1 -- start start 2023-07-14T13:31:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.577+0000 7fa4ed21eb80 1 Processor -- start 2023-07-14T13:31:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.577+0000 7fa4d37fe700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4bc0a14d0 0x7fa4bc0a3980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009550 tx=0x7fa4cc00b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:05.582 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.578+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c71350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.578+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 0x55aa75c71890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.578+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c682d0 0x55aa75c6b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.578+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75b53a60 con 0x55aa75c62580 2023-07-14T13:31:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.578+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75b53760 con 0x55aa75abe6b0 2023-07-14T13:31:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.578+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75a378c0 con 0x55aa75c682d0 2023-07-14T13:31:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.578+0000 7fa4ed21eb80 10 client.0 _ll_register_callbacks cb 0x55aa75b51700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:31:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.579+0000 7fa4d27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 0x55aa75c71890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.583 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.579+0000 7fa4d27fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 0x55aa75c71890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60976/0 (socket says 172.21.15.17:60976) 2023-07-14T13:31:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.579+0000 7fa4d27fc700 1 -- 172.21.15.17:0/2834359707 learned_addr learned my addr 172.21.15.17:0/2834359707 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.580+0000 7fa4d27fc700 1 -- 172.21.15.17:0/2834359707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c682d0 msgr2=0x55aa75c6b610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:31:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.580+0000 7fa4d27fc700 1 --2- 172.21.15.17:0/2834359707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c682d0 0x55aa75c6b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.580+0000 7fa4d27fc700 1 -- 172.21.15.17:0/2834359707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 msgr2=0x55aa75c71350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.580+0000 7fa4d27fc700 1 --2- 172.21.15.17:0/2834359707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c71350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.580+0000 7fa4d27fc700 1 -- 172.21.15.17:0/2834359707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d4118b90 con 0x55aa75c62580 2023-07-14T13:31:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.581+0000 7fa4d27fc700 1 --2- 172.21.15.17:0/2834359707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 0x55aa75c71890 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80042e0 tx=0x7fa4c8096b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e51bf7c58b6edb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.581+0000 7fa4b6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:31:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.581+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2834359707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c809ab80 con 0x55aa75c62580 2023-07-14T13:31:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.581+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2834359707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fa4c80a2ae0 con 0x55aa75c62580 2023-07-14T13:31:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.582+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2834359707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa75b0d490 con 0x55aa75c62580 2023-07-14T13:31:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.582+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2834359707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4c809a720 con 0x55aa75c62580 2023-07-14T13:31:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.585+0000 7fa4ed21eb80 10 client.19752 fetch_fsmap learned FSMap version 68 2023-07-14T13:31:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.585+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2834359707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55aa759cac00 con 0x55aa75c62580 2023-07-14T13:31:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.587+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2834359707 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aa75b0d490 con 0x55aa75c62580 2023-07-14T13:31:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.587+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2834359707 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa4c80a2650 con 0x55aa75c62580 2023-07-14T13:31:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.588+0000 7fa4ed21eb80 10 client.19752 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:31:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.588+0000 7fa4ed21eb80 10 client.19752 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:31:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.588+0000 7fa4ed21eb80 20 client.19752 populate_metadata read hostname 'smithi017' 2023-07-14T13:31:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.588+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2834359707 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aa75c7b350 0x55aa75c7d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.588+0000 7fa4ed21eb80 4 client.19752 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:31:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.588+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2834359707 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa75bace50 con 0x55aa75c7b350 2023-07-14T13:31:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.592+0000 7fa4d2ffd700 1 --2- 172.21.15.17:0/2834359707 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aa75c7b350 0x55aa75c7d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.604+0000 7fa4d2ffd700 1 --2- 172.21.15.17:0/2834359707 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aa75c7b350 0x55aa75c7d760 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcc31254e2c79a62 server_cookie=9307a6c96a91b51b in_seq=0 out_seq=0 2023-07-14T13:31:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.604+0000 7fa4b6ff5700 10 client.19752 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.607+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2834359707 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55aa75bace50 con 0x55aa75c7b350 2023-07-14T13:31:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.607+0000 7fa4b6ff5700 10 client.19752 handle_command_reply: tid=0 2023-07-14T13:31:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.607+0000 7fa4ed21eb80 1 client.19752 shutdown 2023-07-14T13:31:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.607+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2834359707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 msgr2=0x55aa75c71890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.607+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2834359707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 0x55aa75c71890 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80042e0 tx=0x7fa4c8096b90 comp rx=0 tx=0).stop 2023-07-14T13:31:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.618+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2834359707 shutdown_connections 2023-07-14T13:31:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.618+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2834359707 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aa75c7b350 0x55aa75c7d760 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.618+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2834359707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c682d0 0x55aa75c6b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.618+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2834359707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c71350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.618+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2834359707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c62580 0x55aa75c71890 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.618+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2834359707 >> 172.21.15.17:0/2834359707 conn(0x55aa75c57be0 msgr2=0x55aa75c5c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.619+0000 7fa4b6ff5700 0 client.19752 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.619+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2834359707 shutdown_connections 2023-07-14T13:31:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.619+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2834359707 wait complete. 2023-07-14T13:31:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.620+0000 7fa4ed21eb80 20 client.19752 trim_cache size 0 max 16384 2023-07-14T13:31:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.657+0000 7fa4ed21eb80 1 Processor -- start 2023-07-14T13:31:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.657+0000 7fa4ed21eb80 1 -- start start 2023-07-14T13:31:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.658+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c62040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.658+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c62580 0x55aa75c71850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.658+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 0x55aa75c6add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.658+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75c62fd0 con 0x55aa75c682d0 2023-07-14T13:31:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.658+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75c5ea70 con 0x55aa75abe6b0 2023-07-14T13:31:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.658+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75c69b70 con 0x55aa75c62580 2023-07-14T13:31:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.659+0000 7fa4d27fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c62580 0x55aa75c71850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.661+0000 7fa4d2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c62040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.661+0000 7fa4d2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c62040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:60796/0 (socket says 172.21.15.17:60796) 2023-07-14T13:31:05.661 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.661+0000 7fa4d2ffd700 1 -- 172.21.15.17:0/432470416 learned_addr learned my addr 172.21.15.17:0/432470416 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.662+0000 7fa4d37fe700 1 --2- 172.21.15.17:0/432470416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 0x55aa75c6add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.662+0000 7fa4d37fe700 1 -- 172.21.15.17:0/432470416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c62580 msgr2=0x55aa75c71850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.662+0000 7fa4d37fe700 1 --2- 172.21.15.17:0/432470416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c62580 0x55aa75c71850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.662+0000 7fa4d37fe700 1 -- 172.21.15.17:0/432470416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 msgr2=0x55aa75c62040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.662+0000 7fa4d37fe700 1 --2- 172.21.15.17:0/432470416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c62040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.663+0000 7fa4d37fe700 1 -- 172.21.15.17:0/432470416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa75a081f0 con 0x55aa75c682d0 2023-07-14T13:31:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.663+0000 7fa4d37fe700 1 --2- 172.21.15.17:0/432470416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 0x55aa75c6add0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc004320 tx=0x7fa4cc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e161ef3843cf3fe server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.665+0000 7fa4b9ffb700 1 -- 172.21.15.17:0/432470416 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc009e80 con 0x55aa75c682d0 2023-07-14T13:31:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.665+0000 7fa4b9ffb700 1 -- 172.21.15.17:0/432470416 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4cc00f040 con 0x55aa75c682d0 2023-07-14T13:31:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.665+0000 7fa4b9ffb700 1 -- 172.21.15.17:0/432470416 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0226a0 con 0x55aa75c682d0 2023-07-14T13:31:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.666+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/432470416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 msgr2=0x55aa75c6add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.666+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/432470416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 0x55aa75c6add0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc004320 tx=0x7fa4cc015000 comp rx=0 tx=0).stop 2023-07-14T13:31:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.666+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/432470416 shutdown_connections 2023-07-14T13:31:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.666+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/432470416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 0x55aa75c6add0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.666+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/432470416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75abe6b0 0x55aa75c62040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.666+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/432470416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75c62580 0x55aa75c71850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.666+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/432470416 >> 172.21.15.17:0/432470416 conn(0x55aa75c57be0 msgr2=0x55aa75c71140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.667+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/432470416 shutdown_connections 2023-07-14T13:31:05.667 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.667+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/432470416 wait complete. 2023-07-14T13:31:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.668+0000 7fa4ed21eb80 1 -- start start 2023-07-14T13:31:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.668+0000 7fa4ed21eb80 1 Processor -- start 2023-07-14T13:31:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.669+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75abe6b0 0x55aa75c74270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.669+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75c62580 0x55aa75c747b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.669+0000 7fa4ed21eb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 0x55aa75cce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.669+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75c74e70 con 0x55aa75c682d0 2023-07-14T13:31:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.669+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75cce740 con 0x55aa75c62580 2023-07-14T13:31:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.669+0000 7fa4ed21eb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa75cce880 con 0x55aa75abe6b0 2023-07-14T13:31:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.669+0000 7fa4ed21eb80 10 client.0 _ll_register_callbacks cb 0x55aa75b51700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:31:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.670+0000 7fa4d37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 0x55aa75cce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.670+0000 7fa4d37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 0x55aa75cce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60994/0 (socket says 172.21.15.17:60994) 2023-07-14T13:31:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.671+0000 7fa4d37fe700 1 -- 172.21.15.17:0/2670338893 learned_addr learned my addr 172.21.15.17:0/2670338893 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:05.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.671+0000 7fa4d27fc700 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75c62580 0x55aa75c747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.671 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.672+0000 7fa4d2ffd700 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75abe6b0 0x55aa75c74270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.672+0000 7fa4d37fe700 1 -- 172.21.15.17:0/2670338893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75abe6b0 msgr2=0x55aa75c74270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.672+0000 7fa4d37fe700 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75abe6b0 0x55aa75c74270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.672+0000 7fa4d37fe700 1 -- 172.21.15.17:0/2670338893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75c62580 msgr2=0x55aa75c747b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.672+0000 7fa4d37fe700 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75c62580 0x55aa75c747b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.672+0000 7fa4d37fe700 1 -- 172.21.15.17:0/2670338893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc004530 con 0x55aa75c682d0 2023-07-14T13:31:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.673+0000 7fa4d37fe700 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 0x55aa75cce200 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc017c40 tx=0x7fa4cc009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0001f65901d5946 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.673+0000 7fa4b6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:31:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.674+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2670338893 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc017890 con 0x55aa75c682d0 2023-07-14T13:31:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.674+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2670338893 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fa4cc022440 con 0x55aa75c682d0 2023-07-14T13:31:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.674+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2670338893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4c809a080 con 0x55aa75c682d0 2023-07-14T13:31:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.674+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2670338893 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4cc022600 con 0x55aa75c682d0 2023-07-14T13:31:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.679+0000 7fa4ed21eb80 10 client.19758 fetch_fsmap learned FSMap version 68 2023-07-14T13:31:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.679+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2670338893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55aa759e0250 con 0x55aa75c682d0 2023-07-14T13:31:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.695+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2670338893 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4c809a080 con 0x55aa75c682d0 2023-07-14T13:31:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.695+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2670338893 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa4cc03d830 con 0x55aa75c682d0 2023-07-14T13:31:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.696+0000 7fa4ed21eb80 10 client.19758 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:31:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.696+0000 7fa4ed21eb80 10 client.19758 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:31:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.696+0000 7fa4ed21eb80 20 client.19758 populate_metadata read hostname 'smithi017' 2023-07-14T13:31:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.696+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aa75ccfe70 0x55aa75cd2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.696+0000 7fa4ed21eb80 4 client.19758 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:31:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.696+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2670338893 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aa75b6eff0 con 0x55aa75ccfe70 2023-07-14T13:31:05.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.703+0000 7fa4d2ffd700 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aa75ccfe70 0x55aa75cd2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.716+0000 7fa4d2ffd700 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aa75ccfe70 0x55aa75cd2280 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dee84fa35010d74 server_cookie=91b16b6ae7432eeb in_seq=0 out_seq=0 2023-07-14T13:31:05.717 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:05.718+0000 7fa4b6ff5700 10 client.19758 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:06.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:05 smithi017 ceph-mon[95536]: pgmap v993: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-14T13:31:06.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:05 smithi017 ceph-mon[95536]: osdmap e140: 12 total, 12 up, 12 in 2023-07-14T13:31:06.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:05 smithi135 ceph-mon[97338]: pgmap v993: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-14T13:31:06.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:05 smithi135 ceph-mon[97338]: osdmap e140: 12 total, 12 up, 12 in 2023-07-14T13:31:06.221 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:05 smithi131 ceph-mon[96953]: pgmap v993: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-14T13:31:06.221 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:05 smithi131 ceph-mon[96953]: osdmap e140: 12 total, 12 up, 12 in 2023-07-14T13:31:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.271+0000 7fa4b6ff5700 1 -- 172.21.15.17:0/2670338893 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aa75b6eff0 con 0x55aa75ccfe70 2023-07-14T13:31:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.271+0000 7fa4b6ff5700 10 client.19758 handle_command_reply: tid=0 2023-07-14T13:31:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.271+0000 7fa4ed21eb80 1 client.19758 shutdown 2023-07-14T13:31:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.275+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2670338893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 msgr2=0x55aa75cce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.275+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 0x55aa75cce200 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc017c40 tx=0x7fa4cc009e80 comp rx=0 tx=0).stop 2023-07-14T13:31:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.286+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2670338893 shutdown_connections 2023-07-14T13:31:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.286+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55aa75ccfe70 0x55aa75cd2280 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.286+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55aa75c682d0 0x55aa75cce200 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.286+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aa75abe6b0 0x55aa75c74270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.286+0000 7fa4ed21eb80 1 --2- 172.21.15.17:0/2670338893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa75c62580 0x55aa75c747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.286+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2670338893 >> 172.21.15.17:0/2670338893 conn(0x55aa75c57be0 msgr2=0x55aa75c686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.286+0000 7fa4b6ff5700 0 client.19758 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.295+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2670338893 shutdown_connections 2023-07-14T13:31:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.296+0000 7fa4ed21eb80 1 -- 172.21.15.17:0/2670338893 wait complete. 2023-07-14T13:31:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.297+0000 7fa4ed21eb80 20 client.19758 trim_cache size 0 max 16384 2023-07-14T13:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:31:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:31:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.298+0000 7fa4d97ff700 1 -- 172.21.15.17:0/1693147788 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4bc0a14d0 msgr2=0x7fa4bc0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.298+0000 7fa4d97ff700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4bc0a14d0 0x7fa4bc0a3980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009550 tx=0x7fa4cc00b040 comp rx=0 tx=0).stop 2023-07-14T13:31:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.298+0000 7fa4d97ff700 1 -- 172.21.15.17:0/1693147788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d406d3a0 msgr2=0x7fa4d411b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.298+0000 7fa4d97ff700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d406d3a0 0x7fa4d411b370 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800b5c0 tx=0x7fa4c8005740 comp rx=0 tx=0).stop 2023-07-14T13:31:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.298+0000 7fa4d97ff700 1 -- 172.21.15.17:0/1693147788 shutdown_connections 2023-07-14T13:31:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.298+0000 7fa4d97ff700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4bc0a14d0 0x7fa4bc0a3980 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.298+0000 7fa4d97ff700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d410e2a0 0x7fa4d4113cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.298+0000 7fa4d97ff700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d406c910 0x7fa4d411ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.298+0000 7fa4d97ff700 1 --2- 172.21.15.17:0/1693147788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d406d3a0 0x7fa4d411b370 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.298+0000 7fa4d97ff700 1 -- 172.21.15.17:0/1693147788 >> 172.21.15.17:0/1693147788 conn(0x7fa4d406bd70 msgr2=0x7fa4d40707e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.308+0000 7fa4d97ff700 1 -- 172.21.15.17:0/1693147788 shutdown_connections 2023-07-14T13:31:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:06.308+0000 7fa4d97ff700 1 -- 172.21.15.17:0/1693147788 wait complete. 2023-07-14T13:31:07.418 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 775.0 s, 236.6 tps, lat 411.387 ms stddev 210.834 2023-07-14T13:31:08.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:07 smithi135 ceph-mon[97338]: pgmap v995: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2023-07-14T13:31:08.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:07 smithi131 ceph-mon[96953]: pgmap v995: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2023-07-14T13:31:08.329 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:07 smithi017 ceph-mon[95536]: pgmap v995: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2023-07-14T13:31:09.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:08 smithi135 ceph-mon[97338]: pgmap v996: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2023-07-14T13:31:09.220 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:08 smithi131 ceph-mon[96953]: pgmap v996: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2023-07-14T13:31:09.326 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:08 smithi017 ceph-mon[95536]: pgmap v996: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2023-07-14T13:31:11.921 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:11 smithi135 ceph-mon[97338]: pgmap v997: 97 pgs: 12 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 63 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 765 op/s 2023-07-14T13:31:11.968 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:11 smithi131 ceph-mon[96953]: pgmap v997: 97 pgs: 12 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 63 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 765 op/s 2023-07-14T13:31:12.080 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:11 smithi017 ceph-mon[95536]: pgmap v997: 97 pgs: 12 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 63 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.0 MiB/s wr, 765 op/s 2023-07-14T13:31:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 780.0 s, 197.0 tps, lat 521.706 ms stddev 219.494 2023-07-14T13:31:13.966 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:13 smithi131 ceph-mon[96953]: pgmap v998: 97 pgs: 12 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 63 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 795 op/s 2023-07-14T13:31:14.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:13 smithi017 ceph-mon[95536]: pgmap v998: 97 pgs: 12 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 63 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 795 op/s 2023-07-14T13:31:14.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:13 smithi135 ceph-mon[97338]: pgmap v998: 97 pgs: 12 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 63 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 795 op/s 2023-07-14T13:31:16.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:15 smithi017 ceph-mon[95536]: pgmap v999: 97 pgs: 12 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 63 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 795 op/s 2023-07-14T13:31:16.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:15 smithi135 ceph-mon[97338]: pgmap v999: 97 pgs: 12 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 63 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 795 op/s 2023-07-14T13:31:16.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:15 smithi131 ceph-mon[96953]: pgmap v999: 97 pgs: 12 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 63 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 795 op/s 2023-07-14T13:31:17.418 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 785.0 s, 444.1 tps, lat 230.227 ms stddev 92.174 2023-07-14T13:31:18.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:17 smithi017 ceph-mon[95536]: pgmap v1000: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-07-14T13:31:18.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:17 smithi135 ceph-mon[97338]: pgmap v1000: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-07-14T13:31:18.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:17 smithi131 ceph-mon[96953]: pgmap v1000: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-07-14T13:31:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.596+0000 7f48629ff700 1 -- 172.21.15.17:0/3373473021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f485c107510 msgr2=0x7f485c10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.596+0000 7f48629ff700 1 --2- 172.21.15.17:0/3373473021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f485c107510 0x7f485c10e570 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4850009990 tx=0x7f4850009ca0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.597+0000 7f48629ff700 1 -- 172.21.15.17:0/3373473021 shutdown_connections 2023-07-14T13:31:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.597+0000 7f48629ff700 1 --2- 172.21.15.17:0/3373473021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c119460 0x7f485c11b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.597+0000 7f48629ff700 1 --2- 172.21.15.17:0/3373473021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f485c107510 0x7f485c10e570 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.597+0000 7f48629ff700 1 --2- 172.21.15.17:0/3373473021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f485c1078e0 0x7f485c107d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.597+0000 7f48629ff700 1 -- 172.21.15.17:0/3373473021 >> 172.21.15.17:0/3373473021 conn(0x7f485c070830 msgr2=0x7f485c06d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.597+0000 7f48629ff700 1 -- 172.21.15.17:0/3373473021 shutdown_connections 2023-07-14T13:31:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.597+0000 7f48629ff700 1 -- 172.21.15.17:0/3373473021 wait complete. 2023-07-14T13:31:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.599+0000 7f48629ff700 1 Processor -- start 2023-07-14T13:31:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.599+0000 7f48629ff700 1 -- start start 2023-07-14T13:31:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f48629ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c107510 0x7f485c1aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f48629ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f485c1078e0 0x7f485c1aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f48629ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f485c119460 0x7f485c1a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f48629ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c1a4e90 con 0x7f485c107510 2023-07-14T13:31:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f48629ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c1a5000 con 0x7f485c1078e0 2023-07-14T13:31:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f48629ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c1a51c0 con 0x7f485c119460 2023-07-14T13:31:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f485b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f485c1078e0 0x7f485c1aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f4860f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f485c119460 0x7f485c1a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f485bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c107510 0x7f485c1aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f4860f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f485c119460 0x7f485c1a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39834/0 (socket says 172.21.15.17:39834) 2023-07-14T13:31:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f4860f9c700 1 -- 172.21.15.17:0/843754650 learned_addr learned my addr 172.21.15.17:0/843754650 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.600+0000 7f485b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f485c1078e0 0x7f485c1aaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:48592/0 (socket says 172.21.15.17:48592) 2023-07-14T13:31:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.601+0000 7f4860f9c700 1 -- 172.21.15.17:0/843754650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f485c1078e0 msgr2=0x7f485c1aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.601+0000 7f4860f9c700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f485c1078e0 0x7f485c1aaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.601+0000 7f4860f9c700 1 -- 172.21.15.17:0/843754650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c107510 msgr2=0x7f485c1aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.601+0000 7f4860f9c700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c107510 0x7f485c1aa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.601+0000 7f4860f9c700 1 -- 172.21.15.17:0/843754650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500095f0 con 0x7f485c119460 2023-07-14T13:31:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.601+0000 7f4860f9c700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f485c119460 0x7f485c1a4820 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4854007ee0 tx=0x7f485400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.602+0000 7f48597fa700 1 -- 172.21.15.17:0/843754650 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854004db0 con 0x7f485c119460 2023-07-14T13:31:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.602+0000 7f48597fa700 1 -- 172.21.15.17:0/843754650 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f485400f040 con 0x7f485c119460 2023-07-14T13:31:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.602+0000 7f48597fa700 1 -- 172.21.15.17:0/843754650 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540057e0 con 0x7f485c119460 2023-07-14T13:31:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.602+0000 7f48629ff700 1 -- 172.21.15.17:0/843754650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c1a54a0 con 0x7f485c119460 2023-07-14T13:31:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.602+0000 7f48629ff700 1 -- 172.21.15.17:0/843754650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c1b19b0 con 0x7f485c119460 2023-07-14T13:31:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.609+0000 7f48762e2b80 1 Processor -- start 2023-07-14T13:31:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.610+0000 7f48762e2b80 1 -- start start 2023-07-14T13:31:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.610+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d623070d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.610+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d6230712d0 0x55d62306b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.610+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d62306b580 0x55d62306b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.610+0000 7f48762e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d622f70c50 con 0x55d6230712d0 2023-07-14T13:31:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.610+0000 7f48762e2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d622fc39e0 con 0x55d622ec76b0 2023-07-14T13:31:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.610+0000 7f48762e2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d622fbce70 con 0x55d62306b580 2023-07-14T13:31:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.611+0000 7f485b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d623070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.611+0000 7f485b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d623070d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:48604/0 (socket says 172.21.15.17:48604) 2023-07-14T13:31:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.611+0000 7f485b7fe700 1 -- 172.21.15.17:0/2973495174 learned_addr learned my addr 172.21.15.17:0/2973495174 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.611+0000 7f485b7fe700 1 --2- 172.21.15.17:0/2973495174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d62306b580 0x55d62306b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.611+0000 7f485b7fe700 1 -- 172.21.15.17:0/2973495174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d62306b580 msgr2=0x55d62306b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.611+0000 7f485b7fe700 1 --2- 172.21.15.17:0/2973495174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d62306b580 0x55d62306b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.611+0000 7f485b7fe700 1 -- 172.21.15.17:0/2973495174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d6230712d0 msgr2=0x55d62306b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.611+0000 7f485b7fe700 1 --2- 172.21.15.17:0/2973495174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d6230712d0 0x55d62306b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.611+0000 7f485b7fe700 1 -- 172.21.15.17:0/2973495174 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d622dead80 con 0x55d622ec76b0 2023-07-14T13:31:19.618 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.612+0000 7f485b7fe700 1 --2- 172.21.15.17:0/2973495174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d623070d90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f484c006b30 tx=0x7f484c009590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa294249ccdb817a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.613+0000 7f48427fc700 1 -- 172.21.15.17:0/2973495174 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c03a460 con 0x55d622ec76b0 2023-07-14T13:31:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.613+0000 7f48427fc700 1 -- 172.21.15.17:0/2973495174 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f484c009aa0 con 0x55d622ec76b0 2023-07-14T13:31:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.613+0000 7f48427fc700 1 -- 172.21.15.17:0/2973495174 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c013820 con 0x55d622ec76b0 2023-07-14T13:31:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.614+0000 7f48597fa700 1 -- 172.21.15.17:0/843754650 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f4854005940 con 0x7f485c119460 2023-07-14T13:31:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.616+0000 7f48762e2b80 1 -- 172.21.15.17:0/2973495174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 msgr2=0x55d623070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.616+0000 7f48762e2b80 1 --2- 172.21.15.17:0/2973495174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d623070d90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f484c006b30 tx=0x7f484c009590 comp rx=0 tx=0).stop 2023-07-14T13:31:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.617+0000 7f48762e2b80 1 -- 172.21.15.17:0/2973495174 shutdown_connections 2023-07-14T13:31:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.617+0000 7f48762e2b80 1 --2- 172.21.15.17:0/2973495174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d62306b580 0x55d62306b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.617+0000 7f48762e2b80 1 --2- 172.21.15.17:0/2973495174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d623070d90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.617+0000 7f48762e2b80 1 --2- 172.21.15.17:0/2973495174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d6230712d0 0x55d62306b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.617+0000 7f48762e2b80 1 -- 172.21.15.17:0/2973495174 >> 172.21.15.17:0/2973495174 conn(0x55d623060be0 msgr2=0x55d623065f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.618+0000 7f48762e2b80 1 -- 172.21.15.17:0/2973495174 shutdown_connections 2023-07-14T13:31:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.618+0000 7f48762e2b80 1 -- 172.21.15.17:0/2973495174 wait complete. 2023-07-14T13:31:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.618+0000 7f48762e2b80 1 -- start start 2023-07-14T13:31:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.619+0000 7f48762e2b80 1 Processor -- start 2023-07-14T13:31:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.620+0000 7f48597fa700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f48440a12d0 0x7f48440a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.620+0000 7f48597fa700 1 -- 172.21.15.17:0/843754650 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f48540cc680 con 0x7f485c119460 2023-07-14T13:31:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.622+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d62307a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.622+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d62306b580 0x55d62307ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.622+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 0x55d623074950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.624 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.622+0000 7f48762e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d622f5ca60 con 0x55d62306b580 2023-07-14T13:31:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.622+0000 7f48762e2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d622f5c760 con 0x55d622ec76b0 2023-07-14T13:31:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.622+0000 7f48762e2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d622e408c0 con 0x55d6230712d0 2023-07-14T13:31:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.622+0000 7f48762e2b80 10 client.0 _ll_register_callbacks cb 0x55d622f5a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:31:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.622+0000 7f485b7fe700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f48440a12d0 0x7f48440a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.623+0000 7f485bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d62307a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.623+0000 7f4860f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 0x55d623074950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.623+0000 7f485bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d62307a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:48618/0 (socket says 172.21.15.17:48618) 2023-07-14T13:31:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.623+0000 7f485bfff700 1 -- 172.21.15.17:0/1565151425 learned_addr learned my addr 172.21.15.17:0/1565151425 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.623+0000 7f485b7fe700 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d62306b580 0x55d62307ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.624+0000 7f485bfff700 1 -- 172.21.15.17:0/1565151425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 msgr2=0x55d623074950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.624+0000 7f485bfff700 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 0x55d623074950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.624+0000 7f485bfff700 1 -- 172.21.15.17:0/1565151425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d62306b580 msgr2=0x55d62307ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.624+0000 7f485bfff700 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d62306b580 0x55d62307ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.624+0000 7f485bfff700 1 -- 172.21.15.17:0/1565151425 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c017460 con 0x55d622ec76b0 2023-07-14T13:31:19.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.625+0000 7f485b7fe700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f48440a12d0 0x7f48440a3780 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f484c009560 tx=0x7f484c009fd0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.627+0000 7f485bfff700 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d62307a6c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4850009990 tx=0x7f4850005c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fbeb4e2c3b1db6d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.627+0000 7f483b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:31:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.630+0000 7f483b7fe700 1 -- 172.21.15.17:0/1565151425 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485001d070 con 0x55d622ec76b0 2023-07-14T13:31:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.630+0000 7f483b7fe700 1 -- 172.21.15.17:0/1565151425 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f48500054d0 con 0x55d622ec76b0 2023-07-14T13:31:19.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.630+0000 7f48762e2b80 1 -- 172.21.15.17:0/1565151425 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d622f16490 con 0x55d622ec76b0 2023-07-14T13:31:19.635 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.635+0000 7f483b7fe700 1 -- 172.21.15.17:0/1565151425 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4850005690 con 0x55d622ec76b0 2023-07-14T13:31:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.637+0000 7f48762e2b80 10 client.29558 fetch_fsmap learned FSMap version 68 2023-07-14T13:31:19.636 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.637+0000 7f48762e2b80 1 -- 172.21.15.17:0/1565151425 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55d622dd3c00 con 0x55d622ec76b0 2023-07-14T13:31:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.638+0000 7f483b7fe700 1 -- 172.21.15.17:0/1565151425 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d622f16490 con 0x55d622ec76b0 2023-07-14T13:31:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.639+0000 7f483b7fe700 1 -- 172.21.15.17:0/1565151425 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f485002a070 con 0x55d622ec76b0 2023-07-14T13:31:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.639+0000 7f48762e2b80 10 client.29558 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:31:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.639+0000 7f48762e2b80 10 client.29558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:31:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.639+0000 7f48762e2b80 20 client.29558 populate_metadata read hostname 'smithi017' 2023-07-14T13:31:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.639+0000 7f48762e2b80 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d623084bc0 0x55d623086fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.639+0000 7f48762e2b80 4 client.29558 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:31:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.639+0000 7f48762e2b80 1 -- 172.21.15.17:0/1565151425 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d622fb5e50 con 0x55d623084bc0 2023-07-14T13:31:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.642+0000 7f485b7fe700 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d623084bc0 0x55d623086fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.643+0000 7f485b7fe700 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d623084bc0 0x55d623086fd0 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab7ee42c017335d2 server_cookie=9da5ef9e7b97cc91 in_seq=0 out_seq=0 2023-07-14T13:31:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.644+0000 7f483b7fe700 10 client.29558 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.645+0000 7f483b7fe700 1 -- 172.21.15.17:0/1565151425 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d622fb5e50 con 0x55d623084bc0 2023-07-14T13:31:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.645+0000 7f483b7fe700 10 client.29558 handle_command_reply: tid=0 2023-07-14T13:31:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.645+0000 7f48762e2b80 1 client.29558 shutdown 2023-07-14T13:31:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.652+0000 7f48762e2b80 1 -- 172.21.15.17:0/1565151425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 msgr2=0x55d62307a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.652+0000 7f48762e2b80 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d62307a6c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4850009990 tx=0x7f4850005c40 comp rx=0 tx=0).stop 2023-07-14T13:31:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.652+0000 7f48762e2b80 1 -- 172.21.15.17:0/1565151425 shutdown_connections 2023-07-14T13:31:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.652+0000 7f48762e2b80 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d623084bc0 0x55d623086fd0 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.652+0000 7f48762e2b80 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 0x55d623074950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.652+0000 7f48762e2b80 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d622ec76b0 0x55d62307a6c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.652+0000 7f48762e2b80 1 --2- 172.21.15.17:0/1565151425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d62306b580 0x55d62307ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.652+0000 7f48762e2b80 1 -- 172.21.15.17:0/1565151425 >> 172.21.15.17:0/1565151425 conn(0x55d623060be0 msgr2=0x55d6230654e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.652+0000 7f483b7fe700 0 client.29558 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.653+0000 7f48762e2b80 1 -- 172.21.15.17:0/1565151425 shutdown_connections 2023-07-14T13:31:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.653+0000 7f48762e2b80 1 -- 172.21.15.17:0/1565151425 wait complete. 2023-07-14T13:31:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.653+0000 7f48762e2b80 20 client.29558 trim_cache size 0 max 16384 2023-07-14T13:31:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.685+0000 7f48762e2b80 1 Processor -- start 2023-07-14T13:31:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.685+0000 7f48762e2b80 1 -- start start 2023-07-14T13:31:19.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.685+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 0x55d62306b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.685+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d62306b580 0x55d623074a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.685+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6230712d0 0x55d623070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.685 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.685+0000 7f48762e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d623082240 con 0x55d622ec76b0 2023-07-14T13:31:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.685+0000 7f48762e2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62305dbb0 con 0x55d6230712d0 2023-07-14T13:31:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.685+0000 7f48762e2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62306bfd0 con 0x55d62306b580 2023-07-14T13:31:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.686+0000 7f485bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 0x55d62306b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.686+0000 7f485bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 0x55d62306b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56492/0 (socket says 172.21.15.17:56492) 2023-07-14T13:31:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.686+0000 7f485bfff700 1 -- 172.21.15.17:0/795059966 learned_addr learned my addr 172.21.15.17:0/795059966 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:19.686 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.686+0000 7f4860f9c700 1 --2- 172.21.15.17:0/795059966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6230712d0 0x55d623070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.686+0000 7f485b7fe700 1 --2- 172.21.15.17:0/795059966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d62306b580 0x55d623074a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.687+0000 7f4860f9c700 1 -- 172.21.15.17:0/795059966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d62306b580 msgr2=0x55d623074a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:19.687 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.687+0000 7f4860f9c700 1 --2- 172.21.15.17:0/795059966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d62306b580 0x55d623074a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.687+0000 7f4860f9c700 1 -- 172.21.15.17:0/795059966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 msgr2=0x55d62306b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.687+0000 7f4860f9c700 1 --2- 172.21.15.17:0/795059966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 0x55d62306b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.687+0000 7f4860f9c700 1 -- 172.21.15.17:0/795059966 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d622e111f0 con 0x55d6230712d0 2023-07-14T13:31:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.687+0000 7f485bfff700 1 --2- 172.21.15.17:0/795059966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 0x55d62306b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:31:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.687+0000 7f4860f9c700 1 --2- 172.21.15.17:0/795059966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6230712d0 0x55d623070240 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f48540c9d60 tx=0x7f4854007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe6115cf363d538c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.687+0000 7f4842ffd700 1 -- 172.21.15.17:0/795059966 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854009e20 con 0x55d6230712d0 2023-07-14T13:31:19.688 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.688+0000 7f4842ffd700 1 -- 172.21.15.17:0/795059966 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4854099640 con 0x55d6230712d0 2023-07-14T13:31:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.688+0000 7f4842ffd700 1 -- 172.21.15.17:0/795059966 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854084310 con 0x55d6230712d0 2023-07-14T13:31:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.688+0000 7f48762e2b80 1 -- 172.21.15.17:0/795059966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6230712d0 msgr2=0x55d623070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.689+0000 7f48762e2b80 1 --2- 172.21.15.17:0/795059966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6230712d0 0x55d623070240 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f48540c9d60 tx=0x7f4854007f90 comp rx=0 tx=0).stop 2023-07-14T13:31:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.689+0000 7f48762e2b80 1 -- 172.21.15.17:0/795059966 shutdown_connections 2023-07-14T13:31:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.689+0000 7f48762e2b80 1 --2- 172.21.15.17:0/795059966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d6230712d0 0x55d623070240 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.689+0000 7f48762e2b80 1 --2- 172.21.15.17:0/795059966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 0x55d62306b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.689+0000 7f48762e2b80 1 --2- 172.21.15.17:0/795059966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d62306b580 0x55d623074a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.689+0000 7f48762e2b80 1 -- 172.21.15.17:0/795059966 >> 172.21.15.17:0/795059966 conn(0x55d623060be0 msgr2=0x55d62306fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.689+0000 7f48762e2b80 1 -- 172.21.15.17:0/795059966 shutdown_connections 2023-07-14T13:31:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.689+0000 7f48762e2b80 1 -- 172.21.15.17:0/795059966 wait complete. 2023-07-14T13:31:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.690+0000 7f48762e2b80 1 -- start start 2023-07-14T13:31:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.690+0000 7f48762e2b80 1 Processor -- start 2023-07-14T13:31:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.691+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 0x55d6230ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.691+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d62306b580 0x55d6230cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.691+0000 7f48762e2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 0x55d6230d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.691+0000 7f48762e2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6230d1110 con 0x55d622ec76b0 2023-07-14T13:31:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.691+0000 7f48762e2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6230d1280 con 0x55d62306b580 2023-07-14T13:31:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.691+0000 7f48762e2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6230d1440 con 0x55d6230712d0 2023-07-14T13:31:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.691+0000 7f48762e2b80 10 client.0 _ll_register_callbacks cb 0x7f485000bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:31:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.692+0000 7f4860f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 0x55d6230d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.692+0000 7f4860f9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 0x55d6230d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:39874/0 (socket says 172.21.15.17:39874) 2023-07-14T13:31:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.692+0000 7f4860f9c700 1 -- 172.21.15.17:0/3188078878 learned_addr learned my addr 172.21.15.17:0/3188078878 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.692+0000 7f485b7fe700 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d62306b580 0x55d6230cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.692+0000 7f485bfff700 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 0x55d6230ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.694 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.693+0000 7f4860f9c700 1 -- 172.21.15.17:0/3188078878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d62306b580 msgr2=0x55d6230cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:19.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.693+0000 7f4860f9c700 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d62306b580 0x55d6230cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.693+0000 7f4860f9c700 1 -- 172.21.15.17:0/3188078878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 msgr2=0x55d6230ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:19.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.693+0000 7f4860f9c700 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 0x55d6230ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:19.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.693+0000 7f4860f9c700 1 -- 172.21.15.17:0/3188078878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d622dd3c00 con 0x55d6230712d0 2023-07-14T13:31:19.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.693+0000 7f485b7fe700 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d62306b580 0x55d6230cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:31:19.695 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.693+0000 7f4860f9c700 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 0x55d6230d0b60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f485400dfd0 tx=0x7f4854095360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af214c81a9c922c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.694+0000 7f483b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:31:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.694+0000 7f483b7fe700 1 -- 172.21.15.17:0/3188078878 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854099aa0 con 0x55d6230712d0 2023-07-14T13:31:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.694+0000 7f483b7fe700 1 -- 172.21.15.17:0/3188078878 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f4854082e40 con 0x55d6230712d0 2023-07-14T13:31:19.696 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.694+0000 7f48762e2b80 1 -- 172.21.15.17:0/3188078878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f484c009aa0 con 0x55d6230712d0 2023-07-14T13:31:19.700 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.701+0000 7f483b7fe700 1 -- 172.21.15.17:0/3188078878 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48540a1a90 con 0x55d6230712d0 2023-07-14T13:31:19.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.701+0000 7f48762e2b80 10 client.29515 fetch_fsmap learned FSMap version 68 2023-07-14T13:31:19.701 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.701+0000 7f48762e2b80 1 -- 172.21.15.17:0/3188078878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x7f485c1b19b0 con 0x55d6230712d0 2023-07-14T13:31:19.702 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.703+0000 7f483b7fe700 1 -- 172.21.15.17:0/3188078878 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48540c7020 con 0x55d6230712d0 2023-07-14T13:31:19.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.703+0000 7f483b7fe700 1 -- 172.21.15.17:0/3188078878 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f485409d170 con 0x55d6230712d0 2023-07-14T13:31:19.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.703+0000 7f48762e2b80 10 client.29515 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:31:19.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.703+0000 7f48762e2b80 10 client.29515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:31:19.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.703+0000 7f48762e2b80 20 client.29515 populate_metadata read hostname 'smithi017' 2023-07-14T13:31:19.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.703+0000 7f48762e2b80 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d6230d9970 0x55d6230dbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:19.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.703+0000 7f48762e2b80 4 client.29515 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:31:19.703 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.703+0000 7f48762e2b80 1 -- 172.21.15.17:0/3188078878 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d622f77ff0 con 0x55d6230d9970 2023-07-14T13:31:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.704+0000 7f485bfff700 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d6230d9970 0x55d6230dbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:19.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.706+0000 7f485bfff700 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d6230d9970 0x55d6230dbd50 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=515d2d0eb2fecbbf server_cookie=2295a42a124398ea in_seq=0 out_seq=0 2023-07-14T13:31:19.705 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:19.706+0000 7f483b7fe700 10 client.29515 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:20.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:19 smithi017 ceph-mon[95536]: pgmap v1001: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 669 op/s 2023-07-14T13:31:20.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:19 smithi135 ceph-mon[97338]: pgmap v1001: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 669 op/s 2023-07-14T13:31:20.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:19 smithi131 ceph-mon[96953]: pgmap v1001: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.7 MiB/s wr, 669 op/s 2023-07-14T13:31:22.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:21 smithi017 ceph-mon[95536]: pgmap v1002: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-07-14T13:31:22.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:21 smithi017 ceph-mon[95536]: osdmap e141: 12 total, 12 up, 12 in 2023-07-14T13:31:22.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:21 smithi135 ceph-mon[97338]: pgmap v1002: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-07-14T13:31:22.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:21 smithi135 ceph-mon[97338]: osdmap e141: 12 total, 12 up, 12 in 2023-07-14T13:31:22.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:21 smithi131 ceph-mon[96953]: pgmap v1002: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-07-14T13:31:22.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:21 smithi131 ceph-mon[96953]: osdmap e141: 12 total, 12 up, 12 in 2023-07-14T13:31:22.418 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 790.0 s, 455.0 tps, lat 221.282 ms stddev 79.716 2023-07-14T13:31:24.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:23 smithi017 ceph-mon[95536]: pgmap v1004: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-14T13:31:24.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:23 smithi135 ceph-mon[97338]: pgmap v1004: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-14T13:31:24.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:23 smithi131 ceph-mon[96953]: pgmap v1004: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-14T13:31:24.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.588+0000 7f483b7fe700 1 -- 172.21.15.17:0/3188078878 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d622f77ff0 con 0x55d6230d9970 2023-07-14T13:31:24.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.588+0000 7f483b7fe700 10 client.29515 handle_command_reply: tid=0 2023-07-14T13:31:24.588 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.589+0000 7f48762e2b80 1 client.29515 shutdown 2023-07-14T13:31:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.589+0000 7f48762e2b80 1 -- 172.21.15.17:0/3188078878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 msgr2=0x55d6230d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.589+0000 7f48762e2b80 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 0x55d6230d0b60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f485400dfd0 tx=0x7f4854095360 comp rx=0 tx=0).stop 2023-07-14T13:31:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.589+0000 7f48762e2b80 1 -- 172.21.15.17:0/3188078878 shutdown_connections 2023-07-14T13:31:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.589+0000 7f48762e2b80 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55d6230d9970 0x55d6230dbd50 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.589+0000 7f48762e2b80 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6230712d0 0x55d6230d0b60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.589+0000 7f48762e2b80 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55d622ec76b0 0x55d6230ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.589+0000 7f48762e2b80 1 --2- 172.21.15.17:0/3188078878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d62306b580 0x55d6230cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.589+0000 7f48762e2b80 1 -- 172.21.15.17:0/3188078878 >> 172.21.15.17:0/3188078878 conn(0x55d623060be0 msgr2=0x55d623072280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.590+0000 7f483b7fe700 0 client.29515 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.590+0000 7f48762e2b80 1 -- 172.21.15.17:0/3188078878 shutdown_connections 2023-07-14T13:31:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.590+0000 7f48762e2b80 1 -- 172.21.15.17:0/3188078878 wait complete. 2023-07-14T13:31:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.590+0000 7f48762e2b80 20 client.29515 trim_cache size 0 max 16384 2023-07-14T13:31:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:31:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:31:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:31:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:31:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.592+0000 7f48629ff700 1 -- 172.21.15.17:0/843754650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f48440a12d0 msgr2=0x7f48440a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:24.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.592+0000 7f48629ff700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f48440a12d0 0x7f48440a3780 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f484c009560 tx=0x7f484c009fd0 comp rx=0 tx=0).stop 2023-07-14T13:31:24.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.592+0000 7f48629ff700 1 -- 172.21.15.17:0/843754650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f485c119460 msgr2=0x7f485c1a4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:24.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.592+0000 7f48629ff700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f485c119460 0x7f485c1a4820 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4854007ee0 tx=0x7f485400d3b0 comp rx=0 tx=0).stop 2023-07-14T13:31:24.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.592+0000 7f48629ff700 1 -- 172.21.15.17:0/843754650 shutdown_connections 2023-07-14T13:31:24.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.592+0000 7f48629ff700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f48440a12d0 0x7f48440a3780 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:24.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.592+0000 7f48629ff700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f485c119460 0x7f485c1a4820 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.592+0000 7f48629ff700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c107510 0x7f485c1aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.592+0000 7f48629ff700 1 --2- 172.21.15.17:0/843754650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f485c1078e0 0x7f485c1aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.592+0000 7f48629ff700 1 -- 172.21.15.17:0/843754650 >> 172.21.15.17:0/843754650 conn(0x7f485c070830 msgr2=0x7f485c06d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.593+0000 7f48629ff700 1 -- 172.21.15.17:0/843754650 shutdown_connections 2023-07-14T13:31:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:24.593+0000 7f48629ff700 1 -- 172.21.15.17:0/843754650 wait complete. 2023-07-14T13:31:26.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:25 smithi017 ceph-mon[95536]: pgmap v1005: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-14T13:31:26.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:25 smithi135 ceph-mon[97338]: pgmap v1005: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-14T13:31:26.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:25 smithi131 ceph-mon[96953]: pgmap v1005: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-14T13:31:27.425 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 795.0 s, 483.2 tps, lat 205.204 ms stddev 110.135 2023-07-14T13:31:28.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:27 smithi017 ceph-mon[95536]: pgmap v1006: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-14T13:31:28.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:27 smithi135 ceph-mon[97338]: pgmap v1006: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-14T13:31:28.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:27 smithi131 ceph-mon[96953]: pgmap v1006: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-14T13:31:30.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:29 smithi017 ceph-mon[95536]: pgmap v1007: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-14T13:31:30.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:29 smithi135 ceph-mon[97338]: pgmap v1007: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-14T13:31:30.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:29 smithi131 ceph-mon[96953]: pgmap v1007: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-14T13:31:32.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:31 smithi017 ceph-mon[95536]: pgmap v1008: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.44k op/s 2023-07-14T13:31:32.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:31 smithi135 ceph-mon[97338]: pgmap v1008: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.44k op/s 2023-07-14T13:31:32.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:31 smithi131 ceph-mon[96953]: pgmap v1008: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.44k op/s 2023-07-14T13:31:32.418 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 800.0 s, 513.7 tps, lat 194.186 ms stddev 62.431 2023-07-14T13:31:34.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:33 smithi017 ceph-mon[95536]: pgmap v1009: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:31:34.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:33 smithi135 ceph-mon[97338]: pgmap v1009: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:31:34.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:33 smithi131 ceph-mon[96953]: pgmap v1009: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 12 MiB/s wr, 1.33k op/s 2023-07-14T13:31:35.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:34 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:31:35.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:34 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:31:35.325 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:34 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:31:36.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:35 smithi135 ceph-mon[97338]: pgmap v1010: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 1.21k op/s 2023-07-14T13:31:36.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:35 smithi131 ceph-mon[96953]: pgmap v1010: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 1.21k op/s 2023-07-14T13:31:36.328 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:35 smithi017 ceph-mon[95536]: pgmap v1010: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 1.21k op/s 2023-07-14T13:31:37.424 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 805.0 s, 460.6 tps, lat 220.385 ms stddev 160.132 2023-07-14T13:31:37.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.860+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/3832652737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b04101fb0 msgr2=0x7f2b04102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:37.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.860+0000 7f2b0a3ff700 1 --2- 172.21.15.17:0/3832652737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b04101fb0 0x7f2b04102380 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00b0a0 tx=0x7f2afc00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.861+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/3832652737 shutdown_connections 2023-07-14T13:31:37.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.861+0000 7f2b0a3ff700 1 --2- 172.21.15.17:0/3832652737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b04106ff0 0x7f2b0410ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.861+0000 7f2b0a3ff700 1 --2- 172.21.15.17:0/3832652737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b04101fb0 0x7f2b04102380 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.861+0000 7f2b0a3ff700 1 --2- 172.21.15.17:0/3832652737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b04102950 0x7f2b04106910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.861+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/3832652737 >> 172.21.15.17:0/3832652737 conn(0x7f2b040fd800 msgr2=0x7f2b040ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.870+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/3832652737 shutdown_connections 2023-07-14T13:31:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.870+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/3832652737 wait complete. 2023-07-14T13:31:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.872+0000 7f2b0a3ff700 1 Processor -- start 2023-07-14T13:31:37.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.872+0000 7f2b0a3ff700 1 -- start start 2023-07-14T13:31:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.873+0000 7f2b0a3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b04101fb0 0x7f2b0410e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.873+0000 7f2b0a3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b04102950 0x7f2b0410b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.873+0000 7f2b0a3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b04106ff0 0x7f2b0410bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.873+0000 7f2b0a3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0410c270 con 0x7f2b04106ff0 2023-07-14T13:31:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.873+0000 7f2b0a3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0410c3e0 con 0x7f2b04101fb0 2023-07-14T13:31:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.873+0000 7f2b0a3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0419e370 con 0x7f2b04102950 2023-07-14T13:31:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.874+0000 7f2b03fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b04101fb0 0x7f2b0410e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.874+0000 7f2b03fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b04101fb0 0x7f2b0410e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:50570/0 (socket says 172.21.15.17:50570) 2023-07-14T13:31:37.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.874+0000 7f2b03fff700 1 -- 172.21.15.17:0/555065072 learned_addr learned my addr 172.21.15.17:0/555065072 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.875+0000 7f2b03fff700 1 -- 172.21.15.17:0/555065072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b04102950 msgr2=0x7f2b0410b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:37.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.875+0000 7f2b03fff700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b04102950 0x7f2b0410b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.875+0000 7f2b03fff700 1 -- 172.21.15.17:0/555065072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b04106ff0 msgr2=0x7f2b0410bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.875+0000 7f2b03fff700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b04106ff0 0x7f2b0410bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.875+0000 7f2b03fff700 1 -- 172.21.15.17:0/555065072 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009d00 con 0x7f2b04101fb0 2023-07-14T13:31:37.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.876+0000 7f2b03fff700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b04101fb0 0x7f2b0410e8a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2afc005b50 tx=0x7f2afc0124a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.882+0000 7f2b017fa700 1 -- 172.21.15.17:0/555065072 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00e040 con 0x7f2b04101fb0 2023-07-14T13:31:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.882+0000 7f2b017fa700 1 -- 172.21.15.17:0/555065072 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2afc01d480 con 0x7f2b04101fb0 2023-07-14T13:31:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.882+0000 7f2b017fa700 1 -- 172.21.15.17:0/555065072 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc01b6b0 con 0x7f2b04101fb0 2023-07-14T13:31:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.882+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/555065072 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0419e5f0 con 0x7f2b04101fb0 2023-07-14T13:31:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.883+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/555065072 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0419eab0 con 0x7f2b04101fb0 2023-07-14T13:31:37.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.890+0000 7f2b1de03b80 1 Processor -- start 2023-07-14T13:31:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.891+0000 7f2b1de03b80 1 -- start start 2023-07-14T13:31:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.891+0000 7f2b017fa700 1 -- 172.21.15.17:0/555065072 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2afc01d5f0 con 0x7f2b04101fb0 2023-07-14T13:31:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.891+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dbfd6b0 0x559d8dda6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.891+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 0x559d8dda1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.891+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda1580 0x559d8dda19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.891+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8dca6c50 con 0x559d8dda72d0 2023-07-14T13:31:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.891+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8dcf99e0 con 0x559d8dbfd6b0 2023-07-14T13:31:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.891+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8dcf2e70 con 0x559d8dda1580 2023-07-14T13:31:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.892+0000 7f2b0899c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dbfd6b0 0x559d8dda6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.892+0000 7f2b0899c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dbfd6b0 0x559d8dda6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:50582/0 (socket says 172.21.15.17:50582) 2023-07-14T13:31:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.892+0000 7f2b0899c700 1 -- 172.21.15.17:0/2889288837 learned_addr learned my addr 172.21.15.17:0/2889288837 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.893+0000 7f2b03fff700 1 --2- 172.21.15.17:0/2889288837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 0x559d8dda1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.894+0000 7f2b037fe700 1 --2- 172.21.15.17:0/2889288837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda1580 0x559d8dda19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.895+0000 7f2b03fff700 1 -- 172.21.15.17:0/2889288837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda1580 msgr2=0x559d8dda19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.895+0000 7f2b03fff700 1 --2- 172.21.15.17:0/2889288837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda1580 0x559d8dda19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.895+0000 7f2b03fff700 1 -- 172.21.15.17:0/2889288837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dbfd6b0 msgr2=0x559d8dda6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.895+0000 7f2b03fff700 1 --2- 172.21.15.17:0/2889288837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dbfd6b0 0x559d8dda6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.895+0000 7f2b03fff700 1 -- 172.21.15.17:0/2889288837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d8db20d80 con 0x559d8dda72d0 2023-07-14T13:31:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.896+0000 7f2b017fa700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2aec0a1490 0x7f2aec0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.896+0000 7f2b017fa700 1 -- 172.21.15.17:0/555065072 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2afc0ce1b0 con 0x7f2b04101fb0 2023-07-14T13:31:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.897+0000 7f2b03fff700 1 --2- 172.21.15.17:0/2889288837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 0x559d8dda1040 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0cb9d0 tx=0x7f2afc0d6260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b9d9b5e22375bc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.897+0000 7f2b0899c700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2aec0a1490 0x7f2aec0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.898+0000 7f2aea7fc700 1 -- 172.21.15.17:0/2889288837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0977a0 con 0x559d8dda72d0 2023-07-14T13:31:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.898+0000 7f2aea7fc700 1 -- 172.21.15.17:0/2889288837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2afc09b230 con 0x559d8dda72d0 2023-07-14T13:31:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.898+0000 7f2aea7fc700 1 -- 172.21.15.17:0/2889288837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc09b460 con 0x559d8dda72d0 2023-07-14T13:31:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.899+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2889288837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 msgr2=0x559d8dda1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.899+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/2889288837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 0x559d8dda1040 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0cb9d0 tx=0x7f2afc0d6260 comp rx=0 tx=0).stop 2023-07-14T13:31:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.899+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2889288837 shutdown_connections 2023-07-14T13:31:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.899+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/2889288837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda1580 0x559d8dda19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.899+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/2889288837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dbfd6b0 0x559d8dda6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.899+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/2889288837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 0x559d8dda1040 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.899+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2889288837 >> 172.21.15.17:0/2889288837 conn(0x559d8dd96be0 msgr2=0x559d8dd9bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:37.899 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.899+0000 7f2b0899c700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2aec0a1490 0x7f2aec0a3940 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009970 tx=0x7f2af8008040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.900+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2889288837 shutdown_connections 2023-07-14T13:31:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.900+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2889288837 wait complete. 2023-07-14T13:31:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.901+0000 7f2b1de03b80 1 -- start start 2023-07-14T13:31:37.900 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.902+0000 7f2b1de03b80 1 Processor -- start 2023-07-14T13:31:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.903+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dbfd6b0 0x559d8ddb0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.903+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda1580 0x559d8ddb0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.903+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda72d0 0x559d8ddaa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.903+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8dc92a60 con 0x559d8dda1580 2023-07-14T13:31:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.903+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8dc92760 con 0x559d8dda72d0 2023-07-14T13:31:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.903+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8db768c0 con 0x559d8dbfd6b0 2023-07-14T13:31:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.903+0000 7f2b1de03b80 10 client.0 _ll_register_callbacks cb 0x559d8dc90700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:31:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.903+0000 7f2b037fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda1580 0x559d8ddb0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.903+0000 7f2b037fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda1580 0x559d8ddb0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47342/0 (socket says 172.21.15.17:47342) 2023-07-14T13:31:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.903+0000 7f2b037fe700 1 -- 172.21.15.17:0/2233049327 learned_addr learned my addr 172.21.15.17:0/2233049327 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.903+0000 7f2b0899c700 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda72d0 0x559d8ddaa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.904+0000 7f2b037fe700 1 -- 172.21.15.17:0/2233049327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dbfd6b0 msgr2=0x559d8ddb0430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:31:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.904+0000 7f2b037fe700 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dbfd6b0 0x559d8ddb0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.904+0000 7f2b037fe700 1 -- 172.21.15.17:0/2233049327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda72d0 msgr2=0x559d8ddaa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.904+0000 7f2b037fe700 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda72d0 0x559d8ddaa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.904+0000 7f2b037fe700 1 -- 172.21.15.17:0/2233049327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0419eab0 con 0x559d8dda1580 2023-07-14T13:31:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.904+0000 7f2b0899c700 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda72d0 0x559d8ddaa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:31:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.905+0000 7f2b037fe700 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda1580 0x559d8ddb0970 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2af400d210 tx=0x7f2af400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675c3d2e13f9eb90 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.905+0000 7f2ae37fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:31:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.906+0000 7f2ae37fe700 1 -- 172.21.15.17:0/2233049327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400ddf0 con 0x559d8dda1580 2023-07-14T13:31:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.906+0000 7f2ae37fe700 1 -- 172.21.15.17:0/2233049327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2af4012420 con 0x559d8dda1580 2023-07-14T13:31:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.906+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2233049327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d8dc4c490 con 0x559d8dda1580 2023-07-14T13:31:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.907+0000 7f2ae37fe700 1 -- 172.21.15.17:0/2233049327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2af40125e0 con 0x559d8dda1580 2023-07-14T13:31:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.907+0000 7f2b1de03b80 10 client.19779 fetch_fsmap learned FSMap version 68 2023-07-14T13:31:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.907+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2233049327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x559d8db09c00 con 0x559d8dda1580 2023-07-14T13:31:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.908+0000 7f2ae37fe700 1 -- 172.21.15.17:0/2233049327 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559d8dc4c490 con 0x559d8dda1580 2023-07-14T13:31:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.908+0000 7f2ae37fe700 1 -- 172.21.15.17:0/2233049327 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2af4014870 con 0x559d8dda1580 2023-07-14T13:31:37.907 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.909+0000 7f2b1de03b80 10 client.19779 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:31:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.909+0000 7f2b1de03b80 10 client.19779 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:31:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.909+0000 7f2b1de03b80 20 client.19779 populate_metadata read hostname 'smithi017' 2023-07-14T13:31:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.909+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8ddba9d0 0x559d8ddbcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.909+0000 7f2b1de03b80 4 client.19779 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:31:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.909+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2233049327 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d8dcebe50 con 0x559d8ddba9d0 2023-07-14T13:31:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.910+0000 7f2b03fff700 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8ddba9d0 0x559d8ddbcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.912+0000 7f2b03fff700 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8ddba9d0 0x559d8ddbcde0 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=254a8e29ee4d3fb1 server_cookie=f003e83060f5b7da in_seq=0 out_seq=0 2023-07-14T13:31:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.912+0000 7f2ae37fe700 10 client.19779 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.914+0000 7f2ae37fe700 1 -- 172.21.15.17:0/2233049327 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559d8dcebe50 con 0x559d8ddba9d0 2023-07-14T13:31:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.914+0000 7f2ae37fe700 10 client.19779 handle_command_reply: tid=0 2023-07-14T13:31:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.914+0000 7f2b1de03b80 1 client.19779 shutdown 2023-07-14T13:31:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.915+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2233049327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda1580 msgr2=0x559d8ddb0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.915+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda1580 0x559d8ddb0970 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2af400d210 tx=0x7f2af400bf90 comp rx=0 tx=0).stop 2023-07-14T13:31:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.915+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2233049327 shutdown_connections 2023-07-14T13:31:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.915+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8ddba9d0 0x559d8ddbcde0 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.915+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda72d0 0x559d8ddaa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.915+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dbfd6b0 0x559d8ddb0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.915+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/2233049327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda1580 0x559d8ddb0970 secure :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f2af400d210 tx=0x7f2af400bf90 comp rx=0 tx=0).stop 2023-07-14T13:31:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.915+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2233049327 >> 172.21.15.17:0/2233049327 conn(0x559d8dd96be0 msgr2=0x559d8dd9b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.922+0000 7f2ae37fe700 0 client.19779 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.923+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2233049327 shutdown_connections 2023-07-14T13:31:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.925+0000 7f2b1de03b80 1 -- 172.21.15.17:0/2233049327 wait complete. 2023-07-14T13:31:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.925+0000 7f2b1de03b80 20 client.19779 trim_cache size 0 max 16384 2023-07-14T13:31:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.954+0000 7f2b1de03b80 1 Processor -- start 2023-07-14T13:31:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.954+0000 7f2b1de03b80 1 -- start start 2023-07-14T13:31:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.955+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dbfd6b0 0x559d8dda1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.955+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda72d0 0x559d8ddaa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.955+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda5190 0x559d8dda6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.955+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8dc4c490 con 0x559d8dbfd6b0 2023-07-14T13:31:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.955+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8dd98d00 con 0x559d8dda5190 2023-07-14T13:31:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.955+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8dd985f0 con 0x559d8dda72d0 2023-07-14T13:31:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.956+0000 7f2b037fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda72d0 0x559d8ddaa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.956+0000 7f2b037fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda72d0 0x559d8ddaa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40558/0 (socket says 172.21.15.17:40558) 2023-07-14T13:31:37.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.956+0000 7f2b037fe700 1 -- 172.21.15.17:0/3493446088 learned_addr learned my addr 172.21.15.17:0/3493446088 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:37.957 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.956+0000 7f2b0899c700 1 --2- 172.21.15.17:0/3493446088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda5190 0x559d8dda6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.956+0000 7f2b037fe700 1 -- 172.21.15.17:0/3493446088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda5190 msgr2=0x559d8dda6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.956+0000 7f2b037fe700 1 --2- 172.21.15.17:0/3493446088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda5190 0x559d8dda6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.956+0000 7f2b037fe700 1 -- 172.21.15.17:0/3493446088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dbfd6b0 msgr2=0x559d8dda1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.956+0000 7f2b037fe700 1 --2- 172.21.15.17:0/3493446088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dbfd6b0 0x559d8dda1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.956+0000 7f2b037fe700 1 -- 172.21.15.17:0/3493446088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d8db471f0 con 0x559d8dda72d0 2023-07-14T13:31:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.957+0000 7f2b037fe700 1 --2- 172.21.15.17:0/3493446088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda72d0 0x559d8ddaa860 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2af4014c00 tx=0x7f2af4014f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6e15c1c8f49ee1b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:37.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.961+0000 7f2aeaffd700 1 -- 172.21.15.17:0/3493446088 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400a050 con 0x559d8dda72d0 2023-07-14T13:31:37.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.961+0000 7f2aeaffd700 1 -- 172.21.15.17:0/3493446088 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2af400b220 con 0x559d8dda72d0 2023-07-14T13:31:37.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.961+0000 7f2aeaffd700 1 -- 172.21.15.17:0/3493446088 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4013850 con 0x559d8dda72d0 2023-07-14T13:31:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.962+0000 7f2b1de03b80 1 -- 172.21.15.17:0/3493446088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda72d0 msgr2=0x559d8ddaa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.962+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/3493446088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda72d0 0x559d8ddaa860 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2af4014c00 tx=0x7f2af4014f70 comp rx=0 tx=0).stop 2023-07-14T13:31:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.963+0000 7f2b1de03b80 1 -- 172.21.15.17:0/3493446088 shutdown_connections 2023-07-14T13:31:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.963+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/3493446088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda5190 0x559d8dda6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.963+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/3493446088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dbfd6b0 0x559d8dda1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.963+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/3493446088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dda72d0 0x559d8ddaa860 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.963+0000 7f2b1de03b80 1 -- 172.21.15.17:0/3493446088 >> 172.21.15.17:0/3493446088 conn(0x559d8dd96be0 msgr2=0x559d8dda5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.963+0000 7f2b1de03b80 1 -- 172.21.15.17:0/3493446088 shutdown_connections 2023-07-14T13:31:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.963+0000 7f2b1de03b80 1 -- 172.21.15.17:0/3493446088 wait complete. 2023-07-14T13:31:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.964+0000 7f2b1de03b80 1 -- start start 2023-07-14T13:31:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.964+0000 7f2b1de03b80 1 Processor -- start 2023-07-14T13:31:37.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.965+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dbfd6b0 0x559d8de02840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.965+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda5190 0x559d8de02d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.965+0000 7f2b1de03b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 0x559d8de032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.965+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8de0d9a0 con 0x559d8dda72d0 2023-07-14T13:31:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.965+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8de0dae0 con 0x559d8dda5190 2023-07-14T13:31:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.965+0000 7f2b1de03b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d8de0dca0 con 0x559d8dbfd6b0 2023-07-14T13:31:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.965+0000 7f2b1de03b80 10 client.0 _ll_register_callbacks cb 0x7f2af400b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:31:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.966+0000 7f2b037fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda5190 0x559d8de02d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.966+0000 7f2b03fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dbfd6b0 0x559d8de02840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.966+0000 7f2b03fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dbfd6b0 0x559d8de02840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:40564/0 (socket says 172.21.15.17:40564) 2023-07-14T13:31:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.966+0000 7f2b03fff700 1 -- 172.21.15.17:0/1299187119 learned_addr learned my addr 172.21.15.17:0/1299187119 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.967+0000 7f2b0899c700 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 0x559d8de032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.967+0000 7f2b03fff700 1 -- 172.21.15.17:0/1299187119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda5190 msgr2=0x559d8de02d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.967+0000 7f2b03fff700 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda5190 0x559d8de02d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.967+0000 7f2b03fff700 1 -- 172.21.15.17:0/1299187119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 msgr2=0x559d8de032c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.967+0000 7f2b03fff700 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 0x559d8de032c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.967+0000 7f2b03fff700 1 -- 172.21.15.17:0/1299187119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d8db09c00 con 0x559d8dbfd6b0 2023-07-14T13:31:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.967+0000 7f2b0899c700 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 0x559d8de032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:31:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.968+0000 7f2b03fff700 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dbfd6b0 0x559d8de02840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2afc09b3f0 tx=0x7f2afc0cba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f07bfde5f6c7df4c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.968+0000 7f2ae37fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:31:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.972+0000 7f2ae37fe700 1 -- 172.21.15.17:0/1299187119 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0d1c00 con 0x559d8dbfd6b0 2023-07-14T13:31:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.972+0000 7f2ae37fe700 1 -- 172.21.15.17:0/1299187119 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2afc0d16d0 con 0x559d8dbfd6b0 2023-07-14T13:31:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.972+0000 7f2b1de03b80 1 -- 172.21.15.17:0/1299187119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2afc09b230 con 0x559d8dbfd6b0 2023-07-14T13:31:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.973+0000 7f2ae37fe700 1 -- 172.21.15.17:0/1299187119 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2afc0977a0 con 0x559d8dbfd6b0 2023-07-14T13:31:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.973+0000 7f2b1de03b80 10 client.29524 fetch_fsmap learned FSMap version 68 2023-07-14T13:31:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.973+0000 7f2b1de03b80 1 -- 172.21.15.17:0/1299187119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x559d8db1f250 con 0x559d8dbfd6b0 2023-07-14T13:31:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.974+0000 7f2ae37fe700 1 -- 172.21.15.17:0/1299187119 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2afc09b230 con 0x559d8dbfd6b0 2023-07-14T13:31:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.974+0000 7f2ae37fe700 1 -- 172.21.15.17:0/1299187119 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2afc09f0d0 con 0x559d8dbfd6b0 2023-07-14T13:31:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.974+0000 7f2b1de03b80 10 client.29524 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:31:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.974+0000 7f2b1de03b80 10 client.29524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:31:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.974+0000 7f2b1de03b80 20 client.29524 populate_metadata read hostname 'smithi017' 2023-07-14T13:31:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.974+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8de0efd0 0x559d8de113e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.974+0000 7f2b1de03b80 4 client.29524 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:31:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.974+0000 7f2b1de03b80 1 -- 172.21.15.17:0/1299187119 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559d8dcadff0 con 0x559d8de0efd0 2023-07-14T13:31:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.975+0000 7f2b037fe700 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8de0efd0 0x559d8de113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.976+0000 7f2b037fe700 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8de0efd0 0x559d8de113e0 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c53312d52369cb56 server_cookie=c749759bb26dee5b in_seq=0 out_seq=0 2023-07-14T13:31:37.975 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:37.976+0000 7f2ae37fe700 10 client.29524 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.033+0000 7f2ae37fe700 1 -- 172.21.15.17:0/1299187119 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559d8dcadff0 con 0x559d8de0efd0 2023-07-14T13:31:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.033+0000 7f2ae37fe700 10 client.29524 handle_command_reply: tid=0 2023-07-14T13:31:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.034+0000 7f2b1de03b80 1 client.29524 shutdown 2023-07-14T13:31:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.043+0000 7f2b1de03b80 1 -- 172.21.15.17:0/1299187119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dbfd6b0 msgr2=0x559d8de02840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.043+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dbfd6b0 0x559d8de02840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2afc09b3f0 tx=0x7f2afc0cba30 comp rx=0 tx=0).stop 2023-07-14T13:31:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.044+0000 7f2b1de03b80 1 -- 172.21.15.17:0/1299187119 shutdown_connections 2023-07-14T13:31:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.044+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x559d8de0efd0 0x559d8de113e0 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.044+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x559d8dda72d0 0x559d8de032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.044+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559d8dbfd6b0 0x559d8de02840 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.044+0000 7f2b1de03b80 1 --2- 172.21.15.17:0/1299187119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559d8dda5190 0x559d8de02d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.044+0000 7f2b1de03b80 1 -- 172.21.15.17:0/1299187119 >> 172.21.15.17:0/1299187119 conn(0x559d8dd96be0 msgr2=0x559d8dda8190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.046+0000 7f2ae37fe700 0 client.29524 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.047+0000 7f2b1de03b80 1 -- 172.21.15.17:0/1299187119 shutdown_connections 2023-07-14T13:31:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.049+0000 7f2b1de03b80 1 -- 172.21.15.17:0/1299187119 wait complete. 2023-07-14T13:31:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.050+0000 7f2b1de03b80 20 client.29524 trim_cache size 0 max 16384 2023-07-14T13:31:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:31:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:31:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:31:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:31:38.060 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.061+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/555065072 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2aec0a1490 msgr2=0x7f2aec0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.061+0000 7f2b0a3ff700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2aec0a1490 0x7f2aec0a3940 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009970 tx=0x7f2af8008040 comp rx=0 tx=0).stop 2023-07-14T13:31:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.061+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/555065072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b04101fb0 msgr2=0x7f2b0410e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.061+0000 7f2b0a3ff700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b04101fb0 0x7f2b0410e8a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2afc005b50 tx=0x7f2afc0124a0 comp rx=0 tx=0).stop 2023-07-14T13:31:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.061+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/555065072 shutdown_connections 2023-07-14T13:31:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.061+0000 7f2b0a3ff700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2aec0a1490 0x7f2aec0a3940 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.061+0000 7f2b0a3ff700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b04106ff0 0x7f2b0410bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.061+0000 7f2b0a3ff700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2b04101fb0 0x7f2b0410e8a0 secure :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2afc005b50 tx=0x7f2afc0124a0 comp rx=0 tx=0).stop 2023-07-14T13:31:38.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.061+0000 7f2b0a3ff700 1 --2- 172.21.15.17:0/555065072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b04102950 0x7f2b0410b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:38.062 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.061+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/555065072 >> 172.21.15.17:0/555065072 conn(0x7f2b040fd800 msgr2=0x7f2b040fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:38.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.067+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/555065072 shutdown_connections 2023-07-14T13:31:38.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:38.067+0000 7f2b0a3ff700 1 -- 172.21.15.17:0/555065072 wait complete. 2023-07-14T13:31:38.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:37 smithi135 ceph-mon[97338]: pgmap v1011: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 16 MiB/s wr, 1.78k op/s 2023-07-14T13:31:38.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:37 smithi131 ceph-mon[96953]: pgmap v1011: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 16 MiB/s wr, 1.78k op/s 2023-07-14T13:31:38.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:37 smithi017 ceph-mon[95536]: pgmap v1011: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 16 MiB/s wr, 1.78k op/s 2023-07-14T13:31:40.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:39 smithi135 ceph-mon[97338]: pgmap v1012: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:31:40.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:39 smithi131 ceph-mon[96953]: pgmap v1012: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:31:40.325 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:39 smithi017 ceph-mon[95536]: pgmap v1012: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:31:42.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:41 smithi017 ceph-mon[95536]: pgmap v1013: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 15 MiB/s wr, 1.71k op/s 2023-07-14T13:31:42.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:41 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:41 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:41 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:41 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:41 smithi135 ceph-mon[97338]: pgmap v1013: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 15 MiB/s wr, 1.71k op/s 2023-07-14T13:31:42.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:41 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:41 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:41 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:41 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:41 smithi131 ceph-mon[96953]: pgmap v1013: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 15 MiB/s wr, 1.71k op/s 2023-07-14T13:31:42.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:41 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:41 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:41 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:41 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:42.421 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 810.0 s, 468.5 tps, lat 212.526 ms stddev 82.804 2023-07-14T13:31:43.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:42 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:42 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:42 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:42 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:42 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:42 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:42 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:42 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:42 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:42 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:42 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:42 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:42 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:42 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:42 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:42 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:42 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:42 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:42 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:42 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:42 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:42 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:42 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:43.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:42 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:43 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T13:31:44.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:43 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:31:44.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:43 smithi017 ceph-mon[95536]: pgmap v1014: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.20k op/s 2023-07-14T13:31:44.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:43 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:43 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:43 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:43 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:43 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:43 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:43 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.077 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:43 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:43 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T13:31:44.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:43 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:31:44.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:43 smithi135 ceph-mon[97338]: pgmap v1014: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.20k op/s 2023-07-14T13:31:44.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:43 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:43 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:43 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:43 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:43 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:43 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:43 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:43 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:43 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi131 to 220.9M 2023-07-14T13:31:44.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:43 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi131 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:31:44.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:43 smithi131 ceph-mon[96953]: pgmap v1014: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.20k op/s 2023-07-14T13:31:44.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:43 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:43 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:43 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:43 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:43 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:43 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:43 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:44.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:43 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:45.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:44 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T13:31:45.076 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:44 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T13:31:45.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:44 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T13:31:45.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:44 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T13:31:45.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:44 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi017 to 222.0M 2023-07-14T13:31:45.223 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:44 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi017 to 232786534: error parsing value: Value '232786534' is below minimum 939524096 2023-07-14T13:31:46.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:45 smithi017 ceph-mon[95536]: pgmap v1015: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.14k op/s 2023-07-14T13:31:46.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:45 smithi135 ceph-mon[97338]: pgmap v1015: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.14k op/s 2023-07-14T13:31:46.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:45 smithi131 ceph-mon[96953]: pgmap v1015: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.14k op/s 2023-07-14T13:31:47.420 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 815.0 s, 475.5 tps, lat 207.562 ms stddev 73.115 2023-07-14T13:31:48.172 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:47 smithi135 ceph-mon[97338]: pgmap v1016: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 15 MiB/s wr, 1.71k op/s 2023-07-14T13:31:48.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:47 smithi131 ceph-mon[96953]: pgmap v1016: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 15 MiB/s wr, 1.71k op/s 2023-07-14T13:31:48.325 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:47 smithi017 ceph-mon[95536]: pgmap v1016: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 15 MiB/s wr, 1.71k op/s 2023-07-14T13:31:49.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:48 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:49.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:48 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:49.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:48 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:49.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:48 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:49.325 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:48 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:49.325 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:48 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:50.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: pgmap v1017: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2023-07-14T13:31:50.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.167 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.168 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:31:50.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:31:50.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:49 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:50.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: pgmap v1017: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2023-07-14T13:31:50.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:31:50.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:31:50.217 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:49 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:50.325 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: pgmap v1017: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2023-07-14T13:31:50.326 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.326 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.326 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.326 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.326 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.326 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.326 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.327 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T13:31:50.327 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:31:50.327 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:31:50.327 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:49 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:31:51.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:50 smithi135 ceph-mon[97338]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T13:31:51.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:50 smithi135 ceph-mon[97338]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:31:51.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:50 smithi135 ceph-mon[97338]: pgmap v1018: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 16 MiB/s wr, 1.70k op/s 2023-07-14T13:31:51.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:50 smithi131 ceph-mon[96953]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T13:31:51.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:50 smithi131 ceph-mon[96953]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:31:51.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:50 smithi131 ceph-mon[96953]: pgmap v1018: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 16 MiB/s wr, 1.70k op/s 2023-07-14T13:31:51.330 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:50 smithi017 ceph-mon[95536]: Adjusting osd_memory_target on smithi135 to 220.9M 2023-07-14T13:31:51.330 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:50 smithi017 ceph-mon[95536]: Unable to set osd_memory_target on smithi135 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-14T13:31:51.330 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:50 smithi017 ceph-mon[95536]: pgmap v1018: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 16 MiB/s wr, 1.70k op/s 2023-07-14T13:31:51.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.345+0000 7faa02bff700 1 -- 172.21.15.17:0/3141424162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9fc102920 msgr2=0x7fa9fc1068e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.345+0000 7faa02bff700 1 --2- 172.21.15.17:0/3141424162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9fc102920 0x7fa9fc1068e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00098f0 tx=0x7fa9f0009c00 comp rx=0 tx=0).stop 2023-07-14T13:31:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.346+0000 7faa02bff700 1 -- 172.21.15.17:0/3141424162 shutdown_connections 2023-07-14T13:31:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.346+0000 7faa02bff700 1 --2- 172.21.15.17:0/3141424162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9fc106fc0 0x7fa9fc10eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.346+0000 7faa02bff700 1 --2- 172.21.15.17:0/3141424162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9fc101f80 0x7fa9fc102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.346+0000 7faa02bff700 1 --2- 172.21.15.17:0/3141424162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9fc102920 0x7fa9fc1068e0 secure :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00098f0 tx=0x7fa9f0009c00 comp rx=0 tx=0).stop 2023-07-14T13:31:51.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.346+0000 7faa02bff700 1 -- 172.21.15.17:0/3141424162 >> 172.21.15.17:0/3141424162 conn(0x7fa9fc0fd7d0 msgr2=0x7fa9fc0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:51.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.347+0000 7faa02bff700 1 -- 172.21.15.17:0/3141424162 shutdown_connections 2023-07-14T13:31:51.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.347+0000 7faa02bff700 1 -- 172.21.15.17:0/3141424162 wait complete. 2023-07-14T13:31:51.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.348+0000 7faa02bff700 1 Processor -- start 2023-07-14T13:31:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.349+0000 7faa02bff700 1 -- start start 2023-07-14T13:31:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.349+0000 7faa02bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9fc101f80 0x7fa9fc074a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.349+0000 7faa02bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9fc106fc0 0x7fa9fc074f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.349+0000 7faa02bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9fc0754a0 0x7fa9fc070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.349+0000 7faa02bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc071160 con 0x7fa9fc0754a0 2023-07-14T13:31:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.349+0000 7faa02bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0712d0 con 0x7fa9fc106fc0 2023-07-14T13:31:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.349+0000 7faa02bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc071490 con 0x7fa9fc101f80 2023-07-14T13:31:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.351+0000 7faa0119c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9fc0754a0 0x7fa9fc070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.351+0000 7faa0119c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9fc0754a0 0x7fa9fc070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38056/0 (socket says 172.21.15.17:38056) 2023-07-14T13:31:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.351+0000 7faa0119c700 1 -- 172.21.15.17:0/4015445291 learned_addr learned my addr 172.21.15.17:0/4015445291 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.351+0000 7fa9fbfff700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9fc106fc0 0x7fa9fc074f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.352+0000 7faa0119c700 1 -- 172.21.15.17:0/4015445291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9fc101f80 msgr2=0x7fa9fc074a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.352+0000 7faa0119c700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9fc101f80 0x7fa9fc074a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.352+0000 7faa0119c700 1 -- 172.21.15.17:0/4015445291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9fc106fc0 msgr2=0x7fa9fc074f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.352+0000 7faa0119c700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9fc106fc0 0x7fa9fc074f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.352+0000 7faa0119c700 1 -- 172.21.15.17:0/4015445291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f0009520 con 0x7fa9fc0754a0 2023-07-14T13:31:51.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.352+0000 7faa0119c700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9fc0754a0 0x7fa9fc070ac0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400ef30 tx=0x7fa9f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:51.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.353+0000 7fa9f9ffb700 1 -- 172.21.15.17:0/4015445291 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4018070 con 0x7fa9fc0754a0 2023-07-14T13:31:51.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.353+0000 7fa9f9ffb700 1 -- 172.21.15.17:0/4015445291 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9f400f040 con 0x7fa9fc0754a0 2023-07-14T13:31:51.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.353+0000 7fa9f9ffb700 1 -- 172.21.15.17:0/4015445291 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f400cc70 con 0x7fa9fc0754a0 2023-07-14T13:31:51.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.353+0000 7faa02bff700 1 -- 172.21.15.17:0/4015445291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9fc071710 con 0x7fa9fc0754a0 2023-07-14T13:31:51.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.353+0000 7faa02bff700 1 -- 172.21.15.17:0/4015445291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc071ba0 con 0x7fa9fc0754a0 2023-07-14T13:31:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.359+0000 7faa16504b80 1 Processor -- start 2023-07-14T13:31:51.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.360+0000 7fa9f9ffb700 1 -- 172.21.15.17:0/4015445291 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa9f4007500 con 0x7fa9fc0754a0 2023-07-14T13:31:51.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.360+0000 7faa16504b80 1 -- start start 2023-07-14T13:31:51.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.361+0000 7faa16504b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 0x55f7225a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.361+0000 7faa16504b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 0x55f72259c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.361+0000 7faa16504b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f72259c580 0x55f72259c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.361+0000 7faa16504b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7224a1c50 con 0x55f7225a22d0 2023-07-14T13:31:51.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.361+0000 7faa16504b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7224f49e0 con 0x55f7223f86b0 2023-07-14T13:31:51.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.361+0000 7faa16504b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7224ede70 con 0x55f72259c580 2023-07-14T13:31:51.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.361+0000 7faa0099b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 0x55f72259c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.362+0000 7faa0099b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 0x55f72259c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38058/0 (socket says 172.21.15.17:38058) 2023-07-14T13:31:51.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.362+0000 7faa0099b700 1 -- 172.21.15.17:0/1152693259 learned_addr learned my addr 172.21.15.17:0/1152693259 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.362+0000 7faa0099b700 1 -- 172.21.15.17:0/1152693259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f72259c580 msgr2=0x55f72259c9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:31:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.362+0000 7faa0099b700 1 --2- 172.21.15.17:0/1152693259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f72259c580 0x55f72259c9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.362+0000 7faa0099b700 1 -- 172.21.15.17:0/1152693259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 msgr2=0x55f7225a1d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:31:51.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.362+0000 7faa0099b700 1 --2- 172.21.15.17:0/1152693259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 0x55f7225a1d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.362+0000 7faa0099b700 1 -- 172.21.15.17:0/1152693259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f72231bd80 con 0x55f7225a22d0 2023-07-14T13:31:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.362+0000 7fa9f9ffb700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa9e40a1450 0x7fa9e40a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.363+0000 7fa9f9ffb700 1 -- 172.21.15.17:0/4015445291 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa9f40cbed0 con 0x7fa9fc0754a0 2023-07-14T13:31:51.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.363+0000 7faa0099b700 1 --2- 172.21.15.17:0/1152693259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 0x55f72259c040 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009bc0 tx=0x7fa9ec009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c0d34421dba33a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.364+0000 7fa9fbfff700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa9e40a1450 0x7fa9e40a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.364+0000 7fa9e2ffd700 1 -- 172.21.15.17:0/1152693259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec00eb60 con 0x55f7225a22d0 2023-07-14T13:31:51.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.364+0000 7fa9e2ffd700 1 -- 172.21.15.17:0/1152693259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9ec004cc0 con 0x55f7225a22d0 2023-07-14T13:31:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.364+0000 7fa9e2ffd700 1 -- 172.21.15.17:0/1152693259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec005550 con 0x55f7225a22d0 2023-07-14T13:31:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.365+0000 7faa16504b80 1 -- 172.21.15.17:0/1152693259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 msgr2=0x55f72259c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.365+0000 7fa9fbfff700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa9e40a1450 0x7fa9e40a3900 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0008000 tx=0x7fa9f001a040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.365+0000 7faa16504b80 1 --2- 172.21.15.17:0/1152693259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 0x55f72259c040 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009bc0 tx=0x7fa9ec009ed0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.365+0000 7faa16504b80 1 -- 172.21.15.17:0/1152693259 shutdown_connections 2023-07-14T13:31:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.365+0000 7faa16504b80 1 --2- 172.21.15.17:0/1152693259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f72259c580 0x55f72259c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.365+0000 7faa16504b80 1 --2- 172.21.15.17:0/1152693259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 0x55f7225a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.365+0000 7faa16504b80 1 --2- 172.21.15.17:0/1152693259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 0x55f72259c040 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.365+0000 7faa16504b80 1 -- 172.21.15.17:0/1152693259 >> 172.21.15.17:0/1152693259 conn(0x55f722591be0 msgr2=0x55f722596f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.366+0000 7faa16504b80 1 -- 172.21.15.17:0/1152693259 shutdown_connections 2023-07-14T13:31:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.366+0000 7faa16504b80 1 -- 172.21.15.17:0/1152693259 wait complete. 2023-07-14T13:31:51.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.366+0000 7faa16504b80 1 -- start start 2023-07-14T13:31:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.367+0000 7faa16504b80 1 Processor -- start 2023-07-14T13:31:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.368+0000 7faa16504b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 0x55f7225a8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.368+0000 7faa16504b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f72259c580 0x55f7225a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.368+0000 7faa16504b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 0x55f7225a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.368+0000 7faa16504b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72248da60 con 0x55f7225a22d0 2023-07-14T13:31:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.368+0000 7faa16504b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72248d760 con 0x55f7223f86b0 2023-07-14T13:31:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.368+0000 7faa16504b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7223718c0 con 0x55f72259c580 2023-07-14T13:31:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.368+0000 7faa16504b80 10 client.0 _ll_register_callbacks cb 0x55f72248b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:31:51.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.369+0000 7fa9fbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f72259c580 0x55f7225a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.369+0000 7fa9fbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f72259c580 0x55f7225a58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51606/0 (socket says 172.21.15.17:51606) 2023-07-14T13:31:51.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.369+0000 7fa9fbfff700 1 -- 172.21.15.17:0/4261588192 learned_addr learned my addr 172.21.15.17:0/4261588192 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.369+0000 7faa0119c700 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 0x55f7225a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.370+0000 7faa0099b700 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 0x55f7225a8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.370+0000 7fa9fbfff700 1 -- 172.21.15.17:0/4261588192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 msgr2=0x55f7225a8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.370+0000 7fa9fbfff700 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 0x55f7225a8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.370+0000 7fa9fbfff700 1 -- 172.21.15.17:0/4261588192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 msgr2=0x55f7225a5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.370+0000 7fa9fbfff700 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 0x55f7225a5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.370+0000 7fa9fbfff700 1 -- 172.21.15.17:0/4261588192 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec0098a0 con 0x55f72259c580 2023-07-14T13:31:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.370+0000 7fa9fbfff700 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f72259c580 0x55f7225a58a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0016000 tx=0x7fa9f0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32c836b621dfa9ff server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.370+0000 7fa9dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:31:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.370+0000 7fa9dbfff700 1 -- 172.21.15.17:0/4261588192 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f001d040 con 0x55f72259c580 2023-07-14T13:31:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.371+0000 7faa16504b80 1 -- 172.21.15.17:0/4261588192 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f722447490 con 0x55f72259c580 2023-07-14T13:31:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.371+0000 7fa9dbfff700 1 -- 172.21.15.17:0/4261588192 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa9f00052c0 con 0x55f72259c580 2023-07-14T13:31:51.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.371+0000 7fa9dbfff700 1 -- 172.21.15.17:0/4261588192 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9f000bbd0 con 0x55f72259c580 2023-07-14T13:31:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.371+0000 7faa16504b80 10 client.29530 fetch_fsmap learned FSMap version 68 2023-07-14T13:31:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.371+0000 7faa16504b80 1 -- 172.21.15.17:0/4261588192 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55f722304c00 con 0x55f72259c580 2023-07-14T13:31:51.372 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.372+0000 7fa9dbfff700 1 -- 172.21.15.17:0/4261588192 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f722447490 con 0x55f72259c580 2023-07-14T13:31:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.373+0000 7fa9dbfff700 1 -- 172.21.15.17:0/4261588192 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa9f0003680 con 0x55f72259c580 2023-07-14T13:31:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.373+0000 7faa16504b80 10 client.29530 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:31:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.373+0000 7faa16504b80 10 client.29530 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:31:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.373+0000 7faa16504b80 20 client.29530 populate_metadata read hostname 'smithi017' 2023-07-14T13:31:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.373+0000 7faa16504b80 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7225c6bb0 0x55f7225c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.373+0000 7faa16504b80 4 client.29530 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:31:51.373 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.373+0000 7faa16504b80 1 -- 172.21.15.17:0/4261588192 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7224e6e50 con 0x55f7225c6bb0 2023-07-14T13:31:51.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.373+0000 7faa0099b700 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7225c6bb0 0x55f7225c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.374+0000 7faa0099b700 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7225c6bb0 0x55f7225c8fc0 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcb206e324ff3702 server_cookie=64865535cc70b16 in_seq=0 out_seq=0 2023-07-14T13:31:51.374 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.374+0000 7fa9dbfff700 10 client.29530 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:51.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.375+0000 7fa9dbfff700 1 -- 172.21.15.17:0/4261588192 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f7224e6e50 con 0x55f7225c6bb0 2023-07-14T13:31:51.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.375+0000 7fa9dbfff700 10 client.29530 handle_command_reply: tid=0 2023-07-14T13:31:51.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.375+0000 7faa16504b80 1 client.29530 shutdown 2023-07-14T13:31:51.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.375+0000 7faa16504b80 1 -- 172.21.15.17:0/4261588192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f72259c580 msgr2=0x55f7225a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:51.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.375+0000 7faa16504b80 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f72259c580 0x55f7225a58a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0016000 tx=0x7fa9f0009260 comp rx=0 tx=0).stop 2023-07-14T13:31:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.375+0000 7faa16504b80 1 -- 172.21.15.17:0/4261588192 shutdown_connections 2023-07-14T13:31:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.375+0000 7faa16504b80 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f7225c6bb0 0x55f7225c8fc0 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.376+0000 7faa16504b80 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7225a22d0 0x55f7225a5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.376+0000 7faa16504b80 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 0x55f7225a8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.376+0000 7faa16504b80 1 --2- 172.21.15.17:0/4261588192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f72259c580 0x55f7225a58a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.376 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.376+0000 7faa16504b80 1 -- 172.21.15.17:0/4261588192 >> 172.21.15.17:0/4261588192 conn(0x55f722591be0 msgr2=0x55f7225964e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.376+0000 7fa9dbfff700 0 client.29530 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.376+0000 7faa16504b80 1 -- 172.21.15.17:0/4261588192 shutdown_connections 2023-07-14T13:31:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.376+0000 7faa16504b80 1 -- 172.21.15.17:0/4261588192 wait complete. 2023-07-14T13:31:51.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.376+0000 7faa16504b80 20 client.29530 trim_cache size 0 max 16384 2023-07-14T13:31:51.397 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.399+0000 7faa16504b80 1 Processor -- start 2023-07-14T13:31:51.398 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.399+0000 7faa16504b80 1 -- start start 2023-07-14T13:31:51.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7faa16504b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7223f86b0 0x55f722596c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7faa16504b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f72259c580 0x55f7225a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7faa16504b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f7225a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7faa16504b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7225a1a10 con 0x55f7223f86b0 2023-07-14T13:31:51.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7faa16504b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7225a6e80 con 0x55f72259c580 2023-07-14T13:31:51.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7faa16504b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7225985b0 con 0x55f7225a22d0 2023-07-14T13:31:51.399 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7fa9fbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f72259c580 0x55f7225a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7faa0119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f7225a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7fa9fbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f72259c580 0x55f7225a81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:41506/0 (socket says 172.21.15.17:41506) 2023-07-14T13:31:51.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7fa9fbfff700 1 -- 172.21.15.17:0/3938198431 learned_addr learned my addr 172.21.15.17:0/3938198431 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:51.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7faa0119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f7225a50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51616/0 (socket says 172.21.15.17:51616) 2023-07-14T13:31:51.400 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.400+0000 7faa0099b700 1 --2- 172.21.15.17:0/3938198431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7223f86b0 0x55f722596c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.401+0000 7faa0119c700 1 -- 172.21.15.17:0/3938198431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f72259c580 msgr2=0x55f7225a81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:51.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.401+0000 7faa0119c700 1 --2- 172.21.15.17:0/3938198431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f72259c580 0x55f7225a81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.401+0000 7faa0119c700 1 -- 172.21.15.17:0/3938198431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7223f86b0 msgr2=0x55f722596c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:51.401 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.401+0000 7faa0119c700 1 --2- 172.21.15.17:0/3938198431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7223f86b0 0x55f722596c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.401+0000 7faa0119c700 1 -- 172.21.15.17:0/3938198431 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7223421f0 con 0x55f7225a22d0 2023-07-14T13:31:51.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.401+0000 7faa0119c700 1 --2- 172.21.15.17:0/3938198431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f7225a50a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40c9640 tx=0x7fa9f40989a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=699b1803e420b1ba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:51.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.402+0000 7fa9e37fe700 1 -- 172.21.15.17:0/3938198431 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40a1410 con 0x55f7225a22d0 2023-07-14T13:31:51.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.402+0000 7fa9e37fe700 1 -- 172.21.15.17:0/3938198431 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9f400cdd0 con 0x55f7225a22d0 2023-07-14T13:31:51.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.402+0000 7fa9e37fe700 1 -- 172.21.15.17:0/3938198431 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40986f0 con 0x55f7225a22d0 2023-07-14T13:31:51.402 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.403+0000 7faa16504b80 1 -- 172.21.15.17:0/3938198431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 msgr2=0x55f7225a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:51.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.403+0000 7faa16504b80 1 --2- 172.21.15.17:0/3938198431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f7225a50a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa9f40c9640 tx=0x7fa9f40989a0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.403+0000 7faa16504b80 1 -- 172.21.15.17:0/3938198431 shutdown_connections 2023-07-14T13:31:51.403 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.403+0000 7faa16504b80 1 --2- 172.21.15.17:0/3938198431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f7225a50a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.403+0000 7faa16504b80 1 --2- 172.21.15.17:0/3938198431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f7223f86b0 0x55f722596c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.403+0000 7faa16504b80 1 --2- 172.21.15.17:0/3938198431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f72259c580 0x55f7225a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.403+0000 7faa16504b80 1 -- 172.21.15.17:0/3938198431 >> 172.21.15.17:0/3938198431 conn(0x55f722591be0 msgr2=0x55f72259fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:51.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.403+0000 7faa16504b80 1 -- 172.21.15.17:0/3938198431 shutdown_connections 2023-07-14T13:31:51.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.403+0000 7faa16504b80 1 -- 172.21.15.17:0/3938198431 wait complete. 2023-07-14T13:31:51.404 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.404+0000 7faa16504b80 1 -- start start 2023-07-14T13:31:51.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.404+0000 7faa16504b80 1 Processor -- start 2023-07-14T13:31:51.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.405+0000 7faa16504b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 0x55f7225aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.405 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.405+0000 7faa16504b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f72259c580 0x55f7225ab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.405+0000 7faa16504b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f722613a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.405+0000 7faa16504b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f722613fa0 con 0x55f72259c580 2023-07-14T13:31:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.405+0000 7faa16504b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f722614110 con 0x55f7223f86b0 2023-07-14T13:31:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.405+0000 7faa16504b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7226142d0 con 0x55f7225a22d0 2023-07-14T13:31:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.405+0000 7faa16504b80 10 client.0 _ll_register_callbacks cb 0x7fa9f000f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:31:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.406+0000 7faa0119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f722613a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.406+0000 7faa0119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f722613a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:51630/0 (socket says 172.21.15.17:51630) 2023-07-14T13:31:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.406+0000 7faa0119c700 1 -- 172.21.15.17:0/502606051 learned_addr learned my addr 172.21.15.17:0/502606051 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:31:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.406+0000 7faa0099b700 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 0x55f7225aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.406+0000 7fa9fbfff700 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f72259c580 0x55f7225ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.406+0000 7faa0119c700 1 -- 172.21.15.17:0/502606051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 msgr2=0x55f7225aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:51.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.406+0000 7faa0119c700 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 0x55f7225aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.406+0000 7faa0119c700 1 -- 172.21.15.17:0/502606051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f72259c580 msgr2=0x55f7225ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:31:51.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.406+0000 7faa0119c700 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f72259c580 0x55f7225ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.406+0000 7faa0119c700 1 -- 172.21.15.17:0/502606051 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc071ba0 con 0x55f7225a22d0 2023-07-14T13:31:51.408 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.407+0000 7faa0119c700 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f722613a60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4098f50 tx=0x7fa9f4007400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30e6e31a48f4ea9f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:31:51.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.407+0000 7fa9dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:31:51.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.407+0000 7fa9dbfff700 1 -- 172.21.15.17:0/502606051 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40a1410 con 0x55f7225a22d0 2023-07-14T13:31:51.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.407+0000 7fa9dbfff700 1 -- 172.21.15.17:0/502606051 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa9f40c92f0 con 0x55f7225a22d0 2023-07-14T13:31:51.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.407+0000 7faa16504b80 1 -- 172.21.15.17:0/502606051 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa9ec004cc0 con 0x55f7225a22d0 2023-07-14T13:31:51.409 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.408+0000 7fa9dbfff700 1 -- 172.21.15.17:0/502606051 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9f4099220 con 0x55f7225a22d0 2023-07-14T13:31:51.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.408+0000 7faa16504b80 10 client.29536 fetch_fsmap learned FSMap version 68 2023-07-14T13:31:51.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.408+0000 7faa16504b80 1 -- 172.21.15.17:0/502606051 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55f72231a250 con 0x55f7225a22d0 2023-07-14T13:31:51.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.408+0000 7fa9dbfff700 1 -- 172.21.15.17:0/502606051 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9ec004cc0 con 0x55f7225a22d0 2023-07-14T13:31:51.410 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.409+0000 7fa9dbfff700 1 -- 172.21.15.17:0/502606051 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa9f40a0f80 con 0x55f7225a22d0 2023-07-14T13:31:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.409+0000 7faa16504b80 10 client.29536 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:31:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.409+0000 7faa16504b80 10 client.29536 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:31:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.409+0000 7faa16504b80 20 client.29536 populate_metadata read hostname 'smithi017' 2023-07-14T13:31:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.409+0000 7faa16504b80 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f72261b600 0x55f72261d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:31:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.409+0000 7faa16504b80 4 client.29536 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:31:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.409+0000 7faa16504b80 1 -- 172.21.15.17:0/502606051 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f7224a8ff0 con 0x55f72261b600 2023-07-14T13:31:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.409+0000 7faa0099b700 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f72261b600 0x55f72261d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:31:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.410+0000 7faa0099b700 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f72261b600 0x55f72261d9e0 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c8eb58f2864f8a server_cookie=6536fa07e3d7ccbb in_seq=0 out_seq=0 2023-07-14T13:31:51.412 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.410+0000 7fa9dbfff700 10 client.29536 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.474+0000 7fa9dbfff700 1 -- 172.21.15.17:0/502606051 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f7224a8ff0 con 0x55f72261b600 2023-07-14T13:31:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.474+0000 7fa9dbfff700 10 client.29536 handle_command_reply: tid=0 2023-07-14T13:31:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.475+0000 7faa16504b80 1 client.29536 shutdown 2023-07-14T13:31:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.476+0000 7faa16504b80 1 -- 172.21.15.17:0/502606051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 msgr2=0x55f722613a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.476+0000 7faa16504b80 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f722613a60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4098f50 tx=0x7fa9f4007400 comp rx=0 tx=0).stop 2023-07-14T13:31:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.476+0000 7faa16504b80 1 -- 172.21.15.17:0/502606051 shutdown_connections 2023-07-14T13:31:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.476+0000 7faa16504b80 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f72261b600 0x55f72261d9e0 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.476+0000 7faa16504b80 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f7225a22d0 0x55f722613a60 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.476+0000 7faa16504b80 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7223f86b0 0x55f7225aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.476+0000 7faa16504b80 1 --2- 172.21.15.17:0/502606051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f72259c580 0x55f7225ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.476+0000 7fa9dbfff700 0 client.29536 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:31:51.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.476+0000 7faa16504b80 1 -- 172.21.15.17:0/502606051 >> 172.21.15.17:0/502606051 conn(0x55f722591be0 msgr2=0x55f7225a0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:51.476 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.477+0000 7faa16504b80 1 -- 172.21.15.17:0/502606051 shutdown_connections 2023-07-14T13:31:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:31:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:31:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:31:51.486 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:31:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.477+0000 7faa16504b80 1 -- 172.21.15.17:0/502606051 wait complete. 2023-07-14T13:31:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.478+0000 7faa16504b80 20 client.29536 trim_cache size 0 max 16384 2023-07-14T13:31:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.487+0000 7faa02bff700 1 -- 172.21.15.17:0/4015445291 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa9e40a1450 msgr2=0x7fa9e40a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:51.487 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.487+0000 7faa02bff700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa9e40a1450 0x7fa9e40a3900 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0008000 tx=0x7fa9f001a040 comp rx=0 tx=0).stop 2023-07-14T13:31:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.487+0000 7faa02bff700 1 -- 172.21.15.17:0/4015445291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9fc0754a0 msgr2=0x7fa9fc070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:31:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.487+0000 7faa02bff700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9fc0754a0 0x7fa9fc070ac0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400ef30 tx=0x7fa9f400c3a0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.488+0000 7faa02bff700 1 -- 172.21.15.17:0/4015445291 shutdown_connections 2023-07-14T13:31:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.488+0000 7faa02bff700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa9e40a1450 0x7fa9e40a3900 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.488+0000 7faa02bff700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9fc0754a0 0x7fa9fc070ac0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.488+0000 7faa02bff700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9fc101f80 0x7fa9fc074a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.488+0000 7faa02bff700 1 --2- 172.21.15.17:0/4015445291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9fc106fc0 0x7fa9fc074f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:31:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.488+0000 7faa02bff700 1 -- 172.21.15.17:0/4015445291 >> 172.21.15.17:0/4015445291 conn(0x7fa9fc0fd7d0 msgr2=0x7fa9fc0ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:31:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.489+0000 7faa02bff700 1 -- 172.21.15.17:0/4015445291 shutdown_connections 2023-07-14T13:31:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:31:51.489+0000 7faa02bff700 1 -- 172.21.15.17:0/4015445291 wait complete. 2023-07-14T13:31:52.418 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 820.0 s, 462.0 tps, lat 220.449 ms stddev 73.203 2023-07-14T13:31:54.075 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:53 smithi017 ceph-mon[95536]: pgmap v1019: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.25k op/s 2023-07-14T13:31:54.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:53 smithi135 ceph-mon[97338]: pgmap v1019: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.25k op/s 2023-07-14T13:31:54.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:53 smithi131 ceph-mon[96953]: pgmap v1019: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.25k op/s 2023-07-14T13:31:56.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:55 smithi017 ceph-mon[95536]: pgmap v1020: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:31:56.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:55 smithi135 ceph-mon[97338]: pgmap v1020: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:31:56.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:55 smithi131 ceph-mon[96953]: pgmap v1020: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:31:57.418 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 825.0 s, 538.6 tps, lat 185.235 ms stddev 54.668 2023-07-14T13:31:58.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:57 smithi017 ceph-mon[95536]: pgmap v1021: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 17 MiB/s wr, 1.84k op/s 2023-07-14T13:31:58.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:57 smithi135 ceph-mon[97338]: pgmap v1021: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 17 MiB/s wr, 1.84k op/s 2023-07-14T13:31:58.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:57 smithi131 ceph-mon[96953]: pgmap v1021: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 17 MiB/s wr, 1.84k op/s 2023-07-14T13:32:00.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:31:59 smithi017 ceph-mon[95536]: pgmap v1022: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 12 MiB/s wr, 1.28k op/s 2023-07-14T13:32:00.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:31:59 smithi135 ceph-mon[97338]: pgmap v1022: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 12 MiB/s wr, 1.28k op/s 2023-07-14T13:32:00.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:31:59 smithi131 ceph-mon[96953]: pgmap v1022: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 12 MiB/s wr, 1.28k op/s 2023-07-14T13:32:02.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:01 smithi017 ceph-mon[95536]: pgmap v1023: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 17 MiB/s wr, 1.75k op/s 2023-07-14T13:32:02.170 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:01 smithi135 ceph-mon[97338]: pgmap v1023: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 17 MiB/s wr, 1.75k op/s 2023-07-14T13:32:02.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:01 smithi131 ceph-mon[96953]: pgmap v1023: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 17 MiB/s wr, 1.75k op/s 2023-07-14T13:32:02.426 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 830.0 s, 534.2 tps, lat 168.325 ms stddev 108.388 2023-07-14T13:32:04.085 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:03 smithi017 ceph-mon[95536]: pgmap v1024: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2023-07-14T13:32:04.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:03 smithi135 ceph-mon[97338]: pgmap v1024: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2023-07-14T13:32:04.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:03 smithi131 ceph-mon[96953]: pgmap v1024: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 12 MiB/s wr, 1.30k op/s 2023-07-14T13:32:04.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.802+0000 7fd1e81ff700 1 -- 172.21.15.17:0/3565927410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e0119360 msgr2=0x7fd1e011b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.802+0000 7fd1e81ff700 1 --2- 172.21.15.17:0/3565927410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e0119360 0x7fd1e011b740 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800b0a0 tx=0x7fd1d800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.807+0000 7fd1e81ff700 1 -- 172.21.15.17:0/3565927410 shutdown_connections 2023-07-14T13:32:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.807+0000 7fd1e81ff700 1 --2- 172.21.15.17:0/3565927410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e0119360 0x7fd1e011b740 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.807+0000 7fd1e81ff700 1 --2- 172.21.15.17:0/3565927410 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e0080d20 0x7fd1e0078e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.805 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.807+0000 7fd1e81ff700 1 --2- 172.21.15.17:0/3565927410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e0081180 0x7fd1e0079360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.807+0000 7fd1e81ff700 1 -- 172.21.15.17:0/3565927410 >> 172.21.15.17:0/3565927410 conn(0x7fd1e0075a20 msgr2=0x7fd1e0077e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:04.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.810+0000 7fd1e81ff700 1 -- 172.21.15.17:0/3565927410 shutdown_connections 2023-07-14T13:32:04.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.816+0000 7fd1e81ff700 1 -- 172.21.15.17:0/3565927410 wait complete. 2023-07-14T13:32:04.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.817+0000 7fd1e81ff700 1 Processor -- start 2023-07-14T13:32:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.821+0000 7fd1e81ff700 1 -- start start 2023-07-14T13:32:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.822+0000 7fd1e81ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e0080d20 0x7fd1e0071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.822+0000 7fd1e81ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e0081180 0x7fd1e0071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.822+0000 7fd1e81ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e0119360 0x7fd1e006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.822+0000 7fd1e81ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e006bfb0 con 0x7fd1e0081180 2023-07-14T13:32:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.822+0000 7fd1e81ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e006c120 con 0x7fd1e0119360 2023-07-14T13:32:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.822+0000 7fd1e81ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e006c2e0 con 0x7fd1e0080d20 2023-07-14T13:32:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.823+0000 7fd1e679c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e0119360 0x7fd1e006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.825+0000 7fd1e679c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e0119360 0x7fd1e006b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40752/0 (socket says 172.21.15.17:40752) 2023-07-14T13:32:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.825+0000 7fd1e679c700 1 -- 172.21.15.17:0/50505431 learned_addr learned my addr 172.21.15.17:0/50505431 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.826+0000 7fd1e579a700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e0081180 0x7fd1e0071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.827+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e0080d20 0x7fd1e0071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.828+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/50505431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e0119360 msgr2=0x7fd1e006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.828+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e0119360 0x7fd1e006b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.828+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/50505431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e0081180 msgr2=0x7fd1e0071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.828+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e0081180 0x7fd1e0071f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.828+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/50505431 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d8009d00 con 0x7fd1e0080d20 2023-07-14T13:32:04.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.828+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e0080d20 0x7fd1e0071a10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000d950 tx=0x7fd1d000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:04.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.831+0000 7fd1d6ffd700 1 -- 172.21.15.17:0/50505431 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0009930 con 0x7fd1e0080d20 2023-07-14T13:32:04.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.832+0000 7fd1d6ffd700 1 -- 172.21.15.17:0/50505431 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1d0010460 con 0x7fd1e0080d20 2023-07-14T13:32:04.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.832+0000 7fd1d6ffd700 1 -- 172.21.15.17:0/50505431 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d000b5d0 con 0x7fd1e0080d20 2023-07-14T13:32:04.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.833+0000 7fd1e81ff700 1 -- 172.21.15.17:0/50505431 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e006c5c0 con 0x7fd1e0080d20 2023-07-14T13:32:04.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.833+0000 7fd1e81ff700 1 -- 172.21.15.17:0/50505431 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e01ba150 con 0x7fd1e0080d20 2023-07-14T13:32:04.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.840+0000 7fd1fbb00b80 1 Processor -- start 2023-07-14T13:32:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.841+0000 7fd1fbb00b80 1 -- start start 2023-07-14T13:32:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.841+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4a256b0 0x5631f4bced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.841+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bcf2d0 0x5631f4bc9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.841+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bc9580 0x5631f4bc99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.841+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f4acec50 con 0x5631f4bcf2d0 2023-07-14T13:32:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.841+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f4b219e0 con 0x5631f4bc9580 2023-07-14T13:32:04.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.841+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f4b1ae70 con 0x5631f4a256b0 2023-07-14T13:32:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.842+0000 7fd1e579a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bc9580 0x5631f4bc99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.842+0000 7fd1e579a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bc9580 0x5631f4bc99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40758/0 (socket says 172.21.15.17:40758) 2023-07-14T13:32:04.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.842+0000 7fd1e579a700 1 -- 172.21.15.17:0/2842567229 learned_addr learned my addr 172.21.15.17:0/2842567229 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:04.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.845+0000 7fd1d6ffd700 1 -- 172.21.15.17:0/50505431 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd1d0009a90 con 0x7fd1e0080d20 2023-07-14T13:32:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.847+0000 7fd1e679c700 1 --2- 172.21.15.17:0/2842567229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4a256b0 0x5631f4bced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.848+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/2842567229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bcf2d0 0x5631f4bc9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.849+0000 7fd1d6ffd700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1cc0a14d0 0x7fd1cc0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.847 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.849+0000 7fd1d6ffd700 1 -- 172.21.15.17:0/50505431 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd1d00cc2f0 con 0x7fd1e0080d20 2023-07-14T13:32:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.850+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/2842567229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4a256b0 msgr2=0x5631f4bced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.850+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/2842567229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4a256b0 0x5631f4bced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.850+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/2842567229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bc9580 msgr2=0x5631f4bc99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.850+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/2842567229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bc9580 0x5631f4bc99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.850+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/2842567229 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631f4948d80 con 0x5631f4bcf2d0 2023-07-14T13:32:04.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.850+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/2842567229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bcf2d0 0x5631f4bc9040 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00c9a00 tx=0x7fd1d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edddc9d5c0685e57 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:04.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.851+0000 7fd1cbfff700 1 -- 172.21.15.17:0/2842567229 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0098f40 con 0x5631f4bcf2d0 2023-07-14T13:32:04.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.851+0000 7fd1cbfff700 1 -- 172.21.15.17:0/2842567229 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1d0098d60 con 0x5631f4bcf2d0 2023-07-14T13:32:04.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.851+0000 7fd1cbfff700 1 -- 172.21.15.17:0/2842567229 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00a18e0 con 0x5631f4bcf2d0 2023-07-14T13:32:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.852+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2842567229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bcf2d0 msgr2=0x5631f4bc9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.852+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/2842567229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bcf2d0 0x5631f4bc9040 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00c9a00 tx=0x7fd1d0000bc0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.858+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2842567229 shutdown_connections 2023-07-14T13:32:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.858+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/2842567229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bc9580 0x5631f4bc99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.858+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/2842567229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4a256b0 0x5631f4bced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.858+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/2842567229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bcf2d0 0x5631f4bc9040 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.858+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2842567229 >> 172.21.15.17:0/2842567229 conn(0x5631f4bbebe0 msgr2=0x5631f4bc3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:04.862 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.865+0000 7fd1e679c700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1cc0a14d0 0x7fd1cc0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.864 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.866+0000 7fd1e679c700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1cc0a14d0 0x7fd1cc0a3980 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009fd0 tx=0x7fd1d80099e0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:04.866 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.869+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2842567229 shutdown_connections 2023-07-14T13:32:04.871 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.872+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2842567229 wait complete. 2023-07-14T13:32:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.873+0000 7fd1fbb00b80 1 -- start start 2023-07-14T13:32:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.874+0000 7fd1fbb00b80 1 Processor -- start 2023-07-14T13:32:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.874+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4a256b0 0x5631f4bd5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.875+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bc9580 0x5631f4bd2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.875+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4bcf2d0 0x5631f4bd2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.875+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f4abaa60 con 0x5631f4bc9580 2023-07-14T13:32:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.875+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f4aba760 con 0x5631f4a256b0 2023-07-14T13:32:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.875+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f499e8c0 con 0x5631f4bcf2d0 2023-07-14T13:32:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.875+0000 7fd1fbb00b80 10 client.0 _ll_register_callbacks cb 0x5631f4ab8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:32:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.876+0000 7fd1e5f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4a256b0 0x5631f4bd5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.876+0000 7fd1e5f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4a256b0 0x5631f4bd5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:45612/0 (socket says 172.21.15.17:45612) 2023-07-14T13:32:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.876+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/1375142329 learned_addr learned my addr 172.21.15.17:0/1375142329 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.877+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/1375142329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4bcf2d0 msgr2=0x5631f4bd2d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:32:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.877+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/1375142329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4bcf2d0 0x5631f4bd2d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.877+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/1375142329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bc9580 msgr2=0x5631f4bd2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.877+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/1375142329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bc9580 0x5631f4bd2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.877+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/1375142329 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e01ba150 con 0x5631f4a256b0 2023-07-14T13:32:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.877+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/1375142329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4a256b0 0x5631f4bd5570 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0010bd0 tx=0x7fd1d00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52889f4444ff728f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.878+0000 7fd1c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:32:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.878+0000 7fd1c97fa700 1 -- 172.21.15.17:0/1375142329 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0010820 con 0x5631f4a256b0 2023-07-14T13:32:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.878+0000 7fd1c97fa700 1 -- 172.21.15.17:0/1375142329 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd1d0099400 con 0x5631f4a256b0 2023-07-14T13:32:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.878+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/1375142329 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631f4a74490 con 0x5631f4a256b0 2023-07-14T13:32:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.879+0000 7fd1c97fa700 1 -- 172.21.15.17:0/1375142329 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1d0009d40 con 0x5631f4a256b0 2023-07-14T13:32:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.879+0000 7fd1fbb00b80 10 client.29609 fetch_fsmap learned FSMap version 68 2023-07-14T13:32:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.879+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/1375142329 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5631f4931c00 con 0x5631f4a256b0 2023-07-14T13:32:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.882+0000 7fd1c97fa700 1 -- 172.21.15.17:0/1375142329 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5631f4a74490 con 0x5631f4a256b0 2023-07-14T13:32:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.882+0000 7fd1c97fa700 1 -- 172.21.15.17:0/1375142329 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd1d0099660 con 0x5631f4a256b0 2023-07-14T13:32:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.882+0000 7fd1fbb00b80 10 client.29609 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:32:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.882+0000 7fd1fbb00b80 10 client.29609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:32:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.882+0000 7fd1fbb00b80 20 client.29609 populate_metadata read hostname 'smithi017' 2023-07-14T13:32:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.883+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/1375142329 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5631f4be2580 0x5631f4be49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.883+0000 7fd1fbb00b80 4 client.29609 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:32:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.883+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/1375142329 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5631f4b13e50 con 0x5631f4be2580 2023-07-14T13:32:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.884+0000 7fd1e579a700 1 --2- 172.21.15.17:0/1375142329 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5631f4be2580 0x5631f4be49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.886+0000 7fd1e579a700 1 --2- 172.21.15.17:0/1375142329 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5631f4be2580 0x5631f4be49a0 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bbeb9157dd8d502 server_cookie=c5392342bf929383 in_seq=0 out_seq=0 2023-07-14T13:32:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.886+0000 7fd1c97fa700 10 client.29609 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.887+0000 7fd1c97fa700 1 -- 172.21.15.17:0/1375142329 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5631f4b13e50 con 0x5631f4be2580 2023-07-14T13:32:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.887+0000 7fd1c97fa700 10 client.29609 handle_command_reply: tid=0 2023-07-14T13:32:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.887+0000 7fd1fbb00b80 1 client.29609 shutdown 2023-07-14T13:32:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.888+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/1375142329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4a256b0 msgr2=0x5631f4bd5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.888+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/1375142329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4a256b0 0x5631f4bd5570 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0010bd0 tx=0x7fd1d00057f0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.888+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/1375142329 shutdown_connections 2023-07-14T13:32:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.888+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/1375142329 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5631f4be2580 0x5631f4be49a0 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.888+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/1375142329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4bcf2d0 0x5631f4bd2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.888+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/1375142329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4a256b0 0x5631f4bd5570 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.888+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/1375142329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bc9580 0x5631f4bd2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.887 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.888+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/1375142329 >> 172.21.15.17:0/1375142329 conn(0x5631f4bbebe0 msgr2=0x5631f4bc34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.889+0000 7fd1c97fa700 0 client.29609 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.889+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/1375142329 shutdown_connections 2023-07-14T13:32:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.889+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/1375142329 wait complete. 2023-07-14T13:32:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.890+0000 7fd1fbb00b80 20 client.29609 trim_cache size 0 max 16384 2023-07-14T13:32:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.921+0000 7fd1fbb00b80 1 Processor -- start 2023-07-14T13:32:04.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.921+0000 7fd1fbb00b80 1 -- start start 2023-07-14T13:32:04.920 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.922+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bbebe0 0x5631f4bc9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.922+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4a256b0 0x5631f4bd2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.922+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4bc9580 0x5631f4bd9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.922+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f4bbbbb0 con 0x5631f4bbebe0 2023-07-14T13:32:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.922+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f4bc5800 con 0x5631f4a256b0 2023-07-14T13:32:04.921 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.922+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f4bc05f0 con 0x5631f4bc9580 2023-07-14T13:32:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.923+0000 7fd1e5f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bbebe0 0x5631f4bc9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.923+0000 7fd1e5f9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bbebe0 0x5631f4bc9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44664/0 (socket says 172.21.15.17:44664) 2023-07-14T13:32:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.923+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/25813112 learned_addr learned my addr 172.21.15.17:0/25813112 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.923+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/25813112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4bc9580 msgr2=0x5631f4bd9c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:32:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.923+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/25813112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4bc9580 0x5631f4bd9c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.923+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/25813112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4a256b0 msgr2=0x5631f4bd2730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:32:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.923+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/25813112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4a256b0 0x5631f4bd2730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.923+0000 7fd1e5f9b700 1 -- 172.21.15.17:0/25813112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631f4be9610 con 0x5631f4bbebe0 2023-07-14T13:32:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.926+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/25813112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bbebe0 0x5631f4bc9040 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009520 tx=0x7fd1d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23f7c4e42f98258 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:04.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.928+0000 7fd1d4ff9700 1 -- 172.21.15.17:0/25813112 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0098b80 con 0x5631f4bbebe0 2023-07-14T13:32:04.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.928+0000 7fd1d4ff9700 1 -- 172.21.15.17:0/25813112 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1d0010820 con 0x5631f4bbebe0 2023-07-14T13:32:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.928+0000 7fd1d4ff9700 1 -- 172.21.15.17:0/25813112 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00043f0 con 0x5631f4bbebe0 2023-07-14T13:32:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.942+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/25813112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bbebe0 msgr2=0x5631f4bc9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:04.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.942+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/25813112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bbebe0 0x5631f4bc9040 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009520 tx=0x7fd1d0000bc0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.953+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/25813112 shutdown_connections 2023-07-14T13:32:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.953+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/25813112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4bc9580 0x5631f4bd9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.953+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/25813112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bbebe0 0x5631f4bc9040 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.953+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/25813112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4a256b0 0x5631f4bd2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.953+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/25813112 >> 172.21.15.17:0/25813112 conn(0x5631f4be48f0 msgr2=0x5631f4bd2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:04.954 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.956+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/25813112 shutdown_connections 2023-07-14T13:32:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.957+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/25813112 wait complete. 2023-07-14T13:32:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.957+0000 7fd1fbb00b80 1 -- start start 2023-07-14T13:32:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.958+0000 7fd1fbb00b80 1 Processor -- start 2023-07-14T13:32:04.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.959+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4a256b0 0x5631f4bcb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.959+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bbebe0 0x5631f4bcbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.959+0000 7fd1fbb00b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bc9580 0x5631f4bca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.959+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f4bcc5b0 con 0x5631f4bc9580 2023-07-14T13:32:04.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.959+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f4bcacd0 con 0x5631f4bbebe0 2023-07-14T13:32:04.960 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.959+0000 7fd1fbb00b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631f4bcae60 con 0x5631f4a256b0 2023-07-14T13:32:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.959+0000 7fd1fbb00b80 10 client.0 _ll_register_callbacks cb 0x5631f4ab8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:32:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.960+0000 7fd1e579a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bbebe0 0x5631f4bcbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.960+0000 7fd1e579a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bbebe0 0x5631f4bcbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:45630/0 (socket says 172.21.15.17:45630) 2023-07-14T13:32:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.960+0000 7fd1e579a700 1 -- 172.21.15.17:0/2692006609 learned_addr learned my addr 172.21.15.17:0/2692006609 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.961+0000 7fd1e679c700 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bc9580 0x5631f4bca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.961+0000 7fd1e579a700 1 -- 172.21.15.17:0/2692006609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4a256b0 msgr2=0x5631f4bcb960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T13:32:04.961 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.961+0000 7fd1e579a700 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4a256b0 0x5631f4bcb960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.961+0000 7fd1e579a700 1 -- 172.21.15.17:0/2692006609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bc9580 msgr2=0x5631f4bca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.961+0000 7fd1e579a700 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bc9580 0x5631f4bca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.961+0000 7fd1e579a700 1 -- 172.21.15.17:0/2692006609 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631f4931c00 con 0x5631f4bbebe0 2023-07-14T13:32:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.962+0000 7fd1e579a700 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bbebe0 0x5631f4bcbea0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x5631f4be52f0 tx=0x7fd1dc019d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fc1643c84344dfd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:04.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.962+0000 7fd1c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:32:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.963+0000 7fd1c97fa700 1 -- 172.21.15.17:0/2692006609 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc019350 con 0x5631f4bbebe0 2023-07-14T13:32:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.963+0000 7fd1c97fa700 1 -- 172.21.15.17:0/2692006609 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd1dc0194b0 con 0x5631f4bbebe0 2023-07-14T13:32:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.963+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2692006609 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1d0098d60 con 0x5631f4bbebe0 2023-07-14T13:32:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.963+0000 7fd1c97fa700 1 -- 172.21.15.17:0/2692006609 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1dc022410 con 0x5631f4bbebe0 2023-07-14T13:32:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.963+0000 7fd1fbb00b80 10 client.29612 fetch_fsmap learned FSMap version 68 2023-07-14T13:32:04.963 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.963+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2692006609 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5631f496f1f0 con 0x5631f4bbebe0 2023-07-14T13:32:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.964+0000 7fd1c97fa700 1 -- 172.21.15.17:0/2692006609 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1d0098d60 con 0x5631f4bbebe0 2023-07-14T13:32:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.964+0000 7fd1c97fa700 1 -- 172.21.15.17:0/2692006609 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd1dc015520 con 0x5631f4bbebe0 2023-07-14T13:32:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.965+0000 7fd1fbb00b80 10 client.29612 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:32:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.965+0000 7fd1fbb00b80 10 client.29612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:32:04.964 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.965+0000 7fd1fbb00b80 20 client.29612 populate_metadata read hostname 'smithi017' 2023-07-14T13:32:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.966+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5631f4bcf2d0 0x5631f4c392a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.966+0000 7fd1fbb00b80 4 client.29612 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:32:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.966+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2692006609 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5631f4ad5ff0 con 0x5631f4bcf2d0 2023-07-14T13:32:04.965 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.966+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5631f4bcf2d0 0x5631f4c392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.967+0000 7fd1e5f9b700 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5631f4bcf2d0 0x5631f4c392a0 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6de64cb19dd2b8c8 server_cookie=ee454e0e56fdc23c in_seq=0 out_seq=0 2023-07-14T13:32:04.966 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:04.967+0000 7fd1c97fa700 10 client.29612 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:05.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.024+0000 7fd1c97fa700 1 -- 172.21.15.17:0/2692006609 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5631f4ad5ff0 con 0x5631f4bcf2d0 2023-07-14T13:32:05.022 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.024+0000 7fd1c97fa700 10 client.29612 handle_command_reply: tid=0 2023-07-14T13:32:05.035 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.037+0000 7fd1fbb00b80 1 client.29612 shutdown 2023-07-14T13:32:05.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.040+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2692006609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bbebe0 msgr2=0x5631f4bcbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.040+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bbebe0 0x5631f4bcbea0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x5631f4be52f0 tx=0x7fd1dc019d80 comp rx=0 tx=0).stop 2023-07-14T13:32:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.047+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2692006609 shutdown_connections 2023-07-14T13:32:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.047+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x5631f4bcf2d0 0x5631f4c392a0 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.047+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5631f4bc9580 0x5631f4bca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.047+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631f4a256b0 0x5631f4bcb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.047+0000 7fd1fbb00b80 1 --2- 172.21.15.17:0/2692006609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631f4bbebe0 0x5631f4bcbea0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.047+0000 7fd1c97fa700 0 client.29612 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:05.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.047+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2692006609 >> 172.21.15.17:0/2692006609 conn(0x5631f4be48f0 msgr2=0x5631f4bd0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:32:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:32:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:32:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:32:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.050+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2692006609 shutdown_connections 2023-07-14T13:32:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.050+0000 7fd1fbb00b80 1 -- 172.21.15.17:0/2692006609 wait complete. 2023-07-14T13:32:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.053+0000 7fd1fbb00b80 20 client.29612 trim_cache size 0 max 16384 2023-07-14T13:32:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.054+0000 7fd1e81ff700 1 -- 172.21.15.17:0/50505431 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1cc0a14d0 msgr2=0x7fd1cc0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.054+0000 7fd1e81ff700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1cc0a14d0 0x7fd1cc0a3980 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009fd0 tx=0x7fd1d80099e0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.054+0000 7fd1e81ff700 1 -- 172.21.15.17:0/50505431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e0080d20 msgr2=0x7fd1e0071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.054+0000 7fd1e81ff700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e0080d20 0x7fd1e0071a10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000d950 tx=0x7fd1d000dc60 comp rx=0 tx=0).stop 2023-07-14T13:32:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.056+0000 7fd1e81ff700 1 -- 172.21.15.17:0/50505431 shutdown_connections 2023-07-14T13:32:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.056+0000 7fd1e81ff700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd1cc0a14d0 0x7fd1cc0a3980 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.056+0000 7fd1e81ff700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e0119360 0x7fd1e006b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.056+0000 7fd1e81ff700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e0080d20 0x7fd1e0071a10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.056+0000 7fd1e81ff700 1 --2- 172.21.15.17:0/50505431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1e0081180 0x7fd1e0071f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:05.055 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.056+0000 7fd1e81ff700 1 -- 172.21.15.17:0/50505431 >> 172.21.15.17:0/50505431 conn(0x7fd1e0075a20 msgr2=0x7fd1e0080330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:05.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.058+0000 7fd1e81ff700 1 -- 172.21.15.17:0/50505431 shutdown_connections 2023-07-14T13:32:05.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:05.058+0000 7fd1e81ff700 1 -- 172.21.15.17:0/50505431 wait complete. 2023-07-14T13:32:06.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:05 smithi135 ceph-mon[97338]: pgmap v1025: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.24k op/s 2023-07-14T13:32:06.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:05 smithi131 ceph-mon[96953]: pgmap v1025: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.24k op/s 2023-07-14T13:32:06.328 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:05 smithi017 ceph-mon[95536]: pgmap v1025: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.24k op/s 2023-07-14T13:32:07.417 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 835.0 s, 282.4 tps, lat 389.270 ms stddev 641.414 2023-07-14T13:32:08.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:07 smithi135 ceph-mon[97338]: pgmap v1026: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 15 MiB/s wr, 1.63k op/s 2023-07-14T13:32:08.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:07 smithi131 ceph-mon[96953]: pgmap v1026: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 15 MiB/s wr, 1.63k op/s 2023-07-14T13:32:08.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:07 smithi017 ceph-mon[95536]: pgmap v1026: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 15 MiB/s wr, 1.63k op/s 2023-07-14T13:32:10.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:09 smithi135 ceph-mon[97338]: pgmap v1027: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.3 MiB/s wr, 990 op/s 2023-07-14T13:32:10.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:09 smithi131 ceph-mon[96953]: pgmap v1027: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.3 MiB/s wr, 990 op/s 2023-07-14T13:32:10.327 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:09 smithi017 ceph-mon[95536]: pgmap v1027: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.3 MiB/s wr, 990 op/s 2023-07-14T13:32:11.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:10 smithi131 ceph-mon[96953]: osdmap e142: 12 total, 12 up, 12 in 2023-07-14T13:32:11.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:10 smithi131 ceph-mon[96953]: pgmap v1029: 97 pgs: 19 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 48 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.06k op/s 2023-07-14T13:32:11.328 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:10 smithi017 ceph-mon[95536]: osdmap e142: 12 total, 12 up, 12 in 2023-07-14T13:32:11.329 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:10 smithi017 ceph-mon[95536]: pgmap v1029: 97 pgs: 19 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 48 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.06k op/s 2023-07-14T13:32:11.416 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:10 smithi135 ceph-mon[97338]: osdmap e142: 12 total, 12 up, 12 in 2023-07-14T13:32:11.417 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:10 smithi135 ceph-mon[97338]: pgmap v1029: 97 pgs: 19 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 48 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.06k op/s 2023-07-14T13:32:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 840.0 s, 322.6 tps, lat 297.171 ms stddev 182.654 2023-07-14T13:32:14.079 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:13 smithi017 ceph-mon[95536]: pgmap v1030: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.8 MiB/s wr, 1.03k op/s 2023-07-14T13:32:14.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:13 smithi135 ceph-mon[97338]: pgmap v1030: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.8 MiB/s wr, 1.03k op/s 2023-07-14T13:32:14.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:13 smithi131 ceph-mon[96953]: pgmap v1030: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.8 MiB/s wr, 1.03k op/s 2023-07-14T13:32:16.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:15 smithi017 ceph-mon[95536]: pgmap v1031: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.8 MiB/s wr, 1.03k op/s 2023-07-14T13:32:16.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:15 smithi135 ceph-mon[97338]: pgmap v1031: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.8 MiB/s wr, 1.03k op/s 2023-07-14T13:32:16.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:15 smithi131 ceph-mon[96953]: pgmap v1031: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.8 MiB/s wr, 1.03k op/s 2023-07-14T13:32:17.417 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 845.0 s, 264.0 tps, lat 393.965 ms stddev 285.408 2023-07-14T13:32:18.169 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:17 smithi135 ceph-mon[97338]: pgmap v1032: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.0 MiB/s wr, 834 op/s 2023-07-14T13:32:18.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:17 smithi131 ceph-mon[96953]: pgmap v1032: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.0 MiB/s wr, 834 op/s 2023-07-14T13:32:18.327 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:17 smithi017 ceph-mon[95536]: pgmap v1032: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.0 MiB/s wr, 834 op/s 2023-07-14T13:32:18.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.339+0000 7f55d8fff700 1 -- 172.21.15.17:0/3570114635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d4108010 msgr2=0x7f55d4110ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.339+0000 7f55d8fff700 1 --2- 172.21.15.17:0/3570114635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d4108010 0x7f55d4110ac0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f55c800dd20 tx=0x7f55c800f330 comp rx=0 tx=0).stop 2023-07-14T13:32:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.340+0000 7f55d8fff700 1 -- 172.21.15.17:0/3570114635 shutdown_connections 2023-07-14T13:32:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.340+0000 7f55d8fff700 1 --2- 172.21.15.17:0/3570114635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d4111000 0x7f55d41133e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.340+0000 7f55d8fff700 1 --2- 172.21.15.17:0/3570114635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d4067d50 0x7f55d410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.338 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.340+0000 7f55d8fff700 1 --2- 172.21.15.17:0/3570114635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d4108010 0x7f55d4110ac0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.340+0000 7f55d8fff700 1 -- 172.21.15.17:0/3570114635 >> 172.21.15.17:0/3570114635 conn(0x7f55d406c270 msgr2=0x7f55d406c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:18.339 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.341+0000 7f55d8fff700 1 -- 172.21.15.17:0/3570114635 shutdown_connections 2023-07-14T13:32:18.340 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.341+0000 7f55d8fff700 1 -- 172.21.15.17:0/3570114635 wait complete. 2023-07-14T13:32:18.341 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.343+0000 7f55d8fff700 1 Processor -- start 2023-07-14T13:32:18.342 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.344+0000 7f55d8fff700 1 -- start start 2023-07-14T13:32:18.343 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.345+0000 7f55d8fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d4067d50 0x7f55d41aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.345+0000 7f55d8fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d4108010 0x7f55d41aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.345+0000 7f55d8fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d4111000 0x7f55d41a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.345+0000 7f55d8fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d41a4da0 con 0x7f55d4108010 2023-07-14T13:32:18.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.345+0000 7f55d8fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d41a4f10 con 0x7f55d4067d50 2023-07-14T13:32:18.344 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.345+0000 7f55d8fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d41a50d0 con 0x7f55d4111000 2023-07-14T13:32:18.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.348+0000 7f55d1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d4108010 0x7f55d41aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.345 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.348+0000 7f55d1d9b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d4108010 0x7f55d41aae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40274/0 (socket says 172.21.15.17:40274) 2023-07-14T13:32:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.348+0000 7f55d1d9b700 1 -- 172.21.15.17:0/3690018182 learned_addr learned my addr 172.21.15.17:0/3690018182 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.348+0000 7f55d2d9d700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d4111000 0x7f55d41a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.348+0000 7f55d1d9b700 1 -- 172.21.15.17:0/3690018182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d4111000 msgr2=0x7f55d41a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.348+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d4111000 0x7f55d41a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.348+0000 7f55d1d9b700 1 -- 172.21.15.17:0/3690018182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d4067d50 msgr2=0x7f55d41aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.348+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d4067d50 0x7f55d41aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.348+0000 7f55d1d9b700 1 -- 172.21.15.17:0/3690018182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c800da00 con 0x7f55d4108010 2023-07-14T13:32:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.349+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d4108010 0x7f55d41aae10 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f55c8005910 tx=0x7f55c8016430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:18.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.350+0000 7f55c37fe700 1 -- 172.21.15.17:0/3690018182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8012050 con 0x7f55d4108010 2023-07-14T13:32:18.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.351+0000 7f55c37fe700 1 -- 172.21.15.17:0/3690018182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55c801f450 con 0x7f55d4108010 2023-07-14T13:32:18.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.351+0000 7f55c37fe700 1 -- 172.21.15.17:0/3690018182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c800c6a0 con 0x7f55d4108010 2023-07-14T13:32:18.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.351+0000 7f55d8fff700 1 -- 172.21.15.17:0/3690018182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d41a5350 con 0x7f55d4108010 2023-07-14T13:32:18.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.351+0000 7f55d8fff700 1 -- 172.21.15.17:0/3690018182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d41b18c0 con 0x7f55d4108010 2023-07-14T13:32:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.358+0000 7f55ec9bbb80 1 Processor -- start 2023-07-14T13:32:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.358+0000 7f55ec9bbb80 1 -- start start 2023-07-14T13:32:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.359+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7e096b0 0x560bb7fb2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.359+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7fb32d0 0x560bb7fad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.359+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fad580 0x560bb7fad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.359+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb7eb2c50 con 0x560bb7fad580 2023-07-14T13:32:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.359+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb7f059e0 con 0x560bb7fb32d0 2023-07-14T13:32:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.359+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb7efee70 con 0x560bb7e096b0 2023-07-14T13:32:18.358 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.359+0000 7f55d2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7e096b0 0x560bb7fb2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.360+0000 7f55d2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7e096b0 0x560bb7fb2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52448/0 (socket says 172.21.15.17:52448) 2023-07-14T13:32:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.360+0000 7f55d2d9d700 1 -- 172.21.15.17:0/1295466278 learned_addr learned my addr 172.21.15.17:0/1295466278 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.360+0000 7f55d2d9d700 1 -- 172.21.15.17:0/1295466278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7fb32d0 msgr2=0x560bb7fad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.360+0000 7f55d2d9d700 1 --2- 172.21.15.17:0/1295466278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7fb32d0 0x560bb7fad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.360+0000 7f55d2d9d700 1 -- 172.21.15.17:0/1295466278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fad580 msgr2=0x560bb7fad9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:32:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.360+0000 7f55d2d9d700 1 --2- 172.21.15.17:0/1295466278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fad580 0x560bb7fad9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.360+0000 7f55d2d9d700 1 -- 172.21.15.17:0/1295466278 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bb7d2cd80 con 0x560bb7e096b0 2023-07-14T13:32:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.361+0000 7f55c37fe700 1 -- 172.21.15.17:0/3690018182 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f55c8016b20 con 0x7f55d4108010 2023-07-14T13:32:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.362+0000 7f55d2d9d700 1 --2- 172.21.15.17:0/1295466278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7e096b0 0x560bb7fb2d90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009c10 tx=0x7f55cc009f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be7eb28fe6021e37 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.363+0000 7f55c0ff9700 1 -- 172.21.15.17:0/1295466278 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc010c30 con 0x560bb7e096b0 2023-07-14T13:32:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.363+0000 7f55c0ff9700 1 -- 172.21.15.17:0/1295466278 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55cc015070 con 0x560bb7e096b0 2023-07-14T13:32:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.363+0000 7f55c0ff9700 1 -- 172.21.15.17:0/1295466278 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc003d60 con 0x560bb7e096b0 2023-07-14T13:32:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.364+0000 7f55c37fe700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55bc0a1450 0x7f55bc0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.364+0000 7f55c37fe700 1 -- 172.21.15.17:0/3690018182 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f55c80cd690 con 0x7f55d4108010 2023-07-14T13:32:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.364+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1295466278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7e096b0 msgr2=0x560bb7fb2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.364+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/1295466278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7e096b0 0x560bb7fb2d90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009c10 tx=0x7f55cc009f20 comp rx=0 tx=0).stop 2023-07-14T13:32:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.365+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1295466278 shutdown_connections 2023-07-14T13:32:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.365+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/1295466278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fad580 0x560bb7fad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.365+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/1295466278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7e096b0 0x560bb7fb2d90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.365+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/1295466278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7fb32d0 0x560bb7fad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.365+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1295466278 >> 172.21.15.17:0/1295466278 conn(0x560bb7fa2be0 msgr2=0x560bb7fa7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:18.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.370+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1295466278 shutdown_connections 2023-07-14T13:32:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.373+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1295466278 wait complete. 2023-07-14T13:32:18.371 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.374+0000 7f55ec9bbb80 1 -- start start 2023-07-14T13:32:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.381+0000 7f55ec9bbb80 1 Processor -- start 2023-07-14T13:32:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.381+0000 7f55d259c700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55bc0a1450 0x7f55bc0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.382+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 0x560bb7fb6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.382+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fad580 0x560bb7fb7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.382+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 0x560bb7fc2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.382+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb7e9ea60 con 0x560bb7fad580 2023-07-14T13:32:18.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.382+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb7e9e760 con 0x560bb7e096b0 2023-07-14T13:32:18.381 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.382+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb7d828c0 con 0x560bb7fb75a0 2023-07-14T13:32:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.382+0000 7f55ec9bbb80 10 client.0 _ll_register_callbacks cb 0x560bb7e9c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:32:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.382+0000 7f55d2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 0x560bb7fc2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.382+0000 7f55d2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 0x560bb7fc2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:52460/0 (socket says 172.21.15.17:52460) 2023-07-14T13:32:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.382+0000 7f55d2d9d700 1 -- 172.21.15.17:0/1819688635 learned_addr learned my addr 172.21.15.17:0/1819688635 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.383+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fad580 0x560bb7fb7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.383+0000 7f55d259c700 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 0x560bb7fb6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.383+0000 7f55d1d9b700 1 -- 172.21.15.17:0/1819688635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 msgr2=0x560bb7fc2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.383+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 0x560bb7fc2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.383+0000 7f55d1d9b700 1 -- 172.21.15.17:0/1819688635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 msgr2=0x560bb7fb6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.383+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 0x560bb7fb6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.384+0000 7f55d1d9b700 1 -- 172.21.15.17:0/1819688635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc0098f0 con 0x560bb7fad580 2023-07-14T13:32:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.384+0000 7f55d2d9d700 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 0x560bb7fc2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.384+0000 7f55d259c700 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 0x560bb7fb6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.384+0000 7f55d259c700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55bc0a1450 0x7f55bc0a3900 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f55c4008fd0 tx=0x7f55c40148d0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.384+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fad580 0x560bb7fb7060 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f55c80cad70 tx=0x7f55c809a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e9d77268d889d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.384+0000 7f55b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:32:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.385+0000 7f55b9ffb700 1 -- 172.21.15.17:0/1819688635 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c809bbe0 con 0x560bb7fad580 2023-07-14T13:32:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.385+0000 7f55b9ffb700 1 -- 172.21.15.17:0/1819688635 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f55c809bd40 con 0x560bb7fad580 2023-07-14T13:32:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.385+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1819688635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560bb7e58490 con 0x560bb7fad580 2023-07-14T13:32:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.385+0000 7f55b9ffb700 1 -- 172.21.15.17:0/1819688635 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55c809a9e0 con 0x560bb7fad580 2023-07-14T13:32:18.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.385+0000 7f55ec9bbb80 10 client.19818 fetch_fsmap learned FSMap version 68 2023-07-14T13:32:18.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.385+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1819688635 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x560bb7d15c00 con 0x560bb7fad580 2023-07-14T13:32:18.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.386+0000 7f55b9ffb700 1 -- 172.21.15.17:0/1819688635 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560bb7e58490 con 0x560bb7fad580 2023-07-14T13:32:18.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.386+0000 7f55b9ffb700 1 -- 172.21.15.17:0/1819688635 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f55c80b8d20 con 0x560bb7fad580 2023-07-14T13:32:18.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.386+0000 7f55ec9bbb80 10 client.19818 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:32:18.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.386+0000 7f55ec9bbb80 10 client.19818 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:32:18.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.386+0000 7f55ec9bbb80 20 client.19818 populate_metadata read hostname 'smithi017' 2023-07-14T13:32:18.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.387+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560bb7fc6f10 0x560bb7fc9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.387+0000 7f55ec9bbb80 4 client.19818 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:32:18.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.387+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1819688635 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560bb7ef7e50 con 0x560bb7fc6f10 2023-07-14T13:32:18.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.387+0000 7f55d259c700 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560bb7fc6f10 0x560bb7fc9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.389+0000 7f55d259c700 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560bb7fc6f10 0x560bb7fc9320 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddf20b1c83aa3fe3 server_cookie=cd8a82544abe4d40 in_seq=0 out_seq=0 2023-07-14T13:32:18.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.389+0000 7f55b9ffb700 10 client.19818 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:18.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.390+0000 7f55b9ffb700 1 -- 172.21.15.17:0/1819688635 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560bb7ef7e50 con 0x560bb7fc6f10 2023-07-14T13:32:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.390+0000 7f55b9ffb700 10 client.19818 handle_command_reply: tid=0 2023-07-14T13:32:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.390+0000 7f55ec9bbb80 1 client.19818 shutdown 2023-07-14T13:32:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.391+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1819688635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fad580 msgr2=0x560bb7fb7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.391+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fad580 0x560bb7fb7060 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f55c80cad70 tx=0x7f55c809a780 comp rx=0 tx=0).stop 2023-07-14T13:32:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.391+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1819688635 shutdown_connections 2023-07-14T13:32:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.391+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560bb7fc6f10 0x560bb7fc9320 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.391 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.391+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 0x560bb7fc2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.391+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 0x560bb7fb6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.391+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/1819688635 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fad580 0x560bb7fb7060 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.391+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1819688635 >> 172.21.15.17:0/1819688635 conn(0x560bb7fa2be0 msgr2=0x560bb7fa74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:18.392 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.391+0000 7f55b9ffb700 0 client.19818 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.392+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1819688635 shutdown_connections 2023-07-14T13:32:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.392+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/1819688635 wait complete. 2023-07-14T13:32:18.393 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.393+0000 7f55ec9bbb80 20 client.19818 trim_cache size 0 max 16384 2023-07-14T13:32:18.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.419+0000 7f55ec9bbb80 1 Processor -- start 2023-07-14T13:32:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.419+0000 7f55ec9bbb80 1 -- start start 2023-07-14T13:32:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.420+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 0x560bb7fad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.420+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fad580 0x560bb7fc2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.420+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fb75a0 0x560bb7fbdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.420+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb7e58490 con 0x560bb7fb75a0 2023-07-14T13:32:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.420+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb7f9fc00 con 0x560bb7e096b0 2023-07-14T13:32:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.420+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb7fa9b70 con 0x560bb7fad580 2023-07-14T13:32:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.421+0000 7f55d2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fb75a0 0x560bb7fbdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.421+0000 7f55d2d9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fb75a0 0x560bb7fbdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40286/0 (socket says 172.21.15.17:40286) 2023-07-14T13:32:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.421+0000 7f55d2d9d700 1 -- 172.21.15.17:0/2048133898 learned_addr learned my addr 172.21.15.17:0/2048133898 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.422+0000 7f55d259c700 1 --2- 172.21.15.17:0/2048133898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 0x560bb7fad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.422+0000 7f55d2d9d700 1 -- 172.21.15.17:0/2048133898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fad580 msgr2=0x560bb7fc2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.422+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/2048133898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fad580 0x560bb7fc2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.423+0000 7f55d2d9d700 1 --2- 172.21.15.17:0/2048133898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fad580 0x560bb7fc2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.423+0000 7f55d2d9d700 1 -- 172.21.15.17:0/2048133898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 msgr2=0x560bb7fad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.423+0000 7f55d2d9d700 1 --2- 172.21.15.17:0/2048133898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 0x560bb7fad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.423+0000 7f55d2d9d700 1 -- 172.21.15.17:0/2048133898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bb7d531f0 con 0x560bb7fb75a0 2023-07-14T13:32:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.423+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/2048133898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fad580 0x560bb7fc2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.423+0000 7f55d259c700 1 --2- 172.21.15.17:0/2048133898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 0x560bb7fad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:32:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.424+0000 7f55d2d9d700 1 --2- 172.21.15.17:0/2048133898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fb75a0 0x560bb7fbdc60 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f55cc005df0 tx=0x7f55cc005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d4f38ef0340444 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.425+0000 7f55c17fa700 1 -- 172.21.15.17:0/2048133898 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc003a40 con 0x560bb7fb75a0 2023-07-14T13:32:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.425+0000 7f55c17fa700 1 -- 172.21.15.17:0/2048133898 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55cc003ba0 con 0x560bb7fb75a0 2023-07-14T13:32:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.425+0000 7f55c17fa700 1 -- 172.21.15.17:0/2048133898 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc0116a0 con 0x560bb7fb75a0 2023-07-14T13:32:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.426+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/2048133898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fb75a0 msgr2=0x560bb7fbdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.426+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/2048133898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fb75a0 0x560bb7fbdc60 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f55cc005df0 tx=0x7f55cc005e20 comp rx=0 tx=0).stop 2023-07-14T13:32:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.428+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/2048133898 shutdown_connections 2023-07-14T13:32:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.428+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/2048133898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7fb75a0 0x560bb7fbdc60 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.428+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/2048133898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7e096b0 0x560bb7fad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.428+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/2048133898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fad580 0x560bb7fc2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.428+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/2048133898 >> 172.21.15.17:0/2048133898 conn(0x560bb7fa2be0 msgr2=0x560bb7fc2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.431+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/2048133898 shutdown_connections 2023-07-14T13:32:18.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.431+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/2048133898 wait complete. 2023-07-14T13:32:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.432+0000 7f55ec9bbb80 1 -- start start 2023-07-14T13:32:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.432+0000 7f55ec9bbb80 1 Processor -- start 2023-07-14T13:32:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.433+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7e096b0 0x560bb7fbbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.433+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7fad580 0x560bb7fbc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.433+0000 7f55ec9bbb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 0x560bb8019d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.433+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb7fbc920 con 0x560bb7e096b0 2023-07-14T13:32:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.433+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb7fbca90 con 0x560bb7fad580 2023-07-14T13:32:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.433+0000 7f55ec9bbb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb801a2d0 con 0x560bb7fb75a0 2023-07-14T13:32:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.433+0000 7f55ec9bbb80 10 client.0 _ll_register_callbacks cb 0x7f55c809a2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:32:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.433+0000 7f55d1d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7fad580 0x560bb7fbc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.433+0000 7f55d1d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7fad580 0x560bb7fbc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:33502/0 (socket says 172.21.15.17:33502) 2023-07-14T13:32:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.433+0000 7f55d1d9b700 1 -- 172.21.15.17:0/3500491461 learned_addr learned my addr 172.21.15.17:0/3500491461 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.434+0000 7f55d2d9d700 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 0x560bb8019d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.434+0000 7f55d1d9b700 1 -- 172.21.15.17:0/3500491461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 msgr2=0x560bb8019d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.434+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 0x560bb8019d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.434+0000 7f55d1d9b700 1 -- 172.21.15.17:0/3500491461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7e096b0 msgr2=0x560bb7fbbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.434+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7e096b0 0x560bb7fbbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.434+0000 7f55d1d9b700 1 -- 172.21.15.17:0/3500491461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bb7d2cd80 con 0x560bb7fad580 2023-07-14T13:32:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.435+0000 7f55d1d9b700 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7fad580 0x560bb7fbc190 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f55c8096c80 tx=0x7f55c80a2cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3690def467f84b72 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.435+0000 7f55b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:32:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.435+0000 7f55b9ffb700 1 -- 172.21.15.17:0/3500491461 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c809abe0 con 0x560bb7fad580 2023-07-14T13:32:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.435+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/3500491461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f55cc015070 con 0x560bb7fad580 2023-07-14T13:32:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.435+0000 7f55b9ffb700 1 -- 172.21.15.17:0/3500491461 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f55c80a2780 con 0x560bb7fad580 2023-07-14T13:32:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.436+0000 7f55b9ffb700 1 -- 172.21.15.17:0/3500491461 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55c809e830 con 0x560bb7fad580 2023-07-14T13:32:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.436+0000 7f55ec9bbb80 10 client.29621 fetch_fsmap learned FSMap version 68 2023-07-14T13:32:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.436+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/3500491461 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x560bb7d2b250 con 0x560bb7fad580 2023-07-14T13:32:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.436+0000 7f55b9ffb700 1 -- 172.21.15.17:0/3500491461 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55cc015070 con 0x560bb7fad580 2023-07-14T13:32:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.436+0000 7f55b9ffb700 1 -- 172.21.15.17:0/3500491461 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f55c801d070 con 0x560bb7fad580 2023-07-14T13:32:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.437+0000 7f55ec9bbb80 10 client.29621 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:32:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.437+0000 7f55ec9bbb80 10 client.29621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:32:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.437+0000 7f55ec9bbb80 20 client.29621 populate_metadata read hostname 'smithi017' 2023-07-14T13:32:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.437+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560bb801b540 0x560bb801d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.437+0000 7f55ec9bbb80 4 client.29621 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:32:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.437+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/3500491461 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560bb7eb9ff0 con 0x560bb801b540 2023-07-14T13:32:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.438+0000 7f55d259c700 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560bb801b540 0x560bb801d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.439+0000 7f55d259c700 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560bb801b540 0x560bb801d920 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e4c7580023b29ca server_cookie=2345f3357dad5572 in_seq=0 out_seq=0 2023-07-14T13:32:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.439+0000 7f55b9ffb700 10 client.29621 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.490+0000 7f55b9ffb700 1 -- 172.21.15.17:0/3500491461 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560bb7eb9ff0 con 0x560bb801b540 2023-07-14T13:32:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.490+0000 7f55b9ffb700 10 client.29621 handle_command_reply: tid=0 2023-07-14T13:32:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.490+0000 7f55ec9bbb80 1 client.29621 shutdown 2023-07-14T13:32:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.491+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/3500491461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7fad580 msgr2=0x560bb7fbc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.491+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7fad580 0x560bb7fbc190 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f55c8096c80 tx=0x7f55c80a2cc0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.491+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/3500491461 shutdown_connections 2023-07-14T13:32:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.491+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x560bb801b540 0x560bb801d920 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.491+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560bb7fb75a0 0x560bb8019d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.491+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x560bb7e096b0 0x560bb7fbbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.491+0000 7f55ec9bbb80 1 --2- 172.21.15.17:0/3500491461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560bb7fad580 0x560bb7fbc190 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.491+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/3500491461 >> 172.21.15.17:0/3500491461 conn(0x560bb7fa2be0 msgr2=0x560bb7fb2400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.491+0000 7f55b9ffb700 0 client.29621 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.491+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/3500491461 shutdown_connections 2023-07-14T13:32:18.490 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.491+0000 7f55ec9bbb80 1 -- 172.21.15.17:0/3500491461 wait complete. 2023-07-14T13:32:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.492+0000 7f55ec9bbb80 20 client.29621 trim_cache size 0 max 16384 2023-07-14T13:32:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:32:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:32:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:32:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:32:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.492+0000 7f55d8fff700 1 -- 172.21.15.17:0/3690018182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55bc0a1450 msgr2=0x7f55bc0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.492+0000 7f55d8fff700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55bc0a1450 0x7f55bc0a3900 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f55c4008fd0 tx=0x7f55c40148d0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.492+0000 7f55d8fff700 1 -- 172.21.15.17:0/3690018182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d4108010 msgr2=0x7f55d41aae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.492+0000 7f55d8fff700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d4108010 0x7f55d41aae10 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f55c8005910 tx=0x7f55c8016430 comp rx=0 tx=0).stop 2023-07-14T13:32:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.493+0000 7f55d8fff700 1 -- 172.21.15.17:0/3690018182 shutdown_connections 2023-07-14T13:32:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.493+0000 7f55d8fff700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f55bc0a1450 0x7f55bc0a3900 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.493+0000 7f55d8fff700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d4111000 0x7f55d41a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.493+0000 7f55d8fff700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d4067d50 0x7f55d41aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.493+0000 7f55d8fff700 1 --2- 172.21.15.17:0/3690018182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d4108010 0x7f55d41aae10 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:18.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.493+0000 7f55d8fff700 1 -- 172.21.15.17:0/3690018182 >> 172.21.15.17:0/3690018182 conn(0x7f55d406c270 msgr2=0x7f55d40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:18.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.494+0000 7f55d8fff700 1 -- 172.21.15.17:0/3690018182 shutdown_connections 2023-07-14T13:32:18.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:18.494+0000 7f55d8fff700 1 -- 172.21.15.17:0/3690018182 wait complete. 2023-07-14T13:32:20.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:19 smithi135 ceph-mon[97338]: pgmap v1033: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.0 MiB/s wr, 834 op/s 2023-07-14T13:32:20.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:19 smithi131 ceph-mon[96953]: pgmap v1033: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.0 MiB/s wr, 834 op/s 2023-07-14T13:32:20.325 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:19 smithi017 ceph-mon[95536]: pgmap v1033: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.0 MiB/s wr, 834 op/s 2023-07-14T13:32:22.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:21 smithi135 ceph-mon[97338]: pgmap v1034: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-14T13:32:22.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:21 smithi135 ceph-mon[97338]: osdmap e143: 12 total, 12 up, 12 in 2023-07-14T13:32:22.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:21 smithi131 ceph-mon[96953]: pgmap v1034: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-14T13:32:22.218 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:21 smithi131 ceph-mon[96953]: osdmap e143: 12 total, 12 up, 12 in 2023-07-14T13:32:22.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:21 smithi017 ceph-mon[95536]: pgmap v1034: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-14T13:32:22.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:21 smithi017 ceph-mon[95536]: osdmap e143: 12 total, 12 up, 12 in 2023-07-14T13:32:22.417 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 850.0 s, 446.8 tps, lat 225.913 ms stddev 93.926 2023-07-14T13:32:24.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:23 smithi135 ceph-mon[97338]: pgmap v1036: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.8 MiB/s wr, 915 op/s 2023-07-14T13:32:24.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:23 smithi131 ceph-mon[96953]: pgmap v1036: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.8 MiB/s wr, 915 op/s 2023-07-14T13:32:24.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:23 smithi017 ceph-mon[95536]: pgmap v1036: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.8 MiB/s wr, 915 op/s 2023-07-14T13:32:26.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:25 smithi135 ceph-mon[97338]: pgmap v1037: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.8 MiB/s wr, 915 op/s 2023-07-14T13:32:26.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:25 smithi131 ceph-mon[96953]: pgmap v1037: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.8 MiB/s wr, 915 op/s 2023-07-14T13:32:26.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:25 smithi017 ceph-mon[95536]: pgmap v1037: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.8 MiB/s wr, 915 op/s 2023-07-14T13:32:27.416 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 855.0 s, 428.4 tps, lat 230.625 ms stddev 231.004 2023-07-14T13:32:28.083 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:27 smithi017 ceph-mon[95536]: pgmap v1038: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 1.23k op/s 2023-07-14T13:32:28.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:27 smithi135 ceph-mon[97338]: pgmap v1038: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 1.23k op/s 2023-07-14T13:32:28.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:27 smithi131 ceph-mon[96953]: pgmap v1038: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 1.23k op/s 2023-07-14T13:32:30.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:29 smithi017 ceph-mon[95536]: pgmap v1039: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 1.23k op/s 2023-07-14T13:32:30.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:29 smithi135 ceph-mon[97338]: pgmap v1039: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 1.23k op/s 2023-07-14T13:32:30.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:29 smithi131 ceph-mon[96953]: pgmap v1039: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 1.23k op/s 2023-07-14T13:32:31.738 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.741+0000 7fa461fff700 1 -- 172.21.15.17:0/3320317192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa45c1004e0 msgr2=0x7fa45c10c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.741+0000 7fa461fff700 1 --2- 172.21.15.17:0/3320317192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa45c1004e0 0x7fa45c10c920 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fa45400b0a0 tx=0x7fa45400b3b0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.741+0000 7fa461fff700 1 -- 172.21.15.17:0/3320317192 shutdown_connections 2023-07-14T13:32:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.741+0000 7fa461fff700 1 --2- 172.21.15.17:0/3320317192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa45c1004e0 0x7fa45c10c920 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.741+0000 7fa461fff700 1 --2- 172.21.15.17:0/3320317192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c105b60 0x7fa45c105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.741+0000 7fa461fff700 1 --2- 172.21.15.17:0/3320317192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c0ffb30 0x7fa45c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.741+0000 7fa461fff700 1 -- 172.21.15.17:0/3320317192 >> 172.21.15.17:0/3320317192 conn(0x7fa45c0fb5f0 msgr2=0x7fa45c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.741+0000 7fa461fff700 1 -- 172.21.15.17:0/3320317192 shutdown_connections 2023-07-14T13:32:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.741+0000 7fa461fff700 1 -- 172.21.15.17:0/3320317192 wait complete. 2023-07-14T13:32:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.743+0000 7fa461fff700 1 Processor -- start 2023-07-14T13:32:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.743+0000 7fa461fff700 1 -- start start 2023-07-14T13:32:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.744+0000 7fa461fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c0ffb30 0x7fa45c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.741 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.744+0000 7fa461fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c1004e0 0x7fa45c19c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.744+0000 7fa461fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa45c105b60 0x7fa45c195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.744+0000 7fa461fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c1960d0 con 0x7fa45c105b60 2023-07-14T13:32:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.744+0000 7fa461fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c196240 con 0x7fa45c1004e0 2023-07-14T13:32:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.744+0000 7fa461fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c196400 con 0x7fa45c0ffb30 2023-07-14T13:32:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.744+0000 7fa45b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c0ffb30 0x7fa45c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.744+0000 7fa45b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c0ffb30 0x7fa45c19bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41892/0 (socket says 172.21.15.17:41892) 2023-07-14T13:32:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.744+0000 7fa45b7fe700 1 -- 172.21.15.17:0/2972229126 learned_addr learned my addr 172.21.15.17:0/2972229126 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.744+0000 7fa45affd700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c1004e0 0x7fa45c19c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.745+0000 7fa45bfff700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa45c105b60 0x7fa45c195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.745+0000 7fa45b7fe700 1 -- 172.21.15.17:0/2972229126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c1004e0 msgr2=0x7fa45c19c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.745+0000 7fa45b7fe700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c1004e0 0x7fa45c19c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.745+0000 7fa45b7fe700 1 -- 172.21.15.17:0/2972229126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa45c105b60 msgr2=0x7fa45c195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.745+0000 7fa45b7fe700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa45c105b60 0x7fa45c195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.745+0000 7fa45b7fe700 1 -- 172.21.15.17:0/2972229126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454009d00 con 0x7fa45c0ffb30 2023-07-14T13:32:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.745+0000 7fa45bfff700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa45c105b60 0x7fa45c195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:32:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.745+0000 7fa45b7fe700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c0ffb30 0x7fa45c19bc00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00e9a0 tx=0x7fa44c00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.746+0000 7fa458ff9700 1 -- 172.21.15.17:0/2972229126 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c009790 con 0x7fa45c0ffb30 2023-07-14T13:32:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.746+0000 7fa458ff9700 1 -- 172.21.15.17:0/2972229126 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa44c00cc50 con 0x7fa45c0ffb30 2023-07-14T13:32:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.746+0000 7fa458ff9700 1 -- 172.21.15.17:0/2972229126 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c01b9d0 con 0x7fa45c0ffb30 2023-07-14T13:32:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.746+0000 7fa461fff700 1 -- 172.21.15.17:0/2972229126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45c1966e0 con 0x7fa45c0ffb30 2023-07-14T13:32:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.746+0000 7fa461fff700 1 -- 172.21.15.17:0/2972229126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45c072920 con 0x7fa45c0ffb30 2023-07-14T13:32:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.752+0000 7fa4758c1b80 1 Processor -- start 2023-07-14T13:32:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.753+0000 7fa4758c1b80 1 -- start start 2023-07-14T13:32:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.753+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 0x55c42e8c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.753+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c8f80 0x55c42e8cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.753+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c93f0 0x55c42e8cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.753+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e7c5c50 con 0x55c42e8c8f80 2023-07-14T13:32:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.753+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e8189e0 con 0x55c42e71c6b0 2023-07-14T13:32:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.753+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e811e70 con 0x55c42e8c93f0 2023-07-14T13:32:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.753+0000 7fa45bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 0x55c42e8c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.753+0000 7fa45bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 0x55c42e8c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49470/0 (socket says 172.21.15.17:49470) 2023-07-14T13:32:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.753+0000 7fa45bfff700 1 -- 172.21.15.17:0/2074568989 learned_addr learned my addr 172.21.15.17:0/2074568989 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.753+0000 7fa45affd700 1 --2- 172.21.15.17:0/2074568989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c93f0 0x55c42e8cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.754+0000 7fa45affd700 1 -- 172.21.15.17:0/2074568989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 msgr2=0x55c42e8c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.754+0000 7fa45affd700 1 --2- 172.21.15.17:0/2074568989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 0x55c42e8c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.754+0000 7fa45affd700 1 -- 172.21.15.17:0/2074568989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c8f80 msgr2=0x55c42e8cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.754+0000 7fa45affd700 1 --2- 172.21.15.17:0/2074568989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c8f80 0x55c42e8cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.754+0000 7fa45affd700 1 -- 172.21.15.17:0/2074568989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c42e63fd80 con 0x55c42e8c93f0 2023-07-14T13:32:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.754+0000 7fa45affd700 1 --2- 172.21.15.17:0/2074568989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c93f0 0x55c42e8cd6e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa450009bd0 tx=0x7fa450009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efed117f2a7ed3f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.755+0000 7fa458ff9700 1 -- 172.21.15.17:0/2972229126 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa44c00c7c0 con 0x7fa45c0ffb30 2023-07-14T13:32:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.756+0000 7fa441ffb700 1 -- 172.21.15.17:0/2074568989 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450011b90 con 0x55c42e8c93f0 2023-07-14T13:32:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.756+0000 7fa441ffb700 1 -- 172.21.15.17:0/2074568989 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa450011cf0 con 0x55c42e8c93f0 2023-07-14T13:32:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.756+0000 7fa441ffb700 1 -- 172.21.15.17:0/2074568989 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000f6a0 con 0x55c42e8c93f0 2023-07-14T13:32:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.757+0000 7fa4758c1b80 1 -- 172.21.15.17:0/2074568989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c93f0 msgr2=0x55c42e8cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.757+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/2074568989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c93f0 0x55c42e8cd6e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa450009bd0 tx=0x7fa450009ee0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.757+0000 7fa458ff9700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4440a13c0 0x7fa4440a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.757+0000 7fa458ff9700 1 -- 172.21.15.17:0/2972229126 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa44c0d0ee0 con 0x7fa45c0ffb30 2023-07-14T13:32:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.757+0000 7fa4758c1b80 1 -- 172.21.15.17:0/2074568989 shutdown_connections 2023-07-14T13:32:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.757+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/2074568989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c93f0 0x55c42e8cd6e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.757+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/2074568989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 0x55c42e8c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.757+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/2074568989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c8f80 0x55c42e8cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.757+0000 7fa4758c1b80 1 -- 172.21.15.17:0/2074568989 >> 172.21.15.17:0/2074568989 conn(0x55c42e8b5be0 msgr2=0x55c42e8baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.757+0000 7fa45bfff700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4440a13c0 0x7fa4440a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.759+0000 7fa4758c1b80 1 -- 172.21.15.17:0/2074568989 shutdown_connections 2023-07-14T13:32:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.760+0000 7fa4758c1b80 1 -- 172.21.15.17:0/2074568989 wait complete. 2023-07-14T13:32:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.761+0000 7fa4758c1b80 1 -- start start 2023-07-14T13:32:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.761+0000 7fa4758c1b80 1 Processor -- start 2023-07-14T13:32:31.759 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.762+0000 7fa45bfff700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4440a13c0 0x7fa4440a3870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa454009850 tx=0x7fa454009780 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.764+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 0x55c42e8d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.764+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c8f80 0x55c42e8d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.762 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.764+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c93f0 0x55c42e8d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.764+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e7b1a60 con 0x55c42e8c93f0 2023-07-14T13:32:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.764+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e7b1760 con 0x55c42e71c6b0 2023-07-14T13:32:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.764+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e6958c0 con 0x55c42e8c8f80 2023-07-14T13:32:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.764+0000 7fa4758c1b80 10 client.0 _ll_register_callbacks cb 0x55c42e7af700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:32:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.765+0000 7fa45bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c93f0 0x55c42e8d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.765+0000 7fa45bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c93f0 0x55c42e8d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37618/0 (socket says 172.21.15.17:37618) 2023-07-14T13:32:31.763 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.765+0000 7fa45bfff700 1 -- 172.21.15.17:0/80553829 learned_addr learned my addr 172.21.15.17:0/80553829 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.765+0000 7fa45affd700 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c8f80 0x55c42e8d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.765+0000 7fa45b7fe700 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 0x55c42e8d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.766+0000 7fa45b7fe700 1 -- 172.21.15.17:0/80553829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c8f80 msgr2=0x55c42e8d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.764 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.766+0000 7fa45b7fe700 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c8f80 0x55c42e8d2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.766+0000 7fa45b7fe700 1 -- 172.21.15.17:0/80553829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c93f0 msgr2=0x55c42e8d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.766+0000 7fa45b7fe700 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c93f0 0x55c42e8d27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.766+0000 7fa45b7fe700 1 -- 172.21.15.17:0/80553829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa450009830 con 0x55c42e71c6b0 2023-07-14T13:32:31.765 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.766+0000 7fa45b7fe700 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 0x55c42e8d4e60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0ce700 tx=0x7fa44c0ceb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87b15edcfcd2d99d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.767+0000 7fa43affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:32:31.768 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.767+0000 7fa43affd700 1 -- 172.21.15.17:0/80553829 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c0a20b0 con 0x55c42e71c6b0 2023-07-14T13:32:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.767+0000 7fa43affd700 1 -- 172.21.15.17:0/80553829 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa44c0a64d0 con 0x55c42e71c6b0 2023-07-14T13:32:31.769 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.771+0000 7fa4758c1b80 1 -- 172.21.15.17:0/80553829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c42e76b490 con 0x55c42e71c6b0 2023-07-14T13:32:31.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.791+0000 7fa43affd700 1 -- 172.21.15.17:0/80553829 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa44c09d570 con 0x55c42e71c6b0 2023-07-14T13:32:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.793+0000 7fa4758c1b80 10 client.29633 fetch_fsmap learned FSMap version 68 2023-07-14T13:32:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.793+0000 7fa4758c1b80 1 -- 172.21.15.17:0/80553829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55c42e628c00 con 0x55c42e71c6b0 2023-07-14T13:32:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.793+0000 7fa43affd700 1 -- 172.21.15.17:0/80553829 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa44c0b5030 con 0x55c42e71c6b0 2023-07-14T13:32:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.793+0000 7fa43affd700 1 -- 172.21.15.17:0/80553829 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa44c0a6040 con 0x55c42e71c6b0 2023-07-14T13:32:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.794+0000 7fa4758c1b80 10 client.29633 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:32:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.794+0000 7fa4758c1b80 10 client.29633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:32:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.794+0000 7fa4758c1b80 20 client.29633 populate_metadata read hostname 'smithi017' 2023-07-14T13:32:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.794+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c42e8e2350 0x55c42e8e4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.794+0000 7fa4758c1b80 4 client.29633 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:32:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.794+0000 7fa4758c1b80 1 -- 172.21.15.17:0/80553829 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c42e80ae50 con 0x55c42e8e2350 2023-07-14T13:32:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.795+0000 7fa45affd700 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c42e8e2350 0x55c42e8e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.797+0000 7fa45affd700 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c42e8e2350 0x55c42e8e4760 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adc43987a42bb719 server_cookie=c505b3eadeba9d9 in_seq=0 out_seq=0 2023-07-14T13:32:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.797+0000 7fa43affd700 10 client.29633 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.798+0000 7fa43affd700 1 -- 172.21.15.17:0/80553829 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c42e80ae50 con 0x55c42e8e2350 2023-07-14T13:32:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.798+0000 7fa43affd700 10 client.29633 handle_command_reply: tid=0 2023-07-14T13:32:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.798+0000 7fa4758c1b80 1 client.29633 shutdown 2023-07-14T13:32:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.799+0000 7fa4758c1b80 1 -- 172.21.15.17:0/80553829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 msgr2=0x55c42e8d4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.799+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 0x55c42e8d4e60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa44c0ce700 tx=0x7fa44c0ceb50 comp rx=0 tx=0).stop 2023-07-14T13:32:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.799+0000 7fa4758c1b80 1 -- 172.21.15.17:0/80553829 shutdown_connections 2023-07-14T13:32:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.799+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c42e8e2350 0x55c42e8e4760 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.799+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c93f0 0x55c42e8d27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.799+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e71c6b0 0x55c42e8d4e60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.799+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/80553829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c8f80 0x55c42e8d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.799+0000 7fa4758c1b80 1 -- 172.21.15.17:0/80553829 >> 172.21.15.17:0/80553829 conn(0x55c42e8b5be0 msgr2=0x55c42e8ba4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.799+0000 7fa43affd700 0 client.29633 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.801+0000 7fa4758c1b80 1 -- 172.21.15.17:0/80553829 shutdown_connections 2023-07-14T13:32:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.801+0000 7fa4758c1b80 1 -- 172.21.15.17:0/80553829 wait complete. 2023-07-14T13:32:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.802+0000 7fa4758c1b80 20 client.29633 trim_cache size 0 max 16384 2023-07-14T13:32:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.828+0000 7fa4758c1b80 1 Processor -- start 2023-07-14T13:32:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.828+0000 7fa4758c1b80 1 -- start start 2023-07-14T13:32:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.829+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8b5be0 0x55c42e8d9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.829+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c8f80 0x55c42e8cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.829+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.829+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e8bcb40 con 0x55c42e8b5be0 2023-07-14T13:32:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.829+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e8c97c0 con 0x55c42e8c93f0 2023-07-14T13:32:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.829+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e8cdf50 con 0x55c42e8c8f80 2023-07-14T13:32:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.830+0000 7fa45bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.830+0000 7fa45bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8bac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49478/0 (socket says 172.21.15.17:49478) 2023-07-14T13:32:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.830+0000 7fa45bfff700 1 -- 172.21.15.17:0/3015878721 learned_addr learned my addr 172.21.15.17:0/3015878721 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.830+0000 7fa45b7fe700 1 --2- 172.21.15.17:0/3015878721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8b5be0 0x55c42e8d9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.831+0000 7fa45bfff700 1 -- 172.21.15.17:0/3015878721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c8f80 msgr2=0x55c42e8cd530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:32:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.831+0000 7fa45bfff700 1 --2- 172.21.15.17:0/3015878721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c8f80 0x55c42e8cd530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.831+0000 7fa45bfff700 1 -- 172.21.15.17:0/3015878721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8b5be0 msgr2=0x55c42e8d9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.831+0000 7fa45bfff700 1 --2- 172.21.15.17:0/3015878721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8b5be0 0x55c42e8d9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.831+0000 7fa45bfff700 1 -- 172.21.15.17:0/3015878721 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c42e6661f0 con 0x55c42e8c93f0 2023-07-14T13:32:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.832+0000 7fa45bfff700 1 --2- 172.21.15.17:0/3015878721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8bac60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa45400bbb0 tx=0x7fa45401e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a3b73f7a188e141 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.832+0000 7fa4427fc700 1 -- 172.21.15.17:0/3015878721 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45400e040 con 0x55c42e8c93f0 2023-07-14T13:32:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.832+0000 7fa4427fc700 1 -- 172.21.15.17:0/3015878721 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa45400be40 con 0x55c42e8c93f0 2023-07-14T13:32:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.832+0000 7fa4427fc700 1 -- 172.21.15.17:0/3015878721 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454005600 con 0x55c42e8c93f0 2023-07-14T13:32:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.833+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3015878721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 msgr2=0x55c42e8bac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.834+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/3015878721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8bac60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa45400bbb0 tx=0x7fa45401e000 comp rx=0 tx=0).stop 2023-07-14T13:32:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.834+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3015878721 shutdown_connections 2023-07-14T13:32:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.834+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/3015878721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8bac60 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.834+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/3015878721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8b5be0 0x55c42e8d9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.834+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/3015878721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8c8f80 0x55c42e8cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.834+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3015878721 >> 172.21.15.17:0/3015878721 conn(0x55c42e8de940 msgr2=0x55c42e8cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.834+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3015878721 shutdown_connections 2023-07-14T13:32:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.835+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3015878721 wait complete. 2023-07-14T13:32:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.835+0000 7fa4758c1b80 1 -- start start 2023-07-14T13:32:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.835+0000 7fa4758c1b80 1 Processor -- start 2023-07-14T13:32:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.836+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8b5be0 0x55c42e8d9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.836+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c8f80 0x55c42e8c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.836+0000 7fa4758c1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.836+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e8cac40 con 0x55c42e8c8f80 2023-07-14T13:32:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.836+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e8cadb0 con 0x55c42e8c93f0 2023-07-14T13:32:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.836+0000 7fa4758c1b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c42e947200 con 0x55c42e8b5be0 2023-07-14T13:32:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.836+0000 7fa4758c1b80 10 client.0 _ll_register_callbacks cb 0x7fa44c09d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:32:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.837+0000 7fa45affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c8f80 0x55c42e8c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.837+0000 7fa45bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.837+0000 7fa45bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:49482/0 (socket says 172.21.15.17:49482) 2023-07-14T13:32:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.837+0000 7fa45bfff700 1 -- 172.21.15.17:0/3039835603 learned_addr learned my addr 172.21.15.17:0/3039835603 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.837+0000 7fa45b7fe700 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8b5be0 0x55c42e8d9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.837+0000 7fa45bfff700 1 -- 172.21.15.17:0/3039835603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8b5be0 msgr2=0x55c42e8d9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.837+0000 7fa45bfff700 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8b5be0 0x55c42e8d9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.837+0000 7fa45bfff700 1 -- 172.21.15.17:0/3039835603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c8f80 msgr2=0x55c42e8c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.837+0000 7fa45bfff700 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c8f80 0x55c42e8c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.837+0000 7fa45bfff700 1 -- 172.21.15.17:0/3039835603 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45c10d220 con 0x55c42e8c93f0 2023-07-14T13:32:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.837+0000 7fa45affd700 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c8f80 0x55c42e8c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:32:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.838+0000 7fa45bfff700 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8ca500 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa4540094d0 tx=0x7fa454004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=654310ae96f1653 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:31.837 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.838+0000 7fa43affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:32:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.838+0000 7fa43affd700 1 -- 172.21.15.17:0/3039835603 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454036040 con 0x55c42e8c93f0 2023-07-14T13:32:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.838+0000 7fa43affd700 1 -- 172.21.15.17:0/3039835603 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa454004fd0 con 0x55c42e8c93f0 2023-07-14T13:32:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.839+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3039835603 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa450011cf0 con 0x55c42e8c93f0 2023-07-14T13:32:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.839+0000 7fa43affd700 1 -- 172.21.15.17:0/3039835603 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa45400e040 con 0x55c42e8c93f0 2023-07-14T13:32:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.839+0000 7fa4758c1b80 10 client.29639 fetch_fsmap learned FSMap version 68 2023-07-14T13:32:31.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.839+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3039835603 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55c42e63e250 con 0x55c42e8c93f0 2023-07-14T13:32:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.839+0000 7fa43affd700 1 -- 172.21.15.17:0/3039835603 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa450011cf0 con 0x55c42e8c93f0 2023-07-14T13:32:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.840+0000 7fa43affd700 1 -- 172.21.15.17:0/3039835603 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa454030020 con 0x55c42e8c93f0 2023-07-14T13:32:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.840+0000 7fa4758c1b80 10 client.29639 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:32:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.840+0000 7fa4758c1b80 10 client.29639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:32:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.840+0000 7fa4758c1b80 20 client.29639 populate_metadata read hostname 'smithi017' 2023-07-14T13:32:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.840+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c42e9482f0 0x55c42e94a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:31.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.840+0000 7fa4758c1b80 4 client.29639 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:32:31.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.840+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3039835603 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c42e7ccff0 con 0x55c42e9482f0 2023-07-14T13:32:31.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.840+0000 7fa45b7fe700 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c42e9482f0 0x55c42e94a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:31.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.841+0000 7fa45b7fe700 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c42e9482f0 0x55c42e94a700 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a1b80449e97c5f9 server_cookie=10c29c58ee430f92 in_seq=0 out_seq=0 2023-07-14T13:32:31.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:31.841+0000 7fa43affd700 10 client.29639 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:32.074 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:31 smithi017 ceph-mon[95536]: pgmap v1040: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.21k op/s 2023-07-14T13:32:32.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:31 smithi135 ceph-mon[97338]: pgmap v1040: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.21k op/s 2023-07-14T13:32:32.215 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:31 smithi131 ceph-mon[96953]: pgmap v1040: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.21k op/s 2023-07-14T13:32:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 860.0 s, 326.0 tps, lat 310.540 ms stddev 391.767 2023-07-14T13:32:34.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:33 smithi017 ceph-mon[95536]: pgmap v1041: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.7 MiB/s wr, 1.08k op/s 2023-07-14T13:32:34.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:33 smithi135 ceph-mon[97338]: pgmap v1041: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.7 MiB/s wr, 1.08k op/s 2023-07-14T13:32:34.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:33 smithi131 ceph-mon[96953]: pgmap v1041: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.7 MiB/s wr, 1.08k op/s 2023-07-14T13:32:36.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:35 smithi017 ceph-mon[95536]: pgmap v1042: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.8 MiB/s wr, 984 op/s 2023-07-14T13:32:36.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:35 smithi135 ceph-mon[97338]: pgmap v1042: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.8 MiB/s wr, 984 op/s 2023-07-14T13:32:36.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:35 smithi131 ceph-mon[96953]: pgmap v1042: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.8 MiB/s wr, 984 op/s 2023-07-14T13:32:37.416 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 865.0 s, 519.8 tps, lat 191.376 ms stddev 52.404 2023-07-14T13:32:38.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:37 smithi017 ceph-mon[95536]: pgmap v1043: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 14 MiB/s wr, 1.51k op/s 2023-07-14T13:32:38.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:37 smithi135 ceph-mon[97338]: pgmap v1043: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 14 MiB/s wr, 1.51k op/s 2023-07-14T13:32:38.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:37 smithi131 ceph-mon[96953]: pgmap v1043: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 14 MiB/s wr, 1.51k op/s 2023-07-14T13:32:40.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:39 smithi135 ceph-mon[97338]: pgmap v1044: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.6 MiB/s wr, 1.01k op/s 2023-07-14T13:32:40.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:39 smithi131 ceph-mon[96953]: pgmap v1044: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.6 MiB/s wr, 1.01k op/s 2023-07-14T13:32:40.333 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:39 smithi017 ceph-mon[95536]: pgmap v1044: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.6 MiB/s wr, 1.01k op/s 2023-07-14T13:32:42.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:41 smithi135 ceph-mon[97338]: pgmap v1045: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 14 MiB/s wr, 1.47k op/s 2023-07-14T13:32:42.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:41 smithi131 ceph-mon[96953]: pgmap v1045: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 14 MiB/s wr, 1.47k op/s 2023-07-14T13:32:42.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:41 smithi017 ceph-mon[95536]: pgmap v1045: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 14 MiB/s wr, 1.47k op/s 2023-07-14T13:32:42.416 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 870.0 s, 504.2 tps, lat 196.775 ms stddev 78.738 2023-07-14T13:32:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.018+0000 7fa43affd700 1 -- 172.21.15.17:0/3039835603 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c42e7ccff0 con 0x55c42e9482f0 2023-07-14T13:32:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.018+0000 7fa43affd700 10 client.29639 handle_command_reply: tid=0 2023-07-14T13:32:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.018+0000 7fa4758c1b80 1 client.29639 shutdown 2023-07-14T13:32:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.021+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3039835603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 msgr2=0x55c42e8ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.021+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8ca500 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa4540094d0 tx=0x7fa454004d00 comp rx=0 tx=0).stop 2023-07-14T13:32:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.022+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3039835603 shutdown_connections 2023-07-14T13:32:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.022+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55c42e9482f0 0x55c42e94a700 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.022+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c42e8c93f0 0x55c42e8ca500 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.022+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c42e8b5be0 0x55c42e8d9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.022+0000 7fa4758c1b80 1 --2- 172.21.15.17:0/3039835603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c42e8c8f80 0x55c42e8c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.022+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3039835603 >> 172.21.15.17:0/3039835603 conn(0x55c42e8de940 msgr2=0x55c42e8bf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.022+0000 7fa43affd700 0 client.29639 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.022+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3039835603 shutdown_connections 2023-07-14T13:32:44.021 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.022+0000 7fa4758c1b80 1 -- 172.21.15.17:0/3039835603 wait complete. 2023-07-14T13:32:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.026+0000 7fa4758c1b80 20 client.29639 trim_cache size 0 max 16384 2023-07-14T13:32:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:32:44.023 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:32:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:32:44.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:32:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.029+0000 7fa461fff700 1 -- 172.21.15.17:0/2972229126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4440a13c0 msgr2=0x7fa4440a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.029+0000 7fa461fff700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4440a13c0 0x7fa4440a3870 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa454009850 tx=0x7fa454009780 comp rx=0 tx=0).stop 2023-07-14T13:32:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.029+0000 7fa461fff700 1 -- 172.21.15.17:0/2972229126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c0ffb30 msgr2=0x7fa45c19bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:44.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.029+0000 7fa461fff700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c0ffb30 0x7fa45c19bc00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00e9a0 tx=0x7fa44c00ed60 comp rx=0 tx=0).stop 2023-07-14T13:32:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.031+0000 7fa461fff700 1 -- 172.21.15.17:0/2972229126 shutdown_connections 2023-07-14T13:32:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.031+0000 7fa461fff700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa4440a13c0 0x7fa4440a3870 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.031+0000 7fa461fff700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa45c105b60 0x7fa45c195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.031+0000 7fa461fff700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c0ffb30 0x7fa45c19bc00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.031+0000 7fa461fff700 1 --2- 172.21.15.17:0/2972229126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa45c1004e0 0x7fa45c19c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.031+0000 7fa461fff700 1 -- 172.21.15.17:0/2972229126 >> 172.21.15.17:0/2972229126 conn(0x7fa45c0fb5f0 msgr2=0x7fa45c103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.034+0000 7fa461fff700 1 -- 172.21.15.17:0/2972229126 shutdown_connections 2023-07-14T13:32:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:44.034+0000 7fa461fff700 1 -- 172.21.15.17:0/2972229126 wait complete. 2023-07-14T13:32:44.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:43 smithi135 ceph-mon[97338]: pgmap v1046: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-07-14T13:32:44.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:43 smithi131 ceph-mon[96953]: pgmap v1046: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-07-14T13:32:44.325 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:43 smithi017 ceph-mon[95536]: pgmap v1046: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-07-14T13:32:46.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:45 smithi135 ceph-mon[97338]: pgmap v1047: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.11k op/s 2023-07-14T13:32:46.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:45 smithi131 ceph-mon[96953]: pgmap v1047: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.11k op/s 2023-07-14T13:32:46.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:45 smithi017 ceph-mon[95536]: pgmap v1047: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.11k op/s 2023-07-14T13:32:47.416 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 875.0 s, 496.6 tps, lat 203.439 ms stddev 69.830 2023-07-14T13:32:48.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:47 smithi135 ceph-mon[97338]: pgmap v1048: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 15 MiB/s wr, 1.67k op/s 2023-07-14T13:32:48.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:47 smithi131 ceph-mon[96953]: pgmap v1048: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 15 MiB/s wr, 1.67k op/s 2023-07-14T13:32:48.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:47 smithi017 ceph-mon[95536]: pgmap v1048: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 15 MiB/s wr, 1.67k op/s 2023-07-14T13:32:50.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:49 smithi135 ceph-mon[97338]: pgmap v1049: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.15k op/s 2023-07-14T13:32:50.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:49 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:32:50.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:49 smithi131 ceph-mon[96953]: pgmap v1049: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.15k op/s 2023-07-14T13:32:50.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:49 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:32:50.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:49 smithi017 ceph-mon[95536]: pgmap v1049: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.15k op/s 2023-07-14T13:32:50.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:49 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:32:51.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:51 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.666 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:51 smithi135 ceph-mon[97338]: pgmap v1050: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 14 MiB/s wr, 1.61k op/s 2023-07-14T13:32:51.713 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.713 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.714 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.714 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.714 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.714 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:51 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.714 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:51 smithi131 ceph-mon[96953]: pgmap v1050: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 14 MiB/s wr, 1.61k op/s 2023-07-14T13:32:51.823 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.823 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.823 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.824 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.824 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.824 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:51 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:51.824 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:51 smithi017 ceph-mon[95536]: pgmap v1050: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 14 MiB/s wr, 1.61k op/s 2023-07-14T13:32:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 880.0 s, 458.0 tps, lat 218.945 ms stddev 66.775 2023-07-14T13:32:53.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:52 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:32:53.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:52 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:32:53.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:52 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:53.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:52 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:32:53.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:52 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:32:53.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:52 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:53.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:52 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:32:53.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:52 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:32:53.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:52 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:32:54.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:53 smithi017 ceph-mon[95536]: pgmap v1051: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.27k op/s 2023-07-14T13:32:54.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:53 smithi135 ceph-mon[97338]: pgmap v1051: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.27k op/s 2023-07-14T13:32:54.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:53 smithi131 ceph-mon[96953]: pgmap v1051: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.27k op/s 2023-07-14T13:32:56.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:55 smithi017 ceph-mon[95536]: pgmap v1052: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.9 MiB/s wr, 1.14k op/s 2023-07-14T13:32:56.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:55 smithi135 ceph-mon[97338]: pgmap v1052: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.9 MiB/s wr, 1.14k op/s 2023-07-14T13:32:56.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:55 smithi131 ceph-mon[96953]: pgmap v1052: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.9 MiB/s wr, 1.14k op/s 2023-07-14T13:32:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.307+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1825335669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41024f0 msgr2=0x7f06e4102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.304 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.307+0000 7f06ec7ff700 1 --2- 172.21.15.17:0/1825335669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41024f0 0x7f06e4102940 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f06d40098f0 tx=0x7f06d4009c00 comp rx=0 tx=0).stop 2023-07-14T13:32:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.308+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1825335669 shutdown_connections 2023-07-14T13:32:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.308+0000 7f06ec7ff700 1 --2- 172.21.15.17:0/1825335669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41024f0 0x7f06e4102940 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.308+0000 7f06ec7ff700 1 --2- 172.21.15.17:0/1825335669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4104a60 0x7f06e40679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.308+0000 7f06ec7ff700 1 --2- 172.21.15.17:0/1825335669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06e4067ee0 0x7f06e4068350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.308+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1825335669 >> 172.21.15.17:0/1825335669 conn(0x7f06e4074760 msgr2=0x7f06e4074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.320+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1825335669 shutdown_connections 2023-07-14T13:32:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.320+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1825335669 wait complete. 2023-07-14T13:32:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.322+0000 7f06ec7ff700 1 Processor -- start 2023-07-14T13:32:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.322+0000 7f06ec7ff700 1 -- start start 2023-07-14T13:32:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.323+0000 7f06ec7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4067ee0 0x7f06e4071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.323+0000 7f06ec7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41024f0 0x7f06e4071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.323+0000 7f06ec7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06e4104a60 0x7f06e406b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.323+0000 7f06ec7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e406bf60 con 0x7f06e4067ee0 2023-07-14T13:32:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.323+0000 7f06ec7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e406c0d0 con 0x7f06e41024f0 2023-07-14T13:32:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.323+0000 7f06ec7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e406c290 con 0x7f06e4104a60 2023-07-14T13:32:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.323+0000 7f06e9d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41024f0 0x7f06e4071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.323+0000 7f06e9d9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41024f0 0x7f06e4071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52794/0 (socket says 172.21.15.17:52794) 2023-07-14T13:32:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.323+0000 7f06e9d9a700 1 -- 172.21.15.17:0/1525480076 learned_addr learned my addr 172.21.15.17:0/1525480076 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.324+0000 7f06ead9c700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06e4104a60 0x7f06e406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.324+0000 7f06ea59b700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4067ee0 0x7f06e4071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.326+0000 7f06e9d9a700 1 -- 172.21.15.17:0/1525480076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06e4104a60 msgr2=0x7f06e406b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.326+0000 7f06e9d9a700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06e4104a60 0x7f06e406b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.326+0000 7f06e9d9a700 1 -- 172.21.15.17:0/1525480076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4067ee0 msgr2=0x7f06e4071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.326+0000 7f06e9d9a700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4067ee0 0x7f06e4071a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.326+0000 7f06e9d9a700 1 -- 172.21.15.17:0/1525480076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d4009520 con 0x7f06e41024f0 2023-07-14T13:32:57.324 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.327+0000 7f06e9d9a700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41024f0 0x7f06e4071f90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f06e000e9c0 tx=0x7f06e000ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.328+0000 7f06db7fe700 1 -- 172.21.15.17:0/1525480076 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e000cbd0 con 0x7f06e41024f0 2023-07-14T13:32:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.328+0000 7f06db7fe700 1 -- 172.21.15.17:0/1525480076 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06e000cd30 con 0x7f06e41024f0 2023-07-14T13:32:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.329+0000 7f06db7fe700 1 -- 172.21.15.17:0/1525480076 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e00054e0 con 0x7f06e41024f0 2023-07-14T13:32:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.329+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1525480076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e406c570 con 0x7f06e41024f0 2023-07-14T13:32:57.326 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.329+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1525480076 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e411bb50 con 0x7f06e41024f0 2023-07-14T13:32:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.340+0000 7f06db7fe700 1 -- 172.21.15.17:0/1525480076 <== mon.2 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f06e0004750 con 0x7f06e41024f0 2023-07-14T13:32:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.340+0000 7f070008bb80 1 Processor -- start 2023-07-14T13:32:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.349+0000 7f06db7fe700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f06d00a14d0 0x7f06d00a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.349+0000 7f06db7fe700 1 -- 172.21.15.17:0/1525480076 <== mon.2 v2:172.21.15.131:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f06e0014070 con 0x7f06e41024f0 2023-07-14T13:32:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.352+0000 7f070008bb80 1 -- start start 2023-07-14T13:32:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.352+0000 7f070008bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140ddbf6b0 0x56140df68d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.352+0000 7f070008bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 0x56140df63040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.352+0000 7f070008bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 0x56140df639d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.352+0000 7f070008bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140de68c50 con 0x56140df63580 2023-07-14T13:32:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.352+0000 7f070008bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140debb9e0 con 0x56140df692d0 2023-07-14T13:32:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.352+0000 7f070008bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140deb4e70 con 0x56140ddbf6b0 2023-07-14T13:32:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.353+0000 7f06ead9c700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f06d00a14d0 0x7f06d00a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.355+0000 7f06ead9c700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f06d00a14d0 0x7f06d00a3980 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f06d40098c0 tx=0x7f06d4019040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.355+0000 7f06ead9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 0x56140df639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.355+0000 7f06ead9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 0x56140df639d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34176/0 (socket says 172.21.15.17:34176) 2023-07-14T13:32:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.355+0000 7f06ead9c700 1 -- 172.21.15.17:0/2962389011 learned_addr learned my addr 172.21.15.17:0/2962389011 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.356+0000 7f06ea59b700 1 --2- 172.21.15.17:0/2962389011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140ddbf6b0 0x56140df68d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.356+0000 7f06e9d9a700 1 --2- 172.21.15.17:0/2962389011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 0x56140df63040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.357+0000 7f06ea59b700 1 -- 172.21.15.17:0/2962389011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 msgr2=0x56140df63040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.357+0000 7f06ea59b700 1 --2- 172.21.15.17:0/2962389011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 0x56140df63040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.357+0000 7f06ea59b700 1 -- 172.21.15.17:0/2962389011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 msgr2=0x56140df639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.357+0000 7f06ea59b700 1 --2- 172.21.15.17:0/2962389011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 0x56140df639d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.357+0000 7f06ea59b700 1 -- 172.21.15.17:0/2962389011 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56140dce2d80 con 0x56140ddbf6b0 2023-07-14T13:32:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.357+0000 7f06ea59b700 1 --2- 172.21.15.17:0/2962389011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140ddbf6b0 0x56140df68d90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009cd0 tx=0x7f06dc007500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e2def0d5aa2e34 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.361+0000 7f06d8ff9700 1 -- 172.21.15.17:0/2962389011 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc018070 con 0x56140ddbf6b0 2023-07-14T13:32:57.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.361+0000 7f06d8ff9700 1 -- 172.21.15.17:0/2962389011 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06dc00f050 con 0x56140ddbf6b0 2023-07-14T13:32:57.359 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.361+0000 7f06d8ff9700 1 -- 172.21.15.17:0/2962389011 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0046f0 con 0x56140ddbf6b0 2023-07-14T13:32:57.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.362+0000 7f070008bb80 1 -- 172.21.15.17:0/2962389011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140ddbf6b0 msgr2=0x56140df68d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.360 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.362+0000 7f070008bb80 1 --2- 172.21.15.17:0/2962389011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140ddbf6b0 0x56140df68d90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009cd0 tx=0x7f06dc007500 comp rx=0 tx=0).stop 2023-07-14T13:32:57.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.365+0000 7f070008bb80 1 -- 172.21.15.17:0/2962389011 shutdown_connections 2023-07-14T13:32:57.361 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.365+0000 7f070008bb80 1 --2- 172.21.15.17:0/2962389011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 0x56140df639d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.365+0000 7f070008bb80 1 --2- 172.21.15.17:0/2962389011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140ddbf6b0 0x56140df68d90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.365+0000 7f070008bb80 1 --2- 172.21.15.17:0/2962389011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 0x56140df63040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.365+0000 7f070008bb80 1 -- 172.21.15.17:0/2962389011 >> 172.21.15.17:0/2962389011 conn(0x56140df58be0 msgr2=0x56140df5df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:57.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.365+0000 7f070008bb80 1 -- 172.21.15.17:0/2962389011 shutdown_connections 2023-07-14T13:32:57.362 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.366+0000 7f070008bb80 1 -- 172.21.15.17:0/2962389011 wait complete. 2023-07-14T13:32:57.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.366+0000 7f070008bb80 1 -- start start 2023-07-14T13:32:57.363 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.367+0000 7f070008bb80 1 Processor -- start 2023-07-14T13:32:57.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.367+0000 7f070008bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 0x56140df6c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.367+0000 7f070008bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140df63580 0x56140df6ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.367+0000 7f070008bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df692d0 0x56140df6d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.367+0000 7f070008bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140de54a60 con 0x56140df692d0 2023-07-14T13:32:57.364 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.367+0000 7f070008bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140de54760 con 0x56140ddbf6b0 2023-07-14T13:32:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.367+0000 7f070008bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140dd388c0 con 0x56140df63580 2023-07-14T13:32:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.367+0000 7f070008bb80 10 client.0 _ll_register_callbacks cb 0x56140de52700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:32:57.365 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.368+0000 7f06ea59b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 0x56140df6c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.368+0000 7f06ea59b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 0x56140df6c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52818/0 (socket says 172.21.15.17:52818) 2023-07-14T13:32:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.368+0000 7f06ea59b700 1 -- 172.21.15.17:0/2268638159 learned_addr learned my addr 172.21.15.17:0/2268638159 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.368+0000 7f06e9d9a700 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140df63580 0x56140df6ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.368+0000 7f06ead9c700 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df692d0 0x56140df6d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.368+0000 7f06e9d9a700 1 -- 172.21.15.17:0/2268638159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 msgr2=0x56140df6c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.368+0000 7f06e9d9a700 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 0x56140df6c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.368+0000 7f06e9d9a700 1 -- 172.21.15.17:0/2268638159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df692d0 msgr2=0x56140df6d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.369+0000 7f06e9d9a700 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df692d0 0x56140df6d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.369+0000 7f06e9d9a700 1 -- 172.21.15.17:0/2268638159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc009900 con 0x56140df63580 2023-07-14T13:32:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.369+0000 7f06e9d9a700 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140df63580 0x56140df6ceb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f06e00ca6d0 tx=0x7f06e0099aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc2a55200dcfd00b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.369+0000 7f06cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:32:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.370+0000 7f06cdffb700 1 -- 172.21.15.17:0/2268638159 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e009a4b0 con 0x56140df63580 2023-07-14T13:32:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.370+0000 7f06cdffb700 1 -- 172.21.15.17:0/2268638159 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f06e0099540 con 0x56140df63580 2023-07-14T13:32:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.370+0000 7f070008bb80 1 -- 172.21.15.17:0/2268638159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56140de0e490 con 0x56140df63580 2023-07-14T13:32:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.371+0000 7f06cdffb700 1 -- 172.21.15.17:0/2268638159 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06e00cab60 con 0x56140df63580 2023-07-14T13:32:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.371+0000 7f070008bb80 10 client.29584 fetch_fsmap learned FSMap version 68 2023-07-14T13:32:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.371+0000 7f070008bb80 1 -- 172.21.15.17:0/2268638159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x56140dccbc00 con 0x56140df63580 2023-07-14T13:32:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.371+0000 7f06cdffb700 1 -- 172.21.15.17:0/2268638159 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56140de0e490 con 0x56140df63580 2023-07-14T13:32:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.371+0000 7f06cdffb700 1 -- 172.21.15.17:0/2268638159 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f06e00a20a0 con 0x56140df63580 2023-07-14T13:32:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.371+0000 7f070008bb80 10 client.29584 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:32:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.371+0000 7f070008bb80 10 client.29584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:32:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.371+0000 7f070008bb80 20 client.29584 populate_metadata read hostname 'smithi017' 2023-07-14T13:32:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.371+0000 7f070008bb80 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56140df7cb50 0x56140df7ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.371+0000 7f070008bb80 4 client.29584 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:32:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.371+0000 7f070008bb80 1 -- 172.21.15.17:0/2268638159 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56140deade50 con 0x56140df7cb50 2023-07-14T13:32:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.372+0000 7f06ea59b700 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56140df7cb50 0x56140df7ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.379+0000 7f06ea59b700 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56140df7cb50 0x56140df7ef60 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f85d33cbfc762ddd server_cookie=d6a72bf797d5c8b6 in_seq=0 out_seq=0 2023-07-14T13:32:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.379+0000 7f06cdffb700 10 client.29584 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.380+0000 7f06cdffb700 1 -- 172.21.15.17:0/2268638159 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56140deade50 con 0x56140df7cb50 2023-07-14T13:32:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.380+0000 7f06cdffb700 10 client.29584 handle_command_reply: tid=0 2023-07-14T13:32:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.380+0000 7f070008bb80 1 client.29584 shutdown 2023-07-14T13:32:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.386+0000 7f070008bb80 1 -- 172.21.15.17:0/2268638159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140df63580 msgr2=0x56140df6ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.386+0000 7f070008bb80 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140df63580 0x56140df6ceb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f06e00ca6d0 tx=0x7f06e0099aa0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.388+0000 7f070008bb80 1 -- 172.21.15.17:0/2268638159 shutdown_connections 2023-07-14T13:32:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.388+0000 7f070008bb80 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56140df7cb50 0x56140df7ef60 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.388+0000 7f070008bb80 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df692d0 0x56140df6d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.388+0000 7f070008bb80 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 0x56140df6c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.388+0000 7f070008bb80 1 --2- 172.21.15.17:0/2268638159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140df63580 0x56140df6ceb0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.388+0000 7f070008bb80 1 -- 172.21.15.17:0/2268638159 >> 172.21.15.17:0/2268638159 conn(0x56140df58be0 msgr2=0x56140df5d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.388+0000 7f06cdffb700 0 client.29584 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.389+0000 7f070008bb80 1 -- 172.21.15.17:0/2268638159 shutdown_connections 2023-07-14T13:32:57.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.389+0000 7f070008bb80 1 -- 172.21.15.17:0/2268638159 wait complete. 2023-07-14T13:32:57.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.390+0000 7f070008bb80 20 client.29584 trim_cache size 0 max 16384 2023-07-14T13:32:57.418 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 885.0 s, 495.2 tps, lat 200.450 ms stddev 75.193 2023-07-14T13:32:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.422+0000 7f070008bb80 1 Processor -- start 2023-07-14T13:32:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.422+0000 7f070008bb80 1 -- start start 2023-07-14T13:32:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.422+0000 7f070008bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 0x56140df63040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.422+0000 7f070008bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 0x56140df73c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.423+0000 7f070008bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140df692d0 0x56140df5dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.423+0000 7f070008bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140df6af00 con 0x56140df63580 2023-07-14T13:32:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.423+0000 7f070008bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140df67750 con 0x56140ddbf6b0 2023-07-14T13:32:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.423+0000 7f070008bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140df55b40 con 0x56140df692d0 2023-07-14T13:32:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.423+0000 7f06ea59b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 0x56140df63040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.423+0000 7f06ea59b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 0x56140df63040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52822/0 (socket says 172.21.15.17:52822) 2023-07-14T13:32:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.423+0000 7f06ea59b700 1 -- 172.21.15.17:0/1735866994 learned_addr learned my addr 172.21.15.17:0/1735866994 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.424+0000 7f06ea59b700 1 -- 172.21.15.17:0/1735866994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140df692d0 msgr2=0x56140df5dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.424+0000 7f06ea59b700 1 --2- 172.21.15.17:0/1735866994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140df692d0 0x56140df5dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.424+0000 7f06ea59b700 1 -- 172.21.15.17:0/1735866994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 msgr2=0x56140df73c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.424+0000 7f06ea59b700 1 --2- 172.21.15.17:0/1735866994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 0x56140df73c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.424+0000 7f06ea59b700 1 -- 172.21.15.17:0/1735866994 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56140dd091f0 con 0x56140ddbf6b0 2023-07-14T13:32:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.424+0000 7f06ea59b700 1 --2- 172.21.15.17:0/1735866994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 0x56140df63040 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009cd0 tx=0x7f06dc009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65b2c1f1deec54de server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.425+0000 7f06d97fa700 1 -- 172.21.15.17:0/1735866994 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc018070 con 0x56140ddbf6b0 2023-07-14T13:32:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.425+0000 7f06d97fa700 1 -- 172.21.15.17:0/1735866994 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06dc019040 con 0x56140ddbf6b0 2023-07-14T13:32:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.425+0000 7f06d97fa700 1 -- 172.21.15.17:0/1735866994 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc024070 con 0x56140ddbf6b0 2023-07-14T13:32:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.426+0000 7f070008bb80 1 -- 172.21.15.17:0/1735866994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 msgr2=0x56140df63040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.426+0000 7f070008bb80 1 --2- 172.21.15.17:0/1735866994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 0x56140df63040 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009cd0 tx=0x7f06dc009040 comp rx=0 tx=0).stop 2023-07-14T13:32:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.426+0000 7f070008bb80 1 -- 172.21.15.17:0/1735866994 shutdown_connections 2023-07-14T13:32:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.426+0000 7f070008bb80 1 --2- 172.21.15.17:0/1735866994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140df692d0 0x56140df5dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.426+0000 7f070008bb80 1 --2- 172.21.15.17:0/1735866994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140ddbf6b0 0x56140df63040 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.426+0000 7f070008bb80 1 --2- 172.21.15.17:0/1735866994 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 0x56140df73c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.426+0000 7f070008bb80 1 -- 172.21.15.17:0/1735866994 >> 172.21.15.17:0/1735866994 conn(0x56140df58be0 msgr2=0x56140df66c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.427+0000 7f070008bb80 1 -- 172.21.15.17:0/1735866994 shutdown_connections 2023-07-14T13:32:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.427+0000 7f070008bb80 1 -- 172.21.15.17:0/1735866994 wait complete. 2023-07-14T13:32:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.428+0000 7f070008bb80 1 -- start start 2023-07-14T13:32:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.428+0000 7f070008bb80 1 Processor -- start 2023-07-14T13:32:57.426 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.429+0000 7f070008bb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140ddbf6b0 0x56140dfc8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.429+0000 7f070008bb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 0x56140dfc94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.429+0000 7f070008bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 0x56140dfc49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.429+0000 7f070008bb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140dfc4f70 con 0x56140df63580 2023-07-14T13:32:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.429+0000 7f070008bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140dfc50b0 con 0x56140df692d0 2023-07-14T13:32:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.429+0000 7f070008bb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x56140dfc5270 con 0x56140ddbf6b0 2023-07-14T13:32:57.427 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.429+0000 7f070008bb80 10 client.0 _ll_register_callbacks cb 0x56140de52700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:32:57.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.430+0000 7f06ea59b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140ddbf6b0 0x56140dfc8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.430+0000 7f06ead9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 0x56140dfc49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.430+0000 7f06ead9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 0x56140dfc49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:52834/0 (socket says 172.21.15.17:52834) 2023-07-14T13:32:57.428 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.430+0000 7f06ead9c700 1 -- 172.21.15.17:0/3673526974 learned_addr learned my addr 172.21.15.17:0/3673526974 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:32:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.431+0000 7f06ead9c700 1 -- 172.21.15.17:0/3673526974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140ddbf6b0 msgr2=0x56140dfc8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.431+0000 7f06ead9c700 1 --2- 172.21.15.17:0/3673526974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140ddbf6b0 0x56140dfc8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.431+0000 7f06ead9c700 1 -- 172.21.15.17:0/3673526974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 msgr2=0x56140dfc94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:32:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.431+0000 7f06ead9c700 1 --2- 172.21.15.17:0/3673526974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 0x56140dfc94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.431+0000 7f06ead9c700 1 -- 172.21.15.17:0/3673526974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56140dce2d80 con 0x56140df692d0 2023-07-14T13:32:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.431+0000 7f06ead9c700 1 --2- 172.21.15.17:0/3673526974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 0x56140dfc49a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f06d400f6c0 tx=0x7f06d4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88ff3cb6b5db4852 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:32:57.429 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.431+0000 7f06cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:32:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.432+0000 7f06cdffb700 1 -- 172.21.15.17:0/3673526974 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4029040 con 0x56140df692d0 2023-07-14T13:32:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.432+0000 7f06cdffb700 1 -- 172.21.15.17:0/3673526974 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f06d400bb70 con 0x56140df692d0 2023-07-14T13:32:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.432+0000 7f070008bb80 1 -- 172.21.15.17:0/3673526974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06dc00f050 con 0x56140df692d0 2023-07-14T13:32:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.432+0000 7f06cdffb700 1 -- 172.21.15.17:0/3673526974 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06d4005040 con 0x56140df692d0 2023-07-14T13:32:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.432+0000 7f070008bb80 10 client.29657 fetch_fsmap learned FSMap version 68 2023-07-14T13:32:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.433+0000 7f070008bb80 1 -- 172.21.15.17:0/3673526974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x56140dce1250 con 0x56140df692d0 2023-07-14T13:32:57.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.443+0000 7f06cdffb700 1 -- 172.21.15.17:0/3673526974 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06dc00f050 con 0x56140df692d0 2023-07-14T13:32:57.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.443+0000 7f06cdffb700 1 -- 172.21.15.17:0/3673526974 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f06d4004bc0 con 0x56140df692d0 2023-07-14T13:32:57.440 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.443+0000 7f070008bb80 10 client.29657 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:32:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.443+0000 7f070008bb80 10 client.29657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:32:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.443+0000 7f070008bb80 20 client.29657 populate_metadata read hostname 'smithi017' 2023-07-14T13:32:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.443+0000 7f070008bb80 1 --2- 172.21.15.17:0/3673526974 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56140dfd1ff0 0x56140dfd4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:32:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.443+0000 7f070008bb80 4 client.29657 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:32:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.443+0000 7f070008bb80 1 -- 172.21.15.17:0/3673526974 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56140de6fff0 con 0x56140dfd1ff0 2023-07-14T13:32:57.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.444+0000 7f06ea59b700 1 --2- 172.21.15.17:0/3673526974 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56140dfd1ff0 0x56140dfd4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:32:57.443 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.446+0000 7f06ea59b700 1 --2- 172.21.15.17:0/3673526974 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56140dfd1ff0 0x56140dfd4400 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ecddb3e7eb425e1 server_cookie=88f2d4e0592280c4 in_seq=0 out_seq=0 2023-07-14T13:32:57.444 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.446+0000 7f06cdffb700 10 client.29657 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.504+0000 7f06cdffb700 1 -- 172.21.15.17:0/3673526974 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56140de6fff0 con 0x56140dfd1ff0 2023-07-14T13:32:57.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.504+0000 7f06cdffb700 10 client.29657 handle_command_reply: tid=0 2023-07-14T13:32:57.502 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.504+0000 7f070008bb80 1 client.29657 shutdown 2023-07-14T13:32:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.505+0000 7f070008bb80 1 -- 172.21.15.17:0/3673526974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 msgr2=0x56140dfc49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.505+0000 7f070008bb80 1 --2- 172.21.15.17:0/3673526974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 0x56140dfc49a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f06d400f6c0 tx=0x7f06d4009260 comp rx=0 tx=0).stop 2023-07-14T13:32:57.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.506+0000 7f070008bb80 1 -- 172.21.15.17:0/3673526974 shutdown_connections 2023-07-14T13:32:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.506+0000 7f070008bb80 1 --2- 172.21.15.17:0/3673526974 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x56140dfd1ff0 0x56140dfd4400 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.506+0000 7f070008bb80 1 --2- 172.21.15.17:0/3673526974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56140df692d0 0x56140dfc49a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.506+0000 7f070008bb80 1 --2- 172.21.15.17:0/3673526974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56140ddbf6b0 0x56140dfc8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.506+0000 7f070008bb80 1 --2- 172.21.15.17:0/3673526974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x56140df63580 0x56140dfc94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.506+0000 7f070008bb80 1 -- 172.21.15.17:0/3673526974 >> 172.21.15.17:0/3673526974 conn(0x56140df58be0 msgr2=0x56140df67b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.506+0000 7f06cdffb700 0 client.29657 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:32:57.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.506+0000 7f070008bb80 1 -- 172.21.15.17:0/3673526974 shutdown_connections 2023-07-14T13:32:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.506+0000 7f070008bb80 1 -- 172.21.15.17:0/3673526974 wait complete. 2023-07-14T13:32:57.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.507+0000 7f070008bb80 20 client.29657 trim_cache size 0 max 16384 2023-07-14T13:32:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:32:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:32:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:32:57.507 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:32:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.508+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1525480076 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f06d00a14d0 msgr2=0x7f06d00a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.508+0000 7f06ec7ff700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f06d00a14d0 0x7f06d00a3980 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f06d40098c0 tx=0x7f06d4019040 comp rx=0 tx=0).stop 2023-07-14T13:32:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.508+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1525480076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41024f0 msgr2=0x7f06e4071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:32:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.508+0000 7f06ec7ff700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41024f0 0x7f06e4071f90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f06e000e9c0 tx=0x7f06e000ed80 comp rx=0 tx=0).stop 2023-07-14T13:32:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.509+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1525480076 shutdown_connections 2023-07-14T13:32:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.509+0000 7f06ec7ff700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f06d00a14d0 0x7f06d00a3980 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.509+0000 7f06ec7ff700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06e4104a60 0x7f06e406b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.509+0000 7f06ec7ff700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4067ee0 0x7f06e4071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.509+0000 7f06ec7ff700 1 --2- 172.21.15.17:0/1525480076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41024f0 0x7f06e4071f90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:32:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.509+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1525480076 >> 172.21.15.17:0/1525480076 conn(0x7f06e4074760 msgr2=0x7f06e41014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:32:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.509+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1525480076 shutdown_connections 2023-07-14T13:32:57.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:32:57.509+0000 7f06ec7ff700 1 -- 172.21.15.17:0/1525480076 wait complete. 2023-07-14T13:32:58.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:57 smithi017 ceph-mon[95536]: pgmap v1053: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 15 MiB/s wr, 1.69k op/s 2023-07-14T13:32:58.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:57 smithi135 ceph-mon[97338]: pgmap v1053: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 15 MiB/s wr, 1.69k op/s 2023-07-14T13:32:58.216 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:57 smithi131 ceph-mon[96953]: pgmap v1053: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 15 MiB/s wr, 1.69k op/s 2023-07-14T13:33:00.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:32:59 smithi017 ceph-mon[95536]: pgmap v1054: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2023-07-14T13:33:00.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:32:59 smithi135 ceph-mon[97338]: pgmap v1054: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2023-07-14T13:33:00.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:32:59 smithi131 ceph-mon[96953]: pgmap v1054: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2023-07-14T13:33:02.073 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:01 smithi017 ceph-mon[95536]: pgmap v1055: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 15 MiB/s wr, 1.62k op/s 2023-07-14T13:33:02.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:01 smithi135 ceph-mon[97338]: pgmap v1055: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 15 MiB/s wr, 1.62k op/s 2023-07-14T13:33:02.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:01 smithi131 ceph-mon[96953]: pgmap v1055: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 15 MiB/s wr, 1.62k op/s 2023-07-14T13:33:02.416 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 890.0 s, 492.6 tps, lat 196.076 ms stddev 130.040 2023-07-14T13:33:04.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:03 smithi135 ceph-mon[97338]: pgmap v1056: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-14T13:33:04.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:03 smithi131 ceph-mon[96953]: pgmap v1056: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-14T13:33:04.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:03 smithi017 ceph-mon[95536]: pgmap v1056: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-14T13:33:06.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:05 smithi135 ceph-mon[97338]: pgmap v1057: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.17k op/s 2023-07-14T13:33:06.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:05 smithi135 ceph-mon[97338]: osdmap e144: 12 total, 12 up, 12 in 2023-07-14T13:33:06.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:05 smithi131 ceph-mon[96953]: pgmap v1057: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.17k op/s 2023-07-14T13:33:06.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:05 smithi131 ceph-mon[96953]: osdmap e144: 12 total, 12 up, 12 in 2023-07-14T13:33:06.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:05 smithi017 ceph-mon[95536]: pgmap v1057: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.17k op/s 2023-07-14T13:33:06.325 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:05 smithi017 ceph-mon[95536]: osdmap e144: 12 total, 12 up, 12 in 2023-07-14T13:33:07.420 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 895.0 s, 178.0 tps, lat 556.587 ms stddev 324.316 2023-07-14T13:33:08.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:07 smithi131 ceph-mon[96953]: pgmap v1059: 97 pgs: 21 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 40 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.17k op/s 2023-07-14T13:33:08.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:07 smithi017 ceph-mon[95536]: pgmap v1059: 97 pgs: 21 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 40 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.17k op/s 2023-07-14T13:33:08.415 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:07 smithi135 ceph-mon[97338]: pgmap v1059: 97 pgs: 21 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 40 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 11 MiB/s wr, 1.17k op/s 2023-07-14T13:33:10.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:10 smithi017 ceph-mon[95536]: pgmap v1060: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:33:10.414 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:10 smithi135 ceph-mon[97338]: pgmap v1060: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:33:10.467 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:10 smithi131 ceph-mon[96953]: pgmap v1060: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2023-07-14T13:33:10.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.794+0000 7f22305ff700 1 -- 172.21.15.17:0/1631879279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f222810e2a0 msgr2=0x7f222810e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:10.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.794+0000 7f22305ff700 1 --2- 172.21.15.17:0/1631879279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f222810e2a0 0x7f222810e670 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2218009990 tx=0x7f2218009ca0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.796+0000 7f22305ff700 1 -- 172.21.15.17:0/1631879279 shutdown_connections 2023-07-14T13:33:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.796+0000 7f22305ff700 1 --2- 172.21.15.17:0/1631879279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222806d3a0 0x7f222811b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.796+0000 7f22305ff700 1 --2- 172.21.15.17:0/1631879279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f222810e2a0 0x7f222810e670 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.796+0000 7f22305ff700 1 --2- 172.21.15.17:0/1631879279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f222806c910 0x7f222806cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.796+0000 7f22305ff700 1 -- 172.21.15.17:0/1631879279 >> 172.21.15.17:0/1631879279 conn(0x7f222806bd70 msgr2=0x7f2228070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.807+0000 7f22305ff700 1 -- 172.21.15.17:0/1631879279 shutdown_connections 2023-07-14T13:33:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.808+0000 7f22305ff700 1 -- 172.21.15.17:0/1631879279 wait complete. 2023-07-14T13:33:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.809+0000 7f22305ff700 1 Processor -- start 2023-07-14T13:33:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.810+0000 7f22305ff700 1 -- start start 2023-07-14T13:33:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.811+0000 7f22305ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f222806c910 0x7f22281aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.811+0000 7f22305ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f222806d3a0 0x7f22281ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.811+0000 7f22305ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222810e2a0 0x7f22281a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.811+0000 7f22305ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22281a5070 con 0x7f222806c910 2023-07-14T13:33:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.811+0000 7f22305ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22281a51b0 con 0x7f222810e2a0 2023-07-14T13:33:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.811+0000 7f22305ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22281a5370 con 0x7f222806d3a0 2023-07-14T13:33:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.813+0000 7f222db9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f222806d3a0 0x7f22281ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.813+0000 7f222eb9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222810e2a0 0x7f22281a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.813+0000 7f222db9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f222806d3a0 0x7f22281ab010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41002/0 (socket says 172.21.15.17:41002) 2023-07-14T13:33:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.813+0000 7f222db9a700 1 -- 172.21.15.17:0/2368580544 learned_addr learned my addr 172.21.15.17:0/2368580544 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.813+0000 7f222db9a700 1 -- 172.21.15.17:0/2368580544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222810e2a0 msgr2=0x7f22281a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.813+0000 7f222db9a700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222810e2a0 0x7f22281a48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.814+0000 7f222db9a700 1 -- 172.21.15.17:0/2368580544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f222806c910 msgr2=0x7f22281aaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.814+0000 7f222db9a700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f222806c910 0x7f22281aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.814+0000 7f222db9a700 1 -- 172.21.15.17:0/2368580544 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22180095f0 con 0x7f222806d3a0 2023-07-14T13:33:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.814+0000 7f222db9a700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f222806d3a0 0x7f22281ab010 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f222000ba50 tx=0x7f222000be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.815+0000 7f221f7fe700 1 -- 172.21.15.17:0/2368580544 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000cab0 con 0x7f222806d3a0 2023-07-14T13:33:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.815+0000 7f221f7fe700 1 -- 172.21.15.17:0/2368580544 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f222000cc10 con 0x7f222806d3a0 2023-07-14T13:33:10.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.815+0000 7f221f7fe700 1 -- 172.21.15.17:0/2368580544 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22200075b0 con 0x7f222806d3a0 2023-07-14T13:33:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.815+0000 7f22305ff700 1 -- 172.21.15.17:0/2368580544 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22281a5650 con 0x7f222806d3a0 2023-07-14T13:33:10.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.815+0000 7f22305ff700 1 -- 172.21.15.17:0/2368580544 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222810ee20 con 0x7f222806d3a0 2023-07-14T13:33:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.822+0000 7f2243edeb80 1 Processor -- start 2023-07-14T13:33:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.823+0000 7f2243edeb80 1 -- start start 2023-07-14T13:33:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.823+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 0x558e73b11d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.823+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e73b122d0 0x558e73b0c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.823+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b0c580 0x558e73b0c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.823+0000 7f2243edeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e73a11c50 con 0x558e73b0c580 2023-07-14T13:33:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.823+0000 7f2243edeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e73a649e0 con 0x558e739686b0 2023-07-14T13:33:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.823+0000 7f2243edeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e73a5de70 con 0x558e73b122d0 2023-07-14T13:33:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.824+0000 7f222eb9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 0x558e73b11d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.824+0000 7f222eb9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 0x558e73b11d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40596/0 (socket says 172.21.15.17:40596) 2023-07-14T13:33:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.824+0000 7f222eb9c700 1 -- 172.21.15.17:0/626167730 learned_addr learned my addr 172.21.15.17:0/626167730 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.824+0000 7f222eb9c700 1 -- 172.21.15.17:0/626167730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e73b122d0 msgr2=0x558e73b0c040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:33:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.824+0000 7f222eb9c700 1 --2- 172.21.15.17:0/626167730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e73b122d0 0x558e73b0c040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.824+0000 7f222eb9c700 1 -- 172.21.15.17:0/626167730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b0c580 msgr2=0x558e73b0c9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T13:33:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.824+0000 7f222eb9c700 1 --2- 172.21.15.17:0/626167730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b0c580 0x558e73b0c9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.824+0000 7f222eb9c700 1 -- 172.21.15.17:0/626167730 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e7388bd80 con 0x558e739686b0 2023-07-14T13:33:10.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.825+0000 7f222eb9c700 1 --2- 172.21.15.17:0/626167730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 0x558e73b11d90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f222400bc20 tx=0x7f222400bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f980c73d8531e257 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:10.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.826+0000 7f221f7fe700 1 -- 172.21.15.17:0/2368580544 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2220014440 con 0x7f222806d3a0 2023-07-14T13:33:10.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.827+0000 7f221cbfe700 1 -- 172.21.15.17:0/626167730 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222400fbc0 con 0x558e739686b0 2023-07-14T13:33:10.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.827+0000 7f221cbfe700 1 -- 172.21.15.17:0/626167730 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f222400fd20 con 0x558e739686b0 2023-07-14T13:33:10.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.827+0000 7f221cbfe700 1 -- 172.21.15.17:0/626167730 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224005680 con 0x558e739686b0 2023-07-14T13:33:10.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.828+0000 7f2243edeb80 1 -- 172.21.15.17:0/626167730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 msgr2=0x558e73b11d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:10.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.828+0000 7f2243edeb80 1 --2- 172.21.15.17:0/626167730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 0x558e73b11d90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f222400bc20 tx=0x7f222400bf30 comp rx=0 tx=0).stop 2023-07-14T13:33:10.825 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.828+0000 7f221f7fe700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22140a14d0 0x7f22140a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.828+0000 7f221f7fe700 1 -- 172.21.15.17:0/2368580544 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f22200cc540 con 0x7f222806d3a0 2023-07-14T13:33:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.829+0000 7f2243edeb80 1 -- 172.21.15.17:0/626167730 shutdown_connections 2023-07-14T13:33:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.829+0000 7f2243edeb80 1 --2- 172.21.15.17:0/626167730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b0c580 0x558e73b0c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.829+0000 7f2243edeb80 1 --2- 172.21.15.17:0/626167730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 0x558e73b11d90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.829+0000 7f2243edeb80 1 --2- 172.21.15.17:0/626167730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e73b122d0 0x558e73b0c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.826 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.829+0000 7f2243edeb80 1 -- 172.21.15.17:0/626167730 >> 172.21.15.17:0/626167730 conn(0x558e73b01be0 msgr2=0x558e73b06f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:10.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.829+0000 7f222eb9c700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22140a14d0 0x7f22140a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.835+0000 7f2243edeb80 1 -- 172.21.15.17:0/626167730 shutdown_connections 2023-07-14T13:33:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.835+0000 7f222eb9c700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22140a14d0 0x7f22140a3980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2224005200 tx=0x7f2224000bc0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:10.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.835+0000 7f2243edeb80 1 -- 172.21.15.17:0/626167730 wait complete. 2023-07-14T13:33:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.836+0000 7f2243edeb80 1 -- start start 2023-07-14T13:33:10.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.836+0000 7f2243edeb80 1 Processor -- start 2023-07-14T13:33:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.838+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 0x558e73b159a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.838+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b0c580 0x558e73b15ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.838+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e73b122d0 0x558e73b16420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.838+0000 7f2243edeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e739fda60 con 0x558e73b0c580 2023-07-14T13:33:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.838+0000 7f2243edeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e739fd760 con 0x558e739686b0 2023-07-14T13:33:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.838+0000 7f2243edeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e738e18c0 con 0x558e73b122d0 2023-07-14T13:33:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.838+0000 7f2243edeb80 10 client.0 _ll_register_callbacks cb 0x558e739fb700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:33:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.839+0000 7f222eb9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e73b122d0 0x558e73b16420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.839+0000 7f222e39b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 0x558e73b159a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.839+0000 7f222eb9c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e73b122d0 0x558e73b16420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:41012/0 (socket says 172.21.15.17:41012) 2023-07-14T13:33:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.839+0000 7f222eb9c700 1 -- 172.21.15.17:0/292018783 learned_addr learned my addr 172.21.15.17:0/292018783 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.840+0000 7f222db9a700 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b0c580 0x558e73b15ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.841+0000 7f222eb9c700 1 -- 172.21.15.17:0/292018783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 msgr2=0x558e73b159a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.841+0000 7f222eb9c700 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 0x558e73b159a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.841+0000 7f222eb9c700 1 -- 172.21.15.17:0/292018783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b0c580 msgr2=0x558e73b15ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.841+0000 7f222eb9c700 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b0c580 0x558e73b15ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.841+0000 7f222eb9c700 1 -- 172.21.15.17:0/292018783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222400b850 con 0x558e73b122d0 2023-07-14T13:33:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.841+0000 7f222eb9c700 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e73b122d0 0x558e73b16420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f22240056d0 tx=0x7f2224005300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fa69ca4a85381f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.842+0000 7f2211ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:33:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.842+0000 7f2211ffb700 1 -- 172.21.15.17:0/292018783 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224021070 con 0x558e73b122d0 2023-07-14T13:33:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.842+0000 7f2211ffb700 1 -- 172.21.15.17:0/292018783 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f2224005420 con 0x558e73b122d0 2023-07-14T13:33:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.842+0000 7f2243edeb80 1 -- 172.21.15.17:0/292018783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e739b7490 con 0x558e73b122d0 2023-07-14T13:33:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.842+0000 7f2211ffb700 1 -- 172.21.15.17:0/292018783 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f222400fe90 con 0x558e73b122d0 2023-07-14T13:33:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.842+0000 7f2243edeb80 10 client.29593 fetch_fsmap learned FSMap version 68 2023-07-14T13:33:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.842+0000 7f2243edeb80 1 -- 172.21.15.17:0/292018783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x558e73874c00 con 0x558e73b122d0 2023-07-14T13:33:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.843+0000 7f2211ffb700 1 -- 172.21.15.17:0/292018783 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558e739b7490 con 0x558e73b122d0 2023-07-14T13:33:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.843+0000 7f2211ffb700 1 -- 172.21.15.17:0/292018783 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f222403d610 con 0x558e73b122d0 2023-07-14T13:33:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.843+0000 7f2243edeb80 10 client.29593 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:33:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.843+0000 7f2243edeb80 10 client.29593 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:33:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.843+0000 7f2243edeb80 20 client.29593 populate_metadata read hostname 'smithi017' 2023-07-14T13:33:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.843+0000 7f2243edeb80 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558e73b25cb0 0x558e73b280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.843+0000 7f2243edeb80 4 client.29593 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:33:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.843+0000 7f2243edeb80 1 -- 172.21.15.17:0/292018783 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e73a56e50 con 0x558e73b25cb0 2023-07-14T13:33:10.845 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.844+0000 7f222e39b700 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558e73b25cb0 0x558e73b280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.851+0000 7f222e39b700 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558e73b25cb0 0x558e73b280c0 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=800cdbd51837d976 server_cookie=e2fa7296c50bddf6 in_seq=0 out_seq=0 2023-07-14T13:33:10.848 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.851+0000 7f2211ffb700 10 client.29593 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:10.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.854+0000 7f2211ffb700 1 -- 172.21.15.17:0/292018783 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558e73a56e50 con 0x558e73b25cb0 2023-07-14T13:33:10.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.854+0000 7f2211ffb700 10 client.29593 handle_command_reply: tid=0 2023-07-14T13:33:10.857 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.861+0000 7f2243edeb80 1 client.29593 shutdown 2023-07-14T13:33:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.862+0000 7f2243edeb80 1 -- 172.21.15.17:0/292018783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e73b122d0 msgr2=0x558e73b16420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:10.858 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.862+0000 7f2243edeb80 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e73b122d0 0x558e73b16420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f22240056d0 tx=0x7f2224005300 comp rx=0 tx=0).stop 2023-07-14T13:33:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.862+0000 7f2243edeb80 1 -- 172.21.15.17:0/292018783 shutdown_connections 2023-07-14T13:33:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.862+0000 7f2243edeb80 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558e73b25cb0 0x558e73b280c0 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.862+0000 7f2243edeb80 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e73b122d0 0x558e73b16420 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.862+0000 7f2243edeb80 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e739686b0 0x558e73b159a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.859 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.862+0000 7f2243edeb80 1 --2- 172.21.15.17:0/292018783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b0c580 0x558e73b15ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.862+0000 7f2243edeb80 1 -- 172.21.15.17:0/292018783 >> 172.21.15.17:0/292018783 conn(0x558e73b01be0 msgr2=0x558e73b064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:10.860 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.863+0000 7f2211ffb700 0 client.29593 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:10.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.870+0000 7f2243edeb80 1 -- 172.21.15.17:0/292018783 shutdown_connections 2023-07-14T13:33:10.867 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.871+0000 7f2243edeb80 1 -- 172.21.15.17:0/292018783 wait complete. 2023-07-14T13:33:10.868 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.871+0000 7f2243edeb80 20 client.29593 trim_cache size 0 max 16384 2023-07-14T13:33:10.908 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.911+0000 7f2243edeb80 1 Processor -- start 2023-07-14T13:33:10.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.912+0000 7f2243edeb80 1 -- start start 2023-07-14T13:33:10.909 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.912+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e739686b0 0x558e73b0c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.912+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 0x558e73b1cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.912+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b122d0 0x558e73b06c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.912+0000 7f2243edeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e73b226d0 con 0x558e73b122d0 2023-07-14T13:33:10.910 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.912+0000 7f2243edeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e73b23370 con 0x558e73b0c580 2023-07-14T13:33:10.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.912+0000 7f2243edeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e73afebe0 con 0x558e739686b0 2023-07-14T13:33:10.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.913+0000 7f222db9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 0x558e73b1cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.911 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.913+0000 7f222db9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 0x558e73b1cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:40620/0 (socket says 172.21.15.17:40620) 2023-07-14T13:33:10.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.913+0000 7f222db9a700 1 -- 172.21.15.17:0/2275609551 learned_addr learned my addr 172.21.15.17:0/2275609551 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:10.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.914+0000 7f222db9a700 1 -- 172.21.15.17:0/2275609551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e739686b0 msgr2=0x558e73b0c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:10.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.914+0000 7f222db9a700 1 --2- 172.21.15.17:0/2275609551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e739686b0 0x558e73b0c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.914+0000 7f222db9a700 1 -- 172.21.15.17:0/2275609551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b122d0 msgr2=0x558e73b06c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:10.912 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.914+0000 7f222db9a700 1 --2- 172.21.15.17:0/2275609551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b122d0 0x558e73b06c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.914+0000 7f222db9a700 1 -- 172.21.15.17:0/2275609551 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e738b21f0 con 0x558e73b0c580 2023-07-14T13:33:10.913 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.916+0000 7f222db9a700 1 --2- 172.21.15.17:0/2275609551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 0x558e73b1cc60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2220099640 tx=0x7f22200b9040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f898d69e1227d6b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:10.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.919+0000 7f221d3ff700 1 -- 172.21.15.17:0/2275609551 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222009d6e0 con 0x558e73b0c580 2023-07-14T13:33:10.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.919+0000 7f221d3ff700 1 -- 172.21.15.17:0/2275609551 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22200a1b00 con 0x558e73b0c580 2023-07-14T13:33:10.915 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.919+0000 7f221d3ff700 1 -- 172.21.15.17:0/2275609551 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220014950 con 0x558e73b0c580 2023-07-14T13:33:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.920+0000 7f2243edeb80 1 -- 172.21.15.17:0/2275609551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 msgr2=0x558e73b1cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:10.916 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.920+0000 7f2243edeb80 1 --2- 172.21.15.17:0/2275609551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 0x558e73b1cc60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2220099640 tx=0x7f22200b9040 comp rx=0 tx=0).stop 2023-07-14T13:33:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.921+0000 7f2243edeb80 1 -- 172.21.15.17:0/2275609551 shutdown_connections 2023-07-14T13:33:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.921+0000 7f2243edeb80 1 --2- 172.21.15.17:0/2275609551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b122d0 0x558e73b06c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.917 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.921+0000 7f2243edeb80 1 --2- 172.21.15.17:0/2275609551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e739686b0 0x558e73b0c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.921+0000 7f2243edeb80 1 --2- 172.21.15.17:0/2275609551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 0x558e73b1cc60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.921+0000 7f2243edeb80 1 -- 172.21.15.17:0/2275609551 >> 172.21.15.17:0/2275609551 conn(0x558e73b01be0 msgr2=0x558e73b0fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:10.918 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.922+0000 7f2243edeb80 1 -- 172.21.15.17:0/2275609551 shutdown_connections 2023-07-14T13:33:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.926+0000 7f2243edeb80 1 -- 172.21.15.17:0/2275609551 wait complete. 2023-07-14T13:33:10.923 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.927+0000 7f2243edeb80 1 -- start start 2023-07-14T13:33:10.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.927+0000 7f2243edeb80 1 Processor -- start 2023-07-14T13:33:10.924 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.928+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e739686b0 0x558e73b1ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.928+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 0x558e73b1b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.928+0000 7f2243edeb80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b122d0 0x558e73b1b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.928+0000 7f2243edeb80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e73b78c50 con 0x558e73b122d0 2023-07-14T13:33:10.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.928+0000 7f2243edeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e73b78dc0 con 0x558e73b0c580 2023-07-14T13:33:10.925 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.928+0000 7f2243edeb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e73b78f80 con 0x558e739686b0 2023-07-14T13:33:10.926 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.928+0000 7f2243edeb80 10 client.0 _ll_register_callbacks cb 0x558e739fb700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:33:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.930+0000 7f222db9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 0x558e73b1b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.931+0000 7f222eb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b122d0 0x558e73b1b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.931+0000 7f222eb9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b122d0 0x558e73b1b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52636/0 (socket says 172.21.15.17:52636) 2023-07-14T13:33:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.931+0000 7f222eb9c700 1 -- 172.21.15.17:0/1994169046 learned_addr learned my addr 172.21.15.17:0/1994169046 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.932+0000 7f222eb9c700 1 -- 172.21.15.17:0/1994169046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e739686b0 msgr2=0x558e73b1ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.932+0000 7f222eb9c700 1 --2- 172.21.15.17:0/1994169046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e739686b0 0x558e73b1ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.932+0000 7f222eb9c700 1 -- 172.21.15.17:0/1994169046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 msgr2=0x558e73b1b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.932+0000 7f222eb9c700 1 --2- 172.21.15.17:0/1994169046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 0x558e73b1b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.932+0000 7f222eb9c700 1 -- 172.21.15.17:0/1994169046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222810ee20 con 0x558e73b122d0 2023-07-14T13:33:10.931 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.933+0000 7f222eb9c700 1 --2- 172.21.15.17:0/1994169046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b122d0 0x558e73b1b6d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2224004f60 tx=0x7f2224004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5714de36dbaa94 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.934+0000 7f2211ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:33:10.932 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.936+0000 7f2211ffb700 1 -- 172.21.15.17:0/1994169046 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224021040 con 0x558e73b122d0 2023-07-14T13:33:10.933 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.936+0000 7f2211ffb700 1 -- 172.21.15.17:0/1994169046 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f22240058e0 con 0x558e73b122d0 2023-07-14T13:33:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.944+0000 7f2243edeb80 1 -- 172.21.15.17:0/1994169046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f222400fd20 con 0x558e73b122d0 2023-07-14T13:33:10.947 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.951+0000 7f2211ffb700 1 -- 172.21.15.17:0/1994169046 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f222403dc40 con 0x558e73b122d0 2023-07-14T13:33:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.962+0000 7f2243edeb80 10 client.19857 fetch_fsmap learned FSMap version 68 2023-07-14T13:33:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.963+0000 7f2243edeb80 1 -- 172.21.15.17:0/1994169046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x558e7388a250 con 0x558e73b122d0 2023-07-14T13:33:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.974+0000 7f2211ffb700 1 -- 172.21.15.17:0/1994169046 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f222400fd20 con 0x558e73b122d0 2023-07-14T13:33:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.974+0000 7f2211ffb700 1 -- 172.21.15.17:0/1994169046 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2224045020 con 0x558e73b122d0 2023-07-14T13:33:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.975+0000 7f2243edeb80 10 client.19857 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:33:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.975+0000 7f2243edeb80 10 client.19857 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:33:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.975+0000 7f2243edeb80 20 client.19857 populate_metadata read hostname 'smithi017' 2023-07-14T13:33:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.975+0000 7f2243edeb80 1 --2- 172.21.15.17:0/1994169046 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558e73b7a3b0 0x558e73b7c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.975+0000 7f2243edeb80 4 client.19857 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:33:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.975+0000 7f2243edeb80 1 -- 172.21.15.17:0/1994169046 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558e73a18ff0 con 0x558e73b7a3b0 2023-07-14T13:33:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.976+0000 7f222e39b700 1 --2- 172.21.15.17:0/1994169046 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558e73b7a3b0 0x558e73b7c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.978+0000 7f222e39b700 1 --2- 172.21.15.17:0/1994169046 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558e73b7a3b0 0x558e73b7c7c0 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6720b4b10bec8031 server_cookie=445180c0f4734777 in_seq=0 out_seq=0 2023-07-14T13:33:10.981 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:10.985+0000 7f2211ffb700 10 client.19857 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:11.324 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:11 smithi017 ceph-mon[95536]: pgmap v1061: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.0 MiB/s wr, 742 op/s 2023-07-14T13:33:11.415 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:11 smithi135 ceph-mon[97338]: pgmap v1061: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.0 MiB/s wr, 742 op/s 2023-07-14T13:33:11.468 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:11 smithi131 ceph-mon[96953]: pgmap v1061: 97 pgs: 10 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 65 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.0 MiB/s wr, 742 op/s 2023-07-14T13:33:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:progress: 900.0 s, 135.9 tps, lat 730.379 ms stddev 428.690 2023-07-14T13:33:12.940 INFO:teuthology.orchestra.run.smithi017.stdout:transaction type: 2023-07-14T13:33:12.940 INFO:teuthology.orchestra.run.smithi017.stdout:scaling factor: 500 2023-07-14T13:33:12.940 INFO:teuthology.orchestra.run.smithi017.stdout:query mode: simple 2023-07-14T13:33:12.940 INFO:teuthology.orchestra.run.smithi017.stdout:number of clients: 100 2023-07-14T13:33:12.941 INFO:teuthology.orchestra.run.smithi017.stdout:number of threads: 4 2023-07-14T13:33:12.941 INFO:teuthology.orchestra.run.smithi017.stdout:duration: 900 s 2023-07-14T13:33:12.941 INFO:teuthology.orchestra.run.smithi017.stdout:number of transactions actually processed: 408522 2023-07-14T13:33:12.941 INFO:teuthology.orchestra.run.smithi017.stdout:latency average = 220.274 ms 2023-07-14T13:33:12.941 INFO:teuthology.orchestra.run.smithi017.stdout:latency stddev = 359.977 ms 2023-07-14T13:33:12.941 INFO:teuthology.orchestra.run.smithi017.stdout:tps = 453.650336 (including connections establishing) 2023-07-14T13:33:12.941 INFO:teuthology.orchestra.run.smithi017.stdout:tps = 453.660279 (excluding connections establishing) 2023-07-14T13:33:12.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2023-07-14T13:33:14.072 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:13 smithi017 ceph-mon[95536]: pgmap v1062: 97 pgs: 8 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 74 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 626 op/s 2023-07-14T13:33:14.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:13 smithi135 ceph-mon[97338]: pgmap v1062: 97 pgs: 8 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 74 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 626 op/s 2023-07-14T13:33:14.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:13 smithi131 ceph-mon[96953]: pgmap v1062: 97 pgs: 8 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 74 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 626 op/s 2023-07-14T13:33:16.072 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:15 smithi017 ceph-mon[95536]: pgmap v1063: 97 pgs: 8 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 74 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 626 op/s 2023-07-14T13:33:16.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:15 smithi135 ceph-mon[97338]: pgmap v1063: 97 pgs: 8 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 74 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 626 op/s 2023-07-14T13:33:16.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:15 smithi131 ceph-mon[96953]: pgmap v1063: 97 pgs: 8 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 74 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.0 MiB/s wr, 626 op/s 2023-07-14T13:33:18.072 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:17 smithi017 ceph-mon[95536]: pgmap v1064: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.9 MiB/s wr, 731 op/s 2023-07-14T13:33:18.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:17 smithi135 ceph-mon[97338]: pgmap v1064: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.9 MiB/s wr, 731 op/s 2023-07-14T13:33:18.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:17 smithi131 ceph-mon[96953]: pgmap v1064: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.9 MiB/s wr, 731 op/s 2023-07-14T13:33:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.387+0000 7f2211ffb700 1 -- 172.21.15.17:0/1994169046 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558e73a18ff0 con 0x558e73b7a3b0 2023-07-14T13:33:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.387+0000 7f2211ffb700 10 client.19857 handle_command_reply: tid=0 2023-07-14T13:33:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.387+0000 7f2243edeb80 1 client.19857 shutdown 2023-07-14T13:33:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.387+0000 7f2243edeb80 1 -- 172.21.15.17:0/1994169046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b122d0 msgr2=0x558e73b1b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.387+0000 7f2243edeb80 1 --2- 172.21.15.17:0/1994169046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b122d0 0x558e73b1b6d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2224004f60 tx=0x7f2224004cc0 comp rx=0 tx=0).stop 2023-07-14T13:33:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.388+0000 7f2243edeb80 1 -- 172.21.15.17:0/1994169046 shutdown_connections 2023-07-14T13:33:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.388+0000 7f2243edeb80 1 --2- 172.21.15.17:0/1994169046 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x558e73b7a3b0 0x558e73b7c7c0 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.388+0000 7f2243edeb80 1 --2- 172.21.15.17:0/1994169046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x558e73b122d0 0x558e73b1b6d0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.388+0000 7f2243edeb80 1 --2- 172.21.15.17:0/1994169046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e739686b0 0x558e73b1ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.388+0000 7f2243edeb80 1 --2- 172.21.15.17:0/1994169046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558e73b0c580 0x558e73b1b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.388+0000 7f2211ffb700 0 client.19857 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.388+0000 7f2243edeb80 1 -- 172.21.15.17:0/1994169046 >> 172.21.15.17:0/1994169046 conn(0x558e73b01be0 msgr2=0x558e73b10af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.388+0000 7f2243edeb80 1 -- 172.21.15.17:0/1994169046 shutdown_connections 2023-07-14T13:33:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.388+0000 7f2243edeb80 1 -- 172.21.15.17:0/1994169046 wait complete. 2023-07-14T13:33:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.388+0000 7f2243edeb80 20 client.19857 trim_cache size 0 max 16384 2023-07-14T13:33:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:33:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:33:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:33:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:33:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.389+0000 7f22305ff700 1 -- 172.21.15.17:0/2368580544 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22140a14d0 msgr2=0x7f22140a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.389+0000 7f22305ff700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22140a14d0 0x7f22140a3980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2224005200 tx=0x7f2224000bc0 comp rx=0 tx=0).stop 2023-07-14T13:33:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.389+0000 7f22305ff700 1 -- 172.21.15.17:0/2368580544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f222806d3a0 msgr2=0x7f22281ab010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.389+0000 7f22305ff700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f222806d3a0 0x7f22281ab010 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f222000ba50 tx=0x7f222000be10 comp rx=0 tx=0).stop 2023-07-14T13:33:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.389+0000 7f22305ff700 1 -- 172.21.15.17:0/2368580544 shutdown_connections 2023-07-14T13:33:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.389+0000 7f22305ff700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f22140a14d0 0x7f22140a3980 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.389+0000 7f22305ff700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222810e2a0 0x7f22281a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.389+0000 7f22305ff700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f222806c910 0x7f22281aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.389+0000 7f22305ff700 1 --2- 172.21.15.17:0/2368580544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f222806d3a0 0x7f22281ab010 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.389+0000 7f22305ff700 1 -- 172.21.15.17:0/2368580544 >> 172.21.15.17:0/2368580544 conn(0x7f222806bd70 msgr2=0x7f2228070800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.390+0000 7f22305ff700 1 -- 172.21.15.17:0/2368580544 shutdown_connections 2023-07-14T13:33:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:19.390+0000 7f22305ff700 1 -- 172.21.15.17:0/2368580544 wait complete. 2023-07-14T13:33:20.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:19 smithi135 ceph-mon[97338]: pgmap v1065: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 382 op/s 2023-07-14T13:33:20.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:19 smithi131 ceph-mon[96953]: pgmap v1065: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 382 op/s 2023-07-14T13:33:20.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:19 smithi017 ceph-mon[95536]: pgmap v1065: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.3 MiB/s wr, 382 op/s 2023-07-14T13:33:22.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:21 smithi135 ceph-mon[97338]: pgmap v1066: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 3.7 MiB/s wr, 422 op/s 2023-07-14T13:33:22.166 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:21 smithi135 ceph-mon[97338]: osdmap e145: 12 total, 12 up, 12 in 2023-07-14T13:33:22.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:21 smithi131 ceph-mon[96953]: pgmap v1066: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 3.7 MiB/s wr, 422 op/s 2023-07-14T13:33:22.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:21 smithi131 ceph-mon[96953]: osdmap e145: 12 total, 12 up, 12 in 2023-07-14T13:33:22.327 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:21 smithi017 ceph-mon[95536]: pgmap v1066: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 3.7 MiB/s wr, 422 op/s 2023-07-14T13:33:22.327 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:21 smithi017 ceph-mon[95536]: osdmap e145: 12 total, 12 up, 12 in 2023-07-14T13:33:24.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:23 smithi135 ceph-mon[97338]: pgmap v1068: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 3.6 MiB/s wr, 438 op/s 2023-07-14T13:33:24.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:23 smithi131 ceph-mon[96953]: pgmap v1068: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 3.6 MiB/s wr, 438 op/s 2023-07-14T13:33:24.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:23 smithi017 ceph-mon[95536]: pgmap v1068: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 3.6 MiB/s wr, 438 op/s 2023-07-14T13:33:26.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:25 smithi135 ceph-mon[97338]: pgmap v1069: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 3.6 MiB/s wr, 438 op/s 2023-07-14T13:33:26.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:25 smithi131 ceph-mon[96953]: pgmap v1069: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 3.6 MiB/s wr, 438 op/s 2023-07-14T13:33:26.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:25 smithi017 ceph-mon[95536]: pgmap v1069: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 3.6 MiB/s wr, 438 op/s 2023-07-14T13:33:28.165 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:27 smithi135 ceph-mon[97338]: pgmap v1070: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 6.3 MiB/s wr, 775 op/s 2023-07-14T13:33:28.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:27 smithi131 ceph-mon[96953]: pgmap v1070: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 6.3 MiB/s wr, 775 op/s 2023-07-14T13:33:28.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:27 smithi017 ceph-mon[95536]: pgmap v1070: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 6.3 MiB/s wr, 775 op/s 2023-07-14T13:33:30.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:29 smithi135 ceph-mon[97338]: pgmap v1071: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 6.7 MiB/s wr, 809 op/s 2023-07-14T13:33:30.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:29 smithi131 ceph-mon[96953]: pgmap v1071: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 6.7 MiB/s wr, 809 op/s 2023-07-14T13:33:30.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:29 smithi017 ceph-mon[95536]: pgmap v1071: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 6.7 MiB/s wr, 809 op/s 2023-07-14T13:33:32.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:31 smithi135 ceph-mon[97338]: pgmap v1072: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.1 MiB/s wr, 737 op/s 2023-07-14T13:33:32.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:31 smithi131 ceph-mon[96953]: pgmap v1072: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.1 MiB/s wr, 737 op/s 2023-07-14T13:33:32.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:31 smithi017 ceph-mon[95536]: pgmap v1072: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 6.1 MiB/s wr, 737 op/s 2023-07-14T13:33:32.556 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.560+0000 7f07469ff700 1 -- 172.21.15.17:0/1184790406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07400ffdc0 msgr2=0x7f0740100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.560+0000 7f07469ff700 1 --2- 172.21.15.17:0/1184790406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07400ffdc0 0x7f0740100190 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f07300099c0 tx=0x7f0730009cd0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.560+0000 7f07469ff700 1 -- 172.21.15.17:0/1184790406 shutdown_connections 2023-07-14T13:33:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.560+0000 7f07469ff700 1 --2- 172.21.15.17:0/1184790406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0740104e00 0x7f074010c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.560+0000 7f07469ff700 1 --2- 172.21.15.17:0/1184790406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07400ffdc0 0x7f0740100190 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.560+0000 7f07469ff700 1 --2- 172.21.15.17:0/1184790406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0740100760 0x7f0740104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.560+0000 7f07469ff700 1 -- 172.21.15.17:0/1184790406 >> 172.21.15.17:0/1184790406 conn(0x7f07400fb650 msgr2=0x7f07400fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.560+0000 7f07469ff700 1 -- 172.21.15.17:0/1184790406 shutdown_connections 2023-07-14T13:33:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.560+0000 7f07469ff700 1 -- 172.21.15.17:0/1184790406 wait complete. 2023-07-14T13:33:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.561+0000 7f07469ff700 1 Processor -- start 2023-07-14T13:33:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.561+0000 7f07469ff700 1 -- start start 2023-07-14T13:33:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.562+0000 7f07469ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07400ffdc0 0x7f07400729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.562+0000 7f07469ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0740100760 0x7f0740072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.562+0000 7f07469ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0740104e00 0x7f07401a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.562+0000 7f07469ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07401a4370 con 0x7f0740100760 2023-07-14T13:33:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.562+0000 7f07469ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07401a44b0 con 0x7f07400ffdc0 2023-07-14T13:33:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.562+0000 7f07469ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07401a4620 con 0x7f0740104e00 2023-07-14T13:33:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.562+0000 7f073f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0740100760 0x7f0740072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.562+0000 7f073f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0740100760 0x7f0740072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53522/0 (socket says 172.21.15.17:53522) 2023-07-14T13:33:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.562+0000 7f073f7fe700 1 -- 172.21.15.17:0/406711912 learned_addr learned my addr 172.21.15.17:0/406711912 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.562+0000 7f0744f9c700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0740104e00 0x7f07401a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.562+0000 7f073ffff700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07400ffdc0 0x7f07400729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f073f7fe700 1 -- 172.21.15.17:0/406711912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0740104e00 msgr2=0x7f07401a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f073f7fe700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0740104e00 0x7f07401a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f073f7fe700 1 -- 172.21.15.17:0/406711912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07400ffdc0 msgr2=0x7f07400729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f073f7fe700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07400ffdc0 0x7f07400729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f073f7fe700 1 -- 172.21.15.17:0/406711912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07300095f0 con 0x7f0740100760 2023-07-14T13:33:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f073ffff700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07400ffdc0 0x7f07400729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:33:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f073f7fe700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0740100760 0x7f0740072f30 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f073400d950 tx=0x7f073400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f073d7fa700 1 -- 172.21.15.17:0/406711912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734004220 con 0x7f0740100760 2023-07-14T13:33:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f07469ff700 1 -- 172.21.15.17:0/406711912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07401a4900 con 0x7f0740100760 2023-07-14T13:33:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f073d7fa700 1 -- 172.21.15.17:0/406711912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0734004cc0 con 0x7f0740100760 2023-07-14T13:33:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f073d7fa700 1 -- 172.21.15.17:0/406711912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07340055b0 con 0x7f0740100760 2023-07-14T13:33:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.563+0000 7f07469ff700 1 -- 172.21.15.17:0/406711912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07401a4e10 con 0x7f0740100760 2023-07-14T13:33:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.566+0000 7f073d7fa700 1 -- 172.21.15.17:0/406711912 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0734004750 con 0x7f0740100760 2023-07-14T13:33:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.568+0000 7f075a238b80 1 Processor -- start 2023-07-14T13:33:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.568+0000 7f073d7fa700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f07280a12c0 0x7f07280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.568+0000 7f075a238b80 1 -- start start 2023-07-14T13:33:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.568+0000 7f073d7fa700 1 -- 172.21.15.17:0/406711912 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f07340ccb70 con 0x7f0740100760 2023-07-14T13:33:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.568+0000 7f0744f9c700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f07280a12c0 0x7f07280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f075a238b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5bd9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f075a238b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bda2d0 0x55f4f5bd4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f075a238b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5bd49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f075a238b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5ad9c50 con 0x55f4f5bd4580 2023-07-14T13:33:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f075a238b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5b2c9e0 con 0x55f4f5bda2d0 2023-07-14T13:33:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f075a238b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5b25e70 con 0x55f4f5a306b0 2023-07-14T13:33:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f0744f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5bd49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f0744f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5bd49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53536/0 (socket says 172.21.15.17:53536) 2023-07-14T13:33:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f073f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bda2d0 0x55f4f5bd4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f073ffff700 1 --2- 172.21.15.17:0/3999977283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5bd9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f0744f9c700 1 -- 172.21.15.17:0/3999977283 learned_addr learned my addr 172.21.15.17:0/3999977283 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.569+0000 7f0744f9c700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f07280a12c0 0x7f07280a3770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f073800f540 tx=0x7f073800b040 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.570+0000 7f0744f9c700 1 -- 172.21.15.17:0/3999977283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 msgr2=0x55f4f5bd9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.570+0000 7f0744f9c700 1 --2- 172.21.15.17:0/3999977283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5bd9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.570+0000 7f0744f9c700 1 -- 172.21.15.17:0/3999977283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bda2d0 msgr2=0x55f4f5bd4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.570+0000 7f0744f9c700 1 --2- 172.21.15.17:0/3999977283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bda2d0 0x55f4f5bd4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.570+0000 7f0744f9c700 1 -- 172.21.15.17:0/3999977283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f5953d80 con 0x55f4f5bd4580 2023-07-14T13:33:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.570+0000 7f0744f9c700 1 --2- 172.21.15.17:0/3999977283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5bd49d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f0738017790 tx=0x7f0738014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e670f1a86879cd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.570+0000 7f07267fc700 1 -- 172.21.15.17:0/3999977283 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073800e040 con 0x55f4f5bd4580 2023-07-14T13:33:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.570+0000 7f07267fc700 1 -- 172.21.15.17:0/3999977283 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f073800f040 con 0x55f4f5bd4580 2023-07-14T13:33:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.570+0000 7f07267fc700 1 -- 172.21.15.17:0/3999977283 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738008d00 con 0x55f4f5bd4580 2023-07-14T13:33:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.571+0000 7f075a238b80 1 -- 172.21.15.17:0/3999977283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 msgr2=0x55f4f5bd49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.571+0000 7f075a238b80 1 --2- 172.21.15.17:0/3999977283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5bd49d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f0738017790 tx=0x7f0738014000 comp rx=0 tx=0).stop 2023-07-14T13:33:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.571+0000 7f075a238b80 1 -- 172.21.15.17:0/3999977283 shutdown_connections 2023-07-14T13:33:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.571+0000 7f075a238b80 1 --2- 172.21.15.17:0/3999977283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5bd49d0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.571+0000 7f075a238b80 1 --2- 172.21.15.17:0/3999977283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5bd9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.571+0000 7f075a238b80 1 --2- 172.21.15.17:0/3999977283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bda2d0 0x55f4f5bd4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.571+0000 7f075a238b80 1 -- 172.21.15.17:0/3999977283 >> 172.21.15.17:0/3999977283 conn(0x55f4f5bc9be0 msgr2=0x55f4f5bcef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.571+0000 7f075a238b80 1 -- 172.21.15.17:0/3999977283 shutdown_connections 2023-07-14T13:33:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.571+0000 7f075a238b80 1 -- 172.21.15.17:0/3999977283 wait complete. 2023-07-14T13:33:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.572+0000 7f075a238b80 1 -- start start 2023-07-14T13:33:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.572+0000 7f075a238b80 1 Processor -- start 2023-07-14T13:33:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.572+0000 7f075a238b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5be0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.572+0000 7f075a238b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bd4580 0x55f4f5bdd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.572+0000 7f075a238b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bda2d0 0x55f4f5bddee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.572+0000 7f075a238b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5ac5a60 con 0x55f4f5bda2d0 2023-07-14T13:33:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.572+0000 7f075a238b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5ac5760 con 0x55f4f5bd4580 2023-07-14T13:33:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.572+0000 7f075a238b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f59a98c0 con 0x55f4f5a306b0 2023-07-14T13:33:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.572+0000 7f075a238b80 10 client.0 _ll_register_callbacks cb 0x55f4f5ac3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:33:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.573+0000 7f073ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5be0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.573+0000 7f073f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bd4580 0x55f4f5bdd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.573+0000 7f073ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5be0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:53542/0 (socket says 172.21.15.17:53542) 2023-07-14T13:33:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.573+0000 7f073ffff700 1 -- 172.21.15.17:0/2920467762 learned_addr learned my addr 172.21.15.17:0/2920467762 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.573+0000 7f0744f9c700 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bda2d0 0x55f4f5bddee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.573+0000 7f073ffff700 1 -- 172.21.15.17:0/2920467762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bd4580 msgr2=0x55f4f5bdd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.573+0000 7f073ffff700 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bd4580 0x55f4f5bdd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.573+0000 7f073ffff700 1 -- 172.21.15.17:0/2920467762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bda2d0 msgr2=0x55f4f5bddee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.573+0000 7f073ffff700 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bda2d0 0x55f4f5bddee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.573+0000 7f073ffff700 1 -- 172.21.15.17:0/2920467762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0738017440 con 0x55f4f5a306b0 2023-07-14T13:33:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.574+0000 7f073ffff700 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5be0590 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f07300099c0 tx=0x7f0730005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1b26cf4ab58663b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.574+0000 7f071f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2023-07-14T13:33:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.574+0000 7f071f7fe700 1 -- 172.21.15.17:0/2920467762 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073001d040 con 0x55f4f5a306b0 2023-07-14T13:33:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.574+0000 7f075a238b80 1 -- 172.21.15.17:0/2920467762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4f5a7f490 con 0x55f4f5a306b0 2023-07-14T13:33:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.574+0000 7f071f7fe700 1 -- 172.21.15.17:0/2920467762 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f073000bca0 con 0x55f4f5a306b0 2023-07-14T13:33:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.574+0000 7f071f7fe700 1 -- 172.21.15.17:0/2920467762 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0730003760 con 0x55f4f5a306b0 2023-07-14T13:33:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.574+0000 7f075a238b80 10 client.29605 fetch_fsmap learned FSMap version 68 2023-07-14T13:33:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.574+0000 7f075a238b80 1 -- 172.21.15.17:0/2920467762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55f4f593cc00 con 0x55f4f5a306b0 2023-07-14T13:33:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.575+0000 7f071f7fe700 1 -- 172.21.15.17:0/2920467762 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f4f5a7f490 con 0x55f4f5a306b0 2023-07-14T13:33:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.575+0000 7f071f7fe700 1 -- 172.21.15.17:0/2920467762 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0730023760 con 0x55f4f5a306b0 2023-07-14T13:33:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.575+0000 7f075a238b80 10 client.29605 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:33:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.575+0000 7f075a238b80 10 client.29605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:33:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.575+0000 7f075a238b80 20 client.29605 populate_metadata read hostname 'smithi017' 2023-07-14T13:33:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.575+0000 7f075a238b80 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5bedb80 0x55f4f5beff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.575+0000 7f075a238b80 4 client.29605 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:33:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.575+0000 7f075a238b80 1 -- 172.21.15.17:0/2920467762 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4f5b1ee50 con 0x55f4f5bedb80 2023-07-14T13:33:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.576+0000 7f073f7fe700 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5bedb80 0x55f4f5beff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.576+0000 7f073f7fe700 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5bedb80 0x55f4f5beff90 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9e2bac821211143 server_cookie=8a9d52a092c45d9f in_seq=0 out_seq=0 2023-07-14T13:33:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.576+0000 7f071f7fe700 10 client.29605 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.577+0000 7f071f7fe700 1 -- 172.21.15.17:0/2920467762 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f4f5b1ee50 con 0x55f4f5bedb80 2023-07-14T13:33:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.577+0000 7f071f7fe700 10 client.29605 handle_command_reply: tid=0 2023-07-14T13:33:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.577+0000 7f075a238b80 1 client.29605 shutdown 2023-07-14T13:33:32.579 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.577+0000 7f075a238b80 1 -- 172.21.15.17:0/2920467762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 msgr2=0x55f4f5be0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.577+0000 7f075a238b80 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5be0590 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f07300099c0 tx=0x7f0730005800 comp rx=0 tx=0).stop 2023-07-14T13:33:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.577+0000 7f075a238b80 1 -- 172.21.15.17:0/2920467762 shutdown_connections 2023-07-14T13:33:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.578+0000 7f075a238b80 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5bedb80 0x55f4f5beff90 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.578+0000 7f075a238b80 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bda2d0 0x55f4f5bddee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.578+0000 7f075a238b80 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5be0590 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.578+0000 7f075a238b80 1 --2- 172.21.15.17:0/2920467762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bd4580 0x55f4f5bdd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.578+0000 7f071f7fe700 0 client.29605 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:32.580 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.578+0000 7f075a238b80 1 -- 172.21.15.17:0/2920467762 >> 172.21.15.17:0/2920467762 conn(0x55f4f5bc9be0 msgr2=0x55f4f5bcdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.578+0000 7f075a238b80 1 -- 172.21.15.17:0/2920467762 shutdown_connections 2023-07-14T13:33:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.578+0000 7f075a238b80 1 -- 172.21.15.17:0/2920467762 wait complete. 2023-07-14T13:33:32.581 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.578+0000 7f075a238b80 20 client.29605 trim_cache size 0 max 16384 2023-07-14T13:33:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.593+0000 7f075a238b80 1 Processor -- start 2023-07-14T13:33:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.593+0000 7f075a238b80 1 -- start start 2023-07-14T13:33:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f075a238b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bc9be0 0x55f4f5bd4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f075a238b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5bd92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f075a238b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5be4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f075a238b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5b1ee50 con 0x55f4f5bd4580 2023-07-14T13:33:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f075a238b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5a7f490 con 0x55f4f5bc9be0 2023-07-14T13:33:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f075a238b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5bcbd00 con 0x55f4f5a306b0 2023-07-14T13:33:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f0744f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5be4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f0744f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5be4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53554/0 (socket says 172.21.15.17:53554) 2023-07-14T13:33:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f0744f9c700 1 -- 172.21.15.17:0/2001750654 learned_addr learned my addr 172.21.15.17:0/2001750654 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f073f7fe700 1 --2- 172.21.15.17:0/2001750654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5bd92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f073ffff700 1 --2- 172.21.15.17:0/2001750654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bc9be0 0x55f4f5bd4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f0744f9c700 1 -- 172.21.15.17:0/2001750654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 msgr2=0x55f4f5bd92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f0744f9c700 1 --2- 172.21.15.17:0/2001750654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5bd92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f0744f9c700 1 -- 172.21.15.17:0/2001750654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bc9be0 msgr2=0x55f4f5bd4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f0744f9c700 1 --2- 172.21.15.17:0/2001750654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bc9be0 0x55f4f5bd4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f0744f9c700 1 -- 172.21.15.17:0/2001750654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f5bf4b80 con 0x55f4f5bd4580 2023-07-14T13:33:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.594+0000 7f073f7fe700 1 --2- 172.21.15.17:0/2001750654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5bd92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:33:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.595+0000 7f0744f9c700 1 --2- 172.21.15.17:0/2001750654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5be4c70 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f0738017d80 tx=0x7f0738009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de09806c0b7a191c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:32.595 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.595+0000 7f0726ffd700 1 -- 172.21.15.17:0/2001750654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738004a90 con 0x55f4f5bd4580 2023-07-14T13:33:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.595+0000 7f0726ffd700 1 -- 172.21.15.17:0/2001750654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0738003e90 con 0x55f4f5bd4580 2023-07-14T13:33:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.595+0000 7f0726ffd700 1 -- 172.21.15.17:0/2001750654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738004720 con 0x55f4f5bd4580 2023-07-14T13:33:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.596+0000 7f075a238b80 1 -- 172.21.15.17:0/2001750654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 msgr2=0x55f4f5be4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.596+0000 7f075a238b80 1 --2- 172.21.15.17:0/2001750654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5be4c70 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f0738017d80 tx=0x7f0738009920 comp rx=0 tx=0).stop 2023-07-14T13:33:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.596+0000 7f075a238b80 1 -- 172.21.15.17:0/2001750654 shutdown_connections 2023-07-14T13:33:32.596 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.596+0000 7f075a238b80 1 --2- 172.21.15.17:0/2001750654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bd4580 0x55f4f5be4c70 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.596+0000 7f075a238b80 1 --2- 172.21.15.17:0/2001750654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bc9be0 0x55f4f5bd4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.596+0000 7f075a238b80 1 --2- 172.21.15.17:0/2001750654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5bd92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.596+0000 7f075a238b80 1 -- 172.21.15.17:0/2001750654 >> 172.21.15.17:0/2001750654 conn(0x55f4f5bea1c0 msgr2=0x55f4f5bda900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.596+0000 7f075a238b80 1 -- 172.21.15.17:0/2001750654 shutdown_connections 2023-07-14T13:33:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.596+0000 7f075a238b80 1 -- 172.21.15.17:0/2001750654 wait complete. 2023-07-14T13:33:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.596+0000 7f075a238b80 1 -- start start 2023-07-14T13:33:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.596+0000 7f075a238b80 1 Processor -- start 2023-07-14T13:33:32.597 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f075a238b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5be45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f075a238b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bc9be0 0x55f4f5be4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f075a238b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bd4580 0x55f4f5be2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f075a238b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5be3200 con 0x55f4f5bc9be0 2023-07-14T13:33:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f075a238b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5be3370 con 0x55f4f5bd4580 2023-07-14T13:33:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f075a238b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f5be3530 con 0x55f4f5a306b0 2023-07-14T13:33:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f075a238b80 10 client.0 _ll_register_callbacks cb 0x7f07300053c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:33:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f073f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bc9be0 0x55f4f5be4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.598 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f073f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bc9be0 0x55f4f5be4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53568/0 (socket says 172.21.15.17:53568) 2023-07-14T13:33:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f073f7fe700 1 -- 172.21.15.17:0/1246724267 learned_addr learned my addr 172.21.15.17:0/1246724267 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f0744f9c700 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bd4580 0x55f4f5be2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f073ffff700 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5be45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f073f7fe700 1 -- 172.21.15.17:0/1246724267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 msgr2=0x55f4f5be45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.597+0000 7f073f7fe700 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5be45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f073f7fe700 1 -- 172.21.15.17:0/1246724267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bd4580 msgr2=0x55f4f5be2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:32.599 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f073f7fe700 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bd4580 0x55f4f5be2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f073f7fe700 1 -- 172.21.15.17:0/1246724267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4f5953d80 con 0x55f4f5bc9be0 2023-07-14T13:33:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f0744f9c700 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bd4580 0x55f4f5be2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:33:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f073ffff700 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5be45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:33:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f073f7fe700 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bc9be0 0x55f4f5be4b10 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f07340ca2e0 tx=0x7f073400d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22e5938191025bc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f071f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:33:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f071f7fe700 1 -- 172.21.15.17:0/1246724267 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073409dc30 con 0x55f4f5bc9be0 2023-07-14T13:33:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f071f7fe700 1 -- 172.21.15.17:0/1246724267 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f07340b6030 con 0x55f4f5bc9be0 2023-07-14T13:33:32.600 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f075a238b80 1 -- 172.21.15.17:0/1246724267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f073800f040 con 0x55f4f5bc9be0 2023-07-14T13:33:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f071f7fe700 1 -- 172.21.15.17:0/1246724267 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07340a2050 con 0x55f4f5bc9be0 2023-07-14T13:33:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f075a238b80 10 client.19875 fetch_fsmap learned FSMap version 68 2023-07-14T13:33:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.598+0000 7f075a238b80 1 -- 172.21.15.17:0/1246724267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55f4f597a1f0 con 0x55f4f5bc9be0 2023-07-14T13:33:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.599+0000 7f071f7fe700 1 -- 172.21.15.17:0/1246724267 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f073800f040 con 0x55f4f5bc9be0 2023-07-14T13:33:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.599+0000 7f071f7fe700 1 -- 172.21.15.17:0/1246724267 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0734099e60 con 0x55f4f5bc9be0 2023-07-14T13:33:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.599+0000 7f075a238b80 10 client.19875 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:33:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.599+0000 7f075a238b80 10 client.19875 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:33:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.599+0000 7f075a238b80 20 client.19875 populate_metadata read hostname 'smithi017' 2023-07-14T13:33:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.599+0000 7f075a238b80 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5bda2d0 0x55f4f5c44b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.599+0000 7f075a238b80 4 client.19875 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:33:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.599+0000 7f075a238b80 1 -- 172.21.15.17:0/1246724267 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f4f5ae0ff0 con 0x55f4f5bda2d0 2023-07-14T13:33:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.599+0000 7f073ffff700 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5bda2d0 0x55f4f5c44b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.600+0000 7f073ffff700 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5bda2d0 0x55f4f5c44b30 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eccfd1d4cc8aade server_cookie=2eda23192b04a395 in_seq=0 out_seq=0 2023-07-14T13:33:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.600+0000 7f071f7fe700 10 client.19875 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f071f7fe700 1 -- 172.21.15.17:0/1246724267 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f4f5ae0ff0 con 0x55f4f5bda2d0 2023-07-14T13:33:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f071f7fe700 10 client.19875 handle_command_reply: tid=0 2023-07-14T13:33:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 1 client.19875 shutdown 2023-07-14T13:33:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 1 -- 172.21.15.17:0/1246724267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bc9be0 msgr2=0x55f4f5be4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bc9be0 0x55f4f5be4b10 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f07340ca2e0 tx=0x7f073400d8d0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 1 -- 172.21.15.17:0/1246724267 shutdown_connections 2023-07-14T13:33:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55f4f5bda2d0 0x55f4f5c44b30 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f4f5bd4580 0x55f4f5be2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4f5a306b0 0x55f4f5be45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f071f7fe700 0 client.19875 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 1 --2- 172.21.15.17:0/1246724267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f4f5bc9be0 0x55f4f5be4b10 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 1 -- 172.21.15.17:0/1246724267 >> 172.21.15.17:0/1246724267 conn(0x55f4f5bea1c0 msgr2=0x55f4f5bd9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 1 -- 172.21.15.17:0/1246724267 shutdown_connections 2023-07-14T13:33:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 1 -- 172.21.15.17:0/1246724267 wait complete. 2023-07-14T13:33:32.627 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.629+0000 7f075a238b80 20 client.19875 trim_cache size 0 max 16384 2023-07-14T13:33:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:33:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:33:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:33:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:33:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 -- 172.21.15.17:0/406711912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f07280a12c0 msgr2=0x7f07280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f07280a12c0 0x7f07280a3770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f073800f540 tx=0x7f073800b040 comp rx=0 tx=0).stop 2023-07-14T13:33:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 -- 172.21.15.17:0/406711912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0740100760 msgr2=0x7f0740072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0740100760 0x7f0740072f30 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f073400d950 tx=0x7f073400dc60 comp rx=0 tx=0).stop 2023-07-14T13:33:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 -- 172.21.15.17:0/406711912 shutdown_connections 2023-07-14T13:33:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f07280a12c0 0x7f07280a3770 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0740104e00 0x7f07401a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f07400ffdc0 0x7f07400729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 --2- 172.21.15.17:0/406711912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0740100760 0x7f0740072f30 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 -- 172.21.15.17:0/406711912 >> 172.21.15.17:0/406711912 conn(0x7f07400fb650 msgr2=0x7f07400fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 -- 172.21.15.17:0/406711912 shutdown_connections 2023-07-14T13:33:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:32.630+0000 7f07469ff700 1 -- 172.21.15.17:0/406711912 wait complete. 2023-07-14T13:33:34.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:33 smithi135 ceph-mon[97338]: pgmap v1073: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 5.3 MiB/s wr, 619 op/s 2023-07-14T13:33:34.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:33 smithi131 ceph-mon[96953]: pgmap v1073: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 5.3 MiB/s wr, 619 op/s 2023-07-14T13:33:34.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:33 smithi017 ceph-mon[95536]: pgmap v1073: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 5.3 MiB/s wr, 619 op/s 2023-07-14T13:33:36.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:35 smithi135 ceph-mon[97338]: pgmap v1074: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 4.5 MiB/s wr, 525 op/s 2023-07-14T13:33:36.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:35 smithi131 ceph-mon[96953]: pgmap v1074: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 4.5 MiB/s wr, 525 op/s 2023-07-14T13:33:36.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:35 smithi017 ceph-mon[95536]: pgmap v1074: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 4.5 MiB/s wr, 525 op/s 2023-07-14T13:33:38.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:37 smithi135 ceph-mon[97338]: pgmap v1075: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 4.5 MiB/s wr, 541 op/s 2023-07-14T13:33:38.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:37 smithi131 ceph-mon[96953]: pgmap v1075: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 4.5 MiB/s wr, 541 op/s 2023-07-14T13:33:38.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:37 smithi017 ceph-mon[95536]: pgmap v1075: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 4.5 MiB/s wr, 541 op/s 2023-07-14T13:33:40.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:39 smithi135 ceph-mon[97338]: pgmap v1076: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 522 KiB/s wr, 66 op/s 2023-07-14T13:33:40.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:39 smithi131 ceph-mon[96953]: pgmap v1076: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 522 KiB/s wr, 66 op/s 2023-07-14T13:33:40.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:39 smithi017 ceph-mon[95536]: pgmap v1076: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 522 KiB/s wr, 66 op/s 2023-07-14T13:33:42.213 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:41 smithi131 ceph-mon[96953]: pgmap v1077: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 208 KiB/s wr, 31 op/s 2023-07-14T13:33:42.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:41 smithi017 ceph-mon[95536]: pgmap v1077: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 208 KiB/s wr, 31 op/s 2023-07-14T13:33:42.414 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:41 smithi135 ceph-mon[97338]: pgmap v1077: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 208 KiB/s wr, 31 op/s 2023-07-14T13:33:44.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:43 smithi131 ceph-mon[96953]: pgmap v1078: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 302 KiB/s wr, 31 op/s 2023-07-14T13:33:44.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:43 smithi017 ceph-mon[95536]: pgmap v1078: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 302 KiB/s wr, 31 op/s 2023-07-14T13:33:44.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:43 smithi135 ceph-mon[97338]: pgmap v1078: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 302 KiB/s wr, 31 op/s 2023-07-14T13:33:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.790+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1511884952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e341004b0 msgr2=0x7f0e3410c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.790+0000 7f0e3a9ff700 1 --2- 172.21.15.17:0/1511884952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e341004b0 0x7f0e3410c940 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00b0a0 tx=0x7f0e2c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.791+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1511884952 shutdown_connections 2023-07-14T13:33:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.791+0000 7f0e3a9ff700 1 --2- 172.21.15.17:0/1511884952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e341004b0 0x7f0e3410c940 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.791+0000 7f0e3a9ff700 1 --2- 172.21.15.17:0/1511884952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e34105b10 0x7f0e34105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.791+0000 7f0e3a9ff700 1 --2- 172.21.15.17:0/1511884952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e340ffb00 0x7f0e340fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.791+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1511884952 >> 172.21.15.17:0/1511884952 conn(0x7f0e340fb600 msgr2=0x7f0e340fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.791+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1511884952 shutdown_connections 2023-07-14T13:33:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.791+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1511884952 wait complete. 2023-07-14T13:33:45.790 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.792+0000 7f0e3a9ff700 1 Processor -- start 2023-07-14T13:33:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.792+0000 7f0e3a9ff700 1 -- start start 2023-07-14T13:33:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.792+0000 7f0e3a9ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e340ffb00 0x7f0e340729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.792+0000 7f0e3a9ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e341004b0 0x7f0e34072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.792+0000 7f0e3a9ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e34105b10 0x7f0e341a3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.791 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.792+0000 7f0e3a9ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e341a4310 con 0x7f0e341004b0 2023-07-14T13:33:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.792+0000 7f0e3a9ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e341a4450 con 0x7f0e34105b10 2023-07-14T13:33:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.792+0000 7f0e3a9ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e341a45c0 con 0x7f0e340ffb00 2023-07-14T13:33:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.793+0000 7f0e337fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e341004b0 0x7f0e34072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.793+0000 7f0e337fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e341004b0 0x7f0e34072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46094/0 (socket says 172.21.15.17:46094) 2023-07-14T13:33:45.792 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.793+0000 7f0e337fe700 1 -- 172.21.15.17:0/1501752144 learned_addr learned my addr 172.21.15.17:0/1501752144 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.793+0000 7f0e38f9c700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e34105b10 0x7f0e341a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.793+0000 7f0e33fff700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e340ffb00 0x7f0e340729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.793+0000 7f0e337fe700 1 -- 172.21.15.17:0/1501752144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e340ffb00 msgr2=0x7f0e340729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.793+0000 7f0e337fe700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e340ffb00 0x7f0e340729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.793+0000 7f0e337fe700 1 -- 172.21.15.17:0/1501752144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e34105b10 msgr2=0x7f0e341a3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:45.793 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.793+0000 7f0e337fe700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e34105b10 0x7f0e341a3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.793+0000 7f0e337fe700 1 -- 172.21.15.17:0/1501752144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c009d00 con 0x7f0e341004b0 2023-07-14T13:33:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.793+0000 7f0e337fe700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e341004b0 0x7f0e34072f30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800e9a0 tx=0x7f0e2800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.794+0000 7f0e317fa700 1 -- 172.21.15.17:0/1501752144 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28009790 con 0x7f0e341004b0 2023-07-14T13:33:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.794+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1501752144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e341a48a0 con 0x7f0e341004b0 2023-07-14T13:33:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.794+0000 7f0e317fa700 1 -- 172.21.15.17:0/1501752144 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e2800cbd0 con 0x7f0e341004b0 2023-07-14T13:33:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.794+0000 7f0e317fa700 1 -- 172.21.15.17:0/1501752144 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28018680 con 0x7f0e341004b0 2023-07-14T13:33:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.794+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1501752144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e341a4e00 con 0x7f0e341004b0 2023-07-14T13:33:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.797+0000 7f0e317fa700 1 -- 172.21.15.17:0/1501752144 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0e2800cd40 con 0x7f0e341004b0 2023-07-14T13:33:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.798+0000 7f0e4e2f2b80 1 Processor -- start 2023-07-14T13:33:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.798+0000 7f0e317fa700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0e1c0a12c0 0x7f0e1c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.798+0000 7f0e4e2f2b80 1 -- start start 2023-07-14T13:33:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e317fa700 1 -- 172.21.15.17:0/1501752144 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0e28014070 con 0x7f0e341004b0 2023-07-14T13:33:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e38f9c700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0e1c0a12c0 0x7f0e1c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb58b6b0 0x564abb734d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb72f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb72f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb634c50 con 0x564abb7352d0 2023-07-14T13:33:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb6879e0 con 0x564abb58b6b0 2023-07-14T13:33:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb680e70 con 0x564abb72f580 2023-07-14T13:33:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e337fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb72f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e337fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb72f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46110/0 (socket says 172.21.15.17:46110) 2023-07-14T13:33:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e337fe700 1 -- 172.21.15.17:0/3204570720 learned_addr learned my addr 172.21.15.17:0/3204570720 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e33fff700 1 --2- 172.21.15.17:0/3204570720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb58b6b0 0x564abb734d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.799+0000 7f0e38f9c700 1 --2- 172.21.15.17:0/3204570720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb72f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.800+0000 7f0e337fe700 1 -- 172.21.15.17:0/3204570720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 msgr2=0x564abb72f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.800+0000 7f0e337fe700 1 --2- 172.21.15.17:0/3204570720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb72f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.800+0000 7f0e337fe700 1 -- 172.21.15.17:0/3204570720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb58b6b0 msgr2=0x564abb734d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.800+0000 7f0e337fe700 1 --2- 172.21.15.17:0/3204570720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb58b6b0 0x564abb734d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.800+0000 7f0e337fe700 1 -- 172.21.15.17:0/3204570720 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564abb4aed80 con 0x564abb7352d0 2023-07-14T13:33:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.800+0000 7f0e38f9c700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0e1c0a12c0 0x7f0e1c0a3770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0062a0 tx=0x7f0e2c0095a0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.800+0000 7f0e337fe700 1 --2- 172.21.15.17:0/3204570720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb72f040 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f0e28096590 tx=0x7f0e28099cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a6cea76bfb3be7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:45.802 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.800+0000 7f0e1a7fc700 1 -- 172.21.15.17:0/3204570720 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2809e0c0 con 0x564abb7352d0 2023-07-14T13:33:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.800+0000 7f0e1a7fc700 1 -- 172.21.15.17:0/3204570720 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e280a24e0 con 0x564abb7352d0 2023-07-14T13:33:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.800+0000 7f0e1a7fc700 1 -- 172.21.15.17:0/3204570720 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280a2050 con 0x564abb7352d0 2023-07-14T13:33:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.801+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/3204570720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 msgr2=0x564abb72f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.801+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/3204570720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb72f040 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f0e28096590 tx=0x7f0e28099cc0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.801+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/3204570720 shutdown_connections 2023-07-14T13:33:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.801+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/3204570720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb72f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.801+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/3204570720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb58b6b0 0x564abb734d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.801+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/3204570720 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb72f040 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.801+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/3204570720 >> 172.21.15.17:0/3204570720 conn(0x564abb724be0 msgr2=0x564abb729f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.801+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/3204570720 shutdown_connections 2023-07-14T13:33:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.801+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/3204570720 wait complete. 2023-07-14T13:33:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.802+0000 7f0e4e2f2b80 1 -- start start 2023-07-14T13:33:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.802+0000 7f0e4e2f2b80 1 Processor -- start 2023-07-14T13:33:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.803+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb58b6b0 0x564abb73b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.803+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb72f580 0x564abb738940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.803+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb7352d0 0x564abb738fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.803+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb620a60 con 0x564abb72f580 2023-07-14T13:33:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.803+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb620760 con 0x564abb7352d0 2023-07-14T13:33:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.803+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb5048c0 con 0x564abb58b6b0 2023-07-14T13:33:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.803+0000 7f0e4e2f2b80 10 client.0 _ll_register_callbacks cb 0x564abb61e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:33:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.803+0000 7f0e337fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb72f580 0x564abb738940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.803+0000 7f0e337fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb72f580 0x564abb738940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46112/0 (socket says 172.21.15.17:46112) 2023-07-14T13:33:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.803+0000 7f0e337fe700 1 -- 172.21.15.17:0/2347483869 learned_addr learned my addr 172.21.15.17:0/2347483869 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e337fe700 1 -- 172.21.15.17:0/2347483869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb58b6b0 msgr2=0x564abb73b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e33fff700 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb58b6b0 0x564abb73b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e337fe700 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb58b6b0 0x564abb73b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e337fe700 1 -- 172.21.15.17:0/2347483869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb7352d0 msgr2=0x564abb738fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e337fe700 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb7352d0 0x564abb738fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e337fe700 1 -- 172.21.15.17:0/2347483869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e341a4e00 con 0x564abb72f580 2023-07-14T13:33:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e33fff700 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb58b6b0 0x564abb73b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:33:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e337fe700 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb72f580 0x564abb738940 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f0e280983e0 tx=0x7f0e280998e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302a4ffd132a4ad6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e137fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:33:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e137fe700 1 -- 172.21.15.17:0/2347483869 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280a2260 con 0x564abb72f580 2023-07-14T13:33:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e137fe700 1 -- 172.21.15.17:0/2347483869 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0e28010430 con 0x564abb72f580 2023-07-14T13:33:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/2347483869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564abb5da490 con 0x564abb72f580 2023-07-14T13:33:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e137fe700 1 -- 172.21.15.17:0/2347483869 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e28010630 con 0x564abb72f580 2023-07-14T13:33:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e4e2f2b80 10 client.19887 fetch_fsmap learned FSMap version 68 2023-07-14T13:33:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.804+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/2347483869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x564abb497c00 con 0x564abb72f580 2023-07-14T13:33:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.805+0000 7f0e137fe700 1 -- 172.21.15.17:0/2347483869 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e280ca020 con 0x564abb72f580 2023-07-14T13:33:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.805+0000 7f0e137fe700 1 -- 172.21.15.17:0/2347483869 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0e28096080 con 0x564abb72f580 2023-07-14T13:33:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.805+0000 7f0e4e2f2b80 10 client.19887 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:33:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.805+0000 7f0e4e2f2b80 10 client.19887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:33:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.805+0000 7f0e4e2f2b80 20 client.19887 populate_metadata read hostname 'smithi017' 2023-07-14T13:33:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.805+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564abb748850 0x564abb74ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.805+0000 7f0e4e2f2b80 4 client.19887 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:33:45.813 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.805+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/2347483869 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564abb679e50 con 0x564abb748850 2023-07-14T13:33:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.805+0000 7f0e33fff700 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564abb748850 0x564abb74ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.806+0000 7f0e33fff700 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564abb748850 0x564abb74ac60 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fca539de14636b1b server_cookie=17a0e8062b3f42a in_seq=0 out_seq=0 2023-07-14T13:33:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.806+0000 7f0e137fe700 10 client.19887 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e137fe700 1 -- 172.21.15.17:0/2347483869 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564abb679e50 con 0x564abb748850 2023-07-14T13:33:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e137fe700 10 client.19887 handle_command_reply: tid=0 2023-07-14T13:33:45.814 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e4e2f2b80 1 client.19887 shutdown 2023-07-14T13:33:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/2347483869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb72f580 msgr2=0x564abb738940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb72f580 0x564abb738940 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f0e280983e0 tx=0x7f0e280998e0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/2347483869 shutdown_connections 2023-07-14T13:33:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564abb748850 0x564abb74ac60 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb7352d0 0x564abb738fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.815 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb58b6b0 0x564abb73b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e137fe700 0 client.19887 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:45.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/2347483869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb72f580 0x564abb738940 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/2347483869 >> 172.21.15.17:0/2347483869 conn(0x564abb724be0 msgr2=0x564abb7294e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:45.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/2347483869 shutdown_connections 2023-07-14T13:33:45.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.807+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/2347483869 wait complete. 2023-07-14T13:33:45.816 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.808+0000 7f0e4e2f2b80 20 client.19887 trim_cache size 0 max 16384 2023-07-14T13:33:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.823+0000 7f0e4e2f2b80 1 Processor -- start 2023-07-14T13:33:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.823+0000 7f0e4e2f2b80 1 -- start start 2023-07-14T13:33:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.823+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb58b6b0 0x564abb72f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.823+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb734200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.823+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb7352d0 0x564abb729c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.823+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb7358a0 con 0x564abb58b6b0 2023-07-14T13:33:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.823+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb726d00 con 0x564abb7352d0 2023-07-14T13:33:45.820 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.823+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb7265f0 con 0x564abb72f580 2023-07-14T13:33:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.824+0000 7f0e33fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb58b6b0 0x564abb72f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.821 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.824+0000 7f0e33fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb58b6b0 0x564abb72f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46124/0 (socket says 172.21.15.17:46124) 2023-07-14T13:33:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.824+0000 7f0e33fff700 1 -- 172.21.15.17:0/1643366141 learned_addr learned my addr 172.21.15.17:0/1643366141 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.824+0000 7f0e337fe700 1 --2- 172.21.15.17:0/1643366141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb734200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.824+0000 7f0e38f9c700 1 --2- 172.21.15.17:0/1643366141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb7352d0 0x564abb729c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.824+0000 7f0e33fff700 1 -- 172.21.15.17:0/1643366141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 msgr2=0x564abb734200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.824+0000 7f0e33fff700 1 --2- 172.21.15.17:0/1643366141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb734200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.824+0000 7f0e33fff700 1 -- 172.21.15.17:0/1643366141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb7352d0 msgr2=0x564abb729c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.824+0000 7f0e33fff700 1 --2- 172.21.15.17:0/1643366141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb7352d0 0x564abb729c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.824+0000 7f0e33fff700 1 -- 172.21.15.17:0/1643366141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564abb4d51f0 con 0x564abb58b6b0 2023-07-14T13:33:45.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.824+0000 7f0e33fff700 1 --2- 172.21.15.17:0/1643366141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb58b6b0 0x564abb72f040 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f0e2401ab30 tx=0x7f0e2400d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570b0e5a518bd58b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:45.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.825+0000 7f0e1affd700 1 -- 172.21.15.17:0/1643366141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24018040 con 0x564abb58b6b0 2023-07-14T13:33:45.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.825+0000 7f0e1affd700 1 -- 172.21.15.17:0/1643366141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e2401a4b0 con 0x564abb58b6b0 2023-07-14T13:33:45.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.825+0000 7f0e1affd700 1 -- 172.21.15.17:0/1643366141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24003db0 con 0x564abb58b6b0 2023-07-14T13:33:45.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.825+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1643366141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb58b6b0 msgr2=0x564abb72f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:45.823 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.825+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/1643366141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb58b6b0 0x564abb72f040 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f0e2401ab30 tx=0x7f0e2400d440 comp rx=0 tx=0).stop 2023-07-14T13:33:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.825+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1643366141 shutdown_connections 2023-07-14T13:33:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.825+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/1643366141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb7352d0 0x564abb729c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.825+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/1643366141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb58b6b0 0x564abb72f040 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.825+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/1643366141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb734200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.825+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1643366141 >> 172.21.15.17:0/1643366141 conn(0x564abb724be0 msgr2=0x564abb733af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.826+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1643366141 shutdown_connections 2023-07-14T13:33:45.824 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.826+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1643366141 wait complete. 2023-07-14T13:33:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.826+0000 7f0e4e2f2b80 1 -- start start 2023-07-14T13:33:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.826+0000 7f0e4e2f2b80 1 Processor -- start 2023-07-14T13:33:45.827 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb58b6b0 0x564abb73fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb73e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e4e2f2b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb73e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb73ecb0 con 0x564abb7352d0 2023-07-14T13:33:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb73ee20 con 0x564abb58b6b0 2023-07-14T13:33:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e4e2f2b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x564abb79c700 con 0x564abb72f580 2023-07-14T13:33:45.828 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e4e2f2b80 10 client.0 _ll_register_callbacks cb 0x7f0e2400d2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:33:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e38f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb73e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e38f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb73e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46138/0 (socket says 172.21.15.17:46138) 2023-07-14T13:33:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e38f9c700 1 -- 172.21.15.17:0/1929858055 learned_addr learned my addr 172.21.15.17:0/1929858055 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e33fff700 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb58b6b0 0x564abb73fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e337fe700 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb73e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e38f9c700 1 -- 172.21.15.17:0/1929858055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 msgr2=0x564abb73e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e38f9c700 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb73e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e38f9c700 1 -- 172.21.15.17:0/1929858055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb58b6b0 msgr2=0x564abb73fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e38f9c700 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb58b6b0 0x564abb73fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.827+0000 7f0e38f9c700 1 -- 172.21.15.17:0/1929858055 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2401a860 con 0x564abb7352d0 2023-07-14T13:33:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.828+0000 7f0e38f9c700 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb73e5e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00b0a0 tx=0x7f0e2c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb863162c01371b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.828+0000 7f0e137fe700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:33:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.828+0000 7f0e137fe700 1 -- 172.21.15.17:0/1929858055 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c00e040 con 0x564abb7352d0 2023-07-14T13:33:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.828+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1929858055 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e280a24e0 con 0x564abb7352d0 2023-07-14T13:33:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.828+0000 7f0e137fe700 1 -- 172.21.15.17:0/1929858055 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0e2c0055a0 con 0x564abb7352d0 2023-07-14T13:33:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.828+0000 7f0e137fe700 1 -- 172.21.15.17:0/1929858055 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e2c0078f0 con 0x564abb7352d0 2023-07-14T13:33:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.828+0000 7f0e4e2f2b80 10 client.19893 fetch_fsmap learned FSMap version 68 2023-07-14T13:33:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.828+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1929858055 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x564abb4ad250 con 0x564abb7352d0 2023-07-14T13:33:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.829+0000 7f0e137fe700 1 -- 172.21.15.17:0/1929858055 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e280a24e0 con 0x564abb7352d0 2023-07-14T13:33:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.829+0000 7f0e137fe700 1 -- 172.21.15.17:0/1929858055 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 68) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0e2c027030 con 0x564abb7352d0 2023-07-14T13:33:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.829+0000 7f0e4e2f2b80 10 client.19893 fetch_fsmap finished waiting for FSMap version 68 2023-07-14T13:33:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.829+0000 7f0e4e2f2b80 10 client.19893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:33:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.829+0000 7f0e4e2f2b80 20 client.19893 populate_metadata read hostname 'smithi017' 2023-07-14T13:33:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.829+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564abb79dd30 0x564abb7a0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.829+0000 7f0e4e2f2b80 4 client.19893 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:33:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.829+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1929858055 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564abb63bff0 con 0x564abb79dd30 2023-07-14T13:33:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.829+0000 7f0e33fff700 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564abb79dd30 0x564abb7a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.830+0000 7f0e33fff700 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564abb79dd30 0x564abb7a0140 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b21811ae4c042bd0 server_cookie=d12dca4565c16fa5 in_seq=0 out_seq=0 2023-07-14T13:33:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.830+0000 7f0e137fe700 10 client.19893 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e137fe700 1 -- 172.21.15.17:0/1929858055 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564abb63bff0 con 0x564abb79dd30 2023-07-14T13:33:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e137fe700 10 client.19893 handle_command_reply: tid=0 2023-07-14T13:33:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e4e2f2b80 1 client.19893 shutdown 2023-07-14T13:33:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1929858055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 msgr2=0x564abb73e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb73e5e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00b0a0 tx=0x7f0e2c0099e0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1929858055 shutdown_connections 2023-07-14T13:33:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x564abb79dd30 0x564abb7a0140 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x564abb7352d0 0x564abb73e5e0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564abb58b6b0 0x564abb73fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e4e2f2b80 1 --2- 172.21.15.17:0/1929858055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564abb72f580 0x564abb73e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1929858055 >> 172.21.15.17:0/1929858055 conn(0x564abb724be0 msgr2=0x564abb734380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e137fe700 0 client.19893 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1929858055 shutdown_connections 2023-07-14T13:33:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.853+0000 7f0e4e2f2b80 1 -- 172.21.15.17:0/1929858055 wait complete. 2023-07-14T13:33:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.854+0000 7f0e4e2f2b80 20 client.19893 trim_cache size 0 max 16384 2023-07-14T13:33:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:33:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:33:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:33:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:33:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.854+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1501752144 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0e1c0a12c0 msgr2=0x7f0e1c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.854+0000 7f0e3a9ff700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0e1c0a12c0 0x7f0e1c0a3770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0062a0 tx=0x7f0e2c0095a0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.854+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1501752144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e341004b0 msgr2=0x7f0e34072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.854+0000 7f0e3a9ff700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e341004b0 0x7f0e34072f30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800e9a0 tx=0x7f0e2800ecb0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.855+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1501752144 shutdown_connections 2023-07-14T13:33:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.855+0000 7f0e3a9ff700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0e1c0a12c0 0x7f0e1c0a3770 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.855+0000 7f0e3a9ff700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e34105b10 0x7f0e341a3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.855+0000 7f0e3a9ff700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e340ffb00 0x7f0e340729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.855+0000 7f0e3a9ff700 1 --2- 172.21.15.17:0/1501752144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e341004b0 0x7f0e34072f30 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.855+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1501752144 >> 172.21.15.17:0/1501752144 conn(0x7f0e340fb600 msgr2=0x7f0e340fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.855+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1501752144 shutdown_connections 2023-07-14T13:33:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:45.855+0000 7f0e3a9ff700 1 -- 172.21.15.17:0/1501752144 wait complete. 2023-07-14T13:33:46.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:45 smithi131 ceph-mon[96953]: pgmap v1079: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 235 KiB/s wr, 28 op/s 2023-07-14T13:33:46.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:45 smithi017 ceph-mon[95536]: pgmap v1079: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 235 KiB/s wr, 28 op/s 2023-07-14T13:33:46.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:45 smithi135 ceph-mon[97338]: pgmap v1079: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 235 KiB/s wr, 28 op/s 2023-07-14T13:33:48.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:47 smithi131 ceph-mon[96953]: pgmap v1080: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 248 KiB/s wr, 34 op/s 2023-07-14T13:33:48.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:47 smithi017 ceph-mon[95536]: pgmap v1080: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 248 KiB/s wr, 34 op/s 2023-07-14T13:33:48.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:47 smithi135 ceph-mon[97338]: pgmap v1080: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 248 KiB/s wr, 34 op/s 2023-07-14T13:33:50.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:49 smithi131 ceph-mon[96953]: pgmap v1081: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 358 KiB/s wr, 23 op/s 2023-07-14T13:33:50.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:49 smithi017 ceph-mon[95536]: pgmap v1081: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 358 KiB/s wr, 23 op/s 2023-07-14T13:33:50.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:49 smithi135 ceph-mon[97338]: pgmap v1081: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 358 KiB/s wr, 23 op/s 2023-07-14T13:33:52.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:51 smithi131 ceph-mon[96953]: pgmap v1082: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 328 KiB/s wr, 29 op/s 2023-07-14T13:33:52.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:51 smithi017 ceph-mon[95536]: pgmap v1082: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 328 KiB/s wr, 29 op/s 2023-07-14T13:33:52.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:51 smithi135 ceph-mon[97338]: pgmap v1082: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 328 KiB/s wr, 29 op/s 2023-07-14T13:33:53.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:52 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:33:53.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:52 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:33:53.416 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:52 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:33:54.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:53 smithi131 ceph-mon[96953]: pgmap v1083: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 348 KiB/s wr, 28 op/s 2023-07-14T13:33:54.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:53 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:33:54.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:53 smithi017 ceph-mon[95536]: pgmap v1083: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 348 KiB/s wr, 28 op/s 2023-07-14T13:33:54.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:53 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:33:54.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:53 smithi135 ceph-mon[97338]: pgmap v1083: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 348 KiB/s wr, 28 op/s 2023-07-14T13:33:54.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:53 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:33:55.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:54 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:33:55.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:54 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:33:55.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:54 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:33:55.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:54 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:33:55.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:54 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:33:55.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:54 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:33:55.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:54 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:33:55.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:54 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:33:55.414 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:54 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:33:56.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:55 smithi131 ceph-mon[96953]: pgmap v1084: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 246 KiB/s wr, 24 op/s 2023-07-14T13:33:56.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:55 smithi017 ceph-mon[95536]: pgmap v1084: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 246 KiB/s wr, 24 op/s 2023-07-14T13:33:56.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:55 smithi135 ceph-mon[97338]: pgmap v1084: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 246 KiB/s wr, 24 op/s 2023-07-14T13:33:58.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:57 smithi131 ceph-mon[96953]: pgmap v1085: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 283 KiB/s wr, 31 op/s 2023-07-14T13:33:58.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:57 smithi017 ceph-mon[95536]: pgmap v1085: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 283 KiB/s wr, 31 op/s 2023-07-14T13:33:58.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:57 smithi135 ceph-mon[97338]: pgmap v1085: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 283 KiB/s wr, 31 op/s 2023-07-14T13:33:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.023+0000 7f21813ff700 1 -- 172.21.15.17:0/961878910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f217c105b10 msgr2=0x7f217c105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.023+0000 7f21813ff700 1 --2- 172.21.15.17:0/961878910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f217c105b10 0x7f217c105ee0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f216c009990 tx=0x7f216c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.023+0000 7f21813ff700 1 -- 172.21.15.17:0/961878910 shutdown_connections 2023-07-14T13:33:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.023+0000 7f21813ff700 1 --2- 172.21.15.17:0/961878910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f217c1004b0 0x7f217c10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.023+0000 7f21813ff700 1 --2- 172.21.15.17:0/961878910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f217c105b10 0x7f217c105ee0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.023+0000 7f21813ff700 1 --2- 172.21.15.17:0/961878910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f217c0ffb00 0x7f217c0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.023+0000 7f21813ff700 1 -- 172.21.15.17:0/961878910 >> 172.21.15.17:0/961878910 conn(0x7f217c0fb600 msgr2=0x7f217c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.023+0000 7f21813ff700 1 -- 172.21.15.17:0/961878910 shutdown_connections 2023-07-14T13:33:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.024+0000 7f21813ff700 1 -- 172.21.15.17:0/961878910 wait complete. 2023-07-14T13:33:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.025+0000 7f21813ff700 1 Processor -- start 2023-07-14T13:33:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.025+0000 7f21813ff700 1 -- start start 2023-07-14T13:33:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.026+0000 7f21813ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f217c0ffb00 0x7f217c19dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.026+0000 7f21813ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f217c1004b0 0x7f217c19e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.026+0000 7f21813ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f217c105b10 0x7f217c197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.026+0000 7f21813ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c1981b0 con 0x7f217c105b10 2023-07-14T13:33:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.026+0000 7f21813ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c198320 con 0x7f217c1004b0 2023-07-14T13:33:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.026+0000 7f21813ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c1984e0 con 0x7f217c0ffb00 2023-07-14T13:33:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.026+0000 7f217affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f217c0ffb00 0x7f217c19dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.026+0000 7f217b7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f217c105b10 0x7f217c197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.026+0000 7f217affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f217c0ffb00 0x7f217c19dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47498/0 (socket says 172.21.15.17:47498) 2023-07-14T13:33:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.026+0000 7f217affd700 1 -- 172.21.15.17:0/2034852533 learned_addr learned my addr 172.21.15.17:0/2034852533 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.026+0000 7f217a7fc700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f217c1004b0 0x7f217c19e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f217b7fe700 1 -- 172.21.15.17:0/2034852533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f217c0ffb00 msgr2=0x7f217c19dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f217b7fe700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f217c0ffb00 0x7f217c19dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f217b7fe700 1 -- 172.21.15.17:0/2034852533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f217c1004b0 msgr2=0x7f217c19e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f217b7fe700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f217c1004b0 0x7f217c19e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f217b7fe700 1 -- 172.21.15.17:0/2034852533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0095f0 con 0x7f217c105b10 2023-07-14T13:33:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f217affd700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f217c0ffb00 0x7f217c19dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:33:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f217b7fe700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f217c105b10 0x7f217c197b40 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f2174007f10 tx=0x7f217400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f2163fff700 1 -- 172.21.15.17:0/2034852533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174004db0 con 0x7f217c105b10 2023-07-14T13:33:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f21813ff700 1 -- 172.21.15.17:0/2034852533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c1987c0 con 0x7f217c105b10 2023-07-14T13:33:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f2163fff700 1 -- 172.21.15.17:0/2034852533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f217400f040 con 0x7f217c105b10 2023-07-14T13:33:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f2163fff700 1 -- 172.21.15.17:0/2034852533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174005960 con 0x7f217c105b10 2023-07-14T13:33:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.027+0000 7f21813ff700 1 -- 172.21.15.17:0/2034852533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c1a4cd0 con 0x7f217c105b10 2023-07-14T13:33:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.031+0000 7f2163fff700 1 -- 172.21.15.17:0/2034852533 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f217400db20 con 0x7f217c105b10 2023-07-14T13:33:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f2194c6ab80 1 Processor -- start 2023-07-14T13:33:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f2194c6ab80 1 -- start start 2023-07-14T13:33:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f2163fff700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f21640a12c0 0x7f21640a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e59f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e59f580 0x55a70e59f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e4a4c50 con 0x55a70e3fb6b0 2023-07-14T13:33:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e4f79e0 con 0x55a70e59f580 2023-07-14T13:33:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e4f0e70 con 0x55a70e5a52d0 2023-07-14T13:33:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f2163fff700 1 -- 172.21.15.17:0/2034852533 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f21740cc540 con 0x7f217c105b10 2023-07-14T13:33:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f217affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.033+0000 7f217a7fc700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f21640a12c0 0x7f21640a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.034+0000 7f217affd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35478/0 (socket says 172.21.15.17:35478) 2023-07-14T13:33:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.034+0000 7f217affd700 1 -- 172.21.15.17:0/4267111335 learned_addr learned my addr 172.21.15.17:0/4267111335 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.034+0000 7f217b7fe700 1 --2- 172.21.15.17:0/4267111335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e59f580 0x55a70e59f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.034+0000 7f217a7fc700 1 --2- 172.21.15.17:0/4267111335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e59f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.034+0000 7f217affd700 1 -- 172.21.15.17:0/4267111335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 msgr2=0x55a70e59f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.034+0000 7f217affd700 1 --2- 172.21.15.17:0/4267111335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e59f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.034+0000 7f217affd700 1 -- 172.21.15.17:0/4267111335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e59f580 msgr2=0x55a70e59f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.034+0000 7f217affd700 1 --2- 172.21.15.17:0/4267111335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e59f580 0x55a70e59f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.034+0000 7f217affd700 1 -- 172.21.15.17:0/4267111335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a70e31ed80 con 0x55a70e3fb6b0 2023-07-14T13:33:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.034+0000 7f217a7fc700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f21640a12c0 0x7f21640a3770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f217c1051e0 tx=0x7f2170009f90 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.034+0000 7f217affd700 1 --2- 172.21.15.17:0/4267111335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a4d90 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f216c004530 tx=0x7f216c004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c708bf7d04e6ee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.035+0000 7f21617fa700 1 -- 172.21.15.17:0/4267111335 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c01d050 con 0x55a70e3fb6b0 2023-07-14T13:33:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.035+0000 7f21617fa700 1 -- 172.21.15.17:0/4267111335 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f216c01e040 con 0x55a70e3fb6b0 2023-07-14T13:33:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.035+0000 7f21617fa700 1 -- 172.21.15.17:0/4267111335 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c004ce0 con 0x55a70e3fb6b0 2023-07-14T13:33:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.035+0000 7f2194c6ab80 1 -- 172.21.15.17:0/4267111335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e3fb6b0 msgr2=0x55a70e5a4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.035+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/4267111335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a4d90 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f216c004530 tx=0x7f216c004560 comp rx=0 tx=0).stop 2023-07-14T13:33:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.036+0000 7f2194c6ab80 1 -- 172.21.15.17:0/4267111335 shutdown_connections 2023-07-14T13:33:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.036+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/4267111335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e59f580 0x55a70e59f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.036+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/4267111335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a4d90 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.036+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/4267111335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e59f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.036+0000 7f2194c6ab80 1 -- 172.21.15.17:0/4267111335 >> 172.21.15.17:0/4267111335 conn(0x55a70e594be0 msgr2=0x55a70e599f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.036+0000 7f2194c6ab80 1 -- 172.21.15.17:0/4267111335 shutdown_connections 2023-07-14T13:33:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.036+0000 7f2194c6ab80 1 -- 172.21.15.17:0/4267111335 wait complete. 2023-07-14T13:33:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.036+0000 7f2194c6ab80 1 -- start start 2023-07-14T13:33:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.037+0000 7f2194c6ab80 1 Processor -- start 2023-07-14T13:33:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.037+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.037+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.037+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e5a9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.037+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e490a60 con 0x55a70e59f580 2023-07-14T13:33:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.037+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e490760 con 0x55a70e3fb6b0 2023-07-14T13:33:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.037+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e3748c0 con 0x55a70e5a52d0 2023-07-14T13:33:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.037+0000 7f2194c6ab80 10 client.0 _ll_register_callbacks cb 0x55a70e48e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:33:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.17:59292/0 (socket says 172.21.15.17:59292) 2023-07-14T13:33:59.042 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217affd700 1 -- 172.21.15.17:0/1697958493 learned_addr learned my addr 172.21.15.17:0/1697958493 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217b7fe700 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e5a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217affd700 1 -- 172.21.15.17:0/1697958493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 msgr2=0x55a70e5a9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217affd700 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e5a9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217affd700 1 -- 172.21.15.17:0/1697958493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 msgr2=0x55a70e5a8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217affd700 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5a8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217affd700 1 -- 172.21.15.17:0/1697958493 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c10d240 con 0x55a70e3fb6b0 2023-07-14T13:33:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217a7fc700 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5a8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:33:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f217affd700 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a88a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f216c004900 tx=0x7f216c024af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49723ebfb12373ca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.038+0000 7f215eff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-07-14T13:33:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.039+0000 7f215eff5700 1 -- 172.21.15.17:0/1697958493 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00f460 con 0x55a70e3fb6b0 2023-07-14T13:33:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.039+0000 7f215eff5700 1 -- 172.21.15.17:0/1697958493 <== mon.2 v2:172.21.15.131:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f216c00f5c0 con 0x55a70e3fb6b0 2023-07-14T13:33:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.039+0000 7f2194c6ab80 1 -- 172.21.15.17:0/1697958493 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a70e44a490 con 0x55a70e3fb6b0 2023-07-14T13:33:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.039+0000 7f215eff5700 1 -- 172.21.15.17:0/1697958493 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f216c00f780 con 0x55a70e3fb6b0 2023-07-14T13:33:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.039+0000 7f2194c6ab80 10 client.29717 fetch_fsmap learned FSMap version 69 2023-07-14T13:33:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.039+0000 7f2194c6ab80 1 -- 172.21.15.17:0/1697958493 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55a70e307c00 con 0x55a70e3fb6b0 2023-07-14T13:33:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.040+0000 7f215eff5700 1 -- 172.21.15.17:0/1697958493 <== mon.2 v2:172.21.15.131:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a70e44a490 con 0x55a70e3fb6b0 2023-07-14T13:33:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.040+0000 7f215eff5700 1 -- 172.21.15.17:0/1697958493 <== mon.2 v2:172.21.15.131:3300/0 5 ==== fsmap(e 69) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f216c02d6e0 con 0x55a70e3fb6b0 2023-07-14T13:33:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.040+0000 7f2194c6ab80 10 client.29717 fetch_fsmap finished waiting for FSMap version 69 2023-07-14T13:33:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.040+0000 7f2194c6ab80 10 client.29717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:33:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.040+0000 7f2194c6ab80 20 client.29717 populate_metadata read hostname 'smithi017' 2023-07-14T13:33:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.040+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a70e5b87d0 0x55a70e5babe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.040+0000 7f2194c6ab80 4 client.29717 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:33:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.040+0000 7f2194c6ab80 1 -- 172.21.15.17:0/1697958493 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a70e4e9e50 con 0x55a70e5b87d0 2023-07-14T13:33:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.041+0000 7f217a7fc700 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a70e5b87d0 0x55a70e5babe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.041+0000 7f217a7fc700 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a70e5b87d0 0x55a70e5babe0 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f85074d7730fdda3 server_cookie=fd0a88c7890d75dc in_seq=0 out_seq=0 2023-07-14T13:33:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.041+0000 7f215eff5700 10 client.29717 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f215eff5700 1 -- 172.21.15.17:0/1697958493 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a70e4e9e50 con 0x55a70e5b87d0 2023-07-14T13:33:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f215eff5700 10 client.29717 handle_command_reply: tid=0 2023-07-14T13:33:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f2194c6ab80 1 client.29717 shutdown 2023-07-14T13:33:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f2194c6ab80 1 -- 172.21.15.17:0/1697958493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 msgr2=0x55a70e5a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a88a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f216c004900 tx=0x7f216c024af0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f2194c6ab80 1 -- 172.21.15.17:0/1697958493 shutdown_connections 2023-07-14T13:33:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a70e5b87d0 0x55a70e5babe0 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e5a9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 0x55a70e5a88a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/1697958493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5a8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f2194c6ab80 1 -- 172.21.15.17:0/1697958493 >> 172.21.15.17:0/1697958493 conn(0x55a70e594be0 msgr2=0x55a70e5994e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.042+0000 7f215eff5700 0 client.29717 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.043+0000 7f2194c6ab80 1 -- 172.21.15.17:0/1697958493 shutdown_connections 2023-07-14T13:33:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.043+0000 7f2194c6ab80 1 -- 172.21.15.17:0/1697958493 wait complete. 2023-07-14T13:33:59.050 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.043+0000 7f2194c6ab80 20 client.29717 trim_cache size 0 max 16384 2023-07-14T13:33:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.060+0000 7f2194c6ab80 1 Processor -- start 2023-07-14T13:33:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.060+0000 7f2194c6ab80 1 -- start start 2023-07-14T13:33:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.060+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e3fb6b0 0x55a70e59f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.060+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5a4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.060+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e5a52d0 0x55a70e5a9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.060+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e565060 con 0x55a70e59f580 2023-07-14T13:33:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.060+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e59b970 con 0x55a70e5a52d0 2023-07-14T13:33:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.060+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e5965f0 con 0x55a70e3fb6b0 2023-07-14T13:33:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e3fb6b0 0x55a70e59f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e5a52d0 0x55a70e5a9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e3fb6b0 0x55a70e59f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.17:47518/0 (socket says 172.21.15.17:47518) 2023-07-14T13:33:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5a4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35502/0 (socket says 172.21.15.17:35502) 2023-07-14T13:33:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217affd700 1 -- 172.21.15.17:0/3432932059 learned_addr learned my addr 172.21.15.17:0/3432932059 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217a7fc700 1 -- 172.21.15.17:0/3432932059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e3fb6b0 msgr2=0x55a70e59f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217a7fc700 1 --2- 172.21.15.17:0/3432932059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e3fb6b0 0x55a70e59f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217a7fc700 1 -- 172.21.15.17:0/3432932059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e5a52d0 msgr2=0x55a70e5a9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217a7fc700 1 --2- 172.21.15.17:0/3432932059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e5a52d0 0x55a70e5a9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217a7fc700 1 -- 172.21.15.17:0/3432932059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a70e3451f0 con 0x55a70e59f580 2023-07-14T13:33:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217b7fe700 1 --2- 172.21.15.17:0/3432932059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e5a52d0 0x55a70e5a9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:33:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.061+0000 7f217a7fc700 1 --2- 172.21.15.17:0/3432932059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5a4310 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f2170005c30 tx=0x7f2170009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ec646445b7eac8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.062+0000 7f2161ffb700 1 -- 172.21.15.17:0/3432932059 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217002b070 con 0x55a70e59f580 2023-07-14T13:33:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.062+0000 7f2161ffb700 1 -- 172.21.15.17:0/3432932059 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2170004540 con 0x55a70e59f580 2023-07-14T13:33:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.062+0000 7f2161ffb700 1 -- 172.21.15.17:0/3432932059 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170004c20 con 0x55a70e59f580 2023-07-14T13:33:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.062+0000 7f2194c6ab80 1 -- 172.21.15.17:0/3432932059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 msgr2=0x55a70e5a4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.062+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/3432932059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5a4310 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f2170005c30 tx=0x7f2170009260 comp rx=0 tx=0).stop 2023-07-14T13:33:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.062+0000 7f2194c6ab80 1 -- 172.21.15.17:0/3432932059 shutdown_connections 2023-07-14T13:33:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.062+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/3432932059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e5a52d0 0x55a70e5a9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.062+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/3432932059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e3fb6b0 0x55a70e59f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.062+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/3432932059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5a4310 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.062+0000 7f2194c6ab80 1 -- 172.21.15.17:0/3432932059 >> 172.21.15.17:0/3432932059 conn(0x55a70e594be0 msgr2=0x55a70e5a5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.063+0000 7f2194c6ab80 1 -- 172.21.15.17:0/3432932059 shutdown_connections 2023-07-14T13:33:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.063+0000 7f2194c6ab80 1 -- 172.21.15.17:0/3432932059 wait complete. 2023-07-14T13:33:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.063+0000 7f2194c6ab80 1 -- start start 2023-07-14T13:33:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f2194c6ab80 1 Processor -- start 2023-07-14T13:33:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 0x55a70e5ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f2194c6ab80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e60b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e60bbd0 con 0x55a70e59f580 2023-07-14T13:33:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e60bd10 con 0x55a70e3fb6b0 2023-07-14T13:33:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f2194c6ab80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a70e60bed0 con 0x55a70e5a52d0 2023-07-14T13:33:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f2194c6ab80 10 client.0 _ll_register_callbacks cb 0x7f2174004ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:33:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f217a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f217affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 0x55a70e5ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f217a7fc700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35518/0 (socket says 172.21.15.17:35518) 2023-07-14T13:33:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.064+0000 7f217a7fc700 1 -- 172.21.15.17:0/215814569 learned_addr learned my addr 172.21.15.17:0/215814569 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:33:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.065+0000 7f217b7fe700 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e60b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.065+0000 7f217a7fc700 1 -- 172.21.15.17:0/215814569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 msgr2=0x55a70e60b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.065+0000 7f217a7fc700 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e60b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.065+0000 7f217a7fc700 1 -- 172.21.15.17:0/215814569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 msgr2=0x55a70e5ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:33:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.065+0000 7f217a7fc700 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 0x55a70e5ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.065+0000 7f217a7fc700 1 -- 172.21.15.17:0/215814569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c1a4cd0 con 0x55a70e59f580 2023-07-14T13:33:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.065+0000 7f217b7fe700 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e60b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:33:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.065+0000 7f217affd700 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 0x55a70e5ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:33:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.065+0000 7f217a7fc700 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5adfa0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2170027750 tx=0x7f21700098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4211898e12ae1b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:33:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.065+0000 7f215eff5700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:33:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f215eff5700 1 -- 172.21.15.17:0/215814569 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217002b040 con 0x55a70e59f580 2023-07-14T13:33:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f215eff5700 1 -- 172.21.15.17:0/215814569 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f21700274c0 con 0x55a70e59f580 2023-07-14T13:33:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f2194c6ab80 1 -- 172.21.15.17:0/215814569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f216c01e040 con 0x55a70e59f580 2023-07-14T13:33:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f215eff5700 1 -- 172.21.15.17:0/215814569 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2170027780 con 0x55a70e59f580 2023-07-14T13:33:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f2194c6ab80 10 client.19911 fetch_fsmap learned FSMap version 69 2023-07-14T13:33:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f2194c6ab80 1 -- 172.21.15.17:0/215814569 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x7f2170004290 con 0x55a70e59f580 2023-07-14T13:33:59.073 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f215eff5700 1 -- 172.21.15.17:0/215814569 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f217003e080 con 0x55a70e59f580 2023-07-14T13:33:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f215eff5700 1 -- 172.21.15.17:0/215814569 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 69) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f21700308a0 con 0x55a70e59f580 2023-07-14T13:33:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f2194c6ab80 10 client.19911 fetch_fsmap finished waiting for FSMap version 69 2023-07-14T13:33:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f2194c6ab80 10 client.19911 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:33:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f2194c6ab80 20 client.19911 populate_metadata read hostname 'smithi017' 2023-07-14T13:33:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a70e60d690 0x55a70e60faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:33:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f2194c6ab80 4 client.19911 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:33:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.066+0000 7f2194c6ab80 1 -- 172.21.15.17:0/215814569 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a70e4abff0 con 0x55a70e60d690 2023-07-14T13:33:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.067+0000 7f217affd700 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a70e60d690 0x55a70e60faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:33:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.068+0000 7f217affd700 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a70e60d690 0x55a70e60faa0 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b63da1a43795b61 server_cookie=fb95b31b53f0aca6 in_seq=0 out_seq=0 2023-07-14T13:33:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.068+0000 7f215eff5700 10 client.19911 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:59.090 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f215eff5700 1 -- 172.21.15.17:0/215814569 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a70e4abff0 con 0x55a70e60d690 2023-07-14T13:33:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f215eff5700 10 client.19911 handle_command_reply: tid=0 2023-07-14T13:33:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f2194c6ab80 1 client.19911 shutdown 2023-07-14T13:33:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f2194c6ab80 1 -- 172.21.15.17:0/215814569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 msgr2=0x55a70e5adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5adfa0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f2170027750 tx=0x7f21700098b0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f2194c6ab80 1 -- 172.21.15.17:0/215814569 shutdown_connections 2023-07-14T13:33:59.091 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55a70e60d690 0x55a70e60faa0 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a70e5a52d0 0x55a70e60b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a70e3fb6b0 0x55a70e5ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f2194c6ab80 1 --2- 172.21.15.17:0/215814569 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55a70e59f580 0x55a70e5adfa0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f2194c6ab80 1 -- 172.21.15.17:0/215814569 >> 172.21.15.17:0/215814569 conn(0x55a70e594be0 msgr2=0x55a70e5a4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f215eff5700 0 client.19911 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:33:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f2194c6ab80 1 -- 172.21.15.17:0/215814569 shutdown_connections 2023-07-14T13:33:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.095+0000 7f2194c6ab80 1 -- 172.21.15.17:0/215814569 wait complete. 2023-07-14T13:33:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.096+0000 7f2194c6ab80 20 client.19911 trim_cache size 0 max 16384 2023-07-14T13:33:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:33:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:33:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:33:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:33:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.096+0000 7f21813ff700 1 -- 172.21.15.17:0/2034852533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f21640a12c0 msgr2=0x7f21640a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.096+0000 7f21813ff700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f21640a12c0 0x7f21640a3770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f217c1051e0 tx=0x7f2170009f90 comp rx=0 tx=0).stop 2023-07-14T13:33:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.096+0000 7f21813ff700 1 -- 172.21.15.17:0/2034852533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f217c105b10 msgr2=0x7f217c197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:33:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.096+0000 7f21813ff700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f217c105b10 0x7f217c197b40 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f2174007f10 tx=0x7f217400d3b0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.096+0000 7f21813ff700 1 -- 172.21.15.17:0/2034852533 shutdown_connections 2023-07-14T13:33:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.096+0000 7f21813ff700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f21640a12c0 0x7f21640a3770 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.096+0000 7f21813ff700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f217c105b10 0x7f217c197b40 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.096+0000 7f21813ff700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f217c0ffb00 0x7f217c19dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.096+0000 7f21813ff700 1 --2- 172.21.15.17:0/2034852533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f217c1004b0 0x7f217c19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:33:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.096+0000 7f21813ff700 1 -- 172.21.15.17:0/2034852533 >> 172.21.15.17:0/2034852533 conn(0x7f217c0fb600 msgr2=0x7f217c10ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:33:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.097+0000 7f21813ff700 1 -- 172.21.15.17:0/2034852533 shutdown_connections 2023-07-14T13:33:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:33:59.097+0000 7f21813ff700 1 -- 172.21.15.17:0/2034852533 wait complete. 2023-07-14T13:34:00.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:33:59 smithi131 ceph-mon[96953]: pgmap v1086: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 27 op/s 2023-07-14T13:34:00.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:33:59 smithi017 ceph-mon[95536]: pgmap v1086: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 27 op/s 2023-07-14T13:34:00.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:33:59 smithi135 ceph-mon[97338]: pgmap v1086: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 318 KiB/s wr, 27 op/s 2023-07-14T13:34:02.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:01 smithi017 ceph-mon[95536]: pgmap v1087: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 766 KiB/s wr, 95 op/s 2023-07-14T13:34:02.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:01 smithi135 ceph-mon[97338]: pgmap v1087: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 766 KiB/s wr, 95 op/s 2023-07-14T13:34:02.462 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:01 smithi131 ceph-mon[96953]: pgmap v1087: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 766 KiB/s wr, 95 op/s 2023-07-14T13:34:03.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:03 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:34:03.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:03 smithi017 ceph-mon[95536]: pgmap v1088: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 1.7 MiB/s wr, 193 op/s 2023-07-14T13:34:03.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:03 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:34:03.414 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:03 smithi135 ceph-mon[97338]: pgmap v1088: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 1.7 MiB/s wr, 193 op/s 2023-07-14T13:34:03.462 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:03 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:34:03.462 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:03 smithi131 ceph-mon[96953]: pgmap v1088: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 1.7 MiB/s wr, 193 op/s 2023-07-14T13:34:05.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:05 smithi017 ceph-mon[95536]: osdmap e146: 12 total, 12 up, 12 in 2023-07-14T13:34:05.323 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:05 smithi017 ceph-mon[95536]: pgmap v1090: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 2.0 MiB/s wr, 226 op/s 2023-07-14T13:34:05.415 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:05 smithi135 ceph-mon[97338]: osdmap e146: 12 total, 12 up, 12 in 2023-07-14T13:34:05.416 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:05 smithi135 ceph-mon[97338]: pgmap v1090: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 2.0 MiB/s wr, 226 op/s 2023-07-14T13:34:05.465 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:05 smithi131 ceph-mon[96953]: osdmap e146: 12 total, 12 up, 12 in 2023-07-14T13:34:05.466 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:05 smithi131 ceph-mon[96953]: pgmap v1090: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 2.0 MiB/s wr, 226 op/s 2023-07-14T13:34:08.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:07 smithi135 ceph-mon[97338]: pgmap v1091: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 3.4 MiB/s wr, 412 op/s 2023-07-14T13:34:08.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:07 smithi131 ceph-mon[96953]: pgmap v1091: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 3.4 MiB/s wr, 412 op/s 2023-07-14T13:34:08.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:07 smithi017 ceph-mon[95536]: pgmap v1091: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 3.4 MiB/s wr, 412 op/s 2023-07-14T13:34:10.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:09 smithi135 ceph-mon[97338]: pgmap v1092: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 3.4 MiB/s wr, 410 op/s 2023-07-14T13:34:10.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:09 smithi131 ceph-mon[96953]: pgmap v1092: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 3.4 MiB/s wr, 410 op/s 2023-07-14T13:34:10.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:09 smithi017 ceph-mon[95536]: pgmap v1092: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 3.4 MiB/s wr, 410 op/s 2023-07-14T13:34:12.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:11 smithi135 ceph-mon[97338]: pgmap v1093: 97 pgs: 16 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 53 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 2.7 MiB/s wr, 324 op/s 2023-07-14T13:34:12.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:11 smithi131 ceph-mon[96953]: pgmap v1093: 97 pgs: 16 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 53 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 2.7 MiB/s wr, 324 op/s 2023-07-14T13:34:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.258+0000 7f41109ff700 1 -- 172.21.15.17:0/152650348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0ffb30 msgr2=0x7f410c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.258+0000 7f41109ff700 1 --2- 172.21.15.17:0/152650348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0ffb30 0x7f410c0fffa0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009990 tx=0x7f40f4009ca0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.258+0000 7f41109ff700 1 -- 172.21.15.17:0/152650348 shutdown_connections 2023-07-14T13:34:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.258+0000 7f41109ff700 1 --2- 172.21.15.17:0/152650348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c1004e0 0x7f410c10c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.258+0000 7f41109ff700 1 --2- 172.21.15.17:0/152650348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f410c105b60 0x7f410c105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.258+0000 7f41109ff700 1 --2- 172.21.15.17:0/152650348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0ffb30 0x7f410c0fffa0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.258+0000 7f41109ff700 1 -- 172.21.15.17:0/152650348 >> 172.21.15.17:0/152650348 conn(0x7f410c0fb5f0 msgr2=0x7f410c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.258+0000 7f41109ff700 1 -- 172.21.15.17:0/152650348 shutdown_connections 2023-07-14T13:34:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.258+0000 7f41109ff700 1 -- 172.21.15.17:0/152650348 wait complete. 2023-07-14T13:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.260+0000 7f41109ff700 1 Processor -- start 2023-07-14T13:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.260+0000 7f41109ff700 1 -- start start 2023-07-14T13:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.260+0000 7f41109ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0ffb30 0x7f410c0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.260+0000 7f41109ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c1004e0 0x7f410c072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.260+0000 7f41109ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f410c105b60 0x7f410c1a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.260+0000 7f41109ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c1a41c0 con 0x7f410c0ffb30 2023-07-14T13:34:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.260+0000 7f41109ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c1a4300 con 0x7f410c105b60 2023-07-14T13:34:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.260+0000 7f41109ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c1a4470 con 0x7f410c1004e0 2023-07-14T13:34:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.261+0000 7f410a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0ffb30 0x7f410c0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.261+0000 7f410a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0ffb30 0x7f410c0729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51746/0 (socket says 172.21.15.17:51746) 2023-07-14T13:34:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.261+0000 7f410a59c700 1 -- 172.21.15.17:0/2423288789 learned_addr learned my addr 172.21.15.17:0/2423288789 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.261+0000 7f4103fff700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c1004e0 0x7f410c072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.261+0000 7f410ad9d700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f410c105b60 0x7f410c1a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.261+0000 7f410a59c700 1 -- 172.21.15.17:0/2423288789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c1004e0 msgr2=0x7f410c072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.261+0000 7f410a59c700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c1004e0 0x7f410c072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.261+0000 7f410a59c700 1 -- 172.21.15.17:0/2423288789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f410c105b60 msgr2=0x7f410c1a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.261+0000 7f410a59c700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f410c105b60 0x7f410c1a3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.261+0000 7f410a59c700 1 -- 172.21.15.17:0/2423288789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40095f0 con 0x7f410c0ffb30 2023-07-14T13:34:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.261+0000 7f410a59c700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0ffb30 0x7f410c0729f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00d980 tx=0x7f40fc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.262+0000 7f41037fe700 1 -- 172.21.15.17:0/2423288789 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc004220 con 0x7f410c0ffb30 2023-07-14T13:34:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.262+0000 7f41037fe700 1 -- 172.21.15.17:0/2423288789 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40fc007640 con 0x7f410c0ffb30 2023-07-14T13:34:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.262+0000 7f41109ff700 1 -- 172.21.15.17:0/2423288789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c1a4750 con 0x7f410c0ffb30 2023-07-14T13:34:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.262+0000 7f41037fe700 1 -- 172.21.15.17:0/2423288789 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0055e0 con 0x7f410c0ffb30 2023-07-14T13:34:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.262+0000 7f41109ff700 1 -- 172.21.15.17:0/2423288789 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c1a4cb0 con 0x7f410c0ffb30 2023-07-14T13:34:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.267+0000 7f41037fe700 1 -- 172.21.15.17:0/2423288789 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f40fc004750 con 0x7f410c0ffb30 2023-07-14T13:34:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.267+0000 7f41243e8b80 1 Processor -- start 2023-07-14T13:34:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.268+0000 7f41243e8b80 1 -- start start 2023-07-14T13:34:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.268+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd5e86b0 0x563ccd791d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.268+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd78c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.268+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd78c580 0x563ccd78c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.268+0000 7f41243e8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd691c50 con 0x563ccd7922d0 2023-07-14T13:34:12.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.268+0000 7f41243e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd6e49e0 con 0x563ccd5e86b0 2023-07-14T13:34:12.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.268+0000 7f41243e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd6dde70 con 0x563ccd78c580 2023-07-14T13:34:12.264 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.268+0000 7f410a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd78c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.268+0000 7f410ad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd5e86b0 0x563ccd791d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.268+0000 7f410a59c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd78c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51748/0 (socket says 172.21.15.17:51748) 2023-07-14T13:34:12.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.268+0000 7f410a59c700 1 -- 172.21.15.17:0/3086028293 learned_addr learned my addr 172.21.15.17:0/3086028293 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:12.265 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f4103fff700 1 --2- 172.21.15.17:0/3086028293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd78c580 0x563ccd78c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.266 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f410ad9d700 1 -- 172.21.15.17:0/3086028293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd78c580 msgr2=0x563ccd78c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f410ad9d700 1 --2- 172.21.15.17:0/3086028293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd78c580 0x563ccd78c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f410ad9d700 1 -- 172.21.15.17:0/3086028293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 msgr2=0x563ccd78c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f410ad9d700 1 --2- 172.21.15.17:0/3086028293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd78c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f410ad9d700 1 -- 172.21.15.17:0/3086028293 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ccd50bd80 con 0x563ccd5e86b0 2023-07-14T13:34:12.267 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f41037fe700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40f80a1340 0x7f40f80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f410a59c700 1 --2- 172.21.15.17:0/3086028293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd78c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:34:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f41037fe700 1 -- 172.21.15.17:0/2423288789 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f40fc0ccaf0 con 0x7f410c0ffb30 2023-07-14T13:34:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f410ad9d700 1 --2- 172.21.15.17:0/3086028293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd5e86b0 0x563ccd791d90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4104009cd0 tx=0x7f4104007500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da187a6a91bb527c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f410a59c700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40f80a1340 0x7f40f80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.269+0000 7f4100ff9700 1 -- 172.21.15.17:0/3086028293 <== mon.2 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104018070 con 0x563ccd5e86b0 2023-07-14T13:34:12.268 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.270+0000 7f4100ff9700 1 -- 172.21.15.17:0/3086028293 <== mon.2 v2:172.21.15.131:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f410400f050 con 0x563ccd5e86b0 2023-07-14T13:34:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.270+0000 7f4100ff9700 1 -- 172.21.15.17:0/3086028293 <== mon.2 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104005830 con 0x563ccd5e86b0 2023-07-14T13:34:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.270+0000 7f41243e8b80 1 -- 172.21.15.17:0/3086028293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd5e86b0 msgr2=0x563ccd791d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.270+0000 7f410a59c700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40f80a1340 0x7f40f80a37f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f40fc000c00 tx=0x7f40fc0d0560 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.270+0000 7f41243e8b80 1 --2- 172.21.15.17:0/3086028293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd5e86b0 0x563ccd791d90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4104009cd0 tx=0x7f4104007500 comp rx=0 tx=0).stop 2023-07-14T13:34:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.270+0000 7f41243e8b80 1 -- 172.21.15.17:0/3086028293 shutdown_connections 2023-07-14T13:34:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.270+0000 7f41243e8b80 1 --2- 172.21.15.17:0/3086028293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd78c580 0x563ccd78c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.270+0000 7f41243e8b80 1 --2- 172.21.15.17:0/3086028293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd5e86b0 0x563ccd791d90 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.269 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.270+0000 7f41243e8b80 1 --2- 172.21.15.17:0/3086028293 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd78c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.270+0000 7f41243e8b80 1 -- 172.21.15.17:0/3086028293 >> 172.21.15.17:0/3086028293 conn(0x563ccd781be0 msgr2=0x563ccd786f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.270+0000 7f41243e8b80 1 -- 172.21.15.17:0/3086028293 shutdown_connections 2023-07-14T13:34:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.271+0000 7f41243e8b80 1 -- 172.21.15.17:0/3086028293 wait complete. 2023-07-14T13:34:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.271+0000 7f41243e8b80 1 -- start start 2023-07-14T13:34:12.270 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.271+0000 7f41243e8b80 1 Processor -- start 2023-07-14T13:34:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.272+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 0x563ccd798620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.272+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 0x563ccd795910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.272+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd796000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.272+0000 7f41243e8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd67da60 con 0x563ccd7922d0 2023-07-14T13:34:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.272+0000 7f41243e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd67d760 con 0x563ccd78c580 2023-07-14T13:34:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.272+0000 7f41243e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd5618c0 con 0x563ccd5e86b0 2023-07-14T13:34:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.272+0000 7f41243e8b80 10 client.0 _ll_register_callbacks cb 0x563ccd67b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:34:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f410ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd796000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f410ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd796000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51752/0 (socket says 172.21.15.17:51752) 2023-07-14T13:34:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f410ad9d700 1 -- 172.21.15.17:0/170081104 learned_addr learned my addr 172.21.15.17:0/170081104 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f410ad9d700 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 0x563ccd798620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f4103fff700 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 0x563ccd795910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f410ad9d700 1 -- 172.21.15.17:0/170081104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 msgr2=0x563ccd798620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f410ad9d700 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 0x563ccd798620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f410ad9d700 1 -- 172.21.15.17:0/170081104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 msgr2=0x563ccd795910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f410ad9d700 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 0x563ccd795910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f410ad9d700 1 -- 172.21.15.17:0/170081104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c1a4cb0 con 0x563ccd7922d0 2023-07-14T13:34:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f4103fff700 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 0x563ccd795910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:34:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f410ad9d700 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd796000 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f4104009470 tx=0x7f4104004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53dfd0ef469e505d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.273+0000 7f40f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:34:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f40f1ffb700 1 -- 172.21.15.17:0/170081104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104018070 con 0x563ccd7922d0 2023-07-14T13:34:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f40f1ffb700 1 -- 172.21.15.17:0/170081104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f4104028060 con 0x563ccd7922d0 2023-07-14T13:34:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f41243e8b80 1 -- 172.21.15.17:0/170081104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ccd637490 con 0x563ccd7922d0 2023-07-14T13:34:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f40f1ffb700 1 -- 172.21.15.17:0/170081104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41040058e0 con 0x563ccd7922d0 2023-07-14T13:34:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f41243e8b80 10 client.19923 fetch_fsmap learned FSMap version 70 2023-07-14T13:34:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f41243e8b80 1 -- 172.21.15.17:0/170081104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x7f4104009900 con 0x563ccd7922d0 2023-07-14T13:34:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f40f1ffb700 1 -- 172.21.15.17:0/170081104 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4104030020 con 0x563ccd7922d0 2023-07-14T13:34:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f40f1ffb700 1 -- 172.21.15.17:0/170081104 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 70) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4104014cf0 con 0x563ccd7922d0 2023-07-14T13:34:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f41243e8b80 10 client.19923 fetch_fsmap finished waiting for FSMap version 70 2023-07-14T13:34:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f41243e8b80 10 client.19923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:34:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f41243e8b80 20 client.19923 populate_metadata read hostname 'smithi017' 2023-07-14T13:34:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f41243e8b80 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563ccd7a5b90 0x563ccd7a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f41243e8b80 4 client.19923 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:34:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.274+0000 7f41243e8b80 1 -- 172.21.15.17:0/170081104 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ccd6d6e50 con 0x563ccd7a5b90 2023-07-14T13:34:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.275+0000 7f4103fff700 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563ccd7a5b90 0x563ccd7a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.276+0000 7f4103fff700 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563ccd7a5b90 0x563ccd7a7fa0 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25fdd6db6052d692 server_cookie=c0ef4d0eb99e0815 in_seq=0 out_seq=0 2023-07-14T13:34:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.276+0000 7f40f1ffb700 10 client.19923 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:34:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.276+0000 7f40f1ffb700 1 -- 172.21.15.17:0/170081104 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563ccd6d6e50 con 0x563ccd7a5b90 2023-07-14T13:34:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.276+0000 7f40f1ffb700 10 client.19923 handle_command_reply: tid=0 2023-07-14T13:34:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 1 client.19923 shutdown 2023-07-14T13:34:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 1 -- 172.21.15.17:0/170081104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 msgr2=0x563ccd796000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd796000 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f4104009470 tx=0x7f4104004d00 comp rx=0 tx=0).stop 2023-07-14T13:34:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 1 -- 172.21.15.17:0/170081104 shutdown_connections 2023-07-14T13:34:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563ccd7a5b90 0x563ccd7a7fa0 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd796000 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 0x563ccd798620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 1 --2- 172.21.15.17:0/170081104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 0x563ccd795910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f40f1ffb700 0 client.19923 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:34:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 1 -- 172.21.15.17:0/170081104 >> 172.21.15.17:0/170081104 conn(0x563ccd781be0 msgr2=0x563ccd785c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 1 -- 172.21.15.17:0/170081104 shutdown_connections 2023-07-14T13:34:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 1 -- 172.21.15.17:0/170081104 wait complete. 2023-07-14T13:34:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.277+0000 7f41243e8b80 20 client.19923 trim_cache size 0 max 16384 2023-07-14T13:34:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.293+0000 7f41243e8b80 1 Processor -- start 2023-07-14T13:34:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.293+0000 7f41243e8b80 1 -- start start 2023-07-14T13:34:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.293+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 0x563ccd7911c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.293+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd78c580 0x563ccd786c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd7922d0 0x563ccd7981c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f41243e8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd7926a0 con 0x563ccd78c580 2023-07-14T13:34:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f41243e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd783d00 con 0x563ccd7922d0 2023-07-14T13:34:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f41243e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd796390 con 0x563ccd5e86b0 2023-07-14T13:34:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f4103fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd78c580 0x563ccd786c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f4103fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd78c580 0x563ccd786c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51764/0 (socket says 172.21.15.17:51764) 2023-07-14T13:34:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f4103fff700 1 -- 172.21.15.17:0/1784889063 learned_addr learned my addr 172.21.15.17:0/1784889063 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f4103fff700 1 -- 172.21.15.17:0/1784889063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 msgr2=0x563ccd7911c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f4103fff700 1 --2- 172.21.15.17:0/1784889063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 0x563ccd7911c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f4103fff700 1 -- 172.21.15.17:0/1784889063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd7922d0 msgr2=0x563ccd7981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f4103fff700 1 --2- 172.21.15.17:0/1784889063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd7922d0 0x563ccd7981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f4103fff700 1 -- 172.21.15.17:0/1784889063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ccd4f4c00 con 0x563ccd78c580 2023-07-14T13:34:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.294+0000 7f4103fff700 1 --2- 172.21.15.17:0/1784889063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd78c580 0x563ccd786c60 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009990 tx=0x7f40f4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c0c3b08bdead38 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.295+0000 7f41017fa700 1 -- 172.21.15.17:0/1784889063 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f401d070 con 0x563ccd78c580 2023-07-14T13:34:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.295+0000 7f41017fa700 1 -- 172.21.15.17:0/1784889063 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40f401e040 con 0x563ccd78c580 2023-07-14T13:34:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.295+0000 7f41017fa700 1 -- 172.21.15.17:0/1784889063 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f400b9d0 con 0x563ccd78c580 2023-07-14T13:34:12.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.295+0000 7f41243e8b80 1 -- 172.21.15.17:0/1784889063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd78c580 msgr2=0x563ccd786c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:12.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.295+0000 7f41243e8b80 1 --2- 172.21.15.17:0/1784889063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd78c580 0x563ccd786c60 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009990 tx=0x7f40f4009310 comp rx=0 tx=0).stop 2023-07-14T13:34:12.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.295+0000 7f41243e8b80 1 -- 172.21.15.17:0/1784889063 shutdown_connections 2023-07-14T13:34:12.295 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.295+0000 7f41243e8b80 1 --2- 172.21.15.17:0/1784889063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd7922d0 0x563ccd7981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.295+0000 7f41243e8b80 1 --2- 172.21.15.17:0/1784889063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 0x563ccd7911c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.295+0000 7f41243e8b80 1 --2- 172.21.15.17:0/1784889063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd78c580 0x563ccd786c60 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.295+0000 7f41243e8b80 1 -- 172.21.15.17:0/1784889063 >> 172.21.15.17:0/1784889063 conn(0x563ccd781be0 msgr2=0x563ccd790ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:12.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.295+0000 7f41243e8b80 1 -- 172.21.15.17:0/1784889063 shutdown_connections 2023-07-14T13:34:12.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.296+0000 7f41243e8b80 1 -- 172.21.15.17:0/1784889063 wait complete. 2023-07-14T13:34:12.296 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.296+0000 7f41243e8b80 1 -- start start 2023-07-14T13:34:12.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.296+0000 7f41243e8b80 1 Processor -- start 2023-07-14T13:34:12.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 0x563ccd79ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 0x563ccd79b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f41243e8b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd7f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f41243e8b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd7f8f50 con 0x563ccd7922d0 2023-07-14T13:34:12.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f41243e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd7f9090 con 0x563ccd78c580 2023-07-14T13:34:12.297 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f41243e8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ccd7f91d0 con 0x563ccd5e86b0 2023-07-14T13:34:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f41243e8b80 10 client.0 _ll_register_callbacks cb 0x7f4104005000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:34:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f410ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd7f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f4103fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 0x563ccd79b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f410ad9d700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd7f8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51770/0 (socket says 172.21.15.17:51770) 2023-07-14T13:34:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f410ad9d700 1 -- 172.21.15.17:0/4191955623 learned_addr learned my addr 172.21.15.17:0/4191955623 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f410ad9d700 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 0x563ccd79ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f410ad9d700 1 -- 172.21.15.17:0/4191955623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 msgr2=0x563ccd79ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:12.298 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f410ad9d700 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 0x563ccd79ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f410ad9d700 1 -- 172.21.15.17:0/4191955623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 msgr2=0x563ccd79b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f410ad9d700 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 0x563ccd79b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f410ad9d700 1 -- 172.21.15.17:0/4191955623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c10d220 con 0x563ccd7922d0 2023-07-14T13:34:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.297+0000 7f4103fff700 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 0x563ccd79b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T13:34:12.299 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.298+0000 7f410ad9d700 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd7f8a10 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4104004e40 tx=0x7f410401e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5eefd0662bd542 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.298+0000 7f40f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:34:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.298+0000 7f40f1ffb700 1 -- 172.21.15.17:0/4191955623 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104018030 con 0x563ccd7922d0 2023-07-14T13:34:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.298+0000 7f41243e8b80 1 -- 172.21.15.17:0/4191955623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f410400f050 con 0x563ccd7922d0 2023-07-14T13:34:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.298+0000 7f40f1ffb700 1 -- 172.21.15.17:0/4191955623 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f4104028070 con 0x563ccd7922d0 2023-07-14T13:34:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.298+0000 7f40f1ffb700 1 -- 172.21.15.17:0/4191955623 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41040060b0 con 0x563ccd7922d0 2023-07-14T13:34:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.298+0000 7f41243e8b80 10 client.19929 fetch_fsmap learned FSMap version 70 2023-07-14T13:34:12.300 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.298+0000 7f41243e8b80 1 -- 172.21.15.17:0/4191955623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x563ccd5321f0 con 0x563ccd7922d0 2023-07-14T13:34:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.298+0000 7f40f1ffb700 1 -- 172.21.15.17:0/4191955623 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f410400f050 con 0x563ccd7922d0 2023-07-14T13:34:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.299+0000 7f40f1ffb700 1 -- 172.21.15.17:0/4191955623 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 70) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4104033070 con 0x563ccd7922d0 2023-07-14T13:34:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.299+0000 7f41243e8b80 10 client.19929 fetch_fsmap finished waiting for FSMap version 70 2023-07-14T13:34:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.299+0000 7f41243e8b80 10 client.19929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:34:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.299+0000 7f41243e8b80 20 client.19929 populate_metadata read hostname 'smithi017' 2023-07-14T13:34:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.299+0000 7f41243e8b80 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563ccd7fa4f0 0x563ccd7fc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.299+0000 7f41243e8b80 4 client.19929 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:34:12.301 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.299+0000 7f41243e8b80 1 -- 172.21.15.17:0/4191955623 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563ccd698ff0 con 0x563ccd7fa4f0 2023-07-14T13:34:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.299+0000 7f4103fff700 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563ccd7fa4f0 0x563ccd7fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.300+0000 7f4103fff700 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563ccd7fa4f0 0x563ccd7fc900 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9efa99e6316f5d3 server_cookie=4d5a43fd8ce3b5b8 in_seq=0 out_seq=0 2023-07-14T13:34:12.302 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.300+0000 7f40f1ffb700 10 client.19929 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:34:12.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:11 smithi017 ceph-mon[95536]: pgmap v1093: 97 pgs: 16 active+clean+snaptrim, 28 active+clean+snaptrim_wait, 53 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 2.7 MiB/s wr, 324 op/s 2023-07-14T13:34:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f40f1ffb700 1 -- 172.21.15.17:0/4191955623 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563ccd698ff0 con 0x563ccd7fa4f0 2023-07-14T13:34:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f40f1ffb700 10 client.19929 handle_command_reply: tid=0 2023-07-14T13:34:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f41243e8b80 1 client.19929 shutdown 2023-07-14T13:34:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f41243e8b80 1 -- 172.21.15.17:0/4191955623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 msgr2=0x563ccd7f8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f41243e8b80 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd7f8a10 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4104004e40 tx=0x7f410401e530 comp rx=0 tx=0).stop 2023-07-14T13:34:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f41243e8b80 1 -- 172.21.15.17:0/4191955623 shutdown_connections 2023-07-14T13:34:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f41243e8b80 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x563ccd7fa4f0 0x563ccd7fc900 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f41243e8b80 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563ccd7922d0 0x563ccd7f8a10 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f41243e8b80 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ccd5e86b0 0x563ccd79ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f41243e8b80 1 --2- 172.21.15.17:0/4191955623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563ccd78c580 0x563ccd79b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f40f1ffb700 0 client.19929 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:34:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.335+0000 7f41243e8b80 1 -- 172.21.15.17:0/4191955623 >> 172.21.15.17:0/4191955623 conn(0x563ccd781be0 msgr2=0x563ccd792900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:12.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41243e8b80 1 -- 172.21.15.17:0/4191955623 shutdown_connections 2023-07-14T13:34:12.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41243e8b80 1 -- 172.21.15.17:0/4191955623 wait complete. 2023-07-14T13:34:12.333 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41243e8b80 20 client.19929 trim_cache size 0 max 16384 2023-07-14T13:34:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:34:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:34:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:34:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:34:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41109ff700 1 -- 172.21.15.17:0/2423288789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40f80a1340 msgr2=0x7f40f80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41109ff700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40f80a1340 0x7f40f80a37f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f40fc000c00 tx=0x7f40fc0d0560 comp rx=0 tx=0).stop 2023-07-14T13:34:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41109ff700 1 -- 172.21.15.17:0/2423288789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0ffb30 msgr2=0x7f410c0729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41109ff700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0ffb30 0x7f410c0729f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00d980 tx=0x7f40fc00dc90 comp rx=0 tx=0).stop 2023-07-14T13:34:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41109ff700 1 -- 172.21.15.17:0/2423288789 shutdown_connections 2023-07-14T13:34:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41109ff700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f40f80a1340 0x7f40f80a37f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41109ff700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f410c105b60 0x7f410c1a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41109ff700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f410c0ffb30 0x7f410c0729f0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.336+0000 7f41109ff700 1 --2- 172.21.15.17:0/2423288789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f410c1004e0 0x7f410c072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.337+0000 7f41109ff700 1 -- 172.21.15.17:0/2423288789 >> 172.21.15.17:0/2423288789 conn(0x7f410c0fb5f0 msgr2=0x7f410c103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.337+0000 7f41109ff700 1 -- 172.21.15.17:0/2423288789 shutdown_connections 2023-07-14T13:34:12.337 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:12.337+0000 7f41109ff700 1 -- 172.21.15.17:0/2423288789 wait complete. 2023-07-14T13:34:14.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:13 smithi135 ceph-mon[97338]: pgmap v1094: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 1.6 MiB/s wr, 207 op/s 2023-07-14T13:34:14.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:13 smithi131 ceph-mon[96953]: pgmap v1094: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 1.6 MiB/s wr, 207 op/s 2023-07-14T13:34:14.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:13 smithi017 ceph-mon[95536]: pgmap v1094: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 1.6 MiB/s wr, 207 op/s 2023-07-14T13:34:16.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:15 smithi135 ceph-mon[97338]: pgmap v1095: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 1.5 MiB/s wr, 194 op/s 2023-07-14T13:34:16.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:15 smithi131 ceph-mon[96953]: pgmap v1095: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 1.5 MiB/s wr, 194 op/s 2023-07-14T13:34:16.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:15 smithi017 ceph-mon[95536]: pgmap v1095: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 1.5 MiB/s wr, 194 op/s 2023-07-14T13:34:17.839 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:17 smithi131 ceph-mon[96953]: pgmap v1096: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 1.4 MiB/s wr, 192 op/s 2023-07-14T13:34:18.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:17 smithi135 ceph-mon[97338]: pgmap v1096: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 1.4 MiB/s wr, 192 op/s 2023-07-14T13:34:18.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:17 smithi135 ceph-mon[97338]: osdmap e147: 12 total, 12 up, 12 in 2023-07-14T13:34:18.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:17 smithi017 ceph-mon[95536]: pgmap v1096: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 1.4 MiB/s wr, 192 op/s 2023-07-14T13:34:18.322 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:17 smithi017 ceph-mon[95536]: osdmap e147: 12 total, 12 up, 12 in 2023-07-14T13:34:20.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:17 smithi131 ceph-mon[96953]: osdmap e147: 12 total, 12 up, 12 in 2023-07-14T13:34:20.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:19 smithi131 ceph-mon[96953]: pgmap v1098: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 256 KiB/s wr, 35 op/s 2023-07-14T13:34:20.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:19 smithi017 ceph-mon[95536]: pgmap v1098: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 256 KiB/s wr, 35 op/s 2023-07-14T13:34:22.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:19 smithi135 ceph-mon[97338]: pgmap v1098: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 256 KiB/s wr, 35 op/s 2023-07-14T13:34:22.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:21 smithi135 ceph-mon[97338]: pgmap v1099: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 277 KiB/s wr, 37 op/s 2023-07-14T13:34:22.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:21 smithi131 ceph-mon[96953]: pgmap v1099: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 277 KiB/s wr, 37 op/s 2023-07-14T13:34:22.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:21 smithi017 ceph-mon[95536]: pgmap v1099: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 277 KiB/s wr, 37 op/s 2023-07-14T13:34:24.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:23 smithi135 ceph-mon[97338]: pgmap v1100: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 229 KiB/s wr, 31 op/s 2023-07-14T13:34:24.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:23 smithi131 ceph-mon[96953]: pgmap v1100: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 229 KiB/s wr, 31 op/s 2023-07-14T13:34:24.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:23 smithi017 ceph-mon[95536]: pgmap v1100: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 229 KiB/s wr, 31 op/s 2023-07-14T13:34:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.498+0000 7fd84d7ff700 1 -- 172.21.15.17:0/2837312147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8480ffb30 msgr2=0x7fd8480fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.498+0000 7fd84d7ff700 1 --2- 172.21.15.17:0/2837312147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8480ffb30 0x7fd8480fffa0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd830009990 tx=0x7fd830009ca0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.498+0000 7fd84d7ff700 1 -- 172.21.15.17:0/2837312147 shutdown_connections 2023-07-14T13:34:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.498+0000 7fd84d7ff700 1 --2- 172.21.15.17:0/2837312147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8481004e0 0x7fd84810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.498+0000 7fd84d7ff700 1 --2- 172.21.15.17:0/2837312147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd848105b60 0x7fd848105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.498+0000 7fd84d7ff700 1 --2- 172.21.15.17:0/2837312147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8480ffb30 0x7fd8480fffa0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.498+0000 7fd84d7ff700 1 -- 172.21.15.17:0/2837312147 >> 172.21.15.17:0/2837312147 conn(0x7fd8480fb5f0 msgr2=0x7fd8480fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.498+0000 7fd84d7ff700 1 -- 172.21.15.17:0/2837312147 shutdown_connections 2023-07-14T13:34:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.498+0000 7fd84d7ff700 1 -- 172.21.15.17:0/2837312147 wait complete. 2023-07-14T13:34:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.499+0000 7fd84d7ff700 1 Processor -- start 2023-07-14T13:34:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.499+0000 7fd84d7ff700 1 -- start start 2023-07-14T13:34:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd84d7ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8480ffb30 0x7fd8480729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd84d7ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8481004e0 0x7fd848072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd84d7ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848105b60 0x7fd8481a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd84d7ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8481a41c0 con 0x7fd8480ffb30 2023-07-14T13:34:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd84d7ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8481a4300 con 0x7fd848105b60 2023-07-14T13:34:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd84d7ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8481a4470 con 0x7fd8481004e0 2023-07-14T13:34:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd846ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8480ffb30 0x7fd8480729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd846ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8480ffb30 0x7fd8480729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53080/0 (socket says 172.21.15.17:53080) 2023-07-14T13:34:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd846ffd700 1 -- 172.21.15.17:0/1433953533 learned_addr learned my addr 172.21.15.17:0/1433953533 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd83ffff700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8481004e0 0x7fd848072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd846ffd700 1 -- 172.21.15.17:0/1433953533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8481004e0 msgr2=0x7fd848072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd846ffd700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8481004e0 0x7fd848072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd8477fe700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848105b60 0x7fd8481a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd846ffd700 1 -- 172.21.15.17:0/1433953533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848105b60 msgr2=0x7fd8481a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd846ffd700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848105b60 0x7fd8481a3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd846ffd700 1 -- 172.21.15.17:0/1433953533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8300095f0 con 0x7fd8480ffb30 2023-07-14T13:34:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.500+0000 7fd8477fe700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848105b60 0x7fd8481a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:34:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.501+0000 7fd846ffd700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8480ffb30 0x7fd8480729f0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd83800d950 tx=0x7fd83800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.501+0000 7fd844ff9700 1 -- 172.21.15.17:0/1433953533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838009b40 con 0x7fd8480ffb30 2023-07-14T13:34:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.501+0000 7fd84d7ff700 1 -- 172.21.15.17:0/1433953533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8481a4750 con 0x7fd8480ffb30 2023-07-14T13:34:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.501+0000 7fd844ff9700 1 -- 172.21.15.17:0/1433953533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd838009ca0 con 0x7fd8480ffb30 2023-07-14T13:34:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.501+0000 7fd844ff9700 1 -- 172.21.15.17:0/1433953533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800f620 con 0x7fd8480ffb30 2023-07-14T13:34:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.501+0000 7fd84d7ff700 1 -- 172.21.15.17:0/1433953533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8481a4cb0 con 0x7fd8480ffb30 2023-07-14T13:34:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.505+0000 7fd844ff9700 1 -- 172.21.15.17:0/1433953533 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fd838010460 con 0x7fd8480ffb30 2023-07-14T13:34:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.506+0000 7fd861047b80 1 Processor -- start 2023-07-14T13:34:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd861047b80 1 -- start start 2023-07-14T13:34:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd844ff9700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd8340a12c0 0x7fd8340a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd861047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e334922d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd861047b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e33491d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd861047b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 0x55e33491d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd861047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e334822c50 con 0x55e3347796b0 2023-07-14T13:34:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd861047b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3348759e0 con 0x55e3349232d0 2023-07-14T13:34:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd844ff9700 1 -- 172.21.15.17:0/1433953533 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd8380cd110 con 0x7fd8480ffb30 2023-07-14T13:34:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd861047b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33486ee70 con 0x55e33491d580 2023-07-14T13:34:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd8477fe700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd8340a12c0 0x7fd8340a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd846ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e334922d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd846ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e334922d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53096/0 (socket says 172.21.15.17:53096) 2023-07-14T13:34:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.507+0000 7fd846ffd700 1 -- 172.21.15.17:0/3590560474 learned_addr learned my addr 172.21.15.17:0/3590560474 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.508+0000 7fd83ffff700 1 --2- 172.21.15.17:0/3590560474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e33491d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.508+0000 7fd846ffd700 1 -- 172.21.15.17:0/3590560474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 msgr2=0x55e33491d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.508+0000 7fd846ffd700 1 --2- 172.21.15.17:0/3590560474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 0x55e33491d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.508+0000 7fd846ffd700 1 -- 172.21.15.17:0/3590560474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 msgr2=0x55e33491d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.508+0000 7fd846ffd700 1 --2- 172.21.15.17:0/3590560474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e33491d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.508+0000 7fd846ffd700 1 -- 172.21.15.17:0/3590560474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e33469cd80 con 0x55e3347796b0 2023-07-14T13:34:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.508+0000 7fd8477fe700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd8340a12c0 0x7fd8340a3770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd8400060b0 tx=0x7fd840009920 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.508+0000 7fd846ffd700 1 --2- 172.21.15.17:0/3590560474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e334922d90 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fd8380a20c0 tx=0x7fd8380965b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835505a4f87962f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.508+0000 7fd83d7fa700 1 -- 172.21.15.17:0/3590560474 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838099b00 con 0x55e3347796b0 2023-07-14T13:34:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.508+0000 7fd83d7fa700 1 -- 172.21.15.17:0/3590560474 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd83809a1a0 con 0x55e3347796b0 2023-07-14T13:34:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.508+0000 7fd83d7fa700 1 -- 172.21.15.17:0/3590560474 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8380caaa0 con 0x55e3347796b0 2023-07-14T13:34:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.509+0000 7fd861047b80 1 -- 172.21.15.17:0/3590560474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 msgr2=0x55e334922d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.509+0000 7fd861047b80 1 --2- 172.21.15.17:0/3590560474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e334922d90 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fd8380a20c0 tx=0x7fd8380965b0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.509+0000 7fd861047b80 1 -- 172.21.15.17:0/3590560474 shutdown_connections 2023-07-14T13:34:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.509+0000 7fd861047b80 1 --2- 172.21.15.17:0/3590560474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 0x55e33491d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.509+0000 7fd861047b80 1 --2- 172.21.15.17:0/3590560474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e334922d90 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.509+0000 7fd861047b80 1 --2- 172.21.15.17:0/3590560474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e33491d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.509+0000 7fd861047b80 1 -- 172.21.15.17:0/3590560474 >> 172.21.15.17:0/3590560474 conn(0x55e334912be0 msgr2=0x55e334917f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.509+0000 7fd861047b80 1 -- 172.21.15.17:0/3590560474 shutdown_connections 2023-07-14T13:34:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.509+0000 7fd861047b80 1 -- 172.21.15.17:0/3590560474 wait complete. 2023-07-14T13:34:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.510+0000 7fd861047b80 1 -- start start 2023-07-14T13:34:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.510+0000 7fd861047b80 1 Processor -- start 2023-07-14T13:34:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd861047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e3349295e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd861047b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 0x55e334926860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd861047b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e334926fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd861047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33480ea60 con 0x55e3347796b0 2023-07-14T13:34:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd861047b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33480e760 con 0x55e3349232d0 2023-07-14T13:34:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd861047b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3346f28c0 con 0x55e33491d580 2023-07-14T13:34:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd861047b80 10 client.0 _ll_register_callbacks cb 0x55e33480c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:34:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd846ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e3349295e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd846ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e3349295e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53110/0 (socket says 172.21.15.17:53110) 2023-07-14T13:34:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd8477fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e334926fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd846ffd700 1 -- 172.21.15.17:0/2757131273 learned_addr learned my addr 172.21.15.17:0/2757131273 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd83ffff700 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 0x55e334926860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd846ffd700 1 -- 172.21.15.17:0/2757131273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 msgr2=0x55e334926860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd846ffd700 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 0x55e334926860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd846ffd700 1 -- 172.21.15.17:0/2757131273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 msgr2=0x55e334926fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd846ffd700 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e334926fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.511+0000 7fd846ffd700 1 -- 172.21.15.17:0/2757131273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8481a4cb0 con 0x55e3347796b0 2023-07-14T13:34:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.512+0000 7fd846ffd700 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e3349295e0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd8380966a0 tx=0x7fd8380ca830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7129d6df20753c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.512+0000 7fd82e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:34:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.512+0000 7fd82e7fc700 1 -- 172.21.15.17:0/2757131273 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8380adea0 con 0x55e3347796b0 2023-07-14T13:34:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.512+0000 7fd82e7fc700 1 -- 172.21.15.17:0/2757131273 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd8380a25f0 con 0x55e3347796b0 2023-07-14T13:34:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.512+0000 7fd861047b80 1 -- 172.21.15.17:0/2757131273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3347c8490 con 0x55e3347796b0 2023-07-14T13:34:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.512+0000 7fd82e7fc700 1 -- 172.21.15.17:0/2757131273 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8380502f0 con 0x55e3347796b0 2023-07-14T13:34:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.512+0000 7fd861047b80 10 client.19941 fetch_fsmap learned FSMap version 70 2023-07-14T13:34:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.512+0000 7fd861047b80 1 -- 172.21.15.17:0/2757131273 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55e334685c00 con 0x55e3347796b0 2023-07-14T13:34:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.512+0000 7fd82e7fc700 1 -- 172.21.15.17:0/2757131273 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd8380b6080 con 0x55e3347796b0 2023-07-14T13:34:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.512+0000 7fd82e7fc700 1 -- 172.21.15.17:0/2757131273 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 70) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd838099690 con 0x55e3347796b0 2023-07-14T13:34:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.513+0000 7fd861047b80 10 client.19941 fetch_fsmap finished waiting for FSMap version 70 2023-07-14T13:34:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.513+0000 7fd861047b80 10 client.19941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:34:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.513+0000 7fd861047b80 20 client.19941 populate_metadata read hostname 'smithi017' 2023-07-14T13:34:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.513+0000 7fd861047b80 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e334936740 0x55e334938b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.513+0000 7fd861047b80 4 client.19941 mds_command: new command op to 24593 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T13:34:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.513+0000 7fd861047b80 1 -- 172.21.15.17:0/2757131273 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e334867e50 con 0x55e334936740 2023-07-14T13:34:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.513+0000 7fd83ffff700 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e334936740 0x55e334938b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.514+0000 7fd83ffff700 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e334936740 0x55e334938b50 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47cbea2219c4715 server_cookie=9d4a80101713e328 in_seq=0 out_seq=0 2023-07-14T13:34:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.514+0000 7fd82e7fc700 10 client.19941 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:34:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd82e7fc700 1 -- 172.21.15.17:0/2757131273 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e334867e50 con 0x55e334936740 2023-07-14T13:34:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd82e7fc700 10 client.19941 handle_command_reply: tid=0 2023-07-14T13:34:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 1 client.19941 shutdown 2023-07-14T13:34:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 1 -- 172.21.15.17:0/2757131273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 msgr2=0x55e3349295e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e3349295e0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd8380966a0 tx=0x7fd8380ca830 comp rx=0 tx=0).stop 2023-07-14T13:34:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 1 -- 172.21.15.17:0/2757131273 shutdown_connections 2023-07-14T13:34:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e334936740 0x55e334938b50 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e334926fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.518 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3347796b0 0x55e3349295e0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd82e7fc700 0 client.19941 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:34:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 1 --2- 172.21.15.17:0/2757131273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 0x55e334926860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 1 -- 172.21.15.17:0/2757131273 >> 172.21.15.17:0/2757131273 conn(0x55e334912be0 msgr2=0x55e3349174e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 1 -- 172.21.15.17:0/2757131273 shutdown_connections 2023-07-14T13:34:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 1 -- 172.21.15.17:0/2757131273 wait complete. 2023-07-14T13:34:25.519 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.515+0000 7fd861047b80 20 client.19941 trim_cache size 0 max 16384 2023-07-14T13:34:25.525 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.531+0000 7fd861047b80 1 Processor -- start 2023-07-14T13:34:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.531+0000 7fd861047b80 1 -- start start 2023-07-14T13:34:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.531+0000 7fd861047b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3347796b0 0x55e33491d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.531+0000 7fd861047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33491d580 0x55e334926810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.531+0000 7fd861047b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e33492dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.531+0000 7fd861047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e334922a10 con 0x55e33491d580 2023-07-14T13:34:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.531+0000 7fd861047b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e334925f40 con 0x55e3349232d0 2023-07-14T13:34:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.531+0000 7fd861047b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3349236a0 con 0x55e3347796b0 2023-07-14T13:34:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd83ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33491d580 0x55e334926810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd83ffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33491d580 0x55e334926810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53112/0 (socket says 172.21.15.17:53112) 2023-07-14T13:34:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd83ffff700 1 -- 172.21.15.17:0/3237114256 learned_addr learned my addr 172.21.15.17:0/3237114256 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd8477fe700 1 --2- 172.21.15.17:0/3237114256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e33492dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd846ffd700 1 --2- 172.21.15.17:0/3237114256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3347796b0 0x55e33491d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd83ffff700 1 -- 172.21.15.17:0/3237114256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3347796b0 msgr2=0x55e33491d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd83ffff700 1 --2- 172.21.15.17:0/3237114256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3347796b0 0x55e33491d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd83ffff700 1 -- 172.21.15.17:0/3237114256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 msgr2=0x55e33492dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd83ffff700 1 --2- 172.21.15.17:0/3237114256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e33492dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd83ffff700 1 -- 172.21.15.17:0/3237114256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3346c31f0 con 0x55e33491d580 2023-07-14T13:34:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd846ffd700 1 --2- 172.21.15.17:0/3237114256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3347796b0 0x55e33491d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:34:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.532+0000 7fd83ffff700 1 --2- 172.21.15.17:0/3237114256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33491d580 0x55e334926810 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fd830005910 tx=0x7fd830005160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba95d7261c6bb136 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd83dffb700 1 -- 172.21.15.17:0/3237114256 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8300056e0 con 0x55e33491d580 2023-07-14T13:34:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd83dffb700 1 -- 172.21.15.17:0/3237114256 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd83002c070 con 0x55e33491d580 2023-07-14T13:34:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd83dffb700 1 -- 172.21.15.17:0/3237114256 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000b970 con 0x55e33491d580 2023-07-14T13:34:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd861047b80 1 -- 172.21.15.17:0/3237114256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33491d580 msgr2=0x55e334926810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd861047b80 1 --2- 172.21.15.17:0/3237114256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33491d580 0x55e334926810 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fd830005910 tx=0x7fd830005160 comp rx=0 tx=0).stop 2023-07-14T13:34:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd861047b80 1 -- 172.21.15.17:0/3237114256 shutdown_connections 2023-07-14T13:34:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd861047b80 1 --2- 172.21.15.17:0/3237114256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3349232d0 0x55e33492dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd861047b80 1 --2- 172.21.15.17:0/3237114256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3347796b0 0x55e33491d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd861047b80 1 --2- 172.21.15.17:0/3237114256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e33491d580 0x55e334926810 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd861047b80 1 -- 172.21.15.17:0/3237114256 >> 172.21.15.17:0/3237114256 conn(0x55e334912be0 msgr2=0x55e334926100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd861047b80 1 -- 172.21.15.17:0/3237114256 shutdown_connections 2023-07-14T13:34:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.533+0000 7fd861047b80 1 -- 172.21.15.17:0/3237114256 wait complete. 2023-07-14T13:34:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.534+0000 7fd861047b80 1 -- start start 2023-07-14T13:34:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.534+0000 7fd861047b80 1 Processor -- start 2023-07-14T13:34:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.534+0000 7fd861047b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3347796b0 0x55e33492dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.534+0000 7fd861047b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 0x55e33492beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd861047b80 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3349232d0 0x55e33492c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd861047b80 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33492ca90 con 0x55e3349232d0 2023-07-14T13:34:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd861047b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33492cc00 con 0x55e3347796b0 2023-07-14T13:34:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd861047b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e33498a5d0 con 0x55e33491d580 2023-07-14T13:34:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd861047b80 10 client.0 _ll_register_callbacks cb 0x7fd830009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T13:34:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd8477fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3349232d0 0x55e33492c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd8477fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3349232d0 0x55e33492c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53118/0 (socket says 172.21.15.17:53118) 2023-07-14T13:34:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd8477fe700 1 -- 172.21.15.17:0/1784477417 learned_addr learned my addr 172.21.15.17:0/1784477417 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd83ffff700 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 0x55e33492beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd846ffd700 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3347796b0 0x55e33492dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd8477fe700 1 -- 172.21.15.17:0/1784477417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 msgr2=0x55e33492beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd8477fe700 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 0x55e33492beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd8477fe700 1 -- 172.21.15.17:0/1784477417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3347796b0 msgr2=0x55e33492dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T13:34:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd8477fe700 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3347796b0 0x55e33492dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.535+0000 7fd8477fe700 1 -- 172.21.15.17:0/1784477417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84810d220 con 0x55e3349232d0 2023-07-14T13:34:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.536+0000 7fd8477fe700 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3349232d0 0x55e33492c3f0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd84001abf0 tx=0x7fd840014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd81f5a6c8494d72 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.536+0000 7fd82e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2023-07-14T13:34:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.536+0000 7fd82e7fc700 1 -- 172.21.15.17:0/1784477417 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840028070 con 0x55e3349232d0 2023-07-14T13:34:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.536+0000 7fd861047b80 1 -- 172.21.15.17:0/1784477417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd83809a1a0 con 0x55e3349232d0 2023-07-14T13:34:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.536+0000 7fd82e7fc700 1 -- 172.21.15.17:0/1784477417 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd840007e70 con 0x55e3349232d0 2023-07-14T13:34:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.536+0000 7fd82e7fc700 1 -- 172.21.15.17:0/1784477417 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd840020040 con 0x55e3349232d0 2023-07-14T13:34:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.536+0000 7fd861047b80 10 client.19947 fetch_fsmap learned FSMap version 70 2023-07-14T13:34:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.536+0000 7fd861047b80 1 -- 172.21.15.17:0/1784477417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55e33469b250 con 0x55e3349232d0 2023-07-14T13:34:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.536+0000 7fd82e7fc700 1 -- 172.21.15.17:0/1784477417 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd83809a1a0 con 0x55e3349232d0 2023-07-14T13:34:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.536+0000 7fd82e7fc700 1 -- 172.21.15.17:0/1784477417 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 70) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd840023070 con 0x55e3349232d0 2023-07-14T13:34:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.537+0000 7fd861047b80 10 client.19947 fetch_fsmap finished waiting for FSMap version 70 2023-07-14T13:34:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.537+0000 7fd861047b80 10 client.19947 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-14T13:34:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.537+0000 7fd861047b80 20 client.19947 populate_metadata read hostname 'smithi017' 2023-07-14T13:34:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.537+0000 7fd861047b80 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e33498bc10 0x55e33498e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.537+0000 7fd861047b80 4 client.19947 mds_command: new command op to 24593 tid=0[{"prefix": "flush journal"}] 2023-07-14T13:34:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.537+0000 7fd861047b80 1 -- 172.21.15.17:0/1784477417 --> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e334829ff0 con 0x55e33498bc10 2023-07-14T13:34:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.537+0000 7fd846ffd700 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e33498bc10 0x55e33498e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.538+0000 7fd82e7fc700 10 client.19947 ms_handle_connect on v2:172.21.15.131:6838/2296586377 2023-07-14T13:34:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.538+0000 7fd846ffd700 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e33498bc10 0x55e33498e020 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25302363e206ceb4 server_cookie=675995eab79e078a in_seq=0 out_seq=0 2023-07-14T13:34:25.568 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd82e7fc700 1 -- 172.21.15.17:0/1784477417 <== mds.0 v2:172.21.15.131:6838/2296586377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e334829ff0 con 0x55e33498bc10 2023-07-14T13:34:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd82e7fc700 10 client.19947 handle_command_reply: tid=0 2023-07-14T13:34:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 1 client.19947 shutdown 2023-07-14T13:34:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 1 -- 172.21.15.17:0/1784477417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3349232d0 msgr2=0x55e33492c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3349232d0 0x55e33492c3f0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd84001abf0 tx=0x7fd840014000 comp rx=0 tx=0).stop 2023-07-14T13:34:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 1 -- 172.21.15.17:0/1784477417 shutdown_connections 2023-07-14T13:34:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.131:6838/2296586377,v1:172.21.15.131:6839/2296586377] conn(0x55e33498bc10 0x55e33498e020 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.569 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55e3349232d0 0x55e33492c3f0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3347796b0 0x55e33492dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 1 --2- 172.21.15.17:0/1784477417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e33491d580 0x55e33492beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd82e7fc700 0 client.19947 ms_handle_reset on v2:172.21.15.131:6838/2296586377 2023-07-14T13:34:25.570 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 1 -- 172.21.15.17:0/1784477417 >> 172.21.15.17:0/1784477417 conn(0x55e334912be0 msgr2=0x55e3349219d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 1 -- 172.21.15.17:0/1784477417 shutdown_connections 2023-07-14T13:34:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 1 -- 172.21.15.17:0/1784477417 wait complete. 2023-07-14T13:34:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.574+0000 7fd861047b80 20 client.19947 trim_cache size 0 max 16384 2023-07-14T13:34:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:{ 2023-07-14T13:34:25.571 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "message": "", 2023-07-14T13:34:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout: "return_code": 0 2023-07-14T13:34:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stdout:} 2023-07-14T13:34:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 -- 172.21.15.17:0/1433953533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd8340a12c0 msgr2=0x7fd8340a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd8340a12c0 0x7fd8340a3770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd8400060b0 tx=0x7fd840009920 comp rx=0 tx=0).stop 2023-07-14T13:34:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 -- 172.21.15.17:0/1433953533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8480ffb30 msgr2=0x7fd8480729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8480ffb30 0x7fd8480729f0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd83800d950 tx=0x7fd83800dd10 comp rx=0 tx=0).stop 2023-07-14T13:34:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 -- 172.21.15.17:0/1433953533 shutdown_connections 2023-07-14T13:34:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fd8340a12c0 0x7fd8340a3770 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd848105b60 0x7fd8481a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8480ffb30 0x7fd8480729f0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 --2- 172.21.15.17:0/1433953533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8481004e0 0x7fd848072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 -- 172.21.15.17:0/1433953533 >> 172.21.15.17:0/1433953533 conn(0x7fd8480fb5f0 msgr2=0x7fd848103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 -- 172.21.15.17:0/1433953533 shutdown_connections 2023-07-14T13:34:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi017.front.sepia.ceph.com.smithi017.stderr:2023-07-14T13:34:25.575+0000 7fd84d7ff700 1 -- 172.21.15.17:0/1433953533 wait complete. 2023-07-14T13:34:26.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:25 smithi135 ceph-mon[97338]: pgmap v1101: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 229 KiB/s wr, 31 op/s 2023-07-14T13:34:26.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:25 smithi131 ceph-mon[96953]: pgmap v1101: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 229 KiB/s wr, 31 op/s 2023-07-14T13:34:26.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:25 smithi017 ceph-mon[95536]: pgmap v1101: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 229 KiB/s wr, 31 op/s 2023-07-14T13:34:28.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:27 smithi135 ceph-mon[97338]: pgmap v1102: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-07-14T13:34:28.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:27 smithi131 ceph-mon[96953]: pgmap v1102: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-07-14T13:34:28.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:27 smithi017 ceph-mon[95536]: pgmap v1102: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 260 KiB/s wr, 27 op/s 2023-07-14T13:34:30.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:29 smithi135 ceph-mon[97338]: pgmap v1103: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 219 KiB/s wr, 23 op/s 2023-07-14T13:34:30.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:29 smithi131 ceph-mon[96953]: pgmap v1103: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 219 KiB/s wr, 23 op/s 2023-07-14T13:34:30.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:29 smithi017 ceph-mon[95536]: pgmap v1103: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 219 KiB/s wr, 23 op/s 2023-07-14T13:34:32.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:31 smithi135 ceph-mon[97338]: pgmap v1104: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 309 KiB/s wr, 32 op/s 2023-07-14T13:34:32.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:31 smithi131 ceph-mon[96953]: pgmap v1104: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 309 KiB/s wr, 32 op/s 2023-07-14T13:34:32.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:31 smithi017 ceph-mon[95536]: pgmap v1104: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 309 KiB/s wr, 32 op/s 2023-07-14T13:34:34.164 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:33 smithi135 ceph-mon[97338]: pgmap v1105: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 291 KiB/s wr, 31 op/s 2023-07-14T13:34:34.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:33 smithi131 ceph-mon[96953]: pgmap v1105: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 291 KiB/s wr, 31 op/s 2023-07-14T13:34:34.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:33 smithi017 ceph-mon[95536]: pgmap v1105: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 291 KiB/s wr, 31 op/s 2023-07-14T13:34:34.889 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-07-14T13:34:35.725 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/: 2023-07-14T13:34:35.725 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-07-14T13:34:35.725 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 8988219992 Jul 14 12:59 . 2023-07-14T13:34:35.725 INFO:teuthology.orchestra.run.smithi017.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 8988219992 Jul 14 12:59 .. 2023-07-14T13:34:35.726 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 data 2023-07-14T13:34:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:35.726 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data: 2023-07-14T13:34:35.726 INFO:teuthology.orchestra.run.smithi017.stdout:total 41 2023-07-14T13:34:35.726 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 . 2023-07-14T13:34:35.726 INFO:teuthology.orchestra.run.smithi017.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 8988219992 Jul 14 12:59 .. 2023-07-14T13:34:35.726 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7930429581 Jul 14 13:16 base 2023-07-14T13:34:35.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Jul 14 13:00 current_logfiles 2023-07-14T13:34:35.727 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Jul 14 13:00 global 2023-07-14T13:34:35.727 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 838 Jul 14 13:00 log 2023-07-14T13:34:35.727 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_commit_ts 2023-07-14T13:34:35.727 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_dynshmem 2023-07-14T13:34:35.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Jul 14 12:59 pg_hba.conf 2023-07-14T13:34:35.727 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Jul 14 12:59 pg_ident.conf 2023-07-14T13:34:35.728 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 14 13:34 pg_logical 2023-07-14T13:34:35.728 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 pg_multixact 2023-07-14T13:34:35.728 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 pg_notify 2023-07-14T13:34:35.728 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_replslot 2023-07-14T13:34:35.728 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_serial 2023-07-14T13:34:35.728 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_snapshots 2023-07-14T13:34:35.728 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Jul 14 13:34 pg_stat 2023-07-14T13:34:35.729 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:34 pg_stat_tmp 2023-07-14T13:34:35.729 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Jul 14 13:32 pg_subtrans 2023-07-14T13:34:35.729 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_tblspc 2023-07-14T13:34:35.729 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 pg_twophase 2023-07-14T13:34:35.729 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 14 12:59 PG_VERSION 2023-07-14T13:34:35.729 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1107296256 Jul 14 13:34 pg_wal 2023-07-14T13:34:35.729 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 14 12:59 pg_xact 2023-07-14T13:34:35.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Jul 14 12:59 postgresql.auto.conf 2023-07-14T13:34:35.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Jul 14 12:59 postgresql.conf 2023-07-14T13:34:35.730 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Jul 14 13:00 postmaster.opts 2023-07-14T13:34:35.730 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:35.730 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base: 2023-07-14T13:34:35.730 INFO:teuthology.orchestra.run.smithi017.stdout:total 3 2023-07-14T13:34:35.730 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7930429581 Jul 14 13:16 . 2023-07-14T13:34:35.731 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:35.731 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Jul 14 12:59 1 2023-07-14T13:34:35.731 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Jul 14 12:59 12346 2023-07-14T13:34:35.731 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7915699335 Jul 14 13:18 12347 2023-07-14T13:34:35.731 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:18 pgsql_tmp 2023-07-14T13:34:35.731 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:35.731 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/1: 2023-07-14T13:34:35.731 INFO:teuthology.orchestra.run.smithi017.stdout:total 7194 2023-07-14T13:34:35.732 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Jul 14 12:59 . 2023-07-14T13:34:35.732 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7930429581 Jul 14 13:16 .. 2023-07-14T13:34:35.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 112 2023-07-14T13:34:35.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 113 2023-07-14T13:34:35.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 14 12:59 12182 2023-07-14T13:34:35.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12182_fsm 2023-07-14T13:34:35.732 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12182_vm 2023-07-14T13:34:35.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12184 2023-07-14T13:34:35.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12186 2023-07-14T13:34:35.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12187 2023-07-14T13:34:35.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12187_fsm 2023-07-14T13:34:35.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12187_vm 2023-07-14T13:34:35.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12189 2023-07-14T13:34:35.733 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12191 2023-07-14T13:34:35.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192 2023-07-14T13:34:35.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12192_fsm 2023-07-14T13:34:35.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192_vm 2023-07-14T13:34:35.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12194 2023-07-14T13:34:35.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12196 2023-07-14T13:34:35.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12197 2023-07-14T13:34:35.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12197_fsm 2023-07-14T13:34:35.734 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12197_vm 2023-07-14T13:34:35.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12199 2023-07-14T13:34:35.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12201 2023-07-14T13:34:35.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12202 2023-07-14T13:34:35.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12202_fsm 2023-07-14T13:34:35.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12202_vm 2023-07-14T13:34:35.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12204 2023-07-14T13:34:35.735 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12206 2023-07-14T13:34:35.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12207 2023-07-14T13:34:35.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12207_fsm 2023-07-14T13:34:35.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12207_vm 2023-07-14T13:34:35.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12209 2023-07-14T13:34:35.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12211 2023-07-14T13:34:35.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12212 2023-07-14T13:34:35.736 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12214 2023-07-14T13:34:35.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12216 2023-07-14T13:34:35.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 14 12:59 1247 2023-07-14T13:34:35.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1247_fsm 2023-07-14T13:34:35.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1247_vm 2023-07-14T13:34:35.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 14 12:59 1249 2023-07-14T13:34:35.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1249_fsm 2023-07-14T13:34:35.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1249_vm 2023-07-14T13:34:35.737 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 14 12:59 1255 2023-07-14T13:34:35.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1255_fsm 2023-07-14T13:34:35.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1255_vm 2023-07-14T13:34:35.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 14 12:59 1259 2023-07-14T13:34:35.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1259_fsm 2023-07-14T13:34:35.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1259_vm 2023-07-14T13:34:35.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1417 2023-07-14T13:34:35.738 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1417_vm 2023-07-14T13:34:35.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1418 2023-07-14T13:34:35.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1418_vm 2023-07-14T13:34:35.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 174 2023-07-14T13:34:35.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 175 2023-07-14T13:34:35.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2187 2023-07-14T13:34:35.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2224 2023-07-14T13:34:35.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2224_vm 2023-07-14T13:34:35.739 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2328 2023-07-14T13:34:35.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2328_vm 2023-07-14T13:34:35.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2336 2023-07-14T13:34:35.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2336_vm 2023-07-14T13:34:35.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2337 2023-07-14T13:34:35.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2600 2023-07-14T13:34:35.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2600_fsm 2023-07-14T13:34:35.740 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2600_vm 2023-07-14T13:34:35.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2601 2023-07-14T13:34:35.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2601_fsm 2023-07-14T13:34:35.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2601_vm 2023-07-14T13:34:35.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2602 2023-07-14T13:34:35.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2602_fsm 2023-07-14T13:34:35.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2602_vm 2023-07-14T13:34:35.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2603 2023-07-14T13:34:35.741 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2603_fsm 2023-07-14T13:34:35.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2603_vm 2023-07-14T13:34:35.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2604 2023-07-14T13:34:35.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2604_vm 2023-07-14T13:34:35.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2605 2023-07-14T13:34:35.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2605_fsm 2023-07-14T13:34:35.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2605_vm 2023-07-14T13:34:35.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2606 2023-07-14T13:34:35.742 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2606_fsm 2023-07-14T13:34:35.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2606_vm 2023-07-14T13:34:35.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2607 2023-07-14T13:34:35.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2607_fsm 2023-07-14T13:34:35.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2607_vm 2023-07-14T13:34:35.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jul 14 12:59 2608 2023-07-14T13:34:35.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2608_fsm 2023-07-14T13:34:35.743 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2608_vm 2023-07-14T13:34:35.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 14 12:59 2609 2023-07-14T13:34:35.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2609_fsm 2023-07-14T13:34:35.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2609_vm 2023-07-14T13:34:35.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2610 2023-07-14T13:34:35.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2610_fsm 2023-07-14T13:34:35.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2610_vm 2023-07-14T13:34:35.744 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2611 2023-07-14T13:34:35.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2611_vm 2023-07-14T13:34:35.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2612 2023-07-14T13:34:35.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2612_fsm 2023-07-14T13:34:35.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2612_vm 2023-07-14T13:34:35.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2613 2023-07-14T13:34:35.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2613_vm 2023-07-14T13:34:35.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2615 2023-07-14T13:34:35.745 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2615_fsm 2023-07-14T13:34:35.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2615_vm 2023-07-14T13:34:35.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2616 2023-07-14T13:34:35.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2616_fsm 2023-07-14T13:34:35.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2616_vm 2023-07-14T13:34:35.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 14 12:59 2617 2023-07-14T13:34:35.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2617_fsm 2023-07-14T13:34:35.746 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2617_vm 2023-07-14T13:34:35.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 14 12:59 2618 2023-07-14T13:34:35.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2618_fsm 2023-07-14T13:34:35.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2618_vm 2023-07-14T13:34:35.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jul 14 12:59 2619 2023-07-14T13:34:35.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2619_fsm 2023-07-14T13:34:35.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2619_vm 2023-07-14T13:34:35.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2620 2023-07-14T13:34:35.747 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2620_vm 2023-07-14T13:34:35.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2650 2023-07-14T13:34:35.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2651 2023-07-14T13:34:35.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2652 2023-07-14T13:34:35.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2653 2023-07-14T13:34:35.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2654 2023-07-14T13:34:35.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2655 2023-07-14T13:34:35.748 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2656 2023-07-14T13:34:35.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2657 2023-07-14T13:34:35.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 14 12:59 2658 2023-07-14T13:34:35.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 12:59 2659 2023-07-14T13:34:35.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2660 2023-07-14T13:34:35.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2661 2023-07-14T13:34:35.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2662 2023-07-14T13:34:35.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2663 2023-07-14T13:34:35.749 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2664 2023-07-14T13:34:35.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2665 2023-07-14T13:34:35.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2666 2023-07-14T13:34:35.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2667 2023-07-14T13:34:35.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2668 2023-07-14T13:34:35.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2669 2023-07-14T13:34:35.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2670 2023-07-14T13:34:35.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jul 14 12:59 2673 2023-07-14T13:34:35.750 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 14 12:59 2674 2023-07-14T13:34:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 14 12:59 2675 2023-07-14T13:34:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2678 2023-07-14T13:34:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2679 2023-07-14T13:34:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2680 2023-07-14T13:34:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2681 2023-07-14T13:34:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2682 2023-07-14T13:34:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2683 2023-07-14T13:34:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2684 2023-07-14T13:34:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2685 2023-07-14T13:34:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2686 2023-07-14T13:34:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2687 2023-07-14T13:34:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2688 2023-07-14T13:34:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2689 2023-07-14T13:34:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 12:59 2690 2023-07-14T13:34:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 14 12:59 2691 2023-07-14T13:34:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2692 2023-07-14T13:34:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2693 2023-07-14T13:34:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2696 2023-07-14T13:34:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2699 2023-07-14T13:34:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2701 2023-07-14T13:34:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2702 2023-07-14T13:34:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2703 2023-07-14T13:34:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2704 2023-07-14T13:34:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2753 2023-07-14T13:34:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2753_fsm 2023-07-14T13:34:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2753_vm 2023-07-14T13:34:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2754 2023-07-14T13:34:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2755 2023-07-14T13:34:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2756 2023-07-14T13:34:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2757 2023-07-14T13:34:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2830 2023-07-14T13:34:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2830_vm 2023-07-14T13:34:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2831 2023-07-14T13:34:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2832 2023-07-14T13:34:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2832_vm 2023-07-14T13:34:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2833 2023-07-14T13:34:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2834 2023-07-14T13:34:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2834_vm 2023-07-14T13:34:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2835 2023-07-14T13:34:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2836 2023-07-14T13:34:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2836_vm 2023-07-14T13:34:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2837 2023-07-14T13:34:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 14 12:59 2838 2023-07-14T13:34:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2838_fsm 2023-07-14T13:34:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2838_vm 2023-07-14T13:34:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2839 2023-07-14T13:34:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2840 2023-07-14T13:34:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2840_fsm 2023-07-14T13:34:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2840_vm 2023-07-14T13:34:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2841 2023-07-14T13:34:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2995 2023-07-14T13:34:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2995_vm 2023-07-14T13:34:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2996 2023-07-14T13:34:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3079 2023-07-14T13:34:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3079_fsm 2023-07-14T13:34:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3079_vm 2023-07-14T13:34:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3080 2023-07-14T13:34:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3081 2023-07-14T13:34:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3085 2023-07-14T13:34:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3118 2023-07-14T13:34:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3118_vm 2023-07-14T13:34:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3119 2023-07-14T13:34:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3164 2023-07-14T13:34:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3256 2023-07-14T13:34:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3256_vm 2023-07-14T13:34:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3257 2023-07-14T13:34:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3258 2023-07-14T13:34:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3350 2023-07-14T13:34:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3350_vm 2023-07-14T13:34:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3351 2023-07-14T13:34:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3379 2023-07-14T13:34:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3380 2023-07-14T13:34:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3381 2023-07-14T13:34:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3381_vm 2023-07-14T13:34:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3394 2023-07-14T13:34:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3394_fsm 2023-07-14T13:34:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3394_vm 2023-07-14T13:34:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3395 2023-07-14T13:34:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3439 2023-07-14T13:34:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3439_vm 2023-07-14T13:34:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3440 2023-07-14T13:34:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 3455 2023-07-14T13:34:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3456 2023-07-14T13:34:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3456_fsm 2023-07-14T13:34:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3456_vm 2023-07-14T13:34:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3466 2023-07-14T13:34:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3466_vm 2023-07-14T13:34:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3467 2023-07-14T13:34:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3468 2023-07-14T13:34:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3501 2023-07-14T13:34:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3501_vm 2023-07-14T13:34:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3502 2023-07-14T13:34:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3503 2023-07-14T13:34:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3534 2023-07-14T13:34:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3541 2023-07-14T13:34:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3541_fsm 2023-07-14T13:34:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3541_vm 2023-07-14T13:34:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3542 2023-07-14T13:34:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3574 2023-07-14T13:34:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3575 2023-07-14T13:34:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3576 2023-07-14T13:34:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3576_vm 2023-07-14T13:34:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3596 2023-07-14T13:34:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3596_vm 2023-07-14T13:34:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3597 2023-07-14T13:34:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3598 2023-07-14T13:34:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3598_vm 2023-07-14T13:34:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3599 2023-07-14T13:34:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3600 2023-07-14T13:34:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3600_fsm 2023-07-14T13:34:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3600_vm 2023-07-14T13:34:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3601 2023-07-14T13:34:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3601_fsm 2023-07-14T13:34:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3601_vm 2023-07-14T13:34:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3602 2023-07-14T13:34:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3602_fsm 2023-07-14T13:34:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3602_vm 2023-07-14T13:34:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3603 2023-07-14T13:34:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3603_fsm 2023-07-14T13:34:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3603_vm 2023-07-14T13:34:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3604 2023-07-14T13:34:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3605 2023-07-14T13:34:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3606 2023-07-14T13:34:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3607 2023-07-14T13:34:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3608 2023-07-14T13:34:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 3609 2023-07-14T13:34:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3712 2023-07-14T13:34:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3764 2023-07-14T13:34:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3764_fsm 2023-07-14T13:34:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3764_vm 2023-07-14T13:34:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3766 2023-07-14T13:34:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3767 2023-07-14T13:34:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3997 2023-07-14T13:34:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 5002 2023-07-14T13:34:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 548 2023-07-14T13:34:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 549 2023-07-14T13:34:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6102 2023-07-14T13:34:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6102_vm 2023-07-14T13:34:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6104 2023-07-14T13:34:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6104_vm 2023-07-14T13:34:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6106 2023-07-14T13:34:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6106_vm 2023-07-14T13:34:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6110 2023-07-14T13:34:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6111 2023-07-14T13:34:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6112 2023-07-14T13:34:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6113 2023-07-14T13:34:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6117 2023-07-14T13:34:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 826 2023-07-14T13:34:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 826_vm 2023-07-14T13:34:36.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:35 smithi135 ceph-mon[97338]: pgmap v1106: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 235 KiB/s wr, 27 op/s 2023-07-14T13:34:36.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:35 smithi131 ceph-mon[96953]: pgmap v1106: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 235 KiB/s wr, 27 op/s 2023-07-14T13:34:36.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:35 smithi017 ceph-mon[95536]: pgmap v1106: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 235 KiB/s wr, 27 op/s 2023-07-14T13:34:36.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 827 2023-07-14T13:34:36.355 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 828 2023-07-14T13:34:36.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 14 12:59 pg_filenode.map 2023-07-14T13:34:36.356 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 14 12:59 PG_VERSION 2023-07-14T13:34:36.356 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:36.356 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-07-14T13:34:36.357 INFO:teuthology.orchestra.run.smithi017.stdout:total 7194 2023-07-14T13:34:36.357 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7365123 Jul 14 12:59 . 2023-07-14T13:34:36.357 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7930429581 Jul 14 13:16 .. 2023-07-14T13:34:36.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 112 2023-07-14T13:34:36.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 113 2023-07-14T13:34:36.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 14 12:59 12182 2023-07-14T13:34:36.357 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12182_fsm 2023-07-14T13:34:36.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12182_vm 2023-07-14T13:34:36.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12184 2023-07-14T13:34:36.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12186 2023-07-14T13:34:36.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12187 2023-07-14T13:34:36.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12187_fsm 2023-07-14T13:34:36.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12187_vm 2023-07-14T13:34:36.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12189 2023-07-14T13:34:36.358 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12191 2023-07-14T13:34:36.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192 2023-07-14T13:34:36.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12192_fsm 2023-07-14T13:34:36.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192_vm 2023-07-14T13:34:36.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12194 2023-07-14T13:34:36.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12196 2023-07-14T13:34:36.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12197 2023-07-14T13:34:36.359 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12197_fsm 2023-07-14T13:34:36.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12197_vm 2023-07-14T13:34:36.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12199 2023-07-14T13:34:36.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12201 2023-07-14T13:34:36.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12202 2023-07-14T13:34:36.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12202_fsm 2023-07-14T13:34:36.360 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12202_vm 2023-07-14T13:34:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12204 2023-07-14T13:34:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12206 2023-07-14T13:34:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12207 2023-07-14T13:34:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 12207_fsm 2023-07-14T13:34:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12207_vm 2023-07-14T13:34:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12209 2023-07-14T13:34:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12211 2023-07-14T13:34:36.361 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12212 2023-07-14T13:34:36.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12214 2023-07-14T13:34:36.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12216 2023-07-14T13:34:36.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 14 12:59 1247 2023-07-14T13:34:36.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1247_fsm 2023-07-14T13:34:36.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1247_vm 2023-07-14T13:34:36.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 14 12:59 1249 2023-07-14T13:34:36.362 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1249_fsm 2023-07-14T13:34:36.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1249_vm 2023-07-14T13:34:36.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 14 12:59 1255 2023-07-14T13:34:36.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1255_fsm 2023-07-14T13:34:36.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1255_vm 2023-07-14T13:34:36.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 14 12:59 1259 2023-07-14T13:34:36.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1259_fsm 2023-07-14T13:34:36.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1259_vm 2023-07-14T13:34:36.363 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1417 2023-07-14T13:34:36.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1417_vm 2023-07-14T13:34:36.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1418 2023-07-14T13:34:36.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1418_vm 2023-07-14T13:34:36.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 174 2023-07-14T13:34:36.364 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 175 2023-07-14T13:34:36.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2187 2023-07-14T13:34:36.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2224 2023-07-14T13:34:36.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2224_vm 2023-07-14T13:34:36.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2328 2023-07-14T13:34:36.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2328_vm 2023-07-14T13:34:36.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2336 2023-07-14T13:34:36.365 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2336_vm 2023-07-14T13:34:36.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2337 2023-07-14T13:34:36.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2600 2023-07-14T13:34:36.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2600_fsm 2023-07-14T13:34:36.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2600_vm 2023-07-14T13:34:36.366 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2601 2023-07-14T13:34:36.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2601_fsm 2023-07-14T13:34:36.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2601_vm 2023-07-14T13:34:36.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2602 2023-07-14T13:34:36.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2602_fsm 2023-07-14T13:34:36.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2602_vm 2023-07-14T13:34:36.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2603 2023-07-14T13:34:36.367 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2603_fsm 2023-07-14T13:34:36.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2603_vm 2023-07-14T13:34:36.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2604 2023-07-14T13:34:36.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2604_vm 2023-07-14T13:34:36.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2605 2023-07-14T13:34:36.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2605_fsm 2023-07-14T13:34:36.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2605_vm 2023-07-14T13:34:36.368 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2606 2023-07-14T13:34:36.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2606_fsm 2023-07-14T13:34:36.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2606_vm 2023-07-14T13:34:36.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2607 2023-07-14T13:34:36.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2607_fsm 2023-07-14T13:34:36.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2607_vm 2023-07-14T13:34:36.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jul 14 12:59 2608 2023-07-14T13:34:36.369 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2608_fsm 2023-07-14T13:34:36.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2608_vm 2023-07-14T13:34:36.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 14 12:59 2609 2023-07-14T13:34:36.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2609_fsm 2023-07-14T13:34:36.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2609_vm 2023-07-14T13:34:36.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2610 2023-07-14T13:34:36.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2610_fsm 2023-07-14T13:34:36.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2610_vm 2023-07-14T13:34:36.370 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2611 2023-07-14T13:34:36.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2611_vm 2023-07-14T13:34:36.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2612 2023-07-14T13:34:36.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2612_fsm 2023-07-14T13:34:36.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2612_vm 2023-07-14T13:34:36.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2613 2023-07-14T13:34:36.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2613_vm 2023-07-14T13:34:36.371 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2615 2023-07-14T13:34:36.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2615_fsm 2023-07-14T13:34:36.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2615_vm 2023-07-14T13:34:36.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2616 2023-07-14T13:34:36.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2616_fsm 2023-07-14T13:34:36.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2616_vm 2023-07-14T13:34:36.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 14 12:59 2617 2023-07-14T13:34:36.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2617_fsm 2023-07-14T13:34:36.372 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2617_vm 2023-07-14T13:34:36.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 14 12:59 2618 2023-07-14T13:34:36.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2618_fsm 2023-07-14T13:34:36.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2618_vm 2023-07-14T13:34:36.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jul 14 12:59 2619 2023-07-14T13:34:36.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2619_fsm 2023-07-14T13:34:36.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2619_vm 2023-07-14T13:34:36.373 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2620 2023-07-14T13:34:36.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2620_vm 2023-07-14T13:34:36.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2650 2023-07-14T13:34:36.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2651 2023-07-14T13:34:36.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2652 2023-07-14T13:34:36.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2653 2023-07-14T13:34:36.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2654 2023-07-14T13:34:36.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2655 2023-07-14T13:34:36.374 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2656 2023-07-14T13:34:36.375 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2657 2023-07-14T13:34:36.375 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 14 12:59 2658 2023-07-14T13:34:36.375 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 12:59 2659 2023-07-14T13:34:36.375 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2660 2023-07-14T13:34:36.375 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2661 2023-07-14T13:34:36.375 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2662 2023-07-14T13:34:36.375 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2663 2023-07-14T13:34:36.375 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2664 2023-07-14T13:34:36.376 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2665 2023-07-14T13:34:36.376 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2666 2023-07-14T13:34:36.376 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2667 2023-07-14T13:34:36.376 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2668 2023-07-14T13:34:36.376 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2669 2023-07-14T13:34:36.377 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2670 2023-07-14T13:34:36.377 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jul 14 12:59 2673 2023-07-14T13:34:36.377 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 14 12:59 2674 2023-07-14T13:34:36.377 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 14 12:59 2675 2023-07-14T13:34:36.377 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2678 2023-07-14T13:34:36.377 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2679 2023-07-14T13:34:36.377 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2680 2023-07-14T13:34:36.378 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2681 2023-07-14T13:34:36.378 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2682 2023-07-14T13:34:36.378 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2683 2023-07-14T13:34:36.378 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2684 2023-07-14T13:34:36.378 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2685 2023-07-14T13:34:36.378 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2686 2023-07-14T13:34:36.378 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2687 2023-07-14T13:34:36.378 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2688 2023-07-14T13:34:36.379 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 12:59 2689 2023-07-14T13:34:36.379 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 12:59 2690 2023-07-14T13:34:36.379 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 14 12:59 2691 2023-07-14T13:34:36.379 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2692 2023-07-14T13:34:36.379 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2693 2023-07-14T13:34:36.379 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2696 2023-07-14T13:34:36.379 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2699 2023-07-14T13:34:36.380 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2701 2023-07-14T13:34:36.380 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2702 2023-07-14T13:34:36.380 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2703 2023-07-14T13:34:36.380 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 2704 2023-07-14T13:34:36.380 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2753 2023-07-14T13:34:36.380 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2753_fsm 2023-07-14T13:34:36.380 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2753_vm 2023-07-14T13:34:36.381 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2754 2023-07-14T13:34:36.381 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2755 2023-07-14T13:34:36.381 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2756 2023-07-14T13:34:36.381 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2757 2023-07-14T13:34:36.381 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2830 2023-07-14T13:34:36.381 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2830_vm 2023-07-14T13:34:36.381 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2831 2023-07-14T13:34:36.381 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2832 2023-07-14T13:34:36.382 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2832_vm 2023-07-14T13:34:36.382 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2833 2023-07-14T13:34:36.382 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2834 2023-07-14T13:34:36.382 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2834_vm 2023-07-14T13:34:36.382 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2835 2023-07-14T13:34:36.382 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2836 2023-07-14T13:34:36.382 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2836_vm 2023-07-14T13:34:36.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2837 2023-07-14T13:34:36.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 14 12:59 2838 2023-07-14T13:34:36.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2838_fsm 2023-07-14T13:34:36.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2838_vm 2023-07-14T13:34:36.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2839 2023-07-14T13:34:36.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2840 2023-07-14T13:34:36.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2840_fsm 2023-07-14T13:34:36.383 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2840_vm 2023-07-14T13:34:36.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2841 2023-07-14T13:34:36.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2995 2023-07-14T13:34:36.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2995_vm 2023-07-14T13:34:36.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2996 2023-07-14T13:34:36.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3079 2023-07-14T13:34:36.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3079_fsm 2023-07-14T13:34:36.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3079_vm 2023-07-14T13:34:36.384 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3080 2023-07-14T13:34:36.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3081 2023-07-14T13:34:36.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3085 2023-07-14T13:34:36.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3118 2023-07-14T13:34:36.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3118_vm 2023-07-14T13:34:36.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3119 2023-07-14T13:34:36.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3164 2023-07-14T13:34:36.385 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3256 2023-07-14T13:34:36.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3256_vm 2023-07-14T13:34:36.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3257 2023-07-14T13:34:36.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3258 2023-07-14T13:34:36.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3350 2023-07-14T13:34:36.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3350_vm 2023-07-14T13:34:36.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3351 2023-07-14T13:34:36.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3379 2023-07-14T13:34:36.386 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3380 2023-07-14T13:34:36.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3381 2023-07-14T13:34:36.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3381_vm 2023-07-14T13:34:36.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3394 2023-07-14T13:34:36.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3394_fsm 2023-07-14T13:34:36.387 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3394_vm 2023-07-14T13:34:36.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3395 2023-07-14T13:34:36.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3439 2023-07-14T13:34:36.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3439_vm 2023-07-14T13:34:36.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3440 2023-07-14T13:34:36.388 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 12:59 3455 2023-07-14T13:34:36.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3456 2023-07-14T13:34:36.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3456_fsm 2023-07-14T13:34:36.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3456_vm 2023-07-14T13:34:36.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3466 2023-07-14T13:34:36.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3466_vm 2023-07-14T13:34:36.389 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3467 2023-07-14T13:34:36.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3468 2023-07-14T13:34:36.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3501 2023-07-14T13:34:36.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3501_vm 2023-07-14T13:34:36.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3502 2023-07-14T13:34:36.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3503 2023-07-14T13:34:36.390 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3534 2023-07-14T13:34:36.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3541 2023-07-14T13:34:36.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3541_fsm 2023-07-14T13:34:36.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3541_vm 2023-07-14T13:34:36.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3542 2023-07-14T13:34:36.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3574 2023-07-14T13:34:36.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3575 2023-07-14T13:34:36.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3576 2023-07-14T13:34:36.391 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3576_vm 2023-07-14T13:34:36.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3596 2023-07-14T13:34:36.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3596_vm 2023-07-14T13:34:36.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3597 2023-07-14T13:34:36.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3598 2023-07-14T13:34:36.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3598_vm 2023-07-14T13:34:36.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3599 2023-07-14T13:34:36.392 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3600 2023-07-14T13:34:36.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3600_fsm 2023-07-14T13:34:36.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3600_vm 2023-07-14T13:34:36.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3601 2023-07-14T13:34:36.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3601_fsm 2023-07-14T13:34:36.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3601_vm 2023-07-14T13:34:36.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3602 2023-07-14T13:34:36.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3602_fsm 2023-07-14T13:34:36.393 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3602_vm 2023-07-14T13:34:36.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3603 2023-07-14T13:34:36.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3603_fsm 2023-07-14T13:34:36.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3603_vm 2023-07-14T13:34:36.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3604 2023-07-14T13:34:36.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3605 2023-07-14T13:34:36.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3606 2023-07-14T13:34:36.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3607 2023-07-14T13:34:36.394 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3608 2023-07-14T13:34:36.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 3609 2023-07-14T13:34:36.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3712 2023-07-14T13:34:36.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3764 2023-07-14T13:34:36.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3764_fsm 2023-07-14T13:34:36.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3764_vm 2023-07-14T13:34:36.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3766 2023-07-14T13:34:36.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3767 2023-07-14T13:34:36.395 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3997 2023-07-14T13:34:36.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 5002 2023-07-14T13:34:36.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 548 2023-07-14T13:34:36.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 549 2023-07-14T13:34:36.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6102 2023-07-14T13:34:36.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6102_vm 2023-07-14T13:34:36.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6104 2023-07-14T13:34:36.396 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6104_vm 2023-07-14T13:34:36.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6106 2023-07-14T13:34:36.397 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6106_vm 2023-07-14T13:34:37.103 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6110 2023-07-14T13:34:37.103 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6111 2023-07-14T13:34:37.104 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6112 2023-07-14T13:34:37.104 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6113 2023-07-14T13:34:37.104 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6117 2023-07-14T13:34:37.104 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 826 2023-07-14T13:34:37.104 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 826_vm 2023-07-14T13:34:37.104 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 827 2023-07-14T13:34:37.104 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 828 2023-07-14T13:34:37.105 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 14 12:59 pg_filenode.map 2023-07-14T13:34:37.105 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 14 12:59 PG_VERSION 2023-07-14T13:34:37.105 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.105 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-07-14T13:34:37.105 INFO:teuthology.orchestra.run.smithi017.stdout:total 7730177 2023-07-14T13:34:37.105 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7915699335 Jul 14 13:18 . 2023-07-14T13:34:37.105 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7930429581 Jul 14 13:16 .. 2023-07-14T13:34:37.106 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 112 2023-07-14T13:34:37.106 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 113 2023-07-14T13:34:37.106 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 14 13:00 12182 2023-07-14T13:34:37.106 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12182_fsm 2023-07-14T13:34:37.106 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12182_vm 2023-07-14T13:34:37.106 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 12184 2023-07-14T13:34:37.106 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12186 2023-07-14T13:34:37.106 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12187 2023-07-14T13:34:37.107 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12187_fsm 2023-07-14T13:34:37.107 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12187_vm 2023-07-14T13:34:37.107 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 12189 2023-07-14T13:34:37.107 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12191 2023-07-14T13:34:37.107 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192 2023-07-14T13:34:37.107 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12192_fsm 2023-07-14T13:34:37.107 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12192_vm 2023-07-14T13:34:37.108 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 12194 2023-07-14T13:34:37.108 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12196 2023-07-14T13:34:37.108 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12197 2023-07-14T13:34:37.108 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12197_fsm 2023-07-14T13:34:37.108 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12197_vm 2023-07-14T13:34:37.108 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 12199 2023-07-14T13:34:37.108 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12201 2023-07-14T13:34:37.108 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 12202 2023-07-14T13:34:37.109 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12202_fsm 2023-07-14T13:34:37.109 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12202_vm 2023-07-14T13:34:37.109 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12204 2023-07-14T13:34:37.109 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12206 2023-07-14T13:34:37.109 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12207 2023-07-14T13:34:37.109 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 12207_fsm 2023-07-14T13:34:37.109 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12207_vm 2023-07-14T13:34:37.110 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12209 2023-07-14T13:34:37.110 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12211 2023-07-14T13:34:37.110 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 12212 2023-07-14T13:34:37.110 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 12214 2023-07-14T13:34:37.110 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 12216 2023-07-14T13:34:37.110 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 14 13:01 1247 2023-07-14T13:34:37.110 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:01 1247_fsm 2023-07-14T13:34:37.110 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:01 1247_vm 2023-07-14T13:34:37.111 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 14 13:18 1249 2023-07-14T13:34:37.111 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:01 1249_fsm 2023-07-14T13:34:37.111 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:01 1249_vm 2023-07-14T13:34:37.111 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 14 13:00 1255 2023-07-14T13:34:37.111 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 1255_fsm 2023-07-14T13:34:37.111 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 1255_vm 2023-07-14T13:34:37.111 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 14 13:32 1259 2023-07-14T13:34:37.112 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 1259_fsm 2023-07-14T13:34:37.112 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:01 1259_vm 2023-07-14T13:34:37.112 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 1417 2023-07-14T13:34:37.112 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 1417_vm 2023-07-14T13:34:37.112 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 1418 2023-07-14T13:34:37.112 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 1418_vm 2023-07-14T13:34:37.112 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1753088 Jul 14 13:33 16387 2023-07-14T13:34:37.112 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:32 16387_fsm 2023-07-14T13:34:37.113 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:32 16387_vm 2023-07-14T13:34:37.113 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Jul 14 13:33 16393 2023-07-14T13:34:37.113 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:32 16393_fsm 2023-07-14T13:34:37.113 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:32 16393_vm 2023-07-14T13:34:37.113 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 14 13:33 16396 2023-07-14T13:34:37.113 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 14 13:33 16396.1 2023-07-14T13:34:37.113 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 14 13:33 16396.2 2023-07-14T13:34:37.114 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 14 13:33 16396.3 2023-07-14T13:34:37.114 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 14 13:34 16396.4 2023-07-14T13:34:37.114 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 14 13:34 16396.5 2023-07-14T13:34:37.114 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 316440576 Jul 14 13:34 16396.6 2023-07-14T13:34:37.114 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1679360 Jul 14 13:33 16396_fsm 2023-07-14T13:34:37.114 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 212992 Jul 14 13:33 16396_vm 2023-07-14T13:34:37.114 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 13:33 16397 2023-07-14T13:34:37.115 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 237568 Jul 14 13:33 16399 2023-07-14T13:34:37.115 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 14 13:34 16401 2023-07-14T13:34:37.115 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49373184 Jul 14 13:34 16401.1 2023-07-14T13:34:37.115 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21831680 Jul 14 13:34 16403 2023-07-14T13:34:37.115 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:33 16403_fsm 2023-07-14T13:34:37.115 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 174 2023-07-14T13:34:37.115 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 175 2023-07-14T13:34:37.116 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2187 2023-07-14T13:34:37.116 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2224 2023-07-14T13:34:37.116 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2224_vm 2023-07-14T13:34:37.116 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2328 2023-07-14T13:34:37.116 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2328_vm 2023-07-14T13:34:37.116 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2336 2023-07-14T13:34:37.116 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2336_vm 2023-07-14T13:34:37.116 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2337 2023-07-14T13:34:37.117 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2600 2023-07-14T13:34:37.117 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2600_fsm 2023-07-14T13:34:37.117 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2600_vm 2023-07-14T13:34:37.117 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2601 2023-07-14T13:34:37.117 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2601_fsm 2023-07-14T13:34:37.117 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2601_vm 2023-07-14T13:34:37.117 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 13:00 2602 2023-07-14T13:34:37.118 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2602_fsm 2023-07-14T13:34:37.118 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2602_vm 2023-07-14T13:34:37.118 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 13:00 2603 2023-07-14T13:34:37.118 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2603_fsm 2023-07-14T13:34:37.118 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2603_vm 2023-07-14T13:34:37.118 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2604 2023-07-14T13:34:37.118 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2604_vm 2023-07-14T13:34:37.118 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2605 2023-07-14T13:34:37.119 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2605_fsm 2023-07-14T13:34:37.119 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2605_vm 2023-07-14T13:34:37.119 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:16 2606 2023-07-14T13:34:37.119 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2606_fsm 2023-07-14T13:34:37.119 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:16 2606_vm 2023-07-14T13:34:37.119 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2607 2023-07-14T13:34:37.119 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2607_fsm 2023-07-14T13:34:37.119 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2607_vm 2023-07-14T13:34:37.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Jul 14 13:16 2608 2023-07-14T13:34:37.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:16 2608_fsm 2023-07-14T13:34:37.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:16 2608_vm 2023-07-14T13:34:37.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 14 13:00 2609 2023-07-14T13:34:37.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2609_fsm 2023-07-14T13:34:37.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2609_vm 2023-07-14T13:34:37.120 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 13:18 2610 2023-07-14T13:34:37.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:16 2610_fsm 2023-07-14T13:34:37.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:16 2610_vm 2023-07-14T13:34:37.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2611 2023-07-14T13:34:37.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2611_vm 2023-07-14T13:34:37.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2612 2023-07-14T13:34:37.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2612_fsm 2023-07-14T13:34:37.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2612_vm 2023-07-14T13:34:37.121 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2613 2023-07-14T13:34:37.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2613_vm 2023-07-14T13:34:37.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2615 2023-07-14T13:34:37.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2615_fsm 2023-07-14T13:34:37.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2615_vm 2023-07-14T13:34:37.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2616 2023-07-14T13:34:37.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2616_fsm 2023-07-14T13:34:37.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2616_vm 2023-07-14T13:34:37.122 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 14 13:00 2617 2023-07-14T13:34:37.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2617_fsm 2023-07-14T13:34:37.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2617_vm 2023-07-14T13:34:37.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 14 13:00 2618 2023-07-14T13:34:37.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2618_fsm 2023-07-14T13:34:37.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2618_vm 2023-07-14T13:34:37.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Jul 14 13:32 2619 2023-07-14T13:34:37.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:31 2619_fsm 2023-07-14T13:34:37.123 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:16 2619_vm 2023-07-14T13:34:37.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2620 2023-07-14T13:34:37.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2620_vm 2023-07-14T13:34:37.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2650 2023-07-14T13:34:37.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2651 2023-07-14T13:34:37.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2652 2023-07-14T13:34:37.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 13:00 2653 2023-07-14T13:34:37.124 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 13:00 2654 2023-07-14T13:34:37.125 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 13:00 2655 2023-07-14T13:34:37.125 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2656 2023-07-14T13:34:37.125 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2657 2023-07-14T13:34:37.125 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Jul 14 13:16 2658 2023-07-14T13:34:37.125 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 13:16 2659 2023-07-14T13:34:37.125 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2660 2023-07-14T13:34:37.125 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2661 2023-07-14T13:34:37.125 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 13:18 2662 2023-07-14T13:34:37.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 13:18 2663 2023-07-14T13:34:37.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:16 2664 2023-07-14T13:34:37.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:16 2665 2023-07-14T13:34:37.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:16 2666 2023-07-14T13:34:37.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:16 2667 2023-07-14T13:34:37.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2668 2023-07-14T13:34:37.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2669 2023-07-14T13:34:37.126 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2670 2023-07-14T13:34:37.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jul 14 13:16 2673 2023-07-14T13:34:37.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 14 13:16 2674 2023-07-14T13:34:37.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 14 13:00 2675 2023-07-14T13:34:37.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:16 2678 2023-07-14T13:34:37.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:16 2679 2023-07-14T13:34:37.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2680 2023-07-14T13:34:37.127 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2681 2023-07-14T13:34:37.128 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2682 2023-07-14T13:34:37.128 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2683 2023-07-14T13:34:37.128 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2684 2023-07-14T13:34:37.128 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2685 2023-07-14T13:34:37.128 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2686 2023-07-14T13:34:37.128 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2687 2023-07-14T13:34:37.128 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 13:00 2688 2023-07-14T13:34:37.128 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 14 13:00 2689 2023-07-14T13:34:37.129 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 14 13:00 2690 2023-07-14T13:34:37.129 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 14 13:00 2691 2023-07-14T13:34:37.129 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2692 2023-07-14T13:34:37.129 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2693 2023-07-14T13:34:37.129 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 13:31 2696 2023-07-14T13:34:37.129 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2699 2023-07-14T13:34:37.129 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2701 2023-07-14T13:34:37.129 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2702 2023-07-14T13:34:37.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:01 2703 2023-07-14T13:34:37.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 13:01 2704 2023-07-14T13:34:37.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2753 2023-07-14T13:34:37.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2753_fsm 2023-07-14T13:34:37.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2753_vm 2023-07-14T13:34:37.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2754 2023-07-14T13:34:37.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2755 2023-07-14T13:34:37.130 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 13:00 2756 2023-07-14T13:34:37.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 12:59 2757 2023-07-14T13:34:37.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2830 2023-07-14T13:34:37.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2830_vm 2023-07-14T13:34:37.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2831 2023-07-14T13:34:37.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2832 2023-07-14T13:34:37.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2832_vm 2023-07-14T13:34:37.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2833 2023-07-14T13:34:37.131 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2834 2023-07-14T13:34:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2834_vm 2023-07-14T13:34:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2835 2023-07-14T13:34:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2836 2023-07-14T13:34:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2836_vm 2023-07-14T13:34:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2837 2023-07-14T13:34:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 14 13:00 2838 2023-07-14T13:34:37.132 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2838_fsm 2023-07-14T13:34:37.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2838_vm 2023-07-14T13:34:37.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2839 2023-07-14T13:34:37.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2840 2023-07-14T13:34:37.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 2840_fsm 2023-07-14T13:34:37.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2840_vm 2023-07-14T13:34:37.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2841 2023-07-14T13:34:37.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2995 2023-07-14T13:34:37.133 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 2995_vm 2023-07-14T13:34:37.134 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2996 2023-07-14T13:34:37.134 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3079 2023-07-14T13:34:37.134 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3079_fsm 2023-07-14T13:34:37.134 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3079_vm 2023-07-14T13:34:37.134 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3080 2023-07-14T13:34:37.134 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3081 2023-07-14T13:34:37.134 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3085 2023-07-14T13:34:37.134 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3118 2023-07-14T13:34:37.135 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3118_vm 2023-07-14T13:34:37.135 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3119 2023-07-14T13:34:37.135 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3164 2023-07-14T13:34:37.135 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3256 2023-07-14T13:34:37.135 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3256_vm 2023-07-14T13:34:37.135 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3257 2023-07-14T13:34:37.135 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3258 2023-07-14T13:34:37.136 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3350 2023-07-14T13:34:37.136 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3350_vm 2023-07-14T13:34:37.136 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3351 2023-07-14T13:34:37.136 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3379 2023-07-14T13:34:37.136 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3380 2023-07-14T13:34:37.136 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3381 2023-07-14T13:34:37.136 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3381_vm 2023-07-14T13:34:37.136 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3394 2023-07-14T13:34:37.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3394_fsm 2023-07-14T13:34:37.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3394_vm 2023-07-14T13:34:37.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3395 2023-07-14T13:34:37.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3439 2023-07-14T13:34:37.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3439_vm 2023-07-14T13:34:37.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3440 2023-07-14T13:34:37.137 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 14 13:18 3455 2023-07-14T13:34:37.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3456 2023-07-14T13:34:37.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3456_fsm 2023-07-14T13:34:37.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3456_vm 2023-07-14T13:34:37.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3466 2023-07-14T13:34:37.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3466_vm 2023-07-14T13:34:37.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3467 2023-07-14T13:34:37.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3468 2023-07-14T13:34:37.138 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3501 2023-07-14T13:34:37.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3501_vm 2023-07-14T13:34:37.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3502 2023-07-14T13:34:37.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3503 2023-07-14T13:34:37.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3534 2023-07-14T13:34:37.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3541 2023-07-14T13:34:37.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3541_fsm 2023-07-14T13:34:37.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3541_vm 2023-07-14T13:34:37.139 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3542 2023-07-14T13:34:37.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3574 2023-07-14T13:34:37.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3575 2023-07-14T13:34:37.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3576 2023-07-14T13:34:37.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3576_vm 2023-07-14T13:34:37.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3596 2023-07-14T13:34:37.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3596_vm 2023-07-14T13:34:37.140 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3597 2023-07-14T13:34:37.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3598 2023-07-14T13:34:37.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 3598_vm 2023-07-14T13:34:37.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3599 2023-07-14T13:34:37.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3600 2023-07-14T13:34:37.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3600_fsm 2023-07-14T13:34:37.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3600_vm 2023-07-14T13:34:37.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3601 2023-07-14T13:34:37.141 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3601_fsm 2023-07-14T13:34:37.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3601_vm 2023-07-14T13:34:37.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3602 2023-07-14T13:34:37.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3602_fsm 2023-07-14T13:34:37.142 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3602_vm 2023-07-14T13:34:37.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3603 2023-07-14T13:34:37.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 13:00 3603_fsm 2023-07-14T13:34:37.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3603_vm 2023-07-14T13:34:37.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3604 2023-07-14T13:34:37.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3605 2023-07-14T13:34:37.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3606 2023-07-14T13:34:37.143 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3607 2023-07-14T13:34:37.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3608 2023-07-14T13:34:37.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 14 13:00 3609 2023-07-14T13:34:37.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3712 2023-07-14T13:34:37.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3764 2023-07-14T13:34:37.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 3764_fsm 2023-07-14T13:34:37.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3764_vm 2023-07-14T13:34:37.144 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 3766 2023-07-14T13:34:37.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 3767 2023-07-14T13:34:37.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 3997 2023-07-14T13:34:37.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 5002 2023-07-14T13:34:37.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 548 2023-07-14T13:34:37.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 549 2023-07-14T13:34:37.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6102 2023-07-14T13:34:37.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6102_vm 2023-07-14T13:34:37.145 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6104 2023-07-14T13:34:37.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6104_vm 2023-07-14T13:34:37.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6106 2023-07-14T13:34:37.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 6106_vm 2023-07-14T13:34:37.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 6110 2023-07-14T13:34:37.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 6111 2023-07-14T13:34:37.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 6112 2023-07-14T13:34:37.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6113 2023-07-14T13:34:37.146 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 6117 2023-07-14T13:34:37.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 826 2023-07-14T13:34:37.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:00 826_vm 2023-07-14T13:34:37.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 827 2023-07-14T13:34:37.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 828 2023-07-14T13:34:37.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 14 13:00 pg_filenode.map 2023-07-14T13:34:37.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Jul 14 13:00 pg_internal.init 2023-07-14T13:34:37.147 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 14 13:00 PG_VERSION 2023-07-14T13:34:37.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.148 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2023-07-14T13:34:37.148 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.224 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:18 . 2023-07-14T13:34:37.225 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7930429581 Jul 14 13:16 .. 2023-07-14T13:34:37.225 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.225 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/global: 2023-07-14T13:34:37.225 INFO:teuthology.orchestra.run.smithi017.stdout:total 575 2023-07-14T13:34:37.225 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Jul 14 13:00 . 2023-07-14T13:34:37.225 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1136 2023-07-14T13:34:37.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1136_fsm 2023-07-14T13:34:37.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1136_vm 2023-07-14T13:34:37.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 1137 2023-07-14T13:34:37.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1213 2023-07-14T13:34:37.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1213_fsm 2023-07-14T13:34:37.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1213_vm 2023-07-14T13:34:37.226 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1214 2023-07-14T13:34:37.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1214_fsm 2023-07-14T13:34:37.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1214_vm 2023-07-14T13:34:37.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 1232 2023-07-14T13:34:37.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 1233 2023-07-14T13:34:37.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1260 2023-07-14T13:34:37.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1260_fsm 2023-07-14T13:34:37.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1260_vm 2023-07-14T13:34:37.227 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1261 2023-07-14T13:34:37.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1261_fsm 2023-07-14T13:34:37.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1261_vm 2023-07-14T13:34:37.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 1262 2023-07-14T13:34:37.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 1262_fsm 2023-07-14T13:34:37.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 1262_vm 2023-07-14T13:34:37.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 2396 2023-07-14T13:34:37.228 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 14 12:59 2396_fsm 2023-07-14T13:34:37.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2396_vm 2023-07-14T13:34:37.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 13:00 2397 2023-07-14T13:34:37.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2671 2023-07-14T13:34:37.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2672 2023-07-14T13:34:37.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2676 2023-07-14T13:34:37.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2677 2023-07-14T13:34:37.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2694 2023-07-14T13:34:37.229 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2695 2023-07-14T13:34:37.230 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2697 2023-07-14T13:34:37.230 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 2698 2023-07-14T13:34:37.230 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2846 2023-07-14T13:34:37.230 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2846_vm 2023-07-14T13:34:37.230 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2847 2023-07-14T13:34:37.230 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2964 2023-07-14T13:34:37.278 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2964_vm 2023-07-14T13:34:37.278 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2965 2023-07-14T13:34:37.278 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2966 2023-07-14T13:34:37.278 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 2966_vm 2023-07-14T13:34:37.278 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 2967 2023-07-14T13:34:37.278 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3592 2023-07-14T13:34:37.279 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 3592_vm 2023-07-14T13:34:37.279 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 3593 2023-07-14T13:34:37.279 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 4060 2023-07-14T13:34:37.279 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 4060_vm 2023-07-14T13:34:37.279 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 4061 2023-07-14T13:34:37.280 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6000 2023-07-14T13:34:37.280 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6000_vm 2023-07-14T13:34:37.281 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6001 2023-07-14T13:34:37.281 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6002 2023-07-14T13:34:37.281 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6100 2023-07-14T13:34:37.281 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 6100_vm 2023-07-14T13:34:37.281 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6114 2023-07-14T13:34:37.281 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 6115 2023-07-14T13:34:37.281 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:34 pg_control 2023-07-14T13:34:37.282 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 14 12:59 pg_filenode.map 2023-07-14T13:34:37.282 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Jul 14 13:00 pg_internal.init 2023-07-14T13:34:37.282 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.282 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/log: 2023-07-14T13:34:37.282 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-07-14T13:34:37.282 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 838 Jul 14 13:00 . 2023-07-14T13:34:37.282 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.282 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 910 Jul 14 13:34 postgresql-Fri.log 2023-07-14T13:34:37.283 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.283 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-07-14T13:34:37.283 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.283 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:34:37.284 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.284 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-07-14T13:34:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.285 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:34:37.286 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.286 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.286 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-07-14T13:34:37.286 INFO:teuthology.orchestra.run.smithi017.stdout:total 3 2023-07-14T13:34:37.286 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 14 13:34 . 2023-07-14T13:34:37.286 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.287 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 mappings 2023-07-14T13:34:37.287 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 14 13:34 replorigin_checkpoint 2023-07-14T13:34:37.287 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 snapshots 2023-07-14T13:34:37.287 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.287 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-07-14T13:34:37.287 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.287 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:34:37.288 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 14 13:34 .. 2023-07-14T13:34:37.288 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.288 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-07-14T13:34:37.288 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.288 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:34:37.288 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 14 13:34 .. 2023-07-14T13:34:37.289 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.289 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-07-14T13:34:37.505 INFO:teuthology.orchestra.run.smithi017.stdout:total 2 2023-07-14T13:34:37.505 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 . 2023-07-14T13:34:37.506 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.506 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 members 2023-07-14T13:34:37.506 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 offsets 2023-07-14T13:34:37.507 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.507 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-07-14T13:34:37.507 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-07-14T13:34:37.508 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 . 2023-07-14T13:34:37.508 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 .. 2023-07-14T13:34:37.508 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 0000 2023-07-14T13:34:37.509 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.509 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-07-14T13:34:37.509 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-07-14T13:34:37.510 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 12:59 . 2023-07-14T13:34:37.510 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 14 12:59 .. 2023-07-14T13:34:37.510 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:01 0000 2023-07-14T13:34:37.510 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.511 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-07-14T13:34:37.511 INFO:teuthology.orchestra.run.smithi017.stdout:total 9 2023-07-14T13:34:37.511 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 . 2023-07-14T13:34:37.512 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.512 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 14 13:00 0000 2023-07-14T13:34:37.512 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.512 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-07-14T13:34:37.513 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.513 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:34:37.513 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.513 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.514 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-07-14T13:34:37.514 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.514 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:34:37.514 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.515 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.515 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-07-14T13:34:37.515 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.516 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:34:37.516 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.516 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.516 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-07-14T13:34:37.517 INFO:teuthology.orchestra.run.smithi017.stdout:total 14 2023-07-14T13:34:37.517 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Jul 14 13:34 . 2023-07-14T13:34:37.517 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.518 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Jul 14 13:34 db_0.stat 2023-07-14T13:34:37.518 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Jul 14 13:34 db_12347.stat 2023-07-14T13:34:37.518 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Jul 14 13:34 global.stat 2023-07-14T13:34:37.518 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.519 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-07-14T13:34:37.519 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.519 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 13:34 . 2023-07-14T13:34:37.519 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.520 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.520 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-07-14T13:34:37.520 INFO:teuthology.orchestra.run.smithi017.stdout:total 65 2023-07-14T13:34:37.520 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Jul 14 13:32 . 2023-07-14T13:34:37.521 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.521 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Jul 14 13:33 0006 2023-07-14T13:34:37.521 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.521 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-07-14T13:34:37.522 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.522 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:34:37.522 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.522 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.523 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-07-14T13:34:37.523 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.523 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:34:37.523 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.524 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.524 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-07-14T13:34:37.524 INFO:teuthology.orchestra.run.smithi017.stdout:total 1048578 2023-07-14T13:34:37.524 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1107296256 Jul 14 13:34 . 2023-07-14T13:34:37.525 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.525 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:33 0000000100000002000000D4 2023-07-14T13:34:37.525 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:33 0000000100000002000000D5 2023-07-14T13:34:37.525 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:34 0000000100000002000000D6 2023-07-14T13:34:37.526 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:29 0000000100000002000000D7 2023-07-14T13:34:37.526 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:29 0000000100000002000000D8 2023-07-14T13:34:37.526 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:29 0000000100000002000000D9 2023-07-14T13:34:37.526 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000DA 2023-07-14T13:34:37.527 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:29 0000000100000002000000DB 2023-07-14T13:34:37.527 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:29 0000000100000002000000DC 2023-07-14T13:34:37.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000DD 2023-07-14T13:34:37.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:29 0000000100000002000000DE 2023-07-14T13:34:37.528 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:29 0000000100000002000000DF 2023-07-14T13:34:37.529 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:29 0000000100000002000000E0 2023-07-14T13:34:37.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:29 0000000100000002000000E1 2023-07-14T13:34:37.530 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000E2 2023-07-14T13:34:37.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000E3 2023-07-14T13:34:37.531 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000E4 2023-07-14T13:34:37.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000E5 2023-07-14T13:34:37.532 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000E6 2023-07-14T13:34:37.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000E7 2023-07-14T13:34:37.533 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000E8 2023-07-14T13:34:37.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000E9 2023-07-14T13:34:37.534 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000EA 2023-07-14T13:34:37.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000EB 2023-07-14T13:34:37.535 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000EC 2023-07-14T13:34:37.536 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000ED 2023-07-14T13:34:37.537 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000EE 2023-07-14T13:34:37.537 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000EF 2023-07-14T13:34:37.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000F0 2023-07-14T13:34:37.538 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000F1 2023-07-14T13:34:37.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000F2 2023-07-14T13:34:37.539 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000F3 2023-07-14T13:34:37.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000F4 2023-07-14T13:34:37.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000F5 2023-07-14T13:34:37.540 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000F6 2023-07-14T13:34:37.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000F7 2023-07-14T13:34:37.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000F8 2023-07-14T13:34:37.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000F9 2023-07-14T13:34:37.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:30 0000000100000002000000FA 2023-07-14T13:34:37.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 0000000100000002000000FB 2023-07-14T13:34:37.542 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 0000000100000002000000FC 2023-07-14T13:34:37.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 0000000100000002000000FD 2023-07-14T13:34:37.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 0000000100000002000000FE 2023-07-14T13:34:37.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:33 0000000100000002000000FF 2023-07-14T13:34:37.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 000000010000000300000000 2023-07-14T13:34:37.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 000000010000000300000001 2023-07-14T13:34:37.543 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 000000010000000300000002 2023-07-14T13:34:37.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 000000010000000300000003 2023-07-14T13:34:37.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 000000010000000300000004 2023-07-14T13:34:37.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 000000010000000300000005 2023-07-14T13:34:37.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 000000010000000300000006 2023-07-14T13:34:37.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 000000010000000300000007 2023-07-14T13:34:37.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 000000010000000300000008 2023-07-14T13:34:37.544 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 000000010000000300000009 2023-07-14T13:34:37.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 00000001000000030000000A 2023-07-14T13:34:37.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 00000001000000030000000B 2023-07-14T13:34:37.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 00000001000000030000000C 2023-07-14T13:34:37.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 00000001000000030000000D 2023-07-14T13:34:37.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 00000001000000030000000E 2023-07-14T13:34:37.545 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 00000001000000030000000F 2023-07-14T13:34:37.546 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 000000010000000300000010 2023-07-14T13:34:37.546 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 000000010000000300000011 2023-07-14T13:34:37.546 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:32 000000010000000300000012 2023-07-14T13:34:37.546 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 14 13:31 000000010000000300000013 2023-07-14T13:34:37.546 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 archive_status 2023-07-14T13:34:37.546 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.546 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-07-14T13:34:37.547 INFO:teuthology.orchestra.run.smithi017.stdout:total 1 2023-07-14T13:34:37.547 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 14 12:59 . 2023-07-14T13:34:37.547 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1107296256 Jul 14 13:34 .. 2023-07-14T13:34:37.547 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:37.547 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-07-14T13:34:37.547 INFO:teuthology.orchestra.run.smithi017.stdout:total 105 2023-07-14T13:34:37.547 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 14 12:59 . 2023-07-14T13:34:37.548 INFO:teuthology.orchestra.run.smithi017.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9038551532 Jul 14 13:34 .. 2023-07-14T13:34:37.548 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 14 13:33 0000 2023-07-14T13:34:37.548 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-07-14T13:34:37.560 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi017.front.sepia.ceph.com 2023-07-14T13:34:37.572 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-07-14T13:34:37.592 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-07-14T13:34:37.593 INFO:teuthology.task.exec:Executing custom commands... 2023-07-14T13:34:37.593 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi017.front.sepia.ceph.com 2023-07-14T13:34:37.593 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-07-14T13:34:37.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-07-14T13:34:37.818 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-07-14T13:34:38.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.024+0000 7f3f651ff700 1 -- 172.21.15.17:0/3242127694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f600728b0 msgr2=0x7f3f60072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:38.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.024+0000 7f3f651ff700 1 --2- 172.21.15.17:0/3242127694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f600728b0 0x7f3f60072c80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f3f50009990 tx=0x7f3f50009ca0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.024+0000 7f3f651ff700 1 -- 172.21.15.17:0/3242127694 shutdown_connections 2023-07-14T13:34:38.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.024+0000 7f3f651ff700 1 --2- 172.21.15.17:0/3242127694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f6010c350 0x7f3f6010e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.019 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.024+0000 7f3f651ff700 1 --2- 172.21.15.17:0/3242127694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f600728b0 0x7f3f60072c80 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.024+0000 7f3f651ff700 1 --2- 172.21.15.17:0/3242127694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600731c0 0x7f3f6010be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.024+0000 7f3f651ff700 1 -- 172.21.15.17:0/3242127694 >> 172.21.15.17:0/3242127694 conn(0x7f3f600fb5f0 msgr2=0x7f3f600fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:38.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.024+0000 7f3f651ff700 1 -- 172.21.15.17:0/3242127694 shutdown_connections 2023-07-14T13:34:38.020 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.024+0000 7f3f651ff700 1 -- 172.21.15.17:0/3242127694 wait complete. 2023-07-14T13:34:38.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.025+0000 7f3f651ff700 1 Processor -- start 2023-07-14T13:34:38.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.026+0000 7f3f651ff700 1 -- start start 2023-07-14T13:34:38.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.026+0000 7f3f651ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600728b0 0x7f3f60197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:38.021 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.026+0000 7f3f651ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f600731c0 0x7f3f60198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:38.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.026+0000 7f3f651ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f6010c350 0x7f3f6019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:38.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.026+0000 7f3f651ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6019d120 con 0x7f3f600731c0 2023-07-14T13:34:38.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.026+0000 7f3f651ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6019d290 con 0x7f3f6010c350 2023-07-14T13:34:38.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.026+0000 7f3f651ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6019d450 con 0x7f3f600728b0 2023-07-14T13:34:38.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.027+0000 7f3f57fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f600731c0 0x7f3f60198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:38.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.027+0000 7f3f57fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f600731c0 0x7f3f60198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36828/0 (socket says 172.21.15.17:36828) 2023-07-14T13:34:38.022 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.027+0000 7f3f57fff700 1 -- 172.21.15.17:0/1213534718 learned_addr learned my addr 172.21.15.17:0/1213534718 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:38.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.027+0000 7f3f5f59e700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f6010c350 0x7f3f6019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:38.023 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.027+0000 7f3f5ed9d700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600728b0 0x7f3f60197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:38.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.027+0000 7f3f57fff700 1 -- 172.21.15.17:0/1213534718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600728b0 msgr2=0x7f3f60197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:38.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.027+0000 7f3f57fff700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600728b0 0x7f3f60197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.027+0000 7f3f57fff700 1 -- 172.21.15.17:0/1213534718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f6010c350 msgr2=0x7f3f6019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:38.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.027+0000 7f3f57fff700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f6010c350 0x7f3f6019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.027+0000 7f3f57fff700 1 -- 172.21.15.17:0/1213534718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500095f0 con 0x7f3f600731c0 2023-07-14T13:34:38.024 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.027+0000 7f3f57fff700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f600731c0 0x7f3f60198470 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800d950 tx=0x7f3f4800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:38.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.028+0000 7f3f5cd99700 1 -- 172.21.15.17:0/1213534718 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800f890 con 0x7f3f600731c0 2023-07-14T13:34:38.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.028+0000 7f3f5cd99700 1 -- 172.21.15.17:0/1213534718 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f4800fe80 con 0x7f3f600731c0 2023-07-14T13:34:38.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.028+0000 7f3f651ff700 1 -- 172.21.15.17:0/1213534718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6019d730 con 0x7f3f600731c0 2023-07-14T13:34:38.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.028+0000 7f3f5cd99700 1 -- 172.21.15.17:0/1213534718 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800e3b0 con 0x7f3f600731c0 2023-07-14T13:34:38.025 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.028+0000 7f3f651ff700 1 -- 172.21.15.17:0/1213534718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f601a4f70 con 0x7f3f600731c0 2023-07-14T13:34:38.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.029+0000 7f3f651ff700 1 -- 172.21.15.17:0/1213534718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f60107560 con 0x7f3f600731c0 2023-07-14T13:34:38.026 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.031+0000 7f3f5cd99700 1 -- 172.21.15.17:0/1213534718 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3f48010460 con 0x7f3f600731c0 2023-07-14T13:34:38.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.032+0000 7f3f5cd99700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f4c0a1340 0x7f3f4c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:38.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.032+0000 7f3f5cd99700 1 -- 172.21.15.17:0/1213534718 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3f480ccaa0 con 0x7f3f600731c0 2023-07-14T13:34:38.027 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.033+0000 7f3f5ed9d700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f4c0a1340 0x7f3f4c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:38.028 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.033+0000 7f3f5ed9d700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f4c0a1340 0x7f3f4c0a37f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f500036c0 tx=0x7f3f50009530 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:38.031 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.037+0000 7f3f5cd99700 1 -- 172.21.15.17:0/1213534718 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3f48095e70 con 0x7f3f600731c0 2023-07-14T13:34:38.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:37 smithi017 ceph-mon[95536]: pgmap v1107: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 296 KiB/s wr, 34 op/s 2023-07-14T13:34:38.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:37 smithi135 ceph-mon[97338]: pgmap v1107: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 296 KiB/s wr, 34 op/s 2023-07-14T13:34:38.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:37 smithi131 ceph-mon[96953]: pgmap v1107: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 296 KiB/s wr, 34 op/s 2023-07-14T13:34:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.271+0000 7f3f651ff700 1 -- 172.21.15.17:0/1213534718 --> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f60199490 con 0x7f3f4c0a1340 2023-07-14T13:34:38.436 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.308+0000 7f3f5cd99700 1 -- 172.21.15.17:0/1213534718 <== mgr.15525 v2:172.21.15.17:6800/3916014154 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3f60199490 con 0x7f3f4c0a1340 2023-07-14T13:34:38.437 INFO:teuthology.orchestra.run.smithi017.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-07-14T00:00:00", "created": "2023-07-14T12:59:44", "first": "2023-07-14T13:00:00", "last": "2023-07-14T13:34:00", "last_pruned": "2023-07-14T13:34:00", "created_count": 35, "pruned_count": 29, "active": true} 2023-07-14T13:34:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 -- 172.21.15.17:0/1213534718 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f4c0a1340 msgr2=0x7f3f4c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f4c0a1340 0x7f3f4c0a37f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3f500036c0 tx=0x7f3f50009530 comp rx=0 tx=0).stop 2023-07-14T13:34:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 -- 172.21.15.17:0/1213534718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f600731c0 msgr2=0x7f3f60198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f600731c0 0x7f3f60198470 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800d950 tx=0x7f3f4800dc60 comp rx=0 tx=0).stop 2023-07-14T13:34:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 -- 172.21.15.17:0/1213534718 shutdown_connections 2023-07-14T13:34:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f3f4c0a1340 0x7f3f4c0a37f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f6010c350 0x7f3f6019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600728b0 0x7f3f60197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 --2- 172.21.15.17:0/1213534718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f600731c0 0x7f3f60198470 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 -- 172.21.15.17:0/1213534718 >> 172.21.15.17:0/1213534718 conn(0x7f3f600fb5f0 msgr2=0x7f3f6010e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 -- 172.21.15.17:0/1213534718 shutdown_connections 2023-07-14T13:34:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.310+0000 7f3f651ff700 1 -- 172.21.15.17:0/1213534718 wait complete. 2023-07-14T13:34:38.440 DEBUG:teuthology.orchestra.run.smithi017:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-07-14T13:34:38.641 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.646+0000 7f0a661ff700 1 -- 172.21.15.17:0/2731247522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a600ffb00 msgr2=0x7f0a600fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.646+0000 7f0a661ff700 1 --2- 172.21.15.17:0/2731247522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a600ffb00 0x7f0a600fff70 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009990 tx=0x7f0a54009ca0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.646+0000 7f0a661ff700 1 -- 172.21.15.17:0/2731247522 shutdown_connections 2023-07-14T13:34:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.646+0000 7f0a661ff700 1 --2- 172.21.15.17:0/2731247522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a601004b0 0x7f0a6010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.646+0000 7f0a661ff700 1 --2- 172.21.15.17:0/2731247522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a60105b10 0x7f0a60105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.642 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.646+0000 7f0a661ff700 1 --2- 172.21.15.17:0/2731247522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a600ffb00 0x7f0a600fff70 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.646+0000 7f0a661ff700 1 -- 172.21.15.17:0/2731247522 >> 172.21.15.17:0/2731247522 conn(0x7f0a600fb600 msgr2=0x7f0a600fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.647+0000 7f0a661ff700 1 -- 172.21.15.17:0/2731247522 shutdown_connections 2023-07-14T13:34:38.643 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.647+0000 7f0a661ff700 1 -- 172.21.15.17:0/2731247522 wait complete. 2023-07-14T13:34:38.644 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.648+0000 7f0a661ff700 1 Processor -- start 2023-07-14T13:34:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.648+0000 7f0a661ff700 1 -- start start 2023-07-14T13:34:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.648+0000 7f0a661ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a600ffb00 0x7f0a600729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.648+0000 7f0a661ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a601004b0 0x7f0a60072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.648+0000 7f0a661ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a60105b10 0x7f0a601a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.648+0000 7f0a661ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a601a4270 con 0x7f0a600ffb00 2023-07-14T13:34:38.645 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.648+0000 7f0a661ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a601a43b0 con 0x7f0a60105b10 2023-07-14T13:34:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.648+0000 7f0a661ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a601a4520 con 0x7f0a601004b0 2023-07-14T13:34:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.648+0000 7f0a5f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a600ffb00 0x7f0a600729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.648+0000 7f0a5f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a600ffb00 0x7f0a600729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36850/0 (socket says 172.21.15.17:36850) 2023-07-14T13:34:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.648+0000 7f0a5f7fe700 1 -- 172.21.15.17:0/2789888102 learned_addr learned my addr 172.21.15.17:0/2789888102 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a5ffff700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a60105b10 0x7f0a601a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a5f7fe700 1 -- 172.21.15.17:0/2789888102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a601004b0 msgr2=0x7f0a60072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a5f7fe700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a601004b0 0x7f0a60072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.646 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a5f7fe700 1 -- 172.21.15.17:0/2789888102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a60105b10 msgr2=0x7f0a601a3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a5f7fe700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a60105b10 0x7f0a601a3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a5f7fe700 1 -- 172.21.15.17:0/2789888102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a540095f0 con 0x7f0a600ffb00 2023-07-14T13:34:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a5f7fe700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a600ffb00 0x7f0a600729f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000d980 tx=0x7f0a5000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a5cff9700 1 -- 172.21.15.17:0/2789888102 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50009b40 con 0x7f0a600ffb00 2023-07-14T13:34:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a5cff9700 1 -- 172.21.15.17:0/2789888102 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a5000de60 con 0x7f0a600ffb00 2023-07-14T13:34:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a5cff9700 1 -- 172.21.15.17:0/2789888102 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a500054e0 con 0x7f0a600ffb00 2023-07-14T13:34:38.647 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a661ff700 1 -- 172.21.15.17:0/2789888102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a601a4800 con 0x7f0a600ffb00 2023-07-14T13:34:38.648 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.649+0000 7f0a661ff700 1 -- 172.21.15.17:0/2789888102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a601a4cc0 con 0x7f0a600ffb00 2023-07-14T13:34:38.649 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.650+0000 7f0a661ff700 1 -- 172.21.15.17:0/2789888102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a600ff240 con 0x7f0a600ffb00 2023-07-14T13:34:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.652+0000 7f0a5cff9700 1 -- 172.21.15.17:0/2789888102 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f0a50004750 con 0x7f0a600ffb00 2023-07-14T13:34:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.654+0000 7f0a5cff9700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a480a1340 0x7f0a480a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.654+0000 7f0a5cff9700 1 -- 172.21.15.17:0/2789888102 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0a500ccbf0 con 0x7f0a600ffb00 2023-07-14T13:34:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.654+0000 7f0a5effd700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a480a1340 0x7f0a480a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:38.650 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.655+0000 7f0a5effd700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a480a1340 0x7f0a480a37f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0a540098e0 tx=0x7f0a54003680 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:38.652 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.658+0000 7f0a5cff9700 1 -- 172.21.15.17:0/2789888102 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0a50095fc0 con 0x7f0a600ffb00 2023-07-14T13:34:38.891 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.897+0000 7f0a661ff700 1 -- 172.21.15.17:0/2789888102 --> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0a60103d20 con 0x7f0a480a1340 2023-07-14T13:34:38.902 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.907+0000 7f0a5cff9700 1 -- 172.21.15.17:0/2789888102 <== mgr.15525 v2:172.21.15.17:6800/3916014154 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f0a60103d20 con 0x7f0a480a1340 2023-07-14T13:34:38.902 INFO:teuthology.orchestra.run.smithi017.stdout:/ 1M 6M3h 2023-07-14T13:34:38.904 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 -- 172.21.15.17:0/2789888102 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a480a1340 msgr2=0x7f0a480a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a480a1340 0x7f0a480a37f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0a540098e0 tx=0x7f0a54003680 comp rx=0 tx=0).stop 2023-07-14T13:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 -- 172.21.15.17:0/2789888102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a600ffb00 msgr2=0x7f0a600729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a600ffb00 0x7f0a600729f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000d980 tx=0x7f0a5000dd40 comp rx=0 tx=0).stop 2023-07-14T13:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 -- 172.21.15.17:0/2789888102 shutdown_connections 2023-07-14T13:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f0a480a1340 0x7f0a480a37f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a60105b10 0x7f0a601a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.905 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a600ffb00 0x7f0a600729f0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 --2- 172.21.15.17:0/2789888102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a601004b0 0x7f0a60072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 -- 172.21.15.17:0/2789888102 >> 172.21.15.17:0/2789888102 conn(0x7f0a600fb600 msgr2=0x7f0a60103610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 -- 172.21.15.17:0/2789888102 shutdown_connections 2023-07-14T13:34:38.906 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:38.910+0000 7f0a661ff700 1 -- 172.21.15.17:0/2789888102 wait complete. 2023-07-14T13:34:38.923 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-07-14T13:34:38.936 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-07-14T13:34:38.937 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-07-14T13:34:38.937 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-07-14T13:34:38.947 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:34:39.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.158+0000 7f351b3ff700 1 -- 172.21.15.17:0/1542394564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351410c310 msgr2=0x7f351410e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:39.153 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.158+0000 7f351b3ff700 1 --2- 172.21.15.17:0/1542394564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351410c310 0x7f351410e6f0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f350c00b0a0 tx=0x7f350c00b3b0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.158+0000 7f351b3ff700 1 -- 172.21.15.17:0/1542394564 shutdown_connections 2023-07-14T13:34:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.158+0000 7f351b3ff700 1 --2- 172.21.15.17:0/1542394564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351410c310 0x7f351410e6f0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.158+0000 7f351b3ff700 1 --2- 172.21.15.17:0/1542394564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35140728b0 0x7f3514072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.158+0000 7f351b3ff700 1 --2- 172.21.15.17:0/1542394564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35140731c0 0x7f351410bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.158+0000 7f351b3ff700 1 -- 172.21.15.17:0/1542394564 >> 172.21.15.17:0/1542394564 conn(0x7f35140fb590 msgr2=0x7f35140fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.158+0000 7f351b3ff700 1 -- 172.21.15.17:0/1542394564 shutdown_connections 2023-07-14T13:34:39.154 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.158+0000 7f351b3ff700 1 -- 172.21.15.17:0/1542394564 wait complete. 2023-07-14T13:34:39.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.159+0000 7f351b3ff700 1 Processor -- start 2023-07-14T13:34:39.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.160+0000 7f351b3ff700 1 -- start start 2023-07-14T13:34:39.156 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.160+0000 7f351b3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35140728b0 0x7f3514197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.160+0000 7f351b3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35140731c0 0x7f3514198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.160+0000 7f351b3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f351410c310 0x7f351419c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.160+0000 7f351b3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351419ce00 con 0x7f35140728b0 2023-07-14T13:34:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.160+0000 7f351b3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351419cf70 con 0x7f351410c310 2023-07-14T13:34:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.160+0000 7f351b3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351419d130 con 0x7f35140731c0 2023-07-14T13:34:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.160+0000 7f351919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35140728b0 0x7f3514197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.160+0000 7f351919b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35140728b0 0x7f3514197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36874/0 (socket says 172.21.15.17:36874) 2023-07-14T13:34:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.160+0000 7f351919b700 1 -- 172.21.15.17:0/3565292317 learned_addr learned my addr 172.21.15.17:0/3565292317 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:39.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f351899a700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35140731c0 0x7f3514198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:39.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f351999c700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f351410c310 0x7f351419c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:39.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f351919b700 1 -- 172.21.15.17:0/3565292317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35140731c0 msgr2=0x7f3514198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:39.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f351919b700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35140731c0 0x7f3514198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f351919b700 1 -- 172.21.15.17:0/3565292317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f351410c310 msgr2=0x7f351419c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:39.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f351919b700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f351410c310 0x7f351419c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.158 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f351919b700 1 -- 172.21.15.17:0/3565292317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009d00 con 0x7f35140728b0 2023-07-14T13:34:39.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f351919b700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35140728b0 0x7f3514197e20 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f351000d950 tx=0x7f351000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:39.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f350a7fc700 1 -- 172.21.15.17:0/3565292317 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000f890 con 0x7f35140728b0 2023-07-14T13:34:39.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f350a7fc700 1 -- 172.21.15.17:0/3565292317 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f351000fe80 con 0x7f35140728b0 2023-07-14T13:34:39.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f350a7fc700 1 -- 172.21.15.17:0/3565292317 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000e3b0 con 0x7f35140728b0 2023-07-14T13:34:39.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.161+0000 7f351b3ff700 1 -- 172.21.15.17:0/3565292317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351419d410 con 0x7f35140728b0 2023-07-14T13:34:39.159 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.162+0000 7f351b3ff700 1 -- 172.21.15.17:0/3565292317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35141a4c50 con 0x7f35140728b0 2023-07-14T13:34:39.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.163+0000 7f351b3ff700 1 -- 172.21.15.17:0/3565292317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3514067300 con 0x7f35140728b0 2023-07-14T13:34:39.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.165+0000 7f350a7fc700 1 -- 172.21.15.17:0/3565292317 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3510010460 con 0x7f35140728b0 2023-07-14T13:34:39.160 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.166+0000 7f350a7fc700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35000a1380 0x7f35000a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:39.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.166+0000 7f350a7fc700 1 -- 172.21.15.17:0/3565292317 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f35100ccac0 con 0x7f35140728b0 2023-07-14T13:34:39.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.166+0000 7f351899a700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35000a1380 0x7f35000a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:39.161 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.167+0000 7f351899a700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35000a1380 0x7f35000a3830 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3514199430 tx=0x7f350400b410 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:39.164 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.170+0000 7f350a7fc700 1 -- 172.21.15.17:0/3565292317 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3510095e90 con 0x7f35140728b0 2023-07-14T13:34:39.374 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.379+0000 7f351b3ff700 1 -- 172.21.15.17:0/3565292317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35141a4f20 con 0x7f35140728b0 2023-07-14T13:34:39.376 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.381+0000 7f350a7fc700 1 -- 172.21.15.17:0/3565292317 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+22939 (secure 0 0 0) 0x7f3510016090 con 0x7f35140728b0 2023-07-14T13:34:39.377 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:39.378 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":147,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T13:34:16.833291+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":65,"snap_epoch":146,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/645612714":"2023-07-15T12:59:43.864189+0000","172.21.15.17:0/1809272973":"2023-07-15T12:59:43.864189+0000","172.21.15.17:6800/2034486077":"2023-07-15T12:59:43.864189+0000","172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/2034486077":"2023-07-15T12:59:43.864189+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/895305494":"2023-07-15T12:59:43.864189+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1285371613":"2023-07-15T12:59:43.864189+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":52,"length":1},{"begin":65,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:34:39.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.383+0000 7f351b3ff700 1 -- 172.21.15.17:0/3565292317 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35000a1380 msgr2=0x7f35000a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:39.379 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.383+0000 7f351b3ff700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35000a1380 0x7f35000a3830 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3514199430 tx=0x7f350400b410 comp rx=0 tx=0).stop 2023-07-14T13:34:39.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.383+0000 7f351b3ff700 1 -- 172.21.15.17:0/3565292317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35140728b0 msgr2=0x7f3514197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:39.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.383+0000 7f351b3ff700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35140728b0 0x7f3514197e20 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f351000d950 tx=0x7f351000dc60 comp rx=0 tx=0).stop 2023-07-14T13:34:39.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.383+0000 7f351b3ff700 1 -- 172.21.15.17:0/3565292317 shutdown_connections 2023-07-14T13:34:39.380 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.383+0000 7f351b3ff700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f35000a1380 0x7f35000a3830 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.384+0000 7f351b3ff700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f351410c310 0x7f351419c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.384+0000 7f351b3ff700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35140728b0 0x7f3514197e20 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.384+0000 7f351b3ff700 1 --2- 172.21.15.17:0/3565292317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35140731c0 0x7f3514198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.381 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.384+0000 7f351b3ff700 1 -- 172.21.15.17:0/3565292317 >> 172.21.15.17:0/3565292317 conn(0x7f35140fb590 msgr2=0x7f351410e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:39.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.384+0000 7f351b3ff700 1 -- 172.21.15.17:0/3565292317 shutdown_connections 2023-07-14T13:34:39.382 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.384+0000 7f351b3ff700 1 -- 172.21.15.17:0/3565292317 wait complete. 2023-07-14T13:34:39.397 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:57:37.876360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:57:39.117456+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 65, 'snap_epoch': 146, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:34:39.398 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:34:39.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.609+0000 7f64643ff700 1 -- 172.21.15.17:0/3856504853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f645c105ae0 msgr2=0x7f645c105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:39.604 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.609+0000 7f64643ff700 1 --2- 172.21.15.17:0/3856504853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f645c105ae0 0x7f645c105eb0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f6458009990 tx=0x7f6458009ca0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.609+0000 7f64643ff700 1 -- 172.21.15.17:0/3856504853 shutdown_connections 2023-07-14T13:34:39.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.609+0000 7f64643ff700 1 --2- 172.21.15.17:0/3856504853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c100480 0x7f645c10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.609+0000 7f64643ff700 1 --2- 172.21.15.17:0/3856504853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f645c105ae0 0x7f645c105eb0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.609+0000 7f64643ff700 1 --2- 172.21.15.17:0/3856504853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c0ffad0 0x7f645c0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.609+0000 7f64643ff700 1 -- 172.21.15.17:0/3856504853 >> 172.21.15.17:0/3856504853 conn(0x7f645c0fb5f0 msgr2=0x7f645c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:39.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.609+0000 7f64643ff700 1 -- 172.21.15.17:0/3856504853 shutdown_connections 2023-07-14T13:34:39.605 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.609+0000 7f64643ff700 1 -- 172.21.15.17:0/3856504853 wait complete. 2023-07-14T13:34:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.610+0000 7f64643ff700 1 Processor -- start 2023-07-14T13:34:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.611+0000 7f64643ff700 1 -- start start 2023-07-14T13:34:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.611+0000 7f64643ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f645c0ffad0 0x7f645c072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.611+0000 7f64643ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c100480 0x7f645c072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:39.607 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.611+0000 7f64643ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c105ae0 0x7f645c1a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.611+0000 7f64643ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c073580 con 0x7f645c0ffad0 2023-07-14T13:34:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.611+0000 7f64643ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c1a4180 con 0x7f645c105ae0 2023-07-14T13:34:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.611+0000 7f64643ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c1a42c0 con 0x7f645c100480 2023-07-14T13:34:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.611+0000 7f646219b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f645c0ffad0 0x7f645c072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.611+0000 7f646219b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f645c0ffad0 0x7f645c072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36886/0 (socket says 172.21.15.17:36886) 2023-07-14T13:34:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.611+0000 7f646219b700 1 -- 172.21.15.17:0/1473422276 learned_addr learned my addr 172.21.15.17:0/1473422276 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.611+0000 7f646299c700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c105ae0 0x7f645c1a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.612+0000 7f646199a700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c100480 0x7f645c072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.612+0000 7f646219b700 1 -- 172.21.15.17:0/1473422276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c100480 msgr2=0x7f645c072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.612+0000 7f646219b700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c100480 0x7f645c072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.612+0000 7f646219b700 1 -- 172.21.15.17:0/1473422276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c105ae0 msgr2=0x7f645c1a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.612+0000 7f646219b700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c105ae0 0x7f645c1a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.612+0000 7f646219b700 1 -- 172.21.15.17:0/1473422276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64580095f0 con 0x7f645c0ffad0 2023-07-14T13:34:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.612+0000 7f646219b700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f645c0ffad0 0x7f645c072810 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f64580036c0 tx=0x7f6458005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:39.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.612+0000 7f64537fe700 1 -- 172.21.15.17:0/1473422276 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645801d070 con 0x7f645c0ffad0 2023-07-14T13:34:39.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.612+0000 7f64537fe700 1 -- 172.21.15.17:0/1473422276 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6458003ec0 con 0x7f645c0ffad0 2023-07-14T13:34:39.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.612+0000 7f64643ff700 1 -- 172.21.15.17:0/1473422276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c1a44c0 con 0x7f645c0ffad0 2023-07-14T13:34:39.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.613+0000 7f64537fe700 1 -- 172.21.15.17:0/1473422276 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458022b00 con 0x7f645c0ffad0 2023-07-14T13:34:39.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.613+0000 7f64643ff700 1 -- 172.21.15.17:0/1473422276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c1a4940 con 0x7f645c0ffad0 2023-07-14T13:34:39.610 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.614+0000 7f64643ff700 1 -- 172.21.15.17:0/1473422276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c067290 con 0x7f645c0ffad0 2023-07-14T13:34:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.617+0000 7f64537fe700 1 -- 172.21.15.17:0/1473422276 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f6458004030 con 0x7f645c0ffad0 2023-07-14T13:34:39.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.619+0000 7f64537fe700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64480a1340 0x7f64480a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:39.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.619+0000 7f64537fe700 1 -- 172.21.15.17:0/1473422276 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f64580ce940 con 0x7f645c0ffad0 2023-07-14T13:34:39.613 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.619+0000 7f646199a700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64480a1340 0x7f64480a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:39.614 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.619+0000 7f646199a700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64480a1340 0x7f64480a37f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f645c074000 tx=0x7f644c00a380 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:39.615 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.620+0000 7f64537fe700 1 -- 172.21.15.17:0/1473422276 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f6458097da0 con 0x7f645c0ffad0 2023-07-14T13:34:39.823 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.829+0000 7f64643ff700 1 -- 172.21.15.17:0/1473422276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f645c1a4bf0 con 0x7f645c0ffad0 2023-07-14T13:34:39.842 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.848+0000 7f64537fe700 1 -- 172.21.15.17:0/1473422276 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v147) v1 ==== 93+0+10 (secure 0 0 0) 0x7f645809b3c0 con 0x7f645c0ffad0 2023-07-14T13:34:39.843 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T13:34:39.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.850+0000 7f64643ff700 1 -- 172.21.15.17:0/1473422276 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64480a1340 msgr2=0x7f64480a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:39.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.850+0000 7f64643ff700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64480a1340 0x7f64480a37f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f645c074000 tx=0x7f644c00a380 comp rx=0 tx=0).stop 2023-07-14T13:34:39.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.850+0000 7f64643ff700 1 -- 172.21.15.17:0/1473422276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f645c0ffad0 msgr2=0x7f645c072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:39.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.850+0000 7f64643ff700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f645c0ffad0 0x7f645c072810 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f64580036c0 tx=0x7f6458005740 comp rx=0 tx=0).stop 2023-07-14T13:34:39.845 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.850+0000 7f64643ff700 1 -- 172.21.15.17:0/1473422276 shutdown_connections 2023-07-14T13:34:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.850+0000 7f64643ff700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f64480a1340 0x7f64480a37f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.850+0000 7f64643ff700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f645c105ae0 0x7f645c1a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.850+0000 7f64643ff700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f645c0ffad0 0x7f645c072810 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.850+0000 7f64643ff700 1 --2- 172.21.15.17:0/1473422276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f645c100480 0x7f645c072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.850+0000 7f64643ff700 1 -- 172.21.15.17:0/1473422276 >> 172.21.15.17:0/1473422276 conn(0x7f645c0fb5f0 msgr2=0x7f645c0fbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.851+0000 7f64643ff700 1 -- 172.21.15.17:0/1473422276 shutdown_connections 2023-07-14T13:34:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:39.851+0000 7f64643ff700 1 -- 172.21.15.17:0/1473422276 wait complete. 2023-07-14T13:34:39.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:34:40.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.075+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3283481695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d8105af0 msgr2=0x7f74d8105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.070 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.075+0000 7f74dd3ff700 1 --2- 172.21.15.17:0/3283481695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d8105af0 0x7f74d8105ec0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f74c800b0a0 tx=0x7f74c800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.076+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3283481695 shutdown_connections 2023-07-14T13:34:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.076+0000 7f74dd3ff700 1 --2- 172.21.15.17:0/3283481695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8100490 0x7f74d810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.076+0000 7f74dd3ff700 1 --2- 172.21.15.17:0/3283481695 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d8105af0 0x7f74d8105ec0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.076+0000 7f74dd3ff700 1 --2- 172.21.15.17:0/3283481695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d80ffae0 0x7f74d80fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.076+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3283481695 >> 172.21.15.17:0/3283481695 conn(0x7f74d80fb5e0 msgr2=0x7f74d80fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.076+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3283481695 shutdown_connections 2023-07-14T13:34:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.076+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3283481695 wait complete. 2023-07-14T13:34:40.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.077+0000 7f74dd3ff700 1 Processor -- start 2023-07-14T13:34:40.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.077+0000 7f74dd3ff700 1 -- start start 2023-07-14T13:34:40.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.077+0000 7f74dd3ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d80ffae0 0x7f74d8197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.073 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.077+0000 7f74dd3ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d8100490 0x7f74d8198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.077+0000 7f74dd3ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8105af0 0x7f74d819c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.077+0000 7f74dd3ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d819ce30 con 0x7f74d80ffae0 2023-07-14T13:34:40.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.077+0000 7f74dd3ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d819cfa0 con 0x7f74d8105af0 2023-07-14T13:34:40.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.077+0000 7f74dd3ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d819d160 con 0x7f74d8100490 2023-07-14T13:34:40.074 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.077+0000 7f74d6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d80ffae0 0x7f74d8197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.077+0000 7f74d6ffd700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d80ffae0 0x7f74d8197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36910/0 (socket says 172.21.15.17:36910) 2023-07-14T13:34:40.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.077+0000 7f74d6ffd700 1 -- 172.21.15.17:0/3828386899 learned_addr learned my addr 172.21.15.17:0/3828386899 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:40.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.078+0000 7f74cffff700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d8100490 0x7f74d8198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.078+0000 7f74d6ffd700 1 -- 172.21.15.17:0/3828386899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d8100490 msgr2=0x7f74d8198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.078+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d8100490 0x7f74d8198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.078+0000 7f74d6ffd700 1 -- 172.21.15.17:0/3828386899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8105af0 msgr2=0x7f74d819c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.075 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.078+0000 7f74d77fe700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8105af0 0x7f74d819c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.078+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8105af0 0x7f74d819c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.078+0000 7f74d6ffd700 1 -- 172.21.15.17:0/3828386899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8009d00 con 0x7f74d80ffae0 2023-07-14T13:34:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.078+0000 7f74cffff700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d8100490 0x7f74d8198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:34:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.078+0000 7f74d77fe700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8105af0 0x7f74d819c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:34:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.078+0000 7f74d6ffd700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d80ffae0 0x7f74d8197e50 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f74c800b070 tx=0x7f74c800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.078+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3828386899 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c800e040 con 0x7f74d80ffae0 2023-07-14T13:34:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.079+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3828386899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d819d3e0 con 0x7f74d80ffae0 2023-07-14T13:34:40.076 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.079+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3828386899 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74c8003e10 con 0x7f74d80ffae0 2023-07-14T13:34:40.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.079+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3828386899 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c80052a0 con 0x7f74d80ffae0 2023-07-14T13:34:40.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.079+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3828386899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d81a4c80 con 0x7f74d80ffae0 2023-07-14T13:34:40.077 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.080+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3828386899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d8067290 con 0x7f74d80ffae0 2023-07-14T13:34:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.082+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3828386899 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f74c801b9e0 con 0x7f74d80ffae0 2023-07-14T13:34:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.083+0000 7f74d4ff9700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74c40a12c0 0x7f74c40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.083+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3828386899 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f74c80ce400 con 0x7f74d80ffae0 2023-07-14T13:34:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.083+0000 7f74cffff700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74c40a12c0 0x7f74c40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.084+0000 7f74cffff700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74c40a12c0 0x7f74c40a3770 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f74d8199460 tx=0x7f74c0009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:40.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.087+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3828386899 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f74c8097860 con 0x7f74d80ffae0 2023-07-14T13:34:40.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:39 smithi135 ceph-mon[97338]: from='client.19953 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T13:34:40.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:39 smithi135 ceph-mon[97338]: pgmap v1108: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 157 KiB/s wr, 19 op/s 2023-07-14T13:34:40.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:39 smithi135 ceph-mon[97338]: from='client.19959 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T13:34:40.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:39 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3565292317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T13:34:40.163 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:39 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1473422276' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T13:34:40.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:39 smithi131 ceph-mon[96953]: from='client.19953 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T13:34:40.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:39 smithi131 ceph-mon[96953]: pgmap v1108: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 157 KiB/s wr, 19 op/s 2023-07-14T13:34:40.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:39 smithi131 ceph-mon[96953]: from='client.19959 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T13:34:40.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:39 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3565292317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T13:34:40.212 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:39 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1473422276' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T13:34:40.290 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.295+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3828386899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74d81a4e10 con 0x7f74d80ffae0 2023-07-14T13:34:40.291 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.296+0000 7f74d4ff9700 1 -- 172.21.15.17:0/3828386899 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v147) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74c809ae80 con 0x7f74d80ffae0 2023-07-14T13:34:40.291 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-07-14T13:34:40.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.298+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3828386899 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74c40a12c0 msgr2=0x7f74c40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.298+0000 7f74dd3ff700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74c40a12c0 0x7f74c40a3770 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f74d8199460 tx=0x7f74c0009260 comp rx=0 tx=0).stop 2023-07-14T13:34:40.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.298+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3828386899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d80ffae0 msgr2=0x7f74d8197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.293 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.298+0000 7f74dd3ff700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d80ffae0 0x7f74d8197e50 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f74c800b070 tx=0x7f74c800be10 comp rx=0 tx=0).stop 2023-07-14T13:34:40.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.299+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3828386899 shutdown_connections 2023-07-14T13:34:40.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.299+0000 7f74dd3ff700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f74c40a12c0 0x7f74c40a3770 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.299+0000 7f74dd3ff700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74d8105af0 0x7f74d819c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.299+0000 7f74dd3ff700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74d80ffae0 0x7f74d8197e50 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.299+0000 7f74dd3ff700 1 --2- 172.21.15.17:0/3828386899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74d8100490 0x7f74d8198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.299+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3828386899 >> 172.21.15.17:0/3828386899 conn(0x7f74d80fb5e0 msgr2=0x7f74d810ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:40.294 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.299+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3828386899 shutdown_connections 2023-07-14T13:34:40.295 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.299+0000 7f74dd3ff700 1 -- 172.21.15.17:0/3828386899 wait complete. 2023-07-14T13:34:40.309 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:39 smithi017 ceph-mon[95536]: from='client.19953 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T13:34:40.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:39 smithi017 ceph-mon[95536]: pgmap v1108: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 157 KiB/s wr, 19 op/s 2023-07-14T13:34:40.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:39 smithi017 ceph-mon[95536]: from='client.19959 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T13:34:40.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:39 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3565292317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T13:34:40.310 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:39 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1473422276' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T13:34:40.312 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:34:40.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.522+0000 7f3152bff700 1 -- 172.21.15.17:0/222478923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f314c0ffad0 msgr2=0x7f314c0fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.522+0000 7f3152bff700 1 --2- 172.21.15.17:0/222478923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f314c0ffad0 0x7f314c0fff40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f3138009990 tx=0x7f3138009ca0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.522+0000 7f3152bff700 1 -- 172.21.15.17:0/222478923 shutdown_connections 2023-07-14T13:34:40.517 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.522+0000 7f3152bff700 1 --2- 172.21.15.17:0/222478923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f314c100480 0x7f314c10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.522+0000 7f3152bff700 1 --2- 172.21.15.17:0/222478923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c105ae0 0x7f314c105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.522+0000 7f3152bff700 1 --2- 172.21.15.17:0/222478923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f314c0ffad0 0x7f314c0fff40 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.522+0000 7f3152bff700 1 -- 172.21.15.17:0/222478923 >> 172.21.15.17:0/222478923 conn(0x7f314c0fb5f0 msgr2=0x7f314c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.522+0000 7f3152bff700 1 -- 172.21.15.17:0/222478923 shutdown_connections 2023-07-14T13:34:40.518 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.522+0000 7f3152bff700 1 -- 172.21.15.17:0/222478923 wait complete. 2023-07-14T13:34:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.523+0000 7f3152bff700 1 Processor -- start 2023-07-14T13:34:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.523+0000 7f3152bff700 1 -- start start 2023-07-14T13:34:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f3152bff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f314c0ffad0 0x7f314c072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f3152bff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c100480 0x7f314c072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f3152bff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f314c105ae0 0x7f314c073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f3152bff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c1a3f80 con 0x7f314c0ffad0 2023-07-14T13:34:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f3152bff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c1a40f0 con 0x7f314c100480 2023-07-14T13:34:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f3152bff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c1a42b0 con 0x7f314c105ae0 2023-07-14T13:34:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f315099b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f314c0ffad0 0x7f314c072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f315099b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f314c0ffad0 0x7f314c072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36936/0 (socket says 172.21.15.17:36936) 2023-07-14T13:34:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f315099b700 1 -- 172.21.15.17:0/1013933984 learned_addr learned my addr 172.21.15.17:0/1013933984 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f315119c700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f314c105ae0 0x7f314c073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f314bfff700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c100480 0x7f314c072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f315099b700 1 -- 172.21.15.17:0/1013933984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f314c105ae0 msgr2=0x7f314c073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f315099b700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f314c105ae0 0x7f314c073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f315099b700 1 -- 172.21.15.17:0/1013933984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c100480 msgr2=0x7f314c072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f315099b700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c100480 0x7f314c072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f315099b700 1 -- 172.21.15.17:0/1013933984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3140009520 con 0x7f314c0ffad0 2023-07-14T13:34:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f315119c700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f314c105ae0 0x7f314c073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:34:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.524+0000 7f314bfff700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c100480 0x7f314c072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:34:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.525+0000 7f315099b700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f314c0ffad0 0x7f314c072810 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f314000eb30 tx=0x7f314000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.525+0000 7f3149ffb700 1 -- 172.21.15.17:0/1013933984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140009880 con 0x7f314c0ffad0 2023-07-14T13:34:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.525+0000 7f3152bff700 1 -- 172.21.15.17:0/1013933984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31380095f0 con 0x7f314c0ffad0 2023-07-14T13:34:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.525+0000 7f3149ffb700 1 -- 172.21.15.17:0/1013933984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31400044b0 con 0x7f314c0ffad0 2023-07-14T13:34:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.525+0000 7f3149ffb700 1 -- 172.21.15.17:0/1013933984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140003e40 con 0x7f314c0ffad0 2023-07-14T13:34:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.525+0000 7f3152bff700 1 -- 172.21.15.17:0/1013933984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c1a4960 con 0x7f314c0ffad0 2023-07-14T13:34:40.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.526+0000 7f3152bff700 1 -- 172.21.15.17:0/1013933984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c067290 con 0x7f314c0ffad0 2023-07-14T13:34:40.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.528+0000 7f3149ffb700 1 -- 172.21.15.17:0/1013933984 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f3140003fa0 con 0x7f314c0ffad0 2023-07-14T13:34:40.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.530+0000 7f3149ffb700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f313c0a12c0 0x7f313c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.530+0000 7f3149ffb700 1 -- 172.21.15.17:0/1013933984 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3140014070 con 0x7f314c0ffad0 2023-07-14T13:34:40.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.530+0000 7f314bfff700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f313c0a12c0 0x7f313c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.531+0000 7f314bfff700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f313c0a12c0 0x7f313c0a3770 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3138006010 tx=0x7f313800b260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:40.528 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.534+0000 7f3149ffb700 1 -- 172.21.15.17:0/1013933984 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f3140096540 con 0x7f314c0ffad0 2023-07-14T13:34:40.739 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.744+0000 7f3152bff700 1 -- 172.21.15.17:0/1013933984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f314c1a4cb0 con 0x7f314c0ffad0 2023-07-14T13:34:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.745+0000 7f3149ffb700 1 -- 172.21.15.17:0/1013933984 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v147) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3140099b60 con 0x7f314c0ffad0 2023-07-14T13:34:40.740 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-07-14T13:34:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.747+0000 7f3152bff700 1 -- 172.21.15.17:0/1013933984 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f313c0a12c0 msgr2=0x7f313c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.747+0000 7f3152bff700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f313c0a12c0 0x7f313c0a3770 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3138006010 tx=0x7f313800b260 comp rx=0 tx=0).stop 2023-07-14T13:34:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.747+0000 7f3152bff700 1 -- 172.21.15.17:0/1013933984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f314c0ffad0 msgr2=0x7f314c072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.747+0000 7f3152bff700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f314c0ffad0 0x7f314c072810 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f314000eb30 tx=0x7f314000eef0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.748+0000 7f3152bff700 1 -- 172.21.15.17:0/1013933984 shutdown_connections 2023-07-14T13:34:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.748+0000 7f3152bff700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f313c0a12c0 0x7f313c0a3770 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.748+0000 7f3152bff700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f314c105ae0 0x7f314c073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.748+0000 7f3152bff700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f314c0ffad0 0x7f314c072810 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.748+0000 7f3152bff700 1 --2- 172.21.15.17:0/1013933984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f314c100480 0x7f314c072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.748+0000 7f3152bff700 1 -- 172.21.15.17:0/1013933984 >> 172.21.15.17:0/1013933984 conn(0x7f314c0fb5f0 msgr2=0x7f314c0fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.748+0000 7f3152bff700 1 -- 172.21.15.17:0/1013933984 shutdown_connections 2023-07-14T13:34:40.744 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.748+0000 7f3152bff700 1 -- 172.21.15.17:0/1013933984 wait complete. 2023-07-14T13:34:40.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-07-14T13:34:40.966 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.972+0000 7fe3f95ff700 1 -- 172.21.15.17:0/2872685294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f40ffad0 msgr2=0x7fe3f40fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.972+0000 7fe3f95ff700 1 --2- 172.21.15.17:0/2872685294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f40ffad0 0x7fe3f40fff40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009990 tx=0x7fe3e8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.972+0000 7fe3f95ff700 1 -- 172.21.15.17:0/2872685294 shutdown_connections 2023-07-14T13:34:40.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.972+0000 7fe3f95ff700 1 --2- 172.21.15.17:0/2872685294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3f4100480 0x7fe3f410c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.967 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.972+0000 7fe3f95ff700 1 --2- 172.21.15.17:0/2872685294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f4105ae0 0x7fe3f4105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.972+0000 7fe3f95ff700 1 --2- 172.21.15.17:0/2872685294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f40ffad0 0x7fe3f40fff40 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.972+0000 7fe3f95ff700 1 -- 172.21.15.17:0/2872685294 >> 172.21.15.17:0/2872685294 conn(0x7fe3f40fb590 msgr2=0x7fe3f40fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:40.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.972+0000 7fe3f95ff700 1 -- 172.21.15.17:0/2872685294 shutdown_connections 2023-07-14T13:34:40.968 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.972+0000 7fe3f95ff700 1 -- 172.21.15.17:0/2872685294 wait complete. 2023-07-14T13:34:40.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.973+0000 7fe3f95ff700 1 Processor -- start 2023-07-14T13:34:40.970 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.973+0000 7fe3f95ff700 1 -- start start 2023-07-14T13:34:40.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.973+0000 7fe3f95ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f40ffad0 0x7fe3f419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.973+0000 7fe3f95ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3f4100480 0x7fe3f419e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.973+0000 7fe3f95ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4105ae0 0x7fe3f4197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.973+0000 7fe3f95ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f4198300 con 0x7fe3f4105ae0 2023-07-14T13:34:40.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.973+0000 7fe3f95ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f4198470 con 0x7fe3f40ffad0 2023-07-14T13:34:40.971 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.973+0000 7fe3f95ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f4198630 con 0x7fe3f4100480 2023-07-14T13:34:40.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.974+0000 7fe3f37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4105ae0 0x7fe3f4197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.974+0000 7fe3f37fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4105ae0 0x7fe3f4197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36964/0 (socket says 172.21.15.17:36964) 2023-07-14T13:34:40.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.974+0000 7fe3f37fe700 1 -- 172.21.15.17:0/3921616973 learned_addr learned my addr 172.21.15.17:0/3921616973 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:34:40.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.974+0000 7fe3f27fc700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3f4100480 0x7fe3f419e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.972 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.974+0000 7fe3f2ffd700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f40ffad0 0x7fe3f419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.974+0000 7fe3f37fe700 1 -- 172.21.15.17:0/3921616973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3f4100480 msgr2=0x7fe3f419e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.974+0000 7fe3f37fe700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3f4100480 0x7fe3f419e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.974+0000 7fe3f37fe700 1 -- 172.21.15.17:0/3921616973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f40ffad0 msgr2=0x7fe3f419db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:40.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.974+0000 7fe3f37fe700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f40ffad0 0x7fe3f419db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:40.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.974+0000 7fe3f37fe700 1 -- 172.21.15.17:0/3921616973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e80095f0 con 0x7fe3f4105ae0 2023-07-14T13:34:40.973 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.974+0000 7fe3f37fe700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4105ae0 0x7fe3f4197b30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec007ee0 tx=0x7fe3ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:40.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.975+0000 7fe3dbfff700 1 -- 172.21.15.17:0/3921616973 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec017070 con 0x7fe3f4105ae0 2023-07-14T13:34:40.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.975+0000 7fe3dbfff700 1 -- 172.21.15.17:0/3921616973 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3ec00f040 con 0x7fe3f4105ae0 2023-07-14T13:34:40.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.975+0000 7fe3dbfff700 1 -- 172.21.15.17:0/3921616973 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec005710 con 0x7fe3f4105ae0 2023-07-14T13:34:40.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.975+0000 7fe3f95ff700 1 -- 172.21.15.17:0/3921616973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f4198910 con 0x7fe3f4105ae0 2023-07-14T13:34:40.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.975+0000 7fe3f95ff700 1 -- 172.21.15.17:0/3921616973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f41a4ad0 con 0x7fe3f4105ae0 2023-07-14T13:34:40.974 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.976+0000 7fe3f95ff700 1 -- 172.21.15.17:0/3921616973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f4067300 con 0x7fe3f4105ae0 2023-07-14T13:34:40.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.978+0000 7fe3dbfff700 1 -- 172.21.15.17:0/3921616973 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fe3ec005870 con 0x7fe3f4105ae0 2023-07-14T13:34:40.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.979+0000 7fe3dbfff700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe3dc0a1380 0x7fe3dc0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:34:40.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.979+0000 7fe3dbfff700 1 -- 172.21.15.17:0/3921616973 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe3ec0cc4e0 con 0x7fe3f4105ae0 2023-07-14T13:34:40.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.980+0000 7fe3f2ffd700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe3dc0a1380 0x7fe3dc0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:34:40.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.980+0000 7fe3f2ffd700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe3dc0a1380 0x7fe3dc0a3830 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009bd0 tx=0x7fe3e4009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:34:40.977 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:40.983+0000 7fe3dbfff700 1 -- 172.21.15.17:0/3921616973 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fe3ec0958b0 con 0x7fe3f4105ae0 2023-07-14T13:34:41.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:40 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3828386899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T13:34:41.071 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:40 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1013933984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T13:34:41.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:40 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3828386899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T13:34:41.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:40 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1013933984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T13:34:41.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:40 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3828386899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T13:34:41.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:40 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1013933984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T13:34:41.245 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.250+0000 7fe3f95ff700 1 -- 172.21.15.17:0/3921616973 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fe3f4199020 con 0x7fe3f4105ae0 2023-07-14T13:34:41.278 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.284+0000 7fe3dbfff700 1 -- 172.21.15.17:0/3921616973 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+733772 (secure 0 0 0) 0x7fe3ec098ed0 con 0x7fe3f4105ae0 2023-07-14T13:34:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:34:41.287 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:34:41.287 INFO:teuthology.orchestra.run.smithi017.stdout: "epoch": 25, 2023-07-14T13:34:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "active_gid": 15525, 2023-07-14T13:34:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "active_name": "x", 2023-07-14T13:34:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addrs": { 2023-07-14T13:34:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-07-14T13:34:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-07-14T13:34:41.288 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6800", 2023-07-14T13:34:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3916014154 2023-07-14T13:34:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2023-07-14T13:34:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:6801", 2023-07-14T13:34:41.289 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 3916014154 2023-07-14T13:34:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T13:34:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "active_addr": "172.21.15.17:6801/3916014154", 2023-07-14T13:34:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "active_change": "2023-07-14T12:59:43.864390+0000", 2023-07-14T13:34:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "active_mgr_features": 4540138322906710015, 2023-07-14T13:34:41.290 INFO:teuthology.orchestra.run.smithi017.stdout: "available": true, 2023-07-14T13:34:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "standbys": [ 2023-07-14T13:34:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 15516, 2023-07-14T13:34:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "z", 2023-07-14T13:34:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540138322906710015, 2023-07-14T13:34:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2023-07-14T13:34:41.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2023-07-14T13:34:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:41.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.293 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2023-07-14T13:34:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.295 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.296 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.297 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.298 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.300 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.301 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.302 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.303 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.304 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2023-07-14T13:34:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2023-07-14T13:34:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.305 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2023-07-14T13:34:41.306 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2023-07-14T13:34:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2023-07-14T13:34:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.307 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2023-07-14T13:34:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2023-07-14T13:34:41.308 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2023-07-14T13:34:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2023-07-14T13:34:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.309 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.310 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2023-07-14T13:34:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2023-07-14T13:34:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2023-07-14T13:34:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.312 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2023-07-14T13:34:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2023-07-14T13:34:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2023-07-14T13:34:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2023-07-14T13:34:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2023-07-14T13:34:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2023-07-14T13:34:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2023-07-14T13:34:41.316 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.317 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2023-07-14T13:34:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.318 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2023-07-14T13:34:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2023-07-14T13:34:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.319 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2023-07-14T13:34:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2023-07-14T13:34:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2023-07-14T13:34:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.321 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2023-07-14T13:34:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2023-07-14T13:34:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.323 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2023-07-14T13:34:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2023-07-14T13:34:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.324 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2023-07-14T13:34:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2023-07-14T13:34:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2023-07-14T13:34:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2023-07-14T13:34:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2023-07-14T13:34:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T13:34:41.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2023-07-14T13:34:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2023-07-14T13:34:41.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-07-14T13:34:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-07-14T13:34:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.329 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-14T13:34:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T13:34:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2023-07-14T13:34:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2023-07-14T13:34:41.330 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2023-07-14T13:34:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2023-07-14T13:34:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.331 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-07-14T13:34:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2023-07-14T13:34:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2023-07-14T13:34:41.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2023-07-14T13:34:41.334 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.335 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-07-14T13:34:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-14T13:34:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.336 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2023-07-14T13:34:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2023-07-14T13:34:41.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.338 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2023-07-14T13:34:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2023-07-14T13:34:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2023-07-14T13:34:41.339 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2023-07-14T13:34:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-14T13:34:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2023-07-14T13:34:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2023-07-14T13:34:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2023-07-14T13:34:41.341 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2023-07-14T13:34:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T13:34:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2023-07-14T13:34:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2023-07-14T13:34:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:41.343 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-07-14T13:34:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-07-14T13:34:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-14T13:34:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T13:34:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.344 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.345 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.346 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.348 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.348 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.348 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.348 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.348 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.349 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.349 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.349 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.349 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.349 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.349 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.351 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.352 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.353 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.354 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2023-07-14T13:34:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2023-07-14T13:34:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:41.355 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-07-14T13:34:41.356 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-07-14T13:34:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-07-14T13:34:41.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2023-07-14T13:34:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.358 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2023-07-14T13:34:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2023-07-14T13:34:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap" 2023-07-14T13:34:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2023-07-14T13:34:41.359 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.360 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2023-07-14T13:34:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2023-07-14T13:34:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.361 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.362 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.363 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-07-14T13:34:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:41.365 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.367 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-07-14T13:34:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.368 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2023-07-14T13:34:41.369 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2023-07-14T13:34:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.370 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2023-07-14T13:34:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-14T13:34:41.371 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2023-07-14T13:34:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2023-07-14T13:34:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.372 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-07-14T13:34:41.373 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.374 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2023-07-14T13:34:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2023-07-14T13:34:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2023-07-14T13:34:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:41.375 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-07-14T13:34:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.376 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-07-14T13:34:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2023-07-14T13:34:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2023-07-14T13:34:41.377 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2023-07-14T13:34:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-07-14T13:34:41.378 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2023-07-14T13:34:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2023-07-14T13:34:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.379 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2023-07-14T13:34:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.380 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-07-14T13:34:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "alertmanager_web_password": { 2023-07-14T13:34:41.381 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alertmanager_web_password", 2023-07-14T13:34:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.382 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Alertmanager web password", 2023-07-14T13:34:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "alertmanager_web_user": { 2023-07-14T13:34:41.383 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alertmanager_web_user", 2023-07-14T13:34:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.384 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Alertmanager web user", 2023-07-14T13:34:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2023-07-14T13:34:41.385 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2023-07-14T13:34:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.386 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-14T13:34:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-14T13:34:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.387 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2023-07-14T13:34:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2023-07-14T13:34:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.388 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2023-07-14T13:34:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.389 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2023-07-14T13:34:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2023-07-14T13:34:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2023-07-14T13:34:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.390 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-07-14T13:34:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.391 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2023-07-14T13:34:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2023-07-14T13:34:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.392 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-07-14T13:34:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.393 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2023-07-14T13:34:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2023-07-14T13:34:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.394 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-07-14T13:34:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.395 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2023-07-14T13:34:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2023-07-14T13:34:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.396 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-07-14T13:34:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.397 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2023-07-14T13:34:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2023-07-14T13:34:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-07-14T13:34:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.398 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.399 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2023-07-14T13:34:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2023-07-14T13:34:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2023-07-14T13:34:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.400 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2023-07-14T13:34:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.401 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2023-07-14T13:34:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2023-07-14T13:34:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-07-14T13:34:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2023-07-14T13:34:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2023-07-14T13:34:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2023-07-14T13:34:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-07-14T13:34:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:41.405 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2023-07-14T13:34:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2023-07-14T13:34:41.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-07-14T13:34:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.407 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2023-07-14T13:34:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2023-07-14T13:34:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2023-07-14T13:34:41.408 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-07-14T13:34:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.409 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2023-07-14T13:34:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.410 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2023-07-14T13:34:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2023-07-14T13:34:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-07-14T13:34:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.411 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2023-07-14T13:34:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2023-07-14T13:34:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2023-07-14T13:34:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.413 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-07-14T13:34:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2023-07-14T13:34:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.414 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2023-07-14T13:34:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2023-07-14T13:34:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.415 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-07-14T13:34:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2023-07-14T13:34:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2023-07-14T13:34:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2023-07-14T13:34:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-07-14T13:34:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2023-07-14T13:34:41.418 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2023-07-14T13:34:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2023-07-14T13:34:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.419 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-07-14T13:34:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.420 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2023-07-14T13:34:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2023-07-14T13:34:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-07-14T13:34:41.422 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2023-07-14T13:34:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2023-07-14T13:34:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-07-14T13:34:41.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2023-07-14T13:34:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2023-07-14T13:34:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2023-07-14T13:34:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-07-14T13:34:41.426 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2023-07-14T13:34:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.427 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2023-07-14T13:34:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2023-07-14T13:34:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.428 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.429 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2023-07-14T13:34:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.430 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2023-07-14T13:34:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2023-07-14T13:34:41.431 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.432 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.433 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-07-14T13:34:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.434 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2023-07-14T13:34:41.435 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2023-07-14T13:34:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.436 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2023-07-14T13:34:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.437 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-07-14T13:34:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.438 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2023-07-14T13:34:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2023-07-14T13:34:41.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.440 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2023-07-14T13:34:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.441 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-07-14T13:34:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.442 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2023-07-14T13:34:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2023-07-14T13:34:41.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.444 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2023-07-14T13:34:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2023-07-14T13:34:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.446 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2023-07-14T13:34:41.447 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2023-07-14T13:34:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2023-07-14T13:34:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.449 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2023-07-14T13:34:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2023-07-14T13:34:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.450 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2023-07-14T13:34:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2023-07-14T13:34:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2023-07-14T13:34:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.452 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2023-07-14T13:34:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.453 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.454 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.455 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2023-07-14T13:34:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2023-07-14T13:34:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.457 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-07-14T13:34:41.458 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.459 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.460 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-14T13:34:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.465 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2023-07-14T13:34:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-07-14T13:34:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.466 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.467 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-07-14T13:34:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-07-14T13:34:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-07-14T13:34:41.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2023-07-14T13:34:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.469 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-07-14T13:34:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2023-07-14T13:34:41.470 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2023-07-14T13:34:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.471 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2023-07-14T13:34:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2023-07-14T13:34:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2023-07-14T13:34:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:41.473 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-07-14T13:34:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2023-07-14T13:34:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2023-07-14T13:34:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2023-07-14T13:34:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.476 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-07-14T13:34:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-07-14T13:34:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.477 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2023-07-14T13:34:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2023-07-14T13:34:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2023-07-14T13:34:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.478 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2023-07-14T13:34:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.479 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2023-07-14T13:34:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2023-07-14T13:34:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-07-14T13:34:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.480 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-07-14T13:34:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.481 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_web_password": { 2023-07-14T13:34:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_web_password", 2023-07-14T13:34:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.482 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus web password", 2023-07-14T13:34:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.483 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_web_user": { 2023-07-14T13:34:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_web_user", 2023-07-14T13:34:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.484 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus web user", 2023-07-14T13:34:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.485 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2023-07-14T13:34:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2023-07-14T13:34:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.486 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-07-14T13:34:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.487 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2023-07-14T13:34:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2023-07-14T13:34:41.488 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.489 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.490 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-07-14T13:34:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2023-07-14T13:34:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2023-07-14T13:34:41.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.492 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-07-14T13:34:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2023-07-14T13:34:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2023-07-14T13:34:41.493 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.494 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-07-14T13:34:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2023-07-14T13:34:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2023-07-14T13:34:41.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.496 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-07-14T13:34:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2023-07-14T13:34:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2023-07-14T13:34:41.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2023-07-14T13:34:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2023-07-14T13:34:41.498 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2023-07-14T13:34:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2023-07-14T13:34:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.499 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-07-14T13:34:41.500 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2023-07-14T13:34:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2023-07-14T13:34:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.501 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.502 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-07-14T13:34:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2023-07-14T13:34:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2023-07-14T13:34:41.503 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-07-14T13:34:41.504 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2023-07-14T13:34:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2023-07-14T13:34:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.505 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2023-07-14T13:34:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.506 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2023-07-14T13:34:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2023-07-14T13:34:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.507 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-14T13:34:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2023-07-14T13:34:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2023-07-14T13:34:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.509 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-14T13:34:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2023-07-14T13:34:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.511 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.512 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.513 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.514 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.515 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.516 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.517 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.519 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2023-07-14T13:34:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2023-07-14T13:34:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2023-07-14T13:34:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.521 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2023-07-14T13:34:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2023-07-14T13:34:41.522 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2023-07-14T13:34:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2023-07-14T13:34:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.523 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2023-07-14T13:34:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2023-07-14T13:34:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-07-14T13:34:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-07-14T13:34:41.525 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.526 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2023-07-14T13:34:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2023-07-14T13:34:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.527 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.528 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-07-14T13:34:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-07-14T13:34:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.529 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2023-07-14T13:34:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2023-07-14T13:34:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.531 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.532 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-07-14T13:34:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-14T13:34:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.533 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2023-07-14T13:34:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2023-07-14T13:34:41.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.535 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-07-14T13:34:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-07-14T13:34:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.536 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.537 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-07-14T13:34:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-07-14T13:34:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.538 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.539 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-07-14T13:34:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-07-14T13:34:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.540 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-07-14T13:34:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-07-14T13:34:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.542 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2023-07-14T13:34:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-07-14T13:34:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.544 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.545 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2023-07-14T13:34:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-07-14T13:34:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.546 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2023-07-14T13:34:41.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-07-14T13:34:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.548 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-14T13:34:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-14T13:34:41.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.550 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.551 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.551 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.551 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.551 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2023-07-14T13:34:41.551 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2023-07-14T13:34:41.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.552 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.552 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:41.552 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.552 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.552 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.552 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.553 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.553 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.553 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-07-14T13:34:41.553 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-07-14T13:34:41.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.553 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.554 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2023-07-14T13:34:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2023-07-14T13:34:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.555 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.556 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2023-07-14T13:34:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2023-07-14T13:34:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:41.557 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.558 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-07-14T13:34:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-07-14T13:34:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.559 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-14T13:34:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-14T13:34:41.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.561 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.561 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.561 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.561 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.561 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.561 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.561 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.562 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.562 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.562 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.562 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-07-14T13:34:41.562 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-14T13:34:41.562 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.562 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.563 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.563 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.563 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.563 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.563 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.563 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.563 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.564 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.564 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2023-07-14T13:34:41.564 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-07-14T13:34:41.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.564 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.565 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.565 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.565 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.565 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.565 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.565 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.565 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.566 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2023-07-14T13:34:41.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2023-07-14T13:34:41.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.566 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.566 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.567 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.567 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.567 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.567 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.567 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.567 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.567 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.568 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-07-14T13:34:41.568 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-07-14T13:34:41.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.568 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.568 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.569 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.569 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.569 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.569 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.569 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.569 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.569 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.570 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-14T13:34:41.570 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-14T13:34:41.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.570 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.570 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.570 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.570 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.571 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.571 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.571 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.571 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.571 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.571 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.571 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-14T13:34:41.572 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-14T13:34:41.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.572 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.572 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.572 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.572 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.572 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.573 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.573 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.573 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.573 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-14T13:34:41.573 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-14T13:34:41.574 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.574 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.574 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.574 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.574 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.574 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.574 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.574 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.575 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.575 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.575 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.575 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-14T13:34:41.575 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-14T13:34:41.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.576 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.576 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.576 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.576 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.576 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.576 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.576 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.576 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.577 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.577 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-14T13:34:41.577 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-14T13:34:41.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.577 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.578 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.578 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.578 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.578 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.578 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.578 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.578 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.579 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-14T13:34:41.579 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-14T13:34:41.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.579 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.579 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.580 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.580 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.580 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.580 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.580 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.580 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.581 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-14T13:34:41.581 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-14T13:34:41.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.581 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.581 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.581 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.582 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.582 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.582 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.582 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.582 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.582 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2023-07-14T13:34:41.583 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2023-07-14T13:34:41.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.583 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.583 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.583 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.583 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.583 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-07-14T13:34:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-14T13:34:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.585 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.585 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.585 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-14T13:34:41.585 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.585 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.585 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.585 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.585 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.586 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.586 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-14T13:34:41.586 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-14T13:34:41.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.586 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.587 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.587 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:41.587 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.587 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.587 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.587 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.587 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.587 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.588 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.588 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-07-14T13:34:41.588 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-07-14T13:34:41.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.588 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.588 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.588 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2023-07-14T13:34:41.589 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.589 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.589 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.589 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.589 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.589 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.589 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.590 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2023-07-14T13:34:41.590 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-07-14T13:34:41.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.590 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.590 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.590 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2023-07-14T13:34:41.590 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.590 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.591 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.591 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.591 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.591 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.592 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2023-07-14T13:34:41.592 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2023-07-14T13:34:41.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.592 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.592 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.592 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.592 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.592 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.593 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.593 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.593 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.593 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.593 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.593 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-07-14T13:34:41.593 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-07-14T13:34:41.594 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.594 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.594 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.594 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:41.594 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.594 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.594 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.595 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.595 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.595 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.595 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2023-07-14T13:34:41.595 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2023-07-14T13:34:41.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.596 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.596 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.596 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.596 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.596 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.596 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.597 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.597 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.597 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2023-07-14T13:34:41.597 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2023-07-14T13:34:41.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.597 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.598 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.598 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.598 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.598 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.598 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.598 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.598 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.599 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.599 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-07-14T13:34:41.599 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-14T13:34:41.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.599 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.600 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:41.600 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.600 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.600 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.600 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.600 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.600 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.600 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.601 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-14T13:34:41.601 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-14T13:34:41.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.601 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.601 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:41.601 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.602 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.602 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.602 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.602 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.602 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.602 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.602 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-14T13:34:41.603 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-14T13:34:41.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.603 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.603 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:41.603 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.603 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.603 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.604 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.604 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.604 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.604 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2023-07-14T13:34:41.604 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2023-07-14T13:34:41.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.605 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.605 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.605 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.605 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.605 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.606 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.606 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.606 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2023-07-14T13:34:41.606 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2023-07-14T13:34:41.606 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.606 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.607 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.607 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.607 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.607 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.607 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.607 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.607 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.608 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.608 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2023-07-14T13:34:41.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2023-07-14T13:34:41.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.608 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.608 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.609 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.609 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.609 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.609 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.609 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2023-07-14T13:34:41.609 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.609 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.610 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2023-07-14T13:34:41.610 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2023-07-14T13:34:41.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.610 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.610 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2023-07-14T13:34:41.611 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.611 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.611 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.611 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.611 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.611 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.611 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.612 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-07-14T13:34:41.612 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-07-14T13:34:41.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.612 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.612 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.612 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.612 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.613 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.613 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.613 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.613 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.613 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.613 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.613 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.614 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.614 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.614 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.614 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.614 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.614 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.614 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.615 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.615 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.615 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.615 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.615 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.615 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.615 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.616 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.616 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.616 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.616 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.617 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.617 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.617 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.617 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.617 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.617 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.617 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.618 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.618 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.618 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.618 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.619 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.619 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.619 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.619 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.619 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.619 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.619 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.619 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.620 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.620 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.620 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.620 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.620 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.620 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.621 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.621 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.621 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.621 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.621 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.622 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.622 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.622 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.622 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.622 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.622 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2023-07-14T13:34:41.623 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2023-07-14T13:34:41.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.623 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.623 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.623 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.623 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.623 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.624 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2023-07-14T13:34:41.624 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.624 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.624 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.624 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2023-07-14T13:34:41.624 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2023-07-14T13:34:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.625 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-07-14T13:34:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-07-14T13:34:41.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-07-14T13:34:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.627 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.628 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.628 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.628 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-07-14T13:34:41.628 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-07-14T13:34:41.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.628 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.629 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2023-07-14T13:34:41.629 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.629 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.629 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.629 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.629 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.630 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.630 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-07-14T13:34:41.630 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-07-14T13:34:41.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.630 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.631 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.631 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.631 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.631 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.631 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.631 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.632 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.632 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2023-07-14T13:34:41.632 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2023-07-14T13:34:41.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.632 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.632 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.632 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2023-07-14T13:34:41.633 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.633 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.633 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.633 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.633 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.633 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.634 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-07-14T13:34:41.634 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-07-14T13:34:41.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.634 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.634 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2023-07-14T13:34:41.634 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.635 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.635 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.635 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.635 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2023-07-14T13:34:41.635 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.635 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.635 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.636 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.636 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-07-14T13:34:41.636 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-07-14T13:34:41.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.636 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-07-14T13:34:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-07-14T13:34:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-07-14T13:34:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.637 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.638 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2023-07-14T13:34:41.638 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2023-07-14T13:34:41.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.638 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.638 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.638 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.639 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.639 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.639 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.639 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.639 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.640 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2023-07-14T13:34:41.640 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.640 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.640 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.640 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2023-07-14T13:34:41.640 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2023-07-14T13:34:41.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.641 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.641 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.641 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.641 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.642 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.642 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2023-07-14T13:34:41.642 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.642 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.642 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.642 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.643 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.643 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.643 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.643 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.643 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.643 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.644 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.644 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.644 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.644 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.644 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.644 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.644 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.645 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.645 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.645 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.645 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.645 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.646 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.646 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.646 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.646 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.646 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.646 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.647 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.647 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.647 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.647 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.648 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.648 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.648 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.648 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.648 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.648 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.648 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.649 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.649 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.649 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.649 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.649 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.649 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.650 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.650 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.650 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.650 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.650 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.650 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.650 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.651 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.651 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.651 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.651 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.651 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.651 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2023-07-14T13:34:41.652 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2023-07-14T13:34:41.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.652 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.652 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2023-07-14T13:34:41.652 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.653 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.653 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.653 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-07-14T13:34:41.653 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.653 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.653 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2023-07-14T13:34:41.654 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2023-07-14T13:34:41.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.654 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.654 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2023-07-14T13:34:41.654 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.654 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.654 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.655 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2023-07-14T13:34:41.655 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.655 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.655 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2023-07-14T13:34:41.655 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2023-07-14T13:34:41.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.656 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.656 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2023-07-14T13:34:41.656 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.656 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.656 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.656 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2023-07-14T13:34:41.657 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.657 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.657 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2023-07-14T13:34:41.657 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2023-07-14T13:34:41.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.658 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.658 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-07-14T13:34:41.658 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.658 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.658 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.658 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2023-07-14T13:34:41.659 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.659 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.659 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2023-07-14T13:34:41.659 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2023-07-14T13:34:41.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.660 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.660 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.660 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.660 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.660 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.660 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-07-14T13:34:41.660 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.661 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.661 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:41.661 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:41.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.661 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.662 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:41.662 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.662 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.662 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.662 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2023-07-14T13:34:41.662 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.663 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.663 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2023-07-14T13:34:41.663 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2023-07-14T13:34:41.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.663 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.664 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2023-07-14T13:34:41.664 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.664 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.664 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.664 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-07-14T13:34:41.664 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.665 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.665 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2023-07-14T13:34:41.665 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.665 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.666 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.666 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.666 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.667 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.667 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.667 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.667 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.667 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.667 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.667 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.667 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.668 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.668 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.668 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.668 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.668 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.669 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.669 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.669 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.669 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.669 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.669 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.670 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.670 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.670 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.670 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.670 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.671 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.671 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.671 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.671 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.671 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.671 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.672 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.672 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.672 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.672 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.672 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.672 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.672 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.673 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.673 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.673 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.673 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.673 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.673 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.674 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.674 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.674 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.674 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.674 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.674 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.675 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.675 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2023-07-14T13:34:41.675 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2023-07-14T13:34:41.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.675 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.676 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-07-14T13:34:41.676 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.676 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.676 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.677 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2023-07-14T13:34:41.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2023-07-14T13:34:41.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.677 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2023-07-14T13:34:41.677 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.678 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.678 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.678 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.678 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.679 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:41.679 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:41.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.679 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.679 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:41.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.680 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.680 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.680 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.680 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.681 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2023-07-14T13:34:41.681 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2023-07-14T13:34:41.681 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2023-07-14T13:34:41.681 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.681 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2023-07-14T13:34:41.681 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2023-07-14T13:34:41.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.682 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.682 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2023-07-14T13:34:41.682 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.682 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.682 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.683 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-07-14T13:34:41.683 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.683 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.683 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2023-07-14T13:34:41.683 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2023-07-14T13:34:41.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.684 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.684 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2023-07-14T13:34:41.684 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.684 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.684 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.684 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-07-14T13:34:41.685 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.685 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.685 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2023-07-14T13:34:41.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2023-07-14T13:34:41.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.686 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.686 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.686 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.686 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.686 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.686 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2023-07-14T13:34:41.687 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.687 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.687 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:41.687 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:41.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.687 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.688 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2023-07-14T13:34:41.688 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2023-07-14T13:34:41.688 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.688 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.688 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-07-14T13:34:41.689 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.689 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.689 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.689 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.690 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.690 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.690 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.690 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.690 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.691 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.691 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.691 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.691 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.691 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.691 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.692 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.692 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.692 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.692 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.692 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.693 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.693 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.693 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.693 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.693 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.693 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.694 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.694 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.694 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.694 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.694 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.695 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.695 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.695 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.695 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.695 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.695 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.695 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.696 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.696 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.696 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.696 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.696 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.696 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.696 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.696 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.697 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.697 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.697 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.697 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.698 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.698 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.698 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.698 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.698 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.699 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.699 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2023-07-14T13:34:41.699 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2023-07-14T13:34:41.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.699 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.699 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.700 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.700 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.700 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2023-07-14T13:34:41.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.700 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.701 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2023-07-14T13:34:41.701 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2023-07-14T13:34:41.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.701 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.701 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2023-07-14T13:34:41.701 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.702 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.702 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.702 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2023-07-14T13:34:41.702 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.702 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.703 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-07-14T13:34:41.703 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-07-14T13:34:41.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.703 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.703 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.703 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2023-07-14T13:34:41.703 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.704 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.704 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.704 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T13:34:41.704 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.704 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.704 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2023-07-14T13:34:41.705 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2023-07-14T13:34:41.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.705 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.705 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:41.705 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:41.705 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2023-07-14T13:34:41.706 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.706 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-07-14T13:34:41.706 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.706 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.706 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2023-07-14T13:34:41.706 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2023-07-14T13:34:41.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.707 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.707 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.707 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.707 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.707 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.708 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2023-07-14T13:34:41.708 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.708 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.708 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2023-07-14T13:34:41.708 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2023-07-14T13:34:41.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.709 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.709 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2023-07-14T13:34:41.709 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.709 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.709 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.709 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T13:34:41.709 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.710 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.710 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2023-07-14T13:34:41.711 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.711 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.711 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.711 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.711 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.712 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.712 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.712 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.713 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.713 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.713 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.713 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.713 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.713 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.713 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.713 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.714 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.714 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.714 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.715 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.715 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.715 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.715 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.715 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.715 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.715 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.716 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.716 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.716 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.716 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.717 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.717 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.717 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.717 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.717 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.717 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.717 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.718 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.718 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.718 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.718 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.718 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.718 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.718 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.719 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.719 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.719 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.719 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.719 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.720 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.720 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.720 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.720 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.720 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.720 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.721 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2023-07-14T13:34:41.721 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.721 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.721 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.722 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.722 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.722 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.722 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.722 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.723 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.723 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.723 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.723 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.723 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.723 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.723 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.723 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.724 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.724 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.724 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.724 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.724 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.725 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.725 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.725 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.725 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.725 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.726 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.726 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.726 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.726 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.726 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.727 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.727 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.727 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.727 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.727 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.727 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.727 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.728 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.728 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.728 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.728 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.728 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.728 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.729 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.729 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.729 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.729 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.730 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.730 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.730 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.730 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.730 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.730 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.730 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.731 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2023-07-14T13:34:41.731 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.731 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.731 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.732 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2023-07-14T13:34:41.732 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2023-07-14T13:34:41.732 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.732 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.732 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2023-07-14T13:34:41.732 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.732 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.733 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.733 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2023-07-14T13:34:41.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.734 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.734 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2023-07-14T13:34:41.734 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2023-07-14T13:34:41.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.734 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.735 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:41.735 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2023-07-14T13:34:41.735 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.735 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.735 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-07-14T13:34:41.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.736 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.736 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.736 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.736 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.737 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.737 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.737 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.737 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.737 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.737 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.737 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.737 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.738 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.738 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.738 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.738 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.738 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.738 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.739 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.739 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.739 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.739 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.739 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.739 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.739 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.740 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.740 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.740 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.740 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.740 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.741 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.741 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.741 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.741 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.741 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.741 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.742 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.742 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.742 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.742 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.742 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.742 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.743 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.743 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.743 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.743 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.743 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.744 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.744 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.744 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.744 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.744 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.745 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.745 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.745 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.745 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.746 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2023-07-14T13:34:41.746 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.746 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.746 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.746 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2023-07-14T13:34:41.746 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2023-07-14T13:34:41.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.746 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.747 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2023-07-14T13:34:41.747 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.747 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.747 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.747 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2023-07-14T13:34:41.747 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-07-14T13:34:41.748 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.748 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.748 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.748 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.748 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.749 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.749 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.749 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.749 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.749 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.749 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.750 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.750 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.750 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.750 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.750 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.750 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.750 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.751 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.751 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.751 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.752 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.752 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.752 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.752 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.752 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.752 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.753 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.753 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.753 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.753 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.753 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.753 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.754 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.754 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.754 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.754 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.754 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.754 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.754 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.755 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.755 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.755 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.755 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.755 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.755 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.756 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.756 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.756 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.756 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.756 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.756 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.757 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.757 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.757 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.757 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.757 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.757 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.757 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.758 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.758 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.758 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.758 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2023-07-14T13:34:41.758 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2023-07-14T13:34:41.758 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.758 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2023-07-14T13:34:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-07-14T13:34:41.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.760 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.760 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2023-07-14T13:34:41.760 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2023-07-14T13:34:41.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.761 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.761 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2023-07-14T13:34:41.761 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.761 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.762 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2023-07-14T13:34:41.762 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.762 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.762 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.762 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2023-07-14T13:34:41.763 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2023-07-14T13:34:41.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.763 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.763 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2023-07-14T13:34:41.763 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.763 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.763 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.764 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2023-07-14T13:34:41.764 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.764 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.764 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2023-07-14T13:34:41.765 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2023-07-14T13:34:41.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.765 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.766 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.766 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.766 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.766 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.767 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.767 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2023-07-14T13:34:41.767 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.768 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.768 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.769 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2023-07-14T13:34:41.769 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2023-07-14T13:34:41.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.769 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.770 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2023-07-14T13:34:41.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.771 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.771 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.771 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2023-07-14T13:34:41.771 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-07-14T13:34:41.772 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.772 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.773 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2023-07-14T13:34:41.773 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.774 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.774 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.774 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.774 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.775 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.775 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.775 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.775 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.776 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.776 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.776 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.776 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.776 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.776 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.777 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.777 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.777 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.777 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.777 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.777 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.778 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.778 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.778 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.778 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.779 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.779 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.779 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.779 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.779 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.779 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.780 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.780 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.780 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.780 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.780 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.781 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.781 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.781 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.781 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.781 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.781 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.781 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.781 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.782 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.782 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.782 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.782 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.782 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.782 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.783 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.783 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.783 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.783 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.783 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.783 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.783 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.784 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.784 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.784 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2023-07-14T13:34:41.785 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.785 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.785 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.785 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.785 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.786 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.786 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.786 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.786 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.786 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.786 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.787 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.787 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.787 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.787 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.787 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.787 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.787 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.788 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.788 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.788 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.788 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.788 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.789 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.789 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.789 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.789 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.789 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.789 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.789 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.790 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.790 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.790 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.790 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.790 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.791 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.791 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.791 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.791 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.791 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.791 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.791 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.792 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.792 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.792 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.792 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.792 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.792 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.793 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.793 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.793 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.793 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.793 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.794 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.794 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.794 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.794 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.795 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.795 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2023-07-14T13:34:41.795 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.795 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.795 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.796 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.796 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.796 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.796 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.797 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.797 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.797 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.797 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.797 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.797 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.797 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.797 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.798 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.798 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.798 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.798 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.798 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.799 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.799 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.799 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.799 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.799 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.799 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.799 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.800 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.800 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.800 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.800 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.800 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.800 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.801 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.801 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.801 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.801 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.801 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.802 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.802 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.802 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.802 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.802 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.802 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.804 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.805 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-07-14T13:34:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.806 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.807 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.807 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2023-07-14T13:34:41.807 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2023-07-14T13:34:41.807 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.807 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.808 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.808 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.808 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-07-14T13:34:41.808 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.808 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.809 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.809 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.809 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.809 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.809 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.809 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.810 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.810 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.810 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.810 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.810 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.810 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.810 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.810 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.811 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.811 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.811 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.811 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.811 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.812 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.812 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.812 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.812 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.812 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.812 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.812 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.813 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.813 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.813 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.813 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.814 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.814 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.814 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.814 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.814 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.815 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.815 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.815 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.815 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.815 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.815 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.815 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.815 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.816 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.816 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.816 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.816 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.817 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.817 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.817 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.817 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.817 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.817 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.817 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.818 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.818 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.818 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2023-07-14T13:34:41.818 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-07-14T13:34:41.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.818 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.818 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.819 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.819 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.819 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.819 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.819 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2023-07-14T13:34:41.819 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2023-07-14T13:34:41.819 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2023-07-14T13:34:41.820 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.820 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2023-07-14T13:34:41.820 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.820 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.821 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2023-07-14T13:34:41.821 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.821 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.821 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.821 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.821 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.822 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.822 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.822 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.822 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.822 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.822 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.822 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.823 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.823 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.823 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.823 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.823 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.823 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.823 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.824 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.824 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.824 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.824 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.825 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.825 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.825 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.825 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.825 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.825 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.826 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.826 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.826 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.826 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.829 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.829 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.829 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.829 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.829 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.829 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.830 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.830 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.830 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.830 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.830 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.830 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.831 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.831 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.831 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2023-07-14T13:34:41.833 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.833 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.834 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.834 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.834 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.835 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.835 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.836 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.836 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.836 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.837 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.837 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.837 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.838 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.838 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.838 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.838 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.839 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.839 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.839 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.840 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.840 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.840 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.840 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.841 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.841 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.841 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.841 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.842 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.842 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.842 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.843 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.843 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.843 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.844 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.844 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.844 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.844 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.844 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.844 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.845 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.845 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.845 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.845 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.845 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.845 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.845 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.845 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.846 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.846 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.846 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.846 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.846 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.847 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.847 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.847 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.847 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.847 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.847 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.847 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.848 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2023-07-14T13:34:41.848 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.849 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.849 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.849 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.849 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.849 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.850 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.850 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.850 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.850 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.850 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.850 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.850 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.850 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.851 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.851 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.851 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.851 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.851 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.851 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.852 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.852 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.852 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.852 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.852 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.853 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.853 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.853 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.853 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.853 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.854 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.854 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.855 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.855 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.855 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.856 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.856 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.856 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.857 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.857 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.857 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.858 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.858 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.858 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.858 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.859 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.859 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.860 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.860 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.860 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.861 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.861 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.861 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.861 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.862 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.862 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.862 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.863 INFO:teuthology.orchestra.run.smithi017.stdout: "noautoscale": { 2023-07-14T13:34:41.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "noautoscale", 2023-07-14T13:34:41.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.864 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.864 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.865 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.865 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.865 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.866 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "global autoscale flag", 2023-07-14T13:34:41.866 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-07-14T13:34:41.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.866 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.867 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:41.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:41.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.868 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.868 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:41.868 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.869 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.869 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.869 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.870 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.870 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.871 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2023-07-14T13:34:41.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2023-07-14T13:34:41.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:41.871 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.872 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.872 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-07-14T13:34:41.872 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2023-07-14T13:34:41.873 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.873 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.873 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2023-07-14T13:34:41.873 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-07-14T13:34:41.873 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.874 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.875 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2023-07-14T13:34:41.875 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.875 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.876 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.876 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2023-07-14T13:34:41.876 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2023-07-14T13:34:41.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.876 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.877 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.877 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.878 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2023-07-14T13:34:41.878 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.878 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.878 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.879 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-07-14T13:34:41.879 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-07-14T13:34:41.879 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.879 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.879 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.880 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.880 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.880 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.880 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.880 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.880 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.880 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.881 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.881 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.881 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.882 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.882 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.882 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.882 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.882 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.882 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.882 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.883 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.883 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.883 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.883 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.883 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.883 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.883 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.884 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.884 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.884 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.884 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.884 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.885 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.885 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.885 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.885 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.885 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.885 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.886 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.886 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.886 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.886 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.886 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.886 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.887 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.887 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.887 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.887 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.887 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.887 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.887 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.888 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.888 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.888 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.888 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.888 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.888 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.888 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.889 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.889 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.889 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.889 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.890 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.890 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.890 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.890 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.890 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.890 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.890 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.891 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2023-07-14T13:34:41.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2023-07-14T13:34:41.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.891 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.891 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2023-07-14T13:34:41.891 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2023-07-14T13:34:41.892 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.892 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.892 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.893 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:41.893 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:41.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:41.893 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.893 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:41.893 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.893 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.894 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2023-07-14T13:34:41.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.894 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2023-07-14T13:34:41.895 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.895 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.895 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.895 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2023-07-14T13:34:41.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2023-07-14T13:34:41.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.896 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.896 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.896 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.896 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.896 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.896 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.897 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.897 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.897 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2023-07-14T13:34:41.897 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2023-07-14T13:34:41.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.898 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.898 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.898 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.898 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.898 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.898 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.898 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-07-14T13:34:41.899 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-07-14T13:34:41.899 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.899 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.899 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.900 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.900 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.900 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.900 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.900 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.900 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.900 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.901 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.901 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.901 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.901 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.901 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.901 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.901 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.902 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.902 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.902 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.902 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.903 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.904 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.904 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.904 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.904 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.905 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.905 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.905 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.905 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.905 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.905 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.905 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.906 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.906 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.906 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.906 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.906 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.906 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.907 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.907 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.908 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.908 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.908 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.908 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2023-07-14T13:34:41.908 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2023-07-14T13:34:41.908 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.909 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.909 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.909 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.909 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.909 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.909 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.910 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.910 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.910 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2023-07-14T13:34:41.910 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-07-14T13:34:41.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.910 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.911 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2023-07-14T13:34:41.911 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.911 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.911 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.911 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.911 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.911 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.912 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.912 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2023-07-14T13:34:41.912 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2023-07-14T13:34:41.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:41.912 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.913 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2023-07-14T13:34:41.913 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.913 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.913 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.913 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.914 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.914 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-07-14T13:34:41.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-07-14T13:34:41.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.914 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.915 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-07-14T13:34:41.915 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-07-14T13:34:41.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.916 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-07-14T13:34:41.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-07-14T13:34:41.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.916 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2023-07-14T13:34:41.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.917 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-07-14T13:34:41.917 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.917 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.918 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2023-07-14T13:34:41.918 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2023-07-14T13:34:41.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.918 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.918 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2023-07-14T13:34:41.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.919 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.919 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.919 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.919 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.919 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.920 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-07-14T13:34:41.920 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-07-14T13:34:41.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.920 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.920 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2023-07-14T13:34:41.920 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2023-07-14T13:34:41.921 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2023-07-14T13:34:41.921 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.921 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.921 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.922 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.922 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-07-14T13:34:41.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-07-14T13:34:41.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.922 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.923 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-07-14T13:34:41.923 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-07-14T13:34:41.923 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-07-14T13:34:41.923 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.923 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.923 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.923 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.924 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2023-07-14T13:34:41.924 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.924 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.925 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.925 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.925 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.925 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.925 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.925 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.926 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.926 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.926 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.926 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.926 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.926 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.926 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.926 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.927 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.927 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.927 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.927 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.927 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.927 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.928 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.928 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.928 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.928 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.928 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.928 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.928 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.929 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.929 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.929 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.929 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.929 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.929 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.930 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.930 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.930 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.930 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.930 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.930 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.931 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.931 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.931 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.931 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.931 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.931 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.931 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.931 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.932 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.932 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.932 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.932 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.933 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.933 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.933 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.933 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.933 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.933 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.934 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.934 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2023-07-14T13:34:41.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2023-07-14T13:34:41.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.934 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.934 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:41.935 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.935 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.935 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.935 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.935 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.936 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2023-07-14T13:34:41.936 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2023-07-14T13:34:41.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.936 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.936 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.937 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.937 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.937 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.937 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.937 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2023-07-14T13:34:41.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2023-07-14T13:34:41.938 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.938 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.938 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.938 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.938 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.938 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.938 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.939 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.940 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2023-07-14T13:34:41.940 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.940 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.940 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2023-07-14T13:34:41.940 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2023-07-14T13:34:41.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.940 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.941 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:41.941 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.941 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.941 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.941 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.942 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.942 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.942 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-07-14T13:34:41.942 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-07-14T13:34:41.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.942 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.943 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.943 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.943 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.943 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.943 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.943 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.943 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.945 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.946 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.946 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.946 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.946 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.946 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.946 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.946 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.947 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.947 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.947 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.947 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.947 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.947 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.948 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.948 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.948 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.948 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.948 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.949 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.949 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.949 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.949 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.950 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.950 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.950 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.950 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.950 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.951 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.951 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.951 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.951 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.951 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.951 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.951 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.952 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.952 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.952 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.952 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.953 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.953 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.953 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.953 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.954 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.954 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-07-14T13:34:41.954 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-07-14T13:34:41.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.954 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.954 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.955 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.955 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.955 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.955 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.955 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.955 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.956 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-07-14T13:34:41.956 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-07-14T13:34:41.956 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.956 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.956 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.956 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.956 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.956 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.957 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.957 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2023-07-14T13:34:41.958 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.958 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.958 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.958 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.959 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.959 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.960 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.960 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.960 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.960 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.960 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.960 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.960 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.960 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.961 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.961 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.961 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.962 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.962 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.962 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.962 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.962 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.963 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.963 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.963 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.964 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.964 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.964 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.964 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.964 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.964 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.964 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.965 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.965 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.965 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.965 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.965 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.965 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.965 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.966 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.966 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.967 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.967 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.967 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.967 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.968 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2023-07-14T13:34:41.968 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.968 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.968 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.968 INFO:teuthology.orchestra.run.smithi017.stdout: "drive_group_interval": { 2023-07-14T13:34:41.969 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "drive_group_interval", 2023-07-14T13:34:41.969 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:41.969 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.969 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.969 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300.0", 2023-07-14T13:34:41.969 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.969 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.970 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.970 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-07-14T13:34:41.970 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.970 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.970 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.972 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.972 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.972 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.972 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.972 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.972 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.972 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.972 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.973 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.973 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.973 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.973 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.973 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.974 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.974 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.974 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.974 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.974 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.974 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.974 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.975 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.975 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.975 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.975 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.975 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.975 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.976 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.976 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.976 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.976 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.976 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.976 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.976 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.977 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.977 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.977 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.977 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.977 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.977 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.977 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.978 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.978 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.978 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.978 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.979 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.979 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.979 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.979 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.979 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.979 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2023-07-14T13:34:41.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2023-07-14T13:34:41.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.980 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.980 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2023-07-14T13:34:41.980 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.980 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.981 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.981 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-07-14T13:34:41.981 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.981 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.981 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:41.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:41.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2023-07-14T13:34:41.982 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:41.982 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:41.982 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:41.982 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:41.982 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:41.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.983 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.983 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.983 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.983 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.983 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.983 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.983 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.984 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.984 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.984 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.984 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.984 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.984 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.984 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.985 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.985 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:41.985 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:41.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.985 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.986 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.986 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.986 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.986 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.986 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.986 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.986 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.987 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:41.987 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:41.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.987 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.987 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.987 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:41.987 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.988 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.988 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:41.988 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:41.988 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:41.988 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:41.988 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:41.988 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:41.989 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:41.989 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:41.989 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.989 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.989 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.989 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:41.990 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:41.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:41.990 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.990 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:41.990 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:41.990 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.990 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.990 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.991 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.991 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.991 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.991 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2023-07-14T13:34:41.991 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2023-07-14T13:34:41.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.992 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.992 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.992 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.993 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.993 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.993 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.993 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.993 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.993 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.993 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2023-07-14T13:34:41.994 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2023-07-14T13:34:41.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.994 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.994 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2023-07-14T13:34:41.994 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.994 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.995 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.995 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.995 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.995 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.995 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2023-07-14T13:34:41.995 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2023-07-14T13:34:41.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:41.996 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.996 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.996 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.996 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.996 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.997 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.997 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.997 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.997 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2023-07-14T13:34:41.997 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2023-07-14T13:34:41.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:41.998 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:41.998 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:41.998 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:41.998 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:41.998 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:41.998 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:41.998 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:41.999 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:41.999 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:41.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:41.999 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2023-07-14T13:34:41.999 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2023-07-14T13:34:41.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:41.999 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:41.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.000 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.000 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.000 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.000 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.000 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.000 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.001 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.001 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2023-07-14T13:34:42.001 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2023-07-14T13:34:42.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.001 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.002 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.002 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.002 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.002 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.002 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.002 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.002 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.003 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2023-07-14T13:34:42.003 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2023-07-14T13:34:42.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.003 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.003 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.003 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.004 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2023-07-14T13:34:42.005 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2023-07-14T13:34:42.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.005 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.005 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.005 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.005 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.006 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.006 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.006 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.006 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.006 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.006 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2023-07-14T13:34:42.006 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2023-07-14T13:34:42.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.007 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.007 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.007 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:42.007 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2023-07-14T13:34:42.007 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.007 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.008 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.008 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.008 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2023-07-14T13:34:42.008 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2023-07-14T13:34:42.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.009 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.009 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.009 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.009 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.009 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.009 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.009 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.009 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.010 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.010 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2023-07-14T13:34:42.010 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2023-07-14T13:34:42.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.010 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.011 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.011 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.011 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.011 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.011 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.011 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.011 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.011 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.012 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2023-07-14T13:34:42.012 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2023-07-14T13:34:42.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.012 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.012 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.012 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.013 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.013 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.013 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.013 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.013 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.013 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.014 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2023-07-14T13:34:42.014 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.014 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.014 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.014 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2023-07-14T13:34:42.015 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2023-07-14T13:34:42.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.015 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.015 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.015 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.015 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.015 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.016 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2023-07-14T13:34:42.016 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.016 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.016 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2023-07-14T13:34:42.016 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2023-07-14T13:34:42.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.017 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.017 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.017 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.017 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.017 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.017 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2023-07-14T13:34:42.018 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.018 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.018 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.018 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.018 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.019 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.019 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.019 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.019 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.019 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.019 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.019 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.020 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.020 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.020 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.020 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.020 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.020 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.020 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.021 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.021 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.021 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.021 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.022 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.022 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.022 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.022 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.022 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.022 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.022 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.023 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.023 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.023 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.024 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.024 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.024 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.024 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.024 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.024 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.024 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.024 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.025 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.025 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.025 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.025 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.025 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.025 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.026 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.026 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.026 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.026 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.026 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.027 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.027 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.027 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.027 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2023-07-14T13:34:42.028 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.028 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.028 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.029 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.029 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.029 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.029 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.029 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.029 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.030 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.030 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.030 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.030 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.030 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.030 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.030 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.030 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.031 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.031 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.031 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.031 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.031 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.032 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.032 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.032 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.032 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.032 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.032 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.032 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.033 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.033 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.033 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.033 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.033 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.033 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.034 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.034 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.034 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.034 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.034 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.034 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.035 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.035 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.035 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.035 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.035 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.035 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.035 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.036 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.036 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.036 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.036 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.036 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.036 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.037 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.037 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.037 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.037 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.037 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.037 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.037 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.038 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2023-07-14T13:34:42.038 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.038 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.038 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.038 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.039 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.039 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.039 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.039 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.039 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.039 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.040 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.040 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.040 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.040 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.040 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.040 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.040 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.041 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.041 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.041 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.041 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.041 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.042 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.042 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.042 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.042 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.042 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.042 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.042 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.043 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.043 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.043 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.043 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.044 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.044 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.044 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.044 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.044 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.044 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.045 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.045 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.045 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.045 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.045 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.045 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.045 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.045 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.046 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.046 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.046 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.046 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.047 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.047 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.047 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.047 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.047 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.047 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.047 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.048 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2023-07-14T13:34:42.048 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.049 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.049 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.049 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2023-07-14T13:34:42.049 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2023-07-14T13:34:42.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.049 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.049 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-14T13:34:42.050 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.050 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.050 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.050 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.050 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.050 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.050 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.051 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:42.051 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:42.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.051 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.051 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2023-07-14T13:34:42.051 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.051 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.052 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.052 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.052 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.052 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.052 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.052 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.053 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.053 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.053 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.053 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.054 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.054 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.054 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.054 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.054 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.054 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.054 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.054 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.055 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.055 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.055 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.055 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.055 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.056 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.056 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.056 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.056 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.056 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.056 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.056 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.057 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.057 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.057 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.057 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.057 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.058 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.058 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.058 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.058 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.058 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.058 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.058 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.059 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.059 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.059 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.059 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.059 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.059 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.059 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.060 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.060 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.060 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.060 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.060 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.061 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.061 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.061 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.061 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.061 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.061 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.062 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2023-07-14T13:34:42.062 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.062 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.062 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.062 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2023-07-14T13:34:42.063 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2023-07-14T13:34:42.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.063 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.063 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.063 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.063 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.063 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.064 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2023-07-14T13:34:42.064 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.064 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.064 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2023-07-14T13:34:42.064 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2023-07-14T13:34:42.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.065 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.065 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.065 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.065 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.065 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.065 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-07-14T13:34:42.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.066 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.066 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2023-07-14T13:34:42.066 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2023-07-14T13:34:42.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.066 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.067 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.067 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.067 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-07-14T13:34:42.067 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.068 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.068 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2023-07-14T13:34:42.068 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2023-07-14T13:34:42.068 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.068 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.068 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.068 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.069 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.069 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.069 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.069 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-07-14T13:34:42.069 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.069 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.069 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.070 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2023-07-14T13:34:42.070 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2023-07-14T13:34:42.070 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.070 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.070 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.070 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.071 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.071 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.071 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2023-07-14T13:34:42.071 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.071 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.072 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2023-07-14T13:34:42.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2023-07-14T13:34:42.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.072 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.072 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.072 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.073 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.073 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.073 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.073 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.073 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.073 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2023-07-14T13:34:42.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2023-07-14T13:34:42.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.074 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.074 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.074 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.074 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.074 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.075 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.075 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.075 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.075 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.075 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2023-07-14T13:34:42.075 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2023-07-14T13:34:42.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.076 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.076 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-07-14T13:34:42.076 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.076 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.076 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.076 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.077 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.077 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.077 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-07-14T13:34:42.077 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-07-14T13:34:42.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.078 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.078 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.078 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.078 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.078 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.078 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.078 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.079 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.079 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.079 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.079 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:42.079 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:42.079 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.079 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.080 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2023-07-14T13:34:42.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2023-07-14T13:34:42.080 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.080 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.080 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.080 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.081 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.081 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.081 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2023-07-14T13:34:42.081 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2023-07-14T13:34:42.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.081 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.082 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2023-07-14T13:34:42.082 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.082 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.082 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.082 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.082 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.083 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.083 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2023-07-14T13:34:42.083 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2023-07-14T13:34:42.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.083 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.084 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.084 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.084 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.084 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.084 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.084 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.084 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.085 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.085 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2023-07-14T13:34:42.085 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2023-07-14T13:34:42.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.085 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.086 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.086 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.086 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.086 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.086 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.086 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.086 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.087 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.087 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.087 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.087 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.088 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.088 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.088 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.088 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.088 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.088 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.088 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.089 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.089 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.089 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.089 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.089 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.089 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.089 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.090 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.090 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.090 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.090 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.091 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.091 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.091 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.091 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.091 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.091 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.091 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.092 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.092 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.092 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.092 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.092 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.093 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.093 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.093 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.093 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.093 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.093 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.093 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.093 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.094 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.094 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.094 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.094 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.094 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.094 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.095 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.095 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.095 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.095 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.095 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.096 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.096 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.096 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.096 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.096 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.096 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2023-07-14T13:34:42.096 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2023-07-14T13:34:42.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.097 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.097 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.097 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.097 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.097 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.098 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.098 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.098 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.098 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.098 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2023-07-14T13:34:42.098 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2023-07-14T13:34:42.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.099 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.099 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.099 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.099 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.099 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.099 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.100 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.100 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.100 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2023-07-14T13:34:42.100 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2023-07-14T13:34:42.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.100 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.101 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-07-14T13:34:42.101 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.101 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.101 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.101 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.101 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.102 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.102 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2023-07-14T13:34:42.102 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.103 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.103 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.103 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.103 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.103 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.103 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.104 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.104 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.104 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.104 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.104 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.104 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.104 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.105 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.105 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.105 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.105 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.105 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.105 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.106 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.106 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.106 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.106 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.106 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.106 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.107 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.107 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.107 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.107 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.107 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.107 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.107 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.108 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.108 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.108 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.108 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.108 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.109 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.109 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.109 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.109 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.109 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.109 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.109 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.109 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.110 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.110 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.110 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.110 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.110 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.111 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.111 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.111 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.111 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.111 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.111 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.111 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.111 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.112 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.112 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.112 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.112 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.112 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2023-07-14T13:34:42.112 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.113 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.113 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.113 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.113 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.113 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.113 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.113 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.114 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.114 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.114 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.114 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.114 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.114 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.114 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.114 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.115 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.115 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.115 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.115 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.115 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.115 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.116 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.116 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.116 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.116 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.116 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.116 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.117 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.117 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.117 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.117 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.117 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.117 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.118 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.118 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.118 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.118 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.118 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.119 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.119 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.119 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.119 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.119 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.119 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.119 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.119 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.120 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.120 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.120 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.120 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.120 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.121 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.121 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.121 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.121 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.121 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.121 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.122 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.122 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.122 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2023-07-14T13:34:42.122 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2023-07-14T13:34:42.122 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.122 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.122 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.123 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2023-07-14T13:34:42.123 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.123 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.123 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.123 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2023-07-14T13:34:42.123 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.123 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.124 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.124 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2023-07-14T13:34:42.124 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2023-07-14T13:34:42.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.124 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.124 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.124 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:42.125 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.125 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.125 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.125 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-07-14T13:34:42.125 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.125 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.125 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.126 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2023-07-14T13:34:42.126 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.126 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.126 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.126 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2023-07-14T13:34:42.127 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2023-07-14T13:34:42.127 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:42.127 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.127 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.127 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2023-07-14T13:34:42.127 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.127 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.128 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.128 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.128 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.128 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.128 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.128 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2023-07-14T13:34:42.128 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2023-07-14T13:34:42.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.129 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.129 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.129 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.129 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.129 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.129 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.130 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.130 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.130 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.130 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:42.130 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:42.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.131 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.131 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.131 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:42.131 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.131 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.131 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.131 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.131 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.132 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.132 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.132 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.132 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.132 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.133 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.133 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.133 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.133 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.133 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.133 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.133 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.133 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.134 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.134 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.134 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.134 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.134 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.134 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.134 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.135 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.135 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.135 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.135 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.136 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.136 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.136 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.136 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.136 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.136 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.136 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.137 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.137 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.137 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.137 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.137 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.137 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.138 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.138 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.138 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.138 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.138 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.138 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.138 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.138 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.139 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.139 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.139 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.139 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.139 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.140 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.140 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.140 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.140 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.140 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.140 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.140 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.140 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.141 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.141 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.141 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.141 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2023-07-14T13:34:42.141 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2023-07-14T13:34:42.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.141 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.142 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.142 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.142 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.142 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.142 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.142 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.142 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.143 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.143 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2023-07-14T13:34:42.143 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2023-07-14T13:34:42.143 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.143 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.143 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.143 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2023-07-14T13:34:42.144 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.144 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.144 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.144 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.144 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.144 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.144 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.145 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2023-07-14T13:34:42.145 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2023-07-14T13:34:42.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.145 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.145 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-07-14T13:34:42.145 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.146 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.146 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.146 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.146 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.146 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.146 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.147 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T13:34:42.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.147 INFO:teuthology.orchestra.run.smithi017.stdout: "gid": 15519, 2023-07-14T13:34:42.147 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "y", 2023-07-14T13:34:42.147 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_features": 4540138322906710015, 2023-07-14T13:34:42.148 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2023-07-14T13:34:42.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.148 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2023-07-14T13:34:42.148 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.148 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.148 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.148 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:42.149 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:42.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.149 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.149 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:42.149 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.149 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.150 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.150 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2023-07-14T13:34:42.150 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.150 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.150 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.150 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.151 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.151 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.151 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.151 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.151 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.151 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.151 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.152 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.152 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.152 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.152 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.152 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.152 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.152 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.153 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.153 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.153 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.153 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.153 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.154 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.154 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.154 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.154 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.154 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.154 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.154 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.155 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.155 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.155 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.155 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.155 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.155 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.156 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.156 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.156 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.156 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.156 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.156 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.156 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.157 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.157 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.157 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.157 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.157 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.157 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.157 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.157 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2023-07-14T13:34:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2023-07-14T13:34:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2023-07-14T13:34:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2023-07-14T13:34:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2023-07-14T13:34:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2023-07-14T13:34:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2023-07-14T13:34:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2023-07-14T13:34:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2023-07-14T13:34:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2023-07-14T13:34:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2023-07-14T13:34:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2023-07-14T13:34:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2023-07-14T13:34:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2023-07-14T13:34:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2023-07-14T13:34:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2023-07-14T13:34:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2023-07-14T13:34:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2023-07-14T13:34:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2023-07-14T13:34:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2023-07-14T13:34:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2023-07-14T13:34:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2023-07-14T13:34:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2023-07-14T13:34:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2023-07-14T13:34:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2023-07-14T13:34:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2023-07-14T13:34:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2023-07-14T13:34:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2023-07-14T13:34:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2023-07-14T13:34:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2023-07-14T13:34:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2023-07-14T13:34:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2023-07-14T13:34:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2023-07-14T13:34:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2023-07-14T13:34:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T13:34:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2023-07-14T13:34:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2023-07-14T13:34:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-07-14T13:34:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-07-14T13:34:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-14T13:34:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T13:34:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2023-07-14T13:34:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2023-07-14T13:34:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2023-07-14T13:34:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2023-07-14T13:34:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-07-14T13:34:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2023-07-14T13:34:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2023-07-14T13:34:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2023-07-14T13:34:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-07-14T13:34:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-14T13:34:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2023-07-14T13:34:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2023-07-14T13:34:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2023-07-14T13:34:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2023-07-14T13:34:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2023-07-14T13:34:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2023-07-14T13:34:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-14T13:34:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2023-07-14T13:34:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2023-07-14T13:34:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2023-07-14T13:34:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2023-07-14T13:34:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T13:34:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2023-07-14T13:34:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2023-07-14T13:34:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-07-14T13:34:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-07-14T13:34:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-14T13:34:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T13:34:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2023-07-14T13:34:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2023-07-14T13:34:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-07-14T13:34:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-07-14T13:34:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-07-14T13:34:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2023-07-14T13:34:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2023-07-14T13:34:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2023-07-14T13:34:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap" 2023-07-14T13:34:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2023-07-14T13:34:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2023-07-14T13:34:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2023-07-14T13:34:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-07-14T13:34:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-07-14T13:34:42.207 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.207 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.207 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.207 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2023-07-14T13:34:42.207 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2023-07-14T13:34:42.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2023-07-14T13:34:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-14T13:34:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2023-07-14T13:34:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2023-07-14T13:34:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-07-14T13:34:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2023-07-14T13:34:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2023-07-14T13:34:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2023-07-14T13:34:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-07-14T13:34:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-07-14T13:34:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2023-07-14T13:34:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2023-07-14T13:34:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2023-07-14T13:34:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-07-14T13:34:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2023-07-14T13:34:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2023-07-14T13:34:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2023-07-14T13:34:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-07-14T13:34:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "alertmanager_web_password": { 2023-07-14T13:34:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alertmanager_web_password", 2023-07-14T13:34:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Alertmanager web password", 2023-07-14T13:34:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "alertmanager_web_user": { 2023-07-14T13:34:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alertmanager_web_user", 2023-07-14T13:34:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Alertmanager web user", 2023-07-14T13:34:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2023-07-14T13:34:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2023-07-14T13:34:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-14T13:34:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-14T13:34:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2023-07-14T13:34:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2023-07-14T13:34:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2023-07-14T13:34:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2023-07-14T13:34:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2023-07-14T13:34:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2023-07-14T13:34:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-07-14T13:34:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2023-07-14T13:34:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2023-07-14T13:34:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-07-14T13:34:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2023-07-14T13:34:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2023-07-14T13:34:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-07-14T13:34:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2023-07-14T13:34:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2023-07-14T13:34:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-07-14T13:34:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2023-07-14T13:34:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2023-07-14T13:34:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-07-14T13:34:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2023-07-14T13:34:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2023-07-14T13:34:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2023-07-14T13:34:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2023-07-14T13:34:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2023-07-14T13:34:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2023-07-14T13:34:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-07-14T13:34:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2023-07-14T13:34:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2023-07-14T13:34:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2023-07-14T13:34:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-07-14T13:34:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2023-07-14T13:34:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2023-07-14T13:34:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-07-14T13:34:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2023-07-14T13:34:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2023-07-14T13:34:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2023-07-14T13:34:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-07-14T13:34:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2023-07-14T13:34:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2023-07-14T13:34:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2023-07-14T13:34:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-07-14T13:34:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2023-07-14T13:34:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2023-07-14T13:34:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2023-07-14T13:34:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-07-14T13:34:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2023-07-14T13:34:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2023-07-14T13:34:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2023-07-14T13:34:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-07-14T13:34:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2023-07-14T13:34:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2023-07-14T13:34:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2023-07-14T13:34:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-07-14T13:34:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2023-07-14T13:34:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2023-07-14T13:34:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2023-07-14T13:34:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-07-14T13:34:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2023-07-14T13:34:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2023-07-14T13:34:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-07-14T13:34:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2023-07-14T13:34:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2023-07-14T13:34:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-07-14T13:34:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2023-07-14T13:34:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2023-07-14T13:34:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2023-07-14T13:34:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-07-14T13:34:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2023-07-14T13:34:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2023-07-14T13:34:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2023-07-14T13:34:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2023-07-14T13:34:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2023-07-14T13:34:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2023-07-14T13:34:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-07-14T13:34:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2023-07-14T13:34:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2023-07-14T13:34:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2023-07-14T13:34:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-07-14T13:34:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2023-07-14T13:34:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2023-07-14T13:34:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2023-07-14T13:34:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-07-14T13:34:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2023-07-14T13:34:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2023-07-14T13:34:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2023-07-14T13:34:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2023-07-14T13:34:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2023-07-14T13:34:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2023-07-14T13:34:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2023-07-14T13:34:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2023-07-14T13:34:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2023-07-14T13:34:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2023-07-14T13:34:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2023-07-14T13:34:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2023-07-14T13:34:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2023-07-14T13:34:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2023-07-14T13:34:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2023-07-14T13:34:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-07-14T13:34:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-14T13:34:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2023-07-14T13:34:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-07-14T13:34:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-07-14T13:34:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-07-14T13:34:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-07-14T13:34:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.286 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2023-07-14T13:34:42.286 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.286 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.286 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.286 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-07-14T13:34:42.286 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.287 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.287 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2023-07-14T13:34:42.287 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2023-07-14T13:34:42.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.287 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.287 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:42.288 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.288 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.288 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.288 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2023-07-14T13:34:42.288 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.288 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.289 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2023-07-14T13:34:42.289 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2023-07-14T13:34:42.289 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.289 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.289 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.289 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:42.289 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.290 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.290 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.290 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-07-14T13:34:42.290 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.290 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.290 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.290 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2023-07-14T13:34:42.291 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2023-07-14T13:34:42.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.291 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.291 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.291 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.291 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.291 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.292 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.292 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2023-07-14T13:34:42.292 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.292 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.292 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.293 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-07-14T13:34:42.293 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-07-14T13:34:42.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.293 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.293 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.293 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2023-07-14T13:34:42.293 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.294 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.294 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.294 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2023-07-14T13:34:42.294 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2023-07-14T13:34:42.294 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.294 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2023-07-14T13:34:42.294 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.295 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.295 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2023-07-14T13:34:42.295 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2023-07-14T13:34:42.295 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.295 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.295 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.296 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-07-14T13:34:42.296 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.296 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.296 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.296 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-07-14T13:34:42.296 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.296 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.297 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.297 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_web_password": { 2023-07-14T13:34:42.297 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_web_password", 2023-07-14T13:34:42.297 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.297 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.297 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.297 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:42.298 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.298 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.298 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.298 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus web password", 2023-07-14T13:34:42.298 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.298 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.298 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.299 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_web_user": { 2023-07-14T13:34:42.299 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_web_user", 2023-07-14T13:34:42.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.299 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.299 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.299 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:42.299 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.300 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.300 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.300 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus web user", 2023-07-14T13:34:42.300 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.300 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.301 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2023-07-14T13:34:42.301 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2023-07-14T13:34:42.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.301 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.301 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.301 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.301 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.302 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.302 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.302 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-07-14T13:34:42.302 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.302 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.302 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.302 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2023-07-14T13:34:42.303 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2023-07-14T13:34:42.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.303 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.303 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.303 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.303 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.303 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.304 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.304 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-07-14T13:34:42.304 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.304 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.304 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2023-07-14T13:34:42.304 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2023-07-14T13:34:42.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.305 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.305 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.305 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.305 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.305 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.305 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.305 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-07-14T13:34:42.306 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.306 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.306 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2023-07-14T13:34:42.306 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2023-07-14T13:34:42.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.306 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-07-14T13:34:42.307 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2023-07-14T13:34:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2023-07-14T13:34:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-07-14T13:34:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2023-07-14T13:34:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2023-07-14T13:34:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.310 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2023-07-14T13:34:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2023-07-14T13:34:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2023-07-14T13:34:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2023-07-14T13:34:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.312 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-07-14T13:34:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2023-07-14T13:34:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2023-07-14T13:34:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.314 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-07-14T13:34:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.315 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2023-07-14T13:34:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2023-07-14T13:34:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.316 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-07-14T13:34:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.317 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2023-07-14T13:34:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2023-07-14T13:34:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.318 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2023-07-14T13:34:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2023-07-14T13:34:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2023-07-14T13:34:42.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.320 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-14T13:34:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2023-07-14T13:34:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2023-07-14T13:34:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.321 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-14T13:34:42.322 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2023-07-14T13:34:42.323 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.324 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.325 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.325 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.325 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.325 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.325 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.325 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.325 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.325 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.326 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.326 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.326 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.326 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.326 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.326 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.326 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.327 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.327 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.327 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.327 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.327 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.327 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.328 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.328 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.328 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.328 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.328 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.328 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.329 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.329 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.329 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.329 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.329 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.329 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.330 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.330 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.330 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.330 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.330 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.330 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.330 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.331 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.331 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.331 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.331 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.331 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.332 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.332 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.332 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.332 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.332 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.332 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.332 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.333 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.333 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.333 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2023-07-14T13:34:42.333 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2023-07-14T13:34:42.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.333 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.333 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2023-07-14T13:34:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2023-07-14T13:34:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.334 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2023-07-14T13:34:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2023-07-14T13:34:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2023-07-14T13:34:42.335 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2023-07-14T13:34:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.336 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2023-07-14T13:34:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.337 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-07-14T13:34:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-07-14T13:34:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.338 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2023-07-14T13:34:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2023-07-14T13:34:42.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.340 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.341 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.341 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.341 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-07-14T13:34:42.341 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-07-14T13:34:42.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.342 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2023-07-14T13:34:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2023-07-14T13:34:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.343 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.344 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-07-14T13:34:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-14T13:34:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.346 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2023-07-14T13:34:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2023-07-14T13:34:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.347 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-07-14T13:34:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-07-14T13:34:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.349 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-07-14T13:34:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-07-14T13:34:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.351 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-07-14T13:34:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-07-14T13:34:42.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.353 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-07-14T13:34:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-07-14T13:34:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.354 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.355 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.356 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.356 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2023-07-14T13:34:42.356 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-07-14T13:34:42.356 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.356 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.356 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.356 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.357 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.357 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.357 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.357 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.357 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.357 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.358 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2023-07-14T13:34:42.358 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-07-14T13:34:42.358 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.358 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.358 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.358 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.358 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.358 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.359 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.359 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.359 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.359 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.359 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.359 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2023-07-14T13:34:42.359 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-07-14T13:34:42.360 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.360 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.360 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.360 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.360 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.360 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.360 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-14T13:34:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-14T13:34:42.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.362 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.362 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.362 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.362 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.362 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.362 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.362 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2023-07-14T13:34:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2023-07-14T13:34:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.363 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.364 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:42.364 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.364 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.364 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.364 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.364 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.365 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.365 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-07-14T13:34:42.365 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-07-14T13:34:42.365 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.365 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.365 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.366 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.366 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.366 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.366 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.366 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.366 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.366 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.366 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2023-07-14T13:34:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2023-07-14T13:34:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.367 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.368 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.368 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.368 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.368 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.368 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.368 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.369 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2023-07-14T13:34:42.369 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2023-07-14T13:34:42.369 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.369 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.369 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.369 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:42.369 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.369 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.370 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.370 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.370 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.370 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.370 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.370 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-07-14T13:34:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-07-14T13:34:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.371 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-14T13:34:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-14T13:34:42.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.373 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.373 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.373 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.373 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.373 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.373 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.373 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.374 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.374 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-07-14T13:34:42.374 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-14T13:34:42.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.374 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.375 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.375 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.375 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.375 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.375 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.375 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.375 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.375 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.376 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.376 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2023-07-14T13:34:42.376 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-07-14T13:34:42.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.376 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.376 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.376 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.377 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.377 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.377 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.377 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.377 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.377 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.377 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.378 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2023-07-14T13:34:42.378 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2023-07-14T13:34:42.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.378 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.378 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.378 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.378 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.378 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.379 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.379 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.379 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.379 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.379 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.379 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-07-14T13:34:42.380 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-07-14T13:34:42.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.380 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.380 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.380 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.380 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.381 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.381 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.381 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.381 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.381 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-14T13:34:42.381 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-14T13:34:42.382 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.382 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.382 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.382 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.382 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.382 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.382 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.383 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.383 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.383 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.383 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-14T13:34:42.383 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-14T13:34:42.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.384 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.384 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.384 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.384 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.384 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.384 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.384 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.385 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.385 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-14T13:34:42.385 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-14T13:34:42.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.385 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.385 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.386 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.386 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.386 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.386 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.386 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.386 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.386 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.387 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.387 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-14T13:34:42.387 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-14T13:34:42.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.387 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.387 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.388 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.388 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.388 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.388 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.388 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.388 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.388 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.389 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-14T13:34:42.389 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-14T13:34:42.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.389 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.389 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.389 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.389 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.390 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.390 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.390 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.390 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.390 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.390 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.391 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-14T13:34:42.391 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-14T13:34:42.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.391 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.391 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.391 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.391 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.391 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.392 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.392 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.392 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.392 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.392 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.392 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-14T13:34:42.392 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-14T13:34:42.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.393 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.393 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.393 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.393 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.393 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.393 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.394 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.394 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.394 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.394 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2023-07-14T13:34:42.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2023-07-14T13:34:42.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.395 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.395 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.395 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.395 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.395 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.395 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.395 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.396 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.396 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.396 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-07-14T13:34:42.396 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-14T13:34:42.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.397 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.397 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-14T13:34:42.397 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.397 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.397 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.397 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.397 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.398 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.398 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.398 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-14T13:34:42.398 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-14T13:34:42.398 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.398 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.399 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.399 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:42.399 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.399 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.399 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.399 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.399 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.399 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.400 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.400 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-07-14T13:34:42.400 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-07-14T13:34:42.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.400 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.400 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2023-07-14T13:34:42.401 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.401 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.401 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.401 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.401 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.401 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.402 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2023-07-14T13:34:42.402 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-07-14T13:34:42.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.402 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.402 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2023-07-14T13:34:42.402 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.403 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.403 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.403 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.403 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.403 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.403 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2023-07-14T13:34:42.404 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2023-07-14T13:34:42.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.404 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.404 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.404 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.404 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.404 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.404 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.405 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.405 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.405 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.405 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.405 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-07-14T13:34:42.405 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-07-14T13:34:42.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.406 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.406 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.406 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:42.406 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.406 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.406 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.406 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.406 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.407 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.407 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.407 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2023-07-14T13:34:42.407 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2023-07-14T13:34:42.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.407 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.408 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.408 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.408 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.408 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.408 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.408 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.408 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.408 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.409 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.409 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2023-07-14T13:34:42.409 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2023-07-14T13:34:42.409 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.409 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.409 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.409 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.410 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.410 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.410 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.410 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.410 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.410 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.410 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.411 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-07-14T13:34:42.411 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-14T13:34:42.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.411 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.411 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:42.411 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.412 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.412 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.412 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.412 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.412 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.412 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.413 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-14T13:34:42.413 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-14T13:34:42.413 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.413 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.413 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:42.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.413 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.414 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.414 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.414 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.414 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.414 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.414 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-14T13:34:42.414 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-14T13:34:42.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.415 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.415 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:42.415 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.415 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.415 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.415 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2023-07-14T13:34:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2023-07-14T13:34:42.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.417 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.418 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.418 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2023-07-14T13:34:42.418 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2023-07-14T13:34:42.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.418 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.418 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.419 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.419 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.419 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.419 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.419 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.419 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.419 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.420 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.420 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2023-07-14T13:34:42.420 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2023-07-14T13:34:42.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.420 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.421 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.421 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.421 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.421 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.421 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2023-07-14T13:34:42.421 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.421 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.421 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.422 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2023-07-14T13:34:42.422 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2023-07-14T13:34:42.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.422 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.422 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2023-07-14T13:34:42.423 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.423 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.423 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.423 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.423 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.423 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.424 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-07-14T13:34:42.424 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-07-14T13:34:42.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.424 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.424 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.425 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.425 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.425 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.425 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.425 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.425 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.426 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.426 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.426 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.426 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.426 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.426 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.426 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.427 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.427 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.427 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.427 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.427 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.427 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.427 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.427 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.429 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.429 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.429 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.429 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.429 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.429 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.429 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.430 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.430 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.430 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.430 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.430 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.431 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.431 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.431 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.431 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.431 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.431 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.431 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.432 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.432 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.432 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.432 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.432 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.432 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.432 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.432 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.433 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.433 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.433 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.433 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.433 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.434 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.434 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.434 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.434 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.434 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.434 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2023-07-14T13:34:42.435 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2023-07-14T13:34:42.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.435 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.435 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.435 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.435 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.436 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.436 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2023-07-14T13:34:42.436 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.436 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.436 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.436 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2023-07-14T13:34:42.437 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2023-07-14T13:34:42.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.437 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.437 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.437 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.437 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.437 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.438 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.438 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.438 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.438 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.438 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-07-14T13:34:42.438 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-07-14T13:34:42.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.439 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.439 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.439 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-07-14T13:34:42.439 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.439 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.439 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.440 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.440 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.440 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.440 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.440 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-07-14T13:34:42.440 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-07-14T13:34:42.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.441 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.441 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.441 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2023-07-14T13:34:42.441 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.441 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.441 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.441 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.441 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.442 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.442 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-07-14T13:34:42.442 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-07-14T13:34:42.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.442 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.443 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.443 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.443 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.443 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.443 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.443 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.443 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.444 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.444 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.444 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2023-07-14T13:34:42.444 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2023-07-14T13:34:42.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.444 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.445 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2023-07-14T13:34:42.445 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.445 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.445 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.445 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.445 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.445 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.446 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-07-14T13:34:42.446 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-07-14T13:34:42.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.446 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.446 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2023-07-14T13:34:42.446 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.447 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.447 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.447 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.447 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2023-07-14T13:34:42.447 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.447 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.447 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.448 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.448 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-07-14T13:34:42.448 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-07-14T13:34:42.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.448 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.449 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-07-14T13:34:42.449 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-07-14T13:34:42.449 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-07-14T13:34:42.449 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.449 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.449 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.449 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.450 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2023-07-14T13:34:42.450 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2023-07-14T13:34:42.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.450 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.450 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.451 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.451 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.451 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.451 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.451 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.452 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2023-07-14T13:34:42.452 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.452 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.452 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.452 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2023-07-14T13:34:42.453 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2023-07-14T13:34:42.453 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.453 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.453 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.453 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.453 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.453 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.453 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.454 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2023-07-14T13:34:42.454 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.454 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.454 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.454 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.454 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.455 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.455 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.455 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.455 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.455 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.455 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.457 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.457 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.457 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.457 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.457 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.457 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.458 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.458 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.458 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.458 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.458 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.458 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.458 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.458 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.459 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.459 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.459 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.459 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.459 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.460 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.460 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.460 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.460 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.460 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.460 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.460 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.460 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.461 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.461 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.461 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.461 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.461 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.462 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.462 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.462 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.462 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.462 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.462 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.462 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.463 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.463 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.463 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.463 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.463 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.463 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.463 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2023-07-14T13:34:42.464 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2023-07-14T13:34:42.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.464 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.464 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2023-07-14T13:34:42.464 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.464 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.464 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.465 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-07-14T13:34:42.465 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.465 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.465 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2023-07-14T13:34:42.465 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2023-07-14T13:34:42.466 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.466 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.466 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.466 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2023-07-14T13:34:42.466 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.466 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.466 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.467 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2023-07-14T13:34:42.467 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.467 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.467 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.467 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2023-07-14T13:34:42.467 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2023-07-14T13:34:42.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.468 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.468 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.468 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2023-07-14T13:34:42.468 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.468 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.468 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.468 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2023-07-14T13:34:42.469 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.469 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.469 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.469 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2023-07-14T13:34:42.469 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2023-07-14T13:34:42.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.470 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-07-14T13:34:42.470 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.470 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.470 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.470 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2023-07-14T13:34:42.470 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.471 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.471 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.471 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2023-07-14T13:34:42.471 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2023-07-14T13:34:42.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.471 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.472 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.472 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.472 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.472 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.472 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-07-14T13:34:42.472 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.472 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.472 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.473 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:42.473 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:42.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.473 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.473 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:42.473 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.474 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.474 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.474 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2023-07-14T13:34:42.474 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.474 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.475 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2023-07-14T13:34:42.475 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2023-07-14T13:34:42.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.475 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2023-07-14T13:34:42.475 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.475 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.476 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.476 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-07-14T13:34:42.476 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.476 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.476 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.477 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2023-07-14T13:34:42.477 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.477 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.477 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.477 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.477 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.478 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.478 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.478 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.478 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.478 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.478 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.478 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.479 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.479 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.479 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.479 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.479 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.479 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.479 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.480 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.480 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.480 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.480 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.480 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.481 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.481 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.481 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.481 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.481 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.481 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.481 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.482 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.482 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.482 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.482 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.482 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.482 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.483 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.483 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.483 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.483 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.484 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.484 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.484 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.484 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.484 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.484 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.484 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.485 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.485 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.485 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.485 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.485 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.485 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.486 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.486 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.486 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.486 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.486 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.486 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.487 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.487 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.487 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.487 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2023-07-14T13:34:42.487 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2023-07-14T13:34:42.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.488 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.488 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.488 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-07-14T13:34:42.488 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.488 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.488 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.488 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.489 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.489 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.489 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.489 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2023-07-14T13:34:42.489 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2023-07-14T13:34:42.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.489 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.490 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2023-07-14T13:34:42.490 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.490 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.490 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.490 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.490 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.491 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.491 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.491 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:42.491 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:42.491 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.491 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.492 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:42.492 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.492 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.492 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.492 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.492 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.493 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.493 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2023-07-14T13:34:42.493 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2023-07-14T13:34:42.494 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2023-07-14T13:34:42.494 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.494 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2023-07-14T13:34:42.494 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2023-07-14T13:34:42.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.494 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.494 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2023-07-14T13:34:42.495 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.495 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.495 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.495 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-07-14T13:34:42.495 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.495 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.495 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.496 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2023-07-14T13:34:42.496 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2023-07-14T13:34:42.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.496 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.496 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2023-07-14T13:34:42.496 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.497 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.497 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.497 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-07-14T13:34:42.497 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.497 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.497 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2023-07-14T13:34:42.498 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2023-07-14T13:34:42.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.498 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.498 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.498 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.498 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.498 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.499 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.499 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2023-07-14T13:34:42.499 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.499 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.499 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.499 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:42.499 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:42.500 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.500 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.500 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.500 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2023-07-14T13:34:42.500 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2023-07-14T13:34:42.500 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.500 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.501 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-07-14T13:34:42.501 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.501 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.501 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.501 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.502 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.502 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.502 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.502 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.502 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.502 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.503 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.503 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.503 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.503 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.503 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.503 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.503 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.503 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.504 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.504 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.504 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.504 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.504 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.505 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.505 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.505 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.505 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.505 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.505 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.506 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.506 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.506 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.506 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.506 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.506 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.507 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.507 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.507 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.507 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.507 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.507 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.507 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.507 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.508 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.508 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.508 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.508 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.508 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.508 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.509 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.509 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.509 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.509 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.509 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.509 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.509 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.510 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.510 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.510 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.510 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.510 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.510 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2023-07-14T13:34:42.510 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2023-07-14T13:34:42.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.511 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.511 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.511 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.511 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.511 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.512 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2023-07-14T13:34:42.512 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.512 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.512 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.512 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2023-07-14T13:34:42.512 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2023-07-14T13:34:42.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.513 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.513 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2023-07-14T13:34:42.513 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.513 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.513 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.513 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2023-07-14T13:34:42.514 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.514 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.514 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.514 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-07-14T13:34:42.514 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-07-14T13:34:42.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.515 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.515 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.515 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2023-07-14T13:34:42.515 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.515 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.515 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.515 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T13:34:42.515 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.516 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.516 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.516 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2023-07-14T13:34:42.516 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2023-07-14T13:34:42.516 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.517 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.517 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:42.517 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:42.517 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2023-07-14T13:34:42.517 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.517 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-07-14T13:34:42.518 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.518 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.518 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2023-07-14T13:34:42.518 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2023-07-14T13:34:42.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.518 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.519 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.519 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.519 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.519 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.519 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.519 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2023-07-14T13:34:42.519 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.519 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.520 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.520 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2023-07-14T13:34:42.520 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2023-07-14T13:34:42.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.520 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.520 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.521 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2023-07-14T13:34:42.521 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.521 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.521 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.521 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T13:34:42.521 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.521 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.522 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2023-07-14T13:34:42.522 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.522 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.522 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.523 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.523 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.523 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.523 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.523 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.523 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.523 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.524 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.524 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.524 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.524 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.524 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.524 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.524 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.524 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.525 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.525 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.525 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.525 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.525 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.525 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.526 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.526 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.526 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.526 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.526 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.526 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.527 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.527 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.527 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.527 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.527 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.527 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.527 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.528 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.528 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.528 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.528 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.528 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.528 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.528 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.528 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.529 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.529 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.529 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.529 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.529 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.529 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.529 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.530 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.530 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.530 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.530 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.531 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.531 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.531 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.531 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.531 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.531 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.531 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.531 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.532 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2023-07-14T13:34:42.532 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.532 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.532 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.533 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.534 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.535 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.536 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.536 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.536 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.536 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.536 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.537 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.537 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.537 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.537 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.537 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.537 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.538 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.538 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.538 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.538 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.538 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.538 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.538 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.539 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.539 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.539 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.539 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.539 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.539 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.539 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.540 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.540 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.540 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.540 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.540 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.540 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2023-07-14T13:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.543 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.543 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.543 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2023-07-14T13:34:42.543 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2023-07-14T13:34:42.543 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.543 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.543 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2023-07-14T13:34:42.544 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.544 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.544 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.544 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2023-07-14T13:34:42.544 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.544 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.544 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.545 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2023-07-14T13:34:42.545 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2023-07-14T13:34:42.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.545 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.545 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:42.545 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2023-07-14T13:34:42.546 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.546 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.546 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-07-14T13:34:42.546 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.546 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.547 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.547 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.547 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.547 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.547 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.548 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.548 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.548 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.548 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.548 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.548 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.548 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.548 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.549 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.549 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.549 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.549 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.549 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.549 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.550 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.550 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.550 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.550 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.550 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.550 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.550 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.550 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.551 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.551 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.551 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.551 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.551 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.552 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.552 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.552 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.552 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.552 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.552 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.552 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.552 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.553 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.553 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.553 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.553 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.553 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.553 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.554 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.554 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.554 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.554 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.554 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.554 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.555 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.555 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.555 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.555 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.555 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.555 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.555 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.556 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.556 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2023-07-14T13:34:42.556 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.556 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.556 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.557 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2023-07-14T13:34:42.557 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2023-07-14T13:34:42.557 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.557 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.557 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.557 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2023-07-14T13:34:42.557 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.557 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.558 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.558 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2023-07-14T13:34:42.558 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-07-14T13:34:42.558 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.558 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.558 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.558 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.559 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.559 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.559 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.559 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.559 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.560 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.560 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.560 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.560 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.560 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.560 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.560 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.560 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.561 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.561 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.561 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.561 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.561 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.561 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2023-07-14T13:34:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2023-07-14T13:34:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2023-07-14T13:34:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-07-14T13:34:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2023-07-14T13:34:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2023-07-14T13:34:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2023-07-14T13:34:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2023-07-14T13:34:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2023-07-14T13:34:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2023-07-14T13:34:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2023-07-14T13:34:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2023-07-14T13:34:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2023-07-14T13:34:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2023-07-14T13:34:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.574 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.574 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.574 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.574 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.574 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2023-07-14T13:34:42.574 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.575 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.575 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2023-07-14T13:34:42.575 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2023-07-14T13:34:42.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.575 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.576 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2023-07-14T13:34:42.576 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.576 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.576 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.576 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2023-07-14T13:34:42.576 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-07-14T13:34:42.576 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.576 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.577 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.577 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.577 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2023-07-14T13:34:42.577 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.577 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.577 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.578 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.578 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.578 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.578 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.578 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.579 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.579 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.579 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.579 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.579 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.579 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.579 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.579 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.580 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.580 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.580 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.580 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.580 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.580 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.581 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.581 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.581 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.581 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.581 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.581 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.581 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.581 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.582 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.582 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.582 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.582 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.582 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.583 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.583 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.583 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.583 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.583 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.583 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.584 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.584 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.584 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.584 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.584 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.584 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.584 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.584 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.585 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.585 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.585 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.585 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.585 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.586 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.586 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.586 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.586 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.586 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.586 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.587 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.587 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2023-07-14T13:34:42.588 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.588 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.588 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.588 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.588 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.588 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.589 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.589 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.589 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.589 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.589 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.589 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.589 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.589 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.590 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.590 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.590 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.590 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.590 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.590 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.590 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.591 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.591 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.591 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.591 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.591 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.591 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.592 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.592 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.592 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.592 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.592 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.592 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.593 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.593 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.593 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.593 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.593 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.593 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.594 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.594 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.594 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.594 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.594 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.594 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.594 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.594 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.595 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.595 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.595 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.595 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.595 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.595 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.596 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.596 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.596 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.596 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.596 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.596 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.596 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.597 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.597 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.598 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2023-07-14T13:34:42.598 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.598 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.598 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.598 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.598 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.598 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.599 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.599 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.599 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.599 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.599 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.599 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.599 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.600 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.600 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.600 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.600 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.600 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.600 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.600 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.601 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.601 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.601 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.601 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.602 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.602 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.602 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.602 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.602 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.602 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.602 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.603 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.603 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.603 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.603 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.603 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.603 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.604 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.604 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.604 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.604 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.604 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.604 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.604 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.604 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.605 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.605 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.605 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.605 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.605 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.605 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.605 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.606 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.606 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.606 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.606 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.606 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.606 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.606 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.607 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.607 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.607 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.607 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.607 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.607 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-07-14T13:34:42.608 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.608 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.608 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.608 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2023-07-14T13:34:42.608 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2023-07-14T13:34:42.609 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.609 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.609 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.609 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.609 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.609 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.609 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.609 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-07-14T13:34:42.610 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.610 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.610 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.610 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.610 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.611 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.611 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.611 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.611 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.611 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.611 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.611 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.611 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.612 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.612 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.612 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.612 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.612 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.612 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.613 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.613 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.613 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.613 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.614 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.614 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.614 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.614 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.614 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.614 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.614 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.614 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.615 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.615 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.615 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.615 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.616 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.616 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.616 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.616 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.616 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.616 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.616 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.617 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.617 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.617 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.617 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.617 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.617 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.618 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.618 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.618 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.618 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.618 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.619 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.619 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.619 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.619 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.619 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2023-07-14T13:34:42.619 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-07-14T13:34:42.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.620 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.620 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.620 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.620 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.620 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.620 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.620 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2023-07-14T13:34:42.621 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2023-07-14T13:34:42.621 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2023-07-14T13:34:42.621 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.621 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2023-07-14T13:34:42.621 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.621 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.622 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.622 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2023-07-14T13:34:42.622 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.622 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.622 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.623 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.623 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.623 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.623 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.623 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.624 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.624 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.624 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.624 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.624 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.624 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.624 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.624 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.625 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.625 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.625 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.625 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.625 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.625 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.626 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.626 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.626 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.626 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.626 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.626 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.627 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.627 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.627 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.627 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.628 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.628 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.628 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.628 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.628 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.628 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.629 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.629 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.629 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.629 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.629 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.629 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.629 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.629 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.630 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.630 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.630 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.630 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.631 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.631 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.631 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.631 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.631 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.631 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.632 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.632 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2023-07-14T13:34:42.632 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.633 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.633 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.633 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.633 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.633 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.634 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.634 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.634 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.634 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.634 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.634 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.634 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.634 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.635 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.635 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.635 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.635 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.635 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.635 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.636 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.636 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.636 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.636 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.636 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.636 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.637 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.637 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.637 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.637 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.637 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.637 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.638 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.638 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.638 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.638 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.638 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.639 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.639 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.639 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.639 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.639 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.639 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.639 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.640 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.640 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.640 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.640 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.640 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.641 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.641 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.641 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.641 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.641 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.641 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.642 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.642 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.642 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.642 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.643 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2023-07-14T13:34:42.643 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.643 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.643 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.643 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.643 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.644 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.644 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.644 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.644 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.644 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.644 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.645 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.645 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.645 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.645 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.645 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.645 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.645 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.645 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.646 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.646 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.646 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.646 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.647 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.647 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.647 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.647 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.647 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.647 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.648 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.648 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.648 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.648 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.649 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.649 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.649 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.649 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.649 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.649 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.650 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.650 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.650 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.650 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.650 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.650 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.650 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.650 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.651 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.651 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.651 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.651 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.652 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.652 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.652 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.652 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.652 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.652 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.652 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.653 INFO:teuthology.orchestra.run.smithi017.stdout: "noautoscale": { 2023-07-14T13:34:42.653 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "noautoscale", 2023-07-14T13:34:42.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.653 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.653 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.654 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.654 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.654 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.654 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "global autoscale flag", 2023-07-14T13:34:42.654 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-07-14T13:34:42.654 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.654 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.655 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:42.655 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:42.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.655 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.655 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:42.655 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.656 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.656 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.656 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.656 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.656 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.656 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2023-07-14T13:34:42.657 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2023-07-14T13:34:42.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:42.657 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.657 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-07-14T13:34:42.657 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2023-07-14T13:34:42.657 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.657 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.658 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2023-07-14T13:34:42.658 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-07-14T13:34:42.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.658 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.659 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2023-07-14T13:34:42.659 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.659 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.659 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.659 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2023-07-14T13:34:42.659 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2023-07-14T13:34:42.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.660 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.660 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.660 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.660 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.660 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.660 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2023-07-14T13:34:42.661 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.661 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.661 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-07-14T13:34:42.661 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-07-14T13:34:42.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.661 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.662 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.662 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.662 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.662 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.662 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.662 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.663 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.663 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.663 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.663 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.664 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.664 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.664 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.664 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.664 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.664 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.664 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.664 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.665 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.665 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.665 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.665 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.665 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.665 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.666 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.666 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.666 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.667 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.667 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.667 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.667 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.667 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.668 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.668 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.668 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.668 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.668 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.668 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.669 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.669 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.669 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.669 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.669 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.669 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.669 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.669 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.670 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.670 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.670 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.670 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.670 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.671 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.671 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.671 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.671 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.671 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.671 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.672 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.672 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.672 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.672 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2023-07-14T13:34:42.672 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2023-07-14T13:34:42.672 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.672 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.673 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2023-07-14T13:34:42.673 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.673 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.673 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.673 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2023-07-14T13:34:42.673 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.674 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.674 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:42.674 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:42.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.674 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:42.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.675 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.675 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.675 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2023-07-14T13:34:42.675 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.675 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.676 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2023-07-14T13:34:42.676 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.676 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.677 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.677 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2023-07-14T13:34:42.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2023-07-14T13:34:42.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.677 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.677 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.678 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.678 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.678 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.678 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.679 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2023-07-14T13:34:42.679 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2023-07-14T13:34:42.679 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.679 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.679 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.679 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.679 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.679 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.680 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.680 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-07-14T13:34:42.680 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-07-14T13:34:42.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.680 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.680 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.681 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.681 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.681 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.681 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.681 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.682 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.682 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.682 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.682 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.682 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.682 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.682 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.683 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.683 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.683 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.683 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.683 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.684 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.684 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.684 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.684 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.684 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.684 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.684 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.685 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.685 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.685 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.685 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.686 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.686 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.686 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.686 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.686 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.686 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.686 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.687 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.687 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.687 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.687 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.687 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.687 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.687 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.688 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.688 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.688 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.688 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.688 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.688 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.688 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.689 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.689 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.689 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.689 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.689 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.690 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2023-07-14T13:34:42.690 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2023-07-14T13:34:42.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.690 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.690 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.690 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.690 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.691 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.691 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.691 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.691 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.691 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2023-07-14T13:34:42.692 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-07-14T13:34:42.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.692 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.692 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2023-07-14T13:34:42.692 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.692 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.693 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.693 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.693 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.693 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.693 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.693 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2023-07-14T13:34:42.693 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2023-07-14T13:34:42.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:42.694 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.694 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2023-07-14T13:34:42.694 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.694 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.694 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.694 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.695 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.695 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-07-14T13:34:42.695 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-07-14T13:34:42.695 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.695 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.696 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-07-14T13:34:42.696 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.696 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.696 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.696 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-07-14T13:34:42.696 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.697 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.697 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-07-14T13:34:42.697 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-07-14T13:34:42.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.697 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2023-07-14T13:34:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-07-14T13:34:42.698 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.699 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.699 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2023-07-14T13:34:42.699 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2023-07-14T13:34:42.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.699 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.700 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2023-07-14T13:34:42.700 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.700 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.700 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.701 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.701 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-07-14T13:34:42.701 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-07-14T13:34:42.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.701 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.702 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2023-07-14T13:34:42.702 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.702 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.702 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.702 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2023-07-14T13:34:42.702 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2023-07-14T13:34:42.702 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.702 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.703 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.703 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.703 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-07-14T13:34:42.703 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-07-14T13:34:42.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.704 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.704 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-07-14T13:34:42.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-07-14T13:34:42.704 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-07-14T13:34:42.704 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.705 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.705 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.705 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.705 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.706 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2023-07-14T13:34:42.706 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.706 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.706 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.706 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.707 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.707 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.707 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.707 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.707 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.708 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.708 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.708 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.708 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.708 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.708 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.708 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.708 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.709 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.709 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.709 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.709 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.709 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.710 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.710 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.710 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.710 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.710 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.711 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.711 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.711 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.711 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.711 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.711 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.712 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.712 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.712 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.712 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.713 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.713 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.713 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.713 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.713 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.713 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.713 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.713 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.714 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.714 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.714 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.714 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.714 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.715 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.715 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.715 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.715 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.715 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.715 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.716 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.716 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2023-07-14T13:34:42.716 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2023-07-14T13:34:42.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.716 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.717 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:42.717 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.717 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.717 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.717 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.717 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.718 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.718 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2023-07-14T13:34:42.718 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2023-07-14T13:34:42.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.718 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.718 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.719 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.719 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.719 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.719 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.719 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.719 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.719 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.720 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2023-07-14T13:34:42.720 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2023-07-14T13:34:42.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.720 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.720 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.720 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.720 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.721 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.721 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.721 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.721 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.721 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.722 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2023-07-14T13:34:42.722 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.722 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.722 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.722 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2023-07-14T13:34:42.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2023-07-14T13:34:42.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.723 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.723 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.723 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.723 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.723 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.724 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.724 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.724 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.724 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.724 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-07-14T13:34:42.724 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-07-14T13:34:42.725 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.725 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.725 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.725 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.725 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.725 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.725 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.726 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.726 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.726 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.726 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.727 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.727 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.727 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.727 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.727 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.727 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.728 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.728 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.728 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.728 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.728 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.728 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.728 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.729 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.729 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.729 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.729 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.730 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.730 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.730 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.730 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.730 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.730 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.730 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.731 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.731 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.731 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.731 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.732 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.732 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.732 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.732 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.732 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.732 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.732 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.732 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.733 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.733 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.733 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.733 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.733 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.734 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.734 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.734 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.734 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-07-14T13:34:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-07-14T13:34:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.737 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.737 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.737 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.737 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.737 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-07-14T13:34:42.738 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-07-14T13:34:42.738 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.738 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.738 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.738 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.738 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.738 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.739 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.739 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.739 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.739 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.739 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.740 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2023-07-14T13:34:42.740 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.740 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.740 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.740 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.740 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.740 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.741 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.741 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.741 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.741 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.741 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.741 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.742 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.742 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.742 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.742 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.742 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.742 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.742 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.742 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.743 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.743 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.743 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.744 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.744 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.744 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.744 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.744 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.744 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.745 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.745 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.745 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.745 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.745 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.746 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.746 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.746 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.746 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.746 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.746 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.746 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.746 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.747 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.747 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.747 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.747 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.747 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.747 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.748 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.748 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.748 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.748 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.748 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.749 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.749 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.749 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.749 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.749 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.750 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2023-07-14T13:34:42.750 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.750 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.750 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.750 INFO:teuthology.orchestra.run.smithi017.stdout: "drive_group_interval": { 2023-07-14T13:34:42.751 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "drive_group_interval", 2023-07-14T13:34:42.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:42.751 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.751 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.751 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300.0", 2023-07-14T13:34:42.751 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.751 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.751 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.752 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-07-14T13:34:42.752 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.752 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.752 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.752 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.753 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.753 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.753 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.753 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.753 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.753 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.753 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.753 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.754 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.754 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.754 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.754 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.754 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.754 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.754 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.755 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.755 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.755 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.755 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.756 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.756 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.756 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.756 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.756 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.756 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.757 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.757 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.757 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.757 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.757 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.757 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.757 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.758 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.758 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.758 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.758 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.758 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.758 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.758 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.759 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.759 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.759 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.759 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.759 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.759 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.760 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.760 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.760 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.760 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.760 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.761 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.761 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.761 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.761 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.761 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2023-07-14T13:34:42.762 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2023-07-14T13:34:42.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.762 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.762 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.762 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2023-07-14T13:34:42.762 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.762 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.763 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.763 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-07-14T13:34:42.763 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.763 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2023-07-14T13:34:42.764 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.764 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.764 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.764 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.764 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.765 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.765 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.765 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.765 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.765 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.765 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.766 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.766 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.766 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.766 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.766 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.766 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.766 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.766 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.767 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.767 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.767 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.767 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.767 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.768 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.768 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.768 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.768 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.768 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.768 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.768 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.768 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.769 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.769 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.769 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.769 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.769 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.770 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.770 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.770 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.770 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.770 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.770 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.771 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.771 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.771 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.771 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.771 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.771 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.771 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.772 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.772 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.772 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.772 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.772 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.773 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.773 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.773 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.773 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.773 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.773 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.774 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2023-07-14T13:34:42.774 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2023-07-14T13:34:42.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.774 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.774 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.774 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.775 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.775 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.775 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.775 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.775 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.775 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.775 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2023-07-14T13:34:42.776 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2023-07-14T13:34:42.776 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.776 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.776 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.776 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2023-07-14T13:34:42.776 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.776 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.776 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.777 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.777 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.777 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.777 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2023-07-14T13:34:42.777 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2023-07-14T13:34:42.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.778 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.778 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.778 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.778 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.778 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.779 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.779 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.779 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2023-07-14T13:34:42.779 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2023-07-14T13:34:42.779 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.779 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.780 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.780 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.780 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.780 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.780 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.780 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.781 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.781 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.781 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2023-07-14T13:34:42.781 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2023-07-14T13:34:42.781 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:42.781 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.781 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.782 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.782 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.782 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.782 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.782 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.782 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.782 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.783 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.785 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2023-07-14T13:34:42.785 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2023-07-14T13:34:42.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.786 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.786 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.787 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.787 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.787 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.787 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.788 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.788 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.788 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2023-07-14T13:34:42.788 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2023-07-14T13:34:42.789 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.789 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.789 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.789 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.790 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.790 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.790 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.790 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.790 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.791 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.791 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2023-07-14T13:34:42.791 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2023-07-14T13:34:42.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.792 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.792 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.793 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.793 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.793 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.793 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.794 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.795 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2023-07-14T13:34:42.795 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2023-07-14T13:34:42.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.795 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.796 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.796 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.796 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:42.797 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2023-07-14T13:34:42.797 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.797 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.798 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.798 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.799 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2023-07-14T13:34:42.799 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2023-07-14T13:34:42.799 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.800 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.800 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.800 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.800 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.800 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.801 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.801 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.801 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.801 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2023-07-14T13:34:42.801 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2023-07-14T13:34:42.802 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.802 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.802 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.802 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.802 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.802 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.803 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.803 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2023-07-14T13:34:42.803 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2023-07-14T13:34:42.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.804 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.804 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.804 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.804 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.804 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.804 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.804 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.805 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.805 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2023-07-14T13:34:42.805 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.806 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.806 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.806 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2023-07-14T13:34:42.806 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2023-07-14T13:34:42.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.806 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.806 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.807 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.807 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.807 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2023-07-14T13:34:42.807 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.807 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.807 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.808 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2023-07-14T13:34:42.808 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2023-07-14T13:34:42.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.808 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.808 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.808 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.808 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.809 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.809 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.809 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2023-07-14T13:34:42.809 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.809 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.809 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.810 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.810 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.810 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.810 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.810 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.811 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.811 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.811 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.811 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.811 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.811 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.811 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.811 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.812 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.812 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.812 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.812 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.812 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.812 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.813 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.813 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.813 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.813 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.813 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.814 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.814 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.814 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.814 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.814 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.814 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.815 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.815 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.815 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.815 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.816 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.816 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.816 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.816 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.816 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.816 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.816 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.817 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.817 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.817 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.817 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.817 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.817 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.818 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.818 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.818 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.818 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.818 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.818 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.818 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.820 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2023-07-14T13:34:42.820 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.820 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.821 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.821 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.821 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.821 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.821 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.821 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.821 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.822 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.822 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.822 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.822 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.822 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.822 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.822 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.822 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.823 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.823 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.823 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.823 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.823 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.824 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.824 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.824 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.824 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.824 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.824 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.824 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.825 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.825 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.825 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.825 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.825 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.825 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.826 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.826 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.826 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.826 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.826 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.826 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.826 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.826 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.827 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.827 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.827 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.827 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.827 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.827 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.827 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.827 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.828 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.828 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.828 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.828 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.828 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.829 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.829 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.829 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.829 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.829 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.830 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.830 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.830 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.831 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2023-07-14T13:34:42.831 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.831 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.831 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.831 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.831 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.831 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.832 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.832 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.832 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.832 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.832 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.832 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.832 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.833 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.833 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.833 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.833 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.833 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.833 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.833 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.834 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.834 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.834 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.834 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.834 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.834 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.834 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.835 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.835 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.835 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.835 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.835 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.835 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.835 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.835 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.836 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.836 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.836 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.836 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.837 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.837 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.837 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.837 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.837 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.837 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.837 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.837 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.838 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.838 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.838 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.838 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.838 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.838 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.839 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.839 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.839 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.839 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.839 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.839 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.839 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.840 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.840 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.840 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.840 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.840 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.840 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.841 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2023-07-14T13:34:42.841 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.841 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.841 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.842 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2023-07-14T13:34:42.842 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2023-07-14T13:34:42.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.842 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.842 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-14T13:34:42.842 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.843 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.843 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.843 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.843 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.843 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.843 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.843 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:42.844 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:42.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.844 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.844 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2023-07-14T13:34:42.844 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.844 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.845 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.845 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.845 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.845 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.845 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.845 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.846 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.846 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.846 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.846 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.846 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.846 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.847 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.848 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.849 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.849 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.849 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.849 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.849 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.849 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.850 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.850 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.850 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.850 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.850 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.850 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.850 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.851 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.851 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.851 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.851 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.851 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.851 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.851 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.852 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.852 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.852 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.852 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.852 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.852 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.852 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.853 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.853 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.853 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.853 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.853 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.853 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.853 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.853 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.854 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.854 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.854 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.854 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.855 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2023-07-14T13:34:42.855 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.855 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.855 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.855 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2023-07-14T13:34:42.856 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2023-07-14T13:34:42.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.856 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.856 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.856 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.856 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.857 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.857 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2023-07-14T13:34:42.857 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.857 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.857 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.857 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2023-07-14T13:34:42.858 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2023-07-14T13:34:42.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.858 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.858 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.858 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.858 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.858 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.858 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.859 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-07-14T13:34:42.859 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.859 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.859 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.859 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2023-07-14T13:34:42.859 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2023-07-14T13:34:42.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.860 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.860 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.860 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.860 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.860 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.860 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.861 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-07-14T13:34:42.861 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.861 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.861 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2023-07-14T13:34:42.861 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2023-07-14T13:34:42.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.862 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.862 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.862 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.862 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.862 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.862 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-07-14T13:34:42.863 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.863 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.863 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.863 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2023-07-14T13:34:42.863 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2023-07-14T13:34:42.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.863 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.864 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.864 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.864 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.864 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.864 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.864 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2023-07-14T13:34:42.864 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.865 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.865 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2023-07-14T13:34:42.865 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2023-07-14T13:34:42.865 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.865 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.866 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.866 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.866 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.866 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.866 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.866 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.866 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.866 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.867 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2023-07-14T13:34:42.867 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2023-07-14T13:34:42.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.867 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.867 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.868 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.868 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.868 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.868 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.868 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.868 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.869 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2023-07-14T13:34:42.869 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2023-07-14T13:34:42.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.869 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.869 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-07-14T13:34:42.869 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.870 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.870 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.870 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.870 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.870 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.870 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-07-14T13:34:42.871 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-07-14T13:34:42.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.871 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.871 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.871 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.871 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.871 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.871 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.872 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.872 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.872 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.872 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.872 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:42.872 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:42.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.873 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.873 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2023-07-14T13:34:42.873 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2023-07-14T13:34:42.873 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.873 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.873 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.874 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.874 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.874 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2023-07-14T13:34:42.874 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2023-07-14T13:34:42.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.874 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.875 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2023-07-14T13:34:42.875 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.875 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.875 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.875 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.875 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2023-07-14T13:34:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2023-07-14T13:34:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2023-07-14T13:34:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2023-07-14T13:34:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2023-07-14T13:34:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2023-07-14T13:34:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2023-07-14T13:34:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2023-07-14T13:34:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.892 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.892 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.892 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.892 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.892 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.892 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.892 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.893 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.893 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.893 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.893 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2023-07-14T13:34:42.893 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2023-07-14T13:34:42.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.893 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.894 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-07-14T13:34:42.894 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.894 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.894 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.894 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.894 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.895 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.895 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2023-07-14T13:34:42.895 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.895 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.896 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.896 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.896 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.896 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.896 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.896 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.896 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2023-07-14T13:34:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.908 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.908 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.908 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.908 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.908 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.908 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.909 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.909 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.909 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.909 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.909 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.909 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.909 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.910 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.910 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.910 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.910 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.910 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.910 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.911 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.911 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.911 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.911 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.911 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.912 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.912 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.912 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.912 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.912 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.912 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.912 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.912 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.913 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.913 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.913 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.913 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.914 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.914 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.914 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.915 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.915 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.915 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.915 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.915 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.915 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.915 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.916 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2023-07-14T13:34:42.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2023-07-14T13:34:42.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.916 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.916 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2023-07-14T13:34:42.917 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.917 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.917 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.917 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2023-07-14T13:34:42.917 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.917 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.918 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2023-07-14T13:34:42.918 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2023-07-14T13:34:42.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.918 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.918 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:42.918 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.918 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.919 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.919 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-07-14T13:34:42.919 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.919 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.920 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2023-07-14T13:34:42.920 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.920 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.920 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.920 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2023-07-14T13:34:42.920 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2023-07-14T13:34:42.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:42.921 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.921 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2023-07-14T13:34:42.921 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.921 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.921 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.921 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.922 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.922 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.922 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.922 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2023-07-14T13:34:42.922 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2023-07-14T13:34:42.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.923 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.923 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.923 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.923 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.923 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.923 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.923 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.924 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.924 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:42.924 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:42.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.924 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.925 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:42.925 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.925 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.925 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.925 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.925 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.926 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.926 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.926 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.926 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.926 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.927 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.929 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.929 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.929 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.929 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.929 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.930 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.930 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.930 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.930 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.930 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.930 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.931 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.931 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.931 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.931 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.931 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.932 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.932 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.932 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.932 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.932 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.932 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.932 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.933 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.933 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.933 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.933 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.933 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.933 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.934 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.934 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.934 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.934 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.934 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.934 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.934 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.934 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.935 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.935 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.935 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.935 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.935 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2023-07-14T13:34:42.935 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2023-07-14T13:34:42.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.936 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.936 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.936 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.936 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.936 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.936 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.937 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.937 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.937 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2023-07-14T13:34:42.937 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2023-07-14T13:34:42.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.938 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.938 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.938 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2023-07-14T13:34:42.938 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.938 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.938 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.938 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.939 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.939 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.939 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2023-07-14T13:34:42.939 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2023-07-14T13:34:42.939 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.939 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:42.940 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-07-14T13:34:42.940 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.940 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.940 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.940 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.940 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.941 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.941 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T13:34:42.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.941 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.942 INFO:teuthology.orchestra.run.smithi017.stdout: "modules": [ 2023-07-14T13:34:42.942 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2023-07-14T13:34:42.942 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard", 2023-07-14T13:34:42.942 INFO:teuthology.orchestra.run.smithi017.stdout: "iostat", 2023-07-14T13:34:42.942 INFO:teuthology.orchestra.run.smithi017.stdout: "nfs", 2023-07-14T13:34:42.942 INFO:teuthology.orchestra.run.smithi017.stdout: "restful", 2023-07-14T13:34:42.942 INFO:teuthology.orchestra.run.smithi017.stdout: "snap_schedule" 2023-07-14T13:34:42.942 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.943 INFO:teuthology.orchestra.run.smithi017.stdout: "available_modules": [ 2023-07-14T13:34:42.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alerts", 2023-07-14T13:34:42.943 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.943 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.943 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.943 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:42.943 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:42.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:42.944 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.944 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:42.944 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.944 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.944 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.945 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How frequently to reexamine health status", 2023-07-14T13:34:42.945 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.945 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.945 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.945 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.945 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.946 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.946 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.946 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.946 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.946 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.946 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.946 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.947 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.947 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.947 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.947 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.947 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.947 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.947 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.948 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.948 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.948 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.948 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.948 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.949 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.949 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.949 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.949 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.949 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.949 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.949 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.950 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.950 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.950 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.950 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.950 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.950 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.951 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.951 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.951 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.951 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.951 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.951 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.951 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.951 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.952 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.952 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.952 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.952 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.952 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.952 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.953 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.953 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.953 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.953 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.953 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.953 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.953 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.954 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.954 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.954 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.954 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.954 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.954 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_destination": { 2023-07-14T13:34:42.955 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_destination", 2023-07-14T13:34:42.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.955 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.955 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.955 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.955 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.955 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.956 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email address to send alerts to", 2023-07-14T13:34:42.956 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.956 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.956 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_from_name": { 2023-07-14T13:34:42.956 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_from_name", 2023-07-14T13:34:42.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.957 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.957 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "Ceph", 2023-07-14T13:34:42.957 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.957 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.957 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.957 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Email From: name", 2023-07-14T13:34:42.958 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.958 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.958 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_host": { 2023-07-14T13:34:42.958 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_host", 2023-07-14T13:34:42.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.958 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.959 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.959 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.959 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.959 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.959 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP server", 2023-07-14T13:34:42.959 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.960 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.960 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.960 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_password": { 2023-07-14T13:34:42.960 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_password", 2023-07-14T13:34:42.960 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.960 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.960 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Password to authenticate with", 2023-07-14T13:34:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_port": { 2023-07-14T13:34:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_port", 2023-07-14T13:34:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "465", 2023-07-14T13:34:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP port", 2023-07-14T13:34:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_sender": { 2023-07-14T13:34:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_sender", 2023-07-14T13:34:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SMTP envelope sender", 2023-07-14T13:34:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_ssl": { 2023-07-14T13:34:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_ssl", 2023-07-14T13:34:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use SSL to connect to SMTP server", 2023-07-14T13:34:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "smtp_user": { 2023-07-14T13:34:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "smtp_user", 2023-07-14T13:34:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "User to authenticate as", 2023-07-14T13:34:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "balancer", 2023-07-14T13:34:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "active": { 2023-07-14T13:34:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "active", 2023-07-14T13:34:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically balance PGs across cluster", 2023-07-14T13:34:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_time": { 2023-07-14T13:34:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_time", 2023-07-14T13:34:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0000", 2023-07-14T13:34:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "beginning time of day to automatically balance", 2023-07-14T13:34:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T13:34:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "begin_weekday": { 2023-07-14T13:34:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "begin_weekday", 2023-07-14T13:34:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-07-14T13:34:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-07-14T13:34:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-14T13:34:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T13:34:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_max_iterations": { 2023-07-14T13:34:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_max_iterations", 2023-07-14T13:34:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "25", 2023-07-14T13:34:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "250", 2023-07-14T13:34:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-07-14T13:34:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_metrics": { 2023-07-14T13:34:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_metrics", 2023-07-14T13:34:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "pgs,objects,bytes", 2023-07-14T13:34:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-07-14T13:34:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-14T13:34:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_compat_step": { 2023-07-14T13:34:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crush_compat_step", 2023-07-14T13:34:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.5", 2023-07-14T13:34:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0.001", 2023-07-14T13:34:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "0.999", 2023-07-14T13:34:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "aggressiveness of optimization", 2023-07-14T13:34:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-14T13:34:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "end_time": { 2023-07-14T13:34:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_time", 2023-07-14T13:34:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2359", 2023-07-14T13:34:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ending time of day to automatically balance", 2023-07-14T13:34:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T13:34:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "end_weekday": { 2023-07-14T13:34:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "end_weekday", 2023-07-14T13:34:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "0", 2023-07-14T13:34:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "6", 2023-07-14T13:34:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-14T13:34:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T13:34:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "min_score": { 2023-07-14T13:34:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_score", 2023-07-14T13:34:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-07-14T13:34:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-07-14T13:34:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-07-14T13:34:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "upmap", 2023-07-14T13:34:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "crush-compat", 2023-07-14T13:34:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "none", 2023-07-14T13:34:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap" 2023-07-14T13:34:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Balancer mode", 2023-07-14T13:34:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_ids": { 2023-07-14T13:34:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_ids", 2023-07-14T13:34:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-07-14T13:34:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-07-14T13:34:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_deviation": { 2023-07-14T13:34:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_deviation", 2023-07-14T13:34:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "deviation below which no optimization is attempted", 2023-07-14T13:34:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-14T13:34:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "upmap_max_optimizations": { 2023-07-14T13:34:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "upmap_max_optimizations", 2023-07-14T13:34:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-07-14T13:34:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cephadm", 2023-07-14T13:34:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_down_multiplier": { 2023-07-14T13:34:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_down_multiplier", 2023-07-14T13:34:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-07-14T13:34:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-07-14T13:34:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_refresh_rate": { 2023-07-14T13:34:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_refresh_rate", 2023-07-14T13:34:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "20", 2023-07-14T13:34:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-07-14T13:34:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "agent_starting_port": { 2023-07-14T13:34:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "agent_starting_port", 2023-07-14T13:34:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4721", 2023-07-14T13:34:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-07-14T13:34:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "alertmanager_web_password": { 2023-07-14T13:34:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alertmanager_web_password", 2023-07-14T13:34:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Alertmanager web password", 2023-07-14T13:34:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "alertmanager_web_user": { 2023-07-14T13:34:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "alertmanager_web_user", 2023-07-14T13:34:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Alertmanager web user", 2023-07-14T13:34:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_ptrace": { 2023-07-14T13:34:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_ptrace", 2023-07-14T13:34:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-14T13:34:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-14T13:34:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_interval": { 2023-07-14T13:34:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_interval", 2023-07-14T13:34:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to autotune daemon memory", 2023-07-14T13:34:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "autotune_memory_target_ratio": { 2023-07-14T13:34:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "autotune_memory_target_ratio", 2023-07-14T13:34:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0.7", 2023-07-14T13:34:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-07-14T13:34:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "cgroups_split": { 2023-07-14T13:34:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cgroups_split", 2023-07-14T13:34:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-07-14T13:34:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "config_checks_enabled": { 2023-07-14T13:34:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_checks_enabled", 2023-07-14T13:34:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-07-14T13:34:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "config_dashboard": { 2023-07-14T13:34:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_dashboard", 2023-07-14T13:34:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-07-14T13:34:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_alertmanager": { 2023-07-14T13:34:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_alertmanager", 2023-07-14T13:34:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-07-14T13:34:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_base": { 2023-07-14T13:34:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_base", 2023-07-14T13:34:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph", 2023-07-14T13:34:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Container image name, without the tag", 2023-07-14T13:34:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_elasticsearch": { 2023-07-14T13:34:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_elasticsearch", 2023-07-14T13:34:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-07-14T13:34:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "elasticsearch container image", 2023-07-14T13:34:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_grafana": { 2023-07-14T13:34:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_grafana", 2023-07-14T13:34:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-07-14T13:34:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_haproxy": { 2023-07-14T13:34:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_haproxy", 2023-07-14T13:34:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-07-14T13:34:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "HAproxy container image", 2023-07-14T13:34:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_agent": { 2023-07-14T13:34:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_agent", 2023-07-14T13:34:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-07-14T13:34:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger agent container image", 2023-07-14T13:34:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_collector": { 2023-07-14T13:34:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_collector", 2023-07-14T13:34:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-07-14T13:34:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger collector container image", 2023-07-14T13:34:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_jaeger_query": { 2023-07-14T13:34:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_jaeger_query", 2023-07-14T13:34:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-07-14T13:34:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Jaeger query container image", 2023-07-14T13:34:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_keepalived": { 2023-07-14T13:34:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_keepalived", 2023-07-14T13:34:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.051 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-07-14T13:34:43.051 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.051 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.051 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.051 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Keepalived container image", 2023-07-14T13:34:43.051 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.051 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.051 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_loki": { 2023-07-14T13:34:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_loki", 2023-07-14T13:34:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-07-14T13:34:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Loki container image", 2023-07-14T13:34:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_node_exporter": { 2023-07-14T13:34:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_node_exporter", 2023-07-14T13:34:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-07-14T13:34:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_prometheus": { 2023-07-14T13:34:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_prometheus", 2023-07-14T13:34:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-07-14T13:34:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus container image", 2023-07-14T13:34:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_promtail": { 2023-07-14T13:34:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_promtail", 2023-07-14T13:34:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-07-14T13:34:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Promtail container image", 2023-07-14T13:34:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image_snmp_gateway": { 2023-07-14T13:34:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_image_snmp_gateway", 2023-07-14T13:34:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-07-14T13:34:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "SNMP Gateway container image", 2023-07-14T13:34:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "container_init": { 2023-07-14T13:34:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "container_init", 2023-07-14T13:34:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Run podman/docker with `--init`", 2023-07-14T13:34:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "daemon_cache_timeout": { 2023-07-14T13:34:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "daemon_cache_timeout", 2023-07-14T13:34:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-07-14T13:34:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "default_cephadm_command_timeout": { 2023-07-14T13:34:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_cephadm_command_timeout", 2023-07-14T13:34:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "900", 2023-07-14T13:34:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-07-14T13:34:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_registry": { 2023-07-14T13:34:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "default_registry", 2023-07-14T13:34:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "docker.io", 2023-07-14T13:34:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-07-14T13:34:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "device_cache_timeout": { 2023-07-14T13:34:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_cache_timeout", 2023-07-14T13:34:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1800", 2023-07-14T13:34:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache device inventory", 2023-07-14T13:34:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "device_enhanced_scan": { 2023-07-14T13:34:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_enhanced_scan", 2023-07-14T13:34:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use libstoragemgmt during device scans", 2023-07-14T13:34:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "facts_cache_timeout": { 2023-07-14T13:34:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "facts_cache_timeout", 2023-07-14T13:34:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "seconds to cache host facts data", 2023-07-14T13:34:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "host_check_interval": { 2023-07-14T13:34:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "host_check_interval", 2023-07-14T13:34:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to perform a host check", 2023-07-14T13:34:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "log_refresh_metadata": { 2023-07-14T13:34:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_refresh_metadata", 2023-07-14T13:34:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-07-14T13:34:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-14T13:34:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf": { 2023-07-14T13:34:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-07-14T13:34:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.089 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.089 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-07-14T13:34:43.089 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.089 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.089 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.089 INFO:teuthology.orchestra.run.smithi017.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-07-14T13:34:43.089 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-07-14T13:34:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "*", 2023-07-14T13:34:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.090 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-07-14T13:34:43.091 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.091 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.091 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.091 INFO:teuthology.orchestra.run.smithi017.stdout: "max_count_per_host": { 2023-07-14T13:34:43.091 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_count_per_host", 2023-07-14T13:34:43.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.091 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.092 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.092 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:43.092 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.092 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.092 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.092 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of daemons per service per host", 2023-07-14T13:34:43.092 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.093 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.093 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.093 INFO:teuthology.orchestra.run.smithi017.stdout: "max_osd_draining_count": { 2023-07-14T13:34:43.093 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_osd_draining_count", 2023-07-14T13:34:43.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.093 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.093 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.094 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:43.094 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.094 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.094 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.094 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-07-14T13:34:43.094 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.094 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.095 INFO:teuthology.orchestra.run.smithi017.stdout: "migration_current": { 2023-07-14T13:34:43.095 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "migration_current", 2023-07-14T13:34:43.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.095 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.095 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.095 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.096 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.096 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.096 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "internal - do not modify", 2023-07-14T13:34:43.096 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.096 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.096 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.097 INFO:teuthology.orchestra.run.smithi017.stdout: "mode": { 2023-07-14T13:34:43.097 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mode", 2023-07-14T13:34:43.097 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.097 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.097 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.097 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "root", 2023-07-14T13:34:43.097 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.097 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.098 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.098 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm-package", 2023-07-14T13:34:43.098 INFO:teuthology.orchestra.run.smithi017.stdout: "root" 2023-07-14T13:34:43.098 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.098 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "mode for remote execution of cephadm", 2023-07-14T13:34:43.098 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.098 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.098 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.099 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_alerts_path": { 2023-07-14T13:34:43.099 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_alerts_path", 2023-07-14T13:34:43.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.099 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.099 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-07-14T13:34:43.100 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.100 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.100 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.100 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-07-14T13:34:43.100 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.100 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.101 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_web_password": { 2023-07-14T13:34:43.101 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_web_password", 2023-07-14T13:34:43.101 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.101 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.101 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.101 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:43.101 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.102 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.102 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.102 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus web password", 2023-07-14T13:34:43.102 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.102 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.102 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.102 INFO:teuthology.orchestra.run.smithi017.stdout: "prometheus_web_user": { 2023-07-14T13:34:43.103 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus_web_user", 2023-07-14T13:34:43.103 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.103 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.103 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.103 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:43.103 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.103 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.104 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.104 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Prometheus web user", 2023-07-14T13:34:43.104 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.104 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.104 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.104 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_insecure": { 2023-07-14T13:34:43.105 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_insecure", 2023-07-14T13:34:43.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.105 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.105 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.105 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.105 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.105 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.106 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-07-14T13:34:43.106 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.106 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.106 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.106 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_password": { 2023-07-14T13:34:43.106 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_password", 2023-07-14T13:34:43.107 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.107 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.107 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.107 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.107 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.107 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.107 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.107 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-07-14T13:34:43.108 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.108 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.108 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_url": { 2023-07-14T13:34:43.108 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_url", 2023-07-14T13:34:43.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.109 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.109 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.109 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.109 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.109 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.109 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.109 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-07-14T13:34:43.110 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.110 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.110 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.110 INFO:teuthology.orchestra.run.smithi017.stdout: "registry_username": { 2023-07-14T13:34:43.110 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "registry_username", 2023-07-14T13:34:43.110 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.110 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.111 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.111 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.111 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.111 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.111 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.111 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-07-14T13:34:43.111 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.111 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: "secure_monitoring_stack": { 2023-07-14T13:34:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "secure_monitoring_stack", 2023-07-14T13:34:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.112 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.113 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.113 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.113 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.113 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-07-14T13:34:43.113 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.113 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.113 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.114 INFO:teuthology.orchestra.run.smithi017.stdout: "service_discovery_port": { 2023-07-14T13:34:43.114 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "service_discovery_port", 2023-07-14T13:34:43.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.114 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.114 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8765", 2023-07-14T13:34:43.114 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.115 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.115 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.115 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "cephadm service discovery port", 2023-07-14T13:34:43.115 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.115 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.115 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.115 INFO:teuthology.orchestra.run.smithi017.stdout: "ssh_config_file": { 2023-07-14T13:34:43.116 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssh_config_file", 2023-07-14T13:34:43.116 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.116 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.116 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.116 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.116 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.116 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.116 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.117 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-07-14T13:34:43.117 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.117 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.117 INFO:teuthology.orchestra.run.smithi017.stdout: "use_agent": { 2023-07-14T13:34:43.117 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_agent", 2023-07-14T13:34:43.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.118 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.118 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.118 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.118 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.118 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.118 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-07-14T13:34:43.119 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.119 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.119 INFO:teuthology.orchestra.run.smithi017.stdout: "use_repo_digest": { 2023-07-14T13:34:43.119 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "use_repo_digest", 2023-07-14T13:34:43.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.119 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.120 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.120 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.120 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.120 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.120 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-07-14T13:34:43.120 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.121 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.121 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_failed_host_check": { 2023-07-14T13:34:43.121 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_failed_host_check", 2023-07-14T13:34:43.121 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.121 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.121 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.122 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.122 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.122 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.122 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.122 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if the host check fails", 2023-07-14T13:34:43.122 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.122 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.122 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.123 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_daemons": { 2023-07-14T13:34:43.123 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_daemons", 2023-07-14T13:34:43.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.123 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.123 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.123 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.124 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.124 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.124 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-14T13:34:43.124 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.124 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.124 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.125 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_on_stray_hosts": { 2023-07-14T13:34:43.125 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_on_stray_hosts", 2023-07-14T13:34:43.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.125 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.125 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.125 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.125 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.126 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.126 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-14T13:34:43.126 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.126 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.126 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.127 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crash", 2023-07-14T13:34:43.127 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.127 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.127 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.127 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.128 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.128 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.128 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.128 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.128 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.128 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.128 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.128 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.129 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.129 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.129 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.129 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.129 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.129 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.129 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.130 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.130 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.130 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.130 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.130 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.131 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.131 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.131 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.131 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.131 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.131 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.131 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.131 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.132 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.132 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.132 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.132 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.132 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.132 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.133 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.133 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.133 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.133 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.133 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.133 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.133 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.133 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.134 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.134 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.134 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.134 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.134 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.134 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.134 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.134 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.135 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.135 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.135 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.135 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.135 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.135 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.135 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.136 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.136 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.136 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.136 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.136 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.136 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.137 INFO:teuthology.orchestra.run.smithi017.stdout: "retain_interval": { 2023-07-14T13:34:43.137 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retain_interval", 2023-07-14T13:34:43.137 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.137 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.137 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.137 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "31536000", 2023-07-14T13:34:43.137 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.137 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.138 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.138 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain crashes before pruning them", 2023-07-14T13:34:43.138 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.138 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.138 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.138 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_recent_interval": { 2023-07-14T13:34:43.139 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_recent_interval", 2023-07-14T13:34:43.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.139 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.139 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1209600", 2023-07-14T13:34:43.139 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.139 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.140 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.140 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "time interval in which to warn about recent crashes", 2023-07-14T13:34:43.140 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.140 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.140 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.140 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.140 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.141 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dashboard", 2023-07-14T13:34:43.141 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.141 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.141 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.141 INFO:teuthology.orchestra.run.smithi017.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-07-14T13:34:43.141 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-07-14T13:34:43.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.142 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.142 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:43.142 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.142 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.142 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.143 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.143 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.143 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.143 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.143 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_HOST": { 2023-07-14T13:34:43.143 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_HOST", 2023-07-14T13:34:43.144 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.144 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.144 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.144 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.144 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.144 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.144 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.145 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.145 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.145 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.145 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.145 INFO:teuthology.orchestra.run.smithi017.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-07-14T13:34:43.145 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-07-14T13:34:43.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.146 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.146 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.146 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.146 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.146 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.146 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.146 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.147 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.147 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.147 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.147 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_ENABLED": { 2023-07-14T13:34:43.147 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_ENABLED", 2023-07-14T13:34:43.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.148 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.148 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.148 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.148 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.148 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.148 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.148 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.148 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.149 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.149 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.149 INFO:teuthology.orchestra.run.smithi017.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-07-14T13:34:43.149 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-14T13:34:43.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.149 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.150 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.150 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.150 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.150 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.150 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.150 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.150 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.150 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.151 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.151 INFO:teuthology.orchestra.run.smithi017.stdout: "ENABLE_BROWSABLE_API": { 2023-07-14T13:34:43.151 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ENABLE_BROWSABLE_API", 2023-07-14T13:34:43.151 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.151 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.151 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.152 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.152 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.152 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.152 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.152 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.152 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.152 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.153 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-07-14T13:34:43.153 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-07-14T13:34:43.153 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.153 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.153 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.153 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.154 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.154 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.154 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.154 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.154 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.154 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.154 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.155 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-07-14T13:34:43.155 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-07-14T13:34:43.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.155 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.155 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.155 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.155 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.156 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.156 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.156 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.156 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.156 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.156 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.156 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-07-14T13:34:43.157 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-07-14T13:34:43.157 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.157 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.157 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.157 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.157 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.157 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.158 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.158 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.158 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.158 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.158 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.158 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-07-14T13:34:43.158 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-07-14T13:34:43.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.159 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.159 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.159 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.159 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.159 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.159 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.160 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.160 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.160 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_NFS": { 2023-07-14T13:34:43.160 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-07-14T13:34:43.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.160 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.161 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.161 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.161 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.161 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.161 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.161 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.161 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.162 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.162 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.162 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RBD": { 2023-07-14T13:34:43.162 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-07-14T13:34:43.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.162 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.163 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: "FEATURE_TOGGLE_RGW": { 2023-07-14T13:34:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-07-14T13:34:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.164 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.165 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.165 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.165 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.165 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.165 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.165 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.166 INFO:teuthology.orchestra.run.smithi017.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-14T13:34:43.166 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-14T13:34:43.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.166 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.166 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.166 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.166 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.167 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.167 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.167 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.167 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.167 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.168 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_PASSWORD": { 2023-07-14T13:34:43.168 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_PASSWORD", 2023-07-14T13:34:43.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.168 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.168 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.168 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:43.169 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.169 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.169 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.169 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.169 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.169 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.169 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.170 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-07-14T13:34:43.170 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-07-14T13:34:43.170 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.170 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.170 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.170 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.170 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.170 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.171 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.171 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.171 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.171 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.171 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.171 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_URL": { 2023-07-14T13:34:43.172 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_URL", 2023-07-14T13:34:43.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.172 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.172 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.172 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.172 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.172 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.173 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.173 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.173 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.173 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.173 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.174 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_API_USERNAME": { 2023-07-14T13:34:43.174 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_API_USERNAME", 2023-07-14T13:34:43.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.174 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.174 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.174 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:43.174 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.175 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.175 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.175 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.175 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.175 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.175 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.176 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-07-14T13:34:43.176 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-07-14T13:34:43.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.176 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.176 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.176 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.176 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.177 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.177 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.177 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.177 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.177 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.177 INFO:teuthology.orchestra.run.smithi017.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-14T13:34:43.178 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-14T13:34:43.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.178 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.178 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.178 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.178 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.179 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.179 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.179 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.179 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.179 INFO:teuthology.orchestra.run.smithi017.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-07-14T13:34:43.179 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-14T13:34:43.180 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.180 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.180 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.180 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.180 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.180 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.180 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.181 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.181 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.181 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.181 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.181 INFO:teuthology.orchestra.run.smithi017.stdout: "ISSUE_TRACKER_API_KEY": { 2023-07-14T13:34:43.181 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-07-14T13:34:43.181 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.182 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.182 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.182 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.182 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.182 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.182 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.182 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.183 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.183 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_HOST": { 2023-07-14T13:34:43.183 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_HOST", 2023-07-14T13:34:43.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.183 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.183 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.184 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.184 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.184 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.184 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.184 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.184 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.185 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.185 INFO:teuthology.orchestra.run.smithi017.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-07-14T13:34:43.185 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-07-14T13:34:43.185 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.185 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.185 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.185 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.186 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.186 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.186 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.186 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.186 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.186 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.186 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.187 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-14T13:34:43.187 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-14T13:34:43.187 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.187 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.187 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.187 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.187 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.188 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.188 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.188 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.188 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.188 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.188 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-14T13:34:43.189 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-14T13:34:43.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.189 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.189 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.189 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.189 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.189 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.189 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.190 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.190 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.190 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.190 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.190 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-14T13:34:43.190 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-14T13:34:43.191 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.191 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.191 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.191 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.191 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.191 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.191 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-14T13:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-14T13:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-14T13:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-14T13:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.196 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-14T13:34:43.196 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-14T13:34:43.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.196 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.197 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.197 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.197 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.197 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.197 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.197 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.198 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.198 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-14T13:34:43.198 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-14T13:34:43.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.198 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.198 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.199 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.199 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.199 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.199 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.199 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.199 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.200 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_ENABLED": { 2023-07-14T13:34:43.200 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_ENABLED", 2023-07-14T13:34:43.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.200 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.200 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.200 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.201 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.201 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.201 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.201 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.201 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.201 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.201 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-07-14T13:34:43.202 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-14T13:34:43.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.202 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.202 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-14T13:34:43.202 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.202 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.202 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.203 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.203 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.203 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.203 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-14T13:34:43.203 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-14T13:34:43.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.204 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.204 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:43.204 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.204 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.204 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.204 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.205 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.205 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.205 INFO:teuthology.orchestra.run.smithi017.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-07-14T13:34:43.205 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-07-14T13:34:43.205 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.205 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.206 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8", 2023-07-14T13:34:43.206 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.206 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.206 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.206 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.206 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.207 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.207 INFO:teuthology.orchestra.run.smithi017.stdout: "REST_REQUESTS_TIMEOUT": { 2023-07-14T13:34:43.207 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-07-14T13:34:43.207 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.207 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.207 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.207 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "45", 2023-07-14T13:34:43.208 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.208 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.208 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.208 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.208 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.208 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.208 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.209 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ACCESS_KEY": { 2023-07-14T13:34:43.209 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ACCESS_KEY", 2023-07-14T13:34:43.209 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.209 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.209 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.210 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.210 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.210 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.210 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.210 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.210 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.210 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.211 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-07-14T13:34:43.211 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-07-14T13:34:43.211 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.211 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.211 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "admin", 2023-07-14T13:34:43.211 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.211 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.212 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.212 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.212 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.212 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.212 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.212 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SECRET_KEY": { 2023-07-14T13:34:43.213 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SECRET_KEY", 2023-07-14T13:34:43.213 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.213 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.213 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.213 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.213 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.213 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.213 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.214 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.214 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.214 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.214 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.214 INFO:teuthology.orchestra.run.smithi017.stdout: "RGW_API_SSL_VERIFY": { 2023-07-14T13:34:43.214 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "RGW_API_SSL_VERIFY", 2023-07-14T13:34:43.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.215 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.215 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.215 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.215 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.215 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.215 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.216 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.216 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.216 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.216 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-07-14T13:34:43.216 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-14T13:34:43.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.216 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.217 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:43.217 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.217 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.217 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.217 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.217 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.218 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.218 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-14T13:34:43.218 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-14T13:34:43.218 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.218 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.218 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.219 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:43.219 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.219 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.219 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.219 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.219 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.219 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.219 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.220 INFO:teuthology.orchestra.run.smithi017.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-14T13:34:43.220 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-14T13:34:43.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.220 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.220 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:43.221 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.221 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.221 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.221 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.221 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.221 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.222 INFO:teuthology.orchestra.run.smithi017.stdout: "cross_origin_url": { 2023-07-14T13:34:43.222 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cross_origin_url", 2023-07-14T13:34:43.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.222 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.222 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.222 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.222 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.223 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.223 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.223 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.223 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.223 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.224 INFO:teuthology.orchestra.run.smithi017.stdout: "crt_file": { 2023-07-14T13:34:43.224 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "crt_file", 2023-07-14T13:34:43.224 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.224 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.224 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.224 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.224 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.224 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.225 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.225 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.225 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.225 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.225 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.225 INFO:teuthology.orchestra.run.smithi017.stdout: "debug": { 2023-07-14T13:34:43.226 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "debug", 2023-07-14T13:34:43.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.226 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.226 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.226 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.226 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.226 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.227 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.227 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Enable/disable debug options", 2023-07-14T13:34:43.227 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.227 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.227 INFO:teuthology.orchestra.run.smithi017.stdout: "jwt_token_ttl": { 2023-07-14T13:34:43.228 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "jwt_token_ttl", 2023-07-14T13:34:43.228 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.228 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.228 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.228 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "28800", 2023-07-14T13:34:43.228 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.228 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.229 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.229 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.229 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.229 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.229 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.229 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-07-14T13:34:43.230 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-07-14T13:34:43.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.230 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.230 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.230 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.230 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.230 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.231 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.231 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.231 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.231 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.231 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.231 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.232 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.232 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.232 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.232 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.232 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.232 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.233 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.233 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.233 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.233 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.233 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.233 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.233 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.233 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.234 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.234 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.234 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.234 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.234 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.234 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.235 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.235 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.235 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.235 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.235 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.235 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.235 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.235 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.236 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.236 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.236 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.236 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.236 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.237 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.237 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.237 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.237 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.237 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.237 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.237 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.237 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.238 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.238 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.238 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.238 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.238 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.239 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.239 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.239 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.239 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.240 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.240 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.240 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.240 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.240 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.240 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.241 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.241 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.241 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.241 INFO:teuthology.orchestra.run.smithi017.stdout: "motd": { 2023-07-14T13:34:43.241 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "motd", 2023-07-14T13:34:43.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.242 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.242 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.242 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.243 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.243 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.243 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "The message of the day", 2023-07-14T13:34:43.243 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.243 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.244 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect_resolve_ip_addr": { 2023-07-14T13:34:43.244 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "redirect_resolve_ip_addr", 2023-07-14T13:34:43.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.244 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.245 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.245 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.245 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.245 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.245 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.246 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.246 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.246 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.246 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-07-14T13:34:43.247 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-07-14T13:34:43.247 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.247 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.247 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.248 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-07-14T13:34:43.248 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.248 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.248 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.248 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.249 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.249 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.249 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-07-14T13:34:43.250 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-07-14T13:34:43.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.250 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.250 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8080", 2023-07-14T13:34:43.250 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.251 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.251 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.251 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.251 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.252 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.252 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-07-14T13:34:43.252 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-07-14T13:34:43.252 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.252 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.253 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.253 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.253 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.253 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.253 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.253 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.254 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.254 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.254 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.254 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl_server_port": { 2023-07-14T13:34:43.255 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl_server_port", 2023-07-14T13:34:43.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.255 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.255 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8443", 2023-07-14T13:34:43.256 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.256 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.256 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.256 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.256 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.257 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.257 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.257 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-07-14T13:34:43.257 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-07-14T13:34:43.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.257 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.258 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "redirect", 2023-07-14T13:34:43.258 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.258 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.258 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.258 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.258 INFO:teuthology.orchestra.run.smithi017.stdout: "redirect" 2023-07-14T13:34:43.258 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.259 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.259 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.259 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.259 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.259 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-07-14T13:34:43.259 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-07-14T13:34:43.259 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.260 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.260 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.260 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-07-14T13:34:43.260 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-07-14T13:34:43.260 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-07-14T13:34:43.260 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.260 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.261 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.261 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.261 INFO:teuthology.orchestra.run.smithi017.stdout: "url_prefix": { 2023-07-14T13:34:43.261 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url_prefix", 2023-07-14T13:34:43.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.261 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.262 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.262 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.262 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.262 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.262 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.262 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.263 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.264 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2023-07-14T13:34:43.264 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.264 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.264 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.265 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_monitoring": { 2023-07-14T13:34:43.265 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_monitoring", 2023-07-14T13:34:43.265 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.265 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.266 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.266 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.266 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.266 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.267 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.267 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "monitor device health metrics", 2023-07-14T13:34:43.267 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.268 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.268 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.268 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.269 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.269 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.269 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.269 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.270 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.270 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.270 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.270 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.270 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.270 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.271 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.271 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.271 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.271 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.271 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.272 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.272 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.272 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.272 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.273 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.273 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.273 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.273 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.274 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.274 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.274 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.275 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.275 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.275 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.276 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.276 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.276 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.276 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.277 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.277 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.277 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.277 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.277 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.278 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.278 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.278 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.278 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.278 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.279 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.280 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.280 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.280 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.281 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.281 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.281 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.281 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.281 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.282 INFO:teuthology.orchestra.run.smithi017.stdout: "mark_out_threshold": { 2023-07-14T13:34:43.282 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mark_out_threshold", 2023-07-14T13:34:43.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.283 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.283 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.283 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "2419200", 2023-07-14T13:34:43.283 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.283 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.283 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.283 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-07-14T13:34:43.284 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.284 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.284 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.284 INFO:teuthology.orchestra.run.smithi017.stdout: "pool_name": { 2023-07-14T13:34:43.284 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pool_name", 2023-07-14T13:34:43.284 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.284 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.285 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "device_health_metrics", 2023-07-14T13:34:43.285 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.285 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.285 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.285 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name of pool in which to store device health metrics", 2023-07-14T13:34:43.285 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.285 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.286 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.286 INFO:teuthology.orchestra.run.smithi017.stdout: "retention_period": { 2023-07-14T13:34:43.286 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "retention_period", 2023-07-14T13:34:43.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.286 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.287 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15552000", 2023-07-14T13:34:43.287 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.287 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.287 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.287 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long to retain device health metrics", 2023-07-14T13:34:43.287 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.287 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.288 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_frequency": { 2023-07-14T13:34:43.288 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_frequency", 2023-07-14T13:34:43.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.288 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.288 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-07-14T13:34:43.289 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.289 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.289 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.289 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to scrape device health metrics", 2023-07-14T13:34:43.289 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.289 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.289 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.290 INFO:teuthology.orchestra.run.smithi017.stdout: "self_heal": { 2023-07-14T13:34:43.290 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "self_heal", 2023-07-14T13:34:43.290 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.290 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.290 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.290 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.290 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.291 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.291 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.291 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-07-14T13:34:43.291 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.291 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.291 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.291 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:43.292 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:43.292 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.292 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.292 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:43.292 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.292 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.293 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.293 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how frequently to wake up and check device health", 2023-07-14T13:34:43.293 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.293 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.293 INFO:teuthology.orchestra.run.smithi017.stdout: "warn_threshold": { 2023-07-14T13:34:43.294 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "warn_threshold", 2023-07-14T13:34:43.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.294 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.294 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7257600", 2023-07-14T13:34:43.294 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.294 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.295 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.295 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-07-14T13:34:43.295 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.295 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.296 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "diskprediction_local", 2023-07-14T13:34:43.296 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.296 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.296 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.296 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.296 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.296 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.297 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.298 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.298 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.298 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.298 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.298 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.298 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.298 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.298 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.299 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.299 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.299 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.299 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.300 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.300 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.300 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.300 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.300 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.300 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.301 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.301 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.301 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.301 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.301 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.302 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.302 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.302 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.302 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.302 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.302 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.302 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.302 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.303 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.303 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.303 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.303 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.303 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.303 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.303 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.304 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.304 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.304 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.304 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.304 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.305 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.305 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.305 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.305 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.305 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.305 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.306 INFO:teuthology.orchestra.run.smithi017.stdout: "predict_interval": { 2023-07-14T13:34:43.306 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predict_interval", 2023-07-14T13:34:43.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.306 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.306 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "86400", 2023-07-14T13:34:43.306 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.307 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.307 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.307 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.307 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.307 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.307 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.307 INFO:teuthology.orchestra.run.smithi017.stdout: "predictor_model": { 2023-07-14T13:34:43.308 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "predictor_model", 2023-07-14T13:34:43.308 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.308 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.308 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.308 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "prophetstor", 2023-07-14T13:34:43.308 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.308 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.309 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.309 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.309 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.309 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.309 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.309 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:43.309 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:43.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.310 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.310 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "600", 2023-07-14T13:34:43.310 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.310 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.310 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.310 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.311 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.311 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.311 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "influx", 2023-07-14T13:34:43.312 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": false, 2023-07-14T13:34:43.312 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "influxdb python module not found", 2023-07-14T13:34:43.312 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.312 INFO:teuthology.orchestra.run.smithi017.stdout: "batch_size": { 2023-07-14T13:34:43.312 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "batch_size", 2023-07-14T13:34:43.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.312 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.312 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.313 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5000", 2023-07-14T13:34:43.313 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.313 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.313 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.313 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-07-14T13:34:43.313 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.313 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.314 INFO:teuthology.orchestra.run.smithi017.stdout: "database": { 2023-07-14T13:34:43.314 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "database", 2023-07-14T13:34:43.314 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.314 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.314 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.314 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "ceph", 2023-07-14T13:34:43.315 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.315 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.315 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.315 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-07-14T13:34:43.315 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.315 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.315 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.316 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": { 2023-07-14T13:34:43.316 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "hostname", 2023-07-14T13:34:43.316 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.316 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.316 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.316 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.316 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.316 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.317 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.317 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server hostname", 2023-07-14T13:34:43.317 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.317 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.317 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.317 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:43.318 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:43.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.318 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.318 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "30", 2023-07-14T13:34:43.318 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "5", 2023-07-14T13:34:43.318 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.318 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.319 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-07-14T13:34:43.319 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.319 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.319 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.319 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.320 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.320 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.320 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.320 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.320 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.320 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.321 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.321 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.321 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.321 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.321 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.321 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.321 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.321 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.322 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.322 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.322 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.322 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.323 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.323 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.323 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.323 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.323 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.323 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.323 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.324 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.324 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.324 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.324 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.324 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.324 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.324 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.325 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.325 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.325 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.325 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.325 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.325 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.325 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.325 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.326 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.326 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.326 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.326 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.326 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.326 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.327 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.327 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.327 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.327 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.327 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.327 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.327 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.327 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.328 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.328 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.328 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.328 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.328 INFO:teuthology.orchestra.run.smithi017.stdout: "password": { 2023-07-14T13:34:43.328 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "password", 2023-07-14T13:34:43.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.329 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.329 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.329 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.329 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.329 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.330 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "password of InfluxDB server user", 2023-07-14T13:34:43.330 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.330 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.330 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.330 INFO:teuthology.orchestra.run.smithi017.stdout: "port": { 2023-07-14T13:34:43.330 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "port", 2023-07-14T13:34:43.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.331 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.331 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "8086", 2023-07-14T13:34:43.331 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "InfluxDB server port", 2023-07-14T13:34:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.333 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.333 INFO:teuthology.orchestra.run.smithi017.stdout: "ssl": { 2023-07-14T13:34:43.333 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ssl", 2023-07-14T13:34:43.333 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.333 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.334 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "false", 2023-07-14T13:34:43.334 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.334 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.334 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.334 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T13:34:43.335 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.335 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.335 INFO:teuthology.orchestra.run.smithi017.stdout: "threads": { 2023-07-14T13:34:43.336 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threads", 2023-07-14T13:34:43.336 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.336 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.336 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.336 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:43.337 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:43.337 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "32", 2023-07-14T13:34:43.337 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.337 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-07-14T13:34:43.337 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.337 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.338 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.338 INFO:teuthology.orchestra.run.smithi017.stdout: "username": { 2023-07-14T13:34:43.338 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "username", 2023-07-14T13:34:43.338 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.338 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.338 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.339 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.339 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.339 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.339 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.339 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "username of InfluxDB server user", 2023-07-14T13:34:43.339 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.339 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.340 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.340 INFO:teuthology.orchestra.run.smithi017.stdout: "verify_ssl": { 2023-07-14T13:34:43.340 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "verify_ssl", 2023-07-14T13:34:43.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.340 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.340 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.340 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "true", 2023-07-14T13:34:43.341 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.341 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.341 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.341 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T13:34:43.341 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.341 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.342 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "insights", 2023-07-14T13:34:43.342 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.342 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.342 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.343 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.343 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.343 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.343 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.343 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.343 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.343 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.344 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.344 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.344 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.344 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.344 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.344 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.344 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.345 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.345 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.345 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.345 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.345 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.345 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.345 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.346 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.346 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.346 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.346 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.346 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.347 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.347 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.347 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.347 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.347 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.347 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.348 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.348 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.348 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.348 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.348 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.348 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.349 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.349 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.349 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.349 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.349 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.349 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.349 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.350 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.350 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.350 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.350 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.350 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.350 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.351 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.351 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.351 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.351 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.351 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.351 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.351 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.352 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.352 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.352 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.352 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.352 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.353 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "iostat", 2023-07-14T13:34:43.353 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.353 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.353 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.354 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.354 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.354 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.354 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.354 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.355 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.355 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.355 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.355 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.355 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.355 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.355 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.356 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.356 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.356 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.356 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.356 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.356 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.356 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.358 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.359 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.359 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.359 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.359 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.359 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.360 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.361 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.361 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.361 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.361 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.361 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.361 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.361 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.362 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.362 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.362 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.362 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.362 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.363 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.363 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.363 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.363 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.363 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.363 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.364 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.364 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "k8sevents", 2023-07-14T13:34:43.364 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.364 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.365 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.365 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_event_retention_days": { 2023-07-14T13:34:43.365 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "ceph_event_retention_days", 2023-07-14T13:34:43.365 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.365 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.365 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.366 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "7", 2023-07-14T13:34:43.366 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.366 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.366 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.366 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Days to hold ceph event information within local cache", 2023-07-14T13:34:43.366 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.366 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.367 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.367 INFO:teuthology.orchestra.run.smithi017.stdout: "config_check_secs": { 2023-07-14T13:34:43.367 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "config_check_secs", 2023-07-14T13:34:43.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.368 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.368 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:43.368 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "10", 2023-07-14T13:34:43.368 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.368 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.369 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-07-14T13:34:43.369 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.369 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.369 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.370 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.370 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.370 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.370 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.371 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.371 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.371 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.371 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.371 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.371 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.372 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.372 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.372 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.372 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.372 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.372 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.372 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.373 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.373 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.373 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.373 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.373 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.373 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.374 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.374 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.374 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.374 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.374 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.375 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.375 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.376 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.376 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.376 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.376 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.376 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.376 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.377 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.377 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.377 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.377 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.377 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.377 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.378 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.378 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.378 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.378 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.378 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.378 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.379 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.379 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.379 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.379 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.379 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.380 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.380 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.380 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.380 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.381 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.381 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.381 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.383 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "localpool", 2023-07-14T13:34:43.383 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.383 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.383 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.384 INFO:teuthology.orchestra.run.smithi017.stdout: "failure_domain": { 2023-07-14T13:34:43.384 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "failure_domain", 2023-07-14T13:34:43.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.384 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.384 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "host", 2023-07-14T13:34:43.385 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.385 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.385 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.385 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "failure domain for any created local pool", 2023-07-14T13:34:43.385 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-07-14T13:34:43.386 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.386 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.386 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.386 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.387 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.388 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.388 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.388 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.388 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.389 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.389 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.389 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.389 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.389 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.390 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.390 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.390 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.390 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.391 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.391 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.392 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.392 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.392 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.392 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.392 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.392 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.393 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.393 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.393 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.393 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.393 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.393 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.394 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.394 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.394 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.395 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.395 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.395 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.395 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.395 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.395 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.395 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.396 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.396 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.396 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.396 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.396 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.396 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.396 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.397 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.397 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.397 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.397 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.397 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.398 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.398 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.398 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.398 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.398 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.398 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.398 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.399 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.399 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.399 INFO:teuthology.orchestra.run.smithi017.stdout: "min_size": { 2023-07-14T13:34:43.399 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "min_size", 2023-07-14T13:34:43.399 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.399 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.400 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.400 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.400 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.400 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.401 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default min_size for any created local pool", 2023-07-14T13:34:43.401 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-07-14T13:34:43.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.401 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.401 INFO:teuthology.orchestra.run.smithi017.stdout: "num_rep": { 2023-07-14T13:34:43.402 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "num_rep", 2023-07-14T13:34:43.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.402 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.402 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3", 2023-07-14T13:34:43.403 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.403 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.403 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.403 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default replica count for any created local pool", 2023-07-14T13:34:43.403 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.403 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.404 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.404 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_num": { 2023-07-14T13:34:43.404 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_num", 2023-07-14T13:34:43.404 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.404 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.405 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "128", 2023-07-14T13:34:43.405 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.405 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.405 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.405 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "default pg_num for any created local pool", 2023-07-14T13:34:43.406 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.406 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.406 INFO:teuthology.orchestra.run.smithi017.stdout: "prefix": { 2023-07-14T13:34:43.406 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prefix", 2023-07-14T13:34:43.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.407 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.407 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.407 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.407 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.408 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.408 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "name prefix for any created local pool", 2023-07-14T13:34:43.408 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.408 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.408 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.409 INFO:teuthology.orchestra.run.smithi017.stdout: "subtree": { 2023-07-14T13:34:43.409 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "subtree", 2023-07-14T13:34:43.409 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.409 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.409 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.410 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "rack", 2023-07-14T13:34:43.410 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.410 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.410 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.410 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "CRUSH level for which to create a local pool", 2023-07-14T13:34:43.410 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-07-14T13:34:43.410 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.411 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.411 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mds_autoscaler", 2023-07-14T13:34:43.412 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.412 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.412 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.412 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.412 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.412 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.412 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.413 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.413 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.413 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.413 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.413 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.413 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.414 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.414 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.414 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.414 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.414 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.414 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.414 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.415 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.415 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.415 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.415 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.415 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.416 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.416 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.416 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.416 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.416 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.416 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.417 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.417 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.417 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.417 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.417 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.418 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.418 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.418 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.418 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.418 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.418 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.419 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.419 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.419 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.419 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.419 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.419 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.419 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.420 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.420 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.420 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.420 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.420 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.421 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.421 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.421 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.421 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.421 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.421 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.422 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.422 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.422 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.422 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.422 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.423 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirroring", 2023-07-14T13:34:43.423 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.423 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.423 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.423 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.424 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.424 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.424 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.424 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.424 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.425 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.425 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.425 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.425 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.425 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.425 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.425 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.426 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.426 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.426 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.426 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.426 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.427 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.427 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.427 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.427 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.427 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.428 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.428 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.428 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.428 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.428 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.428 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.429 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.429 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.429 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.429 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.430 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.430 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.430 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.430 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.430 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.430 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.431 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.431 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.431 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.431 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.431 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.431 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.432 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.432 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.432 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.432 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.432 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.432 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.433 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.433 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.433 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.433 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.433 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.433 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.433 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.434 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.434 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "nfs", 2023-07-14T13:34:43.434 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.435 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.435 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.435 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.435 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.435 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.436 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.436 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.436 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.436 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.436 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.436 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.436 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.437 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.437 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.437 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.437 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.437 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.437 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.438 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.438 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.438 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.438 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.439 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.439 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.439 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.439 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.439 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.439 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.440 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.440 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.440 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.440 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.440 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.441 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.441 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.441 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.441 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.441 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.442 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.442 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.442 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.442 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.442 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.442 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.442 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.443 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.443 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.443 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.443 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.443 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.444 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.444 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.444 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.444 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.445 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.445 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.445 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.445 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.445 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.445 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.446 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.446 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-07-14T13:34:43.446 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.446 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.446 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.446 INFO:teuthology.orchestra.run.smithi017.stdout: "fail_fs": { 2023-07-14T13:34:43.447 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "fail_fs", 2023-07-14T13:34:43.447 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.447 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.447 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.447 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.447 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.448 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.448 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.448 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-07-14T13:34:43.448 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.448 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.449 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.449 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.449 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.449 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.449 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.449 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.450 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.450 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.450 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.450 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.450 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.450 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.450 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.451 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.451 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.451 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.451 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.451 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.452 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.452 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.452 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.452 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.452 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.453 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.453 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.453 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.453 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.453 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.454 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.454 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.454 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.454 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.454 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.454 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.455 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.455 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.455 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.455 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.455 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.455 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.455 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.455 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.456 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.456 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.456 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.456 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.456 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.457 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.457 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.457 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.457 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.457 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.457 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.457 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.458 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.458 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.458 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.458 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.458 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.459 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator": { 2023-07-14T13:34:43.459 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "orchestrator", 2023-07-14T13:34:43.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.459 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.459 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.459 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.460 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.460 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.460 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.460 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm", 2023-07-14T13:34:43.460 INFO:teuthology.orchestra.run.smithi017.stdout: "rook", 2023-07-14T13:34:43.461 INFO:teuthology.orchestra.run.smithi017.stdout: "test_orchestrator" 2023-07-14T13:34:43.461 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.461 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Orchestrator backend", 2023-07-14T13:34:43.461 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.462 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.462 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_perf_query", 2023-07-14T13:34:43.463 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.463 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.463 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.463 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.463 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.464 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.464 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.464 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.464 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.464 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.464 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.465 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.465 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.465 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.465 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.465 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.465 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.466 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.466 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.466 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.466 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.466 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.467 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.467 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.467 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.467 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.468 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.468 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.468 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.468 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.468 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.469 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.469 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.469 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.469 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.470 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.470 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.470 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.470 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.470 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.470 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.470 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.471 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.471 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.471 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.471 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.471 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.471 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.471 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.472 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.472 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.472 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.472 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.472 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.472 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.473 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.473 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.473 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.473 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.473 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.473 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.473 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.474 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "osd_support", 2023-07-14T13:34:43.474 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.474 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.474 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.474 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.475 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.476 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.476 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.476 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.476 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.476 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.476 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.479 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.479 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.479 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.479 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.479 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.479 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.480 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.480 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.481 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.482 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.483 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.483 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.483 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.483 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.484 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.485 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.485 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.485 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.485 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.486 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "pg_autoscaler", 2023-07-14T13:34:43.486 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.486 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.486 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.487 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.487 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.487 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.487 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.487 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.488 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.488 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.488 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.488 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.488 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.488 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.488 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.489 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.489 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.489 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.489 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.489 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.489 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.490 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.490 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.490 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.490 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.490 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.492 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.493 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.494 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.495 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.496 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "noautoscale": { 2023-07-14T13:34:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "noautoscale", 2023-07-14T13:34:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.497 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "global autoscale flag", 2023-07-14T13:34:43.498 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-07-14T13:34:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.499 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.500 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: "threshold": { 2023-07-14T13:34:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "threshold", 2023-07-14T13:34:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:43.501 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "3.0", 2023-07-14T13:34:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1.0", 2023-07-14T13:34:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "scaling threshold", 2023-07-14T13:34:43.502 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-07-14T13:34:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.503 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "progress", 2023-07-14T13:34:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_pg_recovery_event": { 2023-07-14T13:34:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_pg_recovery_event", 2023-07-14T13:34:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.504 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow the module to show pg recovery progress", 2023-07-14T13:34:43.505 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-07-14T13:34:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-07-14T13:34:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.506 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.507 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.508 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.509 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.510 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.512 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.513 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.514 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.515 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.516 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "max_completed_events": { 2023-07-14T13:34:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_completed_events", 2023-07-14T13:34:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.519 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "50", 2023-07-14T13:34:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.520 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "number of past completed events to remember", 2023-07-14T13:34:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "sleep_interval": { 2023-07-14T13:34:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "sleep_interval", 2023-07-14T13:34:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.521 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "5", 2023-07-14T13:34:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.522 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "how long the module is going to sleep", 2023-07-14T13:34:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.523 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "prometheus", 2023-07-14T13:34:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "cache": { 2023-07-14T13:34:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "cache", 2023-07-14T13:34:43.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.525 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "exclude_perf_counters": { 2023-07-14T13:34:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "exclude_perf_counters", 2023-07-14T13:34:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.526 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-07-14T13:34:43.527 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-07-14T13:34:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.528 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.537 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools": { 2023-07-14T13:34:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools", 2023-07-14T13:34:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.538 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.539 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_stats_pools_refresh_interval": { 2023-07-14T13:34:43.540 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-07-14T13:34:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300", 2023-07-14T13:34:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.541 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.542 INFO:teuthology.orchestra.run.smithi017.stdout: "scrape_interval": { 2023-07-14T13:34:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "scrape_interval", 2023-07-14T13:34:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15.0", 2023-07-14T13:34:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.543 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.544 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-07-14T13:34:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-07-14T13:34:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "::", 2023-07-14T13:34:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.545 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-07-14T13:34:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.546 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-07-14T13:34:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-07-14T13:34:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "9283", 2023-07-14T13:34:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.547 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-07-14T13:34:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.548 INFO:teuthology.orchestra.run.smithi017.stdout: "stale_cache_strategy": { 2023-07-14T13:34:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stale_cache_strategy", 2023-07-14T13:34:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "log", 2023-07-14T13:34:43.549 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_behaviour": { 2023-07-14T13:34:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_behaviour", 2023-07-14T13:34:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "default", 2023-07-14T13:34:43.551 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "default", 2023-07-14T13:34:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "error" 2023-07-14T13:34:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.552 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "standby_error_status_code": { 2023-07-14T13:34:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "standby_error_status_code", 2023-07-14T13:34:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.553 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "500", 2023-07-14T13:34:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "400", 2023-07-14T13:34:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "599", 2023-07-14T13:34:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2023-07-14T13:34:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.557 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.558 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.559 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.561 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.562 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.563 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.564 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.565 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.567 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.568 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_snap_create": { 2023-07-14T13:34:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_snap_create", 2023-07-14T13:34:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10", 2023-07-14T13:34:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.569 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "mirror_snapshot_schedule": { 2023-07-14T13:34:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mirror_snapshot_schedule", 2023-07-14T13:34:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.571 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.572 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "trash_purge_schedule": { 2023-07-14T13:34:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "trash_purge_schedule", 2023-07-14T13:34:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.573 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.574 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "restful", 2023-07-14T13:34:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.575 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_auth": { 2023-07-14T13:34:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enable_auth", 2023-07-14T13:34:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.576 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "key_file": { 2023-07-14T13:34:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "key_file", 2023-07-14T13:34:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.579 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.580 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.581 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.582 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.583 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.584 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.585 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.586 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.587 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.588 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.589 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.590 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.592 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.593 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.594 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.595 INFO:teuthology.orchestra.run.smithi017.stdout: "server_addr": { 2023-07-14T13:34:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_addr", 2023-07-14T13:34:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.596 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.597 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "server_port": { 2023-07-14T13:34:43.598 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "server_port", 2023-07-14T13:34:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.599 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rgw", 2023-07-14T13:34:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.601 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.603 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.605 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.607 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.608 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.610 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rook", 2023-07-14T13:34:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.612 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "drive_group_interval": { 2023-07-14T13:34:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "drive_group_interval", 2023-07-14T13:34:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.613 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "300.0", 2023-07-14T13:34:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-07-14T13:34:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.614 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.615 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.616 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.617 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.619 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.622 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.623 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.624 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.625 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.626 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.627 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.628 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "storage_class": { 2023-07-14T13:34:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "storage_class", 2023-07-14T13:34:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.629 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "local", 2023-07-14T13:34:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-07-14T13:34:43.630 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.631 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "selftest", 2023-07-14T13:34:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.633 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.634 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.636 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.637 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.638 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.639 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.640 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.641 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.642 INFO:teuthology.orchestra.run.smithi017.stdout: "roption1": { 2023-07-14T13:34:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption1", 2023-07-14T13:34:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.643 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "roption2": { 2023-07-14T13:34:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "roption2", 2023-07-14T13:34:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.645 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "xyz", 2023-07-14T13:34:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.646 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption1": { 2023-07-14T13:34:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption1", 2023-07-14T13:34:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.648 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption2": { 2023-07-14T13:34:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption2", 2023-07-14T13:34:43.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.650 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption3": { 2023-07-14T13:34:43.651 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption3", 2023-07-14T13:34:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "float", 2023-07-14T13:34:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.652 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.653 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption4": { 2023-07-14T13:34:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption4", 2023-07-14T13:34:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.654 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.655 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption5": { 2023-07-14T13:34:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption5", 2023-07-14T13:34:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.656 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.657 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption6": { 2023-07-14T13:34:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption6", 2023-07-14T13:34:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.658 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.659 INFO:teuthology.orchestra.run.smithi017.stdout: "rwoption7": { 2023-07-14T13:34:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rwoption7", 2023-07-14T13:34:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "1", 2023-07-14T13:34:43.660 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "42", 2023-07-14T13:34:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.661 INFO:teuthology.orchestra.run.smithi017.stdout: "testkey": { 2023-07-14T13:34:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testkey", 2023-07-14T13:34:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.662 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.663 INFO:teuthology.orchestra.run.smithi017.stdout: "testlkey": { 2023-07-14T13:34:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testlkey", 2023-07-14T13:34:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.664 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "testnewline": { 2023-07-14T13:34:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "testnewline", 2023-07-14T13:34:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.666 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.667 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.668 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2023-07-14T13:34:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: "allow_m_granularity": { 2023-07-14T13:34:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "allow_m_granularity", 2023-07-14T13:34:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.672 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.673 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "allow minute scheduled snapshots", 2023-07-14T13:34:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "dump_on_update": { 2023-07-14T13:34:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "dump_on_update", 2023-07-14T13:34:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.675 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "dump database to debug log on update", 2023-07-14T13:34:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.676 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.677 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.678 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.679 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.680 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.681 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.682 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.683 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.684 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.686 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.687 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.688 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.689 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "stats", 2023-07-14T13:34:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.691 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.692 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.693 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.694 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.695 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.696 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.697 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.698 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.699 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.700 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.701 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.702 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "status", 2023-07-14T13:34:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.703 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.704 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.705 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.707 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.709 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.710 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.711 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.712 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.713 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telegraf", 2023-07-14T13:34:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.714 INFO:teuthology.orchestra.run.smithi017.stdout: "address": { 2023-07-14T13:34:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "address", 2023-07-14T13:34:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-14T13:34:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.715 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.716 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "15", 2023-07-14T13:34:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.717 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.718 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.719 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.720 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.721 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.722 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.723 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.724 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.725 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.726 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.727 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "telemetry", 2023-07-14T13:34:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_basic": { 2023-07-14T13:34:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_basic", 2023-07-14T13:34:43.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.730 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share basic cluster information (size, version)", 2023-07-14T13:34:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_crash": { 2023-07-14T13:34:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_crash", 2023-07-14T13:34:43.731 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.732 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-07-14T13:34:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_device": { 2023-07-14T13:34:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_device", 2023-07-14T13:34:43.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "True", 2023-07-14T13:34:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.734 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-07-14T13:34:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_ident": { 2023-07-14T13:34:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_ident", 2023-07-14T13:34:43.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.736 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-07-14T13:34:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "channel_perf": { 2023-07-14T13:34:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "channel_perf", 2023-07-14T13:34:43.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Share various performance metrics of a cluster", 2023-07-14T13:34:43.738 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "contact": { 2023-07-14T13:34:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "contact", 2023-07-14T13:34:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.739 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.740 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.740 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.740 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.740 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.740 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.740 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "description": { 2023-07-14T13:34:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "description", 2023-07-14T13:34:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.741 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.742 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "device_url": { 2023-07-14T13:34:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "device_url", 2023-07-14T13:34:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.743 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-07-14T13:34:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.744 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "enabled": { 2023-07-14T13:34:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "enabled", 2023-07-14T13:34:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.745 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.746 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.747 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "24", 2023-07-14T13:34:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "8", 2023-07-14T13:34:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.748 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "last_opt_revision": { 2023-07-14T13:34:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "last_opt_revision", 2023-07-14T13:34:43.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "1", 2023-07-14T13:34:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.750 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard": { 2023-07-14T13:34:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard", 2023-07-14T13:34:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.751 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.752 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "leaderboard_description": { 2023-07-14T13:34:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "leaderboard_description", 2023-07-14T13:34:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.753 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.754 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.755 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.756 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.757 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.758 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.759 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.761 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.762 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "organization": { 2023-07-14T13:34:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "organization", 2023-07-14T13:34:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.765 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.766 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "proxy": { 2023-07-14T13:34:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "proxy", 2023-07-14T13:34:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.767 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.768 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "url": { 2023-07-14T13:34:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "url", 2023-07-14T13:34:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.769 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-07-14T13:34:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.770 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "test_orchestrator", 2023-07-14T13:34:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.771 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2023-07-14T13:34:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "max_concurrent_clones": { 2023-07-14T13:34:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "max_concurrent_clones", 2023-07-14T13:34:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "4", 2023-07-14T13:34:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Number of asynchronous cloner threads", 2023-07-14T13:34:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "snapshot_clone_delay": { 2023-07-14T13:34:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snapshot_clone_delay", 2023-07-14T13:34:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "0", 2023-07-14T13:34:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-07-14T13:34:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix", 2023-07-14T13:34:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "can_run": true, 2023-07-14T13:34:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "error_string": "", 2023-07-14T13:34:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "module_options": { 2023-07-14T13:34:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "discovery_interval": { 2023-07-14T13:34:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "discovery_interval", 2023-07-14T13:34:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "uint", 2023-07-14T13:34:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "100", 2023-07-14T13:34:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "identifier": { 2023-07-14T13:34:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "identifier", 2023-07-14T13:34:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "interval": { 2023-07-14T13:34:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "interval", 2023-07-14T13:34:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "secs", 2023-07-14T13:34:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "60", 2023-07-14T13:34:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "log_level": { 2023-07-14T13:34:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_level", 2023-07-14T13:34:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster": { 2023-07-14T13:34:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster", 2023-07-14T13:34:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_cluster_level": { 2023-07-14T13:34:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_cluster_level", 2023-07-14T13:34:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "info", 2023-07-14T13:34:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [ 2023-07-14T13:34:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "", 2023-07-14T13:34:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "critical", 2023-07-14T13:34:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "debug", 2023-07-14T13:34:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "error", 2023-07-14T13:34:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "info", 2023-07-14T13:34:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "warning" 2023-07-14T13:34:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": { 2023-07-14T13:34:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "log_to_file", 2023-07-14T13:34:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "bool", 2023-07-14T13:34:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 1, 2023-07-14T13:34:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "False", 2023-07-14T13:34:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_host": { 2023-07-14T13:34:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_host", 2023-07-14T13:34:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "", 2023-07-14T13:34:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_port": { 2023-07-14T13:34:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_port", 2023-07-14T13:34:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "int", 2023-07-14T13:34:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "10051", 2023-07-14T13:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "zabbix_sender": { 2023-07-14T13:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "zabbix_sender", 2023-07-14T13:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "str", 2023-07-14T13:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "level": "advanced", 2023-07-14T13:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flags": 0, 2023-07-14T13:34:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-07-14T13:34:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "min": "", 2023-07-14T13:34:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "max": "", 2023-07-14T13:34:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "enum_allowed": [], 2023-07-14T13:34:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "desc": "", 2023-07-14T13:34:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "long_desc": "", 2023-07-14T13:34:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "tags": [], 2023-07-14T13:34:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "see_also": [] 2023-07-14T13:34:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "services": { 2023-07-14T13:34:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "dashboard": "https://172.21.15.17:8443/" 2023-07-14T13:34:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "always_on_modules": { 2023-07-14T13:34:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "octopus": [ 2023-07-14T13:34:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2023-07-14T13:34:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2023-07-14T13:34:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2023-07-14T13:34:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2023-07-14T13:34:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2023-07-14T13:34:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2023-07-14T13:34:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2023-07-14T13:34:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2023-07-14T13:34:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2023-07-14T13:34:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2023-07-14T13:34:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: "pacific": [ 2023-07-14T13:34:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2023-07-14T13:34:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2023-07-14T13:34:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2023-07-14T13:34:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2023-07-14T13:34:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2023-07-14T13:34:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2023-07-14T13:34:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2023-07-14T13:34:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2023-07-14T13:34:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2023-07-14T13:34:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2023-07-14T13:34:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "quincy": [ 2023-07-14T13:34:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2023-07-14T13:34:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2023-07-14T13:34:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2023-07-14T13:34:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2023-07-14T13:34:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2023-07-14T13:34:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2023-07-14T13:34:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2023-07-14T13:34:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2023-07-14T13:34:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2023-07-14T13:34:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2023-07-14T13:34:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2023-07-14T13:34:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "reef": [ 2023-07-14T13:34:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "balancer", 2023-07-14T13:34:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2023-07-14T13:34:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "devicehealth", 2023-07-14T13:34:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "orchestrator", 2023-07-14T13:34:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "pg_autoscaler", 2023-07-14T13:34:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "progress", 2023-07-14T13:34:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_support", 2023-07-14T13:34:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "status", 2023-07-14T13:34:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "telemetry", 2023-07-14T13:34:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "volumes" 2023-07-14T13:34:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T13:34:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: "last_failure_osd_epoch": 89, 2023-07-14T13:34:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: "active_clients": [ 2023-07-14T13:34:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "devicehealth", 2023-07-14T13:34:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-07-14T13:34:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-07-14T13:34:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-07-14T13:34:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1161235109 2023-07-14T13:34:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T13:34:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "libcephsqlite", 2023-07-14T13:34:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-07-14T13:34:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-07-14T13:34:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-07-14T13:34:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 1870341053 2023-07-14T13:34:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T13:34:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "rbd_support", 2023-07-14T13:34:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-07-14T13:34:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-07-14T13:34:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-07-14T13:34:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 119131870 2023-07-14T13:34:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T13:34:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2023-07-14T13:34:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-07-14T13:34:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-07-14T13:34:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-07-14T13:34:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 15437665 2023-07-14T13:34:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T13:34:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "snap_schedule", 2023-07-14T13:34:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-07-14T13:34:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-07-14T13:34:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-07-14T13:34:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 453259197 2023-07-14T13:34:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T13:34:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "volumes", 2023-07-14T13:34:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: "addrvec": [ 2023-07-14T13:34:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2023-07-14T13:34:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v2", 2023-07-14T13:34:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "172.21.15.17:0", 2023-07-14T13:34:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 4229577506 2023-07-14T13:34:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T13:34:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2023-07-14T13:34:43.836 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:34:43.837 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:41 smithi131 ceph-mon[96953]: pgmap v1109: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 174 KiB/s wr, 29 op/s 2023-07-14T13:34:43.837 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:41 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3921616973' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-07-14T13:34:43.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:41 smithi135 ceph-mon[97338]: pgmap v1109: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 174 KiB/s wr, 29 op/s 2023-07-14T13:34:43.837 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:41 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3921616973' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-07-14T13:34:43.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 -- 172.21.15.17:0/3921616973 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe3dc0a1380 msgr2=0x7fe3dc0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:43.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe3dc0a1380 0x7fe3dc0a3830 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009bd0 tx=0x7fe3e4009260 comp rx=0 tx=0).stop 2023-07-14T13:34:43.838 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 -- 172.21.15.17:0/3921616973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4105ae0 msgr2=0x7fe3f4197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:34:43.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4105ae0 0x7fe3f4197b30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec007ee0 tx=0x7fe3ec00d3b0 comp rx=0 tx=0).stop 2023-07-14T13:34:43.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 -- 172.21.15.17:0/3921616973 shutdown_connections 2023-07-14T13:34:43.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fe3dc0a1380 0x7fe3dc0a3830 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:43.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3f4105ae0 0x7fe3f4197b30 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:43.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe3f40ffad0 0x7fe3f419db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:43.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 --2- 172.21.15.17:0/3921616973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3f4100480 0x7fe3f419e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:34:43.839 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 -- 172.21.15.17:0/3921616973 >> 172.21.15.17:0/3921616973 conn(0x7fe3f40fb590 msgr2=0x7fe3f410ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:34:43.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 -- 172.21.15.17:0/3921616973 shutdown_connections 2023-07-14T13:34:43.840 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:34:41.291+0000 7fe3f95ff700 1 -- 172.21.15.17:0/3921616973 wait complete. 2023-07-14T13:34:43.846 DEBUG:tasks.check_counter:Getting stats from a 2023-07-14T13:34:43.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.a perf dump 2023-07-14T13:34:43.847 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:41 smithi017 ceph-mon[95536]: pgmap v1109: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 174 KiB/s wr, 29 op/s 2023-07-14T13:34:43.848 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:41 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3921616973' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-07-14T13:34:44.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:43 smithi135 ceph-mon[97338]: pgmap v1110: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 82 KiB/s wr, 28 op/s 2023-07-14T13:34:44.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:43 smithi131 ceph-mon[96953]: pgmap v1110: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 82 KiB/s wr, 28 op/s 2023-07-14T13:34:44.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:43 smithi017 ceph-mon[95536]: pgmap v1110: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 82 KiB/s wr, 28 op/s 2023-07-14T13:34:44.607 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T13:34:46.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:45 smithi135 ceph-mon[97338]: pgmap v1111: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 80 KiB/s wr, 26 op/s 2023-07-14T13:34:46.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:45 smithi131 ceph-mon[96953]: pgmap v1111: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 80 KiB/s wr, 26 op/s 2023-07-14T13:34:46.245 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:45 smithi017 ceph-mon[95536]: pgmap v1111: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 80 KiB/s wr, 26 op/s 2023-07-14T13:34:46.577 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:34:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:34:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 600, 2023-07-14T13:34:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 590, 2023-07-14T13:34:46.578 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1530896, 2023-07-14T13:34:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 339216, 2023-07-14T13:34:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2023-07-14T13:34:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2023-07-14T13:34:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.111502629, 2023-07-14T13:34:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.046776568, 2023-07-14T13:34:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.049760086, 2023-07-14T13:34:46.579 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.015319630, 2023-07-14T13:34:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 589, 2023-07-14T13:34:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.061852387, 2023-07-14T13:34:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000105012 2023-07-14T13:34:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:46.580 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 1530896, 2023-07-14T13:34:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 339216 2023-07-14T13:34:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:34:46.581 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4, 2023-07-14T13:34:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 453, 2023-07-14T13:34:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 640, 2023-07-14T13:34:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 382880, 2023-07-14T13:34:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 7, 2023-07-14T13:34:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 3, 2023-07-14T13:34:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.040701627, 2023-07-14T13:34:46.582 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.031014449, 2023-07-14T13:34:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.003902827, 2023-07-14T13:34:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:34:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 450, 2023-07-14T13:34:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.051422798, 2023-07-14T13:34:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000114272 2023-07-14T13:34:46.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 640, 2023-07-14T13:34:46.584 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 382880 2023-07-14T13:34:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:34:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4, 2023-07-14T13:34:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 4, 2023-07-14T13:34:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 2960, 2023-07-14T13:34:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 448, 2023-07-14T13:34:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2023-07-14T13:34:46.585 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2023-07-14T13:34:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.001330284, 2023-07-14T13:34:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000073281, 2023-07-14T13:34:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.001183009, 2023-07-14T13:34:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:34:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 3, 2023-07-14T13:34:46.586 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.001518975, 2023-07-14T13:34:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000506325 2023-07-14T13:34:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:46.587 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-07-14T13:34:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 448 2023-07-14T13:34:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2023-07-14T13:34:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2023-07-14T13:34:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2023-07-14T13:34:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:46.588 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2023-07-14T13:34:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2023-07-14T13:34:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2023-07-14T13:34:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:34:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:34:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:34:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:34:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:34:46.589 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:34:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:34:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:34:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:34:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:34:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:34:46.590 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:34:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:34:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2023-07-14T13:34:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:34:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2023-07-14T13:34:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:34:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:34:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:34:46.591 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:34:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:34:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:34:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:34:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2023-07-14T13:34:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:34:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:34:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:34:46.592 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2023-07-14T13:34:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2023-07-14T13:34:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2023-07-14T13:34:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:34:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:34:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:34:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:34:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 149745, 2023-07-14T13:34:46.593 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 31, 2023-07-14T13:34:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:34:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2023-07-14T13:34:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2023-07-14T13:34:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2023-07-14T13:34:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:34:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2023-07-14T13:34:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:34:46.594 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2023-07-14T13:34:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2023-07-14T13:34:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2023-07-14T13:34:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:34:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:34:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2023-07-14T13:34:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2023-07-14T13:34:46.595 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2023-07-14T13:34:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2023-07-14T13:34:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2023-07-14T13:34:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2023-07-14T13:34:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2023-07-14T13:34:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2023-07-14T13:34:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:34:46.596 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-07-14T13:34:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2023-07-14T13:34:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-07-14T13:34:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 604, 2023-07-14T13:34:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 1446059, 2023-07-14T13:34:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-07-14T13:34:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 604, 2023-07-14T13:34:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-07-14T13:34:46.597 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-07-14T13:34:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 604, 2023-07-14T13:34:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1446059, 2023-07-14T13:34:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-07-14T13:34:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:46.598 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:46.599 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:34:47.103 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2023-07-14T13:34:47.103 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2023-07-14T13:34:47.103 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2023-07-14T13:34:47.103 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2023-07-14T13:34:47.104 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2023-07-14T13:34:47.104 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2023-07-14T13:34:47.104 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2023-07-14T13:34:47.104 DEBUG:tasks.check_counter:Getting stats from d 2023-07-14T13:34:47.105 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.d perf dump 2023-07-14T13:34:47.837 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T13:34:48.143 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:47 smithi017 ceph-mon[95536]: pgmap v1112: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 103 KiB/s wr, 30 op/s 2023-07-14T13:34:48.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:47 smithi135 ceph-mon[97338]: pgmap v1112: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 103 KiB/s wr, 30 op/s 2023-07-14T13:34:48.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:47 smithi131 ceph-mon[96953]: pgmap v1112: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 103 KiB/s wr, 30 op/s 2023-07-14T13:34:49.397 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:34:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:34:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 607, 2023-07-14T13:34:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 597, 2023-07-14T13:34:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1532800, 2023-07-14T13:34:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 343360, 2023-07-14T13:34:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2023-07-14T13:34:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2023-07-14T13:34:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.110015862, 2023-07-14T13:34:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.046847078, 2023-07-14T13:34:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.048118608, 2023-07-14T13:34:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.014847840, 2023-07-14T13:34:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 596, 2023-07-14T13:34:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.049075827, 2023-07-14T13:34:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000082341 2023-07-14T13:34:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 1532800, 2023-07-14T13:34:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 343360 2023-07-14T13:34:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:34:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 8, 2023-07-14T13:34:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 460, 2023-07-14T13:34:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 3600, 2023-07-14T13:34:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 384208, 2023-07-14T13:34:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 7, 2023-07-14T13:34:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 3, 2023-07-14T13:34:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.040673273, 2023-07-14T13:34:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.030475106, 2023-07-14T13:34:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.004347009, 2023-07-14T13:34:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:34:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 458, 2023-07-14T13:34:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.075819720, 2023-07-14T13:34:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000165545 2023-07-14T13:34:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3600, 2023-07-14T13:34:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 384208 2023-07-14T13:34:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:34:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2023-07-14T13:34:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2023-07-14T13:34:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2023-07-14T13:34:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2023-07-14T13:34:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2023-07-14T13:34:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2023-07-14T13:34:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.000693751, 2023-07-14T13:34:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2023-07-14T13:34:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000536439, 2023-07-14T13:34:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:34:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T13:34:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T13:34:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2023-07-14T13:34:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2023-07-14T13:34:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2023-07-14T13:34:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2023-07-14T13:34:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2023-07-14T13:34:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2023-07-14T13:34:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:34:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:34:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:34:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:34:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:34:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:34:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:34:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:34:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:34:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:34:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:34:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:34:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:34:49.411 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2023-07-14T13:34:49.411 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:34:49.411 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2023-07-14T13:34:49.411 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:34:49.411 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:34:49.411 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:34:49.411 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:34:49.411 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:34:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:34:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:34:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2023-07-14T13:34:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:34:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:34:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:34:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2023-07-14T13:34:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2023-07-14T13:34:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2023-07-14T13:34:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:34:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:34:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:34:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:34:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 148714, 2023-07-14T13:34:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 30, 2023-07-14T13:34:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:34:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2023-07-14T13:34:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2023-07-14T13:34:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2023-07-14T13:34:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:34:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2023-07-14T13:34:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:34:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2023-07-14T13:34:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2023-07-14T13:34:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2023-07-14T13:34:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:34:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:34:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2023-07-14T13:34:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2023-07-14T13:34:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2023-07-14T13:34:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2023-07-14T13:34:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2023-07-14T13:34:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2023-07-14T13:34:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2023-07-14T13:34:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2023-07-14T13:34:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:34:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-07-14T13:34:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2023-07-14T13:34:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-07-14T13:34:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 611, 2023-07-14T13:34:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 1446969, 2023-07-14T13:34:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-07-14T13:34:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 611, 2023-07-14T13:34:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-07-14T13:34:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-07-14T13:34:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 611, 2023-07-14T13:34:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1446969, 2023-07-14T13:34:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-07-14T13:34:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:49.420 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:34:50.035 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-07-14T13:34:50.036 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-07-14T13:34:50.036 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-07-14T13:34:50.036 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-07-14T13:34:50.036 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-07-14T13:34:50.037 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-07-14T13:34:50.037 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-07-14T13:34:50.037 DEBUG:tasks.check_counter:Getting stats from g 2023-07-14T13:34:50.037 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.g perf dump 2023-07-14T13:34:50.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:49 smithi135 ceph-mon[97338]: pgmap v1113: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 42 KiB/s wr, 23 op/s 2023-07-14T13:34:50.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:49 smithi131 ceph-mon[96953]: pgmap v1113: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 42 KiB/s wr, 23 op/s 2023-07-14T13:34:50.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:49 smithi017 ceph-mon[95536]: pgmap v1113: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 42 KiB/s wr, 23 op/s 2023-07-14T13:34:50.866 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T13:34:52.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:51 smithi135 ceph-mon[97338]: pgmap v1114: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 56 KiB/s wr, 24 op/s 2023-07-14T13:34:52.182 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:51 smithi017 ceph-mon[95536]: pgmap v1114: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 56 KiB/s wr, 24 op/s 2023-07-14T13:34:52.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:51 smithi131 ceph-mon[96953]: pgmap v1114: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 56 KiB/s wr, 24 op/s 2023-07-14T13:34:52.831 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:34:52.832 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:34:52.832 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 603, 2023-07-14T13:34:52.832 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 593, 2023-07-14T13:34:52.832 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1531712, 2023-07-14T13:34:52.832 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 340992, 2023-07-14T13:34:52.833 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2023-07-14T13:34:52.833 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2023-07-14T13:34:52.833 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.111398158, 2023-07-14T13:34:52.833 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.047815315, 2023-07-14T13:34:52.833 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.048177992, 2023-07-14T13:34:52.833 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.014728883, 2023-07-14T13:34:52.833 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:52.833 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 592, 2023-07-14T13:34:52.834 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.069274719, 2023-07-14T13:34:52.834 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000117018 2023-07-14T13:34:52.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:52.834 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:52.834 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:52.834 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:52.835 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:52.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:52.835 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 1531712, 2023-07-14T13:34:52.835 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 340992 2023-07-14T13:34:52.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:52.836 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:34:52.836 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 8, 2023-07-14T13:34:52.836 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 457, 2023-07-14T13:34:52.837 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 3600, 2023-07-14T13:34:52.837 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 383680, 2023-07-14T13:34:52.837 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 7, 2023-07-14T13:34:52.837 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 3, 2023-07-14T13:34:52.837 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.040602353, 2023-07-14T13:34:52.837 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.030158091, 2023-07-14T13:34:52.837 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.004605386, 2023-07-14T13:34:52.838 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:34:52.838 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:52.838 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 455, 2023-07-14T13:34:52.838 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.079835331, 2023-07-14T13:34:52.838 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000175462 2023-07-14T13:34:52.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:52.839 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:52.839 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:52.839 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:52.839 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:52.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:52.839 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 3600, 2023-07-14T13:34:52.839 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 383680 2023-07-14T13:34:52.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:52.840 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:34:52.840 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2023-07-14T13:34:52.840 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2023-07-14T13:34:52.841 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2023-07-14T13:34:52.841 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2023-07-14T13:34:52.841 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2023-07-14T13:34:52.841 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2023-07-14T13:34:52.842 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.000969666, 2023-07-14T13:34:52.842 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2023-07-14T13:34:52.842 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000798621, 2023-07-14T13:34:52.843 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:34:52.843 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:52.843 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:52.843 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:52.844 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:52.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:52.844 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:52.844 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:52.845 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:52.845 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:52.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:52.845 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T13:34:52.846 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T13:34:52.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:52.846 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2023-07-14T13:34:52.847 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2023-07-14T13:34:52.847 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2023-07-14T13:34:52.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:52.847 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2023-07-14T13:34:52.848 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2023-07-14T13:34:52.848 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2023-07-14T13:34:52.848 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:34:52.848 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:34:52.848 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:34:52.848 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:34:52.848 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:34:52.849 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:34:52.849 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:34:52.849 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:34:52.849 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:34:52.849 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:34:52.849 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:34:52.849 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:34:52.850 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:34:52.850 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2023-07-14T13:34:52.850 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:34:52.850 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2023-07-14T13:34:52.850 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:34:52.850 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:34:52.851 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:34:52.851 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:34:52.851 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:34:52.851 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:34:52.851 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:34:52.851 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2023-07-14T13:34:52.851 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:34:52.852 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:34:52.852 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:34:52.852 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2023-07-14T13:34:52.852 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2023-07-14T13:34:52.852 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2023-07-14T13:34:52.852 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:34:52.852 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:34:52.853 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:34:52.853 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:34:52.853 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 149785, 2023-07-14T13:34:52.853 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 32, 2023-07-14T13:34:52.853 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:34:52.853 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2023-07-14T13:34:52.853 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2023-07-14T13:34:52.854 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2023-07-14T13:34:52.854 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:34:52.854 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2023-07-14T13:34:52.854 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:34:52.854 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2023-07-14T13:34:52.854 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2023-07-14T13:34:52.854 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2023-07-14T13:34:52.855 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:34:52.855 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:34:52.855 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2023-07-14T13:34:52.855 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2023-07-14T13:34:52.855 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2023-07-14T13:34:52.855 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2023-07-14T13:34:52.856 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2023-07-14T13:34:52.856 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2023-07-14T13:34:52.856 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2023-07-14T13:34:52.856 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2023-07-14T13:34:52.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:52.856 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:34:52.856 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-07-14T13:34:52.857 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2023-07-14T13:34:52.857 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-07-14T13:34:52.857 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 607, 2023-07-14T13:34:52.857 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 1446449, 2023-07-14T13:34:52.857 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-07-14T13:34:52.857 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 607, 2023-07-14T13:34:52.857 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-07-14T13:34:52.858 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-07-14T13:34:52.858 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 607, 2023-07-14T13:34:52.858 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1446449, 2023-07-14T13:34:52.858 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-07-14T13:34:52.858 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:52.858 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:52.858 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:52.858 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:52.859 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:52.859 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:34:53.270 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2023-07-14T13:34:53.271 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2023-07-14T13:34:53.271 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2023-07-14T13:34:53.272 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2023-07-14T13:34:53.272 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2023-07-14T13:34:53.272 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2023-07-14T13:34:53.273 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2023-07-14T13:34:53.273 DEBUG:tasks.check_counter:Getting stats from j 2023-07-14T13:34:53.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.j perf dump 2023-07-14T13:34:54.008 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T13:34:54.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:53 smithi135 ceph-mon[97338]: pgmap v1115: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 41 KiB/s wr, 16 op/s 2023-07-14T13:34:54.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:53 smithi131 ceph-mon[96953]: pgmap v1115: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 41 KiB/s wr, 16 op/s 2023-07-14T13:34:54.287 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:53 smithi017 ceph-mon[95536]: pgmap v1115: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 41 KiB/s wr, 16 op/s 2023-07-14T13:34:55.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:54 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:34:55.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:54 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:34:55.290 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:54 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T13:34:55.612 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2023-07-14T13:34:55.613 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:34:55.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 0, 2023-07-14T13:34:55.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 2, 2023-07-14T13:34:55.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 0, 2023-07-14T13:34:55.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 0, 2023-07-14T13:34:55.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 4, 2023-07-14T13:34:55.613 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 0, 2023-07-14T13:34:55.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.003183587, 2023-07-14T13:34:55.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.000000000, 2023-07-14T13:34:55.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.000436829, 2023-07-14T13:34:55.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:34:55.614 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:55.614 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:55.614 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:55.615 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:55.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:55.615 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:55.615 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:55.615 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:55.615 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:55.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:55.615 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T13:34:55.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T13:34:55.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:55.616 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:34:55.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 4, 2023-07-14T13:34:55.616 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 460, 2023-07-14T13:34:55.617 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 640, 2023-07-14T13:34:55.617 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 384112, 2023-07-14T13:34:55.617 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 7, 2023-07-14T13:34:55.617 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 3, 2023-07-14T13:34:55.617 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.043318463, 2023-07-14T13:34:55.617 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.033760593, 2023-07-14T13:34:55.617 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.003512201, 2023-07-14T13:34:55.618 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:34:55.618 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:55.618 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 457, 2023-07-14T13:34:55.618 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.052753567, 2023-07-14T13:34:55.618 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000115434 2023-07-14T13:34:55.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:55.618 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:55.618 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:55.619 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:55.619 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:55.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:55.619 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 640, 2023-07-14T13:34:55.619 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 384112 2023-07-14T13:34:55.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:55.619 INFO:teuthology.orchestra.run.smithi017.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:34:55.620 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_messages": 614, 2023-07-14T13:34:55.620 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages": 602, 2023-07-14T13:34:55.620 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_bytes": 1535904, 2023-07-14T13:34:55.620 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_bytes": 345152, 2023-07-14T13:34:55.620 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_created_connections": 2, 2023-07-14T13:34:55.620 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_active_connections": 1, 2023-07-14T13:34:55.620 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_total_time": 0.109678492, 2023-07-14T13:34:55.620 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_send_time": 0.047452530, 2023-07-14T13:34:55.621 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_recv_time": 0.049351608, 2023-07-14T13:34:55.621 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_running_fast_dispatch_time": 0.014788471, 2023-07-14T13:34:55.621 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:55.621 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 602, 2023-07-14T13:34:55.621 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.086452045, 2023-07-14T13:34:55.621 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000143608 2023-07-14T13:34:55.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:55.622 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:55.622 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:55.622 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:55.622 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:55.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:55.623 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_recv_encrypted_bytes": 1535904, 2023-07-14T13:34:55.623 INFO:teuthology.orchestra.run.smithi017.stdout: "msgr_send_encrypted_bytes": 345152 2023-07-14T13:34:55.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:55.623 INFO:teuthology.orchestra.run.smithi017.stdout: "cct": { 2023-07-14T13:34:55.623 INFO:teuthology.orchestra.run.smithi017.stdout: "total_workers": 0, 2023-07-14T13:34:55.623 INFO:teuthology.orchestra.run.smithi017.stdout: "unhealthy_workers": 0 2023-07-14T13:34:55.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:55.623 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool": { 2023-07-14T13:34:55.624 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_bytes": 0, 2023-07-14T13:34:55.624 INFO:teuthology.orchestra.run.smithi017.stdout: "bloom_filter_items": 0, 2023-07-14T13:34:55.624 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:34:55.624 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:34:55.624 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:34:55.624 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:34:55.624 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:34:55.625 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:34:55.625 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:34:55.625 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:34:55.625 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:34:55.625 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:34:55.625 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:34:55.625 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:34:55.625 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:34:55.626 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_items": 0, 2023-07-14T13:34:55.626 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:34:55.626 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blob_items": 0, 2023-07-14T13:34:55.626 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:34:55.626 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:34:55.626 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:34:55.626 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:34:55.627 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:34:55.627 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:34:55.627 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:34:55.627 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_txc_items": 0, 2023-07-14T13:34:55.627 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:34:55.627 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:34:55.627 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:34:55.628 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_writing_items": 0, 2023-07-14T13:34:55.628 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_bytes": 0, 2023-07-14T13:34:55.628 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_items": 0, 2023-07-14T13:34:55.628 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:34:55.628 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:34:55.628 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:34:55.628 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:34:55.628 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_bytes": 148771, 2023-07-14T13:34:55.629 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_anon_items": 32, 2023-07-14T13:34:55.629 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:34:55.629 INFO:teuthology.orchestra.run.smithi017.stdout: "buffer_meta_items": 0, 2023-07-14T13:34:55.629 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bytes": 0, 2023-07-14T13:34:55.629 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_items": 0, 2023-07-14T13:34:55.629 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:34:55.629 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mapbl_items": 0, 2023-07-14T13:34:55.630 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:34:55.630 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pglog_items": 0, 2023-07-14T13:34:55.630 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_bytes": 0, 2023-07-14T13:34:55.630 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_items": 0, 2023-07-14T13:34:55.630 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:34:55.630 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:34:55.630 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_bytes": 0, 2023-07-14T13:34:55.630 INFO:teuthology.orchestra.run.smithi017.stdout: "pgmap_items": 0, 2023-07-14T13:34:55.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_bytes": 928, 2023-07-14T13:34:55.631 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_co_items": 2, 2023-07-14T13:34:55.631 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_bytes": 0, 2023-07-14T13:34:55.631 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_1_items": 0, 2023-07-14T13:34:55.631 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_bytes": 0, 2023-07-14T13:34:55.632 INFO:teuthology.orchestra.run.smithi017.stdout: "unittest_2_items": 0 2023-07-14T13:34:55.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2023-07-14T13:34:55.632 INFO:teuthology.orchestra.run.smithi017.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:34:55.633 INFO:teuthology.orchestra.run.smithi017.stdout: "val": 0, 2023-07-14T13:34:55.633 INFO:teuthology.orchestra.run.smithi017.stdout: "max": 104857600, 2023-07-14T13:34:55.633 INFO:teuthology.orchestra.run.smithi017.stdout: "get_started": 0, 2023-07-14T13:34:55.633 INFO:teuthology.orchestra.run.smithi017.stdout: "get": 614, 2023-07-14T13:34:55.633 INFO:teuthology.orchestra.run.smithi017.stdout: "get_sum": 1446686, 2023-07-14T13:34:55.633 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_fail": 0, 2023-07-14T13:34:55.633 INFO:teuthology.orchestra.run.smithi017.stdout: "get_or_fail_success": 614, 2023-07-14T13:34:55.634 INFO:teuthology.orchestra.run.smithi017.stdout: "take": 0, 2023-07-14T13:34:55.634 INFO:teuthology.orchestra.run.smithi017.stdout: "take_sum": 0, 2023-07-14T13:34:55.634 INFO:teuthology.orchestra.run.smithi017.stdout: "put": 614, 2023-07-14T13:34:55.634 INFO:teuthology.orchestra.run.smithi017.stdout: "put_sum": 1446686, 2023-07-14T13:34:55.634 INFO:teuthology.orchestra.run.smithi017.stdout: "wait": { 2023-07-14T13:34:55.634 INFO:teuthology.orchestra.run.smithi017.stdout: "avgcount": 0, 2023-07-14T13:34:55.634 INFO:teuthology.orchestra.run.smithi017.stdout: "sum": 0.000000000, 2023-07-14T13:34:55.635 INFO:teuthology.orchestra.run.smithi017.stdout: "avgtime": 0.000000000 2023-07-14T13:34:55.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:55.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2023-07-14T13:34:55.635 INFO:teuthology.orchestra.run.smithi017.stdout:} 2023-07-14T13:34:56.112 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-07-14T13:34:56.113 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-07-14T13:34:56.113 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-07-14T13:34:56.113 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-07-14T13:34:56.113 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-07-14T13:34:56.113 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-07-14T13:34:56.113 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-07-14T13:34:56.114 DEBUG:tasks.check_counter:Getting stats from b 2023-07-14T13:34:56.114 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.b perf dump 2023-07-14T13:34:56.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:55 smithi135 ceph-mon[97338]: pgmap v1116: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-07-14T13:34:56.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:55 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:34:56.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:55 smithi135 ceph-mon[97338]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:34:56.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:55 smithi135 ceph-mon[97338]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:34:56.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:55 smithi131 ceph-mon[96953]: pgmap v1116: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-07-14T13:34:56.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:55 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:34:56.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:55 smithi131 ceph-mon[96953]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:34:56.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:55 smithi131 ceph-mon[96953]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:34:56.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:55 smithi017 ceph-mon[95536]: pgmap v1116: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 7 op/s 2023-07-14T13:34:56.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:55 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T13:34:56.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:55 smithi017 ceph-mon[95536]: from='mgr.15525 172.21.15.17:0/3543246186' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T13:34:56.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:55 smithi017 ceph-mon[95536]: from='mgr.15525 ' entity='mgr.x' 2023-07-14T13:34:57.049 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T13:34:57.960 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:57 smithi131 ceph-mon[96953]: pgmap v1117: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-07-14T13:34:58.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:57 smithi135 ceph-mon[97338]: pgmap v1117: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-07-14T13:34:58.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:57 smithi017 ceph-mon[95536]: pgmap v1117: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 11 op/s 2023-07-14T13:34:58.849 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-07-14T13:34:58.849 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:34:58.849 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 3536643, 2023-07-14T13:34:58.849 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 3528913, 2023-07-14T13:34:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 577375355, 2023-07-14T13:34:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 618117148, 2023-07-14T13:34:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 20, 2023-07-14T13:34:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 4, 2023-07-14T13:34:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 248.044967625, 2023-07-14T13:34:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 118.149646291, 2023-07-14T13:34:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 164.863822176, 2023-07-14T13:34:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 2.638500237, 2023-07-14T13:34:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 3528917, 2023-07-14T13:34:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 57.471048051, 2023-07-14T13:34:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000016285 2023-07-14T13:34:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 7045301, 2023-07-14T13:34:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.878953498, 2023-07-14T13:34:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000124 2023-07-14T13:34:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 2975664, 2023-07-14T13:34:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 770256 2023-07-14T13:34:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:34:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 61345, 2023-07-14T13:34:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 73886, 2023-07-14T13:34:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 19725881, 2023-07-14T13:34:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 66109274, 2023-07-14T13:34:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 452, 2023-07-14T13:34:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 6, 2023-07-14T13:34:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 6.828984308, 2023-07-14T13:34:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 2.329343319, 2023-07-14T13:34:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 3.710440310, 2023-07-14T13:34:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 1.331637630, 2023-07-14T13:34:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 73883, 2023-07-14T13:34:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 7.865927894, 2023-07-14T13:34:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000106464 2023-07-14T13:34:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 114594, 2023-07-14T13:34:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.027707756, 2023-07-14T13:34:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000241 2023-07-14T13:34:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 96848, 2023-07-14T13:34:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 1017728 2023-07-14T13:34:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:34:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 3369867, 2023-07-14T13:34:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 3370497, 2023-07-14T13:34:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 543297682, 2023-07-14T13:34:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 586834841, 2023-07-14T13:34:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 39, 2023-07-14T13:34:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 7, 2023-07-14T13:34:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 170.183764152, 2023-07-14T13:34:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 70.363271374, 2023-07-14T13:34:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 118.865621008, 2023-07-14T13:34:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.565765520, 2023-07-14T13:34:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:34:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 3370491, 2023-07-14T13:34:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 54.919863381, 2023-07-14T13:34:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000016294 2023-07-14T13:34:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:34:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 6721873, 2023-07-14T13:34:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.821404343, 2023-07-14T13:34:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000122 2023-07-14T13:34:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T13:34:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T13:34:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2023-07-14T13:34:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 1, 2023-07-14T13:34:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2023-07-14T13:34:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-MDSRank": { 2023-07-14T13:34:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-07-14T13:34:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-07-14T13:34:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 23554, 2023-07-14T13:34:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 9.239558939, 2023-07-14T13:34:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000392271 2023-07-14T13:34:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:34:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-PurgeQueue": { 2023-07-14T13:34:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-07-14T13:34:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-07-14T13:34:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 255, 2023-07-14T13:34:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.011706816, 2023-07-14T13:34:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000045909 2023-07-14T13:34:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:34:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": { 2023-07-14T13:34:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: "request": 23574, 2023-07-14T13:34:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: "reply": 19082, 2023-07-14T13:34:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: "reply_latency": { 2023-07-14T13:34:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 19082, 2023-07-14T13:34:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 473.010148889, 2023-07-14T13:34:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.024788289 2023-07-14T13:34:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_reply": 0, 2023-07-14T13:34:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: "forward": 4492, 2023-07-14T13:34:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_complete": 34, 2023-07-14T13:34:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_keys": 2, 2023-07-14T13:34:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_commit": 2308, 2023-07-14T13:34:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_split": 6, 2023-07-14T13:34:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_merge": 0, 2023-07-14T13:34:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes": 1280, 2023-07-14T13:34:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_top": 300, 2023-07-14T13:34:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_bottom": 966, 2023-07-14T13:34:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pin_tail": 14, 2023-07-14T13:34:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pinned": 851, 2023-07-14T13:34:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_expired": 4802, 2023-07-14T13:34:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_with_caps": 835, 2023-07-14T13:34:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": 836, 2023-07-14T13:34:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: "subtrees": 30, 2023-07-14T13:34:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse": 64520, 2023-07-14T13:34:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_hit": 53933, 2023-07-14T13:34:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_forward": 4297, 2023-07-14T13:34:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_discover": 303, 2023-07-14T13:34:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_dir_fetch": 2, 2023-07-14T13:34:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_remote_ino": 2, 2023-07-14T13:34:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_lock": 3846, 2023-07-14T13:34:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: "load_cent": 8147, 2023-07-14T13:34:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: "q": 0, 2023-07-14T13:34:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: "exported": 118, 2023-07-14T13:34:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: "exported_inodes": 4292, 2023-07-14T13:34:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: "imported": 124, 2023-07-14T13:34:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: "imported_inodes": 4191, 2023-07-14T13:34:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_dir_fetch": 0, 2023-07-14T13:34:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_backtrace_fetch": 2340, 2023-07-14T13:34:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_peer_discover": 3, 2023-07-14T13:34:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rfiles": 1045, 2023-07-14T13:34:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rbytes": 9004997418, 2023-07-14T13:34:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rsnaps": 6, 2023-07-14T13:34:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_fetch": 2340, 2023-07-14T13:34:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_set_tag": 0, 2023-07-14T13:34:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T13:34:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_inotable_repaired": 0, 2023-07-14T13:34:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_inodes": 231, 2023-07-14T13:34:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_base_inodes": 15, 2023-07-14T13:34:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dirfrag_rstats": 216, 2023-07-14T13:34:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_file_inodes": 2109, 2023-07-14T13:34:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_inode_file_caps": 482, 2023-07-14T13:34:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_revoke": 19049, 2023-07-14T13:34:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_grant": 13805, 2023-07-14T13:34:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T13:34:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T13:34:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T13:34:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps": 30681, 2023-07-14T13:34:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps_dirty": 7463, 2023-07-14T13:34:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_cap_release": 423, 2023-07-14T13:34:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: "process_request_cap_release": 1725 2023-07-14T13:34:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_cache": { 2023-07-14T13:34:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update": 114, 2023-07-14T13:34:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update_receipt": 43, 2023-07-14T13:34:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_try_discover": 24, 2023-07-14T13:34:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_send_discover": 342, 2023-07-14T13:34:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_handle_discover": 471, 2023-07-14T13:34:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays": 0, 2023-07-14T13:34:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_delayed": 0, 2023-07-14T13:34:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_enqueuing": 0, 2023-07-14T13:34:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_created": 205, 2023-07-14T13:34:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_enqueued": 64, 2023-07-14T13:34:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_reintegrated": 765, 2023-07-14T13:34:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_migrated": 91, 2023-07-14T13:34:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_processing": 0, 2023-07-14T13:34:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_enqueued": 0, 2023-07-14T13:34:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_prioritized": 0, 2023-07-14T13:34:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_started": 0, 2023-07-14T13:34:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_completed": 0, 2023-07-14T13:34:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_enqueue_scrub": 15, 2023-07-14T13:34:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_exportdir": 124, 2023-07-14T13:34:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_flush": 0, 2023-07-14T13:34:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragmentdir": 6, 2023-07-14T13:34:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragstats": 0, 2023-07-14T13:34:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_inodestats": 0 2023-07-14T13:34:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_log": { 2023-07-14T13:34:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: "evadd": 19464, 2023-07-14T13:34:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: "evex": 19414, 2023-07-14T13:34:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: "evtrm": 19414, 2023-07-14T13:34:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: "ev": 50, 2023-07-14T13:34:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: "evexg": 0, 2023-07-14T13:34:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: "evexd": 91, 2023-07-14T13:34:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: "segadd": 175, 2023-07-14T13:34:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: "segex": 174, 2023-07-14T13:34:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: "segtrm": 174, 2023-07-14T13:34:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: "seg": 2, 2023-07-14T13:34:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: "segexg": 0, 2023-07-14T13:34:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: "segexd": 1, 2023-07-14T13:34:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: "expos": 85595016, 2023-07-14T13:34:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: "wrpos": 85873992, 2023-07-14T13:34:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: "rdpos": 0, 2023-07-14T13:34:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: "jlat": { 2023-07-14T13:34:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 9660, 2023-07-14T13:34:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 51.105017543, 2023-07-14T13:34:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.005290374 2023-07-14T13:34:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: "replayed": 0 2023-07-14T13:34:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_mem": { 2023-07-14T13:34:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: "ino": 1169, 2023-07-14T13:34:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: "ino+": 5041, 2023-07-14T13:34:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: "ino-": 3872, 2023-07-14T13:34:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: "dir": 137, 2023-07-14T13:34:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: "dir+": 250, 2023-07-14T13:34:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: "dir-": 113, 2023-07-14T13:34:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: "dn": 1201, 2023-07-14T13:34:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: "dn+": 6993, 2023-07-14T13:34:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: "dn-": 5792, 2023-07-14T13:34:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: "cap": 797, 2023-07-14T13:34:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: "cap+": 2906, 2023-07-14T13:34:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: "cap-": 2109, 2023-07-14T13:34:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: "rss": 76636, 2023-07-14T13:34:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: "heap": 207156 2023-07-14T13:34:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_server": { 2023-07-14T13:34:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_client_request": 52380, 2023-07-14T13:34:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_server_request": 9241, 2023-07-14T13:34:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_request": 23574, 2023-07-14T13:34:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_session": 271, 2023-07-14T13:34:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_peer_request": 18798, 2023-07-14T13:34:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: "req_create_latency": { 2023-07-14T13:34:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1032, 2023-07-14T13:34:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 1.368119580, 2023-07-14T13:34:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001325697 2023-07-14T13:34:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getattr_latency": { 2023-07-14T13:34:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1292, 2023-07-14T13:34:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 1.217157453, 2023-07-14T13:34:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000942072 2023-07-14T13:34:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getfilelock_latency": { 2023-07-14T13:34:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: "req_link_latency": { 2023-07-14T13:34:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 140, 2023-07-14T13:34:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 2.505191208, 2023-07-14T13:34:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.017894222 2023-07-14T13:34:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookup_latency": { 2023-07-14T13:34:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 10111, 2023-07-14T13:34:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 337.324913363, 2023-07-14T13:34:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.033362171 2023-07-14T13:34:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookuphash_latency": { 2023-07-14T13:34:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupino_latency": { 2023-07-14T13:34:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupname_latency": { 2023-07-14T13:34:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupparent_latency": { 2023-07-14T13:34:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupsnap_latency": { 2023-07-14T13:34:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lssnap_latency": { 2023-07-14T13:34:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 35, 2023-07-14T13:34:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.007523242, 2023-07-14T13:34:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000214949 2023-07-14T13:34:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mkdir_latency": { 2023-07-14T13:34:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 34, 2023-07-14T13:34:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.039346482, 2023-07-14T13:34:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001157249 2023-07-14T13:34:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mknod_latency": { 2023-07-14T13:34:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mksnap_latency": { 2023-07-14T13:34:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 35, 2023-07-14T13:34:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 7.477000578, 2023-07-14T13:34:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.213628587 2023-07-14T13:34:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: "req_open_latency": { 2023-07-14T13:34:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 5132, 2023-07-14T13:34:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 3.749727504, 2023-07-14T13:34:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000730656 2023-07-14T13:34:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: "req_readdir_latency": { 2023-07-14T13:34:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 166, 2023-07-14T13:34:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.335431049, 2023-07-14T13:34:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.002020668 2023-07-14T13:34:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rename_latency": { 2023-07-14T13:34:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 911, 2023-07-14T13:34:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 114.525795586, 2023-07-14T13:34:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.125714374 2023-07-14T13:34:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: "req_renamesnap_latency": { 2023-07-14T13:34:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: "req_snapdiff_latency": { 2023-07-14T13:34:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmdir_latency": { 2023-07-14T13:34:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmsnap_latency": { 2023-07-14T13:34:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 29, 2023-07-14T13:34:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 3.333302285, 2023-07-14T13:34:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.114941458 2023-07-14T13:34:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmxattr_latency": { 2023-07-14T13:34:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setattr_latency": { 2023-07-14T13:34:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1, 2023-07-14T13:34:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000918732, 2023-07-14T13:34:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000918732 2023-07-14T13:34:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setdirlayout_latency": { 2023-07-14T13:34:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setfilelock_latency": { 2023-07-14T13:34:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setlayout_latency": { 2023-07-14T13:34:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setxattr_latency": { 2023-07-14T13:34:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 6, 2023-07-14T13:34:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.018627857, 2023-07-14T13:34:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.003104642 2023-07-14T13:34:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: "req_symlink_latency": { 2023-07-14T13:34:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: "req_unlink_latency": { 2023-07-14T13:34:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 158, 2023-07-14T13:34:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 1.107093970, 2023-07-14T13:34:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.007006923 2023-07-14T13:34:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_revoke_eviction": 0, 2023-07-14T13:34:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_acquisition_throttle": 0, 2023-07-14T13:34:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getvxattr_latency": { 2023-07-14T13:34:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:34:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_sessions": { 2023-07-14T13:34:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: "session_count": 2, 2023-07-14T13:34:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: "session_add": 5, 2023-07-14T13:34:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: "session_remove": 3, 2023-07-14T13:34:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_open": 2, 2023-07-14T13:34:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_stale": 0, 2023-07-14T13:34:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: "total_load": 653, 2023-07-14T13:34:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: "average_load": 326, 2023-07-14T13:34:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: "avg_session_uptime": 2112 2023-07-14T13:34:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2023-07-14T13:34:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 0, 2023-07-14T13:34:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 0, 2023-07-14T13:34:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:34:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:34:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:34:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:34:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:34:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:34:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:34:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:34:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:34:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:34:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:34:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:34:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:34:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2023-07-14T13:34:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:34:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2023-07-14T13:34:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:34:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:34:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:34:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:34:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:34:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:34:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:34:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2023-07-14T13:34:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:34:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:34:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:34:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2023-07-14T13:34:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2023-07-14T13:34:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2023-07-14T13:34:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:34:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:34:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:34:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:34:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 609453, 2023-07-14T13:34:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 186, 2023-07-14T13:34:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:34:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 0, 2023-07-14T13:34:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2023-07-14T13:34:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2023-07-14T13:34:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:34:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2023-07-14T13:34:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:34:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2023-07-14T13:34:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 7944, 2023-07-14T13:34:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 166, 2023-07-14T13:34:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:34:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:34:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2023-07-14T13:34:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2023-07-14T13:34:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 4411119, 2023-07-14T13:34:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 40420, 2023-07-14T13:34:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2023-07-14T13:34:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2023-07-14T13:34:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2023-07-14T13:34:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2023-07-14T13:34:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: "objecter": { 2023-07-14T13:34:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: "op_active": 0, 2023-07-14T13:34:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: "op_laggy": 0, 2023-07-14T13:34:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send": 17618, 2023-07-14T13:34:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send_bytes": 89600734, 2023-07-14T13:34:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: "op_resend": 31, 2023-07-14T13:34:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: "op_reply": 17618, 2023-07-14T13:34:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: "op_latency": { 2023-07-14T13:34:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 17618, 2023-07-14T13:34:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 169.330473837, 2023-07-14T13:34:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.009611219 2023-07-14T13:34:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: "op_inflight": 0, 2023-07-14T13:34:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: "oplen_avg": { 2023-07-14T13:34:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 17618, 2023-07-14T13:34:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 24675 2023-07-14T13:34:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: "op": 17618, 2023-07-14T13:34:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: "op_r": 2517, 2023-07-14T13:34:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: "op_w": 15101, 2023-07-14T13:34:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: "op_rmw": 0, 2023-07-14T13:34:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: "op_pg": 0, 2023-07-14T13:34:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_stat": 2213, 2023-07-14T13:34:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_create": 1320, 2023-07-14T13:34:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_read": 49, 2023-07-14T13:34:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_write": 9694, 2023-07-14T13:34:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writefull": 601, 2023-07-14T13:34:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writesame": 0, 2023-07-14T13:34:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_append": 0, 2023-07-14T13:34:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_zero": 0, 2023-07-14T13:34:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_truncate": 4, 2023-07-14T13:34:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_delete": 616, 2023-07-14T13:34:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_mapext": 0, 2023-07-14T13:34:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_sparse_read": 0, 2023-07-14T13:34:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_clonerange": 0, 2023-07-14T13:34:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_getxattr": 2371, 2023-07-14T13:34:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_setxattr": 2640, 2023-07-14T13:34:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_cmpxattr": 0, 2023-07-14T13:34:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_rmxattr": 0, 2023-07-14T13:34:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_resetxattrs": 0, 2023-07-14T13:34:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_call": 0, 2023-07-14T13:34:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_watch": 0, 2023-07-14T13:34:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_notify": 0, 2023-07-14T13:34:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T13:34:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls": 0, 2023-07-14T13:34:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls_filter": 0, 2023-07-14T13:34:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_other": 0, 2023-07-14T13:34:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_active": 0, 2023-07-14T13:34:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_send": 0, 2023-07-14T13:34:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_resend": 0, 2023-07-14T13:34:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_ping": 0, 2023-07-14T13:34:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_active": 0, 2023-07-14T13:34:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_send": 0, 2023-07-14T13:34:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_resend": 0, 2023-07-14T13:34:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_active": 0, 2023-07-14T13:34:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_send": 0, 2023-07-14T13:34:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_resend": 0, 2023-07-14T13:34:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_active": 0, 2023-07-14T13:34:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_send": 0, 2023-07-14T13:34:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_resend": 0, 2023-07-14T13:34:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: "command_active": 0, 2023-07-14T13:34:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: "command_send": 0, 2023-07-14T13:34:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: "command_resend": 0, 2023-07-14T13:34:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: "map_epoch": 147, 2023-07-14T13:34:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: "map_full": 0, 2023-07-14T13:34:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: "map_inc": 62, 2023-07-14T13:34:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_sessions": 12, 2023-07-14T13:34:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_open": 12, 2023-07-14T13:34:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_close": 0, 2023-07-14T13:34:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_laggy": 0, 2023-07-14T13:34:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_wr": 4648, 2023-07-14T13:34:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_rd": 149, 2023-07-14T13:34:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_del": 370 2023-07-14T13:34:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: "oft": { 2023-07-14T13:34:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_objs": 1, 2023-07-14T13:34:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_kv_pairs": 0, 2023-07-14T13:34:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_updates": 0, 2023-07-14T13:34:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_removes": 0 2023-07-14T13:34:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: "osd-slow-ops": { 2023-07-14T13:34:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_ops_count": 28535 2023-07-14T13:34:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: "purge_queue": { 2023-07-14T13:34:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops": 0, 2023-07-14T13:34:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops_high_water": 8, 2023-07-14T13:34:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing": 0, 2023-07-14T13:34:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_high_water": 8, 2023-07-14T13:34:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executed": 64, 2023-07-14T13:34:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_item_in_journal": 0 2023-07-14T13:34:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:34:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:34:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-07-14T13:34:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:34:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 6967851, 2023-07-14T13:34:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 513117884, 2023-07-14T13:34:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:34:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 6967851, 2023-07-14T13:34:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-07-14T13:34:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-07-14T13:34:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 6967851, 2023-07-14T13:34:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 513117884, 2023-07-14T13:34:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:34:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:34:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_bytes": { 2023-07-14T13:34:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:34:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-07-14T13:34:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:34:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-07-14T13:34:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-07-14T13:34:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:34:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-07-14T13:34:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 17618, 2023-07-14T13:34:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 89604568, 2023-07-14T13:34:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 17618, 2023-07-14T13:34:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 89604568, 2023-07-14T13:34:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:34:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:34:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_ops": { 2023-07-14T13:34:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:34:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 1024, 2023-07-14T13:34:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:34:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-07-14T13:34:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-07-14T13:34:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:34:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-07-14T13:34:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 17618, 2023-07-14T13:34:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 17618, 2023-07-14T13:34:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 17618, 2023-07-14T13:34:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 17618, 2023-07-14T13:34:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:34:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:34:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle": { 2023-07-14T13:34:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:34:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-07-14T13:34:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:34:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 64, 2023-07-14T13:34:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 6584, 2023-07-14T13:34:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:34:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 64, 2023-07-14T13:34:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-07-14T13:34:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-07-14T13:34:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 34, 2023-07-14T13:34:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 6584, 2023-07-14T13:34:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:34:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:34:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:34:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle-0x564c116440a0": { 2023-07-14T13:34:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:34:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-07-14T13:34:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:34:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 19464, 2023-07-14T13:34:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 81679688, 2023-07-14T13:34:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:34:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 19464, 2023-07-14T13:34:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-07-14T13:34:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-07-14T13:34:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 9660, 2023-07-14T13:34:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 81679688, 2023-07-14T13:34:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:34:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:34:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:34:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:34:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:34:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:34:58.933 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-07-14T13:34:59.324 INFO:tasks.check_counter:Daemon mds.b mds.exported=118 2023-07-14T13:34:59.324 INFO:tasks.check_counter:Daemon mds.b mds.imported=124 2023-07-14T13:34:59.325 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=114 2023-07-14T13:34:59.325 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=43 2023-07-14T13:34:59.325 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2023-07-14T13:34:59.325 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=35 2023-07-14T13:34:59.325 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=29 2023-07-14T13:34:59.325 DEBUG:tasks.check_counter:Getting stats from e 2023-07-14T13:34:59.326 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.e perf dump 2023-07-14T13:35:00.051 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T13:35:00.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:34:59 smithi135 ceph-mon[97338]: pgmap v1118: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-07-14T13:35:00.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:34:59 smithi131 ceph-mon[96953]: pgmap v1118: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-07-14T13:35:00.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:34:59 smithi017 ceph-mon[95536]: pgmap v1118: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 6 op/s 2023-07-14T13:35:01.592 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-07-14T13:35:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:35:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 3577, 2023-07-14T13:35:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 3517, 2023-07-14T13:35:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 53072750, 2023-07-14T13:35:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 1242910, 2023-07-14T13:35:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 7, 2023-07-14T13:35:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 3, 2023-07-14T13:35:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.503802309, 2023-07-14T13:35:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.170267551, 2023-07-14T13:35:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.205926046, 2023-07-14T13:35:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.101077923, 2023-07-14T13:35:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 3517, 2023-07-14T13:35:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.333070724, 2023-07-14T13:35:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000094703 2023-07-14T13:35:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 1789056, 2023-07-14T13:35:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 356560 2023-07-14T13:35:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:35:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 1328, 2023-07-14T13:35:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 1784, 2023-07-14T13:35:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 65765189, 2023-07-14T13:35:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 1379225, 2023-07-14T13:35:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 10, 2023-07-14T13:35:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 7, 2023-07-14T13:35:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.243990265, 2023-07-14T13:35:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.057265913, 2023-07-14T13:35:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.130795173, 2023-07-14T13:35:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.039122809, 2023-07-14T13:35:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1781, 2023-07-14T13:35:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.155950765, 2023-07-14T13:35:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000087563 2023-07-14T13:35:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 480, 2023-07-14T13:35:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 967088 2023-07-14T13:35:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:35:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 3649, 2023-07-14T13:35:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 3651, 2023-07-14T13:35:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 118488681, 2023-07-14T13:35:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 1134846, 2023-07-14T13:35:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 7, 2023-07-14T13:35:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 5, 2023-07-14T13:35:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.472784909, 2023-07-14T13:35:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.081487588, 2023-07-14T13:35:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.264607028, 2023-07-14T13:35:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.101054434, 2023-07-14T13:35:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 3649, 2023-07-14T13:35:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.189416853, 2023-07-14T13:35:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000051909 2023-07-14T13:35:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T13:35:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T13:35:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2023-07-14T13:35:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 1, 2023-07-14T13:35:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2023-07-14T13:35:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-MDSRank": { 2023-07-14T13:35:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-07-14T13:35:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-07-14T13:35:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 13245, 2023-07-14T13:35:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.363750035, 2023-07-14T13:35:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000027463 2023-07-14T13:35:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-PurgeQueue": { 2023-07-14T13:35:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-07-14T13:35:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-07-14T13:35:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": { 2023-07-14T13:35:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: "request": 0, 2023-07-14T13:35:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: "reply": 0, 2023-07-14T13:35:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: "reply_latency": { 2023-07-14T13:35:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_reply": 0, 2023-07-14T13:35:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: "forward": 0, 2023-07-14T13:35:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_complete": 0, 2023-07-14T13:35:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_keys": 0, 2023-07-14T13:35:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_commit": 0, 2023-07-14T13:35:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_split": 0, 2023-07-14T13:35:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_merge": 0, 2023-07-14T13:35:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes": 1168, 2023-07-14T13:35:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_top": 319, 2023-07-14T13:35:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_bottom": 593, 2023-07-14T13:35:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pin_tail": 256, 2023-07-14T13:35:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pinned": 711, 2023-07-14T13:35:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_expired": 0, 2023-07-14T13:35:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_with_caps": 0, 2023-07-14T13:35:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": 0, 2023-07-14T13:35:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: "subtrees": 8, 2023-07-14T13:35:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse": 0, 2023-07-14T13:35:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_hit": 0, 2023-07-14T13:35:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_forward": 0, 2023-07-14T13:35:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_discover": 0, 2023-07-14T13:35:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_dir_fetch": 0, 2023-07-14T13:35:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_remote_ino": 0, 2023-07-14T13:35:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_lock": 0, 2023-07-14T13:35:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: "load_cent": 0, 2023-07-14T13:35:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: "q": 0, 2023-07-14T13:35:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: "exported": 0, 2023-07-14T13:35:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: "exported_inodes": 0, 2023-07-14T13:35:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: "imported": 0, 2023-07-14T13:35:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: "imported_inodes": 0, 2023-07-14T13:35:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_dir_fetch": 0, 2023-07-14T13:35:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_backtrace_fetch": 0, 2023-07-14T13:35:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_peer_discover": 0, 2023-07-14T13:35:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rfiles": 0, 2023-07-14T13:35:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rbytes": 0, 2023-07-14T13:35:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rsnaps": 0, 2023-07-14T13:35:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_fetch": 0, 2023-07-14T13:35:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_set_tag": 0, 2023-07-14T13:35:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T13:35:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_inotable_repaired": 0, 2023-07-14T13:35:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_inodes": 0, 2023-07-14T13:35:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T13:35:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dirfrag_rstats": 0, 2023-07-14T13:35:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_file_inodes": 0, 2023-07-14T13:35:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_inode_file_caps": 0, 2023-07-14T13:35:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_revoke": 0, 2023-07-14T13:35:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_grant": 0, 2023-07-14T13:35:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T13:35:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T13:35:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T13:35:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps": 0, 2023-07-14T13:35:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps_dirty": 0, 2023-07-14T13:35:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_cap_release": 0, 2023-07-14T13:35:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: "process_request_cap_release": 0 2023-07-14T13:35:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_cache": { 2023-07-14T13:35:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update": 0, 2023-07-14T13:35:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update_receipt": 0, 2023-07-14T13:35:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_try_discover": 0, 2023-07-14T13:35:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_send_discover": 0, 2023-07-14T13:35:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_handle_discover": 0, 2023-07-14T13:35:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays": 0, 2023-07-14T13:35:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_delayed": 0, 2023-07-14T13:35:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_enqueuing": 0, 2023-07-14T13:35:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_created": 0, 2023-07-14T13:35:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_enqueued": 0, 2023-07-14T13:35:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_reintegrated": 0, 2023-07-14T13:35:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_migrated": 0, 2023-07-14T13:35:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_processing": 0, 2023-07-14T13:35:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_enqueued": 0, 2023-07-14T13:35:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_prioritized": 0, 2023-07-14T13:35:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_started": 0, 2023-07-14T13:35:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_completed": 0, 2023-07-14T13:35:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T13:35:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_exportdir": 0, 2023-07-14T13:35:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_flush": 0, 2023-07-14T13:35:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragmentdir": 0, 2023-07-14T13:35:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragstats": 0, 2023-07-14T13:35:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_inodestats": 0 2023-07-14T13:35:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_log": { 2023-07-14T13:35:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: "evadd": 0, 2023-07-14T13:35:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: "evex": 0, 2023-07-14T13:35:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: "evtrm": 0, 2023-07-14T13:35:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: "ev": 0, 2023-07-14T13:35:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: "evexg": 0, 2023-07-14T13:35:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: "evexd": 0, 2023-07-14T13:35:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: "segadd": 0, 2023-07-14T13:35:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: "segex": 0, 2023-07-14T13:35:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: "segtrm": 0, 2023-07-14T13:35:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: "seg": 62, 2023-07-14T13:35:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: "segexg": 0, 2023-07-14T13:35:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: "segexd": 0, 2023-07-14T13:35:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: "expos": 4194304, 2023-07-14T13:35:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: "wrpos": 0, 2023-07-14T13:35:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: "rdpos": 237224776, 2023-07-14T13:35:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: "jlat": { 2023-07-14T13:35:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: "replayed": 19749 2023-07-14T13:35:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_mem": { 2023-07-14T13:35:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: "ino": 480, 2023-07-14T13:35:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: "ino+": 3419, 2023-07-14T13:35:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: "ino-": 2939, 2023-07-14T13:35:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: "dir": 58, 2023-07-14T13:35:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: "dir+": 142, 2023-07-14T13:35:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: "dir-": 84, 2023-07-14T13:35:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: "dn": 1168, 2023-07-14T13:35:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: "dn+": 5425, 2023-07-14T13:35:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: "dn-": 4257, 2023-07-14T13:35:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: "cap": 0, 2023-07-14T13:35:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: "cap+": 0, 2023-07-14T13:35:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: "cap-": 0, 2023-07-14T13:35:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: "rss": 56444, 2023-07-14T13:35:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: "heap": 207156 2023-07-14T13:35:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_server": { 2023-07-14T13:35:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_client_request": 0, 2023-07-14T13:35:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_server_request": 0, 2023-07-14T13:35:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_request": 0, 2023-07-14T13:35:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_session": 0, 2023-07-14T13:35:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_peer_request": 0, 2023-07-14T13:35:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: "req_create_latency": { 2023-07-14T13:35:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getattr_latency": { 2023-07-14T13:35:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getfilelock_latency": { 2023-07-14T13:35:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: "req_link_latency": { 2023-07-14T13:35:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookup_latency": { 2023-07-14T13:35:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookuphash_latency": { 2023-07-14T13:35:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupino_latency": { 2023-07-14T13:35:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupname_latency": { 2023-07-14T13:35:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupparent_latency": { 2023-07-14T13:35:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupsnap_latency": { 2023-07-14T13:35:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lssnap_latency": { 2023-07-14T13:35:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mkdir_latency": { 2023-07-14T13:35:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mknod_latency": { 2023-07-14T13:35:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mksnap_latency": { 2023-07-14T13:35:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: "req_open_latency": { 2023-07-14T13:35:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: "req_readdir_latency": { 2023-07-14T13:35:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rename_latency": { 2023-07-14T13:35:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: "req_renamesnap_latency": { 2023-07-14T13:35:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: "req_snapdiff_latency": { 2023-07-14T13:35:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmdir_latency": { 2023-07-14T13:35:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmsnap_latency": { 2023-07-14T13:35:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmxattr_latency": { 2023-07-14T13:35:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setattr_latency": { 2023-07-14T13:35:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setdirlayout_latency": { 2023-07-14T13:35:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setfilelock_latency": { 2023-07-14T13:35:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setlayout_latency": { 2023-07-14T13:35:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setxattr_latency": { 2023-07-14T13:35:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: "req_symlink_latency": { 2023-07-14T13:35:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: "req_unlink_latency": { 2023-07-14T13:35:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_revoke_eviction": 0, 2023-07-14T13:35:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_acquisition_throttle": 0, 2023-07-14T13:35:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getvxattr_latency": { 2023-07-14T13:35:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_sessions": { 2023-07-14T13:35:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: "session_count": 1, 2023-07-14T13:35:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: "session_add": 1, 2023-07-14T13:35:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: "session_remove": 0, 2023-07-14T13:35:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_open": 1, 2023-07-14T13:35:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_stale": 0, 2023-07-14T13:35:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: "total_load": 0, 2023-07-14T13:35:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: "average_load": 0, 2023-07-14T13:35:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: "avg_session_uptime": 4098 2023-07-14T13:35:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2023-07-14T13:35:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 0, 2023-07-14T13:35:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 0, 2023-07-14T13:35:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:35:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:35:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:35:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:35:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:35:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:35:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:35:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:35:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:35:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:35:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:35:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:35:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:35:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2023-07-14T13:35:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:35:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2023-07-14T13:35:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:35:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:35:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:35:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:35:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:35:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:35:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:35:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2023-07-14T13:35:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:35:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:35:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:35:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2023-07-14T13:35:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2023-07-14T13:35:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2023-07-14T13:35:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:35:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:35:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:35:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:35:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 242634, 2023-07-14T13:35:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 89, 2023-07-14T13:35:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:35:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 0, 2023-07-14T13:35:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2023-07-14T13:35:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2023-07-14T13:35:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:35:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2023-07-14T13:35:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:35:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2023-07-14T13:35:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 7944, 2023-07-14T13:35:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 166, 2023-07-14T13:35:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:35:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:35:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2023-07-14T13:35:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2023-07-14T13:35:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 2374425, 2023-07-14T13:35:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 38069, 2023-07-14T13:35:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2023-07-14T13:35:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2023-07-14T13:35:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2023-07-14T13:35:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2023-07-14T13:35:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: "objecter": { 2023-07-14T13:35:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: "op_active": 0, 2023-07-14T13:35:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: "op_laggy": 0, 2023-07-14T13:35:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send": 7824, 2023-07-14T13:35:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send_bytes": 21, 2023-07-14T13:35:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: "op_resend": 3, 2023-07-14T13:35:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: "op_reply": 7824, 2023-07-14T13:35:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: "op_latency": { 2023-07-14T13:35:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 7824, 2023-07-14T13:35:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 12.695746186, 2023-07-14T13:35:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001622666 2023-07-14T13:35:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: "op_inflight": 0, 2023-07-14T13:35:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: "oplen_avg": { 2023-07-14T13:35:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 7824, 2023-07-14T13:35:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 7825 2023-07-14T13:35:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: "op": 7824, 2023-07-14T13:35:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: "op_r": 7824, 2023-07-14T13:35:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: "op_w": 0, 2023-07-14T13:35:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: "op_rmw": 0, 2023-07-14T13:35:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: "op_pg": 0, 2023-07-14T13:35:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_stat": 4368, 2023-07-14T13:35:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_create": 0, 2023-07-14T13:35:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_read": 3454, 2023-07-14T13:35:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_write": 0, 2023-07-14T13:35:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writefull": 0, 2023-07-14T13:35:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writesame": 0, 2023-07-14T13:35:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_append": 0, 2023-07-14T13:35:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_zero": 0, 2023-07-14T13:35:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_truncate": 0, 2023-07-14T13:35:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_delete": 0, 2023-07-14T13:35:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_mapext": 0, 2023-07-14T13:35:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_sparse_read": 0, 2023-07-14T13:35:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_clonerange": 0, 2023-07-14T13:35:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_getxattr": 1, 2023-07-14T13:35:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_setxattr": 0, 2023-07-14T13:35:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_cmpxattr": 0, 2023-07-14T13:35:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_rmxattr": 0, 2023-07-14T13:35:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_resetxattrs": 0, 2023-07-14T13:35:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_call": 0, 2023-07-14T13:35:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_watch": 0, 2023-07-14T13:35:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_notify": 0, 2023-07-14T13:35:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T13:35:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls": 0, 2023-07-14T13:35:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls_filter": 0, 2023-07-14T13:35:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_other": 0, 2023-07-14T13:35:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_active": 0, 2023-07-14T13:35:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_send": 0, 2023-07-14T13:35:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_resend": 0, 2023-07-14T13:35:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_ping": 0, 2023-07-14T13:35:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_active": 0, 2023-07-14T13:35:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_send": 0, 2023-07-14T13:35:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_resend": 0, 2023-07-14T13:35:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_active": 0, 2023-07-14T13:35:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_send": 0, 2023-07-14T13:35:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_resend": 0, 2023-07-14T13:35:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_active": 0, 2023-07-14T13:35:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_send": 0, 2023-07-14T13:35:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_resend": 0, 2023-07-14T13:35:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: "command_active": 0, 2023-07-14T13:35:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: "command_send": 0, 2023-07-14T13:35:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: "command_resend": 0, 2023-07-14T13:35:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: "map_epoch": 147, 2023-07-14T13:35:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: "map_full": 0, 2023-07-14T13:35:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: "map_inc": 61, 2023-07-14T13:35:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_sessions": 11, 2023-07-14T13:35:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_open": 12, 2023-07-14T13:35:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_close": 1, 2023-07-14T13:35:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_laggy": 0, 2023-07-14T13:35:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_wr": 0, 2023-07-14T13:35:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_rd": 2, 2023-07-14T13:35:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_del": 0 2023-07-14T13:35:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: "oft": { 2023-07-14T13:35:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_objs": 0, 2023-07-14T13:35:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_kv_pairs": 0, 2023-07-14T13:35:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_updates": 0, 2023-07-14T13:35:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_removes": 0 2023-07-14T13:35:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: "osd-slow-ops": { 2023-07-14T13:35:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_ops_count": 0 2023-07-14T13:35:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: "purge_queue": { 2023-07-14T13:35:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops": 0, 2023-07-14T13:35:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops_high_water": 0, 2023-07-14T13:35:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing": 0, 2023-07-14T13:35:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_high_water": 0, 2023-07-14T13:35:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executed": 0, 2023-07-14T13:35:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_item_in_journal": 0 2023-07-14T13:35:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:35:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:35:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-07-14T13:35:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:35:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 8550, 2023-07-14T13:35:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 236517434, 2023-07-14T13:35:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 8550, 2023-07-14T13:35:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-07-14T13:35:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-07-14T13:35:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 8550, 2023-07-14T13:35:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 236517434, 2023-07-14T13:35:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:35:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_bytes": { 2023-07-14T13:35:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:35:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-07-14T13:35:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:35:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-07-14T13:35:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-07-14T13:35:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 7824, 2023-07-14T13:35:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 233369424, 2023-07-14T13:35:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 7824, 2023-07-14T13:35:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 233369424, 2023-07-14T13:35:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:35:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_ops": { 2023-07-14T13:35:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:35:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 1024, 2023-07-14T13:35:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:35:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-07-14T13:35:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-07-14T13:35:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 7824, 2023-07-14T13:35:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 7824, 2023-07-14T13:35:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 7824, 2023-07-14T13:35:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 7824, 2023-07-14T13:35:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:35:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle": { 2023-07-14T13:35:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:35:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-07-14T13:35:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:35:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-07-14T13:35:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-07-14T13:35:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-07-14T13:35:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-07-14T13:35:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 0, 2023-07-14T13:35:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 0, 2023-07-14T13:35:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:35:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle-0x559c16d36500": { 2023-07-14T13:35:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:35:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-07-14T13:35:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:35:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-07-14T13:35:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-07-14T13:35:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-07-14T13:35:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-07-14T13:35:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 0, 2023-07-14T13:35:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 0, 2023-07-14T13:35:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:35:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:01.674 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-07-14T13:35:02.027 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-07-14T13:35:02.028 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-07-14T13:35:02.028 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-07-14T13:35:02.028 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-07-14T13:35:02.028 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2023-07-14T13:35:02.028 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-07-14T13:35:02.028 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-07-14T13:35:02.029 DEBUG:tasks.check_counter:Getting stats from h 2023-07-14T13:35:02.029 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.h perf dump 2023-07-14T13:35:02.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:01 smithi131 ceph-mon[96953]: pgmap v1119: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-07-14T13:35:02.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:01 smithi017 ceph-mon[95536]: pgmap v1119: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-07-14T13:35:02.412 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:01 smithi135 ceph-mon[97338]: pgmap v1119: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 8 op/s 2023-07-14T13:35:02.751 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T13:35:04.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:03 smithi131 ceph-mon[96953]: pgmap v1120: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-07-14T13:35:04.292 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-07-14T13:35:04.292 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:35:04.292 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 3527688, 2023-07-14T13:35:04.292 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 3533296, 2023-07-14T13:35:04.293 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 584238792, 2023-07-14T13:35:04.293 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 637353936, 2023-07-14T13:35:04.293 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 32, 2023-07-14T13:35:04.293 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 4, 2023-07-14T13:35:04.293 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 239.489625080, 2023-07-14T13:35:04.293 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 114.824263043, 2023-07-14T13:35:04.293 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 159.619174772, 2023-07-14T13:35:04.293 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.176248068, 2023-07-14T13:35:04.294 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:04.294 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 3533295, 2023-07-14T13:35:04.294 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 60.915729603, 2023-07-14T13:35:04.294 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000017240 2023-07-14T13:35:04.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.294 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:04.294 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 7040835, 2023-07-14T13:35:04.295 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.829861974, 2023-07-14T13:35:04.295 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000117 2023-07-14T13:35:04.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.295 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 1802496, 2023-07-14T13:35:04.295 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 384384 2023-07-14T13:35:04.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.296 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:35:04.296 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 628048, 2023-07-14T13:35:04.297 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 634006, 2023-07-14T13:35:04.297 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 111700482, 2023-07-14T13:35:04.297 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 179008157, 2023-07-14T13:35:04.297 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 18, 2023-07-14T13:35:04.298 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 5, 2023-07-14T13:35:04.298 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 29.348683233, 2023-07-14T13:35:04.298 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 12.193262563, 2023-07-14T13:35:04.298 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 19.923337938, 2023-07-14T13:35:04.299 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.138421583, 2023-07-14T13:35:04.299 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:04.299 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 634004, 2023-07-14T13:35:04.300 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 13.734801269, 2023-07-14T13:35:04.300 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000021663 2023-07-14T13:35:04.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.301 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:04.301 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1249741, 2023-07-14T13:35:04.301 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.135113681, 2023-07-14T13:35:04.302 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000108 2023-07-14T13:35:04.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.302 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 3440, 2023-07-14T13:35:04.302 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 971648 2023-07-14T13:35:04.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.303 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:35:04.303 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 59529, 2023-07-14T13:35:04.303 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 76098, 2023-07-14T13:35:04.304 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 18401040, 2023-07-14T13:35:04.304 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 138410198, 2023-07-14T13:35:04.304 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 13, 2023-07-14T13:35:04.304 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 5, 2023-07-14T13:35:04.305 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 5.611651145, 2023-07-14T13:35:04.305 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 2.410511741, 2023-07-14T13:35:04.305 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 3.593762243, 2023-07-14T13:35:04.305 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.160355796, 2023-07-14T13:35:04.306 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:04.306 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 76096, 2023-07-14T13:35:04.306 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 6.495003511, 2023-07-14T13:35:04.307 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000085352 2023-07-14T13:35:04.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.307 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:04.307 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 116264, 2023-07-14T13:35:04.307 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.028361076, 2023-07-14T13:35:04.307 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000243 2023-07-14T13:35:04.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.308 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T13:35:04.308 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T13:35:04.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.308 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2023-07-14T13:35:04.308 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 1, 2023-07-14T13:35:04.309 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2023-07-14T13:35:04.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.309 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-MDSRank": { 2023-07-14T13:35:04.309 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-07-14T13:35:04.309 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-07-14T13:35:04.309 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 22428, 2023-07-14T13:35:04.310 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 9.856407366, 2023-07-14T13:35:04.310 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000439468 2023-07-14T13:35:04.310 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:04.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.310 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-PurgeQueue": { 2023-07-14T13:35:04.311 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-07-14T13:35:04.311 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-07-14T13:35:04.311 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 603, 2023-07-14T13:35:04.311 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.036301201, 2023-07-14T13:35:04.311 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000060200 2023-07-14T13:35:04.311 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:04.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.312 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": { 2023-07-14T13:35:04.312 INFO:teuthology.orchestra.run.smithi131.stdout: "request": 28252, 2023-07-14T13:35:04.312 INFO:teuthology.orchestra.run.smithi131.stdout: "reply": 25092, 2023-07-14T13:35:04.312 INFO:teuthology.orchestra.run.smithi131.stdout: "reply_latency": { 2023-07-14T13:35:04.312 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 25092, 2023-07-14T13:35:04.313 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 1163.428555782, 2023-07-14T13:35:04.313 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.046366513 2023-07-14T13:35:04.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.313 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_reply": 0, 2023-07-14T13:35:04.313 INFO:teuthology.orchestra.run.smithi131.stdout: "forward": 3153, 2023-07-14T13:35:04.313 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_complete": 44, 2023-07-14T13:35:04.314 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_keys": 0, 2023-07-14T13:35:04.314 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_commit": 35, 2023-07-14T13:35:04.314 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_split": 3, 2023-07-14T13:35:04.314 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_merge": 0, 2023-07-14T13:35:04.314 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes": 986, 2023-07-14T13:35:04.314 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_top": 171, 2023-07-14T13:35:04.314 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_bottom": 393, 2023-07-14T13:35:04.315 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pin_tail": 422, 2023-07-14T13:35:04.315 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pinned": 702, 2023-07-14T13:35:04.315 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_expired": 4970, 2023-07-14T13:35:04.315 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_with_caps": 196, 2023-07-14T13:35:04.315 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": 196, 2023-07-14T13:35:04.315 INFO:teuthology.orchestra.run.smithi131.stdout: "subtrees": 29, 2023-07-14T13:35:04.316 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse": 96605, 2023-07-14T13:35:04.316 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_hit": 80179, 2023-07-14T13:35:04.316 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_forward": 2901, 2023-07-14T13:35:04.316 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_discover": 354, 2023-07-14T13:35:04.316 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_dir_fetch": 5, 2023-07-14T13:35:04.316 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_remote_ino": 0, 2023-07-14T13:35:04.317 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_lock": 7751, 2023-07-14T13:35:04.317 INFO:teuthology.orchestra.run.smithi131.stdout: "load_cent": 2864, 2023-07-14T13:35:04.317 INFO:teuthology.orchestra.run.smithi131.stdout: "q": 0, 2023-07-14T13:35:04.317 INFO:teuthology.orchestra.run.smithi131.stdout: "exported": 110, 2023-07-14T13:35:04.317 INFO:teuthology.orchestra.run.smithi131.stdout: "exported_inodes": 3867, 2023-07-14T13:35:04.317 INFO:teuthology.orchestra.run.smithi131.stdout: "imported": 106, 2023-07-14T13:35:04.318 INFO:teuthology.orchestra.run.smithi131.stdout: "imported_inodes": 3841, 2023-07-14T13:35:04.318 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_dir_fetch": 0, 2023-07-14T13:35:04.318 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_backtrace_fetch": 1501, 2023-07-14T13:35:04.318 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_peer_discover": 0, 2023-07-14T13:35:04.318 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rfiles": 1046, 2023-07-14T13:35:04.318 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rbytes": 8949455257, 2023-07-14T13:35:04.319 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rsnaps": 6, 2023-07-14T13:35:04.319 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_fetch": 1501, 2023-07-14T13:35:04.319 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_set_tag": 0, 2023-07-14T13:35:04.319 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T13:35:04.319 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_inotable_repaired": 0, 2023-07-14T13:35:04.319 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_inodes": 186, 2023-07-14T13:35:04.320 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T13:35:04.320 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dirfrag_rstats": 186, 2023-07-14T13:35:04.320 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_file_inodes": 1315, 2023-07-14T13:35:04.320 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_inode_file_caps": 903, 2023-07-14T13:35:04.320 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_revoke": 19364, 2023-07-14T13:35:04.320 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_grant": 13905, 2023-07-14T13:35:04.321 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T13:35:04.321 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T13:35:04.321 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T13:35:04.321 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps": 27575, 2023-07-14T13:35:04.321 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps_dirty": 7401, 2023-07-14T13:35:04.321 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_cap_release": 372, 2023-07-14T13:35:04.322 INFO:teuthology.orchestra.run.smithi131.stdout: "process_request_cap_release": 1944 2023-07-14T13:35:04.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.322 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_cache": { 2023-07-14T13:35:04.322 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update": 88, 2023-07-14T13:35:04.322 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update_receipt": 140, 2023-07-14T13:35:04.322 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_try_discover": 80, 2023-07-14T13:35:04.322 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_send_discover": 422, 2023-07-14T13:35:04.323 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_handle_discover": 498, 2023-07-14T13:35:04.323 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays": 0, 2023-07-14T13:35:04.323 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_delayed": 0, 2023-07-14T13:35:04.323 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_enqueuing": 0, 2023-07-14T13:35:04.323 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_created": 547, 2023-07-14T13:35:04.323 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_enqueued": 148, 2023-07-14T13:35:04.324 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_reintegrated": 1961, 2023-07-14T13:35:04.324 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_migrated": 145, 2023-07-14T13:35:04.324 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_processing": 0, 2023-07-14T13:35:04.324 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_enqueued": 0, 2023-07-14T13:35:04.324 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_prioritized": 0, 2023-07-14T13:35:04.324 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_started": 0, 2023-07-14T13:35:04.325 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_completed": 0, 2023-07-14T13:35:04.325 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T13:35:04.325 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_exportdir": 125, 2023-07-14T13:35:04.325 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_flush": 0, 2023-07-14T13:35:04.325 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragmentdir": 3, 2023-07-14T13:35:04.326 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragstats": 0, 2023-07-14T13:35:04.326 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_inodestats": 0 2023-07-14T13:35:04.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.326 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_log": { 2023-07-14T13:35:04.326 INFO:teuthology.orchestra.run.smithi131.stdout: "evadd": 19749, 2023-07-14T13:35:04.326 INFO:teuthology.orchestra.run.smithi131.stdout: "evex": 0, 2023-07-14T13:35:04.327 INFO:teuthology.orchestra.run.smithi131.stdout: "evtrm": 0, 2023-07-14T13:35:04.327 INFO:teuthology.orchestra.run.smithi131.stdout: "ev": 19749, 2023-07-14T13:35:04.327 INFO:teuthology.orchestra.run.smithi131.stdout: "evexg": 0, 2023-07-14T13:35:04.327 INFO:teuthology.orchestra.run.smithi131.stdout: "evexd": 0, 2023-07-14T13:35:04.327 INFO:teuthology.orchestra.run.smithi131.stdout: "segadd": 62, 2023-07-14T13:35:04.327 INFO:teuthology.orchestra.run.smithi131.stdout: "segex": 0, 2023-07-14T13:35:04.327 INFO:teuthology.orchestra.run.smithi131.stdout: "segtrm": 0, 2023-07-14T13:35:04.328 INFO:teuthology.orchestra.run.smithi131.stdout: "seg": 62, 2023-07-14T13:35:04.328 INFO:teuthology.orchestra.run.smithi131.stdout: "segexg": 0, 2023-07-14T13:35:04.328 INFO:teuthology.orchestra.run.smithi131.stdout: "segexd": 0, 2023-07-14T13:35:04.328 INFO:teuthology.orchestra.run.smithi131.stdout: "expos": 4194304, 2023-07-14T13:35:04.328 INFO:teuthology.orchestra.run.smithi131.stdout: "wrpos": 237314411, 2023-07-14T13:35:04.328 INFO:teuthology.orchestra.run.smithi131.stdout: "rdpos": 0, 2023-07-14T13:35:04.328 INFO:teuthology.orchestra.run.smithi131.stdout: "jlat": { 2023-07-14T13:35:04.329 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 10758, 2023-07-14T13:35:04.329 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 65.769154221, 2023-07-14T13:35:04.329 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.006113511 2023-07-14T13:35:04.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.329 INFO:teuthology.orchestra.run.smithi131.stdout: "replayed": 0 2023-07-14T13:35:04.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.329 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_mem": { 2023-07-14T13:35:04.330 INFO:teuthology.orchestra.run.smithi131.stdout: "ino": 417, 2023-07-14T13:35:04.330 INFO:teuthology.orchestra.run.smithi131.stdout: "ino+": 3342, 2023-07-14T13:35:04.330 INFO:teuthology.orchestra.run.smithi131.stdout: "ino-": 2925, 2023-07-14T13:35:04.330 INFO:teuthology.orchestra.run.smithi131.stdout: "dir": 132, 2023-07-14T13:35:04.330 INFO:teuthology.orchestra.run.smithi131.stdout: "dir+": 246, 2023-07-14T13:35:04.330 INFO:teuthology.orchestra.run.smithi131.stdout: "dir-": 114, 2023-07-14T13:35:04.330 INFO:teuthology.orchestra.run.smithi131.stdout: "dn": 987, 2023-07-14T13:35:04.330 INFO:teuthology.orchestra.run.smithi131.stdout: "dn+": 6148, 2023-07-14T13:35:04.331 INFO:teuthology.orchestra.run.smithi131.stdout: "dn-": 5161, 2023-07-14T13:35:04.331 INFO:teuthology.orchestra.run.smithi131.stdout: "cap": 196, 2023-07-14T13:35:04.331 INFO:teuthology.orchestra.run.smithi131.stdout: "cap+": 1604, 2023-07-14T13:35:04.331 INFO:teuthology.orchestra.run.smithi131.stdout: "cap-": 1408, 2023-07-14T13:35:04.331 INFO:teuthology.orchestra.run.smithi131.stdout: "rss": 67632, 2023-07-14T13:35:04.331 INFO:teuthology.orchestra.run.smithi131.stdout: "heap": 198964 2023-07-14T13:35:04.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.332 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_server": { 2023-07-14T13:35:04.332 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_client_request": 71374, 2023-07-14T13:35:04.332 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_server_request": 12067, 2023-07-14T13:35:04.332 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_request": 28252, 2023-07-14T13:35:04.332 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_session": 308, 2023-07-14T13:35:04.332 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_peer_request": 23332, 2023-07-14T13:35:04.332 INFO:teuthology.orchestra.run.smithi131.stdout: "req_create_latency": { 2023-07-14T13:35:04.333 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 219, 2023-07-14T13:35:04.333 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.379875048, 2023-07-14T13:35:04.333 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001734589 2023-07-14T13:35:04.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.333 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getattr_latency": { 2023-07-14T13:35:04.333 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1134, 2023-07-14T13:35:04.333 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 2.462403463, 2023-07-14T13:35:04.334 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.002171431 2023-07-14T13:35:04.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.334 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getfilelock_latency": { 2023-07-14T13:35:04.334 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.334 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.334 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.335 INFO:teuthology.orchestra.run.smithi131.stdout: "req_link_latency": { 2023-07-14T13:35:04.335 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 418, 2023-07-14T13:35:04.335 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 4.147446350, 2023-07-14T13:35:04.335 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.009922120 2023-07-14T13:35:04.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.335 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookup_latency": { 2023-07-14T13:35:04.335 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 15203, 2023-07-14T13:35:04.336 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 636.170818214, 2023-07-14T13:35:04.336 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.041845084 2023-07-14T13:35:04.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.336 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookuphash_latency": { 2023-07-14T13:35:04.336 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.336 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.336 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.337 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupino_latency": { 2023-07-14T13:35:04.337 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.337 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.337 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.337 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupname_latency": { 2023-07-14T13:35:04.338 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.338 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.338 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.338 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupparent_latency": { 2023-07-14T13:35:04.338 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.338 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.339 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.339 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupsnap_latency": { 2023-07-14T13:35:04.339 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.339 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.339 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.340 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lssnap_latency": { 2023-07-14T13:35:04.340 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.340 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.340 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.340 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mkdir_latency": { 2023-07-14T13:35:04.340 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.341 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.341 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.341 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mknod_latency": { 2023-07-14T13:35:04.341 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.341 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.342 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.342 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mksnap_latency": { 2023-07-14T13:35:04.342 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.342 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.342 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.342 INFO:teuthology.orchestra.run.smithi131.stdout: "req_open_latency": { 2023-07-14T13:35:04.343 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 5303, 2023-07-14T13:35:04.343 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 145.821324128, 2023-07-14T13:35:04.343 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.027497892 2023-07-14T13:35:04.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.343 INFO:teuthology.orchestra.run.smithi131.stdout: "req_readdir_latency": { 2023-07-14T13:35:04.343 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 145, 2023-07-14T13:35:04.343 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.223305984, 2023-07-14T13:35:04.344 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001540041 2023-07-14T13:35:04.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.344 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rename_latency": { 2023-07-14T13:35:04.344 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 2263, 2023-07-14T13:35:04.344 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 372.360171989, 2023-07-14T13:35:04.344 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.164542718 2023-07-14T13:35:04.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.345 INFO:teuthology.orchestra.run.smithi131.stdout: "req_renamesnap_latency": { 2023-07-14T13:35:04.345 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.345 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.345 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.345 INFO:teuthology.orchestra.run.smithi131.stdout: "req_snapdiff_latency": { 2023-07-14T13:35:04.345 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.346 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.346 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.346 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmdir_latency": { 2023-07-14T13:35:04.346 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.346 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.346 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.347 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmsnap_latency": { 2023-07-14T13:35:04.347 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.347 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.347 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.347 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmxattr_latency": { 2023-07-14T13:35:04.348 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.348 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.348 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.348 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setattr_latency": { 2023-07-14T13:35:04.348 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.349 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.349 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.349 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setdirlayout_latency": { 2023-07-14T13:35:04.349 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.349 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.349 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.350 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setfilelock_latency": { 2023-07-14T13:35:04.350 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.350 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.350 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.350 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setlayout_latency": { 2023-07-14T13:35:04.350 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.351 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.351 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.351 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setxattr_latency": { 2023-07-14T13:35:04.351 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.351 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.351 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.352 INFO:teuthology.orchestra.run.smithi131.stdout: "req_symlink_latency": { 2023-07-14T13:35:04.352 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.352 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.352 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.352 INFO:teuthology.orchestra.run.smithi131.stdout: "req_unlink_latency": { 2023-07-14T13:35:04.353 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 407, 2023-07-14T13:35:04.353 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 1.863210606, 2023-07-14T13:35:04.353 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.004577913 2023-07-14T13:35:04.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.353 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_revoke_eviction": 0, 2023-07-14T13:35:04.353 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_acquisition_throttle": 0, 2023-07-14T13:35:04.354 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getvxattr_latency": { 2023-07-14T13:35:04.354 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.354 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.354 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.354 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:04.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.354 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_sessions": { 2023-07-14T13:35:04.355 INFO:teuthology.orchestra.run.smithi131.stdout: "session_count": 1, 2023-07-14T13:35:04.355 INFO:teuthology.orchestra.run.smithi131.stdout: "session_add": 1, 2023-07-14T13:35:04.355 INFO:teuthology.orchestra.run.smithi131.stdout: "session_remove": 0, 2023-07-14T13:35:04.355 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_open": 1, 2023-07-14T13:35:04.355 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_stale": 0, 2023-07-14T13:35:04.355 INFO:teuthology.orchestra.run.smithi131.stdout: "total_load": 1260, 2023-07-14T13:35:04.355 INFO:teuthology.orchestra.run.smithi131.stdout: "average_load": 1260, 2023-07-14T13:35:04.356 INFO:teuthology.orchestra.run.smithi131.stdout: "avg_session_uptime": 2138 2023-07-14T13:35:04.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.356 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2023-07-14T13:35:04.356 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 360, 2023-07-14T13:35:04.356 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 360, 2023-07-14T13:35:04.356 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:35:04.356 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:35:04.357 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:35:04.357 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:35:04.357 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:35:04.357 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:35:04.357 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:35:04.357 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:35:04.357 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:35:04.358 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:35:04.358 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:35:04.358 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:35:04.358 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:35:04.358 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2023-07-14T13:35:04.358 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:35:04.358 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2023-07-14T13:35:04.358 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:35:04.359 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:35:04.359 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:35:04.359 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:35:04.359 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:35:04.359 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:35:04.359 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:35:04.359 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2023-07-14T13:35:04.360 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:35:04.360 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:35:04.360 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:35:04.360 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2023-07-14T13:35:04.360 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2023-07-14T13:35:04.360 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2023-07-14T13:35:04.361 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:35:04.361 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:35:04.361 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:35:04.361 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:35:04.361 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 746553, 2023-07-14T13:35:04.361 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 221, 2023-07-14T13:35:04.361 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:35:04.362 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 0, 2023-07-14T13:35:04.362 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2023-07-14T13:35:04.362 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2023-07-14T13:35:04.362 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:35:04.362 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2023-07-14T13:35:04.362 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:35:04.362 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2023-07-14T13:35:04.363 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 7944, 2023-07-14T13:35:04.363 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 166, 2023-07-14T13:35:04.363 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:35:04.363 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:35:04.363 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2023-07-14T13:35:04.363 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2023-07-14T13:35:04.363 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 2471674, 2023-07-14T13:35:04.364 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 56656, 2023-07-14T13:35:04.364 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2023-07-14T13:35:04.364 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2023-07-14T13:35:04.364 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2023-07-14T13:35:04.364 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2023-07-14T13:35:04.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.364 INFO:teuthology.orchestra.run.smithi131.stdout: "objecter": { 2023-07-14T13:35:04.365 INFO:teuthology.orchestra.run.smithi131.stdout: "op_active": 0, 2023-07-14T13:35:04.365 INFO:teuthology.orchestra.run.smithi131.stdout: "op_laggy": 0, 2023-07-14T13:35:04.365 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send": 13377, 2023-07-14T13:35:04.365 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send_bytes": 233509341, 2023-07-14T13:35:04.365 INFO:teuthology.orchestra.run.smithi131.stdout: "op_resend": 27, 2023-07-14T13:35:04.365 INFO:teuthology.orchestra.run.smithi131.stdout: "op_reply": 13377, 2023-07-14T13:35:04.366 INFO:teuthology.orchestra.run.smithi131.stdout: "op_latency": { 2023-07-14T13:35:04.366 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 13377, 2023-07-14T13:35:04.366 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 74.494513978, 2023-07-14T13:35:04.366 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.005568850 2023-07-14T13:35:04.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.366 INFO:teuthology.orchestra.run.smithi131.stdout: "op_inflight": 0, 2023-07-14T13:35:04.366 INFO:teuthology.orchestra.run.smithi131.stdout: "oplen_avg": { 2023-07-14T13:35:04.367 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 13377, 2023-07-14T13:35:04.367 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 14120 2023-07-14T13:35:04.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.367 INFO:teuthology.orchestra.run.smithi131.stdout: "op": 13377, 2023-07-14T13:35:04.367 INFO:teuthology.orchestra.run.smithi131.stdout: "op_r": 1709, 2023-07-14T13:35:04.367 INFO:teuthology.orchestra.run.smithi131.stdout: "op_w": 11668, 2023-07-14T13:35:04.367 INFO:teuthology.orchestra.run.smithi131.stdout: "op_rmw": 0, 2023-07-14T13:35:04.368 INFO:teuthology.orchestra.run.smithi131.stdout: "op_pg": 0, 2023-07-14T13:35:04.368 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_stat": 0, 2023-07-14T13:35:04.368 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_create": 10, 2023-07-14T13:35:04.368 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_read": 80, 2023-07-14T13:35:04.368 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_write": 10838, 2023-07-14T13:35:04.368 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writefull": 199, 2023-07-14T13:35:04.368 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writesame": 0, 2023-07-14T13:35:04.369 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_append": 0, 2023-07-14T13:35:04.369 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_zero": 0, 2023-07-14T13:35:04.369 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_truncate": 1, 2023-07-14T13:35:04.369 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_delete": 217, 2023-07-14T13:35:04.369 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_mapext": 0, 2023-07-14T13:35:04.369 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_sparse_read": 0, 2023-07-14T13:35:04.369 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_clonerange": 0, 2023-07-14T13:35:04.370 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_getxattr": 1515, 2023-07-14T13:35:04.370 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_setxattr": 20, 2023-07-14T13:35:04.370 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_cmpxattr": 0, 2023-07-14T13:35:04.370 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_rmxattr": 0, 2023-07-14T13:35:04.370 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_resetxattrs": 0, 2023-07-14T13:35:04.370 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_call": 0, 2023-07-14T13:35:04.371 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_watch": 0, 2023-07-14T13:35:04.371 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_notify": 0, 2023-07-14T13:35:04.371 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T13:35:04.371 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls": 0, 2023-07-14T13:35:04.371 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls_filter": 0, 2023-07-14T13:35:04.371 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_other": 0, 2023-07-14T13:35:04.371 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_active": 0, 2023-07-14T13:35:04.372 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_send": 0, 2023-07-14T13:35:04.372 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_resend": 0, 2023-07-14T13:35:04.372 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_ping": 0, 2023-07-14T13:35:04.372 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_active": 0, 2023-07-14T13:35:04.372 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_send": 0, 2023-07-14T13:35:04.372 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_resend": 0, 2023-07-14T13:35:04.372 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_active": 0, 2023-07-14T13:35:04.373 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_send": 0, 2023-07-14T13:35:04.373 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_resend": 0, 2023-07-14T13:35:04.373 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_active": 0, 2023-07-14T13:35:04.373 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_send": 0, 2023-07-14T13:35:04.373 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_resend": 0, 2023-07-14T13:35:04.373 INFO:teuthology.orchestra.run.smithi131.stdout: "command_active": 0, 2023-07-14T13:35:04.373 INFO:teuthology.orchestra.run.smithi131.stdout: "command_send": 0, 2023-07-14T13:35:04.374 INFO:teuthology.orchestra.run.smithi131.stdout: "command_resend": 0, 2023-07-14T13:35:04.374 INFO:teuthology.orchestra.run.smithi131.stdout: "map_epoch": 147, 2023-07-14T13:35:04.374 INFO:teuthology.orchestra.run.smithi131.stdout: "map_full": 0, 2023-07-14T13:35:04.374 INFO:teuthology.orchestra.run.smithi131.stdout: "map_inc": 61, 2023-07-14T13:35:04.374 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_sessions": 12, 2023-07-14T13:35:04.374 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_open": 12, 2023-07-14T13:35:04.375 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_close": 0, 2023-07-14T13:35:04.375 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_laggy": 0, 2023-07-14T13:35:04.375 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_wr": 764, 2023-07-14T13:35:04.375 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_rd": 172, 2023-07-14T13:35:04.375 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_del": 304 2023-07-14T13:35:04.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.375 INFO:teuthology.orchestra.run.smithi131.stdout: "oft": { 2023-07-14T13:35:04.375 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_objs": 1, 2023-07-14T13:35:04.376 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_kv_pairs": 0, 2023-07-14T13:35:04.376 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_updates": 0, 2023-07-14T13:35:04.376 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_removes": 0 2023-07-14T13:35:04.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.376 INFO:teuthology.orchestra.run.smithi131.stdout: "osd-slow-ops": { 2023-07-14T13:35:04.376 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_ops_count": 33198 2023-07-14T13:35:04.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.377 INFO:teuthology.orchestra.run.smithi131.stdout: "purge_queue": { 2023-07-14T13:35:04.377 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops": 0, 2023-07-14T13:35:04.377 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops_high_water": 10, 2023-07-14T13:35:04.377 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing": 0, 2023-07-14T13:35:04.377 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_high_water": 10, 2023-07-14T13:35:04.377 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executed": 148, 2023-07-14T13:35:04.378 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_item_in_journal": 0 2023-07-14T13:35:04.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.378 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:35:04.378 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:35:04.378 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-07-14T13:35:04.378 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:35:04.378 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 4215261, 2023-07-14T13:35:04.379 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 334924706, 2023-07-14T13:35:04.379 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:04.379 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 4215261, 2023-07-14T13:35:04.379 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-07-14T13:35:04.379 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-07-14T13:35:04.379 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 4215261, 2023-07-14T13:35:04.379 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 334924706, 2023-07-14T13:35:04.380 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:35:04.380 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.380 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.380 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:04.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.380 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_bytes": { 2023-07-14T13:35:04.381 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:35:04.381 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-07-14T13:35:04.381 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:35:04.381 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-07-14T13:35:04.381 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-07-14T13:35:04.381 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:04.381 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:04.382 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 13377, 2023-07-14T13:35:04.382 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 233521269, 2023-07-14T13:35:04.382 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 13377, 2023-07-14T13:35:04.382 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 233521269, 2023-07-14T13:35:04.382 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:35:04.382 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.382 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.383 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.383 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:04.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.383 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_ops": { 2023-07-14T13:35:04.383 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:35:04.383 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 1024, 2023-07-14T13:35:04.383 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:35:04.384 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-07-14T13:35:04.384 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-07-14T13:35:04.384 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:04.384 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:04.384 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 13377, 2023-07-14T13:35:04.384 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 13377, 2023-07-14T13:35:04.384 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 13377, 2023-07-14T13:35:04.385 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 13377, 2023-07-14T13:35:04.385 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:35:04.385 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.385 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.385 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.385 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:04.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.386 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle": { 2023-07-14T13:35:04.386 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:35:04.386 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-07-14T13:35:04.386 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:35:04.386 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 148, 2023-07-14T13:35:04.386 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 15500, 2023-07-14T13:35:04.387 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:04.387 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 148, 2023-07-14T13:35:04.387 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-07-14T13:35:04.387 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-07-14T13:35:04.387 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 80, 2023-07-14T13:35:04.387 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 15500, 2023-07-14T13:35:04.387 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:35:04.388 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.388 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.388 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.388 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:04.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:04.388 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle-0x557fa0eb80a0": { 2023-07-14T13:35:04.388 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:35:04.388 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-07-14T13:35:04.389 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:35:04.389 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 19749, 2023-07-14T13:35:04.389 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 233120107, 2023-07-14T13:35:04.389 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:04.389 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 19749, 2023-07-14T13:35:04.389 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-07-14T13:35:04.389 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-07-14T13:35:04.390 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 10758, 2023-07-14T13:35:04.390 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 233120107, 2023-07-14T13:35:04.390 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:35:04.390 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:04.390 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:04.390 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:04.390 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:04.391 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:04.391 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-07-14T13:35:04.391 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:03 smithi017 ceph-mon[95536]: pgmap v1120: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-07-14T13:35:04.412 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:03 smithi135 ceph-mon[97338]: pgmap v1120: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 55 KiB/s wr, 11 op/s 2023-07-14T13:35:04.722 INFO:tasks.check_counter:Daemon mds.h mds.exported=110 2023-07-14T13:35:04.722 INFO:tasks.check_counter:Daemon mds.h mds.imported=106 2023-07-14T13:35:04.722 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=88 2023-07-14T13:35:04.723 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=140 2023-07-14T13:35:04.723 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2023-07-14T13:35:04.723 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-07-14T13:35:04.723 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-07-14T13:35:04.723 DEBUG:tasks.check_counter:Getting stats from k 2023-07-14T13:35:04.724 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.k perf dump 2023-07-14T13:35:05.454 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T13:35:06.023 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:05 smithi131 ceph-mon[96953]: pgmap v1121: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-07-14T13:35:06.024 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:05 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:35:06.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:05 smithi017 ceph-mon[95536]: pgmap v1121: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-07-14T13:35:06.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:05 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:35:06.412 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:05 smithi135 ceph-mon[97338]: pgmap v1121: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 54 KiB/s wr, 9 op/s 2023-07-14T13:35:06.412 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:05 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:35:06.960 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-07-14T13:35:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:35:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 4, 2023-07-14T13:35:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 4, 2023-07-14T13:35:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 2960, 2023-07-14T13:35:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 448, 2023-07-14T13:35:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 4, 2023-07-14T13:35:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 0, 2023-07-14T13:35:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.003567106, 2023-07-14T13:35:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.000069089, 2023-07-14T13:35:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.001146838, 2023-07-14T13:35:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:35:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 3, 2023-07-14T13:35:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.001312532, 2023-07-14T13:35:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000437510 2023-07-14T13:35:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-07-14T13:35:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 448 2023-07-14T13:35:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:35:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 4, 2023-07-14T13:35:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 463, 2023-07-14T13:35:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 640, 2023-07-14T13:35:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 325120, 2023-07-14T13:35:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 7, 2023-07-14T13:35:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 3, 2023-07-14T13:35:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.027879001, 2023-07-14T13:35:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.018884863, 2023-07-14T13:35:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.003396660, 2023-07-14T13:35:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:35:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 460, 2023-07-14T13:35:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.038517748, 2023-07-14T13:35:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000083734 2023-07-14T13:35:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 640, 2023-07-14T13:35:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 325120 2023-07-14T13:35:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:35:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 614, 2023-07-14T13:35:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 604, 2023-07-14T13:35:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 1534768, 2023-07-14T13:35:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 347072, 2023-07-14T13:35:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 2, 2023-07-14T13:35:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 1, 2023-07-14T13:35:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.105214255, 2023-07-14T13:35:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.042104752, 2023-07-14T13:35:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.050634065, 2023-07-14T13:35:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.014937726, 2023-07-14T13:35:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 603, 2023-07-14T13:35:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.049509649, 2023-07-14T13:35:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000082105 2023-07-14T13:35:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 1534768, 2023-07-14T13:35:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 347072 2023-07-14T13:35:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2023-07-14T13:35:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 0, 2023-07-14T13:35:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2023-07-14T13:35:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2023-07-14T13:35:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 0, 2023-07-14T13:35:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 0, 2023-07-14T13:35:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:35:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:35:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:35:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:35:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:35:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:35:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:35:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:35:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:35:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:35:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:35:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:35:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:35:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2023-07-14T13:35:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:35:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2023-07-14T13:35:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:35:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:35:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:35:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:35:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:35:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:35:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:35:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2023-07-14T13:35:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:35:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:35:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:35:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2023-07-14T13:35:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2023-07-14T13:35:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2023-07-14T13:35:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:35:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:35:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:35:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:35:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 148754, 2023-07-14T13:35:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 31, 2023-07-14T13:35:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:35:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 0, 2023-07-14T13:35:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2023-07-14T13:35:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2023-07-14T13:35:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:35:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2023-07-14T13:35:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:35:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2023-07-14T13:35:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 0, 2023-07-14T13:35:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 0, 2023-07-14T13:35:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:35:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:35:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2023-07-14T13:35:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2023-07-14T13:35:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 928, 2023-07-14T13:35:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 2, 2023-07-14T13:35:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2023-07-14T13:35:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2023-07-14T13:35:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2023-07-14T13:35:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2023-07-14T13:35:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-07-14T13:35:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:35:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-07-14T13:35:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-07-14T13:35:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-07-14T13:35:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 618, 2023-07-14T13:35:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 1447943, 2023-07-14T13:35:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 618, 2023-07-14T13:35:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-07-14T13:35:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-07-14T13:35:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 618, 2023-07-14T13:35:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 1447943, 2023-07-14T13:35:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-07-14T13:35:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-07-14T13:35:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-07-14T13:35:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-07-14T13:35:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-07-14T13:35:06.981 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-07-14T13:35:07.427 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2023-07-14T13:35:07.427 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2023-07-14T13:35:07.428 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2023-07-14T13:35:07.428 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2023-07-14T13:35:07.428 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2023-07-14T13:35:07.428 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2023-07-14T13:35:07.428 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2023-07-14T13:35:07.429 DEBUG:tasks.check_counter:Getting stats from c 2023-07-14T13:35:07.429 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.c perf dump 2023-07-14T13:35:08.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:07 smithi131 ceph-mon[96953]: pgmap v1122: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 75 KiB/s wr, 24 op/s 2023-07-14T13:35:08.281 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T13:35:08.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:07 smithi017 ceph-mon[95536]: pgmap v1122: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 75 KiB/s wr, 24 op/s 2023-07-14T13:35:08.412 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:07 smithi135 ceph-mon[97338]: pgmap v1122: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 75 KiB/s wr, 24 op/s 2023-07-14T13:35:10.211 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:09 smithi131 ceph-mon[96953]: pgmap v1123: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 57 KiB/s wr, 20 op/s 2023-07-14T13:35:10.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:09 smithi017 ceph-mon[95536]: pgmap v1123: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 57 KiB/s wr, 20 op/s 2023-07-14T13:35:10.413 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:09 smithi135 ceph-mon[97338]: pgmap v1123: 97 pgs: 97 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 57 KiB/s wr, 20 op/s 2023-07-14T13:35:10.743 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-07-14T13:35:10.744 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:35:10.744 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 5147, 2023-07-14T13:35:10.744 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 5088, 2023-07-14T13:35:10.745 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 32458129, 2023-07-14T13:35:10.745 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1731664, 2023-07-14T13:35:10.745 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2023-07-14T13:35:10.745 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2023-07-14T13:35:10.745 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.593488428, 2023-07-14T13:35:10.745 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.174512899, 2023-07-14T13:35:10.745 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.228663655, 2023-07-14T13:35:10.746 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.149832205, 2023-07-14T13:35:10.746 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:10.746 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5087, 2023-07-14T13:35:10.746 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.308652429, 2023-07-14T13:35:10.746 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000060674 2023-07-14T13:35:10.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.746 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:10.747 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.747 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.747 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.747 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1791504, 2023-07-14T13:35:10.747 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 357040 2023-07-14T13:35:10.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.748 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:35:10.748 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 2100, 2023-07-14T13:35:10.748 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2555, 2023-07-14T13:35:10.748 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 27710743, 2023-07-14T13:35:10.749 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1651565, 2023-07-14T13:35:10.749 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 11, 2023-07-14T13:35:10.749 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2023-07-14T13:35:10.749 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.251026686, 2023-07-14T13:35:10.749 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.085874443, 2023-07-14T13:35:10.750 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.088366422, 2023-07-14T13:35:10.750 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.054374199, 2023-07-14T13:35:10.750 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:10.750 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2553, 2023-07-14T13:35:10.750 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.162040430, 2023-07-14T13:35:10.750 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000063470 2023-07-14T13:35:10.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.751 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:10.751 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.751 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.751 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.751 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3440, 2023-07-14T13:35:10.751 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 1000576 2023-07-14T13:35:10.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.752 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:35:10.752 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1309, 2023-07-14T13:35:10.752 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1311, 2023-07-14T13:35:10.752 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 25495944, 2023-07-14T13:35:10.752 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 407106, 2023-07-14T13:35:10.752 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 9, 2023-07-14T13:35:10.752 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2023-07-14T13:35:10.753 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.162087317, 2023-07-14T13:35:10.753 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.043351245, 2023-07-14T13:35:10.753 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.069906411, 2023-07-14T13:35:10.753 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.037062044, 2023-07-14T13:35:10.753 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:10.753 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1309, 2023-07-14T13:35:10.753 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.150990896, 2023-07-14T13:35:10.753 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000115348 2023-07-14T13:35:10.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.754 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:10.754 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.754 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.754 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.754 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T13:35:10.755 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T13:35:10.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.755 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-07-14T13:35:10.755 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2023-07-14T13:35:10.755 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-07-14T13:35:10.756 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.756 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2023-07-14T13:35:10.756 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-07-14T13:35:10.756 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-07-14T13:35:10.756 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 13175, 2023-07-14T13:35:10.756 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.422076500, 2023-07-14T13:35:10.757 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000032036 2023-07-14T13:35:10.757 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:10.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.757 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2023-07-14T13:35:10.757 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-07-14T13:35:10.757 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-07-14T13:35:10.757 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.757 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.758 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.758 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:10.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.758 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2023-07-14T13:35:10.758 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2023-07-14T13:35:10.758 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2023-07-14T13:35:10.759 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2023-07-14T13:35:10.759 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.759 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.759 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2023-07-14T13:35:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2023-07-14T13:35:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2023-07-14T13:35:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2023-07-14T13:35:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2023-07-14T13:35:10.760 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2023-07-14T13:35:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2023-07-14T13:35:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 1298, 2023-07-14T13:35:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 892, 2023-07-14T13:35:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 401, 2023-07-14T13:35:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 5, 2023-07-14T13:35:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 23, 2023-07-14T13:35:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 57, 2023-07-14T13:35:10.761 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2023-07-14T13:35:10.762 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2023-07-14T13:35:10.762 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 24, 2023-07-14T13:35:10.762 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2023-07-14T13:35:10.762 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2023-07-14T13:35:10.762 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2023-07-14T13:35:10.762 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2023-07-14T13:35:10.762 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2023-07-14T13:35:10.763 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2023-07-14T13:35:10.763 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2023-07-14T13:35:10.763 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2023-07-14T13:35:10.763 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2023-07-14T13:35:10.763 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2023-07-14T13:35:10.763 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2023-07-14T13:35:10.763 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2023-07-14T13:35:10.763 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2023-07-14T13:35:10.764 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2023-07-14T13:35:10.764 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2023-07-14T13:35:10.764 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2023-07-14T13:35:10.764 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 1045, 2023-07-14T13:35:10.764 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 9004997418, 2023-07-14T13:35:10.764 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 6, 2023-07-14T13:35:10.764 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2023-07-14T13:35:10.765 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2023-07-14T13:35:10.765 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T13:35:10.765 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2023-07-14T13:35:10.765 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2023-07-14T13:35:10.765 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T13:35:10.765 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2023-07-14T13:35:10.765 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2023-07-14T13:35:10.765 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2023-07-14T13:35:10.766 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2023-07-14T13:35:10.766 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2023-07-14T13:35:10.766 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T13:35:10.766 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T13:35:10.766 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T13:35:10.766 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2023-07-14T13:35:10.766 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2023-07-14T13:35:10.766 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2023-07-14T13:35:10.767 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2023-07-14T13:35:10.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.767 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2023-07-14T13:35:10.767 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2023-07-14T13:35:10.767 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2023-07-14T13:35:10.768 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2023-07-14T13:35:10.768 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2023-07-14T13:35:10.768 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2023-07-14T13:35:10.768 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2023-07-14T13:35:10.769 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2023-07-14T13:35:10.769 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2023-07-14T13:35:10.769 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2023-07-14T13:35:10.769 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2023-07-14T13:35:10.769 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2023-07-14T13:35:10.769 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2023-07-14T13:35:10.769 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2023-07-14T13:35:10.769 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2023-07-14T13:35:10.770 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2023-07-14T13:35:10.770 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2023-07-14T13:35:10.770 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2023-07-14T13:35:10.770 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T13:35:10.770 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2023-07-14T13:35:10.771 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2023-07-14T13:35:10.771 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2023-07-14T13:35:10.771 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2023-07-14T13:35:10.771 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2023-07-14T13:35:10.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.771 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2023-07-14T13:35:10.771 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2023-07-14T13:35:10.772 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2023-07-14T13:35:10.772 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2023-07-14T13:35:10.772 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 0, 2023-07-14T13:35:10.772 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2023-07-14T13:35:10.772 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2023-07-14T13:35:10.772 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2023-07-14T13:35:10.772 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2023-07-14T13:35:10.773 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2023-07-14T13:35:10.773 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 2, 2023-07-14T13:35:10.773 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2023-07-14T13:35:10.773 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2023-07-14T13:35:10.773 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 85595016, 2023-07-14T13:35:10.773 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 0, 2023-07-14T13:35:10.773 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 85883508, 2023-07-14T13:35:10.774 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2023-07-14T13:35:10.774 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.774 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.774 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.774 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 19474 2023-07-14T13:35:10.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.774 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2023-07-14T13:35:10.775 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 1122, 2023-07-14T13:35:10.775 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 5044, 2023-07-14T13:35:10.775 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 3922, 2023-07-14T13:35:10.775 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 93, 2023-07-14T13:35:10.775 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 216, 2023-07-14T13:35:10.775 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 123, 2023-07-14T13:35:10.775 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 1298, 2023-07-14T13:35:10.775 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 6405, 2023-07-14T13:35:10.776 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 5107, 2023-07-14T13:35:10.776 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2023-07-14T13:35:10.776 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2023-07-14T13:35:10.776 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2023-07-14T13:35:10.776 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 57008, 2023-07-14T13:35:10.776 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 207156 2023-07-14T13:35:10.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.777 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2023-07-14T13:35:10.777 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2023-07-14T13:35:10.777 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2023-07-14T13:35:10.777 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2023-07-14T13:35:10.777 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2023-07-14T13:35:10.777 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2023-07-14T13:35:10.777 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2023-07-14T13:35:10.777 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.778 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.778 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.778 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2023-07-14T13:35:10.778 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.778 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.779 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.779 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2023-07-14T13:35:10.779 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.779 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.779 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.780 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2023-07-14T13:35:10.780 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.780 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.780 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.780 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2023-07-14T13:35:10.780 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.781 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.781 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.781 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2023-07-14T13:35:10.781 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.781 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.782 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.782 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2023-07-14T13:35:10.782 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.782 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.782 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.782 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2023-07-14T13:35:10.783 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.783 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.783 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.783 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2023-07-14T13:35:10.783 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.783 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.783 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.784 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2023-07-14T13:35:10.784 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.784 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.784 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.785 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2023-07-14T13:35:10.785 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.785 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.785 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.785 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2023-07-14T13:35:10.785 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.785 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.786 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.786 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2023-07-14T13:35:10.786 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.786 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.786 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.787 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2023-07-14T13:35:10.787 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.787 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.787 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.787 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2023-07-14T13:35:10.787 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.787 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.788 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.788 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2023-07-14T13:35:10.788 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.788 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.788 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2023-07-14T13:35:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2023-07-14T13:35:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.789 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.790 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.790 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2023-07-14T13:35:10.790 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.790 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.790 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.790 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2023-07-14T13:35:10.791 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.791 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.791 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.791 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2023-07-14T13:35:10.791 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.792 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.792 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.792 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2023-07-14T13:35:10.792 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.792 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.792 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.793 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2023-07-14T13:35:10.793 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.793 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.793 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.794 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2023-07-14T13:35:10.794 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.794 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.794 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.794 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2023-07-14T13:35:10.794 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.794 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.795 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.795 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2023-07-14T13:35:10.795 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.795 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.795 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.796 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2023-07-14T13:35:10.796 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.796 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.796 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.796 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2023-07-14T13:35:10.796 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.797 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.797 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.797 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2023-07-14T13:35:10.797 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.797 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.797 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.798 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2023-07-14T13:35:10.798 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2023-07-14T13:35:10.798 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2023-07-14T13:35:10.798 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.798 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.798 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.798 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:10.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.799 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2023-07-14T13:35:10.799 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2023-07-14T13:35:10.799 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 5, 2023-07-14T13:35:10.799 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 3, 2023-07-14T13:35:10.799 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 4, 2023-07-14T13:35:10.799 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2023-07-14T13:35:10.800 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2023-07-14T13:35:10.800 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2023-07-14T13:35:10.800 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 6108 2023-07-14T13:35:10.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.800 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-07-14T13:35:10.800 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-07-14T13:35:10.800 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-07-14T13:35:10.801 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:35:10.801 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:35:10.801 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:35:10.801 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:35:10.801 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:35:10.801 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:35:10.801 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:35:10.801 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:35:10.802 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:35:10.802 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:35:10.802 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:35:10.802 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:35:10.802 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:35:10.802 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-07-14T13:35:10.803 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:35:10.803 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-07-14T13:35:10.803 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:35:10.803 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:35:10.803 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:35:10.803 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:35:10.803 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:35:10.804 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:35:10.804 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:35:10.804 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-07-14T13:35:10.804 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:35:10.804 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:35:10.804 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:35:10.804 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-07-14T13:35:10.804 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-07-14T13:35:10.805 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-07-14T13:35:10.805 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:35:10.805 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:35:10.805 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:35:10.805 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:35:10.805 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 232929, 2023-07-14T13:35:10.805 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 79, 2023-07-14T13:35:10.805 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:35:10.806 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2023-07-14T13:35:10.806 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-07-14T13:35:10.806 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-07-14T13:35:10.806 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:35:10.806 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-07-14T13:35:10.806 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:35:10.806 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-07-14T13:35:10.807 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 7944, 2023-07-14T13:35:10.807 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 166, 2023-07-14T13:35:10.807 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:35:10.807 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:35:10.807 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-07-14T13:35:10.807 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-07-14T13:35:10.807 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 3326076, 2023-07-14T13:35:10.807 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 6438, 2023-07-14T13:35:10.808 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-07-14T13:35:10.808 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-07-14T13:35:10.808 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-07-14T13:35:10.808 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-07-14T13:35:10.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.808 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2023-07-14T13:35:10.808 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2023-07-14T13:35:10.808 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2023-07-14T13:35:10.809 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 7822, 2023-07-14T13:35:10.809 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 26, 2023-07-14T13:35:10.809 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 4, 2023-07-14T13:35:10.809 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 7822, 2023-07-14T13:35:10.809 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2023-07-14T13:35:10.809 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7822, 2023-07-14T13:35:10.809 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 14.253706374, 2023-07-14T13:35:10.809 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001822258 2023-07-14T13:35:10.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.810 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2023-07-14T13:35:10.810 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2023-07-14T13:35:10.810 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7822, 2023-07-14T13:35:10.810 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 7823 2023-07-14T13:35:10.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.810 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 7822, 2023-07-14T13:35:10.811 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 7822, 2023-07-14T13:35:10.811 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2023-07-14T13:35:10.811 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2023-07-14T13:35:10.811 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2023-07-14T13:35:10.811 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 4453, 2023-07-14T13:35:10.811 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2023-07-14T13:35:10.811 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 3366, 2023-07-14T13:35:10.811 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2023-07-14T13:35:10.812 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2023-07-14T13:35:10.812 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2023-07-14T13:35:10.812 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2023-07-14T13:35:10.812 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2023-07-14T13:35:10.812 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2023-07-14T13:35:10.812 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2023-07-14T13:35:10.813 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2023-07-14T13:35:10.813 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2023-07-14T13:35:10.813 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2023-07-14T13:35:10.813 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 2, 2023-07-14T13:35:10.813 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2023-07-14T13:35:10.813 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2023-07-14T13:35:10.813 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2023-07-14T13:35:10.814 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2023-07-14T13:35:10.814 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2023-07-14T13:35:10.814 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2023-07-14T13:35:10.814 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2023-07-14T13:35:10.814 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T13:35:10.814 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2023-07-14T13:35:10.815 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2023-07-14T13:35:10.815 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2023-07-14T13:35:10.815 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2023-07-14T13:35:10.815 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2023-07-14T13:35:10.815 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2023-07-14T13:35:10.815 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2023-07-14T13:35:10.815 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2023-07-14T13:35:10.816 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2023-07-14T13:35:10.816 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2023-07-14T13:35:10.816 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2023-07-14T13:35:10.816 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2023-07-14T13:35:10.816 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2023-07-14T13:35:10.816 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2023-07-14T13:35:10.816 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2023-07-14T13:35:10.816 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2023-07-14T13:35:10.817 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2023-07-14T13:35:10.817 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2023-07-14T13:35:10.817 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2023-07-14T13:35:10.817 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 148, 2023-07-14T13:35:10.817 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2023-07-14T13:35:10.817 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 62, 2023-07-14T13:35:10.817 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 10, 2023-07-14T13:35:10.818 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 15, 2023-07-14T13:35:10.818 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 5, 2023-07-14T13:35:10.818 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2023-07-14T13:35:10.818 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2023-07-14T13:35:10.818 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2023-07-14T13:35:10.818 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2023-07-14T13:35:10.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.818 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2023-07-14T13:35:10.819 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2023-07-14T13:35:10.819 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2023-07-14T13:35:10.819 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2023-07-14T13:35:10.819 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2023-07-14T13:35:10.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.819 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2023-07-14T13:35:10.819 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2023-07-14T13:35:10.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.820 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2023-07-14T13:35:10.820 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2023-07-14T13:35:10.820 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2023-07-14T13:35:10.820 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2023-07-14T13:35:10.820 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2023-07-14T13:35:10.820 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2023-07-14T13:35:10.820 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2023-07-14T13:35:10.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.821 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:35:10.821 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:10.821 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-07-14T13:35:10.821 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:10.821 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 8552, 2023-07-14T13:35:10.821 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 84855263, 2023-07-14T13:35:10.821 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:10.821 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 8552, 2023-07-14T13:35:10.822 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-07-14T13:35:10.822 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-07-14T13:35:10.822 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 8552, 2023-07-14T13:35:10.822 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 84855263, 2023-07-14T13:35:10.822 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:10.822 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.822 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.823 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.823 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:10.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.823 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2023-07-14T13:35:10.823 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:10.823 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-07-14T13:35:10.824 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:10.824 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-07-14T13:35:10.824 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-07-14T13:35:10.824 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:10.824 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:10.824 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 7822, 2023-07-14T13:35:10.824 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 81705900, 2023-07-14T13:35:10.825 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 7822, 2023-07-14T13:35:10.825 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 81705900, 2023-07-14T13:35:10.825 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:10.825 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.825 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.825 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.825 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:10.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.826 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2023-07-14T13:35:10.826 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:10.826 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2023-07-14T13:35:10.826 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:10.826 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-07-14T13:35:10.826 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-07-14T13:35:10.826 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:10.826 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:10.827 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 7822, 2023-07-14T13:35:10.827 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 7822, 2023-07-14T13:35:10.827 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 7822, 2023-07-14T13:35:10.827 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 7822, 2023-07-14T13:35:10.827 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:10.827 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.827 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.828 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.828 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:10.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.828 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2023-07-14T13:35:10.828 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:10.828 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-07-14T13:35:10.828 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:10.828 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-07-14T13:35:10.829 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-07-14T13:35:10.829 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:10.829 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:10.829 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-07-14T13:35:10.829 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-07-14T13:35:10.829 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-07-14T13:35:10.829 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-07-14T13:35:10.829 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:10.830 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.830 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.830 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.830 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:10.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:10.830 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55a003b76500": { 2023-07-14T13:35:10.830 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:10.830 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-07-14T13:35:10.831 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:10.831 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-07-14T13:35:10.831 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-07-14T13:35:10.831 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:10.831 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:10.831 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-07-14T13:35:10.831 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-07-14T13:35:10.832 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-07-14T13:35:10.832 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-07-14T13:35:10.832 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:10.832 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:10.832 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:10.832 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:10.832 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:10.832 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:10.833 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-07-14T13:35:11.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:10 smithi135 ceph-mon[97338]: osdmap e148: 12 total, 12 up, 12 in 2023-07-14T13:35:11.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:10 smithi017 ceph-mon[95536]: osdmap e148: 12 total, 12 up, 12 in 2023-07-14T13:35:11.464 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:10 smithi131 ceph-mon[96953]: osdmap e148: 12 total, 12 up, 12 in 2023-07-14T13:35:12.321 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:12 smithi017 ceph-mon[95536]: pgmap v1125: 97 pgs: 13 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 78 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-14T13:35:12.414 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:12 smithi135 ceph-mon[97338]: pgmap v1125: 97 pgs: 13 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 78 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-14T13:35:12.460 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:12 smithi131 ceph-mon[96953]: pgmap v1125: 97 pgs: 13 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 78 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-14T13:35:14.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:14 smithi017 ceph-mon[95536]: pgmap v1126: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 KiB/s wr, 21 op/s 2023-07-14T13:35:14.411 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:14 smithi135 ceph-mon[97338]: pgmap v1126: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 KiB/s wr, 21 op/s 2023-07-14T13:35:14.460 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:14 smithi131 ceph-mon[96953]: pgmap v1126: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 KiB/s wr, 21 op/s 2023-07-14T13:35:15.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:15 smithi017 ceph-mon[95536]: pgmap v1127: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 KiB/s wr, 21 op/s 2023-07-14T13:35:15.412 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:15 smithi135 ceph-mon[97338]: pgmap v1127: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 KiB/s wr, 21 op/s 2023-07-14T13:35:15.460 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:15 smithi131 ceph-mon[96953]: pgmap v1127: 97 pgs: 41 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 33 active+clean; 12 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 KiB/s wr, 21 op/s 2023-07-14T13:35:15.731 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-07-14T13:35:15.731 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-07-14T13:35:15.731 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2023-07-14T13:35:15.731 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2023-07-14T13:35:15.732 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2023-07-14T13:35:15.732 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-07-14T13:35:15.732 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-07-14T13:35:15.732 DEBUG:tasks.check_counter:Getting stats from f 2023-07-14T13:35:15.733 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.f perf dump 2023-07-14T13:35:16.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:16 smithi017 ceph-mon[95536]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:35:16.412 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:16 smithi135 ceph-mon[97338]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:35:16.456 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T13:35:16.460 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:16 smithi131 ceph-mon[96953]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-07-14T13:35:18.123 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-07-14T13:35:18.123 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:35:18.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1654, 2023-07-14T13:35:18.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1594, 2023-07-14T13:35:18.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 22117652, 2023-07-14T13:35:18.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 645745, 2023-07-14T13:35:18.124 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 8, 2023-07-14T13:35:18.125 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 2, 2023-07-14T13:35:18.125 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.243406081, 2023-07-14T13:35:18.125 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.070827299, 2023-07-14T13:35:18.125 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.123211665, 2023-07-14T13:35:18.125 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.042360619, 2023-07-14T13:35:18.125 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:18.125 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1593, 2023-07-14T13:35:18.126 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.138855493, 2023-07-14T13:35:18.126 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000087166 2023-07-14T13:35:18.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.126 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:18.126 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.126 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.126 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.127 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1795792, 2023-07-14T13:35:18.127 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 358064 2023-07-14T13:35:18.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.128 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:35:18.128 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 2344, 2023-07-14T13:35:18.128 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2803, 2023-07-14T13:35:18.128 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 42542156, 2023-07-14T13:35:18.128 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1730088, 2023-07-14T13:35:18.128 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 10, 2023-07-14T13:35:18.129 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2023-07-14T13:35:18.129 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.300305157, 2023-07-14T13:35:18.129 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.093747691, 2023-07-14T13:35:18.129 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.112996500, 2023-07-14T13:35:18.129 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.067079926, 2023-07-14T13:35:18.129 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:18.129 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2800, 2023-07-14T13:35:18.130 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.329876237, 2023-07-14T13:35:18.130 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000117812 2023-07-14T13:35:18.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.130 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:18.131 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.131 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.131 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.132 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 480, 2023-07-14T13:35:18.132 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 1002032 2023-07-14T13:35:18.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.133 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:35:18.133 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 4403, 2023-07-14T13:35:18.133 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 4403, 2023-07-14T13:35:18.134 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 39073166, 2023-07-14T13:35:18.134 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1368595, 2023-07-14T13:35:18.134 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2023-07-14T13:35:18.134 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2023-07-14T13:35:18.135 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.483525010, 2023-07-14T13:35:18.135 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.132031157, 2023-07-14T13:35:18.135 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.178986453, 2023-07-14T13:35:18.135 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.129411381, 2023-07-14T13:35:18.136 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:18.136 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4402, 2023-07-14T13:35:18.137 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.280912283, 2023-07-14T13:35:18.137 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000063814 2023-07-14T13:35:18.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.137 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:18.138 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.138 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.138 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.138 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-07-14T13:35:18.138 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 448 2023-07-14T13:35:18.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.139 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-07-14T13:35:18.139 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2023-07-14T13:35:18.139 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-07-14T13:35:18.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.139 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2023-07-14T13:35:18.139 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-07-14T13:35:18.139 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-07-14T13:35:18.140 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 12918, 2023-07-14T13:35:18.140 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.352365989, 2023-07-14T13:35:18.140 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000027277 2023-07-14T13:35:18.140 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:18.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.140 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2023-07-14T13:35:18.140 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-07-14T13:35:18.141 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-07-14T13:35:18.141 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.141 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.141 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.141 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:18.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.141 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2023-07-14T13:35:18.141 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2023-07-14T13:35:18.142 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2023-07-14T13:35:18.142 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2023-07-14T13:35:18.142 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.142 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.142 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.142 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2023-07-14T13:35:18.143 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2023-07-14T13:35:18.143 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2023-07-14T13:35:18.143 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2023-07-14T13:35:18.143 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2023-07-14T13:35:18.143 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2023-07-14T13:35:18.143 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2023-07-14T13:35:18.143 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 1219, 2023-07-14T13:35:18.144 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 405, 2023-07-14T13:35:18.144 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 490, 2023-07-14T13:35:18.144 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 324, 2023-07-14T13:35:18.144 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 640, 2023-07-14T13:35:18.144 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2023-07-14T13:35:18.145 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2023-07-14T13:35:18.145 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2023-07-14T13:35:18.145 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 24, 2023-07-14T13:35:18.145 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2023-07-14T13:35:18.145 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2023-07-14T13:35:18.145 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2023-07-14T13:35:18.146 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2023-07-14T13:35:18.146 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2023-07-14T13:35:18.146 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2023-07-14T13:35:18.146 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2023-07-14T13:35:18.146 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2023-07-14T13:35:18.146 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2023-07-14T13:35:18.146 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2023-07-14T13:35:18.147 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2023-07-14T13:35:18.147 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2023-07-14T13:35:18.147 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2023-07-14T13:35:18.147 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2023-07-14T13:35:18.147 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2023-07-14T13:35:18.147 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2023-07-14T13:35:18.147 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2023-07-14T13:35:18.147 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2023-07-14T13:35:18.148 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2023-07-14T13:35:18.148 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2023-07-14T13:35:18.148 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2023-07-14T13:35:18.148 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T13:35:18.148 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2023-07-14T13:35:18.148 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2023-07-14T13:35:18.149 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T13:35:18.149 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2023-07-14T13:35:18.149 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2023-07-14T13:35:18.149 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2023-07-14T13:35:18.149 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2023-07-14T13:35:18.149 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2023-07-14T13:35:18.149 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T13:35:18.150 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T13:35:18.150 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T13:35:18.150 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2023-07-14T13:35:18.150 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2023-07-14T13:35:18.150 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2023-07-14T13:35:18.150 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2023-07-14T13:35:18.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.151 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2023-07-14T13:35:18.151 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2023-07-14T13:35:18.151 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2023-07-14T13:35:18.151 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2023-07-14T13:35:18.151 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2023-07-14T13:35:18.151 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2023-07-14T13:35:18.151 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2023-07-14T13:35:18.152 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2023-07-14T13:35:18.152 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2023-07-14T13:35:18.152 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2023-07-14T13:35:18.152 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2023-07-14T13:35:18.152 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2023-07-14T13:35:18.152 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2023-07-14T13:35:18.152 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2023-07-14T13:35:18.153 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2023-07-14T13:35:18.153 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2023-07-14T13:35:18.153 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2023-07-14T13:35:18.153 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2023-07-14T13:35:18.153 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T13:35:18.153 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2023-07-14T13:35:18.153 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2023-07-14T13:35:18.154 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2023-07-14T13:35:18.154 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2023-07-14T13:35:18.154 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2023-07-14T13:35:18.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.154 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2023-07-14T13:35:18.154 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2023-07-14T13:35:18.154 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2023-07-14T13:35:18.155 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2023-07-14T13:35:18.155 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 0, 2023-07-14T13:35:18.155 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2023-07-14T13:35:18.155 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2023-07-14T13:35:18.155 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2023-07-14T13:35:18.155 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2023-07-14T13:35:18.155 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2023-07-14T13:35:18.156 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 28, 2023-07-14T13:35:18.156 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2023-07-14T13:35:18.156 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2023-07-14T13:35:18.156 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2023-07-14T13:35:18.156 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 0, 2023-07-14T13:35:18.156 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 103973372, 2023-07-14T13:35:18.156 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2023-07-14T13:35:18.157 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.157 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.157 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.157 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 20097 2023-07-14T13:35:18.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.158 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2023-07-14T13:35:18.158 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 569, 2023-07-14T13:35:18.158 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 4433, 2023-07-14T13:35:18.158 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 3864, 2023-07-14T13:35:18.158 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 41, 2023-07-14T13:35:18.158 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 182, 2023-07-14T13:35:18.158 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 141, 2023-07-14T13:35:18.159 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 1219, 2023-07-14T13:35:18.159 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 5898, 2023-07-14T13:35:18.159 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 4679, 2023-07-14T13:35:18.159 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2023-07-14T13:35:18.159 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2023-07-14T13:35:18.159 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2023-07-14T13:35:18.160 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 57348, 2023-07-14T13:35:18.160 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 207156 2023-07-14T13:35:18.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.160 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2023-07-14T13:35:18.161 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2023-07-14T13:35:18.161 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2023-07-14T13:35:18.161 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2023-07-14T13:35:18.162 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2023-07-14T13:35:18.162 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2023-07-14T13:35:18.162 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2023-07-14T13:35:18.162 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.163 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.163 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.163 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2023-07-14T13:35:18.164 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.164 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.164 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.165 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2023-07-14T13:35:18.165 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.165 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.165 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.166 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2023-07-14T13:35:18.166 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.166 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.167 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.167 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2023-07-14T13:35:18.167 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.167 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.167 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.168 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2023-07-14T13:35:18.168 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.168 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.168 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.169 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2023-07-14T13:35:18.169 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.169 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.169 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.169 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2023-07-14T13:35:18.169 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.169 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.170 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.170 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2023-07-14T13:35:18.170 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.170 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.170 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.171 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2023-07-14T13:35:18.171 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.171 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.171 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.171 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2023-07-14T13:35:18.171 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.171 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.172 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.172 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2023-07-14T13:35:18.172 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.172 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.172 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.173 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2023-07-14T13:35:18.173 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.173 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.173 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.173 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2023-07-14T13:35:18.173 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.174 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.174 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2023-07-14T13:35:18.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.174 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.175 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.175 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2023-07-14T13:35:18.175 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.175 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.176 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2023-07-14T13:35:18.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.176 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.177 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2023-07-14T13:35:18.177 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.177 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.177 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.178 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2023-07-14T13:35:18.178 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.179 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.179 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.179 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2023-07-14T13:35:18.180 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.180 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.180 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.181 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2023-07-14T13:35:18.181 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.181 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.181 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.181 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2023-07-14T13:35:18.182 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.182 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.182 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.182 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2023-07-14T13:35:18.183 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.183 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.183 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.183 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2023-07-14T13:35:18.184 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.184 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.184 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.184 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2023-07-14T13:35:18.185 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.185 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.185 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.185 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2023-07-14T13:35:18.185 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.185 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.186 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.186 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2023-07-14T13:35:18.186 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.186 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.186 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.187 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2023-07-14T13:35:18.187 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.187 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.187 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.187 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2023-07-14T13:35:18.187 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.187 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.188 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.188 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2023-07-14T13:35:18.188 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2023-07-14T13:35:18.188 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2023-07-14T13:35:18.188 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.188 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.189 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.189 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:18.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.189 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2023-07-14T13:35:18.189 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2023-07-14T13:35:18.189 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 3, 2023-07-14T13:35:18.189 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2023-07-14T13:35:18.189 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 3, 2023-07-14T13:35:18.190 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2023-07-14T13:35:18.190 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2023-07-14T13:35:18.190 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2023-07-14T13:35:18.190 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 5119 2023-07-14T13:35:18.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.190 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-07-14T13:35:18.190 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-07-14T13:35:18.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-07-14T13:35:18.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:35:18.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:35:18.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:35:18.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:35:18.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:35:18.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:35:18.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:35:18.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:35:18.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:35:18.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:35:18.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:35:18.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:35:18.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:35:18.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-07-14T13:35:18.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:35:18.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-07-14T13:35:18.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:35:18.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:35:18.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:35:18.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:35:18.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:35:18.194 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:35:18.194 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:35:18.194 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-07-14T13:35:18.194 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:35:18.194 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:35:18.194 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:35:18.194 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-07-14T13:35:18.195 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-07-14T13:35:18.195 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-07-14T13:35:18.195 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:35:18.195 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:35:18.195 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:35:18.195 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:35:18.195 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 225633, 2023-07-14T13:35:18.195 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 77, 2023-07-14T13:35:18.196 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:35:18.196 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2023-07-14T13:35:18.196 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-07-14T13:35:18.196 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-07-14T13:35:18.196 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:35:18.196 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-07-14T13:35:18.196 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:35:18.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-07-14T13:35:18.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8064, 2023-07-14T13:35:18.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 169, 2023-07-14T13:35:18.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:35:18.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:35:18.197 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-07-14T13:35:18.198 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-07-14T13:35:18.198 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 2315306, 2023-07-14T13:35:18.198 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 33462, 2023-07-14T13:35:18.198 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-07-14T13:35:18.198 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-07-14T13:35:18.198 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-07-14T13:35:18.198 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-07-14T13:35:18.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.199 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2023-07-14T13:35:18.199 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2023-07-14T13:35:18.199 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2023-07-14T13:35:18.199 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 7665, 2023-07-14T13:35:18.199 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2023-07-14T13:35:18.199 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2023-07-14T13:35:18.199 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 7665, 2023-07-14T13:35:18.200 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2023-07-14T13:35:18.200 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7665, 2023-07-14T13:35:18.200 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 12.870735718, 2023-07-14T13:35:18.200 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001679156 2023-07-14T13:35:18.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.200 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2023-07-14T13:35:18.200 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2023-07-14T13:35:18.201 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7665, 2023-07-14T13:35:18.201 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 7666 2023-07-14T13:35:18.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.201 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 7665, 2023-07-14T13:35:18.201 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 7665, 2023-07-14T13:35:18.201 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2023-07-14T13:35:18.201 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2023-07-14T13:35:18.201 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2023-07-14T13:35:18.202 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 4380, 2023-07-14T13:35:18.202 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2023-07-14T13:35:18.202 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 3283, 2023-07-14T13:35:18.202 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2023-07-14T13:35:18.202 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2023-07-14T13:35:18.202 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2023-07-14T13:35:18.202 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2023-07-14T13:35:18.203 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2023-07-14T13:35:18.203 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2023-07-14T13:35:18.203 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2023-07-14T13:35:18.203 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2023-07-14T13:35:18.203 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2023-07-14T13:35:18.203 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2023-07-14T13:35:18.203 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2023-07-14T13:35:18.203 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2023-07-14T13:35:18.204 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2023-07-14T13:35:18.204 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2023-07-14T13:35:18.204 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2023-07-14T13:35:18.204 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2023-07-14T13:35:18.204 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2023-07-14T13:35:18.204 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2023-07-14T13:35:18.204 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T13:35:18.205 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2023-07-14T13:35:18.205 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2023-07-14T13:35:18.205 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2023-07-14T13:35:18.205 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2023-07-14T13:35:18.205 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2023-07-14T13:35:18.206 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2023-07-14T13:35:18.206 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2023-07-14T13:35:18.206 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2023-07-14T13:35:18.206 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2023-07-14T13:35:18.206 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2023-07-14T13:35:18.206 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2023-07-14T13:35:18.207 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2023-07-14T13:35:18.207 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2023-07-14T13:35:18.207 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2023-07-14T13:35:18.207 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2023-07-14T13:35:18.207 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2023-07-14T13:35:18.207 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2023-07-14T13:35:18.207 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2023-07-14T13:35:18.208 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2023-07-14T13:35:18.208 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 148, 2023-07-14T13:35:18.208 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2023-07-14T13:35:18.208 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 62, 2023-07-14T13:35:18.208 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 9, 2023-07-14T13:35:18.208 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2023-07-14T13:35:18.209 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 3, 2023-07-14T13:35:18.209 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2023-07-14T13:35:18.209 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2023-07-14T13:35:18.209 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2023-07-14T13:35:18.209 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2023-07-14T13:35:18.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.209 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2023-07-14T13:35:18.210 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2023-07-14T13:35:18.210 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2023-07-14T13:35:18.210 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2023-07-14T13:35:18.210 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2023-07-14T13:35:18.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.210 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2023-07-14T13:35:18.211 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2023-07-14T13:35:18.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.211 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2023-07-14T13:35:18.211 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2023-07-14T13:35:18.211 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2023-07-14T13:35:18.211 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2023-07-14T13:35:18.211 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2023-07-14T13:35:18.211 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2023-07-14T13:35:18.212 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2023-07-14T13:35:18.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.212 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:35:18.212 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:18.212 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-07-14T13:35:18.212 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:18.212 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 8397, 2023-07-14T13:35:18.213 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 102937268, 2023-07-14T13:35:18.213 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:18.213 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 8397, 2023-07-14T13:35:18.213 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-07-14T13:35:18.213 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-07-14T13:35:18.213 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 8397, 2023-07-14T13:35:18.213 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 102937268, 2023-07-14T13:35:18.213 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:18.214 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.214 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.214 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.214 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:18.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.214 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2023-07-14T13:35:18.214 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:18.214 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-07-14T13:35:18.215 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:18.215 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-07-14T13:35:18.215 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-07-14T13:35:18.215 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:18.215 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:18.215 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 7665, 2023-07-14T13:35:18.215 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 99806802, 2023-07-14T13:35:18.216 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 7665, 2023-07-14T13:35:18.216 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 99806802, 2023-07-14T13:35:18.216 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:18.216 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.216 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.216 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.216 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:18.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.217 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2023-07-14T13:35:18.217 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:18.217 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2023-07-14T13:35:18.217 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:18.217 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-07-14T13:35:18.217 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-07-14T13:35:18.218 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:18.218 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:18.218 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 7665, 2023-07-14T13:35:18.218 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 7665, 2023-07-14T13:35:18.218 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 7665, 2023-07-14T13:35:18.218 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 7665, 2023-07-14T13:35:18.218 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:18.219 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.219 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.219 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.219 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:18.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.219 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2023-07-14T13:35:18.219 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:18.220 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-07-14T13:35:18.220 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:18.220 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-07-14T13:35:18.220 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-07-14T13:35:18.220 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:18.220 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:18.220 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-07-14T13:35:18.221 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-07-14T13:35:18.221 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-07-14T13:35:18.221 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-07-14T13:35:18.221 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:18.221 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.221 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.221 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.221 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:18.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:18.222 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55bd63ba8500": { 2023-07-14T13:35:18.222 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:18.222 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-07-14T13:35:18.222 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:18.222 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-07-14T13:35:18.222 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-07-14T13:35:18.223 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:18.223 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:18.223 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-07-14T13:35:18.223 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-07-14T13:35:18.223 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2023-07-14T13:35:18.223 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2023-07-14T13:35:18.223 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:18.223 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:18.224 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:18.224 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:18.224 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:18.224 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:18.224 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-07-14T13:35:18.225 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:17 smithi131 ceph-mon[96953]: pgmap v1128: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2023-07-14T13:35:18.226 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:17 smithi135 ceph-mon[97338]: pgmap v1128: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2023-07-14T13:35:18.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:17 smithi017 ceph-mon[95536]: pgmap v1128: 97 pgs: 5 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 90 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2023-07-14T13:35:18.730 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-07-14T13:35:18.731 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-07-14T13:35:18.731 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2023-07-14T13:35:18.731 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2023-07-14T13:35:18.731 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2023-07-14T13:35:18.732 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-07-14T13:35:18.732 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-07-14T13:35:18.732 DEBUG:tasks.check_counter:Getting stats from i 2023-07-14T13:35:18.732 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.i perf dump 2023-07-14T13:35:19.459 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T13:35:20.099 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:19 smithi135 ceph-mon[97338]: pgmap v1129: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2023-07-14T13:35:20.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:19 smithi131 ceph-mon[96953]: pgmap v1129: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2023-07-14T13:35:20.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:19 smithi017 ceph-mon[95536]: pgmap v1129: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2023-07-14T13:35:21.092 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-07-14T13:35:21.092 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:35:21.093 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 3371045, 2023-07-14T13:35:21.093 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 3370549, 2023-07-14T13:35:21.093 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 559308881, 2023-07-14T13:35:21.093 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 590645063, 2023-07-14T13:35:21.093 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 10, 2023-07-14T13:35:21.093 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2023-07-14T13:35:21.093 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 153.147473049, 2023-07-14T13:35:21.094 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 63.534667789, 2023-07-14T13:35:21.094 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 102.800281395, 2023-07-14T13:35:21.094 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.514008796, 2023-07-14T13:35:21.094 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:21.094 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3370550, 2023-07-14T13:35:21.094 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 50.206961124, 2023-07-14T13:35:21.094 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000014895 2023-07-14T13:35:21.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.095 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:21.095 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6720733, 2023-07-14T13:35:21.095 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.694924200, 2023-07-14T13:35:21.095 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000103 2023-07-14T13:35:21.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.096 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 8896, 2023-07-14T13:35:21.096 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 43136 2023-07-14T13:35:21.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.096 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:35:21.096 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 639442, 2023-07-14T13:35:21.096 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 633879, 2023-07-14T13:35:21.096 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 121573564, 2023-07-14T13:35:21.097 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 154719368, 2023-07-14T13:35:21.097 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 12, 2023-07-14T13:35:21.097 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2023-07-14T13:35:21.097 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 29.676650459, 2023-07-14T13:35:21.097 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 12.323169892, 2023-07-14T13:35:21.097 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 20.046795028, 2023-07-14T13:35:21.097 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.209335183, 2023-07-14T13:35:21.097 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:21.098 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 633880, 2023-07-14T13:35:21.098 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 11.933986759, 2023-07-14T13:35:21.098 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000018826 2023-07-14T13:35:21.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.098 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:21.098 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1249185, 2023-07-14T13:35:21.098 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.134045431, 2023-07-14T13:35:21.099 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000107 2023-07-14T13:35:21.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.099 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1808800, 2023-07-14T13:35:21.099 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 374496 2023-07-14T13:35:21.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.099 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:35:21.099 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 48478, 2023-07-14T13:35:21.099 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 68575, 2023-07-14T13:35:21.100 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 16031629, 2023-07-14T13:35:21.100 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 42144399, 2023-07-14T13:35:21.100 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 43, 2023-07-14T13:35:21.100 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 7, 2023-07-14T13:35:21.100 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 4.710517724, 2023-07-14T13:35:21.100 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 2.021401467, 2023-07-14T13:35:21.100 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 3.118034221, 2023-07-14T13:35:21.101 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.081497198, 2023-07-14T13:35:21.101 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:21.101 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 68568, 2023-07-14T13:35:21.101 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 6.368143570, 2023-07-14T13:35:21.101 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000092873 2023-07-14T13:35:21.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.101 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:21.101 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 96785, 2023-07-14T13:35:21.102 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.024323920, 2023-07-14T13:35:21.102 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000251 2023-07-14T13:35:21.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.102 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 2288, 2023-07-14T13:35:21.102 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 1017280 2023-07-14T13:35:21.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.102 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-07-14T13:35:21.103 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2023-07-14T13:35:21.103 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-07-14T13:35:21.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.103 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2023-07-14T13:35:21.103 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-07-14T13:35:21.103 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-07-14T13:35:21.103 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 25491, 2023-07-14T13:35:21.103 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 7.920100876, 2023-07-14T13:35:21.104 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000310701 2023-07-14T13:35:21.104 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:21.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.104 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2023-07-14T13:35:21.104 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2023-07-14T13:35:21.104 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2023-07-14T13:35:21.104 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 893, 2023-07-14T13:35:21.105 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.038160874, 2023-07-14T13:35:21.105 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000042733 2023-07-14T13:35:21.105 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:21.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.105 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2023-07-14T13:35:21.105 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 20166, 2023-07-14T13:35:21.105 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 17283, 2023-07-14T13:35:21.106 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2023-07-14T13:35:21.106 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 17283, 2023-07-14T13:35:21.106 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 381.987468129, 2023-07-14T13:35:21.106 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.022101919 2023-07-14T13:35:21.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.106 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2023-07-14T13:35:21.106 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 2883, 2023-07-14T13:35:21.107 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 19, 2023-07-14T13:35:21.107 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2023-07-14T13:35:21.107 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 35, 2023-07-14T13:35:21.107 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 3, 2023-07-14T13:35:21.107 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2023-07-14T13:35:21.107 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 1106, 2023-07-14T13:35:21.107 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 350, 2023-07-14T13:35:21.108 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 615, 2023-07-14T13:35:21.108 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 141, 2023-07-14T13:35:21.108 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 606, 2023-07-14T13:35:21.108 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 5239, 2023-07-14T13:35:21.108 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 160, 2023-07-14T13:35:21.108 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 160, 2023-07-14T13:35:21.108 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 29, 2023-07-14T13:35:21.109 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 77136, 2023-07-14T13:35:21.109 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 63672, 2023-07-14T13:35:21.109 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 2743, 2023-07-14T13:35:21.109 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 354, 2023-07-14T13:35:21.109 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 3, 2023-07-14T13:35:21.109 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2023-07-14T13:35:21.109 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 5812, 2023-07-14T13:35:21.109 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 78, 2023-07-14T13:35:21.110 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2023-07-14T13:35:21.110 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 123, 2023-07-14T13:35:21.110 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 4346, 2023-07-14T13:35:21.110 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 121, 2023-07-14T13:35:21.110 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 4473, 2023-07-14T13:35:21.110 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2023-07-14T13:35:21.110 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 10008, 2023-07-14T13:35:21.110 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2023-07-14T13:35:21.111 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 1046, 2023-07-14T13:35:21.111 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 8949455257, 2023-07-14T13:35:21.111 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 6, 2023-07-14T13:35:21.111 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 10008, 2023-07-14T13:35:21.111 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2023-07-14T13:35:21.111 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T13:35:21.111 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2023-07-14T13:35:21.111 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 57, 2023-07-14T13:35:21.112 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T13:35:21.112 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 57, 2023-07-14T13:35:21.112 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 9951, 2023-07-14T13:35:21.112 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 886, 2023-07-14T13:35:21.112 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 16985, 2023-07-14T13:35:21.112 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 13564, 2023-07-14T13:35:21.113 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T13:35:21.113 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T13:35:21.113 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T13:35:21.113 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 24209, 2023-07-14T13:35:21.113 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 8763, 2023-07-14T13:35:21.113 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 453, 2023-07-14T13:35:21.113 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 1471 2023-07-14T13:35:21.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.114 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2023-07-14T13:35:21.114 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 13, 2023-07-14T13:35:21.114 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 304, 2023-07-14T13:35:21.114 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 168, 2023-07-14T13:35:21.114 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 578, 2023-07-14T13:35:21.114 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 373, 2023-07-14T13:35:21.114 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 7, 2023-07-14T13:35:21.115 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2023-07-14T13:35:21.115 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2023-07-14T13:35:21.115 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 405, 2023-07-14T13:35:21.115 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 158, 2023-07-14T13:35:21.115 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 1213, 2023-07-14T13:35:21.115 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 158, 2023-07-14T13:35:21.115 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2023-07-14T13:35:21.115 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2023-07-14T13:35:21.116 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2023-07-14T13:35:21.116 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2023-07-14T13:35:21.116 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2023-07-14T13:35:21.116 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T13:35:21.117 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 133, 2023-07-14T13:35:21.117 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2023-07-14T13:35:21.117 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 3, 2023-07-14T13:35:21.117 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2023-07-14T13:35:21.117 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2023-07-14T13:35:21.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.117 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2023-07-14T13:35:21.117 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 20097, 2023-07-14T13:35:21.118 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2023-07-14T13:35:21.118 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2023-07-14T13:35:21.118 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 20097, 2023-07-14T13:35:21.118 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2023-07-14T13:35:21.118 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2023-07-14T13:35:21.118 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 28, 2023-07-14T13:35:21.118 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2023-07-14T13:35:21.119 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2023-07-14T13:35:21.119 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 28, 2023-07-14T13:35:21.119 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2023-07-14T13:35:21.119 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2023-07-14T13:35:21.119 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2023-07-14T13:35:21.119 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 103973946, 2023-07-14T13:35:21.119 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2023-07-14T13:35:21.120 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2023-07-14T13:35:21.120 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 8884, 2023-07-14T13:35:21.120 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 52.883131638, 2023-07-14T13:35:21.120 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.005952626 2023-07-14T13:35:21.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.120 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2023-07-14T13:35:21.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.121 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2023-07-14T13:35:21.121 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 625, 2023-07-14T13:35:21.121 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 4343, 2023-07-14T13:35:21.121 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 3718, 2023-07-14T13:35:21.121 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 133, 2023-07-14T13:35:21.121 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 289, 2023-07-14T13:35:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 156, 2023-07-14T13:35:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 1106, 2023-07-14T13:35:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 6524, 2023-07-14T13:35:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 5418, 2023-07-14T13:35:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 160, 2023-07-14T13:35:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 2355, 2023-07-14T13:35:21.122 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 2195, 2023-07-14T13:35:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 71868, 2023-07-14T13:35:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 198964 2023-07-14T13:35:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2023-07-14T13:35:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 55885, 2023-07-14T13:35:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 11064, 2023-07-14T13:35:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 20166, 2023-07-14T13:35:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 331, 2023-07-14T13:35:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 20397, 2023-07-14T13:35:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2023-07-14T13:35:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 164, 2023-07-14T13:35:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.372168257, 2023-07-14T13:35:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002269318 2023-07-14T13:35:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.124 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2023-07-14T13:35:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 678, 2023-07-14T13:35:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.230509094, 2023-07-14T13:35:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001814910 2023-07-14T13:35:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.125 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2023-07-14T13:35:21.126 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.126 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.126 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.126 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2023-07-14T13:35:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 229, 2023-07-14T13:35:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3.389684808, 2023-07-14T13:35:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.014802117 2023-07-14T13:35:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2023-07-14T13:35:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 9407, 2023-07-14T13:35:21.127 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 249.447180775, 2023-07-14T13:35:21.128 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.026517187 2023-07-14T13:35:21.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.128 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2023-07-14T13:35:21.128 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.128 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.128 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.129 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2023-07-14T13:35:21.129 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.129 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.129 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.129 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2023-07-14T13:35:21.130 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.130 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.130 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.130 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2023-07-14T13:35:21.130 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.130 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.130 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.131 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2023-07-14T13:35:21.131 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.131 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.131 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.131 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2023-07-14T13:35:21.132 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.132 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.132 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.132 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2023-07-14T13:35:21.133 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1, 2023-07-14T13:35:21.133 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.002867565, 2023-07-14T13:35:21.133 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002867565 2023-07-14T13:35:21.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.133 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2023-07-14T13:35:21.133 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.133 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.134 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.134 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2023-07-14T13:35:21.134 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.134 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.135 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.135 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2023-07-14T13:35:21.135 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4925, 2023-07-14T13:35:21.135 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 4.772454960, 2023-07-14T13:35:21.135 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000969026 2023-07-14T13:35:21.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.136 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2023-07-14T13:35:21.136 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 121, 2023-07-14T13:35:21.136 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.088648241, 2023-07-14T13:35:21.136 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000732630 2023-07-14T13:35:21.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.137 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2023-07-14T13:35:21.137 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1499, 2023-07-14T13:35:21.137 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 120.936315857, 2023-07-14T13:35:21.137 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.080677995 2023-07-14T13:35:21.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.138 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2023-07-14T13:35:21.138 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.138 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.138 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.138 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2023-07-14T13:35:21.138 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.138 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.139 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.139 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2023-07-14T13:35:21.139 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.139 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.139 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.139 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2023-07-14T13:35:21.140 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.140 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.140 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.140 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2023-07-14T13:35:21.140 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.141 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.141 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.141 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2023-07-14T13:35:21.141 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.141 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.141 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.142 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2023-07-14T13:35:21.142 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.142 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.142 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.142 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2023-07-14T13:35:21.142 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.143 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.143 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.143 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.143 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2023-07-14T13:35:21.143 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.143 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.144 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.144 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2023-07-14T13:35:21.144 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.144 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.144 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.145 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2023-07-14T13:35:21.145 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.145 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.145 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.145 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2023-07-14T13:35:21.145 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 259, 2023-07-14T13:35:21.145 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.747638572, 2023-07-14T13:35:21.146 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.006747639 2023-07-14T13:35:21.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.146 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2023-07-14T13:35:21.146 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2023-07-14T13:35:21.146 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2023-07-14T13:35:21.146 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.146 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.147 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.147 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:21.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.147 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2023-07-14T13:35:21.147 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2023-07-14T13:35:21.148 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 3, 2023-07-14T13:35:21.148 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2023-07-14T13:35:21.148 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 2, 2023-07-14T13:35:21.148 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2023-07-14T13:35:21.148 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 966, 2023-07-14T13:35:21.148 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 483, 2023-07-14T13:35:21.148 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 2137 2023-07-14T13:35:21.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.149 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-07-14T13:35:21.149 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-07-14T13:35:21.149 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-07-14T13:35:21.149 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:35:21.149 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:35:21.149 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:35:21.149 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:35:21.150 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:35:21.150 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:35:21.150 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:35:21.150 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:35:21.150 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:35:21.150 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:35:21.150 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:35:21.150 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:35:21.151 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:35:21.151 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-07-14T13:35:21.151 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:35:21.151 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-07-14T13:35:21.151 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:35:21.151 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:35:21.151 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:35:21.151 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:35:21.152 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:35:21.152 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:35:21.152 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:35:21.152 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-07-14T13:35:21.152 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:35:21.152 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:35:21.152 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:35:21.153 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-07-14T13:35:21.153 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-07-14T13:35:21.153 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-07-14T13:35:21.153 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:35:21.153 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:35:21.153 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:35:21.154 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:35:21.154 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 859103, 2023-07-14T13:35:21.154 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 250, 2023-07-14T13:35:21.154 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:35:21.154 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2023-07-14T13:35:21.154 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-07-14T13:35:21.154 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-07-14T13:35:21.155 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:35:21.155 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-07-14T13:35:21.155 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:35:21.155 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-07-14T13:35:21.155 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8064, 2023-07-14T13:35:21.155 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 169, 2023-07-14T13:35:21.155 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:35:21.155 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:35:21.156 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-07-14T13:35:21.156 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-07-14T13:35:21.156 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 2870802, 2023-07-14T13:35:21.156 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 68905, 2023-07-14T13:35:21.156 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-07-14T13:35:21.156 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-07-14T13:35:21.156 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-07-14T13:35:21.156 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-07-14T13:35:21.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.157 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2023-07-14T13:35:21.157 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2023-07-14T13:35:21.157 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2023-07-14T13:35:21.157 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 20214, 2023-07-14T13:35:21.157 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 100158729, 2023-07-14T13:35:21.157 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 27, 2023-07-14T13:35:21.158 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 20214, 2023-07-14T13:35:21.158 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2023-07-14T13:35:21.158 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 20214, 2023-07-14T13:35:21.158 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 65.858655952, 2023-07-14T13:35:21.158 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.003258071 2023-07-14T13:35:21.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.159 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2023-07-14T13:35:21.159 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2023-07-14T13:35:21.159 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 20214, 2023-07-14T13:35:21.159 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 20825 2023-07-14T13:35:21.159 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.159 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 20214, 2023-07-14T13:35:21.159 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 10201, 2023-07-14T13:35:21.159 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 10013, 2023-07-14T13:35:21.160 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2023-07-14T13:35:21.160 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2023-07-14T13:35:21.160 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2023-07-14T13:35:21.160 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 10, 2023-07-14T13:35:21.160 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 85, 2023-07-14T13:35:21.160 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 8969, 2023-07-14T13:35:21.160 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 211, 2023-07-14T13:35:21.161 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2023-07-14T13:35:21.161 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2023-07-14T13:35:21.161 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 7, 2023-07-14T13:35:21.161 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2023-07-14T13:35:21.161 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 448, 2023-07-14T13:35:21.161 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2023-07-14T13:35:21.161 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2023-07-14T13:35:21.162 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2023-07-14T13:35:21.162 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 10010, 2023-07-14T13:35:21.162 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 20, 2023-07-14T13:35:21.162 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2023-07-14T13:35:21.162 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2023-07-14T13:35:21.162 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2023-07-14T13:35:21.162 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2023-07-14T13:35:21.162 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2023-07-14T13:35:21.163 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2023-07-14T13:35:21.163 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T13:35:21.163 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2023-07-14T13:35:21.163 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2023-07-14T13:35:21.163 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2023-07-14T13:35:21.163 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2023-07-14T13:35:21.163 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2023-07-14T13:35:21.164 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2023-07-14T13:35:21.164 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2023-07-14T13:35:21.164 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2023-07-14T13:35:21.164 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2023-07-14T13:35:21.164 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2023-07-14T13:35:21.164 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2023-07-14T13:35:21.165 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2023-07-14T13:35:21.165 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2023-07-14T13:35:21.165 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2023-07-14T13:35:21.165 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2023-07-14T13:35:21.165 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2023-07-14T13:35:21.165 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2023-07-14T13:35:21.165 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2023-07-14T13:35:21.166 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2023-07-14T13:35:21.166 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 148, 2023-07-14T13:35:21.166 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2023-07-14T13:35:21.166 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 62, 2023-07-14T13:35:21.166 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2023-07-14T13:35:21.166 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2023-07-14T13:35:21.166 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2023-07-14T13:35:21.166 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2023-07-14T13:35:21.167 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 684, 2023-07-14T13:35:21.167 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 127, 2023-07-14T13:35:21.167 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 254 2023-07-14T13:35:21.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.167 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2023-07-14T13:35:21.167 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2023-07-14T13:35:21.167 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2023-07-14T13:35:21.167 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2023-07-14T13:35:21.168 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2023-07-14T13:35:21.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.168 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2023-07-14T13:35:21.168 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 23861 2023-07-14T13:35:21.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.168 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2023-07-14T13:35:21.169 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2023-07-14T13:35:21.169 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 240, 2023-07-14T13:35:21.169 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2023-07-14T13:35:21.169 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 7, 2023-07-14T13:35:21.169 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 158, 2023-07-14T13:35:21.169 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2023-07-14T13:35:21.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.170 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:35:21.170 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:21.170 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-07-14T13:35:21.170 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:21.170 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 4058961, 2023-07-14T13:35:21.170 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 331563636, 2023-07-14T13:35:21.170 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:21.170 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 4058961, 2023-07-14T13:35:21.171 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-07-14T13:35:21.171 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-07-14T13:35:21.171 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 4058961, 2023-07-14T13:35:21.171 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 331563636, 2023-07-14T13:35:21.171 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:21.171 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.171 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.171 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.172 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:21.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.172 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2023-07-14T13:35:21.172 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:21.172 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-07-14T13:35:21.172 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:21.172 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-07-14T13:35:21.173 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-07-14T13:35:21.173 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:21.173 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:21.173 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 20214, 2023-07-14T13:35:21.173 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 100172783, 2023-07-14T13:35:21.173 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 20214, 2023-07-14T13:35:21.173 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 100172783, 2023-07-14T13:35:21.174 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:21.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.174 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.174 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:21.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.175 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2023-07-14T13:35:21.175 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:21.175 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2023-07-14T13:35:21.175 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:21.175 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2023-07-14T13:35:21.175 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2023-07-14T13:35:21.175 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:21.176 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2023-07-14T13:35:21.176 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 20214, 2023-07-14T13:35:21.176 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 20214, 2023-07-14T13:35:21.176 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 20214, 2023-07-14T13:35:21.176 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 20214, 2023-07-14T13:35:21.176 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:21.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.177 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.177 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.177 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:21.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.177 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2023-07-14T13:35:21.177 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:21.177 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-07-14T13:35:21.178 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:21.178 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 158, 2023-07-14T13:35:21.178 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 17022, 2023-07-14T13:35:21.178 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:21.178 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 158, 2023-07-14T13:35:21.178 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-07-14T13:35:21.178 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-07-14T13:35:21.178 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 85, 2023-07-14T13:35:21.179 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 17022, 2023-07-14T13:35:21.179 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:21.179 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.179 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.179 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.179 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:21.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:21.180 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55acf85560a0": { 2023-07-14T13:35:21.180 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:21.180 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2023-07-14T13:35:21.180 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:21.180 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 20097, 2023-07-14T13:35:21.180 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 99779642, 2023-07-14T13:35:21.181 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:21.181 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 20097, 2023-07-14T13:35:21.181 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-07-14T13:35:21.181 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-07-14T13:35:21.181 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 8884, 2023-07-14T13:35:21.181 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 99779642, 2023-07-14T13:35:21.182 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:21.182 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:21.182 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:21.182 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:21.182 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:21.182 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:21.182 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-07-14T13:35:21.632 INFO:tasks.check_counter:Daemon mds.i mds.exported=123 2023-07-14T13:35:21.632 INFO:tasks.check_counter:Daemon mds.i mds.imported=121 2023-07-14T13:35:21.632 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=13 2023-07-14T13:35:21.632 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=304 2023-07-14T13:35:21.633 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2023-07-14T13:35:21.633 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-07-14T13:35:21.633 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-07-14T13:35:21.633 DEBUG:tasks.check_counter:Getting stats from l 2023-07-14T13:35:21.633 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3fc0089cc1082313a98853d48b892acdc1385b8b shell --fsid b31a3268-2244-11ee-9b33-001a4aab830c -- ceph daemon mds.l perf dump 2023-07-14T13:35:22.161 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:21 smithi135 ceph-mon[97338]: pgmap v1130: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-07-14T13:35:22.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:21 smithi135 ceph-mon[97338]: osdmap e149: 12 total, 12 up, 12 in 2023-07-14T13:35:22.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:21 smithi131 ceph-mon[96953]: pgmap v1130: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-07-14T13:35:22.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:21 smithi131 ceph-mon[96953]: osdmap e149: 12 total, 12 up, 12 in 2023-07-14T13:35:22.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:21 smithi017 ceph-mon[95536]: pgmap v1130: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.0 KiB/s wr, 7 op/s 2023-07-14T13:35:22.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:21 smithi017 ceph-mon[95536]: osdmap e149: 12 total, 12 up, 12 in 2023-07-14T13:35:22.362 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T13:35:24.000 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2023-07-14T13:35:24.000 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T13:35:24.000 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 0, 2023-07-14T13:35:24.000 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2, 2023-07-14T13:35:24.000 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 0, 2023-07-14T13:35:24.001 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 0, 2023-07-14T13:35:24.001 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2023-07-14T13:35:24.001 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 0, 2023-07-14T13:35:24.001 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.003005174, 2023-07-14T13:35:24.001 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.000000000, 2023-07-14T13:35:24.001 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.000546851, 2023-07-14T13:35:24.001 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:35:24.002 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:24.002 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:24.002 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:24.002 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:24.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:24.002 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:24.002 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:24.002 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:24.003 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:24.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:24.003 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T13:35:24.003 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T13:35:24.003 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:24.003 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T13:35:24.003 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 8, 2023-07-14T13:35:24.004 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 469, 2023-07-14T13:35:24.004 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3600, 2023-07-14T13:35:24.004 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 356032, 2023-07-14T13:35:24.004 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2023-07-14T13:35:24.004 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2023-07-14T13:35:24.004 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.028699877, 2023-07-14T13:35:24.004 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.019579333, 2023-07-14T13:35:24.004 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.003511901, 2023-07-14T13:35:24.005 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T13:35:24.005 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:24.005 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 467, 2023-07-14T13:35:24.005 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.053698186, 2023-07-14T13:35:24.005 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000114985 2023-07-14T13:35:24.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:24.005 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:24.005 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:24.006 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:24.006 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:24.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:24.006 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3600, 2023-07-14T13:35:24.006 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 356032 2023-07-14T13:35:24.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:24.006 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T13:35:24.007 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 619, 2023-07-14T13:35:24.007 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 609, 2023-07-14T13:35:24.007 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1536128, 2023-07-14T13:35:24.007 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 350032, 2023-07-14T13:35:24.007 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 2, 2023-07-14T13:35:24.007 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 1, 2023-07-14T13:35:24.007 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.102839714, 2023-07-14T13:35:24.008 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.041721479, 2023-07-14T13:35:24.008 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.048562625, 2023-07-14T13:35:24.008 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.014200987, 2023-07-14T13:35:24.008 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T13:35:24.008 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 608, 2023-07-14T13:35:24.008 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.059628978, 2023-07-14T13:35:24.008 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000098073 2023-07-14T13:35:24.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:24.009 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2023-07-14T13:35:24.009 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:24.009 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:24.009 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:24.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:24.009 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1536128, 2023-07-14T13:35:24.009 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 350032 2023-07-14T13:35:24.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:24.010 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2023-07-14T13:35:24.010 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 0, 2023-07-14T13:35:24.010 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2023-07-14T13:35:24.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:24.010 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2023-07-14T13:35:24.010 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2023-07-14T13:35:24.010 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2023-07-14T13:35:24.011 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T13:35:24.011 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2023-07-14T13:35:24.011 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T13:35:24.011 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2023-07-14T13:35:24.011 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T13:35:24.011 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T13:35:24.011 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T13:35:24.011 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T13:35:24.012 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T13:35:24.012 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2023-07-14T13:35:24.012 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T13:35:24.012 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T13:35:24.012 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2023-07-14T13:35:24.012 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2023-07-14T13:35:24.012 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2023-07-14T13:35:24.012 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2023-07-14T13:35:24.013 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T13:35:24.013 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T13:35:24.013 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T13:35:24.013 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T13:35:24.013 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T13:35:24.013 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2023-07-14T13:35:24.013 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2023-07-14T13:35:24.014 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2023-07-14T13:35:24.014 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T13:35:24.014 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T13:35:24.014 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2023-07-14T13:35:24.014 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2023-07-14T13:35:24.014 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2023-07-14T13:35:24.014 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2023-07-14T13:35:24.014 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T13:35:24.015 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2023-07-14T13:35:24.015 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T13:35:24.015 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2023-07-14T13:35:24.015 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 148754, 2023-07-14T13:35:24.015 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 31, 2023-07-14T13:35:24.015 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2023-07-14T13:35:24.015 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2023-07-14T13:35:24.015 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2023-07-14T13:35:24.016 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2023-07-14T13:35:24.016 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2023-07-14T13:35:24.016 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2023-07-14T13:35:24.016 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2023-07-14T13:35:24.016 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2023-07-14T13:35:24.016 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 0, 2023-07-14T13:35:24.016 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 0, 2023-07-14T13:35:24.017 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T13:35:24.017 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2023-07-14T13:35:24.017 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2023-07-14T13:35:24.017 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2023-07-14T13:35:24.017 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 928, 2023-07-14T13:35:24.017 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 2, 2023-07-14T13:35:24.017 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2023-07-14T13:35:24.017 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2023-07-14T13:35:24.018 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2023-07-14T13:35:24.018 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2023-07-14T13:35:24.018 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2023-07-14T13:35:24.018 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T13:35:24.018 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2023-07-14T13:35:24.018 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2023-07-14T13:35:24.018 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2023-07-14T13:35:24.019 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 623, 2023-07-14T13:35:24.019 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1448593, 2023-07-14T13:35:24.019 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2023-07-14T13:35:24.019 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 623, 2023-07-14T13:35:24.019 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2023-07-14T13:35:24.019 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2023-07-14T13:35:24.019 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 623, 2023-07-14T13:35:24.019 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1448593, 2023-07-14T13:35:24.020 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2023-07-14T13:35:24.020 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2023-07-14T13:35:24.020 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2023-07-14T13:35:24.020 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2023-07-14T13:35:24.020 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:24.020 INFO:teuthology.orchestra.run.smithi135.stdout: } 2023-07-14T13:35:24.020 INFO:teuthology.orchestra.run.smithi135.stdout:} 2023-07-14T13:35:24.021 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:23 smithi135 ceph-mon[97338]: pgmap v1132: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2023-07-14T13:35:24.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:23 smithi131 ceph-mon[96953]: pgmap v1132: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2023-07-14T13:35:24.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:23 smithi017 ceph-mon[95536]: pgmap v1132: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2023-07-14T13:35:24.536 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2023-07-14T13:35:24.536 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2023-07-14T13:35:24.537 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2023-07-14T13:35:24.537 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2023-07-14T13:35:24.537 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2023-07-14T13:35:24.537 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2023-07-14T13:35:24.538 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2023-07-14T13:35:24.538 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-07-14T13:35:24.548 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-07-14T13:35:24.549 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T13:35:24.549 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:35:24.610 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T13:35:24.610 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:35:24.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:35:24.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.954+0000 7f4185fff700 1 -- 172.21.15.17:0/2385599718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4180100480 msgr2=0x7f418010c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:24.948 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.954+0000 7f4185fff700 1 --2- 172.21.15.17:0/2385599718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4180100480 0x7f418010c910 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f417800b0a0 tx=0x7f417800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:35:24.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.954+0000 7f4185fff700 1 -- 172.21.15.17:0/2385599718 shutdown_connections 2023-07-14T13:35:24.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.954+0000 7f4185fff700 1 --2- 172.21.15.17:0/2385599718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4180100480 0x7f418010c910 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:24.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.954+0000 7f4185fff700 1 --2- 172.21.15.17:0/2385599718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4180105ae0 0x7f4180105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:24.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.954+0000 7f4185fff700 1 --2- 172.21.15.17:0/2385599718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41800ffad0 0x7f41800fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:24.949 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.954+0000 7f4185fff700 1 -- 172.21.15.17:0/2385599718 >> 172.21.15.17:0/2385599718 conn(0x7f41800fb590 msgr2=0x7f41800fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:24.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.954+0000 7f4185fff700 1 -- 172.21.15.17:0/2385599718 shutdown_connections 2023-07-14T13:35:24.950 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.954+0000 7f4185fff700 1 -- 172.21.15.17:0/2385599718 wait complete. 2023-07-14T13:35:24.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.955+0000 7f4185fff700 1 Processor -- start 2023-07-14T13:35:24.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.955+0000 7f4185fff700 1 -- start start 2023-07-14T13:35:24.952 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f4185fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41800ffad0 0x7f418019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:24.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f4185fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4180100480 0x7f418019be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:24.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f4185fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4180105ae0 0x7f4180195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:24.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f4185fff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180196000 con 0x7f41800ffad0 2023-07-14T13:35:24.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f4185fff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180196170 con 0x7f4180100480 2023-07-14T13:35:24.953 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f4185fff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180196330 con 0x7f4180105ae0 2023-07-14T13:35:24.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f417f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41800ffad0 0x7f418019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:24.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f417f7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41800ffad0 0x7f418019b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58858/0 (socket says 172.21.15.17:58858) 2023-07-14T13:35:24.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f417f7fe700 1 -- 172.21.15.17:0/2225995156 learned_addr learned my addr 172.21.15.17:0/2225995156 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:35:24.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f417effd700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4180100480 0x7f418019be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:24.954 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f417f7fe700 1 -- 172.21.15.17:0/2225995156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4180105ae0 msgr2=0x7f4180195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:24.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f417f7fe700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4180105ae0 0x7f4180195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:24.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f417f7fe700 1 -- 172.21.15.17:0/2225995156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4180100480 msgr2=0x7f418019be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:24.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f417f7fe700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4180100480 0x7f418019be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:24.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.956+0000 7f417f7fe700 1 -- 172.21.15.17:0/2225995156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178009d00 con 0x7f41800ffad0 2023-07-14T13:35:24.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.957+0000 7f417f7fe700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41800ffad0 0x7f418019b920 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f417000e9a0 tx=0x7f417000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:24.955 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.957+0000 7f417cff9700 1 -- 172.21.15.17:0/2225995156 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170009790 con 0x7f41800ffad0 2023-07-14T13:35:24.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.957+0000 7f417cff9700 1 -- 172.21.15.17:0/2225995156 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f417000cbd0 con 0x7f41800ffad0 2023-07-14T13:35:24.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.957+0000 7f417cff9700 1 -- 172.21.15.17:0/2225995156 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170018680 con 0x7f41800ffad0 2023-07-14T13:35:24.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.957+0000 7f4185fff700 1 -- 172.21.15.17:0/2225995156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4180196610 con 0x7f41800ffad0 2023-07-14T13:35:24.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.957+0000 7f4185fff700 1 -- 172.21.15.17:0/2225995156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41801a2910 con 0x7f41800ffad0 2023-07-14T13:35:24.956 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.958+0000 7f4185fff700 1 -- 172.21.15.17:0/2225995156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4180067300 con 0x7f41800ffad0 2023-07-14T13:35:24.957 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.960+0000 7f417cff9700 1 -- 172.21.15.17:0/2225995156 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f417000cd40 con 0x7f41800ffad0 2023-07-14T13:35:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.961+0000 7f417cff9700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41680a1380 0x7f41680a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.962+0000 7f417cff9700 1 -- 172.21.15.17:0/2225995156 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4170014070 con 0x7f41800ffad0 2023-07-14T13:35:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.962+0000 7f417effd700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41680a1380 0x7f41680a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:24.958 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.962+0000 7f417effd700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41680a1380 0x7f41680a3830 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4180105260 tx=0x7f4174009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:24.959 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:24.965+0000 7f417cff9700 1 -- 172.21.15.17:0/2225995156 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f4170051790 con 0x7f41800ffad0 2023-07-14T13:35:25.172 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.178+0000 7f4185fff700 1 -- 172.21.15.17:0/2225995156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4180196ea0 con 0x7f41800ffad0 2023-07-14T13:35:25.174 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.180+0000 7f417cff9700 1 -- 172.21.15.17:0/2225995156 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+22939 (secure 0 0 0) 0x7f4170099e40 con 0x7f41800ffad0 2023-07-14T13:35:25.175 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:35:25.175 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":149,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T13:35:21.858336+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":67,"snap_epoch":148,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/645612714":"2023-07-15T12:59:43.864189+0000","172.21.15.17:0/1809272973":"2023-07-15T12:59:43.864189+0000","172.21.15.17:6800/2034486077":"2023-07-15T12:59:43.864189+0000","172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/2034486077":"2023-07-15T12:59:43.864189+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/895305494":"2023-07-15T12:59:43.864189+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1285371613":"2023-07-15T12:59:43.864189+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":54,"length":1},{"begin":67,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:35:25.177 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.182+0000 7f4185fff700 1 -- 172.21.15.17:0/2225995156 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41680a1380 msgr2=0x7f41680a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:25.178 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.182+0000 7f4185fff700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41680a1380 0x7f41680a3830 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4180105260 tx=0x7f4174009260 comp rx=0 tx=0).stop 2023-07-14T13:35:25.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.182+0000 7f4185fff700 1 -- 172.21.15.17:0/2225995156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41800ffad0 msgr2=0x7f418019b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:25.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.182+0000 7f4185fff700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41800ffad0 0x7f418019b920 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f417000e9a0 tx=0x7f417000ed60 comp rx=0 tx=0).stop 2023-07-14T13:35:25.179 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.183+0000 7f4185fff700 1 -- 172.21.15.17:0/2225995156 shutdown_connections 2023-07-14T13:35:25.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.183+0000 7f4185fff700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f41680a1380 0x7f41680a3830 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.183+0000 7f4185fff700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4180105ae0 0x7f4180195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.183+0000 7f4185fff700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41800ffad0 0x7f418019b920 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.180 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.183+0000 7f4185fff700 1 --2- 172.21.15.17:0/2225995156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4180100480 0x7f418019be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.183+0000 7f4185fff700 1 -- 172.21.15.17:0/2225995156 >> 172.21.15.17:0/2225995156 conn(0x7f41800fb590 msgr2=0x7f41800fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:25.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.183+0000 7f4185fff700 1 -- 172.21.15.17:0/2225995156 shutdown_connections 2023-07-14T13:35:25.181 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.183+0000 7f4185fff700 1 -- 172.21.15.17:0/2225995156 wait complete. 2023-07-14T13:35:25.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:57:37.876360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:57:39.117456+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 67, 'snap_epoch': 148, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:35:25.198 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:35:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.417+0000 7ff643dff700 1 -- 172.21.15.17:0/3580165122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0728b0 msgr2=0x7ff63c072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:25.411 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.417+0000 7ff643dff700 1 --2- 172.21.15.17:0/3580165122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0728b0 0x7ff63c072c80 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ff638009990 tx=0x7ff638009ca0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.417+0000 7ff643dff700 1 -- 172.21.15.17:0/3580165122 shutdown_connections 2023-07-14T13:35:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.417+0000 7ff643dff700 1 --2- 172.21.15.17:0/3580165122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff63c10c310 0x7ff63c10e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.417+0000 7ff643dff700 1 --2- 172.21.15.17:0/3580165122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0728b0 0x7ff63c072c80 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.417+0000 7ff643dff700 1 --2- 172.21.15.17:0/3580165122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff63c0731c0 0x7ff63c10bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.417+0000 7ff643dff700 1 -- 172.21.15.17:0/3580165122 >> 172.21.15.17:0/3580165122 conn(0x7ff63c0fb5f0 msgr2=0x7ff63c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:25.412 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.417+0000 7ff643dff700 1 -- 172.21.15.17:0/3580165122 shutdown_connections 2023-07-14T13:35:25.413 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.418+0000 7ff643dff700 1 -- 172.21.15.17:0/3580165122 wait complete. 2023-07-14T13:35:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.419+0000 7ff643dff700 1 Processor -- start 2023-07-14T13:35:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.419+0000 7ff643dff700 1 -- start start 2023-07-14T13:35:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff643dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff63c0728b0 0x7ff63c19dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff643dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff63c0731c0 0x7ff63c19e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff643dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c10c310 0x7ff63c197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:25.415 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff643dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c1981a0 con 0x7ff63c10c310 2023-07-14T13:35:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff643dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c198310 con 0x7ff63c0728b0 2023-07-14T13:35:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff643dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c1984d0 con 0x7ff63c0731c0 2023-07-14T13:35:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff64239c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c10c310 0x7ff63c197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff64239c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c10c310 0x7ff63c197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58882/0 (socket says 172.21.15.17:58882) 2023-07-14T13:35:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff64239c700 1 -- 172.21.15.17:0/544203447 learned_addr learned my addr 172.21.15.17:0/544203447 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:35:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff641b9b700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff63c0728b0 0x7ff63c19dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:25.416 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff64139a700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff63c0731c0 0x7ff63c19e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff64239c700 1 -- 172.21.15.17:0/544203447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff63c0731c0 msgr2=0x7ff63c19e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff64239c700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff63c0731c0 0x7ff63c19e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.417 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff64239c700 1 -- 172.21.15.17:0/544203447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff63c0728b0 msgr2=0x7ff63c19dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:25.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff64239c700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff63c0728b0 0x7ff63c19dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.420+0000 7ff64239c700 1 -- 172.21.15.17:0/544203447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6380095f0 con 0x7ff63c10c310 2023-07-14T13:35:25.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.421+0000 7ff64239c700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c10c310 0x7ff63c197b30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7ff634007d70 tx=0x7ff63400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:25.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.421+0000 7ff632ffd700 1 -- 172.21.15.17:0/544203447 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63400ad40 con 0x7ff63c10c310 2023-07-14T13:35:25.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.421+0000 7ff643dff700 1 -- 172.21.15.17:0/544203447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c1987b0 con 0x7ff63c10c310 2023-07-14T13:35:25.418 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.421+0000 7ff632ffd700 1 -- 172.21.15.17:0/544203447 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6340128b0 con 0x7ff63c10c310 2023-07-14T13:35:25.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.421+0000 7ff632ffd700 1 -- 172.21.15.17:0/544203447 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340115a0 con 0x7ff63c10c310 2023-07-14T13:35:25.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.421+0000 7ff643dff700 1 -- 172.21.15.17:0/544203447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c1a4ab0 con 0x7ff63c10c310 2023-07-14T13:35:25.419 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.422+0000 7ff643dff700 1 -- 172.21.15.17:0/544203447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63c067290 con 0x7ff63c10c310 2023-07-14T13:35:25.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.424+0000 7ff632ffd700 1 -- 172.21.15.17:0/544203447 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7ff634012a20 con 0x7ff63c10c310 2023-07-14T13:35:25.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.425+0000 7ff632ffd700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6280a12c0 0x7ff6280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:25.420 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.426+0000 7ff632ffd700 1 -- 172.21.15.17:0/544203447 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff6340cd270 con 0x7ff63c10c310 2023-07-14T13:35:25.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.426+0000 7ff641b9b700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6280a12c0 0x7ff6280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:25.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.426+0000 7ff641b9b700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6280a12c0 0x7ff6280a3770 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff63800b5c0 tx=0x7ff638009f00 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:25.421 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.427+0000 7ff632ffd700 1 -- 172.21.15.17:0/544203447 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7ff634096750 con 0x7ff63c10c310 2023-07-14T13:35:25.628 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.634+0000 7ff643dff700 1 -- 172.21.15.17:0/544203447 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff63c1a4da0 con 0x7ff63c10c310 2023-07-14T13:35:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.635+0000 7ff632ffd700 1 -- 172.21.15.17:0/544203447 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff634023350 con 0x7ff63c10c310 2023-07-14T13:35:25.629 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T13:35:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.637+0000 7ff643dff700 1 -- 172.21.15.17:0/544203447 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6280a12c0 msgr2=0x7ff6280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.637+0000 7ff643dff700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6280a12c0 0x7ff6280a3770 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff63800b5c0 tx=0x7ff638009f00 comp rx=0 tx=0).stop 2023-07-14T13:35:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.637+0000 7ff643dff700 1 -- 172.21.15.17:0/544203447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c10c310 msgr2=0x7ff63c197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.637+0000 7ff643dff700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c10c310 0x7ff63c197b30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7ff634007d70 tx=0x7ff63400a340 comp rx=0 tx=0).stop 2023-07-14T13:35:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.637+0000 7ff643dff700 1 -- 172.21.15.17:0/544203447 shutdown_connections 2023-07-14T13:35:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.637+0000 7ff643dff700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7ff6280a12c0 0x7ff6280a3770 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.637+0000 7ff643dff700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c10c310 0x7ff63c197b30 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.637+0000 7ff643dff700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff63c0728b0 0x7ff63c19dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.637+0000 7ff643dff700 1 --2- 172.21.15.17:0/544203447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff63c0731c0 0x7ff63c19e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.637+0000 7ff643dff700 1 -- 172.21.15.17:0/544203447 >> 172.21.15.17:0/544203447 conn(0x7ff63c0fb5f0 msgr2=0x7ff63c10e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.637+0000 7ff643dff700 1 -- 172.21.15.17:0/544203447 shutdown_connections 2023-07-14T13:35:25.632 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.638+0000 7ff643dff700 1 -- 172.21.15.17:0/544203447 wait complete. 2023-07-14T13:35:25.650 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:35:25.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.862+0000 7fcc187ff700 1 -- 172.21.15.17:0/846199730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc10105ae0 msgr2=0x7fcc10105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:25.856 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.862+0000 7fcc187ff700 1 --2- 172.21.15.17:0/846199730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc10105ae0 0x7fcc10105eb0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009990 tx=0x7fcc0c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.862+0000 7fcc187ff700 1 -- 172.21.15.17:0/846199730 shutdown_connections 2023-07-14T13:35:25.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.862+0000 7fcc187ff700 1 --2- 172.21.15.17:0/846199730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc10100480 0x7fcc1010c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.862+0000 7fcc187ff700 1 --2- 172.21.15.17:0/846199730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc10105ae0 0x7fcc10105eb0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.862+0000 7fcc187ff700 1 --2- 172.21.15.17:0/846199730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc100ffad0 0x7fcc100fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.862+0000 7fcc187ff700 1 -- 172.21.15.17:0/846199730 >> 172.21.15.17:0/846199730 conn(0x7fcc100fb5f0 msgr2=0x7fcc100fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:25.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.863+0000 7fcc187ff700 1 -- 172.21.15.17:0/846199730 shutdown_connections 2023-07-14T13:35:25.857 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.863+0000 7fcc187ff700 1 -- 172.21.15.17:0/846199730 wait complete. 2023-07-14T13:35:25.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc187ff700 1 Processor -- start 2023-07-14T13:35:25.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc187ff700 1 -- start start 2023-07-14T13:35:25.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc187ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc100ffad0 0x7fcc1019da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:25.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc187ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc10100480 0x7fcc1019dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:25.859 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc187ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc10105ae0 0x7fcc10197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc187ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10198140 con 0x7fcc10105ae0 2023-07-14T13:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc187ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc101982b0 con 0x7fcc100ffad0 2023-07-14T13:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc187ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10198470 con 0x7fcc10100480 2023-07-14T13:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc16d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc10105ae0 0x7fcc10197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc16d9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc10105ae0 0x7fcc10197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58902/0 (socket says 172.21.15.17:58902) 2023-07-14T13:35:25.860 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc16d9c700 1 -- 172.21.15.17:0/3876489180 learned_addr learned my addr 172.21.15.17:0/3876489180 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.864+0000 7fcc1659b700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc100ffad0 0x7fcc1019da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc15d9a700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc10100480 0x7fcc1019dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc16d9c700 1 -- 172.21.15.17:0/3876489180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc10100480 msgr2=0x7fcc1019dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc16d9c700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc10100480 0x7fcc1019dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc16d9c700 1 -- 172.21.15.17:0/3876489180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc100ffad0 msgr2=0x7fcc1019da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:25.861 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc16d9c700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc100ffad0 0x7fcc1019da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc16d9c700 1 -- 172.21.15.17:0/3876489180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c0095f0 con 0x7fcc10105ae0 2023-07-14T13:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc16d9c700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc10105ae0 0x7fcc10197ad0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fcc08007ee0 tx=0x7fcc0800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc077fe700 1 -- 172.21.15.17:0/3876489180 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08017070 con 0x7fcc10105ae0 2023-07-14T13:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc077fe700 1 -- 172.21.15.17:0/3876489180 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc0800f040 con 0x7fcc10105ae0 2023-07-14T13:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc187ff700 1 -- 172.21.15.17:0/3876489180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc10198750 con 0x7fcc10105ae0 2023-07-14T13:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc077fe700 1 -- 172.21.15.17:0/3876489180 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08005710 con 0x7fcc10105ae0 2023-07-14T13:35:25.862 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.865+0000 7fcc187ff700 1 -- 172.21.15.17:0/3876489180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc101a4a50 con 0x7fcc10105ae0 2023-07-14T13:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.866+0000 7fcc187ff700 1 -- 172.21.15.17:0/3876489180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc10067290 con 0x7fcc10105ae0 2023-07-14T13:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.868+0000 7fcc077fe700 1 -- 172.21.15.17:0/3876489180 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fcc08005870 con 0x7fcc10105ae0 2023-07-14T13:35:25.863 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.870+0000 7fcc077fe700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcbfc0a1340 0x7fcbfc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:25.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.870+0000 7fcc077fe700 1 -- 172.21.15.17:0/3876489180 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcc080cc4b0 con 0x7fcc10105ae0 2023-07-14T13:35:25.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.870+0000 7fcc1659b700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcbfc0a1340 0x7fcbfc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:25.864 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.871+0000 7fcc1659b700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcbfc0a1340 0x7fcbfc0a37f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00b5c0 tx=0x7fcc0c009f00 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:25.867 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:25.873+0000 7fcc077fe700 1 -- 172.21.15.17:0/3876489180 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fcc08095880 con 0x7fcc10105ae0 2023-07-14T13:35:26.069 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:25 smithi017 ceph-mon[95536]: pgmap v1133: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2023-07-14T13:35:26.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:25 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2225995156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T13:35:26.070 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:25 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/544203447' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T13:35:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.085+0000 7fcc187ff700 1 -- 172.21.15.17:0/3876489180 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc101a4e00 con 0x7fcc10105ae0 2023-07-14T13:35:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.085+0000 7fcc077fe700 1 -- 172.21.15.17:0/3876489180 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v149) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc08098ea0 con 0x7fcc10105ae0 2023-07-14T13:35:26.079 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-07-14T13:35:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 -- 172.21.15.17:0/3876489180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcbfc0a1340 msgr2=0x7fcbfc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcbfc0a1340 0x7fcbfc0a37f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00b5c0 tx=0x7fcc0c009f00 comp rx=0 tx=0).stop 2023-07-14T13:35:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 -- 172.21.15.17:0/3876489180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc10105ae0 msgr2=0x7fcc10197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc10105ae0 0x7fcc10197ad0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fcc08007ee0 tx=0x7fcc0800d3b0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 -- 172.21.15.17:0/3876489180 shutdown_connections 2023-07-14T13:35:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fcbfc0a1340 0x7fcbfc0a37f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc10105ae0 0x7fcc10197ad0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc100ffad0 0x7fcc1019da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 --2- 172.21.15.17:0/3876489180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc10100480 0x7fcc1019dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 -- 172.21.15.17:0/3876489180 >> 172.21.15.17:0/3876489180 conn(0x7fcc100fb5f0 msgr2=0x7fcc1010adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 -- 172.21.15.17:0/3876489180 shutdown_connections 2023-07-14T13:35:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.088+0000 7fcc187ff700 1 -- 172.21.15.17:0/3876489180 wait complete. 2023-07-14T13:35:26.100 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:35:26.161 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:25 smithi135 ceph-mon[97338]: pgmap v1133: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2023-07-14T13:35:26.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:25 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2225995156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T13:35:26.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:25 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/544203447' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T13:35:26.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:25 smithi131 ceph-mon[96953]: pgmap v1133: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 6 op/s 2023-07-14T13:35:26.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:25 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2225995156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T13:35:26.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:25 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/544203447' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T13:35:26.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.312+0000 7fa5a99ff700 1 -- 172.21.15.17:0/2059324620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a40ffad0 msgr2=0x7fa5a40fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.312+0000 7fa5a99ff700 1 --2- 172.21.15.17:0/2059324620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a40ffad0 0x7fa5a40fff40 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009990 tx=0x7fa58c009ca0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.312+0000 7fa5a99ff700 1 -- 172.21.15.17:0/2059324620 shutdown_connections 2023-07-14T13:35:26.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.312+0000 7fa5a99ff700 1 --2- 172.21.15.17:0/2059324620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a4100480 0x7fa5a410c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.312+0000 7fa5a99ff700 1 --2- 172.21.15.17:0/2059324620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5a4105ae0 0x7fa5a4105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.312+0000 7fa5a99ff700 1 --2- 172.21.15.17:0/2059324620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a40ffad0 0x7fa5a40fff40 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.312+0000 7fa5a99ff700 1 -- 172.21.15.17:0/2059324620 >> 172.21.15.17:0/2059324620 conn(0x7fa5a40fb5f0 msgr2=0x7fa5a40fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:26.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.312+0000 7fa5a99ff700 1 -- 172.21.15.17:0/2059324620 shutdown_connections 2023-07-14T13:35:26.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.312+0000 7fa5a99ff700 1 -- 172.21.15.17:0/2059324620 wait complete. 2023-07-14T13:35:26.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.313+0000 7fa5a99ff700 1 Processor -- start 2023-07-14T13:35:26.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.313+0000 7fa5a99ff700 1 -- start start 2023-07-14T13:35:26.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.313+0000 7fa5a99ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a40ffad0 0x7fa5a4197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:26.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.313+0000 7fa5a99ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4100480 0x7fa5a41982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:26.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa5a99ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5a4105ae0 0x7fa5a419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:26.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa5a99ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a419cd40 con 0x7fa5a4100480 2023-07-14T13:35:26.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa5a99ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a419ceb0 con 0x7fa5a40ffad0 2023-07-14T13:35:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa5a99ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a419d070 con 0x7fa5a4105ae0 2023-07-14T13:35:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa59bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4100480 0x7fa5a41982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa59bfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4100480 0x7fa5a41982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58920/0 (socket says 172.21.15.17:58920) 2023-07-14T13:35:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa59bfff700 1 -- 172.21.15.17:0/951788691 learned_addr learned my addr 172.21.15.17:0/951788691 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:35:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa5a2ffd700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a40ffad0 0x7fa5a4197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa5a37fe700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5a4105ae0 0x7fa5a419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa59bfff700 1 -- 172.21.15.17:0/951788691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5a4105ae0 msgr2=0x7fa5a419c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa59bfff700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5a4105ae0 0x7fa5a419c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa59bfff700 1 -- 172.21.15.17:0/951788691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a40ffad0 msgr2=0x7fa5a4197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa59bfff700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a40ffad0 0x7fa5a4197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa59bfff700 1 -- 172.21.15.17:0/951788691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0095f0 con 0x7fa5a4100480 2023-07-14T13:35:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.314+0000 7fa5a37fe700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5a4105ae0 0x7fa5a419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:35:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.315+0000 7fa59bfff700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4100480 0x7fa5a41982a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fa58c005910 tx=0x7fa58c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.315+0000 7fa5a89fd700 1 -- 172.21.15.17:0/951788691 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c01d070 con 0x7fa5a4100480 2023-07-14T13:35:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.315+0000 7fa5a99ff700 1 -- 172.21.15.17:0/951788691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a419d2f0 con 0x7fa5a4100480 2023-07-14T13:35:26.311 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.315+0000 7fa5a89fd700 1 -- 172.21.15.17:0/951788691 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa58c003ec0 con 0x7fa5a4100480 2023-07-14T13:35:26.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.315+0000 7fa5a89fd700 1 -- 172.21.15.17:0/951788691 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c00fb50 con 0x7fa5a4100480 2023-07-14T13:35:26.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.315+0000 7fa5a99ff700 1 -- 172.21.15.17:0/951788691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a41a4b90 con 0x7fa5a4100480 2023-07-14T13:35:26.312 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.316+0000 7fa5a99ff700 1 -- 172.21.15.17:0/951788691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a4067290 con 0x7fa5a4100480 2023-07-14T13:35:26.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.318+0000 7fa5a89fd700 1 -- 172.21.15.17:0/951788691 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa58c004030 con 0x7fa5a4100480 2023-07-14T13:35:26.313 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.320+0000 7fa5a89fd700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5900a12c0 0x7fa5900a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.320+0000 7fa5a89fd700 1 -- 172.21.15.17:0/951788691 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa58c0cdd90 con 0x7fa5a4100480 2023-07-14T13:35:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.320+0000 7fa5a2ffd700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5900a12c0 0x7fa5900a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.321+0000 7fa5a2ffd700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5900a12c0 0x7fa5900a3770 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa594005950 tx=0x7fa59400b410 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:26.315 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.321+0000 7fa5a89fd700 1 -- 172.21.15.17:0/951788691 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa58c0971f0 con 0x7fa5a4100480 2023-07-14T13:35:26.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.532+0000 7fa5a99ff700 1 -- 172.21.15.17:0/951788691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa5a41a4d20 con 0x7fa5a4100480 2023-07-14T13:35:26.526 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.532+0000 7fa5a89fd700 1 -- 172.21.15.17:0/951788691 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v149) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa58c09a810 con 0x7fa5a4100480 2023-07-14T13:35:26.527 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-07-14T13:35:26.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 -- 172.21.15.17:0/951788691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5900a12c0 msgr2=0x7fa5900a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5900a12c0 0x7fa5900a3770 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa594005950 tx=0x7fa59400b410 comp rx=0 tx=0).stop 2023-07-14T13:35:26.529 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 -- 172.21.15.17:0/951788691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4100480 msgr2=0x7fa5a41982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4100480 0x7fa5a41982a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fa58c005910 tx=0x7fa58c009580 comp rx=0 tx=0).stop 2023-07-14T13:35:26.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 -- 172.21.15.17:0/951788691 shutdown_connections 2023-07-14T13:35:26.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa5900a12c0 0x7fa5900a3770 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa5a4105ae0 0x7fa5a419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a40ffad0 0x7fa5a4197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.530 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 --2- 172.21.15.17:0/951788691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5a4100480 0x7fa5a41982a0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 -- 172.21.15.17:0/951788691 >> 172.21.15.17:0/951788691 conn(0x7fa5a40fb5f0 msgr2=0x7fa5a410aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:26.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 -- 172.21.15.17:0/951788691 shutdown_connections 2023-07-14T13:35:26.531 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.535+0000 7fa5a99ff700 1 -- 172.21.15.17:0/951788691 wait complete. 2023-07-14T13:35:26.547 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:35:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.756+0000 7fbc57dff700 1 -- 172.21.15.17:0/1502825547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc500ffad0 msgr2=0x7fbc500fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.756+0000 7fbc57dff700 1 --2- 172.21.15.17:0/1502825547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc500ffad0 0x7fbc500fff40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009990 tx=0x7fbc40009ca0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.751 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.757+0000 7fbc57dff700 1 -- 172.21.15.17:0/1502825547 shutdown_connections 2023-07-14T13:35:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.757+0000 7fbc57dff700 1 --2- 172.21.15.17:0/1502825547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc50100480 0x7fbc5010c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.757+0000 7fbc57dff700 1 --2- 172.21.15.17:0/1502825547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc50105ae0 0x7fbc50105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.757+0000 7fbc57dff700 1 --2- 172.21.15.17:0/1502825547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc500ffad0 0x7fbc500fff40 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.757+0000 7fbc57dff700 1 -- 172.21.15.17:0/1502825547 >> 172.21.15.17:0/1502825547 conn(0x7fbc500fb5f0 msgr2=0x7fbc500fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.757+0000 7fbc57dff700 1 -- 172.21.15.17:0/1502825547 shutdown_connections 2023-07-14T13:35:26.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.757+0000 7fbc57dff700 1 -- 172.21.15.17:0/1502825547 wait complete. 2023-07-14T13:35:26.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.758+0000 7fbc57dff700 1 Processor -- start 2023-07-14T13:35:26.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.758+0000 7fbc57dff700 1 -- start start 2023-07-14T13:35:26.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.759+0000 7fbc57dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc500ffad0 0x7fbc50072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:26.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.759+0000 7fbc57dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc50100480 0x7fbc50072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.759+0000 7fbc57dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc50105ae0 0x7fbc501a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.759+0000 7fbc57dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50073580 con 0x7fbc50100480 2023-07-14T13:35:26.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.759+0000 7fbc57dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc501a4280 con 0x7fbc500ffad0 2023-07-14T13:35:26.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.759+0000 7fbc57dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc501a43c0 con 0x7fbc50105ae0 2023-07-14T13:35:26.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.759+0000 7fbc5539a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc50100480 0x7fbc50072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:26.758 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.759+0000 7fbc5539a700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc50100480 0x7fbc50072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58944/0 (socket says 172.21.15.17:58944) 2023-07-14T13:35:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.759+0000 7fbc5539a700 1 -- 172.21.15.17:0/3910552399 learned_addr learned my addr 172.21.15.17:0/3910552399 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:35:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.759+0000 7fbc55b9b700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc500ffad0 0x7fbc50072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.759+0000 7fbc5639c700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc50105ae0 0x7fbc501a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc5539a700 1 -- 172.21.15.17:0/3910552399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc50105ae0 msgr2=0x7fbc501a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.759 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc5539a700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc50105ae0 0x7fbc501a3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc5539a700 1 -- 172.21.15.17:0/3910552399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc500ffad0 msgr2=0x7fbc50072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc5539a700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc500ffad0 0x7fbc50072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc5539a700 1 -- 172.21.15.17:0/3910552399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc400095f0 con 0x7fbc50100480 2023-07-14T13:35:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc5639c700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc50105ae0 0x7fbc501a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:35:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc5539a700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc50100480 0x7fbc50072d50 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fbc40006010 tx=0x7fbc40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc46ffd700 1 -- 172.21.15.17:0/3910552399 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4001d070 con 0x7fbc50100480 2023-07-14T13:35:26.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc46ffd700 1 -- 172.21.15.17:0/3910552399 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc40004000 con 0x7fbc50100480 2023-07-14T13:35:26.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc57dff700 1 -- 172.21.15.17:0/3910552399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc501a45c0 con 0x7fbc50100480 2023-07-14T13:35:26.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc46ffd700 1 -- 172.21.15.17:0/3910552399 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40022ac0 con 0x7fbc50100480 2023-07-14T13:35:26.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.760+0000 7fbc57dff700 1 -- 172.21.15.17:0/3910552399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc501a49e0 con 0x7fbc50100480 2023-07-14T13:35:26.761 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.761+0000 7fbc57dff700 1 -- 172.21.15.17:0/3910552399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc50067290 con 0x7fbc50100480 2023-07-14T13:35:26.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.763+0000 7fbc46ffd700 1 -- 172.21.15.17:0/3910552399 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fbc40003b70 con 0x7fbc50100480 2023-07-14T13:35:26.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.765+0000 7fbc46ffd700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc3c0a12c0 0x7fbc3c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:26.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.765+0000 7fbc46ffd700 1 -- 172.21.15.17:0/3910552399 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbc400ce400 con 0x7fbc50100480 2023-07-14T13:35:26.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.765+0000 7fbc55b9b700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc3c0a12c0 0x7fbc3c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:26.762 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.766+0000 7fbc55b9b700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc3c0a12c0 0x7fbc3c0a3770 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c005950 tx=0x7fbc4c00b410 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:26.763 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.769+0000 7fbc46ffd700 1 -- 172.21.15.17:0/3910552399 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fbc40097860 con 0x7fbc50100480 2023-07-14T13:35:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:26.999+0000 7fbc57dff700 1 -- 172.21.15.17:0/3910552399 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc501a4bd0 con 0x7fbc50100480 2023-07-14T13:35:26.993 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.000+0000 7fbc46ffd700 1 -- 172.21.15.17:0/3910552399 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v149) v1 ==== 81+0+942 (secure 0 0 0) 0x7fbc4009ae80 con 0x7fbc50100480 2023-07-14T13:35:26.994 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/645612714 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:26.994 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1809272973 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:26.994 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2034486077 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:26.994 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/1783581931 2023-07-15T12:50:06.734862+0000 2023-07-14T13:35:26.994 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2034486077 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:26.994 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/1783581931 2023-07-15T12:50:06.734862+0000 2023-07-14T13:35:26.994 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/895305494 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:26.995 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/289337901 2023-07-15T12:50:06.734862+0000 2023-07-14T13:35:26.995 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3639458654 2023-07-15T12:49:39.980336+0000 2023-07-14T13:35:26.995 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/135468511 2023-07-15T12:50:06.734862+0000 2023-07-14T13:35:26.995 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3639458654 2023-07-15T12:49:39.980336+0000 2023-07-14T13:35:26.995 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1204213342 2023-07-15T12:49:39.980336+0000 2023-07-14T13:35:26.995 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1285371613 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:26.996 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2727688865 2023-07-15T12:49:39.980336+0000 2023-07-14T13:35:26.996 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3042541598 2023-07-15T12:50:06.734862+0000 2023-07-14T13:35:26.996 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3837590693 2023-07-15T12:49:39.980336+0000 2023-07-14T13:35:26.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 -- 172.21.15.17:0/3910552399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc3c0a12c0 msgr2=0x7fbc3c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc3c0a12c0 0x7fbc3c0a3770 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c005950 tx=0x7fbc4c00b410 comp rx=0 tx=0).stop 2023-07-14T13:35:26.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 -- 172.21.15.17:0/3910552399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc50100480 msgr2=0x7fbc50072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:26.997 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc50100480 0x7fbc50072d50 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fbc40006010 tx=0x7fbc40004730 comp rx=0 tx=0).stop 2023-07-14T13:35:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 -- 172.21.15.17:0/3910552399 shutdown_connections 2023-07-14T13:35:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fbc3c0a12c0 0x7fbc3c0a3770 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc50105ae0 0x7fbc501a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc500ffad0 0x7fbc50072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 --2- 172.21.15.17:0/3910552399 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc50100480 0x7fbc50072d50 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 -- 172.21.15.17:0/3910552399 >> 172.21.15.17:0/3910552399 conn(0x7fbc500fb5f0 msgr2=0x7fbc500fbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:26.998 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 -- 172.21.15.17:0/3910552399 shutdown_connections 2023-07-14T13:35:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.002+0000 7fbc57dff700 1 -- 172.21.15.17:0/3910552399 wait complete. 2023-07-14T13:35:26.999 INFO:teuthology.orchestra.run.smithi017.stderr:listed 16 entries 2023-07-14T13:35:27.014 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2023-07-14T13:35:27.015 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T13:35:27.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T13:35:27.158 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:26 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3876489180' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T13:35:27.158 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:26 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/951788691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T13:35:27.161 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:26 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3876489180' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T13:35:27.161 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:26 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/951788691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T13:35:27.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:26 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3876489180' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T13:35:27.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:26 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/951788691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T13:35:27.300 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.306+0000 7fa705dff700 1 -- 172.21.15.17:0/653436596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa700105b00 msgr2=0x7fa700105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.306+0000 7fa705dff700 1 --2- 172.21.15.17:0/653436596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa700105b00 0x7fa700105ed0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009990 tx=0x7fa6f0009ca0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.307+0000 7fa705dff700 1 -- 172.21.15.17:0/653436596 shutdown_connections 2023-07-14T13:35:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.307+0000 7fa705dff700 1 --2- 172.21.15.17:0/653436596 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7001004a0 0x7fa70010c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.307+0000 7fa705dff700 1 --2- 172.21.15.17:0/653436596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa700105b00 0x7fa700105ed0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.307+0000 7fa705dff700 1 --2- 172.21.15.17:0/653436596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7000ffaf0 0x7fa7000fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.307+0000 7fa705dff700 1 -- 172.21.15.17:0/653436596 >> 172.21.15.17:0/653436596 conn(0x7fa7000fb630 msgr2=0x7fa7000fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:27.301 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.307+0000 7fa705dff700 1 -- 172.21.15.17:0/653436596 shutdown_connections 2023-07-14T13:35:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.307+0000 7fa705dff700 1 -- 172.21.15.17:0/653436596 wait complete. 2023-07-14T13:35:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.308+0000 7fa705dff700 1 Processor -- start 2023-07-14T13:35:27.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.308+0000 7fa705dff700 1 -- start start 2023-07-14T13:35:27.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.308+0000 7fa705dff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7000ffaf0 0x7fa700197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:27.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.308+0000 7fa705dff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7001004a0 0x7fa700198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:27.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.308+0000 7fa705dff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa700105b00 0x7fa70019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:27.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.308+0000 7fa705dff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019cd00 con 0x7fa7000ffaf0 2023-07-14T13:35:27.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.308+0000 7fa705dff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019ce70 con 0x7fa700105b00 2023-07-14T13:35:27.304 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.308+0000 7fa705dff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70019d030 con 0x7fa7001004a0 2023-07-14T13:35:27.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.308+0000 7fa6ff7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7000ffaf0 0x7fa700197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:27.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.309+0000 7fa6ff7fe700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7000ffaf0 0x7fa700197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58966/0 (socket says 172.21.15.17:58966) 2023-07-14T13:35:27.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.309+0000 7fa6ff7fe700 1 -- 172.21.15.17:0/2932106543 learned_addr learned my addr 172.21.15.17:0/2932106543 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:35:27.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.309+0000 7fa6fffff700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa700105b00 0x7fa70019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:27.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.309+0000 7fa6feffd700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7001004a0 0x7fa700198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:27.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.309+0000 7fa6ff7fe700 1 -- 172.21.15.17:0/2932106543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7001004a0 msgr2=0x7fa700198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:27.305 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.309+0000 7fa6ff7fe700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7001004a0 0x7fa700198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.309+0000 7fa6ff7fe700 1 -- 172.21.15.17:0/2932106543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa700105b00 msgr2=0x7fa70019c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.309+0000 7fa6ff7fe700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa700105b00 0x7fa70019c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.309+0000 7fa6ff7fe700 1 -- 172.21.15.17:0/2932106543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f00095f0 con 0x7fa7000ffaf0 2023-07-14T13:35:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.309+0000 7fa6ff7fe700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7000ffaf0 0x7fa700197d20 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005740 tx=0x7fa6f0005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.310+0000 7fa6fcff9700 1 -- 172.21.15.17:0/2932106543 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f001d070 con 0x7fa7000ffaf0 2023-07-14T13:35:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.310+0000 7fa6fcff9700 1 -- 172.21.15.17:0/2932106543 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6f0022470 con 0x7fa7000ffaf0 2023-07-14T13:35:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.310+0000 7fa6fcff9700 1 -- 172.21.15.17:0/2932106543 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0017650 con 0x7fa7000ffaf0 2023-07-14T13:35:27.306 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.310+0000 7fa705dff700 1 -- 172.21.15.17:0/2932106543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70019d2b0 con 0x7fa7000ffaf0 2023-07-14T13:35:27.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.310+0000 7fa705dff700 1 -- 172.21.15.17:0/2932106543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70019d530 con 0x7fa7000ffaf0 2023-07-14T13:35:27.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.311+0000 7fa705dff700 1 -- 172.21.15.17:0/2932106543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa700067300 con 0x7fa7000ffaf0 2023-07-14T13:35:27.307 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.313+0000 7fa6fcff9700 1 -- 172.21.15.17:0/2932106543 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fa6f000fb00 con 0x7fa7000ffaf0 2023-07-14T13:35:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.314+0000 7fa6fcff9700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6e80a1300 0x7fa6e80a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.314+0000 7fa6fcff9700 1 -- 172.21.15.17:0/2932106543 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa6f00ce860 con 0x7fa7000ffaf0 2023-07-14T13:35:27.308 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.315+0000 7fa6feffd700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6e80a1300 0x7fa6e80a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.315+0000 7fa6feffd700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6e80a1300 0x7fa6e80a37b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa700199330 tx=0x7fa6f4009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:27.310 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.317+0000 7fa6fcff9700 1 -- 172.21.15.17:0/2932106543 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fa6f0097d20 con 0x7fa7000ffaf0 2023-07-14T13:35:27.519 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.526+0000 7fa705dff700 1 -- 172.21.15.17:0/2932106543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa70019d530 con 0x7fa7000ffaf0 2023-07-14T13:35:27.521 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.527+0000 7fa6fcff9700 1 -- 172.21.15.17:0/2932106543 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+22939 (secure 0 0 0) 0x7fa70019d530 con 0x7fa7000ffaf0 2023-07-14T13:35:27.521 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-07-14T13:35:27.522 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":149,"fsid":"b31a3268-2244-11ee-9b33-001a4aab830c","created":"2023-07-14T12:49:02.947884+0000","modified":"2023-07-14T13:35:21.858336+0000","last_up_change":"2023-07-14T12:56:45.964965+0000","last_in_change":"2023-07-14T12:56:25.395862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T12:52:45.347166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T12:57:37.876360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T12:57:39.117456+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":67,"snap_epoch":148,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de7a33f-905e-4374-bf3b-95ca11eee3c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6803","nonce":2578098788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6805","nonce":2578098788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6809","nonce":2578098788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2578098788},{"type":"v1","addr":"172.21.15.17:6807","nonce":2578098788}]},"public_addr":"172.21.15.17:6803/2578098788","cluster_addr":"172.21.15.17:6805/2578098788","heartbeat_back_addr":"172.21.15.17:6809/2578098788","heartbeat_front_addr":"172.21.15.17:6807/2578098788","state":["exists","up"]},{"osd":1,"uuid":"73e24a1b-4661-4c71-83ef-5f5ad4081046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6801","nonce":3352217592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6803","nonce":3352217592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6807","nonce":3352217592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":3352217592},{"type":"v1","addr":"172.21.15.131:6805","nonce":3352217592}]},"public_addr":"172.21.15.131:6801/3352217592","cluster_addr":"172.21.15.131:6803/3352217592","heartbeat_back_addr":"172.21.15.131:6807/3352217592","heartbeat_front_addr":"172.21.15.131:6805/3352217592","state":["exists","up"]},{"osd":2,"uuid":"fde438ad-9889-4407-b0d7-1baf7dde5fa4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6801","nonce":280499423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6803","nonce":280499423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6807","nonce":280499423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":280499423},{"type":"v1","addr":"172.21.15.135:6805","nonce":280499423}]},"public_addr":"172.21.15.135:6801/280499423","cluster_addr":"172.21.15.135:6803/280499423","heartbeat_back_addr":"172.21.15.135:6807/280499423","heartbeat_front_addr":"172.21.15.135:6805/280499423","state":["exists","up"]},{"osd":3,"uuid":"784f3a65-facf-426b-babf-bde561f064cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6811","nonce":1157710316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6813","nonce":1157710316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6817","nonce":1157710316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1157710316},{"type":"v1","addr":"172.21.15.17:6815","nonce":1157710316}]},"public_addr":"172.21.15.17:6811/1157710316","cluster_addr":"172.21.15.17:6813/1157710316","heartbeat_back_addr":"172.21.15.17:6817/1157710316","heartbeat_front_addr":"172.21.15.17:6815/1157710316","state":["exists","up"]},{"osd":4,"uuid":"443988de-50af-4760-ba5b-9b024a906d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6809","nonce":2961620738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6811","nonce":2961620738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6815","nonce":2961620738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2961620738},{"type":"v1","addr":"172.21.15.131:6813","nonce":2961620738}]},"public_addr":"172.21.15.131:6809/2961620738","cluster_addr":"172.21.15.131:6811/2961620738","heartbeat_back_addr":"172.21.15.131:6815/2961620738","heartbeat_front_addr":"172.21.15.131:6813/2961620738","state":["exists","up"]},{"osd":5,"uuid":"adb30dc0-fa38-45d5-8413-e049e6a1dd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6809","nonce":494689229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6811","nonce":494689229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6815","nonce":494689229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":494689229},{"type":"v1","addr":"172.21.15.135:6813","nonce":494689229}]},"public_addr":"172.21.15.135:6809/494689229","cluster_addr":"172.21.15.135:6811/494689229","heartbeat_back_addr":"172.21.15.135:6815/494689229","heartbeat_front_addr":"172.21.15.135:6813/494689229","state":["exists","up"]},{"osd":6,"uuid":"7d1fa8c7-e1b2-442b-8420-c5fc31cfdfc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6819","nonce":3590489731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6821","nonce":3590489731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6825","nonce":3590489731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":3590489731},{"type":"v1","addr":"172.21.15.17:6823","nonce":3590489731}]},"public_addr":"172.21.15.17:6819/3590489731","cluster_addr":"172.21.15.17:6821/3590489731","heartbeat_back_addr":"172.21.15.17:6825/3590489731","heartbeat_front_addr":"172.21.15.17:6823/3590489731","state":["exists","up"]},{"osd":7,"uuid":"b8043c8e-d385-48fe-afd2-163ce4cb49da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6817","nonce":2006382147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6819","nonce":2006382147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6823","nonce":2006382147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2006382147},{"type":"v1","addr":"172.21.15.131:6821","nonce":2006382147}]},"public_addr":"172.21.15.131:6817/2006382147","cluster_addr":"172.21.15.131:6819/2006382147","heartbeat_back_addr":"172.21.15.131:6823/2006382147","heartbeat_front_addr":"172.21.15.131:6821/2006382147","state":["exists","up"]},{"osd":8,"uuid":"d828ebc9-487a-46ac-bd6c-b5572903cd3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6817","nonce":4144218895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6819","nonce":4144218895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6823","nonce":4144218895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":4144218895},{"type":"v1","addr":"172.21.15.135:6821","nonce":4144218895}]},"public_addr":"172.21.15.135:6817/4144218895","cluster_addr":"172.21.15.135:6819/4144218895","heartbeat_back_addr":"172.21.15.135:6823/4144218895","heartbeat_front_addr":"172.21.15.135:6821/4144218895","state":["exists","up"]},{"osd":9,"uuid":"e83ba4ac-ebb8-4f08-961d-3221193aa1eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6827","nonce":556821808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6829","nonce":556821808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6833","nonce":556821808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":556821808},{"type":"v1","addr":"172.21.15.17:6831","nonce":556821808}]},"public_addr":"172.21.15.17:6827/556821808","cluster_addr":"172.21.15.17:6829/556821808","heartbeat_back_addr":"172.21.15.17:6833/556821808","heartbeat_front_addr":"172.21.15.17:6831/556821808","state":["exists","up"]},{"osd":10,"uuid":"61c3f223-8d23-4b29-9c18-e45d08aa5960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6825","nonce":3503442823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6827","nonce":3503442823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6831","nonce":3503442823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":3503442823},{"type":"v1","addr":"172.21.15.131:6829","nonce":3503442823}]},"public_addr":"172.21.15.131:6825/3503442823","cluster_addr":"172.21.15.131:6827/3503442823","heartbeat_back_addr":"172.21.15.131:6831/3503442823","heartbeat_front_addr":"172.21.15.131:6829/3503442823","state":["exists","up"]},{"osd":11,"uuid":"3a17613e-c927-4c60-bfe9-518ea7d627e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6825","nonce":2475021404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6827","nonce":2475021404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6831","nonce":2475021404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2475021404},{"type":"v1","addr":"172.21.15.135:6829","nonce":2475021404}]},"public_addr":"172.21.15.135:6825/2475021404","cluster_addr":"172.21.15.135:6827/2475021404","heartbeat_back_addr":"172.21.15.135:6831/2475021404","heartbeat_front_addr":"172.21.15.135:6829/2475021404","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:51:48.962241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:15.244244+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:52:41.639631+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:10.314618+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:53:37.220336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:03.023141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:30.029448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:54:56.657792+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:23.285317+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:55:50.215103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:17.351712+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T12:56:44.104400+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/645612714":"2023-07-15T12:59:43.864189+0000","172.21.15.17:0/1809272973":"2023-07-15T12:59:43.864189+0000","172.21.15.17:6800/2034486077":"2023-07-15T12:59:43.864189+0000","172.21.15.17:6801/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/2034486077":"2023-07-15T12:59:43.864189+0000","172.21.15.17:6800/1783581931":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/895305494":"2023-07-15T12:59:43.864189+0000","172.21.15.17:0/289337901":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6801/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/135468511":"2023-07-15T12:50:06.734862+0000","172.21.15.17:6800/3639458654":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1204213342":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/1285371613":"2023-07-15T12:59:43.864189+0000","172.21.15.17:0/2727688865":"2023-07-15T12:49:39.980336+0000","172.21.15.17:0/3042541598":"2023-07-15T12:50:06.734862+0000","172.21.15.17:0/3837590693":"2023-07-15T12:49:39.980336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":54,"length":1},{"begin":67,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T13:35:27.523 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 -- 172.21.15.17:0/2932106543 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6e80a1300 msgr2=0x7fa6e80a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:27.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6e80a1300 0x7fa6e80a37b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa700199330 tx=0x7fa6f4009260 comp rx=0 tx=0).stop 2023-07-14T13:35:27.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 -- 172.21.15.17:0/2932106543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7000ffaf0 msgr2=0x7fa700197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:27.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7000ffaf0 0x7fa700197d20 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005740 tx=0x7fa6f0005770 comp rx=0 tx=0).stop 2023-07-14T13:35:27.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 -- 172.21.15.17:0/2932106543 shutdown_connections 2023-07-14T13:35:27.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fa6e80a1300 0x7fa6e80a37b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa700105b00 0x7fa70019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.524 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7000ffaf0 0x7fa700197d20 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 --2- 172.21.15.17:0/2932106543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7001004a0 0x7fa700198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 -- 172.21.15.17:0/2932106543 >> 172.21.15.17:0/2932106543 conn(0x7fa7000fb630 msgr2=0x7fa70010ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:27.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 -- 172.21.15.17:0/2932106543 shutdown_connections 2023-07-14T13:35:27.525 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.530+0000 7fa705dff700 1 -- 172.21.15.17:0/2932106543 wait complete. 2023-07-14T13:35:27.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T12:52:45.347166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T12:57:37.876360+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T12:57:39.117456+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 67, 'snap_epoch': 148, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T13:35:27.543 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T13:35:27.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.755+0000 7f86cdfff700 1 -- 172.21.15.17:0/1584966678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c8105ae0 msgr2=0x7f86c8105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:27.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.755+0000 7f86cdfff700 1 --2- 172.21.15.17:0/1584966678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c8105ae0 0x7f86c8105eb0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009990 tx=0x7f86b8009ca0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.755+0000 7f86cdfff700 1 -- 172.21.15.17:0/1584966678 shutdown_connections 2023-07-14T13:35:27.749 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.755+0000 7f86cdfff700 1 --2- 172.21.15.17:0/1584966678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86c8100480 0x7f86c810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.755+0000 7f86cdfff700 1 --2- 172.21.15.17:0/1584966678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c8105ae0 0x7f86c8105eb0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.755+0000 7f86cdfff700 1 --2- 172.21.15.17:0/1584966678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c80ffad0 0x7f86c80fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.755+0000 7f86cdfff700 1 -- 172.21.15.17:0/1584966678 >> 172.21.15.17:0/1584966678 conn(0x7f86c80fb5f0 msgr2=0x7f86c80fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:27.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.755+0000 7f86cdfff700 1 -- 172.21.15.17:0/1584966678 shutdown_connections 2023-07-14T13:35:27.750 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.755+0000 7f86cdfff700 1 -- 172.21.15.17:0/1584966678 wait complete. 2023-07-14T13:35:27.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.756+0000 7f86cdfff700 1 Processor -- start 2023-07-14T13:35:27.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.756+0000 7f86cdfff700 1 -- start start 2023-07-14T13:35:27.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.756+0000 7f86cdfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86c80ffad0 0x7f86c819db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:27.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86cdfff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c8100480 0x7f86c819e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:27.752 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86cdfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c8105ae0 0x7f86c8197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86cdfff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c81982e0 con 0x7f86c8100480 2023-07-14T13:35:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86cdfff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8198450 con 0x7f86c80ffad0 2023-07-14T13:35:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86cdfff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8198610 con 0x7f86c8105ae0 2023-07-14T13:35:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c8100480 0x7f86c819e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86bffff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c8100480 0x7f86c819e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58984/0 (socket says 172.21.15.17:58984) 2023-07-14T13:35:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86bffff700 1 -- 172.21.15.17:0/3930112956 learned_addr learned my addr 172.21.15.17:0/3930112956 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:35:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86c7fff700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c8105ae0 0x7f86c8197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:27.753 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86c77fe700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86c80ffad0 0x7f86c819db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:27.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86bffff700 1 -- 172.21.15.17:0/3930112956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c8105ae0 msgr2=0x7f86c8197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:27.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86bffff700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c8105ae0 0x7f86c8197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86bffff700 1 -- 172.21.15.17:0/3930112956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86c80ffad0 msgr2=0x7f86c819db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:27.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86bffff700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86c80ffad0 0x7f86c819db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86bffff700 1 -- 172.21.15.17:0/3930112956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b80095f0 con 0x7f86c8100480 2023-07-14T13:35:27.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86c77fe700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86c80ffad0 0x7f86c819db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T13:35:27.754 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.757+0000 7f86bffff700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c8100480 0x7f86c819e070 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f86b000d950 tx=0x7f86b000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.758+0000 7f86c57fa700 1 -- 172.21.15.17:0/3930112956 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0009b40 con 0x7f86c8100480 2023-07-14T13:35:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.758+0000 7f86c57fa700 1 -- 172.21.15.17:0/3930112956 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86b0009ca0 con 0x7f86c8100480 2023-07-14T13:35:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.758+0000 7f86cdfff700 1 -- 172.21.15.17:0/3930112956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c81988f0 con 0x7f86c8100480 2023-07-14T13:35:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.758+0000 7f86c57fa700 1 -- 172.21.15.17:0/3930112956 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000f620 con 0x7f86c8100480 2023-07-14T13:35:27.755 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.758+0000 7f86cdfff700 1 -- 172.21.15.17:0/3930112956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c81a4b00 con 0x7f86c8100480 2023-07-14T13:35:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.759+0000 7f86cdfff700 1 -- 172.21.15.17:0/3930112956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c8067290 con 0x7f86c8100480 2023-07-14T13:35:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.761+0000 7f86c57fa700 1 -- 172.21.15.17:0/3930112956 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f86b0010460 con 0x7f86c8100480 2023-07-14T13:35:27.756 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.763+0000 7f86c57fa700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f86b40a1340 0x7f86b40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.763+0000 7f86c57fa700 1 -- 172.21.15.17:0/3930112956 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f86b00ccfe0 con 0x7f86c8100480 2023-07-14T13:35:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.763+0000 7f86c77fe700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f86b40a1340 0x7f86b40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:27.757 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.764+0000 7f86c77fe700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f86b40a1340 0x7f86b40a37f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f86b8000c00 tx=0x7f86b8005fb0 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:27.760 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.767+0000 7f86c57fa700 1 -- 172.21.15.17:0/3930112956 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f86b0096410 con 0x7f86c8100480 2023-07-14T13:35:27.975 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.982+0000 7f86cdfff700 1 -- 172.21.15.17:0/3930112956 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86c81a4e20 con 0x7f86c8100480 2023-07-14T13:35:27.976 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.982+0000 7f86c57fa700 1 -- 172.21.15.17:0/3930112956 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86b0099a30 con 0x7f86c8100480 2023-07-14T13:35:27.977 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2023-07-14T13:35:27.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 -- 172.21.15.17:0/3930112956 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f86b40a1340 msgr2=0x7f86b40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:27.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f86b40a1340 0x7f86b40a37f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f86b8000c00 tx=0x7f86b8005fb0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 -- 172.21.15.17:0/3930112956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c8100480 msgr2=0x7f86c819e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:27.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c8100480 0x7f86c819e070 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f86b000d950 tx=0x7f86b000dd10 comp rx=0 tx=0).stop 2023-07-14T13:35:27.979 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 -- 172.21.15.17:0/3930112956 shutdown_connections 2023-07-14T13:35:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f86b40a1340 0x7f86b40a37f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f86c8105ae0 0x7f86c8197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86c80ffad0 0x7f86c819db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 --2- 172.21.15.17:0/3930112956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c8100480 0x7f86c819e070 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 -- 172.21.15.17:0/3930112956 >> 172.21.15.17:0/3930112956 conn(0x7f86c80fb5f0 msgr2=0x7f86c810ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 -- 172.21.15.17:0/3930112956 shutdown_connections 2023-07-14T13:35:27.980 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:27.985+0000 7f86cdfff700 1 -- 172.21.15.17:0/3930112956 wait complete. 2023-07-14T13:35:27.997 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T13:35:28.161 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:27 smithi135 ceph-mon[97338]: pgmap v1134: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-07-14T13:35:28.161 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:27 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3910552399' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T13:35:28.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:27 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/2932106543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T13:35:28.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.213+0000 7fb5769ff700 1 -- 172.21.15.17:0/2356849924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57010c310 msgr2=0x7fb57010e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:28.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.213+0000 7fb5769ff700 1 --2- 172.21.15.17:0/2356849924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57010c310 0x7fb57010e6f0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fb56800b0a0 tx=0x7fb56800b3b0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.213+0000 7fb5769ff700 1 -- 172.21.15.17:0/2356849924 shutdown_connections 2023-07-14T13:35:28.207 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.213+0000 7fb5769ff700 1 --2- 172.21.15.17:0/2356849924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57010c310 0x7fb57010e6f0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.213+0000 7fb5769ff700 1 --2- 172.21.15.17:0/2356849924 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5700728b0 0x7fb570072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.213+0000 7fb5769ff700 1 --2- 172.21.15.17:0/2356849924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5700731c0 0x7fb57010bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.213+0000 7fb5769ff700 1 -- 172.21.15.17:0/2356849924 >> 172.21.15.17:0/2356849924 conn(0x7fb5700fb5f0 msgr2=0x7fb5700fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:28.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.213+0000 7fb5769ff700 1 -- 172.21.15.17:0/2356849924 shutdown_connections 2023-07-14T13:35:28.208 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.213+0000 7fb5769ff700 1 -- 172.21.15.17:0/2356849924 wait complete. 2023-07-14T13:35:28.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.214+0000 7fb5769ff700 1 Processor -- start 2023-07-14T13:35:28.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.214+0000 7fb5769ff700 1 -- start start 2023-07-14T13:35:28.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb5769ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5700728b0 0x7fb570197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:28.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb5769ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5700731c0 0x7fb570198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:28.210 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb5769ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57010c310 0x7fb57019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:28.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb5769ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57019cdb0 con 0x7fb57010c310 2023-07-14T13:35:28.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb5769ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57019cf20 con 0x7fb5700731c0 2023-07-14T13:35:28.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb5769ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57019d0e0 con 0x7fb5700728b0 2023-07-14T13:35:28.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb574f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57010c310 0x7fb57019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:28.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb574f9c700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57010c310 0x7fb57019c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58996/0 (socket says 172.21.15.17:58996) 2023-07-14T13:35:28.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb574f9c700 1 -- 172.21.15.17:0/1311865691 learned_addr learned my addr 172.21.15.17:0/1311865691 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:35:28.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb56ffff700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5700728b0 0x7fb570197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:28.211 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb56f7fe700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5700731c0 0x7fb570198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:28.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb574f9c700 1 -- 172.21.15.17:0/1311865691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5700728b0 msgr2=0x7fb570197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:28.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb574f9c700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5700728b0 0x7fb570197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb574f9c700 1 -- 172.21.15.17:0/1311865691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5700731c0 msgr2=0x7fb570198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:28.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb574f9c700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5700731c0 0x7fb570198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.215+0000 7fb574f9c700 1 -- 172.21.15.17:0/1311865691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb568009d00 con 0x7fb57010c310 2023-07-14T13:35:28.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.216+0000 7fb574f9c700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57010c310 0x7fb57019c770 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fb56800b070 tx=0x7fb56800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:28.212 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.216+0000 7fb56d7fa700 1 -- 172.21.15.17:0/1311865691 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800e040 con 0x7fb57010c310 2023-07-14T13:35:28.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.216+0000 7fb56d7fa700 1 -- 172.21.15.17:0/1311865691 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb568003e10 con 0x7fb57010c310 2023-07-14T13:35:28.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.216+0000 7fb5769ff700 1 -- 172.21.15.17:0/1311865691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57019d360 con 0x7fb57010c310 2023-07-14T13:35:28.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.216+0000 7fb56d7fa700 1 -- 172.21.15.17:0/1311865691 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5680052a0 con 0x7fb57010c310 2023-07-14T13:35:28.213 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.216+0000 7fb5769ff700 1 -- 172.21.15.17:0/1311865691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57019d5e0 con 0x7fb57010c310 2023-07-14T13:35:28.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:27 smithi131 ceph-mon[96953]: pgmap v1134: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-07-14T13:35:28.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:27 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3910552399' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T13:35:28.214 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:27 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/2932106543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T13:35:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.217+0000 7fb5769ff700 1 -- 172.21.15.17:0/1311865691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb570067290 con 0x7fb57010c310 2023-07-14T13:35:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.219+0000 7fb56d7fa700 1 -- 172.21.15.17:0/1311865691 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7fb568005400 con 0x7fb57010c310 2023-07-14T13:35:28.215 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.221+0000 7fb56d7fa700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5580a12c0 0x7fb5580a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:28.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.221+0000 7fb56d7fa700 1 -- 172.21.15.17:0/1311865691 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb5680cdf90 con 0x7fb57010c310 2023-07-14T13:35:28.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.221+0000 7fb56ffff700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5580a12c0 0x7fb5580a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:28.216 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.222+0000 7fb56ffff700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5580a12c0 0x7fb5580a3770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb560009c60 tx=0x7fb560009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:28.218 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.224+0000 7fb56d7fa700 1 -- 172.21.15.17:0/1311865691 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7fb5680973f0 con 0x7fb57010c310 2023-07-14T13:35:28.319 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:27 smithi017 ceph-mon[95536]: pgmap v1134: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-07-14T13:35:28.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:27 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3910552399' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T13:35:28.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:27 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/2932106543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T13:35:28.427 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.433+0000 7fb5769ff700 1 -- 172.21.15.17:0/1311865691 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb57019d4f0 con 0x7fb57010c310 2023-07-14T13:35:28.428 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.434+0000 7fb56d7fa700 1 -- 172.21.15.17:0/1311865691 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v149) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb56809aa10 con 0x7fb57010c310 2023-07-14T13:35:28.428 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2023-07-14T13:35:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 -- 172.21.15.17:0/1311865691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5580a12c0 msgr2=0x7fb5580a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:28.430 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5580a12c0 0x7fb5580a3770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb560009c60 tx=0x7fb560009260 comp rx=0 tx=0).stop 2023-07-14T13:35:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 -- 172.21.15.17:0/1311865691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57010c310 msgr2=0x7fb57019c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57010c310 0x7fb57019c770 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fb56800b070 tx=0x7fb56800bce0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 -- 172.21.15.17:0/1311865691 shutdown_connections 2023-07-14T13:35:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7fb5580a12c0 0x7fb5580a3770 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb57010c310 0x7fb57019c770 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5700728b0 0x7fb570197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.431 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 --2- 172.21.15.17:0/1311865691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5700731c0 0x7fb570198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 -- 172.21.15.17:0/1311865691 >> 172.21.15.17:0/1311865691 conn(0x7fb5700fb5f0 msgr2=0x7fb57010e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:28.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 -- 172.21.15.17:0/1311865691 shutdown_connections 2023-07-14T13:35:28.432 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.437+0000 7fb5769ff700 1 -- 172.21.15.17:0/1311865691 wait complete. 2023-07-14T13:35:28.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T13:35:28.655 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.661+0000 7f050f5ff700 1 -- 172.21.15.17:0/2435305986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0508100480 msgr2=0x7f050810c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:28.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.661+0000 7f050f5ff700 1 --2- 172.21.15.17:0/2435305986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0508100480 0x7f050810c910 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f050000b0a0 tx=0x7f050000b3b0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.661+0000 7f050f5ff700 1 -- 172.21.15.17:0/2435305986 shutdown_connections 2023-07-14T13:35:28.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.661+0000 7f050f5ff700 1 --2- 172.21.15.17:0/2435305986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0508100480 0x7f050810c910 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.661+0000 7f050f5ff700 1 --2- 172.21.15.17:0/2435305986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508105ae0 0x7f0508105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.656 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.661+0000 7f050f5ff700 1 --2- 172.21.15.17:0/2435305986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05080ffad0 0x7f05080fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.661+0000 7f050f5ff700 1 -- 172.21.15.17:0/2435305986 >> 172.21.15.17:0/2435305986 conn(0x7f05080fb5f0 msgr2=0x7f05080fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:28.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.662+0000 7f050f5ff700 1 -- 172.21.15.17:0/2435305986 shutdown_connections 2023-07-14T13:35:28.657 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.662+0000 7f050f5ff700 1 -- 172.21.15.17:0/2435305986 wait complete. 2023-07-14T13:35:28.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.663+0000 7f050f5ff700 1 Processor -- start 2023-07-14T13:35:28.658 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.663+0000 7f050f5ff700 1 -- start start 2023-07-14T13:35:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.663+0000 7f050f5ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05080ffad0 0x7f0508197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.663+0000 7f050f5ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0508100480 0x7f05081982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.663+0000 7f050f5ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508105ae0 0x7f050819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.663+0000 7f050f5ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050819cd80 con 0x7f05080ffad0 2023-07-14T13:35:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.663+0000 7f050f5ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050819cef0 con 0x7f0508100480 2023-07-14T13:35:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.663+0000 7f050f5ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050819d0b0 con 0x7f0508105ae0 2023-07-14T13:35:28.659 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.663+0000 7f050d39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05080ffad0 0x7f0508197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:28.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.663+0000 7f050d39b700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05080ffad0 0x7f0508197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59020/0 (socket says 172.21.15.17:59020) 2023-07-14T13:35:28.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.663+0000 7f050d39b700 1 -- 172.21.15.17:0/1324027972 learned_addr learned my addr 172.21.15.17:0/1324027972 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:35:28.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f050db9c700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508105ae0 0x7f050819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:28.660 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f050cb9a700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0508100480 0x7f05081982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f050d39b700 1 -- 172.21.15.17:0/1324027972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508105ae0 msgr2=0x7f050819c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f050d39b700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508105ae0 0x7f050819c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f050d39b700 1 -- 172.21.15.17:0/1324027972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0508100480 msgr2=0x7f05081982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f050d39b700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0508100480 0x7f05081982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f050d39b700 1 -- 172.21.15.17:0/1324027972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500009d00 con 0x7f05080ffad0 2023-07-14T13:35:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f050d39b700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05080ffad0 0x7f0508197da0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f050400e9a0 tx=0x7f050400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f04fe7fc700 1 -- 172.21.15.17:0/1324027972 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504009790 con 0x7f05080ffad0 2023-07-14T13:35:28.661 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f04fe7fc700 1 -- 172.21.15.17:0/1324027972 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f050400cbd0 con 0x7f05080ffad0 2023-07-14T13:35:28.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f050f5ff700 1 -- 172.21.15.17:0/1324027972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050819d390 con 0x7f05080ffad0 2023-07-14T13:35:28.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f04fe7fc700 1 -- 172.21.15.17:0/1324027972 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504018680 con 0x7f05080ffad0 2023-07-14T13:35:28.662 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.664+0000 7f050f5ff700 1 -- 172.21.15.17:0/1324027972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05081a4bd0 con 0x7f05080ffad0 2023-07-14T13:35:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.665+0000 7f050f5ff700 1 -- 172.21.15.17:0/1324027972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0508067290 con 0x7f05080ffad0 2023-07-14T13:35:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.667+0000 7f04fe7fc700 1 -- 172.21.15.17:0/1324027972 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f050400cd40 con 0x7f05080ffad0 2023-07-14T13:35:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.669+0000 7f04fe7fc700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f04f40a12c0 0x7f04f40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.669+0000 7f04fe7fc700 1 -- 172.21.15.17:0/1324027972 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0504014070 con 0x7f05080ffad0 2023-07-14T13:35:28.663 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.669+0000 7f050cb9a700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f04f40a12c0 0x7f04f40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:28.664 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.670+0000 7f050cb9a700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f04f40a12c0 0x7f04f40a3770 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f05081993b0 tx=0x7f04f8009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:28.666 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.673+0000 7f04fe7fc700 1 -- 172.21.15.17:0/1324027972 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f0504051790 con 0x7f05080ffad0 2023-07-14T13:35:28.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.880+0000 7f050f5ff700 1 -- 172.21.15.17:0/1324027972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05081a4e70 con 0x7f05080ffad0 2023-07-14T13:35:28.874 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.881+0000 7f04fe7fc700 1 -- 172.21.15.17:0/1324027972 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v149) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0504096330 con 0x7f05080ffad0 2023-07-14T13:35:28.875 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2023-07-14T13:35:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.883+0000 7f050f5ff700 1 -- 172.21.15.17:0/1324027972 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f04f40a12c0 msgr2=0x7f04f40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.883+0000 7f050f5ff700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f04f40a12c0 0x7f04f40a3770 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f05081993b0 tx=0x7f04f8009260 comp rx=0 tx=0).stop 2023-07-14T13:35:28.877 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.883+0000 7f050f5ff700 1 -- 172.21.15.17:0/1324027972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05080ffad0 msgr2=0x7f0508197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.883+0000 7f050f5ff700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05080ffad0 0x7f0508197da0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f050400e9a0 tx=0x7f050400ecb0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.884+0000 7f050f5ff700 1 -- 172.21.15.17:0/1324027972 shutdown_connections 2023-07-14T13:35:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.884+0000 7f050f5ff700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f04f40a12c0 0x7f04f40a3770 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.884+0000 7f050f5ff700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0508105ae0 0x7f050819c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.884+0000 7f050f5ff700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05080ffad0 0x7f0508197da0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.884+0000 7f050f5ff700 1 --2- 172.21.15.17:0/1324027972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0508100480 0x7f05081982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:28.878 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.884+0000 7f050f5ff700 1 -- 172.21.15.17:0/1324027972 >> 172.21.15.17:0/1324027972 conn(0x7f05080fb5f0 msgr2=0x7f050810ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.884+0000 7f050f5ff700 1 -- 172.21.15.17:0/1324027972 shutdown_connections 2023-07-14T13:35:28.879 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:28.884+0000 7f050f5ff700 1 -- 172.21.15.17:0/1324027972 wait complete. 2023-07-14T13:35:28.897 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T13:35:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.107+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/863172825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d980ffad0 msgr2=0x7f2d980fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.107+0000 7f2d9e1ff700 1 --2- 172.21.15.17:0/863172825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d980ffad0 0x7f2d980fff40 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009990 tx=0x7f2d80009ca0 comp rx=0 tx=0).stop 2023-07-14T13:35:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.107+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/863172825 shutdown_connections 2023-07-14T13:35:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.107+0000 7f2d9e1ff700 1 --2- 172.21.15.17:0/863172825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d98100480 0x7f2d9810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.107+0000 7f2d9e1ff700 1 --2- 172.21.15.17:0/863172825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d98105ae0 0x7f2d98105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.107+0000 7f2d9e1ff700 1 --2- 172.21.15.17:0/863172825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d980ffad0 0x7f2d980fff40 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.107+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/863172825 >> 172.21.15.17:0/863172825 conn(0x7f2d980fb5f0 msgr2=0x7f2d980fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.107+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/863172825 shutdown_connections 2023-07-14T13:35:29.104 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.107+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/863172825 wait complete. 2023-07-14T13:35:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.108+0000 7f2d9e1ff700 1 Processor -- start 2023-07-14T13:35:29.105 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.108+0000 7f2d9e1ff700 1 -- start start 2023-07-14T13:35:29.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d9e1ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d980ffad0 0x7f2d98072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:29.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d9e1ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d98100480 0x7f2d98072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:29.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d9e1ff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d98105ae0 0x7f2d981a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:29.109 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d9e1ff700 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98073580 con 0x7f2d98105ae0 2023-07-14T13:35:29.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d9e1ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d981a4380 con 0x7f2d980ffad0 2023-07-14T13:35:29.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d9e1ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d981a44c0 con 0x7f2d98100480 2023-07-14T13:35:29.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d97fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d98105ae0 0x7f2d981a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:29.110 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d97fff700 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d98105ae0 0x7f2d981a3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59040/0 (socket says 172.21.15.17:59040) 2023-07-14T13:35:29.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d97fff700 1 -- 172.21.15.17:0/70676667 learned_addr learned my addr 172.21.15.17:0/70676667 (peer_addr_for_me v2:172.21.15.17:0/0) 2023-07-14T13:35:29.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d977fe700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d980ffad0 0x7f2d98072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:29.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d8ffff700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d98100480 0x7f2d98072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:29.111 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d97fff700 1 -- 172.21.15.17:0/70676667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d98100480 msgr2=0x7f2d98072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:29.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d97fff700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d98100480 0x7f2d98072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:29.112 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d97fff700 1 -- 172.21.15.17:0/70676667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d980ffad0 msgr2=0x7f2d98072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:29.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.109+0000 7f2d97fff700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d980ffad0 0x7f2d98072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:29.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.110+0000 7f2d97fff700 1 -- 172.21.15.17:0/70676667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d800095f0 con 0x7f2d98105ae0 2023-07-14T13:35:29.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.110+0000 7f2d8ffff700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d98100480 0x7f2d98072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T13:35:29.113 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.110+0000 7f2d97fff700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d98105ae0 0x7f2d981a3e40 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f2d90007ee0 tx=0x7f2d9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:29.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.110+0000 7f2d957fa700 1 -- 172.21.15.17:0/70676667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000ddd0 con 0x7f2d98105ae0 2023-07-14T13:35:29.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.110+0000 7f2d957fa700 1 -- 172.21.15.17:0/70676667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d9000f040 con 0x7f2d98105ae0 2023-07-14T13:35:29.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.110+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/70676667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d981a4720 con 0x7f2d98105ae0 2023-07-14T13:35:29.114 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.110+0000 7f2d957fa700 1 -- 172.21.15.17:0/70676667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d900047d0 con 0x7f2d98105ae0 2023-07-14T13:35:29.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.110+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/70676667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d981a4c50 con 0x7f2d98105ae0 2023-07-14T13:35:29.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.111+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/70676667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d98067290 con 0x7f2d98105ae0 2023-07-14T13:35:29.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.114+0000 7f2d957fa700 1 -- 172.21.15.17:0/70676667 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 135846+0+0 (secure 0 0 0) 0x7f2d90003f20 con 0x7f2d98105ae0 2023-07-14T13:35:29.115 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.115+0000 7f2d957fa700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d840a1340 0x7f2d840a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T13:35:29.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.115+0000 7f2d957fa700 1 -- 172.21.15.17:0/70676667 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2d900ccd30 con 0x7f2d98105ae0 2023-07-14T13:35:29.116 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.115+0000 7f2d977fe700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d840a1340 0x7f2d840a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T13:35:29.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.116+0000 7f2d977fe700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d840a1340 0x7f2d840a37f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009be0 tx=0x7f2d88009260 comp rx=0 tx=0).ready entity=mgr.15525 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T13:35:29.117 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.117+0000 7f2d957fa700 1 -- 172.21.15.17:0/70676667 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178038 (secure 0 0 0) 0x7f2d90096160 con 0x7f2d98105ae0 2023-07-14T13:35:29.161 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:28 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/3930112956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T13:35:29.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:28 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1311865691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T13:35:29.162 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:28 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/1324027972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T13:35:29.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:28 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/3930112956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T13:35:29.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:28 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1311865691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T13:35:29.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:28 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/1324027972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T13:35:29.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:28 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/3930112956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T13:35:29.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:28 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1311865691' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T13:35:29.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:28 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/1324027972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T13:35:29.335 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.342+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/70676667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2d981a4ea0 con 0x7f2d98105ae0 2023-07-14T13:35:29.336 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.342+0000 7f2d957fa700 1 -- 172.21.15.17:0/70676667 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v149) v1 ==== 81+0+942 (secure 0 0 0) 0x7f2d90023020 con 0x7f2d98105ae0 2023-07-14T13:35:29.336 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/645612714 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:29.336 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1809272973 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:29.336 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2034486077 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:29.337 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/1783581931 2023-07-15T12:50:06.734862+0000 2023-07-14T13:35:29.337 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2034486077 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:29.337 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/1783581931 2023-07-15T12:50:06.734862+0000 2023-07-14T13:35:29.337 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/895305494 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:29.337 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/289337901 2023-07-15T12:50:06.734862+0000 2023-07-14T13:35:29.337 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3639458654 2023-07-15T12:49:39.980336+0000 2023-07-14T13:35:29.337 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/135468511 2023-07-15T12:50:06.734862+0000 2023-07-14T13:35:29.337 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3639458654 2023-07-15T12:49:39.980336+0000 2023-07-14T13:35:29.338 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1204213342 2023-07-15T12:49:39.980336+0000 2023-07-14T13:35:29.338 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1285371613 2023-07-15T12:59:43.864189+0000 2023-07-14T13:35:29.338 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2727688865 2023-07-15T12:49:39.980336+0000 2023-07-14T13:35:29.338 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3042541598 2023-07-15T12:50:06.734862+0000 2023-07-14T13:35:29.338 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3837590693 2023-07-15T12:49:39.980336+0000 2023-07-14T13:35:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/70676667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d840a1340 msgr2=0x7f2d840a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d840a1340 0x7f2d840a37f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009be0 tx=0x7f2d88009260 comp rx=0 tx=0).stop 2023-07-14T13:35:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/70676667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d98105ae0 msgr2=0x7f2d981a3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T13:35:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d98105ae0 0x7f2d981a3e40 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f2d90007ee0 tx=0x7f2d9000d3b0 comp rx=0 tx=0).stop 2023-07-14T13:35:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/70676667 shutdown_connections 2023-07-14T13:35:29.339 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.17:6800/3916014154,v1:172.21.15.17:6801/3916014154] conn(0x7f2d840a1340 0x7f2d840a37f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d98105ae0 0x7f2d981a3e40 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d980ffad0 0x7f2d98072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 --2- 172.21.15.17:0/70676667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d98100480 0x7f2d98072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T13:35:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/70676667 >> 172.21.15.17:0/70676667 conn(0x7f2d980fb5f0 msgr2=0x7f2d980fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T13:35:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/70676667 shutdown_connections 2023-07-14T13:35:29.340 INFO:teuthology.orchestra.run.smithi017.stderr:2023-07-14T13:35:29.345+0000 7f2d9e1ff700 1 -- 172.21.15.17:0/70676667 wait complete. 2023-07-14T13:35:29.341 INFO:teuthology.orchestra.run.smithi017.stderr:listed 16 entries 2023-07-14T13:35:29.357 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2023-07-14T13:35:29.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:35:29.358 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /tmp/cephfs 2023-07-14T13:35:29.445 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[142901]: fuse finished with error 0 and tester_r 0 2023-07-14T13:35:30.161 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:29 smithi135 ceph-mon[97338]: pgmap v1135: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-07-14T13:35:30.161 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:29 smithi135 ceph-mon[97338]: from='client.? 172.21.15.17:0/70676667' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T13:35:30.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:29 smithi131 ceph-mon[96953]: pgmap v1135: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-07-14T13:35:30.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:29 smithi131 ceph-mon[96953]: from='client.? 172.21.15.17:0/70676667' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T13:35:30.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:29 smithi017 ceph-mon[95536]: pgmap v1135: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2023-07-14T13:35:30.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:29 smithi017 ceph-mon[95536]: from='client.? 172.21.15.17:0/70676667' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T13:35:30.822 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T13:35:32.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:31 smithi131 ceph-mon[96953]: pgmap v1136: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2023-07-14T13:35:32.319 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:31 smithi017 ceph-mon[95536]: pgmap v1136: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2023-07-14T13:35:32.411 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:31 smithi135 ceph-mon[97338]: pgmap v1136: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2023-07-14T13:35:34.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:33 smithi131 ceph-mon[96953]: pgmap v1137: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-07-14T13:35:34.319 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:33 smithi017 ceph-mon[95536]: pgmap v1137: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-07-14T13:35:34.411 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:33 smithi135 ceph-mon[97338]: pgmap v1137: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 21 KiB/s wr, 6 op/s 2023-07-14T13:35:36.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:35 smithi131 ceph-mon[96953]: pgmap v1138: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-07-14T13:35:36.319 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:35 smithi017 ceph-mon[95536]: pgmap v1138: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-07-14T13:35:36.411 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:35 smithi135 ceph-mon[97338]: pgmap v1138: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 19 KiB/s wr, 5 op/s 2023-07-14T13:35:36.924 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2023-07-14T13:35:36.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:35:36.925 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2023-07-14T13:35:37.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:35:37.016 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2023-07-14T13:35:37.062 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--tmp-cephfs (id: 0) 2023-07-14T13:35:37.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:35:37.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--tmp-cephfs 2023-07-14T13:35:37.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T13:35:37.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2023-07-14T13:35:37.252 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-07-14T13:35:37.275 INFO:tasks.cephadm:Teardown begin 2023-07-14T13:35:37.275 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/cephadm.py", line 1677, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-07-14T13:35:37.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T13:35:37.398 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T13:35:37.516 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T13:35:37.616 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-07-14T13:35:37.616 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-14T13:35:37.660 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-14T13:35:37.716 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-14T13:35:37.767 INFO:tasks.cephadm:Stopping all daemons... 2023-07-14T13:35:37.767 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-07-14T13:35:37.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.a 2023-07-14T13:35:38.210 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:37 smithi131 ceph-mon[96953]: pgmap v1139: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 9 op/s 2023-07-14T13:35:38.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:37 smithi017 systemd[1]: Stopping Ceph mon.a for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:35:38.320 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:37 smithi017 ceph-mon[95536]: pgmap v1139: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 9 op/s 2023-07-14T13:35:38.411 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:37 smithi135 ceph-mon[97338]: pgmap v1139: 97 pgs: 97 active+clean; 11 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 9 op/s 2023-07-14T13:35:38.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-a[95512]: 2023-07-14T13:35:38.334+0000 7ff2c3af4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:35:38.762 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-a[95512]: 2023-07-14T13:35:38.334+0000 7ff2c3af4700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-07-14T13:35:39.069 INFO:journalctl@ceph.mon.a.smithi017.stdout:Jul 14 13:35:38 smithi017 bash[201711]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-a 2023-07-14T13:35:39.417 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.a.service' 2023-07-14T13:35:39.530 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:35:39.531 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-07-14T13:35:39.531 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-07-14T13:35:39.532 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.b 2023-07-14T13:35:39.960 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:39 smithi131 systemd[1]: Stopping Ceph mon.b for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:35:40.648 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:40 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-b[96929]: 2023-07-14T13:35:40.225+0000 7f4eae4d9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:35:40.649 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:40 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-b[96929]: 2023-07-14T13:35:40.225+0000 7f4eae4d9700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-07-14T13:35:40.960 INFO:journalctl@ceph.mon.b.smithi131.stdout:Jul 14 13:35:40 smithi131 bash[134004]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-b 2023-07-14T13:35:41.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.b.service' 2023-07-14T13:35:41.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:35:41.120 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-07-14T13:35:41.121 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-07-14T13:35:41.121 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.c 2023-07-14T13:35:41.661 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:41 smithi135 systemd[1]: Stopping Ceph mon.c for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:35:42.161 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:41 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-c[97314]: 2023-07-14T13:35:41.755+0000 7f8a2cee7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:35:42.161 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:41 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-c[97314]: 2023-07-14T13:35:41.755+0000 7f8a2cee7700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-07-14T13:35:42.662 INFO:journalctl@ceph.mon.c.smithi135.stdout:Jul 14 13:35:42 smithi135 bash[136294]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mon-c 2023-07-14T13:35:42.765 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mon.c.service' 2023-07-14T13:35:42.862 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:35:42.862 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-07-14T13:35:42.863 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-07-14T13:35:42.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.x 2023-07-14T13:35:43.319 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 13:35:42 smithi017 systemd[1]: Stopping Ceph mgr.x for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:35:43.693 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 13:35:43 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T13:35:43.376+0000 7f645ac44700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:35:43.694 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 13:35:43 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x[95783]: 2023-07-14T13:35:43.376+0000 7f645ac44700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-07-14T13:35:43.955 INFO:journalctl@ceph.mgr.x.smithi017.stdout:Jul 14 13:35:43 smithi017 bash[201854]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-x 2023-07-14T13:35:44.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.x.service' 2023-07-14T13:35:44.356 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:35:44.356 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-07-14T13:35:44.357 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-07-14T13:35:44.357 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.y 2023-07-14T13:35:44.710 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 13:35:44 smithi131 systemd[1]: Stopping Ceph mgr.y for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:35:45.445 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jul 14 13:35:45 smithi131 bash[134143]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-y 2023-07-14T13:35:45.620 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.y.service' 2023-07-14T13:35:45.707 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:35:45.708 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-07-14T13:35:45.708 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-07-14T13:35:45.709 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.z 2023-07-14T13:35:46.161 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 13:35:45 smithi135 systemd[1]: Stopping Ceph mgr.z for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:35:47.847 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 13:35:47 smithi135 bash[136441]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mgr-z 2023-07-14T13:35:47.847 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Jul 14 13:35:47 smithi135 systemd[1]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-07-14T13:35:47.984 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mgr.z.service' 2023-07-14T13:35:48.072 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:35:48.073 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-07-14T13:35:48.073 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-07-14T13:35:48.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.0 2023-07-14T13:35:48.570 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 13:35:48 smithi017 systemd[1]: Stopping Ceph osd.0 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:35:49.069 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 13:35:48 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-0[107780]: 2023-07-14T13:35:48.591+0000 7fb801483700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:35:49.069 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 13:35:48 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-0[107780]: 2023-07-14T13:35:48.591+0000 7fb801483700 -1 osd.0 149 *** Got signal Terminated *** 2023-07-14T13:35:49.070 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 13:35:48 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-0[107780]: 2023-07-14T13:35:48.591+0000 7fb801483700 -1 osd.0 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:35:54.781 INFO:journalctl@ceph.osd.0.smithi017.stdout:Jul 14 13:35:54 smithi017 bash[202003]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-0 2023-07-14T13:35:56.722 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.0.service' 2023-07-14T13:35:56.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:35:56.823 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-07-14T13:35:56.824 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-07-14T13:35:56.824 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.1 2023-07-14T13:35:57.209 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 13:35:56 smithi131 systemd[1]: Stopping Ceph osd.1 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:35:57.709 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 13:35:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-1[102050]: 2023-07-14T13:35:57.397+0000 7f9b3b6d4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:35:57.710 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 13:35:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-1[102050]: 2023-07-14T13:35:57.397+0000 7f9b3b6d4700 -1 osd.1 149 *** Got signal Terminated *** 2023-07-14T13:35:57.710 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 13:35:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-1[102050]: 2023-07-14T13:35:57.397+0000 7f9b3b6d4700 -1 osd.1 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:36:03.709 INFO:journalctl@ceph.osd.1.smithi131.stdout:Jul 14 13:36:03 smithi131 bash[134301]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-1 2023-07-14T13:36:05.756 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.1.service' 2023-07-14T13:36:05.846 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:36:05.846 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-07-14T13:36:05.846 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-07-14T13:36:05.847 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.2 2023-07-14T13:36:06.395 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 13:36:05 smithi135 systemd[1]: Stopping Ceph osd.2 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:36:06.660 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 13:36:06 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-2[103191]: 2023-07-14T13:36:06.401+0000 7f680d534700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:36:06.661 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 13:36:06 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-2[103191]: 2023-07-14T13:36:06.401+0000 7f680d534700 -1 osd.2 149 *** Got signal Terminated *** 2023-07-14T13:36:06.661 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 13:36:06 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-2[103191]: 2023-07-14T13:36:06.401+0000 7f680d534700 -1 osd.2 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:36:12.910 INFO:journalctl@ceph.osd.2.smithi135.stdout:Jul 14 13:36:12 smithi135 bash[136601]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-2 2023-07-14T13:36:14.704 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.2.service' 2023-07-14T13:36:14.794 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:36:14.795 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-07-14T13:36:14.795 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-07-14T13:36:14.796 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.3 2023-07-14T13:36:14.819 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 13:36:14 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3[113327]: 2023-07-14T13:36:14.567+0000 7f653bb5f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.581348+0000 front 2023-07-14T13:35:51.581157+0000 (oldest deadline 2023-07-14T13:36:14.481317+0000) 2023-07-14T13:36:15.319 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 13:36:14 smithi017 systemd[1]: Stopping Ceph osd.3 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:36:15.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:15.205+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:15.608 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 13:36:15 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3[113327]: 2023-07-14T13:36:15.330+0000 7f6541d6e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:36:15.609 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 13:36:15 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3[113327]: 2023-07-14T13:36:15.330+0000 7f6541d6e700 -1 osd.3 149 *** Got signal Terminated *** 2023-07-14T13:36:15.609 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 13:36:15 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3[113327]: 2023-07-14T13:36:15.330+0000 7f6541d6e700 -1 osd.3 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:36:16.069 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 13:36:15 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3[113327]: 2023-07-14T13:36:15.616+0000 7f653bb5f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.581348+0000 front 2023-07-14T13:35:51.581157+0000 (oldest deadline 2023-07-14T13:36:14.481317+0000) 2023-07-14T13:36:16.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:16 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:16.224+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:17.069 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 13:36:16 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3[113327]: 2023-07-14T13:36:16.595+0000 7f653bb5f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.581348+0000 front 2023-07-14T13:35:51.581157+0000 (oldest deadline 2023-07-14T13:36:14.481317+0000) 2023-07-14T13:36:17.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:17 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:17.199+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:17.819 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 13:36:17 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3[113327]: 2023-07-14T13:36:17.556+0000 7f653bb5f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.581348+0000 front 2023-07-14T13:35:51.581157+0000 (oldest deadline 2023-07-14T13:36:14.481317+0000) 2023-07-14T13:36:18.274 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:17 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:17.973+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:18.410 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:18 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:18.011+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:18.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:18 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:18.042+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:18.550 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:18 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:18.281+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:18.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:18 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:18.217+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:18.818 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 13:36:18 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3[113327]: 2023-07-14T13:36:18.557+0000 7f653bb5f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.581348+0000 front 2023-07-14T13:35:51.581157+0000 (oldest deadline 2023-07-14T13:36:14.481317+0000) 2023-07-14T13:36:19.312 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:19 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:19.010+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:19.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:19 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:19.055+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:19.411 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:18 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:18.966+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:19.411 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:19 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:19.207+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:19.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:19 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:19.191+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:19.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:19 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:19.320+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:20.015 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 13:36:19 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3[113327]: 2023-07-14T13:36:19.599+0000 7f653bb5f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.581348+0000 front 2023-07-14T13:35:51.581157+0000 (oldest deadline 2023-07-14T13:36:14.481317+0000) 2023-07-14T13:36:20.273 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:20 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:20.023+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:20.410 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:19 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:19.976+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:20.411 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:20.167+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:20.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:20.042+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:20.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:20 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:20.207+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:20.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:20 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:20.281+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:21.209 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:21.007+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:21.209 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:20.932+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:21.276 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:21 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:21.022+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:21.277 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:21 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:21.245+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:21.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:21 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:21.189+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:21.568 INFO:journalctl@ceph.osd.3.smithi017.stdout:Jul 14 13:36:21 smithi017 bash[202280]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-3 2023-07-14T13:36:21.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:21.217+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:22.230 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:21.964+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:22.231 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:21.973+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:22.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:22 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:22.005+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:22.319 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:22 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:22.254+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:22.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:22.238+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:22.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:22 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:22.235+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:23.219 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:23 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:23.051+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:23.246 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.3.service' 2023-07-14T13:36:23.268 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:22.994+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:23.269 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:22.940+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:23.385 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:36:23.385 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-07-14T13:36:23.386 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-07-14T13:36:23.386 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.4 2023-07-14T13:36:23.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:23 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:23.254+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:23.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:23.277+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:23.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:23 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:23.269+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:23.709 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 13:36:23 smithi131 systemd[1]: Stopping Ceph osd.4 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:36:24.280 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 13:36:23 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-4[107581]: 2023-07-14T13:36:23.969+0000 7fd7fea3f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:36:24.280 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 13:36:23 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-4[107581]: 2023-07-14T13:36:23.969+0000 7fd7fea3f700 -1 osd.4 149 *** Got signal Terminated *** 2023-07-14T13:36:24.281 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 13:36:23 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-4[107581]: 2023-07-14T13:36:23.969+0000 7fd7fea3f700 -1 osd.4 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:36:24.288 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:23.934+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:24.288 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:23.934+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:24.288 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:24.010+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:24.288 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:24.010+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:24.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:24 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:24.026+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:24.319 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:24 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:24.270+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:24.319 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:24 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:24.270+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:24.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:24.295+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:24.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:24.295+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:24.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:24 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:24.288+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:24.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:24 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:24.288+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:25.247 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:24 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:24.986+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:25.333 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:24.938+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:25.334 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:24.938+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:25.334 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:24.966+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:25.334 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:24.966+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:25.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:25 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:25.255+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:25.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:25 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:25.255+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:25.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:25.341+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:25.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:25.341+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:25.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:25 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:25.261+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:25.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:25 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:25.261+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:25.709 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 13:36:25 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-4[107581]: 2023-07-14T13:36:25.472+0000 7fd7f782e700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.128458+0000 front 2023-07-14T13:36:02.128377+0000 (oldest deadline 2023-07-14T13:36:25.028526+0000) 2023-07-14T13:36:26.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:25 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:25.745+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:26.247 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:25 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:25.998+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:26.248 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:25 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:25.998+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:26.291 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:25.927+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:26.291 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:25.927+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:26.292 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:25.965+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:26.292 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:25.965+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:26.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:26 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:26.254+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:26.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:26 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:26.254+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:26.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:26.298+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:26.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:26.298+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:26.709 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 13:36:26 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-4[107581]: 2023-07-14T13:36:26.493+0000 7fd7f782e700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.128458+0000 front 2023-07-14T13:36:02.128377+0000 (oldest deadline 2023-07-14T13:36:25.028526+0000) 2023-07-14T13:36:26.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:26 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:26.273+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:26.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:26 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:26.273+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:27.160 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:26.914+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:27.161 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:26.914+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:27.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:26.937+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:27.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:26.937+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:27.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:26 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:26.768+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:27.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:26 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:26.981+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:27.271 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:26 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:26.981+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:27.528 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:27 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:27.269+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:27.528 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:27 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:27.269+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:27.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:27 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:27.278+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:27.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:27 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:27.278+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:27.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:27.281+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:27.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:27.281+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:27.780 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 13:36:27 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-4[107581]: 2023-07-14T13:36:27.536+0000 7fd7f782e700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.128458+0000 front 2023-07-14T13:36:02.128377+0000 (oldest deadline 2023-07-14T13:36:25.028526+0000) 2023-07-14T13:36:28.160 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:27.964+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:28.161 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:27.964+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:28.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:27.917+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:28.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:27.917+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:28.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:27 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:27.788+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:28.296 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:27 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:27.939+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:28.296 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:27 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:27.939+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:28.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:28 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:28.303+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:28.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:28 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:28.303+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:28.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:28.252+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:28.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:28.252+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:28.709 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 13:36:28 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-4[107581]: 2023-07-14T13:36:28.487+0000 7fd7f782e700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.128458+0000 front 2023-07-14T13:36:02.128377+0000 (oldest deadline 2023-07-14T13:36:25.028526+0000) 2023-07-14T13:36:28.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:28 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:28.240+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:28.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:28 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:28.240+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:29.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:28 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:28.741+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:29.269 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:28.934+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:29.269 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:28.934+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:29.270 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:28.959+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:29.270 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:28.959+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:29.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:28 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:28.955+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:29.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:28 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:28.955+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:29.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:29.276+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:29.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:29.276+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:29.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:29 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:29.272+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:29.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:29 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:29.272+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:29.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:29 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:29.345+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:29.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:29 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:29.345+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:30.006 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:29 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:29.723+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:30.160 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:29.891+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:30.160 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:29.891+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:30.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:29.933+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:30.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:29.933+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:30.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:29 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:29.908+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:30.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:29 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:29.908+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:30.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:30 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:30.248+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:30.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:30 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:30.248+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:30.460 INFO:journalctl@ceph.osd.4.smithi131.stdout:Jul 14 13:36:30 smithi131 bash[134566]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-4 2023-07-14T13:36:30.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:30 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:30.263+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:30.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:30 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:30.263+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:30.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:30 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:30.378+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:30.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:30 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:30.378+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:31.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:30 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:30.735+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:31.268 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:30 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:30.934+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:31.268 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:30 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:30.934+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:31.269 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:30 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:30.958+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:31.269 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:30 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:30.958+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:31.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:30 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:30.910+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:31.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:30 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:30.910+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:31.517 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:31 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:31.272+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:31.517 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:31 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:31.272+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:31.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:31 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:31.275+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:31.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:31 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:31.275+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:31.813 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:31 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:31.730+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:31.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:31 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:31.421+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:31.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:31 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:31.421+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:31.838 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.4.service' 2023-07-14T13:36:31.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:36:31.927 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-07-14T13:36:31.927 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-07-14T13:36:31.928 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.5 2023-07-14T13:36:32.160 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:32 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:32.000+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:32.160 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:32 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:32.000+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:32.161 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:31 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:31.906+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:32.161 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:31 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:31.906+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:32.161 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:32 smithi135 systemd[1]: Stopping Ceph osd.5 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:36:32.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:31 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:31.917+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:32.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:31 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:31.917+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:32.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:32 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:32.286+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:32.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:32 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:32.286+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:32.662 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:32 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:32.455+0000 7fddbba44700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:36:32.662 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:32 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:32.455+0000 7fddbba44700 -1 osd.5 149 *** Got signal Terminated *** 2023-07-14T13:36:32.663 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:32 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:32.455+0000 7fddbba44700 -1 osd.5 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:36:32.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:32 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:32.238+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:32.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:32 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:32.238+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:32.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:32 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:32.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:32.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:32 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:32.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:33.160 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:32 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:32.889+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:33.161 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:32 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:32.889+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:33.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:33 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:33.013+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:33.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:33 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:33.013+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:33.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:32 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:32.718+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:33.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:32 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:32.933+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:33.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:32 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:32.933+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:33.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:33 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:33.309+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:33.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:33 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:33.309+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:33.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:33 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:33.309+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:33.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:33 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:33.275+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:33.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:33 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:33.275+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:33.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:33 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:33.346+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:33.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:33 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:33.346+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:33.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:33 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:33.346+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:34.160 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:33 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:33.975+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:34.160 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:33 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:33.975+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:34.161 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:33 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:33.848+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:34.161 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:33 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:33.848+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:34.208 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:33 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:33.763+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:34.316 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:33 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:33.913+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:34.316 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:33 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:33.913+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:34.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:34 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:34.324+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:34.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:34 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:34.324+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:34.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:34 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:34.324+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:34.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:34 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:34.351+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:34.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:34 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:34.351+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:34.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:34 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:34.351+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:34.708 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:34 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:34.258+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:34.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:34 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:34.258+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:35.160 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:34 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:34.894+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:35.160 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:34 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:34.894+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:35.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:35.018+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:35.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:35.018+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:35.208 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:34 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:34.745+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:35.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:34 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:34.943+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:35.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:34 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:34.943+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:35.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:35.317+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:35.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:35.317+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:35.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:35.317+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:35.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:35.267+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:35.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:35.267+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:35.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:35.267+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:35.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:35.343+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:35.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:35.343+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:35.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:35.343+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:36.160 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:35.862+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:36.160 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:35.862+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:36.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:35.978+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:36.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:35 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:35.978+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:36.208 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:35.786+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:36.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:35 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:35.786+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:36.314 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:35.958+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:36.314 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:35.958+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:36.314 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:35 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:35.958+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.365643+0000 front 2023-07-14T13:36:09.365581+0000 (oldest deadline 2023-07-14T13:36:35.265326+0000) 2023-07-14T13:36:36.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:36.321+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:36.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:36.321+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:36.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:36.321+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:36.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:36 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:36.300+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:36.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:36 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:36.300+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:36.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:36 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:36.300+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:36.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:36 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:36.313+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:36.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:36 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:36.313+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:36.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:36 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:36.313+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:37.160 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:36 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:36.844+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.031496+0000 front 2023-07-14T13:35:52.031441+0000 (oldest deadline 2023-07-14T13:36:17.832094+0000) 2023-07-14T13:36:37.161 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:36 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:36.844+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:57.832729+0000 front 2023-07-14T13:35:57.832711+0000 (oldest deadline 2023-07-14T13:36:23.732727+0000) 2023-07-14T13:36:37.161 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:36 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5[108662]: 2023-07-14T13:36:36.844+0000 7fddb4032700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.334552+0000 front 2023-07-14T13:36:11.334513+0000 (oldest deadline 2023-07-14T13:36:36.634810+0000) 2023-07-14T13:36:37.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:37 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:37.025+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:37.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:37 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:37.026+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:37.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:37 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:37.026+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:37.208 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:36 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:36.794+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:37.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:36 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:36.794+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:37.311 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:36.927+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:37.311 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:36.927+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:37.311 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:36.927+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.365643+0000 front 2023-07-14T13:36:09.365581+0000 (oldest deadline 2023-07-14T13:36:35.265326+0000) 2023-07-14T13:36:37.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:37 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:37.318+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:37.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:37 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:37.318+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:37.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:37 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:37.318+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:37.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:37 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:37.347+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:37.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:37 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:37.347+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:37.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:37 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:37.347+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:37.708 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:37 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:37.300+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:37.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:37 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:37.300+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:37.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:37 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:37.300+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:38.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:37 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:37.768+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:38.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:37 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:37.768+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:38.283 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:37 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:37.946+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:38.284 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:37 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:37.946+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:38.284 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:37 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:37.946+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.365643+0000 front 2023-07-14T13:36:09.365581+0000 (oldest deadline 2023-07-14T13:36:35.265326+0000) 2023-07-14T13:36:38.386 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:38 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:38.061+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:38.386 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:38 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:38.061+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:38.386 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:38 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:38.061+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:38.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:38.291+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:38.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:38.291+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:38.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:38.291+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:38.643 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:38 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:38.393+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:38.643 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:38 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:38.394+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:38.643 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:38 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:38.394+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:38.708 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:38 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:38.291+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:38.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:38 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:38.291+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:38.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:38 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:38.291+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:38.910 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:38 smithi135 bash[136873]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-5 2023-07-14T13:36:39.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:38 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:38.756+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:39.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:38 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:38.756+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:39.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:38.952+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:39.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:38.952+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:39.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:38 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:38.952+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.365643+0000 front 2023-07-14T13:36:09.365581+0000 (oldest deadline 2023-07-14T13:36:35.265326+0000) 2023-07-14T13:36:39.386 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:39 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:39.106+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:39.386 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:39 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:39.106+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:39.387 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:39 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:39.106+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:39.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:39 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:39.393+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:39.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:39 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:39.393+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:39.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:39 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:39.393+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:39.708 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:39 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:39.335+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:39.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:39 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:39.335+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:39.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:39 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:39.335+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:39.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:39 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:39.332+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:39.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:39 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:39.332+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:39.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:39 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:39.332+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:40.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:39 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:39.738+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:40.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:39 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:39.738+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:40.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:39 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:39.978+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:40.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:39 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:39.978+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:40.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:39 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:39.978+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.365643+0000 front 2023-07-14T13:36:09.365581+0000 (oldest deadline 2023-07-14T13:36:35.265326+0000) 2023-07-14T13:36:40.364 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:40 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:40.056+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:40.364 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:40 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:40.056+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:40.364 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:40 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:40.056+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:40.599 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.5.service' 2023-07-14T13:36:40.660 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:40 smithi135 systemd[1]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.5.service: Succeeded. 2023-07-14T13:36:40.660 INFO:journalctl@ceph.osd.5.smithi135.stdout:Jul 14 13:36:40 smithi135 systemd[1]: Stopped Ceph osd.5 for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T13:36:40.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:40 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:40.371+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:40.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:40 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:40.371+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:40.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:40 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:40.371+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:40.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:36:40.687 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-07-14T13:36:40.688 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-07-14T13:36:40.688 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.6 2023-07-14T13:36:40.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:40 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:40.290+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:40.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:40 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:40.290+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:40.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:40 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:40.290+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:40.760 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:40 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:40.326+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:40.760 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:40 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:40.326+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:40.761 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:40 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:40.326+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:41.068 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:40 smithi017 systemd[1]: Stopping Ceph osd.6 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:36:41.068 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:40.998+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:41.069 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:40.998+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:41.069 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:40.998+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.365643+0000 front 2023-07-14T13:36:09.365581+0000 (oldest deadline 2023-07-14T13:36:35.265326+0000) 2023-07-14T13:36:41.208 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:40 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:40.764+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:41.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:40 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:40.764+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:41.384 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:41 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:41.030+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:41.384 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:41 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:41.030+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:41.384 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:41 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:41.030+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:41.568 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:41.218+0000 7f5e2059e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:36:41.568 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:41.218+0000 7f5e2059e700 -1 osd.6 149 *** Got signal Terminated *** 2023-07-14T13:36:41.569 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:41.218+0000 7f5e2059e700 -1 osd.6 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:36:41.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:41.348+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:41.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:41.348+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:41.570 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:41.348+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:41.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:41 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:41.392+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:41.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:41 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:41.392+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:41.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:41 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:41.392+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:41.708 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:41 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:41.257+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:41.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:41 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:41.257+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:41.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:41 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:41.257+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:42.208 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:41 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:41.782+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:42.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:41 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:41.782+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:42.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:41 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:41.782+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:42.297 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:42 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:42.035+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:42.297 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:42 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:42.035+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:42.297 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:42 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:42.035+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.365643+0000 front 2023-07-14T13:36:09.365581+0000 (oldest deadline 2023-07-14T13:36:35.265326+0000) 2023-07-14T13:36:42.370 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:42 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:42.076+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:42.370 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:42 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:42.076+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:42.370 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:42 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:42.076+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:42.371 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:42 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:42.076+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:42.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:42 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:42.304+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:42.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:42 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:42.304+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:42.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:42 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:42.304+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:42.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:42 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:42.378+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:42.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:42 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:42.378+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:42.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:42 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:42.378+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:42.708 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:42 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:42.221+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:42.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:42 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:42.221+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:42.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:42 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:42.221+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:42.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:42 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:42.221+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:43.208 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:42 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:42.763+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:43.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:42 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:42.763+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:43.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:42 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:42.763+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:43.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:43 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:43.001+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:43.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:43 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:43.001+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:43.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:43 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:43.001+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.365643+0000 front 2023-07-14T13:36:09.365581+0000 (oldest deadline 2023-07-14T13:36:35.265326+0000) 2023-07-14T13:36:43.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:43 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:43.001+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.265875+0000 front 2023-07-14T13:36:15.265770+0000 (oldest deadline 2023-07-14T13:36:42.266281+0000) 2023-07-14T13:36:43.408 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:43 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:43.123+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:43.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:43 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:43.123+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:43.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:43 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:43.123+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:43.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:43 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:43.123+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:43.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:43 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:43.416+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:43.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:43 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:43.416+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:43.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:43 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:43.416+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:43.708 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:43 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:43.230+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:43.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:43 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:43.230+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:43.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:43 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:43.230+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:43.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:43 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:43.230+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:43.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:43 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:43.331+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:43.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:43 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:43.331+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:43.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:43 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:43.331+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:44.208 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:43 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:43.765+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:44.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:43 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:43.765+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:44.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:43 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:43.765+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:44.318 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:44.047+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:44.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:44.047+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:44.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:44.047+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.365643+0000 front 2023-07-14T13:36:09.365581+0000 (oldest deadline 2023-07-14T13:36:35.265326+0000) 2023-07-14T13:36:44.319 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:44.047+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.265875+0000 front 2023-07-14T13:36:15.265770+0000 (oldest deadline 2023-07-14T13:36:42.266281+0000) 2023-07-14T13:36:44.319 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:44.285+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:44.319 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:44.285+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:44.319 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:44.285+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:44.320 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:44.285+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:44.410 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:44 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:44.385+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:44.410 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:44 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:44.385+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:44.410 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:44 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:44.385+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:44.410 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:44 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:44.385+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:44.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:44 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:44.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:44.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:44 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:44.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:44.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:44 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:44.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:44.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:44 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:44.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:44.708 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:44 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:44.258+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:44.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:44 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:44.258+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:44.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:44 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:44.258+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:44.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:44 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:44.258+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:45.210 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:44 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:44.797+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:45.210 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:44 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:44.797+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:45.210 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:44 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:44.797+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:45.410 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:45 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:45.385+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:45.411 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:45 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:45.385+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:45.411 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:45 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:45.385+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:45.411 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:45 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:45.385+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:45.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:45 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:45.164+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:45.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:45 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:45.164+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:45.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:45 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:45.164+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:45.412 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:45 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:45.164+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:45.568 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:45.077+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:45.569 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:45.077+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:45.569 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:45.077+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.365643+0000 front 2023-07-14T13:36:09.365581+0000 (oldest deadline 2023-07-14T13:36:35.265326+0000) 2023-07-14T13:36:45.569 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:45.077+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.265875+0000 front 2023-07-14T13:36:15.265770+0000 (oldest deadline 2023-07-14T13:36:42.266281+0000) 2023-07-14T13:36:45.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:45.317+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:45.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:45.317+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:45.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:45.318+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:45.570 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:45 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:45.318+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:45.714 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:45 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:45.275+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:45.714 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:45 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:45.275+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:45.714 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:45 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:45.275+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:45.714 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:45 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:45.275+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:46.208 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:45 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:45.833+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:46.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:45 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:45.833+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:46.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:45 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:45.833+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:46.339 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:46 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:46.078+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.361564+0000 front 2023-07-14T13:35:51.361739+0000 (oldest deadline 2023-07-14T13:36:17.762381+0000) 2023-07-14T13:36:46.339 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:46 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:46.078+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:01.263701+0000 front 2023-07-14T13:36:01.263879+0000 (oldest deadline 2023-07-14T13:36:25.963889+0000) 2023-07-14T13:36:46.339 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:46 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:46.078+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.365643+0000 front 2023-07-14T13:36:09.365581+0000 (oldest deadline 2023-07-14T13:36:35.265326+0000) 2023-07-14T13:36:46.339 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:46 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6[118884]: 2023-07-14T13:36:46.078+0000 7f5e1a38f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.265875+0000 front 2023-07-14T13:36:15.265770+0000 (oldest deadline 2023-07-14T13:36:42.266281+0000) 2023-07-14T13:36:46.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:46 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:46.399+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:46.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:46 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:46.399+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:46.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:46 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:46.399+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:46.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:46 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:46.399+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:46.662 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:46 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:46.173+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:46.662 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:46 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:46.173+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:46.662 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:46 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:46.173+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:46.662 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:46 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:46.173+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:46.708 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:46 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:46.231+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:46.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:46 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:46.231+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:46.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:46 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:46.231+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:46.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:46 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:46.231+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:46.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:46 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:46.346+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:46.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:46 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:46.346+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:46.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:46 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:46.346+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:46.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:46 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:46.346+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:47.208 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:46 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:46.838+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:47.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:46 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:46.838+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:47.209 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:46 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:46.838+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:47.570 INFO:journalctl@ceph.osd.6.smithi017.stdout:Jul 14 13:36:47 smithi017 bash[202543]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-6 2023-07-14T13:36:47.570 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:47 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:47.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:47.570 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:47 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:47.375+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:47.571 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:47 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:47.375+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:47.571 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:47 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:47.375+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:47.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:47 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:47.407+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:47.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:47 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:47.407+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:47.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:47 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:47.407+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:47.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:47 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:47.407+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:47.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:47 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:47.198+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:47.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:47 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:47.198+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:47.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:47 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:47.198+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:47.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:47 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:47.198+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:47.708 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:47 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:47.218+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:47.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:47 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:47.218+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:47.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:47 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:47.218+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:47.709 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:47 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:47.218+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:48.170 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:47 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:47.822+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:48.171 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:47 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:47.822+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:48.171 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:47 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:47.822+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:48.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:48 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:48.178+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:48.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:48 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:48.178+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:48.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:48 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:48.178+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:48.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:48 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:48.178+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:48.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:48 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:48.403+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:48.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:48 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:48.403+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:48.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:48 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:48.403+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:48.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:48 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:48.403+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:48.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:48 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:48.174+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:48.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:48 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:48.174+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:48.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:48 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:48.174+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:48.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:48 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:48.174+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:48.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:48 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:48.404+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:48.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:48 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:48.404+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:48.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:48 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:48.404+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:48.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:48 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:48.404+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:49.141 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:48 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:48.867+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:49.142 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:48 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:48.867+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:49.142 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:48 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:48.867+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:49.264 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.6.service' 2023-07-14T13:36:49.363 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:36:49.364 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-07-14T13:36:49.364 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-07-14T13:36:49.365 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.7 2023-07-14T13:36:49.431 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:49 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:49.149+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:49.431 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:49 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:49.149+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:49.431 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:49 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:49.149+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:49.431 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:49 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:49.149+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:49.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:49 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:49.399+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:49.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:49 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:49.399+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:49.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:49 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:49.399+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:49.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:49 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:49.399+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:49.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:49 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:49.410+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:49.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:49 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:49.410+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:49.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:49 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:49.410+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:49.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:49 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:49.410+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:49.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:49 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:49.215+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:49.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:49 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:49.215+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:49.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:49 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:49.215+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:49.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:49 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:49.215+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:49.708 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:49 smithi131 systemd[1]: Stopping Ceph osd.7 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:36:50.208 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:50 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:50.113+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:50.209 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:50 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:50.113+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:50.209 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:50 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:50.113+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:50.210 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:50 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:50.113+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:50.210 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:49 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:49.867+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:50.210 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:49 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:49.867+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:50.210 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:49 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:49.867+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:50.211 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:49 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:49.880+0000 7fb96f2de700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:36:50.211 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:49 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:49.880+0000 7fb96f2de700 -1 osd.7 149 *** Got signal Terminated *** 2023-07-14T13:36:50.211 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:49 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:49.880+0000 7fb96f2de700 -1 osd.7 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:36:50.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:50 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:50.430+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:50.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:50 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:50.430+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:50.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:50 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:50.430+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:50.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:50 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:50.430+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:50.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:50 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:50.222+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:50.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:50 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:50.222+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:50.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:50 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:50.222+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:50.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:50 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:50.222+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:50.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:50 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:50.403+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:50.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:50 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:50.403+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:50.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:50 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:50.403+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:50.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:50 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:50.403+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:51.145 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:50 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:50.841+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:51.146 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:50 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:50.841+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:51.146 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:50 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:50.841+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:51.146 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:50 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:50.841+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:27.935368+0000 front 2023-07-14T13:36:27.935529+0000 (oldest deadline 2023-07-14T13:36:50.835413+0000) 2023-07-14T13:36:51.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:51 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:51.153+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:51.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:51 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:51.153+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:51.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:51 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:51.153+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:51.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:51 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:51.153+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:51.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:51 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:51.153+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:36:51.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:51 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:51.426+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:51.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:51 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:51.426+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:51.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:51 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:51.426+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:51.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:51 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:51.426+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:51.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:51 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:51.426+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:36:51.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:51 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:51.192+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:51.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:51 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:51.192+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:51.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:51 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:51.192+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:51.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:51 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:51.192+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:51.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:51 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:51.389+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:51.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:51 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:51.389+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:51.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:51 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:51.389+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:51.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:51 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:51.389+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:52.146 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:51 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:51.835+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:52.147 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:51 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:51.835+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:52.147 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:51 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:51.835+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:52.147 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:51 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:51.835+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:27.935368+0000 front 2023-07-14T13:36:27.935529+0000 (oldest deadline 2023-07-14T13:36:50.835413+0000) 2023-07-14T13:36:52.410 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:52 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:52.408+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:52.410 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:52 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:52.408+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:52.410 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:52 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:52.408+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:52.411 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:52 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:52.408+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:52.411 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:52 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:52.408+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:36:52.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:52 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:52.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:52.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:52 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:52.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:52.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:52 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:52.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:52.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:52 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:52.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:52.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:52 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:52.153+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:52.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:52 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:52.154+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:52.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:52 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:52.154+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:52.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:52 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:52.154+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:52.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:52 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:52.154+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:36:52.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:52 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:52.428+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:52.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:52 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:52.428+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:52.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:52 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:52.428+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:52.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:52 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:52.428+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:53.174 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:52 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:52.816+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:53.175 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:52 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:52.816+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:53.175 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:52 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:52.816+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:53.175 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:52 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:52.816+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:27.935368+0000 front 2023-07-14T13:36:27.935529+0000 (oldest deadline 2023-07-14T13:36:50.835413+0000) 2023-07-14T13:36:53.402 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:53 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:53.134+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:53.402 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:53 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:53.134+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:53.403 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:53 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:53.134+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:53.403 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:53 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:53.134+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:53.403 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:53 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:53.134+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:36:53.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:53 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:53.182+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:53.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:53 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:53.182+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:53.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:53 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:53.182+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:53.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:53 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:53.182+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:53.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:53 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:53.182+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:36:53.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:53 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:53.410+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:53.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:53 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:53.410+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:53.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:53 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:53.410+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:53.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:53 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:53.410+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:53.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:53 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:53.410+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:36:53.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:53 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:53.450+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:53.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:53 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:53.451+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:53.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:53 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:53.451+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:53.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:53 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:53.451+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:54.142 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:53 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:53.853+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.128297+0000 front 2023-07-14T13:36:00.128325+0000 (oldest deadline 2023-07-14T13:36:25.329098+0000) 2023-07-14T13:36:54.142 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:53 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:53.853+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.331040+0000 front 2023-07-14T13:36:09.330943+0000 (oldest deadline 2023-07-14T13:36:35.132037+0000) 2023-07-14T13:36:54.143 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:53 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:53.853+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:15.633401+0000 front 2023-07-14T13:36:15.633622+0000 (oldest deadline 2023-07-14T13:36:41.533518+0000) 2023-07-14T13:36:54.143 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:53 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7[113029]: 2023-07-14T13:36:53.853+0000 7fb9690cf700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:27.935368+0000 front 2023-07-14T13:36:27.935529+0000 (oldest deadline 2023-07-14T13:36:50.835413+0000) 2023-07-14T13:36:54.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:54 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:54.115+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:54.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:54 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:54.115+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:54.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:54 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:54.115+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:54.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:54 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:54.115+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:54.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:54 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:54.115+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:36:54.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:54 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:54.150+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:54.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:54 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:54.150+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:54.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:54 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:54.150+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:54.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:54 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:54.150+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:54.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:54 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:54.150+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:36:54.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:54 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:54.417+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:54.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:54 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:54.417+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:54.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:54 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:54.417+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:54.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:54 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:54.417+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:54.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:54 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:54.417+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:36:54.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:54 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:54.430+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:54.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:54 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:54.430+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:54.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:54 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:54.430+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:54.911 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:54 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:54.430+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:54.911 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:54 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:54.430+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:36:55.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:55 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:55.119+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:55.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:55 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:55.119+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:55.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:55 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:55.119+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:55.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:55 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:55.119+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:55.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:55 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:55.119+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:36:55.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:55 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:55.172+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:55.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:55 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:55.172+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:55.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:55 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:55.172+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:55.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:55 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:55.172+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:55.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:55 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:55.172+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:36:55.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:55 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:55.389+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:55.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:55 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:55.389+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:55.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:55 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:55.389+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:55.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:55 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:55.389+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:55.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:55 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:55.389+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:36:55.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:55 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:55.475+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:55.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:55 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:55.475+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:55.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:55 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:55.475+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:55.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:55 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:55.475+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:55.911 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:55 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:55.475+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:36:56.060 INFO:journalctl@ceph.osd.7.smithi131.stdout:Jul 14 13:36:56 smithi131 bash[134836]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-7 2023-07-14T13:36:56.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:56 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:56.158+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:56.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:56 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:56.158+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:56.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:56 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:56.158+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:56.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:56 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:56.158+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:56.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:56 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:56.158+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:36:56.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:56 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:56.132+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:56.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:56 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:56.132+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:56.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:56 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:56.132+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:56.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:56 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:56.132+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:56.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:56 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:56.132+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:36:56.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:56 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:56.376+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:56.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:56 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:56.376+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:56.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:56 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:56.376+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:56.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:56 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:56.376+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:56.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:56 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:56.376+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:36:56.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:56 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:56.428+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:56.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:56 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:56.428+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:56.911 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:56 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:56.428+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:56.911 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:56 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:56.428+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:56.911 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:56 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:56.428+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:36:57.209 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:57.109+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:57.209 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:57.109+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:57.209 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:57.109+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:57.210 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:57.109+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:57.210 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:57.109+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:36:57.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:57 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:57.154+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:57.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:57 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:57.154+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:57.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:57 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:57.154+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:57.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:57 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:57.154+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:57.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:57 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:57.154+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:36:57.799 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.7.service' 2023-07-14T13:36:57.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:57 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:57.353+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:57.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:57 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:57.353+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:57.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:57 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:57.353+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:57.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:57 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:57.353+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:57.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:57 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:57.353+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:36:57.887 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:36:57.887 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-07-14T13:36:57.888 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-07-14T13:36:57.888 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.8 2023-07-14T13:36:57.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:57 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:57.473+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:57.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:57 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:57.473+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:57.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:57 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:57.473+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:57.911 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:57 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:57.473+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:57.911 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:57 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:57.473+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:36:58.394 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:57 smithi135 systemd[1]: Stopping Ceph osd.8 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:36:58.394 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:58.171+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:58.394 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:58.171+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:58.394 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:58.171+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:58.395 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:58.171+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:58.395 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:58.171+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:36:58.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:58 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:58.093+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:58.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:58 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:58.093+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:58.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:58 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:58.093+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:58.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:58 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:58.093+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:58.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:58 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:58.093+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:36:58.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:58.401+0000 7f0032a63700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:36:58.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:58.401+0000 7f0032a63700 -1 osd.8 149 *** Got signal Terminated *** 2023-07-14T13:36:58.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:58.401+0000 7f0032a63700 -1 osd.8 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:36:58.660 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:58.500+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:58.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:58.500+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:58.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:58.500+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:58.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:58.500+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:58.661 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:58 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:58.500+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:36:58.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:58.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:58.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:58.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:58.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:58.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:58.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:58.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:58.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:58 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:58.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:36:59.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:59 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:59.155+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:36:59.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:59 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:59.155+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:36:59.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:59 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:59.155+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:36:59.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:59 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:59.155+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:36:59.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:36:59 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:36:59.155+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:36:59.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:59 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:59.081+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:36:59.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:59 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:59.081+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:36:59.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:59 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:59.081+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:36:59.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:59 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:59.081+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:36:59.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:36:59 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:36:59.081+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:36:59.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:59 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:59.387+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:36:59.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:59 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:59.387+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:36:59.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:59 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:59.387+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:36:59.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:59 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:59.387+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:36:59.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:36:59 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:36:59.387+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:36:59.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:59 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:59.536+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:36:59.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:59 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:59.536+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:36:59.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:59 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:59.536+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:36:59.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:59 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:59.536+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:36:59.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:36:59 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:36:59.536+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:37:00.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:00 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:00.130+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:00.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:00 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:00.130+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:00.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:00 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:00.130+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:00.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:00 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:00.130+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:00.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:00 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:00.130+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:00.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:00 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:00.042+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:00.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:00 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:00.042+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:00.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:00 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:00.042+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:00.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:00 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:00.042+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:00.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:00 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:00.042+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:00.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:00.431+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:00.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:00.431+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:00.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:00.431+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:00.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:00.431+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:00.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:00.431+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:00.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:00 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:00.431+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:00.909 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:00 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:00.533+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:37:00.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:00 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:00.533+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:37:00.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:00 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:00.533+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:37:00.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:00 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:00.533+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:37:00.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:00 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:00.533+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:37:01.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:01 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:01.125+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:01.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:01 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:01.125+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:01.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:01 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:01.125+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:01.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:01 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:01.125+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:01.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:01 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:01.125+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:01.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:01 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:01.125+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:01.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:01 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:01.086+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:01.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:01 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:01.086+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:01.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:01 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:01.086+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:01.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:01 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:01.086+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:01.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:01 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:01.086+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:01.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:01 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:01.086+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:01.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:01 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:01.399+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:01.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:01 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:01.399+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:01.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:01 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:01.399+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:01.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:01 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:01.399+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:01.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:01 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:01.399+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:01.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:01 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:01.399+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:01.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:01 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:01.504+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:37:01.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:01 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:01.504+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:37:01.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:01 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:01.504+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:37:01.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:01 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:01.504+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:37:01.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:01 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:01.504+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:37:02.208 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:02 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:02.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:02.208 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:02 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:02.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:02.209 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:02 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:02.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:02.209 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:02 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:02.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:02.209 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:02 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:02.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:02.209 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:02 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:02.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:02.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:02.115+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:02.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:02.115+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:02.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:02.115+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:02.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:02.115+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:02.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:02.115+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:02.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:02.115+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:02.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:02 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:02.369+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:02.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:02 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:02.369+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:02.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:02 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:02.369+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:02.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:02 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:02.369+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:02.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:02 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:02.369+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:02.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:02 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:02.369+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:02.909 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:02.554+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:53.090768+0000 front 2023-07-14T13:35:53.090656+0000 (oldest deadline 2023-07-14T13:36:18.390674+0000) 2023-07-14T13:37:02.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:02.554+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:00.092344+0000 front 2023-07-14T13:36:00.092146+0000 (oldest deadline 2023-07-14T13:36:23.592418+0000) 2023-07-14T13:37:02.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:02.554+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:09.894732+0000 front 2023-07-14T13:36:09.894761+0000 (oldest deadline 2023-07-14T13:36:32.794933+0000) 2023-07-14T13:37:02.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:02.554+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:17.897810+0000 front 2023-07-14T13:36:17.897829+0000 (oldest deadline 2023-07-14T13:36:43.797611+0000) 2023-07-14T13:37:02.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:02.554+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:25.498812+0000 front 2023-07-14T13:36:25.498820+0000 (oldest deadline 2023-07-14T13:36:50.798777+0000) 2023-07-14T13:37:02.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:02 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8[114226]: 2023-07-14T13:37:02.554+0000 7f002b852700 -1 osd.8 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:36.099887+0000 front 2023-07-14T13:36:36.099815+0000 (oldest deadline 2023-07-14T13:37:01.999984+0000) 2023-07-14T13:37:03.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:03 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:03.128+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:03.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:03 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:03.128+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:03.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:03 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:03.128+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:03.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:03 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:03.128+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:03.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:03 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:03.128+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:03.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:03 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:03.128+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:03.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:03 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:03.110+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:03.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:03 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:03.110+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:03.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:03 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:03.110+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:03.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:03 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:03.110+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:03.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:03 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:03.110+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:03.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:03 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:03.110+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:03.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:03 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:03.343+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:03.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:03 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:03.343+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:03.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:03 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:03.343+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:03.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:03 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:03.343+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:03.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:03 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:03.343+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:03.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:03 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:03.343+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:04.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:04 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:04.093+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:04.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:04 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:04.093+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:04.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:04 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:04.093+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:04.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:04 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:04.093+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:04.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:04 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:04.093+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:04.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:04 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:04.093+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:04.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:04 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:04.094+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:04.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:04 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:04.094+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:04.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:04 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:04.094+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:04.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:04 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:04.094+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:04.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:04 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:04.094+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:04.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:04 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:04.094+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:04.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:04 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:04.297+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:04.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:04 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:04.297+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:04.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:04 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:04.297+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:04.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:04 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:04.297+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:04.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:04 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:04.297+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:04.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:04 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:04.297+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:04.910 INFO:journalctl@ceph.osd.8.smithi135.stdout:Jul 14 13:37:04 smithi135 bash[137158]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-8 2023-07-14T13:37:05.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:05 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:05.102+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:05.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:05 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:05.102+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:05.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:05 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:05.102+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:05.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:05 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:05.102+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:05.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:05 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:05.102+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:05.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:05 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:05.102+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:05.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:05 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:05.090+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:05.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:05 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:05.090+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:05.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:05 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:05.090+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:05.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:05 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:05.090+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:05.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:05 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:05.090+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:05.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:05 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:05.090+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:05.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:05 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:05.292+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:05.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:05 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:05.292+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:05.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:05 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:05.292+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:05.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:05 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:05.292+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:05.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:05 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:05.292+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:05.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:05 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:05.292+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:06.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:06 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:06.082+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:06.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:06 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:06.082+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:06.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:06 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:06.082+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:06.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:06 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:06.082+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:06.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:06 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:06.082+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:06.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:06 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:06.082+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:06.453 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.8.service' 2023-07-14T13:37:06.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:06 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:06.044+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:06.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:06 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:06.044+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:06.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:06 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:06.044+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:06.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:06 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:06.044+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:06.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:06 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:06.044+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:06.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:06 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:06.044+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:06.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:06 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:06.314+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:06.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:06 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:06.314+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:06.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:06 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:06.314+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:06.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:06 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:06.314+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:06.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:06 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:06.314+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:06.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:06 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:06.314+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:06.581 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:37:06.582 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-07-14T13:37:06.582 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-07-14T13:37:06.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.9 2023-07-14T13:37:07.067 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:06 smithi017 systemd[1]: Stopping Ceph osd.9 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:37:07.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:07 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:07.096+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:07.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:07 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:07.096+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:07.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:07 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:07.096+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:07.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:07 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:07.096+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:07.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:07 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:07.096+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:07.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:07 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:07.096+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:07.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:07 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:07.024+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:07.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:07 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:07.024+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:07.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:07 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:07.024+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:07.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:07 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:07.024+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:07.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:07 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:07.024+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:07.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:07 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:07.024+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:07.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:07 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:07.115+0000 7fb877750700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:37:07.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:07 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:07.115+0000 7fb877750700 -1 osd.9 149 *** Got signal Terminated *** 2023-07-14T13:37:07.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:07 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:07.115+0000 7fb877750700 -1 osd.9 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:37:07.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:07 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:07.285+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:07.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:07 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:07.285+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:07.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:07 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:07.285+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:07.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:07 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:07.285+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:07.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:07 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:07.285+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:07.569 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:07 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:07.286+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:08.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:08 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:08.083+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:08.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:08 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:08.083+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:08.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:08 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:08.083+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:08.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:08 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:08.083+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:08.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:08 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:08.083+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:08.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:08 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:08.083+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:08.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:08 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:08.008+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:08.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:08 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:08.008+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:08.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:08 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:08.008+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:08.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:08 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:08.008+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:08.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:08 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:08.008+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:08.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:08 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:08.008+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:08.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:08 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:08.327+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:08.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:08 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:08.327+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:08.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:08 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:08.327+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:08.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:08 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:08.327+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:08.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:08 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:08.327+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:08.820 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:08 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:08.327+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:09.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:09 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:09.065+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:09.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:09 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:09.065+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:09.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:09 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:09.065+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:09.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:09 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:09.065+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:09.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:09 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:09.065+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:09.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:09 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:09.065+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:09.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:09 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:09.022+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:09.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:09 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:09.022+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:09.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:09 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:09.022+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:09.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:09 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:09.022+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:09.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:09 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:09.022+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:09.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:09 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:09.022+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:09.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:09 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:09.022+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:09.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:09 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:09.332+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:09.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:09 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:09.332+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:09.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:09 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:09.332+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:09.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:09 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:09.332+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:09.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:09 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:09.332+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:09.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:09 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:09.332+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:10.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:10 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:10.091+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:10.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:10 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:10.091+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:10.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:10 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:10.091+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:10.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:10 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:10.091+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:10.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:10 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:10.091+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:10.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:10 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:10.091+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:10.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:10 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:10.038+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:10.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:10 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:10.038+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:10.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:10 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:10.038+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:10.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:10 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:10.038+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:10.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:10 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:10.038+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:10.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:10 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:10.038+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:10.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:10 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:10.038+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:10.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:10 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:10.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:10.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:10 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:10.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:10.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:10 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:10.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:10.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:10 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:10.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:10.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:10 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:10.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:10.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:10 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:10.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:10.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:10 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:10.374+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:46.138234+0000 front 2023-07-14T13:36:46.138256+0000 (oldest deadline 2023-07-14T13:37:09.638277+0000) 2023-07-14T13:37:11.416 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:11 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:11.086+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:11.417 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:11 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:11.086+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:11.417 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:11 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:11.086+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:11.417 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:11 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:11.086+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:11.417 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:11 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:11.086+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:11.417 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:11 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:11.086+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:11.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:11 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:11.047+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:11.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:11 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:11.047+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:11.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:11 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:11.047+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:11.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:11 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:11.047+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:11.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:11 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:11.047+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:11.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:11 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:11.047+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:11.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:11 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:11.047+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:11.818 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:11 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:11.392+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:51.327572+0000 front 2023-07-14T13:35:51.327608+0000 (oldest deadline 2023-07-14T13:36:17.728902+0000) 2023-07-14T13:37:11.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:11 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:11.392+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.331141+0000 front 2023-07-14T13:36:02.331125+0000 (oldest deadline 2023-07-14T13:36:23.431225+0000) 2023-07-14T13:37:11.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:11 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:11.392+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.033293+0000 front 2023-07-14T13:36:11.033271+0000 (oldest deadline 2023-07-14T13:36:32.733349+0000) 2023-07-14T13:37:11.819 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:11 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:11.392+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:18.034393+0000 front 2023-07-14T13:36:18.034507+0000 (oldest deadline 2023-07-14T13:36:43.934444+0000) 2023-07-14T13:37:11.820 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:11 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:11.392+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:28.535977+0000 front 2023-07-14T13:36:28.536152+0000 (oldest deadline 2023-07-14T13:36:53.836054+0000) 2023-07-14T13:37:11.820 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:11 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:11.392+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:33.836685+0000 front 2023-07-14T13:36:33.836771+0000 (oldest deadline 2023-07-14T13:36:59.736550+0000) 2023-07-14T13:37:11.820 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:11 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9[124409]: 2023-07-14T13:37:11.392+0000 7fb87053f700 -1 osd.9 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:46.138234+0000 front 2023-07-14T13:36:46.138256+0000 (oldest deadline 2023-07-14T13:37:09.638277+0000) 2023-07-14T13:37:12.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:12 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:12.121+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:12.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:12 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:12.121+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:12.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:12 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:12.121+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:12.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:12 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:12.121+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:12.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:12 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:12.121+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:12.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:12 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:12.121+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:12.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:12 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:12.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:12.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:12 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:12.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:12.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:12 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:12.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:12.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:12 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:12.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:12.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:12 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:12.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:12.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:12 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:12.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:12.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:12 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:12.082+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:13.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:13 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:13.141+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:13.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:13 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:13.141+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:13.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:13 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:13.141+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:13.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:13 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:13.141+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:13.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:13 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:13.141+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:13.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:13 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:13.141+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:13.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:13 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:13.120+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:13.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:13 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:13.120+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:13.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:13 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:13.120+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:13.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:13 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:13.120+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:13.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:13 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:13.120+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:13.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:13 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:13.120+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:13.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:13 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:13.120+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:13.568 INFO:journalctl@ceph.osd.9.smithi017.stdout:Jul 14 13:37:13 smithi017 bash[202821]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-9 2023-07-14T13:37:14.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:14 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:14.077+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:14.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:14 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:14.077+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:14.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:14 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:14.077+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:14.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:14 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:14.077+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:14.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:14 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:14.077+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:14.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:14 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:14.077+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:14.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:14 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:14.077+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:14.659 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:14 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:14.170+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:14.660 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:14 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:14.170+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:14.660 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:14 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:14.170+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:14.660 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:14 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:14.170+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:14.660 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:14 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:14.170+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:14.660 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:14 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:14.170+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:15.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.9.service' 2023-07-14T13:37:15.297 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:37:15.298 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-07-14T13:37:15.298 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-07-14T13:37:15.299 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.10 2023-07-14T13:37:15.365 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:15.117+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:15.365 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:15.118+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:15.365 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:15.118+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:15.365 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:15.118+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:15.365 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:15.118+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:15.366 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:15.118+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:15.366 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:15.118+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:15.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:15 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:15.158+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:15.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:15 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:15.158+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:15.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:15 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:15.158+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:15.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:15 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:15.158+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:15.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:15 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:15.158+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:15.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:15 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:15.158+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:15.708 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:15 smithi131 systemd[1]: Stopping Ceph osd.10 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:37:16.137 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:15.811+0000 7f1a54316700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:37:16.137 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:15.811+0000 7f1a54316700 -1 osd.10 149 *** Got signal Terminated *** 2023-07-14T13:37:16.137 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:15 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:15.811+0000 7f1a54316700 -1 osd.10 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:37:16.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:16 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:16.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:16.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:16 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:16.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:16.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:16 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:16.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:16.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:16 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:16.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:16.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:16 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:16.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:16.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:16 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:16.159+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:16.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:16 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:16.145+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:16.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:16 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:16.145+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:16.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:16 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:16.146+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:16.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:16 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:16.146+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:16.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:16 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:16.146+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:16.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:16 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:16.146+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:16.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:16 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:16.146+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:17.466 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:17 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:17.115+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:17.466 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:17 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:17.115+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:17.466 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:17 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:17.115+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:17.467 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:17 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:17.115+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:17.467 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:17 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:17.115+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:17.467 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:17 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:17.115+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:17.467 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:17 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:17.115+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:17.659 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:17 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:17.177+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:17.660 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:17 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:17.177+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:17.660 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:17 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:17.177+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:17.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:17 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:17.177+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:17.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:17 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:17.177+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:17.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:17 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:17.177+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:17.661 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:17 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:17.177+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:18.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:18 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:18.144+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:18.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:18 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:18.144+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:18.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:18 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:18.144+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:18.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:18 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:18.144+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:18.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:18 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:18.144+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:18.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:18 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:18.144+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:18.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:18 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:18.144+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:18.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:18 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:18.158+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:18.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:18 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:18.158+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:18.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:18 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:18.158+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:18.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:18 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:18.158+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:18.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:18 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:18.158+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:18.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:18 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:18.158+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:18.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:18 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:18.158+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:19.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:19 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:19.143+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:19.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:19 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:19.143+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:19.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:19 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:19.143+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:19.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:19 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:19.143+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:19.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:19 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:19.143+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:19.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:19 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:19.143+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:19.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:19 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:19.143+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:19.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:19 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:19.139+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:19.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:19 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:19.139+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:19.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:19 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:19.139+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:19.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:19 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:19.139+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:19.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:19 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:19.139+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:19.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:19 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:19.139+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:19.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:19 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:19.139+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:20.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:20.160+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:20.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:20.160+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:20.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:20.160+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:20.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:20.160+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:20.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:20.160+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:20.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:20.160+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:20.411 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:20.160+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:20.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:20 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:20.100+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:48.939985+0000 front 2023-07-14T13:35:48.940069+0000 (oldest deadline 2023-07-14T13:36:14.840142+0000) 2023-07-14T13:37:20.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:20 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:20.100+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:35:58.341543+0000 front 2023-07-14T13:35:58.341575+0000 (oldest deadline 2023-07-14T13:36:24.241677+0000) 2023-07-14T13:37:20.458 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:20 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:20.100+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:11.143948+0000 front 2023-07-14T13:36:11.143827+0000 (oldest deadline 2023-07-14T13:36:34.643826+0000) 2023-07-14T13:37:20.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:20 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:20.100+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:19.245697+0000 front 2023-07-14T13:36:19.245624+0000 (oldest deadline 2023-07-14T13:36:41.545492+0000) 2023-07-14T13:37:20.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:20 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:20.100+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:26.746791+0000 front 2023-07-14T13:36:26.746765+0000 (oldest deadline 2023-07-14T13:36:50.846758+0000) 2023-07-14T13:37:20.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:20 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:20.100+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:34.748742+0000 front 2023-07-14T13:36:34.748721+0000 (oldest deadline 2023-07-14T13:37:00.048660+0000) 2023-07-14T13:37:20.459 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:20 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10[118496]: 2023-07-14T13:37:20.100+0000 7f1a4e908700 -1 osd.10 149 heartbeat_check: no reply from 172.21.15.17:6822 osd.6 since back 2023-07-14T13:36:43.550018+0000 front 2023-07-14T13:36:43.550153+0000 (oldest deadline 2023-07-14T13:37:08.249801+0000) 2023-07-14T13:37:21.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:21.139+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:21.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:21.139+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:21.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:21.139+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:21.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:21.139+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:21.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:21.139+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:21.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:21.139+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:21.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:21 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:21.139+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:22.207 INFO:journalctl@ceph.osd.10.smithi131.stdout:Jul 14 13:37:21 smithi131 bash[135108]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-10 2023-07-14T13:37:22.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:22.094+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:22.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:22.094+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:22.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:22.094+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:22.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:22.094+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:22.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:22.094+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:22.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:22.094+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:22.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:22 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:22.094+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:23.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:23.090+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:23.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:23.090+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:23.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:23.090+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:23.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:23.090+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:23.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:23.090+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:23.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:23.090+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:23.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:23 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:23.090+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:23.739 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.10.service' 2023-07-14T13:37:23.826 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:37:23.827 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-07-14T13:37:23.827 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-07-14T13:37:23.828 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.11 2023-07-14T13:37:24.159 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:23 smithi135 systemd[1]: Stopping Ceph osd.11 for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:37:24.160 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:24.095+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:24.160 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:24.095+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:24.160 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:24.095+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:24.160 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:24.095+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:24.160 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:24.095+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:24.160 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:24.095+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:24.161 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:24.095+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:24.659 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:24.339+0000 7f6da92c5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:37:24.659 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:24.339+0000 7f6da92c5700 -1 osd.11 149 *** Got signal Terminated *** 2023-07-14T13:37:24.659 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:24 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:24.339+0000 7f6da92c5700 -1 osd.11 149 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T13:37:25.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:25.056+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:25.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:25.056+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:25.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:25.056+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:25.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:25.056+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:25.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:25.056+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:25.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:25.056+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:25.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:25 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:25.056+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:26.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:26.028+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:26.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:26.028+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:26.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:26.028+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:26.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:26.028+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:26.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:26.028+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:26.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:26.028+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:26.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:26 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:26.028+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:27.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:27.032+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:27.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:27.032+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:27.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:27.032+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:27.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:27.032+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:27.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:27.032+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:27.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:27.032+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:27.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:27.032+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:28.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:28.023+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:28.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:28.023+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:28.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:28.023+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:28.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:28.023+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:28.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:28.023+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:28.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:28.023+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:28.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:28.023+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:28.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:28 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:28.023+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6820 osd.8 since back 2023-07-14T13:37:02.586220+0000 front 2023-07-14T13:37:02.586268+0000 (oldest deadline 2023-07-14T13:37:27.886212+0000) 2023-07-14T13:37:29.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:29.015+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2023-07-14T13:35:52.371930+0000 front 2023-07-14T13:35:52.372274+0000 (oldest deadline 2023-07-14T13:36:17.072114+0000) 2023-07-14T13:37:29.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:29.015+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6804 osd.1 since back 2023-07-14T13:36:02.273937+0000 front 2023-07-14T13:36:02.273837+0000 (oldest deadline 2023-07-14T13:36:23.373847+0000) 2023-07-14T13:37:29.409 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:29.015+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2023-07-14T13:36:10.876076+0000 front 2023-07-14T13:36:10.876012+0000 (oldest deadline 2023-07-14T13:36:36.176175+0000) 2023-07-14T13:37:29.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:29.015+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.17:6814 osd.3 since back 2023-07-14T13:36:16.176977+0000 front 2023-07-14T13:36:16.176955+0000 (oldest deadline 2023-07-14T13:36:41.476820+0000) 2023-07-14T13:37:29.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:29.015+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6812 osd.4 since back 2023-07-14T13:36:24.978226+0000 front 2023-07-14T13:36:24.978080+0000 (oldest deadline 2023-07-14T13:36:52.578542+0000) 2023-07-14T13:37:29.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:29.015+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2023-07-14T13:36:35.479471+0000 front 2023-07-14T13:36:35.479513+0000 (oldest deadline 2023-07-14T13:37:00.779776+0000) 2023-07-14T13:37:29.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:29.015+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.131:6820 osd.7 since back 2023-07-14T13:36:54.584112+0000 front 2023-07-14T13:36:54.584019+0000 (oldest deadline 2023-07-14T13:37:16.283811+0000) 2023-07-14T13:37:29.410 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:29 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11[119737]: 2023-07-14T13:37:29.015+0000 7f6da38b7700 -1 osd.11 149 heartbeat_check: no reply from 172.21.15.135:6820 osd.8 since back 2023-07-14T13:37:02.586220+0000 front 2023-07-14T13:37:02.586268+0000 (oldest deadline 2023-07-14T13:37:27.886212+0000) 2023-07-14T13:37:30.524 INFO:journalctl@ceph.osd.11.smithi135.stdout:Jul 14 13:37:30 smithi135 bash[137429]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-osd-11 2023-07-14T13:37:32.263 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@osd.11.service' 2023-07-14T13:37:32.351 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:37:32.352 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-07-14T13:37:32.352 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-07-14T13:37:32.353 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.a 2023-07-14T13:37:32.818 INFO:journalctl@ceph.mds.a.smithi017.stdout:Jul 14 13:37:32 smithi017 systemd[1]: Stopping Ceph mds.a for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:37:33.317 INFO:journalctl@ceph.mds.a.smithi017.stdout:Jul 14 13:37:32 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-a[129776]: 2023-07-14T13:37:32.870+0000 7ff88f18e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:37:33.317 INFO:journalctl@ceph.mds.a.smithi017.stdout:Jul 14 13:37:32 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-a[129776]: 2023-07-14T13:37:32.870+0000 7ff88f18e700 -1 mds.a *** got signal Terminated *** 2023-07-14T13:37:35.567 INFO:journalctl@ceph.mds.a.smithi017.stdout:Jul 14 13:37:35 smithi017 bash[203092]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-a 2023-07-14T13:37:35.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.a.service' 2023-07-14T13:37:35.794 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:37:35.795 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-07-14T13:37:35.795 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-07-14T13:37:35.796 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.d 2023-07-14T13:37:36.067 INFO:journalctl@ceph.mds.d.smithi017.stdout:Jul 14 13:37:35 smithi017 systemd[1]: Stopping Ceph mds.d for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:37:36.817 INFO:journalctl@ceph.mds.d.smithi017.stdout:Jul 14 13:37:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-d[128679]: 2023-07-14T13:37:36.336+0000 7fd9a4a43700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:37:36.818 INFO:journalctl@ceph.mds.d.smithi017.stdout:Jul 14 13:37:36 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-d[128679]: 2023-07-14T13:37:36.336+0000 7fd9a4a43700 -1 mds.d *** got signal Terminated *** 2023-07-14T13:37:40.817 INFO:journalctl@ceph.mds.d.smithi017.stdout:Jul 14 13:37:40 smithi017 bash[203237]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-d 2023-07-14T13:37:41.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.d.service' 2023-07-14T13:37:41.227 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:37:41.227 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-07-14T13:37:41.228 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-07-14T13:37:41.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.g 2023-07-14T13:37:41.567 INFO:journalctl@ceph.mds.g.smithi017.stdout:Jul 14 13:37:41 smithi017 systemd[1]: Stopping Ceph mds.g for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:37:42.067 INFO:journalctl@ceph.mds.g.smithi017.stdout:Jul 14 13:37:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-g[129352]: 2023-07-14T13:37:41.736+0000 7f84ddb9e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:37:42.067 INFO:journalctl@ceph.mds.g.smithi017.stdout:Jul 14 13:37:41 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-g[129352]: 2023-07-14T13:37:41.736+0000 7f84ddb9e700 -1 mds.g *** got signal Terminated *** 2023-07-14T13:37:44.000 INFO:journalctl@ceph.mds.g.smithi017.stdout:Jul 14 13:37:43 smithi017 bash[203377]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-g 2023-07-14T13:37:44.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.g.service' 2023-07-14T13:37:44.392 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:37:44.392 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-07-14T13:37:44.393 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-07-14T13:37:44.393 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.j 2023-07-14T13:37:44.567 INFO:journalctl@ceph.mds.j.smithi017.stdout:Jul 14 13:37:44 smithi017 systemd[1]: Stopping Ceph mds.j for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:37:45.317 INFO:journalctl@ceph.mds.j.smithi017.stdout:Jul 14 13:37:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-j[128291]: 2023-07-14T13:37:44.943+0000 7f30de9c5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:37:45.317 INFO:journalctl@ceph.mds.j.smithi017.stdout:Jul 14 13:37:44 smithi017 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-j[128291]: 2023-07-14T13:37:44.943+0000 7f30de9c5700 -1 mds.j *** got signal Terminated *** 2023-07-14T13:37:49.606 INFO:journalctl@ceph.mds.j.smithi017.stdout:Jul 14 13:37:49 smithi017 bash[203518]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-j 2023-07-14T13:37:49.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.j.service' 2023-07-14T13:37:50.025 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:37:50.026 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-07-14T13:37:50.026 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-07-14T13:37:50.027 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.b 2023-07-14T13:37:50.457 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 13:37:50 smithi131 systemd[1]: Stopping Ceph mds.b for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:37:50.957 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 13:37:50 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-b[122274]: 2023-07-14T13:37:50.537+0000 7f04275a7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:37:50.958 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 13:37:50 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-b[122274]: 2023-07-14T13:37:50.537+0000 7f04275a7700 -1 mds.b *** got signal Terminated *** 2023-07-14T13:37:56.524 INFO:journalctl@ceph.mds.b.smithi131.stdout:Jul 14 13:37:56 smithi131 bash[135380]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-b 2023-07-14T13:37:56.839 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.b.service' 2023-07-14T13:37:56.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:37:56.925 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-07-14T13:37:56.925 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-07-14T13:37:56.926 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.e 2023-07-14T13:37:57.207 INFO:journalctl@ceph.mds.e.smithi131.stdout:Jul 14 13:37:57 smithi131 systemd[1]: Stopping Ceph mds.e for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:37:57.707 INFO:journalctl@ceph.mds.e.smithi131.stdout:Jul 14 13:37:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-e[121587]: 2023-07-14T13:37:57.428+0000 7f0963cd5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:37:57.707 INFO:journalctl@ceph.mds.e.smithi131.stdout:Jul 14 13:37:57 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-e[121587]: 2023-07-14T13:37:57.428+0000 7f0963cd5700 -1 mds.e *** got signal Terminated *** 2023-07-14T13:38:00.495 INFO:journalctl@ceph.mds.e.smithi131.stdout:Jul 14 13:38:00 smithi131 bash[135524]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-e 2023-07-14T13:38:00.787 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.e.service' 2023-07-14T13:38:00.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:38:00.872 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-07-14T13:38:00.872 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-07-14T13:38:00.873 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.h 2023-07-14T13:38:01.207 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 13:38:01 smithi131 systemd[1]: Stopping Ceph mds.h for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:38:01.707 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 13:38:01 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-h[121932]: 2023-07-14T13:38:01.418+0000 7f7c6bf30700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:38:01.707 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 13:38:01 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-h[121932]: 2023-07-14T13:38:01.418+0000 7f7c6bf30700 -1 mds.h *** got signal Terminated *** 2023-07-14T13:38:05.207 INFO:journalctl@ceph.mds.h.smithi131.stdout:Jul 14 13:38:05 smithi131 bash[135665]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-h 2023-07-14T13:38:05.438 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.h.service' 2023-07-14T13:38:05.519 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:38:05.519 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-07-14T13:38:05.520 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-07-14T13:38:05.520 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.k 2023-07-14T13:38:05.707 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 13:38:05 smithi131 systemd[1]: Stopping Ceph mds.k for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:38:06.457 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 13:38:06 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-k[121248]: 2023-07-14T13:38:06.028+0000 7f42b75a4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:38:06.457 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 13:38:06 smithi131 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-k[121248]: 2023-07-14T13:38:06.028+0000 7f42b75a4700 -1 mds.k *** got signal Terminated *** 2023-07-14T13:38:10.549 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 13:38:10 smithi131 bash[135811]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-k 2023-07-14T13:38:10.785 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.k.service' 2023-07-14T13:38:10.844 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 13:38:10 smithi131 systemd[1]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.k.service: Succeeded. 2023-07-14T13:38:10.844 INFO:journalctl@ceph.mds.k.smithi131.stdout:Jul 14 13:38:10 smithi131 systemd[1]: Stopped Ceph mds.k for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T13:38:10.865 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:38:10.866 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-07-14T13:38:10.866 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-07-14T13:38:10.867 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.c 2023-07-14T13:38:11.382 INFO:journalctl@ceph.mds.c.smithi135.stdout:Jul 14 13:38:10 smithi135 systemd[1]: Stopping Ceph mds.c for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:38:11.658 INFO:journalctl@ceph.mds.c.smithi135.stdout:Jul 14 13:38:11 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-c[123342]: 2023-07-14T13:38:11.391+0000 7f413fb9e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:38:11.659 INFO:journalctl@ceph.mds.c.smithi135.stdout:Jul 14 13:38:11 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-c[123342]: 2023-07-14T13:38:11.391+0000 7f413fb9e700 -1 mds.c *** got signal Terminated *** 2023-07-14T13:38:14.658 INFO:journalctl@ceph.mds.c.smithi135.stdout:Jul 14 13:38:14 smithi135 bash[137700]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-c 2023-07-14T13:38:14.883 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.c.service' 2023-07-14T13:38:14.970 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:38:14.971 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-07-14T13:38:14.971 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-07-14T13:38:14.971 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.f 2023-07-14T13:38:15.158 INFO:journalctl@ceph.mds.f.smithi135.stdout:Jul 14 13:38:15 smithi135 systemd[1]: Stopping Ceph mds.f for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:38:15.908 INFO:journalctl@ceph.mds.f.smithi135.stdout:Jul 14 13:38:15 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-f[122996]: 2023-07-14T13:38:15.523+0000 7f5bf1b39700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:38:15.908 INFO:journalctl@ceph.mds.f.smithi135.stdout:Jul 14 13:38:15 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-f[122996]: 2023-07-14T13:38:15.523+0000 7f5bf1b39700 -1 mds.f *** got signal Terminated *** 2023-07-14T13:38:19.658 INFO:journalctl@ceph.mds.f.smithi135.stdout:Jul 14 13:38:19 smithi135 bash[137842]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-f 2023-07-14T13:38:19.771 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.f.service' 2023-07-14T13:38:19.854 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:38:19.854 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-07-14T13:38:19.855 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-07-14T13:38:19.855 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.i 2023-07-14T13:38:20.158 INFO:journalctl@ceph.mds.i.smithi135.stdout:Jul 14 13:38:19 smithi135 systemd[1]: Stopping Ceph mds.i for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:38:20.658 INFO:journalctl@ceph.mds.i.smithi135.stdout:Jul 14 13:38:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-i[123689]: 2023-07-14T13:38:20.356+0000 7f7f11344700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:38:20.659 INFO:journalctl@ceph.mds.i.smithi135.stdout:Jul 14 13:38:20 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-i[123689]: 2023-07-14T13:38:20.356+0000 7f7f11344700 -1 mds.i *** got signal Terminated *** 2023-07-14T13:38:26.139 INFO:journalctl@ceph.mds.i.smithi135.stdout:Jul 14 13:38:26 smithi135 bash[137988]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-i 2023-07-14T13:38:26.438 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.i.service' 2023-07-14T13:38:26.519 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:38:26.519 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-07-14T13:38:26.519 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-07-14T13:38:26.520 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.l 2023-07-14T13:38:26.908 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 13:38:26 smithi135 systemd[1]: Stopping Ceph mds.l for b31a3268-2244-11ee-9b33-001a4aab830c... 2023-07-14T13:38:27.408 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 13:38:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-l[122648]: 2023-07-14T13:38:27.037+0000 7f05ad2e1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T13:38:27.408 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 13:38:27 smithi135 ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-l[122648]: 2023-07-14T13:38:27.037+0000 7f05ad2e1700 -1 mds.l *** got signal Terminated *** 2023-07-14T13:38:31.556 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 13:38:31 smithi135 bash[138127]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c-mds-l 2023-07-14T13:38:31.751 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.l.service' 2023-07-14T13:38:31.811 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 13:38:31 smithi135 systemd[1]: ceph-b31a3268-2244-11ee-9b33-001a4aab830c@mds.l.service: Succeeded. 2023-07-14T13:38:31.811 INFO:journalctl@ceph.mds.l.smithi135.stdout:Jul 14 13:38:31 smithi135 systemd[1]: Stopped Ceph mds.l for b31a3268-2244-11ee-9b33-001a4aab830c. 2023-07-14T13:38:31.832 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T13:38:31.832 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-07-14T13:38:31.833 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b31a3268-2244-11ee-9b33-001a4aab830c --force --keep-logs 2023-07-14T13:38:35.746 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b31a3268-2244-11ee-9b33-001a4aab830c --force --keep-logs 2023-07-14T13:38:39.488 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b31a3268-2244-11ee-9b33-001a4aab830c --force --keep-logs 2023-07-14T13:38:43.096 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T13:38:43.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T13:38:43.256 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T13:38:43.327 INFO:tasks.cephadm:Archiving crash dumps... 2023-07-14T13:38:43.329 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451/remote/smithi017/crash 2023-07-14T13:38:43.330 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/crash -- . 2023-07-14T13:38:43.454 INFO:teuthology.orchestra.run.smithi017.stderr:tar: /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-14T13:38:43.455 INFO:teuthology.orchestra.run.smithi017.stderr:tar: Error is not recoverable: exiting now 2023-07-14T13:38:43.458 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451/remote/smithi131/crash 2023-07-14T13:38:43.459 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/crash -- . 2023-07-14T13:38:43.622 INFO:teuthology.orchestra.run.smithi131.stderr:tar: /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-14T13:38:43.622 INFO:teuthology.orchestra.run.smithi131.stderr:tar: Error is not recoverable: exiting now 2023-07-14T13:38:43.625 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451/remote/smithi135/crash 2023-07-14T13:38:43.626 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/crash -- . 2023-07-14T13:38:43.715 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-14T13:38:43.715 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2023-07-14T13:38:43.717 INFO:tasks.cephadm:Checking cluster log for badness... 2023-07-14T13:38:43.718 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-07-14T13:38:43.799 INFO:teuthology.orchestra.run.smithi017.stderr:grep: /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph.log: No such file or directory 2023-07-14T13:38:43.804 INFO:tasks.cephadm:Compressing logs... 2023-07-14T13:38:43.804 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T13:38:43.809 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T13:38:43.813 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T13:38:43.884 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2023-07-14T13:38:43.884 INFO:teuthology.orchestra.run.smithi017.stderr:-5 --verbose -- /var/log/ceph/cephadm.log 2023-07-14T13:38:43.889 INFO:teuthology.orchestra.run.smithi131.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-14T13:38:43.890 INFO:teuthology.orchestra.run.smithi131.stderr:: No such file or directory 2023-07-14T13:38:43.892 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.0.log 2023-07-14T13:38:43.893 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.g.log 2023-07-14T13:38:43.894 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.a.log 2023-07-14T13:38:43.895 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-07-14T13:38:43.895 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-14T13:38:43.895 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.10.log 2023-07-14T13:38:43.896 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.6.log 2023-07-14T13:38:43.897 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.3.log 2023-07-14T13:38:43.897 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.h.log 2023-07-14T13:38:43.897 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.e.log 2023-07-14T13:38:43.898 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.d.log 2023-07-14T13:38:43.898 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.4.log 2023-07-14T13:38:43.899 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mgr.x.log 2023-07-14T13:38:43.899 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.1.log 2023-07-14T13:38:43.900 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.9.log 2023-07-14T13:38:43.901 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.k.log 2023-07-14T13:38:43.901 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-volume.log 2023-07-14T13:38:43.901 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-volume.log 2023-07-14T13:38:43.902 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.7.log 2023-07-14T13:38:43.902 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.9.log: 94.5% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.g.log.gz 2023-07-14T13:38:43.903 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.j.log 2023-07-14T13:38:43.903 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mon.b.log 2023-07-14T13:38:43.904 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mon.a.log 2023-07-14T13:38:43.904 INFO:teuthology.orchestra.run.smithi017.stderr: 94.5% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.a.log.gz 2023-07-14T13:38:43.905 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.b.log 2023-07-14T13:38:43.905 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2023-07-14T13:38:43.905 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mgr.y.log 2023-07-14T13:38:43.909 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mon.a.log: /var/log/ceph/ceph-client.0.log: 94.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.d.log.gz 2023-07-14T13:38:43.909 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.b.log: /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mgr.y.log: 94.3% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.k.log.gz 2023-07-14T13:38:43.912 INFO:teuthology.orchestra.run.smithi017.stderr: 94.5% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.j.log.gz 2023-07-14T13:38:43.917 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mgr.y.log.gz 2023-07-14T13:38:43.921 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.5.log 2023-07-14T13:38:43.921 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.2.log 2023-07-14T13:38:43.922 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.11.log 2023-07-14T13:38:43.923 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mgr.z.log 2023-07-14T13:38:43.924 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.8.log 2023-07-14T13:38:43.925 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.f.log 2023-07-14T13:38:43.926 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.c.log 2023-07-14T13:38:43.927 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.i.log 2023-07-14T13:38:43.928 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mon.c.log 2023-07-14T13:38:43.929 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-volume.log 2023-07-14T13:38:43.930 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.l.log 2023-07-14T13:38:43.935 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-volume.log: /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.l.log: 93.0% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mgr.z.log.gz 2023-07-14T13:38:43.939 INFO:teuthology.orchestra.run.smithi135.stderr: 94.5% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.l.log.gz 2023-07-14T13:38:44.099 INFO:teuthology.orchestra.run.smithi135.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-14T13:38:44.123 INFO:teuthology.orchestra.run.smithi017.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-14T13:38:44.170 INFO:teuthology.orchestra.run.smithi135.stderr: 91.5% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-volume.log.gz 2023-07-14T13:38:44.187 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-14T13:38:44.285 INFO:teuthology.orchestra.run.smithi017.stderr: 91.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-volume.log.gz 2023-07-14T13:38:44.918 INFO:teuthology.orchestra.run.smithi131.stderr: 91.5% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-volume.log.gz 2023-07-14T13:38:46.673 INFO:teuthology.orchestra.run.smithi017.stderr: 89.7% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mgr.x.log.gz 2023-07-14T13:38:46.713 INFO:teuthology.orchestra.run.smithi135.stderr: 91.9% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mon.c.log.gz 2023-07-14T13:38:48.068 INFO:teuthology.orchestra.run.smithi135.stderr: 94.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.f.log.gz 2023-07-14T13:38:48.079 INFO:teuthology.orchestra.run.smithi135.stderr: 94.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.c.log.gz 2023-07-14T13:38:49.657 INFO:teuthology.orchestra.run.smithi131.stderr: 94.7% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.e.log.gz 2023-07-14T13:38:49.823 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mon.b.log.gz 2023-07-14T13:38:52.432 INFO:teuthology.orchestra.run.smithi017.stderr: 90.3% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mon.a.log.gz 2023-07-14T13:42:41.681 INFO:teuthology.orchestra.run.smithi135.stderr: 96.8% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.i.log.gz 2023-07-14T13:43:18.869 INFO:teuthology.orchestra.run.smithi135.stderr: 91.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.8.log.gz 2023-07-14T13:43:19.844 INFO:teuthology.orchestra.run.smithi135.stderr: 91.7% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.2.log.gz 2023-07-14T13:43:19.861 INFO:teuthology.orchestra.run.smithi017.stderr: 91.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.6.log.gz 2023-07-14T13:43:27.445 INFO:teuthology.orchestra.run.smithi017.stderr: 91.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.9.log.gz 2023-07-14T13:43:48.708 INFO:teuthology.orchestra.run.smithi135.stderr: 91.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.11.log.gz 2023-07-14T13:43:49.120 INFO:teuthology.orchestra.run.smithi017.stderr: 91.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.0.log.gz 2023-07-14T13:44:08.138 INFO:teuthology.orchestra.run.smithi135.stderr: 91.7% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.5.log.gz 2023-07-14T13:44:08.141 INFO:teuthology.orchestra.run.smithi135.stderr: 2023-07-14T13:44:08.142 INFO:teuthology.orchestra.run.smithi135.stderr:real 5m24.293s 2023-07-14T13:44:08.142 INFO:teuthology.orchestra.run.smithi135.stderr:user 7m12.653s 2023-07-14T13:44:08.142 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m58.949s 2023-07-14T13:44:12.464 INFO:teuthology.orchestra.run.smithi017.stderr: 91.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.3.log.gz 2023-07-14T13:44:52.979 INFO:teuthology.orchestra.run.smithi131.stderr: 96.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.h.log.gz 2023-07-14T13:45:09.615 INFO:teuthology.orchestra.run.smithi131.stderr: 92.0% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.4.log.gz 2023-07-14T13:45:16.191 INFO:teuthology.orchestra.run.smithi131.stderr: 91.7% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.10.log.gz 2023-07-14T13:45:28.842 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.7.log.gz 2023-07-14T13:45:48.859 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-osd.1.log.gz 2023-07-14T13:45:50.544 INFO:teuthology.orchestra.run.smithi017.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2023-07-14T13:45:50.548 INFO:teuthology.orchestra.run.smithi017.stderr: 2023-07-14T13:45:50.549 INFO:teuthology.orchestra.run.smithi017.stderr:real 7m6.708s 2023-07-14T13:45:50.549 INFO:teuthology.orchestra.run.smithi017.stderr:user 9m16.128s 2023-07-14T13:45:50.549 INFO:teuthology.orchestra.run.smithi017.stderr:sys 1m20.450s 2023-07-14T13:46:23.263 INFO:teuthology.orchestra.run.smithi131.stderr: 97.5% -- replaced with /var/log/ceph/b31a3268-2244-11ee-9b33-001a4aab830c/ceph-mds.b.log.gz 2023-07-14T13:46:23.269 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-07-14T13:46:23.269 INFO:teuthology.orchestra.run.smithi131.stderr:real 7m39.423s 2023-07-14T13:46:23.270 INFO:teuthology.orchestra.run.smithi131.stderr:user 9m11.832s 2023-07-14T13:46:23.270 INFO:teuthology.orchestra.run.smithi131.stderr:sys 1m23.206s 2023-07-14T13:46:23.270 INFO:tasks.cephadm:Archiving logs... 2023-07-14T13:46:23.271 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451/remote/smithi017/log 2023-07-14T13:46:23.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T13:47:32.272 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451/remote/smithi131/log 2023-07-14T13:47:32.273 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T13:48:38.350 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451/remote/smithi135/log 2023-07-14T13:48:38.351 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T13:49:36.198 INFO:tasks.cephadm:Removing cluster... 2023-07-14T13:49:36.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b31a3268-2244-11ee-9b33-001a4aab830c --force 2023-07-14T13:49:38.959 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b31a3268-2244-11ee-9b33-001a4aab830c --force 2023-07-14T13:49:41.924 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b31a3268-2244-11ee-9b33-001a4aab830c --force 2023-07-14T13:49:44.933 INFO:tasks.cephadm:Removing cephadm ... 2023-07-14T13:49:44.933 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-14T13:49:44.979 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-14T13:49:45.029 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-14T13:49:45.073 INFO:tasks.cephadm:Teardown complete 2023-07-14T13:49:45.074 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-14T13:49:45.086 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fc0089cc1082313a98853d48b892acdc1385b8b/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-07-14T13:49:45.087 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-14T13:49:45.088 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T13:49:45.092 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T13:49:45.097 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T13:49:45.289 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-14T13:49:45.304 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-14T13:49:45.305 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T13:49:45.310 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T13:49:45.315 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T13:49:45.347 INFO:teuthology.orchestra.run.smithi017.stderr:bash: ntpq: command not found 2023-07-14T13:49:45.352 INFO:teuthology.orchestra.run.smithi131.stderr:bash: ntpq: command not found 2023-07-14T13:49:45.356 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2023-07-14T13:49:45.379 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T13:49:45.379 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2023-07-14T13:49:45.380 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 16 +1671us[+1671us] +/- 81ms 2023-07-14T13:49:45.380 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv02.front.sepia.ceph.com 3 6 377 18 -834us[ -839us] +/- 70ms 2023-07-14T13:49:45.380 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 -471us[ -476us] +/- 69ms 2023-07-14T13:49:45.380 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T13:49:45.381 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T13:49:45.382 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2023-07-14T13:49:45.382 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 18 +1652us[+1652us] +/- 81ms 2023-07-14T13:49:45.382 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv02.front.sepia.ceph.com 3 6 377 21 -845us[ -797us] +/- 70ms 2023-07-14T13:49:45.382 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -499us[ -451us] +/- 69ms 2023-07-14T13:49:45.382 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T13:49:45.396 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T13:49:45.396 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2023-07-14T13:49:45.396 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 16 +1631us[+1631us] +/- 81ms 2023-07-14T13:49:45.400 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv02.front.sepia.ceph.com 3 6 377 16 -859us[ -783us] +/- 70ms 2023-07-14T13:49:45.401 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -509us[ -432us] +/- 69ms 2023-07-14T13:49:45.401 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T13:49:45.402 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-14T13:49:45.416 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-14T13:49:45.418 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-14T13:49:45.434 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-14T13:49:45.692 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-14T13:49:45.936 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-14T13:49:46.275 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T13:49:46.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T13:49:46.352 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T13:49:46.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T13:49:46.429 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T13:49:46.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T13:49:46.505 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-14T13:49:46.517 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-14T13:49:46.536 INFO:teuthology.task.internal:Duration was 4928.910233 seconds 2023-07-14T13:49:46.537 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-14T13:49:46.549 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-14T13:49:46.549 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T13:49:46.555 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T13:49:46.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T13:49:46.697 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T13:49:46.710 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T13:49:46.733 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T13:49:47.231 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-14T13:49:47.231 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2023-07-14T13:49:47.232 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T13:49:47.316 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2023-07-14T13:49:47.317 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T13:49:47.383 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2023-07-14T13:49:47.384 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T13:49:47.457 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-14T13:49:47.457 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T13:49:47.461 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T13:49:47.466 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T13:49:47.612 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-14T13:49:47.613 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T13:49:47.619 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T13:49:47.624 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T13:49:47.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-14T13:49:47.817 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-14T13:49:47.817 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T13:49:47.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T13:49:47.962 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T13:49:48.033 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-14T13:49:48.045 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T13:49:48.050 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T13:49:48.054 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T13:49:48.127 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2023-07-14T13:49:48.127 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2023-07-14T13:49:48.132 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2023-07-14T13:49:48.173 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T13:49:48.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T13:49:48.215 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T13:49:48.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T13:49:48.257 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T13:49:48.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T13:49:48.305 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-14T13:49:48.320 INFO:teuthology.task.internal:Transferring archived files... 2023-07-14T13:49:48.321 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451/remote/smithi017 2023-07-14T13:49:48.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T13:49:48.403 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451/remote/smithi131 2023-07-14T13:49:48.404 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T13:49:48.484 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451/remote/smithi135 2023-07-14T13:49:48.484 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T13:49:48.565 INFO:teuthology.task.internal:Removing archive directory... 2023-07-14T13:49:48.565 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T13:49:48.570 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T13:49:48.577 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T13:49:48.621 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-14T13:49:48.643 INFO:teuthology.task.internal:Not uploading archives. 2023-07-14T13:49:48.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-14T13:49:48.658 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-14T13:49:48.658 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T13:49:48.663 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T13:49:48.668 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T13:49:48.702 INFO:teuthology.orchestra.run.smithi017.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 13:49 /home/ubuntu/cephtest 2023-07-14T13:49:48.707 INFO:teuthology.orchestra.run.smithi131.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 13:49 /home/ubuntu/cephtest 2023-07-14T13:49:48.711 INFO:teuthology.orchestra.run.smithi135.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 13:49 /home/ubuntu/cephtest 2023-07-14T13:49:48.715 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-14T13:49:48.727 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-14T13:49:48.741 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-07-14T13:49:48.742 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T13:49:48.773 DEBUG:teuthology.nuke:shortname: smithi017 2023-07-14T13:49:48.773 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T13:49:48.804 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 12:06:56.489207', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T13:49:48.805 DEBUG:teuthology.nuke:shortname: smithi131 2023-07-14T13:49:48.806 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T13:49:48.832 DEBUG:teuthology.nuke:shortname: smithi135 2023-07-14T13:49:48.833 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T13:49:48.837 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 12:06:56.490547', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T13:49:48.867 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-14_10:26:42-fs-wip-rishabh-2023Jul13-testing-default-smithi/7337451', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 12:06:56.486966', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T13:49:48.875 INFO:teuthology.orchestra.console:Power off smithi017 2023-07-14T13:49:48.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T13:49:48.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:49:48.922 INFO:teuthology.orchestra.console:Power off smithi131 2023-07-14T13:49:48.922 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T13:49:48.943 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:49:48.970 INFO:teuthology.orchestra.console:Power off smithi135 2023-07-14T13:49:48.971 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T13:49:48.994 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:49:52.939 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:49:52.983 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:49:53.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:49:57.052 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:49:57.094 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:49:57.134 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T13:49:57.265 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2023-07-14T13:49:57.307 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2023-07-14T13:49:57.345 INFO:teuthology.orchestra.console:Power off for smithi135 completed 2023-07-14T13:49:57.455 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} duration: 4928.910232543945 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default mon.a-kernel-sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 mon.b-kernel-sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 mon.c-kernel-sha1: a440c79eee0258ae07e4988d8690fe6187b8b7a3 owner: scheduled_rishabh@teuthology status: fail success: false 2023-07-14T13:49:57.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T13:49:57.555 INFO:teuthology.run:FAIL